2024-09-12T01:45:34.077 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T01:45:34.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:45:34.192 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901578 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/damage} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901578' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - bad backtrace - object missing on disk - error reading table object - error reading sessionmap - Error loading MDS rank - missing journal object - Error recovering journal - error decoding table object - failed to read JournalPointer - Corrupt directory entry - Corrupt fnode header - corrupt sessionmap header - Corrupt dentry - Scrub error on inode - Metadata damage detected - MDS_READ_ONLY - force file system read-only - with standby daemon mds - MDS abort because newly corrupt dentry sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi019.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKBgbC6RWlU9gw1fkiz5jySBjndK3x5TCMMfSvWR68KjqtkpNkLG4Tv5ICw31MSxpCOhzHAvzDkr5v30jKndt4w= smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN+eBp5rhD9WVj6KM84HqIXH1DghElpNar3462lSZ1dSWAm4Y1nFaegYwH/qlShsL7hNZxaFQwjudt/LnmAZR3A= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_damage teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T01:45:34.193 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T01:45:34.193 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T01:45:34.194 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T01:45:34.195 INFO:teuthology.task.internal:Checking packages... 2024-09-12T01:45:34.215 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T01:45:34.215 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T01:45:34.215 INFO:teuthology.packaging:ref: None 2024-09-12T01:45:34.216 INFO:teuthology.packaging:tag: None 2024-09-12T01:45:34.216 INFO:teuthology.packaging:branch: squid 2024-09-12T01:45:34.216 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:45:34.216 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T01:45:34.466 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T01:45:34.467 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T01:45:34.474 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T01:45:34.474 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T01:45:34.515 INFO:teuthology.task.internal:Saving configuration 2024-09-12T01:45:34.533 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T01:45:34.540 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T01:45:34.572 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901578', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:40:44.421846', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKBgbC6RWlU9gw1fkiz5jySBjndK3x5TCMMfSvWR68KjqtkpNkLG4Tv5ICw31MSxpCOhzHAvzDkr5v30jKndt4w='} 2024-09-12T01:45:34.602 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901578', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:40:44.420040', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN+eBp5rhD9WVj6KM84HqIXH1DghElpNar3462lSZ1dSWAm4Y1nFaegYwH/qlShsL7hNZxaFQwjudt/LnmAZR3A='} 2024-09-12T01:45:34.602 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T01:45:34.608 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-12T01:45:34.608 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-12T01:45:34.608 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T01:45:34.702 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc37ef33be0>, signals=[15]) 2024-09-12T01:45:34.702 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T01:45:34.708 INFO:teuthology.task.internal:Opening connections... 2024-09-12T01:45:34.708 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:45:34.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:45:34.793 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T01:45:34.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:45:34.878 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T01:45:34.885 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2024-09-12T01:45:34.903 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2024-09-12T01:45:34.904 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-09-12T01:45:34.962 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2024-09-12T01:45:34.962 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2024-09-12T01:45:34.962 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2024-09-12T01:45:34.962 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:45:34.962 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2024-09-12T01:45:34.962 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:45:34.962 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:45:34.963 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2024-09-12T01:45:34.963 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:45:34.963 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:45:34.963 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:45:34.963 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:45:34.963 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:45:34.963 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:45:34.964 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-09-12T01:45:34.990 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-09-12T01:45:35.007 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-09-12T01:45:35.008 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-09-12T01:45:35.066 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-09-12T01:45:35.066 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-09-12T01:45:35.066 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-09-12T01:45:35.066 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:45:35.066 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-09-12T01:45:35.066 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:45:35.066 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:45:35.066 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-09-12T01:45:35.067 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:45:35.067 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:45:35.067 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:45:35.067 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:45:35.067 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:45:35.067 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:45:35.067 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-09-12T01:45:35.098 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T01:45:35.108 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T01:45:35.123 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T01:45:35.124 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:45:35.126 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:45:35.143 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T01:45:35.148 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T01:45:35.148 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:45:35.184 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:45:35.288 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T01:45:35.358 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T01:45:35.372 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T01:45:35.372 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-12T01:45:35.372 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-12T01:45:35.373 DEBUG:teuthology.orchestra.run.smithi019:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:45:35.373 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:45:35.390 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:45:35.390 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-09-12T01:45:35.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:45:35.391 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-09-12T01:45:35.447 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-503.el9.x86_64 2024-09-12T01:45:35.447 INFO:teuthology.task.kernel:Running kernel on smithi019: 5.14.0-503.el9.x86_64 2024-09-12T01:45:35.447 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum install -y kernel 2024-09-12T01:45:35.449 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-503.el9.x86_64 2024-09-12T01:45:35.449 INFO:teuthology.task.kernel:Running kernel on smithi135: 5.14.0-503.el9.x86_64 2024-09-12T01:45:35.449 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum install -y kernel 2024-09-12T01:45:39.252 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.2 MB 00:01 2024-09-12T01:45:39.341 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.2 MB 00:02 2024-09-12T01:45:44.670 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 4.8 MB/s | 20 MB 00:04 2024-09-12T01:45:49.404 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 7.2 MB/s | 6.5 MB 00:00 2024-09-12T01:45:50.091 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 2.1 MB/s | 20 MB 00:09 2024-09-12T01:45:50.838 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 19 kB 00:00 2024-09-12T01:45:51.743 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T01:45:54.450 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-12T01:45:55.909 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 19 kB 00:00 2024-09-12T01:45:56.813 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T01:45:57.259 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-12T01:45:59.308 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T01:45:59.308 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T01:45:59.409 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-12T01:45:59.415 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-12T01:45:59.415 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-09-12T01:45:59.415 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-12T01:45:59.415 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-12T01:45:59.416 INFO:teuthology.orchestra.run.smithi135.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T01:45:59.416 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-09-12T01:45:59.416 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T01:45:59.416 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T01:45:59.416 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T01:45:59.416 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:45:59.416 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-12T01:45:59.416 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-12T01:45:59.416 INFO:teuthology.orchestra.run.smithi135.stdout:Install 4 Packages 2024-09-12T01:45:59.416 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:45:59.417 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 79 M 2024-09-12T01:45:59.417 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 126 M 2024-09-12T01:45:59.417 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-12T01:45:59.527 INFO:teuthology.orchestra.run.smithi135.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 257 kB/s | 23 kB 00:00 2024-09-12T01:45:59.886 INFO:teuthology.orchestra.run.smithi135.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-12T01:46:00.311 INFO:teuthology.orchestra.run.smithi135.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 40 MB/s | 35 MB 00:00 2024-09-12T01:46:00.703 INFO:teuthology.orchestra.run.smithi135.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 24 MB/s | 29 MB 00:01 2024-09-12T01:46:00.703 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:46:00.703 INFO:teuthology.orchestra.run.smithi135.stdout:Total 61 MB/s | 79 MB 00:01 2024-09-12T01:46:01.392 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-12T01:46:01.769 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-12T01:46:01.769 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-12T01:46:02.461 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T01:46:02.736 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-12T01:46:02.736 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-12T01:46:04.551 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T01:46:04.551 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T01:46:04.646 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-09-12T01:46:04.661 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-12T01:46:04.661 INFO:teuthology.orchestra.run.smithi019.stdout: Package Architecture Version Repository Size 2024-09-12T01:46:04.661 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-12T01:46:04.661 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-09-12T01:46:04.662 INFO:teuthology.orchestra.run.smithi019.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T01:46:04.662 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-09-12T01:46:04.662 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T01:46:04.662 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T01:46:04.662 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T01:46:04.662 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:46:04.662 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-09-12T01:46:04.662 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-12T01:46:04.662 INFO:teuthology.orchestra.run.smithi019.stdout:Install 4 Packages 2024-09-12T01:46:04.662 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:46:04.663 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 79 M 2024-09-12T01:46:04.663 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 126 M 2024-09-12T01:46:04.663 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-09-12T01:46:05.063 INFO:teuthology.orchestra.run.smithi019.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 76 kB/s | 23 kB 00:00 2024-09-12T01:46:05.193 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-12T01:46:05.898 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:46:05.977 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:46:08.776 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:46:08.912 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:46:13.847 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:46:13.878 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:46:17.362 INFO:teuthology.orchestra.run.smithi019.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 2.7 MB/s | 35 MB 00:12 2024-09-12T01:46:18.701 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:46:20.303 INFO:teuthology.orchestra.run.smithi019.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 1.0 MB/s | 16 MB 00:15 2024-09-12T01:46:38.569 INFO:teuthology.orchestra.run.smithi019.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 873 kB/s | 29 MB 00:33 2024-09-12T01:46:38.569 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:46:38.569 INFO:teuthology.orchestra.run.smithi019.stdout:Total 2.3 MB/s | 79 MB 00:33 2024-09-12T01:46:39.277 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-09-12T01:46:39.647 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-09-12T01:46:39.647 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-09-12T01:46:40.654 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-09-12T01:46:40.655 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-09-12T01:46:43.232 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-09-12T01:46:43.896 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:46:43.978 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:46:46.769 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:46:46.897 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:46:52.021 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:46:52.065 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:46:57.203 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:46:57.358 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:46:57.398 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:46:57.687 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:46:57.687 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:46:57.687 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:46:57.687 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:46:58.504 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:46:58.505 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:46:58.505 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-12T01:46:58.505 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T01:46:58.505 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T01:46:58.505 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T01:46:58.505 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T01:46:58.505 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:46:58.505 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-12T01:46:58.881 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:46:58.969 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:46:58.969 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:46:58.970 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T01:46:58.970 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T01:46:58.970 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T01:46:58.970 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-12T01:46:58.970 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi135.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T01:46:58.970 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:46:59.029 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:46:59.029 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:46:59.030 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -qi grub2-tools 2024-09-12T01:46:59.067 INFO:teuthology.orchestra.run.smithi135.stdout:Name : grub2-tools 2024-09-12T01:46:59.067 INFO:teuthology.orchestra.run.smithi135.stdout:Epoch : 1 2024-09-12T01:46:59.067 INFO:teuthology.orchestra.run.smithi135.stdout:Version : 2.06 2024-09-12T01:46:59.067 INFO:teuthology.orchestra.run.smithi135.stdout:Release : 82.el9 2024-09-12T01:46:59.067 INFO:teuthology.orchestra.run.smithi135.stdout:Architecture: x86_64 2024-09-12T01:46:59.068 INFO:teuthology.orchestra.run.smithi135.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T01:46:59.068 INFO:teuthology.orchestra.run.smithi135.stdout:Group : Unspecified 2024-09-12T01:46:59.068 INFO:teuthology.orchestra.run.smithi135.stdout:Size : 8274670 2024-09-12T01:46:59.068 INFO:teuthology.orchestra.run.smithi135.stdout:License : GPLv3+ 2024-09-12T01:46:59.068 INFO:teuthology.orchestra.run.smithi135.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T01:46:59.068 INFO:teuthology.orchestra.run.smithi135.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T01:46:59.068 INFO:teuthology.orchestra.run.smithi135.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T01:46:59.068 INFO:teuthology.orchestra.run.smithi135.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T01:46:59.068 INFO:teuthology.orchestra.run.smithi135.stdout:Packager : builder@centos.org 2024-09-12T01:46:59.068 INFO:teuthology.orchestra.run.smithi135.stdout:Vendor : CentOS 2024-09-12T01:46:59.068 INFO:teuthology.orchestra.run.smithi135.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T01:46:59.068 INFO:teuthology.orchestra.run.smithi135.stdout:Summary : Support tools for GRUB. 2024-09-12T01:46:59.069 INFO:teuthology.orchestra.run.smithi135.stdout:Description : 2024-09-12T01:46:59.069 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:46:59.069 INFO:teuthology.orchestra.run.smithi135.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T01:46:59.069 INFO:teuthology.orchestra.run.smithi135.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T01:46:59.069 INFO:teuthology.orchestra.run.smithi135.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T01:46:59.069 INFO:teuthology.orchestra.run.smithi135.stdout:hardware devices. 2024-09-12T01:46:59.069 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:46:59.069 INFO:teuthology.orchestra.run.smithi135.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T01:46:59.070 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T01:46:59.070 INFO:teuthology.task.kernel:Updating grub on smithi135 to boot 5.14.0-505.el9.x86_64 2024-09-12T01:46:59.070 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T01:46:59.767 INFO:teuthology.orchestra.run.smithi135.stderr:Generating grub configuration file ... 2024-09-12T01:47:01.177 INFO:teuthology.orchestra.run.smithi135.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T01:47:01.206 INFO:teuthology.orchestra.run.smithi135.stderr:done 2024-09-12T01:47:01.208 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-09-12T01:47:01.264 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.nMNjk6OZqH 2024-09-12T01:47:01.264 DEBUG:teuthology.orchestra.run.smithi135:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nMNjk6OZqH 2024-09-12T01:47:01.331 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.nMNjk6OZqH 2024-09-12T01:47:01.470 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.nMNjk6OZqH is 6KB 2024-09-12T01:47:01.518 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.nMNjk6OZqH 2024-09-12T01:47:01.533 DEBUG:teuthology.orchestra.run.smithi135:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T01:47:01.596 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T01:47:01.597 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T01:47:01.597 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T01:47:01.597 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T01:47:01.598 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T01:47:01.736 DEBUG:teuthology.orchestra.run.smithi135:> sudo shutdown -r now 2024-09-12T01:47:31.738 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-12T01:47:31.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-12T01:47:31.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:47:36.282 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:47:36.322 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:47:36.643 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:47:36.643 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:47:36.643 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:47:36.644 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:47:37.469 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:47:37.470 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:47:37.470 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-09-12T01:47:37.470 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T01:47:37.470 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T01:47:37.470 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T01:47:37.470 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T01:47:37.470 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:47:37.470 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-09-12T01:47:37.820 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:47:37.908 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:47:37.908 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:47:37.909 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T01:47:37.909 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T01:47:37.909 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T01:47:37.909 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-12T01:47:37.909 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi019.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T01:47:37.909 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:47:37.968 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:47:37.968 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:47:37.968 DEBUG:teuthology.orchestra.run.smithi019:> sudo rpm -qi grub2-tools 2024-09-12T01:47:38.009 INFO:teuthology.orchestra.run.smithi019.stdout:Name : grub2-tools 2024-09-12T01:47:38.009 INFO:teuthology.orchestra.run.smithi019.stdout:Epoch : 1 2024-09-12T01:47:38.009 INFO:teuthology.orchestra.run.smithi019.stdout:Version : 2.06 2024-09-12T01:47:38.009 INFO:teuthology.orchestra.run.smithi019.stdout:Release : 82.el9 2024-09-12T01:47:38.009 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: x86_64 2024-09-12T01:47:38.009 INFO:teuthology.orchestra.run.smithi019.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T01:47:38.009 INFO:teuthology.orchestra.run.smithi019.stdout:Group : Unspecified 2024-09-12T01:47:38.009 INFO:teuthology.orchestra.run.smithi019.stdout:Size : 8274670 2024-09-12T01:47:38.010 INFO:teuthology.orchestra.run.smithi019.stdout:License : GPLv3+ 2024-09-12T01:47:38.010 INFO:teuthology.orchestra.run.smithi019.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T01:47:38.010 INFO:teuthology.orchestra.run.smithi019.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T01:47:38.010 INFO:teuthology.orchestra.run.smithi019.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T01:47:38.010 INFO:teuthology.orchestra.run.smithi019.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T01:47:38.010 INFO:teuthology.orchestra.run.smithi019.stdout:Packager : builder@centos.org 2024-09-12T01:47:38.010 INFO:teuthology.orchestra.run.smithi019.stdout:Vendor : CentOS 2024-09-12T01:47:38.010 INFO:teuthology.orchestra.run.smithi019.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T01:47:38.010 INFO:teuthology.orchestra.run.smithi019.stdout:Summary : Support tools for GRUB. 2024-09-12T01:47:38.010 INFO:teuthology.orchestra.run.smithi019.stdout:Description : 2024-09-12T01:47:38.010 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:47:38.010 INFO:teuthology.orchestra.run.smithi019.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T01:47:38.010 INFO:teuthology.orchestra.run.smithi019.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T01:47:38.011 INFO:teuthology.orchestra.run.smithi019.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T01:47:38.011 INFO:teuthology.orchestra.run.smithi019.stdout:hardware devices. 2024-09-12T01:47:38.011 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:47:38.011 INFO:teuthology.orchestra.run.smithi019.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T01:47:38.012 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T01:47:38.012 INFO:teuthology.task.kernel:Updating grub on smithi019 to boot 5.14.0-505.el9.x86_64 2024-09-12T01:47:38.012 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T01:47:38.722 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2024-09-12T01:47:40.070 INFO:teuthology.orchestra.run.smithi019.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T01:47:40.111 INFO:teuthology.orchestra.run.smithi019.stderr:done 2024-09-12T01:47:40.113 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-12T01:47:40.127 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.wssVxMfuIj 2024-09-12T01:47:40.128 DEBUG:teuthology.orchestra.run.smithi019:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wssVxMfuIj 2024-09-12T01:47:40.193 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.wssVxMfuIj 2024-09-12T01:47:40.341 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.wssVxMfuIj is 6KB 2024-09-12T01:47:40.361 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.wssVxMfuIj 2024-09-12T01:47:40.375 DEBUG:teuthology.orchestra.run.smithi019:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T01:47:40.448 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T01:47:40.448 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T01:47:40.448 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T01:47:40.448 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T01:47:40.449 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T01:47:40.601 DEBUG:teuthology.orchestra.run.smithi019:> sudo shutdown -r now 2024-09-12T01:47:50.205 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-09-12T01:47:59.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-12T01:47:59.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:48:02.305 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-09-12T01:48:10.609 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T01:48:10.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T01:48:10.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:48:14.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-12T01:48:14.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:48:46.126 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-09-12T01:48:46.755 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-12T01:48:46.755 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-505.el9.x86_64"... 2024-09-12T01:48:46.755 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-09-12T01:48:46.803 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-505.el9.x86_64 2024-09-12T01:48:46.803 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T01:48:46.803 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T01:48:46.803 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T01:48:47.804 DEBUG:teuthology.parallel:result is None 2024-09-12T01:49:10.621 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T01:49:19.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T01:49:19.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:49:20.942 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-09-12T01:49:21.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T01:49:21.423 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-12T01:49:21.423 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-09-12T01:49:21.439 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-505.el9.x86_64 2024-09-12T01:49:21.439 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T01:49:21.439 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T01:49:21.440 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T01:49:22.441 DEBUG:teuthology.parallel:result is None 2024-09-12T01:49:22.441 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T01:49:22.449 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T01:49:22.449 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:49:22.452 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:49:22.471 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T01:49:22.477 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T01:49:22.513 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T01:49:22.513 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:49:22.516 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:49:22.551 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T01:49:22.557 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T01:49:22.557 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:49:22.579 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:49:22.668 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:49:22.696 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:49:22.713 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:49:22.720 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:49:22.722 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T01:49:22.730 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T01:49:22.730 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:49:22.733 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:49:22.760 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T01:49:22.790 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T01:49:22.790 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:49:22.799 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:49:22.817 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:49:22.903 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:49:22.943 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:49:23.035 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:49:23.068 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:49:23.069 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:49:23.141 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:49:23.193 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:49:23.237 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:49:23.331 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:49:23.366 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:49:23.366 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:49:23.432 DEBUG:teuthology.orchestra.run.smithi019:> sudo service rsyslog restart 2024-09-12T01:49:23.435 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2024-09-12T01:49:23.483 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:49:23.516 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:49:23.912 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T01:49:23.920 INFO:teuthology.task.internal:Starting timer... 2024-09-12T01:49:23.920 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T01:49:23.967 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T01:49:23.998 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-12T01:49:23.999 DEBUG:teuthology.orchestra.run.smithi019:> sudo service auditd rotate 2024-09-12T01:49:24.048 INFO:teuthology.orchestra.run.smithi019.stdout:Rotating logs: 2024-09-12T01:49:24.050 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2024-09-12T01:49:24.098 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2024-09-12T01:49:24.100 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T01:49:24.100 DEBUG:teuthology.orchestra.run.smithi019:> /usr/sbin/getenforce 2024-09-12T01:49:24.125 INFO:teuthology.orchestra.run.smithi019.stdout:Permissive 2024-09-12T01:49:24.125 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2024-09-12T01:49:24.143 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2024-09-12T01:49:24.143 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi019.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive'} 2024-09-12T01:49:24.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:49:24.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:49:24.191 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:49:24.217 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:49:24.217 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T01:49:24.218 DEBUG:teuthology.orchestra.run.smithi019:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:49:24.265 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:49:24.295 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T01:49:24.305 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T01:49:24.308 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T01:49:24.444 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T01:49:24.456 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T01:49:24.457 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi019.front.sepia.ceph.com,smithi135.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T01:53:13.054 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi019.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com')] 2024-09-12T01:53:13.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T01:53:13.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:53:13.172 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-09-12T01:53:13.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T01:53:13.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-12T01:53:13.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:53:13.340 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-09-12T01:53:13.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-12T01:53:13.422 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T01:53:13.433 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T01:53:13.433 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:53:13.434 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:53:13.437 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:53:13.437 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:53:13.470 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:53:13.487 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:53:13.491 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:53:13.506 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:53:13.515 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: ntpd: command not found 2024-09-12T01:53:13.527 INFO:teuthology.orchestra.run.smithi019.stdout:506 Cannot talk to daemon 2024-09-12T01:53:13.531 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2024-09-12T01:53:13.544 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:53:13.544 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2024-09-12T01:53:13.557 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:53:13.558 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:53:13.570 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:53:13.615 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:53:13.619 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:53:13.619 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-09-12T01:53:13.619 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:53:13.619 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:53:13.619 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:53:13.619 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:53:13.624 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:53:13.627 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:53:13.627 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-09-12T01:53:13.627 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:53:13.628 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:53:13.628 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:53:13.628 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:53:13.629 INFO:teuthology.run_tasks:Running task install... 2024-09-12T01:53:13.636 DEBUG:teuthology.task.install:project ceph 2024-09-12T01:53:13.636 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T01:53:13.636 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T01:53:13.637 INFO:teuthology.task.install:Using flavor: default 2024-09-12T01:53:13.642 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T01:53:13.642 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T01:53:13.642 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:53:13.643 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:53:13.644 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:53:13.645 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:53:13.803 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:53:13.804 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:53:13.816 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:53:13.816 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:53:13.922 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:53:13.922 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:53:13.922 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:53:13.938 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:53:13.938 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:53:13.938 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:53:13.953 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:53:13.953 DEBUG:teuthology.orchestra.run.smithi019:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:53:13.965 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:53:13.965 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:53:14.020 DEBUG:teuthology.orchestra.run.smithi019:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:53:14.031 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:53:14.097 DEBUG:teuthology.orchestra.run.smithi019:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:53:14.105 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:53:14.165 INFO:teuthology.orchestra.run.smithi019.stdout:check_obsoletes = 1 2024-09-12T01:53:14.165 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum clean all 2024-09-12T01:53:14.170 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2024-09-12T01:53:14.172 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2024-09-12T01:53:14.404 INFO:teuthology.orchestra.run.smithi019.stdout:45 files removed 2024-09-12T01:53:14.431 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:53:14.449 INFO:teuthology.orchestra.run.smithi135.stdout:45 files removed 2024-09-12T01:53:14.476 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:53:14.998 INFO:teuthology.orchestra.run.smithi019.stdout:ceph packages for x86_64 313 kB/s | 84 kB 00:00 2024-09-12T01:53:15.024 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 323 kB/s | 84 kB 00:00 2024-09-12T01:53:15.290 INFO:teuthology.orchestra.run.smithi019.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-12T01:53:15.291 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 52 kB/s | 12 kB 00:00 2024-09-12T01:53:15.567 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T01:53:15.574 INFO:teuthology.orchestra.run.smithi019.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-12T01:53:17.341 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-12T01:53:17.574 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.2 MB 00:01 2024-09-12T01:53:21.525 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 6.6 MB/s | 20 MB 00:03 2024-09-12T01:53:22.900 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 4.9 MB/s | 20 MB 00:04 2024-09-12T01:53:26.684 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 6.5 MB 00:01 2024-09-12T01:53:27.468 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-12T01:53:28.402 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-12T01:53:29.198 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-12T01:53:29.818 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-12T01:53:30.782 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-12T01:53:34.670 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-09-12T01:53:36.520 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T01:53:37.056 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:53:37.056 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:53:37.068 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:53:37.069 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:53:37.069 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:53:37.070 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:53:37.072 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:53:37.074 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:53:37.075 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:53:37.138 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-12T01:53:37.158 INFO:teuthology.orchestra.run.smithi135.stdout:====================================================================================== 2024-09-12T01:53:37.158 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-09-12T01:53:37.158 INFO:teuthology.orchestra.run.smithi135.stdout:====================================================================================== 2024-09-12T01:53:37.159 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-12T01:53:37.159 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:53:37.159 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:53:37.159 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:53:37.159 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:53:37.159 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:53:37.159 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:53:37.159 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:53:37.159 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:53:37.159 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:53:37.159 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:53:37.160 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:53:37.160 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:53:37.160 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:53:37.161 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:53:37.161 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:53:37.161 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:53:37.161 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:53:37.161 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:53:37.161 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:53:37.161 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:53:37.161 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:53:37.161 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:53:37.161 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:53:37.162 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:53:37.162 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:53:37.162 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:53:37.162 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:53:37.162 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:53:37.162 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:53:37.162 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:53:37.162 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:53:37.162 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:53:37.162 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:53:37.162 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:53:37.162 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:53:37.162 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:53:37.163 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:53:37.163 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2024-09-12T01:53:37.163 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:53:37.163 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:53:37.163 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:53:37.163 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:53:37.163 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:53:37.163 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:53:37.163 INFO:teuthology.orchestra.run.smithi135.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:53:37.163 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:53:37.163 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-09-12T01:53:37.163 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:53:37.163 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:53:37.164 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:53:37.164 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:53:37.164 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:53:37.164 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:53:37.164 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:53:37.164 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:53:37.164 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:53:37.164 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:53:37.164 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:53:37.164 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:53:37.165 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:53:37.165 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:53:37.165 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:53:37.165 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:53:37.165 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:53:37.165 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:53:37.165 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:53:37.165 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:53:37.165 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:53:37.165 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:53:37.165 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:53:37.165 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:53:37.165 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:53:37.166 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:53:37.166 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:53:37.166 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:53:37.166 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:53:37.166 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:53:37.166 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:53:37.166 INFO:teuthology.orchestra.run.smithi135.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:53:37.166 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:53:37.166 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:53:37.166 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:53:37.166 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:53:37.166 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:53:37.166 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:53:37.167 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:53:37.167 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:53:37.167 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:53:37.167 INFO:teuthology.orchestra.run.smithi135.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:53:37.167 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:53:37.167 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:53:37.167 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:53:37.167 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:53:37.167 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:53:37.167 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:53:37.167 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:53:37.167 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:53:37.167 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:53:37.168 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:53:37.168 INFO:teuthology.orchestra.run.smithi135.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:53:37.168 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:53:37.168 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:53:37.168 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:53:37.168 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:53:37.168 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:53:37.168 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:53:37.168 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:53:37.169 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:53:37.169 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:53:37.169 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:53:37.169 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:53:37.169 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:53:37.169 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:53:37.169 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:53:37.170 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:53:37.170 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:53:37.170 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:53:37.170 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:53:37.170 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:53:37.170 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:53:37.170 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:53:37.170 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:53:37.170 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:53:37.170 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:53:37.170 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:53:37.170 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:53:37.170 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:53:37.170 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:53:37.171 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:53:37.171 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:53:37.171 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:53:37.171 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:53:37.171 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:53:37.171 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:53:37.171 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:53:37.171 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:53:37.171 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:53:37.171 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:53:37.171 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:53:37.171 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:53:37.171 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:53:37.172 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:53:37.172 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:53:37.172 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:53:37.172 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:53:37.172 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:53:37.172 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:53:37.172 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:53:37.172 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:53:37.172 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:53:37.173 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:53:37.173 INFO:teuthology.orchestra.run.smithi135.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:53:37.173 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:53:37.173 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:53:37.173 INFO:teuthology.orchestra.run.smithi135.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:53:37.173 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:53:37.173 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:53:37.173 INFO:teuthology.orchestra.run.smithi135.stdout:Installing weak dependencies: 2024-09-12T01:53:37.173 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:53:37.174 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:53:37.174 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-12T01:53:37.174 INFO:teuthology.orchestra.run.smithi135.stdout:====================================================================================== 2024-09-12T01:53:37.174 INFO:teuthology.orchestra.run.smithi135.stdout:Install 148 Packages 2024-09-12T01:53:37.174 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 8 Packages 2024-09-12T01:53:37.174 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:53:37.175 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 226 M 2024-09-12T01:53:37.175 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-12T01:53:37.622 INFO:teuthology.orchestra.run.smithi135.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 46 kB/s | 6.5 kB 00:00 2024-09-12T01:53:37.938 INFO:teuthology.orchestra.run.smithi135.stdout:(2/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-12T01:53:37.972 INFO:teuthology.orchestra.run.smithi135.stdout:(3/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 2.5 MB/s | 897 kB 00:00 2024-09-12T01:53:37.997 INFO:teuthology.orchestra.run.smithi135.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 2.4 MB/s | 145 kB 00:00 2024-09-12T01:53:38.106 INFO:teuthology.orchestra.run.smithi135.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 14 MB/s | 1.5 MB 00:00 2024-09-12T01:53:38.388 INFO:teuthology.orchestra.run.smithi135.stdout:(6/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-12T01:53:38.432 INFO:teuthology.orchestra.run.smithi135.stdout:(7/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 5.2 MB/s | 2.4 MB 00:00 2024-09-12T01:53:38.683 INFO:teuthology.orchestra.run.smithi135.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 18 MB/s | 21 MB 00:01 2024-09-12T01:53:38.732 INFO:teuthology.orchestra.run.smithi135.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 507 kB/s | 25 kB 00:00 2024-09-12T01:53:38.942 INFO:teuthology.orchestra.run.smithi019.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:53:38.943 INFO:teuthology.orchestra.run.smithi019.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:53:38.957 INFO:teuthology.orchestra.run.smithi019.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:53:38.958 INFO:teuthology.orchestra.run.smithi019.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:53:38.959 INFO:teuthology.orchestra.run.smithi019.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:53:38.960 INFO:teuthology.orchestra.run.smithi019.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:53:38.962 INFO:teuthology.orchestra.run.smithi019.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:53:38.965 INFO:teuthology.orchestra.run.smithi019.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:53:38.966 INFO:teuthology.orchestra.run.smithi019.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:53:39.033 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-09-12T01:53:39.055 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================== 2024-09-12T01:53:39.055 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-09-12T01:53:39.055 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================== 2024-09-12T01:53:39.055 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-09-12T01:53:39.055 INFO:teuthology.orchestra.run.smithi019.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:53:39.055 INFO:teuthology.orchestra.run.smithi019.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:53:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:53:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:53:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:53:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:53:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:53:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:53:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:53:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:53:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:53:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:53:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:53:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:53:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:53:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:53:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:53:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:53:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:53:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:53:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:53:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:53:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:53:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:53:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:53:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:53:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:53:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:53:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:53:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:53:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:53:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:53:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:53:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:53:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:53:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:53:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:53:39.059 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrading: 2024-09-12T01:53:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:53:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:53:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:53:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:53:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:53:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:53:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:53:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:53:39.059 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-09-12T01:53:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:53:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:53:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:53:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:53:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:53:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:53:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:53:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:53:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:53:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:53:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:53:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:53:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:53:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:53:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:53:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:53:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:53:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:53:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:53:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:53:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:53:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:53:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:53:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:53:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:53:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:53:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:53:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:53:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:53:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:53:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:53:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:53:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:53:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:53:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:53:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:53:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:53:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:53:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:53:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:53:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:53:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:53:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:53:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:53:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:53:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:53:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:53:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:53:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:53:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:53:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:53:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:53:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:53:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:53:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:53:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:53:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:53:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:53:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:53:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:53:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:53:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:53:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:53:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:53:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:53:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:53:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:53:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:53:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:53:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:53:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:53:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:53:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:53:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:53:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:53:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:53:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:53:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:53:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:53:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:53:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:53:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:53:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:53:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:53:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:53:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:53:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:53:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:53:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:53:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:53:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:53:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:53:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:53:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:53:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:53:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:53:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:53:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:53:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:53:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:53:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:53:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:53:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:53:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:53:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:53:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:53:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:53:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:53:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:53:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:53:39.068 INFO:teuthology.orchestra.run.smithi019.stdout:Installing weak dependencies: 2024-09-12T01:53:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:53:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:53:39.069 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-09-12T01:53:39.069 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================== 2024-09-12T01:53:39.069 INFO:teuthology.orchestra.run.smithi019.stdout:Install 148 Packages 2024-09-12T01:53:39.069 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrade 8 Packages 2024-09-12T01:53:39.069 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:53:39.069 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 226 M 2024-09-12T01:53:39.070 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-09-12T01:53:39.241 INFO:teuthology.orchestra.run.smithi135.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 20 MB/s | 17 MB 00:00 2024-09-12T01:53:39.291 INFO:teuthology.orchestra.run.smithi135.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-12T01:53:39.349 INFO:teuthology.orchestra.run.smithi135.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 466 kB/s | 27 kB 00:00 2024-09-12T01:53:39.408 INFO:teuthology.orchestra.run.smithi135.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 544 kB/s | 32 kB 00:00 2024-09-12T01:53:39.491 INFO:teuthology.orchestra.run.smithi135.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 8.8 MB/s | 752 kB 00:00 2024-09-12T01:53:39.550 INFO:teuthology.orchestra.run.smithi135.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 163 kB 00:00 2024-09-12T01:53:39.675 INFO:teuthology.orchestra.run.smithi135.stdout:(16/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 8.5 MB/s | 11 MB 00:01 2024-09-12T01:53:39.709 INFO:teuthology.orchestra.run.smithi135.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 797 kB/s | 127 kB 00:00 2024-09-12T01:53:39.759 INFO:teuthology.orchestra.run.smithi135.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.9 MB/s | 506 kB 00:00 2024-09-12T01:53:39.826 INFO:teuthology.orchestra.run.smithi135.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 677 kB/s | 45 kB 00:00 2024-09-12T01:53:39.894 INFO:teuthology.orchestra.run.smithi135.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.0 MB/s | 136 kB 00:00 2024-09-12T01:53:40.018 INFO:teuthology.orchestra.run.smithi135.stdout:(21/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 17 MB/s | 5.3 MB 00:00 2024-09-12T01:53:40.030 INFO:teuthology.orchestra.run.smithi019.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 49 kB/s | 6.5 kB 00:00 2024-09-12T01:53:40.044 INFO:teuthology.orchestra.run.smithi135.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.1 MB/s | 162 kB 00:00 2024-09-12T01:53:40.078 INFO:teuthology.orchestra.run.smithi135.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 5.4 MB/s | 321 kB 00:00 2024-09-12T01:53:40.111 INFO:teuthology.orchestra.run.smithi135.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 4.4 MB/s | 301 kB 00:00 2024-09-12T01:53:40.136 INFO:teuthology.orchestra.run.smithi135.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.7 MB/s | 100 kB 00:00 2024-09-12T01:53:40.195 INFO:teuthology.orchestra.run.smithi135.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.0 MB/s | 85 kB 00:00 2024-09-12T01:53:40.278 INFO:teuthology.orchestra.run.smithi135.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-12T01:53:40.280 INFO:teuthology.orchestra.run.smithi019.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 3.5 MB/s | 897 kB 00:00 2024-09-12T01:53:40.370 INFO:teuthology.orchestra.run.smithi135.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 13 MB/s | 3.1 MB 00:00 2024-09-12T01:53:40.381 INFO:teuthology.orchestra.run.smithi019.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.4 MB/s | 145 kB 00:00 2024-09-12T01:53:40.387 INFO:teuthology.orchestra.run.smithi135.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 294 kB/s | 32 kB 00:00 2024-09-12T01:53:40.421 INFO:teuthology.orchestra.run.smithi135.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.8 MB/s | 146 kB 00:00 2024-09-12T01:53:40.606 INFO:teuthology.orchestra.run.smithi019.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 7.6 MB/s | 5.4 MB 00:00 2024-09-12T01:53:40.856 INFO:teuthology.orchestra.run.smithi019.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 5.0 MB/s | 2.4 MB 00:00 2024-09-12T01:53:40.898 INFO:teuthology.orchestra.run.smithi019.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 5.2 MB/s | 1.5 MB 00:00 2024-09-12T01:53:41.021 INFO:teuthology.orchestra.run.smithi135.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-12T01:53:41.080 INFO:teuthology.orchestra.run.smithi135.stdout:(32/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 5.1 MB/s | 3.6 MB 00:00 2024-09-12T01:53:41.105 INFO:teuthology.orchestra.run.smithi135.stdout:(33/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.9 MB/s | 249 kB 00:00 2024-09-12T01:53:41.147 INFO:teuthology.orchestra.run.smithi135.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 737 kB/s | 49 kB 00:00 2024-09-12T01:53:41.173 INFO:teuthology.orchestra.run.smithi135.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 245 kB/s | 16 kB 00:00 2024-09-12T01:53:41.222 INFO:teuthology.orchestra.run.smithi135.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 3.7 MB/s | 285 kB 00:00 2024-09-12T01:53:41.264 INFO:teuthology.orchestra.run.smithi135.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 8.1 MB/s | 765 kB 00:00 2024-09-12T01:53:41.298 INFO:teuthology.orchestra.run.smithi135.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 242 kB/s | 18 kB 00:00 2024-09-12T01:53:41.315 INFO:teuthology.orchestra.run.smithi019.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 4.7 MB 00:00 2024-09-12T01:53:41.757 INFO:teuthology.orchestra.run.smithi135.stdout:(39/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 16 MB/s | 49 MB 00:03 2024-09-12T01:53:41.782 INFO:teuthology.orchestra.run.smithi135.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 154 kB/s | 80 kB 00:00 2024-09-12T01:53:41.815 INFO:teuthology.orchestra.run.smithi019.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 21 MB 00:01 2024-09-12T01:53:41.866 INFO:teuthology.orchestra.run.smithi019.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 507 kB/s | 25 kB 00:00 2024-09-12T01:53:41.882 INFO:teuthology.orchestra.run.smithi135.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 801 kB 00:00 2024-09-12T01:53:41.907 INFO:teuthology.orchestra.run.smithi135.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-12T01:53:41.933 INFO:teuthology.orchestra.run.smithi135.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-09-12T01:53:41.950 INFO:teuthology.orchestra.run.smithi135.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-12T01:53:41.975 INFO:teuthology.orchestra.run.smithi135.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-12T01:53:41.983 INFO:teuthology.orchestra.run.smithi019.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 16 MB/s | 11 MB 00:00 2024-09-12T01:53:42.000 INFO:teuthology.orchestra.run.smithi135.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T01:53:42.041 INFO:teuthology.orchestra.run.smithi019.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 228 kB 00:00 2024-09-12T01:53:42.042 INFO:teuthology.orchestra.run.smithi135.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-09-12T01:53:42.068 INFO:teuthology.orchestra.run.smithi135.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-12T01:53:42.208 INFO:teuthology.orchestra.run.smithi019.stdout:(12/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 13 MB/s | 17 MB 00:01 2024-09-12T01:53:42.233 INFO:teuthology.orchestra.run.smithi019.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 141 kB/s | 27 kB 00:00 2024-09-12T01:53:42.235 INFO:teuthology.orchestra.run.smithi135.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 641 kB/s | 107 kB 00:00 2024-09-12T01:53:42.259 INFO:teuthology.orchestra.run.smithi019.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 634 kB/s | 32 kB 00:00 2024-09-12T01:53:42.285 INFO:teuthology.orchestra.run.smithi135.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 436 kB/s | 22 kB 00:00 2024-09-12T01:53:42.292 INFO:teuthology.orchestra.run.smithi019.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 13 MB/s | 752 kB 00:00 2024-09-12T01:53:42.318 INFO:teuthology.orchestra.run.smithi019.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 163 kB 00:00 2024-09-12T01:53:42.343 INFO:teuthology.orchestra.run.smithi019.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.5 MB/s | 127 kB 00:00 2024-09-12T01:53:42.368 INFO:teuthology.orchestra.run.smithi135.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 689 kB 00:00 2024-09-12T01:53:42.376 INFO:teuthology.orchestra.run.smithi019.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 8.5 MB/s | 506 kB 00:00 2024-09-12T01:53:42.419 INFO:teuthology.orchestra.run.smithi135.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-12T01:53:42.435 INFO:teuthology.orchestra.run.smithi019.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 774 kB/s | 45 kB 00:00 2024-09-12T01:53:42.444 INFO:teuthology.orchestra.run.smithi135.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 435 kB/s | 33 kB 00:00 2024-09-12T01:53:42.477 INFO:teuthology.orchestra.run.smithi135.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 2.1 MB/s | 943 kB 00:00 2024-09-12T01:53:42.494 INFO:teuthology.orchestra.run.smithi135.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-12T01:53:42.502 INFO:teuthology.orchestra.run.smithi019.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.0 MB/s | 136 kB 00:00 2024-09-12T01:53:42.520 INFO:teuthology.orchestra.run.smithi135.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 265 kB/s | 11 kB 00:00 2024-09-12T01:53:42.570 INFO:teuthology.orchestra.run.smithi135.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-09-12T01:53:42.578 INFO:teuthology.orchestra.run.smithi019.stdout:(21/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 23 MB/s | 5.3 MB 00:00 2024-09-12T01:53:42.595 INFO:teuthology.orchestra.run.smithi135.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-12T01:53:42.603 INFO:teuthology.orchestra.run.smithi019.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.6 MB/s | 162 kB 00:00 2024-09-12T01:53:42.628 INFO:teuthology.orchestra.run.smithi019.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 6.3 MB/s | 321 kB 00:00 2024-09-12T01:53:42.653 INFO:teuthology.orchestra.run.smithi019.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.9 MB/s | 301 kB 00:00 2024-09-12T01:53:42.679 INFO:teuthology.orchestra.run.smithi019.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T01:53:42.704 INFO:teuthology.orchestra.run.smithi019.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T01:53:42.762 INFO:teuthology.orchestra.run.smithi019.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-12T01:53:42.787 INFO:teuthology.orchestra.run.smithi135.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 3.0 MB/s | 581 kB 00:00 2024-09-12T01:53:42.812 INFO:teuthology.orchestra.run.smithi135.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.7 MB/s | 662 kB 00:00 2024-09-12T01:53:42.838 INFO:teuthology.orchestra.run.smithi019.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 20 MB/s | 3.1 MB 00:00 2024-09-12T01:53:42.838 INFO:teuthology.orchestra.run.smithi135.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 487 kB/s | 24 kB 00:00 2024-09-12T01:53:42.855 INFO:teuthology.orchestra.run.smithi135.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-12T01:53:42.863 INFO:teuthology.orchestra.run.smithi019.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 318 kB/s | 32 kB 00:00 2024-09-12T01:53:42.897 INFO:teuthology.orchestra.run.smithi019.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.4 MB/s | 146 kB 00:00 2024-09-12T01:53:42.938 INFO:teuthology.orchestra.run.smithi135.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-12T01:53:42.963 INFO:teuthology.orchestra.run.smithi135.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-12T01:53:42.981 INFO:teuthology.orchestra.run.smithi135.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 917 kB/s | 38 kB 00:00 2024-09-12T01:53:43.206 INFO:teuthology.orchestra.run.smithi019.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 10 MB/s | 3.6 MB 00:00 2024-09-12T01:53:43.297 INFO:teuthology.orchestra.run.smithi019.stdout:(32/156): ceph-mgr-diskprediction-local-19.1.1- 18 MB/s | 7.4 MB 00:00 2024-09-12T01:53:43.314 INFO:teuthology.orchestra.run.smithi135.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-09-12T01:53:43.323 INFO:teuthology.orchestra.run.smithi019.stdout:(33/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.1 MB/s | 249 kB 00:00 2024-09-12T01:53:43.348 INFO:teuthology.orchestra.run.smithi019.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 985 kB/s | 49 kB 00:00 2024-09-12T01:53:43.373 INFO:teuthology.orchestra.run.smithi019.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 328 kB/s | 16 kB 00:00 2024-09-12T01:53:43.399 INFO:teuthology.orchestra.run.smithi019.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 5.6 MB/s | 285 kB 00:00 2024-09-12T01:53:43.559 INFO:teuthology.orchestra.run.smithi019.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 114 kB/s | 18 kB 00:00 2024-09-12T01:53:43.591 INFO:teuthology.orchestra.run.smithi019.stdout:(38/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 3.4 MB/s | 765 kB 00:00 2024-09-12T01:53:43.706 INFO:teuthology.orchestra.run.smithi135.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 4.1 MB/s | 1.6 MB 00:00 2024-09-12T01:53:43.716 INFO:teuthology.orchestra.run.smithi019.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 509 kB/s | 80 kB 00:00 2024-09-12T01:53:43.767 INFO:teuthology.orchestra.run.smithi019.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 801 kB 00:00 2024-09-12T01:53:43.808 INFO:teuthology.orchestra.run.smithi019.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-12T01:53:43.842 INFO:teuthology.orchestra.run.smithi019.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-12T01:53:43.926 INFO:teuthology.orchestra.run.smithi019.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-09-12T01:53:43.939 INFO:teuthology.orchestra.run.smithi135.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 3.8 MB/s | 910 kB 00:00 2024-09-12T01:53:43.968 INFO:teuthology.orchestra.run.smithi019.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-09-12T01:53:43.998 INFO:teuthology.orchestra.run.smithi135.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-12T01:53:44.010 INFO:teuthology.orchestra.run.smithi019.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-12T01:53:44.060 INFO:teuthology.orchestra.run.smithi019.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-12T01:53:44.065 INFO:teuthology.orchestra.run.smithi135.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.1 MB/s | 4.4 MB 00:01 2024-09-12T01:53:44.093 INFO:teuthology.orchestra.run.smithi019.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-12T01:53:44.224 INFO:teuthology.orchestra.run.smithi135.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.9 MB/s | 4.9 MB 00:01 2024-09-12T01:53:44.252 INFO:teuthology.orchestra.run.smithi019.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-09-12T01:53:44.266 INFO:teuthology.orchestra.run.smithi135.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-09-12T01:53:44.341 INFO:teuthology.orchestra.run.smithi135.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.7 MB/s | 1.0 MB 00:00 2024-09-12T01:53:44.391 INFO:teuthology.orchestra.run.smithi135.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-12T01:53:44.475 INFO:teuthology.orchestra.run.smithi135.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-12T01:53:44.558 INFO:teuthology.orchestra.run.smithi135.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-12T01:53:44.609 INFO:teuthology.orchestra.run.smithi135.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-12T01:53:44.660 INFO:teuthology.orchestra.run.smithi135.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-12T01:53:44.703 INFO:teuthology.orchestra.run.smithi019.stdout:(49/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 17 MB/s | 49 MB 00:02 2024-09-12T01:53:44.734 INFO:teuthology.orchestra.run.smithi135.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-12T01:53:44.736 INFO:teuthology.orchestra.run.smithi019.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 1.4 MB/s | 943 kB 00:00 2024-09-12T01:53:44.761 INFO:teuthology.orchestra.run.smithi019.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 210 kB/s | 107 kB 00:00 2024-09-12T01:53:44.785 INFO:teuthology.orchestra.run.smithi135.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-09-12T01:53:44.786 INFO:teuthology.orchestra.run.smithi019.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-12T01:53:44.812 INFO:teuthology.orchestra.run.smithi019.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-09-12T01:53:44.854 INFO:teuthology.orchestra.run.smithi019.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-09-12T01:53:44.888 INFO:teuthology.orchestra.run.smithi019.stdout:(55/156): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-09-12T01:53:44.913 INFO:teuthology.orchestra.run.smithi019.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-12T01:53:44.938 INFO:teuthology.orchestra.run.smithi019.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-12T01:53:44.963 INFO:teuthology.orchestra.run.smithi019.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-09-12T01:53:45.014 INFO:teuthology.orchestra.run.smithi019.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-12T01:53:45.089 INFO:teuthology.orchestra.run.smithi019.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-12T01:53:45.114 INFO:teuthology.orchestra.run.smithi019.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 243 kB/s | 24 kB 00:00 2024-09-12T01:53:45.140 INFO:teuthology.orchestra.run.smithi019.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-12T01:53:45.160 INFO:teuthology.orchestra.run.smithi135.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 5.0 MB/s | 5.8 MB 00:01 2024-09-12T01:53:45.165 INFO:teuthology.orchestra.run.smithi019.stdout:(63/156): libtool-2.4.6-46.el9.x86_64.rpm 2.8 MB/s | 581 kB 00:00 2024-09-12T01:53:45.190 INFO:teuthology.orchestra.run.smithi019.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-12T01:53:45.224 INFO:teuthology.orchestra.run.smithi019.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-12T01:53:45.243 INFO:teuthology.orchestra.run.smithi135.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-12T01:53:45.249 INFO:teuthology.orchestra.run.smithi019.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-12T01:53:45.336 INFO:teuthology.orchestra.run.smithi135.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-12T01:53:45.341 INFO:teuthology.orchestra.run.smithi019.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-12T01:53:45.383 INFO:teuthology.orchestra.run.smithi019.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-12T01:53:45.394 INFO:teuthology.orchestra.run.smithi135.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T01:53:45.425 INFO:teuthology.orchestra.run.smithi019.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-12T01:53:45.444 INFO:teuthology.orchestra.run.smithi135.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-09-12T01:53:45.450 INFO:teuthology.orchestra.run.smithi019.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-12T01:53:45.517 INFO:teuthology.orchestra.run.smithi019.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 17 MB/s | 4.9 MB 00:00 2024-09-12T01:53:45.528 INFO:teuthology.orchestra.run.smithi135.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-09-12T01:53:45.551 INFO:teuthology.orchestra.run.smithi019.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-12T01:53:45.576 INFO:teuthology.orchestra.run.smithi019.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-12T01:53:45.618 INFO:teuthology.orchestra.run.smithi019.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-12T01:53:45.670 INFO:teuthology.orchestra.run.smithi135.stdout:(87/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.2 MB/s | 6.0 MB 00:01 2024-09-12T01:53:45.693 INFO:teuthology.orchestra.run.smithi019.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-12T01:53:45.719 INFO:teuthology.orchestra.run.smithi019.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-12T01:53:45.745 INFO:teuthology.orchestra.run.smithi135.stdout:(88/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.3 MB/s | 5.1 MB 00:00 2024-09-12T01:53:45.752 INFO:teuthology.orchestra.run.smithi019.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-12T01:53:45.770 INFO:teuthology.orchestra.run.smithi135.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 656 kB/s | 159 kB 00:00 2024-09-12T01:53:45.777 INFO:teuthology.orchestra.run.smithi019.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-09-12T01:53:45.795 INFO:teuthology.orchestra.run.smithi135.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-12T01:53:45.803 INFO:teuthology.orchestra.run.smithi019.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-12T01:53:45.812 INFO:teuthology.orchestra.run.smithi135.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 762 kB/s | 51 kB 00:00 2024-09-12T01:53:45.828 INFO:teuthology.orchestra.run.smithi019.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-12T01:53:45.829 INFO:teuthology.orchestra.run.smithi135.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 912 kB/s | 54 kB 00:00 2024-09-12T01:53:45.853 INFO:teuthology.orchestra.run.smithi019.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-12T01:53:45.871 INFO:teuthology.orchestra.run.smithi135.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-09-12T01:53:45.888 INFO:teuthology.orchestra.run.smithi135.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 753 kB/s | 44 kB 00:00 2024-09-12T01:53:45.930 INFO:teuthology.orchestra.run.smithi135.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T01:53:45.945 INFO:teuthology.orchestra.run.smithi019.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-12T01:53:45.947 INFO:teuthology.orchestra.run.smithi135.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-12T01:53:45.971 INFO:teuthology.orchestra.run.smithi019.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-12T01:53:45.989 INFO:teuthology.orchestra.run.smithi135.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-09-12T01:53:45.996 INFO:teuthology.orchestra.run.smithi019.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-12T01:53:46.021 INFO:teuthology.orchestra.run.smithi019.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-12T01:53:46.046 INFO:teuthology.orchestra.run.smithi019.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 846 kB/s | 42 kB 00:00 2024-09-12T01:53:46.056 INFO:teuthology.orchestra.run.smithi135.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 869 kB/s | 58 kB 00:00 2024-09-12T01:53:46.072 INFO:teuthology.orchestra.run.smithi019.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-12T01:53:46.081 INFO:teuthology.orchestra.run.smithi135.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.2 MB/s | 304 kB 00:00 2024-09-12T01:53:46.097 INFO:teuthology.orchestra.run.smithi019.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-12T01:53:46.115 INFO:teuthology.orchestra.run.smithi135.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-12T01:53:46.122 INFO:teuthology.orchestra.run.smithi019.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-12T01:53:46.132 INFO:teuthology.orchestra.run.smithi135.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T01:53:46.148 INFO:teuthology.orchestra.run.smithi019.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T01:53:46.165 INFO:teuthology.orchestra.run.smithi135.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-12T01:53:46.173 INFO:teuthology.orchestra.run.smithi019.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T01:53:46.240 INFO:teuthology.orchestra.run.smithi135.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-12T01:53:46.248 INFO:teuthology.orchestra.run.smithi019.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-12T01:53:46.273 INFO:teuthology.orchestra.run.smithi019.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-12T01:53:46.299 INFO:teuthology.orchestra.run.smithi019.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 881 kB/s | 44 kB 00:00 2024-09-12T01:53:46.299 INFO:teuthology.orchestra.run.smithi135.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-12T01:53:46.324 INFO:teuthology.orchestra.run.smithi019.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T01:53:46.332 INFO:teuthology.orchestra.run.smithi135.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-12T01:53:46.349 INFO:teuthology.orchestra.run.smithi019.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-12T01:53:46.350 INFO:teuthology.orchestra.run.smithi135.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-12T01:53:46.458 INFO:teuthology.orchestra.run.smithi135.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-12T01:53:46.491 INFO:teuthology.orchestra.run.smithi019.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 284 kB/s | 47 kB 00:00 2024-09-12T01:53:46.492 INFO:teuthology.orchestra.run.smithi135.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.6 MB/s | 863 kB 00:00 2024-09-12T01:53:46.517 INFO:teuthology.orchestra.run.smithi019.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.8 MB/s | 304 kB 00:00 2024-09-12T01:53:46.517 INFO:teuthology.orchestra.run.smithi135.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 442 kB/s | 26 kB 00:00 2024-09-12T01:53:46.542 INFO:teuthology.orchestra.run.smithi019.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T01:53:46.542 INFO:teuthology.orchestra.run.smithi135.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-09-12T01:53:46.559 INFO:teuthology.orchestra.run.smithi135.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 724 kB/s | 49 kB 00:00 2024-09-12T01:53:46.567 INFO:teuthology.orchestra.run.smithi019.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-12T01:53:46.585 INFO:teuthology.orchestra.run.smithi135.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-12T01:53:46.593 INFO:teuthology.orchestra.run.smithi019.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T01:53:46.618 INFO:teuthology.orchestra.run.smithi019.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-12T01:53:46.618 INFO:teuthology.orchestra.run.smithi135.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-12T01:53:46.652 INFO:teuthology.orchestra.run.smithi135.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-12T01:53:46.669 INFO:teuthology.orchestra.run.smithi135.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 869 kB/s | 43 kB 00:00 2024-09-12T01:53:46.686 INFO:teuthology.orchestra.run.smithi135.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 964 kB/s | 32 kB 00:00 2024-09-12T01:53:46.703 INFO:teuthology.orchestra.run.smithi135.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 419 kB/s | 14 kB 00:00 2024-09-12T01:53:46.718 INFO:teuthology.orchestra.run.smithi019.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-09-12T01:53:46.728 INFO:teuthology.orchestra.run.smithi135.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-12T01:53:46.753 INFO:teuthology.orchestra.run.smithi135.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-12T01:53:46.779 INFO:teuthology.orchestra.run.smithi135.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-12T01:53:46.804 INFO:teuthology.orchestra.run.smithi135.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-12T01:53:46.829 INFO:teuthology.orchestra.run.smithi135.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T01:53:46.854 INFO:teuthology.orchestra.run.smithi135.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 432 kB/s | 11 kB 00:00 2024-09-12T01:53:46.880 INFO:teuthology.orchestra.run.smithi135.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-12T01:53:46.893 INFO:teuthology.orchestra.run.smithi019.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-09-12T01:53:46.905 INFO:teuthology.orchestra.run.smithi135.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 925 kB/s | 23 kB 00:00 2024-09-12T01:53:46.931 INFO:teuthology.orchestra.run.smithi135.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-12T01:53:46.935 INFO:teuthology.orchestra.run.smithi019.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.5 MB/s | 548 kB 00:00 2024-09-12T01:53:46.956 INFO:teuthology.orchestra.run.smithi135.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 796 kB/s | 20 kB 00:00 2024-09-12T01:53:46.960 INFO:teuthology.orchestra.run.smithi019.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 851 kB/s | 19 kB 00:00 2024-09-12T01:53:47.003 INFO:teuthology.orchestra.run.smithi019.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-12T01:53:47.014 INFO:teuthology.orchestra.run.smithi135.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-09-12T01:53:47.028 INFO:teuthology.orchestra.run.smithi019.stdout:(108/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.3 MB/s | 309 kB 00:00 2024-09-12T01:53:47.039 INFO:teuthology.orchestra.run.smithi135.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T01:53:47.061 INFO:teuthology.orchestra.run.smithi019.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 445 kB/s | 26 kB 00:00 2024-09-12T01:53:47.065 INFO:teuthology.orchestra.run.smithi135.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T01:53:47.087 INFO:teuthology.orchestra.run.smithi019.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-09-12T01:53:47.112 INFO:teuthology.orchestra.run.smithi019.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 579 kB/s | 49 kB 00:00 2024-09-12T01:53:47.115 INFO:teuthology.orchestra.run.smithi135.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.1 MB/s | 2.0 MB 00:00 2024-09-12T01:53:47.137 INFO:teuthology.orchestra.run.smithi019.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-12T01:53:47.140 INFO:teuthology.orchestra.run.smithi135.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 765 kB/s | 58 kB 00:00 2024-09-12T01:53:47.166 INFO:teuthology.orchestra.run.smithi135.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-09-12T01:53:47.183 INFO:teuthology.orchestra.run.smithi135.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 393 kB/s | 16 kB 00:00 2024-09-12T01:53:47.187 INFO:teuthology.orchestra.run.smithi019.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-12T01:53:47.199 INFO:teuthology.orchestra.run.smithi135.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-09-12T01:53:47.221 INFO:teuthology.orchestra.run.smithi019.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-12T01:53:47.225 INFO:teuthology.orchestra.run.smithi135.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-12T01:53:47.250 INFO:teuthology.orchestra.run.smithi135.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 608 kB/s | 31 kB 00:00 2024-09-12T01:53:47.255 INFO:teuthology.orchestra.run.smithi019.stdout:(115/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-09-12T01:53:47.276 INFO:teuthology.orchestra.run.smithi135.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T01:53:47.282 INFO:teuthology.orchestra.run.smithi019.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 549 kB/s | 32 kB 00:00 2024-09-12T01:53:47.301 INFO:teuthology.orchestra.run.smithi135.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T01:53:47.305 INFO:teuthology.orchestra.run.smithi019.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-12T01:53:47.339 INFO:teuthology.orchestra.run.smithi019.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-12T01:53:47.360 INFO:teuthology.orchestra.run.smithi135.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 426 kB/s | 36 kB 00:00 2024-09-12T01:53:47.373 INFO:teuthology.orchestra.run.smithi019.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-12T01:53:47.385 INFO:teuthology.orchestra.run.smithi135.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 3.0 MB/s | 74 kB 00:00 2024-09-12T01:53:47.398 INFO:teuthology.orchestra.run.smithi019.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-12T01:53:47.418 INFO:teuthology.orchestra.run.smithi135.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-12T01:53:47.423 INFO:teuthology.orchestra.run.smithi019.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T01:53:47.444 INFO:teuthology.orchestra.run.smithi135.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-12T01:53:47.449 INFO:teuthology.orchestra.run.smithi019.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T01:53:47.469 INFO:teuthology.orchestra.run.smithi135.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 799 kB/s | 20 kB 00:00 2024-09-12T01:53:47.503 INFO:teuthology.orchestra.run.smithi019.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 200 kB/s | 11 kB 00:00 2024-09-12T01:53:47.503 INFO:teuthology.orchestra.run.smithi135.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-12T01:53:47.533 INFO:teuthology.orchestra.run.smithi019.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 593 kB/s | 18 kB 00:00 2024-09-12T01:53:47.536 INFO:teuthology.orchestra.run.smithi135.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-12T01:53:47.558 INFO:teuthology.orchestra.run.smithi019.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 935 kB/s | 23 kB 00:00 2024-09-12T01:53:47.583 INFO:teuthology.orchestra.run.smithi019.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-12T01:53:47.594 INFO:teuthology.orchestra.run.smithi135.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-09-12T01:53:47.609 INFO:teuthology.orchestra.run.smithi019.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 798 kB/s | 20 kB 00:00 2024-09-12T01:53:47.667 INFO:teuthology.orchestra.run.smithi019.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-09-12T01:53:47.693 INFO:teuthology.orchestra.run.smithi019.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T01:53:47.718 INFO:teuthology.orchestra.run.smithi019.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T01:53:47.743 INFO:teuthology.orchestra.run.smithi019.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T01:53:47.785 INFO:teuthology.orchestra.run.smithi019.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.3 MB/s | 2.0 MB 00:00 2024-09-12T01:53:47.811 INFO:teuthology.orchestra.run.smithi019.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-12T01:53:47.836 INFO:teuthology.orchestra.run.smithi019.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T01:53:47.861 INFO:teuthology.orchestra.run.smithi019.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-12T01:53:47.862 INFO:teuthology.orchestra.run.smithi135.stdout:(148/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 3.2 MB 00:00 2024-09-12T01:53:47.895 INFO:teuthology.orchestra.run.smithi019.stdout:(136/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-12T01:53:47.920 INFO:teuthology.orchestra.run.smithi019.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 526 kB/s | 31 kB 00:00 2024-09-12T01:53:47.987 INFO:teuthology.orchestra.run.smithi019.stdout:(138/156): libarrow-9.0.0-11.el9.x86_64.rpm 4.3 MB/s | 4.4 MB 00:01 2024-09-12T01:53:48.012 INFO:teuthology.orchestra.run.smithi019.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 644 kB/s | 59 kB 00:00 2024-09-12T01:53:48.037 INFO:teuthology.orchestra.run.smithi019.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 716 kB/s | 36 kB 00:00 2024-09-12T01:53:48.045 INFO:teuthology.orchestra.run.smithi135.stdout:(149/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.2 MB/s | 16 MB 00:02 2024-09-12T01:53:48.063 INFO:teuthology.orchestra.run.smithi019.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T01:53:48.088 INFO:teuthology.orchestra.run.smithi019.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 977 kB/s | 188 kB 00:00 2024-09-12T01:53:48.104 INFO:teuthology.orchestra.run.smithi135.stdout:(150/156): librados2-19.1.1-298.gb53b6d3e.el9.x 6.0 MB/s | 3.4 MB 00:00 2024-09-12T01:53:48.113 INFO:teuthology.orchestra.run.smithi019.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T01:53:48.139 INFO:teuthology.orchestra.run.smithi019.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T01:53:48.155 INFO:teuthology.orchestra.run.smithi019.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 479 kB/s | 20 kB 00:00 2024-09-12T01:53:48.181 INFO:teuthology.orchestra.run.smithi019.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.4 MB/s | 191 kB 00:00 2024-09-12T01:53:48.196 INFO:teuthology.orchestra.run.smithi135.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 6.9 MB/s | 2.3 MB 00:00 2024-09-12T01:53:48.206 INFO:teuthology.orchestra.run.smithi019.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-12T01:53:48.221 INFO:teuthology.orchestra.run.smithi135.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 348 kB/s | 41 kB 00:00 2024-09-12T01:53:48.255 INFO:teuthology.orchestra.run.smithi135.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-12T01:53:48.256 INFO:teuthology.orchestra.run.smithi019.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T01:53:48.314 INFO:teuthology.orchestra.run.smithi135.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 6.7 MB/s | 1.8 MB 00:00 2024-09-12T01:53:48.365 INFO:teuthology.orchestra.run.smithi019.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 21 MB/s | 2.3 MB 00:00 2024-09-12T01:53:48.372 INFO:teuthology.orchestra.run.smithi135.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-09-12T01:53:48.414 INFO:teuthology.orchestra.run.smithi135.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 7.0 MB/s | 1.4 MB 00:00 2024-09-12T01:53:48.419 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:53:48.419 INFO:teuthology.orchestra.run.smithi135.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-12T01:53:48.483 INFO:teuthology.orchestra.run.smithi019.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 15 MB/s | 1.8 MB 00:00 2024-09-12T01:53:48.541 INFO:teuthology.orchestra.run.smithi019.stdout:(151/156): librados2-19.1.1-298.gb53b6d3e.el9.x 9.5 MB/s | 3.4 MB 00:00 2024-09-12T01:53:48.567 INFO:teuthology.orchestra.run.smithi019.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 488 kB/s | 41 kB 00:00 2024-09-12T01:53:48.625 INFO:teuthology.orchestra.run.smithi019.stdout:(153/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 7.5 MB/s | 3.2 MB 00:00 2024-09-12T01:53:48.651 INFO:teuthology.orchestra.run.smithi019.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 2.2 MB/s | 249 kB 00:00 2024-09-12T01:53:48.692 INFO:teuthology.orchestra.run.smithi019.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-12T01:53:48.834 INFO:teuthology.orchestra.run.smithi019.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-12T01:53:48.840 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:53:48.841 INFO:teuthology.orchestra.run.smithi019.stdout:Total 23 MB/s | 226 MB 00:09 2024-09-12T01:53:49.620 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-12T01:53:49.772 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-12T01:53:49.772 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-12T01:53:50.115 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-09-12T01:53:50.283 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-09-12T01:53:50.283 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-09-12T01:53:51.959 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-12T01:53:51.959 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-12T01:53:52.629 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-09-12T01:53:52.629 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-09-12T01:53:58.362 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-12T01:53:58.468 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:53:58.516 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:53:58.576 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:53:58.610 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:53:58.636 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:53:58.692 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:53:59.030 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:53:59.147 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:53:59.195 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-09-12T01:53:59.259 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:53:59.288 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:53:59.297 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:53:59.336 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:53:59.380 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:53:59.390 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:53:59.409 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:53:59.431 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:53:59.456 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:53:59.519 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:53:59.568 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:53:59.622 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:53:59.650 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:53:59.770 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:53:59.793 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:53:59.856 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:53:59.877 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:53:59.882 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:53:59.900 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:53:59.999 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:54:00.074 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:54:00.117 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:54:00.150 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:54:00.244 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:54:00.246 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:54:00.271 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:54:00.393 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:54:00.460 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:54:00.518 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:54:00.522 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:54:00.546 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:54:00.594 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:54:00.653 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:54:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:54:00.743 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:54:00.773 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:54:00.801 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:54:00.825 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:54:00.933 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:54:01.027 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:54:01.066 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:54:01.109 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:54:01.172 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:54:01.217 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:54:01.250 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:54:01.294 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:54:01.303 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:54:01.326 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:54:01.354 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:54:01.422 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:54:01.475 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:54:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:54:01.507 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:54:01.551 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:54:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:54:01.625 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:54:01.661 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:54:01.703 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:54:01.704 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:54:01.758 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:54:01.789 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:54:01.818 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:54:01.864 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:54:01.938 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:54:02.015 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:54:02.069 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:54:02.125 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:54:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:54:02.227 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:54:02.261 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:54:02.297 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:54:02.371 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:54:02.423 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:54:02.463 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:54:02.506 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:54:02.539 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:54:02.566 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:54:02.637 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:54:02.646 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:54:02.690 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:54:02.728 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:54:02.729 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:54:02.758 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:54:02.773 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:54:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:54:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:54:02.850 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:54:02.881 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:54:02.882 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:54:02.927 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:54:02.954 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:54:03.026 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:54:03.033 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:54:03.069 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:54:03.083 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:54:03.146 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:54:03.171 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:54:03.212 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:54:03.243 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:54:03.279 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:54:03.316 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:54:03.325 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:54:03.361 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:54:03.372 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:54:03.405 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:54:03.454 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:54:03.590 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:54:03.632 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:54:03.673 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:54:03.784 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:54:03.824 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:54:03.864 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:54:03.889 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:54:03.913 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:54:03.926 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:54:04.010 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:54:04.010 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:54:04.054 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:54:04.106 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:54:04.143 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:54:04.144 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:54:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:54:04.338 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:54:04.396 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:54:04.425 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:54:04.452 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:54:04.470 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:54:04.507 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:54:04.526 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:54:04.552 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:54:04.573 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:54:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:54:04.617 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:54:04.621 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:54:04.655 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:54:04.664 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:54:04.689 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:54:04.700 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:54:04.731 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:54:04.743 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:54:04.765 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:54:04.785 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:54:04.857 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:54:04.904 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:54:04.927 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:54:04.934 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:54:04.970 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:54:05.012 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:54:05.041 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:54:05.093 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:54:05.312 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:54:05.379 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:54:05.419 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:54:05.452 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:54:05.477 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:54:05.584 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:54:05.721 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:54:05.754 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:54:05.782 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:54:05.809 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:54:05.825 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:54:05.857 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:54:05.864 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:54:05.890 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:54:05.904 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:54:05.934 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:54:05.977 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:54:05.986 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:54:06.019 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:54:06.045 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:54:06.060 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:54:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:54:06.094 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:54:06.177 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:54:06.184 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:54:06.219 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:54:06.234 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:54:06.265 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:54:06.373 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:54:06.404 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:54:06.433 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:54:06.433 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:54:06.511 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:54:07.157 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:54:07.190 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:54:07.237 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:54:07.255 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:54:07.271 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:54:07.374 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:54:07.429 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:54:07.475 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:54:07.575 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:54:07.618 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:54:07.809 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:54:07.840 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:54:07.921 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:54:08.494 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:54:08.570 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:54:08.597 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:54:08.608 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:54:08.632 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:54:08.726 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:54:08.948 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:54:09.010 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:54:09.103 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:54:09.134 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:54:09.171 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:54:09.651 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:54:09.682 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:54:09.753 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:54:09.776 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:54:10.042 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:54:10.127 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:54:10.155 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:54:10.189 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:54:10.516 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:54:10.568 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:54:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:54:10.756 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:54:10.794 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:54:11.300 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:54:11.337 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:54:11.417 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:54:11.447 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:54:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:54:12.580 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:54:13.134 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:54:13.184 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:54:13.275 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:54:13.276 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:54:13.276 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:54:13.276 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:13.310 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:54:13.845 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:54:13.894 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:54:14.479 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:54:14.539 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:54:14.639 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:54:14.639 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:54:14.639 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:54:14.639 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:14.682 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:54:25.932 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:54:25.933 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2024-09-12T01:54:25.933 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2024-09-12T01:54:25.933 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2024-09-12T01:54:25.933 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2024-09-12T01:54:25.933 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2024-09-12T01:54:25.933 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /root 2024-09-12T01:54:25.933 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2024-09-12T01:54:25.933 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:26.113 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:54:26.129 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:54:26.130 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:54:26.130 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:54:26.130 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:27.007 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:54:27.007 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /sys 2024-09-12T01:54:27.007 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /proc 2024-09-12T01:54:27.007 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /mnt 2024-09-12T01:54:27.007 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /var/tmp 2024-09-12T01:54:27.007 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /home 2024-09-12T01:54:27.008 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /root 2024-09-12T01:54:27.008 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /tmp 2024-09-12T01:54:27.008 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:27.192 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:54:27.209 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:54:27.209 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:54:27.209 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:54:27.210 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:27.600 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:54:27.626 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:54:27.626 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:54:27.626 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:54:27.627 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:54:27.627 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:54:27.627 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:27.850 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:54:27.873 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:54:27.873 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:54:27.873 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:54:27.873 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:54:27.874 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:54:27.874 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:28.309 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:54:28.332 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:54:28.332 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:54:28.332 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:54:28.332 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:54:28.332 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:54:28.333 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:28.439 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:54:28.486 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:54:28.542 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:54:28.725 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:54:28.754 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:54:28.776 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:54:28.782 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:54:28.782 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:54:28.782 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:54:28.782 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:54:28.782 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:54:28.783 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:28.844 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:54:28.933 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:54:29.022 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:54:29.049 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:54:29.049 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:54:29.049 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:54:29.049 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:54:29.049 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:54:29.049 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:29.072 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:54:29.118 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:54:29.149 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:54:29.178 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:54:29.506 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:54:29.531 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:54:29.531 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:54:29.531 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:54:29.531 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:54:29.531 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:54:29.531 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:29.553 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:54:29.585 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:54:29.616 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:54:29.645 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:54:29.678 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:54:29.703 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:54:29.707 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:54:29.767 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:54:29.961 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:54:30.016 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:54:30.100 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:54:30.193 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:54:30.335 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:54:30.396 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:54:30.431 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:54:30.458 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:54:30.747 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:54:30.785 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:54:30.886 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:54:30.915 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:54:30.956 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:54:31.029 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:54:31.063 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:54:31.752 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:54:31.785 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:54:31.886 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:54:32.046 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:54:32.078 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:54:32.103 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:54:32.103 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:54:32.103 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:54:32.103 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:54:32.103 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:54:32.103 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:32.164 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:54:32.167 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:54:32.175 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:54:32.207 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:54:32.272 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:54:32.330 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:54:33.226 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:54:33.251 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:54:33.257 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:54:33.290 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:54:33.315 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:54:33.315 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:54:33.315 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:54:33.315 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:54:33.315 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:54:33.315 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:33.358 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:54:33.364 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:54:33.381 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:54:33.381 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:54:33.381 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:54:33.381 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:33.425 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:54:33.448 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:54:33.448 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:54:33.448 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:54:33.449 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:54:33.449 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:54:33.449 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:33.535 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:54:33.567 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:54:33.594 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:54:33.594 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:54:33.594 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:54:33.594 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:54:33.594 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:54:33.594 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:33.651 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:54:33.664 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:54:33.759 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:54:33.774 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:54:33.783 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:54:33.783 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:54:33.783 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:54:33.783 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:54:33.783 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:54:33.783 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:54:34.815 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:54:34.846 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:54:34.872 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:54:34.872 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:54:34.872 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:54:34.872 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:54:34.872 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:54:34.872 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:34.914 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:54:34.938 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:54:34.938 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:54:34.939 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:54:34.939 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:34.989 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:54:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:54:35.014 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:54:35.014 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:54:35.015 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:54:35.015 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:54:35.015 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:35.331 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:54:35.356 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:54:35.356 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:54:35.356 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:54:35.357 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:54:35.361 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:54:35.361 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:38.379 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:54:38.420 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:54:38.461 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:54:38.494 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:54:38.521 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:54:38.710 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:54:38.759 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:54:38.798 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:54:38.827 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:54:38.865 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:54:39.428 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:54:39.480 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:54:39.500 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:54:40.202 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:54:40.243 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:54:40.285 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:54:40.316 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:54:40.321 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:54:40.344 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:54:40.426 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:54:40.472 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:54:40.546 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:54:40.566 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:54:40.589 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:54:40.604 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:54:40.619 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:54:40.630 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:54:40.649 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:54:40.655 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:54:40.655 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:54:40.695 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:54:40.739 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:54:40.740 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:54:40.824 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:54:40.849 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:54:40.854 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:54:40.855 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:54:41.034 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:54:41.034 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:54:41.126 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:54:41.191 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:54:41.303 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:54:41.351 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:54:41.373 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:54:42.262 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:54:42.381 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:54:42.432 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:54:42.531 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:54:42.559 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:54:42.585 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:54:42.627 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:54:42.627 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:54:42.719 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:54:42.720 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:54:42.804 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:54:42.829 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:54:42.835 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:54:42.835 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:54:43.022 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:54:43.022 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:54:43.106 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:54:43.184 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:54:46.871 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:54:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:54:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:54:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:54:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:54:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:54:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:54:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:54:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:54:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:54:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:54:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:54:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:54:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:54:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:54:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:54:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:54:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:54:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:54:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:54:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:54:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:54:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:54:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:54:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:54:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:54:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:54:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:54:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:54:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:54:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:54:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:54:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:54:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:54:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:54:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:54:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:54:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:54:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:54:46.876 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:54:46.876 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:54:46.876 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:54:46.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:54:46.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:54:46.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:54:46.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:54:46.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:54:46.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:54:46.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:54:46.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:54:46.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:54:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:54:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:54:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:54:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:54:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:54:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:54:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:54:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:54:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:54:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:54:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:54:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:54:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:54:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:54:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:54:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:54:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:54:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:54:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:54:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:54:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:54:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:54:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:54:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:54:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:54:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:54:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:54:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:54:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:54:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:54:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:54:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:54:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:54:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:54:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:54:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:54:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:54:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:54:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:54:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:54:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:54:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:54:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:54:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:54:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:54:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:54:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:54:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:54:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:54:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:54:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:54:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:54:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:54:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:54:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:54:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:54:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:54:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:54:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:54:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:54:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:54:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:54:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:54:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:54:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:54:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:54:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:54:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:54:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:54:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:54:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:54:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:54:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:54:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:54:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:54:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:54:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:54:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:54:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:54:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:54:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:54:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:54:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:54:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:54:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:54:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:54:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:54:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:54:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:54:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:54:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:54:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:54:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:54:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:54:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:54:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:54:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:54:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:54:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:54:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:54:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:54:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:54:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:54:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:54:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:54:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:54:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:54:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:54:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:54:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:54:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:54:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:54:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:54:48.740 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:54:48.741 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:54:48.741 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:54:48.741 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:54:48.741 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:54:48.741 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:54:48.741 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:54:48.741 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:54:48.741 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:54:48.741 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:54:48.741 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:54:48.741 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:54:48.741 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:54:48.741 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:54:48.742 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:54:48.742 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:54:48.742 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:54:48.742 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:54:48.742 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:54:48.742 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:54:48.742 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:54:48.742 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:54:48.742 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:54:48.742 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:54:48.742 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:54:48.742 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:54:48.742 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:54:48.742 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:54:48.754 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:54:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:54:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:54:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:54:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:54:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:54:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:54:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:54:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:54:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:54:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:54:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:54:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:54:48.756 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:54:48.756 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:54:48.756 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:54:48.756 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:54:48.756 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:54:48.756 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:54:48.756 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:54:48.756 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:54:48.756 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:54:48.756 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:54:48.756 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:54:48.756 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:54:48.756 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:54:48.756 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:54:48.757 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:54:48.757 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:54:48.757 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:54:48.757 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:54:48.757 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:54:48.757 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:54:48.757 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:54:48.757 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:54:48.757 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:54:48.757 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:54:48.757 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:54:48.757 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:54:48.757 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:54:48.757 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:54:48.758 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:54:48.758 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:54:48.758 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:54:48.758 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:54:48.758 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:54:48.758 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:54:48.758 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:54:48.758 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:54:48.758 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:54:48.758 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:54:48.758 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:54:48.758 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:54:48.758 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:54:48.758 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:54:48.759 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:54:48.759 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:54:48.759 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:54:48.759 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:54:48.759 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:54:48.759 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:54:48.759 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:54:48.759 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:54:48.759 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:54:48.759 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:54:48.759 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:54:48.759 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:54:48.759 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:54:48.759 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:54:48.760 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:54:48.760 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:54:48.760 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:54:48.760 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:54:48.760 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:54:48.760 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:54:48.760 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:54:48.760 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:54:48.761 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:54:48.761 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:54:48.761 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:54:48.761 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:54:48.761 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:54:48.761 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:54:48.761 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:54:48.761 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:54:48.761 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:54:48.761 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:54:48.761 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:54:48.761 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:54:48.761 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:54:48.761 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:54:48.762 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:54:48.762 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:54:48.762 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:54:48.762 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:54:48.762 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:54:48.762 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:54:48.762 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:54:48.762 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:54:48.762 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:54:48.762 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:54:48.763 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:54:48.763 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:54:48.763 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:54:48.763 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:54:48.763 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:54:48.763 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:54:48.763 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:54:48.763 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:54:48.763 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:54:48.763 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:54:48.764 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:54:48.764 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:54:48.764 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:54:48.764 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:54:48.764 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:54:48.764 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:54:48.764 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:54:48.764 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:54:48.764 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:54:48.764 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:54:48.764 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:54:48.764 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:54:48.764 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:54:48.765 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:54:48.765 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:54:48.765 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:54:48.765 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:54:48.765 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:54:48.765 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:54:48.765 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:54:48.765 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:54:48.765 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:54:48.765 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:54:48.765 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:54:48.765 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:54:49.726 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:54:49.726 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:49.726 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2024-09-12T01:54:49.727 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:54:49.727 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:54:49.727 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:54:49.727 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:54:49.727 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.728 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.728 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:54:49.728 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:54:49.728 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-12T01:54:49.728 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:54:49.728 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:54:49.729 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:54:49.729 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:54:49.729 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.729 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.729 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.729 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.730 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:49.730 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.730 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.731 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.731 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:49.731 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:49.731 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:49.731 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:49.732 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:49.732 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.732 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.732 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:49.732 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.732 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.733 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.733 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:49.733 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:49.733 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.734 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.734 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:49.734 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:54:49.734 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:54:49.734 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:54:49.735 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:54:49.735 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:54:49.735 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:54:49.735 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:54:49.735 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:54:49.735 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:54:49.736 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:54:49.736 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:54:49.736 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.736 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.736 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.736 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:54:49.737 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:54:49.737 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:54:49.737 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:54:49.737 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:54:49.737 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.737 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.738 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:54:49.738 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.738 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:54:49.738 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:54:49.738 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:54:49.738 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:54:49.739 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:54:49.739 INFO:teuthology.orchestra.run.smithi135.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:54:49.739 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:54:49.739 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:54:49.739 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:54:49.739 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:54:49.740 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:54:49.740 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:54:49.740 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:54:49.740 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:54:49.741 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:54:49.741 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:54:49.741 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:54:49.742 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:54:49.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:54:49.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:54:49.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:54:49.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:54:49.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:54:49.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:54:49.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:54:49.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:54:49.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:54:49.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:54:49.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:54:49.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:54:49.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:54:49.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:54:49.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:54:49.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:54:49.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:54:49.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:54:49.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:54:49.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:54:49.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:54:49.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:54:49.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:54:49.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:54:49.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:54:49.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:54:49.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:54:49.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:54:49.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:54:49.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:54:49.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:54:49.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:54:49.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:54:49.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:54:49.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:54:49.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:54:49.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:54:49.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:54:49.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:54:49.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:54:49.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:54:49.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:54:49.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:54:49.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:54:49.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:54:49.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:54:49.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:54:49.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:54:49.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:54:49.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:54:49.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:54:49.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:54:49.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:54:49.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:54:49.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:54:49.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:54:49.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:54:49.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:54:49.747 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:54:49.747 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:54:49.747 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:54:49.747 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:54:49.747 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:54:49.747 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.747 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.747 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:49.747 INFO:teuthology.orchestra.run.smithi135.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:54:49.747 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:54:49.747 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:54:49.747 INFO:teuthology.orchestra.run.smithi135.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:54:49.747 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:54:49.747 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:54:49.748 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:54:49.748 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:49.748 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-12T01:54:50.182 DEBUG:teuthology.parallel:result is None 2024-09-12T01:54:51.537 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:54:51.537 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:51.537 INFO:teuthology.orchestra.run.smithi019.stdout:Upgraded: 2024-09-12T01:54:51.537 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:54:51.537 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:54:51.537 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:54:51.537 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:54:51.538 INFO:teuthology.orchestra.run.smithi019.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.538 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.538 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:54:51.538 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:54:51.538 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-09-12T01:54:51.538 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:54:51.538 INFO:teuthology.orchestra.run.smithi019.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:54:51.538 INFO:teuthology.orchestra.run.smithi019.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:54:51.538 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:54:51.538 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.538 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.538 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.538 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.539 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:51.539 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.539 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.539 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.539 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:51.539 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:51.539 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:51.539 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:51.539 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:51.539 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.539 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.539 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:51.539 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.539 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.540 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.540 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:51.540 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:51.540 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.540 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.540 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:54:51.540 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:54:51.540 INFO:teuthology.orchestra.run.smithi019.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:54:51.540 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:54:51.540 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:54:51.540 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:54:51.540 INFO:teuthology.orchestra.run.smithi019.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:54:51.540 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:54:51.541 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:54:51.541 INFO:teuthology.orchestra.run.smithi019.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:54:51.541 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:54:51.541 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:54:51.541 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.541 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.541 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.541 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:54:51.541 INFO:teuthology.orchestra.run.smithi019.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:54:51.541 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:54:51.541 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:54:51.541 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:54:51.541 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.541 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.542 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:54:51.542 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.542 INFO:teuthology.orchestra.run.smithi019.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:54:51.542 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:54:51.542 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:54:51.542 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:54:51.542 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:54:51.542 INFO:teuthology.orchestra.run.smithi019.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:54:51.542 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:54:51.542 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:54:51.542 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:54:51.542 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:54:51.542 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:54:51.542 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:54:51.543 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:54:51.543 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:54:51.543 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:54:51.543 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:54:51.543 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:54:51.543 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:54:51.543 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:54:51.543 INFO:teuthology.orchestra.run.smithi019.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:54:51.543 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:54:51.543 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:54:51.543 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:54:51.543 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.543 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.543 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:54:51.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:54:51.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:54:51.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:54:51.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:54:51.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:54:51.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:54:51.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:54:51.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:54:51.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:54:51.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:54:51.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:54:51.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:54:51.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:54:51.545 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:54:51.545 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:54:51.545 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:54:51.545 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:54:51.545 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:54:51.545 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:54:51.545 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:54:51.545 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:54:51.545 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:54:51.545 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:54:51.545 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:54:51.545 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:54:51.545 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:54:51.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:54:51.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:54:51.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:54:51.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:54:51.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:54:51.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:54:51.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:54:51.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:54:51.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:54:51.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:54:51.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:54:51.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:54:51.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:54:51.547 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.547 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.547 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:54:51.547 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:54:51.547 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:54:51.547 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.547 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:54:51.548 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:54:51.548 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:54:51.548 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:54:51.548 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:54:51.548 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:54:51.548 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:54:51.548 INFO:teuthology.orchestra.run.smithi019.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:54:51.548 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:54:51.549 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:54:51.549 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:54:51.549 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:54:51.549 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:54:51.549 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:54:51.549 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:54:51.549 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.550 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.550 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:54:51.550 INFO:teuthology.orchestra.run.smithi019.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:54:51.550 INFO:teuthology.orchestra.run.smithi019.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:54:51.550 INFO:teuthology.orchestra.run.smithi019.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:54:51.550 INFO:teuthology.orchestra.run.smithi019.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:54:51.550 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:54:51.551 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:54:51.551 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:54:51.551 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:51.551 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-09-12T01:54:51.972 DEBUG:teuthology.parallel:result is None 2024-09-12T01:54:51.973 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:54:52.122 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:54:52.147 INFO:teuthology.orchestra.run.smithi019.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:54:52.147 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:54:52.147 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:54:52.149 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:54:52.290 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:54:52.315 INFO:teuthology.orchestra.run.smithi135.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:54:52.315 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:54:52.315 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:54:52.317 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T01:54:52.318 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:54:52.318 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:54:52.350 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:54:52.350 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:54:52.387 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T01:54:52.387 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:54:52.387 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:54:52.419 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:54:52.487 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:54:52.487 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:54:52.515 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:54:52.582 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T01:54:52.583 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:54:52.583 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:54:52.611 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:54:52.678 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:54:52.678 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:54:52.705 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:54:52.771 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T01:54:52.771 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:54:52.772 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:54:52.798 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:54:52.866 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:54:52.866 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:54:52.892 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:54:52.958 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T01:54:53.037 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T01:54:53.037 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 777 /var/log/ceph 2024-09-12T01:54:53.040 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /var/log/ceph 2024-09-12T01:54:53.066 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T01:54:53.066 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T01:54:53.110 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T01:54:53.135 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T01:54:53.135 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T01:54:53.176 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T01:54:53.208 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-12T01:54:53.208 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-12T01:54:53.208 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-12T01:54:53.209 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:54:53.209 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-12T01:54:53.259 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-12T01:54:53.385 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-12T01:54:53.412 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:54:53.412 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-12T01:54:53.427 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-12T01:54:53.546 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-12T01:54:53.575 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T01:54:53.576 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'Error loading MDS rank', 'missing journal object', 'Error recovering journal', 'error decoding table object', 'failed to read JournalPointer', 'Corrupt directory entry', 'Corrupt fnode header', 'corrupt sessionmap header', 'Corrupt dentry', 'Scrub error on inode', 'Metadata damage detected', 'MDS_READ_ONLY', 'force file system read-only', 'with standby daemon mds', 'MDS abort because newly corrupt dentry'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T01:54:53.576 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901578', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/damage}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7901578', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'Error loading MDS rank', 'missing journal object', 'Error recovering journal', 'error decoding table object', 'failed to read JournalPointer', 'Corrupt directory entry', 'Corrupt fnode header', 'corrupt sessionmap header', 'Corrupt dentry', 'Scrub error on inode', 'Metadata damage detected', 'MDS_READ_ONLY', 'force file system read-only', 'with standby daemon mds', 'MDS abort because newly corrupt dentry'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 481, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '57/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi019.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKBgbC6RWlU9gw1fkiz5jySBjndK3x5TCMMfSvWR68KjqtkpNkLG4Tv5ICw31MSxpCOhzHAvzDkr5v30jKndt4w=', 'smithi135.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN+eBp5rhD9WVj6KM84HqIXH1DghElpNar3462lSZ1dSWAm4Y1nFaegYwH/qlShsL7hNZxaFQwjudt/LnmAZR3A='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'Error loading MDS rank', 'missing journal object', 'Error recovering journal', 'error decoding table object', 'failed to read JournalPointer', 'Corrupt directory entry', 'Corrupt fnode header', 'corrupt sessionmap header', 'Corrupt dentry', 'Scrub error on inode', 'Metadata damage detected', 'MDS_READ_ONLY', 'force file system read-only', 'with standby daemon mds', 'MDS abort because newly corrupt dentry'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_damage']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T01:54:53.576 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T01:54:53.579 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T01:54:53.626 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T01:54:53.636 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T01:54:53.692 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:54:53.692 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:54:53.718 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:54:53.718 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_1 2024-09-12T01:54:53.774 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:54:53.775 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:54:53.775 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-12T01:54:53.775 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:54:53.775 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:54:53.775 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-12 01:54:43.560821714 +0000 2024-09-12T01:54:53.775 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-12 01:52:53.922415300 +0000 2024-09-12T01:54:53.775 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-12 01:52:53.922415300 +0000 2024-09-12T01:54:53.775 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-12 01:52:53.922415300 +0000 2024-09-12T01:54:53.775 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:54:53.840 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-12T01:54:53.840 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-12T01:54:53.840 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000217047 s, 2.4 MB/s 2024-09-12T01:54:53.841 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:54:53.899 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_2 2024-09-12T01:54:53.956 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:54:53.956 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:54:53.956 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T01:54:53.957 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:54:53.957 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:54:53.957 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-12 01:54:43.560821714 +0000 2024-09-12T01:54:53.957 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-12 01:52:54.270411703 +0000 2024-09-12T01:54:53.957 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-12 01:52:54.270411703 +0000 2024-09-12T01:54:53.957 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-12 01:52:54.270411703 +0000 2024-09-12T01:54:53.957 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:54:54.021 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-12T01:54:54.021 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-12T01:54:54.021 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000217143 s, 2.4 MB/s 2024-09-12T01:54:54.023 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:54:54.080 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_3 2024-09-12T01:54:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:54:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:54:54.136 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T01:54:54.136 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:54:54.136 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:54:54.136 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-12 01:54:43.561821703 +0000 2024-09-12T01:54:54.136 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-12 01:52:54.644407838 +0000 2024-09-12T01:54:54.136 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-12 01:52:54.644407838 +0000 2024-09-12T01:54:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-12 01:52:54.644407838 +0000 2024-09-12T01:54:54.137 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:54:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-12T01:54:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-12T01:54:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000193236 s, 2.6 MB/s 2024-09-12T01:54:54.202 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:54:54.259 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_4 2024-09-12T01:54:54.316 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:54:54.316 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:54:54.317 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T01:54:54.317 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:54:54.317 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:54:54.317 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-12 01:54:43.561821703 +0000 2024-09-12T01:54:54.317 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-12 01:52:54.973404437 +0000 2024-09-12T01:54:54.317 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-12 01:52:54.973404437 +0000 2024-09-12T01:54:54.317 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-12 01:52:54.973404437 +0000 2024-09-12T01:54:54.317 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:54:54.381 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-12T01:54:54.381 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-12T01:54:54.381 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.00019008 s, 2.7 MB/s 2024-09-12T01:54:54.382 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:54:54.439 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T01:54:54.439 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:54:54.439 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:54:54.457 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:54:54.458 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2024-09-12T01:54:54.515 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:54:54.515 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:54:54.515 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T01:54:54.515 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:54:54.516 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:54:54.516 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-12 01:54:41.560945036 +0000 2024-09-12T01:54:54.516 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-12 01:52:49.094535144 +0000 2024-09-12T01:54:54.516 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-12 01:52:49.094535144 +0000 2024-09-12T01:54:54.516 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-12 01:52:49.094535144 +0000 2024-09-12T01:54:54.516 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:54:54.582 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-12T01:54:54.582 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-12T01:54:54.582 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.00022229 s, 2.3 MB/s 2024-09-12T01:54:54.584 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:54:54.643 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2024-09-12T01:54:54.701 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:54:54.701 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:54:54.701 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T01:54:54.701 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:54:54.701 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:54:54.701 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-12 01:54:41.561945015 +0000 2024-09-12T01:54:54.701 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-12 01:52:49.419528355 +0000 2024-09-12T01:54:54.701 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-12 01:52:49.419528355 +0000 2024-09-12T01:54:54.701 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-12 01:52:49.419528355 +0000 2024-09-12T01:54:54.702 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:54:54.768 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-12T01:54:54.768 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-12T01:54:54.768 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000212561 s, 2.4 MB/s 2024-09-12T01:54:54.769 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:54:54.827 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2024-09-12T01:54:54.884 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:54:54.885 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:54:54.885 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T01:54:54.885 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:54:54.885 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:54:54.885 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-12 01:54:41.561945015 +0000 2024-09-12T01:54:54.885 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-12 01:52:49.749521461 +0000 2024-09-12T01:54:54.885 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-12 01:52:49.749521461 +0000 2024-09-12T01:54:54.885 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-12 01:52:49.749521461 +0000 2024-09-12T01:54:54.885 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:54:54.949 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-12T01:54:54.949 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-12T01:54:54.949 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000221318 s, 2.3 MB/s 2024-09-12T01:54:54.950 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:54:55.007 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2024-09-12T01:54:55.064 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:54:55.064 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:54:55.065 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T01:54:55.065 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:54:55.065 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:54:55.065 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-12 01:54:41.561945015 +0000 2024-09-12T01:54:55.065 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-12 01:52:50.064514881 +0000 2024-09-12T01:54:55.065 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-12 01:52:50.064514881 +0000 2024-09-12T01:54:55.065 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-12 01:52:50.064514881 +0000 2024-09-12T01:54:55.065 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:54:55.129 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-12T01:54:55.129 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-12T01:54:55.129 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000197709 s, 2.6 MB/s 2024-09-12T01:54:55.130 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:54:55.187 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T01:54:55.187 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T01:54:55.187 INFO:tasks.ceph:Generating config... 2024-09-12T01:54:55.189 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-12T01:54:55.189 INFO:tasks.ceph:[client] debug client = 20 2024-09-12T01:54:55.189 INFO:tasks.ceph:[client] debug ms = 1 2024-09-12T01:54:55.189 INFO:tasks.ceph:[client] pid file = 2024-09-12T01:54:55.189 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-12T01:54:55.189 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-12T01:54:55.189 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-12T01:54:55.189 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-12T01:54:55.189 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-12T01:54:55.189 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-12T01:54:55.189 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-12T01:54:55.189 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-12T01:54:55.189 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-12T01:54:55.189 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-12T01:54:55.190 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-12T01:54:55.190 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-12T01:54:55.190 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-12T01:54:55.190 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-12T01:54:55.190 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T01:54:55.190 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T01:54:55.190 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T01:54:55.190 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T01:54:55.190 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T01:54:55.190 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-12T01:54:55.190 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-12T01:54:55.190 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-12T01:54:55.190 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T01:54:55.190 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T01:54:55.190 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-12T01:54:55.191 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-12T01:54:55.191 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T01:54:55.191 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T01:54:55.191 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-12T01:54:55.191 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T01:54:55.191 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T01:54:55.191 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T01:54:55.191 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T01:54:55.191 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T01:54:55.191 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-12T01:54:55.191 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T01:54:55.191 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T01:54:55.256 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T01:54:55.259 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T01:54:55.307 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T01:54:55.334 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.19'), ('mon.b', '172.21.15.135'), ('mon.c', '[v2:172.21.15.135:3301,v1:172.21.15.135:6790]')] 2024-09-12T01:54:55.335 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.19,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-12T01:54:55.336 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:54:55.336 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T01:54:55.392 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.19 --add b 172.21.15.135 --addv c '[v2:172.21.15.135:3301,v1:172.21.15.135:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:54:55.481 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:54:55.481 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: generated fsid 978259a0-e3d5-47df-8e62-5e92f95d9388 2024-09-12T01:54:55.481 INFO:teuthology.orchestra.run.smithi019.stdout:setting min_mon_release = quincy 2024-09-12T01:54:55.481 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 0 2024-09-12T01:54:55.481 INFO:teuthology.orchestra.run.smithi019.stdout:fsid 978259a0-e3d5-47df-8e62-5e92f95d9388 2024-09-12T01:54:55.481 INFO:teuthology.orchestra.run.smithi019.stdout:last_changed 2024-09-12T01:54:55.482250+0000 2024-09-12T01:54:55.481 INFO:teuthology.orchestra.run.smithi019.stdout:created 2024-09-12T01:54:55.482250+0000 2024-09-12T01:54:55.481 INFO:teuthology.orchestra.run.smithi019.stdout:min_mon_release 17 (quincy) 2024-09-12T01:54:55.481 INFO:teuthology.orchestra.run.smithi019.stdout:election_strategy: 1 2024-09-12T01:54:55.482 INFO:teuthology.orchestra.run.smithi019.stdout:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T01:54:55.482 INFO:teuthology.orchestra.run.smithi019.stdout:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T01:54:55.482 INFO:teuthology.orchestra.run.smithi019.stdout:2: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.c 2024-09-12T01:54:55.482 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T01:54:55.483 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T01:54:55.498 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 978259a0-e3d5-47df-8e62-5e92f95d9388... 2024-09-12T01:54:55.499 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T01:54:55.541 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T01:54:55.583 INFO:teuthology.orchestra.run.smithi019.stdout:[global] 2024-09-12T01:54:55.584 INFO:teuthology.orchestra.run.smithi019.stdout: chdir = "" 2024-09-12T01:54:55.584 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T01:54:55.584 INFO:teuthology.orchestra.run.smithi019.stdout: auth supported = cephx 2024-09-12T01:54:55.584 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.584 INFO:teuthology.orchestra.run.smithi019.stdout: filestore xattr use omap = true 2024-09-12T01:54:55.584 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.584 INFO:teuthology.orchestra.run.smithi019.stdout: mon clock drift allowed = 1.000 2024-09-12T01:54:55.584 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.584 INFO:teuthology.orchestra.run.smithi019.stdout: osd crush chooseleaf type = 0 2024-09-12T01:54:55.584 INFO:teuthology.orchestra.run.smithi019.stdout: auth debug = true 2024-09-12T01:54:55.584 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.584 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on old message = true 2024-09-12T01:54:55.585 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on bug = true 2024-09-12T01:54:55.585 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.585 INFO:teuthology.orchestra.run.smithi019.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T01:54:55.585 INFO:teuthology.orchestra.run.smithi019.stdout: mon pg warn max object skew = 0 2024-09-12T01:54:55.585 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.585 INFO:teuthology.orchestra.run.smithi019.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T01:54:55.585 INFO:teuthology.orchestra.run.smithi019.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T01:54:55.585 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.585 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default size = 2 2024-09-12T01:54:55.585 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.585 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow primary affinity = true 2024-09-12T01:54:55.585 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow pg remap = true 2024-09-12T01:54:55.585 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on legacy crush tunables = false 2024-09-12T01:54:55.585 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on crush straw calc version zero = false 2024-09-12T01:54:55.586 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on no sortbitwise = false 2024-09-12T01:54:55.586 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on osd down out interval zero = false 2024-09-12T01:54:55.586 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on too few osds = false 2024-09-12T01:54:55.586 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T01:54:55.586 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T01:54:55.586 INFO:teuthology.orchestra.run.smithi019.stdout: mon_allow_pool_size_one = true 2024-09-12T01:54:55.586 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.586 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T01:54:55.586 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.586 INFO:teuthology.orchestra.run.smithi019.stdout: osd default data pool replay window = 5 2024-09-12T01:54:55.586 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.586 INFO:teuthology.orchestra.run.smithi019.stdout: mon allow pool delete = true 2024-09-12T01:54:55.586 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.586 INFO:teuthology.orchestra.run.smithi019.stdout: mon cluster log file level = debug 2024-09-12T01:54:55.587 INFO:teuthology.orchestra.run.smithi019.stdout: debug asserts on shutdown = true 2024-09-12T01:54:55.587 INFO:teuthology.orchestra.run.smithi019.stdout: mon health detail to clog = false 2024-09-12T01:54:55.587 INFO:teuthology.orchestra.run.smithi019.stdout: mon host = "172.21.15.19,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]" 2024-09-12T01:54:55.587 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on skipped message = False 2024-09-12T01:54:55.587 INFO:teuthology.orchestra.run.smithi019.stdout: fsid = 978259a0-e3d5-47df-8e62-5e92f95d9388 2024-09-12T01:54:55.587 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.587 INFO:teuthology.orchestra.run.smithi019.stdout:[osd] 2024-09-12T01:54:55.587 INFO:teuthology.orchestra.run.smithi019.stdout: osd journal size = 100 2024-09-12T01:54:55.587 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.587 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub load threshold = 5.0 2024-09-12T01:54:55.587 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub max interval = 600 2024-09-12T01:54:55.587 INFO:teuthology.orchestra.run.smithi019.stdout: osd mclock profile = high_recovery_ops 2024-09-12T01:54:55.587 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.587 INFO:teuthology.orchestra.run.smithi019.stdout: osd recover clone overlap = true 2024-09-12T01:54:55.588 INFO:teuthology.orchestra.run.smithi019.stdout: osd recovery max chunk = 1048576 2024-09-12T01:54:55.588 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.588 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug shutdown = true 2024-09-12T01:54:55.588 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug op order = true 2024-09-12T01:54:55.588 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug verify stray on activate = true 2024-09-12T01:54:55.588 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug trim objects = true 2024-09-12T01:54:55.588 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.588 INFO:teuthology.orchestra.run.smithi019.stdout: osd open classes on start = true 2024-09-12T01:54:55.588 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug pg log writeout = true 2024-09-12T01:54:55.588 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.588 INFO:teuthology.orchestra.run.smithi019.stdout: osd deep scrub update digest min age = 30 2024-09-12T01:54:55.588 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.588 INFO:teuthology.orchestra.run.smithi019.stdout: osd map max advance = 10 2024-09-12T01:54:55.588 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.589 INFO:teuthology.orchestra.run.smithi019.stdout: journal zero on create = true 2024-09-12T01:54:55.589 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.589 INFO:teuthology.orchestra.run.smithi019.stdout: filestore ondisk finisher threads = 3 2024-09-12T01:54:55.589 INFO:teuthology.orchestra.run.smithi019.stdout: filestore apply finisher threads = 3 2024-09-12T01:54:55.589 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.589 INFO:teuthology.orchestra.run.smithi019.stdout: bdev debug aio = true 2024-09-12T01:54:55.589 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug misdirected ops = true 2024-09-12T01:54:55.589 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore block size = 96636764160 2024-09-12T01:54:55.589 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore fsck on mount = True 2024-09-12T01:54:55.589 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluefs = 20 2024-09-12T01:54:55.589 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluestore = 20 2024-09-12T01:54:55.589 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T01:54:55.589 INFO:teuthology.orchestra.run.smithi019.stdout: debug osd = 20 2024-09-12T01:54:55.589 INFO:teuthology.orchestra.run.smithi019.stdout: debug rocksdb = 10 2024-09-12T01:54:55.589 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T01:54:55.590 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd full ratio = 0.9 2024-09-12T01:54:55.590 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd nearfull ratio = 0.8 2024-09-12T01:54:55.590 INFO:teuthology.orchestra.run.smithi019.stdout: osd failsafe full ratio = 0.95 2024-09-12T01:54:55.590 INFO:teuthology.orchestra.run.smithi019.stdout: osd objectstore = bluestore 2024-09-12T01:54:55.590 INFO:teuthology.orchestra.run.smithi019.stdout: osd op complaint time = 180 2024-09-12T01:54:55.590 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.590 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr] 2024-09-12T01:54:55.590 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T01:54:55.590 INFO:teuthology.orchestra.run.smithi019.stdout: debug mgr = 20 2024-09-12T01:54:55.590 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-09-12T01:54:55.590 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-09-12T01:54:55.590 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-09-12T01:54:55.590 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-09-12T01:54:55.590 INFO:teuthology.orchestra.run.smithi019.stdout: mgr/telemetry/nag = false 2024-09-12T01:54:55.591 INFO:teuthology.orchestra.run.smithi019.stdout: debug client = 20 2024-09-12T01:54:55.591 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.591 INFO:teuthology.orchestra.run.smithi019.stdout:[mon] 2024-09-12T01:54:55.591 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T01:54:55.591 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-09-12T01:54:55.591 INFO:teuthology.orchestra.run.smithi019.stdout: debug paxos = 20 2024-09-12T01:54:55.591 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-09-12T01:54:55.591 INFO:teuthology.orchestra.run.smithi019.stdout: mon data avail warn = 5 2024-09-12T01:54:55.591 INFO:teuthology.orchestra.run.smithi019.stdout: mon mgr mkfs grace = 240 2024-09-12T01:54:55.591 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-09-12T01:54:55.591 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd reporter subtree level = osd 2024-09-12T01:54:55.591 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd prime pg temp = true 2024-09-12T01:54:55.591 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-09-12T01:54:55.591 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.591 INFO:teuthology.orchestra.run.smithi019.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T01:54:55.592 INFO:teuthology.orchestra.run.smithi019.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T01:54:55.592 INFO:teuthology.orchestra.run.smithi019.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T01:54:55.592 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.592 INFO:teuthology.orchestra.run.smithi019.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T01:54:55.592 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T01:54:55.592 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T01:54:55.592 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.592 INFO:teuthology.orchestra.run.smithi019.stdout: # 1m isn't quite enough 2024-09-12T01:54:55.592 INFO:teuthology.orchestra.run.smithi019.stdout: mon_down_mkfs_grace = 2m 2024-09-12T01:54:55.592 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.592 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_filestore_osds = false 2024-09-12T01:54:55.592 INFO:teuthology.orchestra.run.smithi019.stdout: mon down mkfs grace = 300 2024-09-12T01:54:55.592 INFO:teuthology.orchestra.run.smithi019.stdout: mon op complaint time = 120 2024-09-12T01:54:55.592 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on pool no app = False 2024-09-12T01:54:55.593 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:54:55.593 INFO:teuthology.orchestra.run.smithi019.stdout:[client] 2024-09-12T01:54:55.593 INFO:teuthology.orchestra.run.smithi019.stdout: rgw cache enabled = true 2024-09-12T01:54:55.593 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable ops log = true 2024-09-12T01:54:55.593 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable usage log = true 2024-09-12T01:54:55.593 INFO:teuthology.orchestra.run.smithi019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T01:54:55.593 INFO:teuthology.orchestra.run.smithi019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T01:54:55.593 INFO:teuthology.orchestra.run.smithi019.stdout: client mount timeout = 600 2024-09-12T01:54:55.593 INFO:teuthology.orchestra.run.smithi019.stdout: debug client = 20 2024-09-12T01:54:55.593 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T01:54:55.593 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = "" 2024-09-12T01:54:55.593 INFO:teuthology.orchestra.run.smithi019.stdout: rados mon op timeout = 900 2024-09-12T01:54:55.593 INFO:teuthology.orchestra.run.smithi019.stdout: rados osd op timeout = 900 2024-09-12T01:54:55.593 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.a] 2024-09-12T01:54:55.593 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.b] 2024-09-12T01:54:55.594 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.c] 2024-09-12T01:54:55.594 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2024-09-12T01:54:55.594 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.c] 2024-09-12T01:54:55.594 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.b] 2024-09-12T01:54:55.594 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.d] 2024-09-12T01:54:55.594 INFO:teuthology.orchestra.run.smithi019.stdout:[mds] 2024-09-12T01:54:55.594 INFO:teuthology.orchestra.run.smithi019.stdout: debug mds = 20 2024-09-12T01:54:55.594 INFO:teuthology.orchestra.run.smithi019.stdout: debug mds balancer = 20 2024-09-12T01:54:55.594 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T01:54:55.594 INFO:teuthology.orchestra.run.smithi019.stdout: mds debug frag = True 2024-09-12T01:54:55.594 INFO:teuthology.orchestra.run.smithi019.stdout: mds debug scatterstat = True 2024-09-12T01:54:55.594 INFO:teuthology.orchestra.run.smithi019.stdout: mds op complaint time = 180 2024-09-12T01:54:55.594 INFO:teuthology.orchestra.run.smithi019.stdout: mds verify scatter = True 2024-09-12T01:54:55.594 INFO:teuthology.orchestra.run.smithi019.stdout: osd op complaint time = 180 2024-09-12T01:54:55.595 INFO:teuthology.orchestra.run.smithi019.stdout: rados mon op timeout = 900 2024-09-12T01:54:55.595 INFO:teuthology.orchestra.run.smithi019.stdout: rados osd op timeout = 900 2024-09-12T01:54:55.595 INFO:teuthology.orchestra.run.smithi135.stdout:[global] 2024-09-12T01:54:55.595 INFO:teuthology.orchestra.run.smithi135.stdout: chdir = "" 2024-09-12T01:54:55.595 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T01:54:55.595 INFO:teuthology.orchestra.run.smithi135.stdout: auth supported = cephx 2024-09-12T01:54:55.596 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.596 INFO:teuthology.orchestra.run.smithi135.stdout: filestore xattr use omap = true 2024-09-12T01:54:55.596 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.596 INFO:teuthology.orchestra.run.smithi135.stdout: mon clock drift allowed = 1.000 2024-09-12T01:54:55.596 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.596 INFO:teuthology.orchestra.run.smithi135.stdout: osd crush chooseleaf type = 0 2024-09-12T01:54:55.596 INFO:teuthology.orchestra.run.smithi135.stdout: auth debug = true 2024-09-12T01:54:55.596 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.596 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on old message = true 2024-09-12T01:54:55.596 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on bug = true 2024-09-12T01:54:55.596 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.596 INFO:teuthology.orchestra.run.smithi135.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T01:54:55.596 INFO:teuthology.orchestra.run.smithi135.stdout: mon pg warn max object skew = 0 2024-09-12T01:54:55.596 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.597 INFO:teuthology.orchestra.run.smithi135.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T01:54:55.597 INFO:teuthology.orchestra.run.smithi135.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T01:54:55.597 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.597 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default size = 2 2024-09-12T01:54:55.597 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.597 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow primary affinity = true 2024-09-12T01:54:55.597 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow pg remap = true 2024-09-12T01:54:55.597 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on legacy crush tunables = false 2024-09-12T01:54:55.597 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on crush straw calc version zero = false 2024-09-12T01:54:55.597 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on no sortbitwise = false 2024-09-12T01:54:55.597 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on osd down out interval zero = false 2024-09-12T01:54:55.597 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on too few osds = false 2024-09-12T01:54:55.597 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T01:54:55.597 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T01:54:55.598 INFO:teuthology.orchestra.run.smithi135.stdout: mon_allow_pool_size_one = true 2024-09-12T01:54:55.598 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.598 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T01:54:55.598 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.598 INFO:teuthology.orchestra.run.smithi135.stdout: osd default data pool replay window = 5 2024-09-12T01:54:55.598 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.598 INFO:teuthology.orchestra.run.smithi135.stdout: mon allow pool delete = true 2024-09-12T01:54:55.599 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.599 INFO:teuthology.orchestra.run.smithi135.stdout: mon cluster log file level = debug 2024-09-12T01:54:55.599 INFO:teuthology.orchestra.run.smithi135.stdout: debug asserts on shutdown = true 2024-09-12T01:54:55.599 INFO:teuthology.orchestra.run.smithi135.stdout: mon health detail to clog = false 2024-09-12T01:54:55.599 INFO:teuthology.orchestra.run.smithi135.stdout: mon host = "172.21.15.19,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]" 2024-09-12T01:54:55.599 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on skipped message = False 2024-09-12T01:54:55.599 INFO:teuthology.orchestra.run.smithi135.stdout: fsid = 978259a0-e3d5-47df-8e62-5e92f95d9388 2024-09-12T01:54:55.599 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.599 INFO:teuthology.orchestra.run.smithi135.stdout:[osd] 2024-09-12T01:54:55.599 INFO:teuthology.orchestra.run.smithi135.stdout: osd journal size = 100 2024-09-12T01:54:55.599 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.599 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub load threshold = 5.0 2024-09-12T01:54:55.599 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub max interval = 600 2024-09-12T01:54:55.599 INFO:teuthology.orchestra.run.smithi135.stdout: osd mclock profile = high_recovery_ops 2024-09-12T01:54:55.600 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.600 INFO:teuthology.orchestra.run.smithi135.stdout: osd recover clone overlap = true 2024-09-12T01:54:55.600 INFO:teuthology.orchestra.run.smithi135.stdout: osd recovery max chunk = 1048576 2024-09-12T01:54:55.600 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.600 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug shutdown = true 2024-09-12T01:54:55.600 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug op order = true 2024-09-12T01:54:55.600 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug verify stray on activate = true 2024-09-12T01:54:55.600 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug trim objects = true 2024-09-12T01:54:55.600 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.600 INFO:teuthology.orchestra.run.smithi135.stdout: osd open classes on start = true 2024-09-12T01:54:55.600 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug pg log writeout = true 2024-09-12T01:54:55.600 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.600 INFO:teuthology.orchestra.run.smithi135.stdout: osd deep scrub update digest min age = 30 2024-09-12T01:54:55.600 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.601 INFO:teuthology.orchestra.run.smithi135.stdout: osd map max advance = 10 2024-09-12T01:54:55.601 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.601 INFO:teuthology.orchestra.run.smithi135.stdout: journal zero on create = true 2024-09-12T01:54:55.601 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.601 INFO:teuthology.orchestra.run.smithi135.stdout: filestore ondisk finisher threads = 3 2024-09-12T01:54:55.601 INFO:teuthology.orchestra.run.smithi135.stdout: filestore apply finisher threads = 3 2024-09-12T01:54:55.601 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.601 INFO:teuthology.orchestra.run.smithi135.stdout: bdev debug aio = true 2024-09-12T01:54:55.601 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug misdirected ops = true 2024-09-12T01:54:55.601 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore block size = 96636764160 2024-09-12T01:54:55.601 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore fsck on mount = True 2024-09-12T01:54:55.601 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluefs = 20 2024-09-12T01:54:55.601 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluestore = 20 2024-09-12T01:54:55.601 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-09-12T01:54:55.602 INFO:teuthology.orchestra.run.smithi135.stdout: debug osd = 20 2024-09-12T01:54:55.602 INFO:teuthology.orchestra.run.smithi135.stdout: debug rocksdb = 10 2024-09-12T01:54:55.602 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T01:54:55.602 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd full ratio = 0.9 2024-09-12T01:54:55.602 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd nearfull ratio = 0.8 2024-09-12T01:54:55.602 INFO:teuthology.orchestra.run.smithi135.stdout: osd failsafe full ratio = 0.95 2024-09-12T01:54:55.602 INFO:teuthology.orchestra.run.smithi135.stdout: osd objectstore = bluestore 2024-09-12T01:54:55.602 INFO:teuthology.orchestra.run.smithi135.stdout: osd op complaint time = 180 2024-09-12T01:54:55.602 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.602 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr] 2024-09-12T01:54:55.602 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-09-12T01:54:55.602 INFO:teuthology.orchestra.run.smithi135.stdout: debug mgr = 20 2024-09-12T01:54:55.602 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2024-09-12T01:54:55.602 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2024-09-12T01:54:55.602 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2024-09-12T01:54:55.603 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2024-09-12T01:54:55.603 INFO:teuthology.orchestra.run.smithi135.stdout: mgr/telemetry/nag = false 2024-09-12T01:54:55.603 INFO:teuthology.orchestra.run.smithi135.stdout: debug client = 20 2024-09-12T01:54:55.603 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.603 INFO:teuthology.orchestra.run.smithi135.stdout:[mon] 2024-09-12T01:54:55.603 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-09-12T01:54:55.603 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2024-09-12T01:54:55.603 INFO:teuthology.orchestra.run.smithi135.stdout: debug paxos = 20 2024-09-12T01:54:55.603 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2024-09-12T01:54:55.603 INFO:teuthology.orchestra.run.smithi135.stdout: mon data avail warn = 5 2024-09-12T01:54:55.603 INFO:teuthology.orchestra.run.smithi135.stdout: mon mgr mkfs grace = 240 2024-09-12T01:54:55.603 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2024-09-12T01:54:55.603 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd reporter subtree level = osd 2024-09-12T01:54:55.603 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd prime pg temp = true 2024-09-12T01:54:55.604 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2024-09-12T01:54:55.604 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.604 INFO:teuthology.orchestra.run.smithi135.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T01:54:55.604 INFO:teuthology.orchestra.run.smithi135.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T01:54:55.604 INFO:teuthology.orchestra.run.smithi135.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T01:54:55.604 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.604 INFO:teuthology.orchestra.run.smithi135.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T01:54:55.604 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T01:54:55.604 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T01:54:55.604 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.604 INFO:teuthology.orchestra.run.smithi135.stdout: # 1m isn't quite enough 2024-09-12T01:54:55.604 INFO:teuthology.orchestra.run.smithi135.stdout: mon_down_mkfs_grace = 2m 2024-09-12T01:54:55.604 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.604 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_filestore_osds = false 2024-09-12T01:54:55.605 INFO:teuthology.orchestra.run.smithi135.stdout: mon down mkfs grace = 300 2024-09-12T01:54:55.605 INFO:teuthology.orchestra.run.smithi135.stdout: mon op complaint time = 120 2024-09-12T01:54:55.605 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on pool no app = False 2024-09-12T01:54:55.605 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T01:54:55.605 INFO:teuthology.orchestra.run.smithi135.stdout:[client] 2024-09-12T01:54:55.605 INFO:teuthology.orchestra.run.smithi135.stdout: rgw cache enabled = true 2024-09-12T01:54:55.605 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable ops log = true 2024-09-12T01:54:55.605 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable usage log = true 2024-09-12T01:54:55.605 INFO:teuthology.orchestra.run.smithi135.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T01:54:55.605 INFO:teuthology.orchestra.run.smithi135.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T01:54:55.605 INFO:teuthology.orchestra.run.smithi135.stdout: client mount timeout = 600 2024-09-12T01:54:55.605 INFO:teuthology.orchestra.run.smithi135.stdout: debug client = 20 2024-09-12T01:54:55.605 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-09-12T01:54:55.605 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = "" 2024-09-12T01:54:55.605 INFO:teuthology.orchestra.run.smithi135.stdout: rados mon op timeout = 900 2024-09-12T01:54:55.606 INFO:teuthology.orchestra.run.smithi135.stdout: rados osd op timeout = 900 2024-09-12T01:54:55.606 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.a] 2024-09-12T01:54:55.606 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.b] 2024-09-12T01:54:55.606 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.c] 2024-09-12T01:54:55.606 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2024-09-12T01:54:55.606 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c] 2024-09-12T01:54:55.606 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2024-09-12T01:54:55.606 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d] 2024-09-12T01:54:55.606 INFO:teuthology.orchestra.run.smithi135.stdout:[mds] 2024-09-12T01:54:55.606 INFO:teuthology.orchestra.run.smithi135.stdout: debug mds = 20 2024-09-12T01:54:55.606 INFO:teuthology.orchestra.run.smithi135.stdout: debug mds balancer = 20 2024-09-12T01:54:55.606 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-09-12T01:54:55.606 INFO:teuthology.orchestra.run.smithi135.stdout: mds debug frag = True 2024-09-12T01:54:55.606 INFO:teuthology.orchestra.run.smithi135.stdout: mds debug scatterstat = True 2024-09-12T01:54:55.607 INFO:teuthology.orchestra.run.smithi135.stdout: mds op complaint time = 180 2024-09-12T01:54:55.607 INFO:teuthology.orchestra.run.smithi135.stdout: mds verify scatter = True 2024-09-12T01:54:55.607 INFO:teuthology.orchestra.run.smithi135.stdout: osd op complaint time = 180 2024-09-12T01:54:55.607 INFO:teuthology.orchestra.run.smithi135.stdout: rados mon op timeout = 900 2024-09-12T01:54:55.607 INFO:teuthology.orchestra.run.smithi135.stdout: rados osd op timeout = 900 2024-09-12T01:54:55.608 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T01:54:55.609 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T01:54:55.704 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T01:54:55.704 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:54:55.704 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T01:54:55.720 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:54:55.720 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T01:54:55.776 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:54:55.776 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:54:55.776 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T01:54:55.776 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T01:54:55.852 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:54:55.852 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:54:55.908 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T01:54:55.908 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:54:55.908 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T01:54:55.908 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T01:54:55.946 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:54:55.946 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:54:56.003 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T01:54:56.003 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T01:54:56.003 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T01:54:56.055 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T01:54:56.058 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T01:54:56.121 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T01:54:56.124 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T01:54:56.124 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T01:54:56.177 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T01:54:56.180 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-12T01:54:56.205 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-12T01:54:56.298 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-12T01:54:56.301 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-12T01:54:56.326 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-12T01:54:56.380 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-12T01:54:56.382 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-12T01:54:56.406 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-12T01:54:56.497 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-12T01:54:56.499 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-12T01:54:56.523 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T01:54:56.524 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T01:54:56.566 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T01:54:56.579 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-12T01:54:56.662 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-12T01:54:56.675 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T01:54:56.716 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T01:54:56.728 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-12T01:54:56.809 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-12T01:54:56.822 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T01:54:56.822 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T01:54:56.823 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T01:54:56.849 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T01:54:56.849 INFO:tasks.ceph:role: osd.0 2024-09-12T01:54:56.849 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:54:56.849 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T01:54:56.922 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T01:54:56.922 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T01:54:56.922 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T01:54:56.922 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T01:54:56.922 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T01:54:56.923 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-09-12T01:54:56.923 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T01:54:56.923 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T01:54:56.923 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T01:54:56.923 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T01:54:57.441 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-09-12T01:54:57.444 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-09-12T01:54:57.444 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T01:54:57.557 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T01:54:57.593 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T01:54:57.661 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T01:54:57.661 INFO:tasks.ceph:role: osd.1 2024-09-12T01:54:57.661 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:54:57.661 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T01:54:57.736 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T01:54:57.736 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T01:54:57.736 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T01:54:57.736 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T01:54:57.737 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T01:54:57.737 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-09-12T01:54:57.737 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T01:54:57.737 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T01:54:57.737 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T01:54:57.737 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T01:54:58.194 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-09-12T01:54:58.196 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-09-12T01:54:58.197 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T01:54:58.287 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T01:54:58.317 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T01:54:58.384 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T01:54:58.384 INFO:tasks.ceph:role: osd.2 2024-09-12T01:54:58.384 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:54:58.384 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T01:54:58.457 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T01:54:58.457 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T01:54:58.457 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T01:54:58.457 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T01:54:58.457 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T01:54:58.457 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-09-12T01:54:58.457 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T01:54:58.457 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T01:54:58.458 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T01:54:58.458 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T01:54:58.941 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-09-12T01:54:58.943 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-09-12T01:54:58.943 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T01:54:59.079 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T01:54:59.111 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T01:54:59.177 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T01:54:59.177 INFO:tasks.ceph:role: osd.3 2024-09-12T01:54:59.177 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:54:59.177 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T01:54:59.250 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T01:54:59.250 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T01:54:59.250 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T01:54:59.250 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T01:54:59.250 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T01:54:59.250 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-09-12T01:54:59.250 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T01:54:59.250 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T01:54:59.250 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T01:54:59.251 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T01:54:59.779 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-09-12T01:54:59.781 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-09-12T01:54:59.781 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T01:54:59.937 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T01:54:59.972 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:55:00.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:00.083+0000 7f640de14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T01:55:00.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:00.084+0000 7f640de14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T01:55:00.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:00.084+0000 7f640de14640 -1 bdev(0x555ca2dff800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T01:55:00.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:00.084+0000 7f640de14640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T01:55:03.247 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T01:55:03.278 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:55:03.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:03.371+0000 7fb4c1416640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T01:55:03.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:03.371+0000 7fb4c1416640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T01:55:03.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:03.371+0000 7fb4c1416640 -1 bdev(0x55600c7e7800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T01:55:03.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:03.371+0000 7fb4c1416640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T01:55:06.538 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T01:55:06.568 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:55:06.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:06.660+0000 7fdd87c44640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T01:55:06.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:06.660+0000 7fdd87c44640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T01:55:06.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:06.660+0000 7fdd87c44640 -1 bdev(0x55e4f7779800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T01:55:06.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:06.660+0000 7fdd87c44640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T01:55:09.815 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T01:55:09.847 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:55:09.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:09.938+0000 7f0067a1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T01:55:09.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:09.939+0000 7f0067a1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T01:55:09.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:09.939+0000 7f0067a1c640 -1 bdev(0x558371c75800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T01:55:09.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:09.939+0000 7f0067a1c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T01:55:12.853 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T01:55:12.883 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T01:55:12.913 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T01:55:12.914 INFO:tasks.ceph:role: osd.4 2024-09-12T01:55:12.914 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T01:55:12.914 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T01:55:12.991 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T01:55:12.991 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T01:55:12.991 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T01:55:12.991 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T01:55:12.991 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T01:55:12.991 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-09-12T01:55:12.992 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T01:55:12.992 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T01:55:12.992 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T01:55:12.992 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T01:55:13.493 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-09-12T01:55:13.495 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-09-12T01:55:13.496 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T01:55:13.645 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T01:55:13.678 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T01:55:13.742 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T01:55:13.742 INFO:tasks.ceph:role: osd.5 2024-09-12T01:55:13.743 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T01:55:13.743 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T01:55:13.814 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T01:55:13.815 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T01:55:13.815 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T01:55:13.815 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T01:55:13.815 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T01:55:13.815 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-09-12T01:55:13.815 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T01:55:13.815 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T01:55:13.815 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T01:55:13.815 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T01:55:14.261 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-09-12T01:55:14.263 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-09-12T01:55:14.263 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T01:55:14.345 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T01:55:14.415 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T01:55:14.479 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T01:55:14.479 INFO:tasks.ceph:role: osd.6 2024-09-12T01:55:14.479 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T01:55:14.479 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T01:55:14.551 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T01:55:14.551 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T01:55:14.551 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T01:55:14.551 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T01:55:14.551 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T01:55:14.551 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-09-12T01:55:14.551 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T01:55:14.551 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T01:55:14.552 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T01:55:14.552 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T01:55:15.036 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-09-12T01:55:15.038 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-09-12T01:55:15.038 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T01:55:15.151 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T01:55:15.181 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T01:55:15.246 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T01:55:15.246 INFO:tasks.ceph:role: osd.7 2024-09-12T01:55:15.246 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T01:55:15.246 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T01:55:15.318 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T01:55:15.318 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T01:55:15.318 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T01:55:15.318 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T01:55:15.318 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T01:55:15.318 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-09-12T01:55:15.319 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T01:55:15.319 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T01:55:15.319 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T01:55:15.319 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T01:55:15.819 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-09-12T01:55:15.821 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-09-12T01:55:15.821 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T01:55:15.944 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T01:55:15.974 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:55:16.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:16.072+0000 7fe435117640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T01:55:16.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:16.073+0000 7fe435117640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T01:55:16.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:16.073+0000 7fe435117640 -1 bdev(0x561003ec1800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T01:55:16.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:16.073+0000 7fe435117640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T01:55:18.990 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T01:55:19.017 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:55:19.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:19.106+0000 7f2d8ac0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T01:55:19.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:19.106+0000 7f2d8ac0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T01:55:19.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:19.106+0000 7f2d8ac0d640 -1 bdev(0x55d3bdeed800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T01:55:19.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:19.106+0000 7f2d8ac0d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T01:55:22.017 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T01:55:22.045 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:55:22.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:22.133+0000 7ff8e820d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T01:55:22.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:22.133+0000 7ff8e820d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T01:55:22.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:22.133+0000 7ff8e820d640 -1 bdev(0x557d229f9800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T01:55:22.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:22.133+0000 7ff8e820d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T01:55:23.578 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:55:23.580 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:55:25.551 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T01:55:25.578 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:55:25.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:25.664+0000 7f164611b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T01:55:25.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:25.664+0000 7f164611b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T01:55:25.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:25.664+0000 7f164611b640 -1 bdev(0x5617cd481800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T01:55:25.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:25.664+0000 7f164611b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T01:55:28.823 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T01:55:28.850 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T01:55:28.851 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:55:28.851 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T01:55:28.881 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:55:28.881 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-12T01:55:28.953 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:55:28.954 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-12T01:55:29.024 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:55:29.024 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T01:55:29.094 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:55:29.094 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T01:55:29.164 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:55:29.164 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T01:55:29.233 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:55:29.233 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T01:55:29.301 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:55:29.301 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T01:55:29.331 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:55:29.332 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-12T01:55:29.401 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:55:29.401 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-12T01:55:29.469 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:55:29.470 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T01:55:29.537 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:55:29.537 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T01:55:29.602 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:55:29.602 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T01:55:29.668 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:55:29.668 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T01:55:29.734 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:55:29.734 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T01:55:29.753 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:55:29.753 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-12T01:55:29.812 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:55:29.812 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T01:55:29.828 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:55:29.828 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-12T01:55:29.883 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T01:55:29.884 DEBUG:teuthology.orchestra.run.smithi019:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T01:55:29.889 DEBUG:teuthology.orchestra.run.smithi135:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T01:55:29.927 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.y] 2024-09-12T01:55:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDwSeJmXphnAxAAUnmZ3JPOt1Yzk0zqWh5+kg== 2024-09-12T01:55:29.927 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2024-09-12T01:55:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDwSeJm5rSjChAA4H0OW7ubTgq4vmUaoGvvNA== 2024-09-12T01:55:29.927 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.c] 2024-09-12T01:55:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDwSeJmVLrfERAAlIw2yLSJubtZ1o4NB9IDsg== 2024-09-12T01:55:29.927 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.0] 2024-09-12T01:55:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQD0SeJme7ETBRAA/8v8aJcEzpHYmAPg5Hxdzg== 2024-09-12T01:55:29.928 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.1] 2024-09-12T01:55:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQD3SeJmfXQyFhAALiZjnIoDw+OtH9of5IUu0w== 2024-09-12T01:55:29.928 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.2] 2024-09-12T01:55:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQD6SeJmMDNwJxAABb+94TBxpZx3GovP1g1Q2A== 2024-09-12T01:55:29.928 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.3] 2024-09-12T01:55:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQD9SeJmZMgKOBAAgU+mzTBmPSHE7mUElUA9lA== 2024-09-12T01:55:29.928 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.x] 2024-09-12T01:55:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDwSeJmjx1VBxAAF80kgsMnFJn+gL44QZn6bg== 2024-09-12T01:55:29.928 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.b] 2024-09-12T01:55:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDwSeJmyaCyFhAAV87Ogacs5CmiAuG0p/61Fw== 2024-09-12T01:55:29.928 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.d] 2024-09-12T01:55:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDwSeJmd6a1HRAA04/r87MKfFM1VQvG1Tjj8A== 2024-09-12T01:55:29.928 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.4] 2024-09-12T01:55:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAESuJmnb9kBBAA6PmrEGSckixHv73r9ogheQ== 2024-09-12T01:55:29.929 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.5] 2024-09-12T01:55:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAHSuJmLU1hBhAAlFooSVxCEmIHSjqscaFnhQ== 2024-09-12T01:55:29.929 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.6] 2024-09-12T01:55:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAKSuJmeIj7BxAADTmZtK8dk94LSGa88+xq3Q== 2024-09-12T01:55:29.929 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.7] 2024-09-12T01:55:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQANSuJmw92iJxAAsjNKRSdndTUGmBtaN3g/pQ== 2024-09-12T01:55:29.929 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-09-12T01:55:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDwSeJmfHbXIRAALAvdYAlaB6WxWtubFnlxRw== 2024-09-12T01:55:29.929 INFO:teuthology.orchestra.run.smithi019.stdout:[client.2] 2024-09-12T01:55:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDwSeJmLQSOJxAA2RhDLfjVzPpg1kiJe++WHg== 2024-09-12T01:55:29.929 INFO:teuthology.orchestra.run.smithi019.stdout:[client.1] 2024-09-12T01:55:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDwSeJmOjfDKhAA8h0ldWP6mNPgoqtIejhF+Q== 2024-09-12T01:55:29.929 INFO:teuthology.orchestra.run.smithi019.stdout:[client.3] 2024-09-12T01:55:29.930 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDwSeJmXS5YMBAAXSS+3Omu0PYIz1bJcSxefw== 2024-09-12T01:55:29.946 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.y] 2024-09-12T01:55:29.947 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDwSeJmXphnAxAAUnmZ3JPOt1Yzk0zqWh5+kg== 2024-09-12T01:55:29.947 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2024-09-12T01:55:29.947 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDwSeJm5rSjChAA4H0OW7ubTgq4vmUaoGvvNA== 2024-09-12T01:55:29.947 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c] 2024-09-12T01:55:29.947 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDwSeJmVLrfERAAlIw2yLSJubtZ1o4NB9IDsg== 2024-09-12T01:55:29.947 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.0] 2024-09-12T01:55:29.947 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQD0SeJme7ETBRAA/8v8aJcEzpHYmAPg5Hxdzg== 2024-09-12T01:55:29.947 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.1] 2024-09-12T01:55:29.947 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQD3SeJmfXQyFhAALiZjnIoDw+OtH9of5IUu0w== 2024-09-12T01:55:29.947 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.2] 2024-09-12T01:55:29.947 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQD6SeJmMDNwJxAABb+94TBxpZx3GovP1g1Q2A== 2024-09-12T01:55:29.947 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.3] 2024-09-12T01:55:29.947 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQD9SeJmZMgKOBAAgU+mzTBmPSHE7mUElUA9lA== 2024-09-12T01:55:29.948 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.x] 2024-09-12T01:55:29.948 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDwSeJmjx1VBxAAF80kgsMnFJn+gL44QZn6bg== 2024-09-12T01:55:29.948 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2024-09-12T01:55:29.948 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDwSeJmyaCyFhAAV87Ogacs5CmiAuG0p/61Fw== 2024-09-12T01:55:29.948 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d] 2024-09-12T01:55:29.948 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDwSeJmd6a1HRAA04/r87MKfFM1VQvG1Tjj8A== 2024-09-12T01:55:29.948 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.4] 2024-09-12T01:55:29.948 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAESuJmnb9kBBAA6PmrEGSckixHv73r9ogheQ== 2024-09-12T01:55:29.948 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.5] 2024-09-12T01:55:29.948 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAHSuJmLU1hBhAAlFooSVxCEmIHSjqscaFnhQ== 2024-09-12T01:55:29.948 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.6] 2024-09-12T01:55:29.948 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAKSuJmeIj7BxAADTmZtK8dk94LSGa88+xq3Q== 2024-09-12T01:55:29.948 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.7] 2024-09-12T01:55:29.948 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQANSuJmw92iJxAAsjNKRSdndTUGmBtaN3g/pQ== 2024-09-12T01:55:29.949 INFO:teuthology.orchestra.run.smithi135.stdout:[client.0] 2024-09-12T01:55:29.949 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDwSeJmfHbXIRAALAvdYAlaB6WxWtubFnlxRw== 2024-09-12T01:55:29.949 INFO:teuthology.orchestra.run.smithi135.stdout:[client.2] 2024-09-12T01:55:29.949 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDwSeJmLQSOJxAA2RhDLfjVzPpg1kiJe++WHg== 2024-09-12T01:55:29.949 INFO:teuthology.orchestra.run.smithi135.stdout:[client.1] 2024-09-12T01:55:29.949 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDwSeJmOjfDKhAA8h0ldWP6mNPgoqtIejhF+Q== 2024-09-12T01:55:29.949 INFO:teuthology.orchestra.run.smithi135.stdout:[client.3] 2024-09-12T01:55:29.949 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDwSeJmXS5YMBAAXSS+3Omu0PYIz1bJcSxefw== 2024-09-12T01:55:29.950 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T01:55:29.974 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T01:55:30.042 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T01:55:30.044 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T01:55:30.100 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T01:55:30.103 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T01:55:30.158 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:55:30.160 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:55:30.211 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:55:30.214 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:55:30.309 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:55:30.311 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:55:30.363 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:55:30.365 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:55:30.416 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T01:55:30.418 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T01:55:30.469 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T01:55:30.471 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T01:55:30.525 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T01:55:30.528 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T01:55:30.581 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:55:30.584 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:55:30.635 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:55:30.638 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:55:30.688 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:55:30.691 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:55:30.741 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:55:30.744 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:55:30.795 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T01:55:30.797 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T01:55:30.852 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T01:55:30.854 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T01:55:30.907 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T01:55:30.910 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T01:55:30.964 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T01:55:30.967 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T01:55:31.021 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T01:55:31.021 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T01:55:31.047 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T01:55:31.145 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T01:55:31.171 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T01:55:31.197 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T01:55:31.292 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T01:55:31.317 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T01:55:31.383 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T01:55:31.480 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T01:55:31.505 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:55:31.508 DEBUG:teuthology.orchestra.run.smithi135:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:55:31.561 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T01:55:31.561 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T01:55:31.561 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T01:55:31.565 INFO:tasks.ceph.mon.a:Started 2024-09-12T01:55:31.566 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T01:55:31.566 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T01:55:31.603 INFO:tasks.ceph.mon.b:Started 2024-09-12T01:55:31.603 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T01:55:31.603 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T01:55:31.605 INFO:tasks.ceph.mon.c:Started 2024-09-12T01:55:31.605 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T01:55:31.605 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T01:55:31.606 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T01:55:31.608 INFO:tasks.ceph.mgr.y:Started 2024-09-12T01:55:31.608 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T01:55:31.608 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T01:55:31.610 INFO:tasks.ceph.mgr.x:Started 2024-09-12T01:55:31.610 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T01:55:31.610 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T01:55:31.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.713+0000 7f0e01877640 1 Processor -- start 2024-09-12T01:55:31.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.713+0000 7f0e01877640 1 -- start start 2024-09-12T01:55:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.714+0000 7f0e01877640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc162340 0x7f0dfc06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.714+0000 7f0e01877640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0dfc0cf280 0x7f0dfc162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.714+0000 7f0e01877640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dfc15ff70 con 0x7f0dfc162c60 2024-09-12T01:55:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.714+0000 7f0e01877640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0dfc06de90 con 0x7f0dfc0cf280 2024-09-12T01:55:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.714+0000 7f0e01877640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0dfc0d4d10 con 0x7f0dfc162340 2024-09-12T01:55:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.714+0000 7f0dfa7fc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0dfc0cf280 0x7f0dfc162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.714+0000 7f0dfaffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc162340 0x7f0dfc06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.714+0000 7f0dfa7fc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0dfc0cf280 0x7f0dfc162720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:48156/0 (socket says 172.21.15.19:48156) 2024-09-12T01:55:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.714+0000 7f0dfa7fc640 1 -- 172.21.15.19:0/2626770770 learned_addr learned my addr 172.21.15.19:0/2626770770 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.714+0000 7f0dfaffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc162340 0x7f0dfc06d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:59376/0 (socket says 172.21.15.19:59376) 2024-09-12T01:55:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.714+0000 7f0dfa7fc640 1 -- 172.21.15.19:0/2626770770 >> v2:172.21.15.135:3300/0 conn(0x7f0dfc0cf280 msgr2=0x7f0dfc162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T01:55:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.714+0000 7f0dfa7fc640 1 -- 172.21.15.19:0/2626770770 >> v2:172.21.15.135:3300/0 conn(0x7f0dfc0cf280 msgr2=0x7f0dfc162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:55:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.714+0000 7f0dfa7fc640 1 --2- 172.21.15.19:0/2626770770 >> v2:172.21.15.135:3300/0 conn(0x7f0dfc0cf280 0x7f0dfc162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:55:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.714+0000 7f0dfaffd640 1 -- 172.21.15.19:0/2626770770 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc162340 msgr2=0x7f0dfc06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T01:55:31.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.714+0000 7f0dfaffd640 1 -- 172.21.15.19:0/2626770770 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc162340 msgr2=0x7f0dfc06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:55:31.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.714+0000 7f0dfaffd640 1 --2- 172.21.15.19:0/2626770770 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc162340 0x7f0dfc06d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:55:31.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.714+0000 7f0dfa7fc640 1 --2- 172.21.15.19:0/2626770770 >> v2:172.21.15.135:3300/0 conn(0x7f0dfc0cf280 0x7f0dfc162720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:55:31.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.714+0000 7f0dfaffd640 1 --2- 172.21.15.19:0/2626770770 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc162340 0x7f0dfc06d740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:55:31.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.882+0000 7f0df9ffb640 1 -- 172.21.15.19:0/2626770770 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632224847 0 0) 0x7f0dfc15ff70 con 0x7f0dfc162c60 2024-09-12T01:55:31.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.882+0000 7f0df9ffb640 1 -- 172.21.15.19:0/2626770770 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0de8003520 con 0x7f0dfc162c60 2024-09-12T01:55:31.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0df9ffb640 1 -- 172.21.15.19:0/2626770770 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1605109346 0 0) 0x7f0de8003520 con 0x7f0dfc162c60 2024-09-12T01:55:31.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0df9ffb640 1 -- 172.21.15.19:0/2626770770 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc162340 msgr2=0x7f0dfc06d740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:55:31.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0df9ffb640 1 --2- 172.21.15.19:0/2626770770 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc162340 0x7f0dfc06d740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0df9ffb640 1 -- 172.21.15.19:0/2626770770 >> v2:172.21.15.135:3300/0 conn(0x7f0dfc0cf280 msgr2=0x7f0dfc162720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0df9ffb640 1 --2- 172.21.15.19:0/2626770770 >> v2:172.21.15.135:3300/0 conn(0x7f0dfc0cf280 0x7f0dfc162720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0df9ffb640 1 -- 172.21.15.19:0/2626770770 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dfc0d4ff0 con 0x7f0dfc162c60 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0df9ffb640 1 -- 172.21.15.19:0/2626770770 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f0dec001670 con 0x7f0dfc162c60 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0df9ffb640 1 -- 172.21.15.19:0/2626770770 >> v1:172.21.15.135:6789/0 conn(0x7f0dfc162c60 legacy=0x7f0dfc0d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0df9ffb640 1 --2- 172.21.15.19:0/2626770770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de80039b0 0x7f0de8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0df9ffb640 1 --2- 172.21.15.19:0/2626770770 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc162340 0x7f0de8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0df9ffb640 1 --2- 172.21.15.19:0/2626770770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0de8004d40 0x7f0de80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0df9ffb640 1 -- 172.21.15.19:0/2626770770 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc06de90 con 0x7f0de8004d40 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0df9ffb640 1 -- 172.21.15.19:0/2626770770 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc0d4d10 con 0x7f0de80039b0 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0df9ffb640 1 -- 172.21.15.19:0/2626770770 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0de800bb50 con 0x7f0dfc162340 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0dfaffd640 1 --2- 172.21.15.19:0/2626770770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de80039b0 0x7f0de8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0dfb7fe640 1 --2- 172.21.15.19:0/2626770770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0de8004d40 0x7f0de80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0dfa7fc640 1 --2- 172.21.15.19:0/2626770770 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc162340 0x7f0de8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0dfaffd640 1 -- 172.21.15.19:0/2626770770 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc162340 msgr2=0x7f0de8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.888+0000 7f0dfaffd640 1 --2- 172.21.15.19:0/2626770770 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc162340 0x7f0de8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.889+0000 7f0dfaffd640 1 -- 172.21.15.19:0/2626770770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0de8004d40 msgr2=0x7f0de80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.889+0000 7f0dfaffd640 1 --2- 172.21.15.19:0/2626770770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0de8004d40 0x7f0de80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.889+0000 7f0dfaffd640 1 -- 172.21.15.19:0/2626770770 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de8003520 con 0x7f0de80039b0 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.889+0000 7f0dfb7fe640 1 --2- 172.21.15.19:0/2626770770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0de8004d40 0x7f0de80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.889+0000 7f0dfaffd640 1 --2- 172.21.15.19:0/2626770770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de80039b0 0x7f0de8003dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0df4009fd0 tx=0x7f0de8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83e30557cb5da49e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.890+0000 7f0df9ffb640 1 -- 172.21.15.19:0/2626770770 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4033070 con 0x7f0de80039b0 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.890+0000 7f0df9ffb640 1 -- 172.21.15.19:0/2626770770 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df402f650 con 0x7f0de80039b0 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.890+0000 7f0df9ffb640 1 -- 172.21.15.19:0/2626770770 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4009bd0 con 0x7f0de80039b0 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.891+0000 7f0e01877640 1 -- 172.21.15.19:0/2626770770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de80039b0 msgr2=0x7f0de8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.891+0000 7f0e01877640 1 --2- 172.21.15.19:0/2626770770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de80039b0 0x7f0de8003dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0df4009fd0 tx=0x7f0de8005830 comp rx=0 tx=0).stop 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.891+0000 7f0dfb7fe640 1 -- 172.21.15.19:0/2626770770 reap_dead start 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.891+0000 7f0e01877640 1 -- 172.21.15.19:0/2626770770 shutdown_connections 2024-09-12T01:55:31.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.891+0000 7f0e01877640 1 -- 172.21.15.19:0/2626770770 >> 172.21.15.19:0/2626770770 conn(0x7f0dfc08bfc0 msgr2=0x7f0dfc0d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:31.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.891+0000 7f0e01877640 1 -- 172.21.15.19:0/2626770770 shutdown_connections 2024-09-12T01:55:31.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.891+0000 7f0e01877640 1 -- 172.21.15.19:0/2626770770 wait complete. 2024-09-12T01:55:31.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.893+0000 7f0e01877640 1 Processor -- start 2024-09-12T01:55:31.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.893+0000 7f0e01877640 1 -- start start 2024-09-12T01:55:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.894+0000 7f0e01877640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de80039b0 0x7f0dfc156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.894+0000 7f0e01877640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dfc0ca290 0x7f0dfc0ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.894+0000 7f0e01877640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc15acf0 0x7f0dfc15b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.894+0000 7f0e01877640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc0cf6c0 con 0x7f0dfc0ca290 2024-09-12T01:55:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.894+0000 7f0e01877640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc0d52d0 con 0x7f0de80039b0 2024-09-12T01:55:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.894+0000 7f0e01877640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0dfc163110 con 0x7f0dfc15acf0 2024-09-12T01:55:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.894+0000 7f0dfaffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de80039b0 0x7f0dfc156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.894+0000 7f0dfa7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dfc0ca290 0x7f0dfc0ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.894+0000 7f0dfaffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de80039b0 0x7f0dfc156310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:48198/0 (socket says 172.21.15.19:48198) 2024-09-12T01:55:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.894+0000 7f0dfaffd640 1 -- 172.21.15.19:0/3718431403 learned_addr learned my addr 172.21.15.19:0/3718431403 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.894+0000 7f0dfb7fe640 1 --2- 172.21.15.19:0/3718431403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc15acf0 0x7f0dfc15b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.895+0000 7f0dfaffd640 1 -- 172.21.15.19:0/3718431403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc15acf0 msgr2=0x7f0dfc15b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.895+0000 7f0dfaffd640 1 --2- 172.21.15.19:0/3718431403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc15acf0 0x7f0dfc15b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.895+0000 7f0dfaffd640 1 -- 172.21.15.19:0/3718431403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dfc0ca290 msgr2=0x7f0dfc0ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.895+0000 7f0dfaffd640 1 --2- 172.21.15.19:0/3718431403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dfc0ca290 0x7f0dfc0ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.895+0000 7f0dfaffd640 1 -- 172.21.15.19:0/3718431403 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dfc0cdff0 con 0x7f0de80039b0 2024-09-12T01:55:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.895+0000 7f0dfb7fe640 1 --2- 172.21.15.19:0/3718431403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc15acf0 0x7f0dfc15b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.895+0000 7f0dfa7fc640 1 --2- 172.21.15.19:0/3718431403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dfc0ca290 0x7f0dfc0ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.895+0000 7f0dfaffd640 1 --2- 172.21.15.19:0/3718431403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de80039b0 0x7f0dfc156310 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0df40073f0 tx=0x7f0df4004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.895+0000 7f0df3fff640 1 -- 172.21.15.19:0/3718431403 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4046070 con 0x7f0de80039b0 2024-09-12T01:55:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.895+0000 7f0df3fff640 1 -- 172.21.15.19:0/3718431403 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df402f800 con 0x7f0de80039b0 2024-09-12T01:55:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.895+0000 7f0e01877640 1 -- 172.21.15.19:0/3718431403 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dfc0c81a0 con 0x7f0de80039b0 2024-09-12T01:55:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.895+0000 7f0df3fff640 1 -- 172.21.15.19:0/3718431403 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4033040 con 0x7f0de80039b0 2024-09-12T01:55:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.895+0000 7f0e01877640 1 -- 172.21.15.19:0/3718431403 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dfc0c8760 con 0x7f0de80039b0 2024-09-12T01:55:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.895+0000 7f0df3fff640 1 -- 172.21.15.19:0/3718431403 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0df4049070 con 0x7f0de80039b0 2024-09-12T01:55:31.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.895+0000 7f0df3fff640 1 -- 172.21.15.19:0/3718431403 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0df404bb40 con 0x7f0de80039b0 2024-09-12T01:55:31.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.896+0000 7f0e01877640 1 -- 172.21.15.19:0/3718431403 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dfc075670 con 0x7f0de80039b0 2024-09-12T01:55:31.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.899+0000 7f0df3fff640 1 -- 172.21.15.19:0/3718431403 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0dfc075670 con 0x7f0de80039b0 2024-09-12T01:55:31.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.963+0000 7f0e01877640 1 -- 172.21.15.19:0/3718431403 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f0dfc162720 con 0x7f0de80039b0 2024-09-12T01:55:31.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.969+0000 7f0df3fff640 1 -- 172.21.15.19:0/3718431403 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f0df4050080 con 0x7f0de80039b0 2024-09-12T01:55:31.970 INFO:teuthology.orchestra.run.smithi019.stderr:adjusted tunables profile to default 2024-09-12T01:55:31.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.970+0000 7f0e01877640 1 -- 172.21.15.19:0/3718431403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de80039b0 msgr2=0x7f0dfc156310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.970+0000 7f0e01877640 1 --2- 172.21.15.19:0/3718431403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de80039b0 0x7f0dfc156310 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0df40073f0 tx=0x7f0df4004ab0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.970+0000 7f0e01877640 1 -- 172.21.15.19:0/3718431403 shutdown_connections 2024-09-12T01:55:31.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.970+0000 7f0e01877640 1 --2- 172.21.15.19:0/3718431403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dfc15acf0 0x7f0dfc15b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.970+0000 7f0e01877640 1 --2- 172.21.15.19:0/3718431403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dfc0ca290 0x7f0dfc0ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.970+0000 7f0e01877640 1 --2- 172.21.15.19:0/3718431403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de80039b0 0x7f0dfc156310 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.970+0000 7f0e01877640 1 -- 172.21.15.19:0/3718431403 >> 172.21.15.19:0/3718431403 conn(0x7f0dfc08bfc0 msgr2=0x7f0dfc0d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:31.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.970+0000 7f0e01877640 1 -- 172.21.15.19:0/3718431403 shutdown_connections 2024-09-12T01:55:31.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:31.970+0000 7f0e01877640 1 -- 172.21.15.19:0/3718431403 wait complete. 2024-09-12T01:55:31.981 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T01:55:31.982 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T01:55:31.982 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:55:31.982 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T01:55:31.989 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:31.988+0000 7f355c610040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:55:32.008 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:55:32.008 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T01:55:32.029 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:32.029+0000 7f355c610040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:55:32.074 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:55:32.074 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T01:55:32.107 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:32.107+0000 7efee732b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:55:32.133 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:55:32.134 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T01:55:32.152 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:32.152+0000 7efee732b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:55:32.167 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:32.167+0000 7f355c610040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:55:32.177 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:55:32.177 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T01:55:32.202 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:55:32.202 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T01:55:32.220 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:32.219+0000 7f355c610040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:55:32.244 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:55:32.244 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T01:55:32.302 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:32.302+0000 7efee732b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:55:32.309 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:55:32.310 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T01:55:32.354 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:32.354+0000 7efee732b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:55:32.374 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 19d26b01-4e11-47cf-a738-ba110c0e5c99 0 2024-09-12T01:55:32.393 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:32.392+0000 7f355c610040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:55:32.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.490+0000 7fc1a218d640 1 Processor -- start 2024-09-12T01:55:32.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.490+0000 7fc1a218d640 1 -- start start 2024-09-12T01:55:32.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.491+0000 7fc1a218d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc19c15e520 0x7fc19c0b6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:32.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.491+0000 7fc1a218d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc19c15e900 0x7fc19c06dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:32.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.491+0000 7fc1a218d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc19c0b6fa0 con 0x7fc19c09aa30 2024-09-12T01:55:32.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.491+0000 7fc1a218d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc19c0b7280 con 0x7fc19c15e520 2024-09-12T01:55:32.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.491+0000 7fc1a218d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc19c0b7560 con 0x7fc19c15e900 2024-09-12T01:55:32.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.491+0000 7fc19b7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc19c15e520 0x7fc19c0b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:32.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.491+0000 7fc193fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc19c15e900 0x7fc19c06dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:32.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.491+0000 7fc19b7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc19c15e520 0x7fc19c0b6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51536/0 (socket says 172.21.15.135:51536) 2024-09-12T01:55:32.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.491+0000 7fc193fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc19c15e900 0x7fc19c06dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:41982/0 (socket says 172.21.15.135:41982) 2024-09-12T01:55:32.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.491+0000 7fc19b7fe640 1 -- 172.21.15.135:0/3189837369 learned_addr learned my addr 172.21.15.135:0/3189837369 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-12T01:55:32.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.491+0000 7fc19b7fe640 1 -- 172.21.15.135:0/3189837369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc19c15e900 msgr2=0x7fc19c06dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:32.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.491+0000 7fc19b7fe640 1 --2- 172.21.15.135:0/3189837369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc19c15e900 0x7fc19c06dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.491+0000 7fc19b7fe640 1 -- 172.21.15.135:0/3189837369 >> v1:172.21.15.135:6789/0 conn(0x7fc19c09aa30 legacy=0x7fc19c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:32.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.491+0000 7fc19b7fe640 1 -- 172.21.15.135:0/3189837369 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19c0af3b0 con 0x7fc19c15e520 2024-09-12T01:55:32.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.491+0000 7fc19affd640 1 -- 172.21.15.135:0/3189837369 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3360756234 0 0) 0x7fc19c0b6fa0 con 0x7fc19c09aa30 2024-09-12T01:55:32.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.492+0000 7fc193fff640 1 --2- 172.21.15.135:0/3189837369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc19c15e900 0x7fc19c06dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:32.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.492+0000 7fc19b7fe640 1 --2- 172.21.15.135:0/3189837369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc19c15e520 0x7fc19c0b6930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009870 tx=0x7fc18c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42d00ff6c8510be2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:32.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.492+0000 7fc19affd640 1 -- 172.21.15.135:0/3189837369 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c037070 con 0x7fc19c15e520 2024-09-12T01:55:32.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.492+0000 7fc19affd640 1 -- 172.21.15.135:0/3189837369 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18c032440 con 0x7fc19c15e520 2024-09-12T01:55:32.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.492+0000 7fc19affd640 1 -- 172.21.15.135:0/3189837369 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c032810 con 0x7fc19c15e520 2024-09-12T01:55:32.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.493+0000 7fc1a218d640 1 -- 172.21.15.135:0/3189837369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc19c15e520 msgr2=0x7fc19c0b6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:32.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.493+0000 7fc1a218d640 1 --2- 172.21.15.135:0/3189837369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc19c15e520 0x7fc19c0b6930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009870 tx=0x7fc18c02a1c0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.493+0000 7fc1a218d640 1 -- 172.21.15.135:0/3189837369 shutdown_connections 2024-09-12T01:55:32.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.493+0000 7fc1a218d640 1 --2- 172.21.15.135:0/3189837369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc19c15e900 0x7fc19c06dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.493+0000 7fc1a218d640 1 --2- 172.21.15.135:0/3189837369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc19c15e520 0x7fc19c0b6930 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.493+0000 7fc1a218d640 1 -- 172.21.15.135:0/3189837369 >> 172.21.15.135:0/3189837369 conn(0x7fc19c0b7970 msgr2=0x7fc19c0b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:32.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.493+0000 7fc1a218d640 1 -- 172.21.15.135:0/3189837369 shutdown_connections 2024-09-12T01:55:32.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.493+0000 7fc1a218d640 1 -- 172.21.15.135:0/3189837369 wait complete. 2024-09-12T01:55:32.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.494+0000 7fc1a218d640 1 Processor -- start 2024-09-12T01:55:32.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.494+0000 7fc1a218d640 1 -- start start 2024-09-12T01:55:32.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.495+0000 7fc1a218d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc19c09aa30 0x7fc19c1f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:32.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.495+0000 7fc1a218d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc19c15e520 0x7fc19c160da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:32.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.495+0000 7fc1a218d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc19c15e900 0x7fc19c1612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:32.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.495+0000 7fc1a218d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c0b0a60 con 0x7fc19c15e520 2024-09-12T01:55:32.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.495+0000 7fc1a218d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c0b08e0 con 0x7fc19c15e900 2024-09-12T01:55:32.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.495+0000 7fc1a218d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc19c0b0be0 con 0x7fc19c09aa30 2024-09-12T01:55:32.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.495+0000 7fc19b7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc19c09aa30 0x7fc19c1f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:32.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.495+0000 7fc19bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc19c15e900 0x7fc19c1612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:32.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.495+0000 7fc19b7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc19c09aa30 0x7fc19c1f7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:41988/0 (socket says 172.21.15.135:41988) 2024-09-12T01:55:32.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.495+0000 7fc19b7fe640 1 -- 172.21.15.135:0/804291875 learned_addr learned my addr 172.21.15.135:0/804291875 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-12T01:55:32.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.495+0000 7fc193fff640 1 --2- 172.21.15.135:0/804291875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc19c15e520 0x7fc19c160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:32.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.495+0000 7fc19b7fe640 1 -- 172.21.15.135:0/804291875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc19c15e900 msgr2=0x7fc19c1612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:32.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.495+0000 7fc19b7fe640 1 --2- 172.21.15.135:0/804291875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc19c15e900 0x7fc19c1612e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.495+0000 7fc19b7fe640 1 -- 172.21.15.135:0/804291875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc19c15e520 msgr2=0x7fc19c160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:32.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.495+0000 7fc19b7fe640 1 --2- 172.21.15.135:0/804291875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc19c15e520 0x7fc19c160da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.495+0000 7fc19b7fe640 1 -- 172.21.15.135:0/804291875 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19c15efb0 con 0x7fc19c09aa30 2024-09-12T01:55:32.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.496+0000 7fc19b7fe640 1 --2- 172.21.15.135:0/804291875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc19c09aa30 0x7fc19c1f7f10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009870 tx=0x7fc18c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:32.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.496+0000 7fc198ff9640 1 -- 172.21.15.135:0/804291875 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c037040 con 0x7fc19c09aa30 2024-09-12T01:55:32.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.496+0000 7fc198ff9640 1 -- 172.21.15.135:0/804291875 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18c004250 con 0x7fc19c09aa30 2024-09-12T01:55:32.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.496+0000 7fc1a218d640 1 -- 172.21.15.135:0/804291875 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19c15f290 con 0x7fc19c09aa30 2024-09-12T01:55:32.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.496+0000 7fc198ff9640 1 -- 172.21.15.135:0/804291875 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c003610 con 0x7fc19c09aa30 2024-09-12T01:55:32.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.496+0000 7fc1a218d640 1 -- 172.21.15.135:0/804291875 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc19c15f850 con 0x7fc19c09aa30 2024-09-12T01:55:32.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.496+0000 7fc198ff9640 1 -- 172.21.15.135:0/804291875 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc18c02ad10 con 0x7fc19c09aa30 2024-09-12T01:55:32.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.496+0000 7fc198ff9640 1 -- 172.21.15.135:0/804291875 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fc18c03dd50 con 0x7fc19c09aa30 2024-09-12T01:55:32.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.497+0000 7fc1a218d640 1 -- 172.21.15.135:0/804291875 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc19c0b6930 con 0x7fc19c09aa30 2024-09-12T01:55:32.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.499+0000 7fc198ff9640 1 -- 172.21.15.135:0/804291875 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc18c003d70 con 0x7fc19c09aa30 2024-09-12T01:55:32.509 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:32.509+0000 7f355c610040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:55:32.523 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:32.523+0000 7efee732b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:55:32.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.567+0000 7fc1a218d640 1 -- 172.21.15.135:0/804291875 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "19d26b01-4e11-47cf-a738-ba110c0e5c99", "id": 0} v 0) -- 0x7fc19c0b4160 con 0x7fc19c09aa30 2024-09-12T01:55:32.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.572+0000 7fc198ff9640 1 -- 172.21.15.135:0/804291875 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "19d26b01-4e11-47cf-a738-ba110c0e5c99", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fc18c03d4e0 con 0x7fc19c09aa30 2024-09-12T01:55:32.574 INFO:teuthology.orchestra.run.smithi135.stdout:0 2024-09-12T01:55:32.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.573+0000 7fc1a218d640 1 -- 172.21.15.135:0/804291875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc19c09aa30 msgr2=0x7fc19c1f7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:32.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.573+0000 7fc1a218d640 1 --2- 172.21.15.135:0/804291875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc19c09aa30 0x7fc19c1f7f10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009870 tx=0x7fc18c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.573+0000 7fc1a218d640 1 -- 172.21.15.135:0/804291875 shutdown_connections 2024-09-12T01:55:32.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.573+0000 7fc1a218d640 1 --2- 172.21.15.135:0/804291875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc19c15e900 0x7fc19c1612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.573+0000 7fc1a218d640 1 --2- 172.21.15.135:0/804291875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc19c15e520 0x7fc19c160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.573+0000 7fc1a218d640 1 --2- 172.21.15.135:0/804291875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc19c09aa30 0x7fc19c1f7f10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.573+0000 7fc1a218d640 1 -- 172.21.15.135:0/804291875 >> 172.21.15.135:0/804291875 conn(0x7fc19c0b7970 msgr2=0x7fc19c15c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:32.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.574+0000 7fc1a218d640 1 -- 172.21.15.135:0/804291875 shutdown_connections 2024-09-12T01:55:32.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.574+0000 7fc1a218d640 1 -- 172.21.15.135:0/804291875 wait complete. 2024-09-12T01:55:32.585 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 038660b9-e3de-4974-8439-69e04b14581a 1 2024-09-12T01:55:32.639 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:32.638+0000 7efee732b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:55:32.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.682+0000 7f1a6649b640 1 Processor -- start 2024-09-12T01:55:32.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.682+0000 7f1a6649b640 1 -- start start 2024-09-12T01:55:32.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.683+0000 7f1a6649b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a60161dc0 0x7f1a600b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:32.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.683+0000 7f1a6649b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1a600b5f40 0x7f1a6015e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:32.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.683+0000 7f1a6649b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a6006c970 con 0x7f1a6006be80 2024-09-12T01:55:32.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.683+0000 7f1a6649b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f1a600b6700 con 0x7f1a600b5f40 2024-09-12T01:55:32.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.683+0000 7f1a6649b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1a600b6420 con 0x7f1a60161dc0 2024-09-12T01:55:32.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.683+0000 7f1a64a38640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1a600b5f40 0x7f1a6015e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:32.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.683+0000 7f1a5f7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a60161dc0 0x7f1a600b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:32.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.683+0000 7f1a64a38640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1a600b5f40 0x7f1a6015e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51550/0 (socket says 172.21.15.135:51550) 2024-09-12T01:55:32.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.683+0000 7f1a5f7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a60161dc0 0x7f1a600b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:41992/0 (socket says 172.21.15.135:41992) 2024-09-12T01:55:32.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.683+0000 7f1a5ffff640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f1a6006be80 0x7f1a6006c260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37136/0 (socket says 172.21.15.135:37136) 2024-09-12T01:55:32.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.683+0000 7f1a64a38640 1 -- 172.21.15.135:0/986417362 learned_addr learned my addr 172.21.15.135:0/986417362 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-12T01:55:32.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.684+0000 7f1a64a38640 1 -- 172.21.15.135:0/986417362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a60161dc0 msgr2=0x7f1a600b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:32.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.684+0000 7f1a64a38640 1 --2- 172.21.15.135:0/986417362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a60161dc0 0x7f1a600b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.684+0000 7f1a64a38640 1 -- 172.21.15.135:0/986417362 >> v1:172.21.15.135:6789/0 conn(0x7f1a6006be80 legacy=0x7f1a6006c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:32.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.684+0000 7f1a64a38640 1 -- 172.21.15.135:0/986417362 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a601602d0 con 0x7f1a600b5f40 2024-09-12T01:55:32.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.684+0000 7f1a5effd640 1 -- 172.21.15.135:0/986417362 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 812352111 0 0) 0x7f1a6006c970 con 0x7f1a6006be80 2024-09-12T01:55:32.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.684+0000 7f1a5f7fe640 1 --2- 172.21.15.135:0/986417362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a60161dc0 0x7f1a600b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:32.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.684+0000 7f1a64a38640 1 --2- 172.21.15.135:0/986417362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a600b5f40 0x7f1a6015e680 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009e50 tx=0x7f1a5802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7dbe45cab6e63ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:32.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.684+0000 7f1a5effd640 1 -- 172.21.15.135:0/986417362 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a58036070 con 0x7f1a600b5f40 2024-09-12T01:55:32.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.684+0000 7f1a5effd640 1 -- 172.21.15.135:0/986417362 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a58031600 con 0x7f1a600b5f40 2024-09-12T01:55:32.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.684+0000 7f1a5effd640 1 -- 172.21.15.135:0/986417362 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a580319d0 con 0x7f1a600b5f40 2024-09-12T01:55:32.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.685+0000 7f1a6649b640 1 -- 172.21.15.135:0/986417362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a600b5f40 msgr2=0x7f1a6015e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:32.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.685+0000 7f1a6649b640 1 --2- 172.21.15.135:0/986417362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a600b5f40 0x7f1a6015e680 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009e50 tx=0x7f1a5802a680 comp rx=0 tx=0).stop 2024-09-12T01:55:32.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.685+0000 7f1a6649b640 1 -- 172.21.15.135:0/986417362 shutdown_connections 2024-09-12T01:55:32.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.685+0000 7f1a6649b640 1 --2- 172.21.15.135:0/986417362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a60161dc0 0x7f1a600b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.685+0000 7f1a6649b640 1 --2- 172.21.15.135:0/986417362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a600b5f40 0x7f1a6015e680 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.685+0000 7f1a6649b640 1 -- 172.21.15.135:0/986417362 >> 172.21.15.135:0/986417362 conn(0x7f1a600734b0 msgr2=0x7f1a600b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:32.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.685+0000 7f1a6649b640 1 -- 172.21.15.135:0/986417362 shutdown_connections 2024-09-12T01:55:32.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.685+0000 7f1a6649b640 1 -- 172.21.15.135:0/986417362 wait complete. 2024-09-12T01:55:32.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.686+0000 7f1a6649b640 1 Processor -- start 2024-09-12T01:55:32.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.687+0000 7f1a6649b640 1 -- start start 2024-09-12T01:55:32.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.687+0000 7f1a6649b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a6006be80 0x7f1a601f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:32.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.687+0000 7f1a6649b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a600b5f40 0x7f1a601f8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:32.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.687+0000 7f1a6649b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a60161dc0 0x7f1a601598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:32.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.687+0000 7f1a6649b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6015ebc0 con 0x7f1a600b5f40 2024-09-12T01:55:32.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.687+0000 7f1a6649b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1a60160890 con 0x7f1a6006be80 2024-09-12T01:55:32.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.687+0000 7f1a6649b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6015ed40 con 0x7f1a60161dc0 2024-09-12T01:55:32.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.687+0000 7f1a5ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a6006be80 0x7f1a601f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:32.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.687+0000 7f1a5ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a6006be80 0x7f1a601f7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51564/0 (socket says 172.21.15.135:51564) 2024-09-12T01:55:32.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.687+0000 7f1a64a38640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a60161dc0 0x7f1a601598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:32.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.687+0000 7f1a5ffff640 1 -- 172.21.15.135:0/164779651 learned_addr learned my addr 172.21.15.135:0/164779651 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-12T01:55:32.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.687+0000 7f1a5f7fe640 1 --2- 172.21.15.135:0/164779651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a600b5f40 0x7f1a601f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:32.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.688+0000 7f1a5ffff640 1 -- 172.21.15.135:0/164779651 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a60161dc0 msgr2=0x7f1a601598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:32.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.688+0000 7f1a5ffff640 1 --2- 172.21.15.135:0/164779651 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a60161dc0 0x7f1a601598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.688+0000 7f1a5ffff640 1 -- 172.21.15.135:0/164779651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a600b5f40 msgr2=0x7f1a601f8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:32.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.688+0000 7f1a5ffff640 1 --2- 172.21.15.135:0/164779651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a600b5f40 0x7f1a601f8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.688+0000 7f1a5ffff640 1 -- 172.21.15.135:0/164779651 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a600b1450 con 0x7f1a6006be80 2024-09-12T01:55:32.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.688+0000 7f1a64a38640 1 --2- 172.21.15.135:0/164779651 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a60161dc0 0x7f1a601598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:32.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.688+0000 7f1a5f7fe640 1 --2- 172.21.15.135:0/164779651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a600b5f40 0x7f1a601f8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:32.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.688+0000 7f1a5ffff640 1 --2- 172.21.15.135:0/164779651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a6006be80 0x7f1a601f7cc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000c4d0 tx=0x7f1a5000c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:32.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.688+0000 7f1a5cff9640 1 -- 172.21.15.135:0/164779651 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a50018070 con 0x7f1a6006be80 2024-09-12T01:55:32.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.688+0000 7f1a5cff9640 1 -- 172.21.15.135:0/164779651 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a50007500 con 0x7f1a6006be80 2024-09-12T01:55:32.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.688+0000 7f1a6649b640 1 -- 172.21.15.135:0/164779651 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a600b0460 con 0x7f1a6006be80 2024-09-12T01:55:32.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.688+0000 7f1a5cff9640 1 -- 172.21.15.135:0/164779651 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a50004a20 con 0x7f1a6006be80 2024-09-12T01:55:32.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.688+0000 7f1a6649b640 1 -- 172.21.15.135:0/164779651 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a600b16f0 con 0x7f1a6006be80 2024-09-12T01:55:32.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.688+0000 7f1a5cff9640 1 -- 172.21.15.135:0/164779651 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1a5001b070 con 0x7f1a6006be80 2024-09-12T01:55:32.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.688+0000 7f1a5cff9640 1 -- 172.21.15.135:0/164779651 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f1a500127b0 con 0x7f1a6006be80 2024-09-12T01:55:32.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.689+0000 7f1a6649b640 1 -- 172.21.15.135:0/164779651 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a6015e680 con 0x7f1a6006be80 2024-09-12T01:55:32.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.691+0000 7f1a5cff9640 1 -- 172.21.15.135:0/164779651 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1a5001d440 con 0x7f1a6006be80 2024-09-12T01:55:32.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.760+0000 7f1a6649b640 1 -- 172.21.15.135:0/164779651 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "038660b9-e3de-4974-8439-69e04b14581a", "id": 1} v 0) -- 0x7f1a6015d6e0 con 0x7f1a6006be80 2024-09-12T01:55:32.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.766+0000 7f1a5cff9640 1 -- 172.21.15.135:0/164779651 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "038660b9-e3de-4974-8439-69e04b14581a", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f1a5001d7b0 con 0x7f1a6006be80 2024-09-12T01:55:32.767 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-09-12T01:55:32.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.767+0000 7f1a6649b640 1 -- 172.21.15.135:0/164779651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a6006be80 msgr2=0x7f1a601f7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:32.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.767+0000 7f1a6649b640 1 --2- 172.21.15.135:0/164779651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a6006be80 0x7f1a601f7cc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000c4d0 tx=0x7f1a5000c990 comp rx=0 tx=0).stop 2024-09-12T01:55:32.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.767+0000 7f1a6649b640 1 -- 172.21.15.135:0/164779651 shutdown_connections 2024-09-12T01:55:32.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.767+0000 7f1a6649b640 1 --2- 172.21.15.135:0/164779651 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a60161dc0 0x7f1a601598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.767+0000 7f1a6649b640 1 --2- 172.21.15.135:0/164779651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a600b5f40 0x7f1a601f8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.767+0000 7f1a6649b640 1 --2- 172.21.15.135:0/164779651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a6006be80 0x7f1a601f7cc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.767+0000 7f1a6649b640 1 -- 172.21.15.135:0/164779651 >> 172.21.15.135:0/164779651 conn(0x7f1a600734b0 msgr2=0x7f1a6006f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:32.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.767+0000 7f1a6649b640 1 -- 172.21.15.135:0/164779651 shutdown_connections 2024-09-12T01:55:32.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.767+0000 7f1a6649b640 1 -- 172.21.15.135:0/164779651 wait complete. 2024-09-12T01:55:32.778 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new ad97b147-39cd-4be0-817e-2afd31daf2a7 2 2024-09-12T01:55:32.853 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:32.852+0000 7f355c610040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:55:32.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.875+0000 7fa2e72e6640 1 Processor -- start 2024-09-12T01:55:32.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.876+0000 7fa2e72e6640 1 -- start start 2024-09-12T01:55:32.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.876+0000 7fa2e72e6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2e0162e30 0x7fa2e006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:32.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.876+0000 7fa2e72e6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa2e00cf280 0x7fa2e00d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:32.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.876+0000 7fa2e72e6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2e015ff70 con 0x7fa2e0162340 2024-09-12T01:55:32.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.876+0000 7fa2e72e6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa2e006de90 con 0x7fa2e00cf280 2024-09-12T01:55:32.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.876+0000 7fa2e72e6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e0163270 con 0x7fa2e0162e30 2024-09-12T01:55:32.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.876+0000 7fa2e4881640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2e0162e30 0x7fa2e006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:32.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.876+0000 7fa2e5883640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa2e00cf280 0x7fa2e00d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:32.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.877+0000 7fa2e4881640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2e0162e30 0x7fa2e006d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:42020/0 (socket says 172.21.15.135:42020) 2024-09-12T01:55:32.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.877+0000 7fa2e4881640 1 -- 172.21.15.135:0/1378940477 learned_addr learned my addr 172.21.15.135:0/1378940477 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-12T01:55:32.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.877+0000 7fa2e5082640 1 --1- 172.21.15.135:0/1378940477 >> v1:172.21.15.135:6789/0 conn(0x7fa2e0162340 0x7fa2e0162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37140/0 (socket says 172.21.15.135:37140) 2024-09-12T01:55:32.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.877+0000 7fa2e4881640 1 -- 172.21.15.135:0/1378940477 >> v2:172.21.15.135:3300/0 conn(0x7fa2e00cf280 msgr2=0x7fa2e00d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:32.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.877+0000 7fa2e4881640 1 --2- 172.21.15.135:0/1378940477 >> v2:172.21.15.135:3300/0 conn(0x7fa2e00cf280 0x7fa2e00d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.877+0000 7fa2e4881640 1 -- 172.21.15.135:0/1378940477 >> v1:172.21.15.135:6789/0 conn(0x7fa2e0162340 legacy=0x7fa2e0162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:32.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.877+0000 7fa2e4881640 1 -- 172.21.15.135:0/1378940477 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e00d4d10 con 0x7fa2e0162e30 2024-09-12T01:55:32.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.877+0000 7fa2e5883640 1 --2- 172.21.15.135:0/1378940477 >> v2:172.21.15.135:3300/0 conn(0x7fa2e00cf280 0x7fa2e00d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:32.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.878+0000 7fa2e4881640 1 --2- 172.21.15.135:0/1378940477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2e0162e30 0x7fa2e006d740 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc009850 tx=0x7fa2dc02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba4fe7a13ea3657c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:32.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.879+0000 7fa2d3fff640 1 -- 172.21.15.135:0/1378940477 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc004030 con 0x7fa2e0162e30 2024-09-12T01:55:32.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.879+0000 7fa2d3fff640 1 -- 172.21.15.135:0/1378940477 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2dc0041d0 con 0x7fa2e0162e30 2024-09-12T01:55:32.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.879+0000 7fa2d3fff640 1 -- 172.21.15.135:0/1378940477 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc003610 con 0x7fa2e0162e30 2024-09-12T01:55:32.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.880+0000 7fa2e72e6640 1 -- 172.21.15.135:0/1378940477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2e0162e30 msgr2=0x7fa2e006d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:32.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.880+0000 7fa2e72e6640 1 --2- 172.21.15.135:0/1378940477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2e0162e30 0x7fa2e006d740 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc009850 tx=0x7fa2dc02a1a0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.880+0000 7fa2e72e6640 1 -- 172.21.15.135:0/1378940477 shutdown_connections 2024-09-12T01:55:32.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.880+0000 7fa2e72e6640 1 --2- 172.21.15.135:0/1378940477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2e0162e30 0x7fa2e006d740 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.880+0000 7fa2e72e6640 1 --2- 172.21.15.135:0/1378940477 >> v2:172.21.15.135:3300/0 conn(0x7fa2e00cf280 0x7fa2e00d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.880+0000 7fa2e72e6640 1 -- 172.21.15.135:0/1378940477 >> 172.21.15.135:0/1378940477 conn(0x7fa2e008bfc0 msgr2=0x7fa2e00d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:32.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.880+0000 7fa2e72e6640 1 -- 172.21.15.135:0/1378940477 shutdown_connections 2024-09-12T01:55:32.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.880+0000 7fa2e72e6640 1 -- 172.21.15.135:0/1378940477 wait complete. 2024-09-12T01:55:32.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.881+0000 7fa2e72e6640 1 Processor -- start 2024-09-12T01:55:32.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.881+0000 7fa2e72e6640 1 -- start start 2024-09-12T01:55:32.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.882+0000 7fa2e72e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2e00cf280 0x7fa2e00b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:32.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.882+0000 7fa2e72e6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2e0162340 0x7fa2e00b4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:32.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.882+0000 7fa2e72e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2e0162e30 0x7fa2e00cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:32.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.882+0000 7fa2e72e6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e00cf710 con 0x7fa2e00cf280 2024-09-12T01:55:32.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.882+0000 7fa2e72e6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e00d2470 con 0x7fa2e0162e30 2024-09-12T01:55:32.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.882+0000 7fa2e72e6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e00d52d0 con 0x7fa2e0162340 2024-09-12T01:55:32.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.882+0000 7fa2e4881640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2e0162340 0x7fa2e00b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:32.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.882+0000 7fa2e5883640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2e0162e30 0x7fa2e00cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:32.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.882+0000 7fa2e4881640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2e0162340 0x7fa2e00b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:42028/0 (socket says 172.21.15.135:42028) 2024-09-12T01:55:32.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.882+0000 7fa2e4881640 1 -- 172.21.15.135:0/165953184 learned_addr learned my addr 172.21.15.135:0/165953184 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-12T01:55:32.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.882+0000 7fa2e5082640 1 --2- 172.21.15.135:0/165953184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2e00cf280 0x7fa2e00b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:32.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.883+0000 7fa2e4881640 1 -- 172.21.15.135:0/165953184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2e0162e30 msgr2=0x7fa2e00cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:32.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.883+0000 7fa2e4881640 1 --2- 172.21.15.135:0/165953184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2e0162e30 0x7fa2e00cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.883+0000 7fa2e4881640 1 -- 172.21.15.135:0/165953184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2e00cf280 msgr2=0x7fa2e00b7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:32.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.883+0000 7fa2e4881640 1 --2- 172.21.15.135:0/165953184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2e00cf280 0x7fa2e00b7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.883+0000 7fa2e4881640 1 -- 172.21.15.135:0/165953184 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e00b4fd0 con 0x7fa2e0162340 2024-09-12T01:55:32.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.883+0000 7fa2e5883640 1 --2- 172.21.15.135:0/165953184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2e0162e30 0x7fa2e00cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:32.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.883+0000 7fa2e4881640 1 --2- 172.21.15.135:0/165953184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2e0162340 0x7fa2e00b4940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc034040 tx=0x7fa2dc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:32.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.883+0000 7fa2d1ffb640 1 -- 172.21.15.135:0/165953184 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc041020 con 0x7fa2e0162340 2024-09-12T01:55:32.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.883+0000 7fa2d1ffb640 1 -- 172.21.15.135:0/165953184 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2dc003c50 con 0x7fa2e0162340 2024-09-12T01:55:32.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.883+0000 7fa2e72e6640 1 -- 172.21.15.135:0/165953184 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e01e9590 con 0x7fa2e0162340 2024-09-12T01:55:32.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.883+0000 7fa2d1ffb640 1 -- 172.21.15.135:0/165953184 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc004030 con 0x7fa2e0162340 2024-09-12T01:55:32.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.883+0000 7fa2e72e6640 1 -- 172.21.15.135:0/165953184 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e00cc660 con 0x7fa2e0162340 2024-09-12T01:55:32.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.883+0000 7fa2d1ffb640 1 -- 172.21.15.135:0/165953184 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa2dc044020 con 0x7fa2e0162340 2024-09-12T01:55:32.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.883+0000 7fa2d1ffb640 1 -- 172.21.15.135:0/165953184 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fa2dc0067c0 con 0x7fa2e0162340 2024-09-12T01:55:32.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.884+0000 7fa2e72e6640 1 -- 172.21.15.135:0/165953184 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2e006d740 con 0x7fa2e0162340 2024-09-12T01:55:32.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.886+0000 7fa2d1ffb640 1 -- 172.21.15.135:0/165953184 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa2dc04b030 con 0x7fa2e0162340 2024-09-12T01:55:32.914 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:32.913+0000 7f355c610040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:55:32.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.956+0000 7fa2e72e6640 1 -- 172.21.15.135:0/165953184 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ad97b147-39cd-4be0-817e-2afd31daf2a7", "id": 2} v 0) -- 0x7fa2e00ce3b0 con 0x7fa2e0162340 2024-09-12T01:55:32.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.961+0000 7fa2d1ffb640 1 -- 172.21.15.135:0/165953184 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ad97b147-39cd-4be0-817e-2afd31daf2a7", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fa2dc006040 con 0x7fa2e0162340 2024-09-12T01:55:32.962 INFO:teuthology.orchestra.run.smithi135.stdout:2 2024-09-12T01:55:32.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.962+0000 7fa2e72e6640 1 -- 172.21.15.135:0/165953184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2e0162340 msgr2=0x7fa2e00b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:32.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.962+0000 7fa2e72e6640 1 --2- 172.21.15.135:0/165953184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2e0162340 0x7fa2e00b4940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc034040 tx=0x7fa2dc0046c0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.962+0000 7fa2e72e6640 1 -- 172.21.15.135:0/165953184 shutdown_connections 2024-09-12T01:55:32.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.962+0000 7fa2e72e6640 1 --2- 172.21.15.135:0/165953184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2e0162e30 0x7fa2e00cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.962+0000 7fa2e72e6640 1 --2- 172.21.15.135:0/165953184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2e0162340 0x7fa2e00b4940 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.962+0000 7fa2e72e6640 1 --2- 172.21.15.135:0/165953184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2e00cf280 0x7fa2e00b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:32.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.962+0000 7fa2e72e6640 1 -- 172.21.15.135:0/165953184 >> 172.21.15.135:0/165953184 conn(0x7fa2e008bfc0 msgr2=0x7fa2e0160240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:32.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.963+0000 7fa2e72e6640 1 -- 172.21.15.135:0/165953184 shutdown_connections 2024-09-12T01:55:32.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:32.963+0000 7fa2e72e6640 1 -- 172.21.15.135:0/165953184 wait complete. 2024-09-12T01:55:32.974 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 3a014904-0ed5-428a-82d3-0c15544643c1 3 2024-09-12T01:55:32.990 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:32.990+0000 7efee732b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:55:33.048 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:33.048+0000 7efee732b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:55:33.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.072+0000 7fe7212ba640 1 Processor -- start 2024-09-12T01:55:33.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.072+0000 7fe7212ba640 1 -- start start 2024-09-12T01:55:33.073 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:33.073+0000 7f355c610040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:55:33.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.073+0000 7fe7212ba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe71c15b1b0 0x7fe71c0b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.073+0000 7fe7212ba640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe71c0b48e0 0x7fe71c0b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.073+0000 7fe7212ba640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe71c0b5770 con 0x7fe71c09ab10 2024-09-12T01:55:33.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.073+0000 7fe7212ba640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fe71c0b09f0 con 0x7fe71c0b48e0 2024-09-12T01:55:33.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.073+0000 7fe7212ba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe71c0b0cd0 con 0x7fe71c15b1b0 2024-09-12T01:55:33.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.073+0000 7fe71affd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe71c15b1b0 0x7fe71c0b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.073+0000 7fe71a7fc640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fe71c09ab10 0x7fe71c0b41d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37150/0 (socket says 172.21.15.135:37150) 2024-09-12T01:55:33.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.073+0000 7fe71a7fc640 1 -- 172.21.15.135:0/1289057717 learned_addr learned my addr 172.21.15.135:0/1289057717 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-09-12T01:55:33.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.073+0000 7fe71b7fe640 1 --2- 172.21.15.135:0/1289057717 >> v2:172.21.15.19:3300/0 conn(0x7fe71c0b48e0 0x7fe71c0b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.074+0000 7fe719ffb640 1 -- 172.21.15.135:0/1289057717 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2888422937 0 0) 0x7fe71c0b5770 con 0x7fe71c09ab10 2024-09-12T01:55:33.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.074+0000 7fe71affd640 1 -- 172.21.15.135:0/1289057717 >> v2:172.21.15.19:3300/0 conn(0x7fe71c0b48e0 msgr2=0x7fe71c0b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:33.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.074+0000 7fe71affd640 1 --2- 172.21.15.135:0/1289057717 >> v2:172.21.15.19:3300/0 conn(0x7fe71c0b48e0 0x7fe71c0b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.074+0000 7fe71affd640 1 -- 172.21.15.135:0/1289057717 >> v1:172.21.15.135:6789/0 conn(0x7fe71c09ab10 legacy=0x7fe71c0b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.074+0000 7fe71affd640 1 -- 172.21.15.135:0/1289057717 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71c0b0fb0 con 0x7fe71c15b1b0 2024-09-12T01:55:33.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.074+0000 7fe71affd640 1 --2- 172.21.15.135:0/1289057717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe71c15b1b0 0x7fe71c0b4e00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe7100097a0 tx=0x7fe71002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=150999867e568b9c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:33.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.074+0000 7fe719ffb640 1 -- 172.21.15.135:0/1289057717 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710037070 con 0x7fe71c15b1b0 2024-09-12T01:55:33.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.075+0000 7fe719ffb640 1 -- 172.21.15.135:0/1289057717 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe710032440 con 0x7fe71c15b1b0 2024-09-12T01:55:33.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.075+0000 7fe719ffb640 1 -- 172.21.15.135:0/1289057717 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710032810 con 0x7fe71c15b1b0 2024-09-12T01:55:33.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.075+0000 7fe7212ba640 1 -- 172.21.15.135:0/1289057717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe71c15b1b0 msgr2=0x7fe71c0b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.075+0000 7fe7212ba640 1 --2- 172.21.15.135:0/1289057717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe71c15b1b0 0x7fe71c0b4e00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe7100097a0 tx=0x7fe71002a180 comp rx=0 tx=0).stop 2024-09-12T01:55:33.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.075+0000 7fe7212ba640 1 -- 172.21.15.135:0/1289057717 shutdown_connections 2024-09-12T01:55:33.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.075+0000 7fe7212ba640 1 --2- 172.21.15.135:0/1289057717 >> v2:172.21.15.19:3300/0 conn(0x7fe71c0b48e0 0x7fe71c0b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.075+0000 7fe7212ba640 1 --2- 172.21.15.135:0/1289057717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe71c15b1b0 0x7fe71c0b4e00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.075+0000 7fe7212ba640 1 -- 172.21.15.135:0/1289057717 >> 172.21.15.135:0/1289057717 conn(0x7fe71c0734b0 msgr2=0x7fe71c0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:33.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.075+0000 7fe7212ba640 1 -- 172.21.15.135:0/1289057717 shutdown_connections 2024-09-12T01:55:33.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.075+0000 7fe7212ba640 1 -- 172.21.15.135:0/1289057717 wait complete. 2024-09-12T01:55:33.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.077+0000 7fe7212ba640 1 Processor -- start 2024-09-12T01:55:33.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.077+0000 7fe7212ba640 1 -- start start 2024-09-12T01:55:33.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.077+0000 7fe7212ba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe71c09ab10 0x7fe71c0d05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.077+0000 7fe7212ba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe71c0b48e0 0x7fe71c15d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.077+0000 7fe7212ba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe71c15b1b0 0x7fe71c14cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.077+0000 7fe7212ba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c0b54c0 con 0x7fe71c15b1b0 2024-09-12T01:55:33.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.077+0000 7fe7212ba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c0b5340 con 0x7fe71c09ab10 2024-09-12T01:55:33.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.077+0000 7fe7212ba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe71c15b590 con 0x7fe71c0b48e0 2024-09-12T01:55:33.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.077+0000 7fe71affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe71c09ab10 0x7fe71c0d05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.077+0000 7fe71a7fc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe71c0b48e0 0x7fe71c15d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.077+0000 7fe71affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe71c09ab10 0x7fe71c0d05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51594/0 (socket says 172.21.15.135:51594) 2024-09-12T01:55:33.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.077+0000 7fe71a7fc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe71c0b48e0 0x7fe71c15d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:42042/0 (socket says 172.21.15.135:42042) 2024-09-12T01:55:33.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.078+0000 7fe71affd640 1 -- 172.21.15.135:0/1471871065 learned_addr learned my addr 172.21.15.135:0/1471871065 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-12T01:55:33.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.078+0000 7fe71b7fe640 1 --2- 172.21.15.135:0/1471871065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe71c15b1b0 0x7fe71c14cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.078+0000 7fe71a7fc640 1 -- 172.21.15.135:0/1471871065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe71c09ab10 msgr2=0x7fe71c0d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.078+0000 7fe71a7fc640 1 --2- 172.21.15.135:0/1471871065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe71c09ab10 0x7fe71c0d05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.078+0000 7fe71a7fc640 1 -- 172.21.15.135:0/1471871065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe71c15b1b0 msgr2=0x7fe71c14cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.078+0000 7fe71a7fc640 1 --2- 172.21.15.135:0/1471871065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe71c15b1b0 0x7fe71c14cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.078+0000 7fe71a7fc640 1 -- 172.21.15.135:0/1471871065 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71c15c650 con 0x7fe71c0b48e0 2024-09-12T01:55:33.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.078+0000 7fe71a7fc640 1 --2- 172.21.15.135:0/1471871065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe71c0b48e0 0x7fe71c15d6f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0cd380 tx=0x7fe70c00c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:33.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.078+0000 7fe7037fe640 1 -- 172.21.15.135:0/1471871065 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c0074e0 con 0x7fe71c0b48e0 2024-09-12T01:55:33.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.078+0000 7fe7037fe640 1 -- 172.21.15.135:0/1471871065 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe70c0047e0 con 0x7fe71c0b48e0 2024-09-12T01:55:33.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.078+0000 7fe7037fe640 1 -- 172.21.15.135:0/1471871065 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c004bd0 con 0x7fe71c0b48e0 2024-09-12T01:55:33.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.078+0000 7fe7212ba640 1 -- 172.21.15.135:0/1471871065 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71c15c930 con 0x7fe71c0b48e0 2024-09-12T01:55:33.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.078+0000 7fe7212ba640 1 -- 172.21.15.135:0/1471871065 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe71c15cef0 con 0x7fe71c0b48e0 2024-09-12T01:55:33.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.078+0000 7fe7037fe640 1 -- 172.21.15.135:0/1471871065 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe70c011070 con 0x7fe71c0b48e0 2024-09-12T01:55:33.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.078+0000 7fe7037fe640 1 -- 172.21.15.135:0/1471871065 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fe70c013850 con 0x7fe71c0b48e0 2024-09-12T01:55:33.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.079+0000 7fe7212ba640 1 -- 172.21.15.135:0/1471871065 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe71c0b4e00 con 0x7fe71c0b48e0 2024-09-12T01:55:33.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.081+0000 7fe7037fe640 1 -- 172.21.15.135:0/1471871065 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe70c004d70 con 0x7fe71c0b48e0 2024-09-12T01:55:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.149+0000 7fe7212ba640 1 -- 172.21.15.135:0/1471871065 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3a014904-0ed5-428a-82d3-0c15544643c1", "id": 3} v 0) -- 0x7fe71c157730 con 0x7fe71c0b48e0 2024-09-12T01:55:33.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.154+0000 7fe7037fe640 1 -- 172.21.15.135:0/1471871065 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3a014904-0ed5-428a-82d3-0c15544643c1", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fe70c013bf0 con 0x7fe71c0b48e0 2024-09-12T01:55:33.155 INFO:teuthology.orchestra.run.smithi135.stdout:3 2024-09-12T01:55:33.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.155+0000 7fe7212ba640 1 -- 172.21.15.135:0/1471871065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe71c0b48e0 msgr2=0x7fe71c15d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.155+0000 7fe7212ba640 1 --2- 172.21.15.135:0/1471871065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe71c0b48e0 0x7fe71c15d6f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0cd380 tx=0x7fe70c00c8e0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.155+0000 7fe7212ba640 1 -- 172.21.15.135:0/1471871065 shutdown_connections 2024-09-12T01:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.155+0000 7fe7212ba640 1 --2- 172.21.15.135:0/1471871065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe71c15b1b0 0x7fe71c14cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.155+0000 7fe7212ba640 1 --2- 172.21.15.135:0/1471871065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe71c0b48e0 0x7fe71c15d6f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.155+0000 7fe7212ba640 1 --2- 172.21.15.135:0/1471871065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe71c09ab10 0x7fe71c0d05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.155+0000 7fe7212ba640 1 -- 172.21.15.135:0/1471871065 >> 172.21.15.135:0/1471871065 conn(0x7fe71c0734b0 msgr2=0x7fe71c06ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.155+0000 7fe7212ba640 1 -- 172.21.15.135:0/1471871065 shutdown_connections 2024-09-12T01:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.155+0000 7fe7212ba640 1 -- 172.21.15.135:0/1471871065 wait complete. 2024-09-12T01:55:33.167 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new fbe6aea1-e944-4b67-acd0-c0113343021f 4 2024-09-12T01:55:33.205 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:33.205+0000 7efee732b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:55:33.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.265+0000 7f25d0b6d640 1 Processor -- start 2024-09-12T01:55:33.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.265+0000 7f25d0b6d640 1 -- start start 2024-09-12T01:55:33.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.266+0000 7f25d0b6d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f25cc06be80 0x7f25cc0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.266+0000 7f25d0b6d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f25cc0b5f40 0x7f25cc06c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.266+0000 7f25d0b6d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25cc0b6420 con 0x7f25cc06c7a0 2024-09-12T01:55:33.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.266+0000 7f25d0b6d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f25cc0b6700 con 0x7f25cc0b5f40 2024-09-12T01:55:33.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.266+0000 7f25d0b6d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f25cc1602d0 con 0x7f25cc06be80 2024-09-12T01:55:33.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.266+0000 7f25ca59c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f25cc06be80 0x7f25cc0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.266+0000 7f25ca59c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f25cc06be80 0x7f25cc0b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51602/0 (socket says 172.21.15.135:51602) 2024-09-12T01:55:33.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.266+0000 7f25ca59c640 1 -- 172.21.15.135:0/2153637660 learned_addr learned my addr 172.21.15.135:0/2153637660 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-12T01:55:33.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.266+0000 7f25c9d9b640 1 --2- 172.21.15.135:0/2153637660 >> v2:172.21.15.19:3300/0 conn(0x7f25cc0b5f40 0x7f25cc06c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.267+0000 7f25ca59c640 1 -- 172.21.15.135:0/2153637660 >> v2:172.21.15.19:3300/0 conn(0x7f25cc0b5f40 msgr2=0x7f25cc06c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:33.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.267+0000 7f25ca59c640 1 --2- 172.21.15.135:0/2153637660 >> v2:172.21.15.19:3300/0 conn(0x7f25cc0b5f40 0x7f25cc06c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.267+0000 7f25ca59c640 1 -- 172.21.15.135:0/2153637660 >> v1:172.21.15.19:6789/0 conn(0x7f25cc06c7a0 legacy=0x7f25cc160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.267+0000 7f25ca59c640 1 -- 172.21.15.135:0/2153637660 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25cc1605b0 con 0x7f25cc06be80 2024-09-12T01:55:33.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.267+0000 7f25ca59c640 1 --2- 172.21.15.135:0/2153637660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc06be80 0x7f25cc0b0750 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0687a0 tx=0x7f25b402a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e77a83dc9af1f4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:33.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.267+0000 7f25c959a640 1 -- 172.21.15.135:0/2153637660 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4037070 con 0x7f25cc06be80 2024-09-12T01:55:33.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.267+0000 7f25c959a640 1 -- 172.21.15.135:0/2153637660 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b4032440 con 0x7f25cc06be80 2024-09-12T01:55:33.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.267+0000 7f25c959a640 1 -- 172.21.15.135:0/2153637660 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4032810 con 0x7f25cc06be80 2024-09-12T01:55:33.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.268+0000 7f25d0b6d640 1 -- 172.21.15.135:0/2153637660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc06be80 msgr2=0x7f25cc0b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.268+0000 7f25d0b6d640 1 --2- 172.21.15.135:0/2153637660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc06be80 0x7f25cc0b0750 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0687a0 tx=0x7f25b402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.268+0000 7f25d0b6d640 1 -- 172.21.15.135:0/2153637660 shutdown_connections 2024-09-12T01:55:33.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.268+0000 7f25d0b6d640 1 --2- 172.21.15.135:0/2153637660 >> v2:172.21.15.19:3300/0 conn(0x7f25cc0b5f40 0x7f25cc06c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.268+0000 7f25d0b6d640 1 --2- 172.21.15.135:0/2153637660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc06be80 0x7f25cc0b0750 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.268+0000 7f25d0b6d640 1 -- 172.21.15.135:0/2153637660 >> 172.21.15.135:0/2153637660 conn(0x7f25cc0734b0 msgr2=0x7f25cc0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:33.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.268+0000 7f25d0b6d640 1 -- 172.21.15.135:0/2153637660 shutdown_connections 2024-09-12T01:55:33.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.268+0000 7f25d0b6d640 1 -- 172.21.15.135:0/2153637660 wait complete. 2024-09-12T01:55:33.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.269+0000 7f25d0b6d640 1 Processor -- start 2024-09-12T01:55:33.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.270+0000 7f25d0b6d640 1 -- start start 2024-09-12T01:55:33.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.270+0000 7f25d0b6d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc06be80 0x7f25cc154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.270+0000 7f25d0b6d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25cc0b5f40 0x7f25cc0d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.270+0000 7f25d0b6d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25cc0d0af0 0x7f25cc09eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.270+0000 7f25d0b6d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc15f810 con 0x7f25cc0b5f40 2024-09-12T01:55:33.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.270+0000 7f25d0b6d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc15f690 con 0x7f25cc06be80 2024-09-12T01:55:33.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.270+0000 7f25d0b6d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f25cc15f990 con 0x7f25cc0d0af0 2024-09-12T01:55:33.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.270+0000 7f25ca59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc06be80 0x7f25cc154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.270+0000 7f25ca59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc06be80 0x7f25cc154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51616/0 (socket says 172.21.15.135:51616) 2024-09-12T01:55:33.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.270+0000 7f25ca59c640 1 -- 172.21.15.135:0/3621559743 learned_addr learned my addr 172.21.15.135:0/3621559743 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-12T01:55:33.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.270+0000 7f25cad9d640 1 --2- 172.21.15.135:0/3621559743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25cc0d0af0 0x7f25cc09eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.270+0000 7f25c9d9b640 1 --2- 172.21.15.135:0/3621559743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25cc0b5f40 0x7f25cc0d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.271+0000 7f25ca59c640 1 -- 172.21.15.135:0/3621559743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25cc0d0af0 msgr2=0x7f25cc09eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.271+0000 7f25ca59c640 1 --2- 172.21.15.135:0/3621559743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25cc0d0af0 0x7f25cc09eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.271+0000 7f25ca59c640 1 -- 172.21.15.135:0/3621559743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25cc0b5f40 msgr2=0x7f25cc0d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.271+0000 7f25ca59c640 1 --2- 172.21.15.135:0/3621559743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25cc0b5f40 0x7f25cc0d05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.271+0000 7f25ca59c640 1 -- 172.21.15.135:0/3621559743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25cc0d0f80 con 0x7f25cc06be80 2024-09-12T01:55:33.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.271+0000 7f25ca59c640 1 --2- 172.21.15.135:0/3621559743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc06be80 0x7f25cc154c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f25b402a220 tx=0x7f25b40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:33.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.271+0000 7f25c2ffd640 1 -- 172.21.15.135:0/3621559743 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4041020 con 0x7f25cc06be80 2024-09-12T01:55:33.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.271+0000 7f25c2ffd640 1 -- 172.21.15.135:0/3621559743 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b40306c0 con 0x7f25cc06be80 2024-09-12T01:55:33.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.271+0000 7f25c2ffd640 1 -- 172.21.15.135:0/3621559743 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4037040 con 0x7f25cc06be80 2024-09-12T01:55:33.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.271+0000 7f25d0b6d640 1 -- 172.21.15.135:0/3621559743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25cc1553b0 con 0x7f25cc06be80 2024-09-12T01:55:33.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.271+0000 7f25d0b6d640 1 -- 172.21.15.135:0/3621559743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25cc155970 con 0x7f25cc06be80 2024-09-12T01:55:33.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.271+0000 7f25c2ffd640 1 -- 172.21.15.135:0/3621559743 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f25b4044020 con 0x7f25cc06be80 2024-09-12T01:55:33.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.271+0000 7f25c2ffd640 1 -- 172.21.15.135:0/3621559743 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f25b403dd20 con 0x7f25cc06be80 2024-09-12T01:55:33.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.272+0000 7f25d0b6d640 1 -- 172.21.15.135:0/3621559743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25cc06c260 con 0x7f25cc06be80 2024-09-12T01:55:33.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.274+0000 7f25c2ffd640 1 -- 172.21.15.135:0/3621559743 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f25b404b030 con 0x7f25cc06be80 2024-09-12T01:55:33.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.343+0000 7f25d0b6d640 1 -- 172.21.15.135:0/3621559743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fbe6aea1-e944-4b67-acd0-c0113343021f", "id": 4} v 0) -- 0x7f25cc15cd10 con 0x7f25cc06be80 2024-09-12T01:55:33.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.348+0000 7f25c2ffd640 1 -- 172.21.15.135:0/3621559743 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fbe6aea1-e944-4b67-acd0-c0113343021f", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f25b403d420 con 0x7f25cc06be80 2024-09-12T01:55:33.349 INFO:teuthology.orchestra.run.smithi135.stdout:4 2024-09-12T01:55:33.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.349+0000 7f25d0b6d640 1 -- 172.21.15.135:0/3621559743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc06be80 msgr2=0x7f25cc154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.349+0000 7f25d0b6d640 1 --2- 172.21.15.135:0/3621559743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc06be80 0x7f25cc154c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f25b402a220 tx=0x7f25b40046c0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.349+0000 7f25d0b6d640 1 -- 172.21.15.135:0/3621559743 shutdown_connections 2024-09-12T01:55:33.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.349+0000 7f25d0b6d640 1 --2- 172.21.15.135:0/3621559743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25cc0d0af0 0x7f25cc09eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.349+0000 7f25d0b6d640 1 --2- 172.21.15.135:0/3621559743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25cc0b5f40 0x7f25cc0d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.349+0000 7f25d0b6d640 1 --2- 172.21.15.135:0/3621559743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc06be80 0x7f25cc154c80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.349+0000 7f25d0b6d640 1 -- 172.21.15.135:0/3621559743 >> 172.21.15.135:0/3621559743 conn(0x7f25cc0734b0 msgr2=0x7f25cc15bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:33.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.349+0000 7f25d0b6d640 1 -- 172.21.15.135:0/3621559743 shutdown_connections 2024-09-12T01:55:33.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.349+0000 7f25d0b6d640 1 -- 172.21.15.135:0/3621559743 wait complete. 2024-09-12T01:55:33.361 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f 5 2024-09-12T01:55:33.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.457+0000 7fdbddffd640 1 Processor -- start 2024-09-12T01:55:33.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.458+0000 7fdbddffd640 1 -- start start 2024-09-12T01:55:33.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.458+0000 7fdbddffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd815b070 0x7fdbd80b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.458+0000 7fdbddffd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdbd8070300 0x7fdbd80b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.458+0000 7fdbddffd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbd80cfcb0 con 0x7fdbd80afd10 2024-09-12T01:55:33.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.458+0000 7fdbddffd640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fdbd80cfa10 con 0x7fdbd8070300 2024-09-12T01:55:33.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.458+0000 7fdbddffd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdbd806e810 con 0x7fdbd815b070 2024-09-12T01:55:33.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.458+0000 7fdbd77fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd815b070 0x7fdbd80b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.459+0000 7fdbd7fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdbd8070300 0x7fdbd80b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.459+0000 7fdbd77fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd815b070 0x7fdbd80b4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:42068/0 (socket says 172.21.15.135:42068) 2024-09-12T01:55:33.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.459+0000 7fdbd77fe640 1 -- 172.21.15.135:0/4242070771 learned_addr learned my addr 172.21.15.135:0/4242070771 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-12T01:55:33.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.459+0000 7fdbd7fff640 1 -- 172.21.15.135:0/4242070771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd815b070 msgr2=0x7fdbd80b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:33.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.459+0000 7fdbd7fff640 1 --2- 172.21.15.135:0/4242070771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd815b070 0x7fdbd80b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.459+0000 7fdbd7fff640 1 -- 172.21.15.135:0/4242070771 >> v1:172.21.15.19:6789/0 conn(0x7fdbd80afd10 legacy=0x7fdbd815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:33.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.459+0000 7fdbd7fff640 1 -- 172.21.15.135:0/4242070771 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd806eaf0 con 0x7fdbd8070300 2024-09-12T01:55:33.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.459+0000 7fdbd77fe640 1 --2- 172.21.15.135:0/4242070771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd815b070 0x7fdbd80b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:33.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.460+0000 7fdbd7fff640 1 --2- 172.21.15.135:0/4242070771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbd8070300 0x7fdbd80b53c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00097a0 tx=0x7fdbd002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b0e7d2afc3ef5e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:33.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.460+0000 7fdbd67fc640 1 -- 172.21.15.135:0/4242070771 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0037070 con 0x7fdbd8070300 2024-09-12T01:55:33.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.460+0000 7fdbd67fc640 1 -- 172.21.15.135:0/4242070771 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd002ae40 con 0x7fdbd8070300 2024-09-12T01:55:33.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.460+0000 7fdbd67fc640 1 -- 172.21.15.135:0/4242070771 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0032660 con 0x7fdbd8070300 2024-09-12T01:55:33.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.461+0000 7fdbddffd640 1 -- 172.21.15.135:0/4242070771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbd8070300 msgr2=0x7fdbd80b53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.461+0000 7fdbddffd640 1 --2- 172.21.15.135:0/4242070771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbd8070300 0x7fdbd80b53c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00097a0 tx=0x7fdbd002a130 comp rx=0 tx=0).stop 2024-09-12T01:55:33.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.461+0000 7fdbddffd640 1 -- 172.21.15.135:0/4242070771 shutdown_connections 2024-09-12T01:55:33.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.461+0000 7fdbddffd640 1 --2- 172.21.15.135:0/4242070771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbd8070300 0x7fdbd80b53c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.461+0000 7fdbddffd640 1 --2- 172.21.15.135:0/4242070771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd815b070 0x7fdbd80b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.461+0000 7fdbddffd640 1 -- 172.21.15.135:0/4242070771 >> 172.21.15.135:0/4242070771 conn(0x7fdbd80735d0 msgr2=0x7fdbd806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:33.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.461+0000 7fdbddffd640 1 -- 172.21.15.135:0/4242070771 shutdown_connections 2024-09-12T01:55:33.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.461+0000 7fdbddffd640 1 -- 172.21.15.135:0/4242070771 wait complete. 2024-09-12T01:55:33.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.462+0000 7fdbddffd640 1 Processor -- start 2024-09-12T01:55:33.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.462+0000 7fdbddffd640 1 -- start start 2024-09-12T01:55:33.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.463+0000 7fdbddffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbd8070300 0x7fdbd80b4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.463+0000 7fdbddffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbd80afd10 0x7fdbd80ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.463+0000 7fdbddffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd815b070 0x7fdbd80a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.463+0000 7fdbddffd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd80b6010 con 0x7fdbd8070300 2024-09-12T01:55:33.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.463+0000 7fdbddffd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd815b450 con 0x7fdbd80afd10 2024-09-12T01:55:33.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.463+0000 7fdbddffd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdbd80b6190 con 0x7fdbd815b070 2024-09-12T01:55:33.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.463+0000 7fdbd6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbd80afd10 0x7fdbd80ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.463+0000 7fdbd7fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd815b070 0x7fdbd80a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.463+0000 7fdbd6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbd80afd10 0x7fdbd80ab4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51628/0 (socket says 172.21.15.135:51628) 2024-09-12T01:55:33.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.463+0000 7fdbd6ffd640 1 -- 172.21.15.135:0/2092248266 learned_addr learned my addr 172.21.15.135:0/2092248266 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-12T01:55:33.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.463+0000 7fdbd77fe640 1 --2- 172.21.15.135:0/2092248266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbd8070300 0x7fdbd80b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.463+0000 7fdbd6ffd640 1 -- 172.21.15.135:0/2092248266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd815b070 msgr2=0x7fdbd80a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.463+0000 7fdbd6ffd640 1 --2- 172.21.15.135:0/2092248266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd815b070 0x7fdbd80a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.463+0000 7fdbd6ffd640 1 -- 172.21.15.135:0/2092248266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbd8070300 msgr2=0x7fdbd80b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.463+0000 7fdbd6ffd640 1 --2- 172.21.15.135:0/2092248266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbd8070300 0x7fdbd80b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.463+0000 7fdbd6ffd640 1 -- 172.21.15.135:0/2092248266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd80abbe0 con 0x7fdbd80afd10 2024-09-12T01:55:33.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.463+0000 7fdbd7fff640 1 --2- 172.21.15.135:0/2092248266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd815b070 0x7fdbd80a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:33.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.464+0000 7fdbd6ffd640 1 --2- 172.21.15.135:0/2092248266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbd80afd10 0x7fdbd80ab4e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000c400 tx=0x7fdbc000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:33.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.464+0000 7fdbcffff640 1 -- 172.21.15.135:0/2092248266 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0011790 con 0x7fdbd80afd10 2024-09-12T01:55:33.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.464+0000 7fdbcffff640 1 -- 172.21.15.135:0/2092248266 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc0017070 con 0x7fdbd80afd10 2024-09-12T01:55:33.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.464+0000 7fdbcffff640 1 -- 172.21.15.135:0/2092248266 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0011bb0 con 0x7fdbd80afd10 2024-09-12T01:55:33.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.464+0000 7fdbddffd640 1 -- 172.21.15.135:0/2092248266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd80abec0 con 0x7fdbd80afd10 2024-09-12T01:55:33.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.464+0000 7fdbddffd640 1 -- 172.21.15.135:0/2092248266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd80a99d0 con 0x7fdbd80afd10 2024-09-12T01:55:33.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.464+0000 7fdbcffff640 1 -- 172.21.15.135:0/2092248266 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdbc001c460 con 0x7fdbd80afd10 2024-09-12T01:55:33.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.464+0000 7fdbcffff640 1 -- 172.21.15.135:0/2092248266 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fdbc0011d50 con 0x7fdbd80afd10 2024-09-12T01:55:33.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.465+0000 7fdbddffd640 1 -- 172.21.15.135:0/2092248266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbd80b03f0 con 0x7fdbd80afd10 2024-09-12T01:55:33.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.467+0000 7fdbcffff640 1 -- 172.21.15.135:0/2092248266 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fdbc00126f0 con 0x7fdbd80afd10 2024-09-12T01:55:33.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.545+0000 7fdbddffd640 1 -- 172.21.15.135:0/2092248266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f", "id": 5} v 0) -- 0x7fdbd815ea00 con 0x7fdbd80afd10 2024-09-12T01:55:33.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.551+0000 7fdbcffff640 1 -- 172.21.15.135:0/2092248266 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fdbc00128d0 con 0x7fdbd80afd10 2024-09-12T01:55:33.552 INFO:teuthology.orchestra.run.smithi135.stdout:5 2024-09-12T01:55:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.552+0000 7fdbddffd640 1 -- 172.21.15.135:0/2092248266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbd80afd10 msgr2=0x7fdbd80ab4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.552+0000 7fdbddffd640 1 --2- 172.21.15.135:0/2092248266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbd80afd10 0x7fdbd80ab4e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000c400 tx=0x7fdbc000c8c0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.552+0000 7fdbddffd640 1 -- 172.21.15.135:0/2092248266 shutdown_connections 2024-09-12T01:55:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.552+0000 7fdbddffd640 1 --2- 172.21.15.135:0/2092248266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd815b070 0x7fdbd80a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.552+0000 7fdbddffd640 1 --2- 172.21.15.135:0/2092248266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbd80afd10 0x7fdbd80ab4e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.552+0000 7fdbddffd640 1 --2- 172.21.15.135:0/2092248266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbd8070300 0x7fdbd80b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.552+0000 7fdbddffd640 1 -- 172.21.15.135:0/2092248266 >> 172.21.15.135:0/2092248266 conn(0x7fdbd80735d0 msgr2=0x7fdbd8158660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.552+0000 7fdbddffd640 1 -- 172.21.15.135:0/2092248266 shutdown_connections 2024-09-12T01:55:33.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.552+0000 7fdbddffd640 1 -- 172.21.15.135:0/2092248266 wait complete. 2024-09-12T01:55:33.564 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 9b711c80-90b3-4f92-b353-f1066e3f1e6b 6 2024-09-12T01:55:33.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.663+0000 7fc135586640 1 Processor -- start 2024-09-12T01:55:33.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.663+0000 7fc135586640 1 -- start start 2024-09-12T01:55:33.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.663+0000 7fc135586640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc1300d3140 0x7fc1300d1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.663+0000 7fc135586640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc13015e4f0 0x7fc1300cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.663+0000 7fc135586640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc13015e980 con 0x7fc13015e110 2024-09-12T01:55:33.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.663+0000 7fc135586640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fc1300d1620 con 0x7fc13015e4f0 2024-09-12T01:55:33.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.663+0000 7fc135586640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc1300d0a10 con 0x7fc1300d3140 2024-09-12T01:55:33.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.664+0000 7fc12e7fc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc1300d3140 0x7fc1300d1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.664+0000 7fc12e7fc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc1300d3140 0x7fc1300d1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51644/0 (socket says 172.21.15.135:51644) 2024-09-12T01:55:33.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.664+0000 7fc12e7fc640 1 -- 172.21.15.135:0/4053904054 learned_addr learned my addr 172.21.15.135:0/4053904054 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-12T01:55:33.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.664+0000 7fc12effd640 1 --1- 172.21.15.135:0/4053904054 >> v1:172.21.15.135:6789/0 conn(0x7fc13015e110 0x7fc1300d2a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37162/0 (socket says 172.21.15.135:37162) 2024-09-12T01:55:33.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.664+0000 7fc12f7fe640 1 --2- 172.21.15.135:0/4053904054 >> v2:172.21.15.19:3300/0 conn(0x7fc13015e4f0 0x7fc1300cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.664+0000 7fc12e7fc640 1 -- 172.21.15.135:0/4053904054 >> v2:172.21.15.19:3300/0 conn(0x7fc13015e4f0 msgr2=0x7fc1300cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:33.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.664+0000 7fc12e7fc640 1 --2- 172.21.15.135:0/4053904054 >> v2:172.21.15.19:3300/0 conn(0x7fc13015e4f0 0x7fc1300cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.664+0000 7fc12e7fc640 1 -- 172.21.15.135:0/4053904054 >> v1:172.21.15.135:6789/0 conn(0x7fc13015e110 legacy=0x7fc1300d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.664+0000 7fc12e7fc640 1 -- 172.21.15.135:0/4053904054 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1300d0cf0 con 0x7fc1300d3140 2024-09-12T01:55:33.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.664+0000 7fc12dffb640 1 -- 172.21.15.135:0/4053904054 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1897919544 0 0) 0x7fc13015e980 con 0x7fc13015e110 2024-09-12T01:55:33.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.664+0000 7fc12f7fe640 1 --2- 172.21.15.135:0/4053904054 >> v2:172.21.15.19:3300/0 conn(0x7fc13015e4f0 0x7fc1300cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:33.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.665+0000 7fc12e7fc640 1 --2- 172.21.15.135:0/4053904054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1300d3140 0x7fc1300d1ab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc13008e460 tx=0x7fc11802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6658d20909524c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:33.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.665+0000 7fc12dffb640 1 -- 172.21.15.135:0/4053904054 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc118037070 con 0x7fc1300d3140 2024-09-12T01:55:33.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.665+0000 7fc12dffb640 1 -- 172.21.15.135:0/4053904054 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc118032440 con 0x7fc1300d3140 2024-09-12T01:55:33.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.665+0000 7fc12dffb640 1 -- 172.21.15.135:0/4053904054 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc118032810 con 0x7fc1300d3140 2024-09-12T01:55:33.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.665+0000 7fc135586640 1 -- 172.21.15.135:0/4053904054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1300d3140 msgr2=0x7fc1300d1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.665+0000 7fc135586640 1 --2- 172.21.15.135:0/4053904054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1300d3140 0x7fc1300d1ab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc13008e460 tx=0x7fc11802a270 comp rx=0 tx=0).stop 2024-09-12T01:55:33.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.665+0000 7fc135586640 1 -- 172.21.15.135:0/4053904054 shutdown_connections 2024-09-12T01:55:33.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.665+0000 7fc135586640 1 --2- 172.21.15.135:0/4053904054 >> v2:172.21.15.19:3300/0 conn(0x7fc13015e4f0 0x7fc1300cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.665+0000 7fc135586640 1 --2- 172.21.15.135:0/4053904054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1300d3140 0x7fc1300d1ab0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.665+0000 7fc135586640 1 -- 172.21.15.135:0/4053904054 >> 172.21.15.135:0/4053904054 conn(0x7fc13008bfc0 msgr2=0x7fc1300d44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:33.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.665+0000 7fc135586640 1 -- 172.21.15.135:0/4053904054 shutdown_connections 2024-09-12T01:55:33.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.665+0000 7fc135586640 1 -- 172.21.15.135:0/4053904054 wait complete. 2024-09-12T01:55:33.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.667+0000 7fc135586640 1 Processor -- start 2024-09-12T01:55:33.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.668+0000 7fc135586640 1 -- start start 2024-09-12T01:55:33.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.669+0000 7fc135586640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1300d3140 0x7fc1300ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.669+0000 7fc135586640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc13015e110 0x7fc1300c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.669+0000 7fc135586640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13015e4f0 0x7fc130154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.669+0000 7fc135586640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc1300d0300 con 0x7fc13015e4f0 2024-09-12T01:55:33.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.669+0000 7fc135586640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc1300d12b0 con 0x7fc1300d3140 2024-09-12T01:55:33.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.669+0000 7fc135586640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc1300d0480 con 0x7fc13015e110 2024-09-12T01:55:33.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.669+0000 7fc12effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1300d3140 0x7fc1300ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.669+0000 7fc12effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1300d3140 0x7fc1300ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51650/0 (socket says 172.21.15.135:51650) 2024-09-12T01:55:33.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.669+0000 7fc12effd640 1 -- 172.21.15.135:0/3119229286 learned_addr learned my addr 172.21.15.135:0/3119229286 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-12T01:55:33.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.669+0000 7fc12e7fc640 1 --2- 172.21.15.135:0/3119229286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc13015e110 0x7fc1300c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.669+0000 7fc12f7fe640 1 --2- 172.21.15.135:0/3119229286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13015e4f0 0x7fc130154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.669+0000 7fc12effd640 1 -- 172.21.15.135:0/3119229286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc13015e110 msgr2=0x7fc1300c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.669+0000 7fc12effd640 1 --2- 172.21.15.135:0/3119229286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc13015e110 0x7fc1300c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.669+0000 7fc12effd640 1 -- 172.21.15.135:0/3119229286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13015e4f0 msgr2=0x7fc130154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.669+0000 7fc12effd640 1 --2- 172.21.15.135:0/3119229286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13015e4f0 0x7fc130154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.669+0000 7fc12effd640 1 -- 172.21.15.135:0/3119229286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1301550e0 con 0x7fc1300d3140 2024-09-12T01:55:33.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.669+0000 7fc12effd640 1 --2- 172.21.15.135:0/3119229286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1300d3140 0x7fc1300ca700 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc12000c4d0 tx=0x7fc12000c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:33.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.669+0000 7fc1277fe640 1 -- 172.21.15.135:0/3119229286 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc120018070 con 0x7fc1300d3140 2024-09-12T01:55:33.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.670+0000 7fc1277fe640 1 -- 172.21.15.135:0/3119229286 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc120007500 con 0x7fc1300d3140 2024-09-12T01:55:33.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.670+0000 7fc135586640 1 -- 172.21.15.135:0/3119229286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1300c8f30 con 0x7fc1300d3140 2024-09-12T01:55:33.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.670+0000 7fc1277fe640 1 -- 172.21.15.135:0/3119229286 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc120004a20 con 0x7fc1300d3140 2024-09-12T01:55:33.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.670+0000 7fc135586640 1 -- 172.21.15.135:0/3119229286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1300b8730 con 0x7fc1300d3140 2024-09-12T01:55:33.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.670+0000 7fc1277fe640 1 -- 172.21.15.135:0/3119229286 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc12001b070 con 0x7fc1300d3140 2024-09-12T01:55:33.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.670+0000 7fc1277fe640 1 -- 172.21.15.135:0/3119229286 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fc1200129f0 con 0x7fc1300d3140 2024-09-12T01:55:33.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.671+0000 7fc135586640 1 -- 172.21.15.135:0/3119229286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1300d1a90 con 0x7fc1300d3140 2024-09-12T01:55:33.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.673+0000 7fc1277fe640 1 -- 172.21.15.135:0/3119229286 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc12001d440 con 0x7fc1300d3140 2024-09-12T01:55:33.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.742+0000 7fc135586640 1 -- 172.21.15.135:0/3119229286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9b711c80-90b3-4f92-b353-f1066e3f1e6b", "id": 6} v 0) -- 0x7fc13006d750 con 0x7fc1300d3140 2024-09-12T01:55:33.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.748+0000 7fc1277fe640 1 -- 172.21.15.135:0/3119229286 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9b711c80-90b3-4f92-b353-f1066e3f1e6b", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fc12001d7b0 con 0x7fc1300d3140 2024-09-12T01:55:33.749 INFO:teuthology.orchestra.run.smithi135.stdout:6 2024-09-12T01:55:33.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.749+0000 7fc135586640 1 -- 172.21.15.135:0/3119229286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1300d3140 msgr2=0x7fc1300ca700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.749+0000 7fc135586640 1 --2- 172.21.15.135:0/3119229286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1300d3140 0x7fc1300ca700 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc12000c4d0 tx=0x7fc12000c990 comp rx=0 tx=0).stop 2024-09-12T01:55:33.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.749+0000 7fc135586640 1 -- 172.21.15.135:0/3119229286 shutdown_connections 2024-09-12T01:55:33.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.749+0000 7fc135586640 1 --2- 172.21.15.135:0/3119229286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13015e4f0 0x7fc130154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.749+0000 7fc135586640 1 --2- 172.21.15.135:0/3119229286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc13015e110 0x7fc1300c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.749+0000 7fc135586640 1 --2- 172.21.15.135:0/3119229286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1300d3140 0x7fc1300ca700 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.749+0000 7fc135586640 1 -- 172.21.15.135:0/3119229286 >> 172.21.15.135:0/3119229286 conn(0x7fc13008bfc0 msgr2=0x7fc13015f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:33.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.749+0000 7fc135586640 1 -- 172.21.15.135:0/3119229286 shutdown_connections 2024-09-12T01:55:33.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.749+0000 7fc135586640 1 -- 172.21.15.135:0/3119229286 wait complete. 2024-09-12T01:55:33.764 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 5acf71ac-197b-4844-a2fa-2efb23a1bcb6 7 2024-09-12T01:55:33.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.862+0000 7fb5978f1640 1 Processor -- start 2024-09-12T01:55:33.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.863+0000 7fb5978f1640 1 -- start start 2024-09-12T01:55:33.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.863+0000 7fb5978f1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb590158b70 0x7fb590162a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.863+0000 7fb5978f1640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb590158f50 con 0x7fb5900701f0 2024-09-12T01:55:33.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.863+0000 7fb5978f1640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb590162fa0 con 0x7fb5900afd60 2024-09-12T01:55:33.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.863+0000 7fb5978f1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb5900ae8e0 con 0x7fb590158b70 2024-09-12T01:55:33.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.864+0000 7fb595e8e640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fb5900afd60 0x7fb59006ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37178/0 (socket says 172.21.15.135:37178) 2024-09-12T01:55:33.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.864+0000 7fb595e8e640 1 -- 172.21.15.135:0/1876854444 learned_addr learned my addr 172.21.15.135:0/1876854444 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-09-12T01:55:33.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.864+0000 7fb59568d640 1 --2- 172.21.15.135:0/1876854444 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb590158b70 0x7fb590162a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.864+0000 7fb587fff640 1 -- 172.21.15.135:0/1876854444 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 175689336 0 0) 0x7fb588001490 con 0x7fb5900afd60 2024-09-12T01:55:33.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.864+0000 7fb59568d640 1 -- 172.21.15.135:0/1876854444 >> v1:172.21.15.135:6789/0 conn(0x7fb5900afd60 legacy=0x7fb59006ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.864+0000 7fb59568d640 1 -- 172.21.15.135:0/1876854444 >> v1:172.21.15.19:6789/0 conn(0x7fb5900701f0 legacy=0x7fb59006e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.864+0000 7fb59568d640 1 -- 172.21.15.135:0/1876854444 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb59006f520 con 0x7fb590158b70 2024-09-12T01:55:33.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.865+0000 7fb59568d640 1 --2- 172.21.15.135:0/1876854444 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb590158b70 0x7fb590162a60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0097d0 tx=0x7fb58c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=191cc862fcdcf107 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:33.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.865+0000 7fb587fff640 1 -- 172.21.15.135:0/1876854444 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c037070 con 0x7fb590158b70 2024-09-12T01:55:33.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.865+0000 7fb587fff640 1 -- 172.21.15.135:0/1876854444 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb58c032440 con 0x7fb590158b70 2024-09-12T01:55:33.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.865+0000 7fb587fff640 1 -- 172.21.15.135:0/1876854444 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c032810 con 0x7fb590158b70 2024-09-12T01:55:33.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.865+0000 7fb5978f1640 1 -- 172.21.15.135:0/1876854444 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb590158b70 msgr2=0x7fb590162a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.865+0000 7fb5978f1640 1 --2- 172.21.15.135:0/1876854444 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb590158b70 0x7fb590162a60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0097d0 tx=0x7fb58c02a210 comp rx=0 tx=0).stop 2024-09-12T01:55:33.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.865+0000 7fb5978f1640 1 -- 172.21.15.135:0/1876854444 shutdown_connections 2024-09-12T01:55:33.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.865+0000 7fb5978f1640 1 --2- 172.21.15.135:0/1876854444 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb590158b70 0x7fb590162a60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.865+0000 7fb5978f1640 1 -- 172.21.15.135:0/1876854444 >> 172.21.15.135:0/1876854444 conn(0x7fb5900735d0 msgr2=0x7fb59006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:33.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.866+0000 7fb5978f1640 1 -- 172.21.15.135:0/1876854444 shutdown_connections 2024-09-12T01:55:33.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.866+0000 7fb5978f1640 1 -- 172.21.15.135:0/1876854444 wait complete. 2024-09-12T01:55:33.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.867+0000 7fb5978f1640 1 Processor -- start 2024-09-12T01:55:33.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.867+0000 7fb5978f1640 1 -- start start 2024-09-12T01:55:33.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb5978f1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5900701f0 0x7fb59014e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb5978f1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5900afd60 0x7fb59014bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb5978f1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb590158b70 0x7fb59006c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb5978f1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb59015f150 con 0x7fb5900701f0 2024-09-12T01:55:33.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb5978f1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb59015ee70 con 0x7fb590158b70 2024-09-12T01:55:33.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb5978f1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb59015f430 con 0x7fb5900afd60 2024-09-12T01:55:33.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb594e8c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5900afd60 0x7fb59014bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb595e8e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb590158b70 0x7fb59006c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb595e8e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb590158b70 0x7fb59006c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51666/0 (socket says 172.21.15.135:51666) 2024-09-12T01:55:33.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb594e8c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5900afd60 0x7fb59014bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:42098/0 (socket says 172.21.15.135:42098) 2024-09-12T01:55:33.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb595e8e640 1 -- 172.21.15.135:0/1202894509 learned_addr learned my addr 172.21.15.135:0/1202894509 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-12T01:55:33.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb59568d640 1 --2- 172.21.15.135:0/1202894509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5900701f0 0x7fb59014e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb594e8c640 1 -- 172.21.15.135:0/1202894509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb590158b70 msgr2=0x7fb59006c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb594e8c640 1 --2- 172.21.15.135:0/1202894509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb590158b70 0x7fb59006c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb594e8c640 1 -- 172.21.15.135:0/1202894509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5900701f0 msgr2=0x7fb59014e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb594e8c640 1 --2- 172.21.15.135:0/1202894509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5900701f0 0x7fb59014e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb594e8c640 1 -- 172.21.15.135:0/1202894509 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb590154b70 con 0x7fb5900afd60 2024-09-12T01:55:33.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb595e8e640 1 --2- 172.21.15.135:0/1202894509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb590158b70 0x7fb59006c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:33.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb594e8c640 1 --2- 172.21.15.135:0/1202894509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5900afd60 0x7fb59014bcc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb58000c3c0 tx=0x7fb58000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:33.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.869+0000 7fb585ffb640 1 -- 172.21.15.135:0/1202894509 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5800052d0 con 0x7fb5900afd60 2024-09-12T01:55:33.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.870+0000 7fb585ffb640 1 -- 172.21.15.135:0/1202894509 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb580005490 con 0x7fb5900afd60 2024-09-12T01:55:33.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.870+0000 7fb585ffb640 1 -- 172.21.15.135:0/1202894509 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb580007260 con 0x7fb5900afd60 2024-09-12T01:55:33.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.870+0000 7fb5978f1640 1 -- 172.21.15.135:0/1202894509 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb590154e50 con 0x7fb5900afd60 2024-09-12T01:55:33.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.870+0000 7fb585ffb640 1 -- 172.21.15.135:0/1202894509 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb580007400 con 0x7fb5900afd60 2024-09-12T01:55:33.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.870+0000 7fb5978f1640 1 -- 172.21.15.135:0/1202894509 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5901559d0 con 0x7fb5900afd60 2024-09-12T01:55:33.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.870+0000 7fb585ffb640 1 -- 172.21.15.135:0/1202894509 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fb580003650 con 0x7fb5900afd60 2024-09-12T01:55:33.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.871+0000 7fb5978f1640 1 -- 172.21.15.135:0/1202894509 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb59006fe40 con 0x7fb5900afd60 2024-09-12T01:55:33.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.873+0000 7fb585ffb640 1 -- 172.21.15.135:0/1202894509 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb580021020 con 0x7fb5900afd60 2024-09-12T01:55:33.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.941+0000 7fb5978f1640 1 -- 172.21.15.135:0/1202894509 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5acf71ac-197b-4844-a2fa-2efb23a1bcb6", "id": 7} v 0) -- 0x7fb59006d150 con 0x7fb5900afd60 2024-09-12T01:55:33.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.949+0000 7fb585ffb640 1 -- 172.21.15.135:0/1202894509 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5acf71ac-197b-4844-a2fa-2efb23a1bcb6", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fb580003b40 con 0x7fb5900afd60 2024-09-12T01:55:33.950 INFO:teuthology.orchestra.run.smithi135.stdout:7 2024-09-12T01:55:33.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.950+0000 7fb5978f1640 1 -- 172.21.15.135:0/1202894509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5900afd60 msgr2=0x7fb59014bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.950+0000 7fb5978f1640 1 --2- 172.21.15.135:0/1202894509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5900afd60 0x7fb59014bcc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb58000c3c0 tx=0x7fb58000c880 comp rx=0 tx=0).stop 2024-09-12T01:55:33.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.950+0000 7fb5978f1640 1 -- 172.21.15.135:0/1202894509 shutdown_connections 2024-09-12T01:55:33.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.950+0000 7fb5978f1640 1 --2- 172.21.15.135:0/1202894509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb590158b70 0x7fb59006c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.950+0000 7fb5978f1640 1 --2- 172.21.15.135:0/1202894509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5900afd60 0x7fb59014bcc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.950+0000 7fb5978f1640 1 --2- 172.21.15.135:0/1202894509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5900701f0 0x7fb59014e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.950+0000 7fb5978f1640 1 -- 172.21.15.135:0/1202894509 >> 172.21.15.135:0/1202894509 conn(0x7fb5900735d0 msgr2=0x7fb59006e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:33.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.950+0000 7fb5978f1640 1 -- 172.21.15.135:0/1202894509 shutdown_connections 2024-09-12T01:55:33.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:55:33.950+0000 7fb5978f1640 1 -- 172.21.15.135:0/1202894509 wait complete. 2024-09-12T01:55:33.962 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T01:55:33.962 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T01:55:33.964 INFO:tasks.ceph.osd.0:Started 2024-09-12T01:55:33.964 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T01:55:33.965 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T01:55:33.967 INFO:tasks.ceph.osd.1:Started 2024-09-12T01:55:33.967 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T01:55:33.967 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T01:55:33.969 INFO:tasks.ceph.osd.2:Started 2024-09-12T01:55:33.969 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T01:55:33.969 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T01:55:33.971 INFO:tasks.ceph.osd.3:Started 2024-09-12T01:55:33.971 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T01:55:33.972 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T01:55:33.974 INFO:tasks.ceph.osd.4:Started 2024-09-12T01:55:33.974 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T01:55:33.974 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T01:55:33.976 INFO:tasks.ceph.osd.5:Started 2024-09-12T01:55:33.976 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T01:55:33.976 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T01:55:33.978 INFO:tasks.ceph.osd.6:Started 2024-09-12T01:55:33.978 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T01:55:33.979 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T01:55:33.981 INFO:tasks.ceph.osd.7:Started 2024-09-12T01:55:33.982 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:55:34.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.116+0000 7fd2ef00e640 1 Processor -- start 2024-09-12T01:55:34.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.116+0000 7fd2ef00e640 1 -- start start 2024-09-12T01:55:34.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.117+0000 7fd2ef00e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd2e8161c80 0x7fd2e806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.117+0000 7fd2ef00e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd2e8162060 0x7fd2e80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.117+0000 7fd2ef00e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2e806e870 con 0x7fd2e80b64b0 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.117+0000 7fd2ef00e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e806d9f0 con 0x7fd2e8162060 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.117+0000 7fd2ef00e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e806dcd0 con 0x7fd2e8161c80 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.117+0000 7fd2e7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd2e8162060 0x7fd2e80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.117+0000 7fd2e7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd2e8162060 0x7fd2e80b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58730/0 (socket says 172.21.15.19:58730) 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.117+0000 7fd2e7fff640 1 -- 172.21.15.19:0/1079060870 learned_addr learned my addr 172.21.15.19:0/1079060870 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.117+0000 7fd2ecdaa640 1 --2- 172.21.15.19:0/1079060870 >> v2:172.21.15.135:3300/0 conn(0x7fd2e8161c80 0x7fd2e806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.117+0000 7fd2e7fff640 1 -- 172.21.15.19:0/1079060870 >> v2:172.21.15.135:3300/0 conn(0x7fd2e8161c80 msgr2=0x7fd2e806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.117+0000 7fd2e7fff640 1 --2- 172.21.15.19:0/1079060870 >> v2:172.21.15.135:3300/0 conn(0x7fd2e8161c80 0x7fd2e806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.117+0000 7fd2e7fff640 1 -- 172.21.15.19:0/1079060870 >> v1:172.21.15.135:6789/0 conn(0x7fd2e80b64b0 legacy=0x7fd2e8162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.117+0000 7fd2e7fff640 1 -- 172.21.15.19:0/1079060870 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e806dfb0 con 0x7fd2e8162060 2024-09-12T01:55:34.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.118+0000 7fd2e7fff640 1 --2- 172.21.15.19:0/1079060870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2e8162060 0x7fd2e80b5f70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd2e808d7a0 tx=0x7fd2d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ecbfdf7ca033d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.118+0000 7fd2e77fe640 1 -- 172.21.15.19:0/1079060870 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4037070 con 0x7fd2e8162060 2024-09-12T01:55:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.118+0000 7fd2e77fe640 1 -- 172.21.15.19:0/1079060870 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d4032440 con 0x7fd2e8162060 2024-09-12T01:55:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.118+0000 7fd2e77fe640 1 -- 172.21.15.19:0/1079060870 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4032810 con 0x7fd2e8162060 2024-09-12T01:55:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.119+0000 7fd2ef00e640 1 -- 172.21.15.19:0/1079060870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2e8162060 msgr2=0x7fd2e80b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.119+0000 7fd2ef00e640 1 --2- 172.21.15.19:0/1079060870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2e8162060 0x7fd2e80b5f70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd2e808d7a0 tx=0x7fd2d402a270 comp rx=0 tx=0).stop 2024-09-12T01:55:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.119+0000 7fd2ef00e640 1 -- 172.21.15.19:0/1079060870 shutdown_connections 2024-09-12T01:55:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.119+0000 7fd2ef00e640 1 --2- 172.21.15.19:0/1079060870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2e8162060 0x7fd2e80b5f70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.119+0000 7fd2ef00e640 1 --2- 172.21.15.19:0/1079060870 >> v2:172.21.15.135:3300/0 conn(0x7fd2e8161c80 0x7fd2e806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.119+0000 7fd2ef00e640 1 -- 172.21.15.19:0/1079060870 >> 172.21.15.19:0/1079060870 conn(0x7fd2e80d44f0 msgr2=0x7fd2e80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.119+0000 7fd2ef00e640 1 -- 172.21.15.19:0/1079060870 shutdown_connections 2024-09-12T01:55:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.119+0000 7fd2ef00e640 1 -- 172.21.15.19:0/1079060870 wait complete. 2024-09-12T01:55:34.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.120+0000 7fd2ef00e640 1 Processor -- start 2024-09-12T01:55:34.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.120+0000 7fd2ef00e640 1 -- start start 2024-09-12T01:55:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.121+0000 7fd2ef00e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2e80b64b0 0x7fd2e81565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.121+0000 7fd2ef00e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2e8161c80 0x7fd2e80c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.121+0000 7fd2ef00e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2e8162060 0x7fd2e815e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.121+0000 7fd2ef00e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e80d2a10 con 0x7fd2e8161c80 2024-09-12T01:55:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.121+0000 7fd2ef00e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e80d2890 con 0x7fd2e80b64b0 2024-09-12T01:55:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.121+0000 7fd2ef00e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e80b6960 con 0x7fd2e8162060 2024-09-12T01:55:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.121+0000 7fd2e7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2e8161c80 0x7fd2e80c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.121+0000 7fd2e7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2e8161c80 0x7fd2e80c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58738/0 (socket says 172.21.15.19:58738) 2024-09-12T01:55:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.121+0000 7fd2e7fff640 1 -- 172.21.15.19:0/1644818615 learned_addr learned my addr 172.21.15.19:0/1644818615 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.121+0000 7fd2ecdaa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2e80b64b0 0x7fd2e81565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.121+0000 7fd2ed5ab640 1 --2- 172.21.15.19:0/1644818615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2e8162060 0x7fd2e815e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.121+0000 7fd2e7fff640 1 -- 172.21.15.19:0/1644818615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2e8162060 msgr2=0x7fd2e815e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.121+0000 7fd2e7fff640 1 --2- 172.21.15.19:0/1644818615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2e8162060 0x7fd2e815e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.121+0000 7fd2e7fff640 1 -- 172.21.15.19:0/1644818615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2e80b64b0 msgr2=0x7fd2e81565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:34.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.121+0000 7fd2e7fff640 1 --2- 172.21.15.19:0/1644818615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2e80b64b0 0x7fd2e81565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.121+0000 7fd2e7fff640 1 -- 172.21.15.19:0/1644818615 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e80c8cb0 con 0x7fd2e8161c80 2024-09-12T01:55:34.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.122+0000 7fd2e7fff640 1 --2- 172.21.15.19:0/1644818615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2e8161c80 0x7fd2e80c8460 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4000c00 tx=0x7fd2d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:34.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.122+0000 7fd2e57fa640 1 -- 172.21.15.19:0/1644818615 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4037040 con 0x7fd2e8161c80 2024-09-12T01:55:34.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.122+0000 7fd2e57fa640 1 -- 172.21.15.19:0/1644818615 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d4042070 con 0x7fd2e8161c80 2024-09-12T01:55:34.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.122+0000 7fd2ef00e640 1 -- 172.21.15.19:0/1644818615 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e80c8f90 con 0x7fd2e8161c80 2024-09-12T01:55:34.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.122+0000 7fd2e57fa640 1 -- 172.21.15.19:0/1644818615 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4030880 con 0x7fd2e8161c80 2024-09-12T01:55:34.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.122+0000 7fd2ef00e640 1 -- 172.21.15.19:0/1644818615 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e80c89a0 con 0x7fd2e8161c80 2024-09-12T01:55:34.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.122+0000 7fd2e57fa640 1 -- 172.21.15.19:0/1644818615 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd2d4030a20 con 0x7fd2e8161c80 2024-09-12T01:55:34.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.122+0000 7fd2e57fa640 1 -- 172.21.15.19:0/1644818615 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd2d4030d10 con 0x7fd2e8161c80 2024-09-12T01:55:34.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.123+0000 7fd2ef00e640 1 -- 172.21.15.19:0/1644818615 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e80ba470 con 0x7fd2e8161c80 2024-09-12T01:55:34.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.125+0000 7fd2e57fa640 1 -- 172.21.15.19:0/1644818615 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd2d4047460 con 0x7fd2e8161c80 2024-09-12T01:55:34.156 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:34.155+0000 7f355c610040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:55:34.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.185+0000 7fd2ef00e640 1 -- 172.21.15.19:0/1644818615 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2e80d42b0 con 0x7fd2e8161c80 2024-09-12T01:55:34.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.185+0000 7fd2e57fa640 1 -- 172.21.15.19:0/1644818615 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd2d4047640 con 0x7fd2e8161c80 2024-09-12T01:55:34.186 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:55:34.186 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":10,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:55:33.944188+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:55:34.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.186+0000 7fd2ef00e640 1 -- 172.21.15.19:0/1644818615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2e8161c80 msgr2=0x7fd2e80c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:34.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.186+0000 7fd2ef00e640 1 --2- 172.21.15.19:0/1644818615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2e8161c80 0x7fd2e80c8460 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4000c00 tx=0x7fd2d40046c0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.186+0000 7fd2ef00e640 1 -- 172.21.15.19:0/1644818615 shutdown_connections 2024-09-12T01:55:34.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.186+0000 7fd2ef00e640 1 --2- 172.21.15.19:0/1644818615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2e8162060 0x7fd2e815e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.186+0000 7fd2ef00e640 1 --2- 172.21.15.19:0/1644818615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2e8161c80 0x7fd2e80c8460 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.186+0000 7fd2ef00e640 1 --2- 172.21.15.19:0/1644818615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2e80b64b0 0x7fd2e81565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.186+0000 7fd2ef00e640 1 -- 172.21.15.19:0/1644818615 >> 172.21.15.19:0/1644818615 conn(0x7fd2e80d44f0 msgr2=0x7fd2e80b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:34.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.186+0000 7fd2ef00e640 1 -- 172.21.15.19:0/1644818615 shutdown_connections 2024-09-12T01:55:34.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:34.186+0000 7fd2ef00e640 1 -- 172.21.15.19:0/1644818615 wait complete. 2024-09-12T01:55:34.197 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T01:55:34.197 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T01:55:34.208 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:34.208+0000 7f355c610040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:55:34.234 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:34.234+0000 7efee732b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:55:34.289 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:34.289+0000 7efee732b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:55:34.580 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:34.579+0000 7f355c610040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:55:34.667 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:34.667+0000 7f355c610040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:55:34.675 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:34.675+0000 7efee732b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:55:34.764 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:34.764+0000 7efee732b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:55:34.775 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:34.774+0000 7f355c610040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:55:34.820 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:34.820+0000 7f355c610040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:55:34.876 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:34.876+0000 7efee732b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:55:34.925 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:34.925+0000 7efee732b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:55:34.936 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:34.936+0000 7f355c610040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:55:34.990 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:34.989+0000 7f355c610040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:55:35.004 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T01:55:35.034 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:35.033+0000 7f355c610040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:55:35.044 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:35.044+0000 7efee732b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:55:35.098 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.097+0000 7f6a4b911640 1 Processor -- start 2024-09-12T01:55:35.098 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.098+0000 7f6a4b911640 1 -- start start 2024-09-12T01:55:35.099 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.098+0000 7f6a4b911640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6a4406df60 0x7f6a440cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:35.099 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.098+0000 7f6a4b911640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a440d05d0 con 0x7f6a4409aa70 2024-09-12T01:55:35.099 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.099+0000 7f6a4b911640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a44070c70 con 0x7f6a440d1ef0 2024-09-12T01:55:35.099 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.099+0000 7f6a4b911640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f6a44070f50 con 0x7f6a4406df60 2024-09-12T01:55:35.099 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.099+0000 7f6a496ad640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6a4409aa70 0x7f6a4409ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48032/0 (socket says 172.21.15.19:48032) 2024-09-12T01:55:35.100 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.099+0000 7f6a49eae640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6a4406df60 0x7f6a440cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:35.100 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.099+0000 7f6a496ad640 1 -- 172.21.15.19:0/1666831846 learned_addr learned my addr 172.21.15.19:0/1666831846 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:55:35.100 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.099+0000 7f6a3bfff640 1 -- 172.21.15.19:0/1666831846 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1970158370 0 0) 0x7f6a440d05d0 con 0x7f6a4409aa70 2024-09-12T01:55:35.100 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.099+0000 7f6a3bfff640 1 -- 172.21.15.19:0/1666831846 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a30003520 con 0x7f6a4409aa70 2024-09-12T01:55:35.100 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.099+0000 7f6a49eae640 1 -- 172.21.15.19:0/1666831846 >> v1:172.21.15.135:6789/0 conn(0x7f6a440d1ef0 legacy=0x7f6a440d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:35.100 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.099+0000 7f6a49eae640 1 -- 172.21.15.19:0/1666831846 >> v1:172.21.15.19:6789/0 conn(0x7f6a4409aa70 legacy=0x7f6a4409ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:35.100 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.099+0000 7f6a49eae640 1 -- 172.21.15.19:0/1666831846 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a44071230 con 0x7f6a4406df60 2024-09-12T01:55:35.101 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.100+0000 7f6a49eae640 1 --2- 172.21.15.19:0/1666831846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a4406df60 0x7f6a440cca20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009d90 tx=0x7f6a3c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e92df84feed628 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:35.101 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.100+0000 7f6a3bfff640 1 -- 172.21.15.19:0/1666831846 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c007740 con 0x7f6a4406df60 2024-09-12T01:55:35.101 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.100+0000 7f6a3bfff640 1 -- 172.21.15.19:0/1666831846 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a3c0078e0 con 0x7f6a4406df60 2024-09-12T01:55:35.101 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.100+0000 7f6a3bfff640 1 -- 172.21.15.19:0/1666831846 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c007cb0 con 0x7f6a4406df60 2024-09-12T01:55:35.102 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.101+0000 7f6a4b911640 1 -- 172.21.15.19:0/1666831846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a4406df60 msgr2=0x7f6a440cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:35.102 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.101+0000 7f6a4b911640 1 --2- 172.21.15.19:0/1666831846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a4406df60 0x7f6a440cca20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009d90 tx=0x7f6a3c02a6f0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.102 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.101+0000 7f6a4b911640 1 -- 172.21.15.19:0/1666831846 shutdown_connections 2024-09-12T01:55:35.102 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.101+0000 7f6a4b911640 1 --2- 172.21.15.19:0/1666831846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a4406df60 0x7f6a440cca20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.102 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.101+0000 7f6a4b911640 1 -- 172.21.15.19:0/1666831846 >> 172.21.15.19:0/1666831846 conn(0x7f6a440d23d0 msgr2=0x7f6a440d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:35.102 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.101+0000 7f6a4b911640 1 -- 172.21.15.19:0/1666831846 shutdown_connections 2024-09-12T01:55:35.102 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.101+0000 7f6a4b911640 1 -- 172.21.15.19:0/1666831846 wait complete. 2024-09-12T01:55:35.102 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:35.102+0000 7efee732b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:55:35.103 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.103+0000 7f6a4b911640 1 Processor -- start 2024-09-12T01:55:35.103 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.103+0000 7f6a4b911640 1 -- start start 2024-09-12T01:55:35.106 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a4b911640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a4406df60 0x7f6a440c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:35.106 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a4b911640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a4409aa70 0x7f6a440c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:35.107 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a4b911640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a440d1ef0 0x7f6a441dd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:35.107 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a4b911640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6a440cebc0 con 0x7f6a440d1ef0 2024-09-12T01:55:35.107 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a4b911640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4409bc00 con 0x7f6a4409aa70 2024-09-12T01:55:35.107 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a4b911640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6a440d1470 con 0x7f6a4406df60 2024-09-12T01:55:35.107 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a49eae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a440d1ef0 0x7f6a441dd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:35.107 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a48eac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a4409aa70 0x7f6a440c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:35.107 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a49eae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a440d1ef0 0x7f6a441dd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58756/0 (socket says 172.21.15.19:58756) 2024-09-12T01:55:35.107 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a49eae640 1 -- 172.21.15.19:0/1139371851 learned_addr learned my addr 172.21.15.19:0/1139371851 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:35.107 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a496ad640 1 --2- 172.21.15.19:0/1139371851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a4406df60 0x7f6a440c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:35.107 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a48eac640 1 -- 172.21.15.19:0/1139371851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a4406df60 msgr2=0x7f6a440c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:35.107 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a48eac640 1 --2- 172.21.15.19:0/1139371851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a4406df60 0x7f6a440c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.107 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a48eac640 1 -- 172.21.15.19:0/1139371851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a440d1ef0 msgr2=0x7f6a441dd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:35.107 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a48eac640 1 --2- 172.21.15.19:0/1139371851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a440d1ef0 0x7f6a441dd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.107 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a48eac640 1 -- 172.21.15.19:0/1139371851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a440c8860 con 0x7f6a4409aa70 2024-09-12T01:55:35.108 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a496ad640 1 --2- 172.21.15.19:0/1139371851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a4406df60 0x7f6a440c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:35.108 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a49eae640 1 --2- 172.21.15.19:0/1139371851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a440d1ef0 0x7f6a441dd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:35.108 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.105+0000 7f6a48eac640 1 --2- 172.21.15.19:0/1139371851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a4409aa70 0x7f6a440c8320 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400c3c0 tx=0x7f6a3400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:35.108 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.106+0000 7f6a39ffb640 1 -- 172.21.15.19:0/1139371851 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34017070 con 0x7f6a4409aa70 2024-09-12T01:55:35.108 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.106+0000 7f6a39ffb640 1 -- 172.21.15.19:0/1139371851 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a340052d0 con 0x7f6a4409aa70 2024-09-12T01:55:35.108 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.106+0000 7f6a39ffb640 1 -- 172.21.15.19:0/1139371851 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34003830 con 0x7f6a4409aa70 2024-09-12T01:55:35.108 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.106+0000 7f6a4b911640 1 -- 172.21.15.19:0/1139371851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a440c7280 con 0x7f6a4409aa70 2024-09-12T01:55:35.108 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.106+0000 7f6a39ffb640 1 -- 172.21.15.19:0/1139371851 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6a3401a070 con 0x7f6a4409aa70 2024-09-12T01:55:35.108 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.106+0000 7f6a4b911640 1 -- 172.21.15.19:0/1139371851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a440c7840 con 0x7f6a4409aa70 2024-09-12T01:55:35.108 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.106+0000 7f6a39ffb640 1 -- 172.21.15.19:0/1139371851 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6a34011590 con 0x7f6a4409aa70 2024-09-12T01:55:35.109 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.107+0000 7f6a4b911640 1 -- 172.21.15.19:0/1139371851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a440d1830 con 0x7f6a4409aa70 2024-09-12T01:55:35.109 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.109+0000 7f6a39ffb640 1 -- 172.21.15.19:0/1139371851 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6a34022020 con 0x7f6a4409aa70 2024-09-12T01:55:35.146 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:35.145+0000 7f355c610040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:55:35.151 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:35.151+0000 7efee732b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:55:35.169 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.169+0000 7f6a4b911640 1 -- 172.21.15.19:0/1139371851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a440af9e0 con 0x7f6a4409aa70 2024-09-12T01:55:35.170 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.170+0000 7f6a39ffb640 1 -- 172.21.15.19:0/1139371851 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f6a34011b80 con 0x7f6a4409aa70 2024-09-12T01:55:35.170 INFO:teuthology.misc.health.smithi019.stdout: 2024-09-12T01:55:35.170 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":10,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:55:33.944188+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:55:35.171 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.171+0000 7f6a4b911640 1 -- 172.21.15.19:0/1139371851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a4409aa70 msgr2=0x7f6a440c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:35.171 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.171+0000 7f6a4b911640 1 --2- 172.21.15.19:0/1139371851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a4409aa70 0x7f6a440c8320 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400c3c0 tx=0x7f6a3400c880 comp rx=0 tx=0).stop 2024-09-12T01:55:35.171 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.171+0000 7f6a4b911640 1 -- 172.21.15.19:0/1139371851 shutdown_connections 2024-09-12T01:55:35.171 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.171+0000 7f6a4b911640 1 --2- 172.21.15.19:0/1139371851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a440d1ef0 0x7f6a441dd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.171 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.171+0000 7f6a4b911640 1 --2- 172.21.15.19:0/1139371851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a4409aa70 0x7f6a440c8320 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.172 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.171+0000 7f6a4b911640 1 --2- 172.21.15.19:0/1139371851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a4406df60 0x7f6a440c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.172 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.171+0000 7f6a4b911640 1 -- 172.21.15.19:0/1139371851 >> 172.21.15.19:0/1139371851 conn(0x7f6a440d23d0 msgr2=0x7f6a440ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:35.172 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.171+0000 7f6a4b911640 1 -- 172.21.15.19:0/1139371851 shutdown_connections 2024-09-12T01:55:35.172 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:35.171+0000 7f6a4b911640 1 -- 172.21.15.19:0/1139371851 wait complete. 2024-09-12T01:55:35.175 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T01:55:35.175+0000 7f5691260640 -1 Falling back to public interface 2024-09-12T01:55:35.180 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T01:55:35.196 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T01:55:35.196+0000 7fb609f34640 -1 Falling back to public interface 2024-09-12T01:55:35.197 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:35.197+0000 7f355c610040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:55:35.250 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:35.249+0000 7f355c610040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:55:35.270 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:35.270+0000 7efee732b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:55:35.316 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:35.316+0000 7f355c610040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:55:35.322 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:35.322+0000 7efee732b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:55:35.360 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:35.360+0000 7f355c610040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:55:35.375 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:35.375+0000 7efee732b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:55:35.404 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:35.403+0000 7f355c610040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:55:35.414 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T01:55:35.413+0000 7faf11212640 -1 Falling back to public interface 2024-09-12T01:55:35.446 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:35.446+0000 7efee732b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:55:35.470 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T01:55:35.469+0000 7f0b28a0f640 -1 Falling back to public interface 2024-09-12T01:55:35.492 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:35.492+0000 7efee732b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:55:35.538 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:35.538+0000 7efee732b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:55:35.668 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T01:55:35.668+0000 7f8315e2e640 -1 Falling back to public interface 2024-09-12T01:55:35.680 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T01:55:35.680+0000 7fe867012640 -1 Falling back to public interface 2024-09-12T01:55:35.702 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T01:55:35.701+0000 7f75f143b640 -1 Falling back to public interface 2024-09-12T01:55:35.707 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T01:55:35.706+0000 7f85ca619640 -1 Falling back to public interface 2024-09-12T01:55:36.069 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:36.068+0000 7f355c610040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:55:36.230 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T01:55:36.230+0000 7efee732b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:55:37.086 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:37.087+0000 7f34fc216640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T01:55:37.087 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T01:55:37.088+0000 7f34fc216640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T01:55:38.749 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T01:55:38.747+0000 7f5691260640 -1 osd.3 0 log_to_monitors true 2024-09-12T01:55:38.987 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T01:55:38.987+0000 7faf11212640 -1 osd.4 0 log_to_monitors true 2024-09-12T01:55:39.039 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T01:55:39.040+0000 7fb609f34640 -1 osd.1 0 log_to_monitors true 2024-09-12T01:55:39.548 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T01:55:39.548+0000 7f85ca619640 -1 osd.7 0 log_to_monitors true 2024-09-12T01:55:39.551 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T01:55:39.551+0000 7f0b28a0f640 -1 osd.5 0 log_to_monitors true 2024-09-12T01:55:39.715 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T01:55:39.715+0000 7fe867012640 -1 osd.0 0 log_to_monitors true 2024-09-12T01:55:39.754 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T01:55:39.753+0000 7f75f143b640 -1 osd.6 0 log_to_monitors true 2024-09-12T01:55:40.007 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T01:55:40.007+0000 7f8315e2e640 -1 osd.2 0 log_to_monitors true 2024-09-12T01:55:40.865 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T01:55:40.865+0000 7faf0cc23640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T01:55:40.878 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T01:55:40.879+0000 7faf04a43640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:55:41.508 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T01:55:41.508+0000 7f568d1ef640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T01:55:41.638 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T01:55:41.639+0000 7f568500f640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:55:41.700 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T01:55:41.701+0000 7fb6066d7640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T01:55:41.873 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T01:55:41.874+0000 7fb5fdce3640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:55:41.986 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T01:55:42.114 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.115+0000 7f8ab15c0640 1 Processor -- start 2024-09-12T01:55:42.115 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.115+0000 7f8ab15c0640 1 -- start start 2024-09-12T01:55:42.116 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.116+0000 7f8ab15c0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8aac0d19d0 0x7f8aac1693d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:42.116 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.116+0000 7f8ab15c0640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aac0d0500 con 0x7f8aac15f700 2024-09-12T01:55:42.116 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.116+0000 7f8ab15c0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aac15c480 con 0x7f8aac09aa70 2024-09-12T01:55:42.116 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.116+0000 7f8ab15c0640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8aac0b3d00 con 0x7f8aac0d19d0 2024-09-12T01:55:42.116 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.117+0000 7f8aaaffd640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f8aac09aa70 0x7f8aac09ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:37466/0 (socket says 172.21.15.19:37466) 2024-09-12T01:55:42.117 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.117+0000 7f8aab7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8aac0d19d0 0x7f8aac1693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:42.117 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.117+0000 7f8aaaffd640 1 -- 172.21.15.19:0/801377576 learned_addr learned my addr 172.21.15.19:0/801377576 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:55:42.117 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.117+0000 7f8aaa7fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8aac15f700 0x7f8aac06cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49036/0 (socket says 172.21.15.19:49036) 2024-09-12T01:55:42.117 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.117+0000 7f8aa9ffb640 1 -- 172.21.15.19:0/801377576 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 663381923 0 0) 0x7f8aa0001110 con 0x7f8aac15f700 2024-09-12T01:55:42.117 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.117+0000 7f8aa9ffb640 1 -- 172.21.15.19:0/801377576 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a94003520 con 0x7f8aac15f700 2024-09-12T01:55:42.117 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.117+0000 7f8aab7fe640 1 -- 172.21.15.19:0/801377576 >> v1:172.21.15.135:6789/0 conn(0x7f8aac09aa70 legacy=0x7f8aac09ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:42.117 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.117+0000 7f8aab7fe640 1 -- 172.21.15.19:0/801377576 >> v1:172.21.15.19:6789/0 conn(0x7f8aac15f700 legacy=0x7f8aac06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:42.117 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.117+0000 7f8aab7fe640 1 -- 172.21.15.19:0/801377576 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac06d570 con 0x7f8aac0d19d0 2024-09-12T01:55:42.119 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.118+0000 7f8aab7fe640 1 --2- 172.21.15.19:0/801377576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac0d19d0 0x7f8aac1693d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009d90 tx=0x7f8aa402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadb0ca9facf6396 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:42.119 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.118+0000 7f8aa9ffb640 1 -- 172.21.15.19:0/801377576 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4007740 con 0x7f8aac0d19d0 2024-09-12T01:55:42.119 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.118+0000 7f8aa9ffb640 1 -- 172.21.15.19:0/801377576 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa40078e0 con 0x7f8aac0d19d0 2024-09-12T01:55:42.119 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.118+0000 7f8aa9ffb640 1 -- 172.21.15.19:0/801377576 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4007cb0 con 0x7f8aac0d19d0 2024-09-12T01:55:42.119 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.119+0000 7f8ab15c0640 1 -- 172.21.15.19:0/801377576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac0d19d0 msgr2=0x7f8aac1693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:42.119 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.119+0000 7f8ab15c0640 1 --2- 172.21.15.19:0/801377576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac0d19d0 0x7f8aac1693d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009d90 tx=0x7f8aa402a660 comp rx=0 tx=0).stop 2024-09-12T01:55:42.119 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.119+0000 7f8ab15c0640 1 -- 172.21.15.19:0/801377576 shutdown_connections 2024-09-12T01:55:42.119 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.119+0000 7f8ab15c0640 1 --2- 172.21.15.19:0/801377576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac0d19d0 0x7f8aac1693d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.119 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.119+0000 7f8ab15c0640 1 -- 172.21.15.19:0/801377576 >> 172.21.15.19:0/801377576 conn(0x7f8aac0b3e80 msgr2=0x7f8aac0b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:42.119 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.119+0000 7f8ab15c0640 1 -- 172.21.15.19:0/801377576 shutdown_connections 2024-09-12T01:55:42.120 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.119+0000 7f8ab15c0640 1 -- 172.21.15.19:0/801377576 wait complete. 2024-09-12T01:55:42.120 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.121+0000 7f8ab15c0640 1 Processor -- start 2024-09-12T01:55:42.120 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.121+0000 7f8ab15c0640 1 -- start start 2024-09-12T01:55:42.122 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.122+0000 7f8ab15c0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac09aa70 0x7f8aac0c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:42.123 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.122+0000 7f8ab15c0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8aac0d19d0 0x7f8aac15b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:42.123 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.122+0000 7f8ab15c0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8aac15f700 0x7f8aac15b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:42.123 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.122+0000 7f8ab15c0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac06de10 con 0x7f8aac09aa70 2024-09-12T01:55:42.123 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.122+0000 7f8ab15c0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac06db30 con 0x7f8aac15f700 2024-09-12T01:55:42.123 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.122+0000 7f8ab15c0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac169910 con 0x7f8aac0d19d0 2024-09-12T01:55:42.123 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.122+0000 7f8aaaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac09aa70 0x7f8aac0c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:42.123 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.122+0000 7f8aaaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac09aa70 0x7f8aac0c9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42838/0 (socket says 172.21.15.19:42838) 2024-09-12T01:55:42.123 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.122+0000 7f8aaaffd640 1 -- 172.21.15.19:0/1627254469 learned_addr learned my addr 172.21.15.19:0/1627254469 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:42.123 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.122+0000 7f8aaa7fc640 1 --2- 172.21.15.19:0/1627254469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8aac0d19d0 0x7f8aac15b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:42.123 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.122+0000 7f8aab7fe640 1 --2- 172.21.15.19:0/1627254469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8aac15f700 0x7f8aac15b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:42.123 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.123+0000 7f8aaaffd640 1 -- 172.21.15.19:0/1627254469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8aac0d19d0 msgr2=0x7f8aac15b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:42.123 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.123+0000 7f8aaaffd640 1 --2- 172.21.15.19:0/1627254469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8aac0d19d0 0x7f8aac15b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.123 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.123+0000 7f8aaaffd640 1 -- 172.21.15.19:0/1627254469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8aac15f700 msgr2=0x7f8aac15b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:42.123 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.123+0000 7f8aaaffd640 1 --2- 172.21.15.19:0/1627254469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8aac15f700 0x7f8aac15b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.124 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.123+0000 7f8aaaffd640 1 -- 172.21.15.19:0/1627254469 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac09e3c0 con 0x7f8aac09aa70 2024-09-12T01:55:42.124 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.123+0000 7f8aaaffd640 1 --2- 172.21.15.19:0/1627254469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac09aa70 0x7f8aac0c9460 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00c480 tx=0x7f8a9c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:42.124 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.123+0000 7f8a937fe640 1 -- 172.21.15.19:0/1627254469 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c017070 con 0x7f8aac09aa70 2024-09-12T01:55:42.124 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.123+0000 7f8a937fe640 1 -- 172.21.15.19:0/1627254469 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9c005ce0 con 0x7f8aac09aa70 2024-09-12T01:55:42.124 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.123+0000 7f8ab15c0640 1 -- 172.21.15.19:0/1627254469 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aac09e680 con 0x7f8aac09aa70 2024-09-12T01:55:42.124 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.123+0000 7f8a937fe640 1 -- 172.21.15.19:0/1627254469 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c0072f0 con 0x7f8aac09aa70 2024-09-12T01:55:42.124 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.124+0000 7f8ab15c0640 1 -- 172.21.15.19:0/1627254469 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aac09ec40 con 0x7f8aac09aa70 2024-09-12T01:55:42.125 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.125+0000 7f8ab15c0640 1 -- 172.21.15.19:0/1627254469 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aac09ae50 con 0x7f8aac09aa70 2024-09-12T01:55:42.125 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.125+0000 7f8a937fe640 1 -- 172.21.15.19:0/1627254469 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f8a9c01a070 con 0x7f8aac09aa70 2024-09-12T01:55:42.125 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.125+0000 7f8a937fe640 1 --2- 172.21.15.19:0/1627254469 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a9806bda0 0x7f8a9806e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:42.125 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.126+0000 7f8a937fe640 1 -- 172.21.15.19:0/1627254469 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7f8a9c0892f0 con 0x7f8aac09aa70 2024-09-12T01:55:42.125 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.126+0000 7f8aaa7fc640 1 --2- 172.21.15.19:0/1627254469 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a9806bda0 0x7f8a9806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:42.125 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.127+0000 7f8aaa7fc640 1 --2- 172.21.15.19:0/1627254469 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a9806bda0 0x7f8a9806e260 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8aac15bd40 tx=0x7f8aa0000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:42.133 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.134+0000 7f8a937fe640 1 -- 172.21.15.19:0/1627254469 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a9c058440 con 0x7f8aac09aa70 2024-09-12T01:55:42.420 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T01:55:42.421+0000 7f8311385640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T01:55:42.430 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T01:55:42.431+0000 7f83091a5640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:55:42.431 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.432+0000 7f8ab15c0640 1 -- 172.21.15.19:0/1627254469 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8aac0b8310 con 0x7f8aac09aa70 2024-09-12T01:55:42.432 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.433+0000 7f8a937fe640 1 -- 172.21.15.19:0/1627254469 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7567 (secure 0 0 0) 0x7f8a9c05c740 con 0x7f8aac09aa70 2024-09-12T01:55:42.432 INFO:teuthology.misc.health.smithi019.stdout: 2024-09-12T01:55:42.432 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":13,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:55:41.092404+0000","last_up_change":"2024-09-12T01:55:41.092404+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:55:42.435 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.435+0000 7f8ab15c0640 1 -- 172.21.15.19:0/1627254469 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a9806bda0 msgr2=0x7f8a9806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:42.435 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.435+0000 7f8ab15c0640 1 --2- 172.21.15.19:0/1627254469 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a9806bda0 0x7f8a9806e260 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8aac15bd40 tx=0x7f8aa0000ed0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.435 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.435+0000 7f8ab15c0640 1 -- 172.21.15.19:0/1627254469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac09aa70 msgr2=0x7f8aac0c9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:42.435 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.435+0000 7f8ab15c0640 1 --2- 172.21.15.19:0/1627254469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac09aa70 0x7f8aac0c9460 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00c480 tx=0x7f8a9c00c940 comp rx=0 tx=0).stop 2024-09-12T01:55:42.435 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.435+0000 7f8ab15c0640 1 -- 172.21.15.19:0/1627254469 shutdown_connections 2024-09-12T01:55:42.435 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.435+0000 7f8ab15c0640 1 --2- 172.21.15.19:0/1627254469 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a9806bda0 0x7f8a9806e260 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.435 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.435+0000 7f8ab15c0640 1 --2- 172.21.15.19:0/1627254469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8aac15f700 0x7f8aac15b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.435 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.435+0000 7f8ab15c0640 1 --2- 172.21.15.19:0/1627254469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8aac0d19d0 0x7f8aac15b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.435 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.435+0000 7f8ab15c0640 1 --2- 172.21.15.19:0/1627254469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac09aa70 0x7f8aac0c9460 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.435 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.435+0000 7f8ab15c0640 1 -- 172.21.15.19:0/1627254469 >> 172.21.15.19:0/1627254469 conn(0x7f8aac0b3e80 msgr2=0x7f8aac15ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:42.436 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.435+0000 7f8ab15c0640 1 -- 172.21.15.19:0/1627254469 shutdown_connections 2024-09-12T01:55:42.436 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:42.435+0000 7f8ab15c0640 1 -- 172.21.15.19:0/1627254469 wait complete. 2024-09-12T01:55:42.438 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T01:55:42.439+0000 7fe862a23640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T01:55:42.445 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-12T01:55:42.457 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T01:55:42.458+0000 7fe85a843640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:55:42.729 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T01:55:42.730+0000 7f85c6dbc640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T01:55:42.746 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T01:55:42.747+0000 7f85be3c8640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:55:42.759 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T01:55:42.759+0000 7f75ed3ca640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T01:55:42.770 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T01:55:42.771+0000 7f0b243f9640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T01:55:42.772 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T01:55:42.773+0000 7f75e51ea640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:55:42.780 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T01:55:42.781+0000 7f0b1c219640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:55:49.251 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T01:55:49.357 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.358+0000 7f7304c8b640 1 Processor -- start 2024-09-12T01:55:49.357 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.358+0000 7f7304c8b640 1 -- start start 2024-09-12T01:55:49.359 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.359+0000 7f7304c8b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f730015e7d0 0x7f73000cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.359 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.359+0000 7f7304c8b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f73000d4f70 0x7f73000d2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.359 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.359+0000 7f7304c8b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73000d0580 con 0x7f73000d3410 2024-09-12T01:55:49.359 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.359+0000 7f7304c8b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f73000b7410 con 0x7f73000d4f70 2024-09-12T01:55:49.359 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.359+0000 7f7304c8b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f73000b7cb0 con 0x7f730015e7d0 2024-09-12T01:55:49.359 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.359+0000 7f72fdd9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f73000d4f70 0x7f73000d2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.359 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.359+0000 7f72fed9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f73000d3410 0x7f7300162430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49038/0 (socket says 172.21.15.19:49038) 2024-09-12T01:55:49.360 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.359+0000 7f72fed9d640 1 -- 172.21.15.19:0/4291882125 learned_addr learned my addr 172.21.15.19:0/4291882125 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:55:49.360 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.359+0000 7f72fe59c640 1 --2- 172.21.15.19:0/4291882125 >> v2:172.21.15.135:3300/0 conn(0x7f730015e7d0 0x7f73000cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.360 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.360+0000 7f72fdd9b640 1 -- 172.21.15.19:0/4291882125 >> v2:172.21.15.135:3300/0 conn(0x7f730015e7d0 msgr2=0x7f73000cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:49.360 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.360+0000 7f72fdd9b640 1 --2- 172.21.15.19:0/4291882125 >> v2:172.21.15.135:3300/0 conn(0x7f730015e7d0 0x7f73000cfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.360 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.360+0000 7f72fdd9b640 1 -- 172.21.15.19:0/4291882125 >> v1:172.21.15.19:6789/0 conn(0x7f73000d3410 legacy=0x7f7300162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.360 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.360+0000 7f72fd59a640 1 -- 172.21.15.19:0/4291882125 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3422644785 0 0) 0x7f73000d0580 con 0x7f73000d3410 2024-09-12T01:55:49.360 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.360+0000 7f72fdd9b640 1 -- 172.21.15.19:0/4291882125 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73000b7660 con 0x7f73000d4f70 2024-09-12T01:55:49.361 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.360+0000 7f72fdd9b640 1 --2- 172.21.15.19:0/4291882125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73000d4f70 0x7f73000d2ed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f730008cc90 tx=0x7f72f402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d00e67f9836e2e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:49.361 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.361+0000 7f72fd59a640 1 -- 172.21.15.19:0/4291882125 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4037070 con 0x7f73000d4f70 2024-09-12T01:55:49.361 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.361+0000 7f72fd59a640 1 -- 172.21.15.19:0/4291882125 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f4032440 con 0x7f73000d4f70 2024-09-12T01:55:49.362 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.361+0000 7f72fd59a640 1 -- 172.21.15.19:0/4291882125 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4032810 con 0x7f73000d4f70 2024-09-12T01:55:49.362 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.361+0000 7f7304c8b640 1 -- 172.21.15.19:0/4291882125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73000d4f70 msgr2=0x7f73000d2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.362 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.361+0000 7f7304c8b640 1 --2- 172.21.15.19:0/4291882125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73000d4f70 0x7f73000d2ed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f730008cc90 tx=0x7f72f402a1a0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.362 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.361+0000 7f7304c8b640 1 -- 172.21.15.19:0/4291882125 shutdown_connections 2024-09-12T01:55:49.362 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.361+0000 7f7304c8b640 1 --2- 172.21.15.19:0/4291882125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73000d4f70 0x7f73000d2ed0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.362 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.361+0000 7f7304c8b640 1 --2- 172.21.15.19:0/4291882125 >> v2:172.21.15.135:3300/0 conn(0x7f730015e7d0 0x7f73000cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.362 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.361+0000 7f7304c8b640 1 -- 172.21.15.19:0/4291882125 >> 172.21.15.19:0/4291882125 conn(0x7f730008c000 msgr2=0x7f73000d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:49.362 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.361+0000 7f7304c8b640 1 -- 172.21.15.19:0/4291882125 shutdown_connections 2024-09-12T01:55:49.362 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.361+0000 7f7304c8b640 1 -- 172.21.15.19:0/4291882125 wait complete. 2024-09-12T01:55:49.365 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.363+0000 7f7304c8b640 1 Processor -- start 2024-09-12T01:55:49.365 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.363+0000 7f7304c8b640 1 -- start start 2024-09-12T01:55:49.365 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.363+0000 7f7304c8b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73000d3410 0x7f73000cab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.365 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.363+0000 7f7304c8b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73000d4f70 0x7f73000cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.365 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f7304c8b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f730015e7d0 0x7f73000ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.365 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f7304c8b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f730015ebb0 con 0x7f730015e7d0 2024-09-12T01:55:49.365 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f7304c8b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f73000d5390 con 0x7f73000d4f70 2024-09-12T01:55:49.365 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f7304c8b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f730015ed30 con 0x7f73000d3410 2024-09-12T01:55:49.365 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f72fed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f730015e7d0 0x7f73000ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.365 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f72fed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f730015e7d0 0x7f73000ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42852/0 (socket says 172.21.15.19:42852) 2024-09-12T01:55:49.365 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f72fed9d640 1 -- 172.21.15.19:0/2216377601 learned_addr learned my addr 172.21.15.19:0/2216377601 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:49.366 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f72fdd9b640 1 --2- 172.21.15.19:0/2216377601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73000d4f70 0x7f73000cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.366 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f72fe59c640 1 --2- 172.21.15.19:0/2216377601 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73000d3410 0x7f73000cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.366 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f72fed9d640 1 -- 172.21.15.19:0/2216377601 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73000d3410 msgr2=0x7f73000cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.366 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f72fed9d640 1 --2- 172.21.15.19:0/2216377601 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73000d3410 0x7f73000cab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.366 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f72fed9d640 1 -- 172.21.15.19:0/2216377601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73000d4f70 msgr2=0x7f73000cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.366 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f72fed9d640 1 --2- 172.21.15.19:0/2216377601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73000d4f70 0x7f73000cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.366 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f72fed9d640 1 -- 172.21.15.19:0/2216377601 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73000c9ab0 con 0x7f730015e7d0 2024-09-12T01:55:49.366 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f72fe59c640 1 --2- 172.21.15.19:0/2216377601 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73000d3410 0x7f73000cab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:49.366 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f72fed9d640 1 --2- 172.21.15.19:0/2216377601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f730015e7d0 0x7f73000ce600 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f72f800c700 tx=0x7f72f800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:49.366 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f72eeffd640 1 -- 172.21.15.19:0/2216377601 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8018070 con 0x7f730015e7d0 2024-09-12T01:55:49.366 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f72eeffd640 1 -- 172.21.15.19:0/2216377601 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f800ce10 con 0x7f730015e7d0 2024-09-12T01:55:49.366 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f7304c8b640 1 -- 172.21.15.19:0/2216377601 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73000c9d90 con 0x7f730015e7d0 2024-09-12T01:55:49.366 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f72eeffd640 1 -- 172.21.15.19:0/2216377601 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f800a860 con 0x7f730015e7d0 2024-09-12T01:55:49.367 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.364+0000 7f7304c8b640 1 -- 172.21.15.19:0/2216377601 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73000ca350 con 0x7f730015e7d0 2024-09-12T01:55:49.367 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.365+0000 7f7304c8b640 1 -- 172.21.15.19:0/2216377601 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73000d0580 con 0x7f730015e7d0 2024-09-12T01:55:49.367 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.366+0000 7f72eeffd640 1 -- 172.21.15.19:0/2216377601 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72f801b070 con 0x7f730015e7d0 2024-09-12T01:55:49.367 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.366+0000 7f72eeffd640 1 --2- 172.21.15.19:0/2216377601 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f72e006be30 0x7f72e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.368 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.366+0000 7f72eeffd640 1 -- 172.21.15.19:0/2216377601 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f72f8089ff0 con 0x7f730015e7d0 2024-09-12T01:55:49.368 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.367+0000 7f72fe59c640 1 --2- 172.21.15.19:0/2216377601 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f72e006be30 0x7f72e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.368 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.367+0000 7f72fe59c640 1 --2- 172.21.15.19:0/2216377601 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f72e006be30 0x7f72e006e2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009af0 tx=0x7f72f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:49.370 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.371+0000 7f72eeffd640 1 -- 172.21.15.19:0/2216377601 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72f8058730 con 0x7f730015e7d0 2024-09-12T01:55:49.547 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.548+0000 7f7304c8b640 1 -- 172.21.15.19:0/2216377601 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f730008e380 con 0x7f730015e7d0 2024-09-12T01:55:49.548 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.549+0000 7f72eeffd640 1 -- 172.21.15.19:0/2216377601 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12884 (secure 0 0 0) 0x7f72f805ca30 con 0x7f730015e7d0 2024-09-12T01:55:49.548 INFO:teuthology.misc.health.smithi019.stdout: 2024-09-12T01:55:49.549 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":18,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:55:46.575922+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:55:49.551 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.551+0000 7f7304c8b640 1 -- 172.21.15.19:0/2216377601 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f72e006be30 msgr2=0x7f72e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.551 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.551+0000 7f7304c8b640 1 --2- 172.21.15.19:0/2216377601 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f72e006be30 0x7f72e006e2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009af0 tx=0x7f72f0008040 comp rx=0 tx=0).stop 2024-09-12T01:55:49.551 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.551+0000 7f7304c8b640 1 -- 172.21.15.19:0/2216377601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f730015e7d0 msgr2=0x7f73000ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.551 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.551+0000 7f7304c8b640 1 --2- 172.21.15.19:0/2216377601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f730015e7d0 0x7f73000ce600 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f72f800c700 tx=0x7f72f800cbc0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.551 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.551+0000 7f7304c8b640 1 -- 172.21.15.19:0/2216377601 shutdown_connections 2024-09-12T01:55:49.551 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.551+0000 7f7304c8b640 1 --2- 172.21.15.19:0/2216377601 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f72e006be30 0x7f72e006e2f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.551 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.551+0000 7f7304c8b640 1 --2- 172.21.15.19:0/2216377601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f730015e7d0 0x7f73000ce600 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.552 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.551+0000 7f7304c8b640 1 --2- 172.21.15.19:0/2216377601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73000d4f70 0x7f73000cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.552 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.551+0000 7f7304c8b640 1 --2- 172.21.15.19:0/2216377601 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73000d3410 0x7f73000cab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.552 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.551+0000 7f7304c8b640 1 -- 172.21.15.19:0/2216377601 >> 172.21.15.19:0/2216377601 conn(0x7f730008c000 msgr2=0x7f730015ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:49.552 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.551+0000 7f7304c8b640 1 -- 172.21.15.19:0/2216377601 shutdown_connections 2024-09-12T01:55:49.552 INFO:teuthology.misc.health.smithi019.stderr:2024-09-12T01:55:49.551+0000 7f7304c8b640 1 -- 172.21.15.19:0/2216377601 wait complete. 2024-09-12T01:55:49.560 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T01:55:49.560 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T01:55:49.560 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T01:55:49.560 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T01:55:49.563 INFO:tasks.ceph.mds.a:Started 2024-09-12T01:55:49.563 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T01:55:49.563 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T01:55:49.565 INFO:tasks.ceph.mds.c:Started 2024-09-12T01:55:49.565 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T01:55:49.565 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T01:55:49.568 INFO:tasks.ceph.mds.b:Started 2024-09-12T01:55:49.568 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T01:55:49.568 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T01:55:49.570 INFO:tasks.ceph.mds.d:Started 2024-09-12T01:55:49.570 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-12T01:55:49.571 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:55:49.642 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-09-12T01:55:49.642 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T01:55:49.654 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T01:55:49.654 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2024-09-12T01:55:49.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.678+0000 7f06e38d2640 1 Processor -- start 2024-09-12T01:55:49.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.679+0000 7f06e38d2640 1 -- start start 2024-09-12T01:55:49.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.680+0000 7f06e38d2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f06dc161c80 0x7f06dc06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.680+0000 7f06e38d2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06dc162060 0x7f06dc0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.680+0000 7f06e38d2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06dc06e870 con 0x7f06dc0b64b0 2024-09-12T01:55:49.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.680+0000 7f06e38d2640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f06dc06d9f0 con 0x7f06dc161c80 2024-09-12T01:55:49.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.680+0000 7f06e38d2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f06dc06dcd0 con 0x7f06dc162060 2024-09-12T01:55:49.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.680+0000 7f06e166e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f06dc161c80 0x7f06dc06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.680+0000 7f06e166e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f06dc161c80 0x7f06dc06e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42910/0 (socket says 172.21.15.19:42910) 2024-09-12T01:55:49.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.680+0000 7f06e166e640 1 -- 172.21.15.19:0/3605326934 learned_addr learned my addr 172.21.15.19:0/3605326934 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:49.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.680+0000 7f06e0e6d640 1 --2- 172.21.15.19:0/3605326934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06dc162060 0x7f06dc0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.680+0000 7f06e166e640 1 -- 172.21.15.19:0/3605326934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06dc162060 msgr2=0x7f06dc0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:49.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.680+0000 7f06e166e640 1 --2- 172.21.15.19:0/3605326934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06dc162060 0x7f06dc0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.680+0000 7f06e166e640 1 -- 172.21.15.19:0/3605326934 >> v1:172.21.15.135:6789/0 conn(0x7f06dc0b64b0 legacy=0x7f06dc162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.680+0000 7f06e166e640 1 -- 172.21.15.19:0/3605326934 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06dc06dfb0 con 0x7f06dc161c80 2024-09-12T01:55:49.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.681+0000 7f06e166e640 1 --2- 172.21.15.19:0/3605326934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06dc161c80 0x7f06dc06e330 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009870 tx=0x7f06cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ebd3c5b98ae6f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:49.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.681+0000 7f06d3fff640 1 -- 172.21.15.19:0/3605326934 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc037070 con 0x7f06dc161c80 2024-09-12T01:55:49.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.681+0000 7f06d3fff640 1 -- 172.21.15.19:0/3605326934 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06cc032440 con 0x7f06dc161c80 2024-09-12T01:55:49.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.681+0000 7f06d3fff640 1 -- 172.21.15.19:0/3605326934 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc032810 con 0x7f06dc161c80 2024-09-12T01:55:49.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.681+0000 7f06e38d2640 1 -- 172.21.15.19:0/3605326934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06dc161c80 msgr2=0x7f06dc06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.681+0000 7f06e38d2640 1 --2- 172.21.15.19:0/3605326934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06dc161c80 0x7f06dc06e330 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009870 tx=0x7f06cc02a270 comp rx=0 tx=0).stop 2024-09-12T01:55:49.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.682+0000 7f06e38d2640 1 -- 172.21.15.19:0/3605326934 shutdown_connections 2024-09-12T01:55:49.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.682+0000 7f06e38d2640 1 --2- 172.21.15.19:0/3605326934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06dc162060 0x7f06dc0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.682+0000 7f06e38d2640 1 --2- 172.21.15.19:0/3605326934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06dc161c80 0x7f06dc06e330 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.682+0000 7f06e38d2640 1 -- 172.21.15.19:0/3605326934 >> 172.21.15.19:0/3605326934 conn(0x7f06dc0d44f0 msgr2=0x7f06dc0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:49.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.682+0000 7f06e38d2640 1 -- 172.21.15.19:0/3605326934 shutdown_connections 2024-09-12T01:55:49.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.682+0000 7f06e38d2640 1 -- 172.21.15.19:0/3605326934 wait complete. 2024-09-12T01:55:49.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.683+0000 7f06e38d2640 1 Processor -- start 2024-09-12T01:55:49.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.683+0000 7f06e38d2640 1 -- start start 2024-09-12T01:55:49.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.683+0000 7f06e38d2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06dc0b64b0 0x7f06dc155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.683+0000 7f06e38d2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06dc161c80 0x7f06dc0b8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.683+0000 7f06e38d2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06dc162060 0x7f06dc15e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.683+0000 7f06e38d2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc0d2a10 con 0x7f06dc0b64b0 2024-09-12T01:55:49.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06e38d2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc0d2890 con 0x7f06dc161c80 2024-09-12T01:55:49.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06e38d2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f06dc0b6960 con 0x7f06dc162060 2024-09-12T01:55:49.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06e166e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06dc0b64b0 0x7f06dc155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06e166e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06dc0b64b0 0x7f06dc155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42914/0 (socket says 172.21.15.19:42914) 2024-09-12T01:55:49.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06e166e640 1 -- 172.21.15.19:0/1060462100 learned_addr learned my addr 172.21.15.19:0/1060462100 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:49.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06e0e6d640 1 --2- 172.21.15.19:0/1060462100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06dc161c80 0x7f06dc0b8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06e1e6f640 1 --2- 172.21.15.19:0/1060462100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06dc162060 0x7f06dc15e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06e166e640 1 -- 172.21.15.19:0/1060462100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06dc162060 msgr2=0x7f06dc15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06e166e640 1 --2- 172.21.15.19:0/1060462100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06dc162060 0x7f06dc15e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06e166e640 1 -- 172.21.15.19:0/1060462100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06dc161c80 msgr2=0x7f06dc0b8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06e166e640 1 --2- 172.21.15.19:0/1060462100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06dc161c80 0x7f06dc0b8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06e166e640 1 -- 172.21.15.19:0/1060462100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06dc0c87e0 con 0x7f06dc0b64b0 2024-09-12T01:55:49.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06e0e6d640 1 --2- 172.21.15.19:0/1060462100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06dc161c80 0x7f06dc0b8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:49.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06e166e640 1 --2- 172.21.15.19:0/1060462100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06dc0b64b0 0x7f06dc155ef0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f06cc02a2b0 tx=0x7f06cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:49.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06d1ffb640 1 -- 172.21.15.19:0/1060462100 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc037040 con 0x7f06dc0b64b0 2024-09-12T01:55:49.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06d1ffb640 1 -- 172.21.15.19:0/1060462100 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06cc042070 con 0x7f06dc0b64b0 2024-09-12T01:55:49.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06e38d2640 1 -- 172.21.15.19:0/1060462100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06dc0c8a80 con 0x7f06dc0b64b0 2024-09-12T01:55:49.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06d1ffb640 1 -- 172.21.15.19:0/1060462100 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc030880 con 0x7f06dc0b64b0 2024-09-12T01:55:49.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.684+0000 7f06e38d2640 1 -- 172.21.15.19:0/1060462100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06dc0c9040 con 0x7f06dc0b64b0 2024-09-12T01:55:49.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.685+0000 7f06e38d2640 1 -- 172.21.15.19:0/1060462100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06dc06e330 con 0x7f06dc0b64b0 2024-09-12T01:55:49.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.686+0000 7f06d1ffb640 1 -- 172.21.15.19:0/1060462100 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f06cc030a20 con 0x7f06dc0b64b0 2024-09-12T01:55:49.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.686+0000 7f06d1ffb640 1 --2- 172.21.15.19:0/1060462100 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f06c006be30 0x7f06c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.687+0000 7f06d1ffb640 1 -- 172.21.15.19:0/1060462100 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f06cc0ab2f0 con 0x7f06dc0b64b0 2024-09-12T01:55:49.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.687+0000 7f06e0e6d640 1 --2- 172.21.15.19:0/1060462100 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f06c006be30 0x7f06c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.687+0000 7f06e0e6d640 1 --2- 172.21.15.19:0/1060462100 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f06c006be30 0x7f06c006e2f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0d2c70 tx=0x7f06d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:49.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.691+0000 7f06d1ffb640 1 -- 172.21.15.19:0/1060462100 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f06cc07a080 con 0x7f06dc0b64b0 2024-09-12T01:55:49.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.901+0000 7f06e38d2640 1 -- 172.21.15.19:0/1060462100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06dc0ba470 con 0x7f06dc0b64b0 2024-09-12T01:55:49.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.902+0000 7f06d1ffb640 1 -- 172.21.15.19:0/1060462100 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f06cc079980 con 0x7f06dc0b64b0 2024-09-12T01:55:49.901 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:55:49.901 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":2,"btime":"2024-09-12T01:55:49:647469+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3369866614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3369866614},{"type":"v1","addr":"172.21.15.19:6834","nonce":3369866614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T01:55:49.902 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 2 2024-09-12T01:55:49.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.904+0000 7f06e38d2640 1 -- 172.21.15.19:0/1060462100 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f06c006be30 msgr2=0x7f06c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.904+0000 7f06e38d2640 1 --2- 172.21.15.19:0/1060462100 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f06c006be30 0x7f06c006e2f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0d2c70 tx=0x7f06d8008040 comp rx=0 tx=0).stop 2024-09-12T01:55:49.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.904+0000 7f06e38d2640 1 -- 172.21.15.19:0/1060462100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06dc0b64b0 msgr2=0x7f06dc155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.904+0000 7f06e38d2640 1 --2- 172.21.15.19:0/1060462100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06dc0b64b0 0x7f06dc155ef0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f06cc02a2b0 tx=0x7f06cc0046c0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.904+0000 7f06e38d2640 1 -- 172.21.15.19:0/1060462100 shutdown_connections 2024-09-12T01:55:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.904+0000 7f06e38d2640 1 --2- 172.21.15.19:0/1060462100 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f06c006be30 0x7f06c006e2f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.904+0000 7f06e38d2640 1 --2- 172.21.15.19:0/1060462100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06dc162060 0x7f06dc15e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.904+0000 7f06e38d2640 1 --2- 172.21.15.19:0/1060462100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06dc161c80 0x7f06dc0b8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.904+0000 7f06e38d2640 1 --2- 172.21.15.19:0/1060462100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06dc0b64b0 0x7f06dc155ef0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.904+0000 7f06e38d2640 1 -- 172.21.15.19:0/1060462100 >> 172.21.15.19:0/1060462100 conn(0x7f06dc0d44f0 msgr2=0x7f06dc06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.904+0000 7f06e38d2640 1 -- 172.21.15.19:0/1060462100 shutdown_connections 2024-09-12T01:55:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:49.904+0000 7f06e38d2640 1 -- 172.21.15.19:0/1060462100 wait complete. 2024-09-12T01:55:51.915 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:55:52.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.031+0000 7fe9a2ba6640 1 Processor -- start 2024-09-12T01:55:52.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.031+0000 7fe9a2ba6640 1 -- start start 2024-09-12T01:55:52.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.031+0000 7fe9a2ba6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe99c0d1090 0x7fe99c09b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.031+0000 7fe9a2ba6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe99c0b1620 0x7fe99c0b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.031+0000 7fe9a2ba6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe99c0cec00 con 0x7fe99c15c520 2024-09-12T01:55:52.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.031+0000 7fe9a2ba6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fe99c09bd90 con 0x7fe99c0d1090 2024-09-12T01:55:52.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.031+0000 7fe9a2ba6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe99c0d0010 con 0x7fe99c0b1620 2024-09-12T01:55:52.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.032+0000 7fe99bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe99c0d1090 0x7fe99c09b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.032+0000 7fe9a0942640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe99c15c520 0x7fe99c0d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48698/0 (socket says 172.21.15.19:48698) 2024-09-12T01:55:52.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.032+0000 7fe9a0942640 1 -- 172.21.15.19:0/3861104591 learned_addr learned my addr 172.21.15.19:0/3861104591 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:55:52.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.032+0000 7fe99bfff640 1 -- 172.21.15.19:0/3861104591 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe99c0b1620 msgr2=0x7fe99c0b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:52.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.032+0000 7fe9a1143640 1 --2- 172.21.15.19:0/3861104591 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe99c0b1620 0x7fe99c0b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.032+0000 7fe99b7fe640 1 -- 172.21.15.19:0/3861104591 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2624444820 0 0) 0x7fe99c0cec00 con 0x7fe99c15c520 2024-09-12T01:55:52.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.032+0000 7fe99bfff640 1 --2- 172.21.15.19:0/3861104591 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe99c0b1620 0x7fe99c0b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.032+0000 7fe99bfff640 1 -- 172.21.15.19:0/3861104591 >> v1:172.21.15.19:6789/0 conn(0x7fe99c15c520 legacy=0x7fe99c0d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.032+0000 7fe99bfff640 1 -- 172.21.15.19:0/3861104591 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99c0d02f0 con 0x7fe99c0d1090 2024-09-12T01:55:52.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.033+0000 7fe99bfff640 1 --2- 172.21.15.19:0/3861104591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c0d1090 0x7fe99c09b720 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe9900097a0 tx=0x7fe99002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26d4861dfa48b13 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:52.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.033+0000 7fe99b7fe640 1 -- 172.21.15.19:0/3861104591 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe990037070 con 0x7fe99c0d1090 2024-09-12T01:55:52.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.033+0000 7fe99b7fe640 1 -- 172.21.15.19:0/3861104591 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe990032440 con 0x7fe99c0d1090 2024-09-12T01:55:52.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.033+0000 7fe99b7fe640 1 -- 172.21.15.19:0/3861104591 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe990032810 con 0x7fe99c0d1090 2024-09-12T01:55:52.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.033+0000 7fe9a2ba6640 1 -- 172.21.15.19:0/3861104591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c0d1090 msgr2=0x7fe99c09b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.033+0000 7fe9a2ba6640 1 --2- 172.21.15.19:0/3861104591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c0d1090 0x7fe99c09b720 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe9900097a0 tx=0x7fe99002a180 comp rx=0 tx=0).stop 2024-09-12T01:55:52.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.033+0000 7fe9a2ba6640 1 -- 172.21.15.19:0/3861104591 shutdown_connections 2024-09-12T01:55:52.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.033+0000 7fe9a2ba6640 1 --2- 172.21.15.19:0/3861104591 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe99c0b1620 0x7fe99c0b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.033+0000 7fe9a2ba6640 1 --2- 172.21.15.19:0/3861104591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c0d1090 0x7fe99c09b720 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.033+0000 7fe9a2ba6640 1 -- 172.21.15.19:0/3861104591 >> 172.21.15.19:0/3861104591 conn(0x7fe99c0d23a0 msgr2=0x7fe99c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:52.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.033+0000 7fe9a2ba6640 1 -- 172.21.15.19:0/3861104591 shutdown_connections 2024-09-12T01:55:52.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.034+0000 7fe9a2ba6640 1 -- 172.21.15.19:0/3861104591 wait complete. 2024-09-12T01:55:52.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.035+0000 7fe9a2ba6640 1 Processor -- start 2024-09-12T01:55:52.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.035+0000 7fe9a2ba6640 1 -- start start 2024-09-12T01:55:52.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.036+0000 7fe9a2ba6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe99c0b1620 0x7fe99c0afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.036+0000 7fe9a2ba6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c0d1090 0x7fe99c0c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.036+0000 7fe9a2ba6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe99c15c520 0x7fe99c150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.036+0000 7fe9a2ba6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c15c900 con 0x7fe99c0d1090 2024-09-12T01:55:52.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.036+0000 7fe9a2ba6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c0d05d0 con 0x7fe99c0b1620 2024-09-12T01:55:52.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.036+0000 7fe9a2ba6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe99c0cae90 con 0x7fe99c15c520 2024-09-12T01:55:52.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.036+0000 7fe99bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c0d1090 0x7fe99c0c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.036+0000 7fe99bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c0d1090 0x7fe99c0c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51992/0 (socket says 172.21.15.19:51992) 2024-09-12T01:55:52.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.036+0000 7fe99bfff640 1 -- 172.21.15.19:0/2672459702 learned_addr learned my addr 172.21.15.19:0/2672459702 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:52.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.036+0000 7fe9a0942640 1 --2- 172.21.15.19:0/2672459702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe99c0b1620 0x7fe99c0afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.036+0000 7fe99bfff640 1 -- 172.21.15.19:0/2672459702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe99c15c520 msgr2=0x7fe99c150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.036+0000 7fe9a1143640 1 --2- 172.21.15.19:0/2672459702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe99c15c520 0x7fe99c150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.036+0000 7fe99bfff640 1 --2- 172.21.15.19:0/2672459702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe99c15c520 0x7fe99c150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.036+0000 7fe99bfff640 1 -- 172.21.15.19:0/2672459702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe99c0b1620 msgr2=0x7fe99c0afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.036+0000 7fe99bfff640 1 --2- 172.21.15.19:0/2672459702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe99c0b1620 0x7fe99c0afa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.036+0000 7fe99bfff640 1 -- 172.21.15.19:0/2672459702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99c0cb0b0 con 0x7fe99c0d1090 2024-09-12T01:55:52.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.036+0000 7fe99bfff640 1 --2- 172.21.15.19:0/2672459702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c0d1090 0x7fe99c0c5ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe9900097a0 tx=0x7fe9900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:52.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.037+0000 7fe9997fa640 1 -- 172.21.15.19:0/2672459702 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe990037050 con 0x7fe99c0d1090 2024-09-12T01:55:52.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.037+0000 7fe9997fa640 1 -- 172.21.15.19:0/2672459702 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe990038040 con 0x7fe99c0d1090 2024-09-12T01:55:52.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.037+0000 7fe9a2ba6640 1 -- 172.21.15.19:0/2672459702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99c0cb390 con 0x7fe99c0d1090 2024-09-12T01:55:52.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.037+0000 7fe9997fa640 1 -- 172.21.15.19:0/2672459702 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe990004490 con 0x7fe99c0d1090 2024-09-12T01:55:52.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.037+0000 7fe9a2ba6640 1 -- 172.21.15.19:0/2672459702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe99c0cbc30 con 0x7fe99c0d1090 2024-09-12T01:55:52.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.038+0000 7fe9a2ba6640 1 -- 172.21.15.19:0/2672459702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe99c0cb780 con 0x7fe99c0d1090 2024-09-12T01:55:52.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.038+0000 7fe9997fa640 1 -- 172.21.15.19:0/2672459702 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe990030980 con 0x7fe99c0d1090 2024-09-12T01:55:52.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.038+0000 7fe9997fa640 1 --2- 172.21.15.19:0/2672459702 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe98806be30 0x7fe98806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.039+0000 7fe9997fa640 1 -- 172.21.15.19:0/2672459702 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fe9900ab660 con 0x7fe99c0d1090 2024-09-12T01:55:52.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.039+0000 7fe9a0942640 1 --2- 172.21.15.19:0/2672459702 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe98806be30 0x7fe98806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.039+0000 7fe9a0942640 1 --2- 172.21.15.19:0/2672459702 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe98806be30 0x7fe98806e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe98c000f60 tx=0x7fe98c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:52.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.043+0000 7fe9997fa640 1 -- 172.21.15.19:0/2672459702 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe99007a510 con 0x7fe99c0d1090 2024-09-12T01:55:52.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.254+0000 7fe9a2ba6640 1 -- 172.21.15.19:0/2672459702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe99c0b1d40 con 0x7fe99c0d1090 2024-09-12T01:55:52.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.254+0000 7fe9997fa640 1 -- 172.21.15.19:0/2672459702 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3912 (secure 0 0 0) 0x7fe990079e10 con 0x7fe99c0d1090 2024-09-12T01:55:52.254 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:55:52.254 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":3,"btime":"2024-09-12T01:55:50:648521+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4024559276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":4024559276},{"type":"v1","addr":"172.21.15.135:6837","nonce":4024559276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3369866614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3369866614},{"type":"v1","addr":"172.21.15.19:6834","nonce":3369866614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2476634027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2476634027},{"type":"v1","addr":"172.21.15.19:6835","nonce":2476634027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/4290669195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4290669195},{"type":"v1","addr":"172.21.15.135:6836","nonce":4290669195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-12T01:55:52.254 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 3 2024-09-12T01:55:52.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.256+0000 7fe9a2ba6640 1 -- 172.21.15.19:0/2672459702 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe98806be30 msgr2=0x7fe98806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.256+0000 7fe9a2ba6640 1 --2- 172.21.15.19:0/2672459702 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe98806be30 0x7fe98806e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe98c000f60 tx=0x7fe98c009040 comp rx=0 tx=0).stop 2024-09-12T01:55:52.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.256+0000 7fe9a2ba6640 1 -- 172.21.15.19:0/2672459702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c0d1090 msgr2=0x7fe99c0c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.256+0000 7fe9a2ba6640 1 --2- 172.21.15.19:0/2672459702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c0d1090 0x7fe99c0c5ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe9900097a0 tx=0x7fe9900046c0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.256+0000 7fe9a2ba6640 1 -- 172.21.15.19:0/2672459702 shutdown_connections 2024-09-12T01:55:52.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.256+0000 7fe9a2ba6640 1 --2- 172.21.15.19:0/2672459702 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe98806be30 0x7fe98806e2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.256+0000 7fe9a2ba6640 1 --2- 172.21.15.19:0/2672459702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe99c15c520 0x7fe99c150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.256+0000 7fe9a2ba6640 1 --2- 172.21.15.19:0/2672459702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c0d1090 0x7fe99c0c5ed0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.256+0000 7fe9a2ba6640 1 --2- 172.21.15.19:0/2672459702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe99c0b1620 0x7fe99c0afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.256+0000 7fe9a2ba6640 1 -- 172.21.15.19:0/2672459702 >> 172.21.15.19:0/2672459702 conn(0x7fe99c0d23a0 msgr2=0x7fe99c09b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:52.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.256+0000 7fe9a2ba6640 1 -- 172.21.15.19:0/2672459702 shutdown_connections 2024-09-12T01:55:52.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.257+0000 7fe9a2ba6640 1 -- 172.21.15.19:0/2672459702 wait complete. 2024-09-12T01:55:52.267 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T01:55:52.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.369+0000 7f8a27778640 1 Processor -- start 2024-09-12T01:55:52.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.369+0000 7f8a27778640 1 -- start start 2024-09-12T01:55:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.370+0000 7f8a27778640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a20162060 0x7f8a200b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.370+0000 7f8a27778640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a2006d9f0 con 0x7f8a20161c80 2024-09-12T01:55:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.370+0000 7f8a27778640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a2006dcd0 con 0x7f8a200b64b0 2024-09-12T01:55:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.370+0000 7f8a27778640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2006dfb0 con 0x7f8a20162060 2024-09-12T01:55:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.370+0000 7f8a25514640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8a20161c80 0x7f8a2006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48710/0 (socket says 172.21.15.19:48710) 2024-09-12T01:55:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.370+0000 7f8a25514640 1 -- 172.21.15.19:0/3522175719 learned_addr learned my addr 172.21.15.19:0/3522175719 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:55:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a24d13640 1 --2- 172.21.15.19:0/3522175719 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a20162060 0x7f8a200b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a1ffff640 1 -- 172.21.15.19:0/3522175719 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4008489039 0 0) 0x7f8a2006d9f0 con 0x7f8a20161c80 2024-09-12T01:55:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a1ffff640 1 -- 172.21.15.19:0/3522175719 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a08003520 con 0x7f8a20161c80 2024-09-12T01:55:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a1ffff640 1 -- 172.21.15.19:0/3522175719 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1076796681 0 0) 0x7f8a2006dcd0 con 0x7f8a200b64b0 2024-09-12T01:55:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a1ffff640 1 -- 172.21.15.19:0/3522175719 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a2006d9f0 con 0x7f8a200b64b0 2024-09-12T01:55:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a1ffff640 1 -- 172.21.15.19:0/3522175719 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1553996264 0 0) 0x7f8a08003520 con 0x7f8a20161c80 2024-09-12T01:55:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a1ffff640 1 -- 172.21.15.19:0/3522175719 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a20162060 msgr2=0x7f8a200b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a1ffff640 1 --2- 172.21.15.19:0/3522175719 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a20162060 0x7f8a200b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a1ffff640 1 -- 172.21.15.19:0/3522175719 >> v1:172.21.15.135:6789/0 conn(0x7f8a200b64b0 legacy=0x7f8a200cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a1ffff640 1 -- 172.21.15.19:0/3522175719 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a200d2890 con 0x7f8a20161c80 2024-09-12T01:55:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a1ffff640 1 -- 172.21.15.19:0/3522175719 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f8a100019f0 con 0x7f8a20161c80 2024-09-12T01:55:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a24d13640 1 --2- 172.21.15.19:0/3522175719 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a20162060 0x7f8a200b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a1ffff640 1 -- 172.21.15.19:0/3522175719 >> v1:172.21.15.19:6789/0 conn(0x7f8a20161c80 legacy=0x7f8a2006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a1ffff640 1 --2- 172.21.15.19:0/3522175719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a08003b70 0x7f8a08003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a1ffff640 1 --2- 172.21.15.19:0/3522175719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08004800 0x7f8a08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a1ffff640 1 --2- 172.21.15.19:0/3522175719 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a20162060 0x7f8a080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a1ffff640 1 -- 172.21.15.19:0/3522175719 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2006dfb0 con 0x7f8a08004800 2024-09-12T01:55:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a1ffff640 1 -- 172.21.15.19:0/3522175719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0800b9f0 con 0x7f8a08003b70 2024-09-12T01:55:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a1ffff640 1 -- 172.21.15.19:0/3522175719 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8a0800bbf0 con 0x7f8a20162060 2024-09-12T01:55:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a24d13640 1 --2- 172.21.15.19:0/3522175719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08004800 0x7f8a08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a25514640 1 --2- 172.21.15.19:0/3522175719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a08003b70 0x7f8a08003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a25d15640 1 --2- 172.21.15.19:0/3522175719 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a20162060 0x7f8a080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a24d13640 1 -- 172.21.15.19:0/3522175719 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a20162060 msgr2=0x7f8a080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a24d13640 1 --2- 172.21.15.19:0/3522175719 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a20162060 0x7f8a080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a24d13640 1 -- 172.21.15.19:0/3522175719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a08003b70 msgr2=0x7f8a08003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.371+0000 7f8a24d13640 1 --2- 172.21.15.19:0/3522175719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a08003b70 0x7f8a08003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.372+0000 7f8a24d13640 1 -- 172.21.15.19:0/3522175719 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a08003520 con 0x7f8a08004800 2024-09-12T01:55:52.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.372+0000 7f8a25514640 1 --2- 172.21.15.19:0/3522175719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a08003b70 0x7f8a08003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:52.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.372+0000 7f8a24d13640 1 --2- 172.21.15.19:0/3522175719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08004800 0x7f8a08004c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a200cb570 tx=0x7f8a08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94e959e474b2d2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:52.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.372+0000 7f8a1ffff640 1 -- 172.21.15.19:0/3522175719 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a14009860 con 0x7f8a08004800 2024-09-12T01:55:52.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.372+0000 7f8a1ffff640 1 -- 172.21.15.19:0/3522175719 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a1402ae50 con 0x7f8a08004800 2024-09-12T01:55:52.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.372+0000 7f8a1ffff640 1 -- 172.21.15.19:0/3522175719 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a14004240 con 0x7f8a08004800 2024-09-12T01:55:52.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.373+0000 7f8a27778640 1 -- 172.21.15.19:0/3522175719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08004800 msgr2=0x7f8a08004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.373+0000 7f8a27778640 1 --2- 172.21.15.19:0/3522175719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08004800 0x7f8a08004c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a200cb570 tx=0x7f8a08005830 comp rx=0 tx=0).stop 2024-09-12T01:55:52.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.373+0000 7f8a25d15640 1 -- 172.21.15.19:0/3522175719 reap_dead start 2024-09-12T01:55:52.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.373+0000 7f8a27778640 1 -- 172.21.15.19:0/3522175719 shutdown_connections 2024-09-12T01:55:52.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.373+0000 7f8a27778640 1 -- 172.21.15.19:0/3522175719 >> 172.21.15.19:0/3522175719 conn(0x7f8a200d44f0 msgr2=0x7f8a200d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:52.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.373+0000 7f8a27778640 1 -- 172.21.15.19:0/3522175719 shutdown_connections 2024-09-12T01:55:52.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.373+0000 7f8a27778640 1 -- 172.21.15.19:0/3522175719 wait complete. 2024-09-12T01:55:52.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.374+0000 7f8a27778640 1 Processor -- start 2024-09-12T01:55:52.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.374+0000 7f8a27778640 1 -- start start 2024-09-12T01:55:52.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.375+0000 7f8a27778640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08004800 0x7f8a2015e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.375+0000 7f8a27778640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a2015a900 0x7f8a200cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.375+0000 7f8a27778640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a2015a100 0x7f8a200ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.375+0000 7f8a27778640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8a200b6300 con 0x7f8a08004800 2024-09-12T01:55:52.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.375+0000 7f8a27778640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a200b6180 con 0x7f8a2015a900 2024-09-12T01:55:52.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.375+0000 7f8a27778640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8a200b9110 con 0x7f8a2015a100 2024-09-12T01:55:52.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.375+0000 7f8a25514640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08004800 0x7f8a2015e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.375+0000 7f8a25514640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08004800 0x7f8a2015e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52008/0 (socket says 172.21.15.19:52008) 2024-09-12T01:55:52.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.375+0000 7f8a25514640 1 -- 172.21.15.19:0/1917343548 learned_addr learned my addr 172.21.15.19:0/1917343548 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:52.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.375+0000 7f8a25d15640 1 --2- 172.21.15.19:0/1917343548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a2015a100 0x7f8a200ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.375+0000 7f8a24d13640 1 --2- 172.21.15.19:0/1917343548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a2015a900 0x7f8a200cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.375+0000 7f8a25514640 1 -- 172.21.15.19:0/1917343548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a2015a100 msgr2=0x7f8a200ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.375+0000 7f8a25514640 1 --2- 172.21.15.19:0/1917343548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a2015a100 0x7f8a200ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.375+0000 7f8a25514640 1 -- 172.21.15.19:0/1917343548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a2015a900 msgr2=0x7f8a200cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.375+0000 7f8a25514640 1 --2- 172.21.15.19:0/1917343548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a2015a900 0x7f8a200cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.375+0000 7f8a25514640 1 -- 172.21.15.19:0/1917343548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a200b8850 con 0x7f8a08004800 2024-09-12T01:55:52.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.376+0000 7f8a25514640 1 --2- 172.21.15.19:0/1917343548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08004800 0x7f8a2015e1a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8a10007b60 tx=0x7f8a1000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:52.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.376+0000 7f8a1dffb640 1 -- 172.21.15.19:0/1917343548 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a10013420 con 0x7f8a08004800 2024-09-12T01:55:52.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.376+0000 7f8a1dffb640 1 -- 172.21.15.19:0/1917343548 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a10018070 con 0x7f8a08004800 2024-09-12T01:55:52.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.376+0000 7f8a27778640 1 -- 172.21.15.19:0/1917343548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a200ccc50 con 0x7f8a08004800 2024-09-12T01:55:52.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.376+0000 7f8a1dffb640 1 -- 172.21.15.19:0/1917343548 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a100137c0 con 0x7f8a08004800 2024-09-12T01:55:52.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.376+0000 7f8a27778640 1 -- 172.21.15.19:0/1917343548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a200b8ac0 con 0x7f8a08004800 2024-09-12T01:55:52.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.377+0000 7f8a27778640 1 -- 172.21.15.19:0/1917343548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a200b6960 con 0x7f8a08004800 2024-09-12T01:55:52.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.377+0000 7f8a1dffb640 1 -- 172.21.15.19:0/1917343548 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a10013960 con 0x7f8a08004800 2024-09-12T01:55:52.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.378+0000 7f8a1dffb640 1 --2- 172.21.15.19:0/1917343548 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a0c06be60 0x7f8a0c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.378+0000 7f8a1dffb640 1 -- 172.21.15.19:0/1917343548 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f8a1008b0f0 con 0x7f8a08004800 2024-09-12T01:55:52.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.378+0000 7f8a24d13640 1 --2- 172.21.15.19:0/1917343548 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a0c06be60 0x7f8a0c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.378+0000 7f8a24d13640 1 --2- 172.21.15.19:0/1917343548 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a0c06be60 0x7f8a0c06e320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8a14032000 tx=0x7f8a14008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:52.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.382+0000 7f8a1dffb640 1 -- 172.21.15.19:0/1917343548 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a10059790 con 0x7f8a08004800 2024-09-12T01:55:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.558+0000 7f8a27778640 1 -- 172.21.15.19:0/1917343548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8a200d2a60 con 0x7f8a08004800 2024-09-12T01:55:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.559+0000 7f8a1dffb640 1 -- 172.21.15.19:0/1917343548 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f8a1005da90 con 0x7f8a08004800 2024-09-12T01:55:52.558 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:55:52.558 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-09-12T01:55:52.559 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:55:52.559 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-09-12T01:55:52.559 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-09-12T01:55:52.559 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:55:52.559 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-09-12T01:55:52.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.561+0000 7f8a27778640 1 -- 172.21.15.19:0/1917343548 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a0c06be60 msgr2=0x7f8a0c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.561+0000 7f8a27778640 1 --2- 172.21.15.19:0/1917343548 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a0c06be60 0x7f8a0c06e320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8a14032000 tx=0x7f8a14008030 comp rx=0 tx=0).stop 2024-09-12T01:55:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.561+0000 7f8a27778640 1 -- 172.21.15.19:0/1917343548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08004800 msgr2=0x7f8a2015e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.561+0000 7f8a27778640 1 --2- 172.21.15.19:0/1917343548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08004800 0x7f8a2015e1a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8a10007b60 tx=0x7f8a1000e530 comp rx=0 tx=0).stop 2024-09-12T01:55:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.561+0000 7f8a27778640 1 -- 172.21.15.19:0/1917343548 shutdown_connections 2024-09-12T01:55:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.561+0000 7f8a27778640 1 --2- 172.21.15.19:0/1917343548 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a0c06be60 0x7f8a0c06e320 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.561+0000 7f8a27778640 1 --2- 172.21.15.19:0/1917343548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a2015a100 0x7f8a200ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.561+0000 7f8a27778640 1 --2- 172.21.15.19:0/1917343548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a2015a900 0x7f8a200cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.561+0000 7f8a27778640 1 --2- 172.21.15.19:0/1917343548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08004800 0x7f8a2015e1a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.561+0000 7f8a27778640 1 -- 172.21.15.19:0/1917343548 >> 172.21.15.19:0/1917343548 conn(0x7f8a200d44f0 msgr2=0x7f8a200b48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.561+0000 7f8a27778640 1 -- 172.21.15.19:0/1917343548 shutdown_connections 2024-09-12T01:55:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.561+0000 7f8a27778640 1 -- 172.21.15.19:0/1917343548 wait complete. 2024-09-12T01:55:52.570 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:55:52.571 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:55:52.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.678+0000 7ff81cce6640 1 Processor -- start 2024-09-12T01:55:52.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.678+0000 7ff81cce6640 1 -- start start 2024-09-12T01:55:52.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81cce6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff81815e6c0 0x7ff8180cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81cce6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8180d5090 0x7ff8180cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81cce6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8180cfef0 con 0x7ff8180cfae0 2024-09-12T01:55:52.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81cce6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff8180cf400 con 0x7ff81815e6c0 2024-09-12T01:55:52.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81cce6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff8180b10d0 con 0x7ff8180d5090 2024-09-12T01:55:52.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff816d9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff8180cfae0 0x7ff8181622d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48718/0 (socket says 172.21.15.19:48718) 2024-09-12T01:55:52.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff816d9d640 1 -- 172.21.15.19:0/3180980239 learned_addr learned my addr 172.21.15.19:0/3180980239 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:55:52.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff815d9b640 1 --2- 172.21.15.19:0/3180980239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8180d5090 0x7ff8180cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81559a640 1 -- 172.21.15.19:0/3180980239 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3286005161 0 0) 0x7ff810001490 con 0x7ff8180cfae0 2024-09-12T01:55:52.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81559a640 1 -- 172.21.15.19:0/3180980239 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff800003520 con 0x7ff8180cfae0 2024-09-12T01:55:52.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81659c640 1 --2- 172.21.15.19:0/3180980239 >> v2:172.21.15.135:3300/0 conn(0x7ff81815e6c0 0x7ff8180cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81559a640 1 -- 172.21.15.19:0/3180980239 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2844107923 0 0) 0x7ff800003520 con 0x7ff8180cfae0 2024-09-12T01:55:52.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81559a640 1 -- 172.21.15.19:0/3180980239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8180d5090 msgr2=0x7ff8180cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:52.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81559a640 1 --2- 172.21.15.19:0/3180980239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8180d5090 0x7ff8180cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81559a640 1 -- 172.21.15.19:0/3180980239 >> v2:172.21.15.135:3300/0 conn(0x7ff81815e6c0 msgr2=0x7ff8180cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:52.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81559a640 1 --2- 172.21.15.19:0/3180980239 >> v2:172.21.15.135:3300/0 conn(0x7ff81815e6c0 0x7ff8180cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81559a640 1 -- 172.21.15.19:0/3180980239 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8180d34f0 con 0x7ff8180cfae0 2024-09-12T01:55:52.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81559a640 1 -- 172.21.15.19:0/3180980239 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7ff810001bc0 con 0x7ff8180cfae0 2024-09-12T01:55:52.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81559a640 1 -- 172.21.15.19:0/3180980239 >> v1:172.21.15.19:6789/0 conn(0x7ff8180cfae0 legacy=0x7ff8181622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81559a640 1 --2- 172.21.15.19:0/3180980239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8000039b0 0x7ff800003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81559a640 1 --2- 172.21.15.19:0/3180980239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff800004800 0x7ff800004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81559a640 1 --2- 172.21.15.19:0/3180980239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8000051c0 0x7ff80000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81559a640 1 -- 172.21.15.19:0/3180980239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff8180cf400 con 0x7ff800004800 2024-09-12T01:55:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.679+0000 7ff81559a640 1 -- 172.21.15.19:0/3180980239 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff8180b10d0 con 0x7ff8000039b0 2024-09-12T01:55:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.680+0000 7ff81559a640 1 -- 172.21.15.19:0/3180980239 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff80000c000 con 0x7ff8000051c0 2024-09-12T01:55:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.680+0000 7ff815d9b640 1 --2- 172.21.15.19:0/3180980239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8180d5090 0x7ff8180cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.680+0000 7ff81659c640 1 --2- 172.21.15.19:0/3180980239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8000039b0 0x7ff800003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.680+0000 7ff816d9d640 1 --2- 172.21.15.19:0/3180980239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8000051c0 0x7ff80000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.680+0000 7ff815d9b640 1 --2- 172.21.15.19:0/3180980239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff800004800 0x7ff800004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.680+0000 7ff81659c640 1 -- 172.21.15.19:0/3180980239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8000051c0 msgr2=0x7ff80000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.680+0000 7ff81659c640 1 --2- 172.21.15.19:0/3180980239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8000051c0 0x7ff80000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.680+0000 7ff81659c640 1 -- 172.21.15.19:0/3180980239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff800004800 msgr2=0x7ff800004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.680+0000 7ff81659c640 1 --2- 172.21.15.19:0/3180980239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff800004800 0x7ff800004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.680+0000 7ff81659c640 1 -- 172.21.15.19:0/3180980239 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff800003520 con 0x7ff8000039b0 2024-09-12T01:55:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.680+0000 7ff815d9b640 1 --2- 172.21.15.19:0/3180980239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff800004800 0x7ff800004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.681+0000 7ff81659c640 1 --2- 172.21.15.19:0/3180980239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8000039b0 0x7ff800003df0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff808009ac0 tx=0x7ff800005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2c76e1d7b0255b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.681+0000 7ff81559a640 1 -- 172.21.15.19:0/3180980239 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808036070 con 0x7ff8000039b0 2024-09-12T01:55:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.681+0000 7ff81559a640 1 -- 172.21.15.19:0/3180980239 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff808031400 con 0x7ff8000039b0 2024-09-12T01:55:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.681+0000 7ff81559a640 1 -- 172.21.15.19:0/3180980239 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808009690 con 0x7ff8000039b0 2024-09-12T01:55:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.681+0000 7ff81cce6640 1 -- 172.21.15.19:0/3180980239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8000039b0 msgr2=0x7ff800003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.681+0000 7ff81cce6640 1 --2- 172.21.15.19:0/3180980239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8000039b0 0x7ff800003df0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff808009ac0 tx=0x7ff800005830 comp rx=0 tx=0).stop 2024-09-12T01:55:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.681+0000 7ff816d9d640 1 -- 172.21.15.19:0/3180980239 reap_dead start 2024-09-12T01:55:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.682+0000 7ff81cce6640 1 -- 172.21.15.19:0/3180980239 shutdown_connections 2024-09-12T01:55:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.682+0000 7ff81cce6640 1 -- 172.21.15.19:0/3180980239 >> 172.21.15.19:0/3180980239 conn(0x7ff81808bfc0 msgr2=0x7ff8180d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.682+0000 7ff81cce6640 1 -- 172.21.15.19:0/3180980239 shutdown_connections 2024-09-12T01:55:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.682+0000 7ff81cce6640 1 -- 172.21.15.19:0/3180980239 wait complete. 2024-09-12T01:55:52.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.683+0000 7ff81cce6640 1 Processor -- start 2024-09-12T01:55:52.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.683+0000 7ff81cce6640 1 -- start start 2024-09-12T01:55:52.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff81cce6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8000039b0 0x7ff8181535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff81cce6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8180b9c00 0x7ff81815f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff81cce6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff81815f5a0 0x7ff81815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff81cce6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff8180cf0f0 con 0x7ff8000039b0 2024-09-12T01:55:52.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff81cce6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff8180d3a70 con 0x7ff8180b9c00 2024-09-12T01:55:52.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff81cce6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff81815eaa0 con 0x7ff81815f5a0 2024-09-12T01:55:52.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff81659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8000039b0 0x7ff8181535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff81659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8000039b0 0x7ff8181535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52034/0 (socket says 172.21.15.19:52034) 2024-09-12T01:55:52.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff81659c640 1 -- 172.21.15.19:0/2927465847 learned_addr learned my addr 172.21.15.19:0/2927465847 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:52.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff816d9d640 1 --2- 172.21.15.19:0/2927465847 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff81815f5a0 0x7ff81815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff815d9b640 1 --2- 172.21.15.19:0/2927465847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8180b9c00 0x7ff81815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff81659c640 1 -- 172.21.15.19:0/2927465847 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff81815f5a0 msgr2=0x7ff81815bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff81659c640 1 --2- 172.21.15.19:0/2927465847 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff81815f5a0 0x7ff81815bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff81659c640 1 -- 172.21.15.19:0/2927465847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8180b9c00 msgr2=0x7ff81815f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff81659c640 1 --2- 172.21.15.19:0/2927465847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8180b9c00 0x7ff81815f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff81659c640 1 -- 172.21.15.19:0/2927465847 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8180cb980 con 0x7ff8000039b0 2024-09-12T01:55:52.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff815d9b640 1 --2- 172.21.15.19:0/2927465847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8180b9c00 0x7ff81815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:52.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff81659c640 1 --2- 172.21.15.19:0/2927465847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8000039b0 0x7ff8181535a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff808034040 tx=0x7ff808004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:52.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff806ffd640 1 -- 172.21.15.19:0/2927465847 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808040020 con 0x7ff8000039b0 2024-09-12T01:55:52.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff806ffd640 1 -- 172.21.15.19:0/2927465847 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff808003b60 con 0x7ff8000039b0 2024-09-12T01:55:52.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff81cce6640 1 -- 172.21.15.19:0/2927465847 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8180cbc60 con 0x7ff8000039b0 2024-09-12T01:55:52.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff806ffd640 1 -- 172.21.15.19:0/2927465847 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808036040 con 0x7ff8000039b0 2024-09-12T01:55:52.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.684+0000 7ff81cce6640 1 -- 172.21.15.19:0/2927465847 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8180cc220 con 0x7ff8000039b0 2024-09-12T01:55:52.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.685+0000 7ff81cce6640 1 -- 172.21.15.19:0/2927465847 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8180cebb0 con 0x7ff8000039b0 2024-09-12T01:55:52.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.686+0000 7ff806ffd640 1 -- 172.21.15.19:0/2927465847 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff808043020 con 0x7ff8000039b0 2024-09-12T01:55:52.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.686+0000 7ff806ffd640 1 --2- 172.21.15.19:0/2927465847 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff7f806be30 0x7ff7f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.687+0000 7ff806ffd640 1 -- 172.21.15.19:0/2927465847 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7ff8080aac30 con 0x7ff8000039b0 2024-09-12T01:55:52.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.687+0000 7ff815d9b640 1 --2- 172.21.15.19:0/2927465847 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff7f806be30 0x7ff7f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.687+0000 7ff815d9b640 1 --2- 172.21.15.19:0/2927465847 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff7f806be30 0x7ff7f806e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff8180b8c70 tx=0x7ff80c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:52.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.691+0000 7ff806ffd640 1 -- 172.21.15.19:0/2927465847 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff80804a070 con 0x7ff8000039b0 2024-09-12T01:55:52.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:52.869+0000 7ff81cce6640 1 -- 172.21.15.19:0/2927465847 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff81806d4c0 con 0x7ff8000039b0 2024-09-12T01:55:53.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.665+0000 7ff806ffd640 1 -- 172.21.15.19:0/2927465847 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7ff8080044e0 con 0x7ff8000039b0 2024-09-12T01:55:53.664 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-09-12T01:55:53.666 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:55:53.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.667+0000 7ff81cce6640 1 -- 172.21.15.19:0/2927465847 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff7f806be30 msgr2=0x7ff7f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:53.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.667+0000 7ff81cce6640 1 --2- 172.21.15.19:0/2927465847 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff7f806be30 0x7ff7f806e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff8180b8c70 tx=0x7ff80c008040 comp rx=0 tx=0).stop 2024-09-12T01:55:53.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.667+0000 7ff81cce6640 1 -- 172.21.15.19:0/2927465847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8000039b0 msgr2=0x7ff8181535a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:53.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.667+0000 7ff81cce6640 1 --2- 172.21.15.19:0/2927465847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8000039b0 0x7ff8181535a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff808034040 tx=0x7ff808004730 comp rx=0 tx=0).stop 2024-09-12T01:55:53.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.667+0000 7ff81cce6640 1 -- 172.21.15.19:0/2927465847 shutdown_connections 2024-09-12T01:55:53.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.667+0000 7ff81cce6640 1 --2- 172.21.15.19:0/2927465847 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff7f806be30 0x7ff7f806e2f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.667+0000 7ff81cce6640 1 --2- 172.21.15.19:0/2927465847 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff81815f5a0 0x7ff81815bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.667+0000 7ff81cce6640 1 --2- 172.21.15.19:0/2927465847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8180b9c00 0x7ff81815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.668+0000 7ff81cce6640 1 --2- 172.21.15.19:0/2927465847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8000039b0 0x7ff8181535a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.668+0000 7ff81cce6640 1 -- 172.21.15.19:0/2927465847 >> 172.21.15.19:0/2927465847 conn(0x7ff81808bfc0 msgr2=0x7ff8180b1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.668+0000 7ff81cce6640 1 -- 172.21.15.19:0/2927465847 shutdown_connections 2024-09-12T01:55:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.668+0000 7ff81cce6640 1 -- 172.21.15.19:0/2927465847 wait complete. 2024-09-12T01:55:53.668 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:55:53.686 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-12T01:55:53.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.882+0000 7f41a82b7640 1 Processor -- start 2024-09-12T01:55:53.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.882+0000 7f41a82b7640 1 -- start start 2024-09-12T01:55:53.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.883+0000 7f41a82b7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f41a015e6c0 0x7f41a00cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:53.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.883+0000 7f41a82b7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f41a00cfcb0 0x7f41a00b1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:53.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.883+0000 7f41a82b7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a00d34f0 con 0x7f41a00d5090 2024-09-12T01:55:53.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.883+0000 7f41a82b7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f41a00cf400 con 0x7f41a00cfcb0 2024-09-12T01:55:53.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.883+0000 7f41a82b7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f41a00b10d0 con 0x7f41a015e6c0 2024-09-12T01:55:53.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.883+0000 7f41a6854640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f41a00cfcb0 0x7f41a00b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:53.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.883+0000 7f41a6854640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f41a00cfcb0 0x7f41a00b1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52038/0 (socket says 172.21.15.19:52038) 2024-09-12T01:55:53.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.883+0000 7f41a6854640 1 -- 172.21.15.19:0/543295015 learned_addr learned my addr 172.21.15.19:0/543295015 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:53.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.883+0000 7f41a5852640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f41a00d5090 0x7f41a00cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48724/0 (socket says 172.21.15.19:48724) 2024-09-12T01:55:53.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.883+0000 7f41a6854640 1 -- 172.21.15.19:0/543295015 >> v2:172.21.15.135:3300/0 conn(0x7f41a015e6c0 msgr2=0x7f41a00cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:53.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.883+0000 7f41a6053640 1 --2- 172.21.15.19:0/543295015 >> v2:172.21.15.135:3300/0 conn(0x7f41a015e6c0 0x7f41a00cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:53.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.883+0000 7f41a6854640 1 --2- 172.21.15.19:0/543295015 >> v2:172.21.15.135:3300/0 conn(0x7f41a015e6c0 0x7f41a00cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.883+0000 7f41a6854640 1 -- 172.21.15.19:0/543295015 >> v1:172.21.15.19:6789/0 conn(0x7f41a00d5090 legacy=0x7f41a00cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:53.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.884+0000 7f41a6854640 1 -- 172.21.15.19:0/543295015 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a00d3790 con 0x7f41a00cfcb0 2024-09-12T01:55:53.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.883+0000 7f41a5051640 1 -- 172.21.15.19:0/543295015 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3138515125 0 0) 0x7f41a00d34f0 con 0x7f41a00d5090 2024-09-12T01:55:53.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.884+0000 7f41a6053640 1 --2- 172.21.15.19:0/543295015 >> v2:172.21.15.135:3300/0 conn(0x7f41a015e6c0 0x7f41a00cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:53.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.884+0000 7f41a6854640 1 --2- 172.21.15.19:0/543295015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41a00cfcb0 0x7f41a00b1540 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f41a006cac0 tx=0x7f419802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e2f148d715e561 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:53.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.884+0000 7f41a5051640 1 -- 172.21.15.19:0/543295015 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4198037070 con 0x7f41a00cfcb0 2024-09-12T01:55:53.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.884+0000 7f41a5051640 1 -- 172.21.15.19:0/543295015 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4198032440 con 0x7f41a00cfcb0 2024-09-12T01:55:53.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.884+0000 7f41a5051640 1 -- 172.21.15.19:0/543295015 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4198032810 con 0x7f41a00cfcb0 2024-09-12T01:55:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.885+0000 7f41a82b7640 1 -- 172.21.15.19:0/543295015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41a00cfcb0 msgr2=0x7f41a00b1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.885+0000 7f41a82b7640 1 --2- 172.21.15.19:0/543295015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41a00cfcb0 0x7f41a00b1540 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f41a006cac0 tx=0x7f419802a1e0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.885+0000 7f41a82b7640 1 -- 172.21.15.19:0/543295015 shutdown_connections 2024-09-12T01:55:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.885+0000 7f41a82b7640 1 --2- 172.21.15.19:0/543295015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41a00cfcb0 0x7f41a00b1540 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.885+0000 7f41a82b7640 1 --2- 172.21.15.19:0/543295015 >> v2:172.21.15.135:3300/0 conn(0x7f41a015e6c0 0x7f41a00cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.885+0000 7f41a82b7640 1 -- 172.21.15.19:0/543295015 >> 172.21.15.19:0/543295015 conn(0x7f41a008bfc0 msgr2=0x7f41a00d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.885+0000 7f41a82b7640 1 -- 172.21.15.19:0/543295015 shutdown_connections 2024-09-12T01:55:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.885+0000 7f41a82b7640 1 -- 172.21.15.19:0/543295015 wait complete. 2024-09-12T01:55:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.886+0000 7f41a82b7640 1 Processor -- start 2024-09-12T01:55:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.886+0000 7f41a82b7640 1 -- start start 2024-09-12T01:55:53.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.887+0000 7f41a82b7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00cfcb0 0x7f41a014a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:53.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.887+0000 7f41a82b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41a00d5090 0x7f41a014d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:53.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.887+0000 7f41a82b7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a015e6c0 0x7f41a00b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:53.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.887+0000 7f41a82b7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f41a015eaa0 con 0x7f41a00d5090 2024-09-12T01:55:53.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.887+0000 7f41a82b7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f41a00cf0f0 con 0x7f41a00cfcb0 2024-09-12T01:55:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.887+0000 7f41a82b7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f41a015ec20 con 0x7f41a015e6c0 2024-09-12T01:55:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.887+0000 7f41a5852640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41a00d5090 0x7f41a014d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.887+0000 7f41a5852640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41a00d5090 0x7f41a014d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52040/0 (socket says 172.21.15.19:52040) 2024-09-12T01:55:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.887+0000 7f41a5852640 1 -- 172.21.15.19:0/2791679768 learned_addr learned my addr 172.21.15.19:0/2791679768 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.887+0000 7f41a6053640 1 --2- 172.21.15.19:0/2791679768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00cfcb0 0x7f41a014a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.887+0000 7f41a6854640 1 --2- 172.21.15.19:0/2791679768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a015e6c0 0x7f41a00b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.887+0000 7f41a5852640 1 -- 172.21.15.19:0/2791679768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a015e6c0 msgr2=0x7f41a00b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.887+0000 7f41a5852640 1 --2- 172.21.15.19:0/2791679768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a015e6c0 0x7f41a00b83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.887+0000 7f41a5852640 1 -- 172.21.15.19:0/2791679768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00cfcb0 msgr2=0x7f41a014a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.887+0000 7f41a5852640 1 --2- 172.21.15.19:0/2791679768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00cfcb0 0x7f41a014a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.887+0000 7f41a5852640 1 -- 172.21.15.19:0/2791679768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a00b8920 con 0x7f41a00d5090 2024-09-12T01:55:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.887+0000 7f41a6854640 1 --2- 172.21.15.19:0/2791679768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a015e6c0 0x7f41a00b83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.888+0000 7f41a5852640 1 --2- 172.21.15.19:0/2791679768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41a00d5090 0x7f41a014d060 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f419400c440 tx=0x7f419400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:53.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.888+0000 7f419effd640 1 -- 172.21.15.19:0/2791679768 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4194018070 con 0x7f41a00d5090 2024-09-12T01:55:53.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.888+0000 7f419effd640 1 -- 172.21.15.19:0/2791679768 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41940074a0 con 0x7f41a00d5090 2024-09-12T01:55:53.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.888+0000 7f41a82b7640 1 -- 172.21.15.19:0/2791679768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a00b8bc0 con 0x7f41a00d5090 2024-09-12T01:55:53.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.888+0000 7f419effd640 1 -- 172.21.15.19:0/2791679768 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4194004a20 con 0x7f41a00d5090 2024-09-12T01:55:53.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.888+0000 7f41a82b7640 1 -- 172.21.15.19:0/2791679768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a00b9180 con 0x7f41a00d5090 2024-09-12T01:55:53.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.889+0000 7f41a82b7640 1 -- 172.21.15.19:0/2791679768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a00cebb0 con 0x7f41a00d5090 2024-09-12T01:55:53.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.890+0000 7f419effd640 1 -- 172.21.15.19:0/2791679768 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f419401b070 con 0x7f41a00d5090 2024-09-12T01:55:53.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.890+0000 7f419effd640 1 --2- 172.21.15.19:0/2791679768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f418c06be30 0x7f418c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:53.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.890+0000 7f419effd640 1 -- 172.21.15.19:0/2791679768 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f419408a090 con 0x7f41a00d5090 2024-09-12T01:55:53.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.890+0000 7f41a6053640 1 --2- 172.21.15.19:0/2791679768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f418c06be30 0x7f418c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:53.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.891+0000 7f41a6053640 1 --2- 172.21.15.19:0/2791679768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f418c06be30 0x7f418c06e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f419000f500 tx=0x7f4190007770 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:53.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:53.894+0000 7f419effd640 1 -- 172.21.15.19:0/2791679768 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4194007650 con 0x7f41a00d5090 2024-09-12T01:55:54.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.069+0000 7f41a82b7640 1 -- 172.21.15.19:0/2791679768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f41a00b6d30 con 0x7f41a00d5090 2024-09-12T01:55:54.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.670+0000 7f419effd640 1 -- 172.21.15.19:0/2791679768 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7f41940586b0 con 0x7f41a00d5090 2024-09-12T01:55:54.669 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-09-12T01:55:54.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.673+0000 7f41a82b7640 1 -- 172.21.15.19:0/2791679768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f418c06be30 msgr2=0x7f418c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:54.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.673+0000 7f41a82b7640 1 --2- 172.21.15.19:0/2791679768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f418c06be30 0x7f418c06e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f419000f500 tx=0x7f4190007770 comp rx=0 tx=0).stop 2024-09-12T01:55:54.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.674+0000 7f41a82b7640 1 -- 172.21.15.19:0/2791679768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41a00d5090 msgr2=0x7f41a014d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:54.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.674+0000 7f41a82b7640 1 --2- 172.21.15.19:0/2791679768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41a00d5090 0x7f41a014d060 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f419400c440 tx=0x7f419400c900 comp rx=0 tx=0).stop 2024-09-12T01:55:54.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.674+0000 7f41a82b7640 1 -- 172.21.15.19:0/2791679768 shutdown_connections 2024-09-12T01:55:54.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.674+0000 7f41a82b7640 1 --2- 172.21.15.19:0/2791679768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f418c06be30 0x7f418c06e2f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.674+0000 7f41a82b7640 1 --2- 172.21.15.19:0/2791679768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a015e6c0 0x7f41a00b83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.674+0000 7f41a82b7640 1 --2- 172.21.15.19:0/2791679768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41a00d5090 0x7f41a014d060 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.674+0000 7f41a82b7640 1 --2- 172.21.15.19:0/2791679768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00cfcb0 0x7f41a014a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.674+0000 7f41a82b7640 1 -- 172.21.15.19:0/2791679768 >> 172.21.15.19:0/2791679768 conn(0x7f41a008bfc0 msgr2=0x7f41a00b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:54.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.674+0000 7f41a82b7640 1 -- 172.21.15.19:0/2791679768 shutdown_connections 2024-09-12T01:55:54.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.674+0000 7f41a82b7640 1 -- 172.21.15.19:0/2791679768 wait complete. 2024-09-12T01:55:54.701 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:55:54.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.812+0000 7f6efe7b7640 1 Processor -- start 2024-09-12T01:55:54.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.812+0000 7f6efe7b7640 1 -- start start 2024-09-12T01:55:54.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.813+0000 7f6efe7b7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6ef8162340 0x7f6ef806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:54.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.813+0000 7f6efe7b7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ef80cf280 0x7f6ef8162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:54.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.813+0000 7f6efe7b7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ef815ff70 con 0x7f6ef8162c60 2024-09-12T01:55:54.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.813+0000 7f6efe7b7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6ef806de90 con 0x7f6ef8162340 2024-09-12T01:55:54.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.813+0000 7f6efe7b7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef80d4d10 con 0x7f6ef80cf280 2024-09-12T01:55:54.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.813+0000 7f6ef7fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6ef8162340 0x7f6ef806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:54.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.813+0000 7f6ef77fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ef80cf280 0x7f6ef8162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:54.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.813+0000 7f6ef7fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6ef8162340 0x7f6ef806d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60896/0 (socket says 172.21.15.19:60896) 2024-09-12T01:55:54.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.813+0000 7f6ef7fff640 1 -- 172.21.15.19:0/416436578 learned_addr learned my addr 172.21.15.19:0/416436578 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:54.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.814+0000 7f6ef77fe640 1 -- 172.21.15.19:0/416436578 >> v2:172.21.15.135:3300/0 conn(0x7f6ef8162340 msgr2=0x7f6ef806d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:54.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.814+0000 7f6ef77fe640 1 --2- 172.21.15.19:0/416436578 >> v2:172.21.15.135:3300/0 conn(0x7f6ef8162340 0x7f6ef806d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.814+0000 7f6ef77fe640 1 -- 172.21.15.19:0/416436578 >> v1:172.21.15.135:6789/0 conn(0x7f6ef8162c60 legacy=0x7f6ef80d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:54.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.814+0000 7f6ef77fe640 1 -- 172.21.15.19:0/416436578 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef80d4ff0 con 0x7f6ef80cf280 2024-09-12T01:55:54.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.814+0000 7f6ef7fff640 1 --2- 172.21.15.19:0/416436578 >> v2:172.21.15.135:3300/0 conn(0x7f6ef8162340 0x7f6ef806d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:54.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.814+0000 7f6ef77fe640 1 --2- 172.21.15.19:0/416436578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ef80cf280 0x7f6ef8162720 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009790 tx=0x7f6eec02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1009a071901717c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:54.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.815+0000 7f6ef6ffd640 1 -- 172.21.15.19:0/416436578 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec037070 con 0x7f6ef80cf280 2024-09-12T01:55:54.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.815+0000 7f6ef6ffd640 1 -- 172.21.15.19:0/416436578 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eec02ae50 con 0x7f6ef80cf280 2024-09-12T01:55:54.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.815+0000 7f6ef6ffd640 1 -- 172.21.15.19:0/416436578 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec032660 con 0x7f6ef80cf280 2024-09-12T01:55:54.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.815+0000 7f6efe7b7640 1 -- 172.21.15.19:0/416436578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ef80cf280 msgr2=0x7f6ef8162720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:54.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.815+0000 7f6efe7b7640 1 --2- 172.21.15.19:0/416436578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ef80cf280 0x7f6ef8162720 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009790 tx=0x7f6eec02a100 comp rx=0 tx=0).stop 2024-09-12T01:55:54.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.815+0000 7f6efe7b7640 1 -- 172.21.15.19:0/416436578 shutdown_connections 2024-09-12T01:55:54.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.815+0000 7f6efe7b7640 1 --2- 172.21.15.19:0/416436578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ef80cf280 0x7f6ef8162720 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.815+0000 7f6efe7b7640 1 --2- 172.21.15.19:0/416436578 >> v2:172.21.15.135:3300/0 conn(0x7f6ef8162340 0x7f6ef806d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.815+0000 7f6efe7b7640 1 -- 172.21.15.19:0/416436578 >> 172.21.15.19:0/416436578 conn(0x7f6ef808bfc0 msgr2=0x7f6ef80d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:54.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.815+0000 7f6efe7b7640 1 -- 172.21.15.19:0/416436578 shutdown_connections 2024-09-12T01:55:54.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.815+0000 7f6efe7b7640 1 -- 172.21.15.19:0/416436578 wait complete. 2024-09-12T01:55:54.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.817+0000 7f6efe7b7640 1 Processor -- start 2024-09-12T01:55:54.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.817+0000 7f6efe7b7640 1 -- start start 2024-09-12T01:55:54.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.817+0000 7f6efe7b7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef80cf280 0x7f6ef80c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:54.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.817+0000 7f6efe7b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ef8162340 0x7f6ef80c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:54.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6efe7b7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ef8162c60 0x7f6ef80ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:54.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6efe7b7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef80cf6c0 con 0x7f6ef8162340 2024-09-12T01:55:54.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6efe7b7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef80d52d0 con 0x7f6ef80cf280 2024-09-12T01:55:54.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6efe7b7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef81630f0 con 0x7f6ef8162c60 2024-09-12T01:55:54.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6ef77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ef8162340 0x7f6ef80c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:54.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6ef77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ef8162340 0x7f6ef80c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52044/0 (socket says 172.21.15.19:52044) 2024-09-12T01:55:54.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6ef77fe640 1 -- 172.21.15.19:0/2442620629 learned_addr learned my addr 172.21.15.19:0/2442620629 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:54.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6ef7fff640 1 --2- 172.21.15.19:0/2442620629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef80cf280 0x7f6ef80c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6efcd54640 1 --2- 172.21.15.19:0/2442620629 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ef8162c60 0x7f6ef80ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6ef77fe640 1 -- 172.21.15.19:0/2442620629 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ef8162c60 msgr2=0x7f6ef80ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6ef77fe640 1 --2- 172.21.15.19:0/2442620629 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ef8162c60 0x7f6ef80ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6ef77fe640 1 -- 172.21.15.19:0/2442620629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef80cf280 msgr2=0x7f6ef80c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6ef77fe640 1 --2- 172.21.15.19:0/2442620629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef80cf280 0x7f6ef80c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6ef77fe640 1 -- 172.21.15.19:0/2442620629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef80b83f0 con 0x7f6ef8162340 2024-09-12T01:55:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6ef77fe640 1 --2- 172.21.15.19:0/2442620629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ef8162340 0x7f6ef80c8540 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6eec035040 tx=0x7f6eec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6ef4ff9640 1 -- 172.21.15.19:0/2442620629 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec042020 con 0x7f6ef8162340 2024-09-12T01:55:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6ef4ff9640 1 -- 172.21.15.19:0/2442620629 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eec005990 con 0x7f6ef8162340 2024-09-12T01:55:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6efe7b7640 1 -- 172.21.15.19:0/2442620629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef80caef0 con 0x7f6ef8162340 2024-09-12T01:55:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.818+0000 7f6ef4ff9640 1 -- 172.21.15.19:0/2442620629 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec037040 con 0x7f6ef8162340 2024-09-12T01:55:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.819+0000 7f6efe7b7640 1 -- 172.21.15.19:0/2442620629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef80b8940 con 0x7f6ef8162340 2024-09-12T01:55:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.820+0000 7f6efe7b7640 1 -- 172.21.15.19:0/2442620629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef8162720 con 0x7f6ef8162340 2024-09-12T01:55:54.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.820+0000 7f6ef4ff9640 1 -- 172.21.15.19:0/2442620629 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6eec045020 con 0x7f6ef8162340 2024-09-12T01:55:54.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.821+0000 7f6ef4ff9640 1 --2- 172.21.15.19:0/2442620629 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6ee406be30 0x7f6ee406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:54.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.821+0000 7f6ef4ff9640 1 -- 172.21.15.19:0/2442620629 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f6eec0ab2c0 con 0x7f6ef8162340 2024-09-12T01:55:54.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.821+0000 7f6ef7fff640 1 --2- 172.21.15.19:0/2442620629 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6ee406be30 0x7f6ee406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:54.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.821+0000 7f6ef7fff640 1 --2- 172.21.15.19:0/2442620629 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6ee406be30 0x7f6ee406e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8006ca0 tx=0x7f6ee8009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:54.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:54.825+0000 7f6ef4ff9640 1 -- 172.21.15.19:0/2442620629 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6eec04c030 con 0x7f6ef8162340 2024-09-12T01:55:55.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.035+0000 7f6efe7b7640 1 -- 172.21.15.19:0/2442620629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6ef80b4aa0 con 0x7f6ef8162340 2024-09-12T01:55:55.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.672+0000 7f6ef4ff9640 1 -- 172.21.15.19:0/2442620629 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f6eec079700 con 0x7f6ef8162340 2024-09-12T01:55:55.671 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T01:55:55.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.676+0000 7f6efe7b7640 1 -- 172.21.15.19:0/2442620629 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6ee406be30 msgr2=0x7f6ee406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:55.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.676+0000 7f6efe7b7640 1 --2- 172.21.15.19:0/2442620629 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6ee406be30 0x7f6ee406e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8006ca0 tx=0x7f6ee8009240 comp rx=0 tx=0).stop 2024-09-12T01:55:55.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.676+0000 7f6efe7b7640 1 -- 172.21.15.19:0/2442620629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ef8162340 msgr2=0x7f6ef80c8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:55.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.677+0000 7f6efe7b7640 1 --2- 172.21.15.19:0/2442620629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ef8162340 0x7f6ef80c8540 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6eec035040 tx=0x7f6eec0046c0 comp rx=0 tx=0).stop 2024-09-12T01:55:55.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.677+0000 7f6efe7b7640 1 -- 172.21.15.19:0/2442620629 shutdown_connections 2024-09-12T01:55:55.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.677+0000 7f6efe7b7640 1 --2- 172.21.15.19:0/2442620629 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6ee406be30 0x7f6ee406e2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:55.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.677+0000 7f6efe7b7640 1 --2- 172.21.15.19:0/2442620629 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ef8162c60 0x7f6ef80ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:55.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.677+0000 7f6efe7b7640 1 --2- 172.21.15.19:0/2442620629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ef8162340 0x7f6ef80c8540 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:55.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.677+0000 7f6efe7b7640 1 --2- 172.21.15.19:0/2442620629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef80cf280 0x7f6ef80c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:55.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.677+0000 7f6efe7b7640 1 -- 172.21.15.19:0/2442620629 >> 172.21.15.19:0/2442620629 conn(0x7f6ef808bfc0 msgr2=0x7f6ef80b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:55.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.678+0000 7f6efe7b7640 1 -- 172.21.15.19:0/2442620629 shutdown_connections 2024-09-12T01:55:55.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.678+0000 7f6efe7b7640 1 -- 172.21.15.19:0/2442620629 wait complete. 2024-09-12T01:55:55.706 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-12T01:55:55.706 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-12T01:55:55.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.819+0000 7fb9ef25c640 1 Processor -- start 2024-09-12T01:55:55.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.820+0000 7fb9ef25c640 1 -- start start 2024-09-12T01:55:55.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.820+0000 7fb9ef25c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb9e8162980 0x7fb9e80ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:55.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.820+0000 7fb9ef25c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9e80d2600 con 0x7fb9e80b5f80 2024-09-12T01:55:55.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.820+0000 7fb9ef25c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9e80b3c10 con 0x7fb9e80d4c10 2024-09-12T01:55:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.820+0000 7fb9ef25c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb9e80d5420 con 0x7fb9e8162980 2024-09-12T01:55:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.820+0000 7fb9ed7f9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb9e8162980 0x7fb9e80ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.820+0000 7fb9ecff8640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb9e80b5f80 0x7fb9e80b6360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48734/0 (socket says 172.21.15.19:48734) 2024-09-12T01:55:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.821+0000 7fb9ecff8640 1 -- 172.21.15.19:0/1547902991 learned_addr learned my addr 172.21.15.19:0/1547902991 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:55:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.821+0000 7fb9ed7f9640 1 -- 172.21.15.19:0/1547902991 >> v1:172.21.15.135:6789/0 conn(0x7fb9e80d4c10 legacy=0x7fb9e80d3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.821+0000 7fb9ed7f9640 1 -- 172.21.15.19:0/1547902991 >> v1:172.21.15.19:6789/0 conn(0x7fb9e80b5f80 legacy=0x7fb9e80b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.821+0000 7fb9ed7f9640 1 -- 172.21.15.19:0/1547902991 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e80d2880 con 0x7fb9e8162980 2024-09-12T01:55:55.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.821+0000 7fb9e77fe640 1 -- 172.21.15.19:0/1547902991 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1694790501 0 0) 0x7fb9d8001110 con 0x7fb9e80b5f80 2024-09-12T01:55:55.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.821+0000 7fb9ed7f9640 1 --2- 172.21.15.19:0/1547902991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9e8162980 0x7fb9e80ceb50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009dc0 tx=0x7fb9e002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997b86019349e9e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:55.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.822+0000 7fb9e77fe640 1 -- 172.21.15.19:0/1547902991 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0007740 con 0x7fb9e8162980 2024-09-12T01:55:55.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.822+0000 7fb9e77fe640 1 -- 172.21.15.19:0/1547902991 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e00078e0 con 0x7fb9e8162980 2024-09-12T01:55:55.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.822+0000 7fb9e77fe640 1 -- 172.21.15.19:0/1547902991 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0007cb0 con 0x7fb9e8162980 2024-09-12T01:55:55.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.822+0000 7fb9ef25c640 1 -- 172.21.15.19:0/1547902991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9e8162980 msgr2=0x7fb9e80ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:55.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.822+0000 7fb9ef25c640 1 --2- 172.21.15.19:0/1547902991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9e8162980 0x7fb9e80ceb50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009dc0 tx=0x7fb9e002a730 comp rx=0 tx=0).stop 2024-09-12T01:55:55.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.822+0000 7fb9ef25c640 1 -- 172.21.15.19:0/1547902991 shutdown_connections 2024-09-12T01:55:55.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.822+0000 7fb9ef25c640 1 --2- 172.21.15.19:0/1547902991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9e8162980 0x7fb9e80ceb50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:55.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.822+0000 7fb9ef25c640 1 -- 172.21.15.19:0/1547902991 >> 172.21.15.19:0/1547902991 conn(0x7fb9e808bfc0 msgr2=0x7fb9e80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:55.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.822+0000 7fb9ef25c640 1 -- 172.21.15.19:0/1547902991 shutdown_connections 2024-09-12T01:55:55.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.822+0000 7fb9ef25c640 1 -- 172.21.15.19:0/1547902991 wait complete. 2024-09-12T01:55:55.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.823+0000 7fb9ef25c640 1 Processor -- start 2024-09-12T01:55:55.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.824+0000 7fb9ef25c640 1 -- start start 2024-09-12T01:55:55.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.824+0000 7fb9ef25c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9e80b5f80 0x7fb9e81f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:55.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.824+0000 7fb9ef25c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9e80d4c10 0x7fb9e81f7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:55.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.824+0000 7fb9ef25c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9e8162980 0x7fb9e81f7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:55.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.824+0000 7fb9ef25c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e80d5140 con 0x7fb9e80d4c10 2024-09-12T01:55:55.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.824+0000 7fb9ef25c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e80d2e90 con 0x7fb9e8162980 2024-09-12T01:55:55.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.824+0000 7fb9ef25c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e80d2b20 con 0x7fb9e80b5f80 2024-09-12T01:55:55.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.825+0000 7fb9e7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9e80d4c10 0x7fb9e81f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:55.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.825+0000 7fb9e7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9e80d4c10 0x7fb9e81f7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52064/0 (socket says 172.21.15.19:52064) 2024-09-12T01:55:55.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.825+0000 7fb9e7fff640 1 -- 172.21.15.19:0/2172070270 learned_addr learned my addr 172.21.15.19:0/2172070270 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:55.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.825+0000 7fb9ed7f9640 1 --2- 172.21.15.19:0/2172070270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9e8162980 0x7fb9e81f7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:55.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.825+0000 7fb9ecff8640 1 --2- 172.21.15.19:0/2172070270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9e80b5f80 0x7fb9e81f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:55.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.825+0000 7fb9e7fff640 1 -- 172.21.15.19:0/2172070270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9e80b5f80 msgr2=0x7fb9e81f80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:55.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.825+0000 7fb9e7fff640 1 --2- 172.21.15.19:0/2172070270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9e80b5f80 0x7fb9e81f80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:55.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.825+0000 7fb9e7fff640 1 -- 172.21.15.19:0/2172070270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9e8162980 msgr2=0x7fb9e81f7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:55.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.825+0000 7fb9e7fff640 1 --2- 172.21.15.19:0/2172070270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9e8162980 0x7fb9e81f7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:55.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.825+0000 7fb9e7fff640 1 -- 172.21.15.19:0/2172070270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e815b870 con 0x7fb9e80d4c10 2024-09-12T01:55:55.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.825+0000 7fb9e7fff640 1 --2- 172.21.15.19:0/2172070270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9e80d4c10 0x7fb9e81f7240 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00c450 tx=0x7fb9dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:55.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.825+0000 7fb9e57fa640 1 -- 172.21.15.19:0/2172070270 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0052d0 con 0x7fb9e80d4c10 2024-09-12T01:55:55.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.825+0000 7fb9e57fa640 1 -- 172.21.15.19:0/2172070270 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9dc005470 con 0x7fb9e80d4c10 2024-09-12T01:55:55.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.825+0000 7fb9e57fa640 1 -- 172.21.15.19:0/2172070270 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc012870 con 0x7fb9e80d4c10 2024-09-12T01:55:55.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.825+0000 7fb9ef25c640 1 -- 172.21.15.19:0/2172070270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e815bb50 con 0x7fb9e80d4c10 2024-09-12T01:55:55.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.825+0000 7fb9ef25c640 1 -- 172.21.15.19:0/2172070270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e815c110 con 0x7fb9e80d4c10 2024-09-12T01:55:55.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.826+0000 7fb9ef25c640 1 -- 172.21.15.19:0/2172070270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e80b6360 con 0x7fb9e80d4c10 2024-09-12T01:55:55.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.827+0000 7fb9e57fa640 1 -- 172.21.15.19:0/2172070270 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb9dc012a10 con 0x7fb9e80d4c10 2024-09-12T01:55:55.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.827+0000 7fb9e57fa640 1 --2- 172.21.15.19:0/2172070270 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb9d406be30 0x7fb9d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:55.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.827+0000 7fb9e57fa640 1 -- 172.21.15.19:0/2172070270 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb9dc08a880 con 0x7fb9e80d4c10 2024-09-12T01:55:55.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.827+0000 7fb9ecff8640 1 --2- 172.21.15.19:0/2172070270 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb9d406be30 0x7fb9d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:55.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.828+0000 7fb9ecff8640 1 --2- 172.21.15.19:0/2172070270 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb9d406be30 0x7fb9d406e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8000f60 tx=0x7fb9d8007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:55.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:55.831+0000 7fb9e57fa640 1 -- 172.21.15.19:0/2172070270 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb9e80b3c10 con 0x7fb9e80d4c10 2024-09-12T01:55:56.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.014+0000 7fb9ef25c640 1 -- 172.21.15.19:0/2172070270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fb9e815fe30 con 0x7fb9e80d4c10 2024-09-12T01:55:56.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.673+0000 7fb9e57fa640 1 -- 172.21.15.19:0/2172070270 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) ==== 157+0+0 (secure 0 0 0) 0x7fb9dc058c70 con 0x7fb9e80d4c10 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.677+0000 7fb9ef25c640 1 -- 172.21.15.19:0/2172070270 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb9d406be30 msgr2=0x7fb9d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.677+0000 7fb9ef25c640 1 --2- 172.21.15.19:0/2172070270 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb9d406be30 0x7fb9d406e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8000f60 tx=0x7fb9d8007e40 comp rx=0 tx=0).stop 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.677+0000 7fb9ef25c640 1 -- 172.21.15.19:0/2172070270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9e80d4c10 msgr2=0x7fb9e81f7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.677+0000 7fb9ef25c640 1 --2- 172.21.15.19:0/2172070270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9e80d4c10 0x7fb9e81f7240 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00c450 tx=0x7fb9dc00c910 comp rx=0 tx=0).stop 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.677+0000 7fb9ef25c640 1 -- 172.21.15.19:0/2172070270 shutdown_connections 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.677+0000 7fb9ef25c640 1 --2- 172.21.15.19:0/2172070270 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb9d406be30 0x7fb9d406e2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.677+0000 7fb9ef25c640 1 --2- 172.21.15.19:0/2172070270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9e8162980 0x7fb9e81f7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.677+0000 7fb9ef25c640 1 --2- 172.21.15.19:0/2172070270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9e80d4c10 0x7fb9e81f7240 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.677+0000 7fb9ef25c640 1 --2- 172.21.15.19:0/2172070270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9e80b5f80 0x7fb9e81f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.677+0000 7fb9ef25c640 1 -- 172.21.15.19:0/2172070270 >> 172.21.15.19:0/2172070270 conn(0x7fb9e808bfc0 msgr2=0x7fb9e80d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.677+0000 7fb9ef25c640 1 -- 172.21.15.19:0/2172070270 shutdown_connections 2024-09-12T01:55:56.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.677+0000 7fb9ef25c640 1 -- 172.21.15.19:0/2172070270 wait complete. 2024-09-12T01:55:56.690 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:55:56.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.808+0000 7f17e607b640 1 Processor -- start 2024-09-12T01:55:56.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.808+0000 7f17e607b640 1 -- start start 2024-09-12T01:55:56.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.809+0000 7f17e607b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17e0162340 0x7f17e006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:56.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.809+0000 7f17e607b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f17e00cf280 0x7f17e0162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:56.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.809+0000 7f17e607b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17e0162c60 0x7f17e00d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:56.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.809+0000 7f17e607b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f17e006de90 con 0x7f17e0162c60 2024-09-12T01:55:56.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.809+0000 7f17e607b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f17e015ff70 con 0x7f17e00cf280 2024-09-12T01:55:56.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.809+0000 7f17e607b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f17e00d4d10 con 0x7f17e0162340 2024-09-12T01:55:56.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.809+0000 7f17dffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17e0162c60 0x7f17e00d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:56.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.809+0000 7f17dffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17e0162c60 0x7f17e00d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52072/0 (socket says 172.21.15.19:52072) 2024-09-12T01:55:56.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.809+0000 7f17dffff640 1 -- 172.21.15.19:0/2058491041 learned_addr learned my addr 172.21.15.19:0/2058491041 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:56.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.809+0000 7f17deffd640 1 --2- 172.21.15.19:0/2058491041 >> v2:172.21.15.135:3300/0 conn(0x7f17e00cf280 0x7f17e0162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:56.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.809+0000 7f17df7fe640 1 --2- 172.21.15.19:0/2058491041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17e0162340 0x7f17e006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:56.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.809+0000 7f17dffff640 1 -- 172.21.15.19:0/2058491041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17e0162340 msgr2=0x7f17e006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:56.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.809+0000 7f17dffff640 1 --2- 172.21.15.19:0/2058491041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17e0162340 0x7f17e006d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:56.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.809+0000 7f17dffff640 1 -- 172.21.15.19:0/2058491041 >> v2:172.21.15.135:3300/0 conn(0x7f17e00cf280 msgr2=0x7f17e0162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:56.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.809+0000 7f17dffff640 1 --2- 172.21.15.19:0/2058491041 >> v2:172.21.15.135:3300/0 conn(0x7f17e00cf280 0x7f17e0162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:56.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.809+0000 7f17dffff640 1 -- 172.21.15.19:0/2058491041 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e00d4ff0 con 0x7f17e0162c60 2024-09-12T01:55:56.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.809+0000 7f17df7fe640 1 --2- 172.21.15.19:0/2058491041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17e0162340 0x7f17e006d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:56.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.810+0000 7f17dffff640 1 --2- 172.21.15.19:0/2058491041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17e0162c60 0x7f17e00d2990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f17e008d200 tx=0x7f17d802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c9b9fee6805a6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:56.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.810+0000 7f17de7fc640 1 -- 172.21.15.19:0/2058491041 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d8036070 con 0x7f17e0162c60 2024-09-12T01:55:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.810+0000 7f17de7fc640 1 -- 172.21.15.19:0/2058491041 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d8031600 con 0x7f17e0162c60 2024-09-12T01:55:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.810+0000 7f17de7fc640 1 -- 172.21.15.19:0/2058491041 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d80319d0 con 0x7f17e0162c60 2024-09-12T01:55:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.811+0000 7f17e607b640 1 -- 172.21.15.19:0/2058491041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17e0162c60 msgr2=0x7f17e00d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.811+0000 7f17e607b640 1 --2- 172.21.15.19:0/2058491041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17e0162c60 0x7f17e00d2990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f17e008d200 tx=0x7f17d802a610 comp rx=0 tx=0).stop 2024-09-12T01:55:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.811+0000 7f17e607b640 1 -- 172.21.15.19:0/2058491041 shutdown_connections 2024-09-12T01:55:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.811+0000 7f17e607b640 1 --2- 172.21.15.19:0/2058491041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17e0162c60 0x7f17e00d2990 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.811+0000 7f17e607b640 1 --2- 172.21.15.19:0/2058491041 >> v2:172.21.15.135:3300/0 conn(0x7f17e00cf280 0x7f17e0162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.811+0000 7f17e607b640 1 --2- 172.21.15.19:0/2058491041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17e0162340 0x7f17e006d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.811+0000 7f17e607b640 1 -- 172.21.15.19:0/2058491041 >> 172.21.15.19:0/2058491041 conn(0x7f17e008bfc0 msgr2=0x7f17e00d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.811+0000 7f17e607b640 1 -- 172.21.15.19:0/2058491041 shutdown_connections 2024-09-12T01:55:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.811+0000 7f17e607b640 1 -- 172.21.15.19:0/2058491041 wait complete. 2024-09-12T01:55:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.812+0000 7f17e607b640 1 Processor -- start 2024-09-12T01:55:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.812+0000 7f17e607b640 1 -- start start 2024-09-12T01:55:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.813+0000 7f17e607b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17e00cf280 0x7f17e00b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.813+0000 7f17e607b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17e0162340 0x7f17e014e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.813+0000 7f17e607b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17e0162c60 0x7f17e014ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.813+0000 7f17e607b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f17e00cf6c0 con 0x7f17e0162c60 2024-09-12T01:55:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.813+0000 7f17e607b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f17e00d52d0 con 0x7f17e0162340 2024-09-12T01:55:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.813+0000 7f17e607b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f17e0163110 con 0x7f17e00cf280 2024-09-12T01:55:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.813+0000 7f17dffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17e0162c60 0x7f17e014ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.813+0000 7f17dffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17e0162c60 0x7f17e014ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52076/0 (socket says 172.21.15.19:52076) 2024-09-12T01:55:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.813+0000 7f17dffff640 1 -- 172.21.15.19:0/2107018829 learned_addr learned my addr 172.21.15.19:0/2107018829 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.813+0000 7f17deffd640 1 --2- 172.21.15.19:0/2107018829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17e0162340 0x7f17e014e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.813+0000 7f17df7fe640 1 --2- 172.21.15.19:0/2107018829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17e00cf280 0x7f17e00b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.813+0000 7f17dffff640 1 -- 172.21.15.19:0/2107018829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17e00cf280 msgr2=0x7f17e00b7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.813+0000 7f17dffff640 1 --2- 172.21.15.19:0/2107018829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17e00cf280 0x7f17e00b7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.813+0000 7f17dffff640 1 -- 172.21.15.19:0/2107018829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17e0162340 msgr2=0x7f17e014e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.813+0000 7f17dffff640 1 --2- 172.21.15.19:0/2107018829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17e0162340 0x7f17e014e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.813+0000 7f17dffff640 1 -- 172.21.15.19:0/2107018829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e014b360 con 0x7f17e0162c60 2024-09-12T01:55:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.814+0000 7f17dffff640 1 --2- 172.21.15.19:0/2107018829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17e0162c60 0x7f17e014ae20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f17d802ac00 tx=0x7f17d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.814+0000 7f17c7fff640 1 -- 172.21.15.19:0/2107018829 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d8041070 con 0x7f17e0162c60 2024-09-12T01:55:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.814+0000 7f17c7fff640 1 -- 172.21.15.19:0/2107018829 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d803c650 con 0x7f17e0162c60 2024-09-12T01:55:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.814+0000 7f17c7fff640 1 -- 172.21.15.19:0/2107018829 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d8036040 con 0x7f17e0162c60 2024-09-12T01:55:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.814+0000 7f17e607b640 1 -- 172.21.15.19:0/2107018829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17e00b6bd0 con 0x7f17e0162c60 2024-09-12T01:55:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.814+0000 7f17e607b640 1 -- 172.21.15.19:0/2107018829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17e00b4340 con 0x7f17e0162c60 2024-09-12T01:55:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.815+0000 7f17e607b640 1 -- 172.21.15.19:0/2107018829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17e0162720 con 0x7f17e0162c60 2024-09-12T01:55:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.815+0000 7f17c7fff640 1 -- 172.21.15.19:0/2107018829 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f17d8044070 con 0x7f17e0162c60 2024-09-12T01:55:56.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.816+0000 7f17c7fff640 1 --2- 172.21.15.19:0/2107018829 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f17cc06be30 0x7f17cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:56.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.816+0000 7f17c7fff640 1 -- 172.21.15.19:0/2107018829 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6007+0+0 (secure 0 0 0) 0x7f17d80aba10 con 0x7f17e0162c60 2024-09-12T01:55:56.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.816+0000 7f17df7fe640 1 --2- 172.21.15.19:0/2107018829 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f17cc06be30 0x7f17cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:56.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.817+0000 7f17df7fe640 1 --2- 172.21.15.19:0/2107018829 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f17cc06be30 0x7f17cc06e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f17d000aac0 tx=0x7f17d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:56.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.821+0000 7f17c7fff640 1 -- 172.21.15.19:0/2107018829 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f17d8079c40 con 0x7f17e0162c60 2024-09-12T01:55:56.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:56.996+0000 7f17e607b640 1 -- 172.21.15.19:0/2107018829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f17e008e640 con 0x7f17e0162c60 2024-09-12T01:55:58.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.696+0000 7f17c7fff640 1 -- 172.21.15.19:0/2107018829 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) ==== 228+0+0 (secure 0 0 0) 0x7f17d807df40 con 0x7f17e0162c60 2024-09-12T01:55:58.696 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data_ec' created 2024-09-12T01:55:58.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.700+0000 7f17e607b640 1 -- 172.21.15.19:0/2107018829 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f17cc06be30 msgr2=0x7f17cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:58.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.700+0000 7f17e607b640 1 --2- 172.21.15.19:0/2107018829 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f17cc06be30 0x7f17cc06e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f17d000aac0 tx=0x7f17d0008040 comp rx=0 tx=0).stop 2024-09-12T01:55:58.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.700+0000 7f17e607b640 1 -- 172.21.15.19:0/2107018829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17e0162c60 msgr2=0x7f17e014ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:58.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.700+0000 7f17e607b640 1 --2- 172.21.15.19:0/2107018829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17e0162c60 0x7f17e014ae20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f17d802ac00 tx=0x7f17d8004a40 comp rx=0 tx=0).stop 2024-09-12T01:55:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.700+0000 7f17e607b640 1 -- 172.21.15.19:0/2107018829 shutdown_connections 2024-09-12T01:55:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.700+0000 7f17e607b640 1 --2- 172.21.15.19:0/2107018829 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f17cc06be30 0x7f17cc06e2f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.700+0000 7f17e607b640 1 --2- 172.21.15.19:0/2107018829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17e0162c60 0x7f17e014ae20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.700+0000 7f17e607b640 1 --2- 172.21.15.19:0/2107018829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17e0162340 0x7f17e014e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.700+0000 7f17e607b640 1 --2- 172.21.15.19:0/2107018829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17e00cf280 0x7f17e00b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.700+0000 7f17e607b640 1 -- 172.21.15.19:0/2107018829 >> 172.21.15.19:0/2107018829 conn(0x7f17e008bfc0 msgr2=0x7f17e00d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.701+0000 7f17e607b640 1 -- 172.21.15.19:0/2107018829 shutdown_connections 2024-09-12T01:55:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.701+0000 7f17e607b640 1 -- 172.21.15.19:0/2107018829 wait complete. 2024-09-12T01:55:58.718 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-12T01:55:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.831+0000 7fd91aac9640 1 Processor -- start 2024-09-12T01:55:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.832+0000 7fd91aac9640 1 -- start start 2024-09-12T01:55:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.832+0000 7fd91aac9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd9140cd510 0x7fd914167130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.832+0000 7fd91aac9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9140ce1a0 con 0x7fd9140b4a50 2024-09-12T01:55:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.832+0000 7fd91aac9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9140b3010 con 0x7fd9140b7c30 2024-09-12T01:55:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.832+0000 7fd91aac9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd9140b32f0 con 0x7fd9140cd510 2024-09-12T01:55:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.833+0000 7fd919066640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd9140cd510 0x7fd914167130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.833+0000 7fd919066640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd9140cd510 0x7fd914167130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52084/0 (socket says 172.21.15.19:52084) 2024-09-12T01:55:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.833+0000 7fd919066640 1 -- 172.21.15.19:0/4003995280 learned_addr learned my addr 172.21.15.19:0/4003995280 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.833+0000 7fd913fff640 1 --1- 172.21.15.19:0/4003995280 >> v1:172.21.15.19:6789/0 conn(0x7fd9140b4a50 0x7fd9140cce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48738/0 (socket says 172.21.15.19:48738) 2024-09-12T01:55:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.833+0000 7fd919066640 1 -- 172.21.15.19:0/4003995280 >> v1:172.21.15.135:6789/0 conn(0x7fd9140b7c30 legacy=0x7fd9140cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.833+0000 7fd919066640 1 -- 172.21.15.19:0/4003995280 >> v1:172.21.15.19:6789/0 conn(0x7fd9140b4a50 legacy=0x7fd9140cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.833+0000 7fd919066640 1 -- 172.21.15.19:0/4003995280 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9140b35d0 con 0x7fd9140cd510 2024-09-12T01:55:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.833+0000 7fd9137fe640 1 -- 172.21.15.19:0/4003995280 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2890341649 0 0) 0x7fd9140ce1a0 con 0x7fd9140b4a50 2024-09-12T01:55:58.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.834+0000 7fd919066640 1 --2- 172.21.15.19:0/4003995280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9140cd510 0x7fd914167130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd90c009e50 tx=0x7fd90c02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736d77a061dd748a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:58.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.834+0000 7fd9137fe640 1 -- 172.21.15.19:0/4003995280 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c036070 con 0x7fd9140cd510 2024-09-12T01:55:58.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.834+0000 7fd9137fe640 1 -- 172.21.15.19:0/4003995280 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90c031600 con 0x7fd9140cd510 2024-09-12T01:55:58.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.834+0000 7fd9137fe640 1 -- 172.21.15.19:0/4003995280 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0319d0 con 0x7fd9140cd510 2024-09-12T01:55:58.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.834+0000 7fd91aac9640 1 -- 172.21.15.19:0/4003995280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9140cd510 msgr2=0x7fd914167130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.834+0000 7fd91aac9640 1 --2- 172.21.15.19:0/4003995280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9140cd510 0x7fd914167130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd90c009e50 tx=0x7fd90c02a6d0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.834+0000 7fd91aac9640 1 -- 172.21.15.19:0/4003995280 shutdown_connections 2024-09-12T01:55:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.834+0000 7fd91aac9640 1 --2- 172.21.15.19:0/4003995280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9140cd510 0x7fd914167130 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.834+0000 7fd91aac9640 1 -- 172.21.15.19:0/4003995280 >> 172.21.15.19:0/4003995280 conn(0x7fd9140b3de0 msgr2=0x7fd9140b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.834+0000 7fd91aac9640 1 -- 172.21.15.19:0/4003995280 shutdown_connections 2024-09-12T01:55:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.834+0000 7fd91aac9640 1 -- 172.21.15.19:0/4003995280 wait complete. 2024-09-12T01:55:58.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.836+0000 7fd91aac9640 1 Processor -- start 2024-09-12T01:55:58.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.836+0000 7fd91aac9640 1 -- start start 2024-09-12T01:55:58.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.836+0000 7fd91aac9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9140b4a50 0x7fd9140b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:58.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.836+0000 7fd91aac9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9140b7c30 0x7fd9140b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:58.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.836+0000 7fd91aac9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9140cd510 0x7fd91409e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:58.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.836+0000 7fd91aac9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd9140cd910 con 0x7fd9140b7c30 2024-09-12T01:55:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.837+0000 7fd91aac9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9140b6130 con 0x7fd9140cd510 2024-09-12T01:55:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.837+0000 7fd91aac9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd9140b8010 con 0x7fd9140b4a50 2024-09-12T01:55:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.837+0000 7fd913fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9140b7c30 0x7fd9140b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.837+0000 7fd913fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9140b7c30 0x7fd9140b0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52098/0 (socket says 172.21.15.19:52098) 2024-09-12T01:55:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.837+0000 7fd913fff640 1 -- 172.21.15.19:0/1169365876 learned_addr learned my addr 172.21.15.19:0/1169365876 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.837+0000 7fd919066640 1 --2- 172.21.15.19:0/1169365876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9140cd510 0x7fd91409e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.837+0000 7fd918865640 1 --2- 172.21.15.19:0/1169365876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9140b4a50 0x7fd9140b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.837+0000 7fd913fff640 1 -- 172.21.15.19:0/1169365876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9140b4a50 msgr2=0x7fd9140b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.837+0000 7fd913fff640 1 --2- 172.21.15.19:0/1169365876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9140b4a50 0x7fd9140b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.837+0000 7fd913fff640 1 -- 172.21.15.19:0/1169365876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9140cd510 msgr2=0x7fd91409e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.837+0000 7fd913fff640 1 --2- 172.21.15.19:0/1169365876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9140cd510 0x7fd91409e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.837+0000 7fd913fff640 1 -- 172.21.15.19:0/1169365876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9140b13c0 con 0x7fd9140b7c30 2024-09-12T01:55:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.837+0000 7fd913fff640 1 --2- 172.21.15.19:0/1169365876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9140b7c30 0x7fd9140b0ba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00c4d0 tx=0x7fd8fc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:58.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.837+0000 7fd9117fa640 1 -- 172.21.15.19:0/1169365876 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc018070 con 0x7fd9140b7c30 2024-09-12T01:55:58.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.837+0000 7fd9117fa640 1 -- 172.21.15.19:0/1169365876 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8fc007500 con 0x7fd9140b7c30 2024-09-12T01:55:58.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.837+0000 7fd91aac9640 1 -- 172.21.15.19:0/1169365876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9140b16a0 con 0x7fd9140b7c30 2024-09-12T01:55:58.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.837+0000 7fd9117fa640 1 -- 172.21.15.19:0/1169365876 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc004a20 con 0x7fd9140b7c30 2024-09-12T01:55:58.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.837+0000 7fd91aac9640 1 -- 172.21.15.19:0/1169365876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9140b1c60 con 0x7fd9140b7c30 2024-09-12T01:55:58.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.838+0000 7fd91aac9640 1 -- 172.21.15.19:0/1169365876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9140cce00 con 0x7fd9140b7c30 2024-09-12T01:55:58.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.839+0000 7fd9117fa640 1 -- 172.21.15.19:0/1169365876 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8fc01b070 con 0x7fd9140b7c30 2024-09-12T01:55:58.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.839+0000 7fd9117fa640 1 --2- 172.21.15.19:0/1169365876 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd8f406be30 0x7fd8f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:58.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.840+0000 7fd9117fa640 1 -- 172.21.15.19:0/1169365876 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7fd8fc08a470 con 0x7fd9140b7c30 2024-09-12T01:55:58.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.840+0000 7fd918865640 1 --2- 172.21.15.19:0/1169365876 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd8f406be30 0x7fd8f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:58.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.840+0000 7fd918865640 1 --2- 172.21.15.19:0/1169365876 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd8f406be30 0x7fd8f406e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd904004f60 tx=0x7fd904007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:58.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:58.844+0000 7fd9117fa640 1 -- 172.21.15.19:0/1169365876 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd8fc058410 con 0x7fd9140b7c30 2024-09-12T01:55:59.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.017+0000 7fd91aac9640 1 -- 172.21.15.19:0/1169365876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fd9140b10e0 con 0x7fd9140b7c30 2024-09-12T01:55:59.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.698+0000 7fd9117fa640 1 -- 172.21.15.19:0/1169365876 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) ==== 169+0+0 (secure 0 0 0) 0x7fd8fc05c710 con 0x7fd9140b7c30 2024-09-12T01:55:59.698 INFO:teuthology.orchestra.run.smithi019.stderr:set pool 4 allow_ec_overwrites to true 2024-09-12T01:55:59.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.703+0000 7fd91aac9640 1 -- 172.21.15.19:0/1169365876 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd8f406be30 msgr2=0x7fd8f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:59.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.703+0000 7fd91aac9640 1 --2- 172.21.15.19:0/1169365876 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd8f406be30 0x7fd8f406e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd904004f60 tx=0x7fd904007e30 comp rx=0 tx=0).stop 2024-09-12T01:55:59.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.703+0000 7fd91aac9640 1 -- 172.21.15.19:0/1169365876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9140b7c30 msgr2=0x7fd9140b0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:59.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.703+0000 7fd91aac9640 1 --2- 172.21.15.19:0/1169365876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9140b7c30 0x7fd9140b0ba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00c4d0 tx=0x7fd8fc00c990 comp rx=0 tx=0).stop 2024-09-12T01:55:59.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.704+0000 7fd91aac9640 1 -- 172.21.15.19:0/1169365876 shutdown_connections 2024-09-12T01:55:59.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.704+0000 7fd91aac9640 1 --2- 172.21.15.19:0/1169365876 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd8f406be30 0x7fd8f406e2f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.704+0000 7fd91aac9640 1 --2- 172.21.15.19:0/1169365876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9140cd510 0x7fd91409e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.704+0000 7fd91aac9640 1 --2- 172.21.15.19:0/1169365876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9140b7c30 0x7fd9140b0ba0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.704+0000 7fd91aac9640 1 --2- 172.21.15.19:0/1169365876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9140b4a50 0x7fd9140b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.704+0000 7fd91aac9640 1 -- 172.21.15.19:0/1169365876 >> 172.21.15.19:0/1169365876 conn(0x7fd9140b3de0 msgr2=0x7fd9140ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:59.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.709+0000 7fd91aac9640 1 -- 172.21.15.19:0/1169365876 shutdown_connections 2024-09-12T01:55:59.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.715+0000 7fd91aac9640 1 -- 172.21.15.19:0/1169365876 wait complete. 2024-09-12T01:55:59.736 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-12T01:55:59.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.845+0000 7f6f10b49640 1 Processor -- start 2024-09-12T01:55:59.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.845+0000 7f6f10b49640 1 -- start start 2024-09-12T01:55:59.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.846+0000 7f6f10b49640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6f0c162340 0x7f6f0c06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.846+0000 7f6f10b49640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f0c162e30 0x7f6f0c0d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.846+0000 7f6f10b49640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f0c15ff70 con 0x7f6f0c0cf280 2024-09-12T01:55:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.846+0000 7f6f10b49640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f6f0c06de90 con 0x7f6f0c162340 2024-09-12T01:55:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.846+0000 7f6f10b49640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6f0c0d4d10 con 0x7f6f0c162e30 2024-09-12T01:55:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.846+0000 7f6f0a59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6f0c162340 0x7f6f0c06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.846+0000 7f6f09d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6f0c0cf280 0x7f6f0c162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48744/0 (socket says 172.21.15.19:48744) 2024-09-12T01:55:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.846+0000 7f6f09d9b640 1 -- 172.21.15.19:0/2690695793 learned_addr learned my addr 172.21.15.19:0/2690695793 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:55:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.846+0000 7f6f0ad9d640 1 --2- 172.21.15.19:0/2690695793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f0c162e30 0x7f6f0c0d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.846+0000 7f6f0a59c640 1 -- 172.21.15.19:0/2690695793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f0c162e30 msgr2=0x7f6f0c0d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.846+0000 7f6f0a59c640 1 --2- 172.21.15.19:0/2690695793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f0c162e30 0x7f6f0c0d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.846+0000 7f6f0a59c640 1 -- 172.21.15.19:0/2690695793 >> v1:172.21.15.19:6789/0 conn(0x7f6f0c0cf280 legacy=0x7f6f0c162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.846+0000 7f6f0a59c640 1 -- 172.21.15.19:0/2690695793 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f0c0d4ff0 con 0x7f6f0c162340 2024-09-12T01:55:59.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.847+0000 7f6f0a59c640 1 --2- 172.21.15.19:0/2690695793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f0c162340 0x7f6f0c06d740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0097a0 tx=0x7f6efc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c2274dda3c9d7e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:59.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.847+0000 7f6f0959a640 1 -- 172.21.15.19:0/2690695793 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc037070 con 0x7f6f0c162340 2024-09-12T01:55:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.847+0000 7f6f0959a640 1 -- 172.21.15.19:0/2690695793 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6efc02ae50 con 0x7f6f0c162340 2024-09-12T01:55:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.847+0000 7f6f0959a640 1 -- 172.21.15.19:0/2690695793 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc032660 con 0x7f6f0c162340 2024-09-12T01:55:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.848+0000 7f6f10b49640 1 -- 172.21.15.19:0/2690695793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f0c162340 msgr2=0x7f6f0c06d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.848+0000 7f6f10b49640 1 --2- 172.21.15.19:0/2690695793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f0c162340 0x7f6f0c06d740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0097a0 tx=0x7f6efc02a100 comp rx=0 tx=0).stop 2024-09-12T01:55:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.848+0000 7f6f10b49640 1 -- 172.21.15.19:0/2690695793 shutdown_connections 2024-09-12T01:55:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.848+0000 7f6f10b49640 1 --2- 172.21.15.19:0/2690695793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f0c162e30 0x7f6f0c0d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.848+0000 7f6f10b49640 1 --2- 172.21.15.19:0/2690695793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f0c162340 0x7f6f0c06d740 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.848+0000 7f6f10b49640 1 -- 172.21.15.19:0/2690695793 >> 172.21.15.19:0/2690695793 conn(0x7f6f0c08bfc0 msgr2=0x7f6f0c0d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.848+0000 7f6f10b49640 1 -- 172.21.15.19:0/2690695793 shutdown_connections 2024-09-12T01:55:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.848+0000 7f6f10b49640 1 -- 172.21.15.19:0/2690695793 wait complete. 2024-09-12T01:55:59.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.849+0000 7f6f10b49640 1 Processor -- start 2024-09-12T01:55:59.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.849+0000 7f6f10b49640 1 -- start start 2024-09-12T01:55:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.850+0000 7f6f10b49640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f0c0cf280 0x7f6f0c158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.850+0000 7f6f10b49640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f0c162340 0x7f6f0c0cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.850+0000 7f6f10b49640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f0c162e30 0x7f6f0c1ea1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.850+0000 7f6f10b49640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c0cf6c0 con 0x7f6f0c162340 2024-09-12T01:55:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.850+0000 7f6f10b49640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c0d52d0 con 0x7f6f0c0cf280 2024-09-12T01:55:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.850+0000 7f6f10b49640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6f0c0d2ed0 con 0x7f6f0c162e30 2024-09-12T01:55:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.850+0000 7f6f09d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f0c162340 0x7f6f0c0cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.850+0000 7f6f09d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f0c162340 0x7f6f0c0cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52118/0 (socket says 172.21.15.19:52118) 2024-09-12T01:55:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.850+0000 7f6f09d9b640 1 -- 172.21.15.19:0/336193953 learned_addr learned my addr 172.21.15.19:0/336193953 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:55:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.850+0000 7f6f0ad9d640 1 --2- 172.21.15.19:0/336193953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f0c162e30 0x7f6f0c1ea1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.850+0000 7f6f0a59c640 1 --2- 172.21.15.19:0/336193953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f0c0cf280 0x7f6f0c158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.850+0000 7f6f09d9b640 1 -- 172.21.15.19:0/336193953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f0c162e30 msgr2=0x7f6f0c1ea1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.850+0000 7f6f09d9b640 1 --2- 172.21.15.19:0/336193953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f0c162e30 0x7f6f0c1ea1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.850+0000 7f6f09d9b640 1 -- 172.21.15.19:0/336193953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f0c0cf280 msgr2=0x7f6f0c158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.850+0000 7f6f09d9b640 1 --2- 172.21.15.19:0/336193953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f0c0cf280 0x7f6f0c158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.850+0000 7f6f09d9b640 1 -- 172.21.15.19:0/336193953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f0c1e9100 con 0x7f6f0c162340 2024-09-12T01:55:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.850+0000 7f6f0a59c640 1 --2- 172.21.15.19:0/336193953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f0c0cf280 0x7f6f0c158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.850+0000 7f6f09d9b640 1 --2- 172.21.15.19:0/336193953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f0c162340 0x7f6f0c0cd3e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000c400 tx=0x7f6f0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.851+0000 7f6efaffd640 1 -- 172.21.15.19:0/336193953 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f00017070 con 0x7f6f0c162340 2024-09-12T01:55:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.851+0000 7f6efaffd640 1 -- 172.21.15.19:0/336193953 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f000074e0 con 0x7f6f0c162340 2024-09-12T01:55:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.851+0000 7f6f10b49640 1 -- 172.21.15.19:0/336193953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f0c1e93e0 con 0x7f6f0c162340 2024-09-12T01:55:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.851+0000 7f6efaffd640 1 -- 172.21.15.19:0/336193953 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f000059a0 con 0x7f6f0c162340 2024-09-12T01:55:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.851+0000 7f6f10b49640 1 -- 172.21.15.19:0/336193953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f0c1e9c80 con 0x7f6f0c162340 2024-09-12T01:55:59.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.852+0000 7f6f10b49640 1 -- 172.21.15.19:0/336193953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f0c1e95b0 con 0x7f6f0c162340 2024-09-12T01:55:59.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.852+0000 7f6efaffd640 1 -- 172.21.15.19:0/336193953 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f0001a070 con 0x7f6f0c162340 2024-09-12T01:55:59.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.853+0000 7f6efaffd640 1 --2- 172.21.15.19:0/336193953 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6eec06be60 0x7f6eec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:59.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.853+0000 7f6efaffd640 1 -- 172.21.15.19:0/336193953 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7f6f0008a470 con 0x7f6f0c162340 2024-09-12T01:55:59.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.853+0000 7f6f0a59c640 1 --2- 172.21.15.19:0/336193953 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6eec06be60 0x7f6eec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:59.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.853+0000 7f6f0a59c640 1 --2- 172.21.15.19:0/336193953 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6eec06be60 0x7f6eec06e320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6efc034000 tx=0x7f6efc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:55:59.857+0000 7f6efaffd640 1 -- 172.21.15.19:0/336193953 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f00058420 con 0x7f6f0c162340 2024-09-12T01:56:00.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.072+0000 7f6f10b49640 1 -- 172.21.15.19:0/336193953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f6f0c1e9e80 con 0x7f6f0c162340 2024-09-12T01:56:00.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.743+0000 7f6efaffd640 1 -- 172.21.15.19:0/336193953 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7f6f0c1e9e80 con 0x7f6f0c162340 2024-09-12T01:56:00.744 INFO:teuthology.orchestra.run.smithi019.stderr:added data pool 4 to fsmap 2024-09-12T01:56:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.746+0000 7f6f10b49640 1 -- 172.21.15.19:0/336193953 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6eec06be60 msgr2=0x7f6eec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.746+0000 7f6f10b49640 1 --2- 172.21.15.19:0/336193953 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6eec06be60 0x7f6eec06e320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6efc034000 tx=0x7f6efc02e000 comp rx=0 tx=0).stop 2024-09-12T01:56:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.746+0000 7f6f10b49640 1 -- 172.21.15.19:0/336193953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f0c162340 msgr2=0x7f6f0c0cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.746+0000 7f6f10b49640 1 --2- 172.21.15.19:0/336193953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f0c162340 0x7f6f0c0cd3e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000c400 tx=0x7f6f0000c8c0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.746+0000 7f6f10b49640 1 -- 172.21.15.19:0/336193953 shutdown_connections 2024-09-12T01:56:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.746+0000 7f6f10b49640 1 --2- 172.21.15.19:0/336193953 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6eec06be60 0x7f6eec06e320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.746+0000 7f6f10b49640 1 --2- 172.21.15.19:0/336193953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f0c162e30 0x7f6f0c1ea1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.746+0000 7f6f10b49640 1 --2- 172.21.15.19:0/336193953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f0c162340 0x7f6f0c0cd3e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.746+0000 7f6f10b49640 1 --2- 172.21.15.19:0/336193953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f0c0cf280 0x7f6f0c158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.746+0000 7f6f10b49640 1 -- 172.21.15.19:0/336193953 >> 172.21.15.19:0/336193953 conn(0x7f6f0c08bfc0 msgr2=0x7f6f0c0d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:00.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.746+0000 7f6f10b49640 1 -- 172.21.15.19:0/336193953 shutdown_connections 2024-09-12T01:56:00.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.747+0000 7f6f10b49640 1 -- 172.21.15.19:0/336193953 wait complete. 2024-09-12T01:56:00.760 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:56:00.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.868+0000 7f0e282f1640 1 Processor -- start 2024-09-12T01:56:00.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.868+0000 7f0e282f1640 1 -- start start 2024-09-12T01:56:00.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.869+0000 7f0e282f1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0e200d1090 0x7f0e2009b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:00.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.869+0000 7f0e282f1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e200b1620 0x7f0e200b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:00.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.869+0000 7f0e282f1640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e200cec00 con 0x7f0e2015c520 2024-09-12T01:56:00.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.869+0000 7f0e282f1640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f0e2009bd90 con 0x7f0e200d1090 2024-09-12T01:56:00.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.869+0000 7f0e282f1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0e200d0010 con 0x7f0e200b1620 2024-09-12T01:56:00.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.869+0000 7f0e2588c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0e200d1090 0x7f0e2009b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:00.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.869+0000 7f0e2588c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0e200d1090 0x7f0e2009b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52124/0 (socket says 172.21.15.19:52124) 2024-09-12T01:56:00.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.869+0000 7f0e2588c640 1 -- 172.21.15.19:0/1792371471 learned_addr learned my addr 172.21.15.19:0/1792371471 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:00.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.869+0000 7f0e2608d640 1 --1- 172.21.15.19:0/1792371471 >> v1:172.21.15.19:6789/0 conn(0x7f0e2015c520 0x7f0e200d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48748/0 (socket says 172.21.15.19:48748) 2024-09-12T01:56:00.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.870+0000 7f0e2688e640 1 --2- 172.21.15.19:0/1792371471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e200b1620 0x7f0e200b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:00.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.870+0000 7f0e2588c640 1 -- 172.21.15.19:0/1792371471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e200b1620 msgr2=0x7f0e200b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:00.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.870+0000 7f0e2588c640 1 --2- 172.21.15.19:0/1792371471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e200b1620 0x7f0e200b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.870+0000 7f0e2588c640 1 -- 172.21.15.19:0/1792371471 >> v1:172.21.15.19:6789/0 conn(0x7f0e2015c520 legacy=0x7f0e200d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.870+0000 7f0e2588c640 1 -- 172.21.15.19:0/1792371471 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e200d02f0 con 0x7f0e200d1090 2024-09-12T01:56:00.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.870+0000 7f0e2508b640 1 -- 172.21.15.19:0/1792371471 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1363235413 0 0) 0x7f0e200cec00 con 0x7f0e2015c520 2024-09-12T01:56:00.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.870+0000 7f0e2588c640 1 --2- 172.21.15.19:0/1792371471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e200d1090 0x7f0e2009b720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009870 tx=0x7f0e1002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62cecb6361dc2136 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:00.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.871+0000 7f0e2508b640 1 -- 172.21.15.19:0/1792371471 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10037070 con 0x7f0e200d1090 2024-09-12T01:56:00.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.871+0000 7f0e2508b640 1 -- 172.21.15.19:0/1792371471 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e10032440 con 0x7f0e200d1090 2024-09-12T01:56:00.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.871+0000 7f0e2508b640 1 -- 172.21.15.19:0/1792371471 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10032810 con 0x7f0e200d1090 2024-09-12T01:56:00.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.871+0000 7f0e282f1640 1 -- 172.21.15.19:0/1792371471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e200d1090 msgr2=0x7f0e2009b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.871+0000 7f0e282f1640 1 --2- 172.21.15.19:0/1792371471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e200d1090 0x7f0e2009b720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009870 tx=0x7f0e1002a250 comp rx=0 tx=0).stop 2024-09-12T01:56:00.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.871+0000 7f0e282f1640 1 -- 172.21.15.19:0/1792371471 shutdown_connections 2024-09-12T01:56:00.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.871+0000 7f0e282f1640 1 --2- 172.21.15.19:0/1792371471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e200b1620 0x7f0e200b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.871+0000 7f0e282f1640 1 --2- 172.21.15.19:0/1792371471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e200d1090 0x7f0e2009b720 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.871+0000 7f0e282f1640 1 -- 172.21.15.19:0/1792371471 >> 172.21.15.19:0/1792371471 conn(0x7f0e200d23a0 msgr2=0x7f0e200d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:00.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.871+0000 7f0e282f1640 1 -- 172.21.15.19:0/1792371471 shutdown_connections 2024-09-12T01:56:00.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.871+0000 7f0e282f1640 1 -- 172.21.15.19:0/1792371471 wait complete. 2024-09-12T01:56:00.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.872+0000 7f0e282f1640 1 Processor -- start 2024-09-12T01:56:00.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.873+0000 7f0e282f1640 1 -- start start 2024-09-12T01:56:00.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.873+0000 7f0e282f1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e200b1620 0x7f0e200b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:00.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.873+0000 7f0e282f1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e200d1090 0x7f0e201f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:00.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.873+0000 7f0e282f1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e2015c520 0x7f0e200cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:00.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.873+0000 7f0e282f1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2015c900 con 0x7f0e200d1090 2024-09-12T01:56:00.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.873+0000 7f0e282f1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0e200d05d0 con 0x7f0e2015c520 2024-09-12T01:56:00.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.873+0000 7f0e282f1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0e200cc370 con 0x7f0e200b1620 2024-09-12T01:56:00.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.873+0000 7f0e2588c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e200d1090 0x7f0e201f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:00.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.873+0000 7f0e2588c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e200d1090 0x7f0e201f2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52136/0 (socket says 172.21.15.19:52136) 2024-09-12T01:56:00.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.873+0000 7f0e2588c640 1 -- 172.21.15.19:0/1066317520 learned_addr learned my addr 172.21.15.19:0/1066317520 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:00.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.873+0000 7f0e2608d640 1 --2- 172.21.15.19:0/1066317520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e200b1620 0x7f0e200b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:00.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.873+0000 7f0e2688e640 1 --2- 172.21.15.19:0/1066317520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e2015c520 0x7f0e200cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:00.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.874+0000 7f0e2588c640 1 -- 172.21.15.19:0/1066317520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e200b1620 msgr2=0x7f0e200b61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.874+0000 7f0e2588c640 1 --2- 172.21.15.19:0/1066317520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e200b1620 0x7f0e200b61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.874+0000 7f0e2588c640 1 -- 172.21.15.19:0/1066317520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e2015c520 msgr2=0x7f0e200cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.874+0000 7f0e2588c640 1 --2- 172.21.15.19:0/1066317520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e2015c520 0x7f0e200cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.874+0000 7f0e2588c640 1 -- 172.21.15.19:0/1066317520 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e200c71a0 con 0x7f0e200d1090 2024-09-12T01:56:00.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.874+0000 7f0e2588c640 1 --2- 172.21.15.19:0/1066317520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e200d1090 0x7f0e201f2a70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009870 tx=0x7f0e100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:00.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.874+0000 7f0e16ffd640 1 -- 172.21.15.19:0/1066317520 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10041020 con 0x7f0e200d1090 2024-09-12T01:56:00.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.874+0000 7f0e16ffd640 1 -- 172.21.15.19:0/1066317520 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e100306c0 con 0x7f0e200d1090 2024-09-12T01:56:00.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.874+0000 7f0e16ffd640 1 -- 172.21.15.19:0/1066317520 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10037040 con 0x7f0e200d1090 2024-09-12T01:56:00.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.874+0000 7f0e282f1640 1 -- 172.21.15.19:0/1066317520 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e200cc5f0 con 0x7f0e200d1090 2024-09-12T01:56:00.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.874+0000 7f0e282f1640 1 -- 172.21.15.19:0/1066317520 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e200c7740 con 0x7f0e200d1090 2024-09-12T01:56:00.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.875+0000 7f0e282f1640 1 -- 172.21.15.19:0/1066317520 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e200b1d40 con 0x7f0e200d1090 2024-09-12T01:56:00.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.876+0000 7f0e16ffd640 1 -- 172.21.15.19:0/1066317520 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e10044020 con 0x7f0e200d1090 2024-09-12T01:56:00.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.876+0000 7f0e16ffd640 1 --2- 172.21.15.19:0/1066317520 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0e0406be30 0x7f0e0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:00.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.876+0000 7f0e16ffd640 1 -- 172.21.15.19:0/1066317520 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0e100ab7c0 con 0x7f0e200d1090 2024-09-12T01:56:00.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.876+0000 7f0e2608d640 1 --2- 172.21.15.19:0/1066317520 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0e0406be30 0x7f0e0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:00.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.877+0000 7f0e2608d640 1 --2- 172.21.15.19:0/1066317520 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0e0406be30 0x7f0e0406e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c007fd0 tx=0x7f0e1c007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:00.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:00.880+0000 7f0e16ffd640 1 -- 172.21.15.19:0/1066317520 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e1004b030 con 0x7f0e200d1090 2024-09-12T01:56:01.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.095+0000 7f0e282f1640 1 -- 172.21.15.19:0/1066317520 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e200b8320 con 0x7f0e200d1090 2024-09-12T01:56:01.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.095+0000 7f0e16ffd640 1 -- 172.21.15.19:0/1066317520 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5225 (secure 0 0 0) 0x7f0e10079870 con 0x7f0e200d1090 2024-09-12T01:56:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:01.096 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"btime":"2024-09-12T01:56:00:738411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4024559276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":4024559276},{"type":"v1","addr":"172.21.15.135:6837","nonce":4024559276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3369866614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3369866614},{"type":"v1","addr":"172.21.15.19:6834","nonce":3369866614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2476634027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2476634027},{"type":"v1","addr":"172.21.15.19:6835","nonce":2476634027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:55:55.036100+0000","modified":"2024-09-12T01:56:00.073514+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/4290669195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4290669195},{"type":"v1","addr":"172.21.15.135:6836","nonce":4290669195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-09-12T01:56:01.096 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-09-12T01:56:01.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.097+0000 7f0e282f1640 1 -- 172.21.15.19:0/1066317520 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0e0406be30 msgr2=0x7f0e0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.097+0000 7f0e282f1640 1 --2- 172.21.15.19:0/1066317520 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0e0406be30 0x7f0e0406e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c007fd0 tx=0x7f0e1c007de0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.097+0000 7f0e282f1640 1 -- 172.21.15.19:0/1066317520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e200d1090 msgr2=0x7f0e201f2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.097+0000 7f0e282f1640 1 --2- 172.21.15.19:0/1066317520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e200d1090 0x7f0e201f2a70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009870 tx=0x7f0e100046c0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.097+0000 7f0e282f1640 1 -- 172.21.15.19:0/1066317520 shutdown_connections 2024-09-12T01:56:01.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.097+0000 7f0e282f1640 1 --2- 172.21.15.19:0/1066317520 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0e0406be30 0x7f0e0406e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.097+0000 7f0e282f1640 1 --2- 172.21.15.19:0/1066317520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e2015c520 0x7f0e200cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.097+0000 7f0e282f1640 1 --2- 172.21.15.19:0/1066317520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e200d1090 0x7f0e201f2a70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.097+0000 7f0e282f1640 1 --2- 172.21.15.19:0/1066317520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e200b1620 0x7f0e200b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.097+0000 7f0e282f1640 1 -- 172.21.15.19:0/1066317520 >> 172.21.15.19:0/1066317520 conn(0x7f0e200d23a0 msgr2=0x7f0e20071450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:01.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.097+0000 7f0e282f1640 1 -- 172.21.15.19:0/1066317520 shutdown_connections 2024-09-12T01:56:01.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.097+0000 7f0e282f1640 1 -- 172.21.15.19:0/1066317520 wait complete. 2024-09-12T01:56:01.109 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:56:01.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.211+0000 7f412d423640 1 Processor -- start 2024-09-12T01:56:01.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.211+0000 7f412d423640 1 -- start start 2024-09-12T01:56:01.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.212+0000 7f412d423640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4128162060 0x7f41280b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.212+0000 7f412d423640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f41280b64b0 0x7f41280b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.212+0000 7f412d423640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f412806d9f0 con 0x7f4128161c80 2024-09-12T01:56:01.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.212+0000 7f412d423640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f412806dcd0 con 0x7f41280b64b0 2024-09-12T01:56:01.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.212+0000 7f412d423640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f412806dfb0 con 0x7f4128162060 2024-09-12T01:56:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.212+0000 7f4126ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4128161c80 0x7f412806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48616/0 (socket says 172.21.15.19:48616) 2024-09-12T01:56:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.212+0000 7f4126ffd640 1 -- 172.21.15.19:0/2845809209 learned_addr learned my addr 172.21.15.19:0/2845809209 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.212+0000 7f41277fe640 1 --2- 172.21.15.19:0/2845809209 >> v2:172.21.15.135:3300/0 conn(0x7f41280b64b0 0x7f41280b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.212+0000 7f41267fc640 1 --2- 172.21.15.19:0/2845809209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4128162060 0x7f41280b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.212+0000 7f4125ffb640 1 -- 172.21.15.19:0/2845809209 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 467355256 0 0) 0x7f412806d9f0 con 0x7f4128161c80 2024-09-12T01:56:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.212+0000 7f4125ffb640 1 -- 172.21.15.19:0/2845809209 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4110003520 con 0x7f4128161c80 2024-09-12T01:56:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f4125ffb640 1 -- 172.21.15.19:0/2845809209 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3099751930 0 0) 0x7f4110003520 con 0x7f4128161c80 2024-09-12T01:56:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f4125ffb640 1 -- 172.21.15.19:0/2845809209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4128162060 msgr2=0x7f41280b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f4125ffb640 1 --2- 172.21.15.19:0/2845809209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4128162060 0x7f41280b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f4125ffb640 1 -- 172.21.15.19:0/2845809209 >> v2:172.21.15.135:3300/0 conn(0x7f41280b64b0 msgr2=0x7f41280b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f4125ffb640 1 --2- 172.21.15.19:0/2845809209 >> v2:172.21.15.135:3300/0 conn(0x7f41280b64b0 0x7f41280b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f4125ffb640 1 -- 172.21.15.19:0/2845809209 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41280d01f0 con 0x7f4128161c80 2024-09-12T01:56:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f4125ffb640 1 -- 172.21.15.19:0/2845809209 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f4118001670 con 0x7f4128161c80 2024-09-12T01:56:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f4125ffb640 1 -- 172.21.15.19:0/2845809209 >> v1:172.21.15.19:6789/0 conn(0x7f4128161c80 legacy=0x7f412806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f4125ffb640 1 --2- 172.21.15.19:0/2845809209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41100039b0 0x7f4110003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f4125ffb640 1 --2- 172.21.15.19:0/2845809209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4128162060 0x7f4110004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f4125ffb640 1 --2- 172.21.15.19:0/2845809209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4110004d40 0x7f41100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f4125ffb640 1 -- 172.21.15.19:0/2845809209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f412806dcd0 con 0x7f4110004d40 2024-09-12T01:56:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f4125ffb640 1 -- 172.21.15.19:0/2845809209 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f412806dfb0 con 0x7f41100039b0 2024-09-12T01:56:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f4125ffb640 1 -- 172.21.15.19:0/2845809209 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f411000b9c0 con 0x7f4128162060 2024-09-12T01:56:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f41277fe640 1 --2- 172.21.15.19:0/2845809209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4110004d40 0x7f41100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f41267fc640 1 --2- 172.21.15.19:0/2845809209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4128162060 0x7f4110004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f4126ffd640 1 --2- 172.21.15.19:0/2845809209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41100039b0 0x7f4110003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f41277fe640 1 -- 172.21.15.19:0/2845809209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4128162060 msgr2=0x7f4110004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f41277fe640 1 --2- 172.21.15.19:0/2845809209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4128162060 0x7f4110004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f41277fe640 1 -- 172.21.15.19:0/2845809209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41100039b0 msgr2=0x7f4110003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f41277fe640 1 --2- 172.21.15.19:0/2845809209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41100039b0 0x7f4110003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.213+0000 7f41277fe640 1 -- 172.21.15.19:0/2845809209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4110003520 con 0x7f4110004d40 2024-09-12T01:56:01.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.214+0000 7f41277fe640 1 --2- 172.21.15.19:0/2845809209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4110004d40 0x7f41100051c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4120009fc0 tx=0x7f4110005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444ee9c4a0706cf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:01.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.214+0000 7f4125ffb640 1 -- 172.21.15.19:0/2845809209 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120009c10 con 0x7f4110004d40 2024-09-12T01:56:01.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.214+0000 7f4125ffb640 1 -- 172.21.15.19:0/2845809209 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4120036070 con 0x7f4110004d40 2024-09-12T01:56:01.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.214+0000 7f4125ffb640 1 -- 172.21.15.19:0/2845809209 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412002d070 con 0x7f4110004d40 2024-09-12T01:56:01.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.214+0000 7f412d423640 1 -- 172.21.15.19:0/2845809209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4110004d40 msgr2=0x7f41100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.214+0000 7f412d423640 1 --2- 172.21.15.19:0/2845809209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4110004d40 0x7f41100051c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4120009fc0 tx=0x7f4110005830 comp rx=0 tx=0).stop 2024-09-12T01:56:01.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.214+0000 7f41277fe640 1 -- 172.21.15.19:0/2845809209 reap_dead start 2024-09-12T01:56:01.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.215+0000 7f412d423640 1 -- 172.21.15.19:0/2845809209 shutdown_connections 2024-09-12T01:56:01.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.215+0000 7f412d423640 1 -- 172.21.15.19:0/2845809209 >> 172.21.15.19:0/2845809209 conn(0x7f41280d44f0 msgr2=0x7f41280d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:01.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.215+0000 7f412d423640 1 -- 172.21.15.19:0/2845809209 shutdown_connections 2024-09-12T01:56:01.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.215+0000 7f412d423640 1 -- 172.21.15.19:0/2845809209 wait complete. 2024-09-12T01:56:01.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.216+0000 7f412d423640 1 Processor -- start 2024-09-12T01:56:01.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.216+0000 7f412d423640 1 -- start start 2024-09-12T01:56:01.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f412d423640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4110004d40 0x7f41280b7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f412d423640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41281f45c0 0x7f412815eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f412d423640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41280cc270 0x7f4128159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f412d423640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f41280b5f70 con 0x7f41280cc270 2024-09-12T01:56:01.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f412d423640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f41280d2aa0 con 0x7f4110004d40 2024-09-12T01:56:01.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f412d423640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f41280b60f0 con 0x7f41281f45c0 2024-09-12T01:56:01.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f41277fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41280cc270 0x7f4128159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f41277fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41280cc270 0x7f4128159520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34950/0 (socket says 172.21.15.19:34950) 2024-09-12T01:56:01.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f41277fe640 1 -- 172.21.15.19:0/2062398436 learned_addr learned my addr 172.21.15.19:0/2062398436 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:01.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f41267fc640 1 --2- 172.21.15.19:0/2062398436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41281f45c0 0x7f412815eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f4126ffd640 1 --2- 172.21.15.19:0/2062398436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4110004d40 0x7f41280b7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f41277fe640 1 -- 172.21.15.19:0/2062398436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41281f45c0 msgr2=0x7f412815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f41277fe640 1 --2- 172.21.15.19:0/2062398436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41281f45c0 0x7f412815eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f41277fe640 1 -- 172.21.15.19:0/2062398436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4110004d40 msgr2=0x7f41280b7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f41277fe640 1 --2- 172.21.15.19:0/2062398436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4110004d40 0x7f41280b7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f41277fe640 1 -- 172.21.15.19:0/2062398436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41280cc810 con 0x7f41280cc270 2024-09-12T01:56:01.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f41277fe640 1 --2- 172.21.15.19:0/2062398436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41280cc270 0x7f4128159520 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4120033040 tx=0x7f4120009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:01.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f410f7fe640 1 -- 172.21.15.19:0/2062398436 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120009c10 con 0x7f41280cc270 2024-09-12T01:56:01.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f410f7fe640 1 -- 172.21.15.19:0/2062398436 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4120003990 con 0x7f41280cc270 2024-09-12T01:56:01.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.217+0000 7f412d423640 1 -- 172.21.15.19:0/2062398436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41280ccaf0 con 0x7f41280cc270 2024-09-12T01:56:01.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.218+0000 7f410f7fe640 1 -- 172.21.15.19:0/2062398436 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120003d80 con 0x7f41280cc270 2024-09-12T01:56:01.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.218+0000 7f412d423640 1 -- 172.21.15.19:0/2062398436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41280b8e10 con 0x7f41280cc270 2024-09-12T01:56:01.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.219+0000 7f412d423640 1 -- 172.21.15.19:0/2062398436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41280cd010 con 0x7f41280cc270 2024-09-12T01:56:01.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.219+0000 7f410f7fe640 1 -- 172.21.15.19:0/2062398436 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4120005d10 con 0x7f41280cc270 2024-09-12T01:56:01.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.220+0000 7f410f7fe640 1 --2- 172.21.15.19:0/2062398436 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f411406be30 0x7f411406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.220+0000 7f410f7fe640 1 -- 172.21.15.19:0/2062398436 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f41200ac900 con 0x7f41280cc270 2024-09-12T01:56:01.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.220+0000 7f4126ffd640 1 --2- 172.21.15.19:0/2062398436 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f411406be30 0x7f411406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.220+0000 7f4126ffd640 1 --2- 172.21.15.19:0/2062398436 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f411406be30 0x7f411406e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4118001d30 tx=0x7f4118007970 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:01.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.224+0000 7f410f7fe640 1 -- 172.21.15.19:0/2062398436 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f412004a060 con 0x7f41280cc270 2024-09-12T01:56:01.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.402+0000 7f412d423640 1 -- 172.21.15.19:0/2062398436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41280b6960 con 0x7f41280cc270 2024-09-12T01:56:01.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.404+0000 7f410f7fe640 1 -- 172.21.15.19:0/2062398436 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18599 (secure 0 0 0) 0x7f412007b000 con 0x7f41280cc270 2024-09-12T01:56:01.404 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:01.404 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":26,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:56:00.073321+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:52.899670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:54.099981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:55:57.729901+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:01.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.406+0000 7f412d423640 1 -- 172.21.15.19:0/2062398436 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f411406be30 msgr2=0x7f411406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.406+0000 7f412d423640 1 --2- 172.21.15.19:0/2062398436 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f411406be30 0x7f411406e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4118001d30 tx=0x7f4118007970 comp rx=0 tx=0).stop 2024-09-12T01:56:01.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.406+0000 7f412d423640 1 -- 172.21.15.19:0/2062398436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41280cc270 msgr2=0x7f4128159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.406+0000 7f412d423640 1 --2- 172.21.15.19:0/2062398436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41280cc270 0x7f4128159520 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4120033040 tx=0x7f4120009750 comp rx=0 tx=0).stop 2024-09-12T01:56:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.406+0000 7f412d423640 1 -- 172.21.15.19:0/2062398436 shutdown_connections 2024-09-12T01:56:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.406+0000 7f412d423640 1 --2- 172.21.15.19:0/2062398436 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f411406be30 0x7f411406e2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.406+0000 7f412d423640 1 --2- 172.21.15.19:0/2062398436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41280cc270 0x7f4128159520 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.406+0000 7f412d423640 1 --2- 172.21.15.19:0/2062398436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41281f45c0 0x7f412815eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.406+0000 7f412d423640 1 --2- 172.21.15.19:0/2062398436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4110004d40 0x7f41280b7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.406+0000 7f412d423640 1 -- 172.21.15.19:0/2062398436 >> 172.21.15.19:0/2062398436 conn(0x7f41280d44f0 msgr2=0x7f41280d2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.406+0000 7f412d423640 1 -- 172.21.15.19:0/2062398436 shutdown_connections 2024-09-12T01:56:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.406+0000 7f412d423640 1 -- 172.21.15.19:0/2062398436 wait complete. 2024-09-12T01:56:01.417 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:56:01.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.518+0000 7f321c6e4640 1 Processor -- start 2024-09-12T01:56:01.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.518+0000 7f321c6e4640 1 -- start start 2024-09-12T01:56:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.519+0000 7f321c6e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32140b3760 0x7f32140b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.519+0000 7f321c6e4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f321406cd20 0x7f3214162340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.519+0000 7f321c6e4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32140b2790 con 0x7f321409aa30 2024-09-12T01:56:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.519+0000 7f321c6e4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f32140d0670 con 0x7f321406cd20 2024-09-12T01:56:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.519+0000 7f321c6e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f32140b2a70 con 0x7f32140b3760 2024-09-12T01:56:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321a480640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f321409aa30 0x7f321409ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48630/0 (socket says 172.21.15.19:48630) 2024-09-12T01:56:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321a480640 1 -- 172.21.15.19:0/2677580570 learned_addr learned my addr 172.21.15.19:0/2677580570 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321ac81640 1 --2- 172.21.15.19:0/2677580570 >> v2:172.21.15.135:3300/0 conn(0x7f321406cd20 0x7f3214162340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f3219c7f640 1 --2- 172.21.15.19:0/2677580570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32140b3760 0x7f32140b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321947e640 1 -- 172.21.15.19:0/2677580570 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3965199597 0 0) 0x7f32140b2790 con 0x7f321409aa30 2024-09-12T01:56:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321947e640 1 -- 172.21.15.19:0/2677580570 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31fc003520 con 0x7f321409aa30 2024-09-12T01:56:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321947e640 1 -- 172.21.15.19:0/2677580570 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2033266542 0 0) 0x7f31fc003520 con 0x7f321409aa30 2024-09-12T01:56:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321947e640 1 -- 172.21.15.19:0/2677580570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32140b3760 msgr2=0x7f32140b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321947e640 1 --2- 172.21.15.19:0/2677580570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32140b3760 0x7f32140b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321947e640 1 -- 172.21.15.19:0/2677580570 >> v2:172.21.15.135:3300/0 conn(0x7f321406cd20 msgr2=0x7f3214162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321947e640 1 --2- 172.21.15.19:0/2677580570 >> v2:172.21.15.135:3300/0 conn(0x7f321406cd20 0x7f3214162340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321947e640 1 -- 172.21.15.19:0/2677580570 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32140b2d50 con 0x7f321409aa30 2024-09-12T01:56:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321947e640 1 -- 172.21.15.19:0/2677580570 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f320c001670 con 0x7f321409aa30 2024-09-12T01:56:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321ac81640 1 --2- 172.21.15.19:0/2677580570 >> v2:172.21.15.135:3300/0 conn(0x7f321406cd20 0x7f3214162340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321947e640 1 -- 172.21.15.19:0/2677580570 >> v1:172.21.15.19:6789/0 conn(0x7f321409aa30 legacy=0x7f321409ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321947e640 1 --2- 172.21.15.19:0/2677580570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32140b3760 0x7f31fc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321947e640 1 --2- 172.21.15.19:0/2677580570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31fc003f30 0x7f31fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321947e640 1 --2- 172.21.15.19:0/2677580570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31fc004d40 0x7f31fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321947e640 1 -- 172.21.15.19:0/2677580570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f32140b2a70 con 0x7f31fc004d40 2024-09-12T01:56:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321947e640 1 -- 172.21.15.19:0/2677580570 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f31fc00b9c0 con 0x7f31fc003f30 2024-09-12T01:56:01.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321947e640 1 -- 172.21.15.19:0/2677580570 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f31fc00bb90 con 0x7f32140b3760 2024-09-12T01:56:01.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321a480640 1 --2- 172.21.15.19:0/2677580570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32140b3760 0x7f31fc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f321ac81640 1 --2- 172.21.15.19:0/2677580570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31fc004d40 0x7f31fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.520+0000 7f3219c7f640 1 --2- 172.21.15.19:0/2677580570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31fc003f30 0x7f31fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.521+0000 7f321ac81640 1 -- 172.21.15.19:0/2677580570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32140b3760 msgr2=0x7f31fc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:01.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.521+0000 7f321ac81640 1 --2- 172.21.15.19:0/2677580570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32140b3760 0x7f31fc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.521+0000 7f321ac81640 1 -- 172.21.15.19:0/2677580570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31fc003f30 msgr2=0x7f31fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:01.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.521+0000 7f321ac81640 1 --2- 172.21.15.19:0/2677580570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31fc003f30 0x7f31fc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.521+0000 7f321ac81640 1 -- 172.21.15.19:0/2677580570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31fc003520 con 0x7f31fc004d40 2024-09-12T01:56:01.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.521+0000 7f321a480640 1 --2- 172.21.15.19:0/2677580570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32140b3760 0x7f31fc0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:01.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.521+0000 7f321ac81640 1 --2- 172.21.15.19:0/2677580570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31fc004d40 0x7f31fc0051c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f320400e350 tx=0x7f31fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f493310e04bcdd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:01.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.521+0000 7f321947e640 1 -- 172.21.15.19:0/2677580570 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3204009de0 con 0x7f31fc004d40 2024-09-12T01:56:01.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.521+0000 7f321947e640 1 -- 172.21.15.19:0/2677580570 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3204003b90 con 0x7f31fc004d40 2024-09-12T01:56:01.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.521+0000 7f321947e640 1 -- 172.21.15.19:0/2677580570 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3204004020 con 0x7f31fc004d40 2024-09-12T01:56:01.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.522+0000 7f321c6e4640 1 -- 172.21.15.19:0/2677580570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31fc004d40 msgr2=0x7f31fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.522+0000 7f321c6e4640 1 --2- 172.21.15.19:0/2677580570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31fc004d40 0x7f31fc0051c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f320400e350 tx=0x7f31fc005830 comp rx=0 tx=0).stop 2024-09-12T01:56:01.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.522+0000 7f321ac81640 1 -- 172.21.15.19:0/2677580570 reap_dead start 2024-09-12T01:56:01.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.522+0000 7f321c6e4640 1 -- 172.21.15.19:0/2677580570 shutdown_connections 2024-09-12T01:56:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.522+0000 7f321c6e4640 1 -- 172.21.15.19:0/2677580570 >> 172.21.15.19:0/2677580570 conn(0x7f32140d23a0 msgr2=0x7f32140d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.522+0000 7f321c6e4640 1 -- 172.21.15.19:0/2677580570 shutdown_connections 2024-09-12T01:56:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.522+0000 7f321c6e4640 1 -- 172.21.15.19:0/2677580570 wait complete. 2024-09-12T01:56:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.523+0000 7f321c6e4640 1 Processor -- start 2024-09-12T01:56:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.523+0000 7f321c6e4640 1 -- start start 2024-09-12T01:56:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.524+0000 7f321c6e4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31fc004d40 0x7f3214157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.524+0000 7f321c6e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32140b5b40 0x7f321415c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.524+0000 7f321c6e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32140b5fc0 0x7f3214160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.524+0000 7f321c6e4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f321415fe20 con 0x7f32140b5fc0 2024-09-12T01:56:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.524+0000 7f321c6e4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f321415fca0 con 0x7f31fc004d40 2024-09-12T01:56:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.524+0000 7f321c6e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f32140d1fe0 con 0x7f32140b5b40 2024-09-12T01:56:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.524+0000 7f321ac81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32140b5fc0 0x7f3214160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.524+0000 7f321ac81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32140b5fc0 0x7f3214160ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34964/0 (socket says 172.21.15.19:34964) 2024-09-12T01:56:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.524+0000 7f321ac81640 1 -- 172.21.15.19:0/2166324524 learned_addr learned my addr 172.21.15.19:0/2166324524 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.524+0000 7f321a480640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31fc004d40 0x7f3214157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.524+0000 7f3219c7f640 1 --2- 172.21.15.19:0/2166324524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32140b5b40 0x7f321415c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.524+0000 7f321ac81640 1 -- 172.21.15.19:0/2166324524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32140b5b40 msgr2=0x7f321415c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.524+0000 7f321ac81640 1 --2- 172.21.15.19:0/2166324524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32140b5b40 0x7f321415c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.524+0000 7f321ac81640 1 -- 172.21.15.19:0/2166324524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31fc004d40 msgr2=0x7f3214157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.524+0000 7f321ac81640 1 --2- 172.21.15.19:0/2166324524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31fc004d40 0x7f3214157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.524+0000 7f321ac81640 1 -- 172.21.15.19:0/2166324524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3214162920 con 0x7f32140b5fc0 2024-09-12T01:56:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.525+0000 7f321ac81640 1 --2- 172.21.15.19:0/2166324524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32140b5fc0 0x7f3214160ce0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f320400e470 tx=0x7f3204009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.525+0000 7f3212ffd640 1 -- 172.21.15.19:0/2166324524 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3204046070 con 0x7f32140b5fc0 2024-09-12T01:56:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.525+0000 7f3212ffd640 1 -- 172.21.15.19:0/2166324524 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3204036400 con 0x7f32140b5fc0 2024-09-12T01:56:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.525+0000 7f3212ffd640 1 -- 172.21.15.19:0/2166324524 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c007d70 con 0x7f32140b5fc0 2024-09-12T01:56:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.525+0000 7f321c6e4640 1 -- 172.21.15.19:0/2166324524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3214162c00 con 0x7f32140b5fc0 2024-09-12T01:56:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.525+0000 7f321c6e4640 1 -- 172.21.15.19:0/2166324524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3214157ed0 con 0x7f32140b5fc0 2024-09-12T01:56:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.526+0000 7f321c6e4640 1 -- 172.21.15.19:0/2166324524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32140b3cb0 con 0x7f32140b5fc0 2024-09-12T01:56:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.526+0000 7f3212ffd640 1 -- 172.21.15.19:0/2166324524 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32040367d0 con 0x7f32140b5fc0 2024-09-12T01:56:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.527+0000 7f3212ffd640 1 --2- 172.21.15.19:0/2166324524 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f320006be60 0x7f320006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.527+0000 7f3212ffd640 1 -- 172.21.15.19:0/2166324524 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f32040ab9d0 con 0x7f32140b5fc0 2024-09-12T01:56:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.527+0000 7f321a480640 1 --2- 172.21.15.19:0/2166324524 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f320006be60 0x7f320006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.528+0000 7f321a480640 1 --2- 172.21.15.19:0/2166324524 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f320006be60 0x7f320006e320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3214158920 tx=0x7f320c007970 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:01.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.531+0000 7f3212ffd640 1 -- 172.21.15.19:0/2166324524 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3204032030 con 0x7f32140b5fc0 2024-09-12T01:56:01.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.712+0000 7f321c6e4640 1 -- 172.21.15.19:0/2166324524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32140b8320 con 0x7f32140b5fc0 2024-09-12T01:56:01.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.713+0000 7f3212ffd640 1 -- 172.21.15.19:0/2166324524 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18599 (secure 0 0 0) 0x7f3204079a80 con 0x7f32140b5fc0 2024-09-12T01:56:01.713 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:01.713 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":26,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:56:00.073321+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:52.899670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:54.099981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:55:57.729901+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:01.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.715+0000 7f321c6e4640 1 -- 172.21.15.19:0/2166324524 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f320006be60 msgr2=0x7f320006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.715+0000 7f321c6e4640 1 --2- 172.21.15.19:0/2166324524 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f320006be60 0x7f320006e320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3214158920 tx=0x7f320c007970 comp rx=0 tx=0).stop 2024-09-12T01:56:01.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.715+0000 7f321c6e4640 1 -- 172.21.15.19:0/2166324524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32140b5fc0 msgr2=0x7f3214160ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.715+0000 7f321c6e4640 1 --2- 172.21.15.19:0/2166324524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32140b5fc0 0x7f3214160ce0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f320400e470 tx=0x7f3204009750 comp rx=0 tx=0).stop 2024-09-12T01:56:01.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.715+0000 7f321c6e4640 1 -- 172.21.15.19:0/2166324524 shutdown_connections 2024-09-12T01:56:01.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.715+0000 7f321c6e4640 1 --2- 172.21.15.19:0/2166324524 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f320006be60 0x7f320006e320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.715+0000 7f321c6e4640 1 --2- 172.21.15.19:0/2166324524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32140b5fc0 0x7f3214160ce0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.715+0000 7f321c6e4640 1 --2- 172.21.15.19:0/2166324524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32140b5b40 0x7f321415c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.715+0000 7f321c6e4640 1 --2- 172.21.15.19:0/2166324524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31fc004d40 0x7f3214157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.715+0000 7f321c6e4640 1 -- 172.21.15.19:0/2166324524 >> 172.21.15.19:0/2166324524 conn(0x7f32140d23a0 msgr2=0x7f321415aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:01.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.715+0000 7f321c6e4640 1 -- 172.21.15.19:0/2166324524 shutdown_connections 2024-09-12T01:56:01.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.715+0000 7f321c6e4640 1 -- 172.21.15.19:0/2166324524 wait complete. 2024-09-12T01:56:01.742 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:56:01.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.843+0000 7f10bfd13640 1 Processor -- start 2024-09-12T01:56:01.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.844+0000 7f10bfd13640 1 -- start start 2024-09-12T01:56:01.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.844+0000 7f10bfd13640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10b815e5b0 0x7f10b80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.844+0000 7f10bfd13640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f10b815e990 0x7f10b80b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.844+0000 7f10bfd13640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f10b80ae140 0x7f10b80ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.844+0000 7f10bfd13640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f10b80aeb30 con 0x7f10b80ae140 2024-09-12T01:56:01.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.844+0000 7f10bfd13640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f10b80b6520 con 0x7f10b815e990 2024-09-12T01:56:01.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.844+0000 7f10bfd13640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f10b80b1a40 con 0x7f10b815e5b0 2024-09-12T01:56:01.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.845+0000 7f10be2b0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f10b80ae140 0x7f10b80ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.845+0000 7f10be2b0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f10b80ae140 0x7f10b80ae5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34976/0 (socket says 172.21.15.19:34976) 2024-09-12T01:56:01.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.845+0000 7f10be2b0640 1 -- 172.21.15.19:0/880504066 learned_addr learned my addr 172.21.15.19:0/880504066 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:01.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.845+0000 7f10bdaaf640 1 --2- 172.21.15.19:0/880504066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10b815e5b0 0x7f10b80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.845+0000 7f10bd2ae640 1 --2- 172.21.15.19:0/880504066 >> v2:172.21.15.135:3300/0 conn(0x7f10b815e990 0x7f10b80b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.845+0000 7f10be2b0640 1 -- 172.21.15.19:0/880504066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10b815e5b0 msgr2=0x7f10b80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:01.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.845+0000 7f10be2b0640 1 --2- 172.21.15.19:0/880504066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10b815e5b0 0x7f10b80b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.845+0000 7f10be2b0640 1 -- 172.21.15.19:0/880504066 >> v2:172.21.15.135:3300/0 conn(0x7f10b815e990 msgr2=0x7f10b80b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:01.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.845+0000 7f10be2b0640 1 --2- 172.21.15.19:0/880504066 >> v2:172.21.15.135:3300/0 conn(0x7f10b815e990 0x7f10b80b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.845+0000 7f10be2b0640 1 -- 172.21.15.19:0/880504066 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b80b1d20 con 0x7f10b80ae140 2024-09-12T01:56:01.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.846+0000 7f10be2b0640 1 --2- 172.21.15.19:0/880504066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10b80ae140 0x7f10b80ae5f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f10b8068930 tx=0x7f10b002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab8501e2a493efa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:01.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.846+0000 7f10bcaad640 1 -- 172.21.15.19:0/880504066 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b0036070 con 0x7f10b80ae140 2024-09-12T01:56:01.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.846+0000 7f10bcaad640 1 -- 172.21.15.19:0/880504066 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b0031600 con 0x7f10b80ae140 2024-09-12T01:56:01.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.846+0000 7f10bcaad640 1 -- 172.21.15.19:0/880504066 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b00319d0 con 0x7f10b80ae140 2024-09-12T01:56:01.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.846+0000 7f10bfd13640 1 -- 172.21.15.19:0/880504066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10b80ae140 msgr2=0x7f10b80ae5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.846+0000 7f10bfd13640 1 --2- 172.21.15.19:0/880504066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10b80ae140 0x7f10b80ae5f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f10b8068930 tx=0x7f10b002a6a0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.846+0000 7f10bfd13640 1 -- 172.21.15.19:0/880504066 shutdown_connections 2024-09-12T01:56:01.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.846+0000 7f10bfd13640 1 --2- 172.21.15.19:0/880504066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10b80ae140 0x7f10b80ae5f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.846+0000 7f10bfd13640 1 --2- 172.21.15.19:0/880504066 >> v2:172.21.15.135:3300/0 conn(0x7f10b815e990 0x7f10b80b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.846+0000 7f10bfd13640 1 --2- 172.21.15.19:0/880504066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10b815e5b0 0x7f10b80b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.846+0000 7f10bfd13640 1 -- 172.21.15.19:0/880504066 >> 172.21.15.19:0/880504066 conn(0x7f10b8073490 msgr2=0x7f10b80b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:01.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.846+0000 7f10bfd13640 1 -- 172.21.15.19:0/880504066 shutdown_connections 2024-09-12T01:56:01.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.846+0000 7f10bfd13640 1 -- 172.21.15.19:0/880504066 wait complete. 2024-09-12T01:56:01.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.848+0000 7f10bfd13640 1 Processor -- start 2024-09-12T01:56:01.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.848+0000 7f10bfd13640 1 -- start start 2024-09-12T01:56:01.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.848+0000 7f10bfd13640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10b80ae140 0x7f10b814ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.848+0000 7f10bfd13640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10b815e5b0 0x7f10b80ce650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.848+0000 7f10bfd13640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10b815e990 0x7f10b809b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.848+0000 7f10bfd13640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f10b80b2a60 con 0x7f10b815e990 2024-09-12T01:56:01.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.848+0000 7f10bfd13640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f10b80b0490 con 0x7f10b80ae140 2024-09-12T01:56:01.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.848+0000 7f10bfd13640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f10b80b2be0 con 0x7f10b815e5b0 2024-09-12T01:56:01.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.849+0000 7f10be2b0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10b815e990 0x7f10b809b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.849+0000 7f10be2b0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10b815e990 0x7f10b809b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34978/0 (socket says 172.21.15.19:34978) 2024-09-12T01:56:01.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.849+0000 7f10be2b0640 1 -- 172.21.15.19:0/1237807202 learned_addr learned my addr 172.21.15.19:0/1237807202 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:01.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.849+0000 7f10bdaaf640 1 --2- 172.21.15.19:0/1237807202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10b80ae140 0x7f10b814ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.849+0000 7f10bd2ae640 1 --2- 172.21.15.19:0/1237807202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10b815e5b0 0x7f10b80ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.849+0000 7f10be2b0640 1 -- 172.21.15.19:0/1237807202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10b815e5b0 msgr2=0x7f10b80ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.849+0000 7f10be2b0640 1 --2- 172.21.15.19:0/1237807202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10b815e5b0 0x7f10b80ce650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.849+0000 7f10be2b0640 1 -- 172.21.15.19:0/1237807202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10b80ae140 msgr2=0x7f10b814ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.849+0000 7f10be2b0640 1 --2- 172.21.15.19:0/1237807202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10b80ae140 0x7f10b814ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.849+0000 7f10be2b0640 1 -- 172.21.15.19:0/1237807202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b814f290 con 0x7f10b815e990 2024-09-12T01:56:01.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.849+0000 7f10be2b0640 1 --2- 172.21.15.19:0/1237807202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10b815e990 0x7f10b809b2c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009f40 tx=0x7f10b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:01.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.849+0000 7f10ae7fc640 1 -- 172.21.15.19:0/1237807202 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b0036050 con 0x7f10b815e990 2024-09-12T01:56:01.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.849+0000 7f10ae7fc640 1 -- 172.21.15.19:0/1237807202 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b0042070 con 0x7f10b815e990 2024-09-12T01:56:01.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.849+0000 7f10bfd13640 1 -- 172.21.15.19:0/1237807202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b809d330 con 0x7f10b815e990 2024-09-12T01:56:01.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.849+0000 7f10ae7fc640 1 -- 172.21.15.19:0/1237807202 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b0009510 con 0x7f10b815e990 2024-09-12T01:56:01.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.849+0000 7f10bfd13640 1 -- 172.21.15.19:0/1237807202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b809d8f0 con 0x7f10b815e990 2024-09-12T01:56:01.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.850+0000 7f10bfd13640 1 -- 172.21.15.19:0/1237807202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b8068e10 con 0x7f10b815e990 2024-09-12T01:56:01.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.851+0000 7f10ae7fc640 1 -- 172.21.15.19:0/1237807202 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f10b0007bd0 con 0x7f10b815e990 2024-09-12T01:56:01.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.851+0000 7f10ae7fc640 1 --2- 172.21.15.19:0/1237807202 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f109c06be30 0x7f109c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.851+0000 7f10ae7fc640 1 -- 172.21.15.19:0/1237807202 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f10b00abe40 con 0x7f10b815e990 2024-09-12T01:56:01.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.851+0000 7f10bdaaf640 1 --2- 172.21.15.19:0/1237807202 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f109c06be30 0x7f109c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.852+0000 7f10bdaaf640 1 --2- 172.21.15.19:0/1237807202 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f109c06be30 0x7f109c06e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f10b4006fd0 tx=0x7f10b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:01.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:01.855+0000 7f10ae7fc640 1 -- 172.21.15.19:0/1237807202 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f10b8068e10 con 0x7f10b815e990 2024-09-12T01:56:02.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.069+0000 7f10bfd13640 1 -- 172.21.15.19:0/1237807202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10b8070470 con 0x7f10b815e990 2024-09-12T01:56:02.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.069+0000 7f10ae7fc640 1 -- 172.21.15.19:0/1237807202 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5225 (secure 0 0 0) 0x7f10b0079ef0 con 0x7f10b815e990 2024-09-12T01:56:02.070 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:02.070 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"btime":"2024-09-12T01:56:00:738411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4024559276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":4024559276},{"type":"v1","addr":"172.21.15.135:6837","nonce":4024559276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3369866614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3369866614},{"type":"v1","addr":"172.21.15.19:6834","nonce":3369866614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2476634027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2476634027},{"type":"v1","addr":"172.21.15.19:6835","nonce":2476634027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:55:55.036100+0000","modified":"2024-09-12T01:56:00.073514+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/4290669195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4290669195},{"type":"v1","addr":"172.21.15.135:6836","nonce":4290669195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-09-12T01:56:02.070 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-09-12T01:56:02.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.071+0000 7f10bfd13640 1 -- 172.21.15.19:0/1237807202 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f109c06be30 msgr2=0x7f109c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.071+0000 7f10bfd13640 1 --2- 172.21.15.19:0/1237807202 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f109c06be30 0x7f109c06e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f10b4006fd0 tx=0x7f10b4008040 comp rx=0 tx=0).stop 2024-09-12T01:56:02.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.071+0000 7f10bfd13640 1 -- 172.21.15.19:0/1237807202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10b815e990 msgr2=0x7f10b809b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.071+0000 7f10bfd13640 1 --2- 172.21.15.19:0/1237807202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10b815e990 0x7f10b809b2c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009f40 tx=0x7f10b0004a40 comp rx=0 tx=0).stop 2024-09-12T01:56:02.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.071+0000 7f10bfd13640 1 -- 172.21.15.19:0/1237807202 shutdown_connections 2024-09-12T01:56:02.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.071+0000 7f10bfd13640 1 --2- 172.21.15.19:0/1237807202 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f109c06be30 0x7f109c06e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.071+0000 7f10bfd13640 1 --2- 172.21.15.19:0/1237807202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10b815e990 0x7f10b809b2c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.071+0000 7f10bfd13640 1 --2- 172.21.15.19:0/1237807202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10b815e5b0 0x7f10b80ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.071+0000 7f10bfd13640 1 --2- 172.21.15.19:0/1237807202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10b80ae140 0x7f10b814ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.071+0000 7f10bfd13640 1 -- 172.21.15.19:0/1237807202 >> 172.21.15.19:0/1237807202 conn(0x7f10b8073490 msgr2=0x7f10b80aecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:02.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.071+0000 7f10bfd13640 1 -- 172.21.15.19:0/1237807202 shutdown_connections 2024-09-12T01:56:02.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.071+0000 7f10bfd13640 1 -- 172.21.15.19:0/1237807202 wait complete. 2024-09-12T01:56:02.082 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:56:02.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.183+0000 7fbc4f43c640 1 Processor -- start 2024-09-12T01:56:02.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.183+0000 7fbc4f43c640 1 -- start start 2024-09-12T01:56:02.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.184+0000 7fbc4f43c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbc480ae140 0x7fbc4815ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.184+0000 7fbc4f43c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc480b3570 con 0x7fbc48145bc0 2024-09-12T01:56:02.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.184+0000 7fbc4f43c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc480b3850 con 0x7fbc4806c320 2024-09-12T01:56:02.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.184+0000 7fbc4f43c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fbc480b3b30 con 0x7fbc480ae140 2024-09-12T01:56:02.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.184+0000 7fbc4d1d8640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbc48145bc0 0x7fbc4806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48644/0 (socket says 172.21.15.19:48644) 2024-09-12T01:56:02.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.184+0000 7fbc4d1d8640 1 -- 172.21.15.19:0/3810115308 learned_addr learned my addr 172.21.15.19:0/3810115308 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:02.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc47fff640 1 -- 172.21.15.19:0/3810115308 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 675701782 0 0) 0x7fbc480b3570 con 0x7fbc48145bc0 2024-09-12T01:56:02.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc4d9d9640 1 --2- 172.21.15.19:0/3810115308 >> v2:172.21.15.135:3300/0 conn(0x7fbc480ae140 0x7fbc4815ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc47fff640 1 -- 172.21.15.19:0/3810115308 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc30003520 con 0x7fbc48145bc0 2024-09-12T01:56:02.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc47fff640 1 -- 172.21.15.19:0/3810115308 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4076055035 0 0) 0x7fbc30003520 con 0x7fbc48145bc0 2024-09-12T01:56:02.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc47fff640 1 -- 172.21.15.19:0/3810115308 >> v2:172.21.15.135:3300/0 conn(0x7fbc480ae140 msgr2=0x7fbc4815ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:02.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc47fff640 1 --2- 172.21.15.19:0/3810115308 >> v2:172.21.15.135:3300/0 conn(0x7fbc480ae140 0x7fbc4815ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc47fff640 1 -- 172.21.15.19:0/3810115308 >> v1:172.21.15.135:6789/0 conn(0x7fbc4806c320 legacy=0x7fbc480af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc47fff640 1 -- 172.21.15.19:0/3810115308 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc480b1610 con 0x7fbc48145bc0 2024-09-12T01:56:02.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc47fff640 1 -- 172.21.15.19:0/3810115308 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fbc380019f0 con 0x7fbc48145bc0 2024-09-12T01:56:02.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc47fff640 1 -- 172.21.15.19:0/3810115308 >> v1:172.21.15.19:6789/0 conn(0x7fbc48145bc0 legacy=0x7fbc4806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc47fff640 1 --2- 172.21.15.19:0/3810115308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc300039b0 0x7fbc30003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc47fff640 1 --2- 172.21.15.19:0/3810115308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc30004800 0x7fbc30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc47fff640 1 --2- 172.21.15.19:0/3810115308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc300051c0 0x7fbc3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc47fff640 1 -- 172.21.15.19:0/3810115308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbc480b3b30 con 0x7fbc300051c0 2024-09-12T01:56:02.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc47fff640 1 -- 172.21.15.19:0/3810115308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3000c070 con 0x7fbc30004800 2024-09-12T01:56:02.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc47fff640 1 -- 172.21.15.19:0/3810115308 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbc3000c270 con 0x7fbc300039b0 2024-09-12T01:56:02.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc4d9d9640 1 --2- 172.21.15.19:0/3810115308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc300051c0 0x7fbc3000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc4d1d8640 1 --2- 172.21.15.19:0/3810115308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc300039b0 0x7fbc30003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc4c9d7640 1 --2- 172.21.15.19:0/3810115308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc30004800 0x7fbc30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc4d9d9640 1 -- 172.21.15.19:0/3810115308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc300039b0 msgr2=0x7fbc30003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:02.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc4d9d9640 1 --2- 172.21.15.19:0/3810115308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc300039b0 0x7fbc30003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc4d9d9640 1 -- 172.21.15.19:0/3810115308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc30004800 msgr2=0x7fbc30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:02.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc4d9d9640 1 --2- 172.21.15.19:0/3810115308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc30004800 0x7fbc30004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc4d9d9640 1 -- 172.21.15.19:0/3810115308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc30003520 con 0x7fbc300051c0 2024-09-12T01:56:02.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc4d1d8640 1 --2- 172.21.15.19:0/3810115308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc300039b0 0x7fbc30003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:02.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.185+0000 7fbc4c9d7640 1 --2- 172.21.15.19:0/3810115308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc30004800 0x7fbc30004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:02.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.186+0000 7fbc4d9d9640 1 -- 172.21.15.19:0/3810115308 reap_dead start 2024-09-12T01:56:02.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.186+0000 7fbc4d9d9640 1 --2- 172.21.15.19:0/3810115308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc300051c0 0x7fbc3000b9c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009ac0 tx=0x7fbc30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8777998edc28a530 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:02.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.186+0000 7fbc47fff640 1 -- 172.21.15.19:0/3810115308 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40009690 con 0x7fbc300051c0 2024-09-12T01:56:02.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.186+0000 7fbc47fff640 1 -- 172.21.15.19:0/3810115308 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc40004020 con 0x7fbc300051c0 2024-09-12T01:56:02.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.186+0000 7fbc47fff640 1 -- 172.21.15.19:0/3810115308 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40004410 con 0x7fbc300051c0 2024-09-12T01:56:02.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.187+0000 7fbc4f43c640 1 -- 172.21.15.19:0/3810115308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc300051c0 msgr2=0x7fbc3000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.187+0000 7fbc4f43c640 1 --2- 172.21.15.19:0/3810115308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc300051c0 0x7fbc3000b9c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009ac0 tx=0x7fbc30005830 comp rx=0 tx=0).stop 2024-09-12T01:56:02.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.187+0000 7fbc4f43c640 1 -- 172.21.15.19:0/3810115308 shutdown_connections 2024-09-12T01:56:02.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.187+0000 7fbc4f43c640 1 --2- 172.21.15.19:0/3810115308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc300051c0 0x7fbc3000b9c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.187+0000 7fbc4f43c640 1 -- 172.21.15.19:0/3810115308 >> 172.21.15.19:0/3810115308 conn(0x7fbc48073490 msgr2=0x7fbc480b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:02.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.187+0000 7fbc4f43c640 1 -- 172.21.15.19:0/3810115308 shutdown_connections 2024-09-12T01:56:02.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.187+0000 7fbc4f43c640 1 -- 172.21.15.19:0/3810115308 wait complete. 2024-09-12T01:56:02.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.188+0000 7fbc4f43c640 1 Processor -- start 2024-09-12T01:56:02.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.188+0000 7fbc4f43c640 1 -- start start 2024-09-12T01:56:02.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.189+0000 7fbc4f43c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc300051c0 0x7fbc4813fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.189+0000 7fbc4f43c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc4815bad0 0x7fbc4815d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.189+0000 7fbc4f43c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4815d560 0x7fbc481f1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.189+0000 7fbc4f43c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbc48145fa0 con 0x7fbc4815d560 2024-09-12T01:56:02.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.189+0000 7fbc4f43c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4809aa30 con 0x7fbc4815bad0 2024-09-12T01:56:02.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.189+0000 7fbc4f43c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbc48141d90 con 0x7fbc300051c0 2024-09-12T01:56:02.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.189+0000 7fbc4d9d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4815d560 0x7fbc481f1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.189+0000 7fbc4d9d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4815d560 0x7fbc481f1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35006/0 (socket says 172.21.15.19:35006) 2024-09-12T01:56:02.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.189+0000 7fbc4d9d9640 1 -- 172.21.15.19:0/1887953751 learned_addr learned my addr 172.21.15.19:0/1887953751 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:02.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.189+0000 7fbc4c9d7640 1 --2- 172.21.15.19:0/1887953751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc4815bad0 0x7fbc4815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.189+0000 7fbc4d1d8640 1 --2- 172.21.15.19:0/1887953751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc300051c0 0x7fbc4813fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.189+0000 7fbc4d9d9640 1 -- 172.21.15.19:0/1887953751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc300051c0 msgr2=0x7fbc4813fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.189+0000 7fbc4d9d9640 1 --2- 172.21.15.19:0/1887953751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc300051c0 0x7fbc4813fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.189+0000 7fbc4d9d9640 1 -- 172.21.15.19:0/1887953751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc4815bad0 msgr2=0x7fbc4815d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.189+0000 7fbc4d9d9640 1 --2- 172.21.15.19:0/1887953751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc4815bad0 0x7fbc4815d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.189+0000 7fbc4d9d9640 1 -- 172.21.15.19:0/1887953751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc481f12f0 con 0x7fbc4815d560 2024-09-12T01:56:02.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.189+0000 7fbc4c9d7640 1 --2- 172.21.15.19:0/1887953751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc4815bad0 0x7fbc4815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:02.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.190+0000 7fbc4d9d9640 1 --2- 172.21.15.19:0/1887953751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4815d560 0x7fbc481f1dd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbc4002abe0 tx=0x7fbc40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:02.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.190+0000 7fbc45ffb640 1 -- 172.21.15.19:0/1887953751 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40003e20 con 0x7fbc4815d560 2024-09-12T01:56:02.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.190+0000 7fbc45ffb640 1 -- 172.21.15.19:0/1887953751 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc40040070 con 0x7fbc4815d560 2024-09-12T01:56:02.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.190+0000 7fbc4f43c640 1 -- 172.21.15.19:0/1887953751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc481f15d0 con 0x7fbc4815d560 2024-09-12T01:56:02.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.190+0000 7fbc45ffb640 1 -- 172.21.15.19:0/1887953751 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4003a470 con 0x7fbc4815d560 2024-09-12T01:56:02.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.190+0000 7fbc4f43c640 1 -- 172.21.15.19:0/1887953751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc4815c2e0 con 0x7fbc4815d560 2024-09-12T01:56:02.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.191+0000 7fbc4f43c640 1 -- 172.21.15.19:0/1887953751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc48067e50 con 0x7fbc4815d560 2024-09-12T01:56:02.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.192+0000 7fbc45ffb640 1 -- 172.21.15.19:0/1887953751 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc4003a610 con 0x7fbc4815d560 2024-09-12T01:56:02.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.192+0000 7fbc45ffb640 1 --2- 172.21.15.19:0/1887953751 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbc3406be30 0x7fbc3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.192+0000 7fbc45ffb640 1 -- 172.21.15.19:0/1887953751 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fbc400ab330 con 0x7fbc4815d560 2024-09-12T01:56:02.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.192+0000 7fbc4d1d8640 1 --2- 172.21.15.19:0/1887953751 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbc3406be30 0x7fbc3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.193+0000 7fbc4d1d8640 1 --2- 172.21.15.19:0/1887953751 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbc3406be30 0x7fbc3406e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbc38002230 tx=0x7fbc38002040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:02.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.196+0000 7fbc45ffb640 1 -- 172.21.15.19:0/1887953751 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc48067e50 con 0x7fbc4815d560 2024-09-12T01:56:02.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.374+0000 7fbc4f43c640 1 -- 172.21.15.19:0/1887953751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc48143710 con 0x7fbc4815d560 2024-09-12T01:56:02.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.375+0000 7fbc45ffb640 1 -- 172.21.15.19:0/1887953751 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18586 (secure 0 0 0) 0x7fbc400799a0 con 0x7fbc4815d560 2024-09-12T01:56:02.375 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:02.375 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:56:01.739727+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:52.899670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:54.099981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:55:57.729901+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:02.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.377+0000 7fbc4f43c640 1 -- 172.21.15.19:0/1887953751 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbc3406be30 msgr2=0x7fbc3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.377+0000 7fbc4f43c640 1 --2- 172.21.15.19:0/1887953751 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbc3406be30 0x7fbc3406e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbc38002230 tx=0x7fbc38002040 comp rx=0 tx=0).stop 2024-09-12T01:56:02.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.377+0000 7fbc4f43c640 1 -- 172.21.15.19:0/1887953751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4815d560 msgr2=0x7fbc481f1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.377+0000 7fbc4f43c640 1 --2- 172.21.15.19:0/1887953751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4815d560 0x7fbc481f1dd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbc4002abe0 tx=0x7fbc40004730 comp rx=0 tx=0).stop 2024-09-12T01:56:02.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.377+0000 7fbc4f43c640 1 -- 172.21.15.19:0/1887953751 shutdown_connections 2024-09-12T01:56:02.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.377+0000 7fbc4f43c640 1 --2- 172.21.15.19:0/1887953751 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbc3406be30 0x7fbc3406e2f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.377+0000 7fbc4f43c640 1 --2- 172.21.15.19:0/1887953751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4815d560 0x7fbc481f1dd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.377+0000 7fbc4f43c640 1 --2- 172.21.15.19:0/1887953751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc4815bad0 0x7fbc4815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.377+0000 7fbc4f43c640 1 --2- 172.21.15.19:0/1887953751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc300051c0 0x7fbc4813fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.377+0000 7fbc4f43c640 1 -- 172.21.15.19:0/1887953751 >> 172.21.15.19:0/1887953751 conn(0x7fbc48073490 msgr2=0x7fbc48142b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:02.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.377+0000 7fbc4f43c640 1 -- 172.21.15.19:0/1887953751 shutdown_connections 2024-09-12T01:56:02.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.377+0000 7fbc4f43c640 1 -- 172.21.15.19:0/1887953751 wait complete. 2024-09-12T01:56:02.791 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:55:55.036100+0000', 'modified': '2024-09-12T01:56:00.073514+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6836/4290669195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 4290669195}, {'type': 'v1', 'addr': '172.21.15.135:6836', 'nonce': 4290669195}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4282, 'qdb_cluster': [4282]} 2024-09-12T01:56:02.791 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:56:02.791 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T01:56:02.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.897+0000 7f60a04dd640 1 Processor -- start 2024-09-12T01:56:02.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.897+0000 7f60a04dd640 1 -- start start 2024-09-12T01:56:02.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.898+0000 7f60a04dd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f60980d4fd0 0x7f609806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.898+0000 7f60a04dd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60980d2700 con 0x7f60980cfcc0 2024-09-12T01:56:02.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.898+0000 7f60a04dd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60980cedb0 con 0x7f609815e760 2024-09-12T01:56:02.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.898+0000 7f60a04dd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f60980cf090 con 0x7f60980d4fd0 2024-09-12T01:56:02.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.898+0000 7f609ea7a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f60980d4fd0 0x7f609806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.898+0000 7f609ea7a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f60980d4fd0 0x7f609806cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35020/0 (socket says 172.21.15.19:35020) 2024-09-12T01:56:02.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.898+0000 7f609da78640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f60980cfcc0 0x7f60980d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48658/0 (socket says 172.21.15.19:48658) 2024-09-12T01:56:02.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.898+0000 7f609ea7a640 1 -- 172.21.15.19:0/3520545727 learned_addr learned my addr 172.21.15.19:0/3520545727 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:02.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.898+0000 7f609ea7a640 1 -- 172.21.15.19:0/3520545727 >> v1:172.21.15.135:6789/0 conn(0x7f609815e760 legacy=0x7f60980cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:02.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.898+0000 7f609ea7a640 1 -- 172.21.15.19:0/3520545727 >> v1:172.21.15.19:6789/0 conn(0x7f60980cfcc0 legacy=0x7f60980d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.898+0000 7f609d277640 1 -- 172.21.15.19:0/3520545727 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1970169019 0 0) 0x7f60880011d0 con 0x7f60980cfcc0 2024-09-12T01:56:02.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.898+0000 7f609ea7a640 1 -- 172.21.15.19:0/3520545727 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60980b3c80 con 0x7f60980d4fd0 2024-09-12T01:56:02.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.899+0000 7f609ea7a640 1 --2- 172.21.15.19:0/3520545727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60980d4fd0 0x7f609806cdd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6090009e50 tx=0x7f609002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67db8714db963c33 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:02.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.899+0000 7f609d277640 1 -- 172.21.15.19:0/3520545727 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090036070 con 0x7f60980d4fd0 2024-09-12T01:56:02.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.899+0000 7f609d277640 1 -- 172.21.15.19:0/3520545727 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6090031600 con 0x7f60980d4fd0 2024-09-12T01:56:02.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.899+0000 7f609d277640 1 -- 172.21.15.19:0/3520545727 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60900319f0 con 0x7f60980d4fd0 2024-09-12T01:56:02.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.899+0000 7f60a04dd640 1 -- 172.21.15.19:0/3520545727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60980d4fd0 msgr2=0x7f609806cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.900+0000 7f60a04dd640 1 --2- 172.21.15.19:0/3520545727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60980d4fd0 0x7f609806cdd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6090009e50 tx=0x7f609002a7c0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.900+0000 7f60a04dd640 1 -- 172.21.15.19:0/3520545727 shutdown_connections 2024-09-12T01:56:02.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.900+0000 7f60a04dd640 1 --2- 172.21.15.19:0/3520545727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60980d4fd0 0x7f609806cdd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.900+0000 7f60a04dd640 1 -- 172.21.15.19:0/3520545727 >> 172.21.15.19:0/3520545727 conn(0x7f609808bfc0 msgr2=0x7f60980d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:02.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.900+0000 7f60a04dd640 1 -- 172.21.15.19:0/3520545727 shutdown_connections 2024-09-12T01:56:02.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.900+0000 7f60a04dd640 1 -- 172.21.15.19:0/3520545727 wait complete. 2024-09-12T01:56:02.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.901+0000 7f60a04dd640 1 Processor -- start 2024-09-12T01:56:02.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.901+0000 7f60a04dd640 1 -- start start 2024-09-12T01:56:02.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f60a04dd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60980cfcc0 0x7f609814b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f60a04dd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60980d4fd0 0x7f60980cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f60a04dd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609815e760 0x7f60980cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f60a04dd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f60980d35b0 con 0x7f609815e760 2024-09-12T01:56:02.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f60a04dd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f60980b3920 con 0x7f60980cfcc0 2024-09-12T01:56:02.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f60a04dd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f60980d3730 con 0x7f60980d4fd0 2024-09-12T01:56:02.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f609ea7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609815e760 0x7f60980cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f609ea7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609815e760 0x7f60980cc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35022/0 (socket says 172.21.15.19:35022) 2024-09-12T01:56:02.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f609ea7a640 1 -- 172.21.15.19:0/183323224 learned_addr learned my addr 172.21.15.19:0/183323224 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:02.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f609da78640 1 --2- 172.21.15.19:0/183323224 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60980d4fd0 0x7f60980cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f609e279640 1 --2- 172.21.15.19:0/183323224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60980cfcc0 0x7f609814b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f609ea7a640 1 -- 172.21.15.19:0/183323224 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60980d4fd0 msgr2=0x7f60980cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f609ea7a640 1 --2- 172.21.15.19:0/183323224 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60980d4fd0 0x7f60980cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f609ea7a640 1 -- 172.21.15.19:0/183323224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60980cfcc0 msgr2=0x7f609814b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f609ea7a640 1 --2- 172.21.15.19:0/183323224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60980cfcc0 0x7f609814b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f609ea7a640 1 -- 172.21.15.19:0/183323224 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6098161560 con 0x7f609815e760 2024-09-12T01:56:02.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f609e279640 1 --2- 172.21.15.19:0/183323224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60980cfcc0 0x7f609814b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:02.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f609ea7a640 1 --2- 172.21.15.19:0/183323224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609815e760 0x7f60980cc920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f609002adb0 tx=0x7f6090004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:02.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f608effd640 1 -- 172.21.15.19:0/183323224 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090036050 con 0x7f609815e760 2024-09-12T01:56:02.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f608effd640 1 -- 172.21.15.19:0/183323224 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6090042070 con 0x7f609815e760 2024-09-12T01:56:02.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f60a04dd640 1 -- 172.21.15.19:0/183323224 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60980ba220 con 0x7f609815e760 2024-09-12T01:56:02.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.902+0000 7f608effd640 1 -- 172.21.15.19:0/183323224 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090009510 con 0x7f609815e760 2024-09-12T01:56:02.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.903+0000 7f60a04dd640 1 -- 172.21.15.19:0/183323224 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6098161ae0 con 0x7f609815e760 2024-09-12T01:56:02.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.904+0000 7f608effd640 1 -- 172.21.15.19:0/183323224 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6090004470 con 0x7f609815e760 2024-09-12T01:56:02.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.905+0000 7f608effd640 1 --2- 172.21.15.19:0/183323224 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f607c06be30 0x7f607c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.905+0000 7f608effd640 1 -- 172.21.15.19:0/183323224 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f60900abdd0 con 0x7f609815e760 2024-09-12T01:56:02.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.905+0000 7f609e279640 1 --2- 172.21.15.19:0/183323224 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f607c06be30 0x7f607c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.906+0000 7f609e279640 1 --2- 172.21.15.19:0/183323224 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f607c06be30 0x7f607c06e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6094007fd0 tx=0x7f6094009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:02.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.906+0000 7f60a327b740 1 Processor -- start 2024-09-12T01:56:02.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.906+0000 7f60a327b740 1 -- start start 2024-09-12T01:56:02.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.907+0000 7f60a327b740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a537e2c0 0x5617a53c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.907+0000 7f60a327b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a537ba80 0x5617a537e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.907+0000 7f60a327b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537fa50 0x5617a53788b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.907+0000 7f60a327b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5617a52e0520 con 0x5617a537ba80 2024-09-12T01:56:02.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.907+0000 7f60a327b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5617a52883e0 con 0x5617a537fa50 2024-09-12T01:56:02.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.907+0000 7f60a327b740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5617a52dc4e0 con 0x5617a537e2c0 2024-09-12T01:56:02.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.907+0000 7f609da78640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a537ba80 0x5617a537e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.907+0000 7f609da78640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a537ba80 0x5617a537e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35024/0 (socket says 172.21.15.19:35024) 2024-09-12T01:56:02.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.907+0000 7f609da78640 1 -- 172.21.15.19:0/1220895504 learned_addr learned my addr 172.21.15.19:0/1220895504 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:02.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.907+0000 7f609e279640 1 --2- 172.21.15.19:0/1220895504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a537e2c0 0x5617a53c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.907+0000 7f609ea7a640 1 --2- 172.21.15.19:0/1220895504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537fa50 0x5617a53788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.907+0000 7f609da78640 1 -- 172.21.15.19:0/1220895504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a537e2c0 msgr2=0x5617a53c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.907+0000 7f609da78640 1 --2- 172.21.15.19:0/1220895504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a537e2c0 0x5617a53c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.907+0000 7f609da78640 1 -- 172.21.15.19:0/1220895504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537fa50 msgr2=0x5617a53788b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.907+0000 7f609da78640 1 --2- 172.21.15.19:0/1220895504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537fa50 0x5617a53788b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.907+0000 7f609da78640 1 -- 172.21.15.19:0/1220895504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617a52a32f0 con 0x5617a537ba80 2024-09-12T01:56:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.907+0000 7f609ea7a640 1 --2- 172.21.15.19:0/1220895504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537fa50 0x5617a53788b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.907+0000 7f609e279640 1 --2- 172.21.15.19:0/1220895504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a537e2c0 0x5617a53c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.908+0000 7f609da78640 1 --2- 172.21.15.19:0/1220895504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a537ba80 0x5617a537e6a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6088001810 tx=0x7f6088001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50fa336570cd82b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.908+0000 7f607bfff640 1 -- 172.21.15.19:0/1220895504 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60880073a0 con 0x5617a537ba80 2024-09-12T01:56:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.908+0000 7f607bfff640 1 -- 172.21.15.19:0/1220895504 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6088018070 con 0x5617a537ba80 2024-09-12T01:56:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.908+0000 7f607bfff640 1 -- 172.21.15.19:0/1220895504 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60880057a0 con 0x5617a537ba80 2024-09-12T01:56:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.908+0000 7f60a327b740 1 -- 172.21.15.19:0/1220895504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a537ba80 msgr2=0x5617a537e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.908+0000 7f60a327b740 1 --2- 172.21.15.19:0/1220895504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a537ba80 0x5617a537e6a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6088001810 tx=0x7f6088001cd0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.908+0000 7f60a327b740 1 -- 172.21.15.19:0/1220895504 shutdown_connections 2024-09-12T01:56:02.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.908+0000 7f60a327b740 1 --2- 172.21.15.19:0/1220895504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537fa50 0x5617a53788b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.908+0000 7f60a327b740 1 --2- 172.21.15.19:0/1220895504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a537ba80 0x5617a537e6a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.908+0000 7f60a327b740 1 --2- 172.21.15.19:0/1220895504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a537e2c0 0x5617a53c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.908+0000 7f60a327b740 1 -- 172.21.15.19:0/1220895504 >> 172.21.15.19:0/1220895504 conn(0x5617a537aa80 msgr2=0x5617a53c2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:02.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.909+0000 7f60a327b740 1 -- 172.21.15.19:0/1220895504 shutdown_connections 2024-09-12T01:56:02.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.909+0000 7f60a327b740 1 -- 172.21.15.19:0/1220895504 wait complete. 2024-09-12T01:56:02.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.909+0000 7f60a327b740 1 -- start start 2024-09-12T01:56:02.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.909+0000 7f60a327b740 1 Processor -- start 2024-09-12T01:56:02.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.910+0000 7f60a327b740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a537e2c0 0x5617a53c0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.910+0000 7f60a327b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537fa50 0x5617a539e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.910+0000 7f60a327b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a53a0dc0 0x5617a53a1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.910+0000 7f60a327b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5617a5379f20 con 0x5617a53a0dc0 2024-09-12T01:56:02.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.910+0000 7f60a327b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5617a5269450 con 0x5617a537fa50 2024-09-12T01:56:02.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.910+0000 7f60a327b740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5617a53c4290 con 0x5617a537e2c0 2024-09-12T01:56:02.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.910+0000 7f60a327b740 10 client.0 _ll_register_callbacks cb 0x5617a4ff2ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:56:02.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.910+0000 7f609ea7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a53a0dc0 0x5617a53a1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.910+0000 7f609ea7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a53a0dc0 0x5617a53a1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35032/0 (socket says 172.21.15.19:35032) 2024-09-12T01:56:02.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.910+0000 7f609ea7a640 1 -- 172.21.15.19:0/4240374794 learned_addr learned my addr 172.21.15.19:0/4240374794 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:02.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.910+0000 7f609da78640 1 --2- 172.21.15.19:0/4240374794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537fa50 0x5617a539e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.910+0000 7f609e279640 1 --2- 172.21.15.19:0/4240374794 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a537e2c0 0x5617a53c0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f609ea7a640 1 -- 172.21.15.19:0/4240374794 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a537e2c0 msgr2=0x5617a53c0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:02.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f609ea7a640 1 --2- 172.21.15.19:0/4240374794 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a537e2c0 0x5617a53c0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f609ea7a640 1 -- 172.21.15.19:0/4240374794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537fa50 msgr2=0x5617a539e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:02.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f609ea7a640 1 --2- 172.21.15.19:0/4240374794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537fa50 0x5617a539e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f609ea7a640 1 -- 172.21.15.19:0/4240374794 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617a4ff32d0 con 0x5617a53a0dc0 2024-09-12T01:56:02.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f609ea7a640 1 --2- 172.21.15.19:0/4240374794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a53a0dc0 0x5617a53a1200 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f60900a9fc0 tx=0x7f609007a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a363deb158c505 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:02.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f60797fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:56:02.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f60797fa640 1 -- 172.21.15.19:0/4240374794 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090082920 con 0x5617a53a0dc0 2024-09-12T01:56:02.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f60797fa640 1 -- 172.21.15.19:0/4240374794 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6090004760 con 0x5617a53a0dc0 2024-09-12T01:56:02.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f60a327b740 1 -- 172.21.15.19:0/4240374794 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6088018070 con 0x5617a53a0dc0 2024-09-12T01:56:02.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f60797fa640 1 -- 172.21.15.19:0/4240374794 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f6090098050 con 0x5617a53a0dc0 2024-09-12T01:56:02.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f60a327b740 10 client.4389 fetch_fsmap learned FSMap version 6 2024-09-12T01:56:02.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f60a327b740 1 -- 172.21.15.19:0/4240374794 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5617a50bd6b0 con 0x5617a53a0dc0 2024-09-12T01:56:02.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f60797fa640 1 -- 172.21.15.19:0/4240374794 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6088018070 con 0x5617a53a0dc0 2024-09-12T01:56:02.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f60797fa640 1 -- 172.21.15.19:0/4240374794 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7f6090079190 con 0x5617a53a0dc0 2024-09-12T01:56:02.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f60a327b740 10 client.4389 fetch_fsmap finished waiting for FSMap version 6 2024-09-12T01:56:02.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f60a327b740 10 client.4389 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T01:56:02.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f60a327b740 20 client.4389 populate_metadata read hostname 'smithi019' 2024-09-12T01:56:02.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f60a327b740 1 --2- 172.21.15.19:0/4240374794 >> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] conn(0x5617a53dea10 0x5617a53e0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f60a327b740 4 client.4389 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:56:02.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.911+0000 7f60a327b740 1 -- 172.21.15.19:0/4240374794 --> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617a52edc50 con 0x5617a53dea10 2024-09-12T01:56:02.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.912+0000 7f609e279640 1 --2- 172.21.15.19:0/4240374794 >> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] conn(0x5617a53dea10 0x5617a53e0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.912+0000 7f609e279640 1 --2- 172.21.15.19:0/4240374794 >> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] conn(0x5617a53dea10 0x5617a53e0e00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=527d2b35e54c7ae server_cookie=29e3c377a8dd554f in_seq=0 out_seq=0 2024-09-12T01:56:02.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.912+0000 7f60797fa640 10 client.4389 ms_handle_connect on v2:172.21.15.135:6834/4290669195 2024-09-12T01:56:02.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.913+0000 7f60797fa640 1 -- 172.21.15.19:0/4240374794 <== mds.0 v2:172.21.15.135:6834/4290669195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5617a52edc50 con 0x5617a53dea10 2024-09-12T01:56:02.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.913+0000 7f60797fa640 10 client.4389 handle_command_reply: tid=0 2024-09-12T01:56:02.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.913+0000 7f60a327b740 1 client.4389 shutdown 2024-09-12T01:56:02.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.913+0000 7f60a327b740 1 -- 172.21.15.19:0/4240374794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a53a0dc0 msgr2=0x5617a53a1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.913+0000 7f60a327b740 1 --2- 172.21.15.19:0/4240374794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a53a0dc0 0x5617a53a1200 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f60900a9fc0 tx=0x7f609007a440 comp rx=0 tx=0).stop 2024-09-12T01:56:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.913+0000 7f60a327b740 1 -- 172.21.15.19:0/4240374794 shutdown_connections 2024-09-12T01:56:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.913+0000 7f60a327b740 1 --2- 172.21.15.19:0/4240374794 >> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] conn(0x5617a53dea10 0x5617a53e0e00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.913+0000 7f60a327b740 1 --2- 172.21.15.19:0/4240374794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a53a0dc0 0x5617a53a1200 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.913+0000 7f60797fa640 0 client.4389 ms_handle_reset on v2:172.21.15.135:6834/4290669195 2024-09-12T01:56:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.913+0000 7f60a327b740 1 --2- 172.21.15.19:0/4240374794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537fa50 0x5617a539e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.913+0000 7f60a327b740 1 --2- 172.21.15.19:0/4240374794 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a537e2c0 0x5617a53c0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.913+0000 7f60a327b740 1 -- 172.21.15.19:0/4240374794 >> 172.21.15.19:0/4240374794 conn(0x5617a537ba80 msgr2=0x5617a537c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.913+0000 7f60a327b740 1 -- 172.21.15.19:0/4240374794 shutdown_connections 2024-09-12T01:56:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.913+0000 7f60a327b740 1 -- 172.21.15.19:0/4240374794 wait complete. 2024-09-12T01:56:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.913+0000 7f60a327b740 20 client.4389 trim_cache size 0 max 16384 2024-09-12T01:56:02.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.931+0000 7f60a327b740 1 Processor -- start 2024-09-12T01:56:02.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.931+0000 7f60a327b740 1 -- start start 2024-09-12T01:56:02.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.932+0000 7f60a327b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537e2c0 0x5617a53c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.932+0000 7f60a327b740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a537fa50 0x5617a53c1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.932+0000 7f60a327b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a53a0dc0 0x5617a53bffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.932+0000 7f60a327b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6098201250 con 0x5617a53a0dc0 2024-09-12T01:56:02.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.932+0000 7f60a327b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f60980b9db0 con 0x5617a537e2c0 2024-09-12T01:56:02.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.932+0000 7f60a327b740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6098200c00 con 0x5617a537fa50 2024-09-12T01:56:02.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.932+0000 7f609ea7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a53a0dc0 0x5617a53bffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.932+0000 7f609ea7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a53a0dc0 0x5617a53bffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35048/0 (socket says 172.21.15.19:35048) 2024-09-12T01:56:02.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.932+0000 7f609ea7a640 1 -- 172.21.15.19:0/2536718682 learned_addr learned my addr 172.21.15.19:0/2536718682 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:02.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.932+0000 7f609da78640 1 --2- 172.21.15.19:0/2536718682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a537fa50 0x5617a53c1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.932+0000 7f609e279640 1 --2- 172.21.15.19:0/2536718682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537e2c0 0x5617a53c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.932+0000 7f609ea7a640 1 -- 172.21.15.19:0/2536718682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a537fa50 msgr2=0x5617a53c1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:02.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.932+0000 7f609ea7a640 1 --2- 172.21.15.19:0/2536718682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a537fa50 0x5617a53c1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.932+0000 7f609ea7a640 1 -- 172.21.15.19:0/2536718682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537e2c0 msgr2=0x5617a53c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:02.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.932+0000 7f609ea7a640 1 --2- 172.21.15.19:0/2536718682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537e2c0 0x5617a53c0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.932+0000 7f609ea7a640 1 -- 172.21.15.19:0/2536718682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617a537b720 con 0x5617a53a0dc0 2024-09-12T01:56:02.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.932+0000 7f609ea7a640 1 --2- 172.21.15.19:0/2536718682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a53a0dc0 0x5617a53bffa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60900093e0 tx=0x7f609003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3ceab689b9fc2b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:02.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.933+0000 7f607b7fe640 1 -- 172.21.15.19:0/2536718682 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090003e10 con 0x5617a53a0dc0 2024-09-12T01:56:02.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.933+0000 7f607b7fe640 1 -- 172.21.15.19:0/2536718682 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60900a8070 con 0x5617a53a0dc0 2024-09-12T01:56:02.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.933+0000 7f607b7fe640 1 -- 172.21.15.19:0/2536718682 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090082b70 con 0x5617a53a0dc0 2024-09-12T01:56:02.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.933+0000 7f60a327b740 1 -- 172.21.15.19:0/2536718682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a53a0dc0 msgr2=0x5617a53bffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.933+0000 7f60a327b740 1 --2- 172.21.15.19:0/2536718682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a53a0dc0 0x5617a53bffa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60900093e0 tx=0x7f609003e000 comp rx=0 tx=0).stop 2024-09-12T01:56:02.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.933+0000 7f60a327b740 1 -- 172.21.15.19:0/2536718682 shutdown_connections 2024-09-12T01:56:02.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.933+0000 7f60a327b740 1 --2- 172.21.15.19:0/2536718682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a53a0dc0 0x5617a53bffa0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.933+0000 7f60a327b740 1 --2- 172.21.15.19:0/2536718682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a537fa50 0x5617a53c1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.933+0000 7f60a327b740 1 --2- 172.21.15.19:0/2536718682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537e2c0 0x5617a53c0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.933+0000 7f60a327b740 1 -- 172.21.15.19:0/2536718682 >> 172.21.15.19:0/2536718682 conn(0x5617a537ba80 msgr2=0x5617a537c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:02.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.933+0000 7f60a327b740 1 -- 172.21.15.19:0/2536718682 shutdown_connections 2024-09-12T01:56:02.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.933+0000 7f60a327b740 1 -- 172.21.15.19:0/2536718682 wait complete. 2024-09-12T01:56:02.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.934+0000 7f60a327b740 1 -- start start 2024-09-12T01:56:02.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.934+0000 7f60a327b740 1 Processor -- start 2024-09-12T01:56:02.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f60a327b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537e2c0 0x5617a543e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f60a327b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a537fa50 0x5617a53c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f60a327b740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a53a0dc0 0x5617a53c1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f60a327b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5617a539ebb0 con 0x5617a537fa50 2024-09-12T01:56:02.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f60a327b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5617a53794e0 con 0x5617a537e2c0 2024-09-12T01:56:02.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f60a327b740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5617a53a78a0 con 0x5617a53a0dc0 2024-09-12T01:56:02.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f60a327b740 10 client.0 _ll_register_callbacks cb 0x7f6090032e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:56:02.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f609da78640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a537fa50 0x5617a53c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f609da78640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a537fa50 0x5617a53c0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35056/0 (socket says 172.21.15.19:35056) 2024-09-12T01:56:02.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f609da78640 1 -- 172.21.15.19:0/2069113751 learned_addr learned my addr 172.21.15.19:0/2069113751 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:02.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f609e279640 1 --2- 172.21.15.19:0/2069113751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537e2c0 0x5617a543e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f609ea7a640 1 --2- 172.21.15.19:0/2069113751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a53a0dc0 0x5617a53c1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f609da78640 1 -- 172.21.15.19:0/2069113751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a53a0dc0 msgr2=0x5617a53c1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:02.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f609da78640 1 --2- 172.21.15.19:0/2069113751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a53a0dc0 0x5617a53c1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f609da78640 1 -- 172.21.15.19:0/2069113751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537e2c0 msgr2=0x5617a543e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:02.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f609da78640 1 --2- 172.21.15.19:0/2069113751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537e2c0 0x5617a543e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f609da78640 1 -- 172.21.15.19:0/2069113751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617a539f9c0 con 0x5617a537fa50 2024-09-12T01:56:02.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f609da78640 1 --2- 172.21.15.19:0/2069113751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a537fa50 0x5617a53c0ee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6088014000 tx=0x7f6088007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549576036e9944df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:02.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f60797fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:56:02.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f60797fa640 1 -- 172.21.15.19:0/2069113751 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608800f7b0 con 0x5617a537fa50 2024-09-12T01:56:02.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f60797fa640 1 -- 172.21.15.19:0/2069113751 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f608800f950 con 0x5617a537fa50 2024-09-12T01:56:02.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.935+0000 7f60a327b740 1 -- 172.21.15.19:0/2069113751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60900a8070 con 0x5617a537fa50 2024-09-12T01:56:02.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.936+0000 7f60797fa640 1 -- 172.21.15.19:0/2069113751 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f608802f050 con 0x5617a537fa50 2024-09-12T01:56:02.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.936+0000 7f60a327b740 10 client.4395 fetch_fsmap learned FSMap version 6 2024-09-12T01:56:02.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.936+0000 7f60a327b740 1 -- 172.21.15.19:0/2069113751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5617a53a52a0 con 0x5617a537fa50 2024-09-12T01:56:02.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.936+0000 7f60797fa640 1 -- 172.21.15.19:0/2069113751 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60900a8070 con 0x5617a537fa50 2024-09-12T01:56:02.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.936+0000 7f60797fa640 1 -- 172.21.15.19:0/2069113751 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7f6088032020 con 0x5617a537fa50 2024-09-12T01:56:02.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.936+0000 7f60a327b740 10 client.4395 fetch_fsmap finished waiting for FSMap version 6 2024-09-12T01:56:02.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.936+0000 7f60a327b740 10 client.4395 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T01:56:02.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.936+0000 7f60a327b740 20 client.4395 populate_metadata read hostname 'smithi019' 2024-09-12T01:56:02.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.936+0000 7f60a327b740 1 --2- 172.21.15.19:0/2069113751 >> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] conn(0x5617a53dea10 0x5617a5441c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:02.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.936+0000 7f60a327b740 4 client.4395 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:56:02.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.936+0000 7f60a327b740 1 -- 172.21.15.19:0/2069113751 --> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] -- command(tid 0: {"prefix": "status"}) -- 0x5617a52e7fa0 con 0x5617a53dea10 2024-09-12T01:56:02.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.936+0000 7f609e279640 1 --2- 172.21.15.19:0/2069113751 >> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] conn(0x5617a53dea10 0x5617a5441c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:02.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.936+0000 7f60797fa640 10 client.4395 ms_handle_connect on v2:172.21.15.135:6834/4290669195 2024-09-12T01:56:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.936+0000 7f609e279640 1 --2- 172.21.15.19:0/2069113751 >> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] conn(0x5617a53dea10 0x5617a5441c10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efcd8cf3808e9dc server_cookie=98c62bc391b01943 in_seq=0 out_seq=0 2024-09-12T01:56:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60797fa640 1 -- 172.21.15.19:0/2069113751 <== mds.0 v2:172.21.15.135:6834/4290669195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5617a52e7fa0 con 0x5617a53dea10 2024-09-12T01:56:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60797fa640 10 client.4395 handle_command_reply: tid=0 2024-09-12T01:56:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60a327b740 1 client.4395 shutdown 2024-09-12T01:56:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60a327b740 1 -- 172.21.15.19:0/2069113751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a537fa50 msgr2=0x5617a53c0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60a327b740 1 --2- 172.21.15.19:0/2069113751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a537fa50 0x5617a53c0ee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6088014000 tx=0x7f6088007a40 comp rx=0 tx=0).stop 2024-09-12T01:56:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60a327b740 1 -- 172.21.15.19:0/2069113751 shutdown_connections 2024-09-12T01:56:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60a327b740 1 --2- 172.21.15.19:0/2069113751 >> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] conn(0x5617a53dea10 0x5617a5441c10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60a327b740 1 --2- 172.21.15.19:0/2069113751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5617a53a0dc0 0x5617a53c1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60a327b740 1 --2- 172.21.15.19:0/2069113751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617a537fa50 0x5617a53c0ee0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60a327b740 1 --2- 172.21.15.19:0/2069113751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617a537e2c0 0x5617a543e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60797fa640 0 client.4395 ms_handle_reset on v2:172.21.15.135:6834/4290669195 2024-09-12T01:56:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60a327b740 1 -- 172.21.15.19:0/2069113751 >> 172.21.15.19:0/2069113751 conn(0x5617a537ba80 msgr2=0x5617a5373ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60a327b740 1 -- 172.21.15.19:0/2069113751 shutdown_connections 2024-09-12T01:56:02.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60a327b740 1 -- 172.21.15.19:0/2069113751 wait complete. 2024-09-12T01:56:02.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60a327b740 20 client.4395 trim_cache size 0 max 16384 2024-09-12T01:56:02.944 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:56:02.944 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T01:56:02.944 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T01:56:02.944 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4282, 2024-09-12T01:56:02.944 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T01:56:02.944 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T01:56:02.944 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T01:56:02.944 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 7.2646365099999999, 2024-09-12T01:56:02.945 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 6, 2024-09-12T01:56:02.945 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 27, 2024-09-12T01:56:02.945 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 26, 2024-09-12T01:56:02.945 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 13.281344722 2024-09-12T01:56:02.945 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:56:02.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60a04dd640 1 -- 172.21.15.19:0/183323224 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f607c06be30 msgr2=0x7f607c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60a04dd640 1 --2- 172.21.15.19:0/183323224 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f607c06be30 0x7f607c06e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6094007fd0 tx=0x7f6094009040 comp rx=0 tx=0).stop 2024-09-12T01:56:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60a04dd640 1 -- 172.21.15.19:0/183323224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609815e760 msgr2=0x7f60980cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.937+0000 7f60a04dd640 1 --2- 172.21.15.19:0/183323224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609815e760 0x7f60980cc920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f609002adb0 tx=0x7f6090004a40 comp rx=0 tx=0).stop 2024-09-12T01:56:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.938+0000 7f60a04dd640 1 -- 172.21.15.19:0/183323224 shutdown_connections 2024-09-12T01:56:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.938+0000 7f60a04dd640 1 --2- 172.21.15.19:0/183323224 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f607c06be30 0x7f607c06e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.938+0000 7f60a04dd640 1 --2- 172.21.15.19:0/183323224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609815e760 0x7f60980cc920 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.938+0000 7f60a04dd640 1 --2- 172.21.15.19:0/183323224 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60980d4fd0 0x7f60980cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.938+0000 7f60a04dd640 1 --2- 172.21.15.19:0/183323224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60980cfcc0 0x7f609814b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.938+0000 7f60a04dd640 1 -- 172.21.15.19:0/183323224 >> 172.21.15.19:0/183323224 conn(0x7f609808bfc0 msgr2=0x7f60980d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.938+0000 7f60a04dd640 1 -- 172.21.15.19:0/183323224 shutdown_connections 2024-09-12T01:56:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:02.938+0000 7f60a04dd640 1 -- 172.21.15.19:0/183323224 wait complete. 2024-09-12T01:56:02.948 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T01:56:02.949 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T01:56:02.949 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:56:03.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.050+0000 7ff1f4ab7640 1 Processor -- start 2024-09-12T01:56:03.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.050+0000 7ff1f4ab7640 1 -- start start 2024-09-12T01:56:03.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.051+0000 7ff1f4ab7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff1f00d4fd0 0x7ff1f006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:03.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.051+0000 7ff1f4ab7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1f00d2700 con 0x7ff1f015e760 2024-09-12T01:56:03.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.051+0000 7ff1f4ab7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1f00cedb0 con 0x7ff1f00cfcc0 2024-09-12T01:56:03.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.051+0000 7ff1f4ab7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff1f00cf090 con 0x7ff1f00d4fd0 2024-09-12T01:56:03.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.051+0000 7ff1ee59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff1f015e760 0x7ff1f00cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48662/0 (socket says 172.21.15.19:48662) 2024-09-12T01:56:03.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.051+0000 7ff1eed9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff1f00d4fd0 0x7ff1f006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:03.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.051+0000 7ff1ee59c640 1 -- 172.21.15.19:0/547554418 learned_addr learned my addr 172.21.15.19:0/547554418 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:03.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.051+0000 7ff1ed59a640 1 -- 172.21.15.19:0/547554418 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2685229049 0 0) 0x7ff1e0001110 con 0x7ff1f015e760 2024-09-12T01:56:03.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.051+0000 7ff1ed59a640 1 -- 172.21.15.19:0/547554418 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1d8003520 con 0x7ff1f015e760 2024-09-12T01:56:03.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.051+0000 7ff1eed9d640 1 -- 172.21.15.19:0/547554418 >> v1:172.21.15.135:6789/0 conn(0x7ff1f00cfcc0 legacy=0x7ff1f00d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:03.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.052+0000 7ff1eed9d640 1 -- 172.21.15.19:0/547554418 >> v1:172.21.15.19:6789/0 conn(0x7ff1f015e760 legacy=0x7ff1f00cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:03.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.052+0000 7ff1eed9d640 1 -- 172.21.15.19:0/547554418 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f00b3c80 con 0x7ff1f00d4fd0 2024-09-12T01:56:03.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.053+0000 7ff1eed9d640 1 --2- 172.21.15.19:0/547554418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1f00d4fd0 0x7ff1f006cdd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8009d90 tx=0x7ff1e802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6814348c6cbcc91e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:03.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.053+0000 7ff1ed59a640 1 -- 172.21.15.19:0/547554418 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8007740 con 0x7ff1f00d4fd0 2024-09-12T01:56:03.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.053+0000 7ff1ed59a640 1 -- 172.21.15.19:0/547554418 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e80078e0 con 0x7ff1f00d4fd0 2024-09-12T01:56:03.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.053+0000 7ff1ed59a640 1 -- 172.21.15.19:0/547554418 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8007cb0 con 0x7ff1f00d4fd0 2024-09-12T01:56:03.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.053+0000 7ff1f4ab7640 1 -- 172.21.15.19:0/547554418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1f00d4fd0 msgr2=0x7ff1f006cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:03.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.053+0000 7ff1f4ab7640 1 --2- 172.21.15.19:0/547554418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1f00d4fd0 0x7ff1f006cdd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8009d90 tx=0x7ff1e802a6f0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.053+0000 7ff1f4ab7640 1 -- 172.21.15.19:0/547554418 shutdown_connections 2024-09-12T01:56:03.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.053+0000 7ff1f4ab7640 1 --2- 172.21.15.19:0/547554418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1f00d4fd0 0x7ff1f006cdd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.053+0000 7ff1f4ab7640 1 -- 172.21.15.19:0/547554418 >> 172.21.15.19:0/547554418 conn(0x7ff1f008bfc0 msgr2=0x7ff1f00d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:03.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.054+0000 7ff1f4ab7640 1 -- 172.21.15.19:0/547554418 shutdown_connections 2024-09-12T01:56:03.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.054+0000 7ff1f4ab7640 1 -- 172.21.15.19:0/547554418 wait complete. 2024-09-12T01:56:03.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.055+0000 7ff1f4ab7640 1 Processor -- start 2024-09-12T01:56:03.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.055+0000 7ff1f4ab7640 1 -- start start 2024-09-12T01:56:03.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1f4ab7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1f00cfcc0 0x7ff1f01538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:03.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1f4ab7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1f00d4fd0 0x7ff1f00b8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:03.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1f4ab7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1f015e760 0x7ff1f006e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:03.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1f4ab7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f00d35b0 con 0x7ff1f00cfcc0 2024-09-12T01:56:03.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1f4ab7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f00b3920 con 0x7ff1f015e760 2024-09-12T01:56:03.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1f4ab7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff1f00d3730 con 0x7ff1f00d4fd0 2024-09-12T01:56:03.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1ee59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1f00cfcc0 0x7ff1f01538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:03.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1ee59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1f00cfcc0 0x7ff1f01538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35086/0 (socket says 172.21.15.19:35086) 2024-09-12T01:56:03.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1ee59c640 1 -- 172.21.15.19:0/1404835040 learned_addr learned my addr 172.21.15.19:0/1404835040 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:03.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1ee59c640 1 -- 172.21.15.19:0/1404835040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1f00d4fd0 msgr2=0x7ff1f00b8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:03.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1eed9d640 1 --2- 172.21.15.19:0/1404835040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1f015e760 0x7ff1f006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:03.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1ee59c640 1 --2- 172.21.15.19:0/1404835040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1f00d4fd0 0x7ff1f00b8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1ee59c640 1 -- 172.21.15.19:0/1404835040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1f015e760 msgr2=0x7ff1f006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:03.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1ee59c640 1 --2- 172.21.15.19:0/1404835040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1f015e760 0x7ff1f006e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1ee59c640 1 -- 172.21.15.19:0/1404835040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f0153df0 con 0x7ff1f00cfcc0 2024-09-12T01:56:03.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1ee59c640 1 --2- 172.21.15.19:0/1404835040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1f00cfcc0 0x7ff1f01538b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000c400 tx=0x7ff1e000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:03.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1deffd640 1 -- 172.21.15.19:0/1404835040 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0017070 con 0x7ff1f00cfcc0 2024-09-12T01:56:03.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1deffd640 1 -- 172.21.15.19:0/1404835040 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e0005ce0 con 0x7ff1f00cfcc0 2024-09-12T01:56:03.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1f4ab7640 1 -- 172.21.15.19:0/1404835040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f00b95f0 con 0x7ff1f00cfcc0 2024-09-12T01:56:03.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1deffd640 1 -- 172.21.15.19:0/1404835040 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e00072d0 con 0x7ff1f00cfcc0 2024-09-12T01:56:03.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.056+0000 7ff1f4ab7640 1 -- 172.21.15.19:0/1404835040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f00b9bb0 con 0x7ff1f00cfcc0 2024-09-12T01:56:03.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.058+0000 7ff1f4ab7640 1 -- 172.21.15.19:0/1404835040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1f00d3a60 con 0x7ff1f00cfcc0 2024-09-12T01:56:03.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.058+0000 7ff1deffd640 1 -- 172.21.15.19:0/1404835040 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1e001a070 con 0x7ff1f00cfcc0 2024-09-12T01:56:03.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.058+0000 7ff1deffd640 1 --2- 172.21.15.19:0/1404835040 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff1d006be30 0x7ff1d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:03.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.058+0000 7ff1deffd640 1 -- 172.21.15.19:0/1404835040 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff1e008a4c0 con 0x7ff1f00cfcc0 2024-09-12T01:56:03.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.059+0000 7ff1edd9b640 1 --2- 172.21.15.19:0/1404835040 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff1d006be30 0x7ff1d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:03.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.059+0000 7ff1edd9b640 1 --2- 172.21.15.19:0/1404835040 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff1d006be30 0x7ff1d006e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4000fb0 tx=0x7ff1e40079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:03.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.063+0000 7ff1deffd640 1 -- 172.21.15.19:0/1404835040 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff1f00d2700 con 0x7ff1f00cfcc0 2024-09-12T01:56:03.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.273+0000 7ff1f4ab7640 1 -- 172.21.15.19:0/1404835040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff1f00b6d20 con 0x7ff1f00cfcc0 2024-09-12T01:56:03.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.273+0000 7ff1deffd640 1 -- 172.21.15.19:0/1404835040 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7ff1e0058440 con 0x7ff1f00cfcc0 2024-09-12T01:56:03.274 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T01:56:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.275+0000 7ff1f4ab7640 1 -- 172.21.15.19:0/1404835040 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff1d006be30 msgr2=0x7ff1d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.275+0000 7ff1f4ab7640 1 --2- 172.21.15.19:0/1404835040 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff1d006be30 0x7ff1d006e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4000fb0 tx=0x7ff1e40079c0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.275+0000 7ff1f4ab7640 1 -- 172.21.15.19:0/1404835040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1f00cfcc0 msgr2=0x7ff1f01538b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.275+0000 7ff1f4ab7640 1 --2- 172.21.15.19:0/1404835040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1f00cfcc0 0x7ff1f01538b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000c400 tx=0x7ff1e000c8c0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.275+0000 7ff1f4ab7640 1 -- 172.21.15.19:0/1404835040 shutdown_connections 2024-09-12T01:56:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.275+0000 7ff1f4ab7640 1 --2- 172.21.15.19:0/1404835040 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff1d006be30 0x7ff1d006e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.275+0000 7ff1f4ab7640 1 --2- 172.21.15.19:0/1404835040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1f015e760 0x7ff1f006e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.275+0000 7ff1f4ab7640 1 --2- 172.21.15.19:0/1404835040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1f00d4fd0 0x7ff1f00b8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.275+0000 7ff1f4ab7640 1 --2- 172.21.15.19:0/1404835040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1f00cfcc0 0x7ff1f01538b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.275+0000 7ff1f4ab7640 1 -- 172.21.15.19:0/1404835040 >> 172.21.15.19:0/1404835040 conn(0x7ff1f008bfc0 msgr2=0x7ff1f00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:03.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.275+0000 7ff1f4ab7640 1 -- 172.21.15.19:0/1404835040 shutdown_connections 2024-09-12T01:56:03.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03.275+0000 7ff1f4ab7640 1 -- 172.21.15.19:0/1404835040 wait complete. 2024-09-12T01:56:03.286 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:56:03.286 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:56:03.287 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T01:56:03.287 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-12T01:56:03.287 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T01:56:03.287 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:56:03.287 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T01:56:03.287 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:56:03.287 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T01:56:03.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:03.287 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T01:56:03.303 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:56:03.303 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:56:03.303 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:56:03.303 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:03.303 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T01:56:03.303 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:03.304 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:03.304 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:03.304 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T01:56:03.304 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:03.304 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:03.304 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T01:56:03.304 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:56:03.304 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:03.304 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T01:56:03.304 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:56:03.304 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42797sec preferred_lft 42797sec 2024-09-12T01:56:03.304 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T01:56:03.304 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:03.305 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:03.305 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:03.305 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T01:56:03.305 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T01:56:03.305 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:03.306 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:56:03.306 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add name ceph-brx type bridge 2024-09-12T01:56:03.306 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr flush dev ceph-brx 2024-09-12T01:56:03.306 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set ceph-brx up 2024-09-12T01:56:03.306 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T01:56:03.306 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:56:03.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:03.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:03.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:03.501 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:56:03.527 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T01:56:03.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:03.528 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T01:56:03.605 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T01:56:03.605 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:56:03.606 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:56:03.606 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:56:03.606 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:56:03.606 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:03.606 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:56:03.606 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:56:03.606 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:56:03.606 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:56:03.607 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:56:03.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:03.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:03.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:03.936 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T01:56:03.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:03.953 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2024-09-12T01:56:04.009 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:04.009 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:56:04.009 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T01:56:04.009 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-12T01:56:04.009 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:56:04.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:04.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:04.130 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-12T01:56:04.130 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:04.130 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:56:04.131 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-12T01:56:04.131 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T01:56:04.131 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-12T01:56:04.131 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-12T01:56:04.131 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-12T01:56:04.131 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:56:04.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:04.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:04.263 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:04.263 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:56:04.263 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T01:56:04.263 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T01:56:04.263 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:56:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:04.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:04.343 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-12T01:56:04.343 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:56:04.343 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-12T01:56:04.358 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T01:56:04.359 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:56:04.359 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-12T01:56:04.414 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-09-12T01:56:04.485 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T01:56:04.541 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-09-12T01:56:04.541 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-09-12T01:56:04.542 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-09-12T01:56:04.542 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-09-12T01:56:04.542 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-09-12T01:56:04.542 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-09-12T01:56:04.542 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-09-12T01:56:04.542 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-09-12T01:56:04.542 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-09-12T01:56:04.542 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-09-12T01:56:04.542 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-09-12T01:56:04.542 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-09-12T01:56:04.542 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T01:56:04.542 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-09-12T01:56:04.542 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-09-12T01:56:04.543 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-09-12T01:56:04.543 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-09-12T01:56:04.543 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T01:56:04.543 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-09-12T01:56:04.543 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-09-12T01:56:04.543 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T01:56:04.543 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T01:56:04.543 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T01:56:04.543 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-09-12T01:56:04.543 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-09-12T01:56:04.543 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T01:56:04.543 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T01:56:04.543 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T01:56:04.543 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T01:56:04.544 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-09-12T01:56:04.544 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T01:56:04.544 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T01:56:04.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:04.544 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-09-12T01:56:04.597 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T01:56:04.598 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-12T01:56:04.640 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-09-12T01:56:04.666 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T01:56:04.723 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-09-12T01:56:04.723 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-09-12T01:56:04.723 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-09-12T01:56:04.723 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-09-12T01:56:04.723 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-09-12T01:56:04.723 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-09-12T01:56:04.723 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-09-12T01:56:04.723 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-09-12T01:56:04.723 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-09-12T01:56:04.724 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-09-12T01:56:04.724 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-09-12T01:56:04.724 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-09-12T01:56:04.724 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T01:56:04.724 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-09-12T01:56:04.724 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-09-12T01:56:04.724 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-09-12T01:56:04.724 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-09-12T01:56:04.724 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T01:56:04.724 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-09-12T01:56:04.724 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-09-12T01:56:04.724 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T01:56:04.724 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T01:56:04.724 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T01:56:04.725 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-09-12T01:56:04.725 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-09-12T01:56:04.725 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T01:56:04.725 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T01:56:04.725 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T01:56:04.725 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T01:56:04.725 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-09-12T01:56:04.725 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T01:56:04.725 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T01:56:04.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:04.726 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-09-12T01:56:04.769 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi019.stderr:2024-09-12T01:56:04.768+0000 7f5de4d23480 -1 init, newargv = 0x55c9a572ffa0 newargc=15 2024-09-12T01:56:04.769 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi019.stderr:ceph-fuse[42871]: starting ceph client 2024-09-12T01:56:04.774 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi019.stderr:ceph-fuse[42871]: starting fuse 2024-09-12T01:56:04.783 INFO:teuthology.orchestra.run.smithi019.stdout:41 2024-09-12T01:56:04.783 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-12T01:56:04.783 DEBUG:teuthology.orchestra.run.smithi019:> sudo stdin-killer -- python3 -c ' 2024-09-12T01:56:04.783 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2024-09-12T01:56:04.783 DEBUG:teuthology.orchestra.run.smithi019:> import re 2024-09-12T01:56:04.783 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-09-12T01:56:04.784 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2024-09-12T01:56:04.784 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T01:56:04.784 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2024-09-12T01:56:04.784 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-12T01:56:04.784 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2024-09-12T01:56:04.784 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-12T01:56:04.784 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T01:56:04.784 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2024-09-12T01:56:04.784 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2024-09-12T01:56:04.784 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2024-09-12T01:56:04.784 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2024-09-12T01:56:04.784 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T01:56:04.784 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2024-09-12T01:56:04.784 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T01:56:04.785 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T01:56:04.785 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T01:56:04.785 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2024-09-12T01:56:04.785 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2024-09-12T01:56:04.785 DEBUG:teuthology.orchestra.run.smithi019:> return f 2024-09-12T01:56:04.785 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T01:56:04.785 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T01:56:04.785 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.admin")) 2024-09-12T01:56:04.785 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-09-12T01:56:04.904 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.admin.42871.asok 2024-09-12T01:56:04.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:04.914 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42871.asok 2024-09-12T01:56:04.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:04.915 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42871.asok status 2024-09-12T01:56:05.050 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:56:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2024-09-12T01:56:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T01:56:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T01:56:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "admin", 2024-09-12T01:56:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2024-09-12T01:56:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-12T01:56:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "42871", 2024-09-12T01:56:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2024-09-12T01:56:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2024-09-12T01:56:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2024-09-12T01:56:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4410, 2024-09-12T01:56:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2024-09-12T01:56:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2024-09-12T01:56:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2024-09-12T01:56:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 4410 2024-09-12T01:56:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-09-12T01:56:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T01:56:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-09-12T01:56:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3005339789 2024-09-12T01:56:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:05.053 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-09-12T01:56:05.053 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T01:56:05.053 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-09-12T01:56:05.053 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3005339789 2024-09-12T01:56:05.053 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:05.053 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.4410 192.168.0.1:0/3005339789", 2024-09-12T01:56:05.053 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "192.168.0.1:0/3005339789", 2024-09-12T01:56:05.053 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2024-09-12T01:56:05.053 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 6, 2024-09-12T01:56:05.053 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 27, 2024-09-12T01:56:05.053 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2024-09-12T01:56:05.053 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2024-09-12T01:56:05.053 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2024-09-12T01:56:05.054 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:56:05.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:05.059 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2024-09-12T01:56:05.059 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-12T01:56:05.075 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2024-09-12T01:56:05.075 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-12T01:56:05.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:05.076 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-12T01:56:05.142 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-12T01:56:05.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:56:05.257 INFO:teuthology.orchestra.run.smithi019.stdout:# file: . 2024-09-12T01:56:05.258 INFO:teuthology.orchestra.run.smithi019.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-12T01:56:05.258 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:05.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:05.264 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:56:05.264 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:05.281 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:56:05.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.424+0000 7f45bb05c640 1 Processor -- start 2024-09-12T01:56:05.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.424+0000 7f45bb05c640 1 -- start start 2024-09-12T01:56:05.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.425+0000 7f45bb05c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f45b4161c80 0x7f45b406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.425+0000 7f45bb05c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45b4162060 0x7f45b40b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.425+0000 7f45bb05c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b406e870 con 0x7f45b40b64b0 2024-09-12T01:56:05.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.425+0000 7f45bb05c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f45b406d9f0 con 0x7f45b4161c80 2024-09-12T01:56:05.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.425+0000 7f45bb05c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f45b406dcd0 con 0x7f45b4162060 2024-09-12T01:56:05.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.425+0000 7f45b95f9640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f45b40b64b0 0x7f45b4162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48676/0 (socket says 172.21.15.19:48676) 2024-09-12T01:56:05.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.425+0000 7f45b95f9640 1 -- 172.21.15.19:0/1779169865 learned_addr learned my addr 172.21.15.19:0/1779169865 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:05.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.425+0000 7f45b8df8640 1 --2- 172.21.15.19:0/1779169865 >> v2:172.21.15.135:3300/0 conn(0x7f45b4161c80 0x7f45b406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.426+0000 7f45b3fff640 1 --2- 172.21.15.19:0/1779169865 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45b4162060 0x7f45b40b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.426+0000 7f45b37fe640 1 -- 172.21.15.19:0/1779169865 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1036594738 0 0) 0x7f45ac001490 con 0x7f45b40b64b0 2024-09-12T01:56:05.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.426+0000 7f45b37fe640 1 -- 172.21.15.19:0/1779169865 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f459c003520 con 0x7f45b40b64b0 2024-09-12T01:56:05.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.426+0000 7f45b3fff640 1 -- 172.21.15.19:0/1779169865 >> v2:172.21.15.135:3300/0 conn(0x7f45b4161c80 msgr2=0x7f45b406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:05.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.426+0000 7f45b3fff640 1 --2- 172.21.15.19:0/1779169865 >> v2:172.21.15.135:3300/0 conn(0x7f45b4161c80 0x7f45b406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.426+0000 7f45b3fff640 1 -- 172.21.15.19:0/1779169865 >> v1:172.21.15.19:6789/0 conn(0x7f45b40b64b0 legacy=0x7f45b4162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.426+0000 7f45b37fe640 1 -- 172.21.15.19:0/1779169865 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3265392677 0 0) 0x7f459c003520 con 0x7f45b40b64b0 2024-09-12T01:56:05.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.426+0000 7f45b3fff640 1 -- 172.21.15.19:0/1779169865 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b406dfb0 con 0x7f45b4162060 2024-09-12T01:56:05.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.426+0000 7f45b8df8640 1 --2- 172.21.15.19:0/1779169865 >> v2:172.21.15.135:3300/0 conn(0x7f45b4161c80 0x7f45b406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:05.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.427+0000 7f45b3fff640 1 --2- 172.21.15.19:0/1779169865 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45b4162060 0x7f45b40b5f70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f45a80097a0 tx=0x7f45a802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74c329191e736c3d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:05.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.427+0000 7f45b37fe640 1 -- 172.21.15.19:0/1779169865 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a8037070 con 0x7f45b4162060 2024-09-12T01:56:05.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.427+0000 7f45b37fe640 1 -- 172.21.15.19:0/1779169865 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a802aba0 con 0x7f45b4162060 2024-09-12T01:56:05.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.427+0000 7f45b37fe640 1 -- 172.21.15.19:0/1779169865 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ac001bc0 con 0x7f45b4162060 2024-09-12T01:56:05.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.427+0000 7f45bb05c640 1 -- 172.21.15.19:0/1779169865 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45b4162060 msgr2=0x7f45b40b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.427+0000 7f45bb05c640 1 --2- 172.21.15.19:0/1779169865 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45b4162060 0x7f45b40b5f70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f45a80097a0 tx=0x7f45a802a110 comp rx=0 tx=0).stop 2024-09-12T01:56:05.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.428+0000 7f45bb05c640 1 -- 172.21.15.19:0/1779169865 shutdown_connections 2024-09-12T01:56:05.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.428+0000 7f45bb05c640 1 --2- 172.21.15.19:0/1779169865 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45b4162060 0x7f45b40b5f70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.428+0000 7f45bb05c640 1 --2- 172.21.15.19:0/1779169865 >> v2:172.21.15.135:3300/0 conn(0x7f45b4161c80 0x7f45b406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.428+0000 7f45bb05c640 1 -- 172.21.15.19:0/1779169865 >> 172.21.15.19:0/1779169865 conn(0x7f45b40d44f0 msgr2=0x7f45b40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:05.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.428+0000 7f45bb05c640 1 -- 172.21.15.19:0/1779169865 shutdown_connections 2024-09-12T01:56:05.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.428+0000 7f45bb05c640 1 -- 172.21.15.19:0/1779169865 wait complete. 2024-09-12T01:56:05.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.429+0000 7f45bb05c640 1 Processor -- start 2024-09-12T01:56:05.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.429+0000 7f45bb05c640 1 -- start start 2024-09-12T01:56:05.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.430+0000 7f45bb05c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b40b64b0 0x7f45b40cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.430+0000 7f45bb05c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45b4161c80 0x7f45b40b9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.430+0000 7f45bb05c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45b4162060 0x7f45b40b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.430+0000 7f45bb05c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f45b40d2a10 con 0x7f45b40b64b0 2024-09-12T01:56:05.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.430+0000 7f45bb05c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f45b40d2890 con 0x7f45b4162060 2024-09-12T01:56:05.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.430+0000 7f45bb05c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f45b40b6960 con 0x7f45b4161c80 2024-09-12T01:56:05.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.430+0000 7f45b8df8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b40b64b0 0x7f45b40cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.430+0000 7f45b8df8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b40b64b0 0x7f45b40cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35092/0 (socket says 172.21.15.19:35092) 2024-09-12T01:56:05.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.430+0000 7f45b8df8640 1 -- 172.21.15.19:0/3279133559 learned_addr learned my addr 172.21.15.19:0/3279133559 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:05.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.430+0000 7f45b3fff640 1 --2- 172.21.15.19:0/3279133559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45b4161c80 0x7f45b40b9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.430+0000 7f45b95f9640 1 --2- 172.21.15.19:0/3279133559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45b4162060 0x7f45b40b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.430+0000 7f45b8df8640 1 -- 172.21.15.19:0/3279133559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45b4161c80 msgr2=0x7f45b40b9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.430+0000 7f45b8df8640 1 --2- 172.21.15.19:0/3279133559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45b4161c80 0x7f45b40b9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.430+0000 7f45b8df8640 1 -- 172.21.15.19:0/3279133559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45b4162060 msgr2=0x7f45b40b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.430+0000 7f45b8df8640 1 --2- 172.21.15.19:0/3279133559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45b4162060 0x7f45b40b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.430+0000 7f45b8df8640 1 -- 172.21.15.19:0/3279133559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b40b39f0 con 0x7f45b40b64b0 2024-09-12T01:56:05.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.430+0000 7f45b8df8640 1 --2- 172.21.15.19:0/3279133559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b40b64b0 0x7f45b40cc060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f45a400ebe0 tx=0x7f45a400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:05.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.431+0000 7f45b17fa640 1 -- 172.21.15.19:0/3279133559 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a4017070 con 0x7f45b40b64b0 2024-09-12T01:56:05.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.431+0000 7f45b17fa640 1 -- 172.21.15.19:0/3279133559 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a400cc30 con 0x7f45b40b64b0 2024-09-12T01:56:05.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.431+0000 7f45b17fa640 1 -- 172.21.15.19:0/3279133559 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a4013470 con 0x7f45b40b64b0 2024-09-12T01:56:05.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.431+0000 7f45bb05c640 1 -- 172.21.15.19:0/3279133559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b40b7f40 con 0x7f45b40b64b0 2024-09-12T01:56:05.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.431+0000 7f45bb05c640 1 -- 172.21.15.19:0/3279133559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b40b84e0 con 0x7f45b40b64b0 2024-09-12T01:56:05.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.432+0000 7f45bb05c640 1 -- 172.21.15.19:0/3279133559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45b4068ea0 con 0x7f45b40b64b0 2024-09-12T01:56:05.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.432+0000 7f45b17fa640 1 -- 172.21.15.19:0/3279133559 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f45a401a070 con 0x7f45b40b64b0 2024-09-12T01:56:05.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.433+0000 7f45b17fa640 1 --2- 172.21.15.19:0/3279133559 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f45a006be30 0x7f45a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.433+0000 7f45b17fa640 1 -- 172.21.15.19:0/3279133559 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f45a408b0b0 con 0x7f45b40b64b0 2024-09-12T01:56:05.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.433+0000 7f45b3fff640 1 --2- 172.21.15.19:0/3279133559 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f45a006be30 0x7f45a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.433+0000 7f45b3fff640 1 --2- 172.21.15.19:0/3279133559 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f45a006be30 0x7f45a006e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f45a8034000 tx=0x7f45a802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:05.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.437+0000 7f45b17fa640 1 -- 172.21.15.19:0/3279133559 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f45a40590d0 con 0x7f45b40b64b0 2024-09-12T01:56:05.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.624+0000 7f45bb05c640 1 -- 172.21.15.19:0/3279133559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f45b415fea0 con 0x7f45b40b64b0 2024-09-12T01:56:05.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.625+0000 7f45b17fa640 1 -- 172.21.15.19:0/3279133559 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f45a405d3d0 con 0x7f45b40b64b0 2024-09-12T01:56:05.625 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-09-12T01:56:05.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.627+0000 7f45bb05c640 1 -- 172.21.15.19:0/3279133559 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f45a006be30 msgr2=0x7f45a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.627+0000 7f45bb05c640 1 --2- 172.21.15.19:0/3279133559 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f45a006be30 0x7f45a006e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f45a8034000 tx=0x7f45a802e000 comp rx=0 tx=0).stop 2024-09-12T01:56:05.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.627+0000 7f45bb05c640 1 -- 172.21.15.19:0/3279133559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b40b64b0 msgr2=0x7f45b40cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.627+0000 7f45bb05c640 1 --2- 172.21.15.19:0/3279133559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b40b64b0 0x7f45b40cc060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f45a400ebe0 tx=0x7f45a400c520 comp rx=0 tx=0).stop 2024-09-12T01:56:05.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.627+0000 7f45bb05c640 1 -- 172.21.15.19:0/3279133559 shutdown_connections 2024-09-12T01:56:05.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.627+0000 7f45bb05c640 1 --2- 172.21.15.19:0/3279133559 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f45a006be30 0x7f45a006e2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.627+0000 7f45bb05c640 1 --2- 172.21.15.19:0/3279133559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45b4162060 0x7f45b40b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.627+0000 7f45bb05c640 1 --2- 172.21.15.19:0/3279133559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45b4161c80 0x7f45b40b9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.627+0000 7f45bb05c640 1 --2- 172.21.15.19:0/3279133559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b40b64b0 0x7f45b40cc060 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.627+0000 7f45bb05c640 1 -- 172.21.15.19:0/3279133559 >> 172.21.15.19:0/3279133559 conn(0x7f45b40d44f0 msgr2=0x7f45b406ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:05.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.627+0000 7f45bb05c640 1 -- 172.21.15.19:0/3279133559 shutdown_connections 2024-09-12T01:56:05.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.627+0000 7f45bb05c640 1 -- 172.21.15.19:0/3279133559 wait complete. 2024-09-12T01:56:05.638 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:56:05.638 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:05.654 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:56:05.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.796+0000 7f6bc462e640 1 Processor -- start 2024-09-12T01:56:05.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.797+0000 7f6bc462e640 1 -- start start 2024-09-12T01:56:05.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.797+0000 7f6bc462e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6bbc161c80 0x7f6bbc06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.797+0000 7f6bc462e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6bbc162060 0x7f6bbc0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.797+0000 7f6bc462e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bbc0b64b0 0x7f6bbc0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.797+0000 7f6bc462e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f6bbc06e870 con 0x7f6bbc162060 2024-09-12T01:56:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.797+0000 7f6bc462e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6bbc06d9f0 con 0x7f6bbc161c80 2024-09-12T01:56:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.797+0000 7f6bc462e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6bbc06dcd0 con 0x7f6bbc0b64b0 2024-09-12T01:56:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.798+0000 7f6bc1bc9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6bbc162060 0x7f6bbc0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.798+0000 7f6bc1bc9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6bbc162060 0x7f6bbc0b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35098/0 (socket says 172.21.15.19:35098) 2024-09-12T01:56:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.798+0000 7f6bc1bc9640 1 -- 172.21.15.19:0/3156740228 learned_addr learned my addr 172.21.15.19:0/3156740228 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.798+0000 7f6bc2bcb640 1 --2- 172.21.15.19:0/3156740228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bbc0b64b0 0x7f6bbc0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.798+0000 7f6bc23ca640 1 --2- 172.21.15.19:0/3156740228 >> v2:172.21.15.135:3300/0 conn(0x7f6bbc161c80 0x7f6bbc06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.798+0000 7f6bc1bc9640 1 -- 172.21.15.19:0/3156740228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bbc0b64b0 msgr2=0x7f6bbc0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.798+0000 7f6bc1bc9640 1 --2- 172.21.15.19:0/3156740228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bbc0b64b0 0x7f6bbc0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.798+0000 7f6bc1bc9640 1 -- 172.21.15.19:0/3156740228 >> v2:172.21.15.135:3300/0 conn(0x7f6bbc161c80 msgr2=0x7f6bbc06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.798+0000 7f6bc1bc9640 1 --2- 172.21.15.19:0/3156740228 >> v2:172.21.15.135:3300/0 conn(0x7f6bbc161c80 0x7f6bbc06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.798+0000 7f6bc1bc9640 1 -- 172.21.15.19:0/3156740228 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bbc06dfb0 con 0x7f6bbc162060 2024-09-12T01:56:05.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.798+0000 7f6bc23ca640 1 --2- 172.21.15.19:0/3156740228 >> v2:172.21.15.135:3300/0 conn(0x7f6bbc161c80 0x7f6bbc06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:05.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.799+0000 7f6bc1bc9640 1 --2- 172.21.15.19:0/3156740228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bbc162060 0x7f6bbc0b5f70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc08d7a0 tx=0x7f6bac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6f58983e87195b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:05.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.799+0000 7f6bc13c8640 1 -- 172.21.15.19:0/3156740228 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac037070 con 0x7f6bbc162060 2024-09-12T01:56:05.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.799+0000 7f6bc13c8640 1 -- 172.21.15.19:0/3156740228 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bac032440 con 0x7f6bbc162060 2024-09-12T01:56:05.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.799+0000 7f6bc13c8640 1 -- 172.21.15.19:0/3156740228 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac032810 con 0x7f6bbc162060 2024-09-12T01:56:05.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.799+0000 7f6bc462e640 1 -- 172.21.15.19:0/3156740228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bbc162060 msgr2=0x7f6bbc0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.799+0000 7f6bc462e640 1 --2- 172.21.15.19:0/3156740228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bbc162060 0x7f6bbc0b5f70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc08d7a0 tx=0x7f6bac02a1e0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.800+0000 7f6bc462e640 1 -- 172.21.15.19:0/3156740228 shutdown_connections 2024-09-12T01:56:05.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.800+0000 7f6bc462e640 1 --2- 172.21.15.19:0/3156740228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bbc0b64b0 0x7f6bbc0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.800+0000 7f6bc462e640 1 --2- 172.21.15.19:0/3156740228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bbc162060 0x7f6bbc0b5f70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.800+0000 7f6bc462e640 1 --2- 172.21.15.19:0/3156740228 >> v2:172.21.15.135:3300/0 conn(0x7f6bbc161c80 0x7f6bbc06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.800+0000 7f6bc462e640 1 -- 172.21.15.19:0/3156740228 >> 172.21.15.19:0/3156740228 conn(0x7f6bbc0d44f0 msgr2=0x7f6bbc0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:05.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.800+0000 7f6bc462e640 1 -- 172.21.15.19:0/3156740228 shutdown_connections 2024-09-12T01:56:05.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.800+0000 7f6bc462e640 1 -- 172.21.15.19:0/3156740228 wait complete. 2024-09-12T01:56:05.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.801+0000 7f6bc462e640 1 Processor -- start 2024-09-12T01:56:05.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.801+0000 7f6bc462e640 1 -- start start 2024-09-12T01:56:05.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.801+0000 7f6bc462e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bbc0b64b0 0x7f6bbc156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.801+0000 7f6bc462e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bbc161c80 0x7f6bbc0cd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.801+0000 7f6bc462e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bbc162060 0x7f6bbc0b9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.801+0000 7f6bc462e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc162500 con 0x7f6bbc162060 2024-09-12T01:56:05.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.801+0000 7f6bc462e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc0d2aa0 con 0x7f6bbc161c80 2024-09-12T01:56:05.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.801+0000 7f6bc462e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6bbc162680 con 0x7f6bbc0b64b0 2024-09-12T01:56:05.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.802+0000 7f6bc2bcb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bbc162060 0x7f6bbc0b9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.802+0000 7f6bc2bcb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bbc162060 0x7f6bbc0b9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35104/0 (socket says 172.21.15.19:35104) 2024-09-12T01:56:05.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.802+0000 7f6bc2bcb640 1 -- 172.21.15.19:0/1138876547 learned_addr learned my addr 172.21.15.19:0/1138876547 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:05.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.802+0000 7f6bc23ca640 1 --2- 172.21.15.19:0/1138876547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bbc0b64b0 0x7f6bbc156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.802+0000 7f6bc1bc9640 1 --2- 172.21.15.19:0/1138876547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bbc161c80 0x7f6bbc0cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.802+0000 7f6bc2bcb640 1 -- 172.21.15.19:0/1138876547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bbc0b64b0 msgr2=0x7f6bbc156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.802+0000 7f6bc2bcb640 1 --2- 172.21.15.19:0/1138876547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bbc0b64b0 0x7f6bbc156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.802+0000 7f6bc2bcb640 1 -- 172.21.15.19:0/1138876547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bbc161c80 msgr2=0x7f6bbc0cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.802+0000 7f6bc2bcb640 1 --2- 172.21.15.19:0/1138876547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bbc161c80 0x7f6bbc0cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.802+0000 7f6bc2bcb640 1 -- 172.21.15.19:0/1138876547 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bbc0c8cb0 con 0x7f6bbc162060 2024-09-12T01:56:05.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.802+0000 7f6bc2bcb640 1 --2- 172.21.15.19:0/1138876547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bbc162060 0x7f6bbc0b9510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4007e90 tx=0x7f6bb400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:05.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.802+0000 7f6bb2ffd640 1 -- 172.21.15.19:0/1138876547 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4014420 con 0x7f6bbc162060 2024-09-12T01:56:05.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.802+0000 7f6bb2ffd640 1 -- 172.21.15.19:0/1138876547 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb4019070 con 0x7f6bbc162060 2024-09-12T01:56:05.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.802+0000 7f6bc462e640 1 -- 172.21.15.19:0/1138876547 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bbc0c8f90 con 0x7f6bbc162060 2024-09-12T01:56:05.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.802+0000 7f6bb2ffd640 1 -- 172.21.15.19:0/1138876547 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4014820 con 0x7f6bbc162060 2024-09-12T01:56:05.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.802+0000 7f6bc462e640 1 -- 172.21.15.19:0/1138876547 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bbc0c9550 con 0x7f6bbc162060 2024-09-12T01:56:05.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.803+0000 7f6bc462e640 1 -- 172.21.15.19:0/1138876547 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bbc06e330 con 0x7f6bbc162060 2024-09-12T01:56:05.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.804+0000 7f6bb2ffd640 1 -- 172.21.15.19:0/1138876547 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6bb40149c0 con 0x7f6bbc162060 2024-09-12T01:56:05.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.804+0000 7f6bb2ffd640 1 --2- 172.21.15.19:0/1138876547 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6ba006be30 0x7f6ba006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.804+0000 7f6bb2ffd640 1 -- 172.21.15.19:0/1138876547 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6bb408b940 con 0x7f6bbc162060 2024-09-12T01:56:05.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.804+0000 7f6bc23ca640 1 --2- 172.21.15.19:0/1138876547 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6ba006be30 0x7f6ba006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.805+0000 7f6bc23ca640 1 --2- 172.21.15.19:0/1138876547 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6ba006be30 0x7f6ba006e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8006fd0 tx=0x7f6bb8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:05.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.808+0000 7f6bb2ffd640 1 -- 172.21.15.19:0/1138876547 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6bb40598c0 con 0x7f6bbc162060 2024-09-12T01:56:05.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.996+0000 7f6bc462e640 1 -- 172.21.15.19:0/1138876547 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6bbc0d3320 con 0x7f6bbc162060 2024-09-12T01:56:05.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.996+0000 7f6bb2ffd640 1 -- 172.21.15.19:0/1138876547 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f6bb405dbc0 con 0x7f6bbc162060 2024-09-12T01:56:05.997 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-09-12T01:56:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.998+0000 7f6bc462e640 1 -- 172.21.15.19:0/1138876547 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6ba006be30 msgr2=0x7f6ba006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.998+0000 7f6bc462e640 1 --2- 172.21.15.19:0/1138876547 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6ba006be30 0x7f6ba006e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8006fd0 tx=0x7f6bb8008040 comp rx=0 tx=0).stop 2024-09-12T01:56:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.998+0000 7f6bc462e640 1 -- 172.21.15.19:0/1138876547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bbc162060 msgr2=0x7f6bbc0b9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.998+0000 7f6bc462e640 1 --2- 172.21.15.19:0/1138876547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bbc162060 0x7f6bbc0b9510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4007e90 tx=0x7f6bb400e4b0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.998+0000 7f6bc462e640 1 -- 172.21.15.19:0/1138876547 shutdown_connections 2024-09-12T01:56:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.998+0000 7f6bc462e640 1 --2- 172.21.15.19:0/1138876547 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6ba006be30 0x7f6ba006e2f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.998+0000 7f6bc462e640 1 --2- 172.21.15.19:0/1138876547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bbc162060 0x7f6bbc0b9510 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.998+0000 7f6bc462e640 1 --2- 172.21.15.19:0/1138876547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bbc161c80 0x7f6bbc0cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.998+0000 7f6bc462e640 1 --2- 172.21.15.19:0/1138876547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bbc0b64b0 0x7f6bbc156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.998+0000 7f6bc462e640 1 -- 172.21.15.19:0/1138876547 >> 172.21.15.19:0/1138876547 conn(0x7f6bbc0d44f0 msgr2=0x7f6bbc0b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.998+0000 7f6bc462e640 1 -- 172.21.15.19:0/1138876547 shutdown_connections 2024-09-12T01:56:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:05.998+0000 7f6bc462e640 1 -- 172.21.15.19:0/1138876547 wait complete. 2024-09-12T01:56:06.010 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2024-09-12T01:56:06.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:06.010 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-12T01:56:06.034 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi019.stderr:ceph-fuse[42871]: fuse finished with error 0 and tester_r 0 2024-09-12T01:56:06.036 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:56:12.138 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:56:12.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:12.139 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-12T01:56:12.165 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:56:12.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.320+0000 7fef5f8dd640 1 Processor -- start 2024-09-12T01:56:12.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.320+0000 7fef5f8dd640 1 -- start start 2024-09-12T01:56:12.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.321+0000 7fef5f8dd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fef5806f8d0 0x7fef58165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.321+0000 7fef5f8dd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef580cdbe0 con 0x7fef5815b300 2024-09-12T01:56:12.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.321+0000 7fef5f8dd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef580cd900 con 0x7fef58072d30 2024-09-12T01:56:12.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.321+0000 7fef5f8dd640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fef580728a0 con 0x7fef5806f8d0 2024-09-12T01:56:12.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.321+0000 7fef5d679640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fef5815b300 0x7fef580cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44732/0 (socket says 172.21.15.19:44732) 2024-09-12T01:56:12.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.321+0000 7fef5d679640 1 -- 172.21.15.19:0/4161272616 learned_addr learned my addr 172.21.15.19:0/4161272616 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:12.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.322+0000 7fef5de7a640 1 --2- 172.21.15.19:0/4161272616 >> v2:172.21.15.135:3300/0 conn(0x7fef5806f8d0 0x7fef58165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.322+0000 7fef57fff640 1 -- 172.21.15.19:0/4161272616 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3373459388 0 0) 0x7fef580cdbe0 con 0x7fef5815b300 2024-09-12T01:56:12.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.322+0000 7fef57fff640 1 -- 172.21.15.19:0/4161272616 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef40003520 con 0x7fef5815b300 2024-09-12T01:56:12.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.322+0000 7fef5de7a640 1 -- 172.21.15.19:0/4161272616 >> v1:172.21.15.135:6789/0 conn(0x7fef58072d30 legacy=0x7fef5806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.322+0000 7fef5de7a640 1 -- 172.21.15.19:0/4161272616 >> v1:172.21.15.19:6789/0 conn(0x7fef5815b300 legacy=0x7fef580cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.322+0000 7fef5de7a640 1 -- 172.21.15.19:0/4161272616 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef58072250 con 0x7fef5806f8d0 2024-09-12T01:56:12.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.323+0000 7fef5de7a640 1 --2- 172.21.15.19:0/4161272616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef5806f8d0 0x7fef58165de0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fef500097a0 tx=0x7fef5002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5de73bf07884cbf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:12.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.323+0000 7fef57fff640 1 -- 172.21.15.19:0/4161272616 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef50037070 con 0x7fef5806f8d0 2024-09-12T01:56:12.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.323+0000 7fef57fff640 1 -- 172.21.15.19:0/4161272616 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef50032440 con 0x7fef5806f8d0 2024-09-12T01:56:12.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.323+0000 7fef57fff640 1 -- 172.21.15.19:0/4161272616 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef50032810 con 0x7fef5806f8d0 2024-09-12T01:56:12.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.324+0000 7fef5f8dd640 1 -- 172.21.15.19:0/4161272616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef5806f8d0 msgr2=0x7fef58165de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.324+0000 7fef5f8dd640 1 --2- 172.21.15.19:0/4161272616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef5806f8d0 0x7fef58165de0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fef500097a0 tx=0x7fef5002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.324+0000 7fef5f8dd640 1 -- 172.21.15.19:0/4161272616 shutdown_connections 2024-09-12T01:56:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.324+0000 7fef5f8dd640 1 --2- 172.21.15.19:0/4161272616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef5806f8d0 0x7fef58165de0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.324+0000 7fef5f8dd640 1 -- 172.21.15.19:0/4161272616 >> 172.21.15.19:0/4161272616 conn(0x7fef58067d70 msgr2=0x7fef5806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.324+0000 7fef5f8dd640 1 -- 172.21.15.19:0/4161272616 shutdown_connections 2024-09-12T01:56:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.324+0000 7fef5f8dd640 1 -- 172.21.15.19:0/4161272616 wait complete. 2024-09-12T01:56:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.325+0000 7fef5f8dd640 1 Processor -- start 2024-09-12T01:56:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.325+0000 7fef5f8dd640 1 -- start start 2024-09-12T01:56:12.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.326+0000 7fef5f8dd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef5806f8d0 0x7fef58146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.326+0000 7fef5f8dd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef58072d30 0x7fef580b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.326+0000 7fef5f8dd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef5815b300 0x7fef580b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.326+0000 7fef5f8dd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fef580cffe0 con 0x7fef58072d30 2024-09-12T01:56:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.326+0000 7fef5f8dd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fef580cd5c0 con 0x7fef5815b300 2024-09-12T01:56:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.326+0000 7fef5f8dd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fef580d0160 con 0x7fef5806f8d0 2024-09-12T01:56:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.326+0000 7fef5ce78640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef58072d30 0x7fef580b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.326+0000 7fef5ce78640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef58072d30 0x7fef580b16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41800/0 (socket says 172.21.15.19:41800) 2024-09-12T01:56:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.326+0000 7fef5ce78640 1 -- 172.21.15.19:0/1046324500 learned_addr learned my addr 172.21.15.19:0/1046324500 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.326+0000 7fef5de7a640 1 --2- 172.21.15.19:0/1046324500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef5815b300 0x7fef580b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.326+0000 7fef5d679640 1 --2- 172.21.15.19:0/1046324500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef5806f8d0 0x7fef58146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.326+0000 7fef5ce78640 1 -- 172.21.15.19:0/1046324500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef5806f8d0 msgr2=0x7fef58146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.326+0000 7fef5ce78640 1 --2- 172.21.15.19:0/1046324500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef5806f8d0 0x7fef58146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.326+0000 7fef5ce78640 1 -- 172.21.15.19:0/1046324500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef5815b300 msgr2=0x7fef580b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.326+0000 7fef5ce78640 1 --2- 172.21.15.19:0/1046324500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef5815b300 0x7fef580b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.326+0000 7fef5ce78640 1 -- 172.21.15.19:0/1046324500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef58155ee0 con 0x7fef58072d30 2024-09-12T01:56:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.326+0000 7fef5ce78640 1 --2- 172.21.15.19:0/1046324500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef58072d30 0x7fef580b16f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00c430 tx=0x7fef4c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.326+0000 7fef55ffb640 1 -- 172.21.15.19:0/1046324500 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0052d0 con 0x7fef58072d30 2024-09-12T01:56:12.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.327+0000 7fef55ffb640 1 -- 172.21.15.19:0/1046324500 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef4c005490 con 0x7fef58072d30 2024-09-12T01:56:12.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.327+0000 7fef5f8dd640 1 -- 172.21.15.19:0/1046324500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef58155120 con 0x7fef58072d30 2024-09-12T01:56:12.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.327+0000 7fef55ffb640 1 -- 172.21.15.19:0/1046324500 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c007260 con 0x7fef58072d30 2024-09-12T01:56:12.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.327+0000 7fef5f8dd640 1 -- 172.21.15.19:0/1046324500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef581556e0 con 0x7fef58072d30 2024-09-12T01:56:12.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.328+0000 7fef5f8dd640 1 -- 172.21.15.19:0/1046324500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef5806f1c0 con 0x7fef58072d30 2024-09-12T01:56:12.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.328+0000 7fef55ffb640 1 -- 172.21.15.19:0/1046324500 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef4c007400 con 0x7fef58072d30 2024-09-12T01:56:12.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.329+0000 7fef55ffb640 1 --2- 172.21.15.19:0/1046324500 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef4406be30 0x7fef4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.329+0000 7fef55ffb640 1 -- 172.21.15.19:0/1046324500 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fef4c08a6c0 con 0x7fef58072d30 2024-09-12T01:56:12.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.329+0000 7fef5d679640 1 --2- 172.21.15.19:0/1046324500 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef4406be30 0x7fef4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.330+0000 7fef5d679640 1 --2- 172.21.15.19:0/1046324500 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef4406be30 0x7fef4406e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fef48001560 tx=0x7fef48009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:12.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.333+0000 7fef55ffb640 1 -- 172.21.15.19:0/1046324500 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fef4c058d30 con 0x7fef58072d30 2024-09-12T01:56:12.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.510+0000 7fef5f8dd640 1 -- 172.21.15.19:0/1046324500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef58158e30 con 0x7fef58072d30 2024-09-12T01:56:12.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.511+0000 7fef55ffb640 1 -- 172.21.15.19:0/1046324500 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18586 (secure 0 0 0) 0x7fef4c058630 con 0x7fef58072d30 2024-09-12T01:56:12.512 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:12.512 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:56:01.739727+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:52.899670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:54.099981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:55:57.729901+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:12.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.513+0000 7fef5f8dd640 1 -- 172.21.15.19:0/1046324500 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef4406be30 msgr2=0x7fef4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.513+0000 7fef5f8dd640 1 --2- 172.21.15.19:0/1046324500 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef4406be30 0x7fef4406e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fef48001560 tx=0x7fef48009040 comp rx=0 tx=0).stop 2024-09-12T01:56:12.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.513+0000 7fef5f8dd640 1 -- 172.21.15.19:0/1046324500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef58072d30 msgr2=0x7fef580b16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.513+0000 7fef5f8dd640 1 --2- 172.21.15.19:0/1046324500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef58072d30 0x7fef580b16f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00c430 tx=0x7fef4c00c8f0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.513+0000 7fef5f8dd640 1 -- 172.21.15.19:0/1046324500 shutdown_connections 2024-09-12T01:56:12.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.513+0000 7fef5f8dd640 1 --2- 172.21.15.19:0/1046324500 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef4406be30 0x7fef4406e2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.513+0000 7fef5f8dd640 1 --2- 172.21.15.19:0/1046324500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef5815b300 0x7fef580b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.513+0000 7fef5f8dd640 1 --2- 172.21.15.19:0/1046324500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef58072d30 0x7fef580b16f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.513+0000 7fef5f8dd640 1 --2- 172.21.15.19:0/1046324500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef5806f8d0 0x7fef58146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.513+0000 7fef5f8dd640 1 -- 172.21.15.19:0/1046324500 >> 172.21.15.19:0/1046324500 conn(0x7fef58067d70 msgr2=0x7fef5815d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:12.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.513+0000 7fef5f8dd640 1 -- 172.21.15.19:0/1046324500 shutdown_connections 2024-09-12T01:56:12.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.513+0000 7fef5f8dd640 1 -- 172.21.15.19:0/1046324500 wait complete. 2024-09-12T01:56:12.525 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:56:12.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.626+0000 7fc43c6f8640 1 Processor -- start 2024-09-12T01:56:12.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.626+0000 7fc43c6f8640 1 -- start start 2024-09-12T01:56:12.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.627+0000 7fc43c6f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4340d30f0 0x7fc4340b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.627+0000 7fc43c6f8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4340d3690 con 0x7fc4340b64c0 2024-09-12T01:56:12.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.627+0000 7fc43c6f8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4340d3970 con 0x7fc43415e5f0 2024-09-12T01:56:12.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.627+0000 7fc43c6f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc43406d530 con 0x7fc4340d30f0 2024-09-12T01:56:12.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.627+0000 7fc43ac95640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc4340b64c0 0x7fc43406d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44748/0 (socket says 172.21.15.19:44748) 2024-09-12T01:56:12.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.627+0000 7fc43ac95640 1 -- 172.21.15.19:0/1761447983 learned_addr learned my addr 172.21.15.19:0/1761447983 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:12.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.627+0000 7fc439492640 1 -- 172.21.15.19:0/1761447983 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2840849221 0 0) 0x7fc4340d3690 con 0x7fc4340b64c0 2024-09-12T01:56:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439492640 1 -- 172.21.15.19:0/1761447983 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc420003520 con 0x7fc4340b64c0 2024-09-12T01:56:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.627+0000 7fc439c93640 1 --2- 172.21.15.19:0/1761447983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4340d30f0 0x7fc4340b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439492640 1 -- 172.21.15.19:0/1761447983 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3858878049 0 0) 0x7fc420003520 con 0x7fc4340b64c0 2024-09-12T01:56:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439492640 1 -- 172.21.15.19:0/1761447983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4340d30f0 msgr2=0x7fc4340b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439492640 1 --2- 172.21.15.19:0/1761447983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4340d30f0 0x7fc4340b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439492640 1 -- 172.21.15.19:0/1761447983 >> v1:172.21.15.135:6789/0 conn(0x7fc43415e5f0 legacy=0x7fc4340d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439492640 1 -- 172.21.15.19:0/1761447983 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43406cee0 con 0x7fc4340b64c0 2024-09-12T01:56:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439492640 1 -- 172.21.15.19:0/1761447983 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fc42c0019f0 con 0x7fc4340b64c0 2024-09-12T01:56:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439492640 1 -- 172.21.15.19:0/1761447983 >> v1:172.21.15.19:6789/0 conn(0x7fc4340b64c0 legacy=0x7fc43406d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439492640 1 --2- 172.21.15.19:0/1761447983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4340d30f0 0x7fc4200039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439492640 1 --2- 172.21.15.19:0/1761447983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc420003f60 0x7fc420004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439492640 1 --2- 172.21.15.19:0/1761447983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc420004d40 0x7fc4200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439492640 1 -- 172.21.15.19:0/1761447983 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc43406d530 con 0x7fc420003f60 2024-09-12T01:56:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439492640 1 -- 172.21.15.19:0/1761447983 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc42000baa0 con 0x7fc420004d40 2024-09-12T01:56:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439492640 1 -- 172.21.15.19:0/1761447983 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc42000bca0 con 0x7fc4340d30f0 2024-09-12T01:56:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439c93640 1 --2- 172.21.15.19:0/1761447983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc420003f60 0x7fc420004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc43a494640 1 --2- 172.21.15.19:0/1761447983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4340d30f0 0x7fc4200039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc43ac95640 1 --2- 172.21.15.19:0/1761447983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc420004d40 0x7fc4200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439c93640 1 -- 172.21.15.19:0/1761447983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4340d30f0 msgr2=0x7fc4200039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439c93640 1 --2- 172.21.15.19:0/1761447983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4340d30f0 0x7fc4200039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439c93640 1 -- 172.21.15.19:0/1761447983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc420004d40 msgr2=0x7fc4200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439c93640 1 --2- 172.21.15.19:0/1761447983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc420004d40 0x7fc4200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc439c93640 1 -- 172.21.15.19:0/1761447983 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc420003520 con 0x7fc420003f60 2024-09-12T01:56:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.628+0000 7fc43ac95640 1 --2- 172.21.15.19:0/1761447983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc420004d40 0x7fc4200051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.629+0000 7fc439c93640 1 --2- 172.21.15.19:0/1761447983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc420003f60 0x7fc420004800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc424009a90 tx=0x7fc420005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe0d20fe27b9d09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.629+0000 7fc439492640 1 -- 172.21.15.19:0/1761447983 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc424036070 con 0x7fc420003f60 2024-09-12T01:56:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.629+0000 7fc439492640 1 -- 172.21.15.19:0/1761447983 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc424031400 con 0x7fc420003f60 2024-09-12T01:56:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.629+0000 7fc439492640 1 -- 172.21.15.19:0/1761447983 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc424009690 con 0x7fc420003f60 2024-09-12T01:56:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.630+0000 7fc43c6f8640 1 -- 172.21.15.19:0/1761447983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc420003f60 msgr2=0x7fc420004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.630+0000 7fc43c6f8640 1 --2- 172.21.15.19:0/1761447983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc420003f60 0x7fc420004800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc424009a90 tx=0x7fc420005830 comp rx=0 tx=0).stop 2024-09-12T01:56:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.630+0000 7fc43ac95640 1 -- 172.21.15.19:0/1761447983 reap_dead start 2024-09-12T01:56:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.630+0000 7fc43c6f8640 1 -- 172.21.15.19:0/1761447983 shutdown_connections 2024-09-12T01:56:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.630+0000 7fc43c6f8640 1 -- 172.21.15.19:0/1761447983 >> 172.21.15.19:0/1761447983 conn(0x7fc43408bfc0 msgr2=0x7fc4340d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.630+0000 7fc43c6f8640 1 -- 172.21.15.19:0/1761447983 shutdown_connections 2024-09-12T01:56:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.630+0000 7fc43c6f8640 1 -- 172.21.15.19:0/1761447983 wait complete. 2024-09-12T01:56:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.631+0000 7fc43c6f8640 1 Processor -- start 2024-09-12T01:56:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.631+0000 7fc43c6f8640 1 -- start start 2024-09-12T01:56:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.632+0000 7fc43c6f8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc420003f60 0x7fc4341f3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.632+0000 7fc43c6f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4340b9900 0x7fc43415eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.632+0000 7fc43c6f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc434161010 0x7fc4341614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.632+0000 7fc43c6f8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc4340b5f80 con 0x7fc4340b9900 2024-09-12T01:56:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.632+0000 7fc43c6f8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc43415e9d0 con 0x7fc420003f60 2024-09-12T01:56:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.632+0000 7fc43c6f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc4340b6100 con 0x7fc434161010 2024-09-12T01:56:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.632+0000 7fc439c93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4340b9900 0x7fc43415eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.632+0000 7fc439c93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4340b9900 0x7fc43415eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41820/0 (socket says 172.21.15.19:41820) 2024-09-12T01:56:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.632+0000 7fc439c93640 1 -- 172.21.15.19:0/838434704 learned_addr learned my addr 172.21.15.19:0/838434704 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.632+0000 7fc43ac95640 1 --2- 172.21.15.19:0/838434704 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc434161010 0x7fc4341614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.632+0000 7fc43a494640 1 --2- 172.21.15.19:0/838434704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc420003f60 0x7fc4341f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.632+0000 7fc439c93640 1 -- 172.21.15.19:0/838434704 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc434161010 msgr2=0x7fc4341614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.632+0000 7fc439c93640 1 --2- 172.21.15.19:0/838434704 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc434161010 0x7fc4341614c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.632+0000 7fc439c93640 1 -- 172.21.15.19:0/838434704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc420003f60 msgr2=0x7fc4341f3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.632+0000 7fc439c93640 1 --2- 172.21.15.19:0/838434704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc420003f60 0x7fc4341f3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.632+0000 7fc439c93640 1 -- 172.21.15.19:0/838434704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43415f4a0 con 0x7fc4340b9900 2024-09-12T01:56:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.632+0000 7fc439c93640 1 --2- 172.21.15.19:0/838434704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4340b9900 0x7fc43415eb50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc424009a90 tx=0x7fc424004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:12.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.633+0000 7fc42affd640 1 -- 172.21.15.19:0/838434704 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc424040020 con 0x7fc4340b9900 2024-09-12T01:56:12.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.633+0000 7fc42affd640 1 -- 172.21.15.19:0/838434704 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc42403b660 con 0x7fc4340b9900 2024-09-12T01:56:12.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.633+0000 7fc42affd640 1 -- 172.21.15.19:0/838434704 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc424036040 con 0x7fc4340b9900 2024-09-12T01:56:12.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.633+0000 7fc43c6f8640 1 -- 172.21.15.19:0/838434704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc43415f780 con 0x7fc4340b9900 2024-09-12T01:56:12.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.633+0000 7fc43c6f8640 1 -- 172.21.15.19:0/838434704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc43415fd40 con 0x7fc4340b9900 2024-09-12T01:56:12.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.634+0000 7fc43c6f8640 1 -- 172.21.15.19:0/838434704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4340d3530 con 0x7fc4340b9900 2024-09-12T01:56:12.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.634+0000 7fc42affd640 1 -- 172.21.15.19:0/838434704 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc424043020 con 0x7fc4340b9900 2024-09-12T01:56:12.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.635+0000 7fc42affd640 1 --2- 172.21.15.19:0/838434704 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc41806be60 0x7fc41806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.635+0000 7fc42affd640 1 -- 172.21.15.19:0/838434704 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc4240ab8c0 con 0x7fc4340b9900 2024-09-12T01:56:12.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.635+0000 7fc43a494640 1 --2- 172.21.15.19:0/838434704 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc41806be60 0x7fc41806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.635+0000 7fc43a494640 1 --2- 172.21.15.19:0/838434704 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc41806be60 0x7fc41806e320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc4300035f0 tx=0x7fc430009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:12.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.639+0000 7fc42affd640 1 -- 172.21.15.19:0/838434704 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc42404a030 con 0x7fc4340b9900 2024-09-12T01:56:12.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.816+0000 7fc43c6f8640 1 -- 172.21.15.19:0/838434704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc43406bda0 con 0x7fc4340b9900 2024-09-12T01:56:12.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.818+0000 7fc42affd640 1 -- 172.21.15.19:0/838434704 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18586 (secure 0 0 0) 0x7fc424079f30 con 0x7fc4340b9900 2024-09-12T01:56:12.818 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:12.818 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:56:01.739727+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:52.899670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:54.099981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:55:57.729901+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:12.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.820+0000 7fc43c6f8640 1 -- 172.21.15.19:0/838434704 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc41806be60 msgr2=0x7fc41806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.820+0000 7fc43c6f8640 1 --2- 172.21.15.19:0/838434704 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc41806be60 0x7fc41806e320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc4300035f0 tx=0x7fc430009040 comp rx=0 tx=0).stop 2024-09-12T01:56:12.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.820+0000 7fc43c6f8640 1 -- 172.21.15.19:0/838434704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4340b9900 msgr2=0x7fc43415eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.820+0000 7fc43c6f8640 1 --2- 172.21.15.19:0/838434704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4340b9900 0x7fc43415eb50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc424009a90 tx=0x7fc424004730 comp rx=0 tx=0).stop 2024-09-12T01:56:12.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.820+0000 7fc43c6f8640 1 -- 172.21.15.19:0/838434704 shutdown_connections 2024-09-12T01:56:12.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.820+0000 7fc43c6f8640 1 --2- 172.21.15.19:0/838434704 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc41806be60 0x7fc41806e320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.820+0000 7fc43c6f8640 1 --2- 172.21.15.19:0/838434704 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc434161010 0x7fc4341614c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.820+0000 7fc43c6f8640 1 --2- 172.21.15.19:0/838434704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4340b9900 0x7fc43415eb50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.820+0000 7fc43c6f8640 1 --2- 172.21.15.19:0/838434704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc420003f60 0x7fc4341f3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.820+0000 7fc43c6f8640 1 -- 172.21.15.19:0/838434704 >> 172.21.15.19:0/838434704 conn(0x7fc43408bfc0 msgr2=0x7fc43406d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:12.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.820+0000 7fc43c6f8640 1 -- 172.21.15.19:0/838434704 shutdown_connections 2024-09-12T01:56:12.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.820+0000 7fc43c6f8640 1 -- 172.21.15.19:0/838434704 wait complete. 2024-09-12T01:56:12.832 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:56:12.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.937+0000 7f0e3fa53640 1 Processor -- start 2024-09-12T01:56:12.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.937+0000 7f0e3fa53640 1 -- start start 2024-09-12T01:56:12.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.938+0000 7f0e3fa53640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0e38162340 0x7f0e3806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.938+0000 7f0e3fa53640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0e380cf280 0x7f0e38162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.938+0000 7f0e3fa53640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e3815ff70 con 0x7f0e38162c60 2024-09-12T01:56:12.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.938+0000 7f0e3fa53640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f0e3806de90 con 0x7f0e38162340 2024-09-12T01:56:12.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.938+0000 7f0e3fa53640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0e380d4d10 con 0x7f0e380cf280 2024-09-12T01:56:12.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.938+0000 7f0e3d7ef640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0e38162340 0x7f0e3806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.938+0000 7f0e3d7ef640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0e38162340 0x7f0e3806d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41824/0 (socket says 172.21.15.19:41824) 2024-09-12T01:56:12.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.938+0000 7f0e3d7ef640 1 -- 172.21.15.19:0/469576187 learned_addr learned my addr 172.21.15.19:0/469576187 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:12.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.938+0000 7f0e3cfee640 1 --2- 172.21.15.19:0/469576187 >> v2:172.21.15.135:3300/0 conn(0x7f0e380cf280 0x7f0e38162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.938+0000 7f0e3d7ef640 1 -- 172.21.15.19:0/469576187 >> v2:172.21.15.135:3300/0 conn(0x7f0e380cf280 msgr2=0x7f0e38162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:12.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.938+0000 7f0e3d7ef640 1 --2- 172.21.15.19:0/469576187 >> v2:172.21.15.135:3300/0 conn(0x7f0e380cf280 0x7f0e38162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.938+0000 7f0e3d7ef640 1 -- 172.21.15.19:0/469576187 >> v1:172.21.15.135:6789/0 conn(0x7f0e38162c60 legacy=0x7f0e380d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:12.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.939+0000 7f0e3d7ef640 1 -- 172.21.15.19:0/469576187 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e380d4ff0 con 0x7f0e38162340 2024-09-12T01:56:12.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.939+0000 7f0e3d7ef640 1 --2- 172.21.15.19:0/469576187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e38162340 0x7f0e3806d740 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0e380a23d0 tx=0x7f0e3402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896c84a1413f120b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:12.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.939+0000 7f0e2ffff640 1 -- 172.21.15.19:0/469576187 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e34037070 con 0x7f0e38162340 2024-09-12T01:56:12.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.939+0000 7f0e2ffff640 1 -- 172.21.15.19:0/469576187 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e34032440 con 0x7f0e38162340 2024-09-12T01:56:12.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.939+0000 7f0e2ffff640 1 -- 172.21.15.19:0/469576187 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e34032810 con 0x7f0e38162340 2024-09-12T01:56:12.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.940+0000 7f0e3fa53640 1 -- 172.21.15.19:0/469576187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e38162340 msgr2=0x7f0e3806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.940+0000 7f0e3fa53640 1 --2- 172.21.15.19:0/469576187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e38162340 0x7f0e3806d740 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0e380a23d0 tx=0x7f0e3402a1a0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.940+0000 7f0e3fa53640 1 -- 172.21.15.19:0/469576187 shutdown_connections 2024-09-12T01:56:12.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.940+0000 7f0e3fa53640 1 --2- 172.21.15.19:0/469576187 >> v2:172.21.15.135:3300/0 conn(0x7f0e380cf280 0x7f0e38162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.940+0000 7f0e3fa53640 1 --2- 172.21.15.19:0/469576187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e38162340 0x7f0e3806d740 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.940+0000 7f0e3fa53640 1 -- 172.21.15.19:0/469576187 >> 172.21.15.19:0/469576187 conn(0x7f0e3808bfc0 msgr2=0x7f0e380d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:12.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.940+0000 7f0e3fa53640 1 -- 172.21.15.19:0/469576187 shutdown_connections 2024-09-12T01:56:12.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.940+0000 7f0e3fa53640 1 -- 172.21.15.19:0/469576187 wait complete. 2024-09-12T01:56:12.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.941+0000 7f0e3fa53640 1 Processor -- start 2024-09-12T01:56:12.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.941+0000 7f0e3fa53640 1 -- start start 2024-09-12T01:56:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.942+0000 7f0e3fa53640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e380cf280 0x7f0e38159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.942+0000 7f0e3fa53640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e38162340 0x7f0e380b9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.942+0000 7f0e3fa53640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e38162c60 0x7f0e380b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.942+0000 7f0e3fa53640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0e380cf6c0 con 0x7f0e38162c60 2024-09-12T01:56:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.942+0000 7f0e3fa53640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0e380d52d0 con 0x7f0e380cf280 2024-09-12T01:56:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.942+0000 7f0e3fa53640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0e381630d0 con 0x7f0e38162340 2024-09-12T01:56:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.942+0000 7f0e3dff0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e38162c60 0x7f0e380b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.942+0000 7f0e3dff0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e38162c60 0x7f0e380b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41826/0 (socket says 172.21.15.19:41826) 2024-09-12T01:56:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.942+0000 7f0e3d7ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e380cf280 0x7f0e38159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.942+0000 7f0e3dff0640 1 -- 172.21.15.19:0/1731804276 learned_addr learned my addr 172.21.15.19:0/1731804276 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.942+0000 7f0e3cfee640 1 --2- 172.21.15.19:0/1731804276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e38162340 0x7f0e380b9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.943+0000 7f0e3dff0640 1 -- 172.21.15.19:0/1731804276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e38162340 msgr2=0x7f0e380b9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.943+0000 7f0e3dff0640 1 --2- 172.21.15.19:0/1731804276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e38162340 0x7f0e380b9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.943+0000 7f0e3dff0640 1 -- 172.21.15.19:0/1731804276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e380cf280 msgr2=0x7f0e38159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.943+0000 7f0e3dff0640 1 --2- 172.21.15.19:0/1731804276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e380cf280 0x7f0e38159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.943+0000 7f0e3dff0640 1 -- 172.21.15.19:0/1731804276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e380b3f30 con 0x7f0e38162c60 2024-09-12T01:56:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.943+0000 7f0e3dff0640 1 --2- 172.21.15.19:0/1731804276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e38162c60 0x7f0e380b5270 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000b970 tx=0x7f0e3000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.943+0000 7f0e2dffb640 1 -- 172.21.15.19:0/1731804276 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e30019070 con 0x7f0e38162c60 2024-09-12T01:56:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.943+0000 7f0e2dffb640 1 -- 172.21.15.19:0/1731804276 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e3000cb40 con 0x7f0e38162c60 2024-09-12T01:56:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.943+0000 7f0e2dffb640 1 -- 172.21.15.19:0/1731804276 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e30014440 con 0x7f0e38162c60 2024-09-12T01:56:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.943+0000 7f0e3fa53640 1 -- 172.21.15.19:0/1731804276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e380b41d0 con 0x7f0e38162c60 2024-09-12T01:56:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.943+0000 7f0e3fa53640 1 -- 172.21.15.19:0/1731804276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e380b4790 con 0x7f0e38162c60 2024-09-12T01:56:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.944+0000 7f0e3fa53640 1 -- 172.21.15.19:0/1731804276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e38162720 con 0x7f0e38162c60 2024-09-12T01:56:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.944+0000 7f0e2dffb640 1 -- 172.21.15.19:0/1731804276 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e3001c070 con 0x7f0e38162c60 2024-09-12T01:56:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.945+0000 7f0e2dffb640 1 --2- 172.21.15.19:0/1731804276 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0e1c06be30 0x7f0e1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.945+0000 7f0e2dffb640 1 -- 172.21.15.19:0/1731804276 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0e3008ade0 con 0x7f0e38162c60 2024-09-12T01:56:12.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.945+0000 7f0e3d7ef640 1 --2- 172.21.15.19:0/1731804276 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0e1c06be30 0x7f0e1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.946+0000 7f0e3d7ef640 1 --2- 172.21.15.19:0/1731804276 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0e1c06be30 0x7f0e1c06e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0e34034000 tx=0x7f0e3402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:12.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:12.949+0000 7f0e2dffb640 1 -- 172.21.15.19:0/1731804276 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e30058d60 con 0x7f0e38162c60 2024-09-12T01:56:13.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.160+0000 7f0e3fa53640 1 -- 172.21.15.19:0/1731804276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0e381602e0 con 0x7f0e38162c60 2024-09-12T01:56:13.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.777+0000 7f0e2dffb640 1 -- 172.21.15.19:0/1731804276 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f0e3005d060 con 0x7f0e38162c60 2024-09-12T01:56:13.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.779+0000 7f0e3fa53640 1 -- 172.21.15.19:0/1731804276 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0e1c06be30 msgr2=0x7f0e1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:13.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.779+0000 7f0e3fa53640 1 --2- 172.21.15.19:0/1731804276 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0e1c06be30 0x7f0e1c06e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0e34034000 tx=0x7f0e3402e000 comp rx=0 tx=0).stop 2024-09-12T01:56:13.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.779+0000 7f0e3fa53640 1 -- 172.21.15.19:0/1731804276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e38162c60 msgr2=0x7f0e380b5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:13.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.779+0000 7f0e3fa53640 1 --2- 172.21.15.19:0/1731804276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e38162c60 0x7f0e380b5270 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000b970 tx=0x7f0e3000be30 comp rx=0 tx=0).stop 2024-09-12T01:56:13.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.780+0000 7f0e3fa53640 1 -- 172.21.15.19:0/1731804276 shutdown_connections 2024-09-12T01:56:13.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.780+0000 7f0e3fa53640 1 --2- 172.21.15.19:0/1731804276 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0e1c06be30 0x7f0e1c06e2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.780+0000 7f0e3fa53640 1 --2- 172.21.15.19:0/1731804276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e38162c60 0x7f0e380b5270 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.780+0000 7f0e3fa53640 1 --2- 172.21.15.19:0/1731804276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e38162340 0x7f0e380b9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.780+0000 7f0e3fa53640 1 --2- 172.21.15.19:0/1731804276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e380cf280 0x7f0e38159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.780+0000 7f0e3fa53640 1 -- 172.21.15.19:0/1731804276 >> 172.21.15.19:0/1731804276 conn(0x7f0e3808bfc0 msgr2=0x7f0e380d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:13.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.780+0000 7f0e3fa53640 1 -- 172.21.15.19:0/1731804276 shutdown_connections 2024-09-12T01:56:13.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.780+0000 7f0e3fa53640 1 -- 172.21.15.19:0/1731804276 wait complete. 2024-09-12T01:56:13.794 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-12T01:56:13.794 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T01:56:13.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.905+0000 7fd40ae65640 1 Processor -- start 2024-09-12T01:56:13.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.905+0000 7fd40ae65640 1 -- start start 2024-09-12T01:56:13.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.906+0000 7fd40ae65640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd404071180 0x7fd404169200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:13.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.906+0000 7fd40ae65640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd40406cdc0 con 0x7fd4040af210 2024-09-12T01:56:13.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.906+0000 7fd40ae65640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd40406d0a0 con 0x7fd40415e7f0 2024-09-12T01:56:13.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.906+0000 7fd40ae65640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd40406d380 con 0x7fd404071180 2024-09-12T01:56:13.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.906+0000 7fd403fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd4040af210 0x7fd404070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44752/0 (socket says 172.21.15.19:44752) 2024-09-12T01:56:13.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.906+0000 7fd403fff640 1 -- 172.21.15.19:0/3473998085 learned_addr learned my addr 172.21.15.19:0/3473998085 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:13.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.906+0000 7fd409402640 1 --2- 172.21.15.19:0/3473998085 >> v2:172.21.15.19:3300/0 conn(0x7fd404071180 0x7fd404169200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:13.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.907+0000 7fd4037fe640 1 -- 172.21.15.19:0/3473998085 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2547579781 0 0) 0x7fd40406cdc0 con 0x7fd4040af210 2024-09-12T01:56:13.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.907+0000 7fd4037fe640 1 -- 172.21.15.19:0/3473998085 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3ec003520 con 0x7fd4040af210 2024-09-12T01:56:13.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.907+0000 7fd409402640 1 -- 172.21.15.19:0/3473998085 >> v1:172.21.15.135:6789/0 conn(0x7fd40415e7f0 legacy=0x7fd4040b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:13.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.907+0000 7fd4037fe640 1 -- 172.21.15.19:0/3473998085 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1057212622 0 0) 0x7fd40406d0a0 con 0x7fd40415e7f0 2024-09-12T01:56:13.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.907+0000 7fd409402640 1 -- 172.21.15.19:0/3473998085 >> v1:172.21.15.19:6789/0 conn(0x7fd4040af210 legacy=0x7fd404070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:13.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.907+0000 7fd409402640 1 -- 172.21.15.19:0/3473998085 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40406d660 con 0x7fd404071180 2024-09-12T01:56:13.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.908+0000 7fd409402640 1 --2- 172.21.15.19:0/3473998085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd404071180 0x7fd404169200 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009d90 tx=0x7fd3fc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b88a33ce124bed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:13.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.908+0000 7fd4037fe640 1 -- 172.21.15.19:0/3473998085 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc007740 con 0x7fd404071180 2024-09-12T01:56:13.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.908+0000 7fd4037fe640 1 -- 172.21.15.19:0/3473998085 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3fc0078e0 con 0x7fd404071180 2024-09-12T01:56:13.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.908+0000 7fd4037fe640 1 -- 172.21.15.19:0/3473998085 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc007c90 con 0x7fd404071180 2024-09-12T01:56:13.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.908+0000 7fd40ae65640 1 -- 172.21.15.19:0/3473998085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd404071180 msgr2=0x7fd404169200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:13.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.908+0000 7fd40ae65640 1 --2- 172.21.15.19:0/3473998085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd404071180 0x7fd404169200 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009d90 tx=0x7fd3fc02a6f0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.908+0000 7fd40ae65640 1 -- 172.21.15.19:0/3473998085 shutdown_connections 2024-09-12T01:56:13.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.908+0000 7fd40ae65640 1 --2- 172.21.15.19:0/3473998085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd404071180 0x7fd404169200 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.908+0000 7fd40ae65640 1 -- 172.21.15.19:0/3473998085 >> 172.21.15.19:0/3473998085 conn(0x7fd4040b3f30 msgr2=0x7fd4040b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:13.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.908+0000 7fd40ae65640 1 -- 172.21.15.19:0/3473998085 shutdown_connections 2024-09-12T01:56:13.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.909+0000 7fd40ae65640 1 -- 172.21.15.19:0/3473998085 wait complete. 2024-09-12T01:56:13.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.910+0000 7fd40ae65640 1 Processor -- start 2024-09-12T01:56:13.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.910+0000 7fd40ae65640 1 -- start start 2024-09-12T01:56:13.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd40ae65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd404071180 0x7fd404161880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:13.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd40ae65640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4040af210 0x7fd40415fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:13.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd40ae65640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd40415e7f0 0x7fd40414f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:13.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd40ae65640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd4040b60c0 con 0x7fd404071180 2024-09-12T01:56:13.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd40ae65640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd4040b5f40 con 0x7fd40415e7f0 2024-09-12T01:56:13.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd40ae65640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd404169740 con 0x7fd4040af210 2024-09-12T01:56:13.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd408c01640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd404071180 0x7fd404161880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:13.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd408c01640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd404071180 0x7fd404161880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41844/0 (socket says 172.21.15.19:41844) 2024-09-12T01:56:13.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd408c01640 1 -- 172.21.15.19:0/1136250076 learned_addr learned my addr 172.21.15.19:0/1136250076 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:13.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd403fff640 1 --2- 172.21.15.19:0/1136250076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4040af210 0x7fd40415fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:13.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd409402640 1 --2- 172.21.15.19:0/1136250076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd40415e7f0 0x7fd40414f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:13.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd408c01640 1 -- 172.21.15.19:0/1136250076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4040af210 msgr2=0x7fd40415fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:13.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd408c01640 1 --2- 172.21.15.19:0/1136250076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4040af210 0x7fd40415fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd408c01640 1 -- 172.21.15.19:0/1136250076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd40415e7f0 msgr2=0x7fd40414f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:13.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd408c01640 1 --2- 172.21.15.19:0/1136250076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd40415e7f0 0x7fd40414f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd408c01640 1 -- 172.21.15.19:0/1136250076 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd404160080 con 0x7fd404071180 2024-09-12T01:56:13.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd408c01640 1 --2- 172.21.15.19:0/1136250076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd404071180 0x7fd404161880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400c4e0 tx=0x7fd3f400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:13.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd4017fa640 1 -- 172.21.15.19:0/1136250076 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4017070 con 0x7fd404071180 2024-09-12T01:56:13.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd4017fa640 1 -- 172.21.15.19:0/1136250076 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f40035f0 con 0x7fd404071180 2024-09-12T01:56:13.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd40ae65640 1 -- 172.21.15.19:0/1136250076 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd404160360 con 0x7fd404071180 2024-09-12T01:56:13.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd4017fa640 1 -- 172.21.15.19:0/1136250076 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f40039e0 con 0x7fd404071180 2024-09-12T01:56:13.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.911+0000 7fd40ae65640 1 -- 172.21.15.19:0/1136250076 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd404160920 con 0x7fd404071180 2024-09-12T01:56:13.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.913+0000 7fd40ae65640 1 -- 172.21.15.19:0/1136250076 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd404070a70 con 0x7fd404071180 2024-09-12T01:56:13.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.913+0000 7fd4017fa640 1 -- 172.21.15.19:0/1136250076 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd3f401a070 con 0x7fd404071180 2024-09-12T01:56:13.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.913+0000 7fd4017fa640 1 --2- 172.21.15.19:0/1136250076 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd3f006be30 0x7fd3f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:13.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.914+0000 7fd4017fa640 1 -- 172.21.15.19:0/1136250076 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd3f408a3f0 con 0x7fd404071180 2024-09-12T01:56:13.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.914+0000 7fd403fff640 1 --2- 172.21.15.19:0/1136250076 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd3f006be30 0x7fd3f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:13.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.914+0000 7fd403fff640 1 --2- 172.21.15.19:0/1136250076 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd3f006be30 0x7fd3f006e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd404161dc0 tx=0x7fd3f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:13.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:13.918+0000 7fd4017fa640 1 -- 172.21.15.19:0/1136250076 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3f4058410 con 0x7fd404071180 2024-09-12T01:56:14.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.132+0000 7fd40ae65640 1 -- 172.21.15.19:0/1136250076 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd40406ea00 con 0x7fd404071180 2024-09-12T01:56:14.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.781+0000 7fd4017fa640 1 -- 172.21.15.19:0/1136250076 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fd3f405c710 con 0x7fd404071180 2024-09-12T01:56:14.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.784+0000 7fd40ae65640 1 -- 172.21.15.19:0/1136250076 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd3f006be30 msgr2=0x7fd3f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:14.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.784+0000 7fd40ae65640 1 --2- 172.21.15.19:0/1136250076 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd3f006be30 0x7fd3f006e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd404161dc0 tx=0x7fd3f8009040 comp rx=0 tx=0).stop 2024-09-12T01:56:14.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.784+0000 7fd40ae65640 1 -- 172.21.15.19:0/1136250076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd404071180 msgr2=0x7fd404161880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:14.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.784+0000 7fd40ae65640 1 --2- 172.21.15.19:0/1136250076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd404071180 0x7fd404161880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400c4e0 tx=0x7fd3f400c9a0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.784+0000 7fd40ae65640 1 -- 172.21.15.19:0/1136250076 shutdown_connections 2024-09-12T01:56:14.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.784+0000 7fd40ae65640 1 --2- 172.21.15.19:0/1136250076 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd3f006be30 0x7fd3f006e2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.784+0000 7fd40ae65640 1 --2- 172.21.15.19:0/1136250076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd40415e7f0 0x7fd40414f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.784+0000 7fd40ae65640 1 --2- 172.21.15.19:0/1136250076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4040af210 0x7fd40415fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.784+0000 7fd40ae65640 1 --2- 172.21.15.19:0/1136250076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd404071180 0x7fd404161880 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.784+0000 7fd40ae65640 1 -- 172.21.15.19:0/1136250076 >> 172.21.15.19:0/1136250076 conn(0x7fd4040b3f30 msgr2=0x7fd4040b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:14.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.785+0000 7fd40ae65640 1 -- 172.21.15.19:0/1136250076 shutdown_connections 2024-09-12T01:56:14.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.785+0000 7fd40ae65640 1 -- 172.21.15.19:0/1136250076 wait complete. 2024-09-12T01:56:14.799 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T01:56:14.799 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:56:14.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.911+0000 7f17ad5cf640 1 Processor -- start 2024-09-12T01:56:14.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.911+0000 7f17ad5cf640 1 -- start start 2024-09-12T01:56:14.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.912+0000 7f17ad5cf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17a8162060 0x7f17a80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:14.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.912+0000 7f17ad5cf640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f17a80b64b0 0x7f17a80b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:14.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.912+0000 7f17ad5cf640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a806d9f0 con 0x7f17a8161c80 2024-09-12T01:56:14.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.912+0000 7f17ad5cf640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f17a806dcd0 con 0x7f17a80b64b0 2024-09-12T01:56:14.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.912+0000 7f17ad5cf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f17a806dfb0 con 0x7f17a8162060 2024-09-12T01:56:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.912+0000 7f17a6ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f17a8161c80 0x7f17a806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44756/0 (socket says 172.21.15.19:44756) 2024-09-12T01:56:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.912+0000 7f17a6ffd640 1 -- 172.21.15.19:0/4003207458 learned_addr learned my addr 172.21.15.19:0/4003207458 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.912+0000 7f17a77fe640 1 --2- 172.21.15.19:0/4003207458 >> v2:172.21.15.135:3300/0 conn(0x7f17a80b64b0 0x7f17a80b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.912+0000 7f17a67fc640 1 --2- 172.21.15.19:0/4003207458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17a8162060 0x7f17a80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.912+0000 7f17a5ffb640 1 -- 172.21.15.19:0/4003207458 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2409032596 0 0) 0x7f17a806d9f0 con 0x7f17a8161c80 2024-09-12T01:56:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.912+0000 7f17a5ffb640 1 -- 172.21.15.19:0/4003207458 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1794003520 con 0x7f17a8161c80 2024-09-12T01:56:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.913+0000 7f17a67fc640 1 -- 172.21.15.19:0/4003207458 >> v2:172.21.15.135:3300/0 conn(0x7f17a80b64b0 msgr2=0x7f17a80b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.913+0000 7f17a67fc640 1 --2- 172.21.15.19:0/4003207458 >> v2:172.21.15.135:3300/0 conn(0x7f17a80b64b0 0x7f17a80b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.913+0000 7f17a67fc640 1 -- 172.21.15.19:0/4003207458 >> v1:172.21.15.19:6789/0 conn(0x7f17a8161c80 legacy=0x7f17a806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.913+0000 7f17a67fc640 1 -- 172.21.15.19:0/4003207458 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a80d01f0 con 0x7f17a8162060 2024-09-12T01:56:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.913+0000 7f17a77fe640 1 --2- 172.21.15.19:0/4003207458 >> v2:172.21.15.135:3300/0 conn(0x7f17a80b64b0 0x7f17a80b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:14.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.914+0000 7f17a67fc640 1 --2- 172.21.15.19:0/4003207458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17a8162060 0x7f17a80b5f70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f17980097a0 tx=0x7f179802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43d0b23865877858 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:14.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.914+0000 7f17a5ffb640 1 -- 172.21.15.19:0/4003207458 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1798037070 con 0x7f17a8162060 2024-09-12T01:56:14.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.914+0000 7f17a5ffb640 1 -- 172.21.15.19:0/4003207458 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1798032440 con 0x7f17a8162060 2024-09-12T01:56:14.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.914+0000 7f17a5ffb640 1 -- 172.21.15.19:0/4003207458 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1798032810 con 0x7f17a8162060 2024-09-12T01:56:14.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.914+0000 7f17ad5cf640 1 -- 172.21.15.19:0/4003207458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17a8162060 msgr2=0x7f17a80b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:14.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.914+0000 7f17ad5cf640 1 --2- 172.21.15.19:0/4003207458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17a8162060 0x7f17a80b5f70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f17980097a0 tx=0x7f179802a180 comp rx=0 tx=0).stop 2024-09-12T01:56:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.914+0000 7f17ad5cf640 1 -- 172.21.15.19:0/4003207458 shutdown_connections 2024-09-12T01:56:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.914+0000 7f17ad5cf640 1 --2- 172.21.15.19:0/4003207458 >> v2:172.21.15.135:3300/0 conn(0x7f17a80b64b0 0x7f17a80b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.914+0000 7f17ad5cf640 1 --2- 172.21.15.19:0/4003207458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17a8162060 0x7f17a80b5f70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.914+0000 7f17ad5cf640 1 -- 172.21.15.19:0/4003207458 >> 172.21.15.19:0/4003207458 conn(0x7f17a80d44f0 msgr2=0x7f17a80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.915+0000 7f17ad5cf640 1 -- 172.21.15.19:0/4003207458 shutdown_connections 2024-09-12T01:56:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.915+0000 7f17ad5cf640 1 -- 172.21.15.19:0/4003207458 wait complete. 2024-09-12T01:56:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.916+0000 7f17ad5cf640 1 Processor -- start 2024-09-12T01:56:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.916+0000 7f17ad5cf640 1 -- start start 2024-09-12T01:56:14.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.917+0000 7f17ad5cf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a80b64b0 0x7f17a80ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:14.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.917+0000 7f17ad5cf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17a8161c80 0x7f17a80b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:14.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.917+0000 7f17ad5cf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17a8162060 0x7f17a80b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:14.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.917+0000 7f17ad5cf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f17a80cf1e0 con 0x7f17a80b64b0 2024-09-12T01:56:14.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.917+0000 7f17ad5cf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f17a80d2aa0 con 0x7f17a8161c80 2024-09-12T01:56:14.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.917+0000 7f17ad5cf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f17a80cf360 con 0x7f17a8162060 2024-09-12T01:56:14.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.917+0000 7f17a6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a80b64b0 0x7f17a80ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:14.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.917+0000 7f17a6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a80b64b0 0x7f17a80ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41848/0 (socket says 172.21.15.19:41848) 2024-09-12T01:56:14.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.917+0000 7f17a6ffd640 1 -- 172.21.15.19:0/1678409046 learned_addr learned my addr 172.21.15.19:0/1678409046 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:14.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.917+0000 7f17a77fe640 1 --2- 172.21.15.19:0/1678409046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17a8162060 0x7f17a80b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:14.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.917+0000 7f17a67fc640 1 --2- 172.21.15.19:0/1678409046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17a8161c80 0x7f17a80b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:14.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.917+0000 7f17a6ffd640 1 -- 172.21.15.19:0/1678409046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17a8162060 msgr2=0x7f17a80b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:14.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.917+0000 7f17a6ffd640 1 --2- 172.21.15.19:0/1678409046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17a8162060 0x7f17a80b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.918+0000 7f17a6ffd640 1 -- 172.21.15.19:0/1678409046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17a8161c80 msgr2=0x7f17a80b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:14.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.918+0000 7f17a6ffd640 1 --2- 172.21.15.19:0/1678409046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17a8161c80 0x7f17a80b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.918+0000 7f17a6ffd640 1 -- 172.21.15.19:0/1678409046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a80b9380 con 0x7f17a80b64b0 2024-09-12T01:56:14.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.918+0000 7f17a6ffd640 1 --2- 172.21.15.19:0/1678409046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a80b64b0 0x7f17a80ce220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f179000c430 tx=0x7f179000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:14.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.918+0000 7f179f7fe640 1 -- 172.21.15.19:0/1678409046 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1790017070 con 0x7f17a80b64b0 2024-09-12T01:56:14.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.918+0000 7f179f7fe640 1 -- 172.21.15.19:0/1678409046 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1790005ce0 con 0x7f17a80b64b0 2024-09-12T01:56:14.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.918+0000 7f17ad5cf640 1 -- 172.21.15.19:0/1678409046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a80b85e0 con 0x7f17a80b64b0 2024-09-12T01:56:14.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.918+0000 7f179f7fe640 1 -- 172.21.15.19:0/1678409046 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17900072f0 con 0x7f17a80b64b0 2024-09-12T01:56:14.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.918+0000 7f17ad5cf640 1 -- 172.21.15.19:0/1678409046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a80b8ba0 con 0x7f17a80b64b0 2024-09-12T01:56:14.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.919+0000 7f17ad5cf640 1 -- 172.21.15.19:0/1678409046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a80b5f70 con 0x7f17a80b64b0 2024-09-12T01:56:14.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.919+0000 7f179f7fe640 1 -- 172.21.15.19:0/1678409046 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f179001a070 con 0x7f17a80b64b0 2024-09-12T01:56:14.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.920+0000 7f179f7fe640 1 --2- 172.21.15.19:0/1678409046 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f178806be30 0x7f178806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:14.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.920+0000 7f179f7fe640 1 -- 172.21.15.19:0/1678409046 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f179008a460 con 0x7f17a80b64b0 2024-09-12T01:56:14.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.921+0000 7f17a67fc640 1 --2- 172.21.15.19:0/1678409046 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f178806be30 0x7f178806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:14.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.921+0000 7f17a67fc640 1 --2- 172.21.15.19:0/1678409046 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f178806be30 0x7f178806e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1798034000 tx=0x7f179802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:14.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:14.924+0000 7f179f7fe640 1 -- 172.21.15.19:0/1678409046 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f17a80b9380 con 0x7f17a80b64b0 2024-09-12T01:56:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.139+0000 7f17ad5cf640 1 -- 172.21.15.19:0/1678409046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17a80ba470 con 0x7f17a80b64b0 2024-09-12T01:56:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.140+0000 7f179f7fe640 1 -- 172.21.15.19:0/1678409046 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f1790058510 con 0x7f17a80b64b0 2024-09-12T01:56:15.140 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:15.140 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"btime":"2024-09-12T01:56:14:778796+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4024559276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":4024559276},{"type":"v1","addr":"172.21.15.135:6837","nonce":4024559276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3369866614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3369866614},{"type":"v1","addr":"172.21.15.19:6834","nonce":3369866614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2476634027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2476634027},{"type":"v1","addr":"172.21.15.19:6835","nonce":2476634027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:55:55.036100+0000","modified":"2024-09-12T01:56:14.133810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/4290669195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4290669195},{"type":"v1","addr":"172.21.15.135:6836","nonce":4290669195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-09-12T01:56:15.141 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2024-09-12T01:56:15.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.142+0000 7f17ad5cf640 1 -- 172.21.15.19:0/1678409046 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f178806be30 msgr2=0x7f178806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.142+0000 7f17ad5cf640 1 --2- 172.21.15.19:0/1678409046 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f178806be30 0x7f178806e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1798034000 tx=0x7f179802e000 comp rx=0 tx=0).stop 2024-09-12T01:56:15.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.142+0000 7f17ad5cf640 1 -- 172.21.15.19:0/1678409046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a80b64b0 msgr2=0x7f17a80ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.142+0000 7f17ad5cf640 1 --2- 172.21.15.19:0/1678409046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a80b64b0 0x7f17a80ce220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f179000c430 tx=0x7f179000c830 comp rx=0 tx=0).stop 2024-09-12T01:56:15.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.142+0000 7f17ad5cf640 1 -- 172.21.15.19:0/1678409046 shutdown_connections 2024-09-12T01:56:15.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.142+0000 7f17ad5cf640 1 --2- 172.21.15.19:0/1678409046 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f178806be30 0x7f178806e2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.142+0000 7f17ad5cf640 1 --2- 172.21.15.19:0/1678409046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17a8162060 0x7f17a80b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.142+0000 7f17ad5cf640 1 --2- 172.21.15.19:0/1678409046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17a8161c80 0x7f17a80b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.142+0000 7f17ad5cf640 1 --2- 172.21.15.19:0/1678409046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a80b64b0 0x7f17a80ce220 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.142+0000 7f17ad5cf640 1 -- 172.21.15.19:0/1678409046 >> 172.21.15.19:0/1678409046 conn(0x7f17a80d44f0 msgr2=0x7f17a80b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:15.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.142+0000 7f17ad5cf640 1 -- 172.21.15.19:0/1678409046 shutdown_connections 2024-09-12T01:56:15.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.142+0000 7f17ad5cf640 1 -- 172.21.15.19:0/1678409046 wait complete. 2024-09-12T01:56:15.154 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:56:15.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.256+0000 7f8e2e3b9640 1 Processor -- start 2024-09-12T01:56:15.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.256+0000 7f8e2e3b9640 1 -- start start 2024-09-12T01:56:15.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.256+0000 7f8e2e3b9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e2809aa30 0x7f8e280b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.256+0000 7f8e2e3b9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8e280b3760 0x7f8e2809ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.256+0000 7f8e2e3b9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e2809b350 con 0x7f8e2806cd20 2024-09-12T01:56:15.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.256+0000 7f8e2e3b9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8e280d0670 con 0x7f8e280b3760 2024-09-12T01:56:15.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.256+0000 7f8e2e3b9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8e280b2790 con 0x7f8e2809aa30 2024-09-12T01:56:15.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.257+0000 7f8e277fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8e280b3760 0x7f8e2809ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.257+0000 7f8e2c956640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8e2806cd20 0x7f8e280d0dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44758/0 (socket says 172.21.15.19:44758) 2024-09-12T01:56:15.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.257+0000 7f8e2c956640 1 -- 172.21.15.19:0/3351735854 learned_addr learned my addr 172.21.15.19:0/3351735854 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:15.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.257+0000 7f8e27fff640 1 --2- 172.21.15.19:0/3351735854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e2809aa30 0x7f8e280b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.257+0000 7f8e26ffd640 1 -- 172.21.15.19:0/3351735854 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1056173645 0 0) 0x7f8e2809b350 con 0x7f8e2806cd20 2024-09-12T01:56:15.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.257+0000 7f8e26ffd640 1 -- 172.21.15.19:0/3351735854 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e10003520 con 0x7f8e2806cd20 2024-09-12T01:56:15.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.257+0000 7f8e277fe640 1 -- 172.21.15.19:0/3351735854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e2809aa30 msgr2=0x7f8e280b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:15.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.257+0000 7f8e277fe640 1 --2- 172.21.15.19:0/3351735854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e2809aa30 0x7f8e280b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.257+0000 7f8e277fe640 1 -- 172.21.15.19:0/3351735854 >> v1:172.21.15.19:6789/0 conn(0x7f8e2806cd20 legacy=0x7f8e280d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.257+0000 7f8e277fe640 1 -- 172.21.15.19:0/3351735854 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e280b2a70 con 0x7f8e280b3760 2024-09-12T01:56:15.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.258+0000 7f8e277fe640 1 --2- 172.21.15.19:0/3351735854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e280b3760 0x7f8e2809ae10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0097a0 tx=0x7f8e1c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70175a00d9d04283 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:15.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.258+0000 7f8e26ffd640 1 -- 172.21.15.19:0/3351735854 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c037070 con 0x7f8e280b3760 2024-09-12T01:56:15.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.258+0000 7f8e26ffd640 1 -- 172.21.15.19:0/3351735854 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1c02ae50 con 0x7f8e280b3760 2024-09-12T01:56:15.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.258+0000 7f8e26ffd640 1 -- 172.21.15.19:0/3351735854 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c032660 con 0x7f8e280b3760 2024-09-12T01:56:15.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.258+0000 7f8e2e3b9640 1 -- 172.21.15.19:0/3351735854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e280b3760 msgr2=0x7f8e2809ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.258+0000 7f8e2e3b9640 1 --2- 172.21.15.19:0/3351735854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e280b3760 0x7f8e2809ae10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0097a0 tx=0x7f8e1c02a100 comp rx=0 tx=0).stop 2024-09-12T01:56:15.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.258+0000 7f8e2e3b9640 1 -- 172.21.15.19:0/3351735854 shutdown_connections 2024-09-12T01:56:15.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.258+0000 7f8e2e3b9640 1 --2- 172.21.15.19:0/3351735854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e280b3760 0x7f8e2809ae10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.258+0000 7f8e2e3b9640 1 --2- 172.21.15.19:0/3351735854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e2809aa30 0x7f8e280b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.258+0000 7f8e2e3b9640 1 -- 172.21.15.19:0/3351735854 >> 172.21.15.19:0/3351735854 conn(0x7f8e280d23a0 msgr2=0x7f8e280d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:15.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.258+0000 7f8e2e3b9640 1 -- 172.21.15.19:0/3351735854 shutdown_connections 2024-09-12T01:56:15.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.258+0000 7f8e2e3b9640 1 -- 172.21.15.19:0/3351735854 wait complete. 2024-09-12T01:56:15.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.260+0000 7f8e2e3b9640 1 Processor -- start 2024-09-12T01:56:15.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.260+0000 7f8e2e3b9640 1 -- start start 2024-09-12T01:56:15.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e2e3b9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e2806cd20 0x7f8e2809f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e2e3b9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e2809aa30 0x7f8e280cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e2e3b9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e280b3760 0x7f8e280cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e2e3b9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2815fca0 con 0x7f8e2806cd20 2024-09-12T01:56:15.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e2e3b9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8e280d08a0 con 0x7f8e2809aa30 2024-09-12T01:56:15.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e2e3b9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8e2815fe20 con 0x7f8e280b3760 2024-09-12T01:56:15.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e27fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e2806cd20 0x7f8e2809f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e27fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e2806cd20 0x7f8e2809f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41860/0 (socket says 172.21.15.19:41860) 2024-09-12T01:56:15.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e27fff640 1 -- 172.21.15.19:0/1733128796 learned_addr learned my addr 172.21.15.19:0/1733128796 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:15.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e277fe640 1 --2- 172.21.15.19:0/1733128796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e2809aa30 0x7f8e280cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e2c956640 1 --2- 172.21.15.19:0/1733128796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e280b3760 0x7f8e280cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e27fff640 1 -- 172.21.15.19:0/1733128796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e280b3760 msgr2=0x7f8e280cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e27fff640 1 --2- 172.21.15.19:0/1733128796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e280b3760 0x7f8e280cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e27fff640 1 -- 172.21.15.19:0/1733128796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e2809aa30 msgr2=0x7f8e280cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e27fff640 1 --2- 172.21.15.19:0/1733128796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e2809aa30 0x7f8e280cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e27fff640 1 -- 172.21.15.19:0/1733128796 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e280cb450 con 0x7f8e2806cd20 2024-09-12T01:56:15.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e277fe640 1 --2- 172.21.15.19:0/1733128796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e2809aa30 0x7f8e280cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:15.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e2c956640 1 --2- 172.21.15.19:0/1733128796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e280b3760 0x7f8e280cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:15.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e27fff640 1 --2- 172.21.15.19:0/1733128796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e2806cd20 0x7f8e2809f890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800d800 tx=0x7f8e1800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:15.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e24ff9640 1 -- 172.21.15.19:0/1733128796 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800b6c0 con 0x7f8e2806cd20 2024-09-12T01:56:15.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e24ff9640 1 -- 172.21.15.19:0/1733128796 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e18019070 con 0x7f8e2806cd20 2024-09-12T01:56:15.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e24ff9640 1 -- 172.21.15.19:0/1733128796 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800ba80 con 0x7f8e2806cd20 2024-09-12T01:56:15.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e2e3b9640 1 -- 172.21.15.19:0/1733128796 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e2809fdd0 con 0x7f8e2806cd20 2024-09-12T01:56:15.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.261+0000 7f8e2e3b9640 1 -- 172.21.15.19:0/1733128796 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e280cb9b0 con 0x7f8e2806cd20 2024-09-12T01:56:15.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.262+0000 7f8e2e3b9640 1 -- 172.21.15.19:0/1733128796 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e280d1fe0 con 0x7f8e2806cd20 2024-09-12T01:56:15.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.263+0000 7f8e24ff9640 1 -- 172.21.15.19:0/1733128796 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e1800bc20 con 0x7f8e2806cd20 2024-09-12T01:56:15.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.263+0000 7f8e24ff9640 1 --2- 172.21.15.19:0/1733128796 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8e1406be30 0x7f8e1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.263+0000 7f8e24ff9640 1 -- 172.21.15.19:0/1733128796 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8e1808b6d0 con 0x7f8e2806cd20 2024-09-12T01:56:15.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.263+0000 7f8e277fe640 1 --2- 172.21.15.19:0/1733128796 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8e1406be30 0x7f8e1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.264+0000 7f8e277fe640 1 --2- 172.21.15.19:0/1733128796 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8e1406be30 0x7f8e1406e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c034000 tx=0x7f8e1c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:15.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.268+0000 7f8e24ff9640 1 -- 172.21.15.19:0/1733128796 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e280cb450 con 0x7f8e2806cd20 2024-09-12T01:56:15.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.444+0000 7f8e2e3b9640 1 -- 172.21.15.19:0/1733128796 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e280b3cb0 con 0x7f8e2806cd20 2024-09-12T01:56:15.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.445+0000 7f8e24ff9640 1 -- 172.21.15.19:0/1733128796 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18586 (secure 0 0 0) 0x7f8e18059ca0 con 0x7f8e2806cd20 2024-09-12T01:56:15.446 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:15.446 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:56:01.739727+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:52.899670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:54.099981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:55:57.729901+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:15.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.447+0000 7f8e2e3b9640 1 -- 172.21.15.19:0/1733128796 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8e1406be30 msgr2=0x7f8e1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.447+0000 7f8e2e3b9640 1 --2- 172.21.15.19:0/1733128796 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8e1406be30 0x7f8e1406e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c034000 tx=0x7f8e1c02e000 comp rx=0 tx=0).stop 2024-09-12T01:56:15.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.447+0000 7f8e2e3b9640 1 -- 172.21.15.19:0/1733128796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e2806cd20 msgr2=0x7f8e2809f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.447+0000 7f8e2e3b9640 1 --2- 172.21.15.19:0/1733128796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e2806cd20 0x7f8e2809f890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800d800 tx=0x7f8e1800dcc0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.447+0000 7f8e2e3b9640 1 -- 172.21.15.19:0/1733128796 shutdown_connections 2024-09-12T01:56:15.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.447+0000 7f8e2e3b9640 1 --2- 172.21.15.19:0/1733128796 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8e1406be30 0x7f8e1406e2f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.447+0000 7f8e2e3b9640 1 --2- 172.21.15.19:0/1733128796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e280b3760 0x7f8e280cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.447+0000 7f8e2e3b9640 1 --2- 172.21.15.19:0/1733128796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e2809aa30 0x7f8e280cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.447+0000 7f8e2e3b9640 1 --2- 172.21.15.19:0/1733128796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e2806cd20 0x7f8e2809f890 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.447+0000 7f8e2e3b9640 1 -- 172.21.15.19:0/1733128796 >> 172.21.15.19:0/1733128796 conn(0x7f8e280d23a0 msgr2=0x7f8e280b6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:15.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.447+0000 7f8e2e3b9640 1 -- 172.21.15.19:0/1733128796 shutdown_connections 2024-09-12T01:56:15.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.447+0000 7f8e2e3b9640 1 -- 172.21.15.19:0/1733128796 wait complete. 2024-09-12T01:56:15.459 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:56:15.460 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:56:15.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.561+0000 7fa4798a6640 1 Processor -- start 2024-09-12T01:56:15.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.561+0000 7fa4798a6640 1 -- start start 2024-09-12T01:56:15.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.562+0000 7fa4798a6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4740b6680 0x7fa474169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.562+0000 7fa4798a6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa47406d9f0 con 0x7fa474162060 2024-09-12T01:56:15.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.562+0000 7fa4798a6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa47406dcd0 con 0x7fa474161c80 2024-09-12T01:56:15.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.562+0000 7fa4798a6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa47406dfb0 con 0x7fa4740b6680 2024-09-12T01:56:15.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.562+0000 7fa4727fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa474162060 0x7fa4740b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44772/0 (socket says 172.21.15.19:44772) 2024-09-12T01:56:15.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.562+0000 7fa4727fc640 1 -- 172.21.15.19:0/596867469 learned_addr learned my addr 172.21.15.19:0/596867469 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:15.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa4737fe640 1 --2- 172.21.15.19:0/596867469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4740b6680 0x7fa474169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa471ffb640 1 -- 172.21.15.19:0/596867469 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2027540987 0 0) 0x7fa47406d9f0 con 0x7fa474162060 2024-09-12T01:56:15.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa471ffb640 1 -- 172.21.15.19:0/596867469 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa45c003520 con 0x7fa474162060 2024-09-12T01:56:15.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa471ffb640 1 -- 172.21.15.19:0/596867469 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 219306562 0 0) 0x7fa47406dcd0 con 0x7fa474161c80 2024-09-12T01:56:15.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa471ffb640 1 -- 172.21.15.19:0/596867469 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa47406d9f0 con 0x7fa474161c80 2024-09-12T01:56:15.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa471ffb640 1 -- 172.21.15.19:0/596867469 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2415325089 0 0) 0x7fa45c003520 con 0x7fa474162060 2024-09-12T01:56:15.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa471ffb640 1 -- 172.21.15.19:0/596867469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4740b6680 msgr2=0x7fa474169830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:15.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa471ffb640 1 --2- 172.21.15.19:0/596867469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4740b6680 0x7fa474169830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa471ffb640 1 -- 172.21.15.19:0/596867469 >> v1:172.21.15.135:6789/0 conn(0x7fa474161c80 legacy=0x7fa47406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa471ffb640 1 -- 172.21.15.19:0/596867469 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4740d01f0 con 0x7fa474162060 2024-09-12T01:56:15.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa471ffb640 1 -- 172.21.15.19:0/596867469 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fa468001670 con 0x7fa474162060 2024-09-12T01:56:15.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa471ffb640 1 -- 172.21.15.19:0/596867469 >> v1:172.21.15.19:6789/0 conn(0x7fa474162060 legacy=0x7fa4740b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa471ffb640 1 --2- 172.21.15.19:0/596867469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c003b70 0x7fa45c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa471ffb640 1 --2- 172.21.15.19:0/596867469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4740b6680 0x7fa45c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa471ffb640 1 --2- 172.21.15.19:0/596867469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa45c004d40 0x7fa45c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa471ffb640 1 -- 172.21.15.19:0/596867469 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa47406dfb0 con 0x7fa45c004d40 2024-09-12T01:56:15.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa471ffb640 1 -- 172.21.15.19:0/596867469 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c00ba70 con 0x7fa45c003b70 2024-09-12T01:56:15.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa471ffb640 1 -- 172.21.15.19:0/596867469 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa45c00bc70 con 0x7fa4740b6680 2024-09-12T01:56:15.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa4737fe640 1 --2- 172.21.15.19:0/596867469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa45c004d40 0x7fa45c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa472ffd640 1 --2- 172.21.15.19:0/596867469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c003b70 0x7fa45c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.563+0000 7fa4727fc640 1 --2- 172.21.15.19:0/596867469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4740b6680 0x7fa45c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.564+0000 7fa4737fe640 1 -- 172.21.15.19:0/596867469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4740b6680 msgr2=0x7fa45c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:15.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.564+0000 7fa4737fe640 1 --2- 172.21.15.19:0/596867469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4740b6680 0x7fa45c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.564+0000 7fa4737fe640 1 -- 172.21.15.19:0/596867469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c003b70 msgr2=0x7fa45c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:15.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.564+0000 7fa4737fe640 1 --2- 172.21.15.19:0/596867469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c003b70 0x7fa45c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.564+0000 7fa4737fe640 1 -- 172.21.15.19:0/596867469 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45c003520 con 0x7fa45c004d40 2024-09-12T01:56:15.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.564+0000 7fa4737fe640 1 --2- 172.21.15.19:0/596867469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa45c004d40 0x7fa45c0051c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009fc0 tx=0x7fa45c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97cd4454eb4fa6d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:15.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.564+0000 7fa471ffb640 1 -- 172.21.15.19:0/596867469 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46c009c10 con 0x7fa45c004d40 2024-09-12T01:56:15.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.564+0000 7fa471ffb640 1 -- 172.21.15.19:0/596867469 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa46c036070 con 0x7fa45c004d40 2024-09-12T01:56:15.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.564+0000 7fa471ffb640 1 -- 172.21.15.19:0/596867469 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46c031880 con 0x7fa45c004d40 2024-09-12T01:56:15.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.565+0000 7fa4798a6640 1 -- 172.21.15.19:0/596867469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa45c004d40 msgr2=0x7fa45c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.565+0000 7fa4798a6640 1 --2- 172.21.15.19:0/596867469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa45c004d40 0x7fa45c0051c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009fc0 tx=0x7fa45c005830 comp rx=0 tx=0).stop 2024-09-12T01:56:15.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.565+0000 7fa4737fe640 1 -- 172.21.15.19:0/596867469 reap_dead start 2024-09-12T01:56:15.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.565+0000 7fa4798a6640 1 -- 172.21.15.19:0/596867469 shutdown_connections 2024-09-12T01:56:15.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.565+0000 7fa4798a6640 1 -- 172.21.15.19:0/596867469 >> 172.21.15.19:0/596867469 conn(0x7fa4740d44f0 msgr2=0x7fa4740d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:15.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.565+0000 7fa4798a6640 1 -- 172.21.15.19:0/596867469 shutdown_connections 2024-09-12T01:56:15.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.565+0000 7fa4798a6640 1 -- 172.21.15.19:0/596867469 wait complete. 2024-09-12T01:56:15.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.566+0000 7fa4798a6640 1 Processor -- start 2024-09-12T01:56:15.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.566+0000 7fa4798a6640 1 -- start start 2024-09-12T01:56:15.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.567+0000 7fa4798a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa45c004d40 0x7fa4741515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.567+0000 7fa4798a6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa474151b00 0x7fa4740b7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.567+0000 7fa4798a6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4740b8360 0x7fa474159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.567+0000 7fa4798a6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa4740b6cb0 con 0x7fa45c004d40 2024-09-12T01:56:15.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.567+0000 7fa4798a6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa4740b6b30 con 0x7fa4740b8360 2024-09-12T01:56:15.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.567+0000 7fa4798a6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa474167820 con 0x7fa474151b00 2024-09-12T01:56:15.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.567+0000 7fa472ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa45c004d40 0x7fa4741515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.567+0000 7fa472ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa45c004d40 0x7fa4741515c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41880/0 (socket says 172.21.15.19:41880) 2024-09-12T01:56:15.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.567+0000 7fa472ffd640 1 -- 172.21.15.19:0/1477140343 learned_addr learned my addr 172.21.15.19:0/1477140343 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:15.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.567+0000 7fa4727fc640 1 --2- 172.21.15.19:0/1477140343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa474151b00 0x7fa4740b7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.567+0000 7fa4737fe640 1 --2- 172.21.15.19:0/1477140343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4740b8360 0x7fa474159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.567+0000 7fa472ffd640 1 -- 172.21.15.19:0/1477140343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa474151b00 msgr2=0x7fa4740b7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.567+0000 7fa472ffd640 1 --2- 172.21.15.19:0/1477140343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa474151b00 0x7fa4740b7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.567+0000 7fa472ffd640 1 -- 172.21.15.19:0/1477140343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4740b8360 msgr2=0x7fa474159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.567+0000 7fa472ffd640 1 --2- 172.21.15.19:0/1477140343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4740b8360 0x7fa474159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.567+0000 7fa472ffd640 1 -- 172.21.15.19:0/1477140343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4740c8370 con 0x7fa45c004d40 2024-09-12T01:56:15.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.568+0000 7fa472ffd640 1 --2- 172.21.15.19:0/1477140343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa45c004d40 0x7fa4741515c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa46400f7a0 tx=0x7fa46400fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:15.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.568+0000 7fa45bfff640 1 -- 172.21.15.19:0/1477140343 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46400fe50 con 0x7fa45c004d40 2024-09-12T01:56:15.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.568+0000 7fa45bfff640 1 -- 172.21.15.19:0/1477140343 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa464018070 con 0x7fa45c004d40 2024-09-12T01:56:15.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.568+0000 7fa4798a6640 1 -- 172.21.15.19:0/1477140343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa474151f60 con 0x7fa45c004d40 2024-09-12T01:56:15.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.568+0000 7fa45bfff640 1 -- 172.21.15.19:0/1477140343 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46400d730 con 0x7fa45c004d40 2024-09-12T01:56:15.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.568+0000 7fa4798a6640 1 -- 172.21.15.19:0/1477140343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4740ca760 con 0x7fa45c004d40 2024-09-12T01:56:15.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.569+0000 7fa4798a6640 1 -- 172.21.15.19:0/1477140343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4740ba470 con 0x7fa45c004d40 2024-09-12T01:56:15.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.569+0000 7fa45bfff640 1 -- 172.21.15.19:0/1477140343 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa46400d8d0 con 0x7fa45c004d40 2024-09-12T01:56:15.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.570+0000 7fa45bfff640 1 --2- 172.21.15.19:0/1477140343 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa46006be30 0x7fa46006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.570+0000 7fa45bfff640 1 -- 172.21.15.19:0/1477140343 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa46408b140 con 0x7fa45c004d40 2024-09-12T01:56:15.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.570+0000 7fa4727fc640 1 --2- 172.21.15.19:0/1477140343 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa46006be30 0x7fa46006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.570+0000 7fa4727fc640 1 --2- 172.21.15.19:0/1477140343 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa46006be30 0x7fa46006e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa4740d1eb0 tx=0x7fa468001e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:15.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.574+0000 7fa45bfff640 1 -- 172.21.15.19:0/1477140343 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa4740c8370 con 0x7fa45c004d40 2024-09-12T01:56:15.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.750+0000 7fa4798a6640 1 -- 172.21.15.19:0/1477140343 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa4740b3070 con 0x7fa46006be30 2024-09-12T01:56:15.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.759+0000 7fa45bfff640 1 -- 172.21.15.19:0/1477140343 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fa4740b3070 con 0x7fa46006be30 2024-09-12T01:56:15.763 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:15.765 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:56:15.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.763+0000 7fa4798a6640 1 -- 172.21.15.19:0/1477140343 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa46006be30 msgr2=0x7fa46006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.763+0000 7fa4798a6640 1 --2- 172.21.15.19:0/1477140343 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa46006be30 0x7fa46006e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa4740d1eb0 tx=0x7fa468001e40 comp rx=0 tx=0).stop 2024-09-12T01:56:15.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.763+0000 7fa4798a6640 1 -- 172.21.15.19:0/1477140343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa45c004d40 msgr2=0x7fa4741515c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.763+0000 7fa4798a6640 1 --2- 172.21.15.19:0/1477140343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa45c004d40 0x7fa4741515c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa46400f7a0 tx=0x7fa46400fc60 comp rx=0 tx=0).stop 2024-09-12T01:56:15.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.763+0000 7fa4798a6640 1 -- 172.21.15.19:0/1477140343 shutdown_connections 2024-09-12T01:56:15.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.763+0000 7fa4798a6640 1 --2- 172.21.15.19:0/1477140343 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa46006be30 0x7fa46006e2f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.763+0000 7fa4798a6640 1 --2- 172.21.15.19:0/1477140343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4740b8360 0x7fa474159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.763+0000 7fa4798a6640 1 --2- 172.21.15.19:0/1477140343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa474151b00 0x7fa4740b7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.763+0000 7fa4798a6640 1 --2- 172.21.15.19:0/1477140343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa45c004d40 0x7fa4741515c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.763+0000 7fa4798a6640 1 -- 172.21.15.19:0/1477140343 >> 172.21.15.19:0/1477140343 conn(0x7fa4740d44f0 msgr2=0x7fa4741521a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:15.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.763+0000 7fa4798a6640 1 -- 172.21.15.19:0/1477140343 shutdown_connections 2024-09-12T01:56:15.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.763+0000 7fa4798a6640 1 -- 172.21.15.19:0/1477140343 wait complete. 2024-09-12T01:56:15.774 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-12T01:56:14.088183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219680,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755040,"statfs":{"total":773094113280,"available":772869160960,"internally_reserved":0,"allocated":3514368,"data_stored":2106108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003299"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460711+0000","last_change":"2024-09-12T01:55:54.691417+0000","last_active":"2024-09-12T01:56:02.460711+0000","last_peered":"2024-09-12T01:56:02.460711+0000","last_clean":"2024-09-12T01:56:02.460711+0000","last_became_active":"2024-09-12T01:55:54.690940+0000","last_became_peered":"2024-09-12T01:55:54.690940+0000","last_unstale":"2024-09-12T01:56:02.460711+0000","last_undegraded":"2024-09-12T01:56:02.460711+0000","last_fullsized":"2024-09-12T01:56:02.460711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:41.898184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522661+0000","last_change":"2024-09-12T01:55:55.703230+0000","last_active":"2024-09-12T01:56:02.522661+0000","last_peered":"2024-09-12T01:56:02.522661+0000","last_clean":"2024-09-12T01:56:02.522661+0000","last_became_active":"2024-09-12T01:55:55.702937+0000","last_became_peered":"2024-09-12T01:55:55.702937+0000","last_unstale":"2024-09-12T01:56:02.522661+0000","last_undegraded":"2024-09-12T01:56:02.522661+0000","last_fullsized":"2024-09-12T01:56:02.522661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:12.877973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521554+0000","last_change":"2024-09-12T01:56:00.522020+0000","last_active":"2024-09-12T01:56:02.521554+0000","last_peered":"2024-09-12T01:56:02.521554+0000","last_clean":"2024-09-12T01:56:02.521554+0000","last_became_active":"2024-09-12T01:56:00.521659+0000","last_became_peered":"2024-09-12T01:56:00.521659+0000","last_unstale":"2024-09-12T01:56:02.521554+0000","last_undegraded":"2024-09-12T01:56:02.521554+0000","last_fullsized":"2024-09-12T01:56:02.521554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:04.626201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522786+0000","last_change":"2024-09-12T01:55:54.693523+0000","last_active":"2024-09-12T01:56:02.522786+0000","last_peered":"2024-09-12T01:56:02.522786+0000","last_clean":"2024-09-12T01:56:02.522786+0000","last_became_active":"2024-09-12T01:55:54.693127+0000","last_became_peered":"2024-09-12T01:55:54.693127+0000","last_unstale":"2024-09-12T01:56:02.522786+0000","last_undegraded":"2024-09-12T01:56:02.522786+0000","last_fullsized":"2024-09-12T01:56:02.522786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:18.178661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460539+0000","last_change":"2024-09-12T01:55:55.695198+0000","last_active":"2024-09-12T01:56:02.460539+0000","last_peered":"2024-09-12T01:56:02.460539+0000","last_clean":"2024-09-12T01:56:02.460539+0000","last_became_active":"2024-09-12T01:55:55.694897+0000","last_became_peered":"2024-09-12T01:55:55.694897+0000","last_unstale":"2024-09-12T01:56:02.460539+0000","last_undegraded":"2024-09-12T01:56:02.460539+0000","last_fullsized":"2024-09-12T01:56:02.460539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:05.184458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996331+0000","last_change":"2024-09-12T01:55:59.720981+0000","last_active":"2024-09-12T01:56:01.996331+0000","last_peered":"2024-09-12T01:56:01.996331+0000","last_clean":"2024-09-12T01:56:01.996331+0000","last_became_active":"2024-09-12T01:55:59.720424+0000","last_became_peered":"2024-09-12T01:55:59.720424+0000","last_unstale":"2024-09-12T01:56:01.996331+0000","last_undegraded":"2024-09-12T01:56:01.996331+0000","last_fullsized":"2024-09-12T01:56:01.996331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:37.646140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752215+0000","last_change":"2024-09-12T01:55:54.691906+0000","last_active":"2024-09-12T01:56:01.752215+0000","last_peered":"2024-09-12T01:56:01.752215+0000","last_clean":"2024-09-12T01:56:01.752215+0000","last_became_active":"2024-09-12T01:55:54.691632+0000","last_became_peered":"2024-09-12T01:55:54.691632+0000","last_unstale":"2024-09-12T01:56:01.752215+0000","last_undegraded":"2024-09-12T01:56:01.752215+0000","last_fullsized":"2024-09-12T01:56:01.752215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:02.585865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522293+0000","last_change":"2024-09-12T01:55:55.690825+0000","last_active":"2024-09-12T01:56:02.522293+0000","last_peered":"2024-09-12T01:56:02.522293+0000","last_clean":"2024-09-12T01:56:02.522293+0000","last_became_active":"2024-09-12T01:55:55.690498+0000","last_became_peered":"2024-09-12T01:55:55.690498+0000","last_unstale":"2024-09-12T01:56:02.522293+0000","last_undegraded":"2024-09-12T01:56:02.522293+0000","last_fullsized":"2024-09-12T01:56:02.522293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:20.252934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996426+0000","last_change":"2024-09-12T01:55:59.722572+0000","last_active":"2024-09-12T01:56:01.996426+0000","last_peered":"2024-09-12T01:56:01.996426+0000","last_clean":"2024-09-12T01:56:01.996426+0000","last_became_active":"2024-09-12T01:55:59.722043+0000","last_became_peered":"2024-09-12T01:55:59.722043+0000","last_unstale":"2024-09-12T01:56:01.996426+0000","last_undegraded":"2024-09-12T01:56:01.996426+0000","last_fullsized":"2024-09-12T01:56:01.996426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:01.089137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751710+0000","last_change":"2024-09-12T01:55:54.694886+0000","last_active":"2024-09-12T01:56:01.751710+0000","last_peered":"2024-09-12T01:56:01.751710+0000","last_clean":"2024-09-12T01:56:01.751710+0000","last_became_active":"2024-09-12T01:55:54.694641+0000","last_became_peered":"2024-09-12T01:55:54.694641+0000","last_unstale":"2024-09-12T01:56:01.751710+0000","last_undegraded":"2024-09-12T01:56:01.751710+0000","last_fullsized":"2024-09-12T01:56:01.751710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:07.353242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522367+0000","last_change":"2024-09-12T01:55:55.697509+0000","last_active":"2024-09-12T01:56:02.522367+0000","last_peered":"2024-09-12T01:56:02.522367+0000","last_clean":"2024-09-12T01:56:02.522367+0000","last_became_active":"2024-09-12T01:55:55.696597+0000","last_became_peered":"2024-09-12T01:55:55.696597+0000","last_unstale":"2024-09-12T01:56:02.522367+0000","last_undegraded":"2024-09-12T01:56:02.522367+0000","last_fullsized":"2024-09-12T01:56:02.522367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:50.551708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996296+0000","last_change":"2024-09-12T01:55:59.717407+0000","last_active":"2024-09-12T01:56:01.996296+0000","last_peered":"2024-09-12T01:56:01.996296+0000","last_clean":"2024-09-12T01:56:01.996296+0000","last_became_active":"2024-09-12T01:55:59.716747+0000","last_became_peered":"2024-09-12T01:55:59.716747+0000","last_unstale":"2024-09-12T01:56:01.996296+0000","last_undegraded":"2024-09-12T01:56:01.996296+0000","last_fullsized":"2024-09-12T01:56:01.996296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:30.245761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752221+0000","last_change":"2024-09-12T01:55:55.694504+0000","last_active":"2024-09-12T01:56:01.752221+0000","last_peered":"2024-09-12T01:56:01.752221+0000","last_clean":"2024-09-12T01:56:01.752221+0000","last_became_active":"2024-09-12T01:55:55.694202+0000","last_became_peered":"2024-09-12T01:55:55.694202+0000","last_unstale":"2024-09-12T01:56:01.752221+0000","last_undegraded":"2024-09-12T01:56:01.752221+0000","last_fullsized":"2024-09-12T01:56:01.752221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:49.242430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751844+0000","last_change":"2024-09-12T01:55:54.690614+0000","last_active":"2024-09-12T01:56:01.751844+0000","last_peered":"2024-09-12T01:56:01.751844+0000","last_clean":"2024-09-12T01:56:01.751844+0000","last_became_active":"2024-09-12T01:55:54.690334+0000","last_became_peered":"2024-09-12T01:55:54.690334+0000","last_unstale":"2024-09-12T01:56:01.751844+0000","last_undegraded":"2024-09-12T01:56:01.751844+0000","last_fullsized":"2024-09-12T01:56:01.751844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:29.431495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996751+0000","last_change":"2024-09-12T01:55:59.728056+0000","last_active":"2024-09-12T01:56:01.996751+0000","last_peered":"2024-09-12T01:56:01.996751+0000","last_clean":"2024-09-12T01:56:01.996751+0000","last_became_active":"2024-09-12T01:55:59.727677+0000","last_became_peered":"2024-09-12T01:55:59.727677+0000","last_unstale":"2024-09-12T01:56:01.996751+0000","last_undegraded":"2024-09-12T01:56:01.996751+0000","last_fullsized":"2024-09-12T01:56:01.996751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:25.127551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522339+0000","last_change":"2024-09-12T01:55:55.696190+0000","last_active":"2024-09-12T01:56:02.522339+0000","last_peered":"2024-09-12T01:56:02.522339+0000","last_clean":"2024-09-12T01:56:02.522339+0000","last_became_active":"2024-09-12T01:55:55.695882+0000","last_became_peered":"2024-09-12T01:55:55.695882+0000","last_unstale":"2024-09-12T01:56:02.522339+0000","last_undegraded":"2024-09-12T01:56:02.522339+0000","last_fullsized":"2024-09-12T01:56:02.522339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:18.907293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522246+0000","last_change":"2024-09-12T01:55:54.691318+0000","last_active":"2024-09-12T01:56:02.522246+0000","last_peered":"2024-09-12T01:56:02.522246+0000","last_clean":"2024-09-12T01:56:02.522246+0000","last_became_active":"2024-09-12T01:55:54.690960+0000","last_became_peered":"2024-09-12T01:55:54.690960+0000","last_unstale":"2024-09-12T01:56:02.522246+0000","last_undegraded":"2024-09-12T01:56:02.522246+0000","last_fullsized":"2024-09-12T01:56:02.522246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:12.646367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996557+0000","last_change":"2024-09-12T01:55:59.721175+0000","last_active":"2024-09-12T01:56:01.996557+0000","last_peered":"2024-09-12T01:56:01.996557+0000","last_clean":"2024-09-12T01:56:01.996557+0000","last_became_active":"2024-09-12T01:55:59.720481+0000","last_became_peered":"2024-09-12T01:55:59.720481+0000","last_unstale":"2024-09-12T01:56:01.996557+0000","last_undegraded":"2024-09-12T01:56:01.996557+0000","last_fullsized":"2024-09-12T01:56:01.996557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:33.869240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521581+0000","last_change":"2024-09-12T01:55:55.686041+0000","last_active":"2024-09-12T01:56:02.521581+0000","last_peered":"2024-09-12T01:56:02.521581+0000","last_clean":"2024-09-12T01:56:02.521581+0000","last_became_active":"2024-09-12T01:55:55.685758+0000","last_became_peered":"2024-09-12T01:55:55.685758+0000","last_unstale":"2024-09-12T01:56:02.521581+0000","last_undegraded":"2024-09-12T01:56:02.521581+0000","last_fullsized":"2024-09-12T01:56:02.521581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:11.963913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521629+0000","last_change":"2024-09-12T01:55:54.688788+0000","last_active":"2024-09-12T01:56:02.521629+0000","last_peered":"2024-09-12T01:56:02.521629+0000","last_clean":"2024-09-12T01:56:02.521629+0000","last_became_active":"2024-09-12T01:55:54.688513+0000","last_became_peered":"2024-09-12T01:55:54.688513+0000","last_unstale":"2024-09-12T01:56:02.521629+0000","last_undegraded":"2024-09-12T01:56:02.521629+0000","last_fullsized":"2024-09-12T01:56:02.521629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:49.883464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522091+0000","last_change":"2024-09-12T01:56:00.517213+0000","last_active":"2024-09-12T01:56:02.522091+0000","last_peered":"2024-09-12T01:56:02.522091+0000","last_clean":"2024-09-12T01:56:02.522091+0000","last_became_active":"2024-09-12T01:56:00.516759+0000","last_became_peered":"2024-09-12T01:56:00.516759+0000","last_unstale":"2024-09-12T01:56:02.522091+0000","last_undegraded":"2024-09-12T01:56:02.522091+0000","last_fullsized":"2024-09-12T01:56:02.522091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:01.089137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996491+0000","last_change":"2024-09-12T01:55:55.688036+0000","last_active":"2024-09-12T01:56:01.996491+0000","last_peered":"2024-09-12T01:56:01.996491+0000","last_clean":"2024-09-12T01:56:01.996491+0000","last_became_active":"2024-09-12T01:55:55.687764+0000","last_became_peered":"2024-09-12T01:55:55.687764+0000","last_unstale":"2024-09-12T01:56:01.996491+0000","last_undegraded":"2024-09-12T01:56:01.996491+0000","last_fullsized":"2024-09-12T01:56:01.996491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:18.704097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751280+0000","last_change":"2024-09-12T01:55:54.693835+0000","last_active":"2024-09-12T01:56:01.751280+0000","last_peered":"2024-09-12T01:56:01.751280+0000","last_clean":"2024-09-12T01:56:01.751280+0000","last_became_active":"2024-09-12T01:55:54.693191+0000","last_became_peered":"2024-09-12T01:55:54.693191+0000","last_unstale":"2024-09-12T01:56:01.751280+0000","last_undegraded":"2024-09-12T01:56:01.751280+0000","last_fullsized":"2024-09-12T01:56:01.751280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:33.178694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996869+0000","last_change":"2024-09-12T01:55:59.720935+0000","last_active":"2024-09-12T01:56:01.996869+0000","last_peered":"2024-09-12T01:56:01.996869+0000","last_clean":"2024-09-12T01:56:01.996869+0000","last_became_active":"2024-09-12T01:55:59.720510+0000","last_became_peered":"2024-09-12T01:55:59.720510+0000","last_unstale":"2024-09-12T01:56:01.996869+0000","last_undegraded":"2024-09-12T01:56:01.996869+0000","last_fullsized":"2024-09-12T01:56:01.996869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:24.129803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460733+0000","last_change":"2024-09-12T01:55:55.693557+0000","last_active":"2024-09-12T01:56:02.460733+0000","last_peered":"2024-09-12T01:56:02.460733+0000","last_clean":"2024-09-12T01:56:02.460733+0000","last_became_active":"2024-09-12T01:55:55.693073+0000","last_became_peered":"2024-09-12T01:55:55.693073+0000","last_unstale":"2024-09-12T01:56:02.460733+0000","last_undegraded":"2024-09-12T01:56:02.460733+0000","last_fullsized":"2024-09-12T01:56:02.460733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:36.523619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752229+0000","last_change":"2024-09-12T01:55:54.692628+0000","last_active":"2024-09-12T01:56:01.752229+0000","last_peered":"2024-09-12T01:56:01.752229+0000","last_clean":"2024-09-12T01:56:01.752229+0000","last_became_active":"2024-09-12T01:55:54.692323+0000","last_became_peered":"2024-09-12T01:55:54.692323+0000","last_unstale":"2024-09-12T01:56:01.752229+0000","last_undegraded":"2024-09-12T01:56:01.752229+0000","last_fullsized":"2024-09-12T01:56:01.752229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:51.779183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996393+0000","last_change":"2024-09-12T01:56:00.519632+0000","last_active":"2024-09-12T01:56:01.996393+0000","last_peered":"2024-09-12T01:56:01.996393+0000","last_clean":"2024-09-12T01:56:01.996393+0000","last_became_active":"2024-09-12T01:56:00.518952+0000","last_became_peered":"2024-09-12T01:56:00.518952+0000","last_unstale":"2024-09-12T01:56:01.996393+0000","last_undegraded":"2024-09-12T01:56:01.996393+0000","last_fullsized":"2024-09-12T01:56:01.996393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:25.728022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522901+0000","last_change":"2024-09-12T01:55:55.701476+0000","last_active":"2024-09-12T01:56:02.522901+0000","last_peered":"2024-09-12T01:56:02.522901+0000","last_clean":"2024-09-12T01:56:02.522901+0000","last_became_active":"2024-09-12T01:55:55.697719+0000","last_became_peered":"2024-09-12T01:55:55.697719+0000","last_unstale":"2024-09-12T01:56:02.522901+0000","last_undegraded":"2024-09-12T01:56:02.522901+0000","last_fullsized":"2024-09-12T01:56:02.522901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:05.703141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521753+0000","last_change":"2024-09-12T01:55:54.683694+0000","last_active":"2024-09-12T01:56:02.521753+0000","last_peered":"2024-09-12T01:56:02.521753+0000","last_clean":"2024-09-12T01:56:02.521753+0000","last_became_active":"2024-09-12T01:55:54.683332+0000","last_became_peered":"2024-09-12T01:55:54.683332+0000","last_unstale":"2024-09-12T01:56:02.521753+0000","last_undegraded":"2024-09-12T01:56:02.521753+0000","last_fullsized":"2024-09-12T01:56:02.521753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:24.503780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521372+0000","last_change":"2024-09-12T01:56:00.518243+0000","last_active":"2024-09-12T01:56:02.521372+0000","last_peered":"2024-09-12T01:56:02.521372+0000","last_clean":"2024-09-12T01:56:02.521372+0000","last_became_active":"2024-09-12T01:56:00.517815+0000","last_became_peered":"2024-09-12T01:56:00.517815+0000","last_unstale":"2024-09-12T01:56:02.521372+0000","last_undegraded":"2024-09-12T01:56:02.521372+0000","last_fullsized":"2024-09-12T01:56:02.521372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:59.474572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521936+0000","last_change":"2024-09-12T01:55:55.683383+0000","last_active":"2024-09-12T01:56:02.521936+0000","last_peered":"2024-09-12T01:56:02.521936+0000","last_clean":"2024-09-12T01:56:02.521936+0000","last_became_active":"2024-09-12T01:55:55.683045+0000","last_became_peered":"2024-09-12T01:55:55.683045+0000","last_unstale":"2024-09-12T01:56:02.521936+0000","last_undegraded":"2024-09-12T01:56:02.521936+0000","last_fullsized":"2024-09-12T01:56:02.521936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:11.963913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752400+0000","last_change":"2024-09-12T01:55:54.693479+0000","last_active":"2024-09-12T01:56:01.752400+0000","last_peered":"2024-09-12T01:56:01.752400+0000","last_clean":"2024-09-12T01:56:01.752400+0000","last_became_active":"2024-09-12T01:55:54.693222+0000","last_became_peered":"2024-09-12T01:55:54.693222+0000","last_unstale":"2024-09-12T01:56:01.752400+0000","last_undegraded":"2024-09-12T01:56:01.752400+0000","last_fullsized":"2024-09-12T01:56:01.752400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:29.084779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460600+0000","last_change":"2024-09-12T01:56:00.517418+0000","last_active":"2024-09-12T01:56:02.460600+0000","last_peered":"2024-09-12T01:56:02.460600+0000","last_clean":"2024-09-12T01:56:02.460600+0000","last_became_active":"2024-09-12T01:56:00.516727+0000","last_became_peered":"2024-09-12T01:56:00.516727+0000","last_unstale":"2024-09-12T01:56:02.460600+0000","last_undegraded":"2024-09-12T01:56:02.460600+0000","last_fullsized":"2024-09-12T01:56:02.460600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:05.063807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522480+0000","last_change":"2024-09-12T01:55:55.705667+0000","last_active":"2024-09-12T01:56:02.522480+0000","last_peered":"2024-09-12T01:56:02.522480+0000","last_clean":"2024-09-12T01:56:02.522480+0000","last_became_active":"2024-09-12T01:55:55.705409+0000","last_became_peered":"2024-09-12T01:55:55.705409+0000","last_unstale":"2024-09-12T01:56:02.522480+0000","last_undegraded":"2024-09-12T01:56:02.522480+0000","last_fullsized":"2024-09-12T01:56:02.522480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:32.262001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522031+0000","last_change":"2024-09-12T01:55:54.690520+0000","last_active":"2024-09-12T01:56:02.522031+0000","last_peered":"2024-09-12T01:56:02.522031+0000","last_clean":"2024-09-12T01:56:02.522031+0000","last_became_active":"2024-09-12T01:55:54.690206+0000","last_became_peered":"2024-09-12T01:55:54.690206+0000","last_unstale":"2024-09-12T01:56:02.522031+0000","last_undegraded":"2024-09-12T01:56:02.522031+0000","last_fullsized":"2024-09-12T01:56:02.522031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:12.368192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521948+0000","last_change":"2024-09-12T01:55:59.722879+0000","last_active":"2024-09-12T01:56:02.521948+0000","last_peered":"2024-09-12T01:56:02.521948+0000","last_clean":"2024-09-12T01:56:02.521948+0000","last_became_active":"2024-09-12T01:55:59.722470+0000","last_became_peered":"2024-09-12T01:55:59.722470+0000","last_unstale":"2024-09-12T01:56:02.521948+0000","last_undegraded":"2024-09-12T01:56:02.521948+0000","last_fullsized":"2024-09-12T01:56:02.521948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:37.646140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996762+0000","last_change":"2024-09-12T01:55:55.694445+0000","last_active":"2024-09-12T01:56:01.996762+0000","last_peered":"2024-09-12T01:56:01.996762+0000","last_clean":"2024-09-12T01:56:01.996762+0000","last_became_active":"2024-09-12T01:55:55.694183+0000","last_became_peered":"2024-09-12T01:55:55.694183+0000","last_unstale":"2024-09-12T01:56:01.996762+0000","last_undegraded":"2024-09-12T01:56:01.996762+0000","last_fullsized":"2024-09-12T01:56:01.996762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:34.647815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522397+0000","last_change":"2024-09-12T01:55:54.692279+0000","last_active":"2024-09-12T01:56:02.522397+0000","last_peered":"2024-09-12T01:56:02.522397+0000","last_clean":"2024-09-12T01:56:02.522397+0000","last_became_active":"2024-09-12T01:55:54.692012+0000","last_became_peered":"2024-09-12T01:55:54.692012+0000","last_unstale":"2024-09-12T01:56:02.522397+0000","last_undegraded":"2024-09-12T01:56:02.522397+0000","last_fullsized":"2024-09-12T01:56:02.522397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:23.224359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522020+0000","last_change":"2024-09-12T01:55:59.729468+0000","last_active":"2024-09-12T01:56:02.522020+0000","last_peered":"2024-09-12T01:56:02.522020+0000","last_clean":"2024-09-12T01:56:02.522020+0000","last_became_active":"2024-09-12T01:55:59.729028+0000","last_became_peered":"2024-09-12T01:55:59.729028+0000","last_unstale":"2024-09-12T01:56:02.522020+0000","last_undegraded":"2024-09-12T01:56:02.522020+0000","last_fullsized":"2024-09-12T01:56:02.522020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:25.728022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521427+0000","last_change":"2024-09-12T01:55:55.683856+0000","last_active":"2024-09-12T01:56:02.521427+0000","last_peered":"2024-09-12T01:56:02.521427+0000","last_clean":"2024-09-12T01:56:02.521427+0000","last_became_active":"2024-09-12T01:55:55.683567+0000","last_became_peered":"2024-09-12T01:55:55.683567+0000","last_unstale":"2024-09-12T01:56:02.521427+0000","last_undegraded":"2024-09-12T01:56:02.521427+0000","last_fullsized":"2024-09-12T01:56:02.521427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:44.949953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745947+0000","last_change":"2024-09-12T01:55:54.694100+0000","last_active":"2024-09-12T01:56:01.745947+0000","last_peered":"2024-09-12T01:56:01.745947+0000","last_clean":"2024-09-12T01:56:01.745947+0000","last_became_active":"2024-09-12T01:55:54.693791+0000","last_became_peered":"2024-09-12T01:55:54.693791+0000","last_unstale":"2024-09-12T01:56:01.745947+0000","last_undegraded":"2024-09-12T01:56:01.745947+0000","last_fullsized":"2024-09-12T01:56:01.745947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:28.370799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522265+0000","last_change":"2024-09-12T01:55:59.729446+0000","last_active":"2024-09-12T01:56:02.522265+0000","last_peered":"2024-09-12T01:56:02.522265+0000","last_clean":"2024-09-12T01:56:02.522265+0000","last_became_active":"2024-09-12T01:55:59.729062+0000","last_became_peered":"2024-09-12T01:55:59.729062+0000","last_unstale":"2024-09-12T01:56:02.522265+0000","last_undegraded":"2024-09-12T01:56:02.522265+0000","last_fullsized":"2024-09-12T01:56:02.522265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:05.710174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460187+0000","last_change":"2024-09-12T01:55:55.699106+0000","last_active":"2024-09-12T01:56:02.460187+0000","last_peered":"2024-09-12T01:56:02.460187+0000","last_clean":"2024-09-12T01:56:02.460187+0000","last_became_active":"2024-09-12T01:55:55.698839+0000","last_became_peered":"2024-09-12T01:55:55.698839+0000","last_unstale":"2024-09-12T01:56:02.460187+0000","last_undegraded":"2024-09-12T01:56:02.460187+0000","last_fullsized":"2024-09-12T01:56:02.460187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:34.183993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751389+0000","last_change":"2024-09-12T01:55:54.690892+0000","last_active":"2024-09-12T01:56:01.751389+0000","last_peered":"2024-09-12T01:56:01.751389+0000","last_clean":"2024-09-12T01:56:01.751389+0000","last_became_active":"2024-09-12T01:55:54.690615+0000","last_became_peered":"2024-09-12T01:55:54.690615+0000","last_unstale":"2024-09-12T01:56:01.751389+0000","last_undegraded":"2024-09-12T01:56:01.751389+0000","last_fullsized":"2024-09-12T01:56:01.751389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:27.061787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460647+0000","last_change":"2024-09-12T01:56:00.518805+0000","last_active":"2024-09-12T01:56:02.460647+0000","last_peered":"2024-09-12T01:56:02.460647+0000","last_clean":"2024-09-12T01:56:02.460647+0000","last_became_active":"2024-09-12T01:56:00.518224+0000","last_became_peered":"2024-09-12T01:56:00.518224+0000","last_unstale":"2024-09-12T01:56:02.460647+0000","last_undegraded":"2024-09-12T01:56:02.460647+0000","last_fullsized":"2024-09-12T01:56:02.460647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:56.545297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522174+0000","last_change":"2024-09-12T01:55:55.702458+0000","last_active":"2024-09-12T01:56:02.522174+0000","last_peered":"2024-09-12T01:56:02.522174+0000","last_clean":"2024-09-12T01:56:02.522174+0000","last_became_active":"2024-09-12T01:55:55.702160+0000","last_became_peered":"2024-09-12T01:55:55.702160+0000","last_unstale":"2024-09-12T01:56:02.522174+0000","last_undegraded":"2024-09-12T01:56:02.522174+0000","last_fullsized":"2024-09-12T01:56:02.522174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:49.260515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522189+0000","last_change":"2024-09-12T01:55:54.688748+0000","last_active":"2024-09-12T01:56:02.522189+0000","last_peered":"2024-09-12T01:56:02.522189+0000","last_clean":"2024-09-12T01:56:02.522189+0000","last_became_active":"2024-09-12T01:55:54.688278+0000","last_became_peered":"2024-09-12T01:55:54.688278+0000","last_unstale":"2024-09-12T01:56:02.522189+0000","last_undegraded":"2024-09-12T01:56:02.522189+0000","last_fullsized":"2024-09-12T01:56:02.522189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:51.779183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751452+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:56:01.751452+0000","last_peered":"2024-09-12T01:56:01.751452+0000","last_clean":"2024-09-12T01:56:01.751452+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:56:01.751452+0000","last_undegraded":"2024-09-12T01:56:01.751452+0000","last_fullsized":"2024-09-12T01:56:01.751452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752349+0000","last_change":"2024-09-12T01:56:00.520068+0000","last_active":"2024-09-12T01:56:01.752349+0000","last_peered":"2024-09-12T01:56:01.752349+0000","last_clean":"2024-09-12T01:56:01.752349+0000","last_became_active":"2024-09-12T01:56:00.519253+0000","last_became_peered":"2024-09-12T01:56:00.519253+0000","last_unstale":"2024-09-12T01:56:01.752349+0000","last_undegraded":"2024-09-12T01:56:01.752349+0000","last_fullsized":"2024-09-12T01:56:01.752349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:24.528900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752013+0000","last_change":"2024-09-12T01:55:55.701349+0000","last_active":"2024-09-12T01:56:01.752013+0000","last_peered":"2024-09-12T01:56:01.752013+0000","last_clean":"2024-09-12T01:56:01.752013+0000","last_became_active":"2024-09-12T01:55:55.701081+0000","last_became_peered":"2024-09-12T01:55:55.701081+0000","last_unstale":"2024-09-12T01:56:01.752013+0000","last_undegraded":"2024-09-12T01:56:01.752013+0000","last_fullsized":"2024-09-12T01:56:01.752013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:22.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.746220+0000","last_change":"2024-09-12T01:55:54.686812+0000","last_active":"2024-09-12T01:56:01.746220+0000","last_peered":"2024-09-12T01:56:01.746220+0000","last_clean":"2024-09-12T01:56:01.746220+0000","last_became_active":"2024-09-12T01:55:54.685661+0000","last_became_peered":"2024-09-12T01:55:54.685661+0000","last_unstale":"2024-09-12T01:56:01.746220+0000","last_undegraded":"2024-09-12T01:56:01.746220+0000","last_fullsized":"2024-09-12T01:56:01.746220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:48.747240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752114+0000","last_change":"2024-09-12T01:56:00.519411+0000","last_active":"2024-09-12T01:56:01.752114+0000","last_peered":"2024-09-12T01:56:01.752114+0000","last_clean":"2024-09-12T01:56:01.752114+0000","last_became_active":"2024-09-12T01:56:00.518566+0000","last_became_peered":"2024-09-12T01:56:00.518566+0000","last_unstale":"2024-09-12T01:56:01.752114+0000","last_undegraded":"2024-09-12T01:56:01.752114+0000","last_fullsized":"2024-09-12T01:56:01.752114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:24.282033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522391+0000","last_change":"2024-09-12T01:55:55.702467+0000","last_active":"2024-09-12T01:56:02.522391+0000","last_peered":"2024-09-12T01:56:02.522391+0000","last_clean":"2024-09-12T01:56:02.522391+0000","last_became_active":"2024-09-12T01:55:55.702195+0000","last_became_peered":"2024-09-12T01:55:55.702195+0000","last_unstale":"2024-09-12T01:56:02.522391+0000","last_undegraded":"2024-09-12T01:56:02.522391+0000","last_fullsized":"2024-09-12T01:56:02.522391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:20.499801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522219+0000","last_change":"2024-09-12T01:55:54.687072+0000","last_active":"2024-09-12T01:56:02.522219+0000","last_peered":"2024-09-12T01:56:02.522219+0000","last_clean":"2024-09-12T01:56:02.522219+0000","last_became_active":"2024-09-12T01:55:54.686806+0000","last_became_peered":"2024-09-12T01:55:54.686806+0000","last_unstale":"2024-09-12T01:56:02.522219+0000","last_undegraded":"2024-09-12T01:56:02.522219+0000","last_fullsized":"2024-09-12T01:56:02.522219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:33.642516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460732+0000","last_change":"2024-09-12T01:55:59.719758+0000","last_active":"2024-09-12T01:56:02.460732+0000","last_peered":"2024-09-12T01:56:02.460732+0000","last_clean":"2024-09-12T01:56:02.460732+0000","last_became_active":"2024-09-12T01:55:59.719193+0000","last_became_peered":"2024-09-12T01:55:59.719193+0000","last_unstale":"2024-09-12T01:56:02.460732+0000","last_undegraded":"2024-09-12T01:56:02.460732+0000","last_fullsized":"2024-09-12T01:56:02.460732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:00.698014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752383+0000","last_change":"2024-09-12T01:55:55.700818+0000","last_active":"2024-09-12T01:56:01.752383+0000","last_peered":"2024-09-12T01:56:01.752383+0000","last_clean":"2024-09-12T01:56:01.752383+0000","last_became_active":"2024-09-12T01:55:55.700254+0000","last_became_peered":"2024-09-12T01:55:55.700254+0000","last_unstale":"2024-09-12T01:56:01.752383+0000","last_undegraded":"2024-09-12T01:56:01.752383+0000","last_fullsized":"2024-09-12T01:56:01.752383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:05.947832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745796+0000","last_change":"2024-09-12T01:55:54.695464+0000","last_active":"2024-09-12T01:56:01.745796+0000","last_peered":"2024-09-12T01:56:01.745796+0000","last_clean":"2024-09-12T01:56:01.745796+0000","last_became_active":"2024-09-12T01:55:54.695083+0000","last_became_peered":"2024-09-12T01:55:54.695083+0000","last_unstale":"2024-09-12T01:56:01.745796+0000","last_undegraded":"2024-09-12T01:56:01.745796+0000","last_fullsized":"2024-09-12T01:56:01.745796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:51.779183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521828+0000","last_change":"2024-09-12T01:56:00.522126+0000","last_active":"2024-09-12T01:56:02.521828+0000","last_peered":"2024-09-12T01:56:02.521828+0000","last_clean":"2024-09-12T01:56:02.521828+0000","last_became_active":"2024-09-12T01:56:00.521651+0000","last_became_peered":"2024-09-12T01:56:00.521651+0000","last_unstale":"2024-09-12T01:56:02.521828+0000","last_undegraded":"2024-09-12T01:56:02.521828+0000","last_fullsized":"2024-09-12T01:56:02.521828+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:48.043231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752282+0000","last_change":"2024-09-12T01:55:55.701400+0000","last_active":"2024-09-12T01:56:01.752282+0000","last_peered":"2024-09-12T01:56:01.752282+0000","last_clean":"2024-09-12T01:56:01.752282+0000","last_became_active":"2024-09-12T01:55:55.700281+0000","last_became_peered":"2024-09-12T01:55:55.700281+0000","last_unstale":"2024-09-12T01:56:01.752282+0000","last_undegraded":"2024-09-12T01:56:01.752282+0000","last_fullsized":"2024-09-12T01:56:01.752282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:32.262001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996924+0000","last_change":"2024-09-12T01:55:54.691224+0000","last_active":"2024-09-12T01:56:01.996924+0000","last_peered":"2024-09-12T01:56:01.996924+0000","last_clean":"2024-09-12T01:56:01.996924+0000","last_became_active":"2024-09-12T01:55:54.690944+0000","last_became_peered":"2024-09-12T01:55:54.690944+0000","last_unstale":"2024-09-12T01:56:01.996924+0000","last_undegraded":"2024-09-12T01:56:01.996924+0000","last_fullsized":"2024-09-12T01:56:01.996924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:51.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996161+0000","last_change":"2024-09-12T01:55:59.722394+0000","last_active":"2024-09-12T01:56:01.996161+0000","last_peered":"2024-09-12T01:56:01.996161+0000","last_clean":"2024-09-12T01:56:01.996161+0000","last_became_active":"2024-09-12T01:55:59.721835+0000","last_became_peered":"2024-09-12T01:55:59.721835+0000","last_unstale":"2024-09-12T01:56:01.996161+0000","last_undegraded":"2024-09-12T01:56:01.996161+0000","last_fullsized":"2024-09-12T01:56:01.996161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:06.742059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752118+0000","last_change":"2024-09-12T01:55:55.700667+0000","last_active":"2024-09-12T01:56:01.752118+0000","last_peered":"2024-09-12T01:56:01.752118+0000","last_clean":"2024-09-12T01:56:01.752118+0000","last_became_active":"2024-09-12T01:55:55.700369+0000","last_became_peered":"2024-09-12T01:55:55.700369+0000","last_unstale":"2024-09-12T01:56:01.752118+0000","last_undegraded":"2024-09-12T01:56:01.752118+0000","last_fullsized":"2024-09-12T01:56:01.752118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:17.560307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745655+0000","last_change":"2024-09-12T01:55:54.687908+0000","last_active":"2024-09-12T01:56:01.745655+0000","last_peered":"2024-09-12T01:56:01.745655+0000","last_clean":"2024-09-12T01:56:01.745655+0000","last_became_active":"2024-09-12T01:55:54.687608+0000","last_became_peered":"2024-09-12T01:55:54.687608+0000","last_unstale":"2024-09-12T01:56:01.745655+0000","last_undegraded":"2024-09-12T01:56:01.745655+0000","last_fullsized":"2024-09-12T01:56:01.745655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:56.359673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460597+0000","last_change":"2024-09-12T01:55:59.718288+0000","last_active":"2024-09-12T01:56:02.460597+0000","last_peered":"2024-09-12T01:56:02.460597+0000","last_clean":"2024-09-12T01:56:02.460597+0000","last_became_active":"2024-09-12T01:55:59.717322+0000","last_became_peered":"2024-09-12T01:55:59.717322+0000","last_unstale":"2024-09-12T01:56:02.460597+0000","last_undegraded":"2024-09-12T01:56:02.460597+0000","last_fullsized":"2024-09-12T01:56:02.460597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:22.647699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752673+0000","last_change":"2024-09-12T01:55:55.688289+0000","last_active":"2024-09-12T01:56:01.752673+0000","last_peered":"2024-09-12T01:56:01.752673+0000","last_clean":"2024-09-12T01:56:01.752673+0000","last_became_active":"2024-09-12T01:55:55.688004+0000","last_became_peered":"2024-09-12T01:55:55.688004+0000","last_unstale":"2024-09-12T01:56:01.752673+0000","last_undegraded":"2024-09-12T01:56:01.752673+0000","last_fullsized":"2024-09-12T01:56:01.752673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:10.809959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752404+0000","last_change":"2024-09-12T01:55:54.689369+0000","last_active":"2024-09-12T01:56:01.752404+0000","last_peered":"2024-09-12T01:56:01.752404+0000","last_clean":"2024-09-12T01:56:01.752404+0000","last_became_active":"2024-09-12T01:55:54.689097+0000","last_became_peered":"2024-09-12T01:55:54.689097+0000","last_unstale":"2024-09-12T01:56:01.752404+0000","last_undegraded":"2024-09-12T01:56:01.752404+0000","last_fullsized":"2024-09-12T01:56:01.752404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:48.747240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522904+0000","last_change":"2024-09-12T01:56:00.520323+0000","last_active":"2024-09-12T01:56:02.522904+0000","last_peered":"2024-09-12T01:56:02.522904+0000","last_clean":"2024-09-12T01:56:02.522904+0000","last_became_active":"2024-09-12T01:56:00.519824+0000","last_became_peered":"2024-09-12T01:56:00.519824+0000","last_unstale":"2024-09-12T01:56:02.522904+0000","last_undegraded":"2024-09-12T01:56:02.522904+0000","last_fullsized":"2024-09-12T01:56:02.522904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:52.098544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751804+0000","last_change":"2024-09-12T01:55:55.700672+0000","last_active":"2024-09-12T01:56:01.751804+0000","last_peered":"2024-09-12T01:56:01.751804+0000","last_clean":"2024-09-12T01:56:01.751804+0000","last_became_active":"2024-09-12T01:55:55.700200+0000","last_became_peered":"2024-09-12T01:55:55.700200+0000","last_unstale":"2024-09-12T01:56:01.751804+0000","last_undegraded":"2024-09-12T01:56:01.751804+0000","last_fullsized":"2024-09-12T01:56:01.751804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:52.516198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522306+0000","last_change":"2024-09-12T01:55:54.693863+0000","last_active":"2024-09-12T01:56:02.522306+0000","last_peered":"2024-09-12T01:56:02.522306+0000","last_clean":"2024-09-12T01:56:02.522306+0000","last_became_active":"2024-09-12T01:55:54.693523+0000","last_became_peered":"2024-09-12T01:55:54.693523+0000","last_unstale":"2024-09-12T01:56:02.522306+0000","last_undegraded":"2024-09-12T01:56:02.522306+0000","last_fullsized":"2024-09-12T01:56:02.522306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:48.747240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522582+0000","last_change":"2024-09-12T01:56:00.517194+0000","last_active":"2024-09-12T01:56:02.522582+0000","last_peered":"2024-09-12T01:56:02.522582+0000","last_clean":"2024-09-12T01:56:02.522582+0000","last_became_active":"2024-09-12T01:56:00.516727+0000","last_became_peered":"2024-09-12T01:56:00.516727+0000","last_unstale":"2024-09-12T01:56:02.522582+0000","last_undegraded":"2024-09-12T01:56:02.522582+0000","last_fullsized":"2024-09-12T01:56:02.522582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:00.596782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460450+0000","last_change":"2024-09-12T01:55:55.698062+0000","last_active":"2024-09-12T01:56:02.460450+0000","last_peered":"2024-09-12T01:56:02.460450+0000","last_clean":"2024-09-12T01:56:02.460450+0000","last_became_active":"2024-09-12T01:55:55.697776+0000","last_became_peered":"2024-09-12T01:55:55.697776+0000","last_unstale":"2024-09-12T01:56:02.460450+0000","last_undegraded":"2024-09-12T01:56:02.460450+0000","last_fullsized":"2024-09-12T01:56:02.460450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:28.067086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460790+0000","last_change":"2024-09-12T01:55:54.689127+0000","last_active":"2024-09-12T01:56:02.460790+0000","last_peered":"2024-09-12T01:56:02.460790+0000","last_clean":"2024-09-12T01:56:02.460790+0000","last_became_active":"2024-09-12T01:55:54.688722+0000","last_became_peered":"2024-09-12T01:55:54.688722+0000","last_unstale":"2024-09-12T01:56:02.460790+0000","last_undegraded":"2024-09-12T01:56:02.460790+0000","last_fullsized":"2024-09-12T01:56:02.460790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:56.353031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522434+0000","last_change":"2024-09-12T01:56:00.517059+0000","last_active":"2024-09-12T01:56:02.522434+0000","last_peered":"2024-09-12T01:56:02.522434+0000","last_clean":"2024-09-12T01:56:02.522434+0000","last_became_active":"2024-09-12T01:56:00.516595+0000","last_became_peered":"2024-09-12T01:56:00.516595+0000","last_unstale":"2024-09-12T01:56:02.522434+0000","last_undegraded":"2024-09-12T01:56:02.522434+0000","last_fullsized":"2024-09-12T01:56:02.522434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:14.390892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751922+0000","last_change":"2024-09-12T01:55:55.707760+0000","last_active":"2024-09-12T01:56:01.751922+0000","last_peered":"2024-09-12T01:56:01.751922+0000","last_clean":"2024-09-12T01:56:01.751922+0000","last_became_active":"2024-09-12T01:55:55.707514+0000","last_became_peered":"2024-09-12T01:55:55.707514+0000","last_unstale":"2024-09-12T01:56:01.751922+0000","last_undegraded":"2024-09-12T01:56:01.751922+0000","last_fullsized":"2024-09-12T01:56:01.751922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:20.499801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.256902+0000","last_change":"2024-09-12T01:55:54.690854+0000","last_active":"2024-09-12T01:56:05.256902+0000","last_peered":"2024-09-12T01:56:05.256902+0000","last_clean":"2024-09-12T01:56:05.256902+0000","last_became_active":"2024-09-12T01:55:54.690565+0000","last_became_peered":"2024-09-12T01:55:54.690565+0000","last_unstale":"2024-09-12T01:56:05.256902+0000","last_undegraded":"2024-09-12T01:56:05.256902+0000","last_fullsized":"2024-09-12T01:56:05.256902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:31.710719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522153+0000","last_change":"2024-09-12T01:55:59.728073+0000","last_active":"2024-09-12T01:56:02.522153+0000","last_peered":"2024-09-12T01:56:02.522153+0000","last_clean":"2024-09-12T01:56:02.522153+0000","last_became_active":"2024-09-12T01:55:59.727655+0000","last_became_peered":"2024-09-12T01:55:59.727655+0000","last_unstale":"2024-09-12T01:56:02.522153+0000","last_undegraded":"2024-09-12T01:56:02.522153+0000","last_fullsized":"2024-09-12T01:56:02.522153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:33.869240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996898+0000","last_change":"2024-09-12T01:55:55.698999+0000","last_active":"2024-09-12T01:56:01.996898+0000","last_peered":"2024-09-12T01:56:01.996898+0000","last_clean":"2024-09-12T01:56:01.996898+0000","last_became_active":"2024-09-12T01:55:55.698735+0000","last_became_peered":"2024-09-12T01:55:55.698735+0000","last_unstale":"2024-09-12T01:56:01.996898+0000","last_undegraded":"2024-09-12T01:56:01.996898+0000","last_fullsized":"2024-09-12T01:56:01.996898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:20.510009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522100+0000","last_change":"2024-09-12T01:55:54.692048+0000","last_active":"2024-09-12T01:56:02.522100+0000","last_peered":"2024-09-12T01:56:02.522100+0000","last_clean":"2024-09-12T01:56:02.522100+0000","last_became_active":"2024-09-12T01:55:54.691732+0000","last_became_peered":"2024-09-12T01:55:54.691732+0000","last_unstale":"2024-09-12T01:56:02.522100+0000","last_undegraded":"2024-09-12T01:56:02.522100+0000","last_fullsized":"2024-09-12T01:56:02.522100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:17.698798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996696+0000","last_change":"2024-09-12T01:55:59.715880+0000","last_active":"2024-09-12T01:56:01.996696+0000","last_peered":"2024-09-12T01:56:01.996696+0000","last_clean":"2024-09-12T01:56:01.996696+0000","last_became_active":"2024-09-12T01:55:59.715168+0000","last_became_peered":"2024-09-12T01:55:59.715168+0000","last_unstale":"2024-09-12T01:56:01.996696+0000","last_undegraded":"2024-09-12T01:56:01.996696+0000","last_fullsized":"2024-09-12T01:56:01.996696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:05.710174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460633+0000","last_change":"2024-09-12T01:55:55.690745+0000","last_active":"2024-09-12T01:56:02.460633+0000","last_peered":"2024-09-12T01:56:02.460633+0000","last_clean":"2024-09-12T01:56:02.460633+0000","last_became_active":"2024-09-12T01:55:55.690480+0000","last_became_peered":"2024-09-12T01:55:55.690480+0000","last_unstale":"2024-09-12T01:56:02.460633+0000","last_undegraded":"2024-09-12T01:56:02.460633+0000","last_fullsized":"2024-09-12T01:56:02.460633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:10.058977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522473+0000","last_change":"2024-09-12T01:55:54.691114+0000","last_active":"2024-09-12T01:56:02.522473+0000","last_peered":"2024-09-12T01:56:02.522473+0000","last_clean":"2024-09-12T01:56:02.522473+0000","last_became_active":"2024-09-12T01:55:54.690834+0000","last_became_peered":"2024-09-12T01:55:54.690834+0000","last_unstale":"2024-09-12T01:56:02.522473+0000","last_undegraded":"2024-09-12T01:56:02.522473+0000","last_fullsized":"2024-09-12T01:56:02.522473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:31.710719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521529+0000","last_change":"2024-09-12T01:55:59.722973+0000","last_active":"2024-09-12T01:56:02.521529+0000","last_peered":"2024-09-12T01:56:02.521529+0000","last_clean":"2024-09-12T01:56:02.521529+0000","last_became_active":"2024-09-12T01:55:59.722494+0000","last_became_peered":"2024-09-12T01:55:59.722494+0000","last_unstale":"2024-09-12T01:56:02.521529+0000","last_undegraded":"2024-09-12T01:56:02.521529+0000","last_fullsized":"2024-09-12T01:56:02.521529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:50.692862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522436+0000","last_change":"2024-09-12T01:55:55.696532+0000","last_active":"2024-09-12T01:56:02.522436+0000","last_peered":"2024-09-12T01:56:02.522436+0000","last_clean":"2024-09-12T01:56:02.522436+0000","last_became_active":"2024-09-12T01:55:55.696061+0000","last_became_peered":"2024-09-12T01:55:55.696061+0000","last_unstale":"2024-09-12T01:56:02.522436+0000","last_undegraded":"2024-09-12T01:56:02.522436+0000","last_fullsized":"2024-09-12T01:56:02.522436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.073038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752084+0000","last_change":"2024-09-12T01:55:54.687182+0000","last_active":"2024-09-12T01:56:01.752084+0000","last_peered":"2024-09-12T01:56:01.752084+0000","last_clean":"2024-09-12T01:56:01.752084+0000","last_became_active":"2024-09-12T01:55:54.686893+0000","last_became_peered":"2024-09-12T01:55:54.686893+0000","last_unstale":"2024-09-12T01:56:01.752084+0000","last_undegraded":"2024-09-12T01:56:01.752084+0000","last_fullsized":"2024-09-12T01:56:01.752084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:56.359673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521857+0000","last_change":"2024-09-12T01:56:00.519118+0000","last_active":"2024-09-12T01:56:02.521857+0000","last_peered":"2024-09-12T01:56:02.521857+0000","last_clean":"2024-09-12T01:56:02.521857+0000","last_became_active":"2024-09-12T01:56:00.518658+0000","last_became_peered":"2024-09-12T01:56:00.518658+0000","last_unstale":"2024-09-12T01:56:02.521857+0000","last_undegraded":"2024-09-12T01:56:02.521857+0000","last_fullsized":"2024-09-12T01:56:02.521857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:01.814275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460479+0000","last_change":"2024-09-12T01:56:00.519981+0000","last_active":"2024-09-12T01:56:02.460479+0000","last_peered":"2024-09-12T01:56:02.460479+0000","last_clean":"2024-09-12T01:56:02.460479+0000","last_became_active":"2024-09-12T01:56:00.519500+0000","last_became_peered":"2024-09-12T01:56:00.519500+0000","last_unstale":"2024-09-12T01:56:02.460479+0000","last_undegraded":"2024-09-12T01:56:02.460479+0000","last_fullsized":"2024-09-12T01:56:02.460479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:26.981322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521440+0000","last_change":"2024-09-12T01:55:55.687256+0000","last_active":"2024-09-12T01:56:02.521440+0000","last_peered":"2024-09-12T01:56:02.521440+0000","last_clean":"2024-09-12T01:56:02.521440+0000","last_became_active":"2024-09-12T01:55:55.685099+0000","last_became_peered":"2024-09-12T01:55:55.685099+0000","last_unstale":"2024-09-12T01:56:02.521440+0000","last_undegraded":"2024-09-12T01:56:02.521440+0000","last_fullsized":"2024-09-12T01:56:02.521440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:56.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522004+0000","last_change":"2024-09-12T01:55:54.694320+0000","last_active":"2024-09-12T01:56:02.522004+0000","last_peered":"2024-09-12T01:56:02.522004+0000","last_clean":"2024-09-12T01:56:02.522004+0000","last_became_active":"2024-09-12T01:55:54.694033+0000","last_became_peered":"2024-09-12T01:55:54.694033+0000","last_unstale":"2024-09-12T01:56:02.522004+0000","last_undegraded":"2024-09-12T01:56:02.522004+0000","last_fullsized":"2024-09-12T01:56:02.522004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:41.296972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751924+0000","last_change":"2024-09-12T01:55:59.721355+0000","last_active":"2024-09-12T01:56:01.751924+0000","last_peered":"2024-09-12T01:56:01.751924+0000","last_clean":"2024-09-12T01:56:01.751924+0000","last_became_active":"2024-09-12T01:55:59.720937+0000","last_became_peered":"2024-09-12T01:55:59.720937+0000","last_unstale":"2024-09-12T01:56:01.751924+0000","last_undegraded":"2024-09-12T01:56:01.751924+0000","last_fullsized":"2024-09-12T01:56:01.751924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:35.266537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521497+0000","last_change":"2024-09-12T01:55:55.703177+0000","last_active":"2024-09-12T01:56:02.521497+0000","last_peered":"2024-09-12T01:56:02.521497+0000","last_clean":"2024-09-12T01:56:02.521497+0000","last_became_active":"2024-09-12T01:55:55.697845+0000","last_became_peered":"2024-09-12T01:55:55.697845+0000","last_unstale":"2024-09-12T01:56:02.521497+0000","last_undegraded":"2024-09-12T01:56:02.521497+0000","last_fullsized":"2024-09-12T01:56:02.521497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:44.949953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521959+0000","last_change":"2024-09-12T01:55:54.690580+0000","last_active":"2024-09-12T01:56:02.521959+0000","last_peered":"2024-09-12T01:56:02.521959+0000","last_clean":"2024-09-12T01:56:02.521959+0000","last_became_active":"2024-09-12T01:55:54.690300+0000","last_became_peered":"2024-09-12T01:55:54.690300+0000","last_unstale":"2024-09-12T01:56:02.521959+0000","last_undegraded":"2024-09-12T01:56:02.521959+0000","last_fullsized":"2024-09-12T01:56:02.521959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:32.489045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752411+0000","last_change":"2024-09-12T01:55:54.687192+0000","last_active":"2024-09-12T01:56:01.752411+0000","last_peered":"2024-09-12T01:56:01.752411+0000","last_clean":"2024-09-12T01:56:01.752411+0000","last_became_active":"2024-09-12T01:55:54.686880+0000","last_became_peered":"2024-09-12T01:55:54.686880+0000","last_unstale":"2024-09-12T01:56:01.752411+0000","last_undegraded":"2024-09-12T01:56:01.752411+0000","last_fullsized":"2024-09-12T01:56:01.752411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:23.224359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460765+0000","last_change":"2024-09-12T01:55:55.693529+0000","last_active":"2024-09-12T01:56:02.460765+0000","last_peered":"2024-09-12T01:56:02.460765+0000","last_clean":"2024-09-12T01:56:02.460765+0000","last_became_active":"2024-09-12T01:55:55.693245+0000","last_became_peered":"2024-09-12T01:55:55.693245+0000","last_unstale":"2024-09-12T01:56:02.460765+0000","last_undegraded":"2024-09-12T01:56:02.460765+0000","last_fullsized":"2024-09-12T01:56:02.460765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:53.221222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.746166+0000","last_change":"2024-09-12T01:55:59.718401+0000","last_active":"2024-09-12T01:56:01.746166+0000","last_peered":"2024-09-12T01:56:01.746166+0000","last_clean":"2024-09-12T01:56:01.746166+0000","last_became_active":"2024-09-12T01:55:59.717933+0000","last_became_peered":"2024-09-12T01:55:59.717933+0000","last_unstale":"2024-09-12T01:56:01.746166+0000","last_undegraded":"2024-09-12T01:56:01.746166+0000","last_fullsized":"2024-09-12T01:56:01.746166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.213092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522420+0000","last_change":"2024-09-12T01:55:54.691342+0000","last_active":"2024-09-12T01:56:02.522420+0000","last_peered":"2024-09-12T01:56:02.522420+0000","last_clean":"2024-09-12T01:56:02.522420+0000","last_became_active":"2024-09-12T01:55:54.691025+0000","last_became_peered":"2024-09-12T01:55:54.691025+0000","last_unstale":"2024-09-12T01:56:02.522420+0000","last_undegraded":"2024-09-12T01:56:02.522420+0000","last_fullsized":"2024-09-12T01:56:02.522420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:51.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996419+0000","last_change":"2024-09-12T01:55:55.698351+0000","last_active":"2024-09-12T01:56:01.996419+0000","last_peered":"2024-09-12T01:56:01.996419+0000","last_clean":"2024-09-12T01:56:01.996419+0000","last_became_active":"2024-09-12T01:55:55.698050+0000","last_became_peered":"2024-09-12T01:55:55.698050+0000","last_unstale":"2024-09-12T01:56:01.996419+0000","last_undegraded":"2024-09-12T01:56:01.996419+0000","last_fullsized":"2024-09-12T01:56:01.996419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:50.888763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522693+0000","last_change":"2024-09-12T01:55:59.722326+0000","last_active":"2024-09-12T01:56:02.522693+0000","last_peered":"2024-09-12T01:56:02.522693+0000","last_clean":"2024-09-12T01:56:02.522693+0000","last_became_active":"2024-09-12T01:55:59.721902+0000","last_became_peered":"2024-09-12T01:55:59.721902+0000","last_unstale":"2024-09-12T01:56:02.522693+0000","last_undegraded":"2024-09-12T01:56:02.522693+0000","last_fullsized":"2024-09-12T01:56:02.522693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:39.486622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752590+0000","last_change":"2024-09-12T01:55:55.689349+0000","last_active":"2024-09-12T01:56:01.752590+0000","last_peered":"2024-09-12T01:56:01.752590+0000","last_clean":"2024-09-12T01:56:01.752590+0000","last_became_active":"2024-09-12T01:55:55.688915+0000","last_became_peered":"2024-09-12T01:55:55.688915+0000","last_unstale":"2024-09-12T01:56:01.752590+0000","last_undegraded":"2024-09-12T01:56:01.752590+0000","last_fullsized":"2024-09-12T01:56:01.752590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:28.067086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745858+0000","last_change":"2024-09-12T01:55:55.696841+0000","last_active":"2024-09-12T01:56:01.745858+0000","last_peered":"2024-09-12T01:56:01.745858+0000","last_clean":"2024-09-12T01:56:01.745858+0000","last_became_active":"2024-09-12T01:55:55.696545+0000","last_became_peered":"2024-09-12T01:55:55.696545+0000","last_unstale":"2024-09-12T01:56:01.745858+0000","last_undegraded":"2024-09-12T01:56:01.745858+0000","last_fullsized":"2024-09-12T01:56:01.745858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:46.163637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522177+0000","last_change":"2024-09-12T01:55:55.705917+0000","last_active":"2024-09-12T01:56:02.522177+0000","last_peered":"2024-09-12T01:56:02.522177+0000","last_clean":"2024-09-12T01:56:02.522177+0000","last_became_active":"2024-09-12T01:55:55.705517+0000","last_became_peered":"2024-09-12T01:55:55.705517+0000","last_unstale":"2024-09-12T01:56:02.522177+0000","last_undegraded":"2024-09-12T01:56:02.522177+0000","last_fullsized":"2024-09-12T01:56:02.522177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:31.237438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460726+0000","last_change":"2024-09-12T01:55:55.705881+0000","last_active":"2024-09-12T01:56:02.460726+0000","last_peered":"2024-09-12T01:56:02.460726+0000","last_clean":"2024-09-12T01:56:02.460726+0000","last_became_active":"2024-09-12T01:55:55.705557+0000","last_became_peered":"2024-09-12T01:55:55.705557+0000","last_unstale":"2024-09-12T01:56:02.460726+0000","last_undegraded":"2024-09-12T01:56:02.460726+0000","last_fullsized":"2024-09-12T01:56:02.460726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.073038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522638+0000","last_change":"2024-09-12T01:55:55.704834+0000","last_active":"2024-09-12T01:56:02.522638+0000","last_peered":"2024-09-12T01:56:02.522638+0000","last_clean":"2024-09-12T01:56:02.522638+0000","last_became_active":"2024-09-12T01:55:55.702868+0000","last_became_peered":"2024-09-12T01:55:55.702868+0000","last_unstale":"2024-09-12T01:56:02.522638+0000","last_undegraded":"2024-09-12T01:56:02.522638+0000","last_fullsized":"2024-09-12T01:56:02.522638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:06.356761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521624+0000","last_change":"2024-09-12T01:55:55.685821+0000","last_active":"2024-09-12T01:56:02.521624+0000","last_peered":"2024-09-12T01:56:02.521624+0000","last_clean":"2024-09-12T01:56:02.521624+0000","last_became_active":"2024-09-12T01:55:55.685517+0000","last_became_peered":"2024-09-12T01:55:55.685517+0000","last_unstale":"2024-09-12T01:56:02.521624+0000","last_undegraded":"2024-09-12T01:56:02.521624+0000","last_fullsized":"2024-09-12T01:56:02.521624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:18.907293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752735+0000","last_change":"2024-09-12T01:55:55.697608+0000","last_active":"2024-09-12T01:56:01.752735+0000","last_peered":"2024-09-12T01:56:01.752735+0000","last_clean":"2024-09-12T01:56:01.752735+0000","last_became_active":"2024-09-12T01:55:55.697368+0000","last_became_peered":"2024-09-12T01:55:55.697368+0000","last_unstale":"2024-09-12T01:56:01.752735+0000","last_undegraded":"2024-09-12T01:56:01.752735+0000","last_fullsized":"2024-09-12T01:56:01.752735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:53.221222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522816+0000","last_change":"2024-09-12T01:55:55.704580+0000","last_active":"2024-09-12T01:56:02.522816+0000","last_peered":"2024-09-12T01:56:02.522816+0000","last_clean":"2024-09-12T01:56:02.522816+0000","last_became_active":"2024-09-12T01:55:55.704310+0000","last_became_peered":"2024-09-12T01:55:55.704310+0000","last_unstale":"2024-09-12T01:56:02.522816+0000","last_undegraded":"2024-09-12T01:56:02.522816+0000","last_fullsized":"2024-09-12T01:56:02.522816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:30.891591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521987+0000","last_change":"2024-09-12T01:55:55.702574+0000","last_active":"2024-09-12T01:56:02.521987+0000","last_peered":"2024-09-12T01:56:02.521987+0000","last_clean":"2024-09-12T01:56:02.521987+0000","last_became_active":"2024-09-12T01:55:55.702381+0000","last_became_peered":"2024-09-12T01:55:55.702381+0000","last_unstale":"2024-09-12T01:56:02.521987+0000","last_undegraded":"2024-09-12T01:56:02.521987+0000","last_fullsized":"2024-09-12T01:56:02.521987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:14.471944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521666+0000","last_change":"2024-09-12T01:55:55.702491+0000","last_active":"2024-09-12T01:56:02.521666+0000","last_peered":"2024-09-12T01:56:02.521666+0000","last_clean":"2024-09-12T01:56:02.521666+0000","last_became_active":"2024-09-12T01:55:55.702184+0000","last_became_peered":"2024-09-12T01:55:55.702184+0000","last_unstale":"2024-09-12T01:56:02.521666+0000","last_undegraded":"2024-09-12T01:56:02.521666+0000","last_fullsized":"2024-09-12T01:56:02.521666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:29.526104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522126+0000","last_change":"2024-09-12T01:55:55.696303+0000","last_active":"2024-09-12T01:56:02.522126+0000","last_peered":"2024-09-12T01:56:02.522126+0000","last_clean":"2024-09-12T01:56:02.522126+0000","last_became_active":"2024-09-12T01:55:55.696044+0000","last_became_peered":"2024-09-12T01:55:55.696044+0000","last_unstale":"2024-09-12T01:56:02.522126+0000","last_undegraded":"2024-09-12T01:56:02.522126+0000","last_fullsized":"2024-09-12T01:56:02.522126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:41.082029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460625+0000","last_change":"2024-09-12T01:55:55.698223+0000","last_active":"2024-09-12T01:56:02.460625+0000","last_peered":"2024-09-12T01:56:02.460625+0000","last_clean":"2024-09-12T01:56:02.460625+0000","last_became_active":"2024-09-12T01:55:55.697926+0000","last_became_peered":"2024-09-12T01:55:55.697926+0000","last_unstale":"2024-09-12T01:56:02.460625+0000","last_undegraded":"2024-09-12T01:56:02.460625+0000","last_fullsized":"2024-09-12T01:56:02.460625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:10.809959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752785+0000","last_change":"2024-09-12T01:55:55.687766+0000","last_active":"2024-09-12T01:56:01.752785+0000","last_peered":"2024-09-12T01:56:01.752785+0000","last_clean":"2024-09-12T01:56:01.752785+0000","last_became_active":"2024-09-12T01:55:55.687387+0000","last_became_peered":"2024-09-12T01:55:55.687387+0000","last_unstale":"2024-09-12T01:56:01.752785+0000","last_undegraded":"2024-09-12T01:56:01.752785+0000","last_fullsized":"2024-09-12T01:56:01.752785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:05.184458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752307+0000","last_change":"2024-09-12T01:55:55.697237+0000","last_active":"2024-09-12T01:56:01.752307+0000","last_peered":"2024-09-12T01:56:01.752307+0000","last_clean":"2024-09-12T01:56:01.752307+0000","last_became_active":"2024-09-12T01:55:55.696731+0000","last_became_peered":"2024-09-12T01:55:55.696731+0000","last_unstale":"2024-09-12T01:56:01.752307+0000","last_undegraded":"2024-09-12T01:56:01.752307+0000","last_fullsized":"2024-09-12T01:56:01.752307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:18.618600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745740+0000","last_change":"2024-09-12T01:55:55.691750+0000","last_active":"2024-09-12T01:56:01.745740+0000","last_peered":"2024-09-12T01:56:01.745740+0000","last_clean":"2024-09-12T01:56:01.745740+0000","last_became_active":"2024-09-12T01:55:55.691456+0000","last_became_peered":"2024-09-12T01:55:55.691456+0000","last_unstale":"2024-09-12T01:56:01.745740+0000","last_undegraded":"2024-09-12T01:56:01.745740+0000","last_fullsized":"2024-09-12T01:56:01.745740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:08.358541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522682+0000","last_change":"2024-09-12T01:55:55.699943+0000","last_active":"2024-09-12T01:56:02.522682+0000","last_peered":"2024-09-12T01:56:02.522682+0000","last_clean":"2024-09-12T01:56:02.522682+0000","last_became_active":"2024-09-12T01:55:55.699679+0000","last_became_peered":"2024-09-12T01:55:55.699679+0000","last_unstale":"2024-09-12T01:56:02.522682+0000","last_undegraded":"2024-09-12T01:56:02.522682+0000","last_fullsized":"2024-09-12T01:56:02.522682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:48.470241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521849+0000","last_change":"2024-09-12T01:55:55.689119+0000","last_active":"2024-09-12T01:56:02.521849+0000","last_peered":"2024-09-12T01:56:02.521849+0000","last_clean":"2024-09-12T01:56:02.521849+0000","last_became_active":"2024-09-12T01:55:55.688803+0000","last_became_peered":"2024-09-12T01:55:55.688803+0000","last_unstale":"2024-09-12T01:56:02.521849+0000","last_undegraded":"2024-09-12T01:56:02.521849+0000","last_fullsized":"2024-09-12T01:56:02.521849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:53.221222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521525+0000","last_change":"2024-09-12T01:55:55.699561+0000","last_active":"2024-09-12T01:56:02.521525+0000","last_peered":"2024-09-12T01:56:02.521525+0000","last_clean":"2024-09-12T01:56:02.521525+0000","last_became_active":"2024-09-12T01:55:55.699223+0000","last_became_peered":"2024-09-12T01:55:55.699223+0000","last_unstale":"2024-09-12T01:56:02.521525+0000","last_undegraded":"2024-09-12T01:56:02.521525+0000","last_fullsized":"2024-09-12T01:56:02.521525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:29.526104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460560+0000","last_change":"2024-09-12T01:55:55.692821+0000","last_active":"2024-09-12T01:56:02.460560+0000","last_peered":"2024-09-12T01:56:02.460560+0000","last_clean":"2024-09-12T01:56:02.460560+0000","last_became_active":"2024-09-12T01:55:55.692497+0000","last_became_peered":"2024-09-12T01:55:55.692497+0000","last_unstale":"2024-09-12T01:56:02.460560+0000","last_undegraded":"2024-09-12T01:56:02.460560+0000","last_fullsized":"2024-09-12T01:56:02.460560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:30.090079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522316+0000","last_change":"2024-09-12T01:55:55.703581+0000","last_active":"2024-09-12T01:56:02.522316+0000","last_peered":"2024-09-12T01:56:02.522316+0000","last_clean":"2024-09-12T01:56:02.522316+0000","last_became_active":"2024-09-12T01:55:55.703271+0000","last_became_peered":"2024-09-12T01:55:55.703271+0000","last_unstale":"2024-09-12T01:56:02.522316+0000","last_undegraded":"2024-09-12T01:56:02.522316+0000","last_fullsized":"2024-09-12T01:56:02.522316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:56.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996754+0000","last_change":"2024-09-12T01:55:55.692636+0000","last_active":"2024-09-12T01:56:01.996754+0000","last_peered":"2024-09-12T01:56:01.996754+0000","last_clean":"2024-09-12T01:56:01.996754+0000","last_became_active":"2024-09-12T01:55:55.692367+0000","last_became_peered":"2024-09-12T01:55:55.692367+0000","last_unstale":"2024-09-12T01:56:01.996754+0000","last_undegraded":"2024-09-12T01:56:01.996754+0000","last_fullsized":"2024-09-12T01:56:01.996754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:44.926267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752614+0000","last_change":"2024-09-12T01:55:55.698490+0000","last_active":"2024-09-12T01:56:01.752614+0000","last_peered":"2024-09-12T01:56:01.752614+0000","last_clean":"2024-09-12T01:56:01.752614+0000","last_became_active":"2024-09-12T01:55:55.698190+0000","last_became_peered":"2024-09-12T01:55:55.698190+0000","last_unstale":"2024-09-12T01:56:01.752614+0000","last_undegraded":"2024-09-12T01:56:01.752614+0000","last_fullsized":"2024-09-12T01:56:01.752614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:36.523619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752728+0000","last_change":"2024-09-12T01:55:55.695606+0000","last_active":"2024-09-12T01:56:01.752728+0000","last_peered":"2024-09-12T01:56:01.752728+0000","last_clean":"2024-09-12T01:56:01.752728+0000","last_became_active":"2024-09-12T01:55:55.695348+0000","last_became_peered":"2024-09-12T01:55:55.695348+0000","last_unstale":"2024-09-12T01:56:01.752728+0000","last_undegraded":"2024-09-12T01:56:01.752728+0000","last_fullsized":"2024-09-12T01:56:01.752728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:10.058977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752300+0000","last_change":"2024-09-12T01:55:55.696973+0000","last_active":"2024-09-12T01:56:01.752300+0000","last_peered":"2024-09-12T01:56:01.752300+0000","last_clean":"2024-09-12T01:56:01.752300+0000","last_became_active":"2024-09-12T01:55:55.696435+0000","last_became_peered":"2024-09-12T01:55:55.696435+0000","last_unstale":"2024-09-12T01:56:01.752300+0000","last_undegraded":"2024-09-12T01:56:01.752300+0000","last_fullsized":"2024-09-12T01:56:01.752300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:20.252934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521402+0000","last_change":"2024-09-12T01:55:55.703874+0000","last_active":"2024-09-12T01:56:02.521402+0000","last_peered":"2024-09-12T01:56:02.521402+0000","last_clean":"2024-09-12T01:56:02.521402+0000","last_became_active":"2024-09-12T01:55:55.703532+0000","last_became_peered":"2024-09-12T01:55:55.703532+0000","last_unstale":"2024-09-12T01:56:02.521402+0000","last_undegraded":"2024-09-12T01:56:02.521402+0000","last_fullsized":"2024-09-12T01:56:02.521402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:04.569624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751534+0000","last_change":"2024-09-12T01:55:55.704083+0000","last_active":"2024-09-12T01:56:01.751534+0000","last_peered":"2024-09-12T01:56:01.751534+0000","last_clean":"2024-09-12T01:56:01.751534+0000","last_became_active":"2024-09-12T01:55:55.703653+0000","last_became_peered":"2024-09-12T01:55:55.703653+0000","last_unstale":"2024-09-12T01:56:01.751534+0000","last_undegraded":"2024-09-12T01:56:01.751534+0000","last_fullsized":"2024-09-12T01:56:01.751534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:14.471944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522008+0000","last_change":"2024-09-12T01:55:55.693606+0000","last_active":"2024-09-12T01:56:02.522008+0000","last_peered":"2024-09-12T01:56:02.522008+0000","last_clean":"2024-09-12T01:56:02.522008+0000","last_became_active":"2024-09-12T01:55:55.693044+0000","last_became_peered":"2024-09-12T01:55:55.693044+0000","last_unstale":"2024-09-12T01:56:02.522008+0000","last_undegraded":"2024-09-12T01:56:02.522008+0000","last_fullsized":"2024-09-12T01:56:02.522008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:42.036492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751606+0000","last_change":"2024-09-12T01:55:55.697766+0000","last_active":"2024-09-12T01:56:01.751606+0000","last_peered":"2024-09-12T01:56:01.751606+0000","last_clean":"2024-09-12T01:56:01.751606+0000","last_became_active":"2024-09-12T01:55:55.697504+0000","last_became_peered":"2024-09-12T01:55:55.697504+0000","last_unstale":"2024-09-12T01:56:01.751606+0000","last_undegraded":"2024-09-12T01:56:01.751606+0000","last_fullsized":"2024-09-12T01:56:01.751606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:01.034708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522237+0000","last_change":"2024-09-12T01:55:55.705929+0000","last_active":"2024-09-12T01:56:02.522237+0000","last_peered":"2024-09-12T01:56:02.522237+0000","last_clean":"2024-09-12T01:56:02.522237+0000","last_became_active":"2024-09-12T01:55:55.705645+0000","last_became_peered":"2024-09-12T01:55:55.705645+0000","last_unstale":"2024-09-12T01:56:02.522237+0000","last_undegraded":"2024-09-12T01:56:02.522237+0000","last_fullsized":"2024-09-12T01:56:02.522237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:17.560307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460374+0000","last_change":"2024-09-12T01:55:55.689459+0000","last_active":"2024-09-12T01:56:02.460374+0000","last_peered":"2024-09-12T01:56:02.460374+0000","last_clean":"2024-09-12T01:56:02.460374+0000","last_became_active":"2024-09-12T01:55:55.688932+0000","last_became_peered":"2024-09-12T01:55:55.688932+0000","last_unstale":"2024-09-12T01:56:02.460374+0000","last_undegraded":"2024-09-12T01:56:02.460374+0000","last_fullsized":"2024-09-12T01:56:02.460374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:49.242430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521944+0000","last_change":"2024-09-12T01:55:55.694825+0000","last_active":"2024-09-12T01:56:02.521944+0000","last_peered":"2024-09-12T01:56:02.521944+0000","last_clean":"2024-09-12T01:56:02.521944+0000","last_became_active":"2024-09-12T01:55:55.693916+0000","last_became_peered":"2024-09-12T01:55:55.693916+0000","last_unstale":"2024-09-12T01:56:02.521944+0000","last_undegraded":"2024-09-12T01:56:02.521944+0000","last_fullsized":"2024-09-12T01:56:02.521944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:49.260515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752010+0000","last_change":"2024-09-12T01:55:55.696732+0000","last_active":"2024-09-12T01:56:01.752010+0000","last_peered":"2024-09-12T01:56:01.752010+0000","last_clean":"2024-09-12T01:56:01.752010+0000","last_became_active":"2024-09-12T01:55:55.696146+0000","last_became_peered":"2024-09-12T01:55:55.696146+0000","last_unstale":"2024-09-12T01:56:01.752010+0000","last_undegraded":"2024-09-12T01:56:01.752010+0000","last_fullsized":"2024-09-12T01:56:01.752010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:31.237438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":880640,"data_stored":705461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":118355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":286720,"data_stored":114601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":118355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":114511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":114671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":888832,"data_stored":705517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":114637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:56:15.781 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:56:15.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.917+0000 7f022e181640 1 Processor -- start 2024-09-12T01:56:15.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.917+0000 7f022e181640 1 -- start start 2024-09-12T01:56:15.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.918+0000 7f022e181640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f02280cfcc0 0x7f022806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.918+0000 7f022e181640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f02280d4fd0 0x7f02280d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.918+0000 7f022e181640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02280d2700 con 0x7f022815e760 2024-09-12T01:56:15.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.918+0000 7f022e181640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f02280cedb0 con 0x7f02280d4fd0 2024-09-12T01:56:15.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.918+0000 7f022e181640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f02280cf090 con 0x7f02280cfcc0 2024-09-12T01:56:15.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.918+0000 7f0227fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f02280d4fd0 0x7f02280d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.918+0000 7f02277fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f022815e760 0x7f02280cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44778/0 (socket says 172.21.15.19:44778) 2024-09-12T01:56:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.918+0000 7f02277fe640 1 -- 172.21.15.19:0/655573229 learned_addr learned my addr 172.21.15.19:0/655573229 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.919+0000 7f02267fc640 1 -- 172.21.15.19:0/655573229 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2800571256 0 0) 0x7f0218001110 con 0x7f022815e760 2024-09-12T01:56:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.919+0000 7f0226ffd640 1 --2- 172.21.15.19:0/655573229 >> v2:172.21.15.135:3300/0 conn(0x7f02280cfcc0 0x7f022806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.919+0000 7f02267fc640 1 -- 172.21.15.19:0/655573229 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0210003520 con 0x7f022815e760 2024-09-12T01:56:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.919+0000 7f0227fff640 1 -- 172.21.15.19:0/655573229 >> v2:172.21.15.135:3300/0 conn(0x7f02280cfcc0 msgr2=0x7f022806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.919+0000 7f0227fff640 1 --2- 172.21.15.19:0/655573229 >> v2:172.21.15.135:3300/0 conn(0x7f02280cfcc0 0x7f022806cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.919+0000 7f0227fff640 1 -- 172.21.15.19:0/655573229 >> v1:172.21.15.19:6789/0 conn(0x7f022815e760 legacy=0x7f02280cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.919+0000 7f0227fff640 1 -- 172.21.15.19:0/655573229 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02280b3c80 con 0x7f02280d4fd0 2024-09-12T01:56:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.919+0000 7f0227fff640 1 --2- 172.21.15.19:0/655573229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02280d4fd0 0x7f02280d2ea0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f022808ca80 tx=0x7f022002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ff37a3213f36c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.920+0000 7f02267fc640 1 -- 172.21.15.19:0/655573229 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220007740 con 0x7f02280d4fd0 2024-09-12T01:56:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.920+0000 7f02267fc640 1 -- 172.21.15.19:0/655573229 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02200078e0 con 0x7f02280d4fd0 2024-09-12T01:56:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.920+0000 7f02267fc640 1 -- 172.21.15.19:0/655573229 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220007cb0 con 0x7f02280d4fd0 2024-09-12T01:56:15.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.920+0000 7f022e181640 1 -- 172.21.15.19:0/655573229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02280d4fd0 msgr2=0x7f02280d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.920+0000 7f022e181640 1 --2- 172.21.15.19:0/655573229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02280d4fd0 0x7f02280d2ea0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f022808ca80 tx=0x7f022002a680 comp rx=0 tx=0).stop 2024-09-12T01:56:15.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.920+0000 7f022e181640 1 -- 172.21.15.19:0/655573229 shutdown_connections 2024-09-12T01:56:15.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.920+0000 7f022e181640 1 --2- 172.21.15.19:0/655573229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02280d4fd0 0x7f02280d2ea0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.920+0000 7f022e181640 1 --2- 172.21.15.19:0/655573229 >> v2:172.21.15.135:3300/0 conn(0x7f02280cfcc0 0x7f022806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.920+0000 7f022e181640 1 -- 172.21.15.19:0/655573229 >> 172.21.15.19:0/655573229 conn(0x7f022808bfc0 msgr2=0x7f02280d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:15.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.920+0000 7f022e181640 1 -- 172.21.15.19:0/655573229 shutdown_connections 2024-09-12T01:56:15.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.920+0000 7f022e181640 1 -- 172.21.15.19:0/655573229 wait complete. 2024-09-12T01:56:15.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.921+0000 7f022e181640 1 Processor -- start 2024-09-12T01:56:15.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.922+0000 7f022e181640 1 -- start start 2024-09-12T01:56:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.922+0000 7f022e181640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02280cfcc0 0x7f022815c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.922+0000 7f022e181640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02280d4fd0 0x7f02280b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.922+0000 7f022e181640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022815e760 0x7f02280cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.922+0000 7f022e181640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f02280d33e0 con 0x7f02280d4fd0 2024-09-12T01:56:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.922+0000 7f022e181640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f02280b38e0 con 0x7f022815e760 2024-09-12T01:56:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.922+0000 7f022e181640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f02280d3560 con 0x7f02280cfcc0 2024-09-12T01:56:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.922+0000 7f0226ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02280d4fd0 0x7f02280b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.923+0000 7f0226ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02280d4fd0 0x7f02280b7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41894/0 (socket says 172.21.15.19:41894) 2024-09-12T01:56:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.923+0000 7f0226ffd640 1 -- 172.21.15.19:0/2738612390 learned_addr learned my addr 172.21.15.19:0/2738612390 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.923+0000 7f02277fe640 1 --2- 172.21.15.19:0/2738612390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02280cfcc0 0x7f022815c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.923+0000 7f0227fff640 1 --2- 172.21.15.19:0/2738612390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022815e760 0x7f02280cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.923+0000 7f0226ffd640 1 -- 172.21.15.19:0/2738612390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02280cfcc0 msgr2=0x7f022815c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.923+0000 7f0226ffd640 1 --2- 172.21.15.19:0/2738612390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02280cfcc0 0x7f022815c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.923+0000 7f0226ffd640 1 -- 172.21.15.19:0/2738612390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022815e760 msgr2=0x7f02280cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.923+0000 7f0226ffd640 1 --2- 172.21.15.19:0/2738612390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022815e760 0x7f02280cb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.923+0000 7f0226ffd640 1 -- 172.21.15.19:0/2738612390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02280b9d10 con 0x7f02280d4fd0 2024-09-12T01:56:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.923+0000 7f0226ffd640 1 --2- 172.21.15.19:0/2738612390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02280d4fd0 0x7f02280b7f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f021c00d830 tx=0x7f021c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.923+0000 7f020ffff640 1 -- 172.21.15.19:0/2738612390 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c00b660 con 0x7f02280d4fd0 2024-09-12T01:56:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.923+0000 7f020ffff640 1 -- 172.21.15.19:0/2738612390 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f021c019070 con 0x7f02280d4fd0 2024-09-12T01:56:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.923+0000 7f022e181640 1 -- 172.21.15.19:0/2738612390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02280b74b0 con 0x7f02280d4fd0 2024-09-12T01:56:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.923+0000 7f020ffff640 1 -- 172.21.15.19:0/2738612390 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c00ba40 con 0x7f02280d4fd0 2024-09-12T01:56:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.923+0000 7f022e181640 1 -- 172.21.15.19:0/2738612390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02280b99e0 con 0x7f02280d4fd0 2024-09-12T01:56:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.924+0000 7f022e181640 1 -- 172.21.15.19:0/2738612390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02280d3890 con 0x7f02280d4fd0 2024-09-12T01:56:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.925+0000 7f020ffff640 1 -- 172.21.15.19:0/2738612390 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f021c01e460 con 0x7f02280d4fd0 2024-09-12T01:56:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.925+0000 7f020ffff640 1 --2- 172.21.15.19:0/2738612390 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f021406be30 0x7f021406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.925+0000 7f020ffff640 1 -- 172.21.15.19:0/2738612390 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f021c08b770 con 0x7f02280d4fd0 2024-09-12T01:56:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.925+0000 7f02277fe640 1 --2- 172.21.15.19:0/2738612390 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f021406be30 0x7f021406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:15.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.926+0000 7f02277fe640 1 --2- 172.21.15.19:0/2738612390 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f021406be30 0x7f021406e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f02180012b0 tx=0x7f0218009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:15.930+0000 7f020ffff640 1 -- 172.21.15.19:0/2738612390 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f021c059e70 con 0x7f02280d4fd0 2024-09-12T01:56:16.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.103+0000 7f022e181640 1 -- 172.21.15.19:0/2738612390 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f02280b6d20 con 0x7f021406be30 2024-09-12T01:56:16.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.111+0000 7f020ffff640 1 -- 172.21.15.19:0/2738612390 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f02280b6d20 con 0x7f021406be30 2024-09-12T01:56:16.116 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:16.118 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:56:16.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.114+0000 7f022e181640 1 -- 172.21.15.19:0/2738612390 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f021406be30 msgr2=0x7f021406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.114+0000 7f022e181640 1 --2- 172.21.15.19:0/2738612390 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f021406be30 0x7f021406e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f02180012b0 tx=0x7f0218009040 comp rx=0 tx=0).stop 2024-09-12T01:56:16.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.114+0000 7f022e181640 1 -- 172.21.15.19:0/2738612390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02280d4fd0 msgr2=0x7f02280b7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.114+0000 7f022e181640 1 --2- 172.21.15.19:0/2738612390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02280d4fd0 0x7f02280b7f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f021c00d830 tx=0x7f021c00dcf0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.114+0000 7f022e181640 1 -- 172.21.15.19:0/2738612390 shutdown_connections 2024-09-12T01:56:16.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.114+0000 7f022e181640 1 --2- 172.21.15.19:0/2738612390 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f021406be30 0x7f021406e2f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.114+0000 7f022e181640 1 --2- 172.21.15.19:0/2738612390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022815e760 0x7f02280cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.114+0000 7f022e181640 1 --2- 172.21.15.19:0/2738612390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02280d4fd0 0x7f02280b7f90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.114+0000 7f022e181640 1 --2- 172.21.15.19:0/2738612390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02280cfcc0 0x7f022815c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.114+0000 7f022e181640 1 -- 172.21.15.19:0/2738612390 >> 172.21.15.19:0/2738612390 conn(0x7f022808bfc0 msgr2=0x7f02280b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:16.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.115+0000 7f022e181640 1 -- 172.21.15.19:0/2738612390 shutdown_connections 2024-09-12T01:56:16.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.115+0000 7f022e181640 1 -- 172.21.15.19:0/2738612390 wait complete. 2024-09-12T01:56:16.126 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-12T01:56:16.088835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219680,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755040,"statfs":{"total":773094113280,"available":772869160960,"internally_reserved":0,"allocated":3514368,"data_stored":2106108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003565"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460711+0000","last_change":"2024-09-12T01:55:54.691417+0000","last_active":"2024-09-12T01:56:02.460711+0000","last_peered":"2024-09-12T01:56:02.460711+0000","last_clean":"2024-09-12T01:56:02.460711+0000","last_became_active":"2024-09-12T01:55:54.690940+0000","last_became_peered":"2024-09-12T01:55:54.690940+0000","last_unstale":"2024-09-12T01:56:02.460711+0000","last_undegraded":"2024-09-12T01:56:02.460711+0000","last_fullsized":"2024-09-12T01:56:02.460711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:41.898184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522661+0000","last_change":"2024-09-12T01:55:55.703230+0000","last_active":"2024-09-12T01:56:02.522661+0000","last_peered":"2024-09-12T01:56:02.522661+0000","last_clean":"2024-09-12T01:56:02.522661+0000","last_became_active":"2024-09-12T01:55:55.702937+0000","last_became_peered":"2024-09-12T01:55:55.702937+0000","last_unstale":"2024-09-12T01:56:02.522661+0000","last_undegraded":"2024-09-12T01:56:02.522661+0000","last_fullsized":"2024-09-12T01:56:02.522661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:12.877973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521554+0000","last_change":"2024-09-12T01:56:00.522020+0000","last_active":"2024-09-12T01:56:02.521554+0000","last_peered":"2024-09-12T01:56:02.521554+0000","last_clean":"2024-09-12T01:56:02.521554+0000","last_became_active":"2024-09-12T01:56:00.521659+0000","last_became_peered":"2024-09-12T01:56:00.521659+0000","last_unstale":"2024-09-12T01:56:02.521554+0000","last_undegraded":"2024-09-12T01:56:02.521554+0000","last_fullsized":"2024-09-12T01:56:02.521554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:04.626201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522786+0000","last_change":"2024-09-12T01:55:54.693523+0000","last_active":"2024-09-12T01:56:02.522786+0000","last_peered":"2024-09-12T01:56:02.522786+0000","last_clean":"2024-09-12T01:56:02.522786+0000","last_became_active":"2024-09-12T01:55:54.693127+0000","last_became_peered":"2024-09-12T01:55:54.693127+0000","last_unstale":"2024-09-12T01:56:02.522786+0000","last_undegraded":"2024-09-12T01:56:02.522786+0000","last_fullsized":"2024-09-12T01:56:02.522786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:18.178661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460539+0000","last_change":"2024-09-12T01:55:55.695198+0000","last_active":"2024-09-12T01:56:02.460539+0000","last_peered":"2024-09-12T01:56:02.460539+0000","last_clean":"2024-09-12T01:56:02.460539+0000","last_became_active":"2024-09-12T01:55:55.694897+0000","last_became_peered":"2024-09-12T01:55:55.694897+0000","last_unstale":"2024-09-12T01:56:02.460539+0000","last_undegraded":"2024-09-12T01:56:02.460539+0000","last_fullsized":"2024-09-12T01:56:02.460539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:05.184458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996331+0000","last_change":"2024-09-12T01:55:59.720981+0000","last_active":"2024-09-12T01:56:01.996331+0000","last_peered":"2024-09-12T01:56:01.996331+0000","last_clean":"2024-09-12T01:56:01.996331+0000","last_became_active":"2024-09-12T01:55:59.720424+0000","last_became_peered":"2024-09-12T01:55:59.720424+0000","last_unstale":"2024-09-12T01:56:01.996331+0000","last_undegraded":"2024-09-12T01:56:01.996331+0000","last_fullsized":"2024-09-12T01:56:01.996331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:37.646140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752215+0000","last_change":"2024-09-12T01:55:54.691906+0000","last_active":"2024-09-12T01:56:01.752215+0000","last_peered":"2024-09-12T01:56:01.752215+0000","last_clean":"2024-09-12T01:56:01.752215+0000","last_became_active":"2024-09-12T01:55:54.691632+0000","last_became_peered":"2024-09-12T01:55:54.691632+0000","last_unstale":"2024-09-12T01:56:01.752215+0000","last_undegraded":"2024-09-12T01:56:01.752215+0000","last_fullsized":"2024-09-12T01:56:01.752215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:02.585865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522293+0000","last_change":"2024-09-12T01:55:55.690825+0000","last_active":"2024-09-12T01:56:02.522293+0000","last_peered":"2024-09-12T01:56:02.522293+0000","last_clean":"2024-09-12T01:56:02.522293+0000","last_became_active":"2024-09-12T01:55:55.690498+0000","last_became_peered":"2024-09-12T01:55:55.690498+0000","last_unstale":"2024-09-12T01:56:02.522293+0000","last_undegraded":"2024-09-12T01:56:02.522293+0000","last_fullsized":"2024-09-12T01:56:02.522293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:20.252934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996426+0000","last_change":"2024-09-12T01:55:59.722572+0000","last_active":"2024-09-12T01:56:01.996426+0000","last_peered":"2024-09-12T01:56:01.996426+0000","last_clean":"2024-09-12T01:56:01.996426+0000","last_became_active":"2024-09-12T01:55:59.722043+0000","last_became_peered":"2024-09-12T01:55:59.722043+0000","last_unstale":"2024-09-12T01:56:01.996426+0000","last_undegraded":"2024-09-12T01:56:01.996426+0000","last_fullsized":"2024-09-12T01:56:01.996426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:01.089137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751710+0000","last_change":"2024-09-12T01:55:54.694886+0000","last_active":"2024-09-12T01:56:01.751710+0000","last_peered":"2024-09-12T01:56:01.751710+0000","last_clean":"2024-09-12T01:56:01.751710+0000","last_became_active":"2024-09-12T01:55:54.694641+0000","last_became_peered":"2024-09-12T01:55:54.694641+0000","last_unstale":"2024-09-12T01:56:01.751710+0000","last_undegraded":"2024-09-12T01:56:01.751710+0000","last_fullsized":"2024-09-12T01:56:01.751710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:07.353242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522367+0000","last_change":"2024-09-12T01:55:55.697509+0000","last_active":"2024-09-12T01:56:02.522367+0000","last_peered":"2024-09-12T01:56:02.522367+0000","last_clean":"2024-09-12T01:56:02.522367+0000","last_became_active":"2024-09-12T01:55:55.696597+0000","last_became_peered":"2024-09-12T01:55:55.696597+0000","last_unstale":"2024-09-12T01:56:02.522367+0000","last_undegraded":"2024-09-12T01:56:02.522367+0000","last_fullsized":"2024-09-12T01:56:02.522367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:50.551708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996296+0000","last_change":"2024-09-12T01:55:59.717407+0000","last_active":"2024-09-12T01:56:01.996296+0000","last_peered":"2024-09-12T01:56:01.996296+0000","last_clean":"2024-09-12T01:56:01.996296+0000","last_became_active":"2024-09-12T01:55:59.716747+0000","last_became_peered":"2024-09-12T01:55:59.716747+0000","last_unstale":"2024-09-12T01:56:01.996296+0000","last_undegraded":"2024-09-12T01:56:01.996296+0000","last_fullsized":"2024-09-12T01:56:01.996296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:30.245761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752221+0000","last_change":"2024-09-12T01:55:55.694504+0000","last_active":"2024-09-12T01:56:01.752221+0000","last_peered":"2024-09-12T01:56:01.752221+0000","last_clean":"2024-09-12T01:56:01.752221+0000","last_became_active":"2024-09-12T01:55:55.694202+0000","last_became_peered":"2024-09-12T01:55:55.694202+0000","last_unstale":"2024-09-12T01:56:01.752221+0000","last_undegraded":"2024-09-12T01:56:01.752221+0000","last_fullsized":"2024-09-12T01:56:01.752221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:49.242430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751844+0000","last_change":"2024-09-12T01:55:54.690614+0000","last_active":"2024-09-12T01:56:01.751844+0000","last_peered":"2024-09-12T01:56:01.751844+0000","last_clean":"2024-09-12T01:56:01.751844+0000","last_became_active":"2024-09-12T01:55:54.690334+0000","last_became_peered":"2024-09-12T01:55:54.690334+0000","last_unstale":"2024-09-12T01:56:01.751844+0000","last_undegraded":"2024-09-12T01:56:01.751844+0000","last_fullsized":"2024-09-12T01:56:01.751844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:29.431495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996751+0000","last_change":"2024-09-12T01:55:59.728056+0000","last_active":"2024-09-12T01:56:01.996751+0000","last_peered":"2024-09-12T01:56:01.996751+0000","last_clean":"2024-09-12T01:56:01.996751+0000","last_became_active":"2024-09-12T01:55:59.727677+0000","last_became_peered":"2024-09-12T01:55:59.727677+0000","last_unstale":"2024-09-12T01:56:01.996751+0000","last_undegraded":"2024-09-12T01:56:01.996751+0000","last_fullsized":"2024-09-12T01:56:01.996751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:25.127551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522339+0000","last_change":"2024-09-12T01:55:55.696190+0000","last_active":"2024-09-12T01:56:02.522339+0000","last_peered":"2024-09-12T01:56:02.522339+0000","last_clean":"2024-09-12T01:56:02.522339+0000","last_became_active":"2024-09-12T01:55:55.695882+0000","last_became_peered":"2024-09-12T01:55:55.695882+0000","last_unstale":"2024-09-12T01:56:02.522339+0000","last_undegraded":"2024-09-12T01:56:02.522339+0000","last_fullsized":"2024-09-12T01:56:02.522339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:18.907293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522246+0000","last_change":"2024-09-12T01:55:54.691318+0000","last_active":"2024-09-12T01:56:02.522246+0000","last_peered":"2024-09-12T01:56:02.522246+0000","last_clean":"2024-09-12T01:56:02.522246+0000","last_became_active":"2024-09-12T01:55:54.690960+0000","last_became_peered":"2024-09-12T01:55:54.690960+0000","last_unstale":"2024-09-12T01:56:02.522246+0000","last_undegraded":"2024-09-12T01:56:02.522246+0000","last_fullsized":"2024-09-12T01:56:02.522246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:12.646367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996557+0000","last_change":"2024-09-12T01:55:59.721175+0000","last_active":"2024-09-12T01:56:01.996557+0000","last_peered":"2024-09-12T01:56:01.996557+0000","last_clean":"2024-09-12T01:56:01.996557+0000","last_became_active":"2024-09-12T01:55:59.720481+0000","last_became_peered":"2024-09-12T01:55:59.720481+0000","last_unstale":"2024-09-12T01:56:01.996557+0000","last_undegraded":"2024-09-12T01:56:01.996557+0000","last_fullsized":"2024-09-12T01:56:01.996557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:33.869240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521581+0000","last_change":"2024-09-12T01:55:55.686041+0000","last_active":"2024-09-12T01:56:02.521581+0000","last_peered":"2024-09-12T01:56:02.521581+0000","last_clean":"2024-09-12T01:56:02.521581+0000","last_became_active":"2024-09-12T01:55:55.685758+0000","last_became_peered":"2024-09-12T01:55:55.685758+0000","last_unstale":"2024-09-12T01:56:02.521581+0000","last_undegraded":"2024-09-12T01:56:02.521581+0000","last_fullsized":"2024-09-12T01:56:02.521581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:11.963913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521629+0000","last_change":"2024-09-12T01:55:54.688788+0000","last_active":"2024-09-12T01:56:02.521629+0000","last_peered":"2024-09-12T01:56:02.521629+0000","last_clean":"2024-09-12T01:56:02.521629+0000","last_became_active":"2024-09-12T01:55:54.688513+0000","last_became_peered":"2024-09-12T01:55:54.688513+0000","last_unstale":"2024-09-12T01:56:02.521629+0000","last_undegraded":"2024-09-12T01:56:02.521629+0000","last_fullsized":"2024-09-12T01:56:02.521629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:49.883464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522091+0000","last_change":"2024-09-12T01:56:00.517213+0000","last_active":"2024-09-12T01:56:02.522091+0000","last_peered":"2024-09-12T01:56:02.522091+0000","last_clean":"2024-09-12T01:56:02.522091+0000","last_became_active":"2024-09-12T01:56:00.516759+0000","last_became_peered":"2024-09-12T01:56:00.516759+0000","last_unstale":"2024-09-12T01:56:02.522091+0000","last_undegraded":"2024-09-12T01:56:02.522091+0000","last_fullsized":"2024-09-12T01:56:02.522091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:01.089137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996491+0000","last_change":"2024-09-12T01:55:55.688036+0000","last_active":"2024-09-12T01:56:01.996491+0000","last_peered":"2024-09-12T01:56:01.996491+0000","last_clean":"2024-09-12T01:56:01.996491+0000","last_became_active":"2024-09-12T01:55:55.687764+0000","last_became_peered":"2024-09-12T01:55:55.687764+0000","last_unstale":"2024-09-12T01:56:01.996491+0000","last_undegraded":"2024-09-12T01:56:01.996491+0000","last_fullsized":"2024-09-12T01:56:01.996491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:18.704097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751280+0000","last_change":"2024-09-12T01:55:54.693835+0000","last_active":"2024-09-12T01:56:01.751280+0000","last_peered":"2024-09-12T01:56:01.751280+0000","last_clean":"2024-09-12T01:56:01.751280+0000","last_became_active":"2024-09-12T01:55:54.693191+0000","last_became_peered":"2024-09-12T01:55:54.693191+0000","last_unstale":"2024-09-12T01:56:01.751280+0000","last_undegraded":"2024-09-12T01:56:01.751280+0000","last_fullsized":"2024-09-12T01:56:01.751280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:33.178694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996869+0000","last_change":"2024-09-12T01:55:59.720935+0000","last_active":"2024-09-12T01:56:01.996869+0000","last_peered":"2024-09-12T01:56:01.996869+0000","last_clean":"2024-09-12T01:56:01.996869+0000","last_became_active":"2024-09-12T01:55:59.720510+0000","last_became_peered":"2024-09-12T01:55:59.720510+0000","last_unstale":"2024-09-12T01:56:01.996869+0000","last_undegraded":"2024-09-12T01:56:01.996869+0000","last_fullsized":"2024-09-12T01:56:01.996869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:24.129803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460733+0000","last_change":"2024-09-12T01:55:55.693557+0000","last_active":"2024-09-12T01:56:02.460733+0000","last_peered":"2024-09-12T01:56:02.460733+0000","last_clean":"2024-09-12T01:56:02.460733+0000","last_became_active":"2024-09-12T01:55:55.693073+0000","last_became_peered":"2024-09-12T01:55:55.693073+0000","last_unstale":"2024-09-12T01:56:02.460733+0000","last_undegraded":"2024-09-12T01:56:02.460733+0000","last_fullsized":"2024-09-12T01:56:02.460733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:36.523619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752229+0000","last_change":"2024-09-12T01:55:54.692628+0000","last_active":"2024-09-12T01:56:01.752229+0000","last_peered":"2024-09-12T01:56:01.752229+0000","last_clean":"2024-09-12T01:56:01.752229+0000","last_became_active":"2024-09-12T01:55:54.692323+0000","last_became_peered":"2024-09-12T01:55:54.692323+0000","last_unstale":"2024-09-12T01:56:01.752229+0000","last_undegraded":"2024-09-12T01:56:01.752229+0000","last_fullsized":"2024-09-12T01:56:01.752229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:51.779183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996393+0000","last_change":"2024-09-12T01:56:00.519632+0000","last_active":"2024-09-12T01:56:01.996393+0000","last_peered":"2024-09-12T01:56:01.996393+0000","last_clean":"2024-09-12T01:56:01.996393+0000","last_became_active":"2024-09-12T01:56:00.518952+0000","last_became_peered":"2024-09-12T01:56:00.518952+0000","last_unstale":"2024-09-12T01:56:01.996393+0000","last_undegraded":"2024-09-12T01:56:01.996393+0000","last_fullsized":"2024-09-12T01:56:01.996393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:25.728022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522901+0000","last_change":"2024-09-12T01:55:55.701476+0000","last_active":"2024-09-12T01:56:02.522901+0000","last_peered":"2024-09-12T01:56:02.522901+0000","last_clean":"2024-09-12T01:56:02.522901+0000","last_became_active":"2024-09-12T01:55:55.697719+0000","last_became_peered":"2024-09-12T01:55:55.697719+0000","last_unstale":"2024-09-12T01:56:02.522901+0000","last_undegraded":"2024-09-12T01:56:02.522901+0000","last_fullsized":"2024-09-12T01:56:02.522901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:05.703141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521753+0000","last_change":"2024-09-12T01:55:54.683694+0000","last_active":"2024-09-12T01:56:02.521753+0000","last_peered":"2024-09-12T01:56:02.521753+0000","last_clean":"2024-09-12T01:56:02.521753+0000","last_became_active":"2024-09-12T01:55:54.683332+0000","last_became_peered":"2024-09-12T01:55:54.683332+0000","last_unstale":"2024-09-12T01:56:02.521753+0000","last_undegraded":"2024-09-12T01:56:02.521753+0000","last_fullsized":"2024-09-12T01:56:02.521753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:24.503780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521372+0000","last_change":"2024-09-12T01:56:00.518243+0000","last_active":"2024-09-12T01:56:02.521372+0000","last_peered":"2024-09-12T01:56:02.521372+0000","last_clean":"2024-09-12T01:56:02.521372+0000","last_became_active":"2024-09-12T01:56:00.517815+0000","last_became_peered":"2024-09-12T01:56:00.517815+0000","last_unstale":"2024-09-12T01:56:02.521372+0000","last_undegraded":"2024-09-12T01:56:02.521372+0000","last_fullsized":"2024-09-12T01:56:02.521372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:59.474572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521936+0000","last_change":"2024-09-12T01:55:55.683383+0000","last_active":"2024-09-12T01:56:02.521936+0000","last_peered":"2024-09-12T01:56:02.521936+0000","last_clean":"2024-09-12T01:56:02.521936+0000","last_became_active":"2024-09-12T01:55:55.683045+0000","last_became_peered":"2024-09-12T01:55:55.683045+0000","last_unstale":"2024-09-12T01:56:02.521936+0000","last_undegraded":"2024-09-12T01:56:02.521936+0000","last_fullsized":"2024-09-12T01:56:02.521936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:11.963913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752400+0000","last_change":"2024-09-12T01:55:54.693479+0000","last_active":"2024-09-12T01:56:01.752400+0000","last_peered":"2024-09-12T01:56:01.752400+0000","last_clean":"2024-09-12T01:56:01.752400+0000","last_became_active":"2024-09-12T01:55:54.693222+0000","last_became_peered":"2024-09-12T01:55:54.693222+0000","last_unstale":"2024-09-12T01:56:01.752400+0000","last_undegraded":"2024-09-12T01:56:01.752400+0000","last_fullsized":"2024-09-12T01:56:01.752400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:29.084779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460600+0000","last_change":"2024-09-12T01:56:00.517418+0000","last_active":"2024-09-12T01:56:02.460600+0000","last_peered":"2024-09-12T01:56:02.460600+0000","last_clean":"2024-09-12T01:56:02.460600+0000","last_became_active":"2024-09-12T01:56:00.516727+0000","last_became_peered":"2024-09-12T01:56:00.516727+0000","last_unstale":"2024-09-12T01:56:02.460600+0000","last_undegraded":"2024-09-12T01:56:02.460600+0000","last_fullsized":"2024-09-12T01:56:02.460600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:05.063807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522480+0000","last_change":"2024-09-12T01:55:55.705667+0000","last_active":"2024-09-12T01:56:02.522480+0000","last_peered":"2024-09-12T01:56:02.522480+0000","last_clean":"2024-09-12T01:56:02.522480+0000","last_became_active":"2024-09-12T01:55:55.705409+0000","last_became_peered":"2024-09-12T01:55:55.705409+0000","last_unstale":"2024-09-12T01:56:02.522480+0000","last_undegraded":"2024-09-12T01:56:02.522480+0000","last_fullsized":"2024-09-12T01:56:02.522480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:32.262001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522031+0000","last_change":"2024-09-12T01:55:54.690520+0000","last_active":"2024-09-12T01:56:02.522031+0000","last_peered":"2024-09-12T01:56:02.522031+0000","last_clean":"2024-09-12T01:56:02.522031+0000","last_became_active":"2024-09-12T01:55:54.690206+0000","last_became_peered":"2024-09-12T01:55:54.690206+0000","last_unstale":"2024-09-12T01:56:02.522031+0000","last_undegraded":"2024-09-12T01:56:02.522031+0000","last_fullsized":"2024-09-12T01:56:02.522031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:12.368192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521948+0000","last_change":"2024-09-12T01:55:59.722879+0000","last_active":"2024-09-12T01:56:02.521948+0000","last_peered":"2024-09-12T01:56:02.521948+0000","last_clean":"2024-09-12T01:56:02.521948+0000","last_became_active":"2024-09-12T01:55:59.722470+0000","last_became_peered":"2024-09-12T01:55:59.722470+0000","last_unstale":"2024-09-12T01:56:02.521948+0000","last_undegraded":"2024-09-12T01:56:02.521948+0000","last_fullsized":"2024-09-12T01:56:02.521948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:37.646140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996762+0000","last_change":"2024-09-12T01:55:55.694445+0000","last_active":"2024-09-12T01:56:01.996762+0000","last_peered":"2024-09-12T01:56:01.996762+0000","last_clean":"2024-09-12T01:56:01.996762+0000","last_became_active":"2024-09-12T01:55:55.694183+0000","last_became_peered":"2024-09-12T01:55:55.694183+0000","last_unstale":"2024-09-12T01:56:01.996762+0000","last_undegraded":"2024-09-12T01:56:01.996762+0000","last_fullsized":"2024-09-12T01:56:01.996762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:34.647815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522397+0000","last_change":"2024-09-12T01:55:54.692279+0000","last_active":"2024-09-12T01:56:02.522397+0000","last_peered":"2024-09-12T01:56:02.522397+0000","last_clean":"2024-09-12T01:56:02.522397+0000","last_became_active":"2024-09-12T01:55:54.692012+0000","last_became_peered":"2024-09-12T01:55:54.692012+0000","last_unstale":"2024-09-12T01:56:02.522397+0000","last_undegraded":"2024-09-12T01:56:02.522397+0000","last_fullsized":"2024-09-12T01:56:02.522397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:23.224359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522020+0000","last_change":"2024-09-12T01:55:59.729468+0000","last_active":"2024-09-12T01:56:02.522020+0000","last_peered":"2024-09-12T01:56:02.522020+0000","last_clean":"2024-09-12T01:56:02.522020+0000","last_became_active":"2024-09-12T01:55:59.729028+0000","last_became_peered":"2024-09-12T01:55:59.729028+0000","last_unstale":"2024-09-12T01:56:02.522020+0000","last_undegraded":"2024-09-12T01:56:02.522020+0000","last_fullsized":"2024-09-12T01:56:02.522020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:25.728022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521427+0000","last_change":"2024-09-12T01:55:55.683856+0000","last_active":"2024-09-12T01:56:02.521427+0000","last_peered":"2024-09-12T01:56:02.521427+0000","last_clean":"2024-09-12T01:56:02.521427+0000","last_became_active":"2024-09-12T01:55:55.683567+0000","last_became_peered":"2024-09-12T01:55:55.683567+0000","last_unstale":"2024-09-12T01:56:02.521427+0000","last_undegraded":"2024-09-12T01:56:02.521427+0000","last_fullsized":"2024-09-12T01:56:02.521427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:44.949953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745947+0000","last_change":"2024-09-12T01:55:54.694100+0000","last_active":"2024-09-12T01:56:01.745947+0000","last_peered":"2024-09-12T01:56:01.745947+0000","last_clean":"2024-09-12T01:56:01.745947+0000","last_became_active":"2024-09-12T01:55:54.693791+0000","last_became_peered":"2024-09-12T01:55:54.693791+0000","last_unstale":"2024-09-12T01:56:01.745947+0000","last_undegraded":"2024-09-12T01:56:01.745947+0000","last_fullsized":"2024-09-12T01:56:01.745947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:28.370799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522265+0000","last_change":"2024-09-12T01:55:59.729446+0000","last_active":"2024-09-12T01:56:02.522265+0000","last_peered":"2024-09-12T01:56:02.522265+0000","last_clean":"2024-09-12T01:56:02.522265+0000","last_became_active":"2024-09-12T01:55:59.729062+0000","last_became_peered":"2024-09-12T01:55:59.729062+0000","last_unstale":"2024-09-12T01:56:02.522265+0000","last_undegraded":"2024-09-12T01:56:02.522265+0000","last_fullsized":"2024-09-12T01:56:02.522265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:05.710174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460187+0000","last_change":"2024-09-12T01:55:55.699106+0000","last_active":"2024-09-12T01:56:02.460187+0000","last_peered":"2024-09-12T01:56:02.460187+0000","last_clean":"2024-09-12T01:56:02.460187+0000","last_became_active":"2024-09-12T01:55:55.698839+0000","last_became_peered":"2024-09-12T01:55:55.698839+0000","last_unstale":"2024-09-12T01:56:02.460187+0000","last_undegraded":"2024-09-12T01:56:02.460187+0000","last_fullsized":"2024-09-12T01:56:02.460187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:34.183993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751389+0000","last_change":"2024-09-12T01:55:54.690892+0000","last_active":"2024-09-12T01:56:01.751389+0000","last_peered":"2024-09-12T01:56:01.751389+0000","last_clean":"2024-09-12T01:56:01.751389+0000","last_became_active":"2024-09-12T01:55:54.690615+0000","last_became_peered":"2024-09-12T01:55:54.690615+0000","last_unstale":"2024-09-12T01:56:01.751389+0000","last_undegraded":"2024-09-12T01:56:01.751389+0000","last_fullsized":"2024-09-12T01:56:01.751389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:27.061787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460647+0000","last_change":"2024-09-12T01:56:00.518805+0000","last_active":"2024-09-12T01:56:02.460647+0000","last_peered":"2024-09-12T01:56:02.460647+0000","last_clean":"2024-09-12T01:56:02.460647+0000","last_became_active":"2024-09-12T01:56:00.518224+0000","last_became_peered":"2024-09-12T01:56:00.518224+0000","last_unstale":"2024-09-12T01:56:02.460647+0000","last_undegraded":"2024-09-12T01:56:02.460647+0000","last_fullsized":"2024-09-12T01:56:02.460647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:56.545297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522174+0000","last_change":"2024-09-12T01:55:55.702458+0000","last_active":"2024-09-12T01:56:02.522174+0000","last_peered":"2024-09-12T01:56:02.522174+0000","last_clean":"2024-09-12T01:56:02.522174+0000","last_became_active":"2024-09-12T01:55:55.702160+0000","last_became_peered":"2024-09-12T01:55:55.702160+0000","last_unstale":"2024-09-12T01:56:02.522174+0000","last_undegraded":"2024-09-12T01:56:02.522174+0000","last_fullsized":"2024-09-12T01:56:02.522174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:49.260515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522189+0000","last_change":"2024-09-12T01:55:54.688748+0000","last_active":"2024-09-12T01:56:02.522189+0000","last_peered":"2024-09-12T01:56:02.522189+0000","last_clean":"2024-09-12T01:56:02.522189+0000","last_became_active":"2024-09-12T01:55:54.688278+0000","last_became_peered":"2024-09-12T01:55:54.688278+0000","last_unstale":"2024-09-12T01:56:02.522189+0000","last_undegraded":"2024-09-12T01:56:02.522189+0000","last_fullsized":"2024-09-12T01:56:02.522189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:51.779183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751452+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:56:01.751452+0000","last_peered":"2024-09-12T01:56:01.751452+0000","last_clean":"2024-09-12T01:56:01.751452+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:56:01.751452+0000","last_undegraded":"2024-09-12T01:56:01.751452+0000","last_fullsized":"2024-09-12T01:56:01.751452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752349+0000","last_change":"2024-09-12T01:56:00.520068+0000","last_active":"2024-09-12T01:56:01.752349+0000","last_peered":"2024-09-12T01:56:01.752349+0000","last_clean":"2024-09-12T01:56:01.752349+0000","last_became_active":"2024-09-12T01:56:00.519253+0000","last_became_peered":"2024-09-12T01:56:00.519253+0000","last_unstale":"2024-09-12T01:56:01.752349+0000","last_undegraded":"2024-09-12T01:56:01.752349+0000","last_fullsized":"2024-09-12T01:56:01.752349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:24.528900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752013+0000","last_change":"2024-09-12T01:55:55.701349+0000","last_active":"2024-09-12T01:56:01.752013+0000","last_peered":"2024-09-12T01:56:01.752013+0000","last_clean":"2024-09-12T01:56:01.752013+0000","last_became_active":"2024-09-12T01:55:55.701081+0000","last_became_peered":"2024-09-12T01:55:55.701081+0000","last_unstale":"2024-09-12T01:56:01.752013+0000","last_undegraded":"2024-09-12T01:56:01.752013+0000","last_fullsized":"2024-09-12T01:56:01.752013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:22.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.746220+0000","last_change":"2024-09-12T01:55:54.686812+0000","last_active":"2024-09-12T01:56:01.746220+0000","last_peered":"2024-09-12T01:56:01.746220+0000","last_clean":"2024-09-12T01:56:01.746220+0000","last_became_active":"2024-09-12T01:55:54.685661+0000","last_became_peered":"2024-09-12T01:55:54.685661+0000","last_unstale":"2024-09-12T01:56:01.746220+0000","last_undegraded":"2024-09-12T01:56:01.746220+0000","last_fullsized":"2024-09-12T01:56:01.746220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:48.747240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752114+0000","last_change":"2024-09-12T01:56:00.519411+0000","last_active":"2024-09-12T01:56:01.752114+0000","last_peered":"2024-09-12T01:56:01.752114+0000","last_clean":"2024-09-12T01:56:01.752114+0000","last_became_active":"2024-09-12T01:56:00.518566+0000","last_became_peered":"2024-09-12T01:56:00.518566+0000","last_unstale":"2024-09-12T01:56:01.752114+0000","last_undegraded":"2024-09-12T01:56:01.752114+0000","last_fullsized":"2024-09-12T01:56:01.752114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:24.282033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522391+0000","last_change":"2024-09-12T01:55:55.702467+0000","last_active":"2024-09-12T01:56:02.522391+0000","last_peered":"2024-09-12T01:56:02.522391+0000","last_clean":"2024-09-12T01:56:02.522391+0000","last_became_active":"2024-09-12T01:55:55.702195+0000","last_became_peered":"2024-09-12T01:55:55.702195+0000","last_unstale":"2024-09-12T01:56:02.522391+0000","last_undegraded":"2024-09-12T01:56:02.522391+0000","last_fullsized":"2024-09-12T01:56:02.522391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:20.499801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522219+0000","last_change":"2024-09-12T01:55:54.687072+0000","last_active":"2024-09-12T01:56:02.522219+0000","last_peered":"2024-09-12T01:56:02.522219+0000","last_clean":"2024-09-12T01:56:02.522219+0000","last_became_active":"2024-09-12T01:55:54.686806+0000","last_became_peered":"2024-09-12T01:55:54.686806+0000","last_unstale":"2024-09-12T01:56:02.522219+0000","last_undegraded":"2024-09-12T01:56:02.522219+0000","last_fullsized":"2024-09-12T01:56:02.522219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:33.642516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460732+0000","last_change":"2024-09-12T01:55:59.719758+0000","last_active":"2024-09-12T01:56:02.460732+0000","last_peered":"2024-09-12T01:56:02.460732+0000","last_clean":"2024-09-12T01:56:02.460732+0000","last_became_active":"2024-09-12T01:55:59.719193+0000","last_became_peered":"2024-09-12T01:55:59.719193+0000","last_unstale":"2024-09-12T01:56:02.460732+0000","last_undegraded":"2024-09-12T01:56:02.460732+0000","last_fullsized":"2024-09-12T01:56:02.460732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:00.698014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752383+0000","last_change":"2024-09-12T01:55:55.700818+0000","last_active":"2024-09-12T01:56:01.752383+0000","last_peered":"2024-09-12T01:56:01.752383+0000","last_clean":"2024-09-12T01:56:01.752383+0000","last_became_active":"2024-09-12T01:55:55.700254+0000","last_became_peered":"2024-09-12T01:55:55.700254+0000","last_unstale":"2024-09-12T01:56:01.752383+0000","last_undegraded":"2024-09-12T01:56:01.752383+0000","last_fullsized":"2024-09-12T01:56:01.752383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:05.947832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745796+0000","last_change":"2024-09-12T01:55:54.695464+0000","last_active":"2024-09-12T01:56:01.745796+0000","last_peered":"2024-09-12T01:56:01.745796+0000","last_clean":"2024-09-12T01:56:01.745796+0000","last_became_active":"2024-09-12T01:55:54.695083+0000","last_became_peered":"2024-09-12T01:55:54.695083+0000","last_unstale":"2024-09-12T01:56:01.745796+0000","last_undegraded":"2024-09-12T01:56:01.745796+0000","last_fullsized":"2024-09-12T01:56:01.745796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:51.779183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521828+0000","last_change":"2024-09-12T01:56:00.522126+0000","last_active":"2024-09-12T01:56:02.521828+0000","last_peered":"2024-09-12T01:56:02.521828+0000","last_clean":"2024-09-12T01:56:02.521828+0000","last_became_active":"2024-09-12T01:56:00.521651+0000","last_became_peered":"2024-09-12T01:56:00.521651+0000","last_unstale":"2024-09-12T01:56:02.521828+0000","last_undegraded":"2024-09-12T01:56:02.521828+0000","last_fullsized":"2024-09-12T01:56:02.521828+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:48.043231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752282+0000","last_change":"2024-09-12T01:55:55.701400+0000","last_active":"2024-09-12T01:56:01.752282+0000","last_peered":"2024-09-12T01:56:01.752282+0000","last_clean":"2024-09-12T01:56:01.752282+0000","last_became_active":"2024-09-12T01:55:55.700281+0000","last_became_peered":"2024-09-12T01:55:55.700281+0000","last_unstale":"2024-09-12T01:56:01.752282+0000","last_undegraded":"2024-09-12T01:56:01.752282+0000","last_fullsized":"2024-09-12T01:56:01.752282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:32.262001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996924+0000","last_change":"2024-09-12T01:55:54.691224+0000","last_active":"2024-09-12T01:56:01.996924+0000","last_peered":"2024-09-12T01:56:01.996924+0000","last_clean":"2024-09-12T01:56:01.996924+0000","last_became_active":"2024-09-12T01:55:54.690944+0000","last_became_peered":"2024-09-12T01:55:54.690944+0000","last_unstale":"2024-09-12T01:56:01.996924+0000","last_undegraded":"2024-09-12T01:56:01.996924+0000","last_fullsized":"2024-09-12T01:56:01.996924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:51.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996161+0000","last_change":"2024-09-12T01:55:59.722394+0000","last_active":"2024-09-12T01:56:01.996161+0000","last_peered":"2024-09-12T01:56:01.996161+0000","last_clean":"2024-09-12T01:56:01.996161+0000","last_became_active":"2024-09-12T01:55:59.721835+0000","last_became_peered":"2024-09-12T01:55:59.721835+0000","last_unstale":"2024-09-12T01:56:01.996161+0000","last_undegraded":"2024-09-12T01:56:01.996161+0000","last_fullsized":"2024-09-12T01:56:01.996161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:06.742059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752118+0000","last_change":"2024-09-12T01:55:55.700667+0000","last_active":"2024-09-12T01:56:01.752118+0000","last_peered":"2024-09-12T01:56:01.752118+0000","last_clean":"2024-09-12T01:56:01.752118+0000","last_became_active":"2024-09-12T01:55:55.700369+0000","last_became_peered":"2024-09-12T01:55:55.700369+0000","last_unstale":"2024-09-12T01:56:01.752118+0000","last_undegraded":"2024-09-12T01:56:01.752118+0000","last_fullsized":"2024-09-12T01:56:01.752118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:17.560307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745655+0000","last_change":"2024-09-12T01:55:54.687908+0000","last_active":"2024-09-12T01:56:01.745655+0000","last_peered":"2024-09-12T01:56:01.745655+0000","last_clean":"2024-09-12T01:56:01.745655+0000","last_became_active":"2024-09-12T01:55:54.687608+0000","last_became_peered":"2024-09-12T01:55:54.687608+0000","last_unstale":"2024-09-12T01:56:01.745655+0000","last_undegraded":"2024-09-12T01:56:01.745655+0000","last_fullsized":"2024-09-12T01:56:01.745655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:56.359673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460597+0000","last_change":"2024-09-12T01:55:59.718288+0000","last_active":"2024-09-12T01:56:02.460597+0000","last_peered":"2024-09-12T01:56:02.460597+0000","last_clean":"2024-09-12T01:56:02.460597+0000","last_became_active":"2024-09-12T01:55:59.717322+0000","last_became_peered":"2024-09-12T01:55:59.717322+0000","last_unstale":"2024-09-12T01:56:02.460597+0000","last_undegraded":"2024-09-12T01:56:02.460597+0000","last_fullsized":"2024-09-12T01:56:02.460597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:22.647699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752673+0000","last_change":"2024-09-12T01:55:55.688289+0000","last_active":"2024-09-12T01:56:01.752673+0000","last_peered":"2024-09-12T01:56:01.752673+0000","last_clean":"2024-09-12T01:56:01.752673+0000","last_became_active":"2024-09-12T01:55:55.688004+0000","last_became_peered":"2024-09-12T01:55:55.688004+0000","last_unstale":"2024-09-12T01:56:01.752673+0000","last_undegraded":"2024-09-12T01:56:01.752673+0000","last_fullsized":"2024-09-12T01:56:01.752673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:10.809959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752404+0000","last_change":"2024-09-12T01:55:54.689369+0000","last_active":"2024-09-12T01:56:01.752404+0000","last_peered":"2024-09-12T01:56:01.752404+0000","last_clean":"2024-09-12T01:56:01.752404+0000","last_became_active":"2024-09-12T01:55:54.689097+0000","last_became_peered":"2024-09-12T01:55:54.689097+0000","last_unstale":"2024-09-12T01:56:01.752404+0000","last_undegraded":"2024-09-12T01:56:01.752404+0000","last_fullsized":"2024-09-12T01:56:01.752404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:48.747240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522904+0000","last_change":"2024-09-12T01:56:00.520323+0000","last_active":"2024-09-12T01:56:02.522904+0000","last_peered":"2024-09-12T01:56:02.522904+0000","last_clean":"2024-09-12T01:56:02.522904+0000","last_became_active":"2024-09-12T01:56:00.519824+0000","last_became_peered":"2024-09-12T01:56:00.519824+0000","last_unstale":"2024-09-12T01:56:02.522904+0000","last_undegraded":"2024-09-12T01:56:02.522904+0000","last_fullsized":"2024-09-12T01:56:02.522904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:52.098544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751804+0000","last_change":"2024-09-12T01:55:55.700672+0000","last_active":"2024-09-12T01:56:01.751804+0000","last_peered":"2024-09-12T01:56:01.751804+0000","last_clean":"2024-09-12T01:56:01.751804+0000","last_became_active":"2024-09-12T01:55:55.700200+0000","last_became_peered":"2024-09-12T01:55:55.700200+0000","last_unstale":"2024-09-12T01:56:01.751804+0000","last_undegraded":"2024-09-12T01:56:01.751804+0000","last_fullsized":"2024-09-12T01:56:01.751804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:52.516198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522306+0000","last_change":"2024-09-12T01:55:54.693863+0000","last_active":"2024-09-12T01:56:02.522306+0000","last_peered":"2024-09-12T01:56:02.522306+0000","last_clean":"2024-09-12T01:56:02.522306+0000","last_became_active":"2024-09-12T01:55:54.693523+0000","last_became_peered":"2024-09-12T01:55:54.693523+0000","last_unstale":"2024-09-12T01:56:02.522306+0000","last_undegraded":"2024-09-12T01:56:02.522306+0000","last_fullsized":"2024-09-12T01:56:02.522306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:48.747240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522582+0000","last_change":"2024-09-12T01:56:00.517194+0000","last_active":"2024-09-12T01:56:02.522582+0000","last_peered":"2024-09-12T01:56:02.522582+0000","last_clean":"2024-09-12T01:56:02.522582+0000","last_became_active":"2024-09-12T01:56:00.516727+0000","last_became_peered":"2024-09-12T01:56:00.516727+0000","last_unstale":"2024-09-12T01:56:02.522582+0000","last_undegraded":"2024-09-12T01:56:02.522582+0000","last_fullsized":"2024-09-12T01:56:02.522582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:00.596782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460450+0000","last_change":"2024-09-12T01:55:55.698062+0000","last_active":"2024-09-12T01:56:02.460450+0000","last_peered":"2024-09-12T01:56:02.460450+0000","last_clean":"2024-09-12T01:56:02.460450+0000","last_became_active":"2024-09-12T01:55:55.697776+0000","last_became_peered":"2024-09-12T01:55:55.697776+0000","last_unstale":"2024-09-12T01:56:02.460450+0000","last_undegraded":"2024-09-12T01:56:02.460450+0000","last_fullsized":"2024-09-12T01:56:02.460450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:28.067086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460790+0000","last_change":"2024-09-12T01:55:54.689127+0000","last_active":"2024-09-12T01:56:02.460790+0000","last_peered":"2024-09-12T01:56:02.460790+0000","last_clean":"2024-09-12T01:56:02.460790+0000","last_became_active":"2024-09-12T01:55:54.688722+0000","last_became_peered":"2024-09-12T01:55:54.688722+0000","last_unstale":"2024-09-12T01:56:02.460790+0000","last_undegraded":"2024-09-12T01:56:02.460790+0000","last_fullsized":"2024-09-12T01:56:02.460790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:56.353031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522434+0000","last_change":"2024-09-12T01:56:00.517059+0000","last_active":"2024-09-12T01:56:02.522434+0000","last_peered":"2024-09-12T01:56:02.522434+0000","last_clean":"2024-09-12T01:56:02.522434+0000","last_became_active":"2024-09-12T01:56:00.516595+0000","last_became_peered":"2024-09-12T01:56:00.516595+0000","last_unstale":"2024-09-12T01:56:02.522434+0000","last_undegraded":"2024-09-12T01:56:02.522434+0000","last_fullsized":"2024-09-12T01:56:02.522434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:14.390892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751922+0000","last_change":"2024-09-12T01:55:55.707760+0000","last_active":"2024-09-12T01:56:01.751922+0000","last_peered":"2024-09-12T01:56:01.751922+0000","last_clean":"2024-09-12T01:56:01.751922+0000","last_became_active":"2024-09-12T01:55:55.707514+0000","last_became_peered":"2024-09-12T01:55:55.707514+0000","last_unstale":"2024-09-12T01:56:01.751922+0000","last_undegraded":"2024-09-12T01:56:01.751922+0000","last_fullsized":"2024-09-12T01:56:01.751922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:20.499801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.256902+0000","last_change":"2024-09-12T01:55:54.690854+0000","last_active":"2024-09-12T01:56:05.256902+0000","last_peered":"2024-09-12T01:56:05.256902+0000","last_clean":"2024-09-12T01:56:05.256902+0000","last_became_active":"2024-09-12T01:55:54.690565+0000","last_became_peered":"2024-09-12T01:55:54.690565+0000","last_unstale":"2024-09-12T01:56:05.256902+0000","last_undegraded":"2024-09-12T01:56:05.256902+0000","last_fullsized":"2024-09-12T01:56:05.256902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:31.710719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522153+0000","last_change":"2024-09-12T01:55:59.728073+0000","last_active":"2024-09-12T01:56:02.522153+0000","last_peered":"2024-09-12T01:56:02.522153+0000","last_clean":"2024-09-12T01:56:02.522153+0000","last_became_active":"2024-09-12T01:55:59.727655+0000","last_became_peered":"2024-09-12T01:55:59.727655+0000","last_unstale":"2024-09-12T01:56:02.522153+0000","last_undegraded":"2024-09-12T01:56:02.522153+0000","last_fullsized":"2024-09-12T01:56:02.522153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:33.869240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996898+0000","last_change":"2024-09-12T01:55:55.698999+0000","last_active":"2024-09-12T01:56:01.996898+0000","last_peered":"2024-09-12T01:56:01.996898+0000","last_clean":"2024-09-12T01:56:01.996898+0000","last_became_active":"2024-09-12T01:55:55.698735+0000","last_became_peered":"2024-09-12T01:55:55.698735+0000","last_unstale":"2024-09-12T01:56:01.996898+0000","last_undegraded":"2024-09-12T01:56:01.996898+0000","last_fullsized":"2024-09-12T01:56:01.996898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:20.510009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522100+0000","last_change":"2024-09-12T01:55:54.692048+0000","last_active":"2024-09-12T01:56:02.522100+0000","last_peered":"2024-09-12T01:56:02.522100+0000","last_clean":"2024-09-12T01:56:02.522100+0000","last_became_active":"2024-09-12T01:55:54.691732+0000","last_became_peered":"2024-09-12T01:55:54.691732+0000","last_unstale":"2024-09-12T01:56:02.522100+0000","last_undegraded":"2024-09-12T01:56:02.522100+0000","last_fullsized":"2024-09-12T01:56:02.522100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:17.698798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996696+0000","last_change":"2024-09-12T01:55:59.715880+0000","last_active":"2024-09-12T01:56:01.996696+0000","last_peered":"2024-09-12T01:56:01.996696+0000","last_clean":"2024-09-12T01:56:01.996696+0000","last_became_active":"2024-09-12T01:55:59.715168+0000","last_became_peered":"2024-09-12T01:55:59.715168+0000","last_unstale":"2024-09-12T01:56:01.996696+0000","last_undegraded":"2024-09-12T01:56:01.996696+0000","last_fullsized":"2024-09-12T01:56:01.996696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:05.710174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460633+0000","last_change":"2024-09-12T01:55:55.690745+0000","last_active":"2024-09-12T01:56:02.460633+0000","last_peered":"2024-09-12T01:56:02.460633+0000","last_clean":"2024-09-12T01:56:02.460633+0000","last_became_active":"2024-09-12T01:55:55.690480+0000","last_became_peered":"2024-09-12T01:55:55.690480+0000","last_unstale":"2024-09-12T01:56:02.460633+0000","last_undegraded":"2024-09-12T01:56:02.460633+0000","last_fullsized":"2024-09-12T01:56:02.460633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:10.058977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522473+0000","last_change":"2024-09-12T01:55:54.691114+0000","last_active":"2024-09-12T01:56:02.522473+0000","last_peered":"2024-09-12T01:56:02.522473+0000","last_clean":"2024-09-12T01:56:02.522473+0000","last_became_active":"2024-09-12T01:55:54.690834+0000","last_became_peered":"2024-09-12T01:55:54.690834+0000","last_unstale":"2024-09-12T01:56:02.522473+0000","last_undegraded":"2024-09-12T01:56:02.522473+0000","last_fullsized":"2024-09-12T01:56:02.522473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:31.710719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521529+0000","last_change":"2024-09-12T01:55:59.722973+0000","last_active":"2024-09-12T01:56:02.521529+0000","last_peered":"2024-09-12T01:56:02.521529+0000","last_clean":"2024-09-12T01:56:02.521529+0000","last_became_active":"2024-09-12T01:55:59.722494+0000","last_became_peered":"2024-09-12T01:55:59.722494+0000","last_unstale":"2024-09-12T01:56:02.521529+0000","last_undegraded":"2024-09-12T01:56:02.521529+0000","last_fullsized":"2024-09-12T01:56:02.521529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:50.692862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522436+0000","last_change":"2024-09-12T01:55:55.696532+0000","last_active":"2024-09-12T01:56:02.522436+0000","last_peered":"2024-09-12T01:56:02.522436+0000","last_clean":"2024-09-12T01:56:02.522436+0000","last_became_active":"2024-09-12T01:55:55.696061+0000","last_became_peered":"2024-09-12T01:55:55.696061+0000","last_unstale":"2024-09-12T01:56:02.522436+0000","last_undegraded":"2024-09-12T01:56:02.522436+0000","last_fullsized":"2024-09-12T01:56:02.522436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.073038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752084+0000","last_change":"2024-09-12T01:55:54.687182+0000","last_active":"2024-09-12T01:56:01.752084+0000","last_peered":"2024-09-12T01:56:01.752084+0000","last_clean":"2024-09-12T01:56:01.752084+0000","last_became_active":"2024-09-12T01:55:54.686893+0000","last_became_peered":"2024-09-12T01:55:54.686893+0000","last_unstale":"2024-09-12T01:56:01.752084+0000","last_undegraded":"2024-09-12T01:56:01.752084+0000","last_fullsized":"2024-09-12T01:56:01.752084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:56.359673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521857+0000","last_change":"2024-09-12T01:56:00.519118+0000","last_active":"2024-09-12T01:56:02.521857+0000","last_peered":"2024-09-12T01:56:02.521857+0000","last_clean":"2024-09-12T01:56:02.521857+0000","last_became_active":"2024-09-12T01:56:00.518658+0000","last_became_peered":"2024-09-12T01:56:00.518658+0000","last_unstale":"2024-09-12T01:56:02.521857+0000","last_undegraded":"2024-09-12T01:56:02.521857+0000","last_fullsized":"2024-09-12T01:56:02.521857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:01.814275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460479+0000","last_change":"2024-09-12T01:56:00.519981+0000","last_active":"2024-09-12T01:56:02.460479+0000","last_peered":"2024-09-12T01:56:02.460479+0000","last_clean":"2024-09-12T01:56:02.460479+0000","last_became_active":"2024-09-12T01:56:00.519500+0000","last_became_peered":"2024-09-12T01:56:00.519500+0000","last_unstale":"2024-09-12T01:56:02.460479+0000","last_undegraded":"2024-09-12T01:56:02.460479+0000","last_fullsized":"2024-09-12T01:56:02.460479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:26.981322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521440+0000","last_change":"2024-09-12T01:55:55.687256+0000","last_active":"2024-09-12T01:56:02.521440+0000","last_peered":"2024-09-12T01:56:02.521440+0000","last_clean":"2024-09-12T01:56:02.521440+0000","last_became_active":"2024-09-12T01:55:55.685099+0000","last_became_peered":"2024-09-12T01:55:55.685099+0000","last_unstale":"2024-09-12T01:56:02.521440+0000","last_undegraded":"2024-09-12T01:56:02.521440+0000","last_fullsized":"2024-09-12T01:56:02.521440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:56.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522004+0000","last_change":"2024-09-12T01:55:54.694320+0000","last_active":"2024-09-12T01:56:02.522004+0000","last_peered":"2024-09-12T01:56:02.522004+0000","last_clean":"2024-09-12T01:56:02.522004+0000","last_became_active":"2024-09-12T01:55:54.694033+0000","last_became_peered":"2024-09-12T01:55:54.694033+0000","last_unstale":"2024-09-12T01:56:02.522004+0000","last_undegraded":"2024-09-12T01:56:02.522004+0000","last_fullsized":"2024-09-12T01:56:02.522004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:41.296972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751924+0000","last_change":"2024-09-12T01:55:59.721355+0000","last_active":"2024-09-12T01:56:01.751924+0000","last_peered":"2024-09-12T01:56:01.751924+0000","last_clean":"2024-09-12T01:56:01.751924+0000","last_became_active":"2024-09-12T01:55:59.720937+0000","last_became_peered":"2024-09-12T01:55:59.720937+0000","last_unstale":"2024-09-12T01:56:01.751924+0000","last_undegraded":"2024-09-12T01:56:01.751924+0000","last_fullsized":"2024-09-12T01:56:01.751924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:35.266537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521497+0000","last_change":"2024-09-12T01:55:55.703177+0000","last_active":"2024-09-12T01:56:02.521497+0000","last_peered":"2024-09-12T01:56:02.521497+0000","last_clean":"2024-09-12T01:56:02.521497+0000","last_became_active":"2024-09-12T01:55:55.697845+0000","last_became_peered":"2024-09-12T01:55:55.697845+0000","last_unstale":"2024-09-12T01:56:02.521497+0000","last_undegraded":"2024-09-12T01:56:02.521497+0000","last_fullsized":"2024-09-12T01:56:02.521497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:44.949953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521959+0000","last_change":"2024-09-12T01:55:54.690580+0000","last_active":"2024-09-12T01:56:02.521959+0000","last_peered":"2024-09-12T01:56:02.521959+0000","last_clean":"2024-09-12T01:56:02.521959+0000","last_became_active":"2024-09-12T01:55:54.690300+0000","last_became_peered":"2024-09-12T01:55:54.690300+0000","last_unstale":"2024-09-12T01:56:02.521959+0000","last_undegraded":"2024-09-12T01:56:02.521959+0000","last_fullsized":"2024-09-12T01:56:02.521959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:32.489045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752411+0000","last_change":"2024-09-12T01:55:54.687192+0000","last_active":"2024-09-12T01:56:01.752411+0000","last_peered":"2024-09-12T01:56:01.752411+0000","last_clean":"2024-09-12T01:56:01.752411+0000","last_became_active":"2024-09-12T01:55:54.686880+0000","last_became_peered":"2024-09-12T01:55:54.686880+0000","last_unstale":"2024-09-12T01:56:01.752411+0000","last_undegraded":"2024-09-12T01:56:01.752411+0000","last_fullsized":"2024-09-12T01:56:01.752411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:23.224359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460765+0000","last_change":"2024-09-12T01:55:55.693529+0000","last_active":"2024-09-12T01:56:02.460765+0000","last_peered":"2024-09-12T01:56:02.460765+0000","last_clean":"2024-09-12T01:56:02.460765+0000","last_became_active":"2024-09-12T01:55:55.693245+0000","last_became_peered":"2024-09-12T01:55:55.693245+0000","last_unstale":"2024-09-12T01:56:02.460765+0000","last_undegraded":"2024-09-12T01:56:02.460765+0000","last_fullsized":"2024-09-12T01:56:02.460765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:53.221222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.746166+0000","last_change":"2024-09-12T01:55:59.718401+0000","last_active":"2024-09-12T01:56:01.746166+0000","last_peered":"2024-09-12T01:56:01.746166+0000","last_clean":"2024-09-12T01:56:01.746166+0000","last_became_active":"2024-09-12T01:55:59.717933+0000","last_became_peered":"2024-09-12T01:55:59.717933+0000","last_unstale":"2024-09-12T01:56:01.746166+0000","last_undegraded":"2024-09-12T01:56:01.746166+0000","last_fullsized":"2024-09-12T01:56:01.746166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.213092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522420+0000","last_change":"2024-09-12T01:55:54.691342+0000","last_active":"2024-09-12T01:56:02.522420+0000","last_peered":"2024-09-12T01:56:02.522420+0000","last_clean":"2024-09-12T01:56:02.522420+0000","last_became_active":"2024-09-12T01:55:54.691025+0000","last_became_peered":"2024-09-12T01:55:54.691025+0000","last_unstale":"2024-09-12T01:56:02.522420+0000","last_undegraded":"2024-09-12T01:56:02.522420+0000","last_fullsized":"2024-09-12T01:56:02.522420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:51.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996419+0000","last_change":"2024-09-12T01:55:55.698351+0000","last_active":"2024-09-12T01:56:01.996419+0000","last_peered":"2024-09-12T01:56:01.996419+0000","last_clean":"2024-09-12T01:56:01.996419+0000","last_became_active":"2024-09-12T01:55:55.698050+0000","last_became_peered":"2024-09-12T01:55:55.698050+0000","last_unstale":"2024-09-12T01:56:01.996419+0000","last_undegraded":"2024-09-12T01:56:01.996419+0000","last_fullsized":"2024-09-12T01:56:01.996419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:50.888763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522693+0000","last_change":"2024-09-12T01:55:59.722326+0000","last_active":"2024-09-12T01:56:02.522693+0000","last_peered":"2024-09-12T01:56:02.522693+0000","last_clean":"2024-09-12T01:56:02.522693+0000","last_became_active":"2024-09-12T01:55:59.721902+0000","last_became_peered":"2024-09-12T01:55:59.721902+0000","last_unstale":"2024-09-12T01:56:02.522693+0000","last_undegraded":"2024-09-12T01:56:02.522693+0000","last_fullsized":"2024-09-12T01:56:02.522693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:39.486622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752590+0000","last_change":"2024-09-12T01:55:55.689349+0000","last_active":"2024-09-12T01:56:01.752590+0000","last_peered":"2024-09-12T01:56:01.752590+0000","last_clean":"2024-09-12T01:56:01.752590+0000","last_became_active":"2024-09-12T01:55:55.688915+0000","last_became_peered":"2024-09-12T01:55:55.688915+0000","last_unstale":"2024-09-12T01:56:01.752590+0000","last_undegraded":"2024-09-12T01:56:01.752590+0000","last_fullsized":"2024-09-12T01:56:01.752590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:28.067086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745858+0000","last_change":"2024-09-12T01:55:55.696841+0000","last_active":"2024-09-12T01:56:01.745858+0000","last_peered":"2024-09-12T01:56:01.745858+0000","last_clean":"2024-09-12T01:56:01.745858+0000","last_became_active":"2024-09-12T01:55:55.696545+0000","last_became_peered":"2024-09-12T01:55:55.696545+0000","last_unstale":"2024-09-12T01:56:01.745858+0000","last_undegraded":"2024-09-12T01:56:01.745858+0000","last_fullsized":"2024-09-12T01:56:01.745858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:46.163637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522177+0000","last_change":"2024-09-12T01:55:55.705917+0000","last_active":"2024-09-12T01:56:02.522177+0000","last_peered":"2024-09-12T01:56:02.522177+0000","last_clean":"2024-09-12T01:56:02.522177+0000","last_became_active":"2024-09-12T01:55:55.705517+0000","last_became_peered":"2024-09-12T01:55:55.705517+0000","last_unstale":"2024-09-12T01:56:02.522177+0000","last_undegraded":"2024-09-12T01:56:02.522177+0000","last_fullsized":"2024-09-12T01:56:02.522177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:31.237438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460726+0000","last_change":"2024-09-12T01:55:55.705881+0000","last_active":"2024-09-12T01:56:02.460726+0000","last_peered":"2024-09-12T01:56:02.460726+0000","last_clean":"2024-09-12T01:56:02.460726+0000","last_became_active":"2024-09-12T01:55:55.705557+0000","last_became_peered":"2024-09-12T01:55:55.705557+0000","last_unstale":"2024-09-12T01:56:02.460726+0000","last_undegraded":"2024-09-12T01:56:02.460726+0000","last_fullsized":"2024-09-12T01:56:02.460726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.073038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522638+0000","last_change":"2024-09-12T01:55:55.704834+0000","last_active":"2024-09-12T01:56:02.522638+0000","last_peered":"2024-09-12T01:56:02.522638+0000","last_clean":"2024-09-12T01:56:02.522638+0000","last_became_active":"2024-09-12T01:55:55.702868+0000","last_became_peered":"2024-09-12T01:55:55.702868+0000","last_unstale":"2024-09-12T01:56:02.522638+0000","last_undegraded":"2024-09-12T01:56:02.522638+0000","last_fullsized":"2024-09-12T01:56:02.522638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:06.356761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521624+0000","last_change":"2024-09-12T01:55:55.685821+0000","last_active":"2024-09-12T01:56:02.521624+0000","last_peered":"2024-09-12T01:56:02.521624+0000","last_clean":"2024-09-12T01:56:02.521624+0000","last_became_active":"2024-09-12T01:55:55.685517+0000","last_became_peered":"2024-09-12T01:55:55.685517+0000","last_unstale":"2024-09-12T01:56:02.521624+0000","last_undegraded":"2024-09-12T01:56:02.521624+0000","last_fullsized":"2024-09-12T01:56:02.521624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:18.907293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752735+0000","last_change":"2024-09-12T01:55:55.697608+0000","last_active":"2024-09-12T01:56:01.752735+0000","last_peered":"2024-09-12T01:56:01.752735+0000","last_clean":"2024-09-12T01:56:01.752735+0000","last_became_active":"2024-09-12T01:55:55.697368+0000","last_became_peered":"2024-09-12T01:55:55.697368+0000","last_unstale":"2024-09-12T01:56:01.752735+0000","last_undegraded":"2024-09-12T01:56:01.752735+0000","last_fullsized":"2024-09-12T01:56:01.752735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:53.221222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522816+0000","last_change":"2024-09-12T01:55:55.704580+0000","last_active":"2024-09-12T01:56:02.522816+0000","last_peered":"2024-09-12T01:56:02.522816+0000","last_clean":"2024-09-12T01:56:02.522816+0000","last_became_active":"2024-09-12T01:55:55.704310+0000","last_became_peered":"2024-09-12T01:55:55.704310+0000","last_unstale":"2024-09-12T01:56:02.522816+0000","last_undegraded":"2024-09-12T01:56:02.522816+0000","last_fullsized":"2024-09-12T01:56:02.522816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:30.891591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521987+0000","last_change":"2024-09-12T01:55:55.702574+0000","last_active":"2024-09-12T01:56:02.521987+0000","last_peered":"2024-09-12T01:56:02.521987+0000","last_clean":"2024-09-12T01:56:02.521987+0000","last_became_active":"2024-09-12T01:55:55.702381+0000","last_became_peered":"2024-09-12T01:55:55.702381+0000","last_unstale":"2024-09-12T01:56:02.521987+0000","last_undegraded":"2024-09-12T01:56:02.521987+0000","last_fullsized":"2024-09-12T01:56:02.521987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:14.471944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521666+0000","last_change":"2024-09-12T01:55:55.702491+0000","last_active":"2024-09-12T01:56:02.521666+0000","last_peered":"2024-09-12T01:56:02.521666+0000","last_clean":"2024-09-12T01:56:02.521666+0000","last_became_active":"2024-09-12T01:55:55.702184+0000","last_became_peered":"2024-09-12T01:55:55.702184+0000","last_unstale":"2024-09-12T01:56:02.521666+0000","last_undegraded":"2024-09-12T01:56:02.521666+0000","last_fullsized":"2024-09-12T01:56:02.521666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:29.526104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522126+0000","last_change":"2024-09-12T01:55:55.696303+0000","last_active":"2024-09-12T01:56:02.522126+0000","last_peered":"2024-09-12T01:56:02.522126+0000","last_clean":"2024-09-12T01:56:02.522126+0000","last_became_active":"2024-09-12T01:55:55.696044+0000","last_became_peered":"2024-09-12T01:55:55.696044+0000","last_unstale":"2024-09-12T01:56:02.522126+0000","last_undegraded":"2024-09-12T01:56:02.522126+0000","last_fullsized":"2024-09-12T01:56:02.522126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:41.082029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460625+0000","last_change":"2024-09-12T01:55:55.698223+0000","last_active":"2024-09-12T01:56:02.460625+0000","last_peered":"2024-09-12T01:56:02.460625+0000","last_clean":"2024-09-12T01:56:02.460625+0000","last_became_active":"2024-09-12T01:55:55.697926+0000","last_became_peered":"2024-09-12T01:55:55.697926+0000","last_unstale":"2024-09-12T01:56:02.460625+0000","last_undegraded":"2024-09-12T01:56:02.460625+0000","last_fullsized":"2024-09-12T01:56:02.460625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:10.809959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752785+0000","last_change":"2024-09-12T01:55:55.687766+0000","last_active":"2024-09-12T01:56:01.752785+0000","last_peered":"2024-09-12T01:56:01.752785+0000","last_clean":"2024-09-12T01:56:01.752785+0000","last_became_active":"2024-09-12T01:55:55.687387+0000","last_became_peered":"2024-09-12T01:55:55.687387+0000","last_unstale":"2024-09-12T01:56:01.752785+0000","last_undegraded":"2024-09-12T01:56:01.752785+0000","last_fullsized":"2024-09-12T01:56:01.752785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:05.184458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752307+0000","last_change":"2024-09-12T01:55:55.697237+0000","last_active":"2024-09-12T01:56:01.752307+0000","last_peered":"2024-09-12T01:56:01.752307+0000","last_clean":"2024-09-12T01:56:01.752307+0000","last_became_active":"2024-09-12T01:55:55.696731+0000","last_became_peered":"2024-09-12T01:55:55.696731+0000","last_unstale":"2024-09-12T01:56:01.752307+0000","last_undegraded":"2024-09-12T01:56:01.752307+0000","last_fullsized":"2024-09-12T01:56:01.752307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:18.618600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745740+0000","last_change":"2024-09-12T01:55:55.691750+0000","last_active":"2024-09-12T01:56:01.745740+0000","last_peered":"2024-09-12T01:56:01.745740+0000","last_clean":"2024-09-12T01:56:01.745740+0000","last_became_active":"2024-09-12T01:55:55.691456+0000","last_became_peered":"2024-09-12T01:55:55.691456+0000","last_unstale":"2024-09-12T01:56:01.745740+0000","last_undegraded":"2024-09-12T01:56:01.745740+0000","last_fullsized":"2024-09-12T01:56:01.745740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:08.358541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522682+0000","last_change":"2024-09-12T01:55:55.699943+0000","last_active":"2024-09-12T01:56:02.522682+0000","last_peered":"2024-09-12T01:56:02.522682+0000","last_clean":"2024-09-12T01:56:02.522682+0000","last_became_active":"2024-09-12T01:55:55.699679+0000","last_became_peered":"2024-09-12T01:55:55.699679+0000","last_unstale":"2024-09-12T01:56:02.522682+0000","last_undegraded":"2024-09-12T01:56:02.522682+0000","last_fullsized":"2024-09-12T01:56:02.522682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:48.470241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521849+0000","last_change":"2024-09-12T01:55:55.689119+0000","last_active":"2024-09-12T01:56:02.521849+0000","last_peered":"2024-09-12T01:56:02.521849+0000","last_clean":"2024-09-12T01:56:02.521849+0000","last_became_active":"2024-09-12T01:55:55.688803+0000","last_became_peered":"2024-09-12T01:55:55.688803+0000","last_unstale":"2024-09-12T01:56:02.521849+0000","last_undegraded":"2024-09-12T01:56:02.521849+0000","last_fullsized":"2024-09-12T01:56:02.521849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:53.221222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521525+0000","last_change":"2024-09-12T01:55:55.699561+0000","last_active":"2024-09-12T01:56:02.521525+0000","last_peered":"2024-09-12T01:56:02.521525+0000","last_clean":"2024-09-12T01:56:02.521525+0000","last_became_active":"2024-09-12T01:55:55.699223+0000","last_became_peered":"2024-09-12T01:55:55.699223+0000","last_unstale":"2024-09-12T01:56:02.521525+0000","last_undegraded":"2024-09-12T01:56:02.521525+0000","last_fullsized":"2024-09-12T01:56:02.521525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:29.526104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460560+0000","last_change":"2024-09-12T01:55:55.692821+0000","last_active":"2024-09-12T01:56:02.460560+0000","last_peered":"2024-09-12T01:56:02.460560+0000","last_clean":"2024-09-12T01:56:02.460560+0000","last_became_active":"2024-09-12T01:55:55.692497+0000","last_became_peered":"2024-09-12T01:55:55.692497+0000","last_unstale":"2024-09-12T01:56:02.460560+0000","last_undegraded":"2024-09-12T01:56:02.460560+0000","last_fullsized":"2024-09-12T01:56:02.460560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:30.090079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522316+0000","last_change":"2024-09-12T01:55:55.703581+0000","last_active":"2024-09-12T01:56:02.522316+0000","last_peered":"2024-09-12T01:56:02.522316+0000","last_clean":"2024-09-12T01:56:02.522316+0000","last_became_active":"2024-09-12T01:55:55.703271+0000","last_became_peered":"2024-09-12T01:55:55.703271+0000","last_unstale":"2024-09-12T01:56:02.522316+0000","last_undegraded":"2024-09-12T01:56:02.522316+0000","last_fullsized":"2024-09-12T01:56:02.522316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:56.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996754+0000","last_change":"2024-09-12T01:55:55.692636+0000","last_active":"2024-09-12T01:56:01.996754+0000","last_peered":"2024-09-12T01:56:01.996754+0000","last_clean":"2024-09-12T01:56:01.996754+0000","last_became_active":"2024-09-12T01:55:55.692367+0000","last_became_peered":"2024-09-12T01:55:55.692367+0000","last_unstale":"2024-09-12T01:56:01.996754+0000","last_undegraded":"2024-09-12T01:56:01.996754+0000","last_fullsized":"2024-09-12T01:56:01.996754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:44.926267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752614+0000","last_change":"2024-09-12T01:55:55.698490+0000","last_active":"2024-09-12T01:56:01.752614+0000","last_peered":"2024-09-12T01:56:01.752614+0000","last_clean":"2024-09-12T01:56:01.752614+0000","last_became_active":"2024-09-12T01:55:55.698190+0000","last_became_peered":"2024-09-12T01:55:55.698190+0000","last_unstale":"2024-09-12T01:56:01.752614+0000","last_undegraded":"2024-09-12T01:56:01.752614+0000","last_fullsized":"2024-09-12T01:56:01.752614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:36.523619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752728+0000","last_change":"2024-09-12T01:55:55.695606+0000","last_active":"2024-09-12T01:56:01.752728+0000","last_peered":"2024-09-12T01:56:01.752728+0000","last_clean":"2024-09-12T01:56:01.752728+0000","last_became_active":"2024-09-12T01:55:55.695348+0000","last_became_peered":"2024-09-12T01:55:55.695348+0000","last_unstale":"2024-09-12T01:56:01.752728+0000","last_undegraded":"2024-09-12T01:56:01.752728+0000","last_fullsized":"2024-09-12T01:56:01.752728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:10.058977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752300+0000","last_change":"2024-09-12T01:55:55.696973+0000","last_active":"2024-09-12T01:56:01.752300+0000","last_peered":"2024-09-12T01:56:01.752300+0000","last_clean":"2024-09-12T01:56:01.752300+0000","last_became_active":"2024-09-12T01:55:55.696435+0000","last_became_peered":"2024-09-12T01:55:55.696435+0000","last_unstale":"2024-09-12T01:56:01.752300+0000","last_undegraded":"2024-09-12T01:56:01.752300+0000","last_fullsized":"2024-09-12T01:56:01.752300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:20.252934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521402+0000","last_change":"2024-09-12T01:55:55.703874+0000","last_active":"2024-09-12T01:56:02.521402+0000","last_peered":"2024-09-12T01:56:02.521402+0000","last_clean":"2024-09-12T01:56:02.521402+0000","last_became_active":"2024-09-12T01:55:55.703532+0000","last_became_peered":"2024-09-12T01:55:55.703532+0000","last_unstale":"2024-09-12T01:56:02.521402+0000","last_undegraded":"2024-09-12T01:56:02.521402+0000","last_fullsized":"2024-09-12T01:56:02.521402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:04.569624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751534+0000","last_change":"2024-09-12T01:55:55.704083+0000","last_active":"2024-09-12T01:56:01.751534+0000","last_peered":"2024-09-12T01:56:01.751534+0000","last_clean":"2024-09-12T01:56:01.751534+0000","last_became_active":"2024-09-12T01:55:55.703653+0000","last_became_peered":"2024-09-12T01:55:55.703653+0000","last_unstale":"2024-09-12T01:56:01.751534+0000","last_undegraded":"2024-09-12T01:56:01.751534+0000","last_fullsized":"2024-09-12T01:56:01.751534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:14.471944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522008+0000","last_change":"2024-09-12T01:55:55.693606+0000","last_active":"2024-09-12T01:56:02.522008+0000","last_peered":"2024-09-12T01:56:02.522008+0000","last_clean":"2024-09-12T01:56:02.522008+0000","last_became_active":"2024-09-12T01:55:55.693044+0000","last_became_peered":"2024-09-12T01:55:55.693044+0000","last_unstale":"2024-09-12T01:56:02.522008+0000","last_undegraded":"2024-09-12T01:56:02.522008+0000","last_fullsized":"2024-09-12T01:56:02.522008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:42.036492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751606+0000","last_change":"2024-09-12T01:55:55.697766+0000","last_active":"2024-09-12T01:56:01.751606+0000","last_peered":"2024-09-12T01:56:01.751606+0000","last_clean":"2024-09-12T01:56:01.751606+0000","last_became_active":"2024-09-12T01:55:55.697504+0000","last_became_peered":"2024-09-12T01:55:55.697504+0000","last_unstale":"2024-09-12T01:56:01.751606+0000","last_undegraded":"2024-09-12T01:56:01.751606+0000","last_fullsized":"2024-09-12T01:56:01.751606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:01.034708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522237+0000","last_change":"2024-09-12T01:55:55.705929+0000","last_active":"2024-09-12T01:56:02.522237+0000","last_peered":"2024-09-12T01:56:02.522237+0000","last_clean":"2024-09-12T01:56:02.522237+0000","last_became_active":"2024-09-12T01:55:55.705645+0000","last_became_peered":"2024-09-12T01:55:55.705645+0000","last_unstale":"2024-09-12T01:56:02.522237+0000","last_undegraded":"2024-09-12T01:56:02.522237+0000","last_fullsized":"2024-09-12T01:56:02.522237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:17.560307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460374+0000","last_change":"2024-09-12T01:55:55.689459+0000","last_active":"2024-09-12T01:56:02.460374+0000","last_peered":"2024-09-12T01:56:02.460374+0000","last_clean":"2024-09-12T01:56:02.460374+0000","last_became_active":"2024-09-12T01:55:55.688932+0000","last_became_peered":"2024-09-12T01:55:55.688932+0000","last_unstale":"2024-09-12T01:56:02.460374+0000","last_undegraded":"2024-09-12T01:56:02.460374+0000","last_fullsized":"2024-09-12T01:56:02.460374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:49.242430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521944+0000","last_change":"2024-09-12T01:55:55.694825+0000","last_active":"2024-09-12T01:56:02.521944+0000","last_peered":"2024-09-12T01:56:02.521944+0000","last_clean":"2024-09-12T01:56:02.521944+0000","last_became_active":"2024-09-12T01:55:55.693916+0000","last_became_peered":"2024-09-12T01:55:55.693916+0000","last_unstale":"2024-09-12T01:56:02.521944+0000","last_undegraded":"2024-09-12T01:56:02.521944+0000","last_fullsized":"2024-09-12T01:56:02.521944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:49.260515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752010+0000","last_change":"2024-09-12T01:55:55.696732+0000","last_active":"2024-09-12T01:56:01.752010+0000","last_peered":"2024-09-12T01:56:01.752010+0000","last_clean":"2024-09-12T01:56:01.752010+0000","last_became_active":"2024-09-12T01:55:55.696146+0000","last_became_peered":"2024-09-12T01:55:55.696146+0000","last_unstale":"2024-09-12T01:56:01.752010+0000","last_undegraded":"2024-09-12T01:56:01.752010+0000","last_fullsized":"2024-09-12T01:56:01.752010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:31.237438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":880640,"data_stored":705461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":118355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":286720,"data_stored":114601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":118355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":114511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":114671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":888832,"data_stored":705517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":114637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:56:16.130 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:56:16.131 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T01:56:16.131 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T01:56:16.131 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T01:56:16.131 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T01:56:16.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.268+0000 7f5aa667b640 1 Processor -- start 2024-09-12T01:56:16.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.268+0000 7f5aa667b640 1 -- start start 2024-09-12T01:56:16.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.269+0000 7f5aa667b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa0161c80 0x7f5aa006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.269+0000 7f5aa667b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aa006e870 con 0x7f5aa0162060 2024-09-12T01:56:16.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.269+0000 7f5aa667b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aa006d9f0 con 0x7f5aa00b6680 2024-09-12T01:56:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.269+0000 7f5aa667b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa006dcd0 con 0x7f5aa0161c80 2024-09-12T01:56:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.269+0000 7f5a9f7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5aa0162060 0x7f5aa00b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44786/0 (socket says 172.21.15.19:44786) 2024-09-12T01:56:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.269+0000 7f5a9f7fe640 1 -- 172.21.15.19:0/2001974338 learned_addr learned my addr 172.21.15.19:0/2001974338 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9ffff640 1 --2- 172.21.15.19:0/2001974338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa0161c80 0x7f5aa006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9effd640 1 -- 172.21.15.19:0/2001974338 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4069332556 0 0) 0x7f5a94001110 con 0x7f5aa0162060 2024-09-12T01:56:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9effd640 1 -- 172.21.15.19:0/2001974338 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a88003520 con 0x7f5aa0162060 2024-09-12T01:56:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9effd640 1 -- 172.21.15.19:0/2001974338 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1085746525 0 0) 0x7f5a88003520 con 0x7f5aa0162060 2024-09-12T01:56:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9effd640 1 -- 172.21.15.19:0/2001974338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa0161c80 msgr2=0x7f5aa006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9effd640 1 --2- 172.21.15.19:0/2001974338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa0161c80 0x7f5aa006e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9effd640 1 -- 172.21.15.19:0/2001974338 >> v1:172.21.15.135:6789/0 conn(0x7f5aa00b6680 legacy=0x7f5aa00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9effd640 1 -- 172.21.15.19:0/2001974338 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa006dfb0 con 0x7f5aa0162060 2024-09-12T01:56:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9effd640 1 -- 172.21.15.19:0/2001974338 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f5a94001840 con 0x7f5aa0162060 2024-09-12T01:56:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9effd640 1 -- 172.21.15.19:0/2001974338 >> v1:172.21.15.19:6789/0 conn(0x7f5aa0162060 legacy=0x7f5aa00b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9effd640 1 --2- 172.21.15.19:0/2001974338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a880039e0 0x7f5a88003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9effd640 1 --2- 172.21.15.19:0/2001974338 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a88004800 0x7f5a88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9effd640 1 --2- 172.21.15.19:0/2001974338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa0161c80 0x7f5a880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9effd640 1 -- 172.21.15.19:0/2001974338 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa006dcd0 con 0x7f5a88004800 2024-09-12T01:56:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9effd640 1 -- 172.21.15.19:0/2001974338 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8800ba70 con 0x7f5a880039e0 2024-09-12T01:56:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9effd640 1 -- 172.21.15.19:0/2001974338 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5a8800bc70 con 0x7f5aa0161c80 2024-09-12T01:56:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9ffff640 1 --2- 172.21.15.19:0/2001974338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a880039e0 0x7f5a88003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9f7fe640 1 --2- 172.21.15.19:0/2001974338 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a88004800 0x7f5a88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5aa4c18640 1 --2- 172.21.15.19:0/2001974338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa0161c80 0x7f5a880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9f7fe640 1 -- 172.21.15.19:0/2001974338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa0161c80 msgr2=0x7f5a880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9f7fe640 1 --2- 172.21.15.19:0/2001974338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa0161c80 0x7f5a880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9f7fe640 1 -- 172.21.15.19:0/2001974338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a880039e0 msgr2=0x7f5a88003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9f7fe640 1 --2- 172.21.15.19:0/2001974338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a880039e0 0x7f5a88003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9f7fe640 1 -- 172.21.15.19:0/2001974338 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a88003520 con 0x7f5a88004800 2024-09-12T01:56:16.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.270+0000 7f5a9ffff640 1 --2- 172.21.15.19:0/2001974338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a880039e0 0x7f5a88003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:16.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.271+0000 7f5a9f7fe640 1 --2- 172.21.15.19:0/2001974338 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a88004800 0x7f5a88004c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5aa00cb570 tx=0x7f5a88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91831cf827bba87d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:16.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.271+0000 7f5a9effd640 1 -- 172.21.15.19:0/2001974338 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9400c0e0 con 0x7f5a88004800 2024-09-12T01:56:16.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.271+0000 7f5a9effd640 1 -- 172.21.15.19:0/2001974338 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a94005ad0 con 0x7f5a88004800 2024-09-12T01:56:16.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.271+0000 7f5a9effd640 1 -- 172.21.15.19:0/2001974338 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a94007070 con 0x7f5a88004800 2024-09-12T01:56:16.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.272+0000 7f5aa667b640 1 -- 172.21.15.19:0/2001974338 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a88004800 msgr2=0x7f5a88004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.272+0000 7f5aa667b640 1 --2- 172.21.15.19:0/2001974338 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a88004800 0x7f5a88004c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5aa00cb570 tx=0x7f5a88005830 comp rx=0 tx=0).stop 2024-09-12T01:56:16.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.272+0000 7f5aa4c18640 1 -- 172.21.15.19:0/2001974338 reap_dead start 2024-09-12T01:56:16.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.272+0000 7f5aa667b640 1 -- 172.21.15.19:0/2001974338 shutdown_connections 2024-09-12T01:56:16.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.272+0000 7f5aa667b640 1 -- 172.21.15.19:0/2001974338 >> 172.21.15.19:0/2001974338 conn(0x7f5aa00d44f0 msgr2=0x7f5aa00d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:16.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.272+0000 7f5aa667b640 1 -- 172.21.15.19:0/2001974338 shutdown_connections 2024-09-12T01:56:16.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.272+0000 7f5aa667b640 1 -- 172.21.15.19:0/2001974338 wait complete. 2024-09-12T01:56:16.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.273+0000 7f5aa667b640 1 Processor -- start 2024-09-12T01:56:16.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.273+0000 7f5aa667b640 1 -- start start 2024-09-12T01:56:16.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.274+0000 7f5aa667b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a88004800 0x7f5aa00cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.274+0000 7f5aa667b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa00cdfc0 0x7f5aa0156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.274+0000 7f5aa667b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aa00b8230 0x7f5aa00b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.274+0000 7f5aa667b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa00b6cb0 con 0x7f5a88004800 2024-09-12T01:56:16.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.274+0000 7f5aa667b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa00b6b30 con 0x7f5aa00b8230 2024-09-12T01:56:16.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.274+0000 7f5aa667b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa006e330 con 0x7f5aa00cdfc0 2024-09-12T01:56:16.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.274+0000 7f5a9ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a88004800 0x7f5aa00cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.274+0000 7f5a9ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a88004800 0x7f5aa00cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41912/0 (socket says 172.21.15.19:41912) 2024-09-12T01:56:16.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.274+0000 7f5a9ffff640 1 -- 172.21.15.19:0/813938842 learned_addr learned my addr 172.21.15.19:0/813938842 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:16.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.274+0000 7f5a9f7fe640 1 --2- 172.21.15.19:0/813938842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa00cdfc0 0x7f5aa0156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.274+0000 7f5aa4c18640 1 --2- 172.21.15.19:0/813938842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aa00b8230 0x7f5aa00b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.274+0000 7f5a9ffff640 1 -- 172.21.15.19:0/813938842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa00cdfc0 msgr2=0x7f5aa0156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.274+0000 7f5a9ffff640 1 --2- 172.21.15.19:0/813938842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa00cdfc0 0x7f5aa0156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.274+0000 7f5a9ffff640 1 -- 172.21.15.19:0/813938842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aa00b8230 msgr2=0x7f5aa00b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.274+0000 7f5a9ffff640 1 --2- 172.21.15.19:0/813938842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aa00b8230 0x7f5aa00b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.274+0000 7f5a9ffff640 1 -- 172.21.15.19:0/813938842 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa0156ef0 con 0x7f5a88004800 2024-09-12T01:56:16.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.274+0000 7f5aa4c18640 1 --2- 172.21.15.19:0/813938842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aa00b8230 0x7f5aa00b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:16.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.275+0000 7f5a9ffff640 1 --2- 172.21.15.19:0/813938842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a88004800 0x7f5aa00cd560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5a90011d00 tx=0x7f5a9000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:16.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.275+0000 7f5a9cff9640 1 -- 172.21.15.19:0/813938842 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9000fcc0 con 0x7f5a88004800 2024-09-12T01:56:16.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.275+0000 7f5a9cff9640 1 -- 172.21.15.19:0/813938842 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a9000fe60 con 0x7f5a88004800 2024-09-12T01:56:16.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.275+0000 7f5aa667b640 1 -- 172.21.15.19:0/813938842 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aa00b7470 con 0x7f5a88004800 2024-09-12T01:56:16.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.275+0000 7f5a9cff9640 1 -- 172.21.15.19:0/813938842 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a90014680 con 0x7f5a88004800 2024-09-12T01:56:16.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.275+0000 7f5aa667b640 1 -- 172.21.15.19:0/813938842 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aa00b7a30 con 0x7f5a88004800 2024-09-12T01:56:16.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.276+0000 7f5aa667b640 1 -- 172.21.15.19:0/813938842 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aa00b5f70 con 0x7f5a88004800 2024-09-12T01:56:16.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.276+0000 7f5a9cff9640 1 -- 172.21.15.19:0/813938842 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a90012040 con 0x7f5a88004800 2024-09-12T01:56:16.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.277+0000 7f5a9cff9640 1 --2- 172.21.15.19:0/813938842 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a8c06be30 0x7f5a8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.277+0000 7f5a9cff9640 1 -- 172.21.15.19:0/813938842 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5a9008b920 con 0x7f5a88004800 2024-09-12T01:56:16.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.277+0000 7f5a9f7fe640 1 --2- 172.21.15.19:0/813938842 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a8c06be30 0x7f5a8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.278+0000 7f5a9f7fe640 1 --2- 172.21.15.19:0/813938842 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a8c06be30 0x7f5a8c06e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a94033000 tx=0x7f5a9402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:16.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.281+0000 7f5a9cff9640 1 -- 172.21.15.19:0/813938842 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5a90019030 con 0x7f5a88004800 2024-09-12T01:56:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.504+0000 7f5aa667b640 1 -- 172.21.15.19:0/813938842 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5aa00ba470 con 0x7f5a88004800 2024-09-12T01:56:16.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.507+0000 7f5a9cff9640 1 -- 172.21.15.19:0/813938842 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172944 (secure 0 0 0) 0x7f5a9005a020 con 0x7f5a88004800 2024-09-12T01:56:16.509 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.510+0000 7f5aa667b640 1 -- 172.21.15.19:0/813938842 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a8c06be30 msgr2=0x7f5a8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.510+0000 7f5aa667b640 1 --2- 172.21.15.19:0/813938842 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a8c06be30 0x7f5a8c06e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a94033000 tx=0x7f5a9402e000 comp rx=0 tx=0).stop 2024-09-12T01:56:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.510+0000 7f5aa667b640 1 -- 172.21.15.19:0/813938842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a88004800 msgr2=0x7f5aa00cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.510+0000 7f5aa667b640 1 --2- 172.21.15.19:0/813938842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a88004800 0x7f5aa00cd560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5a90011d00 tx=0x7f5a9000f610 comp rx=0 tx=0).stop 2024-09-12T01:56:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.510+0000 7f5aa667b640 1 -- 172.21.15.19:0/813938842 shutdown_connections 2024-09-12T01:56:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.510+0000 7f5aa667b640 1 --2- 172.21.15.19:0/813938842 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a8c06be30 0x7f5a8c06e2f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.510+0000 7f5aa667b640 1 --2- 172.21.15.19:0/813938842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aa00b8230 0x7f5aa00b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.510+0000 7f5aa667b640 1 --2- 172.21.15.19:0/813938842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa00cdfc0 0x7f5aa0156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.510+0000 7f5aa667b640 1 --2- 172.21.15.19:0/813938842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a88004800 0x7f5aa00cd560 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.510+0000 7f5aa667b640 1 -- 172.21.15.19:0/813938842 >> 172.21.15.19:0/813938842 conn(0x7f5aa00d44f0 msgr2=0x7f5aa006d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.510+0000 7f5aa667b640 1 -- 172.21.15.19:0/813938842 shutdown_connections 2024-09-12T01:56:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.510+0000 7f5aa667b640 1 -- 172.21.15.19:0/813938842 wait complete. 2024-09-12T01:56:16.522 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1305006827},{"type":"v1","addr":"172.21.15.135:6833","nonce":1305006827}]},"active_addr":"172.21.15.135:6833/1305006827","active_change":"2024-09-12T01:55:36.072168+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":2530464180}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":47009053}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":3861831251}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":2899870235}]}]} 2024-09-12T01:56:16.527 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T01:56:16.527 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T01:56:16.527 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:56:16.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.629+0000 7f8f63386640 1 Processor -- start 2024-09-12T01:56:16.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.629+0000 7f8f63386640 1 -- start start 2024-09-12T01:56:16.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.630+0000 7f8f63386640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f5c15e760 0x7f8f5c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.630+0000 7f8f63386640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8f5c0d4fd0 0x7f8f5c0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.630+0000 7f8f63386640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f5c0d2700 con 0x7f8f5c0b3650 2024-09-12T01:56:16.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.630+0000 7f8f63386640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8f5c0cedb0 con 0x7f8f5c15e760 2024-09-12T01:56:16.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.630+0000 7f8f63386640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f8f5c0cf090 con 0x7f8f5c0d4fd0 2024-09-12T01:56:16.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.630+0000 7f8f61122640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f5c15e760 0x7f8f5c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.630+0000 7f8f61122640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f5c15e760 0x7f8f5c06cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41926/0 (socket says 172.21.15.19:41926) 2024-09-12T01:56:16.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.630+0000 7f8f61122640 1 -- 172.21.15.19:0/4254619256 learned_addr learned my addr 172.21.15.19:0/4254619256 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:16.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.630+0000 7f8f60921640 1 --2- 172.21.15.19:0/4254619256 >> v2:172.21.15.135:3300/0 conn(0x7f8f5c0d4fd0 0x7f8f5c0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.631+0000 7f8f61122640 1 -- 172.21.15.19:0/4254619256 >> v2:172.21.15.135:3300/0 conn(0x7f8f5c0d4fd0 msgr2=0x7f8f5c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:16.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.631+0000 7f8f61122640 1 --2- 172.21.15.19:0/4254619256 >> v2:172.21.15.135:3300/0 conn(0x7f8f5c0d4fd0 0x7f8f5c0cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.631+0000 7f8f61122640 1 -- 172.21.15.19:0/4254619256 >> v1:172.21.15.135:6789/0 conn(0x7f8f5c0b3650 legacy=0x7f8f5c0d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.631+0000 7f8f61122640 1 -- 172.21.15.19:0/4254619256 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f5c0b3c80 con 0x7f8f5c15e760 2024-09-12T01:56:16.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.631+0000 7f8f61122640 1 --2- 172.21.15.19:0/4254619256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f5c15e760 0x7f8f5c06cdd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c08ca80 tx=0x7f8f5802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956795e231a69fc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:16.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.631+0000 7f8f53fff640 1 -- 172.21.15.19:0/4254619256 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f58037070 con 0x7f8f5c15e760 2024-09-12T01:56:16.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.632+0000 7f8f53fff640 1 -- 172.21.15.19:0/4254619256 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f58032440 con 0x7f8f5c15e760 2024-09-12T01:56:16.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.632+0000 7f8f53fff640 1 -- 172.21.15.19:0/4254619256 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f58032810 con 0x7f8f5c15e760 2024-09-12T01:56:16.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.632+0000 7f8f63386640 1 -- 172.21.15.19:0/4254619256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f5c15e760 msgr2=0x7f8f5c06cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.632+0000 7f8f63386640 1 --2- 172.21.15.19:0/4254619256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f5c15e760 0x7f8f5c06cdd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c08ca80 tx=0x7f8f5802a1e0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.632+0000 7f8f63386640 1 -- 172.21.15.19:0/4254619256 shutdown_connections 2024-09-12T01:56:16.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.632+0000 7f8f63386640 1 --2- 172.21.15.19:0/4254619256 >> v2:172.21.15.135:3300/0 conn(0x7f8f5c0d4fd0 0x7f8f5c0cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.632+0000 7f8f63386640 1 --2- 172.21.15.19:0/4254619256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f5c15e760 0x7f8f5c06cdd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.632+0000 7f8f63386640 1 -- 172.21.15.19:0/4254619256 >> 172.21.15.19:0/4254619256 conn(0x7f8f5c08bfc0 msgr2=0x7f8f5c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:16.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.632+0000 7f8f63386640 1 -- 172.21.15.19:0/4254619256 shutdown_connections 2024-09-12T01:56:16.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.632+0000 7f8f63386640 1 -- 172.21.15.19:0/4254619256 wait complete. 2024-09-12T01:56:16.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.633+0000 7f8f63386640 1 Processor -- start 2024-09-12T01:56:16.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.633+0000 7f8f63386640 1 -- start start 2024-09-12T01:56:16.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.634+0000 7f8f63386640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f5c0b3650 0x7f8f5c0b9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.634+0000 7f8f63386640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f5c0d4fd0 0x7f8f5c0b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.634+0000 7f8f63386640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f5c15e760 0x7f8f5c0b8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.634+0000 7f8f63386640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5c0cff00 con 0x7f8f5c15e760 2024-09-12T01:56:16.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.634+0000 7f8f63386640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5c0cfd80 con 0x7f8f5c0d4fd0 2024-09-12T01:56:16.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.634+0000 7f8f63386640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8f5c0d35b0 con 0x7f8f5c0b3650 2024-09-12T01:56:16.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.634+0000 7f8f61923640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f5c15e760 0x7f8f5c0b8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.634+0000 7f8f61122640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f5c0b3650 0x7f8f5c0b9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.634+0000 7f8f61923640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f5c15e760 0x7f8f5c0b8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41932/0 (socket says 172.21.15.19:41932) 2024-09-12T01:56:16.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.634+0000 7f8f61923640 1 -- 172.21.15.19:0/3607361698 learned_addr learned my addr 172.21.15.19:0/3607361698 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:16.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.634+0000 7f8f60921640 1 --2- 172.21.15.19:0/3607361698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f5c0d4fd0 0x7f8f5c0b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.635+0000 7f8f61923640 1 -- 172.21.15.19:0/3607361698 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f5c0b3650 msgr2=0x7f8f5c0b9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.635+0000 7f8f61923640 1 --2- 172.21.15.19:0/3607361698 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f5c0b3650 0x7f8f5c0b9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.635+0000 7f8f61923640 1 -- 172.21.15.19:0/3607361698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f5c0d4fd0 msgr2=0x7f8f5c0b83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.635+0000 7f8f61923640 1 --2- 172.21.15.19:0/3607361698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f5c0d4fd0 0x7f8f5c0b83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.635+0000 7f8f61923640 1 -- 172.21.15.19:0/3607361698 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f5c151ae0 con 0x7f8f5c15e760 2024-09-12T01:56:16.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.635+0000 7f8f61122640 1 --2- 172.21.15.19:0/3607361698 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f5c0b3650 0x7f8f5c0b9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:16.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.635+0000 7f8f61923640 1 --2- 172.21.15.19:0/3607361698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f5c15e760 0x7f8f5c0b8910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400c730 tx=0x7f8f5400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:16.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.635+0000 7f8f51ffb640 1 -- 172.21.15.19:0/3607361698 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f54003b70 con 0x7f8f5c15e760 2024-09-12T01:56:16.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.635+0000 7f8f51ffb640 1 -- 172.21.15.19:0/3607361698 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f54003d30 con 0x7f8f5c15e760 2024-09-12T01:56:16.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.635+0000 7f8f63386640 1 -- 172.21.15.19:0/3607361698 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f5c0cc100 con 0x7f8f5c15e760 2024-09-12T01:56:16.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.635+0000 7f8f51ffb640 1 -- 172.21.15.19:0/3607361698 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f54005310 con 0x7f8f5c15e760 2024-09-12T01:56:16.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.635+0000 7f8f63386640 1 -- 172.21.15.19:0/3607361698 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f5c0cc3a0 con 0x7f8f5c15e760 2024-09-12T01:56:16.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.636+0000 7f8f63386640 1 -- 172.21.15.19:0/3607361698 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f5c0d3880 con 0x7f8f5c15e760 2024-09-12T01:56:16.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.637+0000 7f8f51ffb640 1 -- 172.21.15.19:0/3607361698 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f540056c0 con 0x7f8f5c15e760 2024-09-12T01:56:16.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.637+0000 7f8f51ffb640 1 --2- 172.21.15.19:0/3607361698 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8f4006be60 0x7f8f4006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.637+0000 7f8f51ffb640 1 -- 172.21.15.19:0/3607361698 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8f5408b030 con 0x7f8f5c15e760 2024-09-12T01:56:16.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.637+0000 7f8f61122640 1 --2- 172.21.15.19:0/3607361698 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8f4006be60 0x7f8f4006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.638+0000 7f8f61122640 1 --2- 172.21.15.19:0/3607361698 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8f4006be60 0x7f8f4006e320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f58034000 tx=0x7f8f5802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:16.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.641+0000 7f8f51ffb640 1 -- 172.21.15.19:0/3607361698 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f5c0d2700 con 0x7f8f5c15e760 2024-09-12T01:56:16.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.821+0000 7f8f63386640 1 -- 172.21.15.19:0/3607361698 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f5c0b6d20 con 0x7f8f5c15e760 2024-09-12T01:56:16.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.822+0000 7f8f51ffb640 1 -- 172.21.15.19:0/3607361698 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18586 (secure 0 0 0) 0x7f8f54059050 con 0x7f8f5c15e760 2024-09-12T01:56:16.823 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:16.823 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:56:01.739727+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:52.899670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:54.099981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:55:57.729901+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:16.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.824+0000 7f8f63386640 1 -- 172.21.15.19:0/3607361698 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8f4006be60 msgr2=0x7f8f4006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.824+0000 7f8f63386640 1 --2- 172.21.15.19:0/3607361698 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8f4006be60 0x7f8f4006e320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f58034000 tx=0x7f8f5802e000 comp rx=0 tx=0).stop 2024-09-12T01:56:16.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.824+0000 7f8f63386640 1 -- 172.21.15.19:0/3607361698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f5c15e760 msgr2=0x7f8f5c0b8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.824+0000 7f8f63386640 1 --2- 172.21.15.19:0/3607361698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f5c15e760 0x7f8f5c0b8910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400c730 tx=0x7f8f5400cbf0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.824+0000 7f8f63386640 1 -- 172.21.15.19:0/3607361698 shutdown_connections 2024-09-12T01:56:16.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.824+0000 7f8f63386640 1 --2- 172.21.15.19:0/3607361698 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8f4006be60 0x7f8f4006e320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.824+0000 7f8f63386640 1 --2- 172.21.15.19:0/3607361698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f5c15e760 0x7f8f5c0b8910 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.824+0000 7f8f63386640 1 --2- 172.21.15.19:0/3607361698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f5c0d4fd0 0x7f8f5c0b83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.824+0000 7f8f63386640 1 --2- 172.21.15.19:0/3607361698 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f5c0b3650 0x7f8f5c0b9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.824+0000 7f8f63386640 1 -- 172.21.15.19:0/3607361698 >> 172.21.15.19:0/3607361698 conn(0x7f8f5c08bfc0 msgr2=0x7f8f5c0b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:16.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.824+0000 7f8f63386640 1 -- 172.21.15.19:0/3607361698 shutdown_connections 2024-09-12T01:56:16.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.824+0000 7f8f63386640 1 -- 172.21.15.19:0/3607361698 wait complete. 2024-09-12T01:56:16.836 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T01:56:16.836 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:56:16.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.939+0000 7f992e9bd640 1 Processor -- start 2024-09-12T01:56:16.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.939+0000 7f992e9bd640 1 -- start start 2024-09-12T01:56:16.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.939+0000 7f992e9bd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99280d0270 0x7f99280d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.939+0000 7f992e9bd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f99280b6010 0x7f99280b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.939+0000 7f992e9bd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99280d2170 con 0x7f992815e710 2024-09-12T01:56:16.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.939+0000 7f992e9bd640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f99280d2d20 con 0x7f99280b6010 2024-09-12T01:56:16.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.939+0000 7f992e9bd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f99280d2410 con 0x7f99280d0270 2024-09-12T01:56:16.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.940+0000 7f992cf5a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f99280b6010 0x7f99280b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.940+0000 7f99277fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99280d0270 0x7f99280d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.940+0000 7f99277fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99280d0270 0x7f99280d31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:42160/0 (socket says 172.21.15.19:42160) 2024-09-12T01:56:16.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.940+0000 7f99277fe640 1 -- 172.21.15.19:0/571282162 learned_addr learned my addr 172.21.15.19:0/571282162 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:16.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.940+0000 7f992cf5a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f99280b6010 0x7f99280b64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:57876/0 (socket says 172.21.15.19:57876) 2024-09-12T01:56:16.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.940+0000 7f99277fe640 1 -- 172.21.15.19:0/571282162 >> v2:172.21.15.135:3300/0 conn(0x7f99280b6010 msgr2=0x7f99280b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:16.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.940+0000 7f99277fe640 1 --2- 172.21.15.19:0/571282162 >> v2:172.21.15.135:3300/0 conn(0x7f99280b6010 0x7f99280b64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.940+0000 7f99277fe640 1 -- 172.21.15.19:0/571282162 >> v1:172.21.15.135:6789/0 conn(0x7f992815e710 legacy=0x7f99280cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.940+0000 7f99277fe640 1 -- 172.21.15.19:0/571282162 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99280d5240 con 0x7f99280d0270 2024-09-12T01:56:16.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.940+0000 7f992cf5a640 1 --2- 172.21.15.19:0/571282162 >> v2:172.21.15.135:3300/0 conn(0x7f99280b6010 0x7f99280b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:16.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.941+0000 7f99277fe640 1 --2- 172.21.15.19:0/571282162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99280d0270 0x7f99280d31b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f991c009850 tx=0x7f991c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c54abb084575e6b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:16.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.941+0000 7f9926ffd640 1 -- 172.21.15.19:0/571282162 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c004030 con 0x7f99280d0270 2024-09-12T01:56:16.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.941+0000 7f9926ffd640 1 -- 172.21.15.19:0/571282162 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f991c0041d0 con 0x7f99280d0270 2024-09-12T01:56:16.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.941+0000 7f9926ffd640 1 -- 172.21.15.19:0/571282162 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c003610 con 0x7f99280d0270 2024-09-12T01:56:16.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.942+0000 7f992e9bd640 1 -- 172.21.15.19:0/571282162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99280d0270 msgr2=0x7f99280d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.942+0000 7f992e9bd640 1 --2- 172.21.15.19:0/571282162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99280d0270 0x7f99280d31b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f991c009850 tx=0x7f991c02a250 comp rx=0 tx=0).stop 2024-09-12T01:56:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.942+0000 7f992e9bd640 1 -- 172.21.15.19:0/571282162 shutdown_connections 2024-09-12T01:56:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.942+0000 7f992e9bd640 1 --2- 172.21.15.19:0/571282162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99280d0270 0x7f99280d31b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.942+0000 7f992e9bd640 1 --2- 172.21.15.19:0/571282162 >> v2:172.21.15.135:3300/0 conn(0x7f99280b6010 0x7f99280b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.942+0000 7f992e9bd640 1 -- 172.21.15.19:0/571282162 >> 172.21.15.19:0/571282162 conn(0x7f992808bfc0 msgr2=0x7f99280d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.942+0000 7f992e9bd640 1 -- 172.21.15.19:0/571282162 shutdown_connections 2024-09-12T01:56:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.942+0000 7f992e9bd640 1 -- 172.21.15.19:0/571282162 wait complete. 2024-09-12T01:56:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.943+0000 7f992e9bd640 1 Processor -- start 2024-09-12T01:56:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.943+0000 7f992e9bd640 1 -- start start 2024-09-12T01:56:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.944+0000 7f992e9bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99280b6010 0x7f99280cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.944+0000 7f992e9bd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99280d0270 0x7f99281579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.944+0000 7f992e9bd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f992815e710 0x7f9928156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.944+0000 7f992e9bd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f992806ce60 con 0x7f99280b6010 2024-09-12T01:56:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.944+0000 7f992e9bd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f99280d29b0 con 0x7f992815e710 2024-09-12T01:56:16.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.944+0000 7f992e9bd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f992806cfe0 con 0x7f99280d0270 2024-09-12T01:56:16.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.944+0000 7f9927fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99280b6010 0x7f99280cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.944+0000 7f9927fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99280b6010 0x7f99280cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41948/0 (socket says 172.21.15.19:41948) 2024-09-12T01:56:16.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.944+0000 7f9927fff640 1 -- 172.21.15.19:0/1178223856 learned_addr learned my addr 172.21.15.19:0/1178223856 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:16.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.944+0000 7f99277fe640 1 --2- 172.21.15.19:0/1178223856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99280d0270 0x7f99281579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.944+0000 7f992cf5a640 1 --2- 172.21.15.19:0/1178223856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f992815e710 0x7f9928156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.944+0000 7f9927fff640 1 -- 172.21.15.19:0/1178223856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99280d0270 msgr2=0x7f99281579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.944+0000 7f9927fff640 1 --2- 172.21.15.19:0/1178223856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99280d0270 0x7f99281579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.944+0000 7f9927fff640 1 -- 172.21.15.19:0/1178223856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f992815e710 msgr2=0x7f9928156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.944+0000 7f9927fff640 1 --2- 172.21.15.19:0/1178223856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f992815e710 0x7f9928156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.944+0000 7f9927fff640 1 -- 172.21.15.19:0/1178223856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99280ce580 con 0x7f99280b6010 2024-09-12T01:56:16.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.944+0000 7f9927fff640 1 --2- 172.21.15.19:0/1178223856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99280b6010 0x7f99280cdef0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f991800c3f0 tx=0x7f991800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:16.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.945+0000 7f9924ff9640 1 -- 172.21.15.19:0/1178223856 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99180052d0 con 0x7f99280b6010 2024-09-12T01:56:16.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.945+0000 7f9924ff9640 1 -- 172.21.15.19:0/1178223856 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9918005490 con 0x7f99280b6010 2024-09-12T01:56:16.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.945+0000 7f992e9bd640 1 -- 172.21.15.19:0/1178223856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99280ce860 con 0x7f99280b6010 2024-09-12T01:56:16.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.945+0000 7f9924ff9640 1 -- 172.21.15.19:0/1178223856 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9918007260 con 0x7f99280b6010 2024-09-12T01:56:16.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.945+0000 7f992e9bd640 1 -- 172.21.15.19:0/1178223856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99281617a0 con 0x7f99280b6010 2024-09-12T01:56:16.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.946+0000 7f992e9bd640 1 -- 172.21.15.19:0/1178223856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99280d31b0 con 0x7f99280b6010 2024-09-12T01:56:16.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.946+0000 7f9924ff9640 1 -- 172.21.15.19:0/1178223856 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9918007400 con 0x7f99280b6010 2024-09-12T01:56:16.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.947+0000 7f9924ff9640 1 --2- 172.21.15.19:0/1178223856 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f991406be30 0x7f991406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.947+0000 7f9924ff9640 1 -- 172.21.15.19:0/1178223856 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f991808a710 con 0x7f99280b6010 2024-09-12T01:56:16.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.947+0000 7f99277fe640 1 --2- 172.21.15.19:0/1178223856 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f991406be30 0x7f991406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.947+0000 7f99277fe640 1 --2- 172.21.15.19:0/1178223856 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f991406be30 0x7f991406e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f991c033000 tx=0x7f991c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:16.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:16.951+0000 7f9924ff9640 1 -- 172.21.15.19:0/1178223856 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9918058d00 con 0x7f99280b6010 2024-09-12T01:56:17.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.127+0000 7f992e9bd640 1 -- 172.21.15.19:0/1178223856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99280b6cf0 con 0x7f99280b6010 2024-09-12T01:56:17.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.128+0000 7f9924ff9640 1 -- 172.21.15.19:0/1178223856 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18586 (secure 0 0 0) 0x7f9918058600 con 0x7f99280b6010 2024-09-12T01:56:17.128 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:17.129 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:56:01.739727+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:52.899670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:54.099981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:55:57.729901+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:17.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.130+0000 7f992e9bd640 1 -- 172.21.15.19:0/1178223856 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f991406be30 msgr2=0x7f991406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.130+0000 7f992e9bd640 1 --2- 172.21.15.19:0/1178223856 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f991406be30 0x7f991406e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f991c033000 tx=0x7f991c02e000 comp rx=0 tx=0).stop 2024-09-12T01:56:17.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.130+0000 7f992e9bd640 1 -- 172.21.15.19:0/1178223856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99280b6010 msgr2=0x7f99280cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.130+0000 7f992e9bd640 1 --2- 172.21.15.19:0/1178223856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99280b6010 0x7f99280cdef0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f991800c3f0 tx=0x7f991800c8b0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.130+0000 7f992e9bd640 1 -- 172.21.15.19:0/1178223856 shutdown_connections 2024-09-12T01:56:17.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.130+0000 7f992e9bd640 1 --2- 172.21.15.19:0/1178223856 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f991406be30 0x7f991406e2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.130+0000 7f992e9bd640 1 --2- 172.21.15.19:0/1178223856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f992815e710 0x7f9928156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.130+0000 7f992e9bd640 1 --2- 172.21.15.19:0/1178223856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99280d0270 0x7f99281579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.130+0000 7f992e9bd640 1 --2- 172.21.15.19:0/1178223856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99280b6010 0x7f99280cdef0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.130+0000 7f992e9bd640 1 -- 172.21.15.19:0/1178223856 >> 172.21.15.19:0/1178223856 conn(0x7f992808bfc0 msgr2=0x7f992806da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.130+0000 7f992e9bd640 1 -- 172.21.15.19:0/1178223856 shutdown_connections 2024-09-12T01:56:17.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.130+0000 7f992e9bd640 1 -- 172.21.15.19:0/1178223856 wait complete. 2024-09-12T01:56:17.142 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T01:56:17.143 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T01:56:17.143 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T01:56:17.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T01:56:17.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T01:56:17.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T01:56:17.145 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T01:56:17.145 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T01:56:17.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.320+0000 7f18f3fff640 1 Processor -- start 2024-09-12T01:56:17.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.320+0000 7f228ee8d640 1 Processor -- start 2024-09-12T01:56:17.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.321+0000 7f228ee8d640 1 -- start start 2024-09-12T01:56:17.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.320+0000 7f18f3fff640 1 -- start start 2024-09-12T01:56:17.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.321+0000 7f9ff759e640 1 Processor -- start 2024-09-12T01:56:17.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.321+0000 7f18f3fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f18ec0e6fe0 0x7f18ec0068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.321+0000 7f18f3fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ec049f20 0x7f18ec03b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.321+0000 7f18f3fff640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18ec006e10 con 0x7f18ec036f20 2024-09-12T01:56:17.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7f18f3fff640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f18ec009690 con 0x7f18ec0e6fe0 2024-09-12T01:56:17.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7f18f3fff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f18ec0374b0 con 0x7f18ec049f20 2024-09-12T01:56:17.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7f18f37fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ec049f20 0x7f18ec03b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7f18f2ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f18ec0e6fe0 0x7f18ec0068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7f18f37fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ec049f20 0x7f18ec03b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:42178/0 (socket says 172.21.15.19:42178) 2024-09-12T01:56:17.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7f18f37fe640 1 -- 172.21.15.19:0/2411507353 learned_addr learned my addr 172.21.15.19:0/2411507353 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7f228ee8d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f228815a2c0 0x7f22880cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7f228ee8d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22880720b0 0x7f2288072500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7f228ee8d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22880ce620 con 0x7f228815ea90 2024-09-12T01:56:17.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7f228ee8d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f22880ce3f0 con 0x7f228815a2c0 2024-09-12T01:56:17.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7f228ee8d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2288072a40 con 0x7f22880720b0 2024-09-12T01:56:17.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.321+0000 7f9ff759e640 1 -- start start 2024-09-12T01:56:17.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.323+0000 7f9ff759e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ff00df7a0 0x7f9ff00080c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.323+0000 7f9ff759e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9ff0050380 0x7f9ff00561c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.323+0000 7f9ff759e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ff00090c0 con 0x7f9ff0055dc0 2024-09-12T01:56:17.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.323+0000 7f9ff759e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f9ff000b0b0 con 0x7f9ff0050380 2024-09-12T01:56:17.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.323+0000 7f9ff759e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9ff0008b00 con 0x7f9ff00df7a0 2024-09-12T01:56:17.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7f9ff659c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ff00df7a0 0x7f9ff00080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7f9ff659c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ff00df7a0 0x7f9ff00080c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:42186/0 (socket says 172.21.15.19:42186) 2024-09-12T01:56:17.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7f9ff659c640 1 -- 172.21.15.19:0/844585102 learned_addr learned my addr 172.21.15.19:0/844585102 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7f18f37fe640 1 -- 172.21.15.19:0/2411507353 >> v2:172.21.15.19:3300/0 conn(0x7f18ec0e6fe0 msgr2=0x7f18ec0068d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7f18f37fe640 1 --2- 172.21.15.19:0/2411507353 >> v2:172.21.15.19:3300/0 conn(0x7f18ec0e6fe0 0x7f18ec0068d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7f18f37fe640 1 -- 172.21.15.19:0/2411507353 >> v1:172.21.15.135:6789/0 conn(0x7f18ec036f20 legacy=0x7f18ec049810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7f18f2ffd640 1 --2- 172.21.15.19:0/2411507353 >> v2:172.21.15.19:3300/0 conn(0x7f18ec0e6fe0 0x7f18ec0068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:17.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7f18f37fe640 1 -- 172.21.15.19:0/2411507353 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ec037790 con 0x7f18ec049f20 2024-09-12T01:56:17.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7f18f37fe640 1 --2- 172.21.15.19:0/2411507353 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ec049f20 0x7f18ec03b710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f18f402dd50 tx=0x7f18f40a60e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd13e72fd712399b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.323+0000 7f365128f640 1 Processor -- start 2024-09-12T01:56:17.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.323+0000 7f365128f640 1 -- start start 2024-09-12T01:56:17.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7fdf608e6640 1 Processor -- start 2024-09-12T01:56:17.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7fdf608e6640 1 -- start start 2024-09-12T01:56:17.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.323+0000 7fdf608e6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdf5c154a00 0x7fdf5c0720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.323+0000 7fdf608e6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf5c0725f0 0x7fdf5c15e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.323+0000 7fdf608e6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdf5c0701a0 0x7fdf5c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7fdf608e6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fdf5c15a980 con 0x7fdf5c154a00 2024-09-12T01:56:17.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7fdf608e6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fdf5c15b980 con 0x7fdf5c0701a0 2024-09-12T01:56:17.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7fdf608e6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdf5c15abc0 con 0x7fdf5c0725f0 2024-09-12T01:56:17.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7fdf5ad9d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdf5c0701a0 0x7fdf5c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7fdf5ad9d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdf5c0701a0 0x7fdf5c06e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:57898/0 (socket says 172.21.15.19:57898) 2024-09-12T01:56:17.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7fdf5ad9d640 1 -- 172.21.15.19:0/2108600182 learned_addr learned my addr 172.21.15.19:0/2108600182 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7f2287fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f228815ea90 0x7f22880cf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44788/0 (socket says 172.21.15.19:44788) 2024-09-12T01:56:17.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.322+0000 7f2287fff640 1 -- 172.21.15.19:0/2412178394 learned_addr learned my addr 172.21.15.19:0/2412178394 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:17.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7f18f1ffb640 1 -- 172.21.15.19:0/2411507353 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f40b3070 con 0x7f18ec049f20 2024-09-12T01:56:17.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7f18f1ffb640 1 -- 172.21.15.19:0/2411507353 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f40ae440 con 0x7f18ec049f20 2024-09-12T01:56:17.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7f18f1ffb640 1 -- 172.21.15.19:0/2411507353 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f40ae8b0 con 0x7f18ec049f20 2024-09-12T01:56:17.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7f9ff6d9d640 1 --2- 172.21.15.19:0/844585102 >> v2:172.21.15.19:3300/0 conn(0x7f9ff0050380 0x7f9ff00561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.323+0000 7f228d42a640 1 --2- 172.21.15.19:0/2412178394 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22880720b0 0x7f2288072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.323+0000 7f228cc29640 1 --2- 172.21.15.19:0/2412178394 >> v2:172.21.15.135:3300/0 conn(0x7f228815a2c0 0x7f22880cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7f228cc29640 1 -- 172.21.15.19:0/2412178394 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22880720b0 msgr2=0x7f2288072500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7f228cc29640 1 --2- 172.21.15.19:0/2412178394 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22880720b0 0x7f2288072500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7f228cc29640 1 -- 172.21.15.19:0/2412178394 >> v1:172.21.15.19:6789/0 conn(0x7f228815ea90 legacy=0x7f22880cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7f228cc29640 1 -- 172.21.15.19:0/2412178394 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22880ce8c0 con 0x7f228815a2c0 2024-09-12T01:56:17.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7fce540c9640 1 Processor -- start 2024-09-12T01:56:17.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7fdf5a59c640 1 --2- 172.21.15.19:0/2108600182 >> v2:172.21.15.19:3300/0 conn(0x7fdf5c154a00 0x7fdf5c0720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7f9ff659c640 1 -- 172.21.15.19:0/844585102 >> v2:172.21.15.19:3300/0 conn(0x7f9ff0050380 msgr2=0x7f9ff00561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7f9ff659c640 1 --2- 172.21.15.19:0/844585102 >> v2:172.21.15.19:3300/0 conn(0x7f9ff0050380 0x7f9ff00561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7f9ff659c640 1 -- 172.21.15.19:0/844585102 >> v1:172.21.15.19:6789/0 conn(0x7f9ff0055dc0 legacy=0x7f9ff004fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.325+0000 7f9ff659c640 1 -- 172.21.15.19:0/844585102 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff0008de0 con 0x7f9ff00df7a0 2024-09-12T01:56:17.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.325+0000 7f365128f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f36440df0a0 0x7f3644039ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.325+0000 7fce540c9640 1 -- start start 2024-09-12T01:56:17.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.325+0000 7f364bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f36440df0a0 0x7f3644039ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.325+0000 7f364bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f36440df0a0 0x7f3644039ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41992/0 (socket says 172.21.15.19:41992) 2024-09-12T01:56:17.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.325+0000 7fe49d398640 1 Processor -- start 2024-09-12T01:56:17.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.325+0000 7fe49d398640 1 -- start start 2024-09-12T01:56:17.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.325+0000 7f364bfff640 1 -- 172.21.15.19:0/770394622 learned_addr learned my addr 172.21.15.19:0/770394622 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7fdf5ad9d640 1 -- 172.21.15.19:0/2108600182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf5c0725f0 msgr2=0x7fdf5c15e1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:56:17.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7fdf5ad9d640 1 --2- 172.21.15.19:0/2108600182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf5c0725f0 0x7fdf5c15e1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7fdf5ad9d640 1 -- 172.21.15.19:0/2108600182 >> v2:172.21.15.19:3300/0 conn(0x7fdf5c154a00 msgr2=0x7fdf5c0720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7fdf5ad9d640 1 --2- 172.21.15.19:0/2108600182 >> v2:172.21.15.19:3300/0 conn(0x7fdf5c154a00 0x7fdf5c0720b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.324+0000 7fdf5ad9d640 1 -- 172.21.15.19:0/2108600182 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5c15aea0 con 0x7fdf5c0701a0 2024-09-12T01:56:17.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.325+0000 7f228cc29640 1 --2- 172.21.15.19:0/2412178394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f228815a2c0 0x7f22880cc9e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f228806c800 tx=0x7f228002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee1751684169866b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.325+0000 7f18f3fff640 1 -- 172.21.15.19:0/2411507353 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ec049f20 msgr2=0x7f18ec03b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.325+0000 7f18f3fff640 1 --2- 172.21.15.19:0/2411507353 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ec049f20 0x7f18ec03b710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f18f402dd50 tx=0x7f18f40a60e0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.325+0000 7f365128f640 1 -- 172.21.15.19:0/770394622 --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36440df480 con 0x7f3644033b50 2024-09-12T01:56:17.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.325+0000 7f365128f640 1 -- 172.21.15.19:0/770394622 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f364400c330 con 0x7f3644055ab0 2024-09-12T01:56:17.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.325+0000 7f365128f640 1 -- 172.21.15.19:0/770394622 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f364400a410 con 0x7f36440df0a0 2024-09-12T01:56:17.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.325+0000 7fef39b78640 1 Processor -- start 2024-09-12T01:56:17.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7f18f3fff640 1 -- 172.21.15.19:0/2411507353 shutdown_connections 2024-09-12T01:56:17.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7f18f3fff640 1 --2- 172.21.15.19:0/2411507353 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ec049f20 0x7f18ec03b710 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7f18f3fff640 1 --2- 172.21.15.19:0/2411507353 >> v2:172.21.15.19:3300/0 conn(0x7f18ec0e6fe0 0x7f18ec0068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7f18f3fff640 1 -- 172.21.15.19:0/2411507353 >> 172.21.15.19:0/2411507353 conn(0x7f18ec01fb10 msgr2=0x7f18ec056840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7f9ff659c640 1 --2- 172.21.15.19:0/844585102 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ff00df7a0 0x7f9ff00080c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009850 tx=0x7f9fe802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de3893e5b00ce6eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7f18f3fff640 1 -- 172.21.15.19:0/2411507353 shutdown_connections 2024-09-12T01:56:17.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fdf5ad9d640 1 --2- 172.21.15.19:0/2108600182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c0701a0 0x7fdf5c06e940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c06c880 tx=0x7fdf5402ea70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8403a42006356da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7f18f3fff640 1 -- 172.21.15.19:0/2411507353 wait complete. 2024-09-12T01:56:17.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fe49d398640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe4980727f0 0x7fe49815a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fce540c9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce4c0720b0 0x7fce4c0cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fe49d398640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe4980cf3a0 0x7fe4980cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fe49d398640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4980b3c30 con 0x7fe498068c60 2024-09-12T01:56:17.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fe49d398640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fe49815a8c0 con 0x7fe4980cf3a0 2024-09-12T01:56:17.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fe49d398640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe4980b4520 con 0x7fe4980727f0 2024-09-12T01:56:17.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fdf5959a640 1 -- 172.21.15.19:0/2108600182 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54036070 con 0x7fdf5c0701a0 2024-09-12T01:56:17.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fdf5959a640 1 -- 172.21.15.19:0/2108600182 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf54009600 con 0x7fdf5c0701a0 2024-09-12T01:56:17.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fdf5959a640 1 -- 172.21.15.19:0/2108600182 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54009a10 con 0x7fdf5c0701a0 2024-09-12T01:56:17.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fce540c9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce4c162ad0 0x7fce4c06f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7f9ff559a640 1 -- 172.21.15.19:0/844585102 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8004030 con 0x7f9ff00df7a0 2024-09-12T01:56:17.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fe496ffd640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fe498068c60 0x7fe4980720e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:41812/0 (socket says 172.21.15.19:41812) 2024-09-12T01:56:17.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fe496ffd640 1 -- 172.21.15.19:0/4046971589 learned_addr learned my addr 172.21.15.19:0/4046971589 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:17.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7f9ff559a640 1 -- 172.21.15.19:0/844585102 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe80041d0 con 0x7f9ff00df7a0 2024-09-12T01:56:17.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fce540c9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce4c0b49a0 con 0x7fce4c072490 2024-09-12T01:56:17.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fce540c9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fce4c0afa20 con 0x7fce4c0720b0 2024-09-12T01:56:17.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fce540c9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fce4c0afce0 con 0x7fce4c162ad0 2024-09-12T01:56:17.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fce51664640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce4c162ad0 0x7fce4c06f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fce51664640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce4c162ad0 0x7fce4c06f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:57916/0 (socket says 172.21.15.19:57916) 2024-09-12T01:56:17.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fce51664640 1 -- 172.21.15.19:0/2977706682 learned_addr learned my addr 172.21.15.19:0/2977706682 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7f9ff559a640 1 -- 172.21.15.19:0/844585102 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8003610 con 0x7f9ff00df7a0 2024-09-12T01:56:17.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7f364affd640 1 -- 172.21.15.19:0/770394622 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2457268794 0 0) 0x7f36440df480 con 0x7f3644033b50 2024-09-12T01:56:17.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7f364affd640 1 -- 172.21.15.19:0/770394622 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f363c003520 con 0x7f3644033b50 2024-09-12T01:56:17.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7fe4967fc640 1 --2- 172.21.15.19:0/4046971589 >> v2:172.21.15.135:3300/0 conn(0x7fe4980727f0 0x7fe49815a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7fce51e65640 1 --2- 172.21.15.19:0/2977706682 >> v2:172.21.15.19:3300/0 conn(0x7fce4c0720b0 0x7fce4c0cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7fef39b78640 1 -- start start 2024-09-12T01:56:17.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7f9ff759e640 1 -- 172.21.15.19:0/844585102 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ff00df7a0 msgr2=0x7f9ff00080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7f9ff759e640 1 --2- 172.21.15.19:0/844585102 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ff00df7a0 0x7f9ff00080c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009850 tx=0x7f9fe802a270 comp rx=0 tx=0).stop 2024-09-12T01:56:17.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f9ff759e640 1 -- 172.21.15.19:0/844585102 shutdown_connections 2024-09-12T01:56:17.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f9ff759e640 1 --2- 172.21.15.19:0/844585102 >> v2:172.21.15.19:3300/0 conn(0x7f9ff0050380 0x7f9ff00561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f9ff759e640 1 --2- 172.21.15.19:0/844585102 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ff00df7a0 0x7f9ff00080c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f9ff759e640 1 -- 172.21.15.19:0/844585102 >> 172.21.15.19:0/844585102 conn(0x7f9ff001ea40 msgr2=0x7f9ff00556b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f364affd640 1 -- 172.21.15.19:0/770394622 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1598172038 0 0) 0x7f364400c330 con 0x7f3644055ab0 2024-09-12T01:56:17.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f364affd640 1 -- 172.21.15.19:0/770394622 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36440df480 con 0x7f3644055ab0 2024-09-12T01:56:17.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7fdf608e6640 1 -- 172.21.15.19:0/2108600182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c0701a0 msgr2=0x7fdf5c06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7fdf608e6640 1 --2- 172.21.15.19:0/2108600182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c0701a0 0x7fdf5c06e940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c06c880 tx=0x7fdf5402ea70 comp rx=0 tx=0).stop 2024-09-12T01:56:17.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7fdf608e6640 1 -- 172.21.15.19:0/2108600182 shutdown_connections 2024-09-12T01:56:17.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7fdf608e6640 1 --2- 172.21.15.19:0/2108600182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c0701a0 0x7fdf5c06e940 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7fdf608e6640 1 --2- 172.21.15.19:0/2108600182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf5c0725f0 0x7fdf5c15e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7fdf608e6640 1 --2- 172.21.15.19:0/2108600182 >> v2:172.21.15.19:3300/0 conn(0x7fdf5c154a00 0x7fdf5c0720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7fdf608e6640 1 -- 172.21.15.19:0/2108600182 >> 172.21.15.19:0/2108600182 conn(0x7fdf5c067d70 msgr2=0x7fdf5c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7f22877fe640 1 -- 172.21.15.19:0/2412178394 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2280007740 con 0x7f228815a2c0 2024-09-12T01:56:17.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.326+0000 7f22877fe640 1 -- 172.21.15.19:0/2412178394 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22800078e0 con 0x7f228815a2c0 2024-09-12T01:56:17.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7f22877fe640 1 -- 172.21.15.19:0/2412178394 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2280007cb0 con 0x7f228815a2c0 2024-09-12T01:56:17.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7f228ee8d640 1 -- 172.21.15.19:0/2412178394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f228815a2c0 msgr2=0x7f22880cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7f228ee8d640 1 --2- 172.21.15.19:0/2412178394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f228815a2c0 0x7f22880cc9e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f228806c800 tx=0x7f228002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7fef39b78640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef3415a2e0 0x7fef34073900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7fef39b78640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fef3406e370 0x7fef3415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7fef39b78640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef3415e060 con 0x7fef340cfba0 2024-09-12T01:56:17.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7fef39b78640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fef3415e340 con 0x7fef3415a2e0 2024-09-12T01:56:17.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7fef39b78640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fef3415e620 con 0x7fef3406e370 2024-09-12T01:56:17.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7fef33fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fef3406e370 0x7fef3415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7fef33fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fef3406e370 0x7fef3415aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:57930/0 (socket says 172.21.15.19:57930) 2024-09-12T01:56:17.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7fef33fff640 1 -- 172.21.15.19:0/3324541588 learned_addr learned my addr 172.21.15.19:0/3324541588 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7fe4977fe640 1 --2- 172.21.15.19:0/4046971589 >> v2:172.21.15.19:3300/0 conn(0x7fe4980cf3a0 0x7fe4980cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7fe4967fc640 1 -- 172.21.15.19:0/4046971589 >> v2:172.21.15.19:3300/0 conn(0x7fe4980cf3a0 msgr2=0x7fe4980cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f364affd640 1 -- 172.21.15.19:0/770394622 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3910774813 0 0) 0x7f363c003520 con 0x7f3644033b50 2024-09-12T01:56:17.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f364affd640 1 -- 172.21.15.19:0/770394622 >> v2:172.21.15.19:3300/0 conn(0x7f36440df0a0 msgr2=0x7f3644039ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f364affd640 1 --2- 172.21.15.19:0/770394622 >> v2:172.21.15.19:3300/0 conn(0x7f36440df0a0 0x7f3644039ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f364affd640 1 -- 172.21.15.19:0/770394622 >> v1:172.21.15.135:6789/0 conn(0x7f3644055ab0 legacy=0x7f364403a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f9ff759e640 1 -- 172.21.15.19:0/844585102 shutdown_connections 2024-09-12T01:56:17.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7f228ee8d640 1 -- 172.21.15.19:0/2412178394 shutdown_connections 2024-09-12T01:56:17.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7f228ee8d640 1 --2- 172.21.15.19:0/2412178394 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22880720b0 0x7f2288072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7f228ee8d640 1 --2- 172.21.15.19:0/2412178394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f228815a2c0 0x7f22880cc9e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7f228ee8d640 1 -- 172.21.15.19:0/2412178394 >> 172.21.15.19:0/2412178394 conn(0x7f2288067b30 msgr2=0x7f228806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7f228ee8d640 1 -- 172.21.15.19:0/2412178394 shutdown_connections 2024-09-12T01:56:17.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7f228ee8d640 1 -- 172.21.15.19:0/2412178394 wait complete. 2024-09-12T01:56:17.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7fce51664640 1 -- 172.21.15.19:0/2977706682 >> v2:172.21.15.19:3300/0 conn(0x7fce4c0720b0 msgr2=0x7fce4c0cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7fce51664640 1 --2- 172.21.15.19:0/2977706682 >> v2:172.21.15.19:3300/0 conn(0x7fce4c0720b0 0x7fce4c0cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7fce51664640 1 -- 172.21.15.19:0/2977706682 >> v1:172.21.15.19:6789/0 conn(0x7fce4c072490 legacy=0x7fce4c0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.327+0000 7fce51664640 1 -- 172.21.15.19:0/2977706682 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4c0b34d0 con 0x7fce4c162ad0 2024-09-12T01:56:17.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7fef33fff640 1 -- 172.21.15.19:0/3324541588 >> v2:172.21.15.19:3300/0 conn(0x7fef3415a2e0 msgr2=0x7fef34073900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7fef33fff640 1 --2- 172.21.15.19:0/3324541588 >> v2:172.21.15.19:3300/0 conn(0x7fef3415a2e0 0x7fef34073900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7fef33fff640 1 -- 172.21.15.19:0/3324541588 >> v1:172.21.15.135:6789/0 conn(0x7fef340cfba0 legacy=0x7fef3406dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f364affd640 1 -- 172.21.15.19:0/770394622 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364400a6f0 con 0x7f3644033b50 2024-09-12T01:56:17.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f364affd640 1 -- 172.21.15.19:0/770394622 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f3638001670 con 0x7f3644033b50 2024-09-12T01:56:17.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f364affd640 1 -- 172.21.15.19:0/770394622 >> v1:172.21.15.19:6789/0 conn(0x7f3644033b50 legacy=0x7f3644007040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f364affd640 1 --2- 172.21.15.19:0/770394622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f363c003b40 0x7f363c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f364affd640 1 --2- 172.21.15.19:0/770394622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f363c004800 0x7f363c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7fef33fff640 1 -- 172.21.15.19:0/3324541588 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3415e900 con 0x7fef3406e370 2024-09-12T01:56:17.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f364affd640 1 --2- 172.21.15.19:0/770394622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f363c0051c0 0x7f363c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f364affd640 1 -- 172.21.15.19:0/770394622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f364400a410 con 0x7f363c003b40 2024-09-12T01:56:17.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f364affd640 1 -- 172.21.15.19:0/770394622 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f363c00bf00 con 0x7f363c004800 2024-09-12T01:56:17.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f364affd640 1 -- 172.21.15.19:0/770394622 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f363c00c100 con 0x7f363c0051c0 2024-09-12T01:56:17.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7fdf608e6640 1 -- 172.21.15.19:0/2108600182 shutdown_connections 2024-09-12T01:56:17.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f364b7fe640 1 --2- 172.21.15.19:0/770394622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f363c004800 0x7f363c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7fdf608e6640 1 -- 172.21.15.19:0/2108600182 wait complete. 2024-09-12T01:56:17.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7f9ff759e640 1 -- 172.21.15.19:0/844585102 wait complete. 2024-09-12T01:56:17.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7fe4967fc640 1 --2- 172.21.15.19:0/4046971589 >> v2:172.21.15.19:3300/0 conn(0x7fe4980cf3a0 0x7fe4980cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7fe4967fc640 1 -- 172.21.15.19:0/4046971589 >> v1:172.21.15.135:6789/0 conn(0x7fe498068c60 legacy=0x7fe4980720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7fe4967fc640 1 -- 172.21.15.19:0/4046971589 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4980b3ed0 con 0x7fe4980727f0 2024-09-12T01:56:17.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.328+0000 7fe4977fe640 1 --2- 172.21.15.19:0/4046971589 >> v2:172.21.15.19:3300/0 conn(0x7fe4980cf3a0 0x7fe4980cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:17.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.329+0000 7f18f3fff640 1 Processor -- start 2024-09-12T01:56:17.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.329+0000 7fef33fff640 1 --2- 172.21.15.19:0/3324541588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef3406e370 0x7fef3415aa20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fef3406c8f0 tx=0x7fef2c02e970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c83256d5a113fa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.329+0000 7fe4967fc640 1 --2- 172.21.15.19:0/4046971589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4980727f0 0x7fe49815a380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe4980b46a0 tx=0x7fe48c02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3859a4d4a94361ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.329+0000 7f228ee8d640 1 Processor -- start 2024-09-12T01:56:17.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.329+0000 7f18f3fff640 1 -- start start 2024-09-12T01:56:17.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.329+0000 7f364bfff640 1 --2- 172.21.15.19:0/770394622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f363c003b40 0x7f363c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.329+0000 7f3650a8e640 1 --2- 172.21.15.19:0/770394622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f363c0051c0 0x7f363c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.329+0000 7fef327fc640 1 -- 172.21.15.19:0/3324541588 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c0357e0 con 0x7fef3406e370 2024-09-12T01:56:17.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.329+0000 7f364bfff640 1 -- 172.21.15.19:0/770394622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f363c0051c0 msgr2=0x7f363c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.329+0000 7f364bfff640 1 --2- 172.21.15.19:0/770394622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f363c0051c0 0x7f363c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.329+0000 7f364bfff640 1 -- 172.21.15.19:0/770394622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f363c004800 msgr2=0x7f363c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.329+0000 7f364bfff640 1 --2- 172.21.15.19:0/770394622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f363c004800 0x7f363c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.329+0000 7f364bfff640 1 -- 172.21.15.19:0/770394622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363c003520 con 0x7f363c003b40 2024-09-12T01:56:17.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.329+0000 7fef327fc640 1 -- 172.21.15.19:0/3324541588 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c03b070 con 0x7fef3406e370 2024-09-12T01:56:17.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.329+0000 7fef327fc640 1 -- 172.21.15.19:0/3324541588 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c0357e0 con 0x7fef3406e370 2024-09-12T01:56:17.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.329+0000 7fe495ffb640 1 -- 172.21.15.19:0/4046971589 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c037070 con 0x7fe4980727f0 2024-09-12T01:56:17.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.330+0000 7f228ee8d640 1 -- start start 2024-09-12T01:56:17.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.330+0000 7f9ff759e640 1 Processor -- start 2024-09-12T01:56:17.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.330+0000 7fce51664640 1 --2- 172.21.15.19:0/2977706682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce4c162ad0 0x7fce4c06f6f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce4c072d20 tx=0x7fce3c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f02c975c3e7bab3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.330+0000 7fdf608e6640 1 Processor -- start 2024-09-12T01:56:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.330+0000 7fef39b78640 1 -- 172.21.15.19:0/3324541588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef3406e370 msgr2=0x7fef3415aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.330+0000 7fef39b78640 1 --2- 172.21.15.19:0/3324541588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef3406e370 0x7fef3415aa20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fef3406c8f0 tx=0x7fef2c02e970 comp rx=0 tx=0).stop 2024-09-12T01:56:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.330+0000 7f18f3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18ec036f20 0x7f18ec04a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.330+0000 7fe495ffb640 1 -- 172.21.15.19:0/4046971589 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe48c032440 con 0x7fe4980727f0 2024-09-12T01:56:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.330+0000 7fe49d398640 1 -- 172.21.15.19:0/4046971589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4980727f0 msgr2=0x7fe49815a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.330+0000 7f18f3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18ec049f20 0x7f18ec04cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.330+0000 7f3650a8e640 1 --2- 172.21.15.19:0/770394622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f363c0051c0 0x7f363c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.330+0000 7f3650a8e640 1 -- 172.21.15.19:0/770394622 reap_dead start 2024-09-12T01:56:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f364bfff640 1 --2- 172.21.15.19:0/770394622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f363c003b40 0x7f363c003f40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3640009be0 tx=0x7f363c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ce50608ec74f88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7fe495ffb640 1 -- 172.21.15.19:0/4046971589 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c037070 con 0x7fe4980727f0 2024-09-12T01:56:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f364b7fe640 1 --2- 172.21.15.19:0/770394622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f363c004800 0x7f363c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7fe49d398640 1 --2- 172.21.15.19:0/4046971589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4980727f0 0x7fe49815a380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe4980b46a0 tx=0x7fe48c02a1a0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.330+0000 7f18f3fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ec0e6fe0 0x7f18ec17cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.330+0000 7f18f3fff640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec038030 con 0x7f18ec049f20 2024-09-12T01:56:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.330+0000 7fdf608e6640 1 -- start start 2024-09-12T01:56:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f228ee8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22880720b0 0x7f2288145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.330+0000 7f18f3fff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec037d50 con 0x7f18ec036f20 2024-09-12T01:56:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.330+0000 7f18f3fff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f18ec007790 con 0x7f18ec0e6fe0 2024-09-12T01:56:17.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7fce50e63640 1 -- 172.21.15.19:0/2977706682 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c037070 con 0x7fce4c162ad0 2024-09-12T01:56:17.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f228ee8d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f228815a2c0 0x7f22880b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7fce50e63640 1 -- 172.21.15.19:0/2977706682 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce3c032440 con 0x7fce4c162ad0 2024-09-12T01:56:17.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7fce50e63640 1 -- 172.21.15.19:0/2977706682 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c032810 con 0x7fce4c162ad0 2024-09-12T01:56:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f228cc29640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22880720b0 0x7f2288145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f228cc29640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22880720b0 0x7f2288145ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42036/0 (socket says 172.21.15.19:42036) 2024-09-12T01:56:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f228cc29640 1 -- 172.21.15.19:0/598308833 learned_addr learned my addr 172.21.15.19:0/598308833 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f364affd640 1 -- 172.21.15.19:0/770394622 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640040070 con 0x7f363c003b40 2024-09-12T01:56:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.330+0000 7f9ff759e640 1 -- start start 2024-09-12T01:56:17.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f228ee8d640 1 --2- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f228815ea90 0x7f22880b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f364affd640 1 -- 172.21.15.19:0/770394622 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3640033790 con 0x7f363c003b40 2024-09-12T01:56:17.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f364affd640 1 -- 172.21.15.19:0/770394622 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36400097b0 con 0x7f363c003b40 2024-09-12T01:56:17.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f228ee8d640 1 -- 172.21.15.19:0/598308833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f22880cee80 con 0x7f22880720b0 2024-09-12T01:56:17.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f18f2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18ec036f20 0x7f18ec04a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f18f2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18ec036f20 0x7f18ec04a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:57940/0 (socket says 172.21.15.19:57940) 2024-09-12T01:56:17.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f18f2ffd640 1 -- 172.21.15.19:0/2373349318 learned_addr learned my addr 172.21.15.19:0/2373349318 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f18f2ffd640 1 -- 172.21.15.19:0/2373349318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ec0e6fe0 msgr2=0x7f18ec17cd00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:56:17.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f18f2ffd640 1 --2- 172.21.15.19:0/2373349318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ec0e6fe0 0x7f18ec17cd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f18f2ffd640 1 -- 172.21.15.19:0/2373349318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18ec049f20 msgr2=0x7f18ec04cc50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:56:17.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f18f2ffd640 1 --2- 172.21.15.19:0/2373349318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18ec049f20 0x7f18ec04cc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f18f2ffd640 1 -- 172.21.15.19:0/2373349318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ec0e1860 con 0x7f18ec036f20 2024-09-12T01:56:17.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f2287fff640 1 --2- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f228815a2c0 0x7f22880b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f228ee8d640 1 -- 172.21.15.19:0/598308833 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22880cf1f0 con 0x7f228815ea90 2024-09-12T01:56:17.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f228ee8d640 1 -- 172.21.15.19:0/598308833 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f22880ccf20 con 0x7f228815a2c0 2024-09-12T01:56:17.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f228d42a640 1 --2- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f228815ea90 0x7f22880b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fdf608e6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf5c0701a0 0x7fdf5c158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fdf608e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c0725f0 0x7fdf5c13eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f9ff759e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ff0050380 0x7f9ff00d5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f9ff759e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff0055dc0 0x7f9ff00334c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f9ff759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ff00df7a0 0x7f9ff0033a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.331+0000 7f18f2ffd640 1 --2- 172.21.15.19:0/2373349318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18ec036f20 0x7f18ec04a710 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00e810 tx=0x7f18dc00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fdf608e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf5c154a00 0x7fdf5c13f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f18eb7fe640 1 -- 172.21.15.19:0/2373349318 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc017070 con 0x7f18ec036f20 2024-09-12T01:56:17.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fdf608e6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c06ee80 con 0x7fdf5c154a00 2024-09-12T01:56:17.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f9ff759e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff00dfb80 con 0x7f9ff00df7a0 2024-09-12T01:56:17.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f9ff759e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff0008600 con 0x7f9ff0055dc0 2024-09-12T01:56:17.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f9ff759e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9ff0037130 con 0x7f9ff0050380 2024-09-12T01:56:17.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fef39b78640 1 -- 172.21.15.19:0/3324541588 shutdown_connections 2024-09-12T01:56:17.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fef39b78640 1 --2- 172.21.15.19:0/3324541588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef3406e370 0x7fef3415aa20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fef39b78640 1 --2- 172.21.15.19:0/3324541588 >> v2:172.21.15.19:3300/0 conn(0x7fef3415a2e0 0x7fef34073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fef39b78640 1 -- 172.21.15.19:0/3324541588 >> 172.21.15.19:0/3324541588 conn(0x7fef34067950 msgr2=0x7fef34067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f228d42a640 1 -- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f228815a2c0 msgr2=0x7f22880b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f228d42a640 1 --2- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f228815a2c0 0x7f22880b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f228d42a640 1 -- 172.21.15.19:0/598308833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22880720b0 msgr2=0x7f2288145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fef39b78640 1 -- 172.21.15.19:0/3324541588 shutdown_connections 2024-09-12T01:56:17.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f228d42a640 1 --2- 172.21.15.19:0/598308833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22880720b0 0x7f2288145ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f365128f640 1 -- 172.21.15.19:0/770394622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f363c003b40 msgr2=0x7f363c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f365128f640 1 --2- 172.21.15.19:0/770394622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f363c003b40 0x7f363c003f40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3640009be0 tx=0x7f363c005830 comp rx=0 tx=0).stop 2024-09-12T01:56:17.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f18eb7fe640 1 -- 172.21.15.19:0/2373349318 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18dc00c6d0 con 0x7f18ec036f20 2024-09-12T01:56:17.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f18eb7fe640 1 -- 172.21.15.19:0/2373349318 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc00f040 con 0x7f18ec036f20 2024-09-12T01:56:17.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f365128f640 1 -- 172.21.15.19:0/770394622 shutdown_connections 2024-09-12T01:56:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f365128f640 1 --2- 172.21.15.19:0/770394622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f363c003b40 0x7f363c003f40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f365128f640 1 -- 172.21.15.19:0/770394622 >> 172.21.15.19:0/770394622 conn(0x7f364401e1b0 msgr2=0x7f3644054e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f228d42a640 1 -- 172.21.15.19:0/598308833 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228814e840 con 0x7f228815ea90 2024-09-12T01:56:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f2287fff640 1 --2- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f228815a2c0 0x7f22880b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fe49d398640 1 -- 172.21.15.19:0/4046971589 shutdown_connections 2024-09-12T01:56:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fe49d398640 1 --2- 172.21.15.19:0/4046971589 >> v2:172.21.15.19:3300/0 conn(0x7fe4980cf3a0 0x7fe4980cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fe49d398640 1 --2- 172.21.15.19:0/4046971589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4980727f0 0x7fe49815a380 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fe49d398640 1 -- 172.21.15.19:0/4046971589 >> 172.21.15.19:0/4046971589 conn(0x7fe498067b30 msgr2=0x7fe49806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fdf608e6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c15b460 con 0x7fdf5c0725f0 2024-09-12T01:56:17.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fdf608e6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdf5c154de0 con 0x7fdf5c0701a0 2024-09-12T01:56:17.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f228cc29640 1 --2- 172.21.15.19:0/598308833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22880720b0 0x7f2288145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:17.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fdf5ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf5c154a00 0x7fdf5c13f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fdf5ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf5c154a00 0x7fdf5c13f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42044/0 (socket says 172.21.15.19:42044) 2024-09-12T01:56:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fdf5ad9d640 1 -- 172.21.15.19:0/691792943 learned_addr learned my addr 172.21.15.19:0/691792943 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fdf5a59c640 1 --2- 172.21.15.19:0/691792943 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf5c0701a0 0x7fdf5c158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fdf59d9b640 1 --2- 172.21.15.19:0/691792943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c0725f0 0x7fdf5c13eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f18f3fff640 1 -- 172.21.15.19:0/2373349318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18ec04d330 con 0x7f18ec036f20 2024-09-12T01:56:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f18f3fff640 1 -- 172.21.15.19:0/2373349318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18ec034840 con 0x7f18ec036f20 2024-09-12T01:56:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f9ff6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ff00df7a0 0x7f9ff0033a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f9ff6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ff00df7a0 0x7f9ff0033a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42048/0 (socket says 172.21.15.19:42048) 2024-09-12T01:56:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f9ff6d9d640 1 -- 172.21.15.19:0/763240890 learned_addr learned my addr 172.21.15.19:0/763240890 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f9ff659c640 1 --2- 172.21.15.19:0/763240890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ff0050380 0x7f9ff00d5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7f9ff5d9b640 1 --2- 172.21.15.19:0/763240890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff0055dc0 0x7f9ff00334c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7f9ff659c640 1 -- 172.21.15.19:0/763240890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff0055dc0 msgr2=0x7f9ff00334c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7f9ff659c640 1 --2- 172.21.15.19:0/763240890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff0055dc0 0x7f9ff00334c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7f9ff659c640 1 -- 172.21.15.19:0/763240890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ff00df7a0 msgr2=0x7f9ff0033a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7f9ff659c640 1 --2- 172.21.15.19:0/763240890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ff00df7a0 0x7f9ff0033a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7f9ff659c640 1 -- 172.21.15.19:0/763240890 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff0180280 con 0x7f9ff0050380 2024-09-12T01:56:17.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7fdf5ad9d640 1 -- 172.21.15.19:0/691792943 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf5c0701a0 msgr2=0x7fdf5c158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7fdf5ad9d640 1 --2- 172.21.15.19:0/691792943 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf5c0701a0 0x7fdf5c158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7fdf5ad9d640 1 -- 172.21.15.19:0/691792943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c0725f0 msgr2=0x7fdf5c13eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7fdf5ad9d640 1 --2- 172.21.15.19:0/691792943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c0725f0 0x7fdf5c13eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7fdf5ad9d640 1 -- 172.21.15.19:0/691792943 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5c0b28f0 con 0x7fdf5c154a00 2024-09-12T01:56:17.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7fce540c9640 1 -- 172.21.15.19:0/2977706682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce4c162ad0 msgr2=0x7fce4c06f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7fce540c9640 1 --2- 172.21.15.19:0/2977706682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce4c162ad0 0x7fce4c06f6f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce4c072d20 tx=0x7fce3c02a230 comp rx=0 tx=0).stop 2024-09-12T01:56:17.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7fce540c9640 1 -- 172.21.15.19:0/2977706682 shutdown_connections 2024-09-12T01:56:17.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7fce540c9640 1 --2- 172.21.15.19:0/2977706682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce4c162ad0 0x7fce4c06f6f0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce4c072d20 tx=0x7fce3c02a230 comp rx=0 tx=0).stop 2024-09-12T01:56:17.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7fce540c9640 1 --2- 172.21.15.19:0/2977706682 >> v2:172.21.15.19:3300/0 conn(0x7fce4c0720b0 0x7fce4c0cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7fce540c9640 1 -- 172.21.15.19:0/2977706682 >> 172.21.15.19:0/2977706682 conn(0x7fce4c067d70 msgr2=0x7fce4c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7f9ff659c640 1 --2- 172.21.15.19:0/763240890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ff0050380 0x7f9ff00d5ac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8004000 tx=0x7f9fe80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7f18f3fff640 1 -- 172.21.15.19:0/2373349318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f18ec0e73c0 con 0x7f18ec036f20 2024-09-12T01:56:17.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7fe49d398640 1 -- 172.21.15.19:0/4046971589 shutdown_connections 2024-09-12T01:56:17.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7fe49d398640 1 -- 172.21.15.19:0/4046971589 wait complete. 2024-09-12T01:56:17.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7fce540c9640 1 -- 172.21.15.19:0/2977706682 shutdown_connections 2024-09-12T01:56:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.333+0000 7fdf5ad9d640 1 --2- 172.21.15.19:0/691792943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf5c154a00 0x7fdf5c13f0d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf5402f060 tx=0x7fdf54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.334+0000 7fdf4affd640 1 -- 172.21.15.19:0/691792943 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5403f030 con 0x7fdf5c154a00 2024-09-12T01:56:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.334+0000 7fdf4affd640 1 -- 172.21.15.19:0/691792943 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf54032650 con 0x7fdf5c154a00 2024-09-12T01:56:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.334+0000 7fdf608e6640 1 -- 172.21.15.19:0/691792943 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf5c13f9f0 con 0x7fdf5c154a00 2024-09-12T01:56:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.334+0000 7fdf4affd640 1 -- 172.21.15.19:0/691792943 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54036050 con 0x7fdf5c154a00 2024-09-12T01:56:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.334+0000 7fdf608e6640 1 -- 172.21.15.19:0/691792943 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf5c13ffb0 con 0x7fdf5c154a00 2024-09-12T01:56:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.334+0000 7f9feeffd640 1 -- 172.21.15.19:0/763240890 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8041020 con 0x7f9ff0050380 2024-09-12T01:56:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.334+0000 7f9feeffd640 1 -- 172.21.15.19:0/763240890 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe8003bd0 con 0x7f9ff0050380 2024-09-12T01:56:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.334+0000 7f9feeffd640 1 -- 172.21.15.19:0/763240890 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8006040 con 0x7f9ff0050380 2024-09-12T01:56:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.332+0000 7fef39b78640 1 -- 172.21.15.19:0/3324541588 wait complete. 2024-09-12T01:56:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.334+0000 7fef39b78640 1 Processor -- start 2024-09-12T01:56:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.334+0000 7f18eb7fe640 1 -- 172.21.15.19:0/2373349318 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18dc01a070 con 0x7f18ec036f20 2024-09-12T01:56:17.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.335+0000 7f365128f640 1 -- 172.21.15.19:0/770394622 shutdown_connections 2024-09-12T01:56:17.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.335+0000 7f365128f640 1 -- 172.21.15.19:0/770394622 wait complete. 2024-09-12T01:56:17.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.335+0000 7fe49d398640 1 Processor -- start 2024-09-12T01:56:17.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.334+0000 7fce540c9640 1 -- 172.21.15.19:0/2977706682 wait complete. 2024-09-12T01:56:17.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.335+0000 7fce540c9640 1 Processor -- start 2024-09-12T01:56:17.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.336+0000 7fe49d398640 1 -- start start 2024-09-12T01:56:17.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.334+0000 7fef39b78640 1 -- start start 2024-09-12T01:56:17.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.336+0000 7f18eb7fe640 1 --2- 172.21.15.19:0/2373349318 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18d406be30 0x7f18d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.336+0000 7fef39b78640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef3406e370 0x7fef341515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.336+0000 7fef39b78640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef340cfba0 0x7fef3415d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.336+0000 7fef39b78640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef3415a2e0 0x7fef34203900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.336+0000 7f18eb7fe640 1 -- 172.21.15.19:0/2373349318 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f18dc08ad30 con 0x7f18ec036f20 2024-09-12T01:56:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.336+0000 7fef337fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef3406e370 0x7fef341515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.336+0000 7f18eb7fe640 1 --2- 172.21.15.19:0/2373349318 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7f18d40755b0 0x7f18d40779f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.336+0000 7f18eb7fe640 1 -- 172.21.15.19:0/2373349318 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f18dc001d30 con 0x7f18d40755b0 2024-09-12T01:56:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.336+0000 7f18eb7fe640 1 -- 172.21.15.19:0/2373349318 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f18dc08d390 con 0x7f18ec036f20 2024-09-12T01:56:17.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.336+0000 7fef337fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef3406e370 0x7fef341515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:57986/0 (socket says 172.21.15.19:57986) 2024-09-12T01:56:17.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.335+0000 7fdf608e6640 1 -- 172.21.15.19:0/691792943 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf5c0afde0 con 0x7fdf5c154a00 2024-09-12T01:56:17.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.336+0000 7fef32ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef340cfba0 0x7fef3415d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.336+0000 7f9ff759e640 1 -- 172.21.15.19:0/763240890 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff0180560 con 0x7f9ff0050380 2024-09-12T01:56:17.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.336+0000 7f228d42a640 1 --2- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f228815ea90 0x7f22880b2780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f227800d530 tx=0x7f227800d9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.336+0000 7fef32ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef340cfba0 0x7fef3415d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:42244/0 (socket says 172.21.15.19:42244) 2024-09-12T01:56:17.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.336+0000 7fef33fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef3415a2e0 0x7fef34203900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.336+0000 7f9ff759e640 1 -- 172.21.15.19:0/763240890 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff0180b20 con 0x7f9ff0050380 2024-09-12T01:56:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.335+0000 7fce540c9640 1 -- start start 2024-09-12T01:56:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7f18f37fe640 1 --2- 172.21.15.19:0/2373349318 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7f18d40755b0 0x7f18d40779f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7f365128f640 1 Processor -- start 2024-09-12T01:56:17.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fce540c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce4c0720b0 0x7fce4c157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7f22857fa640 1 -- 172.21.15.19:0/598308833 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22780125f0 con 0x7f228815ea90 2024-09-12T01:56:17.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7f22857fa640 1 -- 172.21.15.19:0/598308833 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2278019070 con 0x7f228815ea90 2024-09-12T01:56:17.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7f228ee8d640 1 -- 172.21.15.19:0/598308833 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228814eb20 con 0x7f228815ea90 2024-09-12T01:56:17.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7f22857fa640 1 -- 172.21.15.19:0/598308833 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22780125f0 con 0x7f228815ea90 2024-09-12T01:56:17.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7f228ee8d640 1 -- 172.21.15.19:0/598308833 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f228814f0e0 con 0x7f228815ea90 2024-09-12T01:56:17.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fe49d398640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe498068c60 0x7fe4981efd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7f365128f640 1 -- start start 2024-09-12T01:56:17.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fe49d398640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4980727f0 0x7fe4980a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fce540c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce4c072490 0x7fce4c158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fce51e65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce4c0720b0 0x7fce4c157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fce51e65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce4c0720b0 0x7fce4c157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42068/0 (socket says 172.21.15.19:42068) 2024-09-12T01:56:17.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fe49d398640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4980cf3a0 0x7fe4980abea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fdf4affd640 1 -- 172.21.15.19:0/691792943 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf54042030 con 0x7fdf5c154a00 2024-09-12T01:56:17.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fce51e65640 1 -- 172.21.15.19:0/1214780159 learned_addr learned my addr 172.21.15.19:0/1214780159 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fce540c9640 1 --2- 172.21.15.19:0/1214780159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce4c1638c0 0x7fce4c0b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fce540c9640 1 -- 172.21.15.19:0/1214780159 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c0b3d70 con 0x7fce4c0720b0 2024-09-12T01:56:17.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fce540c9640 1 -- 172.21.15.19:0/1214780159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c0b3a90 con 0x7fce4c1638c0 2024-09-12T01:56:17.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fce540c9640 1 -- 172.21.15.19:0/1214780159 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fce4c072900 con 0x7fce4c072490 2024-09-12T01:56:17.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fe496ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe498068c60 0x7fe4981efd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fe496ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe498068c60 0x7fe4981efd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42080/0 (socket says 172.21.15.19:42080) 2024-09-12T01:56:17.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fe496ffd640 1 -- 172.21.15.19:0/63123876 learned_addr learned my addr 172.21.15.19:0/63123876 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fe49d398640 1 -- 172.21.15.19:0/63123876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe4980cfd70 con 0x7fe498068c60 2024-09-12T01:56:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fe49d398640 1 -- 172.21.15.19:0/63123876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe4980d0100 con 0x7fe4980727f0 2024-09-12T01:56:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fe49d398640 1 -- 172.21.15.19:0/63123876 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe4980b49b0 con 0x7fe4980cf3a0 2024-09-12T01:56:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.337+0000 7fe4977fe640 1 --2- 172.21.15.19:0/63123876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4980cf3a0 0x7fe4980abea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.338+0000 7f18f37fe640 1 --2- 172.21.15.19:0/2373349318 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7f18d40755b0 0x7f18d40779f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.336+0000 7fef33fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef3415a2e0 0x7fef34203900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42060/0 (socket says 172.21.15.19:42060) 2024-09-12T01:56:17.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.338+0000 7fef337fe640 1 -- 172.21.15.19:0/2659633104 learned_addr learned my addr 172.21.15.19:0/2659633104 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.338+0000 7fef39b78640 1 -- 172.21.15.19:0/2659633104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fef34073e40 con 0x7fef3415a2e0 2024-09-12T01:56:17.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.338+0000 7fdf4affd640 1 --2- 172.21.15.19:0/691792943 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdf3c06be30 0x7fdf3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.338+0000 7fdf4affd640 1 -- 172.21.15.19:0/691792943 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fdf540abbd0 con 0x7fdf5c154a00 2024-09-12T01:56:17.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.338+0000 7fdf5a59c640 1 --2- 172.21.15.19:0/691792943 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdf3c06be30 0x7fdf3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.338+0000 7fdf4affd640 1 --2- 172.21.15.19:0/691792943 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x7fdf3c075520 0x7fdf3c077960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.338+0000 7fdf4affd640 1 -- 172.21.15.19:0/691792943 --> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf5402fe90 con 0x7fdf3c075520 2024-09-12T01:56:17.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.338+0000 7fdf4affd640 1 -- 172.21.15.19:0/691792943 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdf540abfc0 con 0x7fdf5c154a00 2024-09-12T01:56:17.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.338+0000 7fe496ffd640 1 -- 172.21.15.19:0/63123876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4980cf3a0 msgr2=0x7fe4980abea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.338+0000 7fe496ffd640 1 --2- 172.21.15.19:0/63123876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4980cf3a0 0x7fe4980abea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7f365128f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f363c003b40 0x7f36440d72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.338+0000 7fe496ffd640 1 -- 172.21.15.19:0/63123876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4980727f0 msgr2=0x7fe4980a9490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:56:17.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.338+0000 7fe496ffd640 1 --2- 172.21.15.19:0/63123876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4980727f0 0x7fe4980a9490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.338+0000 7fe496ffd640 1 -- 172.21.15.19:0/63123876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4980aac80 con 0x7fe498068c60 2024-09-12T01:56:17.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7f365128f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36440dd060 0x7f36440dd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7fdf59d9b640 1 --2- 172.21.15.19:0/691792943 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x7fdf3c075520 0x7fdf3c077960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7f364bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f363c003b40 0x7f36440d72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7f364bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f363c003b40 0x7f36440d72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:42260/0 (socket says 172.21.15.19:42260) 2024-09-12T01:56:17.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7f364bfff640 1 -- 172.21.15.19:0/890342195 learned_addr learned my addr 172.21.15.19:0/890342195 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7f364b7fe640 1 --2- 172.21.15.19:0/890342195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36440dd060 0x7f36440dd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7f365128f640 1 --2- 172.21.15.19:0/890342195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f364404db50 0x7f364404dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7fe496ffd640 1 --2- 172.21.15.19:0/63123876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe498068c60 0x7fe4981efd00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe49000cb10 tx=0x7fe49000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7f3650a8e640 1 --2- 172.21.15.19:0/890342195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f364404db50 0x7f364404dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7f9feeffd640 1 -- 172.21.15.19:0/763240890 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9fe8044020 con 0x7f9ff0050380 2024-09-12T01:56:17.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7fe47f7fe640 1 -- 172.21.15.19:0/63123876 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49000abb0 con 0x7fe498068c60 2024-09-12T01:56:17.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7fe49d398640 1 -- 172.21.15.19:0/63123876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4980a9be0 con 0x7fe498068c60 2024-09-12T01:56:17.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7f18f27fc640 1 --2- 172.21.15.19:0/2373349318 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18d406be30 0x7f18d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7f365128f640 1 -- 172.21.15.19:0/890342195 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f364400c0d0 con 0x7f364404db50 2024-09-12T01:56:17.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.338+0000 7fce52666640 1 --2- 172.21.15.19:0/1214780159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce4c1638c0 0x7fce4c0b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.338+0000 7fce51664640 1 --2- 172.21.15.19:0/1214780159 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce4c072490 0x7fce4c158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7fce52666640 1 -- 172.21.15.19:0/1214780159 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce4c072490 msgr2=0x7fce4c158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7fce52666640 1 --2- 172.21.15.19:0/1214780159 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce4c072490 0x7fce4c158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7f18eb7fe640 1 -- 172.21.15.19:0/2373349318 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f18dc001d30 con 0x7f18d40755b0 2024-09-12T01:56:17.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7fce52666640 1 -- 172.21.15.19:0/1214780159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce4c0720b0 msgr2=0x7fce4c157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7fce52666640 1 --2- 172.21.15.19:0/1214780159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce4c0720b0 0x7fce4c157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7fce52666640 1 -- 172.21.15.19:0/1214780159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4c1eb370 con 0x7fce4c1638c0 2024-09-12T01:56:17.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7fce52666640 1 --2- 172.21.15.19:0/1214780159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce4c1638c0 0x7fce4c0b06f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fce4400be20 tx=0x7fce4400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7f365128f640 1 -- 172.21.15.19:0/890342195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f364400bf50 con 0x7f36440dd060 2024-09-12T01:56:17.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7fce427fc640 1 -- 172.21.15.19:0/1214780159 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce44019070 con 0x7fce4c1638c0 2024-09-12T01:56:17.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7f365128f640 1 -- 172.21.15.19:0/890342195 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3644005da0 con 0x7f363c003b40 2024-09-12T01:56:17.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7fdf5a59c640 1 --2- 172.21.15.19:0/691792943 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdf3c06be30 0x7fdf3c06e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009a30 tx=0x7fdf4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7fe49d398640 1 -- 172.21.15.19:0/63123876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4980aa1a0 con 0x7fe498068c60 2024-09-12T01:56:17.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7fe47f7fe640 1 -- 172.21.15.19:0/63123876 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe490015070 con 0x7fe498068c60 2024-09-12T01:56:17.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.340+0000 7f364bfff640 1 -- 172.21.15.19:0/890342195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36440dd060 msgr2=0x7f36440dd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.340+0000 7f364bfff640 1 --2- 172.21.15.19:0/890342195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36440dd060 0x7f36440dd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.340+0000 7f364bfff640 1 -- 172.21.15.19:0/890342195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f364404db50 msgr2=0x7f364404dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.340+0000 7f364bfff640 1 --2- 172.21.15.19:0/890342195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f364404db50 0x7f364404dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.340+0000 7f364bfff640 1 -- 172.21.15.19:0/890342195 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364404be60 con 0x7f363c003b40 2024-09-12T01:56:17.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.340+0000 7f3650a8e640 1 --2- 172.21.15.19:0/890342195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f364404db50 0x7f364404dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:17.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.340+0000 7f9feeffd640 1 --2- 172.21.15.19:0/763240890 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9fd806be80 0x7f9fd806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.340+0000 7f364bfff640 1 --2- 172.21.15.19:0/890342195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f363c003b40 0x7f36440d72c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3640009c40 tx=0x7f3640004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.341+0000 7f3648ff9640 1 -- 172.21.15.19:0/890342195 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364004a020 con 0x7f363c003b40 2024-09-12T01:56:17.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.341+0000 7f9feeffd640 1 -- 172.21.15.19:0/763240890 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9fe80abc80 con 0x7f9ff0050380 2024-09-12T01:56:17.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.341+0000 7f9ff5d9b640 1 --2- 172.21.15.19:0/763240890 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9fd806be80 0x7f9fd806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.341+0000 7f9ff759e640 1 --2- 172.21.15.19:0/763240890 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x7f9ff00e1610 0x7f9ff00e19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.341+0000 7f9ff759e640 1 -- 172.21.15.19:0/763240890 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ff00e2270 con 0x7f9ff00e1610 2024-09-12T01:56:17.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.341+0000 7f3648ff9640 1 -- 172.21.15.19:0/890342195 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364003b640 con 0x7f363c003b40 2024-09-12T01:56:17.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.341+0000 7f3648ff9640 1 -- 172.21.15.19:0/890342195 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640040040 con 0x7f363c003b40 2024-09-12T01:56:17.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.341+0000 7fdf59d9b640 1 --2- 172.21.15.19:0/691792943 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x7fdf3c075520 0x7fdf3c077960 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.341+0000 7f365128f640 1 -- 172.21.15.19:0/890342195 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f364404c140 con 0x7f363c003b40 2024-09-12T01:56:17.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.341+0000 7f365128f640 1 -- 172.21.15.19:0/890342195 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f364404c700 con 0x7f363c003b40 2024-09-12T01:56:17.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.342+0000 7f9ff6d9d640 1 --2- 172.21.15.19:0/763240890 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x7f9ff00e1610 0x7f9ff00e19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.342+0000 7f365128f640 1 -- 172.21.15.19:0/890342195 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f364404e510 con 0x7f363c003b40 2024-09-12T01:56:17.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.342+0000 7fe47f7fe640 1 -- 172.21.15.19:0/63123876 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490011560 con 0x7fe498068c60 2024-09-12T01:56:17.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.342+0000 7fe47f7fe640 1 -- 172.21.15.19:0/63123876 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe4900117e0 con 0x7fe498068c60 2024-09-12T01:56:17.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.343+0000 7fe47f7fe640 1 --2- 172.21.15.19:0/63123876 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe48406bf30 0x7fe48406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7fce427fc640 1 -- 172.21.15.19:0/1214780159 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce44014440 con 0x7fce4c1638c0 2024-09-12T01:56:17.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.339+0000 7fce427fc640 1 -- 172.21.15.19:0/1214780159 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce44014870 con 0x7fce4c1638c0 2024-09-12T01:56:17.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.340+0000 7fce540c9640 1 -- 172.21.15.19:0/1214780159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce4c1eb650 con 0x7fce4c1638c0 2024-09-12T01:56:17.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.340+0000 7fce540c9640 1 -- 172.21.15.19:0/1214780159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce4c1ebc10 con 0x7fce4c1638c0 2024-09-12T01:56:17.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.341+0000 7fce540c9640 1 -- 172.21.15.19:0/1214780159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fce4c06f6f0 con 0x7fce4c1638c0 2024-09-12T01:56:17.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.343+0000 7fe47f7fe640 1 -- 172.21.15.19:0/63123876 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe49008f7b0 con 0x7fe498068c60 2024-09-12T01:56:17.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.343+0000 7fe4967fc640 1 --2- 172.21.15.19:0/63123876 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe48406bf30 0x7fe48406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.338+0000 7fef39b78640 1 -- 172.21.15.19:0/2659633104 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fef3415a6c0 con 0x7fef3406e370 2024-09-12T01:56:17.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.338+0000 7fef39b78640 1 -- 172.21.15.19:0/2659633104 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fef3406bcb0 con 0x7fef340cfba0 2024-09-12T01:56:17.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.343+0000 7fce427fc640 1 -- 172.21.15.19:0/1214780159 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce4401c070 con 0x7fce4c1638c0 2024-09-12T01:56:17.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.340+0000 7fef33fff640 1 -- 172.21.15.19:0/2659633104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef340cfba0 msgr2=0x7fef3415d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.343+0000 7f9ff6d9d640 1 --2- 172.21.15.19:0/763240890 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x7f9ff00e1610 0x7f9ff00e19f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.341+0000 7f228ee8d640 1 -- 172.21.15.19:0/598308833 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2268001030 con 0x7f228815ea90 2024-09-12T01:56:17.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.340+0000 7fef33fff640 1 --2- 172.21.15.19:0/2659633104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef340cfba0 0x7fef3415d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.340+0000 7fef33fff640 1 -- 172.21.15.19:0/2659633104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef3406e370 msgr2=0x7fef341515d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.340+0000 7fef33fff640 1 --2- 172.21.15.19:0/2659633104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef3406e370 0x7fef341515d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.340+0000 7fef33fff640 1 -- 172.21.15.19:0/2659633104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef340b11b0 con 0x7fef3415a2e0 2024-09-12T01:56:17.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.340+0000 7fef33fff640 1 --2- 172.21.15.19:0/2659633104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef3415a2e0 0x7fef34203900 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fef2c037000 tx=0x7fef2c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.341+0000 7fef1bfff640 1 -- 172.21.15.19:0/2659633104 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c0357e0 con 0x7fef3415a2e0 2024-09-12T01:56:17.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.341+0000 7fef1bfff640 1 -- 172.21.15.19:0/2659633104 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c044070 con 0x7fef3415a2e0 2024-09-12T01:56:17.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.341+0000 7fef1bfff640 1 -- 172.21.15.19:0/2659633104 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c036db0 con 0x7fef3415a2e0 2024-09-12T01:56:17.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.342+0000 7f22857fa640 1 -- 172.21.15.19:0/598308833 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2278012790 con 0x7f228815ea90 2024-09-12T01:56:17.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.342+0000 7f22857fa640 1 --2- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f227406c230 0x7f227406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.342+0000 7f228cc29640 1 --2- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f227406c230 0x7f227406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.343+0000 7f22857fa640 1 -- 172.21.15.19:0/598308833 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f227800f040 con 0x7f228815ea90 2024-09-12T01:56:17.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.343+0000 7f22857fa640 1 --2- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7f2274076500 0x7f22740789a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.341+0000 7fef39b78640 1 -- 172.21.15.19:0/2659633104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef340b0110 con 0x7fef3415a2e0 2024-09-12T01:56:17.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.342+0000 7fef39b78640 1 -- 172.21.15.19:0/2659633104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef340b06d0 con 0x7fef3415a2e0 2024-09-12T01:56:17.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.343+0000 7f22857fa640 1 -- 172.21.15.19:0/598308833 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2274079070 con 0x7f2274076500 2024-09-12T01:56:17.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.343+0000 7f22857fa640 1 -- 172.21.15.19:0/598308833 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2278055820 con 0x7f228815ea90 2024-09-12T01:56:17.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.343+0000 7f228cc29640 1 --2- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f227406c230 0x7f227406e6f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2280009bd0 tx=0x7f228002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.343+0000 7f2287fff640 1 --2- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7f2274076500 0x7f22740789a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.343+0000 7fef19ffb640 1 -- 172.21.15.19:0/2659633104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fef340b3130 con 0x7fef3415a2e0 2024-09-12T01:56:17.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.344+0000 7f3648ff9640 1 -- 172.21.15.19:0/890342195 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f364004d020 con 0x7f363c003b40 2024-09-12T01:56:17.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.344+0000 7fe49d398640 1 --2- 172.21.15.19:0/63123876 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x7fe478001650 0x7fe478003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.344+0000 7fe49d398640 1 -- 172.21.15.19:0/63123876 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe478006bb0 con 0x7fe478001650 2024-09-12T01:56:17.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.344+0000 7f18f27fc640 1 --2- 172.21.15.19:0/2373349318 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18d406be30 0x7f18d406e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f18ec03c1c0 tx=0x7f18e4006b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.344+0000 7fe4977fe640 1 --2- 172.21.15.19:0/63123876 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x7fe478001650 0x7fe478003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.344+0000 7fce427fc640 1 --2- 172.21.15.19:0/1214780159 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce3006bf00 0x7fce3006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.344+0000 7fe4967fc640 1 --2- 172.21.15.19:0/63123876 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe48406bf30 0x7fe48406e3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe48c034000 tx=0x7fe48c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.344+0000 7fef1bfff640 1 -- 172.21.15.19:0/2659633104 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef2c052430 con 0x7fef3415a2e0 2024-09-12T01:56:17.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7f9ff5d9b640 1 --2- 172.21.15.19:0/763240890 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9fd806be80 0x7f9fd806e340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0034170 tx=0x7f9fe0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.344+0000 7fdf4affd640 1 -- 172.21.15.19:0/691792943 <== osd.3 v2:172.21.15.19:6800/2581301650 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf5402fe90 con 0x7fdf3c075520 2024-09-12T01:56:17.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.344+0000 7fce427fc640 1 -- 172.21.15.19:0/1214780159 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fce4408b170 con 0x7fce4c1638c0 2024-09-12T01:56:17.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7fce427fc640 1 --2- 172.21.15.19:0/1214780159 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7fce30075680 0x7fce30077ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.344+0000 7f2287fff640 1 --2- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7f2274076500 0x7f22740789a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7fce427fc640 1 -- 172.21.15.19:0/1214780159 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fce44021e50 con 0x7fce30075680 2024-09-12T01:56:17.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7fce427fc640 1 -- 172.21.15.19:0/1214780159 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fce44092050 con 0x7fce4c1638c0 2024-09-12T01:56:17.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7f3648ff9640 1 --2- 172.21.15.19:0/890342195 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f363006bf00 0x7f363006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7f9feeffd640 1 -- 172.21.15.19:0/763240890 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ff00e2270 con 0x7f9ff00e1610 2024-09-12T01:56:17.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7fce51e65640 1 --2- 172.21.15.19:0/1214780159 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce3006bf00 0x7fce3006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7f3648ff9640 1 -- 172.21.15.19:0/890342195 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f36400b3c80 con 0x7f363c003b40 2024-09-12T01:56:17.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7fce51664640 1 --2- 172.21.15.19:0/1214780159 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7fce30075680 0x7fce30077ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7fef1bfff640 1 --2- 172.21.15.19:0/2659633104 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef2006be80 0x7fef2006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7f3648ff9640 1 --2- 172.21.15.19:0/890342195 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7f3630075680 0x7f3630077ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7f3648ff9640 1 -- 172.21.15.19:0/890342195 --> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f364004ee70 con 0x7f3630075680 2024-09-12T01:56:17.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7f3648ff9640 1 -- 172.21.15.19:0/890342195 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f36400b62e0 con 0x7f363c003b40 2024-09-12T01:56:17.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7fef1bfff640 1 -- 172.21.15.19:0/2659633104 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fef2c0acb40 con 0x7fef3415a2e0 2024-09-12T01:56:17.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7fef337fe640 1 --2- 172.21.15.19:0/2659633104 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef2006be80 0x7fef2006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7fef1bfff640 1 --2- 172.21.15.19:0/2659633104 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x7fef20075600 0x7fef20077a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7fef1bfff640 1 -- 172.21.15.19:0/2659633104 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef2c03cec0 con 0x7fef20075600 2024-09-12T01:56:17.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7fef1bfff640 1 -- 172.21.15.19:0/2659633104 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fef2c0ad020 con 0x7fef3415a2e0 2024-09-12T01:56:17.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7f22857fa640 1 -- 172.21.15.19:0/598308833 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2274079070 con 0x7f2274076500 2024-09-12T01:56:17.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.345+0000 7f3650a8e640 1 --2- 172.21.15.19:0/890342195 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7f3630075680 0x7f3630077ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.346+0000 7f364b7fe640 1 --2- 172.21.15.19:0/890342195 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f363006bf00 0x7f363006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.346+0000 7fce51664640 1 --2- 172.21.15.19:0/1214780159 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7fce30075680 0x7fce30077ac0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.346+0000 7fe4977fe640 1 --2- 172.21.15.19:0/63123876 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x7fe478001650 0x7fe478003b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.346+0000 7fef337fe640 1 --2- 172.21.15.19:0/2659633104 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef2006be80 0x7fef2006e340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fef340b5290 tx=0x7fef28006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.346+0000 7f364b7fe640 1 --2- 172.21.15.19:0/890342195 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f363006bf00 0x7f363006e3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f364c06aa80 tx=0x7f364c08d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.346+0000 7fef32ffd640 1 --2- 172.21.15.19:0/2659633104 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x7fef20075600 0x7fef20077a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.346+0000 7f3650a8e640 1 --2- 172.21.15.19:0/890342195 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7f3630075680 0x7f3630077ac0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.347+0000 7fce427fc640 1 -- 172.21.15.19:0/1214780159 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fce44021e50 con 0x7fce30075680 2024-09-12T01:56:17.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.347+0000 7fef32ffd640 1 --2- 172.21.15.19:0/2659633104 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x7fef20075600 0x7fef20077a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.347+0000 7fce51e65640 1 --2- 172.21.15.19:0/1214780159 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce3006bf00 0x7fce3006e3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fce48006fd0 tx=0x7fce48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.347+0000 7fe47f7fe640 1 -- 172.21.15.19:0/63123876 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe478006bb0 con 0x7fe478001650 2024-09-12T01:56:17.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.348+0000 7f3648ff9640 1 -- 172.21.15.19:0/890342195 <== osd.2 v2:172.21.15.19:6816/1297238899 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f364004ee70 con 0x7f3630075680 2024-09-12T01:56:17.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.348+0000 7fef1bfff640 1 -- 172.21.15.19:0/2659633104 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fef2c03cec0 con 0x7fef20075600 2024-09-12T01:56:17.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.371+0000 7f18f3fff640 1 -- 172.21.15.19:0/2373349318 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f18ec0e10d0 con 0x7f18d40755b0 2024-09-12T01:56:17.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.371+0000 7f18eb7fe640 1 -- 172.21.15.19:0/2373349318 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f18ec0e10d0 con 0x7f18d40755b0 2024-09-12T01:56:17.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.372+0000 7f18e97fa640 1 -- 172.21.15.19:0/2373349318 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7f18d40755b0 msgr2=0x7f18d40779f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.372+0000 7f18e97fa640 1 --2- 172.21.15.19:0/2373349318 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7f18d40755b0 0x7f18d40779f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.373+0000 7f18e97fa640 1 -- 172.21.15.19:0/2373349318 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18d406be30 msgr2=0x7f18d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.373+0000 7f18e97fa640 1 --2- 172.21.15.19:0/2373349318 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18d406be30 0x7f18d406e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f18ec03c1c0 tx=0x7f18e4006b50 comp rx=0 tx=0).stop 2024-09-12T01:56:17.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.373+0000 7f18e97fa640 1 -- 172.21.15.19:0/2373349318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18ec036f20 msgr2=0x7f18ec04a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.373+0000 7f18e97fa640 1 --2- 172.21.15.19:0/2373349318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18ec036f20 0x7f18ec04a710 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00e810 tx=0x7f18dc00ecd0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.373+0000 7f18f37fe640 1 -- 172.21.15.19:0/2373349318 reap_dead start 2024-09-12T01:56:17.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.373+0000 7f18e97fa640 1 -- 172.21.15.19:0/2373349318 shutdown_connections 2024-09-12T01:56:17.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.373+0000 7f18e97fa640 1 -- 172.21.15.19:0/2373349318 >> 172.21.15.19:0/2373349318 conn(0x7f18ec01fb10 msgr2=0x7f18ec004a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.373+0000 7f18e97fa640 1 -- 172.21.15.19:0/2373349318 shutdown_connections 2024-09-12T01:56:17.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.374+0000 7f18e97fa640 1 -- 172.21.15.19:0/2373349318 wait complete. 2024-09-12T01:56:17.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.374+0000 7fdf608e6640 1 -- 172.21.15.19:0/691792943 --> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf5c140180 con 0x7fdf3c075520 2024-09-12T01:56:17.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.375+0000 7fdf4affd640 1 -- 172.21.15.19:0/691792943 <== osd.3 v2:172.21.15.19:6800/2581301650 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdf5c140180 con 0x7fdf3c075520 2024-09-12T01:56:17.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.376+0000 7f228ee8d640 1 -- 172.21.15.19:0/598308833 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2268002dd0 con 0x7f2274076500 2024-09-12T01:56:17.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.376+0000 7fdf608e6640 1 -- 172.21.15.19:0/691792943 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x7fdf3c075520 msgr2=0x7fdf3c077960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.376+0000 7fdf608e6640 1 --2- 172.21.15.19:0/691792943 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x7fdf3c075520 0x7fdf3c077960 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.377+0000 7fdf608e6640 1 -- 172.21.15.19:0/691792943 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdf3c06be30 msgr2=0x7fdf3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.377+0000 7fdf608e6640 1 --2- 172.21.15.19:0/691792943 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdf3c06be30 0x7fdf3c06e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009a30 tx=0x7fdf4c008040 comp rx=0 tx=0).stop 2024-09-12T01:56:17.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.377+0000 7fdf608e6640 1 -- 172.21.15.19:0/691792943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf5c154a00 msgr2=0x7fdf5c13f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.377+0000 7fdf608e6640 1 --2- 172.21.15.19:0/691792943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf5c154a00 0x7fdf5c13f0d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf5402f060 tx=0x7fdf54004a40 comp rx=0 tx=0).stop 2024-09-12T01:56:17.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.377+0000 7fdf5ad9d640 1 -- 172.21.15.19:0/691792943 reap_dead start 2024-09-12T01:56:17.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.377+0000 7fdf608e6640 1 -- 172.21.15.19:0/691792943 shutdown_connections 2024-09-12T01:56:17.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.377+0000 7fdf608e6640 1 -- 172.21.15.19:0/691792943 >> 172.21.15.19:0/691792943 conn(0x7fdf5c067d70 msgr2=0x7fdf5c15bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.377+0000 7f22857fa640 1 -- 172.21.15.19:0/598308833 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2268002dd0 con 0x7f2274076500 2024-09-12T01:56:17.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.377+0000 7f9ff759e640 1 -- 172.21.15.19:0/763240890 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9ff00561c0 con 0x7f9ff00e1610 2024-09-12T01:56:17.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.377+0000 7fdf608e6640 1 -- 172.21.15.19:0/691792943 shutdown_connections 2024-09-12T01:56:17.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.377+0000 7fdf608e6640 1 -- 172.21.15.19:0/691792943 wait complete. 2024-09-12T01:56:17.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.378+0000 7f9feeffd640 1 -- 172.21.15.19:0/763240890 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9ff00561c0 con 0x7f9ff00e1610 2024-09-12T01:56:17.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.378+0000 7f365128f640 1 -- 172.21.15.19:0/890342195 --> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3644006130 con 0x7f3630075680 2024-09-12T01:56:17.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.378+0000 7f228ee8d640 1 -- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7f2274076500 msgr2=0x7f22740789a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.378+0000 7f228ee8d640 1 --2- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7f2274076500 0x7f22740789a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.378+0000 7f228ee8d640 1 -- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f227406c230 msgr2=0x7f227406e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.378+0000 7f228ee8d640 1 --2- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f227406c230 0x7f227406e6f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2280009bd0 tx=0x7f228002f000 comp rx=0 tx=0).stop 2024-09-12T01:56:17.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.378+0000 7f228ee8d640 1 -- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f228815ea90 msgr2=0x7f22880b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.378+0000 7f228ee8d640 1 --2- 172.21.15.19:0/598308833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f228815ea90 0x7f22880b2780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f227800d530 tx=0x7f227800d9f0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.378+0000 7f228d42a640 1 -- 172.21.15.19:0/598308833 reap_dead start 2024-09-12T01:56:17.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.378+0000 7f9ff759e640 1 -- 172.21.15.19:0/763240890 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x7f9ff00e1610 msgr2=0x7f9ff00e19f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.378+0000 7f3648ff9640 1 -- 172.21.15.19:0/890342195 <== osd.2 v2:172.21.15.19:6816/1297238899 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3644006130 con 0x7f3630075680 2024-09-12T01:56:17.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7f228ee8d640 1 -- 172.21.15.19:0/598308833 shutdown_connections 2024-09-12T01:56:17.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7f9ff759e640 1 --2- 172.21.15.19:0/763240890 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x7f9ff00e1610 0x7f9ff00e19f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7f228ee8d640 1 -- 172.21.15.19:0/598308833 >> 172.21.15.19:0/598308833 conn(0x7f2288067b30 msgr2=0x7f228815f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7fce540c9640 1 -- 172.21.15.19:0/1214780159 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fce4c1652e0 con 0x7fce30075680 2024-09-12T01:56:17.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7f9ff759e640 1 -- 172.21.15.19:0/763240890 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9fd806be80 msgr2=0x7f9fd806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7f9ff759e640 1 --2- 172.21.15.19:0/763240890 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9fd806be80 0x7f9fd806e340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0034170 tx=0x7f9fe0009040 comp rx=0 tx=0).stop 2024-09-12T01:56:17.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7f9ff759e640 1 -- 172.21.15.19:0/763240890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ff0050380 msgr2=0x7f9ff00d5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7f228ee8d640 1 -- 172.21.15.19:0/598308833 shutdown_connections 2024-09-12T01:56:17.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7f228ee8d640 1 -- 172.21.15.19:0/598308833 wait complete. 2024-09-12T01:56:17.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7f9ff759e640 1 --2- 172.21.15.19:0/763240890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ff0050380 0x7f9ff00d5ac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8004000 tx=0x7f9fe80046c0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7fe49d398640 1 -- 172.21.15.19:0/63123876 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe478005c90 con 0x7fe478001650 2024-09-12T01:56:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7f9ff6d9d640 1 -- 172.21.15.19:0/763240890 reap_dead start 2024-09-12T01:56:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7f9ff759e640 1 -- 172.21.15.19:0/763240890 shutdown_connections 2024-09-12T01:56:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7f9ff759e640 1 -- 172.21.15.19:0/763240890 >> 172.21.15.19:0/763240890 conn(0x7f9ff001ea40 msgr2=0x7f9ff0050810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7f365128f640 1 -- 172.21.15.19:0/890342195 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7f3630075680 msgr2=0x7f3630077ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7f365128f640 1 --2- 172.21.15.19:0/890342195 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7f3630075680 0x7f3630077ac0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7f9ff759e640 1 -- 172.21.15.19:0/763240890 shutdown_connections 2024-09-12T01:56:17.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7f9ff759e640 1 -- 172.21.15.19:0/763240890 wait complete. 2024-09-12T01:56:17.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7fce427fc640 1 -- 172.21.15.19:0/1214780159 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fce4c1652e0 con 0x7fce30075680 2024-09-12T01:56:17.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.379+0000 7fe47f7fe640 1 -- 172.21.15.19:0/63123876 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe478005c90 con 0x7fe478001650 2024-09-12T01:56:17.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7f365128f640 1 -- 172.21.15.19:0/890342195 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f363006bf00 msgr2=0x7f363006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7f365128f640 1 --2- 172.21.15.19:0/890342195 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f363006bf00 0x7f363006e3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f364c06aa80 tx=0x7f364c08d040 comp rx=0 tx=0).stop 2024-09-12T01:56:17.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7f365128f640 1 -- 172.21.15.19:0/890342195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f363c003b40 msgr2=0x7f36440d72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7f365128f640 1 --2- 172.21.15.19:0/890342195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f363c003b40 0x7f36440d72c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3640009c40 tx=0x7f3640004730 comp rx=0 tx=0).stop 2024-09-12T01:56:17.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7f3650a8e640 1 -- 172.21.15.19:0/890342195 reap_dead start 2024-09-12T01:56:17.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7f365128f640 1 -- 172.21.15.19:0/890342195 shutdown_connections 2024-09-12T01:56:17.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7f365128f640 1 -- 172.21.15.19:0/890342195 >> 172.21.15.19:0/890342195 conn(0x7f364401e1b0 msgr2=0x7f3644050ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7fef19ffb640 1 -- 172.21.15.19:0/2659633104 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fef340b3130 con 0x7fef20075600 2024-09-12T01:56:17.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7fe47d7fa640 1 -- 172.21.15.19:0/63123876 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x7fe478001650 msgr2=0x7fe478003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7fe47d7fa640 1 --2- 172.21.15.19:0/63123876 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x7fe478001650 0x7fe478003b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7f365128f640 1 -- 172.21.15.19:0/890342195 shutdown_connections 2024-09-12T01:56:17.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7f365128f640 1 -- 172.21.15.19:0/890342195 wait complete. 2024-09-12T01:56:17.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7fe47d7fa640 1 -- 172.21.15.19:0/63123876 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe48406bf30 msgr2=0x7fe48406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7fe47d7fa640 1 --2- 172.21.15.19:0/63123876 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe48406bf30 0x7fe48406e3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe48c034000 tx=0x7fe48c02e000 comp rx=0 tx=0).stop 2024-09-12T01:56:17.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7fe47d7fa640 1 -- 172.21.15.19:0/63123876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe498068c60 msgr2=0x7fe4981efd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7fe47d7fa640 1 --2- 172.21.15.19:0/63123876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe498068c60 0x7fe4981efd00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe49000cb10 tx=0x7fe49000cf10 comp rx=0 tx=0).stop 2024-09-12T01:56:17.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7fe4977fe640 1 -- 172.21.15.19:0/63123876 reap_dead start 2024-09-12T01:56:17.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7fef1bfff640 1 -- 172.21.15.19:0/2659633104 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fef340b3130 con 0x7fef20075600 2024-09-12T01:56:17.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7fce540c9640 1 -- 172.21.15.19:0/1214780159 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7fce30075680 msgr2=0x7fce30077ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.380+0000 7fce540c9640 1 --2- 172.21.15.19:0/1214780159 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7fce30075680 0x7fce30077ac0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fe47d7fa640 1 -- 172.21.15.19:0/63123876 shutdown_connections 2024-09-12T01:56:17.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fe47d7fa640 1 -- 172.21.15.19:0/63123876 >> 172.21.15.19:0/63123876 conn(0x7fe498067b30 msgr2=0x7fe49815d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fce540c9640 1 -- 172.21.15.19:0/1214780159 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce3006bf00 msgr2=0x7fce3006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fce540c9640 1 --2- 172.21.15.19:0/1214780159 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce3006bf00 0x7fce3006e3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fce48006fd0 tx=0x7fce48008040 comp rx=0 tx=0).stop 2024-09-12T01:56:17.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fce540c9640 1 -- 172.21.15.19:0/1214780159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce4c1638c0 msgr2=0x7fce4c0b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fce540c9640 1 --2- 172.21.15.19:0/1214780159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce4c1638c0 0x7fce4c0b06f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fce4400be20 tx=0x7fce4400bf10 comp rx=0 tx=0).stop 2024-09-12T01:56:17.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fe47d7fa640 1 -- 172.21.15.19:0/63123876 shutdown_connections 2024-09-12T01:56:17.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fce52666640 1 -- 172.21.15.19:0/1214780159 reap_dead start 2024-09-12T01:56:17.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fe47d7fa640 1 -- 172.21.15.19:0/63123876 wait complete. 2024-09-12T01:56:17.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fce540c9640 1 -- 172.21.15.19:0/1214780159 shutdown_connections 2024-09-12T01:56:17.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fce540c9640 1 -- 172.21.15.19:0/1214780159 >> 172.21.15.19:0/1214780159 conn(0x7fce4c067d70 msgr2=0x7fce4c161790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fce540c9640 1 -- 172.21.15.19:0/1214780159 shutdown_connections 2024-09-12T01:56:17.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fce540c9640 1 -- 172.21.15.19:0/1214780159 wait complete. 2024-09-12T01:56:17.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fef19ffb640 1 -- 172.21.15.19:0/2659633104 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x7fef20075600 msgr2=0x7fef20077a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fef19ffb640 1 --2- 172.21.15.19:0/2659633104 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x7fef20075600 0x7fef20077a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fef19ffb640 1 -- 172.21.15.19:0/2659633104 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef2006be80 msgr2=0x7fef2006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fef19ffb640 1 --2- 172.21.15.19:0/2659633104 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef2006be80 0x7fef2006e340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fef340b5290 tx=0x7fef28006f90 comp rx=0 tx=0).stop 2024-09-12T01:56:17.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fef19ffb640 1 -- 172.21.15.19:0/2659633104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef3415a2e0 msgr2=0x7fef34203900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fef19ffb640 1 --2- 172.21.15.19:0/2659633104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef3415a2e0 0x7fef34203900 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fef2c037000 tx=0x7fef2c004730 comp rx=0 tx=0).stop 2024-09-12T01:56:17.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.381+0000 7fef33fff640 1 -- 172.21.15.19:0/2659633104 reap_dead start 2024-09-12T01:56:17.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.382+0000 7fef19ffb640 1 -- 172.21.15.19:0/2659633104 shutdown_connections 2024-09-12T01:56:17.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.382+0000 7fef19ffb640 1 -- 172.21.15.19:0/2659633104 >> 172.21.15.19:0/2659633104 conn(0x7fef34067950 msgr2=0x7fef340b4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.382+0000 7fef19ffb640 1 -- 172.21.15.19:0/2659633104 shutdown_connections 2024-09-12T01:56:17.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.382+0000 7fef19ffb640 1 -- 172.21.15.19:0/2659633104 wait complete. 2024-09-12T01:56:17.440 INFO:teuthology.orchestra.run.smithi019.stdout:60129542154 2024-09-12T01:56:17.441 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T01:56:17.441 INFO:teuthology.orchestra.run.smithi019.stdout:60129542154 2024-09-12T01:56:17.442 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T01:56:17.442 INFO:teuthology.orchestra.run.smithi019.stdout:55834574859 2024-09-12T01:56:17.443 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T01:56:17.443 INFO:teuthology.orchestra.run.smithi019.stdout:64424509450 2024-09-12T01:56:17.444 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T01:56:17.444 INFO:teuthology.orchestra.run.smithi019.stdout:60129542154 2024-09-12T01:56:17.445 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T01:56:17.446 INFO:teuthology.orchestra.run.smithi019.stdout:60129542154 2024-09-12T01:56:17.446 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T01:56:17.447 INFO:teuthology.orchestra.run.smithi019.stdout:64424509450 2024-09-12T01:56:17.447 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T01:56:17.448 INFO:teuthology.orchestra.run.smithi019.stdout:64424509449 2024-09-12T01:56:17.448 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T01:56:17.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.657+0000 7f8c5005e640 1 Processor -- start 2024-09-12T01:56:17.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.657+0000 7f8c5005e640 1 -- start start 2024-09-12T01:56:17.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.659+0000 7f8c5005e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c480d1020 0x7f8c480d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.658+0000 7f69654c9640 1 Processor -- start 2024-09-12T01:56:17.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.658+0000 7f69654c9640 1 -- start start 2024-09-12T01:56:17.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.659+0000 7fb3b04d2640 1 Processor -- start 2024-09-12T01:56:17.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.659+0000 7fb3b04d2640 1 -- start start 2024-09-12T01:56:17.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.659+0000 7f8c5005e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c480c7560 0x7f8c4806cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.659+0000 7f8c5005e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c4806d510 con 0x7f8c4806e5b0 2024-09-12T01:56:17.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.659+0000 7f8c5005e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8c480d3410 con 0x7f8c480c7560 2024-09-12T01:56:17.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.659+0000 7f8c5005e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8c4806d7f0 con 0x7f8c480d1020 2024-09-12T01:56:17.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.659+0000 7f8c4e5fb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c480c7560 0x7f8c4806cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.659+0000 7f69654c9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f696015df90 0x7f69600ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.659+0000 7f69654c9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6960068c60 0x7f69600b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.659+0000 7f69654c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69600b5200 0x7f69600b5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.659+0000 7f69654c9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f696015a9c0 con 0x7f696015df90 2024-09-12T01:56:17.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.659+0000 7f69654c9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f69600cd1a0 con 0x7f6960068c60 2024-09-12T01:56:17.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.659+0000 7f69654c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f696006fff0 con 0x7f69600b5200 2024-09-12T01:56:17.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.659+0000 7f8c4e5fb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c480c7560 0x7f8c4806cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42090/0 (socket says 172.21.15.19:42090) 2024-09-12T01:56:17.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.659+0000 7f8c4e5fb640 1 -- 172.21.15.19:0/3588124617 learned_addr learned my addr 172.21.15.19:0/3588124617 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.660+0000 7f695e7fc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6960068c60 0x7f69600b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.660+0000 7f695e7fc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6960068c60 0x7f69600b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:58024/0 (socket says 172.21.15.19:58024) 2024-09-12T01:56:17.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.660+0000 7f695e7fc640 1 -- 172.21.15.19:0/74651654 learned_addr learned my addr 172.21.15.19:0/74651654 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.660+0000 7f695f7fe640 1 --2- 172.21.15.19:0/74651654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69600b5200 0x7f69600b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.660+0000 7f8c4ddfa640 1 --2- 172.21.15.19:0/3588124617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c480d1020 0x7f8c480d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.660+0000 7f8c4e5fb640 1 -- 172.21.15.19:0/3588124617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c480d1020 msgr2=0x7f8c480d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.660+0000 7f8c4e5fb640 1 --2- 172.21.15.19:0/3588124617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c480d1020 0x7f8c480d1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.660+0000 7f8c4e5fb640 1 -- 172.21.15.19:0/3588124617 >> v1:172.21.15.135:6789/0 conn(0x7f8c4806e5b0 legacy=0x7f8c480d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.660+0000 7f8c4e5fb640 1 -- 172.21.15.19:0/3588124617 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4806dad0 con 0x7f8c480c7560 2024-09-12T01:56:17.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.660+0000 7f695effd640 1 --2- 172.21.15.19:0/74651654 >> v2:172.21.15.19:3300/0 conn(0x7f696015df90 0x7f69600ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.660+0000 7f695f7fe640 1 -- 172.21.15.19:0/74651654 >> v2:172.21.15.135:3300/0 conn(0x7f6960068c60 msgr2=0x7f69600b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.660+0000 7f695f7fe640 1 --2- 172.21.15.19:0/74651654 >> v2:172.21.15.135:3300/0 conn(0x7f6960068c60 0x7f69600b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.660+0000 7f695f7fe640 1 -- 172.21.15.19:0/74651654 >> v2:172.21.15.19:3300/0 conn(0x7f696015df90 msgr2=0x7f69600ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.660+0000 7fefb359e640 1 Processor -- start 2024-09-12T01:56:17.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.660+0000 7fefb359e640 1 -- start start 2024-09-12T01:56:17.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.660+0000 7fb3b04d2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3a80afde0 0x7fb3a815d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.661+0000 7fb3b04d2640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3a815d7d0 con 0x7fb3a80b65f0 2024-09-12T01:56:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.661+0000 7fb3b04d2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3a806ec10 con 0x7fb3a806e6e0 2024-09-12T01:56:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.661+0000 7fb3b04d2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a806fd60 con 0x7fb3a80afde0 2024-09-12T01:56:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.661+0000 7f264d227640 1 Processor -- start 2024-09-12T01:56:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.660+0000 7f695f7fe640 1 --2- 172.21.15.19:0/74651654 >> v2:172.21.15.19:3300/0 conn(0x7f696015df90 0x7f69600ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.660+0000 7f695f7fe640 1 -- 172.21.15.19:0/74651654 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696015e700 con 0x7f69600b5200 2024-09-12T01:56:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.661+0000 7f695effd640 1 --2- 172.21.15.19:0/74651654 >> v2:172.21.15.19:3300/0 conn(0x7f696015df90 0x7f69600ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:17.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.661+0000 7f7dcf02b640 1 Processor -- start 2024-09-12T01:56:17.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.661+0000 7f7dcf02b640 1 -- start start 2024-09-12T01:56:17.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.661+0000 7f8c4e5fb640 1 --2- 172.21.15.19:0/3588124617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c480c7560 0x7f8c4806cd10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8c44009ad0 tx=0x7f8c4402a3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b7fef050a680f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.661+0000 7fb3ada6d640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fb3a806e6e0 0x7fb3a80b5ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:41820/0 (socket says 172.21.15.19:41820) 2024-09-12T01:56:17.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.661+0000 7fb3ada6d640 1 -- 172.21.15.19:0/3252013066 learned_addr learned my addr 172.21.15.19:0/3252013066 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:17.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.661+0000 7fb3ae26e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3a80afde0 0x7fb3a815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7f09afbb7640 1 Processor -- start 2024-09-12T01:56:17.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7f695f7fe640 1 --2- 172.21.15.19:0/74651654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69600b5200 0x7f69600b5690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f69600b0370 tx=0x7f695802ea70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab3f0af942d953d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.661+0000 7fb3aea6f640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb3a80b65f0 0x7fb3a815dc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44822/0 (socket says 172.21.15.19:44822) 2024-09-12T01:56:17.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7fefb359e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fefac053600 0x7fefac0eb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7fefb359e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefac0575d0 con 0x7fefac0e1860 2024-09-12T01:56:17.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7fb3ad26c640 1 -- 172.21.15.19:0/3252013066 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3996768032 0 0) 0x7fb3a806ec10 con 0x7fb3a806e6e0 2024-09-12T01:56:17.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7fb3ad26c640 1 -- 172.21.15.19:0/3252013066 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb394003520 con 0x7fb3a806e6e0 2024-09-12T01:56:17.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7fefb259c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fefac0e1860 0x7fefac056ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44830/0 (socket says 172.21.15.19:44830) 2024-09-12T01:56:17.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7fefb259c640 1 -- 172.21.15.19:0/513292694 learned_addr learned my addr 172.21.15.19:0/513292694 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:17.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7fefb359e640 1 -- 172.21.15.19:0/513292694 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefac0516f0 con 0x7fefac0524b0 2024-09-12T01:56:17.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7fefb359e640 1 -- 172.21.15.19:0/513292694 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fefac052020 con 0x7fefac053600 2024-09-12T01:56:17.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7fefb2d9d640 1 --2- 172.21.15.19:0/513292694 >> v2:172.21.15.19:3300/0 conn(0x7fefac053600 0x7fefac0eb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7fb3ad26c640 1 -- 172.21.15.19:0/3252013066 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 193288104 0 0) 0x7fb3a0001490 con 0x7fb3a80b65f0 2024-09-12T01:56:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7fb3ad26c640 1 -- 172.21.15.19:0/3252013066 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3a806ec10 con 0x7fb3a80b65f0 2024-09-12T01:56:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7fb3ad26c640 1 -- 172.21.15.19:0/3252013066 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3654025245 0 0) 0x7fb394003520 con 0x7fb3a806e6e0 2024-09-12T01:56:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7fb3ad26c640 1 -- 172.21.15.19:0/3252013066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3a80afde0 msgr2=0x7fb3a815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7fb3ad26c640 1 --2- 172.21.15.19:0/3252013066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3a80afde0 0x7fb3a815d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7fb3ad26c640 1 -- 172.21.15.19:0/3252013066 >> v1:172.21.15.19:6789/0 conn(0x7fb3a80b65f0 legacy=0x7fb3a815dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7fb3ad26c640 1 -- 172.21.15.19:0/3252013066 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a80b5cf0 con 0x7fb3a806e6e0 2024-09-12T01:56:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7f3da571f640 1 Processor -- start 2024-09-12T01:56:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7f3da571f640 1 -- start start 2024-09-12T01:56:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f7dcf02b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7dc00345e0 0x7f7dc003a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f7dcf02b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dc00542c0 con 0x7f7dc003afe0 2024-09-12T01:56:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f7dcf02b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dc00350b0 con 0x7f7dc0036a00 2024-09-12T01:56:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f7dcf02b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f7dc0036f00 con 0x7f7dc00345e0 2024-09-12T01:56:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7fb3ad26c640 1 -- 172.21.15.19:0/3252013066 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fb3a4001670 con 0x7fb3a806e6e0 2024-09-12T01:56:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7fb3ad26c640 1 -- 172.21.15.19:0/3252013066 >> v1:172.21.15.135:6789/0 conn(0x7fb3a806e6e0 legacy=0x7fb3a80b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7fb3ad26c640 1 --2- 172.21.15.19:0/3252013066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb394003b40 0x7fb394003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7fb3ad26c640 1 --2- 172.21.15.19:0/3252013066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb394004800 0x7fb394004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7fb3ad26c640 1 --2- 172.21.15.19:0/3252013066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3940051c0 0x7fb39400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f695dffb640 1 -- 172.21.15.19:0/74651654 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6958036070 con 0x7f69600b5200 2024-09-12T01:56:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7f264d227640 1 -- start start 2024-09-12T01:56:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f264d227640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2648162710 0x7f264806dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f264d227640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f264806e1a0 0x7f26480732b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f264d227640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f26480737f0 0x7f2648071c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f264d227640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2648166290 con 0x7f26480737f0 2024-09-12T01:56:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f264d227640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f264806e5e0 con 0x7f264806e1a0 2024-09-12T01:56:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f264d227640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f26480cdb20 con 0x7f2648162710 2024-09-12T01:56:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f3da571f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3da006e680 0x7f3da015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f3da571f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da015b090 0x7f3da0072b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f3da571f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da0072620 con 0x7f3da006fdc0 2024-09-12T01:56:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f695dffb640 1 -- 172.21.15.19:0/74651654 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f695800d4e0 con 0x7f69600b5200 2024-09-12T01:56:17.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f3da571f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f3da00b4240 con 0x7f3da006e680 2024-09-12T01:56:17.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f3da571f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3da006ebf0 con 0x7f3da015b090 2024-09-12T01:56:17.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7fb3ad26c640 1 -- 172.21.15.19:0/3252013066 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a806fd60 con 0x7fb394003b40 2024-09-12T01:56:17.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7fb3ad26c640 1 -- 172.21.15.19:0/3252013066 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb39400bf80 con 0x7fb3940051c0 2024-09-12T01:56:17.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f2646d9d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2648162710 0x7f264806dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f264659c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f264806e1a0 0x7f26480732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f3d9ffff640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f3da006fdc0 0x7f3da00b3b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:41850/0 (socket says 172.21.15.19:41850) 2024-09-12T01:56:17.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f7dce029640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7dc00345e0 0x7f7dc003a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f7dce82a640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7dc003afe0 0x7f7dc00ea790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44834/0 (socket says 172.21.15.19:44834) 2024-09-12T01:56:17.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7f7dce82a640 1 -- 172.21.15.19:0/1417256479 learned_addr learned my addr 172.21.15.19:0/1417256479 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:17.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7fb3ad26c640 1 -- 172.21.15.19:0/3252013066 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb39400c180 con 0x7fb394004800 2024-09-12T01:56:17.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f3da4f1e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da015b090 0x7f3da0072b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f3da4f1e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da015b090 0x7f3da0072b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:42316/0 (socket says 172.21.15.19:42316) 2024-09-12T01:56:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f7dce029640 1 -- 172.21.15.19:0/1417256479 >> v1:172.21.15.135:6789/0 conn(0x7f7dc0036a00 legacy=0x7f7dc003a8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:56:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7fefb159a640 1 -- 172.21.15.19:0/513292694 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 916633532 0 0) 0x7fefac0575d0 con 0x7fefac0e1860 2024-09-12T01:56:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7fefb159a640 1 -- 172.21.15.19:0/513292694 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef9c003520 con 0x7fefac0e1860 2024-09-12T01:56:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7fefb2d9d640 1 -- 172.21.15.19:0/513292694 >> v1:172.21.15.135:6789/0 conn(0x7fefac0524b0 legacy=0x7fefac052ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:56:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7fefb2d9d640 1 -- 172.21.15.19:0/513292694 >> v1:172.21.15.19:6789/0 conn(0x7fefac0e1860 legacy=0x7fefac056ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.663+0000 7fefb2d9d640 1 -- 172.21.15.19:0/513292694 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefac0519d0 con 0x7fefac053600 2024-09-12T01:56:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.662+0000 7f09afbb7640 1 -- start start 2024-09-12T01:56:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f09afbb7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f09a80b5910 0x7f09a80ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f09afbb7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a815e420 con 0x7f09a8157ed0 2024-09-12T01:56:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f09afbb7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a815e700 con 0x7f09a815df90 2024-09-12T01:56:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f09afbb7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f09a8070020 con 0x7f09a80b5910 2024-09-12T01:56:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f3da4f1e640 1 -- 172.21.15.19:0/1831891155 learned_addr learned my addr 172.21.15.19:0/1831891155 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f7dce029640 1 -- 172.21.15.19:0/1417256479 >> v1:172.21.15.19:6789/0 conn(0x7f7dc003afe0 legacy=0x7f7dc00ea790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f695dffb640 1 -- 172.21.15.19:0/74651654 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695800b960 con 0x7f69600b5200 2024-09-12T01:56:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f7dce029640 1 -- 172.21.15.19:0/1417256479 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc00e6580 con 0x7f7dc00345e0 2024-09-12T01:56:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f264759e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f26480737f0 0x7f2648071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f264759e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f26480737f0 0x7f2648071c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42134/0 (socket says 172.21.15.19:42134) 2024-09-12T01:56:17.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f264759e640 1 -- 172.21.15.19:0/3711951740 learned_addr learned my addr 172.21.15.19:0/3711951740 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7fb3aea6f640 1 --2- 172.21.15.19:0/3252013066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3940051c0 0x7fb39400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7fb3ada6d640 1 --2- 172.21.15.19:0/3252013066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb394004800 0x7fb394004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f3d97fff640 1 --2- 172.21.15.19:0/1831891155 >> v2:172.21.15.19:3300/0 conn(0x7f3da006e680 0x7f3da015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7fefb2d9d640 1 --2- 172.21.15.19:0/513292694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefac053600 0x7fefac0eb740 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fefa80097d0 tx=0x7fefa802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3d173cea8ea8fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f264759e640 1 -- 172.21.15.19:0/3711951740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2648162710 msgr2=0x7f264806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f264759e640 1 --2- 172.21.15.19:0/3711951740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2648162710 0x7f264806dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f264759e640 1 -- 172.21.15.19:0/3711951740 >> v2:172.21.15.135:3300/0 conn(0x7f264806e1a0 msgr2=0x7f26480732b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f264759e640 1 --2- 172.21.15.19:0/3711951740 >> v2:172.21.15.135:3300/0 conn(0x7f264806e1a0 0x7f26480732b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f264759e640 1 -- 172.21.15.19:0/3711951740 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2648162af0 con 0x7f26480737f0 2024-09-12T01:56:17.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f09ad152640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f09a815df90 0x7f09a80b5200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:41862/0 (socket says 172.21.15.19:41862) 2024-09-12T01:56:17.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f09ad152640 1 -- 172.21.15.19:0/3616436902 learned_addr learned my addr 172.21.15.19:0/3616436902 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:17.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7f09ac951640 1 -- 172.21.15.19:0/3616436902 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 752975391 0 0) 0x7f09a815e420 con 0x7f09a8157ed0 2024-09-12T01:56:17.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7f09ae154640 1 --2- 172.21.15.19:0/3616436902 >> v2:172.21.15.135:3300/0 conn(0x7f09a80b5910 0x7f09a80ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7f09ac951640 1 -- 172.21.15.19:0/3616436902 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0994003500 con 0x7f09a8157ed0 2024-09-12T01:56:17.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7f09ac951640 1 -- 172.21.15.19:0/3616436902 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1693915828 0 0) 0x7f09a815e700 con 0x7f09a815df90 2024-09-12T01:56:17.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7f09ac951640 1 -- 172.21.15.19:0/3616436902 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09a815e420 con 0x7f09a815df90 2024-09-12T01:56:17.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7f09ae154640 1 -- 172.21.15.19:0/3616436902 >> v1:172.21.15.135:6789/0 conn(0x7f09a815df90 legacy=0x7f09a80b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f69654c9640 1 -- 172.21.15.19:0/74651654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69600b5200 msgr2=0x7f69600b5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f69654c9640 1 --2- 172.21.15.19:0/74651654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69600b5200 0x7f69600b5690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f69600b0370 tx=0x7f695802ea70 comp rx=0 tx=0).stop 2024-09-12T01:56:17.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f69654c9640 1 -- 172.21.15.19:0/74651654 shutdown_connections 2024-09-12T01:56:17.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f69654c9640 1 --2- 172.21.15.19:0/74651654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69600b5200 0x7f69600b5690 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f69654c9640 1 --2- 172.21.15.19:0/74651654 >> v2:172.21.15.135:3300/0 conn(0x7f6960068c60 0x7f69600b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f69654c9640 1 --2- 172.21.15.19:0/74651654 >> v2:172.21.15.19:3300/0 conn(0x7f696015df90 0x7f69600ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f69654c9640 1 -- 172.21.15.19:0/74651654 >> 172.21.15.19:0/74651654 conn(0x7f696006bc10 msgr2=0x7f696006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7f69654c9640 1 -- 172.21.15.19:0/74651654 shutdown_connections 2024-09-12T01:56:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f8c4cdf8640 1 -- 172.21.15.19:0/3588124617 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44037070 con 0x7f8c480c7560 2024-09-12T01:56:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f8c4cdf8640 1 -- 172.21.15.19:0/3588124617 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c44032440 con 0x7f8c480c7560 2024-09-12T01:56:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f8c4cdf8640 1 -- 172.21.15.19:0/3588124617 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44032810 con 0x7f8c480c7560 2024-09-12T01:56:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7f8c5005e640 1 -- 172.21.15.19:0/3588124617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c480c7560 msgr2=0x7f8c4806cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7f8c5005e640 1 --2- 172.21.15.19:0/3588124617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c480c7560 0x7f8c4806cd10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8c44009ad0 tx=0x7f8c4402a3e0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7f8c5005e640 1 -- 172.21.15.19:0/3588124617 shutdown_connections 2024-09-12T01:56:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7f8c5005e640 1 --2- 172.21.15.19:0/3588124617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c480c7560 0x7f8c4806cd10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7f8c5005e640 1 --2- 172.21.15.19:0/3588124617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c480d1020 0x7f8c480d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7f8c5005e640 1 -- 172.21.15.19:0/3588124617 >> 172.21.15.19:0/3588124617 conn(0x7f8c4809d850 msgr2=0x7f8c4808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f3da4f1e640 1 -- 172.21.15.19:0/1831891155 >> v2:172.21.15.19:3300/0 conn(0x7f3da006e680 msgr2=0x7f3da015ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f3da4f1e640 1 --2- 172.21.15.19:0/1831891155 >> v2:172.21.15.19:3300/0 conn(0x7f3da006e680 0x7f3da015ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f3da4f1e640 1 -- 172.21.15.19:0/1831891155 >> v1:172.21.15.135:6789/0 conn(0x7f3da006fdc0 legacy=0x7f3da00b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7f3da4f1e640 1 -- 172.21.15.19:0/1831891155 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da006eed0 con 0x7f3da015b090 2024-09-12T01:56:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7fb3ae26e640 1 --2- 172.21.15.19:0/3252013066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb394003b40 0x7fb394003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7fb3aea6f640 1 -- 172.21.15.19:0/3252013066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb394004800 msgr2=0x7fb394004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7fb3aea6f640 1 --2- 172.21.15.19:0/3252013066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb394004800 0x7fb394004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7fb3aea6f640 1 -- 172.21.15.19:0/3252013066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb394003b40 msgr2=0x7fb394003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7fb3aea6f640 1 --2- 172.21.15.19:0/3252013066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb394003b40 0x7fb394003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7fb3aea6f640 1 -- 172.21.15.19:0/3252013066 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb394003520 con 0x7fb3940051c0 2024-09-12T01:56:17.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7fefb159a640 1 -- 172.21.15.19:0/513292694 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8037070 con 0x7fefac053600 2024-09-12T01:56:17.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7fefb159a640 1 -- 172.21.15.19:0/513292694 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa8032440 con 0x7fefac053600 2024-09-12T01:56:17.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.664+0000 7fefb159a640 1 -- 172.21.15.19:0/513292694 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8032810 con 0x7fefac053600 2024-09-12T01:56:17.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7fefb359e640 1 -- 172.21.15.19:0/513292694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefac053600 msgr2=0x7fefac0eb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7fefb359e640 1 --2- 172.21.15.19:0/513292694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefac053600 0x7fefac0eb740 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fefa80097d0 tx=0x7fefa802a210 comp rx=0 tx=0).stop 2024-09-12T01:56:17.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7f264759e640 1 --2- 172.21.15.19:0/3711951740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26480737f0 0x7f2648071c30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2648070140 tx=0x7f264002a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4681955730e1ff11 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7f09ac951640 1 -- 172.21.15.19:0/3616436902 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2003800386 0 0) 0x7f0994003500 con 0x7f09a8157ed0 2024-09-12T01:56:17.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7f09ae154640 1 -- 172.21.15.19:0/3616436902 >> v1:172.21.15.19:6789/0 conn(0x7f09a8157ed0 legacy=0x7f09a80b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.665+0000 7f09ae154640 1 -- 172.21.15.19:0/3616436902 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a815e9e0 con 0x7f09a80b5910 2024-09-12T01:56:17.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.666+0000 7f7dce029640 1 --2- 172.21.15.19:0/1417256479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc00345e0 0x7f7dc003a390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7dc806a6a0 tx=0x7f7dc80a6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8da651df0e30399 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.666+0000 7f69654c9640 1 -- 172.21.15.19:0/74651654 wait complete. 2024-09-12T01:56:17.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.666+0000 7fefb359e640 1 -- 172.21.15.19:0/513292694 shutdown_connections 2024-09-12T01:56:17.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.666+0000 7f3da4f1e640 1 --2- 172.21.15.19:0/1831891155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da015b090 0x7f3da0072b00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009e50 tx=0x7f3d9802a7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bad33e3c1a020f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.666+0000 7f7dcd027640 1 -- 172.21.15.19:0/1417256479 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc80b3070 con 0x7f7dc00345e0 2024-09-12T01:56:17.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.666+0000 7f7dcd027640 1 -- 172.21.15.19:0/1417256479 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc80a6e50 con 0x7f7dc00345e0 2024-09-12T01:56:17.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.666+0000 7f7dcd027640 1 -- 172.21.15.19:0/1417256479 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc80ae640 con 0x7f7dc00345e0 2024-09-12T01:56:17.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.666+0000 7fefb359e640 1 --2- 172.21.15.19:0/513292694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefac053600 0x7fefac0eb740 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.666+0000 7fefb359e640 1 -- 172.21.15.19:0/513292694 >> 172.21.15.19:0/513292694 conn(0x7fefac01fb40 msgr2=0x7fefac0567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.666+0000 7fefb359e640 1 -- 172.21.15.19:0/513292694 shutdown_connections 2024-09-12T01:56:17.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.666+0000 7fefb359e640 1 -- 172.21.15.19:0/513292694 wait complete. 2024-09-12T01:56:17.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.666+0000 7f2645d9b640 1 -- 172.21.15.19:0/3711951740 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2640036070 con 0x7f26480737f0 2024-09-12T01:56:17.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.666+0000 7f2645d9b640 1 -- 172.21.15.19:0/3711951740 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2640031600 con 0x7f26480737f0 2024-09-12T01:56:17.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.666+0000 7f2645d9b640 1 -- 172.21.15.19:0/3711951740 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26400319d0 con 0x7f26480737f0 2024-09-12T01:56:17.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.666+0000 7fb3aea6f640 1 --2- 172.21.15.19:0/3252013066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3940051c0 0x7fb39400b9c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8072620 tx=0x7fb394005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=babb0789aeee989f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.666+0000 7f3d9f7fe640 1 -- 172.21.15.19:0/1831891155 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98036070 con 0x7f3da015b090 2024-09-12T01:56:17.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.666+0000 7f3d9f7fe640 1 -- 172.21.15.19:0/1831891155 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d98031600 con 0x7f3da015b090 2024-09-12T01:56:17.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f264d227640 1 -- 172.21.15.19:0/3711951740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26480737f0 msgr2=0x7f2648071c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f264d227640 1 --2- 172.21.15.19:0/3711951740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26480737f0 0x7f2648071c30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2648070140 tx=0x7f264002a690 comp rx=0 tx=0).stop 2024-09-12T01:56:17.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f7dcf02b640 1 -- 172.21.15.19:0/1417256479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc00345e0 msgr2=0x7f7dc003a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f7dcf02b640 1 --2- 172.21.15.19:0/1417256479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc00345e0 0x7f7dc003a390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7dc806a6a0 tx=0x7f7dc80a6040 comp rx=0 tx=0).stop 2024-09-12T01:56:17.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f264d227640 1 -- 172.21.15.19:0/3711951740 shutdown_connections 2024-09-12T01:56:17.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f3d9f7fe640 1 -- 172.21.15.19:0/1831891155 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d980319f0 con 0x7f3da015b090 2024-09-12T01:56:17.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f264d227640 1 --2- 172.21.15.19:0/3711951740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26480737f0 0x7f2648071c30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f7dcf02b640 1 -- 172.21.15.19:0/1417256479 shutdown_connections 2024-09-12T01:56:17.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f7dcf02b640 1 --2- 172.21.15.19:0/1417256479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc00345e0 0x7f7dc003a390 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f7dcf02b640 1 -- 172.21.15.19:0/1417256479 >> 172.21.15.19:0/1417256479 conn(0x7f7dc001ea40 msgr2=0x7f7dc00556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f264d227640 1 --2- 172.21.15.19:0/3711951740 >> v2:172.21.15.135:3300/0 conn(0x7f264806e1a0 0x7f26480732b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f7dcf02b640 1 -- 172.21.15.19:0/1417256479 shutdown_connections 2024-09-12T01:56:17.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f3da571f640 1 -- 172.21.15.19:0/1831891155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da015b090 msgr2=0x7f3da0072b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f3da571f640 1 --2- 172.21.15.19:0/1831891155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da015b090 0x7f3da0072b00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009e50 tx=0x7f3d9802a7e0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f264d227640 1 --2- 172.21.15.19:0/3711951740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2648162710 0x7f264806dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f264d227640 1 -- 172.21.15.19:0/3711951740 >> 172.21.15.19:0/3711951740 conn(0x7f2648067d70 msgr2=0x7f264806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f7dcf02b640 1 -- 172.21.15.19:0/1417256479 wait complete. 2024-09-12T01:56:17.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f3da571f640 1 -- 172.21.15.19:0/1831891155 shutdown_connections 2024-09-12T01:56:17.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f3da571f640 1 --2- 172.21.15.19:0/1831891155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da015b090 0x7f3da0072b00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f3da571f640 1 --2- 172.21.15.19:0/1831891155 >> v2:172.21.15.19:3300/0 conn(0x7f3da006e680 0x7f3da015ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f3da571f640 1 -- 172.21.15.19:0/1831891155 >> 172.21.15.19:0/1831891155 conn(0x7f3da006c240 msgr2=0x7f3da00b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.666+0000 7f8c5005e640 1 -- 172.21.15.19:0/3588124617 shutdown_connections 2024-09-12T01:56:17.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f8c5005e640 1 -- 172.21.15.19:0/3588124617 wait complete. 2024-09-12T01:56:17.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f264d227640 1 -- 172.21.15.19:0/3711951740 shutdown_connections 2024-09-12T01:56:17.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f264d227640 1 -- 172.21.15.19:0/3711951740 wait complete. 2024-09-12T01:56:17.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7f69654c9640 1 Processor -- start 2024-09-12T01:56:17.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.667+0000 7fb3ad26c640 1 -- 172.21.15.19:0/3252013066 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0001de0 con 0x7fb3940051c0 2024-09-12T01:56:17.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.668+0000 7fb3ad26c640 1 -- 172.21.15.19:0/3252013066 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a0005d90 con 0x7fb3940051c0 2024-09-12T01:56:17.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.668+0000 7f09ae154640 1 --2- 172.21.15.19:0/3616436902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09a80b5910 0x7f09a80ccc60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009d90 tx=0x7f09a002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=281704bbde13fd1e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.668+0000 7f69654c9640 1 -- start start 2024-09-12T01:56:17.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.668+0000 7f09ac951640 1 -- 172.21.15.19:0/3616436902 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c0015f0 con 0x7f09a80b5910 2024-09-12T01:56:17.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.668+0000 7fb3ad26c640 1 -- 172.21.15.19:0/3252013066 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a00072b0 con 0x7fb3940051c0 2024-09-12T01:56:17.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.669+0000 7f09ac951640 1 -- 172.21.15.19:0/3616436902 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a0007540 con 0x7f09a80b5910 2024-09-12T01:56:17.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.669+0000 7f09ac951640 1 -- 172.21.15.19:0/3616436902 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a00078f0 con 0x7f09a80b5910 2024-09-12T01:56:17.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.669+0000 7f69654c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6960068c60 0x7f6960156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.669+0000 7f69654c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69600b5200 0x7f69600ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.669+0000 7f69654c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69600ad660 0x7f69601ef8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.669+0000 7f7dcf02b640 1 Processor -- start 2024-09-12T01:56:17.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.669+0000 7f7dcf02b640 1 -- start start 2024-09-12T01:56:17.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.669+0000 7fb3b04d2640 1 -- 172.21.15.19:0/3252013066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3940051c0 msgr2=0x7fb39400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.669+0000 7fb3b04d2640 1 --2- 172.21.15.19:0/3252013066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3940051c0 0x7fb39400b9c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8072620 tx=0x7fb394005830 comp rx=0 tx=0).stop 2024-09-12T01:56:17.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.669+0000 7fb3aea6f640 1 -- 172.21.15.19:0/3252013066 reap_dead start 2024-09-12T01:56:17.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.669+0000 7fb3b04d2640 1 -- 172.21.15.19:0/3252013066 shutdown_connections 2024-09-12T01:56:17.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.669+0000 7fb3b04d2640 1 -- 172.21.15.19:0/3252013066 >> 172.21.15.19:0/3252013066 conn(0x7fb3a806bc10 msgr2=0x7fb3a806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.669+0000 7fb3b04d2640 1 -- 172.21.15.19:0/3252013066 shutdown_connections 2024-09-12T01:56:17.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f264d227640 1 Processor -- start 2024-09-12T01:56:17.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f09afbb7640 1 -- 172.21.15.19:0/3616436902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09a80b5910 msgr2=0x7f09a80ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f09afbb7640 1 --2- 172.21.15.19:0/3616436902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09a80b5910 0x7f09a80ccc60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009d90 tx=0x7f09a002a680 comp rx=0 tx=0).stop 2024-09-12T01:56:17.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f09afbb7640 1 -- 172.21.15.19:0/3616436902 shutdown_connections 2024-09-12T01:56:17.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f09afbb7640 1 --2- 172.21.15.19:0/3616436902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09a80b5910 0x7f09a80ccc60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f09afbb7640 1 -- 172.21.15.19:0/3616436902 >> 172.21.15.19:0/3616436902 conn(0x7f09a806bc10 msgr2=0x7f09a806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f695effd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6960068c60 0x7f6960156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f695effd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6960068c60 0x7f6960156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:42320/0 (socket says 172.21.15.19:42320) 2024-09-12T01:56:17.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f695e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69600b5200 0x7f69600ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f695f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69600ad660 0x7f69601ef8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f695e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69600b5200 0x7f69600ad120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:58064/0 (socket says 172.21.15.19:58064) 2024-09-12T01:56:17.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f695f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69600ad660 0x7f69601ef8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42152/0 (socket says 172.21.15.19:42152) 2024-09-12T01:56:17.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f695effd640 1 -- 172.21.15.19:0/1158417555 learned_addr learned my addr 172.21.15.19:0/1158417555 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f69654c9640 1 -- 172.21.15.19:0/1158417555 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f69600b3c90 con 0x7f69600ad660 2024-09-12T01:56:17.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f69654c9640 1 -- 172.21.15.19:0/1158417555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f696015ecc0 con 0x7f69600b5200 2024-09-12T01:56:17.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f7dcf02b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dc00345e0 0x7f7dc00e05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f69654c9640 1 -- 172.21.15.19:0/1158417555 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6960157c60 con 0x7f6960068c60 2024-09-12T01:56:17.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.668+0000 7fefb359e640 1 Processor -- start 2024-09-12T01:56:17.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.668+0000 7f8c5005e640 1 Processor -- start 2024-09-12T01:56:17.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.669+0000 7fefb359e640 1 -- start start 2024-09-12T01:56:17.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.669+0000 7f8c5005e640 1 -- start start 2024-09-12T01:56:17.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f8c5005e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c480c7560 0x7f8c48200930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f8c5005e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c480d1020 0x7f8c480c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f8c5005e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c480b8950 0x7f8c480c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f8c5005e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8c480d4020 con 0x7f8c480d1020 2024-09-12T01:56:17.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f8c5005e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4806e090 con 0x7f8c480c7560 2024-09-12T01:56:17.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f8c5005e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8c480d41a0 con 0x7f8c480b8950 2024-09-12T01:56:17.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f7dcf02b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dc0036a00 0x7f7dc00e5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f3da571f640 1 -- 172.21.15.19:0/1831891155 shutdown_connections 2024-09-12T01:56:17.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f7dcf02b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc003afe0 0x7f7dc00dffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f8c4d5f9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c480d1020 0x7f8c480c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f8c4e5fb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c480b8950 0x7f8c480c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f8c4e5fb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c480b8950 0x7f8c480c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:42328/0 (socket says 172.21.15.19:42328) 2024-09-12T01:56:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f8c4e5fb640 1 -- 172.21.15.19:0/32164887 learned_addr learned my addr 172.21.15.19:0/32164887 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7fefb359e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefac0524b0 0x7fefac0d2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7fefb359e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefac053600 0x7fefac180460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7fefb359e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefac0e1860 0x7fefac1809a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7fefb359e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fefac0514d0 con 0x7fefac053600 2024-09-12T01:56:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7fefb359e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fefac051350 con 0x7fefac0524b0 2024-09-12T01:56:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7fefb359e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fefac0e1c40 con 0x7fefac0e1860 2024-09-12T01:56:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7fefb259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefac0524b0 0x7fefac0d2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7fefb259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefac0524b0 0x7fefac0d2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:58076/0 (socket says 172.21.15.19:58076) 2024-09-12T01:56:17.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7fefb259c640 1 -- 172.21.15.19:0/1352439464 learned_addr learned my addr 172.21.15.19:0/1352439464 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7fefb2d9d640 1 --2- 172.21.15.19:0/1352439464 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefac0e1860 0x7fefac1809a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f8c4ddfa640 1 --2- 172.21.15.19:0/32164887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c480c7560 0x7f8c48200930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.670+0000 7f264d227640 1 -- start start 2024-09-12T01:56:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f09afbb7640 1 -- 172.21.15.19:0/3616436902 shutdown_connections 2024-09-12T01:56:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f8c4e5fb640 1 -- 172.21.15.19:0/32164887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c480c7560 msgr2=0x7f8c48200930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f8c4e5fb640 1 --2- 172.21.15.19:0/32164887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c480c7560 0x7f8c48200930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f8c4e5fb640 1 -- 172.21.15.19:0/32164887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c480d1020 msgr2=0x7f8c480c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f8c4e5fb640 1 --2- 172.21.15.19:0/32164887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c480d1020 0x7f8c480c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f8c4e5fb640 1 -- 172.21.15.19:0/32164887 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c480cae10 con 0x7f8c480b8950 2024-09-12T01:56:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f7dcf02b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc0008f40 con 0x7f7dc003afe0 2024-09-12T01:56:17.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f7dcf02b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc0008ab0 con 0x7f7dc00345e0 2024-09-12T01:56:17.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f7dcf02b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc0008630 con 0x7f7dc0036a00 2024-09-12T01:56:17.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f7dce029640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dc00345e0 0x7f7dc00e05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f7dce029640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dc00345e0 0x7f7dc00e05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:58084/0 (socket says 172.21.15.19:58084) 2024-09-12T01:56:17.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f7dce029640 1 -- 172.21.15.19:0/340496618 learned_addr learned my addr 172.21.15.19:0/340496618 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f7dcd828640 1 --2- 172.21.15.19:0/340496618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dc0036a00 0x7f7dc00e5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f7dce82a640 1 --2- 172.21.15.19:0/340496618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc003afe0 0x7f7dc00dffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f7dce029640 1 -- 172.21.15.19:0/340496618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dc0036a00 msgr2=0x7f7dc00e5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f7dce029640 1 --2- 172.21.15.19:0/340496618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dc0036a00 0x7f7dc00e5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f7dce029640 1 -- 172.21.15.19:0/340496618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc003afe0 msgr2=0x7f7dc00dffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f7dce029640 1 --2- 172.21.15.19:0/340496618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc003afe0 0x7f7dc00dffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f7dce029640 1 -- 172.21.15.19:0/340496618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc00e3290 con 0x7f7dc00345e0 2024-09-12T01:56:17.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f7dcd828640 1 --2- 172.21.15.19:0/340496618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dc0036a00 0x7f7dc00e5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:17.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.669+0000 7fb3b04d2640 1 -- 172.21.15.19:0/3252013066 wait complete. 2024-09-12T01:56:17.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7fb3b04d2640 1 Processor -- start 2024-09-12T01:56:17.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7fb3b04d2640 1 -- start start 2024-09-12T01:56:17.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7fefb2d9d640 1 -- 172.21.15.19:0/1352439464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefac0524b0 msgr2=0x7fefac0d2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7fefb2d9d640 1 --2- 172.21.15.19:0/1352439464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefac0524b0 0x7fefac0d2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7fefb2d9d640 1 -- 172.21.15.19:0/1352439464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefac053600 msgr2=0x7fefac180460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7fefb2d9d640 1 --2- 172.21.15.19:0/1352439464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefac053600 0x7fefac180460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7fefb2d9d640 1 -- 172.21.15.19:0/1352439464 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefac04a530 con 0x7fefac0e1860 2024-09-12T01:56:17.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7fefb2d9d640 1 --2- 172.21.15.19:0/1352439464 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefac0e1860 0x7fefac1809a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fefa8031000 tx=0x7fefa80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f264d227640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f264806e1a0 0x7f26480b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f264d227640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26480737f0 0x7f2648164c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f264d227640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2648162710 0x7f2648162d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f264d227640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2648166aa0 con 0x7f264806e1a0 2024-09-12T01:56:17.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f09afbb7640 1 -- 172.21.15.19:0/3616436902 wait complete. 2024-09-12T01:56:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f695e7fc640 1 -- 172.21.15.19:0/1158417555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6960068c60 msgr2=0x7f6960156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f695e7fc640 1 --2- 172.21.15.19:0/1158417555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6960068c60 0x7f6960156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f695e7fc640 1 -- 172.21.15.19:0/1158417555 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69600ad660 msgr2=0x7f69601ef8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f695e7fc640 1 --2- 172.21.15.19:0/1158417555 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69600ad660 0x7f69601ef8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f695e7fc640 1 -- 172.21.15.19:0/1158417555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69600adb20 con 0x7f69600b5200 2024-09-12T01:56:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f695effd640 1 --2- 172.21.15.19:0/1158417555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6960068c60 0x7f6960156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f695f7fe640 1 --2- 172.21.15.19:0/1158417555 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69600ad660 0x7f69601ef8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7fefa2ffd640 1 -- 172.21.15.19:0/1352439464 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8037040 con 0x7fefac0e1860 2024-09-12T01:56:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f264d227640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f26481667c0 con 0x7f2648162710 2024-09-12T01:56:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f264d227640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2648166d80 con 0x7f26480737f0 2024-09-12T01:56:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7fefa2ffd640 1 -- 172.21.15.19:0/1352439464 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa8004250 con 0x7fefac0e1860 2024-09-12T01:56:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7fefa2ffd640 1 -- 172.21.15.19:0/1352439464 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa803c670 con 0x7fefac0e1860 2024-09-12T01:56:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7f8c4e5fb640 1 --2- 172.21.15.19:0/32164887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c480b8950 0x7f8c480c8680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8c4402a900 tx=0x7f8c440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7f695e7fc640 1 --2- 172.21.15.19:0/1158417555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69600b5200 0x7f69600ad120 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f695000eb40 tx=0x7f695000c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7f264659c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26480737f0 0x7f2648164c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.671+0000 7f3da571f640 1 -- 172.21.15.19:0/1831891155 wait complete. 2024-09-12T01:56:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7f7dce029640 1 --2- 172.21.15.19:0/340496618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dc00345e0 0x7f7dc00e05d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7dc802dd50 tx=0x7f7dc80699e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7f2646d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f264806e1a0 0x7f26480b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7f264659c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26480737f0 0x7f2648164c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:42356/0 (socket says 172.21.15.19:42356) 2024-09-12T01:56:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7f264659c640 1 -- 172.21.15.19:0/3071484946 learned_addr learned my addr 172.21.15.19:0/3071484946 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7f8c3e7fc640 1 -- 172.21.15.19:0/32164887 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44041020 con 0x7f8c480b8950 2024-09-12T01:56:17.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7f7dbeffd640 1 -- 172.21.15.19:0/340496618 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc80be070 con 0x7f7dc00345e0 2024-09-12T01:56:17.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7fefb359e640 1 -- 172.21.15.19:0/1352439464 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefac04a810 con 0x7fefac0e1860 2024-09-12T01:56:17.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7fefb359e640 1 -- 172.21.15.19:0/1352439464 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fefac0d9440 con 0x7fefac0e1860 2024-09-12T01:56:17.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7f7dcf02b640 1 -- 172.21.15.19:0/340496618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc00338d0 con 0x7f7dc00345e0 2024-09-12T01:56:17.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7f7dcf02b640 1 -- 172.21.15.19:0/340496618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc00233b0 con 0x7f7dc00345e0 2024-09-12T01:56:17.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7f2646d9d640 1 -- 172.21.15.19:0/3071484946 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26480737f0 msgr2=0x7f2648164c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7f2646d9d640 1 --2- 172.21.15.19:0/3071484946 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26480737f0 0x7f2648164c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7f2646d9d640 1 -- 172.21.15.19:0/3071484946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2648162710 msgr2=0x7f2648162d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7f2646d9d640 1 --2- 172.21.15.19:0/3071484946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2648162710 0x7f2648162d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7f2646d9d640 1 -- 172.21.15.19:0/3071484946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2648147ba0 con 0x7f264806e1a0 2024-09-12T01:56:17.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7f264659c640 1 --2- 172.21.15.19:0/3071484946 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26480737f0 0x7f2648164c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:17.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7fb3b04d2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3940051c0 0x7fb3a81f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7fb3b04d2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a80b0e00 0x7fb3a80b1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.672+0000 7f8c3e7fc640 1 -- 172.21.15.19:0/32164887 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c440308f0 con 0x7f8c480b8950 2024-09-12T01:56:17.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7fb3b04d2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3a8158290 0x7fb3a8158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7f2646d9d640 1 --2- 172.21.15.19:0/3071484946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f264806e1a0 0x7f26480b1240 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f263800e880 tx=0x7f263800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7f09afbb7640 1 Processor -- start 2024-09-12T01:56:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7f69477fe640 1 -- 172.21.15.19:0/1158417555 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69500183f0 con 0x7f69600b5200 2024-09-12T01:56:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7f69477fe640 1 -- 172.21.15.19:0/1158417555 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6950018590 con 0x7f69600b5200 2024-09-12T01:56:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7f69477fe640 1 -- 172.21.15.19:0/1158417555 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6950018960 con 0x7f69600b5200 2024-09-12T01:56:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7f09afbb7640 1 -- start start 2024-09-12T01:56:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7f69654c9640 1 -- 172.21.15.19:0/1158417555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69600aac00 con 0x7f69600b5200 2024-09-12T01:56:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7f69654c9640 1 -- 172.21.15.19:0/1158417555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69600ab1c0 con 0x7f69600b5200 2024-09-12T01:56:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7fb3b04d2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a806f1d0 con 0x7fb3940051c0 2024-09-12T01:56:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7fb3b04d2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a80b01c0 con 0x7fb3a80b0e00 2024-09-12T01:56:17.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7fb3b04d2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a806f4b0 con 0x7fb3a8158290 2024-09-12T01:56:17.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7f262f7fe640 1 -- 172.21.15.19:0/3071484946 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638017070 con 0x7f264806e1a0 2024-09-12T01:56:17.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7f264d227640 1 -- 172.21.15.19:0/3071484946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2648147e80 con 0x7f264806e1a0 2024-09-12T01:56:17.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7f264d227640 1 -- 172.21.15.19:0/3071484946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2648148440 con 0x7f264806e1a0 2024-09-12T01:56:17.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7f8c3e7fc640 1 -- 172.21.15.19:0/32164887 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44037040 con 0x7f8c480b8950 2024-09-12T01:56:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7fb3aea6f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3a8158290 0x7fb3a8158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7fb3aea6f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3a8158290 0x7fb3a8158710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:42360/0 (socket says 172.21.15.19:42360) 2024-09-12T01:56:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7fb3aea6f640 1 -- 172.21.15.19:0/2589283988 learned_addr learned my addr 172.21.15.19:0/2589283988 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7fb3ada6d640 1 --2- 172.21.15.19:0/2589283988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a80b0e00 0x7fb3a80b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7fb3aea6f640 1 -- 172.21.15.19:0/2589283988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a80b0e00 msgr2=0x7fb3a80b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7fb3aea6f640 1 --2- 172.21.15.19:0/2589283988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a80b0e00 0x7fb3a80b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7fb3aea6f640 1 -- 172.21.15.19:0/2589283988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3940051c0 msgr2=0x7fb3a81f3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7fb3ada6d640 1 --2- 172.21.15.19:0/2589283988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a80b0e00 0x7fb3a80b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7fb3ae26e640 1 --2- 172.21.15.19:0/2589283988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3940051c0 0x7fb3a81f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7fb3aea6f640 1 --2- 172.21.15.19:0/2589283988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3940051c0 0x7fb3a81f3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7fb3aea6f640 1 -- 172.21.15.19:0/2589283988 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a8158e70 con 0x7fb3a8158290 2024-09-12T01:56:17.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7f8c5005e640 1 -- 172.21.15.19:0/32164887 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c480cb0f0 con 0x7f8c480b8950 2024-09-12T01:56:17.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7f8c5005e640 1 -- 172.21.15.19:0/32164887 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c480ca130 con 0x7f8c480b8950 2024-09-12T01:56:17.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7fb3ae26e640 1 --2- 172.21.15.19:0/2589283988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3940051c0 0x7fb3a81f3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:17.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7f09afbb7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09a80b5910 0x7f09a815d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7fb3aea6f640 1 --2- 172.21.15.19:0/2589283988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3a8158290 0x7fb3a8158710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb3a000c1a0 tx=0x7fb3a0001800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.675+0000 7f09afbb7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09a8157ed0 0x7f09a81499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.675+0000 7f09afbb7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a814a230 0x7f09a80b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.675+0000 7f09afbb7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f09a80cd1a0 con 0x7f09a80b5910 2024-09-12T01:56:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7f3da571f640 1 Processor -- start 2024-09-12T01:56:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7f3da571f640 1 -- start start 2024-09-12T01:56:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7f3da571f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3da006e680 0x7f3da00cf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7f3da571f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3da006fdc0 0x7f3da014e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7f3da571f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da015b090 0x7f3da009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.675+0000 7f3da571f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3da015b520 con 0x7f3da006fdc0 2024-09-12T01:56:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.675+0000 7f3da571f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3da006f490 con 0x7f3da006e680 2024-09-12T01:56:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.675+0000 7f3da571f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3da015b6a0 con 0x7f3da015b090 2024-09-12T01:56:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.675+0000 7f09afbb7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f09a815a9c0 con 0x7f09a8157ed0 2024-09-12T01:56:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.675+0000 7f09ae154640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a814a230 0x7f09a80b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7f7dbeffd640 1 -- 172.21.15.19:0/340496618 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc80aee50 con 0x7f7dc00345e0 2024-09-12T01:56:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.673+0000 7f7dbeffd640 1 -- 172.21.15.19:0/340496618 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc80b3040 con 0x7f7dc00345e0 2024-09-12T01:56:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.675+0000 7f09ae154640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a814a230 0x7f09a80b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:42366/0 (socket says 172.21.15.19:42366) 2024-09-12T01:56:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.675+0000 7f09ae154640 1 -- 172.21.15.19:0/2051369361 learned_addr learned my addr 172.21.15.19:0/2051369361 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.675+0000 7f09afbb7640 1 -- 172.21.15.19:0/2051369361 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f09a81582b0 con 0x7f09a814a230 2024-09-12T01:56:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.676+0000 7f09ad953640 1 --2- 172.21.15.19:0/2051369361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09a80b5910 0x7f09a815d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.676+0000 7f3da4f1e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da015b090 0x7f3da009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.676+0000 7fefa2ffd640 1 -- 172.21.15.19:0/1352439464 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fefa803a070 con 0x7fefac0e1860 2024-09-12T01:56:17.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.676+0000 7f3da4f1e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da015b090 0x7f3da009cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:42362/0 (socket says 172.21.15.19:42362) 2024-09-12T01:56:17.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.676+0000 7f3da4f1e640 1 -- 172.21.15.19:0/4056158331 learned_addr learned my addr 172.21.15.19:0/4056158331 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:17.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.675+0000 7f69477fe640 1 -- 172.21.15.19:0/1158417555 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6950018b00 con 0x7f69600b5200 2024-09-12T01:56:17.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.676+0000 7f69477fe640 1 --2- 172.21.15.19:0/1158417555 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f694c06bf00 0x7f694c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.676+0000 7f3d97fff640 1 --2- 172.21.15.19:0/4056158331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3da006fdc0 0x7f3da014e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.676+0000 7fb39effd640 1 -- 172.21.15.19:0/2589283988 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0037040 con 0x7fb3a8158290 2024-09-12T01:56:17.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.676+0000 7f69477fe640 1 -- 172.21.15.19:0/1158417555 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f695008b590 con 0x7f69600b5200 2024-09-12T01:56:17.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.676+0000 7f3da4f1e640 1 -- 172.21.15.19:0/4056158331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3da006e680 msgr2=0x7f3da00cf440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:56:17.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.676+0000 7f3da4f1e640 1 --2- 172.21.15.19:0/4056158331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3da006e680 0x7f3da00cf440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.676+0000 7f7dbeffd640 1 -- 172.21.15.19:0/340496618 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7dc80c1070 con 0x7f7dc00345e0 2024-09-12T01:56:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.676+0000 7f7dcf02b640 1 -- 172.21.15.19:0/340496618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7db0005290 con 0x7f7dc00345e0 2024-09-12T01:56:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.676+0000 7f7dbeffd640 1 --2- 172.21.15.19:0/340496618 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7dac06be30 0x7f7dac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7f262f7fe640 1 -- 172.21.15.19:0/3071484946 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f263800c8e0 con 0x7f264806e1a0 2024-09-12T01:56:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.674+0000 7f262f7fe640 1 -- 172.21.15.19:0/3071484946 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263800ccd0 con 0x7f264806e1a0 2024-09-12T01:56:17.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7f3da4f1e640 1 -- 172.21.15.19:0/4056158331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3da006fdc0 msgr2=0x7f3da014e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7f3da4f1e640 1 --2- 172.21.15.19:0/4056158331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3da006fdc0 0x7f3da014e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.676+0000 7fb3b04d2640 1 -- 172.21.15.19:0/2589283988 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a8159150 con 0x7fb3a8158290 2024-09-12T01:56:17.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7fb3b04d2640 1 -- 172.21.15.19:0/2589283988 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a8159710 con 0x7fb3a8158290 2024-09-12T01:56:17.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7f3da4f1e640 1 -- 172.21.15.19:0/4056158331 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da009cd10 con 0x7f3da015b090 2024-09-12T01:56:17.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7fefa2ffd640 1 --2- 172.21.15.19:0/1352439464 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef9406bf00 0x7fef9406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7f7dbeffd640 1 -- 172.21.15.19:0/340496618 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7dc8127850 con 0x7f7dc00345e0 2024-09-12T01:56:17.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7f3d97fff640 1 --2- 172.21.15.19:0/4056158331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3da006fdc0 0x7f3da014e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:17.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7fefa2ffd640 1 -- 172.21.15.19:0/1352439464 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fefa80abb60 con 0x7fefac0e1860 2024-09-12T01:56:17.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7fefb359e640 1 -- 172.21.15.19:0/1352439464 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef98005290 con 0x7fefac0e1860 2024-09-12T01:56:17.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7f264d227640 1 -- 172.21.15.19:0/3071484946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2648073c20 con 0x7f264806e1a0 2024-09-12T01:56:17.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7f3da4f1e640 1 --2- 172.21.15.19:0/4056158331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da015b090 0x7f3da009cf00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3d9802add0 tx=0x7f3d98004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7f09ae154640 1 -- 172.21.15.19:0/2051369361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09a8157ed0 msgr2=0x7f09a81499a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:56:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7f09ae154640 1 --2- 172.21.15.19:0/2051369361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09a8157ed0 0x7f09a81499a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7f09ae154640 1 -- 172.21.15.19:0/2051369361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09a80b5910 msgr2=0x7f09a815d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7f09ae154640 1 --2- 172.21.15.19:0/2051369361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09a80b5910 0x7f09a815d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7f09ae154640 1 -- 172.21.15.19:0/2051369361 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a815d5c0 con 0x7f09a814a230 2024-09-12T01:56:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7f695effd640 1 --2- 172.21.15.19:0/1158417555 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f694c06bf00 0x7f694c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7fefb259c640 1 --2- 172.21.15.19:0/1352439464 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef9406bf00 0x7fef9406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7f69654c9640 1 -- 172.21.15.19:0/1158417555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6940005290 con 0x7f69600b5200 2024-09-12T01:56:17.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7f7dcd828640 1 --2- 172.21.15.19:0/340496618 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7dac06be30 0x7f7dac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7fb39effd640 1 -- 172.21.15.19:0/2589283988 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a0041070 con 0x7fb3a8158290 2024-09-12T01:56:17.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.677+0000 7f8c5005e640 1 -- 172.21.15.19:0/32164887 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c48164350 con 0x7f8c480b8950 2024-09-12T01:56:17.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.678+0000 7f09ae154640 1 --2- 172.21.15.19:0/2051369361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a814a230 0x7f09a80b3d10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009eb0 tx=0x7f09a0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.678+0000 7fb39effd640 1 -- 172.21.15.19:0/2589283988 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a00011c0 con 0x7fb3a8158290 2024-09-12T01:56:17.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.678+0000 7f7dcd828640 1 --2- 172.21.15.19:0/340496618 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7dac06be30 0x7f7dac06e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00f0290 tx=0x7f7dc4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.678+0000 7f262f7fe640 1 -- 172.21.15.19:0/3071484946 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f263801a070 con 0x7f264806e1a0 2024-09-12T01:56:17.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.678+0000 7f695effd640 1 --2- 172.21.15.19:0/1158417555 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f694c06bf00 0x7f694c06e3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6960072720 tx=0x7f6954008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.678+0000 7f8c3e7fc640 1 -- 172.21.15.19:0/32164887 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c44044020 con 0x7f8c480b8950 2024-09-12T01:56:17.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.678+0000 7fefb259c640 1 --2- 172.21.15.19:0/1352439464 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef9406bf00 0x7fef9406e3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fefb4076e10 tx=0x7fefb4069e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.679+0000 7fb3b04d2640 1 -- 172.21.15.19:0/2589283988 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb390005290 con 0x7fb3a8158290 2024-09-12T01:56:17.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.679+0000 7f262f7fe640 1 --2- 172.21.15.19:0/3071484946 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f263406be80 0x7f263406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.679+0000 7fb39effd640 1 -- 172.21.15.19:0/2589283988 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3a0007490 con 0x7fb3a8158290 2024-09-12T01:56:17.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.679+0000 7f262f7fe640 1 -- 172.21.15.19:0/3071484946 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f263808b2a0 con 0x7f264806e1a0 2024-09-12T01:56:17.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.679+0000 7f264659c640 1 --2- 172.21.15.19:0/3071484946 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f263406be80 0x7f263406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.679+0000 7fb39effd640 1 --2- 172.21.15.19:0/2589283988 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb38c06beb0 0x7fb38c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.679+0000 7fb39effd640 1 -- 172.21.15.19:0/2589283988 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb3a00aadd0 con 0x7fb3a8158290 2024-09-12T01:56:17.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.679+0000 7f8c3e7fc640 1 --2- 172.21.15.19:0/32164887 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c2c06bf30 0x7f8c2c06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.679+0000 7fb3ae26e640 1 --2- 172.21.15.19:0/2589283988 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb38c06beb0 0x7fb38c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.679+0000 7f8c3e7fc640 1 -- 172.21.15.19:0/32164887 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8c440ab8d0 con 0x7f8c480b8950 2024-09-12T01:56:17.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.679+0000 7f264659c640 1 --2- 172.21.15.19:0/3071484946 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f263406be80 0x7f263406e340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2648164b50 tx=0x7f263c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.680+0000 7f8c4ddfa640 1 --2- 172.21.15.19:0/32164887 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c2c06bf30 0x7f8c2c06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.680+0000 7fb3ae26e640 1 --2- 172.21.15.19:0/2589283988 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb38c06beb0 0x7fb38c06e370 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8069820 tx=0x7fb398008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.680+0000 7f8c4ddfa640 1 --2- 172.21.15.19:0/32164887 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c2c06bf30 0x7f8c2c06e3f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8c400070b0 tx=0x7f8c40007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.683+0000 7f099a7fc640 1 -- 172.21.15.19:0/2051369361 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a0040070 con 0x7f09a814a230 2024-09-12T01:56:17.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.683+0000 7f3d9d7fa640 1 -- 172.21.15.19:0/4056158331 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98041020 con 0x7f3da015b090 2024-09-12T01:56:17.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.683+0000 7f09afbb7640 1 -- 172.21.15.19:0/2051369361 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a815bf50 con 0x7f09a814a230 2024-09-12T01:56:17.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.683+0000 7f3da571f640 1 -- 172.21.15.19:0/4056158331 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da00cd790 con 0x7f3da015b090 2024-09-12T01:56:17.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.683+0000 7f09afbb7640 1 -- 172.21.15.19:0/2051369361 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a815c510 con 0x7f09a814a230 2024-09-12T01:56:17.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.683+0000 7f3da571f640 1 -- 172.21.15.19:0/4056158331 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da00cdd50 con 0x7f3da015b090 2024-09-12T01:56:17.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.683+0000 7fefa2ffd640 1 -- 172.21.15.19:0/1352439464 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fefa8041020 con 0x7fefac0e1860 2024-09-12T01:56:17.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.683+0000 7f69477fe640 1 -- 172.21.15.19:0/1158417555 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6950013070 con 0x7f69600b5200 2024-09-12T01:56:17.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.684+0000 7f3da571f640 1 -- 172.21.15.19:0/4056158331 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da015ab50 con 0x7f3da015b090 2024-09-12T01:56:17.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.684+0000 7f09afbb7640 1 -- 172.21.15.19:0/2051369361 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09a8068c60 con 0x7f09a814a230 2024-09-12T01:56:17.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.684+0000 7f262f7fe640 1 -- 172.21.15.19:0/3071484946 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2638059330 con 0x7f264806e1a0 2024-09-12T01:56:17.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.688+0000 7f8c3e7fc640 1 -- 172.21.15.19:0/32164887 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8c4404b030 con 0x7f8c480b8950 2024-09-12T01:56:17.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.688+0000 7f7dbeffd640 1 -- 172.21.15.19:0/340496618 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7dc80f58f0 con 0x7f7dc00345e0 2024-09-12T01:56:17.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.692+0000 7f3d9d7fa640 1 -- 172.21.15.19:0/4056158331 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d98037040 con 0x7f3da015b090 2024-09-12T01:56:17.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.692+0000 7f3d9d7fa640 1 -- 172.21.15.19:0/4056158331 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98036070 con 0x7f3da015b090 2024-09-12T01:56:17.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.692+0000 7fb39effd640 1 -- 172.21.15.19:0/2589283988 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb3a815d7d0 con 0x7fb3a8158290 2024-09-12T01:56:17.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.693+0000 7f099a7fc640 1 -- 172.21.15.19:0/2051369361 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a0007540 con 0x7f09a814a230 2024-09-12T01:56:17.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.694+0000 7f099a7fc640 1 -- 172.21.15.19:0/2051369361 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a0049060 con 0x7f09a814a230 2024-09-12T01:56:17.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.694+0000 7f099a7fc640 1 -- 172.21.15.19:0/2051369361 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f09a0039040 con 0x7f09a814a230 2024-09-12T01:56:17.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.694+0000 7f3d9d7fa640 1 -- 172.21.15.19:0/4056158331 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d98044020 con 0x7f3da015b090 2024-09-12T01:56:17.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.695+0000 7f3d9d7fa640 1 --2- 172.21.15.19:0/4056158331 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3d8006c030 0x7f3d8006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.695+0000 7f099a7fc640 1 --2- 172.21.15.19:0/2051369361 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f098c06be60 0x7f098c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.695+0000 7f3d9d7fa640 1 -- 172.21.15.19:0/4056158331 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3d980099b0 con 0x7f3da015b090 2024-09-12T01:56:17.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.695+0000 7f3d9ffff640 1 --2- 172.21.15.19:0/4056158331 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3d8006c030 0x7f3d8006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.696+0000 7f099a7fc640 1 -- 172.21.15.19:0/2051369361 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f09a00ac7a0 con 0x7f09a814a230 2024-09-12T01:56:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.696+0000 7f09ad953640 1 --2- 172.21.15.19:0/2051369361 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f098c06be60 0x7f098c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.696+0000 7f3d9ffff640 1 --2- 172.21.15.19:0/4056158331 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3d8006c030 0x7f3d8006e4f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3da00b1a20 tx=0x7f3d900079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.697+0000 7f09ad953640 1 --2- 172.21.15.19:0/2051369361 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f098c06be60 0x7f098c06e320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f099c000f60 tx=0x7f099c0018f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.697+0000 7f3d9d7fa640 1 -- 172.21.15.19:0/4056158331 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d9804b020 con 0x7f3da015b090 2024-09-12T01:56:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:17.701+0000 7f099a7fc640 1 -- 172.21.15.19:0/2051369361 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f09a007a7a0 con 0x7f09a814a230 2024-09-12T01:56:18.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.089+0000 7fefb359e640 1 -- 172.21.15.19:0/1352439464 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fef98005580 con 0x7fefac0e1860 2024-09-12T01:56:18.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.090+0000 7f69654c9640 1 -- 172.21.15.19:0/1158417555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6940005580 con 0x7f69600b5200 2024-09-12T01:56:18.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.089+0000 7fefa2ffd640 1 -- 172.21.15.19:0/1352439464 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fefa8079bf0 con 0x7fefac0e1860 2024-09-12T01:56:18.093 INFO:teuthology.orchestra.run.smithi019.stdout:55834574857 2024-09-12T01:56:18.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.090+0000 7f69477fe640 1 -- 172.21.15.19:0/1158417555 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6950059c70 con 0x7f69600b5200 2024-09-12T01:56:18.094 INFO:teuthology.orchestra.run.smithi019.stdout:64424509448 2024-09-12T01:56:18.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.093+0000 7f264d227640 1 -- 172.21.15.19:0/3071484946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2648165c40 con 0x7f264806e1a0 2024-09-12T01:56:18.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.093+0000 7f69457fa640 1 -- 172.21.15.19:0/1158417555 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f694c06bf00 msgr2=0x7f694c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.093+0000 7fefb359e640 1 -- 172.21.15.19:0/1352439464 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef9406bf00 msgr2=0x7fef9406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.093+0000 7fefb359e640 1 --2- 172.21.15.19:0/1352439464 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef9406bf00 0x7fef9406e3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fefb4076e10 tx=0x7fefb4069e50 comp rx=0 tx=0).stop 2024-09-12T01:56:18.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.093+0000 7fefb359e640 1 -- 172.21.15.19:0/1352439464 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefac0e1860 msgr2=0x7fefac1809a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.093+0000 7fefb359e640 1 --2- 172.21.15.19:0/1352439464 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefac0e1860 0x7fefac1809a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fefa8031000 tx=0x7fefa80046c0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.093+0000 7f69457fa640 1 --2- 172.21.15.19:0/1158417555 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f694c06bf00 0x7f694c06e3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6960072720 tx=0x7f6954008040 comp rx=0 tx=0).stop 2024-09-12T01:56:18.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.093+0000 7f69457fa640 1 -- 172.21.15.19:0/1158417555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69600b5200 msgr2=0x7f69600ad120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.093+0000 7f69457fa640 1 --2- 172.21.15.19:0/1158417555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69600b5200 0x7f69600ad120 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f695000eb40 tx=0x7f695000c3e0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.094+0000 7f69457fa640 1 -- 172.21.15.19:0/1158417555 shutdown_connections 2024-09-12T01:56:18.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.094+0000 7f69457fa640 1 --2- 172.21.15.19:0/1158417555 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f694c06bf00 0x7f694c06e3c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.094+0000 7f69457fa640 1 --2- 172.21.15.19:0/1158417555 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69600ad660 0x7f69601ef8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.094+0000 7f69457fa640 1 --2- 172.21.15.19:0/1158417555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69600b5200 0x7f69600ad120 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.094+0000 7f69457fa640 1 --2- 172.21.15.19:0/1158417555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6960068c60 0x7f6960156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.094+0000 7f69457fa640 1 -- 172.21.15.19:0/1158417555 >> 172.21.15.19:0/1158417555 conn(0x7f696006bc10 msgr2=0x7f69600b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:18.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.094+0000 7f262f7fe640 1 -- 172.21.15.19:0/3071484946 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f263805d630 con 0x7f264806e1a0 2024-09-12T01:56:18.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.093+0000 7fefb359e640 1 -- 172.21.15.19:0/1352439464 shutdown_connections 2024-09-12T01:56:18.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.093+0000 7fefb359e640 1 --2- 172.21.15.19:0/1352439464 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef9406bf00 0x7fef9406e3c0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fefb4076e10 tx=0x7fefb4069e50 comp rx=0 tx=0).stop 2024-09-12T01:56:18.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.093+0000 7fefb359e640 1 --2- 172.21.15.19:0/1352439464 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefac0e1860 0x7fefac1809a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.093+0000 7fefb359e640 1 --2- 172.21.15.19:0/1352439464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefac053600 0x7fefac180460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.093+0000 7fefb359e640 1 --2- 172.21.15.19:0/1352439464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefac0524b0 0x7fefac0d2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.093+0000 7fefb359e640 1 -- 172.21.15.19:0/1352439464 >> 172.21.15.19:0/1352439464 conn(0x7fefac01fb40 msgr2=0x7fefac007650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:18.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.094+0000 7f69457fa640 1 -- 172.21.15.19:0/1158417555 shutdown_connections 2024-09-12T01:56:18.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.094+0000 7f69457fa640 1 -- 172.21.15.19:0/1158417555 wait complete. 2024-09-12T01:56:18.098 INFO:teuthology.orchestra.run.smithi019.stdout:60129542153 2024-09-12T01:56:18.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.094+0000 7fefb359e640 1 -- 172.21.15.19:0/1352439464 shutdown_connections 2024-09-12T01:56:18.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.094+0000 7fefb359e640 1 -- 172.21.15.19:0/1352439464 wait complete. 2024-09-12T01:56:18.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.097+0000 7f262d7fa640 1 -- 172.21.15.19:0/3071484946 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f263406be80 msgr2=0x7f263406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.098+0000 7f262d7fa640 1 --2- 172.21.15.19:0/3071484946 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f263406be80 0x7f263406e340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2648164b50 tx=0x7f263c009190 comp rx=0 tx=0).stop 2024-09-12T01:56:18.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.098+0000 7f262d7fa640 1 -- 172.21.15.19:0/3071484946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f264806e1a0 msgr2=0x7f26480b1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.098+0000 7f262d7fa640 1 --2- 172.21.15.19:0/3071484946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f264806e1a0 0x7f26480b1240 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f263800e880 tx=0x7f263800ed40 comp rx=0 tx=0).stop 2024-09-12T01:56:18.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.098+0000 7f262d7fa640 1 -- 172.21.15.19:0/3071484946 shutdown_connections 2024-09-12T01:56:18.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.098+0000 7f262d7fa640 1 --2- 172.21.15.19:0/3071484946 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f263406be80 0x7f263406e340 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.098+0000 7f262d7fa640 1 --2- 172.21.15.19:0/3071484946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2648162710 0x7f2648162d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.098+0000 7f262d7fa640 1 --2- 172.21.15.19:0/3071484946 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26480737f0 0x7f2648164c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.098+0000 7f262d7fa640 1 --2- 172.21.15.19:0/3071484946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f264806e1a0 0x7f26480b1240 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.099+0000 7f262d7fa640 1 -- 172.21.15.19:0/3071484946 >> 172.21.15.19:0/3071484946 conn(0x7f2648067d70 msgr2=0x7f264814efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:18.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.099+0000 7f262d7fa640 1 -- 172.21.15.19:0/3071484946 shutdown_connections 2024-09-12T01:56:18.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.099+0000 7f262d7fa640 1 -- 172.21.15.19:0/3071484946 wait complete. 2024-09-12T01:56:18.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.103+0000 7f7dcf02b640 1 -- 172.21.15.19:0/340496618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7db0005580 con 0x7f7dc00345e0 2024-09-12T01:56:18.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.103+0000 7f8c5005e640 1 -- 172.21.15.19:0/32164887 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8c48164070 con 0x7f8c480b8950 2024-09-12T01:56:18.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.104+0000 7f7dbeffd640 1 -- 172.21.15.19:0/340496618 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7dc80f9bf0 con 0x7f7dc00345e0 2024-09-12T01:56:18.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.104+0000 7f8c3e7fc640 1 -- 172.21.15.19:0/32164887 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8c44079f20 con 0x7f8c480b8950 2024-09-12T01:56:18.104 INFO:teuthology.orchestra.run.smithi019.stdout:64424509449 2024-09-12T01:56:18.104 INFO:teuthology.orchestra.run.smithi019.stdout:60129542153 2024-09-12T01:56:18.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.106+0000 7fb3b04d2640 1 -- 172.21.15.19:0/2589283988 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb390005580 con 0x7fb3a8158290 2024-09-12T01:56:18.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.107+0000 7fb39effd640 1 -- 172.21.15.19:0/2589283988 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb3a00793d0 con 0x7fb3a8158290 2024-09-12T01:56:18.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.107+0000 7f7dcf02b640 1 -- 172.21.15.19:0/340496618 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7dac06be30 msgr2=0x7f7dac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.107+0000 7f7dcf02b640 1 --2- 172.21.15.19:0/340496618 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7dac06be30 0x7f7dac06e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00f0290 tx=0x7f7dc4008040 comp rx=0 tx=0).stop 2024-09-12T01:56:18.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.107+0000 7f7dcf02b640 1 -- 172.21.15.19:0/340496618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dc00345e0 msgr2=0x7f7dc00e05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.109 INFO:teuthology.orchestra.run.smithi019.stdout:64424509449 2024-09-12T01:56:18.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.108+0000 7f09afbb7640 1 -- 172.21.15.19:0/2051369361 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f09a80ccc10 con 0x7f09a814a230 2024-09-12T01:56:18.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.107+0000 7f7dcf02b640 1 --2- 172.21.15.19:0/340496618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dc00345e0 0x7f7dc00e05d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7dc802dd50 tx=0x7f7dc80699e0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.108+0000 7f7dcf02b640 1 -- 172.21.15.19:0/340496618 shutdown_connections 2024-09-12T01:56:18.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.108+0000 7f7dcf02b640 1 --2- 172.21.15.19:0/340496618 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7dac06be30 0x7f7dac06e2f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.107+0000 7f8c5005e640 1 -- 172.21.15.19:0/32164887 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c2c06bf30 msgr2=0x7f8c2c06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.107+0000 7f8c5005e640 1 --2- 172.21.15.19:0/32164887 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c2c06bf30 0x7f8c2c06e3f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8c400070b0 tx=0x7f8c40007040 comp rx=0 tx=0).stop 2024-09-12T01:56:18.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.107+0000 7f8c5005e640 1 -- 172.21.15.19:0/32164887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c480b8950 msgr2=0x7f8c480c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.107+0000 7f8c5005e640 1 --2- 172.21.15.19:0/32164887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c480b8950 0x7f8c480c8680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8c4402a900 tx=0x7f8c440046c0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.108+0000 7f8c5005e640 1 -- 172.21.15.19:0/32164887 shutdown_connections 2024-09-12T01:56:18.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.108+0000 7f8c5005e640 1 --2- 172.21.15.19:0/32164887 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c2c06bf30 0x7f8c2c06e3f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.108+0000 7f7dcf02b640 1 --2- 172.21.15.19:0/340496618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc003afe0 0x7f7dc00dffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.108+0000 7f7dcf02b640 1 --2- 172.21.15.19:0/340496618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dc0036a00 0x7f7dc00e5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.108+0000 7f7dcf02b640 1 --2- 172.21.15.19:0/340496618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dc00345e0 0x7f7dc00e05d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.108+0000 7f7dcf02b640 1 -- 172.21.15.19:0/340496618 >> 172.21.15.19:0/340496618 conn(0x7f7dc001ea40 msgr2=0x7f7dc004bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:18.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.108+0000 7f8c5005e640 1 --2- 172.21.15.19:0/32164887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c480b8950 0x7f8c480c8680 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.108+0000 7f8c5005e640 1 --2- 172.21.15.19:0/32164887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c480d1020 0x7f8c480c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.108+0000 7f8c5005e640 1 --2- 172.21.15.19:0/32164887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c480c7560 0x7f8c48200930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.108+0000 7f8c5005e640 1 -- 172.21.15.19:0/32164887 >> 172.21.15.19:0/32164887 conn(0x7f8c4809d850 msgr2=0x7f8c480ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:18.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.108+0000 7f7dcf02b640 1 -- 172.21.15.19:0/340496618 shutdown_connections 2024-09-12T01:56:18.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.108+0000 7f7dcf02b640 1 -- 172.21.15.19:0/340496618 wait complete. 2024-09-12T01:56:18.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.109+0000 7f8c5005e640 1 -- 172.21.15.19:0/32164887 shutdown_connections 2024-09-12T01:56:18.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.109+0000 7f8c5005e640 1 -- 172.21.15.19:0/32164887 wait complete. 2024-09-12T01:56:18.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.110+0000 7f099a7fc640 1 -- 172.21.15.19:0/2051369361 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f09a007eaa0 con 0x7f09a814a230 2024-09-12T01:56:18.113 INFO:teuthology.orchestra.run.smithi019.stdout:60129542153 2024-09-12T01:56:18.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.111+0000 7fb3b04d2640 1 -- 172.21.15.19:0/2589283988 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb38c06beb0 msgr2=0x7fb38c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.111+0000 7fb3b04d2640 1 --2- 172.21.15.19:0/2589283988 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb38c06beb0 0x7fb38c06e370 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8069820 tx=0x7fb398008040 comp rx=0 tx=0).stop 2024-09-12T01:56:18.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.111+0000 7fb3b04d2640 1 -- 172.21.15.19:0/2589283988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3a8158290 msgr2=0x7fb3a8158710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.111+0000 7fb3b04d2640 1 --2- 172.21.15.19:0/2589283988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3a8158290 0x7fb3a8158710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb3a000c1a0 tx=0x7fb3a0001800 comp rx=0 tx=0).stop 2024-09-12T01:56:18.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.112+0000 7f3da571f640 1 -- 172.21.15.19:0/4056158331 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3da00aebe0 con 0x7f3da015b090 2024-09-12T01:56:18.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.112+0000 7fb3b04d2640 1 -- 172.21.15.19:0/2589283988 shutdown_connections 2024-09-12T01:56:18.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.112+0000 7fb3b04d2640 1 --2- 172.21.15.19:0/2589283988 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb38c06beb0 0x7fb38c06e370 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.112+0000 7fb3b04d2640 1 --2- 172.21.15.19:0/2589283988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3a8158290 0x7fb3a8158710 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.112+0000 7fb3b04d2640 1 --2- 172.21.15.19:0/2589283988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a80b0e00 0x7fb3a80b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.113+0000 7fb3b04d2640 1 --2- 172.21.15.19:0/2589283988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3940051c0 0x7fb3a81f3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.113+0000 7fb3b04d2640 1 -- 172.21.15.19:0/2589283988 >> 172.21.15.19:0/2589283988 conn(0x7fb3a806bc10 msgr2=0x7fb3a815e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:18.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.113+0000 7f3d9d7fa640 1 -- 172.21.15.19:0/4056158331 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3d9804b020 con 0x7f3da015b090 2024-09-12T01:56:18.115 INFO:teuthology.orchestra.run.smithi019.stdout:60129542153 2024-09-12T01:56:18.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.114+0000 7f09afbb7640 1 -- 172.21.15.19:0/2051369361 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f098c06be60 msgr2=0x7f098c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.114+0000 7f09afbb7640 1 --2- 172.21.15.19:0/2051369361 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f098c06be60 0x7f098c06e320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f099c000f60 tx=0x7f099c0018f0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.114+0000 7fb3b04d2640 1 -- 172.21.15.19:0/2589283988 shutdown_connections 2024-09-12T01:56:18.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.114+0000 7f09afbb7640 1 -- 172.21.15.19:0/2051369361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a814a230 msgr2=0x7f09a80b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.114+0000 7fb3b04d2640 1 -- 172.21.15.19:0/2589283988 wait complete. 2024-09-12T01:56:18.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.114+0000 7f09afbb7640 1 --2- 172.21.15.19:0/2051369361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a814a230 0x7f09a80b3d10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009eb0 tx=0x7f09a0004a40 comp rx=0 tx=0).stop 2024-09-12T01:56:18.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.6 2024-09-12T01:56:18.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.4 2024-09-12T01:56:18.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.114+0000 7f09afbb7640 1 -- 172.21.15.19:0/2051369361 shutdown_connections 2024-09-12T01:56:18.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.114+0000 7f09afbb7640 1 --2- 172.21.15.19:0/2051369361 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f098c06be60 0x7f098c06e320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.114+0000 7f09afbb7640 1 --2- 172.21.15.19:0/2051369361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a814a230 0x7f09a80b3d10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.114+0000 7f09afbb7640 1 --2- 172.21.15.19:0/2051369361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09a8157ed0 0x7f09a81499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.114+0000 7f09afbb7640 1 --2- 172.21.15.19:0/2051369361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09a80b5910 0x7f09a815d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.115+0000 7f09afbb7640 1 -- 172.21.15.19:0/2051369361 >> 172.21.15.19:0/2051369361 conn(0x7f09a806bc10 msgr2=0x7f09a80ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:18.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.115+0000 7f09afbb7640 1 -- 172.21.15.19:0/2051369361 shutdown_connections 2024-09-12T01:56:18.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.115+0000 7f09afbb7640 1 -- 172.21.15.19:0/2051369361 wait complete. 2024-09-12T01:56:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.116+0000 7f3da571f640 1 -- 172.21.15.19:0/4056158331 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3d8006c030 msgr2=0x7f3d8006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.116+0000 7f3da571f640 1 --2- 172.21.15.19:0/4056158331 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3d8006c030 0x7f3d8006e4f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3da00b1a20 tx=0x7f3d900079c0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.116+0000 7f3da571f640 1 -- 172.21.15.19:0/4056158331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da015b090 msgr2=0x7f3da009cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.116+0000 7f3da571f640 1 --2- 172.21.15.19:0/4056158331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da015b090 0x7f3da009cf00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3d9802add0 tx=0x7f3d98004a40 comp rx=0 tx=0).stop 2024-09-12T01:56:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.116+0000 7f3da571f640 1 -- 172.21.15.19:0/4056158331 shutdown_connections 2024-09-12T01:56:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.116+0000 7f3da571f640 1 --2- 172.21.15.19:0/4056158331 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3d8006c030 0x7f3d8006e4f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.116+0000 7f3da571f640 1 --2- 172.21.15.19:0/4056158331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da015b090 0x7f3da009cf00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.116+0000 7f3da571f640 1 --2- 172.21.15.19:0/4056158331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3da006fdc0 0x7f3da014e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.116+0000 7f3da571f640 1 --2- 172.21.15.19:0/4056158331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3da006e680 0x7f3da00cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.116+0000 7f3da571f640 1 -- 172.21.15.19:0/4056158331 >> 172.21.15.19:0/4056158331 conn(0x7f3da006c240 msgr2=0x7f3da01585d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:18.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.116+0000 7f3da571f640 1 -- 172.21.15.19:0/4056158331 shutdown_connections 2024-09-12T01:56:18.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:18.116+0000 7f3da571f640 1 -- 172.21.15.19:0/4056158331 wait complete. 2024-09-12T01:56:18.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.1 2024-09-12T01:56:18.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.2 2024-09-12T01:56:18.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.5 2024-09-12T01:56:18.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.0 2024-09-12T01:56:18.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.7 2024-09-12T01:56:18.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.3 2024-09-12T01:56:19.119 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T01:56:19.120 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T01:56:19.123 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T01:56:19.129 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T01:56:19.130 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T01:56:19.133 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T01:56:19.136 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T01:56:19.137 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T01:56:19.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.286+0000 7f0226dd6640 1 Processor -- start 2024-09-12T01:56:19.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.286+0000 7f0226dd6640 1 -- start start 2024-09-12T01:56:19.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.288+0000 7f0226dd6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02200b61e0 0x7f02200b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.288+0000 7f0226dd6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f02200b6b00 0x7f02200cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.288+0000 7f0226dd6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f02200d3ad0 0x7f02200cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.288+0000 7f0226dd6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f02200c7e50 con 0x7f02200d3ad0 2024-09-12T01:56:19.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.288+0000 7f0226dd6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f02200d3640 con 0x7f02200b6b00 2024-09-12T01:56:19.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.288+0000 7f0226dd6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f02200d5010 con 0x7f02200b61e0 2024-09-12T01:56:19.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.288+0000 7f0225373640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f02200d3ad0 0x7f02200cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.288+0000 7f0225373640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f02200d3ad0 0x7f02200cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42240/0 (socket says 172.21.15.19:42240) 2024-09-12T01:56:19.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.288+0000 7f0225373640 1 -- 172.21.15.19:0/3689861841 learned_addr learned my addr 172.21.15.19:0/3689861841 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:19.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.289+0000 7f021ffff640 1 --2- 172.21.15.19:0/3689861841 >> v2:172.21.15.135:3300/0 conn(0x7f02200b6b00 0x7f02200cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.289+0000 7f0225373640 1 -- 172.21.15.19:0/3689861841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02200b61e0 msgr2=0x7f02200b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:19.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.289+0000 7f0225373640 1 --2- 172.21.15.19:0/3689861841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02200b61e0 0x7f02200b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.289+0000 7f0225373640 1 -- 172.21.15.19:0/3689861841 >> v2:172.21.15.135:3300/0 conn(0x7f02200b6b00 msgr2=0x7f02200cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:19.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.289+0000 7f0225373640 1 --2- 172.21.15.19:0/3689861841 >> v2:172.21.15.135:3300/0 conn(0x7f02200b6b00 0x7f02200cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.289+0000 7f0225373640 1 -- 172.21.15.19:0/3689861841 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022006e7e0 con 0x7f02200d3ad0 2024-09-12T01:56:19.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.290+0000 7f0225373640 1 --2- 172.21.15.19:0/3689861841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02200d3ad0 0x7f02200cf320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f02200ce910 tx=0x7f021402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65fee832ecb361 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.288+0000 7f17b3eeb640 1 Processor -- start 2024-09-12T01:56:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.289+0000 7f17b3eeb640 1 -- start start 2024-09-12T01:56:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.290+0000 7f17b3eeb640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f17ac15a2c0 0x7f17ac0cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.290+0000 7f17b3eeb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17ac15ea90 0x7f17ac0cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.290+0000 7f17b3eeb640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17ac0ce620 con 0x7f17ac0720b0 2024-09-12T01:56:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.290+0000 7f17b3eeb640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f17ac0ce3f0 con 0x7f17ac15ea90 2024-09-12T01:56:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.290+0000 7f17b3eeb640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f17ac0cf1f0 con 0x7f17ac15a2c0 2024-09-12T01:56:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.291+0000 7f17b1486640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17ac15ea90 0x7f17ac0cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.291+0000 7f17b1486640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17ac15ea90 0x7f17ac0cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42254/0 (socket says 172.21.15.19:42254) 2024-09-12T01:56:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.291+0000 7f17b1486640 1 -- 172.21.15.19:0/1429138322 learned_addr learned my addr 172.21.15.19:0/1429138322 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.291+0000 7f17b1c87640 1 --2- 172.21.15.19:0/1429138322 >> v2:172.21.15.135:3300/0 conn(0x7f17ac15a2c0 0x7f17ac0cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.292+0000 7f17b1486640 1 -- 172.21.15.19:0/1429138322 >> v2:172.21.15.135:3300/0 conn(0x7f17ac15a2c0 msgr2=0x7f17ac0cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.292+0000 7f17b1486640 1 --2- 172.21.15.19:0/1429138322 >> v2:172.21.15.135:3300/0 conn(0x7f17ac15a2c0 0x7f17ac0cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.292+0000 7f17b1486640 1 -- 172.21.15.19:0/1429138322 >> v1:172.21.15.135:6789/0 conn(0x7f17ac0720b0 legacy=0x7f17ac0b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.292+0000 7f17b1486640 1 -- 172.21.15.19:0/1429138322 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ac0ce8c0 con 0x7f17ac15ea90 2024-09-12T01:56:19.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.293+0000 7f17b1486640 1 --2- 172.21.15.19:0/1429138322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17ac15ea90 0x7f17ac0cf680 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0cf370 tx=0x7f17a802c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb299520e17f8b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.294+0000 7f17b0c85640 1 -- 172.21.15.19:0/1429138322 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a803a070 con 0x7f17ac15ea90 2024-09-12T01:56:19.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.294+0000 7f021f7fe640 1 -- 172.21.15.19:0/3689861841 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0214037070 con 0x7f02200d3ad0 2024-09-12T01:56:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.294+0000 7f17b0c85640 1 -- 172.21.15.19:0/1429138322 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a8032480 con 0x7f17ac15ea90 2024-09-12T01:56:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.294+0000 7f021f7fe640 1 -- 172.21.15.19:0/3689861841 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0214032440 con 0x7f02200d3ad0 2024-09-12T01:56:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.295+0000 7f17b3eeb640 1 -- 172.21.15.19:0/1429138322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17ac15ea90 msgr2=0x7f17ac0cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.295+0000 7f0226dd6640 1 -- 172.21.15.19:0/3689861841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02200d3ad0 msgr2=0x7f02200cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.295+0000 7f17b3eeb640 1 --2- 172.21.15.19:0/1429138322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17ac15ea90 0x7f17ac0cf680 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0cf370 tx=0x7f17a802c7a0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.295+0000 7f0226dd6640 1 --2- 172.21.15.19:0/3689861841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02200d3ad0 0x7f02200cf320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f02200ce910 tx=0x7f021402a200 comp rx=0 tx=0).stop 2024-09-12T01:56:19.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.295+0000 7f17b3eeb640 1 -- 172.21.15.19:0/1429138322 shutdown_connections 2024-09-12T01:56:19.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.295+0000 7f17b3eeb640 1 --2- 172.21.15.19:0/1429138322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17ac15ea90 0x7f17ac0cf680 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.295+0000 7f17b3eeb640 1 --2- 172.21.15.19:0/1429138322 >> v2:172.21.15.135:3300/0 conn(0x7f17ac15a2c0 0x7f17ac0cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.295+0000 7f17b3eeb640 1 -- 172.21.15.19:0/1429138322 >> 172.21.15.19:0/1429138322 conn(0x7f17ac067b30 msgr2=0x7f17ac06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.296+0000 7f0226dd6640 1 -- 172.21.15.19:0/3689861841 shutdown_connections 2024-09-12T01:56:19.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.296+0000 7f0226dd6640 1 --2- 172.21.15.19:0/3689861841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02200d3ad0 0x7f02200cf320 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.296+0000 7f0226dd6640 1 --2- 172.21.15.19:0/3689861841 >> v2:172.21.15.135:3300/0 conn(0x7f02200b6b00 0x7f02200cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.296+0000 7f0226dd6640 1 --2- 172.21.15.19:0/3689861841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02200b61e0 0x7f02200b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.296+0000 7f0226dd6640 1 -- 172.21.15.19:0/3689861841 >> 172.21.15.19:0/3689861841 conn(0x7f02200d44f0 msgr2=0x7f02200d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.296+0000 7f17b3eeb640 1 -- 172.21.15.19:0/1429138322 shutdown_connections 2024-09-12T01:56:19.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.296+0000 7f17b3eeb640 1 -- 172.21.15.19:0/1429138322 wait complete. 2024-09-12T01:56:19.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.297+0000 7f0226dd6640 1 -- 172.21.15.19:0/3689861841 shutdown_connections 2024-09-12T01:56:19.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.298+0000 7f17b3eeb640 1 Processor -- start 2024-09-12T01:56:19.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.297+0000 7f0226dd6640 1 -- 172.21.15.19:0/3689861841 wait complete. 2024-09-12T01:56:19.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.299+0000 7f0226dd6640 1 Processor -- start 2024-09-12T01:56:19.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.298+0000 7f17b3eeb640 1 -- start start 2024-09-12T01:56:19.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.299+0000 7f17b3eeb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17ac0720b0 0x7f17ac1f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.299+0000 7f17b3eeb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17ac15a2c0 0x7f17ac14aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.299+0000 7f17b3eeb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17ac15ea90 0x7f17ac153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.299+0000 7f17b3eeb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac0ccf20 con 0x7f17ac0720b0 2024-09-12T01:56:19.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.300+0000 7f17b3eeb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac0cee80 con 0x7f17ac15a2c0 2024-09-12T01:56:19.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.300+0000 7f17b3eeb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f17ac0cfbc0 con 0x7f17ac15ea90 2024-09-12T01:56:19.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.299+0000 7f0226dd6640 1 -- start start 2024-09-12T01:56:19.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.300+0000 7f17b2488640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17ac15ea90 0x7f17ac153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.300+0000 7f17b2488640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17ac15ea90 0x7f17ac153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:42376/0 (socket says 172.21.15.19:42376) 2024-09-12T01:56:19.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.301+0000 7f17b2488640 1 -- 172.21.15.19:0/2028127802 learned_addr learned my addr 172.21.15.19:0/2028127802 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:19.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.301+0000 7f0226dd6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02200b61e0 0x7f022006d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.301+0000 7f17b1486640 1 --2- 172.21.15.19:0/2028127802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17ac15a2c0 0x7f17ac14aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.301+0000 7f17b1c87640 1 --2- 172.21.15.19:0/2028127802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17ac0720b0 0x7f17ac1f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.301+0000 7f0226dd6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02200b6b00 0x7f02200c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.301+0000 7f17b2488640 1 -- 172.21.15.19:0/2028127802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17ac15a2c0 msgr2=0x7f17ac14aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.301+0000 7f0224b72640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02200b61e0 0x7f022006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.301+0000 7f17b2488640 1 --2- 172.21.15.19:0/2028127802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17ac15a2c0 0x7f17ac14aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.301+0000 7f17b2488640 1 -- 172.21.15.19:0/2028127802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17ac0720b0 msgr2=0x7f17ac1f7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.301+0000 7f0224b72640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02200b61e0 0x7f022006d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:42384/0 (socket says 172.21.15.19:42384) 2024-09-12T01:56:19.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.301+0000 7f17b2488640 1 --2- 172.21.15.19:0/2028127802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17ac0720b0 0x7f17ac1f7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.302+0000 7f17b2488640 1 -- 172.21.15.19:0/2028127802 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ac14b410 con 0x7f17ac15ea90 2024-09-12T01:56:19.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.302+0000 7f17b1c87640 1 --2- 172.21.15.19:0/2028127802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17ac0720b0 0x7f17ac1f7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:19.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.302+0000 7f17b2488640 1 --2- 172.21.15.19:0/2028127802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17ac15ea90 0x7f17ac153680 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f179c00c3f0 tx=0x7f179c00c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.302+0000 7f021ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02200b6b00 0x7f02200c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.302+0000 7f021ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02200b6b00 0x7f02200c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42282/0 (socket says 172.21.15.19:42282) 2024-09-12T01:56:19.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.302+0000 7f0224b72640 1 -- 172.21.15.19:0/2532142830 learned_addr learned my addr 172.21.15.19:0/2532142830 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:19.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.302+0000 7f0226dd6640 1 --2- 172.21.15.19:0/2532142830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02200d3ad0 0x7f0220204f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.302+0000 7f17a27fc640 1 -- 172.21.15.19:0/2028127802 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c0052d0 con 0x7f17ac15ea90 2024-09-12T01:56:19.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.302+0000 7f17b3eeb640 1 -- 172.21.15.19:0/2028127802 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ac14ef80 con 0x7f17ac15ea90 2024-09-12T01:56:19.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.302+0000 7f17b3eeb640 1 -- 172.21.15.19:0/2028127802 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ac14f540 con 0x7f17ac15ea90 2024-09-12T01:56:19.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.303+0000 7f17a27fc640 1 -- 172.21.15.19:0/2028127802 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179c005470 con 0x7f17ac15ea90 2024-09-12T01:56:19.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.303+0000 7f17a27fc640 1 -- 172.21.15.19:0/2028127802 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c0052d0 con 0x7f17ac15ea90 2024-09-12T01:56:19.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.303+0000 7f0226dd6640 1 -- 172.21.15.19:0/2532142830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f02200c76b0 con 0x7f02200b6b00 2024-09-12T01:56:19.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.303+0000 7f0226dd6640 1 -- 172.21.15.19:0/2532142830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f02200d52f0 con 0x7f02200d3ad0 2024-09-12T01:56:19.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.303+0000 7f0226dd6640 1 -- 172.21.15.19:0/2532142830 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f02200c7830 con 0x7f02200b61e0 2024-09-12T01:56:19.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.305+0000 7f17b3eeb640 1 -- 172.21.15.19:0/2028127802 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17ac15a6a0 con 0x7f17ac15ea90 2024-09-12T01:56:19.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.304+0000 7f0224b72640 1 -- 172.21.15.19:0/2532142830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02200d3ad0 msgr2=0x7f0220204f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:56:19.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.304+0000 7f0224b72640 1 --2- 172.21.15.19:0/2532142830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02200d3ad0 0x7f0220204f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.304+0000 7f0224b72640 1 -- 172.21.15.19:0/2532142830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02200b6b00 msgr2=0x7f02200c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.304+0000 7f0224b72640 1 --2- 172.21.15.19:0/2532142830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02200b6b00 0x7f02200c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.304+0000 7f0224b72640 1 -- 172.21.15.19:0/2532142830 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02200ca360 con 0x7f02200b61e0 2024-09-12T01:56:19.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.304+0000 7f021ffff640 1 --2- 172.21.15.19:0/2532142830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02200b6b00 0x7f02200c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:19.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.306+0000 7f17a27fc640 1 -- 172.21.15.19:0/2028127802 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f179c007020 con 0x7f17ac15ea90 2024-09-12T01:56:19.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.306+0000 7f0224b72640 1 --2- 172.21.15.19:0/2532142830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02200b61e0 0x7f022006d510 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f021000b4d0 tx=0x7f021000b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.306+0000 7f021d7fa640 1 -- 172.21.15.19:0/2532142830 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210014070 con 0x7f02200b61e0 2024-09-12T01:56:19.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.306+0000 7f021d7fa640 1 -- 172.21.15.19:0/2532142830 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0210010870 con 0x7f02200b61e0 2024-09-12T01:56:19.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.306+0000 7f021d7fa640 1 -- 172.21.15.19:0/2532142830 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210010c60 con 0x7f02200b61e0 2024-09-12T01:56:19.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.306+0000 7f17a27fc640 1 --2- 172.21.15.19:0/2028127802 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f179006c260 0x7f179006e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.307+0000 7f0226dd6640 1 -- 172.21.15.19:0/2532142830 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02200ca640 con 0x7f02200b61e0 2024-09-12T01:56:19.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.307+0000 7f17b1c87640 1 --2- 172.21.15.19:0/2028127802 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f179006c260 0x7f179006e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.307+0000 7f0226dd6640 1 -- 172.21.15.19:0/2532142830 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f02200cac00 con 0x7f02200b61e0 2024-09-12T01:56:19.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.307+0000 7f17a27fc640 1 -- 172.21.15.19:0/2028127802 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f179c0050d0 con 0x7f17ac15ea90 2024-09-12T01:56:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.309+0000 7f0206ffd640 1 -- 172.21.15.19:0/2532142830 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f8005290 con 0x7f02200b61e0 2024-09-12T01:56:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.310+0000 7f021d7fa640 1 -- 172.21.15.19:0/2532142830 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0210017070 con 0x7f02200b61e0 2024-09-12T01:56:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.311+0000 7f021d7fa640 1 --2- 172.21.15.19:0/2532142830 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f020c06be80 0x7f020c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.311+0000 7f021d7fa640 1 -- 172.21.15.19:0/2532142830 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f021008af30 con 0x7f02200b61e0 2024-09-12T01:56:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.312+0000 7f021ffff640 1 --2- 172.21.15.19:0/2532142830 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f020c06be80 0x7f020c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.312+0000 7f17b1c87640 1 --2- 172.21.15.19:0/2028127802 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f179006c260 0x7f179006e720 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f17a40074c0 tx=0x7f17a400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.312+0000 7f021ffff640 1 --2- 172.21.15.19:0/2532142830 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f020c06be80 0x7f020c06e340 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f02200cb1e0 tx=0x7f0218009850 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.314+0000 7f17a27fc640 1 -- 172.21.15.19:0/2028127802 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f179c057fa0 con 0x7f17ac15ea90 2024-09-12T01:56:19.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.318+0000 7f021d7fa640 1 -- 172.21.15.19:0/2532142830 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0210058f30 con 0x7f02200b61e0 2024-09-12T01:56:19.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.345+0000 7f0717926640 1 Processor -- start 2024-09-12T01:56:19.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.345+0000 7f0717926640 1 -- start start 2024-09-12T01:56:19.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.346+0000 7f0717926640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f07100cee90 0x7f071006db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.346+0000 7f0717926640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07100c50a0 0x7f0710071a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.346+0000 7f0717926640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f07100cf270 0x7f07100d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.346+0000 7f0717926640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f0710071fd0 con 0x7f07100cf270 2024-09-12T01:56:19.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.346+0000 7f0717926640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0710070a10 con 0x7f07100cee90 2024-09-12T01:56:19.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.346+0000 7f0717926640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0710070cf0 con 0x7f07100c50a0 2024-09-12T01:56:19.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.347+0000 7f07156c2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f07100cee90 0x7f071006db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.347+0000 7f07156c2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f07100cee90 0x7f071006db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:58160/0 (socket says 172.21.15.19:58160) 2024-09-12T01:56:19.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.347+0000 7f07156c2640 1 -- 172.21.15.19:0/3286678186 learned_addr learned my addr 172.21.15.19:0/3286678186 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:19.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.347+0000 7f0715ec3640 1 --2- 172.21.15.19:0/3286678186 >> v2:172.21.15.19:3300/0 conn(0x7f07100cf270 0x7f07100d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.347+0000 7f07156c2640 1 -- 172.21.15.19:0/3286678186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07100c50a0 msgr2=0x7f0710071a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:19.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.347+0000 7f0714ec1640 1 --2- 172.21.15.19:0/3286678186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07100c50a0 0x7f0710071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.347+0000 7f07156c2640 1 --2- 172.21.15.19:0/3286678186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07100c50a0 0x7f0710071a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.347+0000 7f07156c2640 1 -- 172.21.15.19:0/3286678186 >> v2:172.21.15.19:3300/0 conn(0x7f07100cf270 msgr2=0x7f07100d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:19.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.347+0000 7f07156c2640 1 --2- 172.21.15.19:0/3286678186 >> v2:172.21.15.19:3300/0 conn(0x7f07100cf270 0x7f07100d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.347+0000 7f07156c2640 1 -- 172.21.15.19:0/3286678186 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0710070fd0 con 0x7f07100cee90 2024-09-12T01:56:19.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.349+0000 7f07156c2640 1 --2- 172.21.15.19:0/3286678186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07100cee90 0x7f071006db10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f071006fa90 tx=0x7f070c02a1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6167ad8235ed267 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.349+0000 7f0707fff640 1 -- 172.21.15.19:0/3286678186 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c037070 con 0x7f07100cee90 2024-09-12T01:56:19.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.349+0000 7f23effff640 1 Processor -- start 2024-09-12T01:56:19.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.349+0000 7f0707fff640 1 -- 172.21.15.19:0/3286678186 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f070c032440 con 0x7f07100cee90 2024-09-12T01:56:19.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.349+0000 7f0707fff640 1 -- 172.21.15.19:0/3286678186 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c032850 con 0x7f07100cee90 2024-09-12T01:56:19.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.349+0000 7f6177303640 1 Processor -- start 2024-09-12T01:56:19.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.350+0000 7f6177303640 1 -- start start 2024-09-12T01:56:19.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.350+0000 7f0717926640 1 -- 172.21.15.19:0/3286678186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07100cee90 msgr2=0x7f071006db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.350+0000 7f0717926640 1 --2- 172.21.15.19:0/3286678186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07100cee90 0x7f071006db10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f071006fa90 tx=0x7f070c02a1f0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.349+0000 7f0dcb391640 1 Processor -- start 2024-09-12T01:56:19.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.350+0000 7f0dcb391640 1 -- start start 2024-09-12T01:56:19.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.350+0000 7f0717926640 1 -- 172.21.15.19:0/3286678186 shutdown_connections 2024-09-12T01:56:19.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.350+0000 7f0717926640 1 --2- 172.21.15.19:0/3286678186 >> v2:172.21.15.19:3300/0 conn(0x7f07100cf270 0x7f07100d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.349+0000 7f23effff640 1 -- start start 2024-09-12T01:56:19.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f23effff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f015d730 0x7f23f0073860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f23effff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f23f00b4350 0x7f23f006f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f23effff640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23f0071fd0 con 0x7f23f006f110 2024-09-12T01:56:19.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f23effff640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f23f0073da0 con 0x7f23f00b4350 2024-09-12T01:56:19.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f23effff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f23f006fa90 con 0x7f23f015d730 2024-09-12T01:56:19.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.350+0000 7f0717926640 1 --2- 172.21.15.19:0/3286678186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07100c50a0 0x7f0710071a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.350+0000 7f0717926640 1 --2- 172.21.15.19:0/3286678186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07100cee90 0x7f071006db10 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f071006fa90 tx=0x7f070c02a1f0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f23ef7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f23f00b4350 0x7f23f006f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.350+0000 7f0717926640 1 -- 172.21.15.19:0/3286678186 >> 172.21.15.19:0/3286678186 conn(0x7f07100b3ed0 msgr2=0x7f07100b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f23ef7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f23f00b4350 0x7f23f006f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:58172/0 (socket says 172.21.15.19:58172) 2024-09-12T01:56:19.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f23ef7fe640 1 -- 172.21.15.19:0/3232842178 learned_addr learned my addr 172.21.15.19:0/3232842178 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:19.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f6177303640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f61700720b0 0x7f61700cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f6177303640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6170162ad0 0x7f617006f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f0717926640 1 -- 172.21.15.19:0/3286678186 shutdown_connections 2024-09-12T01:56:19.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f23eeffd640 1 --2- 172.21.15.19:0/3232842178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f015d730 0x7f23f0073860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f23ef7fe640 1 -- 172.21.15.19:0/3232842178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f015d730 msgr2=0x7f23f0073860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:19.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f0dcb391640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0dc4165f00 0x7f0dc40b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f6177303640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61700b49a0 con 0x7f6170072490 2024-09-12T01:56:19.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f6177303640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f61700afa20 con 0x7f61700720b0 2024-09-12T01:56:19.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f6177303640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f61700afce0 con 0x7f6170162ad0 2024-09-12T01:56:19.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f0717926640 1 -- 172.21.15.19:0/3286678186 wait complete. 2024-09-12T01:56:19.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.352+0000 7f61758a0640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f6170072490 0x7f61700b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:41900/0 (socket says 172.21.15.19:41900) 2024-09-12T01:56:19.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f0dcb391640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dc40729a0 0x7f0dc40cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f0dcb391640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dc40b42c0 con 0x7f0dc40b3c90 2024-09-12T01:56:19.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f0dcb391640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0dc40b45a0 con 0x7f0dc4165f00 2024-09-12T01:56:19.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.352+0000 7f0dcb391640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc40ce480 con 0x7f0dc40729a0 2024-09-12T01:56:19.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.352+0000 7f61758a0640 1 -- 172.21.15.19:0/1245967759 learned_addr learned my addr 172.21.15.19:0/1245967759 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:19.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.352+0000 7f617509f640 1 --2- 172.21.15.19:0/1245967759 >> v2:172.21.15.135:3300/0 conn(0x7f61700720b0 0x7f61700cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.352+0000 7f0dc912d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0dc4165f00 0x7f0dc40b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.352+0000 7f0dc912d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0dc4165f00 0x7f0dc40b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:58186/0 (socket says 172.21.15.19:58186) 2024-09-12T01:56:19.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.352+0000 7f0dc912d640 1 -- 172.21.15.19:0/384425958 learned_addr learned my addr 172.21.15.19:0/384425958 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:19.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.352+0000 7f0dc992e640 1 --2- 172.21.15.19:0/384425958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dc40729a0 0x7f0dc40cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.352+0000 7f617509f640 1 -- 172.21.15.19:0/1245967759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6170162ad0 msgr2=0x7f617006f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:56:19.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.352+0000 7f617509f640 1 --2- 172.21.15.19:0/1245967759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6170162ad0 0x7f617006f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.352+0000 7f617509f640 1 -- 172.21.15.19:0/1245967759 >> v1:172.21.15.135:6789/0 conn(0x7f6170072490 legacy=0x7f61700b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.352+0000 7f617509f640 1 -- 172.21.15.19:0/1245967759 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61700b34d0 con 0x7f61700720b0 2024-09-12T01:56:19.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.351+0000 7f23ef7fe640 1 --2- 172.21.15.19:0/3232842178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f015d730 0x7f23f0073860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.352+0000 7f23ef7fe640 1 -- 172.21.15.19:0/3232842178 >> v1:172.21.15.135:6789/0 conn(0x7f23f006f110 legacy=0x7f23f015df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.352+0000 7f23ef7fe640 1 -- 172.21.15.19:0/3232842178 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f00722b0 con 0x7f23f00b4350 2024-09-12T01:56:19.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.353+0000 7f23eeffd640 1 --2- 172.21.15.19:0/3232842178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f015d730 0x7f23f0073860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:19.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.352+0000 7f0dc912d640 1 -- 172.21.15.19:0/384425958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dc40729a0 msgr2=0x7f0dc40cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.352+0000 7f0dc912d640 1 --2- 172.21.15.19:0/384425958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dc40729a0 0x7f0dc40cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.352+0000 7f0dc912d640 1 -- 172.21.15.19:0/384425958 >> v1:172.21.15.19:6789/0 conn(0x7f0dc40b3c90 legacy=0x7f0dc4072290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:56:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.352+0000 7f0dc912d640 1 -- 172.21.15.19:0/384425958 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc40ce760 con 0x7f0dc4165f00 2024-09-12T01:56:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.349+0000 7f99096af640 1 Processor -- start 2024-09-12T01:56:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.350+0000 7f99096af640 1 -- start start 2024-09-12T01:56:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.353+0000 7f23ef7fe640 1 --2- 172.21.15.19:0/3232842178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f00b4350 0x7f23f006f550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f23e80096b0 tx=0x7f23e802cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d59b2e52a79306f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.353+0000 7f99096af640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f98fc100810 0x7f98fc009f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.353+0000 7f99096af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98fc00b770 0x7f98fc036020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.353+0000 7f99096af640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98fc006940 con 0x7f98fc04eb60 2024-09-12T01:56:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.353+0000 7f99096af640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f98fc007480 con 0x7f98fc100810 2024-09-12T01:56:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.353+0000 7f99096af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f98fc0553c0 con 0x7f98fc00b770 2024-09-12T01:56:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.353+0000 7f09aff8f640 1 Processor -- start 2024-09-12T01:56:19.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.353+0000 7f617509f640 1 --2- 172.21.15.19:0/1245967759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61700720b0 0x7f61700cfca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f61600097a0 tx=0x7f616002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4577a5164e4dcd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.353+0000 7f0717926640 1 Processor -- start 2024-09-12T01:56:19.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.353+0000 7f23ee7fc640 1 -- 172.21.15.19:0/3232842178 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e802d780 con 0x7f23f00b4350 2024-09-12T01:56:19.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.353+0000 7f23ee7fc640 1 -- 172.21.15.19:0/3232842178 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e802d920 con 0x7f23f00b4350 2024-09-12T01:56:19.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.353+0000 7f0717926640 1 -- start start 2024-09-12T01:56:19.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.353+0000 7f99027fc640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f98fc04eb60 0x7f98fc054cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:41914/0 (socket says 172.21.15.19:41914) 2024-09-12T01:56:19.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f6167fff640 1 -- 172.21.15.19:0/1245967759 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6160037070 con 0x7f61700720b0 2024-09-12T01:56:19.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f6167fff640 1 -- 172.21.15.19:0/1245967759 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6160032440 con 0x7f61700720b0 2024-09-12T01:56:19.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f6167fff640 1 -- 172.21.15.19:0/1245967759 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6160032810 con 0x7f61700720b0 2024-09-12T01:56:19.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.353+0000 7f99027fc640 1 -- 172.21.15.19:0/2024521096 learned_addr learned my addr 172.21.15.19:0/2024521096 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:19.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f23ee7fc640 1 -- 172.21.15.19:0/3232842178 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e802dcd0 con 0x7f23f00b4350 2024-09-12T01:56:19.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f9901ffb640 1 -- 172.21.15.19:0/2024521096 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2389602121 0 0) 0x7f98fc006940 con 0x7f98fc04eb60 2024-09-12T01:56:19.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f9901ffb640 1 -- 172.21.15.19:0/2024521096 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98ec003520 con 0x7f98fc04eb60 2024-09-12T01:56:19.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f0dc912d640 1 --2- 172.21.15.19:0/384425958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dc4165f00 0x7f0dc40b3750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0db40098a0 tx=0x7f0db402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62aedf3082c402fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f9901ffb640 1 -- 172.21.15.19:0/2024521096 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3797894815 0 0) 0x7f98ec003520 con 0x7f98fc04eb60 2024-09-12T01:56:19.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f9901ffb640 1 -- 172.21.15.19:0/2024521096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98fc00b770 msgr2=0x7f98fc036020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:19.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f9901ffb640 1 --2- 172.21.15.19:0/2024521096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98fc00b770 0x7f98fc036020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f9901ffb640 1 -- 172.21.15.19:0/2024521096 >> v2:172.21.15.135:3300/0 conn(0x7f98fc100810 msgr2=0x7f98fc009f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:19.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f9901ffb640 1 --2- 172.21.15.19:0/2024521096 >> v2:172.21.15.135:3300/0 conn(0x7f98fc100810 0x7f98fc009f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f9901ffb640 1 -- 172.21.15.19:0/2024521096 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc006e70 con 0x7f98fc04eb60 2024-09-12T01:56:19.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f9901ffb640 1 -- 172.21.15.19:0/2024521096 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f990404ffb0 con 0x7f98fc04eb60 2024-09-12T01:56:19.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f9901ffb640 1 -- 172.21.15.19:0/2024521096 >> v1:172.21.15.135:6789/0 conn(0x7f98fc04eb60 legacy=0x7f98fc054cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f9901ffb640 1 --2- 172.21.15.19:0/2024521096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98ec0039b0 0x7f98ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f9901ffb640 1 --2- 172.21.15.19:0/2024521096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98ec004800 0x7f98ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f9901ffb640 1 --2- 172.21.15.19:0/2024521096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98ec0051c0 0x7f98ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f9901ffb640 1 -- 172.21.15.19:0/2024521096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc007480 con 0x7f98ec0051c0 2024-09-12T01:56:19.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f9901ffb640 1 -- 172.21.15.19:0/2024521096 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc0553c0 con 0x7f98ec004800 2024-09-12T01:56:19.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f9901ffb640 1 -- 172.21.15.19:0/2024521096 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f98ec00c1c0 con 0x7f98ec0039b0 2024-09-12T01:56:19.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f23effff640 1 -- 172.21.15.19:0/3232842178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f00b4350 msgr2=0x7f23f006f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f23effff640 1 --2- 172.21.15.19:0/3232842178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f00b4350 0x7f23f006f550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f23e80096b0 tx=0x7f23e802cc40 comp rx=0 tx=0).stop 2024-09-12T01:56:19.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f23effff640 1 -- 172.21.15.19:0/3232842178 shutdown_connections 2024-09-12T01:56:19.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f23effff640 1 --2- 172.21.15.19:0/3232842178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f00b4350 0x7f23f006f550 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f23effff640 1 --2- 172.21.15.19:0/3232842178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f015d730 0x7f23f0073860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f23effff640 1 -- 172.21.15.19:0/3232842178 >> 172.21.15.19:0/3232842178 conn(0x7f23f00b1e00 msgr2=0x7f23f00b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f6177303640 1 -- 172.21.15.19:0/1245967759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61700720b0 msgr2=0x7f61700cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f6177303640 1 --2- 172.21.15.19:0/1245967759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61700720b0 0x7f61700cfca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f61600097a0 tx=0x7f616002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f99027fc640 1 --2- 172.21.15.19:0/2024521096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98ec004800 0x7f98ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f6177303640 1 -- 172.21.15.19:0/1245967759 shutdown_connections 2024-09-12T01:56:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f6177303640 1 --2- 172.21.15.19:0/1245967759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6170162ad0 0x7f617006f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f6177303640 1 --2- 172.21.15.19:0/1245967759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61700720b0 0x7f61700cfca0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f0dbbfff640 1 -- 172.21.15.19:0/384425958 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4037070 con 0x7f0dc4165f00 2024-09-12T01:56:19.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f0dbbfff640 1 -- 172.21.15.19:0/384425958 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db4032440 con 0x7f0dc4165f00 2024-09-12T01:56:19.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f0dbbfff640 1 -- 172.21.15.19:0/384425958 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4032810 con 0x7f0dc4165f00 2024-09-12T01:56:19.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f0717926640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07100c50a0 0x7f07100b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f6177303640 1 -- 172.21.15.19:0/1245967759 >> 172.21.15.19:0/1245967759 conn(0x7f6170067d70 msgr2=0x7f617006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.353+0000 7f09aff8f640 1 -- start start 2024-09-12T01:56:19.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f0717926640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07100cf270 0x7f07100b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f6177303640 1 -- 172.21.15.19:0/1245967759 shutdown_connections 2024-09-12T01:56:19.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f09aff8f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f09a80720b0 0x7f09a80cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f6177303640 1 -- 172.21.15.19:0/1245967759 wait complete. 2024-09-12T01:56:19.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f07156c2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07100c50a0 0x7f07100b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f09aff8f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a806f6f0 0x7f09a80b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f09ad52a640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f09a8162ad0 0x7f09a8072490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44850/0 (socket says 172.21.15.19:44850) 2024-09-12T01:56:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f07156c2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07100c50a0 0x7f07100b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42298/0 (socket says 172.21.15.19:42298) 2024-09-12T01:56:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f23effff640 1 -- 172.21.15.19:0/3232842178 shutdown_connections 2024-09-12T01:56:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.354+0000 7f23effff640 1 -- 172.21.15.19:0/3232842178 wait complete. 2024-09-12T01:56:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f07156c2640 1 -- 172.21.15.19:0/2373920420 learned_addr learned my addr 172.21.15.19:0/2373920420 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f09aff8f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a80afa20 con 0x7f09a8162ad0 2024-09-12T01:56:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f09aff8f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f09a80afce0 con 0x7f09a80720b0 2024-09-12T01:56:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f09aff8f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f09a80b34d0 con 0x7f09a806f6f0 2024-09-12T01:56:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f09ae52c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a806f6f0 0x7f09a80b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f09ae52c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a806f6f0 0x7f09a80b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:42422/0 (socket says 172.21.15.19:42422) 2024-09-12T01:56:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f09ae52c640 1 -- 172.21.15.19:0/296590171 learned_addr learned my addr 172.21.15.19:0/296590171 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f0717926640 1 --2- 172.21.15.19:0/2373920420 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07100b5f10 0x7f07100b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f0714ec1640 1 --2- 172.21.15.19:0/2373920420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07100cf270 0x7f07100b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f99027fc640 1 -- 172.21.15.19:0/2024521096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98ec0039b0 msgr2=0x7f98ec003dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:56:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f99027fc640 1 --2- 172.21.15.19:0/2024521096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98ec0039b0 0x7f98ec003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f99027fc640 1 -- 172.21.15.19:0/2024521096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98ec0051c0 msgr2=0x7f98ec00b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:56:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f99027fc640 1 --2- 172.21.15.19:0/2024521096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98ec0051c0 0x7f98ec00b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f99027fc640 1 -- 172.21.15.19:0/2024521096 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc006e70 con 0x7f98ec004800 2024-09-12T01:56:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f0717926640 1 -- 172.21.15.19:0/2373920420 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f07100706c0 con 0x7f07100c50a0 2024-09-12T01:56:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f0717926640 1 -- 172.21.15.19:0/2373920420 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0710071590 con 0x7f07100cf270 2024-09-12T01:56:19.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f0dcb391640 1 -- 172.21.15.19:0/384425958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dc4165f00 msgr2=0x7f0dc40b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f0dcb391640 1 --2- 172.21.15.19:0/384425958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dc4165f00 0x7f0dc40b3750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0db40098a0 tx=0x7f0db402a250 comp rx=0 tx=0).stop 2024-09-12T01:56:19.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f0dcb391640 1 -- 172.21.15.19:0/384425958 shutdown_connections 2024-09-12T01:56:19.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f0dcb391640 1 --2- 172.21.15.19:0/384425958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dc40729a0 0x7f0dc40cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f0dcb391640 1 --2- 172.21.15.19:0/384425958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dc4165f00 0x7f0dc40b3750 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.355+0000 7f0dcb391640 1 -- 172.21.15.19:0/384425958 >> 172.21.15.19:0/384425958 conn(0x7f0dc406bc10 msgr2=0x7f0dc406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f09ae52c640 1 -- 172.21.15.19:0/296590171 >> v2:172.21.15.135:3300/0 conn(0x7f09a80720b0 msgr2=0x7f09a80cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:19.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f0717926640 1 -- 172.21.15.19:0/2373920420 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f07100d0800 con 0x7f07100b5f10 2024-09-12T01:56:19.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f09ae52c640 1 --2- 172.21.15.19:0/296590171 >> v2:172.21.15.135:3300/0 conn(0x7f09a80720b0 0x7f09a80cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f09ae52c640 1 -- 172.21.15.19:0/296590171 >> v1:172.21.15.19:6789/0 conn(0x7f09a8162ad0 legacy=0x7f09a8072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:19.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f99027fc640 1 --2- 172.21.15.19:0/2024521096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98ec004800 0x7f98ec004c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f99040504d0 tx=0x7f98ec005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=385daca93a6f629d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f0dcb391640 1 -- 172.21.15.19:0/384425958 shutdown_connections 2024-09-12T01:56:19.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.357+0000 7f9901ffb640 1 -- 172.21.15.19:0/2024521096 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9904075800 con 0x7f98ec004800 2024-09-12T01:56:19.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.357+0000 7f9901ffb640 1 -- 172.21.15.19:0/2024521096 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f990406d130 con 0x7f98ec004800 2024-09-12T01:56:19.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.357+0000 7f07156c2640 1 -- 172.21.15.19:0/2373920420 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07100b5f10 msgr2=0x7f07100b6b30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:56:19.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.357+0000 7f07156c2640 1 --2- 172.21.15.19:0/2373920420 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07100b5f10 0x7f07100b6b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.357+0000 7f07156c2640 1 -- 172.21.15.19:0/2373920420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07100cf270 msgr2=0x7f07100b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.357+0000 7f07156c2640 1 --2- 172.21.15.19:0/2373920420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07100cf270 0x7f07100b65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.357+0000 7f07156c2640 1 -- 172.21.15.19:0/2373920420 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0710153e50 con 0x7f07100c50a0 2024-09-12T01:56:19.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f09ae52c640 1 -- 172.21.15.19:0/296590171 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a80b37b0 con 0x7f09a806f6f0 2024-09-12T01:56:19.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.357+0000 7f09ae52c640 1 --2- 172.21.15.19:0/296590171 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a806f6f0 0x7f09a80b4290 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f09a8070280 tx=0x7f09a002a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8052efb588a57a23 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.357+0000 7f07156c2640 1 --2- 172.21.15.19:0/2373920420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07100c50a0 0x7f07100b59d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f070c0090b0 tx=0x7f070c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.358+0000 7f0705ffb640 1 -- 172.21.15.19:0/2373920420 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c041020 con 0x7f07100c50a0 2024-09-12T01:56:19.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.358+0000 7f0717926640 1 -- 172.21.15.19:0/2373920420 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0710154130 con 0x7f07100c50a0 2024-09-12T01:56:19.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.358+0000 7f09acd29640 1 -- 172.21.15.19:0/296590171 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a0036070 con 0x7f09a806f6f0 2024-09-12T01:56:19.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.358+0000 7f09acd29640 1 -- 172.21.15.19:0/296590171 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a0031600 con 0x7f09a806f6f0 2024-09-12T01:56:19.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.358+0000 7f09acd29640 1 -- 172.21.15.19:0/296590171 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a00319b0 con 0x7f09a806f6f0 2024-09-12T01:56:19.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.357+0000 7f6177303640 1 Processor -- start 2024-09-12T01:56:19.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.357+0000 7f6177303640 1 -- start start 2024-09-12T01:56:19.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f0dcb391640 1 -- 172.21.15.19:0/384425958 wait complete. 2024-09-12T01:56:19.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.358+0000 7f99096af640 1 -- 172.21.15.19:0/2024521096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98ec004800 msgr2=0x7f98ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.358+0000 7f99096af640 1 --2- 172.21.15.19:0/2024521096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98ec004800 0x7f98ec004c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f99040504d0 tx=0x7f98ec005830 comp rx=0 tx=0).stop 2024-09-12T01:56:19.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.358+0000 7f99037fe640 1 -- 172.21.15.19:0/2024521096 reap_dead start 2024-09-12T01:56:19.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.358+0000 7f0705ffb640 1 -- 172.21.15.19:0/2373920420 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f070c0306c0 con 0x7f07100c50a0 2024-09-12T01:56:19.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.358+0000 7f99096af640 1 -- 172.21.15.19:0/2024521096 shutdown_connections 2024-09-12T01:56:19.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.358+0000 7f99096af640 1 -- 172.21.15.19:0/2024521096 >> 172.21.15.19:0/2024521096 conn(0x7f98fc01d930 msgr2=0x7f98fc0545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.358+0000 7f0717926640 1 -- 172.21.15.19:0/2373920420 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07100b51d0 con 0x7f07100c50a0 2024-09-12T01:56:19.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.356+0000 7f23effff640 1 Processor -- start 2024-09-12T01:56:19.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.357+0000 7f23effff640 1 -- start start 2024-09-12T01:56:19.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f6177303640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61700720b0 0x7f6170151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.358+0000 7f23effff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23f006f110 0x7f23f00af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f0705ffb640 1 -- 172.21.15.19:0/2373920420 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c037040 con 0x7f07100c50a0 2024-09-12T01:56:19.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f6177303640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6170072490 0x7f617015c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f6177303640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6170162ad0 0x7f6170164230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f617509f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61700720b0 0x7f6170151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f617509f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61700720b0 0x7f6170151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42302/0 (socket says 172.21.15.19:42302) 2024-09-12T01:56:19.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f0dcb391640 1 Processor -- start 2024-09-12T01:56:19.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f6177303640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f61700b3d70 con 0x7f61700720b0 2024-09-12T01:56:19.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f6177303640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f61700b3a90 con 0x7f6170162ad0 2024-09-12T01:56:19.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f6177303640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6170072940 con 0x7f6170072490 2024-09-12T01:56:19.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f617489e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6170072490 0x7f617015c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f617509f640 1 -- 172.21.15.19:0/870469614 learned_addr learned my addr 172.21.15.19:0/870469614 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:19.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f0dcb391640 1 -- start start 2024-09-12T01:56:19.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f61758a0640 1 --2- 172.21.15.19:0/870469614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6170162ad0 0x7f6170164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f09aff8f640 1 -- 172.21.15.19:0/296590171 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a806f6f0 msgr2=0x7f09a80b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f09aff8f640 1 --2- 172.21.15.19:0/296590171 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a806f6f0 0x7f09a80b4290 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f09a8070280 tx=0x7f09a002a6c0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.360+0000 7f61758a0640 1 -- 172.21.15.19:0/870469614 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6170072490 msgr2=0x7f617015c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.360+0000 7f61758a0640 1 --2- 172.21.15.19:0/870469614 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6170072490 0x7f617015c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.360+0000 7f61758a0640 1 -- 172.21.15.19:0/870469614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61700720b0 msgr2=0x7f6170151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.360+0000 7f61758a0640 1 --2- 172.21.15.19:0/870469614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61700720b0 0x7f6170151850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.360+0000 7f61758a0640 1 -- 172.21.15.19:0/870469614 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6170162eb0 con 0x7f6170162ad0 2024-09-12T01:56:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.358+0000 7f23effff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f00b4350 0x7f23f01f9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.360+0000 7f61758a0640 1 --2- 172.21.15.19:0/870469614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6170162ad0 0x7f6170164230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f616800cad0 tx=0x7f616800cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.358+0000 7f23effff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f015d730 0x7f23f01f8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.360+0000 7f09aff8f640 1 -- 172.21.15.19:0/296590171 shutdown_connections 2024-09-12T01:56:19.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.360+0000 7f09aff8f640 1 --2- 172.21.15.19:0/296590171 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a806f6f0 0x7f09a80b4290 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.360+0000 7f09aff8f640 1 --2- 172.21.15.19:0/296590171 >> v2:172.21.15.135:3300/0 conn(0x7f09a80720b0 0x7f09a80cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.360+0000 7f09aff8f640 1 -- 172.21.15.19:0/296590171 >> 172.21.15.19:0/296590171 conn(0x7f09a8067d70 msgr2=0x7f09a806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f99096af640 1 -- 172.21.15.19:0/2024521096 shutdown_connections 2024-09-12T01:56:19.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f99096af640 1 -- 172.21.15.19:0/2024521096 wait complete. 2024-09-12T01:56:19.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.358+0000 7f23e67fc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f00b4350 0x7f23f01f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.359+0000 7f23eeffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23f006f110 0x7f23f00af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.360+0000 7f23effff640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f23f0072b50 con 0x7f23f006f110 2024-09-12T01:56:19.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.360+0000 7f23e67fc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f00b4350 0x7f23f01f9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:42444/0 (socket says 172.21.15.19:42444) 2024-09-12T01:56:19.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.360+0000 7f23e67fc640 1 -- 172.21.15.19:0/2532534189 learned_addr learned my addr 172.21.15.19:0/2532534189 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:19.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.360+0000 7f23effff640 1 -- 172.21.15.19:0/2532534189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f23f0072870 con 0x7f23f015d730 2024-09-12T01:56:19.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.360+0000 7f23ef7fe640 1 --2- 172.21.15.19:0/2532534189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f015d730 0x7f23f01f8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.360+0000 7f23effff640 1 -- 172.21.15.19:0/2532534189 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f23f00cfd10 con 0x7f23f00b4350 2024-09-12T01:56:19.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.360+0000 7f0dcb391640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dc40729a0 0x7f0dc415ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.360+0000 7f6165ffb640 1 -- 172.21.15.19:0/870469614 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6168017070 con 0x7f6170162ad0 2024-09-12T01:56:19.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.361+0000 7f6165ffb640 1 -- 172.21.15.19:0/870469614 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f616800ac30 con 0x7f6170162ad0 2024-09-12T01:56:19.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.361+0000 7f0dcb391640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dc40b3c90 0x7f0dc414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.361+0000 7f0dcb391640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dc4165f00 0x7f0dc414d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.361+0000 7f0dcb391640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc40cf1c0 con 0x7f0dc40b3c90 2024-09-12T01:56:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.361+0000 7f0dcb391640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc40b4880 con 0x7f0dc4165f00 2024-09-12T01:56:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.361+0000 7f09aff8f640 1 -- 172.21.15.19:0/296590171 shutdown_connections 2024-09-12T01:56:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.361+0000 7f0dcb391640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc40cf340 con 0x7f0dc40729a0 2024-09-12T01:56:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.361+0000 7f09aff8f640 1 -- 172.21.15.19:0/296590171 wait complete. 2024-09-12T01:56:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.361+0000 7f6165ffb640 1 -- 172.21.15.19:0/870469614 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6168012400 con 0x7f6170162ad0 2024-09-12T01:56:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.361+0000 7f0dc912d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dc40729a0 0x7f0dc415ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.361+0000 7f6177303640 1 -- 172.21.15.19:0/870469614 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6170163190 con 0x7f6170162ad0 2024-09-12T01:56:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.361+0000 7f6177303640 1 -- 172.21.15.19:0/870469614 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6170163750 con 0x7f6170162ad0 2024-09-12T01:56:19.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.361+0000 7f0dc992e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dc4165f00 0x7f0dc414d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.361+0000 7f0dc992e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dc4165f00 0x7f0dc414d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:58260/0 (socket says 172.21.15.19:58260) 2024-09-12T01:56:19.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.361+0000 7f99096af640 1 Processor -- start 2024-09-12T01:56:19.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.361+0000 7f0dc992e640 1 -- 172.21.15.19:0/593241931 learned_addr learned my addr 172.21.15.19:0/593241931 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:19.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.362+0000 7f23ef7fe640 1 -- 172.21.15.19:0/2532534189 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f00b4350 msgr2=0x7f23f01f9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.362+0000 7f23ef7fe640 1 --2- 172.21.15.19:0/2532534189 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f00b4350 0x7f23f01f9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.362+0000 7f23ef7fe640 1 -- 172.21.15.19:0/2532534189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23f006f110 msgr2=0x7f23f00af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.362+0000 7f23ef7fe640 1 --2- 172.21.15.19:0/2532534189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23f006f110 0x7f23f00af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.362+0000 7f23ef7fe640 1 -- 172.21.15.19:0/2532534189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f0154470 con 0x7f23f015d730 2024-09-12T01:56:19.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.362+0000 7f23eeffd640 1 --2- 172.21.15.19:0/2532534189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23f006f110 0x7f23f00af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:19.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.361+0000 7f06fb7fe640 1 -- 172.21.15.19:0/2373920420 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0710071a90 con 0x7f07100c50a0 2024-09-12T01:56:19.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.362+0000 7f0705ffb640 1 -- 172.21.15.19:0/2373920420 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f070c044020 con 0x7f07100c50a0 2024-09-12T01:56:19.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.362+0000 7f23ef7fe640 1 --2- 172.21.15.19:0/2532534189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f015d730 0x7f23f01f8e00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f23e8033000 tx=0x7f23e8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.362+0000 7f0dc892c640 1 --2- 172.21.15.19:0/593241931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dc40b3c90 0x7f0dc414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.362+0000 7f0dc892c640 1 -- 172.21.15.19:0/593241931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dc40729a0 msgr2=0x7f0dc415ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.362+0000 7f0dc892c640 1 --2- 172.21.15.19:0/593241931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dc40729a0 0x7f0dc415ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.362+0000 7f0dc892c640 1 -- 172.21.15.19:0/593241931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dc4165f00 msgr2=0x7f0dc414d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.362+0000 7f0dc892c640 1 --2- 172.21.15.19:0/593241931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dc4165f00 0x7f0dc414d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.362+0000 7f0dc892c640 1 -- 172.21.15.19:0/593241931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc415d9a0 con 0x7f0dc40b3c90 2024-09-12T01:56:19.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.362+0000 7f0dc892c640 1 --2- 172.21.15.19:0/593241931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dc40b3c90 0x7f0dc414f9b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00bd50 tx=0x7f0dbc00be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.363+0000 7f09aff8f640 1 Processor -- start 2024-09-12T01:56:19.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.363+0000 7f6177303640 1 -- 172.21.15.19:0/870469614 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f617006ea40 con 0x7f6170162ad0 2024-09-12T01:56:19.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.363+0000 7f23e7fff640 1 -- 172.21.15.19:0/2532534189 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8003b90 con 0x7f23f015d730 2024-09-12T01:56:19.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.363+0000 7f09aff8f640 1 -- start start 2024-09-12T01:56:19.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.363+0000 7f0705ffb640 1 --2- 172.21.15.19:0/2373920420 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f06f406bf30 0x7f06f406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.363+0000 7f23e7fff640 1 -- 172.21.15.19:0/2532534189 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e8044070 con 0x7f23f015d730 2024-09-12T01:56:19.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.363+0000 7f23e7fff640 1 -- 172.21.15.19:0/2532534189 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8004040 con 0x7f23f015d730 2024-09-12T01:56:19.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.363+0000 7f0705ffb640 1 -- 172.21.15.19:0/2373920420 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f070c0ab8a0 con 0x7f07100c50a0 2024-09-12T01:56:19.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.363+0000 7f6165ffb640 1 -- 172.21.15.19:0/870469614 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f616801a070 con 0x7f6170162ad0 2024-09-12T01:56:19.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.363+0000 7f0714ec1640 1 --2- 172.21.15.19:0/2373920420 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f06f406bf30 0x7f06f406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.363+0000 7f23effff640 1 -- 172.21.15.19:0/2532534189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23f0154750 con 0x7f23f015d730 2024-09-12T01:56:19.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.364+0000 7f23effff640 1 -- 172.21.15.19:0/2532534189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23f0154d10 con 0x7f23f015d730 2024-09-12T01:56:19.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.364+0000 7f6165ffb640 1 --2- 172.21.15.19:0/870469614 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f615406be80 0x7f615406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.364+0000 7f6165ffb640 1 -- 172.21.15.19:0/870469614 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f616808ad30 con 0x7f6170162ad0 2024-09-12T01:56:19.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.364+0000 7f617509f640 1 --2- 172.21.15.19:0/870469614 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f615406be80 0x7f615406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.364+0000 7f99096af640 1 -- start start 2024-09-12T01:56:19.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.364+0000 7f0714ec1640 1 --2- 172.21.15.19:0/2373920420 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f06f406bf30 0x7f06f406e3f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f070800f510 tx=0x7f07080077b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f99096af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98ec004800 0x7f98fc0ffa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f09aff8f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09a806f6f0 0x7f09a81f9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f99096af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98fc04afd0 0x7f98fc100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f99096af640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98fc102620 0x7f98fc04d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f617509f640 1 --2- 172.21.15.19:0/870469614 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f615406be80 0x7f615406e340 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f616002a1e0 tx=0x7f616002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f9902ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98ec004800 0x7f98fc0ffa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f99096af640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc006660 con 0x7f98ec004800 2024-09-12T01:56:19.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f9902ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98ec004800 0x7f98fc0ffa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42324/0 (socket says 172.21.15.19:42324) 2024-09-12T01:56:19.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f9902ffd640 1 -- 172.21.15.19:0/2581218678 learned_addr learned my addr 172.21.15.19:0/2581218678 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:19.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f99096af640 1 -- 172.21.15.19:0/2581218678 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc04efa0 con 0x7f98fc102620 2024-09-12T01:56:19.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f99096af640 1 -- 172.21.15.19:0/2581218678 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f98fc007110 con 0x7f98fc04afd0 2024-09-12T01:56:19.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f09aff8f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09a80720b0 0x7f09a81f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f99037fe640 1 --2- 172.21.15.19:0/2581218678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98fc102620 0x7f98fc04d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f09aff8f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a8162ad0 0x7f09a8164820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f09aff8f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f09a80b47d0 con 0x7f09a806f6f0 2024-09-12T01:56:19.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f09aff8f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f09a80b3d70 con 0x7f09a80720b0 2024-09-12T01:56:19.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f09aff8f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f09a80b4950 con 0x7f09a8162ad0 2024-09-12T01:56:19.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f09ad52a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09a80720b0 0x7f09a81f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f09ad52a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09a80720b0 0x7f09a81f8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:58274/0 (socket says 172.21.15.19:58274) 2024-09-12T01:56:19.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f09ad52a640 1 -- 172.21.15.19:0/4118631200 learned_addr learned my addr 172.21.15.19:0/4118631200 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:19.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f09ae52c640 1 --2- 172.21.15.19:0/4118631200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a8162ad0 0x7f09a8164820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f09add2b640 1 --2- 172.21.15.19:0/4118631200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09a806f6f0 0x7f09a81f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.365+0000 7f99027fc640 1 --2- 172.21.15.19:0/2581218678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98fc04afd0 0x7f98fc100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f99027fc640 1 -- 172.21.15.19:0/2581218678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98fc102620 msgr2=0x7f98fc04d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f99027fc640 1 --2- 172.21.15.19:0/2581218678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98fc102620 0x7f98fc04d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f99027fc640 1 -- 172.21.15.19:0/2581218678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98ec004800 msgr2=0x7f98fc0ffa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f99027fc640 1 --2- 172.21.15.19:0/2581218678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98ec004800 0x7f98fc0ffa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f99027fc640 1 -- 172.21.15.19:0/2581218678 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc101580 con 0x7f98fc04afd0 2024-09-12T01:56:19.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f09ae52c640 1 -- 172.21.15.19:0/4118631200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09a80720b0 msgr2=0x7f09a81f8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f09ae52c640 1 --2- 172.21.15.19:0/4118631200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09a80720b0 0x7f09a81f8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f09ae52c640 1 -- 172.21.15.19:0/4118631200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09a806f6f0 msgr2=0x7f09a81f9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f09ae52c640 1 --2- 172.21.15.19:0/4118631200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09a806f6f0 0x7f09a81f9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f09ae52c640 1 -- 172.21.15.19:0/4118631200 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a815a290 con 0x7f09a8162ad0 2024-09-12T01:56:19.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f09ad52a640 1 --2- 172.21.15.19:0/4118631200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09a80720b0 0x7f09a81f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:19.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f99027fc640 1 --2- 172.21.15.19:0/2581218678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98fc04afd0 0x7f98fc100c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9904000b60 tx=0x7f99040699e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f23effff640 1 -- 172.21.15.19:0/2532534189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23f0071c10 con 0x7f23f015d730 2024-09-12T01:56:19.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f09ae52c640 1 --2- 172.21.15.19:0/4118631200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a8162ad0 0x7f09a8164820 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f09a0030000 tx=0x7f09a0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f98eb7fe640 1 -- 172.21.15.19:0/2581218678 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99040ac020 con 0x7f98fc04afd0 2024-09-12T01:56:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f98eb7fe640 1 -- 172.21.15.19:0/2581218678 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9904050520 con 0x7f98fc04afd0 2024-09-12T01:56:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f98eb7fe640 1 -- 172.21.15.19:0/2581218678 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99040a3040 con 0x7f98fc04afd0 2024-09-12T01:56:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f99096af640 1 -- 172.21.15.19:0/2581218678 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98fc101860 con 0x7f98fc04afd0 2024-09-12T01:56:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.366+0000 7f99096af640 1 -- 172.21.15.19:0/2581218678 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f98fc101e20 con 0x7f98fc04afd0 2024-09-12T01:56:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.367+0000 7f09a67fc640 1 -- 172.21.15.19:0/4118631200 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a0036070 con 0x7f09a8162ad0 2024-09-12T01:56:19.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.367+0000 7f09aff8f640 1 -- 172.21.15.19:0/4118631200 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a815a570 con 0x7f09a8162ad0 2024-09-12T01:56:19.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.367+0000 7f09aff8f640 1 -- 172.21.15.19:0/4118631200 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a815ab30 con 0x7f09a8162ad0 2024-09-12T01:56:19.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.367+0000 7f09a67fc640 1 -- 172.21.15.19:0/4118631200 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a0037040 con 0x7f09a8162ad0 2024-09-12T01:56:19.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.367+0000 7f09a67fc640 1 -- 172.21.15.19:0/4118631200 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a0004040 con 0x7f09a8162ad0 2024-09-12T01:56:19.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.368+0000 7f99096af640 1 -- 172.21.15.19:0/2581218678 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98fc009f00 con 0x7f98fc04afd0 2024-09-12T01:56:19.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.368+0000 7f09aff8f640 1 -- 172.21.15.19:0/4118631200 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0988005290 con 0x7f09a8162ad0 2024-09-12T01:56:19.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.369+0000 7f98eb7fe640 1 -- 172.21.15.19:0/2581218678 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f99040af020 con 0x7f98fc04afd0 2024-09-12T01:56:19.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.369+0000 7f98eb7fe640 1 --2- 172.21.15.19:0/2581218678 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f98f006be60 0x7f98f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.369+0000 7f98eb7fe640 1 -- 172.21.15.19:0/2581218678 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9904116130 con 0x7f98fc04afd0 2024-09-12T01:56:19.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.369+0000 7f09a67fc640 1 -- 172.21.15.19:0/4118631200 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f09a0043020 con 0x7f09a8162ad0 2024-09-12T01:56:19.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.369+0000 7f9902ffd640 1 --2- 172.21.15.19:0/2581218678 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f98f006be60 0x7f98f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.370+0000 7f6165ffb640 1 -- 172.21.15.19:0/870469614 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6168058dc0 con 0x7f6170162ad0 2024-09-12T01:56:19.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.370+0000 7f9902ffd640 1 --2- 172.21.15.19:0/2581218678 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f98f006be60 0x7f98f006e320 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f98f4009a20 tx=0x7f98f40091c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.370+0000 7f09a67fc640 1 --2- 172.21.15.19:0/4118631200 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f099406be30 0x7f099406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.370+0000 7f09a67fc640 1 -- 172.21.15.19:0/4118631200 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f09a00ab0e0 con 0x7f09a8162ad0 2024-09-12T01:56:19.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.370+0000 7f09add2b640 1 --2- 172.21.15.19:0/4118631200 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f099406be30 0x7f099406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.371+0000 7f0db9ffb640 1 -- 172.21.15.19:0/593241931 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc019070 con 0x7f0dc40b3c90 2024-09-12T01:56:19.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.371+0000 7f0db9ffb640 1 -- 172.21.15.19:0/593241931 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dbc014440 con 0x7f0dc40b3c90 2024-09-12T01:56:19.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.371+0000 7f0db9ffb640 1 -- 172.21.15.19:0/593241931 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0148b0 con 0x7f0dc40b3c90 2024-09-12T01:56:19.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.371+0000 7f0705ffb640 1 -- 172.21.15.19:0/2373920420 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f070c04b030 con 0x7f07100c50a0 2024-09-12T01:56:19.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.371+0000 7f0dcb391640 1 -- 172.21.15.19:0/593241931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc415ee10 con 0x7f0dc40b3c90 2024-09-12T01:56:19.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.371+0000 7f0dcb391640 1 -- 172.21.15.19:0/593241931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc415d6c0 con 0x7f0dc40b3c90 2024-09-12T01:56:19.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.372+0000 7f09add2b640 1 --2- 172.21.15.19:0/4118631200 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f099406be30 0x7f099406e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f099c009990 tx=0x7f099c009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.372+0000 7f23e7fff640 1 -- 172.21.15.19:0/2532534189 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f23e80041e0 con 0x7f23f015d730 2024-09-12T01:56:19.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.372+0000 7f23e7fff640 1 --2- 172.21.15.19:0/2532534189 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f23d406bf30 0x7f23d406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.373+0000 7f23e7fff640 1 -- 172.21.15.19:0/2532534189 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f23e80ac0e0 con 0x7f23f015d730 2024-09-12T01:56:19.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.373+0000 7f0dcb391640 1 -- 172.21.15.19:0/593241931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dc40cec80 con 0x7f0dc40b3c90 2024-09-12T01:56:19.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.374+0000 7f23eeffd640 1 --2- 172.21.15.19:0/2532534189 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f23d406bf30 0x7f23d406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.374+0000 7f0db9ffb640 1 -- 172.21.15.19:0/593241931 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0dbc01c070 con 0x7f0dc40b3c90 2024-09-12T01:56:19.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.374+0000 7f98eb7fe640 1 -- 172.21.15.19:0/2581218678 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f99040b6030 con 0x7f98fc04afd0 2024-09-12T01:56:19.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.375+0000 7f23eeffd640 1 --2- 172.21.15.19:0/2532534189 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f23d406bf30 0x7f23d406e3f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f23d800ae90 tx=0x7f23d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.375+0000 7f0db9ffb640 1 --2- 172.21.15.19:0/593241931 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0da806bf30 0x7f0da806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.375+0000 7f23e7fff640 1 -- 172.21.15.19:0/2532534189 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23e807a350 con 0x7f23f015d730 2024-09-12T01:56:19.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.375+0000 7f0db9ffb640 1 -- 172.21.15.19:0/593241931 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0dbc08b0f0 con 0x7f0dc40b3c90 2024-09-12T01:56:19.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.375+0000 7f0dc912d640 1 --2- 172.21.15.19:0/593241931 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0da806bf30 0x7f0da806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.376+0000 7f0dc912d640 1 --2- 172.21.15.19:0/593241931 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0da806bf30 0x7f0da806e3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0db4034000 tx=0x7f0db402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.380+0000 7f09a67fc640 1 -- 172.21.15.19:0/4118631200 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f09a004a020 con 0x7f09a8162ad0 2024-09-12T01:56:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.384+0000 7f0db9ffb640 1 -- 172.21.15.19:0/593241931 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0dbc059180 con 0x7f0dc40b3c90 2024-09-12T01:56:19.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.711+0000 7f17b3eeb640 1 -- 172.21.15.19:0/2028127802 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f17ac06d090 con 0x7f17ac15ea90 2024-09-12T01:56:19.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.712+0000 7f17a27fc640 1 -- 172.21.15.19:0/2028127802 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f179c05c2a0 con 0x7f17ac15ea90 2024-09-12T01:56:19.712 INFO:teuthology.orchestra.run.smithi019.stdout:55834574859 2024-09-12T01:56:19.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.712+0000 7f0206ffd640 1 -- 172.21.15.19:0/2532142830 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f01f8005580 con 0x7f02200b61e0 2024-09-12T01:56:19.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.712+0000 7f021d7fa640 1 -- 172.21.15.19:0/2532142830 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f021005d230 con 0x7f02200b61e0 2024-09-12T01:56:19.713 INFO:teuthology.orchestra.run.smithi019.stdout:64424509449 2024-09-12T01:56:19.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.716+0000 7f178ffff640 1 -- 172.21.15.19:0/2028127802 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f179006c260 msgr2=0x7f179006e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.716+0000 7f178ffff640 1 --2- 172.21.15.19:0/2028127802 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f179006c260 0x7f179006e720 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f17a40074c0 tx=0x7f17a400b040 comp rx=0 tx=0).stop 2024-09-12T01:56:19.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.716+0000 7f178ffff640 1 -- 172.21.15.19:0/2028127802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17ac15ea90 msgr2=0x7f17ac153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.716+0000 7f178ffff640 1 --2- 172.21.15.19:0/2028127802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17ac15ea90 0x7f17ac153680 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f179c00c3f0 tx=0x7f179c00c8b0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.716+0000 7f0226dd6640 1 -- 172.21.15.19:0/2532142830 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f020c06be80 msgr2=0x7f020c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.716+0000 7f0226dd6640 1 --2- 172.21.15.19:0/2532142830 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f020c06be80 0x7f020c06e340 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f02200cb1e0 tx=0x7f0218009850 comp rx=0 tx=0).stop 2024-09-12T01:56:19.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.716+0000 7f0226dd6640 1 -- 172.21.15.19:0/2532142830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02200b61e0 msgr2=0x7f022006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.716+0000 7f178ffff640 1 -- 172.21.15.19:0/2028127802 shutdown_connections 2024-09-12T01:56:19.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.716+0000 7f178ffff640 1 --2- 172.21.15.19:0/2028127802 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f179006c260 0x7f179006e720 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.716+0000 7f178ffff640 1 --2- 172.21.15.19:0/2028127802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17ac15ea90 0x7f17ac153680 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.716+0000 7f178ffff640 1 --2- 172.21.15.19:0/2028127802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17ac15a2c0 0x7f17ac14aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.716+0000 7f178ffff640 1 --2- 172.21.15.19:0/2028127802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17ac0720b0 0x7f17ac1f7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.716+0000 7f178ffff640 1 -- 172.21.15.19:0/2028127802 >> 172.21.15.19:0/2028127802 conn(0x7f17ac067b30 msgr2=0x7f17ac15ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.717+0000 7f0226dd6640 1 --2- 172.21.15.19:0/2532142830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02200b61e0 0x7f022006d510 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f021000b4d0 tx=0x7f021000b990 comp rx=0 tx=0).stop 2024-09-12T01:56:19.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.717+0000 7f178ffff640 1 -- 172.21.15.19:0/2028127802 shutdown_connections 2024-09-12T01:56:19.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.717+0000 7f178ffff640 1 -- 172.21.15.19:0/2028127802 wait complete. 2024-09-12T01:56:19.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.717+0000 7f0226dd6640 1 -- 172.21.15.19:0/2532142830 shutdown_connections 2024-09-12T01:56:19.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.717+0000 7f0226dd6640 1 --2- 172.21.15.19:0/2532142830 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f020c06be80 0x7f020c06e340 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.717+0000 7f0226dd6640 1 --2- 172.21.15.19:0/2532142830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02200d3ad0 0x7f0220204f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.717+0000 7f0226dd6640 1 --2- 172.21.15.19:0/2532142830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02200b6b00 0x7f02200c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.717+0000 7f0226dd6640 1 --2- 172.21.15.19:0/2532142830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02200b61e0 0x7f022006d510 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.717+0000 7f0226dd6640 1 -- 172.21.15.19:0/2532142830 >> 172.21.15.19:0/2532142830 conn(0x7f02200d44f0 msgr2=0x7f02200b4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.717+0000 7f0226dd6640 1 -- 172.21.15.19:0/2532142830 shutdown_connections 2024-09-12T01:56:19.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.718+0000 7f0226dd6640 1 -- 172.21.15.19:0/2532142830 wait complete. 2024-09-12T01:56:19.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2024-09-12T01:56:19.735 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:19.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.6 2024-09-12T01:56:19.736 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:19.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.755+0000 7f23effff640 1 -- 172.21.15.19:0/2532534189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f23f00ce290 con 0x7f23f015d730 2024-09-12T01:56:19.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.756+0000 7f23e7fff640 1 -- 172.21.15.19:0/2532534189 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f23e807e650 con 0x7f23f015d730 2024-09-12T01:56:19.756 INFO:teuthology.orchestra.run.smithi019.stdout:64424509450 2024-09-12T01:56:19.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.757+0000 7f99096af640 1 -- 172.21.15.19:0/2581218678 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f98fc0055c0 con 0x7f98fc04afd0 2024-09-12T01:56:19.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.758+0000 7f98eb7fe640 1 -- 172.21.15.19:0/2581218678 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f99040e4140 con 0x7f98fc04afd0 2024-09-12T01:56:19.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.758+0000 7f23effff640 1 -- 172.21.15.19:0/2532534189 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f23d406bf30 msgr2=0x7f23d406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.758+0000 7f23effff640 1 --2- 172.21.15.19:0/2532534189 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f23d406bf30 0x7f23d406e3f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f23d800ae90 tx=0x7f23d8008040 comp rx=0 tx=0).stop 2024-09-12T01:56:19.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.758+0000 7f23effff640 1 -- 172.21.15.19:0/2532534189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f015d730 msgr2=0x7f23f01f8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.758+0000 7f23effff640 1 --2- 172.21.15.19:0/2532534189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f015d730 0x7f23f01f8e00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f23e8033000 tx=0x7f23e8004a40 comp rx=0 tx=0).stop 2024-09-12T01:56:19.759 INFO:teuthology.orchestra.run.smithi019.stdout:64424509450 2024-09-12T01:56:19.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.758+0000 7f23effff640 1 -- 172.21.15.19:0/2532534189 shutdown_connections 2024-09-12T01:56:19.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.758+0000 7f23effff640 1 --2- 172.21.15.19:0/2532534189 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f23d406bf30 0x7f23d406e3f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.758+0000 7f23effff640 1 --2- 172.21.15.19:0/2532534189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f015d730 0x7f23f01f8e00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.758+0000 7f23effff640 1 --2- 172.21.15.19:0/2532534189 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f00b4350 0x7f23f01f9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.758+0000 7f23effff640 1 --2- 172.21.15.19:0/2532534189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23f006f110 0x7f23f00af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.758+0000 7f23effff640 1 -- 172.21.15.19:0/2532534189 >> 172.21.15.19:0/2532534189 conn(0x7f23f00b1e00 msgr2=0x7f23f015e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.758+0000 7f23effff640 1 -- 172.21.15.19:0/2532534189 shutdown_connections 2024-09-12T01:56:19.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.758+0000 7f23effff640 1 -- 172.21.15.19:0/2532534189 wait complete. 2024-09-12T01:56:19.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.760+0000 7f99096af640 1 -- 172.21.15.19:0/2581218678 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f98f006be60 msgr2=0x7f98f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.761+0000 7f99096af640 1 --2- 172.21.15.19:0/2581218678 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f98f006be60 0x7f98f006e320 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f98f4009a20 tx=0x7f98f40091c0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.761+0000 7f99096af640 1 -- 172.21.15.19:0/2581218678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98fc04afd0 msgr2=0x7f98fc100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.761+0000 7f99096af640 1 --2- 172.21.15.19:0/2581218678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98fc04afd0 0x7f98fc100c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9904000b60 tx=0x7f99040699e0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.761+0000 7f99096af640 1 -- 172.21.15.19:0/2581218678 shutdown_connections 2024-09-12T01:56:19.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.761+0000 7f99096af640 1 --2- 172.21.15.19:0/2581218678 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f98f006be60 0x7f98f006e320 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.761+0000 7f99096af640 1 --2- 172.21.15.19:0/2581218678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98fc102620 0x7f98fc04d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.761+0000 7f99096af640 1 --2- 172.21.15.19:0/2581218678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98fc04afd0 0x7f98fc100c80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.761+0000 7f99096af640 1 --2- 172.21.15.19:0/2581218678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98ec004800 0x7f98fc0ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.761+0000 7f99096af640 1 -- 172.21.15.19:0/2581218678 >> 172.21.15.19:0/2581218678 conn(0x7f98fc01d930 msgr2=0x7f98fc032260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.761+0000 7f99096af640 1 -- 172.21.15.19:0/2581218678 shutdown_connections 2024-09-12T01:56:19.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.761+0000 7f99096af640 1 -- 172.21.15.19:0/2581218678 wait complete. 2024-09-12T01:56:19.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.773+0000 7f6177303640 1 -- 172.21.15.19:0/870469614 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f617006f670 con 0x7f6170162ad0 2024-09-12T01:56:19.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.7 2024-09-12T01:56:19.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.774+0000 7f6165ffb640 1 -- 172.21.15.19:0/870469614 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f616805d0c0 con 0x7f6170162ad0 2024-09-12T01:56:19.775 INFO:teuthology.orchestra.run.smithi019.stdout:60129542154 2024-09-12T01:56:19.775 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:19.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.5 2024-09-12T01:56:19.776 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:19.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.777+0000 7f6177303640 1 -- 172.21.15.19:0/870469614 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f615406be80 msgr2=0x7f615406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.777+0000 7f6177303640 1 --2- 172.21.15.19:0/870469614 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f615406be80 0x7f615406e340 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f616002a1e0 tx=0x7f616002e000 comp rx=0 tx=0).stop 2024-09-12T01:56:19.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.777+0000 7f6177303640 1 -- 172.21.15.19:0/870469614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6170162ad0 msgr2=0x7f6170164230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.777+0000 7f6177303640 1 --2- 172.21.15.19:0/870469614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6170162ad0 0x7f6170164230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f616800cad0 tx=0x7f616800cf90 comp rx=0 tx=0).stop 2024-09-12T01:56:19.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.777+0000 7f6177303640 1 -- 172.21.15.19:0/870469614 shutdown_connections 2024-09-12T01:56:19.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.777+0000 7f6177303640 1 --2- 172.21.15.19:0/870469614 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f615406be80 0x7f615406e340 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.777+0000 7f6177303640 1 --2- 172.21.15.19:0/870469614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6170162ad0 0x7f6170164230 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.777+0000 7f6177303640 1 --2- 172.21.15.19:0/870469614 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6170072490 0x7f617015c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.777+0000 7f6177303640 1 --2- 172.21.15.19:0/870469614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61700720b0 0x7f6170151850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.777+0000 7f6177303640 1 -- 172.21.15.19:0/870469614 >> 172.21.15.19:0/870469614 conn(0x7f6170067d70 msgr2=0x7f61700b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.777+0000 7f6177303640 1 -- 172.21.15.19:0/870469614 shutdown_connections 2024-09-12T01:56:19.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.778+0000 7f6177303640 1 -- 172.21.15.19:0/870469614 wait complete. 2024-09-12T01:56:19.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.783+0000 7f06fb7fe640 1 -- 172.21.15.19:0/2373920420 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f07100d2f10 con 0x7f07100c50a0 2024-09-12T01:56:19.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.783+0000 7f0705ffb640 1 -- 172.21.15.19:0/2373920420 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f070c079ef0 con 0x7f07100c50a0 2024-09-12T01:56:19.783 INFO:teuthology.orchestra.run.smithi019.stdout:60129542154 2024-09-12T01:56:19.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.783+0000 7f09aff8f640 1 -- 172.21.15.19:0/4118631200 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0988005580 con 0x7f09a8162ad0 2024-09-12T01:56:19.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.784+0000 7f09a67fc640 1 -- 172.21.15.19:0/4118631200 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f09a00796b0 con 0x7f09a8162ad0 2024-09-12T01:56:19.784 INFO:teuthology.orchestra.run.smithi019.stdout:60129542154 2024-09-12T01:56:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.786+0000 7f06fb7fe640 1 -- 172.21.15.19:0/2373920420 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f06f406bf30 msgr2=0x7f06f406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.786+0000 7f06fb7fe640 1 --2- 172.21.15.19:0/2373920420 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f06f406bf30 0x7f06f406e3f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f070800f510 tx=0x7f07080077b0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.786+0000 7f06fb7fe640 1 -- 172.21.15.19:0/2373920420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07100c50a0 msgr2=0x7f07100b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.786+0000 7f06fb7fe640 1 --2- 172.21.15.19:0/2373920420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07100c50a0 0x7f07100b59d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f070c0090b0 tx=0x7f070c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.786+0000 7f06fb7fe640 1 -- 172.21.15.19:0/2373920420 shutdown_connections 2024-09-12T01:56:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f06fb7fe640 1 --2- 172.21.15.19:0/2373920420 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f06f406bf30 0x7f06f406e3f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f06fb7fe640 1 --2- 172.21.15.19:0/2373920420 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07100b5f10 0x7f07100b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f06fb7fe640 1 --2- 172.21.15.19:0/2373920420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07100cf270 0x7f07100b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f06fb7fe640 1 --2- 172.21.15.19:0/2373920420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07100c50a0 0x7f07100b59d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f06fb7fe640 1 -- 172.21.15.19:0/2373920420 >> 172.21.15.19:0/2373920420 conn(0x7f07100b3ed0 msgr2=0x7f07100b0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f06fb7fe640 1 -- 172.21.15.19:0/2373920420 shutdown_connections 2024-09-12T01:56:19.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f06fb7fe640 1 -- 172.21.15.19:0/2373920420 wait complete. 2024-09-12T01:56:19.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f09aff8f640 1 -- 172.21.15.19:0/4118631200 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f099406be30 msgr2=0x7f099406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f09aff8f640 1 --2- 172.21.15.19:0/4118631200 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f099406be30 0x7f099406e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f099c009990 tx=0x7f099c009110 comp rx=0 tx=0).stop 2024-09-12T01:56:19.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f09aff8f640 1 -- 172.21.15.19:0/4118631200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a8162ad0 msgr2=0x7f09a8164820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f09aff8f640 1 --2- 172.21.15.19:0/4118631200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a8162ad0 0x7f09a8164820 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f09a0030000 tx=0x7f09a0004a40 comp rx=0 tx=0).stop 2024-09-12T01:56:19.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f09aff8f640 1 -- 172.21.15.19:0/4118631200 shutdown_connections 2024-09-12T01:56:19.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f09aff8f640 1 --2- 172.21.15.19:0/4118631200 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f099406be30 0x7f099406e2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f09aff8f640 1 --2- 172.21.15.19:0/4118631200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09a8162ad0 0x7f09a8164820 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f09aff8f640 1 --2- 172.21.15.19:0/4118631200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09a80720b0 0x7f09a81f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f09aff8f640 1 --2- 172.21.15.19:0/4118631200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09a806f6f0 0x7f09a81f9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f09aff8f640 1 -- 172.21.15.19:0/4118631200 >> 172.21.15.19:0/4118631200 conn(0x7f09a8067d70 msgr2=0x7f09a80b4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f09aff8f640 1 -- 172.21.15.19:0/4118631200 shutdown_connections 2024-09-12T01:56:19.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.787+0000 7f09aff8f640 1 -- 172.21.15.19:0/4118631200 wait complete. 2024-09-12T01:56:19.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.2 2024-09-12T01:56:19.792 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:19.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.794+0000 7f0dcb391640 1 -- 172.21.15.19:0/593241931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0dc40d01e0 con 0x7f0dc40b3c90 2024-09-12T01:56:19.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.794+0000 7f0db9ffb640 1 -- 172.21.15.19:0/593241931 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0dbc05d480 con 0x7f0dc40b3c90 2024-09-12T01:56:19.797 INFO:teuthology.orchestra.run.smithi019.stdout:60129542154 2024-09-12T01:56:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.797+0000 7f0dcb391640 1 -- 172.21.15.19:0/593241931 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0da806bf30 msgr2=0x7f0da806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.797+0000 7f0dcb391640 1 --2- 172.21.15.19:0/593241931 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0da806bf30 0x7f0da806e3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0db4034000 tx=0x7f0db402e000 comp rx=0 tx=0).stop 2024-09-12T01:56:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.797+0000 7f0dcb391640 1 -- 172.21.15.19:0/593241931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dc40b3c90 msgr2=0x7f0dc414f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.797+0000 7f0dcb391640 1 --2- 172.21.15.19:0/593241931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dc40b3c90 0x7f0dc414f9b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00bd50 tx=0x7f0dbc00be40 comp rx=0 tx=0).stop 2024-09-12T01:56:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.797+0000 7f0dcb391640 1 -- 172.21.15.19:0/593241931 shutdown_connections 2024-09-12T01:56:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.797+0000 7f0dcb391640 1 --2- 172.21.15.19:0/593241931 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0da806bf30 0x7f0da806e3f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.797+0000 7f0dcb391640 1 --2- 172.21.15.19:0/593241931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dc4165f00 0x7f0dc414d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.797+0000 7f0dcb391640 1 --2- 172.21.15.19:0/593241931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dc40b3c90 0x7f0dc414f9b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.797+0000 7f0dcb391640 1 --2- 172.21.15.19:0/593241931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0dc40729a0 0x7f0dc415ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.797+0000 7f0dcb391640 1 -- 172.21.15.19:0/593241931 >> 172.21.15.19:0/593241931 conn(0x7f0dc406bc10 msgr2=0x7f0dc406e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.797+0000 7f0dcb391640 1 -- 172.21.15.19:0/593241931 shutdown_connections 2024-09-12T01:56:19.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.797+0000 7f0dcb391640 1 -- 172.21.15.19:0/593241931 wait complete. 2024-09-12T01:56:19.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.1 2024-09-12T01:56:19.802 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:19.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.0 2024-09-12T01:56:19.803 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:19.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.3 2024-09-12T01:56:19.809 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:19.809 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:56:19.809 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:56:19.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.951+0000 7f225d67b640 1 Processor -- start 2024-09-12T01:56:19.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.951+0000 7f225d67b640 1 -- start start 2024-09-12T01:56:19.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.952+0000 7f225d67b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22580b6680 0x7f2258169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.952+0000 7f225d67b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f225806d9f0 con 0x7f2258161c80 2024-09-12T01:56:19.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.952+0000 7f225d67b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f225806dcd0 con 0x7f2258162060 2024-09-12T01:56:19.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.952+0000 7f225d67b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f225806dfb0 con 0x7f22580b6680 2024-09-12T01:56:19.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.952+0000 7f22577fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22580b6680 0x7f2258169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.952+0000 7f2256ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2258161c80 0x7f225806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44860/0 (socket says 172.21.15.19:44860) 2024-09-12T01:56:19.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.952+0000 7f2256ffd640 1 -- 172.21.15.19:0/445106804 learned_addr learned my addr 172.21.15.19:0/445106804 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:19.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.952+0000 7f22577fe640 1 -- 172.21.15.19:0/445106804 >> v1:172.21.15.135:6789/0 conn(0x7f2258162060 legacy=0x7f22580b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:19.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.952+0000 7f22577fe640 1 -- 172.21.15.19:0/445106804 >> v1:172.21.15.19:6789/0 conn(0x7f2258161c80 legacy=0x7f225806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.952+0000 7f2255ffb640 1 -- 172.21.15.19:0/445106804 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2586978655 0 0) 0x7f225806d9f0 con 0x7f2258161c80 2024-09-12T01:56:19.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.952+0000 7f22577fe640 1 -- 172.21.15.19:0/445106804 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22580d01f0 con 0x7f22580b6680 2024-09-12T01:56:19.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.953+0000 7f22577fe640 1 --2- 172.21.15.19:0/445106804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22580b6680 0x7f2258169830 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2250009d90 tx=0x7f225002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89d942e008b2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.953+0000 7f2255ffb640 1 -- 172.21.15.19:0/445106804 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2250007740 con 0x7f22580b6680 2024-09-12T01:56:19.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.953+0000 7f2255ffb640 1 -- 172.21.15.19:0/445106804 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22500078e0 con 0x7f22580b6680 2024-09-12T01:56:19.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.953+0000 7f2255ffb640 1 -- 172.21.15.19:0/445106804 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2250007cb0 con 0x7f22580b6680 2024-09-12T01:56:19.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.953+0000 7f225d67b640 1 -- 172.21.15.19:0/445106804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22580b6680 msgr2=0x7f2258169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.953+0000 7f225d67b640 1 --2- 172.21.15.19:0/445106804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22580b6680 0x7f2258169830 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2250009d90 tx=0x7f225002a6a0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.954+0000 7f225d67b640 1 -- 172.21.15.19:0/445106804 shutdown_connections 2024-09-12T01:56:19.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.954+0000 7f225d67b640 1 --2- 172.21.15.19:0/445106804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22580b6680 0x7f2258169830 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.954+0000 7f225d67b640 1 -- 172.21.15.19:0/445106804 >> 172.21.15.19:0/445106804 conn(0x7f22580d44f0 msgr2=0x7f22580d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.954+0000 7f225d67b640 1 -- 172.21.15.19:0/445106804 shutdown_connections 2024-09-12T01:56:19.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.954+0000 7f225d67b640 1 -- 172.21.15.19:0/445106804 wait complete. 2024-09-12T01:56:19.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.955+0000 7f225d67b640 1 Processor -- start 2024-09-12T01:56:19.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.955+0000 7f225d67b640 1 -- start start 2024-09-12T01:56:19.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f225d67b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22580b6680 0x7f2258158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f225d67b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2258161c80 0x7f22580cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f225d67b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2258162060 0x7f22580c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f225d67b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f22580b6cb0 con 0x7f22580b6680 2024-09-12T01:56:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f225d67b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22580b6b30 con 0x7f2258162060 2024-09-12T01:56:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f225d67b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2258169d70 con 0x7f2258161c80 2024-09-12T01:56:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f2256ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22580b6680 0x7f2258158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f2256ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22580b6680 0x7f2258158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42354/0 (socket says 172.21.15.19:42354) 2024-09-12T01:56:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f2256ffd640 1 -- 172.21.15.19:0/1007485502 learned_addr learned my addr 172.21.15.19:0/1007485502 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f22577fe640 1 --2- 172.21.15.19:0/1007485502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2258162060 0x7f22580c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f22567fc640 1 --2- 172.21.15.19:0/1007485502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2258161c80 0x7f22580cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f2256ffd640 1 -- 172.21.15.19:0/1007485502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2258161c80 msgr2=0x7f22580cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f2256ffd640 1 --2- 172.21.15.19:0/1007485502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2258161c80 0x7f22580cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f2256ffd640 1 -- 172.21.15.19:0/1007485502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2258162060 msgr2=0x7f22580c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f2256ffd640 1 --2- 172.21.15.19:0/1007485502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2258162060 0x7f22580c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f2256ffd640 1 -- 172.21.15.19:0/1007485502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2258159ae0 con 0x7f22580b6680 2024-09-12T01:56:19.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f2256ffd640 1 --2- 172.21.15.19:0/1007485502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22580b6680 0x7f2258158410 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f224800c430 tx=0x7f224800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f223f7fe640 1 -- 172.21.15.19:0/1007485502 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22480074e0 con 0x7f22580b6680 2024-09-12T01:56:19.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f223f7fe640 1 -- 172.21.15.19:0/1007485502 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22480047e0 con 0x7f22580b6680 2024-09-12T01:56:19.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.956+0000 7f225d67b640 1 -- 172.21.15.19:0/1007485502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225815a4e0 con 0x7f22580b6680 2024-09-12T01:56:19.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.957+0000 7f223f7fe640 1 -- 172.21.15.19:0/1007485502 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248004bd0 con 0x7f22580b6680 2024-09-12T01:56:19.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.957+0000 7f225d67b640 1 -- 172.21.15.19:0/1007485502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f225815a750 con 0x7f22580b6680 2024-09-12T01:56:19.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.957+0000 7f225d67b640 1 -- 172.21.15.19:0/1007485502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22580b5f70 con 0x7f22580b6680 2024-09-12T01:56:19.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.958+0000 7f223f7fe640 1 -- 172.21.15.19:0/1007485502 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2248011070 con 0x7f22580b6680 2024-09-12T01:56:19.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.958+0000 7f223f7fe640 1 --2- 172.21.15.19:0/1007485502 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f224406be30 0x7f224406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.959+0000 7f223f7fe640 1 -- 172.21.15.19:0/1007485502 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f224808ad80 con 0x7f22580b6680 2024-09-12T01:56:19.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.959+0000 7f22567fc640 1 --2- 172.21.15.19:0/1007485502 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f224406be30 0x7f224406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.959+0000 7f22567fc640 1 --2- 172.21.15.19:0/1007485502 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f224406be30 0x7f224406e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2258158980 tx=0x7f224c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:19.963+0000 7f223f7fe640 1 -- 172.21.15.19:0/1007485502 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2248059480 con 0x7f22580b6680 2024-09-12T01:56:20.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.136+0000 7f225d67b640 1 -- 172.21.15.19:0/1007485502 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f22580ba470 con 0x7f224406be30 2024-09-12T01:56:20.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.144+0000 7f223f7fe640 1 -- 172.21.15.19:0/1007485502 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f22580ba470 con 0x7f224406be30 2024-09-12T01:56:20.149 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:20.151 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:56:20.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.148+0000 7f225d67b640 1 -- 172.21.15.19:0/1007485502 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f224406be30 msgr2=0x7f224406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.148+0000 7f225d67b640 1 --2- 172.21.15.19:0/1007485502 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f224406be30 0x7f224406e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2258158980 tx=0x7f224c009040 comp rx=0 tx=0).stop 2024-09-12T01:56:20.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.148+0000 7f225d67b640 1 -- 172.21.15.19:0/1007485502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22580b6680 msgr2=0x7f2258158410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.148+0000 7f225d67b640 1 --2- 172.21.15.19:0/1007485502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22580b6680 0x7f2258158410 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f224800c430 tx=0x7f224800c8f0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.148+0000 7f225d67b640 1 -- 172.21.15.19:0/1007485502 shutdown_connections 2024-09-12T01:56:20.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.148+0000 7f225d67b640 1 --2- 172.21.15.19:0/1007485502 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f224406be30 0x7f224406e2f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.148+0000 7f225d67b640 1 --2- 172.21.15.19:0/1007485502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2258162060 0x7f22580c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.148+0000 7f225d67b640 1 --2- 172.21.15.19:0/1007485502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2258161c80 0x7f22580cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.148+0000 7f225d67b640 1 --2- 172.21.15.19:0/1007485502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22580b6680 0x7f2258158410 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.148+0000 7f225d67b640 1 -- 172.21.15.19:0/1007485502 >> 172.21.15.19:0/1007485502 conn(0x7f22580d44f0 msgr2=0x7f22580b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:20.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.148+0000 7f225d67b640 1 -- 172.21.15.19:0/1007485502 shutdown_connections 2024-09-12T01:56:20.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.148+0000 7f225d67b640 1 -- 172.21.15.19:0/1007485502 wait complete. 2024-09-12T01:56:20.159 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-09-12T01:56:20.090006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219680,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755040,"statfs":{"total":773094113280,"available":772869160960,"internally_reserved":0,"allocated":3514368,"data_stored":2106108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003549"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460711+0000","last_change":"2024-09-12T01:55:54.691417+0000","last_active":"2024-09-12T01:56:02.460711+0000","last_peered":"2024-09-12T01:56:02.460711+0000","last_clean":"2024-09-12T01:56:02.460711+0000","last_became_active":"2024-09-12T01:55:54.690940+0000","last_became_peered":"2024-09-12T01:55:54.690940+0000","last_unstale":"2024-09-12T01:56:02.460711+0000","last_undegraded":"2024-09-12T01:56:02.460711+0000","last_fullsized":"2024-09-12T01:56:02.460711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:41.898184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522661+0000","last_change":"2024-09-12T01:55:55.703230+0000","last_active":"2024-09-12T01:56:02.522661+0000","last_peered":"2024-09-12T01:56:02.522661+0000","last_clean":"2024-09-12T01:56:02.522661+0000","last_became_active":"2024-09-12T01:55:55.702937+0000","last_became_peered":"2024-09-12T01:55:55.702937+0000","last_unstale":"2024-09-12T01:56:02.522661+0000","last_undegraded":"2024-09-12T01:56:02.522661+0000","last_fullsized":"2024-09-12T01:56:02.522661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:12.877973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521554+0000","last_change":"2024-09-12T01:56:00.522020+0000","last_active":"2024-09-12T01:56:02.521554+0000","last_peered":"2024-09-12T01:56:02.521554+0000","last_clean":"2024-09-12T01:56:02.521554+0000","last_became_active":"2024-09-12T01:56:00.521659+0000","last_became_peered":"2024-09-12T01:56:00.521659+0000","last_unstale":"2024-09-12T01:56:02.521554+0000","last_undegraded":"2024-09-12T01:56:02.521554+0000","last_fullsized":"2024-09-12T01:56:02.521554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:04.626201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522786+0000","last_change":"2024-09-12T01:55:54.693523+0000","last_active":"2024-09-12T01:56:02.522786+0000","last_peered":"2024-09-12T01:56:02.522786+0000","last_clean":"2024-09-12T01:56:02.522786+0000","last_became_active":"2024-09-12T01:55:54.693127+0000","last_became_peered":"2024-09-12T01:55:54.693127+0000","last_unstale":"2024-09-12T01:56:02.522786+0000","last_undegraded":"2024-09-12T01:56:02.522786+0000","last_fullsized":"2024-09-12T01:56:02.522786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:18.178661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460539+0000","last_change":"2024-09-12T01:55:55.695198+0000","last_active":"2024-09-12T01:56:02.460539+0000","last_peered":"2024-09-12T01:56:02.460539+0000","last_clean":"2024-09-12T01:56:02.460539+0000","last_became_active":"2024-09-12T01:55:55.694897+0000","last_became_peered":"2024-09-12T01:55:55.694897+0000","last_unstale":"2024-09-12T01:56:02.460539+0000","last_undegraded":"2024-09-12T01:56:02.460539+0000","last_fullsized":"2024-09-12T01:56:02.460539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:05.184458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996331+0000","last_change":"2024-09-12T01:55:59.720981+0000","last_active":"2024-09-12T01:56:01.996331+0000","last_peered":"2024-09-12T01:56:01.996331+0000","last_clean":"2024-09-12T01:56:01.996331+0000","last_became_active":"2024-09-12T01:55:59.720424+0000","last_became_peered":"2024-09-12T01:55:59.720424+0000","last_unstale":"2024-09-12T01:56:01.996331+0000","last_undegraded":"2024-09-12T01:56:01.996331+0000","last_fullsized":"2024-09-12T01:56:01.996331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:37.646140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752215+0000","last_change":"2024-09-12T01:55:54.691906+0000","last_active":"2024-09-12T01:56:01.752215+0000","last_peered":"2024-09-12T01:56:01.752215+0000","last_clean":"2024-09-12T01:56:01.752215+0000","last_became_active":"2024-09-12T01:55:54.691632+0000","last_became_peered":"2024-09-12T01:55:54.691632+0000","last_unstale":"2024-09-12T01:56:01.752215+0000","last_undegraded":"2024-09-12T01:56:01.752215+0000","last_fullsized":"2024-09-12T01:56:01.752215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:02.585865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522293+0000","last_change":"2024-09-12T01:55:55.690825+0000","last_active":"2024-09-12T01:56:02.522293+0000","last_peered":"2024-09-12T01:56:02.522293+0000","last_clean":"2024-09-12T01:56:02.522293+0000","last_became_active":"2024-09-12T01:55:55.690498+0000","last_became_peered":"2024-09-12T01:55:55.690498+0000","last_unstale":"2024-09-12T01:56:02.522293+0000","last_undegraded":"2024-09-12T01:56:02.522293+0000","last_fullsized":"2024-09-12T01:56:02.522293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:20.252934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996426+0000","last_change":"2024-09-12T01:55:59.722572+0000","last_active":"2024-09-12T01:56:01.996426+0000","last_peered":"2024-09-12T01:56:01.996426+0000","last_clean":"2024-09-12T01:56:01.996426+0000","last_became_active":"2024-09-12T01:55:59.722043+0000","last_became_peered":"2024-09-12T01:55:59.722043+0000","last_unstale":"2024-09-12T01:56:01.996426+0000","last_undegraded":"2024-09-12T01:56:01.996426+0000","last_fullsized":"2024-09-12T01:56:01.996426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:01.089137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751710+0000","last_change":"2024-09-12T01:55:54.694886+0000","last_active":"2024-09-12T01:56:01.751710+0000","last_peered":"2024-09-12T01:56:01.751710+0000","last_clean":"2024-09-12T01:56:01.751710+0000","last_became_active":"2024-09-12T01:55:54.694641+0000","last_became_peered":"2024-09-12T01:55:54.694641+0000","last_unstale":"2024-09-12T01:56:01.751710+0000","last_undegraded":"2024-09-12T01:56:01.751710+0000","last_fullsized":"2024-09-12T01:56:01.751710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:07.353242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522367+0000","last_change":"2024-09-12T01:55:55.697509+0000","last_active":"2024-09-12T01:56:02.522367+0000","last_peered":"2024-09-12T01:56:02.522367+0000","last_clean":"2024-09-12T01:56:02.522367+0000","last_became_active":"2024-09-12T01:55:55.696597+0000","last_became_peered":"2024-09-12T01:55:55.696597+0000","last_unstale":"2024-09-12T01:56:02.522367+0000","last_undegraded":"2024-09-12T01:56:02.522367+0000","last_fullsized":"2024-09-12T01:56:02.522367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:50.551708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996296+0000","last_change":"2024-09-12T01:55:59.717407+0000","last_active":"2024-09-12T01:56:01.996296+0000","last_peered":"2024-09-12T01:56:01.996296+0000","last_clean":"2024-09-12T01:56:01.996296+0000","last_became_active":"2024-09-12T01:55:59.716747+0000","last_became_peered":"2024-09-12T01:55:59.716747+0000","last_unstale":"2024-09-12T01:56:01.996296+0000","last_undegraded":"2024-09-12T01:56:01.996296+0000","last_fullsized":"2024-09-12T01:56:01.996296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:30.245761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752221+0000","last_change":"2024-09-12T01:55:55.694504+0000","last_active":"2024-09-12T01:56:01.752221+0000","last_peered":"2024-09-12T01:56:01.752221+0000","last_clean":"2024-09-12T01:56:01.752221+0000","last_became_active":"2024-09-12T01:55:55.694202+0000","last_became_peered":"2024-09-12T01:55:55.694202+0000","last_unstale":"2024-09-12T01:56:01.752221+0000","last_undegraded":"2024-09-12T01:56:01.752221+0000","last_fullsized":"2024-09-12T01:56:01.752221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:49.242430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751844+0000","last_change":"2024-09-12T01:55:54.690614+0000","last_active":"2024-09-12T01:56:01.751844+0000","last_peered":"2024-09-12T01:56:01.751844+0000","last_clean":"2024-09-12T01:56:01.751844+0000","last_became_active":"2024-09-12T01:55:54.690334+0000","last_became_peered":"2024-09-12T01:55:54.690334+0000","last_unstale":"2024-09-12T01:56:01.751844+0000","last_undegraded":"2024-09-12T01:56:01.751844+0000","last_fullsized":"2024-09-12T01:56:01.751844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:29.431495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996751+0000","last_change":"2024-09-12T01:55:59.728056+0000","last_active":"2024-09-12T01:56:01.996751+0000","last_peered":"2024-09-12T01:56:01.996751+0000","last_clean":"2024-09-12T01:56:01.996751+0000","last_became_active":"2024-09-12T01:55:59.727677+0000","last_became_peered":"2024-09-12T01:55:59.727677+0000","last_unstale":"2024-09-12T01:56:01.996751+0000","last_undegraded":"2024-09-12T01:56:01.996751+0000","last_fullsized":"2024-09-12T01:56:01.996751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:25.127551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522339+0000","last_change":"2024-09-12T01:55:55.696190+0000","last_active":"2024-09-12T01:56:02.522339+0000","last_peered":"2024-09-12T01:56:02.522339+0000","last_clean":"2024-09-12T01:56:02.522339+0000","last_became_active":"2024-09-12T01:55:55.695882+0000","last_became_peered":"2024-09-12T01:55:55.695882+0000","last_unstale":"2024-09-12T01:56:02.522339+0000","last_undegraded":"2024-09-12T01:56:02.522339+0000","last_fullsized":"2024-09-12T01:56:02.522339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:18.907293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522246+0000","last_change":"2024-09-12T01:55:54.691318+0000","last_active":"2024-09-12T01:56:02.522246+0000","last_peered":"2024-09-12T01:56:02.522246+0000","last_clean":"2024-09-12T01:56:02.522246+0000","last_became_active":"2024-09-12T01:55:54.690960+0000","last_became_peered":"2024-09-12T01:55:54.690960+0000","last_unstale":"2024-09-12T01:56:02.522246+0000","last_undegraded":"2024-09-12T01:56:02.522246+0000","last_fullsized":"2024-09-12T01:56:02.522246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:12.646367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996557+0000","last_change":"2024-09-12T01:55:59.721175+0000","last_active":"2024-09-12T01:56:01.996557+0000","last_peered":"2024-09-12T01:56:01.996557+0000","last_clean":"2024-09-12T01:56:01.996557+0000","last_became_active":"2024-09-12T01:55:59.720481+0000","last_became_peered":"2024-09-12T01:55:59.720481+0000","last_unstale":"2024-09-12T01:56:01.996557+0000","last_undegraded":"2024-09-12T01:56:01.996557+0000","last_fullsized":"2024-09-12T01:56:01.996557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:33.869240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521581+0000","last_change":"2024-09-12T01:55:55.686041+0000","last_active":"2024-09-12T01:56:02.521581+0000","last_peered":"2024-09-12T01:56:02.521581+0000","last_clean":"2024-09-12T01:56:02.521581+0000","last_became_active":"2024-09-12T01:55:55.685758+0000","last_became_peered":"2024-09-12T01:55:55.685758+0000","last_unstale":"2024-09-12T01:56:02.521581+0000","last_undegraded":"2024-09-12T01:56:02.521581+0000","last_fullsized":"2024-09-12T01:56:02.521581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:11.963913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521629+0000","last_change":"2024-09-12T01:55:54.688788+0000","last_active":"2024-09-12T01:56:02.521629+0000","last_peered":"2024-09-12T01:56:02.521629+0000","last_clean":"2024-09-12T01:56:02.521629+0000","last_became_active":"2024-09-12T01:55:54.688513+0000","last_became_peered":"2024-09-12T01:55:54.688513+0000","last_unstale":"2024-09-12T01:56:02.521629+0000","last_undegraded":"2024-09-12T01:56:02.521629+0000","last_fullsized":"2024-09-12T01:56:02.521629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:49.883464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522091+0000","last_change":"2024-09-12T01:56:00.517213+0000","last_active":"2024-09-12T01:56:02.522091+0000","last_peered":"2024-09-12T01:56:02.522091+0000","last_clean":"2024-09-12T01:56:02.522091+0000","last_became_active":"2024-09-12T01:56:00.516759+0000","last_became_peered":"2024-09-12T01:56:00.516759+0000","last_unstale":"2024-09-12T01:56:02.522091+0000","last_undegraded":"2024-09-12T01:56:02.522091+0000","last_fullsized":"2024-09-12T01:56:02.522091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:01.089137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996491+0000","last_change":"2024-09-12T01:55:55.688036+0000","last_active":"2024-09-12T01:56:01.996491+0000","last_peered":"2024-09-12T01:56:01.996491+0000","last_clean":"2024-09-12T01:56:01.996491+0000","last_became_active":"2024-09-12T01:55:55.687764+0000","last_became_peered":"2024-09-12T01:55:55.687764+0000","last_unstale":"2024-09-12T01:56:01.996491+0000","last_undegraded":"2024-09-12T01:56:01.996491+0000","last_fullsized":"2024-09-12T01:56:01.996491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:18.704097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751280+0000","last_change":"2024-09-12T01:55:54.693835+0000","last_active":"2024-09-12T01:56:01.751280+0000","last_peered":"2024-09-12T01:56:01.751280+0000","last_clean":"2024-09-12T01:56:01.751280+0000","last_became_active":"2024-09-12T01:55:54.693191+0000","last_became_peered":"2024-09-12T01:55:54.693191+0000","last_unstale":"2024-09-12T01:56:01.751280+0000","last_undegraded":"2024-09-12T01:56:01.751280+0000","last_fullsized":"2024-09-12T01:56:01.751280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:33.178694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996869+0000","last_change":"2024-09-12T01:55:59.720935+0000","last_active":"2024-09-12T01:56:01.996869+0000","last_peered":"2024-09-12T01:56:01.996869+0000","last_clean":"2024-09-12T01:56:01.996869+0000","last_became_active":"2024-09-12T01:55:59.720510+0000","last_became_peered":"2024-09-12T01:55:59.720510+0000","last_unstale":"2024-09-12T01:56:01.996869+0000","last_undegraded":"2024-09-12T01:56:01.996869+0000","last_fullsized":"2024-09-12T01:56:01.996869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:24.129803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460733+0000","last_change":"2024-09-12T01:55:55.693557+0000","last_active":"2024-09-12T01:56:02.460733+0000","last_peered":"2024-09-12T01:56:02.460733+0000","last_clean":"2024-09-12T01:56:02.460733+0000","last_became_active":"2024-09-12T01:55:55.693073+0000","last_became_peered":"2024-09-12T01:55:55.693073+0000","last_unstale":"2024-09-12T01:56:02.460733+0000","last_undegraded":"2024-09-12T01:56:02.460733+0000","last_fullsized":"2024-09-12T01:56:02.460733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:36.523619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752229+0000","last_change":"2024-09-12T01:55:54.692628+0000","last_active":"2024-09-12T01:56:01.752229+0000","last_peered":"2024-09-12T01:56:01.752229+0000","last_clean":"2024-09-12T01:56:01.752229+0000","last_became_active":"2024-09-12T01:55:54.692323+0000","last_became_peered":"2024-09-12T01:55:54.692323+0000","last_unstale":"2024-09-12T01:56:01.752229+0000","last_undegraded":"2024-09-12T01:56:01.752229+0000","last_fullsized":"2024-09-12T01:56:01.752229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:51.779183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996393+0000","last_change":"2024-09-12T01:56:00.519632+0000","last_active":"2024-09-12T01:56:01.996393+0000","last_peered":"2024-09-12T01:56:01.996393+0000","last_clean":"2024-09-12T01:56:01.996393+0000","last_became_active":"2024-09-12T01:56:00.518952+0000","last_became_peered":"2024-09-12T01:56:00.518952+0000","last_unstale":"2024-09-12T01:56:01.996393+0000","last_undegraded":"2024-09-12T01:56:01.996393+0000","last_fullsized":"2024-09-12T01:56:01.996393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:25.728022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522901+0000","last_change":"2024-09-12T01:55:55.701476+0000","last_active":"2024-09-12T01:56:02.522901+0000","last_peered":"2024-09-12T01:56:02.522901+0000","last_clean":"2024-09-12T01:56:02.522901+0000","last_became_active":"2024-09-12T01:55:55.697719+0000","last_became_peered":"2024-09-12T01:55:55.697719+0000","last_unstale":"2024-09-12T01:56:02.522901+0000","last_undegraded":"2024-09-12T01:56:02.522901+0000","last_fullsized":"2024-09-12T01:56:02.522901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:05.703141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521753+0000","last_change":"2024-09-12T01:55:54.683694+0000","last_active":"2024-09-12T01:56:02.521753+0000","last_peered":"2024-09-12T01:56:02.521753+0000","last_clean":"2024-09-12T01:56:02.521753+0000","last_became_active":"2024-09-12T01:55:54.683332+0000","last_became_peered":"2024-09-12T01:55:54.683332+0000","last_unstale":"2024-09-12T01:56:02.521753+0000","last_undegraded":"2024-09-12T01:56:02.521753+0000","last_fullsized":"2024-09-12T01:56:02.521753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:24.503780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521372+0000","last_change":"2024-09-12T01:56:00.518243+0000","last_active":"2024-09-12T01:56:02.521372+0000","last_peered":"2024-09-12T01:56:02.521372+0000","last_clean":"2024-09-12T01:56:02.521372+0000","last_became_active":"2024-09-12T01:56:00.517815+0000","last_became_peered":"2024-09-12T01:56:00.517815+0000","last_unstale":"2024-09-12T01:56:02.521372+0000","last_undegraded":"2024-09-12T01:56:02.521372+0000","last_fullsized":"2024-09-12T01:56:02.521372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:59.474572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521936+0000","last_change":"2024-09-12T01:55:55.683383+0000","last_active":"2024-09-12T01:56:02.521936+0000","last_peered":"2024-09-12T01:56:02.521936+0000","last_clean":"2024-09-12T01:56:02.521936+0000","last_became_active":"2024-09-12T01:55:55.683045+0000","last_became_peered":"2024-09-12T01:55:55.683045+0000","last_unstale":"2024-09-12T01:56:02.521936+0000","last_undegraded":"2024-09-12T01:56:02.521936+0000","last_fullsized":"2024-09-12T01:56:02.521936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:11.963913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752400+0000","last_change":"2024-09-12T01:55:54.693479+0000","last_active":"2024-09-12T01:56:01.752400+0000","last_peered":"2024-09-12T01:56:01.752400+0000","last_clean":"2024-09-12T01:56:01.752400+0000","last_became_active":"2024-09-12T01:55:54.693222+0000","last_became_peered":"2024-09-12T01:55:54.693222+0000","last_unstale":"2024-09-12T01:56:01.752400+0000","last_undegraded":"2024-09-12T01:56:01.752400+0000","last_fullsized":"2024-09-12T01:56:01.752400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:29.084779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460600+0000","last_change":"2024-09-12T01:56:00.517418+0000","last_active":"2024-09-12T01:56:02.460600+0000","last_peered":"2024-09-12T01:56:02.460600+0000","last_clean":"2024-09-12T01:56:02.460600+0000","last_became_active":"2024-09-12T01:56:00.516727+0000","last_became_peered":"2024-09-12T01:56:00.516727+0000","last_unstale":"2024-09-12T01:56:02.460600+0000","last_undegraded":"2024-09-12T01:56:02.460600+0000","last_fullsized":"2024-09-12T01:56:02.460600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:05.063807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522480+0000","last_change":"2024-09-12T01:55:55.705667+0000","last_active":"2024-09-12T01:56:02.522480+0000","last_peered":"2024-09-12T01:56:02.522480+0000","last_clean":"2024-09-12T01:56:02.522480+0000","last_became_active":"2024-09-12T01:55:55.705409+0000","last_became_peered":"2024-09-12T01:55:55.705409+0000","last_unstale":"2024-09-12T01:56:02.522480+0000","last_undegraded":"2024-09-12T01:56:02.522480+0000","last_fullsized":"2024-09-12T01:56:02.522480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:32.262001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522031+0000","last_change":"2024-09-12T01:55:54.690520+0000","last_active":"2024-09-12T01:56:02.522031+0000","last_peered":"2024-09-12T01:56:02.522031+0000","last_clean":"2024-09-12T01:56:02.522031+0000","last_became_active":"2024-09-12T01:55:54.690206+0000","last_became_peered":"2024-09-12T01:55:54.690206+0000","last_unstale":"2024-09-12T01:56:02.522031+0000","last_undegraded":"2024-09-12T01:56:02.522031+0000","last_fullsized":"2024-09-12T01:56:02.522031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:12.368192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521948+0000","last_change":"2024-09-12T01:55:59.722879+0000","last_active":"2024-09-12T01:56:02.521948+0000","last_peered":"2024-09-12T01:56:02.521948+0000","last_clean":"2024-09-12T01:56:02.521948+0000","last_became_active":"2024-09-12T01:55:59.722470+0000","last_became_peered":"2024-09-12T01:55:59.722470+0000","last_unstale":"2024-09-12T01:56:02.521948+0000","last_undegraded":"2024-09-12T01:56:02.521948+0000","last_fullsized":"2024-09-12T01:56:02.521948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:37.646140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996762+0000","last_change":"2024-09-12T01:55:55.694445+0000","last_active":"2024-09-12T01:56:01.996762+0000","last_peered":"2024-09-12T01:56:01.996762+0000","last_clean":"2024-09-12T01:56:01.996762+0000","last_became_active":"2024-09-12T01:55:55.694183+0000","last_became_peered":"2024-09-12T01:55:55.694183+0000","last_unstale":"2024-09-12T01:56:01.996762+0000","last_undegraded":"2024-09-12T01:56:01.996762+0000","last_fullsized":"2024-09-12T01:56:01.996762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:34.647815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522397+0000","last_change":"2024-09-12T01:55:54.692279+0000","last_active":"2024-09-12T01:56:02.522397+0000","last_peered":"2024-09-12T01:56:02.522397+0000","last_clean":"2024-09-12T01:56:02.522397+0000","last_became_active":"2024-09-12T01:55:54.692012+0000","last_became_peered":"2024-09-12T01:55:54.692012+0000","last_unstale":"2024-09-12T01:56:02.522397+0000","last_undegraded":"2024-09-12T01:56:02.522397+0000","last_fullsized":"2024-09-12T01:56:02.522397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:23.224359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522020+0000","last_change":"2024-09-12T01:55:59.729468+0000","last_active":"2024-09-12T01:56:02.522020+0000","last_peered":"2024-09-12T01:56:02.522020+0000","last_clean":"2024-09-12T01:56:02.522020+0000","last_became_active":"2024-09-12T01:55:59.729028+0000","last_became_peered":"2024-09-12T01:55:59.729028+0000","last_unstale":"2024-09-12T01:56:02.522020+0000","last_undegraded":"2024-09-12T01:56:02.522020+0000","last_fullsized":"2024-09-12T01:56:02.522020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:25.728022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521427+0000","last_change":"2024-09-12T01:55:55.683856+0000","last_active":"2024-09-12T01:56:02.521427+0000","last_peered":"2024-09-12T01:56:02.521427+0000","last_clean":"2024-09-12T01:56:02.521427+0000","last_became_active":"2024-09-12T01:55:55.683567+0000","last_became_peered":"2024-09-12T01:55:55.683567+0000","last_unstale":"2024-09-12T01:56:02.521427+0000","last_undegraded":"2024-09-12T01:56:02.521427+0000","last_fullsized":"2024-09-12T01:56:02.521427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:44.949953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745947+0000","last_change":"2024-09-12T01:55:54.694100+0000","last_active":"2024-09-12T01:56:01.745947+0000","last_peered":"2024-09-12T01:56:01.745947+0000","last_clean":"2024-09-12T01:56:01.745947+0000","last_became_active":"2024-09-12T01:55:54.693791+0000","last_became_peered":"2024-09-12T01:55:54.693791+0000","last_unstale":"2024-09-12T01:56:01.745947+0000","last_undegraded":"2024-09-12T01:56:01.745947+0000","last_fullsized":"2024-09-12T01:56:01.745947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:28.370799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522265+0000","last_change":"2024-09-12T01:55:59.729446+0000","last_active":"2024-09-12T01:56:02.522265+0000","last_peered":"2024-09-12T01:56:02.522265+0000","last_clean":"2024-09-12T01:56:02.522265+0000","last_became_active":"2024-09-12T01:55:59.729062+0000","last_became_peered":"2024-09-12T01:55:59.729062+0000","last_unstale":"2024-09-12T01:56:02.522265+0000","last_undegraded":"2024-09-12T01:56:02.522265+0000","last_fullsized":"2024-09-12T01:56:02.522265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:05.710174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460187+0000","last_change":"2024-09-12T01:55:55.699106+0000","last_active":"2024-09-12T01:56:02.460187+0000","last_peered":"2024-09-12T01:56:02.460187+0000","last_clean":"2024-09-12T01:56:02.460187+0000","last_became_active":"2024-09-12T01:55:55.698839+0000","last_became_peered":"2024-09-12T01:55:55.698839+0000","last_unstale":"2024-09-12T01:56:02.460187+0000","last_undegraded":"2024-09-12T01:56:02.460187+0000","last_fullsized":"2024-09-12T01:56:02.460187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:34.183993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751389+0000","last_change":"2024-09-12T01:55:54.690892+0000","last_active":"2024-09-12T01:56:01.751389+0000","last_peered":"2024-09-12T01:56:01.751389+0000","last_clean":"2024-09-12T01:56:01.751389+0000","last_became_active":"2024-09-12T01:55:54.690615+0000","last_became_peered":"2024-09-12T01:55:54.690615+0000","last_unstale":"2024-09-12T01:56:01.751389+0000","last_undegraded":"2024-09-12T01:56:01.751389+0000","last_fullsized":"2024-09-12T01:56:01.751389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:27.061787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460647+0000","last_change":"2024-09-12T01:56:00.518805+0000","last_active":"2024-09-12T01:56:02.460647+0000","last_peered":"2024-09-12T01:56:02.460647+0000","last_clean":"2024-09-12T01:56:02.460647+0000","last_became_active":"2024-09-12T01:56:00.518224+0000","last_became_peered":"2024-09-12T01:56:00.518224+0000","last_unstale":"2024-09-12T01:56:02.460647+0000","last_undegraded":"2024-09-12T01:56:02.460647+0000","last_fullsized":"2024-09-12T01:56:02.460647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:56.545297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522174+0000","last_change":"2024-09-12T01:55:55.702458+0000","last_active":"2024-09-12T01:56:02.522174+0000","last_peered":"2024-09-12T01:56:02.522174+0000","last_clean":"2024-09-12T01:56:02.522174+0000","last_became_active":"2024-09-12T01:55:55.702160+0000","last_became_peered":"2024-09-12T01:55:55.702160+0000","last_unstale":"2024-09-12T01:56:02.522174+0000","last_undegraded":"2024-09-12T01:56:02.522174+0000","last_fullsized":"2024-09-12T01:56:02.522174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:49.260515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522189+0000","last_change":"2024-09-12T01:55:54.688748+0000","last_active":"2024-09-12T01:56:02.522189+0000","last_peered":"2024-09-12T01:56:02.522189+0000","last_clean":"2024-09-12T01:56:02.522189+0000","last_became_active":"2024-09-12T01:55:54.688278+0000","last_became_peered":"2024-09-12T01:55:54.688278+0000","last_unstale":"2024-09-12T01:56:02.522189+0000","last_undegraded":"2024-09-12T01:56:02.522189+0000","last_fullsized":"2024-09-12T01:56:02.522189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:51.779183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751452+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:56:01.751452+0000","last_peered":"2024-09-12T01:56:01.751452+0000","last_clean":"2024-09-12T01:56:01.751452+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:56:01.751452+0000","last_undegraded":"2024-09-12T01:56:01.751452+0000","last_fullsized":"2024-09-12T01:56:01.751452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752349+0000","last_change":"2024-09-12T01:56:00.520068+0000","last_active":"2024-09-12T01:56:01.752349+0000","last_peered":"2024-09-12T01:56:01.752349+0000","last_clean":"2024-09-12T01:56:01.752349+0000","last_became_active":"2024-09-12T01:56:00.519253+0000","last_became_peered":"2024-09-12T01:56:00.519253+0000","last_unstale":"2024-09-12T01:56:01.752349+0000","last_undegraded":"2024-09-12T01:56:01.752349+0000","last_fullsized":"2024-09-12T01:56:01.752349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:24.528900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752013+0000","last_change":"2024-09-12T01:55:55.701349+0000","last_active":"2024-09-12T01:56:01.752013+0000","last_peered":"2024-09-12T01:56:01.752013+0000","last_clean":"2024-09-12T01:56:01.752013+0000","last_became_active":"2024-09-12T01:55:55.701081+0000","last_became_peered":"2024-09-12T01:55:55.701081+0000","last_unstale":"2024-09-12T01:56:01.752013+0000","last_undegraded":"2024-09-12T01:56:01.752013+0000","last_fullsized":"2024-09-12T01:56:01.752013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:22.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.746220+0000","last_change":"2024-09-12T01:55:54.686812+0000","last_active":"2024-09-12T01:56:01.746220+0000","last_peered":"2024-09-12T01:56:01.746220+0000","last_clean":"2024-09-12T01:56:01.746220+0000","last_became_active":"2024-09-12T01:55:54.685661+0000","last_became_peered":"2024-09-12T01:55:54.685661+0000","last_unstale":"2024-09-12T01:56:01.746220+0000","last_undegraded":"2024-09-12T01:56:01.746220+0000","last_fullsized":"2024-09-12T01:56:01.746220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:48.747240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752114+0000","last_change":"2024-09-12T01:56:00.519411+0000","last_active":"2024-09-12T01:56:01.752114+0000","last_peered":"2024-09-12T01:56:01.752114+0000","last_clean":"2024-09-12T01:56:01.752114+0000","last_became_active":"2024-09-12T01:56:00.518566+0000","last_became_peered":"2024-09-12T01:56:00.518566+0000","last_unstale":"2024-09-12T01:56:01.752114+0000","last_undegraded":"2024-09-12T01:56:01.752114+0000","last_fullsized":"2024-09-12T01:56:01.752114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:24.282033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522391+0000","last_change":"2024-09-12T01:55:55.702467+0000","last_active":"2024-09-12T01:56:02.522391+0000","last_peered":"2024-09-12T01:56:02.522391+0000","last_clean":"2024-09-12T01:56:02.522391+0000","last_became_active":"2024-09-12T01:55:55.702195+0000","last_became_peered":"2024-09-12T01:55:55.702195+0000","last_unstale":"2024-09-12T01:56:02.522391+0000","last_undegraded":"2024-09-12T01:56:02.522391+0000","last_fullsized":"2024-09-12T01:56:02.522391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:20.499801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522219+0000","last_change":"2024-09-12T01:55:54.687072+0000","last_active":"2024-09-12T01:56:02.522219+0000","last_peered":"2024-09-12T01:56:02.522219+0000","last_clean":"2024-09-12T01:56:02.522219+0000","last_became_active":"2024-09-12T01:55:54.686806+0000","last_became_peered":"2024-09-12T01:55:54.686806+0000","last_unstale":"2024-09-12T01:56:02.522219+0000","last_undegraded":"2024-09-12T01:56:02.522219+0000","last_fullsized":"2024-09-12T01:56:02.522219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:33.642516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460732+0000","last_change":"2024-09-12T01:55:59.719758+0000","last_active":"2024-09-12T01:56:02.460732+0000","last_peered":"2024-09-12T01:56:02.460732+0000","last_clean":"2024-09-12T01:56:02.460732+0000","last_became_active":"2024-09-12T01:55:59.719193+0000","last_became_peered":"2024-09-12T01:55:59.719193+0000","last_unstale":"2024-09-12T01:56:02.460732+0000","last_undegraded":"2024-09-12T01:56:02.460732+0000","last_fullsized":"2024-09-12T01:56:02.460732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:00.698014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752383+0000","last_change":"2024-09-12T01:55:55.700818+0000","last_active":"2024-09-12T01:56:01.752383+0000","last_peered":"2024-09-12T01:56:01.752383+0000","last_clean":"2024-09-12T01:56:01.752383+0000","last_became_active":"2024-09-12T01:55:55.700254+0000","last_became_peered":"2024-09-12T01:55:55.700254+0000","last_unstale":"2024-09-12T01:56:01.752383+0000","last_undegraded":"2024-09-12T01:56:01.752383+0000","last_fullsized":"2024-09-12T01:56:01.752383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:05.947832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745796+0000","last_change":"2024-09-12T01:55:54.695464+0000","last_active":"2024-09-12T01:56:01.745796+0000","last_peered":"2024-09-12T01:56:01.745796+0000","last_clean":"2024-09-12T01:56:01.745796+0000","last_became_active":"2024-09-12T01:55:54.695083+0000","last_became_peered":"2024-09-12T01:55:54.695083+0000","last_unstale":"2024-09-12T01:56:01.745796+0000","last_undegraded":"2024-09-12T01:56:01.745796+0000","last_fullsized":"2024-09-12T01:56:01.745796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:51.779183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521828+0000","last_change":"2024-09-12T01:56:00.522126+0000","last_active":"2024-09-12T01:56:02.521828+0000","last_peered":"2024-09-12T01:56:02.521828+0000","last_clean":"2024-09-12T01:56:02.521828+0000","last_became_active":"2024-09-12T01:56:00.521651+0000","last_became_peered":"2024-09-12T01:56:00.521651+0000","last_unstale":"2024-09-12T01:56:02.521828+0000","last_undegraded":"2024-09-12T01:56:02.521828+0000","last_fullsized":"2024-09-12T01:56:02.521828+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:48.043231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752282+0000","last_change":"2024-09-12T01:55:55.701400+0000","last_active":"2024-09-12T01:56:01.752282+0000","last_peered":"2024-09-12T01:56:01.752282+0000","last_clean":"2024-09-12T01:56:01.752282+0000","last_became_active":"2024-09-12T01:55:55.700281+0000","last_became_peered":"2024-09-12T01:55:55.700281+0000","last_unstale":"2024-09-12T01:56:01.752282+0000","last_undegraded":"2024-09-12T01:56:01.752282+0000","last_fullsized":"2024-09-12T01:56:01.752282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:32.262001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996924+0000","last_change":"2024-09-12T01:55:54.691224+0000","last_active":"2024-09-12T01:56:01.996924+0000","last_peered":"2024-09-12T01:56:01.996924+0000","last_clean":"2024-09-12T01:56:01.996924+0000","last_became_active":"2024-09-12T01:55:54.690944+0000","last_became_peered":"2024-09-12T01:55:54.690944+0000","last_unstale":"2024-09-12T01:56:01.996924+0000","last_undegraded":"2024-09-12T01:56:01.996924+0000","last_fullsized":"2024-09-12T01:56:01.996924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:51.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996161+0000","last_change":"2024-09-12T01:55:59.722394+0000","last_active":"2024-09-12T01:56:01.996161+0000","last_peered":"2024-09-12T01:56:01.996161+0000","last_clean":"2024-09-12T01:56:01.996161+0000","last_became_active":"2024-09-12T01:55:59.721835+0000","last_became_peered":"2024-09-12T01:55:59.721835+0000","last_unstale":"2024-09-12T01:56:01.996161+0000","last_undegraded":"2024-09-12T01:56:01.996161+0000","last_fullsized":"2024-09-12T01:56:01.996161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:06.742059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752118+0000","last_change":"2024-09-12T01:55:55.700667+0000","last_active":"2024-09-12T01:56:01.752118+0000","last_peered":"2024-09-12T01:56:01.752118+0000","last_clean":"2024-09-12T01:56:01.752118+0000","last_became_active":"2024-09-12T01:55:55.700369+0000","last_became_peered":"2024-09-12T01:55:55.700369+0000","last_unstale":"2024-09-12T01:56:01.752118+0000","last_undegraded":"2024-09-12T01:56:01.752118+0000","last_fullsized":"2024-09-12T01:56:01.752118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:17.560307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745655+0000","last_change":"2024-09-12T01:55:54.687908+0000","last_active":"2024-09-12T01:56:01.745655+0000","last_peered":"2024-09-12T01:56:01.745655+0000","last_clean":"2024-09-12T01:56:01.745655+0000","last_became_active":"2024-09-12T01:55:54.687608+0000","last_became_peered":"2024-09-12T01:55:54.687608+0000","last_unstale":"2024-09-12T01:56:01.745655+0000","last_undegraded":"2024-09-12T01:56:01.745655+0000","last_fullsized":"2024-09-12T01:56:01.745655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:56.359673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460597+0000","last_change":"2024-09-12T01:55:59.718288+0000","last_active":"2024-09-12T01:56:02.460597+0000","last_peered":"2024-09-12T01:56:02.460597+0000","last_clean":"2024-09-12T01:56:02.460597+0000","last_became_active":"2024-09-12T01:55:59.717322+0000","last_became_peered":"2024-09-12T01:55:59.717322+0000","last_unstale":"2024-09-12T01:56:02.460597+0000","last_undegraded":"2024-09-12T01:56:02.460597+0000","last_fullsized":"2024-09-12T01:56:02.460597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:22.647699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752673+0000","last_change":"2024-09-12T01:55:55.688289+0000","last_active":"2024-09-12T01:56:01.752673+0000","last_peered":"2024-09-12T01:56:01.752673+0000","last_clean":"2024-09-12T01:56:01.752673+0000","last_became_active":"2024-09-12T01:55:55.688004+0000","last_became_peered":"2024-09-12T01:55:55.688004+0000","last_unstale":"2024-09-12T01:56:01.752673+0000","last_undegraded":"2024-09-12T01:56:01.752673+0000","last_fullsized":"2024-09-12T01:56:01.752673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:10.809959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752404+0000","last_change":"2024-09-12T01:55:54.689369+0000","last_active":"2024-09-12T01:56:01.752404+0000","last_peered":"2024-09-12T01:56:01.752404+0000","last_clean":"2024-09-12T01:56:01.752404+0000","last_became_active":"2024-09-12T01:55:54.689097+0000","last_became_peered":"2024-09-12T01:55:54.689097+0000","last_unstale":"2024-09-12T01:56:01.752404+0000","last_undegraded":"2024-09-12T01:56:01.752404+0000","last_fullsized":"2024-09-12T01:56:01.752404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:48.747240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522904+0000","last_change":"2024-09-12T01:56:00.520323+0000","last_active":"2024-09-12T01:56:02.522904+0000","last_peered":"2024-09-12T01:56:02.522904+0000","last_clean":"2024-09-12T01:56:02.522904+0000","last_became_active":"2024-09-12T01:56:00.519824+0000","last_became_peered":"2024-09-12T01:56:00.519824+0000","last_unstale":"2024-09-12T01:56:02.522904+0000","last_undegraded":"2024-09-12T01:56:02.522904+0000","last_fullsized":"2024-09-12T01:56:02.522904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:52.098544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751804+0000","last_change":"2024-09-12T01:55:55.700672+0000","last_active":"2024-09-12T01:56:01.751804+0000","last_peered":"2024-09-12T01:56:01.751804+0000","last_clean":"2024-09-12T01:56:01.751804+0000","last_became_active":"2024-09-12T01:55:55.700200+0000","last_became_peered":"2024-09-12T01:55:55.700200+0000","last_unstale":"2024-09-12T01:56:01.751804+0000","last_undegraded":"2024-09-12T01:56:01.751804+0000","last_fullsized":"2024-09-12T01:56:01.751804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:52.516198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522306+0000","last_change":"2024-09-12T01:55:54.693863+0000","last_active":"2024-09-12T01:56:02.522306+0000","last_peered":"2024-09-12T01:56:02.522306+0000","last_clean":"2024-09-12T01:56:02.522306+0000","last_became_active":"2024-09-12T01:55:54.693523+0000","last_became_peered":"2024-09-12T01:55:54.693523+0000","last_unstale":"2024-09-12T01:56:02.522306+0000","last_undegraded":"2024-09-12T01:56:02.522306+0000","last_fullsized":"2024-09-12T01:56:02.522306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:48.747240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522582+0000","last_change":"2024-09-12T01:56:00.517194+0000","last_active":"2024-09-12T01:56:02.522582+0000","last_peered":"2024-09-12T01:56:02.522582+0000","last_clean":"2024-09-12T01:56:02.522582+0000","last_became_active":"2024-09-12T01:56:00.516727+0000","last_became_peered":"2024-09-12T01:56:00.516727+0000","last_unstale":"2024-09-12T01:56:02.522582+0000","last_undegraded":"2024-09-12T01:56:02.522582+0000","last_fullsized":"2024-09-12T01:56:02.522582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:00.596782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460450+0000","last_change":"2024-09-12T01:55:55.698062+0000","last_active":"2024-09-12T01:56:02.460450+0000","last_peered":"2024-09-12T01:56:02.460450+0000","last_clean":"2024-09-12T01:56:02.460450+0000","last_became_active":"2024-09-12T01:55:55.697776+0000","last_became_peered":"2024-09-12T01:55:55.697776+0000","last_unstale":"2024-09-12T01:56:02.460450+0000","last_undegraded":"2024-09-12T01:56:02.460450+0000","last_fullsized":"2024-09-12T01:56:02.460450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:28.067086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460790+0000","last_change":"2024-09-12T01:55:54.689127+0000","last_active":"2024-09-12T01:56:02.460790+0000","last_peered":"2024-09-12T01:56:02.460790+0000","last_clean":"2024-09-12T01:56:02.460790+0000","last_became_active":"2024-09-12T01:55:54.688722+0000","last_became_peered":"2024-09-12T01:55:54.688722+0000","last_unstale":"2024-09-12T01:56:02.460790+0000","last_undegraded":"2024-09-12T01:56:02.460790+0000","last_fullsized":"2024-09-12T01:56:02.460790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:56.353031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522434+0000","last_change":"2024-09-12T01:56:00.517059+0000","last_active":"2024-09-12T01:56:02.522434+0000","last_peered":"2024-09-12T01:56:02.522434+0000","last_clean":"2024-09-12T01:56:02.522434+0000","last_became_active":"2024-09-12T01:56:00.516595+0000","last_became_peered":"2024-09-12T01:56:00.516595+0000","last_unstale":"2024-09-12T01:56:02.522434+0000","last_undegraded":"2024-09-12T01:56:02.522434+0000","last_fullsized":"2024-09-12T01:56:02.522434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:14.390892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751922+0000","last_change":"2024-09-12T01:55:55.707760+0000","last_active":"2024-09-12T01:56:01.751922+0000","last_peered":"2024-09-12T01:56:01.751922+0000","last_clean":"2024-09-12T01:56:01.751922+0000","last_became_active":"2024-09-12T01:55:55.707514+0000","last_became_peered":"2024-09-12T01:55:55.707514+0000","last_unstale":"2024-09-12T01:56:01.751922+0000","last_undegraded":"2024-09-12T01:56:01.751922+0000","last_fullsized":"2024-09-12T01:56:01.751922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:20.499801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.256902+0000","last_change":"2024-09-12T01:55:54.690854+0000","last_active":"2024-09-12T01:56:05.256902+0000","last_peered":"2024-09-12T01:56:05.256902+0000","last_clean":"2024-09-12T01:56:05.256902+0000","last_became_active":"2024-09-12T01:55:54.690565+0000","last_became_peered":"2024-09-12T01:55:54.690565+0000","last_unstale":"2024-09-12T01:56:05.256902+0000","last_undegraded":"2024-09-12T01:56:05.256902+0000","last_fullsized":"2024-09-12T01:56:05.256902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:31.710719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522153+0000","last_change":"2024-09-12T01:55:59.728073+0000","last_active":"2024-09-12T01:56:02.522153+0000","last_peered":"2024-09-12T01:56:02.522153+0000","last_clean":"2024-09-12T01:56:02.522153+0000","last_became_active":"2024-09-12T01:55:59.727655+0000","last_became_peered":"2024-09-12T01:55:59.727655+0000","last_unstale":"2024-09-12T01:56:02.522153+0000","last_undegraded":"2024-09-12T01:56:02.522153+0000","last_fullsized":"2024-09-12T01:56:02.522153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:33.869240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996898+0000","last_change":"2024-09-12T01:55:55.698999+0000","last_active":"2024-09-12T01:56:01.996898+0000","last_peered":"2024-09-12T01:56:01.996898+0000","last_clean":"2024-09-12T01:56:01.996898+0000","last_became_active":"2024-09-12T01:55:55.698735+0000","last_became_peered":"2024-09-12T01:55:55.698735+0000","last_unstale":"2024-09-12T01:56:01.996898+0000","last_undegraded":"2024-09-12T01:56:01.996898+0000","last_fullsized":"2024-09-12T01:56:01.996898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:20.510009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522100+0000","last_change":"2024-09-12T01:55:54.692048+0000","last_active":"2024-09-12T01:56:02.522100+0000","last_peered":"2024-09-12T01:56:02.522100+0000","last_clean":"2024-09-12T01:56:02.522100+0000","last_became_active":"2024-09-12T01:55:54.691732+0000","last_became_peered":"2024-09-12T01:55:54.691732+0000","last_unstale":"2024-09-12T01:56:02.522100+0000","last_undegraded":"2024-09-12T01:56:02.522100+0000","last_fullsized":"2024-09-12T01:56:02.522100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:17.698798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996696+0000","last_change":"2024-09-12T01:55:59.715880+0000","last_active":"2024-09-12T01:56:01.996696+0000","last_peered":"2024-09-12T01:56:01.996696+0000","last_clean":"2024-09-12T01:56:01.996696+0000","last_became_active":"2024-09-12T01:55:59.715168+0000","last_became_peered":"2024-09-12T01:55:59.715168+0000","last_unstale":"2024-09-12T01:56:01.996696+0000","last_undegraded":"2024-09-12T01:56:01.996696+0000","last_fullsized":"2024-09-12T01:56:01.996696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:05.710174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460633+0000","last_change":"2024-09-12T01:55:55.690745+0000","last_active":"2024-09-12T01:56:02.460633+0000","last_peered":"2024-09-12T01:56:02.460633+0000","last_clean":"2024-09-12T01:56:02.460633+0000","last_became_active":"2024-09-12T01:55:55.690480+0000","last_became_peered":"2024-09-12T01:55:55.690480+0000","last_unstale":"2024-09-12T01:56:02.460633+0000","last_undegraded":"2024-09-12T01:56:02.460633+0000","last_fullsized":"2024-09-12T01:56:02.460633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:10.058977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522473+0000","last_change":"2024-09-12T01:55:54.691114+0000","last_active":"2024-09-12T01:56:02.522473+0000","last_peered":"2024-09-12T01:56:02.522473+0000","last_clean":"2024-09-12T01:56:02.522473+0000","last_became_active":"2024-09-12T01:55:54.690834+0000","last_became_peered":"2024-09-12T01:55:54.690834+0000","last_unstale":"2024-09-12T01:56:02.522473+0000","last_undegraded":"2024-09-12T01:56:02.522473+0000","last_fullsized":"2024-09-12T01:56:02.522473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:31.710719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521529+0000","last_change":"2024-09-12T01:55:59.722973+0000","last_active":"2024-09-12T01:56:02.521529+0000","last_peered":"2024-09-12T01:56:02.521529+0000","last_clean":"2024-09-12T01:56:02.521529+0000","last_became_active":"2024-09-12T01:55:59.722494+0000","last_became_peered":"2024-09-12T01:55:59.722494+0000","last_unstale":"2024-09-12T01:56:02.521529+0000","last_undegraded":"2024-09-12T01:56:02.521529+0000","last_fullsized":"2024-09-12T01:56:02.521529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:50.692862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522436+0000","last_change":"2024-09-12T01:55:55.696532+0000","last_active":"2024-09-12T01:56:02.522436+0000","last_peered":"2024-09-12T01:56:02.522436+0000","last_clean":"2024-09-12T01:56:02.522436+0000","last_became_active":"2024-09-12T01:55:55.696061+0000","last_became_peered":"2024-09-12T01:55:55.696061+0000","last_unstale":"2024-09-12T01:56:02.522436+0000","last_undegraded":"2024-09-12T01:56:02.522436+0000","last_fullsized":"2024-09-12T01:56:02.522436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.073038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752084+0000","last_change":"2024-09-12T01:55:54.687182+0000","last_active":"2024-09-12T01:56:01.752084+0000","last_peered":"2024-09-12T01:56:01.752084+0000","last_clean":"2024-09-12T01:56:01.752084+0000","last_became_active":"2024-09-12T01:55:54.686893+0000","last_became_peered":"2024-09-12T01:55:54.686893+0000","last_unstale":"2024-09-12T01:56:01.752084+0000","last_undegraded":"2024-09-12T01:56:01.752084+0000","last_fullsized":"2024-09-12T01:56:01.752084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:56.359673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521857+0000","last_change":"2024-09-12T01:56:00.519118+0000","last_active":"2024-09-12T01:56:02.521857+0000","last_peered":"2024-09-12T01:56:02.521857+0000","last_clean":"2024-09-12T01:56:02.521857+0000","last_became_active":"2024-09-12T01:56:00.518658+0000","last_became_peered":"2024-09-12T01:56:00.518658+0000","last_unstale":"2024-09-12T01:56:02.521857+0000","last_undegraded":"2024-09-12T01:56:02.521857+0000","last_fullsized":"2024-09-12T01:56:02.521857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:01.814275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460479+0000","last_change":"2024-09-12T01:56:00.519981+0000","last_active":"2024-09-12T01:56:02.460479+0000","last_peered":"2024-09-12T01:56:02.460479+0000","last_clean":"2024-09-12T01:56:02.460479+0000","last_became_active":"2024-09-12T01:56:00.519500+0000","last_became_peered":"2024-09-12T01:56:00.519500+0000","last_unstale":"2024-09-12T01:56:02.460479+0000","last_undegraded":"2024-09-12T01:56:02.460479+0000","last_fullsized":"2024-09-12T01:56:02.460479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:26.981322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521440+0000","last_change":"2024-09-12T01:55:55.687256+0000","last_active":"2024-09-12T01:56:02.521440+0000","last_peered":"2024-09-12T01:56:02.521440+0000","last_clean":"2024-09-12T01:56:02.521440+0000","last_became_active":"2024-09-12T01:55:55.685099+0000","last_became_peered":"2024-09-12T01:55:55.685099+0000","last_unstale":"2024-09-12T01:56:02.521440+0000","last_undegraded":"2024-09-12T01:56:02.521440+0000","last_fullsized":"2024-09-12T01:56:02.521440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:56.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522004+0000","last_change":"2024-09-12T01:55:54.694320+0000","last_active":"2024-09-12T01:56:02.522004+0000","last_peered":"2024-09-12T01:56:02.522004+0000","last_clean":"2024-09-12T01:56:02.522004+0000","last_became_active":"2024-09-12T01:55:54.694033+0000","last_became_peered":"2024-09-12T01:55:54.694033+0000","last_unstale":"2024-09-12T01:56:02.522004+0000","last_undegraded":"2024-09-12T01:56:02.522004+0000","last_fullsized":"2024-09-12T01:56:02.522004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:41.296972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751924+0000","last_change":"2024-09-12T01:55:59.721355+0000","last_active":"2024-09-12T01:56:01.751924+0000","last_peered":"2024-09-12T01:56:01.751924+0000","last_clean":"2024-09-12T01:56:01.751924+0000","last_became_active":"2024-09-12T01:55:59.720937+0000","last_became_peered":"2024-09-12T01:55:59.720937+0000","last_unstale":"2024-09-12T01:56:01.751924+0000","last_undegraded":"2024-09-12T01:56:01.751924+0000","last_fullsized":"2024-09-12T01:56:01.751924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:35.266537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521497+0000","last_change":"2024-09-12T01:55:55.703177+0000","last_active":"2024-09-12T01:56:02.521497+0000","last_peered":"2024-09-12T01:56:02.521497+0000","last_clean":"2024-09-12T01:56:02.521497+0000","last_became_active":"2024-09-12T01:55:55.697845+0000","last_became_peered":"2024-09-12T01:55:55.697845+0000","last_unstale":"2024-09-12T01:56:02.521497+0000","last_undegraded":"2024-09-12T01:56:02.521497+0000","last_fullsized":"2024-09-12T01:56:02.521497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:44.949953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521959+0000","last_change":"2024-09-12T01:55:54.690580+0000","last_active":"2024-09-12T01:56:02.521959+0000","last_peered":"2024-09-12T01:56:02.521959+0000","last_clean":"2024-09-12T01:56:02.521959+0000","last_became_active":"2024-09-12T01:55:54.690300+0000","last_became_peered":"2024-09-12T01:55:54.690300+0000","last_unstale":"2024-09-12T01:56:02.521959+0000","last_undegraded":"2024-09-12T01:56:02.521959+0000","last_fullsized":"2024-09-12T01:56:02.521959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:32.489045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752411+0000","last_change":"2024-09-12T01:55:54.687192+0000","last_active":"2024-09-12T01:56:01.752411+0000","last_peered":"2024-09-12T01:56:01.752411+0000","last_clean":"2024-09-12T01:56:01.752411+0000","last_became_active":"2024-09-12T01:55:54.686880+0000","last_became_peered":"2024-09-12T01:55:54.686880+0000","last_unstale":"2024-09-12T01:56:01.752411+0000","last_undegraded":"2024-09-12T01:56:01.752411+0000","last_fullsized":"2024-09-12T01:56:01.752411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:23.224359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460765+0000","last_change":"2024-09-12T01:55:55.693529+0000","last_active":"2024-09-12T01:56:02.460765+0000","last_peered":"2024-09-12T01:56:02.460765+0000","last_clean":"2024-09-12T01:56:02.460765+0000","last_became_active":"2024-09-12T01:55:55.693245+0000","last_became_peered":"2024-09-12T01:55:55.693245+0000","last_unstale":"2024-09-12T01:56:02.460765+0000","last_undegraded":"2024-09-12T01:56:02.460765+0000","last_fullsized":"2024-09-12T01:56:02.460765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:53.221222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.746166+0000","last_change":"2024-09-12T01:55:59.718401+0000","last_active":"2024-09-12T01:56:01.746166+0000","last_peered":"2024-09-12T01:56:01.746166+0000","last_clean":"2024-09-12T01:56:01.746166+0000","last_became_active":"2024-09-12T01:55:59.717933+0000","last_became_peered":"2024-09-12T01:55:59.717933+0000","last_unstale":"2024-09-12T01:56:01.746166+0000","last_undegraded":"2024-09-12T01:56:01.746166+0000","last_fullsized":"2024-09-12T01:56:01.746166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.213092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522420+0000","last_change":"2024-09-12T01:55:54.691342+0000","last_active":"2024-09-12T01:56:02.522420+0000","last_peered":"2024-09-12T01:56:02.522420+0000","last_clean":"2024-09-12T01:56:02.522420+0000","last_became_active":"2024-09-12T01:55:54.691025+0000","last_became_peered":"2024-09-12T01:55:54.691025+0000","last_unstale":"2024-09-12T01:56:02.522420+0000","last_undegraded":"2024-09-12T01:56:02.522420+0000","last_fullsized":"2024-09-12T01:56:02.522420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:51.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996419+0000","last_change":"2024-09-12T01:55:55.698351+0000","last_active":"2024-09-12T01:56:01.996419+0000","last_peered":"2024-09-12T01:56:01.996419+0000","last_clean":"2024-09-12T01:56:01.996419+0000","last_became_active":"2024-09-12T01:55:55.698050+0000","last_became_peered":"2024-09-12T01:55:55.698050+0000","last_unstale":"2024-09-12T01:56:01.996419+0000","last_undegraded":"2024-09-12T01:56:01.996419+0000","last_fullsized":"2024-09-12T01:56:01.996419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:50.888763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522693+0000","last_change":"2024-09-12T01:55:59.722326+0000","last_active":"2024-09-12T01:56:02.522693+0000","last_peered":"2024-09-12T01:56:02.522693+0000","last_clean":"2024-09-12T01:56:02.522693+0000","last_became_active":"2024-09-12T01:55:59.721902+0000","last_became_peered":"2024-09-12T01:55:59.721902+0000","last_unstale":"2024-09-12T01:56:02.522693+0000","last_undegraded":"2024-09-12T01:56:02.522693+0000","last_fullsized":"2024-09-12T01:56:02.522693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:39.486622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752590+0000","last_change":"2024-09-12T01:55:55.689349+0000","last_active":"2024-09-12T01:56:01.752590+0000","last_peered":"2024-09-12T01:56:01.752590+0000","last_clean":"2024-09-12T01:56:01.752590+0000","last_became_active":"2024-09-12T01:55:55.688915+0000","last_became_peered":"2024-09-12T01:55:55.688915+0000","last_unstale":"2024-09-12T01:56:01.752590+0000","last_undegraded":"2024-09-12T01:56:01.752590+0000","last_fullsized":"2024-09-12T01:56:01.752590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:28.067086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745858+0000","last_change":"2024-09-12T01:55:55.696841+0000","last_active":"2024-09-12T01:56:01.745858+0000","last_peered":"2024-09-12T01:56:01.745858+0000","last_clean":"2024-09-12T01:56:01.745858+0000","last_became_active":"2024-09-12T01:55:55.696545+0000","last_became_peered":"2024-09-12T01:55:55.696545+0000","last_unstale":"2024-09-12T01:56:01.745858+0000","last_undegraded":"2024-09-12T01:56:01.745858+0000","last_fullsized":"2024-09-12T01:56:01.745858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:46.163637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522177+0000","last_change":"2024-09-12T01:55:55.705917+0000","last_active":"2024-09-12T01:56:02.522177+0000","last_peered":"2024-09-12T01:56:02.522177+0000","last_clean":"2024-09-12T01:56:02.522177+0000","last_became_active":"2024-09-12T01:55:55.705517+0000","last_became_peered":"2024-09-12T01:55:55.705517+0000","last_unstale":"2024-09-12T01:56:02.522177+0000","last_undegraded":"2024-09-12T01:56:02.522177+0000","last_fullsized":"2024-09-12T01:56:02.522177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:31.237438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460726+0000","last_change":"2024-09-12T01:55:55.705881+0000","last_active":"2024-09-12T01:56:02.460726+0000","last_peered":"2024-09-12T01:56:02.460726+0000","last_clean":"2024-09-12T01:56:02.460726+0000","last_became_active":"2024-09-12T01:55:55.705557+0000","last_became_peered":"2024-09-12T01:55:55.705557+0000","last_unstale":"2024-09-12T01:56:02.460726+0000","last_undegraded":"2024-09-12T01:56:02.460726+0000","last_fullsized":"2024-09-12T01:56:02.460726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.073038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522638+0000","last_change":"2024-09-12T01:55:55.704834+0000","last_active":"2024-09-12T01:56:02.522638+0000","last_peered":"2024-09-12T01:56:02.522638+0000","last_clean":"2024-09-12T01:56:02.522638+0000","last_became_active":"2024-09-12T01:55:55.702868+0000","last_became_peered":"2024-09-12T01:55:55.702868+0000","last_unstale":"2024-09-12T01:56:02.522638+0000","last_undegraded":"2024-09-12T01:56:02.522638+0000","last_fullsized":"2024-09-12T01:56:02.522638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:06.356761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521624+0000","last_change":"2024-09-12T01:55:55.685821+0000","last_active":"2024-09-12T01:56:02.521624+0000","last_peered":"2024-09-12T01:56:02.521624+0000","last_clean":"2024-09-12T01:56:02.521624+0000","last_became_active":"2024-09-12T01:55:55.685517+0000","last_became_peered":"2024-09-12T01:55:55.685517+0000","last_unstale":"2024-09-12T01:56:02.521624+0000","last_undegraded":"2024-09-12T01:56:02.521624+0000","last_fullsized":"2024-09-12T01:56:02.521624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:18.907293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752735+0000","last_change":"2024-09-12T01:55:55.697608+0000","last_active":"2024-09-12T01:56:01.752735+0000","last_peered":"2024-09-12T01:56:01.752735+0000","last_clean":"2024-09-12T01:56:01.752735+0000","last_became_active":"2024-09-12T01:55:55.697368+0000","last_became_peered":"2024-09-12T01:55:55.697368+0000","last_unstale":"2024-09-12T01:56:01.752735+0000","last_undegraded":"2024-09-12T01:56:01.752735+0000","last_fullsized":"2024-09-12T01:56:01.752735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:53.221222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522816+0000","last_change":"2024-09-12T01:55:55.704580+0000","last_active":"2024-09-12T01:56:02.522816+0000","last_peered":"2024-09-12T01:56:02.522816+0000","last_clean":"2024-09-12T01:56:02.522816+0000","last_became_active":"2024-09-12T01:55:55.704310+0000","last_became_peered":"2024-09-12T01:55:55.704310+0000","last_unstale":"2024-09-12T01:56:02.522816+0000","last_undegraded":"2024-09-12T01:56:02.522816+0000","last_fullsized":"2024-09-12T01:56:02.522816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:30.891591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521987+0000","last_change":"2024-09-12T01:55:55.702574+0000","last_active":"2024-09-12T01:56:02.521987+0000","last_peered":"2024-09-12T01:56:02.521987+0000","last_clean":"2024-09-12T01:56:02.521987+0000","last_became_active":"2024-09-12T01:55:55.702381+0000","last_became_peered":"2024-09-12T01:55:55.702381+0000","last_unstale":"2024-09-12T01:56:02.521987+0000","last_undegraded":"2024-09-12T01:56:02.521987+0000","last_fullsized":"2024-09-12T01:56:02.521987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:14.471944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521666+0000","last_change":"2024-09-12T01:55:55.702491+0000","last_active":"2024-09-12T01:56:02.521666+0000","last_peered":"2024-09-12T01:56:02.521666+0000","last_clean":"2024-09-12T01:56:02.521666+0000","last_became_active":"2024-09-12T01:55:55.702184+0000","last_became_peered":"2024-09-12T01:55:55.702184+0000","last_unstale":"2024-09-12T01:56:02.521666+0000","last_undegraded":"2024-09-12T01:56:02.521666+0000","last_fullsized":"2024-09-12T01:56:02.521666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:29.526104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522126+0000","last_change":"2024-09-12T01:55:55.696303+0000","last_active":"2024-09-12T01:56:02.522126+0000","last_peered":"2024-09-12T01:56:02.522126+0000","last_clean":"2024-09-12T01:56:02.522126+0000","last_became_active":"2024-09-12T01:55:55.696044+0000","last_became_peered":"2024-09-12T01:55:55.696044+0000","last_unstale":"2024-09-12T01:56:02.522126+0000","last_undegraded":"2024-09-12T01:56:02.522126+0000","last_fullsized":"2024-09-12T01:56:02.522126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:41.082029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460625+0000","last_change":"2024-09-12T01:55:55.698223+0000","last_active":"2024-09-12T01:56:02.460625+0000","last_peered":"2024-09-12T01:56:02.460625+0000","last_clean":"2024-09-12T01:56:02.460625+0000","last_became_active":"2024-09-12T01:55:55.697926+0000","last_became_peered":"2024-09-12T01:55:55.697926+0000","last_unstale":"2024-09-12T01:56:02.460625+0000","last_undegraded":"2024-09-12T01:56:02.460625+0000","last_fullsized":"2024-09-12T01:56:02.460625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:10.809959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752785+0000","last_change":"2024-09-12T01:55:55.687766+0000","last_active":"2024-09-12T01:56:01.752785+0000","last_peered":"2024-09-12T01:56:01.752785+0000","last_clean":"2024-09-12T01:56:01.752785+0000","last_became_active":"2024-09-12T01:55:55.687387+0000","last_became_peered":"2024-09-12T01:55:55.687387+0000","last_unstale":"2024-09-12T01:56:01.752785+0000","last_undegraded":"2024-09-12T01:56:01.752785+0000","last_fullsized":"2024-09-12T01:56:01.752785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:05.184458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752307+0000","last_change":"2024-09-12T01:55:55.697237+0000","last_active":"2024-09-12T01:56:01.752307+0000","last_peered":"2024-09-12T01:56:01.752307+0000","last_clean":"2024-09-12T01:56:01.752307+0000","last_became_active":"2024-09-12T01:55:55.696731+0000","last_became_peered":"2024-09-12T01:55:55.696731+0000","last_unstale":"2024-09-12T01:56:01.752307+0000","last_undegraded":"2024-09-12T01:56:01.752307+0000","last_fullsized":"2024-09-12T01:56:01.752307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:18.618600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745740+0000","last_change":"2024-09-12T01:55:55.691750+0000","last_active":"2024-09-12T01:56:01.745740+0000","last_peered":"2024-09-12T01:56:01.745740+0000","last_clean":"2024-09-12T01:56:01.745740+0000","last_became_active":"2024-09-12T01:55:55.691456+0000","last_became_peered":"2024-09-12T01:55:55.691456+0000","last_unstale":"2024-09-12T01:56:01.745740+0000","last_undegraded":"2024-09-12T01:56:01.745740+0000","last_fullsized":"2024-09-12T01:56:01.745740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:08.358541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522682+0000","last_change":"2024-09-12T01:55:55.699943+0000","last_active":"2024-09-12T01:56:02.522682+0000","last_peered":"2024-09-12T01:56:02.522682+0000","last_clean":"2024-09-12T01:56:02.522682+0000","last_became_active":"2024-09-12T01:55:55.699679+0000","last_became_peered":"2024-09-12T01:55:55.699679+0000","last_unstale":"2024-09-12T01:56:02.522682+0000","last_undegraded":"2024-09-12T01:56:02.522682+0000","last_fullsized":"2024-09-12T01:56:02.522682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:48.470241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521849+0000","last_change":"2024-09-12T01:55:55.689119+0000","last_active":"2024-09-12T01:56:02.521849+0000","last_peered":"2024-09-12T01:56:02.521849+0000","last_clean":"2024-09-12T01:56:02.521849+0000","last_became_active":"2024-09-12T01:55:55.688803+0000","last_became_peered":"2024-09-12T01:55:55.688803+0000","last_unstale":"2024-09-12T01:56:02.521849+0000","last_undegraded":"2024-09-12T01:56:02.521849+0000","last_fullsized":"2024-09-12T01:56:02.521849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:53.221222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521525+0000","last_change":"2024-09-12T01:55:55.699561+0000","last_active":"2024-09-12T01:56:02.521525+0000","last_peered":"2024-09-12T01:56:02.521525+0000","last_clean":"2024-09-12T01:56:02.521525+0000","last_became_active":"2024-09-12T01:55:55.699223+0000","last_became_peered":"2024-09-12T01:55:55.699223+0000","last_unstale":"2024-09-12T01:56:02.521525+0000","last_undegraded":"2024-09-12T01:56:02.521525+0000","last_fullsized":"2024-09-12T01:56:02.521525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:29.526104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460560+0000","last_change":"2024-09-12T01:55:55.692821+0000","last_active":"2024-09-12T01:56:02.460560+0000","last_peered":"2024-09-12T01:56:02.460560+0000","last_clean":"2024-09-12T01:56:02.460560+0000","last_became_active":"2024-09-12T01:55:55.692497+0000","last_became_peered":"2024-09-12T01:55:55.692497+0000","last_unstale":"2024-09-12T01:56:02.460560+0000","last_undegraded":"2024-09-12T01:56:02.460560+0000","last_fullsized":"2024-09-12T01:56:02.460560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:30.090079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522316+0000","last_change":"2024-09-12T01:55:55.703581+0000","last_active":"2024-09-12T01:56:02.522316+0000","last_peered":"2024-09-12T01:56:02.522316+0000","last_clean":"2024-09-12T01:56:02.522316+0000","last_became_active":"2024-09-12T01:55:55.703271+0000","last_became_peered":"2024-09-12T01:55:55.703271+0000","last_unstale":"2024-09-12T01:56:02.522316+0000","last_undegraded":"2024-09-12T01:56:02.522316+0000","last_fullsized":"2024-09-12T01:56:02.522316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:56.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996754+0000","last_change":"2024-09-12T01:55:55.692636+0000","last_active":"2024-09-12T01:56:01.996754+0000","last_peered":"2024-09-12T01:56:01.996754+0000","last_clean":"2024-09-12T01:56:01.996754+0000","last_became_active":"2024-09-12T01:55:55.692367+0000","last_became_peered":"2024-09-12T01:55:55.692367+0000","last_unstale":"2024-09-12T01:56:01.996754+0000","last_undegraded":"2024-09-12T01:56:01.996754+0000","last_fullsized":"2024-09-12T01:56:01.996754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:44.926267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752614+0000","last_change":"2024-09-12T01:55:55.698490+0000","last_active":"2024-09-12T01:56:01.752614+0000","last_peered":"2024-09-12T01:56:01.752614+0000","last_clean":"2024-09-12T01:56:01.752614+0000","last_became_active":"2024-09-12T01:55:55.698190+0000","last_became_peered":"2024-09-12T01:55:55.698190+0000","last_unstale":"2024-09-12T01:56:01.752614+0000","last_undegraded":"2024-09-12T01:56:01.752614+0000","last_fullsized":"2024-09-12T01:56:01.752614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:36.523619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752728+0000","last_change":"2024-09-12T01:55:55.695606+0000","last_active":"2024-09-12T01:56:01.752728+0000","last_peered":"2024-09-12T01:56:01.752728+0000","last_clean":"2024-09-12T01:56:01.752728+0000","last_became_active":"2024-09-12T01:55:55.695348+0000","last_became_peered":"2024-09-12T01:55:55.695348+0000","last_unstale":"2024-09-12T01:56:01.752728+0000","last_undegraded":"2024-09-12T01:56:01.752728+0000","last_fullsized":"2024-09-12T01:56:01.752728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:10.058977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752300+0000","last_change":"2024-09-12T01:55:55.696973+0000","last_active":"2024-09-12T01:56:01.752300+0000","last_peered":"2024-09-12T01:56:01.752300+0000","last_clean":"2024-09-12T01:56:01.752300+0000","last_became_active":"2024-09-12T01:55:55.696435+0000","last_became_peered":"2024-09-12T01:55:55.696435+0000","last_unstale":"2024-09-12T01:56:01.752300+0000","last_undegraded":"2024-09-12T01:56:01.752300+0000","last_fullsized":"2024-09-12T01:56:01.752300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:20.252934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521402+0000","last_change":"2024-09-12T01:55:55.703874+0000","last_active":"2024-09-12T01:56:02.521402+0000","last_peered":"2024-09-12T01:56:02.521402+0000","last_clean":"2024-09-12T01:56:02.521402+0000","last_became_active":"2024-09-12T01:55:55.703532+0000","last_became_peered":"2024-09-12T01:55:55.703532+0000","last_unstale":"2024-09-12T01:56:02.521402+0000","last_undegraded":"2024-09-12T01:56:02.521402+0000","last_fullsized":"2024-09-12T01:56:02.521402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:04.569624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751534+0000","last_change":"2024-09-12T01:55:55.704083+0000","last_active":"2024-09-12T01:56:01.751534+0000","last_peered":"2024-09-12T01:56:01.751534+0000","last_clean":"2024-09-12T01:56:01.751534+0000","last_became_active":"2024-09-12T01:55:55.703653+0000","last_became_peered":"2024-09-12T01:55:55.703653+0000","last_unstale":"2024-09-12T01:56:01.751534+0000","last_undegraded":"2024-09-12T01:56:01.751534+0000","last_fullsized":"2024-09-12T01:56:01.751534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:14.471944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522008+0000","last_change":"2024-09-12T01:55:55.693606+0000","last_active":"2024-09-12T01:56:02.522008+0000","last_peered":"2024-09-12T01:56:02.522008+0000","last_clean":"2024-09-12T01:56:02.522008+0000","last_became_active":"2024-09-12T01:55:55.693044+0000","last_became_peered":"2024-09-12T01:55:55.693044+0000","last_unstale":"2024-09-12T01:56:02.522008+0000","last_undegraded":"2024-09-12T01:56:02.522008+0000","last_fullsized":"2024-09-12T01:56:02.522008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:42.036492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751606+0000","last_change":"2024-09-12T01:55:55.697766+0000","last_active":"2024-09-12T01:56:01.751606+0000","last_peered":"2024-09-12T01:56:01.751606+0000","last_clean":"2024-09-12T01:56:01.751606+0000","last_became_active":"2024-09-12T01:55:55.697504+0000","last_became_peered":"2024-09-12T01:55:55.697504+0000","last_unstale":"2024-09-12T01:56:01.751606+0000","last_undegraded":"2024-09-12T01:56:01.751606+0000","last_fullsized":"2024-09-12T01:56:01.751606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:01.034708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522237+0000","last_change":"2024-09-12T01:55:55.705929+0000","last_active":"2024-09-12T01:56:02.522237+0000","last_peered":"2024-09-12T01:56:02.522237+0000","last_clean":"2024-09-12T01:56:02.522237+0000","last_became_active":"2024-09-12T01:55:55.705645+0000","last_became_peered":"2024-09-12T01:55:55.705645+0000","last_unstale":"2024-09-12T01:56:02.522237+0000","last_undegraded":"2024-09-12T01:56:02.522237+0000","last_fullsized":"2024-09-12T01:56:02.522237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:17.560307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460374+0000","last_change":"2024-09-12T01:55:55.689459+0000","last_active":"2024-09-12T01:56:02.460374+0000","last_peered":"2024-09-12T01:56:02.460374+0000","last_clean":"2024-09-12T01:56:02.460374+0000","last_became_active":"2024-09-12T01:55:55.688932+0000","last_became_peered":"2024-09-12T01:55:55.688932+0000","last_unstale":"2024-09-12T01:56:02.460374+0000","last_undegraded":"2024-09-12T01:56:02.460374+0000","last_fullsized":"2024-09-12T01:56:02.460374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:49.242430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521944+0000","last_change":"2024-09-12T01:55:55.694825+0000","last_active":"2024-09-12T01:56:02.521944+0000","last_peered":"2024-09-12T01:56:02.521944+0000","last_clean":"2024-09-12T01:56:02.521944+0000","last_became_active":"2024-09-12T01:55:55.693916+0000","last_became_peered":"2024-09-12T01:55:55.693916+0000","last_unstale":"2024-09-12T01:56:02.521944+0000","last_undegraded":"2024-09-12T01:56:02.521944+0000","last_fullsized":"2024-09-12T01:56:02.521944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:49.260515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752010+0000","last_change":"2024-09-12T01:55:55.696732+0000","last_active":"2024-09-12T01:56:01.752010+0000","last_peered":"2024-09-12T01:56:01.752010+0000","last_clean":"2024-09-12T01:56:01.752010+0000","last_became_active":"2024-09-12T01:55:55.696146+0000","last_became_peered":"2024-09-12T01:55:55.696146+0000","last_unstale":"2024-09-12T01:56:01.752010+0000","last_undegraded":"2024-09-12T01:56:01.752010+0000","last_fullsized":"2024-09-12T01:56:01.752010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:31.237438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":880640,"data_stored":705461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":118355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":286720,"data_stored":114601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":118355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":114511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":114671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":888832,"data_stored":705517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":114637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:56:20.165 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:56:20.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.302+0000 7f3769354640 1 Processor -- start 2024-09-12T01:56:20.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.302+0000 7f3769354640 1 -- start start 2024-09-12T01:56:20.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.303+0000 7f3769354640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f37640d30f0 0x7f37640b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:20.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.303+0000 7f3769354640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37640d3690 con 0x7f376415e5f0 2024-09-12T01:56:20.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.303+0000 7f3769354640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37640d3970 con 0x7f37640b64c0 2024-09-12T01:56:20.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.303+0000 7f3769354640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f376406d530 con 0x7f37640d30f0 2024-09-12T01:56:20.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.303+0000 7f3762ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f376415e5f0 0x7f37640d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44872/0 (socket says 172.21.15.19:44872) 2024-09-12T01:56:20.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.303+0000 7f3762ffd640 1 -- 172.21.15.19:0/2964303908 learned_addr learned my addr 172.21.15.19:0/2964303908 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:20.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.303+0000 7f37627fc640 1 --2- 172.21.15.19:0/2964303908 >> v2:172.21.15.135:3300/0 conn(0x7f37640d30f0 0x7f37640b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:20.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.303+0000 7f3761ffb640 1 -- 172.21.15.19:0/2964303908 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1900078517 0 0) 0x7f37640d3690 con 0x7f376415e5f0 2024-09-12T01:56:20.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.303+0000 7f3761ffb640 1 -- 172.21.15.19:0/2964303908 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3750003520 con 0x7f376415e5f0 2024-09-12T01:56:20.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.303+0000 7f37627fc640 1 -- 172.21.15.19:0/2964303908 >> v1:172.21.15.135:6789/0 conn(0x7f37640b64c0 legacy=0x7f376406d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.303+0000 7f37627fc640 1 -- 172.21.15.19:0/2964303908 >> v1:172.21.15.19:6789/0 conn(0x7f376415e5f0 legacy=0x7f37640d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.303+0000 7f3761ffb640 1 -- 172.21.15.19:0/2964303908 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 576120024 0 0) 0x7f3750003520 con 0x7f376415e5f0 2024-09-12T01:56:20.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.303+0000 7f37627fc640 1 -- 172.21.15.19:0/2964303908 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376406cee0 con 0x7f37640d30f0 2024-09-12T01:56:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.304+0000 7f37627fc640 1 --2- 172.21.15.19:0/2964303908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37640d30f0 0x7f37640b5f80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f37540097a0 tx=0x7f375402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ac471c64301d3fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.304+0000 7f3761ffb640 1 -- 172.21.15.19:0/2964303908 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754037070 con 0x7f37640d30f0 2024-09-12T01:56:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.304+0000 7f3761ffb640 1 -- 172.21.15.19:0/2964303908 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375402ac50 con 0x7f37640d30f0 2024-09-12T01:56:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.304+0000 7f3761ffb640 1 -- 172.21.15.19:0/2964303908 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c001670 con 0x7f37640d30f0 2024-09-12T01:56:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.305+0000 7f3769354640 1 -- 172.21.15.19:0/2964303908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37640d30f0 msgr2=0x7f37640b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.305+0000 7f3769354640 1 --2- 172.21.15.19:0/2964303908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37640d30f0 0x7f37640b5f80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f37540097a0 tx=0x7f375402a1c0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.305+0000 7f3769354640 1 -- 172.21.15.19:0/2964303908 shutdown_connections 2024-09-12T01:56:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.305+0000 7f3769354640 1 --2- 172.21.15.19:0/2964303908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37640d30f0 0x7f37640b5f80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.305+0000 7f3769354640 1 -- 172.21.15.19:0/2964303908 >> 172.21.15.19:0/2964303908 conn(0x7f376408bfc0 msgr2=0x7f37640d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.305+0000 7f3769354640 1 -- 172.21.15.19:0/2964303908 shutdown_connections 2024-09-12T01:56:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.305+0000 7f3769354640 1 -- 172.21.15.19:0/2964303908 wait complete. 2024-09-12T01:56:20.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.306+0000 7f3769354640 1 Processor -- start 2024-09-12T01:56:20.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.306+0000 7f3769354640 1 -- start start 2024-09-12T01:56:20.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.307+0000 7f3769354640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37640b64c0 0x7f376415da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:20.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.307+0000 7f3769354640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37640d30f0 0x7f37640b8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:20.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.307+0000 7f3769354640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f376415e5f0 0x7f37640b9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:20.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.307+0000 7f3769354640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f376406e0d0 con 0x7f37640d30f0 2024-09-12T01:56:20.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.307+0000 7f3769354640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f376415e9d0 con 0x7f37640b64c0 2024-09-12T01:56:20.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.307+0000 7f3769354640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f376406e250 con 0x7f376415e5f0 2024-09-12T01:56:20.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.307+0000 7f37627fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37640d30f0 0x7f37640b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:20.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.307+0000 7f37627fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37640d30f0 0x7f37640b8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42368/0 (socket says 172.21.15.19:42368) 2024-09-12T01:56:20.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.307+0000 7f37627fc640 1 -- 172.21.15.19:0/379412245 learned_addr learned my addr 172.21.15.19:0/379412245 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:20.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.307+0000 7f3762ffd640 1 --2- 172.21.15.19:0/379412245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37640b64c0 0x7f376415da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:20.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.307+0000 7f37637fe640 1 --2- 172.21.15.19:0/379412245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f376415e5f0 0x7f37640b9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:20.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.307+0000 7f37627fc640 1 -- 172.21.15.19:0/379412245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f376415e5f0 msgr2=0x7f37640b9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.308+0000 7f37627fc640 1 --2- 172.21.15.19:0/379412245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f376415e5f0 0x7f37640b9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.308+0000 7f37627fc640 1 -- 172.21.15.19:0/379412245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37640b64c0 msgr2=0x7f376415da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.308+0000 7f37627fc640 1 --2- 172.21.15.19:0/379412245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37640b64c0 0x7f376415da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.308+0000 7f37627fc640 1 -- 172.21.15.19:0/379412245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376415df70 con 0x7f37640d30f0 2024-09-12T01:56:20.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.308+0000 7f37637fe640 1 --2- 172.21.15.19:0/379412245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f376415e5f0 0x7f37640b9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:20.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.308+0000 7f3762ffd640 1 --2- 172.21.15.19:0/379412245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37640b64c0 0x7f376415da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:20.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.308+0000 7f37627fc640 1 --2- 172.21.15.19:0/379412245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37640d30f0 0x7f37640b8240 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f37540098c0 tx=0x7f37540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:20.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.308+0000 7f375b7fe640 1 -- 172.21.15.19:0/379412245 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754041020 con 0x7f37640d30f0 2024-09-12T01:56:20.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.308+0000 7f375b7fe640 1 -- 172.21.15.19:0/379412245 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37540044c0 con 0x7f37640d30f0 2024-09-12T01:56:20.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.308+0000 7f3769354640 1 -- 172.21.15.19:0/379412245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37640b8b70 con 0x7f37640d30f0 2024-09-12T01:56:20.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.308+0000 7f375b7fe640 1 -- 172.21.15.19:0/379412245 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754037040 con 0x7f37640d30f0 2024-09-12T01:56:20.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.308+0000 7f3769354640 1 -- 172.21.15.19:0/379412245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37640b9130 con 0x7f37640d30f0 2024-09-12T01:56:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.309+0000 7f3769354640 1 -- 172.21.15.19:0/379412245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37640b5f80 con 0x7f37640d30f0 2024-09-12T01:56:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.309+0000 7f375b7fe640 1 -- 172.21.15.19:0/379412245 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3754044020 con 0x7f37640d30f0 2024-09-12T01:56:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.310+0000 7f375b7fe640 1 --2- 172.21.15.19:0/379412245 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f374406be60 0x7f374406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.310+0000 7f375b7fe640 1 -- 172.21.15.19:0/379412245 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f37540ab490 con 0x7f37640d30f0 2024-09-12T01:56:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.310+0000 7f3762ffd640 1 --2- 172.21.15.19:0/379412245 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f374406be60 0x7f374406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:20.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.310+0000 7f3762ffd640 1 --2- 172.21.15.19:0/379412245 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f374406be60 0x7f374406e320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f374c001eb0 tx=0x7f374c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:20.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.314+0000 7f375b7fe640 1 -- 172.21.15.19:0/379412245 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f375404b030 con 0x7f37640d30f0 2024-09-12T01:56:20.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.484+0000 7f3769354640 1 -- 172.21.15.19:0/379412245 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f376406daf0 con 0x7f374406be60 2024-09-12T01:56:20.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.492+0000 7f375b7fe640 1 -- 172.21.15.19:0/379412245 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f376406daf0 con 0x7f374406be60 2024-09-12T01:56:20.496 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:20.498 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:56:20.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.495+0000 7f3769354640 1 -- 172.21.15.19:0/379412245 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f374406be60 msgr2=0x7f374406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.495+0000 7f3769354640 1 --2- 172.21.15.19:0/379412245 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f374406be60 0x7f374406e320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f374c001eb0 tx=0x7f374c009040 comp rx=0 tx=0).stop 2024-09-12T01:56:20.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.495+0000 7f3769354640 1 -- 172.21.15.19:0/379412245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37640d30f0 msgr2=0x7f37640b8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.495+0000 7f3769354640 1 --2- 172.21.15.19:0/379412245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37640d30f0 0x7f37640b8240 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f37540098c0 tx=0x7f37540046c0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.495+0000 7f3769354640 1 -- 172.21.15.19:0/379412245 shutdown_connections 2024-09-12T01:56:20.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.495+0000 7f3769354640 1 --2- 172.21.15.19:0/379412245 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f374406be60 0x7f374406e320 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.495+0000 7f3769354640 1 --2- 172.21.15.19:0/379412245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f376415e5f0 0x7f37640b9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.495+0000 7f3769354640 1 --2- 172.21.15.19:0/379412245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37640d30f0 0x7f37640b8240 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.495+0000 7f3769354640 1 --2- 172.21.15.19:0/379412245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37640b64c0 0x7f376415da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.495+0000 7f3769354640 1 -- 172.21.15.19:0/379412245 >> 172.21.15.19:0/379412245 conn(0x7f376408bfc0 msgr2=0x7f37641e8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:20.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.495+0000 7f3769354640 1 -- 172.21.15.19:0/379412245 shutdown_connections 2024-09-12T01:56:20.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.495+0000 7f3769354640 1 -- 172.21.15.19:0/379412245 wait complete. 2024-09-12T01:56:20.506 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-09-12T01:56:20.090006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219680,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755040,"statfs":{"total":773094113280,"available":772869160960,"internally_reserved":0,"allocated":3514368,"data_stored":2106108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003549"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460711+0000","last_change":"2024-09-12T01:55:54.691417+0000","last_active":"2024-09-12T01:56:02.460711+0000","last_peered":"2024-09-12T01:56:02.460711+0000","last_clean":"2024-09-12T01:56:02.460711+0000","last_became_active":"2024-09-12T01:55:54.690940+0000","last_became_peered":"2024-09-12T01:55:54.690940+0000","last_unstale":"2024-09-12T01:56:02.460711+0000","last_undegraded":"2024-09-12T01:56:02.460711+0000","last_fullsized":"2024-09-12T01:56:02.460711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:41.898184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522661+0000","last_change":"2024-09-12T01:55:55.703230+0000","last_active":"2024-09-12T01:56:02.522661+0000","last_peered":"2024-09-12T01:56:02.522661+0000","last_clean":"2024-09-12T01:56:02.522661+0000","last_became_active":"2024-09-12T01:55:55.702937+0000","last_became_peered":"2024-09-12T01:55:55.702937+0000","last_unstale":"2024-09-12T01:56:02.522661+0000","last_undegraded":"2024-09-12T01:56:02.522661+0000","last_fullsized":"2024-09-12T01:56:02.522661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:12.877973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521554+0000","last_change":"2024-09-12T01:56:00.522020+0000","last_active":"2024-09-12T01:56:02.521554+0000","last_peered":"2024-09-12T01:56:02.521554+0000","last_clean":"2024-09-12T01:56:02.521554+0000","last_became_active":"2024-09-12T01:56:00.521659+0000","last_became_peered":"2024-09-12T01:56:00.521659+0000","last_unstale":"2024-09-12T01:56:02.521554+0000","last_undegraded":"2024-09-12T01:56:02.521554+0000","last_fullsized":"2024-09-12T01:56:02.521554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:04.626201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522786+0000","last_change":"2024-09-12T01:55:54.693523+0000","last_active":"2024-09-12T01:56:02.522786+0000","last_peered":"2024-09-12T01:56:02.522786+0000","last_clean":"2024-09-12T01:56:02.522786+0000","last_became_active":"2024-09-12T01:55:54.693127+0000","last_became_peered":"2024-09-12T01:55:54.693127+0000","last_unstale":"2024-09-12T01:56:02.522786+0000","last_undegraded":"2024-09-12T01:56:02.522786+0000","last_fullsized":"2024-09-12T01:56:02.522786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:18.178661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460539+0000","last_change":"2024-09-12T01:55:55.695198+0000","last_active":"2024-09-12T01:56:02.460539+0000","last_peered":"2024-09-12T01:56:02.460539+0000","last_clean":"2024-09-12T01:56:02.460539+0000","last_became_active":"2024-09-12T01:55:55.694897+0000","last_became_peered":"2024-09-12T01:55:55.694897+0000","last_unstale":"2024-09-12T01:56:02.460539+0000","last_undegraded":"2024-09-12T01:56:02.460539+0000","last_fullsized":"2024-09-12T01:56:02.460539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:05.184458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996331+0000","last_change":"2024-09-12T01:55:59.720981+0000","last_active":"2024-09-12T01:56:01.996331+0000","last_peered":"2024-09-12T01:56:01.996331+0000","last_clean":"2024-09-12T01:56:01.996331+0000","last_became_active":"2024-09-12T01:55:59.720424+0000","last_became_peered":"2024-09-12T01:55:59.720424+0000","last_unstale":"2024-09-12T01:56:01.996331+0000","last_undegraded":"2024-09-12T01:56:01.996331+0000","last_fullsized":"2024-09-12T01:56:01.996331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:37.646140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752215+0000","last_change":"2024-09-12T01:55:54.691906+0000","last_active":"2024-09-12T01:56:01.752215+0000","last_peered":"2024-09-12T01:56:01.752215+0000","last_clean":"2024-09-12T01:56:01.752215+0000","last_became_active":"2024-09-12T01:55:54.691632+0000","last_became_peered":"2024-09-12T01:55:54.691632+0000","last_unstale":"2024-09-12T01:56:01.752215+0000","last_undegraded":"2024-09-12T01:56:01.752215+0000","last_fullsized":"2024-09-12T01:56:01.752215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:02.585865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522293+0000","last_change":"2024-09-12T01:55:55.690825+0000","last_active":"2024-09-12T01:56:02.522293+0000","last_peered":"2024-09-12T01:56:02.522293+0000","last_clean":"2024-09-12T01:56:02.522293+0000","last_became_active":"2024-09-12T01:55:55.690498+0000","last_became_peered":"2024-09-12T01:55:55.690498+0000","last_unstale":"2024-09-12T01:56:02.522293+0000","last_undegraded":"2024-09-12T01:56:02.522293+0000","last_fullsized":"2024-09-12T01:56:02.522293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:20.252934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996426+0000","last_change":"2024-09-12T01:55:59.722572+0000","last_active":"2024-09-12T01:56:01.996426+0000","last_peered":"2024-09-12T01:56:01.996426+0000","last_clean":"2024-09-12T01:56:01.996426+0000","last_became_active":"2024-09-12T01:55:59.722043+0000","last_became_peered":"2024-09-12T01:55:59.722043+0000","last_unstale":"2024-09-12T01:56:01.996426+0000","last_undegraded":"2024-09-12T01:56:01.996426+0000","last_fullsized":"2024-09-12T01:56:01.996426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:01.089137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751710+0000","last_change":"2024-09-12T01:55:54.694886+0000","last_active":"2024-09-12T01:56:01.751710+0000","last_peered":"2024-09-12T01:56:01.751710+0000","last_clean":"2024-09-12T01:56:01.751710+0000","last_became_active":"2024-09-12T01:55:54.694641+0000","last_became_peered":"2024-09-12T01:55:54.694641+0000","last_unstale":"2024-09-12T01:56:01.751710+0000","last_undegraded":"2024-09-12T01:56:01.751710+0000","last_fullsized":"2024-09-12T01:56:01.751710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:07.353242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522367+0000","last_change":"2024-09-12T01:55:55.697509+0000","last_active":"2024-09-12T01:56:02.522367+0000","last_peered":"2024-09-12T01:56:02.522367+0000","last_clean":"2024-09-12T01:56:02.522367+0000","last_became_active":"2024-09-12T01:55:55.696597+0000","last_became_peered":"2024-09-12T01:55:55.696597+0000","last_unstale":"2024-09-12T01:56:02.522367+0000","last_undegraded":"2024-09-12T01:56:02.522367+0000","last_fullsized":"2024-09-12T01:56:02.522367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:50.551708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996296+0000","last_change":"2024-09-12T01:55:59.717407+0000","last_active":"2024-09-12T01:56:01.996296+0000","last_peered":"2024-09-12T01:56:01.996296+0000","last_clean":"2024-09-12T01:56:01.996296+0000","last_became_active":"2024-09-12T01:55:59.716747+0000","last_became_peered":"2024-09-12T01:55:59.716747+0000","last_unstale":"2024-09-12T01:56:01.996296+0000","last_undegraded":"2024-09-12T01:56:01.996296+0000","last_fullsized":"2024-09-12T01:56:01.996296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:30.245761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752221+0000","last_change":"2024-09-12T01:55:55.694504+0000","last_active":"2024-09-12T01:56:01.752221+0000","last_peered":"2024-09-12T01:56:01.752221+0000","last_clean":"2024-09-12T01:56:01.752221+0000","last_became_active":"2024-09-12T01:55:55.694202+0000","last_became_peered":"2024-09-12T01:55:55.694202+0000","last_unstale":"2024-09-12T01:56:01.752221+0000","last_undegraded":"2024-09-12T01:56:01.752221+0000","last_fullsized":"2024-09-12T01:56:01.752221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:49.242430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751844+0000","last_change":"2024-09-12T01:55:54.690614+0000","last_active":"2024-09-12T01:56:01.751844+0000","last_peered":"2024-09-12T01:56:01.751844+0000","last_clean":"2024-09-12T01:56:01.751844+0000","last_became_active":"2024-09-12T01:55:54.690334+0000","last_became_peered":"2024-09-12T01:55:54.690334+0000","last_unstale":"2024-09-12T01:56:01.751844+0000","last_undegraded":"2024-09-12T01:56:01.751844+0000","last_fullsized":"2024-09-12T01:56:01.751844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:29.431495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996751+0000","last_change":"2024-09-12T01:55:59.728056+0000","last_active":"2024-09-12T01:56:01.996751+0000","last_peered":"2024-09-12T01:56:01.996751+0000","last_clean":"2024-09-12T01:56:01.996751+0000","last_became_active":"2024-09-12T01:55:59.727677+0000","last_became_peered":"2024-09-12T01:55:59.727677+0000","last_unstale":"2024-09-12T01:56:01.996751+0000","last_undegraded":"2024-09-12T01:56:01.996751+0000","last_fullsized":"2024-09-12T01:56:01.996751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:25.127551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522339+0000","last_change":"2024-09-12T01:55:55.696190+0000","last_active":"2024-09-12T01:56:02.522339+0000","last_peered":"2024-09-12T01:56:02.522339+0000","last_clean":"2024-09-12T01:56:02.522339+0000","last_became_active":"2024-09-12T01:55:55.695882+0000","last_became_peered":"2024-09-12T01:55:55.695882+0000","last_unstale":"2024-09-12T01:56:02.522339+0000","last_undegraded":"2024-09-12T01:56:02.522339+0000","last_fullsized":"2024-09-12T01:56:02.522339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:18.907293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522246+0000","last_change":"2024-09-12T01:55:54.691318+0000","last_active":"2024-09-12T01:56:02.522246+0000","last_peered":"2024-09-12T01:56:02.522246+0000","last_clean":"2024-09-12T01:56:02.522246+0000","last_became_active":"2024-09-12T01:55:54.690960+0000","last_became_peered":"2024-09-12T01:55:54.690960+0000","last_unstale":"2024-09-12T01:56:02.522246+0000","last_undegraded":"2024-09-12T01:56:02.522246+0000","last_fullsized":"2024-09-12T01:56:02.522246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:12.646367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996557+0000","last_change":"2024-09-12T01:55:59.721175+0000","last_active":"2024-09-12T01:56:01.996557+0000","last_peered":"2024-09-12T01:56:01.996557+0000","last_clean":"2024-09-12T01:56:01.996557+0000","last_became_active":"2024-09-12T01:55:59.720481+0000","last_became_peered":"2024-09-12T01:55:59.720481+0000","last_unstale":"2024-09-12T01:56:01.996557+0000","last_undegraded":"2024-09-12T01:56:01.996557+0000","last_fullsized":"2024-09-12T01:56:01.996557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:33.869240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521581+0000","last_change":"2024-09-12T01:55:55.686041+0000","last_active":"2024-09-12T01:56:02.521581+0000","last_peered":"2024-09-12T01:56:02.521581+0000","last_clean":"2024-09-12T01:56:02.521581+0000","last_became_active":"2024-09-12T01:55:55.685758+0000","last_became_peered":"2024-09-12T01:55:55.685758+0000","last_unstale":"2024-09-12T01:56:02.521581+0000","last_undegraded":"2024-09-12T01:56:02.521581+0000","last_fullsized":"2024-09-12T01:56:02.521581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:11.963913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521629+0000","last_change":"2024-09-12T01:55:54.688788+0000","last_active":"2024-09-12T01:56:02.521629+0000","last_peered":"2024-09-12T01:56:02.521629+0000","last_clean":"2024-09-12T01:56:02.521629+0000","last_became_active":"2024-09-12T01:55:54.688513+0000","last_became_peered":"2024-09-12T01:55:54.688513+0000","last_unstale":"2024-09-12T01:56:02.521629+0000","last_undegraded":"2024-09-12T01:56:02.521629+0000","last_fullsized":"2024-09-12T01:56:02.521629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:49.883464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522091+0000","last_change":"2024-09-12T01:56:00.517213+0000","last_active":"2024-09-12T01:56:02.522091+0000","last_peered":"2024-09-12T01:56:02.522091+0000","last_clean":"2024-09-12T01:56:02.522091+0000","last_became_active":"2024-09-12T01:56:00.516759+0000","last_became_peered":"2024-09-12T01:56:00.516759+0000","last_unstale":"2024-09-12T01:56:02.522091+0000","last_undegraded":"2024-09-12T01:56:02.522091+0000","last_fullsized":"2024-09-12T01:56:02.522091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:01.089137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996491+0000","last_change":"2024-09-12T01:55:55.688036+0000","last_active":"2024-09-12T01:56:01.996491+0000","last_peered":"2024-09-12T01:56:01.996491+0000","last_clean":"2024-09-12T01:56:01.996491+0000","last_became_active":"2024-09-12T01:55:55.687764+0000","last_became_peered":"2024-09-12T01:55:55.687764+0000","last_unstale":"2024-09-12T01:56:01.996491+0000","last_undegraded":"2024-09-12T01:56:01.996491+0000","last_fullsized":"2024-09-12T01:56:01.996491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:18.704097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751280+0000","last_change":"2024-09-12T01:55:54.693835+0000","last_active":"2024-09-12T01:56:01.751280+0000","last_peered":"2024-09-12T01:56:01.751280+0000","last_clean":"2024-09-12T01:56:01.751280+0000","last_became_active":"2024-09-12T01:55:54.693191+0000","last_became_peered":"2024-09-12T01:55:54.693191+0000","last_unstale":"2024-09-12T01:56:01.751280+0000","last_undegraded":"2024-09-12T01:56:01.751280+0000","last_fullsized":"2024-09-12T01:56:01.751280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:33.178694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996869+0000","last_change":"2024-09-12T01:55:59.720935+0000","last_active":"2024-09-12T01:56:01.996869+0000","last_peered":"2024-09-12T01:56:01.996869+0000","last_clean":"2024-09-12T01:56:01.996869+0000","last_became_active":"2024-09-12T01:55:59.720510+0000","last_became_peered":"2024-09-12T01:55:59.720510+0000","last_unstale":"2024-09-12T01:56:01.996869+0000","last_undegraded":"2024-09-12T01:56:01.996869+0000","last_fullsized":"2024-09-12T01:56:01.996869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:24.129803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460733+0000","last_change":"2024-09-12T01:55:55.693557+0000","last_active":"2024-09-12T01:56:02.460733+0000","last_peered":"2024-09-12T01:56:02.460733+0000","last_clean":"2024-09-12T01:56:02.460733+0000","last_became_active":"2024-09-12T01:55:55.693073+0000","last_became_peered":"2024-09-12T01:55:55.693073+0000","last_unstale":"2024-09-12T01:56:02.460733+0000","last_undegraded":"2024-09-12T01:56:02.460733+0000","last_fullsized":"2024-09-12T01:56:02.460733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:36.523619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752229+0000","last_change":"2024-09-12T01:55:54.692628+0000","last_active":"2024-09-12T01:56:01.752229+0000","last_peered":"2024-09-12T01:56:01.752229+0000","last_clean":"2024-09-12T01:56:01.752229+0000","last_became_active":"2024-09-12T01:55:54.692323+0000","last_became_peered":"2024-09-12T01:55:54.692323+0000","last_unstale":"2024-09-12T01:56:01.752229+0000","last_undegraded":"2024-09-12T01:56:01.752229+0000","last_fullsized":"2024-09-12T01:56:01.752229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:51.779183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996393+0000","last_change":"2024-09-12T01:56:00.519632+0000","last_active":"2024-09-12T01:56:01.996393+0000","last_peered":"2024-09-12T01:56:01.996393+0000","last_clean":"2024-09-12T01:56:01.996393+0000","last_became_active":"2024-09-12T01:56:00.518952+0000","last_became_peered":"2024-09-12T01:56:00.518952+0000","last_unstale":"2024-09-12T01:56:01.996393+0000","last_undegraded":"2024-09-12T01:56:01.996393+0000","last_fullsized":"2024-09-12T01:56:01.996393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:25.728022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522901+0000","last_change":"2024-09-12T01:55:55.701476+0000","last_active":"2024-09-12T01:56:02.522901+0000","last_peered":"2024-09-12T01:56:02.522901+0000","last_clean":"2024-09-12T01:56:02.522901+0000","last_became_active":"2024-09-12T01:55:55.697719+0000","last_became_peered":"2024-09-12T01:55:55.697719+0000","last_unstale":"2024-09-12T01:56:02.522901+0000","last_undegraded":"2024-09-12T01:56:02.522901+0000","last_fullsized":"2024-09-12T01:56:02.522901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:05.703141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521753+0000","last_change":"2024-09-12T01:55:54.683694+0000","last_active":"2024-09-12T01:56:02.521753+0000","last_peered":"2024-09-12T01:56:02.521753+0000","last_clean":"2024-09-12T01:56:02.521753+0000","last_became_active":"2024-09-12T01:55:54.683332+0000","last_became_peered":"2024-09-12T01:55:54.683332+0000","last_unstale":"2024-09-12T01:56:02.521753+0000","last_undegraded":"2024-09-12T01:56:02.521753+0000","last_fullsized":"2024-09-12T01:56:02.521753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:24.503780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521372+0000","last_change":"2024-09-12T01:56:00.518243+0000","last_active":"2024-09-12T01:56:02.521372+0000","last_peered":"2024-09-12T01:56:02.521372+0000","last_clean":"2024-09-12T01:56:02.521372+0000","last_became_active":"2024-09-12T01:56:00.517815+0000","last_became_peered":"2024-09-12T01:56:00.517815+0000","last_unstale":"2024-09-12T01:56:02.521372+0000","last_undegraded":"2024-09-12T01:56:02.521372+0000","last_fullsized":"2024-09-12T01:56:02.521372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:59.474572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521936+0000","last_change":"2024-09-12T01:55:55.683383+0000","last_active":"2024-09-12T01:56:02.521936+0000","last_peered":"2024-09-12T01:56:02.521936+0000","last_clean":"2024-09-12T01:56:02.521936+0000","last_became_active":"2024-09-12T01:55:55.683045+0000","last_became_peered":"2024-09-12T01:55:55.683045+0000","last_unstale":"2024-09-12T01:56:02.521936+0000","last_undegraded":"2024-09-12T01:56:02.521936+0000","last_fullsized":"2024-09-12T01:56:02.521936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:11.963913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752400+0000","last_change":"2024-09-12T01:55:54.693479+0000","last_active":"2024-09-12T01:56:01.752400+0000","last_peered":"2024-09-12T01:56:01.752400+0000","last_clean":"2024-09-12T01:56:01.752400+0000","last_became_active":"2024-09-12T01:55:54.693222+0000","last_became_peered":"2024-09-12T01:55:54.693222+0000","last_unstale":"2024-09-12T01:56:01.752400+0000","last_undegraded":"2024-09-12T01:56:01.752400+0000","last_fullsized":"2024-09-12T01:56:01.752400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:29.084779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460600+0000","last_change":"2024-09-12T01:56:00.517418+0000","last_active":"2024-09-12T01:56:02.460600+0000","last_peered":"2024-09-12T01:56:02.460600+0000","last_clean":"2024-09-12T01:56:02.460600+0000","last_became_active":"2024-09-12T01:56:00.516727+0000","last_became_peered":"2024-09-12T01:56:00.516727+0000","last_unstale":"2024-09-12T01:56:02.460600+0000","last_undegraded":"2024-09-12T01:56:02.460600+0000","last_fullsized":"2024-09-12T01:56:02.460600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:05.063807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522480+0000","last_change":"2024-09-12T01:55:55.705667+0000","last_active":"2024-09-12T01:56:02.522480+0000","last_peered":"2024-09-12T01:56:02.522480+0000","last_clean":"2024-09-12T01:56:02.522480+0000","last_became_active":"2024-09-12T01:55:55.705409+0000","last_became_peered":"2024-09-12T01:55:55.705409+0000","last_unstale":"2024-09-12T01:56:02.522480+0000","last_undegraded":"2024-09-12T01:56:02.522480+0000","last_fullsized":"2024-09-12T01:56:02.522480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:32.262001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522031+0000","last_change":"2024-09-12T01:55:54.690520+0000","last_active":"2024-09-12T01:56:02.522031+0000","last_peered":"2024-09-12T01:56:02.522031+0000","last_clean":"2024-09-12T01:56:02.522031+0000","last_became_active":"2024-09-12T01:55:54.690206+0000","last_became_peered":"2024-09-12T01:55:54.690206+0000","last_unstale":"2024-09-12T01:56:02.522031+0000","last_undegraded":"2024-09-12T01:56:02.522031+0000","last_fullsized":"2024-09-12T01:56:02.522031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:12.368192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521948+0000","last_change":"2024-09-12T01:55:59.722879+0000","last_active":"2024-09-12T01:56:02.521948+0000","last_peered":"2024-09-12T01:56:02.521948+0000","last_clean":"2024-09-12T01:56:02.521948+0000","last_became_active":"2024-09-12T01:55:59.722470+0000","last_became_peered":"2024-09-12T01:55:59.722470+0000","last_unstale":"2024-09-12T01:56:02.521948+0000","last_undegraded":"2024-09-12T01:56:02.521948+0000","last_fullsized":"2024-09-12T01:56:02.521948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:37.646140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996762+0000","last_change":"2024-09-12T01:55:55.694445+0000","last_active":"2024-09-12T01:56:01.996762+0000","last_peered":"2024-09-12T01:56:01.996762+0000","last_clean":"2024-09-12T01:56:01.996762+0000","last_became_active":"2024-09-12T01:55:55.694183+0000","last_became_peered":"2024-09-12T01:55:55.694183+0000","last_unstale":"2024-09-12T01:56:01.996762+0000","last_undegraded":"2024-09-12T01:56:01.996762+0000","last_fullsized":"2024-09-12T01:56:01.996762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:34.647815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522397+0000","last_change":"2024-09-12T01:55:54.692279+0000","last_active":"2024-09-12T01:56:02.522397+0000","last_peered":"2024-09-12T01:56:02.522397+0000","last_clean":"2024-09-12T01:56:02.522397+0000","last_became_active":"2024-09-12T01:55:54.692012+0000","last_became_peered":"2024-09-12T01:55:54.692012+0000","last_unstale":"2024-09-12T01:56:02.522397+0000","last_undegraded":"2024-09-12T01:56:02.522397+0000","last_fullsized":"2024-09-12T01:56:02.522397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:23.224359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522020+0000","last_change":"2024-09-12T01:55:59.729468+0000","last_active":"2024-09-12T01:56:02.522020+0000","last_peered":"2024-09-12T01:56:02.522020+0000","last_clean":"2024-09-12T01:56:02.522020+0000","last_became_active":"2024-09-12T01:55:59.729028+0000","last_became_peered":"2024-09-12T01:55:59.729028+0000","last_unstale":"2024-09-12T01:56:02.522020+0000","last_undegraded":"2024-09-12T01:56:02.522020+0000","last_fullsized":"2024-09-12T01:56:02.522020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:25.728022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521427+0000","last_change":"2024-09-12T01:55:55.683856+0000","last_active":"2024-09-12T01:56:02.521427+0000","last_peered":"2024-09-12T01:56:02.521427+0000","last_clean":"2024-09-12T01:56:02.521427+0000","last_became_active":"2024-09-12T01:55:55.683567+0000","last_became_peered":"2024-09-12T01:55:55.683567+0000","last_unstale":"2024-09-12T01:56:02.521427+0000","last_undegraded":"2024-09-12T01:56:02.521427+0000","last_fullsized":"2024-09-12T01:56:02.521427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:44.949953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745947+0000","last_change":"2024-09-12T01:55:54.694100+0000","last_active":"2024-09-12T01:56:01.745947+0000","last_peered":"2024-09-12T01:56:01.745947+0000","last_clean":"2024-09-12T01:56:01.745947+0000","last_became_active":"2024-09-12T01:55:54.693791+0000","last_became_peered":"2024-09-12T01:55:54.693791+0000","last_unstale":"2024-09-12T01:56:01.745947+0000","last_undegraded":"2024-09-12T01:56:01.745947+0000","last_fullsized":"2024-09-12T01:56:01.745947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:28.370799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522265+0000","last_change":"2024-09-12T01:55:59.729446+0000","last_active":"2024-09-12T01:56:02.522265+0000","last_peered":"2024-09-12T01:56:02.522265+0000","last_clean":"2024-09-12T01:56:02.522265+0000","last_became_active":"2024-09-12T01:55:59.729062+0000","last_became_peered":"2024-09-12T01:55:59.729062+0000","last_unstale":"2024-09-12T01:56:02.522265+0000","last_undegraded":"2024-09-12T01:56:02.522265+0000","last_fullsized":"2024-09-12T01:56:02.522265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:05.710174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460187+0000","last_change":"2024-09-12T01:55:55.699106+0000","last_active":"2024-09-12T01:56:02.460187+0000","last_peered":"2024-09-12T01:56:02.460187+0000","last_clean":"2024-09-12T01:56:02.460187+0000","last_became_active":"2024-09-12T01:55:55.698839+0000","last_became_peered":"2024-09-12T01:55:55.698839+0000","last_unstale":"2024-09-12T01:56:02.460187+0000","last_undegraded":"2024-09-12T01:56:02.460187+0000","last_fullsized":"2024-09-12T01:56:02.460187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:34.183993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751389+0000","last_change":"2024-09-12T01:55:54.690892+0000","last_active":"2024-09-12T01:56:01.751389+0000","last_peered":"2024-09-12T01:56:01.751389+0000","last_clean":"2024-09-12T01:56:01.751389+0000","last_became_active":"2024-09-12T01:55:54.690615+0000","last_became_peered":"2024-09-12T01:55:54.690615+0000","last_unstale":"2024-09-12T01:56:01.751389+0000","last_undegraded":"2024-09-12T01:56:01.751389+0000","last_fullsized":"2024-09-12T01:56:01.751389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:27.061787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460647+0000","last_change":"2024-09-12T01:56:00.518805+0000","last_active":"2024-09-12T01:56:02.460647+0000","last_peered":"2024-09-12T01:56:02.460647+0000","last_clean":"2024-09-12T01:56:02.460647+0000","last_became_active":"2024-09-12T01:56:00.518224+0000","last_became_peered":"2024-09-12T01:56:00.518224+0000","last_unstale":"2024-09-12T01:56:02.460647+0000","last_undegraded":"2024-09-12T01:56:02.460647+0000","last_fullsized":"2024-09-12T01:56:02.460647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:56.545297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522174+0000","last_change":"2024-09-12T01:55:55.702458+0000","last_active":"2024-09-12T01:56:02.522174+0000","last_peered":"2024-09-12T01:56:02.522174+0000","last_clean":"2024-09-12T01:56:02.522174+0000","last_became_active":"2024-09-12T01:55:55.702160+0000","last_became_peered":"2024-09-12T01:55:55.702160+0000","last_unstale":"2024-09-12T01:56:02.522174+0000","last_undegraded":"2024-09-12T01:56:02.522174+0000","last_fullsized":"2024-09-12T01:56:02.522174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:49.260515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522189+0000","last_change":"2024-09-12T01:55:54.688748+0000","last_active":"2024-09-12T01:56:02.522189+0000","last_peered":"2024-09-12T01:56:02.522189+0000","last_clean":"2024-09-12T01:56:02.522189+0000","last_became_active":"2024-09-12T01:55:54.688278+0000","last_became_peered":"2024-09-12T01:55:54.688278+0000","last_unstale":"2024-09-12T01:56:02.522189+0000","last_undegraded":"2024-09-12T01:56:02.522189+0000","last_fullsized":"2024-09-12T01:56:02.522189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:51.779183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751452+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:56:01.751452+0000","last_peered":"2024-09-12T01:56:01.751452+0000","last_clean":"2024-09-12T01:56:01.751452+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:56:01.751452+0000","last_undegraded":"2024-09-12T01:56:01.751452+0000","last_fullsized":"2024-09-12T01:56:01.751452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752349+0000","last_change":"2024-09-12T01:56:00.520068+0000","last_active":"2024-09-12T01:56:01.752349+0000","last_peered":"2024-09-12T01:56:01.752349+0000","last_clean":"2024-09-12T01:56:01.752349+0000","last_became_active":"2024-09-12T01:56:00.519253+0000","last_became_peered":"2024-09-12T01:56:00.519253+0000","last_unstale":"2024-09-12T01:56:01.752349+0000","last_undegraded":"2024-09-12T01:56:01.752349+0000","last_fullsized":"2024-09-12T01:56:01.752349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:24.528900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752013+0000","last_change":"2024-09-12T01:55:55.701349+0000","last_active":"2024-09-12T01:56:01.752013+0000","last_peered":"2024-09-12T01:56:01.752013+0000","last_clean":"2024-09-12T01:56:01.752013+0000","last_became_active":"2024-09-12T01:55:55.701081+0000","last_became_peered":"2024-09-12T01:55:55.701081+0000","last_unstale":"2024-09-12T01:56:01.752013+0000","last_undegraded":"2024-09-12T01:56:01.752013+0000","last_fullsized":"2024-09-12T01:56:01.752013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:22.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.746220+0000","last_change":"2024-09-12T01:55:54.686812+0000","last_active":"2024-09-12T01:56:01.746220+0000","last_peered":"2024-09-12T01:56:01.746220+0000","last_clean":"2024-09-12T01:56:01.746220+0000","last_became_active":"2024-09-12T01:55:54.685661+0000","last_became_peered":"2024-09-12T01:55:54.685661+0000","last_unstale":"2024-09-12T01:56:01.746220+0000","last_undegraded":"2024-09-12T01:56:01.746220+0000","last_fullsized":"2024-09-12T01:56:01.746220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:48.747240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752114+0000","last_change":"2024-09-12T01:56:00.519411+0000","last_active":"2024-09-12T01:56:01.752114+0000","last_peered":"2024-09-12T01:56:01.752114+0000","last_clean":"2024-09-12T01:56:01.752114+0000","last_became_active":"2024-09-12T01:56:00.518566+0000","last_became_peered":"2024-09-12T01:56:00.518566+0000","last_unstale":"2024-09-12T01:56:01.752114+0000","last_undegraded":"2024-09-12T01:56:01.752114+0000","last_fullsized":"2024-09-12T01:56:01.752114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:24.282033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522391+0000","last_change":"2024-09-12T01:55:55.702467+0000","last_active":"2024-09-12T01:56:02.522391+0000","last_peered":"2024-09-12T01:56:02.522391+0000","last_clean":"2024-09-12T01:56:02.522391+0000","last_became_active":"2024-09-12T01:55:55.702195+0000","last_became_peered":"2024-09-12T01:55:55.702195+0000","last_unstale":"2024-09-12T01:56:02.522391+0000","last_undegraded":"2024-09-12T01:56:02.522391+0000","last_fullsized":"2024-09-12T01:56:02.522391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:20.499801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522219+0000","last_change":"2024-09-12T01:55:54.687072+0000","last_active":"2024-09-12T01:56:02.522219+0000","last_peered":"2024-09-12T01:56:02.522219+0000","last_clean":"2024-09-12T01:56:02.522219+0000","last_became_active":"2024-09-12T01:55:54.686806+0000","last_became_peered":"2024-09-12T01:55:54.686806+0000","last_unstale":"2024-09-12T01:56:02.522219+0000","last_undegraded":"2024-09-12T01:56:02.522219+0000","last_fullsized":"2024-09-12T01:56:02.522219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:33.642516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460732+0000","last_change":"2024-09-12T01:55:59.719758+0000","last_active":"2024-09-12T01:56:02.460732+0000","last_peered":"2024-09-12T01:56:02.460732+0000","last_clean":"2024-09-12T01:56:02.460732+0000","last_became_active":"2024-09-12T01:55:59.719193+0000","last_became_peered":"2024-09-12T01:55:59.719193+0000","last_unstale":"2024-09-12T01:56:02.460732+0000","last_undegraded":"2024-09-12T01:56:02.460732+0000","last_fullsized":"2024-09-12T01:56:02.460732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:00.698014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752383+0000","last_change":"2024-09-12T01:55:55.700818+0000","last_active":"2024-09-12T01:56:01.752383+0000","last_peered":"2024-09-12T01:56:01.752383+0000","last_clean":"2024-09-12T01:56:01.752383+0000","last_became_active":"2024-09-12T01:55:55.700254+0000","last_became_peered":"2024-09-12T01:55:55.700254+0000","last_unstale":"2024-09-12T01:56:01.752383+0000","last_undegraded":"2024-09-12T01:56:01.752383+0000","last_fullsized":"2024-09-12T01:56:01.752383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:05.947832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745796+0000","last_change":"2024-09-12T01:55:54.695464+0000","last_active":"2024-09-12T01:56:01.745796+0000","last_peered":"2024-09-12T01:56:01.745796+0000","last_clean":"2024-09-12T01:56:01.745796+0000","last_became_active":"2024-09-12T01:55:54.695083+0000","last_became_peered":"2024-09-12T01:55:54.695083+0000","last_unstale":"2024-09-12T01:56:01.745796+0000","last_undegraded":"2024-09-12T01:56:01.745796+0000","last_fullsized":"2024-09-12T01:56:01.745796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:51.779183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521828+0000","last_change":"2024-09-12T01:56:00.522126+0000","last_active":"2024-09-12T01:56:02.521828+0000","last_peered":"2024-09-12T01:56:02.521828+0000","last_clean":"2024-09-12T01:56:02.521828+0000","last_became_active":"2024-09-12T01:56:00.521651+0000","last_became_peered":"2024-09-12T01:56:00.521651+0000","last_unstale":"2024-09-12T01:56:02.521828+0000","last_undegraded":"2024-09-12T01:56:02.521828+0000","last_fullsized":"2024-09-12T01:56:02.521828+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:48.043231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752282+0000","last_change":"2024-09-12T01:55:55.701400+0000","last_active":"2024-09-12T01:56:01.752282+0000","last_peered":"2024-09-12T01:56:01.752282+0000","last_clean":"2024-09-12T01:56:01.752282+0000","last_became_active":"2024-09-12T01:55:55.700281+0000","last_became_peered":"2024-09-12T01:55:55.700281+0000","last_unstale":"2024-09-12T01:56:01.752282+0000","last_undegraded":"2024-09-12T01:56:01.752282+0000","last_fullsized":"2024-09-12T01:56:01.752282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:32.262001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996924+0000","last_change":"2024-09-12T01:55:54.691224+0000","last_active":"2024-09-12T01:56:01.996924+0000","last_peered":"2024-09-12T01:56:01.996924+0000","last_clean":"2024-09-12T01:56:01.996924+0000","last_became_active":"2024-09-12T01:55:54.690944+0000","last_became_peered":"2024-09-12T01:55:54.690944+0000","last_unstale":"2024-09-12T01:56:01.996924+0000","last_undegraded":"2024-09-12T01:56:01.996924+0000","last_fullsized":"2024-09-12T01:56:01.996924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:51.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996161+0000","last_change":"2024-09-12T01:55:59.722394+0000","last_active":"2024-09-12T01:56:01.996161+0000","last_peered":"2024-09-12T01:56:01.996161+0000","last_clean":"2024-09-12T01:56:01.996161+0000","last_became_active":"2024-09-12T01:55:59.721835+0000","last_became_peered":"2024-09-12T01:55:59.721835+0000","last_unstale":"2024-09-12T01:56:01.996161+0000","last_undegraded":"2024-09-12T01:56:01.996161+0000","last_fullsized":"2024-09-12T01:56:01.996161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:06.742059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752118+0000","last_change":"2024-09-12T01:55:55.700667+0000","last_active":"2024-09-12T01:56:01.752118+0000","last_peered":"2024-09-12T01:56:01.752118+0000","last_clean":"2024-09-12T01:56:01.752118+0000","last_became_active":"2024-09-12T01:55:55.700369+0000","last_became_peered":"2024-09-12T01:55:55.700369+0000","last_unstale":"2024-09-12T01:56:01.752118+0000","last_undegraded":"2024-09-12T01:56:01.752118+0000","last_fullsized":"2024-09-12T01:56:01.752118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:17.560307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745655+0000","last_change":"2024-09-12T01:55:54.687908+0000","last_active":"2024-09-12T01:56:01.745655+0000","last_peered":"2024-09-12T01:56:01.745655+0000","last_clean":"2024-09-12T01:56:01.745655+0000","last_became_active":"2024-09-12T01:55:54.687608+0000","last_became_peered":"2024-09-12T01:55:54.687608+0000","last_unstale":"2024-09-12T01:56:01.745655+0000","last_undegraded":"2024-09-12T01:56:01.745655+0000","last_fullsized":"2024-09-12T01:56:01.745655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:56.359673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460597+0000","last_change":"2024-09-12T01:55:59.718288+0000","last_active":"2024-09-12T01:56:02.460597+0000","last_peered":"2024-09-12T01:56:02.460597+0000","last_clean":"2024-09-12T01:56:02.460597+0000","last_became_active":"2024-09-12T01:55:59.717322+0000","last_became_peered":"2024-09-12T01:55:59.717322+0000","last_unstale":"2024-09-12T01:56:02.460597+0000","last_undegraded":"2024-09-12T01:56:02.460597+0000","last_fullsized":"2024-09-12T01:56:02.460597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:22.647699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752673+0000","last_change":"2024-09-12T01:55:55.688289+0000","last_active":"2024-09-12T01:56:01.752673+0000","last_peered":"2024-09-12T01:56:01.752673+0000","last_clean":"2024-09-12T01:56:01.752673+0000","last_became_active":"2024-09-12T01:55:55.688004+0000","last_became_peered":"2024-09-12T01:55:55.688004+0000","last_unstale":"2024-09-12T01:56:01.752673+0000","last_undegraded":"2024-09-12T01:56:01.752673+0000","last_fullsized":"2024-09-12T01:56:01.752673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:10.809959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752404+0000","last_change":"2024-09-12T01:55:54.689369+0000","last_active":"2024-09-12T01:56:01.752404+0000","last_peered":"2024-09-12T01:56:01.752404+0000","last_clean":"2024-09-12T01:56:01.752404+0000","last_became_active":"2024-09-12T01:55:54.689097+0000","last_became_peered":"2024-09-12T01:55:54.689097+0000","last_unstale":"2024-09-12T01:56:01.752404+0000","last_undegraded":"2024-09-12T01:56:01.752404+0000","last_fullsized":"2024-09-12T01:56:01.752404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:48.747240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522904+0000","last_change":"2024-09-12T01:56:00.520323+0000","last_active":"2024-09-12T01:56:02.522904+0000","last_peered":"2024-09-12T01:56:02.522904+0000","last_clean":"2024-09-12T01:56:02.522904+0000","last_became_active":"2024-09-12T01:56:00.519824+0000","last_became_peered":"2024-09-12T01:56:00.519824+0000","last_unstale":"2024-09-12T01:56:02.522904+0000","last_undegraded":"2024-09-12T01:56:02.522904+0000","last_fullsized":"2024-09-12T01:56:02.522904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:52.098544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751804+0000","last_change":"2024-09-12T01:55:55.700672+0000","last_active":"2024-09-12T01:56:01.751804+0000","last_peered":"2024-09-12T01:56:01.751804+0000","last_clean":"2024-09-12T01:56:01.751804+0000","last_became_active":"2024-09-12T01:55:55.700200+0000","last_became_peered":"2024-09-12T01:55:55.700200+0000","last_unstale":"2024-09-12T01:56:01.751804+0000","last_undegraded":"2024-09-12T01:56:01.751804+0000","last_fullsized":"2024-09-12T01:56:01.751804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:52.516198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522306+0000","last_change":"2024-09-12T01:55:54.693863+0000","last_active":"2024-09-12T01:56:02.522306+0000","last_peered":"2024-09-12T01:56:02.522306+0000","last_clean":"2024-09-12T01:56:02.522306+0000","last_became_active":"2024-09-12T01:55:54.693523+0000","last_became_peered":"2024-09-12T01:55:54.693523+0000","last_unstale":"2024-09-12T01:56:02.522306+0000","last_undegraded":"2024-09-12T01:56:02.522306+0000","last_fullsized":"2024-09-12T01:56:02.522306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:48.747240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522582+0000","last_change":"2024-09-12T01:56:00.517194+0000","last_active":"2024-09-12T01:56:02.522582+0000","last_peered":"2024-09-12T01:56:02.522582+0000","last_clean":"2024-09-12T01:56:02.522582+0000","last_became_active":"2024-09-12T01:56:00.516727+0000","last_became_peered":"2024-09-12T01:56:00.516727+0000","last_unstale":"2024-09-12T01:56:02.522582+0000","last_undegraded":"2024-09-12T01:56:02.522582+0000","last_fullsized":"2024-09-12T01:56:02.522582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:00.596782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460450+0000","last_change":"2024-09-12T01:55:55.698062+0000","last_active":"2024-09-12T01:56:02.460450+0000","last_peered":"2024-09-12T01:56:02.460450+0000","last_clean":"2024-09-12T01:56:02.460450+0000","last_became_active":"2024-09-12T01:55:55.697776+0000","last_became_peered":"2024-09-12T01:55:55.697776+0000","last_unstale":"2024-09-12T01:56:02.460450+0000","last_undegraded":"2024-09-12T01:56:02.460450+0000","last_fullsized":"2024-09-12T01:56:02.460450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:28.067086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460790+0000","last_change":"2024-09-12T01:55:54.689127+0000","last_active":"2024-09-12T01:56:02.460790+0000","last_peered":"2024-09-12T01:56:02.460790+0000","last_clean":"2024-09-12T01:56:02.460790+0000","last_became_active":"2024-09-12T01:55:54.688722+0000","last_became_peered":"2024-09-12T01:55:54.688722+0000","last_unstale":"2024-09-12T01:56:02.460790+0000","last_undegraded":"2024-09-12T01:56:02.460790+0000","last_fullsized":"2024-09-12T01:56:02.460790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:56.353031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522434+0000","last_change":"2024-09-12T01:56:00.517059+0000","last_active":"2024-09-12T01:56:02.522434+0000","last_peered":"2024-09-12T01:56:02.522434+0000","last_clean":"2024-09-12T01:56:02.522434+0000","last_became_active":"2024-09-12T01:56:00.516595+0000","last_became_peered":"2024-09-12T01:56:00.516595+0000","last_unstale":"2024-09-12T01:56:02.522434+0000","last_undegraded":"2024-09-12T01:56:02.522434+0000","last_fullsized":"2024-09-12T01:56:02.522434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:14.390892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751922+0000","last_change":"2024-09-12T01:55:55.707760+0000","last_active":"2024-09-12T01:56:01.751922+0000","last_peered":"2024-09-12T01:56:01.751922+0000","last_clean":"2024-09-12T01:56:01.751922+0000","last_became_active":"2024-09-12T01:55:55.707514+0000","last_became_peered":"2024-09-12T01:55:55.707514+0000","last_unstale":"2024-09-12T01:56:01.751922+0000","last_undegraded":"2024-09-12T01:56:01.751922+0000","last_fullsized":"2024-09-12T01:56:01.751922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:20.499801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.256902+0000","last_change":"2024-09-12T01:55:54.690854+0000","last_active":"2024-09-12T01:56:05.256902+0000","last_peered":"2024-09-12T01:56:05.256902+0000","last_clean":"2024-09-12T01:56:05.256902+0000","last_became_active":"2024-09-12T01:55:54.690565+0000","last_became_peered":"2024-09-12T01:55:54.690565+0000","last_unstale":"2024-09-12T01:56:05.256902+0000","last_undegraded":"2024-09-12T01:56:05.256902+0000","last_fullsized":"2024-09-12T01:56:05.256902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:31.710719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522153+0000","last_change":"2024-09-12T01:55:59.728073+0000","last_active":"2024-09-12T01:56:02.522153+0000","last_peered":"2024-09-12T01:56:02.522153+0000","last_clean":"2024-09-12T01:56:02.522153+0000","last_became_active":"2024-09-12T01:55:59.727655+0000","last_became_peered":"2024-09-12T01:55:59.727655+0000","last_unstale":"2024-09-12T01:56:02.522153+0000","last_undegraded":"2024-09-12T01:56:02.522153+0000","last_fullsized":"2024-09-12T01:56:02.522153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:33.869240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996898+0000","last_change":"2024-09-12T01:55:55.698999+0000","last_active":"2024-09-12T01:56:01.996898+0000","last_peered":"2024-09-12T01:56:01.996898+0000","last_clean":"2024-09-12T01:56:01.996898+0000","last_became_active":"2024-09-12T01:55:55.698735+0000","last_became_peered":"2024-09-12T01:55:55.698735+0000","last_unstale":"2024-09-12T01:56:01.996898+0000","last_undegraded":"2024-09-12T01:56:01.996898+0000","last_fullsized":"2024-09-12T01:56:01.996898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:20.510009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522100+0000","last_change":"2024-09-12T01:55:54.692048+0000","last_active":"2024-09-12T01:56:02.522100+0000","last_peered":"2024-09-12T01:56:02.522100+0000","last_clean":"2024-09-12T01:56:02.522100+0000","last_became_active":"2024-09-12T01:55:54.691732+0000","last_became_peered":"2024-09-12T01:55:54.691732+0000","last_unstale":"2024-09-12T01:56:02.522100+0000","last_undegraded":"2024-09-12T01:56:02.522100+0000","last_fullsized":"2024-09-12T01:56:02.522100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:17.698798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996696+0000","last_change":"2024-09-12T01:55:59.715880+0000","last_active":"2024-09-12T01:56:01.996696+0000","last_peered":"2024-09-12T01:56:01.996696+0000","last_clean":"2024-09-12T01:56:01.996696+0000","last_became_active":"2024-09-12T01:55:59.715168+0000","last_became_peered":"2024-09-12T01:55:59.715168+0000","last_unstale":"2024-09-12T01:56:01.996696+0000","last_undegraded":"2024-09-12T01:56:01.996696+0000","last_fullsized":"2024-09-12T01:56:01.996696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:05.710174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460633+0000","last_change":"2024-09-12T01:55:55.690745+0000","last_active":"2024-09-12T01:56:02.460633+0000","last_peered":"2024-09-12T01:56:02.460633+0000","last_clean":"2024-09-12T01:56:02.460633+0000","last_became_active":"2024-09-12T01:55:55.690480+0000","last_became_peered":"2024-09-12T01:55:55.690480+0000","last_unstale":"2024-09-12T01:56:02.460633+0000","last_undegraded":"2024-09-12T01:56:02.460633+0000","last_fullsized":"2024-09-12T01:56:02.460633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:10.058977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522473+0000","last_change":"2024-09-12T01:55:54.691114+0000","last_active":"2024-09-12T01:56:02.522473+0000","last_peered":"2024-09-12T01:56:02.522473+0000","last_clean":"2024-09-12T01:56:02.522473+0000","last_became_active":"2024-09-12T01:55:54.690834+0000","last_became_peered":"2024-09-12T01:55:54.690834+0000","last_unstale":"2024-09-12T01:56:02.522473+0000","last_undegraded":"2024-09-12T01:56:02.522473+0000","last_fullsized":"2024-09-12T01:56:02.522473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:31.710719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521529+0000","last_change":"2024-09-12T01:55:59.722973+0000","last_active":"2024-09-12T01:56:02.521529+0000","last_peered":"2024-09-12T01:56:02.521529+0000","last_clean":"2024-09-12T01:56:02.521529+0000","last_became_active":"2024-09-12T01:55:59.722494+0000","last_became_peered":"2024-09-12T01:55:59.722494+0000","last_unstale":"2024-09-12T01:56:02.521529+0000","last_undegraded":"2024-09-12T01:56:02.521529+0000","last_fullsized":"2024-09-12T01:56:02.521529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:50.692862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522436+0000","last_change":"2024-09-12T01:55:55.696532+0000","last_active":"2024-09-12T01:56:02.522436+0000","last_peered":"2024-09-12T01:56:02.522436+0000","last_clean":"2024-09-12T01:56:02.522436+0000","last_became_active":"2024-09-12T01:55:55.696061+0000","last_became_peered":"2024-09-12T01:55:55.696061+0000","last_unstale":"2024-09-12T01:56:02.522436+0000","last_undegraded":"2024-09-12T01:56:02.522436+0000","last_fullsized":"2024-09-12T01:56:02.522436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.073038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752084+0000","last_change":"2024-09-12T01:55:54.687182+0000","last_active":"2024-09-12T01:56:01.752084+0000","last_peered":"2024-09-12T01:56:01.752084+0000","last_clean":"2024-09-12T01:56:01.752084+0000","last_became_active":"2024-09-12T01:55:54.686893+0000","last_became_peered":"2024-09-12T01:55:54.686893+0000","last_unstale":"2024-09-12T01:56:01.752084+0000","last_undegraded":"2024-09-12T01:56:01.752084+0000","last_fullsized":"2024-09-12T01:56:01.752084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:56.359673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521857+0000","last_change":"2024-09-12T01:56:00.519118+0000","last_active":"2024-09-12T01:56:02.521857+0000","last_peered":"2024-09-12T01:56:02.521857+0000","last_clean":"2024-09-12T01:56:02.521857+0000","last_became_active":"2024-09-12T01:56:00.518658+0000","last_became_peered":"2024-09-12T01:56:00.518658+0000","last_unstale":"2024-09-12T01:56:02.521857+0000","last_undegraded":"2024-09-12T01:56:02.521857+0000","last_fullsized":"2024-09-12T01:56:02.521857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:01.814275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460479+0000","last_change":"2024-09-12T01:56:00.519981+0000","last_active":"2024-09-12T01:56:02.460479+0000","last_peered":"2024-09-12T01:56:02.460479+0000","last_clean":"2024-09-12T01:56:02.460479+0000","last_became_active":"2024-09-12T01:56:00.519500+0000","last_became_peered":"2024-09-12T01:56:00.519500+0000","last_unstale":"2024-09-12T01:56:02.460479+0000","last_undegraded":"2024-09-12T01:56:02.460479+0000","last_fullsized":"2024-09-12T01:56:02.460479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:26.981322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521440+0000","last_change":"2024-09-12T01:55:55.687256+0000","last_active":"2024-09-12T01:56:02.521440+0000","last_peered":"2024-09-12T01:56:02.521440+0000","last_clean":"2024-09-12T01:56:02.521440+0000","last_became_active":"2024-09-12T01:55:55.685099+0000","last_became_peered":"2024-09-12T01:55:55.685099+0000","last_unstale":"2024-09-12T01:56:02.521440+0000","last_undegraded":"2024-09-12T01:56:02.521440+0000","last_fullsized":"2024-09-12T01:56:02.521440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:56.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522004+0000","last_change":"2024-09-12T01:55:54.694320+0000","last_active":"2024-09-12T01:56:02.522004+0000","last_peered":"2024-09-12T01:56:02.522004+0000","last_clean":"2024-09-12T01:56:02.522004+0000","last_became_active":"2024-09-12T01:55:54.694033+0000","last_became_peered":"2024-09-12T01:55:54.694033+0000","last_unstale":"2024-09-12T01:56:02.522004+0000","last_undegraded":"2024-09-12T01:56:02.522004+0000","last_fullsized":"2024-09-12T01:56:02.522004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:41.296972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751924+0000","last_change":"2024-09-12T01:55:59.721355+0000","last_active":"2024-09-12T01:56:01.751924+0000","last_peered":"2024-09-12T01:56:01.751924+0000","last_clean":"2024-09-12T01:56:01.751924+0000","last_became_active":"2024-09-12T01:55:59.720937+0000","last_became_peered":"2024-09-12T01:55:59.720937+0000","last_unstale":"2024-09-12T01:56:01.751924+0000","last_undegraded":"2024-09-12T01:56:01.751924+0000","last_fullsized":"2024-09-12T01:56:01.751924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:35.266537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521497+0000","last_change":"2024-09-12T01:55:55.703177+0000","last_active":"2024-09-12T01:56:02.521497+0000","last_peered":"2024-09-12T01:56:02.521497+0000","last_clean":"2024-09-12T01:56:02.521497+0000","last_became_active":"2024-09-12T01:55:55.697845+0000","last_became_peered":"2024-09-12T01:55:55.697845+0000","last_unstale":"2024-09-12T01:56:02.521497+0000","last_undegraded":"2024-09-12T01:56:02.521497+0000","last_fullsized":"2024-09-12T01:56:02.521497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:44.949953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521959+0000","last_change":"2024-09-12T01:55:54.690580+0000","last_active":"2024-09-12T01:56:02.521959+0000","last_peered":"2024-09-12T01:56:02.521959+0000","last_clean":"2024-09-12T01:56:02.521959+0000","last_became_active":"2024-09-12T01:55:54.690300+0000","last_became_peered":"2024-09-12T01:55:54.690300+0000","last_unstale":"2024-09-12T01:56:02.521959+0000","last_undegraded":"2024-09-12T01:56:02.521959+0000","last_fullsized":"2024-09-12T01:56:02.521959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:32.489045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752411+0000","last_change":"2024-09-12T01:55:54.687192+0000","last_active":"2024-09-12T01:56:01.752411+0000","last_peered":"2024-09-12T01:56:01.752411+0000","last_clean":"2024-09-12T01:56:01.752411+0000","last_became_active":"2024-09-12T01:55:54.686880+0000","last_became_peered":"2024-09-12T01:55:54.686880+0000","last_unstale":"2024-09-12T01:56:01.752411+0000","last_undegraded":"2024-09-12T01:56:01.752411+0000","last_fullsized":"2024-09-12T01:56:01.752411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:23.224359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460765+0000","last_change":"2024-09-12T01:55:55.693529+0000","last_active":"2024-09-12T01:56:02.460765+0000","last_peered":"2024-09-12T01:56:02.460765+0000","last_clean":"2024-09-12T01:56:02.460765+0000","last_became_active":"2024-09-12T01:55:55.693245+0000","last_became_peered":"2024-09-12T01:55:55.693245+0000","last_unstale":"2024-09-12T01:56:02.460765+0000","last_undegraded":"2024-09-12T01:56:02.460765+0000","last_fullsized":"2024-09-12T01:56:02.460765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:53.221222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.746166+0000","last_change":"2024-09-12T01:55:59.718401+0000","last_active":"2024-09-12T01:56:01.746166+0000","last_peered":"2024-09-12T01:56:01.746166+0000","last_clean":"2024-09-12T01:56:01.746166+0000","last_became_active":"2024-09-12T01:55:59.717933+0000","last_became_peered":"2024-09-12T01:55:59.717933+0000","last_unstale":"2024-09-12T01:56:01.746166+0000","last_undegraded":"2024-09-12T01:56:01.746166+0000","last_fullsized":"2024-09-12T01:56:01.746166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.213092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522420+0000","last_change":"2024-09-12T01:55:54.691342+0000","last_active":"2024-09-12T01:56:02.522420+0000","last_peered":"2024-09-12T01:56:02.522420+0000","last_clean":"2024-09-12T01:56:02.522420+0000","last_became_active":"2024-09-12T01:55:54.691025+0000","last_became_peered":"2024-09-12T01:55:54.691025+0000","last_unstale":"2024-09-12T01:56:02.522420+0000","last_undegraded":"2024-09-12T01:56:02.522420+0000","last_fullsized":"2024-09-12T01:56:02.522420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:53.660384+0000","last_clean_scrub_stamp":"2024-09-12T01:55:53.660384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:51.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996419+0000","last_change":"2024-09-12T01:55:55.698351+0000","last_active":"2024-09-12T01:56:01.996419+0000","last_peered":"2024-09-12T01:56:01.996419+0000","last_clean":"2024-09-12T01:56:01.996419+0000","last_became_active":"2024-09-12T01:55:55.698050+0000","last_became_peered":"2024-09-12T01:55:55.698050+0000","last_unstale":"2024-09-12T01:56:01.996419+0000","last_undegraded":"2024-09-12T01:56:01.996419+0000","last_fullsized":"2024-09-12T01:56:01.996419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:50.888763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522693+0000","last_change":"2024-09-12T01:55:59.722326+0000","last_active":"2024-09-12T01:56:02.522693+0000","last_peered":"2024-09-12T01:56:02.522693+0000","last_clean":"2024-09-12T01:56:02.522693+0000","last_became_active":"2024-09-12T01:55:59.721902+0000","last_became_peered":"2024-09-12T01:55:59.721902+0000","last_unstale":"2024-09-12T01:56:02.522693+0000","last_undegraded":"2024-09-12T01:56:02.522693+0000","last_fullsized":"2024-09-12T01:56:02.522693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:58.694783+0000","last_clean_scrub_stamp":"2024-09-12T01:55:58.694783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:39.486622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752590+0000","last_change":"2024-09-12T01:55:55.689349+0000","last_active":"2024-09-12T01:56:01.752590+0000","last_peered":"2024-09-12T01:56:01.752590+0000","last_clean":"2024-09-12T01:56:01.752590+0000","last_became_active":"2024-09-12T01:55:55.688915+0000","last_became_peered":"2024-09-12T01:55:55.688915+0000","last_unstale":"2024-09-12T01:56:01.752590+0000","last_undegraded":"2024-09-12T01:56:01.752590+0000","last_fullsized":"2024-09-12T01:56:01.752590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:28.067086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745858+0000","last_change":"2024-09-12T01:55:55.696841+0000","last_active":"2024-09-12T01:56:01.745858+0000","last_peered":"2024-09-12T01:56:01.745858+0000","last_clean":"2024-09-12T01:56:01.745858+0000","last_became_active":"2024-09-12T01:55:55.696545+0000","last_became_peered":"2024-09-12T01:55:55.696545+0000","last_unstale":"2024-09-12T01:56:01.745858+0000","last_undegraded":"2024-09-12T01:56:01.745858+0000","last_fullsized":"2024-09-12T01:56:01.745858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:46.163637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522177+0000","last_change":"2024-09-12T01:55:55.705917+0000","last_active":"2024-09-12T01:56:02.522177+0000","last_peered":"2024-09-12T01:56:02.522177+0000","last_clean":"2024-09-12T01:56:02.522177+0000","last_became_active":"2024-09-12T01:55:55.705517+0000","last_became_peered":"2024-09-12T01:55:55.705517+0000","last_unstale":"2024-09-12T01:56:02.522177+0000","last_undegraded":"2024-09-12T01:56:02.522177+0000","last_fullsized":"2024-09-12T01:56:02.522177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:31.237438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460726+0000","last_change":"2024-09-12T01:55:55.705881+0000","last_active":"2024-09-12T01:56:02.460726+0000","last_peered":"2024-09-12T01:56:02.460726+0000","last_clean":"2024-09-12T01:56:02.460726+0000","last_became_active":"2024-09-12T01:55:55.705557+0000","last_became_peered":"2024-09-12T01:55:55.705557+0000","last_unstale":"2024-09-12T01:56:02.460726+0000","last_undegraded":"2024-09-12T01:56:02.460726+0000","last_fullsized":"2024-09-12T01:56:02.460726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.073038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522638+0000","last_change":"2024-09-12T01:55:55.704834+0000","last_active":"2024-09-12T01:56:02.522638+0000","last_peered":"2024-09-12T01:56:02.522638+0000","last_clean":"2024-09-12T01:56:02.522638+0000","last_became_active":"2024-09-12T01:55:55.702868+0000","last_became_peered":"2024-09-12T01:55:55.702868+0000","last_unstale":"2024-09-12T01:56:02.522638+0000","last_undegraded":"2024-09-12T01:56:02.522638+0000","last_fullsized":"2024-09-12T01:56:02.522638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:06.356761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521624+0000","last_change":"2024-09-12T01:55:55.685821+0000","last_active":"2024-09-12T01:56:02.521624+0000","last_peered":"2024-09-12T01:56:02.521624+0000","last_clean":"2024-09-12T01:56:02.521624+0000","last_became_active":"2024-09-12T01:55:55.685517+0000","last_became_peered":"2024-09-12T01:55:55.685517+0000","last_unstale":"2024-09-12T01:56:02.521624+0000","last_undegraded":"2024-09-12T01:56:02.521624+0000","last_fullsized":"2024-09-12T01:56:02.521624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:18.907293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752735+0000","last_change":"2024-09-12T01:55:55.697608+0000","last_active":"2024-09-12T01:56:01.752735+0000","last_peered":"2024-09-12T01:56:01.752735+0000","last_clean":"2024-09-12T01:56:01.752735+0000","last_became_active":"2024-09-12T01:55:55.697368+0000","last_became_peered":"2024-09-12T01:55:55.697368+0000","last_unstale":"2024-09-12T01:56:01.752735+0000","last_undegraded":"2024-09-12T01:56:01.752735+0000","last_fullsized":"2024-09-12T01:56:01.752735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:53.221222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522816+0000","last_change":"2024-09-12T01:55:55.704580+0000","last_active":"2024-09-12T01:56:02.522816+0000","last_peered":"2024-09-12T01:56:02.522816+0000","last_clean":"2024-09-12T01:56:02.522816+0000","last_became_active":"2024-09-12T01:55:55.704310+0000","last_became_peered":"2024-09-12T01:55:55.704310+0000","last_unstale":"2024-09-12T01:56:02.522816+0000","last_undegraded":"2024-09-12T01:56:02.522816+0000","last_fullsized":"2024-09-12T01:56:02.522816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:30.891591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521987+0000","last_change":"2024-09-12T01:55:55.702574+0000","last_active":"2024-09-12T01:56:02.521987+0000","last_peered":"2024-09-12T01:56:02.521987+0000","last_clean":"2024-09-12T01:56:02.521987+0000","last_became_active":"2024-09-12T01:55:55.702381+0000","last_became_peered":"2024-09-12T01:55:55.702381+0000","last_unstale":"2024-09-12T01:56:02.521987+0000","last_undegraded":"2024-09-12T01:56:02.521987+0000","last_fullsized":"2024-09-12T01:56:02.521987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:14.471944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521666+0000","last_change":"2024-09-12T01:55:55.702491+0000","last_active":"2024-09-12T01:56:02.521666+0000","last_peered":"2024-09-12T01:56:02.521666+0000","last_clean":"2024-09-12T01:56:02.521666+0000","last_became_active":"2024-09-12T01:55:55.702184+0000","last_became_peered":"2024-09-12T01:55:55.702184+0000","last_unstale":"2024-09-12T01:56:02.521666+0000","last_undegraded":"2024-09-12T01:56:02.521666+0000","last_fullsized":"2024-09-12T01:56:02.521666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:29.526104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522126+0000","last_change":"2024-09-12T01:55:55.696303+0000","last_active":"2024-09-12T01:56:02.522126+0000","last_peered":"2024-09-12T01:56:02.522126+0000","last_clean":"2024-09-12T01:56:02.522126+0000","last_became_active":"2024-09-12T01:55:55.696044+0000","last_became_peered":"2024-09-12T01:55:55.696044+0000","last_unstale":"2024-09-12T01:56:02.522126+0000","last_undegraded":"2024-09-12T01:56:02.522126+0000","last_fullsized":"2024-09-12T01:56:02.522126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:41.082029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460625+0000","last_change":"2024-09-12T01:55:55.698223+0000","last_active":"2024-09-12T01:56:02.460625+0000","last_peered":"2024-09-12T01:56:02.460625+0000","last_clean":"2024-09-12T01:56:02.460625+0000","last_became_active":"2024-09-12T01:55:55.697926+0000","last_became_peered":"2024-09-12T01:55:55.697926+0000","last_unstale":"2024-09-12T01:56:02.460625+0000","last_undegraded":"2024-09-12T01:56:02.460625+0000","last_fullsized":"2024-09-12T01:56:02.460625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:10.809959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752785+0000","last_change":"2024-09-12T01:55:55.687766+0000","last_active":"2024-09-12T01:56:01.752785+0000","last_peered":"2024-09-12T01:56:01.752785+0000","last_clean":"2024-09-12T01:56:01.752785+0000","last_became_active":"2024-09-12T01:55:55.687387+0000","last_became_peered":"2024-09-12T01:55:55.687387+0000","last_unstale":"2024-09-12T01:56:01.752785+0000","last_undegraded":"2024-09-12T01:56:01.752785+0000","last_fullsized":"2024-09-12T01:56:01.752785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:05.184458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752307+0000","last_change":"2024-09-12T01:55:55.697237+0000","last_active":"2024-09-12T01:56:01.752307+0000","last_peered":"2024-09-12T01:56:01.752307+0000","last_clean":"2024-09-12T01:56:01.752307+0000","last_became_active":"2024-09-12T01:55:55.696731+0000","last_became_peered":"2024-09-12T01:55:55.696731+0000","last_unstale":"2024-09-12T01:56:01.752307+0000","last_undegraded":"2024-09-12T01:56:01.752307+0000","last_fullsized":"2024-09-12T01:56:01.752307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:18.618600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.745740+0000","last_change":"2024-09-12T01:55:55.691750+0000","last_active":"2024-09-12T01:56:01.745740+0000","last_peered":"2024-09-12T01:56:01.745740+0000","last_clean":"2024-09-12T01:56:01.745740+0000","last_became_active":"2024-09-12T01:55:55.691456+0000","last_became_peered":"2024-09-12T01:55:55.691456+0000","last_unstale":"2024-09-12T01:56:01.745740+0000","last_undegraded":"2024-09-12T01:56:01.745740+0000","last_fullsized":"2024-09-12T01:56:01.745740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:08.358541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522682+0000","last_change":"2024-09-12T01:55:55.699943+0000","last_active":"2024-09-12T01:56:02.522682+0000","last_peered":"2024-09-12T01:56:02.522682+0000","last_clean":"2024-09-12T01:56:02.522682+0000","last_became_active":"2024-09-12T01:55:55.699679+0000","last_became_peered":"2024-09-12T01:55:55.699679+0000","last_unstale":"2024-09-12T01:56:02.522682+0000","last_undegraded":"2024-09-12T01:56:02.522682+0000","last_fullsized":"2024-09-12T01:56:02.522682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:48.470241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521849+0000","last_change":"2024-09-12T01:55:55.689119+0000","last_active":"2024-09-12T01:56:02.521849+0000","last_peered":"2024-09-12T01:56:02.521849+0000","last_clean":"2024-09-12T01:56:02.521849+0000","last_became_active":"2024-09-12T01:55:55.688803+0000","last_became_peered":"2024-09-12T01:55:55.688803+0000","last_unstale":"2024-09-12T01:56:02.521849+0000","last_undegraded":"2024-09-12T01:56:02.521849+0000","last_fullsized":"2024-09-12T01:56:02.521849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:53.221222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521525+0000","last_change":"2024-09-12T01:55:55.699561+0000","last_active":"2024-09-12T01:56:02.521525+0000","last_peered":"2024-09-12T01:56:02.521525+0000","last_clean":"2024-09-12T01:56:02.521525+0000","last_became_active":"2024-09-12T01:55:55.699223+0000","last_became_peered":"2024-09-12T01:55:55.699223+0000","last_unstale":"2024-09-12T01:56:02.521525+0000","last_undegraded":"2024-09-12T01:56:02.521525+0000","last_fullsized":"2024-09-12T01:56:02.521525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:29.526104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460560+0000","last_change":"2024-09-12T01:55:55.692821+0000","last_active":"2024-09-12T01:56:02.460560+0000","last_peered":"2024-09-12T01:56:02.460560+0000","last_clean":"2024-09-12T01:56:02.460560+0000","last_became_active":"2024-09-12T01:55:55.692497+0000","last_became_peered":"2024-09-12T01:55:55.692497+0000","last_unstale":"2024-09-12T01:56:02.460560+0000","last_undegraded":"2024-09-12T01:56:02.460560+0000","last_fullsized":"2024-09-12T01:56:02.460560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:30.090079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522316+0000","last_change":"2024-09-12T01:55:55.703581+0000","last_active":"2024-09-12T01:56:02.522316+0000","last_peered":"2024-09-12T01:56:02.522316+0000","last_clean":"2024-09-12T01:56:02.522316+0000","last_became_active":"2024-09-12T01:55:55.703271+0000","last_became_peered":"2024-09-12T01:55:55.703271+0000","last_unstale":"2024-09-12T01:56:02.522316+0000","last_undegraded":"2024-09-12T01:56:02.522316+0000","last_fullsized":"2024-09-12T01:56:02.522316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:56.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.996754+0000","last_change":"2024-09-12T01:55:55.692636+0000","last_active":"2024-09-12T01:56:01.996754+0000","last_peered":"2024-09-12T01:56:01.996754+0000","last_clean":"2024-09-12T01:56:01.996754+0000","last_became_active":"2024-09-12T01:55:55.692367+0000","last_became_peered":"2024-09-12T01:55:55.692367+0000","last_unstale":"2024-09-12T01:56:01.996754+0000","last_undegraded":"2024-09-12T01:56:01.996754+0000","last_fullsized":"2024-09-12T01:56:01.996754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:44.926267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752614+0000","last_change":"2024-09-12T01:55:55.698490+0000","last_active":"2024-09-12T01:56:01.752614+0000","last_peered":"2024-09-12T01:56:01.752614+0000","last_clean":"2024-09-12T01:56:01.752614+0000","last_became_active":"2024-09-12T01:55:55.698190+0000","last_became_peered":"2024-09-12T01:55:55.698190+0000","last_unstale":"2024-09-12T01:56:01.752614+0000","last_undegraded":"2024-09-12T01:56:01.752614+0000","last_fullsized":"2024-09-12T01:56:01.752614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:36.523619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752728+0000","last_change":"2024-09-12T01:55:55.695606+0000","last_active":"2024-09-12T01:56:01.752728+0000","last_peered":"2024-09-12T01:56:01.752728+0000","last_clean":"2024-09-12T01:56:01.752728+0000","last_became_active":"2024-09-12T01:55:55.695348+0000","last_became_peered":"2024-09-12T01:55:55.695348+0000","last_unstale":"2024-09-12T01:56:01.752728+0000","last_undegraded":"2024-09-12T01:56:01.752728+0000","last_fullsized":"2024-09-12T01:56:01.752728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:10.058977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752300+0000","last_change":"2024-09-12T01:55:55.696973+0000","last_active":"2024-09-12T01:56:01.752300+0000","last_peered":"2024-09-12T01:56:01.752300+0000","last_clean":"2024-09-12T01:56:01.752300+0000","last_became_active":"2024-09-12T01:55:55.696435+0000","last_became_peered":"2024-09-12T01:55:55.696435+0000","last_unstale":"2024-09-12T01:56:01.752300+0000","last_undegraded":"2024-09-12T01:56:01.752300+0000","last_fullsized":"2024-09-12T01:56:01.752300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:20.252934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521402+0000","last_change":"2024-09-12T01:55:55.703874+0000","last_active":"2024-09-12T01:56:02.521402+0000","last_peered":"2024-09-12T01:56:02.521402+0000","last_clean":"2024-09-12T01:56:02.521402+0000","last_became_active":"2024-09-12T01:55:55.703532+0000","last_became_peered":"2024-09-12T01:55:55.703532+0000","last_unstale":"2024-09-12T01:56:02.521402+0000","last_undegraded":"2024-09-12T01:56:02.521402+0000","last_fullsized":"2024-09-12T01:56:02.521402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:04.569624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751534+0000","last_change":"2024-09-12T01:55:55.704083+0000","last_active":"2024-09-12T01:56:01.751534+0000","last_peered":"2024-09-12T01:56:01.751534+0000","last_clean":"2024-09-12T01:56:01.751534+0000","last_became_active":"2024-09-12T01:55:55.703653+0000","last_became_peered":"2024-09-12T01:55:55.703653+0000","last_unstale":"2024-09-12T01:56:01.751534+0000","last_undegraded":"2024-09-12T01:56:01.751534+0000","last_fullsized":"2024-09-12T01:56:01.751534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:14.471944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522008+0000","last_change":"2024-09-12T01:55:55.693606+0000","last_active":"2024-09-12T01:56:02.522008+0000","last_peered":"2024-09-12T01:56:02.522008+0000","last_clean":"2024-09-12T01:56:02.522008+0000","last_became_active":"2024-09-12T01:55:55.693044+0000","last_became_peered":"2024-09-12T01:55:55.693044+0000","last_unstale":"2024-09-12T01:56:02.522008+0000","last_undegraded":"2024-09-12T01:56:02.522008+0000","last_fullsized":"2024-09-12T01:56:02.522008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:42.036492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.751606+0000","last_change":"2024-09-12T01:55:55.697766+0000","last_active":"2024-09-12T01:56:01.751606+0000","last_peered":"2024-09-12T01:56:01.751606+0000","last_clean":"2024-09-12T01:56:01.751606+0000","last_became_active":"2024-09-12T01:55:55.697504+0000","last_became_peered":"2024-09-12T01:55:55.697504+0000","last_unstale":"2024-09-12T01:56:01.751606+0000","last_undegraded":"2024-09-12T01:56:01.751606+0000","last_fullsized":"2024-09-12T01:56:01.751606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:01.034708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.522237+0000","last_change":"2024-09-12T01:55:55.705929+0000","last_active":"2024-09-12T01:56:02.522237+0000","last_peered":"2024-09-12T01:56:02.522237+0000","last_clean":"2024-09-12T01:56:02.522237+0000","last_became_active":"2024-09-12T01:55:55.705645+0000","last_became_peered":"2024-09-12T01:55:55.705645+0000","last_unstale":"2024-09-12T01:56:02.522237+0000","last_undegraded":"2024-09-12T01:56:02.522237+0000","last_fullsized":"2024-09-12T01:56:02.522237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:17.560307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.460374+0000","last_change":"2024-09-12T01:55:55.689459+0000","last_active":"2024-09-12T01:56:02.460374+0000","last_peered":"2024-09-12T01:56:02.460374+0000","last_clean":"2024-09-12T01:56:02.460374+0000","last_became_active":"2024-09-12T01:55:55.688932+0000","last_became_peered":"2024-09-12T01:55:55.688932+0000","last_unstale":"2024-09-12T01:56:02.460374+0000","last_undegraded":"2024-09-12T01:56:02.460374+0000","last_fullsized":"2024-09-12T01:56:02.460374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:49.242430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:02.521944+0000","last_change":"2024-09-12T01:55:55.694825+0000","last_active":"2024-09-12T01:56:02.521944+0000","last_peered":"2024-09-12T01:56:02.521944+0000","last_clean":"2024-09-12T01:56:02.521944+0000","last_became_active":"2024-09-12T01:55:55.693916+0000","last_became_peered":"2024-09-12T01:55:55.693916+0000","last_unstale":"2024-09-12T01:56:02.521944+0000","last_undegraded":"2024-09-12T01:56:02.521944+0000","last_fullsized":"2024-09-12T01:56:02.521944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:49.260515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-12T01:56:01.752010+0000","last_change":"2024-09-12T01:55:55.696732+0000","last_active":"2024-09-12T01:56:01.752010+0000","last_peered":"2024-09-12T01:56:01.752010+0000","last_clean":"2024-09-12T01:56:01.752010+0000","last_became_active":"2024-09-12T01:55:55.696146+0000","last_became_peered":"2024-09-12T01:55:55.696146+0000","last_unstale":"2024-09-12T01:56:01.752010+0000","last_undegraded":"2024-09-12T01:56:01.752010+0000","last_fullsized":"2024-09-12T01:56:01.752010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:54.665684+0000","last_clean_scrub_stamp":"2024-09-12T01:55:54.665684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:31.237438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":880640,"data_stored":705461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":118355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":286720,"data_stored":114601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":118355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":114511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":114671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":888832,"data_stored":705517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":114637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:56:20.511 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:56:20.512 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T01:56:20.512 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T01:56:20.512 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:56:20.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.647+0000 7f3888d31640 1 Processor -- start 2024-09-12T01:56:20.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.647+0000 7f3888d31640 1 -- start start 2024-09-12T01:56:20.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.648+0000 7f3888d31640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3884165260 0x7f3884167650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:20.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.648+0000 7f3888d31640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38840d01c0 con 0x7f388415c870 2024-09-12T01:56:20.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.648+0000 7f3888d31640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38840d04a0 con 0x7f388415c490 2024-09-12T01:56:20.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.648+0000 7f3888d31640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f38840cff70 con 0x7f3884165260 2024-09-12T01:56:20.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.648+0000 7f3882d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3884165260 0x7f3884167650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:20.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.648+0000 7f3881d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f388415c870 0x7f388415cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44882/0 (socket says 172.21.15.19:44882) 2024-09-12T01:56:20.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.648+0000 7f3881d9b640 1 -- 172.21.15.19:0/3078529786 learned_addr learned my addr 172.21.15.19:0/3078529786 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:20.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.648+0000 7f3882d9d640 1 -- 172.21.15.19:0/3078529786 >> v1:172.21.15.135:6789/0 conn(0x7f388415c490 legacy=0x7f388409b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.648+0000 7f3882d9d640 1 -- 172.21.15.19:0/3078529786 >> v1:172.21.15.19:6789/0 conn(0x7f388415c870 legacy=0x7f388415cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.648+0000 7f3882d9d640 1 -- 172.21.15.19:0/3078529786 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38840d0780 con 0x7f3884165260 2024-09-12T01:56:20.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.648+0000 7f388159a640 1 -- 172.21.15.19:0/3078529786 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 162976436 0 0) 0x7f38840d01c0 con 0x7f388415c870 2024-09-12T01:56:20.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.649+0000 7f3882d9d640 1 --2- 172.21.15.19:0/3078529786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3884165260 0x7f3884167650 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f387c009d90 tx=0x7f387c02a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47069351654a9983 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:20.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.649+0000 7f388159a640 1 -- 172.21.15.19:0/3078529786 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c037070 con 0x7f3884165260 2024-09-12T01:56:20.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.649+0000 7f388159a640 1 -- 172.21.15.19:0/3078529786 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387c007740 con 0x7f3884165260 2024-09-12T01:56:20.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.649+0000 7f388159a640 1 -- 172.21.15.19:0/3078529786 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c007b10 con 0x7f3884165260 2024-09-12T01:56:20.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.649+0000 7f3888d31640 1 -- 172.21.15.19:0/3078529786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3884165260 msgr2=0x7f3884167650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.649+0000 7f3888d31640 1 --2- 172.21.15.19:0/3078529786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3884165260 0x7f3884167650 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f387c009d90 tx=0x7f387c02a780 comp rx=0 tx=0).stop 2024-09-12T01:56:20.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.649+0000 7f3888d31640 1 -- 172.21.15.19:0/3078529786 shutdown_connections 2024-09-12T01:56:20.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.649+0000 7f3888d31640 1 --2- 172.21.15.19:0/3078529786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3884165260 0x7f3884167650 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.649+0000 7f3888d31640 1 -- 172.21.15.19:0/3078529786 >> 172.21.15.19:0/3078529786 conn(0x7f38840d23a0 msgr2=0x7f38840d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:20.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.650+0000 7f3888d31640 1 -- 172.21.15.19:0/3078529786 shutdown_connections 2024-09-12T01:56:20.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.650+0000 7f3888d31640 1 -- 172.21.15.19:0/3078529786 wait complete. 2024-09-12T01:56:20.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.651+0000 7f3888d31640 1 Processor -- start 2024-09-12T01:56:20.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.651+0000 7f3888d31640 1 -- start start 2024-09-12T01:56:20.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3888d31640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f388415c490 0x7f38840c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:20.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3888d31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f388415c870 0x7f3884156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:20.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3888d31640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3884165260 0x7f38841562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:20.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3888d31640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f38840cdfa0 con 0x7f388415c870 2024-09-12T01:56:20.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3888d31640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f38840d0dd0 con 0x7f388415c490 2024-09-12T01:56:20.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3888d31640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f38840d1260 con 0x7f3884165260 2024-09-12T01:56:20.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3881d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f388415c870 0x7f3884156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:20.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3881d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f388415c870 0x7f3884156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42380/0 (socket says 172.21.15.19:42380) 2024-09-12T01:56:20.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3881d9b640 1 -- 172.21.15.19:0/3373097086 learned_addr learned my addr 172.21.15.19:0/3373097086 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:20.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f388259c640 1 --2- 172.21.15.19:0/3373097086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f388415c490 0x7f38840c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:20.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3882d9d640 1 --2- 172.21.15.19:0/3373097086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3884165260 0x7f38841562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:20.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3881d9b640 1 -- 172.21.15.19:0/3373097086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3884165260 msgr2=0x7f38841562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3881d9b640 1 --2- 172.21.15.19:0/3373097086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3884165260 0x7f38841562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3881d9b640 1 -- 172.21.15.19:0/3373097086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f388415c490 msgr2=0x7f38840c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3881d9b640 1 --2- 172.21.15.19:0/3373097086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f388415c490 0x7f38840c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3881d9b640 1 -- 172.21.15.19:0/3373097086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38840ca270 con 0x7f388415c870 2024-09-12T01:56:20.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3882d9d640 1 --2- 172.21.15.19:0/3373097086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3884165260 0x7f38841562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:20.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3881d9b640 1 --2- 172.21.15.19:0/3373097086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f388415c870 0x7f3884156ac0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f387800c4a0 tx=0x7f387800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:20.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3872ffd640 1 -- 172.21.15.19:0/3373097086 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878018070 con 0x7f388415c870 2024-09-12T01:56:20.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3872ffd640 1 -- 172.21.15.19:0/3373097086 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38780074e0 con 0x7f388415c870 2024-09-12T01:56:20.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3888d31640 1 -- 172.21.15.19:0/3373097086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38840cb970 con 0x7f388415c870 2024-09-12T01:56:20.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3872ffd640 1 -- 172.21.15.19:0/3373097086 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878004a20 con 0x7f388415c870 2024-09-12T01:56:20.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.652+0000 7f3888d31640 1 -- 172.21.15.19:0/3373097086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38840cbf30 con 0x7f388415c870 2024-09-12T01:56:20.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.653+0000 7f3888d31640 1 -- 172.21.15.19:0/3373097086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38840b0290 con 0x7f388415c870 2024-09-12T01:56:20.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.654+0000 7f3872ffd640 1 -- 172.21.15.19:0/3373097086 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3878004bc0 con 0x7f388415c870 2024-09-12T01:56:20.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.654+0000 7f3872ffd640 1 --2- 172.21.15.19:0/3373097086 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f386406be30 0x7f386406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:20.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.654+0000 7f3872ffd640 1 -- 172.21.15.19:0/3373097086 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f387808a430 con 0x7f388415c870 2024-09-12T01:56:20.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.655+0000 7f388259c640 1 --2- 172.21.15.19:0/3373097086 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f386406be30 0x7f386406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:20.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.655+0000 7f388259c640 1 --2- 172.21.15.19:0/3373097086 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f386406be30 0x7f386406e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3884072170 tx=0x7f3874009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:20.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.658+0000 7f3872ffd640 1 -- 172.21.15.19:0/3373097086 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f38840b0290 con 0x7f388415c870 2024-09-12T01:56:20.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.870+0000 7f3888d31640 1 -- 172.21.15.19:0/3373097086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f388415cce0 con 0x7f388415c870 2024-09-12T01:56:20.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.870+0000 7f3872ffd640 1 -- 172.21.15.19:0/3373097086 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f3878058460 con 0x7f388415c870 2024-09-12T01:56:20.870 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:20.870 INFO:teuthology.orchestra.run.smithi019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T01:56:20.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.872+0000 7f3888d31640 1 -- 172.21.15.19:0/3373097086 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f386406be30 msgr2=0x7f386406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.872+0000 7f3888d31640 1 --2- 172.21.15.19:0/3373097086 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f386406be30 0x7f386406e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3884072170 tx=0x7f3874009040 comp rx=0 tx=0).stop 2024-09-12T01:56:20.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.872+0000 7f3888d31640 1 -- 172.21.15.19:0/3373097086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f388415c870 msgr2=0x7f3884156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.872+0000 7f3888d31640 1 --2- 172.21.15.19:0/3373097086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f388415c870 0x7f3884156ac0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f387800c4a0 tx=0x7f387800c960 comp rx=0 tx=0).stop 2024-09-12T01:56:20.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.872+0000 7f3888d31640 1 -- 172.21.15.19:0/3373097086 shutdown_connections 2024-09-12T01:56:20.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.872+0000 7f3888d31640 1 --2- 172.21.15.19:0/3373097086 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f386406be30 0x7f386406e2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.872+0000 7f3888d31640 1 --2- 172.21.15.19:0/3373097086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3884165260 0x7f38841562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.872+0000 7f3888d31640 1 --2- 172.21.15.19:0/3373097086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f388415c870 0x7f3884156ac0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.872+0000 7f3888d31640 1 --2- 172.21.15.19:0/3373097086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f388415c490 0x7f38840c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.872+0000 7f3888d31640 1 -- 172.21.15.19:0/3373097086 >> 172.21.15.19:0/3373097086 conn(0x7f38840d23a0 msgr2=0x7f38840afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:20.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.872+0000 7f3888d31640 1 -- 172.21.15.19:0/3373097086 shutdown_connections 2024-09-12T01:56:20.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.872+0000 7f3888d31640 1 -- 172.21.15.19:0/3373097086 wait complete. 2024-09-12T01:56:20.883 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T01:56:20.883 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:56:20.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.985+0000 7f9382ad0640 1 Processor -- start 2024-09-12T01:56:20.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.985+0000 7f9382ad0640 1 -- start start 2024-09-12T01:56:20.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.985+0000 7f9382ad0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f937c162060 0x7f937c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:20.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.985+0000 7f9382ad0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f937c0b64b0 0x7f937c0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:20.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.985+0000 7f9382ad0640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f937c06d9f0 con 0x7f937c161c80 2024-09-12T01:56:20.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.985+0000 7f9382ad0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f937c06dcd0 con 0x7f937c162060 2024-09-12T01:56:20.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.985+0000 7f9382ad0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f937c06dfb0 con 0x7f937c0b64b0 2024-09-12T01:56:20.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.986+0000 7f938086c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f937c161c80 0x7f937c06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44890/0 (socket says 172.21.15.19:44890) 2024-09-12T01:56:20.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.986+0000 7f938086c640 1 -- 172.21.15.19:0/3772600110 learned_addr learned my addr 172.21.15.19:0/3772600110 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:20.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.986+0000 7f938106d640 1 --2- 172.21.15.19:0/3772600110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f937c0b64b0 0x7f937c0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:20.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.986+0000 7f937bfff640 1 --2- 172.21.15.19:0/3772600110 >> v2:172.21.15.135:3300/0 conn(0x7f937c162060 0x7f937c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:20.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.986+0000 7f937b7fe640 1 -- 172.21.15.19:0/3772600110 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2300127012 0 0) 0x7f937c06d9f0 con 0x7f937c161c80 2024-09-12T01:56:20.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.986+0000 7f937b7fe640 1 -- 172.21.15.19:0/3772600110 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9368003520 con 0x7f937c161c80 2024-09-12T01:56:20.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.986+0000 7f937bfff640 1 -- 172.21.15.19:0/3772600110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f937c0b64b0 msgr2=0x7f937c0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:20.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.986+0000 7f937bfff640 1 --2- 172.21.15.19:0/3772600110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f937c0b64b0 0x7f937c0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.986+0000 7f937bfff640 1 -- 172.21.15.19:0/3772600110 >> v1:172.21.15.19:6789/0 conn(0x7f937c161c80 legacy=0x7f937c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.986+0000 7f937bfff640 1 -- 172.21.15.19:0/3772600110 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937c0d01f0 con 0x7f937c162060 2024-09-12T01:56:20.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.986+0000 7f938106d640 1 --2- 172.21.15.19:0/3772600110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f937c0b64b0 0x7f937c0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:20.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.987+0000 7f937bfff640 1 --2- 172.21.15.19:0/3772600110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f937c162060 0x7f937c0b5f70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9364009d90 tx=0x7f936402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82fe49817d20d5d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:20.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.987+0000 7f937b7fe640 1 -- 172.21.15.19:0/3772600110 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364007740 con 0x7f937c162060 2024-09-12T01:56:20.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.987+0000 7f937b7fe640 1 -- 172.21.15.19:0/3772600110 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93640078e0 con 0x7f937c162060 2024-09-12T01:56:20.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.987+0000 7f937b7fe640 1 -- 172.21.15.19:0/3772600110 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364007c90 con 0x7f937c162060 2024-09-12T01:56:20.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.988+0000 7f9382ad0640 1 -- 172.21.15.19:0/3772600110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f937c162060 msgr2=0x7f937c0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.988+0000 7f9382ad0640 1 --2- 172.21.15.19:0/3772600110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f937c162060 0x7f937c0b5f70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9364009d90 tx=0x7f936402a660 comp rx=0 tx=0).stop 2024-09-12T01:56:20.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.988+0000 7f9382ad0640 1 -- 172.21.15.19:0/3772600110 shutdown_connections 2024-09-12T01:56:20.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.988+0000 7f9382ad0640 1 --2- 172.21.15.19:0/3772600110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f937c0b64b0 0x7f937c0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.988+0000 7f9382ad0640 1 --2- 172.21.15.19:0/3772600110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f937c162060 0x7f937c0b5f70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.988+0000 7f9382ad0640 1 -- 172.21.15.19:0/3772600110 >> 172.21.15.19:0/3772600110 conn(0x7f937c0d44f0 msgr2=0x7f937c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:20.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.988+0000 7f9382ad0640 1 -- 172.21.15.19:0/3772600110 shutdown_connections 2024-09-12T01:56:20.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.988+0000 7f9382ad0640 1 -- 172.21.15.19:0/3772600110 wait complete. 2024-09-12T01:56:20.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.989+0000 7f9382ad0640 1 Processor -- start 2024-09-12T01:56:20.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.989+0000 7f9382ad0640 1 -- start start 2024-09-12T01:56:20.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.990+0000 7f9382ad0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f937c0b64b0 0x7f937c0b8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:20.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.990+0000 7f9382ad0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f937c161c80 0x7f937c0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:20.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.990+0000 7f9382ad0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f937c162060 0x7f937c15ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:20.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.990+0000 7f9382ad0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f937c0cf360 con 0x7f937c0b64b0 2024-09-12T01:56:20.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.990+0000 7f9382ad0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f937c0cf1e0 con 0x7f937c162060 2024-09-12T01:56:20.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.990+0000 7f9382ad0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f937c0cf4e0 con 0x7f937c161c80 2024-09-12T01:56:20.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.990+0000 7f938086c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f937c0b64b0 0x7f937c0b8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:20.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.990+0000 7f938086c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f937c0b64b0 0x7f937c0b8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42394/0 (socket says 172.21.15.19:42394) 2024-09-12T01:56:20.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.990+0000 7f938086c640 1 -- 172.21.15.19:0/2830188566 learned_addr learned my addr 172.21.15.19:0/2830188566 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.990+0000 7f938106d640 1 --2- 172.21.15.19:0/2830188566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f937c162060 0x7f937c15ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.990+0000 7f937bfff640 1 --2- 172.21.15.19:0/2830188566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f937c161c80 0x7f937c0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.990+0000 7f938086c640 1 -- 172.21.15.19:0/2830188566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f937c161c80 msgr2=0x7f937c0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.990+0000 7f938086c640 1 --2- 172.21.15.19:0/2830188566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f937c161c80 0x7f937c0cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.990+0000 7f938086c640 1 -- 172.21.15.19:0/2830188566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f937c162060 msgr2=0x7f937c15ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.990+0000 7f938086c640 1 --2- 172.21.15.19:0/2830188566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f937c162060 0x7f937c15ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.990+0000 7f938086c640 1 -- 172.21.15.19:0/2830188566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937c0ccdf0 con 0x7f937c0b64b0 2024-09-12T01:56:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.990+0000 7f938106d640 1 --2- 172.21.15.19:0/2830188566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f937c162060 0x7f937c15ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.990+0000 7f938086c640 1 --2- 172.21.15.19:0/2830188566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f937c0b64b0 0x7f937c0b8e80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f936c00c430 tx=0x7f936c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.991+0000 7f93797fa640 1 -- 172.21.15.19:0/2830188566 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c017070 con 0x7f937c0b64b0 2024-09-12T01:56:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.991+0000 7f93797fa640 1 -- 172.21.15.19:0/2830188566 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f936c005ce0 con 0x7f937c0b64b0 2024-09-12T01:56:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.991+0000 7f9382ad0640 1 -- 172.21.15.19:0/2830188566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f937c0b94d0 con 0x7f937c0b64b0 2024-09-12T01:56:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.991+0000 7f93797fa640 1 -- 172.21.15.19:0/2830188566 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c0072f0 con 0x7f937c0b64b0 2024-09-12T01:56:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.991+0000 7f9382ad0640 1 -- 172.21.15.19:0/2830188566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f937c0b9d10 con 0x7f937c0b64b0 2024-09-12T01:56:20.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.992+0000 7f9382ad0640 1 -- 172.21.15.19:0/2830188566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f937c0b5f70 con 0x7f937c0b64b0 2024-09-12T01:56:20.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.992+0000 7f93797fa640 1 -- 172.21.15.19:0/2830188566 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f936c01a070 con 0x7f937c0b64b0 2024-09-12T01:56:20.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.992+0000 7f93797fa640 1 --2- 172.21.15.19:0/2830188566 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f935c06be30 0x7f935c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:20.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.993+0000 7f93797fa640 1 -- 172.21.15.19:0/2830188566 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f936c08a6a0 con 0x7f937c0b64b0 2024-09-12T01:56:20.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.993+0000 7f937bfff640 1 --2- 172.21.15.19:0/2830188566 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f935c06be30 0x7f935c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:20.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.993+0000 7f937bfff640 1 --2- 172.21.15.19:0/2830188566 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f935c06be30 0x7f935c06e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9364034000 tx=0x7f9364033040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:20.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:20.997+0000 7f93797fa640 1 -- 172.21.15.19:0/2830188566 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f937c0b94d0 con 0x7f937c0b64b0 2024-09-12T01:56:21.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.209+0000 7f9382ad0640 1 -- 172.21.15.19:0/2830188566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f937c0ba470 con 0x7f937c0b64b0 2024-09-12T01:56:21.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.210+0000 7f93797fa640 1 -- 172.21.15.19:0/2830188566 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f936c058d10 con 0x7f937c0b64b0 2024-09-12T01:56:21.210 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:21.210 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"btime":"2024-09-12T01:56:14:778796+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4024559276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":4024559276},{"type":"v1","addr":"172.21.15.135:6837","nonce":4024559276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3369866614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3369866614},{"type":"v1","addr":"172.21.15.19:6834","nonce":3369866614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2476634027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2476634027},{"type":"v1","addr":"172.21.15.19:6835","nonce":2476634027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:55:55.036100+0000","modified":"2024-09-12T01:56:14.133810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/4290669195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4290669195},{"type":"v1","addr":"172.21.15.135:6836","nonce":4290669195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-09-12T01:56:21.211 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2024-09-12T01:56:21.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.212+0000 7f9382ad0640 1 -- 172.21.15.19:0/2830188566 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f935c06be30 msgr2=0x7f935c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.212+0000 7f9382ad0640 1 --2- 172.21.15.19:0/2830188566 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f935c06be30 0x7f935c06e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9364034000 tx=0x7f9364033040 comp rx=0 tx=0).stop 2024-09-12T01:56:21.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.212+0000 7f9382ad0640 1 -- 172.21.15.19:0/2830188566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f937c0b64b0 msgr2=0x7f937c0b8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.212+0000 7f9382ad0640 1 --2- 172.21.15.19:0/2830188566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f937c0b64b0 0x7f937c0b8e80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f936c00c430 tx=0x7f936c00c8f0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.212+0000 7f9382ad0640 1 -- 172.21.15.19:0/2830188566 shutdown_connections 2024-09-12T01:56:21.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.212+0000 7f9382ad0640 1 --2- 172.21.15.19:0/2830188566 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f935c06be30 0x7f935c06e2f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.212+0000 7f9382ad0640 1 --2- 172.21.15.19:0/2830188566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f937c162060 0x7f937c15ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.212+0000 7f9382ad0640 1 --2- 172.21.15.19:0/2830188566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f937c161c80 0x7f937c0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.212+0000 7f9382ad0640 1 --2- 172.21.15.19:0/2830188566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f937c0b64b0 0x7f937c0b8e80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.212+0000 7f9382ad0640 1 -- 172.21.15.19:0/2830188566 >> 172.21.15.19:0/2830188566 conn(0x7f937c0d44f0 msgr2=0x7f937c074760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:21.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.212+0000 7f9382ad0640 1 -- 172.21.15.19:0/2830188566 shutdown_connections 2024-09-12T01:56:21.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.212+0000 7f9382ad0640 1 -- 172.21.15.19:0/2830188566 wait complete. 2024-09-12T01:56:21.226 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:56:21.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.329+0000 7f35c2d81640 1 Processor -- start 2024-09-12T01:56:21.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.329+0000 7f35c2d81640 1 -- start start 2024-09-12T01:56:21.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.329+0000 7f35c2d81640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f35bc161a20 0x7f35bc0d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.329+0000 7f35c2d81640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35bc0d1420 0x7f35bc0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.329+0000 7f35c2d81640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f35bc0cf160 0x7f35bc0b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.329+0000 7f35c2d81640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f35bc161e00 con 0x7f35bc0cf160 2024-09-12T01:56:21.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.329+0000 7f35c2d81640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f35bc0d1830 con 0x7f35bc161a20 2024-09-12T01:56:21.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.329+0000 7f35c2d81640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f35bc0cf980 con 0x7f35bc0d1420 2024-09-12T01:56:21.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.330+0000 7f35c131e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f35bc0cf160 0x7f35bc0b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.330+0000 7f35c131e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f35bc0cf160 0x7f35bc0b5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59932/0 (socket says 172.21.15.19:59932) 2024-09-12T01:56:21.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.330+0000 7f35c131e640 1 -- 172.21.15.19:0/4040852126 learned_addr learned my addr 172.21.15.19:0/4040852126 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:21.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.330+0000 7f35c0b1d640 1 --2- 172.21.15.19:0/4040852126 >> v2:172.21.15.135:3300/0 conn(0x7f35bc161a20 0x7f35bc0d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.330+0000 7f35bbfff640 1 --2- 172.21.15.19:0/4040852126 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35bc0d1420 0x7f35bc0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.330+0000 7f35c131e640 1 -- 172.21.15.19:0/4040852126 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35bc0d1420 msgr2=0x7f35bc0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:21.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.330+0000 7f35c131e640 1 --2- 172.21.15.19:0/4040852126 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35bc0d1420 0x7f35bc0cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.330+0000 7f35c131e640 1 -- 172.21.15.19:0/4040852126 >> v2:172.21.15.135:3300/0 conn(0x7f35bc161a20 msgr2=0x7f35bc0d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:21.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.330+0000 7f35c131e640 1 --2- 172.21.15.19:0/4040852126 >> v2:172.21.15.135:3300/0 conn(0x7f35bc161a20 0x7f35bc0d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.330+0000 7f35c131e640 1 -- 172.21.15.19:0/4040852126 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35bc06d050 con 0x7f35bc0cf160 2024-09-12T01:56:21.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.331+0000 7f35c131e640 1 --2- 172.21.15.19:0/4040852126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35bc0cf160 0x7f35bc0b5f50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f35bc08c910 tx=0x7f35a402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34d842edf0fbc3b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:21.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.331+0000 7f35bb7fe640 1 -- 172.21.15.19:0/4040852126 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a4037070 con 0x7f35bc0cf160 2024-09-12T01:56:21.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.331+0000 7f35bb7fe640 1 -- 172.21.15.19:0/4040852126 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a4032440 con 0x7f35bc0cf160 2024-09-12T01:56:21.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.331+0000 7f35bb7fe640 1 -- 172.21.15.19:0/4040852126 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a4032810 con 0x7f35bc0cf160 2024-09-12T01:56:21.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.331+0000 7f35c2d81640 1 -- 172.21.15.19:0/4040852126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35bc0cf160 msgr2=0x7f35bc0b5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.331+0000 7f35c2d81640 1 --2- 172.21.15.19:0/4040852126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35bc0cf160 0x7f35bc0b5f50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f35bc08c910 tx=0x7f35a402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.331+0000 7f35c2d81640 1 -- 172.21.15.19:0/4040852126 shutdown_connections 2024-09-12T01:56:21.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.331+0000 7f35c2d81640 1 --2- 172.21.15.19:0/4040852126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35bc0cf160 0x7f35bc0b5f50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.331+0000 7f35c2d81640 1 --2- 172.21.15.19:0/4040852126 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35bc0d1420 0x7f35bc0cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.331+0000 7f35c2d81640 1 --2- 172.21.15.19:0/4040852126 >> v2:172.21.15.135:3300/0 conn(0x7f35bc161a20 0x7f35bc0d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.331+0000 7f35c2d81640 1 -- 172.21.15.19:0/4040852126 >> 172.21.15.19:0/4040852126 conn(0x7f35bc09d850 msgr2=0x7f35bc08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:21.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.332+0000 7f35c2d81640 1 -- 172.21.15.19:0/4040852126 shutdown_connections 2024-09-12T01:56:21.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.332+0000 7f35c2d81640 1 -- 172.21.15.19:0/4040852126 wait complete. 2024-09-12T01:56:21.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.333+0000 7f35c2d81640 1 Processor -- start 2024-09-12T01:56:21.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.333+0000 7f35c2d81640 1 -- start start 2024-09-12T01:56:21.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35c2d81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35bc0cf160 0x7f35bc1565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35c2d81640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35bc0d1420 0x7f35bc0b94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35c2d81640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35bc161a20 0x7f35bc0b9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35c2d81640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc06d2f0 con 0x7f35bc0cf160 2024-09-12T01:56:21.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35c2d81640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc0cff00 con 0x7f35bc161a20 2024-09-12T01:56:21.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35c2d81640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f35bc0b1040 con 0x7f35bc0d1420 2024-09-12T01:56:21.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35c0b1d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35bc0cf160 0x7f35bc1565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35c0b1d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35bc0cf160 0x7f35bc1565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59936/0 (socket says 172.21.15.19:59936) 2024-09-12T01:56:21.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35c0b1d640 1 -- 172.21.15.19:0/1498885258 learned_addr learned my addr 172.21.15.19:0/1498885258 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:21.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35bbfff640 1 --2- 172.21.15.19:0/1498885258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35bc0d1420 0x7f35bc0b94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35c131e640 1 --2- 172.21.15.19:0/1498885258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35bc161a20 0x7f35bc0b9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35c0b1d640 1 -- 172.21.15.19:0/1498885258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35bc0d1420 msgr2=0x7f35bc0b94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35c0b1d640 1 --2- 172.21.15.19:0/1498885258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35bc0d1420 0x7f35bc0b94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35c0b1d640 1 -- 172.21.15.19:0/1498885258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35bc161a20 msgr2=0x7f35bc0b9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35c0b1d640 1 --2- 172.21.15.19:0/1498885258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35bc161a20 0x7f35bc0b9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35c0b1d640 1 -- 172.21.15.19:0/1498885258 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35bc0cb370 con 0x7f35bc0cf160 2024-09-12T01:56:21.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35c0b1d640 1 --2- 172.21.15.19:0/1498885258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35bc0cf160 0x7f35bc1565d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009d10 tx=0x7f35b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:21.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35b97fa640 1 -- 172.21.15.19:0/1498885258 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4018020 con 0x7f35bc0cf160 2024-09-12T01:56:21.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35b97fa640 1 -- 172.21.15.19:0/1498885258 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b4014480 con 0x7f35bc0cf160 2024-09-12T01:56:21.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35c2d81640 1 -- 172.21.15.19:0/1498885258 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35bc0cb090 con 0x7f35bc0cf160 2024-09-12T01:56:21.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.334+0000 7f35b97fa640 1 -- 172.21.15.19:0/1498885258 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4014830 con 0x7f35bc0cf160 2024-09-12T01:56:21.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.335+0000 7f35c2d81640 1 -- 172.21.15.19:0/1498885258 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35bc156fc0 con 0x7f35bc0cf160 2024-09-12T01:56:21.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.335+0000 7f35c2d81640 1 -- 172.21.15.19:0/1498885258 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35bc0cf5f0 con 0x7f35bc0cf160 2024-09-12T01:56:21.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.336+0000 7f35b97fa640 1 -- 172.21.15.19:0/1498885258 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f35b4005d10 con 0x7f35bc0cf160 2024-09-12T01:56:21.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.336+0000 7f35b97fa640 1 --2- 172.21.15.19:0/1498885258 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f359c06be60 0x7f359c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.336+0000 7f35b97fa640 1 -- 172.21.15.19:0/1498885258 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f35b408b990 con 0x7f35bc0cf160 2024-09-12T01:56:21.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.337+0000 7f35bbfff640 1 --2- 172.21.15.19:0/1498885258 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f359c06be60 0x7f359c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.337+0000 7f35bbfff640 1 --2- 172.21.15.19:0/1498885258 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f359c06be60 0x7f359c06e320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f35bc15ca50 tx=0x7f35ac009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:21.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.341+0000 7f35b97fa640 1 -- 172.21.15.19:0/1498885258 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f35b4022070 con 0x7f35bc0cf160 2024-09-12T01:56:21.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.552+0000 7f35c2d81640 1 -- 172.21.15.19:0/1498885258 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35bc08c060 con 0x7f35bc0cf160 2024-09-12T01:56:21.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.552+0000 7f35b97fa640 1 -- 172.21.15.19:0/1498885258 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f35b4010040 con 0x7f35bc0cf160 2024-09-12T01:56:21.553 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:21.553 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"btime":"2024-09-12T01:56:14:778796+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4024559276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":4024559276},{"type":"v1","addr":"172.21.15.135:6837","nonce":4024559276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3369866614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3369866614},{"type":"v1","addr":"172.21.15.19:6834","nonce":3369866614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2476634027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2476634027},{"type":"v1","addr":"172.21.15.19:6835","nonce":2476634027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:55:55.036100+0000","modified":"2024-09-12T01:56:14.133810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/4290669195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4290669195},{"type":"v1","addr":"172.21.15.135:6836","nonce":4290669195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-09-12T01:56:21.553 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2024-09-12T01:56:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.554+0000 7f35c2d81640 1 -- 172.21.15.19:0/1498885258 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f359c06be60 msgr2=0x7f359c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.554+0000 7f35c2d81640 1 --2- 172.21.15.19:0/1498885258 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f359c06be60 0x7f359c06e320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f35bc15ca50 tx=0x7f35ac009190 comp rx=0 tx=0).stop 2024-09-12T01:56:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.554+0000 7f35c2d81640 1 -- 172.21.15.19:0/1498885258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35bc0cf160 msgr2=0x7f35bc1565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.554+0000 7f35c2d81640 1 --2- 172.21.15.19:0/1498885258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35bc0cf160 0x7f35bc1565d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009d10 tx=0x7f35b400c490 comp rx=0 tx=0).stop 2024-09-12T01:56:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.555+0000 7f35c2d81640 1 -- 172.21.15.19:0/1498885258 shutdown_connections 2024-09-12T01:56:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.555+0000 7f35c2d81640 1 --2- 172.21.15.19:0/1498885258 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f359c06be60 0x7f359c06e320 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.555+0000 7f35c2d81640 1 --2- 172.21.15.19:0/1498885258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35bc161a20 0x7f35bc0b9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.555+0000 7f35c2d81640 1 --2- 172.21.15.19:0/1498885258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35bc0d1420 0x7f35bc0b94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.555+0000 7f35c2d81640 1 --2- 172.21.15.19:0/1498885258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35bc0cf160 0x7f35bc1565d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.555+0000 7f35c2d81640 1 -- 172.21.15.19:0/1498885258 >> 172.21.15.19:0/1498885258 conn(0x7f35bc09d850 msgr2=0x7f35bc0cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:21.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.555+0000 7f35c2d81640 1 -- 172.21.15.19:0/1498885258 shutdown_connections 2024-09-12T01:56:21.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.555+0000 7f35c2d81640 1 -- 172.21.15.19:0/1498885258 wait complete. 2024-09-12T01:56:21.566 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:56:21.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.667+0000 7f327fe96640 1 Processor -- start 2024-09-12T01:56:21.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.667+0000 7f327fe96640 1 -- start start 2024-09-12T01:56:21.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.668+0000 7f327fe96640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3278161c80 0x7f327806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.668+0000 7f327fe96640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f32780b6680 0x7f32780cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.668+0000 7f327fe96640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f327806e870 con 0x7f3278162060 2024-09-12T01:56:21.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.668+0000 7f327fe96640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f327806d9f0 con 0x7f32780b6680 2024-09-12T01:56:21.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.668+0000 7f327fe96640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f327806dcd0 con 0x7f3278161c80 2024-09-12T01:56:21.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.668+0000 7f327e433640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f32780b6680 0x7f32780cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.668+0000 7f327d431640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3278162060 0x7f32780b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59676/0 (socket says 172.21.15.19:59676) 2024-09-12T01:56:21.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.668+0000 7f327d431640 1 -- 172.21.15.19:0/3435206500 learned_addr learned my addr 172.21.15.19:0/3435206500 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:21.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.669+0000 7f327dc32640 1 --2- 172.21.15.19:0/3435206500 >> v2:172.21.15.135:3300/0 conn(0x7f3278161c80 0x7f327806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.669+0000 7f327e433640 1 -- 172.21.15.19:0/3435206500 >> v2:172.21.15.135:3300/0 conn(0x7f3278161c80 msgr2=0x7f327806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:21.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.669+0000 7f327e433640 1 --2- 172.21.15.19:0/3435206500 >> v2:172.21.15.135:3300/0 conn(0x7f3278161c80 0x7f327806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.669+0000 7f327e433640 1 -- 172.21.15.19:0/3435206500 >> v1:172.21.15.19:6789/0 conn(0x7f3278162060 legacy=0x7f32780b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.669+0000 7f327e433640 1 -- 172.21.15.19:0/3435206500 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f327806dfb0 con 0x7f32780b6680 2024-09-12T01:56:21.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.669+0000 7f327e433640 1 --2- 172.21.15.19:0/3435206500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32780b6680 0x7f32780cf1e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f327808d7a0 tx=0x7f327002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe8dac1c141daa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:21.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.670+0000 7f327cc30640 1 -- 172.21.15.19:0/3435206500 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3270037070 con 0x7f32780b6680 2024-09-12T01:56:21.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.670+0000 7f327cc30640 1 -- 172.21.15.19:0/3435206500 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3270032440 con 0x7f32780b6680 2024-09-12T01:56:21.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.670+0000 7f327cc30640 1 -- 172.21.15.19:0/3435206500 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3270032810 con 0x7f32780b6680 2024-09-12T01:56:21.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.670+0000 7f327fe96640 1 -- 172.21.15.19:0/3435206500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32780b6680 msgr2=0x7f32780cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.670+0000 7f327fe96640 1 --2- 172.21.15.19:0/3435206500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32780b6680 0x7f32780cf1e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f327808d7a0 tx=0x7f327002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.670+0000 7f327fe96640 1 -- 172.21.15.19:0/3435206500 shutdown_connections 2024-09-12T01:56:21.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.670+0000 7f327fe96640 1 --2- 172.21.15.19:0/3435206500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32780b6680 0x7f32780cf1e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.670+0000 7f327fe96640 1 --2- 172.21.15.19:0/3435206500 >> v2:172.21.15.135:3300/0 conn(0x7f3278161c80 0x7f327806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.670+0000 7f327fe96640 1 -- 172.21.15.19:0/3435206500 >> 172.21.15.19:0/3435206500 conn(0x7f32780d44f0 msgr2=0x7f32780d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:21.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.670+0000 7f327fe96640 1 -- 172.21.15.19:0/3435206500 shutdown_connections 2024-09-12T01:56:21.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.670+0000 7f327fe96640 1 -- 172.21.15.19:0/3435206500 wait complete. 2024-09-12T01:56:21.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.671+0000 7f327fe96640 1 Processor -- start 2024-09-12T01:56:21.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.671+0000 7f327fe96640 1 -- start start 2024-09-12T01:56:21.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.672+0000 7f327fe96640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32780b6680 0x7f3278159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.672+0000 7f327fe96640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3278161c80 0x7f32780b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.672+0000 7f327fe96640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3278162060 0x7f32781f3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.672+0000 7f327fe96640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f32780b6b30 con 0x7f3278161c80 2024-09-12T01:56:21.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.672+0000 7f327fe96640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f32780d2aa0 con 0x7f32780b6680 2024-09-12T01:56:21.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.672+0000 7f327fe96640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f32780b6cb0 con 0x7f3278162060 2024-09-12T01:56:21.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.672+0000 7f327d431640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3278161c80 0x7f32780b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.672+0000 7f327d431640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3278161c80 0x7f32780b3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59942/0 (socket says 172.21.15.19:59942) 2024-09-12T01:56:21.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.672+0000 7f327d431640 1 -- 172.21.15.19:0/2612523646 learned_addr learned my addr 172.21.15.19:0/2612523646 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:21.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.672+0000 7f327dc32640 1 --2- 172.21.15.19:0/2612523646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32780b6680 0x7f3278159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.672+0000 7f327e433640 1 --2- 172.21.15.19:0/2612523646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3278162060 0x7f32781f3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.673+0000 7f327d431640 1 -- 172.21.15.19:0/2612523646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3278162060 msgr2=0x7f32781f3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.673+0000 7f327d431640 1 --2- 172.21.15.19:0/2612523646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3278162060 0x7f32781f3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.673+0000 7f327d431640 1 -- 172.21.15.19:0/2612523646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32780b6680 msgr2=0x7f3278159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.673+0000 7f327d431640 1 --2- 172.21.15.19:0/2612523646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32780b6680 0x7f3278159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.673+0000 7f327d431640 1 -- 172.21.15.19:0/2612523646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32780b9ae0 con 0x7f3278161c80 2024-09-12T01:56:21.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.673+0000 7f327d431640 1 --2- 172.21.15.19:0/2612523646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3278161c80 0x7f32780b3460 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f326c00c530 tx=0x7f326c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:21.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.673+0000 7f32767fc640 1 -- 172.21.15.19:0/2612523646 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c017070 con 0x7f3278161c80 2024-09-12T01:56:21.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.673+0000 7f32767fc640 1 -- 172.21.15.19:0/2612523646 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f326c005ce0 con 0x7f3278161c80 2024-09-12T01:56:21.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.673+0000 7f327fe96640 1 -- 172.21.15.19:0/2612523646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32780b39a0 con 0x7f3278161c80 2024-09-12T01:56:21.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.673+0000 7f32767fc640 1 -- 172.21.15.19:0/2612523646 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c007270 con 0x7f3278161c80 2024-09-12T01:56:21.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.673+0000 7f327fe96640 1 -- 172.21.15.19:0/2612523646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32780ba040 con 0x7f3278161c80 2024-09-12T01:56:21.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.674+0000 7f327fe96640 1 -- 172.21.15.19:0/2612523646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f327806e330 con 0x7f3278161c80 2024-09-12T01:56:21.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.675+0000 7f32767fc640 1 -- 172.21.15.19:0/2612523646 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f326c01a070 con 0x7f3278161c80 2024-09-12T01:56:21.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.675+0000 7f32767fc640 1 --2- 172.21.15.19:0/2612523646 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f326406be30 0x7f326406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.675+0000 7f32767fc640 1 -- 172.21.15.19:0/2612523646 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f326c08a3d0 con 0x7f3278161c80 2024-09-12T01:56:21.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.675+0000 7f327dc32640 1 --2- 172.21.15.19:0/2612523646 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f326406be30 0x7f326406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.676+0000 7f327dc32640 1 --2- 172.21.15.19:0/2612523646 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f326406be30 0x7f326406e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3268003b80 tx=0x7f32680098d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:21.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.679+0000 7f32767fc640 1 -- 172.21.15.19:0/2612523646 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32780b9ae0 con 0x7f3278161c80 2024-09-12T01:56:21.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.859+0000 7f327fe96640 1 -- 172.21.15.19:0/2612523646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32781604c0 con 0x7f3278161c80 2024-09-12T01:56:21.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.860+0000 7f32767fc640 1 -- 172.21.15.19:0/2612523646 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18586 (secure 0 0 0) 0x7f327806e870 con 0x7f3278161c80 2024-09-12T01:56:21.860 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:21.860 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:56:01.739727+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:52.899670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:54.099981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:55:57.729901+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.862+0000 7f327fe96640 1 -- 172.21.15.19:0/2612523646 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f326406be30 msgr2=0x7f326406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.862+0000 7f327fe96640 1 --2- 172.21.15.19:0/2612523646 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f326406be30 0x7f326406e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3268003b80 tx=0x7f32680098d0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.862+0000 7f327fe96640 1 -- 172.21.15.19:0/2612523646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3278161c80 msgr2=0x7f32780b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.862+0000 7f327fe96640 1 --2- 172.21.15.19:0/2612523646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3278161c80 0x7f32780b3460 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f326c00c530 tx=0x7f326c00c9f0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.862+0000 7f327fe96640 1 -- 172.21.15.19:0/2612523646 shutdown_connections 2024-09-12T01:56:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.862+0000 7f327fe96640 1 --2- 172.21.15.19:0/2612523646 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f326406be30 0x7f326406e2f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.862+0000 7f327fe96640 1 --2- 172.21.15.19:0/2612523646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3278162060 0x7f32781f3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.862+0000 7f327fe96640 1 --2- 172.21.15.19:0/2612523646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3278161c80 0x7f32780b3460 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.862+0000 7f327fe96640 1 --2- 172.21.15.19:0/2612523646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32780b6680 0x7f3278159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.862+0000 7f327fe96640 1 -- 172.21.15.19:0/2612523646 >> 172.21.15.19:0/2612523646 conn(0x7f32780d44f0 msgr2=0x7f32780b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.862+0000 7f327fe96640 1 -- 172.21.15.19:0/2612523646 shutdown_connections 2024-09-12T01:56:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.862+0000 7f327fe96640 1 -- 172.21.15.19:0/2612523646 wait complete. 2024-09-12T01:56:21.873 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:56:21.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.975+0000 7f65909f1640 1 Processor -- start 2024-09-12T01:56:21.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.975+0000 7f65909f1640 1 -- start start 2024-09-12T01:56:21.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.976+0000 7f65909f1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f658c162060 0x7f658c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.976+0000 7f65909f1640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f658c0b64b0 0x7f658c0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.976+0000 7f65909f1640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f658c06d9f0 con 0x7f658c161c80 2024-09-12T01:56:21.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.976+0000 7f65909f1640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f658c06dcd0 con 0x7f658c162060 2024-09-12T01:56:21.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.976+0000 7f65909f1640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f658c06dfb0 con 0x7f658c0b64b0 2024-09-12T01:56:21.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.976+0000 7f6589d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f658c162060 0x7f658c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.976+0000 7f6589d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f658c162060 0x7f658c0b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59956/0 (socket says 172.21.15.19:59956) 2024-09-12T01:56:21.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.976+0000 7f6589d9b640 1 -- 172.21.15.19:0/2373854391 learned_addr learned my addr 172.21.15.19:0/2373854391 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:21.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.976+0000 7f658ad9d640 1 --2- 172.21.15.19:0/2373854391 >> v2:172.21.15.135:3300/0 conn(0x7f658c0b64b0 0x7f658c0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.976+0000 7f6589d9b640 1 -- 172.21.15.19:0/2373854391 >> v2:172.21.15.135:3300/0 conn(0x7f658c0b64b0 msgr2=0x7f658c0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:21.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.976+0000 7f6589d9b640 1 --2- 172.21.15.19:0/2373854391 >> v2:172.21.15.135:3300/0 conn(0x7f658c0b64b0 0x7f658c0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.976+0000 7f6589d9b640 1 -- 172.21.15.19:0/2373854391 >> v1:172.21.15.135:6789/0 conn(0x7f658c161c80 legacy=0x7f658c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:21.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.976+0000 7f6589d9b640 1 -- 172.21.15.19:0/2373854391 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658c0d01f0 con 0x7f658c162060 2024-09-12T01:56:21.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.976+0000 7f658ad9d640 1 --2- 172.21.15.19:0/2373854391 >> v2:172.21.15.135:3300/0 conn(0x7f658c0b64b0 0x7f658c0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:21.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.977+0000 7f6589d9b640 1 --2- 172.21.15.19:0/2373854391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f658c162060 0x7f658c0b5f70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f658c08d750 tx=0x7f658002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f396422e4d53ccc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:21.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.977+0000 7f658959a640 1 -- 172.21.15.19:0/2373854391 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6580037070 con 0x7f658c162060 2024-09-12T01:56:21.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.977+0000 7f658959a640 1 -- 172.21.15.19:0/2373854391 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6580032440 con 0x7f658c162060 2024-09-12T01:56:21.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.977+0000 7f658959a640 1 -- 172.21.15.19:0/2373854391 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6580032810 con 0x7f658c162060 2024-09-12T01:56:21.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.978+0000 7f65909f1640 1 -- 172.21.15.19:0/2373854391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f658c162060 msgr2=0x7f658c0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.978+0000 7f65909f1640 1 --2- 172.21.15.19:0/2373854391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f658c162060 0x7f658c0b5f70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f658c08d750 tx=0x7f658002a270 comp rx=0 tx=0).stop 2024-09-12T01:56:21.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.978+0000 7f65909f1640 1 -- 172.21.15.19:0/2373854391 shutdown_connections 2024-09-12T01:56:21.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.978+0000 7f65909f1640 1 --2- 172.21.15.19:0/2373854391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f658c162060 0x7f658c0b5f70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.978+0000 7f65909f1640 1 --2- 172.21.15.19:0/2373854391 >> v2:172.21.15.135:3300/0 conn(0x7f658c0b64b0 0x7f658c0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.978+0000 7f65909f1640 1 -- 172.21.15.19:0/2373854391 >> 172.21.15.19:0/2373854391 conn(0x7f658c0d44f0 msgr2=0x7f658c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:21.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.978+0000 7f65909f1640 1 -- 172.21.15.19:0/2373854391 shutdown_connections 2024-09-12T01:56:21.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.978+0000 7f65909f1640 1 -- 172.21.15.19:0/2373854391 wait complete. 2024-09-12T01:56:21.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.979+0000 7f65909f1640 1 Processor -- start 2024-09-12T01:56:21.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.979+0000 7f65909f1640 1 -- start start 2024-09-12T01:56:21.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.980+0000 7f65909f1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f658c0b64b0 0x7f658c0c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.980+0000 7f65909f1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f658c161c80 0x7f658c159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.980+0000 7f65909f1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f658c162060 0x7f658c159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.980+0000 7f65909f1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f658c0cf1e0 con 0x7f658c161c80 2024-09-12T01:56:21.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.980+0000 7f65909f1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f658c0d2aa0 con 0x7f658c162060 2024-09-12T01:56:21.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.980+0000 7f65909f1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f658c0cf360 con 0x7f658c0b64b0 2024-09-12T01:56:21.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.980+0000 7f6589d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f658c161c80 0x7f658c159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.980+0000 7f6589d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f658c161c80 0x7f658c159400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59960/0 (socket says 172.21.15.19:59960) 2024-09-12T01:56:21.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.980+0000 7f6589d9b640 1 -- 172.21.15.19:0/906275585 learned_addr learned my addr 172.21.15.19:0/906275585 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:21.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.980+0000 7f658a59c640 1 --2- 172.21.15.19:0/906275585 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f658c0b64b0 0x7f658c0c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.980+0000 7f658ad9d640 1 --2- 172.21.15.19:0/906275585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f658c162060 0x7f658c159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.980+0000 7f6589d9b640 1 -- 172.21.15.19:0/906275585 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f658c0b64b0 msgr2=0x7f658c0c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.980+0000 7f6589d9b640 1 --2- 172.21.15.19:0/906275585 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f658c0b64b0 0x7f658c0c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.980+0000 7f6589d9b640 1 -- 172.21.15.19:0/906275585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f658c162060 msgr2=0x7f658c159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.980+0000 7f6589d9b640 1 --2- 172.21.15.19:0/906275585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f658c162060 0x7f658c159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.980+0000 7f6589d9b640 1 -- 172.21.15.19:0/906275585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658c0ca580 con 0x7f658c161c80 2024-09-12T01:56:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.980+0000 7f658a59c640 1 --2- 172.21.15.19:0/906275585 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f658c0b64b0 0x7f658c0c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.980+0000 7f6589d9b640 1 --2- 172.21.15.19:0/906275585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f658c161c80 0x7f658c159400 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f658002a2b0 tx=0x7f65800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.981+0000 7f657affd640 1 -- 172.21.15.19:0/906275585 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6580041020 con 0x7f658c161c80 2024-09-12T01:56:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.981+0000 7f657affd640 1 -- 172.21.15.19:0/906275585 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65800306c0 con 0x7f658c161c80 2024-09-12T01:56:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.981+0000 7f65909f1640 1 -- 172.21.15.19:0/906275585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f658c0c9fc0 con 0x7f658c161c80 2024-09-12T01:56:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.981+0000 7f657affd640 1 -- 172.21.15.19:0/906275585 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6580037040 con 0x7f658c161c80 2024-09-12T01:56:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.981+0000 7f65909f1640 1 -- 172.21.15.19:0/906275585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f658c0b74e0 con 0x7f658c161c80 2024-09-12T01:56:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.982+0000 7f65909f1640 1 -- 172.21.15.19:0/906275585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f658c0b5f70 con 0x7f658c161c80 2024-09-12T01:56:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.982+0000 7f657affd640 1 -- 172.21.15.19:0/906275585 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6580044020 con 0x7f658c161c80 2024-09-12T01:56:21.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.983+0000 7f657affd640 1 --2- 172.21.15.19:0/906275585 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f656c06be30 0x7f656c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.983+0000 7f657affd640 1 -- 172.21.15.19:0/906275585 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f65800ab9e0 con 0x7f658c161c80 2024-09-12T01:56:21.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.983+0000 7f658a59c640 1 --2- 172.21.15.19:0/906275585 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f656c06be30 0x7f656c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.983+0000 7f658a59c640 1 --2- 172.21.15.19:0/906275585 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f656c06be30 0x7f656c06e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f658c15fce0 tx=0x7f657c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:21.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:21.987+0000 7f657affd640 1 -- 172.21.15.19:0/906275585 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f658004b030 con 0x7f658c161c80 2024-09-12T01:56:22.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.197+0000 7f65909f1640 1 -- 172.21.15.19:0/906275585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f658c0ba470 con 0x7f658c161c80 2024-09-12T01:56:22.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.198+0000 7f657affd640 1 -- 172.21.15.19:0/906275585 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f658007a050 con 0x7f658c161c80 2024-09-12T01:56:22.198 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:22.198 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"btime":"2024-09-12T01:56:14:778796+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4024559276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":4024559276},{"type":"v1","addr":"172.21.15.135:6837","nonce":4024559276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3369866614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3369866614},{"type":"v1","addr":"172.21.15.19:6834","nonce":3369866614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2476634027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2476634027},{"type":"v1","addr":"172.21.15.19:6835","nonce":2476634027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:55:55.036100+0000","modified":"2024-09-12T01:56:14.133810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/4290669195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4290669195},{"type":"v1","addr":"172.21.15.135:6836","nonce":4290669195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-09-12T01:56:22.199 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2024-09-12T01:56:22.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.200+0000 7f65909f1640 1 -- 172.21.15.19:0/906275585 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f656c06be30 msgr2=0x7f656c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.200+0000 7f65909f1640 1 --2- 172.21.15.19:0/906275585 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f656c06be30 0x7f656c06e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f658c15fce0 tx=0x7f657c009040 comp rx=0 tx=0).stop 2024-09-12T01:56:22.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.200+0000 7f65909f1640 1 -- 172.21.15.19:0/906275585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f658c161c80 msgr2=0x7f658c159400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.200+0000 7f65909f1640 1 --2- 172.21.15.19:0/906275585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f658c161c80 0x7f658c159400 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f658002a2b0 tx=0x7f65800046c0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.200+0000 7f65909f1640 1 -- 172.21.15.19:0/906275585 shutdown_connections 2024-09-12T01:56:22.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.200+0000 7f65909f1640 1 --2- 172.21.15.19:0/906275585 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f656c06be30 0x7f656c06e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.200+0000 7f65909f1640 1 --2- 172.21.15.19:0/906275585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f658c162060 0x7f658c159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.200+0000 7f65909f1640 1 --2- 172.21.15.19:0/906275585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f658c161c80 0x7f658c159400 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.200+0000 7f65909f1640 1 --2- 172.21.15.19:0/906275585 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f658c0b64b0 0x7f658c0c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.200+0000 7f65909f1640 1 -- 172.21.15.19:0/906275585 >> 172.21.15.19:0/906275585 conn(0x7f658c0d44f0 msgr2=0x7f658c0cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:22.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.200+0000 7f65909f1640 1 -- 172.21.15.19:0/906275585 shutdown_connections 2024-09-12T01:56:22.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.200+0000 7f65909f1640 1 -- 172.21.15.19:0/906275585 wait complete. 2024-09-12T01:56:22.613 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:55:55.036100+0000', 'modified': '2024-09-12T01:56:14.133810+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6836/4290669195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 4290669195}, {'type': 'v1', 'addr': '172.21.15.135:6836', 'nonce': 4290669195}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4282, 'qdb_cluster': [4282]} 2024-09-12T01:56:22.614 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:56:22.614 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T01:56:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.719+0000 7fba53bb0640 1 Processor -- start 2024-09-12T01:56:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.719+0000 7fba53bb0640 1 -- start start 2024-09-12T01:56:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.720+0000 7fba53bb0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fba4c145e00 0x7fba4c0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.720+0000 7fba53bb0640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba4c0af720 con 0x7fba4c0d0be0 2024-09-12T01:56:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.720+0000 7fba53bb0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba4c15d8f0 con 0x7fba4c15d460 2024-09-12T01:56:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.720+0000 7fba53bb0640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fba4c1461e0 con 0x7fba4c145e00 2024-09-12T01:56:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.720+0000 7fba5194c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fba4c145e00 0x7fba4c0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.720+0000 7fba5214d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fba4c0d0be0 0x7fba4c0afc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59686/0 (socket says 172.21.15.19:59686) 2024-09-12T01:56:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.720+0000 7fba5214d640 1 -- 172.21.15.19:0/2286791450 learned_addr learned my addr 172.21.15.19:0/2286791450 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.720+0000 7fba5194c640 1 -- 172.21.15.19:0/2286791450 >> v1:172.21.15.135:6789/0 conn(0x7fba4c15d460 legacy=0x7fba4c0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.720+0000 7fba5194c640 1 -- 172.21.15.19:0/2286791450 >> v1:172.21.15.19:6789/0 conn(0x7fba4c0d0be0 legacy=0x7fba4c0afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.720+0000 7fba5194c640 1 -- 172.21.15.19:0/2286791450 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4c0cdf90 con 0x7fba4c145e00 2024-09-12T01:56:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.720+0000 7fba5094a640 1 -- 172.21.15.19:0/2286791450 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 443008656 0 0) 0x7fba4c0af720 con 0x7fba4c0d0be0 2024-09-12T01:56:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.721+0000 7fba5194c640 1 --2- 172.21.15.19:0/2286791450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba4c145e00 0x7fba4c0cd8a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fba480097a0 tx=0x7fba4802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd9d81fa695625 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.721+0000 7fba5094a640 1 -- 172.21.15.19:0/2286791450 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba48037070 con 0x7fba4c145e00 2024-09-12T01:56:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.721+0000 7fba5094a640 1 -- 172.21.15.19:0/2286791450 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba48032440 con 0x7fba4c145e00 2024-09-12T01:56:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.721+0000 7fba5094a640 1 -- 172.21.15.19:0/2286791450 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba48032810 con 0x7fba4c145e00 2024-09-12T01:56:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.722+0000 7fba53bb0640 1 -- 172.21.15.19:0/2286791450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba4c145e00 msgr2=0x7fba4c0cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.722+0000 7fba53bb0640 1 --2- 172.21.15.19:0/2286791450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba4c145e00 0x7fba4c0cd8a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fba480097a0 tx=0x7fba4802a1e0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.722+0000 7fba53bb0640 1 -- 172.21.15.19:0/2286791450 shutdown_connections 2024-09-12T01:56:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.722+0000 7fba53bb0640 1 --2- 172.21.15.19:0/2286791450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba4c145e00 0x7fba4c0cd8a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.722+0000 7fba53bb0640 1 -- 172.21.15.19:0/2286791450 >> 172.21.15.19:0/2286791450 conn(0x7fba4c0b2f40 msgr2=0x7fba4c0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.722+0000 7fba53bb0640 1 -- 172.21.15.19:0/2286791450 shutdown_connections 2024-09-12T01:56:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.722+0000 7fba53bb0640 1 -- 172.21.15.19:0/2286791450 wait complete. 2024-09-12T01:56:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.723+0000 7fba53bb0640 1 Processor -- start 2024-09-12T01:56:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.723+0000 7fba53bb0640 1 -- start start 2024-09-12T01:56:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.724+0000 7fba53bb0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba4c0d0be0 0x7fba4c0b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.724+0000 7fba53bb0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba4c145e00 0x7fba4c1f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.724+0000 7fba53bb0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba4c15d460 0x7fba4c141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.724+0000 7fba53bb0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c0ce830 con 0x7fba4c0d0be0 2024-09-12T01:56:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.724+0000 7fba53bb0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c0ce550 con 0x7fba4c15d460 2024-09-12T01:56:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.724+0000 7fba53bb0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fba4c0cede0 con 0x7fba4c145e00 2024-09-12T01:56:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.724+0000 7fba5194c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba4c0d0be0 0x7fba4c0b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.724+0000 7fba5194c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba4c0d0be0 0x7fba4c0b65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59982/0 (socket says 172.21.15.19:59982) 2024-09-12T01:56:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.724+0000 7fba5194c640 1 -- 172.21.15.19:0/4070614054 learned_addr learned my addr 172.21.15.19:0/4070614054 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.724+0000 7fba5114b640 1 --2- 172.21.15.19:0/4070614054 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba4c145e00 0x7fba4c1f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.724+0000 7fba5214d640 1 --2- 172.21.15.19:0/4070614054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba4c15d460 0x7fba4c141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.724+0000 7fba5194c640 1 -- 172.21.15.19:0/4070614054 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba4c145e00 msgr2=0x7fba4c1f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.724+0000 7fba5194c640 1 --2- 172.21.15.19:0/4070614054 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba4c145e00 0x7fba4c1f25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.724+0000 7fba5194c640 1 -- 172.21.15.19:0/4070614054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba4c15d460 msgr2=0x7fba4c141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.724+0000 7fba5194c640 1 --2- 172.21.15.19:0/4070614054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba4c15d460 0x7fba4c141ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.724+0000 7fba5194c640 1 -- 172.21.15.19:0/4070614054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4c1f2af0 con 0x7fba4c0d0be0 2024-09-12T01:56:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.724+0000 7fba5214d640 1 --2- 172.21.15.19:0/4070614054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba4c15d460 0x7fba4c141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.724+0000 7fba5194c640 1 --2- 172.21.15.19:0/4070614054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba4c0d0be0 0x7fba4c0b65d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fba480097a0 tx=0x7fba480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.725+0000 7fba427fc640 1 -- 172.21.15.19:0/4070614054 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba48037040 con 0x7fba4c0d0be0 2024-09-12T01:56:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.725+0000 7fba427fc640 1 -- 172.21.15.19:0/4070614054 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba48004250 con 0x7fba4c0d0be0 2024-09-12T01:56:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.725+0000 7fba427fc640 1 -- 172.21.15.19:0/4070614054 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba48032e20 con 0x7fba4c0d0be0 2024-09-12T01:56:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.725+0000 7fba53bb0640 1 -- 172.21.15.19:0/4070614054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba4c1f2da0 con 0x7fba4c0d0be0 2024-09-12T01:56:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.725+0000 7fba53bb0640 1 -- 172.21.15.19:0/4070614054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba4c1f3360 con 0x7fba4c0d0be0 2024-09-12T01:56:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.726+0000 7fba427fc640 1 -- 172.21.15.19:0/4070614054 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba48030770 con 0x7fba4c0d0be0 2024-09-12T01:56:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.727+0000 7fba427fc640 1 --2- 172.21.15.19:0/4070614054 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fba3006be30 0x7fba3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.727+0000 7fba427fc640 1 -- 172.21.15.19:0/4070614054 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fba480ac430 con 0x7fba4c0d0be0 2024-09-12T01:56:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.727+0000 7fba5114b640 1 --2- 172.21.15.19:0/4070614054 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fba3006be30 0x7fba3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.728+0000 7fba5114b640 1 --2- 172.21.15.19:0/4070614054 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fba3006be30 0x7fba3006e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fba4c1f5b30 tx=0x7fba3c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:22.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.728+0000 7fba56a25740 1 Processor -- start 2024-09-12T01:56:22.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.728+0000 7fba56a25740 1 -- start start 2024-09-12T01:56:22.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba56a25740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752832c0 0x55aa752c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba56a25740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75280a80 0x55aa752836a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba56a25740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa75284a50 0x55aa7527d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba56a25740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55aa751e5520 con 0x55aa752832c0 2024-09-12T01:56:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba56a25740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55aa7518d3e0 con 0x55aa75280a80 2024-09-12T01:56:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba56a25740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55aa751e14e0 con 0x55aa75284a50 2024-09-12T01:56:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba5194c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752832c0 0x55aa752c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba5194c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752832c0 0x55aa752c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59992/0 (socket says 172.21.15.19:59992) 2024-09-12T01:56:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba5194c640 1 -- 172.21.15.19:0/180988086 learned_addr learned my addr 172.21.15.19:0/180988086 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba5214d640 1 --2- 172.21.15.19:0/180988086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa75284a50 0x55aa7527d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba5114b640 1 --2- 172.21.15.19:0/180988086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75280a80 0x55aa752836a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba5194c640 1 -- 172.21.15.19:0/180988086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa75284a50 msgr2=0x55aa7527d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba5194c640 1 --2- 172.21.15.19:0/180988086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa75284a50 0x55aa7527d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba5194c640 1 -- 172.21.15.19:0/180988086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75280a80 msgr2=0x55aa752836a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba5194c640 1 --2- 172.21.15.19:0/180988086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75280a80 0x55aa752836a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba5194c640 1 -- 172.21.15.19:0/180988086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa751a82f0 con 0x55aa752832c0 2024-09-12T01:56:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba5214d640 1 --2- 172.21.15.19:0/180988086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa75284a50 0x55aa7527d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba5194c640 1 --2- 172.21.15.19:0/180988086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752832c0 0x55aa752c8a60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fba480aa620 tx=0x7fba48076920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1fee2ebe1cf1ffd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba2f7fe640 1 -- 172.21.15.19:0/180988086 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba48083130 con 0x55aa752832c0 2024-09-12T01:56:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba2f7fe640 1 -- 172.21.15.19:0/180988086 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba48078850 con 0x55aa752832c0 2024-09-12T01:56:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.729+0000 7fba2f7fe640 1 -- 172.21.15.19:0/180988086 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba480ac0d0 con 0x55aa752832c0 2024-09-12T01:56:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.730+0000 7fba56a25740 1 -- 172.21.15.19:0/180988086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752832c0 msgr2=0x55aa752c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.730+0000 7fba56a25740 1 --2- 172.21.15.19:0/180988086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752832c0 0x55aa752c8a60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fba480aa620 tx=0x7fba48076920 comp rx=0 tx=0).stop 2024-09-12T01:56:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.730+0000 7fba56a25740 1 -- 172.21.15.19:0/180988086 shutdown_connections 2024-09-12T01:56:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.730+0000 7fba56a25740 1 --2- 172.21.15.19:0/180988086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa75284a50 0x55aa7527d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.730+0000 7fba56a25740 1 --2- 172.21.15.19:0/180988086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75280a80 0x55aa752836a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.730+0000 7fba56a25740 1 --2- 172.21.15.19:0/180988086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752832c0 0x55aa752c8a60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.730+0000 7fba56a25740 1 -- 172.21.15.19:0/180988086 >> 172.21.15.19:0/180988086 conn(0x55aa7527fa80 msgr2=0x55aa752c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.730+0000 7fba56a25740 1 -- 172.21.15.19:0/180988086 shutdown_connections 2024-09-12T01:56:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.730+0000 7fba56a25740 1 -- 172.21.15.19:0/180988086 wait complete. 2024-09-12T01:56:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.731+0000 7fba56a25740 1 -- start start 2024-09-12T01:56:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.731+0000 7fba56a25740 1 Processor -- start 2024-09-12T01:56:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba56a25740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa752832c0 0x55aa7529c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba56a25740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa75284a50 0x55aa752b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba56a25740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa752b2ca0 0x55aa752ac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba56a25740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55aa751e5520 con 0x55aa75284a50 2024-09-12T01:56:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba56a25740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55aa7516e450 con 0x55aa752832c0 2024-09-12T01:56:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba56a25740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55aa7527ef20 con 0x55aa752b2ca0 2024-09-12T01:56:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba56a25740 10 client.0 _ll_register_callbacks cb 0x55aa74ef7ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:56:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba5114b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa75284a50 0x55aa752b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba5114b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa75284a50 0x55aa752b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59996/0 (socket says 172.21.15.19:59996) 2024-09-12T01:56:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba5114b640 1 -- 172.21.15.19:0/2652237838 learned_addr learned my addr 172.21.15.19:0/2652237838 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba5194c640 1 --2- 172.21.15.19:0/2652237838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa752832c0 0x55aa7529c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba5214d640 1 --2- 172.21.15.19:0/2652237838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa752b2ca0 0x55aa752ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba5114b640 1 -- 172.21.15.19:0/2652237838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa752b2ca0 msgr2=0x55aa752ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba5114b640 1 --2- 172.21.15.19:0/2652237838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa752b2ca0 0x55aa752ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba5114b640 1 -- 172.21.15.19:0/2652237838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa752832c0 msgr2=0x55aa7529c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba5114b640 1 --2- 172.21.15.19:0/2652237838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa752832c0 0x55aa7529c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba5114b640 1 -- 172.21.15.19:0/2652237838 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa74ef82d0 con 0x55aa75284a50 2024-09-12T01:56:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba5214d640 1 --2- 172.21.15.19:0/2652237838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa752b2ca0 0x55aa752ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba5114b640 1 --2- 172.21.15.19:0/2652237838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa75284a50 0x55aa752b2760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00ddc0 tx=0x7fba3c003760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1854389a218393d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.732+0000 7fba2cff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:56:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.733+0000 7fba2cff9640 1 -- 172.21.15.19:0/2652237838 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c024030 con 0x55aa75284a50 2024-09-12T01:56:22.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.733+0000 7fba2cff9640 1 -- 172.21.15.19:0/2652237838 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fba3c01d040 con 0x55aa75284a50 2024-09-12T01:56:22.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.733+0000 7fba56a25740 1 -- 172.21.15.19:0/2652237838 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba48078850 con 0x55aa75284a50 2024-09-12T01:56:22.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.733+0000 7fba2cff9640 1 -- 172.21.15.19:0/2652237838 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fba3c02d050 con 0x55aa75284a50 2024-09-12T01:56:22.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.733+0000 7fba56a25740 10 client.4677 fetch_fsmap learned FSMap version 8 2024-09-12T01:56:22.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.733+0000 7fba56a25740 1 -- 172.21.15.19:0/2652237838 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55aa74fc26b0 con 0x55aa75284a50 2024-09-12T01:56:22.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.733+0000 7fba2cff9640 1 -- 172.21.15.19:0/2652237838 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba48078850 con 0x55aa75284a50 2024-09-12T01:56:22.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.733+0000 7fba2cff9640 1 -- 172.21.15.19:0/2652237838 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7fba3c030020 con 0x55aa75284a50 2024-09-12T01:56:22.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.733+0000 7fba56a25740 10 client.4677 fetch_fsmap finished waiting for FSMap version 8 2024-09-12T01:56:22.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.733+0000 7fba56a25740 10 client.4677 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T01:56:22.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.733+0000 7fba56a25740 20 client.4677 populate_metadata read hostname 'smithi019' 2024-09-12T01:56:22.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.733+0000 7fba56a25740 1 --2- 172.21.15.19:0/2652237838 >> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] conn(0x55aa7529e420 0x55aa752c26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.733+0000 7fba56a25740 4 client.4677 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:56:22.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.733+0000 7fba56a25740 1 -- 172.21.15.19:0/2652237838 --> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa751f2c50 con 0x55aa7529e420 2024-09-12T01:56:22.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.733+0000 7fba5194c640 1 --2- 172.21.15.19:0/2652237838 >> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] conn(0x55aa7529e420 0x55aa752c26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.734+0000 7fba2cff9640 10 client.4677 ms_handle_connect on v2:172.21.15.135:6834/4290669195 2024-09-12T01:56:22.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.734+0000 7fba5194c640 1 --2- 172.21.15.19:0/2652237838 >> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] conn(0x55aa7529e420 0x55aa752c26d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a19632649136b17d server_cookie=83731759e43b68b in_seq=0 out_seq=0 2024-09-12T01:56:22.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.735+0000 7fba2cff9640 1 -- 172.21.15.19:0/2652237838 <== mds.0 v2:172.21.15.135:6834/4290669195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aa751f2c50 con 0x55aa7529e420 2024-09-12T01:56:22.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.735+0000 7fba2cff9640 10 client.4677 handle_command_reply: tid=0 2024-09-12T01:56:22.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.735+0000 7fba56a25740 1 client.4677 shutdown 2024-09-12T01:56:22.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.735+0000 7fba56a25740 1 -- 172.21.15.19:0/2652237838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa75284a50 msgr2=0x55aa752b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.735+0000 7fba56a25740 1 --2- 172.21.15.19:0/2652237838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa75284a50 0x55aa752b2760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00ddc0 tx=0x7fba3c003760 comp rx=0 tx=0).stop 2024-09-12T01:56:22.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.735+0000 7fba56a25740 1 -- 172.21.15.19:0/2652237838 shutdown_connections 2024-09-12T01:56:22.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.735+0000 7fba56a25740 1 --2- 172.21.15.19:0/2652237838 >> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] conn(0x55aa7529e420 0x55aa752c26d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.735+0000 7fba56a25740 1 --2- 172.21.15.19:0/2652237838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa752b2ca0 0x55aa752ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.735+0000 7fba56a25740 1 --2- 172.21.15.19:0/2652237838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa75284a50 0x55aa752b2760 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.735+0000 7fba2cff9640 0 client.4677 ms_handle_reset on v2:172.21.15.135:6834/4290669195 2024-09-12T01:56:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.735+0000 7fba56a25740 1 --2- 172.21.15.19:0/2652237838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa752832c0 0x55aa7529c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.735+0000 7fba56a25740 1 -- 172.21.15.19:0/2652237838 >> 172.21.15.19:0/2652237838 conn(0x55aa75280a80 msgr2=0x55aa752c5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.735+0000 7fba56a25740 1 -- 172.21.15.19:0/2652237838 shutdown_connections 2024-09-12T01:56:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.735+0000 7fba56a25740 1 -- 172.21.15.19:0/2652237838 wait complete. 2024-09-12T01:56:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.735+0000 7fba56a25740 20 client.4677 trim_cache size 0 max 16384 2024-09-12T01:56:22.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.753+0000 7fba56a25740 1 Processor -- start 2024-09-12T01:56:22.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.753+0000 7fba56a25740 1 -- start start 2024-09-12T01:56:22.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.754+0000 7fba56a25740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752832c0 0x55aa75282790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.754+0000 7fba56a25740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa75284a50 0x55aa752b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.754+0000 7fba56a25740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa752b2ca0 0x55aa752c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.754+0000 7fba56a25740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c1fce70 con 0x55aa752832c0 2024-09-12T01:56:22.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.754+0000 7fba56a25740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c070fe0 con 0x55aa752b2ca0 2024-09-12T01:56:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.754+0000 7fba56a25740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fba4c1fc880 con 0x55aa75284a50 2024-09-12T01:56:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.754+0000 7fba5194c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752832c0 0x55aa75282790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.754+0000 7fba5194c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752832c0 0x55aa75282790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60004/0 (socket says 172.21.15.19:60004) 2024-09-12T01:56:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.754+0000 7fba5194c640 1 -- 172.21.15.19:0/161073660 learned_addr learned my addr 172.21.15.19:0/161073660 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.754+0000 7fba5194c640 1 -- 172.21.15.19:0/161073660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa75284a50 msgr2=0x55aa752b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:22.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.754+0000 7fba5194c640 1 --2- 172.21.15.19:0/161073660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa75284a50 0x55aa752b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.754+0000 7fba5194c640 1 -- 172.21.15.19:0/161073660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa752b2ca0 msgr2=0x55aa752c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:22.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.754+0000 7fba5194c640 1 --2- 172.21.15.19:0/161073660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa752b2ca0 0x55aa752c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.754+0000 7fba5194c640 1 -- 172.21.15.19:0/161073660 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa752deeb0 con 0x55aa752832c0 2024-09-12T01:56:22.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.755+0000 7fba5194c640 1 --2- 172.21.15.19:0/161073660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752832c0 0x55aa75282790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fba4807a200 tx=0x7fba4807d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e418e0deaa4697ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:22.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.755+0000 7fba2effd640 1 -- 172.21.15.19:0/161073660 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba48078850 con 0x55aa752832c0 2024-09-12T01:56:22.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.755+0000 7fba2effd640 1 -- 172.21.15.19:0/161073660 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba48076bc0 con 0x55aa752832c0 2024-09-12T01:56:22.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.755+0000 7fba2effd640 1 -- 172.21.15.19:0/161073660 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4807a7b0 con 0x55aa752832c0 2024-09-12T01:56:22.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.755+0000 7fba56a25740 1 -- 172.21.15.19:0/161073660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752832c0 msgr2=0x55aa75282790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.755+0000 7fba56a25740 1 --2- 172.21.15.19:0/161073660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752832c0 0x55aa75282790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fba4807a200 tx=0x7fba4807d000 comp rx=0 tx=0).stop 2024-09-12T01:56:22.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.755+0000 7fba56a25740 1 -- 172.21.15.19:0/161073660 shutdown_connections 2024-09-12T01:56:22.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.755+0000 7fba56a25740 1 --2- 172.21.15.19:0/161073660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa752b2ca0 0x55aa752c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.755+0000 7fba56a25740 1 --2- 172.21.15.19:0/161073660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa75284a50 0x55aa752b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.755+0000 7fba56a25740 1 --2- 172.21.15.19:0/161073660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752832c0 0x55aa75282790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.755+0000 7fba56a25740 1 -- 172.21.15.19:0/161073660 >> 172.21.15.19:0/161073660 conn(0x55aa75280a80 msgr2=0x55aa752de600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:22.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.755+0000 7fba56a25740 1 -- 172.21.15.19:0/161073660 shutdown_connections 2024-09-12T01:56:22.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.755+0000 7fba56a25740 1 -- 172.21.15.19:0/161073660 wait complete. 2024-09-12T01:56:22.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.756+0000 7fba56a25740 1 -- start start 2024-09-12T01:56:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.756+0000 7fba56a25740 1 Processor -- start 2024-09-12T01:56:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba56a25740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa752832c0 0x55aa7534d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba56a25740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa75284a50 0x55aa752812d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba56a25740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752b2ca0 0x55aa75281810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba56a25740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55aa7529d0f0 con 0x55aa752b2ca0 2024-09-12T01:56:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba56a25740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55aa752c36e0 con 0x55aa752832c0 2024-09-12T01:56:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba56a25740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55aa7529e8a0 con 0x55aa75284a50 2024-09-12T01:56:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba56a25740 10 client.0 _ll_register_callbacks cb 0x7fba3c00d580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:56:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba5214d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752b2ca0 0x55aa75281810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba5214d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752b2ca0 0x55aa75281810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60006/0 (socket says 172.21.15.19:60006) 2024-09-12T01:56:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba5214d640 1 -- 172.21.15.19:0/1139013850 learned_addr learned my addr 172.21.15.19:0/1139013850 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba5214d640 1 -- 172.21.15.19:0/1139013850 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa75284a50 msgr2=0x55aa752812d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba5214d640 1 --2- 172.21.15.19:0/1139013850 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa75284a50 0x55aa752812d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba5214d640 1 -- 172.21.15.19:0/1139013850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa752832c0 msgr2=0x55aa7534d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba5194c640 1 --2- 172.21.15.19:0/1139013850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa752832c0 0x55aa7534d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba5214d640 1 --2- 172.21.15.19:0/1139013850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa752832c0 0x55aa7534d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba5214d640 1 -- 172.21.15.19:0/1139013850 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa752cbb70 con 0x55aa752b2ca0 2024-09-12T01:56:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba5214d640 1 --2- 172.21.15.19:0/1139013850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752b2ca0 0x55aa75281810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fba44010890 tx=0x7fba44010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ec17b966658feb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba2cff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:56:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba2cff9640 1 -- 172.21.15.19:0/1139013850 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44018020 con 0x55aa752b2ca0 2024-09-12T01:56:22.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.757+0000 7fba2cff9640 1 -- 172.21.15.19:0/1139013850 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fba4400ebb0 con 0x55aa752b2ca0 2024-09-12T01:56:22.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.758+0000 7fba56a25740 1 -- 172.21.15.19:0/1139013850 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba48076bc0 con 0x55aa752b2ca0 2024-09-12T01:56:22.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.758+0000 7fba2cff9640 1 -- 172.21.15.19:0/1139013850 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fba44022050 con 0x55aa752b2ca0 2024-09-12T01:56:22.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.758+0000 7fba56a25740 10 client.4683 fetch_fsmap learned FSMap version 8 2024-09-12T01:56:22.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.758+0000 7fba56a25740 1 -- 172.21.15.19:0/1139013850 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55aa752c9a90 con 0x55aa752b2ca0 2024-09-12T01:56:22.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.758+0000 7fba2cff9640 1 -- 172.21.15.19:0/1139013850 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba48076bc0 con 0x55aa752b2ca0 2024-09-12T01:56:22.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.758+0000 7fba2cff9640 1 -- 172.21.15.19:0/1139013850 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7fba44025020 con 0x55aa752b2ca0 2024-09-12T01:56:22.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.758+0000 7fba56a25740 10 client.4683 fetch_fsmap finished waiting for FSMap version 8 2024-09-12T01:56:22.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.758+0000 7fba56a25740 10 client.4683 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T01:56:22.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.758+0000 7fba56a25740 20 client.4683 populate_metadata read hostname 'smithi019' 2024-09-12T01:56:22.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.758+0000 7fba56a25740 1 --2- 172.21.15.19:0/1139013850 >> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] conn(0x55aa752a9fe0 0x55aa7529b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.758+0000 7fba56a25740 4 client.4683 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:56:22.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.758+0000 7fba56a25740 1 -- 172.21.15.19:0/1139013850 --> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] -- command(tid 0: {"prefix": "status"}) -- 0x55aa751ecfa0 con 0x55aa752a9fe0 2024-09-12T01:56:22.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.758+0000 7fba5194c640 1 --2- 172.21.15.19:0/1139013850 >> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] conn(0x55aa752a9fe0 0x55aa7529b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.759+0000 7fba5194c640 1 --2- 172.21.15.19:0/1139013850 >> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] conn(0x55aa752a9fe0 0x55aa7529b050 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f28effc3ca3b0599 server_cookie=f458fb13aa375ae9 in_seq=0 out_seq=0 2024-09-12T01:56:22.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.759+0000 7fba2cff9640 10 client.4683 ms_handle_connect on v2:172.21.15.135:6834/4290669195 2024-09-12T01:56:22.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.759+0000 7fba2cff9640 1 -- 172.21.15.19:0/1139013850 <== mds.0 v2:172.21.15.135:6834/4290669195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55aa751ecfa0 con 0x55aa752a9fe0 2024-09-12T01:56:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.759+0000 7fba2cff9640 10 client.4683 handle_command_reply: tid=0 2024-09-12T01:56:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.759+0000 7fba56a25740 1 client.4683 shutdown 2024-09-12T01:56:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.759+0000 7fba56a25740 1 -- 172.21.15.19:0/1139013850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752b2ca0 msgr2=0x55aa75281810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.759+0000 7fba56a25740 1 --2- 172.21.15.19:0/1139013850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752b2ca0 0x55aa75281810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fba44010890 tx=0x7fba44010d50 comp rx=0 tx=0).stop 2024-09-12T01:56:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.759+0000 7fba56a25740 1 -- 172.21.15.19:0/1139013850 shutdown_connections 2024-09-12T01:56:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.759+0000 7fba56a25740 1 --2- 172.21.15.19:0/1139013850 >> [v2:172.21.15.135:6834/4290669195,v1:172.21.15.135:6836/4290669195] conn(0x55aa752a9fe0 0x55aa7529b050 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.759+0000 7fba56a25740 1 --2- 172.21.15.19:0/1139013850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aa752b2ca0 0x55aa75281810 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.759+0000 7fba56a25740 1 --2- 172.21.15.19:0/1139013850 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa75284a50 0x55aa752812d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.759+0000 7fba2cff9640 0 client.4683 ms_handle_reset on v2:172.21.15.135:6834/4290669195 2024-09-12T01:56:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.759+0000 7fba56a25740 1 --2- 172.21.15.19:0/1139013850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa752832c0 0x55aa7534d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.759+0000 7fba56a25740 1 -- 172.21.15.19:0/1139013850 >> 172.21.15.19:0/1139013850 conn(0x55aa75280a80 msgr2=0x55aa752c80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.759+0000 7fba56a25740 1 -- 172.21.15.19:0/1139013850 shutdown_connections 2024-09-12T01:56:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.759+0000 7fba56a25740 1 -- 172.21.15.19:0/1139013850 wait complete. 2024-09-12T01:56:22.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.759+0000 7fba56a25740 20 client.4683 trim_cache size 0 max 16384 2024-09-12T01:56:22.775 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:56:22.775 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T01:56:22.775 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T01:56:22.775 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4282, 2024-09-12T01:56:22.775 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T01:56:22.775 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T01:56:22.775 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T01:56:22.775 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 27.086704264000002, 2024-09-12T01:56:22.775 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 8, 2024-09-12T01:56:22.776 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 27, 2024-09-12T01:56:22.776 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 27, 2024-09-12T01:56:22.776 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 33.103410658000001 2024-09-12T01:56:22.776 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:56:22.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.760+0000 7fba53bb0640 1 -- 172.21.15.19:0/4070614054 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fba3006be30 msgr2=0x7fba3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.760+0000 7fba53bb0640 1 --2- 172.21.15.19:0/4070614054 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fba3006be30 0x7fba3006e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fba4c1f5b30 tx=0x7fba3c009040 comp rx=0 tx=0).stop 2024-09-12T01:56:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.760+0000 7fba53bb0640 1 -- 172.21.15.19:0/4070614054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba4c0d0be0 msgr2=0x7fba4c0b65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.760+0000 7fba53bb0640 1 --2- 172.21.15.19:0/4070614054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba4c0d0be0 0x7fba4c0b65d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fba480097a0 tx=0x7fba480046c0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.760+0000 7fba53bb0640 1 -- 172.21.15.19:0/4070614054 shutdown_connections 2024-09-12T01:56:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.760+0000 7fba53bb0640 1 --2- 172.21.15.19:0/4070614054 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fba3006be30 0x7fba3006e2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.760+0000 7fba53bb0640 1 --2- 172.21.15.19:0/4070614054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba4c15d460 0x7fba4c141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.760+0000 7fba53bb0640 1 --2- 172.21.15.19:0/4070614054 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba4c145e00 0x7fba4c1f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.760+0000 7fba53bb0640 1 --2- 172.21.15.19:0/4070614054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba4c0d0be0 0x7fba4c0b65d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.760+0000 7fba53bb0640 1 -- 172.21.15.19:0/4070614054 >> 172.21.15.19:0/4070614054 conn(0x7fba4c0b2f40 msgr2=0x7fba4c156600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.760+0000 7fba53bb0640 1 -- 172.21.15.19:0/4070614054 shutdown_connections 2024-09-12T01:56:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:22.760+0000 7fba53bb0640 1 -- 172.21.15.19:0/4070614054 wait complete. 2024-09-12T01:56:22.779 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T01:56:22.789 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T01:56:22.789 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T01:56:22.789 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T01:56:22.789 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T01:56:22.833 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T01:56:22.833 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-12T01:56:22.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:22.833 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T01:56:22.849 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-12T01:56:22.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:22.850 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T01:56:22.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:22.917 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-09-12T01:56:23.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:23.026 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T01:56:23.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:23.043 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-09-12T01:56:23.111 INFO:teuthology.orchestra.run.smithi019.stderr:Cannot find device "ceph-brx" 2024-09-12T01:56:23.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:56:23.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:23.113 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-09-12T01:56:23.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:23.133 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-09-12T01:56:23.205 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2024-09-12T01:56:23.206 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:56:23.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:23.207 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-09-12T01:56:23.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:23.270 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-09-12T01:56:23.339 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2024-09-12T01:56:23.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:56:23.341 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-12T01:56:23.341 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T01:56:23.341 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:56:23.341 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:56:23.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.444+0000 7f2903b5f640 1 Processor -- start 2024-09-12T01:56:23.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.444+0000 7f2903b5f640 1 -- start start 2024-09-12T01:56:23.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.445+0000 7f2903b5f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28fc072320 0x7f28fc0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:23.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.445+0000 7f2903b5f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f28fc072de0 0x7f28fc06e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:23.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.445+0000 7f2903b5f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28fc146140 con 0x7f28fc072700 2024-09-12T01:56:23.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.445+0000 7f2903b5f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f28fc0cd740 con 0x7f28fc072de0 2024-09-12T01:56:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.445+0000 7f2903b5f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f28fc0cda20 con 0x7f28fc072320 2024-09-12T01:56:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.445+0000 7f29020fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f28fc072700 0x7f28fc06e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59700/0 (socket says 172.21.15.19:59700) 2024-09-12T01:56:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.445+0000 7f29020fc640 1 -- 172.21.15.19:0/447590749 learned_addr learned my addr 172.21.15.19:0/447590749 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.445+0000 7f29010fa640 1 --2- 172.21.15.19:0/447590749 >> v2:172.21.15.135:3300/0 conn(0x7f28fc072de0 0x7f28fc06e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.445+0000 7f29018fb640 1 --2- 172.21.15.19:0/447590749 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28fc072320 0x7f28fc0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.445+0000 7f29008f9640 1 -- 172.21.15.19:0/447590749 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1131047334 0 0) 0x7f28fc146140 con 0x7f28fc072700 2024-09-12T01:56:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.445+0000 7f29008f9640 1 -- 172.21.15.19:0/447590749 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28e4003520 con 0x7f28fc072700 2024-09-12T01:56:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.446+0000 7f29010fa640 1 -- 172.21.15.19:0/447590749 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28fc072320 msgr2=0x7f28fc0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.446+0000 7f29010fa640 1 --2- 172.21.15.19:0/447590749 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28fc072320 0x7f28fc0cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.446+0000 7f29010fa640 1 -- 172.21.15.19:0/447590749 >> v1:172.21.15.19:6789/0 conn(0x7f28fc072700 legacy=0x7f28fc06e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.446+0000 7f29008f9640 1 -- 172.21.15.19:0/447590749 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2353980463 0 0) 0x7f28e4003520 con 0x7f28fc072700 2024-09-12T01:56:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.446+0000 7f29010fa640 1 -- 172.21.15.19:0/447590749 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28fc0cdd00 con 0x7f28fc072de0 2024-09-12T01:56:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.446+0000 7f29018fb640 1 --2- 172.21.15.19:0/447590749 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28fc072320 0x7f28fc0cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:23.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.447+0000 7f29010fa640 1 --2- 172.21.15.19:0/447590749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28fc072de0 0x7f28fc06e0b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f28f00097a0 tx=0x7f28f002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2bb7557173e34ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:23.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.447+0000 7f29008f9640 1 -- 172.21.15.19:0/447590749 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0037070 con 0x7f28fc072de0 2024-09-12T01:56:23.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.447+0000 7f29008f9640 1 -- 172.21.15.19:0/447590749 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f002ab10 con 0x7f28fc072de0 2024-09-12T01:56:23.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.447+0000 7f29008f9640 1 -- 172.21.15.19:0/447590749 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ec0019f0 con 0x7f28fc072de0 2024-09-12T01:56:23.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.447+0000 7f2903b5f640 1 -- 172.21.15.19:0/447590749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28fc072de0 msgr2=0x7f28fc06e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:23.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.447+0000 7f2903b5f640 1 --2- 172.21.15.19:0/447590749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28fc072de0 0x7f28fc06e0b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f28f00097a0 tx=0x7f28f002a080 comp rx=0 tx=0).stop 2024-09-12T01:56:23.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.447+0000 7f2903b5f640 1 -- 172.21.15.19:0/447590749 shutdown_connections 2024-09-12T01:56:23.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.447+0000 7f2903b5f640 1 --2- 172.21.15.19:0/447590749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28fc072de0 0x7f28fc06e0b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:23.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.447+0000 7f2903b5f640 1 --2- 172.21.15.19:0/447590749 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28fc072320 0x7f28fc0cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:23.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.447+0000 7f2903b5f640 1 -- 172.21.15.19:0/447590749 >> 172.21.15.19:0/447590749 conn(0x7f28fc067d70 msgr2=0x7f28fc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:23.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.447+0000 7f2903b5f640 1 -- 172.21.15.19:0/447590749 shutdown_connections 2024-09-12T01:56:23.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.447+0000 7f2903b5f640 1 -- 172.21.15.19:0/447590749 wait complete. 2024-09-12T01:56:23.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.449+0000 7f2903b5f640 1 Processor -- start 2024-09-12T01:56:23.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.449+0000 7f2903b5f640 1 -- start start 2024-09-12T01:56:23.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.449+0000 7f2903b5f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28fc072320 0x7f28fc0b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:23.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.449+0000 7f2903b5f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28fc072700 0x7f28fc133710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:23.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.449+0000 7f2903b5f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28fc072de0 0x7f28fc0caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:23.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.449+0000 7f2903b5f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f28fc0cd520 con 0x7f28fc072de0 2024-09-12T01:56:23.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.449+0000 7f2903b5f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f28fc0cd3a0 con 0x7f28fc072700 2024-09-12T01:56:23.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.449+0000 7f2903b5f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f28fc06ed00 con 0x7f28fc072320 2024-09-12T01:56:23.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.450+0000 7f29020fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28fc072de0 0x7f28fc0caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:23.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.450+0000 7f29020fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28fc072de0 0x7f28fc0caf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60012/0 (socket says 172.21.15.19:60012) 2024-09-12T01:56:23.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.450+0000 7f29020fc640 1 -- 172.21.15.19:0/3288198486 learned_addr learned my addr 172.21.15.19:0/3288198486 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:23.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.450+0000 7f29018fb640 1 --2- 172.21.15.19:0/3288198486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28fc072320 0x7f28fc0b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:23.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.450+0000 7f29010fa640 1 --2- 172.21.15.19:0/3288198486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28fc072700 0x7f28fc133710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:23.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.450+0000 7f29020fc640 1 -- 172.21.15.19:0/3288198486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28fc072320 msgr2=0x7f28fc0b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:23.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.450+0000 7f29020fc640 1 --2- 172.21.15.19:0/3288198486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28fc072320 0x7f28fc0b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:23.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.450+0000 7f29020fc640 1 -- 172.21.15.19:0/3288198486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28fc072700 msgr2=0x7f28fc133710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:23.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.450+0000 7f29020fc640 1 --2- 172.21.15.19:0/3288198486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28fc072700 0x7f28fc133710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:23.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.450+0000 7f29020fc640 1 -- 172.21.15.19:0/3288198486 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28fc1e3c70 con 0x7f28fc072de0 2024-09-12T01:56:23.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.450+0000 7f29020fc640 1 --2- 172.21.15.19:0/3288198486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28fc072de0 0x7f28fc0caf60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00cc70 tx=0x7f28ec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:23.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.450+0000 7f28fa7fc640 1 -- 172.21.15.19:0/3288198486 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ec017070 con 0x7f28fc072de0 2024-09-12T01:56:23.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.450+0000 7f28fa7fc640 1 -- 172.21.15.19:0/3288198486 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28ec012400 con 0x7f28fc072de0 2024-09-12T01:56:23.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.450+0000 7f2903b5f640 1 -- 172.21.15.19:0/3288198486 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28fc1e3f50 con 0x7f28fc072de0 2024-09-12T01:56:23.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.450+0000 7f28fa7fc640 1 -- 172.21.15.19:0/3288198486 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ec012830 con 0x7f28fc072de0 2024-09-12T01:56:23.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.450+0000 7f2903b5f640 1 -- 172.21.15.19:0/3288198486 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28fc1e4510 con 0x7f28fc072de0 2024-09-12T01:56:23.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.451+0000 7f2903b5f640 1 -- 172.21.15.19:0/3288198486 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28fc0cce60 con 0x7f28fc072de0 2024-09-12T01:56:23.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.452+0000 7f28fa7fc640 1 -- 172.21.15.19:0/3288198486 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28ec01a070 con 0x7f28fc072de0 2024-09-12T01:56:23.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.452+0000 7f28fa7fc640 1 --2- 172.21.15.19:0/3288198486 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f28e806be60 0x7f28e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:23.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.452+0000 7f28fa7fc640 1 -- 172.21.15.19:0/3288198486 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f28ec08b250 con 0x7f28fc072de0 2024-09-12T01:56:23.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.452+0000 7f29018fb640 1 --2- 172.21.15.19:0/3288198486 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f28e806be60 0x7f28e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:23.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.453+0000 7f29018fb640 1 --2- 172.21.15.19:0/3288198486 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f28e806be60 0x7f28e806e320 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009560 tx=0x7f28f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:23.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.456+0000 7f28fa7fc640 1 -- 172.21.15.19:0/3288198486 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f28ec059820 con 0x7f28fc072de0 2024-09-12T01:56:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.667+0000 7f2903b5f640 1 -- 172.21.15.19:0/3288198486 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f28fc0cc480 con 0x7f28fc072de0 2024-09-12T01:56:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.667+0000 7f28fa7fc640 1 -- 172.21.15.19:0/3288198486 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f28ec059120 con 0x7f28fc072de0 2024-09-12T01:56:23.667 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T01:56:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.669+0000 7f2903b5f640 1 -- 172.21.15.19:0/3288198486 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f28e806be60 msgr2=0x7f28e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.669+0000 7f2903b5f640 1 --2- 172.21.15.19:0/3288198486 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f28e806be60 0x7f28e806e320 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009560 tx=0x7f28f4008040 comp rx=0 tx=0).stop 2024-09-12T01:56:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.669+0000 7f2903b5f640 1 -- 172.21.15.19:0/3288198486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28fc072de0 msgr2=0x7f28fc0caf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.669+0000 7f2903b5f640 1 --2- 172.21.15.19:0/3288198486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28fc072de0 0x7f28fc0caf60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00cc70 tx=0x7f28ec00a430 comp rx=0 tx=0).stop 2024-09-12T01:56:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.669+0000 7f2903b5f640 1 -- 172.21.15.19:0/3288198486 shutdown_connections 2024-09-12T01:56:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.669+0000 7f2903b5f640 1 --2- 172.21.15.19:0/3288198486 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f28e806be60 0x7f28e806e320 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.669+0000 7f2903b5f640 1 --2- 172.21.15.19:0/3288198486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28fc072de0 0x7f28fc0caf60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.669+0000 7f2903b5f640 1 --2- 172.21.15.19:0/3288198486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28fc072700 0x7f28fc133710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.669+0000 7f2903b5f640 1 --2- 172.21.15.19:0/3288198486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28fc072320 0x7f28fc0b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.669+0000 7f2903b5f640 1 -- 172.21.15.19:0/3288198486 >> 172.21.15.19:0/3288198486 conn(0x7f28fc067d70 msgr2=0x7f28fc06e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.669+0000 7f2903b5f640 1 -- 172.21.15.19:0/3288198486 shutdown_connections 2024-09-12T01:56:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23.669+0000 7f2903b5f640 1 -- 172.21.15.19:0/3288198486 wait complete. 2024-09-12T01:56:23.680 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T01:56:23.681 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:56:23.681 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T01:56:23.681 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:56:23.681 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:56:23.681 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T01:56:23.681 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T01:56:23.681 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:56:23.682 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:56:23.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:23.682 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T01:56:23.698 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:56:23.699 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:56:23.699 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:56:23.699 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:23.699 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T01:56:23.699 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:23.699 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:23.699 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:23.699 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T01:56:23.699 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:23.699 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:23.699 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T01:56:23.699 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:56:23.699 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:23.700 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T01:56:23.700 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:56:23.700 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42777sec preferred_lft 42777sec 2024-09-12T01:56:23.700 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T01:56:23.700 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:23.700 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:23.700 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:23.700 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T01:56:23.700 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T01:56:23.701 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:23.701 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:56:23.701 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add name ceph-brx type bridge 2024-09-12T01:56:23.701 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr flush dev ceph-brx 2024-09-12T01:56:23.701 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set ceph-brx up 2024-09-12T01:56:23.701 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T01:56:23.701 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:56:23.727 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:56:23.742 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:56:23.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:23.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:23.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:23.842 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:56:23.866 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T01:56:23.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:23.868 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T01:56:23.925 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T01:56:23.925 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:56:23.925 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:56:23.925 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:56:23.925 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:56:23.926 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:23.926 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:56:23.926 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:56:23.926 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:56:23.926 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:56:23.926 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:56:24.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:24.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:24.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:24.055 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T01:56:24.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:24.071 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2024-09-12T01:56:24.126 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:24.126 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:56:24.126 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:56:24.126 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T01:56:24.126 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:56:24.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:24.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:24.246 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T01:56:24.246 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:24.246 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:56:24.246 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T01:56:24.246 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T01:56:24.246 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T01:56:24.246 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T01:56:24.246 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T01:56:24.246 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:56:24.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:24.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:24.364 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:24.364 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:56:24.364 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T01:56:24.364 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T01:56:24.364 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:56:24.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:24.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:24.445 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:56:24.445 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:56:24.473 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:56:24.474 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:56:24.474 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:56:24.530 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T01:56:24.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:24.531 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:56:24.617 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:56:24.617 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:56:24.617 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:56:24.752 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:56:24.752 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:56:24.752 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:56:24.752 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:56:24.752 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:56:24.757 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:56:24.757 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:56:24.758 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:56:24.758 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:56:24.758 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:56:24.758 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T01:56:24.758 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T01:56:24.758 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T01:56:24.758 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:56:24.758 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:56:24.759 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:56:24.759 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:56:24.759 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:56:24.760 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:56:24.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:24.761 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:56:24.791 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:56:24.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:56:24.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:24.889 INFO:teuthology.orchestra.run.smithi019.stdout:client4692 2024-09-12T01:56:24.889 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:56:24.889 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:24.910 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:56:25.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:56:25.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:25.008 INFO:teuthology.orchestra.run.smithi019.stdout:client4692 2024-09-12T01:56:25.008 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:56:25.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:56:25.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:25.065 INFO:teuthology.orchestra.run.smithi019.stdout:client4692 2024-09-12T01:56:25.066 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/978259a0-e3d5-47df-8e62-5e92f95d9388.client4692/status') 2024-09-12T01:56:25.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:25.126 INFO:teuthology.orchestra.run.smithi019.stdout:instance: client.4692 (3)192.168.0.1:0/4216079274 2024-09-12T01:56:25.126 INFO:teuthology.orchestra.run.smithi019.stdout:blocklisted: false 2024-09-12T01:56:25.126 INFO:teuthology.orchestra.run.smithi019.stderr:0+1 records in 2024-09-12T01:56:25.126 INFO:teuthology.orchestra.run.smithi019.stderr:0+1 records out 2024-09-12T01:56:25.126 INFO:teuthology.orchestra.run.smithi019.stderr:69 bytes copied, 2.4484e-05 s, 2.8 MB/s 2024-09-12T01:56:25.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:25.133 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-12T01:56:25.133 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T01:56:25.133 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-12T01:56:25.134 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:56:25.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.235+0000 7f1f38b78640 1 Processor -- start 2024-09-12T01:56:25.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.235+0000 7f1f38b78640 1 -- start start 2024-09-12T01:56:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.236+0000 7f1f38b78640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f34072de0 0x7f1f3415d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.236+0000 7f1f38b78640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1f34072700 0x7f1f3415d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.236+0000 7f1f38b78640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f34146140 con 0x7f1f34072320 2024-09-12T01:56:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.236+0000 7f1f38b78640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f1f340cd740 con 0x7f1f34072700 2024-09-12T01:56:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.236+0000 7f1f38b78640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1f340cda20 con 0x7f1f34072de0 2024-09-12T01:56:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.236+0000 7f1f32d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1f34072700 0x7f1f3415d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.236+0000 7f1f32d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1f34072700 0x7f1f3415d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60020/0 (socket says 172.21.15.19:60020) 2024-09-12T01:56:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.236+0000 7f1f32d9d640 1 -- 172.21.15.19:0/2407914356 learned_addr learned my addr 172.21.15.19:0/2407914356 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.236+0000 7f1f29d9b640 1 --2- 172.21.15.19:0/2407914356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f34072de0 0x7f1f3415d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.236+0000 7f1f32d9d640 1 -- 172.21.15.19:0/2407914356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f34072de0 msgr2=0x7f1f3415d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.236+0000 7f1f32d9d640 1 --2- 172.21.15.19:0/2407914356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f34072de0 0x7f1f3415d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.236+0000 7f1f32d9d640 1 -- 172.21.15.19:0/2407914356 >> v1:172.21.15.135:6789/0 conn(0x7f1f34072320 legacy=0x7f1f340cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:25.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.236+0000 7f1f32d9d640 1 -- 172.21.15.19:0/2407914356 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f340cdd00 con 0x7f1f34072700 2024-09-12T01:56:25.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.237+0000 7f1f32d9d640 1 --2- 172.21.15.19:0/2407914356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f34072700 0x7f1f3415d720 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c009e50 tx=0x7f1f2c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bf9b75e1f1bf06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:25.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.237+0000 7f1f31d9b640 1 -- 172.21.15.19:0/2407914356 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c036070 con 0x7f1f34072700 2024-09-12T01:56:25.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.237+0000 7f1f31d9b640 1 -- 172.21.15.19:0/2407914356 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f2c031600 con 0x7f1f34072700 2024-09-12T01:56:25.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.237+0000 7f1f31d9b640 1 -- 172.21.15.19:0/2407914356 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c0319d0 con 0x7f1f34072700 2024-09-12T01:56:25.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.238+0000 7f1f38b78640 1 -- 172.21.15.19:0/2407914356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f34072700 msgr2=0x7f1f3415d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:25.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.238+0000 7f1f38b78640 1 --2- 172.21.15.19:0/2407914356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f34072700 0x7f1f3415d720 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c009e50 tx=0x7f1f2c02a680 comp rx=0 tx=0).stop 2024-09-12T01:56:25.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.238+0000 7f1f38b78640 1 -- 172.21.15.19:0/2407914356 shutdown_connections 2024-09-12T01:56:25.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.238+0000 7f1f38b78640 1 --2- 172.21.15.19:0/2407914356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f34072700 0x7f1f3415d720 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:25.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.238+0000 7f1f38b78640 1 --2- 172.21.15.19:0/2407914356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f34072de0 0x7f1f3415d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:25.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.238+0000 7f1f38b78640 1 -- 172.21.15.19:0/2407914356 >> 172.21.15.19:0/2407914356 conn(0x7f1f34067d70 msgr2=0x7f1f3406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:25.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.238+0000 7f1f38b78640 1 -- 172.21.15.19:0/2407914356 shutdown_connections 2024-09-12T01:56:25.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.238+0000 7f1f38b78640 1 -- 172.21.15.19:0/2407914356 wait complete. 2024-09-12T01:56:25.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.239+0000 7f1f38b78640 1 Processor -- start 2024-09-12T01:56:25.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.239+0000 7f1f38b78640 1 -- start start 2024-09-12T01:56:25.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.240+0000 7f1f38b78640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f34072320 0x7f1f340a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:25.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.240+0000 7f1f38b78640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f34072700 0x7f1f3415be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:25.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.240+0000 7f1f38b78640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f34072de0 0x7f1f340cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:25.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.240+0000 7f1f38b78640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3415dde0 con 0x7f1f34072de0 2024-09-12T01:56:25.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.240+0000 7f1f38b78640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3415dc60 con 0x7f1f34072700 2024-09-12T01:56:25.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.240+0000 7f1f38b78640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1f3415df60 con 0x7f1f34072320 2024-09-12T01:56:25.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.240+0000 7f1f32d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f34072de0 0x7f1f340cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:25.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.240+0000 7f1f32d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f34072de0 0x7f1f340cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60036/0 (socket says 172.21.15.19:60036) 2024-09-12T01:56:25.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.240+0000 7f1f32d9d640 1 -- 172.21.15.19:0/1013112776 learned_addr learned my addr 172.21.15.19:0/1013112776 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:25.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.240+0000 7f1f29d9b640 1 --2- 172.21.15.19:0/1013112776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f34072700 0x7f1f3415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:25.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.240+0000 7f1f3259c640 1 --2- 172.21.15.19:0/1013112776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f34072320 0x7f1f340a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:25.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.240+0000 7f1f32d9d640 1 -- 172.21.15.19:0/1013112776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f34072320 msgr2=0x7f1f340a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.240+0000 7f1f32d9d640 1 --2- 172.21.15.19:0/1013112776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f34072320 0x7f1f340a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.240+0000 7f1f32d9d640 1 -- 172.21.15.19:0/1013112776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f34072700 msgr2=0x7f1f3415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.240+0000 7f1f32d9d640 1 --2- 172.21.15.19:0/1013112776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f34072700 0x7f1f3415be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.240+0000 7f1f32d9d640 1 -- 172.21.15.19:0/1013112776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3415c390 con 0x7f1f34072de0 2024-09-12T01:56:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.241+0000 7f1f32d9d640 1 --2- 172.21.15.19:0/1013112776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f34072de0 0x7f1f340cac30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c034040 tx=0x7f1f2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.241+0000 7f1f2b7fe640 1 -- 172.21.15.19:0/1013112776 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c036050 con 0x7f1f34072de0 2024-09-12T01:56:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.241+0000 7f1f2b7fe640 1 -- 172.21.15.19:0/1013112776 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f2c042070 con 0x7f1f34072de0 2024-09-12T01:56:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.241+0000 7f1f38b78640 1 -- 172.21.15.19:0/1013112776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f340a9b20 con 0x7f1f34072de0 2024-09-12T01:56:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.241+0000 7f1f2b7fe640 1 -- 172.21.15.19:0/1013112776 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c009510 con 0x7f1f34072de0 2024-09-12T01:56:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.241+0000 7f1f38b78640 1 -- 172.21.15.19:0/1013112776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f341f7b00 con 0x7f1f34072de0 2024-09-12T01:56:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.242+0000 7f1f38b78640 1 -- 172.21.15.19:0/1013112776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f340ce270 con 0x7f1f34072de0 2024-09-12T01:56:25.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.242+0000 7f1f2b7fe640 1 -- 172.21.15.19:0/1013112776 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f2c007bd0 con 0x7f1f34072de0 2024-09-12T01:56:25.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.243+0000 7f1f2b7fe640 1 --2- 172.21.15.19:0/1013112776 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1f1406be30 0x7f1f1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:25.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.243+0000 7f1f2b7fe640 1 -- 172.21.15.19:0/1013112776 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1f2c0abe80 con 0x7f1f34072de0 2024-09-12T01:56:25.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.243+0000 7f1f3259c640 1 --2- 172.21.15.19:0/1013112776 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1f1406be30 0x7f1f1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:25.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.243+0000 7f1f3259c640 1 --2- 172.21.15.19:0/1013112776 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1f1406be30 0x7f1f1406e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1f24001780 tx=0x7f1f24009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.247+0000 7f1f2b7fe640 1 -- 172.21.15.19:0/1013112776 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f340ce270 con 0x7f1f34072de0 2024-09-12T01:56:25.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.464+0000 7f1f38b78640 1 -- 172.21.15.19:0/1013112776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1f34143380 con 0x7f1f34072de0 2024-09-12T01:56:25.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.465+0000 7f1f2b7fe640 1 -- 172.21.15.19:0/1013112776 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f1f2c079f30 con 0x7f1f34072de0 2024-09-12T01:56:25.465 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T01:56:25.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.466+0000 7f1f38b78640 1 -- 172.21.15.19:0/1013112776 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1f1406be30 msgr2=0x7f1f1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:25.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.466+0000 7f1f38b78640 1 --2- 172.21.15.19:0/1013112776 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1f1406be30 0x7f1f1406e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1f24001780 tx=0x7f1f24009040 comp rx=0 tx=0).stop 2024-09-12T01:56:25.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.467+0000 7f1f38b78640 1 -- 172.21.15.19:0/1013112776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f34072de0 msgr2=0x7f1f340cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:25.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.467+0000 7f1f38b78640 1 --2- 172.21.15.19:0/1013112776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f34072de0 0x7f1f340cac30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c034040 tx=0x7f1f2c004a40 comp rx=0 tx=0).stop 2024-09-12T01:56:25.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.467+0000 7f1f38b78640 1 -- 172.21.15.19:0/1013112776 shutdown_connections 2024-09-12T01:56:25.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.467+0000 7f1f38b78640 1 --2- 172.21.15.19:0/1013112776 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1f1406be30 0x7f1f1406e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:25.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.467+0000 7f1f38b78640 1 --2- 172.21.15.19:0/1013112776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f34072de0 0x7f1f340cac30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:25.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.467+0000 7f1f38b78640 1 --2- 172.21.15.19:0/1013112776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f34072700 0x7f1f3415be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:25.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.467+0000 7f1f38b78640 1 --2- 172.21.15.19:0/1013112776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f34072320 0x7f1f340a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:25.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.467+0000 7f1f38b78640 1 -- 172.21.15.19:0/1013112776 >> 172.21.15.19:0/1013112776 conn(0x7f1f34067d70 msgr2=0x7f1f3406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:25.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.467+0000 7f1f38b78640 1 -- 172.21.15.19:0/1013112776 shutdown_connections 2024-09-12T01:56:25.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25.467+0000 7f1f38b78640 1 -- 172.21.15.19:0/1013112776 wait complete. 2024-09-12T01:56:25.478 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T01:56:25.478 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:56:25.478 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T01:56:25.478 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-12T01:56:25.478 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-12T01:56:25.478 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T01:56:25.478 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T01:56:25.478 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:56:25.479 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-12T01:56:25.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:25.479 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T01:56:25.495 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:56:25.495 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:56:25.495 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:56:25.495 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:25.495 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T01:56:25.495 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:25.495 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:25.495 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:25.495 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T01:56:25.496 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:25.496 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:25.496 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T01:56:25.496 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:56:25.496 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:25.496 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T01:56:25.496 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:56:25.496 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42775sec preferred_lft 42775sec 2024-09-12T01:56:25.496 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T01:56:25.496 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:25.496 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:25.496 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:25.496 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T01:56:25.497 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:56:25.497 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:25.497 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:56:25.497 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:25.497 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link tentative 2024-09-12T01:56:25.497 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:25.497 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:56:25.497 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:56:25.497 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link tentative 2024-09-12T01:56:25.497 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:25.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:25.498 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:56:25.559 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T01:56:25.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:25.561 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T01:56:25.622 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T01:56:25.623 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:56:25.623 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:56:25.623 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:56:25.623 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:56:25.624 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:25.624 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:56:25.624 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:56:25.624 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:56:25.624 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:56:25.624 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:56:25.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:25.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:25.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:25.753 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T01:56:25.770 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:56:25.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:25.771 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2024-09-12T01:56:25.826 INFO:teuthology.orchestra.run.smithi019.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-12T01:56:25.827 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:25.827 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:56:25.827 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:56:25.827 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-12T01:56:25.827 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:56:25.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:25.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:25.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:25.946 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-12T01:56:25.972 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:56:25.972 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:56:25.972 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:56:25.972 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:25.972 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T01:56:25.972 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:25.972 INFO:teuthology.orchestra.run.smithi019.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:56:25.972 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 42:4a:f8:9d:62:fb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T01:56:25.972 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T01:56:25.973 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:25.973 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::404a:f8ff:fe9d:62fb/64 scope link tentative 2024-09-12T01:56:25.973 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:25.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:25.974 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-12T01:56:26.039 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:56:26.039 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:56:26.040 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:56:26.040 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:26.040 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T01:56:26.040 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:26.040 INFO:teuthology.orchestra.run.smithi019.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:56:26.040 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 42:4a:f8:9d:62:fb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T01:56:26.040 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T01:56:26.040 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:26.040 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::404a:f8ff:fe9d:62fb/64 scope link tentative 2024-09-12T01:56:26.040 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:26.041 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-12T01:56:26.042 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:26.042 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:56:26.042 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-12T01:56:26.042 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-12T01:56:26.042 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-12T01:56:26.042 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-12T01:56:26.042 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-12T01:56:26.042 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:56:26.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:26.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:26.199 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:26.199 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:56:26.199 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.1 up 2024-09-12T01:56:26.199 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.1 master ceph-brx 2024-09-12T01:56:26.199 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:56:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:26.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:26.280 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:56:26.280 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-12T01:56:26.296 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-12T01:56:26.296 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:56:26.297 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-12T01:56:26.360 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T01:56:26.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:26.361 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-12T01:56:26.448 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-12T01:56:26.448 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-12T01:56:26.448 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:56:26.456 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-12T01:56:26.456 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-12T01:56:26.457 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:56:26.457 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:56:26.457 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:56:26.462 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-12T01:56:26.462 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-12T01:56:26.462 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:56:26.462 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:56:26.462 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:56:26.463 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T01:56:26.463 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T01:56:26.463 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T01:56:26.464 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-12T01:56:26.464 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:56:26.464 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:56:26.464 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:56:26.464 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:56:26.465 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:56:26.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:26.465 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-12T01:56:26.533 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:56:26.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:56:26.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:26.634 INFO:teuthology.orchestra.run.smithi019.stdout:client4642 2024-09-12T01:56:26.634 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:56:26.634 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:26.651 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:56:26.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:56:26.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:26.748 INFO:teuthology.orchestra.run.smithi019.stdout:client4642 2024-09-12T01:56:26.748 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:56:26.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:56:26.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:26.805 INFO:teuthology.orchestra.run.smithi019.stdout:client4642 2024-09-12T01:56:26.805 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/978259a0-e3d5-47df-8e62-5e92f95d9388.client4642/status') 2024-09-12T01:56:26.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:26.865 INFO:teuthology.orchestra.run.smithi019.stdout:instance: client.4642 (3)172.21.15.19:0/918470506 2024-09-12T01:56:26.865 INFO:teuthology.orchestra.run.smithi019.stdout:blocklisted: false 2024-09-12T01:56:26.865 INFO:teuthology.orchestra.run.smithi019.stderr:0+1 records in 2024-09-12T01:56:26.866 INFO:teuthology.orchestra.run.smithi019.stderr:0+1 records out 2024-09-12T01:56:26.866 INFO:teuthology.orchestra.run.smithi019.stderr:69 bytes copied, 2.5654e-05 s, 2.7 MB/s 2024-09-12T01:56:26.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:26.872 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-12T01:56:26.873 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T01:56:26.873 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T01:56:26.873 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:56:26.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.974+0000 7f224043c640 1 Processor -- start 2024-09-12T01:56:26.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.974+0000 7f224043c640 1 -- start start 2024-09-12T01:56:26.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.975+0000 7f224043c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f223815e5b0 0x7f22380b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.975+0000 7f224043c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f223815e990 0x7f22380b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.975+0000 7f224043c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22380ae140 0x7f22380ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.975+0000 7f224043c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f22380aeb10 con 0x7f223815e5b0 2024-09-12T01:56:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.975+0000 7f224043c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f22380b6520 con 0x7f223815e990 2024-09-12T01:56:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.975+0000 7f224043c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f22380b1a40 con 0x7f22380ae140 2024-09-12T01:56:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.975+0000 7f223e1d8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f223815e5b0 0x7f22380b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.976+0000 7f223e1d8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f223815e5b0 0x7f22380b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60050/0 (socket says 172.21.15.19:60050) 2024-09-12T01:56:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.976+0000 7f223e1d8640 1 -- 172.21.15.19:0/1738637049 learned_addr learned my addr 172.21.15.19:0/1738637049 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.976+0000 7f223d9d7640 1 --2- 172.21.15.19:0/1738637049 >> v2:172.21.15.135:3300/0 conn(0x7f223815e990 0x7f22380b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.976+0000 7f223e9d9640 1 --2- 172.21.15.19:0/1738637049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22380ae140 0x7f22380ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.976+0000 7f223e1d8640 1 -- 172.21.15.19:0/1738637049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22380ae140 msgr2=0x7f22380ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.976+0000 7f223e1d8640 1 --2- 172.21.15.19:0/1738637049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22380ae140 0x7f22380ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.976+0000 7f223e1d8640 1 -- 172.21.15.19:0/1738637049 >> v2:172.21.15.135:3300/0 conn(0x7f223815e990 msgr2=0x7f22380b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.976+0000 7f223e1d8640 1 --2- 172.21.15.19:0/1738637049 >> v2:172.21.15.135:3300/0 conn(0x7f223815e990 0x7f22380b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.976+0000 7f223e1d8640 1 -- 172.21.15.19:0/1738637049 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22380b1d20 con 0x7f223815e5b0 2024-09-12T01:56:26.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.976+0000 7f223e9d9640 1 --2- 172.21.15.19:0/1738637049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22380ae140 0x7f22380ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:26.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.976+0000 7f223e1d8640 1 --2- 172.21.15.19:0/1738637049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223815e5b0 0x7f22380b5f40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f22380cd9c0 tx=0x7f223002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3843ff080f298d53 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.977+0000 7f223d1d6640 1 -- 172.21.15.19:0/1738637049 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2230037070 con 0x7f223815e5b0 2024-09-12T01:56:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.977+0000 7f223d1d6640 1 -- 172.21.15.19:0/1738637049 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2230032440 con 0x7f223815e5b0 2024-09-12T01:56:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.977+0000 7f223d1d6640 1 -- 172.21.15.19:0/1738637049 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2230032810 con 0x7f223815e5b0 2024-09-12T01:56:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.977+0000 7f224043c640 1 -- 172.21.15.19:0/1738637049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223815e5b0 msgr2=0x7f22380b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.977+0000 7f224043c640 1 --2- 172.21.15.19:0/1738637049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223815e5b0 0x7f22380b5f40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f22380cd9c0 tx=0x7f223002a1e0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.977+0000 7f224043c640 1 -- 172.21.15.19:0/1738637049 shutdown_connections 2024-09-12T01:56:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.977+0000 7f224043c640 1 --2- 172.21.15.19:0/1738637049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22380ae140 0x7f22380ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.977+0000 7f224043c640 1 --2- 172.21.15.19:0/1738637049 >> v2:172.21.15.135:3300/0 conn(0x7f223815e990 0x7f22380b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.977+0000 7f224043c640 1 --2- 172.21.15.19:0/1738637049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223815e5b0 0x7f22380b5f40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.977+0000 7f224043c640 1 -- 172.21.15.19:0/1738637049 >> 172.21.15.19:0/1738637049 conn(0x7f2238073490 msgr2=0x7f22380b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:26.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.977+0000 7f224043c640 1 -- 172.21.15.19:0/1738637049 shutdown_connections 2024-09-12T01:56:26.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.977+0000 7f224043c640 1 -- 172.21.15.19:0/1738637049 wait complete. 2024-09-12T01:56:26.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.979+0000 7f224043c640 1 Processor -- start 2024-09-12T01:56:26.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.979+0000 7f224043c640 1 -- start start 2024-09-12T01:56:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.979+0000 7f224043c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22380ae140 0x7f223814ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.979+0000 7f224043c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223815e5b0 0x7f223815bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.979+0000 7f224043c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f223815e990 0x7f223815c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.979+0000 7f224043c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f22380b2a60 con 0x7f223815e5b0 2024-09-12T01:56:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.979+0000 7f224043c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22380b0490 con 0x7f223815e990 2024-09-12T01:56:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.979+0000 7f224043c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f22380b2be0 con 0x7f22380ae140 2024-09-12T01:56:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.980+0000 7f223d9d7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223815e5b0 0x7f223815bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.980+0000 7f223d9d7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223815e5b0 0x7f223815bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60062/0 (socket says 172.21.15.19:60062) 2024-09-12T01:56:26.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.980+0000 7f223d9d7640 1 -- 172.21.15.19:0/120763404 learned_addr learned my addr 172.21.15.19:0/120763404 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:26.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.980+0000 7f223e9d9640 1 --2- 172.21.15.19:0/120763404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f223815e990 0x7f223815c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.980+0000 7f223e1d8640 1 --2- 172.21.15.19:0/120763404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22380ae140 0x7f223814ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.980+0000 7f223d9d7640 1 -- 172.21.15.19:0/120763404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22380ae140 msgr2=0x7f223814ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:26.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.980+0000 7f223d9d7640 1 --2- 172.21.15.19:0/120763404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22380ae140 0x7f223814ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.980+0000 7f223d9d7640 1 -- 172.21.15.19:0/120763404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f223815e990 msgr2=0x7f223815c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:26.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.980+0000 7f223d9d7640 1 --2- 172.21.15.19:0/120763404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f223815e990 0x7f223815c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.980+0000 7f223d9d7640 1 -- 172.21.15.19:0/120763404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223809ddb0 con 0x7f223815e5b0 2024-09-12T01:56:26.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.980+0000 7f223d9d7640 1 --2- 172.21.15.19:0/120763404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223815e5b0 0x7f223815bef0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f222c00d5f0 tx=0x7f222c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:26.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.980+0000 7f2236ffd640 1 -- 172.21.15.19:0/120763404 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c0125f0 con 0x7f223815e5b0 2024-09-12T01:56:26.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.980+0000 7f2236ffd640 1 -- 172.21.15.19:0/120763404 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f222c019070 con 0x7f223815e5b0 2024-09-12T01:56:26.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.980+0000 7f2236ffd640 1 -- 172.21.15.19:0/120763404 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c0129d0 con 0x7f223815e5b0 2024-09-12T01:56:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.980+0000 7f224043c640 1 -- 172.21.15.19:0/120763404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f223809e090 con 0x7f223815e5b0 2024-09-12T01:56:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.980+0000 7f224043c640 1 -- 172.21.15.19:0/120763404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f223809e650 con 0x7f223815e5b0 2024-09-12T01:56:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.981+0000 7f224043c640 1 -- 172.21.15.19:0/120763404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22380d1940 con 0x7f223815e5b0 2024-09-12T01:56:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.982+0000 7f2236ffd640 1 -- 172.21.15.19:0/120763404 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f222c012b70 con 0x7f223815e5b0 2024-09-12T01:56:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.982+0000 7f2236ffd640 1 --2- 172.21.15.19:0/120763404 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f222406be30 0x7f222406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.982+0000 7f2236ffd640 1 -- 172.21.15.19:0/120763404 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f222c08b3b0 con 0x7f223815e5b0 2024-09-12T01:56:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.983+0000 7f223e1d8640 1 --2- 172.21.15.19:0/120763404 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f222406be30 0x7f222406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.983+0000 7f223e1d8640 1 --2- 172.21.15.19:0/120763404 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f222406be30 0x7f222406e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2230034000 tx=0x7f223002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:26.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:26.987+0000 7f2236ffd640 1 -- 172.21.15.19:0/120763404 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f22380d1940 con 0x7f223815e5b0 2024-09-12T01:56:27.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:27.196+0000 7f224043c640 1 -- 172.21.15.19:0/120763404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f22380b5f40 con 0x7f223815e5b0 2024-09-12T01:56:27.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:27.196+0000 7f2236ffd640 1 -- 172.21.15.19:0/120763404 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f222c059460 con 0x7f223815e5b0 2024-09-12T01:56:27.197 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T01:56:27.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:27.198+0000 7f224043c640 1 -- 172.21.15.19:0/120763404 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f222406be30 msgr2=0x7f222406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:27.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:27.198+0000 7f224043c640 1 --2- 172.21.15.19:0/120763404 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f222406be30 0x7f222406e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2230034000 tx=0x7f223002e000 comp rx=0 tx=0).stop 2024-09-12T01:56:27.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:27.198+0000 7f224043c640 1 -- 172.21.15.19:0/120763404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223815e5b0 msgr2=0x7f223815bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:27.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:27.198+0000 7f224043c640 1 --2- 172.21.15.19:0/120763404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223815e5b0 0x7f223815bef0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f222c00d5f0 tx=0x7f222c00dab0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:27.199+0000 7f224043c640 1 -- 172.21.15.19:0/120763404 shutdown_connections 2024-09-12T01:56:27.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:27.199+0000 7f224043c640 1 --2- 172.21.15.19:0/120763404 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f222406be30 0x7f222406e2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:27.199+0000 7f224043c640 1 --2- 172.21.15.19:0/120763404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f223815e990 0x7f223815c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:27.199+0000 7f224043c640 1 --2- 172.21.15.19:0/120763404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223815e5b0 0x7f223815bef0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:27.199+0000 7f224043c640 1 --2- 172.21.15.19:0/120763404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22380ae140 0x7f223814ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:27.199+0000 7f224043c640 1 -- 172.21.15.19:0/120763404 >> 172.21.15.19:0/120763404 conn(0x7f2238073490 msgr2=0x7f22380d1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:27.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:27.199+0000 7f224043c640 1 -- 172.21.15.19:0/120763404 shutdown_connections 2024-09-12T01:56:27.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:27.199+0000 7f224043c640 1 -- 172.21.15.19:0/120763404 wait complete. 2024-09-12T01:56:27.210 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T01:56:27.210 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:56:27.210 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2024-09-12T01:56:27.210 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T01:56:27.210 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T01:56:27.210 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T01:56:27.210 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T01:56:27.210 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:56:27.210 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:56:27.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:27.211 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2024-09-12T01:56:27.230 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:56:27.230 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:56:27.230 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:56:27.230 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:27.231 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-09-12T01:56:27.231 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:27.231 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:27.231 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:27.231 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2024-09-12T01:56:27.231 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:27.231 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:27.231 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2024-09-12T01:56:27.231 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:27.231 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:27.231 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:56:27.231 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:27.231 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:56:27.232 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42731sec preferred_lft 42731sec 2024-09-12T01:56:27.232 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link noprefixroute 2024-09-12T01:56:27.232 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:27.232 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T01:56:27.232 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:27.232 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-12T01:56:27.232 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add name ceph-brx type bridge 2024-09-12T01:56:27.232 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr flush dev ceph-brx 2024-09-12T01:56:27.232 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set ceph-brx up 2024-09-12T01:56:27.232 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T01:56:27.233 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-12T01:56:27.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:27.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:27.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:27.541 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:56:27.567 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-09-12T01:56:27.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:27.569 DEBUG:teuthology.orchestra.run.smithi135:> route 2024-09-12T01:56:27.636 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2024-09-12T01:56:27.637 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:56:27.637 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:56:27.637 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:56:27.637 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:56:27.637 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:27.638 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-12T01:56:27.638 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:56:27.638 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:56:27.638 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:56:27.638 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-12T01:56:27.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:27.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:27.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:27.924 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-09-12T01:56:27.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:27.940 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2024-09-12T01:56:27.996 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:27.996 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-12T01:56:27.996 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T01:56:27.996 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-12T01:56:27.996 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-12T01:56:28.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:28.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:28.135 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-12T01:56:28.135 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:28.135 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-12T01:56:28.135 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-12T01:56:28.136 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T01:56:28.136 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-12T01:56:28.136 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-12T01:56:28.136 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-12T01:56:28.136 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-12T01:56:28.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:28.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:28.262 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:28.262 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-12T01:56:28.262 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2024-09-12T01:56:28.263 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T01:56:28.263 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-12T01:56:28.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:28.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:28.340 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:56:28.340 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T01:56:28.355 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:56:28.355 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:56:28.356 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:56:28.410 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T01:56:28.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:28.411 DEBUG:teuthology.orchestra.run.smithi135:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-12T01:56:28.511 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-12T01:56:28.511 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-12T01:56:28.511 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-09-12T01:56:28.637 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-12T01:56:28.637 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-12T01:56:28.637 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-09-12T01:56:28.637 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:56:28.637 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:56:28.643 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-12T01:56:28.643 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-12T01:56:28.643 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-09-12T01:56:28.643 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:56:28.643 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:56:28.644 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T01:56:28.644 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T01:56:28.644 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T01:56:28.644 INFO:teuthology.orchestra.run.smithi135.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T01:56:28.644 INFO:teuthology.orchestra.run.smithi135.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:56:28.644 INFO:teuthology.orchestra.run.smithi135.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:56:28.644 INFO:teuthology.orchestra.run.smithi135.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:56:28.644 INFO:teuthology.orchestra.run.smithi135.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:56:28.645 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:56:28.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:28.646 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:56:28.670 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:56:28.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:56:28.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:28.768 INFO:teuthology.orchestra.run.smithi135.stdout:client4707 2024-09-12T01:56:28.768 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:56:28.768 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:28.784 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:56:28.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:56:28.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:28.880 INFO:teuthology.orchestra.run.smithi135.stdout:client4707 2024-09-12T01:56:28.880 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:56:28.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:56:28.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:28.937 INFO:teuthology.orchestra.run.smithi135.stdout:client4707 2024-09-12T01:56:28.937 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/978259a0-e3d5-47df-8e62-5e92f95d9388.client4707/status') 2024-09-12T01:56:28.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:28.996 INFO:teuthology.orchestra.run.smithi135.stdout:instance: client.4707 (3)172.21.15.135:0/3615589393 2024-09-12T01:56:28.996 INFO:teuthology.orchestra.run.smithi135.stdout:blocklisted: false 2024-09-12T01:56:28.996 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records in 2024-09-12T01:56:28.997 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records out 2024-09-12T01:56:28.997 INFO:teuthology.orchestra.run.smithi135.stderr:71 bytes copied, 2.1768e-05 s, 3.3 MB/s 2024-09-12T01:56:28.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:29.003 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-12T01:56:29.003 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T01:56:29.003 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-12T01:56:29.004 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:56:29.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.119+0000 7f7a7f247640 1 Processor -- start 2024-09-12T01:56:29.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.119+0000 7f7a7f247640 1 -- start start 2024-09-12T01:56:29.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.120+0000 7f7a7f247640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a780cfcc0 0x7f7a7806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:29.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.120+0000 7f7a7f247640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7a780d4fd0 0x7f7a780d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:29.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.120+0000 7f7a7f247640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a780d2700 con 0x7f7a7815e760 2024-09-12T01:56:29.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.120+0000 7f7a7f247640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f7a780cedb0 con 0x7f7a780d4fd0 2024-09-12T01:56:29.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.120+0000 7f7a7f247640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7a780cf090 con 0x7f7a780cfcc0 2024-09-12T01:56:29.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.120+0000 7f7a7cfe3640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7a7815e760 0x7f7a780cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59716/0 (socket says 172.21.15.19:59716) 2024-09-12T01:56:29.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.120+0000 7f7a7cfe3640 1 -- 172.21.15.19:0/3796348842 learned_addr learned my addr 172.21.15.19:0/3796348842 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:29.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.121+0000 7f7a7d7e4640 1 --2- 172.21.15.19:0/3796348842 >> v2:172.21.15.135:3300/0 conn(0x7f7a780d4fd0 0x7f7a780d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:29.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.121+0000 7f7a77fff640 1 --2- 172.21.15.19:0/3796348842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a780cfcc0 0x7f7a7806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:29.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.121+0000 7f7a777fe640 1 -- 172.21.15.19:0/3796348842 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2078494248 0 0) 0x7f7a68001110 con 0x7f7a7815e760 2024-09-12T01:56:29.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.121+0000 7f7a777fe640 1 -- 172.21.15.19:0/3796348842 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a60003520 con 0x7f7a7815e760 2024-09-12T01:56:29.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.121+0000 7f7a7d7e4640 1 -- 172.21.15.19:0/3796348842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a780cfcc0 msgr2=0x7f7a7806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:29.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.121+0000 7f7a7d7e4640 1 --2- 172.21.15.19:0/3796348842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a780cfcc0 0x7f7a7806cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.121+0000 7f7a7d7e4640 1 -- 172.21.15.19:0/3796348842 >> v1:172.21.15.19:6789/0 conn(0x7f7a7815e760 legacy=0x7f7a780cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:29.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.121+0000 7f7a7d7e4640 1 -- 172.21.15.19:0/3796348842 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a780b3c80 con 0x7f7a780d4fd0 2024-09-12T01:56:29.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.121+0000 7f7a77fff640 1 --2- 172.21.15.19:0/3796348842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a780cfcc0 0x7f7a7806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:29.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.122+0000 7f7a7d7e4640 1 --2- 172.21.15.19:0/3796348842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a780d4fd0 0x7f7a780d2ea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7a70009d90 tx=0x7f7a7002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d67593bc2898d19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:29.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.122+0000 7f7a777fe640 1 -- 172.21.15.19:0/3796348842 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70007740 con 0x7f7a780d4fd0 2024-09-12T01:56:29.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.122+0000 7f7a777fe640 1 -- 172.21.15.19:0/3796348842 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a700078e0 con 0x7f7a780d4fd0 2024-09-12T01:56:29.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.122+0000 7f7a777fe640 1 -- 172.21.15.19:0/3796348842 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70007cb0 con 0x7f7a780d4fd0 2024-09-12T01:56:29.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.123+0000 7f7a7f247640 1 -- 172.21.15.19:0/3796348842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a780d4fd0 msgr2=0x7f7a780d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:29.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.123+0000 7f7a7f247640 1 --2- 172.21.15.19:0/3796348842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a780d4fd0 0x7f7a780d2ea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7a70009d90 tx=0x7f7a7002a660 comp rx=0 tx=0).stop 2024-09-12T01:56:29.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.123+0000 7f7a7f247640 1 -- 172.21.15.19:0/3796348842 shutdown_connections 2024-09-12T01:56:29.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.123+0000 7f7a7f247640 1 --2- 172.21.15.19:0/3796348842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a780d4fd0 0x7f7a780d2ea0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.123+0000 7f7a7f247640 1 --2- 172.21.15.19:0/3796348842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a780cfcc0 0x7f7a7806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.123+0000 7f7a7f247640 1 -- 172.21.15.19:0/3796348842 >> 172.21.15.19:0/3796348842 conn(0x7f7a7808bfc0 msgr2=0x7f7a780d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:29.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.123+0000 7f7a7f247640 1 -- 172.21.15.19:0/3796348842 shutdown_connections 2024-09-12T01:56:29.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.123+0000 7f7a7f247640 1 -- 172.21.15.19:0/3796348842 wait complete. 2024-09-12T01:56:29.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.124+0000 7f7a7f247640 1 Processor -- start 2024-09-12T01:56:29.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.124+0000 7f7a7f247640 1 -- start start 2024-09-12T01:56:29.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.125+0000 7f7a7f247640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a780cfcc0 0x7f7a780b9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:29.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.125+0000 7f7a7f247640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a780d4fd0 0x7f7a7815b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:29.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.125+0000 7f7a7f247640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a7815e760 0x7f7a7815bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:29.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.125+0000 7f7a7f247640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7a780d33e0 con 0x7f7a780cfcc0 2024-09-12T01:56:29.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.125+0000 7f7a7f247640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7a780b3860 con 0x7f7a780d4fd0 2024-09-12T01:56:29.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.125+0000 7f7a7f247640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7a780d3560 con 0x7f7a7815e760 2024-09-12T01:56:29.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.125+0000 7f7a7cfe3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a780cfcc0 0x7f7a780b9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:29.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.125+0000 7f7a7cfe3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a780cfcc0 0x7f7a780b9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60068/0 (socket says 172.21.15.19:60068) 2024-09-12T01:56:29.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.125+0000 7f7a7cfe3640 1 -- 172.21.15.19:0/3510951166 learned_addr learned my addr 172.21.15.19:0/3510951166 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:29.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.125+0000 7f7a77fff640 1 --2- 172.21.15.19:0/3510951166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a780d4fd0 0x7f7a7815b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.125+0000 7f7a7d7e4640 1 --2- 172.21.15.19:0/3510951166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a7815e760 0x7f7a7815bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.125+0000 7f7a7cfe3640 1 -- 172.21.15.19:0/3510951166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a7815e760 msgr2=0x7f7a7815bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.125+0000 7f7a7cfe3640 1 --2- 172.21.15.19:0/3510951166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a7815e760 0x7f7a7815bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.125+0000 7f7a7cfe3640 1 -- 172.21.15.19:0/3510951166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a780d4fd0 msgr2=0x7f7a7815b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.125+0000 7f7a7cfe3640 1 --2- 172.21.15.19:0/3510951166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a780d4fd0 0x7f7a7815b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.125+0000 7f7a7cfe3640 1 -- 172.21.15.19:0/3510951166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7815a8b0 con 0x7f7a780cfcc0 2024-09-12T01:56:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.126+0000 7f7a7cfe3640 1 --2- 172.21.15.19:0/3510951166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a780cfcc0 0x7f7a780b9f70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800c3a0 tx=0x7f7a6800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.126+0000 7f7a757fa640 1 -- 172.21.15.19:0/3510951166 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68017070 con 0x7f7a780cfcc0 2024-09-12T01:56:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.126+0000 7f7a757fa640 1 -- 172.21.15.19:0/3510951166 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a68005ce0 con 0x7f7a780cfcc0 2024-09-12T01:56:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.126+0000 7f7a7f247640 1 -- 172.21.15.19:0/3510951166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a7815ab90 con 0x7f7a780cfcc0 2024-09-12T01:56:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.126+0000 7f7a757fa640 1 -- 172.21.15.19:0/3510951166 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68007310 con 0x7f7a780cfcc0 2024-09-12T01:56:29.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.126+0000 7f7a7f247640 1 -- 172.21.15.19:0/3510951166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a78155d40 con 0x7f7a780cfcc0 2024-09-12T01:56:29.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.127+0000 7f7a7f247640 1 -- 172.21.15.19:0/3510951166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a7815ad60 con 0x7f7a780cfcc0 2024-09-12T01:56:29.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.127+0000 7f7a757fa640 1 -- 172.21.15.19:0/3510951166 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a6801a070 con 0x7f7a780cfcc0 2024-09-12T01:56:29.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.128+0000 7f7a757fa640 1 --2- 172.21.15.19:0/3510951166 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7a6406be30 0x7f7a6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:29.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.128+0000 7f7a757fa640 1 -- 172.21.15.19:0/3510951166 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7a6808a490 con 0x7f7a780cfcc0 2024-09-12T01:56:29.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.128+0000 7f7a77fff640 1 --2- 172.21.15.19:0/3510951166 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7a6406be30 0x7f7a6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:29.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.128+0000 7f7a77fff640 1 --2- 172.21.15.19:0/3510951166 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7a6406be30 0x7f7a6406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7a780d41a0 tx=0x7f7a6c009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:29.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.132+0000 7f7a757fa640 1 -- 172.21.15.19:0/3510951166 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7a780d2700 con 0x7f7a780cfcc0 2024-09-12T01:56:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.343+0000 7f7a7f247640 1 -- 172.21.15.19:0/3510951166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7a780d3890 con 0x7f7a780cfcc0 2024-09-12T01:56:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.343+0000 7f7a757fa640 1 -- 172.21.15.19:0/3510951166 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f7a68058540 con 0x7f7a780cfcc0 2024-09-12T01:56:29.343 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T01:56:29.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.345+0000 7f7a7f247640 1 -- 172.21.15.19:0/3510951166 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7a6406be30 msgr2=0x7f7a6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:29.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.345+0000 7f7a7f247640 1 --2- 172.21.15.19:0/3510951166 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7a6406be30 0x7f7a6406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7a780d41a0 tx=0x7f7a6c009110 comp rx=0 tx=0).stop 2024-09-12T01:56:29.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.345+0000 7f7a7f247640 1 -- 172.21.15.19:0/3510951166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a780cfcc0 msgr2=0x7f7a780b9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:29.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.345+0000 7f7a7f247640 1 --2- 172.21.15.19:0/3510951166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a780cfcc0 0x7f7a780b9f70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800c3a0 tx=0x7f7a6800c860 comp rx=0 tx=0).stop 2024-09-12T01:56:29.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.345+0000 7f7a7f247640 1 -- 172.21.15.19:0/3510951166 shutdown_connections 2024-09-12T01:56:29.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.345+0000 7f7a7f247640 1 --2- 172.21.15.19:0/3510951166 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7a6406be30 0x7f7a6406e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.345+0000 7f7a7f247640 1 --2- 172.21.15.19:0/3510951166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a7815e760 0x7f7a7815bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.345+0000 7f7a7f247640 1 --2- 172.21.15.19:0/3510951166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a780d4fd0 0x7f7a7815b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.345+0000 7f7a7f247640 1 --2- 172.21.15.19:0/3510951166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a780cfcc0 0x7f7a780b9f70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.345+0000 7f7a7f247640 1 -- 172.21.15.19:0/3510951166 >> 172.21.15.19:0/3510951166 conn(0x7f7a7808bfc0 msgr2=0x7f7a780b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:29.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.346+0000 7f7a7f247640 1 -- 172.21.15.19:0/3510951166 shutdown_connections 2024-09-12T01:56:29.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:29.346+0000 7f7a7f247640 1 -- 172.21.15.19:0/3510951166 wait complete. 2024-09-12T01:56:29.357 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T01:56:29.357 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:56:29.357 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2024-09-12T01:56:29.357 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-12T01:56:29.357 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-12T01:56:29.357 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T01:56:29.357 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T01:56:29.357 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:56:29.357 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-12T01:56:29.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:29.357 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2024-09-12T01:56:29.374 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:56:29.374 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:56:29.374 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:56:29.374 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:29.374 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-09-12T01:56:29.374 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:29.374 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:29.374 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:29.374 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2024-09-12T01:56:29.375 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:29.375 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:29.375 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2024-09-12T01:56:29.375 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:29.375 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:29.375 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:56:29.375 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:29.375 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:56:29.375 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42729sec preferred_lft 42729sec 2024-09-12T01:56:29.375 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link noprefixroute 2024-09-12T01:56:29.375 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:29.375 INFO:teuthology.orchestra.run.smithi135.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:56:29.375 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 9a:e3:60:60:40:19 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:29.375 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:56:29.376 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:29.376 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::40e7:84ff:fe49:bf22/64 scope link 2024-09-12T01:56:29.376 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:29.376 INFO:teuthology.orchestra.run.smithi135.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:56:29.376 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 9a:e3:60:60:40:19 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T01:56:29.376 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::98e3:60ff:fe60:4019/64 scope link tentative 2024-09-12T01:56:29.376 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:29.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:29.376 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:56:29.439 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-09-12T01:56:29.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:29.440 DEBUG:teuthology.orchestra.run.smithi135:> route 2024-09-12T01:56:29.497 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2024-09-12T01:56:29.497 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:56:29.497 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:56:29.498 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:56:29.498 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:56:29.498 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:29.498 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-12T01:56:29.498 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:56:29.498 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:56:29.498 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:56:29.498 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-12T01:56:29.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:29.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:29.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:29.624 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-09-12T01:56:29.639 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T01:56:29.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:29.640 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2024-09-12T01:56:29.695 INFO:teuthology.orchestra.run.smithi135.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-12T01:56:29.695 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:29.695 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-12T01:56:29.695 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T01:56:29.695 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-12T01:56:29.696 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-12T01:56:29.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:29.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:29.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:29.812 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-12T01:56:29.837 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:56:29.838 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:56:29.838 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:56:29.838 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:29.838 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-09-12T01:56:29.838 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:29.838 INFO:teuthology.orchestra.run.smithi135.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:56:29.838 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 72:c9:39:7c:1d:06 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T01:56:29.838 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T01:56:29.838 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:29.838 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::70c9:39ff:fe7c:1d06/64 scope link tentative 2024-09-12T01:56:29.838 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:29.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:29.839 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-12T01:56:29.904 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:56:29.904 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:56:29.904 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:56:29.904 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:29.904 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-09-12T01:56:29.904 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:29.904 INFO:teuthology.orchestra.run.smithi135.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:56:29.904 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 72:c9:39:7c:1d:06 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T01:56:29.904 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T01:56:29.904 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:29.904 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::70c9:39ff:fe7c:1d06/64 scope link 2024-09-12T01:56:29.904 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:29.905 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-12T01:56:29.906 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:29.906 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-12T01:56:29.906 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-12T01:56:29.906 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-12T01:56:29.906 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-12T01:56:29.906 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-12T01:56:29.906 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-12T01:56:29.906 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-12T01:56:29.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:30.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:30.059 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:30.059 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-12T01:56:30.059 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.1 up 2024-09-12T01:56:30.059 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.1 master ceph-brx 2024-09-12T01:56:30.059 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-12T01:56:30.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:30.136 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:56:30.136 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-12T01:56:30.151 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-12T01:56:30.151 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:56:30.151 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-12T01:56:30.207 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T01:56:30.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:30.208 DEBUG:teuthology.orchestra.run.smithi135:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-12T01:56:30.291 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-12T01:56:30.291 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-12T01:56:30.291 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-09-12T01:56:30.300 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-12T01:56:30.300 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-12T01:56:30.300 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-09-12T01:56:30.300 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:56:30.300 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:56:30.305 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-12T01:56:30.305 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-12T01:56:30.305 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-09-12T01:56:30.305 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:56:30.305 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:56:30.306 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T01:56:30.306 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T01:56:30.306 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T01:56:30.306 INFO:teuthology.orchestra.run.smithi135.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-12T01:56:30.306 INFO:teuthology.orchestra.run.smithi135.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:56:30.306 INFO:teuthology.orchestra.run.smithi135.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:56:30.306 INFO:teuthology.orchestra.run.smithi135.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:56:30.307 INFO:teuthology.orchestra.run.smithi135.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:56:30.308 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:56:30.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:30.308 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-12T01:56:30.374 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:56:30.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:56:30.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:30.470 INFO:teuthology.orchestra.run.smithi135.stdout:client4535 2024-09-12T01:56:30.470 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:56:30.471 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:30.487 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:56:30.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:56:30.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:30.582 INFO:teuthology.orchestra.run.smithi135.stdout:client4535 2024-09-12T01:56:30.582 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:56:30.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:56:30.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:30.637 INFO:teuthology.orchestra.run.smithi135.stdout:client4535 2024-09-12T01:56:30.637 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/978259a0-e3d5-47df-8e62-5e92f95d9388.client4535/status') 2024-09-12T01:56:30.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:30.694 INFO:teuthology.orchestra.run.smithi135.stdout:instance: client.4535 (3)192.168.0.2:0/1791003529 2024-09-12T01:56:30.695 INFO:teuthology.orchestra.run.smithi135.stdout:blocklisted: false 2024-09-12T01:56:30.695 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records in 2024-09-12T01:56:30.695 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records out 2024-09-12T01:56:30.695 INFO:teuthology.orchestra.run.smithi135.stderr:69 bytes copied, 2.0828e-05 s, 3.3 MB/s 2024-09-12T01:56:30.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T01:56:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:30.702 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-12T01:56:30.817 INFO:tasks.cephfs_test_runner:Starting test: test_damaged_dentry (tasks.cephfs.test_damage.TestDamage) 2024-09-12T01:56:30.818 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:56:30.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.934+0000 7fed81d3a640 1 Processor -- start 2024-09-12T01:56:30.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.934+0000 7fed81d3a640 1 -- start start 2024-09-12T01:56:30.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.935+0000 7fed81d3a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fed7c0b3760 0x7fed7c0b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:30.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.935+0000 7fed81d3a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed7c06cd20 0x7fed7c162340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:30.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.935+0000 7fed81d3a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed7c0b2790 con 0x7fed7c09aa30 2024-09-12T01:56:30.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.935+0000 7fed81d3a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fed7c0d0670 con 0x7fed7c0b3760 2024-09-12T01:56:30.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.935+0000 7fed81d3a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fed7c0b2a70 con 0x7fed7c06cd20 2024-09-12T01:56:30.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.935+0000 7fed7affd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fed7c0b3760 0x7fed7c0b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:30.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.935+0000 7fed7bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed7c06cd20 0x7fed7c162340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:30.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.935+0000 7fed7b7fe640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fed7c09aa30 0x7fed7c09ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:60394/0 (socket says 172.21.15.19:60394) 2024-09-12T01:56:30.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.935+0000 7fed7b7fe640 1 -- 172.21.15.19:0/4158032876 learned_addr learned my addr 172.21.15.19:0/4158032876 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:30.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.935+0000 7fed7a7fc640 1 -- 172.21.15.19:0/4158032876 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4216901028 0 0) 0x7fed7c0b2790 con 0x7fed7c09aa30 2024-09-12T01:56:30.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.935+0000 7fed7a7fc640 1 -- 172.21.15.19:0/4158032876 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed64003520 con 0x7fed7c09aa30 2024-09-12T01:56:30.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.935+0000 7fed7bfff640 1 -- 172.21.15.19:0/4158032876 >> v2:172.21.15.135:3300/0 conn(0x7fed7c0b3760 msgr2=0x7fed7c0b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:30.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.935+0000 7fed7bfff640 1 --2- 172.21.15.19:0/4158032876 >> v2:172.21.15.135:3300/0 conn(0x7fed7c0b3760 0x7fed7c0b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:30.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.935+0000 7fed7bfff640 1 -- 172.21.15.19:0/4158032876 >> v1:172.21.15.135:6789/0 conn(0x7fed7c09aa30 legacy=0x7fed7c09ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:30.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.935+0000 7fed7bfff640 1 -- 172.21.15.19:0/4158032876 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7c0b2d50 con 0x7fed7c06cd20 2024-09-12T01:56:30.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.935+0000 7fed7affd640 1 --2- 172.21.15.19:0/4158032876 >> v2:172.21.15.135:3300/0 conn(0x7fed7c0b3760 0x7fed7c0b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:30.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.936+0000 7fed7bfff640 1 --2- 172.21.15.19:0/4158032876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed7c06cd20 0x7fed7c162340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fed74009d90 tx=0x7fed7402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a474af273f81afb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:30.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.936+0000 7fed7a7fc640 1 -- 172.21.15.19:0/4158032876 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74031600 con 0x7fed7c06cd20 2024-09-12T01:56:30.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.936+0000 7fed7a7fc640 1 -- 172.21.15.19:0/4158032876 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed740317a0 con 0x7fed7c06cd20 2024-09-12T01:56:30.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.936+0000 7fed7a7fc640 1 -- 172.21.15.19:0/4158032876 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74031b70 con 0x7fed7c06cd20 2024-09-12T01:56:30.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.937+0000 7fed81d3a640 1 -- 172.21.15.19:0/4158032876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed7c06cd20 msgr2=0x7fed7c162340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:30.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.937+0000 7fed81d3a640 1 --2- 172.21.15.19:0/4158032876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed7c06cd20 0x7fed7c162340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fed74009d90 tx=0x7fed7402a5d0 comp rx=0 tx=0).stop 2024-09-12T01:56:30.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.937+0000 7fed81d3a640 1 -- 172.21.15.19:0/4158032876 shutdown_connections 2024-09-12T01:56:30.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.937+0000 7fed81d3a640 1 --2- 172.21.15.19:0/4158032876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed7c06cd20 0x7fed7c162340 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:30.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.937+0000 7fed81d3a640 1 --2- 172.21.15.19:0/4158032876 >> v2:172.21.15.135:3300/0 conn(0x7fed7c0b3760 0x7fed7c0b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:30.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.937+0000 7fed81d3a640 1 -- 172.21.15.19:0/4158032876 >> 172.21.15.19:0/4158032876 conn(0x7fed7c0d23a0 msgr2=0x7fed7c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:30.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.937+0000 7fed81d3a640 1 -- 172.21.15.19:0/4158032876 shutdown_connections 2024-09-12T01:56:30.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.937+0000 7fed81d3a640 1 -- 172.21.15.19:0/4158032876 wait complete. 2024-09-12T01:56:30.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.938+0000 7fed81d3a640 1 Processor -- start 2024-09-12T01:56:30.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.938+0000 7fed81d3a640 1 -- start start 2024-09-12T01:56:30.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.939+0000 7fed81d3a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed7c06cd20 0x7fed7c0c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:30.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.939+0000 7fed81d3a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed7c09aa30 0x7fed7c1f4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:30.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.939+0000 7fed81d3a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed7c0b3760 0x7fed7c0cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:30.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.939+0000 7fed81d3a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c15fe20 con 0x7fed7c06cd20 2024-09-12T01:56:30.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.939+0000 7fed81d3a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c15fca0 con 0x7fed7c0b3760 2024-09-12T01:56:30.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.939+0000 7fed81d3a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fed7c0d1fe0 con 0x7fed7c09aa30 2024-09-12T01:56:30.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.939+0000 7fed7b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed7c06cd20 0x7fed7c0c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:30.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.939+0000 7fed7b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed7c06cd20 0x7fed7c0c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60084/0 (socket says 172.21.15.19:60084) 2024-09-12T01:56:30.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.939+0000 7fed7b7fe640 1 -- 172.21.15.19:0/4128919714 learned_addr learned my addr 172.21.15.19:0/4128919714 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:30.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.939+0000 7fed7affd640 1 --2- 172.21.15.19:0/4128919714 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed7c09aa30 0x7fed7c1f4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:30.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.939+0000 7fed7bfff640 1 --2- 172.21.15.19:0/4128919714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed7c0b3760 0x7fed7c0cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:30.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.940+0000 7fed7b7fe640 1 -- 172.21.15.19:0/4128919714 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed7c09aa30 msgr2=0x7fed7c1f4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:30.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.940+0000 7fed7b7fe640 1 --2- 172.21.15.19:0/4128919714 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed7c09aa30 0x7fed7c1f4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:30.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.940+0000 7fed7b7fe640 1 -- 172.21.15.19:0/4128919714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed7c0b3760 msgr2=0x7fed7c0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:30.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.940+0000 7fed7b7fe640 1 --2- 172.21.15.19:0/4128919714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed7c0b3760 0x7fed7c0cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:30.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.940+0000 7fed7b7fe640 1 -- 172.21.15.19:0/4128919714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7c1611f0 con 0x7fed7c06cd20 2024-09-12T01:56:30.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.940+0000 7fed7b7fe640 1 --2- 172.21.15.19:0/4128919714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed7c06cd20 0x7fed7c0c9470 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fed6c00c430 tx=0x7fed6c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:30.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.940+0000 7fed63fff640 1 -- 172.21.15.19:0/4128919714 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6c017070 con 0x7fed7c06cd20 2024-09-12T01:56:30.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.940+0000 7fed63fff640 1 -- 172.21.15.19:0/4128919714 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed6c005ce0 con 0x7fed7c06cd20 2024-09-12T01:56:30.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.940+0000 7fed63fff640 1 -- 172.21.15.19:0/4128919714 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6c0072f0 con 0x7fed7c06cd20 2024-09-12T01:56:30.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.940+0000 7fed81d3a640 1 -- 172.21.15.19:0/4128919714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed7c0ce510 con 0x7fed7c06cd20 2024-09-12T01:56:30.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.940+0000 7fed81d3a640 1 -- 172.21.15.19:0/4128919714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed7c1f57a0 con 0x7fed7c06cd20 2024-09-12T01:56:30.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.941+0000 7fed81d3a640 1 -- 172.21.15.19:0/4128919714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed7c0b3030 con 0x7fed7c06cd20 2024-09-12T01:56:30.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.942+0000 7fed63fff640 1 -- 172.21.15.19:0/4128919714 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed6c01a070 con 0x7fed7c06cd20 2024-09-12T01:56:30.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.942+0000 7fed63fff640 1 --2- 172.21.15.19:0/4128919714 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fed6806be30 0x7fed6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:30.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.942+0000 7fed63fff640 1 -- 172.21.15.19:0/4128919714 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fed6c08a560 con 0x7fed7c06cd20 2024-09-12T01:56:30.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.942+0000 7fed7affd640 1 --2- 172.21.15.19:0/4128919714 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fed6806be30 0x7fed6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:30.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.943+0000 7fed7affd640 1 --2- 172.21.15.19:0/4128919714 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fed6806be30 0x7fed6806e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fed70009560 tx=0x7fed70009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:30.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:30.947+0000 7fed63fff640 1 -- 172.21.15.19:0/4128919714 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed6c058610 con 0x7fed7c06cd20 2024-09-12T01:56:31.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.126+0000 7fed81d3a640 1 -- 172.21.15.19:0/4128919714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed7c0b1be0 con 0x7fed7c06cd20 2024-09-12T01:56:31.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.128+0000 7fed63fff640 1 -- 172.21.15.19:0/4128919714 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18586 (secure 0 0 0) 0x7fed6c05c910 con 0x7fed7c06cd20 2024-09-12T01:56:31.128 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:31.128 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:56:01.739727+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:52.899670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:54.099981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:55:57.729901+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:31.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.130+0000 7fed81d3a640 1 -- 172.21.15.19:0/4128919714 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fed6806be30 msgr2=0x7fed6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.130+0000 7fed81d3a640 1 --2- 172.21.15.19:0/4128919714 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fed6806be30 0x7fed6806e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fed70009560 tx=0x7fed70009190 comp rx=0 tx=0).stop 2024-09-12T01:56:31.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.130+0000 7fed81d3a640 1 -- 172.21.15.19:0/4128919714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed7c06cd20 msgr2=0x7fed7c0c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.130+0000 7fed81d3a640 1 --2- 172.21.15.19:0/4128919714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed7c06cd20 0x7fed7c0c9470 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fed6c00c430 tx=0x7fed6c00c8f0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.130+0000 7fed81d3a640 1 -- 172.21.15.19:0/4128919714 shutdown_connections 2024-09-12T01:56:31.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.130+0000 7fed81d3a640 1 --2- 172.21.15.19:0/4128919714 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fed6806be30 0x7fed6806e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.130+0000 7fed81d3a640 1 --2- 172.21.15.19:0/4128919714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed7c0b3760 0x7fed7c0cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.130+0000 7fed81d3a640 1 --2- 172.21.15.19:0/4128919714 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed7c09aa30 0x7fed7c1f4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.130+0000 7fed81d3a640 1 --2- 172.21.15.19:0/4128919714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed7c06cd20 0x7fed7c0c9470 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.130+0000 7fed81d3a640 1 -- 172.21.15.19:0/4128919714 >> 172.21.15.19:0/4128919714 conn(0x7fed7c0d23a0 msgr2=0x7fed7c0af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:31.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.130+0000 7fed81d3a640 1 -- 172.21.15.19:0/4128919714 shutdown_connections 2024-09-12T01:56:31.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.130+0000 7fed81d3a640 1 -- 172.21.15.19:0/4128919714 wait complete. 2024-09-12T01:56:31.142 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:55:44.127030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T01:55:52.899670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T01:55:54.099981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-12T01:55:57.729901+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-12T01:56:31.142 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:56:31.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.247+0000 7fa50f366640 1 Processor -- start 2024-09-12T01:56:31.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.247+0000 7fa50f366640 1 -- start start 2024-09-12T01:56:31.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.248+0000 7fa50f366640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa5080b5f80 0x7fa508162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.248+0000 7fa50f366640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5080d3320 0x7fa5080d37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.248+0000 7fa50f366640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5080d2600 con 0x7fa5080d4c10 2024-09-12T01:56:31.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.248+0000 7fa50f366640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa5080d5420 con 0x7fa5080b5f80 2024-09-12T01:56:31.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.248+0000 7fa50f366640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa5080d2e90 con 0x7fa5080d3320 2024-09-12T01:56:31.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.248+0000 7fa50d102640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa5080b5f80 0x7fa508162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.248+0000 7fa50d903640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5080d3320 0x7fa5080d37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.248+0000 7fa50c901640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fa5080d4c10 0x7fa5080b6360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:51974/0 (socket says 172.21.15.19:51974) 2024-09-12T01:56:31.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.248+0000 7fa50c901640 1 -- 172.21.15.19:0/3746333715 learned_addr learned my addr 172.21.15.19:0/3746333715 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:31.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.249+0000 7fa50d102640 1 -- 172.21.15.19:0/3746333715 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5080d3320 msgr2=0x7fa5080d37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:31.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.249+0000 7fa50d102640 1 --2- 172.21.15.19:0/3746333715 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5080d3320 0x7fa5080d37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.249+0000 7fa50d102640 1 -- 172.21.15.19:0/3746333715 >> v1:172.21.15.135:6789/0 conn(0x7fa5080d4c10 legacy=0x7fa5080b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.249+0000 7fa50d102640 1 -- 172.21.15.19:0/3746333715 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5080b3c10 con 0x7fa5080b5f80 2024-09-12T01:56:31.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.249+0000 7fa507fff640 1 -- 172.21.15.19:0/3746333715 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 342138367 0 0) 0x7fa4fc001110 con 0x7fa5080d4c10 2024-09-12T01:56:31.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.249+0000 7fa50d102640 1 --2- 172.21.15.19:0/3746333715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5080b5f80 0x7fa508162980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009dc0 tx=0x7fa4f802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=504d503cc669c19a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:31.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.250+0000 7fa507fff640 1 -- 172.21.15.19:0/3746333715 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f802ae60 con 0x7fa5080b5f80 2024-09-12T01:56:31.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.250+0000 7fa507fff640 1 -- 172.21.15.19:0/3746333715 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f8007740 con 0x7fa5080b5f80 2024-09-12T01:56:31.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.250+0000 7fa507fff640 1 -- 172.21.15.19:0/3746333715 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8007b10 con 0x7fa5080b5f80 2024-09-12T01:56:31.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.250+0000 7fa50f366640 1 -- 172.21.15.19:0/3746333715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5080b5f80 msgr2=0x7fa508162980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.250+0000 7fa50f366640 1 --2- 172.21.15.19:0/3746333715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5080b5f80 0x7fa508162980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009dc0 tx=0x7fa4f802a680 comp rx=0 tx=0).stop 2024-09-12T01:56:31.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.250+0000 7fa50f366640 1 -- 172.21.15.19:0/3746333715 shutdown_connections 2024-09-12T01:56:31.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.250+0000 7fa50f366640 1 --2- 172.21.15.19:0/3746333715 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5080d3320 0x7fa5080d37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.250+0000 7fa50f366640 1 --2- 172.21.15.19:0/3746333715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5080b5f80 0x7fa508162980 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.250+0000 7fa50f366640 1 -- 172.21.15.19:0/3746333715 >> 172.21.15.19:0/3746333715 conn(0x7fa50808bfc0 msgr2=0x7fa5080d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:31.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.250+0000 7fa50f366640 1 -- 172.21.15.19:0/3746333715 shutdown_connections 2024-09-12T01:56:31.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.250+0000 7fa50f366640 1 -- 172.21.15.19:0/3746333715 wait complete. 2024-09-12T01:56:31.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.251+0000 7fa50f366640 1 Processor -- start 2024-09-12T01:56:31.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.251+0000 7fa50f366640 1 -- start start 2024-09-12T01:56:31.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.252+0000 7fa50f366640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5080b5f80 0x7fa508154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.252+0000 7fa50f366640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5080d3320 0x7fa5080c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.252+0000 7fa50f366640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5080d4c10 0x7fa5080c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.252+0000 7fa50f366640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa5080d2b20 con 0x7fa5080d3320 2024-09-12T01:56:31.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.252+0000 7fa50f366640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa5080d2880 con 0x7fa5080d4c10 2024-09-12T01:56:31.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.252+0000 7fa50f366640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa50815f690 con 0x7fa5080b5f80 2024-09-12T01:56:31.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.252+0000 7fa50c901640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5080d3320 0x7fa5080c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.252+0000 7fa50c901640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5080d3320 0x7fa5080c9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36332/0 (socket says 172.21.15.19:36332) 2024-09-12T01:56:31.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.252+0000 7fa50c901640 1 -- 172.21.15.19:0/3614227073 learned_addr learned my addr 172.21.15.19:0/3614227073 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:31.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.252+0000 7fa50d102640 1 --2- 172.21.15.19:0/3614227073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5080b5f80 0x7fa508154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.252+0000 7fa50d903640 1 --2- 172.21.15.19:0/3614227073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5080d4c10 0x7fa5080c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.253+0000 7fa50c901640 1 -- 172.21.15.19:0/3614227073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5080b5f80 msgr2=0x7fa508154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.253+0000 7fa50c901640 1 --2- 172.21.15.19:0/3614227073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5080b5f80 0x7fa508154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.253+0000 7fa50c901640 1 -- 172.21.15.19:0/3614227073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5080d4c10 msgr2=0x7fa5080c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.253+0000 7fa50c901640 1 --2- 172.21.15.19:0/3614227073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5080d4c10 0x7fa5080c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.253+0000 7fa50c901640 1 -- 172.21.15.19:0/3614227073 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5080c9f80 con 0x7fa5080d3320 2024-09-12T01:56:31.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.253+0000 7fa50c901640 1 --2- 172.21.15.19:0/3614227073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5080d3320 0x7fa5080c9410 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00c460 tx=0x7fa4fc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:31.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.253+0000 7fa505ffb640 1 -- 172.21.15.19:0/3614227073 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc018070 con 0x7fa5080d3320 2024-09-12T01:56:31.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.253+0000 7fa505ffb640 1 -- 172.21.15.19:0/3614227073 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4fc007500 con 0x7fa5080d3320 2024-09-12T01:56:31.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.253+0000 7fa50f366640 1 -- 172.21.15.19:0/3614227073 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5080ca260 con 0x7fa5080d3320 2024-09-12T01:56:31.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.253+0000 7fa505ffb640 1 -- 172.21.15.19:0/3614227073 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc004a20 con 0x7fa5080d3320 2024-09-12T01:56:31.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.253+0000 7fa50f366640 1 -- 172.21.15.19:0/3614227073 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5080b73d0 con 0x7fa5080d3320 2024-09-12T01:56:31.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.254+0000 7fa50f366640 1 -- 172.21.15.19:0/3614227073 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5080d37b0 con 0x7fa5080d3320 2024-09-12T01:56:31.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.254+0000 7fa505ffb640 1 -- 172.21.15.19:0/3614227073 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4fc004bc0 con 0x7fa5080d3320 2024-09-12T01:56:31.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.255+0000 7fa505ffb640 1 --2- 172.21.15.19:0/3614227073 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa4f406be30 0x7fa4f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.255+0000 7fa505ffb640 1 -- 172.21.15.19:0/3614227073 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa4fc08a450 con 0x7fa5080d3320 2024-09-12T01:56:31.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.255+0000 7fa50d102640 1 --2- 172.21.15.19:0/3614227073 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa4f406be30 0x7fa4f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.256+0000 7fa50d102640 1 --2- 172.21.15.19:0/3614227073 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa4f406be30 0x7fa4f406e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8034000 tx=0x7fa4f802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:31.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.259+0000 7fa505ffb640 1 -- 172.21.15.19:0/3614227073 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa5080d2600 con 0x7fa5080d3320 2024-09-12T01:56:31.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.432+0000 7fa50f366640 1 -- 172.21.15.19:0/3614227073 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa50815c540 con 0x7fa5080d3320 2024-09-12T01:56:31.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.433+0000 7fa505ffb640 1 -- 172.21.15.19:0/3614227073 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fa4fc058480 con 0x7fa5080d3320 2024-09-12T01:56:31.434 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-09-12T01:56:31.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.435+0000 7fa50f366640 1 -- 172.21.15.19:0/3614227073 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa4f406be30 msgr2=0x7fa4f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.435+0000 7fa50f366640 1 --2- 172.21.15.19:0/3614227073 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa4f406be30 0x7fa4f406e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8034000 tx=0x7fa4f802f000 comp rx=0 tx=0).stop 2024-09-12T01:56:31.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.435+0000 7fa50f366640 1 -- 172.21.15.19:0/3614227073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5080d3320 msgr2=0x7fa5080c9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.435+0000 7fa50f366640 1 --2- 172.21.15.19:0/3614227073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5080d3320 0x7fa5080c9410 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00c460 tx=0x7fa4fc00c920 comp rx=0 tx=0).stop 2024-09-12T01:56:31.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.435+0000 7fa50f366640 1 -- 172.21.15.19:0/3614227073 shutdown_connections 2024-09-12T01:56:31.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.435+0000 7fa50f366640 1 --2- 172.21.15.19:0/3614227073 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa4f406be30 0x7fa4f406e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.435+0000 7fa50f366640 1 --2- 172.21.15.19:0/3614227073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5080d4c10 0x7fa5080c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.435+0000 7fa50f366640 1 --2- 172.21.15.19:0/3614227073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5080d3320 0x7fa5080c9410 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.435+0000 7fa50f366640 1 --2- 172.21.15.19:0/3614227073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5080b5f80 0x7fa508154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.435+0000 7fa50f366640 1 -- 172.21.15.19:0/3614227073 >> 172.21.15.19:0/3614227073 conn(0x7fa50808bfc0 msgr2=0x7fa508161410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:31.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.435+0000 7fa50f366640 1 -- 172.21.15.19:0/3614227073 shutdown_connections 2024-09-12T01:56:31.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.435+0000 7fa50f366640 1 -- 172.21.15.19:0/3614227073 wait complete. 2024-09-12T01:56:31.446 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T01:56:31.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.551+0000 7fc60a417640 1 Processor -- start 2024-09-12T01:56:31.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.552+0000 7fc60a417640 1 -- start start 2024-09-12T01:56:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.552+0000 7fc60a417640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc60409b140 0x7fc6040b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.552+0000 7fc60a417640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc60406cec0 con 0x7fc60415e660 2024-09-12T01:56:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.552+0000 7fc60a417640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc60406d160 con 0x7fc6040af240 2024-09-12T01:56:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.552+0000 7fc60a417640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc60415ea40 con 0x7fc60409b140 2024-09-12T01:56:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.553+0000 7fc603fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc60415e660 0x7fc60409aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38240/0 (socket says 172.21.15.19:38240) 2024-09-12T01:56:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.553+0000 7fc603fff640 1 -- 172.21.15.19:0/1074323452 learned_addr learned my addr 172.21.15.19:0/1074323452 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.553+0000 7fc5fbfff640 1 --2- 172.21.15.19:0/1074323452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc60409b140 0x7fc6040b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.553+0000 7fc6037fe640 1 -- 172.21.15.19:0/1074323452 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 424206817 0 0) 0x7fc60406cec0 con 0x7fc60415e660 2024-09-12T01:56:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.553+0000 7fc6037fe640 1 -- 172.21.15.19:0/1074323452 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5f0003520 con 0x7fc60415e660 2024-09-12T01:56:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.553+0000 7fc6037fe640 1 -- 172.21.15.19:0/1074323452 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2373497882 0 0) 0x7fc60406d160 con 0x7fc6040af240 2024-09-12T01:56:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.553+0000 7fc6037fe640 1 -- 172.21.15.19:0/1074323452 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc60406cec0 con 0x7fc6040af240 2024-09-12T01:56:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.553+0000 7fc5fbfff640 1 -- 172.21.15.19:0/1074323452 >> v1:172.21.15.135:6789/0 conn(0x7fc6040af240 legacy=0x7fc60406df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.553+0000 7fc5fbfff640 1 -- 172.21.15.19:0/1074323452 >> v1:172.21.15.19:6789/0 conn(0x7fc60415e660 legacy=0x7fc60409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.553+0000 7fc6037fe640 1 -- 172.21.15.19:0/1074323452 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3504497561 0 0) 0x7fc5f0003520 con 0x7fc60415e660 2024-09-12T01:56:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.553+0000 7fc5fbfff640 1 -- 172.21.15.19:0/1074323452 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60406d440 con 0x7fc60409b140 2024-09-12T01:56:31.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.554+0000 7fc5fbfff640 1 --2- 172.21.15.19:0/1074323452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc60409b140 0x7fc6040b6be0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0097d0 tx=0x7fc5ec02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a37cba0c155b317 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:31.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.554+0000 7fc6037fe640 1 -- 172.21.15.19:0/1074323452 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec037070 con 0x7fc60409b140 2024-09-12T01:56:31.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.554+0000 7fc6037fe640 1 -- 172.21.15.19:0/1074323452 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5ec02ac30 con 0x7fc60409b140 2024-09-12T01:56:31.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.554+0000 7fc6037fe640 1 -- 172.21.15.19:0/1074323452 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4001670 con 0x7fc60409b140 2024-09-12T01:56:31.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.555+0000 7fc60a417640 1 -- 172.21.15.19:0/1074323452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc60409b140 msgr2=0x7fc6040b6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.555+0000 7fc60a417640 1 --2- 172.21.15.19:0/1074323452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc60409b140 0x7fc6040b6be0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0097d0 tx=0x7fc5ec02a1a0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.555+0000 7fc60a417640 1 -- 172.21.15.19:0/1074323452 shutdown_connections 2024-09-12T01:56:31.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.555+0000 7fc60a417640 1 --2- 172.21.15.19:0/1074323452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc60409b140 0x7fc6040b6be0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.555+0000 7fc60a417640 1 -- 172.21.15.19:0/1074323452 >> 172.21.15.19:0/1074323452 conn(0x7fc6040b3f60 msgr2=0x7fc6040b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:31.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.555+0000 7fc60a417640 1 -- 172.21.15.19:0/1074323452 shutdown_connections 2024-09-12T01:56:31.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.555+0000 7fc60a417640 1 -- 172.21.15.19:0/1074323452 wait complete. 2024-09-12T01:56:31.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.556+0000 7fc60a417640 1 Processor -- start 2024-09-12T01:56:31.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.556+0000 7fc60a417640 1 -- start start 2024-09-12T01:56:31.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.557+0000 7fc60a417640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc60409b140 0x7fc604150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.557+0000 7fc60a417640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6040af240 0x7fc6040cd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.557+0000 7fc60a417640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc60415e660 0x7fc604160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.557+0000 7fc60a417640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc6040b7120 con 0x7fc60409b140 2024-09-12T01:56:31.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.557+0000 7fc60a417640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc60406da90 con 0x7fc60415e660 2024-09-12T01:56:31.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.557+0000 7fc60a417640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc6040b72a0 con 0x7fc6040af240 2024-09-12T01:56:31.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.557+0000 7fc603fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc60409b140 0x7fc604150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.557+0000 7fc603fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc60409b140 0x7fc604150130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36338/0 (socket says 172.21.15.19:36338) 2024-09-12T01:56:31.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.557+0000 7fc603fff640 1 -- 172.21.15.19:0/748243560 learned_addr learned my addr 172.21.15.19:0/748243560 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:31.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.557+0000 7fc5fbfff640 1 --2- 172.21.15.19:0/748243560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6040af240 0x7fc6040cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.557+0000 7fc6089b4640 1 --2- 172.21.15.19:0/748243560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc60415e660 0x7fc604160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.557+0000 7fc603fff640 1 -- 172.21.15.19:0/748243560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6040af240 msgr2=0x7fc6040cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.557+0000 7fc603fff640 1 --2- 172.21.15.19:0/748243560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6040af240 0x7fc6040cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.557+0000 7fc603fff640 1 -- 172.21.15.19:0/748243560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc60415e660 msgr2=0x7fc604160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.557+0000 7fc603fff640 1 --2- 172.21.15.19:0/748243560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc60415e660 0x7fc604160770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.557+0000 7fc603fff640 1 -- 172.21.15.19:0/748243560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6040cbff0 con 0x7fc60409b140 2024-09-12T01:56:31.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.557+0000 7fc603fff640 1 --2- 172.21.15.19:0/748243560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc60409b140 0x7fc604150130 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc5f400c4f0 tx=0x7fc5f400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:31.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.558+0000 7fc6017fa640 1 -- 172.21.15.19:0/748243560 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4017070 con 0x7fc60409b140 2024-09-12T01:56:31.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.558+0000 7fc60a417640 1 -- 172.21.15.19:0/748243560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6040cc2d0 con 0x7fc60409b140 2024-09-12T01:56:31.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.558+0000 7fc6017fa640 1 -- 172.21.15.19:0/748243560 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f4005ce0 con 0x7fc60409b140 2024-09-12T01:56:31.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.558+0000 7fc6017fa640 1 -- 172.21.15.19:0/748243560 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4007290 con 0x7fc60409b140 2024-09-12T01:56:31.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.558+0000 7fc60a417640 1 -- 172.21.15.19:0/748243560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6040cc890 con 0x7fc60409b140 2024-09-12T01:56:31.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.559+0000 7fc60a417640 1 -- 172.21.15.19:0/748243560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6040b6be0 con 0x7fc60409b140 2024-09-12T01:56:31.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.559+0000 7fc6017fa640 1 -- 172.21.15.19:0/748243560 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc5f401a070 con 0x7fc60409b140 2024-09-12T01:56:31.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.559+0000 7fc6017fa640 1 --2- 172.21.15.19:0/748243560 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc5e406be30 0x7fc5e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.560+0000 7fc6017fa640 1 -- 172.21.15.19:0/748243560 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc5f408a5d0 con 0x7fc60409b140 2024-09-12T01:56:31.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.560+0000 7fc5fbfff640 1 --2- 172.21.15.19:0/748243560 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc5e406be30 0x7fc5e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.560+0000 7fc5fbfff640 1 --2- 172.21.15.19:0/748243560 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc5e406be30 0x7fc5e406e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec034000 tx=0x7fc5ec02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:31.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.564+0000 7fc6017fa640 1 -- 172.21.15.19:0/748243560 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc5f4058570 con 0x7fc60409b140 2024-09-12T01:56:31.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.740+0000 7fc60a417640 1 -- 172.21.15.19:0/748243560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc6040cf500 con 0x7fc60409b140 2024-09-12T01:56:31.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.740+0000 7fc6017fa640 1 -- 172.21.15.19:0/748243560 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fc5f405c870 con 0x7fc60409b140 2024-09-12T01:56:31.741 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-09-12T01:56:31.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.742+0000 7fc60a417640 1 -- 172.21.15.19:0/748243560 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc5e406be30 msgr2=0x7fc5e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.742+0000 7fc60a417640 1 --2- 172.21.15.19:0/748243560 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc5e406be30 0x7fc5e406e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec034000 tx=0x7fc5ec02e000 comp rx=0 tx=0).stop 2024-09-12T01:56:31.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.742+0000 7fc60a417640 1 -- 172.21.15.19:0/748243560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc60409b140 msgr2=0x7fc604150130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.742+0000 7fc60a417640 1 --2- 172.21.15.19:0/748243560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc60409b140 0x7fc604150130 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc5f400c4f0 tx=0x7fc5f400c9b0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.742+0000 7fc60a417640 1 -- 172.21.15.19:0/748243560 shutdown_connections 2024-09-12T01:56:31.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.742+0000 7fc60a417640 1 --2- 172.21.15.19:0/748243560 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc5e406be30 0x7fc5e406e2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.742+0000 7fc60a417640 1 --2- 172.21.15.19:0/748243560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc60415e660 0x7fc604160770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.742+0000 7fc60a417640 1 --2- 172.21.15.19:0/748243560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6040af240 0x7fc6040cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.742+0000 7fc60a417640 1 --2- 172.21.15.19:0/748243560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc60409b140 0x7fc604150130 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.742+0000 7fc60a417640 1 -- 172.21.15.19:0/748243560 >> 172.21.15.19:0/748243560 conn(0x7fc6040b3f60 msgr2=0x7fc604071220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:31.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.743+0000 7fc60a417640 1 -- 172.21.15.19:0/748243560 shutdown_connections 2024-09-12T01:56:31.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.743+0000 7fc60a417640 1 -- 172.21.15.19:0/748243560 wait complete. 2024-09-12T01:56:31.754 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T01:56:31.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.861+0000 7ffb21952640 1 Processor -- start 2024-09-12T01:56:31.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.861+0000 7ffb21952640 1 -- start start 2024-09-12T01:56:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.862+0000 7ffb21952640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffb1c0b4020 0x7ffb1c0b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.862+0000 7ffb21952640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb1c072050 0x7ffb1c072480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.862+0000 7ffb21952640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb1c0b4620 con 0x7ffb1c15e900 2024-09-12T01:56:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.862+0000 7ffb21952640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ffb1c0b4f60 con 0x7ffb1c072050 2024-09-12T01:56:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.862+0000 7ffb21952640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ffb1c0729c0 con 0x7ffb1c0b4020 2024-09-12T01:56:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.862+0000 7ffb1affd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ffb1c15e900 0x7ffb1c0ad020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38252/0 (socket says 172.21.15.19:38252) 2024-09-12T01:56:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.862+0000 7ffb1affd640 1 -- 172.21.15.19:0/183213386 learned_addr learned my addr 172.21.15.19:0/183213386 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.862+0000 7ffb1b7fe640 1 --2- 172.21.15.19:0/183213386 >> v2:172.21.15.19:3300/0 conn(0x7ffb1c072050 0x7ffb1c072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.862+0000 7ffb13fff640 1 --2- 172.21.15.19:0/183213386 >> v2:172.21.15.135:3300/0 conn(0x7ffb1c0b4020 0x7ffb1c0b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.862+0000 7ffb1b7fe640 1 -- 172.21.15.19:0/183213386 >> v2:172.21.15.135:3300/0 conn(0x7ffb1c0b4020 msgr2=0x7ffb1c0b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:31.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.862+0000 7ffb1b7fe640 1 --2- 172.21.15.19:0/183213386 >> v2:172.21.15.135:3300/0 conn(0x7ffb1c0b4020 0x7ffb1c0b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.862+0000 7ffb1b7fe640 1 -- 172.21.15.19:0/183213386 >> v1:172.21.15.19:6789/0 conn(0x7ffb1c15e900 legacy=0x7ffb1c0ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.862+0000 7ffb1b7fe640 1 -- 172.21.15.19:0/183213386 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1c0ce100 con 0x7ffb1c072050 2024-09-12T01:56:31.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.862+0000 7ffb1a7fc640 1 -- 172.21.15.19:0/183213386 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3807133433 0 0) 0x7ffb1c0b4620 con 0x7ffb1c15e900 2024-09-12T01:56:31.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.862+0000 7ffb13fff640 1 --2- 172.21.15.19:0/183213386 >> v2:172.21.15.135:3300/0 conn(0x7ffb1c0b4020 0x7ffb1c0b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:31.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.863+0000 7ffb1b7fe640 1 --2- 172.21.15.19:0/183213386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1c072050 0x7ffb1c072480 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c071c90 tx=0x7ffb1402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2345281595813e31 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:31.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.863+0000 7ffb1a7fc640 1 -- 172.21.15.19:0/183213386 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14031600 con 0x7ffb1c072050 2024-09-12T01:56:31.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.863+0000 7ffb1a7fc640 1 -- 172.21.15.19:0/183213386 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb140317a0 con 0x7ffb1c072050 2024-09-12T01:56:31.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.863+0000 7ffb1a7fc640 1 -- 172.21.15.19:0/183213386 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14031b70 con 0x7ffb1c072050 2024-09-12T01:56:31.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.864+0000 7ffb21952640 1 -- 172.21.15.19:0/183213386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1c072050 msgr2=0x7ffb1c072480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.864+0000 7ffb21952640 1 --2- 172.21.15.19:0/183213386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1c072050 0x7ffb1c072480 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c071c90 tx=0x7ffb1402a610 comp rx=0 tx=0).stop 2024-09-12T01:56:31.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.864+0000 7ffb21952640 1 -- 172.21.15.19:0/183213386 shutdown_connections 2024-09-12T01:56:31.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.864+0000 7ffb21952640 1 --2- 172.21.15.19:0/183213386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1c072050 0x7ffb1c072480 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.864+0000 7ffb21952640 1 --2- 172.21.15.19:0/183213386 >> v2:172.21.15.135:3300/0 conn(0x7ffb1c0b4020 0x7ffb1c0b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.864+0000 7ffb21952640 1 -- 172.21.15.19:0/183213386 >> 172.21.15.19:0/183213386 conn(0x7ffb1c06bdf0 msgr2=0x7ffb1c06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:31.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.864+0000 7ffb21952640 1 -- 172.21.15.19:0/183213386 shutdown_connections 2024-09-12T01:56:31.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.864+0000 7ffb21952640 1 -- 172.21.15.19:0/183213386 wait complete. 2024-09-12T01:56:31.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.865+0000 7ffb21952640 1 Processor -- start 2024-09-12T01:56:31.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.865+0000 7ffb21952640 1 -- start start 2024-09-12T01:56:31.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.866+0000 7ffb21952640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb1c072050 0x7ffb1c153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.866+0000 7ffb21952640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb1c0b4020 0x7ffb1c0aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.866+0000 7ffb21952640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1c15e900 0x7ffb1c157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.866+0000 7ffb21952640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c0ce960 con 0x7ffb1c15e900 2024-09-12T01:56:31.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.866+0000 7ffb21952640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c0ce680 con 0x7ffb1c0b4020 2024-09-12T01:56:31.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.866+0000 7ffb21952640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1c0cee80 con 0x7ffb1c072050 2024-09-12T01:56:31.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.866+0000 7ffb1b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1c15e900 0x7ffb1c157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.866+0000 7ffb1b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1c15e900 0x7ffb1c157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36350/0 (socket says 172.21.15.19:36350) 2024-09-12T01:56:31.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.866+0000 7ffb1b7fe640 1 -- 172.21.15.19:0/4118546556 learned_addr learned my addr 172.21.15.19:0/4118546556 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:31.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.866+0000 7ffb13fff640 1 --2- 172.21.15.19:0/4118546556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb1c0b4020 0x7ffb1c0aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.866+0000 7ffb1affd640 1 --2- 172.21.15.19:0/4118546556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb1c072050 0x7ffb1c153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.866+0000 7ffb1b7fe640 1 -- 172.21.15.19:0/4118546556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb1c072050 msgr2=0x7ffb1c153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.866+0000 7ffb1b7fe640 1 --2- 172.21.15.19:0/4118546556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb1c072050 0x7ffb1c153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.866+0000 7ffb1b7fe640 1 -- 172.21.15.19:0/4118546556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb1c0b4020 msgr2=0x7ffb1c0aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.866+0000 7ffb1b7fe640 1 --2- 172.21.15.19:0/4118546556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb1c0b4020 0x7ffb1c0aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.866+0000 7ffb1b7fe640 1 -- 172.21.15.19:0/4118546556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1c0b1a50 con 0x7ffb1c15e900 2024-09-12T01:56:31.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.866+0000 7ffb1b7fe640 1 --2- 172.21.15.19:0/4118546556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1c15e900 0x7ffb1c157500 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009eb0 tx=0x7ffb14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:31.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.867+0000 7ffb18ff9640 1 -- 172.21.15.19:0/4118546556 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14040070 con 0x7ffb1c15e900 2024-09-12T01:56:31.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.867+0000 7ffb18ff9640 1 -- 172.21.15.19:0/4118546556 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb14030b60 con 0x7ffb1c15e900 2024-09-12T01:56:31.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.867+0000 7ffb21952640 1 -- 172.21.15.19:0/4118546556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb1c0af300 con 0x7ffb1c15e900 2024-09-12T01:56:31.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.867+0000 7ffb18ff9640 1 -- 172.21.15.19:0/4118546556 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14009450 con 0x7ffb1c15e900 2024-09-12T01:56:31.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.867+0000 7ffb21952640 1 -- 172.21.15.19:0/4118546556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb1c0afb40 con 0x7ffb1c15e900 2024-09-12T01:56:31.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.868+0000 7ffb21952640 1 -- 172.21.15.19:0/4118546556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb1c072480 con 0x7ffb1c15e900 2024-09-12T01:56:31.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.868+0000 7ffb18ff9640 1 -- 172.21.15.19:0/4118546556 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb14039040 con 0x7ffb1c15e900 2024-09-12T01:56:31.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.869+0000 7ffb18ff9640 1 --2- 172.21.15.19:0/4118546556 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffafc06be30 0x7ffafc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.869+0000 7ffb18ff9640 1 -- 172.21.15.19:0/4118546556 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ffb140ac8d0 con 0x7ffb1c15e900 2024-09-12T01:56:31.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.869+0000 7ffb1affd640 1 --2- 172.21.15.19:0/4118546556 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffafc06be30 0x7ffafc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.869+0000 7ffb1affd640 1 --2- 172.21.15.19:0/4118546556 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffafc06be30 0x7ffafc06e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c000f60 tx=0x7ffb0c007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:31.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:31.873+0000 7ffb18ff9640 1 -- 172.21.15.19:0/4118546556 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffb1c0af300 con 0x7ffb1c15e900 2024-09-12T01:56:32.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.050+0000 7ffb21952640 1 -- 172.21.15.19:0/4118546556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffb1c06fa20 con 0x7ffb1c15e900 2024-09-12T01:56:32.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.051+0000 7ffb18ff9640 1 -- 172.21.15.19:0/4118546556 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7ffb1407af40 con 0x7ffb1c15e900 2024-09-12T01:56:32.051 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-09-12T01:56:32.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.053+0000 7ffb21952640 1 -- 172.21.15.19:0/4118546556 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffafc06be30 msgr2=0x7ffafc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.053+0000 7ffb21952640 1 --2- 172.21.15.19:0/4118546556 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffafc06be30 0x7ffafc06e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c000f60 tx=0x7ffb0c007c00 comp rx=0 tx=0).stop 2024-09-12T01:56:32.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.053+0000 7ffb21952640 1 -- 172.21.15.19:0/4118546556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1c15e900 msgr2=0x7ffb1c157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.053+0000 7ffb21952640 1 --2- 172.21.15.19:0/4118546556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1c15e900 0x7ffb1c157500 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009eb0 tx=0x7ffb14004a40 comp rx=0 tx=0).stop 2024-09-12T01:56:32.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.053+0000 7ffb21952640 1 -- 172.21.15.19:0/4118546556 shutdown_connections 2024-09-12T01:56:32.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.053+0000 7ffb21952640 1 --2- 172.21.15.19:0/4118546556 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffafc06be30 0x7ffafc06e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.053+0000 7ffb21952640 1 --2- 172.21.15.19:0/4118546556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1c15e900 0x7ffb1c157500 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.053+0000 7ffb21952640 1 --2- 172.21.15.19:0/4118546556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb1c0b4020 0x7ffb1c0aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.053+0000 7ffb21952640 1 --2- 172.21.15.19:0/4118546556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb1c072050 0x7ffb1c153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.053+0000 7ffb21952640 1 -- 172.21.15.19:0/4118546556 >> 172.21.15.19:0/4118546556 conn(0x7ffb1c06bdf0 msgr2=0x7ffb1c0ad1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:32.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.053+0000 7ffb21952640 1 -- 172.21.15.19:0/4118546556 shutdown_connections 2024-09-12T01:56:32.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.053+0000 7ffb21952640 1 -- 172.21.15.19:0/4118546556 wait complete. 2024-09-12T01:56:32.065 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-12T01:56:32.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.171+0000 7fabd8465640 1 Processor -- start 2024-09-12T01:56:32.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.171+0000 7fabd8465640 1 -- start start 2024-09-12T01:56:32.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.172+0000 7fabd8465640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fabd0162340 0x7fabd006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.172+0000 7fabd8465640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fabd00cf280 0x7fabd0162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.172+0000 7fabd8465640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabd0162c60 0x7fabd00d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.172+0000 7fabd8465640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fabd006de90 con 0x7fabd0162340 2024-09-12T01:56:32.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.172+0000 7fabd8465640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fabd015ff70 con 0x7fabd00cf280 2024-09-12T01:56:32.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.172+0000 7fabd8465640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fabd00d4d10 con 0x7fabd0162c60 2024-09-12T01:56:32.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.172+0000 7fabd6201640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fabd0162340 0x7fabd006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.173+0000 7fabd6201640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fabd0162340 0x7fabd006d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36360/0 (socket says 172.21.15.19:36360) 2024-09-12T01:56:32.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.173+0000 7fabd6201640 1 -- 172.21.15.19:0/1115269902 learned_addr learned my addr 172.21.15.19:0/1115269902 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:32.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.173+0000 7fabd6a02640 1 --2- 172.21.15.19:0/1115269902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabd0162c60 0x7fabd00d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.173+0000 7fabd5a00640 1 --2- 172.21.15.19:0/1115269902 >> v2:172.21.15.135:3300/0 conn(0x7fabd00cf280 0x7fabd0162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.173+0000 7fabd6201640 1 -- 172.21.15.19:0/1115269902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabd0162c60 msgr2=0x7fabd00d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:32.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.173+0000 7fabd6201640 1 --2- 172.21.15.19:0/1115269902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabd0162c60 0x7fabd00d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.173+0000 7fabd6201640 1 -- 172.21.15.19:0/1115269902 >> v2:172.21.15.135:3300/0 conn(0x7fabd00cf280 msgr2=0x7fabd0162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:32.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.173+0000 7fabd6201640 1 --2- 172.21.15.19:0/1115269902 >> v2:172.21.15.135:3300/0 conn(0x7fabd00cf280 0x7fabd0162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.173+0000 7fabd6201640 1 -- 172.21.15.19:0/1115269902 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd00d4ff0 con 0x7fabd0162340 2024-09-12T01:56:32.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.174+0000 7fabd6201640 1 --2- 172.21.15.19:0/1115269902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd0162340 0x7fabd006d740 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fabd00a23d0 tx=0x7fabcc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa001b2cd1f3b495 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:32.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.174+0000 7fabd51ff640 1 -- 172.21.15.19:0/1115269902 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc037070 con 0x7fabd0162340 2024-09-12T01:56:32.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.174+0000 7fabd51ff640 1 -- 172.21.15.19:0/1115269902 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabcc032440 con 0x7fabd0162340 2024-09-12T01:56:32.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.174+0000 7fabd51ff640 1 -- 172.21.15.19:0/1115269902 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc032810 con 0x7fabd0162340 2024-09-12T01:56:32.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.174+0000 7fabd8465640 1 -- 172.21.15.19:0/1115269902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd0162340 msgr2=0x7fabd006d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.174+0000 7fabd8465640 1 --2- 172.21.15.19:0/1115269902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd0162340 0x7fabd006d740 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fabd00a23d0 tx=0x7fabcc02a140 comp rx=0 tx=0).stop 2024-09-12T01:56:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.175+0000 7fabd8465640 1 -- 172.21.15.19:0/1115269902 shutdown_connections 2024-09-12T01:56:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.175+0000 7fabd8465640 1 --2- 172.21.15.19:0/1115269902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabd0162c60 0x7fabd00d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.175+0000 7fabd8465640 1 --2- 172.21.15.19:0/1115269902 >> v2:172.21.15.135:3300/0 conn(0x7fabd00cf280 0x7fabd0162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.175+0000 7fabd8465640 1 --2- 172.21.15.19:0/1115269902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd0162340 0x7fabd006d740 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.175+0000 7fabd8465640 1 -- 172.21.15.19:0/1115269902 >> 172.21.15.19:0/1115269902 conn(0x7fabd008bfc0 msgr2=0x7fabd00d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.175+0000 7fabd8465640 1 -- 172.21.15.19:0/1115269902 shutdown_connections 2024-09-12T01:56:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.175+0000 7fabd8465640 1 -- 172.21.15.19:0/1115269902 wait complete. 2024-09-12T01:56:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.176+0000 7fabd8465640 1 Processor -- start 2024-09-12T01:56:32.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.176+0000 7fabd8465640 1 -- start start 2024-09-12T01:56:32.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd8465640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd00cf280 0x7fabd00b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd8465640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabd0162340 0x7fabd00b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd8465640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabd0162c60 0x7fabd00b9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd8465640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fabd00cf6c0 con 0x7fabd00cf280 2024-09-12T01:56:32.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd8465640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fabd00d52d0 con 0x7fabd0162340 2024-09-12T01:56:32.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd8465640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fabd01630f0 con 0x7fabd0162c60 2024-09-12T01:56:32.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd6201640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd00cf280 0x7fabd00b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd6201640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd00cf280 0x7fabd00b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36364/0 (socket says 172.21.15.19:36364) 2024-09-12T01:56:32.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd6201640 1 -- 172.21.15.19:0/169822816 learned_addr learned my addr 172.21.15.19:0/169822816 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:32.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd5a00640 1 --2- 172.21.15.19:0/169822816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabd0162340 0x7fabd00b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd6a02640 1 --2- 172.21.15.19:0/169822816 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabd0162c60 0x7fabd00b9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd6201640 1 -- 172.21.15.19:0/169822816 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabd0162c60 msgr2=0x7fabd00b9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd6201640 1 --2- 172.21.15.19:0/169822816 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabd0162c60 0x7fabd00b9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd6201640 1 -- 172.21.15.19:0/169822816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabd0162340 msgr2=0x7fabd00b8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd6201640 1 --2- 172.21.15.19:0/169822816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabd0162340 0x7fabd00b8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd6201640 1 -- 172.21.15.19:0/169822816 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd00cdc90 con 0x7fabd00cf280 2024-09-12T01:56:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd6201640 1 --2- 172.21.15.19:0/169822816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd00cf280 0x7fabd00b4b50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fabcc02a180 tx=0x7fabcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabc6ffd640 1 -- 172.21.15.19:0/169822816 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc041020 con 0x7fabd00cf280 2024-09-12T01:56:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabc6ffd640 1 -- 172.21.15.19:0/169822816 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabcc0306c0 con 0x7fabd00cf280 2024-09-12T01:56:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd8465640 1 -- 172.21.15.19:0/169822816 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd00b8170 con 0x7fabd00cf280 2024-09-12T01:56:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabc6ffd640 1 -- 172.21.15.19:0/169822816 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc037040 con 0x7fabd00cf280 2024-09-12T01:56:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.177+0000 7fabd8465640 1 -- 172.21.15.19:0/169822816 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd00b8730 con 0x7fabd00cf280 2024-09-12T01:56:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.178+0000 7fabd8465640 1 -- 172.21.15.19:0/169822816 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabd0162720 con 0x7fabd00cf280 2024-09-12T01:56:32.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.179+0000 7fabc6ffd640 1 -- 172.21.15.19:0/169822816 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fabcc044020 con 0x7fabd00cf280 2024-09-12T01:56:32.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.179+0000 7fabc6ffd640 1 --2- 172.21.15.19:0/169822816 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabb406be30 0x7fabb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.179+0000 7fabc6ffd640 1 -- 172.21.15.19:0/169822816 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fabcc0ab950 con 0x7fabd00cf280 2024-09-12T01:56:32.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.180+0000 7fabd5a00640 1 --2- 172.21.15.19:0/169822816 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabb406be30 0x7fabb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.180+0000 7fabd5a00640 1 --2- 172.21.15.19:0/169822816 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabb406be30 0x7fabb406e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fabd00b4150 tx=0x7fabc0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:32.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.184+0000 7fabc6ffd640 1 -- 172.21.15.19:0/169822816 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fabcc04b030 con 0x7fabd00cf280 2024-09-12T01:56:32.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.358+0000 7fabd8465640 1 -- 172.21.15.19:0/169822816 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fabd008e640 con 0x7fabd00cf280 2024-09-12T01:56:32.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.358+0000 7fabc6ffd640 1 -- 172.21.15.19:0/169822816 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fabcc07a050 con 0x7fabd00cf280 2024-09-12T01:56:32.359 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-09-12T01:56:32.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.360+0000 7fabd8465640 1 -- 172.21.15.19:0/169822816 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabb406be30 msgr2=0x7fabb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.360+0000 7fabd8465640 1 --2- 172.21.15.19:0/169822816 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabb406be30 0x7fabb406e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fabd00b4150 tx=0x7fabc0008040 comp rx=0 tx=0).stop 2024-09-12T01:56:32.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.360+0000 7fabd8465640 1 -- 172.21.15.19:0/169822816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd00cf280 msgr2=0x7fabd00b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.360+0000 7fabd8465640 1 --2- 172.21.15.19:0/169822816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd00cf280 0x7fabd00b4b50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fabcc02a180 tx=0x7fabcc0046c0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.360+0000 7fabd8465640 1 -- 172.21.15.19:0/169822816 shutdown_connections 2024-09-12T01:56:32.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.360+0000 7fabd8465640 1 --2- 172.21.15.19:0/169822816 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabb406be30 0x7fabb406e2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.360+0000 7fabd8465640 1 --2- 172.21.15.19:0/169822816 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabd0162c60 0x7fabd00b9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.360+0000 7fabd8465640 1 --2- 172.21.15.19:0/169822816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabd0162340 0x7fabd00b8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.360+0000 7fabd8465640 1 --2- 172.21.15.19:0/169822816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabd00cf280 0x7fabd00b4b50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.360+0000 7fabd8465640 1 -- 172.21.15.19:0/169822816 >> 172.21.15.19:0/169822816 conn(0x7fabd008bfc0 msgr2=0x7fabd01619b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:32.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.360+0000 7fabd8465640 1 -- 172.21.15.19:0/169822816 shutdown_connections 2024-09-12T01:56:32.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.361+0000 7fabd8465640 1 -- 172.21.15.19:0/169822816 wait complete. 2024-09-12T01:56:32.372 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_damage.TestDamage.test_damaged_dentry' 2024-09-12T01:56:32.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.475+0000 7fdc2656d640 1 Processor -- start 2024-09-12T01:56:32.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.475+0000 7fdc2656d640 1 -- start start 2024-09-12T01:56:32.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.476+0000 7fdc2656d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdc20161c80 0x7fdc2006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.476+0000 7fdc2656d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc2006e870 con 0x7fdc200b6680 2024-09-12T01:56:32.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.476+0000 7fdc2656d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc2006d9f0 con 0x7fdc20162060 2024-09-12T01:56:32.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.476+0000 7fdc2656d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fdc2006dcd0 con 0x7fdc20161c80 2024-09-12T01:56:32.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.476+0000 7fdc24b0a640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdc200b6680 0x7fdc200cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38254/0 (socket says 172.21.15.19:38254) 2024-09-12T01:56:32.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.476+0000 7fdc24b0a640 1 -- 172.21.15.19:0/4196995658 learned_addr learned my addr 172.21.15.19:0/4196995658 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:32.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.476+0000 7fdc1ffff640 1 --2- 172.21.15.19:0/4196995658 >> v2:172.21.15.135:3300/0 conn(0x7fdc20161c80 0x7fdc2006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.476+0000 7fdc1f7fe640 1 -- 172.21.15.19:0/4196995658 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1638364327 0 0) 0x7fdc18001490 con 0x7fdc200b6680 2024-09-12T01:56:32.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.477+0000 7fdc1f7fe640 1 -- 172.21.15.19:0/4196995658 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc0c003520 con 0x7fdc200b6680 2024-09-12T01:56:32.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.477+0000 7fdc1f7fe640 1 -- 172.21.15.19:0/4196995658 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4178102963 0 0) 0x7fdc0c003520 con 0x7fdc200b6680 2024-09-12T01:56:32.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.477+0000 7fdc1ffff640 1 -- 172.21.15.19:0/4196995658 >> v1:172.21.15.135:6789/0 conn(0x7fdc20162060 legacy=0x7fdc200b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.477+0000 7fdc1ffff640 1 -- 172.21.15.19:0/4196995658 >> v1:172.21.15.19:6789/0 conn(0x7fdc200b6680 legacy=0x7fdc200cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.477+0000 7fdc1ffff640 1 -- 172.21.15.19:0/4196995658 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2006dfb0 con 0x7fdc20161c80 2024-09-12T01:56:32.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.478+0000 7fdc1ffff640 1 --2- 172.21.15.19:0/4196995658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc20161c80 0x7fdc2006e330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdc100097a0 tx=0x7fdc1002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d41157042c923ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:32.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.478+0000 7fdc1f7fe640 1 -- 172.21.15.19:0/4196995658 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc10037070 con 0x7fdc20161c80 2024-09-12T01:56:32.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.478+0000 7fdc1f7fe640 1 -- 172.21.15.19:0/4196995658 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1002ac50 con 0x7fdc20161c80 2024-09-12T01:56:32.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.478+0000 7fdc1f7fe640 1 -- 172.21.15.19:0/4196995658 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18001bc0 con 0x7fdc20161c80 2024-09-12T01:56:32.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.478+0000 7fdc2656d640 1 -- 172.21.15.19:0/4196995658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc20161c80 msgr2=0x7fdc2006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.478+0000 7fdc2656d640 1 --2- 172.21.15.19:0/4196995658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc20161c80 0x7fdc2006e330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdc100097a0 tx=0x7fdc1002a1c0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.478+0000 7fdc2656d640 1 -- 172.21.15.19:0/4196995658 shutdown_connections 2024-09-12T01:56:32.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.478+0000 7fdc2656d640 1 --2- 172.21.15.19:0/4196995658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc20161c80 0x7fdc2006e330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.478+0000 7fdc2656d640 1 -- 172.21.15.19:0/4196995658 >> 172.21.15.19:0/4196995658 conn(0x7fdc200d44f0 msgr2=0x7fdc200d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:32.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.478+0000 7fdc2656d640 1 -- 172.21.15.19:0/4196995658 shutdown_connections 2024-09-12T01:56:32.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.479+0000 7fdc2656d640 1 -- 172.21.15.19:0/4196995658 wait complete. 2024-09-12T01:56:32.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.480+0000 7fdc2656d640 1 Processor -- start 2024-09-12T01:56:32.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.480+0000 7fdc2656d640 1 -- start start 2024-09-12T01:56:32.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.480+0000 7fdc2656d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc200b6680 0x7fdc2014f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.480+0000 7fdc2656d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc20161c80 0x7fdc200ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.480+0000 7fdc2656d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc20162060 0x7fdc201f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.480+0000 7fdc2656d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdc200b6b30 con 0x7fdc20162060 2024-09-12T01:56:32.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.480+0000 7fdc2656d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdc200d2aa0 con 0x7fdc20161c80 2024-09-12T01:56:32.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.480+0000 7fdc2656d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdc200b6cb0 con 0x7fdc200b6680 2024-09-12T01:56:32.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.481+0000 7fdc24b0a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc20162060 0x7fdc201f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.481+0000 7fdc24b0a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc20162060 0x7fdc201f4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36378/0 (socket says 172.21.15.19:36378) 2024-09-12T01:56:32.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.481+0000 7fdc24b0a640 1 -- 172.21.15.19:0/2892621008 learned_addr learned my addr 172.21.15.19:0/2892621008 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:32.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.481+0000 7fdc1ffff640 1 --2- 172.21.15.19:0/2892621008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc200b6680 0x7fdc2014f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.481+0000 7fdc17fff640 1 --2- 172.21.15.19:0/2892621008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc20161c80 0x7fdc200ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.481+0000 7fdc24b0a640 1 -- 172.21.15.19:0/2892621008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc200b6680 msgr2=0x7fdc2014f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.481+0000 7fdc24b0a640 1 --2- 172.21.15.19:0/2892621008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc200b6680 0x7fdc2014f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.481+0000 7fdc24b0a640 1 -- 172.21.15.19:0/2892621008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc20161c80 msgr2=0x7fdc200ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.481+0000 7fdc24b0a640 1 --2- 172.21.15.19:0/2892621008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc20161c80 0x7fdc200ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.481+0000 7fdc24b0a640 1 -- 172.21.15.19:0/2892621008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc200b8850 con 0x7fdc20162060 2024-09-12T01:56:32.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.481+0000 7fdc24b0a640 1 --2- 172.21.15.19:0/2892621008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc20162060 0x7fdc201f4810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800cc10 tx=0x7fdc1800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:32.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.481+0000 7fdc1d7fa640 1 -- 172.21.15.19:0/2892621008 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18017070 con 0x7fdc20162060 2024-09-12T01:56:32.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.481+0000 7fdc1d7fa640 1 -- 172.21.15.19:0/2892621008 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1800ce20 con 0x7fdc20162060 2024-09-12T01:56:32.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.481+0000 7fdc2656d640 1 -- 172.21.15.19:0/2892621008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc200b8b30 con 0x7fdc20162060 2024-09-12T01:56:32.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.481+0000 7fdc1d7fa640 1 -- 172.21.15.19:0/2892621008 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18012640 con 0x7fdc20162060 2024-09-12T01:56:32.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.481+0000 7fdc2656d640 1 -- 172.21.15.19:0/2892621008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc200b90f0 con 0x7fdc20162060 2024-09-12T01:56:32.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.482+0000 7fdc2656d640 1 -- 172.21.15.19:0/2892621008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc2006e330 con 0x7fdc20162060 2024-09-12T01:56:32.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.483+0000 7fdc1d7fa640 1 -- 172.21.15.19:0/2892621008 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc1801a070 con 0x7fdc20162060 2024-09-12T01:56:32.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.483+0000 7fdc1d7fa640 1 --2- 172.21.15.19:0/2892621008 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdc0006be60 0x7fdc0006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.483+0000 7fdc1d7fa640 1 -- 172.21.15.19:0/2892621008 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fdc1808b100 con 0x7fdc20162060 2024-09-12T01:56:32.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.483+0000 7fdc1ffff640 1 --2- 172.21.15.19:0/2892621008 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdc0006be60 0x7fdc0006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.484+0000 7fdc1ffff640 1 --2- 172.21.15.19:0/2892621008 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdc0006be60 0x7fdc0006e320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdc10034000 tx=0x7fdc1002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:32.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.487+0000 7fdc1d7fa640 1 -- 172.21.15.19:0/2892621008 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc2006e870 con 0x7fdc20162060 2024-09-12T01:56:32.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.730+0000 7fdc2656d640 1 -- 172.21.15.19:0/2892621008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_damaged_dentry"]} v 0) -- 0x7fdc200b3c10 con 0x7fdc20162060 2024-09-12T01:56:32.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.841+0000 7fdc1d7fa640 1 -- 172.21.15.19:0/2892621008 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_damaged_dentry"]}]=0 v54) ==== 137+0+0 (secure 0 0 0) 0x7fdc18059770 con 0x7fdc20162060 2024-09-12T01:56:32.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.843+0000 7fdc2656d640 1 -- 172.21.15.19:0/2892621008 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdc0006be60 msgr2=0x7fdc0006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.843+0000 7fdc2656d640 1 --2- 172.21.15.19:0/2892621008 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdc0006be60 0x7fdc0006e320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdc10034000 tx=0x7fdc1002e000 comp rx=0 tx=0).stop 2024-09-12T01:56:32.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.843+0000 7fdc2656d640 1 -- 172.21.15.19:0/2892621008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc20162060 msgr2=0x7fdc201f4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.843+0000 7fdc2656d640 1 --2- 172.21.15.19:0/2892621008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc20162060 0x7fdc201f4810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800cc10 tx=0x7fdc1800a430 comp rx=0 tx=0).stop 2024-09-12T01:56:32.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.843+0000 7fdc2656d640 1 -- 172.21.15.19:0/2892621008 shutdown_connections 2024-09-12T01:56:32.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.843+0000 7fdc2656d640 1 --2- 172.21.15.19:0/2892621008 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdc0006be60 0x7fdc0006e320 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.843+0000 7fdc2656d640 1 --2- 172.21.15.19:0/2892621008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc20162060 0x7fdc201f4810 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.843+0000 7fdc2656d640 1 --2- 172.21.15.19:0/2892621008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc20161c80 0x7fdc200ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.843+0000 7fdc2656d640 1 --2- 172.21.15.19:0/2892621008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc200b6680 0x7fdc2014f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.843+0000 7fdc2656d640 1 -- 172.21.15.19:0/2892621008 >> 172.21.15.19:0/2892621008 conn(0x7fdc200d44f0 msgr2=0x7fdc200b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:32.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.843+0000 7fdc2656d640 1 -- 172.21.15.19:0/2892621008 shutdown_connections 2024-09-12T01:56:32.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.843+0000 7fdc2656d640 1 -- 172.21.15.19:0/2892621008 wait complete. 2024-09-12T01:56:32.854 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T01:56:32.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.960+0000 7fd93aa5e640 1 Processor -- start 2024-09-12T01:56:32.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.960+0000 7fd93aa5e640 1 -- start start 2024-09-12T01:56:32.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.961+0000 7fd93aa5e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd93415e6c0 0x7fd9340cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.961+0000 7fd93aa5e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9340cfcb0 0x7fd9340b1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.961+0000 7fd93aa5e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9340d34f0 con 0x7fd9340d5090 2024-09-12T01:56:32.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.961+0000 7fd93aa5e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd9340cf400 con 0x7fd93415e6c0 2024-09-12T01:56:32.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.961+0000 7fd93aa5e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd9340b10d0 con 0x7fd9340cfcb0 2024-09-12T01:56:32.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.961+0000 7fd933fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd93415e6c0 0x7fd9340cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.961+0000 7fd9337fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd9340d5090 0x7fd9340cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38266/0 (socket says 172.21.15.19:38266) 2024-09-12T01:56:32.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.961+0000 7fd9337fe640 1 -- 172.21.15.19:0/2723151324 learned_addr learned my addr 172.21.15.19:0/2723151324 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:32.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.961+0000 7fd933fff640 1 -- 172.21.15.19:0/2723151324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9340cfcb0 msgr2=0x7fd9340b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:32.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.961+0000 7fd933fff640 1 --2- 172.21.15.19:0/2723151324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9340cfcb0 0x7fd9340b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.961+0000 7fd933fff640 1 -- 172.21.15.19:0/2723151324 >> v1:172.21.15.19:6789/0 conn(0x7fd9340d5090 legacy=0x7fd9340cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.961+0000 7fd933fff640 1 -- 172.21.15.19:0/2723151324 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9340d3790 con 0x7fd93415e6c0 2024-09-12T01:56:32.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.961+0000 7fd932ffd640 1 -- 172.21.15.19:0/2723151324 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159324530 0 0) 0x7fd9340d34f0 con 0x7fd9340d5090 2024-09-12T01:56:32.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.962+0000 7fd933fff640 1 --2- 172.21.15.19:0/2723151324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd93415e6c0 0x7fd9340cebb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd9240097a0 tx=0x7fd92402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc079c6fbf445d08 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:32.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.962+0000 7fd932ffd640 1 -- 172.21.15.19:0/2723151324 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd924037070 con 0x7fd93415e6c0 2024-09-12T01:56:32.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.962+0000 7fd932ffd640 1 -- 172.21.15.19:0/2723151324 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92402ae50 con 0x7fd93415e6c0 2024-09-12T01:56:32.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.962+0000 7fd932ffd640 1 -- 172.21.15.19:0/2723151324 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd924032660 con 0x7fd93415e6c0 2024-09-12T01:56:32.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.963+0000 7fd93aa5e640 1 -- 172.21.15.19:0/2723151324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd93415e6c0 msgr2=0x7fd9340cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.963+0000 7fd93aa5e640 1 --2- 172.21.15.19:0/2723151324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd93415e6c0 0x7fd9340cebb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd9240097a0 tx=0x7fd92402a100 comp rx=0 tx=0).stop 2024-09-12T01:56:32.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.963+0000 7fd93aa5e640 1 -- 172.21.15.19:0/2723151324 shutdown_connections 2024-09-12T01:56:32.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.963+0000 7fd93aa5e640 1 --2- 172.21.15.19:0/2723151324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9340cfcb0 0x7fd9340b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.963+0000 7fd93aa5e640 1 --2- 172.21.15.19:0/2723151324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd93415e6c0 0x7fd9340cebb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.963+0000 7fd93aa5e640 1 -- 172.21.15.19:0/2723151324 >> 172.21.15.19:0/2723151324 conn(0x7fd93408bfc0 msgr2=0x7fd9340d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:32.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.963+0000 7fd93aa5e640 1 -- 172.21.15.19:0/2723151324 shutdown_connections 2024-09-12T01:56:32.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.963+0000 7fd93aa5e640 1 -- 172.21.15.19:0/2723151324 wait complete. 2024-09-12T01:56:32.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.964+0000 7fd93aa5e640 1 Processor -- start 2024-09-12T01:56:32.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.964+0000 7fd93aa5e640 1 -- start start 2024-09-12T01:56:32.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.965+0000 7fd93aa5e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9340cfcb0 0x7fd934155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.965+0000 7fd93aa5e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9340d5090 0x7fd9340b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.965+0000 7fd93aa5e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd93415e6c0 0x7fd9340b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.965+0000 7fd93aa5e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd93415eaa0 con 0x7fd9340cfcb0 2024-09-12T01:56:32.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.965+0000 7fd93aa5e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9340cf0f0 con 0x7fd93415e6c0 2024-09-12T01:56:32.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.965+0000 7fd93aa5e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd93415ec20 con 0x7fd9340d5090 2024-09-12T01:56:32.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.965+0000 7fd933fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9340cfcb0 0x7fd934155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.965+0000 7fd933fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9340cfcb0 0x7fd934155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36396/0 (socket says 172.21.15.19:36396) 2024-09-12T01:56:32.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.965+0000 7fd933fff640 1 -- 172.21.15.19:0/2625881780 learned_addr learned my addr 172.21.15.19:0/2625881780 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:32.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.966+0000 7fd9337fe640 1 --2- 172.21.15.19:0/2625881780 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9340d5090 0x7fd9340b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.966+0000 7fd938ffb640 1 --2- 172.21.15.19:0/2625881780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd93415e6c0 0x7fd9340b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.966+0000 7fd933fff640 1 -- 172.21.15.19:0/2625881780 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9340d5090 msgr2=0x7fd9340b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.966+0000 7fd933fff640 1 --2- 172.21.15.19:0/2625881780 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9340d5090 0x7fd9340b7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.966+0000 7fd933fff640 1 -- 172.21.15.19:0/2625881780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd93415e6c0 msgr2=0x7fd9340b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.966+0000 7fd933fff640 1 --2- 172.21.15.19:0/2625881780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd93415e6c0 0x7fd9340b7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.966+0000 7fd933fff640 1 -- 172.21.15.19:0/2625881780 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd934156370 con 0x7fd9340cfcb0 2024-09-12T01:56:32.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.966+0000 7fd9337fe640 1 --2- 172.21.15.19:0/2625881780 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9340d5090 0x7fd9340b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:32.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.966+0000 7fd938ffb640 1 --2- 172.21.15.19:0/2625881780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd93415e6c0 0x7fd9340b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:32.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.966+0000 7fd933fff640 1 --2- 172.21.15.19:0/2625881780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9340cfcb0 0x7fd934155e30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd924000c00 tx=0x7fd9240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:32.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.966+0000 7fd930ff9640 1 -- 172.21.15.19:0/2625881780 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd924037040 con 0x7fd9340cfcb0 2024-09-12T01:56:32.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.966+0000 7fd930ff9640 1 -- 172.21.15.19:0/2625881780 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd924004030 con 0x7fd9340cfcb0 2024-09-12T01:56:32.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.966+0000 7fd930ff9640 1 -- 172.21.15.19:0/2625881780 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd924006e10 con 0x7fd9340cfcb0 2024-09-12T01:56:32.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.966+0000 7fd93aa5e640 1 -- 172.21.15.19:0/2625881780 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9340ccfb0 con 0x7fd9340cfcb0 2024-09-12T01:56:32.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.966+0000 7fd93aa5e640 1 -- 172.21.15.19:0/2625881780 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9340cd250 con 0x7fd9340cfcb0 2024-09-12T01:56:32.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.967+0000 7fd93aa5e640 1 -- 172.21.15.19:0/2625881780 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9340cebb0 con 0x7fd9340cfcb0 2024-09-12T01:56:32.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.968+0000 7fd930ff9640 1 -- 172.21.15.19:0/2625881780 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd92403d650 con 0x7fd9340cfcb0 2024-09-12T01:56:32.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.968+0000 7fd930ff9640 1 --2- 172.21.15.19:0/2625881780 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd92006be30 0x7fd92006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.968+0000 7fd930ff9640 1 -- 172.21.15.19:0/2625881780 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd9240aba00 con 0x7fd9340cfcb0 2024-09-12T01:56:32.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.968+0000 7fd9337fe640 1 --2- 172.21.15.19:0/2625881780 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd92006be30 0x7fd92006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.969+0000 7fd9337fe640 1 --2- 172.21.15.19:0/2625881780 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd92006be30 0x7fd92006e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd9341eb420 tx=0x7fd928009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:32.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:32.972+0000 7fd930ff9640 1 -- 172.21.15.19:0/2625881780 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd924042020 con 0x7fd9340cfcb0 2024-09-12T01:56:33.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.149+0000 7fd93aa5e640 1 -- 172.21.15.19:0/2625881780 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd9340cfa90 con 0x7fd9340cfcb0 2024-09-12T01:56:33.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.154+0000 7fd930ff9640 1 -- 172.21.15.19:0/2625881780 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fd92407a070 con 0x7fd9340cfcb0 2024-09-12T01:56:33.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.156+0000 7fd93aa5e640 1 -- 172.21.15.19:0/2625881780 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd92006be30 msgr2=0x7fd92006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:33.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.156+0000 7fd93aa5e640 1 --2- 172.21.15.19:0/2625881780 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd92006be30 0x7fd92006e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd9341eb420 tx=0x7fd928009040 comp rx=0 tx=0).stop 2024-09-12T01:56:33.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.156+0000 7fd93aa5e640 1 -- 172.21.15.19:0/2625881780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9340cfcb0 msgr2=0x7fd934155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:33.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.156+0000 7fd93aa5e640 1 --2- 172.21.15.19:0/2625881780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9340cfcb0 0x7fd934155e30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd924000c00 tx=0x7fd9240046c0 comp rx=0 tx=0).stop 2024-09-12T01:56:33.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.156+0000 7fd93aa5e640 1 -- 172.21.15.19:0/2625881780 shutdown_connections 2024-09-12T01:56:33.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.156+0000 7fd93aa5e640 1 --2- 172.21.15.19:0/2625881780 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd92006be30 0x7fd92006e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:33.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.156+0000 7fd93aa5e640 1 --2- 172.21.15.19:0/2625881780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd93415e6c0 0x7fd9340b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:33.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.156+0000 7fd93aa5e640 1 --2- 172.21.15.19:0/2625881780 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9340d5090 0x7fd9340b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:33.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.156+0000 7fd93aa5e640 1 --2- 172.21.15.19:0/2625881780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9340cfcb0 0x7fd934155e30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:33.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.156+0000 7fd93aa5e640 1 -- 172.21.15.19:0/2625881780 >> 172.21.15.19:0/2625881780 conn(0x7fd93408bfc0 msgr2=0x7fd93415cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:33.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.156+0000 7fd93aa5e640 1 -- 172.21.15.19:0/2625881780 shutdown_connections 2024-09-12T01:56:33.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.156+0000 7fd93aa5e640 1 -- 172.21.15.19:0/2625881780 wait complete. 2024-09-12T01:56:33.168 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:56:33.169 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:56:33.212 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:56:33.261 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:56:33.261 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:56:33.261 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:33.278 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:56:33.278 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:33.334 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:56:33.334 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:33.390 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:56:33.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.533+0000 7f6dd2be4640 1 Processor -- start 2024-09-12T01:56:33.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.533+0000 7f6dd2be4640 1 -- start start 2024-09-12T01:56:33.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.534+0000 7f6dd2be4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6dcc0cfcc0 0x7f6dcc06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:33.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.534+0000 7f6dd2be4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dcc0d2700 con 0x7f6dcc0d4fd0 2024-09-12T01:56:33.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.534+0000 7f6dd2be4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dcc0cedb0 con 0x7f6dcc15e760 2024-09-12T01:56:33.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.534+0000 7f6dd2be4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6dcc0cf090 con 0x7f6dcc0cfcc0 2024-09-12T01:56:33.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.534+0000 7f6dd1181640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6dcc0d4fd0 0x7f6dcc0d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38272/0 (socket says 172.21.15.19:38272) 2024-09-12T01:56:33.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.534+0000 7f6dd1181640 1 -- 172.21.15.19:0/2921753337 learned_addr learned my addr 172.21.15.19:0/2921753337 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:33.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.534+0000 7f6dcbfff640 1 --2- 172.21.15.19:0/2921753337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6dcc0cfcc0 0x7f6dcc06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:33.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.534+0000 7f6dcb7fe640 1 -- 172.21.15.19:0/2921753337 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1661303023 0 0) 0x7f6dc4001110 con 0x7f6dcc0d4fd0 2024-09-12T01:56:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.534+0000 7f6dcb7fe640 1 -- 172.21.15.19:0/2921753337 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6db4003520 con 0x7f6dcc0d4fd0 2024-09-12T01:56:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcb7fe640 1 -- 172.21.15.19:0/2921753337 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3707457996 0 0) 0x7f6dcc0cedb0 con 0x7f6dcc15e760 2024-09-12T01:56:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcb7fe640 1 -- 172.21.15.19:0/2921753337 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dc4001110 con 0x7f6dcc15e760 2024-09-12T01:56:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcb7fe640 1 -- 172.21.15.19:0/2921753337 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1641117017 0 0) 0x7f6db4003520 con 0x7f6dcc0d4fd0 2024-09-12T01:56:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcb7fe640 1 -- 172.21.15.19:0/2921753337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6dcc0cfcc0 msgr2=0x7f6dcc06cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcb7fe640 1 --2- 172.21.15.19:0/2921753337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6dcc0cfcc0 0x7f6dcc06cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcb7fe640 1 -- 172.21.15.19:0/2921753337 >> v1:172.21.15.135:6789/0 conn(0x7f6dcc15e760 legacy=0x7f6dcc0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcb7fe640 1 -- 172.21.15.19:0/2921753337 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dcc0b3c80 con 0x7f6dcc0d4fd0 2024-09-12T01:56:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcb7fe640 1 -- 172.21.15.19:0/2921753337 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f6dc4001840 con 0x7f6dcc0d4fd0 2024-09-12T01:56:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcb7fe640 1 -- 172.21.15.19:0/2921753337 >> v1:172.21.15.19:6789/0 conn(0x7f6dcc0d4fd0 legacy=0x7f6dcc0d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcb7fe640 1 --2- 172.21.15.19:0/2921753337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6db4003b70 0x7f6db4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcb7fe640 1 --2- 172.21.15.19:0/2921753337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db4004800 0x7f6db4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcb7fe640 1 --2- 172.21.15.19:0/2921753337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6dcc0cfcc0 0x7f6db40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcb7fe640 1 -- 172.21.15.19:0/2921753337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc0cf090 con 0x7f6db4004800 2024-09-12T01:56:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcb7fe640 1 -- 172.21.15.19:0/2921753337 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6db400ba70 con 0x7f6db4003b70 2024-09-12T01:56:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcb7fe640 1 -- 172.21.15.19:0/2921753337 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6db400bc70 con 0x7f6dcc0cfcc0 2024-09-12T01:56:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcbfff640 1 --2- 172.21.15.19:0/2921753337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db4004800 0x7f6db4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dd0980640 1 --2- 172.21.15.19:0/2921753337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6db4003b70 0x7f6db4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dd1181640 1 --2- 172.21.15.19:0/2921753337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6dcc0cfcc0 0x7f6db40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcbfff640 1 -- 172.21.15.19:0/2921753337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6dcc0cfcc0 msgr2=0x7f6db40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcbfff640 1 --2- 172.21.15.19:0/2921753337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6dcc0cfcc0 0x7f6db40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcbfff640 1 -- 172.21.15.19:0/2921753337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6db4003b70 msgr2=0x7f6db4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcbfff640 1 --2- 172.21.15.19:0/2921753337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6db4003b70 0x7f6db4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.535+0000 7f6dcbfff640 1 -- 172.21.15.19:0/2921753337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db4003520 con 0x7f6db4004800 2024-09-12T01:56:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.536+0000 7f6dcbfff640 1 --2- 172.21.15.19:0/2921753337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db4004800 0x7f6db4004c80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc08ca80 tx=0x7f6db4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4bb39b16ca6f653 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.536+0000 7f6dcb7fe640 1 -- 172.21.15.19:0/2921753337 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0009c60 con 0x7f6db4004800 2024-09-12T01:56:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.536+0000 7f6dcb7fe640 1 -- 172.21.15.19:0/2921753337 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc0036070 con 0x7f6db4004800 2024-09-12T01:56:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.536+0000 7f6dcb7fe640 1 -- 172.21.15.19:0/2921753337 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0031850 con 0x7f6db4004800 2024-09-12T01:56:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.537+0000 7f6dd2be4640 1 -- 172.21.15.19:0/2921753337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db4004800 msgr2=0x7f6db4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.537+0000 7f6dd2be4640 1 --2- 172.21.15.19:0/2921753337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db4004800 0x7f6db4004c80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc08ca80 tx=0x7f6db4005830 comp rx=0 tx=0).stop 2024-09-12T01:56:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.537+0000 7f6dd1181640 1 -- 172.21.15.19:0/2921753337 reap_dead start 2024-09-12T01:56:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.537+0000 7f6dd2be4640 1 -- 172.21.15.19:0/2921753337 shutdown_connections 2024-09-12T01:56:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.537+0000 7f6dd2be4640 1 -- 172.21.15.19:0/2921753337 >> 172.21.15.19:0/2921753337 conn(0x7f6dcc08bfc0 msgr2=0x7f6dcc0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.537+0000 7f6dd2be4640 1 -- 172.21.15.19:0/2921753337 shutdown_connections 2024-09-12T01:56:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.537+0000 7f6dd2be4640 1 -- 172.21.15.19:0/2921753337 wait complete. 2024-09-12T01:56:33.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.538+0000 7f6dd2be4640 1 Processor -- start 2024-09-12T01:56:33.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.538+0000 7f6dd2be4640 1 -- start start 2024-09-12T01:56:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.539+0000 7f6dd2be4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db4004800 0x7f6dcc0b98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.539+0000 7f6dd2be4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6dcc15b920 0x7f6dcc15bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.539+0000 7f6dd2be4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6dcc0cc000 0x7f6dcc0cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.539+0000 7f6dd2be4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc06cdd0 con 0x7f6db4004800 2024-09-12T01:56:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.539+0000 7f6dd2be4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc0b3860 con 0x7f6dcc0cc000 2024-09-12T01:56:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.539+0000 7f6dd2be4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6dcc06cf50 con 0x7f6dcc15b920 2024-09-12T01:56:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.539+0000 7f6dd0980640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db4004800 0x7f6dcc0b98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.539+0000 7f6dd0980640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db4004800 0x7f6dcc0b98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36422/0 (socket says 172.21.15.19:36422) 2024-09-12T01:56:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.539+0000 7f6dd0980640 1 -- 172.21.15.19:0/1195446695 learned_addr learned my addr 172.21.15.19:0/1195446695 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.539+0000 7f6dd0980640 1 -- 172.21.15.19:0/1195446695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6dcc15b920 msgr2=0x7f6dcc15bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.539+0000 7f6dd0980640 1 --2- 172.21.15.19:0/1195446695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6dcc15b920 0x7f6dcc15bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.539+0000 7f6dd1181640 1 --2- 172.21.15.19:0/1195446695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6dcc0cc000 0x7f6dcc0cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.539+0000 7f6dd0980640 1 -- 172.21.15.19:0/1195446695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6dcc0cc000 msgr2=0x7f6dcc0cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.539+0000 7f6dd0980640 1 --2- 172.21.15.19:0/1195446695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6dcc0cc000 0x7f6dcc0cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.539+0000 7f6dd0980640 1 -- 172.21.15.19:0/1195446695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dcc0cccf0 con 0x7f6db4004800 2024-09-12T01:56:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.539+0000 7f6dd1181640 1 --2- 172.21.15.19:0/1195446695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6dcc0cc000 0x7f6dcc0cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.540+0000 7f6dd0980640 1 --2- 172.21.15.19:0/1195446695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db4004800 0x7f6dcc0b98d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00f7a0 tx=0x7f6dbc00fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.540+0000 7f6dc97fa640 1 -- 172.21.15.19:0/1195446695 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00fe50 con 0x7f6db4004800 2024-09-12T01:56:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.540+0000 7f6dc97fa640 1 -- 172.21.15.19:0/1195446695 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dbc018070 con 0x7f6db4004800 2024-09-12T01:56:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.540+0000 7f6dd2be4640 1 -- 172.21.15.19:0/1195446695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dcc0ccfd0 con 0x7f6db4004800 2024-09-12T01:56:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.540+0000 7f6dc97fa640 1 -- 172.21.15.19:0/1195446695 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00d730 con 0x7f6db4004800 2024-09-12T01:56:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.540+0000 7f6dd2be4640 1 -- 172.21.15.19:0/1195446695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dcc0cc9c0 con 0x7f6db4004800 2024-09-12T01:56:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.541+0000 7f6dd2be4640 1 -- 172.21.15.19:0/1195446695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dcc0b6d20 con 0x7f6db4004800 2024-09-12T01:56:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.541+0000 7f6dc97fa640 1 -- 172.21.15.19:0/1195446695 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6dbc00d8d0 con 0x7f6db4004800 2024-09-12T01:56:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.542+0000 7f6dc97fa640 1 --2- 172.21.15.19:0/1195446695 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6db806be30 0x7f6db806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.542+0000 7f6dc97fa640 1 -- 172.21.15.19:0/1195446695 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6dbc08b160 con 0x7f6db4004800 2024-09-12T01:56:33.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.542+0000 7f6dcbfff640 1 --2- 172.21.15.19:0/1195446695 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6db806be30 0x7f6db806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:33.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.542+0000 7f6dcbfff640 1 --2- 172.21.15.19:0/1195446695 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6db806be30 0x7f6db806e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc08ca80 tx=0x7f6dc002d000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:33.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.546+0000 7f6dc97fa640 1 -- 172.21.15.19:0/1195446695 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6dbc0597d0 con 0x7f6db4004800 2024-09-12T01:56:33.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.733+0000 7f6dd2be4640 1 -- 172.21.15.19:0/1195446695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6dcc15d940 con 0x7f6db4004800 2024-09-12T01:56:33.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.733+0000 7f6dc97fa640 1 -- 172.21.15.19:0/1195446695 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f6dbc0590d0 con 0x7f6db4004800 2024-09-12T01:56:33.734 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-09-12T01:56:33.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.735+0000 7f6dd2be4640 1 -- 172.21.15.19:0/1195446695 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6db806be30 msgr2=0x7f6db806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.735+0000 7f6dd2be4640 1 --2- 172.21.15.19:0/1195446695 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6db806be30 0x7f6db806e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc08ca80 tx=0x7f6dc002d000 comp rx=0 tx=0).stop 2024-09-12T01:56:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.735+0000 7f6dd2be4640 1 -- 172.21.15.19:0/1195446695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db4004800 msgr2=0x7f6dcc0b98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.735+0000 7f6dd2be4640 1 --2- 172.21.15.19:0/1195446695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db4004800 0x7f6dcc0b98d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00f7a0 tx=0x7f6dbc00fc60 comp rx=0 tx=0).stop 2024-09-12T01:56:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.736+0000 7f6dd2be4640 1 -- 172.21.15.19:0/1195446695 shutdown_connections 2024-09-12T01:56:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.736+0000 7f6dd2be4640 1 --2- 172.21.15.19:0/1195446695 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6db806be30 0x7f6db806e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.736+0000 7f6dd2be4640 1 --2- 172.21.15.19:0/1195446695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6dcc0cc000 0x7f6dcc0cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.736+0000 7f6dd2be4640 1 --2- 172.21.15.19:0/1195446695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6dcc15b920 0x7f6dcc15bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.736+0000 7f6dd2be4640 1 --2- 172.21.15.19:0/1195446695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db4004800 0x7f6dcc0b98d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.736+0000 7f6dd2be4640 1 -- 172.21.15.19:0/1195446695 >> 172.21.15.19:0/1195446695 conn(0x7f6dcc08bfc0 msgr2=0x7f6dcc15d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.736+0000 7f6dd2be4640 1 -- 172.21.15.19:0/1195446695 shutdown_connections 2024-09-12T01:56:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:33.736+0000 7f6dd2be4640 1 -- 172.21.15.19:0/1195446695 wait complete. 2024-09-12T01:56:33.747 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:56:33.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:33.747 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-12T01:56:33.773 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:56:33.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:33.774 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:56:33.830 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:56:33.830 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:33.850 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:56:33.850 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:33.909 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:56:33.909 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:33.967 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:56:34.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.072+0000 7f635bfff640 1 Processor -- start 2024-09-12T01:56:34.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.072+0000 7f635bfff640 1 -- start start 2024-09-12T01:56:34.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f635c15e6a0 0x7f635c06d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635bfff640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635c0d2c20 con 0x7f635c06dd60 2024-09-12T01:56:34.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635bfff640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635c06e390 con 0x7f635c0d4180 2024-09-12T01:56:34.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635bfff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f635c0cefb0 con 0x7f635c15e6a0 2024-09-12T01:56:34.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635b7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f635c06dd60 0x7f635c0cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38274/0 (socket says 172.21.15.19:38274) 2024-09-12T01:56:34.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635b7fe640 1 -- 172.21.15.19:0/3170527725 learned_addr learned my addr 172.21.15.19:0/3170527725 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:34.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635a7fc640 1 -- 172.21.15.19:0/3170527725 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4230007734 0 0) 0x7f635c0d2c20 con 0x7f635c06dd60 2024-09-12T01:56:34.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635a7fc640 1 -- 172.21.15.19:0/3170527725 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6348003520 con 0x7f635c06dd60 2024-09-12T01:56:34.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f63527fc640 1 --2- 172.21.15.19:0/3170527725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f635c15e6a0 0x7f635c06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635a7fc640 1 -- 172.21.15.19:0/3170527725 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2439159389 0 0) 0x7f6348003520 con 0x7f635c06dd60 2024-09-12T01:56:34.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635a7fc640 1 -- 172.21.15.19:0/3170527725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f635c15e6a0 msgr2=0x7f635c06d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:34.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635a7fc640 1 --2- 172.21.15.19:0/3170527725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f635c15e6a0 0x7f635c06d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635a7fc640 1 -- 172.21.15.19:0/3170527725 >> v1:172.21.15.135:6789/0 conn(0x7f635c0d4180 legacy=0x7f635c0d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635a7fc640 1 -- 172.21.15.19:0/3170527725 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635c06e670 con 0x7f635c06dd60 2024-09-12T01:56:34.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635a7fc640 1 -- 172.21.15.19:0/3170527725 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f63540019f0 con 0x7f635c06dd60 2024-09-12T01:56:34.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635a7fc640 1 -- 172.21.15.19:0/3170527725 >> v1:172.21.15.19:6789/0 conn(0x7f635c06dd60 legacy=0x7f635c0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635a7fc640 1 --2- 172.21.15.19:0/3170527725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f635c15e6a0 0x7f63480039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635a7fc640 1 --2- 172.21.15.19:0/3170527725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6348003f60 0x7f6348004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635a7fc640 1 --2- 172.21.15.19:0/3170527725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6348004d40 0x7f63480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635a7fc640 1 -- 172.21.15.19:0/3170527725 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f635c0cefb0 con 0x7f6348003f60 2024-09-12T01:56:34.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635a7fc640 1 -- 172.21.15.19:0/3170527725 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f634800bb50 con 0x7f6348004d40 2024-09-12T01:56:34.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.073+0000 7f635a7fc640 1 -- 172.21.15.19:0/3170527725 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f634800bd50 con 0x7f635c15e6a0 2024-09-12T01:56:34.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.074+0000 7f63527fc640 1 --2- 172.21.15.19:0/3170527725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6348003f60 0x7f6348004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.074+0000 7f635affd640 1 --2- 172.21.15.19:0/3170527725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f635c15e6a0 0x7f63480039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.074+0000 7f635b7fe640 1 --2- 172.21.15.19:0/3170527725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6348004d40 0x7f63480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.074+0000 7f63527fc640 1 -- 172.21.15.19:0/3170527725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f635c15e6a0 msgr2=0x7f63480039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:34.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.074+0000 7f63527fc640 1 --2- 172.21.15.19:0/3170527725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f635c15e6a0 0x7f63480039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.074+0000 7f63527fc640 1 -- 172.21.15.19:0/3170527725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6348004d40 msgr2=0x7f63480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:34.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.074+0000 7f63527fc640 1 --2- 172.21.15.19:0/3170527725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6348004d40 0x7f63480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.074+0000 7f63527fc640 1 -- 172.21.15.19:0/3170527725 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6348003520 con 0x7f6348003f60 2024-09-12T01:56:34.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.074+0000 7f635b7fe640 1 --2- 172.21.15.19:0/3170527725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6348004d40 0x7f63480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:34.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.075+0000 7f63527fc640 1 --2- 172.21.15.19:0/3170527725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6348003f60 0x7f6348004800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6344009ac0 tx=0x7f6348005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbeea6a0127738f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:34.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.075+0000 7f635a7fc640 1 -- 172.21.15.19:0/3170527725 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6344036070 con 0x7f6348003f60 2024-09-12T01:56:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.075+0000 7f635a7fc640 1 -- 172.21.15.19:0/3170527725 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6344031400 con 0x7f6348003f60 2024-09-12T01:56:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.075+0000 7f635a7fc640 1 -- 172.21.15.19:0/3170527725 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6344009690 con 0x7f6348003f60 2024-09-12T01:56:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.075+0000 7f635bfff640 1 -- 172.21.15.19:0/3170527725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6348003f60 msgr2=0x7f6348004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.075+0000 7f635bfff640 1 --2- 172.21.15.19:0/3170527725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6348003f60 0x7f6348004800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6344009ac0 tx=0x7f6348005830 comp rx=0 tx=0).stop 2024-09-12T01:56:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.075+0000 7f635b7fe640 1 -- 172.21.15.19:0/3170527725 reap_dead start 2024-09-12T01:56:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.075+0000 7f635bfff640 1 -- 172.21.15.19:0/3170527725 shutdown_connections 2024-09-12T01:56:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.075+0000 7f635bfff640 1 -- 172.21.15.19:0/3170527725 >> 172.21.15.19:0/3170527725 conn(0x7f635c09d6f0 msgr2=0x7f635c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.075+0000 7f635bfff640 1 -- 172.21.15.19:0/3170527725 shutdown_connections 2024-09-12T01:56:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.075+0000 7f635bfff640 1 -- 172.21.15.19:0/3170527725 wait complete. 2024-09-12T01:56:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.076+0000 7f635bfff640 1 Processor -- start 2024-09-12T01:56:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.077+0000 7f635bfff640 1 -- start start 2024-09-12T01:56:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.077+0000 7f635bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6348003f60 0x7f635c1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.077+0000 7f635bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f635c0cabb0 0x7f635c158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.077+0000 7f635bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f635c0b71d0 0x7f635c0cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.077+0000 7f635bfff640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f635c06d820 con 0x7f635c0cabb0 2024-09-12T01:56:34.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.077+0000 7f635bfff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f635c0cebd0 con 0x7f635c0b71d0 2024-09-12T01:56:34.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.077+0000 7f635bfff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f635c06d9a0 con 0x7f6348003f60 2024-09-12T01:56:34.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.077+0000 7f63527fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f635c0cabb0 0x7f635c158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.078+0000 7f63527fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f635c0cabb0 0x7f635c158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36434/0 (socket says 172.21.15.19:36434) 2024-09-12T01:56:34.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.078+0000 7f63527fc640 1 -- 172.21.15.19:0/4101897228 learned_addr learned my addr 172.21.15.19:0/4101897228 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:34.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.078+0000 7f635affd640 1 --2- 172.21.15.19:0/4101897228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6348003f60 0x7f635c1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.078+0000 7f635b7fe640 1 --2- 172.21.15.19:0/4101897228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f635c0b71d0 0x7f635c0cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.078+0000 7f63527fc640 1 -- 172.21.15.19:0/4101897228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6348003f60 msgr2=0x7f635c1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.078+0000 7f63527fc640 1 --2- 172.21.15.19:0/4101897228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6348003f60 0x7f635c1586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.078+0000 7f63527fc640 1 -- 172.21.15.19:0/4101897228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f635c0b71d0 msgr2=0x7f635c0cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.078+0000 7f63527fc640 1 --2- 172.21.15.19:0/4101897228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f635c0b71d0 0x7f635c0cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.078+0000 7f63527fc640 1 -- 172.21.15.19:0/4101897228 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635c158f40 con 0x7f635c0cabb0 2024-09-12T01:56:34.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.078+0000 7f63527fc640 1 --2- 172.21.15.19:0/4101897228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f635c0cabb0 0x7f635c158040 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6344000c00 tx=0x7f6344004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:34.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.078+0000 7f6358ff9640 1 -- 172.21.15.19:0/4101897228 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6344040020 con 0x7f635c0cabb0 2024-09-12T01:56:34.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.078+0000 7f6358ff9640 1 -- 172.21.15.19:0/4101897228 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6344003c40 con 0x7f635c0cabb0 2024-09-12T01:56:34.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.078+0000 7f635bfff640 1 -- 172.21.15.19:0/4101897228 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f635c0cb030 con 0x7f635c0cabb0 2024-09-12T01:56:34.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.078+0000 7f6358ff9640 1 -- 172.21.15.19:0/4101897228 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6344036040 con 0x7f635c0cabb0 2024-09-12T01:56:34.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.078+0000 7f635bfff640 1 -- 172.21.15.19:0/4101897228 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f635c0ba120 con 0x7f635c0cabb0 2024-09-12T01:56:34.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.079+0000 7f635bfff640 1 -- 172.21.15.19:0/4101897228 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f635c0d4560 con 0x7f635c0cabb0 2024-09-12T01:56:34.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.080+0000 7f6358ff9640 1 -- 172.21.15.19:0/4101897228 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6344043020 con 0x7f635c0cabb0 2024-09-12T01:56:34.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.080+0000 7f6358ff9640 1 --2- 172.21.15.19:0/4101897228 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f633c06be30 0x7f633c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.080+0000 7f6358ff9640 1 -- 172.21.15.19:0/4101897228 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f63440ab2e0 con 0x7f635c0cabb0 2024-09-12T01:56:34.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.080+0000 7f635affd640 1 --2- 172.21.15.19:0/4101897228 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f633c06be30 0x7f633c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.081+0000 7f635affd640 1 --2- 172.21.15.19:0/4101897228 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f633c06be30 0x7f633c06e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f634c0035f0 tx=0x7f634c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:34.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.084+0000 7f6358ff9640 1 -- 172.21.15.19:0/4101897228 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f634404a070 con 0x7f635c0cabb0 2024-09-12T01:56:34.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.273+0000 7f635bfff640 1 -- 172.21.15.19:0/4101897228 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f635c0b1210 con 0x7f635c0cabb0 2024-09-12T01:56:34.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.273+0000 7f6358ff9640 1 -- 172.21.15.19:0/4101897228 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f635c0cb030 con 0x7f635c0cabb0 2024-09-12T01:56:34.274 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-09-12T01:56:34.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.275+0000 7f635bfff640 1 -- 172.21.15.19:0/4101897228 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f633c06be30 msgr2=0x7f633c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.275+0000 7f635bfff640 1 --2- 172.21.15.19:0/4101897228 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f633c06be30 0x7f633c06e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f634c0035f0 tx=0x7f634c009040 comp rx=0 tx=0).stop 2024-09-12T01:56:34.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.275+0000 7f635bfff640 1 -- 172.21.15.19:0/4101897228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f635c0cabb0 msgr2=0x7f635c158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.275+0000 7f635bfff640 1 --2- 172.21.15.19:0/4101897228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f635c0cabb0 0x7f635c158040 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6344000c00 tx=0x7f6344004730 comp rx=0 tx=0).stop 2024-09-12T01:56:34.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.275+0000 7f635bfff640 1 -- 172.21.15.19:0/4101897228 shutdown_connections 2024-09-12T01:56:34.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.275+0000 7f635bfff640 1 --2- 172.21.15.19:0/4101897228 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f633c06be30 0x7f633c06e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.275+0000 7f635bfff640 1 --2- 172.21.15.19:0/4101897228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f635c0b71d0 0x7f635c0cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.275+0000 7f635bfff640 1 --2- 172.21.15.19:0/4101897228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f635c0cabb0 0x7f635c158040 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.275+0000 7f635bfff640 1 --2- 172.21.15.19:0/4101897228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6348003f60 0x7f635c1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.275+0000 7f635bfff640 1 -- 172.21.15.19:0/4101897228 >> 172.21.15.19:0/4101897228 conn(0x7f635c09d6f0 msgr2=0x7f635c0cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:34.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.275+0000 7f635bfff640 1 -- 172.21.15.19:0/4101897228 shutdown_connections 2024-09-12T01:56:34.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.276+0000 7f635bfff640 1 -- 172.21.15.19:0/4101897228 wait complete. 2024-09-12T01:56:34.287 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T01:56:34.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:34.287 DEBUG:teuthology.orchestra.run.smithi135:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-12T01:56:34.319 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T01:56:34.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:34.320 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T01:56:34.383 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:56:34.383 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:34.402 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:56:34.403 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:34.459 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:56:34.459 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:34.515 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:56:34.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.660+0000 7f694710a640 1 Processor -- start 2024-09-12T01:56:34.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.660+0000 7f694710a640 1 -- start start 2024-09-12T01:56:34.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.661+0000 7f694710a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6940072320 0x7f69400cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.661+0000 7f694710a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f694015e1f0 0x7f694006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.661+0000 7f694710a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6940146140 con 0x7f6940072de0 2024-09-12T01:56:34.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.661+0000 7f694710a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f69400cd740 con 0x7f694015e1f0 2024-09-12T01:56:34.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.661+0000 7f694710a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f69400cda20 con 0x7f6940072320 2024-09-12T01:56:34.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.661+0000 7f69456a7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f694015e1f0 0x7f694006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.661+0000 7f693ffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6940072de0 0x7f694006e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38278/0 (socket says 172.21.15.19:38278) 2024-09-12T01:56:34.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.661+0000 7f693ffff640 1 -- 172.21.15.19:0/473732854 learned_addr learned my addr 172.21.15.19:0/473732854 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:34.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.661+0000 7f6944ea6640 1 --2- 172.21.15.19:0/473732854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6940072320 0x7f69400cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.661+0000 7f69456a7640 1 -- 172.21.15.19:0/473732854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6940072320 msgr2=0x7f69400cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:34.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.661+0000 7f69456a7640 1 --2- 172.21.15.19:0/473732854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6940072320 0x7f69400cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.661+0000 7f69456a7640 1 -- 172.21.15.19:0/473732854 >> v1:172.21.15.19:6789/0 conn(0x7f6940072de0 legacy=0x7f694006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.661+0000 7f69456a7640 1 -- 172.21.15.19:0/473732854 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69400cdd00 con 0x7f694015e1f0 2024-09-12T01:56:34.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.662+0000 7f69456a7640 1 --2- 172.21.15.19:0/473732854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f694015e1f0 0x7f694006e7c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6938009d90 tx=0x7f693802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905751eae82b4e88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.663+0000 7f693f7fe640 1 -- 172.21.15.19:0/473732854 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938031600 con 0x7f694015e1f0 2024-09-12T01:56:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.663+0000 7f693f7fe640 1 -- 172.21.15.19:0/473732854 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69380317a0 con 0x7f694015e1f0 2024-09-12T01:56:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.663+0000 7f693f7fe640 1 -- 172.21.15.19:0/473732854 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938031b70 con 0x7f694015e1f0 2024-09-12T01:56:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.663+0000 7f694710a640 1 -- 172.21.15.19:0/473732854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f694015e1f0 msgr2=0x7f694006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.663+0000 7f694710a640 1 --2- 172.21.15.19:0/473732854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f694015e1f0 0x7f694006e7c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6938009d90 tx=0x7f693802a5d0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.663+0000 7f694710a640 1 -- 172.21.15.19:0/473732854 shutdown_connections 2024-09-12T01:56:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.663+0000 7f694710a640 1 --2- 172.21.15.19:0/473732854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f694015e1f0 0x7f694006e7c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.663+0000 7f694710a640 1 --2- 172.21.15.19:0/473732854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6940072320 0x7f69400cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.663+0000 7f694710a640 1 -- 172.21.15.19:0/473732854 >> 172.21.15.19:0/473732854 conn(0x7f6940067d70 msgr2=0x7f694006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.663+0000 7f694710a640 1 -- 172.21.15.19:0/473732854 shutdown_connections 2024-09-12T01:56:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.663+0000 7f694710a640 1 -- 172.21.15.19:0/473732854 wait complete. 2024-09-12T01:56:34.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.664+0000 7f694710a640 1 Processor -- start 2024-09-12T01:56:34.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.664+0000 7f694710a640 1 -- start start 2024-09-12T01:56:34.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.665+0000 7f694710a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6940072320 0x7f6940143210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.665+0000 7f694710a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6940072de0 0x7f69400affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.665+0000 7f694710a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f694015e1f0 0x7f69400adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.665+0000 7f694710a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f69400cd520 con 0x7f6940072320 2024-09-12T01:56:34.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.665+0000 7f694710a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f69400cd3a0 con 0x7f694015e1f0 2024-09-12T01:56:34.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.665+0000 7f694710a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f694006ed00 con 0x7f6940072de0 2024-09-12T01:56:34.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.665+0000 7f6944ea6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6940072320 0x7f6940143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.665+0000 7f6944ea6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6940072320 0x7f6940143210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36444/0 (socket says 172.21.15.19:36444) 2024-09-12T01:56:34.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.665+0000 7f6944ea6640 1 -- 172.21.15.19:0/483161092 learned_addr learned my addr 172.21.15.19:0/483161092 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:34.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.666+0000 7f693ffff640 1 --2- 172.21.15.19:0/483161092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6940072de0 0x7f69400affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.666+0000 7f69456a7640 1 --2- 172.21.15.19:0/483161092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f694015e1f0 0x7f69400adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.666+0000 7f6944ea6640 1 -- 172.21.15.19:0/483161092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6940072de0 msgr2=0x7f69400affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.666+0000 7f6944ea6640 1 --2- 172.21.15.19:0/483161092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6940072de0 0x7f69400affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.666+0000 7f6944ea6640 1 -- 172.21.15.19:0/483161092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f694015e1f0 msgr2=0x7f69400adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.666+0000 7f6944ea6640 1 --2- 172.21.15.19:0/483161092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f694015e1f0 0x7f69400adea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.666+0000 7f6944ea6640 1 -- 172.21.15.19:0/483161092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69400a96e0 con 0x7f6940072320 2024-09-12T01:56:34.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.666+0000 7f693ffff640 1 --2- 172.21.15.19:0/483161092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6940072de0 0x7f69400affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:34.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.666+0000 7f69456a7640 1 --2- 172.21.15.19:0/483161092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f694015e1f0 0x7f69400adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:34.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.666+0000 7f6944ea6640 1 --2- 172.21.15.19:0/483161092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6940072320 0x7f6940143210 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f693400d620 tx=0x7f693400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:34.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.666+0000 7f693d7fa640 1 -- 172.21.15.19:0/483161092 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693400b620 con 0x7f6940072320 2024-09-12T01:56:34.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.666+0000 7f693d7fa640 1 -- 172.21.15.19:0/483161092 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6934019070 con 0x7f6940072320 2024-09-12T01:56:34.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.666+0000 7f693d7fa640 1 -- 172.21.15.19:0/483161092 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693400ba00 con 0x7f6940072320 2024-09-12T01:56:34.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.666+0000 7f694710a640 1 -- 172.21.15.19:0/483161092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69400a99c0 con 0x7f6940072320 2024-09-12T01:56:34.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.666+0000 7f694710a640 1 -- 172.21.15.19:0/483161092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69400a9f80 con 0x7f6940072320 2024-09-12T01:56:34.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.667+0000 7f694710a640 1 -- 172.21.15.19:0/483161092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6940072700 con 0x7f6940072320 2024-09-12T01:56:34.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.668+0000 7f693d7fa640 1 -- 172.21.15.19:0/483161092 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f693400bba0 con 0x7f6940072320 2024-09-12T01:56:34.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.668+0000 7f693d7fa640 1 --2- 172.21.15.19:0/483161092 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f692406be30 0x7f692406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.668+0000 7f693d7fa640 1 -- 172.21.15.19:0/483161092 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f693408b510 con 0x7f6940072320 2024-09-12T01:56:34.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.668+0000 7f693ffff640 1 --2- 172.21.15.19:0/483161092 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f692406be30 0x7f692406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.669+0000 7f693ffff640 1 --2- 172.21.15.19:0/483161092 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f692406be30 0x7f692406e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f69400cc840 tx=0x7f692c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:34.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.673+0000 7f693d7fa640 1 -- 172.21.15.19:0/483161092 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6934059c10 con 0x7f6940072320 2024-09-12T01:56:34.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.865+0000 7f694710a640 1 -- 172.21.15.19:0/483161092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f69400c7920 con 0x7f6940072320 2024-09-12T01:56:34.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.866+0000 7f693d7fa640 1 -- 172.21.15.19:0/483161092 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f6934059510 con 0x7f6940072320 2024-09-12T01:56:34.866 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-09-12T01:56:34.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.868+0000 7f694710a640 1 -- 172.21.15.19:0/483161092 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f692406be30 msgr2=0x7f692406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.868+0000 7f694710a640 1 --2- 172.21.15.19:0/483161092 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f692406be30 0x7f692406e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f69400cc840 tx=0x7f692c009040 comp rx=0 tx=0).stop 2024-09-12T01:56:34.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.868+0000 7f694710a640 1 -- 172.21.15.19:0/483161092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6940072320 msgr2=0x7f6940143210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.868+0000 7f694710a640 1 --2- 172.21.15.19:0/483161092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6940072320 0x7f6940143210 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f693400d620 tx=0x7f693400dae0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.868+0000 7f694710a640 1 -- 172.21.15.19:0/483161092 shutdown_connections 2024-09-12T01:56:34.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.868+0000 7f694710a640 1 --2- 172.21.15.19:0/483161092 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f692406be30 0x7f692406e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.868+0000 7f694710a640 1 --2- 172.21.15.19:0/483161092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f694015e1f0 0x7f69400adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.868+0000 7f694710a640 1 --2- 172.21.15.19:0/483161092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6940072de0 0x7f69400affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.868+0000 7f694710a640 1 --2- 172.21.15.19:0/483161092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6940072320 0x7f6940143210 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.868+0000 7f694710a640 1 -- 172.21.15.19:0/483161092 >> 172.21.15.19:0/483161092 conn(0x7f6940067d70 msgr2=0x7f6940143a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:34.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.868+0000 7f694710a640 1 -- 172.21.15.19:0/483161092 shutdown_connections 2024-09-12T01:56:34.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:34.868+0000 7f694710a640 1 -- 172.21.15.19:0/483161092 wait complete. 2024-09-12T01:56:34.879 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-12T01:56:34.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:34.880 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-12T01:56:34.907 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:56:34.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:34.907 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T01:56:34.963 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:56:34.963 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:34.982 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:56:34.982 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:35.040 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:56:35.040 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:35.099 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:56:35.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.202+0000 7f7d1668b640 1 Processor -- start 2024-09-12T01:56:35.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.202+0000 7f7d1668b640 1 -- start start 2024-09-12T01:56:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.203+0000 7f7d1668b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d1015c520 0x7f7d1009b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.203+0000 7f7d1668b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7d100d1090 0x7f7d100b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.203+0000 7f7d1668b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d100cec00 con 0x7f7d100b1620 2024-09-12T01:56:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.203+0000 7f7d1668b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f7d1009bd90 con 0x7f7d100d1090 2024-09-12T01:56:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.203+0000 7f7d1668b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7d100d0010 con 0x7f7d1015c520 2024-09-12T01:56:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.203+0000 7f7d0ffff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d1015c520 0x7f7d1009b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.203+0000 7f7d14c28640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7d100d1090 0x7f7d100b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.203+0000 7f7d14c28640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7d100d1090 0x7f7d100b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:48734/0 (socket says 172.21.15.19:48734) 2024-09-12T01:56:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.203+0000 7f7d0ffff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d1015c520 0x7f7d1009b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:36274/0 (socket says 172.21.15.19:36274) 2024-09-12T01:56:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.203+0000 7f7d14c28640 1 -- 172.21.15.19:0/1440244064 learned_addr learned my addr 172.21.15.19:0/1440244064 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.204+0000 7f7d14c28640 1 -- 172.21.15.19:0/1440244064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d1015c520 msgr2=0x7f7d1009b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.204+0000 7f7d14c28640 1 --2- 172.21.15.19:0/1440244064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d1015c520 0x7f7d1009b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.204+0000 7f7d14c28640 1 -- 172.21.15.19:0/1440244064 >> v1:172.21.15.135:6789/0 conn(0x7f7d100b1620 legacy=0x7f7d100d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.204+0000 7f7d14c28640 1 -- 172.21.15.19:0/1440244064 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d100d02f0 con 0x7f7d100d1090 2024-09-12T01:56:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.204+0000 7f7d0ffff640 1 --2- 172.21.15.19:0/1440244064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d1015c520 0x7f7d1009b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.204+0000 7f7d14c28640 1 --2- 172.21.15.19:0/1440244064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d100d1090 0x7f7d100b1d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009e50 tx=0x7f7d0802a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa22b464105b239e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.205+0000 7f7d0effd640 1 -- 172.21.15.19:0/1440244064 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08036070 con 0x7f7d100d1090 2024-09-12T01:56:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.205+0000 7f7d0effd640 1 -- 172.21.15.19:0/1440244064 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d08031600 con 0x7f7d100d1090 2024-09-12T01:56:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.205+0000 7f7d0effd640 1 -- 172.21.15.19:0/1440244064 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d080319d0 con 0x7f7d100d1090 2024-09-12T01:56:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.205+0000 7f7d1668b640 1 -- 172.21.15.19:0/1440244064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d100d1090 msgr2=0x7f7d100b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.205+0000 7f7d1668b640 1 --2- 172.21.15.19:0/1440244064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d100d1090 0x7f7d100b1d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009e50 tx=0x7f7d0802a710 comp rx=0 tx=0).stop 2024-09-12T01:56:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.205+0000 7f7d1668b640 1 -- 172.21.15.19:0/1440244064 shutdown_connections 2024-09-12T01:56:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.205+0000 7f7d1668b640 1 --2- 172.21.15.19:0/1440244064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d100d1090 0x7f7d100b1d40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.205+0000 7f7d1668b640 1 --2- 172.21.15.19:0/1440244064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d1015c520 0x7f7d1009b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.205+0000 7f7d1668b640 1 -- 172.21.15.19:0/1440244064 >> 172.21.15.19:0/1440244064 conn(0x7f7d100d23a0 msgr2=0x7f7d100d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:35.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.205+0000 7f7d1668b640 1 -- 172.21.15.19:0/1440244064 shutdown_connections 2024-09-12T01:56:35.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.205+0000 7f7d1668b640 1 -- 172.21.15.19:0/1440244064 wait complete. 2024-09-12T01:56:35.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.206+0000 7f7d1668b640 1 Processor -- start 2024-09-12T01:56:35.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.207+0000 7f7d1668b640 1 -- start start 2024-09-12T01:56:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.207+0000 7f7d1668b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d100b1620 0x7f7d100b7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.207+0000 7f7d1668b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d100d1090 0x7f7d100b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.207+0000 7f7d1668b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d1015c520 0x7f7d100cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.207+0000 7f7d1668b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1015c900 con 0x7f7d1015c520 2024-09-12T01:56:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.207+0000 7f7d1668b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7d100d05d0 con 0x7f7d100d1090 2024-09-12T01:56:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.207+0000 7f7d1668b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7d100b5be0 con 0x7f7d100b1620 2024-09-12T01:56:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.208+0000 7f7d14c28640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d1015c520 0x7f7d100cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.208+0000 7f7d14c28640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d1015c520 0x7f7d100cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36446/0 (socket says 172.21.15.19:36446) 2024-09-12T01:56:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.208+0000 7f7d14c28640 1 -- 172.21.15.19:0/1088760065 learned_addr learned my addr 172.21.15.19:0/1088760065 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.208+0000 7f7d0ffff640 1 --2- 172.21.15.19:0/1088760065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d100b1620 0x7f7d100b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.208+0000 7f7d0f7fe640 1 --2- 172.21.15.19:0/1088760065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d100d1090 0x7f7d100b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.208+0000 7f7d14c28640 1 -- 172.21.15.19:0/1088760065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d100b1620 msgr2=0x7f7d100b7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.208+0000 7f7d14c28640 1 --2- 172.21.15.19:0/1088760065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d100b1620 0x7f7d100b7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.208+0000 7f7d14c28640 1 -- 172.21.15.19:0/1088760065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d100d1090 msgr2=0x7f7d100b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.208+0000 7f7d14c28640 1 --2- 172.21.15.19:0/1088760065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d100d1090 0x7f7d100b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.208+0000 7f7d14c28640 1 -- 172.21.15.19:0/1088760065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d100b5ec0 con 0x7f7d1015c520 2024-09-12T01:56:35.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.208+0000 7f7d0f7fe640 1 --2- 172.21.15.19:0/1088760065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d100d1090 0x7f7d100b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:35.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.208+0000 7f7d14c28640 1 --2- 172.21.15.19:0/1088760065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d1015c520 0x7f7d100cb8f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7d08034040 tx=0x7f7d08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:35.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.208+0000 7f7d0cff9640 1 -- 172.21.15.19:0/1088760065 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08036050 con 0x7f7d1015c520 2024-09-12T01:56:35.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.208+0000 7f7d0cff9640 1 -- 172.21.15.19:0/1088760065 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d08042070 con 0x7f7d1015c520 2024-09-12T01:56:35.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.208+0000 7f7d1668b640 1 -- 172.21.15.19:0/1088760065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d100b61a0 con 0x7f7d1015c520 2024-09-12T01:56:35.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.208+0000 7f7d0cff9640 1 -- 172.21.15.19:0/1088760065 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08009510 con 0x7f7d1015c520 2024-09-12T01:56:35.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.208+0000 7f7d1668b640 1 -- 172.21.15.19:0/1088760065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d100b6760 con 0x7f7d1015c520 2024-09-12T01:56:35.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.209+0000 7f7d1668b640 1 -- 172.21.15.19:0/1088760065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d100d31f0 con 0x7f7d1015c520 2024-09-12T01:56:35.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.210+0000 7f7d0cff9640 1 -- 172.21.15.19:0/1088760065 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d08007bf0 con 0x7f7d1015c520 2024-09-12T01:56:35.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.210+0000 7f7d0cff9640 1 --2- 172.21.15.19:0/1088760065 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7cf006be30 0x7f7cf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.210+0000 7f7d0cff9640 1 -- 172.21.15.19:0/1088760065 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7d080ac0b0 con 0x7f7d1015c520 2024-09-12T01:56:35.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.211+0000 7f7d0ffff640 1 --2- 172.21.15.19:0/1088760065 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7cf006be30 0x7f7cf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.211+0000 7f7d0ffff640 1 --2- 172.21.15.19:0/1088760065 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7cf006be30 0x7f7cf006e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009a30 tx=0x7f7d00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:35.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.215+0000 7f7d0cff9640 1 -- 172.21.15.19:0/1088760065 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d100d31f0 con 0x7f7d1015c520 2024-09-12T01:56:35.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.401+0000 7f7d1668b640 1 -- 172.21.15.19:0/1088760065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7d100b1d40 con 0x7f7d1015c520 2024-09-12T01:56:35.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.401+0000 7f7d0cff9640 1 -- 172.21.15.19:0/1088760065 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f7d0807a600 con 0x7f7d1015c520 2024-09-12T01:56:35.402 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-09-12T01:56:35.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.403+0000 7f7d1668b640 1 -- 172.21.15.19:0/1088760065 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7cf006be30 msgr2=0x7f7cf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.403+0000 7f7d1668b640 1 --2- 172.21.15.19:0/1088760065 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7cf006be30 0x7f7cf006e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009a30 tx=0x7f7d00008040 comp rx=0 tx=0).stop 2024-09-12T01:56:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.403+0000 7f7d1668b640 1 -- 172.21.15.19:0/1088760065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d1015c520 msgr2=0x7f7d100cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.403+0000 7f7d1668b640 1 --2- 172.21.15.19:0/1088760065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d1015c520 0x7f7d100cb8f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7d08034040 tx=0x7f7d08004a40 comp rx=0 tx=0).stop 2024-09-12T01:56:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.403+0000 7f7d1668b640 1 -- 172.21.15.19:0/1088760065 shutdown_connections 2024-09-12T01:56:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.403+0000 7f7d1668b640 1 --2- 172.21.15.19:0/1088760065 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7cf006be30 0x7f7cf006e2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.403+0000 7f7d1668b640 1 --2- 172.21.15.19:0/1088760065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d1015c520 0x7f7d100cb8f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.403+0000 7f7d1668b640 1 --2- 172.21.15.19:0/1088760065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d100d1090 0x7f7d100b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.403+0000 7f7d1668b640 1 --2- 172.21.15.19:0/1088760065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d100b1620 0x7f7d100b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.403+0000 7f7d1668b640 1 -- 172.21.15.19:0/1088760065 >> 172.21.15.19:0/1088760065 conn(0x7f7d100d23a0 msgr2=0x7f7d100716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.403+0000 7f7d1668b640 1 -- 172.21.15.19:0/1088760065 shutdown_connections 2024-09-12T01:56:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.403+0000 7f7d1668b640 1 -- 172.21.15.19:0/1088760065 wait complete. 2024-09-12T01:56:35.414 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-12T01:56:35.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:35.415 DEBUG:teuthology.orchestra.run.smithi135:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-12T01:56:35.446 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T01:56:35.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:35.446 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T01:56:35.505 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T01:56:35.505 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:56:35.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.608+0000 7f8fda128640 1 Processor -- start 2024-09-12T01:56:35.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.608+0000 7f8fda128640 1 -- start start 2024-09-12T01:56:35.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.609+0000 7f8fda128640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fd4162060 0x7f8fd40b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.609+0000 7f8fda128640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fd406d9f0 con 0x7f8fd4161c80 2024-09-12T01:56:35.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.609+0000 7f8fda128640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fd406dcd0 con 0x7f8fd40b64b0 2024-09-12T01:56:35.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.609+0000 7f8fda128640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd406dfb0 con 0x7f8fd4162060 2024-09-12T01:56:35.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.609+0000 7f8fd37fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8fd4161c80 0x7f8fd406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38292/0 (socket says 172.21.15.19:38292) 2024-09-12T01:56:35.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.609+0000 7f8fd37fe640 1 -- 172.21.15.19:0/2493331227 learned_addr learned my addr 172.21.15.19:0/2493331227 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:35.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.609+0000 7f8fd2ffd640 1 --2- 172.21.15.19:0/2493331227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fd4162060 0x7f8fd40b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.609+0000 7f8fd27fc640 1 -- 172.21.15.19:0/2493331227 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 909996983 0 0) 0x7f8fd406d9f0 con 0x7f8fd4161c80 2024-09-12T01:56:35.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.609+0000 7f8fd27fc640 1 -- 172.21.15.19:0/2493331227 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fbc003520 con 0x7f8fd4161c80 2024-09-12T01:56:35.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.609+0000 7f8fd27fc640 1 -- 172.21.15.19:0/2493331227 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2936913835 0 0) 0x7f8fbc003520 con 0x7f8fd4161c80 2024-09-12T01:56:35.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.609+0000 7f8fd27fc640 1 -- 172.21.15.19:0/2493331227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fd4162060 msgr2=0x7f8fd40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:35.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.609+0000 7f8fd27fc640 1 --2- 172.21.15.19:0/2493331227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fd4162060 0x7f8fd40b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.609+0000 7f8fd27fc640 1 -- 172.21.15.19:0/2493331227 >> v1:172.21.15.135:6789/0 conn(0x7f8fd40b64b0 legacy=0x7f8fd40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.609+0000 7f8fd27fc640 1 -- 172.21.15.19:0/2493331227 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd40d2890 con 0x7f8fd4161c80 2024-09-12T01:56:35.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.609+0000 7f8fd27fc640 1 -- 172.21.15.19:0/2493331227 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f8fc4001670 con 0x7f8fd4161c80 2024-09-12T01:56:35.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.610+0000 7f8fd27fc640 1 -- 172.21.15.19:0/2493331227 >> v1:172.21.15.19:6789/0 conn(0x7f8fd4161c80 legacy=0x7f8fd406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.610+0000 7f8fd27fc640 1 --2- 172.21.15.19:0/2493331227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fbc0039e0 0x7f8fbc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.610+0000 7f8fd27fc640 1 --2- 172.21.15.19:0/2493331227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fd4162060 0x7f8fbc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.610+0000 7f8fd27fc640 1 --2- 172.21.15.19:0/2493331227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fbc004d40 0x7f8fbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.610+0000 7f8fd27fc640 1 -- 172.21.15.19:0/2493331227 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd406dfb0 con 0x7f8fbc0039e0 2024-09-12T01:56:35.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.610+0000 7f8fd27fc640 1 -- 172.21.15.19:0/2493331227 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc00ba70 con 0x7f8fbc004d40 2024-09-12T01:56:35.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.610+0000 7f8fd27fc640 1 -- 172.21.15.19:0/2493331227 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8fbc00bc70 con 0x7f8fd4162060 2024-09-12T01:56:35.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.610+0000 7f8fd37fe640 1 --2- 172.21.15.19:0/2493331227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fbc0039e0 0x7f8fbc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.610+0000 7f8fd2ffd640 1 --2- 172.21.15.19:0/2493331227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fd4162060 0x7f8fbc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.610+0000 7f8fd3fff640 1 --2- 172.21.15.19:0/2493331227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fbc004d40 0x7f8fbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.610+0000 7f8fd37fe640 1 -- 172.21.15.19:0/2493331227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fd4162060 msgr2=0x7f8fbc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:35.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.610+0000 7f8fd37fe640 1 --2- 172.21.15.19:0/2493331227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fd4162060 0x7f8fbc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.610+0000 7f8fd37fe640 1 -- 172.21.15.19:0/2493331227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fbc004d40 msgr2=0x7f8fbc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:35.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.610+0000 7f8fd37fe640 1 --2- 172.21.15.19:0/2493331227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fbc004d40 0x7f8fbc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.610+0000 7f8fd37fe640 1 -- 172.21.15.19:0/2493331227 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc003520 con 0x7f8fbc0039e0 2024-09-12T01:56:35.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.610+0000 7f8fd3fff640 1 --2- 172.21.15.19:0/2493331227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fbc004d40 0x7f8fbc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:35.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.611+0000 7f8fd37fe640 1 --2- 172.21.15.19:0/2493331227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fbc0039e0 0x7f8fbc003e00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4001eb0 tx=0x7f8fbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58be9e9f328193c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:35.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.611+0000 7f8fd27fc640 1 -- 172.21.15.19:0/2493331227 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4007d30 con 0x7f8fbc0039e0 2024-09-12T01:56:35.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.611+0000 7f8fd27fc640 1 -- 172.21.15.19:0/2493331227 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc40058d0 con 0x7f8fbc0039e0 2024-09-12T01:56:35.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.611+0000 7f8fd27fc640 1 -- 172.21.15.19:0/2493331227 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4005ce0 con 0x7f8fbc0039e0 2024-09-12T01:56:35.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.611+0000 7f8fda128640 1 -- 172.21.15.19:0/2493331227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fbc0039e0 msgr2=0x7f8fbc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.611+0000 7f8fda128640 1 --2- 172.21.15.19:0/2493331227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fbc0039e0 0x7f8fbc003e00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4001eb0 tx=0x7f8fbc005830 comp rx=0 tx=0).stop 2024-09-12T01:56:35.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.611+0000 7f8fd3fff640 1 -- 172.21.15.19:0/2493331227 reap_dead start 2024-09-12T01:56:35.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.611+0000 7f8fda128640 1 -- 172.21.15.19:0/2493331227 shutdown_connections 2024-09-12T01:56:35.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.611+0000 7f8fda128640 1 -- 172.21.15.19:0/2493331227 >> 172.21.15.19:0/2493331227 conn(0x7f8fd40d44f0 msgr2=0x7f8fd40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:35.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.611+0000 7f8fda128640 1 -- 172.21.15.19:0/2493331227 shutdown_connections 2024-09-12T01:56:35.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.611+0000 7f8fda128640 1 -- 172.21.15.19:0/2493331227 wait complete. 2024-09-12T01:56:35.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.613+0000 7f8fda128640 1 Processor -- start 2024-09-12T01:56:35.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.613+0000 7f8fda128640 1 -- start start 2024-09-12T01:56:35.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.613+0000 7f8fda128640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fbc0039e0 0x7f8fd40cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.613+0000 7f8fda128640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fd40ccc40 0x7f8fd4153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.613+0000 7f8fda128640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fd40b9d20 0x7f8fd40cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fda128640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd40b6300 con 0x7f8fbc0039e0 2024-09-12T01:56:35.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fda128640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd40b6180 con 0x7f8fd40ccc40 2024-09-12T01:56:35.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fda128640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd40cbba0 con 0x7f8fd40b9d20 2024-09-12T01:56:35.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fd37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fbc0039e0 0x7f8fd40cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fd37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fbc0039e0 0x7f8fd40cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36472/0 (socket says 172.21.15.19:36472) 2024-09-12T01:56:35.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fd37fe640 1 -- 172.21.15.19:0/1251211164 learned_addr learned my addr 172.21.15.19:0/1251211164 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:35.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fd2ffd640 1 --2- 172.21.15.19:0/1251211164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fd40ccc40 0x7f8fd4153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fd3fff640 1 --2- 172.21.15.19:0/1251211164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fd40b9d20 0x7f8fd40cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fd37fe640 1 -- 172.21.15.19:0/1251211164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fd40b9d20 msgr2=0x7f8fd40cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fd37fe640 1 --2- 172.21.15.19:0/1251211164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fd40b9d20 0x7f8fd40cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fd37fe640 1 -- 172.21.15.19:0/1251211164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fd40ccc40 msgr2=0x7f8fd4153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fd37fe640 1 --2- 172.21.15.19:0/1251211164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fd40ccc40 0x7f8fd4153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fd37fe640 1 -- 172.21.15.19:0/1251211164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd40cbe80 con 0x7f8fbc0039e0 2024-09-12T01:56:35.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fd3fff640 1 --2- 172.21.15.19:0/1251211164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fd40b9d20 0x7f8fd40cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:35.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fd37fe640 1 --2- 172.21.15.19:0/1251211164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fbc0039e0 0x7f8fd40cb5c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400c300 tx=0x7f8fc4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:35.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fbbfff640 1 -- 172.21.15.19:0/1251211164 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4007480 con 0x7f8fbc0039e0 2024-09-12T01:56:35.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fbbfff640 1 -- 172.21.15.19:0/1251211164 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc4043070 con 0x7f8fbc0039e0 2024-09-12T01:56:35.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fda128640 1 -- 172.21.15.19:0/1251211164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fd40cc160 con 0x7f8fbc0039e0 2024-09-12T01:56:35.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fbbfff640 1 -- 172.21.15.19:0/1251211164 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4007d10 con 0x7f8fbc0039e0 2024-09-12T01:56:35.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.614+0000 7f8fda128640 1 -- 172.21.15.19:0/1251211164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fd40ba1a0 con 0x7f8fbc0039e0 2024-09-12T01:56:35.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.615+0000 7f8fda128640 1 -- 172.21.15.19:0/1251211164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fd4075770 con 0x7f8fbc0039e0 2024-09-12T01:56:35.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.616+0000 7f8fbbfff640 1 -- 172.21.15.19:0/1251211164 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8fc4048460 con 0x7f8fbc0039e0 2024-09-12T01:56:35.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.616+0000 7f8fbbfff640 1 --2- 172.21.15.19:0/1251211164 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8fc006be60 0x7f8fc006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.616+0000 7f8fbbfff640 1 -- 172.21.15.19:0/1251211164 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8fc40ab730 con 0x7f8fbc0039e0 2024-09-12T01:56:35.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.617+0000 7f8fd2ffd640 1 --2- 172.21.15.19:0/1251211164 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8fc006be60 0x7f8fc006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.617+0000 7f8fd2ffd640 1 --2- 172.21.15.19:0/1251211164 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8fc006be60 0x7f8fc006e320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40b3b80 tx=0x7f8fc8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:35.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.621+0000 7f8fbbfff640 1 -- 172.21.15.19:0/1251211164 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8fc4079ec0 con 0x7f8fbc0039e0 2024-09-12T01:56:35.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.833+0000 7f8fda128640 1 -- 172.21.15.19:0/1251211164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8fd40d2a60 con 0x7f8fbc0039e0 2024-09-12T01:56:35.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.833+0000 7f8fbbfff640 1 -- 172.21.15.19:0/1251211164 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f8fc40797c0 con 0x7f8fbc0039e0 2024-09-12T01:56:35.834 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:35.834 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"btime":"2024-09-12T01:56:14:778796+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4024559276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":4024559276},{"type":"v1","addr":"172.21.15.135:6837","nonce":4024559276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3369866614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3369866614},{"type":"v1","addr":"172.21.15.19:6834","nonce":3369866614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2476634027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2476634027},{"type":"v1","addr":"172.21.15.19:6835","nonce":2476634027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:55:55.036100+0000","modified":"2024-09-12T01:56:14.133810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/4290669195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4290669195},{"type":"v1","addr":"172.21.15.135:6836","nonce":4290669195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-09-12T01:56:35.834 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2024-09-12T01:56:35.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.836+0000 7f8fda128640 1 -- 172.21.15.19:0/1251211164 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8fc006be60 msgr2=0x7f8fc006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.836+0000 7f8fda128640 1 --2- 172.21.15.19:0/1251211164 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8fc006be60 0x7f8fc006e320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40b3b80 tx=0x7f8fc8009190 comp rx=0 tx=0).stop 2024-09-12T01:56:35.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.836+0000 7f8fda128640 1 -- 172.21.15.19:0/1251211164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fbc0039e0 msgr2=0x7f8fd40cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.836+0000 7f8fda128640 1 --2- 172.21.15.19:0/1251211164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fbc0039e0 0x7f8fd40cb5c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400c300 tx=0x7f8fc4001a40 comp rx=0 tx=0).stop 2024-09-12T01:56:35.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.836+0000 7f8fda128640 1 -- 172.21.15.19:0/1251211164 shutdown_connections 2024-09-12T01:56:35.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.836+0000 7f8fda128640 1 --2- 172.21.15.19:0/1251211164 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8fc006be60 0x7f8fc006e320 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.836+0000 7f8fda128640 1 --2- 172.21.15.19:0/1251211164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fd40b9d20 0x7f8fd40cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.836+0000 7f8fda128640 1 --2- 172.21.15.19:0/1251211164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fd40ccc40 0x7f8fd4153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.836+0000 7f8fda128640 1 --2- 172.21.15.19:0/1251211164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fbc0039e0 0x7f8fd40cb5c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.836+0000 7f8fda128640 1 -- 172.21.15.19:0/1251211164 >> 172.21.15.19:0/1251211164 conn(0x7f8fd40d44f0 msgr2=0x7f8fd40d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:35.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.836+0000 7f8fda128640 1 -- 172.21.15.19:0/1251211164 shutdown_connections 2024-09-12T01:56:35.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.836+0000 7f8fda128640 1 -- 172.21.15.19:0/1251211164 wait complete. 2024-09-12T01:56:35.847 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:56:35.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.948+0000 7f65a2882640 1 Processor -- start 2024-09-12T01:56:35.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.948+0000 7f65a2882640 1 -- start start 2024-09-12T01:56:35.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.949+0000 7f65a2882640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f659c15e5d0 0x7f659c0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.949+0000 7f65a2882640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f659c06cec0 con 0x7f659c06df60 2024-09-12T01:56:35.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.949+0000 7f65a2882640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f659c06d1a0 con 0x7f659c09b140 2024-09-12T01:56:35.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.949+0000 7f65a2882640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f659c06dad0 con 0x7f659c15e5d0 2024-09-12T01:56:35.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.949+0000 7f659b7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f659c06df60 0x7f659c09aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38304/0 (socket says 172.21.15.19:38304) 2024-09-12T01:56:35.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.949+0000 7f659b7fe640 1 -- 172.21.15.19:0/3714389843 learned_addr learned my addr 172.21.15.19:0/3714389843 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.949+0000 7f659bfff640 1 --2- 172.21.15.19:0/3714389843 >> v2:172.21.15.135:3300/0 conn(0x7f659c15e5d0 0x7f659c0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.949+0000 7f659affd640 1 -- 172.21.15.19:0/3714389843 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 829172317 0 0) 0x7f659c06cec0 con 0x7f659c06df60 2024-09-12T01:56:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.949+0000 7f659affd640 1 -- 172.21.15.19:0/3714389843 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6584003520 con 0x7f659c06df60 2024-09-12T01:56:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659affd640 1 -- 172.21.15.19:0/3714389843 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 861248332 0 0) 0x7f6584003520 con 0x7f659c06df60 2024-09-12T01:56:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659affd640 1 -- 172.21.15.19:0/3714389843 >> v2:172.21.15.135:3300/0 conn(0x7f659c15e5d0 msgr2=0x7f659c0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659affd640 1 --2- 172.21.15.19:0/3714389843 >> v2:172.21.15.135:3300/0 conn(0x7f659c15e5d0 0x7f659c0d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659affd640 1 -- 172.21.15.19:0/3714389843 >> v1:172.21.15.135:6789/0 conn(0x7f659c09b140 legacy=0x7f659c168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659affd640 1 -- 172.21.15.19:0/3714389843 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f659c06d480 con 0x7f659c06df60 2024-09-12T01:56:35.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659affd640 1 -- 172.21.15.19:0/3714389843 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f6590001670 con 0x7f659c06df60 2024-09-12T01:56:35.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659affd640 1 -- 172.21.15.19:0/3714389843 >> v1:172.21.15.19:6789/0 conn(0x7f659c06df60 legacy=0x7f659c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659affd640 1 --2- 172.21.15.19:0/3714389843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65840039b0 0x7f6584003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659affd640 1 --2- 172.21.15.19:0/3714389843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6584004800 0x7f6584004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659affd640 1 --2- 172.21.15.19:0/3714389843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65840051c0 0x7f658400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659affd640 1 -- 172.21.15.19:0/3714389843 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f659c06dad0 con 0x7f6584004800 2024-09-12T01:56:35.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659affd640 1 -- 172.21.15.19:0/3714389843 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f658400c070 con 0x7f65840039b0 2024-09-12T01:56:35.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659affd640 1 -- 172.21.15.19:0/3714389843 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f658400c270 con 0x7f65840051c0 2024-09-12T01:56:35.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659b7fe640 1 --2- 172.21.15.19:0/3714389843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6584004800 0x7f6584004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659bfff640 1 --2- 172.21.15.19:0/3714389843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65840039b0 0x7f6584003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f65a0e1f640 1 --2- 172.21.15.19:0/3714389843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65840051c0 0x7f658400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659b7fe640 1 -- 172.21.15.19:0/3714389843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65840051c0 msgr2=0x7f658400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659b7fe640 1 --2- 172.21.15.19:0/3714389843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65840051c0 0x7f658400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659b7fe640 1 -- 172.21.15.19:0/3714389843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65840039b0 msgr2=0x7f6584003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659b7fe640 1 --2- 172.21.15.19:0/3714389843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65840039b0 0x7f6584003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659b7fe640 1 -- 172.21.15.19:0/3714389843 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6584003520 con 0x7f6584004800 2024-09-12T01:56:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f659bfff640 1 --2- 172.21.15.19:0/3714389843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65840039b0 0x7f6584003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:35.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.950+0000 7f65a0e1f640 1 -- 172.21.15.19:0/3714389843 reap_dead start 2024-09-12T01:56:35.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.951+0000 7f659b7fe640 1 --2- 172.21.15.19:0/3714389843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6584004800 0x7f6584004c80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f659000c210 tx=0x7f6584005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945b13fcfd90a1da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:35.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.951+0000 7f659affd640 1 -- 172.21.15.19:0/3714389843 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590007d30 con 0x7f6584004800 2024-09-12T01:56:35.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.951+0000 7f659affd640 1 -- 172.21.15.19:0/3714389843 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6590005af0 con 0x7f6584004800 2024-09-12T01:56:35.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.951+0000 7f659affd640 1 -- 172.21.15.19:0/3714389843 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590007070 con 0x7f6584004800 2024-09-12T01:56:35.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.952+0000 7f65a2882640 1 -- 172.21.15.19:0/3714389843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6584004800 msgr2=0x7f6584004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.952+0000 7f65a2882640 1 --2- 172.21.15.19:0/3714389843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6584004800 0x7f6584004c80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f659000c210 tx=0x7f6584005830 comp rx=0 tx=0).stop 2024-09-12T01:56:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.952+0000 7f65a2882640 1 -- 172.21.15.19:0/3714389843 shutdown_connections 2024-09-12T01:56:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.952+0000 7f65a2882640 1 --2- 172.21.15.19:0/3714389843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6584004800 0x7f6584004c80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.952+0000 7f65a2882640 1 -- 172.21.15.19:0/3714389843 >> 172.21.15.19:0/3714389843 conn(0x7f659c0d23a0 msgr2=0x7f659c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.952+0000 7f65a2882640 1 -- 172.21.15.19:0/3714389843 shutdown_connections 2024-09-12T01:56:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.952+0000 7f65a2882640 1 -- 172.21.15.19:0/3714389843 wait complete. 2024-09-12T01:56:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.953+0000 7f65a2882640 1 Processor -- start 2024-09-12T01:56:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.953+0000 7f65a2882640 1 -- start start 2024-09-12T01:56:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.954+0000 7f65a2882640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6584004800 0x7f659c1f77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.954+0000 7f65a2882640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f659c1f72e0 0x7f659c1f7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.954+0000 7f65a2882640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f659c0b7df0 0x7f659c1f8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.954+0000 7f65a2882640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f659c15eb30 con 0x7f6584004800 2024-09-12T01:56:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.954+0000 7f65a2882640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f659c15e9b0 con 0x7f659c0b7df0 2024-09-12T01:56:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.954+0000 7f65a2882640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f659c09aa30 con 0x7f659c1f72e0 2024-09-12T01:56:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.954+0000 7f659bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6584004800 0x7f659c1f77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.954+0000 7f659bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6584004800 0x7f659c1f77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36492/0 (socket says 172.21.15.19:36492) 2024-09-12T01:56:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.954+0000 7f659bfff640 1 -- 172.21.15.19:0/22999598 learned_addr learned my addr 172.21.15.19:0/22999598 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.954+0000 7f65a0e1f640 1 --2- 172.21.15.19:0/22999598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f659c0b7df0 0x7f659c1f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.954+0000 7f659b7fe640 1 --2- 172.21.15.19:0/22999598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f659c1f72e0 0x7f659c1f7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.954+0000 7f659bfff640 1 -- 172.21.15.19:0/22999598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f659c1f72e0 msgr2=0x7f659c1f7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.954+0000 7f659bfff640 1 --2- 172.21.15.19:0/22999598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f659c1f72e0 0x7f659c1f7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.954+0000 7f659bfff640 1 -- 172.21.15.19:0/22999598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f659c0b7df0 msgr2=0x7f659c1f8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.954+0000 7f659bfff640 1 --2- 172.21.15.19:0/22999598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f659c0b7df0 0x7f659c1f8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.954+0000 7f659bfff640 1 -- 172.21.15.19:0/22999598 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f659c0afcf0 con 0x7f6584004800 2024-09-12T01:56:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.954+0000 7f659bfff640 1 --2- 172.21.15.19:0/22999598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6584004800 0x7f659c1f77b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f658c011510 tx=0x7f658c0119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.954+0000 7f6598ff9640 1 -- 172.21.15.19:0/22999598 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c015870 con 0x7f6584004800 2024-09-12T01:56:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.955+0000 7f6598ff9640 1 -- 172.21.15.19:0/22999598 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f658c015a10 con 0x7f6584004800 2024-09-12T01:56:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.955+0000 7f6598ff9640 1 -- 172.21.15.19:0/22999598 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c015e00 con 0x7f6584004800 2024-09-12T01:56:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.955+0000 7f65a2882640 1 -- 172.21.15.19:0/22999598 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f659c0aff90 con 0x7f6584004800 2024-09-12T01:56:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.955+0000 7f65a2882640 1 -- 172.21.15.19:0/22999598 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f659c0b0550 con 0x7f6584004800 2024-09-12T01:56:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.956+0000 7f65a2882640 1 -- 172.21.15.19:0/22999598 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f659c09ae20 con 0x7f6584004800 2024-09-12T01:56:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.956+0000 7f6598ff9640 1 -- 172.21.15.19:0/22999598 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f658c01d400 con 0x7f6584004800 2024-09-12T01:56:35.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.956+0000 7f6598ff9640 1 --2- 172.21.15.19:0/22999598 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f658806be60 0x7f658806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.957+0000 7f6598ff9640 1 -- 172.21.15.19:0/22999598 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f658c08b980 con 0x7f6584004800 2024-09-12T01:56:35.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.957+0000 7f659b7fe640 1 --2- 172.21.15.19:0/22999598 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f658806be60 0x7f658806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.957+0000 7f659b7fe640 1 --2- 172.21.15.19:0/22999598 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f658806be60 0x7f658806e320 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6590033000 tx=0x7f659002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:35.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:35.961+0000 7f6598ff9640 1 -- 172.21.15.19:0/22999598 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f658c019030 con 0x7f6584004800 2024-09-12T01:56:36.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.172+0000 7f65a2882640 1 -- 172.21.15.19:0/22999598 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f659c070590 con 0x7f6584004800 2024-09-12T01:56:36.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.172+0000 7f6598ff9640 1 -- 172.21.15.19:0/22999598 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f658c059ff0 con 0x7f6584004800 2024-09-12T01:56:36.173 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:36.173 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"btime":"2024-09-12T01:56:14:778796+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4024559276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":4024559276},{"type":"v1","addr":"172.21.15.135:6837","nonce":4024559276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3369866614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3369866614},{"type":"v1","addr":"172.21.15.19:6834","nonce":3369866614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2476634027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2476634027},{"type":"v1","addr":"172.21.15.19:6835","nonce":2476634027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:55:55.036100+0000","modified":"2024-09-12T01:56:14.133810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/4290669195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4290669195},{"type":"v1","addr":"172.21.15.135:6836","nonce":4290669195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-09-12T01:56:36.173 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2024-09-12T01:56:36.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.175+0000 7f65a2882640 1 -- 172.21.15.19:0/22999598 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f658806be60 msgr2=0x7f658806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.175+0000 7f65a2882640 1 --2- 172.21.15.19:0/22999598 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f658806be60 0x7f658806e320 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6590033000 tx=0x7f659002e000 comp rx=0 tx=0).stop 2024-09-12T01:56:36.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.175+0000 7f65a2882640 1 -- 172.21.15.19:0/22999598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6584004800 msgr2=0x7f659c1f77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.175+0000 7f65a2882640 1 --2- 172.21.15.19:0/22999598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6584004800 0x7f659c1f77b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f658c011510 tx=0x7f658c0119d0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.175+0000 7f65a2882640 1 -- 172.21.15.19:0/22999598 shutdown_connections 2024-09-12T01:56:36.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.175+0000 7f65a2882640 1 --2- 172.21.15.19:0/22999598 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f658806be60 0x7f658806e320 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.175+0000 7f65a2882640 1 --2- 172.21.15.19:0/22999598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f659c0b7df0 0x7f659c1f8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.175+0000 7f65a2882640 1 --2- 172.21.15.19:0/22999598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f659c1f72e0 0x7f659c1f7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.175+0000 7f65a2882640 1 --2- 172.21.15.19:0/22999598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6584004800 0x7f659c1f77b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.175+0000 7f65a2882640 1 -- 172.21.15.19:0/22999598 >> 172.21.15.19:0/22999598 conn(0x7f659c0d23a0 msgr2=0x7f659c09b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:36.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.175+0000 7f65a2882640 1 -- 172.21.15.19:0/22999598 shutdown_connections 2024-09-12T01:56:36.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.175+0000 7f65a2882640 1 -- 172.21.15.19:0/22999598 wait complete. 2024-09-12T01:56:36.186 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:56:36.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.287+0000 7f8e23c74640 1 Processor -- start 2024-09-12T01:56:36.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.288+0000 7f8e23c74640 1 -- start start 2024-09-12T01:56:36.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.288+0000 7f8e23c74640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e1c161c80 0x7f8e1c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.288+0000 7f8e23c74640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e1c06e870 con 0x7f8e1c162060 2024-09-12T01:56:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.288+0000 7f8e23c74640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e1c06d9f0 con 0x7f8e1c0b6680 2024-09-12T01:56:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.288+0000 7f8e23c74640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8e1c06dcd0 con 0x7f8e1c161c80 2024-09-12T01:56:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e2120f640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8e1c162060 0x7f8e1c0b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38312/0 (socket says 172.21.15.19:38312) 2024-09-12T01:56:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e2120f640 1 -- 172.21.15.19:0/2696429002 learned_addr learned my addr 172.21.15.19:0/2696429002 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e21a10640 1 --2- 172.21.15.19:0/2696429002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e1c161c80 0x7f8e1c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e20a0e640 1 -- 172.21.15.19:0/2696429002 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2885566479 0 0) 0x7f8e10001110 con 0x7f8e1c162060 2024-09-12T01:56:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e20a0e640 1 -- 172.21.15.19:0/2696429002 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e04003520 con 0x7f8e1c162060 2024-09-12T01:56:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e20a0e640 1 -- 172.21.15.19:0/2696429002 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3787004993 0 0) 0x7f8e04003520 con 0x7f8e1c162060 2024-09-12T01:56:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e20a0e640 1 -- 172.21.15.19:0/2696429002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e1c161c80 msgr2=0x7f8e1c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e20a0e640 1 --2- 172.21.15.19:0/2696429002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e1c161c80 0x7f8e1c06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e20a0e640 1 -- 172.21.15.19:0/2696429002 >> v1:172.21.15.135:6789/0 conn(0x7f8e1c0b6680 legacy=0x7f8e1c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e20a0e640 1 -- 172.21.15.19:0/2696429002 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1c06dfb0 con 0x7f8e1c162060 2024-09-12T01:56:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e20a0e640 1 -- 172.21.15.19:0/2696429002 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f8e10001840 con 0x7f8e1c162060 2024-09-12T01:56:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e20a0e640 1 -- 172.21.15.19:0/2696429002 >> v1:172.21.15.19:6789/0 conn(0x7f8e1c162060 legacy=0x7f8e1c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e20a0e640 1 --2- 172.21.15.19:0/2696429002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e1c161c80 0x7f8e040039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e20a0e640 1 --2- 172.21.15.19:0/2696429002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e04003f20 0x7f8e04004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e20a0e640 1 --2- 172.21.15.19:0/2696429002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e04004d40 0x7f8e040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e20a0e640 1 -- 172.21.15.19:0/2696429002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c06dcd0 con 0x7f8e04003f20 2024-09-12T01:56:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e20a0e640 1 -- 172.21.15.19:0/2696429002 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0400ba20 con 0x7f8e04004d40 2024-09-12T01:56:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e20a0e640 1 -- 172.21.15.19:0/2696429002 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8e0400bc20 con 0x7f8e1c161c80 2024-09-12T01:56:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.289+0000 7f8e2120f640 1 --2- 172.21.15.19:0/2696429002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e04003f20 0x7f8e04004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.290+0000 7f8e21a10640 1 --2- 172.21.15.19:0/2696429002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e1c161c80 0x7f8e040039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:36.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.290+0000 7f8e22211640 1 --2- 172.21.15.19:0/2696429002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e04004d40 0x7f8e040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:36.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.290+0000 7f8e2120f640 1 -- 172.21.15.19:0/2696429002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e1c161c80 msgr2=0x7f8e040039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:36.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.290+0000 7f8e2120f640 1 --2- 172.21.15.19:0/2696429002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e1c161c80 0x7f8e040039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.290+0000 7f8e2120f640 1 -- 172.21.15.19:0/2696429002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e04004d40 msgr2=0x7f8e040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:36.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.290+0000 7f8e2120f640 1 --2- 172.21.15.19:0/2696429002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e04004d40 0x7f8e040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.290+0000 7f8e2120f640 1 -- 172.21.15.19:0/2696429002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e04003520 con 0x7f8e04003f20 2024-09-12T01:56:36.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.290+0000 7f8e22211640 1 --2- 172.21.15.19:0/2696429002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e04004d40 0x7f8e040051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:36.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.290+0000 7f8e2120f640 1 --2- 172.21.15.19:0/2696429002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e04003f20 0x7f8e04004800 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c08e830 tx=0x7f8e04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e704a5e0a83d937f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:36.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.291+0000 7f8e20a0e640 1 -- 172.21.15.19:0/2696429002 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10036070 con 0x7f8e04003f20 2024-09-12T01:56:36.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.291+0000 7f8e20a0e640 1 -- 172.21.15.19:0/2696429002 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e10005ad0 con 0x7f8e04003f20 2024-09-12T01:56:36.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.291+0000 7f8e20a0e640 1 -- 172.21.15.19:0/2696429002 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1000c0e0 con 0x7f8e04003f20 2024-09-12T01:56:36.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.291+0000 7f8e23c74640 1 -- 172.21.15.19:0/2696429002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e04003f20 msgr2=0x7f8e04004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.291+0000 7f8e23c74640 1 --2- 172.21.15.19:0/2696429002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e04003f20 0x7f8e04004800 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c08e830 tx=0x7f8e04005830 comp rx=0 tx=0).stop 2024-09-12T01:56:36.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.291+0000 7f8e22211640 1 -- 172.21.15.19:0/2696429002 reap_dead start 2024-09-12T01:56:36.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.291+0000 7f8e23c74640 1 -- 172.21.15.19:0/2696429002 shutdown_connections 2024-09-12T01:56:36.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.291+0000 7f8e23c74640 1 -- 172.21.15.19:0/2696429002 >> 172.21.15.19:0/2696429002 conn(0x7f8e1c0d44f0 msgr2=0x7f8e1c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:36.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.291+0000 7f8e23c74640 1 -- 172.21.15.19:0/2696429002 shutdown_connections 2024-09-12T01:56:36.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.291+0000 7f8e23c74640 1 -- 172.21.15.19:0/2696429002 wait complete. 2024-09-12T01:56:36.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.292+0000 7f8e23c74640 1 Processor -- start 2024-09-12T01:56:36.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.292+0000 7f8e23c74640 1 -- start start 2024-09-12T01:56:36.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.293+0000 7f8e23c74640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e04003f20 0x7f8e1c156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.293+0000 7f8e23c74640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e1c15ea90 0x7f8e1c15ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.293+0000 7f8e23c74640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e1c0cb830 0x7f8e1c0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.293+0000 7f8e23c74640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c0b6b30 con 0x7f8e1c15ea90 2024-09-12T01:56:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.293+0000 7f8e23c74640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c0d2aa0 con 0x7f8e1c0cb830 2024-09-12T01:56:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.293+0000 7f8e23c74640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8e1c0b6cb0 con 0x7f8e04003f20 2024-09-12T01:56:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.293+0000 7f8e2120f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e1c15ea90 0x7f8e1c15ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.293+0000 7f8e2120f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e1c15ea90 0x7f8e1c15ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36518/0 (socket says 172.21.15.19:36518) 2024-09-12T01:56:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.293+0000 7f8e2120f640 1 -- 172.21.15.19:0/3838410818 learned_addr learned my addr 172.21.15.19:0/3838410818 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.293+0000 7f8e21a10640 1 --2- 172.21.15.19:0/3838410818 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e04003f20 0x7f8e1c156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.293+0000 7f8e22211640 1 --2- 172.21.15.19:0/3838410818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e1c0cb830 0x7f8e1c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.294+0000 7f8e2120f640 1 -- 172.21.15.19:0/3838410818 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e04003f20 msgr2=0x7f8e1c156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.294+0000 7f8e2120f640 1 --2- 172.21.15.19:0/3838410818 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e04003f20 0x7f8e1c156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.294+0000 7f8e2120f640 1 -- 172.21.15.19:0/3838410818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e1c0cb830 msgr2=0x7f8e1c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.294+0000 7f8e2120f640 1 --2- 172.21.15.19:0/3838410818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e1c0cb830 0x7f8e1c0cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.294+0000 7f8e2120f640 1 -- 172.21.15.19:0/3838410818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1c0cc5d0 con 0x7f8e1c15ea90 2024-09-12T01:56:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.294+0000 7f8e22211640 1 --2- 172.21.15.19:0/3838410818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e1c0cb830 0x7f8e1c0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.294+0000 7f8e2120f640 1 --2- 172.21.15.19:0/3838410818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e1c15ea90 0x7f8e1c15ef10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000c3b0 tx=0x7f8e1c06dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.294+0000 7f8e1a7fc640 1 -- 172.21.15.19:0/3838410818 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10036030 con 0x7f8e1c15ea90 2024-09-12T01:56:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.294+0000 7f8e1a7fc640 1 -- 172.21.15.19:0/3838410818 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e10042070 con 0x7f8e1c15ea90 2024-09-12T01:56:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.294+0000 7f8e23c74640 1 -- 172.21.15.19:0/3838410818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e1c0cc8b0 con 0x7f8e1c15ea90 2024-09-12T01:56:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.294+0000 7f8e1a7fc640 1 -- 172.21.15.19:0/3838410818 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10001600 con 0x7f8e1c15ea90 2024-09-12T01:56:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.294+0000 7f8e23c74640 1 -- 172.21.15.19:0/3838410818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e1c0cce70 con 0x7f8e1c15ea90 2024-09-12T01:56:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.295+0000 7f8e23c74640 1 -- 172.21.15.19:0/3838410818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e1c06e330 con 0x7f8e1c15ea90 2024-09-12T01:56:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.296+0000 7f8e1a7fc640 1 -- 172.21.15.19:0/3838410818 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e100047e0 con 0x7f8e1c15ea90 2024-09-12T01:56:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.296+0000 7f8e1a7fc640 1 --2- 172.21.15.19:0/3838410818 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8e0806be60 0x7f8e0806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.296+0000 7f8e1a7fc640 1 -- 172.21.15.19:0/3838410818 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8e100ab060 con 0x7f8e1c15ea90 2024-09-12T01:56:36.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.296+0000 7f8e21a10640 1 --2- 172.21.15.19:0/3838410818 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8e0806be60 0x7f8e0806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:36.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.297+0000 7f8e21a10640 1 --2- 172.21.15.19:0/3838410818 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8e0806be60 0x7f8e0806e320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009bc0 tx=0x7f8e14009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:36.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.300+0000 7f8e1a7fc640 1 -- 172.21.15.19:0/3838410818 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e1c06e870 con 0x7f8e1c15ea90 2024-09-12T01:56:36.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.475+0000 7f8e23c74640 1 -- 172.21.15.19:0/3838410818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e1c0ba470 con 0x7f8e1c15ea90 2024-09-12T01:56:36.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.477+0000 7f8e1a7fc640 1 -- 172.21.15.19:0/3838410818 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18586 (secure 0 0 0) 0x7f8e100796e0 con 0x7f8e1c15ea90 2024-09-12T01:56:36.477 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:36.477 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:56:01.739727+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:52.899670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:54.099981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:55:57.729901+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:36.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.479+0000 7f8e23c74640 1 -- 172.21.15.19:0/3838410818 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8e0806be60 msgr2=0x7f8e0806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.479+0000 7f8e23c74640 1 --2- 172.21.15.19:0/3838410818 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8e0806be60 0x7f8e0806e320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009bc0 tx=0x7f8e14009190 comp rx=0 tx=0).stop 2024-09-12T01:56:36.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.479+0000 7f8e23c74640 1 -- 172.21.15.19:0/3838410818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e1c15ea90 msgr2=0x7f8e1c15ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.479+0000 7f8e23c74640 1 --2- 172.21.15.19:0/3838410818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e1c15ea90 0x7f8e1c15ef10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000c3b0 tx=0x7f8e1c06dbc0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.479+0000 7f8e23c74640 1 -- 172.21.15.19:0/3838410818 shutdown_connections 2024-09-12T01:56:36.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.479+0000 7f8e23c74640 1 --2- 172.21.15.19:0/3838410818 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8e0806be60 0x7f8e0806e320 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.479+0000 7f8e23c74640 1 --2- 172.21.15.19:0/3838410818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e1c0cb830 0x7f8e1c0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.479+0000 7f8e23c74640 1 --2- 172.21.15.19:0/3838410818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e1c15ea90 0x7f8e1c15ef10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.479+0000 7f8e23c74640 1 --2- 172.21.15.19:0/3838410818 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e04003f20 0x7f8e1c156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.479+0000 7f8e23c74640 1 -- 172.21.15.19:0/3838410818 >> 172.21.15.19:0/3838410818 conn(0x7f8e1c0d44f0 msgr2=0x7f8e1c0b5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:36.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.479+0000 7f8e23c74640 1 -- 172.21.15.19:0/3838410818 shutdown_connections 2024-09-12T01:56:36.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.479+0000 7f8e23c74640 1 -- 172.21.15.19:0/3838410818 wait complete. 2024-09-12T01:56:36.490 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T01:56:36.490 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:56:36.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.592+0000 7f39d7386640 1 Processor -- start 2024-09-12T01:56:36.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.592+0000 7f39d7386640 1 -- start start 2024-09-12T01:56:36.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.593+0000 7f39d7386640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f39d015fc30 0x7f39d0071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.593+0000 7f39d7386640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39d00b17d0 0x7f39d009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.593+0000 7f39d7386640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f39d009af70 0x7f39d00d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.593+0000 7f39d7386640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f39d00b1590 con 0x7f39d009af70 2024-09-12T01:56:36.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.593+0000 7f39d7386640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f39d0160ab0 con 0x7f39d015fc30 2024-09-12T01:56:36.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.593+0000 7f39d7386640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f39d0160fe0 con 0x7f39d00b17d0 2024-09-12T01:56:36.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.593+0000 7f39d5923640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f39d009af70 0x7f39d00d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:36.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.593+0000 7f39d5923640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f39d009af70 0x7f39d00d0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36530/0 (socket says 172.21.15.19:36530) 2024-09-12T01:56:36.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.593+0000 7f39d5923640 1 -- 172.21.15.19:0/4136687682 learned_addr learned my addr 172.21.15.19:0/4136687682 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:36.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.593+0000 7f39d5122640 1 --2- 172.21.15.19:0/4136687682 >> v2:172.21.15.135:3300/0 conn(0x7f39d015fc30 0x7f39d0071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:36.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.593+0000 7f39d4921640 1 --2- 172.21.15.19:0/4136687682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39d00b17d0 0x7f39d009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:36.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.593+0000 7f39d5923640 1 -- 172.21.15.19:0/4136687682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39d00b17d0 msgr2=0x7f39d009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:36.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.593+0000 7f39d5923640 1 --2- 172.21.15.19:0/4136687682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39d00b17d0 0x7f39d009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.593+0000 7f39d5923640 1 -- 172.21.15.19:0/4136687682 >> v2:172.21.15.135:3300/0 conn(0x7f39d015fc30 msgr2=0x7f39d0071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:36.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.593+0000 7f39d5923640 1 --2- 172.21.15.19:0/4136687682 >> v2:172.21.15.135:3300/0 conn(0x7f39d015fc30 0x7f39d0071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.593+0000 7f39d5923640 1 -- 172.21.15.19:0/4136687682 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d009ba30 con 0x7f39d009af70 2024-09-12T01:56:36.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.594+0000 7f39d5923640 1 --2- 172.21.15.19:0/4136687682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39d009af70 0x7f39d00d0310 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f39d00743f0 tx=0x7f39c802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9544fdbef3cc7ade server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:36.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.594+0000 7f39cffff640 1 -- 172.21.15.19:0/4136687682 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c8037070 con 0x7f39d009af70 2024-09-12T01:56:36.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.594+0000 7f39cffff640 1 -- 172.21.15.19:0/4136687682 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c8032440 con 0x7f39d009af70 2024-09-12T01:56:36.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.594+0000 7f39cffff640 1 -- 172.21.15.19:0/4136687682 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c8032810 con 0x7f39d009af70 2024-09-12T01:56:36.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.595+0000 7f39d7386640 1 -- 172.21.15.19:0/4136687682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39d009af70 msgr2=0x7f39d00d0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.595+0000 7f39d7386640 1 --2- 172.21.15.19:0/4136687682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39d009af70 0x7f39d00d0310 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f39d00743f0 tx=0x7f39c802a140 comp rx=0 tx=0).stop 2024-09-12T01:56:36.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.595+0000 7f39d7386640 1 -- 172.21.15.19:0/4136687682 shutdown_connections 2024-09-12T01:56:36.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.595+0000 7f39d7386640 1 --2- 172.21.15.19:0/4136687682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39d009af70 0x7f39d00d0310 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.595+0000 7f39d7386640 1 --2- 172.21.15.19:0/4136687682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39d00b17d0 0x7f39d009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.595+0000 7f39d7386640 1 --2- 172.21.15.19:0/4136687682 >> v2:172.21.15.135:3300/0 conn(0x7f39d015fc30 0x7f39d0071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.595+0000 7f39d7386640 1 -- 172.21.15.19:0/4136687682 >> 172.21.15.19:0/4136687682 conn(0x7f39d00d23a0 msgr2=0x7f39d00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:36.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.595+0000 7f39d7386640 1 -- 172.21.15.19:0/4136687682 shutdown_connections 2024-09-12T01:56:36.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.595+0000 7f39d7386640 1 -- 172.21.15.19:0/4136687682 wait complete. 2024-09-12T01:56:36.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.596+0000 7f39d7386640 1 Processor -- start 2024-09-12T01:56:36.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.596+0000 7f39d7386640 1 -- start start 2024-09-12T01:56:36.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.597+0000 7f39d7386640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39d009af70 0x7f39d00c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.597+0000 7f39d7386640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39d00b17d0 0x7f39d015b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.597+0000 7f39d7386640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39d015fc30 0x7f39d006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.597+0000 7f39d7386640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f39d0160d00 con 0x7f39d009af70 2024-09-12T01:56:36.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.597+0000 7f39d7386640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f39d00b1bd0 con 0x7f39d00b17d0 2024-09-12T01:56:36.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.597+0000 7f39d7386640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f39d00d0850 con 0x7f39d015fc30 2024-09-12T01:56:36.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.597+0000 7f39d5122640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39d009af70 0x7f39d00c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:36.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.597+0000 7f39d5122640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39d009af70 0x7f39d00c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36542/0 (socket says 172.21.15.19:36542) 2024-09-12T01:56:36.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.597+0000 7f39d5122640 1 -- 172.21.15.19:0/952957293 learned_addr learned my addr 172.21.15.19:0/952957293 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:36.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.597+0000 7f39d5122640 1 -- 172.21.15.19:0/952957293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39d015fc30 msgr2=0x7f39d006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.597+0000 7f39d5122640 1 --2- 172.21.15.19:0/952957293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39d015fc30 0x7f39d006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.597+0000 7f39d5122640 1 -- 172.21.15.19:0/952957293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39d00b17d0 msgr2=0x7f39d015b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.597+0000 7f39d5122640 1 --2- 172.21.15.19:0/952957293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39d00b17d0 0x7f39d015b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.597+0000 7f39d5122640 1 -- 172.21.15.19:0/952957293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d00b51d0 con 0x7f39d009af70 2024-09-12T01:56:36.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.597+0000 7f39d5122640 1 --2- 172.21.15.19:0/952957293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39d009af70 0x7f39d00c5ed0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f39c000efc0 tx=0x7f39c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:36.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.598+0000 7f39cdffb640 1 -- 172.21.15.19:0/952957293 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c0018020 con 0x7f39d009af70 2024-09-12T01:56:36.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.598+0000 7f39cdffb640 1 -- 172.21.15.19:0/952957293 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c0014480 con 0x7f39d009af70 2024-09-12T01:56:36.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.598+0000 7f39d7386640 1 -- 172.21.15.19:0/952957293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d00c8880 con 0x7f39d009af70 2024-09-12T01:56:36.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.598+0000 7f39cdffb640 1 -- 172.21.15.19:0/952957293 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c0014850 con 0x7f39d009af70 2024-09-12T01:56:36.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.598+0000 7f39d7386640 1 -- 172.21.15.19:0/952957293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d00c8e40 con 0x7f39d009af70 2024-09-12T01:56:36.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.599+0000 7f39d7386640 1 -- 172.21.15.19:0/952957293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d009aa30 con 0x7f39d009af70 2024-09-12T01:56:36.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.599+0000 7f39cdffb640 1 -- 172.21.15.19:0/952957293 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39c0005d10 con 0x7f39d009af70 2024-09-12T01:56:36.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.600+0000 7f39cdffb640 1 --2- 172.21.15.19:0/952957293 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f39bc06be30 0x7f39bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.600+0000 7f39cdffb640 1 -- 172.21.15.19:0/952957293 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f39c008bc60 con 0x7f39d009af70 2024-09-12T01:56:36.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.600+0000 7f39d4921640 1 --2- 172.21.15.19:0/952957293 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f39bc06be30 0x7f39bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:36.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.600+0000 7f39d4921640 1 --2- 172.21.15.19:0/952957293 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f39bc06be30 0x7f39bc06e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f39d01f7ac0 tx=0x7f39c4009500 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:36.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.604+0000 7f39cdffb640 1 -- 172.21.15.19:0/952957293 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39c0022070 con 0x7f39d009af70 2024-09-12T01:56:36.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.815+0000 7f39d7386640 1 -- 172.21.15.19:0/952957293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39d00b8320 con 0x7f39d009af70 2024-09-12T01:56:36.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.816+0000 7f39cdffb640 1 -- 172.21.15.19:0/952957293 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f39c0010040 con 0x7f39d009af70 2024-09-12T01:56:36.817 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:36.817 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"btime":"2024-09-12T01:56:14:778796+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4024559276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":4024559276},{"type":"v1","addr":"172.21.15.135:6837","nonce":4024559276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3369866614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3369866614},{"type":"v1","addr":"172.21.15.19:6834","nonce":3369866614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2476634027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2476634027},{"type":"v1","addr":"172.21.15.19:6835","nonce":2476634027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:55:55.036100+0000","modified":"2024-09-12T01:56:14.133810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/4290669195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4290669195},{"type":"v1","addr":"172.21.15.135:6836","nonce":4290669195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-09-12T01:56:36.817 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2024-09-12T01:56:36.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.818+0000 7f39d7386640 1 -- 172.21.15.19:0/952957293 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f39bc06be30 msgr2=0x7f39bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.818+0000 7f39d7386640 1 --2- 172.21.15.19:0/952957293 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f39bc06be30 0x7f39bc06e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f39d01f7ac0 tx=0x7f39c4009500 comp rx=0 tx=0).stop 2024-09-12T01:56:36.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.818+0000 7f39d7386640 1 -- 172.21.15.19:0/952957293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39d009af70 msgr2=0x7f39d00c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.818+0000 7f39d7386640 1 --2- 172.21.15.19:0/952957293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39d009af70 0x7f39d00c5ed0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f39c000efc0 tx=0x7f39c000c490 comp rx=0 tx=0).stop 2024-09-12T01:56:36.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.818+0000 7f39d7386640 1 -- 172.21.15.19:0/952957293 shutdown_connections 2024-09-12T01:56:36.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.818+0000 7f39d7386640 1 --2- 172.21.15.19:0/952957293 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f39bc06be30 0x7f39bc06e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.818+0000 7f39d7386640 1 --2- 172.21.15.19:0/952957293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39d015fc30 0x7f39d006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.818+0000 7f39d7386640 1 --2- 172.21.15.19:0/952957293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39d00b17d0 0x7f39d015b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.818+0000 7f39d7386640 1 --2- 172.21.15.19:0/952957293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39d009af70 0x7f39d00c5ed0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.818+0000 7f39d7386640 1 -- 172.21.15.19:0/952957293 >> 172.21.15.19:0/952957293 conn(0x7f39d00d23a0 msgr2=0x7f39d00cee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:36.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.818+0000 7f39d7386640 1 -- 172.21.15.19:0/952957293 shutdown_connections 2024-09-12T01:56:36.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.818+0000 7f39d7386640 1 -- 172.21.15.19:0/952957293 wait complete. 2024-09-12T01:56:36.829 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:56:36.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.935+0000 7ff8cbb18640 1 Processor -- start 2024-09-12T01:56:36.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.936+0000 7ff8cbb18640 1 -- start start 2024-09-12T01:56:36.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.936+0000 7ff8cbb18640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8c406cd20 0x7ff8c40b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.936+0000 7ff8cbb18640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8c40b2790 con 0x7ff8c409aa30 2024-09-12T01:56:36.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.936+0000 7ff8cbb18640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8c40b2a70 con 0x7ff8c40b3760 2024-09-12T01:56:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.936+0000 7ff8cbb18640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c40d0670 con 0x7ff8c406cd20 2024-09-12T01:56:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.937+0000 7ff8c98b4640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff8c409aa30 0x7ff8c409ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38324/0 (socket says 172.21.15.19:38324) 2024-09-12T01:56:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.937+0000 7ff8c98b4640 1 -- 172.21.15.19:0/1676953993 learned_addr learned my addr 172.21.15.19:0/1676953993 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.937+0000 7ff8ca0b5640 1 --2- 172.21.15.19:0/1676953993 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8c406cd20 0x7ff8c40b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.937+0000 7ff8c88b2640 1 -- 172.21.15.19:0/1676953993 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 13147344 0 0) 0x7ff8c40b2790 con 0x7ff8c409aa30 2024-09-12T01:56:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.937+0000 7ff8c88b2640 1 -- 172.21.15.19:0/1676953993 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8b0003520 con 0x7ff8c409aa30 2024-09-12T01:56:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.937+0000 7ff8c88b2640 1 -- 172.21.15.19:0/1676953993 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1403591133 0 0) 0x7ff8c40b2a70 con 0x7ff8c40b3760 2024-09-12T01:56:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.937+0000 7ff8c88b2640 1 -- 172.21.15.19:0/1676953993 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8c40b2790 con 0x7ff8c40b3760 2024-09-12T01:56:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.937+0000 7ff8c88b2640 1 -- 172.21.15.19:0/1676953993 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 972734218 0 0) 0x7ff8b0003520 con 0x7ff8c409aa30 2024-09-12T01:56:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.937+0000 7ff8ca0b5640 1 -- 172.21.15.19:0/1676953993 >> v1:172.21.15.135:6789/0 conn(0x7ff8c40b3760 legacy=0x7ff8c4162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.937+0000 7ff8ca0b5640 1 -- 172.21.15.19:0/1676953993 >> v1:172.21.15.19:6789/0 conn(0x7ff8c409aa30 legacy=0x7ff8c409ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.937+0000 7ff8ca0b5640 1 -- 172.21.15.19:0/1676953993 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c40b2d50 con 0x7ff8c406cd20 2024-09-12T01:56:36.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.938+0000 7ff8ca0b5640 1 --2- 172.21.15.19:0/1676953993 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8c406cd20 0x7ff8c40b3030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009dc0 tx=0x7ff8bc02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef66f3226230b72d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:36.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.938+0000 7ff8c88b2640 1 -- 172.21.15.19:0/1676953993 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0001670 con 0x7ff8c406cd20 2024-09-12T01:56:36.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.938+0000 7ff8c88b2640 1 -- 172.21.15.19:0/1676953993 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8bc007540 con 0x7ff8c406cd20 2024-09-12T01:56:36.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.938+0000 7ff8c88b2640 1 -- 172.21.15.19:0/1676953993 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0078f0 con 0x7ff8c406cd20 2024-09-12T01:56:36.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.939+0000 7ff8cbb18640 1 -- 172.21.15.19:0/1676953993 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8c406cd20 msgr2=0x7ff8c40b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.939+0000 7ff8cbb18640 1 --2- 172.21.15.19:0/1676953993 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8c406cd20 0x7ff8c40b3030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009dc0 tx=0x7ff8bc02a5d0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.939+0000 7ff8cbb18640 1 -- 172.21.15.19:0/1676953993 shutdown_connections 2024-09-12T01:56:36.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.939+0000 7ff8cbb18640 1 --2- 172.21.15.19:0/1676953993 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8c406cd20 0x7ff8c40b3030 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.939+0000 7ff8cbb18640 1 -- 172.21.15.19:0/1676953993 >> 172.21.15.19:0/1676953993 conn(0x7ff8c40d23a0 msgr2=0x7ff8c40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:36.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.939+0000 7ff8cbb18640 1 -- 172.21.15.19:0/1676953993 shutdown_connections 2024-09-12T01:56:36.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.939+0000 7ff8cbb18640 1 -- 172.21.15.19:0/1676953993 wait complete. 2024-09-12T01:56:36.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.940+0000 7ff8cbb18640 1 Processor -- start 2024-09-12T01:56:36.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.940+0000 7ff8cbb18640 1 -- start start 2024-09-12T01:56:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8cbb18640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8c406cd20 0x7ff8c41519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8cbb18640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8c409aa30 0x7ff8c40b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8cbb18640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8c40b3760 0x7ff8c4160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8cbb18640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c415fe20 con 0x7ff8c409aa30 2024-09-12T01:56:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8cbb18640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c415fca0 con 0x7ff8c406cd20 2024-09-12T01:56:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8cbb18640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c40d1fe0 con 0x7ff8c40b3760 2024-09-12T01:56:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8c90b3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8c409aa30 0x7ff8c40b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8c90b3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8c409aa30 0x7ff8c40b6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36548/0 (socket says 172.21.15.19:36548) 2024-09-12T01:56:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8c90b3640 1 -- 172.21.15.19:0/1354974732 learned_addr learned my addr 172.21.15.19:0/1354974732 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8c98b4640 1 --2- 172.21.15.19:0/1354974732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8c406cd20 0x7ff8c41519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8ca0b5640 1 --2- 172.21.15.19:0/1354974732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8c40b3760 0x7ff8c4160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8c90b3640 1 -- 172.21.15.19:0/1354974732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8c40b3760 msgr2=0x7ff8c4160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8c90b3640 1 --2- 172.21.15.19:0/1354974732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8c40b3760 0x7ff8c4160150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8c90b3640 1 -- 172.21.15.19:0/1354974732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8c406cd20 msgr2=0x7ff8c41519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8c90b3640 1 --2- 172.21.15.19:0/1354974732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8c406cd20 0x7ff8c41519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8c90b3640 1 -- 172.21.15.19:0/1354974732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c40c6290 con 0x7ff8c409aa30 2024-09-12T01:56:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8ca0b5640 1 --2- 172.21.15.19:0/1354974732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8c40b3760 0x7ff8c4160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8c90b3640 1 --2- 172.21.15.19:0/1354974732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8c409aa30 0x7ff8c40b6bd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400c4c0 tx=0x7ff8b400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.941+0000 7ff8ba7fc640 1 -- 172.21.15.19:0/1354974732 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b40052d0 con 0x7ff8c409aa30 2024-09-12T01:56:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.942+0000 7ff8ba7fc640 1 -- 172.21.15.19:0/1354974732 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8b4005470 con 0x7ff8c409aa30 2024-09-12T01:56:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.942+0000 7ff8ba7fc640 1 -- 172.21.15.19:0/1354974732 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4012870 con 0x7ff8c409aa30 2024-09-12T01:56:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.942+0000 7ff8cbb18640 1 -- 172.21.15.19:0/1354974732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c40c6570 con 0x7ff8c409aa30 2024-09-12T01:56:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.942+0000 7ff8cbb18640 1 -- 172.21.15.19:0/1354974732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c40c6b30 con 0x7ff8c409aa30 2024-09-12T01:56:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.942+0000 7ff8cbb18640 1 -- 172.21.15.19:0/1354974732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c40b3030 con 0x7ff8c409aa30 2024-09-12T01:56:36.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.943+0000 7ff8ba7fc640 1 -- 172.21.15.19:0/1354974732 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff8b4012a10 con 0x7ff8c409aa30 2024-09-12T01:56:36.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.944+0000 7ff8ba7fc640 1 --2- 172.21.15.19:0/1354974732 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff8a806be30 0x7ff8a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:36.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.944+0000 7ff8ba7fc640 1 -- 172.21.15.19:0/1354974732 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7ff8b408ae60 con 0x7ff8c409aa30 2024-09-12T01:56:36.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.944+0000 7ff8c98b4640 1 --2- 172.21.15.19:0/1354974732 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff8a806be30 0x7ff8a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:36.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.944+0000 7ff8c98b4640 1 --2- 172.21.15.19:0/1354974732 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff8a806be30 0x7ff8a806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff8c00017e0 tx=0x7ff8c0001610 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:36.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:36.948+0000 7ff8ba7fc640 1 -- 172.21.15.19:0/1354974732 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff8b4059410 con 0x7ff8c409aa30 2024-09-12T01:56:37.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.162+0000 7ff8cbb18640 1 -- 172.21.15.19:0/1354974732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8c40b3cb0 con 0x7ff8c409aa30 2024-09-12T01:56:37.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.163+0000 7ff8ba7fc640 1 -- 172.21.15.19:0/1354974732 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7ff8b4058d10 con 0x7ff8c409aa30 2024-09-12T01:56:37.163 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:37.163 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"btime":"2024-09-12T01:56:14:778796+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4024559276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":4024559276},{"type":"v1","addr":"172.21.15.135:6837","nonce":4024559276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3369866614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3369866614},{"type":"v1","addr":"172.21.15.19:6834","nonce":3369866614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2476634027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2476634027},{"type":"v1","addr":"172.21.15.19:6835","nonce":2476634027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:55:55.036100+0000","modified":"2024-09-12T01:56:14.133810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/4290669195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4290669195},{"type":"v1","addr":"172.21.15.135:6836","nonce":4290669195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-09-12T01:56:37.164 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2024-09-12T01:56:37.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.165+0000 7ff8cbb18640 1 -- 172.21.15.19:0/1354974732 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff8a806be30 msgr2=0x7ff8a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.165+0000 7ff8cbb18640 1 --2- 172.21.15.19:0/1354974732 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff8a806be30 0x7ff8a806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff8c00017e0 tx=0x7ff8c0001610 comp rx=0 tx=0).stop 2024-09-12T01:56:37.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.165+0000 7ff8cbb18640 1 -- 172.21.15.19:0/1354974732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8c409aa30 msgr2=0x7ff8c40b6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.165+0000 7ff8cbb18640 1 --2- 172.21.15.19:0/1354974732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8c409aa30 0x7ff8c40b6bd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400c4c0 tx=0x7ff8b400c980 comp rx=0 tx=0).stop 2024-09-12T01:56:37.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.165+0000 7ff8cbb18640 1 -- 172.21.15.19:0/1354974732 shutdown_connections 2024-09-12T01:56:37.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.165+0000 7ff8cbb18640 1 --2- 172.21.15.19:0/1354974732 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff8a806be30 0x7ff8a806e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.165+0000 7ff8cbb18640 1 --2- 172.21.15.19:0/1354974732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8c40b3760 0x7ff8c4160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.165+0000 7ff8cbb18640 1 --2- 172.21.15.19:0/1354974732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8c409aa30 0x7ff8c40b6bd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.165+0000 7ff8cbb18640 1 --2- 172.21.15.19:0/1354974732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8c406cd20 0x7ff8c41519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.165+0000 7ff8cbb18640 1 -- 172.21.15.19:0/1354974732 >> 172.21.15.19:0/1354974732 conn(0x7ff8c40d23a0 msgr2=0x7ff8c415d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:37.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.165+0000 7ff8cbb18640 1 -- 172.21.15.19:0/1354974732 shutdown_connections 2024-09-12T01:56:37.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.165+0000 7ff8cbb18640 1 -- 172.21.15.19:0/1354974732 wait complete. 2024-09-12T01:56:37.176 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:56:37.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.277+0000 7f1bd9cf1640 1 Processor -- start 2024-09-12T01:56:37.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.277+0000 7f1bd9cf1640 1 -- start start 2024-09-12T01:56:37.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.278+0000 7f1bd9cf1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bd40cd8a0 0x7f1bd415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.278+0000 7f1bd9cf1640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd40af720 con 0x7f1bd40d0be0 2024-09-12T01:56:37.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.278+0000 7f1bd9cf1640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd40cdcf0 con 0x7f1bd4145e00 2024-09-12T01:56:37.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.278+0000 7f1bd9cf1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd41461e0 con 0x7f1bd40cd8a0 2024-09-12T01:56:37.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.278+0000 7f1bd2ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1bd40d0be0 0x7f1bd40afc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38340/0 (socket says 172.21.15.19:38340) 2024-09-12T01:56:37.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.278+0000 7f1bd2ffd640 1 -- 172.21.15.19:0/3346621754 learned_addr learned my addr 172.21.15.19:0/3346621754 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.278+0000 7f1bd3fff640 1 --2- 172.21.15.19:0/3346621754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bd40cd8a0 0x7f1bd415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd27fc640 1 -- 172.21.15.19:0/3346621754 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3704496045 0 0) 0x7f1bd40af720 con 0x7f1bd40d0be0 2024-09-12T01:56:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd27fc640 1 -- 172.21.15.19:0/3346621754 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bbc003520 con 0x7f1bd40d0be0 2024-09-12T01:56:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd27fc640 1 -- 172.21.15.19:0/3346621754 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1149942692 0 0) 0x7f1bbc003520 con 0x7f1bd40d0be0 2024-09-12T01:56:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd27fc640 1 -- 172.21.15.19:0/3346621754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bd40cd8a0 msgr2=0x7f1bd415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd27fc640 1 --2- 172.21.15.19:0/3346621754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bd40cd8a0 0x7f1bd415d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd27fc640 1 -- 172.21.15.19:0/3346621754 >> v1:172.21.15.135:6789/0 conn(0x7f1bd4145e00 legacy=0x7f1bd40d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd27fc640 1 -- 172.21.15.19:0/3346621754 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd40cdf90 con 0x7f1bd40d0be0 2024-09-12T01:56:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd27fc640 1 -- 172.21.15.19:0/3346621754 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f1bc8001690 con 0x7f1bd40d0be0 2024-09-12T01:56:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd27fc640 1 -- 172.21.15.19:0/3346621754 >> v1:172.21.15.19:6789/0 conn(0x7f1bd40d0be0 legacy=0x7f1bd40afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd27fc640 1 --2- 172.21.15.19:0/3346621754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bd40cd8a0 0x7f1bbc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd27fc640 1 --2- 172.21.15.19:0/3346621754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bbc003f60 0x7f1bbc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd27fc640 1 --2- 172.21.15.19:0/3346621754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bbc004d40 0x7f1bbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd27fc640 1 -- 172.21.15.19:0/3346621754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd41461e0 con 0x7f1bbc003f60 2024-09-12T01:56:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd27fc640 1 -- 172.21.15.19:0/3346621754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc00baa0 con 0x7f1bbc004d40 2024-09-12T01:56:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd27fc640 1 -- 172.21.15.19:0/3346621754 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1bbc00bca0 con 0x7f1bd40cd8a0 2024-09-12T01:56:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd2ffd640 1 --2- 172.21.15.19:0/3346621754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bbc003f60 0x7f1bbc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd37fe640 1 --2- 172.21.15.19:0/3346621754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bd40cd8a0 0x7f1bbc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd3fff640 1 --2- 172.21.15.19:0/3346621754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bbc004d40 0x7f1bbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd2ffd640 1 -- 172.21.15.19:0/3346621754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bd40cd8a0 msgr2=0x7f1bbc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd2ffd640 1 --2- 172.21.15.19:0/3346621754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bd40cd8a0 0x7f1bbc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd2ffd640 1 -- 172.21.15.19:0/3346621754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bbc004d40 msgr2=0x7f1bbc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd2ffd640 1 --2- 172.21.15.19:0/3346621754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bbc004d40 0x7f1bbc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.279+0000 7f1bd2ffd640 1 -- 172.21.15.19:0/3346621754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bbc003520 con 0x7f1bbc003f60 2024-09-12T01:56:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.280+0000 7f1bd2ffd640 1 --2- 172.21.15.19:0/3346621754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bbc003f60 0x7f1bbc004800 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800c210 tx=0x7f1bbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50700152910ef274 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.280+0000 7f1bd27fc640 1 -- 172.21.15.19:0/3346621754 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8007d30 con 0x7f1bbc003f60 2024-09-12T01:56:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.280+0000 7f1bd27fc640 1 -- 172.21.15.19:0/3346621754 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc80058d0 con 0x7f1bbc003f60 2024-09-12T01:56:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.280+0000 7f1bd27fc640 1 -- 172.21.15.19:0/3346621754 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8005ce0 con 0x7f1bbc003f60 2024-09-12T01:56:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.281+0000 7f1bd9cf1640 1 -- 172.21.15.19:0/3346621754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bbc003f60 msgr2=0x7f1bbc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.281+0000 7f1bd9cf1640 1 --2- 172.21.15.19:0/3346621754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bbc003f60 0x7f1bbc004800 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800c210 tx=0x7f1bbc005830 comp rx=0 tx=0).stop 2024-09-12T01:56:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.281+0000 7f1bd3fff640 1 -- 172.21.15.19:0/3346621754 reap_dead start 2024-09-12T01:56:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.281+0000 7f1bd9cf1640 1 -- 172.21.15.19:0/3346621754 shutdown_connections 2024-09-12T01:56:37.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.281+0000 7f1bd9cf1640 1 -- 172.21.15.19:0/3346621754 >> 172.21.15.19:0/3346621754 conn(0x7f1bd40b2f40 msgr2=0x7f1bd40b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:37.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.281+0000 7f1bd9cf1640 1 -- 172.21.15.19:0/3346621754 shutdown_connections 2024-09-12T01:56:37.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.281+0000 7f1bd9cf1640 1 -- 172.21.15.19:0/3346621754 wait complete. 2024-09-12T01:56:37.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.282+0000 7f1bd9cf1640 1 Processor -- start 2024-09-12T01:56:37.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.282+0000 7f1bd9cf1640 1 -- start start 2024-09-12T01:56:37.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.283+0000 7f1bd9cf1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bbc003f60 0x7f1bd413e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.283+0000 7f1bd9cf1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd41e5830 0x7f1bd40b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.283+0000 7f1bd9cf1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bd415b8e0 0x7f1bd415bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.283+0000 7f1bd9cf1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd40ce830 con 0x7f1bd415b8e0 2024-09-12T01:56:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.283+0000 7f1bd9cf1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd40ce550 con 0x7f1bd41e5830 2024-09-12T01:56:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.283+0000 7f1bd9cf1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd40cede0 con 0x7f1bbc003f60 2024-09-12T01:56:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.283+0000 7f1bd3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bd415b8e0 0x7f1bd415bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.283+0000 7f1bd3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bd415b8e0 0x7f1bd415bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36560/0 (socket says 172.21.15.19:36560) 2024-09-12T01:56:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.283+0000 7f1bd3fff640 1 -- 172.21.15.19:0/2448182914 learned_addr learned my addr 172.21.15.19:0/2448182914 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.283+0000 7f1bd37fe640 1 --2- 172.21.15.19:0/2448182914 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bbc003f60 0x7f1bd413e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.283+0000 7f1bd2ffd640 1 --2- 172.21.15.19:0/2448182914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd41e5830 0x7f1bd40b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.283+0000 7f1bd3fff640 1 -- 172.21.15.19:0/2448182914 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bbc003f60 msgr2=0x7f1bd413e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.283+0000 7f1bd3fff640 1 --2- 172.21.15.19:0/2448182914 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bbc003f60 0x7f1bd413e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.283+0000 7f1bd3fff640 1 -- 172.21.15.19:0/2448182914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd41e5830 msgr2=0x7f1bd40b61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.283+0000 7f1bd3fff640 1 --2- 172.21.15.19:0/2448182914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd41e5830 0x7f1bd40b61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.283+0000 7f1bd3fff640 1 -- 172.21.15.19:0/2448182914 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd40b6b80 con 0x7f1bd415b8e0 2024-09-12T01:56:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.283+0000 7f1bd2ffd640 1 --2- 172.21.15.19:0/2448182914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd41e5830 0x7f1bd40b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.284+0000 7f1bd3fff640 1 --2- 172.21.15.19:0/2448182914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bd415b8e0 0x7f1bd415bd90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40aec70 tx=0x7f1bcc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.284+0000 7f1bbbfff640 1 -- 172.21.15.19:0/2448182914 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc00fde0 con 0x7f1bd415b8e0 2024-09-12T01:56:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.284+0000 7f1bbbfff640 1 -- 172.21.15.19:0/2448182914 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bcc015430 con 0x7f1bd415b8e0 2024-09-12T01:56:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.284+0000 7f1bd9cf1640 1 -- 172.21.15.19:0/2448182914 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd40b6e60 con 0x7f1bd415b8e0 2024-09-12T01:56:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.284+0000 7f1bbbfff640 1 -- 172.21.15.19:0/2448182914 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc015820 con 0x7f1bd415b8e0 2024-09-12T01:56:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.284+0000 7f1bd9cf1640 1 -- 172.21.15.19:0/2448182914 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd41e61b0 con 0x7f1bd415b8e0 2024-09-12T01:56:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.285+0000 7f1bd9cf1640 1 -- 172.21.15.19:0/2448182914 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd415d460 con 0x7f1bd415b8e0 2024-09-12T01:56:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.285+0000 7f1bbbfff640 1 -- 172.21.15.19:0/2448182914 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1bcc0159c0 con 0x7f1bd415b8e0 2024-09-12T01:56:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.286+0000 7f1bbbfff640 1 --2- 172.21.15.19:0/2448182914 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1bc006be30 0x7f1bc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.286+0000 7f1bbbfff640 1 -- 172.21.15.19:0/2448182914 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f1bcc08c090 con 0x7f1bd415b8e0 2024-09-12T01:56:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.286+0000 7f1bd37fe640 1 --2- 172.21.15.19:0/2448182914 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1bc006be30 0x7f1bc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.286+0000 7f1bd37fe640 1 --2- 172.21.15.19:0/2448182914 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1bc006be30 0x7f1bc006e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1bd415c460 tx=0x7f1bc4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:37.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.290+0000 7f1bbbfff640 1 -- 172.21.15.19:0/2448182914 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1bcc019030 con 0x7f1bd415b8e0 2024-09-12T01:56:37.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.466+0000 7f1bd9cf1640 1 -- 172.21.15.19:0/2448182914 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1bd41e8970 con 0x7f1bd415b8e0 2024-09-12T01:56:37.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.467+0000 7f1bbbfff640 1 -- 172.21.15.19:0/2448182914 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18975 (secure 0 0 0) 0x7f1bcc010040 con 0x7f1bd415b8e0 2024-09-12T01:56:37.467 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:37.467 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":28,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:56:36.849733+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:52.899670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:54.099981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:55:57.729901+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:37.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.469+0000 7f1bd9cf1640 1 -- 172.21.15.19:0/2448182914 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1bc006be30 msgr2=0x7f1bc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.469+0000 7f1bd9cf1640 1 --2- 172.21.15.19:0/2448182914 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1bc006be30 0x7f1bc006e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1bd415c460 tx=0x7f1bc4009040 comp rx=0 tx=0).stop 2024-09-12T01:56:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.469+0000 7f1bd9cf1640 1 -- 172.21.15.19:0/2448182914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bd415b8e0 msgr2=0x7f1bd415bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.469+0000 7f1bd9cf1640 1 --2- 172.21.15.19:0/2448182914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bd415b8e0 0x7f1bd415bd90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40aec70 tx=0x7f1bcc00f580 comp rx=0 tx=0).stop 2024-09-12T01:56:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.469+0000 7f1bd9cf1640 1 -- 172.21.15.19:0/2448182914 shutdown_connections 2024-09-12T01:56:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.469+0000 7f1bd9cf1640 1 --2- 172.21.15.19:0/2448182914 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1bc006be30 0x7f1bc006e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.469+0000 7f1bd9cf1640 1 --2- 172.21.15.19:0/2448182914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bd415b8e0 0x7f1bd415bd90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.469+0000 7f1bd9cf1640 1 --2- 172.21.15.19:0/2448182914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd41e5830 0x7f1bd40b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.469+0000 7f1bd9cf1640 1 --2- 172.21.15.19:0/2448182914 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bbc003f60 0x7f1bd413e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.469+0000 7f1bd9cf1640 1 -- 172.21.15.19:0/2448182914 >> 172.21.15.19:0/2448182914 conn(0x7f1bd40b2f40 msgr2=0x7f1bd41e4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.469+0000 7f1bd9cf1640 1 -- 172.21.15.19:0/2448182914 shutdown_connections 2024-09-12T01:56:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.469+0000 7f1bd9cf1640 1 -- 172.21.15.19:0/2448182914 wait complete. 2024-09-12T01:56:37.481 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T01:56:37.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.584+0000 7f34ca93b640 1 Processor -- start 2024-09-12T01:56:37.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.584+0000 7f34ca93b640 1 -- start start 2024-09-12T01:56:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.585+0000 7f34ca93b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f34c40b5f80 0x7f34c40b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.585+0000 7f34ca93b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f34c40cd650 0x7f34c40cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.585+0000 7f34ca93b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34c406fdb0 con 0x7f34c40afd70 2024-09-12T01:56:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.585+0000 7f34ca93b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f34c40b6910 con 0x7f34c40b5f80 2024-09-12T01:56:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.585+0000 7f34ca93b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f34c4070090 con 0x7f34c40cd650 2024-09-12T01:56:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.585+0000 7f34c37fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f34c40b5f80 0x7f34c40b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.585+0000 7f34c37fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f34c40b5f80 0x7f34c40b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36572/0 (socket says 172.21.15.19:36572) 2024-09-12T01:56:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.585+0000 7f34c37fe640 1 -- 172.21.15.19:0/1316154247 learned_addr learned my addr 172.21.15.19:0/1316154247 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.585+0000 7f34c8ed8640 1 --2- 172.21.15.19:0/1316154247 >> v2:172.21.15.135:3300/0 conn(0x7f34c40cd650 0x7f34c40cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.585+0000 7f34c37fe640 1 -- 172.21.15.19:0/1316154247 >> v2:172.21.15.135:3300/0 conn(0x7f34c40cd650 msgr2=0x7f34c40cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.585+0000 7f34c37fe640 1 --2- 172.21.15.19:0/1316154247 >> v2:172.21.15.135:3300/0 conn(0x7f34c40cd650 0x7f34c40cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.585+0000 7f34c37fe640 1 -- 172.21.15.19:0/1316154247 >> v1:172.21.15.135:6789/0 conn(0x7f34c40afd70 legacy=0x7f34c4160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.585+0000 7f34c37fe640 1 -- 172.21.15.19:0/1316154247 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c4070370 con 0x7f34c40b5f80 2024-09-12T01:56:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.585+0000 7f34c8ed8640 1 --2- 172.21.15.19:0/1316154247 >> v2:172.21.15.135:3300/0 conn(0x7f34c40cd650 0x7f34c40cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.586+0000 7f34c37fe640 1 --2- 172.21.15.19:0/1316154247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34c40b5f80 0x7f34c40b63d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f34c4067ea0 tx=0x7f34b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6b3faab698c090 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.586+0000 7f34c2ffd640 1 -- 172.21.15.19:0/1316154247 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b8037070 con 0x7f34c40b5f80 2024-09-12T01:56:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.586+0000 7f34c2ffd640 1 -- 172.21.15.19:0/1316154247 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b8032440 con 0x7f34c40b5f80 2024-09-12T01:56:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.586+0000 7f34c2ffd640 1 -- 172.21.15.19:0/1316154247 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b8032810 con 0x7f34c40b5f80 2024-09-12T01:56:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.587+0000 7f34ca93b640 1 -- 172.21.15.19:0/1316154247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34c40b5f80 msgr2=0x7f34c40b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.587+0000 7f34ca93b640 1 --2- 172.21.15.19:0/1316154247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34c40b5f80 0x7f34c40b63d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f34c4067ea0 tx=0x7f34b802a270 comp rx=0 tx=0).stop 2024-09-12T01:56:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.587+0000 7f34ca93b640 1 -- 172.21.15.19:0/1316154247 shutdown_connections 2024-09-12T01:56:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.587+0000 7f34ca93b640 1 --2- 172.21.15.19:0/1316154247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34c40b5f80 0x7f34c40b63d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.587+0000 7f34ca93b640 1 --2- 172.21.15.19:0/1316154247 >> v2:172.21.15.135:3300/0 conn(0x7f34c40cd650 0x7f34c40cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.587+0000 7f34ca93b640 1 -- 172.21.15.19:0/1316154247 >> 172.21.15.19:0/1316154247 conn(0x7f34c406bc10 msgr2=0x7f34c406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:37.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.587+0000 7f34ca93b640 1 -- 172.21.15.19:0/1316154247 shutdown_connections 2024-09-12T01:56:37.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.587+0000 7f34ca93b640 1 -- 172.21.15.19:0/1316154247 wait complete. 2024-09-12T01:56:37.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.588+0000 7f34ca93b640 1 Processor -- start 2024-09-12T01:56:37.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.588+0000 7f34ca93b640 1 -- start start 2024-09-12T01:56:37.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.589+0000 7f34ca93b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34c40afd70 0x7f34c414b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.589+0000 7f34ca93b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34c40b5f80 0x7f34c41f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.589+0000 7f34ca93b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34c40cd650 0x7f34c40ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.589+0000 7f34ca93b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f34c40b0150 con 0x7f34c40afd70 2024-09-12T01:56:37.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.589+0000 7f34ca93b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f34c406fa80 con 0x7f34c40b5f80 2024-09-12T01:56:37.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.589+0000 7f34ca93b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f34c4160060 con 0x7f34c40cd650 2024-09-12T01:56:37.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.589+0000 7f34c3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34c40afd70 0x7f34c414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.589+0000 7f34c3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34c40afd70 0x7f34c414b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36584/0 (socket says 172.21.15.19:36584) 2024-09-12T01:56:37.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.589+0000 7f34c3fff640 1 -- 172.21.15.19:0/3402005162 learned_addr learned my addr 172.21.15.19:0/3402005162 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:37.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.589+0000 7f34c37fe640 1 --2- 172.21.15.19:0/3402005162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34c40b5f80 0x7f34c41f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.589+0000 7f34c8ed8640 1 --2- 172.21.15.19:0/3402005162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34c40cd650 0x7f34c40ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.589+0000 7f34c3fff640 1 -- 172.21.15.19:0/3402005162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34c40cd650 msgr2=0x7f34c40ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.589+0000 7f34c3fff640 1 --2- 172.21.15.19:0/3402005162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34c40cd650 0x7f34c40ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.589+0000 7f34c3fff640 1 -- 172.21.15.19:0/3402005162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34c40b5f80 msgr2=0x7f34c41f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.589+0000 7f34c3fff640 1 --2- 172.21.15.19:0/3402005162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34c40b5f80 0x7f34c41f47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.589+0000 7f34c3fff640 1 -- 172.21.15.19:0/3402005162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c40aced0 con 0x7f34c40afd70 2024-09-12T01:56:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.589+0000 7f34c3fff640 1 --2- 172.21.15.19:0/3402005162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34c40afd70 0x7f34c414b320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f34b400c400 tx=0x7f34b400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.590+0000 7f34c0ff9640 1 -- 172.21.15.19:0/3402005162 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b40052d0 con 0x7f34c40afd70 2024-09-12T01:56:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.590+0000 7f34c0ff9640 1 -- 172.21.15.19:0/3402005162 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b4005490 con 0x7f34c40afd70 2024-09-12T01:56:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.590+0000 7f34ca93b640 1 -- 172.21.15.19:0/3402005162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34c40ad1b0 con 0x7f34c40afd70 2024-09-12T01:56:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.590+0000 7f34c0ff9640 1 -- 172.21.15.19:0/3402005162 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4007260 con 0x7f34c40afd70 2024-09-12T01:56:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.590+0000 7f34ca93b640 1 -- 172.21.15.19:0/3402005162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34c40ada50 con 0x7f34c40afd70 2024-09-12T01:56:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.591+0000 7f34ca93b640 1 -- 172.21.15.19:0/3402005162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34c40ad380 con 0x7f34c40afd70 2024-09-12T01:56:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.591+0000 7f34c0ff9640 1 -- 172.21.15.19:0/3402005162 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f34b4007400 con 0x7f34c40afd70 2024-09-12T01:56:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.591+0000 7f34c0ff9640 1 --2- 172.21.15.19:0/3402005162 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f34b006be30 0x7f34b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.592+0000 7f34c0ff9640 1 -- 172.21.15.19:0/3402005162 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f34b408a870 con 0x7f34c40afd70 2024-09-12T01:56:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.592+0000 7f34c37fe640 1 --2- 172.21.15.19:0/3402005162 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f34b006be30 0x7f34b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.592+0000 7f34c37fe640 1 --2- 172.21.15.19:0/3402005162 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f34b006be30 0x7f34b006e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f34b8034000 tx=0x7f34b802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.596+0000 7f34c0ff9640 1 -- 172.21.15.19:0/3402005162 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f34b4058da0 con 0x7f34c40afd70 2024-09-12T01:56:37.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.810+0000 7f34ca93b640 1 -- 172.21.15.19:0/3402005162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f34c40b63d0 con 0x7f34c40afd70 2024-09-12T01:56:37.811 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T01:56:37.811+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:56:37.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.812+0000 7f34c0ff9640 1 -- 172.21.15.19:0/3402005162 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f34b40586a0 con 0x7f34c40afd70 2024-09-12T01:56:37.812 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:56:37.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.815+0000 7f34ca93b640 1 -- 172.21.15.19:0/3402005162 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f34b006be30 msgr2=0x7f34b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.815+0000 7f34ca93b640 1 --2- 172.21.15.19:0/3402005162 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f34b006be30 0x7f34b006e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f34b8034000 tx=0x7f34b802e000 comp rx=0 tx=0).stop 2024-09-12T01:56:37.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.815+0000 7f34ca93b640 1 -- 172.21.15.19:0/3402005162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34c40afd70 msgr2=0x7f34c414b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.815+0000 7f34ca93b640 1 --2- 172.21.15.19:0/3402005162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34c40afd70 0x7f34c414b320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f34b400c400 tx=0x7f34b400c8c0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.815+0000 7f34ca93b640 1 -- 172.21.15.19:0/3402005162 shutdown_connections 2024-09-12T01:56:37.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.815+0000 7f34ca93b640 1 --2- 172.21.15.19:0/3402005162 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f34b006be30 0x7f34b006e2f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.815+0000 7f34ca93b640 1 --2- 172.21.15.19:0/3402005162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34c40cd650 0x7f34c40ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.815+0000 7f34ca93b640 1 --2- 172.21.15.19:0/3402005162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34c40b5f80 0x7f34c41f47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.815+0000 7f34ca93b640 1 --2- 172.21.15.19:0/3402005162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34c40afd70 0x7f34c414b320 secure :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f34b400c400 tx=0x7f34b400c8c0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.815+0000 7f34ca93b640 1 -- 172.21.15.19:0/3402005162 >> 172.21.15.19:0/3402005162 conn(0x7f34c406bc10 msgr2=0x7f34c406c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:37.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.815+0000 7f34ca93b640 1 -- 172.21.15.19:0/3402005162 shutdown_connections 2024-09-12T01:56:37.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.815+0000 7f34ca93b640 1 -- 172.21.15.19:0/3402005162 wait complete. 2024-09-12T01:56:37.828 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T01:56:37.851 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T01:56:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.933+0000 7fde2f40e640 1 Processor -- start 2024-09-12T01:56:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.933+0000 7fde2f40e640 1 -- start start 2024-09-12T01:56:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.934+0000 7fde2f40e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fde2815cf10 0x7fde280b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.934+0000 7fde2f40e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde2815d2f0 0x7fde280b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.934+0000 7fde2f40e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fde280b3510 0x7fde280b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.934+0000 7fde2f40e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fde2815d820 con 0x7fde280b3510 2024-09-12T01:56:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.934+0000 7fde2f40e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fde2815db00 con 0x7fde2815cf10 2024-09-12T01:56:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.934+0000 7fde2f40e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fde2815dde0 con 0x7fde2815d2f0 2024-09-12T01:56:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.934+0000 7fde2d9ab640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fde280b3510 0x7fde280b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.935+0000 7fde2d9ab640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fde280b3510 0x7fde280b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36596/0 (socket says 172.21.15.19:36596) 2024-09-12T01:56:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.935+0000 7fde2d9ab640 1 -- 172.21.15.19:0/92301921 learned_addr learned my addr 172.21.15.19:0/92301921 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.935+0000 7fde2c9a9640 1 --2- 172.21.15.19:0/92301921 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde2815d2f0 0x7fde280b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.935+0000 7fde2d1aa640 1 --2- 172.21.15.19:0/92301921 >> v2:172.21.15.135:3300/0 conn(0x7fde2815cf10 0x7fde280b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.935+0000 7fde2d9ab640 1 -- 172.21.15.19:0/92301921 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde2815d2f0 msgr2=0x7fde280b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.935+0000 7fde2d9ab640 1 --2- 172.21.15.19:0/92301921 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde2815d2f0 0x7fde280b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.935+0000 7fde2d9ab640 1 -- 172.21.15.19:0/92301921 >> v2:172.21.15.135:3300/0 conn(0x7fde2815cf10 msgr2=0x7fde280b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.935+0000 7fde2d9ab640 1 --2- 172.21.15.19:0/92301921 >> v2:172.21.15.135:3300/0 conn(0x7fde2815cf10 0x7fde280b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.935+0000 7fde2d9ab640 1 -- 172.21.15.19:0/92301921 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2815e0c0 con 0x7fde280b3510 2024-09-12T01:56:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.936+0000 7fde2d9ab640 1 --2- 172.21.15.19:0/92301921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde280b3510 0x7fde280b6260 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fde280742a0 tx=0x7fde1802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452068d99106e8e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.936+0000 7fde27fff640 1 -- 172.21.15.19:0/92301921 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18036070 con 0x7fde280b3510 2024-09-12T01:56:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.936+0000 7fde27fff640 1 -- 172.21.15.19:0/92301921 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde18031600 con 0x7fde280b3510 2024-09-12T01:56:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.936+0000 7fde27fff640 1 -- 172.21.15.19:0/92301921 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde180319d0 con 0x7fde280b3510 2024-09-12T01:56:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.936+0000 7fde2f40e640 1 -- 172.21.15.19:0/92301921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde280b3510 msgr2=0x7fde280b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.936+0000 7fde2f40e640 1 --2- 172.21.15.19:0/92301921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde280b3510 0x7fde280b6260 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fde280742a0 tx=0x7fde1802a610 comp rx=0 tx=0).stop 2024-09-12T01:56:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.936+0000 7fde2f40e640 1 -- 172.21.15.19:0/92301921 shutdown_connections 2024-09-12T01:56:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.936+0000 7fde2f40e640 1 --2- 172.21.15.19:0/92301921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde280b3510 0x7fde280b6260 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.936+0000 7fde2f40e640 1 --2- 172.21.15.19:0/92301921 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde2815d2f0 0x7fde280b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.936+0000 7fde2f40e640 1 --2- 172.21.15.19:0/92301921 >> v2:172.21.15.135:3300/0 conn(0x7fde2815cf10 0x7fde280b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.936+0000 7fde2f40e640 1 -- 172.21.15.19:0/92301921 >> 172.21.15.19:0/92301921 conn(0x7fde280b7970 msgr2=0x7fde280b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.936+0000 7fde2f40e640 1 -- 172.21.15.19:0/92301921 shutdown_connections 2024-09-12T01:56:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.936+0000 7fde2f40e640 1 -- 172.21.15.19:0/92301921 wait complete. 2024-09-12T01:56:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.938+0000 7fde2f40e640 1 Processor -- start 2024-09-12T01:56:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.938+0000 7fde2f40e640 1 -- start start 2024-09-12T01:56:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.938+0000 7fde2f40e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde280b3510 0x7fde28154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.938+0000 7fde2f40e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde2815cf10 0x7fde28146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.938+0000 7fde2f40e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde2815d2f0 0x7fde281f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.938+0000 7fde2f40e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fde2809abb0 con 0x7fde2815cf10 2024-09-12T01:56:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.938+0000 7fde2f40e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fde2809aa30 con 0x7fde2815d2f0 2024-09-12T01:56:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.938+0000 7fde2f40e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fde2809ad30 con 0x7fde280b3510 2024-09-12T01:56:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.939+0000 7fde2c9a9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde2815cf10 0x7fde28146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.939+0000 7fde2c9a9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde2815cf10 0x7fde28146df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36610/0 (socket says 172.21.15.19:36610) 2024-09-12T01:56:37.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.939+0000 7fde2c9a9640 1 -- 172.21.15.19:0/4152280570 learned_addr learned my addr 172.21.15.19:0/4152280570 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:37.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.939+0000 7fde2d1aa640 1 --2- 172.21.15.19:0/4152280570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde280b3510 0x7fde28154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.939+0000 7fde2d9ab640 1 --2- 172.21.15.19:0/4152280570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde2815d2f0 0x7fde281f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.939+0000 7fde2c9a9640 1 -- 172.21.15.19:0/4152280570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde280b3510 msgr2=0x7fde28154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.939+0000 7fde2c9a9640 1 --2- 172.21.15.19:0/4152280570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde280b3510 0x7fde28154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.939+0000 7fde2c9a9640 1 -- 172.21.15.19:0/4152280570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde2815d2f0 msgr2=0x7fde281f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.939+0000 7fde2c9a9640 1 --2- 172.21.15.19:0/4152280570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde2815d2f0 0x7fde281f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.939+0000 7fde2c9a9640 1 -- 172.21.15.19:0/4152280570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde28156b20 con 0x7fde2815cf10 2024-09-12T01:56:37.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.939+0000 7fde2c9a9640 1 --2- 172.21.15.19:0/4152280570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde2815cf10 0x7fde28146df0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00e870 tx=0x7fde1c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:37.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.939+0000 7fde25ffb640 1 -- 172.21.15.19:0/4152280570 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c017070 con 0x7fde2815cf10 2024-09-12T01:56:37.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.939+0000 7fde25ffb640 1 -- 172.21.15.19:0/4152280570 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c00c940 con 0x7fde2815cf10 2024-09-12T01:56:37.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.939+0000 7fde2f40e640 1 -- 172.21.15.19:0/4152280570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde28155230 con 0x7fde2815cf10 2024-09-12T01:56:37.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.939+0000 7fde25ffb640 1 -- 172.21.15.19:0/4152280570 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c00cd30 con 0x7fde2815cf10 2024-09-12T01:56:37.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.940+0000 7fde2f40e640 1 -- 172.21.15.19:0/4152280570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde281557f0 con 0x7fde2815cf10 2024-09-12T01:56:37.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.940+0000 7fde2f40e640 1 -- 172.21.15.19:0/4152280570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde280b2fd0 con 0x7fde2815cf10 2024-09-12T01:56:37.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.941+0000 7fde25ffb640 1 -- 172.21.15.19:0/4152280570 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde1c01a070 con 0x7fde2815cf10 2024-09-12T01:56:37.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.941+0000 7fde25ffb640 1 --2- 172.21.15.19:0/4152280570 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fde1406be30 0x7fde1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.941+0000 7fde25ffb640 1 -- 172.21.15.19:0/4152280570 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7fde1c08b030 con 0x7fde2815cf10 2024-09-12T01:56:37.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.942+0000 7fde2d1aa640 1 --2- 172.21.15.19:0/4152280570 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fde1406be30 0x7fde1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.942+0000 7fde2d1aa640 1 --2- 172.21.15.19:0/4152280570 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fde1406be30 0x7fde1406e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fde28156f40 tx=0x7fde20009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:37.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:37.946+0000 7fde25ffb640 1 -- 172.21.15.19:0/4152280570 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde1c058fc0 con 0x7fde2815cf10 2024-09-12T01:56:38.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.159+0000 7fde2f40e640 1 -- 172.21.15.19:0/4152280570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fde2815c220 con 0x7fde2815cf10 2024-09-12T01:56:38.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.814+0000 7fde25ffb640 1 -- 172.21.15.19:0/4152280570 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fde1c05d2c0 con 0x7fde2815cf10 2024-09-12T01:56:38.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.816+0000 7fde2f40e640 1 -- 172.21.15.19:0/4152280570 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fde1406be30 msgr2=0x7fde1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:38.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.816+0000 7fde2f40e640 1 --2- 172.21.15.19:0/4152280570 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fde1406be30 0x7fde1406e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fde28156f40 tx=0x7fde20009190 comp rx=0 tx=0).stop 2024-09-12T01:56:38.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.816+0000 7fde2f40e640 1 -- 172.21.15.19:0/4152280570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde2815cf10 msgr2=0x7fde28146df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:38.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.816+0000 7fde2f40e640 1 --2- 172.21.15.19:0/4152280570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde2815cf10 0x7fde28146df0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00e870 tx=0x7fde1c00ed30 comp rx=0 tx=0).stop 2024-09-12T01:56:38.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.816+0000 7fde2f40e640 1 -- 172.21.15.19:0/4152280570 shutdown_connections 2024-09-12T01:56:38.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.816+0000 7fde2f40e640 1 --2- 172.21.15.19:0/4152280570 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fde1406be30 0x7fde1406e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:38.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.816+0000 7fde2f40e640 1 --2- 172.21.15.19:0/4152280570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde2815d2f0 0x7fde281f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:38.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.816+0000 7fde2f40e640 1 --2- 172.21.15.19:0/4152280570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde2815cf10 0x7fde28146df0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:38.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.816+0000 7fde2f40e640 1 --2- 172.21.15.19:0/4152280570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde280b3510 0x7fde28154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:38.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.816+0000 7fde2f40e640 1 -- 172.21.15.19:0/4152280570 >> 172.21.15.19:0/4152280570 conn(0x7fde280b7970 msgr2=0x7fde280b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:38.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.817+0000 7fde2f40e640 1 -- 172.21.15.19:0/4152280570 shutdown_connections 2024-09-12T01:56:38.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.817+0000 7fde2f40e640 1 -- 172.21.15.19:0/4152280570 wait complete. 2024-09-12T01:56:38.830 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T01:56:38.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.942+0000 7fd4eb077640 1 Processor -- start 2024-09-12T01:56:38.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.942+0000 7fd4eb077640 1 -- start start 2024-09-12T01:56:38.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.943+0000 7fd4eb077640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4e415e980 0x7fd4e40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:38.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.943+0000 7fd4eb077640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd4e40d1330 0x7fd4e41685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:38.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.943+0000 7fd4eb077640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e40d53f0 con 0x7fd4e415e5a0 2024-09-12T01:56:38.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.943+0000 7fd4eb077640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd4e40d1780 con 0x7fd4e40d1330 2024-09-12T01:56:38.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.943+0000 7fd4eb077640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e406cd90 con 0x7fd4e415e980 2024-09-12T01:56:38.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.943+0000 7fd4e9614640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd4e40d1330 0x7fd4e41685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:38.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.943+0000 7fd4e3fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4e415e980 0x7fd4e40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:38.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.943+0000 7fd4e9614640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd4e40d1330 0x7fd4e41685c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:48900/0 (socket says 172.21.15.19:48900) 2024-09-12T01:56:38.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.943+0000 7fd4e3fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4e415e980 0x7fd4e40d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:36438/0 (socket says 172.21.15.19:36438) 2024-09-12T01:56:38.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.943+0000 7fd4e9614640 1 -- 172.21.15.19:0/3133552954 learned_addr learned my addr 172.21.15.19:0/3133552954 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:38.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.943+0000 7fd4e8e13640 1 --1- 172.21.15.19:0/3133552954 >> v1:172.21.15.135:6789/0 conn(0x7fd4e415e5a0 0x7fd4e40cfcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:52060/0 (socket says 172.21.15.19:52060) 2024-09-12T01:56:38.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.943+0000 7fd4e3fff640 1 -- 172.21.15.19:0/3133552954 >> v2:172.21.15.135:3300/0 conn(0x7fd4e40d1330 msgr2=0x7fd4e41685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:38.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.943+0000 7fd4e3fff640 1 --2- 172.21.15.19:0/3133552954 >> v2:172.21.15.135:3300/0 conn(0x7fd4e40d1330 0x7fd4e41685c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:38.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.944+0000 7fd4e3fff640 1 -- 172.21.15.19:0/3133552954 >> v1:172.21.15.135:6789/0 conn(0x7fd4e415e5a0 legacy=0x7fd4e40cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:38.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.944+0000 7fd4e3fff640 1 -- 172.21.15.19:0/3133552954 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e406d070 con 0x7fd4e415e980 2024-09-12T01:56:38.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.944+0000 7fd4e9614640 1 --2- 172.21.15.19:0/3133552954 >> v2:172.21.15.135:3300/0 conn(0x7fd4e40d1330 0x7fd4e41685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:38.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.944+0000 7fd4e3fff640 1 --2- 172.21.15.19:0/3133552954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4e415e980 0x7fd4e40d0df0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd4d00097a0 tx=0x7fd4d002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb008568f26eac12 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:38.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.944+0000 7fd4e37fe640 1 -- 172.21.15.19:0/3133552954 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0037070 con 0x7fd4e415e980 2024-09-12T01:56:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.944+0000 7fd4e37fe640 1 -- 172.21.15.19:0/3133552954 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d002ae50 con 0x7fd4e415e980 2024-09-12T01:56:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.944+0000 7fd4e37fe640 1 -- 172.21.15.19:0/3133552954 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0032660 con 0x7fd4e415e980 2024-09-12T01:56:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.945+0000 7fd4eb077640 1 -- 172.21.15.19:0/3133552954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4e415e980 msgr2=0x7fd4e40d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.945+0000 7fd4eb077640 1 --2- 172.21.15.19:0/3133552954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4e415e980 0x7fd4e40d0df0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd4d00097a0 tx=0x7fd4d002a100 comp rx=0 tx=0).stop 2024-09-12T01:56:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.945+0000 7fd4eb077640 1 -- 172.21.15.19:0/3133552954 shutdown_connections 2024-09-12T01:56:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.945+0000 7fd4eb077640 1 --2- 172.21.15.19:0/3133552954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4e415e980 0x7fd4e40d0df0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.945+0000 7fd4eb077640 1 --2- 172.21.15.19:0/3133552954 >> v2:172.21.15.135:3300/0 conn(0x7fd4e40d1330 0x7fd4e41685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.945+0000 7fd4eb077640 1 -- 172.21.15.19:0/3133552954 >> 172.21.15.19:0/3133552954 conn(0x7fd4e408bfc0 msgr2=0x7fd4e40d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.945+0000 7fd4eb077640 1 -- 172.21.15.19:0/3133552954 shutdown_connections 2024-09-12T01:56:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.945+0000 7fd4eb077640 1 -- 172.21.15.19:0/3133552954 wait complete. 2024-09-12T01:56:38.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.946+0000 7fd4eb077640 1 Processor -- start 2024-09-12T01:56:38.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.946+0000 7fd4eb077640 1 -- start start 2024-09-12T01:56:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.947+0000 7fd4eb077640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4e40d1330 0x7fd4e40c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.947+0000 7fd4eb077640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4e415e5a0 0x7fd4e4155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.947+0000 7fd4eb077640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4e415e980 0x7fd4e40b5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.947+0000 7fd4eb077640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e406d910 con 0x7fd4e40d1330 2024-09-12T01:56:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.947+0000 7fd4eb077640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e406d630 con 0x7fd4e415e5a0 2024-09-12T01:56:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.947+0000 7fd4eb077640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e40d03e0 con 0x7fd4e415e980 2024-09-12T01:56:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.947+0000 7fd4e8e13640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4e40d1330 0x7fd4e40c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.947+0000 7fd4e8e13640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4e40d1330 0x7fd4e40c7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36612/0 (socket says 172.21.15.19:36612) 2024-09-12T01:56:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.947+0000 7fd4e8e13640 1 -- 172.21.15.19:0/2433380044 learned_addr learned my addr 172.21.15.19:0/2433380044 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.947+0000 7fd4e3fff640 1 --2- 172.21.15.19:0/2433380044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4e415e5a0 0x7fd4e4155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.947+0000 7fd4e9614640 1 --2- 172.21.15.19:0/2433380044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4e415e980 0x7fd4e40b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.948+0000 7fd4e8e13640 1 -- 172.21.15.19:0/2433380044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4e415e980 msgr2=0x7fd4e40b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.948+0000 7fd4e8e13640 1 --2- 172.21.15.19:0/2433380044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4e415e980 0x7fd4e40b5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.948+0000 7fd4e8e13640 1 -- 172.21.15.19:0/2433380044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4e415e5a0 msgr2=0x7fd4e4155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.948+0000 7fd4e8e13640 1 --2- 172.21.15.19:0/2433380044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4e415e5a0 0x7fd4e4155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.948+0000 7fd4e8e13640 1 -- 172.21.15.19:0/2433380044 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e40c8430 con 0x7fd4e40d1330 2024-09-12T01:56:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.948+0000 7fd4e8e13640 1 --2- 172.21.15.19:0/2433380044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4e40d1330 0x7fd4e40c7e50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800c400 tx=0x7fd4d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.948+0000 7fd4e17fa640 1 -- 172.21.15.19:0/2433380044 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d80074e0 con 0x7fd4e40d1330 2024-09-12T01:56:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.948+0000 7fd4e17fa640 1 -- 172.21.15.19:0/2433380044 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d8007680 con 0x7fd4e40d1330 2024-09-12T01:56:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.948+0000 7fd4e17fa640 1 -- 172.21.15.19:0/2433380044 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8004a00 con 0x7fd4e40d1330 2024-09-12T01:56:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.948+0000 7fd4eb077640 1 -- 172.21.15.19:0/2433380044 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e40c8710 con 0x7fd4e40d1330 2024-09-12T01:56:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.948+0000 7fd4eb077640 1 -- 172.21.15.19:0/2433380044 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e40c8cd0 con 0x7fd4e40d1330 2024-09-12T01:56:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.949+0000 7fd4eb077640 1 -- 172.21.15.19:0/2433380044 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e406de30 con 0x7fd4e40d1330 2024-09-12T01:56:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.950+0000 7fd4e17fa640 1 -- 172.21.15.19:0/2433380044 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd4d801a020 con 0x7fd4e40d1330 2024-09-12T01:56:38.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.950+0000 7fd4e17fa640 1 --2- 172.21.15.19:0/2433380044 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd4c806be30 0x7fd4c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:38.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.950+0000 7fd4e17fa640 1 -- 172.21.15.19:0/2433380044 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7fd4d808aa00 con 0x7fd4e40d1330 2024-09-12T01:56:38.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.950+0000 7fd4e3fff640 1 --2- 172.21.15.19:0/2433380044 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd4c806be30 0x7fd4c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:38.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.951+0000 7fd4e3fff640 1 --2- 172.21.15.19:0/2433380044 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd4c806be30 0x7fd4c806e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0034000 tx=0x7fd4d002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:38.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:38.954+0000 7fd4e17fa640 1 -- 172.21.15.19:0/2433380044 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4d8058880 con 0x7fd4e40d1330 2024-09-12T01:56:39.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:39.129+0000 7fd4eb077640 1 -- 172.21.15.19:0/2433380044 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd4e41560f0 con 0x7fd4e40d1330 2024-09-12T01:56:39.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:39.868+0000 7fd4e17fa640 1 -- 172.21.15.19:0/2433380044 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) ==== 181+0+0 (secure 0 0 0) 0x7fd4d805cb80 con 0x7fd4e40d1330 2024-09-12T01:56:39.869 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-09-12T01:56:39.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:39.872+0000 7fd4eb077640 1 -- 172.21.15.19:0/2433380044 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd4c806be30 msgr2=0x7fd4c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:39.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:39.872+0000 7fd4eb077640 1 --2- 172.21.15.19:0/2433380044 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd4c806be30 0x7fd4c806e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0034000 tx=0x7fd4d002e000 comp rx=0 tx=0).stop 2024-09-12T01:56:39.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:39.872+0000 7fd4eb077640 1 -- 172.21.15.19:0/2433380044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4e40d1330 msgr2=0x7fd4e40c7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:39.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:39.872+0000 7fd4eb077640 1 --2- 172.21.15.19:0/2433380044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4e40d1330 0x7fd4e40c7e50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800c400 tx=0x7fd4d800c8c0 comp rx=0 tx=0).stop 2024-09-12T01:56:39.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:39.872+0000 7fd4eb077640 1 -- 172.21.15.19:0/2433380044 shutdown_connections 2024-09-12T01:56:39.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:39.872+0000 7fd4eb077640 1 --2- 172.21.15.19:0/2433380044 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd4c806be30 0x7fd4c806e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:39.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:39.872+0000 7fd4eb077640 1 --2- 172.21.15.19:0/2433380044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4e415e980 0x7fd4e40b5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:39.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:39.872+0000 7fd4eb077640 1 --2- 172.21.15.19:0/2433380044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4e415e5a0 0x7fd4e4155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:39.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:39.872+0000 7fd4eb077640 1 --2- 172.21.15.19:0/2433380044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4e40d1330 0x7fd4e40c7e50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:39.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:39.872+0000 7fd4eb077640 1 -- 172.21.15.19:0/2433380044 >> 172.21.15.19:0/2433380044 conn(0x7fd4e408bfc0 msgr2=0x7fd4e40d3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:39.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:39.873+0000 7fd4eb077640 1 -- 172.21.15.19:0/2433380044 shutdown_connections 2024-09-12T01:56:39.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:39.873+0000 7fd4eb077640 1 -- 172.21.15.19:0/2433380044 wait complete. 2024-09-12T01:56:39.888 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T01:56:40.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.000+0000 7f7d518c9640 1 Processor -- start 2024-09-12T01:56:40.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.000+0000 7f7d518c9640 1 -- start start 2024-09-12T01:56:40.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.001+0000 7f7d518c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d4c0d4c10 0x7f7d4c162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:40.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.001+0000 7f7d518c9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7d4c0d3320 0x7f7d4c0d37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:40.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.001+0000 7f7d518c9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d4c0d2600 con 0x7f7d4c0b5f80 2024-09-12T01:56:40.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.001+0000 7f7d518c9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f7d4c0d5420 con 0x7f7d4c0d3320 2024-09-12T01:56:40.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.001+0000 7f7d518c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7d4c0d2e90 con 0x7f7d4c0d4c10 2024-09-12T01:56:40.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.001+0000 7f7d4b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7d4c0d3320 0x7f7d4c0d37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:40.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.001+0000 7f7d4b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7d4c0d3320 0x7f7d4c0d37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36620/0 (socket says 172.21.15.19:36620) 2024-09-12T01:56:40.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.001+0000 7f7d4b7fe640 1 -- 172.21.15.19:0/4154938692 learned_addr learned my addr 172.21.15.19:0/4154938692 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:40.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.001+0000 7f7d4a7fc640 1 --2- 172.21.15.19:0/4154938692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d4c0d4c10 0x7f7d4c162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:40.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.001+0000 7f7d4b7fe640 1 -- 172.21.15.19:0/4154938692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d4c0d4c10 msgr2=0x7f7d4c162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:40.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.001+0000 7f7d4b7fe640 1 --2- 172.21.15.19:0/4154938692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d4c0d4c10 0x7f7d4c162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:40.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.001+0000 7f7d4b7fe640 1 -- 172.21.15.19:0/4154938692 >> v1:172.21.15.135:6789/0 conn(0x7f7d4c0b5f80 legacy=0x7f7d4c0b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:40.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.001+0000 7f7d4b7fe640 1 -- 172.21.15.19:0/4154938692 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4c0b3c10 con 0x7f7d4c0d3320 2024-09-12T01:56:40.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.002+0000 7f7d4b7fe640 1 --2- 172.21.15.19:0/4154938692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d4c0d3320 0x7f7d4c0d37b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009e50 tx=0x7f7d4402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f21d26e8ea280b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:40.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.002+0000 7f7d49ffb640 1 -- 172.21.15.19:0/4154938692 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d44036070 con 0x7f7d4c0d3320 2024-09-12T01:56:40.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.002+0000 7f7d49ffb640 1 -- 172.21.15.19:0/4154938692 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d44031600 con 0x7f7d4c0d3320 2024-09-12T01:56:40.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.002+0000 7f7d49ffb640 1 -- 172.21.15.19:0/4154938692 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d440319d0 con 0x7f7d4c0d3320 2024-09-12T01:56:40.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.003+0000 7f7d518c9640 1 -- 172.21.15.19:0/4154938692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d4c0d3320 msgr2=0x7f7d4c0d37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:40.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.003+0000 7f7d518c9640 1 --2- 172.21.15.19:0/4154938692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d4c0d3320 0x7f7d4c0d37b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009e50 tx=0x7f7d4402a710 comp rx=0 tx=0).stop 2024-09-12T01:56:40.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.003+0000 7f7d518c9640 1 -- 172.21.15.19:0/4154938692 shutdown_connections 2024-09-12T01:56:40.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.003+0000 7f7d518c9640 1 --2- 172.21.15.19:0/4154938692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d4c0d3320 0x7f7d4c0d37b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:40.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.003+0000 7f7d518c9640 1 --2- 172.21.15.19:0/4154938692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d4c0d4c10 0x7f7d4c162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:40.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.003+0000 7f7d518c9640 1 -- 172.21.15.19:0/4154938692 >> 172.21.15.19:0/4154938692 conn(0x7f7d4c08bfc0 msgr2=0x7f7d4c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:40.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.003+0000 7f7d518c9640 1 -- 172.21.15.19:0/4154938692 shutdown_connections 2024-09-12T01:56:40.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.003+0000 7f7d518c9640 1 -- 172.21.15.19:0/4154938692 wait complete. 2024-09-12T01:56:40.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.004+0000 7f7d518c9640 1 Processor -- start 2024-09-12T01:56:40.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.004+0000 7f7d518c9640 1 -- start start 2024-09-12T01:56:40.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.005+0000 7f7d518c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d4c0b5f80 0x7f7d4c14e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:40.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.005+0000 7f7d518c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d4c0d3320 0x7f7d4c0b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:40.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.005+0000 7f7d518c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d4c0d4c10 0x7f7d4c0b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:40.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.005+0000 7f7d518c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4c0d2b20 con 0x7f7d4c0b5f80 2024-09-12T01:56:40.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.005+0000 7f7d518c9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4c0d2880 con 0x7f7d4c0d4c10 2024-09-12T01:56:40.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.005+0000 7f7d518c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7d4c15f690 con 0x7f7d4c0d3320 2024-09-12T01:56:40.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.005+0000 7f7d4affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d4c0b5f80 0x7f7d4c14e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:40.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.005+0000 7f7d4affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d4c0b5f80 0x7f7d4c14e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36622/0 (socket says 172.21.15.19:36622) 2024-09-12T01:56:40.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.005+0000 7f7d4affd640 1 -- 172.21.15.19:0/344810712 learned_addr learned my addr 172.21.15.19:0/344810712 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:40.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.005+0000 7f7d4b7fe640 1 --2- 172.21.15.19:0/344810712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d4c0d4c10 0x7f7d4c0b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:40.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.005+0000 7f7d4a7fc640 1 --2- 172.21.15.19:0/344810712 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d4c0d3320 0x7f7d4c0b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:40.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.006+0000 7f7d4affd640 1 -- 172.21.15.19:0/344810712 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d4c0d3320 msgr2=0x7f7d4c0b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:40.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.006+0000 7f7d4affd640 1 --2- 172.21.15.19:0/344810712 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d4c0d3320 0x7f7d4c0b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:40.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.006+0000 7f7d4affd640 1 -- 172.21.15.19:0/344810712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d4c0d4c10 msgr2=0x7f7d4c0b7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:40.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.006+0000 7f7d4affd640 1 --2- 172.21.15.19:0/344810712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d4c0d4c10 0x7f7d4c0b7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:40.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.006+0000 7f7d4affd640 1 -- 172.21.15.19:0/344810712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4c0b3410 con 0x7f7d4c0b5f80 2024-09-12T01:56:40.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.006+0000 7f7d4affd640 1 --2- 172.21.15.19:0/344810712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d4c0b5f80 0x7f7d4c14e990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00c400 tx=0x7f7d3c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:40.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.006+0000 7f7d33fff640 1 -- 172.21.15.19:0/344810712 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c0052d0 con 0x7f7d4c0b5f80 2024-09-12T01:56:40.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.006+0000 7f7d33fff640 1 -- 172.21.15.19:0/344810712 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d3c005490 con 0x7f7d4c0b5f80 2024-09-12T01:56:40.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.006+0000 7f7d518c9640 1 -- 172.21.15.19:0/344810712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d4c0b36f0 con 0x7f7d4c0b5f80 2024-09-12T01:56:40.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.006+0000 7f7d33fff640 1 -- 172.21.15.19:0/344810712 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c007260 con 0x7f7d4c0b5f80 2024-09-12T01:56:40.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.006+0000 7f7d518c9640 1 -- 172.21.15.19:0/344810712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d4c1e81b0 con 0x7f7d4c0b5f80 2024-09-12T01:56:40.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.007+0000 7f7d518c9640 1 -- 172.21.15.19:0/344810712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d4c0d37b0 con 0x7f7d4c0b5f80 2024-09-12T01:56:40.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.008+0000 7f7d33fff640 1 -- 172.21.15.19:0/344810712 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d3c007400 con 0x7f7d4c0b5f80 2024-09-12T01:56:40.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.008+0000 7f7d33fff640 1 --2- 172.21.15.19:0/344810712 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7d3806be30 0x7f7d3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:40.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.008+0000 7f7d33fff640 1 -- 172.21.15.19:0/344810712 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6383+0+0 (secure 0 0 0) 0x7f7d3c08a500 con 0x7f7d4c0b5f80 2024-09-12T01:56:40.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.008+0000 7f7d4a7fc640 1 --2- 172.21.15.19:0/344810712 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7d3806be30 0x7f7d3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:40.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.009+0000 7f7d4a7fc640 1 --2- 172.21.15.19:0/344810712 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7d3806be30 0x7f7d3806e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0b1a60 tx=0x7f7d40008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:40.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.012+0000 7f7d33fff640 1 -- 172.21.15.19:0/344810712 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d4c0d2600 con 0x7f7d4c0b5f80 2024-09-12T01:56:40.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.191+0000 7f7d518c9640 1 -- 172.21.15.19:0/344810712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7d4c15fb10 con 0x7f7d4c0b5f80 2024-09-12T01:56:40.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.880+0000 7f7d33fff640 1 -- 172.21.15.19:0/344810712 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) ==== 169+0+0 (secure 0 0 0) 0x7f7d3c058650 con 0x7f7d4c0b5f80 2024-09-12T01:56:40.880 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-09-12T01:56:40.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.884+0000 7f7d518c9640 1 -- 172.21.15.19:0/344810712 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7d3806be30 msgr2=0x7f7d3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:40.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.884+0000 7f7d518c9640 1 --2- 172.21.15.19:0/344810712 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7d3806be30 0x7f7d3806e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0b1a60 tx=0x7f7d40008040 comp rx=0 tx=0).stop 2024-09-12T01:56:40.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.884+0000 7f7d518c9640 1 -- 172.21.15.19:0/344810712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d4c0b5f80 msgr2=0x7f7d4c14e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:40.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.884+0000 7f7d518c9640 1 --2- 172.21.15.19:0/344810712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d4c0b5f80 0x7f7d4c14e990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00c400 tx=0x7f7d3c00c8c0 comp rx=0 tx=0).stop 2024-09-12T01:56:40.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.884+0000 7f7d518c9640 1 -- 172.21.15.19:0/344810712 shutdown_connections 2024-09-12T01:56:40.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.884+0000 7f7d518c9640 1 --2- 172.21.15.19:0/344810712 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7d3806be30 0x7f7d3806e2f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:40.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.884+0000 7f7d518c9640 1 --2- 172.21.15.19:0/344810712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d4c0d4c10 0x7f7d4c0b7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:40.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.884+0000 7f7d518c9640 1 --2- 172.21.15.19:0/344810712 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d4c0d3320 0x7f7d4c0b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:40.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.884+0000 7f7d518c9640 1 --2- 172.21.15.19:0/344810712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d4c0b5f80 0x7f7d4c14e990 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:40.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.884+0000 7f7d518c9640 1 -- 172.21.15.19:0/344810712 >> 172.21.15.19:0/344810712 conn(0x7f7d4c08bfc0 msgr2=0x7f7d4c0d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:40.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.885+0000 7f7d518c9640 1 -- 172.21.15.19:0/344810712 shutdown_connections 2024-09-12T01:56:40.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:40.885+0000 7f7d518c9640 1 -- 172.21.15.19:0/344810712 wait complete. 2024-09-12T01:56:40.900 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-12T01:56:41.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.015+0000 7fd3473ef640 1 Processor -- start 2024-09-12T01:56:41.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.015+0000 7fd3473ef640 1 -- start start 2024-09-12T01:56:41.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.016+0000 7fd3473ef640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd3400cd120 0x7fd340071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:41.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.016+0000 7fd3473ef640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd34015b950 0x7fd34015e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:41.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.016+0000 7fd3473ef640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd34015be00 con 0x7fd34015b570 2024-09-12T01:56:41.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.016+0000 7fd3473ef640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd3400740e0 con 0x7fd3400cd120 2024-09-12T01:56:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.016+0000 7fd3473ef640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd340073b20 con 0x7fd34015b950 2024-09-12T01:56:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.017+0000 7fd34598c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd34015b950 0x7fd34015e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.017+0000 7fd34498a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd3400cd120 0x7fd340071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.017+0000 7fd34598c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd34015b950 0x7fd34015e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:36490/0 (socket says 172.21.15.19:36490) 2024-09-12T01:56:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.017+0000 7fd34498a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd3400cd120 0x7fd340071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:48926/0 (socket says 172.21.15.19:48926) 2024-09-12T01:56:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.017+0000 7fd34598c640 1 -- 172.21.15.19:0/2305315098 learned_addr learned my addr 172.21.15.19:0/2305315098 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.017+0000 7fd34518b640 1 --1- 172.21.15.19:0/2305315098 >> v1:172.21.15.135:6789/0 conn(0x7fd34015b570 0x7fd3400cca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:52082/0 (socket says 172.21.15.19:52082) 2024-09-12T01:56:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.017+0000 7fd337fff640 1 -- 172.21.15.19:0/2305315098 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3806401652 0 0) 0x7fd34015be00 con 0x7fd34015b570 2024-09-12T01:56:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.017+0000 7fd337fff640 1 -- 172.21.15.19:0/2305315098 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd32c003520 con 0x7fd34015b570 2024-09-12T01:56:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.017+0000 7fd34498a640 1 -- 172.21.15.19:0/2305315098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd34015b950 msgr2=0x7fd34015e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:41.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.017+0000 7fd34498a640 1 --2- 172.21.15.19:0/2305315098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd34015b950 0x7fd34015e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.017+0000 7fd34498a640 1 -- 172.21.15.19:0/2305315098 >> v1:172.21.15.135:6789/0 conn(0x7fd34015b570 legacy=0x7fd3400cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:41.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.017+0000 7fd34498a640 1 -- 172.21.15.19:0/2305315098 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd340073e00 con 0x7fd3400cd120 2024-09-12T01:56:41.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.017+0000 7fd34598c640 1 --2- 172.21.15.19:0/2305315098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd34015b950 0x7fd34015e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:41.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.018+0000 7fd34498a640 1 --2- 172.21.15.19:0/2305315098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3400cd120 0x7fd340071e40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd3300097a0 tx=0x7fd33002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63871155e2eb718c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:41.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.018+0000 7fd337fff640 1 -- 172.21.15.19:0/2305315098 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd330037070 con 0x7fd3400cd120 2024-09-12T01:56:41.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.018+0000 7fd337fff640 1 -- 172.21.15.19:0/2305315098 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd33002ae50 con 0x7fd3400cd120 2024-09-12T01:56:41.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.018+0000 7fd337fff640 1 -- 172.21.15.19:0/2305315098 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd330032660 con 0x7fd3400cd120 2024-09-12T01:56:41.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.019+0000 7fd3473ef640 1 -- 172.21.15.19:0/2305315098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3400cd120 msgr2=0x7fd340071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:41.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.019+0000 7fd3473ef640 1 --2- 172.21.15.19:0/2305315098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3400cd120 0x7fd340071e40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd3300097a0 tx=0x7fd33002a100 comp rx=0 tx=0).stop 2024-09-12T01:56:41.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.019+0000 7fd3473ef640 1 -- 172.21.15.19:0/2305315098 shutdown_connections 2024-09-12T01:56:41.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.019+0000 7fd3473ef640 1 --2- 172.21.15.19:0/2305315098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd34015b950 0x7fd34015e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.019+0000 7fd3473ef640 1 --2- 172.21.15.19:0/2305315098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3400cd120 0x7fd340071e40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.019+0000 7fd3473ef640 1 -- 172.21.15.19:0/2305315098 >> 172.21.15.19:0/2305315098 conn(0x7fd34006bdf0 msgr2=0x7fd34006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:41.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.019+0000 7fd3473ef640 1 -- 172.21.15.19:0/2305315098 shutdown_connections 2024-09-12T01:56:41.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.019+0000 7fd3473ef640 1 -- 172.21.15.19:0/2305315098 wait complete. 2024-09-12T01:56:41.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.020+0000 7fd3473ef640 1 Processor -- start 2024-09-12T01:56:41.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.020+0000 7fd3473ef640 1 -- start start 2024-09-12T01:56:41.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.021+0000 7fd3473ef640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3400cd120 0x7fd34006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:41.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.021+0000 7fd3473ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd34015b570 0x7fd340156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:41.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.021+0000 7fd3473ef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd34015b950 0x7fd340147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:41.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.021+0000 7fd3473ef640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd3400cf840 con 0x7fd34015b950 2024-09-12T01:56:41.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.021+0000 7fd3473ef640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd340072450 con 0x7fd34015b570 2024-09-12T01:56:41.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.021+0000 7fd3473ef640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd3400cf9c0 con 0x7fd3400cd120 2024-09-12T01:56:41.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.021+0000 7fd34598c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd34015b950 0x7fd340147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:41.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.021+0000 7fd34598c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd34015b950 0x7fd340147200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36634/0 (socket says 172.21.15.19:36634) 2024-09-12T01:56:41.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.021+0000 7fd34598c640 1 -- 172.21.15.19:0/158282553 learned_addr learned my addr 172.21.15.19:0/158282553 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:41.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.021+0000 7fd34518b640 1 --2- 172.21.15.19:0/158282553 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3400cd120 0x7fd34006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:41.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.021+0000 7fd34498a640 1 --2- 172.21.15.19:0/158282553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd34015b570 0x7fd340156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:41.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.021+0000 7fd34598c640 1 -- 172.21.15.19:0/158282553 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3400cd120 msgr2=0x7fd34006f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:41.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.021+0000 7fd34598c640 1 --2- 172.21.15.19:0/158282553 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3400cd120 0x7fd34006f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.021+0000 7fd34598c640 1 -- 172.21.15.19:0/158282553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd34015b570 msgr2=0x7fd340156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:41.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.021+0000 7fd34598c640 1 --2- 172.21.15.19:0/158282553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd34015b570 0x7fd340156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.021+0000 7fd34598c640 1 -- 172.21.15.19:0/158282553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3400b06f0 con 0x7fd34015b950 2024-09-12T01:56:41.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.021+0000 7fd34598c640 1 --2- 172.21.15.19:0/158282553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd34015b950 0x7fd340147200 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd33800efc0 tx=0x7fd33800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:41.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.022+0000 7fd335ffb640 1 -- 172.21.15.19:0/158282553 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33800cbe0 con 0x7fd34015b950 2024-09-12T01:56:41.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.022+0000 7fd335ffb640 1 -- 172.21.15.19:0/158282553 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd33800cd80 con 0x7fd34015b950 2024-09-12T01:56:41.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.022+0000 7fd3473ef640 1 -- 172.21.15.19:0/158282553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3400b09d0 con 0x7fd34015b950 2024-09-12T01:56:41.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.022+0000 7fd335ffb640 1 -- 172.21.15.19:0/158282553 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd338003bb0 con 0x7fd34015b950 2024-09-12T01:56:41.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.022+0000 7fd3473ef640 1 -- 172.21.15.19:0/158282553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3401481c0 con 0x7fd34015b950 2024-09-12T01:56:41.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.023+0000 7fd3473ef640 1 -- 172.21.15.19:0/158282553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd340071e40 con 0x7fd34015b950 2024-09-12T01:56:41.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.023+0000 7fd335ffb640 1 -- 172.21.15.19:0/158282553 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd33801b030 con 0x7fd34015b950 2024-09-12T01:56:41.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.024+0000 7fd335ffb640 1 --2- 172.21.15.19:0/158282553 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd32406be30 0x7fd32406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:41.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.024+0000 7fd335ffb640 1 -- 172.21.15.19:0/158282553 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5853+0+0 (secure 0 0 0) 0x7fd33808b240 con 0x7fd34015b950 2024-09-12T01:56:41.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.024+0000 7fd34518b640 1 --2- 172.21.15.19:0/158282553 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd32406be30 0x7fd32406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:41.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.024+0000 7fd34518b640 1 --2- 172.21.15.19:0/158282553 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd32406be30 0x7fd32406e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0011e0 tx=0x7fd33c007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:41.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.028+0000 7fd335ffb640 1 -- 172.21.15.19:0/158282553 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd338022020 con 0x7fd34015b950 2024-09-12T01:56:41.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.208+0000 7fd3473ef640 1 -- 172.21.15.19:0/158282553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd3401577a0 con 0x7fd34015b950 2024-09-12T01:56:41.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.881+0000 7fd335ffb640 1 -- 172.21.15.19:0/158282553 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) ==== 178+0+0 (secure 0 0 0) 0x7fd338010040 con 0x7fd34015b950 2024-09-12T01:56:41.881 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data_ec' removed 2024-09-12T01:56:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.885+0000 7fd3473ef640 1 -- 172.21.15.19:0/158282553 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd32406be30 msgr2=0x7fd32406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.885+0000 7fd3473ef640 1 --2- 172.21.15.19:0/158282553 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd32406be30 0x7fd32406e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0011e0 tx=0x7fd33c007b50 comp rx=0 tx=0).stop 2024-09-12T01:56:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.885+0000 7fd3473ef640 1 -- 172.21.15.19:0/158282553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd34015b950 msgr2=0x7fd340147200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.885+0000 7fd3473ef640 1 --2- 172.21.15.19:0/158282553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd34015b950 0x7fd340147200 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd33800efc0 tx=0x7fd33800c490 comp rx=0 tx=0).stop 2024-09-12T01:56:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.885+0000 7fd3473ef640 1 -- 172.21.15.19:0/158282553 shutdown_connections 2024-09-12T01:56:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.885+0000 7fd3473ef640 1 --2- 172.21.15.19:0/158282553 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd32406be30 0x7fd32406e2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.885+0000 7fd3473ef640 1 --2- 172.21.15.19:0/158282553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd34015b950 0x7fd340147200 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.885+0000 7fd3473ef640 1 --2- 172.21.15.19:0/158282553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd34015b570 0x7fd340156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.885+0000 7fd3473ef640 1 --2- 172.21.15.19:0/158282553 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3400cd120 0x7fd34006f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.885+0000 7fd3473ef640 1 -- 172.21.15.19:0/158282553 >> 172.21.15.19:0/158282553 conn(0x7fd34006bdf0 msgr2=0x7fd3400cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.885+0000 7fd3473ef640 1 -- 172.21.15.19:0/158282553 shutdown_connections 2024-09-12T01:56:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:41.885+0000 7fd3473ef640 1 -- 172.21.15.19:0/158282553 wait complete. 2024-09-12T01:56:41.901 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T01:56:41.901 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T01:56:41.901 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T01:56:41.901 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:56:41.902 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T01:56:41.902 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T01:56:41.902 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T01:56:41.902 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:56:41.902 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T01:56:41.903 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T01:56:41.903 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T01:56:41.903 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:56:41.903 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T01:56:41.903 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T01:56:41.903 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T01:56:41.903 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:56:41.913 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T01:56:41.914 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T01:56:41.914 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T01:56:41.915 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T01:56:41.916 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T01:56:41.916 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T01:56:41.916 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T01:56:41.917 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T01:56:41.957 INFO:tasks.ceph.mds.a:Started 2024-09-12T01:56:41.957 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:41.958 INFO:tasks.ceph.mds.c:Started 2024-09-12T01:56:41.958 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:41.959 INFO:tasks.ceph.mds.b:Started 2024-09-12T01:56:41.959 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:41.960 INFO:tasks.ceph.mds.d:Started 2024-09-12T01:56:41.960 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:41.960 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T01:56:42.036 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2024-09-12T01:56:42.036 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T01:56:42.041 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T01:56:42.042 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-09-12T01:56:42.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.072+0000 7f18b4a9b640 1 Processor -- start 2024-09-12T01:56:42.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.073+0000 7f18b4a9b640 1 -- start start 2024-09-12T01:56:42.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.073+0000 7f18b4a9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f18b006cd20 0x7f18b00b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:42.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.073+0000 7f18b4a9b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18b00b2790 con 0x7f18b00b3760 2024-09-12T01:56:42.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.073+0000 7f18b4a9b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18b00b2a70 con 0x7f18b009aa30 2024-09-12T01:56:42.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.073+0000 7f18b4a9b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f18b00d0670 con 0x7f18b006cd20 2024-09-12T01:56:42.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.074+0000 7f18a7fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f18b00b3760 0x7f18b0162340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58622/0 (socket says 172.21.15.19:58622) 2024-09-12T01:56:42.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.074+0000 7f18a7fff640 1 -- 172.21.15.19:0/3272409929 learned_addr learned my addr 172.21.15.19:0/3272409929 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:42.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.074+0000 7f18aed9d640 1 --2- 172.21.15.19:0/3272409929 >> v2:172.21.15.19:3300/0 conn(0x7f18b006cd20 0x7f18b00b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:42.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.074+0000 7f18aed9d640 1 -- 172.21.15.19:0/3272409929 >> v1:172.21.15.135:6789/0 conn(0x7f18b009aa30 legacy=0x7f18b009ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:42.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.074+0000 7f18aed9d640 1 -- 172.21.15.19:0/3272409929 >> v1:172.21.15.19:6789/0 conn(0x7f18b00b3760 legacy=0x7f18b0162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:42.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.074+0000 7f18add9b640 1 -- 172.21.15.19:0/3272409929 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828865856 0 0) 0x7f18b00b2790 con 0x7f18b00b3760 2024-09-12T01:56:42.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.074+0000 7f18aed9d640 1 -- 172.21.15.19:0/3272409929 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b00b2d50 con 0x7f18b006cd20 2024-09-12T01:56:42.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.075+0000 7f18aed9d640 1 --2- 172.21.15.19:0/3272409929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b006cd20 0x7f18b00b3030 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009d90 tx=0x7f18a802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbd86ad48b6781c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:42.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.075+0000 7f18add9b640 1 -- 172.21.15.19:0/3272409929 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8031600 con 0x7f18b006cd20 2024-09-12T01:56:42.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.075+0000 7f18add9b640 1 -- 172.21.15.19:0/3272409929 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a80317a0 con 0x7f18b006cd20 2024-09-12T01:56:42.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.075+0000 7f18add9b640 1 -- 172.21.15.19:0/3272409929 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8031b70 con 0x7f18b006cd20 2024-09-12T01:56:42.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.075+0000 7f18b4a9b640 1 -- 172.21.15.19:0/3272409929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b006cd20 msgr2=0x7f18b00b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:42.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.075+0000 7f18b4a9b640 1 --2- 172.21.15.19:0/3272409929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b006cd20 0x7f18b00b3030 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009d90 tx=0x7f18a802a5d0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.075+0000 7f18b4a9b640 1 -- 172.21.15.19:0/3272409929 shutdown_connections 2024-09-12T01:56:42.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.075+0000 7f18b4a9b640 1 --2- 172.21.15.19:0/3272409929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b006cd20 0x7f18b00b3030 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.075+0000 7f18b4a9b640 1 -- 172.21.15.19:0/3272409929 >> 172.21.15.19:0/3272409929 conn(0x7f18b00d23a0 msgr2=0x7f18b00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:42.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.076+0000 7f18b4a9b640 1 -- 172.21.15.19:0/3272409929 shutdown_connections 2024-09-12T01:56:42.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.076+0000 7f18b4a9b640 1 -- 172.21.15.19:0/3272409929 wait complete. 2024-09-12T01:56:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.077+0000 7f18b4a9b640 1 Processor -- start 2024-09-12T01:56:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.077+0000 7f18b4a9b640 1 -- start start 2024-09-12T01:56:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.078+0000 7f18b4a9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18b006cd20 0x7f18b01e9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.078+0000 7f18b4a9b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18b009aa30 0x7f18b015a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.078+0000 7f18b4a9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b00b3760 0x7f18b0160df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.078+0000 7f18b4a9b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f18b015fe20 con 0x7f18b00b3760 2024-09-12T01:56:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.078+0000 7f18b4a9b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f18b015fca0 con 0x7f18b006cd20 2024-09-12T01:56:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.078+0000 7f18b4a9b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f18b00d1fe0 con 0x7f18b009aa30 2024-09-12T01:56:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.078+0000 7f18aed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b00b3760 0x7f18b0160df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.078+0000 7f18a7fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18b009aa30 0x7f18b015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.078+0000 7f18aed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b00b3760 0x7f18b0160df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39834/0 (socket says 172.21.15.19:39834) 2024-09-12T01:56:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.078+0000 7f18aed9d640 1 -- 172.21.15.19:0/3102281222 learned_addr learned my addr 172.21.15.19:0/3102281222 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.078+0000 7f18ae59c640 1 --2- 172.21.15.19:0/3102281222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18b006cd20 0x7f18b01e9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.079+0000 7f18aed9d640 1 -- 172.21.15.19:0/3102281222 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18b009aa30 msgr2=0x7f18b015a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.079+0000 7f18aed9d640 1 --2- 172.21.15.19:0/3102281222 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18b009aa30 0x7f18b015a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.079+0000 7f18aed9d640 1 -- 172.21.15.19:0/3102281222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18b006cd20 msgr2=0x7f18b01e9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.079+0000 7f18aed9d640 1 --2- 172.21.15.19:0/3102281222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18b006cd20 0x7f18b01e9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.079+0000 7f18aed9d640 1 -- 172.21.15.19:0/3102281222 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b01e9ce0 con 0x7f18b00b3760 2024-09-12T01:56:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.079+0000 7f18aed9d640 1 --2- 172.21.15.19:0/3102281222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b00b3760 0x7f18b0160df0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009eb0 tx=0x7f18a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.079+0000 7f18a6ffd640 1 -- 172.21.15.19:0/3102281222 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a803f070 con 0x7f18b00b3760 2024-09-12T01:56:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.079+0000 7f18a6ffd640 1 -- 172.21.15.19:0/3102281222 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a8030b60 con 0x7f18b00b3760 2024-09-12T01:56:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.079+0000 7f18b4a9b640 1 -- 172.21.15.19:0/3102281222 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b01e9fc0 con 0x7f18b00b3760 2024-09-12T01:56:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.079+0000 7f18a6ffd640 1 -- 172.21.15.19:0/3102281222 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8043410 con 0x7f18b00b3760 2024-09-12T01:56:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.079+0000 7f18b4a9b640 1 -- 172.21.15.19:0/3102281222 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b01ea580 con 0x7f18b00b3760 2024-09-12T01:56:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.080+0000 7f18b4a9b640 1 -- 172.21.15.19:0/3102281222 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b00b3030 con 0x7f18b00b3760 2024-09-12T01:56:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.081+0000 7f18a6ffd640 1 -- 172.21.15.19:0/3102281222 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18a803b410 con 0x7f18b00b3760 2024-09-12T01:56:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.082+0000 7f18a6ffd640 1 --2- 172.21.15.19:0/3102281222 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f189006be30 0x7f189006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.082+0000 7f18a6ffd640 1 -- 172.21.15.19:0/3102281222 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5335+0+0 (secure 0 0 0) 0x7f18a80ac080 con 0x7f18b00b3760 2024-09-12T01:56:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.082+0000 7f18ae59c640 1 --2- 172.21.15.19:0/3102281222 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f189006be30 0x7f189006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.083+0000 7f18ae59c640 1 --2- 172.21.15.19:0/3102281222 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f189006be30 0x7f189006e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f18b01f8810 tx=0x7f18a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:42.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.086+0000 7f18a6ffd640 1 -- 172.21.15.19:0/3102281222 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18a807a5f0 con 0x7f18b00b3760 2024-09-12T01:56:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.275+0000 7f18b4a9b640 1 -- 172.21.15.19:0/3102281222 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f18b0071240 con 0x7f18b00b3760 2024-09-12T01:56:42.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.908+0000 7f18a6ffd640 1 -- 172.21.15.19:0/3102281222 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) ==== 97+0+0 (secure 0 0 0) 0x7f18a807e8f0 con 0x7f18b00b3760 2024-09-12T01:56:42.909 INFO:teuthology.orchestra.run.smithi019.stderr: removed all blocklist entries 2024-09-12T01:56:42.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.912+0000 7f18b4a9b640 1 -- 172.21.15.19:0/3102281222 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f189006be30 msgr2=0x7f189006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:42.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.912+0000 7f18b4a9b640 1 --2- 172.21.15.19:0/3102281222 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f189006be30 0x7f189006e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f18b01f8810 tx=0x7f18a0009040 comp rx=0 tx=0).stop 2024-09-12T01:56:42.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.912+0000 7f18b4a9b640 1 -- 172.21.15.19:0/3102281222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b00b3760 msgr2=0x7f18b0160df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:42.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.912+0000 7f18b4a9b640 1 --2- 172.21.15.19:0/3102281222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b00b3760 0x7f18b0160df0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009eb0 tx=0x7f18a8004a40 comp rx=0 tx=0).stop 2024-09-12T01:56:42.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.913+0000 7f18b4a9b640 1 -- 172.21.15.19:0/3102281222 shutdown_connections 2024-09-12T01:56:42.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.913+0000 7f18b4a9b640 1 --2- 172.21.15.19:0/3102281222 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f189006be30 0x7f189006e2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.913+0000 7f18b4a9b640 1 --2- 172.21.15.19:0/3102281222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b00b3760 0x7f18b0160df0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.913+0000 7f18b4a9b640 1 --2- 172.21.15.19:0/3102281222 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18b009aa30 0x7f18b015a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.913+0000 7f18b4a9b640 1 --2- 172.21.15.19:0/3102281222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18b006cd20 0x7f18b01e9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.913+0000 7f18b4a9b640 1 -- 172.21.15.19:0/3102281222 >> 172.21.15.19:0/3102281222 conn(0x7f18b00d23a0 msgr2=0x7f18b0071a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:42.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.913+0000 7f18b4a9b640 1 -- 172.21.15.19:0/3102281222 shutdown_connections 2024-09-12T01:56:42.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:42.913+0000 7f18b4a9b640 1 -- 172.21.15.19:0/3102281222 wait complete. 2024-09-12T01:56:42.932 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T01:56:43.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.040+0000 7f2556bd8640 1 Processor -- start 2024-09-12T01:56:43.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.041+0000 7f2556bd8640 1 -- start start 2024-09-12T01:56:43.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.041+0000 7f2556bd8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f255006cd20 0x7f25500b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.041+0000 7f2556bd8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25500b2790 con 0x7f255009aa30 2024-09-12T01:56:43.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.041+0000 7f2556bd8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25500b2a70 con 0x7f25500b3760 2024-09-12T01:56:43.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.041+0000 7f2556bd8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f25500d0670 con 0x7f255006cd20 2024-09-12T01:56:43.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.041+0000 7f2554974640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f255009aa30 0x7f255009ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58624/0 (socket says 172.21.15.19:58624) 2024-09-12T01:56:43.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.041+0000 7f2554974640 1 -- 172.21.15.19:0/3969510041 learned_addr learned my addr 172.21.15.19:0/3969510041 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:43.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f254f7fe640 1 -- 172.21.15.19:0/3969510041 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3884448628 0 0) 0x7f25500b2790 con 0x7f255009aa30 2024-09-12T01:56:43.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f2555175640 1 --2- 172.21.15.19:0/3969510041 >> v2:172.21.15.135:3300/0 conn(0x7f255006cd20 0x7f25500b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f254f7fe640 1 -- 172.21.15.19:0/3969510041 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2540003520 con 0x7f255009aa30 2024-09-12T01:56:43.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f254f7fe640 1 -- 172.21.15.19:0/3969510041 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2133329970 0 0) 0x7f2540003520 con 0x7f255009aa30 2024-09-12T01:56:43.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f254f7fe640 1 -- 172.21.15.19:0/3969510041 >> v2:172.21.15.135:3300/0 conn(0x7f255006cd20 msgr2=0x7f25500b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:43.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f254f7fe640 1 --2- 172.21.15.19:0/3969510041 >> v2:172.21.15.135:3300/0 conn(0x7f255006cd20 0x7f25500b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f254f7fe640 1 -- 172.21.15.19:0/3969510041 >> v1:172.21.15.135:6789/0 conn(0x7f25500b3760 legacy=0x7f2550162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:43.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f254f7fe640 1 -- 172.21.15.19:0/3969510041 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25500b2d50 con 0x7f255009aa30 2024-09-12T01:56:43.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f254f7fe640 1 -- 172.21.15.19:0/3969510041 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f2544001670 con 0x7f255009aa30 2024-09-12T01:56:43.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f254f7fe640 1 -- 172.21.15.19:0/3969510041 >> v1:172.21.15.19:6789/0 conn(0x7f255009aa30 legacy=0x7f255009ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:43.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f254f7fe640 1 --2- 172.21.15.19:0/3969510041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25400039b0 0x7f2540003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f254f7fe640 1 --2- 172.21.15.19:0/3969510041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540004800 0x7f2540004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f254f7fe640 1 --2- 172.21.15.19:0/3969510041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25400052e0 0x7f254000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f254f7fe640 1 -- 172.21.15.19:0/3969510041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f254000c180 con 0x7f2540004800 2024-09-12T01:56:43.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f254f7fe640 1 -- 172.21.15.19:0/3969510041 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f254000c330 con 0x7f25400052e0 2024-09-12T01:56:43.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f254f7fe640 1 -- 172.21.15.19:0/3969510041 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f254000c530 con 0x7f25400039b0 2024-09-12T01:56:43.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f254ffff640 1 --2- 172.21.15.19:0/3969510041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540004800 0x7f2540004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f2554974640 1 --2- 172.21.15.19:0/3969510041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25400039b0 0x7f2540003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.042+0000 7f2555175640 1 --2- 172.21.15.19:0/3969510041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25400052e0 0x7f254000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.043+0000 7f254ffff640 1 -- 172.21.15.19:0/3969510041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25400039b0 msgr2=0x7f2540003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:43.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.043+0000 7f254ffff640 1 --2- 172.21.15.19:0/3969510041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25400039b0 0x7f2540003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.043+0000 7f254ffff640 1 -- 172.21.15.19:0/3969510041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25400052e0 msgr2=0x7f254000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:43.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.043+0000 7f254ffff640 1 --2- 172.21.15.19:0/3969510041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25400052e0 0x7f254000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.043+0000 7f2555175640 1 -- 172.21.15.19:0/3969510041 reap_dead start 2024-09-12T01:56:43.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.043+0000 7f254ffff640 1 -- 172.21.15.19:0/3969510041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2540003520 con 0x7f2540004800 2024-09-12T01:56:43.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.043+0000 7f254ffff640 1 --2- 172.21.15.19:0/3969510041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540004800 0x7f2540004c80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f253c001720 tx=0x7f2540005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4020bacf4939c6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:43.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.043+0000 7f254f7fe640 1 -- 172.21.15.19:0/3969510041 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c001370 con 0x7f2540004800 2024-09-12T01:56:43.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.043+0000 7f254f7fe640 1 -- 172.21.15.19:0/3969510041 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253c0052d0 con 0x7f2540004800 2024-09-12T01:56:43.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.043+0000 7f254f7fe640 1 -- 172.21.15.19:0/3969510041 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c02ab90 con 0x7f2540004800 2024-09-12T01:56:43.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.044+0000 7f2556bd8640 1 -- 172.21.15.19:0/3969510041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540004800 msgr2=0x7f2540004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:43.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.044+0000 7f2556bd8640 1 --2- 172.21.15.19:0/3969510041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540004800 0x7f2540004c80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f253c001720 tx=0x7f2540005830 comp rx=0 tx=0).stop 2024-09-12T01:56:43.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.044+0000 7f2556bd8640 1 -- 172.21.15.19:0/3969510041 shutdown_connections 2024-09-12T01:56:43.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.044+0000 7f2556bd8640 1 --2- 172.21.15.19:0/3969510041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540004800 0x7f2540004c80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.044+0000 7f2556bd8640 1 -- 172.21.15.19:0/3969510041 >> 172.21.15.19:0/3969510041 conn(0x7f25500d23a0 msgr2=0x7f25500d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:43.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.044+0000 7f2556bd8640 1 -- 172.21.15.19:0/3969510041 shutdown_connections 2024-09-12T01:56:43.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.044+0000 7f2556bd8640 1 -- 172.21.15.19:0/3969510041 wait complete. 2024-09-12T01:56:43.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.045+0000 7f2556bd8640 1 Processor -- start 2024-09-12T01:56:43.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.045+0000 7f2556bd8640 1 -- start start 2024-09-12T01:56:43.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.046+0000 7f2556bd8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540004800 0x7f2550162250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.046+0000 7f2556bd8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2550159b30 0x7f2550159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.046+0000 7f2556bd8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25500b07b0 0x7f25500b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.046+0000 7f2556bd8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f255015fe20 con 0x7f2540004800 2024-09-12T01:56:43.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.046+0000 7f2556bd8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f255015fca0 con 0x7f25500b07b0 2024-09-12T01:56:43.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.046+0000 7f2556bd8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f25500d1fe0 con 0x7f2550159b30 2024-09-12T01:56:43.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.046+0000 7f2554974640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540004800 0x7f2550162250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.046+0000 7f2554974640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540004800 0x7f2550162250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39848/0 (socket says 172.21.15.19:39848) 2024-09-12T01:56:43.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.046+0000 7f2554974640 1 -- 172.21.15.19:0/326728315 learned_addr learned my addr 172.21.15.19:0/326728315 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:43.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.046+0000 7f254ffff640 1 --2- 172.21.15.19:0/326728315 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2550159b30 0x7f2550159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.046+0000 7f2555175640 1 --2- 172.21.15.19:0/326728315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25500b07b0 0x7f25500b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.047+0000 7f2554974640 1 -- 172.21.15.19:0/326728315 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2550159b30 msgr2=0x7f2550159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:43.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.047+0000 7f2554974640 1 --2- 172.21.15.19:0/326728315 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2550159b30 0x7f2550159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.047+0000 7f2554974640 1 -- 172.21.15.19:0/326728315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25500b07b0 msgr2=0x7f25500b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:43.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.047+0000 7f2554974640 1 --2- 172.21.15.19:0/326728315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25500b07b0 0x7f25500b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.047+0000 7f2554974640 1 -- 172.21.15.19:0/326728315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2550162790 con 0x7f2540004800 2024-09-12T01:56:43.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.047+0000 7f2555175640 1 --2- 172.21.15.19:0/326728315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25500b07b0 0x7f25500b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:43.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.047+0000 7f2554974640 1 --2- 172.21.15.19:0/326728315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540004800 0x7f2550162250 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2544004ef0 tx=0x7f2544007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:43.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.047+0000 7f254d7fa640 1 -- 172.21.15.19:0/326728315 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254401a070 con 0x7f2540004800 2024-09-12T01:56:43.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.047+0000 7f254d7fa640 1 -- 172.21.15.19:0/326728315 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f254400f750 con 0x7f2540004800 2024-09-12T01:56:43.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.047+0000 7f2556bd8640 1 -- 172.21.15.19:0/326728315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25500b0110 con 0x7f2540004800 2024-09-12T01:56:43.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.047+0000 7f254d7fa640 1 -- 172.21.15.19:0/326728315 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254400fb00 con 0x7f2540004800 2024-09-12T01:56:43.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.047+0000 7f2556bd8640 1 -- 172.21.15.19:0/326728315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25500af630 con 0x7f2540004800 2024-09-12T01:56:43.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.048+0000 7f2556bd8640 1 -- 172.21.15.19:0/326728315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25500c91f0 con 0x7f2540004800 2024-09-12T01:56:43.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.049+0000 7f254d7fa640 1 -- 172.21.15.19:0/326728315 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f254401d070 con 0x7f2540004800 2024-09-12T01:56:43.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.049+0000 7f254d7fa640 1 --2- 172.21.15.19:0/326728315 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f253406be30 0x7f253406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.049+0000 7f254d7fa640 1 -- 172.21.15.19:0/326728315 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f254408a560 con 0x7f2540004800 2024-09-12T01:56:43.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.049+0000 7f254ffff640 1 --2- 172.21.15.19:0/326728315 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f253406be30 0x7f253406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.050+0000 7f254ffff640 1 --2- 172.21.15.19:0/326728315 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f253406be30 0x7f253406e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f253c032000 tx=0x7f253c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:43.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.054+0000 7f254d7fa640 1 -- 172.21.15.19:0/326728315 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f25500c91f0 con 0x7f2540004800 2024-09-12T01:56:43.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.294+0000 7f2556bd8640 1 -- 172.21.15.19:0/326728315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f25500b3030 con 0x7f2540004800 2024-09-12T01:56:43.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.294+0000 7f254d7fa640 1 -- 172.21.15.19:0/326728315 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f2550162790 con 0x7f2540004800 2024-09-12T01:56:43.296 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:43.296 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:56:43.296 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_dump": [ 2024-09-12T01:56:43.296 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.297 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.a", 2024-09-12T01:56:43.297 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJm5rSjChAA4H0OW7ubTgq4vmUaoGvvNA==", 2024-09-12T01:56:43.297 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.297 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:56:43.297 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T01:56:43.297 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T01:56:43.297 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:56:43.297 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.297 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.297 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.b", 2024-09-12T01:56:43.297 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmyaCyFhAAV87Ogacs5CmiAuG0p/61Fw==", 2024-09-12T01:56:43.297 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.297 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:56:43.298 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T01:56:43.298 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T01:56:43.298 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:56:43.298 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.298 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.298 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.c", 2024-09-12T01:56:43.298 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmVLrfERAAlIw2yLSJubtZ1o4NB9IDsg==", 2024-09-12T01:56:43.298 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.298 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:56:43.298 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T01:56:43.298 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T01:56:43.298 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:56:43.299 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.299 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.299 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.d", 2024-09-12T01:56:43.299 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmd6a1HRAA04/r87MKfFM1VQvG1Tjj8A==", 2024-09-12T01:56:43.299 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.299 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:56:43.299 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T01:56:43.299 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T01:56:43.299 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:56:43.299 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.299 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.299 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.0", 2024-09-12T01:56:43.299 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD0SeJme7ETBRAA/8v8aJcEzpHYmAPg5Hxdzg==", 2024-09-12T01:56:43.300 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.300 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:56:43.300 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:56:43.300 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:56:43.300 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.300 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.300 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.1", 2024-09-12T01:56:43.300 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD3SeJmfXQyFhAALiZjnIoDw+OtH9of5IUu0w==", 2024-09-12T01:56:43.300 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.300 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:56:43.300 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:56:43.300 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:56:43.301 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.301 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.2", 2024-09-12T01:56:43.301 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD6SeJmMDNwJxAABb+94TBxpZx3GovP1g1Q2A==", 2024-09-12T01:56:43.301 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.301 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:56:43.301 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:56:43.301 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:56:43.301 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.301 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.3", 2024-09-12T01:56:43.301 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD9SeJmZMgKOBAAgU+mzTBmPSHE7mUElUA9lA==", 2024-09-12T01:56:43.302 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.302 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:56:43.302 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:56:43.302 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:56:43.302 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.302 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.302 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.4", 2024-09-12T01:56:43.302 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAESuJmnb9kBBAA6PmrEGSckixHv73r9ogheQ==", 2024-09-12T01:56:43.302 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.302 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:56:43.302 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:56:43.302 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:56:43.302 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.303 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.303 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.5", 2024-09-12T01:56:43.303 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAHSuJmLU1hBhAAlFooSVxCEmIHSjqscaFnhQ==", 2024-09-12T01:56:43.303 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.303 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:56:43.303 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:56:43.303 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:56:43.303 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.303 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.303 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.6", 2024-09-12T01:56:43.303 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAKSuJmeIj7BxAADTmZtK8dk94LSGa88+xq3Q==", 2024-09-12T01:56:43.303 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.303 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:56:43.304 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:56:43.304 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:56:43.304 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.304 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.304 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.7", 2024-09-12T01:56:43.304 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQANSuJmw92iJxAAsjNKRSdndTUGmBtaN3g/pQ==", 2024-09-12T01:56:43.304 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.304 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:56:43.304 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:56:43.304 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:56:43.304 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.305 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.305 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.0", 2024-09-12T01:56:43.305 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmfHbXIRAALAvdYAlaB6WxWtubFnlxRw==", 2024-09-12T01:56:43.305 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.305 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:56:43.305 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T01:56:43.305 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T01:56:43.305 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T01:56:43.305 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.305 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.305 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.1", 2024-09-12T01:56:43.305 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmOjfDKhAA8h0ldWP6mNPgoqtIejhF+Q==", 2024-09-12T01:56:43.305 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:56:43.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T01:56:43.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T01:56:43.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T01:56:43.306 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.306 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.306 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.2", 2024-09-12T01:56:43.306 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmLQSOJxAA2RhDLfjVzPpg1kiJe++WHg==", 2024-09-12T01:56:43.306 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:56:43.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T01:56:43.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T01:56:43.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T01:56:43.307 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.307 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.307 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.3", 2024-09-12T01:56:43.307 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmXS5YMBAAXSS+3Omu0PYIz1bJcSxefw==", 2024-09-12T01:56:43.307 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:56:43.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T01:56:43.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T01:56:43.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T01:56:43.307 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.307 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.307 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.admin", 2024-09-12T01:56:43.308 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDvSeJmCljiKRAAQmsy5rl4ZPpm2pD1kXMO3g==", 2024-09-12T01:56:43.308 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-09-12T01:56:43.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T01:56:43.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T01:56:43.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:56:43.308 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.308 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.308 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-mds", 2024-09-12T01:56:43.308 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQATSuJmQ0fcMxAAmcm8lmwKuCcFNYCizPFhkQ==", 2024-09-12T01:56:43.308 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-mds" 2024-09-12T01:56:43.309 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.309 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-mgr", 2024-09-12T01:56:43.309 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQATSuJmoU/cMxAACsOKwp5VgSnhqOvw6p6Suw==", 2024-09-12T01:56:43.309 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.309 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-12T01:56:43.309 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.309 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-osd", 2024-09-12T01:56:43.309 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQATSuJm01bcMxAAF+98EAgnJSMpDgUooOhpyg==", 2024-09-12T01:56:43.309 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-osd" 2024-09-12T01:56:43.310 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.310 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-rbd", 2024-09-12T01:56:43.310 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQATSuJmEV7cMxAAMwBbfzYiQ+CZWkO9EbS7nw==", 2024-09-12T01:56:43.310 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-12T01:56:43.310 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.310 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-12T01:56:43.310 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQATSuJmFWbcMxAA+RmAtM/J3osOzYqPfrTfRA==", 2024-09-12T01:56:43.310 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-12T01:56:43.311 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.311 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.311 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.311 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-rgw", 2024-09-12T01:56:43.311 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQATSuJm8m3cMxAA1yUHx7mPVOY/i8PlLwoCTw==", 2024-09-12T01:56:43.311 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-12T01:56:43.311 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.311 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.311 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.311 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.x", 2024-09-12T01:56:43.311 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmjx1VBxAAF80kgsMnFJn+gL44QZn6bg==", 2024-09-12T01:56:43.311 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.312 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-09-12T01:56:43.312 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-09-12T01:56:43.312 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:56:43.312 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.312 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:56:43.312 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:43.312 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.y", 2024-09-12T01:56:43.312 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmXphnAxAAUnmZ3JPOt1Yzk0zqWh5+kg==", 2024-09-12T01:56:43.312 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:56:43.312 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-09-12T01:56:43.312 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-09-12T01:56:43.312 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:56:43.312 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.313 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:43.313 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T01:56:43.313 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:56:43.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.296+0000 7f2556bd8640 1 -- 172.21.15.19:0/326728315 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f253406be30 msgr2=0x7f253406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:43.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.296+0000 7f2556bd8640 1 --2- 172.21.15.19:0/326728315 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f253406be30 0x7f253406e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f253c032000 tx=0x7f253c02e000 comp rx=0 tx=0).stop 2024-09-12T01:56:43.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.296+0000 7f2556bd8640 1 -- 172.21.15.19:0/326728315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540004800 msgr2=0x7f2550162250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:43.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.296+0000 7f2556bd8640 1 --2- 172.21.15.19:0/326728315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540004800 0x7f2550162250 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2544004ef0 tx=0x7f2544007430 comp rx=0 tx=0).stop 2024-09-12T01:56:43.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.296+0000 7f2556bd8640 1 -- 172.21.15.19:0/326728315 shutdown_connections 2024-09-12T01:56:43.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.296+0000 7f2556bd8640 1 --2- 172.21.15.19:0/326728315 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f253406be30 0x7f253406e2f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.296+0000 7f2556bd8640 1 --2- 172.21.15.19:0/326728315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25500b07b0 0x7f25500b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.296+0000 7f2556bd8640 1 --2- 172.21.15.19:0/326728315 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2550159b30 0x7f2550159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.296+0000 7f2556bd8640 1 --2- 172.21.15.19:0/326728315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540004800 0x7f2550162250 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.296+0000 7f2556bd8640 1 -- 172.21.15.19:0/326728315 >> 172.21.15.19:0/326728315 conn(0x7f25500d23a0 msgr2=0x7f255015af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:43.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.296+0000 7f2556bd8640 1 -- 172.21.15.19:0/326728315 shutdown_connections 2024-09-12T01:56:43.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.296+0000 7f2556bd8640 1 -- 172.21.15.19:0/326728315 wait complete. 2024-09-12T01:56:43.315 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-12T01:56:43.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.419+0000 7f75a2a53640 1 Processor -- start 2024-09-12T01:56:43.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.420+0000 7f75a2a53640 1 -- start start 2024-09-12T01:56:43.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.420+0000 7f75a2a53640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f759c145bc0 0x7f759c15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.420+0000 7f75a2a53640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f759c06c320 0x7f759c0af950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.420+0000 7f75a2a53640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f759c0b3570 con 0x7f759c0ae140 2024-09-12T01:56:43.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.420+0000 7f75a2a53640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f759c0b3850 con 0x7f759c145bc0 2024-09-12T01:56:43.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.420+0000 7f75a2a53640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f759c0b3b30 con 0x7f759c06c320 2024-09-12T01:56:43.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.421+0000 7f759bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f759c145bc0 0x7f759c15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.421+0000 7f759bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f759c145bc0 0x7f759c15ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39864/0 (socket says 172.21.15.19:39864) 2024-09-12T01:56:43.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.421+0000 7f759bfff640 1 -- 172.21.15.19:0/1212204778 learned_addr learned my addr 172.21.15.19:0/1212204778 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:43.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.421+0000 7f75a0ff0640 1 --2- 172.21.15.19:0/1212204778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f759c06c320 0x7f759c0af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.421+0000 7f759bfff640 1 -- 172.21.15.19:0/1212204778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f759c06c320 msgr2=0x7f759c0af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:43.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.421+0000 7f759bfff640 1 --2- 172.21.15.19:0/1212204778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f759c06c320 0x7f759c0af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.421+0000 7f759bfff640 1 -- 172.21.15.19:0/1212204778 >> v1:172.21.15.135:6789/0 conn(0x7f759c0ae140 legacy=0x7f759c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:43.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.421+0000 7f759bfff640 1 -- 172.21.15.19:0/1212204778 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759c0b1610 con 0x7f759c145bc0 2024-09-12T01:56:43.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.421+0000 7f75a0ff0640 1 --2- 172.21.15.19:0/1212204778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f759c06c320 0x7f759c0af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:43.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.422+0000 7f759bfff640 1 --2- 172.21.15.19:0/1212204778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f759c145bc0 0x7f759c15ca70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f758c0098a0 tx=0x7f758c02a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36408c02b64ebcd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:43.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.422+0000 7f759affd640 1 -- 172.21.15.19:0/1212204778 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c037070 con 0x7f759c145bc0 2024-09-12T01:56:43.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.422+0000 7f759affd640 1 -- 172.21.15.19:0/1212204778 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f758c032640 con 0x7f759c145bc0 2024-09-12T01:56:43.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.422+0000 7f759affd640 1 -- 172.21.15.19:0/1212204778 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c032a10 con 0x7f759c145bc0 2024-09-12T01:56:43.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.422+0000 7f75a2a53640 1 -- 172.21.15.19:0/1212204778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f759c145bc0 msgr2=0x7f759c15ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:43.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.422+0000 7f75a2a53640 1 --2- 172.21.15.19:0/1212204778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f759c145bc0 0x7f759c15ca70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f758c0098a0 tx=0x7f758c02a320 comp rx=0 tx=0).stop 2024-09-12T01:56:43.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.422+0000 7f75a2a53640 1 -- 172.21.15.19:0/1212204778 shutdown_connections 2024-09-12T01:56:43.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.422+0000 7f75a2a53640 1 --2- 172.21.15.19:0/1212204778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f759c06c320 0x7f759c0af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.422+0000 7f75a2a53640 1 --2- 172.21.15.19:0/1212204778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f759c145bc0 0x7f759c15ca70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.422+0000 7f75a2a53640 1 -- 172.21.15.19:0/1212204778 >> 172.21.15.19:0/1212204778 conn(0x7f759c073490 msgr2=0x7f759c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:43.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.423+0000 7f75a2a53640 1 -- 172.21.15.19:0/1212204778 shutdown_connections 2024-09-12T01:56:43.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.423+0000 7f75a2a53640 1 -- 172.21.15.19:0/1212204778 wait complete. 2024-09-12T01:56:43.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.424+0000 7f75a2a53640 1 Processor -- start 2024-09-12T01:56:43.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.424+0000 7f75a2a53640 1 -- start start 2024-09-12T01:56:43.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.425+0000 7f75a2a53640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f759c06c320 0x7f759c151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.425+0000 7f75a2a53640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f759c0ae140 0x7f759c1517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.425+0000 7f75a2a53640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f759c145bc0 0x7f759c09d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.425+0000 7f75a2a53640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f759c145fa0 con 0x7f759c0ae140 2024-09-12T01:56:43.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.425+0000 7f75a2a53640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f759c09aa30 con 0x7f759c145bc0 2024-09-12T01:56:43.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.425+0000 7f75a2a53640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f759c142b80 con 0x7f759c06c320 2024-09-12T01:56:43.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.425+0000 7f759b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f759c0ae140 0x7f759c1517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.425+0000 7f759b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f759c0ae140 0x7f759c1517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39868/0 (socket says 172.21.15.19:39868) 2024-09-12T01:56:43.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.425+0000 7f759b7fe640 1 -- 172.21.15.19:0/196373227 learned_addr learned my addr 172.21.15.19:0/196373227 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:43.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.425+0000 7f759bfff640 1 --2- 172.21.15.19:0/196373227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f759c06c320 0x7f759c151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.425+0000 7f75a0ff0640 1 --2- 172.21.15.19:0/196373227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f759c145bc0 0x7f759c09d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.425+0000 7f759b7fe640 1 -- 172.21.15.19:0/196373227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f759c06c320 msgr2=0x7f759c151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:43.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.425+0000 7f759b7fe640 1 --2- 172.21.15.19:0/196373227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f759c06c320 0x7f759c151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.425+0000 7f759b7fe640 1 -- 172.21.15.19:0/196373227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f759c145bc0 msgr2=0x7f759c09d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:43.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.425+0000 7f759b7fe640 1 --2- 172.21.15.19:0/196373227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f759c145bc0 0x7f759c09d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.425+0000 7f759b7fe640 1 -- 172.21.15.19:0/196373227 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759c151d10 con 0x7f759c0ae140 2024-09-12T01:56:43.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.425+0000 7f759b7fe640 1 --2- 172.21.15.19:0/196373227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f759c0ae140 0x7f759c1517d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f759000c400 tx=0x7f759000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:43.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.425+0000 7f7598ff9640 1 -- 172.21.15.19:0/196373227 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75900052d0 con 0x7f759c0ae140 2024-09-12T01:56:43.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.426+0000 7f7598ff9640 1 -- 172.21.15.19:0/196373227 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7590005490 con 0x7f759c0ae140 2024-09-12T01:56:43.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.426+0000 7f75a2a53640 1 -- 172.21.15.19:0/196373227 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f759c1428a0 con 0x7f759c0ae140 2024-09-12T01:56:43.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.426+0000 7f7598ff9640 1 -- 172.21.15.19:0/196373227 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7590007260 con 0x7f759c0ae140 2024-09-12T01:56:43.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.426+0000 7f75a2a53640 1 -- 172.21.15.19:0/196373227 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f759c09c620 con 0x7f759c0ae140 2024-09-12T01:56:43.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.427+0000 7f75a2a53640 1 -- 172.21.15.19:0/196373227 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f759c06da90 con 0x7f759c0ae140 2024-09-12T01:56:43.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.427+0000 7f7598ff9640 1 -- 172.21.15.19:0/196373227 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7590007400 con 0x7f759c0ae140 2024-09-12T01:56:43.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.428+0000 7f7598ff9640 1 --2- 172.21.15.19:0/196373227 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f758806be30 0x7f758806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.428+0000 7f7598ff9640 1 -- 172.21.15.19:0/196373227 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f759008a0a0 con 0x7f759c0ae140 2024-09-12T01:56:43.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.428+0000 7f759bfff640 1 --2- 172.21.15.19:0/196373227 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f758806be30 0x7f758806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.429+0000 7f759bfff640 1 --2- 172.21.15.19:0/196373227 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f758806be30 0x7f758806e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f758c034000 tx=0x7f758c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:43.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.432+0000 7f7598ff9640 1 -- 172.21.15.19:0/196373227 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f759c06da90 con 0x7f759c0ae140 2024-09-12T01:56:43.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.673+0000 7f75a2a53640 1 -- 172.21.15.19:0/196373227 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f759c0b10f0 con 0x7f759c0ae140 2024-09-12T01:56:43.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.676+0000 7f7598ff9640 1 -- 172.21.15.19:0/196373227 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f7590058650 con 0x7f759c0ae140 2024-09-12T01:56:43.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.678+0000 7f75a2a53640 1 -- 172.21.15.19:0/196373227 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f758806be30 msgr2=0x7f758806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:43.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.678+0000 7f75a2a53640 1 --2- 172.21.15.19:0/196373227 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f758806be30 0x7f758806e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f758c034000 tx=0x7f758c02e000 comp rx=0 tx=0).stop 2024-09-12T01:56:43.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.678+0000 7f75a2a53640 1 -- 172.21.15.19:0/196373227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f759c0ae140 msgr2=0x7f759c1517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:43.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.678+0000 7f75a2a53640 1 --2- 172.21.15.19:0/196373227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f759c0ae140 0x7f759c1517d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f759000c400 tx=0x7f759000c8c0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.678+0000 7f75a2a53640 1 -- 172.21.15.19:0/196373227 shutdown_connections 2024-09-12T01:56:43.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.678+0000 7f75a2a53640 1 --2- 172.21.15.19:0/196373227 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f758806be30 0x7f758806e2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.678+0000 7f75a2a53640 1 --2- 172.21.15.19:0/196373227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f759c145bc0 0x7f759c09d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.678+0000 7f75a2a53640 1 --2- 172.21.15.19:0/196373227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f759c0ae140 0x7f759c1517d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.678+0000 7f75a2a53640 1 --2- 172.21.15.19:0/196373227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f759c06c320 0x7f759c151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.678+0000 7f75a2a53640 1 -- 172.21.15.19:0/196373227 >> 172.21.15.19:0/196373227 conn(0x7f759c073490 msgr2=0x7f759c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:43.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.678+0000 7f75a2a53640 1 -- 172.21.15.19:0/196373227 shutdown_connections 2024-09-12T01:56:43.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.678+0000 7f75a2a53640 1 -- 172.21.15.19:0/196373227 wait complete. 2024-09-12T01:56:43.689 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-12T01:56:43.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.791+0000 7fb927d33640 1 Processor -- start 2024-09-12T01:56:43.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.792+0000 7fb927d33640 1 -- start start 2024-09-12T01:56:43.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.792+0000 7fb927d33640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb92015b300 0x7fb9200cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.793+0000 7fb927d33640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb9200cd3f0 0x7fb92006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.793+0000 7fb927d33640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb920072d30 0x7fb92006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.793+0000 7fb927d33640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb9200728a0 con 0x7fb9200cd3f0 2024-09-12T01:56:43.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.793+0000 7fb927d33640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb9200cdbe0 con 0x7fb92015b300 2024-09-12T01:56:43.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.793+0000 7fb927d33640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb9200cd900 con 0x7fb920072d30 2024-09-12T01:56:43.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.793+0000 7fb9252ce640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb9200cd3f0 0x7fb92006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.793+0000 7fb9252ce640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb9200cd3f0 0x7fb92006f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39884/0 (socket says 172.21.15.19:39884) 2024-09-12T01:56:43.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.793+0000 7fb9252ce640 1 -- 172.21.15.19:0/786205306 learned_addr learned my addr 172.21.15.19:0/786205306 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:43.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.793+0000 7fb925acf640 1 --2- 172.21.15.19:0/786205306 >> v2:172.21.15.135:3300/0 conn(0x7fb92015b300 0x7fb9200cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.793+0000 7fb9262d0640 1 --2- 172.21.15.19:0/786205306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb920072d30 0x7fb92006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.793+0000 7fb9252ce640 1 -- 172.21.15.19:0/786205306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb920072d30 msgr2=0x7fb92006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:43.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.793+0000 7fb9252ce640 1 --2- 172.21.15.19:0/786205306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb920072d30 0x7fb92006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.793+0000 7fb9252ce640 1 -- 172.21.15.19:0/786205306 >> v2:172.21.15.135:3300/0 conn(0x7fb92015b300 msgr2=0x7fb9200cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:43.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.793+0000 7fb9252ce640 1 --2- 172.21.15.19:0/786205306 >> v2:172.21.15.135:3300/0 conn(0x7fb92015b300 0x7fb9200cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.793+0000 7fb9252ce640 1 -- 172.21.15.19:0/786205306 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb920072250 con 0x7fb9200cd3f0 2024-09-12T01:56:43.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.794+0000 7fb9252ce640 1 --2- 172.21.15.19:0/786205306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9200cd3f0 0x7fb92006f1c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb920070250 tx=0x7fb91402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8833026df8ff550c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:43.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.794+0000 7fb924acd640 1 -- 172.21.15.19:0/786205306 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914037070 con 0x7fb9200cd3f0 2024-09-12T01:56:43.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.794+0000 7fb924acd640 1 -- 172.21.15.19:0/786205306 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb914032440 con 0x7fb9200cd3f0 2024-09-12T01:56:43.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.794+0000 7fb924acd640 1 -- 172.21.15.19:0/786205306 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914032810 con 0x7fb9200cd3f0 2024-09-12T01:56:43.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.794+0000 7fb927d33640 1 -- 172.21.15.19:0/786205306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9200cd3f0 msgr2=0x7fb92006f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:43.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.794+0000 7fb927d33640 1 --2- 172.21.15.19:0/786205306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9200cd3f0 0x7fb92006f1c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb920070250 tx=0x7fb91402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.794+0000 7fb927d33640 1 -- 172.21.15.19:0/786205306 shutdown_connections 2024-09-12T01:56:43.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.794+0000 7fb927d33640 1 --2- 172.21.15.19:0/786205306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb920072d30 0x7fb92006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.794+0000 7fb927d33640 1 --2- 172.21.15.19:0/786205306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9200cd3f0 0x7fb92006f1c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.794+0000 7fb927d33640 1 --2- 172.21.15.19:0/786205306 >> v2:172.21.15.135:3300/0 conn(0x7fb92015b300 0x7fb9200cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.794+0000 7fb927d33640 1 -- 172.21.15.19:0/786205306 >> 172.21.15.19:0/786205306 conn(0x7fb920067d70 msgr2=0x7fb92006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:43.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.795+0000 7fb927d33640 1 -- 172.21.15.19:0/786205306 shutdown_connections 2024-09-12T01:56:43.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.795+0000 7fb927d33640 1 -- 172.21.15.19:0/786205306 wait complete. 2024-09-12T01:56:43.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.796+0000 7fb927d33640 1 Processor -- start 2024-09-12T01:56:43.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.796+0000 7fb927d33640 1 -- start start 2024-09-12T01:56:43.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb927d33640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb920072d30 0x7fb92014fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb927d33640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9200cd3f0 0x7fb920156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb927d33640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb92015b300 0x7fb920154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb927d33640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb9200d0160 con 0x7fb9200cd3f0 2024-09-12T01:56:43.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb927d33640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb9200cffe0 con 0x7fb920072d30 2024-09-12T01:56:43.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb927d33640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb9200b3c40 con 0x7fb92015b300 2024-09-12T01:56:43.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb9252ce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9200cd3f0 0x7fb920156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb9252ce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9200cd3f0 0x7fb920156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39890/0 (socket says 172.21.15.19:39890) 2024-09-12T01:56:43.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb9252ce640 1 -- 172.21.15.19:0/1564883150 learned_addr learned my addr 172.21.15.19:0/1564883150 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:43.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb9262d0640 1 --2- 172.21.15.19:0/1564883150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb92015b300 0x7fb920154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb925acf640 1 --2- 172.21.15.19:0/1564883150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb920072d30 0x7fb92014fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb9252ce640 1 -- 172.21.15.19:0/1564883150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb92015b300 msgr2=0x7fb920154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:43.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb9252ce640 1 --2- 172.21.15.19:0/1564883150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb92015b300 0x7fb920154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb9252ce640 1 -- 172.21.15.19:0/1564883150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb920072d30 msgr2=0x7fb92014fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:43.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb9252ce640 1 --2- 172.21.15.19:0/1564883150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb920072d30 0x7fb92014fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:43.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb9252ce640 1 -- 172.21.15.19:0/1564883150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb920152b50 con 0x7fb9200cd3f0 2024-09-12T01:56:43.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb9252ce640 1 --2- 172.21.15.19:0/1564883150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9200cd3f0 0x7fb920156e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb914000c00 tx=0x7fb9140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:43.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb91e7fc640 1 -- 172.21.15.19:0/1564883150 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914041020 con 0x7fb9200cd3f0 2024-09-12T01:56:43.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb91e7fc640 1 -- 172.21.15.19:0/1564883150 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9140306c0 con 0x7fb9200cd3f0 2024-09-12T01:56:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb927d33640 1 -- 172.21.15.19:0/1564883150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9200ca400 con 0x7fb9200cd3f0 2024-09-12T01:56:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb91e7fc640 1 -- 172.21.15.19:0/1564883150 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914037040 con 0x7fb9200cd3f0 2024-09-12T01:56:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.797+0000 7fb927d33640 1 -- 172.21.15.19:0/1564883150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9200ca9c0 con 0x7fb9200cd3f0 2024-09-12T01:56:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.798+0000 7fb927d33640 1 -- 172.21.15.19:0/1564883150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9200cabc0 con 0x7fb9200cd3f0 2024-09-12T01:56:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.799+0000 7fb91e7fc640 1 -- 172.21.15.19:0/1564883150 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb914044020 con 0x7fb9200cd3f0 2024-09-12T01:56:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.799+0000 7fb91e7fc640 1 --2- 172.21.15.19:0/1564883150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb90c06be60 0x7fb90c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.799+0000 7fb91e7fc640 1 -- 172.21.15.19:0/1564883150 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fb9140ab4e0 con 0x7fb9200cd3f0 2024-09-12T01:56:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.799+0000 7fb925acf640 1 --2- 172.21.15.19:0/1564883150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb90c06be60 0x7fb90c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.800+0000 7fb925acf640 1 --2- 172.21.15.19:0/1564883150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb90c06be60 0x7fb90c06e320 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb918006fd0 tx=0x7fb918008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:43.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:43.804+0000 7fb91e7fc640 1 -- 172.21.15.19:0/1564883150 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb9200cabc0 con 0x7fb9200cd3f0 2024-09-12T01:56:44.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.049+0000 7fb927d33640 1 -- 172.21.15.19:0/1564883150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fb9201e5580 con 0x7fb9200cd3f0 2024-09-12T01:56:44.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.052+0000 7fb91e7fc640 1 -- 172.21.15.19:0/1564883150 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7fb91404b030 con 0x7fb9200cd3f0 2024-09-12T01:56:44.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.054+0000 7fb927d33640 1 -- 172.21.15.19:0/1564883150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb90c06be60 msgr2=0x7fb90c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.054+0000 7fb927d33640 1 --2- 172.21.15.19:0/1564883150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb90c06be60 0x7fb90c06e320 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb918006fd0 tx=0x7fb918008040 comp rx=0 tx=0).stop 2024-09-12T01:56:44.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.054+0000 7fb927d33640 1 -- 172.21.15.19:0/1564883150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9200cd3f0 msgr2=0x7fb920156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.054+0000 7fb927d33640 1 --2- 172.21.15.19:0/1564883150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9200cd3f0 0x7fb920156e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb914000c00 tx=0x7fb9140046c0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.054+0000 7fb927d33640 1 -- 172.21.15.19:0/1564883150 shutdown_connections 2024-09-12T01:56:44.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.054+0000 7fb927d33640 1 --2- 172.21.15.19:0/1564883150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb90c06be60 0x7fb90c06e320 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.054+0000 7fb927d33640 1 --2- 172.21.15.19:0/1564883150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb92015b300 0x7fb920154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.055+0000 7fb927d33640 1 --2- 172.21.15.19:0/1564883150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9200cd3f0 0x7fb920156e10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.055+0000 7fb927d33640 1 --2- 172.21.15.19:0/1564883150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb920072d30 0x7fb92014fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.055+0000 7fb927d33640 1 -- 172.21.15.19:0/1564883150 >> 172.21.15.19:0/1564883150 conn(0x7fb920067d70 msgr2=0x7fb92006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:44.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.055+0000 7fb927d33640 1 -- 172.21.15.19:0/1564883150 shutdown_connections 2024-09-12T01:56:44.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.055+0000 7fb927d33640 1 -- 172.21.15.19:0/1564883150 wait complete. 2024-09-12T01:56:44.066 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-12T01:56:44.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.169+0000 7f2063959640 1 Processor -- start 2024-09-12T01:56:44.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.169+0000 7f2063959640 1 -- start start 2024-09-12T01:56:44.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.170+0000 7f2063959640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f205c15e760 0x7f205c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.170+0000 7f2063959640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f205c0cfcc0 0x7f205c0d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.170+0000 7f2063959640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f205c0d2700 con 0x7f205c0d4fd0 2024-09-12T01:56:44.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.170+0000 7f2063959640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f205c0cedb0 con 0x7f205c0cfcc0 2024-09-12T01:56:44.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.170+0000 7f2063959640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f205c0cf090 con 0x7f205c15e760 2024-09-12T01:56:44.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.170+0000 7f2060ef4640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f205c0d4fd0 0x7f205c0cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58636/0 (socket says 172.21.15.19:58636) 2024-09-12T01:56:44.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.170+0000 7f2060ef4640 1 -- 172.21.15.19:0/1467886772 learned_addr learned my addr 172.21.15.19:0/1467886772 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:44.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.170+0000 7f2061ef6640 1 --2- 172.21.15.19:0/1467886772 >> v2:172.21.15.135:3300/0 conn(0x7f205c0cfcc0 0x7f205c0d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.170+0000 7f20616f5640 1 --2- 172.21.15.19:0/1467886772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f205c15e760 0x7f205c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.170+0000 7f2053fff640 1 -- 172.21.15.19:0/1467886772 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2877780047 0 0) 0x7f204c001290 con 0x7f205c0d4fd0 2024-09-12T01:56:44.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2053fff640 1 -- 172.21.15.19:0/1467886772 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2048003520 con 0x7f205c0d4fd0 2024-09-12T01:56:44.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2053fff640 1 -- 172.21.15.19:0/1467886772 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 13565979 0 0) 0x7f2048003520 con 0x7f205c0d4fd0 2024-09-12T01:56:44.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2053fff640 1 -- 172.21.15.19:0/1467886772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f205c15e760 msgr2=0x7f205c06cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:44.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2053fff640 1 --2- 172.21.15.19:0/1467886772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f205c15e760 0x7f205c06cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2053fff640 1 -- 172.21.15.19:0/1467886772 >> v2:172.21.15.135:3300/0 conn(0x7f205c0cfcc0 msgr2=0x7f205c0d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:44.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2053fff640 1 --2- 172.21.15.19:0/1467886772 >> v2:172.21.15.135:3300/0 conn(0x7f205c0cfcc0 0x7f205c0d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2053fff640 1 -- 172.21.15.19:0/1467886772 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205c0b3c80 con 0x7f205c0d4fd0 2024-09-12T01:56:44.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2053fff640 1 -- 172.21.15.19:0/1467886772 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f204c0019e0 con 0x7f205c0d4fd0 2024-09-12T01:56:44.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f20616f5640 1 --2- 172.21.15.19:0/1467886772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f205c15e760 0x7f205c06cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:44.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2053fff640 1 -- 172.21.15.19:0/1467886772 >> v1:172.21.15.19:6789/0 conn(0x7f205c0d4fd0 legacy=0x7f205c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2053fff640 1 --2- 172.21.15.19:0/1467886772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20480039b0 0x7f2048003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2053fff640 1 --2- 172.21.15.19:0/1467886772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2048004800 0x7f2048004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2053fff640 1 --2- 172.21.15.19:0/1467886772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f205c15e760 0x7f20480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2053fff640 1 -- 172.21.15.19:0/1467886772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f205c0cedb0 con 0x7f2048004800 2024-09-12T01:56:44.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2053fff640 1 -- 172.21.15.19:0/1467886772 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f205c0cf090 con 0x7f20480039b0 2024-09-12T01:56:44.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2053fff640 1 -- 172.21.15.19:0/1467886772 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f204800b9c0 con 0x7f205c15e760 2024-09-12T01:56:44.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2061ef6640 1 --2- 172.21.15.19:0/1467886772 >> v2:172.21.15.135:3300/0 conn(0x7f205c0cfcc0 0x7f205c0d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:44.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2060ef4640 1 --2- 172.21.15.19:0/1467886772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2048004800 0x7f2048004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f20616f5640 1 --2- 172.21.15.19:0/1467886772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20480039b0 0x7f2048003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2061ef6640 1 --2- 172.21.15.19:0/1467886772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f205c15e760 0x7f20480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2060ef4640 1 -- 172.21.15.19:0/1467886772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f205c15e760 msgr2=0x7f20480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:44.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2060ef4640 1 --2- 172.21.15.19:0/1467886772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f205c15e760 0x7f20480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2060ef4640 1 -- 172.21.15.19:0/1467886772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20480039b0 msgr2=0x7f2048003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:44.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2060ef4640 1 --2- 172.21.15.19:0/1467886772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20480039b0 0x7f2048003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.171+0000 7f2060ef4640 1 -- 172.21.15.19:0/1467886772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2048003520 con 0x7f2048004800 2024-09-12T01:56:44.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.172+0000 7f2060ef4640 1 --2- 172.21.15.19:0/1467886772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2048004800 0x7f2048004c80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f205c08ca80 tx=0x7f2048005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e88f34a481f824 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:44.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.172+0000 7f2053fff640 1 -- 172.21.15.19:0/1467886772 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c00c0e0 con 0x7f2048004800 2024-09-12T01:56:44.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.172+0000 7f2053fff640 1 -- 172.21.15.19:0/1467886772 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f204c034070 con 0x7f2048004800 2024-09-12T01:56:44.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.172+0000 7f2053fff640 1 -- 172.21.15.19:0/1467886772 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c0074b0 con 0x7f2048004800 2024-09-12T01:56:44.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.173+0000 7f2063959640 1 -- 172.21.15.19:0/1467886772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2048004800 msgr2=0x7f2048004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.173+0000 7f2063959640 1 --2- 172.21.15.19:0/1467886772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2048004800 0x7f2048004c80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f205c08ca80 tx=0x7f2048005830 comp rx=0 tx=0).stop 2024-09-12T01:56:44.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.173+0000 7f2061ef6640 1 -- 172.21.15.19:0/1467886772 reap_dead start 2024-09-12T01:56:44.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.173+0000 7f2063959640 1 -- 172.21.15.19:0/1467886772 shutdown_connections 2024-09-12T01:56:44.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.173+0000 7f2063959640 1 -- 172.21.15.19:0/1467886772 >> 172.21.15.19:0/1467886772 conn(0x7f205c08bfc0 msgr2=0x7f205c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:44.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.173+0000 7f2063959640 1 -- 172.21.15.19:0/1467886772 shutdown_connections 2024-09-12T01:56:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.173+0000 7f2063959640 1 -- 172.21.15.19:0/1467886772 wait complete. 2024-09-12T01:56:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.174+0000 7f2063959640 1 Processor -- start 2024-09-12T01:56:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.174+0000 7f2063959640 1 -- start start 2024-09-12T01:56:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.175+0000 7f2063959640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2048004800 0x7f205c161580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.175+0000 7f2063959640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f205c0b55e0 0x7f205c156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.175+0000 7f2063959640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f205c0b5a60 0x7f205c156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.175+0000 7f2063959640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f205c06cdd0 con 0x7f2048004800 2024-09-12T01:56:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.175+0000 7f2063959640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f205c0b3860 con 0x7f205c0b55e0 2024-09-12T01:56:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.175+0000 7f2063959640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f205c06cf50 con 0x7f205c0b5a60 2024-09-12T01:56:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.175+0000 7f20616f5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2048004800 0x7f205c161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.175+0000 7f20616f5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2048004800 0x7f205c161580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39912/0 (socket says 172.21.15.19:39912) 2024-09-12T01:56:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.175+0000 7f20616f5640 1 -- 172.21.15.19:0/1700112639 learned_addr learned my addr 172.21.15.19:0/1700112639 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.175+0000 7f2060ef4640 1 --2- 172.21.15.19:0/1700112639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f205c0b55e0 0x7f205c156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.175+0000 7f2061ef6640 1 --2- 172.21.15.19:0/1700112639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f205c0b5a60 0x7f205c156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.175+0000 7f20616f5640 1 -- 172.21.15.19:0/1700112639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f205c0b5a60 msgr2=0x7f205c156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.175+0000 7f20616f5640 1 --2- 172.21.15.19:0/1700112639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f205c0b5a60 0x7f205c156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.175+0000 7f20616f5640 1 -- 172.21.15.19:0/1700112639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f205c0b55e0 msgr2=0x7f205c156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.175+0000 7f20616f5640 1 --2- 172.21.15.19:0/1700112639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f205c0b55e0 0x7f205c156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.175+0000 7f20616f5640 1 -- 172.21.15.19:0/1700112639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205c1607e0 con 0x7f2048004800 2024-09-12T01:56:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.175+0000 7f2060ef4640 1 --2- 172.21.15.19:0/1700112639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f205c0b55e0 0x7f205c156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.175+0000 7f20616f5640 1 --2- 172.21.15.19:0/1700112639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2048004800 0x7f205c161580 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2058011930 tx=0x7f2058011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.176+0000 7f2051ffb640 1 -- 172.21.15.19:0/1700112639 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205800faf0 con 0x7f2048004800 2024-09-12T01:56:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.176+0000 7f2051ffb640 1 -- 172.21.15.19:0/1700112639 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205800fc90 con 0x7f2048004800 2024-09-12T01:56:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.176+0000 7f2063959640 1 -- 172.21.15.19:0/1700112639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205c1f8ce0 con 0x7f2048004800 2024-09-12T01:56:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.176+0000 7f2051ffb640 1 -- 172.21.15.19:0/1700112639 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058004030 con 0x7f2048004800 2024-09-12T01:56:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.176+0000 7f2063959640 1 -- 172.21.15.19:0/1700112639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f205c160d80 con 0x7f2048004800 2024-09-12T01:56:44.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.177+0000 7f2063959640 1 -- 172.21.15.19:0/1700112639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f205c0ce690 con 0x7f2048004800 2024-09-12T01:56:44.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.177+0000 7f2051ffb640 1 -- 172.21.15.19:0/1700112639 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2058012040 con 0x7f2048004800 2024-09-12T01:56:44.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.178+0000 7f2051ffb640 1 --2- 172.21.15.19:0/1700112639 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f204006be30 0x7f204006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.178+0000 7f2051ffb640 1 -- 172.21.15.19:0/1700112639 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f205808af30 con 0x7f2048004800 2024-09-12T01:56:44.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.178+0000 7f2060ef4640 1 --2- 172.21.15.19:0/1700112639 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f204006be30 0x7f204006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.179+0000 7f2060ef4640 1 --2- 172.21.15.19:0/1700112639 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f204006be30 0x7f204006e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f204c033000 tx=0x7f204c009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:44.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.182+0000 7f2051ffb640 1 -- 172.21.15.19:0/1700112639 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2058019070 con 0x7f2048004800 2024-09-12T01:56:44.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.423+0000 7f2063959640 1 -- 172.21.15.19:0/1700112639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f205c0b6d20 con 0x7f2048004800 2024-09-12T01:56:44.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.425+0000 7f2051ffb640 1 -- 172.21.15.19:0/1700112639 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f20580593b0 con 0x7f2048004800 2024-09-12T01:56:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.427+0000 7f2063959640 1 -- 172.21.15.19:0/1700112639 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f204006be30 msgr2=0x7f204006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.427+0000 7f2063959640 1 --2- 172.21.15.19:0/1700112639 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f204006be30 0x7f204006e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f204c033000 tx=0x7f204c009030 comp rx=0 tx=0).stop 2024-09-12T01:56:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.427+0000 7f2063959640 1 -- 172.21.15.19:0/1700112639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2048004800 msgr2=0x7f205c161580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.427+0000 7f2063959640 1 --2- 172.21.15.19:0/1700112639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2048004800 0x7f205c161580 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2058011930 tx=0x7f2058011df0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.427+0000 7f2063959640 1 -- 172.21.15.19:0/1700112639 shutdown_connections 2024-09-12T01:56:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.427+0000 7f2063959640 1 --2- 172.21.15.19:0/1700112639 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f204006be30 0x7f204006e2f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.427+0000 7f2063959640 1 --2- 172.21.15.19:0/1700112639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f205c0b5a60 0x7f205c156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.427+0000 7f2063959640 1 --2- 172.21.15.19:0/1700112639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f205c0b55e0 0x7f205c156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.427+0000 7f2063959640 1 --2- 172.21.15.19:0/1700112639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2048004800 0x7f205c161580 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.427+0000 7f2063959640 1 -- 172.21.15.19:0/1700112639 >> 172.21.15.19:0/1700112639 conn(0x7f205c08bfc0 msgr2=0x7f205c0d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.427+0000 7f2063959640 1 -- 172.21.15.19:0/1700112639 shutdown_connections 2024-09-12T01:56:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.427+0000 7f2063959640 1 -- 172.21.15.19:0/1700112639 wait complete. 2024-09-12T01:56:44.438 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-12T01:56:44.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.541+0000 7ff3aff2a640 1 Processor -- start 2024-09-12T01:56:44.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.541+0000 7ff3aff2a640 1 -- start start 2024-09-12T01:56:44.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.542+0000 7ff3aff2a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a815b300 0x7ff3a80cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.542+0000 7ff3aff2a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff3a80cd3f0 0x7ff3a806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.542+0000 7ff3aff2a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3a80cdbe0 con 0x7ff3a8072d30 2024-09-12T01:56:44.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.542+0000 7ff3aff2a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff3a80728a0 con 0x7ff3a80cd3f0 2024-09-12T01:56:44.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.542+0000 7ff3aff2a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a80cd900 con 0x7ff3a815b300 2024-09-12T01:56:44.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.542+0000 7ff3ad4c5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff3a80cd3f0 0x7ff3a806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.542+0000 7ff3ad4c5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff3a80cd3f0 0x7ff3a806f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39918/0 (socket says 172.21.15.19:39918) 2024-09-12T01:56:44.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.542+0000 7ff3ad4c5640 1 -- 172.21.15.19:0/39300804 learned_addr learned my addr 172.21.15.19:0/39300804 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:44.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.542+0000 7ff3adcc6640 1 --2- 172.21.15.19:0/39300804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a815b300 0x7ff3a80cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.542+0000 7ff3ad4c5640 1 -- 172.21.15.19:0/39300804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a815b300 msgr2=0x7ff3a80cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:44.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.542+0000 7ff3ad4c5640 1 --2- 172.21.15.19:0/39300804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a815b300 0x7ff3a80cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.542+0000 7ff3ad4c5640 1 -- 172.21.15.19:0/39300804 >> v1:172.21.15.135:6789/0 conn(0x7ff3a8072d30 legacy=0x7ff3a80b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.542+0000 7ff3ad4c5640 1 -- 172.21.15.19:0/39300804 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a8072250 con 0x7ff3a80cd3f0 2024-09-12T01:56:44.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.542+0000 7ff3adcc6640 1 --2- 172.21.15.19:0/39300804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a815b300 0x7ff3a80cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:44.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.543+0000 7ff3ad4c5640 1 --2- 172.21.15.19:0/39300804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a80cd3f0 0x7ff3a806f1c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff398009870 tx=0x7ff39802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c7408e9fa43e98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:44.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.543+0000 7ff3accc4640 1 -- 172.21.15.19:0/39300804 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff398037070 con 0x7ff3a80cd3f0 2024-09-12T01:56:44.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.543+0000 7ff3accc4640 1 -- 172.21.15.19:0/39300804 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff398032440 con 0x7ff3a80cd3f0 2024-09-12T01:56:44.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.543+0000 7ff3accc4640 1 -- 172.21.15.19:0/39300804 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff398032810 con 0x7ff3a80cd3f0 2024-09-12T01:56:44.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.544+0000 7ff3aff2a640 1 -- 172.21.15.19:0/39300804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a80cd3f0 msgr2=0x7ff3a806f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.544+0000 7ff3aff2a640 1 --2- 172.21.15.19:0/39300804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a80cd3f0 0x7ff3a806f1c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff398009870 tx=0x7ff39802a270 comp rx=0 tx=0).stop 2024-09-12T01:56:44.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.544+0000 7ff3aff2a640 1 -- 172.21.15.19:0/39300804 shutdown_connections 2024-09-12T01:56:44.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.544+0000 7ff3aff2a640 1 --2- 172.21.15.19:0/39300804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a80cd3f0 0x7ff3a806f1c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.544+0000 7ff3aff2a640 1 --2- 172.21.15.19:0/39300804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a815b300 0x7ff3a80cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.544+0000 7ff3aff2a640 1 -- 172.21.15.19:0/39300804 >> 172.21.15.19:0/39300804 conn(0x7ff3a8067d70 msgr2=0x7ff3a806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:44.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.544+0000 7ff3aff2a640 1 -- 172.21.15.19:0/39300804 shutdown_connections 2024-09-12T01:56:44.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.544+0000 7ff3aff2a640 1 -- 172.21.15.19:0/39300804 wait complete. 2024-09-12T01:56:44.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.545+0000 7ff3aff2a640 1 Processor -- start 2024-09-12T01:56:44.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.545+0000 7ff3aff2a640 1 -- start start 2024-09-12T01:56:44.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.546+0000 7ff3aff2a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a8072d30 0x7ff3a814ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.546+0000 7ff3aff2a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a80cd3f0 0x7ff3a8147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.546+0000 7ff3aff2a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3a815b300 0x7ff3a814c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.546+0000 7ff3aff2a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a80d0160 con 0x7ff3a8072d30 2024-09-12T01:56:44.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.546+0000 7ff3aff2a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a80cffe0 con 0x7ff3a815b300 2024-09-12T01:56:44.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.546+0000 7ff3aff2a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a806f700 con 0x7ff3a80cd3f0 2024-09-12T01:56:44.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.546+0000 7ff3adcc6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a8072d30 0x7ff3a814ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.546+0000 7ff3adcc6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a8072d30 0x7ff3a814ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39928/0 (socket says 172.21.15.19:39928) 2024-09-12T01:56:44.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.546+0000 7ff3adcc6640 1 -- 172.21.15.19:0/4060713853 learned_addr learned my addr 172.21.15.19:0/4060713853 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:44.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.546+0000 7ff3ad4c5640 1 --2- 172.21.15.19:0/4060713853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a80cd3f0 0x7ff3a8147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.546+0000 7ff3ae4c7640 1 --2- 172.21.15.19:0/4060713853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3a815b300 0x7ff3a814c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.546+0000 7ff3adcc6640 1 -- 172.21.15.19:0/4060713853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a80cd3f0 msgr2=0x7ff3a8147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.546+0000 7ff3adcc6640 1 --2- 172.21.15.19:0/4060713853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a80cd3f0 0x7ff3a8147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.546+0000 7ff3adcc6640 1 -- 172.21.15.19:0/4060713853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3a815b300 msgr2=0x7ff3a814c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.546+0000 7ff3adcc6640 1 --2- 172.21.15.19:0/4060713853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3a815b300 0x7ff3a814c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.546+0000 7ff3adcc6640 1 -- 172.21.15.19:0/4060713853 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a814f500 con 0x7ff3a8072d30 2024-09-12T01:56:44.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.546+0000 7ff3ae4c7640 1 --2- 172.21.15.19:0/4060713853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3a815b300 0x7ff3a814c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:44.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.546+0000 7ff3adcc6640 1 --2- 172.21.15.19:0/4060713853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a8072d30 0x7ff3a814ed70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400d7d0 tx=0x7ff3a400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:44.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.547+0000 7ff39e7fc640 1 -- 172.21.15.19:0/4060713853 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4004030 con 0x7ff3a8072d30 2024-09-12T01:56:44.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.547+0000 7ff39e7fc640 1 -- 172.21.15.19:0/4060713853 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a40041d0 con 0x7ff3a8072d30 2024-09-12T01:56:44.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.547+0000 7ff3aff2a640 1 -- 172.21.15.19:0/4060713853 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a814f7e0 con 0x7ff3a8072d30 2024-09-12T01:56:44.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.547+0000 7ff39e7fc640 1 -- 172.21.15.19:0/4060713853 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a40096a0 con 0x7ff3a8072d30 2024-09-12T01:56:44.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.547+0000 7ff3aff2a640 1 -- 172.21.15.19:0/4060713853 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a814fda0 con 0x7ff3a8072d30 2024-09-12T01:56:44.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.548+0000 7ff3aff2a640 1 -- 172.21.15.19:0/4060713853 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a80b52b0 con 0x7ff3a8072d30 2024-09-12T01:56:44.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.548+0000 7ff39e7fc640 1 -- 172.21.15.19:0/4060713853 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3a4009840 con 0x7ff3a8072d30 2024-09-12T01:56:44.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.549+0000 7ff39e7fc640 1 --2- 172.21.15.19:0/4060713853 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff38c06be30 0x7ff38c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.549+0000 7ff39e7fc640 1 -- 172.21.15.19:0/4060713853 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7ff3a408ae20 con 0x7ff3a8072d30 2024-09-12T01:56:44.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.549+0000 7ff3ad4c5640 1 --2- 172.21.15.19:0/4060713853 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff38c06be30 0x7ff38c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.550+0000 7ff3ad4c5640 1 --2- 172.21.15.19:0/4060713853 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff38c06be30 0x7ff38c06e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff398034000 tx=0x7ff39802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:44.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.553+0000 7ff39e7fc640 1 -- 172.21.15.19:0/4060713853 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3a4059a20 con 0x7ff3a8072d30 2024-09-12T01:56:44.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.794+0000 7ff3aff2a640 1 -- 172.21.15.19:0/4060713853 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7ff3a80b4fd0 con 0x7ff3a8072d30 2024-09-12T01:56:44.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.796+0000 7ff39e7fc640 1 -- 172.21.15.19:0/4060713853 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7ff3a4059320 con 0x7ff3a8072d30 2024-09-12T01:56:44.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.798+0000 7ff3aff2a640 1 -- 172.21.15.19:0/4060713853 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff38c06be30 msgr2=0x7ff38c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.798+0000 7ff3aff2a640 1 --2- 172.21.15.19:0/4060713853 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff38c06be30 0x7ff38c06e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff398034000 tx=0x7ff39802e000 comp rx=0 tx=0).stop 2024-09-12T01:56:44.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.798+0000 7ff3aff2a640 1 -- 172.21.15.19:0/4060713853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a8072d30 msgr2=0x7ff3a814ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.798+0000 7ff3aff2a640 1 --2- 172.21.15.19:0/4060713853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a8072d30 0x7ff3a814ed70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400d7d0 tx=0x7ff3a400dc90 comp rx=0 tx=0).stop 2024-09-12T01:56:44.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.798+0000 7ff3aff2a640 1 -- 172.21.15.19:0/4060713853 shutdown_connections 2024-09-12T01:56:44.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.798+0000 7ff3aff2a640 1 --2- 172.21.15.19:0/4060713853 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff38c06be30 0x7ff38c06e2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.798+0000 7ff3aff2a640 1 --2- 172.21.15.19:0/4060713853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3a815b300 0x7ff3a814c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.798+0000 7ff3aff2a640 1 --2- 172.21.15.19:0/4060713853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a80cd3f0 0x7ff3a8147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.798+0000 7ff3aff2a640 1 --2- 172.21.15.19:0/4060713853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a8072d30 0x7ff3a814ed70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.798+0000 7ff3aff2a640 1 -- 172.21.15.19:0/4060713853 >> 172.21.15.19:0/4060713853 conn(0x7ff3a8067d70 msgr2=0x7ff3a80b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:44.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.798+0000 7ff3aff2a640 1 -- 172.21.15.19:0/4060713853 shutdown_connections 2024-09-12T01:56:44.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.798+0000 7ff3aff2a640 1 -- 172.21.15.19:0/4060713853 wait complete. 2024-09-12T01:56:44.809 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-12T01:56:44.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.913+0000 7f35bd9fd640 1 Processor -- start 2024-09-12T01:56:44.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.913+0000 7f35bd9fd640 1 -- start start 2024-09-12T01:56:44.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.914+0000 7f35bd9fd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35b815b300 0x7f35b80cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.914+0000 7f35bd9fd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f35b80cd3f0 0x7f35b806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.914+0000 7f35bd9fd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35b80cdbe0 con 0x7f35b8072d30 2024-09-12T01:56:44.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.914+0000 7f35bd9fd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f35b80728a0 con 0x7f35b80cd3f0 2024-09-12T01:56:44.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.914+0000 7f35bd9fd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f35b80cd900 con 0x7f35b815b300 2024-09-12T01:56:44.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.914+0000 7f35b67fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f35b80cd3f0 0x7f35b806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.914+0000 7f35b77fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f35b8072d30 0x7f35b80b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58644/0 (socket says 172.21.15.19:58644) 2024-09-12T01:56:44.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.914+0000 7f35b77fe640 1 -- 172.21.15.19:0/928357108 learned_addr learned my addr 172.21.15.19:0/928357108 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:44.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.914+0000 7f35b6ffd640 1 --2- 172.21.15.19:0/928357108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35b815b300 0x7f35b80cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.914+0000 7f35b67fc640 1 -- 172.21.15.19:0/928357108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35b815b300 msgr2=0x7f35b80cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:44.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.914+0000 7f35b67fc640 1 --2- 172.21.15.19:0/928357108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35b815b300 0x7f35b80cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.914+0000 7f35b67fc640 1 -- 172.21.15.19:0/928357108 >> v1:172.21.15.19:6789/0 conn(0x7f35b8072d30 legacy=0x7f35b80b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.915+0000 7f35b67fc640 1 -- 172.21.15.19:0/928357108 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b8072250 con 0x7f35b80cd3f0 2024-09-12T01:56:44.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.914+0000 7f35b5ffb640 1 -- 172.21.15.19:0/928357108 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1093103024 0 0) 0x7f35b80cdbe0 con 0x7f35b8072d30 2024-09-12T01:56:44.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.915+0000 7f35b67fc640 1 --2- 172.21.15.19:0/928357108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35b80cd3f0 0x7f35b806f1c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0097a0 tx=0x7f35ac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f93d49ac6893509 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:44.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.915+0000 7f35b5ffb640 1 -- 172.21.15.19:0/928357108 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ac037070 con 0x7f35b80cd3f0 2024-09-12T01:56:44.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.915+0000 7f35b5ffb640 1 -- 172.21.15.19:0/928357108 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35ac032440 con 0x7f35b80cd3f0 2024-09-12T01:56:44.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.915+0000 7f35b5ffb640 1 -- 172.21.15.19:0/928357108 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ac032810 con 0x7f35b80cd3f0 2024-09-12T01:56:44.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.916+0000 7f35bd9fd640 1 -- 172.21.15.19:0/928357108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35b80cd3f0 msgr2=0x7f35b806f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.916+0000 7f35bd9fd640 1 --2- 172.21.15.19:0/928357108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35b80cd3f0 0x7f35b806f1c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0097a0 tx=0x7f35ac02a180 comp rx=0 tx=0).stop 2024-09-12T01:56:44.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.916+0000 7f35bd9fd640 1 -- 172.21.15.19:0/928357108 shutdown_connections 2024-09-12T01:56:44.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.916+0000 7f35bd9fd640 1 --2- 172.21.15.19:0/928357108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35b80cd3f0 0x7f35b806f1c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.916+0000 7f35bd9fd640 1 --2- 172.21.15.19:0/928357108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35b815b300 0x7f35b80cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.916+0000 7f35bd9fd640 1 -- 172.21.15.19:0/928357108 >> 172.21.15.19:0/928357108 conn(0x7f35b8067d70 msgr2=0x7f35b806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:44.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.916+0000 7f35bd9fd640 1 -- 172.21.15.19:0/928357108 shutdown_connections 2024-09-12T01:56:44.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.916+0000 7f35bd9fd640 1 -- 172.21.15.19:0/928357108 wait complete. 2024-09-12T01:56:44.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.917+0000 7f35bd9fd640 1 Processor -- start 2024-09-12T01:56:44.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.917+0000 7f35bd9fd640 1 -- start start 2024-09-12T01:56:44.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.918+0000 7f35bd9fd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35b8072d30 0x7f35b8147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.918+0000 7f35bd9fd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b80cd3f0 0x7f35b8150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.918+0000 7f35bd9fd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35b815b300 0x7f35b81f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.918+0000 7f35bd9fd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f35b80d0160 con 0x7f35b815b300 2024-09-12T01:56:44.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.918+0000 7f35bd9fd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f35b80cffe0 con 0x7f35b80cd3f0 2024-09-12T01:56:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.918+0000 7f35bd9fd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f35b806f700 con 0x7f35b8072d30 2024-09-12T01:56:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.918+0000 7f35b77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35b815b300 0x7f35b81f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.918+0000 7f35b77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35b815b300 0x7f35b81f5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39954/0 (socket says 172.21.15.19:39954) 2024-09-12T01:56:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.918+0000 7f35b77fe640 1 -- 172.21.15.19:0/935386529 learned_addr learned my addr 172.21.15.19:0/935386529 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.918+0000 7f35b6ffd640 1 --2- 172.21.15.19:0/935386529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35b8072d30 0x7f35b8147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.918+0000 7f35b67fc640 1 --2- 172.21.15.19:0/935386529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b80cd3f0 0x7f35b8150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.919+0000 7f35b77fe640 1 -- 172.21.15.19:0/935386529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35b8072d30 msgr2=0x7f35b8147520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.919+0000 7f35b77fe640 1 --2- 172.21.15.19:0/935386529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35b8072d30 0x7f35b8147520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.919+0000 7f35b77fe640 1 -- 172.21.15.19:0/935386529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b80cd3f0 msgr2=0x7f35b8150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.919+0000 7f35b77fe640 1 --2- 172.21.15.19:0/935386529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b80cd3f0 0x7f35b8150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.919+0000 7f35b77fe640 1 -- 172.21.15.19:0/935386529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b814ec20 con 0x7f35b815b300 2024-09-12T01:56:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.919+0000 7f35b77fe640 1 --2- 172.21.15.19:0/935386529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35b815b300 0x7f35b81f5fe0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f35b000c7a0 tx=0x7f35b000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.919+0000 7f359ffff640 1 -- 172.21.15.19:0/935386529 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b0018070 con 0x7f35b815b300 2024-09-12T01:56:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.919+0000 7f359ffff640 1 -- 172.21.15.19:0/935386529 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b000a640 con 0x7f35b815b300 2024-09-12T01:56:44.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.919+0000 7f35bd9fd640 1 -- 172.21.15.19:0/935386529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35b814ef00 con 0x7f35b815b300 2024-09-12T01:56:44.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.919+0000 7f359ffff640 1 -- 172.21.15.19:0/935386529 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b000aab0 con 0x7f35b815b300 2024-09-12T01:56:44.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.919+0000 7f35bd9fd640 1 -- 172.21.15.19:0/935386529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b814c7a0 con 0x7f35b815b300 2024-09-12T01:56:44.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.920+0000 7f35bd9fd640 1 -- 172.21.15.19:0/935386529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35b806bf30 con 0x7f35b815b300 2024-09-12T01:56:44.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.921+0000 7f359ffff640 1 -- 172.21.15.19:0/935386529 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f35b000ac50 con 0x7f35b815b300 2024-09-12T01:56:44.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.921+0000 7f359ffff640 1 --2- 172.21.15.19:0/935386529 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f35a406be30 0x7f35a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.921+0000 7f359ffff640 1 -- 172.21.15.19:0/935386529 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f35b008a2d0 con 0x7f35b815b300 2024-09-12T01:56:44.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.921+0000 7f35b6ffd640 1 --2- 172.21.15.19:0/935386529 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f35a406be30 0x7f35a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.922+0000 7f35b6ffd640 1 --2- 172.21.15.19:0/935386529 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f35a406be30 0x7f35a406e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009aa0 tx=0x7f35a8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:44.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:44.925+0000 7f359ffff640 1 -- 172.21.15.19:0/935386529 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f35b0058770 con 0x7f35b815b300 2024-09-12T01:56:45.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.169+0000 7f35bd9fd640 1 -- 172.21.15.19:0/935386529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f35b806ebc0 con 0x7f35b815b300 2024-09-12T01:56:45.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.171+0000 7f359ffff640 1 -- 172.21.15.19:0/935386529 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f35b005ca70 con 0x7f35b815b300 2024-09-12T01:56:45.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.174+0000 7f35bd9fd640 1 -- 172.21.15.19:0/935386529 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f35a406be30 msgr2=0x7f35a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.174+0000 7f35bd9fd640 1 --2- 172.21.15.19:0/935386529 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f35a406be30 0x7f35a406e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009aa0 tx=0x7f35a8009190 comp rx=0 tx=0).stop 2024-09-12T01:56:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.174+0000 7f35bd9fd640 1 -- 172.21.15.19:0/935386529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35b815b300 msgr2=0x7f35b81f5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.174+0000 7f35bd9fd640 1 --2- 172.21.15.19:0/935386529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35b815b300 0x7f35b81f5fe0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f35b000c7a0 tx=0x7f35b000cc60 comp rx=0 tx=0).stop 2024-09-12T01:56:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.174+0000 7f35bd9fd640 1 -- 172.21.15.19:0/935386529 shutdown_connections 2024-09-12T01:56:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.174+0000 7f35bd9fd640 1 --2- 172.21.15.19:0/935386529 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f35a406be30 0x7f35a406e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.174+0000 7f35bd9fd640 1 --2- 172.21.15.19:0/935386529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35b815b300 0x7f35b81f5fe0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.174+0000 7f35bd9fd640 1 --2- 172.21.15.19:0/935386529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b80cd3f0 0x7f35b8150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.174+0000 7f35bd9fd640 1 --2- 172.21.15.19:0/935386529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35b8072d30 0x7f35b8147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.174+0000 7f35bd9fd640 1 -- 172.21.15.19:0/935386529 >> 172.21.15.19:0/935386529 conn(0x7f35b8067d70 msgr2=0x7f35b8151fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.174+0000 7f35bd9fd640 1 -- 172.21.15.19:0/935386529 shutdown_connections 2024-09-12T01:56:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.174+0000 7f35bd9fd640 1 -- 172.21.15.19:0/935386529 wait complete. 2024-09-12T01:56:45.185 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-12T01:56:45.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.288+0000 7ff5e47cd640 1 Processor -- start 2024-09-12T01:56:45.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.288+0000 7ff5e47cd640 1 -- start start 2024-09-12T01:56:45.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.289+0000 7ff5e47cd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff5dc072de0 0x7ff5dc15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.289+0000 7ff5e47cd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5dc146140 con 0x7ff5dc072700 2024-09-12T01:56:45.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.289+0000 7ff5e47cd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5dc0cd740 con 0x7ff5dc072320 2024-09-12T01:56:45.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.289+0000 7ff5e47cd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff5dc0cda20 con 0x7ff5dc072de0 2024-09-12T01:56:45.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.289+0000 7ff5e1d68640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff5dc072de0 0x7ff5dc15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.289+0000 7ff5e2d6a640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff5dc072700 0x7ff5dc15d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58652/0 (socket says 172.21.15.19:58652) 2024-09-12T01:56:45.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.289+0000 7ff5e2d6a640 1 -- 172.21.15.19:0/1543091525 learned_addr learned my addr 172.21.15.19:0/1543091525 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:45.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.289+0000 7ff5e1d68640 1 -- 172.21.15.19:0/1543091525 >> v1:172.21.15.135:6789/0 conn(0x7ff5dc072320 legacy=0x7ff5dc0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:45.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.290+0000 7ff5e1d68640 1 -- 172.21.15.19:0/1543091525 >> v1:172.21.15.19:6789/0 conn(0x7ff5dc072700 legacy=0x7ff5dc15d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.290+0000 7ff5e1d68640 1 -- 172.21.15.19:0/1543091525 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5dc0cdd00 con 0x7ff5dc072de0 2024-09-12T01:56:45.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.290+0000 7ff5e1567640 1 -- 172.21.15.19:0/1543091525 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1664226541 0 0) 0x7ff5dc146140 con 0x7ff5dc072700 2024-09-12T01:56:45.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.290+0000 7ff5e1d68640 1 --2- 172.21.15.19:0/1543091525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5dc072de0 0x7ff5dc15d1e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00097a0 tx=0x7ff5d002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a04eca12a847e88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:45.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.290+0000 7ff5e1567640 1 -- 172.21.15.19:0/1543091525 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0037070 con 0x7ff5dc072de0 2024-09-12T01:56:45.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.290+0000 7ff5e1567640 1 -- 172.21.15.19:0/1543091525 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d002ae50 con 0x7ff5dc072de0 2024-09-12T01:56:45.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.290+0000 7ff5e1567640 1 -- 172.21.15.19:0/1543091525 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0032660 con 0x7ff5dc072de0 2024-09-12T01:56:45.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.291+0000 7ff5e47cd640 1 -- 172.21.15.19:0/1543091525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5dc072de0 msgr2=0x7ff5dc15d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.291+0000 7ff5e47cd640 1 --2- 172.21.15.19:0/1543091525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5dc072de0 0x7ff5dc15d1e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00097a0 tx=0x7ff5d002a140 comp rx=0 tx=0).stop 2024-09-12T01:56:45.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.291+0000 7ff5e47cd640 1 -- 172.21.15.19:0/1543091525 shutdown_connections 2024-09-12T01:56:45.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.291+0000 7ff5e47cd640 1 --2- 172.21.15.19:0/1543091525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5dc072de0 0x7ff5dc15d1e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.291+0000 7ff5e47cd640 1 -- 172.21.15.19:0/1543091525 >> 172.21.15.19:0/1543091525 conn(0x7ff5dc067d70 msgr2=0x7ff5dc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:45.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.291+0000 7ff5e47cd640 1 -- 172.21.15.19:0/1543091525 shutdown_connections 2024-09-12T01:56:45.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.291+0000 7ff5e47cd640 1 -- 172.21.15.19:0/1543091525 wait complete. 2024-09-12T01:56:45.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.292+0000 7ff5e47cd640 1 Processor -- start 2024-09-12T01:56:45.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.292+0000 7ff5e47cd640 1 -- start start 2024-09-12T01:56:45.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.293+0000 7ff5e47cd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5dc072320 0x7ff5dc15bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.293+0000 7ff5e47cd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5dc072700 0x7ff5dc0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.293+0000 7ff5e47cd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5dc072de0 0x7ff5dc1e7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.293+0000 7ff5e47cd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc15dfb0 con 0x7ff5dc072de0 2024-09-12T01:56:45.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.293+0000 7ff5e47cd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc15de30 con 0x7ff5dc072700 2024-09-12T01:56:45.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.293+0000 7ff5e47cd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff5dc15e130 con 0x7ff5dc072320 2024-09-12T01:56:45.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.293+0000 7ff5e2d6a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5dc072de0 0x7ff5dc1e7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.293+0000 7ff5e2d6a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5dc072de0 0x7ff5dc1e7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39966/0 (socket says 172.21.15.19:39966) 2024-09-12T01:56:45.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.293+0000 7ff5e2d6a640 1 -- 172.21.15.19:0/1266951653 learned_addr learned my addr 172.21.15.19:0/1266951653 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:45.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.293+0000 7ff5e1d68640 1 --2- 172.21.15.19:0/1266951653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5dc072700 0x7ff5dc0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.293+0000 7ff5e2569640 1 --2- 172.21.15.19:0/1266951653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5dc072320 0x7ff5dc15bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.293+0000 7ff5e2d6a640 1 -- 172.21.15.19:0/1266951653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5dc072320 msgr2=0x7ff5dc15bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.293+0000 7ff5e2d6a640 1 --2- 172.21.15.19:0/1266951653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5dc072320 0x7ff5dc15bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.293+0000 7ff5e2d6a640 1 -- 172.21.15.19:0/1266951653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5dc072700 msgr2=0x7ff5dc0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.293+0000 7ff5e2d6a640 1 --2- 172.21.15.19:0/1266951653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5dc072700 0x7ff5dc0c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.293+0000 7ff5e2d6a640 1 -- 172.21.15.19:0/1266951653 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5dc0c9340 con 0x7ff5dc072de0 2024-09-12T01:56:45.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.293+0000 7ff5e1d68640 1 --2- 172.21.15.19:0/1266951653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5dc072700 0x7ff5dc0c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:45.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.293+0000 7ff5e2569640 1 --2- 172.21.15.19:0/1266951653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5dc072320 0x7ff5dc15bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:45.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.294+0000 7ff5e2d6a640 1 --2- 172.21.15.19:0/1266951653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5dc072de0 0x7ff5dc1e7bc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400c480 tx=0x7ff5d400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:45.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.294+0000 7ff5daffd640 1 -- 172.21.15.19:0/1266951653 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4018070 con 0x7ff5dc072de0 2024-09-12T01:56:45.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.294+0000 7ff5daffd640 1 -- 172.21.15.19:0/1266951653 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d40074e0 con 0x7ff5dc072de0 2024-09-12T01:56:45.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.294+0000 7ff5e47cd640 1 -- 172.21.15.19:0/1266951653 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5dc0c9620 con 0x7ff5dc072de0 2024-09-12T01:56:45.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.294+0000 7ff5daffd640 1 -- 172.21.15.19:0/1266951653 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4004a20 con 0x7ff5dc072de0 2024-09-12T01:56:45.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.294+0000 7ff5e47cd640 1 -- 172.21.15.19:0/1266951653 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5dc0c9be0 con 0x7ff5dc072de0 2024-09-12T01:56:45.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.295+0000 7ff5e47cd640 1 -- 172.21.15.19:0/1266951653 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5dc0cce60 con 0x7ff5dc072de0 2024-09-12T01:56:45.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.295+0000 7ff5daffd640 1 -- 172.21.15.19:0/1266951653 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff5d401b070 con 0x7ff5dc072de0 2024-09-12T01:56:45.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.296+0000 7ff5daffd640 1 --2- 172.21.15.19:0/1266951653 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff5c806be30 0x7ff5c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.296+0000 7ff5daffd640 1 -- 172.21.15.19:0/1266951653 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7ff5d4089fd0 con 0x7ff5dc072de0 2024-09-12T01:56:45.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.296+0000 7ff5e2569640 1 --2- 172.21.15.19:0/1266951653 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff5c806be30 0x7ff5c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.297+0000 7ff5e2569640 1 --2- 172.21.15.19:0/1266951653 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff5c806be30 0x7ff5c806e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc004520 tx=0x7ff5cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:45.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.300+0000 7ff5daffd640 1 -- 172.21.15.19:0/1266951653 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5d4058b40 con 0x7ff5dc072de0 2024-09-12T01:56:45.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.549+0000 7ff5e47cd640 1 -- 172.21.15.19:0/1266951653 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7ff5dc06d090 con 0x7ff5dc072de0 2024-09-12T01:56:45.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.551+0000 7ff5daffd640 1 -- 172.21.15.19:0/1266951653 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7ff5d4058440 con 0x7ff5dc072de0 2024-09-12T01:56:45.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.554+0000 7ff5e47cd640 1 -- 172.21.15.19:0/1266951653 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff5c806be30 msgr2=0x7ff5c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.554+0000 7ff5e47cd640 1 --2- 172.21.15.19:0/1266951653 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff5c806be30 0x7ff5c806e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc004520 tx=0x7ff5cc009040 comp rx=0 tx=0).stop 2024-09-12T01:56:45.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.554+0000 7ff5e47cd640 1 -- 172.21.15.19:0/1266951653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5dc072de0 msgr2=0x7ff5dc1e7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.554+0000 7ff5e47cd640 1 --2- 172.21.15.19:0/1266951653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5dc072de0 0x7ff5dc1e7bc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400c480 tx=0x7ff5d400c940 comp rx=0 tx=0).stop 2024-09-12T01:56:45.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.554+0000 7ff5e47cd640 1 -- 172.21.15.19:0/1266951653 shutdown_connections 2024-09-12T01:56:45.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.554+0000 7ff5e47cd640 1 --2- 172.21.15.19:0/1266951653 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff5c806be30 0x7ff5c806e2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.554+0000 7ff5e47cd640 1 --2- 172.21.15.19:0/1266951653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5dc072de0 0x7ff5dc1e7bc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.554+0000 7ff5e47cd640 1 --2- 172.21.15.19:0/1266951653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5dc072700 0x7ff5dc0c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.554+0000 7ff5e47cd640 1 --2- 172.21.15.19:0/1266951653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5dc072320 0x7ff5dc15bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.554+0000 7ff5e47cd640 1 -- 172.21.15.19:0/1266951653 >> 172.21.15.19:0/1266951653 conn(0x7ff5dc067d70 msgr2=0x7ff5dc06f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:45.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.554+0000 7ff5e47cd640 1 -- 172.21.15.19:0/1266951653 shutdown_connections 2024-09-12T01:56:45.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.554+0000 7ff5e47cd640 1 -- 172.21.15.19:0/1266951653 wait complete. 2024-09-12T01:56:45.565 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T01:56:45.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.670+0000 7f464df86640 1 Processor -- start 2024-09-12T01:56:45.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.670+0000 7f464df86640 1 -- start start 2024-09-12T01:56:45.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.671+0000 7f464df86640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f464815e760 0x7f464806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.671+0000 7f464df86640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46480d2700 con 0x7f46480d4fd0 2024-09-12T01:56:45.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.671+0000 7f464df86640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46480cedb0 con 0x7f46480cfcc0 2024-09-12T01:56:45.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.671+0000 7f464df86640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f46480cf090 con 0x7f464815e760 2024-09-12T01:56:45.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.671+0000 7f4646ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f46480d4fd0 0x7f46480cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58660/0 (socket says 172.21.15.19:58660) 2024-09-12T01:56:45.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.671+0000 7f4646ffd640 1 -- 172.21.15.19:0/1398484869 learned_addr learned my addr 172.21.15.19:0/1398484869 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:45.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.671+0000 7f46477fe640 1 --2- 172.21.15.19:0/1398484869 >> v2:172.21.15.135:3300/0 conn(0x7f464815e760 0x7f464806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.671+0000 7f46467fc640 1 -- 172.21.15.19:0/1398484869 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1095918674 0 0) 0x7f463c001290 con 0x7f46480d4fd0 2024-09-12T01:56:45.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.671+0000 7f46467fc640 1 -- 172.21.15.19:0/1398484869 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4630003520 con 0x7f46480d4fd0 2024-09-12T01:56:45.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46467fc640 1 -- 172.21.15.19:0/1398484869 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4228613544 0 0) 0x7f4630003520 con 0x7f46480d4fd0 2024-09-12T01:56:45.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46467fc640 1 -- 172.21.15.19:0/1398484869 >> v2:172.21.15.135:3300/0 conn(0x7f464815e760 msgr2=0x7f464806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:45.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46467fc640 1 --2- 172.21.15.19:0/1398484869 >> v2:172.21.15.135:3300/0 conn(0x7f464815e760 0x7f464806cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46467fc640 1 -- 172.21.15.19:0/1398484869 >> v1:172.21.15.135:6789/0 conn(0x7f46480cfcc0 legacy=0x7f46480d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46467fc640 1 -- 172.21.15.19:0/1398484869 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46480b3c80 con 0x7f46480d4fd0 2024-09-12T01:56:45.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46467fc640 1 -- 172.21.15.19:0/1398484869 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f463c0019c0 con 0x7f46480d4fd0 2024-09-12T01:56:45.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46467fc640 1 -- 172.21.15.19:0/1398484869 >> v1:172.21.15.19:6789/0 conn(0x7f46480d4fd0 legacy=0x7f46480cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46467fc640 1 --2- 172.21.15.19:0/1398484869 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46300039b0 0x7f4630003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46467fc640 1 --2- 172.21.15.19:0/1398484869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4630004800 0x7f4630004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46467fc640 1 --2- 172.21.15.19:0/1398484869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46300051c0 0x7f463000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46467fc640 1 -- 172.21.15.19:0/1398484869 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f46480cf090 con 0x7f46300039b0 2024-09-12T01:56:45.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46467fc640 1 -- 172.21.15.19:0/1398484869 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f463000c060 con 0x7f4630004800 2024-09-12T01:56:45.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46467fc640 1 -- 172.21.15.19:0/1398484869 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f463000c260 con 0x7f46300051c0 2024-09-12T01:56:45.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46477fe640 1 --2- 172.21.15.19:0/1398484869 >> v2:172.21.15.135:3300/0 conn(0x7f464815e760 0x7f464806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:45.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46477fe640 1 --2- 172.21.15.19:0/1398484869 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46300039b0 0x7f4630003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f4646ffd640 1 --2- 172.21.15.19:0/1398484869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4630004800 0x7f4630004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f4647fff640 1 --2- 172.21.15.19:0/1398484869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46300051c0 0x7f463000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46477fe640 1 -- 172.21.15.19:0/1398484869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46300051c0 msgr2=0x7f463000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:45.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46477fe640 1 --2- 172.21.15.19:0/1398484869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46300051c0 0x7f463000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46477fe640 1 -- 172.21.15.19:0/1398484869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4630004800 msgr2=0x7f4630004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:45.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46477fe640 1 --2- 172.21.15.19:0/1398484869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4630004800 0x7f4630004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f4647fff640 1 -- 172.21.15.19:0/1398484869 reap_dead start 2024-09-12T01:56:45.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f46477fe640 1 -- 172.21.15.19:0/1398484869 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4630003520 con 0x7f46300039b0 2024-09-12T01:56:45.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.672+0000 7f4646ffd640 1 --2- 172.21.15.19:0/1398484869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4630004800 0x7f4630004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:45.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.673+0000 7f46477fe640 1 --2- 172.21.15.19:0/1398484869 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46300039b0 0x7f4630003dd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4638009c70 tx=0x7f4630005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb64c328bb0238db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:45.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.673+0000 7f46467fc640 1 -- 172.21.15.19:0/1398484869 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638009840 con 0x7f46300039b0 2024-09-12T01:56:45.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.673+0000 7f46467fc640 1 -- 172.21.15.19:0/1398484869 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4638004020 con 0x7f46300039b0 2024-09-12T01:56:45.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.673+0000 7f46467fc640 1 -- 172.21.15.19:0/1398484869 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46380043d0 con 0x7f46300039b0 2024-09-12T01:56:45.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.674+0000 7f464df86640 1 -- 172.21.15.19:0/1398484869 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46300039b0 msgr2=0x7f4630003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.674+0000 7f464df86640 1 --2- 172.21.15.19:0/1398484869 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46300039b0 0x7f4630003dd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4638009c70 tx=0x7f4630005830 comp rx=0 tx=0).stop 2024-09-12T01:56:45.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.674+0000 7f464df86640 1 -- 172.21.15.19:0/1398484869 shutdown_connections 2024-09-12T01:56:45.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.674+0000 7f464df86640 1 --2- 172.21.15.19:0/1398484869 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46300039b0 0x7f4630003dd0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.674+0000 7f464df86640 1 -- 172.21.15.19:0/1398484869 >> 172.21.15.19:0/1398484869 conn(0x7f464808bfc0 msgr2=0x7f46480d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:45.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.674+0000 7f464df86640 1 -- 172.21.15.19:0/1398484869 shutdown_connections 2024-09-12T01:56:45.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.674+0000 7f464df86640 1 -- 172.21.15.19:0/1398484869 wait complete. 2024-09-12T01:56:45.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.675+0000 7f464df86640 1 Processor -- start 2024-09-12T01:56:45.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.675+0000 7f464df86640 1 -- start start 2024-09-12T01:56:45.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.676+0000 7f464df86640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46300039b0 0x7f46480ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.676+0000 7f464df86640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46480b9f20 0x7f4648153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.676+0000 7f464df86640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46480b7380 0x7f46480cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.676+0000 7f464df86640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f464806cdd0 con 0x7f46480b9f20 2024-09-12T01:56:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.676+0000 7f464df86640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f46480b3860 con 0x7f46300039b0 2024-09-12T01:56:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.676+0000 7f464df86640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f464806cf50 con 0x7f46480b7380 2024-09-12T01:56:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.676+0000 7f4646ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46480b9f20 0x7f4648153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.676+0000 7f4646ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46480b9f20 0x7f4648153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39982/0 (socket says 172.21.15.19:39982) 2024-09-12T01:56:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.676+0000 7f4646ffd640 1 -- 172.21.15.19:0/3632563091 learned_addr learned my addr 172.21.15.19:0/3632563091 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.676+0000 7f46477fe640 1 --2- 172.21.15.19:0/3632563091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46300039b0 0x7f46480ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.676+0000 7f4647fff640 1 --2- 172.21.15.19:0/3632563091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46480b7380 0x7f46480cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.676+0000 7f4646ffd640 1 -- 172.21.15.19:0/3632563091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46480b7380 msgr2=0x7f46480cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.676+0000 7f4646ffd640 1 --2- 172.21.15.19:0/3632563091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46480b7380 0x7f46480cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.676+0000 7f4646ffd640 1 -- 172.21.15.19:0/3632563091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46300039b0 msgr2=0x7f46480ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.676+0000 7f4646ffd640 1 --2- 172.21.15.19:0/3632563091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46300039b0 0x7f46480ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.676+0000 7f4646ffd640 1 -- 172.21.15.19:0/3632563091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46480cc330 con 0x7f46480b9f20 2024-09-12T01:56:45.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.676+0000 7f46477fe640 1 --2- 172.21.15.19:0/3632563091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46300039b0 0x7f46480ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:45.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.677+0000 7f4646ffd640 1 --2- 172.21.15.19:0/3632563091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46480b9f20 0x7f4648153590 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f463c00c960 tx=0x7f463c00ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:45.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.677+0000 7f462ffff640 1 -- 172.21.15.19:0/3632563091 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c017020 con 0x7f46480b9f20 2024-09-12T01:56:45.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.677+0000 7f462ffff640 1 -- 172.21.15.19:0/3632563091 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f463c0072e0 con 0x7f46480b9f20 2024-09-12T01:56:45.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.677+0000 7f464df86640 1 -- 172.21.15.19:0/3632563091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46480ce120 con 0x7f46480b9f20 2024-09-12T01:56:45.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.677+0000 7f462ffff640 1 -- 172.21.15.19:0/3632563091 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c00c0e0 con 0x7f46480b9f20 2024-09-12T01:56:45.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.677+0000 7f464df86640 1 -- 172.21.15.19:0/3632563091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46480cc5d0 con 0x7f46480b9f20 2024-09-12T01:56:45.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.678+0000 7f464df86640 1 -- 172.21.15.19:0/3632563091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46480cc7d0 con 0x7f46480b9f20 2024-09-12T01:56:45.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.678+0000 7f462ffff640 1 -- 172.21.15.19:0/3632563091 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f463c01a020 con 0x7f46480b9f20 2024-09-12T01:56:45.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.679+0000 7f462ffff640 1 --2- 172.21.15.19:0/3632563091 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f463406be30 0x7f463406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.679+0000 7f462ffff640 1 -- 172.21.15.19:0/3632563091 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f463c08ace0 con 0x7f46480b9f20 2024-09-12T01:56:45.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.679+0000 7f46477fe640 1 --2- 172.21.15.19:0/3632563091 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f463406be30 0x7f463406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.680+0000 7f46477fe640 1 --2- 172.21.15.19:0/3632563091 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f463406be30 0x7f463406e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4638032000 tx=0x7f4638008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:45.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.683+0000 7f462ffff640 1 -- 172.21.15.19:0/3632563091 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46480cc7d0 con 0x7f46480b9f20 2024-09-12T01:56:45.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.860+0000 7f464df86640 1 -- 172.21.15.19:0/3632563091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f46480ce640 con 0x7f46480b9f20 2024-09-12T01:56:45.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.860+0000 7f462ffff640 1 -- 172.21.15.19:0/3632563091 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) ==== 84+0+65 (secure 0 0 0) 0x7f463c021020 con 0x7f46480b9f20 2024-09-12T01:56:45.860 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:45.861 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-09-12T01:56:45.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:56:45.861 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-09-12T01:56:45.861 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-09-12T01:56:45.861 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:56:45.861 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-09-12T01:56:45.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.862+0000 7f464df86640 1 -- 172.21.15.19:0/3632563091 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f463406be30 msgr2=0x7f463406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.862+0000 7f464df86640 1 --2- 172.21.15.19:0/3632563091 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f463406be30 0x7f463406e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4638032000 tx=0x7f4638008030 comp rx=0 tx=0).stop 2024-09-12T01:56:45.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.862+0000 7f464df86640 1 -- 172.21.15.19:0/3632563091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46480b9f20 msgr2=0x7f4648153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.862+0000 7f464df86640 1 --2- 172.21.15.19:0/3632563091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46480b9f20 0x7f4648153590 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f463c00c960 tx=0x7f463c00ce20 comp rx=0 tx=0).stop 2024-09-12T01:56:45.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.862+0000 7f464df86640 1 -- 172.21.15.19:0/3632563091 shutdown_connections 2024-09-12T01:56:45.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.862+0000 7f464df86640 1 --2- 172.21.15.19:0/3632563091 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f463406be30 0x7f463406e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.862+0000 7f464df86640 1 --2- 172.21.15.19:0/3632563091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46480b7380 0x7f46480cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.862+0000 7f464df86640 1 --2- 172.21.15.19:0/3632563091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46480b9f20 0x7f4648153590 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.862+0000 7f464df86640 1 --2- 172.21.15.19:0/3632563091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46300039b0 0x7f46480ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.862+0000 7f464df86640 1 -- 172.21.15.19:0/3632563091 >> 172.21.15.19:0/3632563091 conn(0x7f464808bfc0 msgr2=0x7f46480d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:45.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.862+0000 7f464df86640 1 -- 172.21.15.19:0/3632563091 shutdown_connections 2024-09-12T01:56:45.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.862+0000 7f464df86640 1 -- 172.21.15.19:0/3632563091 wait complete. 2024-09-12T01:56:45.873 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:56:45.874 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:56:45.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.979+0000 7f0fc147b640 1 Processor -- start 2024-09-12T01:56:45.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.979+0000 7f0fc147b640 1 -- start start 2024-09-12T01:56:45.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.980+0000 7f0fc147b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0fbc15c490 0x7f0fbc09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.980+0000 7f0fc147b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fbc072180 con 0x7f0fbc071100 2024-09-12T01:56:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.980+0000 7f0fc147b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fbc15c870 con 0x7f0fbc09af70 2024-09-12T01:56:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.980+0000 7f0fc147b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0fbc09b3b0 con 0x7f0fbc15c490 2024-09-12T01:56:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.980+0000 7f0fbb7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0fbc071100 0x7f0fbc0b0bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58670/0 (socket says 172.21.15.19:58670) 2024-09-12T01:56:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.980+0000 7f0fbb7fe640 1 -- 172.21.15.19:0/3211949187 learned_addr learned my addr 172.21.15.19:0/3211949187 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fbaffd640 1 --2- 172.21.15.19:0/3211949187 >> v2:172.21.15.135:3300/0 conn(0x7f0fbc15c490 0x7f0fbc09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fb9ffb640 1 -- 172.21.15.19:0/3211949187 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3629913818 0 0) 0x7f0fbc072180 con 0x7f0fbc071100 2024-09-12T01:56:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fb9ffb640 1 -- 172.21.15.19:0/3211949187 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fa8003520 con 0x7f0fbc071100 2024-09-12T01:56:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fb9ffb640 1 -- 172.21.15.19:0/3211949187 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3095897431 0 0) 0x7f0fa8003520 con 0x7f0fbc071100 2024-09-12T01:56:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fb9ffb640 1 -- 172.21.15.19:0/3211949187 >> v2:172.21.15.135:3300/0 conn(0x7f0fbc15c490 msgr2=0x7f0fbc09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fb9ffb640 1 --2- 172.21.15.19:0/3211949187 >> v2:172.21.15.135:3300/0 conn(0x7f0fbc15c490 0x7f0fbc09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fb9ffb640 1 -- 172.21.15.19:0/3211949187 >> v1:172.21.15.135:6789/0 conn(0x7f0fbc09af70 legacy=0x7f0fbc0b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fb9ffb640 1 -- 172.21.15.19:0/3211949187 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc071bc0 con 0x7f0fbc071100 2024-09-12T01:56:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fb9ffb640 1 -- 172.21.15.19:0/3211949187 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f0fb4001670 con 0x7f0fbc071100 2024-09-12T01:56:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fb9ffb640 1 -- 172.21.15.19:0/3211949187 >> v1:172.21.15.19:6789/0 conn(0x7f0fbc071100 legacy=0x7f0fbc0b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fb9ffb640 1 --2- 172.21.15.19:0/3211949187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fa80039b0 0x7f0fa8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fb9ffb640 1 --2- 172.21.15.19:0/3211949187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fa80043b0 0x7f0fa8004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fb9ffb640 1 --2- 172.21.15.19:0/3211949187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fa8005080 0x7f0fa800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fb9ffb640 1 -- 172.21.15.19:0/3211949187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc09b3b0 con 0x7f0fa80043b0 2024-09-12T01:56:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fb9ffb640 1 -- 172.21.15.19:0/3211949187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa800bfe0 con 0x7f0fa8005080 2024-09-12T01:56:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fb9ffb640 1 -- 172.21.15.19:0/3211949187 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa800c1e0 con 0x7f0fa80039b0 2024-09-12T01:56:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fba7fc640 1 --2- 172.21.15.19:0/3211949187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fa80043b0 0x7f0fa8004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fbaffd640 1 --2- 172.21.15.19:0/3211949187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fa80039b0 0x7f0fa8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fbb7fe640 1 --2- 172.21.15.19:0/3211949187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fa8005080 0x7f0fa800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fba7fc640 1 -- 172.21.15.19:0/3211949187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fa80039b0 msgr2=0x7f0fa8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fba7fc640 1 --2- 172.21.15.19:0/3211949187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fa80039b0 0x7f0fa8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fba7fc640 1 -- 172.21.15.19:0/3211949187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fa8005080 msgr2=0x7f0fa800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:45.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fba7fc640 1 --2- 172.21.15.19:0/3211949187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fa8005080 0x7f0fa800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fba7fc640 1 -- 172.21.15.19:0/3211949187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa8003520 con 0x7f0fa80043b0 2024-09-12T01:56:45.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.981+0000 7f0fbb7fe640 1 -- 172.21.15.19:0/3211949187 reap_dead start 2024-09-12T01:56:45.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.982+0000 7f0fba7fc640 1 --2- 172.21.15.19:0/3211949187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fa80043b0 0x7f0fa8004880 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4001910 tx=0x7f0fa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1367b55fae9df0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:45.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.982+0000 7f0fb9ffb640 1 -- 172.21.15.19:0/3211949187 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4037070 con 0x7f0fa80043b0 2024-09-12T01:56:45.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.982+0000 7f0fb9ffb640 1 -- 172.21.15.19:0/3211949187 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa402ac60 con 0x7f0fa80043b0 2024-09-12T01:56:45.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.982+0000 7f0fb9ffb640 1 -- 172.21.15.19:0/3211949187 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40014e0 con 0x7f0fa80043b0 2024-09-12T01:56:45.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.983+0000 7f0fc147b640 1 -- 172.21.15.19:0/3211949187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fa80043b0 msgr2=0x7f0fa8004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.983+0000 7f0fc147b640 1 --2- 172.21.15.19:0/3211949187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fa80043b0 0x7f0fa8004880 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4001910 tx=0x7f0fa8005830 comp rx=0 tx=0).stop 2024-09-12T01:56:45.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.983+0000 7f0fc147b640 1 -- 172.21.15.19:0/3211949187 shutdown_connections 2024-09-12T01:56:45.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.983+0000 7f0fc147b640 1 --2- 172.21.15.19:0/3211949187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fa80043b0 0x7f0fa8004880 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.983+0000 7f0fc147b640 1 -- 172.21.15.19:0/3211949187 >> 172.21.15.19:0/3211949187 conn(0x7f0fbc0b3f30 msgr2=0x7f0fbc0b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.983+0000 7f0fc147b640 1 -- 172.21.15.19:0/3211949187 shutdown_connections 2024-09-12T01:56:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.983+0000 7f0fc147b640 1 -- 172.21.15.19:0/3211949187 wait complete. 2024-09-12T01:56:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.984+0000 7f0fc147b640 1 Processor -- start 2024-09-12T01:56:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.984+0000 7f0fc147b640 1 -- start start 2024-09-12T01:56:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.985+0000 7f0fc147b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fa80043b0 0x7f0fbc14d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.985+0000 7f0fc147b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fbc15ec80 0x7f0fbc148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.985+0000 7f0fc147b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fbc0b5d20 0x7f0fbc0b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.985+0000 7f0fc147b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc0affa0 con 0x7f0fbc15ec80 2024-09-12T01:56:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.985+0000 7f0fc147b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc0afcc0 con 0x7f0fa80043b0 2024-09-12T01:56:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.985+0000 7f0fc147b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0fbc09b8f0 con 0x7f0fbc0b5d20 2024-09-12T01:56:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.985+0000 7f0fba7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fbc15ec80 0x7f0fbc148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.985+0000 7f0fba7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fbc15ec80 0x7f0fbc148120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39996/0 (socket says 172.21.15.19:39996) 2024-09-12T01:56:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.985+0000 7f0fba7fc640 1 -- 172.21.15.19:0/578709141 learned_addr learned my addr 172.21.15.19:0/578709141 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:45.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.985+0000 7f0fbaffd640 1 --2- 172.21.15.19:0/578709141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fa80043b0 0x7f0fbc14d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.985+0000 7f0fbb7fe640 1 --2- 172.21.15.19:0/578709141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fbc0b5d20 0x7f0fbc0b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.986+0000 7f0fba7fc640 1 -- 172.21.15.19:0/578709141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fbc0b5d20 msgr2=0x7f0fbc0b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.986+0000 7f0fba7fc640 1 --2- 172.21.15.19:0/578709141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fbc0b5d20 0x7f0fbc0b61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.986+0000 7f0fba7fc640 1 -- 172.21.15.19:0/578709141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fa80043b0 msgr2=0x7f0fbc14d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.986+0000 7f0fba7fc640 1 --2- 172.21.15.19:0/578709141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fa80043b0 0x7f0fbc14d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.986+0000 7f0fba7fc640 1 -- 172.21.15.19:0/578709141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc14da10 con 0x7f0fbc15ec80 2024-09-12T01:56:45.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.986+0000 7f0fbb7fe640 1 --2- 172.21.15.19:0/578709141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fbc0b5d20 0x7f0fbc0b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:45.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.986+0000 7f0fba7fc640 1 --2- 172.21.15.19:0/578709141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fbc15ec80 0x7f0fbc148120 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4001910 tx=0x7f0fa40012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:45.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.986+0000 7f0fb37fe640 1 -- 172.21.15.19:0/578709141 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4037050 con 0x7f0fbc15ec80 2024-09-12T01:56:45.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.986+0000 7f0fb37fe640 1 -- 172.21.15.19:0/578709141 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa4043070 con 0x7f0fbc15ec80 2024-09-12T01:56:45.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.986+0000 7f0fc147b640 1 -- 172.21.15.19:0/578709141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fbc14dcf0 con 0x7f0fbc15ec80 2024-09-12T01:56:45.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.986+0000 7f0fb37fe640 1 -- 172.21.15.19:0/578709141 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4007a70 con 0x7f0fbc15ec80 2024-09-12T01:56:45.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.986+0000 7f0fc147b640 1 -- 172.21.15.19:0/578709141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fbc14e2b0 con 0x7f0fbc15ec80 2024-09-12T01:56:45.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.987+0000 7f0fc147b640 1 -- 172.21.15.19:0/578709141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fbc068dc0 con 0x7f0fbc15ec80 2024-09-12T01:56:45.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.987+0000 7f0fb37fe640 1 -- 172.21.15.19:0/578709141 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0fa4048460 con 0x7f0fbc15ec80 2024-09-12T01:56:45.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.988+0000 7f0fb37fe640 1 --2- 172.21.15.19:0/578709141 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0f9c06be60 0x7f0f9c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.988+0000 7f0fb37fe640 1 -- 172.21.15.19:0/578709141 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f0fa40ab550 con 0x7f0fbc15ec80 2024-09-12T01:56:45.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.988+0000 7f0fbaffd640 1 --2- 172.21.15.19:0/578709141 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0f9c06be60 0x7f0f9c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.989+0000 7f0fbaffd640 1 --2- 172.21.15.19:0/578709141 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0f9c06be60 0x7f0f9c06e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc1596e0 tx=0x7f0fac00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:45.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:45.992+0000 7f0fb37fe640 1 -- 172.21.15.19:0/578709141 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0fa4079a70 con 0x7f0fbc15ec80 2024-09-12T01:56:46.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:46.169+0000 7f0fc147b640 1 -- 172.21.15.19:0/578709141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0fbc0b5880 con 0x7f0fbc15ec80 2024-09-12T01:56:47.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.059+0000 7f0fb37fe640 1 -- 172.21.15.19:0/578709141 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) ==== 138+0+0 (secure 0 0 0) 0x7f0fa407dd70 con 0x7f0fbc15ec80 2024-09-12T01:56:47.060 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-09-12T01:56:47.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.063+0000 7f0fc147b640 1 -- 172.21.15.19:0/578709141 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0f9c06be60 msgr2=0x7f0f9c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:47.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.063+0000 7f0fc147b640 1 --2- 172.21.15.19:0/578709141 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0f9c06be60 0x7f0f9c06e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc1596e0 tx=0x7f0fac00b040 comp rx=0 tx=0).stop 2024-09-12T01:56:47.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.063+0000 7f0fc147b640 1 -- 172.21.15.19:0/578709141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fbc15ec80 msgr2=0x7f0fbc148120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:47.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.063+0000 7f0fc147b640 1 --2- 172.21.15.19:0/578709141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fbc15ec80 0x7f0fbc148120 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4001910 tx=0x7f0fa40012b0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.063+0000 7f0fc147b640 1 -- 172.21.15.19:0/578709141 shutdown_connections 2024-09-12T01:56:47.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.063+0000 7f0fc147b640 1 --2- 172.21.15.19:0/578709141 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0f9c06be60 0x7f0f9c06e320 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc1596e0 tx=0x7f0fac00b040 comp rx=0 tx=0).stop 2024-09-12T01:56:47.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.063+0000 7f0fc147b640 1 --2- 172.21.15.19:0/578709141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fbc0b5d20 0x7f0fbc0b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.063+0000 7f0fc147b640 1 --2- 172.21.15.19:0/578709141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fbc15ec80 0x7f0fbc148120 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.063+0000 7f0fc147b640 1 --2- 172.21.15.19:0/578709141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fa80043b0 0x7f0fbc14d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.063+0000 7f0fc147b640 1 -- 172.21.15.19:0/578709141 >> 172.21.15.19:0/578709141 conn(0x7f0fbc0b3f30 msgr2=0x7f0fbc0b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:47.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.063+0000 7f0fc147b640 1 -- 172.21.15.19:0/578709141 shutdown_connections 2024-09-12T01:56:47.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.063+0000 7f0fc147b640 1 -- 172.21.15.19:0/578709141 wait complete. 2024-09-12T01:56:47.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:56:47.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.198+0000 7f7640fb7640 1 Processor -- start 2024-09-12T01:56:47.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.198+0000 7f7640fb7640 1 -- start start 2024-09-12T01:56:47.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.199+0000 7f7640fb7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f763c161a20 0x7f763c0d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.199+0000 7f7640fb7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f763c0d1420 0x7f763c0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.199+0000 7f7640fb7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f763c06e820 con 0x7f763c0cf160 2024-09-12T01:56:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.199+0000 7f7640fb7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f763c161e00 con 0x7f763c161a20 2024-09-12T01:56:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.199+0000 7f7640fb7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f763c0d1830 con 0x7f763c0d1420 2024-09-12T01:56:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.199+0000 7f763a59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f763c161a20 0x7f763c0d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.199+0000 7f763ad9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f763c0cf160 0x7f763c0b5f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58680/0 (socket says 172.21.15.19:58680) 2024-09-12T01:56:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.199+0000 7f763ad9d640 1 -- 172.21.15.19:0/3169635266 learned_addr learned my addr 172.21.15.19:0/3169635266 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.199+0000 7f7639d9b640 1 --2- 172.21.15.19:0/3169635266 >> v2:172.21.15.135:3300/0 conn(0x7f763c0d1420 0x7f763c0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.199+0000 7f763a59c640 1 -- 172.21.15.19:0/3169635266 >> v2:172.21.15.135:3300/0 conn(0x7f763c0d1420 msgr2=0x7f763c0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.199+0000 7f763a59c640 1 --2- 172.21.15.19:0/3169635266 >> v2:172.21.15.135:3300/0 conn(0x7f763c0d1420 0x7f763c0cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.199+0000 7f763a59c640 1 -- 172.21.15.19:0/3169635266 >> v1:172.21.15.19:6789/0 conn(0x7f763c0cf160 legacy=0x7f763c0b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:47.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.199+0000 7f763959a640 1 -- 172.21.15.19:0/3169635266 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2646226462 0 0) 0x7f763c06e820 con 0x7f763c0cf160 2024-09-12T01:56:47.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.199+0000 7f763a59c640 1 -- 172.21.15.19:0/3169635266 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f763c0cf980 con 0x7f763c161a20 2024-09-12T01:56:47.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.200+0000 7f763a59c640 1 --2- 172.21.15.19:0/3169635266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f763c161a20 0x7f763c0d0ee0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f763c06c7d0 tx=0x7f762c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6320f4db04d4863b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:47.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.200+0000 7f763959a640 1 -- 172.21.15.19:0/3169635266 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762c007740 con 0x7f763c161a20 2024-09-12T01:56:47.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.200+0000 7f763959a640 1 -- 172.21.15.19:0/3169635266 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f762c0078e0 con 0x7f763c161a20 2024-09-12T01:56:47.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.200+0000 7f763959a640 1 -- 172.21.15.19:0/3169635266 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762c007cb0 con 0x7f763c161a20 2024-09-12T01:56:47.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.201+0000 7f7640fb7640 1 -- 172.21.15.19:0/3169635266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f763c161a20 msgr2=0x7f763c0d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:47.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.201+0000 7f7640fb7640 1 --2- 172.21.15.19:0/3169635266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f763c161a20 0x7f763c0d0ee0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f763c06c7d0 tx=0x7f762c02a680 comp rx=0 tx=0).stop 2024-09-12T01:56:47.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.201+0000 7f7640fb7640 1 -- 172.21.15.19:0/3169635266 shutdown_connections 2024-09-12T01:56:47.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.201+0000 7f7640fb7640 1 --2- 172.21.15.19:0/3169635266 >> v2:172.21.15.135:3300/0 conn(0x7f763c0d1420 0x7f763c0cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.201+0000 7f7640fb7640 1 --2- 172.21.15.19:0/3169635266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f763c161a20 0x7f763c0d0ee0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.201+0000 7f7640fb7640 1 -- 172.21.15.19:0/3169635266 >> 172.21.15.19:0/3169635266 conn(0x7f763c09d850 msgr2=0x7f763c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:47.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.201+0000 7f7640fb7640 1 -- 172.21.15.19:0/3169635266 shutdown_connections 2024-09-12T01:56:47.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.201+0000 7f7640fb7640 1 -- 172.21.15.19:0/3169635266 wait complete. 2024-09-12T01:56:47.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.202+0000 7f7640fb7640 1 Processor -- start 2024-09-12T01:56:47.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.202+0000 7f7640fb7640 1 -- start start 2024-09-12T01:56:47.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.203+0000 7f7640fb7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f763c0cf160 0x7f763c0b8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.203+0000 7f7640fb7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f763c0d1420 0x7f763c0b8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.203+0000 7f7640fb7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f763c161a20 0x7f763c1f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.203+0000 7f7640fb7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f763c0cff00 con 0x7f763c161a20 2024-09-12T01:56:47.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.203+0000 7f7640fb7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f763c06d050 con 0x7f763c0cf160 2024-09-12T01:56:47.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.203+0000 7f7640fb7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f763c06d2f0 con 0x7f763c0d1420 2024-09-12T01:56:47.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.203+0000 7f763ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f763c161a20 0x7f763c1f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.203+0000 7f763ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f763c161a20 0x7f763c1f3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40008/0 (socket says 172.21.15.19:40008) 2024-09-12T01:56:47.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.203+0000 7f763ad9d640 1 -- 172.21.15.19:0/2351518872 learned_addr learned my addr 172.21.15.19:0/2351518872 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:47.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.203+0000 7f763a59c640 1 --2- 172.21.15.19:0/2351518872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f763c0cf160 0x7f763c0b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.203+0000 7f7639d9b640 1 --2- 172.21.15.19:0/2351518872 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f763c0d1420 0x7f763c0b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.203+0000 7f763ad9d640 1 -- 172.21.15.19:0/2351518872 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f763c0d1420 msgr2=0x7f763c0b8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:47.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.204+0000 7f763ad9d640 1 --2- 172.21.15.19:0/2351518872 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f763c0d1420 0x7f763c0b8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.204+0000 7f763ad9d640 1 -- 172.21.15.19:0/2351518872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f763c0cf160 msgr2=0x7f763c0b8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:47.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.204+0000 7f763ad9d640 1 --2- 172.21.15.19:0/2351518872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f763c0cf160 0x7f763c0b8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.204+0000 7f763ad9d640 1 -- 172.21.15.19:0/2351518872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f763c0b8cc0 con 0x7f763c161a20 2024-09-12T01:56:47.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.204+0000 7f763ad9d640 1 --2- 172.21.15.19:0/2351518872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f763c161a20 0x7f763c1f3e90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f763400c450 tx=0x7f763400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:47.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.204+0000 7f7632ffd640 1 -- 172.21.15.19:0/2351518872 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76340074e0 con 0x7f763c161a20 2024-09-12T01:56:47.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.204+0000 7f7632ffd640 1 -- 172.21.15.19:0/2351518872 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76340047e0 con 0x7f763c161a20 2024-09-12T01:56:47.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.204+0000 7f7640fb7640 1 -- 172.21.15.19:0/2351518872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f763c1f5120 con 0x7f763c161a20 2024-09-12T01:56:47.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.204+0000 7f7632ffd640 1 -- 172.21.15.19:0/2351518872 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7634004bd0 con 0x7f763c161a20 2024-09-12T01:56:47.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.204+0000 7f7640fb7640 1 -- 172.21.15.19:0/2351518872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f763c1f59c0 con 0x7f763c161a20 2024-09-12T01:56:47.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.205+0000 7f7640fb7640 1 -- 172.21.15.19:0/2351518872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f763c1f5bc0 con 0x7f763c161a20 2024-09-12T01:56:47.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.206+0000 7f7632ffd640 1 -- 172.21.15.19:0/2351518872 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7634011070 con 0x7f763c161a20 2024-09-12T01:56:47.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.206+0000 7f7632ffd640 1 --2- 172.21.15.19:0/2351518872 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f761c06be30 0x7f761c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.206+0000 7f7632ffd640 1 -- 172.21.15.19:0/2351518872 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5619+0+0 (secure 0 0 0) 0x7f763408a8a0 con 0x7f763c161a20 2024-09-12T01:56:47.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.207+0000 7f763a59c640 1 --2- 172.21.15.19:0/2351518872 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f761c06be30 0x7f761c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.207+0000 7f763a59c640 1 --2- 172.21.15.19:0/2351518872 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f761c06be30 0x7f761c06e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f762c034000 tx=0x7f762c02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:47.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.211+0000 7f7632ffd640 1 -- 172.21.15.19:0/2351518872 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f763c1f5bc0 con 0x7f763c161a20 2024-09-12T01:56:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:47.385+0000 7f7640fb7640 1 -- 172.21.15.19:0/2351518872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f763c0b3a70 con 0x7f763c161a20 2024-09-12T01:56:48.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.062+0000 7f7632ffd640 1 -- 172.21.15.19:0/2351518872 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) ==== 170+0+0 (secure 0 0 0) 0x7f7634058c40 con 0x7f763c161a20 2024-09-12T01:56:48.063 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-09-12T01:56:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.069+0000 7f7640fb7640 1 -- 172.21.15.19:0/2351518872 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f761c06be30 msgr2=0x7f761c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.069+0000 7f7640fb7640 1 --2- 172.21.15.19:0/2351518872 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f761c06be30 0x7f761c06e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f762c034000 tx=0x7f762c02f000 comp rx=0 tx=0).stop 2024-09-12T01:56:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.069+0000 7f7640fb7640 1 -- 172.21.15.19:0/2351518872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f763c161a20 msgr2=0x7f763c1f3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.069+0000 7f7640fb7640 1 --2- 172.21.15.19:0/2351518872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f763c161a20 0x7f763c1f3e90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f763400c450 tx=0x7f763400c910 comp rx=0 tx=0).stop 2024-09-12T01:56:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.069+0000 7f7640fb7640 1 -- 172.21.15.19:0/2351518872 shutdown_connections 2024-09-12T01:56:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.069+0000 7f7640fb7640 1 --2- 172.21.15.19:0/2351518872 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f761c06be30 0x7f761c06e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.069+0000 7f7640fb7640 1 --2- 172.21.15.19:0/2351518872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f763c161a20 0x7f763c1f3e90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.069+0000 7f7640fb7640 1 --2- 172.21.15.19:0/2351518872 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f763c0d1420 0x7f763c0b8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.069+0000 7f7640fb7640 1 --2- 172.21.15.19:0/2351518872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f763c0cf160 0x7f763c0b8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.069+0000 7f7640fb7640 1 -- 172.21.15.19:0/2351518872 >> 172.21.15.19:0/2351518872 conn(0x7f763c09d850 msgr2=0x7f763c06e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:48.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.075+0000 7f7640fb7640 1 -- 172.21.15.19:0/2351518872 shutdown_connections 2024-09-12T01:56:48.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.075+0000 7f7640fb7640 1 -- 172.21.15.19:0/2351518872 wait complete. 2024-09-12T01:56:48.096 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:56:48.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.207+0000 7f954abc6640 1 Processor -- start 2024-09-12T01:56:48.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.207+0000 7f954abc6640 1 -- start start 2024-09-12T01:56:48.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.208+0000 7f954abc6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9544156740 0x7f95440b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:48.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.208+0000 7f954abc6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95440b4af0 0x7f95440cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:48.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.208+0000 7f954abc6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95440b30e0 con 0x7f95440cfcd0 2024-09-12T01:56:48.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.208+0000 7f954abc6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f954406edc0 con 0x7f9544156740 2024-09-12T01:56:48.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.208+0000 7f954abc6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f95440b33c0 con 0x7f95440b4af0 2024-09-12T01:56:48.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.208+0000 7f9548962640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9544156740 0x7f95440b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:48.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.208+0000 7f9543fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95440b4af0 0x7f95440cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:48.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.208+0000 7f9548962640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9544156740 0x7f95440b45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:59686/0 (socket says 172.21.15.19:59686) 2024-09-12T01:56:48.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.208+0000 7f9543fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95440b4af0 0x7f95440cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:54748/0 (socket says 172.21.15.19:54748) 2024-09-12T01:56:48.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.208+0000 7f9549163640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f95440cfcd0 0x7f954415fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:33534/0 (socket says 172.21.15.19:33534) 2024-09-12T01:56:48.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.208+0000 7f9548962640 1 -- 172.21.15.19:0/1352779225 learned_addr learned my addr 172.21.15.19:0/1352779225 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:48.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.208+0000 7f9543fff640 1 -- 172.21.15.19:0/1352779225 >> v2:172.21.15.135:3300/0 conn(0x7f9544156740 msgr2=0x7f95440b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.208+0000 7f9543fff640 1 --2- 172.21.15.19:0/1352779225 >> v2:172.21.15.135:3300/0 conn(0x7f9544156740 0x7f95440b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.208+0000 7f9543fff640 1 -- 172.21.15.19:0/1352779225 >> v1:172.21.15.135:6789/0 conn(0x7f95440cfcd0 legacy=0x7f954415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.208+0000 7f95437fe640 1 -- 172.21.15.19:0/1352779225 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1968187352 0 0) 0x7f95440b30e0 con 0x7f95440cfcd0 2024-09-12T01:56:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.208+0000 7f9543fff640 1 -- 172.21.15.19:0/1352779225 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95440b36a0 con 0x7f95440b4af0 2024-09-12T01:56:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.208+0000 7f9548962640 1 --2- 172.21.15.19:0/1352779225 >> v2:172.21.15.135:3300/0 conn(0x7f9544156740 0x7f95440b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.209+0000 7f9543fff640 1 --2- 172.21.15.19:0/1352779225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95440b4af0 0x7f95440cf790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f95340097a0 tx=0x7f953402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80ca04181a7fc696 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.209+0000 7f95437fe640 1 -- 172.21.15.19:0/1352779225 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9534037070 con 0x7f95440b4af0 2024-09-12T01:56:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.209+0000 7f95437fe640 1 -- 172.21.15.19:0/1352779225 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9534032440 con 0x7f95440b4af0 2024-09-12T01:56:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.209+0000 7f95437fe640 1 -- 172.21.15.19:0/1352779225 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9534032810 con 0x7f95440b4af0 2024-09-12T01:56:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.210+0000 7f954abc6640 1 -- 172.21.15.19:0/1352779225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95440b4af0 msgr2=0x7f95440cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.210+0000 7f954abc6640 1 --2- 172.21.15.19:0/1352779225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95440b4af0 0x7f95440cf790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f95340097a0 tx=0x7f953402a180 comp rx=0 tx=0).stop 2024-09-12T01:56:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.210+0000 7f954abc6640 1 -- 172.21.15.19:0/1352779225 shutdown_connections 2024-09-12T01:56:48.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.210+0000 7f954abc6640 1 --2- 172.21.15.19:0/1352779225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95440b4af0 0x7f95440cf790 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:48.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.210+0000 7f954abc6640 1 --2- 172.21.15.19:0/1352779225 >> v2:172.21.15.135:3300/0 conn(0x7f9544156740 0x7f95440b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:48.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.210+0000 7f954abc6640 1 -- 172.21.15.19:0/1352779225 >> 172.21.15.19:0/1352779225 conn(0x7f954406bdf0 msgr2=0x7f954406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:48.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.210+0000 7f954abc6640 1 -- 172.21.15.19:0/1352779225 shutdown_connections 2024-09-12T01:56:48.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.210+0000 7f954abc6640 1 -- 172.21.15.19:0/1352779225 wait complete. 2024-09-12T01:56:48.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.211+0000 7f954abc6640 1 Processor -- start 2024-09-12T01:56:48.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.211+0000 7f954abc6640 1 -- start start 2024-09-12T01:56:48.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.212+0000 7f954abc6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95440b4af0 0x7f9544153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:48.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.212+0000 7f954abc6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95440cfcd0 0x7f954414dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:48.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.212+0000 7f954abc6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9544156740 0x7f95440affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:48.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.212+0000 7f954abc6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f95440d0890 con 0x7f95440cfcd0 2024-09-12T01:56:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.212+0000 7f954abc6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f95440b3c60 con 0x7f95440b4af0 2024-09-12T01:56:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.212+0000 7f954abc6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f95440d0a10 con 0x7f9544156740 2024-09-12T01:56:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.212+0000 7f9543fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95440cfcd0 0x7f954414dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.212+0000 7f9543fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95440cfcd0 0x7f954414dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40018/0 (socket says 172.21.15.19:40018) 2024-09-12T01:56:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.212+0000 7f9543fff640 1 -- 172.21.15.19:0/3503062121 learned_addr learned my addr 172.21.15.19:0/3503062121 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.212+0000 7f9548962640 1 --2- 172.21.15.19:0/3503062121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95440b4af0 0x7f9544153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.212+0000 7f9549163640 1 --2- 172.21.15.19:0/3503062121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9544156740 0x7f95440affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.213+0000 7f9543fff640 1 -- 172.21.15.19:0/3503062121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9544156740 msgr2=0x7f95440affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.213+0000 7f9543fff640 1 --2- 172.21.15.19:0/3503062121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9544156740 0x7f95440affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.213+0000 7f9543fff640 1 -- 172.21.15.19:0/3503062121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95440b4af0 msgr2=0x7f9544153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.213+0000 7f9543fff640 1 --2- 172.21.15.19:0/3503062121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95440b4af0 0x7f9544153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.213+0000 7f9543fff640 1 -- 172.21.15.19:0/3503062121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9544155d10 con 0x7f95440cfcd0 2024-09-12T01:56:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.213+0000 7f9548962640 1 --2- 172.21.15.19:0/3503062121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95440b4af0 0x7f9544153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.213+0000 7f9543fff640 1 --2- 172.21.15.19:0/3503062121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95440cfcd0 0x7f954414dcb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f95340097a0 tx=0x7f95340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.213+0000 7f95417fa640 1 -- 172.21.15.19:0/3503062121 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9534037050 con 0x7f95440cfcd0 2024-09-12T01:56:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.213+0000 7f95417fa640 1 -- 172.21.15.19:0/3503062121 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9534038040 con 0x7f95440cfcd0 2024-09-12T01:56:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.213+0000 7f954abc6640 1 -- 172.21.15.19:0/3503062121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9544154410 con 0x7f95440cfcd0 2024-09-12T01:56:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.213+0000 7f95417fa640 1 -- 172.21.15.19:0/3503062121 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9534004490 con 0x7f95440cfcd0 2024-09-12T01:56:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.213+0000 7f954abc6640 1 -- 172.21.15.19:0/3503062121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95441549d0 con 0x7f95440cfcd0 2024-09-12T01:56:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.214+0000 7f954abc6640 1 -- 172.21.15.19:0/3503062121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9544154c10 con 0x7f95440cfcd0 2024-09-12T01:56:48.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.215+0000 7f95417fa640 1 -- 172.21.15.19:0/3503062121 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f953403c6d0 con 0x7f95440cfcd0 2024-09-12T01:56:48.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.215+0000 7f95417fa640 1 --2- 172.21.15.19:0/3503062121 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f952406be30 0x7f952406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:48.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.215+0000 7f95417fa640 1 -- 172.21.15.19:0/3503062121 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6001+0+0 (secure 0 0 0) 0x7f95340ab820 con 0x7f95440cfcd0 2024-09-12T01:56:48.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.215+0000 7f9548962640 1 --2- 172.21.15.19:0/3503062121 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f952406be30 0x7f952406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:48.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.216+0000 7f9548962640 1 --2- 172.21.15.19:0/3503062121 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f952406be30 0x7f952406e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f952c009630 tx=0x7f952c009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:48.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.219+0000 7f95417fa640 1 -- 172.21.15.19:0/3503062121 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9544154c10 con 0x7f95440cfcd0 2024-09-12T01:56:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:48.429+0000 7f954abc6640 1 -- 172.21.15.19:0/3503062121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9544156b20 con 0x7f95440cfcd0 2024-09-12T01:56:49.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.083+0000 7f95417fa640 1 -- 172.21.15.19:0/3503062121 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7f9534079a60 con 0x7f95440cfcd0 2024-09-12T01:56:49.084 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 5 and data pool 6 2024-09-12T01:56:49.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.098+0000 7f954abc6640 1 -- 172.21.15.19:0/3503062121 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f952406be30 msgr2=0x7f952406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.098+0000 7f954abc6640 1 --2- 172.21.15.19:0/3503062121 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f952406be30 0x7f952406e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f952c009630 tx=0x7f952c009240 comp rx=0 tx=0).stop 2024-09-12T01:56:49.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.098+0000 7f954abc6640 1 -- 172.21.15.19:0/3503062121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95440cfcd0 msgr2=0x7f954414dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.098+0000 7f954abc6640 1 --2- 172.21.15.19:0/3503062121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95440cfcd0 0x7f954414dcb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f95340097a0 tx=0x7f95340046c0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.100+0000 7f954abc6640 1 -- 172.21.15.19:0/3503062121 shutdown_connections 2024-09-12T01:56:49.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.100+0000 7f954abc6640 1 --2- 172.21.15.19:0/3503062121 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f952406be30 0x7f952406e2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.100+0000 7f954abc6640 1 --2- 172.21.15.19:0/3503062121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9544156740 0x7f95440affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.100+0000 7f954abc6640 1 --2- 172.21.15.19:0/3503062121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95440cfcd0 0x7f954414dcb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.100+0000 7f954abc6640 1 --2- 172.21.15.19:0/3503062121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95440b4af0 0x7f9544153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.100+0000 7f954abc6640 1 -- 172.21.15.19:0/3503062121 >> 172.21.15.19:0/3503062121 conn(0x7f954406bdf0 msgr2=0x7f95440ad020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:49.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.102+0000 7f954abc6640 1 -- 172.21.15.19:0/3503062121 shutdown_connections 2024-09-12T01:56:49.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.104+0000 7f954abc6640 1 -- 172.21.15.19:0/3503062121 wait complete. 2024-09-12T01:56:49.118 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:56:49.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.222+0000 7fe0b17e8640 1 Processor -- start 2024-09-12T01:56:49.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.222+0000 7fe0b17e8640 1 -- start start 2024-09-12T01:56:49.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.223+0000 7fe0b17e8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe0ac15c520 0x7fe0ac09b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.223+0000 7fe0b17e8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe0ac0b1620 0x7fe0ac0b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.223+0000 7fe0b17e8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0ac0d0980 0x7fe0ac0d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.223+0000 7fe0b17e8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fe0ac0d1310 con 0x7fe0ac15c520 2024-09-12T01:56:49.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.223+0000 7fe0b17e8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe0ac0cec00 con 0x7fe0ac0b1620 2024-09-12T01:56:49.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.223+0000 7fe0b17e8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe0ac09bd90 con 0x7fe0ac0d0980 2024-09-12T01:56:49.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.223+0000 7fe0aaffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe0ac15c520 0x7fe0ac09b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.223+0000 7fe0aaffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe0ac15c520 0x7fe0ac09b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40028/0 (socket says 172.21.15.19:40028) 2024-09-12T01:56:49.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.223+0000 7fe0aaffd640 1 -- 172.21.15.19:0/1986260836 learned_addr learned my addr 172.21.15.19:0/1986260836 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:49.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.223+0000 7fe0aa7fc640 1 --2- 172.21.15.19:0/1986260836 >> v2:172.21.15.135:3300/0 conn(0x7fe0ac0b1620 0x7fe0ac0b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.223+0000 7fe0ab7fe640 1 --2- 172.21.15.19:0/1986260836 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0ac0d0980 0x7fe0ac0d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.223+0000 7fe0aaffd640 1 -- 172.21.15.19:0/1986260836 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0ac0d0980 msgr2=0x7fe0ac0d0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:49.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.223+0000 7fe0aaffd640 1 --2- 172.21.15.19:0/1986260836 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0ac0d0980 0x7fe0ac0d0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.223+0000 7fe0aaffd640 1 -- 172.21.15.19:0/1986260836 >> v2:172.21.15.135:3300/0 conn(0x7fe0ac0b1620 msgr2=0x7fe0ac0b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:49.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.224+0000 7fe0aaffd640 1 --2- 172.21.15.19:0/1986260836 >> v2:172.21.15.135:3300/0 conn(0x7fe0ac0b1620 0x7fe0ac0b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.224+0000 7fe0aaffd640 1 -- 172.21.15.19:0/1986260836 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ac0d0010 con 0x7fe0ac15c520 2024-09-12T01:56:49.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.224+0000 7fe0aaffd640 1 --2- 172.21.15.19:0/1986260836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0ac15c520 0x7fe0ac09b720 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0733c0 tx=0x7fe09c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b1396aed9dc4bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:49.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.224+0000 7fe0a9ffb640 1 -- 172.21.15.19:0/1986260836 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09c037070 con 0x7fe0ac15c520 2024-09-12T01:56:49.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.224+0000 7fe0a9ffb640 1 -- 172.21.15.19:0/1986260836 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe09c032440 con 0x7fe0ac15c520 2024-09-12T01:56:49.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.224+0000 7fe0a9ffb640 1 -- 172.21.15.19:0/1986260836 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09c032810 con 0x7fe0ac15c520 2024-09-12T01:56:49.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.225+0000 7fe0b17e8640 1 -- 172.21.15.19:0/1986260836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0ac15c520 msgr2=0x7fe0ac09b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.225+0000 7fe0b17e8640 1 --2- 172.21.15.19:0/1986260836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0ac15c520 0x7fe0ac09b720 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0733c0 tx=0x7fe09c02a1e0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.225+0000 7fe0b17e8640 1 -- 172.21.15.19:0/1986260836 shutdown_connections 2024-09-12T01:56:49.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.225+0000 7fe0b17e8640 1 --2- 172.21.15.19:0/1986260836 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0ac0d0980 0x7fe0ac0d0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.225+0000 7fe0b17e8640 1 --2- 172.21.15.19:0/1986260836 >> v2:172.21.15.135:3300/0 conn(0x7fe0ac0b1620 0x7fe0ac0b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.225+0000 7fe0b17e8640 1 --2- 172.21.15.19:0/1986260836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0ac15c520 0x7fe0ac09b720 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.225+0000 7fe0b17e8640 1 -- 172.21.15.19:0/1986260836 >> 172.21.15.19:0/1986260836 conn(0x7fe0ac0d23a0 msgr2=0x7fe0ac0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:49.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.225+0000 7fe0b17e8640 1 -- 172.21.15.19:0/1986260836 shutdown_connections 2024-09-12T01:56:49.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.225+0000 7fe0b17e8640 1 -- 172.21.15.19:0/1986260836 wait complete. 2024-09-12T01:56:49.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.226+0000 7fe0b17e8640 1 Processor -- start 2024-09-12T01:56:49.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.226+0000 7fe0b17e8640 1 -- start start 2024-09-12T01:56:49.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.227+0000 7fe0b17e8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0ac0b1620 0x7fe0ac0cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.227+0000 7fe0b17e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0ac0d0980 0x7fe0ac0afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.227+0000 7fe0b17e8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0ac15c520 0x7fe0ac0c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.227+0000 7fe0b17e8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ac0d05d0 con 0x7fe0ac0d0980 2024-09-12T01:56:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.227+0000 7fe0b17e8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ac0cd050 con 0x7fe0ac0b1620 2024-09-12T01:56:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.227+0000 7fe0b17e8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe0ac15c900 con 0x7fe0ac15c520 2024-09-12T01:56:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.227+0000 7fe0aa7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0ac0d0980 0x7fe0ac0afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.227+0000 7fe0aa7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0ac0d0980 0x7fe0ac0afe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40030/0 (socket says 172.21.15.19:40030) 2024-09-12T01:56:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.227+0000 7fe0aa7fc640 1 -- 172.21.15.19:0/940480614 learned_addr learned my addr 172.21.15.19:0/940480614 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.227+0000 7fe0ab7fe640 1 --2- 172.21.15.19:0/940480614 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0ac15c520 0x7fe0ac0c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.227+0000 7fe0aaffd640 1 --2- 172.21.15.19:0/940480614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0ac0b1620 0x7fe0ac0cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.228+0000 7fe0aa7fc640 1 -- 172.21.15.19:0/940480614 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0ac15c520 msgr2=0x7fe0ac0c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.228+0000 7fe0aa7fc640 1 --2- 172.21.15.19:0/940480614 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0ac15c520 0x7fe0ac0c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.228+0000 7fe0aa7fc640 1 -- 172.21.15.19:0/940480614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0ac0b1620 msgr2=0x7fe0ac0cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.228+0000 7fe0aa7fc640 1 --2- 172.21.15.19:0/940480614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0ac0b1620 0x7fe0ac0cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.228+0000 7fe0aa7fc640 1 -- 172.21.15.19:0/940480614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ac1f4ff0 con 0x7fe0ac0d0980 2024-09-12T01:56:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.228+0000 7fe0ab7fe640 1 --2- 172.21.15.19:0/940480614 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0ac15c520 0x7fe0ac0c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:49.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.228+0000 7fe0aaffd640 1 --2- 172.21.15.19:0/940480614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0ac0b1620 0x7fe0ac0cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:49.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.228+0000 7fe0aa7fc640 1 --2- 172.21.15.19:0/940480614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0ac0d0980 0x7fe0ac0afe60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000e8c0 tx=0x7fe0a000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:49.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.228+0000 7fe0937fe640 1 -- 172.21.15.19:0/940480614 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0017070 con 0x7fe0ac0d0980 2024-09-12T01:56:49.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.228+0000 7fe0937fe640 1 -- 172.21.15.19:0/940480614 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a000c8e0 con 0x7fe0ac0d0980 2024-09-12T01:56:49.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.228+0000 7fe0b17e8640 1 -- 172.21.15.19:0/940480614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0ac1f52d0 con 0x7fe0ac0d0980 2024-09-12T01:56:49.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.228+0000 7fe0937fe640 1 -- 172.21.15.19:0/940480614 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a000ccb0 con 0x7fe0ac0d0980 2024-09-12T01:56:49.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.228+0000 7fe0b17e8640 1 -- 172.21.15.19:0/940480614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0ac1f5890 con 0x7fe0ac0d0980 2024-09-12T01:56:49.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.229+0000 7fe0b17e8640 1 -- 172.21.15.19:0/940480614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0ac0d31f0 con 0x7fe0ac0d0980 2024-09-12T01:56:49.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.230+0000 7fe0937fe640 1 -- 172.21.15.19:0/940480614 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe0a001a070 con 0x7fe0ac0d0980 2024-09-12T01:56:49.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.230+0000 7fe0937fe640 1 --2- 172.21.15.19:0/940480614 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe09806be30 0x7fe09806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.230+0000 7fe0937fe640 1 -- 172.21.15.19:0/940480614 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fe0a008b320 con 0x7fe0ac0d0980 2024-09-12T01:56:49.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.230+0000 7fe0aaffd640 1 --2- 172.21.15.19:0/940480614 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe09806be30 0x7fe09806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.231+0000 7fe0aaffd640 1 --2- 172.21.15.19:0/940480614 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe09806be30 0x7fe09806e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe09c034000 tx=0x7fe09c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:49.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.234+0000 7fe0937fe640 1 -- 172.21.15.19:0/940480614 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe0ac0d31f0 con 0x7fe0ac0d0980 2024-09-12T01:56:49.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.411+0000 7fe0b17e8640 1 -- 172.21.15.19:0/940480614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0ac15b130 con 0x7fe0ac0d0980 2024-09-12T01:56:49.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.413+0000 7fe0937fe640 1 -- 172.21.15.19:0/940480614 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17003 (secure 0 0 0) 0x7fe0ac15b130 con 0x7fe0ac0d0980 2024-09-12T01:56:49.413 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:49.413 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":39,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:56:48.431512+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:56:46.200850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T01:56:47.416374+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:49.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.415+0000 7fe0b17e8640 1 -- 172.21.15.19:0/940480614 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe09806be30 msgr2=0x7fe09806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.415+0000 7fe0b17e8640 1 --2- 172.21.15.19:0/940480614 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe09806be30 0x7fe09806e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe09c034000 tx=0x7fe09c02e000 comp rx=0 tx=0).stop 2024-09-12T01:56:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.415+0000 7fe0b17e8640 1 -- 172.21.15.19:0/940480614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0ac0d0980 msgr2=0x7fe0ac0afe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.415+0000 7fe0b17e8640 1 --2- 172.21.15.19:0/940480614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0ac0d0980 0x7fe0ac0afe60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000e8c0 tx=0x7fe0a000ed80 comp rx=0 tx=0).stop 2024-09-12T01:56:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.415+0000 7fe0b17e8640 1 -- 172.21.15.19:0/940480614 shutdown_connections 2024-09-12T01:56:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.415+0000 7fe0b17e8640 1 --2- 172.21.15.19:0/940480614 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe09806be30 0x7fe09806e2f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.415+0000 7fe0b17e8640 1 --2- 172.21.15.19:0/940480614 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0ac15c520 0x7fe0ac0c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.415+0000 7fe0b17e8640 1 --2- 172.21.15.19:0/940480614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0ac0d0980 0x7fe0ac0afe60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.415+0000 7fe0b17e8640 1 --2- 172.21.15.19:0/940480614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0ac0b1620 0x7fe0ac0cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.415+0000 7fe0b17e8640 1 -- 172.21.15.19:0/940480614 >> 172.21.15.19:0/940480614 conn(0x7fe0ac0d23a0 msgr2=0x7fe0ac15b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.415+0000 7fe0b17e8640 1 -- 172.21.15.19:0/940480614 shutdown_connections 2024-09-12T01:56:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.415+0000 7fe0b17e8640 1 -- 172.21.15.19:0/940480614 wait complete. 2024-09-12T01:56:49.427 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:56:49.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.528+0000 7f83ecfcf640 1 Processor -- start 2024-09-12T01:56:49.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.528+0000 7f83ecfcf640 1 -- start start 2024-09-12T01:56:49.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.529+0000 7f83ecfcf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83e815e5f0 0x7f83e80d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.529+0000 7f83ecfcf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f83e80d30f0 0x7f83e80b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.529+0000 7f83ecfcf640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83e80d3690 con 0x7f83e80b64c0 2024-09-12T01:56:49.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.529+0000 7f83ecfcf640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f83e806d530 con 0x7f83e80d30f0 2024-09-12T01:56:49.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.529+0000 7f83ecfcf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f83e80d3970 con 0x7f83e815e5f0 2024-09-12T01:56:49.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.529+0000 7f83e5d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f83e80d30f0 0x7f83e80b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.529+0000 7f83e5d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f83e80d30f0 0x7f83e80b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40046/0 (socket says 172.21.15.19:40046) 2024-09-12T01:56:49.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.529+0000 7f83e5d9b640 1 -- 172.21.15.19:0/2691972570 learned_addr learned my addr 172.21.15.19:0/2691972570 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:49.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.529+0000 7f83e5d9b640 1 -- 172.21.15.19:0/2691972570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83e815e5f0 msgr2=0x7f83e80d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:49.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.529+0000 7f83e659c640 1 --2- 172.21.15.19:0/2691972570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83e815e5f0 0x7f83e80d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.529+0000 7f83e5d9b640 1 --2- 172.21.15.19:0/2691972570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83e815e5f0 0x7f83e80d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.529+0000 7f83e5d9b640 1 -- 172.21.15.19:0/2691972570 >> v1:172.21.15.135:6789/0 conn(0x7f83e80b64c0 legacy=0x7f83e80cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:49.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.529+0000 7f83e5d9b640 1 -- 172.21.15.19:0/2691972570 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e806cee0 con 0x7f83e80d30f0 2024-09-12T01:56:49.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.530+0000 7f83e5d9b640 1 --2- 172.21.15.19:0/2691972570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83e80d30f0 0x7f83e80b5f80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f83d0009870 tx=0x7f83d002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe1b5aff73b6d7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:49.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.530+0000 7f83e559a640 1 -- 172.21.15.19:0/2691972570 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d0037070 con 0x7f83e80d30f0 2024-09-12T01:56:49.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.530+0000 7f83e559a640 1 -- 172.21.15.19:0/2691972570 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83d0032440 con 0x7f83e80d30f0 2024-09-12T01:56:49.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.530+0000 7f83e559a640 1 -- 172.21.15.19:0/2691972570 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d0032810 con 0x7f83e80d30f0 2024-09-12T01:56:49.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.531+0000 7f83ecfcf640 1 -- 172.21.15.19:0/2691972570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83e80d30f0 msgr2=0x7f83e80b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.531+0000 7f83ecfcf640 1 --2- 172.21.15.19:0/2691972570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83e80d30f0 0x7f83e80b5f80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f83d0009870 tx=0x7f83d002a210 comp rx=0 tx=0).stop 2024-09-12T01:56:49.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.531+0000 7f83ecfcf640 1 -- 172.21.15.19:0/2691972570 shutdown_connections 2024-09-12T01:56:49.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.531+0000 7f83ecfcf640 1 --2- 172.21.15.19:0/2691972570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83e80d30f0 0x7f83e80b5f80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.531+0000 7f83ecfcf640 1 --2- 172.21.15.19:0/2691972570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83e815e5f0 0x7f83e80d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.531+0000 7f83ecfcf640 1 -- 172.21.15.19:0/2691972570 >> 172.21.15.19:0/2691972570 conn(0x7f83e808bfc0 msgr2=0x7f83e80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:49.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.531+0000 7f83ecfcf640 1 -- 172.21.15.19:0/2691972570 shutdown_connections 2024-09-12T01:56:49.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.531+0000 7f83ecfcf640 1 -- 172.21.15.19:0/2691972570 wait complete. 2024-09-12T01:56:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.532+0000 7f83ecfcf640 1 Processor -- start 2024-09-12T01:56:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.532+0000 7f83ecfcf640 1 -- start start 2024-09-12T01:56:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.533+0000 7f83ecfcf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83e80b64c0 0x7f83e81619d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.533+0000 7f83ecfcf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83e80d30f0 0x7f83e81f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.533+0000 7f83ecfcf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83e815e5f0 0x7f83e81f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.533+0000 7f83ecfcf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f83e80d5310 con 0x7f83e815e5f0 2024-09-12T01:56:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.533+0000 7f83ecfcf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f83e815e9d0 con 0x7f83e80d30f0 2024-09-12T01:56:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.533+0000 7f83ecfcf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f83e806e9d0 con 0x7f83e80b64c0 2024-09-12T01:56:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.533+0000 7f83e6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83e815e5f0 0x7f83e81f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.533+0000 7f83e6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83e815e5f0 0x7f83e81f3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40056/0 (socket says 172.21.15.19:40056) 2024-09-12T01:56:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.533+0000 7f83e6d9d640 1 -- 172.21.15.19:0/1682302394 learned_addr learned my addr 172.21.15.19:0/1682302394 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.534+0000 7f83e659c640 1 --2- 172.21.15.19:0/1682302394 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83e80b64c0 0x7f83e81619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.534+0000 7f83e5d9b640 1 --2- 172.21.15.19:0/1682302394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83e80d30f0 0x7f83e81f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.534+0000 7f83e6d9d640 1 -- 172.21.15.19:0/1682302394 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83e80b64c0 msgr2=0x7f83e81619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.534+0000 7f83e6d9d640 1 --2- 172.21.15.19:0/1682302394 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83e80b64c0 0x7f83e81619d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.534+0000 7f83e6d9d640 1 -- 172.21.15.19:0/1682302394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83e80d30f0 msgr2=0x7f83e81f39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.534+0000 7f83e6d9d640 1 --2- 172.21.15.19:0/1682302394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83e80d30f0 0x7f83e81f39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.534+0000 7f83e6d9d640 1 -- 172.21.15.19:0/1682302394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e81f5070 con 0x7f83e815e5f0 2024-09-12T01:56:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.534+0000 7f83e659c640 1 --2- 172.21.15.19:0/1682302394 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83e80b64c0 0x7f83e81619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.534+0000 7f83e6d9d640 1 --2- 172.21.15.19:0/1682302394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83e815e5f0 0x7f83e81f3f10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f83e000c410 tx=0x7f83e000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.534+0000 7f83deffd640 1 -- 172.21.15.19:0/1682302394 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0011790 con 0x7f83e815e5f0 2024-09-12T01:56:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.534+0000 7f83deffd640 1 -- 172.21.15.19:0/1682302394 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e0017070 con 0x7f83e815e5f0 2024-09-12T01:56:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.534+0000 7f83ecfcf640 1 -- 172.21.15.19:0/1682302394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e81f44f0 con 0x7f83e815e5f0 2024-09-12T01:56:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.534+0000 7f83deffd640 1 -- 172.21.15.19:0/1682302394 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0011bb0 con 0x7f83e815e5f0 2024-09-12T01:56:49.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.534+0000 7f83ecfcf640 1 -- 172.21.15.19:0/1682302394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e81f4ab0 con 0x7f83e815e5f0 2024-09-12T01:56:49.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.535+0000 7f83ecfcf640 1 -- 172.21.15.19:0/1682302394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83e80b5f80 con 0x7f83e815e5f0 2024-09-12T01:56:49.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.536+0000 7f83deffd640 1 -- 172.21.15.19:0/1682302394 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83e001c460 con 0x7f83e815e5f0 2024-09-12T01:56:49.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.536+0000 7f83deffd640 1 --2- 172.21.15.19:0/1682302394 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f83c806be30 0x7f83c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.536+0000 7f83deffd640 1 -- 172.21.15.19:0/1682302394 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f83e008ac00 con 0x7f83e815e5f0 2024-09-12T01:56:49.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.536+0000 7f83e659c640 1 --2- 172.21.15.19:0/1682302394 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f83c806be30 0x7f83c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.537+0000 7f83e659c640 1 --2- 172.21.15.19:0/1682302394 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f83c806be30 0x7f83c806e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f83d8007eb0 tx=0x7f83d8007400 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:49.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.540+0000 7f83deffd640 1 -- 172.21.15.19:0/1682302394 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f83e0091080 con 0x7f83e815e5f0 2024-09-12T01:56:49.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.716+0000 7f83ecfcf640 1 -- 172.21.15.19:0/1682302394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83e806bda0 con 0x7f83e815e5f0 2024-09-12T01:56:49.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.717+0000 7f83deffd640 1 -- 172.21.15.19:0/1682302394 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17003 (secure 0 0 0) 0x7f83e0021020 con 0x7f83e815e5f0 2024-09-12T01:56:49.718 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:49.718 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":39,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:56:48.431512+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:56:46.200850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T01:56:47.416374+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.719+0000 7f83ecfcf640 1 -- 172.21.15.19:0/1682302394 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f83c806be30 msgr2=0x7f83c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.719+0000 7f83ecfcf640 1 --2- 172.21.15.19:0/1682302394 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f83c806be30 0x7f83c806e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f83d8007eb0 tx=0x7f83d8007400 comp rx=0 tx=0).stop 2024-09-12T01:56:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.719+0000 7f83ecfcf640 1 -- 172.21.15.19:0/1682302394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83e815e5f0 msgr2=0x7f83e81f3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.719+0000 7f83ecfcf640 1 --2- 172.21.15.19:0/1682302394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83e815e5f0 0x7f83e81f3f10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f83e000c410 tx=0x7f83e000c8d0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.719+0000 7f83ecfcf640 1 -- 172.21.15.19:0/1682302394 shutdown_connections 2024-09-12T01:56:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.719+0000 7f83ecfcf640 1 --2- 172.21.15.19:0/1682302394 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f83c806be30 0x7f83c806e2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.719+0000 7f83ecfcf640 1 --2- 172.21.15.19:0/1682302394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83e815e5f0 0x7f83e81f3f10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.719+0000 7f83ecfcf640 1 --2- 172.21.15.19:0/1682302394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83e80d30f0 0x7f83e81f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.719+0000 7f83ecfcf640 1 --2- 172.21.15.19:0/1682302394 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83e80b64c0 0x7f83e81619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.719+0000 7f83ecfcf640 1 -- 172.21.15.19:0/1682302394 >> 172.21.15.19:0/1682302394 conn(0x7f83e808bfc0 msgr2=0x7f83e80b4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.719+0000 7f83ecfcf640 1 -- 172.21.15.19:0/1682302394 shutdown_connections 2024-09-12T01:56:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.719+0000 7f83ecfcf640 1 -- 172.21.15.19:0/1682302394 wait complete. 2024-09-12T01:56:49.731 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:56:49.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.836+0000 7fde1eac0640 1 Processor -- start 2024-09-12T01:56:49.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.836+0000 7fde1eac0640 1 -- start start 2024-09-12T01:56:49.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.837+0000 7fde1eac0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1809b140 0x7fde180700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.837+0000 7fde1eac0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fde180b14d0 0x7fde18070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.837+0000 7fde1eac0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde18072180 con 0x7fde1815c490 2024-09-12T01:56:49.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.837+0000 7fde1eac0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fde1815c870 con 0x7fde180b14d0 2024-09-12T01:56:49.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.837+0000 7fde1eac0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fde18071bc0 con 0x7fde1809b140 2024-09-12T01:56:49.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.837+0000 7fde1d05d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fde180b14d0 0x7fde18070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.837+0000 7fde17fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1809b140 0x7fde180700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.837+0000 7fde1c85c640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fde1815c490 0x7fde1809aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:33544/0 (socket says 172.21.15.19:33544) 2024-09-12T01:56:49.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.837+0000 7fde1c85c640 1 -- 172.21.15.19:0/3875930601 learned_addr learned my addr 172.21.15.19:0/3875930601 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:49.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.837+0000 7fde1d05d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fde180b14d0 0x7fde18070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:59744/0 (socket says 172.21.15.19:59744) 2024-09-12T01:56:49.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.838+0000 7fde1d05d640 1 -- 172.21.15.19:0/3875930601 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1809b140 msgr2=0x7fde180700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:49.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.838+0000 7fde1d05d640 1 --2- 172.21.15.19:0/3875930601 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1809b140 0x7fde180700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.838+0000 7fde1d05d640 1 -- 172.21.15.19:0/3875930601 >> v1:172.21.15.135:6789/0 conn(0x7fde1815c490 legacy=0x7fde1809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.838+0000 7fde1d05d640 1 -- 172.21.15.19:0/3875930601 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde18071ea0 con 0x7fde180b14d0 2024-09-12T01:56:49.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.838+0000 7fde17fff640 1 --2- 172.21.15.19:0/3875930601 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1809b140 0x7fde180700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:49.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.838+0000 7fde1d05d640 1 --2- 172.21.15.19:0/3875930601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde180b14d0 0x7fde18070630 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fde10009d90 tx=0x7fde1002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f65bb57424609e5e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:49.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.839+0000 7fde177fe640 1 -- 172.21.15.19:0/3875930601 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde10007740 con 0x7fde180b14d0 2024-09-12T01:56:49.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.839+0000 7fde177fe640 1 -- 172.21.15.19:0/3875930601 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde100078e0 con 0x7fde180b14d0 2024-09-12T01:56:49.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.839+0000 7fde177fe640 1 -- 172.21.15.19:0/3875930601 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde10007cb0 con 0x7fde180b14d0 2024-09-12T01:56:49.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.839+0000 7fde1eac0640 1 -- 172.21.15.19:0/3875930601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde180b14d0 msgr2=0x7fde18070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.839+0000 7fde1eac0640 1 --2- 172.21.15.19:0/3875930601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde180b14d0 0x7fde18070630 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fde10009d90 tx=0x7fde1002a660 comp rx=0 tx=0).stop 2024-09-12T01:56:49.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.839+0000 7fde1eac0640 1 -- 172.21.15.19:0/3875930601 shutdown_connections 2024-09-12T01:56:49.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.839+0000 7fde1eac0640 1 --2- 172.21.15.19:0/3875930601 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1809b140 0x7fde180700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.839+0000 7fde1eac0640 1 --2- 172.21.15.19:0/3875930601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde180b14d0 0x7fde18070630 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.839+0000 7fde1eac0640 1 -- 172.21.15.19:0/3875930601 >> 172.21.15.19:0/3875930601 conn(0x7fde180b3f30 msgr2=0x7fde180b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:49.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.839+0000 7fde1eac0640 1 -- 172.21.15.19:0/3875930601 shutdown_connections 2024-09-12T01:56:49.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.839+0000 7fde1eac0640 1 -- 172.21.15.19:0/3875930601 wait complete. 2024-09-12T01:56:49.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.840+0000 7fde1eac0640 1 Processor -- start 2024-09-12T01:56:49.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.841+0000 7fde1eac0640 1 -- start start 2024-09-12T01:56:49.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.841+0000 7fde1eac0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1809b140 0x7fde181f41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.841+0000 7fde1eac0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde180b14d0 0x7fde18156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.841+0000 7fde1eac0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde1815c490 0x7fde1813e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.841+0000 7fde1eac0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fde1809b8f0 con 0x7fde180b14d0 2024-09-12T01:56:49.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.841+0000 7fde1eac0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fde180affa0 con 0x7fde1815c490 2024-09-12T01:56:49.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.841+0000 7fde1eac0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fde18070b70 con 0x7fde1809b140 2024-09-12T01:56:49.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.842+0000 7fde17fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde180b14d0 0x7fde18156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.842+0000 7fde17fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde180b14d0 0x7fde18156930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40068/0 (socket says 172.21.15.19:40068) 2024-09-12T01:56:49.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.842+0000 7fde17fff640 1 -- 172.21.15.19:0/2807572477 learned_addr learned my addr 172.21.15.19:0/2807572477 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:49.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.842+0000 7fde1d05d640 1 --2- 172.21.15.19:0/2807572477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde1815c490 0x7fde1813e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.842+0000 7fde1c85c640 1 --2- 172.21.15.19:0/2807572477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1809b140 0x7fde181f41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.842+0000 7fde17fff640 1 -- 172.21.15.19:0/2807572477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1809b140 msgr2=0x7fde181f41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.842+0000 7fde17fff640 1 --2- 172.21.15.19:0/2807572477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1809b140 0x7fde181f41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.842+0000 7fde17fff640 1 -- 172.21.15.19:0/2807572477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde1815c490 msgr2=0x7fde1813e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.842+0000 7fde17fff640 1 --2- 172.21.15.19:0/2807572477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde1815c490 0x7fde1813e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.842+0000 7fde17fff640 1 -- 172.21.15.19:0/2807572477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde181566f0 con 0x7fde180b14d0 2024-09-12T01:56:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.842+0000 7fde17fff640 1 --2- 172.21.15.19:0/2807572477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde180b14d0 0x7fde18156930 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fde0c00ebe0 tx=0x7fde0c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.842+0000 7fde157fa640 1 -- 172.21.15.19:0/2807572477 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0c017070 con 0x7fde180b14d0 2024-09-12T01:56:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.842+0000 7fde157fa640 1 -- 172.21.15.19:0/2807572477 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde0c00cc30 con 0x7fde180b14d0 2024-09-12T01:56:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.842+0000 7fde157fa640 1 -- 172.21.15.19:0/2807572477 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0c013470 con 0x7fde180b14d0 2024-09-12T01:56:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.842+0000 7fde1eac0640 1 -- 172.21.15.19:0/2807572477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde18156e70 con 0x7fde180b14d0 2024-09-12T01:56:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.842+0000 7fde1eac0640 1 -- 172.21.15.19:0/2807572477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde1814d920 con 0x7fde180b14d0 2024-09-12T01:56:49.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.844+0000 7fde1eac0640 1 -- 172.21.15.19:0/2807572477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde1809aa30 con 0x7fde180b14d0 2024-09-12T01:56:49.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.844+0000 7fde157fa640 1 -- 172.21.15.19:0/2807572477 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde0c01a070 con 0x7fde180b14d0 2024-09-12T01:56:49.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.844+0000 7fde157fa640 1 --2- 172.21.15.19:0/2807572477 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fde0406be30 0x7fde0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.844+0000 7fde157fa640 1 -- 172.21.15.19:0/2807572477 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fde0c08aef0 con 0x7fde180b14d0 2024-09-12T01:56:49.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.845+0000 7fde1c85c640 1 --2- 172.21.15.19:0/2807572477 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fde0406be30 0x7fde0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.845+0000 7fde1c85c640 1 --2- 172.21.15.19:0/2807572477 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fde0406be30 0x7fde0406e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fde08007fd0 tx=0x7fde08007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:49.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:49.849+0000 7fde157fa640 1 -- 172.21.15.19:0/2807572477 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde0c0590c0 con 0x7fde180b14d0 2024-09-12T01:56:50.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.061+0000 7fde1eac0640 1 -- 172.21.15.19:0/2807572477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fde180b5880 con 0x7fde180b14d0 2024-09-12T01:56:50.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.093+0000 7fde157fa640 1 -- 172.21.15.19:0/2807572477 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) ==== 118+0+0 (secure 0 0 0) 0x7fde0c05d3c0 con 0x7fde180b14d0 2024-09-12T01:56:50.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.095+0000 7fde1eac0640 1 -- 172.21.15.19:0/2807572477 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fde0406be30 msgr2=0x7fde0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:50.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.095+0000 7fde1eac0640 1 --2- 172.21.15.19:0/2807572477 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fde0406be30 0x7fde0406e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fde08007fd0 tx=0x7fde08007e80 comp rx=0 tx=0).stop 2024-09-12T01:56:50.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.095+0000 7fde1eac0640 1 -- 172.21.15.19:0/2807572477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde180b14d0 msgr2=0x7fde18156930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:50.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.095+0000 7fde1eac0640 1 --2- 172.21.15.19:0/2807572477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde180b14d0 0x7fde18156930 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fde0c00ebe0 tx=0x7fde0c00c520 comp rx=0 tx=0).stop 2024-09-12T01:56:50.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.095+0000 7fde1eac0640 1 -- 172.21.15.19:0/2807572477 shutdown_connections 2024-09-12T01:56:50.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.095+0000 7fde1eac0640 1 --2- 172.21.15.19:0/2807572477 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fde0406be30 0x7fde0406e2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.095+0000 7fde1eac0640 1 --2- 172.21.15.19:0/2807572477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde1815c490 0x7fde1813e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.095+0000 7fde1eac0640 1 --2- 172.21.15.19:0/2807572477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde180b14d0 0x7fde18156930 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.095+0000 7fde1eac0640 1 --2- 172.21.15.19:0/2807572477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1809b140 0x7fde181f41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.095+0000 7fde1eac0640 1 -- 172.21.15.19:0/2807572477 >> 172.21.15.19:0/2807572477 conn(0x7fde180b3f30 msgr2=0x7fde180b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:50.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.095+0000 7fde1eac0640 1 -- 172.21.15.19:0/2807572477 shutdown_connections 2024-09-12T01:56:50.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.095+0000 7fde1eac0640 1 -- 172.21.15.19:0/2807572477 wait complete. 2024-09-12T01:56:50.107 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T01:56:50.107 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T01:56:50.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.212+0000 7f7fcea42640 1 Processor -- start 2024-09-12T01:56:50.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.212+0000 7f7fcea42640 1 -- start start 2024-09-12T01:56:50.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.213+0000 7f7fcea42640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7fc80af210 0x7f7fc8070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:50.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.213+0000 7f7fcea42640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fc8070fb0 0x7f7fc806de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:50.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.213+0000 7f7fcea42640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc806cdc0 con 0x7f7fc815e7f0 2024-09-12T01:56:50.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.213+0000 7f7fcea42640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc806d0a0 con 0x7f7fc80af210 2024-09-12T01:56:50.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.213+0000 7f7fcea42640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc806d380 con 0x7f7fc8070fb0 2024-09-12T01:56:50.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.213+0000 7f7fc77fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7fc80af210 0x7f7fc8070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:50.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.213+0000 7f7fc77fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7fc80af210 0x7f7fc8070a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40080/0 (socket says 172.21.15.19:40080) 2024-09-12T01:56:50.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.213+0000 7f7fc77fe640 1 -- 172.21.15.19:0/3870603697 learned_addr learned my addr 172.21.15.19:0/3870603697 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:50.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.213+0000 7f7fccfdf640 1 --2- 172.21.15.19:0/3870603697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fc8070fb0 0x7f7fc806de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:50.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.213+0000 7f7fc77fe640 1 -- 172.21.15.19:0/3870603697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fc8070fb0 msgr2=0x7f7fc806de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:50.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.213+0000 7f7fc77fe640 1 --2- 172.21.15.19:0/3870603697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fc8070fb0 0x7f7fc806de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.213+0000 7f7fc77fe640 1 -- 172.21.15.19:0/3870603697 >> v1:172.21.15.135:6789/0 conn(0x7f7fc815e7f0 legacy=0x7f7fc80b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:50.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.213+0000 7f7fc77fe640 1 -- 172.21.15.19:0/3870603697 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc806d660 con 0x7f7fc80af210 2024-09-12T01:56:50.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.214+0000 7f7fc77fe640 1 --2- 172.21.15.19:0/3870603697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fc80af210 0x7f7fc8070a70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009870 tx=0x7f7fbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f7dfbf73292528 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:50.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.214+0000 7f7fc6ffd640 1 -- 172.21.15.19:0/3870603697 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc037070 con 0x7f7fc80af210 2024-09-12T01:56:50.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.214+0000 7f7fc6ffd640 1 -- 172.21.15.19:0/3870603697 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fbc032440 con 0x7f7fc80af210 2024-09-12T01:56:50.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.214+0000 7f7fc6ffd640 1 -- 172.21.15.19:0/3870603697 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc032810 con 0x7f7fc80af210 2024-09-12T01:56:50.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.215+0000 7f7fcea42640 1 -- 172.21.15.19:0/3870603697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fc80af210 msgr2=0x7f7fc8070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:50.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.215+0000 7f7fcea42640 1 --2- 172.21.15.19:0/3870603697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fc80af210 0x7f7fc8070a70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009870 tx=0x7f7fbc02a270 comp rx=0 tx=0).stop 2024-09-12T01:56:50.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.215+0000 7f7fcea42640 1 -- 172.21.15.19:0/3870603697 shutdown_connections 2024-09-12T01:56:50.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.215+0000 7f7fcea42640 1 --2- 172.21.15.19:0/3870603697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fc8070fb0 0x7f7fc806de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.215+0000 7f7fcea42640 1 --2- 172.21.15.19:0/3870603697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fc80af210 0x7f7fc8070a70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.215+0000 7f7fcea42640 1 -- 172.21.15.19:0/3870603697 >> 172.21.15.19:0/3870603697 conn(0x7f7fc80b3f30 msgr2=0x7f7fc80b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:50.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.215+0000 7f7fcea42640 1 -- 172.21.15.19:0/3870603697 shutdown_connections 2024-09-12T01:56:50.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.215+0000 7f7fcea42640 1 -- 172.21.15.19:0/3870603697 wait complete. 2024-09-12T01:56:50.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.216+0000 7f7fcea42640 1 Processor -- start 2024-09-12T01:56:50.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.216+0000 7f7fcea42640 1 -- start start 2024-09-12T01:56:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.217+0000 7f7fcea42640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fc8070fb0 0x7f7fc8160d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.217+0000 7f7fcea42640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fc80af210 0x7f7fc8146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.217+0000 7f7fcea42640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fc815e7f0 0x7f7fc8158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.217+0000 7f7fcea42640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc80b60c0 con 0x7f7fc815e7f0 2024-09-12T01:56:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.217+0000 7f7fcea42640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc80b5f40 con 0x7f7fc80af210 2024-09-12T01:56:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.217+0000 7f7fcea42640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc806e3a0 con 0x7f7fc8070fb0 2024-09-12T01:56:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.217+0000 7f7fccfdf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fc815e7f0 0x7f7fc8158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.217+0000 7f7fccfdf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fc815e7f0 0x7f7fc8158570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40096/0 (socket says 172.21.15.19:40096) 2024-09-12T01:56:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.217+0000 7f7fccfdf640 1 -- 172.21.15.19:0/2158046150 learned_addr learned my addr 172.21.15.19:0/2158046150 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.217+0000 7f7fc7fff640 1 --2- 172.21.15.19:0/2158046150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fc8070fb0 0x7f7fc8160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.217+0000 7f7fc77fe640 1 --2- 172.21.15.19:0/2158046150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fc80af210 0x7f7fc8146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.218+0000 7f7fccfdf640 1 -- 172.21.15.19:0/2158046150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fc8070fb0 msgr2=0x7f7fc8160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.218+0000 7f7fccfdf640 1 --2- 172.21.15.19:0/2158046150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fc8070fb0 0x7f7fc8160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.218+0000 7f7fccfdf640 1 -- 172.21.15.19:0/2158046150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fc80af210 msgr2=0x7f7fc8146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.218+0000 7f7fccfdf640 1 --2- 172.21.15.19:0/2158046150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fc80af210 0x7f7fc8146f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.218+0000 7f7fccfdf640 1 -- 172.21.15.19:0/2158046150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc81613a0 con 0x7f7fc815e7f0 2024-09-12T01:56:50.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.218+0000 7f7fccfdf640 1 --2- 172.21.15.19:0/2158046150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fc815e7f0 0x7f7fc8158570 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0007e70 tx=0x7f7fc000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:50.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.218+0000 7f7fc4ff9640 1 -- 172.21.15.19:0/2158046150 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0014620 con 0x7f7fc815e7f0 2024-09-12T01:56:50.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.218+0000 7f7fc4ff9640 1 -- 172.21.15.19:0/2158046150 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc0019070 con 0x7f7fc815e7f0 2024-09-12T01:56:50.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.218+0000 7f7fcea42640 1 -- 172.21.15.19:0/2158046150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc8161680 con 0x7f7fc815e7f0 2024-09-12T01:56:50.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.218+0000 7f7fc4ff9640 1 -- 172.21.15.19:0/2158046150 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0014a20 con 0x7f7fc815e7f0 2024-09-12T01:56:50.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.218+0000 7f7fcea42640 1 -- 172.21.15.19:0/2158046150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc81f4330 con 0x7f7fc815e7f0 2024-09-12T01:56:50.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.219+0000 7f7fcea42640 1 -- 172.21.15.19:0/2158046150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc806de60 con 0x7f7fc815e7f0 2024-09-12T01:56:50.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.220+0000 7f7fc4ff9640 1 -- 172.21.15.19:0/2158046150 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7fc0014bc0 con 0x7f7fc815e7f0 2024-09-12T01:56:50.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.220+0000 7f7fc4ff9640 1 --2- 172.21.15.19:0/2158046150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7fb406be30 0x7f7fb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:50.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.220+0000 7f7fc4ff9640 1 -- 172.21.15.19:0/2158046150 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f7fc008b740 con 0x7f7fc815e7f0 2024-09-12T01:56:50.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.220+0000 7f7fc7fff640 1 --2- 172.21.15.19:0/2158046150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7fb406be30 0x7f7fb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:50.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.221+0000 7f7fc7fff640 1 --2- 172.21.15.19:0/2158046150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7fb406be30 0x7f7fb406e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80016e0 tx=0x7f7fb8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:50.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.224+0000 7f7fc4ff9640 1 -- 172.21.15.19:0/2158046150 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7fc0059910 con 0x7f7fc815e7f0 2024-09-12T01:56:50.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:50.438+0000 7f7fcea42640 1 -- 172.21.15.19:0/2158046150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7fc8161850 con 0x7f7fc815e7f0 2024-09-12T01:56:51.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.098+0000 7f7fc4ff9640 1 -- 172.21.15.19:0/2158046150 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) ==== 122+0+0 (secure 0 0 0) 0x7f7fc005dc10 con 0x7f7fc815e7f0 2024-09-12T01:56:51.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.101+0000 7f7fcea42640 1 -- 172.21.15.19:0/2158046150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7fb406be30 msgr2=0x7f7fb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.101+0000 7f7fcea42640 1 --2- 172.21.15.19:0/2158046150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7fb406be30 0x7f7fb406e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80016e0 tx=0x7f7fb8009040 comp rx=0 tx=0).stop 2024-09-12T01:56:51.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.101+0000 7f7fcea42640 1 -- 172.21.15.19:0/2158046150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fc815e7f0 msgr2=0x7f7fc8158570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.101+0000 7f7fcea42640 1 --2- 172.21.15.19:0/2158046150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fc815e7f0 0x7f7fc8158570 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0007e70 tx=0x7f7fc000e4b0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.101+0000 7f7fcea42640 1 -- 172.21.15.19:0/2158046150 shutdown_connections 2024-09-12T01:56:51.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.101+0000 7f7fcea42640 1 --2- 172.21.15.19:0/2158046150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7fb406be30 0x7f7fb406e2f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.101+0000 7f7fcea42640 1 --2- 172.21.15.19:0/2158046150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fc815e7f0 0x7f7fc8158570 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.101+0000 7f7fcea42640 1 --2- 172.21.15.19:0/2158046150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fc80af210 0x7f7fc8146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.101+0000 7f7fcea42640 1 --2- 172.21.15.19:0/2158046150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fc8070fb0 0x7f7fc8160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.101+0000 7f7fcea42640 1 -- 172.21.15.19:0/2158046150 >> 172.21.15.19:0/2158046150 conn(0x7f7fc80b3f30 msgr2=0x7f7fc80d2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:51.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.101+0000 7f7fcea42640 1 -- 172.21.15.19:0/2158046150 shutdown_connections 2024-09-12T01:56:51.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.101+0000 7f7fcea42640 1 -- 172.21.15.19:0/2158046150 wait complete. 2024-09-12T01:56:51.115 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T01:56:51.115 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:56:51.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.223+0000 7f1f3f01e640 1 Processor -- start 2024-09-12T01:56:51.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.223+0000 7f1f3f01e640 1 -- start start 2024-09-12T01:56:51.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.224+0000 7f1f3f01e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f380cfcc0 0x7f1f3806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:51.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.224+0000 7f1f3f01e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1f380d4fd0 0x7f1f380d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:51.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.224+0000 7f1f3f01e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f380d2700 con 0x7f1f3815e760 2024-09-12T01:56:51.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.224+0000 7f1f3f01e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f1f380cedb0 con 0x7f1f380d4fd0 2024-09-12T01:56:51.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.224+0000 7f1f3f01e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1f380cf090 con 0x7f1f380cfcc0 2024-09-12T01:56:51.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.224+0000 7f1f3d5bb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1f380d4fd0 0x7f1f380d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:51.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.224+0000 7f1f3d5bb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1f380d4fd0 0x7f1f380d2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52996/0 (socket says 172.21.15.19:52996) 2024-09-12T01:56:51.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.224+0000 7f1f3d5bb640 1 -- 172.21.15.19:0/3584384713 learned_addr learned my addr 172.21.15.19:0/3584384713 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:51.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.224+0000 7f1f2ffff640 1 --2- 172.21.15.19:0/3584384713 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f380cfcc0 0x7f1f3806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:51.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.224+0000 7f1f3d5bb640 1 -- 172.21.15.19:0/3584384713 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f380cfcc0 msgr2=0x7f1f3806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:51.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.224+0000 7f1f3d5bb640 1 --2- 172.21.15.19:0/3584384713 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f380cfcc0 0x7f1f3806cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.224+0000 7f1f3d5bb640 1 -- 172.21.15.19:0/3584384713 >> v1:172.21.15.135:6789/0 conn(0x7f1f3815e760 legacy=0x7f1f380cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.224+0000 7f1f3d5bb640 1 -- 172.21.15.19:0/3584384713 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f380b3c80 con 0x7f1f380d4fd0 2024-09-12T01:56:51.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.224+0000 7f1f2ffff640 1 --2- 172.21.15.19:0/3584384713 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f380cfcc0 0x7f1f3806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:51.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.225+0000 7f1f3d5bb640 1 --2- 172.21.15.19:0/3584384713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f380d4fd0 0x7f1f380d2ea0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009e50 tx=0x7f1f3002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7464dcf9423d4c42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:51.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.225+0000 7f1f2f7fe640 1 -- 172.21.15.19:0/3584384713 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f30036070 con 0x7f1f380d4fd0 2024-09-12T01:56:51.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.225+0000 7f1f2f7fe640 1 -- 172.21.15.19:0/3584384713 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f30031600 con 0x7f1f380d4fd0 2024-09-12T01:56:51.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.225+0000 7f1f2f7fe640 1 -- 172.21.15.19:0/3584384713 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f300319d0 con 0x7f1f380d4fd0 2024-09-12T01:56:51.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.226+0000 7f1f3f01e640 1 -- 172.21.15.19:0/3584384713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f380d4fd0 msgr2=0x7f1f380d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.226+0000 7f1f3f01e640 1 --2- 172.21.15.19:0/3584384713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f380d4fd0 0x7f1f380d2ea0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009e50 tx=0x7f1f3002a710 comp rx=0 tx=0).stop 2024-09-12T01:56:51.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.226+0000 7f1f3f01e640 1 -- 172.21.15.19:0/3584384713 shutdown_connections 2024-09-12T01:56:51.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.226+0000 7f1f3f01e640 1 --2- 172.21.15.19:0/3584384713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f380d4fd0 0x7f1f380d2ea0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.226+0000 7f1f3f01e640 1 --2- 172.21.15.19:0/3584384713 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f380cfcc0 0x7f1f3806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.226+0000 7f1f3f01e640 1 -- 172.21.15.19:0/3584384713 >> 172.21.15.19:0/3584384713 conn(0x7f1f3808bfc0 msgr2=0x7f1f380d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:51.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.226+0000 7f1f3f01e640 1 -- 172.21.15.19:0/3584384713 shutdown_connections 2024-09-12T01:56:51.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.226+0000 7f1f3f01e640 1 -- 172.21.15.19:0/3584384713 wait complete. 2024-09-12T01:56:51.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.227+0000 7f1f3f01e640 1 Processor -- start 2024-09-12T01:56:51.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.227+0000 7f1f3f01e640 1 -- start start 2024-09-12T01:56:51.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.228+0000 7f1f3f01e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f380cfcc0 0x7f1f3815a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:51.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.228+0000 7f1f3f01e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f380d4fd0 0x7f1f381569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:51.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.228+0000 7f1f3f01e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f3815e760 0x7f1f381f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:51.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.228+0000 7f1f3f01e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1f380d33e0 con 0x7f1f380cfcc0 2024-09-12T01:56:51.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.228+0000 7f1f3f01e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1f380b38a0 con 0x7f1f380d4fd0 2024-09-12T01:56:51.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.228+0000 7f1f3f01e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1f380d3560 con 0x7f1f3815e760 2024-09-12T01:56:51.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.228+0000 7f1f3cdba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f380cfcc0 0x7f1f3815a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:51.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.228+0000 7f1f3cdba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f380cfcc0 0x7f1f3815a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52998/0 (socket says 172.21.15.19:52998) 2024-09-12T01:56:51.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.228+0000 7f1f3cdba640 1 -- 172.21.15.19:0/807265894 learned_addr learned my addr 172.21.15.19:0/807265894 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:51.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.228+0000 7f1f2ffff640 1 --2- 172.21.15.19:0/807265894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f380d4fd0 0x7f1f381569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:51.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.228+0000 7f1f3d5bb640 1 --2- 172.21.15.19:0/807265894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f3815e760 0x7f1f381f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:51.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.228+0000 7f1f3cdba640 1 -- 172.21.15.19:0/807265894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f3815e760 msgr2=0x7f1f381f46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.228+0000 7f1f3cdba640 1 --2- 172.21.15.19:0/807265894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f3815e760 0x7f1f381f46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.228+0000 7f1f3cdba640 1 -- 172.21.15.19:0/807265894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f380d4fd0 msgr2=0x7f1f381569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.228+0000 7f1f3cdba640 1 --2- 172.21.15.19:0/807265894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f380d4fd0 0x7f1f381569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.228+0000 7f1f3cdba640 1 -- 172.21.15.19:0/807265894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3815b1b0 con 0x7f1f380cfcc0 2024-09-12T01:56:51.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.229+0000 7f1f3cdba640 1 --2- 172.21.15.19:0/807265894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f380cfcc0 0x7f1f3815a960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400c3c0 tx=0x7f1f3400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:51.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.229+0000 7f1f2d7fa640 1 -- 172.21.15.19:0/807265894 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f340052d0 con 0x7f1f380cfcc0 2024-09-12T01:56:51.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.229+0000 7f1f2d7fa640 1 -- 172.21.15.19:0/807265894 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f34005490 con 0x7f1f380cfcc0 2024-09-12T01:56:51.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.229+0000 7f1f3f01e640 1 -- 172.21.15.19:0/807265894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f3815b490 con 0x7f1f380cfcc0 2024-09-12T01:56:51.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.229+0000 7f1f2d7fa640 1 -- 172.21.15.19:0/807265894 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f34007260 con 0x7f1f380cfcc0 2024-09-12T01:56:51.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.229+0000 7f1f3f01e640 1 -- 172.21.15.19:0/807265894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f380b7590 con 0x7f1f380cfcc0 2024-09-12T01:56:51.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.230+0000 7f1f3f01e640 1 -- 172.21.15.19:0/807265894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f380d38e0 con 0x7f1f380cfcc0 2024-09-12T01:56:51.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.230+0000 7f1f2d7fa640 1 -- 172.21.15.19:0/807265894 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f34007400 con 0x7f1f380cfcc0 2024-09-12T01:56:51.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.231+0000 7f1f2d7fa640 1 --2- 172.21.15.19:0/807265894 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1f2406be30 0x7f1f2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:51.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.231+0000 7f1f2d7fa640 1 -- 172.21.15.19:0/807265894 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f1f3408a390 con 0x7f1f380cfcc0 2024-09-12T01:56:51.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.231+0000 7f1f2ffff640 1 --2- 172.21.15.19:0/807265894 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1f2406be30 0x7f1f2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:51.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.232+0000 7f1f2ffff640 1 --2- 172.21.15.19:0/807265894 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1f2406be30 0x7f1f2406e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1f380a2470 tx=0x7f1f28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:51.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.235+0000 7f1f2d7fa640 1 -- 172.21.15.19:0/807265894 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f380d2700 con 0x7f1f380cfcc0 2024-09-12T01:56:51.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.448+0000 7f1f3f01e640 1 -- 172.21.15.19:0/807265894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f380b6d20 con 0x7f1f380cfcc0 2024-09-12T01:56:51.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.449+0000 7f1f2d7fa640 1 -- 172.21.15.19:0/807265894 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5226 (secure 0 0 0) 0x7f1f340585f0 con 0x7f1f380cfcc0 2024-09-12T01:56:51.449 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:51.449 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":15,"btime":"2024-09-12T01:56:51:094820+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1979542220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1979542220},{"type":"v1","addr":"172.21.15.135:6836","nonce":1979542220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/809710386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":809710386},{"type":"v1","addr":"172.21.15.19:6835","nonce":809710386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1005776280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1005776280},{"type":"v1","addr":"172.21.15.135:6837","nonce":1005776280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:56:48.431829+0000","modified":"2024-09-12T01:56:50.440044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4822},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4822":{"gid":4822,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6834/1994815169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1994815169},{"type":"v1","addr":"172.21.15.19:6834","nonce":1994815169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4822,"qdb_cluster":[4822]},"id":2}]} 2024-09-12T01:56:51.449 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 15 2024-09-12T01:56:51.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.451+0000 7f1f3f01e640 1 -- 172.21.15.19:0/807265894 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1f2406be30 msgr2=0x7f1f2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.451+0000 7f1f3f01e640 1 --2- 172.21.15.19:0/807265894 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1f2406be30 0x7f1f2406e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1f380a2470 tx=0x7f1f28008040 comp rx=0 tx=0).stop 2024-09-12T01:56:51.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.451+0000 7f1f3f01e640 1 -- 172.21.15.19:0/807265894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f380cfcc0 msgr2=0x7f1f3815a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.451+0000 7f1f3f01e640 1 --2- 172.21.15.19:0/807265894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f380cfcc0 0x7f1f3815a960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400c3c0 tx=0x7f1f3400c880 comp rx=0 tx=0).stop 2024-09-12T01:56:51.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.451+0000 7f1f3f01e640 1 -- 172.21.15.19:0/807265894 shutdown_connections 2024-09-12T01:56:51.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.451+0000 7f1f3f01e640 1 --2- 172.21.15.19:0/807265894 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1f2406be30 0x7f1f2406e2f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.451+0000 7f1f3f01e640 1 --2- 172.21.15.19:0/807265894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f3815e760 0x7f1f381f46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.451+0000 7f1f3f01e640 1 --2- 172.21.15.19:0/807265894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f380d4fd0 0x7f1f381569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.451+0000 7f1f3f01e640 1 --2- 172.21.15.19:0/807265894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f380cfcc0 0x7f1f3815a960 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.451+0000 7f1f3f01e640 1 -- 172.21.15.19:0/807265894 >> 172.21.15.19:0/807265894 conn(0x7f1f3808bfc0 msgr2=0x7f1f380b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:51.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.451+0000 7f1f3f01e640 1 -- 172.21.15.19:0/807265894 shutdown_connections 2024-09-12T01:56:51.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.451+0000 7f1f3f01e640 1 -- 172.21.15.19:0/807265894 wait complete. 2024-09-12T01:56:51.462 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:56:51.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.564+0000 7ff80e79f640 1 Processor -- start 2024-09-12T01:56:51.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.564+0000 7ff80e79f640 1 -- start start 2024-09-12T01:56:51.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.564+0000 7ff80e79f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80815fc30 0x7ff808071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:51.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.564+0000 7ff80e79f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8080b17d0 0x7ff80809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:51.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.564+0000 7ff80e79f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff80809ba30 con 0x7ff80809af70 2024-09-12T01:56:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.564+0000 7ff80e79f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff8080b1590 con 0x7ff8080b17d0 2024-09-12T01:56:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.564+0000 7ff80e79f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff808160ab0 con 0x7ff80815fc30 2024-09-12T01:56:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.565+0000 7ff8077fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8080b17d0 0x7ff80809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.565+0000 7ff8077fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8080b17d0 0x7ff80809aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53010/0 (socket says 172.21.15.19:53010) 2024-09-12T01:56:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.565+0000 7ff80cd3c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff80809af70 0x7ff8080d0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43798/0 (socket says 172.21.15.19:43798) 2024-09-12T01:56:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.565+0000 7ff8077fe640 1 -- 172.21.15.19:0/2134884432 learned_addr learned my addr 172.21.15.19:0/2134884432 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.565+0000 7ff807fff640 1 --2- 172.21.15.19:0/2134884432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80815fc30 0x7ff808071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.565+0000 7ff8077fe640 1 -- 172.21.15.19:0/2134884432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80815fc30 msgr2=0x7ff808071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.565+0000 7ff8077fe640 1 --2- 172.21.15.19:0/2134884432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80815fc30 0x7ff808071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.565+0000 7ff8077fe640 1 -- 172.21.15.19:0/2134884432 >> v1:172.21.15.19:6789/0 conn(0x7ff80809af70 legacy=0x7ff8080d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.565+0000 7ff8077fe640 1 -- 172.21.15.19:0/2134884432 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff80809bcf0 con 0x7ff8080b17d0 2024-09-12T01:56:51.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.566+0000 7ff8077fe640 1 --2- 172.21.15.19:0/2134884432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8080b17d0 0x7ff80809aa30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc009870 tx=0x7ff7fc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d02def0db0e4c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:51.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.566+0000 7ff806ffd640 1 -- 172.21.15.19:0/2134884432 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc037070 con 0x7ff8080b17d0 2024-09-12T01:56:51.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.566+0000 7ff806ffd640 1 -- 172.21.15.19:0/2134884432 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7fc032440 con 0x7ff8080b17d0 2024-09-12T01:56:51.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.566+0000 7ff806ffd640 1 -- 172.21.15.19:0/2134884432 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc032810 con 0x7ff8080b17d0 2024-09-12T01:56:51.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.566+0000 7ff80e79f640 1 -- 172.21.15.19:0/2134884432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8080b17d0 msgr2=0x7ff80809aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.566+0000 7ff80e79f640 1 --2- 172.21.15.19:0/2134884432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8080b17d0 0x7ff80809aa30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc009870 tx=0x7ff7fc02a1c0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.566+0000 7ff80e79f640 1 -- 172.21.15.19:0/2134884432 shutdown_connections 2024-09-12T01:56:51.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.566+0000 7ff80e79f640 1 --2- 172.21.15.19:0/2134884432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8080b17d0 0x7ff80809aa30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.566+0000 7ff80e79f640 1 --2- 172.21.15.19:0/2134884432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80815fc30 0x7ff808071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.566+0000 7ff80e79f640 1 -- 172.21.15.19:0/2134884432 >> 172.21.15.19:0/2134884432 conn(0x7ff8080d23a0 msgr2=0x7ff8080d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:51.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.566+0000 7ff80e79f640 1 -- 172.21.15.19:0/2134884432 shutdown_connections 2024-09-12T01:56:51.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.566+0000 7ff80e79f640 1 -- 172.21.15.19:0/2134884432 wait complete. 2024-09-12T01:56:51.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.568+0000 7ff80e79f640 1 Processor -- start 2024-09-12T01:56:51.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.568+0000 7ff80e79f640 1 -- start start 2024-09-12T01:56:51.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.568+0000 7ff80e79f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff80809af70 0x7ff808153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:51.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff80e79f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8080b17d0 0x7ff8081544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:51.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff80e79f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff80815fc30 0x7ff8081599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:51.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff80e79f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff8080b1bd0 con 0x7ff80809af70 2024-09-12T01:56:51.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff80e79f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff808160fe0 con 0x7ff80815fc30 2024-09-12T01:56:51.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff80e79f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff808071500 con 0x7ff8080b17d0 2024-09-12T01:56:51.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff807fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff80809af70 0x7ff808153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:51.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff807fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff80809af70 0x7ff808153f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53022/0 (socket says 172.21.15.19:53022) 2024-09-12T01:56:51.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff807fff640 1 -- 172.21.15.19:0/1624443986 learned_addr learned my addr 172.21.15.19:0/1624443986 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:51.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff80cd3c640 1 --2- 172.21.15.19:0/1624443986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff80815fc30 0x7ff8081599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:51.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff8077fe640 1 --2- 172.21.15.19:0/1624443986 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8080b17d0 0x7ff8081544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:51.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff807fff640 1 -- 172.21.15.19:0/1624443986 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8080b17d0 msgr2=0x7ff8081544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff807fff640 1 --2- 172.21.15.19:0/1624443986 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8080b17d0 0x7ff8081544b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff807fff640 1 -- 172.21.15.19:0/1624443986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff80815fc30 msgr2=0x7ff8081599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff807fff640 1 --2- 172.21.15.19:0/1624443986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff80815fc30 0x7ff8081599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff807fff640 1 -- 172.21.15.19:0/1624443986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8080c8df0 con 0x7ff80809af70 2024-09-12T01:56:51.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff807fff640 1 --2- 172.21.15.19:0/1624443986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff80809af70 0x7ff808153f70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800d5f0 tx=0x7ff7f800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:51.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff804ff9640 1 -- 172.21.15.19:0/1624443986 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f80125f0 con 0x7ff80809af70 2024-09-12T01:56:51.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff804ff9640 1 -- 172.21.15.19:0/1624443986 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f8019070 con 0x7ff80809af70 2024-09-12T01:56:51.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff80e79f640 1 -- 172.21.15.19:0/1624443986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8080b8050 con 0x7ff80809af70 2024-09-12T01:56:51.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff804ff9640 1 -- 172.21.15.19:0/1624443986 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f80129d0 con 0x7ff80809af70 2024-09-12T01:56:51.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.569+0000 7ff80e79f640 1 -- 172.21.15.19:0/1624443986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8080c6750 con 0x7ff80809af70 2024-09-12T01:56:51.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.570+0000 7ff80e79f640 1 -- 172.21.15.19:0/1624443986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8080b0390 con 0x7ff80809af70 2024-09-12T01:56:51.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.571+0000 7ff804ff9640 1 -- 172.21.15.19:0/1624443986 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff7f8012b70 con 0x7ff80809af70 2024-09-12T01:56:51.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.571+0000 7ff804ff9640 1 --2- 172.21.15.19:0/1624443986 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff7f406be30 0x7ff7f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:51.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.572+0000 7ff804ff9640 1 -- 172.21.15.19:0/1624443986 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7ff7f808b480 con 0x7ff80809af70 2024-09-12T01:56:51.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.572+0000 7ff8077fe640 1 --2- 172.21.15.19:0/1624443986 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff7f406be30 0x7ff7f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:51.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.572+0000 7ff8077fe640 1 --2- 172.21.15.19:0/1624443986 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff7f406be30 0x7ff7f406e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc034000 tx=0x7ff7fc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:51.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.576+0000 7ff804ff9640 1 -- 172.21.15.19:0/1624443986 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff8080b0390 con 0x7ff80809af70 2024-09-12T01:56:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.752+0000 7ff80e79f640 1 -- 172.21.15.19:0/1624443986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff80806c0a0 con 0x7ff80809af70 2024-09-12T01:56:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.753+0000 7ff804ff9640 1 -- 172.21.15.19:0/1624443986 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16990 (secure 0 0 0) 0x7ff80806c0a0 con 0x7ff80809af70 2024-09-12T01:56:51.754 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:51.754 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":40,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:56:50.084454+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:56:46.200850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T01:56:47.416374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.755+0000 7ff80e79f640 1 -- 172.21.15.19:0/1624443986 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff7f406be30 msgr2=0x7ff7f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.755+0000 7ff80e79f640 1 --2- 172.21.15.19:0/1624443986 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff7f406be30 0x7ff7f406e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc034000 tx=0x7ff7fc02e000 comp rx=0 tx=0).stop 2024-09-12T01:56:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.755+0000 7ff80e79f640 1 -- 172.21.15.19:0/1624443986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff80809af70 msgr2=0x7ff808153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.755+0000 7ff80e79f640 1 --2- 172.21.15.19:0/1624443986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff80809af70 0x7ff808153f70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800d5f0 tx=0x7ff7f800dab0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.755+0000 7ff80e79f640 1 -- 172.21.15.19:0/1624443986 shutdown_connections 2024-09-12T01:56:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.755+0000 7ff80e79f640 1 --2- 172.21.15.19:0/1624443986 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff7f406be30 0x7ff7f406e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.755+0000 7ff80e79f640 1 --2- 172.21.15.19:0/1624443986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff80815fc30 0x7ff8081599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.755+0000 7ff80e79f640 1 --2- 172.21.15.19:0/1624443986 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8080b17d0 0x7ff8081544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.755+0000 7ff80e79f640 1 --2- 172.21.15.19:0/1624443986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff80809af70 0x7ff808153f70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.755+0000 7ff80e79f640 1 -- 172.21.15.19:0/1624443986 >> 172.21.15.19:0/1624443986 conn(0x7ff8080d23a0 msgr2=0x7ff8080afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.755+0000 7ff80e79f640 1 -- 172.21.15.19:0/1624443986 shutdown_connections 2024-09-12T01:56:51.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.755+0000 7ff80e79f640 1 -- 172.21.15.19:0/1624443986 wait complete. 2024-09-12T01:56:51.767 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:56:51.767 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:56:51.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.868+0000 7fcbf2f2c640 1 Processor -- start 2024-09-12T01:56:51.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.868+0000 7fcbf2f2c640 1 -- start start 2024-09-12T01:56:51.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.869+0000 7fcbf2f2c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcbec161c80 0x7fcbec06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:51.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.869+0000 7fcbf2f2c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec0b6680 0x7fcbec0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:51.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.869+0000 7fcbf2f2c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbec06e870 con 0x7fcbec162060 2024-09-12T01:56:51.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.869+0000 7fcbf2f2c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fcbec06d9f0 con 0x7fcbec161c80 2024-09-12T01:56:51.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.869+0000 7fcbf2f2c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcbec06dcd0 con 0x7fcbec0b6680 2024-09-12T01:56:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.870+0000 7fcbf0cc8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcbec161c80 0x7fcbec06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.870+0000 7fcbebfff640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fcbec162060 0x7fcbec0b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:52206/0 (socket says 172.21.15.19:52206) 2024-09-12T01:56:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.870+0000 7fcbf14c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec0b6680 0x7fcbec0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.870+0000 7fcbebfff640 1 -- 172.21.15.19:0/2306260000 learned_addr learned my addr 172.21.15.19:0/2306260000 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.870+0000 7fcbf0cc8640 1 -- 172.21.15.19:0/2306260000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec0b6680 msgr2=0x7fcbec0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.870+0000 7fcbf0cc8640 1 --2- 172.21.15.19:0/2306260000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec0b6680 0x7fcbec0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.870+0000 7fcbf0cc8640 1 -- 172.21.15.19:0/2306260000 >> v1:172.21.15.135:6789/0 conn(0x7fcbec162060 legacy=0x7fcbec0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.870+0000 7fcbeb7fe640 1 -- 172.21.15.19:0/2306260000 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1181774008 0 0) 0x7fcbdc001110 con 0x7fcbec162060 2024-09-12T01:56:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.870+0000 7fcbf0cc8640 1 -- 172.21.15.19:0/2306260000 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbec06dfb0 con 0x7fcbec161c80 2024-09-12T01:56:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.870+0000 7fcbf14c9640 1 --2- 172.21.15.19:0/2306260000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec0b6680 0x7fcbec0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:51.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.871+0000 7fcbf0cc8640 1 --2- 172.21.15.19:0/2306260000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbec161c80 0x7fcbec06e330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009d90 tx=0x7fcbe402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cb0a10b2d77cee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:51.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.871+0000 7fcbeb7fe640 1 -- 172.21.15.19:0/2306260000 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4007740 con 0x7fcbec161c80 2024-09-12T01:56:51.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.871+0000 7fcbeb7fe640 1 -- 172.21.15.19:0/2306260000 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe40078e0 con 0x7fcbec161c80 2024-09-12T01:56:51.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.871+0000 7fcbeb7fe640 1 -- 172.21.15.19:0/2306260000 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4007cb0 con 0x7fcbec161c80 2024-09-12T01:56:51.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.871+0000 7fcbf2f2c640 1 -- 172.21.15.19:0/2306260000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbec161c80 msgr2=0x7fcbec06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.871+0000 7fcbf2f2c640 1 --2- 172.21.15.19:0/2306260000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbec161c80 0x7fcbec06e330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009d90 tx=0x7fcbe402a660 comp rx=0 tx=0).stop 2024-09-12T01:56:51.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.871+0000 7fcbf2f2c640 1 -- 172.21.15.19:0/2306260000 shutdown_connections 2024-09-12T01:56:51.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.871+0000 7fcbf2f2c640 1 --2- 172.21.15.19:0/2306260000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec0b6680 0x7fcbec0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.871+0000 7fcbf2f2c640 1 --2- 172.21.15.19:0/2306260000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbec161c80 0x7fcbec06e330 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.871+0000 7fcbf2f2c640 1 -- 172.21.15.19:0/2306260000 >> 172.21.15.19:0/2306260000 conn(0x7fcbec0d44f0 msgr2=0x7fcbec0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:51.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.872+0000 7fcbf2f2c640 1 -- 172.21.15.19:0/2306260000 shutdown_connections 2024-09-12T01:56:51.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.872+0000 7fcbf2f2c640 1 -- 172.21.15.19:0/2306260000 wait complete. 2024-09-12T01:56:51.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.873+0000 7fcbf2f2c640 1 Processor -- start 2024-09-12T01:56:51.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.873+0000 7fcbf2f2c640 1 -- start start 2024-09-12T01:56:51.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbf2f2c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec0b6680 0x7fcbec0ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:51.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbf2f2c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbec161c80 0x7fcbec152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:51.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbf2f2c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbec162060 0x7fcbec1f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:51.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbf2f2c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec0b6cb0 con 0x7fcbec161c80 2024-09-12T01:56:51.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbf2f2c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec0b6b30 con 0x7fcbec162060 2024-09-12T01:56:51.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbf2f2c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcbec0cf720 con 0x7fcbec0b6680 2024-09-12T01:56:51.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbebfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbec161c80 0x7fcbec152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:51.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbebfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbec161c80 0x7fcbec152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53030/0 (socket says 172.21.15.19:53030) 2024-09-12T01:56:51.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbebfff640 1 -- 172.21.15.19:0/2263144524 learned_addr learned my addr 172.21.15.19:0/2263144524 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:51.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbf0cc8640 1 --2- 172.21.15.19:0/2263144524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec0b6680 0x7fcbec0ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:51.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbf14c9640 1 --2- 172.21.15.19:0/2263144524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbec162060 0x7fcbec1f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:51.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbebfff640 1 -- 172.21.15.19:0/2263144524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec0b6680 msgr2=0x7fcbec0ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbebfff640 1 --2- 172.21.15.19:0/2263144524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec0b6680 0x7fcbec0ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbebfff640 1 -- 172.21.15.19:0/2263144524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbec162060 msgr2=0x7fcbec1f7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbebfff640 1 --2- 172.21.15.19:0/2263144524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbec162060 0x7fcbec1f7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbebfff640 1 -- 172.21.15.19:0/2263144524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbec0b8660 con 0x7fcbec161c80 2024-09-12T01:56:51.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbebfff640 1 --2- 172.21.15.19:0/2263144524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbec161c80 0x7fcbec152fc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00c410 tx=0x7fcbdc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:51.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbe97fa640 1 -- 172.21.15.19:0/2263144524 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0074e0 con 0x7fcbec161c80 2024-09-12T01:56:51.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbe97fa640 1 -- 172.21.15.19:0/2263144524 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbdc0047e0 con 0x7fcbec161c80 2024-09-12T01:56:51.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbf2f2c640 1 -- 172.21.15.19:0/2263144524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbec1f8360 con 0x7fcbec161c80 2024-09-12T01:56:51.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbe97fa640 1 -- 172.21.15.19:0/2263144524 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc004bd0 con 0x7fcbec161c80 2024-09-12T01:56:51.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.874+0000 7fcbf2f2c640 1 -- 172.21.15.19:0/2263144524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbec1f8920 con 0x7fcbec161c80 2024-09-12T01:56:51.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.875+0000 7fcbf2f2c640 1 -- 172.21.15.19:0/2263144524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbec0ba470 con 0x7fcbec161c80 2024-09-12T01:56:51.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.876+0000 7fcbe97fa640 1 -- 172.21.15.19:0/2263144524 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcbdc011070 con 0x7fcbec161c80 2024-09-12T01:56:51.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.876+0000 7fcbe97fa640 1 --2- 172.21.15.19:0/2263144524 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcbcc06be30 0x7fcbcc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:51.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.876+0000 7fcbe97fa640 1 -- 172.21.15.19:0/2263144524 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fcbdc08ab30 con 0x7fcbec161c80 2024-09-12T01:56:51.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.877+0000 7fcbf0cc8640 1 --2- 172.21.15.19:0/2263144524 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcbcc06be30 0x7fcbcc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:51.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.877+0000 7fcbf0cc8640 1 --2- 172.21.15.19:0/2263144524 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcbcc06be30 0x7fcbcc06e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4034000 tx=0x7fcbe402f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:51.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:51.881+0000 7fcbe97fa640 1 -- 172.21.15.19:0/2263144524 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcbec06e870 con 0x7fcbec161c80 2024-09-12T01:56:52.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.052+0000 7fcbf2f2c640 1 -- 172.21.15.19:0/2263144524 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcbec160810 con 0x7fcbcc06be30 2024-09-12T01:56:52.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.059+0000 7fcbe97fa640 1 -- 172.21.15.19:0/2263144524 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248078 (secure 0 0 0) 0x7fcbec160810 con 0x7fcbcc06be30 2024-09-12T01:56:52.062 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:52.063 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:56:52.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.062+0000 7fcbf2f2c640 1 -- 172.21.15.19:0/2263144524 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcbcc06be30 msgr2=0x7fcbcc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.062+0000 7fcbf2f2c640 1 --2- 172.21.15.19:0/2263144524 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcbcc06be30 0x7fcbcc06e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4034000 tx=0x7fcbe402f000 comp rx=0 tx=0).stop 2024-09-12T01:56:52.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.062+0000 7fcbf2f2c640 1 -- 172.21.15.19:0/2263144524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbec161c80 msgr2=0x7fcbec152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.062+0000 7fcbf2f2c640 1 --2- 172.21.15.19:0/2263144524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbec161c80 0x7fcbec152fc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00c410 tx=0x7fcbdc00c810 comp rx=0 tx=0).stop 2024-09-12T01:56:52.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.062+0000 7fcbf2f2c640 1 -- 172.21.15.19:0/2263144524 shutdown_connections 2024-09-12T01:56:52.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.062+0000 7fcbf2f2c640 1 --2- 172.21.15.19:0/2263144524 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcbcc06be30 0x7fcbcc06e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.062+0000 7fcbf2f2c640 1 --2- 172.21.15.19:0/2263144524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbec162060 0x7fcbec1f7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.062+0000 7fcbf2f2c640 1 --2- 172.21.15.19:0/2263144524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbec161c80 0x7fcbec152fc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.062+0000 7fcbf2f2c640 1 --2- 172.21.15.19:0/2263144524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec0b6680 0x7fcbec0ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.062+0000 7fcbf2f2c640 1 -- 172.21.15.19:0/2263144524 >> 172.21.15.19:0/2263144524 conn(0x7fcbec0d44f0 msgr2=0x7fcbec0b4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:52.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.062+0000 7fcbf2f2c640 1 -- 172.21.15.19:0/2263144524 shutdown_connections 2024-09-12T01:56:52.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.062+0000 7fcbf2f2c640 1 -- 172.21.15.19:0/2263144524 wait complete. 2024-09-12T01:56:52.073 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-12T01:56:50.097602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":183,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220680,"kb_used_data":4448,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754040,"statfs":{"total":773094113280,"available":772868136960,"internally_reserved":0,"allocated":4554752,"data_stored":2609040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000858"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.074094+0000","last_change":"2024-09-12T01:56:48.074094+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.074094+0000","last_undegraded":"2024-09-12T01:56:48.074094+0000","last_fullsized":"2024-09-12T01:56:48.074094+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.072752+0000","last_change":"2024-09-12T01:56:48.072752+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.072752+0000","last_undegraded":"2024-09-12T01:56:48.072752+0000","last_fullsized":"2024-09-12T01:56:48.072752+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070857+0000","last_change":"2024-09-12T01:56:48.070857+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070857+0000","last_undegraded":"2024-09-12T01:56:48.070857+0000","last_fullsized":"2024-09-12T01:56:48.070857+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071680+0000","last_change":"2024-09-12T01:56:48.071680+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071680+0000","last_undegraded":"2024-09-12T01:56:48.071680+0000","last_fullsized":"2024-09-12T01:56:48.071680+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071211+0000","last_change":"2024-09-12T01:56:48.071211+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071211+0000","last_undegraded":"2024-09-12T01:56:48.071211+0000","last_fullsized":"2024-09-12T01:56:48.071211+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.077153+0000","last_change":"2024-09-12T01:56:48.077153+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.077153+0000","last_undegraded":"2024-09-12T01:56:48.077153+0000","last_fullsized":"2024-09-12T01:56:48.077153+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104551+0000","last_change":"2024-09-12T01:56:49.095662+0000","last_active":"2024-09-12T01:56:49.104551+0000","last_peered":"2024-09-12T01:56:49.104551+0000","last_clean":"2024-09-12T01:56:49.104551+0000","last_became_active":"2024-09-12T01:56:49.095303+0000","last_became_peered":"2024-09-12T01:56:49.095303+0000","last_unstale":"2024-09-12T01:56:49.104551+0000","last_undegraded":"2024-09-12T01:56:49.104551+0000","last_fullsized":"2024-09-12T01:56:49.104551+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:08.496640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069837+0000","last_change":"2024-09-12T01:56:48.069837+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069837+0000","last_undegraded":"2024-09-12T01:56:48.069837+0000","last_fullsized":"2024-09-12T01:56:48.069837+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070676+0000","last_change":"2024-09-12T01:56:48.070676+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070676+0000","last_undegraded":"2024-09-12T01:56:48.070676+0000","last_fullsized":"2024-09-12T01:56:48.070676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107459+0000","last_change":"2024-09-12T01:56:49.100284+0000","last_active":"2024-09-12T01:56:49.107459+0000","last_peered":"2024-09-12T01:56:49.107459+0000","last_clean":"2024-09-12T01:56:49.107459+0000","last_became_active":"2024-09-12T01:56:49.100012+0000","last_became_peered":"2024-09-12T01:56:49.100012+0000","last_unstale":"2024-09-12T01:56:49.107459+0000","last_undegraded":"2024-09-12T01:56:49.107459+0000","last_fullsized":"2024-09-12T01:56:49.107459+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:27.444535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099908+0000","last_change":"2024-09-12T01:56:49.092104+0000","last_active":"2024-09-12T01:56:49.099908+0000","last_peered":"2024-09-12T01:56:49.099908+0000","last_clean":"2024-09-12T01:56:49.099908+0000","last_became_active":"2024-09-12T01:56:49.091831+0000","last_became_peered":"2024-09-12T01:56:49.091831+0000","last_unstale":"2024-09-12T01:56:49.099908+0000","last_undegraded":"2024-09-12T01:56:49.099908+0000","last_fullsized":"2024-09-12T01:56:49.099908+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:30.275429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069910+0000","last_change":"2024-09-12T01:56:48.069910+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069910+0000","last_undegraded":"2024-09-12T01:56:48.069910+0000","last_fullsized":"2024-09-12T01:56:48.069910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104911+0000","last_change":"2024-09-12T01:56:49.097145+0000","last_active":"2024-09-12T01:56:49.104911+0000","last_peered":"2024-09-12T01:56:49.104911+0000","last_clean":"2024-09-12T01:56:49.104911+0000","last_became_active":"2024-09-12T01:56:49.096854+0000","last_became_peered":"2024-09-12T01:56:49.096854+0000","last_unstale":"2024-09-12T01:56:49.104911+0000","last_undegraded":"2024-09-12T01:56:49.104911+0000","last_fullsized":"2024-09-12T01:56:49.104911+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:10.499892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104572+0000","last_change":"2024-09-12T01:56:49.098596+0000","last_active":"2024-09-12T01:56:49.104572+0000","last_peered":"2024-09-12T01:56:49.104572+0000","last_clean":"2024-09-12T01:56:49.104572+0000","last_became_active":"2024-09-12T01:56:49.096857+0000","last_became_peered":"2024-09-12T01:56:49.096857+0000","last_unstale":"2024-09-12T01:56:49.104572+0000","last_undegraded":"2024-09-12T01:56:49.104572+0000","last_fullsized":"2024-09-12T01:56:49.104572+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:30.650006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103449+0000","last_change":"2024-09-12T01:56:49.098562+0000","last_active":"2024-09-12T01:56:49.103449+0000","last_peered":"2024-09-12T01:56:49.103449+0000","last_clean":"2024-09-12T01:56:49.103449+0000","last_became_active":"2024-09-12T01:56:49.098285+0000","last_became_peered":"2024-09-12T01:56:49.098285+0000","last_unstale":"2024-09-12T01:56:49.103449+0000","last_undegraded":"2024-09-12T01:56:49.103449+0000","last_fullsized":"2024-09-12T01:56:49.103449+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:10.499892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103274+0000","last_change":"2024-09-12T01:56:49.097918+0000","last_active":"2024-09-12T01:56:49.103274+0000","last_peered":"2024-09-12T01:56:49.103274+0000","last_clean":"2024-09-12T01:56:49.103274+0000","last_became_active":"2024-09-12T01:56:49.097595+0000","last_became_peered":"2024-09-12T01:56:49.097595+0000","last_unstale":"2024-09-12T01:56:49.103274+0000","last_undegraded":"2024-09-12T01:56:49.103274+0000","last_fullsized":"2024-09-12T01:56:49.103274+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:40.245592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.095664+0000","last_change":"2024-09-12T01:56:49.090304+0000","last_active":"2024-09-12T01:56:49.095664+0000","last_peered":"2024-09-12T01:56:49.095664+0000","last_clean":"2024-09-12T01:56:49.095664+0000","last_became_active":"2024-09-12T01:56:49.089928+0000","last_became_peered":"2024-09-12T01:56:49.089928+0000","last_unstale":"2024-09-12T01:56:49.095664+0000","last_undegraded":"2024-09-12T01:56:49.095664+0000","last_fullsized":"2024-09-12T01:56:49.095664+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:23.477178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070725+0000","last_change":"2024-09-12T01:56:48.070725+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070725+0000","last_undegraded":"2024-09-12T01:56:48.070725+0000","last_fullsized":"2024-09-12T01:56:48.070725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099144+0000","last_change":"2024-09-12T01:56:49.093382+0000","last_active":"2024-09-12T01:56:49.099144+0000","last_peered":"2024-09-12T01:56:49.099144+0000","last_clean":"2024-09-12T01:56:49.099144+0000","last_became_active":"2024-09-12T01:56:49.093060+0000","last_became_peered":"2024-09-12T01:56:49.093060+0000","last_unstale":"2024-09-12T01:56:49.099144+0000","last_undegraded":"2024-09-12T01:56:49.099144+0000","last_fullsized":"2024-09-12T01:56:49.099144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:41.113310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107723+0000","last_change":"2024-09-12T01:56:49.102971+0000","last_active":"2024-09-12T01:56:49.107723+0000","last_peered":"2024-09-12T01:56:49.107723+0000","last_clean":"2024-09-12T01:56:49.107723+0000","last_became_active":"2024-09-12T01:56:49.102708+0000","last_became_peered":"2024-09-12T01:56:49.102708+0000","last_unstale":"2024-09-12T01:56:49.107723+0000","last_undegraded":"2024-09-12T01:56:49.107723+0000","last_fullsized":"2024-09-12T01:56:49.107723+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:26.195981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103132+0000","last_change":"2024-09-12T01:56:49.094962+0000","last_active":"2024-09-12T01:56:49.103132+0000","last_peered":"2024-09-12T01:56:49.103132+0000","last_clean":"2024-09-12T01:56:49.103132+0000","last_became_active":"2024-09-12T01:56:49.094689+0000","last_became_peered":"2024-09-12T01:56:49.094689+0000","last_unstale":"2024-09-12T01:56:49.103132+0000","last_undegraded":"2024-09-12T01:56:49.103132+0000","last_fullsized":"2024-09-12T01:56:49.103132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:44.543744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070901+0000","last_change":"2024-09-12T01:56:48.070901+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070901+0000","last_undegraded":"2024-09-12T01:56:48.070901+0000","last_fullsized":"2024-09-12T01:56:48.070901+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104095+0000","last_change":"2024-09-12T01:56:49.094852+0000","last_active":"2024-09-12T01:56:49.104095+0000","last_peered":"2024-09-12T01:56:49.104095+0000","last_clean":"2024-09-12T01:56:49.104095+0000","last_became_active":"2024-09-12T01:56:49.094582+0000","last_became_peered":"2024-09-12T01:56:49.094582+0000","last_unstale":"2024-09-12T01:56:49.104095+0000","last_undegraded":"2024-09-12T01:56:49.104095+0000","last_fullsized":"2024-09-12T01:56:49.104095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:42.421526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.075748+0000","last_change":"2024-09-12T01:56:48.075748+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.075748+0000","last_undegraded":"2024-09-12T01:56:48.075748+0000","last_fullsized":"2024-09-12T01:56:48.075748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103662+0000","last_change":"2024-09-12T01:56:49.095001+0000","last_active":"2024-09-12T01:56:49.103662+0000","last_peered":"2024-09-12T01:56:49.103662+0000","last_clean":"2024-09-12T01:56:49.103662+0000","last_became_active":"2024-09-12T01:56:49.094730+0000","last_became_peered":"2024-09-12T01:56:49.094730+0000","last_unstale":"2024-09-12T01:56:49.103662+0000","last_undegraded":"2024-09-12T01:56:49.103662+0000","last_fullsized":"2024-09-12T01:56:49.103662+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:46.371782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099958+0000","last_change":"2024-09-12T01:56:49.091704+0000","last_active":"2024-09-12T01:56:49.099958+0000","last_peered":"2024-09-12T01:56:49.099958+0000","last_clean":"2024-09-12T01:56:49.099958+0000","last_became_active":"2024-09-12T01:56:49.091369+0000","last_became_peered":"2024-09-12T01:56:49.091369+0000","last_unstale":"2024-09-12T01:56:49.099958+0000","last_undegraded":"2024-09-12T01:56:49.099958+0000","last_fullsized":"2024-09-12T01:56:49.099958+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:40.245592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107570+0000","last_change":"2024-09-12T01:56:49.102931+0000","last_active":"2024-09-12T01:56:49.107570+0000","last_peered":"2024-09-12T01:56:49.107570+0000","last_clean":"2024-09-12T01:56:49.107570+0000","last_became_active":"2024-09-12T01:56:49.102638+0000","last_became_peered":"2024-09-12T01:56:49.102638+0000","last_unstale":"2024-09-12T01:56:49.107570+0000","last_undegraded":"2024-09-12T01:56:49.107570+0000","last_fullsized":"2024-09-12T01:56:49.107570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:18.709627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.092187+0000","last_change":"2024-09-12T01:56:49.088392+0000","last_active":"2024-09-12T01:56:49.092187+0000","last_peered":"2024-09-12T01:56:49.092187+0000","last_clean":"2024-09-12T01:56:49.092187+0000","last_became_active":"2024-09-12T01:56:49.088100+0000","last_became_peered":"2024-09-12T01:56:49.088100+0000","last_unstale":"2024-09-12T01:56:49.092187+0000","last_undegraded":"2024-09-12T01:56:49.092187+0000","last_fullsized":"2024-09-12T01:56:49.092187+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:22.615266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103382+0000","last_change":"2024-09-12T01:56:49.098430+0000","last_active":"2024-09-12T01:56:49.103382+0000","last_peered":"2024-09-12T01:56:49.103382+0000","last_clean":"2024-09-12T01:56:49.103382+0000","last_became_active":"2024-09-12T01:56:49.098144+0000","last_became_peered":"2024-09-12T01:56:49.098144+0000","last_unstale":"2024-09-12T01:56:49.103382+0000","last_undegraded":"2024-09-12T01:56:49.103382+0000","last_fullsized":"2024-09-12T01:56:49.103382+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:38.096087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.074304+0000","last_change":"2024-09-12T01:56:48.074304+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.074304+0000","last_undegraded":"2024-09-12T01:56:48.074304+0000","last_fullsized":"2024-09-12T01:56:48.074304+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103361+0000","last_change":"2024-09-12T01:56:49.097725+0000","last_active":"2024-09-12T01:56:49.103361+0000","last_peered":"2024-09-12T01:56:49.103361+0000","last_clean":"2024-09-12T01:56:49.103361+0000","last_became_active":"2024-09-12T01:56:49.097049+0000","last_became_peered":"2024-09-12T01:56:49.097049+0000","last_unstale":"2024-09-12T01:56:49.103361+0000","last_undegraded":"2024-09-12T01:56:49.103361+0000","last_fullsized":"2024-09-12T01:56:49.103361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:36.644433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.108732+0000","last_change":"2024-09-12T01:56:48.083339+0000","last_active":"2024-09-12T01:56:49.108732+0000","last_peered":"2024-09-12T01:56:49.108732+0000","last_clean":"2024-09-12T01:56:49.108732+0000","last_became_active":"2024-09-12T01:56:48.083086+0000","last_became_peered":"2024-09-12T01:56:48.083086+0000","last_unstale":"2024-09-12T01:56:49.108732+0000","last_undegraded":"2024-09-12T01:56:49.108732+0000","last_fullsized":"2024-09-12T01:56:49.108732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:26.586415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.078670+0000","last_change":"2024-09-12T01:56:48.078670+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.078670+0000","last_undegraded":"2024-09-12T01:56:48.078670+0000","last_fullsized":"2024-09-12T01:56:48.078670+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.086032+0000","last_change":"2024-09-12T01:56:48.082903+0000","last_active":"2024-09-12T01:56:48.086032+0000","last_peered":"2024-09-12T01:56:48.086032+0000","last_clean":"2024-09-12T01:56:48.086032+0000","last_became_active":"2024-09-12T01:56:48.082585+0000","last_became_peered":"2024-09-12T01:56:48.082585+0000","last_unstale":"2024-09-12T01:56:48.086032+0000","last_undegraded":"2024-09-12T01:56:48.086032+0000","last_fullsized":"2024-09-12T01:56:48.086032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:27.805990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.088719+0000","last_change":"2024-09-12T01:56:48.084769+0000","last_active":"2024-09-12T01:56:48.088719+0000","last_peered":"2024-09-12T01:56:48.088719+0000","last_clean":"2024-09-12T01:56:48.088719+0000","last_became_active":"2024-09-12T01:56:48.084356+0000","last_became_peered":"2024-09-12T01:56:48.084356+0000","last_unstale":"2024-09-12T01:56:48.088719+0000","last_undegraded":"2024-09-12T01:56:48.088719+0000","last_fullsized":"2024-09-12T01:56:48.088719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:06.724111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.074518+0000","last_change":"2024-09-12T01:56:48.074518+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.074518+0000","last_undegraded":"2024-09-12T01:56:48.074518+0000","last_fullsized":"2024-09-12T01:56:48.074518+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T01:56:47.063721+0000","last_change":"2024-09-12T01:56:47.063721+0000","last_active":"2024-09-12T01:56:47.056365+0000","last_peered":"2024-09-12T01:56:47.056365+0000","last_clean":"2024-09-12T01:56:47.056365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:47.063721+0000","last_undegraded":"2024-09-12T01:56:47.063721+0000","last_fullsized":"2024-09-12T01:56:47.063721+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071004+0000","last_change":"2024-09-12T01:56:48.071004+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071004+0000","last_undegraded":"2024-09-12T01:56:48.071004+0000","last_fullsized":"2024-09-12T01:56:48.071004+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107598+0000","last_change":"2024-09-12T01:56:48.086406+0000","last_active":"2024-09-12T01:56:49.107598+0000","last_peered":"2024-09-12T01:56:49.107598+0000","last_clean":"2024-09-12T01:56:49.107598+0000","last_became_active":"2024-09-12T01:56:48.086117+0000","last_became_peered":"2024-09-12T01:56:48.086117+0000","last_unstale":"2024-09-12T01:56:49.107598+0000","last_undegraded":"2024-09-12T01:56:49.107598+0000","last_fullsized":"2024-09-12T01:56:49.107598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:45.367043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107899+0000","last_change":"2024-09-12T01:56:49.104426+0000","last_active":"2024-09-12T01:56:49.107899+0000","last_peered":"2024-09-12T01:56:49.107899+0000","last_clean":"2024-09-12T01:56:49.107899+0000","last_became_active":"2024-09-12T01:56:49.103633+0000","last_became_peered":"2024-09-12T01:56:49.103633+0000","last_unstale":"2024-09-12T01:56:49.107899+0000","last_undegraded":"2024-09-12T01:56:49.107899+0000","last_fullsized":"2024-09-12T01:56:49.107899+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:00.426689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.108805+0000","last_change":"2024-09-12T01:56:48.084388+0000","last_active":"2024-09-12T01:56:49.108805+0000","last_peered":"2024-09-12T01:56:49.108805+0000","last_clean":"2024-09-12T01:56:49.108805+0000","last_became_active":"2024-09-12T01:56:48.084111+0000","last_became_peered":"2024-09-12T01:56:48.084111+0000","last_unstale":"2024-09-12T01:56:49.108805+0000","last_undegraded":"2024-09-12T01:56:49.108805+0000","last_fullsized":"2024-09-12T01:56:49.108805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:22.472440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.092038+0000","last_change":"2024-09-12T01:56:48.091222+0000","last_active":"2024-09-12T01:56:48.092038+0000","last_peered":"2024-09-12T01:56:48.092038+0000","last_clean":"2024-09-12T01:56:48.092038+0000","last_became_active":"2024-09-12T01:56:48.090909+0000","last_became_peered":"2024-09-12T01:56:48.090909+0000","last_unstale":"2024-09-12T01:56:48.092038+0000","last_undegraded":"2024-09-12T01:56:48.092038+0000","last_fullsized":"2024-09-12T01:56:48.092038+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:45.171550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.072553+0000","last_change":"2024-09-12T01:56:48.072553+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.072553+0000","last_undegraded":"2024-09-12T01:56:48.072553+0000","last_fullsized":"2024-09-12T01:56:48.072553+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T01:56:47.063531+0000","last_change":"2024-09-12T01:56:47.063531+0000","last_active":"2024-09-12T01:56:47.056365+0000","last_peered":"2024-09-12T01:56:47.056365+0000","last_clean":"2024-09-12T01:56:47.056365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:47.063531+0000","last_undegraded":"2024-09-12T01:56:47.063531+0000","last_fullsized":"2024-09-12T01:56:47.063531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069971+0000","last_change":"2024-09-12T01:56:48.069971+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069971+0000","last_undegraded":"2024-09-12T01:56:48.069971+0000","last_fullsized":"2024-09-12T01:56:48.069971+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.091861+0000","last_change":"2024-09-12T01:56:48.085039+0000","last_active":"2024-09-12T01:56:48.091861+0000","last_peered":"2024-09-12T01:56:48.091861+0000","last_clean":"2024-09-12T01:56:48.091861+0000","last_became_active":"2024-09-12T01:56:48.084764+0000","last_became_peered":"2024-09-12T01:56:48.084764+0000","last_unstale":"2024-09-12T01:56:48.091861+0000","last_undegraded":"2024-09-12T01:56:48.091861+0000","last_fullsized":"2024-09-12T01:56:48.091861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:26.449812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099629+0000","last_change":"2024-09-12T01:56:49.092967+0000","last_active":"2024-09-12T01:56:49.099629+0000","last_peered":"2024-09-12T01:56:49.099629+0000","last_clean":"2024-09-12T01:56:49.099629+0000","last_became_active":"2024-09-12T01:56:49.092693+0000","last_became_peered":"2024-09-12T01:56:49.092693+0000","last_unstale":"2024-09-12T01:56:49.099629+0000","last_undegraded":"2024-09-12T01:56:49.099629+0000","last_fullsized":"2024-09-12T01:56:49.099629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:18.993260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.088574+0000","last_change":"2024-09-12T01:56:48.081300+0000","last_active":"2024-09-12T01:56:49.088574+0000","last_peered":"2024-09-12T01:56:49.088574+0000","last_clean":"2024-09-12T01:56:49.088574+0000","last_became_active":"2024-09-12T01:56:48.080352+0000","last_became_peered":"2024-09-12T01:56:48.080352+0000","last_unstale":"2024-09-12T01:56:49.088574+0000","last_undegraded":"2024-09-12T01:56:49.088574+0000","last_fullsized":"2024-09-12T01:56:49.088574+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:17.988522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071472+0000","last_change":"2024-09-12T01:56:48.071472+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071472+0000","last_undegraded":"2024-09-12T01:56:48.071472+0000","last_fullsized":"2024-09-12T01:56:48.071472+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.110625+0000","last_change":"2024-09-12T01:56:48.084554+0000","last_active":"2024-09-12T01:56:49.110625+0000","last_peered":"2024-09-12T01:56:49.110625+0000","last_clean":"2024-09-12T01:56:49.110625+0000","last_became_active":"2024-09-12T01:56:48.084150+0000","last_became_peered":"2024-09-12T01:56:48.084150+0000","last_unstale":"2024-09-12T01:56:49.110625+0000","last_undegraded":"2024-09-12T01:56:49.110625+0000","last_fullsized":"2024-09-12T01:56:49.110625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:43.539005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.088871+0000","last_change":"2024-09-12T01:56:48.083135+0000","last_active":"2024-09-12T01:56:48.088871+0000","last_peered":"2024-09-12T01:56:48.088871+0000","last_clean":"2024-09-12T01:56:48.088871+0000","last_became_active":"2024-09-12T01:56:48.082844+0000","last_became_peered":"2024-09-12T01:56:48.082844+0000","last_unstale":"2024-09-12T01:56:48.088871+0000","last_undegraded":"2024-09-12T01:56:48.088871+0000","last_fullsized":"2024-09-12T01:56:48.088871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:42.037302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070131+0000","last_change":"2024-09-12T01:56:48.070131+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070131+0000","last_undegraded":"2024-09-12T01:56:48.070131+0000","last_fullsized":"2024-09-12T01:56:48.070131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.079034+0000","last_change":"2024-09-12T01:56:48.076816+0000","last_active":"2024-09-12T01:56:48.079034+0000","last_peered":"2024-09-12T01:56:48.079034+0000","last_clean":"2024-09-12T01:56:48.079034+0000","last_became_active":"2024-09-12T01:56:48.076400+0000","last_became_peered":"2024-09-12T01:56:48.076400+0000","last_unstale":"2024-09-12T01:56:48.079034+0000","last_undegraded":"2024-09-12T01:56:48.079034+0000","last_fullsized":"2024-09-12T01:56:48.079034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:42.760298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069627+0000","last_change":"2024-09-12T01:56:48.069627+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069627+0000","last_undegraded":"2024-09-12T01:56:48.069627+0000","last_fullsized":"2024-09-12T01:56:48.069627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.092021+0000","last_change":"2024-09-12T01:56:48.091263+0000","last_active":"2024-09-12T01:56:48.092021+0000","last_peered":"2024-09-12T01:56:48.092021+0000","last_clean":"2024-09-12T01:56:48.092021+0000","last_became_active":"2024-09-12T01:56:48.090933+0000","last_became_peered":"2024-09-12T01:56:48.090933+0000","last_unstale":"2024-09-12T01:56:48.092021+0000","last_undegraded":"2024-09-12T01:56:48.092021+0000","last_fullsized":"2024-09-12T01:56:48.092021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:00.824926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103325+0000","last_change":"2024-09-12T01:56:49.095408+0000","last_active":"2024-09-12T01:56:49.103325+0000","last_peered":"2024-09-12T01:56:49.103325+0000","last_clean":"2024-09-12T01:56:49.103325+0000","last_became_active":"2024-09-12T01:56:49.095100+0000","last_became_peered":"2024-09-12T01:56:49.095100+0000","last_unstale":"2024-09-12T01:56:49.103325+0000","last_undegraded":"2024-09-12T01:56:49.103325+0000","last_fullsized":"2024-09-12T01:56:49.103325+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:30.275429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.080227+0000","last_change":"2024-09-12T01:56:48.085093+0000","last_active":"2024-09-12T01:56:49.080227+0000","last_peered":"2024-09-12T01:56:49.080227+0000","last_clean":"2024-09-12T01:56:49.080227+0000","last_became_active":"2024-09-12T01:56:48.084794+0000","last_became_peered":"2024-09-12T01:56:48.084794+0000","last_unstale":"2024-09-12T01:56:49.080227+0000","last_undegraded":"2024-09-12T01:56:49.080227+0000","last_fullsized":"2024-09-12T01:56:49.080227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:53.692206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.072096+0000","last_change":"2024-09-12T01:56:48.072096+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.072096+0000","last_undegraded":"2024-09-12T01:56:48.072096+0000","last_fullsized":"2024-09-12T01:56:48.072096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.109217+0000","last_change":"2024-09-12T01:56:48.081824+0000","last_active":"2024-09-12T01:56:49.109217+0000","last_peered":"2024-09-12T01:56:49.109217+0000","last_clean":"2024-09-12T01:56:49.109217+0000","last_became_active":"2024-09-12T01:56:48.081536+0000","last_became_peered":"2024-09-12T01:56:48.081536+0000","last_unstale":"2024-09-12T01:56:49.109217+0000","last_undegraded":"2024-09-12T01:56:49.109217+0000","last_fullsized":"2024-09-12T01:56:49.109217+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:40.108571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.073530+0000","last_change":"2024-09-12T01:56:48.073530+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.073530+0000","last_undegraded":"2024-09-12T01:56:48.073530+0000","last_fullsized":"2024-09-12T01:56:48.073530+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.108566+0000","last_change":"2024-09-12T01:56:48.086519+0000","last_active":"2024-09-12T01:56:49.108566+0000","last_peered":"2024-09-12T01:56:49.108566+0000","last_clean":"2024-09-12T01:56:49.108566+0000","last_became_active":"2024-09-12T01:56:48.086139+0000","last_became_peered":"2024-09-12T01:56:48.086139+0000","last_unstale":"2024-09-12T01:56:49.108566+0000","last_undegraded":"2024-09-12T01:56:49.108566+0000","last_fullsized":"2024-09-12T01:56:49.108566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:17.704888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107860+0000","last_change":"2024-09-12T01:56:49.104837+0000","last_active":"2024-09-12T01:56:49.107860+0000","last_peered":"2024-09-12T01:56:49.107860+0000","last_clean":"2024-09-12T01:56:49.107860+0000","last_became_active":"2024-09-12T01:56:49.103859+0000","last_became_peered":"2024-09-12T01:56:49.103859+0000","last_unstale":"2024-09-12T01:56:49.107860+0000","last_undegraded":"2024-09-12T01:56:49.107860+0000","last_fullsized":"2024-09-12T01:56:49.107860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:25.718464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T01:56:47.063834+0000","last_change":"2024-09-12T01:56:47.063834+0000","last_active":"2024-09-12T01:56:47.056365+0000","last_peered":"2024-09-12T01:56:47.056365+0000","last_clean":"2024-09-12T01:56:47.056365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:47.063834+0000","last_undegraded":"2024-09-12T01:56:47.063834+0000","last_fullsized":"2024-09-12T01:56:47.063834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.081219+0000","last_change":"2024-09-12T01:56:48.073784+0000","last_active":"2024-09-12T01:56:48.081219+0000","last_peered":"2024-09-12T01:56:48.081219+0000","last_clean":"2024-09-12T01:56:48.081219+0000","last_became_active":"2024-09-12T01:56:48.073319+0000","last_became_peered":"2024-09-12T01:56:48.073319+0000","last_unstale":"2024-09-12T01:56:48.081219+0000","last_undegraded":"2024-09-12T01:56:48.081219+0000","last_fullsized":"2024-09-12T01:56:48.081219+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:44.906880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069015+0000","last_change":"2024-09-12T01:56:48.069015+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069015+0000","last_undegraded":"2024-09-12T01:56:48.069015+0000","last_fullsized":"2024-09-12T01:56:48.069015+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.088726+0000","last_change":"2024-09-12T01:56:48.084752+0000","last_active":"2024-09-12T01:56:48.088726+0000","last_peered":"2024-09-12T01:56:48.088726+0000","last_clean":"2024-09-12T01:56:48.088726+0000","last_became_active":"2024-09-12T01:56:48.084474+0000","last_became_peered":"2024-09-12T01:56:48.084474+0000","last_unstale":"2024-09-12T01:56:48.088726+0000","last_undegraded":"2024-09-12T01:56:48.088726+0000","last_fullsized":"2024-09-12T01:56:48.088726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:00.113502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103336+0000","last_change":"2024-09-12T01:56:49.098187+0000","last_active":"2024-09-12T01:56:49.103336+0000","last_peered":"2024-09-12T01:56:49.103336+0000","last_clean":"2024-09-12T01:56:49.103336+0000","last_became_active":"2024-09-12T01:56:49.097323+0000","last_became_peered":"2024-09-12T01:56:49.097323+0000","last_unstale":"2024-09-12T01:56:49.103336+0000","last_undegraded":"2024-09-12T01:56:49.103336+0000","last_fullsized":"2024-09-12T01:56:49.103336+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:08.496640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.083486+0000","last_change":"2024-09-12T01:56:48.080455+0000","last_active":"2024-09-12T01:56:48.083486+0000","last_peered":"2024-09-12T01:56:48.083486+0000","last_clean":"2024-09-12T01:56:48.083486+0000","last_became_active":"2024-09-12T01:56:48.080116+0000","last_became_peered":"2024-09-12T01:56:48.080116+0000","last_unstale":"2024-09-12T01:56:48.083486+0000","last_undegraded":"2024-09-12T01:56:48.083486+0000","last_fullsized":"2024-09-12T01:56:48.083486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:49.059597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069144+0000","last_change":"2024-09-12T01:56:48.069144+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069144+0000","last_undegraded":"2024-09-12T01:56:48.069144+0000","last_fullsized":"2024-09-12T01:56:48.069144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.083974+0000","last_change":"2024-09-12T01:56:48.081119+0000","last_active":"2024-09-12T01:56:48.083974+0000","last_peered":"2024-09-12T01:56:48.083974+0000","last_clean":"2024-09-12T01:56:48.083974+0000","last_became_active":"2024-09-12T01:56:48.080833+0000","last_became_peered":"2024-09-12T01:56:48.080833+0000","last_unstale":"2024-09-12T01:56:48.083974+0000","last_undegraded":"2024-09-12T01:56:48.083974+0000","last_fullsized":"2024-09-12T01:56:48.083974+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:36.404814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104601+0000","last_change":"2024-09-12T01:56:49.095989+0000","last_active":"2024-09-12T01:56:49.104601+0000","last_peered":"2024-09-12T01:56:49.104601+0000","last_clean":"2024-09-12T01:56:49.104601+0000","last_became_active":"2024-09-12T01:56:49.095624+0000","last_became_peered":"2024-09-12T01:56:49.095624+0000","last_unstale":"2024-09-12T01:56:49.104601+0000","last_undegraded":"2024-09-12T01:56:49.104601+0000","last_fullsized":"2024-09-12T01:56:49.104601+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:36.644433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.085299+0000","last_change":"2024-09-12T01:56:48.079323+0000","last_active":"2024-09-12T01:56:49.085299+0000","last_peered":"2024-09-12T01:56:49.085299+0000","last_clean":"2024-09-12T01:56:49.085299+0000","last_became_active":"2024-09-12T01:56:48.079064+0000","last_became_peered":"2024-09-12T01:56:48.079064+0000","last_unstale":"2024-09-12T01:56:49.085299+0000","last_undegraded":"2024-09-12T01:56:49.085299+0000","last_fullsized":"2024-09-12T01:56:49.085299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:41.416788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071670+0000","last_change":"2024-09-12T01:56:48.071670+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071670+0000","last_undegraded":"2024-09-12T01:56:48.071670+0000","last_fullsized":"2024-09-12T01:56:48.071670+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.084049+0000","last_change":"2024-09-12T01:56:48.080729+0000","last_active":"2024-09-12T01:56:48.084049+0000","last_peered":"2024-09-12T01:56:48.084049+0000","last_clean":"2024-09-12T01:56:48.084049+0000","last_became_active":"2024-09-12T01:56:48.079864+0000","last_became_peered":"2024-09-12T01:56:48.079864+0000","last_unstale":"2024-09-12T01:56:48.084049+0000","last_undegraded":"2024-09-12T01:56:48.084049+0000","last_fullsized":"2024-09-12T01:56:48.084049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:41.061958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.075231+0000","last_change":"2024-09-12T01:56:48.075231+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.075231+0000","last_undegraded":"2024-09-12T01:56:48.075231+0000","last_fullsized":"2024-09-12T01:56:48.075231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.110710+0000","last_change":"2024-09-12T01:56:48.086993+0000","last_active":"2024-09-12T01:56:49.110710+0000","last_peered":"2024-09-12T01:56:49.110710+0000","last_clean":"2024-09-12T01:56:49.110710+0000","last_became_active":"2024-09-12T01:56:48.086487+0000","last_became_peered":"2024-09-12T01:56:48.086487+0000","last_unstale":"2024-09-12T01:56:49.110710+0000","last_undegraded":"2024-09-12T01:56:49.110710+0000","last_fullsized":"2024-09-12T01:56:49.110710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:10.954294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099651+0000","last_change":"2024-09-12T01:56:49.093510+0000","last_active":"2024-09-12T01:56:49.099651+0000","last_peered":"2024-09-12T01:56:49.099651+0000","last_clean":"2024-09-12T01:56:49.099651+0000","last_became_active":"2024-09-12T01:56:49.092875+0000","last_became_peered":"2024-09-12T01:56:49.092875+0000","last_unstale":"2024-09-12T01:56:49.099651+0000","last_undegraded":"2024-09-12T01:56:49.099651+0000","last_fullsized":"2024-09-12T01:56:49.099651+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:11.959033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.091762+0000","last_change":"2024-09-12T01:56:48.086941+0000","last_active":"2024-09-12T01:56:48.091762+0000","last_peered":"2024-09-12T01:56:48.091762+0000","last_clean":"2024-09-12T01:56:48.091762+0000","last_became_active":"2024-09-12T01:56:48.086626+0000","last_became_peered":"2024-09-12T01:56:48.086626+0000","last_unstale":"2024-09-12T01:56:48.091762+0000","last_undegraded":"2024-09-12T01:56:48.091762+0000","last_fullsized":"2024-09-12T01:56:48.091762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:02.752474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.072071+0000","last_change":"2024-09-12T01:56:48.072071+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.072071+0000","last_undegraded":"2024-09-12T01:56:48.072071+0000","last_fullsized":"2024-09-12T01:56:48.072071+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.089060+0000","last_change":"2024-09-12T01:56:48.084372+0000","last_active":"2024-09-12T01:56:48.089060+0000","last_peered":"2024-09-12T01:56:48.089060+0000","last_clean":"2024-09-12T01:56:48.089060+0000","last_became_active":"2024-09-12T01:56:48.084012+0000","last_became_peered":"2024-09-12T01:56:48.084012+0000","last_unstale":"2024-09-12T01:56:48.089060+0000","last_undegraded":"2024-09-12T01:56:48.089060+0000","last_fullsized":"2024-09-12T01:56:48.089060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:26.586415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069653+0000","last_change":"2024-09-12T01:56:48.069653+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069653+0000","last_undegraded":"2024-09-12T01:56:48.069653+0000","last_fullsized":"2024-09-12T01:56:48.069653+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.075260+0000","last_change":"2024-09-12T01:56:48.074045+0000","last_active":"2024-09-12T01:56:48.075260+0000","last_peered":"2024-09-12T01:56:48.075260+0000","last_clean":"2024-09-12T01:56:48.075260+0000","last_became_active":"2024-09-12T01:56:48.073680+0000","last_became_peered":"2024-09-12T01:56:48.073680+0000","last_unstale":"2024-09-12T01:56:48.075260+0000","last_undegraded":"2024-09-12T01:56:48.075260+0000","last_fullsized":"2024-09-12T01:56:48.075260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:06.321418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.074317+0000","last_change":"2024-09-12T01:56:48.074317+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.074317+0000","last_undegraded":"2024-09-12T01:56:48.074317+0000","last_fullsized":"2024-09-12T01:56:48.074317+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.080051+0000","last_change":"2024-09-12T01:56:48.076087+0000","last_active":"2024-09-12T01:56:49.080051+0000","last_peered":"2024-09-12T01:56:49.080051+0000","last_clean":"2024-09-12T01:56:49.080051+0000","last_became_active":"2024-09-12T01:56:48.075803+0000","last_became_peered":"2024-09-12T01:56:48.075803+0000","last_unstale":"2024-09-12T01:56:49.080051+0000","last_undegraded":"2024-09-12T01:56:49.080051+0000","last_fullsized":"2024-09-12T01:56:49.080051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:27.805990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T01:56:47.064248+0000","last_change":"2024-09-12T01:56:47.064248+0000","last_active":"2024-09-12T01:56:47.056365+0000","last_peered":"2024-09-12T01:56:47.056365+0000","last_clean":"2024-09-12T01:56:47.056365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:47.064248+0000","last_undegraded":"2024-09-12T01:56:47.064248+0000","last_fullsized":"2024-09-12T01:56:47.064248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.095869+0000","last_change":"2024-09-12T01:56:49.091608+0000","last_active":"2024-09-12T01:56:49.095869+0000","last_peered":"2024-09-12T01:56:49.095869+0000","last_clean":"2024-09-12T01:56:49.095869+0000","last_became_active":"2024-09-12T01:56:49.090710+0000","last_became_peered":"2024-09-12T01:56:49.090710+0000","last_unstale":"2024-09-12T01:56:49.095869+0000","last_undegraded":"2024-09-12T01:56:49.095869+0000","last_fullsized":"2024-09-12T01:56:49.095869+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:18.709627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.091829+0000","last_change":"2024-09-12T01:56:48.086306+0000","last_active":"2024-09-12T01:56:48.091829+0000","last_peered":"2024-09-12T01:56:48.091829+0000","last_clean":"2024-09-12T01:56:48.091829+0000","last_became_active":"2024-09-12T01:56:48.085519+0000","last_became_peered":"2024-09-12T01:56:48.085519+0000","last_unstale":"2024-09-12T01:56:48.091829+0000","last_undegraded":"2024-09-12T01:56:48.091829+0000","last_fullsized":"2024-09-12T01:56:48.091829+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:09.193086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104372+0000","last_change":"2024-09-12T01:56:49.096214+0000","last_active":"2024-09-12T01:56:49.104372+0000","last_peered":"2024-09-12T01:56:49.104372+0000","last_clean":"2024-09-12T01:56:49.104372+0000","last_became_active":"2024-09-12T01:56:49.095889+0000","last_became_peered":"2024-09-12T01:56:49.095889+0000","last_unstale":"2024-09-12T01:56:49.104372+0000","last_undegraded":"2024-09-12T01:56:49.104372+0000","last_fullsized":"2024-09-12T01:56:49.104372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:38.096087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.086070+0000","last_change":"2024-09-12T01:56:48.082804+0000","last_active":"2024-09-12T01:56:49.086070+0000","last_peered":"2024-09-12T01:56:49.086070+0000","last_clean":"2024-09-12T01:56:49.086070+0000","last_became_active":"2024-09-12T01:56:48.082323+0000","last_became_peered":"2024-09-12T01:56:48.082323+0000","last_unstale":"2024-09-12T01:56:49.086070+0000","last_undegraded":"2024-09-12T01:56:49.086070+0000","last_fullsized":"2024-09-12T01:56:49.086070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:45.367043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":202,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.084948+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:56:49.084948+0000","last_peered":"2024-09-12T01:56:49.084948+0000","last_clean":"2024-09-12T01:56:49.084948+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:56:49.084948+0000","last_undegraded":"2024-09-12T01:56:49.084948+0000","last_fullsized":"2024-09-12T01:56:49.084948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":773849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":183481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":183481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1011712,"data_stored":767182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":405504,"data_stored":170605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:56:52.077 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:56:52.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.216+0000 7f9e94f9f640 1 Processor -- start 2024-09-12T01:56:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.216+0000 7f9e94f9f640 1 -- start start 2024-09-12T01:56:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.217+0000 7f9e94f9f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e90145b20 0x7f9e9015e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.217+0000 7f9e94f9f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e9015ee10 con 0x7f9e9006c320 2024-09-12T01:56:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.217+0000 7f9e94f9f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e9015f0f0 con 0x7f9e9015e900 2024-09-12T01:56:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.217+0000 7f9e94f9f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9e9015f3d0 con 0x7f9e90145b20 2024-09-12T01:56:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.217+0000 7f9e8ffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9e9006c320 0x7f9e900af920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43814/0 (socket says 172.21.15.19:43814) 2024-09-12T01:56:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.217+0000 7f9e8ffff640 1 -- 172.21.15.19:0/660159594 learned_addr learned my addr 172.21.15.19:0/660159594 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.217+0000 7f9e8f7fe640 1 --2- 172.21.15.19:0/660159594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e90145b20 0x7f9e9015e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.217+0000 7f9e8e7fc640 1 -- 172.21.15.19:0/660159594 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2741227500 0 0) 0x7f9e9015ee10 con 0x7f9e9006c320 2024-09-12T01:56:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8e7fc640 1 -- 172.21.15.19:0/660159594 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e78003520 con 0x7f9e9006c320 2024-09-12T01:56:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8e7fc640 1 -- 172.21.15.19:0/660159594 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2673655483 0 0) 0x7f9e78003520 con 0x7f9e9006c320 2024-09-12T01:56:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8e7fc640 1 -- 172.21.15.19:0/660159594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e90145b20 msgr2=0x7f9e9015e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8e7fc640 1 --2- 172.21.15.19:0/660159594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e90145b20 0x7f9e9015e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8e7fc640 1 -- 172.21.15.19:0/660159594 >> v1:172.21.15.135:6789/0 conn(0x7f9e9015e900 legacy=0x7f9e9006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8e7fc640 1 -- 172.21.15.19:0/660159594 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9015f6b0 con 0x7f9e9006c320 2024-09-12T01:56:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8e7fc640 1 -- 172.21.15.19:0/660159594 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f9e880019f0 con 0x7f9e9006c320 2024-09-12T01:56:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8e7fc640 1 -- 172.21.15.19:0/660159594 >> v1:172.21.15.19:6789/0 conn(0x7f9e9006c320 legacy=0x7f9e900af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8e7fc640 1 --2- 172.21.15.19:0/660159594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e780039e0 0x7f9e78003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8e7fc640 1 --2- 172.21.15.19:0/660159594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e78004800 0x7f9e78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8e7fc640 1 --2- 172.21.15.19:0/660159594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e90145b20 0x7f9e78005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8e7fc640 1 -- 172.21.15.19:0/660159594 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9015f3d0 con 0x7f9e78004800 2024-09-12T01:56:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8e7fc640 1 -- 172.21.15.19:0/660159594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7800baf0 con 0x7f9e780039e0 2024-09-12T01:56:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8e7fc640 1 -- 172.21.15.19:0/660159594 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9e7800bcf0 con 0x7f9e90145b20 2024-09-12T01:56:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8effd640 1 --2- 172.21.15.19:0/660159594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e78004800 0x7f9e78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8f7fe640 1 --2- 172.21.15.19:0/660159594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e780039e0 0x7f9e78003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8ffff640 1 --2- 172.21.15.19:0/660159594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e90145b20 0x7f9e78005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8effd640 1 -- 172.21.15.19:0/660159594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e90145b20 msgr2=0x7f9e78005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:52.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8effd640 1 --2- 172.21.15.19:0/660159594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e90145b20 0x7f9e78005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8effd640 1 -- 172.21.15.19:0/660159594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e780039e0 msgr2=0x7f9e78003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:52.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8effd640 1 --2- 172.21.15.19:0/660159594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e780039e0 0x7f9e78003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.218+0000 7f9e8effd640 1 -- 172.21.15.19:0/660159594 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e78003520 con 0x7f9e78004800 2024-09-12T01:56:52.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.219+0000 7f9e8effd640 1 --2- 172.21.15.19:0/660159594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e78004800 0x7f9e78004c80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9e84001720 tx=0x7f9e78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8927a8b970d00a5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:52.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.219+0000 7f9e8e7fc640 1 -- 172.21.15.19:0/660159594 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84001370 con 0x7f9e78004800 2024-09-12T01:56:52.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.219+0000 7f9e8e7fc640 1 -- 172.21.15.19:0/660159594 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e840052d0 con 0x7f9e78004800 2024-09-12T01:56:52.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.219+0000 7f9e8e7fc640 1 -- 172.21.15.19:0/660159594 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8402abc0 con 0x7f9e78004800 2024-09-12T01:56:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.220+0000 7f9e94f9f640 1 -- 172.21.15.19:0/660159594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e78004800 msgr2=0x7f9e78004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.220+0000 7f9e94f9f640 1 --2- 172.21.15.19:0/660159594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e78004800 0x7f9e78004c80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9e84001720 tx=0x7f9e78005830 comp rx=0 tx=0).stop 2024-09-12T01:56:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.220+0000 7f9e8ffff640 1 -- 172.21.15.19:0/660159594 reap_dead start 2024-09-12T01:56:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.220+0000 7f9e94f9f640 1 -- 172.21.15.19:0/660159594 shutdown_connections 2024-09-12T01:56:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.220+0000 7f9e94f9f640 1 -- 172.21.15.19:0/660159594 >> 172.21.15.19:0/660159594 conn(0x7f9e9009aa30 msgr2=0x7f9e900b6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.220+0000 7f9e94f9f640 1 -- 172.21.15.19:0/660159594 shutdown_connections 2024-09-12T01:56:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.220+0000 7f9e94f9f640 1 -- 172.21.15.19:0/660159594 wait complete. 2024-09-12T01:56:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.221+0000 7f9e94f9f640 1 Processor -- start 2024-09-12T01:56:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.221+0000 7f9e94f9f640 1 -- start start 2024-09-12T01:56:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.222+0000 7f9e94f9f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e78004800 0x7f9e9013b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.222+0000 7f9e94f9f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e9015bd00 0x7f9e90142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.222+0000 7f9e94f9f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e900cd810 0x7f9e900cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.222+0000 7f9e94f9f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9e900b7060 con 0x7f9e9015bd00 2024-09-12T01:56:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.222+0000 7f9e94f9f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9e900b6ee0 con 0x7f9e900cd810 2024-09-12T01:56:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.222+0000 7f9e94f9f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9e9015e3c0 con 0x7f9e78004800 2024-09-12T01:56:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.222+0000 7f9e8effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e9015bd00 0x7f9e90142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.222+0000 7f9e8effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e9015bd00 0x7f9e90142a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53050/0 (socket says 172.21.15.19:53050) 2024-09-12T01:56:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.222+0000 7f9e8effd640 1 -- 172.21.15.19:0/2605545527 learned_addr learned my addr 172.21.15.19:0/2605545527 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.222+0000 7f9e8f7fe640 1 --2- 172.21.15.19:0/2605545527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e78004800 0x7f9e9013b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.222+0000 7f9e8ffff640 1 --2- 172.21.15.19:0/2605545527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e900cd810 0x7f9e900cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.222+0000 7f9e8effd640 1 -- 172.21.15.19:0/2605545527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e78004800 msgr2=0x7f9e9013b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.222+0000 7f9e8effd640 1 --2- 172.21.15.19:0/2605545527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e78004800 0x7f9e9013b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.222+0000 7f9e8effd640 1 -- 172.21.15.19:0/2605545527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e900cd810 msgr2=0x7f9e900cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.222+0000 7f9e8effd640 1 --2- 172.21.15.19:0/2605545527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e900cd810 0x7f9e900cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.222+0000 7f9e8effd640 1 -- 172.21.15.19:0/2605545527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e90143280 con 0x7f9e9015bd00 2024-09-12T01:56:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.223+0000 7f9e8effd640 1 --2- 172.21.15.19:0/2605545527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e9015bd00 0x7f9e90142a30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9e84005040 tx=0x7f9e84001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.223+0000 7f9e77fff640 1 -- 172.21.15.19:0/2605545527 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84042070 con 0x7f9e9015bd00 2024-09-12T01:56:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.223+0000 7f9e77fff640 1 -- 172.21.15.19:0/2605545527 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e84005480 con 0x7f9e9015bd00 2024-09-12T01:56:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.223+0000 7f9e77fff640 1 -- 172.21.15.19:0/2605545527 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84037040 con 0x7f9e9015bd00 2024-09-12T01:56:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.223+0000 7f9e94f9f640 1 -- 172.21.15.19:0/2605545527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e90143560 con 0x7f9e9015bd00 2024-09-12T01:56:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.223+0000 7f9e94f9f640 1 -- 172.21.15.19:0/2605545527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e901f2620 con 0x7f9e9015bd00 2024-09-12T01:56:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.224+0000 7f9e94f9f640 1 -- 172.21.15.19:0/2605545527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e9006bc10 con 0x7f9e9015bd00 2024-09-12T01:56:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.224+0000 7f9e77fff640 1 -- 172.21.15.19:0/2605545527 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e84045070 con 0x7f9e9015bd00 2024-09-12T01:56:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.225+0000 7f9e77fff640 1 --2- 172.21.15.19:0/2605545527 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e7c06be30 0x7f9e7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.225+0000 7f9e77fff640 1 -- 172.21.15.19:0/2605545527 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f9e840aa7c0 con 0x7f9e9015bd00 2024-09-12T01:56:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.225+0000 7f9e8f7fe640 1 --2- 172.21.15.19:0/2605545527 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e7c06be30 0x7f9e7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.226+0000 7f9e8f7fe640 1 --2- 172.21.15.19:0/2605545527 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e7c06be30 0x7f9e7c06e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9e80009a80 tx=0x7f9e80008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:52.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.229+0000 7f9e77fff640 1 -- 172.21.15.19:0/2605545527 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e84078fe0 con 0x7f9e9015bd00 2024-09-12T01:56:52.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.402+0000 7f9e94f9f640 1 -- 172.21.15.19:0/2605545527 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9e9006fd50 con 0x7f9e7c06be30 2024-09-12T01:56:52.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.408+0000 7f9e77fff640 1 -- 172.21.15.19:0/2605545527 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248078 (secure 0 0 0) 0x7f9e9006fd50 con 0x7f9e7c06be30 2024-09-12T01:56:52.411 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:56:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.411+0000 7f9e94f9f640 1 -- 172.21.15.19:0/2605545527 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e7c06be30 msgr2=0x7f9e7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.411+0000 7f9e94f9f640 1 --2- 172.21.15.19:0/2605545527 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e7c06be30 0x7f9e7c06e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9e80009a80 tx=0x7f9e80008040 comp rx=0 tx=0).stop 2024-09-12T01:56:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.411+0000 7f9e94f9f640 1 -- 172.21.15.19:0/2605545527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e9015bd00 msgr2=0x7f9e90142a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.411+0000 7f9e94f9f640 1 --2- 172.21.15.19:0/2605545527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e9015bd00 0x7f9e90142a30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9e84005040 tx=0x7f9e84001120 comp rx=0 tx=0).stop 2024-09-12T01:56:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.411+0000 7f9e94f9f640 1 -- 172.21.15.19:0/2605545527 shutdown_connections 2024-09-12T01:56:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.411+0000 7f9e94f9f640 1 --2- 172.21.15.19:0/2605545527 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e7c06be30 0x7f9e7c06e2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.411+0000 7f9e94f9f640 1 --2- 172.21.15.19:0/2605545527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e900cd810 0x7f9e900cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.411+0000 7f9e94f9f640 1 --2- 172.21.15.19:0/2605545527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e9015bd00 0x7f9e90142a30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.411+0000 7f9e94f9f640 1 --2- 172.21.15.19:0/2605545527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e78004800 0x7f9e9013b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.411+0000 7f9e94f9f640 1 -- 172.21.15.19:0/2605545527 >> 172.21.15.19:0/2605545527 conn(0x7f9e9009aa30 msgr2=0x7f9e90070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.411+0000 7f9e94f9f640 1 -- 172.21.15.19:0/2605545527 shutdown_connections 2024-09-12T01:56:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.411+0000 7f9e94f9f640 1 -- 172.21.15.19:0/2605545527 wait complete. 2024-09-12T01:56:52.422 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-12T01:56:52.097903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":183,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220680,"kb_used_data":4448,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754040,"statfs":{"total":773094113280,"available":772868136960,"internally_reserved":0,"allocated":4554752,"data_stored":2609040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.035864"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.074094+0000","last_change":"2024-09-12T01:56:48.074094+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.074094+0000","last_undegraded":"2024-09-12T01:56:48.074094+0000","last_fullsized":"2024-09-12T01:56:48.074094+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.072752+0000","last_change":"2024-09-12T01:56:48.072752+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.072752+0000","last_undegraded":"2024-09-12T01:56:48.072752+0000","last_fullsized":"2024-09-12T01:56:48.072752+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070857+0000","last_change":"2024-09-12T01:56:48.070857+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070857+0000","last_undegraded":"2024-09-12T01:56:48.070857+0000","last_fullsized":"2024-09-12T01:56:48.070857+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071680+0000","last_change":"2024-09-12T01:56:48.071680+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071680+0000","last_undegraded":"2024-09-12T01:56:48.071680+0000","last_fullsized":"2024-09-12T01:56:48.071680+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071211+0000","last_change":"2024-09-12T01:56:48.071211+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071211+0000","last_undegraded":"2024-09-12T01:56:48.071211+0000","last_fullsized":"2024-09-12T01:56:48.071211+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.077153+0000","last_change":"2024-09-12T01:56:48.077153+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.077153+0000","last_undegraded":"2024-09-12T01:56:48.077153+0000","last_fullsized":"2024-09-12T01:56:48.077153+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104551+0000","last_change":"2024-09-12T01:56:49.095662+0000","last_active":"2024-09-12T01:56:49.104551+0000","last_peered":"2024-09-12T01:56:49.104551+0000","last_clean":"2024-09-12T01:56:49.104551+0000","last_became_active":"2024-09-12T01:56:49.095303+0000","last_became_peered":"2024-09-12T01:56:49.095303+0000","last_unstale":"2024-09-12T01:56:49.104551+0000","last_undegraded":"2024-09-12T01:56:49.104551+0000","last_fullsized":"2024-09-12T01:56:49.104551+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:08.496640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069837+0000","last_change":"2024-09-12T01:56:48.069837+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069837+0000","last_undegraded":"2024-09-12T01:56:48.069837+0000","last_fullsized":"2024-09-12T01:56:48.069837+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070676+0000","last_change":"2024-09-12T01:56:48.070676+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070676+0000","last_undegraded":"2024-09-12T01:56:48.070676+0000","last_fullsized":"2024-09-12T01:56:48.070676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107459+0000","last_change":"2024-09-12T01:56:49.100284+0000","last_active":"2024-09-12T01:56:49.107459+0000","last_peered":"2024-09-12T01:56:49.107459+0000","last_clean":"2024-09-12T01:56:49.107459+0000","last_became_active":"2024-09-12T01:56:49.100012+0000","last_became_peered":"2024-09-12T01:56:49.100012+0000","last_unstale":"2024-09-12T01:56:49.107459+0000","last_undegraded":"2024-09-12T01:56:49.107459+0000","last_fullsized":"2024-09-12T01:56:49.107459+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:27.444535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099908+0000","last_change":"2024-09-12T01:56:49.092104+0000","last_active":"2024-09-12T01:56:49.099908+0000","last_peered":"2024-09-12T01:56:49.099908+0000","last_clean":"2024-09-12T01:56:49.099908+0000","last_became_active":"2024-09-12T01:56:49.091831+0000","last_became_peered":"2024-09-12T01:56:49.091831+0000","last_unstale":"2024-09-12T01:56:49.099908+0000","last_undegraded":"2024-09-12T01:56:49.099908+0000","last_fullsized":"2024-09-12T01:56:49.099908+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:30.275429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069910+0000","last_change":"2024-09-12T01:56:48.069910+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069910+0000","last_undegraded":"2024-09-12T01:56:48.069910+0000","last_fullsized":"2024-09-12T01:56:48.069910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104911+0000","last_change":"2024-09-12T01:56:49.097145+0000","last_active":"2024-09-12T01:56:49.104911+0000","last_peered":"2024-09-12T01:56:49.104911+0000","last_clean":"2024-09-12T01:56:49.104911+0000","last_became_active":"2024-09-12T01:56:49.096854+0000","last_became_peered":"2024-09-12T01:56:49.096854+0000","last_unstale":"2024-09-12T01:56:49.104911+0000","last_undegraded":"2024-09-12T01:56:49.104911+0000","last_fullsized":"2024-09-12T01:56:49.104911+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:10.499892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104572+0000","last_change":"2024-09-12T01:56:49.098596+0000","last_active":"2024-09-12T01:56:49.104572+0000","last_peered":"2024-09-12T01:56:49.104572+0000","last_clean":"2024-09-12T01:56:49.104572+0000","last_became_active":"2024-09-12T01:56:49.096857+0000","last_became_peered":"2024-09-12T01:56:49.096857+0000","last_unstale":"2024-09-12T01:56:49.104572+0000","last_undegraded":"2024-09-12T01:56:49.104572+0000","last_fullsized":"2024-09-12T01:56:49.104572+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:30.650006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103449+0000","last_change":"2024-09-12T01:56:49.098562+0000","last_active":"2024-09-12T01:56:49.103449+0000","last_peered":"2024-09-12T01:56:49.103449+0000","last_clean":"2024-09-12T01:56:49.103449+0000","last_became_active":"2024-09-12T01:56:49.098285+0000","last_became_peered":"2024-09-12T01:56:49.098285+0000","last_unstale":"2024-09-12T01:56:49.103449+0000","last_undegraded":"2024-09-12T01:56:49.103449+0000","last_fullsized":"2024-09-12T01:56:49.103449+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:10.499892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103274+0000","last_change":"2024-09-12T01:56:49.097918+0000","last_active":"2024-09-12T01:56:49.103274+0000","last_peered":"2024-09-12T01:56:49.103274+0000","last_clean":"2024-09-12T01:56:49.103274+0000","last_became_active":"2024-09-12T01:56:49.097595+0000","last_became_peered":"2024-09-12T01:56:49.097595+0000","last_unstale":"2024-09-12T01:56:49.103274+0000","last_undegraded":"2024-09-12T01:56:49.103274+0000","last_fullsized":"2024-09-12T01:56:49.103274+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:40.245592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.095664+0000","last_change":"2024-09-12T01:56:49.090304+0000","last_active":"2024-09-12T01:56:49.095664+0000","last_peered":"2024-09-12T01:56:49.095664+0000","last_clean":"2024-09-12T01:56:49.095664+0000","last_became_active":"2024-09-12T01:56:49.089928+0000","last_became_peered":"2024-09-12T01:56:49.089928+0000","last_unstale":"2024-09-12T01:56:49.095664+0000","last_undegraded":"2024-09-12T01:56:49.095664+0000","last_fullsized":"2024-09-12T01:56:49.095664+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:23.477178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070725+0000","last_change":"2024-09-12T01:56:48.070725+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070725+0000","last_undegraded":"2024-09-12T01:56:48.070725+0000","last_fullsized":"2024-09-12T01:56:48.070725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099144+0000","last_change":"2024-09-12T01:56:49.093382+0000","last_active":"2024-09-12T01:56:49.099144+0000","last_peered":"2024-09-12T01:56:49.099144+0000","last_clean":"2024-09-12T01:56:49.099144+0000","last_became_active":"2024-09-12T01:56:49.093060+0000","last_became_peered":"2024-09-12T01:56:49.093060+0000","last_unstale":"2024-09-12T01:56:49.099144+0000","last_undegraded":"2024-09-12T01:56:49.099144+0000","last_fullsized":"2024-09-12T01:56:49.099144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:41.113310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107723+0000","last_change":"2024-09-12T01:56:49.102971+0000","last_active":"2024-09-12T01:56:49.107723+0000","last_peered":"2024-09-12T01:56:49.107723+0000","last_clean":"2024-09-12T01:56:49.107723+0000","last_became_active":"2024-09-12T01:56:49.102708+0000","last_became_peered":"2024-09-12T01:56:49.102708+0000","last_unstale":"2024-09-12T01:56:49.107723+0000","last_undegraded":"2024-09-12T01:56:49.107723+0000","last_fullsized":"2024-09-12T01:56:49.107723+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:26.195981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103132+0000","last_change":"2024-09-12T01:56:49.094962+0000","last_active":"2024-09-12T01:56:49.103132+0000","last_peered":"2024-09-12T01:56:49.103132+0000","last_clean":"2024-09-12T01:56:49.103132+0000","last_became_active":"2024-09-12T01:56:49.094689+0000","last_became_peered":"2024-09-12T01:56:49.094689+0000","last_unstale":"2024-09-12T01:56:49.103132+0000","last_undegraded":"2024-09-12T01:56:49.103132+0000","last_fullsized":"2024-09-12T01:56:49.103132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:44.543744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070901+0000","last_change":"2024-09-12T01:56:48.070901+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070901+0000","last_undegraded":"2024-09-12T01:56:48.070901+0000","last_fullsized":"2024-09-12T01:56:48.070901+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104095+0000","last_change":"2024-09-12T01:56:49.094852+0000","last_active":"2024-09-12T01:56:49.104095+0000","last_peered":"2024-09-12T01:56:49.104095+0000","last_clean":"2024-09-12T01:56:49.104095+0000","last_became_active":"2024-09-12T01:56:49.094582+0000","last_became_peered":"2024-09-12T01:56:49.094582+0000","last_unstale":"2024-09-12T01:56:49.104095+0000","last_undegraded":"2024-09-12T01:56:49.104095+0000","last_fullsized":"2024-09-12T01:56:49.104095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:42.421526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.075748+0000","last_change":"2024-09-12T01:56:48.075748+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.075748+0000","last_undegraded":"2024-09-12T01:56:48.075748+0000","last_fullsized":"2024-09-12T01:56:48.075748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103662+0000","last_change":"2024-09-12T01:56:49.095001+0000","last_active":"2024-09-12T01:56:49.103662+0000","last_peered":"2024-09-12T01:56:49.103662+0000","last_clean":"2024-09-12T01:56:49.103662+0000","last_became_active":"2024-09-12T01:56:49.094730+0000","last_became_peered":"2024-09-12T01:56:49.094730+0000","last_unstale":"2024-09-12T01:56:49.103662+0000","last_undegraded":"2024-09-12T01:56:49.103662+0000","last_fullsized":"2024-09-12T01:56:49.103662+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:46.371782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099958+0000","last_change":"2024-09-12T01:56:49.091704+0000","last_active":"2024-09-12T01:56:49.099958+0000","last_peered":"2024-09-12T01:56:49.099958+0000","last_clean":"2024-09-12T01:56:49.099958+0000","last_became_active":"2024-09-12T01:56:49.091369+0000","last_became_peered":"2024-09-12T01:56:49.091369+0000","last_unstale":"2024-09-12T01:56:49.099958+0000","last_undegraded":"2024-09-12T01:56:49.099958+0000","last_fullsized":"2024-09-12T01:56:49.099958+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:40.245592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107570+0000","last_change":"2024-09-12T01:56:49.102931+0000","last_active":"2024-09-12T01:56:49.107570+0000","last_peered":"2024-09-12T01:56:49.107570+0000","last_clean":"2024-09-12T01:56:49.107570+0000","last_became_active":"2024-09-12T01:56:49.102638+0000","last_became_peered":"2024-09-12T01:56:49.102638+0000","last_unstale":"2024-09-12T01:56:49.107570+0000","last_undegraded":"2024-09-12T01:56:49.107570+0000","last_fullsized":"2024-09-12T01:56:49.107570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:18.709627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.092187+0000","last_change":"2024-09-12T01:56:49.088392+0000","last_active":"2024-09-12T01:56:49.092187+0000","last_peered":"2024-09-12T01:56:49.092187+0000","last_clean":"2024-09-12T01:56:49.092187+0000","last_became_active":"2024-09-12T01:56:49.088100+0000","last_became_peered":"2024-09-12T01:56:49.088100+0000","last_unstale":"2024-09-12T01:56:49.092187+0000","last_undegraded":"2024-09-12T01:56:49.092187+0000","last_fullsized":"2024-09-12T01:56:49.092187+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:22.615266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103382+0000","last_change":"2024-09-12T01:56:49.098430+0000","last_active":"2024-09-12T01:56:49.103382+0000","last_peered":"2024-09-12T01:56:49.103382+0000","last_clean":"2024-09-12T01:56:49.103382+0000","last_became_active":"2024-09-12T01:56:49.098144+0000","last_became_peered":"2024-09-12T01:56:49.098144+0000","last_unstale":"2024-09-12T01:56:49.103382+0000","last_undegraded":"2024-09-12T01:56:49.103382+0000","last_fullsized":"2024-09-12T01:56:49.103382+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:38.096087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.074304+0000","last_change":"2024-09-12T01:56:48.074304+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.074304+0000","last_undegraded":"2024-09-12T01:56:48.074304+0000","last_fullsized":"2024-09-12T01:56:48.074304+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103361+0000","last_change":"2024-09-12T01:56:49.097725+0000","last_active":"2024-09-12T01:56:49.103361+0000","last_peered":"2024-09-12T01:56:49.103361+0000","last_clean":"2024-09-12T01:56:49.103361+0000","last_became_active":"2024-09-12T01:56:49.097049+0000","last_became_peered":"2024-09-12T01:56:49.097049+0000","last_unstale":"2024-09-12T01:56:49.103361+0000","last_undegraded":"2024-09-12T01:56:49.103361+0000","last_fullsized":"2024-09-12T01:56:49.103361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:36.644433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.108732+0000","last_change":"2024-09-12T01:56:48.083339+0000","last_active":"2024-09-12T01:56:49.108732+0000","last_peered":"2024-09-12T01:56:49.108732+0000","last_clean":"2024-09-12T01:56:49.108732+0000","last_became_active":"2024-09-12T01:56:48.083086+0000","last_became_peered":"2024-09-12T01:56:48.083086+0000","last_unstale":"2024-09-12T01:56:49.108732+0000","last_undegraded":"2024-09-12T01:56:49.108732+0000","last_fullsized":"2024-09-12T01:56:49.108732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:26.586415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.078670+0000","last_change":"2024-09-12T01:56:48.078670+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.078670+0000","last_undegraded":"2024-09-12T01:56:48.078670+0000","last_fullsized":"2024-09-12T01:56:48.078670+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.086032+0000","last_change":"2024-09-12T01:56:48.082903+0000","last_active":"2024-09-12T01:56:48.086032+0000","last_peered":"2024-09-12T01:56:48.086032+0000","last_clean":"2024-09-12T01:56:48.086032+0000","last_became_active":"2024-09-12T01:56:48.082585+0000","last_became_peered":"2024-09-12T01:56:48.082585+0000","last_unstale":"2024-09-12T01:56:48.086032+0000","last_undegraded":"2024-09-12T01:56:48.086032+0000","last_fullsized":"2024-09-12T01:56:48.086032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:27.805990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.088719+0000","last_change":"2024-09-12T01:56:48.084769+0000","last_active":"2024-09-12T01:56:48.088719+0000","last_peered":"2024-09-12T01:56:48.088719+0000","last_clean":"2024-09-12T01:56:48.088719+0000","last_became_active":"2024-09-12T01:56:48.084356+0000","last_became_peered":"2024-09-12T01:56:48.084356+0000","last_unstale":"2024-09-12T01:56:48.088719+0000","last_undegraded":"2024-09-12T01:56:48.088719+0000","last_fullsized":"2024-09-12T01:56:48.088719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:06.724111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.074518+0000","last_change":"2024-09-12T01:56:48.074518+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.074518+0000","last_undegraded":"2024-09-12T01:56:48.074518+0000","last_fullsized":"2024-09-12T01:56:48.074518+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T01:56:47.063721+0000","last_change":"2024-09-12T01:56:47.063721+0000","last_active":"2024-09-12T01:56:47.056365+0000","last_peered":"2024-09-12T01:56:47.056365+0000","last_clean":"2024-09-12T01:56:47.056365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:47.063721+0000","last_undegraded":"2024-09-12T01:56:47.063721+0000","last_fullsized":"2024-09-12T01:56:47.063721+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071004+0000","last_change":"2024-09-12T01:56:48.071004+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071004+0000","last_undegraded":"2024-09-12T01:56:48.071004+0000","last_fullsized":"2024-09-12T01:56:48.071004+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107598+0000","last_change":"2024-09-12T01:56:48.086406+0000","last_active":"2024-09-12T01:56:49.107598+0000","last_peered":"2024-09-12T01:56:49.107598+0000","last_clean":"2024-09-12T01:56:49.107598+0000","last_became_active":"2024-09-12T01:56:48.086117+0000","last_became_peered":"2024-09-12T01:56:48.086117+0000","last_unstale":"2024-09-12T01:56:49.107598+0000","last_undegraded":"2024-09-12T01:56:49.107598+0000","last_fullsized":"2024-09-12T01:56:49.107598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:45.367043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107899+0000","last_change":"2024-09-12T01:56:49.104426+0000","last_active":"2024-09-12T01:56:49.107899+0000","last_peered":"2024-09-12T01:56:49.107899+0000","last_clean":"2024-09-12T01:56:49.107899+0000","last_became_active":"2024-09-12T01:56:49.103633+0000","last_became_peered":"2024-09-12T01:56:49.103633+0000","last_unstale":"2024-09-12T01:56:49.107899+0000","last_undegraded":"2024-09-12T01:56:49.107899+0000","last_fullsized":"2024-09-12T01:56:49.107899+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:00.426689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.108805+0000","last_change":"2024-09-12T01:56:48.084388+0000","last_active":"2024-09-12T01:56:49.108805+0000","last_peered":"2024-09-12T01:56:49.108805+0000","last_clean":"2024-09-12T01:56:49.108805+0000","last_became_active":"2024-09-12T01:56:48.084111+0000","last_became_peered":"2024-09-12T01:56:48.084111+0000","last_unstale":"2024-09-12T01:56:49.108805+0000","last_undegraded":"2024-09-12T01:56:49.108805+0000","last_fullsized":"2024-09-12T01:56:49.108805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:22.472440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.092038+0000","last_change":"2024-09-12T01:56:48.091222+0000","last_active":"2024-09-12T01:56:48.092038+0000","last_peered":"2024-09-12T01:56:48.092038+0000","last_clean":"2024-09-12T01:56:48.092038+0000","last_became_active":"2024-09-12T01:56:48.090909+0000","last_became_peered":"2024-09-12T01:56:48.090909+0000","last_unstale":"2024-09-12T01:56:48.092038+0000","last_undegraded":"2024-09-12T01:56:48.092038+0000","last_fullsized":"2024-09-12T01:56:48.092038+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:45.171550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.072553+0000","last_change":"2024-09-12T01:56:48.072553+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.072553+0000","last_undegraded":"2024-09-12T01:56:48.072553+0000","last_fullsized":"2024-09-12T01:56:48.072553+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T01:56:47.063531+0000","last_change":"2024-09-12T01:56:47.063531+0000","last_active":"2024-09-12T01:56:47.056365+0000","last_peered":"2024-09-12T01:56:47.056365+0000","last_clean":"2024-09-12T01:56:47.056365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:47.063531+0000","last_undegraded":"2024-09-12T01:56:47.063531+0000","last_fullsized":"2024-09-12T01:56:47.063531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069971+0000","last_change":"2024-09-12T01:56:48.069971+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069971+0000","last_undegraded":"2024-09-12T01:56:48.069971+0000","last_fullsized":"2024-09-12T01:56:48.069971+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.091861+0000","last_change":"2024-09-12T01:56:48.085039+0000","last_active":"2024-09-12T01:56:48.091861+0000","last_peered":"2024-09-12T01:56:48.091861+0000","last_clean":"2024-09-12T01:56:48.091861+0000","last_became_active":"2024-09-12T01:56:48.084764+0000","last_became_peered":"2024-09-12T01:56:48.084764+0000","last_unstale":"2024-09-12T01:56:48.091861+0000","last_undegraded":"2024-09-12T01:56:48.091861+0000","last_fullsized":"2024-09-12T01:56:48.091861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:26.449812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099629+0000","last_change":"2024-09-12T01:56:49.092967+0000","last_active":"2024-09-12T01:56:49.099629+0000","last_peered":"2024-09-12T01:56:49.099629+0000","last_clean":"2024-09-12T01:56:49.099629+0000","last_became_active":"2024-09-12T01:56:49.092693+0000","last_became_peered":"2024-09-12T01:56:49.092693+0000","last_unstale":"2024-09-12T01:56:49.099629+0000","last_undegraded":"2024-09-12T01:56:49.099629+0000","last_fullsized":"2024-09-12T01:56:49.099629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:18.993260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.088574+0000","last_change":"2024-09-12T01:56:48.081300+0000","last_active":"2024-09-12T01:56:49.088574+0000","last_peered":"2024-09-12T01:56:49.088574+0000","last_clean":"2024-09-12T01:56:49.088574+0000","last_became_active":"2024-09-12T01:56:48.080352+0000","last_became_peered":"2024-09-12T01:56:48.080352+0000","last_unstale":"2024-09-12T01:56:49.088574+0000","last_undegraded":"2024-09-12T01:56:49.088574+0000","last_fullsized":"2024-09-12T01:56:49.088574+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:17.988522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071472+0000","last_change":"2024-09-12T01:56:48.071472+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071472+0000","last_undegraded":"2024-09-12T01:56:48.071472+0000","last_fullsized":"2024-09-12T01:56:48.071472+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.110625+0000","last_change":"2024-09-12T01:56:48.084554+0000","last_active":"2024-09-12T01:56:49.110625+0000","last_peered":"2024-09-12T01:56:49.110625+0000","last_clean":"2024-09-12T01:56:49.110625+0000","last_became_active":"2024-09-12T01:56:48.084150+0000","last_became_peered":"2024-09-12T01:56:48.084150+0000","last_unstale":"2024-09-12T01:56:49.110625+0000","last_undegraded":"2024-09-12T01:56:49.110625+0000","last_fullsized":"2024-09-12T01:56:49.110625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:43.539005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.088871+0000","last_change":"2024-09-12T01:56:48.083135+0000","last_active":"2024-09-12T01:56:48.088871+0000","last_peered":"2024-09-12T01:56:48.088871+0000","last_clean":"2024-09-12T01:56:48.088871+0000","last_became_active":"2024-09-12T01:56:48.082844+0000","last_became_peered":"2024-09-12T01:56:48.082844+0000","last_unstale":"2024-09-12T01:56:48.088871+0000","last_undegraded":"2024-09-12T01:56:48.088871+0000","last_fullsized":"2024-09-12T01:56:48.088871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:42.037302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070131+0000","last_change":"2024-09-12T01:56:48.070131+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070131+0000","last_undegraded":"2024-09-12T01:56:48.070131+0000","last_fullsized":"2024-09-12T01:56:48.070131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.079034+0000","last_change":"2024-09-12T01:56:48.076816+0000","last_active":"2024-09-12T01:56:48.079034+0000","last_peered":"2024-09-12T01:56:48.079034+0000","last_clean":"2024-09-12T01:56:48.079034+0000","last_became_active":"2024-09-12T01:56:48.076400+0000","last_became_peered":"2024-09-12T01:56:48.076400+0000","last_unstale":"2024-09-12T01:56:48.079034+0000","last_undegraded":"2024-09-12T01:56:48.079034+0000","last_fullsized":"2024-09-12T01:56:48.079034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:42.760298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069627+0000","last_change":"2024-09-12T01:56:48.069627+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069627+0000","last_undegraded":"2024-09-12T01:56:48.069627+0000","last_fullsized":"2024-09-12T01:56:48.069627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.092021+0000","last_change":"2024-09-12T01:56:48.091263+0000","last_active":"2024-09-12T01:56:48.092021+0000","last_peered":"2024-09-12T01:56:48.092021+0000","last_clean":"2024-09-12T01:56:48.092021+0000","last_became_active":"2024-09-12T01:56:48.090933+0000","last_became_peered":"2024-09-12T01:56:48.090933+0000","last_unstale":"2024-09-12T01:56:48.092021+0000","last_undegraded":"2024-09-12T01:56:48.092021+0000","last_fullsized":"2024-09-12T01:56:48.092021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:00.824926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103325+0000","last_change":"2024-09-12T01:56:49.095408+0000","last_active":"2024-09-12T01:56:49.103325+0000","last_peered":"2024-09-12T01:56:49.103325+0000","last_clean":"2024-09-12T01:56:49.103325+0000","last_became_active":"2024-09-12T01:56:49.095100+0000","last_became_peered":"2024-09-12T01:56:49.095100+0000","last_unstale":"2024-09-12T01:56:49.103325+0000","last_undegraded":"2024-09-12T01:56:49.103325+0000","last_fullsized":"2024-09-12T01:56:49.103325+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:30.275429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.080227+0000","last_change":"2024-09-12T01:56:48.085093+0000","last_active":"2024-09-12T01:56:49.080227+0000","last_peered":"2024-09-12T01:56:49.080227+0000","last_clean":"2024-09-12T01:56:49.080227+0000","last_became_active":"2024-09-12T01:56:48.084794+0000","last_became_peered":"2024-09-12T01:56:48.084794+0000","last_unstale":"2024-09-12T01:56:49.080227+0000","last_undegraded":"2024-09-12T01:56:49.080227+0000","last_fullsized":"2024-09-12T01:56:49.080227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:53.692206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.072096+0000","last_change":"2024-09-12T01:56:48.072096+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.072096+0000","last_undegraded":"2024-09-12T01:56:48.072096+0000","last_fullsized":"2024-09-12T01:56:48.072096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.109217+0000","last_change":"2024-09-12T01:56:48.081824+0000","last_active":"2024-09-12T01:56:49.109217+0000","last_peered":"2024-09-12T01:56:49.109217+0000","last_clean":"2024-09-12T01:56:49.109217+0000","last_became_active":"2024-09-12T01:56:48.081536+0000","last_became_peered":"2024-09-12T01:56:48.081536+0000","last_unstale":"2024-09-12T01:56:49.109217+0000","last_undegraded":"2024-09-12T01:56:49.109217+0000","last_fullsized":"2024-09-12T01:56:49.109217+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:40.108571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.073530+0000","last_change":"2024-09-12T01:56:48.073530+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.073530+0000","last_undegraded":"2024-09-12T01:56:48.073530+0000","last_fullsized":"2024-09-12T01:56:48.073530+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.108566+0000","last_change":"2024-09-12T01:56:48.086519+0000","last_active":"2024-09-12T01:56:49.108566+0000","last_peered":"2024-09-12T01:56:49.108566+0000","last_clean":"2024-09-12T01:56:49.108566+0000","last_became_active":"2024-09-12T01:56:48.086139+0000","last_became_peered":"2024-09-12T01:56:48.086139+0000","last_unstale":"2024-09-12T01:56:49.108566+0000","last_undegraded":"2024-09-12T01:56:49.108566+0000","last_fullsized":"2024-09-12T01:56:49.108566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:17.704888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107860+0000","last_change":"2024-09-12T01:56:49.104837+0000","last_active":"2024-09-12T01:56:49.107860+0000","last_peered":"2024-09-12T01:56:49.107860+0000","last_clean":"2024-09-12T01:56:49.107860+0000","last_became_active":"2024-09-12T01:56:49.103859+0000","last_became_peered":"2024-09-12T01:56:49.103859+0000","last_unstale":"2024-09-12T01:56:49.107860+0000","last_undegraded":"2024-09-12T01:56:49.107860+0000","last_fullsized":"2024-09-12T01:56:49.107860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:25.718464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T01:56:47.063834+0000","last_change":"2024-09-12T01:56:47.063834+0000","last_active":"2024-09-12T01:56:47.056365+0000","last_peered":"2024-09-12T01:56:47.056365+0000","last_clean":"2024-09-12T01:56:47.056365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:47.063834+0000","last_undegraded":"2024-09-12T01:56:47.063834+0000","last_fullsized":"2024-09-12T01:56:47.063834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.081219+0000","last_change":"2024-09-12T01:56:48.073784+0000","last_active":"2024-09-12T01:56:48.081219+0000","last_peered":"2024-09-12T01:56:48.081219+0000","last_clean":"2024-09-12T01:56:48.081219+0000","last_became_active":"2024-09-12T01:56:48.073319+0000","last_became_peered":"2024-09-12T01:56:48.073319+0000","last_unstale":"2024-09-12T01:56:48.081219+0000","last_undegraded":"2024-09-12T01:56:48.081219+0000","last_fullsized":"2024-09-12T01:56:48.081219+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:44.906880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069015+0000","last_change":"2024-09-12T01:56:48.069015+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069015+0000","last_undegraded":"2024-09-12T01:56:48.069015+0000","last_fullsized":"2024-09-12T01:56:48.069015+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.088726+0000","last_change":"2024-09-12T01:56:48.084752+0000","last_active":"2024-09-12T01:56:48.088726+0000","last_peered":"2024-09-12T01:56:48.088726+0000","last_clean":"2024-09-12T01:56:48.088726+0000","last_became_active":"2024-09-12T01:56:48.084474+0000","last_became_peered":"2024-09-12T01:56:48.084474+0000","last_unstale":"2024-09-12T01:56:48.088726+0000","last_undegraded":"2024-09-12T01:56:48.088726+0000","last_fullsized":"2024-09-12T01:56:48.088726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:00.113502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103336+0000","last_change":"2024-09-12T01:56:49.098187+0000","last_active":"2024-09-12T01:56:49.103336+0000","last_peered":"2024-09-12T01:56:49.103336+0000","last_clean":"2024-09-12T01:56:49.103336+0000","last_became_active":"2024-09-12T01:56:49.097323+0000","last_became_peered":"2024-09-12T01:56:49.097323+0000","last_unstale":"2024-09-12T01:56:49.103336+0000","last_undegraded":"2024-09-12T01:56:49.103336+0000","last_fullsized":"2024-09-12T01:56:49.103336+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:08.496640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.083486+0000","last_change":"2024-09-12T01:56:48.080455+0000","last_active":"2024-09-12T01:56:48.083486+0000","last_peered":"2024-09-12T01:56:48.083486+0000","last_clean":"2024-09-12T01:56:48.083486+0000","last_became_active":"2024-09-12T01:56:48.080116+0000","last_became_peered":"2024-09-12T01:56:48.080116+0000","last_unstale":"2024-09-12T01:56:48.083486+0000","last_undegraded":"2024-09-12T01:56:48.083486+0000","last_fullsized":"2024-09-12T01:56:48.083486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:49.059597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069144+0000","last_change":"2024-09-12T01:56:48.069144+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069144+0000","last_undegraded":"2024-09-12T01:56:48.069144+0000","last_fullsized":"2024-09-12T01:56:48.069144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.083974+0000","last_change":"2024-09-12T01:56:48.081119+0000","last_active":"2024-09-12T01:56:48.083974+0000","last_peered":"2024-09-12T01:56:48.083974+0000","last_clean":"2024-09-12T01:56:48.083974+0000","last_became_active":"2024-09-12T01:56:48.080833+0000","last_became_peered":"2024-09-12T01:56:48.080833+0000","last_unstale":"2024-09-12T01:56:48.083974+0000","last_undegraded":"2024-09-12T01:56:48.083974+0000","last_fullsized":"2024-09-12T01:56:48.083974+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:36.404814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104601+0000","last_change":"2024-09-12T01:56:49.095989+0000","last_active":"2024-09-12T01:56:49.104601+0000","last_peered":"2024-09-12T01:56:49.104601+0000","last_clean":"2024-09-12T01:56:49.104601+0000","last_became_active":"2024-09-12T01:56:49.095624+0000","last_became_peered":"2024-09-12T01:56:49.095624+0000","last_unstale":"2024-09-12T01:56:49.104601+0000","last_undegraded":"2024-09-12T01:56:49.104601+0000","last_fullsized":"2024-09-12T01:56:49.104601+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:36.644433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.085299+0000","last_change":"2024-09-12T01:56:48.079323+0000","last_active":"2024-09-12T01:56:49.085299+0000","last_peered":"2024-09-12T01:56:49.085299+0000","last_clean":"2024-09-12T01:56:49.085299+0000","last_became_active":"2024-09-12T01:56:48.079064+0000","last_became_peered":"2024-09-12T01:56:48.079064+0000","last_unstale":"2024-09-12T01:56:49.085299+0000","last_undegraded":"2024-09-12T01:56:49.085299+0000","last_fullsized":"2024-09-12T01:56:49.085299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:41.416788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071670+0000","last_change":"2024-09-12T01:56:48.071670+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071670+0000","last_undegraded":"2024-09-12T01:56:48.071670+0000","last_fullsized":"2024-09-12T01:56:48.071670+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.084049+0000","last_change":"2024-09-12T01:56:48.080729+0000","last_active":"2024-09-12T01:56:48.084049+0000","last_peered":"2024-09-12T01:56:48.084049+0000","last_clean":"2024-09-12T01:56:48.084049+0000","last_became_active":"2024-09-12T01:56:48.079864+0000","last_became_peered":"2024-09-12T01:56:48.079864+0000","last_unstale":"2024-09-12T01:56:48.084049+0000","last_undegraded":"2024-09-12T01:56:48.084049+0000","last_fullsized":"2024-09-12T01:56:48.084049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:41.061958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.075231+0000","last_change":"2024-09-12T01:56:48.075231+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.075231+0000","last_undegraded":"2024-09-12T01:56:48.075231+0000","last_fullsized":"2024-09-12T01:56:48.075231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.110710+0000","last_change":"2024-09-12T01:56:48.086993+0000","last_active":"2024-09-12T01:56:49.110710+0000","last_peered":"2024-09-12T01:56:49.110710+0000","last_clean":"2024-09-12T01:56:49.110710+0000","last_became_active":"2024-09-12T01:56:48.086487+0000","last_became_peered":"2024-09-12T01:56:48.086487+0000","last_unstale":"2024-09-12T01:56:49.110710+0000","last_undegraded":"2024-09-12T01:56:49.110710+0000","last_fullsized":"2024-09-12T01:56:49.110710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:10.954294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099651+0000","last_change":"2024-09-12T01:56:49.093510+0000","last_active":"2024-09-12T01:56:49.099651+0000","last_peered":"2024-09-12T01:56:49.099651+0000","last_clean":"2024-09-12T01:56:49.099651+0000","last_became_active":"2024-09-12T01:56:49.092875+0000","last_became_peered":"2024-09-12T01:56:49.092875+0000","last_unstale":"2024-09-12T01:56:49.099651+0000","last_undegraded":"2024-09-12T01:56:49.099651+0000","last_fullsized":"2024-09-12T01:56:49.099651+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:11.959033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.091762+0000","last_change":"2024-09-12T01:56:48.086941+0000","last_active":"2024-09-12T01:56:48.091762+0000","last_peered":"2024-09-12T01:56:48.091762+0000","last_clean":"2024-09-12T01:56:48.091762+0000","last_became_active":"2024-09-12T01:56:48.086626+0000","last_became_peered":"2024-09-12T01:56:48.086626+0000","last_unstale":"2024-09-12T01:56:48.091762+0000","last_undegraded":"2024-09-12T01:56:48.091762+0000","last_fullsized":"2024-09-12T01:56:48.091762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:02.752474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.072071+0000","last_change":"2024-09-12T01:56:48.072071+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.072071+0000","last_undegraded":"2024-09-12T01:56:48.072071+0000","last_fullsized":"2024-09-12T01:56:48.072071+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.089060+0000","last_change":"2024-09-12T01:56:48.084372+0000","last_active":"2024-09-12T01:56:48.089060+0000","last_peered":"2024-09-12T01:56:48.089060+0000","last_clean":"2024-09-12T01:56:48.089060+0000","last_became_active":"2024-09-12T01:56:48.084012+0000","last_became_peered":"2024-09-12T01:56:48.084012+0000","last_unstale":"2024-09-12T01:56:48.089060+0000","last_undegraded":"2024-09-12T01:56:48.089060+0000","last_fullsized":"2024-09-12T01:56:48.089060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:26.586415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069653+0000","last_change":"2024-09-12T01:56:48.069653+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069653+0000","last_undegraded":"2024-09-12T01:56:48.069653+0000","last_fullsized":"2024-09-12T01:56:48.069653+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.075260+0000","last_change":"2024-09-12T01:56:48.074045+0000","last_active":"2024-09-12T01:56:48.075260+0000","last_peered":"2024-09-12T01:56:48.075260+0000","last_clean":"2024-09-12T01:56:48.075260+0000","last_became_active":"2024-09-12T01:56:48.073680+0000","last_became_peered":"2024-09-12T01:56:48.073680+0000","last_unstale":"2024-09-12T01:56:48.075260+0000","last_undegraded":"2024-09-12T01:56:48.075260+0000","last_fullsized":"2024-09-12T01:56:48.075260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:06.321418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.074317+0000","last_change":"2024-09-12T01:56:48.074317+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.074317+0000","last_undegraded":"2024-09-12T01:56:48.074317+0000","last_fullsized":"2024-09-12T01:56:48.074317+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.080051+0000","last_change":"2024-09-12T01:56:48.076087+0000","last_active":"2024-09-12T01:56:49.080051+0000","last_peered":"2024-09-12T01:56:49.080051+0000","last_clean":"2024-09-12T01:56:49.080051+0000","last_became_active":"2024-09-12T01:56:48.075803+0000","last_became_peered":"2024-09-12T01:56:48.075803+0000","last_unstale":"2024-09-12T01:56:49.080051+0000","last_undegraded":"2024-09-12T01:56:49.080051+0000","last_fullsized":"2024-09-12T01:56:49.080051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:27.805990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T01:56:47.064248+0000","last_change":"2024-09-12T01:56:47.064248+0000","last_active":"2024-09-12T01:56:47.056365+0000","last_peered":"2024-09-12T01:56:47.056365+0000","last_clean":"2024-09-12T01:56:47.056365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:47.064248+0000","last_undegraded":"2024-09-12T01:56:47.064248+0000","last_fullsized":"2024-09-12T01:56:47.064248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.095869+0000","last_change":"2024-09-12T01:56:49.091608+0000","last_active":"2024-09-12T01:56:49.095869+0000","last_peered":"2024-09-12T01:56:49.095869+0000","last_clean":"2024-09-12T01:56:49.095869+0000","last_became_active":"2024-09-12T01:56:49.090710+0000","last_became_peered":"2024-09-12T01:56:49.090710+0000","last_unstale":"2024-09-12T01:56:49.095869+0000","last_undegraded":"2024-09-12T01:56:49.095869+0000","last_fullsized":"2024-09-12T01:56:49.095869+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:18.709627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.091829+0000","last_change":"2024-09-12T01:56:48.086306+0000","last_active":"2024-09-12T01:56:48.091829+0000","last_peered":"2024-09-12T01:56:48.091829+0000","last_clean":"2024-09-12T01:56:48.091829+0000","last_became_active":"2024-09-12T01:56:48.085519+0000","last_became_peered":"2024-09-12T01:56:48.085519+0000","last_unstale":"2024-09-12T01:56:48.091829+0000","last_undegraded":"2024-09-12T01:56:48.091829+0000","last_fullsized":"2024-09-12T01:56:48.091829+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:09.193086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104372+0000","last_change":"2024-09-12T01:56:49.096214+0000","last_active":"2024-09-12T01:56:49.104372+0000","last_peered":"2024-09-12T01:56:49.104372+0000","last_clean":"2024-09-12T01:56:49.104372+0000","last_became_active":"2024-09-12T01:56:49.095889+0000","last_became_peered":"2024-09-12T01:56:49.095889+0000","last_unstale":"2024-09-12T01:56:49.104372+0000","last_undegraded":"2024-09-12T01:56:49.104372+0000","last_fullsized":"2024-09-12T01:56:49.104372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:38.096087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.086070+0000","last_change":"2024-09-12T01:56:48.082804+0000","last_active":"2024-09-12T01:56:49.086070+0000","last_peered":"2024-09-12T01:56:49.086070+0000","last_clean":"2024-09-12T01:56:49.086070+0000","last_became_active":"2024-09-12T01:56:48.082323+0000","last_became_peered":"2024-09-12T01:56:48.082323+0000","last_unstale":"2024-09-12T01:56:49.086070+0000","last_undegraded":"2024-09-12T01:56:49.086070+0000","last_fullsized":"2024-09-12T01:56:49.086070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:45.367043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":202,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.084948+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:56:49.084948+0000","last_peered":"2024-09-12T01:56:49.084948+0000","last_clean":"2024-09-12T01:56:49.084948+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:56:49.084948+0000","last_undegraded":"2024-09-12T01:56:49.084948+0000","last_fullsized":"2024-09-12T01:56:49.084948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":773849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":183481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":183481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1011712,"data_stored":767182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":405504,"data_stored":170605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:56:52.426 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:56:52.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.566+0000 7f36c0ae4640 1 Processor -- start 2024-09-12T01:56:52.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.566+0000 7f36c0ae4640 1 -- start start 2024-09-12T01:56:52.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.567+0000 7f36c0ae4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f36bc0cfcc0 0x7f36bc06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.567+0000 7f36c0ae4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36bc0d4fd0 0x7f36bc0d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.567+0000 7f36c0ae4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36bc0d2700 con 0x7f36bc15e760 2024-09-12T01:56:52.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.567+0000 7f36c0ae4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f36bc0cedb0 con 0x7f36bc0cfcc0 2024-09-12T01:56:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.567+0000 7f36c0ae4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f36bc0cf090 con 0x7f36bc0d4fd0 2024-09-12T01:56:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.567+0000 7f36b1d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f36bc0cfcc0 0x7f36bc06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.567+0000 7f36b1d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f36bc0cfcc0 0x7f36bc06cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53062/0 (socket says 172.21.15.19:53062) 2024-09-12T01:56:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.567+0000 7f36b1d9b640 1 -- 172.21.15.19:0/3706738401 learned_addr learned my addr 172.21.15.19:0/3706738401 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.567+0000 7f36bad9d640 1 --2- 172.21.15.19:0/3706738401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36bc0d4fd0 0x7f36bc0d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.567+0000 7f36b1d9b640 1 -- 172.21.15.19:0/3706738401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36bc0d4fd0 msgr2=0x7f36bc0d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.567+0000 7f36b1d9b640 1 --2- 172.21.15.19:0/3706738401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36bc0d4fd0 0x7f36bc0d2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.567+0000 7f36b1d9b640 1 -- 172.21.15.19:0/3706738401 >> v1:172.21.15.135:6789/0 conn(0x7f36bc15e760 legacy=0x7f36bc0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.567+0000 7f36b1d9b640 1 -- 172.21.15.19:0/3706738401 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36bc0b3c80 con 0x7f36bc0cfcc0 2024-09-12T01:56:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.568+0000 7f36b1d9b640 1 --2- 172.21.15.19:0/3706738401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36bc0cfcc0 0x7f36bc06cdd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009850 tx=0x7f36a402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45078eccd280840 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.568+0000 7f36b9d9b640 1 -- 172.21.15.19:0/3706738401 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4004030 con 0x7f36bc0cfcc0 2024-09-12T01:56:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.568+0000 7f36b9d9b640 1 -- 172.21.15.19:0/3706738401 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a40041d0 con 0x7f36bc0cfcc0 2024-09-12T01:56:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.568+0000 7f36b9d9b640 1 -- 172.21.15.19:0/3706738401 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4003610 con 0x7f36bc0cfcc0 2024-09-12T01:56:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.568+0000 7f36c0ae4640 1 -- 172.21.15.19:0/3706738401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36bc0cfcc0 msgr2=0x7f36bc06cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.568+0000 7f36c0ae4640 1 --2- 172.21.15.19:0/3706738401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36bc0cfcc0 0x7f36bc06cdd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009850 tx=0x7f36a402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.568+0000 7f36c0ae4640 1 -- 172.21.15.19:0/3706738401 shutdown_connections 2024-09-12T01:56:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.568+0000 7f36c0ae4640 1 --2- 172.21.15.19:0/3706738401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36bc0d4fd0 0x7f36bc0d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.568+0000 7f36c0ae4640 1 --2- 172.21.15.19:0/3706738401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36bc0cfcc0 0x7f36bc06cdd0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.568+0000 7f36c0ae4640 1 -- 172.21.15.19:0/3706738401 >> 172.21.15.19:0/3706738401 conn(0x7f36bc08bfc0 msgr2=0x7f36bc0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.569+0000 7f36c0ae4640 1 -- 172.21.15.19:0/3706738401 shutdown_connections 2024-09-12T01:56:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.569+0000 7f36c0ae4640 1 -- 172.21.15.19:0/3706738401 wait complete. 2024-09-12T01:56:52.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.570+0000 7f36c0ae4640 1 Processor -- start 2024-09-12T01:56:52.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.570+0000 7f36c0ae4640 1 -- start start 2024-09-12T01:56:52.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.571+0000 7f36c0ae4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36bc0cfcc0 0x7f36bc1537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.571+0000 7f36c0ae4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36bc0d4fd0 0x7f36bc0b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.571+0000 7f36c0ae4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36bc15e760 0x7f36bc0b8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.571+0000 7f36c0ae4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc0d33e0 con 0x7f36bc0cfcc0 2024-09-12T01:56:52.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.571+0000 7f36c0ae4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc0b38e0 con 0x7f36bc15e760 2024-09-12T01:56:52.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.571+0000 7f36c0ae4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f36bc0d3560 con 0x7f36bc0d4fd0 2024-09-12T01:56:52.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.571+0000 7f36ba59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36bc0cfcc0 0x7f36bc1537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.571+0000 7f36ba59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36bc0cfcc0 0x7f36bc1537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53074/0 (socket says 172.21.15.19:53074) 2024-09-12T01:56:52.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.571+0000 7f36ba59c640 1 -- 172.21.15.19:0/1543746443 learned_addr learned my addr 172.21.15.19:0/1543746443 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:52.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.571+0000 7f36b1d9b640 1 --2- 172.21.15.19:0/1543746443 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36bc0d4fd0 0x7f36bc0b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.571+0000 7f36bad9d640 1 --2- 172.21.15.19:0/1543746443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36bc15e760 0x7f36bc0b8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.571+0000 7f36ba59c640 1 -- 172.21.15.19:0/1543746443 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36bc0d4fd0 msgr2=0x7f36bc0b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.571+0000 7f36ba59c640 1 --2- 172.21.15.19:0/1543746443 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36bc0d4fd0 0x7f36bc0b7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.571+0000 7f36ba59c640 1 -- 172.21.15.19:0/1543746443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36bc15e760 msgr2=0x7f36bc0b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.571+0000 7f36ba59c640 1 --2- 172.21.15.19:0/1543746443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36bc15e760 0x7f36bc0b8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.571+0000 7f36ba59c640 1 -- 172.21.15.19:0/1543746443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36bc0cbd40 con 0x7f36bc0cfcc0 2024-09-12T01:56:52.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.571+0000 7f36b1d9b640 1 --2- 172.21.15.19:0/1543746443 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36bc0d4fd0 0x7f36bc0b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:52.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.571+0000 7f36ba59c640 1 --2- 172.21.15.19:0/1543746443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36bc0cfcc0 0x7f36bc1537a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00b3f0 tx=0x7f36ac00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:52.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.572+0000 7f36b37fe640 1 -- 172.21.15.19:0/1543746443 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac015020 con 0x7f36bc0cfcc0 2024-09-12T01:56:52.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.572+0000 7f36b37fe640 1 -- 172.21.15.19:0/1543746443 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36ac011830 con 0x7f36bc0cfcc0 2024-09-12T01:56:52.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.572+0000 7f36c0ae4640 1 -- 172.21.15.19:0/1543746443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36bc0cc020 con 0x7f36bc0cfcc0 2024-09-12T01:56:52.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.572+0000 7f36b37fe640 1 -- 172.21.15.19:0/1543746443 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac011c20 con 0x7f36bc0cfcc0 2024-09-12T01:56:52.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.572+0000 7f36c0ae4640 1 -- 172.21.15.19:0/1543746443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36bc0cc5e0 con 0x7f36bc0cfcc0 2024-09-12T01:56:52.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.573+0000 7f36c0ae4640 1 -- 172.21.15.19:0/1543746443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36bc0d38e0 con 0x7f36bc0cfcc0 2024-09-12T01:56:52.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.573+0000 7f36b37fe640 1 -- 172.21.15.19:0/1543746443 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f36ac018020 con 0x7f36bc0cfcc0 2024-09-12T01:56:52.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.574+0000 7f36b37fe640 1 --2- 172.21.15.19:0/1543746443 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f369c06be30 0x7f369c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.574+0000 7f36b37fe640 1 -- 172.21.15.19:0/1543746443 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f36ac08ac00 con 0x7f36bc0cfcc0 2024-09-12T01:56:52.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.574+0000 7f36b1d9b640 1 --2- 172.21.15.19:0/1543746443 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f369c06be30 0x7f369c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.574+0000 7f36b1d9b640 1 --2- 172.21.15.19:0/1543746443 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f369c06be30 0x7f369c06e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f36a4033000 tx=0x7f36a402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:52.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.578+0000 7f36b37fe640 1 -- 172.21.15.19:0/1543746443 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f36ac091080 con 0x7f36bc0cfcc0 2024-09-12T01:56:52.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.750+0000 7f36c0ae4640 1 -- 172.21.15.19:0/1543746443 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f36bc06d810 con 0x7f369c06be30 2024-09-12T01:56:52.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.757+0000 7f36b37fe640 1 -- 172.21.15.19:0/1543746443 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248078 (secure 0 0 0) 0x7f36bc06d810 con 0x7f369c06be30 2024-09-12T01:56:52.760 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:52.761 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:56:52.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.759+0000 7f36c0ae4640 1 -- 172.21.15.19:0/1543746443 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f369c06be30 msgr2=0x7f369c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.759+0000 7f36c0ae4640 1 --2- 172.21.15.19:0/1543746443 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f369c06be30 0x7f369c06e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f36a4033000 tx=0x7f36a402e000 comp rx=0 tx=0).stop 2024-09-12T01:56:52.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.759+0000 7f36c0ae4640 1 -- 172.21.15.19:0/1543746443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36bc0cfcc0 msgr2=0x7f36bc1537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.759+0000 7f36c0ae4640 1 --2- 172.21.15.19:0/1543746443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36bc0cfcc0 0x7f36bc1537a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00b3f0 tx=0x7f36ac00b8b0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.759+0000 7f36c0ae4640 1 -- 172.21.15.19:0/1543746443 shutdown_connections 2024-09-12T01:56:52.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.759+0000 7f36c0ae4640 1 --2- 172.21.15.19:0/1543746443 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f369c06be30 0x7f369c06e2f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.759+0000 7f36c0ae4640 1 --2- 172.21.15.19:0/1543746443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36bc15e760 0x7f36bc0b8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.759+0000 7f36c0ae4640 1 --2- 172.21.15.19:0/1543746443 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36bc0d4fd0 0x7f36bc0b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.759+0000 7f36c0ae4640 1 --2- 172.21.15.19:0/1543746443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36bc0cfcc0 0x7f36bc1537a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.759+0000 7f36c0ae4640 1 -- 172.21.15.19:0/1543746443 >> 172.21.15.19:0/1543746443 conn(0x7f36bc08bfc0 msgr2=0x7f36bc0d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:52.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.759+0000 7f36c0ae4640 1 -- 172.21.15.19:0/1543746443 shutdown_connections 2024-09-12T01:56:52.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.759+0000 7f36c0ae4640 1 -- 172.21.15.19:0/1543746443 wait complete. 2024-09-12T01:56:52.771 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-12T01:56:52.097903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":183,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220680,"kb_used_data":4448,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754040,"statfs":{"total":773094113280,"available":772868136960,"internally_reserved":0,"allocated":4554752,"data_stored":2609040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.035864"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.074094+0000","last_change":"2024-09-12T01:56:48.074094+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.074094+0000","last_undegraded":"2024-09-12T01:56:48.074094+0000","last_fullsized":"2024-09-12T01:56:48.074094+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.072752+0000","last_change":"2024-09-12T01:56:48.072752+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.072752+0000","last_undegraded":"2024-09-12T01:56:48.072752+0000","last_fullsized":"2024-09-12T01:56:48.072752+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070857+0000","last_change":"2024-09-12T01:56:48.070857+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070857+0000","last_undegraded":"2024-09-12T01:56:48.070857+0000","last_fullsized":"2024-09-12T01:56:48.070857+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071680+0000","last_change":"2024-09-12T01:56:48.071680+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071680+0000","last_undegraded":"2024-09-12T01:56:48.071680+0000","last_fullsized":"2024-09-12T01:56:48.071680+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071211+0000","last_change":"2024-09-12T01:56:48.071211+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071211+0000","last_undegraded":"2024-09-12T01:56:48.071211+0000","last_fullsized":"2024-09-12T01:56:48.071211+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.077153+0000","last_change":"2024-09-12T01:56:48.077153+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.077153+0000","last_undegraded":"2024-09-12T01:56:48.077153+0000","last_fullsized":"2024-09-12T01:56:48.077153+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104551+0000","last_change":"2024-09-12T01:56:49.095662+0000","last_active":"2024-09-12T01:56:49.104551+0000","last_peered":"2024-09-12T01:56:49.104551+0000","last_clean":"2024-09-12T01:56:49.104551+0000","last_became_active":"2024-09-12T01:56:49.095303+0000","last_became_peered":"2024-09-12T01:56:49.095303+0000","last_unstale":"2024-09-12T01:56:49.104551+0000","last_undegraded":"2024-09-12T01:56:49.104551+0000","last_fullsized":"2024-09-12T01:56:49.104551+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:08.496640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069837+0000","last_change":"2024-09-12T01:56:48.069837+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069837+0000","last_undegraded":"2024-09-12T01:56:48.069837+0000","last_fullsized":"2024-09-12T01:56:48.069837+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070676+0000","last_change":"2024-09-12T01:56:48.070676+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070676+0000","last_undegraded":"2024-09-12T01:56:48.070676+0000","last_fullsized":"2024-09-12T01:56:48.070676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107459+0000","last_change":"2024-09-12T01:56:49.100284+0000","last_active":"2024-09-12T01:56:49.107459+0000","last_peered":"2024-09-12T01:56:49.107459+0000","last_clean":"2024-09-12T01:56:49.107459+0000","last_became_active":"2024-09-12T01:56:49.100012+0000","last_became_peered":"2024-09-12T01:56:49.100012+0000","last_unstale":"2024-09-12T01:56:49.107459+0000","last_undegraded":"2024-09-12T01:56:49.107459+0000","last_fullsized":"2024-09-12T01:56:49.107459+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:27.444535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099908+0000","last_change":"2024-09-12T01:56:49.092104+0000","last_active":"2024-09-12T01:56:49.099908+0000","last_peered":"2024-09-12T01:56:49.099908+0000","last_clean":"2024-09-12T01:56:49.099908+0000","last_became_active":"2024-09-12T01:56:49.091831+0000","last_became_peered":"2024-09-12T01:56:49.091831+0000","last_unstale":"2024-09-12T01:56:49.099908+0000","last_undegraded":"2024-09-12T01:56:49.099908+0000","last_fullsized":"2024-09-12T01:56:49.099908+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:30.275429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069910+0000","last_change":"2024-09-12T01:56:48.069910+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069910+0000","last_undegraded":"2024-09-12T01:56:48.069910+0000","last_fullsized":"2024-09-12T01:56:48.069910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104911+0000","last_change":"2024-09-12T01:56:49.097145+0000","last_active":"2024-09-12T01:56:49.104911+0000","last_peered":"2024-09-12T01:56:49.104911+0000","last_clean":"2024-09-12T01:56:49.104911+0000","last_became_active":"2024-09-12T01:56:49.096854+0000","last_became_peered":"2024-09-12T01:56:49.096854+0000","last_unstale":"2024-09-12T01:56:49.104911+0000","last_undegraded":"2024-09-12T01:56:49.104911+0000","last_fullsized":"2024-09-12T01:56:49.104911+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:10.499892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104572+0000","last_change":"2024-09-12T01:56:49.098596+0000","last_active":"2024-09-12T01:56:49.104572+0000","last_peered":"2024-09-12T01:56:49.104572+0000","last_clean":"2024-09-12T01:56:49.104572+0000","last_became_active":"2024-09-12T01:56:49.096857+0000","last_became_peered":"2024-09-12T01:56:49.096857+0000","last_unstale":"2024-09-12T01:56:49.104572+0000","last_undegraded":"2024-09-12T01:56:49.104572+0000","last_fullsized":"2024-09-12T01:56:49.104572+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:30.650006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103449+0000","last_change":"2024-09-12T01:56:49.098562+0000","last_active":"2024-09-12T01:56:49.103449+0000","last_peered":"2024-09-12T01:56:49.103449+0000","last_clean":"2024-09-12T01:56:49.103449+0000","last_became_active":"2024-09-12T01:56:49.098285+0000","last_became_peered":"2024-09-12T01:56:49.098285+0000","last_unstale":"2024-09-12T01:56:49.103449+0000","last_undegraded":"2024-09-12T01:56:49.103449+0000","last_fullsized":"2024-09-12T01:56:49.103449+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:10.499892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103274+0000","last_change":"2024-09-12T01:56:49.097918+0000","last_active":"2024-09-12T01:56:49.103274+0000","last_peered":"2024-09-12T01:56:49.103274+0000","last_clean":"2024-09-12T01:56:49.103274+0000","last_became_active":"2024-09-12T01:56:49.097595+0000","last_became_peered":"2024-09-12T01:56:49.097595+0000","last_unstale":"2024-09-12T01:56:49.103274+0000","last_undegraded":"2024-09-12T01:56:49.103274+0000","last_fullsized":"2024-09-12T01:56:49.103274+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:40.245592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.095664+0000","last_change":"2024-09-12T01:56:49.090304+0000","last_active":"2024-09-12T01:56:49.095664+0000","last_peered":"2024-09-12T01:56:49.095664+0000","last_clean":"2024-09-12T01:56:49.095664+0000","last_became_active":"2024-09-12T01:56:49.089928+0000","last_became_peered":"2024-09-12T01:56:49.089928+0000","last_unstale":"2024-09-12T01:56:49.095664+0000","last_undegraded":"2024-09-12T01:56:49.095664+0000","last_fullsized":"2024-09-12T01:56:49.095664+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:23.477178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070725+0000","last_change":"2024-09-12T01:56:48.070725+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070725+0000","last_undegraded":"2024-09-12T01:56:48.070725+0000","last_fullsized":"2024-09-12T01:56:48.070725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099144+0000","last_change":"2024-09-12T01:56:49.093382+0000","last_active":"2024-09-12T01:56:49.099144+0000","last_peered":"2024-09-12T01:56:49.099144+0000","last_clean":"2024-09-12T01:56:49.099144+0000","last_became_active":"2024-09-12T01:56:49.093060+0000","last_became_peered":"2024-09-12T01:56:49.093060+0000","last_unstale":"2024-09-12T01:56:49.099144+0000","last_undegraded":"2024-09-12T01:56:49.099144+0000","last_fullsized":"2024-09-12T01:56:49.099144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:41.113310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107723+0000","last_change":"2024-09-12T01:56:49.102971+0000","last_active":"2024-09-12T01:56:49.107723+0000","last_peered":"2024-09-12T01:56:49.107723+0000","last_clean":"2024-09-12T01:56:49.107723+0000","last_became_active":"2024-09-12T01:56:49.102708+0000","last_became_peered":"2024-09-12T01:56:49.102708+0000","last_unstale":"2024-09-12T01:56:49.107723+0000","last_undegraded":"2024-09-12T01:56:49.107723+0000","last_fullsized":"2024-09-12T01:56:49.107723+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:26.195981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103132+0000","last_change":"2024-09-12T01:56:49.094962+0000","last_active":"2024-09-12T01:56:49.103132+0000","last_peered":"2024-09-12T01:56:49.103132+0000","last_clean":"2024-09-12T01:56:49.103132+0000","last_became_active":"2024-09-12T01:56:49.094689+0000","last_became_peered":"2024-09-12T01:56:49.094689+0000","last_unstale":"2024-09-12T01:56:49.103132+0000","last_undegraded":"2024-09-12T01:56:49.103132+0000","last_fullsized":"2024-09-12T01:56:49.103132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:44.543744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070901+0000","last_change":"2024-09-12T01:56:48.070901+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070901+0000","last_undegraded":"2024-09-12T01:56:48.070901+0000","last_fullsized":"2024-09-12T01:56:48.070901+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104095+0000","last_change":"2024-09-12T01:56:49.094852+0000","last_active":"2024-09-12T01:56:49.104095+0000","last_peered":"2024-09-12T01:56:49.104095+0000","last_clean":"2024-09-12T01:56:49.104095+0000","last_became_active":"2024-09-12T01:56:49.094582+0000","last_became_peered":"2024-09-12T01:56:49.094582+0000","last_unstale":"2024-09-12T01:56:49.104095+0000","last_undegraded":"2024-09-12T01:56:49.104095+0000","last_fullsized":"2024-09-12T01:56:49.104095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:42.421526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.075748+0000","last_change":"2024-09-12T01:56:48.075748+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.075748+0000","last_undegraded":"2024-09-12T01:56:48.075748+0000","last_fullsized":"2024-09-12T01:56:48.075748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103662+0000","last_change":"2024-09-12T01:56:49.095001+0000","last_active":"2024-09-12T01:56:49.103662+0000","last_peered":"2024-09-12T01:56:49.103662+0000","last_clean":"2024-09-12T01:56:49.103662+0000","last_became_active":"2024-09-12T01:56:49.094730+0000","last_became_peered":"2024-09-12T01:56:49.094730+0000","last_unstale":"2024-09-12T01:56:49.103662+0000","last_undegraded":"2024-09-12T01:56:49.103662+0000","last_fullsized":"2024-09-12T01:56:49.103662+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:46.371782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099958+0000","last_change":"2024-09-12T01:56:49.091704+0000","last_active":"2024-09-12T01:56:49.099958+0000","last_peered":"2024-09-12T01:56:49.099958+0000","last_clean":"2024-09-12T01:56:49.099958+0000","last_became_active":"2024-09-12T01:56:49.091369+0000","last_became_peered":"2024-09-12T01:56:49.091369+0000","last_unstale":"2024-09-12T01:56:49.099958+0000","last_undegraded":"2024-09-12T01:56:49.099958+0000","last_fullsized":"2024-09-12T01:56:49.099958+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:40.245592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107570+0000","last_change":"2024-09-12T01:56:49.102931+0000","last_active":"2024-09-12T01:56:49.107570+0000","last_peered":"2024-09-12T01:56:49.107570+0000","last_clean":"2024-09-12T01:56:49.107570+0000","last_became_active":"2024-09-12T01:56:49.102638+0000","last_became_peered":"2024-09-12T01:56:49.102638+0000","last_unstale":"2024-09-12T01:56:49.107570+0000","last_undegraded":"2024-09-12T01:56:49.107570+0000","last_fullsized":"2024-09-12T01:56:49.107570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:18.709627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.092187+0000","last_change":"2024-09-12T01:56:49.088392+0000","last_active":"2024-09-12T01:56:49.092187+0000","last_peered":"2024-09-12T01:56:49.092187+0000","last_clean":"2024-09-12T01:56:49.092187+0000","last_became_active":"2024-09-12T01:56:49.088100+0000","last_became_peered":"2024-09-12T01:56:49.088100+0000","last_unstale":"2024-09-12T01:56:49.092187+0000","last_undegraded":"2024-09-12T01:56:49.092187+0000","last_fullsized":"2024-09-12T01:56:49.092187+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:22.615266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103382+0000","last_change":"2024-09-12T01:56:49.098430+0000","last_active":"2024-09-12T01:56:49.103382+0000","last_peered":"2024-09-12T01:56:49.103382+0000","last_clean":"2024-09-12T01:56:49.103382+0000","last_became_active":"2024-09-12T01:56:49.098144+0000","last_became_peered":"2024-09-12T01:56:49.098144+0000","last_unstale":"2024-09-12T01:56:49.103382+0000","last_undegraded":"2024-09-12T01:56:49.103382+0000","last_fullsized":"2024-09-12T01:56:49.103382+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:38.096087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.074304+0000","last_change":"2024-09-12T01:56:48.074304+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.074304+0000","last_undegraded":"2024-09-12T01:56:48.074304+0000","last_fullsized":"2024-09-12T01:56:48.074304+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103361+0000","last_change":"2024-09-12T01:56:49.097725+0000","last_active":"2024-09-12T01:56:49.103361+0000","last_peered":"2024-09-12T01:56:49.103361+0000","last_clean":"2024-09-12T01:56:49.103361+0000","last_became_active":"2024-09-12T01:56:49.097049+0000","last_became_peered":"2024-09-12T01:56:49.097049+0000","last_unstale":"2024-09-12T01:56:49.103361+0000","last_undegraded":"2024-09-12T01:56:49.103361+0000","last_fullsized":"2024-09-12T01:56:49.103361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:36.644433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.108732+0000","last_change":"2024-09-12T01:56:48.083339+0000","last_active":"2024-09-12T01:56:49.108732+0000","last_peered":"2024-09-12T01:56:49.108732+0000","last_clean":"2024-09-12T01:56:49.108732+0000","last_became_active":"2024-09-12T01:56:48.083086+0000","last_became_peered":"2024-09-12T01:56:48.083086+0000","last_unstale":"2024-09-12T01:56:49.108732+0000","last_undegraded":"2024-09-12T01:56:49.108732+0000","last_fullsized":"2024-09-12T01:56:49.108732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:26.586415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.078670+0000","last_change":"2024-09-12T01:56:48.078670+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.078670+0000","last_undegraded":"2024-09-12T01:56:48.078670+0000","last_fullsized":"2024-09-12T01:56:48.078670+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.086032+0000","last_change":"2024-09-12T01:56:48.082903+0000","last_active":"2024-09-12T01:56:48.086032+0000","last_peered":"2024-09-12T01:56:48.086032+0000","last_clean":"2024-09-12T01:56:48.086032+0000","last_became_active":"2024-09-12T01:56:48.082585+0000","last_became_peered":"2024-09-12T01:56:48.082585+0000","last_unstale":"2024-09-12T01:56:48.086032+0000","last_undegraded":"2024-09-12T01:56:48.086032+0000","last_fullsized":"2024-09-12T01:56:48.086032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:27.805990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.088719+0000","last_change":"2024-09-12T01:56:48.084769+0000","last_active":"2024-09-12T01:56:48.088719+0000","last_peered":"2024-09-12T01:56:48.088719+0000","last_clean":"2024-09-12T01:56:48.088719+0000","last_became_active":"2024-09-12T01:56:48.084356+0000","last_became_peered":"2024-09-12T01:56:48.084356+0000","last_unstale":"2024-09-12T01:56:48.088719+0000","last_undegraded":"2024-09-12T01:56:48.088719+0000","last_fullsized":"2024-09-12T01:56:48.088719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:06.724111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.074518+0000","last_change":"2024-09-12T01:56:48.074518+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.074518+0000","last_undegraded":"2024-09-12T01:56:48.074518+0000","last_fullsized":"2024-09-12T01:56:48.074518+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T01:56:47.063721+0000","last_change":"2024-09-12T01:56:47.063721+0000","last_active":"2024-09-12T01:56:47.056365+0000","last_peered":"2024-09-12T01:56:47.056365+0000","last_clean":"2024-09-12T01:56:47.056365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:47.063721+0000","last_undegraded":"2024-09-12T01:56:47.063721+0000","last_fullsized":"2024-09-12T01:56:47.063721+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071004+0000","last_change":"2024-09-12T01:56:48.071004+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071004+0000","last_undegraded":"2024-09-12T01:56:48.071004+0000","last_fullsized":"2024-09-12T01:56:48.071004+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107598+0000","last_change":"2024-09-12T01:56:48.086406+0000","last_active":"2024-09-12T01:56:49.107598+0000","last_peered":"2024-09-12T01:56:49.107598+0000","last_clean":"2024-09-12T01:56:49.107598+0000","last_became_active":"2024-09-12T01:56:48.086117+0000","last_became_peered":"2024-09-12T01:56:48.086117+0000","last_unstale":"2024-09-12T01:56:49.107598+0000","last_undegraded":"2024-09-12T01:56:49.107598+0000","last_fullsized":"2024-09-12T01:56:49.107598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:45.367043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107899+0000","last_change":"2024-09-12T01:56:49.104426+0000","last_active":"2024-09-12T01:56:49.107899+0000","last_peered":"2024-09-12T01:56:49.107899+0000","last_clean":"2024-09-12T01:56:49.107899+0000","last_became_active":"2024-09-12T01:56:49.103633+0000","last_became_peered":"2024-09-12T01:56:49.103633+0000","last_unstale":"2024-09-12T01:56:49.107899+0000","last_undegraded":"2024-09-12T01:56:49.107899+0000","last_fullsized":"2024-09-12T01:56:49.107899+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:00.426689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.108805+0000","last_change":"2024-09-12T01:56:48.084388+0000","last_active":"2024-09-12T01:56:49.108805+0000","last_peered":"2024-09-12T01:56:49.108805+0000","last_clean":"2024-09-12T01:56:49.108805+0000","last_became_active":"2024-09-12T01:56:48.084111+0000","last_became_peered":"2024-09-12T01:56:48.084111+0000","last_unstale":"2024-09-12T01:56:49.108805+0000","last_undegraded":"2024-09-12T01:56:49.108805+0000","last_fullsized":"2024-09-12T01:56:49.108805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:22.472440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.092038+0000","last_change":"2024-09-12T01:56:48.091222+0000","last_active":"2024-09-12T01:56:48.092038+0000","last_peered":"2024-09-12T01:56:48.092038+0000","last_clean":"2024-09-12T01:56:48.092038+0000","last_became_active":"2024-09-12T01:56:48.090909+0000","last_became_peered":"2024-09-12T01:56:48.090909+0000","last_unstale":"2024-09-12T01:56:48.092038+0000","last_undegraded":"2024-09-12T01:56:48.092038+0000","last_fullsized":"2024-09-12T01:56:48.092038+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:45.171550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.072553+0000","last_change":"2024-09-12T01:56:48.072553+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.072553+0000","last_undegraded":"2024-09-12T01:56:48.072553+0000","last_fullsized":"2024-09-12T01:56:48.072553+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T01:56:47.063531+0000","last_change":"2024-09-12T01:56:47.063531+0000","last_active":"2024-09-12T01:56:47.056365+0000","last_peered":"2024-09-12T01:56:47.056365+0000","last_clean":"2024-09-12T01:56:47.056365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:47.063531+0000","last_undegraded":"2024-09-12T01:56:47.063531+0000","last_fullsized":"2024-09-12T01:56:47.063531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069971+0000","last_change":"2024-09-12T01:56:48.069971+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069971+0000","last_undegraded":"2024-09-12T01:56:48.069971+0000","last_fullsized":"2024-09-12T01:56:48.069971+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.091861+0000","last_change":"2024-09-12T01:56:48.085039+0000","last_active":"2024-09-12T01:56:48.091861+0000","last_peered":"2024-09-12T01:56:48.091861+0000","last_clean":"2024-09-12T01:56:48.091861+0000","last_became_active":"2024-09-12T01:56:48.084764+0000","last_became_peered":"2024-09-12T01:56:48.084764+0000","last_unstale":"2024-09-12T01:56:48.091861+0000","last_undegraded":"2024-09-12T01:56:48.091861+0000","last_fullsized":"2024-09-12T01:56:48.091861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:26.449812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099629+0000","last_change":"2024-09-12T01:56:49.092967+0000","last_active":"2024-09-12T01:56:49.099629+0000","last_peered":"2024-09-12T01:56:49.099629+0000","last_clean":"2024-09-12T01:56:49.099629+0000","last_became_active":"2024-09-12T01:56:49.092693+0000","last_became_peered":"2024-09-12T01:56:49.092693+0000","last_unstale":"2024-09-12T01:56:49.099629+0000","last_undegraded":"2024-09-12T01:56:49.099629+0000","last_fullsized":"2024-09-12T01:56:49.099629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:18.993260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.088574+0000","last_change":"2024-09-12T01:56:48.081300+0000","last_active":"2024-09-12T01:56:49.088574+0000","last_peered":"2024-09-12T01:56:49.088574+0000","last_clean":"2024-09-12T01:56:49.088574+0000","last_became_active":"2024-09-12T01:56:48.080352+0000","last_became_peered":"2024-09-12T01:56:48.080352+0000","last_unstale":"2024-09-12T01:56:49.088574+0000","last_undegraded":"2024-09-12T01:56:49.088574+0000","last_fullsized":"2024-09-12T01:56:49.088574+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:17.988522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071472+0000","last_change":"2024-09-12T01:56:48.071472+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071472+0000","last_undegraded":"2024-09-12T01:56:48.071472+0000","last_fullsized":"2024-09-12T01:56:48.071472+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.110625+0000","last_change":"2024-09-12T01:56:48.084554+0000","last_active":"2024-09-12T01:56:49.110625+0000","last_peered":"2024-09-12T01:56:49.110625+0000","last_clean":"2024-09-12T01:56:49.110625+0000","last_became_active":"2024-09-12T01:56:48.084150+0000","last_became_peered":"2024-09-12T01:56:48.084150+0000","last_unstale":"2024-09-12T01:56:49.110625+0000","last_undegraded":"2024-09-12T01:56:49.110625+0000","last_fullsized":"2024-09-12T01:56:49.110625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:43.539005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.088871+0000","last_change":"2024-09-12T01:56:48.083135+0000","last_active":"2024-09-12T01:56:48.088871+0000","last_peered":"2024-09-12T01:56:48.088871+0000","last_clean":"2024-09-12T01:56:48.088871+0000","last_became_active":"2024-09-12T01:56:48.082844+0000","last_became_peered":"2024-09-12T01:56:48.082844+0000","last_unstale":"2024-09-12T01:56:48.088871+0000","last_undegraded":"2024-09-12T01:56:48.088871+0000","last_fullsized":"2024-09-12T01:56:48.088871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:42.037302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070131+0000","last_change":"2024-09-12T01:56:48.070131+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070131+0000","last_undegraded":"2024-09-12T01:56:48.070131+0000","last_fullsized":"2024-09-12T01:56:48.070131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.079034+0000","last_change":"2024-09-12T01:56:48.076816+0000","last_active":"2024-09-12T01:56:48.079034+0000","last_peered":"2024-09-12T01:56:48.079034+0000","last_clean":"2024-09-12T01:56:48.079034+0000","last_became_active":"2024-09-12T01:56:48.076400+0000","last_became_peered":"2024-09-12T01:56:48.076400+0000","last_unstale":"2024-09-12T01:56:48.079034+0000","last_undegraded":"2024-09-12T01:56:48.079034+0000","last_fullsized":"2024-09-12T01:56:48.079034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:42.760298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069627+0000","last_change":"2024-09-12T01:56:48.069627+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069627+0000","last_undegraded":"2024-09-12T01:56:48.069627+0000","last_fullsized":"2024-09-12T01:56:48.069627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.092021+0000","last_change":"2024-09-12T01:56:48.091263+0000","last_active":"2024-09-12T01:56:48.092021+0000","last_peered":"2024-09-12T01:56:48.092021+0000","last_clean":"2024-09-12T01:56:48.092021+0000","last_became_active":"2024-09-12T01:56:48.090933+0000","last_became_peered":"2024-09-12T01:56:48.090933+0000","last_unstale":"2024-09-12T01:56:48.092021+0000","last_undegraded":"2024-09-12T01:56:48.092021+0000","last_fullsized":"2024-09-12T01:56:48.092021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:00.824926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103325+0000","last_change":"2024-09-12T01:56:49.095408+0000","last_active":"2024-09-12T01:56:49.103325+0000","last_peered":"2024-09-12T01:56:49.103325+0000","last_clean":"2024-09-12T01:56:49.103325+0000","last_became_active":"2024-09-12T01:56:49.095100+0000","last_became_peered":"2024-09-12T01:56:49.095100+0000","last_unstale":"2024-09-12T01:56:49.103325+0000","last_undegraded":"2024-09-12T01:56:49.103325+0000","last_fullsized":"2024-09-12T01:56:49.103325+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:30.275429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.080227+0000","last_change":"2024-09-12T01:56:48.085093+0000","last_active":"2024-09-12T01:56:49.080227+0000","last_peered":"2024-09-12T01:56:49.080227+0000","last_clean":"2024-09-12T01:56:49.080227+0000","last_became_active":"2024-09-12T01:56:48.084794+0000","last_became_peered":"2024-09-12T01:56:48.084794+0000","last_unstale":"2024-09-12T01:56:49.080227+0000","last_undegraded":"2024-09-12T01:56:49.080227+0000","last_fullsized":"2024-09-12T01:56:49.080227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:53.692206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.072096+0000","last_change":"2024-09-12T01:56:48.072096+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.072096+0000","last_undegraded":"2024-09-12T01:56:48.072096+0000","last_fullsized":"2024-09-12T01:56:48.072096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.109217+0000","last_change":"2024-09-12T01:56:48.081824+0000","last_active":"2024-09-12T01:56:49.109217+0000","last_peered":"2024-09-12T01:56:49.109217+0000","last_clean":"2024-09-12T01:56:49.109217+0000","last_became_active":"2024-09-12T01:56:48.081536+0000","last_became_peered":"2024-09-12T01:56:48.081536+0000","last_unstale":"2024-09-12T01:56:49.109217+0000","last_undegraded":"2024-09-12T01:56:49.109217+0000","last_fullsized":"2024-09-12T01:56:49.109217+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:40.108571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.073530+0000","last_change":"2024-09-12T01:56:48.073530+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.073530+0000","last_undegraded":"2024-09-12T01:56:48.073530+0000","last_fullsized":"2024-09-12T01:56:48.073530+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.108566+0000","last_change":"2024-09-12T01:56:48.086519+0000","last_active":"2024-09-12T01:56:49.108566+0000","last_peered":"2024-09-12T01:56:49.108566+0000","last_clean":"2024-09-12T01:56:49.108566+0000","last_became_active":"2024-09-12T01:56:48.086139+0000","last_became_peered":"2024-09-12T01:56:48.086139+0000","last_unstale":"2024-09-12T01:56:49.108566+0000","last_undegraded":"2024-09-12T01:56:49.108566+0000","last_fullsized":"2024-09-12T01:56:49.108566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:17.704888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107860+0000","last_change":"2024-09-12T01:56:49.104837+0000","last_active":"2024-09-12T01:56:49.107860+0000","last_peered":"2024-09-12T01:56:49.107860+0000","last_clean":"2024-09-12T01:56:49.107860+0000","last_became_active":"2024-09-12T01:56:49.103859+0000","last_became_peered":"2024-09-12T01:56:49.103859+0000","last_unstale":"2024-09-12T01:56:49.107860+0000","last_undegraded":"2024-09-12T01:56:49.107860+0000","last_fullsized":"2024-09-12T01:56:49.107860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:25.718464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T01:56:47.063834+0000","last_change":"2024-09-12T01:56:47.063834+0000","last_active":"2024-09-12T01:56:47.056365+0000","last_peered":"2024-09-12T01:56:47.056365+0000","last_clean":"2024-09-12T01:56:47.056365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:47.063834+0000","last_undegraded":"2024-09-12T01:56:47.063834+0000","last_fullsized":"2024-09-12T01:56:47.063834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.081219+0000","last_change":"2024-09-12T01:56:48.073784+0000","last_active":"2024-09-12T01:56:48.081219+0000","last_peered":"2024-09-12T01:56:48.081219+0000","last_clean":"2024-09-12T01:56:48.081219+0000","last_became_active":"2024-09-12T01:56:48.073319+0000","last_became_peered":"2024-09-12T01:56:48.073319+0000","last_unstale":"2024-09-12T01:56:48.081219+0000","last_undegraded":"2024-09-12T01:56:48.081219+0000","last_fullsized":"2024-09-12T01:56:48.081219+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:44.906880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069015+0000","last_change":"2024-09-12T01:56:48.069015+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069015+0000","last_undegraded":"2024-09-12T01:56:48.069015+0000","last_fullsized":"2024-09-12T01:56:48.069015+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.088726+0000","last_change":"2024-09-12T01:56:48.084752+0000","last_active":"2024-09-12T01:56:48.088726+0000","last_peered":"2024-09-12T01:56:48.088726+0000","last_clean":"2024-09-12T01:56:48.088726+0000","last_became_active":"2024-09-12T01:56:48.084474+0000","last_became_peered":"2024-09-12T01:56:48.084474+0000","last_unstale":"2024-09-12T01:56:48.088726+0000","last_undegraded":"2024-09-12T01:56:48.088726+0000","last_fullsized":"2024-09-12T01:56:48.088726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:00.113502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103336+0000","last_change":"2024-09-12T01:56:49.098187+0000","last_active":"2024-09-12T01:56:49.103336+0000","last_peered":"2024-09-12T01:56:49.103336+0000","last_clean":"2024-09-12T01:56:49.103336+0000","last_became_active":"2024-09-12T01:56:49.097323+0000","last_became_peered":"2024-09-12T01:56:49.097323+0000","last_unstale":"2024-09-12T01:56:49.103336+0000","last_undegraded":"2024-09-12T01:56:49.103336+0000","last_fullsized":"2024-09-12T01:56:49.103336+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:08.496640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.083486+0000","last_change":"2024-09-12T01:56:48.080455+0000","last_active":"2024-09-12T01:56:48.083486+0000","last_peered":"2024-09-12T01:56:48.083486+0000","last_clean":"2024-09-12T01:56:48.083486+0000","last_became_active":"2024-09-12T01:56:48.080116+0000","last_became_peered":"2024-09-12T01:56:48.080116+0000","last_unstale":"2024-09-12T01:56:48.083486+0000","last_undegraded":"2024-09-12T01:56:48.083486+0000","last_fullsized":"2024-09-12T01:56:48.083486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:49.059597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069144+0000","last_change":"2024-09-12T01:56:48.069144+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069144+0000","last_undegraded":"2024-09-12T01:56:48.069144+0000","last_fullsized":"2024-09-12T01:56:48.069144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.083974+0000","last_change":"2024-09-12T01:56:48.081119+0000","last_active":"2024-09-12T01:56:48.083974+0000","last_peered":"2024-09-12T01:56:48.083974+0000","last_clean":"2024-09-12T01:56:48.083974+0000","last_became_active":"2024-09-12T01:56:48.080833+0000","last_became_peered":"2024-09-12T01:56:48.080833+0000","last_unstale":"2024-09-12T01:56:48.083974+0000","last_undegraded":"2024-09-12T01:56:48.083974+0000","last_fullsized":"2024-09-12T01:56:48.083974+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:36.404814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104601+0000","last_change":"2024-09-12T01:56:49.095989+0000","last_active":"2024-09-12T01:56:49.104601+0000","last_peered":"2024-09-12T01:56:49.104601+0000","last_clean":"2024-09-12T01:56:49.104601+0000","last_became_active":"2024-09-12T01:56:49.095624+0000","last_became_peered":"2024-09-12T01:56:49.095624+0000","last_unstale":"2024-09-12T01:56:49.104601+0000","last_undegraded":"2024-09-12T01:56:49.104601+0000","last_fullsized":"2024-09-12T01:56:49.104601+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:36.644433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.085299+0000","last_change":"2024-09-12T01:56:48.079323+0000","last_active":"2024-09-12T01:56:49.085299+0000","last_peered":"2024-09-12T01:56:49.085299+0000","last_clean":"2024-09-12T01:56:49.085299+0000","last_became_active":"2024-09-12T01:56:48.079064+0000","last_became_peered":"2024-09-12T01:56:48.079064+0000","last_unstale":"2024-09-12T01:56:49.085299+0000","last_undegraded":"2024-09-12T01:56:49.085299+0000","last_fullsized":"2024-09-12T01:56:49.085299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:41.416788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071670+0000","last_change":"2024-09-12T01:56:48.071670+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071670+0000","last_undegraded":"2024-09-12T01:56:48.071670+0000","last_fullsized":"2024-09-12T01:56:48.071670+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.084049+0000","last_change":"2024-09-12T01:56:48.080729+0000","last_active":"2024-09-12T01:56:48.084049+0000","last_peered":"2024-09-12T01:56:48.084049+0000","last_clean":"2024-09-12T01:56:48.084049+0000","last_became_active":"2024-09-12T01:56:48.079864+0000","last_became_peered":"2024-09-12T01:56:48.079864+0000","last_unstale":"2024-09-12T01:56:48.084049+0000","last_undegraded":"2024-09-12T01:56:48.084049+0000","last_fullsized":"2024-09-12T01:56:48.084049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:41.061958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.075231+0000","last_change":"2024-09-12T01:56:48.075231+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.075231+0000","last_undegraded":"2024-09-12T01:56:48.075231+0000","last_fullsized":"2024-09-12T01:56:48.075231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.110710+0000","last_change":"2024-09-12T01:56:48.086993+0000","last_active":"2024-09-12T01:56:49.110710+0000","last_peered":"2024-09-12T01:56:49.110710+0000","last_clean":"2024-09-12T01:56:49.110710+0000","last_became_active":"2024-09-12T01:56:48.086487+0000","last_became_peered":"2024-09-12T01:56:48.086487+0000","last_unstale":"2024-09-12T01:56:49.110710+0000","last_undegraded":"2024-09-12T01:56:49.110710+0000","last_fullsized":"2024-09-12T01:56:49.110710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:10.954294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099651+0000","last_change":"2024-09-12T01:56:49.093510+0000","last_active":"2024-09-12T01:56:49.099651+0000","last_peered":"2024-09-12T01:56:49.099651+0000","last_clean":"2024-09-12T01:56:49.099651+0000","last_became_active":"2024-09-12T01:56:49.092875+0000","last_became_peered":"2024-09-12T01:56:49.092875+0000","last_unstale":"2024-09-12T01:56:49.099651+0000","last_undegraded":"2024-09-12T01:56:49.099651+0000","last_fullsized":"2024-09-12T01:56:49.099651+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:11.959033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.091762+0000","last_change":"2024-09-12T01:56:48.086941+0000","last_active":"2024-09-12T01:56:48.091762+0000","last_peered":"2024-09-12T01:56:48.091762+0000","last_clean":"2024-09-12T01:56:48.091762+0000","last_became_active":"2024-09-12T01:56:48.086626+0000","last_became_peered":"2024-09-12T01:56:48.086626+0000","last_unstale":"2024-09-12T01:56:48.091762+0000","last_undegraded":"2024-09-12T01:56:48.091762+0000","last_fullsized":"2024-09-12T01:56:48.091762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:02.752474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.072071+0000","last_change":"2024-09-12T01:56:48.072071+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.072071+0000","last_undegraded":"2024-09-12T01:56:48.072071+0000","last_fullsized":"2024-09-12T01:56:48.072071+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.089060+0000","last_change":"2024-09-12T01:56:48.084372+0000","last_active":"2024-09-12T01:56:48.089060+0000","last_peered":"2024-09-12T01:56:48.089060+0000","last_clean":"2024-09-12T01:56:48.089060+0000","last_became_active":"2024-09-12T01:56:48.084012+0000","last_became_peered":"2024-09-12T01:56:48.084012+0000","last_unstale":"2024-09-12T01:56:48.089060+0000","last_undegraded":"2024-09-12T01:56:48.089060+0000","last_fullsized":"2024-09-12T01:56:48.089060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:26.586415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069653+0000","last_change":"2024-09-12T01:56:48.069653+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069653+0000","last_undegraded":"2024-09-12T01:56:48.069653+0000","last_fullsized":"2024-09-12T01:56:48.069653+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.075260+0000","last_change":"2024-09-12T01:56:48.074045+0000","last_active":"2024-09-12T01:56:48.075260+0000","last_peered":"2024-09-12T01:56:48.075260+0000","last_clean":"2024-09-12T01:56:48.075260+0000","last_became_active":"2024-09-12T01:56:48.073680+0000","last_became_peered":"2024-09-12T01:56:48.073680+0000","last_unstale":"2024-09-12T01:56:48.075260+0000","last_undegraded":"2024-09-12T01:56:48.075260+0000","last_fullsized":"2024-09-12T01:56:48.075260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:06.321418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.074317+0000","last_change":"2024-09-12T01:56:48.074317+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.074317+0000","last_undegraded":"2024-09-12T01:56:48.074317+0000","last_fullsized":"2024-09-12T01:56:48.074317+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.080051+0000","last_change":"2024-09-12T01:56:48.076087+0000","last_active":"2024-09-12T01:56:49.080051+0000","last_peered":"2024-09-12T01:56:49.080051+0000","last_clean":"2024-09-12T01:56:49.080051+0000","last_became_active":"2024-09-12T01:56:48.075803+0000","last_became_peered":"2024-09-12T01:56:48.075803+0000","last_unstale":"2024-09-12T01:56:49.080051+0000","last_undegraded":"2024-09-12T01:56:49.080051+0000","last_fullsized":"2024-09-12T01:56:49.080051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:27.805990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T01:56:47.064248+0000","last_change":"2024-09-12T01:56:47.064248+0000","last_active":"2024-09-12T01:56:47.056365+0000","last_peered":"2024-09-12T01:56:47.056365+0000","last_clean":"2024-09-12T01:56:47.056365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:47.064248+0000","last_undegraded":"2024-09-12T01:56:47.064248+0000","last_fullsized":"2024-09-12T01:56:47.064248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.095869+0000","last_change":"2024-09-12T01:56:49.091608+0000","last_active":"2024-09-12T01:56:49.095869+0000","last_peered":"2024-09-12T01:56:49.095869+0000","last_clean":"2024-09-12T01:56:49.095869+0000","last_became_active":"2024-09-12T01:56:49.090710+0000","last_became_peered":"2024-09-12T01:56:49.090710+0000","last_unstale":"2024-09-12T01:56:49.095869+0000","last_undegraded":"2024-09-12T01:56:49.095869+0000","last_fullsized":"2024-09-12T01:56:49.095869+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:18.709627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.091829+0000","last_change":"2024-09-12T01:56:48.086306+0000","last_active":"2024-09-12T01:56:48.091829+0000","last_peered":"2024-09-12T01:56:48.091829+0000","last_clean":"2024-09-12T01:56:48.091829+0000","last_became_active":"2024-09-12T01:56:48.085519+0000","last_became_peered":"2024-09-12T01:56:48.085519+0000","last_unstale":"2024-09-12T01:56:48.091829+0000","last_undegraded":"2024-09-12T01:56:48.091829+0000","last_fullsized":"2024-09-12T01:56:48.091829+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:09.193086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104372+0000","last_change":"2024-09-12T01:56:49.096214+0000","last_active":"2024-09-12T01:56:49.104372+0000","last_peered":"2024-09-12T01:56:49.104372+0000","last_clean":"2024-09-12T01:56:49.104372+0000","last_became_active":"2024-09-12T01:56:49.095889+0000","last_became_peered":"2024-09-12T01:56:49.095889+0000","last_unstale":"2024-09-12T01:56:49.104372+0000","last_undegraded":"2024-09-12T01:56:49.104372+0000","last_fullsized":"2024-09-12T01:56:49.104372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:38.096087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.086070+0000","last_change":"2024-09-12T01:56:48.082804+0000","last_active":"2024-09-12T01:56:49.086070+0000","last_peered":"2024-09-12T01:56:49.086070+0000","last_clean":"2024-09-12T01:56:49.086070+0000","last_became_active":"2024-09-12T01:56:48.082323+0000","last_became_peered":"2024-09-12T01:56:48.082323+0000","last_unstale":"2024-09-12T01:56:49.086070+0000","last_undegraded":"2024-09-12T01:56:49.086070+0000","last_fullsized":"2024-09-12T01:56:49.086070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:45.367043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":202,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.084948+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:56:49.084948+0000","last_peered":"2024-09-12T01:56:49.084948+0000","last_clean":"2024-09-12T01:56:49.084948+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:56:49.084948+0000","last_undegraded":"2024-09-12T01:56:49.084948+0000","last_fullsized":"2024-09-12T01:56:49.084948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":773849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":183481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":183481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1011712,"data_stored":767182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":405504,"data_stored":170605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:56:52.775 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3f is not active+clean 2024-09-12T01:56:52.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.074094+0000', 'last_change': '2024-09-12T01:56:48.074094+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.074094+0000', 'last_undegraded': '2024-09-12T01:56:48.074094+0000', 'last_fullsized': '2024-09-12T01:56:48.074094+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:56:52.775 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3e is not active+clean 2024-09-12T01:56:52.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.072752+0000', 'last_change': '2024-09-12T01:56:48.072752+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.072752+0000', 'last_undegraded': '2024-09-12T01:56:48.072752+0000', 'last_fullsized': '2024-09-12T01:56:48.072752+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:56:52.775 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3d is not active+clean 2024-09-12T01:56:52.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.070857+0000', 'last_change': '2024-09-12T01:56:48.070857+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.070857+0000', 'last_undegraded': '2024-09-12T01:56:48.070857+0000', 'last_fullsized': '2024-09-12T01:56:48.070857+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:56:52.775 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3c is not active+clean 2024-09-12T01:56:52.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.071680+0000', 'last_change': '2024-09-12T01:56:48.071680+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.071680+0000', 'last_undegraded': '2024-09-12T01:56:48.071680+0000', 'last_fullsized': '2024-09-12T01:56:48.071680+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:56:52.775 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3b is not active+clean 2024-09-12T01:56:52.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.071211+0000', 'last_change': '2024-09-12T01:56:48.071211+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.071211+0000', 'last_undegraded': '2024-09-12T01:56:48.071211+0000', 'last_fullsized': '2024-09-12T01:56:48.071211+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:56:52.776 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3a is not active+clean 2024-09-12T01:56:52.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.077153+0000', 'last_change': '2024-09-12T01:56:48.077153+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.077153+0000', 'last_undegraded': '2024-09-12T01:56:48.077153+0000', 'last_fullsized': '2024-09-12T01:56:48.077153+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:56:52.776 INFO:tasks.ceph.ceph_manager.ceph:PG 6.38 is not active+clean 2024-09-12T01:56:52.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.069837+0000', 'last_change': '2024-09-12T01:56:48.069837+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.069837+0000', 'last_undegraded': '2024-09-12T01:56:48.069837+0000', 'last_fullsized': '2024-09-12T01:56:48.069837+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:56:52.776 INFO:tasks.ceph.ceph_manager.ceph:PG 6.37 is not active+clean 2024-09-12T01:56:52.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.070676+0000', 'last_change': '2024-09-12T01:56:48.070676+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.070676+0000', 'last_undegraded': '2024-09-12T01:56:48.070676+0000', 'last_fullsized': '2024-09-12T01:56:48.070676+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:56:52.776 INFO:tasks.ceph.ceph_manager.ceph:PG 6.34 is not active+clean 2024-09-12T01:56:52.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.069910+0000', 'last_change': '2024-09-12T01:56:48.069910+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.069910+0000', 'last_undegraded': '2024-09-12T01:56:48.069910+0000', 'last_fullsized': '2024-09-12T01:56:48.069910+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:56:52.776 INFO:tasks.ceph.ceph_manager.ceph:PG 6.32 is not active+clean 2024-09-12T01:56:52.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:56:48.061104+0000', 'last_change': '2024-09-12T01:56:48.061104+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.061104+0000', 'last_undegraded': '2024-09-12T01:56:48.061104+0000', 'last_fullsized': '2024-09-12T01:56:48.061104+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:56:52.777 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2d is not active+clean 2024-09-12T01:56:52.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.070725+0000', 'last_change': '2024-09-12T01:56:48.070725+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.070725+0000', 'last_undegraded': '2024-09-12T01:56:48.070725+0000', 'last_fullsized': '2024-09-12T01:56:48.070725+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:56:52.777 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2a is not active+clean 2024-09-12T01:56:52.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:56:48.061104+0000', 'last_change': '2024-09-12T01:56:48.061104+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.061104+0000', 'last_undegraded': '2024-09-12T01:56:48.061104+0000', 'last_fullsized': '2024-09-12T01:56:48.061104+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:56:52.777 INFO:tasks.ceph.ceph_manager.ceph:PG 6.28 is not active+clean 2024-09-12T01:56:52.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.070901+0000', 'last_change': '2024-09-12T01:56:48.070901+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.070901+0000', 'last_undegraded': '2024-09-12T01:56:48.070901+0000', 'last_fullsized': '2024-09-12T01:56:48.070901+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:56:52.777 INFO:tasks.ceph.ceph_manager.ceph:PG 6.26 is not active+clean 2024-09-12T01:56:52.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.075748+0000', 'last_change': '2024-09-12T01:56:48.075748+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.075748+0000', 'last_undegraded': '2024-09-12T01:56:48.075748+0000', 'last_fullsized': '2024-09-12T01:56:48.075748+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:56:52.777 INFO:tasks.ceph.ceph_manager.ceph:PG 6.20 is not active+clean 2024-09-12T01:56:52.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.074304+0000', 'last_change': '2024-09-12T01:56:48.074304+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.074304+0000', 'last_undegraded': '2024-09-12T01:56:48.074304+0000', 'last_fullsized': '2024-09-12T01:56:48.074304+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:56:52.777 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1d is not active+clean 2024-09-12T01:56:52.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.078670+0000', 'last_change': '2024-09-12T01:56:48.078670+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.078670+0000', 'last_undegraded': '2024-09-12T01:56:48.078670+0000', 'last_fullsized': '2024-09-12T01:56:48.078670+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:56:52.778 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1e is not active+clean 2024-09-12T01:56:52.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:56:48.061104+0000', 'last_change': '2024-09-12T01:56:48.061104+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.061104+0000', 'last_undegraded': '2024-09-12T01:56:48.061104+0000', 'last_fullsized': '2024-09-12T01:56:48.061104+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:56:52.778 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1f is not active+clean 2024-09-12T01:56:52.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.074518+0000', 'last_change': '2024-09-12T01:56:48.074518+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.074518+0000', 'last_undegraded': '2024-09-12T01:56:48.074518+0000', 'last_fullsized': '2024-09-12T01:56:48.074518+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:56:52.778 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-09-12T01:56:52.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:47.063721+0000', 'last_change': '2024-09-12T01:56:47.063721+0000', 'last_active': '2024-09-12T01:56:47.056365+0000', 'last_peered': '2024-09-12T01:56:47.056365+0000', 'last_clean': '2024-09-12T01:56:47.056365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:47.063721+0000', 'last_undegraded': '2024-09-12T01:56:47.063721+0000', 'last_fullsized': '2024-09-12T01:56:47.063721+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:47.056365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:47.056365+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:47.056365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:56:52.778 INFO:tasks.ceph.ceph_manager.ceph:PG 6.18 is not active+clean 2024-09-12T01:56:52.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.071004+0000', 'last_change': '2024-09-12T01:56:48.071004+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.071004+0000', 'last_undegraded': '2024-09-12T01:56:48.071004+0000', 'last_fullsized': '2024-09-12T01:56:48.071004+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:56:52.779 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1a is not active+clean 2024-09-12T01:56:52.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:56:48.061104+0000', 'last_change': '2024-09-12T01:56:48.061104+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.061104+0000', 'last_undegraded': '2024-09-12T01:56:48.061104+0000', 'last_fullsized': '2024-09-12T01:56:48.061104+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:56:52.779 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1b is not active+clean 2024-09-12T01:56:52.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.072553+0000', 'last_change': '2024-09-12T01:56:48.072553+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.072553+0000', 'last_undegraded': '2024-09-12T01:56:48.072553+0000', 'last_fullsized': '2024-09-12T01:56:48.072553+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:56:52.779 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-12T01:56:52.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:47.063531+0000', 'last_change': '2024-09-12T01:56:47.063531+0000', 'last_active': '2024-09-12T01:56:47.056365+0000', 'last_peered': '2024-09-12T01:56:47.056365+0000', 'last_clean': '2024-09-12T01:56:47.056365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:47.063531+0000', 'last_undegraded': '2024-09-12T01:56:47.063531+0000', 'last_fullsized': '2024-09-12T01:56:47.063531+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:47.056365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:47.056365+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:47.056365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:56:52.779 INFO:tasks.ceph.ceph_manager.ceph:PG 6.14 is not active+clean 2024-09-12T01:56:52.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.069971+0000', 'last_change': '2024-09-12T01:56:48.069971+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.069971+0000', 'last_undegraded': '2024-09-12T01:56:48.069971+0000', 'last_fullsized': '2024-09-12T01:56:48.069971+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:56:52.779 INFO:tasks.ceph.ceph_manager.ceph:PG 6.16 is not active+clean 2024-09-12T01:56:52.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.071472+0000', 'last_change': '2024-09-12T01:56:48.071472+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.071472+0000', 'last_undegraded': '2024-09-12T01:56:48.071472+0000', 'last_fullsized': '2024-09-12T01:56:48.071472+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:56:52.780 INFO:tasks.ceph.ceph_manager.ceph:PG 6.17 is not active+clean 2024-09-12T01:56:52.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:56:48.061104+0000', 'last_change': '2024-09-12T01:56:48.061104+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.061104+0000', 'last_undegraded': '2024-09-12T01:56:48.061104+0000', 'last_fullsized': '2024-09-12T01:56:48.061104+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:56:52.780 INFO:tasks.ceph.ceph_manager.ceph:PG 6.10 is not active+clean 2024-09-12T01:56:52.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.070131+0000', 'last_change': '2024-09-12T01:56:48.070131+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.070131+0000', 'last_undegraded': '2024-09-12T01:56:48.070131+0000', 'last_fullsized': '2024-09-12T01:56:48.070131+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:56:52.780 INFO:tasks.ceph.ceph_manager.ceph:PG 6.11 is not active+clean 2024-09-12T01:56:52.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.069627+0000', 'last_change': '2024-09-12T01:56:48.069627+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.069627+0000', 'last_undegraded': '2024-09-12T01:56:48.069627+0000', 'last_fullsized': '2024-09-12T01:56:48.069627+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:56:52.780 INFO:tasks.ceph.ceph_manager.ceph:PG 6.13 is not active+clean 2024-09-12T01:56:52.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.072096+0000', 'last_change': '2024-09-12T01:56:48.072096+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.072096+0000', 'last_undegraded': '2024-09-12T01:56:48.072096+0000', 'last_fullsized': '2024-09-12T01:56:48.072096+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:56:52.780 INFO:tasks.ceph.ceph_manager.ceph:PG 6.c is not active+clean 2024-09-12T01:56:52.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.073530+0000', 'last_change': '2024-09-12T01:56:48.073530+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.073530+0000', 'last_undegraded': '2024-09-12T01:56:48.073530+0000', 'last_fullsized': '2024-09-12T01:56:48.073530+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:56:52.780 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-12T01:56:52.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:47.063834+0000', 'last_change': '2024-09-12T01:56:47.063834+0000', 'last_active': '2024-09-12T01:56:47.056365+0000', 'last_peered': '2024-09-12T01:56:47.056365+0000', 'last_clean': '2024-09-12T01:56:47.056365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:47.063834+0000', 'last_undegraded': '2024-09-12T01:56:47.063834+0000', 'last_fullsized': '2024-09-12T01:56:47.063834+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:47.056365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:47.056365+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:47.056365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:56:52.781 INFO:tasks.ceph.ceph_manager.ceph:PG 6.e is not active+clean 2024-09-12T01:56:52.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:56:48.061104+0000', 'last_change': '2024-09-12T01:56:48.061104+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.061104+0000', 'last_undegraded': '2024-09-12T01:56:48.061104+0000', 'last_fullsized': '2024-09-12T01:56:48.061104+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:56:52.781 INFO:tasks.ceph.ceph_manager.ceph:PG 6.f is not active+clean 2024-09-12T01:56:52.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.069015+0000', 'last_change': '2024-09-12T01:56:48.069015+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.069015+0000', 'last_undegraded': '2024-09-12T01:56:48.069015+0000', 'last_fullsized': '2024-09-12T01:56:48.069015+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:56:52.781 INFO:tasks.ceph.ceph_manager.ceph:PG 6.9 is not active+clean 2024-09-12T01:56:52.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.069144+0000', 'last_change': '2024-09-12T01:56:48.069144+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.069144+0000', 'last_undegraded': '2024-09-12T01:56:48.069144+0000', 'last_fullsized': '2024-09-12T01:56:48.069144+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:56:52.781 INFO:tasks.ceph.ceph_manager.ceph:PG 6.b is not active+clean 2024-09-12T01:56:52.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.071670+0000', 'last_change': '2024-09-12T01:56:48.071670+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.071670+0000', 'last_undegraded': '2024-09-12T01:56:48.071670+0000', 'last_fullsized': '2024-09-12T01:56:48.071670+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:56:52.782 INFO:tasks.ceph.ceph_manager.ceph:PG 6.4 is not active+clean 2024-09-12T01:56:52.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.075231+0000', 'last_change': '2024-09-12T01:56:48.075231+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.075231+0000', 'last_undegraded': '2024-09-12T01:56:48.075231+0000', 'last_fullsized': '2024-09-12T01:56:48.075231+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:56:52.782 INFO:tasks.ceph.ceph_manager.ceph:PG 6.6 is not active+clean 2024-09-12T01:56:52.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.072071+0000', 'last_change': '2024-09-12T01:56:48.072071+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.072071+0000', 'last_undegraded': '2024-09-12T01:56:48.072071+0000', 'last_fullsized': '2024-09-12T01:56:48.072071+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:56:52.782 INFO:tasks.ceph.ceph_manager.ceph:PG 6.0 is not active+clean 2024-09-12T01:56:52.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.069653+0000', 'last_change': '2024-09-12T01:56:48.069653+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.069653+0000', 'last_undegraded': '2024-09-12T01:56:48.069653+0000', 'last_fullsized': '2024-09-12T01:56:48.069653+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:56:52.782 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1 is not active+clean 2024-09-12T01:56:52.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:48.074317+0000', 'last_change': '2024-09-12T01:56:48.074317+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.074317+0000', 'last_undegraded': '2024-09-12T01:56:48.074317+0000', 'last_fullsized': '2024-09-12T01:56:48.074317+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:56:52.782 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2 is not active+clean 2024-09-12T01:56:52.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:56:48.061104+0000', 'last_change': '2024-09-12T01:56:48.061104+0000', 'last_active': '2024-09-12T01:56:48.061104+0000', 'last_peered': '2024-09-12T01:56:48.061104+0000', 'last_clean': '2024-09-12T01:56:48.061104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:48.061104+0000', 'last_undegraded': '2024-09-12T01:56:48.061104+0000', 'last_fullsized': '2024-09-12T01:56:48.061104+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:48.061104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:56:52.782 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-12T01:56:52.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:56:47.064248+0000', 'last_change': '2024-09-12T01:56:47.064248+0000', 'last_active': '2024-09-12T01:56:47.056365+0000', 'last_peered': '2024-09-12T01:56:47.056365+0000', 'last_clean': '2024-09-12T01:56:47.056365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:56:47.064248+0000', 'last_undegraded': '2024-09-12T01:56:47.064248+0000', 'last_fullsized': '2024-09-12T01:56:47.064248+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:56:47.056365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:56:47.056365+0000', 'last_clean_scrub_stamp': '2024-09-12T01:56:47.056365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:56:52.783 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T01:56:52.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.913+0000 7fc3c3da1640 1 Processor -- start 2024-09-12T01:56:52.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.913+0000 7fc3c3da1640 1 -- start start 2024-09-12T01:56:52.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.914+0000 7fc3c3da1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3bc0b6680 0x7fc3bc169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.914+0000 7fc3c3da1640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3bc06d9f0 con 0x7fc3bc161c80 2024-09-12T01:56:52.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.914+0000 7fc3c3da1640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3bc06dcd0 con 0x7fc3bc162060 2024-09-12T01:56:52.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.914+0000 7fc3c3da1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc3bc06dfb0 con 0x7fc3bc0b6680 2024-09-12T01:56:52.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.914+0000 7fc3c1b3d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc3bc161c80 0x7fc3bc06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43824/0 (socket says 172.21.15.19:43824) 2024-09-12T01:56:52.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.914+0000 7fc3c1b3d640 1 -- 172.21.15.19:0/3504264408 learned_addr learned my addr 172.21.15.19:0/3504264408 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:52.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.914+0000 7fc3c233e640 1 --2- 172.21.15.19:0/3504264408 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3bc0b6680 0x7fc3bc169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.914+0000 7fc3c0b3b640 1 -- 172.21.15.19:0/3504264408 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 577550802 0 0) 0x7fc3bc06d9f0 con 0x7fc3bc161c80 2024-09-12T01:56:52.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.914+0000 7fc3c0b3b640 1 -- 172.21.15.19:0/3504264408 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3a8003520 con 0x7fc3bc161c80 2024-09-12T01:56:52.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.914+0000 7fc3c0b3b640 1 -- 172.21.15.19:0/3504264408 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3711805918 0 0) 0x7fc3bc06dcd0 con 0x7fc3bc162060 2024-09-12T01:56:52.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.914+0000 7fc3c0b3b640 1 -- 172.21.15.19:0/3504264408 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3bc06d9f0 con 0x7fc3bc162060 2024-09-12T01:56:52.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.915+0000 7fc3c0b3b640 1 -- 172.21.15.19:0/3504264408 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3164016296 0 0) 0x7fc3a8003520 con 0x7fc3bc161c80 2024-09-12T01:56:52.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.915+0000 7fc3c233e640 1 -- 172.21.15.19:0/3504264408 >> v1:172.21.15.135:6789/0 conn(0x7fc3bc162060 legacy=0x7fc3bc0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.915+0000 7fc3c233e640 1 -- 172.21.15.19:0/3504264408 >> v1:172.21.15.19:6789/0 conn(0x7fc3bc161c80 legacy=0x7fc3bc06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.915+0000 7fc3c233e640 1 -- 172.21.15.19:0/3504264408 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3bc0d01f0 con 0x7fc3bc0b6680 2024-09-12T01:56:52.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.915+0000 7fc3c233e640 1 --2- 172.21.15.19:0/3504264408 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3bc0b6680 0x7fc3bc169830 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009dc0 tx=0x7fc3b402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48c86e3b9a59a0f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:52.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.916+0000 7fc3c0b3b640 1 -- 172.21.15.19:0/3504264408 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8001670 con 0x7fc3bc0b6680 2024-09-12T01:56:52.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.916+0000 7fc3c0b3b640 1 -- 172.21.15.19:0/3504264408 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b4007540 con 0x7fc3bc0b6680 2024-09-12T01:56:52.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.916+0000 7fc3c0b3b640 1 -- 172.21.15.19:0/3504264408 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4007910 con 0x7fc3bc0b6680 2024-09-12T01:56:52.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.916+0000 7fc3c3da1640 1 -- 172.21.15.19:0/3504264408 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3bc0b6680 msgr2=0x7fc3bc169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.916+0000 7fc3c3da1640 1 --2- 172.21.15.19:0/3504264408 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3bc0b6680 0x7fc3bc169830 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009dc0 tx=0x7fc3b402a660 comp rx=0 tx=0).stop 2024-09-12T01:56:52.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.916+0000 7fc3c3da1640 1 -- 172.21.15.19:0/3504264408 shutdown_connections 2024-09-12T01:56:52.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.916+0000 7fc3c3da1640 1 --2- 172.21.15.19:0/3504264408 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3bc0b6680 0x7fc3bc169830 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.916+0000 7fc3c3da1640 1 -- 172.21.15.19:0/3504264408 >> 172.21.15.19:0/3504264408 conn(0x7fc3bc0d44f0 msgr2=0x7fc3bc0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:52.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.916+0000 7fc3c3da1640 1 -- 172.21.15.19:0/3504264408 shutdown_connections 2024-09-12T01:56:52.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.916+0000 7fc3c3da1640 1 -- 172.21.15.19:0/3504264408 wait complete. 2024-09-12T01:56:52.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.917+0000 7fc3c3da1640 1 Processor -- start 2024-09-12T01:56:52.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.917+0000 7fc3c3da1640 1 -- start start 2024-09-12T01:56:52.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.918+0000 7fc3c3da1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3bc0b6680 0x7fc3bc14fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.918+0000 7fc3c3da1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3bc161c80 0x7fc3bc158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.918+0000 7fc3c3da1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3bc162060 0x7fc3bc1585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.918+0000 7fc3c3da1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc0b6cb0 con 0x7fc3bc161c80 2024-09-12T01:56:52.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.918+0000 7fc3c3da1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc0b6b30 con 0x7fc3bc0b6680 2024-09-12T01:56:52.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.918+0000 7fc3c3da1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc3bc169d70 con 0x7fc3bc162060 2024-09-12T01:56:52.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.918+0000 7fc3c133c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3bc161c80 0x7fc3bc158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.918+0000 7fc3c133c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3bc161c80 0x7fc3bc158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53084/0 (socket says 172.21.15.19:53084) 2024-09-12T01:56:52.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.918+0000 7fc3c133c640 1 -- 172.21.15.19:0/3810044266 learned_addr learned my addr 172.21.15.19:0/3810044266 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:52.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.918+0000 7fc3c1b3d640 1 --2- 172.21.15.19:0/3810044266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3bc0b6680 0x7fc3bc14fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.918+0000 7fc3c233e640 1 --2- 172.21.15.19:0/3810044266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3bc162060 0x7fc3bc1585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.919+0000 7fc3c133c640 1 -- 172.21.15.19:0/3810044266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3bc162060 msgr2=0x7fc3bc1585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.919+0000 7fc3c133c640 1 --2- 172.21.15.19:0/3810044266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3bc162060 0x7fc3bc1585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.919+0000 7fc3c133c640 1 -- 172.21.15.19:0/3810044266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3bc0b6680 msgr2=0x7fc3bc14fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.919+0000 7fc3c133c640 1 --2- 172.21.15.19:0/3810044266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3bc0b6680 0x7fc3bc14fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.919+0000 7fc3c133c640 1 -- 172.21.15.19:0/3810044266 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3bc0cabe0 con 0x7fc3bc161c80 2024-09-12T01:56:52.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.919+0000 7fc3c233e640 1 --2- 172.21.15.19:0/3810044266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3bc162060 0x7fc3bc1585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:52.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.919+0000 7fc3c133c640 1 --2- 172.21.15.19:0/3810044266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3bc161c80 0x7fc3bc158070 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000c480 tx=0x7fc3b000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:52.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.919+0000 7fc3ae7fc640 1 -- 172.21.15.19:0/3810044266 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b00052d0 con 0x7fc3bc161c80 2024-09-12T01:56:52.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.919+0000 7fc3ae7fc640 1 -- 172.21.15.19:0/3810044266 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b0005470 con 0x7fc3bc161c80 2024-09-12T01:56:52.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.919+0000 7fc3c3da1640 1 -- 172.21.15.19:0/3810044266 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3bc0b9e10 con 0x7fc3bc161c80 2024-09-12T01:56:52.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.919+0000 7fc3ae7fc640 1 -- 172.21.15.19:0/3810044266 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0012870 con 0x7fc3bc161c80 2024-09-12T01:56:52.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.919+0000 7fc3c3da1640 1 -- 172.21.15.19:0/3810044266 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3bc0c9fe0 con 0x7fc3bc161c80 2024-09-12T01:56:52.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.920+0000 7fc3c3da1640 1 -- 172.21.15.19:0/3810044266 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3bc0b5f70 con 0x7fc3bc161c80 2024-09-12T01:56:52.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.921+0000 7fc3ae7fc640 1 -- 172.21.15.19:0/3810044266 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3b0012a10 con 0x7fc3bc161c80 2024-09-12T01:56:52.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.921+0000 7fc3ae7fc640 1 --2- 172.21.15.19:0/3810044266 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc3a006be30 0x7fc3a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.921+0000 7fc3ae7fc640 1 -- 172.21.15.19:0/3810044266 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fc3b008abc0 con 0x7fc3bc161c80 2024-09-12T01:56:52.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.921+0000 7fc3c1b3d640 1 --2- 172.21.15.19:0/3810044266 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc3a006be30 0x7fc3a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.922+0000 7fc3c1b3d640 1 --2- 172.21.15.19:0/3810044266 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc3a006be30 0x7fc3a006e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80017e0 tx=0x7fc3b8001610 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:52.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:52.926+0000 7fc3ae7fc640 1 -- 172.21.15.19:0/3810044266 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc3b0059530 con 0x7fc3bc161c80 2024-09-12T01:56:53.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.169+0000 7fc3c3da1640 1 -- 172.21.15.19:0/3810044266 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc3bc0ba470 con 0x7fc3bc161c80 2024-09-12T01:56:53.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.170+0000 7fc3ae7fc640 1 -- 172.21.15.19:0/3810044266 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1762 (secure 0 0 0) 0x7fc3b0058e30 con 0x7fc3bc161c80 2024-09-12T01:56:53.170 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:53.170 INFO:teuthology.orchestra.run.smithi019.stdout:{"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":81,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":40,"num_osds":8,"num_up_osds":8,"osd_up_since":1726106143,"num_in_osds":8,"osd_in_since":1726106133,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":56},{"state_name":"creating+peering","count":34},{"state_name":"unknown","count":7}],"num_pgs":97,"num_pools":3,"num_objects":12,"data_bytes":591062,"bytes_used":225976320,"bytes_avail":772868136960,"bytes_total":773094113280,"unknown_pgs_ratio":0.072164945304393768,"inactive_pgs_ratio":0.3505154550075531,"write_bytes_sec":610,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":15,"btime":"2024-09-12T01:56:51:094820+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4822}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-12T01:56:46.096848+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T01:56:53.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.172+0000 7fc3c3da1640 1 -- 172.21.15.19:0/3810044266 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc3a006be30 msgr2=0x7fc3a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:53.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.172+0000 7fc3c3da1640 1 --2- 172.21.15.19:0/3810044266 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc3a006be30 0x7fc3a006e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80017e0 tx=0x7fc3b8001610 comp rx=0 tx=0).stop 2024-09-12T01:56:53.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.172+0000 7fc3c3da1640 1 -- 172.21.15.19:0/3810044266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3bc161c80 msgr2=0x7fc3bc158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:53.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.172+0000 7fc3c3da1640 1 --2- 172.21.15.19:0/3810044266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3bc161c80 0x7fc3bc158070 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000c480 tx=0x7fc3b000c940 comp rx=0 tx=0).stop 2024-09-12T01:56:53.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.172+0000 7fc3c3da1640 1 -- 172.21.15.19:0/3810044266 shutdown_connections 2024-09-12T01:56:53.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.172+0000 7fc3c3da1640 1 --2- 172.21.15.19:0/3810044266 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc3a006be30 0x7fc3a006e2f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:53.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.172+0000 7fc3c3da1640 1 --2- 172.21.15.19:0/3810044266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3bc162060 0x7fc3bc1585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:53.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.172+0000 7fc3c3da1640 1 --2- 172.21.15.19:0/3810044266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3bc161c80 0x7fc3bc158070 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:53.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.172+0000 7fc3c3da1640 1 --2- 172.21.15.19:0/3810044266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3bc0b6680 0x7fc3bc14fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:53.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.172+0000 7fc3c3da1640 1 -- 172.21.15.19:0/3810044266 >> 172.21.15.19:0/3810044266 conn(0x7fc3bc0d44f0 msgr2=0x7fc3bc0b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:53.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.172+0000 7fc3c3da1640 1 -- 172.21.15.19:0/3810044266 shutdown_connections 2024-09-12T01:56:53.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.172+0000 7fc3c3da1640 1 -- 172.21.15.19:0/3810044266 wait complete. 2024-09-12T01:56:53.183 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T01:56:53.183 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:56:53.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.286+0000 7f476378d640 1 Processor -- start 2024-09-12T01:56:53.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.286+0000 7f476378d640 1 -- start start 2024-09-12T01:56:53.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.287+0000 7f476378d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f475c0d04a0 0x7f475c0d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:53.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.287+0000 7f476378d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f475c0ae550 0x7f475c0ae980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:53.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.287+0000 7f476378d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f475c06cb30 con 0x7f475c147360 2024-09-12T01:56:53.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.287+0000 7f476378d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f475c06bfb0 con 0x7f475c0ae550 2024-09-12T01:56:53.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.287+0000 7f476378d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f475c06c290 con 0x7f475c0d04a0 2024-09-12T01:56:53.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.287+0000 7f4761d2a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f475c0ae550 0x7f475c0ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:53.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.287+0000 7f4761d2a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f475c0ae550 0x7f475c0ae980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53098/0 (socket says 172.21.15.19:53098) 2024-09-12T01:56:53.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.287+0000 7f4761d2a640 1 -- 172.21.15.19:0/1695379874 learned_addr learned my addr 172.21.15.19:0/1695379874 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:53.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.287+0000 7f4761d2a640 1 -- 172.21.15.19:0/1695379874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f475c0d04a0 msgr2=0x7f475c0d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:53.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.287+0000 7f4761d2a640 1 --2- 172.21.15.19:0/1695379874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f475c0d04a0 0x7f475c0d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:53.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.287+0000 7f4761d2a640 1 -- 172.21.15.19:0/1695379874 >> v1:172.21.15.135:6789/0 conn(0x7f475c147360 legacy=0x7f475c070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:53.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.287+0000 7f4761d2a640 1 -- 172.21.15.19:0/1695379874 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475c06c570 con 0x7f475c0ae550 2024-09-12T01:56:53.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.288+0000 7f4761d2a640 1 --2- 172.21.15.19:0/1695379874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c0ae550 0x7f475c0ae980 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4754009e50 tx=0x7f475402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3460877a89764b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:53.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.288+0000 7f4753fff640 1 -- 172.21.15.19:0/1695379874 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4754036070 con 0x7f475c0ae550 2024-09-12T01:56:53.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.288+0000 7f4753fff640 1 -- 172.21.15.19:0/1695379874 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4754031600 con 0x7f475c0ae550 2024-09-12T01:56:53.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.288+0000 7f4753fff640 1 -- 172.21.15.19:0/1695379874 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47540319d0 con 0x7f475c0ae550 2024-09-12T01:56:53.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.289+0000 7f476378d640 1 -- 172.21.15.19:0/1695379874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c0ae550 msgr2=0x7f475c0ae980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:53.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.289+0000 7f476378d640 1 --2- 172.21.15.19:0/1695379874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c0ae550 0x7f475c0ae980 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4754009e50 tx=0x7f475402a630 comp rx=0 tx=0).stop 2024-09-12T01:56:53.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.289+0000 7f476378d640 1 -- 172.21.15.19:0/1695379874 shutdown_connections 2024-09-12T01:56:53.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.289+0000 7f476378d640 1 --2- 172.21.15.19:0/1695379874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c0ae550 0x7f475c0ae980 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:53.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.289+0000 7f476378d640 1 --2- 172.21.15.19:0/1695379874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f475c0d04a0 0x7f475c0d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:53.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.289+0000 7f476378d640 1 -- 172.21.15.19:0/1695379874 >> 172.21.15.19:0/1695379874 conn(0x7f475c0b2f40 msgr2=0x7f475c0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:53.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.289+0000 7f476378d640 1 -- 172.21.15.19:0/1695379874 shutdown_connections 2024-09-12T01:56:53.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.289+0000 7f476378d640 1 -- 172.21.15.19:0/1695379874 wait complete. 2024-09-12T01:56:53.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.290+0000 7f476378d640 1 Processor -- start 2024-09-12T01:56:53.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.290+0000 7f476378d640 1 -- start start 2024-09-12T01:56:53.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f476378d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f475c0ae550 0x7f475c0b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:53.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f476378d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c0d04a0 0x7f475c1f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f476378d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f475c147360 0x7f475c141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f476378d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f475c070fa0 con 0x7f475c0d04a0 2024-09-12T01:56:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f476378d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f475c0d0e20 con 0x7f475c0ae550 2024-09-12T01:56:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f476378d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f475c06bc10 con 0x7f475c147360 2024-09-12T01:56:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f4760d28640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c0d04a0 0x7f475c1f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f4760d28640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c0d04a0 0x7f475c1f44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53104/0 (socket says 172.21.15.19:53104) 2024-09-12T01:56:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f4760d28640 1 -- 172.21.15.19:0/388994154 learned_addr learned my addr 172.21.15.19:0/388994154 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f4761d2a640 1 --2- 172.21.15.19:0/388994154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f475c147360 0x7f475c141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f4761529640 1 --2- 172.21.15.19:0/388994154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f475c0ae550 0x7f475c0b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f4760d28640 1 -- 172.21.15.19:0/388994154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f475c147360 msgr2=0x7f475c141870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f4760d28640 1 --2- 172.21.15.19:0/388994154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f475c147360 0x7f475c141870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f4760d28640 1 -- 172.21.15.19:0/388994154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f475c0ae550 msgr2=0x7f475c0b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f4760d28640 1 --2- 172.21.15.19:0/388994154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f475c0ae550 0x7f475c0b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:53.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f4760d28640 1 -- 172.21.15.19:0/388994154 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475c0b5710 con 0x7f475c0d04a0 2024-09-12T01:56:53.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f4761529640 1 --2- 172.21.15.19:0/388994154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f475c0ae550 0x7f475c0b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:53.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f4760d28640 1 --2- 172.21.15.19:0/388994154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c0d04a0 0x7f475c1f44e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f474c00b4d0 tx=0x7f474c00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:53.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f4751ffb640 1 -- 172.21.15.19:0/388994154 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c014070 con 0x7f475c0d04a0 2024-09-12T01:56:53.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f4751ffb640 1 -- 172.21.15.19:0/388994154 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f474c010870 con 0x7f475c0d04a0 2024-09-12T01:56:53.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f476378d640 1 -- 172.21.15.19:0/388994154 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f475c0b5a50 con 0x7f475c0d04a0 2024-09-12T01:56:53.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.291+0000 7f4751ffb640 1 -- 172.21.15.19:0/388994154 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c010c60 con 0x7f475c0d04a0 2024-09-12T01:56:53.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.292+0000 7f476378d640 1 -- 172.21.15.19:0/388994154 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f475c0b6290 con 0x7f475c0d04a0 2024-09-12T01:56:53.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.293+0000 7f476378d640 1 -- 172.21.15.19:0/388994154 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f475c0d08e0 con 0x7f475c0d04a0 2024-09-12T01:56:53.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.293+0000 7f4751ffb640 1 -- 172.21.15.19:0/388994154 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f474c017070 con 0x7f475c0d04a0 2024-09-12T01:56:53.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.294+0000 7f4751ffb640 1 --2- 172.21.15.19:0/388994154 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f474006be30 0x7f474006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:53.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.294+0000 7f4751ffb640 1 -- 172.21.15.19:0/388994154 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f474c08ae50 con 0x7f475c0d04a0 2024-09-12T01:56:53.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.294+0000 7f4761529640 1 --2- 172.21.15.19:0/388994154 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f474006be30 0x7f474006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:53.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.294+0000 7f4761529640 1 --2- 172.21.15.19:0/388994154 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f474006be30 0x7f474006e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f475c142320 tx=0x7f4758008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:53.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.298+0000 7f4751ffb640 1 -- 172.21.15.19:0/388994154 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f475c0b5a50 con 0x7f475c0d04a0 2024-09-12T01:56:53.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.474+0000 7f476378d640 1 -- 172.21.15.19:0/388994154 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f475c0b5c30 con 0x7f474006be30 2024-09-12T01:56:53.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.480+0000 7f4751ffb640 1 -- 172.21.15.19:0/388994154 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248078 (secure 0 0 0) 0x7f475800ad80 con 0x7f474006be30 2024-09-12T01:56:53.483 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:53.484 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:56:53.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.484+0000 7f476378d640 1 -- 172.21.15.19:0/388994154 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f474006be30 msgr2=0x7f474006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:53.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.484+0000 7f476378d640 1 --2- 172.21.15.19:0/388994154 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f474006be30 0x7f474006e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f475c142320 tx=0x7f4758008040 comp rx=0 tx=0).stop 2024-09-12T01:56:53.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.484+0000 7f476378d640 1 -- 172.21.15.19:0/388994154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c0d04a0 msgr2=0x7f475c1f44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:53.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.484+0000 7f476378d640 1 --2- 172.21.15.19:0/388994154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c0d04a0 0x7f475c1f44e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f474c00b4d0 tx=0x7f474c00b990 comp rx=0 tx=0).stop 2024-09-12T01:56:53.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.484+0000 7f476378d640 1 -- 172.21.15.19:0/388994154 shutdown_connections 2024-09-12T01:56:53.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.484+0000 7f476378d640 1 --2- 172.21.15.19:0/388994154 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f474006be30 0x7f474006e2f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:53.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.484+0000 7f476378d640 1 --2- 172.21.15.19:0/388994154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f475c147360 0x7f475c141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:53.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.484+0000 7f476378d640 1 --2- 172.21.15.19:0/388994154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c0d04a0 0x7f475c1f44e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:53.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.484+0000 7f476378d640 1 --2- 172.21.15.19:0/388994154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f475c0ae550 0x7f475c0b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:53.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.484+0000 7f476378d640 1 -- 172.21.15.19:0/388994154 >> 172.21.15.19:0/388994154 conn(0x7f475c0b2f40 msgr2=0x7f475c0b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:53.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.484+0000 7f476378d640 1 -- 172.21.15.19:0/388994154 shutdown_connections 2024-09-12T01:56:53.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:53.484+0000 7f476378d640 1 -- 172.21.15.19:0/388994154 wait complete. 2024-09-12T01:56:53.495 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-12T01:56:52.097903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":183,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220680,"kb_used_data":4448,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754040,"statfs":{"total":773094113280,"available":772868136960,"internally_reserved":0,"allocated":4554752,"data_stored":2609040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.035864"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.074094+0000","last_change":"2024-09-12T01:56:48.074094+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.074094+0000","last_undegraded":"2024-09-12T01:56:48.074094+0000","last_fullsized":"2024-09-12T01:56:48.074094+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.072752+0000","last_change":"2024-09-12T01:56:48.072752+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.072752+0000","last_undegraded":"2024-09-12T01:56:48.072752+0000","last_fullsized":"2024-09-12T01:56:48.072752+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070857+0000","last_change":"2024-09-12T01:56:48.070857+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070857+0000","last_undegraded":"2024-09-12T01:56:48.070857+0000","last_fullsized":"2024-09-12T01:56:48.070857+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071680+0000","last_change":"2024-09-12T01:56:48.071680+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071680+0000","last_undegraded":"2024-09-12T01:56:48.071680+0000","last_fullsized":"2024-09-12T01:56:48.071680+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071211+0000","last_change":"2024-09-12T01:56:48.071211+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071211+0000","last_undegraded":"2024-09-12T01:56:48.071211+0000","last_fullsized":"2024-09-12T01:56:48.071211+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.077153+0000","last_change":"2024-09-12T01:56:48.077153+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.077153+0000","last_undegraded":"2024-09-12T01:56:48.077153+0000","last_fullsized":"2024-09-12T01:56:48.077153+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104551+0000","last_change":"2024-09-12T01:56:49.095662+0000","last_active":"2024-09-12T01:56:49.104551+0000","last_peered":"2024-09-12T01:56:49.104551+0000","last_clean":"2024-09-12T01:56:49.104551+0000","last_became_active":"2024-09-12T01:56:49.095303+0000","last_became_peered":"2024-09-12T01:56:49.095303+0000","last_unstale":"2024-09-12T01:56:49.104551+0000","last_undegraded":"2024-09-12T01:56:49.104551+0000","last_fullsized":"2024-09-12T01:56:49.104551+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:08.496640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069837+0000","last_change":"2024-09-12T01:56:48.069837+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069837+0000","last_undegraded":"2024-09-12T01:56:48.069837+0000","last_fullsized":"2024-09-12T01:56:48.069837+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070676+0000","last_change":"2024-09-12T01:56:48.070676+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070676+0000","last_undegraded":"2024-09-12T01:56:48.070676+0000","last_fullsized":"2024-09-12T01:56:48.070676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107459+0000","last_change":"2024-09-12T01:56:49.100284+0000","last_active":"2024-09-12T01:56:49.107459+0000","last_peered":"2024-09-12T01:56:49.107459+0000","last_clean":"2024-09-12T01:56:49.107459+0000","last_became_active":"2024-09-12T01:56:49.100012+0000","last_became_peered":"2024-09-12T01:56:49.100012+0000","last_unstale":"2024-09-12T01:56:49.107459+0000","last_undegraded":"2024-09-12T01:56:49.107459+0000","last_fullsized":"2024-09-12T01:56:49.107459+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:27.444535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099908+0000","last_change":"2024-09-12T01:56:49.092104+0000","last_active":"2024-09-12T01:56:49.099908+0000","last_peered":"2024-09-12T01:56:49.099908+0000","last_clean":"2024-09-12T01:56:49.099908+0000","last_became_active":"2024-09-12T01:56:49.091831+0000","last_became_peered":"2024-09-12T01:56:49.091831+0000","last_unstale":"2024-09-12T01:56:49.099908+0000","last_undegraded":"2024-09-12T01:56:49.099908+0000","last_fullsized":"2024-09-12T01:56:49.099908+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:30.275429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069910+0000","last_change":"2024-09-12T01:56:48.069910+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069910+0000","last_undegraded":"2024-09-12T01:56:48.069910+0000","last_fullsized":"2024-09-12T01:56:48.069910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104911+0000","last_change":"2024-09-12T01:56:49.097145+0000","last_active":"2024-09-12T01:56:49.104911+0000","last_peered":"2024-09-12T01:56:49.104911+0000","last_clean":"2024-09-12T01:56:49.104911+0000","last_became_active":"2024-09-12T01:56:49.096854+0000","last_became_peered":"2024-09-12T01:56:49.096854+0000","last_unstale":"2024-09-12T01:56:49.104911+0000","last_undegraded":"2024-09-12T01:56:49.104911+0000","last_fullsized":"2024-09-12T01:56:49.104911+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:10.499892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104572+0000","last_change":"2024-09-12T01:56:49.098596+0000","last_active":"2024-09-12T01:56:49.104572+0000","last_peered":"2024-09-12T01:56:49.104572+0000","last_clean":"2024-09-12T01:56:49.104572+0000","last_became_active":"2024-09-12T01:56:49.096857+0000","last_became_peered":"2024-09-12T01:56:49.096857+0000","last_unstale":"2024-09-12T01:56:49.104572+0000","last_undegraded":"2024-09-12T01:56:49.104572+0000","last_fullsized":"2024-09-12T01:56:49.104572+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:30.650006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103449+0000","last_change":"2024-09-12T01:56:49.098562+0000","last_active":"2024-09-12T01:56:49.103449+0000","last_peered":"2024-09-12T01:56:49.103449+0000","last_clean":"2024-09-12T01:56:49.103449+0000","last_became_active":"2024-09-12T01:56:49.098285+0000","last_became_peered":"2024-09-12T01:56:49.098285+0000","last_unstale":"2024-09-12T01:56:49.103449+0000","last_undegraded":"2024-09-12T01:56:49.103449+0000","last_fullsized":"2024-09-12T01:56:49.103449+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:10.499892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103274+0000","last_change":"2024-09-12T01:56:49.097918+0000","last_active":"2024-09-12T01:56:49.103274+0000","last_peered":"2024-09-12T01:56:49.103274+0000","last_clean":"2024-09-12T01:56:49.103274+0000","last_became_active":"2024-09-12T01:56:49.097595+0000","last_became_peered":"2024-09-12T01:56:49.097595+0000","last_unstale":"2024-09-12T01:56:49.103274+0000","last_undegraded":"2024-09-12T01:56:49.103274+0000","last_fullsized":"2024-09-12T01:56:49.103274+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:40.245592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.095664+0000","last_change":"2024-09-12T01:56:49.090304+0000","last_active":"2024-09-12T01:56:49.095664+0000","last_peered":"2024-09-12T01:56:49.095664+0000","last_clean":"2024-09-12T01:56:49.095664+0000","last_became_active":"2024-09-12T01:56:49.089928+0000","last_became_peered":"2024-09-12T01:56:49.089928+0000","last_unstale":"2024-09-12T01:56:49.095664+0000","last_undegraded":"2024-09-12T01:56:49.095664+0000","last_fullsized":"2024-09-12T01:56:49.095664+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:23.477178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070725+0000","last_change":"2024-09-12T01:56:48.070725+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070725+0000","last_undegraded":"2024-09-12T01:56:48.070725+0000","last_fullsized":"2024-09-12T01:56:48.070725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099144+0000","last_change":"2024-09-12T01:56:49.093382+0000","last_active":"2024-09-12T01:56:49.099144+0000","last_peered":"2024-09-12T01:56:49.099144+0000","last_clean":"2024-09-12T01:56:49.099144+0000","last_became_active":"2024-09-12T01:56:49.093060+0000","last_became_peered":"2024-09-12T01:56:49.093060+0000","last_unstale":"2024-09-12T01:56:49.099144+0000","last_undegraded":"2024-09-12T01:56:49.099144+0000","last_fullsized":"2024-09-12T01:56:49.099144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:41.113310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107723+0000","last_change":"2024-09-12T01:56:49.102971+0000","last_active":"2024-09-12T01:56:49.107723+0000","last_peered":"2024-09-12T01:56:49.107723+0000","last_clean":"2024-09-12T01:56:49.107723+0000","last_became_active":"2024-09-12T01:56:49.102708+0000","last_became_peered":"2024-09-12T01:56:49.102708+0000","last_unstale":"2024-09-12T01:56:49.107723+0000","last_undegraded":"2024-09-12T01:56:49.107723+0000","last_fullsized":"2024-09-12T01:56:49.107723+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:26.195981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103132+0000","last_change":"2024-09-12T01:56:49.094962+0000","last_active":"2024-09-12T01:56:49.103132+0000","last_peered":"2024-09-12T01:56:49.103132+0000","last_clean":"2024-09-12T01:56:49.103132+0000","last_became_active":"2024-09-12T01:56:49.094689+0000","last_became_peered":"2024-09-12T01:56:49.094689+0000","last_unstale":"2024-09-12T01:56:49.103132+0000","last_undegraded":"2024-09-12T01:56:49.103132+0000","last_fullsized":"2024-09-12T01:56:49.103132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:44.543744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070901+0000","last_change":"2024-09-12T01:56:48.070901+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070901+0000","last_undegraded":"2024-09-12T01:56:48.070901+0000","last_fullsized":"2024-09-12T01:56:48.070901+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104095+0000","last_change":"2024-09-12T01:56:49.094852+0000","last_active":"2024-09-12T01:56:49.104095+0000","last_peered":"2024-09-12T01:56:49.104095+0000","last_clean":"2024-09-12T01:56:49.104095+0000","last_became_active":"2024-09-12T01:56:49.094582+0000","last_became_peered":"2024-09-12T01:56:49.094582+0000","last_unstale":"2024-09-12T01:56:49.104095+0000","last_undegraded":"2024-09-12T01:56:49.104095+0000","last_fullsized":"2024-09-12T01:56:49.104095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:42.421526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.075748+0000","last_change":"2024-09-12T01:56:48.075748+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.075748+0000","last_undegraded":"2024-09-12T01:56:48.075748+0000","last_fullsized":"2024-09-12T01:56:48.075748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103662+0000","last_change":"2024-09-12T01:56:49.095001+0000","last_active":"2024-09-12T01:56:49.103662+0000","last_peered":"2024-09-12T01:56:49.103662+0000","last_clean":"2024-09-12T01:56:49.103662+0000","last_became_active":"2024-09-12T01:56:49.094730+0000","last_became_peered":"2024-09-12T01:56:49.094730+0000","last_unstale":"2024-09-12T01:56:49.103662+0000","last_undegraded":"2024-09-12T01:56:49.103662+0000","last_fullsized":"2024-09-12T01:56:49.103662+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:46.371782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099958+0000","last_change":"2024-09-12T01:56:49.091704+0000","last_active":"2024-09-12T01:56:49.099958+0000","last_peered":"2024-09-12T01:56:49.099958+0000","last_clean":"2024-09-12T01:56:49.099958+0000","last_became_active":"2024-09-12T01:56:49.091369+0000","last_became_peered":"2024-09-12T01:56:49.091369+0000","last_unstale":"2024-09-12T01:56:49.099958+0000","last_undegraded":"2024-09-12T01:56:49.099958+0000","last_fullsized":"2024-09-12T01:56:49.099958+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:40.245592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107570+0000","last_change":"2024-09-12T01:56:49.102931+0000","last_active":"2024-09-12T01:56:49.107570+0000","last_peered":"2024-09-12T01:56:49.107570+0000","last_clean":"2024-09-12T01:56:49.107570+0000","last_became_active":"2024-09-12T01:56:49.102638+0000","last_became_peered":"2024-09-12T01:56:49.102638+0000","last_unstale":"2024-09-12T01:56:49.107570+0000","last_undegraded":"2024-09-12T01:56:49.107570+0000","last_fullsized":"2024-09-12T01:56:49.107570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:18.709627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.092187+0000","last_change":"2024-09-12T01:56:49.088392+0000","last_active":"2024-09-12T01:56:49.092187+0000","last_peered":"2024-09-12T01:56:49.092187+0000","last_clean":"2024-09-12T01:56:49.092187+0000","last_became_active":"2024-09-12T01:56:49.088100+0000","last_became_peered":"2024-09-12T01:56:49.088100+0000","last_unstale":"2024-09-12T01:56:49.092187+0000","last_undegraded":"2024-09-12T01:56:49.092187+0000","last_fullsized":"2024-09-12T01:56:49.092187+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:22.615266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103382+0000","last_change":"2024-09-12T01:56:49.098430+0000","last_active":"2024-09-12T01:56:49.103382+0000","last_peered":"2024-09-12T01:56:49.103382+0000","last_clean":"2024-09-12T01:56:49.103382+0000","last_became_active":"2024-09-12T01:56:49.098144+0000","last_became_peered":"2024-09-12T01:56:49.098144+0000","last_unstale":"2024-09-12T01:56:49.103382+0000","last_undegraded":"2024-09-12T01:56:49.103382+0000","last_fullsized":"2024-09-12T01:56:49.103382+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:38.096087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.074304+0000","last_change":"2024-09-12T01:56:48.074304+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.074304+0000","last_undegraded":"2024-09-12T01:56:48.074304+0000","last_fullsized":"2024-09-12T01:56:48.074304+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103361+0000","last_change":"2024-09-12T01:56:49.097725+0000","last_active":"2024-09-12T01:56:49.103361+0000","last_peered":"2024-09-12T01:56:49.103361+0000","last_clean":"2024-09-12T01:56:49.103361+0000","last_became_active":"2024-09-12T01:56:49.097049+0000","last_became_peered":"2024-09-12T01:56:49.097049+0000","last_unstale":"2024-09-12T01:56:49.103361+0000","last_undegraded":"2024-09-12T01:56:49.103361+0000","last_fullsized":"2024-09-12T01:56:49.103361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:36.644433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.108732+0000","last_change":"2024-09-12T01:56:48.083339+0000","last_active":"2024-09-12T01:56:49.108732+0000","last_peered":"2024-09-12T01:56:49.108732+0000","last_clean":"2024-09-12T01:56:49.108732+0000","last_became_active":"2024-09-12T01:56:48.083086+0000","last_became_peered":"2024-09-12T01:56:48.083086+0000","last_unstale":"2024-09-12T01:56:49.108732+0000","last_undegraded":"2024-09-12T01:56:49.108732+0000","last_fullsized":"2024-09-12T01:56:49.108732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:26.586415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.078670+0000","last_change":"2024-09-12T01:56:48.078670+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.078670+0000","last_undegraded":"2024-09-12T01:56:48.078670+0000","last_fullsized":"2024-09-12T01:56:48.078670+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.086032+0000","last_change":"2024-09-12T01:56:48.082903+0000","last_active":"2024-09-12T01:56:48.086032+0000","last_peered":"2024-09-12T01:56:48.086032+0000","last_clean":"2024-09-12T01:56:48.086032+0000","last_became_active":"2024-09-12T01:56:48.082585+0000","last_became_peered":"2024-09-12T01:56:48.082585+0000","last_unstale":"2024-09-12T01:56:48.086032+0000","last_undegraded":"2024-09-12T01:56:48.086032+0000","last_fullsized":"2024-09-12T01:56:48.086032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:27.805990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.088719+0000","last_change":"2024-09-12T01:56:48.084769+0000","last_active":"2024-09-12T01:56:48.088719+0000","last_peered":"2024-09-12T01:56:48.088719+0000","last_clean":"2024-09-12T01:56:48.088719+0000","last_became_active":"2024-09-12T01:56:48.084356+0000","last_became_peered":"2024-09-12T01:56:48.084356+0000","last_unstale":"2024-09-12T01:56:48.088719+0000","last_undegraded":"2024-09-12T01:56:48.088719+0000","last_fullsized":"2024-09-12T01:56:48.088719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:06.724111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.074518+0000","last_change":"2024-09-12T01:56:48.074518+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.074518+0000","last_undegraded":"2024-09-12T01:56:48.074518+0000","last_fullsized":"2024-09-12T01:56:48.074518+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T01:56:47.063721+0000","last_change":"2024-09-12T01:56:47.063721+0000","last_active":"2024-09-12T01:56:47.056365+0000","last_peered":"2024-09-12T01:56:47.056365+0000","last_clean":"2024-09-12T01:56:47.056365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:47.063721+0000","last_undegraded":"2024-09-12T01:56:47.063721+0000","last_fullsized":"2024-09-12T01:56:47.063721+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071004+0000","last_change":"2024-09-12T01:56:48.071004+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071004+0000","last_undegraded":"2024-09-12T01:56:48.071004+0000","last_fullsized":"2024-09-12T01:56:48.071004+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107598+0000","last_change":"2024-09-12T01:56:48.086406+0000","last_active":"2024-09-12T01:56:49.107598+0000","last_peered":"2024-09-12T01:56:49.107598+0000","last_clean":"2024-09-12T01:56:49.107598+0000","last_became_active":"2024-09-12T01:56:48.086117+0000","last_became_peered":"2024-09-12T01:56:48.086117+0000","last_unstale":"2024-09-12T01:56:49.107598+0000","last_undegraded":"2024-09-12T01:56:49.107598+0000","last_fullsized":"2024-09-12T01:56:49.107598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:45.367043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107899+0000","last_change":"2024-09-12T01:56:49.104426+0000","last_active":"2024-09-12T01:56:49.107899+0000","last_peered":"2024-09-12T01:56:49.107899+0000","last_clean":"2024-09-12T01:56:49.107899+0000","last_became_active":"2024-09-12T01:56:49.103633+0000","last_became_peered":"2024-09-12T01:56:49.103633+0000","last_unstale":"2024-09-12T01:56:49.107899+0000","last_undegraded":"2024-09-12T01:56:49.107899+0000","last_fullsized":"2024-09-12T01:56:49.107899+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:00.426689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.108805+0000","last_change":"2024-09-12T01:56:48.084388+0000","last_active":"2024-09-12T01:56:49.108805+0000","last_peered":"2024-09-12T01:56:49.108805+0000","last_clean":"2024-09-12T01:56:49.108805+0000","last_became_active":"2024-09-12T01:56:48.084111+0000","last_became_peered":"2024-09-12T01:56:48.084111+0000","last_unstale":"2024-09-12T01:56:49.108805+0000","last_undegraded":"2024-09-12T01:56:49.108805+0000","last_fullsized":"2024-09-12T01:56:49.108805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:22.472440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.092038+0000","last_change":"2024-09-12T01:56:48.091222+0000","last_active":"2024-09-12T01:56:48.092038+0000","last_peered":"2024-09-12T01:56:48.092038+0000","last_clean":"2024-09-12T01:56:48.092038+0000","last_became_active":"2024-09-12T01:56:48.090909+0000","last_became_peered":"2024-09-12T01:56:48.090909+0000","last_unstale":"2024-09-12T01:56:48.092038+0000","last_undegraded":"2024-09-12T01:56:48.092038+0000","last_fullsized":"2024-09-12T01:56:48.092038+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:45.171550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.072553+0000","last_change":"2024-09-12T01:56:48.072553+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.072553+0000","last_undegraded":"2024-09-12T01:56:48.072553+0000","last_fullsized":"2024-09-12T01:56:48.072553+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T01:56:47.063531+0000","last_change":"2024-09-12T01:56:47.063531+0000","last_active":"2024-09-12T01:56:47.056365+0000","last_peered":"2024-09-12T01:56:47.056365+0000","last_clean":"2024-09-12T01:56:47.056365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:47.063531+0000","last_undegraded":"2024-09-12T01:56:47.063531+0000","last_fullsized":"2024-09-12T01:56:47.063531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069971+0000","last_change":"2024-09-12T01:56:48.069971+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069971+0000","last_undegraded":"2024-09-12T01:56:48.069971+0000","last_fullsized":"2024-09-12T01:56:48.069971+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.091861+0000","last_change":"2024-09-12T01:56:48.085039+0000","last_active":"2024-09-12T01:56:48.091861+0000","last_peered":"2024-09-12T01:56:48.091861+0000","last_clean":"2024-09-12T01:56:48.091861+0000","last_became_active":"2024-09-12T01:56:48.084764+0000","last_became_peered":"2024-09-12T01:56:48.084764+0000","last_unstale":"2024-09-12T01:56:48.091861+0000","last_undegraded":"2024-09-12T01:56:48.091861+0000","last_fullsized":"2024-09-12T01:56:48.091861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:26.449812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099629+0000","last_change":"2024-09-12T01:56:49.092967+0000","last_active":"2024-09-12T01:56:49.099629+0000","last_peered":"2024-09-12T01:56:49.099629+0000","last_clean":"2024-09-12T01:56:49.099629+0000","last_became_active":"2024-09-12T01:56:49.092693+0000","last_became_peered":"2024-09-12T01:56:49.092693+0000","last_unstale":"2024-09-12T01:56:49.099629+0000","last_undegraded":"2024-09-12T01:56:49.099629+0000","last_fullsized":"2024-09-12T01:56:49.099629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:18.993260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.088574+0000","last_change":"2024-09-12T01:56:48.081300+0000","last_active":"2024-09-12T01:56:49.088574+0000","last_peered":"2024-09-12T01:56:49.088574+0000","last_clean":"2024-09-12T01:56:49.088574+0000","last_became_active":"2024-09-12T01:56:48.080352+0000","last_became_peered":"2024-09-12T01:56:48.080352+0000","last_unstale":"2024-09-12T01:56:49.088574+0000","last_undegraded":"2024-09-12T01:56:49.088574+0000","last_fullsized":"2024-09-12T01:56:49.088574+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:17.988522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071472+0000","last_change":"2024-09-12T01:56:48.071472+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071472+0000","last_undegraded":"2024-09-12T01:56:48.071472+0000","last_fullsized":"2024-09-12T01:56:48.071472+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.110625+0000","last_change":"2024-09-12T01:56:48.084554+0000","last_active":"2024-09-12T01:56:49.110625+0000","last_peered":"2024-09-12T01:56:49.110625+0000","last_clean":"2024-09-12T01:56:49.110625+0000","last_became_active":"2024-09-12T01:56:48.084150+0000","last_became_peered":"2024-09-12T01:56:48.084150+0000","last_unstale":"2024-09-12T01:56:49.110625+0000","last_undegraded":"2024-09-12T01:56:49.110625+0000","last_fullsized":"2024-09-12T01:56:49.110625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:43.539005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.088871+0000","last_change":"2024-09-12T01:56:48.083135+0000","last_active":"2024-09-12T01:56:48.088871+0000","last_peered":"2024-09-12T01:56:48.088871+0000","last_clean":"2024-09-12T01:56:48.088871+0000","last_became_active":"2024-09-12T01:56:48.082844+0000","last_became_peered":"2024-09-12T01:56:48.082844+0000","last_unstale":"2024-09-12T01:56:48.088871+0000","last_undegraded":"2024-09-12T01:56:48.088871+0000","last_fullsized":"2024-09-12T01:56:48.088871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:42.037302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.070131+0000","last_change":"2024-09-12T01:56:48.070131+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.070131+0000","last_undegraded":"2024-09-12T01:56:48.070131+0000","last_fullsized":"2024-09-12T01:56:48.070131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.079034+0000","last_change":"2024-09-12T01:56:48.076816+0000","last_active":"2024-09-12T01:56:48.079034+0000","last_peered":"2024-09-12T01:56:48.079034+0000","last_clean":"2024-09-12T01:56:48.079034+0000","last_became_active":"2024-09-12T01:56:48.076400+0000","last_became_peered":"2024-09-12T01:56:48.076400+0000","last_unstale":"2024-09-12T01:56:48.079034+0000","last_undegraded":"2024-09-12T01:56:48.079034+0000","last_fullsized":"2024-09-12T01:56:48.079034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:42.760298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069627+0000","last_change":"2024-09-12T01:56:48.069627+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069627+0000","last_undegraded":"2024-09-12T01:56:48.069627+0000","last_fullsized":"2024-09-12T01:56:48.069627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.092021+0000","last_change":"2024-09-12T01:56:48.091263+0000","last_active":"2024-09-12T01:56:48.092021+0000","last_peered":"2024-09-12T01:56:48.092021+0000","last_clean":"2024-09-12T01:56:48.092021+0000","last_became_active":"2024-09-12T01:56:48.090933+0000","last_became_peered":"2024-09-12T01:56:48.090933+0000","last_unstale":"2024-09-12T01:56:48.092021+0000","last_undegraded":"2024-09-12T01:56:48.092021+0000","last_fullsized":"2024-09-12T01:56:48.092021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:00.824926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103325+0000","last_change":"2024-09-12T01:56:49.095408+0000","last_active":"2024-09-12T01:56:49.103325+0000","last_peered":"2024-09-12T01:56:49.103325+0000","last_clean":"2024-09-12T01:56:49.103325+0000","last_became_active":"2024-09-12T01:56:49.095100+0000","last_became_peered":"2024-09-12T01:56:49.095100+0000","last_unstale":"2024-09-12T01:56:49.103325+0000","last_undegraded":"2024-09-12T01:56:49.103325+0000","last_fullsized":"2024-09-12T01:56:49.103325+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:30.275429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.080227+0000","last_change":"2024-09-12T01:56:48.085093+0000","last_active":"2024-09-12T01:56:49.080227+0000","last_peered":"2024-09-12T01:56:49.080227+0000","last_clean":"2024-09-12T01:56:49.080227+0000","last_became_active":"2024-09-12T01:56:48.084794+0000","last_became_peered":"2024-09-12T01:56:48.084794+0000","last_unstale":"2024-09-12T01:56:49.080227+0000","last_undegraded":"2024-09-12T01:56:49.080227+0000","last_fullsized":"2024-09-12T01:56:49.080227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:53.692206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.072096+0000","last_change":"2024-09-12T01:56:48.072096+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.072096+0000","last_undegraded":"2024-09-12T01:56:48.072096+0000","last_fullsized":"2024-09-12T01:56:48.072096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.109217+0000","last_change":"2024-09-12T01:56:48.081824+0000","last_active":"2024-09-12T01:56:49.109217+0000","last_peered":"2024-09-12T01:56:49.109217+0000","last_clean":"2024-09-12T01:56:49.109217+0000","last_became_active":"2024-09-12T01:56:48.081536+0000","last_became_peered":"2024-09-12T01:56:48.081536+0000","last_unstale":"2024-09-12T01:56:49.109217+0000","last_undegraded":"2024-09-12T01:56:49.109217+0000","last_fullsized":"2024-09-12T01:56:49.109217+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:40.108571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.073530+0000","last_change":"2024-09-12T01:56:48.073530+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.073530+0000","last_undegraded":"2024-09-12T01:56:48.073530+0000","last_fullsized":"2024-09-12T01:56:48.073530+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.108566+0000","last_change":"2024-09-12T01:56:48.086519+0000","last_active":"2024-09-12T01:56:49.108566+0000","last_peered":"2024-09-12T01:56:49.108566+0000","last_clean":"2024-09-12T01:56:49.108566+0000","last_became_active":"2024-09-12T01:56:48.086139+0000","last_became_peered":"2024-09-12T01:56:48.086139+0000","last_unstale":"2024-09-12T01:56:49.108566+0000","last_undegraded":"2024-09-12T01:56:49.108566+0000","last_fullsized":"2024-09-12T01:56:49.108566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:17.704888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.107860+0000","last_change":"2024-09-12T01:56:49.104837+0000","last_active":"2024-09-12T01:56:49.107860+0000","last_peered":"2024-09-12T01:56:49.107860+0000","last_clean":"2024-09-12T01:56:49.107860+0000","last_became_active":"2024-09-12T01:56:49.103859+0000","last_became_peered":"2024-09-12T01:56:49.103859+0000","last_unstale":"2024-09-12T01:56:49.107860+0000","last_undegraded":"2024-09-12T01:56:49.107860+0000","last_fullsized":"2024-09-12T01:56:49.107860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:25.718464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T01:56:47.063834+0000","last_change":"2024-09-12T01:56:47.063834+0000","last_active":"2024-09-12T01:56:47.056365+0000","last_peered":"2024-09-12T01:56:47.056365+0000","last_clean":"2024-09-12T01:56:47.056365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:47.063834+0000","last_undegraded":"2024-09-12T01:56:47.063834+0000","last_fullsized":"2024-09-12T01:56:47.063834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.081219+0000","last_change":"2024-09-12T01:56:48.073784+0000","last_active":"2024-09-12T01:56:48.081219+0000","last_peered":"2024-09-12T01:56:48.081219+0000","last_clean":"2024-09-12T01:56:48.081219+0000","last_became_active":"2024-09-12T01:56:48.073319+0000","last_became_peered":"2024-09-12T01:56:48.073319+0000","last_unstale":"2024-09-12T01:56:48.081219+0000","last_undegraded":"2024-09-12T01:56:48.081219+0000","last_fullsized":"2024-09-12T01:56:48.081219+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:44.906880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069015+0000","last_change":"2024-09-12T01:56:48.069015+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069015+0000","last_undegraded":"2024-09-12T01:56:48.069015+0000","last_fullsized":"2024-09-12T01:56:48.069015+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.088726+0000","last_change":"2024-09-12T01:56:48.084752+0000","last_active":"2024-09-12T01:56:48.088726+0000","last_peered":"2024-09-12T01:56:48.088726+0000","last_clean":"2024-09-12T01:56:48.088726+0000","last_became_active":"2024-09-12T01:56:48.084474+0000","last_became_peered":"2024-09-12T01:56:48.084474+0000","last_unstale":"2024-09-12T01:56:48.088726+0000","last_undegraded":"2024-09-12T01:56:48.088726+0000","last_fullsized":"2024-09-12T01:56:48.088726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:00.113502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.103336+0000","last_change":"2024-09-12T01:56:49.098187+0000","last_active":"2024-09-12T01:56:49.103336+0000","last_peered":"2024-09-12T01:56:49.103336+0000","last_clean":"2024-09-12T01:56:49.103336+0000","last_became_active":"2024-09-12T01:56:49.097323+0000","last_became_peered":"2024-09-12T01:56:49.097323+0000","last_unstale":"2024-09-12T01:56:49.103336+0000","last_undegraded":"2024-09-12T01:56:49.103336+0000","last_fullsized":"2024-09-12T01:56:49.103336+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:08.496640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.083486+0000","last_change":"2024-09-12T01:56:48.080455+0000","last_active":"2024-09-12T01:56:48.083486+0000","last_peered":"2024-09-12T01:56:48.083486+0000","last_clean":"2024-09-12T01:56:48.083486+0000","last_became_active":"2024-09-12T01:56:48.080116+0000","last_became_peered":"2024-09-12T01:56:48.080116+0000","last_unstale":"2024-09-12T01:56:48.083486+0000","last_undegraded":"2024-09-12T01:56:48.083486+0000","last_fullsized":"2024-09-12T01:56:48.083486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:49.059597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069144+0000","last_change":"2024-09-12T01:56:48.069144+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069144+0000","last_undegraded":"2024-09-12T01:56:48.069144+0000","last_fullsized":"2024-09-12T01:56:48.069144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.083974+0000","last_change":"2024-09-12T01:56:48.081119+0000","last_active":"2024-09-12T01:56:48.083974+0000","last_peered":"2024-09-12T01:56:48.083974+0000","last_clean":"2024-09-12T01:56:48.083974+0000","last_became_active":"2024-09-12T01:56:48.080833+0000","last_became_peered":"2024-09-12T01:56:48.080833+0000","last_unstale":"2024-09-12T01:56:48.083974+0000","last_undegraded":"2024-09-12T01:56:48.083974+0000","last_fullsized":"2024-09-12T01:56:48.083974+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:36.404814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104601+0000","last_change":"2024-09-12T01:56:49.095989+0000","last_active":"2024-09-12T01:56:49.104601+0000","last_peered":"2024-09-12T01:56:49.104601+0000","last_clean":"2024-09-12T01:56:49.104601+0000","last_became_active":"2024-09-12T01:56:49.095624+0000","last_became_peered":"2024-09-12T01:56:49.095624+0000","last_unstale":"2024-09-12T01:56:49.104601+0000","last_undegraded":"2024-09-12T01:56:49.104601+0000","last_fullsized":"2024-09-12T01:56:49.104601+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:36.644433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.085299+0000","last_change":"2024-09-12T01:56:48.079323+0000","last_active":"2024-09-12T01:56:49.085299+0000","last_peered":"2024-09-12T01:56:49.085299+0000","last_clean":"2024-09-12T01:56:49.085299+0000","last_became_active":"2024-09-12T01:56:48.079064+0000","last_became_peered":"2024-09-12T01:56:48.079064+0000","last_unstale":"2024-09-12T01:56:49.085299+0000","last_undegraded":"2024-09-12T01:56:49.085299+0000","last_fullsized":"2024-09-12T01:56:49.085299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:41.416788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.071670+0000","last_change":"2024-09-12T01:56:48.071670+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.071670+0000","last_undegraded":"2024-09-12T01:56:48.071670+0000","last_fullsized":"2024-09-12T01:56:48.071670+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.084049+0000","last_change":"2024-09-12T01:56:48.080729+0000","last_active":"2024-09-12T01:56:48.084049+0000","last_peered":"2024-09-12T01:56:48.084049+0000","last_clean":"2024-09-12T01:56:48.084049+0000","last_became_active":"2024-09-12T01:56:48.079864+0000","last_became_peered":"2024-09-12T01:56:48.079864+0000","last_unstale":"2024-09-12T01:56:48.084049+0000","last_undegraded":"2024-09-12T01:56:48.084049+0000","last_fullsized":"2024-09-12T01:56:48.084049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:41.061958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.075231+0000","last_change":"2024-09-12T01:56:48.075231+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.075231+0000","last_undegraded":"2024-09-12T01:56:48.075231+0000","last_fullsized":"2024-09-12T01:56:48.075231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.110710+0000","last_change":"2024-09-12T01:56:48.086993+0000","last_active":"2024-09-12T01:56:49.110710+0000","last_peered":"2024-09-12T01:56:49.110710+0000","last_clean":"2024-09-12T01:56:49.110710+0000","last_became_active":"2024-09-12T01:56:48.086487+0000","last_became_peered":"2024-09-12T01:56:48.086487+0000","last_unstale":"2024-09-12T01:56:49.110710+0000","last_undegraded":"2024-09-12T01:56:49.110710+0000","last_fullsized":"2024-09-12T01:56:49.110710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:10.954294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.099651+0000","last_change":"2024-09-12T01:56:49.093510+0000","last_active":"2024-09-12T01:56:49.099651+0000","last_peered":"2024-09-12T01:56:49.099651+0000","last_clean":"2024-09-12T01:56:49.099651+0000","last_became_active":"2024-09-12T01:56:49.092875+0000","last_became_peered":"2024-09-12T01:56:49.092875+0000","last_unstale":"2024-09-12T01:56:49.099651+0000","last_undegraded":"2024-09-12T01:56:49.099651+0000","last_fullsized":"2024-09-12T01:56:49.099651+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:11.959033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.091762+0000","last_change":"2024-09-12T01:56:48.086941+0000","last_active":"2024-09-12T01:56:48.091762+0000","last_peered":"2024-09-12T01:56:48.091762+0000","last_clean":"2024-09-12T01:56:48.091762+0000","last_became_active":"2024-09-12T01:56:48.086626+0000","last_became_peered":"2024-09-12T01:56:48.086626+0000","last_unstale":"2024-09-12T01:56:48.091762+0000","last_undegraded":"2024-09-12T01:56:48.091762+0000","last_fullsized":"2024-09-12T01:56:48.091762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:02.752474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.072071+0000","last_change":"2024-09-12T01:56:48.072071+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.072071+0000","last_undegraded":"2024-09-12T01:56:48.072071+0000","last_fullsized":"2024-09-12T01:56:48.072071+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.089060+0000","last_change":"2024-09-12T01:56:48.084372+0000","last_active":"2024-09-12T01:56:48.089060+0000","last_peered":"2024-09-12T01:56:48.089060+0000","last_clean":"2024-09-12T01:56:48.089060+0000","last_became_active":"2024-09-12T01:56:48.084012+0000","last_became_peered":"2024-09-12T01:56:48.084012+0000","last_unstale":"2024-09-12T01:56:48.089060+0000","last_undegraded":"2024-09-12T01:56:48.089060+0000","last_fullsized":"2024-09-12T01:56:48.089060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:26.586415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.069653+0000","last_change":"2024-09-12T01:56:48.069653+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.069653+0000","last_undegraded":"2024-09-12T01:56:48.069653+0000","last_fullsized":"2024-09-12T01:56:48.069653+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.075260+0000","last_change":"2024-09-12T01:56:48.074045+0000","last_active":"2024-09-12T01:56:48.075260+0000","last_peered":"2024-09-12T01:56:48.075260+0000","last_clean":"2024-09-12T01:56:48.075260+0000","last_became_active":"2024-09-12T01:56:48.073680+0000","last_became_peered":"2024-09-12T01:56:48.073680+0000","last_unstale":"2024-09-12T01:56:48.075260+0000","last_undegraded":"2024-09-12T01:56:48.075260+0000","last_fullsized":"2024-09-12T01:56:48.075260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:06.321418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-12T01:56:48.074317+0000","last_change":"2024-09-12T01:56:48.074317+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.074317+0000","last_undegraded":"2024-09-12T01:56:48.074317+0000","last_fullsized":"2024-09-12T01:56:48.074317+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.080051+0000","last_change":"2024-09-12T01:56:48.076087+0000","last_active":"2024-09-12T01:56:49.080051+0000","last_peered":"2024-09-12T01:56:49.080051+0000","last_clean":"2024-09-12T01:56:49.080051+0000","last_became_active":"2024-09-12T01:56:48.075803+0000","last_became_peered":"2024-09-12T01:56:48.075803+0000","last_unstale":"2024-09-12T01:56:49.080051+0000","last_undegraded":"2024-09-12T01:56:49.080051+0000","last_fullsized":"2024-09-12T01:56:49.080051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:27.805990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:56:48.061104+0000","last_change":"2024-09-12T01:56:48.061104+0000","last_active":"2024-09-12T01:56:48.061104+0000","last_peered":"2024-09-12T01:56:48.061104+0000","last_clean":"2024-09-12T01:56:48.061104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:48.061104+0000","last_undegraded":"2024-09-12T01:56:48.061104+0000","last_fullsized":"2024-09-12T01:56:48.061104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-12T01:56:47.064248+0000","last_change":"2024-09-12T01:56:47.064248+0000","last_active":"2024-09-12T01:56:47.056365+0000","last_peered":"2024-09-12T01:56:47.056365+0000","last_clean":"2024-09-12T01:56:47.056365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:56:47.064248+0000","last_undegraded":"2024-09-12T01:56:47.064248+0000","last_fullsized":"2024-09-12T01:56:47.064248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.095869+0000","last_change":"2024-09-12T01:56:49.091608+0000","last_active":"2024-09-12T01:56:49.095869+0000","last_peered":"2024-09-12T01:56:49.095869+0000","last_clean":"2024-09-12T01:56:49.095869+0000","last_became_active":"2024-09-12T01:56:49.090710+0000","last_became_peered":"2024-09-12T01:56:49.090710+0000","last_unstale":"2024-09-12T01:56:49.095869+0000","last_undegraded":"2024-09-12T01:56:49.095869+0000","last_fullsized":"2024-09-12T01:56:49.095869+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:18.709627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T01:56:48.091829+0000","last_change":"2024-09-12T01:56:48.086306+0000","last_active":"2024-09-12T01:56:48.091829+0000","last_peered":"2024-09-12T01:56:48.091829+0000","last_clean":"2024-09-12T01:56:48.091829+0000","last_became_active":"2024-09-12T01:56:48.085519+0000","last_became_peered":"2024-09-12T01:56:48.085519+0000","last_unstale":"2024-09-12T01:56:48.091829+0000","last_undegraded":"2024-09-12T01:56:48.091829+0000","last_fullsized":"2024-09-12T01:56:48.091829+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:09.193086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.104372+0000","last_change":"2024-09-12T01:56:49.096214+0000","last_active":"2024-09-12T01:56:49.104372+0000","last_peered":"2024-09-12T01:56:49.104372+0000","last_clean":"2024-09-12T01:56:49.104372+0000","last_became_active":"2024-09-12T01:56:49.095889+0000","last_became_peered":"2024-09-12T01:56:49.095889+0000","last_unstale":"2024-09-12T01:56:49.104372+0000","last_undegraded":"2024-09-12T01:56:49.104372+0000","last_fullsized":"2024-09-12T01:56:49.104372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:38.096087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.086070+0000","last_change":"2024-09-12T01:56:48.082804+0000","last_active":"2024-09-12T01:56:49.086070+0000","last_peered":"2024-09-12T01:56:49.086070+0000","last_clean":"2024-09-12T01:56:49.086070+0000","last_became_active":"2024-09-12T01:56:48.082323+0000","last_became_peered":"2024-09-12T01:56:48.082323+0000","last_unstale":"2024-09-12T01:56:49.086070+0000","last_undegraded":"2024-09-12T01:56:49.086070+0000","last_fullsized":"2024-09-12T01:56:49.086070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:45.367043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":202,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T01:56:49.084948+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:56:49.084948+0000","last_peered":"2024-09-12T01:56:49.084948+0000","last_clean":"2024-09-12T01:56:49.084948+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:56:49.084948+0000","last_undegraded":"2024-09-12T01:56:49.084948+0000","last_fullsized":"2024-09-12T01:56:49.084948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":773849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":183481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":183481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1011712,"data_stored":767182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":405504,"data_stored":170605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:56:53.799 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:56:53.802 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:56:53.915 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T01:56:53.916+0000 7f9fae4e3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:56:56.499 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:56:56.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.615+0000 7fca75f98640 1 Processor -- start 2024-09-12T01:56:56.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.615+0000 7fca75f98640 1 -- start start 2024-09-12T01:56:56.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.616+0000 7fca75f98640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fca7015e5f0 0x7fca700d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.616+0000 7fca75f98640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca700d30f0 0x7fca700b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.616+0000 7fca75f98640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca700d3690 con 0x7fca700b64c0 2024-09-12T01:56:56.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.616+0000 7fca75f98640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fca7006d530 con 0x7fca7015e5f0 2024-09-12T01:56:56.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.616+0000 7fca75f98640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fca700d3970 con 0x7fca700d30f0 2024-09-12T01:56:56.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.616+0000 7fca6ffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fca700b64c0 0x7fca700cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43836/0 (socket says 172.21.15.19:43836) 2024-09-12T01:56:56.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.616+0000 7fca6ffff640 1 -- 172.21.15.19:0/3652117233 learned_addr learned my addr 172.21.15.19:0/3652117233 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:56.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6f7fe640 1 --2- 172.21.15.19:0/3652117233 >> v2:172.21.15.135:3300/0 conn(0x7fca7015e5f0 0x7fca700d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6effd640 1 --2- 172.21.15.19:0/3652117233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca700d30f0 0x7fca700b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6e7fc640 1 -- 172.21.15.19:0/3652117233 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 684984293 0 0) 0x7fca700d3690 con 0x7fca700b64c0 2024-09-12T01:56:56.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6e7fc640 1 -- 172.21.15.19:0/3652117233 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca58003520 con 0x7fca700b64c0 2024-09-12T01:56:56.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6e7fc640 1 -- 172.21.15.19:0/3652117233 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3452835381 0 0) 0x7fca58003520 con 0x7fca700b64c0 2024-09-12T01:56:56.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6e7fc640 1 -- 172.21.15.19:0/3652117233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca700d30f0 msgr2=0x7fca700b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6e7fc640 1 --2- 172.21.15.19:0/3652117233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca700d30f0 0x7fca700b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6e7fc640 1 -- 172.21.15.19:0/3652117233 >> v2:172.21.15.135:3300/0 conn(0x7fca7015e5f0 msgr2=0x7fca700d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6e7fc640 1 --2- 172.21.15.19:0/3652117233 >> v2:172.21.15.135:3300/0 conn(0x7fca7015e5f0 0x7fca700d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6e7fc640 1 -- 172.21.15.19:0/3652117233 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7006cee0 con 0x7fca700b64c0 2024-09-12T01:56:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6e7fc640 1 -- 172.21.15.19:0/3652117233 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fca680019f0 con 0x7fca700b64c0 2024-09-12T01:56:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6f7fe640 1 --2- 172.21.15.19:0/3652117233 >> v2:172.21.15.135:3300/0 conn(0x7fca7015e5f0 0x7fca700d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6e7fc640 1 -- 172.21.15.19:0/3652117233 >> v1:172.21.15.19:6789/0 conn(0x7fca700b64c0 legacy=0x7fca700cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6e7fc640 1 --2- 172.21.15.19:0/3652117233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca700d30f0 0x7fca580039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6e7fc640 1 --2- 172.21.15.19:0/3652117233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca58003f30 0x7fca58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6e7fc640 1 --2- 172.21.15.19:0/3652117233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca58004d40 0x7fca580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6e7fc640 1 -- 172.21.15.19:0/3652117233 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fca7006d530 con 0x7fca58003f30 2024-09-12T01:56:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6e7fc640 1 -- 172.21.15.19:0/3652117233 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca700d3970 con 0x7fca58004d40 2024-09-12T01:56:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6e7fc640 1 -- 172.21.15.19:0/3652117233 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fca5800b9c0 con 0x7fca700d30f0 2024-09-12T01:56:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6effd640 1 --2- 172.21.15.19:0/3652117233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca58003f30 0x7fca58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6f7fe640 1 --2- 172.21.15.19:0/3652117233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca700d30f0 0x7fca580039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.617+0000 7fca6ffff640 1 --2- 172.21.15.19:0/3652117233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca58004d40 0x7fca580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.618+0000 7fca6effd640 1 -- 172.21.15.19:0/3652117233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca700d30f0 msgr2=0x7fca580039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.618+0000 7fca6effd640 1 --2- 172.21.15.19:0/3652117233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca700d30f0 0x7fca580039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.618+0000 7fca6effd640 1 -- 172.21.15.19:0/3652117233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca58004d40 msgr2=0x7fca580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.618+0000 7fca6effd640 1 --2- 172.21.15.19:0/3652117233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca58004d40 0x7fca580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.618+0000 7fca6effd640 1 -- 172.21.15.19:0/3652117233 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca58003520 con 0x7fca58003f30 2024-09-12T01:56:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.618+0000 7fca6f7fe640 1 --2- 172.21.15.19:0/3652117233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca700d30f0 0x7fca580039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.618+0000 7fca6effd640 1 --2- 172.21.15.19:0/3652117233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca58003f30 0x7fca58004800 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fca64009a90 tx=0x7fca58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de4ebace8c65962 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.619+0000 7fca6e7fc640 1 -- 172.21.15.19:0/3652117233 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64036070 con 0x7fca58003f30 2024-09-12T01:56:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.619+0000 7fca6e7fc640 1 -- 172.21.15.19:0/3652117233 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca64031400 con 0x7fca58003f30 2024-09-12T01:56:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.619+0000 7fca6e7fc640 1 -- 172.21.15.19:0/3652117233 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64009690 con 0x7fca58003f30 2024-09-12T01:56:56.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.619+0000 7fca75f98640 1 -- 172.21.15.19:0/3652117233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca58003f30 msgr2=0x7fca58004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.619+0000 7fca75f98640 1 --2- 172.21.15.19:0/3652117233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca58003f30 0x7fca58004800 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fca64009a90 tx=0x7fca58005830 comp rx=0 tx=0).stop 2024-09-12T01:56:56.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.619+0000 7fca6ffff640 1 -- 172.21.15.19:0/3652117233 reap_dead start 2024-09-12T01:56:56.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.619+0000 7fca75f98640 1 -- 172.21.15.19:0/3652117233 shutdown_connections 2024-09-12T01:56:56.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.619+0000 7fca75f98640 1 -- 172.21.15.19:0/3652117233 >> 172.21.15.19:0/3652117233 conn(0x7fca7008bfc0 msgr2=0x7fca700d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:56.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.619+0000 7fca75f98640 1 -- 172.21.15.19:0/3652117233 shutdown_connections 2024-09-12T01:56:56.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.619+0000 7fca75f98640 1 -- 172.21.15.19:0/3652117233 wait complete. 2024-09-12T01:56:56.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.620+0000 7fca75f98640 1 Processor -- start 2024-09-12T01:56:56.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.621+0000 7fca75f98640 1 -- start start 2024-09-12T01:56:56.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.621+0000 7fca75f98640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca58003f30 0x7fca701484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.621+0000 7fca75f98640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca7015ac00 0x7fca701f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.621+0000 7fca75f98640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca7015b080 0x7fca701f4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.621+0000 7fca75f98640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fca700d5310 con 0x7fca7015b080 2024-09-12T01:56:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.621+0000 7fca75f98640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca7015e9d0 con 0x7fca7015ac00 2024-09-12T01:56:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.621+0000 7fca75f98640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fca7006e9d0 con 0x7fca58003f30 2024-09-12T01:56:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.621+0000 7fca6ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca7015b080 0x7fca701f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.622+0000 7fca6ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca7015b080 0x7fca701f4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53116/0 (socket says 172.21.15.19:53116) 2024-09-12T01:56:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.622+0000 7fca6ffff640 1 -- 172.21.15.19:0/2198567117 learned_addr learned my addr 172.21.15.19:0/2198567117 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.622+0000 7fca6f7fe640 1 --2- 172.21.15.19:0/2198567117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca58003f30 0x7fca701484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.622+0000 7fca6effd640 1 --2- 172.21.15.19:0/2198567117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca7015ac00 0x7fca701f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.622+0000 7fca6ffff640 1 -- 172.21.15.19:0/2198567117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca58003f30 msgr2=0x7fca701484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.622+0000 7fca6ffff640 1 --2- 172.21.15.19:0/2198567117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca58003f30 0x7fca701484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.622+0000 7fca6ffff640 1 -- 172.21.15.19:0/2198567117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca7015ac00 msgr2=0x7fca701f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.622+0000 7fca6ffff640 1 --2- 172.21.15.19:0/2198567117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca7015ac00 0x7fca701f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.622+0000 7fca6ffff640 1 -- 172.21.15.19:0/2198567117 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca700b7fd0 con 0x7fca7015b080 2024-09-12T01:56:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.622+0000 7fca6effd640 1 --2- 172.21.15.19:0/2198567117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca7015ac00 0x7fca701f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:56.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.622+0000 7fca6ffff640 1 --2- 172.21.15.19:0/2198567117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca7015b080 0x7fca701f4b20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fca7008cf50 tx=0x7fca68007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:56.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.622+0000 7fca57fff640 1 -- 172.21.15.19:0/2198567117 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca68017020 con 0x7fca7015b080 2024-09-12T01:56:56.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.622+0000 7fca57fff640 1 -- 172.21.15.19:0/2198567117 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca6800aca0 con 0x7fca7015b080 2024-09-12T01:56:56.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.622+0000 7fca75f98640 1 -- 172.21.15.19:0/2198567117 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca700b82b0 con 0x7fca7015b080 2024-09-12T01:56:56.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.622+0000 7fca57fff640 1 -- 172.21.15.19:0/2198567117 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca60009860 con 0x7fca7015b080 2024-09-12T01:56:56.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.622+0000 7fca75f98640 1 -- 172.21.15.19:0/2198567117 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca70148a10 con 0x7fca7015b080 2024-09-12T01:56:56.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.623+0000 7fca75f98640 1 -- 172.21.15.19:0/2198567117 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca700d3690 con 0x7fca7015b080 2024-09-12T01:56:56.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.624+0000 7fca57fff640 1 -- 172.21.15.19:0/2198567117 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca6801a020 con 0x7fca7015b080 2024-09-12T01:56:56.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.624+0000 7fca57fff640 1 --2- 172.21.15.19:0/2198567117 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca5c06be30 0x7fca5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.624+0000 7fca57fff640 1 -- 172.21.15.19:0/2198567117 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fca6808b690 con 0x7fca7015b080 2024-09-12T01:56:56.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.624+0000 7fca6f7fe640 1 --2- 172.21.15.19:0/2198567117 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca5c06be30 0x7fca5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.625+0000 7fca6f7fe640 1 --2- 172.21.15.19:0/2198567117 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca5c06be30 0x7fca5c06e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fca700b9cd0 tx=0x7fca60009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:56.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.628+0000 7fca57fff640 1 -- 172.21.15.19:0/2198567117 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca68021020 con 0x7fca7015b080 2024-09-12T01:56:56.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.799+0000 7fca75f98640 1 -- 172.21.15.19:0/2198567117 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca7015b500 con 0x7fca5c06be30 2024-09-12T01:56:56.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.805+0000 7fca57fff640 1 -- 172.21.15.19:0/2198567117 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251935 (secure 0 0 0) 0x7fca7015b500 con 0x7fca5c06be30 2024-09-12T01:56:56.809 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:56.810 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:56:56.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.808+0000 7fca75f98640 1 -- 172.21.15.19:0/2198567117 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca5c06be30 msgr2=0x7fca5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.808+0000 7fca75f98640 1 --2- 172.21.15.19:0/2198567117 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca5c06be30 0x7fca5c06e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fca700b9cd0 tx=0x7fca60009190 comp rx=0 tx=0).stop 2024-09-12T01:56:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.808+0000 7fca75f98640 1 -- 172.21.15.19:0/2198567117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca7015b080 msgr2=0x7fca701f4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.808+0000 7fca75f98640 1 --2- 172.21.15.19:0/2198567117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca7015b080 0x7fca701f4b20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fca7008cf50 tx=0x7fca68007b20 comp rx=0 tx=0).stop 2024-09-12T01:56:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.808+0000 7fca75f98640 1 -- 172.21.15.19:0/2198567117 shutdown_connections 2024-09-12T01:56:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.808+0000 7fca75f98640 1 --2- 172.21.15.19:0/2198567117 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca5c06be30 0x7fca5c06e2f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.808+0000 7fca75f98640 1 --2- 172.21.15.19:0/2198567117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca7015b080 0x7fca701f4b20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.808+0000 7fca75f98640 1 --2- 172.21.15.19:0/2198567117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca7015ac00 0x7fca701f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.808+0000 7fca75f98640 1 --2- 172.21.15.19:0/2198567117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca58003f30 0x7fca701484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.808+0000 7fca75f98640 1 -- 172.21.15.19:0/2198567117 >> 172.21.15.19:0/2198567117 conn(0x7fca7008bfc0 msgr2=0x7fca700b5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.808+0000 7fca75f98640 1 -- 172.21.15.19:0/2198567117 shutdown_connections 2024-09-12T01:56:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.808+0000 7fca75f98640 1 -- 172.21.15.19:0/2198567117 wait complete. 2024-09-12T01:56:56.819 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-09-12T01:56:56.098839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221036,"kb_used_data":4776,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753684,"statfs":{"total":773094113280,"available":772867772416,"internally_reserved":0,"allocated":4890624,"data_stored":2764276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001606"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.090689+0000","last_change":"2024-09-12T01:56:49.095388+0000","last_active":"2024-09-12T01:56:50.090689+0000","last_peered":"2024-09-12T01:56:50.090689+0000","last_clean":"2024-09-12T01:56:50.090689+0000","last_became_active":"2024-09-12T01:56:49.095068+0000","last_became_peered":"2024-09-12T01:56:49.095068+0000","last_unstale":"2024-09-12T01:56:50.090689+0000","last_undegraded":"2024-09-12T01:56:50.090689+0000","last_fullsized":"2024-09-12T01:56:50.090689+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:15.481774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.090558+0000","last_change":"2024-09-12T01:56:49.094305+0000","last_active":"2024-09-12T01:56:50.090558+0000","last_peered":"2024-09-12T01:56:50.090558+0000","last_clean":"2024-09-12T01:56:50.090558+0000","last_became_active":"2024-09-12T01:56:49.094017+0000","last_became_peered":"2024-09-12T01:56:49.094017+0000","last_unstale":"2024-09-12T01:56:50.090558+0000","last_undegraded":"2024-09-12T01:56:50.090558+0000","last_fullsized":"2024-09-12T01:56:50.090558+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:53.723195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920069+0000","last_change":"2024-09-12T01:56:49.101486+0000","last_active":"2024-09-12T01:56:50.920069+0000","last_peered":"2024-09-12T01:56:50.920069+0000","last_clean":"2024-09-12T01:56:50.920069+0000","last_became_active":"2024-09-12T01:56:49.101183+0000","last_became_peered":"2024-09-12T01:56:49.101183+0000","last_unstale":"2024-09-12T01:56:50.920069+0000","last_undegraded":"2024-09-12T01:56:50.920069+0000","last_fullsized":"2024-09-12T01:56:50.920069+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:08.496640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.098885+0000","last_change":"2024-09-12T01:56:49.102675+0000","last_active":"2024-09-12T01:56:50.098885+0000","last_peered":"2024-09-12T01:56:50.098885+0000","last_clean":"2024-09-12T01:56:50.098885+0000","last_became_active":"2024-09-12T01:56:49.102415+0000","last_became_peered":"2024-09-12T01:56:49.102415+0000","last_unstale":"2024-09-12T01:56:50.098885+0000","last_undegraded":"2024-09-12T01:56:50.098885+0000","last_fullsized":"2024-09-12T01:56:50.098885+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:41.113310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.098611+0000","last_change":"2024-09-12T01:56:49.097577+0000","last_active":"2024-09-12T01:56:50.098611+0000","last_peered":"2024-09-12T01:56:50.098611+0000","last_clean":"2024-09-12T01:56:50.098611+0000","last_became_active":"2024-09-12T01:56:49.097329+0000","last_became_peered":"2024-09-12T01:56:49.097329+0000","last_unstale":"2024-09-12T01:56:50.098611+0000","last_undegraded":"2024-09-12T01:56:50.098611+0000","last_fullsized":"2024-09-12T01:56:50.098611+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:54.696945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920072+0000","last_change":"2024-09-12T01:56:49.095276+0000","last_active":"2024-09-12T01:56:50.920072+0000","last_peered":"2024-09-12T01:56:50.920072+0000","last_clean":"2024-09-12T01:56:50.920072+0000","last_became_active":"2024-09-12T01:56:49.094945+0000","last_became_peered":"2024-09-12T01:56:49.094945+0000","last_unstale":"2024-09-12T01:56:50.920072+0000","last_undegraded":"2024-09-12T01:56:50.920072+0000","last_fullsized":"2024-09-12T01:56:50.920072+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:10.197824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.100754+0000","last_change":"2024-09-12T01:56:49.095662+0000","last_active":"2024-09-12T01:56:50.100754+0000","last_peered":"2024-09-12T01:56:50.100754+0000","last_clean":"2024-09-12T01:56:50.100754+0000","last_became_active":"2024-09-12T01:56:49.095303+0000","last_became_peered":"2024-09-12T01:56:49.095303+0000","last_unstale":"2024-09-12T01:56:50.100754+0000","last_undegraded":"2024-09-12T01:56:50.100754+0000","last_fullsized":"2024-09-12T01:56:50.100754+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:17.316465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.090253+0000","last_change":"2024-09-12T01:56:49.093051+0000","last_active":"2024-09-12T01:56:50.090253+0000","last_peered":"2024-09-12T01:56:50.090253+0000","last_clean":"2024-09-12T01:56:50.090253+0000","last_became_active":"2024-09-12T01:56:49.092272+0000","last_became_peered":"2024-09-12T01:56:49.092272+0000","last_unstale":"2024-09-12T01:56:50.090253+0000","last_undegraded":"2024-09-12T01:56:50.090253+0000","last_fullsized":"2024-09-12T01:56:50.090253+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:15.402830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920602+0000","last_change":"2024-09-12T01:56:49.097875+0000","last_active":"2024-09-12T01:56:50.920602+0000","last_peered":"2024-09-12T01:56:50.920602+0000","last_clean":"2024-09-12T01:56:50.920602+0000","last_became_active":"2024-09-12T01:56:49.097390+0000","last_became_peered":"2024-09-12T01:56:49.097390+0000","last_unstale":"2024-09-12T01:56:50.920602+0000","last_undegraded":"2024-09-12T01:56:50.920602+0000","last_fullsized":"2024-09-12T01:56:50.920602+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:27.444535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.101141+0000","last_change":"2024-09-12T01:56:49.100284+0000","last_active":"2024-09-12T01:56:50.101141+0000","last_peered":"2024-09-12T01:56:50.101141+0000","last_clean":"2024-09-12T01:56:50.101141+0000","last_became_active":"2024-09-12T01:56:49.100012+0000","last_became_peered":"2024-09-12T01:56:49.100012+0000","last_unstale":"2024-09-12T01:56:50.101141+0000","last_undegraded":"2024-09-12T01:56:50.101141+0000","last_fullsized":"2024-09-12T01:56:50.101141+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:20.337506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.101096+0000","last_change":"2024-09-12T01:56:49.092104+0000","last_active":"2024-09-12T01:56:50.101096+0000","last_peered":"2024-09-12T01:56:50.101096+0000","last_clean":"2024-09-12T01:56:50.101096+0000","last_became_active":"2024-09-12T01:56:49.091831+0000","last_became_peered":"2024-09-12T01:56:49.091831+0000","last_unstale":"2024-09-12T01:56:50.101096+0000","last_undegraded":"2024-09-12T01:56:50.101096+0000","last_fullsized":"2024-09-12T01:56:50.101096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:39.587882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920232+0000","last_change":"2024-09-12T01:56:49.094433+0000","last_active":"2024-09-12T01:56:50.920232+0000","last_peered":"2024-09-12T01:56:50.920232+0000","last_clean":"2024-09-12T01:56:50.920232+0000","last_became_active":"2024-09-12T01:56:49.094165+0000","last_became_peered":"2024-09-12T01:56:49.094165+0000","last_unstale":"2024-09-12T01:56:50.920232+0000","last_undegraded":"2024-09-12T01:56:50.920232+0000","last_fullsized":"2024-09-12T01:56:50.920232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:10.499892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.100857+0000","last_change":"2024-09-12T01:56:49.097145+0000","last_active":"2024-09-12T01:56:50.100857+0000","last_peered":"2024-09-12T01:56:50.100857+0000","last_clean":"2024-09-12T01:56:50.100857+0000","last_became_active":"2024-09-12T01:56:49.096854+0000","last_became_peered":"2024-09-12T01:56:49.096854+0000","last_unstale":"2024-09-12T01:56:50.100857+0000","last_undegraded":"2024-09-12T01:56:50.100857+0000","last_fullsized":"2024-09-12T01:56:50.100857+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:09.721662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.089103+0000","last_change":"2024-09-12T01:56:49.093532+0000","last_active":"2024-09-12T01:56:50.089103+0000","last_peered":"2024-09-12T01:56:50.089103+0000","last_clean":"2024-09-12T01:56:50.089103+0000","last_became_active":"2024-09-12T01:56:49.091302+0000","last_became_peered":"2024-09-12T01:56:49.091302+0000","last_unstale":"2024-09-12T01:56:50.089103+0000","last_undegraded":"2024-09-12T01:56:50.089103+0000","last_fullsized":"2024-09-12T01:56:50.089103+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:06.245645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.100857+0000","last_change":"2024-09-12T01:56:49.098596+0000","last_active":"2024-09-12T01:56:50.100857+0000","last_peered":"2024-09-12T01:56:50.100857+0000","last_clean":"2024-09-12T01:56:50.100857+0000","last_became_active":"2024-09-12T01:56:49.096857+0000","last_became_peered":"2024-09-12T01:56:49.096857+0000","last_unstale":"2024-09-12T01:56:50.100857+0000","last_undegraded":"2024-09-12T01:56:50.100857+0000","last_fullsized":"2024-09-12T01:56:50.100857+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:57.393775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.561094+0000","last_change":"2024-09-12T01:56:49.098562+0000","last_active":"2024-09-12T01:56:50.561094+0000","last_peered":"2024-09-12T01:56:50.561094+0000","last_clean":"2024-09-12T01:56:50.561094+0000","last_became_active":"2024-09-12T01:56:49.098285+0000","last_became_peered":"2024-09-12T01:56:49.098285+0000","last_unstale":"2024-09-12T01:56:50.561094+0000","last_undegraded":"2024-09-12T01:56:50.561094+0000","last_fullsized":"2024-09-12T01:56:50.561094+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:27.444535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.561607+0000","last_change":"2024-09-12T01:56:49.097918+0000","last_active":"2024-09-12T01:56:50.561607+0000","last_peered":"2024-09-12T01:56:50.561607+0000","last_clean":"2024-09-12T01:56:50.561607+0000","last_became_active":"2024-09-12T01:56:49.097595+0000","last_became_peered":"2024-09-12T01:56:49.097595+0000","last_unstale":"2024-09-12T01:56:50.561607+0000","last_undegraded":"2024-09-12T01:56:50.561607+0000","last_fullsized":"2024-09-12T01:56:50.561607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:57.393775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.089766+0000","last_change":"2024-09-12T01:56:49.090304+0000","last_active":"2024-09-12T01:56:50.089766+0000","last_peered":"2024-09-12T01:56:50.089766+0000","last_clean":"2024-09-12T01:56:50.089766+0000","last_became_active":"2024-09-12T01:56:49.089928+0000","last_became_peered":"2024-09-12T01:56:49.089928+0000","last_unstale":"2024-09-12T01:56:50.089766+0000","last_undegraded":"2024-09-12T01:56:50.089766+0000","last_fullsized":"2024-09-12T01:56:50.089766+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:08.496640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.098785+0000","last_change":"2024-09-12T01:56:49.106821+0000","last_active":"2024-09-12T01:56:50.098785+0000","last_peered":"2024-09-12T01:56:50.098785+0000","last_clean":"2024-09-12T01:56:50.098785+0000","last_became_active":"2024-09-12T01:56:49.106523+0000","last_became_peered":"2024-09-12T01:56:49.106523+0000","last_unstale":"2024-09-12T01:56:50.098785+0000","last_undegraded":"2024-09-12T01:56:50.098785+0000","last_fullsized":"2024-09-12T01:56:50.098785+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:22.615266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.089320+0000","last_change":"2024-09-12T01:56:49.093382+0000","last_active":"2024-09-12T01:56:50.089320+0000","last_peered":"2024-09-12T01:56:50.089320+0000","last_clean":"2024-09-12T01:56:50.089320+0000","last_became_active":"2024-09-12T01:56:49.093060+0000","last_became_peered":"2024-09-12T01:56:49.093060+0000","last_unstale":"2024-09-12T01:56:50.089320+0000","last_undegraded":"2024-09-12T01:56:50.089320+0000","last_fullsized":"2024-09-12T01:56:50.089320+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:44.543744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.101115+0000","last_change":"2024-09-12T01:56:49.102971+0000","last_active":"2024-09-12T01:56:50.101115+0000","last_peered":"2024-09-12T01:56:50.101115+0000","last_clean":"2024-09-12T01:56:50.101115+0000","last_became_active":"2024-09-12T01:56:49.102708+0000","last_became_peered":"2024-09-12T01:56:49.102708+0000","last_unstale":"2024-09-12T01:56:50.101115+0000","last_undegraded":"2024-09-12T01:56:50.101115+0000","last_fullsized":"2024-09-12T01:56:50.101115+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:32.858474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.089383+0000","last_change":"2024-09-12T01:56:49.094929+0000","last_active":"2024-09-12T01:56:50.089383+0000","last_peered":"2024-09-12T01:56:50.089383+0000","last_clean":"2024-09-12T01:56:50.089383+0000","last_became_active":"2024-09-12T01:56:49.094668+0000","last_became_peered":"2024-09-12T01:56:49.094668+0000","last_unstale":"2024-09-12T01:56:50.089383+0000","last_undegraded":"2024-09-12T01:56:50.089383+0000","last_fullsized":"2024-09-12T01:56:50.089383+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:02.377141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.561187+0000","last_change":"2024-09-12T01:56:49.094962+0000","last_active":"2024-09-12T01:56:50.561187+0000","last_peered":"2024-09-12T01:56:50.561187+0000","last_clean":"2024-09-12T01:56:50.561187+0000","last_became_active":"2024-09-12T01:56:49.094689+0000","last_became_peered":"2024-09-12T01:56:49.094689+0000","last_unstale":"2024-09-12T01:56:50.561187+0000","last_undegraded":"2024-09-12T01:56:50.561187+0000","last_fullsized":"2024-09-12T01:56:50.561187+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:26.195981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.098569+0000","last_change":"2024-09-12T01:56:49.100678+0000","last_active":"2024-09-12T01:56:50.098569+0000","last_peered":"2024-09-12T01:56:50.098569+0000","last_clean":"2024-09-12T01:56:50.098569+0000","last_became_active":"2024-09-12T01:56:49.100427+0000","last_became_peered":"2024-09-12T01:56:49.100427+0000","last_unstale":"2024-09-12T01:56:50.098569+0000","last_undegraded":"2024-09-12T01:56:50.098569+0000","last_fullsized":"2024-09-12T01:56:50.098569+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:27.591154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.089530+0000","last_change":"2024-09-12T01:56:49.094852+0000","last_active":"2024-09-12T01:56:50.089530+0000","last_peered":"2024-09-12T01:56:50.089530+0000","last_clean":"2024-09-12T01:56:50.089530+0000","last_became_active":"2024-09-12T01:56:49.094582+0000","last_became_peered":"2024-09-12T01:56:49.094582+0000","last_unstale":"2024-09-12T01:56:50.089530+0000","last_undegraded":"2024-09-12T01:56:50.089530+0000","last_fullsized":"2024-09-12T01:56:50.089530+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:30.275429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920375+0000","last_change":"2024-09-12T01:56:49.102143+0000","last_active":"2024-09-12T01:56:50.920375+0000","last_peered":"2024-09-12T01:56:50.920375+0000","last_clean":"2024-09-12T01:56:50.920375+0000","last_became_active":"2024-09-12T01:56:49.101870+0000","last_became_peered":"2024-09-12T01:56:49.101870+0000","last_unstale":"2024-09-12T01:56:50.920375+0000","last_undegraded":"2024-09-12T01:56:50.920375+0000","last_fullsized":"2024-09-12T01:56:50.920375+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:00.314227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.089553+0000","last_change":"2024-09-12T01:56:49.095001+0000","last_active":"2024-09-12T01:56:50.089553+0000","last_peered":"2024-09-12T01:56:50.089553+0000","last_clean":"2024-09-12T01:56:50.089553+0000","last_became_active":"2024-09-12T01:56:49.094730+0000","last_became_peered":"2024-09-12T01:56:49.094730+0000","last_unstale":"2024-09-12T01:56:50.089553+0000","last_undegraded":"2024-09-12T01:56:50.089553+0000","last_fullsized":"2024-09-12T01:56:50.089553+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:40.245592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.101090+0000","last_change":"2024-09-12T01:56:49.091704+0000","last_active":"2024-09-12T01:56:50.101090+0000","last_peered":"2024-09-12T01:56:50.101090+0000","last_clean":"2024-09-12T01:56:50.101090+0000","last_became_active":"2024-09-12T01:56:49.091369+0000","last_became_peered":"2024-09-12T01:56:49.091369+0000","last_unstale":"2024-09-12T01:56:50.101090+0000","last_undegraded":"2024-09-12T01:56:50.101090+0000","last_fullsized":"2024-09-12T01:56:50.101090+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:13.703920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.089232+0000","last_change":"2024-09-12T01:56:49.102931+0000","last_active":"2024-09-12T01:56:50.089232+0000","last_peered":"2024-09-12T01:56:50.089232+0000","last_clean":"2024-09-12T01:56:50.089232+0000","last_became_active":"2024-09-12T01:56:49.102638+0000","last_became_peered":"2024-09-12T01:56:49.102638+0000","last_unstale":"2024-09-12T01:56:50.089232+0000","last_undegraded":"2024-09-12T01:56:50.089232+0000","last_fullsized":"2024-09-12T01:56:50.089232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:11.959033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.089129+0000","last_change":"2024-09-12T01:56:49.088392+0000","last_active":"2024-09-12T01:56:50.089129+0000","last_peered":"2024-09-12T01:56:50.089129+0000","last_clean":"2024-09-12T01:56:50.089129+0000","last_became_active":"2024-09-12T01:56:49.088100+0000","last_became_peered":"2024-09-12T01:56:49.088100+0000","last_unstale":"2024-09-12T01:56:50.089129+0000","last_undegraded":"2024-09-12T01:56:50.089129+0000","last_fullsized":"2024-09-12T01:56:50.089129+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:18.993260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.561218+0000","last_change":"2024-09-12T01:56:49.098430+0000","last_active":"2024-09-12T01:56:50.561218+0000","last_peered":"2024-09-12T01:56:50.561218+0000","last_clean":"2024-09-12T01:56:50.561218+0000","last_became_active":"2024-09-12T01:56:49.098144+0000","last_became_peered":"2024-09-12T01:56:49.098144+0000","last_unstale":"2024-09-12T01:56:50.561218+0000","last_undegraded":"2024-09-12T01:56:50.561218+0000","last_fullsized":"2024-09-12T01:56:50.561218+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:00.426689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920459+0000","last_change":"2024-09-12T01:56:49.094601+0000","last_active":"2024-09-12T01:56:50.920459+0000","last_peered":"2024-09-12T01:56:50.920459+0000","last_clean":"2024-09-12T01:56:50.920459+0000","last_became_active":"2024-09-12T01:56:49.094322+0000","last_became_peered":"2024-09-12T01:56:49.094322+0000","last_unstale":"2024-09-12T01:56:50.920459+0000","last_undegraded":"2024-09-12T01:56:50.920459+0000","last_fullsized":"2024-09-12T01:56:50.920459+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:10.977613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.561570+0000","last_change":"2024-09-12T01:56:49.097725+0000","last_active":"2024-09-12T01:56:50.561570+0000","last_peered":"2024-09-12T01:56:50.561570+0000","last_clean":"2024-09-12T01:56:50.561570+0000","last_became_active":"2024-09-12T01:56:49.097049+0000","last_became_peered":"2024-09-12T01:56:49.097049+0000","last_unstale":"2024-09-12T01:56:50.561570+0000","last_undegraded":"2024-09-12T01:56:50.561570+0000","last_fullsized":"2024-09-12T01:56:50.561570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:13.593421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.089617+0000","last_change":"2024-09-12T01:56:48.083339+0000","last_active":"2024-09-12T01:56:50.089617+0000","last_peered":"2024-09-12T01:56:50.089617+0000","last_clean":"2024-09-12T01:56:50.089617+0000","last_became_active":"2024-09-12T01:56:48.083086+0000","last_became_peered":"2024-09-12T01:56:48.083086+0000","last_unstale":"2024-09-12T01:56:50.089617+0000","last_undegraded":"2024-09-12T01:56:50.089617+0000","last_fullsized":"2024-09-12T01:56:50.089617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:26.586415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920495+0000","last_change":"2024-09-12T01:56:49.102036+0000","last_active":"2024-09-12T01:56:50.920495+0000","last_peered":"2024-09-12T01:56:50.920495+0000","last_clean":"2024-09-12T01:56:50.920495+0000","last_became_active":"2024-09-12T01:56:49.101700+0000","last_became_peered":"2024-09-12T01:56:49.101700+0000","last_unstale":"2024-09-12T01:56:50.920495+0000","last_undegraded":"2024-09-12T01:56:50.920495+0000","last_fullsized":"2024-09-12T01:56:50.920495+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:00.475141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920638+0000","last_change":"2024-09-12T01:56:48.082903+0000","last_active":"2024-09-12T01:56:50.920638+0000","last_peered":"2024-09-12T01:56:50.920638+0000","last_clean":"2024-09-12T01:56:50.920638+0000","last_became_active":"2024-09-12T01:56:48.082585+0000","last_became_peered":"2024-09-12T01:56:48.082585+0000","last_unstale":"2024-09-12T01:56:50.920638+0000","last_undegraded":"2024-09-12T01:56:50.920638+0000","last_fullsized":"2024-09-12T01:56:50.920638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:53.692206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.090134+0000","last_change":"2024-09-12T01:56:49.084357+0000","last_active":"2024-09-12T01:56:50.090134+0000","last_peered":"2024-09-12T01:56:50.090134+0000","last_clean":"2024-09-12T01:56:50.090134+0000","last_became_active":"2024-09-12T01:56:49.084103+0000","last_became_peered":"2024-09-12T01:56:49.084103+0000","last_unstale":"2024-09-12T01:56:50.090134+0000","last_undegraded":"2024-09-12T01:56:50.090134+0000","last_fullsized":"2024-09-12T01:56:50.090134+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:22.424154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920659+0000","last_change":"2024-09-12T01:56:48.084769+0000","last_active":"2024-09-12T01:56:50.920659+0000","last_peered":"2024-09-12T01:56:50.920659+0000","last_clean":"2024-09-12T01:56:50.920659+0000","last_became_active":"2024-09-12T01:56:48.084356+0000","last_became_peered":"2024-09-12T01:56:48.084356+0000","last_unstale":"2024-09-12T01:56:50.920659+0000","last_undegraded":"2024-09-12T01:56:50.920659+0000","last_fullsized":"2024-09-12T01:56:50.920659+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:08.814944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.090668+0000","last_change":"2024-09-12T01:56:49.085495+0000","last_active":"2024-09-12T01:56:50.090668+0000","last_peered":"2024-09-12T01:56:50.090668+0000","last_clean":"2024-09-12T01:56:50.090668+0000","last_became_active":"2024-09-12T01:56:49.084056+0000","last_became_peered":"2024-09-12T01:56:49.084056+0000","last_unstale":"2024-09-12T01:56:50.090668+0000","last_undegraded":"2024-09-12T01:56:50.090668+0000","last_fullsized":"2024-09-12T01:56:50.090668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:26.468951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.089834+0000","last_change":"2024-09-12T01:56:48.082833+0000","last_active":"2024-09-12T01:56:50.089834+0000","last_peered":"2024-09-12T01:56:50.089834+0000","last_clean":"2024-09-12T01:56:50.089834+0000","last_became_active":"2024-09-12T01:56:48.082490+0000","last_became_peered":"2024-09-12T01:56:48.082490+0000","last_unstale":"2024-09-12T01:56:50.089834+0000","last_undegraded":"2024-09-12T01:56:50.089834+0000","last_fullsized":"2024-09-12T01:56:50.089834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:40.365943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920686+0000","last_change":"2024-09-12T01:56:49.102683+0000","last_active":"2024-09-12T01:56:50.920686+0000","last_peered":"2024-09-12T01:56:50.920686+0000","last_clean":"2024-09-12T01:56:50.920686+0000","last_became_active":"2024-09-12T01:56:49.102353+0000","last_became_peered":"2024-09-12T01:56:49.102353+0000","last_unstale":"2024-09-12T01:56:50.920686+0000","last_undegraded":"2024-09-12T01:56:50.920686+0000","last_fullsized":"2024-09-12T01:56:50.920686+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:00.426689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.100973+0000","last_change":"2024-09-12T01:56:48.086406+0000","last_active":"2024-09-12T01:56:50.100973+0000","last_peered":"2024-09-12T01:56:50.100973+0000","last_clean":"2024-09-12T01:56:50.100973+0000","last_became_active":"2024-09-12T01:56:48.086117+0000","last_became_peered":"2024-09-12T01:56:48.086117+0000","last_unstale":"2024-09-12T01:56:50.100973+0000","last_undegraded":"2024-09-12T01:56:50.100973+0000","last_fullsized":"2024-09-12T01:56:50.100973+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:45.367043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.100993+0000","last_change":"2024-09-12T01:56:49.104426+0000","last_active":"2024-09-12T01:56:50.100993+0000","last_peered":"2024-09-12T01:56:50.100993+0000","last_clean":"2024-09-12T01:56:50.100993+0000","last_became_active":"2024-09-12T01:56:49.103633+0000","last_became_peered":"2024-09-12T01:56:49.103633+0000","last_unstale":"2024-09-12T01:56:50.100993+0000","last_undegraded":"2024-09-12T01:56:50.100993+0000","last_fullsized":"2024-09-12T01:56:50.100993+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:13.593421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.561189+0000","last_change":"2024-09-12T01:56:48.084388+0000","last_active":"2024-09-12T01:56:50.561189+0000","last_peered":"2024-09-12T01:56:50.561189+0000","last_clean":"2024-09-12T01:56:50.561189+0000","last_became_active":"2024-09-12T01:56:48.084111+0000","last_became_peered":"2024-09-12T01:56:48.084111+0000","last_unstale":"2024-09-12T01:56:50.561189+0000","last_undegraded":"2024-09-12T01:56:50.561189+0000","last_fullsized":"2024-09-12T01:56:50.561189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:22.472440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.089580+0000","last_change":"2024-09-12T01:56:49.096817+0000","last_active":"2024-09-12T01:56:50.089580+0000","last_peered":"2024-09-12T01:56:50.089580+0000","last_clean":"2024-09-12T01:56:50.089580+0000","last_became_active":"2024-09-12T01:56:49.096544+0000","last_became_peered":"2024-09-12T01:56:49.096544+0000","last_unstale":"2024-09-12T01:56:50.089580+0000","last_undegraded":"2024-09-12T01:56:50.089580+0000","last_fullsized":"2024-09-12T01:56:50.089580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:47.037464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920206+0000","last_change":"2024-09-12T01:56:48.091222+0000","last_active":"2024-09-12T01:56:50.920206+0000","last_peered":"2024-09-12T01:56:50.920206+0000","last_clean":"2024-09-12T01:56:50.920206+0000","last_became_active":"2024-09-12T01:56:48.090909+0000","last_became_peered":"2024-09-12T01:56:48.090909+0000","last_unstale":"2024-09-12T01:56:50.920206+0000","last_undegraded":"2024-09-12T01:56:50.920206+0000","last_fullsized":"2024-09-12T01:56:50.920206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:16.092627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.090426+0000","last_change":"2024-09-12T01:56:49.095060+0000","last_active":"2024-09-12T01:56:50.090426+0000","last_peered":"2024-09-12T01:56:50.090426+0000","last_clean":"2024-09-12T01:56:50.090426+0000","last_became_active":"2024-09-12T01:56:49.094554+0000","last_became_peered":"2024-09-12T01:56:49.094554+0000","last_unstale":"2024-09-12T01:56:50.090426+0000","last_undegraded":"2024-09-12T01:56:50.090426+0000","last_fullsized":"2024-09-12T01:56:50.090426+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:07.617067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.088884+0000","last_change":"2024-09-12T01:56:48.081235+0000","last_active":"2024-09-12T01:56:50.088884+0000","last_peered":"2024-09-12T01:56:50.088884+0000","last_clean":"2024-09-12T01:56:50.088884+0000","last_became_active":"2024-09-12T01:56:48.080960+0000","last_became_peered":"2024-09-12T01:56:48.080960+0000","last_unstale":"2024-09-12T01:56:50.088884+0000","last_undegraded":"2024-09-12T01:56:50.088884+0000","last_fullsized":"2024-09-12T01:56:50.088884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:06.862865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.098890+0000","last_change":"2024-09-12T01:56:49.102035+0000","last_active":"2024-09-12T01:56:50.098890+0000","last_peered":"2024-09-12T01:56:50.098890+0000","last_clean":"2024-09-12T01:56:50.098890+0000","last_became_active":"2024-09-12T01:56:49.101772+0000","last_became_peered":"2024-09-12T01:56:49.101772+0000","last_unstale":"2024-09-12T01:56:50.098890+0000","last_undegraded":"2024-09-12T01:56:50.098890+0000","last_fullsized":"2024-09-12T01:56:50.098890+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:42.421526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.090749+0000","last_change":"2024-09-12T01:56:48.085039+0000","last_active":"2024-09-12T01:56:50.090749+0000","last_peered":"2024-09-12T01:56:50.090749+0000","last_clean":"2024-09-12T01:56:50.090749+0000","last_became_active":"2024-09-12T01:56:48.084764+0000","last_became_peered":"2024-09-12T01:56:48.084764+0000","last_unstale":"2024-09-12T01:56:50.090749+0000","last_undegraded":"2024-09-12T01:56:50.090749+0000","last_fullsized":"2024-09-12T01:56:50.090749+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:59.470403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.561536+0000","last_change":"2024-09-12T01:56:49.092967+0000","last_active":"2024-09-12T01:56:50.561536+0000","last_peered":"2024-09-12T01:56:50.561536+0000","last_clean":"2024-09-12T01:56:50.561536+0000","last_became_active":"2024-09-12T01:56:49.092693+0000","last_became_peered":"2024-09-12T01:56:49.092693+0000","last_unstale":"2024-09-12T01:56:50.561536+0000","last_undegraded":"2024-09-12T01:56:50.561536+0000","last_fullsized":"2024-09-12T01:56:50.561536+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:09.721662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.101275+0000","last_change":"2024-09-12T01:56:48.081300+0000","last_active":"2024-09-12T01:56:50.101275+0000","last_peered":"2024-09-12T01:56:50.101275+0000","last_clean":"2024-09-12T01:56:50.101275+0000","last_became_active":"2024-09-12T01:56:48.080352+0000","last_became_peered":"2024-09-12T01:56:48.080352+0000","last_unstale":"2024-09-12T01:56:50.101275+0000","last_undegraded":"2024-09-12T01:56:50.101275+0000","last_fullsized":"2024-09-12T01:56:50.101275+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:17.988522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920641+0000","last_change":"2024-09-12T01:56:49.100310+0000","last_active":"2024-09-12T01:56:50.920641+0000","last_peered":"2024-09-12T01:56:50.920641+0000","last_clean":"2024-09-12T01:56:50.920641+0000","last_became_active":"2024-09-12T01:56:49.100022+0000","last_became_peered":"2024-09-12T01:56:49.100022+0000","last_unstale":"2024-09-12T01:56:50.920641+0000","last_undegraded":"2024-09-12T01:56:50.920641+0000","last_fullsized":"2024-09-12T01:56:50.920641+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:26.195981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.101225+0000","last_change":"2024-09-12T01:56:48.084554+0000","last_active":"2024-09-12T01:56:50.101225+0000","last_peered":"2024-09-12T01:56:50.101225+0000","last_clean":"2024-09-12T01:56:50.101225+0000","last_became_active":"2024-09-12T01:56:48.084150+0000","last_became_peered":"2024-09-12T01:56:48.084150+0000","last_unstale":"2024-09-12T01:56:50.101225+0000","last_undegraded":"2024-09-12T01:56:50.101225+0000","last_fullsized":"2024-09-12T01:56:50.101225+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:43.539005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.090031+0000","last_change":"2024-09-12T01:56:49.094301+0000","last_active":"2024-09-12T01:56:50.090031+0000","last_peered":"2024-09-12T01:56:50.090031+0000","last_clean":"2024-09-12T01:56:50.090031+0000","last_became_active":"2024-09-12T01:56:49.094048+0000","last_became_peered":"2024-09-12T01:56:49.094048+0000","last_unstale":"2024-09-12T01:56:50.090031+0000","last_undegraded":"2024-09-12T01:56:50.090031+0000","last_fullsized":"2024-09-12T01:56:50.090031+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:07.500867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.090546+0000","last_change":"2024-09-12T01:56:48.083135+0000","last_active":"2024-09-12T01:56:50.090546+0000","last_peered":"2024-09-12T01:56:50.090546+0000","last_clean":"2024-09-12T01:56:50.090546+0000","last_became_active":"2024-09-12T01:56:48.082844+0000","last_became_peered":"2024-09-12T01:56:48.082844+0000","last_unstale":"2024-09-12T01:56:50.090546+0000","last_undegraded":"2024-09-12T01:56:50.090546+0000","last_fullsized":"2024-09-12T01:56:50.090546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:59.309489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920148+0000","last_change":"2024-09-12T01:56:49.096994+0000","last_active":"2024-09-12T01:56:50.920148+0000","last_peered":"2024-09-12T01:56:50.920148+0000","last_clean":"2024-09-12T01:56:50.920148+0000","last_became_active":"2024-09-12T01:56:49.096716+0000","last_became_peered":"2024-09-12T01:56:49.096716+0000","last_unstale":"2024-09-12T01:56:50.920148+0000","last_undegraded":"2024-09-12T01:56:50.920148+0000","last_fullsized":"2024-09-12T01:56:50.920148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:38.096087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.090551+0000","last_change":"2024-09-12T01:56:48.076816+0000","last_active":"2024-09-12T01:56:50.090551+0000","last_peered":"2024-09-12T01:56:50.090551+0000","last_clean":"2024-09-12T01:56:50.090551+0000","last_became_active":"2024-09-12T01:56:48.076400+0000","last_became_peered":"2024-09-12T01:56:48.076400+0000","last_unstale":"2024-09-12T01:56:50.090551+0000","last_undegraded":"2024-09-12T01:56:50.090551+0000","last_fullsized":"2024-09-12T01:56:50.090551+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:09.972875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.090327+0000","last_change":"2024-09-12T01:56:49.094375+0000","last_active":"2024-09-12T01:56:50.090327+0000","last_peered":"2024-09-12T01:56:50.090327+0000","last_clean":"2024-09-12T01:56:50.090327+0000","last_became_active":"2024-09-12T01:56:49.094029+0000","last_became_peered":"2024-09-12T01:56:49.094029+0000","last_unstale":"2024-09-12T01:56:50.090327+0000","last_undegraded":"2024-09-12T01:56:50.090327+0000","last_fullsized":"2024-09-12T01:56:50.090327+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:24.686953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920353+0000","last_change":"2024-09-12T01:56:48.091263+0000","last_active":"2024-09-12T01:56:50.920353+0000","last_peered":"2024-09-12T01:56:50.920353+0000","last_clean":"2024-09-12T01:56:50.920353+0000","last_became_active":"2024-09-12T01:56:48.090933+0000","last_became_peered":"2024-09-12T01:56:48.090933+0000","last_unstale":"2024-09-12T01:56:50.920353+0000","last_undegraded":"2024-09-12T01:56:50.920353+0000","last_fullsized":"2024-09-12T01:56:50.920353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:44.353925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.561259+0000","last_change":"2024-09-12T01:56:49.095408+0000","last_active":"2024-09-12T01:56:50.561259+0000","last_peered":"2024-09-12T01:56:50.561259+0000","last_clean":"2024-09-12T01:56:50.561259+0000","last_became_active":"2024-09-12T01:56:49.095100+0000","last_became_peered":"2024-09-12T01:56:49.095100+0000","last_unstale":"2024-09-12T01:56:50.561259+0000","last_undegraded":"2024-09-12T01:56:50.561259+0000","last_fullsized":"2024-09-12T01:56:50.561259+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:25.718464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.088872+0000","last_change":"2024-09-12T01:56:48.085093+0000","last_active":"2024-09-12T01:56:50.088872+0000","last_peered":"2024-09-12T01:56:50.088872+0000","last_clean":"2024-09-12T01:56:50.088872+0000","last_became_active":"2024-09-12T01:56:48.084794+0000","last_became_peered":"2024-09-12T01:56:48.084794+0000","last_unstale":"2024-09-12T01:56:50.088872+0000","last_undegraded":"2024-09-12T01:56:50.088872+0000","last_fullsized":"2024-09-12T01:56:50.088872+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:53.692206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.090450+0000","last_change":"2024-09-12T01:56:49.096762+0000","last_active":"2024-09-12T01:56:50.090450+0000","last_peered":"2024-09-12T01:56:50.090450+0000","last_clean":"2024-09-12T01:56:50.090450+0000","last_became_active":"2024-09-12T01:56:49.096475+0000","last_became_peered":"2024-09-12T01:56:49.096475+0000","last_unstale":"2024-09-12T01:56:50.090450+0000","last_undegraded":"2024-09-12T01:56:50.090450+0000","last_fullsized":"2024-09-12T01:56:50.090450+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:29.171391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.561097+0000","last_change":"2024-09-12T01:56:48.081824+0000","last_active":"2024-09-12T01:56:50.561097+0000","last_peered":"2024-09-12T01:56:50.561097+0000","last_clean":"2024-09-12T01:56:50.561097+0000","last_became_active":"2024-09-12T01:56:48.081536+0000","last_became_peered":"2024-09-12T01:56:48.081536+0000","last_unstale":"2024-09-12T01:56:50.561097+0000","last_undegraded":"2024-09-12T01:56:50.561097+0000","last_fullsized":"2024-09-12T01:56:50.561097+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:40.108571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.090767+0000","last_change":"2024-09-12T01:56:49.085416+0000","last_active":"2024-09-12T01:56:50.090767+0000","last_peered":"2024-09-12T01:56:50.090767+0000","last_clean":"2024-09-12T01:56:50.090767+0000","last_became_active":"2024-09-12T01:56:49.084559+0000","last_became_peered":"2024-09-12T01:56:49.084559+0000","last_unstale":"2024-09-12T01:56:50.090767+0000","last_undegraded":"2024-09-12T01:56:50.090767+0000","last_fullsized":"2024-09-12T01:56:50.090767+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:31.813747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.101290+0000","last_change":"2024-09-12T01:56:48.086519+0000","last_active":"2024-09-12T01:56:50.101290+0000","last_peered":"2024-09-12T01:56:50.101290+0000","last_clean":"2024-09-12T01:56:50.101290+0000","last_became_active":"2024-09-12T01:56:48.086139+0000","last_became_peered":"2024-09-12T01:56:48.086139+0000","last_unstale":"2024-09-12T01:56:50.101290+0000","last_undegraded":"2024-09-12T01:56:50.101290+0000","last_fullsized":"2024-09-12T01:56:50.101290+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:17.704888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.101169+0000","last_change":"2024-09-12T01:56:49.104837+0000","last_active":"2024-09-12T01:56:50.101169+0000","last_peered":"2024-09-12T01:56:50.101169+0000","last_clean":"2024-09-12T01:56:50.101169+0000","last_became_active":"2024-09-12T01:56:49.103859+0000","last_became_peered":"2024-09-12T01:56:49.103859+0000","last_unstale":"2024-09-12T01:56:50.101169+0000","last_undegraded":"2024-09-12T01:56:50.101169+0000","last_fullsized":"2024-09-12T01:56:50.101169+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:53.233949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.090120+0000","last_change":"2024-09-12T01:56:48.086966+0000","last_active":"2024-09-12T01:56:50.090120+0000","last_peered":"2024-09-12T01:56:50.090120+0000","last_clean":"2024-09-12T01:56:50.090120+0000","last_became_active":"2024-09-12T01:56:48.086678+0000","last_became_peered":"2024-09-12T01:56:48.086678+0000","last_unstale":"2024-09-12T01:56:50.090120+0000","last_undegraded":"2024-09-12T01:56:50.090120+0000","last_fullsized":"2024-09-12T01:56:50.090120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:42.760298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.090080+0000","last_change":"2024-09-12T01:56:49.105519+0000","last_active":"2024-09-12T01:56:50.090080+0000","last_peered":"2024-09-12T01:56:50.090080+0000","last_clean":"2024-09-12T01:56:50.090080+0000","last_became_active":"2024-09-12T01:56:49.105230+0000","last_became_peered":"2024-09-12T01:56:49.105230+0000","last_unstale":"2024-09-12T01:56:50.090080+0000","last_undegraded":"2024-09-12T01:56:50.090080+0000","last_fullsized":"2024-09-12T01:56:50.090080+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:21.577370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.098757+0000","last_change":"2024-09-12T01:56:48.073784+0000","last_active":"2024-09-12T01:56:50.098757+0000","last_peered":"2024-09-12T01:56:50.098757+0000","last_clean":"2024-09-12T01:56:50.098757+0000","last_became_active":"2024-09-12T01:56:48.073319+0000","last_became_peered":"2024-09-12T01:56:48.073319+0000","last_unstale":"2024-09-12T01:56:50.098757+0000","last_undegraded":"2024-09-12T01:56:50.098757+0000","last_fullsized":"2024-09-12T01:56:50.098757+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:18.731697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.098761+0000","last_change":"2024-09-12T01:56:49.105920+0000","last_active":"2024-09-12T01:56:50.098761+0000","last_peered":"2024-09-12T01:56:50.098761+0000","last_clean":"2024-09-12T01:56:50.098761+0000","last_became_active":"2024-09-12T01:56:49.105635+0000","last_became_peered":"2024-09-12T01:56:49.105635+0000","last_unstale":"2024-09-12T01:56:50.098761+0000","last_undegraded":"2024-09-12T01:56:50.098761+0000","last_fullsized":"2024-09-12T01:56:50.098761+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:23.477178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920348+0000","last_change":"2024-09-12T01:56:48.084752+0000","last_active":"2024-09-12T01:56:50.920348+0000","last_peered":"2024-09-12T01:56:50.920348+0000","last_clean":"2024-09-12T01:56:50.920348+0000","last_became_active":"2024-09-12T01:56:48.084474+0000","last_became_peered":"2024-09-12T01:56:48.084474+0000","last_unstale":"2024-09-12T01:56:50.920348+0000","last_undegraded":"2024-09-12T01:56:50.920348+0000","last_fullsized":"2024-09-12T01:56:50.920348+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:07.667918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.561296+0000","last_change":"2024-09-12T01:56:49.098187+0000","last_active":"2024-09-12T01:56:50.561296+0000","last_peered":"2024-09-12T01:56:50.561296+0000","last_clean":"2024-09-12T01:56:50.561296+0000","last_became_active":"2024-09-12T01:56:49.097323+0000","last_became_peered":"2024-09-12T01:56:49.097323+0000","last_unstale":"2024-09-12T01:56:50.561296+0000","last_undegraded":"2024-09-12T01:56:50.561296+0000","last_fullsized":"2024-09-12T01:56:50.561296+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:17.316465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.098608+0000","last_change":"2024-09-12T01:56:48.080455+0000","last_active":"2024-09-12T01:56:50.098608+0000","last_peered":"2024-09-12T01:56:50.098608+0000","last_clean":"2024-09-12T01:56:50.098608+0000","last_became_active":"2024-09-12T01:56:48.080116+0000","last_became_peered":"2024-09-12T01:56:48.080116+0000","last_unstale":"2024-09-12T01:56:50.098608+0000","last_undegraded":"2024-09-12T01:56:50.098608+0000","last_fullsized":"2024-09-12T01:56:50.098608+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:45.330294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920074+0000","last_change":"2024-09-12T01:56:49.093231+0000","last_active":"2024-09-12T01:56:50.920074+0000","last_peered":"2024-09-12T01:56:50.920074+0000","last_clean":"2024-09-12T01:56:50.920074+0000","last_became_active":"2024-09-12T01:56:49.092939+0000","last_became_peered":"2024-09-12T01:56:49.092939+0000","last_unstale":"2024-09-12T01:56:50.920074+0000","last_undegraded":"2024-09-12T01:56:50.920074+0000","last_fullsized":"2024-09-12T01:56:50.920074+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:36.644433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.098629+0000","last_change":"2024-09-12T01:56:48.081119+0000","last_active":"2024-09-12T01:56:50.098629+0000","last_peered":"2024-09-12T01:56:50.098629+0000","last_clean":"2024-09-12T01:56:50.098629+0000","last_became_active":"2024-09-12T01:56:48.080833+0000","last_became_peered":"2024-09-12T01:56:48.080833+0000","last_unstale":"2024-09-12T01:56:50.098629+0000","last_undegraded":"2024-09-12T01:56:50.098629+0000","last_fullsized":"2024-09-12T01:56:50.098629+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:38.176870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.100885+0000","last_change":"2024-09-12T01:56:49.095989+0000","last_active":"2024-09-12T01:56:50.100885+0000","last_peered":"2024-09-12T01:56:50.100885+0000","last_clean":"2024-09-12T01:56:50.100885+0000","last_became_active":"2024-09-12T01:56:49.095624+0000","last_became_peered":"2024-09-12T01:56:49.095624+0000","last_unstale":"2024-09-12T01:56:50.100885+0000","last_undegraded":"2024-09-12T01:56:50.100885+0000","last_fullsized":"2024-09-12T01:56:50.100885+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:24.581245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.561350+0000","last_change":"2024-09-12T01:56:48.079323+0000","last_active":"2024-09-12T01:56:50.561350+0000","last_peered":"2024-09-12T01:56:50.561350+0000","last_clean":"2024-09-12T01:56:50.561350+0000","last_became_active":"2024-09-12T01:56:48.079064+0000","last_became_peered":"2024-09-12T01:56:48.079064+0000","last_unstale":"2024-09-12T01:56:50.561350+0000","last_undegraded":"2024-09-12T01:56:50.561350+0000","last_fullsized":"2024-09-12T01:56:50.561350+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:41.416788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.090582+0000","last_change":"2024-09-12T01:56:49.094830+0000","last_active":"2024-09-12T01:56:50.090582+0000","last_peered":"2024-09-12T01:56:50.090582+0000","last_clean":"2024-09-12T01:56:50.090582+0000","last_became_active":"2024-09-12T01:56:49.094182+0000","last_became_peered":"2024-09-12T01:56:49.094182+0000","last_unstale":"2024-09-12T01:56:50.090582+0000","last_undegraded":"2024-09-12T01:56:50.090582+0000","last_fullsized":"2024-09-12T01:56:50.090582+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:28.228620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.098503+0000","last_change":"2024-09-12T01:56:48.080729+0000","last_active":"2024-09-12T01:56:50.098503+0000","last_peered":"2024-09-12T01:56:50.098503+0000","last_clean":"2024-09-12T01:56:50.098503+0000","last_became_active":"2024-09-12T01:56:48.079864+0000","last_became_peered":"2024-09-12T01:56:48.079864+0000","last_unstale":"2024-09-12T01:56:50.098503+0000","last_undegraded":"2024-09-12T01:56:50.098503+0000","last_fullsized":"2024-09-12T01:56:50.098503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:16.833049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920286+0000","last_change":"2024-09-12T01:56:49.096740+0000","last_active":"2024-09-12T01:56:50.920286+0000","last_peered":"2024-09-12T01:56:50.920286+0000","last_clean":"2024-09-12T01:56:50.920286+0000","last_became_active":"2024-09-12T01:56:49.096390+0000","last_became_peered":"2024-09-12T01:56:49.096390+0000","last_unstale":"2024-09-12T01:56:50.920286+0000","last_undegraded":"2024-09-12T01:56:50.920286+0000","last_fullsized":"2024-09-12T01:56:50.920286+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:08.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.101335+0000","last_change":"2024-09-12T01:56:48.086993+0000","last_active":"2024-09-12T01:56:50.101335+0000","last_peered":"2024-09-12T01:56:50.101335+0000","last_clean":"2024-09-12T01:56:50.101335+0000","last_became_active":"2024-09-12T01:56:48.086487+0000","last_became_peered":"2024-09-12T01:56:48.086487+0000","last_unstale":"2024-09-12T01:56:50.101335+0000","last_undegraded":"2024-09-12T01:56:50.101335+0000","last_fullsized":"2024-09-12T01:56:50.101335+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:10.954294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.561669+0000","last_change":"2024-09-12T01:56:49.093510+0000","last_active":"2024-09-12T01:56:50.561669+0000","last_peered":"2024-09-12T01:56:50.561669+0000","last_clean":"2024-09-12T01:56:50.561669+0000","last_became_active":"2024-09-12T01:56:49.092875+0000","last_became_peered":"2024-09-12T01:56:49.092875+0000","last_unstale":"2024-09-12T01:56:50.561669+0000","last_undegraded":"2024-09-12T01:56:50.561669+0000","last_fullsized":"2024-09-12T01:56:50.561669+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:39.587882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.098740+0000","last_change":"2024-09-12T01:56:48.086941+0000","last_active":"2024-09-12T01:56:50.098740+0000","last_peered":"2024-09-12T01:56:50.098740+0000","last_clean":"2024-09-12T01:56:50.098740+0000","last_became_active":"2024-09-12T01:56:48.086626+0000","last_became_peered":"2024-09-12T01:56:48.086626+0000","last_unstale":"2024-09-12T01:56:50.098740+0000","last_undegraded":"2024-09-12T01:56:50.098740+0000","last_fullsized":"2024-09-12T01:56:50.098740+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:56.351358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.090734+0000","last_change":"2024-09-12T01:56:49.091489+0000","last_active":"2024-09-12T01:56:50.090734+0000","last_peered":"2024-09-12T01:56:50.090734+0000","last_clean":"2024-09-12T01:56:50.090734+0000","last_became_active":"2024-09-12T01:56:49.091224+0000","last_became_peered":"2024-09-12T01:56:49.091224+0000","last_unstale":"2024-09-12T01:56:50.090734+0000","last_undegraded":"2024-09-12T01:56:50.090734+0000","last_fullsized":"2024-09-12T01:56:50.090734+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:09.083722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920259+0000","last_change":"2024-09-12T01:56:48.084372+0000","last_active":"2024-09-12T01:56:50.920259+0000","last_peered":"2024-09-12T01:56:50.920259+0000","last_clean":"2024-09-12T01:56:50.920259+0000","last_became_active":"2024-09-12T01:56:48.084012+0000","last_became_peered":"2024-09-12T01:56:48.084012+0000","last_unstale":"2024-09-12T01:56:50.920259+0000","last_undegraded":"2024-09-12T01:56:50.920259+0000","last_fullsized":"2024-09-12T01:56:50.920259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:21.610527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920305+0000","last_change":"2024-09-12T01:56:49.093173+0000","last_active":"2024-09-12T01:56:50.920305+0000","last_peered":"2024-09-12T01:56:50.920305+0000","last_clean":"2024-09-12T01:56:50.920305+0000","last_became_active":"2024-09-12T01:56:49.092867+0000","last_became_peered":"2024-09-12T01:56:49.092867+0000","last_unstale":"2024-09-12T01:56:50.920305+0000","last_undegraded":"2024-09-12T01:56:50.920305+0000","last_fullsized":"2024-09-12T01:56:50.920305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:30.650006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920571+0000","last_change":"2024-09-12T01:56:48.074045+0000","last_active":"2024-09-12T01:56:50.920571+0000","last_peered":"2024-09-12T01:56:50.920571+0000","last_clean":"2024-09-12T01:56:50.920571+0000","last_became_active":"2024-09-12T01:56:48.073680+0000","last_became_peered":"2024-09-12T01:56:48.073680+0000","last_unstale":"2024-09-12T01:56:50.920571+0000","last_undegraded":"2024-09-12T01:56:50.920571+0000","last_fullsized":"2024-09-12T01:56:50.920571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:22.472440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.920055+0000","last_change":"2024-09-12T01:56:49.101750+0000","last_active":"2024-09-12T01:56:50.920055+0000","last_peered":"2024-09-12T01:56:50.920055+0000","last_clean":"2024-09-12T01:56:50.920055+0000","last_became_active":"2024-09-12T01:56:49.101426+0000","last_became_peered":"2024-09-12T01:56:49.101426+0000","last_unstale":"2024-09-12T01:56:50.920055+0000","last_undegraded":"2024-09-12T01:56:50.920055+0000","last_fullsized":"2024-09-12T01:56:50.920055+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:27.454551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.089226+0000","last_change":"2024-09-12T01:56:48.076087+0000","last_active":"2024-09-12T01:56:50.089226+0000","last_peered":"2024-09-12T01:56:50.089226+0000","last_clean":"2024-09-12T01:56:50.089226+0000","last_became_active":"2024-09-12T01:56:48.075803+0000","last_became_peered":"2024-09-12T01:56:48.075803+0000","last_unstale":"2024-09-12T01:56:50.089226+0000","last_undegraded":"2024-09-12T01:56:50.089226+0000","last_fullsized":"2024-09-12T01:56:50.089226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:27.805990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.089238+0000","last_change":"2024-09-12T01:56:49.093307+0000","last_active":"2024-09-12T01:56:50.089238+0000","last_peered":"2024-09-12T01:56:50.089238+0000","last_clean":"2024-09-12T01:56:50.089238+0000","last_became_active":"2024-09-12T01:56:49.091006+0000","last_became_peered":"2024-09-12T01:56:49.091006+0000","last_unstale":"2024-09-12T01:56:50.089238+0000","last_undegraded":"2024-09-12T01:56:50.089238+0000","last_fullsized":"2024-09-12T01:56:50.089238+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:14.097085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.089439+0000","last_change":"2024-09-12T01:56:48.080547+0000","last_active":"2024-09-12T01:56:50.089439+0000","last_peered":"2024-09-12T01:56:50.089439+0000","last_clean":"2024-09-12T01:56:50.089439+0000","last_became_active":"2024-09-12T01:56:48.080094+0000","last_became_peered":"2024-09-12T01:56:48.080094+0000","last_unstale":"2024-09-12T01:56:50.089439+0000","last_undegraded":"2024-09-12T01:56:50.089439+0000","last_fullsized":"2024-09-12T01:56:50.089439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:19.434441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.561652+0000","last_change":"2024-09-12T01:56:49.091608+0000","last_active":"2024-09-12T01:56:50.561652+0000","last_peered":"2024-09-12T01:56:50.561652+0000","last_clean":"2024-09-12T01:56:50.561652+0000","last_became_active":"2024-09-12T01:56:49.090710+0000","last_became_peered":"2024-09-12T01:56:49.090710+0000","last_unstale":"2024-09-12T01:56:50.561652+0000","last_undegraded":"2024-09-12T01:56:50.561652+0000","last_fullsized":"2024-09-12T01:56:50.561652+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:24.581245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.090265+0000","last_change":"2024-09-12T01:56:48.086306+0000","last_active":"2024-09-12T01:56:50.090265+0000","last_peered":"2024-09-12T01:56:50.090265+0000","last_clean":"2024-09-12T01:56:50.090265+0000","last_became_active":"2024-09-12T01:56:48.085519+0000","last_became_peered":"2024-09-12T01:56:48.085519+0000","last_unstale":"2024-09-12T01:56:50.090265+0000","last_undegraded":"2024-09-12T01:56:50.090265+0000","last_fullsized":"2024-09-12T01:56:50.090265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:07.472303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.101170+0000","last_change":"2024-09-12T01:56:49.096214+0000","last_active":"2024-09-12T01:56:50.101170+0000","last_peered":"2024-09-12T01:56:50.101170+0000","last_clean":"2024-09-12T01:56:50.101170+0000","last_became_active":"2024-09-12T01:56:49.095889+0000","last_became_peered":"2024-09-12T01:56:49.095889+0000","last_unstale":"2024-09-12T01:56:50.101170+0000","last_undegraded":"2024-09-12T01:56:50.101170+0000","last_fullsized":"2024-09-12T01:56:50.101170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.061104+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.061104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:39.494295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.561501+0000","last_change":"2024-09-12T01:56:48.082804+0000","last_active":"2024-09-12T01:56:50.561501+0000","last_peered":"2024-09-12T01:56:50.561501+0000","last_clean":"2024-09-12T01:56:50.561501+0000","last_became_active":"2024-09-12T01:56:48.082323+0000","last_became_peered":"2024-09-12T01:56:48.082323+0000","last_unstale":"2024-09-12T01:56:50.561501+0000","last_undegraded":"2024-09-12T01:56:50.561501+0000","last_fullsized":"2024-09-12T01:56:50.561501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:47.056365+0000","last_clean_scrub_stamp":"2024-09-12T01:56:47.056365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:45.367043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":204,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-12T01:56:50.561247+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:56:50.561247+0000","last_peered":"2024-09-12T01:56:50.561247+0000","last_clean":"2024-09-12T01:56:50.561247+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:56:50.561247+0000","last_undegraded":"2024-09-12T01:56:50.561247+0000","last_fullsized":"2024-09-12T01:56:50.561247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1064960,"data_stored":789390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":197922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":462848,"data_stored":197452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":198986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":197410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":197430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1052672,"data_stored":787742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":462848,"data_stored":197944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:56:56.823 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:56:56.823 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T01:56:56.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.970+0000 7f86d43d6640 1 Processor -- start 2024-09-12T01:56:56.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.970+0000 7f86d43d6640 1 -- start start 2024-09-12T01:56:56.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.971+0000 7f86d43d6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f86cc0b5f80 0x7f86cc162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.971+0000 7f86d43d6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86cc0d4c10 0x7f86cc0b6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.971+0000 7f86d43d6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86cc0d2600 con 0x7f86cc0d3320 2024-09-12T01:56:56.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.971+0000 7f86d43d6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f86cc0d5420 con 0x7f86cc0b5f80 2024-09-12T01:56:56.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.971+0000 7f86d43d6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f86cc0d2e90 con 0x7f86cc0d4c10 2024-09-12T01:56:56.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.971+0000 7f86d1971640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86cc0d4c10 0x7f86cc0b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.971+0000 7f86d2172640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f86cc0b5f80 0x7f86cc162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.971+0000 7f86d1971640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86cc0d4c10 0x7f86cc0b6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:35892/0 (socket says 172.21.15.19:35892) 2024-09-12T01:56:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.971+0000 7f86d2973640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f86cc0d3320 0x7f86cc0ceb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:52248/0 (socket says 172.21.15.19:52248) 2024-09-12T01:56:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.971+0000 7f86d2172640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f86cc0b5f80 0x7f86cc162980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:45110/0 (socket says 172.21.15.19:45110) 2024-09-12T01:56:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.971+0000 7f86d1971640 1 -- 172.21.15.19:0/1694722139 learned_addr learned my addr 172.21.15.19:0/1694722139 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:56.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.971+0000 7f86d1971640 1 -- 172.21.15.19:0/1694722139 >> v2:172.21.15.135:3300/0 conn(0x7f86cc0b5f80 msgr2=0x7f86cc162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:56.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.971+0000 7f86d1971640 1 --2- 172.21.15.19:0/1694722139 >> v2:172.21.15.135:3300/0 conn(0x7f86cc0b5f80 0x7f86cc162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.971+0000 7f86d1971640 1 -- 172.21.15.19:0/1694722139 >> v1:172.21.15.135:6789/0 conn(0x7f86cc0d3320 legacy=0x7f86cc0ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.971+0000 7f86d1971640 1 -- 172.21.15.19:0/1694722139 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86cc0b3c10 con 0x7f86cc0d4c10 2024-09-12T01:56:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.972+0000 7f86d1971640 1 --2- 172.21.15.19:0/1694722139 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86cc0d4c10 0x7f86cc0b6360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009870 tx=0x7f86bc02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2fcf843302dd7bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.972+0000 7f86d1170640 1 -- 172.21.15.19:0/1694722139 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc037070 con 0x7f86cc0d4c10 2024-09-12T01:56:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.972+0000 7f86d1170640 1 -- 172.21.15.19:0/1694722139 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86bc032440 con 0x7f86cc0d4c10 2024-09-12T01:56:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.972+0000 7f86d1170640 1 -- 172.21.15.19:0/1694722139 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc032810 con 0x7f86cc0d4c10 2024-09-12T01:56:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.973+0000 7f86d43d6640 1 -- 172.21.15.19:0/1694722139 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86cc0d4c10 msgr2=0x7f86cc0b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.973+0000 7f86d43d6640 1 --2- 172.21.15.19:0/1694722139 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86cc0d4c10 0x7f86cc0b6360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009870 tx=0x7f86bc02a270 comp rx=0 tx=0).stop 2024-09-12T01:56:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.973+0000 7f86d43d6640 1 -- 172.21.15.19:0/1694722139 shutdown_connections 2024-09-12T01:56:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.973+0000 7f86d43d6640 1 --2- 172.21.15.19:0/1694722139 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86cc0d4c10 0x7f86cc0b6360 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.973+0000 7f86d43d6640 1 --2- 172.21.15.19:0/1694722139 >> v2:172.21.15.135:3300/0 conn(0x7f86cc0b5f80 0x7f86cc162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.973+0000 7f86d43d6640 1 -- 172.21.15.19:0/1694722139 >> 172.21.15.19:0/1694722139 conn(0x7f86cc08bfc0 msgr2=0x7f86cc0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.973+0000 7f86d43d6640 1 -- 172.21.15.19:0/1694722139 shutdown_connections 2024-09-12T01:56:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.973+0000 7f86d43d6640 1 -- 172.21.15.19:0/1694722139 wait complete. 2024-09-12T01:56:56.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.974+0000 7f86d43d6640 1 Processor -- start 2024-09-12T01:56:56.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.974+0000 7f86d43d6640 1 -- start start 2024-09-12T01:56:56.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.975+0000 7f86d43d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86cc0b5f80 0x7f86cc156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.975+0000 7f86d43d6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86cc0d3320 0x7f86cc15bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.975+0000 7f86d43d6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86cc0d4c10 0x7f86cc15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.975+0000 7f86d43d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc0d5140 con 0x7f86cc0b5f80 2024-09-12T01:56:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.975+0000 7f86d43d6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc0d2880 con 0x7f86cc0d4c10 2024-09-12T01:56:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.975+0000 7f86d43d6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f86cc0d2b20 con 0x7f86cc0d3320 2024-09-12T01:56:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.975+0000 7f86d2172640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86cc0b5f80 0x7f86cc156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.975+0000 7f86d2172640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86cc0b5f80 0x7f86cc156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53122/0 (socket says 172.21.15.19:53122) 2024-09-12T01:56:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.975+0000 7f86d2172640 1 -- 172.21.15.19:0/626370257 learned_addr learned my addr 172.21.15.19:0/626370257 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.975+0000 7f86d2973640 1 --2- 172.21.15.19:0/626370257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86cc0d4c10 0x7f86cc15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.975+0000 7f86d1971640 1 --2- 172.21.15.19:0/626370257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86cc0d3320 0x7f86cc15bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.975+0000 7f86d2172640 1 -- 172.21.15.19:0/626370257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86cc0d3320 msgr2=0x7f86cc15bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.975+0000 7f86d2172640 1 --2- 172.21.15.19:0/626370257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86cc0d3320 0x7f86cc15bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.975+0000 7f86d2172640 1 -- 172.21.15.19:0/626370257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86cc0d4c10 msgr2=0x7f86cc15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.975+0000 7f86d2172640 1 --2- 172.21.15.19:0/626370257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86cc0d4c10 0x7f86cc15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.975+0000 7f86d2172640 1 -- 172.21.15.19:0/626370257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86cc0c8e20 con 0x7f86cc0b5f80 2024-09-12T01:56:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.976+0000 7f86d2172640 1 --2- 172.21.15.19:0/626370257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86cc0b5f80 0x7f86cc156570 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f86c800e9b0 tx=0x7f86c800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.976+0000 7f86c2ffd640 1 -- 172.21.15.19:0/626370257 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c8017070 con 0x7f86cc0b5f80 2024-09-12T01:56:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.976+0000 7f86c2ffd640 1 -- 172.21.15.19:0/626370257 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c800c9a0 con 0x7f86cc0b5f80 2024-09-12T01:56:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.976+0000 7f86d43d6640 1 -- 172.21.15.19:0/626370257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86cc0b1150 con 0x7f86cc0b5f80 2024-09-12T01:56:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.976+0000 7f86c2ffd640 1 -- 172.21.15.19:0/626370257 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c800cd90 con 0x7f86cc0b5f80 2024-09-12T01:56:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.976+0000 7f86d43d6640 1 -- 172.21.15.19:0/626370257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86cc0b1710 con 0x7f86cc0b5f80 2024-09-12T01:56:56.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.977+0000 7f86d43d6640 1 -- 172.21.15.19:0/626370257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86cc0b6360 con 0x7f86cc0b5f80 2024-09-12T01:56:56.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.977+0000 7f86c2ffd640 1 -- 172.21.15.19:0/626370257 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f86c801a070 con 0x7f86cc0b5f80 2024-09-12T01:56:56.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.978+0000 7f86c2ffd640 1 --2- 172.21.15.19:0/626370257 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f86b006be30 0x7f86b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.978+0000 7f86c2ffd640 1 -- 172.21.15.19:0/626370257 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f86c808b340 con 0x7f86cc0b5f80 2024-09-12T01:56:56.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.978+0000 7f86d1971640 1 --2- 172.21.15.19:0/626370257 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f86b006be30 0x7f86b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.979+0000 7f86d1971640 1 --2- 172.21.15.19:0/626370257 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f86b006be30 0x7f86b006e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f86bc034000 tx=0x7f86bc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:56.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:56.983+0000 7f86c2ffd640 1 -- 172.21.15.19:0/626370257 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f86c8059510 con 0x7f86cc0b5f80 2024-09-12T01:56:57.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.228+0000 7f86d43d6640 1 -- 172.21.15.19:0/626370257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f86cc0b42a0 con 0x7f86cc0b5f80 2024-09-12T01:56:57.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.230+0000 7f86c2ffd640 1 -- 172.21.15.19:0/626370257 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f86c805d810 con 0x7f86cc0b5f80 2024-09-12T01:56:57.230 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-09-12T01:56:57.230 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDwSeJmfHbXIRAALAvdYAlaB6WxWtubFnlxRw== 2024-09-12T01:56:57.230 INFO:teuthology.orchestra.run.smithi019.stdout: caps mds = "allow" 2024-09-12T01:56:57.230 INFO:teuthology.orchestra.run.smithi019.stdout: caps mon = "allow r" 2024-09-12T01:56:57.230 INFO:teuthology.orchestra.run.smithi019.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T01:56:57.230 INFO:teuthology.orchestra.run.smithi019.stderr:updated caps for client.0 2024-09-12T01:56:57.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.232+0000 7f86d43d6640 1 -- 172.21.15.19:0/626370257 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f86b006be30 msgr2=0x7f86b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:57.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.232+0000 7f86d43d6640 1 --2- 172.21.15.19:0/626370257 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f86b006be30 0x7f86b006e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f86bc034000 tx=0x7f86bc02e000 comp rx=0 tx=0).stop 2024-09-12T01:56:57.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.232+0000 7f86d43d6640 1 -- 172.21.15.19:0/626370257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86cc0b5f80 msgr2=0x7f86cc156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:57.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.232+0000 7f86d43d6640 1 --2- 172.21.15.19:0/626370257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86cc0b5f80 0x7f86cc156570 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f86c800e9b0 tx=0x7f86c800ee70 comp rx=0 tx=0).stop 2024-09-12T01:56:57.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.232+0000 7f86d43d6640 1 -- 172.21.15.19:0/626370257 shutdown_connections 2024-09-12T01:56:57.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.232+0000 7f86d43d6640 1 --2- 172.21.15.19:0/626370257 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f86b006be30 0x7f86b006e2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.232+0000 7f86d43d6640 1 --2- 172.21.15.19:0/626370257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86cc0d4c10 0x7f86cc15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.232+0000 7f86d43d6640 1 --2- 172.21.15.19:0/626370257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86cc0d3320 0x7f86cc15bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.232+0000 7f86d43d6640 1 --2- 172.21.15.19:0/626370257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86cc0b5f80 0x7f86cc156570 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.232+0000 7f86d43d6640 1 -- 172.21.15.19:0/626370257 >> 172.21.15.19:0/626370257 conn(0x7f86cc08bfc0 msgr2=0x7f86cc15ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:57.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.232+0000 7f86d43d6640 1 -- 172.21.15.19:0/626370257 shutdown_connections 2024-09-12T01:56:57.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.232+0000 7f86d43d6640 1 -- 172.21.15.19:0/626370257 wait complete. 2024-09-12T01:56:57.243 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:56:57.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.345+0000 7f708b198640 1 Processor -- start 2024-09-12T01:56:57.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.345+0000 7f708b198640 1 -- start start 2024-09-12T01:56:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.346+0000 7f708b198640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f708415e760 0x7f708406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.346+0000 7f708b198640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f70840d4fd0 0x7f70840cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.346+0000 7f708b198640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70840d2700 con 0x7f70840b3650 2024-09-12T01:56:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.346+0000 7f708b198640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f70840cedb0 con 0x7f70840d4fd0 2024-09-12T01:56:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.346+0000 7f708b198640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f70840cf090 con 0x7f708415e760 2024-09-12T01:56:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.346+0000 7f7083fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f70840d4fd0 0x7f70840cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.346+0000 7f7089735640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f70840b3650 0x7f70840d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43840/0 (socket says 172.21.15.19:43840) 2024-09-12T01:56:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.346+0000 7f7089735640 1 -- 172.21.15.19:0/1516244168 learned_addr learned my addr 172.21.15.19:0/1516244168 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.346+0000 7f7088f34640 1 --2- 172.21.15.19:0/1516244168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f708415e760 0x7f708406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.346+0000 7f7083fff640 1 -- 172.21.15.19:0/1516244168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f708415e760 msgr2=0x7f708406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.346+0000 7f7083fff640 1 --2- 172.21.15.19:0/1516244168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f708415e760 0x7f708406cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.346+0000 7f7083fff640 1 -- 172.21.15.19:0/1516244168 >> v1:172.21.15.19:6789/0 conn(0x7f70840b3650 legacy=0x7f70840d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:57.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.346+0000 7f7083fff640 1 -- 172.21.15.19:0/1516244168 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70840b3c80 con 0x7f70840d4fd0 2024-09-12T01:56:57.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.346+0000 7f70837fe640 1 -- 172.21.15.19:0/1516244168 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4022650384 0 0) 0x7f707c001490 con 0x7f70840b3650 2024-09-12T01:56:57.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.347+0000 7f7083fff640 1 --2- 172.21.15.19:0/1516244168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70840d4fd0 0x7f70840cf5b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7070009790 tx=0x7f707002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2deb571ab3d5291 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:57.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.347+0000 7f70837fe640 1 -- 172.21.15.19:0/1516244168 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070037070 con 0x7f70840d4fd0 2024-09-12T01:56:57.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.347+0000 7f70837fe640 1 -- 172.21.15.19:0/1516244168 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f707002ae50 con 0x7f70840d4fd0 2024-09-12T01:56:57.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.347+0000 7f70837fe640 1 -- 172.21.15.19:0/1516244168 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070032660 con 0x7f70840d4fd0 2024-09-12T01:56:57.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.348+0000 7f708b198640 1 -- 172.21.15.19:0/1516244168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70840d4fd0 msgr2=0x7f70840cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:57.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.348+0000 7f708b198640 1 --2- 172.21.15.19:0/1516244168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70840d4fd0 0x7f70840cf5b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7070009790 tx=0x7f707002a100 comp rx=0 tx=0).stop 2024-09-12T01:56:57.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.348+0000 7f708b198640 1 -- 172.21.15.19:0/1516244168 shutdown_connections 2024-09-12T01:56:57.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.348+0000 7f708b198640 1 --2- 172.21.15.19:0/1516244168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70840d4fd0 0x7f70840cf5b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.348+0000 7f708b198640 1 --2- 172.21.15.19:0/1516244168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f708415e760 0x7f708406cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.348+0000 7f708b198640 1 -- 172.21.15.19:0/1516244168 >> 172.21.15.19:0/1516244168 conn(0x7f708408bfc0 msgr2=0x7f70840d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:57.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.348+0000 7f708b198640 1 -- 172.21.15.19:0/1516244168 shutdown_connections 2024-09-12T01:56:57.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.348+0000 7f708b198640 1 -- 172.21.15.19:0/1516244168 wait complete. 2024-09-12T01:56:57.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.349+0000 7f708b198640 1 Processor -- start 2024-09-12T01:56:57.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.349+0000 7f708b198640 1 -- start start 2024-09-12T01:56:57.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.350+0000 7f708b198640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70840b3650 0x7f7084156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:57.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.350+0000 7f708b198640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70840d4fd0 0x7f70840b9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:57.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.350+0000 7f708b198640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f708415e760 0x7f708415eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:57.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.350+0000 7f708b198640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f70840cfe80 con 0x7f70840b3650 2024-09-12T01:56:57.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.350+0000 7f708b198640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70840cfd00 con 0x7f70840d4fd0 2024-09-12T01:56:57.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.350+0000 7f708b198640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f70840d35b0 con 0x7f708415e760 2024-09-12T01:56:57.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.350+0000 7f7088f34640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70840b3650 0x7f7084156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:57.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.350+0000 7f7088f34640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70840b3650 0x7f7084156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53146/0 (socket says 172.21.15.19:53146) 2024-09-12T01:56:57.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.350+0000 7f7088f34640 1 -- 172.21.15.19:0/1190453607 learned_addr learned my addr 172.21.15.19:0/1190453607 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:57.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.350+0000 7f7089735640 1 --2- 172.21.15.19:0/1190453607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f708415e760 0x7f708415eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.350+0000 7f7083fff640 1 --2- 172.21.15.19:0/1190453607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70840d4fd0 0x7f70840b9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.350+0000 7f7088f34640 1 -- 172.21.15.19:0/1190453607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f708415e760 msgr2=0x7f708415eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.350+0000 7f7088f34640 1 --2- 172.21.15.19:0/1190453607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f708415e760 0x7f708415eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.350+0000 7f7088f34640 1 -- 172.21.15.19:0/1190453607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70840d4fd0 msgr2=0x7f70840b9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.350+0000 7f7088f34640 1 --2- 172.21.15.19:0/1190453607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70840d4fd0 0x7f70840b9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.350+0000 7f7088f34640 1 -- 172.21.15.19:0/1190453607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7084160c70 con 0x7f70840b3650 2024-09-12T01:56:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.350+0000 7f7083fff640 1 --2- 172.21.15.19:0/1190453607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70840d4fd0 0x7f70840b9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.351+0000 7f7088f34640 1 --2- 172.21.15.19:0/1190453607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70840b3650 0x7f7084156ba0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f707800d5f0 tx=0x7f707800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.351+0000 7f70817fa640 1 -- 172.21.15.19:0/1190453607 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70780125f0 con 0x7f70840b3650 2024-09-12T01:56:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.351+0000 7f70817fa640 1 -- 172.21.15.19:0/1190453607 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7078019070 con 0x7f70840b3650 2024-09-12T01:56:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.351+0000 7f708b198640 1 -- 172.21.15.19:0/1190453607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7084160f50 con 0x7f70840b3650 2024-09-12T01:56:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.351+0000 7f70817fa640 1 -- 172.21.15.19:0/1190453607 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70780129d0 con 0x7f70840b3650 2024-09-12T01:56:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.351+0000 7f708b198640 1 -- 172.21.15.19:0/1190453607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70840b7500 con 0x7f70840b3650 2024-09-12T01:56:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.352+0000 7f708b198640 1 -- 172.21.15.19:0/1190453607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70840d3980 con 0x7f70840b3650 2024-09-12T01:56:57.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.352+0000 7f70817fa640 1 -- 172.21.15.19:0/1190453607 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7078012b70 con 0x7f70840b3650 2024-09-12T01:56:57.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.353+0000 7f70817fa640 1 --2- 172.21.15.19:0/1190453607 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f706806be30 0x7f706806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:57.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.353+0000 7f70817fa640 1 -- 172.21.15.19:0/1190453607 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f707808b3a0 con 0x7f70840b3650 2024-09-12T01:56:57.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.353+0000 7f7083fff640 1 --2- 172.21.15.19:0/1190453607 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f706806be30 0x7f706806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:57.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.354+0000 7f7083fff640 1 --2- 172.21.15.19:0/1190453607 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f706806be30 0x7f706806e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7070034000 tx=0x7f707002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:57.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.357+0000 7f70817fa640 1 -- 172.21.15.19:0/1190453607 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7078059bc0 con 0x7f70840b3650 2024-09-12T01:56:57.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.567+0000 7f708b198640 1 -- 172.21.15.19:0/1190453607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70840b6d20 con 0x7f70840b3650 2024-09-12T01:56:57.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.568+0000 7f70817fa640 1 -- 172.21.15.19:0/1190453607 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5226 (secure 0 0 0) 0x7f70780594c0 con 0x7f70840b3650 2024-09-12T01:56:57.568 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:56:57.568 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":15,"btime":"2024-09-12T01:56:51:094820+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1979542220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1979542220},{"type":"v1","addr":"172.21.15.135:6836","nonce":1979542220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/809710386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":809710386},{"type":"v1","addr":"172.21.15.19:6835","nonce":809710386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1005776280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1005776280},{"type":"v1","addr":"172.21.15.135:6837","nonce":1005776280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:56:48.431829+0000","modified":"2024-09-12T01:56:50.440044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4822},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4822":{"gid":4822,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6834/1994815169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1994815169},{"type":"v1","addr":"172.21.15.19:6834","nonce":1994815169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4822,"qdb_cluster":[4822]},"id":2}]} 2024-09-12T01:56:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 15 2024-09-12T01:56:57.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.570+0000 7f708b198640 1 -- 172.21.15.19:0/1190453607 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f706806be30 msgr2=0x7f706806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.570+0000 7f708b198640 1 --2- 172.21.15.19:0/1190453607 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f706806be30 0x7f706806e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7070034000 tx=0x7f707002e000 comp rx=0 tx=0).stop 2024-09-12T01:56:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.570+0000 7f708b198640 1 -- 172.21.15.19:0/1190453607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70840b3650 msgr2=0x7f7084156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.570+0000 7f708b198640 1 --2- 172.21.15.19:0/1190453607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70840b3650 0x7f7084156ba0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f707800d5f0 tx=0x7f707800dab0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.570+0000 7f708b198640 1 -- 172.21.15.19:0/1190453607 shutdown_connections 2024-09-12T01:56:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.570+0000 7f708b198640 1 --2- 172.21.15.19:0/1190453607 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f706806be30 0x7f706806e2f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.570+0000 7f708b198640 1 --2- 172.21.15.19:0/1190453607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f708415e760 0x7f708415eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.570+0000 7f708b198640 1 --2- 172.21.15.19:0/1190453607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70840d4fd0 0x7f70840b9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.570+0000 7f708b198640 1 --2- 172.21.15.19:0/1190453607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70840b3650 0x7f7084156ba0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.570+0000 7f708b198640 1 -- 172.21.15.19:0/1190453607 >> 172.21.15.19:0/1190453607 conn(0x7f708408bfc0 msgr2=0x7f70840d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.570+0000 7f708b198640 1 -- 172.21.15.19:0/1190453607 shutdown_connections 2024-09-12T01:56:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:57.570+0000 7f708b198640 1 -- 172.21.15.19:0/1190453607 wait complete. 2024-09-12T01:56:57.985 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:56:48.431829+0000', 'modified': '2024-09-12T01:56:50.440044+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4822}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4822': {'gid': 4822, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.19:6834/1994815169', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 1994815169}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 1994815169}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4822, 'qdb_cluster': [4822]} 2024-09-12T01:56:57.985 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:56:57.985 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T01:56:58.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.092+0000 7f2eaaa42640 1 Processor -- start 2024-09-12T01:56:58.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.092+0000 7f2eaaa42640 1 -- start start 2024-09-12T01:56:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.093+0000 7f2eaaa42640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2ea415c520 0x7f2ea409b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.093+0000 7f2eaaa42640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea40b1620 0x7f2ea40b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.093+0000 7f2eaaa42640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea40cec00 con 0x7f2ea40d0980 2024-09-12T01:56:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.093+0000 7f2eaaa42640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea409bd90 con 0x7f2ea415c520 2024-09-12T01:56:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.093+0000 7f2eaaa42640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea40d0010 con 0x7f2ea40b1620 2024-09-12T01:56:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.093+0000 7f2ea3fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2ea415c520 0x7f2ea409b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.093+0000 7f2ea8fdf640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2ea40d0980 0x7f2ea40cd570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43850/0 (socket says 172.21.15.19:43850) 2024-09-12T01:56:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.093+0000 7f2ea8fdf640 1 -- 172.21.15.19:0/1837512276 learned_addr learned my addr 172.21.15.19:0/1837512276 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.093+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/1837512276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea40b1620 0x7f2ea40b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.093+0000 7f2ea3fff640 1 -- 172.21.15.19:0/1837512276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea40b1620 msgr2=0x7f2ea40b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:58.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.093+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/1837512276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea40b1620 0x7f2ea40b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.093+0000 7f2ea3fff640 1 -- 172.21.15.19:0/1837512276 >> v1:172.21.15.19:6789/0 conn(0x7f2ea40d0980 legacy=0x7f2ea40cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.093+0000 7f2ea3fff640 1 -- 172.21.15.19:0/1837512276 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea40d02f0 con 0x7f2ea415c520 2024-09-12T01:56:58.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.093+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/1837512276 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3978242075 0 0) 0x7f2ea40cec00 con 0x7f2ea40d0980 2024-09-12T01:56:58.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.094+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/1837512276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea415c520 0x7f2ea409b720 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2e940097a0 tx=0x7f2e9402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e55b6fe01a358d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:58.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.094+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/1837512276 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94037070 con 0x7f2ea415c520 2024-09-12T01:56:58.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.094+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/1837512276 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e94032440 con 0x7f2ea415c520 2024-09-12T01:56:58.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.094+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/1837512276 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94032810 con 0x7f2ea415c520 2024-09-12T01:56:58.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.095+0000 7f2eaaa42640 1 -- 172.21.15.19:0/1837512276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea415c520 msgr2=0x7f2ea409b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.095+0000 7f2eaaa42640 1 --2- 172.21.15.19:0/1837512276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea415c520 0x7f2ea409b720 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2e940097a0 tx=0x7f2e9402a180 comp rx=0 tx=0).stop 2024-09-12T01:56:58.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.095+0000 7f2eaaa42640 1 -- 172.21.15.19:0/1837512276 shutdown_connections 2024-09-12T01:56:58.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.095+0000 7f2eaaa42640 1 --2- 172.21.15.19:0/1837512276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea40b1620 0x7f2ea40b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.095+0000 7f2eaaa42640 1 --2- 172.21.15.19:0/1837512276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea415c520 0x7f2ea409b720 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.095+0000 7f2eaaa42640 1 -- 172.21.15.19:0/1837512276 >> 172.21.15.19:0/1837512276 conn(0x7f2ea40d23a0 msgr2=0x7f2ea40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:58.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.095+0000 7f2eaaa42640 1 -- 172.21.15.19:0/1837512276 shutdown_connections 2024-09-12T01:56:58.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.095+0000 7f2eaaa42640 1 -- 172.21.15.19:0/1837512276 wait complete. 2024-09-12T01:56:58.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.096+0000 7f2eaaa42640 1 Processor -- start 2024-09-12T01:56:58.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.096+0000 7f2eaaa42640 1 -- start start 2024-09-12T01:56:58.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.097+0000 7f2eaaa42640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea40b1620 0x7f2ea415ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.097+0000 7f2eaaa42640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea40d0980 0x7f2ea40b7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.097+0000 7f2eaaa42640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea415c520 0x7f2ea40b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.097+0000 7f2eaaa42640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea415c900 con 0x7f2ea40d0980 2024-09-12T01:56:58.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.097+0000 7f2eaaa42640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea40d05d0 con 0x7f2ea40b1620 2024-09-12T01:56:58.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.097+0000 7f2eaaa42640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea415b0b0 con 0x7f2ea415c520 2024-09-12T01:56:58.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.097+0000 7f2ea37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea40d0980 0x7f2ea40b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.097+0000 7f2ea37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea40d0980 0x7f2ea40b7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53176/0 (socket says 172.21.15.19:53176) 2024-09-12T01:56:58.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.097+0000 7f2ea37fe640 1 -- 172.21.15.19:0/2155985234 learned_addr learned my addr 172.21.15.19:0/2155985234 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:58.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.097+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/2155985234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea40b1620 0x7f2ea415ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.097+0000 7f2ea8fdf640 1 --2- 172.21.15.19:0/2155985234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea415c520 0x7f2ea40b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.097+0000 7f2ea37fe640 1 -- 172.21.15.19:0/2155985234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea415c520 msgr2=0x7f2ea40b7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.097+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/2155985234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea415c520 0x7f2ea40b7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.097+0000 7f2ea37fe640 1 -- 172.21.15.19:0/2155985234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea40b1620 msgr2=0x7f2ea415ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.097+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/2155985234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea40b1620 0x7f2ea415ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.097+0000 7f2ea37fe640 1 -- 172.21.15.19:0/2155985234 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea41f3630 con 0x7f2ea40d0980 2024-09-12T01:56:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.097+0000 7f2ea8fdf640 1 --2- 172.21.15.19:0/2155985234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea415c520 0x7f2ea40b7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.098+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/2155985234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea40d0980 0x7f2ea40b7450 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800e9b0 tx=0x7f2e9800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.098+0000 7f2ea0ff9640 1 -- 172.21.15.19:0/2155985234 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98017070 con 0x7f2ea40d0980 2024-09-12T01:56:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.098+0000 7f2ea0ff9640 1 -- 172.21.15.19:0/2155985234 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9800c9a0 con 0x7f2ea40d0980 2024-09-12T01:56:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.098+0000 7f2ea0ff9640 1 -- 172.21.15.19:0/2155985234 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9800cd90 con 0x7f2ea40d0980 2024-09-12T01:56:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.098+0000 7f2eaaa42640 1 -- 172.21.15.19:0/2155985234 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea41f2ab0 con 0x7f2ea40d0980 2024-09-12T01:56:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.098+0000 7f2eaaa42640 1 -- 172.21.15.19:0/2155985234 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea41f3070 con 0x7f2ea40d0980 2024-09-12T01:56:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.099+0000 7f2ea0ff9640 1 -- 172.21.15.19:0/2155985234 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e9801a070 con 0x7f2ea40d0980 2024-09-12T01:56:58.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.100+0000 7f2ea0ff9640 1 --2- 172.21.15.19:0/2155985234 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e9006be30 0x7f2e9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.100+0000 7f2ea0ff9640 1 -- 172.21.15.19:0/2155985234 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f2e9808b370 con 0x7f2ea40d0980 2024-09-12T01:56:58.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.100+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/2155985234 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e9006be30 0x7f2e9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.101+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/2155985234 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e9006be30 0x7f2e9006e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2e94034000 tx=0x7f2e9402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:58.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.101+0000 7f2ead7d1740 1 Processor -- start 2024-09-12T01:56:58.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.101+0000 7f2ead7d1740 1 -- start start 2024-09-12T01:56:58.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2ead7d1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a22c0 0x55a60a3e7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2ead7d1740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a39fa80 0x55a60a3a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2ead7d1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3a3a50 0x55a60a39c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2ead7d1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a60a304520 con 0x55a60a3a22c0 2024-09-12T01:56:58.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2ead7d1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a60a2ac3e0 con 0x55a60a3a3a50 2024-09-12T01:56:58.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2ead7d1740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55a60a3004e0 con 0x55a60a39fa80 2024-09-12T01:56:58.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2ea3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a22c0 0x55a60a3e7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2ea3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a22c0 0x55a60a3e7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53188/0 (socket says 172.21.15.19:53188) 2024-09-12T01:56:58.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2ea3fff640 1 -- 172.21.15.19:0/1929898357 learned_addr learned my addr 172.21.15.19:0/1929898357 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:58.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/1929898357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a39fa80 0x55a60a3a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2ea8fdf640 1 --2- 172.21.15.19:0/1929898357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3a3a50 0x55a60a39c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2ea3fff640 1 -- 172.21.15.19:0/1929898357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a39fa80 msgr2=0x55a60a3a26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:58.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/1929898357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a39fa80 0x55a60a3a26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2ea3fff640 1 -- 172.21.15.19:0/1929898357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3a3a50 msgr2=0x55a60a39c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:58.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/1929898357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3a3a50 0x55a60a39c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2ea3fff640 1 -- 172.21.15.19:0/1929898357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a60a2c72f0 con 0x55a60a3a22c0 2024-09-12T01:56:58.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2ea8fdf640 1 --2- 172.21.15.19:0/1929898357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3a3a50 0x55a60a39c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:58.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/1929898357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a22c0 0x55a60a3e7a60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2e94035040 tx=0x7f2e9402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1d606cb4d6135c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:58.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2e89ffb640 1 -- 172.21.15.19:0/1929898357 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9404f070 con 0x55a60a3a22c0 2024-09-12T01:56:58.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2e89ffb640 1 -- 172.21.15.19:0/1929898357 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e94038040 con 0x55a60a3a22c0 2024-09-12T01:56:58.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.102+0000 7f2e89ffb640 1 -- 172.21.15.19:0/1929898357 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94037050 con 0x55a60a3a22c0 2024-09-12T01:56:58.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.103+0000 7f2ead7d1740 1 -- 172.21.15.19:0/1929898357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a22c0 msgr2=0x55a60a3e7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.103+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/1929898357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a22c0 0x55a60a3e7a60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2e94035040 tx=0x7f2e9402c000 comp rx=0 tx=0).stop 2024-09-12T01:56:58.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.103+0000 7f2ead7d1740 1 -- 172.21.15.19:0/1929898357 shutdown_connections 2024-09-12T01:56:58.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.103+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/1929898357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3a3a50 0x55a60a39c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.103+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/1929898357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a39fa80 0x55a60a3a26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.103+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/1929898357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a22c0 0x55a60a3e7a60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.103+0000 7f2ead7d1740 1 -- 172.21.15.19:0/1929898357 >> 172.21.15.19:0/1929898357 conn(0x55a60a39ea80 msgr2=0x55a60a3e6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:58.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.103+0000 7f2ead7d1740 1 -- 172.21.15.19:0/1929898357 shutdown_connections 2024-09-12T01:56:58.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.103+0000 7f2ead7d1740 1 -- 172.21.15.19:0/1929898357 wait complete. 2024-09-12T01:56:58.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.104+0000 7f2ead7d1740 1 -- start start 2024-09-12T01:56:58.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.104+0000 7f2ead7d1740 1 Processor -- start 2024-09-12T01:56:58.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ead7d1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a22c0 0x55a60a3cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ead7d1740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a3a3a50 0x55a60a3c04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ead7d1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3c0ca0 0x55a60a3a0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ead7d1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a60a39df20 con 0x55a60a3a22c0 2024-09-12T01:56:58.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ead7d1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a60a28d450 con 0x55a60a3c0ca0 2024-09-12T01:56:58.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ead7d1740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55a60a3e8290 con 0x55a60a3a3a50 2024-09-12T01:56:58.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ead7d1740 10 client.0 _ll_register_callbacks cb 0x55a60a016ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:56:58.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ea3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a22c0 0x55a60a3cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ea3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a22c0 0x55a60a3cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53192/0 (socket says 172.21.15.19:53192) 2024-09-12T01:56:58.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ea3fff640 1 -- 172.21.15.19:0/171025246 learned_addr learned my addr 172.21.15.19:0/171025246 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:58.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/171025246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a3a3a50 0x55a60a3c04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ea8fdf640 1 --2- 172.21.15.19:0/171025246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3c0ca0 0x55a60a3a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ea3fff640 1 -- 172.21.15.19:0/171025246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a3a3a50 msgr2=0x55a60a3c04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:58.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/171025246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a3a3a50 0x55a60a3c04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ea3fff640 1 -- 172.21.15.19:0/171025246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3c0ca0 msgr2=0x55a60a3a0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:58.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/171025246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3c0ca0 0x55a60a3a0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ea3fff640 1 -- 172.21.15.19:0/171025246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a60a0172d0 con 0x55a60a3a22c0 2024-09-12T01:56:58.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ea8fdf640 1 --2- 172.21.15.19:0/171025246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3c0ca0 0x55a60a3a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:58.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/171025246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a22c0 0x55a60a3cc9c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2e9402a770 tx=0x7f2e94004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30da42fecf60901f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:58.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2e82ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:56:58.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2e82ffd640 1 -- 172.21.15.19:0/171025246 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9404f070 con 0x55a60a3a22c0 2024-09-12T01:56:58.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2e82ffd640 1 -- 172.21.15.19:0/171025246 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f2e94054c50 con 0x55a60a3a22c0 2024-09-12T01:56:58.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.105+0000 7f2ead7d1740 1 -- 172.21.15.19:0/171025246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e94038040 con 0x55a60a3a22c0 2024-09-12T01:56:58.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.106+0000 7f2e82ffd640 1 -- 172.21.15.19:0/171025246 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f2e9405b050 con 0x55a60a3a22c0 2024-09-12T01:56:58.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.106+0000 7f2ead7d1740 10 client.5049 fetch_fsmap learned FSMap version 15 2024-09-12T01:56:58.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.106+0000 7f2ead7d1740 1 -- 172.21.15.19:0/171025246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55a60a0e16b0 con 0x55a60a3a22c0 2024-09-12T01:56:58.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.106+0000 7f2e82ffd640 1 -- 172.21.15.19:0/171025246 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e94038040 con 0x55a60a3a22c0 2024-09-12T01:56:58.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.106+0000 7f2e82ffd640 1 -- 172.21.15.19:0/171025246 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7f2e9405e020 con 0x55a60a3a22c0 2024-09-12T01:56:58.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.106+0000 7f2ead7d1740 10 client.5049 fetch_fsmap finished waiting for FSMap version 15 2024-09-12T01:56:58.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.106+0000 7f2ead7d1740 10 client.5049 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T01:56:58.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.106+0000 7f2ead7d1740 20 client.5049 populate_metadata read hostname 'smithi019' 2024-09-12T01:56:58.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.106+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/171025246 >> [v2:172.21.15.19:6832/1994815169,v1:172.21.15.19:6834/1994815169] conn(0x55a60a3c1630 0x55a60a3c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.106+0000 7f2ead7d1740 4 client.5049 mds_command: new command op to 4822 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:56:58.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.106+0000 7f2ead7d1740 1 -- 172.21.15.19:0/171025246 --> [v2:172.21.15.19:6832/1994815169,v1:172.21.15.19:6834/1994815169] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a60a311c50 con 0x55a60a3c1630 2024-09-12T01:56:58.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.106+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/171025246 >> [v2:172.21.15.19:6832/1994815169,v1:172.21.15.19:6834/1994815169] conn(0x55a60a3c1630 0x55a60a3c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.106+0000 7f2e82ffd640 10 client.5049 ms_handle_connect on v2:172.21.15.19:6832/1994815169 2024-09-12T01:56:58.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.106+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/171025246 >> [v2:172.21.15.19:6832/1994815169,v1:172.21.15.19:6834/1994815169] conn(0x55a60a3c1630 0x55a60a3c1a10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2a9034fc18ffba4 server_cookie=507ff18dbd989492 in_seq=0 out_seq=0 2024-09-12T01:56:58.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.107+0000 7f2e82ffd640 1 -- 172.21.15.19:0/171025246 <== mds.0 v2:172.21.15.19:6832/1994815169 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a60a311c50 con 0x55a60a3c1630 2024-09-12T01:56:58.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.107+0000 7f2e82ffd640 10 client.5049 handle_command_reply: tid=0 2024-09-12T01:56:58.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.107+0000 7f2ead7d1740 1 client.5049 shutdown 2024-09-12T01:56:58.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.107+0000 7f2ead7d1740 1 -- 172.21.15.19:0/171025246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a22c0 msgr2=0x55a60a3cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.107+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/171025246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a22c0 0x55a60a3cc9c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2e9402a770 tx=0x7f2e94004730 comp rx=0 tx=0).stop 2024-09-12T01:56:58.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.107+0000 7f2ead7d1740 1 -- 172.21.15.19:0/171025246 shutdown_connections 2024-09-12T01:56:58.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.107+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/171025246 >> [v2:172.21.15.19:6832/1994815169,v1:172.21.15.19:6834/1994815169] conn(0x55a60a3c1630 0x55a60a3c1a10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.107+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/171025246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3c0ca0 0x55a60a3a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.107+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/171025246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a3a3a50 0x55a60a3c04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.107+0000 7f2e82ffd640 0 client.5049 ms_handle_reset on v2:172.21.15.19:6832/1994815169 2024-09-12T01:56:58.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.107+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/171025246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a22c0 0x55a60a3cc9c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.107+0000 7f2ead7d1740 1 -- 172.21.15.19:0/171025246 >> 172.21.15.19:0/171025246 conn(0x55a60a39fa80 msgr2=0x55a60a3e6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:58.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.107+0000 7f2ead7d1740 1 -- 172.21.15.19:0/171025246 shutdown_connections 2024-09-12T01:56:58.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.107+0000 7f2ead7d1740 1 -- 172.21.15.19:0/171025246 wait complete. 2024-09-12T01:56:58.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.108+0000 7f2ead7d1740 20 client.5049 trim_cache size 0 max 16384 2024-09-12T01:56:58.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.126+0000 7f2ead7d1740 1 Processor -- start 2024-09-12T01:56:58.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.126+0000 7f2ead7d1740 1 -- start start 2024-09-12T01:56:58.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.127+0000 7f2ead7d1740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a3a22c0 0x55a60a3e8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.127+0000 7f2ead7d1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a3a50 0x55a60a3c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.127+0000 7f2ead7d1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3c0ca0 0x55a60a3c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.127+0000 7f2ead7d1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea41fdea0 con 0x55a60a3a3a50 2024-09-12T01:56:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.127+0000 7f2ead7d1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea40c7160 con 0x55a60a3c0ca0 2024-09-12T01:56:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.127+0000 7f2ead7d1740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea40c77b0 con 0x55a60a3a22c0 2024-09-12T01:56:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.127+0000 7f2ea37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a3a50 0x55a60a3c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.127+0000 7f2ea37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a3a50 0x55a60a3c1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53200/0 (socket says 172.21.15.19:53200) 2024-09-12T01:56:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.127+0000 7f2ea37fe640 1 -- 172.21.15.19:0/2805449895 learned_addr learned my addr 172.21.15.19:0/2805449895 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.127+0000 7f2ea37fe640 1 -- 172.21.15.19:0/2805449895 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a3a22c0 msgr2=0x55a60a3e8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.127+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/2805449895 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a3a22c0 0x55a60a3e8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.127+0000 7f2ea37fe640 1 -- 172.21.15.19:0/2805449895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3c0ca0 msgr2=0x55a60a3c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.127+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/2805449895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3c0ca0 0x55a60a3c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.127+0000 7f2ea37fe640 1 -- 172.21.15.19:0/2805449895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a60a3c97b0 con 0x55a60a3a3a50 2024-09-12T01:56:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.127+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/2805449895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a3a50 0x55a60a3c1c40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2e98004770 tx=0x7f2e980895e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6f0f2c0ae1ae74 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.127+0000 7f2e897fa640 1 -- 172.21.15.19:0/2805449895 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98086070 con 0x55a60a3a3a50 2024-09-12T01:56:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.127+0000 7f2e897fa640 1 -- 172.21.15.19:0/2805449895 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e98057530 con 0x55a60a3a3a50 2024-09-12T01:56:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.127+0000 7f2e897fa640 1 -- 172.21.15.19:0/2805449895 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98021040 con 0x55a60a3a3a50 2024-09-12T01:56:58.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.128+0000 7f2ead7d1740 1 -- 172.21.15.19:0/2805449895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a3a50 msgr2=0x55a60a3c1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.128+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/2805449895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a3a50 0x55a60a3c1c40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2e98004770 tx=0x7f2e980895e0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.128+0000 7f2ead7d1740 1 -- 172.21.15.19:0/2805449895 shutdown_connections 2024-09-12T01:56:58.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.128+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/2805449895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3c0ca0 0x55a60a3c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.128+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/2805449895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a3a50 0x55a60a3c1c40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.128+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/2805449895 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a3a22c0 0x55a60a3e8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.128+0000 7f2ead7d1740 1 -- 172.21.15.19:0/2805449895 >> 172.21.15.19:0/2805449895 conn(0x55a60a39fa80 msgr2=0x55a60a3ea440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:58.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.128+0000 7f2ead7d1740 1 -- 172.21.15.19:0/2805449895 shutdown_connections 2024-09-12T01:56:58.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.128+0000 7f2ead7d1740 1 -- 172.21.15.19:0/2805449895 wait complete. 2024-09-12T01:56:58.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.129+0000 7f2ead7d1740 1 -- start start 2024-09-12T01:56:58.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.129+0000 7f2ead7d1740 1 Processor -- start 2024-09-12T01:56:58.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ead7d1740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a3a22c0 0x55a60a464b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ead7d1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a3a50 0x55a60a3c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ead7d1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3c0ca0 0x55a60a3c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ead7d1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a60a39df20 con 0x55a60a3a3a50 2024-09-12T01:56:58.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ead7d1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a60a28d450 con 0x55a60a3c0ca0 2024-09-12T01:56:58.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ead7d1740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55a60a3cb2e0 con 0x55a60a3a22c0 2024-09-12T01:56:58.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ead7d1740 10 client.0 _ll_register_callbacks cb 0x7f2e9404d070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:56:58.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ea37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a3a50 0x55a60a3c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ea37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a3a50 0x55a60a3c1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53208/0 (socket says 172.21.15.19:53208) 2024-09-12T01:56:58.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ea37fe640 1 -- 172.21.15.19:0/1125839536 learned_addr learned my addr 172.21.15.19:0/1125839536 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:58.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/1125839536 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a3a22c0 0x55a60a464b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ea8fdf640 1 --2- 172.21.15.19:0/1125839536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3c0ca0 0x55a60a3c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ea37fe640 1 -- 172.21.15.19:0/1125839536 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a3a22c0 msgr2=0x55a60a464b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:58.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/1125839536 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a3a22c0 0x55a60a464b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ea37fe640 1 -- 172.21.15.19:0/1125839536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3c0ca0 msgr2=0x55a60a3c1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:58.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/1125839536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3c0ca0 0x55a60a3c1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ea37fe640 1 -- 172.21.15.19:0/1125839536 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a60a3f5580 con 0x55a60a3a3a50 2024-09-12T01:56:58.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ea8fdf640 1 --2- 172.21.15.19:0/1125839536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3c0ca0 0x55a60a3c1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:58.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/1125839536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a3a50 0x55a60a3c1a10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2e98059420 tx=0x7f2e9808b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928c5e3130c8af07 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:58.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2e82ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:56:58.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2e82ffd640 1 -- 172.21.15.19:0/1125839536 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98021070 con 0x55a60a3a3a50 2024-09-12T01:56:58.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2e82ffd640 1 -- 172.21.15.19:0/1125839536 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f2e98089360 con 0x55a60a3a3a50 2024-09-12T01:56:58.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.130+0000 7f2ead7d1740 1 -- 172.21.15.19:0/1125839536 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e98057530 con 0x55a60a3a3a50 2024-09-12T01:56:58.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.131+0000 7f2e82ffd640 1 -- 172.21.15.19:0/1125839536 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f2e98086070 con 0x55a60a3a3a50 2024-09-12T01:56:58.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.131+0000 7f2ead7d1740 10 client.5055 fetch_fsmap learned FSMap version 15 2024-09-12T01:56:58.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.131+0000 7f2ead7d1740 1 -- 172.21.15.19:0/1125839536 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55a60a3e9160 con 0x55a60a3a3a50 2024-09-12T01:56:58.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.131+0000 7f2e82ffd640 1 -- 172.21.15.19:0/1125839536 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e98057530 con 0x55a60a3a3a50 2024-09-12T01:56:58.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.131+0000 7f2e82ffd640 1 -- 172.21.15.19:0/1125839536 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7f2e98055b00 con 0x55a60a3a3a50 2024-09-12T01:56:58.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.131+0000 7f2ead7d1740 10 client.5055 fetch_fsmap finished waiting for FSMap version 15 2024-09-12T01:56:58.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.131+0000 7f2ead7d1740 10 client.5055 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T01:56:58.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.131+0000 7f2ead7d1740 20 client.5055 populate_metadata read hostname 'smithi019' 2024-09-12T01:56:58.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.131+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/1125839536 >> [v2:172.21.15.19:6832/1994815169,v1:172.21.15.19:6834/1994815169] conn(0x55a60a465b00 0x55a60a465ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.131+0000 7f2ead7d1740 4 client.5055 mds_command: new command op to 4822 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:56:58.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.131+0000 7f2ead7d1740 1 -- 172.21.15.19:0/1125839536 --> [v2:172.21.15.19:6832/1994815169,v1:172.21.15.19:6834/1994815169] -- command(tid 0: {"prefix": "status"}) -- 0x55a60a30bfa0 con 0x55a60a465b00 2024-09-12T01:56:58.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.131+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/1125839536 >> [v2:172.21.15.19:6832/1994815169,v1:172.21.15.19:6834/1994815169] conn(0x55a60a465b00 0x55a60a465ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.131+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/1125839536 >> [v2:172.21.15.19:6832/1994815169,v1:172.21.15.19:6834/1994815169] conn(0x55a60a465b00 0x55a60a465ee0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a9ee22a7fab89ee server_cookie=dc00fc0f99487ec9 in_seq=0 out_seq=0 2024-09-12T01:56:58.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.131+0000 7f2e82ffd640 10 client.5055 ms_handle_connect on v2:172.21.15.19:6832/1994815169 2024-09-12T01:56:58.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2e82ffd640 1 -- 172.21.15.19:0/1125839536 <== mds.0 v2:172.21.15.19:6832/1994815169 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55a60a30bfa0 con 0x55a60a465b00 2024-09-12T01:56:58.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2e82ffd640 10 client.5055 handle_command_reply: tid=0 2024-09-12T01:56:58.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2ead7d1740 1 client.5055 shutdown 2024-09-12T01:56:58.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2ead7d1740 1 -- 172.21.15.19:0/1125839536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a3a50 msgr2=0x55a60a3c1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/1125839536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a3a50 0x55a60a3c1a10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2e98059420 tx=0x7f2e9808b040 comp rx=0 tx=0).stop 2024-09-12T01:56:58.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2ead7d1740 1 -- 172.21.15.19:0/1125839536 shutdown_connections 2024-09-12T01:56:58.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/1125839536 >> [v2:172.21.15.19:6832/1994815169,v1:172.21.15.19:6834/1994815169] conn(0x55a60a465b00 0x55a60a465ee0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/1125839536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a60a3c0ca0 0x55a60a3c1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/1125839536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a60a3a3a50 0x55a60a3c1a10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2e82ffd640 0 client.5055 ms_handle_reset on v2:172.21.15.19:6832/1994815169 2024-09-12T01:56:58.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2ead7d1740 1 --2- 172.21.15.19:0/1125839536 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a60a3a22c0 0x55a60a464b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2ead7d1740 1 -- 172.21.15.19:0/1125839536 >> 172.21.15.19:0/1125839536 conn(0x55a60a39fa80 msgr2=0x55a60a3a1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:58.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2ead7d1740 1 -- 172.21.15.19:0/1125839536 shutdown_connections 2024-09-12T01:56:58.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2ead7d1740 1 -- 172.21.15.19:0/1125839536 wait complete. 2024-09-12T01:56:58.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2ead7d1740 20 client.5055 trim_cache size 0 max 16384 2024-09-12T01:56:58.140 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:56:58.140 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T01:56:58.140 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T01:56:58.140 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4822, 2024-09-12T01:56:58.140 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T01:56:58.140 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T01:56:58.140 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T01:56:58.140 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 9.0427779600000004, 2024-09-12T01:56:58.140 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 15, 2024-09-12T01:56:58.140 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 40, 2024-09-12T01:56:58.140 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 40, 2024-09-12T01:56:58.140 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 16.088845044999999 2024-09-12T01:56:58.140 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:56:58.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2eaaa42640 1 -- 172.21.15.19:0/2155985234 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e9006be30 msgr2=0x7f2e9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2eaaa42640 1 --2- 172.21.15.19:0/2155985234 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e9006be30 0x7f2e9006e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2e94034000 tx=0x7f2e9402e000 comp rx=0 tx=0).stop 2024-09-12T01:56:58.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2eaaa42640 1 -- 172.21.15.19:0/2155985234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea40d0980 msgr2=0x7f2ea40b7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.132+0000 7f2eaaa42640 1 --2- 172.21.15.19:0/2155985234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea40d0980 0x7f2ea40b7450 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800e9b0 tx=0x7f2e9800ee70 comp rx=0 tx=0).stop 2024-09-12T01:56:58.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.133+0000 7f2eaaa42640 1 -- 172.21.15.19:0/2155985234 shutdown_connections 2024-09-12T01:56:58.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.133+0000 7f2eaaa42640 1 --2- 172.21.15.19:0/2155985234 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e9006be30 0x7f2e9006e2f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.133+0000 7f2eaaa42640 1 --2- 172.21.15.19:0/2155985234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea415c520 0x7f2ea40b7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.133+0000 7f2eaaa42640 1 --2- 172.21.15.19:0/2155985234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea40d0980 0x7f2ea40b7450 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.133+0000 7f2eaaa42640 1 --2- 172.21.15.19:0/2155985234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea40b1620 0x7f2ea415ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.133+0000 7f2eaaa42640 1 -- 172.21.15.19:0/2155985234 >> 172.21.15.19:0/2155985234 conn(0x7f2ea40d23a0 msgr2=0x7f2ea40d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:58.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.133+0000 7f2eaaa42640 1 -- 172.21.15.19:0/2155985234 shutdown_connections 2024-09-12T01:56:58.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.133+0000 7f2eaaa42640 1 -- 172.21.15.19:0/2155985234 wait complete. 2024-09-12T01:56:58.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:56:58.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.246+0000 7fd273eba640 1 Processor -- start 2024-09-12T01:56:58.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.246+0000 7fd273eba640 1 -- start start 2024-09-12T01:56:58.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd273eba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd26c15e740 0x7fd26c0d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd273eba640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd26c09b690 0x7fd26c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd273eba640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd26c06e020 con 0x7fd26c06d4c0 2024-09-12T01:56:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd273eba640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd26c15eb20 con 0x7fd26c09b690 2024-09-12T01:56:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd273eba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd26c06d260 con 0x7fd26c15e740 2024-09-12T01:56:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd272457640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd26c06d4c0 0x7fd26c06d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43864/0 (socket says 172.21.15.19:43864) 2024-09-12T01:56:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd272457640 1 -- 172.21.15.19:0/1956667904 learned_addr learned my addr 172.21.15.19:0/1956667904 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd271455640 1 --2- 172.21.15.19:0/1956667904 >> v2:172.21.15.135:3300/0 conn(0x7fd26c09b690 0x7fd26c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd270c54640 1 -- 172.21.15.19:0/1956667904 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3145791357 0 0) 0x7fd26c06e020 con 0x7fd26c06d4c0 2024-09-12T01:56:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd271c56640 1 --2- 172.21.15.19:0/1956667904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd26c15e740 0x7fd26c0d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd270c54640 1 -- 172.21.15.19:0/1956667904 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd258003520 con 0x7fd26c06d4c0 2024-09-12T01:56:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd270c54640 1 -- 172.21.15.19:0/1956667904 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4163208485 0 0) 0x7fd258003520 con 0x7fd26c06d4c0 2024-09-12T01:56:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd270c54640 1 -- 172.21.15.19:0/1956667904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd26c15e740 msgr2=0x7fd26c0d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:58.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd270c54640 1 --2- 172.21.15.19:0/1956667904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd26c15e740 0x7fd26c0d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd270c54640 1 -- 172.21.15.19:0/1956667904 >> v2:172.21.15.135:3300/0 conn(0x7fd26c09b690 msgr2=0x7fd26c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:58.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd270c54640 1 --2- 172.21.15.19:0/1956667904 >> v2:172.21.15.135:3300/0 conn(0x7fd26c09b690 0x7fd26c06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd270c54640 1 -- 172.21.15.19:0/1956667904 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26c0d0780 con 0x7fd26c06d4c0 2024-09-12T01:56:58.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd270c54640 1 -- 172.21.15.19:0/1956667904 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fd2640019f0 con 0x7fd26c06d4c0 2024-09-12T01:56:58.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.247+0000 7fd270c54640 1 -- 172.21.15.19:0/1956667904 >> v1:172.21.15.19:6789/0 conn(0x7fd26c06d4c0 legacy=0x7fd26c06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.248+0000 7fd270c54640 1 --2- 172.21.15.19:0/1956667904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2580039e0 0x7fd258003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.248+0000 7fd270c54640 1 --2- 172.21.15.19:0/1956667904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd26c15e740 0x7fd258004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.248+0000 7fd270c54640 1 --2- 172.21.15.19:0/1956667904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd258004d40 0x7fd2580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.248+0000 7fd270c54640 1 -- 172.21.15.19:0/1956667904 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c15eb20 con 0x7fd2580039e0 2024-09-12T01:56:58.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.248+0000 7fd270c54640 1 -- 172.21.15.19:0/1956667904 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c06d260 con 0x7fd258004d40 2024-09-12T01:56:58.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.248+0000 7fd270c54640 1 -- 172.21.15.19:0/1956667904 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd25800b9c0 con 0x7fd26c15e740 2024-09-12T01:56:58.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.248+0000 7fd271c56640 1 --2- 172.21.15.19:0/1956667904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2580039e0 0x7fd258003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.248+0000 7fd271455640 1 --2- 172.21.15.19:0/1956667904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd26c15e740 0x7fd258004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.248+0000 7fd272457640 1 --2- 172.21.15.19:0/1956667904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd258004d40 0x7fd2580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.248+0000 7fd271c56640 1 -- 172.21.15.19:0/1956667904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd26c15e740 msgr2=0x7fd258004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:58.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.248+0000 7fd271c56640 1 --2- 172.21.15.19:0/1956667904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd26c15e740 0x7fd258004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.248+0000 7fd271c56640 1 -- 172.21.15.19:0/1956667904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd258004d40 msgr2=0x7fd2580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:58.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.248+0000 7fd271c56640 1 --2- 172.21.15.19:0/1956667904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd258004d40 0x7fd2580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.248+0000 7fd271c56640 1 -- 172.21.15.19:0/1956667904 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd258003520 con 0x7fd2580039e0 2024-09-12T01:56:58.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.249+0000 7fd271c56640 1 --2- 172.21.15.19:0/1956667904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2580039e0 0x7fd258003e00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd25c009ac0 tx=0x7fd258005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89de388c112e556e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:58.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.249+0000 7fd270c54640 1 -- 172.21.15.19:0/1956667904 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c036070 con 0x7fd2580039e0 2024-09-12T01:56:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.249+0000 7fd270c54640 1 -- 172.21.15.19:0/1956667904 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd25c031400 con 0x7fd2580039e0 2024-09-12T01:56:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.249+0000 7fd270c54640 1 -- 172.21.15.19:0/1956667904 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c009690 con 0x7fd2580039e0 2024-09-12T01:56:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.249+0000 7fd273eba640 1 -- 172.21.15.19:0/1956667904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2580039e0 msgr2=0x7fd258003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.249+0000 7fd273eba640 1 --2- 172.21.15.19:0/1956667904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2580039e0 0x7fd258003e00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd25c009ac0 tx=0x7fd258005830 comp rx=0 tx=0).stop 2024-09-12T01:56:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.249+0000 7fd272457640 1 -- 172.21.15.19:0/1956667904 reap_dead start 2024-09-12T01:56:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.249+0000 7fd273eba640 1 -- 172.21.15.19:0/1956667904 shutdown_connections 2024-09-12T01:56:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.249+0000 7fd273eba640 1 -- 172.21.15.19:0/1956667904 >> 172.21.15.19:0/1956667904 conn(0x7fd26c0d23a0 msgr2=0x7fd26c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.250+0000 7fd273eba640 1 -- 172.21.15.19:0/1956667904 shutdown_connections 2024-09-12T01:56:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.250+0000 7fd273eba640 1 -- 172.21.15.19:0/1956667904 wait complete. 2024-09-12T01:56:58.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.251+0000 7fd273eba640 1 Processor -- start 2024-09-12T01:56:58.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.251+0000 7fd273eba640 1 -- start start 2024-09-12T01:56:58.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.251+0000 7fd273eba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2580039e0 0x7fd26c0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd273eba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd26c0b6430 0x7fd26c0b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd273eba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd26c15cee0 0x7fd26c15d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd273eba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c0d1020 con 0x7fd26c15cee0 2024-09-12T01:56:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd273eba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c0d0d40 con 0x7fd2580039e0 2024-09-12T01:56:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd273eba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd26c09ba90 con 0x7fd26c0b6430 2024-09-12T01:56:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd272457640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd26c15cee0 0x7fd26c15d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd272457640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd26c15cee0 0x7fd26c15d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53216/0 (socket says 172.21.15.19:53216) 2024-09-12T01:56:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd272457640 1 -- 172.21.15.19:0/1019082185 learned_addr learned my addr 172.21.15.19:0/1019082185 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd271455640 1 --2- 172.21.15.19:0/1019082185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd26c0b6430 0x7fd26c0b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd271c56640 1 --2- 172.21.15.19:0/1019082185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2580039e0 0x7fd26c0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd272457640 1 -- 172.21.15.19:0/1019082185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd26c0b6430 msgr2=0x7fd26c0b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd272457640 1 --2- 172.21.15.19:0/1019082185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd26c0b6430 0x7fd26c0b68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd272457640 1 -- 172.21.15.19:0/1019082185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2580039e0 msgr2=0x7fd26c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd272457640 1 --2- 172.21.15.19:0/1019082185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2580039e0 0x7fd26c0b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd272457640 1 -- 172.21.15.19:0/1019082185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26c15dd10 con 0x7fd26c15cee0 2024-09-12T01:56:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd272457640 1 --2- 172.21.15.19:0/1019082185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd26c15cee0 0x7fd26c15d360 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0b1c90 tx=0x7fd26400a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd2627fc640 1 -- 172.21.15.19:0/1019082185 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd264017020 con 0x7fd26c15cee0 2024-09-12T01:56:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd2627fc640 1 -- 172.21.15.19:0/1019082185 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd26400acb0 con 0x7fd26c15cee0 2024-09-12T01:56:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd273eba640 1 -- 172.21.15.19:0/1019082185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd26c0b6f80 con 0x7fd26c15cee0 2024-09-12T01:56:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd2627fc640 1 -- 172.21.15.19:0/1019082185 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26400ae60 con 0x7fd26c15cee0 2024-09-12T01:56:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.252+0000 7fd273eba640 1 -- 172.21.15.19:0/1019082185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd26c0b7540 con 0x7fd26c15cee0 2024-09-12T01:56:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.253+0000 7fd273eba640 1 -- 172.21.15.19:0/1019082185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd26c06cd20 con 0x7fd26c15cee0 2024-09-12T01:56:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.254+0000 7fd2627fc640 1 -- 172.21.15.19:0/1019082185 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd26401a020 con 0x7fd26c15cee0 2024-09-12T01:56:58.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.254+0000 7fd2627fc640 1 --2- 172.21.15.19:0/1019082185 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd25006be30 0x7fd25006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.255+0000 7fd2627fc640 1 -- 172.21.15.19:0/1019082185 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fd26408b6f0 con 0x7fd26c15cee0 2024-09-12T01:56:58.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.255+0000 7fd271c56640 1 --2- 172.21.15.19:0/1019082185 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd25006be30 0x7fd25006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.255+0000 7fd271c56640 1 --2- 172.21.15.19:0/1019082185 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd25006be30 0x7fd25006e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd25c033000 tx=0x7fd25c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:58.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.259+0000 7fd2627fc640 1 -- 172.21.15.19:0/1019082185 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd264021020 con 0x7fd26c15cee0 2024-09-12T01:56:58.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.472+0000 7fd273eba640 1 -- 172.21.15.19:0/1019082185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd26c0d1cb0 con 0x7fd26c15cee0 2024-09-12T01:56:58.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.473+0000 7fd2627fc640 1 -- 172.21.15.19:0/1019082185 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+73 (secure 0 0 0) 0x7fd264059fa0 con 0x7fd26c15cee0 2024-09-12T01:56:58.473 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:56:58.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.475+0000 7fd273eba640 1 -- 172.21.15.19:0/1019082185 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd25006be30 msgr2=0x7fd25006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.475+0000 7fd273eba640 1 --2- 172.21.15.19:0/1019082185 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd25006be30 0x7fd25006e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd25c033000 tx=0x7fd25c008030 comp rx=0 tx=0).stop 2024-09-12T01:56:58.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.475+0000 7fd273eba640 1 -- 172.21.15.19:0/1019082185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd26c15cee0 msgr2=0x7fd26c15d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.475+0000 7fd273eba640 1 --2- 172.21.15.19:0/1019082185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd26c15cee0 0x7fd26c15d360 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0b1c90 tx=0x7fd26400a730 comp rx=0 tx=0).stop 2024-09-12T01:56:58.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.475+0000 7fd273eba640 1 -- 172.21.15.19:0/1019082185 shutdown_connections 2024-09-12T01:56:58.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.475+0000 7fd273eba640 1 --2- 172.21.15.19:0/1019082185 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd25006be30 0x7fd25006e2f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.475+0000 7fd273eba640 1 --2- 172.21.15.19:0/1019082185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd26c15cee0 0x7fd26c15d360 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.475+0000 7fd273eba640 1 --2- 172.21.15.19:0/1019082185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd26c0b6430 0x7fd26c0b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.475+0000 7fd273eba640 1 --2- 172.21.15.19:0/1019082185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2580039e0 0x7fd26c0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.475+0000 7fd273eba640 1 -- 172.21.15.19:0/1019082185 >> 172.21.15.19:0/1019082185 conn(0x7fd26c0d23a0 msgr2=0x7fd26c0cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:58.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.475+0000 7fd273eba640 1 -- 172.21.15.19:0/1019082185 shutdown_connections 2024-09-12T01:56:58.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58.475+0000 7fd273eba640 1 -- 172.21.15.19:0/1019082185 wait complete. 2024-09-12T01:56:58.486 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:56:58.486 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:56:58.486 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T01:56:58.486 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:56:58.486 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:56:58.486 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:56:58.486 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:56:58.486 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:56:58.486 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:56:58.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:58.487 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T01:56:58.504 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:56:58.504 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:56:58.504 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:56:58.504 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:58.505 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T01:56:58.505 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:58.505 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:58.505 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:58.505 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T01:56:58.505 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:58.505 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:58.505 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T01:56:58.505 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:56:58.505 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:58.505 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T01:56:58.505 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:56:58.505 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42742sec preferred_lft 42742sec 2024-09-12T01:56:58.506 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T01:56:58.506 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:58.506 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:58.506 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:58.506 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T01:56:58.506 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:56:58.506 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:58.506 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:56:58.506 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:58.506 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T01:56:58.506 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:58.506 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:56:58.507 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:56:58.507 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T01:56:58.507 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:58.507 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:56:58.507 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:56:58.507 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T01:56:58.507 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:58.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:58.507 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:56:58.569 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T01:56:58.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:58.571 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T01:56:58.628 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T01:56:58.628 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:56:58.628 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:56:58.628 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:56:58.628 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:56:58.629 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:58.629 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:56:58.629 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:56:58.629 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:56:58.629 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:56:58.629 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:56:58.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:58.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:58.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:58.757 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T01:56:58.773 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T01:56:58.773 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:56:58.773 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:56:58.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:58.774 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T01:56:58.839 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:56:58.839 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:56:58.895 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:56:58.895 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:56:58.895 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:56:58.951 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T01:56:58.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:58.951 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:56:59.037 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:56:59.037 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:56:59.037 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:56:59.045 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:56:59.046 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:56:59.046 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:56:59.046 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:56:59.046 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:56:59.052 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:56:59.052 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:56:59.052 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:56:59.052 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:56:59.052 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:56:59.052 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T01:56:59.053 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T01:56:59.053 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T01:56:59.053 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:56:59.053 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:56:59.053 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:56:59.053 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:56:59.053 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:56:59.054 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:56:59.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:59.054 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:56:59.081 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:56:59.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:56:59.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:59.182 INFO:teuthology.orchestra.run.smithi019.stdout:client4990 2024-09-12T01:56:59.183 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:56:59.183 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:59.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:59.199 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/) 2024-09-12T01:56:59.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:59.260 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_undamaged) 2024-09-12T01:56:59.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:59.318 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_to_be_damaged) 2024-09-12T01:56:59.375 DEBUG:teuthology.orchestra.run.smithi019:> stdin-killer -- python3 -c ' 2024-09-12T01:56:59.376 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-09-12T01:56:59.376 DEBUG:teuthology.orchestra.run.smithi019:> import stat 2024-09-12T01:56:59.376 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T01:56:59.376 DEBUG:teuthology.orchestra.run.smithi019:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-09-12T01:56:59.376 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-09-12T01:56:59.482 INFO:teuthology.orchestra.run.smithi019.stdout:1099511627776 2024-09-12T01:56:59.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:59.491 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:56:59.491 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:59.547 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:56:59.547 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:59.604 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:56:59.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.750+0000 7f5daf074640 1 Processor -- start 2024-09-12T01:56:59.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.750+0000 7f5daf074640 1 -- start start 2024-09-12T01:56:59.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.751+0000 7f5daf074640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5da8162060 0x7f5da80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:59.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.751+0000 7f5daf074640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5da80b64b0 0x7f5da80b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:59.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.751+0000 7f5daf074640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5da806d9f0 con 0x7f5da8161c80 2024-09-12T01:56:59.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.751+0000 7f5daf074640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f5da806dcd0 con 0x7f5da80b64b0 2024-09-12T01:56:59.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.751+0000 7f5daf074640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5da806dfb0 con 0x7f5da8162060 2024-09-12T01:56:59.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.751+0000 7f5dace10640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5da8161c80 0x7f5da806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43866/0 (socket says 172.21.15.19:43866) 2024-09-12T01:56:59.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.751+0000 7f5dace10640 1 -- 172.21.15.19:0/1564744875 learned_addr learned my addr 172.21.15.19:0/1564744875 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:56:59.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.751+0000 7f5dad611640 1 --2- 172.21.15.19:0/1564744875 >> v2:172.21.15.135:3300/0 conn(0x7f5da80b64b0 0x7f5da80b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:59.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.751+0000 7f5da7fff640 1 --2- 172.21.15.19:0/1564744875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5da8162060 0x7f5da80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:59.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.751+0000 7f5da77fe640 1 -- 172.21.15.19:0/1564744875 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4011984606 0 0) 0x7f5da806d9f0 con 0x7f5da8161c80 2024-09-12T01:56:59.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.751+0000 7f5da77fe640 1 -- 172.21.15.19:0/1564744875 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d98003520 con 0x7f5da8161c80 2024-09-12T01:56:59.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.751+0000 7f5dad611640 1 -- 172.21.15.19:0/1564744875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5da8162060 msgr2=0x7f5da80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:59.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.752+0000 7f5dad611640 1 --2- 172.21.15.19:0/1564744875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5da8162060 0x7f5da80b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.752+0000 7f5dad611640 1 -- 172.21.15.19:0/1564744875 >> v1:172.21.15.19:6789/0 conn(0x7f5da8161c80 legacy=0x7f5da806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:59.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.752+0000 7f5dad611640 1 -- 172.21.15.19:0/1564744875 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da80d01f0 con 0x7f5da80b64b0 2024-09-12T01:56:59.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.752+0000 7f5da7fff640 1 --2- 172.21.15.19:0/1564744875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5da8162060 0x7f5da80b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.753+0000 7f5dad611640 1 --2- 172.21.15.19:0/1564744875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5da80b64b0 0x7f5da80b6960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009d90 tx=0x7f5da002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46f14019758ae33d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.753+0000 7f5da77fe640 1 -- 172.21.15.19:0/1564744875 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da0007740 con 0x7f5da80b64b0 2024-09-12T01:56:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.753+0000 7f5da77fe640 1 -- 172.21.15.19:0/1564744875 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5da00078e0 con 0x7f5da80b64b0 2024-09-12T01:56:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.753+0000 7f5da77fe640 1 -- 172.21.15.19:0/1564744875 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da0007cb0 con 0x7f5da80b64b0 2024-09-12T01:56:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.754+0000 7f5daf074640 1 -- 172.21.15.19:0/1564744875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5da80b64b0 msgr2=0x7f5da80b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.754+0000 7f5daf074640 1 --2- 172.21.15.19:0/1564744875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5da80b64b0 0x7f5da80b6960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009d90 tx=0x7f5da002a660 comp rx=0 tx=0).stop 2024-09-12T01:56:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.754+0000 7f5daf074640 1 -- 172.21.15.19:0/1564744875 shutdown_connections 2024-09-12T01:56:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.754+0000 7f5daf074640 1 --2- 172.21.15.19:0/1564744875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5da80b64b0 0x7f5da80b6960 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.754+0000 7f5daf074640 1 --2- 172.21.15.19:0/1564744875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5da8162060 0x7f5da80b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.754+0000 7f5daf074640 1 -- 172.21.15.19:0/1564744875 >> 172.21.15.19:0/1564744875 conn(0x7f5da80d44f0 msgr2=0x7f5da80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.754+0000 7f5daf074640 1 -- 172.21.15.19:0/1564744875 shutdown_connections 2024-09-12T01:56:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.754+0000 7f5daf074640 1 -- 172.21.15.19:0/1564744875 wait complete. 2024-09-12T01:56:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.755+0000 7f5daf074640 1 Processor -- start 2024-09-12T01:56:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.755+0000 7f5daf074640 1 -- start start 2024-09-12T01:56:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.756+0000 7f5daf074640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da80b64b0 0x7f5da814ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.756+0000 7f5daf074640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5da8161c80 0x7f5da80cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.756+0000 7f5daf074640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5da8162060 0x7f5da80cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.756+0000 7f5daf074640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5da80cf1e0 con 0x7f5da80b64b0 2024-09-12T01:56:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.756+0000 7f5daf074640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5da80d2aa0 con 0x7f5da8161c80 2024-09-12T01:56:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.756+0000 7f5daf074640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5da80cf360 con 0x7f5da8162060 2024-09-12T01:56:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.756+0000 7f5dace10640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da80b64b0 0x7f5da814ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.756+0000 7f5dace10640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da80b64b0 0x7f5da814ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53224/0 (socket says 172.21.15.19:53224) 2024-09-12T01:56:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.756+0000 7f5dace10640 1 -- 172.21.15.19:0/1871207239 learned_addr learned my addr 172.21.15.19:0/1871207239 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:56:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.756+0000 7f5da7fff640 1 --2- 172.21.15.19:0/1871207239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5da8161c80 0x7f5da80cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.756+0000 7f5dad611640 1 --2- 172.21.15.19:0/1871207239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5da8162060 0x7f5da80cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.756+0000 7f5dace10640 1 -- 172.21.15.19:0/1871207239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5da8162060 msgr2=0x7f5da80cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.756+0000 7f5dace10640 1 --2- 172.21.15.19:0/1871207239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5da8162060 0x7f5da80cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.756+0000 7f5dace10640 1 -- 172.21.15.19:0/1871207239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5da8161c80 msgr2=0x7f5da80cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.756+0000 7f5dace10640 1 --2- 172.21.15.19:0/1871207239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5da8161c80 0x7f5da80cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.756+0000 7f5dace10640 1 -- 172.21.15.19:0/1871207239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da814f2b0 con 0x7f5da80b64b0 2024-09-12T01:56:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.756+0000 7f5da7fff640 1 --2- 172.21.15.19:0/1871207239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5da8161c80 0x7f5da80cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.757+0000 7f5dace10640 1 --2- 172.21.15.19:0/1871207239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da80b64b0 0x7f5da814ed70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00c430 tx=0x7f5d9c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.757+0000 7f5da57fa640 1 -- 172.21.15.19:0/1871207239 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c017070 con 0x7f5da80b64b0 2024-09-12T01:56:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.757+0000 7f5da57fa640 1 -- 172.21.15.19:0/1871207239 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d9c005ce0 con 0x7f5da80b64b0 2024-09-12T01:56:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.757+0000 7f5daf074640 1 -- 172.21.15.19:0/1871207239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da80cb760 con 0x7f5da80b64b0 2024-09-12T01:56:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.757+0000 7f5da57fa640 1 -- 172.21.15.19:0/1871207239 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c0072f0 con 0x7f5da80b64b0 2024-09-12T01:56:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.757+0000 7f5daf074640 1 -- 172.21.15.19:0/1871207239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da80cbd20 con 0x7f5da80b64b0 2024-09-12T01:56:59.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.758+0000 7f5daf074640 1 -- 172.21.15.19:0/1871207239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5da80b5f70 con 0x7f5da80b64b0 2024-09-12T01:56:59.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.759+0000 7f5da57fa640 1 -- 172.21.15.19:0/1871207239 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d9c01a070 con 0x7f5da80b64b0 2024-09-12T01:56:59.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.759+0000 7f5da57fa640 1 --2- 172.21.15.19:0/1871207239 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5d8c06be30 0x7f5d8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:59.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.759+0000 7f5da57fa640 1 -- 172.21.15.19:0/1871207239 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f5d9c08a4c0 con 0x7f5da80b64b0 2024-09-12T01:56:59.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.759+0000 7f5da7fff640 1 --2- 172.21.15.19:0/1871207239 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5d8c06be30 0x7f5d8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:59.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.760+0000 7f5da7fff640 1 --2- 172.21.15.19:0/1871207239 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5d8c06be30 0x7f5d8c06e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5da80ba200 tx=0x7f5d94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:59.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.763+0000 7f5da57fa640 1 -- 172.21.15.19:0/1871207239 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5da814f2b0 con 0x7f5da80b64b0 2024-09-12T01:56:59.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.953+0000 7f5daf074640 1 -- 172.21.15.19:0/1871207239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5da80ba470 con 0x7f5da80b64b0 2024-09-12T01:56:59.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.954+0000 7f5da57fa640 1 -- 172.21.15.19:0/1871207239 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) ==== 80+0+0 (secure 0 0 0) 0x7f5d9c058c60 con 0x7f5da80b64b0 2024-09-12T01:56:59.954 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-09-12T01:56:59.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.956+0000 7f5daf074640 1 -- 172.21.15.19:0/1871207239 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5d8c06be30 msgr2=0x7f5d8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:59.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.956+0000 7f5daf074640 1 --2- 172.21.15.19:0/1871207239 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5d8c06be30 0x7f5d8c06e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5da80ba200 tx=0x7f5d94008040 comp rx=0 tx=0).stop 2024-09-12T01:56:59.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.956+0000 7f5daf074640 1 -- 172.21.15.19:0/1871207239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da80b64b0 msgr2=0x7f5da814ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:59.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.956+0000 7f5daf074640 1 --2- 172.21.15.19:0/1871207239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da80b64b0 0x7f5da814ed70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00c430 tx=0x7f5d9c00c8f0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.956+0000 7f5daf074640 1 -- 172.21.15.19:0/1871207239 shutdown_connections 2024-09-12T01:56:59.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.956+0000 7f5daf074640 1 --2- 172.21.15.19:0/1871207239 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5d8c06be30 0x7f5d8c06e2f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.956+0000 7f5daf074640 1 --2- 172.21.15.19:0/1871207239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5da8162060 0x7f5da80cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.956+0000 7f5daf074640 1 --2- 172.21.15.19:0/1871207239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5da8161c80 0x7f5da80cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.956+0000 7f5daf074640 1 --2- 172.21.15.19:0/1871207239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da80b64b0 0x7f5da814ed70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.956+0000 7f5daf074640 1 -- 172.21.15.19:0/1871207239 >> 172.21.15.19:0/1871207239 conn(0x7f5da80d44f0 msgr2=0x7f5da806ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:59.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.956+0000 7f5daf074640 1 -- 172.21.15.19:0/1871207239 shutdown_connections 2024-09-12T01:56:59.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:56:59.956+0000 7f5daf074640 1 -- 172.21.15.19:0/1871207239 wait complete. 2024-09-12T01:56:59.967 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:56:59.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:59.968 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:57:00.020 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:57:00.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:00.021 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:57:00.054 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:57:00.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.196+0000 7fccd3cd9640 1 Processor -- start 2024-09-12T01:57:00.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.196+0000 7fccd3cd9640 1 -- start start 2024-09-12T01:57:00.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.197+0000 7fccd3cd9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcccc15c520 0x7fcccc09b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.197+0000 7fccd3cd9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcccc0b1620 0x7fcccc0b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.197+0000 7fccd3cd9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcccc0d0980 0x7fcccc0d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.197+0000 7fccd3cd9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fcccc0cec00 con 0x7fcccc15c520 2024-09-12T01:57:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.197+0000 7fccd3cd9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fcccc09bd90 con 0x7fcccc0d0980 2024-09-12T01:57:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.197+0000 7fccd3cd9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcccc0d0010 con 0x7fcccc0b1620 2024-09-12T01:57:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.197+0000 7fccd1a75640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcccc15c520 0x7fcccc09b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.197+0000 7fccd1a75640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcccc15c520 0x7fcccc09b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53240/0 (socket says 172.21.15.19:53240) 2024-09-12T01:57:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.197+0000 7fccd1a75640 1 -- 172.21.15.19:0/390151459 learned_addr learned my addr 172.21.15.19:0/390151459 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.197+0000 7fccd2276640 1 --2- 172.21.15.19:0/390151459 >> v2:172.21.15.135:3300/0 conn(0x7fcccc0d0980 0x7fcccc0d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.197+0000 7fccd1274640 1 --2- 172.21.15.19:0/390151459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcccc0b1620 0x7fcccc0b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.197+0000 7fccd1a75640 1 -- 172.21.15.19:0/390151459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcccc0b1620 msgr2=0x7fcccc0b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.197+0000 7fccd1a75640 1 --2- 172.21.15.19:0/390151459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcccc0b1620 0x7fcccc0b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.197+0000 7fccd1a75640 1 -- 172.21.15.19:0/390151459 >> v2:172.21.15.135:3300/0 conn(0x7fcccc0d0980 msgr2=0x7fcccc0d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.197+0000 7fccd1a75640 1 --2- 172.21.15.19:0/390151459 >> v2:172.21.15.135:3300/0 conn(0x7fcccc0d0980 0x7fcccc0d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.198+0000 7fccd1a75640 1 -- 172.21.15.19:0/390151459 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcccc0d02f0 con 0x7fcccc15c520 2024-09-12T01:57:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.198+0000 7fccd1274640 1 --2- 172.21.15.19:0/390151459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcccc0b1620 0x7fcccc0b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.198+0000 7fccd2276640 1 --2- 172.21.15.19:0/390151459 >> v2:172.21.15.135:3300/0 conn(0x7fcccc0d0980 0x7fcccc0d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:00.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.198+0000 7fccd1a75640 1 --2- 172.21.15.19:0/390151459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcccc15c520 0x7fcccc09b720 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0b3ea0 tx=0x7fccc802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4e01b7236e27ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.198+0000 7fccd0a73640 1 -- 172.21.15.19:0/390151459 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8037070 con 0x7fcccc15c520 2024-09-12T01:57:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.198+0000 7fccd0a73640 1 -- 172.21.15.19:0/390151459 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc8032440 con 0x7fcccc15c520 2024-09-12T01:57:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.199+0000 7fccd0a73640 1 -- 172.21.15.19:0/390151459 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8032810 con 0x7fcccc15c520 2024-09-12T01:57:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.199+0000 7fccd3cd9640 1 -- 172.21.15.19:0/390151459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcccc15c520 msgr2=0x7fcccc09b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.199+0000 7fccd3cd9640 1 --2- 172.21.15.19:0/390151459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcccc15c520 0x7fcccc09b720 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0b3ea0 tx=0x7fccc802a1e0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.199+0000 7fccd3cd9640 1 -- 172.21.15.19:0/390151459 shutdown_connections 2024-09-12T01:57:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.199+0000 7fccd3cd9640 1 --2- 172.21.15.19:0/390151459 >> v2:172.21.15.135:3300/0 conn(0x7fcccc0d0980 0x7fcccc0d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.199+0000 7fccd3cd9640 1 --2- 172.21.15.19:0/390151459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcccc0b1620 0x7fcccc0b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.199+0000 7fccd3cd9640 1 --2- 172.21.15.19:0/390151459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcccc15c520 0x7fcccc09b720 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.199+0000 7fccd3cd9640 1 -- 172.21.15.19:0/390151459 >> 172.21.15.19:0/390151459 conn(0x7fcccc0d23a0 msgr2=0x7fcccc0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.199+0000 7fccd3cd9640 1 -- 172.21.15.19:0/390151459 shutdown_connections 2024-09-12T01:57:00.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.199+0000 7fccd3cd9640 1 -- 172.21.15.19:0/390151459 wait complete. 2024-09-12T01:57:00.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.200+0000 7fccd3cd9640 1 Processor -- start 2024-09-12T01:57:00.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.201+0000 7fccd3cd9640 1 -- start start 2024-09-12T01:57:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.201+0000 7fccd3cd9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcccc0b1620 0x7fcccc1f3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.201+0000 7fccd3cd9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcccc0d0980 0x7fcccc1f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.201+0000 7fccd3cd9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcccc15c520 0x7fcccc0c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.201+0000 7fccd3cd9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc15c900 con 0x7fcccc0b1620 2024-09-12T01:57:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.201+0000 7fccd3cd9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc0d05d0 con 0x7fcccc0d0980 2024-09-12T01:57:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.201+0000 7fccd3cd9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcccc0b51d0 con 0x7fcccc15c520 2024-09-12T01:57:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.201+0000 7fccd1a75640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcccc0b1620 0x7fcccc1f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.201+0000 7fccd1a75640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcccc0b1620 0x7fcccc1f3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53256/0 (socket says 172.21.15.19:53256) 2024-09-12T01:57:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.201+0000 7fccd1a75640 1 -- 172.21.15.19:0/124088313 learned_addr learned my addr 172.21.15.19:0/124088313 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.202+0000 7fccd2276640 1 --2- 172.21.15.19:0/124088313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcccc15c520 0x7fcccc0c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.202+0000 7fccd1274640 1 --2- 172.21.15.19:0/124088313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcccc0d0980 0x7fcccc1f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.202+0000 7fccd1a75640 1 -- 172.21.15.19:0/124088313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcccc15c520 msgr2=0x7fcccc0c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.202+0000 7fccd1a75640 1 --2- 172.21.15.19:0/124088313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcccc15c520 0x7fcccc0c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.202+0000 7fccd1a75640 1 -- 172.21.15.19:0/124088313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcccc0d0980 msgr2=0x7fcccc1f2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.202+0000 7fccd1a75640 1 --2- 172.21.15.19:0/124088313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcccc0d0980 0x7fcccc1f2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.202+0000 7fccd1a75640 1 -- 172.21.15.19:0/124088313 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcccc0b5420 con 0x7fcccc0b1620 2024-09-12T01:57:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.202+0000 7fccd2276640 1 --2- 172.21.15.19:0/124088313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcccc15c520 0x7fcccc0c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.202+0000 7fccd1274640 1 --2- 172.21.15.19:0/124088313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcccc0d0980 0x7fcccc1f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.202+0000 7fccd1a75640 1 --2- 172.21.15.19:0/124088313 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcccc0b1620 0x7fcccc1f3010 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fccc802a220 tx=0x7fccc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.202+0000 7fccc27fc640 1 -- 172.21.15.19:0/124088313 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8037040 con 0x7fcccc0b1620 2024-09-12T01:57:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.202+0000 7fccc27fc640 1 -- 172.21.15.19:0/124088313 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc8042070 con 0x7fcccc0b1620 2024-09-12T01:57:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.202+0000 7fccd3cd9640 1 -- 172.21.15.19:0/124088313 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcccc0b5700 con 0x7fcccc0b1620 2024-09-12T01:57:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.202+0000 7fccc27fc640 1 -- 172.21.15.19:0/124088313 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8030bb0 con 0x7fcccc0b1620 2024-09-12T01:57:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.202+0000 7fccd3cd9640 1 -- 172.21.15.19:0/124088313 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcccc0b5cc0 con 0x7fcccc0b1620 2024-09-12T01:57:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.203+0000 7fccd3cd9640 1 -- 172.21.15.19:0/124088313 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcccc0b8320 con 0x7fcccc0b1620 2024-09-12T01:57:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.204+0000 7fccc27fc640 1 -- 172.21.15.19:0/124088313 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fccc8047460 con 0x7fcccc0b1620 2024-09-12T01:57:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.204+0000 7fccc27fc640 1 --2- 172.21.15.19:0/124088313 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fccb006be30 0x7fccb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.204+0000 7fccc27fc640 1 -- 172.21.15.19:0/124088313 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fccc80abc70 con 0x7fcccc0b1620 2024-09-12T01:57:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.205+0000 7fccd1274640 1 --2- 172.21.15.19:0/124088313 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fccb006be30 0x7fccb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.205+0000 7fccd1274640 1 --2- 172.21.15.19:0/124088313 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fccb006be30 0x7fccb006e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fccbc006fd0 tx=0x7fccbc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:00.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.213+0000 7fccc27fc640 1 -- 172.21.15.19:0/124088313 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fccc8045360 con 0x7fcccc0b1620 2024-09-12T01:57:00.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.428+0000 7fccd3cd9640 1 -- 172.21.15.19:0/124088313 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcccc0b1d40 con 0x7fcccc0b1620 2024-09-12T01:57:00.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.429+0000 7fccc27fc640 1 -- 172.21.15.19:0/124088313 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5226 (secure 0 0 0) 0x7fccc807a490 con 0x7fcccc0b1620 2024-09-12T01:57:00.430 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:00.430 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":15,"btime":"2024-09-12T01:56:51:094820+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1979542220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1979542220},{"type":"v1","addr":"172.21.15.135:6836","nonce":1979542220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/809710386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":809710386},{"type":"v1","addr":"172.21.15.19:6835","nonce":809710386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1005776280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1005776280},{"type":"v1","addr":"172.21.15.135:6837","nonce":1005776280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:56:48.431829+0000","modified":"2024-09-12T01:56:50.440044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4822},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4822":{"gid":4822,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6834/1994815169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1994815169},{"type":"v1","addr":"172.21.15.19:6834","nonce":1994815169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4822,"qdb_cluster":[4822]},"id":2}]} 2024-09-12T01:57:00.430 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 15 2024-09-12T01:57:00.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.431+0000 7fccd3cd9640 1 -- 172.21.15.19:0/124088313 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fccb006be30 msgr2=0x7fccb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.431+0000 7fccd3cd9640 1 --2- 172.21.15.19:0/124088313 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fccb006be30 0x7fccb006e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fccbc006fd0 tx=0x7fccbc008040 comp rx=0 tx=0).stop 2024-09-12T01:57:00.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.431+0000 7fccd3cd9640 1 -- 172.21.15.19:0/124088313 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcccc0b1620 msgr2=0x7fcccc1f3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.431+0000 7fccd3cd9640 1 --2- 172.21.15.19:0/124088313 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcccc0b1620 0x7fcccc1f3010 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fccc802a220 tx=0x7fccc80046c0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.431+0000 7fccd3cd9640 1 -- 172.21.15.19:0/124088313 shutdown_connections 2024-09-12T01:57:00.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.431+0000 7fccd3cd9640 1 --2- 172.21.15.19:0/124088313 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fccb006be30 0x7fccb006e2f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.431+0000 7fccd3cd9640 1 --2- 172.21.15.19:0/124088313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcccc15c520 0x7fcccc0c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.431+0000 7fccd3cd9640 1 --2- 172.21.15.19:0/124088313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcccc0d0980 0x7fcccc1f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.431+0000 7fccd3cd9640 1 --2- 172.21.15.19:0/124088313 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcccc0b1620 0x7fcccc1f3010 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.431+0000 7fccd3cd9640 1 -- 172.21.15.19:0/124088313 >> 172.21.15.19:0/124088313 conn(0x7fcccc0d23a0 msgr2=0x7fcccc071440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:00.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.431+0000 7fccd3cd9640 1 -- 172.21.15.19:0/124088313 shutdown_connections 2024-09-12T01:57:00.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.431+0000 7fccd3cd9640 1 -- 172.21.15.19:0/124088313 wait complete. 2024-09-12T01:57:00.442 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-12T01:57:00.571 INFO:teuthology.orchestra.run.smithi019.stdout:{"message":"","return_code":0} 2024-09-12T01:57:00.571 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-12T01:57:00.571 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T01:57:00.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.675+0000 7fa057e2e640 1 Processor -- start 2024-09-12T01:57:00.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.675+0000 7fa057e2e640 1 -- start start 2024-09-12T01:57:00.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.676+0000 7fa057e2e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa05015e5d0 0x7fa0500d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.676+0000 7fa057e2e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa05006cec0 con 0x7fa05009b140 2024-09-12T01:57:00.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.676+0000 7fa057e2e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa05006d1a0 con 0x7fa05006df60 2024-09-12T01:57:00.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.676+0000 7fa057e2e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa05006dad0 con 0x7fa05015e5d0 2024-09-12T01:57:00.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.676+0000 7fa055bca640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa05015e5d0 0x7fa0500d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.676+0000 7fa0563cb640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa05009b140 0x7fa050168560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43880/0 (socket says 172.21.15.19:43880) 2024-09-12T01:57:00.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.676+0000 7fa0563cb640 1 -- 172.21.15.19:0/20249046 learned_addr learned my addr 172.21.15.19:0/20249046 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:00.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.676+0000 7fa055bca640 1 -- 172.21.15.19:0/20249046 >> v1:172.21.15.135:6789/0 conn(0x7fa05006df60 legacy=0x7fa05009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:00.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.676+0000 7fa055bca640 1 -- 172.21.15.19:0/20249046 >> v1:172.21.15.19:6789/0 conn(0x7fa05009b140 legacy=0x7fa050168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.676+0000 7fa055bca640 1 -- 172.21.15.19:0/20249046 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05006d480 con 0x7fa05015e5d0 2024-09-12T01:57:00.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.676+0000 7fa054bc8640 1 -- 172.21.15.19:0/20249046 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1303504624 0 0) 0x7fa05006cec0 con 0x7fa05009b140 2024-09-12T01:57:00.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.677+0000 7fa055bca640 1 --2- 172.21.15.19:0/20249046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05015e5d0 0x7fa0500d10f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa04c0097d0 tx=0x7fa04c02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4d4c2eb057350b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:00.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.677+0000 7fa054bc8640 1 -- 172.21.15.19:0/20249046 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c037070 con 0x7fa05015e5d0 2024-09-12T01:57:00.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.677+0000 7fa054bc8640 1 -- 172.21.15.19:0/20249046 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa04c032440 con 0x7fa05015e5d0 2024-09-12T01:57:00.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.677+0000 7fa054bc8640 1 -- 172.21.15.19:0/20249046 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c032810 con 0x7fa05015e5d0 2024-09-12T01:57:00.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.678+0000 7fa057e2e640 1 -- 172.21.15.19:0/20249046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05015e5d0 msgr2=0x7fa0500d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.678+0000 7fa057e2e640 1 --2- 172.21.15.19:0/20249046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05015e5d0 0x7fa0500d10f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa04c0097d0 tx=0x7fa04c02a290 comp rx=0 tx=0).stop 2024-09-12T01:57:00.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.678+0000 7fa057e2e640 1 -- 172.21.15.19:0/20249046 shutdown_connections 2024-09-12T01:57:00.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.678+0000 7fa057e2e640 1 --2- 172.21.15.19:0/20249046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05015e5d0 0x7fa0500d10f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.678+0000 7fa057e2e640 1 -- 172.21.15.19:0/20249046 >> 172.21.15.19:0/20249046 conn(0x7fa0500d23a0 msgr2=0x7fa0500d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:00.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.678+0000 7fa057e2e640 1 -- 172.21.15.19:0/20249046 shutdown_connections 2024-09-12T01:57:00.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.678+0000 7fa057e2e640 1 -- 172.21.15.19:0/20249046 wait complete. 2024-09-12T01:57:00.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.679+0000 7fa057e2e640 1 Processor -- start 2024-09-12T01:57:00.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.679+0000 7fa057e2e640 1 -- start start 2024-09-12T01:57:00.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.680+0000 7fa057e2e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa05006df60 0x7fa050071710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.680+0000 7fa057e2e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05009b140 0x7fa0500c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.680+0000 7fa057e2e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa05015e5d0 0x7fa0500b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.680+0000 7fa057e2e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa05015eb30 con 0x7fa05009b140 2024-09-12T01:57:00.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.680+0000 7fa057e2e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa05015e9b0 con 0x7fa05015e5d0 2024-09-12T01:57:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.680+0000 7fa057e2e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa0500d1630 con 0x7fa05006df60 2024-09-12T01:57:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.680+0000 7fa0553c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05009b140 0x7fa0500c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.680+0000 7fa0553c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05009b140 0x7fa0500c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53268/0 (socket says 172.21.15.19:53268) 2024-09-12T01:57:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.680+0000 7fa0553c9640 1 -- 172.21.15.19:0/2467341549 learned_addr learned my addr 172.21.15.19:0/2467341549 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.680+0000 7fa0553c9640 1 -- 172.21.15.19:0/2467341549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa05006df60 msgr2=0x7fa050071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.680+0000 7fa0553c9640 1 --2- 172.21.15.19:0/2467341549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa05006df60 0x7fa050071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.680+0000 7fa0563cb640 1 --2- 172.21.15.19:0/2467341549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa05015e5d0 0x7fa0500b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.680+0000 7fa0553c9640 1 -- 172.21.15.19:0/2467341549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa05015e5d0 msgr2=0x7fa0500b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.680+0000 7fa0553c9640 1 --2- 172.21.15.19:0/2467341549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa05015e5d0 0x7fa0500b1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.680+0000 7fa0553c9640 1 -- 172.21.15.19:0/2467341549 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0500b06e0 con 0x7fa05009b140 2024-09-12T01:57:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.681+0000 7fa0553c9640 1 --2- 172.21.15.19:0/2467341549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05009b140 0x7fa0500c88c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa04000c410 tx=0x7fa04000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.681+0000 7fa0467fc640 1 -- 172.21.15.19:0/2467341549 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa040017070 con 0x7fa05009b140 2024-09-12T01:57:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.681+0000 7fa0467fc640 1 -- 172.21.15.19:0/2467341549 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0400035f0 con 0x7fa05009b140 2024-09-12T01:57:00.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.681+0000 7fa0467fc640 1 -- 172.21.15.19:0/2467341549 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa040003a20 con 0x7fa05009b140 2024-09-12T01:57:00.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.681+0000 7fa057e2e640 1 -- 172.21.15.19:0/2467341549 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0500b0400 con 0x7fa05009b140 2024-09-12T01:57:00.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.681+0000 7fa057e2e640 1 -- 172.21.15.19:0/2467341549 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa050070f10 con 0x7fa05009b140 2024-09-12T01:57:00.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.682+0000 7fa057e2e640 1 -- 172.21.15.19:0/2467341549 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0500d10f0 con 0x7fa05009b140 2024-09-12T01:57:00.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.682+0000 7fa0467fc640 1 -- 172.21.15.19:0/2467341549 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa040003bc0 con 0x7fa05009b140 2024-09-12T01:57:00.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.683+0000 7fa0467fc640 1 --2- 172.21.15.19:0/2467341549 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa03406be30 0x7fa03406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.683+0000 7fa0467fc640 1 -- 172.21.15.19:0/2467341549 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fa04008a380 con 0x7fa05009b140 2024-09-12T01:57:00.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.683+0000 7fa055bca640 1 --2- 172.21.15.19:0/2467341549 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa03406be30 0x7fa03406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.684+0000 7fa055bca640 1 --2- 172.21.15.19:0/2467341549 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa03406be30 0x7fa03406e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa04c034000 tx=0x7fa04c02c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:00.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.687+0000 7fa0467fc640 1 -- 172.21.15.19:0/2467341549 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa040058b20 con 0x7fa05009b140 2024-09-12T01:57:00.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.900+0000 7fa057e2e640 1 -- 172.21.15.19:0/2467341549 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa0500b8320 con 0x7fa05009b140 2024-09-12T01:57:00.901 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T01:57:00.901+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:57:00.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.902+0000 7fa0467fc640 1 -- 172.21.15.19:0/2467341549 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) ==== 161+0+0 (secure 0 0 0) 0x7fa0400010c0 con 0x7fa05009b140 2024-09-12T01:57:00.902 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:57:00.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.904+0000 7fa057e2e640 1 -- 172.21.15.19:0/2467341549 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa03406be30 msgr2=0x7fa03406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.904+0000 7fa057e2e640 1 --2- 172.21.15.19:0/2467341549 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa03406be30 0x7fa03406e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa04c034000 tx=0x7fa04c02c000 comp rx=0 tx=0).stop 2024-09-12T01:57:00.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.904+0000 7fa057e2e640 1 -- 172.21.15.19:0/2467341549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05009b140 msgr2=0x7fa0500c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.904+0000 7fa057e2e640 1 --2- 172.21.15.19:0/2467341549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05009b140 0x7fa0500c88c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa04000c410 tx=0x7fa04000c8d0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.904+0000 7fa057e2e640 1 -- 172.21.15.19:0/2467341549 shutdown_connections 2024-09-12T01:57:00.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.904+0000 7fa057e2e640 1 --2- 172.21.15.19:0/2467341549 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa03406be30 0x7fa03406e2f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.904+0000 7fa057e2e640 1 --2- 172.21.15.19:0/2467341549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa05015e5d0 0x7fa0500b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.904+0000 7fa057e2e640 1 --2- 172.21.15.19:0/2467341549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05009b140 0x7fa0500c88c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.904+0000 7fa057e2e640 1 --2- 172.21.15.19:0/2467341549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa05006df60 0x7fa050071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.904+0000 7fa057e2e640 1 -- 172.21.15.19:0/2467341549 >> 172.21.15.19:0/2467341549 conn(0x7fa0500d23a0 msgr2=0x7fa0500d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:00.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.904+0000 7fa057e2e640 1 -- 172.21.15.19:0/2467341549 shutdown_connections 2024-09-12T01:57:00.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.904+0000 7fa057e2e640 1 -- 172.21.15.19:0/2467341549 wait complete. 2024-09-12T01:57:00.909 INFO:tasks.ceph.mds.c.smithi019.stderr: -4560> 2024-09-12T01:56:53.916+0000 7f9fae4e3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:57:00.920 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-09-12T01:57:00.944 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T01:57:00.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.966+0000 7fe565c3cf40 1 Processor -- start 2024-09-12T01:57:00.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.966+0000 7fe565c3cf40 1 -- start start 2024-09-12T01:57:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.966+0000 7fe565c3cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2320bb9e0 0x55b232181c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe565c3cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2321048e0 0x55b232182300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe565c3cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b232192fb0 0x55b23218dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe565c3cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b23200d510 con 0x55b2321048e0 2024-09-12T01:57:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe565c3cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b2320bbf20 con 0x55b232192fb0 2024-09-12T01:57:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe565c3cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55b23218e880 con 0x55b2320bb9e0 2024-09-12T01:57:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe562f33640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2321048e0 0x55b232182300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe562f33640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2321048e0 0x55b232182300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53292/0 (socket says 172.21.15.19:53292) 2024-09-12T01:57:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe562f33640 1 -- 172.21.15.19:0/2205362385 learned_addr learned my addr 172.21.15.19:0/2205362385 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe563734640 1 --2- 172.21.15.19:0/2205362385 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2320bb9e0 0x55b232181c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe563f35640 1 --2- 172.21.15.19:0/2205362385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b232192fb0 0x55b23218dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe562f33640 1 -- 172.21.15.19:0/2205362385 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2320bb9e0 msgr2=0x55b232181c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe562f33640 1 --2- 172.21.15.19:0/2205362385 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2320bb9e0 0x55b232181c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe562f33640 1 -- 172.21.15.19:0/2205362385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b232192fb0 msgr2=0x55b23218dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe562f33640 1 --2- 172.21.15.19:0/2205362385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b232192fb0 0x55b23218dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe562f33640 1 -- 172.21.15.19:0/2205362385 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b23218eb20 con 0x55b2321048e0 2024-09-12T01:57:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe563f35640 1 --2- 172.21.15.19:0/2205362385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b232192fb0 0x55b23218dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe562f33640 1 --2- 172.21.15.19:0/2205362385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2321048e0 0x55b232182300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe55800a770 tx=0x7fe55800a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b62072fb405189f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe561f31640 1 -- 172.21.15.19:0/2205362385 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe558018070 con 0x55b2321048e0 2024-09-12T01:57:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe561f31640 1 -- 172.21.15.19:0/2205362385 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe558007600 con 0x55b2321048e0 2024-09-12T01:57:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.967+0000 7fe561f31640 1 -- 172.21.15.19:0/2205362385 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5580079b0 con 0x55b2321048e0 2024-09-12T01:57:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.968+0000 7fe565c3cf40 1 -- 172.21.15.19:0/2205362385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2321048e0 msgr2=0x55b232182300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.968+0000 7fe565c3cf40 1 --2- 172.21.15.19:0/2205362385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2321048e0 0x55b232182300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe55800a770 tx=0x7fe55800a860 comp rx=0 tx=0).stop 2024-09-12T01:57:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.968+0000 7fe565c3cf40 1 -- 172.21.15.19:0/2205362385 shutdown_connections 2024-09-12T01:57:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.968+0000 7fe565c3cf40 1 --2- 172.21.15.19:0/2205362385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b232192fb0 0x55b23218dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.968+0000 7fe565c3cf40 1 --2- 172.21.15.19:0/2205362385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2321048e0 0x55b232182300 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.968+0000 7fe565c3cf40 1 --2- 172.21.15.19:0/2205362385 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2320bb9e0 0x55b232181c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.968+0000 7fe565c3cf40 1 -- 172.21.15.19:0/2205362385 >> 172.21.15.19:0/2205362385 conn(0x55b2320e9490 msgr2=0x55b2320e9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.968+0000 7fe565c3cf40 1 -- 172.21.15.19:0/2205362385 shutdown_connections 2024-09-12T01:57:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.968+0000 7fe565c3cf40 1 -- 172.21.15.19:0/2205362385 wait complete. 2024-09-12T01:57:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.968+0000 7fe565c3cf40 1 Processor -- start 2024-09-12T01:57:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.968+0000 7fe565c3cf40 1 -- start start 2024-09-12T01:57:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.969+0000 7fe565c3cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2320bb9e0 0x55b232187be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.969+0000 7fe565c3cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2321048e0 0x55b232101600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.969+0000 7fe565c3cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b232192fb0 0x55b232101b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.969+0000 7fe565c3cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b23218f0e0 con 0x55b2320bb9e0 2024-09-12T01:57:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.969+0000 7fe565c3cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b23218ee00 con 0x55b232192fb0 2024-09-12T01:57:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.969+0000 7fe565c3cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55b23218d7e0 con 0x55b2321048e0 2024-09-12T01:57:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.969+0000 7fe563734640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2320bb9e0 0x55b232187be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.969+0000 7fe563734640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2320bb9e0 0x55b232187be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53304/0 (socket says 172.21.15.19:53304) 2024-09-12T01:57:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.969+0000 7fe563734640 1 -- 172.21.15.19:0/2449531704 learned_addr learned my addr 172.21.15.19:0/2449531704 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.969+0000 7fe562f33640 1 --2- 172.21.15.19:0/2449531704 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2321048e0 0x55b232101600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.969+0000 7fe563f35640 1 --2- 172.21.15.19:0/2449531704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b232192fb0 0x55b232101b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.970+0000 7fe563734640 1 -- 172.21.15.19:0/2449531704 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2321048e0 msgr2=0x55b232101600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.970+0000 7fe563734640 1 --2- 172.21.15.19:0/2449531704 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2321048e0 0x55b232101600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.970+0000 7fe563734640 1 -- 172.21.15.19:0/2449531704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b232192fb0 msgr2=0x55b232101b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.970+0000 7fe563734640 1 --2- 172.21.15.19:0/2449531704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b232192fb0 0x55b232101b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.970+0000 7fe563734640 1 -- 172.21.15.19:0/2449531704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b23218b7d0 con 0x55b2320bb9e0 2024-09-12T01:57:00.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.970+0000 7fe563734640 1 --2- 172.21.15.19:0/2449531704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2320bb9e0 0x55b232187be0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe55400dfa0 tx=0x7fe55400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:00.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.970+0000 7fe560f2f640 1 -- 172.21.15.19:0/2449531704 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554011480 con 0x55b2320bb9e0 2024-09-12T01:57:00.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.970+0000 7fe560f2f640 1 -- 172.21.15.19:0/2449531704 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe554016070 con 0x55b2320bb9e0 2024-09-12T01:57:00.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.970+0000 7fe565c3cf40 1 -- 172.21.15.19:0/2449531704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b23218bab0 con 0x55b2320bb9e0 2024-09-12T01:57:00.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.970+0000 7fe560f2f640 1 -- 172.21.15.19:0/2449531704 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554011860 con 0x55b2320bb9e0 2024-09-12T01:57:00.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.970+0000 7fe565c3cf40 1 -- 172.21.15.19:0/2449531704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b23218c070 con 0x55b2320bb9e0 2024-09-12T01:57:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.971+0000 7fe560f2f640 1 -- 172.21.15.19:0/2449531704 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe554011a00 con 0x55b2320bb9e0 2024-09-12T01:57:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.972+0000 7fe560f2f640 1 --2- 172.21.15.19:0/2449531704 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe55006a810 0x7fe55006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.972+0000 7fe560f2f640 1 -- 172.21.15.19:0/2449531704 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7fe554089a90 con 0x55b2320bb9e0 2024-09-12T01:57:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.972+0000 7fe562f33640 1 --2- 172.21.15.19:0/2449531704 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe55006a810 0x7fe55006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.972+0000 7fe565c3cf40 1 --2- 172.21.15.19:0/2449531704 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55b232102660 0x55b232190660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.972+0000 7fe565c3cf40 1 -- 172.21.15.19:0/2449531704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) -- 0x55b232190ba0 con 0x55b232102660 2024-09-12T01:57:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.972+0000 7fe563f35640 1 --2- 172.21.15.19:0/2449531704 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55b232102660 0x55b232190660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.973+0000 7fe562f33640 1 --2- 172.21.15.19:0/2449531704 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe55006a810 0x7fe55006ccd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55b23218f3c0 tx=0x7fe55800c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.973+0000 7fe563f35640 1 --2- 172.21.15.19:0/2449531704 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55b232102660 0x55b232190660 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.974+0000 7fe563f35640 1 -- 172.21.15.19:0/2449531704 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v41'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe55c04f990 con 0x55b232102660 2024-09-12T01:57:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.974+0000 7fe565c3cf40 1 -- 172.21.15.19:0/2449531704 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55b232102660 msgr2=0x55b232190660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.974+0000 7fe565c3cf40 1 --2- 172.21.15.19:0/2449531704 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55b232102660 0x55b232190660 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.974+0000 7fe565c3cf40 1 -- 172.21.15.19:0/2449531704 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe55006a810 msgr2=0x7fe55006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.974+0000 7fe565c3cf40 1 --2- 172.21.15.19:0/2449531704 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe55006a810 0x7fe55006ccd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55b23218f3c0 tx=0x7fe55800c000 comp rx=0 tx=0).stop 2024-09-12T01:57:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.974+0000 7fe565c3cf40 1 -- 172.21.15.19:0/2449531704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2320bb9e0 msgr2=0x55b232187be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.974+0000 7fe565c3cf40 1 --2- 172.21.15.19:0/2449531704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2320bb9e0 0x55b232187be0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe55400dfa0 tx=0x7fe55400b5b0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.974+0000 7fe563f35640 1 -- 172.21.15.19:0/2449531704 reap_dead start 2024-09-12T01:57:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.974+0000 7fe565c3cf40 1 -- 172.21.15.19:0/2449531704 shutdown_connections 2024-09-12T01:57:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.974+0000 7fe565c3cf40 1 -- 172.21.15.19:0/2449531704 >> 172.21.15.19:0/2449531704 conn(0x55b2320e9490 msgr2=0x55b2320eb360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.974+0000 7fe565c3cf40 1 -- 172.21.15.19:0/2449531704 shutdown_connections 2024-09-12T01:57:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:00.974+0000 7fe565c3cf40 1 -- 172.21.15.19:0/2449531704 wait complete. 2024-09-12T01:57:00.978 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T01:57:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.123+0000 7f2746def640 1 Processor -- start 2024-09-12T01:57:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.123+0000 7f2746def640 1 -- start start 2024-09-12T01:57:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.124+0000 7f2746def640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f27400d15f0 0x7f27400cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.124+0000 7f2746def640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27400cf980 con 0x7f2740161a20 2024-09-12T01:57:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.124+0000 7f2746def640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f274006d050 con 0x7f27400cf160 2024-09-12T01:57:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.124+0000 7f2746def640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f2740161e00 con 0x7f27400d15f0 2024-09-12T01:57:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.124+0000 7f2744b8b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2740161a20 0x7f27400d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56814/0 (socket says 172.21.15.19:56814) 2024-09-12T01:57:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.124+0000 7f2744b8b640 1 -- 172.21.15.19:0/511607613 learned_addr learned my addr 172.21.15.19:0/511607613 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.124+0000 7f273ffff640 1 --2- 172.21.15.19:0/511607613 >> v2:172.21.15.135:3300/0 conn(0x7f27400d15f0 0x7f27400cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.124+0000 7f273f7fe640 1 -- 172.21.15.19:0/511607613 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4159537218 0 0) 0x7f27400cf980 con 0x7f2740161a20 2024-09-12T01:57:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.124+0000 7f273f7fe640 1 -- 172.21.15.19:0/511607613 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2730003520 con 0x7f2740161a20 2024-09-12T01:57:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.124+0000 7f273f7fe640 1 -- 172.21.15.19:0/511607613 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1836692246 0 0) 0x7f274006d050 con 0x7f27400cf160 2024-09-12T01:57:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.124+0000 7f273f7fe640 1 -- 172.21.15.19:0/511607613 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27400cf980 con 0x7f27400cf160 2024-09-12T01:57:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.124+0000 7f273ffff640 1 -- 172.21.15.19:0/511607613 >> v1:172.21.15.135:6789/0 conn(0x7f27400cf160 legacy=0x7f274006d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.124+0000 7f273ffff640 1 -- 172.21.15.19:0/511607613 >> v1:172.21.15.19:6789/0 conn(0x7f2740161a20 legacy=0x7f27400d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.124+0000 7f273f7fe640 1 -- 172.21.15.19:0/511607613 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4240441810 0 0) 0x7f2730003520 con 0x7f2740161a20 2024-09-12T01:57:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.124+0000 7f273ffff640 1 -- 172.21.15.19:0/511607613 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27400cfc20 con 0x7f27400d15f0 2024-09-12T01:57:01.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.125+0000 7f273ffff640 1 --2- 172.21.15.19:0/511607613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27400d15f0 0x7f27400cec20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f272c0097a0 tx=0x7f272c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17d323a26e44ce90 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:01.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.125+0000 7f273f7fe640 1 -- 172.21.15.19:0/511607613 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c037070 con 0x7f27400d15f0 2024-09-12T01:57:01.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.125+0000 7f273f7fe640 1 -- 172.21.15.19:0/511607613 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f272c02ac50 con 0x7f27400d15f0 2024-09-12T01:57:01.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.125+0000 7f273f7fe640 1 -- 172.21.15.19:0/511607613 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2734001690 con 0x7f27400d15f0 2024-09-12T01:57:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.126+0000 7f2746def640 1 -- 172.21.15.19:0/511607613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27400d15f0 msgr2=0x7f27400cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.126+0000 7f2746def640 1 --2- 172.21.15.19:0/511607613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27400d15f0 0x7f27400cec20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f272c0097a0 tx=0x7f272c02a1c0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.126+0000 7f2746def640 1 -- 172.21.15.19:0/511607613 shutdown_connections 2024-09-12T01:57:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.126+0000 7f2746def640 1 --2- 172.21.15.19:0/511607613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27400d15f0 0x7f27400cec20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.126+0000 7f2746def640 1 -- 172.21.15.19:0/511607613 >> 172.21.15.19:0/511607613 conn(0x7f274009d850 msgr2=0x7f274008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.126+0000 7f2746def640 1 -- 172.21.15.19:0/511607613 shutdown_connections 2024-09-12T01:57:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.126+0000 7f2746def640 1 -- 172.21.15.19:0/511607613 wait complete. 2024-09-12T01:57:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.127+0000 7f2746def640 1 Processor -- start 2024-09-12T01:57:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.127+0000 7f2746def640 1 -- start start 2024-09-12T01:57:01.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.128+0000 7f2746def640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27400cf160 0x7f27400b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:01.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.128+0000 7f2746def640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27400d15f0 0x7f27401529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:01.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.128+0000 7f2746def640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2740161a20 0x7f27400b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:01.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.128+0000 7f2746def640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f27400b1040 con 0x7f27400cf160 2024-09-12T01:57:01.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.128+0000 7f2746def640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f274006d2f0 con 0x7f27400d15f0 2024-09-12T01:57:01.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.128+0000 7f2746def640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f27400cf590 con 0x7f2740161a20 2024-09-12T01:57:01.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.128+0000 7f2744b8b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27400cf160 0x7f27400b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:01.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.128+0000 7f2744b8b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27400cf160 0x7f27400b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46176/0 (socket says 172.21.15.19:46176) 2024-09-12T01:57:01.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.128+0000 7f2744b8b640 1 -- 172.21.15.19:0/1484061761 learned_addr learned my addr 172.21.15.19:0/1484061761 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:01.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.128+0000 7f274538c640 1 --2- 172.21.15.19:0/1484061761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2740161a20 0x7f27400b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.128+0000 7f273ffff640 1 --2- 172.21.15.19:0/1484061761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27400d15f0 0x7f27401529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.129+0000 7f2744b8b640 1 -- 172.21.15.19:0/1484061761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2740161a20 msgr2=0x7f27400b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.129+0000 7f2744b8b640 1 --2- 172.21.15.19:0/1484061761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2740161a20 0x7f27400b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.129+0000 7f2744b8b640 1 -- 172.21.15.19:0/1484061761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27400d15f0 msgr2=0x7f27401529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.129+0000 7f2744b8b640 1 --2- 172.21.15.19:0/1484061761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27400d15f0 0x7f27401529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.129+0000 7f2744b8b640 1 -- 172.21.15.19:0/1484061761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2740152f00 con 0x7f27400cf160 2024-09-12T01:57:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.129+0000 7f273ffff640 1 --2- 172.21.15.19:0/1484061761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27400d15f0 0x7f27401529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.129+0000 7f2744b8b640 1 --2- 172.21.15.19:0/1484061761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27400cf160 0x7f27400b6390 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f273400c750 tx=0x7f273400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.129+0000 7f273d7fa640 1 -- 172.21.15.19:0/1484061761 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2734018070 con 0x7f27400cf160 2024-09-12T01:57:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.129+0000 7f273d7fa640 1 -- 172.21.15.19:0/1484061761 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27340072d0 con 0x7f27400cf160 2024-09-12T01:57:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.129+0000 7f2746def640 1 -- 172.21.15.19:0/1484061761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27400b52f0 con 0x7f27400cf160 2024-09-12T01:57:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.129+0000 7f273d7fa640 1 -- 172.21.15.19:0/1484061761 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27340047e0 con 0x7f27400cf160 2024-09-12T01:57:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.129+0000 7f2746def640 1 -- 172.21.15.19:0/1484061761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27400b58b0 con 0x7f27400cf160 2024-09-12T01:57:01.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.130+0000 7f2746def640 1 -- 172.21.15.19:0/1484061761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27400cec20 con 0x7f27400cf160 2024-09-12T01:57:01.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.130+0000 7f273d7fa640 1 -- 172.21.15.19:0/1484061761 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f273401b070 con 0x7f27400cf160 2024-09-12T01:57:01.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.131+0000 7f273d7fa640 1 --2- 172.21.15.19:0/1484061761 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f272406be30 0x7f272406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:01.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.131+0000 7f273d7fa640 1 -- 172.21.15.19:0/1484061761 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7f273408a3b0 con 0x7f27400cf160 2024-09-12T01:57:01.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.131+0000 7f273ffff640 1 --2- 172.21.15.19:0/1484061761 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f272406be30 0x7f272406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:01.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.132+0000 7f273ffff640 1 --2- 172.21.15.19:0/1484061761 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f272406be30 0x7f272406e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f272c034000 tx=0x7f272c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:01.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.135+0000 7f273d7fa640 1 -- 172.21.15.19:0/1484061761 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2740152f00 con 0x7f27400cf160 2024-09-12T01:57:01.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.347+0000 7f2746def640 1 -- 172.21.15.19:0/1484061761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f274015f0e0 con 0x7f27400cf160 2024-09-12T01:57:01.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.664+0000 7f273d7fa640 1 -- 172.21.15.19:0/1484061761 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v17) ==== 162+0+0 (secure 0 0 0) 0x7f27340585f0 con 0x7f27400cf160 2024-09-12T01:57:01.664 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T01:57:01.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.666+0000 7f2746def640 1 -- 172.21.15.19:0/1484061761 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f272406be30 msgr2=0x7f272406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:01.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.666+0000 7f2746def640 1 --2- 172.21.15.19:0/1484061761 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f272406be30 0x7f272406e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f272c034000 tx=0x7f272c02e000 comp rx=0 tx=0).stop 2024-09-12T01:57:01.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.666+0000 7f2746def640 1 -- 172.21.15.19:0/1484061761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27400cf160 msgr2=0x7f27400b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:01.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.666+0000 7f2746def640 1 --2- 172.21.15.19:0/1484061761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27400cf160 0x7f27400b6390 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f273400c750 tx=0x7f273400cc10 comp rx=0 tx=0).stop 2024-09-12T01:57:01.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.666+0000 7f2746def640 1 -- 172.21.15.19:0/1484061761 shutdown_connections 2024-09-12T01:57:01.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.666+0000 7f2746def640 1 --2- 172.21.15.19:0/1484061761 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f272406be30 0x7f272406e2f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.666+0000 7f2746def640 1 --2- 172.21.15.19:0/1484061761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2740161a20 0x7f27400b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.666+0000 7f2746def640 1 --2- 172.21.15.19:0/1484061761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27400d15f0 0x7f27401529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.666+0000 7f2746def640 1 --2- 172.21.15.19:0/1484061761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27400cf160 0x7f27400b6390 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.666+0000 7f2746def640 1 -- 172.21.15.19:0/1484061761 >> 172.21.15.19:0/1484061761 conn(0x7f274009d850 msgr2=0x7f27401584b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:01.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.666+0000 7f2746def640 1 -- 172.21.15.19:0/1484061761 shutdown_connections 2024-09-12T01:57:01.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.666+0000 7f2746def640 1 -- 172.21.15.19:0/1484061761 wait complete. 2024-09-12T01:57:01.681 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:57:01.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.785+0000 7f85127af640 1 Processor -- start 2024-09-12T01:57:01.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.785+0000 7f85127af640 1 -- start start 2024-09-12T01:57:01.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.785+0000 7f85127af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f850c161c80 0x7f850c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:01.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.785+0000 7f85127af640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f850c162060 0x7f850c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:01.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.785+0000 7f85127af640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f850c0b64b0 0x7f850c0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:01.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.785+0000 7f85127af640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f850c06e870 con 0x7f850c0b64b0 2024-09-12T01:57:01.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.785+0000 7f85127af640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f850c06d9f0 con 0x7f850c162060 2024-09-12T01:57:01.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.785+0000 7f85127af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f850c06dcd0 con 0x7f850c161c80 2024-09-12T01:57:01.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.786+0000 7f8510d4c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f850c0b64b0 0x7f850c0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:01.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.786+0000 7f8510d4c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f850c0b64b0 0x7f850c0b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46190/0 (socket says 172.21.15.19:46190) 2024-09-12T01:57:01.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.786+0000 7f8510d4c640 1 -- 172.21.15.19:0/2839120059 learned_addr learned my addr 172.21.15.19:0/2839120059 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:01.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.786+0000 7f850b7fe640 1 --2- 172.21.15.19:0/2839120059 >> v2:172.21.15.135:3300/0 conn(0x7f850c162060 0x7f850c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:01.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.786+0000 7f850bfff640 1 --2- 172.21.15.19:0/2839120059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f850c161c80 0x7f850c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:01.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.786+0000 7f8510d4c640 1 -- 172.21.15.19:0/2839120059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f850c161c80 msgr2=0x7f850c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:01.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.786+0000 7f8510d4c640 1 --2- 172.21.15.19:0/2839120059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f850c161c80 0x7f850c06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.786+0000 7f8510d4c640 1 -- 172.21.15.19:0/2839120059 >> v2:172.21.15.135:3300/0 conn(0x7f850c162060 msgr2=0x7f850c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:01.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.786+0000 7f8510d4c640 1 --2- 172.21.15.19:0/2839120059 >> v2:172.21.15.135:3300/0 conn(0x7f850c162060 0x7f850c0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.786+0000 7f8510d4c640 1 -- 172.21.15.19:0/2839120059 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850c06dfb0 con 0x7f850c0b64b0 2024-09-12T01:57:01.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.786+0000 7f850b7fe640 1 --2- 172.21.15.19:0/2839120059 >> v2:172.21.15.135:3300/0 conn(0x7f850c162060 0x7f850c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:01.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.786+0000 7f850bfff640 1 --2- 172.21.15.19:0/2839120059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f850c161c80 0x7f850c06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:01.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.787+0000 7f8510d4c640 1 --2- 172.21.15.19:0/2839120059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850c0b64b0 0x7f850c0b6960 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f850c0d0cb0 tx=0x7f850402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7fa4d5583f0893e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:01.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.787+0000 7f850affd640 1 -- 172.21.15.19:0/2839120059 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504036070 con 0x7f850c0b64b0 2024-09-12T01:57:01.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.787+0000 7f850affd640 1 -- 172.21.15.19:0/2839120059 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8504031600 con 0x7f850c0b64b0 2024-09-12T01:57:01.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.787+0000 7f850affd640 1 -- 172.21.15.19:0/2839120059 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85040319d0 con 0x7f850c0b64b0 2024-09-12T01:57:01.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.787+0000 7f85127af640 1 -- 172.21.15.19:0/2839120059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850c0b64b0 msgr2=0x7f850c0b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:01.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.787+0000 7f85127af640 1 --2- 172.21.15.19:0/2839120059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850c0b64b0 0x7f850c0b6960 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f850c0d0cb0 tx=0x7f850402a6a0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.787+0000 7f85127af640 1 -- 172.21.15.19:0/2839120059 shutdown_connections 2024-09-12T01:57:01.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.787+0000 7f85127af640 1 --2- 172.21.15.19:0/2839120059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850c0b64b0 0x7f850c0b6960 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.787+0000 7f85127af640 1 --2- 172.21.15.19:0/2839120059 >> v2:172.21.15.135:3300/0 conn(0x7f850c162060 0x7f850c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.787+0000 7f85127af640 1 --2- 172.21.15.19:0/2839120059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f850c161c80 0x7f850c06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.787+0000 7f85127af640 1 -- 172.21.15.19:0/2839120059 >> 172.21.15.19:0/2839120059 conn(0x7f850c0d44f0 msgr2=0x7f850c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:01.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.787+0000 7f85127af640 1 -- 172.21.15.19:0/2839120059 shutdown_connections 2024-09-12T01:57:01.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.787+0000 7f85127af640 1 -- 172.21.15.19:0/2839120059 wait complete. 2024-09-12T01:57:01.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.788+0000 7f85127af640 1 Processor -- start 2024-09-12T01:57:01.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.789+0000 7f85127af640 1 -- start start 2024-09-12T01:57:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.789+0000 7f85127af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f850c0b64b0 0x7f850c0b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.789+0000 7f85127af640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c161c80 0x7f850c0c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.789+0000 7f85127af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850c162060 0x7f850c0c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.789+0000 7f85127af640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f850c162500 con 0x7f850c162060 2024-09-12T01:57:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.789+0000 7f85127af640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f850c0d2aa0 con 0x7f850c161c80 2024-09-12T01:57:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.789+0000 7f85127af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f850c162680 con 0x7f850c0b64b0 2024-09-12T01:57:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.790+0000 7f8510d4c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850c162060 0x7f850c0c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.790+0000 7f8510d4c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850c162060 0x7f850c0c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46192/0 (socket says 172.21.15.19:46192) 2024-09-12T01:57:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.790+0000 7f8510d4c640 1 -- 172.21.15.19:0/853506249 learned_addr learned my addr 172.21.15.19:0/853506249 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.790+0000 7f850b7fe640 1 --2- 172.21.15.19:0/853506249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c161c80 0x7f850c0c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.790+0000 7f850bfff640 1 --2- 172.21.15.19:0/853506249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f850c0b64b0 0x7f850c0b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.790+0000 7f8510d4c640 1 -- 172.21.15.19:0/853506249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f850c0b64b0 msgr2=0x7f850c0b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.790+0000 7f8510d4c640 1 --2- 172.21.15.19:0/853506249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f850c0b64b0 0x7f850c0b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.790+0000 7f8510d4c640 1 -- 172.21.15.19:0/853506249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c161c80 msgr2=0x7f850c0c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.790+0000 7f8510d4c640 1 --2- 172.21.15.19:0/853506249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c161c80 0x7f850c0c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.790+0000 7f8510d4c640 1 -- 172.21.15.19:0/853506249 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850c0b2150 con 0x7f850c162060 2024-09-12T01:57:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.790+0000 7f850bfff640 1 --2- 172.21.15.19:0/853506249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f850c0b64b0 0x7f850c0b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.790+0000 7f8510d4c640 1 --2- 172.21.15.19:0/853506249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850c162060 0x7f850c0c8470 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8504034040 tx=0x7f8504004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.790+0000 7f8508ff9640 1 -- 172.21.15.19:0/853506249 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504036050 con 0x7f850c162060 2024-09-12T01:57:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.790+0000 7f8508ff9640 1 -- 172.21.15.19:0/853506249 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8504042070 con 0x7f850c162060 2024-09-12T01:57:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.790+0000 7f85127af640 1 -- 172.21.15.19:0/853506249 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f850c0b2430 con 0x7f850c162060 2024-09-12T01:57:01.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.790+0000 7f8508ff9640 1 -- 172.21.15.19:0/853506249 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504009510 con 0x7f850c162060 2024-09-12T01:57:01.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.790+0000 7f85127af640 1 -- 172.21.15.19:0/853506249 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f850c0b29f0 con 0x7f850c162060 2024-09-12T01:57:01.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.791+0000 7f85127af640 1 -- 172.21.15.19:0/853506249 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f850c06e330 con 0x7f850c162060 2024-09-12T01:57:01.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.792+0000 7f8508ff9640 1 -- 172.21.15.19:0/853506249 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8504007bd0 con 0x7f850c162060 2024-09-12T01:57:01.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.792+0000 7f8508ff9640 1 --2- 172.21.15.19:0/853506249 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f84f806be30 0x7f84f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:01.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.792+0000 7f8508ff9640 1 -- 172.21.15.19:0/853506249 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7f85040abff0 con 0x7f850c162060 2024-09-12T01:57:01.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.793+0000 7f850bfff640 1 --2- 172.21.15.19:0/853506249 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f84f806be30 0x7f84f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:01.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.793+0000 7f850bfff640 1 --2- 172.21.15.19:0/853506249 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f84f806be30 0x7f84f806e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0088b0 tx=0x7f84fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:01.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:01.797+0000 7f8508ff9640 1 -- 172.21.15.19:0/853506249 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f850407a130 con 0x7f850c162060 2024-09-12T01:57:02.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:02.008+0000 7f85127af640 1 -- 172.21.15.19:0/853506249 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f850c075790 con 0x7f850c162060 2024-09-12T01:57:02.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:02.008+0000 7f8508ff9640 1 -- 172.21.15.19:0/853506249 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5220 (secure 0 0 0) 0x7f850407e430 con 0x7f850c162060 2024-09-12T01:57:02.009 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:02.009 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":17,"btime":"2024-09-12T01:57:01:663886+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1979542220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1979542220},{"type":"v1","addr":"172.21.15.135:6836","nonce":1979542220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/809710386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":809710386},{"type":"v1","addr":"172.21.15.19:6835","nonce":809710386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1005776280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1005776280},{"type":"v1","addr":"172.21.15.135:6837","nonce":1005776280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:56:48.431829+0000","modified":"2024-09-12T01:57:01.663860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"c","rank":0,"incarnation":17,"state":"up:replay","state_seq":1,"addr":"172.21.15.19:6834/3554496273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3554496273},{"type":"v1","addr":"172.21.15.19:6834","nonce":3554496273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-09-12T01:57:02.009 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 17 2024-09-12T01:57:02.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:02.010+0000 7f85127af640 1 -- 172.21.15.19:0/853506249 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f84f806be30 msgr2=0x7f84f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:02.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:02.010+0000 7f85127af640 1 --2- 172.21.15.19:0/853506249 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f84f806be30 0x7f84f806e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0088b0 tx=0x7f84fc008040 comp rx=0 tx=0).stop 2024-09-12T01:57:02.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:02.010+0000 7f85127af640 1 -- 172.21.15.19:0/853506249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850c162060 msgr2=0x7f850c0c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:02.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:02.010+0000 7f85127af640 1 --2- 172.21.15.19:0/853506249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850c162060 0x7f850c0c8470 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8504034040 tx=0x7f8504004a40 comp rx=0 tx=0).stop 2024-09-12T01:57:02.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:02.010+0000 7f85127af640 1 -- 172.21.15.19:0/853506249 shutdown_connections 2024-09-12T01:57:02.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:02.010+0000 7f85127af640 1 --2- 172.21.15.19:0/853506249 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f84f806be30 0x7f84f806e2f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:02.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:02.010+0000 7f85127af640 1 --2- 172.21.15.19:0/853506249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850c162060 0x7f850c0c8470 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:02.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:02.010+0000 7f85127af640 1 --2- 172.21.15.19:0/853506249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c161c80 0x7f850c0c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:02.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:02.010+0000 7f85127af640 1 --2- 172.21.15.19:0/853506249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f850c0b64b0 0x7f850c0b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:02.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:02.010+0000 7f85127af640 1 -- 172.21.15.19:0/853506249 >> 172.21.15.19:0/853506249 conn(0x7f850c0d44f0 msgr2=0x7f850c06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:02.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:02.010+0000 7f85127af640 1 -- 172.21.15.19:0/853506249 shutdown_connections 2024-09-12T01:57:02.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:02.010+0000 7f85127af640 1 -- 172.21.15.19:0/853506249 wait complete. 2024-09-12T01:57:02.425 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:56:48.431829+0000', 'modified': '2024-09-12T01:57:01.663860+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 41, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5088}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5088': {'gid': 5088, 'name': 'c', 'rank': 0, 'incarnation': 17, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.19:6834/3554496273', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 3554496273}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 3554496273}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T01:57:02.425 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5088:up:replay 2024-09-12T01:57:03.426 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:57:03.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.542+0000 7fb7c8dc4640 1 Processor -- start 2024-09-12T01:57:03.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.542+0000 7fb7c8dc4640 1 -- start start 2024-09-12T01:57:03.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.543+0000 7fb7c8dc4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb7c415e760 0x7fb7c406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.543+0000 7fb7c8dc4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7c40d4fd0 0x7fb7c40cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.543+0000 7fb7c8dc4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7c40d2700 con 0x7fb7c40b3650 2024-09-12T01:57:03.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.543+0000 7fb7c8dc4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb7c40cedb0 con 0x7fb7c415e760 2024-09-12T01:57:03.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.543+0000 7fb7c8dc4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb7c40cf090 con 0x7fb7c40d4fd0 2024-09-12T01:57:03.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.543+0000 7fb7c259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb7c415e760 0x7fb7c406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.543+0000 7fb7c259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb7c415e760 0x7fb7c406cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46206/0 (socket says 172.21.15.19:46206) 2024-09-12T01:57:03.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.543+0000 7fb7c259c640 1 -- 172.21.15.19:0/3811484613 learned_addr learned my addr 172.21.15.19:0/3811484613 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:03.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.543+0000 7fb7c1d9b640 1 --2- 172.21.15.19:0/3811484613 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7c40d4fd0 0x7fb7c40cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.543+0000 7fb7c259c640 1 -- 172.21.15.19:0/3811484613 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7c40d4fd0 msgr2=0x7fb7c40cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:03.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.543+0000 7fb7c259c640 1 --2- 172.21.15.19:0/3811484613 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7c40d4fd0 0x7fb7c40cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.543+0000 7fb7c259c640 1 -- 172.21.15.19:0/3811484613 >> v1:172.21.15.19:6789/0 conn(0x7fb7c40b3650 legacy=0x7fb7c40d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:03.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.543+0000 7fb7c259c640 1 -- 172.21.15.19:0/3811484613 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c40b3c80 con 0x7fb7c415e760 2024-09-12T01:57:03.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.544+0000 7fb7c259c640 1 --2- 172.21.15.19:0/3811484613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7c415e760 0x7fb7c406cdd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009870 tx=0x7fb7b402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9b731c1ad8425b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:03.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.544+0000 7fb7c159a640 1 -- 172.21.15.19:0/3811484613 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4037070 con 0x7fb7c415e760 2024-09-12T01:57:03.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.544+0000 7fb7c159a640 1 -- 172.21.15.19:0/3811484613 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b4032440 con 0x7fb7c415e760 2024-09-12T01:57:03.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.544+0000 7fb7c159a640 1 -- 172.21.15.19:0/3811484613 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4032810 con 0x7fb7c415e760 2024-09-12T01:57:03.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.545+0000 7fb7c8dc4640 1 -- 172.21.15.19:0/3811484613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7c415e760 msgr2=0x7fb7c406cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:03.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.545+0000 7fb7c8dc4640 1 --2- 172.21.15.19:0/3811484613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7c415e760 0x7fb7c406cdd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009870 tx=0x7fb7b402a1c0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.545+0000 7fb7c8dc4640 1 -- 172.21.15.19:0/3811484613 shutdown_connections 2024-09-12T01:57:03.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.545+0000 7fb7c8dc4640 1 --2- 172.21.15.19:0/3811484613 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7c40d4fd0 0x7fb7c40cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.545+0000 7fb7c8dc4640 1 --2- 172.21.15.19:0/3811484613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7c415e760 0x7fb7c406cdd0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.545+0000 7fb7c8dc4640 1 -- 172.21.15.19:0/3811484613 >> 172.21.15.19:0/3811484613 conn(0x7fb7c408bfc0 msgr2=0x7fb7c40d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:03.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.545+0000 7fb7c8dc4640 1 -- 172.21.15.19:0/3811484613 shutdown_connections 2024-09-12T01:57:03.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.545+0000 7fb7c8dc4640 1 -- 172.21.15.19:0/3811484613 wait complete. 2024-09-12T01:57:03.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.546+0000 7fb7c8dc4640 1 Processor -- start 2024-09-12T01:57:03.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.546+0000 7fb7c8dc4640 1 -- start start 2024-09-12T01:57:03.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.547+0000 7fb7c8dc4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7c40b3650 0x7fb7c415a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.547+0000 7fb7c8dc4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7c40d4fd0 0x7fb7c4156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.547+0000 7fb7c8dc4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7c415e760 0x7fb7c40cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.547+0000 7fb7c8dc4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c40cfe80 con 0x7fb7c40d4fd0 2024-09-12T01:57:03.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.547+0000 7fb7c8dc4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c40cfd00 con 0x7fb7c415e760 2024-09-12T01:57:03.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.547+0000 7fb7c8dc4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb7c40d35b0 con 0x7fb7c40b3650 2024-09-12T01:57:03.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.547+0000 7fb7c1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7c40d4fd0 0x7fb7c4156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.547+0000 7fb7c1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7c40d4fd0 0x7fb7c4156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46218/0 (socket says 172.21.15.19:46218) 2024-09-12T01:57:03.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.547+0000 7fb7c1d9b640 1 -- 172.21.15.19:0/3679061908 learned_addr learned my addr 172.21.15.19:0/3679061908 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:03.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.548+0000 7fb7c259c640 1 --2- 172.21.15.19:0/3679061908 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7c40b3650 0x7fb7c415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.548+0000 7fb7c2d9d640 1 --2- 172.21.15.19:0/3679061908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7c415e760 0x7fb7c40cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.548+0000 7fb7c1d9b640 1 -- 172.21.15.19:0/3679061908 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7c40b3650 msgr2=0x7fb7c415a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:03.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.548+0000 7fb7c1d9b640 1 --2- 172.21.15.19:0/3679061908 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7c40b3650 0x7fb7c415a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.548+0000 7fb7c1d9b640 1 -- 172.21.15.19:0/3679061908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7c415e760 msgr2=0x7fb7c40cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:03.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.548+0000 7fb7c1d9b640 1 --2- 172.21.15.19:0/3679061908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7c415e760 0x7fb7c40cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.548+0000 7fb7c1d9b640 1 -- 172.21.15.19:0/3679061908 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c40cc880 con 0x7fb7c40d4fd0 2024-09-12T01:57:03.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.548+0000 7fb7c1d9b640 1 --2- 172.21.15.19:0/3679061908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7c40d4fd0 0x7fb7c4156dc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00d7d0 tx=0x7fb7ac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:03.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.548+0000 7fb7baffd640 1 -- 172.21.15.19:0/3679061908 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac004020 con 0x7fb7c40d4fd0 2024-09-12T01:57:03.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.548+0000 7fb7baffd640 1 -- 172.21.15.19:0/3679061908 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ac0041c0 con 0x7fb7c40d4fd0 2024-09-12T01:57:03.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.548+0000 7fb7c8dc4640 1 -- 172.21.15.19:0/3679061908 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7c40ccb60 con 0x7fb7c40d4fd0 2024-09-12T01:57:03.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.548+0000 7fb7baffd640 1 -- 172.21.15.19:0/3679061908 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac0043b0 con 0x7fb7c40d4fd0 2024-09-12T01:57:03.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.548+0000 7fb7c8dc4640 1 -- 172.21.15.19:0/3679061908 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7c40cd120 con 0x7fb7c40d4fd0 2024-09-12T01:57:03.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.549+0000 7fb7c8dc4640 1 -- 172.21.15.19:0/3679061908 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7c40d3980 con 0x7fb7c40d4fd0 2024-09-12T01:57:03.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.550+0000 7fb7baffd640 1 -- 172.21.15.19:0/3679061908 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7ac01b020 con 0x7fb7c40d4fd0 2024-09-12T01:57:03.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.550+0000 7fb7baffd640 1 --2- 172.21.15.19:0/3679061908 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb7a406be60 0x7fb7a406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.551+0000 7fb7baffd640 1 -- 172.21.15.19:0/3679061908 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7fb7ac08aa30 con 0x7fb7c40d4fd0 2024-09-12T01:57:03.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.551+0000 7fb7c259c640 1 --2- 172.21.15.19:0/3679061908 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb7a406be60 0x7fb7a406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.552+0000 7fb7c259c640 1 --2- 172.21.15.19:0/3679061908 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb7a406be60 0x7fb7a406e320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4034000 tx=0x7fb7b402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:03.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.555+0000 7fb7baffd640 1 -- 172.21.15.19:0/3679061908 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7ac022020 con 0x7fb7c40d4fd0 2024-09-12T01:57:03.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.767+0000 7fb7c8dc4640 1 -- 172.21.15.19:0/3679061908 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7c40b6d20 con 0x7fb7c40d4fd0 2024-09-12T01:57:03.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.768+0000 7fb7baffd640 1 -- 172.21.15.19:0/3679061908 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5220 (secure 0 0 0) 0x7fb7ac058c40 con 0x7fb7c40d4fd0 2024-09-12T01:57:03.768 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:03.768 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":19,"btime":"2024-09-12T01:57:03:672471+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1979542220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1979542220},{"type":"v1","addr":"172.21.15.135:6836","nonce":1979542220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/809710386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":809710386},{"type":"v1","addr":"172.21.15.19:6835","nonce":809710386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1005776280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1005776280},{"type":"v1","addr":"172.21.15.135:6837","nonce":1005776280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:56:48.431829+0000","modified":"2024-09-12T01:57:02.673863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"c","rank":0,"incarnation":17,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.19:6834/3554496273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3554496273},{"type":"v1","addr":"172.21.15.19:6834","nonce":3554496273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-09-12T01:57:03.768 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 19 2024-09-12T01:57:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.769+0000 7fb7c8dc4640 1 -- 172.21.15.19:0/3679061908 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb7a406be60 msgr2=0x7fb7a406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.769+0000 7fb7c8dc4640 1 --2- 172.21.15.19:0/3679061908 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb7a406be60 0x7fb7a406e320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4034000 tx=0x7fb7b402e000 comp rx=0 tx=0).stop 2024-09-12T01:57:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.769+0000 7fb7c8dc4640 1 -- 172.21.15.19:0/3679061908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7c40d4fd0 msgr2=0x7fb7c4156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.769+0000 7fb7c8dc4640 1 --2- 172.21.15.19:0/3679061908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7c40d4fd0 0x7fb7c4156dc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00d7d0 tx=0x7fb7ac00dc90 comp rx=0 tx=0).stop 2024-09-12T01:57:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.769+0000 7fb7c8dc4640 1 -- 172.21.15.19:0/3679061908 shutdown_connections 2024-09-12T01:57:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.769+0000 7fb7c8dc4640 1 --2- 172.21.15.19:0/3679061908 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb7a406be60 0x7fb7a406e320 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.769+0000 7fb7c8dc4640 1 --2- 172.21.15.19:0/3679061908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7c415e760 0x7fb7c40cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.769+0000 7fb7c8dc4640 1 --2- 172.21.15.19:0/3679061908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7c40d4fd0 0x7fb7c4156dc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.769+0000 7fb7c8dc4640 1 --2- 172.21.15.19:0/3679061908 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7c40b3650 0x7fb7c415a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.769+0000 7fb7c8dc4640 1 -- 172.21.15.19:0/3679061908 >> 172.21.15.19:0/3679061908 conn(0x7fb7c408bfc0 msgr2=0x7fb7c40d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:03.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.770+0000 7fb7c8dc4640 1 -- 172.21.15.19:0/3679061908 shutdown_connections 2024-09-12T01:57:03.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:03.770+0000 7fb7c8dc4640 1 -- 172.21.15.19:0/3679061908 wait complete. 2024-09-12T01:57:04.185 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:56:48.431829+0000', 'modified': '2024-09-12T01:57:02.673863+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 41, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5088}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5088': {'gid': 5088, 'name': 'c', 'rank': 0, 'incarnation': 17, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.19:6834/3554496273', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 3554496273}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 3554496273}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T01:57:04.185 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5088:up:rejoin 2024-09-12T01:57:05.188 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:57:05.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.304+0000 7f1546445640 1 Processor -- start 2024-09-12T01:57:05.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.304+0000 7f1546445640 1 -- start start 2024-09-12T01:57:05.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f1546445640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f15400b6680 0x7f1540169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f1546445640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f154006d9f0 con 0x7f1540161c80 2024-09-12T01:57:05.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f1546445640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f154006dcd0 con 0x7f1540162060 2024-09-12T01:57:05.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f1546445640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f154006dfb0 con 0x7f15400b6680 2024-09-12T01:57:05.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f153ffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1540161c80 0x7f154006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56832/0 (socket says 172.21.15.19:56832) 2024-09-12T01:57:05.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f153ffff640 1 -- 172.21.15.19:0/3212600683 learned_addr learned my addr 172.21.15.19:0/3212600683 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:05.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f15449e2640 1 --2- 172.21.15.19:0/3212600683 >> v2:172.21.15.135:3300/0 conn(0x7f15400b6680 0x7f1540169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f153effd640 1 -- 172.21.15.19:0/3212600683 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 750538234 0 0) 0x7f154006d9f0 con 0x7f1540161c80 2024-09-12T01:57:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f153effd640 1 -- 172.21.15.19:0/3212600683 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1528003520 con 0x7f1540161c80 2024-09-12T01:57:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f153effd640 1 -- 172.21.15.19:0/3212600683 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 598544865 0 0) 0x7f1528003520 con 0x7f1540161c80 2024-09-12T01:57:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f153effd640 1 -- 172.21.15.19:0/3212600683 >> v2:172.21.15.135:3300/0 conn(0x7f15400b6680 msgr2=0x7f1540169830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f153effd640 1 --2- 172.21.15.19:0/3212600683 >> v2:172.21.15.135:3300/0 conn(0x7f15400b6680 0x7f1540169830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f153effd640 1 -- 172.21.15.19:0/3212600683 >> v1:172.21.15.135:6789/0 conn(0x7f1540162060 legacy=0x7f15400b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f153effd640 1 -- 172.21.15.19:0/3212600683 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15400d01f0 con 0x7f1540161c80 2024-09-12T01:57:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f153effd640 1 -- 172.21.15.19:0/3212600683 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f1530001670 con 0x7f1540161c80 2024-09-12T01:57:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f153effd640 1 -- 172.21.15.19:0/3212600683 >> v1:172.21.15.19:6789/0 conn(0x7f1540161c80 legacy=0x7f154006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f153effd640 1 --2- 172.21.15.19:0/3212600683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15280039b0 0x7f1528003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f153effd640 1 --2- 172.21.15.19:0/3212600683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1528004800 0x7f1528004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f153effd640 1 --2- 172.21.15.19:0/3212600683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15280051c0 0x7f152800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f153effd640 1 -- 172.21.15.19:0/3212600683 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f154006dfb0 con 0x7f15280039b0 2024-09-12T01:57:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f153effd640 1 -- 172.21.15.19:0/3212600683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f152800c060 con 0x7f15280051c0 2024-09-12T01:57:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.305+0000 7f153effd640 1 -- 172.21.15.19:0/3212600683 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f152800c260 con 0x7f1528004800 2024-09-12T01:57:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.306+0000 7f153ffff640 1 --2- 172.21.15.19:0/3212600683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15280039b0 0x7f1528003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.306+0000 7f153f7fe640 1 --2- 172.21.15.19:0/3212600683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1528004800 0x7f1528004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.306+0000 7f15449e2640 1 --2- 172.21.15.19:0/3212600683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15280051c0 0x7f152800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.306+0000 7f153ffff640 1 -- 172.21.15.19:0/3212600683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1528004800 msgr2=0x7f1528004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.306+0000 7f153ffff640 1 --2- 172.21.15.19:0/3212600683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1528004800 0x7f1528004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.306+0000 7f153ffff640 1 -- 172.21.15.19:0/3212600683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15280051c0 msgr2=0x7f152800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.306+0000 7f153ffff640 1 --2- 172.21.15.19:0/3212600683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15280051c0 0x7f152800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.306+0000 7f15449e2640 1 -- 172.21.15.19:0/3212600683 reap_dead start 2024-09-12T01:57:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.306+0000 7f153ffff640 1 -- 172.21.15.19:0/3212600683 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1528003520 con 0x7f15280039b0 2024-09-12T01:57:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.307+0000 7f153ffff640 1 --2- 172.21.15.19:0/3212600683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15280039b0 0x7f1528003dd0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f153000c210 tx=0x7f1528005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45881128ba20cf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.307+0000 7f153effd640 1 -- 172.21.15.19:0/3212600683 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530007d30 con 0x7f15280039b0 2024-09-12T01:57:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.307+0000 7f153effd640 1 -- 172.21.15.19:0/3212600683 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1530005ad0 con 0x7f15280039b0 2024-09-12T01:57:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.307+0000 7f153effd640 1 -- 172.21.15.19:0/3212600683 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530007070 con 0x7f15280039b0 2024-09-12T01:57:05.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.307+0000 7f1546445640 1 -- 172.21.15.19:0/3212600683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15280039b0 msgr2=0x7f1528003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:05.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.307+0000 7f1546445640 1 --2- 172.21.15.19:0/3212600683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15280039b0 0x7f1528003dd0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f153000c210 tx=0x7f1528005830 comp rx=0 tx=0).stop 2024-09-12T01:57:05.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.307+0000 7f1546445640 1 -- 172.21.15.19:0/3212600683 shutdown_connections 2024-09-12T01:57:05.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.307+0000 7f1546445640 1 --2- 172.21.15.19:0/3212600683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15280039b0 0x7f1528003dd0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.307+0000 7f1546445640 1 -- 172.21.15.19:0/3212600683 >> 172.21.15.19:0/3212600683 conn(0x7f15400d44f0 msgr2=0x7f15400d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:05.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.307+0000 7f1546445640 1 -- 172.21.15.19:0/3212600683 shutdown_connections 2024-09-12T01:57:05.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.307+0000 7f1546445640 1 -- 172.21.15.19:0/3212600683 wait complete. 2024-09-12T01:57:05.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.309+0000 7f1546445640 1 Processor -- start 2024-09-12T01:57:05.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.309+0000 7f1546445640 1 -- start start 2024-09-12T01:57:05.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.310+0000 7f1546445640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15280039b0 0x7f1540159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.310+0000 7f1546445640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15400cdf50 0x7f15400b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.310+0000 7f1546445640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15400ce3d0 0x7f15400b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.310+0000 7f1546445640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f15400b6b30 con 0x7f15280039b0 2024-09-12T01:57:05.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.310+0000 7f1546445640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f15400d2aa0 con 0x7f15400cdf50 2024-09-12T01:57:05.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.310+0000 7f1546445640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f15400b6cb0 con 0x7f15400ce3d0 2024-09-12T01:57:05.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.310+0000 7f153ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15280039b0 0x7f1540159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.310+0000 7f153ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15280039b0 0x7f1540159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46236/0 (socket says 172.21.15.19:46236) 2024-09-12T01:57:05.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.310+0000 7f153ffff640 1 -- 172.21.15.19:0/1778371952 learned_addr learned my addr 172.21.15.19:0/1778371952 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:05.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.310+0000 7f15449e2640 1 --2- 172.21.15.19:0/1778371952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15400ce3d0 0x7f15400b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.310+0000 7f153f7fe640 1 --2- 172.21.15.19:0/1778371952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15400cdf50 0x7f15400b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.310+0000 7f153ffff640 1 -- 172.21.15.19:0/1778371952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15400ce3d0 msgr2=0x7f15400b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:05.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.310+0000 7f153ffff640 1 --2- 172.21.15.19:0/1778371952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15400ce3d0 0x7f15400b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.310+0000 7f153ffff640 1 -- 172.21.15.19:0/1778371952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15400cdf50 msgr2=0x7f15400b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:05.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.310+0000 7f153ffff640 1 --2- 172.21.15.19:0/1778371952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15400cdf50 0x7f15400b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.310+0000 7f153ffff640 1 -- 172.21.15.19:0/1778371952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15401f7dc0 con 0x7f15280039b0 2024-09-12T01:57:05.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.310+0000 7f153ffff640 1 --2- 172.21.15.19:0/1778371952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15280039b0 0x7f1540159470 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f153002adb0 tx=0x7f1530001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:05.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.310+0000 7f153cff9640 1 -- 172.21.15.19:0/1778371952 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530037040 con 0x7f15280039b0 2024-09-12T01:57:05.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.311+0000 7f153cff9640 1 -- 172.21.15.19:0/1778371952 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1530041070 con 0x7f15280039b0 2024-09-12T01:57:05.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.311+0000 7f1546445640 1 -- 172.21.15.19:0/1778371952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15401f80a0 con 0x7f15280039b0 2024-09-12T01:57:05.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.311+0000 7f153cff9640 1 -- 172.21.15.19:0/1778371952 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530001670 con 0x7f15280039b0 2024-09-12T01:57:05.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.311+0000 7f1546445640 1 -- 172.21.15.19:0/1778371952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15401f8660 con 0x7f15280039b0 2024-09-12T01:57:05.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.312+0000 7f1546445640 1 -- 172.21.15.19:0/1778371952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15400b5f70 con 0x7f15280039b0 2024-09-12T01:57:05.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.312+0000 7f153cff9640 1 -- 172.21.15.19:0/1778371952 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1530004a20 con 0x7f15280039b0 2024-09-12T01:57:05.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.313+0000 7f153cff9640 1 --2- 172.21.15.19:0/1778371952 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f152c06be60 0x7f152c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.313+0000 7f153cff9640 1 -- 172.21.15.19:0/1778371952 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7f15300aa940 con 0x7f15280039b0 2024-09-12T01:57:05.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.313+0000 7f153f7fe640 1 --2- 172.21.15.19:0/1778371952 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f152c06be60 0x7f152c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.313+0000 7f153f7fe640 1 --2- 172.21.15.19:0/1778371952 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f152c06be60 0x7f152c06e320 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1534000c00 tx=0x7f1534009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:05.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.317+0000 7f153cff9640 1 -- 172.21.15.19:0/1778371952 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1530078a20 con 0x7f15280039b0 2024-09-12T01:57:05.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.526+0000 7f1546445640 1 -- 172.21.15.19:0/1778371952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1540160a10 con 0x7f15280039b0 2024-09-12T01:57:05.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.526+0000 7f153cff9640 1 -- 172.21.15.19:0/1778371952 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5227 (secure 0 0 0) 0x7f153007cd20 con 0x7f15280039b0 2024-09-12T01:57:05.527 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:05.527 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"btime":"2024-09-12T01:57:04:677301+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1979542220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1979542220},{"type":"v1","addr":"172.21.15.135:6836","nonce":1979542220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/809710386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":809710386},{"type":"v1","addr":"172.21.15.19:6835","nonce":809710386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1005776280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1005776280},{"type":"v1","addr":"172.21.15.135:6837","nonce":1005776280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:56:48.431829+0000","modified":"2024-09-12T01:57:04.677295+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6834/3554496273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3554496273},{"type":"v1","addr":"172.21.15.19:6834","nonce":3554496273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5088,"qdb_cluster":[5088]},"id":2}]} 2024-09-12T01:57:05.528 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 20 2024-09-12T01:57:05.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.528+0000 7f1546445640 1 -- 172.21.15.19:0/1778371952 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f152c06be60 msgr2=0x7f152c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:05.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.528+0000 7f1546445640 1 --2- 172.21.15.19:0/1778371952 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f152c06be60 0x7f152c06e320 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1534000c00 tx=0x7f1534009040 comp rx=0 tx=0).stop 2024-09-12T01:57:05.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.528+0000 7f1546445640 1 -- 172.21.15.19:0/1778371952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15280039b0 msgr2=0x7f1540159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:05.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.528+0000 7f1546445640 1 --2- 172.21.15.19:0/1778371952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15280039b0 0x7f1540159470 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f153002adb0 tx=0x7f1530001a40 comp rx=0 tx=0).stop 2024-09-12T01:57:05.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.528+0000 7f1546445640 1 -- 172.21.15.19:0/1778371952 shutdown_connections 2024-09-12T01:57:05.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.528+0000 7f1546445640 1 --2- 172.21.15.19:0/1778371952 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f152c06be60 0x7f152c06e320 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.528+0000 7f1546445640 1 --2- 172.21.15.19:0/1778371952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15400ce3d0 0x7f15400b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.528+0000 7f1546445640 1 --2- 172.21.15.19:0/1778371952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15400cdf50 0x7f15400b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.528+0000 7f1546445640 1 --2- 172.21.15.19:0/1778371952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15280039b0 0x7f1540159470 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.528+0000 7f1546445640 1 -- 172.21.15.19:0/1778371952 >> 172.21.15.19:0/1778371952 conn(0x7f15400d44f0 msgr2=0x7f154006ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:05.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.529+0000 7f1546445640 1 -- 172.21.15.19:0/1778371952 shutdown_connections 2024-09-12T01:57:05.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:05.529+0000 7f1546445640 1 -- 172.21.15.19:0/1778371952 wait complete. 2024-09-12T01:57:05.943 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:56:48.431829+0000', 'modified': '2024-09-12T01:57:04.677295+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 41, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5088}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5088': {'gid': 5088, 'name': 'c', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.19:6834/3554496273', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 3554496273}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 3554496273}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5088, 'qdb_cluster': [5088]} 2024-09-12T01:57:05.943 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:57:05.943 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T01:57:06.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.047+0000 7fa6c1d03640 1 Processor -- start 2024-09-12T01:57:06.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.047+0000 7fa6c1d03640 1 -- start start 2024-09-12T01:57:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.048+0000 7fa6c1d03640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6bc15ba30 0x7fa6bc06f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.048+0000 7fa6c1d03640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa6bc073050 0x7fa6bc0b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.048+0000 7fa6c1d03640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6bc0b3570 con 0x7fa6bc06fd50 2024-09-12T01:57:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.048+0000 7fa6c1d03640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa6bc0b4180 con 0x7fa6bc073050 2024-09-12T01:57:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.048+0000 7fa6c1d03640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa6bc0b3850 con 0x7fa6bc15ba30 2024-09-12T01:57:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.048+0000 7fa6bbfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa6bc073050 0x7fa6bc0b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.048+0000 7fa6bbfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa6bc073050 0x7fa6bc0b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46252/0 (socket says 172.21.15.19:46252) 2024-09-12T01:57:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.048+0000 7fa6bbfff640 1 -- 172.21.15.19:0/182489662 learned_addr learned my addr 172.21.15.19:0/182489662 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.048+0000 7fa6bb7fe640 1 --2- 172.21.15.19:0/182489662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6bc15ba30 0x7fa6bc06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.048+0000 7fa6bbfff640 1 -- 172.21.15.19:0/182489662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6bc15ba30 msgr2=0x7fa6bc06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.048+0000 7fa6bbfff640 1 --2- 172.21.15.19:0/182489662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6bc15ba30 0x7fa6bc06f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.048+0000 7fa6bbfff640 1 -- 172.21.15.19:0/182489662 >> v1:172.21.15.19:6789/0 conn(0x7fa6bc06fd50 legacy=0x7fa6bc072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.048+0000 7fa6bbfff640 1 -- 172.21.15.19:0/182489662 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6bc0b3b30 con 0x7fa6bc073050 2024-09-12T01:57:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.048+0000 7fa6ba7fc640 1 -- 172.21.15.19:0/182489662 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2566547155 0 0) 0x7fa6bc0b3570 con 0x7fa6bc06fd50 2024-09-12T01:57:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.049+0000 7fa6bbfff640 1 --2- 172.21.15.19:0/182489662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6bc073050 0x7fa6bc0b4880 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400d150 tx=0x7fa6b402c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ae88fee88fd9b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:06.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.049+0000 7fa6ba7fc640 1 -- 172.21.15.19:0/182489662 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b400b2e0 con 0x7fa6bc073050 2024-09-12T01:57:06.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.049+0000 7fa6ba7fc640 1 -- 172.21.15.19:0/182489662 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b4037070 con 0x7fa6bc073050 2024-09-12T01:57:06.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.049+0000 7fa6ba7fc640 1 -- 172.21.15.19:0/182489662 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b400b480 con 0x7fa6bc073050 2024-09-12T01:57:06.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.050+0000 7fa6c1d03640 1 -- 172.21.15.19:0/182489662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6bc073050 msgr2=0x7fa6bc0b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.050+0000 7fa6c1d03640 1 --2- 172.21.15.19:0/182489662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6bc073050 0x7fa6bc0b4880 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400d150 tx=0x7fa6b402c940 comp rx=0 tx=0).stop 2024-09-12T01:57:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.050+0000 7fa6c1d03640 1 -- 172.21.15.19:0/182489662 shutdown_connections 2024-09-12T01:57:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.050+0000 7fa6c1d03640 1 --2- 172.21.15.19:0/182489662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6bc073050 0x7fa6bc0b4880 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.050+0000 7fa6c1d03640 1 --2- 172.21.15.19:0/182489662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6bc15ba30 0x7fa6bc06f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.050+0000 7fa6c1d03640 1 -- 172.21.15.19:0/182489662 >> 172.21.15.19:0/182489662 conn(0x7fa6bc067d70 msgr2=0x7fa6bc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.050+0000 7fa6c1d03640 1 -- 172.21.15.19:0/182489662 shutdown_connections 2024-09-12T01:57:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.050+0000 7fa6c1d03640 1 -- 172.21.15.19:0/182489662 wait complete. 2024-09-12T01:57:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.051+0000 7fa6c1d03640 1 Processor -- start 2024-09-12T01:57:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.051+0000 7fa6c1d03640 1 -- start start 2024-09-12T01:57:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.052+0000 7fa6c1d03640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6bc06fd50 0x7fa6bc1f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.052+0000 7fa6c1d03640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6bc073050 0x7fa6bc152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.052+0000 7fa6c1d03640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6bc15ba30 0x7fa6bc144560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.052+0000 7fa6c1d03640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa6bc0ccfe0 con 0x7fa6bc073050 2024-09-12T01:57:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.052+0000 7fa6c1d03640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa6bc0ce810 con 0x7fa6bc06fd50 2024-09-12T01:57:06.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.052+0000 7fa6c1d03640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa6bc0cd160 con 0x7fa6bc15ba30 2024-09-12T01:57:06.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.052+0000 7fa6baffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6bc073050 0x7fa6bc152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.052+0000 7fa6baffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6bc073050 0x7fa6bc152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46256/0 (socket says 172.21.15.19:46256) 2024-09-12T01:57:06.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.052+0000 7fa6baffd640 1 -- 172.21.15.19:0/2784683902 learned_addr learned my addr 172.21.15.19:0/2784683902 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:06.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.052+0000 7fa6bb7fe640 1 --2- 172.21.15.19:0/2784683902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6bc06fd50 0x7fa6bc1f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.052+0000 7fa6bbfff640 1 --2- 172.21.15.19:0/2784683902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6bc15ba30 0x7fa6bc144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.052+0000 7fa6baffd640 1 -- 172.21.15.19:0/2784683902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6bc15ba30 msgr2=0x7fa6bc144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.052+0000 7fa6baffd640 1 --2- 172.21.15.19:0/2784683902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6bc15ba30 0x7fa6bc144560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.052+0000 7fa6baffd640 1 -- 172.21.15.19:0/2784683902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6bc06fd50 msgr2=0x7fa6bc1f2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.052+0000 7fa6baffd640 1 --2- 172.21.15.19:0/2784683902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6bc06fd50 0x7fa6bc1f2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.052+0000 7fa6baffd640 1 -- 172.21.15.19:0/2784683902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6bc1f3510 con 0x7fa6bc073050 2024-09-12T01:57:06.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.052+0000 7fa6bbfff640 1 --2- 172.21.15.19:0/2784683902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6bc15ba30 0x7fa6bc144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:06.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.053+0000 7fa6baffd640 1 --2- 172.21.15.19:0/2784683902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6bc073050 0x7fa6bc152be0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00011e0 tx=0x7fa6b000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:06.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.053+0000 7fa6a3fff640 1 -- 172.21.15.19:0/2784683902 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0017070 con 0x7fa6bc073050 2024-09-12T01:57:06.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.053+0000 7fa6a3fff640 1 -- 172.21.15.19:0/2784683902 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b00035f0 con 0x7fa6bc073050 2024-09-12T01:57:06.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.053+0000 7fa6c1d03640 1 -- 172.21.15.19:0/2784683902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6bc1f3790 con 0x7fa6bc073050 2024-09-12T01:57:06.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.053+0000 7fa6a3fff640 1 -- 172.21.15.19:0/2784683902 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b00039e0 con 0x7fa6bc073050 2024-09-12T01:57:06.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.053+0000 7fa6c1d03640 1 -- 172.21.15.19:0/2784683902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6bc154ac0 con 0x7fa6bc073050 2024-09-12T01:57:06.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.054+0000 7fa6a3fff640 1 -- 172.21.15.19:0/2784683902 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa6b001a070 con 0x7fa6bc073050 2024-09-12T01:57:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.055+0000 7fa6a3fff640 1 --2- 172.21.15.19:0/2784683902 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6a806be30 0x7fa6a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.055+0000 7fa6a3fff640 1 -- 172.21.15.19:0/2784683902 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7fa6b008a460 con 0x7fa6bc073050 2024-09-12T01:57:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.055+0000 7fa6bb7fe640 1 --2- 172.21.15.19:0/2784683902 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6a806be30 0x7fa6a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.056+0000 7fa6bb7fe640 1 --2- 172.21.15.19:0/2784683902 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6a806be30 0x7fa6a806e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac0079a0 tx=0x7fa6ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.056+0000 7fa6c4a99740 1 Processor -- start 2024-09-12T01:57:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.056+0000 7fa6c4a99740 1 -- start start 2024-09-12T01:57:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.057+0000 7fa6c4a99740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560ce91f8120 0x560ce91f8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.057+0000 7fa6c4a99740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 0x560ce9214290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.057+0000 7fa6c4a99740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ce91cba80 0x560ce92147d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.057+0000 7fa6c4a99740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560ce9130520 con 0x560ce9212ae0 2024-09-12T01:57:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.057+0000 7fa6c4a99740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560ce90d83e0 con 0x560ce91cba80 2024-09-12T01:57:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.057+0000 7fa6c4a99740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560ce912c4e0 con 0x560ce91f8120 2024-09-12T01:57:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.057+0000 7fa6baffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 0x560ce9214290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.057+0000 7fa6baffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 0x560ce9214290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46272/0 (socket says 172.21.15.19:46272) 2024-09-12T01:57:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.057+0000 7fa6baffd640 1 -- 172.21.15.19:0/2198048841 learned_addr learned my addr 172.21.15.19:0/2198048841 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.057+0000 7fa6bb7fe640 1 --2- 172.21.15.19:0/2198048841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560ce91f8120 0x560ce91f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.057+0000 7fa6bbfff640 1 --2- 172.21.15.19:0/2198048841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ce91cba80 0x560ce92147d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.057+0000 7fa6baffd640 1 -- 172.21.15.19:0/2198048841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560ce91f8120 msgr2=0x560ce91f8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.057+0000 7fa6baffd640 1 --2- 172.21.15.19:0/2198048841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560ce91f8120 0x560ce91f8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.057+0000 7fa6baffd640 1 -- 172.21.15.19:0/2198048841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ce91cba80 msgr2=0x560ce92147d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.057+0000 7fa6baffd640 1 --2- 172.21.15.19:0/2198048841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ce91cba80 0x560ce92147d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.057+0000 7fa6baffd640 1 -- 172.21.15.19:0/2198048841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ce90f32f0 con 0x560ce9212ae0 2024-09-12T01:57:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.058+0000 7fa6baffd640 1 --2- 172.21.15.19:0/2198048841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 0x560ce9214290 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0060b40 tx=0x7fa6b000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1683f2180a5dd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.058+0000 7fa6a17fa640 1 -- 172.21.15.19:0/2198048841 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0056840 con 0x560ce9212ae0 2024-09-12T01:57:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.058+0000 7fa6a17fa640 1 -- 172.21.15.19:0/2198048841 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b0054bb0 con 0x560ce9212ae0 2024-09-12T01:57:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.058+0000 7fa6a17fa640 1 -- 172.21.15.19:0/2198048841 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0003b80 con 0x560ce9212ae0 2024-09-12T01:57:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.058+0000 7fa6c4a99740 1 -- 172.21.15.19:0/2198048841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 msgr2=0x560ce9214290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.058+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/2198048841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 0x560ce9214290 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0060b40 tx=0x7fa6b000cf90 comp rx=0 tx=0).stop 2024-09-12T01:57:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.058+0000 7fa6c4a99740 1 -- 172.21.15.19:0/2198048841 shutdown_connections 2024-09-12T01:57:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.058+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/2198048841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ce91cba80 0x560ce92147d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.058+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/2198048841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 0x560ce9214290 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.058+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/2198048841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560ce91f8120 0x560ce91f8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.058+0000 7fa6c4a99740 1 -- 172.21.15.19:0/2198048841 >> 172.21.15.19:0/2198048841 conn(0x560ce91caa80 msgr2=0x560ce9212f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.059+0000 7fa6c4a99740 1 -- 172.21.15.19:0/2198048841 shutdown_connections 2024-09-12T01:57:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.059+0000 7fa6c4a99740 1 -- 172.21.15.19:0/2198048841 wait complete. 2024-09-12T01:57:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.059+0000 7fa6c4a99740 1 -- start start 2024-09-12T01:57:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.059+0000 7fa6c4a99740 1 Processor -- start 2024-09-12T01:57:06.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.060+0000 7fa6c4a99740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560ce91f8120 0x560ce920c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.060+0000 7fa6c4a99740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ce9212ae0 0x560ce9227890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.060+0000 7fa6c4a99740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce91f5650 0x560ce9227dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.060+0000 7fa6c4a99740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560ce91f8ee0 con 0x560ce91f5650 2024-09-12T01:57:06.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.060+0000 7fa6c4a99740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560ce90b9450 con 0x560ce9212ae0 2024-09-12T01:57:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.060+0000 7fa6c4a99740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560ce9213770 con 0x560ce91f8120 2024-09-12T01:57:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.060+0000 7fa6c4a99740 10 client.0 _ll_register_callbacks cb 0x560ce8e42ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.060+0000 7fa6bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce91f5650 0x560ce9227dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.060+0000 7fa6bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce91f5650 0x560ce9227dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46274/0 (socket says 172.21.15.19:46274) 2024-09-12T01:57:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.060+0000 7fa6bbfff640 1 -- 172.21.15.19:0/2561977450 learned_addr learned my addr 172.21.15.19:0/2561977450 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.060+0000 7fa6bb7fe640 1 --2- 172.21.15.19:0/2561977450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560ce91f8120 0x560ce920c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.060+0000 7fa6baffd640 1 --2- 172.21.15.19:0/2561977450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ce9212ae0 0x560ce9227890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.060+0000 7fa6bbfff640 1 -- 172.21.15.19:0/2561977450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560ce91f8120 msgr2=0x560ce920c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.060+0000 7fa6bbfff640 1 --2- 172.21.15.19:0/2561977450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560ce91f8120 0x560ce920c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.060+0000 7fa6bbfff640 1 -- 172.21.15.19:0/2561977450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ce9212ae0 msgr2=0x560ce9227890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.060+0000 7fa6bbfff640 1 --2- 172.21.15.19:0/2561977450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ce9212ae0 0x560ce9227890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.060+0000 7fa6bbfff640 1 -- 172.21.15.19:0/2561977450 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ce8e432d0 con 0x560ce91f5650 2024-09-12T01:57:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.061+0000 7fa6bbfff640 1 --2- 172.21.15.19:0/2561977450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce91f5650 0x560ce9227dd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400d150 tx=0x7fa6b4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8e47794fb49709 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.061+0000 7fa69a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:57:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.061+0000 7fa69a7fc640 1 -- 172.21.15.19:0/2561977450 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4049060 con 0x560ce91f5650 2024-09-12T01:57:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.061+0000 7fa69a7fc640 1 -- 172.21.15.19:0/2561977450 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7fa6b4032af0 con 0x560ce91f5650 2024-09-12T01:57:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.061+0000 7fa6c4a99740 1 -- 172.21.15.19:0/2561977450 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6b0054bb0 con 0x560ce91f5650 2024-09-12T01:57:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.061+0000 7fa69a7fc640 1 -- 172.21.15.19:0/2561977450 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa6b404f050 con 0x560ce91f5650 2024-09-12T01:57:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.061+0000 7fa6c4a99740 10 client.5139 fetch_fsmap learned FSMap version 20 2024-09-12T01:57:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.061+0000 7fa6c4a99740 1 -- 172.21.15.19:0/2561977450 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x560ce8f0d6b0 con 0x560ce91f5650 2024-09-12T01:57:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.061+0000 7fa69a7fc640 1 -- 172.21.15.19:0/2561977450 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b0054bb0 con 0x560ce91f5650 2024-09-12T01:57:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.061+0000 7fa69a7fc640 1 -- 172.21.15.19:0/2561977450 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7fa6b4043070 con 0x560ce91f5650 2024-09-12T01:57:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.061+0000 7fa6c4a99740 10 client.5139 fetch_fsmap finished waiting for FSMap version 20 2024-09-12T01:57:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.061+0000 7fa6c4a99740 10 client.5139 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T01:57:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.061+0000 7fa6c4a99740 20 client.5139 populate_metadata read hostname 'smithi019' 2024-09-12T01:57:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.061+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/2561977450 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x560ce9233270 0x560ce9235660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.061+0000 7fa6c4a99740 4 client.5139 mds_command: new command op to 5088 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.061+0000 7fa6c4a99740 1 -- 172.21.15.19:0/2561977450 --> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ce913dc50 con 0x560ce9233270 2024-09-12T01:57:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.061+0000 7fa6bb7fe640 1 --2- 172.21.15.19:0/2561977450 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x560ce9233270 0x560ce9235660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.062+0000 7fa6bb7fe640 1 --2- 172.21.15.19:0/2561977450 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x560ce9233270 0x560ce9235660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ae167949d2a93e4 server_cookie=987e81a4d0eb0f1 in_seq=0 out_seq=0 2024-09-12T01:57:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.062+0000 7fa69a7fc640 10 client.5139 ms_handle_connect on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.062+0000 7fa69a7fc640 1 -- 172.21.15.19:0/2561977450 <== mds.0 v2:172.21.15.19:6832/3554496273 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560ce913dc50 con 0x560ce9233270 2024-09-12T01:57:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.062+0000 7fa69a7fc640 10 client.5139 handle_command_reply: tid=0 2024-09-12T01:57:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.062+0000 7fa6c4a99740 1 client.5139 shutdown 2024-09-12T01:57:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.063+0000 7fa6c4a99740 1 -- 172.21.15.19:0/2561977450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce91f5650 msgr2=0x560ce9227dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.063+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/2561977450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce91f5650 0x560ce9227dd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400d150 tx=0x7fa6b4004ab0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.063+0000 7fa6c4a99740 1 -- 172.21.15.19:0/2561977450 shutdown_connections 2024-09-12T01:57:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.063+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/2561977450 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x560ce9233270 0x560ce9235660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.063+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/2561977450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce91f5650 0x560ce9227dd0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.063+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/2561977450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ce9212ae0 0x560ce9227890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.063+0000 7fa69a7fc640 0 client.5139 ms_handle_reset on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.063+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/2561977450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560ce91f8120 0x560ce920c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.063+0000 7fa6c4a99740 1 -- 172.21.15.19:0/2561977450 >> 172.21.15.19:0/2561977450 conn(0x560ce91cba80 msgr2=0x560ce9216440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.063+0000 7fa6c4a99740 1 -- 172.21.15.19:0/2561977450 shutdown_connections 2024-09-12T01:57:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.063+0000 7fa6c4a99740 1 -- 172.21.15.19:0/2561977450 wait complete. 2024-09-12T01:57:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.063+0000 7fa6c4a99740 20 client.5139 trim_cache size 0 max 16384 2024-09-12T01:57:06.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.081+0000 7fa6c4a99740 1 Processor -- start 2024-09-12T01:57:06.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.081+0000 7fa6c4a99740 1 -- start start 2024-09-12T01:57:06.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.082+0000 7fa6c4a99740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560ce91f5650 0x560ce920c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.082+0000 7fa6c4a99740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ce91f8120 0x560ce920d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.082+0000 7fa6c4a99740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 0x560ce920ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.082+0000 7fa6c4a99740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa6bc1fbc20 con 0x560ce9212ae0 2024-09-12T01:57:06.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.082+0000 7fa6c4a99740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa6bc1578a0 con 0x560ce91f8120 2024-09-12T01:57:06.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.082+0000 7fa6c4a99740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa6bc1fb5d0 con 0x560ce91f5650 2024-09-12T01:57:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.082+0000 7fa6bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 0x560ce920ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.082+0000 7fa6bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 0x560ce920ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46278/0 (socket says 172.21.15.19:46278) 2024-09-12T01:57:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.082+0000 7fa6bbfff640 1 -- 172.21.15.19:0/637466923 learned_addr learned my addr 172.21.15.19:0/637466923 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.082+0000 7fa6bbfff640 1 -- 172.21.15.19:0/637466923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560ce91f5650 msgr2=0x560ce920c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.082+0000 7fa6bbfff640 1 --2- 172.21.15.19:0/637466923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560ce91f5650 0x560ce920c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.082+0000 7fa6bbfff640 1 -- 172.21.15.19:0/637466923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ce91f8120 msgr2=0x560ce920d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.082+0000 7fa6bbfff640 1 --2- 172.21.15.19:0/637466923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ce91f8120 0x560ce920d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.082+0000 7fa6bbfff640 1 -- 172.21.15.19:0/637466923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ce91ca820 con 0x560ce9212ae0 2024-09-12T01:57:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.082+0000 7fa6bbfff640 1 --2- 172.21.15.19:0/637466923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 0x560ce920ddb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400bdb0 tx=0x7fa6b4040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58278680354203ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:06.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.082+0000 7fa6a0ff9640 1 -- 172.21.15.19:0/637466923 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b400b6e0 con 0x560ce9212ae0 2024-09-12T01:57:06.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.082+0000 7fa6a0ff9640 1 -- 172.21.15.19:0/637466923 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b4037040 con 0x560ce9212ae0 2024-09-12T01:57:06.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.082+0000 7fa6a0ff9640 1 -- 172.21.15.19:0/637466923 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4003990 con 0x560ce9212ae0 2024-09-12T01:57:06.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.083+0000 7fa6c4a99740 1 -- 172.21.15.19:0/637466923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 msgr2=0x560ce920ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.083+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/637466923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 0x560ce920ddb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400bdb0 tx=0x7fa6b4040000 comp rx=0 tx=0).stop 2024-09-12T01:57:06.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.083+0000 7fa6c4a99740 1 -- 172.21.15.19:0/637466923 shutdown_connections 2024-09-12T01:57:06.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.083+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/637466923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 0x560ce920ddb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.083+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/637466923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ce91f8120 0x560ce920d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.083+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/637466923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560ce91f5650 0x560ce920c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.083+0000 7fa6c4a99740 1 -- 172.21.15.19:0/637466923 >> 172.21.15.19:0/637466923 conn(0x560ce91cba80 msgr2=0x560ce9216440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:06.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.083+0000 7fa6c4a99740 1 -- 172.21.15.19:0/637466923 shutdown_connections 2024-09-12T01:57:06.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.083+0000 7fa6c4a99740 1 -- 172.21.15.19:0/637466923 wait complete. 2024-09-12T01:57:06.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.084+0000 7fa6c4a99740 1 -- start start 2024-09-12T01:57:06.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.084+0000 7fa6c4a99740 1 Processor -- start 2024-09-12T01:57:06.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.084+0000 7fa6c4a99740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ce91f5650 0x560ce927e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.084+0000 7fa6c4a99740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560ce91f8120 0x560ce921c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.084+0000 7fa6c4a99740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 0x560ce921cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.084+0000 7fa6c4a99740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560ce9230eb0 con 0x560ce9212ae0 2024-09-12T01:57:06.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.084+0000 7fa6c4a99740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560ce9209f90 con 0x560ce91f5650 2024-09-12T01:57:06.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa6c4a99740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560ce92313f0 con 0x560ce91f8120 2024-09-12T01:57:06.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa6c4a99740 10 client.0 _ll_register_callbacks cb 0x7fa6b400be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:06.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa6bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 0x560ce921cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa6bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 0x560ce921cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46290/0 (socket says 172.21.15.19:46290) 2024-09-12T01:57:06.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa6bbfff640 1 -- 172.21.15.19:0/399514026 learned_addr learned my addr 172.21.15.19:0/399514026 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:06.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa6bbfff640 1 -- 172.21.15.19:0/399514026 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560ce91f8120 msgr2=0x560ce921c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:06.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa6bbfff640 1 --2- 172.21.15.19:0/399514026 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560ce91f8120 0x560ce921c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa6bbfff640 1 -- 172.21.15.19:0/399514026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ce91f5650 msgr2=0x560ce927e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:06.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa6bbfff640 1 --2- 172.21.15.19:0/399514026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ce91f5650 0x560ce927e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa6bbfff640 1 -- 172.21.15.19:0/399514026 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ce91ce850 con 0x560ce9212ae0 2024-09-12T01:57:06.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa6bbfff640 1 --2- 172.21.15.19:0/399514026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 0x560ce921cb70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa6b403e040 tx=0x7fa6b400ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c894e3642dcb16 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:06.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa69a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:57:06.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa69a7fc640 1 -- 172.21.15.19:0/399514026 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b40070e0 con 0x560ce9212ae0 2024-09-12T01:57:06.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa69a7fc640 1 -- 172.21.15.19:0/399514026 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7fa6b4041040 con 0x560ce9212ae0 2024-09-12T01:57:06.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa6c4a99740 1 -- 172.21.15.19:0/399514026 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6b4037040 con 0x560ce9212ae0 2024-09-12T01:57:06.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa69a7fc640 1 -- 172.21.15.19:0/399514026 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa6b405f050 con 0x560ce9212ae0 2024-09-12T01:57:06.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa6c4a99740 10 client.5145 fetch_fsmap learned FSMap version 20 2024-09-12T01:57:06.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa6c4a99740 1 -- 172.21.15.19:0/399514026 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x560ce9299940 con 0x560ce9212ae0 2024-09-12T01:57:06.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.085+0000 7fa69a7fc640 1 -- 172.21.15.19:0/399514026 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b4037040 con 0x560ce9212ae0 2024-09-12T01:57:06.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa69a7fc640 1 -- 172.21.15.19:0/399514026 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7fa6b4062020 con 0x560ce9212ae0 2024-09-12T01:57:06.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa6c4a99740 10 client.5145 fetch_fsmap finished waiting for FSMap version 20 2024-09-12T01:57:06.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa6c4a99740 10 client.5145 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T01:57:06.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa6c4a99740 20 client.5145 populate_metadata read hostname 'smithi019' 2024-09-12T01:57:06.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/399514026 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x560ce92278c0 0x560ce9225d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa6c4a99740 4 client.5145 mds_command: new command op to 5088 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:57:06.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa6c4a99740 1 -- 172.21.15.19:0/399514026 --> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] -- command(tid 0: {"prefix": "status"}) -- 0x560ce9137fa0 con 0x560ce92278c0 2024-09-12T01:57:06.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa6bb7fe640 1 --2- 172.21.15.19:0/399514026 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x560ce92278c0 0x560ce9225d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa69a7fc640 10 client.5145 ms_handle_connect on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:06.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa6bb7fe640 1 --2- 172.21.15.19:0/399514026 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x560ce92278c0 0x560ce9225d10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67d59747d02903eb server_cookie=c64aa7b085672668 in_seq=0 out_seq=0 2024-09-12T01:57:06.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa69a7fc640 1 -- 172.21.15.19:0/399514026 <== mds.0 v2:172.21.15.19:6832/3554496273 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x560ce9137fa0 con 0x560ce92278c0 2024-09-12T01:57:06.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa69a7fc640 10 client.5145 handle_command_reply: tid=0 2024-09-12T01:57:06.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa6c4a99740 1 client.5145 shutdown 2024-09-12T01:57:06.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa6c4a99740 1 -- 172.21.15.19:0/399514026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 msgr2=0x560ce921cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/399514026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 0x560ce921cb70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa6b403e040 tx=0x7fa6b400ba20 comp rx=0 tx=0).stop 2024-09-12T01:57:06.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa6c4a99740 1 -- 172.21.15.19:0/399514026 shutdown_connections 2024-09-12T01:57:06.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/399514026 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x560ce92278c0 0x560ce9225d10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/399514026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560ce9212ae0 0x560ce921cb70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/399514026 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560ce91f8120 0x560ce921c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa69a7fc640 0 client.5145 ms_handle_reset on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:06.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa6c4a99740 1 --2- 172.21.15.19:0/399514026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ce91f5650 0x560ce927e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.086+0000 7fa6c4a99740 1 -- 172.21.15.19:0/399514026 >> 172.21.15.19:0/399514026 conn(0x560ce91cba80 msgr2=0x560ce9216440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:06.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.087+0000 7fa6c4a99740 1 -- 172.21.15.19:0/399514026 shutdown_connections 2024-09-12T01:57:06.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.087+0000 7fa6c4a99740 1 -- 172.21.15.19:0/399514026 wait complete. 2024-09-12T01:57:06.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.087+0000 7fa6c4a99740 20 client.5145 trim_cache size 0 max 16384 2024-09-12T01:57:06.094 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:57:06.094 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T01:57:06.094 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T01:57:06.094 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 5088, 2024-09-12T01:57:06.094 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T01:57:06.094 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T01:57:06.094 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T01:57:06.094 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 4.4220734679999998, 2024-09-12T01:57:06.094 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 20, 2024-09-12T01:57:06.094 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 41, 2024-09-12T01:57:06.095 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 41, 2024-09-12T01:57:06.095 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 5.1414709040000002 2024-09-12T01:57:06.095 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:57:06.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.087+0000 7fa6c1d03640 1 -- 172.21.15.19:0/2784683902 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6a806be30 msgr2=0x7fa6a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.087+0000 7fa6c1d03640 1 --2- 172.21.15.19:0/2784683902 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6a806be30 0x7fa6a806e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac0079a0 tx=0x7fa6ac008040 comp rx=0 tx=0).stop 2024-09-12T01:57:06.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.087+0000 7fa6c1d03640 1 -- 172.21.15.19:0/2784683902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6bc073050 msgr2=0x7fa6bc152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.087+0000 7fa6c1d03640 1 --2- 172.21.15.19:0/2784683902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6bc073050 0x7fa6bc152be0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00011e0 tx=0x7fa6b000c8e0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.087+0000 7fa6c1d03640 1 -- 172.21.15.19:0/2784683902 shutdown_connections 2024-09-12T01:57:06.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.087+0000 7fa6c1d03640 1 --2- 172.21.15.19:0/2784683902 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6a806be30 0x7fa6a806e2f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.087+0000 7fa6c1d03640 1 --2- 172.21.15.19:0/2784683902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6bc15ba30 0x7fa6bc144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.087+0000 7fa6c1d03640 1 --2- 172.21.15.19:0/2784683902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6bc073050 0x7fa6bc152be0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.087+0000 7fa6c1d03640 1 --2- 172.21.15.19:0/2784683902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6bc06fd50 0x7fa6bc1f2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.087+0000 7fa6c1d03640 1 -- 172.21.15.19:0/2784683902 >> 172.21.15.19:0/2784683902 conn(0x7fa6bc067d70 msgr2=0x7fa6bc1597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:06.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.087+0000 7fa6c1d03640 1 -- 172.21.15.19:0/2784683902 shutdown_connections 2024-09-12T01:57:06.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.087+0000 7fa6c1d03640 1 -- 172.21.15.19:0/2784683902 wait complete. 2024-09-12T01:57:06.098 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:57:06.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.201+0000 7fcd83065640 1 Processor -- start 2024-09-12T01:57:06.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.201+0000 7fcd83065640 1 -- start start 2024-09-12T01:57:06.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.201+0000 7fcd83065640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcd7c161c80 0x7fcd7c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.201+0000 7fcd83065640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd7c162060 0x7fcd7c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.201+0000 7fcd83065640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd7c06e870 con 0x7fcd7c0b64b0 2024-09-12T01:57:06.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.201+0000 7fcd83065640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fcd7c06d9f0 con 0x7fcd7c161c80 2024-09-12T01:57:06.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.201+0000 7fcd83065640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcd7c06dcd0 con 0x7fcd7c162060 2024-09-12T01:57:06.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.202+0000 7fcd7bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd7c162060 0x7fcd7c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.202+0000 7fcd7bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd7c162060 0x7fcd7c0b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:38960/0 (socket says 172.21.15.19:38960) 2024-09-12T01:57:06.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.202+0000 7fcd7bfff640 1 -- 172.21.15.19:0/1020376814 learned_addr learned my addr 172.21.15.19:0/1020376814 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:06.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.202+0000 7fcd80e01640 1 --2- 172.21.15.19:0/1020376814 >> v2:172.21.15.135:3300/0 conn(0x7fcd7c161c80 0x7fcd7c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.202+0000 7fcd7bfff640 1 -- 172.21.15.19:0/1020376814 >> v2:172.21.15.135:3300/0 conn(0x7fcd7c161c80 msgr2=0x7fcd7c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:06.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.202+0000 7fcd7bfff640 1 --2- 172.21.15.19:0/1020376814 >> v2:172.21.15.135:3300/0 conn(0x7fcd7c161c80 0x7fcd7c06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.202+0000 7fcd7bfff640 1 -- 172.21.15.19:0/1020376814 >> v1:172.21.15.135:6789/0 conn(0x7fcd7c0b64b0 legacy=0x7fcd7c162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.202+0000 7fcd7b7fe640 1 -- 172.21.15.19:0/1020376814 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3414826604 0 0) 0x7fcd6c001110 con 0x7fcd7c0b64b0 2024-09-12T01:57:06.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.202+0000 7fcd7bfff640 1 -- 172.21.15.19:0/1020376814 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7c06dfb0 con 0x7fcd7c162060 2024-09-12T01:57:06.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.203+0000 7fcd7bfff640 1 --2- 172.21.15.19:0/1020376814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd7c162060 0x7fcd7c0b5f70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009870 tx=0x7fcd7002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebe465e3902ca25d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:06.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.203+0000 7fcd7b7fe640 1 -- 172.21.15.19:0/1020376814 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd70037070 con 0x7fcd7c162060 2024-09-12T01:57:06.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.203+0000 7fcd7b7fe640 1 -- 172.21.15.19:0/1020376814 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd70032440 con 0x7fcd7c162060 2024-09-12T01:57:06.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.203+0000 7fcd7b7fe640 1 -- 172.21.15.19:0/1020376814 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd70032810 con 0x7fcd7c162060 2024-09-12T01:57:06.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.204+0000 7fcd83065640 1 -- 172.21.15.19:0/1020376814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd7c162060 msgr2=0x7fcd7c0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.204+0000 7fcd83065640 1 --2- 172.21.15.19:0/1020376814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd7c162060 0x7fcd7c0b5f70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009870 tx=0x7fcd7002a270 comp rx=0 tx=0).stop 2024-09-12T01:57:06.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.204+0000 7fcd83065640 1 -- 172.21.15.19:0/1020376814 shutdown_connections 2024-09-12T01:57:06.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.204+0000 7fcd83065640 1 --2- 172.21.15.19:0/1020376814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd7c162060 0x7fcd7c0b5f70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.204+0000 7fcd83065640 1 --2- 172.21.15.19:0/1020376814 >> v2:172.21.15.135:3300/0 conn(0x7fcd7c161c80 0x7fcd7c06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.204+0000 7fcd83065640 1 -- 172.21.15.19:0/1020376814 >> 172.21.15.19:0/1020376814 conn(0x7fcd7c0d44f0 msgr2=0x7fcd7c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:06.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.204+0000 7fcd83065640 1 -- 172.21.15.19:0/1020376814 shutdown_connections 2024-09-12T01:57:06.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.204+0000 7fcd83065640 1 -- 172.21.15.19:0/1020376814 wait complete. 2024-09-12T01:57:06.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.205+0000 7fcd83065640 1 Processor -- start 2024-09-12T01:57:06.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.205+0000 7fcd83065640 1 -- start start 2024-09-12T01:57:06.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.206+0000 7fcd83065640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd7c0b64b0 0x7fcd7c1565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.206+0000 7fcd83065640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd7c161c80 0x7fcd7c0b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.206+0000 7fcd83065640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd7c162060 0x7fcd7c0b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.206+0000 7fcd83065640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7c0d2a10 con 0x7fcd7c161c80 2024-09-12T01:57:06.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.206+0000 7fcd83065640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7c0d2890 con 0x7fcd7c162060 2024-09-12T01:57:06.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.206+0000 7fcd83065640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcd7c0b6960 con 0x7fcd7c0b64b0 2024-09-12T01:57:06.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.206+0000 7fcd7bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd7c161c80 0x7fcd7c0b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.206+0000 7fcd7bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd7c161c80 0x7fcd7c0b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46292/0 (socket says 172.21.15.19:46292) 2024-09-12T01:57:06.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.206+0000 7fcd7bfff640 1 -- 172.21.15.19:0/2176634106 learned_addr learned my addr 172.21.15.19:0/2176634106 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:06.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.206+0000 7fcd80e01640 1 --2- 172.21.15.19:0/2176634106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd7c0b64b0 0x7fcd7c1565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.206+0000 7fcd81602640 1 --2- 172.21.15.19:0/2176634106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd7c162060 0x7fcd7c0b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.206+0000 7fcd7bfff640 1 -- 172.21.15.19:0/2176634106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd7c0b64b0 msgr2=0x7fcd7c1565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.206+0000 7fcd7bfff640 1 --2- 172.21.15.19:0/2176634106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd7c0b64b0 0x7fcd7c1565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.206+0000 7fcd7bfff640 1 -- 172.21.15.19:0/2176634106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd7c162060 msgr2=0x7fcd7c0b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.206+0000 7fcd7bfff640 1 --2- 172.21.15.19:0/2176634106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd7c162060 0x7fcd7c0b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.206+0000 7fcd7bfff640 1 -- 172.21.15.19:0/2176634106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7c0b98c0 con 0x7fcd7c161c80 2024-09-12T01:57:06.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.206+0000 7fcd80e01640 1 --2- 172.21.15.19:0/2176634106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd7c0b64b0 0x7fcd7c1565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:06.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.207+0000 7fcd7bfff640 1 --2- 172.21.15.19:0/2176634106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd7c161c80 0x7fcd7c0b20b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcd700090b0 tx=0x7fcd700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:06.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.207+0000 7fcd797fa640 1 -- 172.21.15.19:0/2176634106 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd70037040 con 0x7fcd7c161c80 2024-09-12T01:57:06.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.207+0000 7fcd83065640 1 -- 172.21.15.19:0/2176634106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd7c0b9ba0 con 0x7fcd7c161c80 2024-09-12T01:57:06.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.207+0000 7fcd797fa640 1 -- 172.21.15.19:0/2176634106 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd70004030 con 0x7fcd7c161c80 2024-09-12T01:57:06.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.207+0000 7fcd797fa640 1 -- 172.21.15.19:0/2176634106 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd70004420 con 0x7fcd7c161c80 2024-09-12T01:57:06.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.207+0000 7fcd83065640 1 -- 172.21.15.19:0/2176634106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd7c0ba160 con 0x7fcd7c161c80 2024-09-12T01:57:06.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.208+0000 7fcd83065640 1 -- 172.21.15.19:0/2176634106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd7c068ea0 con 0x7fcd7c161c80 2024-09-12T01:57:06.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.208+0000 7fcd797fa640 1 -- 172.21.15.19:0/2176634106 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd7003a070 con 0x7fcd7c161c80 2024-09-12T01:57:06.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.209+0000 7fcd797fa640 1 --2- 172.21.15.19:0/2176634106 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd6806be30 0x7fcd6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.209+0000 7fcd797fa640 1 -- 172.21.15.19:0/2176634106 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7fcd700ab600 con 0x7fcd7c161c80 2024-09-12T01:57:06.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.209+0000 7fcd80e01640 1 --2- 172.21.15.19:0/2176634106 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd6806be30 0x7fcd6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.209+0000 7fcd80e01640 1 --2- 172.21.15.19:0/2176634106 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd6806be30 0x7fcd6806e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcd740074c0 tx=0x7fcd7400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:06.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.213+0000 7fcd797fa640 1 -- 172.21.15.19:0/2176634106 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcd70041020 con 0x7fcd7c161c80 2024-09-12T01:57:06.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.424+0000 7fcd83065640 1 -- 172.21.15.19:0/2176634106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcd7c1604e0 con 0x7fcd7c161c80 2024-09-12T01:57:06.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.424+0000 7fcd797fa640 1 -- 172.21.15.19:0/2176634106 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+73 (secure 0 0 0) 0x7fcd70079d50 con 0x7fcd7c161c80 2024-09-12T01:57:06.425 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:57:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.426+0000 7fcd83065640 1 -- 172.21.15.19:0/2176634106 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd6806be30 msgr2=0x7fcd6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.426+0000 7fcd83065640 1 --2- 172.21.15.19:0/2176634106 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd6806be30 0x7fcd6806e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcd740074c0 tx=0x7fcd7400b040 comp rx=0 tx=0).stop 2024-09-12T01:57:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.426+0000 7fcd83065640 1 -- 172.21.15.19:0/2176634106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd7c161c80 msgr2=0x7fcd7c0b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.426+0000 7fcd83065640 1 --2- 172.21.15.19:0/2176634106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd7c161c80 0x7fcd7c0b20b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcd700090b0 tx=0x7fcd700046c0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.426+0000 7fcd83065640 1 -- 172.21.15.19:0/2176634106 shutdown_connections 2024-09-12T01:57:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.426+0000 7fcd83065640 1 --2- 172.21.15.19:0/2176634106 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd6806be30 0x7fcd6806e2f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.426+0000 7fcd83065640 1 --2- 172.21.15.19:0/2176634106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd7c162060 0x7fcd7c0b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.426+0000 7fcd83065640 1 --2- 172.21.15.19:0/2176634106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd7c161c80 0x7fcd7c0b20b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.426+0000 7fcd83065640 1 --2- 172.21.15.19:0/2176634106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd7c0b64b0 0x7fcd7c1565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.426+0000 7fcd83065640 1 -- 172.21.15.19:0/2176634106 >> 172.21.15.19:0/2176634106 conn(0x7fcd7c0d44f0 msgr2=0x7fcd7c0b5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.426+0000 7fcd83065640 1 -- 172.21.15.19:0/2176634106 shutdown_connections 2024-09-12T01:57:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06.426+0000 7fcd83065640 1 -- 172.21.15.19:0/2176634106 wait complete. 2024-09-12T01:57:06.438 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:57:06.438 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:57:06.438 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T01:57:06.438 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:57:06.438 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:57:06.438 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:57:06.438 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:57:06.438 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:57:06.438 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:57:06.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:06.439 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T01:57:06.455 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:57:06.455 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:57:06.455 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:57:06.455 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:57:06.455 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T01:57:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:57:06.456 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:57:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:57:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T01:57:06.456 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:57:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:57:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T01:57:06.456 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:57:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T01:57:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T01:57:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:57:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42734sec preferred_lft 42734sec 2024-09-12T01:57:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T01:57:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:57:06.457 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:57:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T01:57:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T01:57:06.457 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:57:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T01:57:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:57:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:57:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T01:57:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:57:06.457 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:57:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:57:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T01:57:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:57:06.457 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:57:06.458 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:57:06.458 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T01:57:06.458 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:57:06.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:06.458 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:57:06.520 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T01:57:06.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:06.521 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T01:57:06.578 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T01:57:06.578 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:57:06.578 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:57:06.578 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:57:06.578 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:57:06.578 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:57:06.578 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:57:06.579 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:57:06.579 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:57:06.579 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:57:06.579 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:57:06.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:57:06.670 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T01:57:06.670+0000 7f75a551b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:57:06.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:57:06.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:06.708 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T01:57:06.724 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T01:57:06.725 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:57:06.725 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:57:06.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:06.725 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T01:57:06.792 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:57:06.792 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:57:06.848 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:57:06.849 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:57:06.849 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:57:06.904 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T01:57:06.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:06.905 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:57:06.990 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:57:06.990 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:57:06.990 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:57:06.999 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:57:06.999 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:57:06.999 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:57:07.000 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:57:07.000 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:57:07.004 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:57:07.004 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:57:07.004 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:57:07.004 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:57:07.004 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:57:07.004 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T01:57:07.005 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T01:57:07.005 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T01:57:07.005 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:57:07.005 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:57:07.005 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:57:07.005 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:57:07.005 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:57:07.007 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:57:07.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:07.008 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:57:07.034 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:57:07.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:57:07.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:57:07.132 INFO:teuthology.orchestra.run.smithi019.stdout:client5151 2024-09-12T01:57:07.132 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:57:07.132 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:57:07.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:07.149 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2024-09-12T01:57:07.207 INFO:teuthology.orchestra.run.smithi019.stdout:file_undamaged 2024-09-12T01:57:07.208 DEBUG:teuthology.orchestra.run.smithi019:> stdin-killer -- python3 -c ' 2024-09-12T01:57:07.208 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-09-12T01:57:07.208 DEBUG:teuthology.orchestra.run.smithi019:> import stat 2024-09-12T01:57:07.208 DEBUG:teuthology.orchestra.run.smithi019:> import json 2024-09-12T01:57:07.208 DEBUG:teuthology.orchestra.run.smithi019:> import sys 2024-09-12T01:57:07.208 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T01:57:07.208 DEBUG:teuthology.orchestra.run.smithi019:> try: 2024-09-12T01:57:07.208 DEBUG:teuthology.orchestra.run.smithi019:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2024-09-12T01:57:07.208 DEBUG:teuthology.orchestra.run.smithi019:> except OSError as e: 2024-09-12T01:57:07.208 DEBUG:teuthology.orchestra.run.smithi019:> sys.exit(e.errno) 2024-09-12T01:57:07.208 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T01:57:07.209 DEBUG:teuthology.orchestra.run.smithi019:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-12T01:57:07.209 DEBUG:teuthology.orchestra.run.smithi019:> print(json.dumps( 2024-09-12T01:57:07.209 DEBUG:teuthology.orchestra.run.smithi019:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-12T01:57:07.209 DEBUG:teuthology.orchestra.run.smithi019:> indent=2)) 2024-09-12T01:57:07.209 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-09-12T01:57:07.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-09-12T01:57:07.325 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T01:57:07.326 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:57:07.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.468+0000 7f18e867b640 1 Processor -- start 2024-09-12T01:57:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.468+0000 7f18e867b640 1 -- start start 2024-09-12T01:57:07.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.469+0000 7f18e867b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f18e0161c80 0x7f18e006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.469+0000 7f18e867b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e006e870 con 0x7f18e0162060 2024-09-12T01:57:07.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.469+0000 7f18e867b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e006d9f0 con 0x7f18e00b6680 2024-09-12T01:57:07.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.469+0000 7f18e867b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f18e006dcd0 con 0x7f18e0161c80 2024-09-12T01:57:07.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.469+0000 7f18e5c16640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f18e0162060 0x7f18e00b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56846/0 (socket says 172.21.15.19:56846) 2024-09-12T01:57:07.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.469+0000 7f18e5c16640 1 -- 172.21.15.19:0/4062249467 learned_addr learned my addr 172.21.15.19:0/4062249467 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:07.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.469+0000 7f18e6417640 1 --2- 172.21.15.19:0/4062249467 >> v2:172.21.15.135:3300/0 conn(0x7f18e0161c80 0x7f18e006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.469+0000 7f18e5415640 1 -- 172.21.15.19:0/4062249467 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 950821604 0 0) 0x7f18d0001110 con 0x7f18e0162060 2024-09-12T01:57:07.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.469+0000 7f18e5415640 1 -- 172.21.15.19:0/4062249467 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18cc003520 con 0x7f18e0162060 2024-09-12T01:57:07.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e5415640 1 -- 172.21.15.19:0/4062249467 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 672619293 0 0) 0x7f18cc003520 con 0x7f18e0162060 2024-09-12T01:57:07.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e5415640 1 -- 172.21.15.19:0/4062249467 >> v2:172.21.15.135:3300/0 conn(0x7f18e0161c80 msgr2=0x7f18e006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:07.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e5415640 1 --2- 172.21.15.19:0/4062249467 >> v2:172.21.15.135:3300/0 conn(0x7f18e0161c80 0x7f18e006e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e5415640 1 -- 172.21.15.19:0/4062249467 >> v1:172.21.15.135:6789/0 conn(0x7f18e00b6680 legacy=0x7f18e00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e5415640 1 -- 172.21.15.19:0/4062249467 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e006dfb0 con 0x7f18e0162060 2024-09-12T01:57:07.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e5415640 1 -- 172.21.15.19:0/4062249467 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f18d0001840 con 0x7f18e0162060 2024-09-12T01:57:07.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e5415640 1 -- 172.21.15.19:0/4062249467 >> v1:172.21.15.19:6789/0 conn(0x7f18e0162060 legacy=0x7f18e00b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e5415640 1 --2- 172.21.15.19:0/4062249467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18cc0039b0 0x7f18cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e5415640 1 --2- 172.21.15.19:0/4062249467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18cc004800 0x7f18cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e5415640 1 --2- 172.21.15.19:0/4062249467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18cc0051c0 0x7f18cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e5415640 1 -- 172.21.15.19:0/4062249467 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f18e006dcd0 con 0x7f18cc0039b0 2024-09-12T01:57:07.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e5415640 1 -- 172.21.15.19:0/4062249467 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc00c060 con 0x7f18cc0051c0 2024-09-12T01:57:07.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e5415640 1 -- 172.21.15.19:0/4062249467 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f18cc00c260 con 0x7f18cc004800 2024-09-12T01:57:07.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e6417640 1 --2- 172.21.15.19:0/4062249467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18cc0039b0 0x7f18cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e6c18640 1 --2- 172.21.15.19:0/4062249467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18cc0051c0 0x7f18cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e5c16640 1 --2- 172.21.15.19:0/4062249467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18cc004800 0x7f18cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e6417640 1 -- 172.21.15.19:0/4062249467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18cc004800 msgr2=0x7f18cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:07.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e6417640 1 --2- 172.21.15.19:0/4062249467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18cc004800 0x7f18cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e6417640 1 -- 172.21.15.19:0/4062249467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18cc0051c0 msgr2=0x7f18cc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:07.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e6417640 1 --2- 172.21.15.19:0/4062249467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18cc0051c0 0x7f18cc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e6417640 1 -- 172.21.15.19:0/4062249467 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc003520 con 0x7f18cc0039b0 2024-09-12T01:57:07.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.470+0000 7f18e6c18640 1 -- 172.21.15.19:0/4062249467 reap_dead start 2024-09-12T01:57:07.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.471+0000 7f18e6417640 1 --2- 172.21.15.19:0/4062249467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18cc0039b0 0x7f18cc003dd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f18dc009ac0 tx=0x7f18cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45101a933443bee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:07.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.471+0000 7f18e5415640 1 -- 172.21.15.19:0/4062249467 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc036070 con 0x7f18cc0039b0 2024-09-12T01:57:07.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.471+0000 7f18e5415640 1 -- 172.21.15.19:0/4062249467 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18dc031400 con 0x7f18cc0039b0 2024-09-12T01:57:07.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.471+0000 7f18e5415640 1 -- 172.21.15.19:0/4062249467 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc009690 con 0x7f18cc0039b0 2024-09-12T01:57:07.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.471+0000 7f18e867b640 1 -- 172.21.15.19:0/4062249467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18cc0039b0 msgr2=0x7f18cc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.471+0000 7f18e867b640 1 --2- 172.21.15.19:0/4062249467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18cc0039b0 0x7f18cc003dd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f18dc009ac0 tx=0x7f18cc005830 comp rx=0 tx=0).stop 2024-09-12T01:57:07.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.471+0000 7f18e867b640 1 -- 172.21.15.19:0/4062249467 shutdown_connections 2024-09-12T01:57:07.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.471+0000 7f18e867b640 1 --2- 172.21.15.19:0/4062249467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18cc0039b0 0x7f18cc003dd0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.471+0000 7f18e867b640 1 -- 172.21.15.19:0/4062249467 >> 172.21.15.19:0/4062249467 conn(0x7f18e00d44f0 msgr2=0x7f18e00d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:07.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.472+0000 7f18e867b640 1 -- 172.21.15.19:0/4062249467 shutdown_connections 2024-09-12T01:57:07.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.472+0000 7f18e867b640 1 -- 172.21.15.19:0/4062249467 wait complete. 2024-09-12T01:57:07.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.473+0000 7f18e867b640 1 Processor -- start 2024-09-12T01:57:07.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.473+0000 7f18e867b640 1 -- start start 2024-09-12T01:57:07.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e867b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18cc0039b0 0x7f18e0153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e867b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18e00b3200 0x7f18e00b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e867b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18e00b75e0 0x7f18e00b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e867b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f18e00b6b30 con 0x7f18e00b75e0 2024-09-12T01:57:07.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e867b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f18e00d2aa0 con 0x7f18e00b3200 2024-09-12T01:57:07.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e867b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f18e00b6cb0 con 0x7f18cc0039b0 2024-09-12T01:57:07.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e6c18640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18e00b75e0 0x7f18e00b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e6c18640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18e00b75e0 0x7f18e00b7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46310/0 (socket says 172.21.15.19:46310) 2024-09-12T01:57:07.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e6c18640 1 -- 172.21.15.19:0/2800950939 learned_addr learned my addr 172.21.15.19:0/2800950939 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:07.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e6417640 1 --2- 172.21.15.19:0/2800950939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18cc0039b0 0x7f18e0153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e5c16640 1 --2- 172.21.15.19:0/2800950939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18e00b3200 0x7f18e00b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e6c18640 1 -- 172.21.15.19:0/2800950939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18cc0039b0 msgr2=0x7f18e0153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e6c18640 1 --2- 172.21.15.19:0/2800950939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18cc0039b0 0x7f18e0153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e6c18640 1 -- 172.21.15.19:0/2800950939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18e00b3200 msgr2=0x7f18e00b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e6c18640 1 --2- 172.21.15.19:0/2800950939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18e00b3200 0x7f18e00b3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e6c18640 1 -- 172.21.15.19:0/2800950939 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e01f4ba0 con 0x7f18e00b75e0 2024-09-12T01:57:07.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e6c18640 1 --2- 172.21.15.19:0/2800950939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18e00b75e0 0x7f18e00b7a60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f18d8007fd0 tx=0x7f18d800e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:07.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18d6ffd640 1 -- 172.21.15.19:0/2800950939 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8019070 con 0x7f18e00b75e0 2024-09-12T01:57:07.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18d6ffd640 1 -- 172.21.15.19:0/2800950939 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d8006d60 con 0x7f18e00b75e0 2024-09-12T01:57:07.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e867b640 1 -- 172.21.15.19:0/2800950939 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e01f4e60 con 0x7f18e00b75e0 2024-09-12T01:57:07.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18d6ffd640 1 -- 172.21.15.19:0/2800950939 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8003b90 con 0x7f18e00b75e0 2024-09-12T01:57:07.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.474+0000 7f18e867b640 1 -- 172.21.15.19:0/2800950939 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e01f5420 con 0x7f18e00b75e0 2024-09-12T01:57:07.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.475+0000 7f18e867b640 1 -- 172.21.15.19:0/2800950939 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e006e330 con 0x7f18e00b75e0 2024-09-12T01:57:07.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.476+0000 7f18d6ffd640 1 -- 172.21.15.19:0/2800950939 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18d801c070 con 0x7f18e00b75e0 2024-09-12T01:57:07.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.476+0000 7f18d6ffd640 1 --2- 172.21.15.19:0/2800950939 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18c406be30 0x7f18c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.477+0000 7f18d6ffd640 1 -- 172.21.15.19:0/2800950939 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7f18d808a510 con 0x7f18e00b75e0 2024-09-12T01:57:07.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.477+0000 7f18e6417640 1 --2- 172.21.15.19:0/2800950939 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18c406be30 0x7f18c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.477+0000 7f18e6417640 1 --2- 172.21.15.19:0/2800950939 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18c406be30 0x7f18c406e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f18dc033000 tx=0x7f18dc008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:07.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.481+0000 7f18d6ffd640 1 -- 172.21.15.19:0/2800950939 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18d8058690 con 0x7f18e00b75e0 2024-09-12T01:57:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.694+0000 7f18e867b640 1 -- 172.21.15.19:0/2800950939 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18e00ba470 con 0x7f18e00b75e0 2024-09-12T01:57:07.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.694+0000 7f18d6ffd640 1 -- 172.21.15.19:0/2800950939 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5227 (secure 0 0 0) 0x7f18d805c990 con 0x7f18e00b75e0 2024-09-12T01:57:07.695 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:07.695 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"btime":"2024-09-12T01:57:04:677301+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1979542220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1979542220},{"type":"v1","addr":"172.21.15.135:6836","nonce":1979542220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/809710386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":809710386},{"type":"v1","addr":"172.21.15.19:6835","nonce":809710386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1005776280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1005776280},{"type":"v1","addr":"172.21.15.135:6837","nonce":1005776280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:56:48.431829+0000","modified":"2024-09-12T01:57:04.677295+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6834/3554496273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3554496273},{"type":"v1","addr":"172.21.15.19:6834","nonce":3554496273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5088,"qdb_cluster":[5088]},"id":2}]} 2024-09-12T01:57:07.696 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 20 2024-09-12T01:57:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.697+0000 7f18e867b640 1 -- 172.21.15.19:0/2800950939 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18c406be30 msgr2=0x7f18c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.697+0000 7f18e867b640 1 --2- 172.21.15.19:0/2800950939 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18c406be30 0x7f18c406e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f18dc033000 tx=0x7f18dc008030 comp rx=0 tx=0).stop 2024-09-12T01:57:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.697+0000 7f18e867b640 1 -- 172.21.15.19:0/2800950939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18e00b75e0 msgr2=0x7f18e00b7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.697+0000 7f18e867b640 1 --2- 172.21.15.19:0/2800950939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18e00b75e0 0x7f18e00b7a60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f18d8007fd0 tx=0x7f18d800e960 comp rx=0 tx=0).stop 2024-09-12T01:57:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.697+0000 7f18e867b640 1 -- 172.21.15.19:0/2800950939 shutdown_connections 2024-09-12T01:57:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.697+0000 7f18e867b640 1 --2- 172.21.15.19:0/2800950939 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18c406be30 0x7f18c406e2f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.697+0000 7f18e867b640 1 --2- 172.21.15.19:0/2800950939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18e00b75e0 0x7f18e00b7a60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.697+0000 7f18e867b640 1 --2- 172.21.15.19:0/2800950939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18e00b3200 0x7f18e00b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.697+0000 7f18e867b640 1 --2- 172.21.15.19:0/2800950939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18cc0039b0 0x7f18e0153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.697+0000 7f18e867b640 1 -- 172.21.15.19:0/2800950939 >> 172.21.15.19:0/2800950939 conn(0x7f18e00d44f0 msgr2=0x7f18e00b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.697+0000 7f18e867b640 1 -- 172.21.15.19:0/2800950939 shutdown_connections 2024-09-12T01:57:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.697+0000 7f18e867b640 1 -- 172.21.15.19:0/2800950939 wait complete. 2024-09-12T01:57:07.709 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-09-12T01:57:07.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.813+0000 7f337f280640 1 Processor -- start 2024-09-12T01:57:07.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.813+0000 7f337f280640 1 -- start start 2024-09-12T01:57:07.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.814+0000 7f337f280640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f337815c620 0x7f337809b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.814+0000 7f337f280640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f337809aa30 0x7f337809ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.814+0000 7f337f280640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33780b6c00 con 0x7f33780b67a0 2024-09-12T01:57:07.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.814+0000 7f337f280640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f33780b0600 con 0x7f337809aa30 2024-09-12T01:57:07.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.814+0000 7f337f280640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f337809b3a0 con 0x7f337815c620 2024-09-12T01:57:07.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.814+0000 7f337d81d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f337809aa30 0x7f337809ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.814+0000 7f337d01c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f337815c620 0x7f337809b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.814+0000 7f337d81d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f337809aa30 0x7f337809ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:45070/0 (socket says 172.21.15.19:45070) 2024-09-12T01:57:07.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.814+0000 7f337d01c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f337815c620 0x7f337809b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:38990/0 (socket says 172.21.15.19:38990) 2024-09-12T01:57:07.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.814+0000 7f337c81b640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f33780b67a0 0x7f33780b0a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:51990/0 (socket says 172.21.15.19:51990) 2024-09-12T01:57:07.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.814+0000 7f337d01c640 1 -- 172.21.15.19:0/776053524 learned_addr learned my addr 172.21.15.19:0/776053524 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:07.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.814+0000 7f337d01c640 1 -- 172.21.15.19:0/776053524 >> v2:172.21.15.135:3300/0 conn(0x7f337809aa30 msgr2=0x7f337809ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:07.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.815+0000 7f337d01c640 1 --2- 172.21.15.19:0/776053524 >> v2:172.21.15.135:3300/0 conn(0x7f337809aa30 0x7f337809ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.815+0000 7f337d01c640 1 -- 172.21.15.19:0/776053524 >> v1:172.21.15.135:6789/0 conn(0x7f33780b67a0 legacy=0x7f33780b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.815+0000 7f337d01c640 1 -- 172.21.15.19:0/776053524 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33780afcd0 con 0x7f337815c620 2024-09-12T01:57:07.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.815+0000 7f337d01c640 1 --2- 172.21.15.19:0/776053524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f337815c620 0x7f337809b9c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3374009870 tx=0x7f337402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d973158ebf52ebb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:07.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.815+0000 7f336ffff640 1 -- 172.21.15.19:0/776053524 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374037070 con 0x7f337815c620 2024-09-12T01:57:07.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.816+0000 7f336ffff640 1 -- 172.21.15.19:0/776053524 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3374032440 con 0x7f337815c620 2024-09-12T01:57:07.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.816+0000 7f336ffff640 1 -- 172.21.15.19:0/776053524 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374032810 con 0x7f337815c620 2024-09-12T01:57:07.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.816+0000 7f337f280640 1 -- 172.21.15.19:0/776053524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f337815c620 msgr2=0x7f337809b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.816+0000 7f337f280640 1 --2- 172.21.15.19:0/776053524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f337815c620 0x7f337809b9c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3374009870 tx=0x7f337402a270 comp rx=0 tx=0).stop 2024-09-12T01:57:07.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.816+0000 7f337f280640 1 -- 172.21.15.19:0/776053524 shutdown_connections 2024-09-12T01:57:07.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.816+0000 7f337f280640 1 --2- 172.21.15.19:0/776053524 >> v2:172.21.15.135:3300/0 conn(0x7f337809aa30 0x7f337809ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.816+0000 7f337f280640 1 --2- 172.21.15.19:0/776053524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f337815c620 0x7f337809b9c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.816+0000 7f337f280640 1 -- 172.21.15.19:0/776053524 >> 172.21.15.19:0/776053524 conn(0x7f33780b79e0 msgr2=0x7f33780b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:07.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.816+0000 7f337f280640 1 -- 172.21.15.19:0/776053524 shutdown_connections 2024-09-12T01:57:07.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.816+0000 7f337f280640 1 -- 172.21.15.19:0/776053524 wait complete. 2024-09-12T01:57:07.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.817+0000 7f337f280640 1 Processor -- start 2024-09-12T01:57:07.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.817+0000 7f337f280640 1 -- start start 2024-09-12T01:57:07.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.818+0000 7f337f280640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f337809aa30 0x7f3378145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.818+0000 7f337f280640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33780b67a0 0x7f337806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.818+0000 7f337f280640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f337806d260 0x7f337813f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.818+0000 7f337f280640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f33780b17a0 con 0x7f33780b67a0 2024-09-12T01:57:07.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.818+0000 7f337f280640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33780b0290 con 0x7f337806d260 2024-09-12T01:57:07.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.818+0000 7f337f280640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f33780af980 con 0x7f337809aa30 2024-09-12T01:57:07.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.818+0000 7f337c81b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33780b67a0 0x7f337806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.818+0000 7f337d81d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f337806d260 0x7f337813f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.818+0000 7f337c81b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33780b67a0 0x7f337806cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46312/0 (socket says 172.21.15.19:46312) 2024-09-12T01:57:07.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.818+0000 7f337c81b640 1 -- 172.21.15.19:0/3240507771 learned_addr learned my addr 172.21.15.19:0/3240507771 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:07.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.818+0000 7f337d81d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f337806d260 0x7f337813f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:45084/0 (socket says 172.21.15.19:45084) 2024-09-12T01:57:07.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.818+0000 7f337d01c640 1 --2- 172.21.15.19:0/3240507771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f337809aa30 0x7f3378145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.819+0000 7f337c81b640 1 -- 172.21.15.19:0/3240507771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f337809aa30 msgr2=0x7f3378145db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.819+0000 7f337c81b640 1 --2- 172.21.15.19:0/3240507771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f337809aa30 0x7f3378145db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.819+0000 7f337c81b640 1 -- 172.21.15.19:0/3240507771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f337806d260 msgr2=0x7f337813f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.819+0000 7f337c81b640 1 --2- 172.21.15.19:0/3240507771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f337806d260 0x7f337813f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.819+0000 7f337c81b640 1 -- 172.21.15.19:0/3240507771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337806d8a0 con 0x7f33780b67a0 2024-09-12T01:57:07.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.819+0000 7f337c81b640 1 --2- 172.21.15.19:0/3240507771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33780b67a0 0x7f337806cd20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f336800c430 tx=0x7f336800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:07.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.819+0000 7f336dffb640 1 -- 172.21.15.19:0/3240507771 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33680074e0 con 0x7f33780b67a0 2024-09-12T01:57:07.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.819+0000 7f336dffb640 1 -- 172.21.15.19:0/3240507771 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3368007680 con 0x7f33780b67a0 2024-09-12T01:57:07.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.819+0000 7f337f280640 1 -- 172.21.15.19:0/3240507771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f337806db80 con 0x7f33780b67a0 2024-09-12T01:57:07.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.819+0000 7f336dffb640 1 -- 172.21.15.19:0/3240507771 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3368004a00 con 0x7f33780b67a0 2024-09-12T01:57:07.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.819+0000 7f337f280640 1 -- 172.21.15.19:0/3240507771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f337806e140 con 0x7f33780b67a0 2024-09-12T01:57:07.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.821+0000 7f336dffb640 1 -- 172.21.15.19:0/3240507771 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f336801a020 con 0x7f33780b67a0 2024-09-12T01:57:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.821+0000 7f336dffb640 1 --2- 172.21.15.19:0/3240507771 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f335c06be30 0x7f335c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.822+0000 7f336dffb640 1 -- 172.21.15.19:0/3240507771 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7f336808a670 con 0x7f33780b67a0 2024-09-12T01:57:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.822+0000 7f337d01c640 1 --2- 172.21.15.19:0/3240507771 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f335c06be30 0x7f335c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.822+0000 7f337d01c640 1 --2- 172.21.15.19:0/3240507771 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f335c06be30 0x7f335c06e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3374034000 tx=0x7f337402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.823+0000 7f3382014740 1 Processor -- start 2024-09-12T01:57:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.823+0000 7f3382014740 1 -- start start 2024-09-12T01:57:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.823+0000 7f3382014740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0eff00 0x56495a0f02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.823+0000 7f3382014740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0ed6c0 0x56495a0ef250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.823+0000 7f3382014740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a0edb20 0x56495a0cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.823+0000 7f3382014740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56495a00c930 con 0x56495a0ed6c0 2024-09-12T01:57:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.823+0000 7f3382014740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564959fb4570 con 0x56495a0edb20 2024-09-12T01:57:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.823+0000 7f3382014740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56495a0088f0 con 0x56495a0eff00 2024-09-12T01:57:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.823+0000 7f337c81b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0ed6c0 0x56495a0ef250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.823+0000 7f337c81b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0ed6c0 0x56495a0ef250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46322/0 (socket says 172.21.15.19:46322) 2024-09-12T01:57:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.823+0000 7f337c81b640 1 -- 172.21.15.19:0/882611798 learned_addr learned my addr 172.21.15.19:0/882611798 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.823+0000 7f337d01c640 1 --2- 172.21.15.19:0/882611798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0eff00 0x56495a0f02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.824+0000 7f337d81d640 1 --2- 172.21.15.19:0/882611798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a0edb20 0x56495a0cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.824+0000 7f337c81b640 1 -- 172.21.15.19:0/882611798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0eff00 msgr2=0x56495a0f02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.824+0000 7f337c81b640 1 --2- 172.21.15.19:0/882611798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0eff00 0x56495a0f02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.824+0000 7f337c81b640 1 -- 172.21.15.19:0/882611798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a0edb20 msgr2=0x56495a0cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.824+0000 7f337c81b640 1 --2- 172.21.15.19:0/882611798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a0edb20 0x56495a0cfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.824+0000 7f337c81b640 1 -- 172.21.15.19:0/882611798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564959fc9200 con 0x56495a0ed6c0 2024-09-12T01:57:07.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.824+0000 7f337d81d640 1 --2- 172.21.15.19:0/882611798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a0edb20 0x56495a0cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:07.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.824+0000 7f337c81b640 1 --2- 172.21.15.19:0/882611798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0ed6c0 0x56495a0ef250 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f336800c400 tx=0x7f336805cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22c2d279be307de server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:07.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.824+0000 7f3362ffd640 1 -- 172.21.15.19:0/882611798 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336805f0d0 con 0x56495a0ed6c0 2024-09-12T01:57:07.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.824+0000 7f3362ffd640 1 -- 172.21.15.19:0/882611798 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3368054ef0 con 0x56495a0ed6c0 2024-09-12T01:57:07.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.824+0000 7f3362ffd640 1 -- 172.21.15.19:0/882611798 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3368058d20 con 0x56495a0ed6c0 2024-09-12T01:57:07.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.825+0000 7f3382014740 1 -- 172.21.15.19:0/882611798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0ed6c0 msgr2=0x56495a0ef250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.825+0000 7f3382014740 1 --2- 172.21.15.19:0/882611798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0ed6c0 0x56495a0ef250 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f336800c400 tx=0x7f336805cc40 comp rx=0 tx=0).stop 2024-09-12T01:57:07.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.825+0000 7f3382014740 1 -- 172.21.15.19:0/882611798 shutdown_connections 2024-09-12T01:57:07.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.825+0000 7f3382014740 1 --2- 172.21.15.19:0/882611798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a0edb20 0x56495a0cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.825+0000 7f3382014740 1 --2- 172.21.15.19:0/882611798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0ed6c0 0x56495a0ef250 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.825+0000 7f3382014740 1 --2- 172.21.15.19:0/882611798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0eff00 0x56495a0f02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.825+0000 7f3382014740 1 -- 172.21.15.19:0/882611798 >> 172.21.15.19:0/882611798 conn(0x56495a0a5df0 msgr2=0x56495a0edf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:07.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.825+0000 7f3382014740 1 -- 172.21.15.19:0/882611798 shutdown_connections 2024-09-12T01:57:07.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.825+0000 7f3382014740 1 -- 172.21.15.19:0/882611798 wait complete. 2024-09-12T01:57:07.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.825+0000 7f3382014740 1 -- start start 2024-09-12T01:57:07.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.825+0000 7f3382014740 1 Processor -- start 2024-09-12T01:57:07.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.826+0000 7f3382014740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a0edb20 0x56495a100f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.826+0000 7f3382014740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0eff00 0x56495a0eae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.826+0000 7f3382014740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a101780 0x56495a101ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.826+0000 7f3382014740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56495a0ec620 con 0x56495a101780 2024-09-12T01:57:07.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.826+0000 7f3382014740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564959f956a0 con 0x56495a0edb20 2024-09-12T01:57:07.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.826+0000 7f3382014740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56495a0ec900 con 0x56495a0eff00 2024-09-12T01:57:07.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.826+0000 7f3382014740 10 client.0 _ll_register_callbacks cb 0x564959fcd300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:07.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.826+0000 7f337d81d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a101780 0x56495a101ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.826+0000 7f337d81d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a101780 0x56495a101ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46328/0 (socket says 172.21.15.19:46328) 2024-09-12T01:57:07.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.826+0000 7f337d81d640 1 -- 172.21.15.19:0/3199142771 learned_addr learned my addr 172.21.15.19:0/3199142771 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:07.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.826+0000 7f337d01c640 1 --2- 172.21.15.19:0/3199142771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a0edb20 0x56495a100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.826+0000 7f337c81b640 1 --2- 172.21.15.19:0/3199142771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0eff00 0x56495a0eae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.827+0000 7f337d81d640 1 -- 172.21.15.19:0/3199142771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0eff00 msgr2=0x56495a0eae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:07.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.827+0000 7f337d81d640 1 --2- 172.21.15.19:0/3199142771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0eff00 0x56495a0eae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.827+0000 7f337d81d640 1 -- 172.21.15.19:0/3199142771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a0edb20 msgr2=0x56495a100f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:07.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.827+0000 7f337d81d640 1 --2- 172.21.15.19:0/3199142771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a0edb20 0x56495a100f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.827+0000 7f337d81d640 1 -- 172.21.15.19:0/3199142771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564959deb7c0 con 0x56495a101780 2024-09-12T01:57:07.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.827+0000 7f337d81d640 1 --2- 172.21.15.19:0/3199142771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a101780 0x56495a101ba0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3370007d50 tx=0x7f3370013680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63fe13bfebba7f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:07.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.827+0000 7f3357fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:57:07.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.827+0000 7f3357fff640 1 -- 172.21.15.19:0/3199142771 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337001c070 con 0x56495a101780 2024-09-12T01:57:07.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.827+0000 7f3382014740 1 -- 172.21.15.19:0/3199142771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3368054ef0 con 0x56495a101780 2024-09-12T01:57:07.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.827+0000 7f3357fff640 1 -- 172.21.15.19:0/3199142771 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7f3370016630 con 0x56495a101780 2024-09-12T01:57:07.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.827+0000 7f3357fff640 1 -- 172.21.15.19:0/3199142771 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3370027050 con 0x56495a101780 2024-09-12T01:57:07.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.827+0000 7f3382014740 10 client.5166 fetch_fsmap learned FSMap version 20 2024-09-12T01:57:07.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.827+0000 7f3382014740 1 -- 172.21.15.19:0/3199142771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x564959e4bf50 con 0x56495a101780 2024-09-12T01:57:07.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.827+0000 7f3357fff640 1 -- 172.21.15.19:0/3199142771 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3368054ef0 con 0x56495a101780 2024-09-12T01:57:07.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.827+0000 7f3357fff640 1 -- 172.21.15.19:0/3199142771 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7f337002a020 con 0x56495a101780 2024-09-12T01:57:07.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.827+0000 7f3382014740 10 client.5166 fetch_fsmap finished waiting for FSMap version 20 2024-09-12T01:57:07.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.828+0000 7f3382014740 10 client.5166 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T01:57:07.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.828+0000 7f3382014740 20 client.5166 populate_metadata read hostname 'smithi019' 2024-09-12T01:57:07.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.828+0000 7f3382014740 1 --2- 172.21.15.19:0/3199142771 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x56495a0e6b10 0x56495a0fe190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.828+0000 7f3382014740 4 client.5166 mds_command: new command op to 5088 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:07.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.828+0000 7f3382014740 1 -- 172.21.15.19:0/3199142771 --> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56495a01a060 con 0x56495a0e6b10 2024-09-12T01:57:07.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.828+0000 7f337d01c640 1 --2- 172.21.15.19:0/3199142771 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x56495a0e6b10 0x56495a0fe190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.828+0000 7f337d01c640 1 --2- 172.21.15.19:0/3199142771 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x56495a0e6b10 0x56495a0fe190 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af79056f26c62044 server_cookie=2c43cf04fe8a1726 in_seq=0 out_seq=0 2024-09-12T01:57:07.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.828+0000 7f3357fff640 10 client.5166 ms_handle_connect on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:07.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.829+0000 7f3357fff640 1 -- 172.21.15.19:0/3199142771 <== mds.0 v2:172.21.15.19:6832/3554496273 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56495a01a060 con 0x56495a0e6b10 2024-09-12T01:57:07.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.829+0000 7f3357fff640 10 client.5166 handle_command_reply: tid=0 2024-09-12T01:57:07.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.829+0000 7f3382014740 1 client.5166 shutdown 2024-09-12T01:57:07.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.829+0000 7f3382014740 1 -- 172.21.15.19:0/3199142771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a101780 msgr2=0x56495a101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.829+0000 7f3382014740 1 --2- 172.21.15.19:0/3199142771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a101780 0x56495a101ba0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3370007d50 tx=0x7f3370013680 comp rx=0 tx=0).stop 2024-09-12T01:57:07.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.829+0000 7f3382014740 1 -- 172.21.15.19:0/3199142771 shutdown_connections 2024-09-12T01:57:07.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.829+0000 7f3382014740 1 --2- 172.21.15.19:0/3199142771 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x56495a0e6b10 0x56495a0fe190 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.829+0000 7f3382014740 1 --2- 172.21.15.19:0/3199142771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a101780 0x56495a101ba0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.829+0000 7f3357fff640 0 client.5166 ms_handle_reset on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:07.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.829+0000 7f3382014740 1 --2- 172.21.15.19:0/3199142771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0eff00 0x56495a0eae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.829+0000 7f3382014740 1 --2- 172.21.15.19:0/3199142771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a0edb20 0x56495a100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.829+0000 7f3382014740 1 -- 172.21.15.19:0/3199142771 >> 172.21.15.19:0/3199142771 conn(0x56495a0ed6c0 msgr2=0x56495a0f1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:07.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.829+0000 7f3382014740 1 -- 172.21.15.19:0/3199142771 shutdown_connections 2024-09-12T01:57:07.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.829+0000 7f3382014740 1 -- 172.21.15.19:0/3199142771 wait complete. 2024-09-12T01:57:07.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.829+0000 7f3382014740 20 client.5166 trim_cache size 0 max 16384 2024-09-12T01:57:07.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.842+0000 7f3382014740 1 Processor -- start 2024-09-12T01:57:07.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.842+0000 7f3382014740 1 -- start start 2024-09-12T01:57:07.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.843+0000 7f3382014740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0edb20 0x56495a112a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.843+0000 7f3382014740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0eff00 0x56495a0e7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.843+0000 7f3382014740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a101780 0x56495a108530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.843+0000 7f3382014740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3378157e00 con 0x56495a0edb20 2024-09-12T01:57:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.843+0000 7f3382014740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33781f8e60 con 0x56495a101780 2024-09-12T01:57:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.843+0000 7f3382014740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f33781577b0 con 0x56495a0eff00 2024-09-12T01:57:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.843+0000 7f337d01c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0edb20 0x56495a112a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.843+0000 7f337d01c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0edb20 0x56495a112a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46338/0 (socket says 172.21.15.19:46338) 2024-09-12T01:57:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.843+0000 7f337d01c640 1 -- 172.21.15.19:0/3641562050 learned_addr learned my addr 172.21.15.19:0/3641562050 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.843+0000 7f337d01c640 1 -- 172.21.15.19:0/3641562050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0eff00 msgr2=0x56495a0e7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.843+0000 7f337d01c640 1 --2- 172.21.15.19:0/3641562050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0eff00 0x56495a0e7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.843+0000 7f337d01c640 1 -- 172.21.15.19:0/3641562050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a101780 msgr2=0x56495a108530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.843+0000 7f337d01c640 1 --2- 172.21.15.19:0/3641562050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a101780 0x56495a108530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.843+0000 7f337d01c640 1 -- 172.21.15.19:0/3641562050 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56495a0f0650 con 0x56495a0edb20 2024-09-12T01:57:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.843+0000 7f337d01c640 1 --2- 172.21.15.19:0/3641562050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0edb20 0x56495a112a80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f337402a860 tx=0x7f337402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404e0e9f880d212a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.844+0000 7f33627fc640 1 -- 172.21.15.19:0/3641562050 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374057070 con 0x56495a0edb20 2024-09-12T01:57:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.844+0000 7f33627fc640 1 -- 172.21.15.19:0/3641562050 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33740525b0 con 0x56495a0edb20 2024-09-12T01:57:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.844+0000 7f33627fc640 1 -- 172.21.15.19:0/3641562050 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374037040 con 0x56495a0edb20 2024-09-12T01:57:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.844+0000 7f3382014740 1 -- 172.21.15.19:0/3641562050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0edb20 msgr2=0x56495a112a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.844+0000 7f3382014740 1 --2- 172.21.15.19:0/3641562050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0edb20 0x56495a112a80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f337402a860 tx=0x7f337402c000 comp rx=0 tx=0).stop 2024-09-12T01:57:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.844+0000 7f3382014740 1 -- 172.21.15.19:0/3641562050 shutdown_connections 2024-09-12T01:57:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.844+0000 7f3382014740 1 --2- 172.21.15.19:0/3641562050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a101780 0x56495a108530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.844+0000 7f3382014740 1 --2- 172.21.15.19:0/3641562050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0eff00 0x56495a0e7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.844+0000 7f3382014740 1 --2- 172.21.15.19:0/3641562050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0edb20 0x56495a112a80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.844+0000 7f3382014740 1 -- 172.21.15.19:0/3641562050 >> 172.21.15.19:0/3641562050 conn(0x56495a0ed6c0 msgr2=0x56495a0e6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.844+0000 7f3382014740 1 -- 172.21.15.19:0/3641562050 shutdown_connections 2024-09-12T01:57:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.844+0000 7f3382014740 1 -- 172.21.15.19:0/3641562050 wait complete. 2024-09-12T01:57:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.845+0000 7f3382014740 1 -- start start 2024-09-12T01:57:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.845+0000 7f3382014740 1 Processor -- start 2024-09-12T01:57:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f3382014740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0edb20 0x56495a0edf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f3382014740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0eff00 0x56495a0ee440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f3382014740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a101780 0x56495a111620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f3382014740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56495a0ff610 con 0x56495a0eff00 2024-09-12T01:57:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f3382014740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56495a1014d0 con 0x56495a101780 2024-09-12T01:57:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f3382014740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56495a0d3930 con 0x56495a0edb20 2024-09-12T01:57:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f3382014740 10 client.0 _ll_register_callbacks cb 0x7f3370009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f337c81b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0eff00 0x56495a0ee440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f337c81b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0eff00 0x56495a0ee440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46348/0 (socket says 172.21.15.19:46348) 2024-09-12T01:57:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f337c81b640 1 -- 172.21.15.19:0/822606564 learned_addr learned my addr 172.21.15.19:0/822606564 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f337d01c640 1 --2- 172.21.15.19:0/822606564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0edb20 0x56495a0edf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f337d81d640 1 --2- 172.21.15.19:0/822606564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a101780 0x56495a111620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f337c81b640 1 -- 172.21.15.19:0/822606564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0edb20 msgr2=0x56495a0edf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f337c81b640 1 --2- 172.21.15.19:0/822606564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0edb20 0x56495a0edf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f337c81b640 1 -- 172.21.15.19:0/822606564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a101780 msgr2=0x56495a111620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f337c81b640 1 --2- 172.21.15.19:0/822606564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a101780 0x56495a111620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f337c81b640 1 -- 172.21.15.19:0/822606564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564959cdf0b0 con 0x56495a0eff00 2024-09-12T01:57:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f337d01c640 1 --2- 172.21.15.19:0/822606564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0edb20 0x56495a0edf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f337d81d640 1 --2- 172.21.15.19:0/822606564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a101780 0x56495a111620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f337c81b640 1 --2- 172.21.15.19:0/822606564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0eff00 0x56495a0ee440 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3368058580 tx=0x7f3368000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742d7ee05d154dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f3357fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:57:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f3357fff640 1 -- 172.21.15.19:0/822606564 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336805f0d0 con 0x56495a0eff00 2024-09-12T01:57:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f3357fff640 1 -- 172.21.15.19:0/822606564 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7f3368060f20 con 0x56495a0eff00 2024-09-12T01:57:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.846+0000 7f3382014740 1 -- 172.21.15.19:0/822606564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33740525b0 con 0x56495a0eff00 2024-09-12T01:57:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.847+0000 7f3357fff640 1 -- 172.21.15.19:0/822606564 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3368001120 con 0x56495a0eff00 2024-09-12T01:57:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.847+0000 7f3382014740 10 client.5172 fetch_fsmap learned FSMap version 20 2024-09-12T01:57:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.847+0000 7f3382014740 1 -- 172.21.15.19:0/822606564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x56495a0d0880 con 0x56495a0eff00 2024-09-12T01:57:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.847+0000 7f3357fff640 1 -- 172.21.15.19:0/822606564 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33740525b0 con 0x56495a0eff00 2024-09-12T01:57:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.847+0000 7f3357fff640 1 -- 172.21.15.19:0/822606564 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7f3368004ba0 con 0x56495a0eff00 2024-09-12T01:57:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.847+0000 7f3382014740 10 client.5172 fetch_fsmap finished waiting for FSMap version 20 2024-09-12T01:57:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.847+0000 7f3382014740 10 client.5172 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T01:57:07.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.847+0000 7f3382014740 20 client.5172 populate_metadata read hostname 'smithi019' 2024-09-12T01:57:07.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.847+0000 7f3382014740 1 --2- 172.21.15.19:0/822606564 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x56495a111b60 0x56495a111f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:07.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.847+0000 7f3382014740 4 client.5172 mds_command: new command op to 5088 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-09-12T01:57:07.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.847+0000 7f3382014740 1 -- 172.21.15.19:0/822606564 --> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x56495a0143b0 con 0x56495a111b60 2024-09-12T01:57:07.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.847+0000 7f337d01c640 1 --2- 172.21.15.19:0/822606564 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x56495a111b60 0x56495a111f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:07.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.847+0000 7f3357fff640 10 client.5172 ms_handle_connect on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:07.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.847+0000 7f337d01c640 1 --2- 172.21.15.19:0/822606564 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x56495a111b60 0x56495a111f40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a083a4a5c36ae0b server_cookie=327a27231958fd7 in_seq=0 out_seq=0 2024-09-12T01:57:07.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.847+0000 7f3357fff640 1 -- 172.21.15.19:0/822606564 <== mds.0 v2:172.21.15.19:6832/3554496273 1 ==== command_reply(tid 0: 0 ) ==== 8+0+237 (crc 0 0 0) 0x56495a0143b0 con 0x56495a111b60 2024-09-12T01:57:07.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.847+0000 7f3357fff640 10 client.5172 handle_command_reply: tid=0 2024-09-12T01:57:07.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.848+0000 7f3382014740 1 client.5172 shutdown 2024-09-12T01:57:07.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.848+0000 7f3382014740 1 -- 172.21.15.19:0/822606564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0eff00 msgr2=0x56495a0ee440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.848+0000 7f3382014740 1 --2- 172.21.15.19:0/822606564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0eff00 0x56495a0ee440 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3368058580 tx=0x7f3368000bc0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.848+0000 7f3382014740 1 -- 172.21.15.19:0/822606564 shutdown_connections 2024-09-12T01:57:07.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.848+0000 7f3382014740 1 --2- 172.21.15.19:0/822606564 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x56495a111b60 0x56495a111f40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.848+0000 7f3382014740 1 --2- 172.21.15.19:0/822606564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495a101780 0x56495a111620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.848+0000 7f3357fff640 0 client.5172 ms_handle_reset on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:07.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.848+0000 7f3382014740 1 --2- 172.21.15.19:0/822606564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495a0eff00 0x56495a0ee440 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.848+0000 7f3382014740 1 --2- 172.21.15.19:0/822606564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56495a0edb20 0x56495a0edf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.848+0000 7f3382014740 1 -- 172.21.15.19:0/822606564 >> 172.21.15.19:0/822606564 conn(0x56495a0ed6c0 msgr2=0x56495a0e7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:07.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.848+0000 7f3382014740 1 -- 172.21.15.19:0/822606564 shutdown_connections 2024-09-12T01:57:07.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.848+0000 7f3382014740 1 -- 172.21.15.19:0/822606564 wait complete. 2024-09-12T01:57:07.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.848+0000 7f3382014740 20 client.5172 trim_cache size 0 max 16384 2024-09-12T01:57:07.857 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:07.857 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-09-12T01:57:07.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:07.858 INFO:teuthology.orchestra.run.smithi019.stdout: "damage_type": "dentry", 2024-09-12T01:57:07.858 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 3691414925, 2024-09-12T01:57:07.858 INFO:teuthology.orchestra.run.smithi019.stdout: "ino": 1099511627776, 2024-09-12T01:57:07.858 INFO:teuthology.orchestra.run.smithi019.stdout: "frag": "*", 2024-09-12T01:57:07.858 INFO:teuthology.orchestra.run.smithi019.stdout: "dname": "file_to_be_damaged", 2024-09-12T01:57:07.858 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_id": "head", 2024-09-12T01:57:07.858 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/subdir/file_to_be_damaged" 2024-09-12T01:57:07.858 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:07.858 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-09-12T01:57:07.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.848+0000 7f337f280640 1 -- 172.21.15.19:0/3240507771 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f335c06be30 msgr2=0x7f335c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.848+0000 7f337f280640 1 --2- 172.21.15.19:0/3240507771 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f335c06be30 0x7f335c06e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3374034000 tx=0x7f337402e000 comp rx=0 tx=0).stop 2024-09-12T01:57:07.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.848+0000 7f337f280640 1 -- 172.21.15.19:0/3240507771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33780b67a0 msgr2=0x7f337806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.848+0000 7f337f280640 1 --2- 172.21.15.19:0/3240507771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33780b67a0 0x7f337806cd20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f336800c430 tx=0x7f336800c8f0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.849+0000 7f337f280640 1 -- 172.21.15.19:0/3240507771 shutdown_connections 2024-09-12T01:57:07.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.849+0000 7f337f280640 1 --2- 172.21.15.19:0/3240507771 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f335c06be30 0x7f335c06e2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.849+0000 7f337f280640 1 --2- 172.21.15.19:0/3240507771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f337806d260 0x7f337813f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.849+0000 7f337f280640 1 --2- 172.21.15.19:0/3240507771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33780b67a0 0x7f337806cd20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.849+0000 7f337f280640 1 --2- 172.21.15.19:0/3240507771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f337809aa30 0x7f3378145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.849+0000 7f337f280640 1 -- 172.21.15.19:0/3240507771 >> 172.21.15.19:0/3240507771 conn(0x7f33780b79e0 msgr2=0x7f33780ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:07.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.849+0000 7f337f280640 1 -- 172.21.15.19:0/3240507771 shutdown_connections 2024-09-12T01:57:07.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07.849+0000 7f337f280640 1 -- 172.21.15.19:0/3240507771 wait complete. 2024-09-12T01:57:07.861 DEBUG:teuthology.orchestra.run.smithi019:> stdin-killer -- python3 -c ' 2024-09-12T01:57:07.861 DEBUG:teuthology.orchestra.run.smithi019:> import sys 2024-09-12T01:57:07.861 DEBUG:teuthology.orchestra.run.smithi019:> import errno 2024-09-12T01:57:07.861 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T01:57:07.861 DEBUG:teuthology.orchestra.run.smithi019:> try: 2024-09-12T01:57:07.861 DEBUG:teuthology.orchestra.run.smithi019:> f = open("/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged", "w") 2024-09-12T01:57:07.861 DEBUG:teuthology.orchestra.run.smithi019:> f.close() 2024-09-12T01:57:07.861 DEBUG:teuthology.orchestra.run.smithi019:> except IOError as e: 2024-09-12T01:57:07.861 DEBUG:teuthology.orchestra.run.smithi019:> sys.exit(errno.EIO) 2024-09-12T01:57:07.861 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-09-12T01:57:07.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:07 stdin-killer INFO: command exited with status 5: exiting normally with same code! 2024-09-12T01:57:07.937 DEBUG:teuthology.orchestra.run:got remote process result: 5 2024-09-12T01:57:07.938 DEBUG:teuthology.orchestra.run.smithi019:> stdin-killer -- python3 -c ' 2024-09-12T01:57:07.938 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-09-12T01:57:07.938 DEBUG:teuthology.orchestra.run.smithi019:> import stat 2024-09-12T01:57:07.938 DEBUG:teuthology.orchestra.run.smithi019:> import json 2024-09-12T01:57:07.938 DEBUG:teuthology.orchestra.run.smithi019:> import sys 2024-09-12T01:57:07.938 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T01:57:07.938 DEBUG:teuthology.orchestra.run.smithi019:> try: 2024-09-12T01:57:07.938 DEBUG:teuthology.orchestra.run.smithi019:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2024-09-12T01:57:07.939 DEBUG:teuthology.orchestra.run.smithi019:> except OSError as e: 2024-09-12T01:57:07.939 DEBUG:teuthology.orchestra.run.smithi019:> sys.exit(e.errno) 2024-09-12T01:57:07.939 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T01:57:07.939 DEBUG:teuthology.orchestra.run.smithi019:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-12T01:57:07.939 DEBUG:teuthology.orchestra.run.smithi019:> print(json.dumps( 2024-09-12T01:57:07.939 DEBUG:teuthology.orchestra.run.smithi019:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-12T01:57:07.939 DEBUG:teuthology.orchestra.run.smithi019:> indent=2)) 2024-09-12T01:57:07.940 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-09-12T01:57:08.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08 stdin-killer INFO: command exited with status 5: exiting normally with same code! 2024-09-12T01:57:08.056 DEBUG:teuthology.orchestra.run:got remote process result: 5 2024-09-12T01:57:08.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:08.056 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-09-12T01:57:08.113 INFO:teuthology.orchestra.run.smithi019.stdout:2 2024-09-12T01:57:08.114 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:57:08.114 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:57:08.170 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:57:08.170 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:57:08.227 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:57:08.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.370+0000 7fbd64d2a640 1 Processor -- start 2024-09-12T01:57:08.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.370+0000 7fbd64d2a640 1 -- start start 2024-09-12T01:57:08.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.371+0000 7fbd64d2a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbd60072940 0x7fbd60072da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.371+0000 7fbd64d2a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd600b3570 con 0x7fbd6015ba30 2024-09-12T01:57:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.371+0000 7fbd64d2a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd600b3850 con 0x7fbd600b4880 2024-09-12T01:57:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.371+0000 7fbd64d2a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fbd600732e0 con 0x7fbd60072940 2024-09-12T01:57:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.371+0000 7fbd5e59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbd6015ba30 0x7fbd6006f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56848/0 (socket says 172.21.15.19:56848) 2024-09-12T01:57:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.371+0000 7fbd5e59c640 1 -- 172.21.15.19:0/3022055625 learned_addr learned my addr 172.21.15.19:0/3022055625 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.371+0000 7fbd5dd9b640 1 --2- 172.21.15.19:0/3022055625 >> v2:172.21.15.135:3300/0 conn(0x7fbd60072940 0x7fbd60072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.371+0000 7fbd5d59a640 1 -- 172.21.15.19:0/3022055625 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236549970 0 0) 0x7fbd600b3570 con 0x7fbd6015ba30 2024-09-12T01:57:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.371+0000 7fbd5d59a640 1 -- 172.21.15.19:0/3022055625 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd48003520 con 0x7fbd6015ba30 2024-09-12T01:57:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.371+0000 7fbd5d59a640 1 -- 172.21.15.19:0/3022055625 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 575889225 0 0) 0x7fbd48003520 con 0x7fbd6015ba30 2024-09-12T01:57:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.371+0000 7fbd5d59a640 1 -- 172.21.15.19:0/3022055625 >> v2:172.21.15.135:3300/0 conn(0x7fbd60072940 msgr2=0x7fbd60072da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.371+0000 7fbd5d59a640 1 --2- 172.21.15.19:0/3022055625 >> v2:172.21.15.135:3300/0 conn(0x7fbd60072940 0x7fbd60072da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.371+0000 7fbd5d59a640 1 -- 172.21.15.19:0/3022055625 >> v1:172.21.15.135:6789/0 conn(0x7fbd600b4880 legacy=0x7fbd600b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.371+0000 7fbd5d59a640 1 -- 172.21.15.19:0/3022055625 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd600b3b30 con 0x7fbd6015ba30 2024-09-12T01:57:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.371+0000 7fbd5d59a640 1 -- 172.21.15.19:0/3022055625 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fbd50001670 con 0x7fbd6015ba30 2024-09-12T01:57:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.371+0000 7fbd5d59a640 1 -- 172.21.15.19:0/3022055625 >> v1:172.21.15.19:6789/0 conn(0x7fbd6015ba30 legacy=0x7fbd6006f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.371+0000 7fbd5d59a640 1 --2- 172.21.15.19:0/3022055625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd480039b0 0x7fbd48003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.372+0000 7fbd5d59a640 1 --2- 172.21.15.19:0/3022055625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd48004800 0x7fbd48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.372+0000 7fbd5d59a640 1 --2- 172.21.15.19:0/3022055625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd480051c0 0x7fbd4800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.372+0000 7fbd5d59a640 1 -- 172.21.15.19:0/3022055625 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4800e240 con 0x7fbd480051c0 2024-09-12T01:57:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.372+0000 7fbd5d59a640 1 -- 172.21.15.19:0/3022055625 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4800e3f0 con 0x7fbd48004800 2024-09-12T01:57:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.372+0000 7fbd5d59a640 1 -- 172.21.15.19:0/3022055625 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbd4800e5f0 con 0x7fbd480039b0 2024-09-12T01:57:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.372+0000 7fbd5ed9d640 1 --2- 172.21.15.19:0/3022055625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd480051c0 0x7fbd4800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.372+0000 7fbd5e59c640 1 --2- 172.21.15.19:0/3022055625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd480039b0 0x7fbd48003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.372+0000 7fbd5dd9b640 1 --2- 172.21.15.19:0/3022055625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd48004800 0x7fbd48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.372+0000 7fbd5ed9d640 1 -- 172.21.15.19:0/3022055625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd480039b0 msgr2=0x7fbd48003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.372+0000 7fbd5ed9d640 1 --2- 172.21.15.19:0/3022055625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd480039b0 0x7fbd48003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.372+0000 7fbd5ed9d640 1 -- 172.21.15.19:0/3022055625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd48004800 msgr2=0x7fbd48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.372+0000 7fbd5ed9d640 1 --2- 172.21.15.19:0/3022055625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd48004800 0x7fbd48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.372+0000 7fbd5ed9d640 1 -- 172.21.15.19:0/3022055625 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd48003520 con 0x7fbd480051c0 2024-09-12T01:57:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.372+0000 7fbd5dd9b640 1 --2- 172.21.15.19:0/3022055625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd48004800 0x7fbd48004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.373+0000 7fbd5ed9d640 1 -- 172.21.15.19:0/3022055625 reap_dead start 2024-09-12T01:57:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.373+0000 7fbd5ed9d640 1 --2- 172.21.15.19:0/3022055625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd480051c0 0x7fbd4800dbd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbd58001e50 tx=0x7fbd48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c83cf91b18f60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.373+0000 7fbd5d59a640 1 -- 172.21.15.19:0/3022055625 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58001a70 con 0x7fbd480051c0 2024-09-12T01:57:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.373+0000 7fbd5d59a640 1 -- 172.21.15.19:0/3022055625 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd58003970 con 0x7fbd480051c0 2024-09-12T01:57:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.373+0000 7fbd5d59a640 1 -- 172.21.15.19:0/3022055625 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58003d60 con 0x7fbd480051c0 2024-09-12T01:57:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.373+0000 7fbd64d2a640 1 -- 172.21.15.19:0/3022055625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd480051c0 msgr2=0x7fbd4800dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.373+0000 7fbd64d2a640 1 --2- 172.21.15.19:0/3022055625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd480051c0 0x7fbd4800dbd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbd58001e50 tx=0x7fbd48005830 comp rx=0 tx=0).stop 2024-09-12T01:57:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.373+0000 7fbd64d2a640 1 -- 172.21.15.19:0/3022055625 shutdown_connections 2024-09-12T01:57:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.373+0000 7fbd64d2a640 1 --2- 172.21.15.19:0/3022055625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd480051c0 0x7fbd4800dbd0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.373+0000 7fbd64d2a640 1 -- 172.21.15.19:0/3022055625 >> 172.21.15.19:0/3022055625 conn(0x7fbd60067d70 msgr2=0x7fbd6006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.373+0000 7fbd64d2a640 1 -- 172.21.15.19:0/3022055625 shutdown_connections 2024-09-12T01:57:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.374+0000 7fbd64d2a640 1 -- 172.21.15.19:0/3022055625 wait complete. 2024-09-12T01:57:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.375+0000 7fbd64d2a640 1 Processor -- start 2024-09-12T01:57:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.375+0000 7fbd64d2a640 1 -- start start 2024-09-12T01:57:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd64d2a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd480051c0 0x7fbd60154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd64d2a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd600ced10 0x7fbd601554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd64d2a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd601480b0 0x7fbd6006f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd64d2a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbd600ce810 con 0x7fbd480051c0 2024-09-12T01:57:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd64d2a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd600b4180 con 0x7fbd601480b0 2024-09-12T01:57:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd64d2a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbd600ccfe0 con 0x7fbd600ced10 2024-09-12T01:57:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd5e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd480051c0 0x7fbd60154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd5e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd480051c0 0x7fbd60154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46358/0 (socket says 172.21.15.19:46358) 2024-09-12T01:57:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd5e59c640 1 -- 172.21.15.19:0/3523941215 learned_addr learned my addr 172.21.15.19:0/3523941215 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd5dd9b640 1 --2- 172.21.15.19:0/3523941215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd600ced10 0x7fbd601554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd5ed9d640 1 --2- 172.21.15.19:0/3523941215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd601480b0 0x7fbd6006f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd5e59c640 1 -- 172.21.15.19:0/3523941215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd600ced10 msgr2=0x7fbd601554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd5e59c640 1 --2- 172.21.15.19:0/3523941215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd600ced10 0x7fbd601554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd5e59c640 1 -- 172.21.15.19:0/3523941215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd601480b0 msgr2=0x7fbd6006f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd5e59c640 1 --2- 172.21.15.19:0/3523941215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd601480b0 0x7fbd6006f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd5e59c640 1 -- 172.21.15.19:0/3523941215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd600cf190 con 0x7fbd480051c0 2024-09-12T01:57:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd5dd9b640 1 --2- 172.21.15.19:0/3523941215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd600ced10 0x7fbd601554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd5e59c640 1 --2- 172.21.15.19:0/3523941215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd480051c0 0x7fbd60154b70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbd50007340 tx=0x7fbd50007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd4effd640 1 -- 172.21.15.19:0/3523941215 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5000f940 con 0x7fbd480051c0 2024-09-12T01:57:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd4effd640 1 -- 172.21.15.19:0/3523941215 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd50018070 con 0x7fbd480051c0 2024-09-12T01:57:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd64d2a640 1 -- 172.21.15.19:0/3523941215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd600cf410 con 0x7fbd480051c0 2024-09-12T01:57:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd4effd640 1 -- 172.21.15.19:0/3523941215 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5000fd40 con 0x7fbd480051c0 2024-09-12T01:57:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.376+0000 7fbd64d2a640 1 -- 172.21.15.19:0/3523941215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd601475d0 con 0x7fbd480051c0 2024-09-12T01:57:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.377+0000 7fbd64d2a640 1 -- 172.21.15.19:0/3523941215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd60072da0 con 0x7fbd480051c0 2024-09-12T01:57:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.378+0000 7fbd4effd640 1 -- 172.21.15.19:0/3523941215 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd5001d460 con 0x7fbd480051c0 2024-09-12T01:57:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.378+0000 7fbd4effd640 1 --2- 172.21.15.19:0/3523941215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbd4006be60 0x7fbd4006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.379+0000 7fbd4effd640 1 -- 172.21.15.19:0/3523941215 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7fbd5008b120 con 0x7fbd480051c0 2024-09-12T01:57:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.379+0000 7fbd5dd9b640 1 --2- 172.21.15.19:0/3523941215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbd4006be60 0x7fbd4006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.379+0000 7fbd5dd9b640 1 --2- 172.21.15.19:0/3523941215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbd4006be60 0x7fbd4006e320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbd600cdd50 tx=0x7fbd54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.383+0000 7fbd4effd640 1 -- 172.21.15.19:0/3523941215 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbd600cf190 con 0x7fbd480051c0 2024-09-12T01:57:08.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.572+0000 7fbd64d2a640 1 -- 172.21.15.19:0/3523941215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbd601594c0 con 0x7fbd480051c0 2024-09-12T01:57:08.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.572+0000 7fbd4effd640 1 -- 172.21.15.19:0/3523941215 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v41) ==== 80+0+122 (secure 0 0 0) 0x7fbd50059910 con 0x7fbd480051c0 2024-09-12T01:57:08.573 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/1994815169 2024-09-13T01:57:00.902156+0000 2024-09-12T01:57:08.573 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/1994815169 2024-09-13T01:57:00.902156+0000 2024-09-12T01:57:08.573 INFO:teuthology.orchestra.run.smithi019.stderr:listed 2 entries 2024-09-12T01:57:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.574+0000 7fbd64d2a640 1 -- 172.21.15.19:0/3523941215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbd4006be60 msgr2=0x7fbd4006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.574+0000 7fbd64d2a640 1 --2- 172.21.15.19:0/3523941215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbd4006be60 0x7fbd4006e320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbd600cdd50 tx=0x7fbd54008040 comp rx=0 tx=0).stop 2024-09-12T01:57:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.574+0000 7fbd64d2a640 1 -- 172.21.15.19:0/3523941215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd480051c0 msgr2=0x7fbd60154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.574+0000 7fbd64d2a640 1 --2- 172.21.15.19:0/3523941215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd480051c0 0x7fbd60154b70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbd50007340 tx=0x7fbd50007800 comp rx=0 tx=0).stop 2024-09-12T01:57:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.575+0000 7fbd64d2a640 1 -- 172.21.15.19:0/3523941215 shutdown_connections 2024-09-12T01:57:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.575+0000 7fbd64d2a640 1 --2- 172.21.15.19:0/3523941215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbd4006be60 0x7fbd4006e320 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.575+0000 7fbd64d2a640 1 --2- 172.21.15.19:0/3523941215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd601480b0 0x7fbd6006f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.575+0000 7fbd64d2a640 1 --2- 172.21.15.19:0/3523941215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd600ced10 0x7fbd601554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.575+0000 7fbd64d2a640 1 --2- 172.21.15.19:0/3523941215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd480051c0 0x7fbd60154b70 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.575+0000 7fbd64d2a640 1 -- 172.21.15.19:0/3523941215 >> 172.21.15.19:0/3523941215 conn(0x7fbd60067d70 msgr2=0x7fbd600cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.575+0000 7fbd64d2a640 1 -- 172.21.15.19:0/3523941215 shutdown_connections 2024-09-12T01:57:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.575+0000 7fbd64d2a640 1 -- 172.21.15.19:0/3523941215 wait complete. 2024-09-12T01:57:08.586 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:57:08.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:08.586 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:57:08.616 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:57:08.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:08.617 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:57:08.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:08.674 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start /subdir repair 2024-09-12T01:57:08.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.820+0000 7fac87277640 1 Processor -- start 2024-09-12T01:57:08.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.821+0000 7fac87277640 1 -- start start 2024-09-12T01:57:08.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.821+0000 7fac87277640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fac800b43b0 0x7fac8006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.821+0000 7fac87277640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac8006c150 0x7fac8015fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.821+0000 7fac87277640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8015eff0 con 0x7fac80161ac0 2024-09-12T01:57:08.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.821+0000 7fac87277640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fac8006c5a0 con 0x7fac800b43b0 2024-09-12T01:57:08.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.821+0000 7fac87277640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fac8015f920 con 0x7fac8006c150 2024-09-12T01:57:08.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.822+0000 7fac84812640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fac800b43b0 0x7fac8006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.822+0000 7fac85814640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac8006c150 0x7fac8015fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.822+0000 7fac84812640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fac800b43b0 0x7fac8006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:45168/0 (socket says 172.21.15.19:45168) 2024-09-12T01:57:08.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.822+0000 7fac84812640 1 -- 172.21.15.19:0/4197035219 learned_addr learned my addr 172.21.15.19:0/4197035219 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:08.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.822+0000 7fac84812640 1 -- 172.21.15.19:0/4197035219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac8006c150 msgr2=0x7fac8015fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:08.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.822+0000 7fac84812640 1 --2- 172.21.15.19:0/4197035219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac8006c150 0x7fac8015fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.822+0000 7fac84812640 1 -- 172.21.15.19:0/4197035219 >> v1:172.21.15.135:6789/0 conn(0x7fac80161ac0 legacy=0x7fac800b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.822+0000 7fac84812640 1 -- 172.21.15.19:0/4197035219 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8015f2d0 con 0x7fac800b43b0 2024-09-12T01:57:08.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.822+0000 7fac85814640 1 --2- 172.21.15.19:0/4197035219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac8006c150 0x7fac8015fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:08.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.823+0000 7fac84812640 1 --2- 172.21.15.19:0/4197035219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac800b43b0 0x7fac8006bc10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fac74009870 tx=0x7fac7402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6146e26ae45b9e4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:08.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.823+0000 7fac7ffff640 1 -- 172.21.15.19:0/4197035219 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac74037070 con 0x7fac800b43b0 2024-09-12T01:57:08.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.823+0000 7fac7ffff640 1 -- 172.21.15.19:0/4197035219 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac74032440 con 0x7fac800b43b0 2024-09-12T01:57:08.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.823+0000 7fac7ffff640 1 -- 172.21.15.19:0/4197035219 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac74032810 con 0x7fac800b43b0 2024-09-12T01:57:08.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.824+0000 7fac87277640 1 -- 172.21.15.19:0/4197035219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac800b43b0 msgr2=0x7fac8006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.824+0000 7fac87277640 1 --2- 172.21.15.19:0/4197035219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac800b43b0 0x7fac8006bc10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fac74009870 tx=0x7fac7402a1c0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.824+0000 7fac87277640 1 -- 172.21.15.19:0/4197035219 shutdown_connections 2024-09-12T01:57:08.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.824+0000 7fac87277640 1 --2- 172.21.15.19:0/4197035219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac8006c150 0x7fac8015fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.824+0000 7fac87277640 1 --2- 172.21.15.19:0/4197035219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac800b43b0 0x7fac8006bc10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.824+0000 7fac87277640 1 -- 172.21.15.19:0/4197035219 >> 172.21.15.19:0/4197035219 conn(0x7fac8009aa30 msgr2=0x7fac800b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:08.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.824+0000 7fac87277640 1 -- 172.21.15.19:0/4197035219 shutdown_connections 2024-09-12T01:57:08.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.824+0000 7fac87277640 1 -- 172.21.15.19:0/4197035219 wait complete. 2024-09-12T01:57:08.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.825+0000 7fac87277640 1 Processor -- start 2024-09-12T01:57:08.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.825+0000 7fac87277640 1 -- start start 2024-09-12T01:57:08.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac87277640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac8006c150 0x7fac8009e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac87277640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac800b43b0 0x7fac800b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac87277640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac80161ac0 0x7fac800ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac87277640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fac8015ece0 con 0x7fac8006c150 2024-09-12T01:57:08.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac87277640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fac800b2d60 con 0x7fac80161ac0 2024-09-12T01:57:08.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac87277640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fac80161ea0 con 0x7fac800b43b0 2024-09-12T01:57:08.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac85013640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac8006c150 0x7fac8009e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac85013640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac8006c150 0x7fac8009e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46370/0 (socket says 172.21.15.19:46370) 2024-09-12T01:57:08.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac85013640 1 -- 172.21.15.19:0/3057872493 learned_addr learned my addr 172.21.15.19:0/3057872493 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:08.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac84812640 1 --2- 172.21.15.19:0/3057872493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac800b43b0 0x7fac800b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac85814640 1 --2- 172.21.15.19:0/3057872493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac80161ac0 0x7fac800ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac85013640 1 -- 172.21.15.19:0/3057872493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac800b43b0 msgr2=0x7fac800b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac85013640 1 --2- 172.21.15.19:0/3057872493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac800b43b0 0x7fac800b07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac85013640 1 -- 172.21.15.19:0/3057872493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac80161ac0 msgr2=0x7fac800ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac85013640 1 --2- 172.21.15.19:0/3057872493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac80161ac0 0x7fac800ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac85013640 1 -- 172.21.15.19:0/3057872493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac801443e0 con 0x7fac8006c150 2024-09-12T01:57:08.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac84812640 1 --2- 172.21.15.19:0/3057872493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac800b43b0 0x7fac800b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:08.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac85814640 1 --2- 172.21.15.19:0/3057872493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac80161ac0 0x7fac800ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:08.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac85013640 1 --2- 172.21.15.19:0/3057872493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac8006c150 0x7fac8009e3c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fac7800c3c0 tx=0x7fac7800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:08.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac7dffb640 1 -- 172.21.15.19:0/3057872493 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac780052d0 con 0x7fac8006c150 2024-09-12T01:57:08.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac7dffb640 1 -- 172.21.15.19:0/3057872493 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac78005490 con 0x7fac8006c150 2024-09-12T01:57:08.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.826+0000 7fac87277640 1 -- 172.21.15.19:0/3057872493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac8009d0a0 con 0x7fac8006c150 2024-09-12T01:57:08.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.827+0000 7fac7dffb640 1 -- 172.21.15.19:0/3057872493 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78007260 con 0x7fac8006c150 2024-09-12T01:57:08.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.827+0000 7fac87277640 1 -- 172.21.15.19:0/3057872493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac8009d8e0 con 0x7fac8006c150 2024-09-12T01:57:08.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.828+0000 7fac7dffb640 1 -- 172.21.15.19:0/3057872493 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac78007400 con 0x7fac8006c150 2024-09-12T01:57:08.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.828+0000 7fac7dffb640 1 --2- 172.21.15.19:0/3057872493 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac6c06be30 0x7fac6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.829+0000 7fac7dffb640 1 -- 172.21.15.19:0/3057872493 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7fac7808a5c0 con 0x7fac8006c150 2024-09-12T01:57:08.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.829+0000 7fac84812640 1 --2- 172.21.15.19:0/3057872493 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac6c06be30 0x7fac6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.829+0000 7fac84812640 1 --2- 172.21.15.19:0/3057872493 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac6c06be30 0x7fac6c06e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fac74034000 tx=0x7fac7402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.830+0000 7fac8a011740 1 Processor -- start 2024-09-12T01:57:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.830+0000 7fac8a011740 1 -- start start 2024-09-12T01:57:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.830+0000 7fac8a011740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092cc500 0x5573092cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.830+0000 7fac8a011740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092c9cc0 0x5573092cb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.830+0000 7fac8a011740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092ca120 0x5573092ac480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.830+0000 7fac8a011740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5573091e8ac0 con 0x5573092cc500 2024-09-12T01:57:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.830+0000 7fac8a011740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5573091907b0 con 0x5573092c9cc0 2024-09-12T01:57:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.830+0000 7fac8a011740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5573091e4a80 con 0x5573092ca120 2024-09-12T01:57:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.830+0000 7fac85013640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092cc500 0x5573092cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.830+0000 7fac85013640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092cc500 0x5573092cc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46372/0 (socket says 172.21.15.19:46372) 2024-09-12T01:57:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.830+0000 7fac85013640 1 -- 172.21.15.19:0/2633243665 learned_addr learned my addr 172.21.15.19:0/2633243665 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.830+0000 7fac84812640 1 --2- 172.21.15.19:0/2633243665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092c9cc0 0x5573092cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.830+0000 7fac85814640 1 --2- 172.21.15.19:0/2633243665 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092ca120 0x5573092ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.831+0000 7fac85013640 1 -- 172.21.15.19:0/2633243665 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092ca120 msgr2=0x5573092ac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:08.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.831+0000 7fac85013640 1 --2- 172.21.15.19:0/2633243665 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092ca120 0x5573092ac480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.831+0000 7fac85013640 1 -- 172.21.15.19:0/2633243665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092c9cc0 msgr2=0x5573092cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:08.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.831+0000 7fac85013640 1 --2- 172.21.15.19:0/2633243665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092c9cc0 0x5573092cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.831+0000 7fac85013640 1 -- 172.21.15.19:0/2633243665 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557308fc7a20 con 0x5573092cc500 2024-09-12T01:57:08.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.831+0000 7fac85814640 1 --2- 172.21.15.19:0/2633243665 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092ca120 0x5573092ac480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:08.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.831+0000 7fac85013640 1 --2- 172.21.15.19:0/2633243665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092cc500 0x5573092cc8e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fac78007810 tx=0x7fac7800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22ef7720a36a782 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:08.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.831+0000 7fac66ffd640 1 -- 172.21.15.19:0/2633243665 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac780568f0 con 0x5573092cc500 2024-09-12T01:57:08.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.831+0000 7fac66ffd640 1 -- 172.21.15.19:0/2633243665 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac78054c60 con 0x5573092cc500 2024-09-12T01:57:08.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.831+0000 7fac66ffd640 1 -- 172.21.15.19:0/2633243665 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7808a300 con 0x5573092cc500 2024-09-12T01:57:08.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.832+0000 7fac8a011740 1 -- 172.21.15.19:0/2633243665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092cc500 msgr2=0x5573092cc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.832+0000 7fac8a011740 1 --2- 172.21.15.19:0/2633243665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092cc500 0x5573092cc8e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fac78007810 tx=0x7fac7800a000 comp rx=0 tx=0).stop 2024-09-12T01:57:08.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.832+0000 7fac8a011740 1 -- 172.21.15.19:0/2633243665 shutdown_connections 2024-09-12T01:57:08.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.832+0000 7fac8a011740 1 --2- 172.21.15.19:0/2633243665 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092ca120 0x5573092ac480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.832+0000 7fac8a011740 1 --2- 172.21.15.19:0/2633243665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092c9cc0 0x5573092cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.832+0000 7fac8a011740 1 --2- 172.21.15.19:0/2633243665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092cc500 0x5573092cc8e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.832+0000 7fac8a011740 1 -- 172.21.15.19:0/2633243665 >> 172.21.15.19:0/2633243665 conn(0x557309282160 msgr2=0x5573092ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:08.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.832+0000 7fac8a011740 1 -- 172.21.15.19:0/2633243665 shutdown_connections 2024-09-12T01:57:08.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.832+0000 7fac8a011740 1 -- 172.21.15.19:0/2633243665 wait complete. 2024-09-12T01:57:08.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.832+0000 7fac8a011740 1 -- start start 2024-09-12T01:57:08.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.832+0000 7fac8a011740 1 Processor -- start 2024-09-12T01:57:08.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.833+0000 7fac8a011740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092ca120 0x5573092adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.833+0000 7fac8a011740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092cc500 0x5573092d9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.833+0000 7fac8a011740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092ac180 0x5573092ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.833+0000 7fac8a011740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5573092c8c20 con 0x5573092ca120 2024-09-12T01:57:08.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.833+0000 7fac8a011740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5573091717b0 con 0x5573092cc500 2024-09-12T01:57:08.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.833+0000 7fac8a011740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5573092c8f00 con 0x5573092ac180 2024-09-12T01:57:08.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.833+0000 7fac8a011740 10 client.0 _ll_register_callbacks cb 0x557308efae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:08.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.833+0000 7fac85013640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092ca120 0x5573092adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.833+0000 7fac85013640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092ca120 0x5573092adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46378/0 (socket says 172.21.15.19:46378) 2024-09-12T01:57:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.833+0000 7fac85013640 1 -- 172.21.15.19:0/3385025448 learned_addr learned my addr 172.21.15.19:0/3385025448 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.834+0000 7fac85814640 1 --2- 172.21.15.19:0/3385025448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092ac180 0x5573092ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.834+0000 7fac84812640 1 --2- 172.21.15.19:0/3385025448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092cc500 0x5573092d9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.834+0000 7fac85013640 1 -- 172.21.15.19:0/3385025448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092ac180 msgr2=0x5573092ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.834+0000 7fac85013640 1 --2- 172.21.15.19:0/3385025448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092ac180 0x5573092ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.834+0000 7fac85013640 1 -- 172.21.15.19:0/3385025448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092cc500 msgr2=0x5573092d9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.834+0000 7fac85013640 1 --2- 172.21.15.19:0/3385025448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092cc500 0x5573092d9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.834+0000 7fac85013640 1 -- 172.21.15.19:0/3385025448 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557308ebb310 con 0x5573092ca120 2024-09-12T01:57:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.834+0000 7fac85013640 1 --2- 172.21.15.19:0/3385025448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092ca120 0x5573092adf10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fac7805cb60 tx=0x7fac78000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c741569e0839408c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.834+0000 7fac5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:57:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.834+0000 7fac5ffff640 1 -- 172.21.15.19:0/3385025448 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7808a0c0 con 0x5573092ca120 2024-09-12T01:57:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.834+0000 7fac5ffff640 1 -- 172.21.15.19:0/3385025448 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7fac7808a260 con 0x5573092ca120 2024-09-12T01:57:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.834+0000 7fac8a011740 1 -- 172.21.15.19:0/3385025448 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac78054c60 con 0x5573092ca120 2024-09-12T01:57:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.834+0000 7fac5ffff640 1 -- 172.21.15.19:0/3385025448 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fac7805db30 con 0x5573092ca120 2024-09-12T01:57:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.834+0000 7fac8a011740 10 client.5187 fetch_fsmap learned FSMap version 20 2024-09-12T01:57:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.834+0000 7fac8a011740 1 -- 172.21.15.19:0/3385025448 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5573090281b0 con 0x5573092ca120 2024-09-12T01:57:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.834+0000 7fac5ffff640 1 -- 172.21.15.19:0/3385025448 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac78054c60 con 0x5573092ca120 2024-09-12T01:57:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.834+0000 7fac5ffff640 1 -- 172.21.15.19:0/3385025448 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7fac7805dcd0 con 0x5573092ca120 2024-09-12T01:57:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.835+0000 7fac8a011740 10 client.5187 fetch_fsmap finished waiting for FSMap version 20 2024-09-12T01:57:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.835+0000 7fac8a011740 10 client.5187 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-12T01:57:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.835+0000 7fac8a011740 20 client.5187 populate_metadata read hostname 'smithi019' 2024-09-12T01:57:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.835+0000 7fac8a011740 1 --2- 172.21.15.19:0/3385025448 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x5573092de1f0 0x5573092de600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.835+0000 7fac8a011740 4 client.5187 mds_command: new command op to 5088 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.835+0000 7fac8a011740 1 -- 172.21.15.19:0/3385025448 --> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573091f61f0 con 0x5573092de1f0 2024-09-12T01:57:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.835+0000 7fac84812640 1 --2- 172.21.15.19:0/3385025448 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x5573092de1f0 0x5573092de600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.835+0000 7fac84812640 1 --2- 172.21.15.19:0/3385025448 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x5573092de1f0 0x5573092de600 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c0c6e44180662bb server_cookie=492e169e3ce6b555 in_seq=0 out_seq=0 2024-09-12T01:57:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.835+0000 7fac5ffff640 10 client.5187 ms_handle_connect on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.836+0000 7fac5ffff640 1 -- 172.21.15.19:0/3385025448 <== mds.0 v2:172.21.15.19:6832/3554496273 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5573091f61f0 con 0x5573092de1f0 2024-09-12T01:57:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.836+0000 7fac5ffff640 10 client.5187 handle_command_reply: tid=0 2024-09-12T01:57:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.836+0000 7fac8a011740 1 client.5187 shutdown 2024-09-12T01:57:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.836+0000 7fac8a011740 1 -- 172.21.15.19:0/3385025448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092ca120 msgr2=0x5573092adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.836+0000 7fac8a011740 1 --2- 172.21.15.19:0/3385025448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092ca120 0x5573092adf10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fac7805cb60 tx=0x7fac78000bc0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.836+0000 7fac8a011740 1 -- 172.21.15.19:0/3385025448 shutdown_connections 2024-09-12T01:57:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.836+0000 7fac8a011740 1 --2- 172.21.15.19:0/3385025448 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x5573092de1f0 0x5573092de600 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.836+0000 7fac8a011740 1 --2- 172.21.15.19:0/3385025448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092ac180 0x5573092ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.836+0000 7fac8a011740 1 --2- 172.21.15.19:0/3385025448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092cc500 0x5573092d9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.836+0000 7fac5ffff640 0 client.5187 ms_handle_reset on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.836+0000 7fac8a011740 1 --2- 172.21.15.19:0/3385025448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092ca120 0x5573092adf10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.836+0000 7fac8a011740 1 -- 172.21.15.19:0/3385025448 >> 172.21.15.19:0/3385025448 conn(0x5573092c9cc0 msgr2=0x5573092ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.836+0000 7fac8a011740 1 -- 172.21.15.19:0/3385025448 shutdown_connections 2024-09-12T01:57:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.836+0000 7fac8a011740 1 -- 172.21.15.19:0/3385025448 wait complete. 2024-09-12T01:57:08.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.836+0000 7fac8a011740 20 client.5187 trim_cache size 0 max 16384 2024-09-12T01:57:08.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.854+0000 7fac8a011740 1 Processor -- start 2024-09-12T01:57:08.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.854+0000 7fac8a011740 1 -- start start 2024-09-12T01:57:08.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.854+0000 7fac8a011740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092ac180 0x5573092c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.854+0000 7fac8a011740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092ca120 0x5573092c0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.854+0000 7fac8a011740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092cc500 0x5573092dce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.854+0000 7fac8a011740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5573092810e0 con 0x5573092ac180 2024-09-12T01:57:08.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.854+0000 7fac8a011740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fac802014c0 con 0x5573092ca120 2024-09-12T01:57:08.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.854+0000 7fac8a011740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fac802004e0 con 0x5573092cc500 2024-09-12T01:57:08.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.855+0000 7fac85013640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092ac180 0x5573092c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.855+0000 7fac85013640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092ac180 0x5573092c6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46388/0 (socket says 172.21.15.19:46388) 2024-09-12T01:57:08.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.855+0000 7fac85013640 1 -- 172.21.15.19:0/2163827569 learned_addr learned my addr 172.21.15.19:0/2163827569 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:08.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.855+0000 7fac85013640 1 -- 172.21.15.19:0/2163827569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092cc500 msgr2=0x5573092dce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:08.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.855+0000 7fac85013640 1 --2- 172.21.15.19:0/2163827569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092cc500 0x5573092dce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.855+0000 7fac85013640 1 -- 172.21.15.19:0/2163827569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092ca120 msgr2=0x5573092c0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:08.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.855+0000 7fac85013640 1 --2- 172.21.15.19:0/2163827569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092ca120 0x5573092c0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.855+0000 7fac85013640 1 -- 172.21.15.19:0/2163827569 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557308e943d0 con 0x5573092ac180 2024-09-12T01:57:08.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.855+0000 7fac85013640 1 --2- 172.21.15.19:0/2163827569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092ac180 0x5573092c6da0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fac780582a0 tx=0x7fac78014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64573e7fa66a557 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:08.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.855+0000 7fac667fc640 1 -- 172.21.15.19:0/2163827569 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac780583c0 con 0x5573092ac180 2024-09-12T01:57:08.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.855+0000 7fac667fc640 1 -- 172.21.15.19:0/2163827569 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac78054c60 con 0x5573092ac180 2024-09-12T01:57:08.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.855+0000 7fac667fc640 1 -- 172.21.15.19:0/2163827569 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78057ba0 con 0x5573092ac180 2024-09-12T01:57:08.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.856+0000 7fac8a011740 1 -- 172.21.15.19:0/2163827569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092ac180 msgr2=0x5573092c6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.856+0000 7fac8a011740 1 --2- 172.21.15.19:0/2163827569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092ac180 0x5573092c6da0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fac780582a0 tx=0x7fac78014070 comp rx=0 tx=0).stop 2024-09-12T01:57:08.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.856+0000 7fac8a011740 1 -- 172.21.15.19:0/2163827569 shutdown_connections 2024-09-12T01:57:08.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.856+0000 7fac8a011740 1 --2- 172.21.15.19:0/2163827569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092cc500 0x5573092dce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.856+0000 7fac8a011740 1 --2- 172.21.15.19:0/2163827569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092ca120 0x5573092c0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.856+0000 7fac8a011740 1 --2- 172.21.15.19:0/2163827569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092ac180 0x5573092c6da0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.856+0000 7fac8a011740 1 -- 172.21.15.19:0/2163827569 >> 172.21.15.19:0/2163827569 conn(0x5573092c9cc0 msgr2=0x5573092ac600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:08.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.856+0000 7fac8a011740 1 -- 172.21.15.19:0/2163827569 shutdown_connections 2024-09-12T01:57:08.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.856+0000 7fac8a011740 1 -- 172.21.15.19:0/2163827569 wait complete. 2024-09-12T01:57:08.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.856+0000 7fac8a011740 1 -- start start 2024-09-12T01:57:08.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.856+0000 7fac8a011740 1 Processor -- start 2024-09-12T01:57:08.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.857+0000 7fac8a011740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092ac180 0x5573092a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.857+0000 7fac8a011740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092ca120 0x5573092afa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.857+0000 7fac8a011740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092cc500 0x5573092dc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.857+0000 7fac8a011740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fac801fff90 con 0x5573092cc500 2024-09-12T01:57:08.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.857+0000 7fac8a011740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fac8009bcd0 con 0x5573092ca120 2024-09-12T01:57:08.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.857+0000 7fac8a011740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5573092c8800 con 0x5573092ac180 2024-09-12T01:57:08.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.857+0000 7fac8a011740 10 client.0 _ll_register_callbacks cb 0x7fac74035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:08.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.857+0000 7fac85814640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092cc500 0x5573092dc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.857+0000 7fac85814640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092cc500 0x5573092dc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46404/0 (socket says 172.21.15.19:46404) 2024-09-12T01:57:08.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.857+0000 7fac85814640 1 -- 172.21.15.19:0/2441864902 learned_addr learned my addr 172.21.15.19:0/2441864902 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:08.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.858+0000 7fac85013640 1 --2- 172.21.15.19:0/2441864902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092ac180 0x5573092a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.858+0000 7fac84812640 1 --2- 172.21.15.19:0/2441864902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092ca120 0x5573092afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.858+0000 7fac85814640 1 -- 172.21.15.19:0/2441864902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092ac180 msgr2=0x5573092a59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:08.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.858+0000 7fac85814640 1 --2- 172.21.15.19:0/2441864902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092ac180 0x5573092a59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.858+0000 7fac85814640 1 -- 172.21.15.19:0/2441864902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092ca120 msgr2=0x5573092afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:08.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.858+0000 7fac85814640 1 --2- 172.21.15.19:0/2441864902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092ca120 0x5573092afa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.858+0000 7fac85814640 1 -- 172.21.15.19:0/2441864902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573092dc9e0 con 0x5573092cc500 2024-09-12T01:57:08.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.858+0000 7fac5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:57:08.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.858+0000 7fac85814640 1 --2- 172.21.15.19:0/2441864902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092cc500 0x5573092dc4a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fac70013d00 tx=0x7fac70007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd70ac67aace81b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:08.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.858+0000 7fac5ffff640 1 -- 172.21.15.19:0/2441864902 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7001d020 con 0x5573092cc500 2024-09-12T01:57:08.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.858+0000 7fac5ffff640 1 -- 172.21.15.19:0/2441864902 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7fac70007cb0 con 0x5573092cc500 2024-09-12T01:57:08.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.858+0000 7fac8a011740 1 -- 172.21.15.19:0/2441864902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac78054c60 con 0x5573092cc500 2024-09-12T01:57:08.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.858+0000 7fac5ffff640 1 -- 172.21.15.19:0/2441864902 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fac70027050 con 0x5573092cc500 2024-09-12T01:57:08.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.858+0000 7fac8a011740 10 client.5193 fetch_fsmap learned FSMap version 20 2024-09-12T01:57:08.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.858+0000 7fac8a011740 1 -- 172.21.15.19:0/2441864902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x557309284f80 con 0x5573092cc500 2024-09-12T01:57:08.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.858+0000 7fac5ffff640 1 -- 172.21.15.19:0/2441864902 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac78054c60 con 0x5573092cc500 2024-09-12T01:57:08.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.859+0000 7fac5ffff640 1 -- 172.21.15.19:0/2441864902 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7fac7002a020 con 0x5573092cc500 2024-09-12T01:57:08.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.859+0000 7fac8a011740 10 client.5193 fetch_fsmap finished waiting for FSMap version 20 2024-09-12T01:57:08.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.859+0000 7fac8a011740 10 client.5193 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-12T01:57:08.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.859+0000 7fac8a011740 20 client.5193 populate_metadata read hostname 'smithi019' 2024-09-12T01:57:08.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.859+0000 7fac8a011740 1 --2- 172.21.15.19:0/2441864902 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x5573093479b0 0x557309347dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.859+0000 7fac8a011740 4 client.5193 mds_command: new command op to 5088 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair"]}] 2024-09-12T01:57:08.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.859+0000 7fac8a011740 1 -- 172.21.15.19:0/2441864902 --> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair"]}) -- 0x5573091f0540 con 0x5573093479b0 2024-09-12T01:57:08.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.859+0000 7fac85013640 1 --2- 172.21.15.19:0/2441864902 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x5573093479b0 0x557309347dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.859+0000 7fac85013640 1 --2- 172.21.15.19:0/2441864902 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x5573093479b0 0x557309347dc0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d730e01e36d7270 server_cookie=22f0414d8ade300a in_seq=0 out_seq=0 2024-09-12T01:57:08.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.859+0000 7fac5ffff640 10 client.5193 ms_handle_connect on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:08.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.859+0000 7fac5ffff640 1 -- 172.21.15.19:0/2441864902 <== mds.0 v2:172.21.15.19:6832/3554496273 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5573091f0540 con 0x5573093479b0 2024-09-12T01:57:08.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.859+0000 7fac5ffff640 10 client.5193 handle_command_reply: tid=0 2024-09-12T01:57:08.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.859+0000 7fac8a011740 1 client.5193 shutdown 2024-09-12T01:57:08.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac8a011740 1 -- 172.21.15.19:0/2441864902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092cc500 msgr2=0x5573092dc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac8a011740 1 --2- 172.21.15.19:0/2441864902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092cc500 0x5573092dc4a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fac70013d00 tx=0x7fac70007620 comp rx=0 tx=0).stop 2024-09-12T01:57:08.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac8a011740 1 -- 172.21.15.19:0/2441864902 shutdown_connections 2024-09-12T01:57:08.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac8a011740 1 --2- 172.21.15.19:0/2441864902 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x5573093479b0 0x557309347dc0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac8a011740 1 --2- 172.21.15.19:0/2441864902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573092cc500 0x5573092dc4a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac8a011740 1 --2- 172.21.15.19:0/2441864902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573092ca120 0x5573092afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac5ffff640 0 client.5193 ms_handle_reset on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:08.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac8a011740 1 --2- 172.21.15.19:0/2441864902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573092ac180 0x5573092a59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac8a011740 1 -- 172.21.15.19:0/2441864902 >> 172.21.15.19:0/2441864902 conn(0x5573092c9cc0 msgr2=0x5573092c0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:08.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac8a011740 1 -- 172.21.15.19:0/2441864902 shutdown_connections 2024-09-12T01:57:08.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac8a011740 1 -- 172.21.15.19:0/2441864902 wait complete. 2024-09-12T01:57:08.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac8a011740 20 client.5193 trim_cache size 0 max 16384 2024-09-12T01:57:08.867 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:57:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-12T01:57:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "90fc2e04-abc7-464b-bed8-c299760e34d9", 2024-09-12T01:57:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-12T01:57:08.868 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:57:08.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac87277640 1 -- 172.21.15.19:0/3057872493 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac6c06be30 msgr2=0x7fac6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac87277640 1 --2- 172.21.15.19:0/3057872493 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac6c06be30 0x7fac6c06e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fac74034000 tx=0x7fac7402e000 comp rx=0 tx=0).stop 2024-09-12T01:57:08.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac87277640 1 -- 172.21.15.19:0/3057872493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac8006c150 msgr2=0x7fac8009e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac87277640 1 --2- 172.21.15.19:0/3057872493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac8006c150 0x7fac8009e3c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fac7800c3c0 tx=0x7fac7800c880 comp rx=0 tx=0).stop 2024-09-12T01:57:08.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac87277640 1 -- 172.21.15.19:0/3057872493 shutdown_connections 2024-09-12T01:57:08.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac87277640 1 --2- 172.21.15.19:0/3057872493 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac6c06be30 0x7fac6c06e2f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac87277640 1 --2- 172.21.15.19:0/3057872493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac80161ac0 0x7fac800ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac87277640 1 --2- 172.21.15.19:0/3057872493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac800b43b0 0x7fac800b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.860+0000 7fac87277640 1 --2- 172.21.15.19:0/3057872493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac8006c150 0x7fac8009e3c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.861+0000 7fac87277640 1 -- 172.21.15.19:0/3057872493 >> 172.21.15.19:0/3057872493 conn(0x7fac8009aa30 msgr2=0x7fac80146ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:08.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.861+0000 7fac87277640 1 -- 172.21.15.19:0/3057872493 shutdown_connections 2024-09-12T01:57:08.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.861+0000 7fac87277640 1 -- 172.21.15.19:0/3057872493 wait complete. 2024-09-12T01:57:08.871 INFO:tasks.cephfs.test_damage:{ "return_code": 0, "scrub_tag": "90fc2e04-abc7-464b-bed8-c299760e34d9", "mode": "asynchronous" } 2024-09-12T01:57:08.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:08.872 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-12T01:57:08.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.976+0000 7fcc1375f640 1 Processor -- start 2024-09-12T01:57:08.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.976+0000 7fcc1375f640 1 -- start start 2024-09-12T01:57:08.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.977+0000 7fcc1375f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c161d00 0x7fcc0c0b5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.977+0000 7fcc1375f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc0c0d4300 con 0x7fcc0c0b62b0 2024-09-12T01:57:08.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.977+0000 7fcc1375f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc0c0b49a0 con 0x7fcc0c161920 2024-09-12T01:57:08.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.977+0000 7fcc1375f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcc0c0b4c40 con 0x7fcc0c161d00 2024-09-12T01:57:08.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.977+0000 7fcc11cfc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcc0c0b62b0 0x7fcc0c0d2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56862/0 (socket says 172.21.15.19:56862) 2024-09-12T01:57:08.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.977+0000 7fcc11cfc640 1 -- 172.21.15.19:0/747600403 learned_addr learned my addr 172.21.15.19:0/747600403 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:08.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.977+0000 7fcc10cfa640 1 --2- 172.21.15.19:0/747600403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c161d00 0x7fcc0c0b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.978+0000 7fcc03fff640 1 -- 172.21.15.19:0/747600403 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3291201209 0 0) 0x7fcc0c0d4300 con 0x7fcc0c0b62b0 2024-09-12T01:57:08.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.978+0000 7fcc03fff640 1 -- 172.21.15.19:0/747600403 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbf8003520 con 0x7fcc0c0b62b0 2024-09-12T01:57:08.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.978+0000 7fcc03fff640 1 -- 172.21.15.19:0/747600403 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1192124174 0 0) 0x7fcc0c0b49a0 con 0x7fcc0c161920 2024-09-12T01:57:08.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.978+0000 7fcc03fff640 1 -- 172.21.15.19:0/747600403 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc0c0d4300 con 0x7fcc0c161920 2024-09-12T01:57:08.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.978+0000 7fcc10cfa640 1 -- 172.21.15.19:0/747600403 >> v1:172.21.15.135:6789/0 conn(0x7fcc0c161920 legacy=0x7fcc0c0b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.978+0000 7fcc10cfa640 1 -- 172.21.15.19:0/747600403 >> v1:172.21.15.19:6789/0 conn(0x7fcc0c0b62b0 legacy=0x7fcc0c0d2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.978+0000 7fcc10cfa640 1 -- 172.21.15.19:0/747600403 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0c0d4db0 con 0x7fcc0c161d00 2024-09-12T01:57:08.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.979+0000 7fcc10cfa640 1 --2- 172.21.15.19:0/747600403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c161d00 0x7fcc0c0b5090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c0b4b70 tx=0x7fcbfc02a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e02a740205a646a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:08.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.979+0000 7fcc03fff640 1 -- 172.21.15.19:0/747600403 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc037070 con 0x7fcc0c161d00 2024-09-12T01:57:08.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.979+0000 7fcc03fff640 1 -- 172.21.15.19:0/747600403 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbfc02ae20 con 0x7fcc0c161d00 2024-09-12T01:57:08.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.979+0000 7fcc03fff640 1 -- 172.21.15.19:0/747600403 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc032640 con 0x7fcc0c161d00 2024-09-12T01:57:08.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.979+0000 7fcc1375f640 1 -- 172.21.15.19:0/747600403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c161d00 msgr2=0x7fcc0c0b5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.979+0000 7fcc1375f640 1 --2- 172.21.15.19:0/747600403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c161d00 0x7fcc0c0b5090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c0b4b70 tx=0x7fcbfc02a0d0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.979+0000 7fcc1375f640 1 -- 172.21.15.19:0/747600403 shutdown_connections 2024-09-12T01:57:08.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.979+0000 7fcc1375f640 1 --2- 172.21.15.19:0/747600403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c161d00 0x7fcc0c0b5090 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.979+0000 7fcc1375f640 1 -- 172.21.15.19:0/747600403 >> 172.21.15.19:0/747600403 conn(0x7fcc0c08bfc0 msgr2=0x7fcc0c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:08.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.979+0000 7fcc1375f640 1 -- 172.21.15.19:0/747600403 shutdown_connections 2024-09-12T01:57:08.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.979+0000 7fcc1375f640 1 -- 172.21.15.19:0/747600403 wait complete. 2024-09-12T01:57:08.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.981+0000 7fcc1375f640 1 Processor -- start 2024-09-12T01:57:08.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.981+0000 7fcc1375f640 1 -- start start 2024-09-12T01:57:08.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.981+0000 7fcc1375f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc0c0b62b0 0x7fcc0c0cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.981+0000 7fcc1375f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c161920 0x7fcc0c14d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.981+0000 7fcc1375f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc0c161d00 0x7fcc0c0c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.981+0000 7fcc1375f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c0d2d10 con 0x7fcc0c161d00 2024-09-12T01:57:08.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.981+0000 7fcc1375f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c0b6970 con 0x7fcc0c0b62b0 2024-09-12T01:57:08.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.981+0000 7fcc1375f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcc0c0d2e90 con 0x7fcc0c161920 2024-09-12T01:57:08.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.981+0000 7fcc11cfc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc0c161d00 0x7fcc0c0c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.981+0000 7fcc11cfc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc0c161d00 0x7fcc0c0c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46412/0 (socket says 172.21.15.19:46412) 2024-09-12T01:57:08.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.981+0000 7fcc11cfc640 1 -- 172.21.15.19:0/4017385804 learned_addr learned my addr 172.21.15.19:0/4017385804 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:08.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.982+0000 7fcc11cfc640 1 -- 172.21.15.19:0/4017385804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c161920 msgr2=0x7fcc0c14d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.982+0000 7fcc10cfa640 1 --2- 172.21.15.19:0/4017385804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c161920 0x7fcc0c14d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.982+0000 7fcc114fb640 1 --2- 172.21.15.19:0/4017385804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc0c0b62b0 0x7fcc0c0cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.982+0000 7fcc11cfc640 1 --2- 172.21.15.19:0/4017385804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c161920 0x7fcc0c14d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.982+0000 7fcc11cfc640 1 -- 172.21.15.19:0/4017385804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc0c0b62b0 msgr2=0x7fcc0c0cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.982+0000 7fcc11cfc640 1 --2- 172.21.15.19:0/4017385804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc0c0b62b0 0x7fcc0c0cc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.982+0000 7fcc11cfc640 1 -- 172.21.15.19:0/4017385804 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0c0b75a0 con 0x7fcc0c161d00 2024-09-12T01:57:08.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.982+0000 7fcc11cfc640 1 --2- 172.21.15.19:0/4017385804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc0c161d00 0x7fcc0c0c9d50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400cbc0 tx=0x7fcc0400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:08.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.982+0000 7fcc01ffb640 1 -- 172.21.15.19:0/4017385804 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04017070 con 0x7fcc0c161d00 2024-09-12T01:57:08.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.982+0000 7fcc01ffb640 1 -- 172.21.15.19:0/4017385804 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc0400ace0 con 0x7fcc0c161d00 2024-09-12T01:57:08.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.982+0000 7fcc01ffb640 1 -- 172.21.15.19:0/4017385804 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04012600 con 0x7fcc0c161d00 2024-09-12T01:57:08.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.982+0000 7fcc1375f640 1 -- 172.21.15.19:0/4017385804 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc0c0b7880 con 0x7fcc0c161d00 2024-09-12T01:57:08.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.982+0000 7fcc1375f640 1 -- 172.21.15.19:0/4017385804 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc0c0b7e40 con 0x7fcc0c161d00 2024-09-12T01:57:08.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.984+0000 7fcc01ffb640 1 -- 172.21.15.19:0/4017385804 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc0401a070 con 0x7fcc0c161d00 2024-09-12T01:57:08.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.984+0000 7fcc01ffb640 1 --2- 172.21.15.19:0/4017385804 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcbf006be60 0x7fcbf006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.984+0000 7fcc01ffb640 1 -- 172.21.15.19:0/4017385804 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7fcc0408ada0 con 0x7fcc0c161d00 2024-09-12T01:57:08.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.985+0000 7fcc114fb640 1 --2- 172.21.15.19:0/4017385804 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcbf006be60 0x7fcbf006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.985+0000 7fcc114fb640 1 --2- 172.21.15.19:0/4017385804 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcbf006be60 0x7fcbf006e320 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcc080010e0 tx=0x7fcc08009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:08.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.985+0000 7fcc165d4740 1 Processor -- start 2024-09-12T01:57:08.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.985+0000 7fcc165d4740 1 -- start start 2024-09-12T01:57:08.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.986+0000 7fcc165d4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 0x55940aeae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.986+0000 7fcc165d4740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae660e0 0x55940ae68d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.986+0000 7fcc165d4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae6a0b0 0x55940ae631a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.986+0000 7fcc165d4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55940adcb6f0 con 0x55940ae68920 2024-09-12T01:57:08.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.986+0000 7fcc165d4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55940ad73330 con 0x55940ae6a0b0 2024-09-12T01:57:08.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.986+0000 7fcc165d4740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55940adc76b0 con 0x55940ae660e0 2024-09-12T01:57:08.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.986+0000 7fcc114fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 0x55940aeae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.986+0000 7fcc114fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 0x55940aeae0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46416/0 (socket says 172.21.15.19:46416) 2024-09-12T01:57:08.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.986+0000 7fcc114fb640 1 -- 172.21.15.19:0/3428426401 learned_addr learned my addr 172.21.15.19:0/3428426401 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:08.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.986+0000 7fcc11cfc640 1 --2- 172.21.15.19:0/3428426401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae6a0b0 0x55940ae631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.986+0000 7fcc10cfa640 1 --2- 172.21.15.19:0/3428426401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae660e0 0x55940ae68d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.987+0000 7fcc114fb640 1 -- 172.21.15.19:0/3428426401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae660e0 msgr2=0x55940ae68d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:08.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.987+0000 7fcc114fb640 1 --2- 172.21.15.19:0/3428426401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae660e0 0x55940ae68d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.987+0000 7fcc114fb640 1 -- 172.21.15.19:0/3428426401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae6a0b0 msgr2=0x55940ae631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:08.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.987+0000 7fcc114fb640 1 --2- 172.21.15.19:0/3428426401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae6a0b0 0x55940ae631a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.987+0000 7fcc114fb640 1 -- 172.21.15.19:0/3428426401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55940ad990d0 con 0x55940ae68920 2024-09-12T01:57:08.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.987+0000 7fcc114fb640 1 --2- 172.21.15.19:0/3428426401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 0x55940aeae0c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800d940 tx=0x7fcc08010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45716a831c78c62 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:08.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.987+0000 7fcbeeffd640 1 -- 172.21.15.19:0/3428426401 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc08024070 con 0x55940ae68920 2024-09-12T01:57:08.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.987+0000 7fcbeeffd640 1 -- 172.21.15.19:0/3428426401 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc08014db0 con 0x55940ae68920 2024-09-12T01:57:08.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.987+0000 7fcbeeffd640 1 -- 172.21.15.19:0/3428426401 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0801f620 con 0x55940ae68920 2024-09-12T01:57:08.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.988+0000 7fcc165d4740 1 -- 172.21.15.19:0/3428426401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 msgr2=0x55940aeae0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.988+0000 7fcc165d4740 1 --2- 172.21.15.19:0/3428426401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 0x55940aeae0c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800d940 tx=0x7fcc08010000 comp rx=0 tx=0).stop 2024-09-12T01:57:08.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.988+0000 7fcc165d4740 1 -- 172.21.15.19:0/3428426401 shutdown_connections 2024-09-12T01:57:08.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.988+0000 7fcc165d4740 1 --2- 172.21.15.19:0/3428426401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae6a0b0 0x55940ae631a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.988+0000 7fcc165d4740 1 --2- 172.21.15.19:0/3428426401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae660e0 0x55940ae68d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.988+0000 7fcc165d4740 1 --2- 172.21.15.19:0/3428426401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 0x55940aeae0c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.988+0000 7fcc165d4740 1 -- 172.21.15.19:0/3428426401 >> 172.21.15.19:0/3428426401 conn(0x55940ae65370 msgr2=0x55940aead590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:08.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.988+0000 7fcc165d4740 1 -- 172.21.15.19:0/3428426401 shutdown_connections 2024-09-12T01:57:08.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.988+0000 7fcc165d4740 1 -- 172.21.15.19:0/3428426401 wait complete. 2024-09-12T01:57:08.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.988+0000 7fcc165d4740 1 -- start start 2024-09-12T01:57:08.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.988+0000 7fcc165d4740 1 Processor -- start 2024-09-12T01:57:08.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.989+0000 7fcc165d4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 0x55940aeaac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.989+0000 7fcc165d4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae6a0b0 0x55940ae67700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.989+0000 7fcc165d4740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae67c40 0x55940ae924a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.989+0000 7fcc165d4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55940ae64810 con 0x55940ae68920 2024-09-12T01:57:08.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.989+0000 7fcc165d4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55940ad544f0 con 0x55940ae6a0b0 2024-09-12T01:57:08.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.989+0000 7fcc165d4740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55940aeae8f0 con 0x55940ae67c40 2024-09-12T01:57:08.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.989+0000 7fcc165d4740 10 client.0 _ll_register_callbacks cb 0x55940ad75b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:08.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.989+0000 7fcc114fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 0x55940aeaac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.989+0000 7fcc114fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 0x55940aeaac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46418/0 (socket says 172.21.15.19:46418) 2024-09-12T01:57:08.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.989+0000 7fcc114fb640 1 -- 172.21.15.19:0/2228883263 learned_addr learned my addr 172.21.15.19:0/2228883263 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:08.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcc10cfa640 1 --2- 172.21.15.19:0/2228883263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae6a0b0 0x55940ae67700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcc11cfc640 1 --2- 172.21.15.19:0/2228883263 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae67c40 0x55940ae924a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcc114fb640 1 -- 172.21.15.19:0/2228883263 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae67c40 msgr2=0x55940ae924a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:08.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcc114fb640 1 --2- 172.21.15.19:0/2228883263 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae67c40 0x55940ae924a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcc114fb640 1 -- 172.21.15.19:0/2228883263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae6a0b0 msgr2=0x55940ae67700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:08.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcc114fb640 1 --2- 172.21.15.19:0/2228883263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae6a0b0 0x55940ae67700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcc114fb640 1 -- 172.21.15.19:0/2228883263 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55940aba87d0 con 0x55940ae68920 2024-09-12T01:57:08.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcc11cfc640 1 --2- 172.21.15.19:0/2228883263 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae67c40 0x55940ae924a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:08.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcc10cfa640 1 --2- 172.21.15.19:0/2228883263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae6a0b0 0x55940ae67700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:08.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcc114fb640 1 --2- 172.21.15.19:0/2228883263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 0x55940aeaac10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcc08007b60 tx=0x7fcc08000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae051088e51305d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:08.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcbe7fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:57:08.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcbe7fff640 1 -- 172.21.15.19:0/2228883263 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc08024040 con 0x55940ae68920 2024-09-12T01:57:08.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcbe7fff640 1 -- 172.21.15.19:0/2228883263 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7fcc0802acd0 con 0x55940ae68920 2024-09-12T01:57:08.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcc165d4740 1 -- 172.21.15.19:0/2228883263 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc08014db0 con 0x55940ae68920 2024-09-12T01:57:08.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcbe7fff640 1 -- 172.21.15.19:0/2228883263 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcc08031050 con 0x55940ae68920 2024-09-12T01:57:08.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcc165d4740 10 client.5205 fetch_fsmap learned FSMap version 20 2024-09-12T01:57:08.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcc165d4740 1 -- 172.21.15.19:0/2228883263 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55940aade3f0 con 0x55940ae68920 2024-09-12T01:57:08.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcbe7fff640 1 -- 172.21.15.19:0/2228883263 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc08014db0 con 0x55940ae68920 2024-09-12T01:57:08.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcbe7fff640 1 -- 172.21.15.19:0/2228883263 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7fcc08034020 con 0x55940ae68920 2024-09-12T01:57:08.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcc165d4740 10 client.5205 fetch_fsmap finished waiting for FSMap version 20 2024-09-12T01:57:08.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.990+0000 7fcc165d4740 10 client.5205 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-12T01:57:08.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.991+0000 7fcc165d4740 20 client.5205 populate_metadata read hostname 'smithi019' 2024-09-12T01:57:08.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.991+0000 7fcc165d4740 1 --2- 172.21.15.19:0/2228883263 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x55940ae87d50 0x55940ae88150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.991+0000 7fcc165d4740 4 client.5205 mds_command: new command op to 5088 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:08.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.991+0000 7fcc165d4740 1 -- 172.21.15.19:0/2228883263 --> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55940add8e20 con 0x55940ae87d50 2024-09-12T01:57:08.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.991+0000 7fcc10cfa640 1 --2- 172.21.15.19:0/2228883263 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x55940ae87d50 0x55940ae88150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.991+0000 7fcbe7fff640 10 client.5205 ms_handle_connect on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:08.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.991+0000 7fcc10cfa640 1 --2- 172.21.15.19:0/2228883263 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x55940ae87d50 0x55940ae88150 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d01686542d433637 server_cookie=430bed2e7bd2a650 in_seq=0 out_seq=0 2024-09-12T01:57:08.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.992+0000 7fcbe7fff640 1 -- 172.21.15.19:0/2228883263 <== mds.0 v2:172.21.15.19:6832/3554496273 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55940add8e20 con 0x55940ae87d50 2024-09-12T01:57:08.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.992+0000 7fcbe7fff640 10 client.5205 handle_command_reply: tid=0 2024-09-12T01:57:08.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.992+0000 7fcc165d4740 1 client.5205 shutdown 2024-09-12T01:57:08.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.992+0000 7fcc165d4740 1 -- 172.21.15.19:0/2228883263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 msgr2=0x55940aeaac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.992+0000 7fcc165d4740 1 --2- 172.21.15.19:0/2228883263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 0x55940aeaac10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcc08007b60 tx=0x7fcc08000ed0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.992+0000 7fcc165d4740 1 -- 172.21.15.19:0/2228883263 shutdown_connections 2024-09-12T01:57:08.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.992+0000 7fcc165d4740 1 --2- 172.21.15.19:0/2228883263 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x55940ae87d50 0x55940ae88150 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.992+0000 7fcc165d4740 1 --2- 172.21.15.19:0/2228883263 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae67c40 0x55940ae924a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.992+0000 7fcbe7fff640 0 client.5205 ms_handle_reset on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:08.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.992+0000 7fcc165d4740 1 --2- 172.21.15.19:0/2228883263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae6a0b0 0x55940ae67700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.992+0000 7fcc165d4740 1 --2- 172.21.15.19:0/2228883263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 0x55940aeaac10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.992+0000 7fcc165d4740 1 -- 172.21.15.19:0/2228883263 >> 172.21.15.19:0/2228883263 conn(0x55940ae660e0 msgr2=0x55940aeac500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:08.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.992+0000 7fcc165d4740 1 -- 172.21.15.19:0/2228883263 shutdown_connections 2024-09-12T01:57:08.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.992+0000 7fcc165d4740 1 -- 172.21.15.19:0/2228883263 wait complete. 2024-09-12T01:57:08.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:08.992+0000 7fcc165d4740 20 client.5205 trim_cache size 0 max 16384 2024-09-12T01:57:09.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.010+0000 7fcc165d4740 1 Processor -- start 2024-09-12T01:57:09.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.010+0000 7fcc165d4740 1 -- start start 2024-09-12T01:57:09.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.010+0000 7fcc165d4740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae67c40 0x55940ae673e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:09.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.010+0000 7fcc165d4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 0x55940aed1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:09.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.010+0000 7fcc165d4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae6a0b0 0x55940aeab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:09.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.010+0000 7fcc165d4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c201020 con 0x55940ae68920 2024-09-12T01:57:09.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.010+0000 7fcc165d4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c200020 con 0x55940ae6a0b0 2024-09-12T01:57:09.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.010+0000 7fcc165d4740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcc0c1e8ad0 con 0x55940ae67c40 2024-09-12T01:57:09.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.011+0000 7fcc10cfa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 0x55940aed1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:09.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.011+0000 7fcc10cfa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 0x55940aed1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46432/0 (socket says 172.21.15.19:46432) 2024-09-12T01:57:09.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.011+0000 7fcc10cfa640 1 -- 172.21.15.19:0/1183742053 learned_addr learned my addr 172.21.15.19:0/1183742053 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:09.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.011+0000 7fcc114fb640 1 --2- 172.21.15.19:0/1183742053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae67c40 0x55940ae673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:09.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.011+0000 7fcc11cfc640 1 --2- 172.21.15.19:0/1183742053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae6a0b0 0x55940aeab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:09.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.011+0000 7fcc10cfa640 1 -- 172.21.15.19:0/1183742053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae67c40 msgr2=0x55940ae673e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:09.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.011+0000 7fcc10cfa640 1 --2- 172.21.15.19:0/1183742053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae67c40 0x55940ae673e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:09.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.011+0000 7fcc10cfa640 1 -- 172.21.15.19:0/1183742053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae6a0b0 msgr2=0x55940aeab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:09.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.011+0000 7fcc10cfa640 1 --2- 172.21.15.19:0/1183742053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae6a0b0 0x55940aeab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:09.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.011+0000 7fcc10cfa640 1 -- 172.21.15.19:0/1183742053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55940aa9e0f0 con 0x55940ae68920 2024-09-12T01:57:09.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.011+0000 7fcc114fb640 1 --2- 172.21.15.19:0/1183742053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae67c40 0x55940ae673e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:09.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.011+0000 7fcc11cfc640 1 --2- 172.21.15.19:0/1183742053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae6a0b0 0x55940aeab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:09.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.011+0000 7fcc10cfa640 1 --2- 172.21.15.19:0/1183742053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 0x55940aed1e80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009560 tx=0x7fcbfc02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6363618415a26a59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:09.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.011+0000 7fcbee7fc640 1 -- 172.21.15.19:0/1183742053 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc04b070 con 0x55940ae68920 2024-09-12T01:57:09.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.011+0000 7fcbee7fc640 1 -- 172.21.15.19:0/1183742053 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbfc0328b0 con 0x55940ae68920 2024-09-12T01:57:09.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.011+0000 7fcbee7fc640 1 -- 172.21.15.19:0/1183742053 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc044070 con 0x55940ae68920 2024-09-12T01:57:09.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.012+0000 7fcc165d4740 1 -- 172.21.15.19:0/1183742053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 msgr2=0x55940aed1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:09.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.012+0000 7fcc165d4740 1 --2- 172.21.15.19:0/1183742053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 0x55940aed1e80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009560 tx=0x7fcbfc02e000 comp rx=0 tx=0).stop 2024-09-12T01:57:09.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.012+0000 7fcc165d4740 1 -- 172.21.15.19:0/1183742053 shutdown_connections 2024-09-12T01:57:09.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.012+0000 7fcc165d4740 1 --2- 172.21.15.19:0/1183742053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae6a0b0 0x55940aeab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:09.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.012+0000 7fcc165d4740 1 --2- 172.21.15.19:0/1183742053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae68920 0x55940aed1e80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:09.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.012+0000 7fcc165d4740 1 --2- 172.21.15.19:0/1183742053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae67c40 0x55940ae673e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:09.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.012+0000 7fcc165d4740 1 -- 172.21.15.19:0/1183742053 >> 172.21.15.19:0/1183742053 conn(0x55940ae660e0 msgr2=0x55940aeaf9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:09.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.012+0000 7fcc165d4740 1 -- 172.21.15.19:0/1183742053 shutdown_connections 2024-09-12T01:57:09.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.012+0000 7fcc165d4740 1 -- 172.21.15.19:0/1183742053 wait complete. 2024-09-12T01:57:09.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.012+0000 7fcc165d4740 1 -- start start 2024-09-12T01:57:09.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.012+0000 7fcc165d4740 1 Processor -- start 2024-09-12T01:57:09.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.013+0000 7fcc165d4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae67c40 0x55940ae91340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:09.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.013+0000 7fcc165d4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae68920 0x55940aec0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:09.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.013+0000 7fcc165d4740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae6a0b0 0x55940ae8f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:09.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.013+0000 7fcc165d4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55940ae63d50 con 0x55940ae67c40 2024-09-12T01:57:09.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.013+0000 7fcc165d4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c1ff9d0 con 0x55940ae68920 2024-09-12T01:57:09.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.013+0000 7fcc165d4740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55940ae66f70 con 0x55940ae6a0b0 2024-09-12T01:57:09.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.013+0000 7fcc165d4740 10 client.0 _ll_register_callbacks cb 0x7fcc08022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:09.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.013+0000 7fcc114fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae67c40 0x55940ae91340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:09.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.013+0000 7fcc114fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae67c40 0x55940ae91340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46436/0 (socket says 172.21.15.19:46436) 2024-09-12T01:57:09.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.013+0000 7fcc114fb640 1 -- 172.21.15.19:0/184810584 learned_addr learned my addr 172.21.15.19:0/184810584 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:09.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcc10cfa640 1 --2- 172.21.15.19:0/184810584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae68920 0x55940aec0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:09.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcc11cfc640 1 --2- 172.21.15.19:0/184810584 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae6a0b0 0x55940ae8f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:09.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcc114fb640 1 -- 172.21.15.19:0/184810584 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae6a0b0 msgr2=0x55940ae8f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:09.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcc114fb640 1 --2- 172.21.15.19:0/184810584 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae6a0b0 0x55940ae8f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:09.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcc114fb640 1 -- 172.21.15.19:0/184810584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae68920 msgr2=0x55940aec0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:09.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcc114fb640 1 --2- 172.21.15.19:0/184810584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae68920 0x55940aec0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:09.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcc114fb640 1 -- 172.21.15.19:0/184810584 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55940aec1390 con 0x55940ae67c40 2024-09-12T01:57:09.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcc11cfc640 1 --2- 172.21.15.19:0/184810584 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae6a0b0 0x55940ae8f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:09.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcc114fb640 1 --2- 172.21.15.19:0/184810584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae67c40 0x55940ae91340 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcc08005300 tx=0x7fcc08013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672f908f2abaa86c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:09.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcbe7fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:57:09.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcbe7fff640 1 -- 172.21.15.19:0/184810584 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc08024040 con 0x55940ae67c40 2024-09-12T01:57:09.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcbe7fff640 1 -- 172.21.15.19:0/184810584 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7fcc08036c80 con 0x55940ae67c40 2024-09-12T01:57:09.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcc165d4740 1 -- 172.21.15.19:0/184810584 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbfc0328b0 con 0x55940ae67c40 2024-09-12T01:57:09.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcbe7fff640 1 -- 172.21.15.19:0/184810584 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcc0803d050 con 0x55940ae67c40 2024-09-12T01:57:09.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcc165d4740 10 client.5211 fetch_fsmap learned FSMap version 20 2024-09-12T01:57:09.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcc165d4740 1 -- 172.21.15.19:0/184810584 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55940ae8f5b0 con 0x55940ae67c40 2024-09-12T01:57:09.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcbe7fff640 1 -- 172.21.15.19:0/184810584 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbfc0328b0 con 0x55940ae67c40 2024-09-12T01:57:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcbe7fff640 1 -- 172.21.15.19:0/184810584 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7fcc08040020 con 0x55940ae67c40 2024-09-12T01:57:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcc165d4740 10 client.5211 fetch_fsmap finished waiting for FSMap version 20 2024-09-12T01:57:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcc165d4740 10 client.5211 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-12T01:57:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcc165d4740 20 client.5211 populate_metadata read hostname 'smithi019' 2024-09-12T01:57:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcc165d4740 1 --2- 172.21.15.19:0/184810584 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x55940af14180 0x55940af110d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcc165d4740 4 client.5211 mds_command: new command op to 5088 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:57:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.014+0000 7fcc165d4740 1 -- 172.21.15.19:0/184810584 --> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55940add3170 con 0x55940af14180 2024-09-12T01:57:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.015+0000 7fcc10cfa640 1 --2- 172.21.15.19:0/184810584 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x55940af14180 0x55940af110d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.015+0000 7fcbe7fff640 10 client.5211 ms_handle_connect on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.015+0000 7fcc10cfa640 1 --2- 172.21.15.19:0/184810584 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x55940af14180 0x55940af110d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7702b06fc71212b2 server_cookie=c8cd4b919906ab05 in_seq=0 out_seq=0 2024-09-12T01:57:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.015+0000 7fcbe7fff640 1 -- 172.21.15.19:0/184810584 <== mds.0 v2:172.21.15.19:6832/3554496273 1 ==== command_reply(tid 0: 0 ) ==== 8+0+256 (crc 0 0 0) 0x55940add3170 con 0x55940af14180 2024-09-12T01:57:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.015+0000 7fcbe7fff640 10 client.5211 handle_command_reply: tid=0 2024-09-12T01:57:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.015+0000 7fcc165d4740 1 client.5211 shutdown 2024-09-12T01:57:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.015+0000 7fcc165d4740 1 -- 172.21.15.19:0/184810584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae67c40 msgr2=0x55940ae91340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.015+0000 7fcc165d4740 1 --2- 172.21.15.19:0/184810584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae67c40 0x55940ae91340 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcc08005300 tx=0x7fcc08013000 comp rx=0 tx=0).stop 2024-09-12T01:57:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.015+0000 7fcc165d4740 1 -- 172.21.15.19:0/184810584 shutdown_connections 2024-09-12T01:57:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.015+0000 7fcc165d4740 1 --2- 172.21.15.19:0/184810584 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x55940af14180 0x55940af110d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.015+0000 7fcc165d4740 1 --2- 172.21.15.19:0/184810584 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55940ae6a0b0 0x55940ae8f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.015+0000 7fcc165d4740 1 --2- 172.21.15.19:0/184810584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55940ae68920 0x55940aec0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.015+0000 7fcc165d4740 1 --2- 172.21.15.19:0/184810584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55940ae67c40 0x55940ae91340 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.015+0000 7fcbe7fff640 0 client.5211 ms_handle_reset on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.015+0000 7fcc165d4740 1 -- 172.21.15.19:0/184810584 >> 172.21.15.19:0/184810584 conn(0x55940ae660e0 msgr2=0x55940ae673e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.015+0000 7fcc165d4740 1 -- 172.21.15.19:0/184810584 shutdown_connections 2024-09-12T01:57:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.015+0000 7fcc165d4740 1 -- 172.21.15.19:0/184810584 wait complete. 2024-09-12T01:57:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.016+0000 7fcc165d4740 20 client.5211 trim_cache size 0 max 16384 2024-09-12T01:57:09.023 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:57:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:57:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-12T01:57:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: "90fc2e04-abc7-464b-bed8-c299760e34d9": { 2024-09-12T01:57:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/subdir", 2024-09-12T01:57:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "90fc2e04-abc7-464b-bed8-c299760e34d9", 2024-09-12T01:57:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "repair" 2024-09-12T01:57:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:09.023 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:57:09.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.016+0000 7fcc1375f640 1 -- 172.21.15.19:0/4017385804 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcbf006be60 msgr2=0x7fcbf006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:09.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.016+0000 7fcc1375f640 1 --2- 172.21.15.19:0/4017385804 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcbf006be60 0x7fcbf006e320 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcc080010e0 tx=0x7fcc08009040 comp rx=0 tx=0).stop 2024-09-12T01:57:09.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.016+0000 7fcc1375f640 1 -- 172.21.15.19:0/4017385804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc0c161d00 msgr2=0x7fcc0c0c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:09.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.016+0000 7fcc1375f640 1 --2- 172.21.15.19:0/4017385804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc0c161d00 0x7fcc0c0c9d50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400cbc0 tx=0x7fcc0400a430 comp rx=0 tx=0).stop 2024-09-12T01:57:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.016+0000 7fcc1375f640 1 -- 172.21.15.19:0/4017385804 shutdown_connections 2024-09-12T01:57:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.016+0000 7fcc1375f640 1 --2- 172.21.15.19:0/4017385804 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcbf006be60 0x7fcbf006e320 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.016+0000 7fcc1375f640 1 --2- 172.21.15.19:0/4017385804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc0c161d00 0x7fcc0c0c9d50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.016+0000 7fcc1375f640 1 --2- 172.21.15.19:0/4017385804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c161920 0x7fcc0c14d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.016+0000 7fcc1375f640 1 --2- 172.21.15.19:0/4017385804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc0c0b62b0 0x7fcc0c0cc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.016+0000 7fcc1375f640 1 -- 172.21.15.19:0/4017385804 >> 172.21.15.19:0/4017385804 conn(0x7fcc0c08bfc0 msgr2=0x7fcc0c06d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.016+0000 7fcc1375f640 1 -- 172.21.15.19:0/4017385804 shutdown_connections 2024-09-12T01:57:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:09.016+0000 7fcc1375f640 1 -- 172.21.15.19:0/4017385804 wait complete. 2024-09-12T01:57:09.027 INFO:tasks.cephfs.filesystem:scrub status for tag:90fc2e04-abc7-464b-bed8-c299760e34d9 - {'path': '/subdir', 'tag': '90fc2e04-abc7-464b-bed8-c299760e34d9', 'options': 'repair'} 2024-09-12T01:57:23.926 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:57:23.929 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:57:39.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:39.029 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-12T01:57:39.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.147+0000 7f16183bd640 1 Processor -- start 2024-09-12T01:57:39.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.147+0000 7f16183bd640 1 -- start start 2024-09-12T01:57:39.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.148+0000 7f16183bd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16100b1c00 0x7f16101696e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.148+0000 7f16183bd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16100d2ff0 con 0x7f161015f9a0 2024-09-12T01:57:39.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.148+0000 7f16183bd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f161015fd80 con 0x7f16100b32a0 2024-09-12T01:57:39.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.148+0000 7f16183bd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f16100d19a0 con 0x7f16100b1c00 2024-09-12T01:57:39.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.148+0000 7f1616159640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f161015f9a0 0x7f161006d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53324/0 (socket says 172.21.15.19:53324) 2024-09-12T01:57:39.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.148+0000 7f1616159640 1 -- 172.21.15.19:0/3977340567 learned_addr learned my addr 172.21.15.19:0/3977340567 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:39.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.148+0000 7f1615157640 1 -- 172.21.15.19:0/3977340567 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3036051380 0 0) 0x7f16100d2ff0 con 0x7f161015f9a0 2024-09-12T01:57:39.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.148+0000 7f1615157640 1 -- 172.21.15.19:0/3977340567 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15fc003520 con 0x7f161015f9a0 2024-09-12T01:57:39.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.148+0000 7f161695a640 1 --2- 172.21.15.19:0/3977340567 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16100b1c00 0x7f16101696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1615157640 1 -- 172.21.15.19:0/3977340567 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3828615389 0 0) 0x7f15fc003520 con 0x7f161015f9a0 2024-09-12T01:57:39.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1615157640 1 -- 172.21.15.19:0/3977340567 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16100b1c00 msgr2=0x7f16101696e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:39.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1615157640 1 --2- 172.21.15.19:0/3977340567 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16100b1c00 0x7f16101696e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1615157640 1 -- 172.21.15.19:0/3977340567 >> v1:172.21.15.135:6789/0 conn(0x7f16100b32a0 legacy=0x7f161006dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1615157640 1 -- 172.21.15.19:0/3977340567 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16100d1100 con 0x7f161015f9a0 2024-09-12T01:57:39.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1615157640 1 -- 172.21.15.19:0/3977340567 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f160c001670 con 0x7f161015f9a0 2024-09-12T01:57:39.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1615157640 1 -- 172.21.15.19:0/3977340567 >> v1:172.21.15.19:6789/0 conn(0x7f161015f9a0 legacy=0x7f161006d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1615157640 1 --2- 172.21.15.19:0/3977340567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15fc0039e0 0x7f15fc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1615157640 1 --2- 172.21.15.19:0/3977340567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15fc004800 0x7f15fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1615157640 1 --2- 172.21.15.19:0/3977340567 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16100b1c00 0x7f15fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1615157640 1 -- 172.21.15.19:0/3977340567 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f16100d19a0 con 0x7f15fc0039e0 2024-09-12T01:57:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1615157640 1 -- 172.21.15.19:0/3977340567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc00baa0 con 0x7f15fc004800 2024-09-12T01:57:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1615157640 1 -- 172.21.15.19:0/3977340567 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f15fc00bca0 con 0x7f16100b1c00 2024-09-12T01:57:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1616159640 1 --2- 172.21.15.19:0/3977340567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15fc0039e0 0x7f15fc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f161695a640 1 --2- 172.21.15.19:0/3977340567 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16100b1c00 0x7f15fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1615958640 1 --2- 172.21.15.19:0/3977340567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15fc004800 0x7f15fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1616159640 1 -- 172.21.15.19:0/3977340567 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16100b1c00 msgr2=0x7f15fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1616159640 1 --2- 172.21.15.19:0/3977340567 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16100b1c00 0x7f15fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1616159640 1 -- 172.21.15.19:0/3977340567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15fc004800 msgr2=0x7f15fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1616159640 1 --2- 172.21.15.19:0/3977340567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15fc004800 0x7f15fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.149+0000 7f1616159640 1 -- 172.21.15.19:0/3977340567 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15fc003520 con 0x7f15fc0039e0 2024-09-12T01:57:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.150+0000 7f1616159640 1 --2- 172.21.15.19:0/3977340567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15fc0039e0 0x7f15fc003e00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f160c001050 tx=0x7f15fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec610d8ffe1b402 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:39.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.150+0000 7f1615157640 1 -- 172.21.15.19:0/3977340567 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160c007d30 con 0x7f15fc0039e0 2024-09-12T01:57:39.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.150+0000 7f1615157640 1 -- 172.21.15.19:0/3977340567 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f160c005af0 con 0x7f15fc0039e0 2024-09-12T01:57:39.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.150+0000 7f1615157640 1 -- 172.21.15.19:0/3977340567 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160c007070 con 0x7f15fc0039e0 2024-09-12T01:57:39.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.151+0000 7f16183bd640 1 -- 172.21.15.19:0/3977340567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15fc0039e0 msgr2=0x7f15fc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.151+0000 7f16183bd640 1 --2- 172.21.15.19:0/3977340567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15fc0039e0 0x7f15fc003e00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f160c001050 tx=0x7f15fc005830 comp rx=0 tx=0).stop 2024-09-12T01:57:39.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.151+0000 7f161695a640 1 -- 172.21.15.19:0/3977340567 reap_dead start 2024-09-12T01:57:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.151+0000 7f16183bd640 1 -- 172.21.15.19:0/3977340567 shutdown_connections 2024-09-12T01:57:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.151+0000 7f16183bd640 1 -- 172.21.15.19:0/3977340567 >> 172.21.15.19:0/3977340567 conn(0x7f16100d2310 msgr2=0x7f16100d2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.151+0000 7f16183bd640 1 -- 172.21.15.19:0/3977340567 shutdown_connections 2024-09-12T01:57:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.151+0000 7f16183bd640 1 -- 172.21.15.19:0/3977340567 wait complete. 2024-09-12T01:57:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.152+0000 7f16183bd640 1 Processor -- start 2024-09-12T01:57:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.152+0000 7f16183bd640 1 -- start start 2024-09-12T01:57:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.153+0000 7f16183bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15fc0039e0 0x7f161015d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.153+0000 7f16183bd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16100ca360 0x7f16100ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.153+0000 7f16183bd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1610160e00 0x7f1610161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.153+0000 7f16183bd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f16101676d0 con 0x7f15fc0039e0 2024-09-12T01:57:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.153+0000 7f16183bd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f16100d16c0 con 0x7f1610160e00 2024-09-12T01:57:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.153+0000 7f16183bd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1610167850 con 0x7f16100ca360 2024-09-12T01:57:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.153+0000 7f1616159640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15fc0039e0 0x7f161015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.153+0000 7f1616159640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15fc0039e0 0x7f161015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39650/0 (socket says 172.21.15.19:39650) 2024-09-12T01:57:39.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.153+0000 7f1616159640 1 -- 172.21.15.19:0/2830756874 learned_addr learned my addr 172.21.15.19:0/2830756874 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:39.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.153+0000 7f1615958640 1 --2- 172.21.15.19:0/2830756874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16100ca360 0x7f16100ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.153+0000 7f161695a640 1 --2- 172.21.15.19:0/2830756874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1610160e00 0x7f1610161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.153+0000 7f1616159640 1 -- 172.21.15.19:0/2830756874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16100ca360 msgr2=0x7f16100ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.153+0000 7f1616159640 1 --2- 172.21.15.19:0/2830756874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16100ca360 0x7f16100ca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.153+0000 7f1616159640 1 -- 172.21.15.19:0/2830756874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1610160e00 msgr2=0x7f1610161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.153+0000 7f1616159640 1 --2- 172.21.15.19:0/2830756874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1610160e00 0x7f1610161280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.153+0000 7f1616159640 1 -- 172.21.15.19:0/2830756874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161015dea0 con 0x7f15fc0039e0 2024-09-12T01:57:39.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.154+0000 7f1616159640 1 --2- 172.21.15.19:0/2830756874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15fc0039e0 0x7f161015d960 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f160c000c00 tx=0x7f160c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:39.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.154+0000 7f1606ffd640 1 -- 172.21.15.19:0/2830756874 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160c001430 con 0x7f15fc0039e0 2024-09-12T01:57:39.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.154+0000 7f1606ffd640 1 -- 172.21.15.19:0/2830756874 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f160c038040 con 0x7f15fc0039e0 2024-09-12T01:57:39.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.154+0000 7f1606ffd640 1 -- 172.21.15.19:0/2830756874 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160c007070 con 0x7f15fc0039e0 2024-09-12T01:57:39.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.154+0000 7f16183bd640 1 -- 172.21.15.19:0/2830756874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16100b6ea0 con 0x7f15fc0039e0 2024-09-12T01:57:39.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.154+0000 7f16183bd640 1 -- 172.21.15.19:0/2830756874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1610160320 con 0x7f15fc0039e0 2024-09-12T01:57:39.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.155+0000 7f1606ffd640 1 -- 172.21.15.19:0/2830756874 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f160c044030 con 0x7f15fc0039e0 2024-09-12T01:57:39.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.156+0000 7f1606ffd640 1 --2- 172.21.15.19:0/2830756874 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f15f406be30 0x7f15f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.156+0000 7f1606ffd640 1 -- 172.21.15.19:0/2830756874 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7f160c0aa6d0 con 0x7f15fc0039e0 2024-09-12T01:57:39.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.156+0000 7f1615958640 1 --2- 172.21.15.19:0/2830756874 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f15f406be30 0x7f15f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.157+0000 7f1615958640 1 --2- 172.21.15.19:0/2830756874 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f15f406be30 0x7f15f406e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f16101669b0 tx=0x7f1600009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:39.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.157+0000 7f161b235740 1 Processor -- start 2024-09-12T01:57:39.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.157+0000 7f161b235740 1 -- start start 2024-09-12T01:57:39.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.158+0000 7f161b235740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e311920 0x556f8e3570c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.158+0000 7f161b235740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e30f0e0 0x556f8e311d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.158+0000 7f161b235740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e3130b0 0x556f8e30c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.158+0000 7f161b235740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556f8e2746f0 con 0x556f8e311920 2024-09-12T01:57:39.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.158+0000 7f161b235740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556f8e21c330 con 0x556f8e3130b0 2024-09-12T01:57:39.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.158+0000 7f161b235740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556f8e2706b0 con 0x556f8e30f0e0 2024-09-12T01:57:39.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.158+0000 7f1616159640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e311920 0x556f8e3570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.158+0000 7f1616159640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e311920 0x556f8e3570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39660/0 (socket says 172.21.15.19:39660) 2024-09-12T01:57:39.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.158+0000 7f1616159640 1 -- 172.21.15.19:0/531400480 learned_addr learned my addr 172.21.15.19:0/531400480 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:39.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.158+0000 7f1615958640 1 --2- 172.21.15.19:0/531400480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e30f0e0 0x556f8e311d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.158+0000 7f161695a640 1 --2- 172.21.15.19:0/531400480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e3130b0 0x556f8e30c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.159+0000 7f1616159640 1 -- 172.21.15.19:0/531400480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e30f0e0 msgr2=0x556f8e311d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.159+0000 7f1616159640 1 --2- 172.21.15.19:0/531400480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e30f0e0 0x556f8e311d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.159+0000 7f1616159640 1 -- 172.21.15.19:0/531400480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e3130b0 msgr2=0x556f8e30c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.159+0000 7f1616159640 1 --2- 172.21.15.19:0/531400480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e3130b0 0x556f8e30c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.159+0000 7f1616159640 1 -- 172.21.15.19:0/531400480 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f8e2420d0 con 0x556f8e311920 2024-09-12T01:57:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.159+0000 7f1616159640 1 --2- 172.21.15.19:0/531400480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e311920 0x556f8e3570c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f160c0a8a00 tx=0x7f160c005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de67241291499b1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.159+0000 7f15f3fff640 1 -- 172.21.15.19:0/531400480 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160c090020 con 0x556f8e311920 2024-09-12T01:57:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.159+0000 7f15f3fff640 1 -- 172.21.15.19:0/531400480 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f160c0813f0 con 0x556f8e311920 2024-09-12T01:57:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.159+0000 7f15f3fff640 1 -- 172.21.15.19:0/531400480 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160c076bc0 con 0x556f8e311920 2024-09-12T01:57:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.160+0000 7f161b235740 1 -- 172.21.15.19:0/531400480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e311920 msgr2=0x556f8e3570c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.160+0000 7f161b235740 1 --2- 172.21.15.19:0/531400480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e311920 0x556f8e3570c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f160c0a8a00 tx=0x7f160c005ac0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.160+0000 7f161b235740 1 -- 172.21.15.19:0/531400480 shutdown_connections 2024-09-12T01:57:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.160+0000 7f161b235740 1 --2- 172.21.15.19:0/531400480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e3130b0 0x556f8e30c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.160+0000 7f161b235740 1 --2- 172.21.15.19:0/531400480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e30f0e0 0x556f8e311d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.160+0000 7f161b235740 1 --2- 172.21.15.19:0/531400480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e311920 0x556f8e3570c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.160+0000 7f161b235740 1 -- 172.21.15.19:0/531400480 >> 172.21.15.19:0/531400480 conn(0x556f8e30e370 msgr2=0x556f8e356590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.160+0000 7f161b235740 1 -- 172.21.15.19:0/531400480 shutdown_connections 2024-09-12T01:57:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.160+0000 7f161b235740 1 -- 172.21.15.19:0/531400480 wait complete. 2024-09-12T01:57:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.160+0000 7f161b235740 1 -- start start 2024-09-12T01:57:39.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.160+0000 7f161b235740 1 Processor -- start 2024-09-12T01:57:39.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.161+0000 7f161b235740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e311920 0x556f8e334db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.161+0000 7f161b235740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e3130b0 0x556f8e366570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.161+0000 7f161b235740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e33b5e0 0x556f8e30c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.161+0000 7f161b235740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556f8e21c330 con 0x556f8e311920 2024-09-12T01:57:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.161+0000 7f161b235740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556f8e1fd4f0 con 0x556f8e3130b0 2024-09-12T01:57:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.161+0000 7f161b235740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556f8e2746f0 con 0x556f8e33b5e0 2024-09-12T01:57:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f161b235740 10 client.0 _ll_register_callbacks cb 0x556f8e21eb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f1616159640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e311920 0x556f8e334db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f1616159640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e311920 0x556f8e334db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39668/0 (socket says 172.21.15.19:39668) 2024-09-12T01:57:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f1616159640 1 -- 172.21.15.19:0/4250233253 learned_addr learned my addr 172.21.15.19:0/4250233253 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f161695a640 1 --2- 172.21.15.19:0/4250233253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e33b5e0 0x556f8e30c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f1615958640 1 --2- 172.21.15.19:0/4250233253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e3130b0 0x556f8e366570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f1616159640 1 -- 172.21.15.19:0/4250233253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e33b5e0 msgr2=0x556f8e30c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f1616159640 1 --2- 172.21.15.19:0/4250233253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e33b5e0 0x556f8e30c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f1616159640 1 -- 172.21.15.19:0/4250233253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e3130b0 msgr2=0x556f8e366570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f1616159640 1 --2- 172.21.15.19:0/4250233253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e3130b0 0x556f8e366570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f1616159640 1 -- 172.21.15.19:0/4250233253 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f8e0517d0 con 0x556f8e311920 2024-09-12T01:57:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f1616159640 1 --2- 172.21.15.19:0/4250233253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e311920 0x556f8e334db0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f160c074d20 tx=0x7f160c07f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe931b96dda815ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f15f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:57:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f15f17fa640 1 -- 172.21.15.19:0/4250233253 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160c094030 con 0x556f8e311920 2024-09-12T01:57:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f15f17fa640 1 -- 172.21.15.19:0/4250233253 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7f160c07f0c0 con 0x556f8e311920 2024-09-12T01:57:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f161b235740 1 -- 172.21.15.19:0/4250233253 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f160c0813f0 con 0x556f8e311920 2024-09-12T01:57:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f15f17fa640 1 -- 172.21.15.19:0/4250233253 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f160c090040 con 0x556f8e311920 2024-09-12T01:57:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f161b235740 10 client.5223 fetch_fsmap learned FSMap version 20 2024-09-12T01:57:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.162+0000 7f161b235740 1 -- 172.21.15.19:0/4250233253 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x556f8df873f0 con 0x556f8e311920 2024-09-12T01:57:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.163+0000 7f15f17fa640 1 -- 172.21.15.19:0/4250233253 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f160c0813f0 con 0x556f8e311920 2024-09-12T01:57:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.163+0000 7f15f17fa640 1 -- 172.21.15.19:0/4250233253 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7f160c074f30 con 0x556f8e311920 2024-09-12T01:57:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.163+0000 7f161b235740 10 client.5223 fetch_fsmap finished waiting for FSMap version 20 2024-09-12T01:57:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.163+0000 7f161b235740 10 client.5223 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-12T01:57:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.163+0000 7f161b235740 20 client.5223 populate_metadata read hostname 'smithi019' 2024-09-12T01:57:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.163+0000 7f161b235740 1 --2- 172.21.15.19:0/4250233253 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x556f8e339420 0x556f8e339800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.163+0000 7f161b235740 4 client.5223 mds_command: new command op to 5088 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.163+0000 7f161b235740 1 -- 172.21.15.19:0/4250233253 --> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f8e281e20 con 0x556f8e339420 2024-09-12T01:57:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.163+0000 7f1615958640 1 --2- 172.21.15.19:0/4250233253 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x556f8e339420 0x556f8e339800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.163+0000 7f15f17fa640 10 client.5223 ms_handle_connect on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.163+0000 7f1615958640 1 --2- 172.21.15.19:0/4250233253 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x556f8e339420 0x556f8e339800 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=921f28bb2edbd87b server_cookie=9788199df275a8a6 in_seq=0 out_seq=0 2024-09-12T01:57:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.164+0000 7f15f17fa640 1 -- 172.21.15.19:0/4250233253 <== mds.0 v2:172.21.15.19:6832/3554496273 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556f8e281e20 con 0x556f8e339420 2024-09-12T01:57:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.164+0000 7f15f17fa640 10 client.5223 handle_command_reply: tid=0 2024-09-12T01:57:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.164+0000 7f161b235740 1 client.5223 shutdown 2024-09-12T01:57:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.164+0000 7f161b235740 1 -- 172.21.15.19:0/4250233253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e311920 msgr2=0x556f8e334db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.164+0000 7f161b235740 1 --2- 172.21.15.19:0/4250233253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e311920 0x556f8e334db0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f160c074d20 tx=0x7f160c07f050 comp rx=0 tx=0).stop 2024-09-12T01:57:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.164+0000 7f161b235740 1 -- 172.21.15.19:0/4250233253 shutdown_connections 2024-09-12T01:57:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.164+0000 7f161b235740 1 --2- 172.21.15.19:0/4250233253 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x556f8e339420 0x556f8e339800 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.164+0000 7f161b235740 1 --2- 172.21.15.19:0/4250233253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e33b5e0 0x556f8e30c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.164+0000 7f161b235740 1 --2- 172.21.15.19:0/4250233253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e3130b0 0x556f8e366570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.164+0000 7f161b235740 1 --2- 172.21.15.19:0/4250233253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e311920 0x556f8e334db0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.164+0000 7f15f17fa640 0 client.5223 ms_handle_reset on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:39.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.164+0000 7f161b235740 1 -- 172.21.15.19:0/4250233253 >> 172.21.15.19:0/4250233253 conn(0x556f8e30f0e0 msgr2=0x556f8e355b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:39.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.164+0000 7f161b235740 1 -- 172.21.15.19:0/4250233253 shutdown_connections 2024-09-12T01:57:39.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.164+0000 7f161b235740 1 -- 172.21.15.19:0/4250233253 wait complete. 2024-09-12T01:57:39.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.164+0000 7f161b235740 20 client.5223 trim_cache size 0 max 16384 2024-09-12T01:57:39.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.182+0000 7f161b235740 1 Processor -- start 2024-09-12T01:57:39.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.182+0000 7f161b235740 1 -- start start 2024-09-12T01:57:39.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.183+0000 7f161b235740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e311920 0x556f8e368010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.183+0000 7f161b235740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e3130b0 0x556f8e358190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.183+0000 7f161b235740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e33b5e0 0x556f8e33b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.183+0000 7f161b235740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1610201a90 con 0x556f8e3130b0 2024-09-12T01:57:39.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.183+0000 7f161b235740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1610200a90 con 0x556f8e311920 2024-09-12T01:57:39.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.183+0000 7f161b235740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f16100b6940 con 0x556f8e33b5e0 2024-09-12T01:57:39.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.183+0000 7f1615958640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e3130b0 0x556f8e358190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.183+0000 7f1615958640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e3130b0 0x556f8e358190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39678/0 (socket says 172.21.15.19:39678) 2024-09-12T01:57:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.183+0000 7f1615958640 1 -- 172.21.15.19:0/354206898 learned_addr learned my addr 172.21.15.19:0/354206898 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.183+0000 7f1615958640 1 -- 172.21.15.19:0/354206898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e33b5e0 msgr2=0x556f8e33b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.183+0000 7f1615958640 1 --2- 172.21.15.19:0/354206898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e33b5e0 0x556f8e33b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.183+0000 7f1615958640 1 -- 172.21.15.19:0/354206898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e311920 msgr2=0x556f8e368010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.183+0000 7f1615958640 1 --2- 172.21.15.19:0/354206898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e311920 0x556f8e368010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.183+0000 7f1615958640 1 -- 172.21.15.19:0/354206898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f8df470f0 con 0x556f8e3130b0 2024-09-12T01:57:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.183+0000 7f1615958640 1 --2- 172.21.15.19:0/354206898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e3130b0 0x556f8e358190 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1600001640 tx=0x7f1600015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7fb1ee4af9ec15 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.184+0000 7f15f37fe640 1 -- 172.21.15.19:0/354206898 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600019040 con 0x556f8e3130b0 2024-09-12T01:57:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.184+0000 7f15f37fe640 1 -- 172.21.15.19:0/354206898 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f160001a040 con 0x556f8e3130b0 2024-09-12T01:57:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.184+0000 7f15f37fe640 1 -- 172.21.15.19:0/354206898 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600015b80 con 0x556f8e3130b0 2024-09-12T01:57:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.184+0000 7f161b235740 1 -- 172.21.15.19:0/354206898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e3130b0 msgr2=0x556f8e358190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.184+0000 7f161b235740 1 --2- 172.21.15.19:0/354206898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e3130b0 0x556f8e358190 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1600001640 tx=0x7f1600015000 comp rx=0 tx=0).stop 2024-09-12T01:57:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.184+0000 7f161b235740 1 -- 172.21.15.19:0/354206898 shutdown_connections 2024-09-12T01:57:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.184+0000 7f161b235740 1 --2- 172.21.15.19:0/354206898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e33b5e0 0x556f8e33b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.184+0000 7f161b235740 1 --2- 172.21.15.19:0/354206898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e3130b0 0x556f8e358190 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.184+0000 7f161b235740 1 --2- 172.21.15.19:0/354206898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e311920 0x556f8e368010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.184+0000 7f161b235740 1 -- 172.21.15.19:0/354206898 >> 172.21.15.19:0/354206898 conn(0x556f8e30f0e0 msgr2=0x556f8e339e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.184+0000 7f161b235740 1 -- 172.21.15.19:0/354206898 shutdown_connections 2024-09-12T01:57:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.184+0000 7f161b235740 1 -- 172.21.15.19:0/354206898 wait complete. 2024-09-12T01:57:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.185+0000 7f161b235740 1 -- start start 2024-09-12T01:57:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.185+0000 7f161b235740 1 Processor -- start 2024-09-12T01:57:39.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f161b235740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e311920 0x556f8e370230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f161b235740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e3130b0 0x556f8e30b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f161b235740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e33b5e0 0x556f8e30b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f161b235740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556f8e33ab90 con 0x556f8e3130b0 2024-09-12T01:57:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f161b235740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1610200440 con 0x556f8e311920 2024-09-12T01:57:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f161b235740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556f8e367830 con 0x556f8e33b5e0 2024-09-12T01:57:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f161b235740 10 client.0 _ll_register_callbacks cb 0x7f1608009210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f1615958640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e3130b0 0x556f8e30b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f1615958640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e3130b0 0x556f8e30b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39690/0 (socket says 172.21.15.19:39690) 2024-09-12T01:57:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f1615958640 1 -- 172.21.15.19:0/3813464166 learned_addr learned my addr 172.21.15.19:0/3813464166 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f1616159640 1 --2- 172.21.15.19:0/3813464166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e311920 0x556f8e370230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f161695a640 1 --2- 172.21.15.19:0/3813464166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e33b5e0 0x556f8e30b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f1615958640 1 -- 172.21.15.19:0/3813464166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e33b5e0 msgr2=0x556f8e30b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f1615958640 1 --2- 172.21.15.19:0/3813464166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e33b5e0 0x556f8e30b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f1615958640 1 -- 172.21.15.19:0/3813464166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e311920 msgr2=0x556f8e370230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f1615958640 1 --2- 172.21.15.19:0/3813464166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e311920 0x556f8e370230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f1615958640 1 -- 172.21.15.19:0/3813464166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f8e355020 con 0x556f8e3130b0 2024-09-12T01:57:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f1616159640 1 --2- 172.21.15.19:0/3813464166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e311920 0x556f8e370230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f1615958640 1 --2- 172.21.15.19:0/3813464166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e3130b0 0x556f8e30b0c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1600001670 tx=0x7f1600001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f711114aa6cc303f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.186+0000 7f15f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:57:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.187+0000 7f15f17fa640 1 -- 172.21.15.19:0/3813464166 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600019070 con 0x556f8e3130b0 2024-09-12T01:57:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.187+0000 7f15f17fa640 1 -- 172.21.15.19:0/3813464166 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7f1600006aa0 con 0x556f8e3130b0 2024-09-12T01:57:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.187+0000 7f161b235740 1 -- 172.21.15.19:0/3813464166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f160001a040 con 0x556f8e3130b0 2024-09-12T01:57:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.187+0000 7f15f17fa640 1 -- 172.21.15.19:0/3813464166 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1600043050 con 0x556f8e3130b0 2024-09-12T01:57:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.187+0000 7f161b235740 10 client.5229 fetch_fsmap learned FSMap version 20 2024-09-12T01:57:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.187+0000 7f161b235740 1 -- 172.21.15.19:0/3813464166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x556f8e3d4e10 con 0x556f8e3130b0 2024-09-12T01:57:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.187+0000 7f15f17fa640 1 -- 172.21.15.19:0/3813464166 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f160001a040 con 0x556f8e3130b0 2024-09-12T01:57:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.187+0000 7f15f17fa640 1 -- 172.21.15.19:0/3813464166 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7f1600046020 con 0x556f8e3130b0 2024-09-12T01:57:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.187+0000 7f161b235740 10 client.5229 fetch_fsmap finished waiting for FSMap version 20 2024-09-12T01:57:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.187+0000 7f161b235740 10 client.5229 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-12T01:57:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.187+0000 7f161b235740 20 client.5229 populate_metadata read hostname 'smithi019' 2024-09-12T01:57:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.187+0000 7f161b235740 1 --2- 172.21.15.19:0/3813464166 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x556f8e33c0d0 0x556f8e337450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.187+0000 7f161b235740 4 client.5229 mds_command: new command op to 5088 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:57:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.187+0000 7f161b235740 1 -- 172.21.15.19:0/3813464166 --> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556f8e27c170 con 0x556f8e33c0d0 2024-09-12T01:57:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.187+0000 7f1616159640 1 --2- 172.21.15.19:0/3813464166 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x556f8e33c0d0 0x556f8e337450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.188+0000 7f15f17fa640 10 client.5229 ms_handle_connect on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.188+0000 7f1616159640 1 --2- 172.21.15.19:0/3813464166 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x556f8e33c0d0 0x556f8e337450 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52066cebff999af4 server_cookie=78884050904d8ca6 in_seq=0 out_seq=0 2024-09-12T01:57:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.188+0000 7f15f17fa640 1 -- 172.21.15.19:0/3813464166 <== mds.0 v2:172.21.15.19:6832/3554496273 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556f8e27c170 con 0x556f8e33c0d0 2024-09-12T01:57:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.188+0000 7f15f17fa640 10 client.5229 handle_command_reply: tid=0 2024-09-12T01:57:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.188+0000 7f161b235740 1 client.5229 shutdown 2024-09-12T01:57:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.188+0000 7f161b235740 1 -- 172.21.15.19:0/3813464166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e3130b0 msgr2=0x556f8e30b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.188+0000 7f161b235740 1 --2- 172.21.15.19:0/3813464166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e3130b0 0x556f8e30b0c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1600001670 tx=0x7f1600001120 comp rx=0 tx=0).stop 2024-09-12T01:57:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.188+0000 7f161b235740 1 -- 172.21.15.19:0/3813464166 shutdown_connections 2024-09-12T01:57:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.188+0000 7f161b235740 1 --2- 172.21.15.19:0/3813464166 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x556f8e33c0d0 0x556f8e337450 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.188+0000 7f161b235740 1 --2- 172.21.15.19:0/3813464166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f8e33b5e0 0x556f8e30b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.188+0000 7f161b235740 1 --2- 172.21.15.19:0/3813464166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f8e3130b0 0x556f8e30b0c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.188+0000 7f15f17fa640 0 client.5229 ms_handle_reset on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.188+0000 7f161b235740 1 --2- 172.21.15.19:0/3813464166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f8e311920 0x556f8e370230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.188+0000 7f161b235740 1 -- 172.21.15.19:0/3813464166 >> 172.21.15.19:0/3813464166 conn(0x556f8e30f0e0 msgr2=0x556f8e33b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.188+0000 7f161b235740 1 -- 172.21.15.19:0/3813464166 shutdown_connections 2024-09-12T01:57:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.188+0000 7f161b235740 1 -- 172.21.15.19:0/3813464166 wait complete. 2024-09-12T01:57:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.188+0000 7f161b235740 20 client.5229 trim_cache size 0 max 16384 2024-09-12T01:57:39.194 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:57:39.194 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-12T01:57:39.194 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {} 2024-09-12T01:57:39.194 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:57:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.189+0000 7f16183bd640 1 -- 172.21.15.19:0/2830756874 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f15f406be30 msgr2=0x7f15f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.189+0000 7f16183bd640 1 --2- 172.21.15.19:0/2830756874 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f15f406be30 0x7f15f406e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f16101669b0 tx=0x7f1600009040 comp rx=0 tx=0).stop 2024-09-12T01:57:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.189+0000 7f16183bd640 1 -- 172.21.15.19:0/2830756874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15fc0039e0 msgr2=0x7f161015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.189+0000 7f16183bd640 1 --2- 172.21.15.19:0/2830756874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15fc0039e0 0x7f161015d960 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f160c000c00 tx=0x7f160c000fe0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.189+0000 7f16183bd640 1 -- 172.21.15.19:0/2830756874 shutdown_connections 2024-09-12T01:57:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.189+0000 7f16183bd640 1 --2- 172.21.15.19:0/2830756874 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f15f406be30 0x7f15f406e2f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.189+0000 7f16183bd640 1 --2- 172.21.15.19:0/2830756874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1610160e00 0x7f1610161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.189+0000 7f16183bd640 1 --2- 172.21.15.19:0/2830756874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16100ca360 0x7f16100ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.189+0000 7f16183bd640 1 --2- 172.21.15.19:0/2830756874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15fc0039e0 0x7f161015d960 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.189+0000 7f16183bd640 1 -- 172.21.15.19:0/2830756874 >> 172.21.15.19:0/2830756874 conn(0x7f16100d2310 msgr2=0x7f16100ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.189+0000 7f16183bd640 1 -- 172.21.15.19:0/2830756874 shutdown_connections 2024-09-12T01:57:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.189+0000 7f16183bd640 1 -- 172.21.15.19:0/2830756874 wait complete. 2024-09-12T01:57:39.200 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:57:39.200 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:57:39.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.302+0000 7fa0cad6d640 1 Processor -- start 2024-09-12T01:57:39.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.302+0000 7fa0cad6d640 1 -- start start 2024-09-12T01:57:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.303+0000 7fa0cad6d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0c4072320 0x7fa0c40cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.303+0000 7fa0cad6d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa0c4072de0 0x7fa0c406e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.303+0000 7fa0cad6d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa0c4072700 0x7fa0c406e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.303+0000 7fa0cad6d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa0c4146140 con 0x7fa0c4072de0 2024-09-12T01:57:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.303+0000 7fa0cad6d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa0c40cd740 con 0x7fa0c4072700 2024-09-12T01:57:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.303+0000 7fa0cad6d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c40cda20 con 0x7fa0c4072320 2024-09-12T01:57:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.303+0000 7fa0c3fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa0c4072de0 0x7fa0c406e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.303+0000 7fa0c3fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa0c4072de0 0x7fa0c406e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39696/0 (socket says 172.21.15.19:39696) 2024-09-12T01:57:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.303+0000 7fa0c3fff640 1 -- 172.21.15.19:0/3621783865 learned_addr learned my addr 172.21.15.19:0/3621783865 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.303+0000 7fa0c8b09640 1 --2- 172.21.15.19:0/3621783865 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0c4072320 0x7fa0c40cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.303+0000 7fa0c930a640 1 --2- 172.21.15.19:0/3621783865 >> v2:172.21.15.135:3300/0 conn(0x7fa0c4072700 0x7fa0c406e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.303+0000 7fa0c3fff640 1 -- 172.21.15.19:0/3621783865 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0c4072320 msgr2=0x7fa0c40cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.303+0000 7fa0c3fff640 1 --2- 172.21.15.19:0/3621783865 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0c4072320 0x7fa0c40cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.303+0000 7fa0c3fff640 1 -- 172.21.15.19:0/3621783865 >> v2:172.21.15.135:3300/0 conn(0x7fa0c4072700 msgr2=0x7fa0c406e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.303+0000 7fa0c3fff640 1 --2- 172.21.15.19:0/3621783865 >> v2:172.21.15.135:3300/0 conn(0x7fa0c4072700 0x7fa0c406e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.303+0000 7fa0c3fff640 1 -- 172.21.15.19:0/3621783865 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c40cdd00 con 0x7fa0c4072de0 2024-09-12T01:57:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.304+0000 7fa0c3fff640 1 --2- 172.21.15.19:0/3621783865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c4072de0 0x7fa0c406e0b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa0c406f4e0 tx=0x7fa0b002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f81306b97778b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:39.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.304+0000 7fa0c37fe640 1 -- 172.21.15.19:0/3621783865 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0037070 con 0x7fa0c4072de0 2024-09-12T01:57:39.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.304+0000 7fa0c37fe640 1 -- 172.21.15.19:0/3621783865 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b0032440 con 0x7fa0c4072de0 2024-09-12T01:57:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.304+0000 7fa0c37fe640 1 -- 172.21.15.19:0/3621783865 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0032810 con 0x7fa0c4072de0 2024-09-12T01:57:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.305+0000 7fa0cad6d640 1 -- 172.21.15.19:0/3621783865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c4072de0 msgr2=0x7fa0c406e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.305+0000 7fa0cad6d640 1 --2- 172.21.15.19:0/3621783865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c4072de0 0x7fa0c406e0b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa0c406f4e0 tx=0x7fa0b002a140 comp rx=0 tx=0).stop 2024-09-12T01:57:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.305+0000 7fa0cad6d640 1 -- 172.21.15.19:0/3621783865 shutdown_connections 2024-09-12T01:57:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.305+0000 7fa0cad6d640 1 --2- 172.21.15.19:0/3621783865 >> v2:172.21.15.135:3300/0 conn(0x7fa0c4072700 0x7fa0c406e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.305+0000 7fa0cad6d640 1 --2- 172.21.15.19:0/3621783865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c4072de0 0x7fa0c406e0b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.305+0000 7fa0cad6d640 1 --2- 172.21.15.19:0/3621783865 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0c4072320 0x7fa0c40cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.305+0000 7fa0cad6d640 1 -- 172.21.15.19:0/3621783865 >> 172.21.15.19:0/3621783865 conn(0x7fa0c4067d70 msgr2=0x7fa0c406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.305+0000 7fa0cad6d640 1 -- 172.21.15.19:0/3621783865 shutdown_connections 2024-09-12T01:57:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.305+0000 7fa0cad6d640 1 -- 172.21.15.19:0/3621783865 wait complete. 2024-09-12T01:57:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.306+0000 7fa0cad6d640 1 Processor -- start 2024-09-12T01:57:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.306+0000 7fa0cad6d640 1 -- start start 2024-09-12T01:57:39.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.307+0000 7fa0cad6d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c4072320 0x7fa0c40c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.307+0000 7fa0cad6d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0c4072700 0x7fa0c415b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.307+0000 7fa0cad6d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0c4072de0 0x7fa0c415bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.307+0000 7fa0cad6d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c40cd520 con 0x7fa0c4072320 2024-09-12T01:57:39.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.307+0000 7fa0cad6d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c40cd3a0 con 0x7fa0c4072700 2024-09-12T01:57:39.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.307+0000 7fa0cad6d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c406eb30 con 0x7fa0c4072de0 2024-09-12T01:57:39.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.307+0000 7fa0c8b09640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c4072320 0x7fa0c40c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.307+0000 7fa0c8b09640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c4072320 0x7fa0c40c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39698/0 (socket says 172.21.15.19:39698) 2024-09-12T01:57:39.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.307+0000 7fa0c8b09640 1 -- 172.21.15.19:0/4080257357 learned_addr learned my addr 172.21.15.19:0/4080257357 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:39.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.307+0000 7fa0c3fff640 1 --2- 172.21.15.19:0/4080257357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0c4072700 0x7fa0c415b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.307+0000 7fa0c930a640 1 --2- 172.21.15.19:0/4080257357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0c4072de0 0x7fa0c415bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.307+0000 7fa0c8b09640 1 -- 172.21.15.19:0/4080257357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0c4072de0 msgr2=0x7fa0c415bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.307+0000 7fa0c8b09640 1 --2- 172.21.15.19:0/4080257357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0c4072de0 0x7fa0c415bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.307+0000 7fa0c8b09640 1 -- 172.21.15.19:0/4080257357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0c4072700 msgr2=0x7fa0c415b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.307+0000 7fa0c8b09640 1 --2- 172.21.15.19:0/4080257357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0c4072700 0x7fa0c415b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.307+0000 7fa0c8b09640 1 -- 172.21.15.19:0/4080257357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c41f2280 con 0x7fa0c4072320 2024-09-12T01:57:39.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.307+0000 7fa0c930a640 1 --2- 172.21.15.19:0/4080257357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0c4072de0 0x7fa0c415bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:39.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.307+0000 7fa0c8b09640 1 --2- 172.21.15.19:0/4080257357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c4072320 0x7fa0c40c6ad0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800e8c0 tx=0x7fa0b800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:39.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.308+0000 7fa0c17fa640 1 -- 172.21.15.19:0/4080257357 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8017070 con 0x7fa0c4072320 2024-09-12T01:57:39.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.308+0000 7fa0c17fa640 1 -- 172.21.15.19:0/4080257357 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b800c940 con 0x7fa0c4072320 2024-09-12T01:57:39.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.308+0000 7fa0c17fa640 1 -- 172.21.15.19:0/4080257357 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b800cd10 con 0x7fa0c4072320 2024-09-12T01:57:39.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.308+0000 7fa0cad6d640 1 -- 172.21.15.19:0/4080257357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c41f2540 con 0x7fa0c4072320 2024-09-12T01:57:39.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.308+0000 7fa0cad6d640 1 -- 172.21.15.19:0/4080257357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c41f2b00 con 0x7fa0c4072320 2024-09-12T01:57:39.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.309+0000 7fa0cad6d640 1 -- 172.21.15.19:0/4080257357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c40cce60 con 0x7fa0c4072320 2024-09-12T01:57:39.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.309+0000 7fa0c17fa640 1 -- 172.21.15.19:0/4080257357 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0b801a070 con 0x7fa0c4072320 2024-09-12T01:57:39.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.310+0000 7fa0c17fa640 1 --2- 172.21.15.19:0/4080257357 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa0a806be30 0x7fa0a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.310+0000 7fa0c17fa640 1 -- 172.21.15.19:0/4080257357 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7fa0b808af70 con 0x7fa0c4072320 2024-09-12T01:57:39.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.310+0000 7fa0c3fff640 1 --2- 172.21.15.19:0/4080257357 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa0a806be30 0x7fa0a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.310+0000 7fa0c3fff640 1 --2- 172.21.15.19:0/4080257357 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa0a806be30 0x7fa0a806e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0034000 tx=0x7fa0b002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:39.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.314+0000 7fa0c17fa640 1 -- 172.21.15.19:0/4080257357 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa0b80590c0 con 0x7fa0c4072320 2024-09-12T01:57:39.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.525+0000 7fa0cad6d640 1 -- 172.21.15.19:0/4080257357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa0c40c58c0 con 0x7fa0c4072320 2024-09-12T01:57:39.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.526+0000 7fa0c17fa640 1 -- 172.21.15.19:0/4080257357 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+73 (secure 0 0 0) 0x7fa0b805d3c0 con 0x7fa0c4072320 2024-09-12T01:57:39.527 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:57:39.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.528+0000 7fa0cad6d640 1 -- 172.21.15.19:0/4080257357 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa0a806be30 msgr2=0x7fa0a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.528+0000 7fa0cad6d640 1 --2- 172.21.15.19:0/4080257357 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa0a806be30 0x7fa0a806e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0034000 tx=0x7fa0b002e000 comp rx=0 tx=0).stop 2024-09-12T01:57:39.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.528+0000 7fa0cad6d640 1 -- 172.21.15.19:0/4080257357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c4072320 msgr2=0x7fa0c40c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.528+0000 7fa0cad6d640 1 --2- 172.21.15.19:0/4080257357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c4072320 0x7fa0c40c6ad0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800e8c0 tx=0x7fa0b800ed80 comp rx=0 tx=0).stop 2024-09-12T01:57:39.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.528+0000 7fa0cad6d640 1 -- 172.21.15.19:0/4080257357 shutdown_connections 2024-09-12T01:57:39.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.528+0000 7fa0cad6d640 1 --2- 172.21.15.19:0/4080257357 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa0a806be30 0x7fa0a806e2f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.528+0000 7fa0cad6d640 1 --2- 172.21.15.19:0/4080257357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0c4072de0 0x7fa0c415bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.528+0000 7fa0cad6d640 1 --2- 172.21.15.19:0/4080257357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0c4072700 0x7fa0c415b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.528+0000 7fa0cad6d640 1 --2- 172.21.15.19:0/4080257357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c4072320 0x7fa0c40c6ad0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.528+0000 7fa0cad6d640 1 -- 172.21.15.19:0/4080257357 >> 172.21.15.19:0/4080257357 conn(0x7fa0c4067d70 msgr2=0x7fa0c40c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:39.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.528+0000 7fa0cad6d640 1 -- 172.21.15.19:0/4080257357 shutdown_connections 2024-09-12T01:57:39.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39.528+0000 7fa0cad6d640 1 -- 172.21.15.19:0/4080257357 wait complete. 2024-09-12T01:57:39.540 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:57:39.540 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:57:39.540 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T01:57:39.540 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:57:39.541 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:57:39.541 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:57:39.541 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:57:39.541 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:57:39.541 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:57:39.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:39.541 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T01:57:39.558 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:57:39.558 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:57:39.558 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:57:39.558 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:57:39.558 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T01:57:39.558 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:57:39.558 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:57:39.558 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:57:39.558 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T01:57:39.558 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:57:39.559 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:57:39.559 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T01:57:39.559 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:57:39.559 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T01:57:39.559 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T01:57:39.559 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:57:39.559 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42701sec preferred_lft 42701sec 2024-09-12T01:57:39.559 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T01:57:39.559 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:57:39.559 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:57:39.559 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T01:57:39.559 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T01:57:39.560 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:57:39.560 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T01:57:39.560 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:57:39.560 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:57:39.560 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T01:57:39.560 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:57:39.560 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:57:39.560 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:57:39.560 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T01:57:39.560 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:57:39.560 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:57:39.560 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:57:39.561 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T01:57:39.561 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:57:39.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:39.561 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:57:39.622 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T01:57:39.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:39.624 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T01:57:39.681 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T01:57:39.681 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:57:39.681 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:57:39.681 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:57:39.681 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:57:39.681 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:57:39.682 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:57:39.682 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:57:39.682 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:57:39.682 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:57:39.682 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:57:39.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:57:39.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:57:39.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:39.811 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T01:57:39.826 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T01:57:39.826 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:57:39.827 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:57:39.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:39.827 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T01:57:39.893 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:57:39.893 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:57:39.949 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:57:39.949 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:57:39.949 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:57:40.004 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T01:57:40.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:40.005 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:57:40.089 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:57:40.089 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:57:40.089 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:57:40.097 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:57:40.098 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:57:40.098 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:57:40.098 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:57:40.098 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:57:40.104 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:57:40.104 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:57:40.104 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:57:40.104 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:57:40.104 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:57:40.104 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T01:57:40.105 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T01:57:40.105 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T01:57:40.105 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:57:40.106 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:57:40.106 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:57:40.106 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:57:40.106 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:57:40.107 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:57:40.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:40.107 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:57:40.137 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:57:40.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:57:40.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:57:40.234 INFO:teuthology.orchestra.run.smithi019.stdout:client5143 2024-09-12T01:57:40.234 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:57:40.235 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:57:40.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:40.251 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-09-12T01:57:40.309 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T01:57:40.309 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-09-12T01:57:40.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.394+0000 7f2ec9fcaf40 1 Processor -- start 2024-09-12T01:57:40.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.395+0000 7f2ec9fcaf40 1 -- start start 2024-09-12T01:57:40.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.395+0000 7f2ec9fcaf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557ff76d4640 0x557ff76bb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.395+0000 7f2ec9fcaf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557ff7760d20 0x557ff77631b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.395+0000 7f2ec9fcaf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ff7761100 0x557ff7762390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.395+0000 7f2ec9fcaf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557ff75dd510 con 0x557ff76d4640 2024-09-12T01:57:40.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.395+0000 7f2ec9fcaf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557ff7636c50 con 0x557ff7761100 2024-09-12T01:57:40.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.395+0000 7f2ec9fcaf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x557ff76d56b0 con 0x557ff7760d20 2024-09-12T01:57:40.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.395+0000 7f2ec7ac0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557ff76d4640 0x557ff76bb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.395+0000 7f2ec7ac0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557ff76d4640 0x557ff76bb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39724/0 (socket says 172.21.15.19:39724) 2024-09-12T01:57:40.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.395+0000 7f2ec7ac0640 1 -- 172.21.15.19:0/1505904775 learned_addr learned my addr 172.21.15.19:0/1505904775 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:40.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.395+0000 7f2ec82c1640 1 --2- 172.21.15.19:0/1505904775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ff7761100 0x557ff7762390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.395+0000 7f2ebffff640 1 --2- 172.21.15.19:0/1505904775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557ff7760d20 0x557ff77631b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.396+0000 7f2ec7ac0640 1 -- 172.21.15.19:0/1505904775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557ff7760d20 msgr2=0x557ff77631b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:40.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.396+0000 7f2ec7ac0640 1 --2- 172.21.15.19:0/1505904775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557ff7760d20 0x557ff77631b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.396+0000 7f2ec7ac0640 1 -- 172.21.15.19:0/1505904775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ff7761100 msgr2=0x557ff7762390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:40.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.396+0000 7f2ec7ac0640 1 --2- 172.21.15.19:0/1505904775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ff7761100 0x557ff7762390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.396+0000 7f2ec7ac0640 1 -- 172.21.15.19:0/1505904775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ff7757e30 con 0x557ff76d4640 2024-09-12T01:57:40.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.396+0000 7f2ebffff640 1 --2- 172.21.15.19:0/1505904775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557ff7760d20 0x557ff77631b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:40.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.396+0000 7f2ec7ac0640 1 --2- 172.21.15.19:0/1505904775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557ff76d4640 0x557ff76bb2c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8000c00 tx=0x7f2eb8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d5810c1cc2201e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.396+0000 7f2ec6abe640 1 -- 172.21.15.19:0/1505904775 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb804f600 con 0x557ff76d4640 2024-09-12T01:57:40.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.396+0000 7f2ec6abe640 1 -- 172.21.15.19:0/1505904775 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb804f9d0 con 0x557ff76d4640 2024-09-12T01:57:40.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.396+0000 7f2ec6abe640 1 -- 172.21.15.19:0/1505904775 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb804fdc0 con 0x557ff76d4640 2024-09-12T01:57:40.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.396+0000 7f2ec9fcaf40 1 -- 172.21.15.19:0/1505904775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557ff76d4640 msgr2=0x557ff76bb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.396+0000 7f2ec9fcaf40 1 --2- 172.21.15.19:0/1505904775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557ff76d4640 0x557ff76bb2c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8000c00 tx=0x7f2eb8051000 comp rx=0 tx=0).stop 2024-09-12T01:57:40.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.396+0000 7f2ec9fcaf40 1 -- 172.21.15.19:0/1505904775 shutdown_connections 2024-09-12T01:57:40.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.396+0000 7f2ec9fcaf40 1 --2- 172.21.15.19:0/1505904775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ff7761100 0x557ff7762390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.396+0000 7f2ec9fcaf40 1 --2- 172.21.15.19:0/1505904775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557ff7760d20 0x557ff77631b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.396+0000 7f2ec9fcaf40 1 --2- 172.21.15.19:0/1505904775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557ff76d4640 0x557ff76bb2c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.396+0000 7f2ec9fcaf40 1 -- 172.21.15.19:0/1505904775 >> 172.21.15.19:0/1505904775 conn(0x557ff76b9490 msgr2=0x557ff76b9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.397+0000 7f2ec9fcaf40 1 -- 172.21.15.19:0/1505904775 shutdown_connections 2024-09-12T01:57:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.397+0000 7f2ec9fcaf40 1 -- 172.21.15.19:0/1505904775 wait complete. 2024-09-12T01:57:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.397+0000 7f2ec9fcaf40 1 Processor -- start 2024-09-12T01:57:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.397+0000 7f2ec9fcaf40 1 -- start start 2024-09-12T01:57:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.398+0000 7f2ec9fcaf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557ff76d4640 0x557ff774f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.398+0000 7f2ec9fcaf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ff7760d20 0x557ff77524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.398+0000 7f2ec9fcaf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557ff7761100 0x557ff7762080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.398+0000 7f2ec9fcaf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557ff76d24f0 con 0x557ff76d4640 2024-09-12T01:57:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.398+0000 7f2ec9fcaf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557ff77616a0 con 0x557ff7760d20 2024-09-12T01:57:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.398+0000 7f2ec9fcaf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x557ff76bb800 con 0x557ff7761100 2024-09-12T01:57:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.398+0000 7f2ec7ac0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557ff76d4640 0x557ff774f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.398+0000 7f2ec7ac0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557ff76d4640 0x557ff774f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39726/0 (socket says 172.21.15.19:39726) 2024-09-12T01:57:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.398+0000 7f2ec7ac0640 1 -- 172.21.15.19:0/4050250445 learned_addr learned my addr 172.21.15.19:0/4050250445 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.398+0000 7f2ebffff640 1 --2- 172.21.15.19:0/4050250445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ff7760d20 0x557ff77524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.398+0000 7f2ec82c1640 1 --2- 172.21.15.19:0/4050250445 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557ff7761100 0x557ff7762080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.398+0000 7f2ec7ac0640 1 -- 172.21.15.19:0/4050250445 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557ff7761100 msgr2=0x557ff7762080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.398+0000 7f2ec7ac0640 1 --2- 172.21.15.19:0/4050250445 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557ff7761100 0x557ff7762080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.398+0000 7f2ec7ac0640 1 -- 172.21.15.19:0/4050250445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ff7760d20 msgr2=0x557ff77524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.398+0000 7f2ec7ac0640 1 --2- 172.21.15.19:0/4050250445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ff7760d20 0x557ff77524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.398+0000 7f2ec7ac0640 1 -- 172.21.15.19:0/4050250445 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ff77529e0 con 0x557ff76d4640 2024-09-12T01:57:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.398+0000 7f2ec7ac0640 1 --2- 172.21.15.19:0/4050250445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557ff76d4640 0x557ff774f8b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8025ec0 tx=0x7f2eb8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.399+0000 7f2ec5abc640 1 -- 172.21.15.19:0/4050250445 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb806c410 con 0x557ff76d4640 2024-09-12T01:57:40.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.399+0000 7f2ec5abc640 1 -- 172.21.15.19:0/4050250445 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb806c5b0 con 0x557ff76d4640 2024-09-12T01:57:40.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.399+0000 7f2ec9fcaf40 1 -- 172.21.15.19:0/4050250445 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ff77f4d80 con 0x557ff76d4640 2024-09-12T01:57:40.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.399+0000 7f2ec5abc640 1 -- 172.21.15.19:0/4050250445 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb806c9a0 con 0x557ff76d4640 2024-09-12T01:57:40.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.399+0000 7f2ec9fcaf40 1 -- 172.21.15.19:0/4050250445 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ff77f4aa0 con 0x557ff76d4640 2024-09-12T01:57:40.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.400+0000 7f2ec5abc640 1 -- 172.21.15.19:0/4050250445 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2eb806a070 con 0x557ff76d4640 2024-09-12T01:57:40.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.400+0000 7f2ec5abc640 1 --2- 172.21.15.19:0/4050250445 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2ea806a840 0x7f2ea806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.401+0000 7f2ec5abc640 1 -- 172.21.15.19:0/4050250445 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7f2eb80ce780 con 0x557ff76d4640 2024-09-12T01:57:40.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.401+0000 7f2ec9fcaf40 1 --2- 172.21.15.19:0/4050250445 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x557ff7751e40 0x557ff77f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.401+0000 7f2ec9fcaf40 1 -- 172.21.15.19:0/4050250445 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43) -- 0x557ff77625c0 con 0x557ff7751e40 2024-09-12T01:57:40.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.401+0000 7f2ec82c1640 1 --2- 172.21.15.19:0/4050250445 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x557ff7751e40 0x557ff77f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.401+0000 7f2ebffff640 1 --2- 172.21.15.19:0/4050250445 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2ea806a840 0x7f2ea806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.401+0000 7f2ec82c1640 1 --2- 172.21.15.19:0/4050250445 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x557ff7751e40 0x557ff77f3860 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.402+0000 7f2ebffff640 1 --2- 172.21.15.19:0/4050250445 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2ea806a840 0x7f2ea806cd00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x557ff76bca90 tx=0x7f2eb00017e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.403+0000 7f2ec82c1640 1 -- 172.21.15.19:0/4050250445 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v43'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f2ec0001630 con 0x557ff7751e40 2024-09-12T01:57:40.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.403+0000 7f2ec9fcaf40 1 -- 172.21.15.19:0/4050250445 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x557ff7751e40 msgr2=0x557ff77f3860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.403+0000 7f2ec9fcaf40 1 --2- 172.21.15.19:0/4050250445 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x557ff7751e40 0x557ff77f3860 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.403+0000 7f2ec9fcaf40 1 -- 172.21.15.19:0/4050250445 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2ea806a840 msgr2=0x7f2ea806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.403+0000 7f2ec9fcaf40 1 --2- 172.21.15.19:0/4050250445 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2ea806a840 0x7f2ea806cd00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x557ff76bca90 tx=0x7f2eb00017e0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.403+0000 7f2ec9fcaf40 1 -- 172.21.15.19:0/4050250445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557ff76d4640 msgr2=0x557ff774f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.403+0000 7f2ec9fcaf40 1 --2- 172.21.15.19:0/4050250445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557ff76d4640 0x557ff774f8b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8025ec0 tx=0x7f2eb8002fb0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.403+0000 7f2ec82c1640 1 -- 172.21.15.19:0/4050250445 reap_dead start 2024-09-12T01:57:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.403+0000 7f2ec9fcaf40 1 -- 172.21.15.19:0/4050250445 shutdown_connections 2024-09-12T01:57:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.403+0000 7f2ec9fcaf40 1 -- 172.21.15.19:0/4050250445 >> 172.21.15.19:0/4050250445 conn(0x557ff76b9490 msgr2=0x557ff768ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.403+0000 7f2ec9fcaf40 1 -- 172.21.15.19:0/4050250445 shutdown_connections 2024-09-12T01:57:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.403+0000 7f2ec9fcaf40 1 -- 172.21.15.19:0/4050250445 wait complete. 2024-09-12T01:57:40.420 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:57:40.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.522+0000 7f07e9198640 1 Processor -- start 2024-09-12T01:57:40.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.522+0000 7f07e9198640 1 -- start start 2024-09-12T01:57:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.523+0000 7f07e9198640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f07e4161c80 0x7f07e406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.523+0000 7f07e9198640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e4162060 0x7f07e40b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.523+0000 7f07e9198640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07e406e870 con 0x7f07e40b64b0 2024-09-12T01:57:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.523+0000 7f07e9198640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f07e406d9f0 con 0x7f07e4161c80 2024-09-12T01:57:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.523+0000 7f07e9198640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f07e406dcd0 con 0x7f07e4162060 2024-09-12T01:57:40.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.523+0000 7f07e359e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f07e40b64b0 0x7f07e4162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53344/0 (socket says 172.21.15.19:53344) 2024-09-12T01:57:40.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.523+0000 7f07e359e640 1 -- 172.21.15.19:0/3462102851 learned_addr learned my addr 172.21.15.19:0/3462102851 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:40.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.523+0000 7f07e259c640 1 --2- 172.21.15.19:0/3462102851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e4162060 0x7f07e40b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.523+0000 7f07e2d9d640 1 --2- 172.21.15.19:0/3462102851 >> v2:172.21.15.135:3300/0 conn(0x7f07e4161c80 0x7f07e406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.524+0000 7f07e1d9b640 1 -- 172.21.15.19:0/3462102851 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1104984232 0 0) 0x7f07dc001110 con 0x7f07e40b64b0 2024-09-12T01:57:40.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.524+0000 7f07e1d9b640 1 -- 172.21.15.19:0/3462102851 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07cc003520 con 0x7f07e40b64b0 2024-09-12T01:57:40.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.524+0000 7f07e259c640 1 -- 172.21.15.19:0/3462102851 >> v2:172.21.15.135:3300/0 conn(0x7f07e4161c80 msgr2=0x7f07e406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:40.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.524+0000 7f07e259c640 1 --2- 172.21.15.19:0/3462102851 >> v2:172.21.15.135:3300/0 conn(0x7f07e4161c80 0x7f07e406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.524+0000 7f07e259c640 1 -- 172.21.15.19:0/3462102851 >> v1:172.21.15.19:6789/0 conn(0x7f07e40b64b0 legacy=0x7f07e4162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.524+0000 7f07e259c640 1 -- 172.21.15.19:0/3462102851 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e406dfb0 con 0x7f07e4162060 2024-09-12T01:57:40.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.525+0000 7f07e259c640 1 --2- 172.21.15.19:0/3462102851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e4162060 0x7f07e40b5f70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07d80097a0 tx=0x7f07d802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96e952388487142c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.525+0000 7f07e1d9b640 1 -- 172.21.15.19:0/3462102851 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8037070 con 0x7f07e4162060 2024-09-12T01:57:40.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.525+0000 7f07e1d9b640 1 -- 172.21.15.19:0/3462102851 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d8032440 con 0x7f07e4162060 2024-09-12T01:57:40.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.525+0000 7f07e1d9b640 1 -- 172.21.15.19:0/3462102851 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d80327f0 con 0x7f07e4162060 2024-09-12T01:57:40.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.525+0000 7f07e9198640 1 -- 172.21.15.19:0/3462102851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e4162060 msgr2=0x7f07e40b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.525+0000 7f07e9198640 1 --2- 172.21.15.19:0/3462102851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e4162060 0x7f07e40b5f70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07d80097a0 tx=0x7f07d802a180 comp rx=0 tx=0).stop 2024-09-12T01:57:40.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.525+0000 7f07e9198640 1 -- 172.21.15.19:0/3462102851 shutdown_connections 2024-09-12T01:57:40.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.525+0000 7f07e9198640 1 --2- 172.21.15.19:0/3462102851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e4162060 0x7f07e40b5f70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.525+0000 7f07e9198640 1 --2- 172.21.15.19:0/3462102851 >> v2:172.21.15.135:3300/0 conn(0x7f07e4161c80 0x7f07e406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.525+0000 7f07e9198640 1 -- 172.21.15.19:0/3462102851 >> 172.21.15.19:0/3462102851 conn(0x7f07e40d44f0 msgr2=0x7f07e40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:40.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.525+0000 7f07e9198640 1 -- 172.21.15.19:0/3462102851 shutdown_connections 2024-09-12T01:57:40.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.525+0000 7f07e9198640 1 -- 172.21.15.19:0/3462102851 wait complete. 2024-09-12T01:57:40.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.527+0000 7f07e9198640 1 Processor -- start 2024-09-12T01:57:40.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.527+0000 7f07e9198640 1 -- start start 2024-09-12T01:57:40.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.528+0000 7f07e9198640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e40b64b0 0x7f07e4155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.528+0000 7f07e9198640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e4161c80 0x7f07e40b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.528+0000 7f07e9198640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07e4162060 0x7f07e415a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.528+0000 7f07e9198640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f07e40d2a10 con 0x7f07e4162060 2024-09-12T01:57:40.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.528+0000 7f07e9198640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f07e40d2890 con 0x7f07e4161c80 2024-09-12T01:57:40.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.528+0000 7f07e9198640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f07e40b6960 con 0x7f07e40b64b0 2024-09-12T01:57:40.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.528+0000 7f07e359e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07e4162060 0x7f07e415a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.528+0000 7f07e359e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07e4162060 0x7f07e415a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39732/0 (socket says 172.21.15.19:39732) 2024-09-12T01:57:40.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.528+0000 7f07e359e640 1 -- 172.21.15.19:0/4059902821 learned_addr learned my addr 172.21.15.19:0/4059902821 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:40.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.528+0000 7f07e2d9d640 1 --2- 172.21.15.19:0/4059902821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e40b64b0 0x7f07e4155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.528+0000 7f07e259c640 1 --2- 172.21.15.19:0/4059902821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e4161c80 0x7f07e40b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.528+0000 7f07e359e640 1 -- 172.21.15.19:0/4059902821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e40b64b0 msgr2=0x7f07e4155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.528+0000 7f07e359e640 1 --2- 172.21.15.19:0/4059902821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e40b64b0 0x7f07e4155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.528+0000 7f07e359e640 1 -- 172.21.15.19:0/4059902821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e4161c80 msgr2=0x7f07e40b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.528+0000 7f07e359e640 1 --2- 172.21.15.19:0/4059902821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e4161c80 0x7f07e40b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.528+0000 7f07e359e640 1 -- 172.21.15.19:0/4059902821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e40b2a20 con 0x7f07e4162060 2024-09-12T01:57:40.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.528+0000 7f07e359e640 1 --2- 172.21.15.19:0/4059902821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07e4162060 0x7f07e415a250 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00c730 tx=0x7f07dc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.529+0000 7f07cb7fe640 1 -- 172.21.15.19:0/4059902821 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc017070 con 0x7f07e4162060 2024-09-12T01:57:40.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.529+0000 7f07cb7fe640 1 -- 172.21.15.19:0/4059902821 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07dc0058b0 con 0x7f07e4162060 2024-09-12T01:57:40.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.529+0000 7f07e9198640 1 -- 172.21.15.19:0/4059902821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e40b2d00 con 0x7f07e4162060 2024-09-12T01:57:40.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.529+0000 7f07cb7fe640 1 -- 172.21.15.19:0/4059902821 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc005ca0 con 0x7f07e4162060 2024-09-12T01:57:40.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.529+0000 7f07e9198640 1 -- 172.21.15.19:0/4059902821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e40b32c0 con 0x7f07e4162060 2024-09-12T01:57:40.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.530+0000 7f07e9198640 1 -- 172.21.15.19:0/4059902821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07e40ce8a0 con 0x7f07e4162060 2024-09-12T01:57:40.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.530+0000 7f07cb7fe640 1 -- 172.21.15.19:0/4059902821 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f07dc01a070 con 0x7f07e4162060 2024-09-12T01:57:40.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.531+0000 7f07cb7fe640 1 --2- 172.21.15.19:0/4059902821 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f07d006be30 0x7f07d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.531+0000 7f07cb7fe640 1 -- 172.21.15.19:0/4059902821 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7f07dc08a280 con 0x7f07e4162060 2024-09-12T01:57:40.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.531+0000 7f07e2d9d640 1 --2- 172.21.15.19:0/4059902821 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f07d006be30 0x7f07d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.531+0000 7f07e2d9d640 1 --2- 172.21.15.19:0/4059902821 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f07d006be30 0x7f07d006e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f07e40ba440 tx=0x7f07d400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.535+0000 7f07cb7fe640 1 -- 172.21.15.19:0/4059902821 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f07e406e870 con 0x7f07e4162060 2024-09-12T01:57:40.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.747+0000 7f07e9198640 1 -- 172.21.15.19:0/4059902821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07e4160660 con 0x7f07e4162060 2024-09-12T01:57:40.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.747+0000 7f07cb7fe640 1 -- 172.21.15.19:0/4059902821 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5227 (secure 0 0 0) 0x7f07dc058470 con 0x7f07e4162060 2024-09-12T01:57:40.748 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:40.748 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"btime":"2024-09-12T01:57:04:677301+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1979542220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1979542220},{"type":"v1","addr":"172.21.15.135:6836","nonce":1979542220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/809710386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":809710386},{"type":"v1","addr":"172.21.15.19:6835","nonce":809710386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1005776280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1005776280},{"type":"v1","addr":"172.21.15.135:6837","nonce":1005776280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:56:48.431829+0000","modified":"2024-09-12T01:57:04.677295+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6834/3554496273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3554496273},{"type":"v1","addr":"172.21.15.19:6834","nonce":3554496273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5088,"qdb_cluster":[5088]},"id":2}]} 2024-09-12T01:57:40.748 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 20 2024-09-12T01:57:40.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.750+0000 7f07e9198640 1 -- 172.21.15.19:0/4059902821 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f07d006be30 msgr2=0x7f07d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.750+0000 7f07e9198640 1 --2- 172.21.15.19:0/4059902821 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f07d006be30 0x7f07d006e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f07e40ba440 tx=0x7f07d400b040 comp rx=0 tx=0).stop 2024-09-12T01:57:40.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.750+0000 7f07e9198640 1 -- 172.21.15.19:0/4059902821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07e4162060 msgr2=0x7f07e415a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.750+0000 7f07e9198640 1 --2- 172.21.15.19:0/4059902821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07e4162060 0x7f07e415a250 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00c730 tx=0x7f07dc00cbf0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.750+0000 7f07e9198640 1 -- 172.21.15.19:0/4059902821 shutdown_connections 2024-09-12T01:57:40.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.750+0000 7f07e9198640 1 --2- 172.21.15.19:0/4059902821 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f07d006be30 0x7f07d006e2f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.750+0000 7f07e9198640 1 --2- 172.21.15.19:0/4059902821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07e4162060 0x7f07e415a250 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.750+0000 7f07e9198640 1 --2- 172.21.15.19:0/4059902821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e4161c80 0x7f07e40b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.750+0000 7f07e9198640 1 --2- 172.21.15.19:0/4059902821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e40b64b0 0x7f07e4155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.750+0000 7f07e9198640 1 -- 172.21.15.19:0/4059902821 >> 172.21.15.19:0/4059902821 conn(0x7f07e40d44f0 msgr2=0x7f07e40b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:40.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.750+0000 7f07e9198640 1 -- 172.21.15.19:0/4059902821 shutdown_connections 2024-09-12T01:57:40.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.750+0000 7f07e9198640 1 -- 172.21.15.19:0/4059902821 wait complete. 2024-09-12T01:57:40.762 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 3691414925 2024-09-12T01:57:40.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.867+0000 7f55d294b640 1 Processor -- start 2024-09-12T01:57:40.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.867+0000 7f55d294b640 1 -- start start 2024-09-12T01:57:40.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.868+0000 7f55d294b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f55cc159f90 0x7f55cc06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.868+0000 7f55d294b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f55cc06ff10 0x7f55cc15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.868+0000 7f55d294b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55cc0b3d10 con 0x7f55cc160390 2024-09-12T01:57:40.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.868+0000 7f55d294b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f55cc0b4db0 con 0x7f55cc06ff10 2024-09-12T01:57:40.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.868+0000 7f55d294b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f55cc160800 con 0x7f55cc159f90 2024-09-12T01:57:40.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.868+0000 7f55cb7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f55cc06ff10 0x7f55cc15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.868+0000 7f55cb7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f55cc06ff10 0x7f55cc15fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39746/0 (socket says 172.21.15.19:39746) 2024-09-12T01:57:40.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.868+0000 7f55d0ee8640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f55cc160390 0x7f55cc15c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53354/0 (socket says 172.21.15.19:53354) 2024-09-12T01:57:40.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.868+0000 7f55cb7fe640 1 -- 172.21.15.19:0/1475804055 learned_addr learned my addr 172.21.15.19:0/1475804055 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:40.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.868+0000 7f55cb7fe640 1 -- 172.21.15.19:0/1475804055 >> v2:172.21.15.135:3300/0 conn(0x7f55cc159f90 msgr2=0x7f55cc06f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:40.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.868+0000 7f55cbfff640 1 --2- 172.21.15.19:0/1475804055 >> v2:172.21.15.135:3300/0 conn(0x7f55cc159f90 0x7f55cc06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.868+0000 7f55cb7fe640 1 --2- 172.21.15.19:0/1475804055 >> v2:172.21.15.135:3300/0 conn(0x7f55cc159f90 0x7f55cc06f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.868+0000 7f55caffd640 1 -- 172.21.15.19:0/1475804055 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1676768361 0 0) 0x7f55cc0b3d10 con 0x7f55cc160390 2024-09-12T01:57:40.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.868+0000 7f55cb7fe640 1 -- 172.21.15.19:0/1475804055 >> v1:172.21.15.19:6789/0 conn(0x7f55cc160390 legacy=0x7f55cc15c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.868+0000 7f55cb7fe640 1 -- 172.21.15.19:0/1475804055 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55cc0b3ff0 con 0x7f55cc06ff10 2024-09-12T01:57:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.869+0000 7f55cb7fe640 1 --2- 172.21.15.19:0/1475804055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55cc06ff10 0x7f55cc15fe50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0d04e0 tx=0x7f55c002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9aba95bc382529 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.869+0000 7f55caffd640 1 -- 172.21.15.19:0/1475804055 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c0037070 con 0x7f55cc06ff10 2024-09-12T01:57:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.869+0000 7f55caffd640 1 -- 172.21.15.19:0/1475804055 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c0032440 con 0x7f55cc06ff10 2024-09-12T01:57:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.869+0000 7f55caffd640 1 -- 172.21.15.19:0/1475804055 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c0032810 con 0x7f55cc06ff10 2024-09-12T01:57:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.870+0000 7f55d294b640 1 -- 172.21.15.19:0/1475804055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55cc06ff10 msgr2=0x7f55cc15fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.870+0000 7f55d294b640 1 --2- 172.21.15.19:0/1475804055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55cc06ff10 0x7f55cc15fe50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0d04e0 tx=0x7f55c002a1e0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.870+0000 7f55d294b640 1 -- 172.21.15.19:0/1475804055 shutdown_connections 2024-09-12T01:57:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.870+0000 7f55d294b640 1 --2- 172.21.15.19:0/1475804055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55cc06ff10 0x7f55cc15fe50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.870+0000 7f55d294b640 1 --2- 172.21.15.19:0/1475804055 >> v2:172.21.15.135:3300/0 conn(0x7f55cc159f90 0x7f55cc06f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.870+0000 7f55d294b640 1 -- 172.21.15.19:0/1475804055 >> 172.21.15.19:0/1475804055 conn(0x7f55cc06bdf0 msgr2=0x7f55cc06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.870+0000 7f55d294b640 1 -- 172.21.15.19:0/1475804055 shutdown_connections 2024-09-12T01:57:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.870+0000 7f55d294b640 1 -- 172.21.15.19:0/1475804055 wait complete. 2024-09-12T01:57:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.871+0000 7f55d294b640 1 Processor -- start 2024-09-12T01:57:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.871+0000 7f55d294b640 1 -- start start 2024-09-12T01:57:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.872+0000 7f55d294b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55cc06ff10 0x7f55cc0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.872+0000 7f55d294b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55cc159f90 0x7f55cc072170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.872+0000 7f55d294b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55cc160390 0x7f55cc141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.872+0000 7f55d294b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f55cc0b3930 con 0x7f55cc160390 2024-09-12T01:57:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.872+0000 7f55d294b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55cc0b45b0 con 0x7f55cc06ff10 2024-09-12T01:57:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.872+0000 7f55d294b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f55cc0b3ab0 con 0x7f55cc159f90 2024-09-12T01:57:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.872+0000 7f55d0ee8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55cc160390 0x7f55cc141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.872+0000 7f55d0ee8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55cc160390 0x7f55cc141310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39756/0 (socket says 172.21.15.19:39756) 2024-09-12T01:57:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.872+0000 7f55d0ee8640 1 -- 172.21.15.19:0/3326713970 learned_addr learned my addr 172.21.15.19:0/3326713970 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.872+0000 7f55cb7fe640 1 --2- 172.21.15.19:0/3326713970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55cc159f90 0x7f55cc072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.872+0000 7f55cbfff640 1 --2- 172.21.15.19:0/3326713970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55cc06ff10 0x7f55cc0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.872+0000 7f55d0ee8640 1 -- 172.21.15.19:0/3326713970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55cc159f90 msgr2=0x7f55cc072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.872+0000 7f55d0ee8640 1 --2- 172.21.15.19:0/3326713970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55cc159f90 0x7f55cc072170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.873+0000 7f55d0ee8640 1 -- 172.21.15.19:0/3326713970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55cc06ff10 msgr2=0x7f55cc0732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.873+0000 7f55d0ee8640 1 --2- 172.21.15.19:0/3326713970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55cc06ff10 0x7f55cc0732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.873+0000 7f55d0ee8640 1 -- 172.21.15.19:0/3326713970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55cc0b0000 con 0x7f55cc160390 2024-09-12T01:57:40.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.873+0000 7f55d0ee8640 1 --2- 172.21.15.19:0/3326713970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55cc160390 0x7f55cc141310 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f55c400c7d0 tx=0x7f55c400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.873+0000 7f55c8ff9640 1 -- 172.21.15.19:0/3326713970 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c4018070 con 0x7f55cc160390 2024-09-12T01:57:40.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.873+0000 7f55c8ff9640 1 -- 172.21.15.19:0/3326713970 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c400a5e0 con 0x7f55cc160390 2024-09-12T01:57:40.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.873+0000 7f55d294b640 1 -- 172.21.15.19:0/3326713970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55cc0b02e0 con 0x7f55cc160390 2024-09-12T01:57:40.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.873+0000 7f55c8ff9640 1 -- 172.21.15.19:0/3326713970 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c400aa10 con 0x7f55cc160390 2024-09-12T01:57:40.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.873+0000 7f55d294b640 1 -- 172.21.15.19:0/3326713970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55cc0afcb0 con 0x7f55cc160390 2024-09-12T01:57:40.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.875+0000 7f55c8ff9640 1 -- 172.21.15.19:0/3326713970 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55c401b070 con 0x7f55cc160390 2024-09-12T01:57:40.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.875+0000 7f55c8ff9640 1 --2- 172.21.15.19:0/3326713970 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f55b806be30 0x7f55b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.875+0000 7f55c8ff9640 1 -- 172.21.15.19:0/3326713970 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7f55c408a5c0 con 0x7f55cc160390 2024-09-12T01:57:40.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.876+0000 7f55cbfff640 1 --2- 172.21.15.19:0/3326713970 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f55b806be30 0x7f55b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.876+0000 7f55d57c5740 1 Processor -- start 2024-09-12T01:57:40.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.876+0000 7f55d57c5740 1 -- start start 2024-09-12T01:57:40.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.876+0000 7f55cbfff640 1 --2- 172.21.15.19:0/3326713970 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f55b806be30 0x7f55b806e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f55bc006fd0 tx=0x7f55bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55d57c5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe63ea0 0x56379fe64280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55d57c5740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe61660 0x56379fe631f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55d57c5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe61ac0 0x56379fe43e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55d57c5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56379fd808d0 con 0x56379fe61ac0 2024-09-12T01:57:40.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55d57c5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56379fd28510 con 0x56379fe63ea0 2024-09-12T01:57:40.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55d57c5740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56379fd7c890 con 0x56379fe61660 2024-09-12T01:57:40.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55d0ee8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe61ac0 0x56379fe43e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55cbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe63ea0 0x56379fe64280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55d0ee8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe61ac0 0x56379fe43e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39766/0 (socket says 172.21.15.19:39766) 2024-09-12T01:57:40.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55d0ee8640 1 -- 172.21.15.19:0/3758404693 learned_addr learned my addr 172.21.15.19:0/3758404693 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:40.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55cb7fe640 1 --2- 172.21.15.19:0/3758404693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe61660 0x56379fe631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55d0ee8640 1 -- 172.21.15.19:0/3758404693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe61660 msgr2=0x56379fe631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:40.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55d0ee8640 1 --2- 172.21.15.19:0/3758404693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe61660 0x56379fe631f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55d0ee8640 1 -- 172.21.15.19:0/3758404693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe63ea0 msgr2=0x56379fe64280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:40.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55d0ee8640 1 --2- 172.21.15.19:0/3758404693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe63ea0 0x56379fe64280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55d0ee8640 1 -- 172.21.15.19:0/3758404693 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56379fd3d1a0 con 0x56379fe61ac0 2024-09-12T01:57:40.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55cb7fe640 1 --2- 172.21.15.19:0/3758404693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe61660 0x56379fe631f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:40.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55d0ee8640 1 --2- 172.21.15.19:0/3758404693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe61ac0 0x56379fe43e20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f55c4004fd0 tx=0x7f55c4058620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3fecd8c6ad915ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55b1ffb640 1 -- 172.21.15.19:0/3758404693 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c4056a20 con 0x56379fe61ac0 2024-09-12T01:57:40.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55b1ffb640 1 -- 172.21.15.19:0/3758404693 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c4054d90 con 0x56379fe61ac0 2024-09-12T01:57:40.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.877+0000 7f55b1ffb640 1 -- 172.21.15.19:0/3758404693 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c405ddf0 con 0x56379fe61ac0 2024-09-12T01:57:40.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.878+0000 7f55d57c5740 1 -- 172.21.15.19:0/3758404693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe61ac0 msgr2=0x56379fe43e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.878+0000 7f55d57c5740 1 --2- 172.21.15.19:0/3758404693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe61ac0 0x56379fe43e20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f55c4004fd0 tx=0x7f55c4058620 comp rx=0 tx=0).stop 2024-09-12T01:57:40.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.878+0000 7f55d57c5740 1 -- 172.21.15.19:0/3758404693 shutdown_connections 2024-09-12T01:57:40.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.878+0000 7f55d57c5740 1 --2- 172.21.15.19:0/3758404693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe61ac0 0x56379fe43e20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.878+0000 7f55d57c5740 1 --2- 172.21.15.19:0/3758404693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe61660 0x56379fe631f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.878+0000 7f55d57c5740 1 --2- 172.21.15.19:0/3758404693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe63ea0 0x56379fe64280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.878+0000 7f55d57c5740 1 -- 172.21.15.19:0/3758404693 >> 172.21.15.19:0/3758404693 conn(0x56379fe19d90 msgr2=0x56379fe61f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:40.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.878+0000 7f55d57c5740 1 -- 172.21.15.19:0/3758404693 shutdown_connections 2024-09-12T01:57:40.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.878+0000 7f55d57c5740 1 -- 172.21.15.19:0/3758404693 wait complete. 2024-09-12T01:57:40.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.879+0000 7f55d57c5740 1 -- start start 2024-09-12T01:57:40.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.879+0000 7f55d57c5740 1 Processor -- start 2024-09-12T01:57:40.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55d57c5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe61ac0 0x56379fe42bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55d57c5740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe63ea0 0x56379fe5c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55d57c5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 0x56379fe47250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55d57c5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56379fe605c0 con 0x56379fe45a90 2024-09-12T01:57:40.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55d57c5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56379fd09640 con 0x56379fe61ac0 2024-09-12T01:57:40.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55d57c5740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56379fe608a0 con 0x56379fe63ea0 2024-09-12T01:57:40.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55d57c5740 10 client.0 _ll_register_callbacks cb 0x56379fd412a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:40.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55d0ee8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 0x56379fe47250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55d0ee8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 0x56379fe47250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39770/0 (socket says 172.21.15.19:39770) 2024-09-12T01:57:40.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55d0ee8640 1 -- 172.21.15.19:0/3611920184 learned_addr learned my addr 172.21.15.19:0/3611920184 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:40.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55cb7fe640 1 --2- 172.21.15.19:0/3611920184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe63ea0 0x56379fe5c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55cbfff640 1 --2- 172.21.15.19:0/3611920184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe61ac0 0x56379fe42bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55d0ee8640 1 -- 172.21.15.19:0/3611920184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe63ea0 msgr2=0x56379fe5c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:40.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55d0ee8640 1 --2- 172.21.15.19:0/3611920184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe63ea0 0x56379fe5c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55d0ee8640 1 -- 172.21.15.19:0/3611920184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe61ac0 msgr2=0x56379fe42bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:40.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55d0ee8640 1 --2- 172.21.15.19:0/3611920184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe61ac0 0x56379fe42bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55d0ee8640 1 -- 172.21.15.19:0/3611920184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56379fb5f710 con 0x56379fe45a90 2024-09-12T01:57:40.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55d0ee8640 1 --2- 172.21.15.19:0/3611920184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 0x56379fe47250 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f55c4058420 tx=0x7f55c405b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ea066dc4f39cfe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:57:40.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.880+0000 7f55aaffd640 1 -- 172.21.15.19:0/3611920184 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c400adb0 con 0x56379fe45a90 2024-09-12T01:57:40.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.881+0000 7f55aaffd640 1 -- 172.21.15.19:0/3611920184 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7f55c4057b70 con 0x56379fe45a90 2024-09-12T01:57:40.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.881+0000 7f55d57c5740 1 -- 172.21.15.19:0/3611920184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55c4054d90 con 0x56379fe45a90 2024-09-12T01:57:40.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.881+0000 7f55aaffd640 1 -- 172.21.15.19:0/3611920184 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f55c4057d70 con 0x56379fe45a90 2024-09-12T01:57:40.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.881+0000 7f55d57c5740 10 client.5268 fetch_fsmap learned FSMap version 20 2024-09-12T01:57:40.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.881+0000 7f55d57c5740 1 -- 172.21.15.19:0/3611920184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x56379fbbfea0 con 0x56379fe45a90 2024-09-12T01:57:40.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.881+0000 7f55aaffd640 1 -- 172.21.15.19:0/3611920184 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c4054d90 con 0x56379fe45a90 2024-09-12T01:57:40.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.881+0000 7f55aaffd640 1 -- 172.21.15.19:0/3611920184 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7f55c4084030 con 0x56379fe45a90 2024-09-12T01:57:40.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.881+0000 7f55d57c5740 10 client.5268 fetch_fsmap finished waiting for FSMap version 20 2024-09-12T01:57:40.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.881+0000 7f55d57c5740 10 client.5268 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T01:57:40.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.881+0000 7f55d57c5740 20 client.5268 populate_metadata read hostname 'smithi019' 2024-09-12T01:57:40.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.881+0000 7f55d57c5740 1 --2- 172.21.15.19:0/3611920184 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x56379fe75f60 0x56379fe59b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.881+0000 7f55d57c5740 4 client.5268 mds_command: new command op to 5088 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:40.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.881+0000 7f55d57c5740 1 -- 172.21.15.19:0/3611920184 --> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56379fd8e000 con 0x56379fe75f60 2024-09-12T01:57:40.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.881+0000 7f55cbfff640 1 --2- 172.21.15.19:0/3611920184 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x56379fe75f60 0x56379fe59b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.881+0000 7f55aaffd640 10 client.5268 ms_handle_connect on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:40.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.881+0000 7f55cbfff640 1 --2- 172.21.15.19:0/3611920184 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x56379fe75f60 0x56379fe59b90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d1b9cac8b27eedf server_cookie=dff961ca5b245a44 in_seq=0 out_seq=0 2024-09-12T01:57:40.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.882+0000 7f55aaffd640 1 -- 172.21.15.19:0/3611920184 <== mds.0 v2:172.21.15.19:6832/3554496273 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56379fd8e000 con 0x56379fe75f60 2024-09-12T01:57:40.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.882+0000 7f55aaffd640 10 client.5268 handle_command_reply: tid=0 2024-09-12T01:57:40.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.882+0000 7f55d57c5740 1 client.5268 shutdown 2024-09-12T01:57:40.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.882+0000 7f55d57c5740 1 -- 172.21.15.19:0/3611920184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 msgr2=0x56379fe47250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.882+0000 7f55d57c5740 1 --2- 172.21.15.19:0/3611920184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 0x56379fe47250 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f55c4058420 tx=0x7f55c405b040 comp rx=0 tx=0).stop 2024-09-12T01:57:40.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.882+0000 7f55d57c5740 1 -- 172.21.15.19:0/3611920184 shutdown_connections 2024-09-12T01:57:40.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.882+0000 7f55d57c5740 1 --2- 172.21.15.19:0/3611920184 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x56379fe75f60 0x56379fe59b90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.882+0000 7f55d57c5740 1 --2- 172.21.15.19:0/3611920184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 0x56379fe47250 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.882+0000 7f55d57c5740 1 --2- 172.21.15.19:0/3611920184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe63ea0 0x56379fe5c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.882+0000 7f55d57c5740 1 --2- 172.21.15.19:0/3611920184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe61ac0 0x56379fe42bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.882+0000 7f55d57c5740 1 -- 172.21.15.19:0/3611920184 >> 172.21.15.19:0/3611920184 conn(0x56379fe61660 msgr2=0x56379fe16ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:40.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.882+0000 7f55aaffd640 0 client.5268 ms_handle_reset on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:40.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.882+0000 7f55d57c5740 1 -- 172.21.15.19:0/3611920184 shutdown_connections 2024-09-12T01:57:40.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.882+0000 7f55d57c5740 1 -- 172.21.15.19:0/3611920184 wait complete. 2024-09-12T01:57:40.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.882+0000 7f55d57c5740 20 client.5268 trim_cache size 0 max 16384 2024-09-12T01:57:40.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.896+0000 7f55d57c5740 1 Processor -- start 2024-09-12T01:57:40.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.896+0000 7f55d57c5740 1 -- start start 2024-09-12T01:57:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.896+0000 7f55d57c5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 0x56379fe5cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55d57c5740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe61ac0 0x56379fe580e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55d57c5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe63ea0 0x56379fe58620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55d57c5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f55cc2001e0 con 0x56379fe45a90 2024-09-12T01:57:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55d57c5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55cc0b26e0 con 0x56379fe63ea0 2024-09-12T01:57:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55d57c5740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f55cc1f8920 con 0x56379fe61ac0 2024-09-12T01:57:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55cbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 0x56379fe5cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55cbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 0x56379fe5cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39776/0 (socket says 172.21.15.19:39776) 2024-09-12T01:57:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55cbfff640 1 -- 172.21.15.19:0/2281497697 learned_addr learned my addr 172.21.15.19:0/2281497697 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55cb7fe640 1 --2- 172.21.15.19:0/2281497697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe61ac0 0x56379fe580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55d0ee8640 1 --2- 172.21.15.19:0/2281497697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe63ea0 0x56379fe58620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55cbfff640 1 -- 172.21.15.19:0/2281497697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe61ac0 msgr2=0x56379fe580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55cbfff640 1 --2- 172.21.15.19:0/2281497697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe61ac0 0x56379fe580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55cbfff640 1 -- 172.21.15.19:0/2281497697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe63ea0 msgr2=0x56379fe58620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55cbfff640 1 --2- 172.21.15.19:0/2281497697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe63ea0 0x56379fe58620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55cbfff640 1 -- 172.21.15.19:0/2281497697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56379fe59120 con 0x56379fe45a90 2024-09-12T01:57:40.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55cbfff640 1 --2- 172.21.15.19:0/2281497697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 0x56379fe5cf70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00e5a0 tx=0x7f55bc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c9cc0845bfb81f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55b17fa640 1 -- 172.21.15.19:0/2281497697 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc01a040 con 0x56379fe45a90 2024-09-12T01:57:40.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55b17fa640 1 -- 172.21.15.19:0/2281497697 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55bc01b040 con 0x56379fe45a90 2024-09-12T01:57:40.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.897+0000 7f55b17fa640 1 -- 172.21.15.19:0/2281497697 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc013d60 con 0x56379fe45a90 2024-09-12T01:57:40.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.898+0000 7f55d57c5740 1 -- 172.21.15.19:0/2281497697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 msgr2=0x56379fe5cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.898+0000 7f55d57c5740 1 --2- 172.21.15.19:0/2281497697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 0x56379fe5cf70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00e5a0 tx=0x7f55bc014000 comp rx=0 tx=0).stop 2024-09-12T01:57:40.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.898+0000 7f55d57c5740 1 -- 172.21.15.19:0/2281497697 shutdown_connections 2024-09-12T01:57:40.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.898+0000 7f55d57c5740 1 --2- 172.21.15.19:0/2281497697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe63ea0 0x56379fe58620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.898+0000 7f55d57c5740 1 --2- 172.21.15.19:0/2281497697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe61ac0 0x56379fe580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.898+0000 7f55d57c5740 1 --2- 172.21.15.19:0/2281497697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 0x56379fe5cf70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.898+0000 7f55d57c5740 1 -- 172.21.15.19:0/2281497697 >> 172.21.15.19:0/2281497697 conn(0x56379fe61660 msgr2=0x56379fe64860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:40.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.898+0000 7f55d57c5740 1 -- 172.21.15.19:0/2281497697 shutdown_connections 2024-09-12T01:57:40.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.898+0000 7f55d57c5740 1 -- 172.21.15.19:0/2281497697 wait complete. 2024-09-12T01:57:40.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.898+0000 7f55d57c5740 1 -- start start 2024-09-12T01:57:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.899+0000 7f55d57c5740 1 Processor -- start 2024-09-12T01:57:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.899+0000 7f55d57c5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 0x56379fec5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.899+0000 7f55d57c5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe61ac0 0x56379fe580e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.899+0000 7f55d57c5740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe63ea0 0x56379fe58620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.899+0000 7f55d57c5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56379fe605c0 con 0x56379fe45a90 2024-09-12T01:57:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.899+0000 7f55d57c5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56379fe608a0 con 0x56379fe61ac0 2024-09-12T01:57:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.899+0000 7f55d57c5740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56379fd09640 con 0x56379fe63ea0 2024-09-12T01:57:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.899+0000 7f55d57c5740 10 client.0 _ll_register_callbacks cb 0x7f55bc00a1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55cbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 0x56379fec5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55cbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 0x56379fec5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39792/0 (socket says 172.21.15.19:39792) 2024-09-12T01:57:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55cbfff640 1 -- 172.21.15.19:0/2495580724 learned_addr learned my addr 172.21.15.19:0/2495580724 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55cb7fe640 1 --2- 172.21.15.19:0/2495580724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe61ac0 0x56379fe580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55d0ee8640 1 --2- 172.21.15.19:0/2495580724 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe63ea0 0x56379fe58620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55cbfff640 1 -- 172.21.15.19:0/2495580724 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe63ea0 msgr2=0x56379fe58620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55cbfff640 1 --2- 172.21.15.19:0/2495580724 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe63ea0 0x56379fe58620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55cbfff640 1 -- 172.21.15.19:0/2495580724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe61ac0 msgr2=0x56379fe580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55cbfff640 1 --2- 172.21.15.19:0/2495580724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe61ac0 0x56379fe580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55cbfff640 1 -- 172.21.15.19:0/2495580724 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56379fa53000 con 0x56379fe45a90 2024-09-12T01:57:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55cbfff640 1 --2- 172.21.15.19:0/2495580724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 0x56379fec5220 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f55bc024040 tx=0x7f55bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e45bdc3d0468423 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:57:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55aaffd640 1 -- 172.21.15.19:0/2495580724 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc01a040 con 0x56379fe45a90 2024-09-12T01:57:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55aaffd640 1 -- 172.21.15.19:0/2495580724 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7f55bc005d60 con 0x56379fe45a90 2024-09-12T01:57:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55d57c5740 1 -- 172.21.15.19:0/2495580724 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55bc01b040 con 0x56379fe45a90 2024-09-12T01:57:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55aaffd640 1 -- 172.21.15.19:0/2495580724 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f55bc006040 con 0x56379fe45a90 2024-09-12T01:57:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55d57c5740 10 client.5274 fetch_fsmap learned FSMap version 20 2024-09-12T01:57:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55d57c5740 1 -- 172.21.15.19:0/2495580724 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x56379fe743c0 con 0x56379fe45a90 2024-09-12T01:57:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.900+0000 7f55aaffd640 1 -- 172.21.15.19:0/2495580724 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55bc01b040 con 0x56379fe45a90 2024-09-12T01:57:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.901+0000 7f55aaffd640 1 -- 172.21.15.19:0/2495580724 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7f55bc0061e0 con 0x56379fe45a90 2024-09-12T01:57:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.901+0000 7f55d57c5740 10 client.5274 fetch_fsmap finished waiting for FSMap version 20 2024-09-12T01:57:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.901+0000 7f55d57c5740 10 client.5274 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T01:57:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.901+0000 7f55d57c5740 20 client.5274 populate_metadata read hostname 'smithi019' 2024-09-12T01:57:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.901+0000 7f55d57c5740 1 --2- 172.21.15.19:0/2495580724 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x56379fe62600 0x56379fe1d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.901+0000 7f55d57c5740 4 client.5274 mds_command: new command op to 5088 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 3691414925}] 2024-09-12T01:57:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.901+0000 7f55d57c5740 1 -- 172.21.15.19:0/2495580724 --> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] -- command(tid 0: {"prefix": "damage rm", "damage_id": 3691414925}) -- 0x56379fd88350 con 0x56379fe62600 2024-09-12T01:57:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.901+0000 7f55cb7fe640 1 --2- 172.21.15.19:0/2495580724 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x56379fe62600 0x56379fe1d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.901+0000 7f55aaffd640 10 client.5274 ms_handle_connect on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.901+0000 7f55cb7fe640 1 --2- 172.21.15.19:0/2495580724 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x56379fe62600 0x56379fe1d0b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32f0788ec734bde3 server_cookie=ccac41364f2d1fb0 in_seq=0 out_seq=0 2024-09-12T01:57:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.901+0000 7f55aaffd640 1 -- 172.21.15.19:0/2495580724 <== mds.0 v2:172.21.15.19:6832/3554496273 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x56379fd88350 con 0x56379fe62600 2024-09-12T01:57:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.901+0000 7f55aaffd640 10 client.5274 handle_command_reply: tid=0 2024-09-12T01:57:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.901+0000 7f55d57c5740 1 client.5274 shutdown 2024-09-12T01:57:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.901+0000 7f55d57c5740 1 -- 172.21.15.19:0/2495580724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 msgr2=0x56379fec5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.901+0000 7f55d57c5740 1 --2- 172.21.15.19:0/2495580724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 0x56379fec5220 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f55bc024040 tx=0x7f55bc004730 comp rx=0 tx=0).stop 2024-09-12T01:57:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.901+0000 7f55d57c5740 1 -- 172.21.15.19:0/2495580724 shutdown_connections 2024-09-12T01:57:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.901+0000 7f55d57c5740 1 --2- 172.21.15.19:0/2495580724 >> [v2:172.21.15.19:6832/3554496273,v1:172.21.15.19:6834/3554496273] conn(0x56379fe62600 0x56379fe1d0b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d57c5740 1 --2- 172.21.15.19:0/2495580724 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56379fe63ea0 0x56379fe58620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d57c5740 1 --2- 172.21.15.19:0/2495580724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56379fe61ac0 0x56379fe580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d57c5740 1 --2- 172.21.15.19:0/2495580724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56379fe45a90 0x56379fec5220 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55aaffd640 0 client.5274 ms_handle_reset on v2:172.21.15.19:6832/3554496273 2024-09-12T01:57:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d57c5740 1 -- 172.21.15.19:0/2495580724 >> 172.21.15.19:0/2495580724 conn(0x56379fe61660 msgr2=0x56379fe65380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d57c5740 1 -- 172.21.15.19:0/2495580724 shutdown_connections 2024-09-12T01:57:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d57c5740 1 -- 172.21.15.19:0/2495580724 wait complete. 2024-09-12T01:57:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d57c5740 20 client.5274 trim_cache size 0 max 16384 2024-09-12T01:57:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d294b640 1 -- 172.21.15.19:0/3326713970 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f55b806be30 msgr2=0x7f55b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d294b640 1 --2- 172.21.15.19:0/3326713970 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f55b806be30 0x7f55b806e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f55bc006fd0 tx=0x7f55bc008040 comp rx=0 tx=0).stop 2024-09-12T01:57:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d294b640 1 -- 172.21.15.19:0/3326713970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55cc160390 msgr2=0x7f55cc141310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d294b640 1 --2- 172.21.15.19:0/3326713970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55cc160390 0x7f55cc141310 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f55c400c7d0 tx=0x7f55c400cc90 comp rx=0 tx=0).stop 2024-09-12T01:57:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d294b640 1 -- 172.21.15.19:0/3326713970 shutdown_connections 2024-09-12T01:57:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d294b640 1 --2- 172.21.15.19:0/3326713970 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f55b806be30 0x7f55b806e2f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d294b640 1 --2- 172.21.15.19:0/3326713970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55cc160390 0x7f55cc141310 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d294b640 1 --2- 172.21.15.19:0/3326713970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55cc159f90 0x7f55cc072170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d294b640 1 --2- 172.21.15.19:0/3326713970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55cc06ff10 0x7f55cc0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d294b640 1 -- 172.21.15.19:0/3326713970 >> 172.21.15.19:0/3326713970 conn(0x7f55cc06bdf0 msgr2=0x7f55cc1586f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d294b640 1 -- 172.21.15.19:0/3326713970 shutdown_connections 2024-09-12T01:57:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40.902+0000 7f55d294b640 1 -- 172.21.15.19:0/3326713970 wait complete. 2024-09-12T01:57:40.914 DEBUG:teuthology.orchestra.run.smithi019:> stdin-killer -- python3 -c ' 2024-09-12T01:57:40.914 DEBUG:teuthology.orchestra.run.smithi019:> import sys 2024-09-12T01:57:40.914 DEBUG:teuthology.orchestra.run.smithi019:> import errno 2024-09-12T01:57:40.914 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T01:57:40.914 DEBUG:teuthology.orchestra.run.smithi019:> try: 2024-09-12T01:57:40.914 DEBUG:teuthology.orchestra.run.smithi019:> f = open("/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged", "w") 2024-09-12T01:57:40.914 DEBUG:teuthology.orchestra.run.smithi019:> f.close() 2024-09-12T01:57:40.914 DEBUG:teuthology.orchestra.run.smithi019:> except IOError as e: 2024-09-12T01:57:40.914 DEBUG:teuthology.orchestra.run.smithi019:> sys.exit(errno.EIO) 2024-09-12T01:57:40.914 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-09-12T01:57:40.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:57:40.994 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:57:40.995 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:57:41.079 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:57:41.124 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:57:41.124 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:57:41.125 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:57:41.125 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:57:41.141 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:57:41.141 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:57:41.197 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:57:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.340+0000 7fd8a4280640 1 Processor -- start 2024-09-12T01:57:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.340+0000 7fd8a4280640 1 -- start start 2024-09-12T01:57:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.341+0000 7fd8a4280640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd89c15b300 0x7fd89c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.341+0000 7fd8a4280640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd89c06f8d0 0x7fd89c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.341+0000 7fd8a4280640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd89c0cdbe0 con 0x7fd89c0cd3f0 2024-09-12T01:57:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.341+0000 7fd8a4280640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd89c0728a0 con 0x7fd89c15b300 2024-09-12T01:57:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.341+0000 7fd8a4280640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd89c0cd900 con 0x7fd89c06f8d0 2024-09-12T01:57:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.341+0000 7fd8a201c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd89c15b300 0x7fd89c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.341+0000 7fd8a201c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd89c15b300 0x7fd89c0cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42890/0 (socket says 172.21.15.19:42890) 2024-09-12T01:57:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.341+0000 7fd8a201c640 1 -- 172.21.15.19:0/3747682528 learned_addr learned my addr 172.21.15.19:0/3747682528 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.341+0000 7fd8a181b640 1 --1- 172.21.15.19:0/3747682528 >> v1:172.21.15.19:6789/0 conn(0x7fd89c0cd3f0 0x7fd89c06f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54742/0 (socket says 172.21.15.19:54742) 2024-09-12T01:57:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.341+0000 7fd8a201c640 1 -- 172.21.15.19:0/3747682528 >> v2:172.21.15.135:3300/0 conn(0x7fd89c06f8d0 msgr2=0x7fd89c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.341+0000 7fd8a201c640 1 --2- 172.21.15.19:0/3747682528 >> v2:172.21.15.135:3300/0 conn(0x7fd89c06f8d0 0x7fd89c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.341+0000 7fd8a201c640 1 -- 172.21.15.19:0/3747682528 >> v1:172.21.15.19:6789/0 conn(0x7fd89c0cd3f0 legacy=0x7fd89c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.341+0000 7fd8a201c640 1 -- 172.21.15.19:0/3747682528 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89c072250 con 0x7fd89c15b300 2024-09-12T01:57:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.341+0000 7fd8a101a640 1 -- 172.21.15.19:0/3747682528 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2329354515 0 0) 0x7fd89c0cdbe0 con 0x7fd89c0cd3f0 2024-09-12T01:57:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.342+0000 7fd8a201c640 1 --2- 172.21.15.19:0/3747682528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd89c15b300 0x7fd89c0cceb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0b38f0 tx=0x7fd89802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78629a71418a7d0a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.342+0000 7fd8a101a640 1 -- 172.21.15.19:0/3747682528 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd898037070 con 0x7fd89c15b300 2024-09-12T01:57:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.342+0000 7fd8a101a640 1 -- 172.21.15.19:0/3747682528 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd898032440 con 0x7fd89c15b300 2024-09-12T01:57:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.342+0000 7fd8a101a640 1 -- 172.21.15.19:0/3747682528 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd898032810 con 0x7fd89c15b300 2024-09-12T01:57:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.343+0000 7fd8a4280640 1 -- 172.21.15.19:0/3747682528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd89c15b300 msgr2=0x7fd89c0cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.343+0000 7fd8a4280640 1 --2- 172.21.15.19:0/3747682528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd89c15b300 0x7fd89c0cceb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0b38f0 tx=0x7fd89802a270 comp rx=0 tx=0).stop 2024-09-12T01:57:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.343+0000 7fd8a4280640 1 -- 172.21.15.19:0/3747682528 shutdown_connections 2024-09-12T01:57:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.343+0000 7fd8a4280640 1 --2- 172.21.15.19:0/3747682528 >> v2:172.21.15.135:3300/0 conn(0x7fd89c06f8d0 0x7fd89c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.343+0000 7fd8a4280640 1 --2- 172.21.15.19:0/3747682528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd89c15b300 0x7fd89c0cceb0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.343+0000 7fd8a4280640 1 -- 172.21.15.19:0/3747682528 >> 172.21.15.19:0/3747682528 conn(0x7fd89c067d70 msgr2=0x7fd89c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.343+0000 7fd8a4280640 1 -- 172.21.15.19:0/3747682528 shutdown_connections 2024-09-12T01:57:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.343+0000 7fd8a4280640 1 -- 172.21.15.19:0/3747682528 wait complete. 2024-09-12T01:57:41.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.344+0000 7fd8a4280640 1 Processor -- start 2024-09-12T01:57:41.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.344+0000 7fd8a4280640 1 -- start start 2024-09-12T01:57:41.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd8a4280640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd89c06f8d0 0x7fd89c0b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd8a4280640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd89c0cd3f0 0x7fd89c157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd8a4280640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd89c15b300 0x7fd89c155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd8a4280640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c0d0160 con 0x7fd89c0cd3f0 2024-09-12T01:57:41.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd8a4280640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c0cffe0 con 0x7fd89c06f8d0 2024-09-12T01:57:41.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd8a4280640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd89c072d30 con 0x7fd89c15b300 2024-09-12T01:57:41.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd8a181b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd89c0cd3f0 0x7fd89c157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd8a181b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd89c0cd3f0 0x7fd89c157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42896/0 (socket says 172.21.15.19:42896) 2024-09-12T01:57:41.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd8a181b640 1 -- 172.21.15.19:0/3838241912 learned_addr learned my addr 172.21.15.19:0/3838241912 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:41.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd8a201c640 1 --2- 172.21.15.19:0/3838241912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd89c06f8d0 0x7fd89c0b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd8a281d640 1 --2- 172.21.15.19:0/3838241912 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd89c15b300 0x7fd89c155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd8a181b640 1 -- 172.21.15.19:0/3838241912 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd89c15b300 msgr2=0x7fd89c155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd8a181b640 1 --2- 172.21.15.19:0/3838241912 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd89c15b300 0x7fd89c155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd8a181b640 1 -- 172.21.15.19:0/3838241912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd89c06f8d0 msgr2=0x7fd89c0b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd8a181b640 1 --2- 172.21.15.19:0/3838241912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd89c06f8d0 0x7fd89c0b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd8a181b640 1 -- 172.21.15.19:0/3838241912 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89c155d70 con 0x7fd89c0cd3f0 2024-09-12T01:57:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd8a281d640 1 --2- 172.21.15.19:0/3838241912 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd89c15b300 0x7fd89c155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd8a181b640 1 --2- 172.21.15.19:0/3838241912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd89c0cd3f0 0x7fd89c157210 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00e990 tx=0x7fd88c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.345+0000 7fd892ffd640 1 -- 172.21.15.19:0/3838241912 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c0072e0 con 0x7fd89c0cd3f0 2024-09-12T01:57:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.346+0000 7fd892ffd640 1 -- 172.21.15.19:0/3838241912 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd88c016020 con 0x7fd89c0cd3f0 2024-09-12T01:57:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.346+0000 7fd8a4280640 1 -- 172.21.15.19:0/3838241912 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89c1578f0 con 0x7fd89c0cd3f0 2024-09-12T01:57:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.346+0000 7fd892ffd640 1 -- 172.21.15.19:0/3838241912 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c0047e0 con 0x7fd89c0cd3f0 2024-09-12T01:57:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.346+0000 7fd8a4280640 1 -- 172.21.15.19:0/3838241912 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd89c157eb0 con 0x7fd89c0cd3f0 2024-09-12T01:57:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.347+0000 7fd8a4280640 1 -- 172.21.15.19:0/3838241912 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd89c15d760 con 0x7fd89c0cd3f0 2024-09-12T01:57:41.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.347+0000 7fd892ffd640 1 -- 172.21.15.19:0/3838241912 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd88c004980 con 0x7fd89c0cd3f0 2024-09-12T01:57:41.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.348+0000 7fd892ffd640 1 --2- 172.21.15.19:0/3838241912 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd88006be30 0x7fd88006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.348+0000 7fd892ffd640 1 -- 172.21.15.19:0/3838241912 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7fd88c08d460 con 0x7fd89c0cd3f0 2024-09-12T01:57:41.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.348+0000 7fd8a201c640 1 --2- 172.21.15.19:0/3838241912 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd88006be30 0x7fd88006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.348+0000 7fd8a201c640 1 --2- 172.21.15.19:0/3838241912 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd88006be30 0x7fd88006e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd898034000 tx=0x7fd89802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:41.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.352+0000 7fd892ffd640 1 -- 172.21.15.19:0/3838241912 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd88c020030 con 0x7fd89c0cd3f0 2024-09-12T01:57:41.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.542+0000 7fd8a4280640 1 -- 172.21.15.19:0/3838241912 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd89c0008d0 con 0x7fd89c0cd3f0 2024-09-12T01:57:41.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.543+0000 7fd892ffd640 1 -- 172.21.15.19:0/3838241912 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v43) ==== 80+0+122 (secure 0 0 0) 0x7fd88c0212b0 con 0x7fd89c0cd3f0 2024-09-12T01:57:41.543 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/1994815169 2024-09-13T01:57:00.902156+0000 2024-09-12T01:57:41.544 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/1994815169 2024-09-13T01:57:00.902156+0000 2024-09-12T01:57:41.544 INFO:teuthology.orchestra.run.smithi019.stderr:listed 2 entries 2024-09-12T01:57:41.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.545+0000 7fd8a4280640 1 -- 172.21.15.19:0/3838241912 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd88006be30 msgr2=0x7fd88006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.545+0000 7fd8a4280640 1 --2- 172.21.15.19:0/3838241912 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd88006be30 0x7fd88006e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd898034000 tx=0x7fd89802e000 comp rx=0 tx=0).stop 2024-09-12T01:57:41.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.545+0000 7fd8a4280640 1 -- 172.21.15.19:0/3838241912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd89c0cd3f0 msgr2=0x7fd89c157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.545+0000 7fd8a4280640 1 --2- 172.21.15.19:0/3838241912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd89c0cd3f0 0x7fd89c157210 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00e990 tx=0x7fd88c00ee50 comp rx=0 tx=0).stop 2024-09-12T01:57:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.545+0000 7fd8a4280640 1 -- 172.21.15.19:0/3838241912 shutdown_connections 2024-09-12T01:57:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.545+0000 7fd8a4280640 1 --2- 172.21.15.19:0/3838241912 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd88006be30 0x7fd88006e2f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.545+0000 7fd8a4280640 1 --2- 172.21.15.19:0/3838241912 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd89c15b300 0x7fd89c155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.545+0000 7fd8a4280640 1 --2- 172.21.15.19:0/3838241912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd89c0cd3f0 0x7fd89c157210 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.545+0000 7fd8a4280640 1 --2- 172.21.15.19:0/3838241912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd89c06f8d0 0x7fd89c0b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.545+0000 7fd8a4280640 1 -- 172.21.15.19:0/3838241912 >> 172.21.15.19:0/3838241912 conn(0x7fd89c067d70 msgr2=0x7fd89c15c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.545+0000 7fd8a4280640 1 -- 172.21.15.19:0/3838241912 shutdown_connections 2024-09-12T01:57:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.545+0000 7fd8a4280640 1 -- 172.21.15.19:0/3838241912 wait complete. 2024-09-12T01:57:41.556 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:57:41.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:41.557 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:57:41.586 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:57:41.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:41.586 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:57:41.642 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:57:41.642 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:57:41.642 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:57:41.662 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:57:41.662 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:57:41.662 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:57:41.662 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:57:41.698 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:57:41.698 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:57:41.698 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:57:41.698 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:57:41.721 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:57:41.721 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:57:41.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.840+0000 7f315543c640 1 Processor -- start 2024-09-12T01:57:41.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.840+0000 7f315543c640 1 -- start start 2024-09-12T01:57:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.840+0000 7f315543c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3150072dc0 0x7f31500cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.840+0000 7f315543c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f315015c770 0x7f315015cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.840+0000 7f315543c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315015d0e0 con 0x7f31500ce940 2024-09-12T01:57:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.840+0000 7f315543c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f31500cd630 con 0x7f315015c770 2024-09-12T01:57:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.840+0000 7f315543c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f31500b4f20 con 0x7f3150072dc0 2024-09-12T01:57:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314effd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f31500ce940 0x7f31500726b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54752/0 (socket says 172.21.15.19:54752) 2024-09-12T01:57:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314effd640 1 -- 172.21.15.19:0/1402749541 learned_addr learned my addr 172.21.15.19:0/1402749541 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314dffb640 1 -- 172.21.15.19:0/1402749541 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2093010367 0 0) 0x7f315015d0e0 con 0x7f31500ce940 2024-09-12T01:57:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314f7fe640 1 --2- 172.21.15.19:0/1402749541 >> v2:172.21.15.135:3300/0 conn(0x7f315015c770 0x7f315015cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314e7fc640 1 --2- 172.21.15.19:0/1402749541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3150072dc0 0x7f31500cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314dffb640 1 -- 172.21.15.19:0/1402749541 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f313c003520 con 0x7f31500ce940 2024-09-12T01:57:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314dffb640 1 -- 172.21.15.19:0/1402749541 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1245088223 0 0) 0x7f313c003520 con 0x7f31500ce940 2024-09-12T01:57:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314dffb640 1 -- 172.21.15.19:0/1402749541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3150072dc0 msgr2=0x7f31500cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314dffb640 1 --2- 172.21.15.19:0/1402749541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3150072dc0 0x7f31500cdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314dffb640 1 -- 172.21.15.19:0/1402749541 >> v2:172.21.15.135:3300/0 conn(0x7f315015c770 msgr2=0x7f315015cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314dffb640 1 --2- 172.21.15.19:0/1402749541 >> v2:172.21.15.135:3300/0 conn(0x7f315015c770 0x7f315015cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314dffb640 1 -- 172.21.15.19:0/1402749541 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315015d350 con 0x7f31500ce940 2024-09-12T01:57:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314dffb640 1 -- 172.21.15.19:0/1402749541 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f31400019f0 con 0x7f31500ce940 2024-09-12T01:57:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314dffb640 1 -- 172.21.15.19:0/1402749541 >> v1:172.21.15.19:6789/0 conn(0x7f31500ce940 legacy=0x7f31500726b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314dffb640 1 --2- 172.21.15.19:0/1402749541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f313c0039b0 0x7f313c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314dffb640 1 --2- 172.21.15.19:0/1402749541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f313c004800 0x7f313c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314dffb640 1 --2- 172.21.15.19:0/1402749541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3150072dc0 0x7f313c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314dffb640 1 -- 172.21.15.19:0/1402749541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f31500cd630 con 0x7f313c0039b0 2024-09-12T01:57:41.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314dffb640 1 -- 172.21.15.19:0/1402749541 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f31500b4f20 con 0x7f313c004800 2024-09-12T01:57:41.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314dffb640 1 -- 172.21.15.19:0/1402749541 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f313c00fdd0 con 0x7f3150072dc0 2024-09-12T01:57:41.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.841+0000 7f314effd640 1 --2- 172.21.15.19:0/1402749541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f313c0039b0 0x7f313c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.842+0000 7f314e7fc640 1 --2- 172.21.15.19:0/1402749541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f313c004800 0x7f313c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.842+0000 7f314f7fe640 1 --2- 172.21.15.19:0/1402749541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3150072dc0 0x7f313c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.842+0000 7f314effd640 1 -- 172.21.15.19:0/1402749541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3150072dc0 msgr2=0x7f313c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.842+0000 7f314effd640 1 --2- 172.21.15.19:0/1402749541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3150072dc0 0x7f313c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.842+0000 7f314effd640 1 -- 172.21.15.19:0/1402749541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f313c004800 msgr2=0x7f313c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.842+0000 7f314effd640 1 --2- 172.21.15.19:0/1402749541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f313c004800 0x7f313c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.842+0000 7f314effd640 1 -- 172.21.15.19:0/1402749541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313c003520 con 0x7f313c0039b0 2024-09-12T01:57:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.842+0000 7f314e7fc640 1 --2- 172.21.15.19:0/1402749541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f313c004800 0x7f313c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.842+0000 7f314effd640 1 --2- 172.21.15.19:0/1402749541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f313c0039b0 0x7f313c003dd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f314000a870 tx=0x7f313c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ceb7d829d75558 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.843+0000 7f314dffb640 1 -- 172.21.15.19:0/1402749541 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314000a4c0 con 0x7f313c0039b0 2024-09-12T01:57:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.843+0000 7f314dffb640 1 -- 172.21.15.19:0/1402749541 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f314002f070 con 0x7f313c0039b0 2024-09-12T01:57:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.843+0000 7f314dffb640 1 -- 172.21.15.19:0/1402749541 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314002bcc0 con 0x7f313c0039b0 2024-09-12T01:57:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.843+0000 7f315543c640 1 -- 172.21.15.19:0/1402749541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f313c0039b0 msgr2=0x7f313c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.843+0000 7f315543c640 1 --2- 172.21.15.19:0/1402749541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f313c0039b0 0x7f313c003dd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f314000a870 tx=0x7f313c005830 comp rx=0 tx=0).stop 2024-09-12T01:57:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.843+0000 7f314f7fe640 1 -- 172.21.15.19:0/1402749541 reap_dead start 2024-09-12T01:57:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.843+0000 7f315543c640 1 -- 172.21.15.19:0/1402749541 shutdown_connections 2024-09-12T01:57:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.843+0000 7f315543c640 1 -- 172.21.15.19:0/1402749541 >> 172.21.15.19:0/1402749541 conn(0x7f315006c030 msgr2=0x7f315006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.843+0000 7f315543c640 1 -- 172.21.15.19:0/1402749541 shutdown_connections 2024-09-12T01:57:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.843+0000 7f315543c640 1 -- 172.21.15.19:0/1402749541 wait complete. 2024-09-12T01:57:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.845+0000 7f315543c640 1 Processor -- start 2024-09-12T01:57:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.845+0000 7f315543c640 1 -- start start 2024-09-12T01:57:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.845+0000 7f315543c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f313c0039b0 0x7f315014bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.845+0000 7f315543c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315006f840 0x7f315014dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.845+0000 7f315543c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f315014ae60 0x7f315015fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.845+0000 7f315543c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f31500cd2c0 con 0x7f315014ae60 2024-09-12T01:57:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.845+0000 7f315543c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f31500ccfe0 con 0x7f315006f840 2024-09-12T01:57:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.845+0000 7f315543c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f31500ced20 con 0x7f313c0039b0 2024-09-12T01:57:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.845+0000 7f314f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f315014ae60 0x7f315015fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.845+0000 7f314f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f315014ae60 0x7f315015fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42918/0 (socket says 172.21.15.19:42918) 2024-09-12T01:57:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.845+0000 7f314f7fe640 1 -- 172.21.15.19:0/1282053582 learned_addr learned my addr 172.21.15.19:0/1282053582 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.846+0000 7f314effd640 1 --2- 172.21.15.19:0/1282053582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f313c0039b0 0x7f315014bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.846+0000 7f314e7fc640 1 --2- 172.21.15.19:0/1282053582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315006f840 0x7f315014dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.846+0000 7f314f7fe640 1 -- 172.21.15.19:0/1282053582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f313c0039b0 msgr2=0x7f315014bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.846+0000 7f314f7fe640 1 --2- 172.21.15.19:0/1282053582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f313c0039b0 0x7f315014bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.846+0000 7f314f7fe640 1 -- 172.21.15.19:0/1282053582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315006f840 msgr2=0x7f315014dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.846+0000 7f314f7fe640 1 --2- 172.21.15.19:0/1282053582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315006f840 0x7f315014dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.846+0000 7f314f7fe640 1 -- 172.21.15.19:0/1282053582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315006fdb0 con 0x7f315014ae60 2024-09-12T01:57:41.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.846+0000 7f314f7fe640 1 --2- 172.21.15.19:0/1282053582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f315014ae60 0x7f315015fad0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f31500b5690 tx=0x7f3148011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:41.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.846+0000 7f31477fe640 1 -- 172.21.15.19:0/1282053582 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148019020 con 0x7f315014ae60 2024-09-12T01:57:41.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.846+0000 7f31477fe640 1 -- 172.21.15.19:0/1282053582 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3148004240 con 0x7f315014ae60 2024-09-12T01:57:41.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.846+0000 7f31477fe640 1 -- 172.21.15.19:0/1282053582 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314800f7a0 con 0x7f315014ae60 2024-09-12T01:57:41.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.846+0000 7f315543c640 1 -- 172.21.15.19:0/1282053582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3150070090 con 0x7f315014ae60 2024-09-12T01:57:41.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.846+0000 7f315543c640 1 -- 172.21.15.19:0/1282053582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3150153a30 con 0x7f315014ae60 2024-09-12T01:57:41.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.847+0000 7f315543c640 1 -- 172.21.15.19:0/1282053582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3150153580 con 0x7f315014ae60 2024-09-12T01:57:41.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.848+0000 7f31477fe640 1 -- 172.21.15.19:0/1282053582 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f314801c020 con 0x7f315014ae60 2024-09-12T01:57:41.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.848+0000 7f31477fe640 1 --2- 172.21.15.19:0/1282053582 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f313006be30 0x7f313006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.848+0000 7f31477fe640 1 -- 172.21.15.19:0/1282053582 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7f314808b300 con 0x7f315014ae60 2024-09-12T01:57:41.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.848+0000 7f314effd640 1 --2- 172.21.15.19:0/1282053582 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f313006be30 0x7f313006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.849+0000 7f314effd640 1 --2- 172.21.15.19:0/1282053582 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f313006be30 0x7f313006e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3140033000 tx=0x7f3140038040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:41.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:41.852+0000 7f31477fe640 1 -- 172.21.15.19:0/1282053582 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3150153580 con 0x7f315014ae60 2024-09-12T01:57:42.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.065+0000 7f315543c640 1 -- 172.21.15.19:0/1282053582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31500705b0 con 0x7f315014ae60 2024-09-12T01:57:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.066+0000 7f31477fe640 1 -- 172.21.15.19:0/1282053582 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5227 (secure 0 0 0) 0x7f3148023020 con 0x7f315014ae60 2024-09-12T01:57:42.066 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:42.066 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"btime":"2024-09-12T01:57:04:677301+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1979542220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1979542220},{"type":"v1","addr":"172.21.15.135:6836","nonce":1979542220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/809710386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":809710386},{"type":"v1","addr":"172.21.15.19:6835","nonce":809710386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1005776280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1005776280},{"type":"v1","addr":"172.21.15.135:6837","nonce":1005776280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:56:48.431829+0000","modified":"2024-09-12T01:57:04.677295+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6834/3554496273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3554496273},{"type":"v1","addr":"172.21.15.19:6834","nonce":3554496273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5088,"qdb_cluster":[5088]},"id":2}]} 2024-09-12T01:57:42.067 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 20 2024-09-12T01:57:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.068+0000 7f315543c640 1 -- 172.21.15.19:0/1282053582 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f313006be30 msgr2=0x7f313006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.068+0000 7f315543c640 1 --2- 172.21.15.19:0/1282053582 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f313006be30 0x7f313006e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3140033000 tx=0x7f3140038040 comp rx=0 tx=0).stop 2024-09-12T01:57:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.068+0000 7f315543c640 1 -- 172.21.15.19:0/1282053582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f315014ae60 msgr2=0x7f315015fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.068+0000 7f315543c640 1 --2- 172.21.15.19:0/1282053582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f315014ae60 0x7f315015fad0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f31500b5690 tx=0x7f3148011cf0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.068+0000 7f315543c640 1 -- 172.21.15.19:0/1282053582 shutdown_connections 2024-09-12T01:57:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.068+0000 7f315543c640 1 --2- 172.21.15.19:0/1282053582 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f313006be30 0x7f313006e2f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.068+0000 7f315543c640 1 --2- 172.21.15.19:0/1282053582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f315014ae60 0x7f315015fad0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.068+0000 7f315543c640 1 --2- 172.21.15.19:0/1282053582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315006f840 0x7f315014dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.068+0000 7f315543c640 1 --2- 172.21.15.19:0/1282053582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f313c0039b0 0x7f315014bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.068+0000 7f315543c640 1 -- 172.21.15.19:0/1282053582 >> 172.21.15.19:0/1282053582 conn(0x7f315006c030 msgr2=0x7f315006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.068+0000 7f315543c640 1 -- 172.21.15.19:0/1282053582 shutdown_connections 2024-09-12T01:57:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.068+0000 7f315543c640 1 -- 172.21.15.19:0/1282053582 wait complete. 2024-09-12T01:57:42.080 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:57:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.181+0000 7f80e76f1640 1 Processor -- start 2024-09-12T01:57:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.181+0000 7f80e76f1640 1 -- start start 2024-09-12T01:57:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.182+0000 7f80e76f1640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f80e0147230 0x7f80e006e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.182+0000 7f80e76f1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80e00727c0 0x7f80e00aee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.182+0000 7f80e76f1640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e006f480 con 0x7f80e0147e90 2024-09-12T01:57:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.182+0000 7f80e76f1640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f80e00b34d0 con 0x7f80e0147230 2024-09-12T01:57:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.182+0000 7f80e76f1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f80e00ae9e0 con 0x7f80e00727c0 2024-09-12T01:57:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.182+0000 7f80e548d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f80e0147230 0x7f80e006e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.182+0000 7f80e5c8e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80e00727c0 0x7f80e00aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.182+0000 7f80e548d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f80e0147230 0x7f80e006e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:43570/0 (socket says 172.21.15.19:43570) 2024-09-12T01:57:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.182+0000 7f80e4c8c640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f80e0147e90 0x7f80e00720b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:53066/0 (socket says 172.21.15.19:53066) 2024-09-12T01:57:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.183+0000 7f80e548d640 1 -- 172.21.15.19:0/2733765677 learned_addr learned my addr 172.21.15.19:0/2733765677 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.182+0000 7f80e5c8e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80e00727c0 0x7f80e00aee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:50394/0 (socket says 172.21.15.19:50394) 2024-09-12T01:57:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.183+0000 7f80e548d640 1 -- 172.21.15.19:0/2733765677 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80e00727c0 msgr2=0x7f80e00aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.183+0000 7f80e548d640 1 --2- 172.21.15.19:0/2733765677 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80e00727c0 0x7f80e00aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.183+0000 7f80e548d640 1 -- 172.21.15.19:0/2733765677 >> v1:172.21.15.135:6789/0 conn(0x7f80e0147e90 legacy=0x7f80e00720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.183+0000 7f80e548d640 1 -- 172.21.15.19:0/2733765677 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e006e900 con 0x7f80e0147230 2024-09-12T01:57:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.183+0000 7f80e5c8e640 1 --2- 172.21.15.19:0/2733765677 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80e00727c0 0x7f80e00aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:42.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.184+0000 7f80e548d640 1 --2- 172.21.15.19:0/2733765677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80e0147230 0x7f80e006e0b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009e50 tx=0x7f80d002a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=939a02ce79f6de23 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:42.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.184+0000 7f80dffff640 1 -- 172.21.15.19:0/2733765677 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0036070 con 0x7f80e0147230 2024-09-12T01:57:42.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.184+0000 7f80dffff640 1 -- 172.21.15.19:0/2733765677 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d0031600 con 0x7f80e0147230 2024-09-12T01:57:42.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.184+0000 7f80dffff640 1 -- 172.21.15.19:0/2733765677 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d00319d0 con 0x7f80e0147230 2024-09-12T01:57:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.184+0000 7f80e76f1640 1 -- 172.21.15.19:0/2733765677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80e0147230 msgr2=0x7f80e006e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.184+0000 7f80e76f1640 1 --2- 172.21.15.19:0/2733765677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80e0147230 0x7f80e006e0b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009e50 tx=0x7f80d002a730 comp rx=0 tx=0).stop 2024-09-12T01:57:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.184+0000 7f80e76f1640 1 -- 172.21.15.19:0/2733765677 shutdown_connections 2024-09-12T01:57:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.184+0000 7f80e76f1640 1 --2- 172.21.15.19:0/2733765677 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80e00727c0 0x7f80e00aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.184+0000 7f80e76f1640 1 --2- 172.21.15.19:0/2733765677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80e0147230 0x7f80e006e0b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.184+0000 7f80e76f1640 1 -- 172.21.15.19:0/2733765677 >> 172.21.15.19:0/2733765677 conn(0x7f80e0067d70 msgr2=0x7f80e006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.184+0000 7f80e76f1640 1 -- 172.21.15.19:0/2733765677 shutdown_connections 2024-09-12T01:57:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.185+0000 7f80e76f1640 1 -- 172.21.15.19:0/2733765677 wait complete. 2024-09-12T01:57:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.186+0000 7f80e76f1640 1 Processor -- start 2024-09-12T01:57:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.186+0000 7f80e76f1640 1 -- start start 2024-09-12T01:57:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.186+0000 7f80e76f1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80e00727c0 0x7f80e01f3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.186+0000 7f80e76f1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80e0147230 0x7f80e00cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.186+0000 7f80e76f1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80e0147e90 0x7f80e0160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.186+0000 7f80e76f1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f80e006f1a0 con 0x7f80e0147e90 2024-09-12T01:57:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.186+0000 7f80e76f1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f80e006eec0 con 0x7f80e00727c0 2024-09-12T01:57:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.186+0000 7f80e76f1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f80e006e5f0 con 0x7f80e0147230 2024-09-12T01:57:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.187+0000 7f80e5c8e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80e0147e90 0x7f80e0160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.187+0000 7f80e5c8e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80e0147e90 0x7f80e0160600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42934/0 (socket says 172.21.15.19:42934) 2024-09-12T01:57:42.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.187+0000 7f80e5c8e640 1 -- 172.21.15.19:0/1806524030 learned_addr learned my addr 172.21.15.19:0/1806524030 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:42.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.187+0000 7f80e548d640 1 --2- 172.21.15.19:0/1806524030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80e00727c0 0x7f80e01f3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.187+0000 7f80e4c8c640 1 --2- 172.21.15.19:0/1806524030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80e0147230 0x7f80e00cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.187+0000 7f80e5c8e640 1 -- 172.21.15.19:0/1806524030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80e0147230 msgr2=0x7f80e00cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.187+0000 7f80e5c8e640 1 --2- 172.21.15.19:0/1806524030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80e0147230 0x7f80e00cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.187+0000 7f80e5c8e640 1 -- 172.21.15.19:0/1806524030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80e00727c0 msgr2=0x7f80e01f3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.187+0000 7f80e5c8e640 1 --2- 172.21.15.19:0/1806524030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80e00727c0 0x7f80e01f3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.187+0000 7f80e5c8e640 1 -- 172.21.15.19:0/1806524030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e01e6c40 con 0x7f80e0147e90 2024-09-12T01:57:42.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.187+0000 7f80e5c8e640 1 --2- 172.21.15.19:0/1806524030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80e0147e90 0x7f80e0160600 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f80d800e900 tx=0x7f80d800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:42.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.187+0000 7f80ddffb640 1 -- 172.21.15.19:0/1806524030 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8017070 con 0x7f80e0147e90 2024-09-12T01:57:42.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.187+0000 7f80ddffb640 1 -- 172.21.15.19:0/1806524030 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d800ca00 con 0x7f80e0147e90 2024-09-12T01:57:42.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.187+0000 7f80ddffb640 1 -- 172.21.15.19:0/1806524030 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d800cdf0 con 0x7f80e0147e90 2024-09-12T01:57:42.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.187+0000 7f80e76f1640 1 -- 172.21.15.19:0/1806524030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e01e71d0 con 0x7f80e0147e90 2024-09-12T01:57:42.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.188+0000 7f80e76f1640 1 -- 172.21.15.19:0/1806524030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e01e7790 con 0x7f80e0147e90 2024-09-12T01:57:42.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.189+0000 7f80e76f1640 1 -- 172.21.15.19:0/1806524030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e0147610 con 0x7f80e0147e90 2024-09-12T01:57:42.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.189+0000 7f80ddffb640 1 -- 172.21.15.19:0/1806524030 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f80d801a070 con 0x7f80e0147e90 2024-09-12T01:57:42.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.190+0000 7f80ddffb640 1 --2- 172.21.15.19:0/1806524030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f80cc06be30 0x7f80cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.190+0000 7f80ddffb640 1 -- 172.21.15.19:0/1806524030 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7f80d808af00 con 0x7f80e0147e90 2024-09-12T01:57:42.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.190+0000 7f80e548d640 1 --2- 172.21.15.19:0/1806524030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f80cc06be30 0x7f80cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.190+0000 7f80e548d640 1 --2- 172.21.15.19:0/1806524030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f80cc06be30 0x7f80cc06e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f80d0033000 tx=0x7f80d0009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:42.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.194+0000 7f80ddffb640 1 -- 172.21.15.19:0/1806524030 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f80d8059060 con 0x7f80e0147e90 2024-09-12T01:57:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.410+0000 7f80e76f1640 1 -- 172.21.15.19:0/1806524030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80e00b5400 con 0x7f80e0147e90 2024-09-12T01:57:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.411+0000 7f80ddffb640 1 -- 172.21.15.19:0/1806524030 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5227 (secure 0 0 0) 0x7f80d805d360 con 0x7f80e0147e90 2024-09-12T01:57:42.411 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:42.412 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"btime":"2024-09-12T01:57:04:677301+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1979542220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1979542220},{"type":"v1","addr":"172.21.15.135:6836","nonce":1979542220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/809710386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":809710386},{"type":"v1","addr":"172.21.15.19:6835","nonce":809710386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1005776280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1005776280},{"type":"v1","addr":"172.21.15.135:6837","nonce":1005776280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:56:48.431829+0000","modified":"2024-09-12T01:57:04.677295+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6834/3554496273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3554496273},{"type":"v1","addr":"172.21.15.19:6834","nonce":3554496273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5088,"qdb_cluster":[5088]},"id":2}]} 2024-09-12T01:57:42.412 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 20 2024-09-12T01:57:42.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.413+0000 7f80e76f1640 1 -- 172.21.15.19:0/1806524030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f80cc06be30 msgr2=0x7f80cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.413+0000 7f80e76f1640 1 --2- 172.21.15.19:0/1806524030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f80cc06be30 0x7f80cc06e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f80d0033000 tx=0x7f80d0009000 comp rx=0 tx=0).stop 2024-09-12T01:57:42.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.413+0000 7f80e76f1640 1 -- 172.21.15.19:0/1806524030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80e0147e90 msgr2=0x7f80e0160600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.413+0000 7f80e76f1640 1 --2- 172.21.15.19:0/1806524030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80e0147e90 0x7f80e0160600 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f80d800e900 tx=0x7f80d800edc0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.413+0000 7f80e76f1640 1 -- 172.21.15.19:0/1806524030 shutdown_connections 2024-09-12T01:57:42.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.413+0000 7f80e76f1640 1 --2- 172.21.15.19:0/1806524030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f80cc06be30 0x7f80cc06e2f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.413+0000 7f80e76f1640 1 --2- 172.21.15.19:0/1806524030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80e0147e90 0x7f80e0160600 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.413+0000 7f80e76f1640 1 --2- 172.21.15.19:0/1806524030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80e0147230 0x7f80e00cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.413+0000 7f80e76f1640 1 --2- 172.21.15.19:0/1806524030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80e00727c0 0x7f80e01f3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.413+0000 7f80e76f1640 1 -- 172.21.15.19:0/1806524030 >> 172.21.15.19:0/1806524030 conn(0x7f80e0067d70 msgr2=0x7f80e00af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:42.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.413+0000 7f80e76f1640 1 -- 172.21.15.19:0/1806524030 shutdown_connections 2024-09-12T01:57:42.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.413+0000 7f80e76f1640 1 -- 172.21.15.19:0/1806524030 wait complete. 2024-09-12T01:57:42.425 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:57:42.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.526+0000 7f55bbcb7640 1 Processor -- start 2024-09-12T01:57:42.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.526+0000 7f55bbcb7640 1 -- start start 2024-09-12T01:57:42.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.527+0000 7f55bbcb7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f55b4161c80 0x7f55b406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.527+0000 7f55bbcb7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f55b4162060 0x7f55b40b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.527+0000 7f55bbcb7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55b406e870 con 0x7f55b40b64b0 2024-09-12T01:57:42.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.527+0000 7f55bbcb7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f55b406d9f0 con 0x7f55b4162060 2024-09-12T01:57:42.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.527+0000 7f55bbcb7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f55b406dcd0 con 0x7f55b4161c80 2024-09-12T01:57:42.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.527+0000 7f55b9252640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f55b4162060 0x7f55b40b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.527+0000 7f55ba254640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f55b40b64b0 0x7f55b4162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54768/0 (socket says 172.21.15.19:54768) 2024-09-12T01:57:42.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.527+0000 7f55b9252640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f55b4162060 0x7f55b40b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42942/0 (socket says 172.21.15.19:42942) 2024-09-12T01:57:42.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.527+0000 7f55ba254640 1 -- 172.21.15.19:0/1442781344 learned_addr learned my addr 172.21.15.19:0/1442781344 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:42.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.527+0000 7f55b9a53640 1 --2- 172.21.15.19:0/1442781344 >> v2:172.21.15.135:3300/0 conn(0x7f55b4161c80 0x7f55b406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.527+0000 7f55b9252640 1 -- 172.21.15.19:0/1442781344 >> v2:172.21.15.135:3300/0 conn(0x7f55b4161c80 msgr2=0x7f55b406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:42.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.527+0000 7f55b9252640 1 --2- 172.21.15.19:0/1442781344 >> v2:172.21.15.135:3300/0 conn(0x7f55b4161c80 0x7f55b406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.527+0000 7f55b9252640 1 -- 172.21.15.19:0/1442781344 >> v1:172.21.15.19:6789/0 conn(0x7f55b40b64b0 legacy=0x7f55b4162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.528+0000 7f55b9252640 1 -- 172.21.15.19:0/1442781344 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b406dfb0 con 0x7f55b4162060 2024-09-12T01:57:42.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.527+0000 7f55b8a51640 1 -- 172.21.15.19:0/1442781344 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 242114371 0 0) 0x7f55ac001490 con 0x7f55b40b64b0 2024-09-12T01:57:42.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.528+0000 7f55b9252640 1 --2- 172.21.15.19:0/1442781344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55b4162060 0x7f55b40b5f70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f55b408d7a0 tx=0x7f55a402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92293522561c64f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:42.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.528+0000 7f55b8a51640 1 -- 172.21.15.19:0/1442781344 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4037070 con 0x7f55b4162060 2024-09-12T01:57:42.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.528+0000 7f55b8a51640 1 -- 172.21.15.19:0/1442781344 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a4032440 con 0x7f55b4162060 2024-09-12T01:57:42.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.528+0000 7f55b8a51640 1 -- 172.21.15.19:0/1442781344 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4032810 con 0x7f55b4162060 2024-09-12T01:57:42.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.529+0000 7f55bbcb7640 1 -- 172.21.15.19:0/1442781344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55b4162060 msgr2=0x7f55b40b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.529+0000 7f55bbcb7640 1 --2- 172.21.15.19:0/1442781344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55b4162060 0x7f55b40b5f70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f55b408d7a0 tx=0x7f55a402a1a0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.529+0000 7f55bbcb7640 1 -- 172.21.15.19:0/1442781344 shutdown_connections 2024-09-12T01:57:42.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.529+0000 7f55bbcb7640 1 --2- 172.21.15.19:0/1442781344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55b4162060 0x7f55b40b5f70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.529+0000 7f55bbcb7640 1 --2- 172.21.15.19:0/1442781344 >> v2:172.21.15.135:3300/0 conn(0x7f55b4161c80 0x7f55b406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.529+0000 7f55bbcb7640 1 -- 172.21.15.19:0/1442781344 >> 172.21.15.19:0/1442781344 conn(0x7f55b40d44f0 msgr2=0x7f55b40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:42.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.529+0000 7f55bbcb7640 1 -- 172.21.15.19:0/1442781344 shutdown_connections 2024-09-12T01:57:42.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.529+0000 7f55bbcb7640 1 -- 172.21.15.19:0/1442781344 wait complete. 2024-09-12T01:57:42.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.530+0000 7f55bbcb7640 1 Processor -- start 2024-09-12T01:57:42.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.530+0000 7f55bbcb7640 1 -- start start 2024-09-12T01:57:42.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.531+0000 7f55bbcb7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55b40b64b0 0x7f55b4156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.531+0000 7f55bbcb7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55b4161c80 0x7f55b40b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.531+0000 7f55bbcb7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55b4162060 0x7f55b41f77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.531+0000 7f55bbcb7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f55b40d2a10 con 0x7f55b4162060 2024-09-12T01:57:42.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.531+0000 7f55bbcb7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55b40d2890 con 0x7f55b40b64b0 2024-09-12T01:57:42.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.531+0000 7f55bbcb7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f55b40b6960 con 0x7f55b4161c80 2024-09-12T01:57:42.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.531+0000 7f55ba254640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55b4162060 0x7f55b41f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.531+0000 7f55ba254640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55b4162060 0x7f55b41f77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42946/0 (socket says 172.21.15.19:42946) 2024-09-12T01:57:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.531+0000 7f55ba254640 1 -- 172.21.15.19:0/2087905973 learned_addr learned my addr 172.21.15.19:0/2087905973 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.531+0000 7f55b9a53640 1 --2- 172.21.15.19:0/2087905973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55b40b64b0 0x7f55b4156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.531+0000 7f55b9252640 1 --2- 172.21.15.19:0/2087905973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55b4161c80 0x7f55b40b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.531+0000 7f55ba254640 1 -- 172.21.15.19:0/2087905973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55b4161c80 msgr2=0x7f55b40b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.531+0000 7f55ba254640 1 --2- 172.21.15.19:0/2087905973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55b4161c80 0x7f55b40b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.531+0000 7f55ba254640 1 -- 172.21.15.19:0/2087905973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55b40b64b0 msgr2=0x7f55b4156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.531+0000 7f55ba254640 1 --2- 172.21.15.19:0/2087905973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55b40b64b0 0x7f55b4156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.531+0000 7f55ba254640 1 -- 172.21.15.19:0/2087905973 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b41f85f0 con 0x7f55b4162060 2024-09-12T01:57:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.531+0000 7f55b9a53640 1 --2- 172.21.15.19:0/2087905973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55b40b64b0 0x7f55b4156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.531+0000 7f55b9252640 1 --2- 172.21.15.19:0/2087905973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55b4161c80 0x7f55b40b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.532+0000 7f55ba254640 1 --2- 172.21.15.19:0/2087905973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55b4162060 0x7f55b41f77e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f55ac00c7f0 tx=0x7f55ac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.532+0000 7f55aa7fc640 1 -- 172.21.15.19:0/2087905973 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ac018070 con 0x7f55b4162060 2024-09-12T01:57:42.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.532+0000 7f55aa7fc640 1 -- 172.21.15.19:0/2087905973 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55ac00a5e0 con 0x7f55b4162060 2024-09-12T01:57:42.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.532+0000 7f55bbcb7640 1 -- 172.21.15.19:0/2087905973 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55b40cc370 con 0x7f55b4162060 2024-09-12T01:57:42.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.532+0000 7f55aa7fc640 1 -- 172.21.15.19:0/2087905973 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ac00a9d0 con 0x7f55b4162060 2024-09-12T01:57:42.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.532+0000 7f55bbcb7640 1 -- 172.21.15.19:0/2087905973 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55b40cc930 con 0x7f55b4162060 2024-09-12T01:57:42.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.533+0000 7f55bbcb7640 1 -- 172.21.15.19:0/2087905973 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55b41613e0 con 0x7f55b4162060 2024-09-12T01:57:42.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.534+0000 7f55aa7fc640 1 -- 172.21.15.19:0/2087905973 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55ac01b070 con 0x7f55b4162060 2024-09-12T01:57:42.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.534+0000 7f55aa7fc640 1 --2- 172.21.15.19:0/2087905973 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f559806be30 0x7f559806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.534+0000 7f55aa7fc640 1 -- 172.21.15.19:0/2087905973 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7f55ac08a5d0 con 0x7f55b4162060 2024-09-12T01:57:42.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.534+0000 7f55b9a53640 1 --2- 172.21.15.19:0/2087905973 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f559806be30 0x7f559806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.535+0000 7f55b9a53640 1 --2- 172.21.15.19:0/2087905973 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f559806be30 0x7f559806e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f55b0006fd0 tx=0x7f55b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:42.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.538+0000 7f55aa7fc640 1 -- 172.21.15.19:0/2087905973 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f55b41613e0 con 0x7f55b4162060 2024-09-12T01:57:42.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.718+0000 7f55bbcb7640 1 -- 172.21.15.19:0/2087905973 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55b40ba470 con 0x7f55b4162060 2024-09-12T01:57:42.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.719+0000 7f55aa7fc640 1 -- 172.21.15.19:0/2087905973 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+17112 (secure 0 0 0) 0x7f55b406e870 con 0x7f55b4162060 2024-09-12T01:57:42.719 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:42.720 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":43,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:57:38.739542+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:56:46.200850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T01:56:47.416374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.24","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6834/1994815169":"2024-09-13T01:57:00.902156+0000","172.21.15.19:6832/1994815169":"2024-09-13T01:57:00.902156+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:57:42.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.721+0000 7f55bbcb7640 1 -- 172.21.15.19:0/2087905973 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f559806be30 msgr2=0x7f559806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.721+0000 7f55bbcb7640 1 --2- 172.21.15.19:0/2087905973 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f559806be30 0x7f559806e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f55b0006fd0 tx=0x7f55b0008040 comp rx=0 tx=0).stop 2024-09-12T01:57:42.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.721+0000 7f55bbcb7640 1 -- 172.21.15.19:0/2087905973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55b4162060 msgr2=0x7f55b41f77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.721+0000 7f55bbcb7640 1 --2- 172.21.15.19:0/2087905973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55b4162060 0x7f55b41f77e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f55ac00c7f0 tx=0x7f55ac00ccb0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.721+0000 7f55bbcb7640 1 -- 172.21.15.19:0/2087905973 shutdown_connections 2024-09-12T01:57:42.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.721+0000 7f55bbcb7640 1 --2- 172.21.15.19:0/2087905973 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f559806be30 0x7f559806e2f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.721+0000 7f55bbcb7640 1 --2- 172.21.15.19:0/2087905973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55b4162060 0x7f55b41f77e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.721+0000 7f55bbcb7640 1 --2- 172.21.15.19:0/2087905973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55b4161c80 0x7f55b40b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.721+0000 7f55bbcb7640 1 --2- 172.21.15.19:0/2087905973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55b40b64b0 0x7f55b4156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.721+0000 7f55bbcb7640 1 -- 172.21.15.19:0/2087905973 >> 172.21.15.19:0/2087905973 conn(0x7f55b40d44f0 msgr2=0x7f55b406ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:42.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.721+0000 7f55bbcb7640 1 -- 172.21.15.19:0/2087905973 shutdown_connections 2024-09-12T01:57:42.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.721+0000 7f55bbcb7640 1 -- 172.21.15.19:0/2087905973 wait complete. 2024-09-12T01:57:42.733 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T01:57:42.733 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:57:42.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.835+0000 7fe63e7f8640 1 Processor -- start 2024-09-12T01:57:42.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.835+0000 7fe63e7f8640 1 -- start start 2024-09-12T01:57:42.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.836+0000 7fe63e7f8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe638072de0 0x7fe63815d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.836+0000 7fe63e7f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe638072700 0x7fe63815d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.836+0000 7fe63e7f8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe638146140 con 0x7fe638072320 2024-09-12T01:57:42.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.836+0000 7fe63e7f8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe6380cd740 con 0x7fe638072de0 2024-09-12T01:57:42.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.836+0000 7fe63e7f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe6380cda20 con 0x7fe638072700 2024-09-12T01:57:42.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.836+0000 7fe63cd95640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe638072700 0x7fe63815d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.836+0000 7fe6377fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe638072de0 0x7fe63815d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.837+0000 7fe63cd95640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe638072700 0x7fe63815d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:50424/0 (socket says 172.21.15.19:50424) 2024-09-12T01:57:42.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.837+0000 7fe6377fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe638072de0 0x7fe63815d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:43604/0 (socket says 172.21.15.19:43604) 2024-09-12T01:57:42.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.837+0000 7fe63cd95640 1 -- 172.21.15.19:0/878258397 learned_addr learned my addr 172.21.15.19:0/878258397 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:42.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.837+0000 7fe6377fe640 1 -- 172.21.15.19:0/878258397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe638072700 msgr2=0x7fe63815d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:42.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.837+0000 7fe6377fe640 1 --2- 172.21.15.19:0/878258397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe638072700 0x7fe63815d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.837+0000 7fe6377fe640 1 -- 172.21.15.19:0/878258397 >> v1:172.21.15.135:6789/0 conn(0x7fe638072320 legacy=0x7fe6380cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.837+0000 7fe6377fe640 1 -- 172.21.15.19:0/878258397 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6380cdd00 con 0x7fe638072de0 2024-09-12T01:57:42.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.837+0000 7fe636ffd640 1 -- 172.21.15.19:0/878258397 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399130002 0 0) 0x7fe638146140 con 0x7fe638072320 2024-09-12T01:57:42.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.837+0000 7fe63cd95640 1 --2- 172.21.15.19:0/878258397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe638072700 0x7fe63815d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:42.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.838+0000 7fe6377fe640 1 --2- 172.21.15.19:0/878258397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638072de0 0x7fe63815d1e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0097a0 tx=0x7fe62c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bfee014c4594c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:42.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.838+0000 7fe636ffd640 1 -- 172.21.15.19:0/878258397 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62c037070 con 0x7fe638072de0 2024-09-12T01:57:42.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.838+0000 7fe636ffd640 1 -- 172.21.15.19:0/878258397 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe62c02ae50 con 0x7fe638072de0 2024-09-12T01:57:42.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.838+0000 7fe636ffd640 1 -- 172.21.15.19:0/878258397 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62c032660 con 0x7fe638072de0 2024-09-12T01:57:42.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.838+0000 7fe63e7f8640 1 -- 172.21.15.19:0/878258397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638072de0 msgr2=0x7fe63815d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.838+0000 7fe63e7f8640 1 --2- 172.21.15.19:0/878258397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638072de0 0x7fe63815d1e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0097a0 tx=0x7fe62c02a100 comp rx=0 tx=0).stop 2024-09-12T01:57:42.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.838+0000 7fe63e7f8640 1 -- 172.21.15.19:0/878258397 shutdown_connections 2024-09-12T01:57:42.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.838+0000 7fe63e7f8640 1 --2- 172.21.15.19:0/878258397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe638072700 0x7fe63815d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.838+0000 7fe63e7f8640 1 --2- 172.21.15.19:0/878258397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638072de0 0x7fe63815d1e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.838+0000 7fe63e7f8640 1 -- 172.21.15.19:0/878258397 >> 172.21.15.19:0/878258397 conn(0x7fe638067d70 msgr2=0x7fe63806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:42.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.839+0000 7fe63e7f8640 1 -- 172.21.15.19:0/878258397 shutdown_connections 2024-09-12T01:57:42.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.839+0000 7fe63e7f8640 1 -- 172.21.15.19:0/878258397 wait complete. 2024-09-12T01:57:42.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.840+0000 7fe63e7f8640 1 Processor -- start 2024-09-12T01:57:42.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.840+0000 7fe63e7f8640 1 -- start start 2024-09-12T01:57:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe63e7f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe638072320 0x7fe63815b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe63e7f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe638072700 0x7fe6380c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe63e7f8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638072de0 0x7fe6380c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe63e7f8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe63815dde0 con 0x7fe638072320 2024-09-12T01:57:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe63e7f8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe63815dc60 con 0x7fe638072de0 2024-09-12T01:57:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe63e7f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe63815df60 con 0x7fe638072700 2024-09-12T01:57:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe637fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe638072320 0x7fe63815b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe637fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe638072320 0x7fe63815b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42948/0 (socket says 172.21.15.19:42948) 2024-09-12T01:57:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe637fff640 1 -- 172.21.15.19:0/3177470892 learned_addr learned my addr 172.21.15.19:0/3177470892 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe6377fe640 1 --2- 172.21.15.19:0/3177470892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe638072700 0x7fe6380c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe63cd95640 1 --2- 172.21.15.19:0/3177470892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638072de0 0x7fe6380c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe637fff640 1 -- 172.21.15.19:0/3177470892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe638072700 msgr2=0x7fe6380c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe637fff640 1 --2- 172.21.15.19:0/3177470892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe638072700 0x7fe6380c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe637fff640 1 -- 172.21.15.19:0/3177470892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638072de0 msgr2=0x7fe6380c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe637fff640 1 --2- 172.21.15.19:0/3177470892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638072de0 0x7fe6380c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe637fff640 1 -- 172.21.15.19:0/3177470892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe63815bca0 con 0x7fe638072320 2024-09-12T01:57:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe637fff640 1 --2- 172.21.15.19:0/3177470892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe638072320 0x7fe63815b290 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe62800c4b0 tx=0x7fe62800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe634ff9640 1 -- 172.21.15.19:0/3177470892 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe628017070 con 0x7fe638072320 2024-09-12T01:57:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.841+0000 7fe634ff9640 1 -- 172.21.15.19:0/3177470892 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe628005480 con 0x7fe638072320 2024-09-12T01:57:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.842+0000 7fe634ff9640 1 -- 172.21.15.19:0/3177470892 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe628003830 con 0x7fe638072320 2024-09-12T01:57:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.842+0000 7fe63e7f8640 1 -- 172.21.15.19:0/3177470892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6380c6d60 con 0x7fe638072320 2024-09-12T01:57:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.842+0000 7fe63e7f8640 1 -- 172.21.15.19:0/3177470892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6380c7320 con 0x7fe638072320 2024-09-12T01:57:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.843+0000 7fe63e7f8640 1 -- 172.21.15.19:0/3177470892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe63815e370 con 0x7fe638072320 2024-09-12T01:57:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.843+0000 7fe634ff9640 1 -- 172.21.15.19:0/3177470892 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe62801a070 con 0x7fe638072320 2024-09-12T01:57:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.843+0000 7fe634ff9640 1 --2- 172.21.15.19:0/3177470892 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe62406be30 0x7fe62406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.843+0000 7fe634ff9640 1 -- 172.21.15.19:0/3177470892 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7fe62808a310 con 0x7fe638072320 2024-09-12T01:57:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.844+0000 7fe6377fe640 1 --2- 172.21.15.19:0/3177470892 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe62406be30 0x7fe62406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.844+0000 7fe6377fe640 1 --2- 172.21.15.19:0/3177470892 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe62406be30 0x7fe62406e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe62c034000 tx=0x7fe62c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:42.848+0000 7fe634ff9640 1 -- 172.21.15.19:0/3177470892 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe63815bca0 con 0x7fe638072320 2024-09-12T01:57:43.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.058+0000 7fe63e7f8640 1 -- 172.21.15.19:0/3177470892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe63815bec0 con 0x7fe638072320 2024-09-12T01:57:43.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.058+0000 7fe634ff9640 1 -- 172.21.15.19:0/3177470892 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5227 (secure 0 0 0) 0x7fe628058500 con 0x7fe638072320 2024-09-12T01:57:43.059 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:43.059 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"btime":"2024-09-12T01:57:04:677301+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1979542220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1979542220},{"type":"v1","addr":"172.21.15.135:6836","nonce":1979542220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/809710386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":809710386},{"type":"v1","addr":"172.21.15.19:6835","nonce":809710386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1005776280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1005776280},{"type":"v1","addr":"172.21.15.135:6837","nonce":1005776280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:56:48.431829+0000","modified":"2024-09-12T01:57:04.677295+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6834/3554496273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3554496273},{"type":"v1","addr":"172.21.15.19:6834","nonce":3554496273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5088,"qdb_cluster":[5088]},"id":2}]} 2024-09-12T01:57:43.059 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 20 2024-09-12T01:57:43.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.061+0000 7fe63e7f8640 1 -- 172.21.15.19:0/3177470892 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe62406be30 msgr2=0x7fe62406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.061+0000 7fe63e7f8640 1 --2- 172.21.15.19:0/3177470892 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe62406be30 0x7fe62406e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe62c034000 tx=0x7fe62c02e000 comp rx=0 tx=0).stop 2024-09-12T01:57:43.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.061+0000 7fe63e7f8640 1 -- 172.21.15.19:0/3177470892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe638072320 msgr2=0x7fe63815b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.061+0000 7fe63e7f8640 1 --2- 172.21.15.19:0/3177470892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe638072320 0x7fe63815b290 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe62800c4b0 tx=0x7fe62800c970 comp rx=0 tx=0).stop 2024-09-12T01:57:43.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.061+0000 7fe63e7f8640 1 -- 172.21.15.19:0/3177470892 shutdown_connections 2024-09-12T01:57:43.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.061+0000 7fe63e7f8640 1 --2- 172.21.15.19:0/3177470892 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe62406be30 0x7fe62406e2f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.061+0000 7fe63e7f8640 1 --2- 172.21.15.19:0/3177470892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638072de0 0x7fe6380c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.061+0000 7fe63e7f8640 1 --2- 172.21.15.19:0/3177470892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe638072700 0x7fe6380c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.061+0000 7fe63e7f8640 1 --2- 172.21.15.19:0/3177470892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe638072320 0x7fe63815b290 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.061+0000 7fe63e7f8640 1 -- 172.21.15.19:0/3177470892 >> 172.21.15.19:0/3177470892 conn(0x7fe638067d70 msgr2=0x7fe6380c58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:43.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.061+0000 7fe63e7f8640 1 -- 172.21.15.19:0/3177470892 shutdown_connections 2024-09-12T01:57:43.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.061+0000 7fe63e7f8640 1 -- 172.21.15.19:0/3177470892 wait complete. 2024-09-12T01:57:43.072 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:57:43.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.174+0000 7f8236d9f640 1 Processor -- start 2024-09-12T01:57:43.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.174+0000 7f8236d9f640 1 -- start start 2024-09-12T01:57:43.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.175+0000 7f8236d9f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f823015c520 0x7f823009b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.175+0000 7f8236d9f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82300b1620 0x7f82300b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.175+0000 7f8236d9f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82300cec00 con 0x7f82300d0980 2024-09-12T01:57:43.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.175+0000 7f8236d9f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f823009bd90 con 0x7f823015c520 2024-09-12T01:57:43.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.175+0000 7f8236d9f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f82300d0010 con 0x7f82300b1620 2024-09-12T01:57:43.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.175+0000 7f823533c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f82300d0980 0x7f82300cd570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54774/0 (socket says 172.21.15.19:54774) 2024-09-12T01:57:43.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.175+0000 7f823533c640 1 -- 172.21.15.19:0/113624462 learned_addr learned my addr 172.21.15.19:0/113624462 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:43.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f822ffff640 1 --2- 172.21.15.19:0/113624462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82300b1620 0x7f82300b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f8234b3b640 1 --2- 172.21.15.19:0/113624462 >> v2:172.21.15.135:3300/0 conn(0x7f823015c520 0x7f823009b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f822f7fe640 1 -- 172.21.15.19:0/113624462 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3069208436 0 0) 0x7f82300cec00 con 0x7f82300d0980 2024-09-12T01:57:43.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f822f7fe640 1 -- 172.21.15.19:0/113624462 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8218003520 con 0x7f82300d0980 2024-09-12T01:57:43.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f822f7fe640 1 -- 172.21.15.19:0/113624462 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3257270127 0 0) 0x7f8218003520 con 0x7f82300d0980 2024-09-12T01:57:43.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f822f7fe640 1 -- 172.21.15.19:0/113624462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82300b1620 msgr2=0x7f82300b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:43.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f822f7fe640 1 --2- 172.21.15.19:0/113624462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82300b1620 0x7f82300b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f822f7fe640 1 -- 172.21.15.19:0/113624462 >> v2:172.21.15.135:3300/0 conn(0x7f823015c520 msgr2=0x7f823009b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:43.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f822f7fe640 1 --2- 172.21.15.19:0/113624462 >> v2:172.21.15.135:3300/0 conn(0x7f823015c520 0x7f823009b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f822f7fe640 1 -- 172.21.15.19:0/113624462 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82300d02f0 con 0x7f82300d0980 2024-09-12T01:57:43.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f822f7fe640 1 -- 172.21.15.19:0/113624462 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f8220001670 con 0x7f82300d0980 2024-09-12T01:57:43.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f822f7fe640 1 -- 172.21.15.19:0/113624462 >> v1:172.21.15.19:6789/0 conn(0x7f82300d0980 legacy=0x7f82300cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f822f7fe640 1 --2- 172.21.15.19:0/113624462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82300b1620 0x7f82180039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f822f7fe640 1 --2- 172.21.15.19:0/113624462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8218003f30 0x7f8218004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f822f7fe640 1 --2- 172.21.15.19:0/113624462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8218004d40 0x7f82180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f822f7fe640 1 -- 172.21.15.19:0/113624462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f823009bd90 con 0x7f8218003f30 2024-09-12T01:57:43.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f822f7fe640 1 -- 172.21.15.19:0/113624462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f82300d0010 con 0x7f8218004d40 2024-09-12T01:57:43.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f822f7fe640 1 -- 172.21.15.19:0/113624462 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f821800b9c0 con 0x7f82300b1620 2024-09-12T01:57:43.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f822ffff640 1 --2- 172.21.15.19:0/113624462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8218003f30 0x7f8218004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f8234b3b640 1 --2- 172.21.15.19:0/113624462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82300b1620 0x7f82180039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.176+0000 7f823533c640 1 --2- 172.21.15.19:0/113624462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8218004d40 0x7f82180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.177+0000 7f822ffff640 1 -- 172.21.15.19:0/113624462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82300b1620 msgr2=0x7f82180039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:43.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.177+0000 7f822ffff640 1 --2- 172.21.15.19:0/113624462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82300b1620 0x7f82180039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.177+0000 7f822ffff640 1 -- 172.21.15.19:0/113624462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8218004d40 msgr2=0x7f82180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:43.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.177+0000 7f822ffff640 1 --2- 172.21.15.19:0/113624462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8218004d40 0x7f82180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.177+0000 7f822ffff640 1 -- 172.21.15.19:0/113624462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8218003520 con 0x7f8218003f30 2024-09-12T01:57:43.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.177+0000 7f822ffff640 1 --2- 172.21.15.19:0/113624462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8218003f30 0x7f8218004800 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8224009ac0 tx=0x7f8218005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe8bab850d3cbcf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:43.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.177+0000 7f822f7fe640 1 -- 172.21.15.19:0/113624462 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224036070 con 0x7f8218003f30 2024-09-12T01:57:43.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.177+0000 7f822f7fe640 1 -- 172.21.15.19:0/113624462 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8224031400 con 0x7f8218003f30 2024-09-12T01:57:43.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.177+0000 7f822f7fe640 1 -- 172.21.15.19:0/113624462 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224009690 con 0x7f8218003f30 2024-09-12T01:57:43.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.178+0000 7f8236d9f640 1 -- 172.21.15.19:0/113624462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8218003f30 msgr2=0x7f8218004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.178+0000 7f8236d9f640 1 --2- 172.21.15.19:0/113624462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8218003f30 0x7f8218004800 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8224009ac0 tx=0x7f8218005830 comp rx=0 tx=0).stop 2024-09-12T01:57:43.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.178+0000 7f823533c640 1 -- 172.21.15.19:0/113624462 reap_dead start 2024-09-12T01:57:43.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.178+0000 7f8236d9f640 1 -- 172.21.15.19:0/113624462 shutdown_connections 2024-09-12T01:57:43.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.178+0000 7f8236d9f640 1 -- 172.21.15.19:0/113624462 >> 172.21.15.19:0/113624462 conn(0x7f82300d23a0 msgr2=0x7f82300d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:43.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.178+0000 7f8236d9f640 1 -- 172.21.15.19:0/113624462 shutdown_connections 2024-09-12T01:57:43.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.178+0000 7f8236d9f640 1 -- 172.21.15.19:0/113624462 wait complete. 2024-09-12T01:57:43.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.179+0000 7f8236d9f640 1 Processor -- start 2024-09-12T01:57:43.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.179+0000 7f8236d9f640 1 -- start start 2024-09-12T01:57:43.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.180+0000 7f8236d9f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8218003f30 0x7f82301e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.180+0000 7f8236d9f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8230147a40 0x7f823006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.180+0000 7f8236d9f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f823006e530 0x7f823006e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.180+0000 7f8236d9f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f823015c900 con 0x7f8218003f30 2024-09-12T01:57:43.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.180+0000 7f8236d9f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f82300d05d0 con 0x7f823006e530 2024-09-12T01:57:43.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.180+0000 7f8236d9f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f823006d260 con 0x7f8230147a40 2024-09-12T01:57:43.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.180+0000 7f8234b3b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8218003f30 0x7f82301e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.180+0000 7f8234b3b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8218003f30 0x7f82301e78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42976/0 (socket says 172.21.15.19:42976) 2024-09-12T01:57:43.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.180+0000 7f8234b3b640 1 -- 172.21.15.19:0/850141801 learned_addr learned my addr 172.21.15.19:0/850141801 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:43.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.180+0000 7f822ffff640 1 --2- 172.21.15.19:0/850141801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8230147a40 0x7f823006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.180+0000 7f823533c640 1 --2- 172.21.15.19:0/850141801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f823006e530 0x7f823006e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.180+0000 7f8234b3b640 1 -- 172.21.15.19:0/850141801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8230147a40 msgr2=0x7f823006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.180+0000 7f8234b3b640 1 --2- 172.21.15.19:0/850141801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8230147a40 0x7f823006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.180+0000 7f8234b3b640 1 -- 172.21.15.19:0/850141801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f823006e530 msgr2=0x7f823006e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.180+0000 7f8234b3b640 1 --2- 172.21.15.19:0/850141801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f823006e530 0x7f823006e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.180+0000 7f8234b3b640 1 -- 172.21.15.19:0/850141801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823006d490 con 0x7f8218003f30 2024-09-12T01:57:43.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.180+0000 7f822ffff640 1 --2- 172.21.15.19:0/850141801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8230147a40 0x7f823006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:43.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.181+0000 7f8234b3b640 1 --2- 172.21.15.19:0/850141801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8218003f30 0x7f82301e78e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8228011e90 tx=0x7f822800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:43.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.181+0000 7f822d7fa640 1 -- 172.21.15.19:0/850141801 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8228015630 con 0x7f8218003f30 2024-09-12T01:57:43.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.181+0000 7f822d7fa640 1 -- 172.21.15.19:0/850141801 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82280157d0 con 0x7f8218003f30 2024-09-12T01:57:43.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.181+0000 7f8236d9f640 1 -- 172.21.15.19:0/850141801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f823006d770 con 0x7f8218003f30 2024-09-12T01:57:43.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.181+0000 7f822d7fa640 1 -- 172.21.15.19:0/850141801 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8228015ba0 con 0x7f8218003f30 2024-09-12T01:57:43.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.181+0000 7f8236d9f640 1 -- 172.21.15.19:0/850141801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f823006dd30 con 0x7f8218003f30 2024-09-12T01:57:43.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.182+0000 7f8236d9f640 1 -- 172.21.15.19:0/850141801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82300ccac0 con 0x7f8218003f30 2024-09-12T01:57:43.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.182+0000 7f822d7fa640 1 -- 172.21.15.19:0/850141801 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f822801d400 con 0x7f8218003f30 2024-09-12T01:57:43.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.183+0000 7f822d7fa640 1 --2- 172.21.15.19:0/850141801 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f821c06be30 0x7f821c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.183+0000 7f822d7fa640 1 -- 172.21.15.19:0/850141801 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7f822808c3b0 con 0x7f8218003f30 2024-09-12T01:57:43.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.183+0000 7f822ffff640 1 --2- 172.21.15.19:0/850141801 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f821c06be30 0x7f821c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.184+0000 7f822ffff640 1 --2- 172.21.15.19:0/850141801 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f821c06be30 0x7f821c06e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8224033000 tx=0x7f8224008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:43.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.187+0000 7f822d7fa640 1 -- 172.21.15.19:0/850141801 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f82300ccac0 con 0x7f8218003f30 2024-09-12T01:57:43.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.395+0000 7f8236d9f640 1 -- 172.21.15.19:0/850141801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f823009b720 con 0x7f8218003f30 2024-09-12T01:57:43.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.395+0000 7f822d7fa640 1 -- 172.21.15.19:0/850141801 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5227 (secure 0 0 0) 0x7f8228019030 con 0x7f8218003f30 2024-09-12T01:57:43.396 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:43.396 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"btime":"2024-09-12T01:57:04:677301+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1979542220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1979542220},{"type":"v1","addr":"172.21.15.135:6836","nonce":1979542220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/809710386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":809710386},{"type":"v1","addr":"172.21.15.19:6835","nonce":809710386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1005776280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1005776280},{"type":"v1","addr":"172.21.15.135:6837","nonce":1005776280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:56:48.431829+0000","modified":"2024-09-12T01:57:04.677295+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6834/3554496273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3554496273},{"type":"v1","addr":"172.21.15.19:6834","nonce":3554496273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5088,"qdb_cluster":[5088]},"id":2}]} 2024-09-12T01:57:43.396 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 20 2024-09-12T01:57:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.397+0000 7f8236d9f640 1 -- 172.21.15.19:0/850141801 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f821c06be30 msgr2=0x7f821c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.397+0000 7f8236d9f640 1 --2- 172.21.15.19:0/850141801 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f821c06be30 0x7f821c06e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8224033000 tx=0x7f8224008030 comp rx=0 tx=0).stop 2024-09-12T01:57:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.397+0000 7f8236d9f640 1 -- 172.21.15.19:0/850141801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8218003f30 msgr2=0x7f82301e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.397+0000 7f8236d9f640 1 --2- 172.21.15.19:0/850141801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8218003f30 0x7f82301e78e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8228011e90 tx=0x7f822800f580 comp rx=0 tx=0).stop 2024-09-12T01:57:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.397+0000 7f8236d9f640 1 -- 172.21.15.19:0/850141801 shutdown_connections 2024-09-12T01:57:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.397+0000 7f8236d9f640 1 --2- 172.21.15.19:0/850141801 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f821c06be30 0x7f821c06e2f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.397+0000 7f8236d9f640 1 --2- 172.21.15.19:0/850141801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f823006e530 0x7f823006e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.397+0000 7f8236d9f640 1 --2- 172.21.15.19:0/850141801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8230147a40 0x7f823006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.397+0000 7f8236d9f640 1 --2- 172.21.15.19:0/850141801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8218003f30 0x7f82301e78e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.397+0000 7f8236d9f640 1 -- 172.21.15.19:0/850141801 >> 172.21.15.19:0/850141801 conn(0x7f82300d23a0 msgr2=0x7f82300b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:43.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.398+0000 7f8236d9f640 1 -- 172.21.15.19:0/850141801 shutdown_connections 2024-09-12T01:57:43.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.398+0000 7f8236d9f640 1 -- 172.21.15.19:0/850141801 wait complete. 2024-09-12T01:57:43.409 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:57:43.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.510+0000 7f6130711640 1 Processor -- start 2024-09-12T01:57:43.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.510+0000 7f6130711640 1 -- start start 2024-09-12T01:57:43.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.511+0000 7f6130711640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61280d30f0 0x7f61280b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.511+0000 7f6130711640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61280d3690 con 0x7f61280b64c0 2024-09-12T01:57:43.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.511+0000 7f6130711640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61280d3970 con 0x7f612815e5f0 2024-09-12T01:57:43.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.511+0000 7f6130711640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f612806d530 con 0x7f61280d30f0 2024-09-12T01:57:43.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.511+0000 7f612ecae640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f61280b64c0 0x7f612806d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54788/0 (socket says 172.21.15.19:54788) 2024-09-12T01:57:43.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.511+0000 7f612ecae640 1 -- 172.21.15.19:0/3266252257 learned_addr learned my addr 172.21.15.19:0/3266252257 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:43.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.511+0000 7f612dcac640 1 --2- 172.21.15.19:0/3266252257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61280d30f0 0x7f61280b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.511+0000 7f612d4ab640 1 -- 172.21.15.19:0/3266252257 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1245463753 0 0) 0x7f61280d3690 con 0x7f61280b64c0 2024-09-12T01:57:43.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.511+0000 7f612d4ab640 1 -- 172.21.15.19:0/3266252257 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6114003520 con 0x7f61280b64c0 2024-09-12T01:57:43.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.512+0000 7f612d4ab640 1 -- 172.21.15.19:0/3266252257 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3402050391 0 0) 0x7f61280d3970 con 0x7f612815e5f0 2024-09-12T01:57:43.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.512+0000 7f612dcac640 1 -- 172.21.15.19:0/3266252257 >> v1:172.21.15.135:6789/0 conn(0x7f612815e5f0 legacy=0x7f61280d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.512+0000 7f612dcac640 1 -- 172.21.15.19:0/3266252257 >> v1:172.21.15.19:6789/0 conn(0x7f61280b64c0 legacy=0x7f612806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.512+0000 7f612dcac640 1 -- 172.21.15.19:0/3266252257 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612806cee0 con 0x7f61280d30f0 2024-09-12T01:57:43.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.512+0000 7f612dcac640 1 --2- 172.21.15.19:0/3266252257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61280d30f0 0x7f61280b5f80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f611c0097d0 tx=0x7f611c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3613ea03d2826bed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:43.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.513+0000 7f612d4ab640 1 -- 172.21.15.19:0/3266252257 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c037070 con 0x7f61280d30f0 2024-09-12T01:57:43.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.513+0000 7f612d4ab640 1 -- 172.21.15.19:0/3266252257 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f611c032440 con 0x7f61280d30f0 2024-09-12T01:57:43.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.513+0000 7f612d4ab640 1 -- 172.21.15.19:0/3266252257 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c0327f0 con 0x7f61280d30f0 2024-09-12T01:57:43.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.513+0000 7f6130711640 1 -- 172.21.15.19:0/3266252257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61280d30f0 msgr2=0x7f61280b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.513+0000 7f6130711640 1 --2- 172.21.15.19:0/3266252257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61280d30f0 0x7f61280b5f80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f611c0097d0 tx=0x7f611c02a210 comp rx=0 tx=0).stop 2024-09-12T01:57:43.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.513+0000 7f6130711640 1 -- 172.21.15.19:0/3266252257 shutdown_connections 2024-09-12T01:57:43.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.513+0000 7f6130711640 1 --2- 172.21.15.19:0/3266252257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61280d30f0 0x7f61280b5f80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.513+0000 7f6130711640 1 -- 172.21.15.19:0/3266252257 >> 172.21.15.19:0/3266252257 conn(0x7f612808bfc0 msgr2=0x7f61280d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:43.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.513+0000 7f6130711640 1 -- 172.21.15.19:0/3266252257 shutdown_connections 2024-09-12T01:57:43.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.513+0000 7f6130711640 1 -- 172.21.15.19:0/3266252257 wait complete. 2024-09-12T01:57:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.514+0000 7f6130711640 1 Processor -- start 2024-09-12T01:57:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.514+0000 7f6130711640 1 -- start start 2024-09-12T01:57:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.515+0000 7f6130711640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61280b64c0 0x7f61280c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.515+0000 7f6130711640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61280d30f0 0x7f61281f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.515+0000 7f6130711640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612815e5f0 0x7f61281600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.515+0000 7f6130711640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f612806e0d0 con 0x7f61280d30f0 2024-09-12T01:57:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.515+0000 7f6130711640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f612815e9d0 con 0x7f612815e5f0 2024-09-12T01:57:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.515+0000 7f6130711640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f612806e250 con 0x7f61280b64c0 2024-09-12T01:57:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.515+0000 7f612dcac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61280d30f0 0x7f61281f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.515+0000 7f612dcac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61280d30f0 0x7f61281f4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42978/0 (socket says 172.21.15.19:42978) 2024-09-12T01:57:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.515+0000 7f612dcac640 1 -- 172.21.15.19:0/1570889051 learned_addr learned my addr 172.21.15.19:0/1570889051 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.516+0000 7f612ecae640 1 --2- 172.21.15.19:0/1570889051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612815e5f0 0x7f61281600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.516+0000 7f612dcac640 1 -- 172.21.15.19:0/1570889051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61280b64c0 msgr2=0x7f61280c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.516+0000 7f612dcac640 1 --2- 172.21.15.19:0/1570889051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61280b64c0 0x7f61280c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.516+0000 7f612dcac640 1 -- 172.21.15.19:0/1570889051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612815e5f0 msgr2=0x7f61281600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.516+0000 7f612dcac640 1 --2- 172.21.15.19:0/1570889051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612815e5f0 0x7f61281600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.516+0000 7f612dcac640 1 -- 172.21.15.19:0/1570889051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61280b77f0 con 0x7f61280d30f0 2024-09-12T01:57:43.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.516+0000 7f612ecae640 1 --2- 172.21.15.19:0/1570889051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612815e5f0 0x7f61281600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:43.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.516+0000 7f612dcac640 1 --2- 172.21.15.19:0/1570889051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61280d30f0 0x7f61281f4450 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f611c000c00 tx=0x7f611c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:43.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.516+0000 7f611affd640 1 -- 172.21.15.19:0/1570889051 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c037040 con 0x7f61280d30f0 2024-09-12T01:57:43.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.516+0000 7f611affd640 1 -- 172.21.15.19:0/1570889051 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f611c042070 con 0x7f61280d30f0 2024-09-12T01:57:43.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.516+0000 7f6130711640 1 -- 172.21.15.19:0/1570889051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61280b7a90 con 0x7f61280d30f0 2024-09-12T01:57:43.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.516+0000 7f611affd640 1 -- 172.21.15.19:0/1570889051 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c030900 con 0x7f61280d30f0 2024-09-12T01:57:43.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.516+0000 7f6130711640 1 -- 172.21.15.19:0/1570889051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61280b8050 con 0x7f61280d30f0 2024-09-12T01:57:43.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.517+0000 7f6130711640 1 -- 172.21.15.19:0/1570889051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61280b5f80 con 0x7f61280d30f0 2024-09-12T01:57:43.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.518+0000 7f611affd640 1 -- 172.21.15.19:0/1570889051 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f611c030aa0 con 0x7f61280d30f0 2024-09-12T01:57:43.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.518+0000 7f611affd640 1 --2- 172.21.15.19:0/1570889051 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f610c06be30 0x7f610c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.518+0000 7f611affd640 1 -- 172.21.15.19:0/1570889051 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7f611c0ab990 con 0x7f61280d30f0 2024-09-12T01:57:43.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.518+0000 7f612e4ad640 1 --2- 172.21.15.19:0/1570889051 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f610c06be30 0x7f610c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.519+0000 7f612e4ad640 1 --2- 172.21.15.19:0/1570889051 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f610c06be30 0x7f610c06e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6124000f60 tx=0x7f61240079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:43.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.523+0000 7f611affd640 1 -- 172.21.15.19:0/1570889051 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f611c07a1d0 con 0x7f61280d30f0 2024-09-12T01:57:43.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.700+0000 7f6130711640 1 -- 172.21.15.19:0/1570889051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f612815d7a0 con 0x7f61280d30f0 2024-09-12T01:57:43.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.701+0000 7f611affd640 1 -- 172.21.15.19:0/1570889051 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+17112 (secure 0 0 0) 0x7f611c079ad0 con 0x7f61280d30f0 2024-09-12T01:57:43.702 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:43.702 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":43,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:57:38.739542+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:56:46.200850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T01:56:47.416374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.24","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6834/1994815169":"2024-09-13T01:57:00.902156+0000","172.21.15.19:6832/1994815169":"2024-09-13T01:57:00.902156+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:57:43.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.703+0000 7f6130711640 1 -- 172.21.15.19:0/1570889051 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f610c06be30 msgr2=0x7f610c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.703+0000 7f6130711640 1 --2- 172.21.15.19:0/1570889051 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f610c06be30 0x7f610c06e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6124000f60 tx=0x7f61240079b0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.703+0000 7f6130711640 1 -- 172.21.15.19:0/1570889051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61280d30f0 msgr2=0x7f61281f4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.703+0000 7f6130711640 1 --2- 172.21.15.19:0/1570889051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61280d30f0 0x7f61281f4450 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f611c000c00 tx=0x7f611c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.703+0000 7f6130711640 1 -- 172.21.15.19:0/1570889051 shutdown_connections 2024-09-12T01:57:43.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.703+0000 7f6130711640 1 --2- 172.21.15.19:0/1570889051 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f610c06be30 0x7f610c06e2f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.703+0000 7f6130711640 1 --2- 172.21.15.19:0/1570889051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612815e5f0 0x7f61281600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.703+0000 7f6130711640 1 --2- 172.21.15.19:0/1570889051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61280d30f0 0x7f61281f4450 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.703+0000 7f6130711640 1 --2- 172.21.15.19:0/1570889051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61280b64c0 0x7f61280c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.703+0000 7f6130711640 1 -- 172.21.15.19:0/1570889051 >> 172.21.15.19:0/1570889051 conn(0x7f612808bfc0 msgr2=0x7f61280b4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:43.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.703+0000 7f6130711640 1 -- 172.21.15.19:0/1570889051 shutdown_connections 2024-09-12T01:57:43.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.703+0000 7f6130711640 1 -- 172.21.15.19:0/1570889051 wait complete. 2024-09-12T01:57:43.715 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T01:57:43.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.819+0000 7f2483db0640 1 Processor -- start 2024-09-12T01:57:43.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.820+0000 7f2483db0640 1 -- start start 2024-09-12T01:57:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2483db0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f247c145bc0 0x7f247c15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2483db0640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f247c0b3570 con 0x7f247c0ae140 2024-09-12T01:57:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2483db0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f247c0b3850 con 0x7f247c06c320 2024-09-12T01:57:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2483db0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f247c0b3b30 con 0x7f247c145bc0 2024-09-12T01:57:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f248134b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f247c0ae140 0x7f247c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54792/0 (socket says 172.21.15.19:54792) 2024-09-12T01:57:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f248134b640 1 -- 172.21.15.19:0/2607419087 learned_addr learned my addr 172.21.15.19:0/2607419087 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2480b4a640 1 -- 172.21.15.19:0/2607419087 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3672017271 0 0) 0x7f247c0b3570 con 0x7f247c0ae140 2024-09-12T01:57:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2480b4a640 1 -- 172.21.15.19:0/2607419087 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2468003520 con 0x7f247c0ae140 2024-09-12T01:57:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2480b4a640 1 -- 172.21.15.19:0/2607419087 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3067284427 0 0) 0x7f2468003520 con 0x7f247c0ae140 2024-09-12T01:57:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2480b4a640 1 -- 172.21.15.19:0/2607419087 >> v2:172.21.15.135:3300/0 conn(0x7f247c145bc0 msgr2=0x7f247c15ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:57:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2480b4a640 1 --2- 172.21.15.19:0/2607419087 >> v2:172.21.15.135:3300/0 conn(0x7f247c145bc0 0x7f247c15ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2480b4a640 1 -- 172.21.15.19:0/2607419087 >> v1:172.21.15.135:6789/0 conn(0x7f247c06c320 legacy=0x7f247c0af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2480b4a640 1 -- 172.21.15.19:0/2607419087 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247c0b1610 con 0x7f247c0ae140 2024-09-12T01:57:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2480b4a640 1 -- 172.21.15.19:0/2607419087 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f246c001670 con 0x7f247c0ae140 2024-09-12T01:57:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2480b4a640 1 -- 172.21.15.19:0/2607419087 >> v1:172.21.15.19:6789/0 conn(0x7f247c0ae140 legacy=0x7f247c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2480b4a640 1 --2- 172.21.15.19:0/2607419087 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2468003a00 0x7f2468003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2480b4a640 1 --2- 172.21.15.19:0/2607419087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2468004800 0x7f2468004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2480b4a640 1 --2- 172.21.15.19:0/2607419087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24680052e0 0x7f246800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2480b4a640 1 -- 172.21.15.19:0/2607419087 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f247c0b3b30 con 0x7f2468004800 2024-09-12T01:57:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2480b4a640 1 -- 172.21.15.19:0/2607419087 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f246800c220 con 0x7f24680052e0 2024-09-12T01:57:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f2480b4a640 1 -- 172.21.15.19:0/2607419087 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f246800c420 con 0x7f2468003a00 2024-09-12T01:57:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.821+0000 7f248134b640 1 --2- 172.21.15.19:0/2607419087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2468004800 0x7f2468004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.822+0000 7f248134b640 1 -- 172.21.15.19:0/2607419087 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2468003a00 msgr2=0x7f2468003e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:57:43.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.822+0000 7f248134b640 1 --2- 172.21.15.19:0/2607419087 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2468003a00 0x7f2468003e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.822+0000 7f248134b640 1 -- 172.21.15.19:0/2607419087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24680052e0 msgr2=0x7f246800b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:57:43.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.822+0000 7f248134b640 1 --2- 172.21.15.19:0/2607419087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24680052e0 0x7f246800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.822+0000 7f248134b640 1 -- 172.21.15.19:0/2607419087 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2468003520 con 0x7f2468004800 2024-09-12T01:57:43.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.822+0000 7f248234d640 1 -- 172.21.15.19:0/2607419087 reap_dead start 2024-09-12T01:57:43.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.822+0000 7f248134b640 1 --2- 172.21.15.19:0/2607419087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2468004800 0x7f2468004c80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f246c00c160 tx=0x7f2468005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e968da1c20862d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:43.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.823+0000 7f2480b4a640 1 -- 172.21.15.19:0/2607419087 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c007c60 con 0x7f2468004800 2024-09-12T01:57:43.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.823+0000 7f2480b4a640 1 -- 172.21.15.19:0/2607419087 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f246c005af0 con 0x7f2468004800 2024-09-12T01:57:43.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.823+0000 7f2480b4a640 1 -- 172.21.15.19:0/2607419087 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c007070 con 0x7f2468004800 2024-09-12T01:57:43.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.823+0000 7f2483db0640 1 -- 172.21.15.19:0/2607419087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2468004800 msgr2=0x7f2468004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.823+0000 7f2483db0640 1 --2- 172.21.15.19:0/2607419087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2468004800 0x7f2468004c80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f246c00c160 tx=0x7f2468005830 comp rx=0 tx=0).stop 2024-09-12T01:57:43.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.823+0000 7f2483db0640 1 -- 172.21.15.19:0/2607419087 shutdown_connections 2024-09-12T01:57:43.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.823+0000 7f2483db0640 1 --2- 172.21.15.19:0/2607419087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2468004800 0x7f2468004c80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.823+0000 7f2483db0640 1 -- 172.21.15.19:0/2607419087 >> 172.21.15.19:0/2607419087 conn(0x7f247c073490 msgr2=0x7f247c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:43.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.823+0000 7f2483db0640 1 -- 172.21.15.19:0/2607419087 shutdown_connections 2024-09-12T01:57:43.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.823+0000 7f2483db0640 1 -- 172.21.15.19:0/2607419087 wait complete. 2024-09-12T01:57:43.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.824+0000 7f2483db0640 1 Processor -- start 2024-09-12T01:57:43.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.824+0000 7f2483db0640 1 -- start start 2024-09-12T01:57:43.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.825+0000 7f2483db0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2468004800 0x7f247c13ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.825+0000 7f2483db0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f247c09c310 0x7f247c09c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.825+0000 7f2483db0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f247c13fc30 0x7f247c1400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.825+0000 7f2483db0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f247c145fa0 con 0x7f247c09c310 2024-09-12T01:57:43.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.825+0000 7f2483db0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f247c09aa30 con 0x7f247c13fc30 2024-09-12T01:57:43.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.825+0000 7f2483db0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f247c13f190 con 0x7f2468004800 2024-09-12T01:57:43.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.825+0000 7f248134b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f247c09c310 0x7f247c09c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.825+0000 7f248134b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f247c09c310 0x7f247c09c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43002/0 (socket says 172.21.15.19:43002) 2024-09-12T01:57:43.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.825+0000 7f248134b640 1 -- 172.21.15.19:0/4072296658 learned_addr learned my addr 172.21.15.19:0/4072296658 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:43.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.825+0000 7f248234d640 1 --2- 172.21.15.19:0/4072296658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f247c13fc30 0x7f247c1400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.825+0000 7f2481b4c640 1 --2- 172.21.15.19:0/4072296658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2468004800 0x7f247c13ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.826+0000 7f248134b640 1 -- 172.21.15.19:0/4072296658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2468004800 msgr2=0x7f247c13ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.826+0000 7f248134b640 1 --2- 172.21.15.19:0/4072296658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2468004800 0x7f247c13ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.826+0000 7f248134b640 1 -- 172.21.15.19:0/4072296658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f247c13fc30 msgr2=0x7f247c1400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.826+0000 7f248134b640 1 --2- 172.21.15.19:0/4072296658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f247c13fc30 0x7f247c1400e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.826+0000 7f248134b640 1 -- 172.21.15.19:0/4072296658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247c09cdd0 con 0x7f247c09c310 2024-09-12T01:57:43.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.826+0000 7f248234d640 1 --2- 172.21.15.19:0/4072296658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f247c13fc30 0x7f247c1400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:43.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.826+0000 7f248134b640 1 --2- 172.21.15.19:0/4072296658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f247c09c310 0x7f247c09c790 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f246c02ad00 tx=0x7f247c0b3a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:43.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.826+0000 7f24727fc640 1 -- 172.21.15.19:0/4072296658 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c0015b0 con 0x7f247c09c310 2024-09-12T01:57:43.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.826+0000 7f24727fc640 1 -- 172.21.15.19:0/4072296658 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f246c042070 con 0x7f247c09c310 2024-09-12T01:57:43.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.826+0000 7f24727fc640 1 -- 172.21.15.19:0/4072296658 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c007270 con 0x7f247c09c310 2024-09-12T01:57:43.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.826+0000 7f2483db0640 1 -- 172.21.15.19:0/4072296658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247c09d0b0 con 0x7f247c09c310 2024-09-12T01:57:43.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.826+0000 7f2483db0640 1 -- 172.21.15.19:0/4072296658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f247c09d670 con 0x7f247c09c310 2024-09-12T01:57:43.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.827+0000 7f2483db0640 1 -- 172.21.15.19:0/4072296658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f247c15ca70 con 0x7f247c09c310 2024-09-12T01:57:43.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.828+0000 7f24727fc640 1 -- 172.21.15.19:0/4072296658 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f246c007410 con 0x7f247c09c310 2024-09-12T01:57:43.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.828+0000 7f24727fc640 1 --2- 172.21.15.19:0/4072296658 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f246006be30 0x7f246006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.828+0000 7f24727fc640 1 -- 172.21.15.19:0/4072296658 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7f246c0ab100 con 0x7f247c09c310 2024-09-12T01:57:43.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.828+0000 7f2481b4c640 1 --2- 172.21.15.19:0/4072296658 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f246006be30 0x7f246006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.829+0000 7f2481b4c640 1 --2- 172.21.15.19:0/4072296658 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f246006be30 0x7f246006e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2478006fd0 tx=0x7f2478008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:43.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:43.832+0000 7f24727fc640 1 -- 172.21.15.19:0/4072296658 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f246c030380 con 0x7f247c09c310 2024-09-12T01:57:44.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.050+0000 7f2483db0640 1 -- 172.21.15.19:0/4072296658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f247c15dc80 con 0x7f247c09c310 2024-09-12T01:57:44.050 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T01:57:44.050+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:57:44.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.052+0000 7f24727fc640 1 -- 172.21.15.19:0/4072296658 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) ==== 161+0+0 (secure 0 0 0) 0x7f246c079940 con 0x7f247c09c310 2024-09-12T01:57:44.052 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:57:44.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.055+0000 7f2483db0640 1 -- 172.21.15.19:0/4072296658 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f246006be30 msgr2=0x7f246006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:44.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.055+0000 7f2483db0640 1 --2- 172.21.15.19:0/4072296658 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f246006be30 0x7f246006e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2478006fd0 tx=0x7f2478008040 comp rx=0 tx=0).stop 2024-09-12T01:57:44.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.055+0000 7f2483db0640 1 -- 172.21.15.19:0/4072296658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f247c09c310 msgr2=0x7f247c09c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:44.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.055+0000 7f2483db0640 1 --2- 172.21.15.19:0/4072296658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f247c09c310 0x7f247c09c790 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f246c02ad00 tx=0x7f247c0b3a20 comp rx=0 tx=0).stop 2024-09-12T01:57:44.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.055+0000 7f2483db0640 1 -- 172.21.15.19:0/4072296658 shutdown_connections 2024-09-12T01:57:44.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.055+0000 7f2483db0640 1 --2- 172.21.15.19:0/4072296658 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f246006be30 0x7f246006e2f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:44.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.055+0000 7f2483db0640 1 --2- 172.21.15.19:0/4072296658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f247c13fc30 0x7f247c1400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:44.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.055+0000 7f2483db0640 1 --2- 172.21.15.19:0/4072296658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f247c09c310 0x7f247c09c790 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:44.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.055+0000 7f2483db0640 1 --2- 172.21.15.19:0/4072296658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2468004800 0x7f247c13ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:44.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.055+0000 7f2483db0640 1 -- 172.21.15.19:0/4072296658 >> 172.21.15.19:0/4072296658 conn(0x7f247c073490 msgr2=0x7f247c15e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:44.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.055+0000 7f2483db0640 1 -- 172.21.15.19:0/4072296658 shutdown_connections 2024-09-12T01:57:44.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.055+0000 7f2483db0640 1 -- 172.21.15.19:0/4072296658 wait complete. 2024-09-12T01:57:44.058 INFO:tasks.ceph.mds.c.smithi019.stderr: -3308> 2024-09-12T01:57:06.670+0000 7f75a551b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:57:44.068 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T01:57:44.089 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T01:57:44.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.174+0000 7f89c54b7640 1 Processor -- start 2024-09-12T01:57:44.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.174+0000 7f89c54b7640 1 -- start start 2024-09-12T01:57:44.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.174+0000 7f89c54b7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f89c015e5a0 0x7f89c00cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:44.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.174+0000 7f89c54b7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89c00d1500 0x7f89c00d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:44.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.174+0000 7f89c54b7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c00d53f0 con 0x7f89c015e980 2024-09-12T01:57:44.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.174+0000 7f89c54b7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f89c006cd90 con 0x7f89c015e5a0 2024-09-12T01:57:44.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.174+0000 7f89c54b7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f89c006d070 con 0x7f89c00d1500 2024-09-12T01:57:44.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.175+0000 7f89beffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f89c015e5a0 0x7f89c00cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:44.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.175+0000 7f89be7fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f89c015e980 0x7f89c00d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54796/0 (socket says 172.21.15.19:54796) 2024-09-12T01:57:44.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.175+0000 7f89beffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f89c015e5a0 0x7f89c00cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43042/0 (socket says 172.21.15.19:43042) 2024-09-12T01:57:44.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.175+0000 7f89be7fc640 1 -- 172.21.15.19:0/2965141972 learned_addr learned my addr 172.21.15.19:0/2965141972 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:44.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.175+0000 7f89bf7fe640 1 --2- 172.21.15.19:0/2965141972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89c00d1500 0x7f89c00d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:44.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.175+0000 7f89beffd640 1 -- 172.21.15.19:0/2965141972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89c00d1500 msgr2=0x7f89c00d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:44.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.175+0000 7f89beffd640 1 --2- 172.21.15.19:0/2965141972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89c00d1500 0x7f89c00d0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:44.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.175+0000 7f89beffd640 1 -- 172.21.15.19:0/2965141972 >> v1:172.21.15.19:6789/0 conn(0x7f89c015e980 legacy=0x7f89c00d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:44.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.175+0000 7f89beffd640 1 -- 172.21.15.19:0/2965141972 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c006d350 con 0x7f89c015e5a0 2024-09-12T01:57:44.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.175+0000 7f89bdffb640 1 -- 172.21.15.19:0/2965141972 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516090002 0 0) 0x7f89c00d53f0 con 0x7f89c015e980 2024-09-12T01:57:44.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.176+0000 7f89beffd640 1 --2- 172.21.15.19:0/2965141972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89c015e5a0 0x7f89c00cfcd0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009d90 tx=0x7f89b002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2b10c78c0a9a08 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:44.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.176+0000 7f89bdffb640 1 -- 172.21.15.19:0/2965141972 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b0031600 con 0x7f89c015e5a0 2024-09-12T01:57:44.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.176+0000 7f89bdffb640 1 -- 172.21.15.19:0/2965141972 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89b00317a0 con 0x7f89c015e5a0 2024-09-12T01:57:44.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.176+0000 7f89bdffb640 1 -- 172.21.15.19:0/2965141972 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b0031b70 con 0x7f89c015e5a0 2024-09-12T01:57:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.176+0000 7f89c54b7640 1 -- 172.21.15.19:0/2965141972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89c015e5a0 msgr2=0x7f89c00cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.176+0000 7f89c54b7640 1 --2- 172.21.15.19:0/2965141972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89c015e5a0 0x7f89c00cfcd0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009d90 tx=0x7f89b002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:57:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.176+0000 7f89c54b7640 1 -- 172.21.15.19:0/2965141972 shutdown_connections 2024-09-12T01:57:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.176+0000 7f89c54b7640 1 --2- 172.21.15.19:0/2965141972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89c00d1500 0x7f89c00d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.176+0000 7f89c54b7640 1 --2- 172.21.15.19:0/2965141972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89c015e5a0 0x7f89c00cfcd0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.176+0000 7f89c54b7640 1 -- 172.21.15.19:0/2965141972 >> 172.21.15.19:0/2965141972 conn(0x7f89c008bfc0 msgr2=0x7f89c00d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.176+0000 7f89c54b7640 1 -- 172.21.15.19:0/2965141972 shutdown_connections 2024-09-12T01:57:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.176+0000 7f89c54b7640 1 -- 172.21.15.19:0/2965141972 wait complete. 2024-09-12T01:57:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.178+0000 7f89c54b7640 1 Processor -- start 2024-09-12T01:57:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.178+0000 7f89c54b7640 1 -- start start 2024-09-12T01:57:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.178+0000 7f89c54b7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89c00d1500 0x7f89c01522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.178+0000 7f89c54b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89c015e5a0 0x7f89c00cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.178+0000 7f89c54b7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89c015e980 0x7f89c00cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.178+0000 7f89c54b7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f89c006de30 con 0x7f89c015e5a0 2024-09-12T01:57:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.178+0000 7f89c54b7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f89c006d910 con 0x7f89c00d1500 2024-09-12T01:57:44.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.178+0000 7f89c54b7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f89c006dfb0 con 0x7f89c015e980 2024-09-12T01:57:44.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.179+0000 7f89be7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89c015e5a0 0x7f89c00cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:44.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.179+0000 7f89be7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89c015e5a0 0x7f89c00cfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43050/0 (socket says 172.21.15.19:43050) 2024-09-12T01:57:44.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.179+0000 7f89be7fc640 1 -- 172.21.15.19:0/1938370433 learned_addr learned my addr 172.21.15.19:0/1938370433 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:44.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.179+0000 7f89beffd640 1 --2- 172.21.15.19:0/1938370433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89c00d1500 0x7f89c01522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:44.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.179+0000 7f89bf7fe640 1 --2- 172.21.15.19:0/1938370433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89c015e980 0x7f89c00cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:44.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.179+0000 7f89be7fc640 1 -- 172.21.15.19:0/1938370433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89c015e980 msgr2=0x7f89c00cffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.179+0000 7f89be7fc640 1 --2- 172.21.15.19:0/1938370433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89c015e980 0x7f89c00cffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.179+0000 7f89be7fc640 1 -- 172.21.15.19:0/1938370433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89c00d1500 msgr2=0x7f89c01522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.179+0000 7f89be7fc640 1 --2- 172.21.15.19:0/1938370433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89c00d1500 0x7f89c01522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.179+0000 7f89be7fc640 1 -- 172.21.15.19:0/1938370433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c0152970 con 0x7f89c015e5a0 2024-09-12T01:57:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.179+0000 7f89be7fc640 1 --2- 172.21.15.19:0/1938370433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89c015e5a0 0x7f89c00cfaa0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f89a800c430 tx=0x7f89a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.179+0000 7f89b77fe640 1 -- 172.21.15.19:0/1938370433 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a80074e0 con 0x7f89c015e5a0 2024-09-12T01:57:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.179+0000 7f89b77fe640 1 -- 172.21.15.19:0/1938370433 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a80047e0 con 0x7f89c015e5a0 2024-09-12T01:57:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.179+0000 7f89c54b7640 1 -- 172.21.15.19:0/1938370433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c0152c50 con 0x7f89c015e5a0 2024-09-12T01:57:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.179+0000 7f89b77fe640 1 -- 172.21.15.19:0/1938370433 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a8004bd0 con 0x7f89c015e5a0 2024-09-12T01:57:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.179+0000 7f89c54b7640 1 -- 172.21.15.19:0/1938370433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c0153210 con 0x7f89c015e5a0 2024-09-12T01:57:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.180+0000 7f89c54b7640 1 -- 172.21.15.19:0/1938370433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89c00d0df0 con 0x7f89c015e5a0 2024-09-12T01:57:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.181+0000 7f89b77fe640 1 -- 172.21.15.19:0/1938370433 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89a8011070 con 0x7f89c015e5a0 2024-09-12T01:57:44.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.181+0000 7f89b77fe640 1 --2- 172.21.15.19:0/1938370433 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89a006be30 0x7f89a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:44.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.182+0000 7f89b77fe640 1 -- 172.21.15.19:0/1938370433 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6302+0+0 (secure 0 0 0) 0x7f89a808ac30 con 0x7f89c015e5a0 2024-09-12T01:57:44.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.182+0000 7f89beffd640 1 --2- 172.21.15.19:0/1938370433 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89a006be30 0x7f89a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:44.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.182+0000 7f89beffd640 1 --2- 172.21.15.19:0/1938370433 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89a006be30 0x7f89a006e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f89b0034000 tx=0x7f89b002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:44.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.186+0000 7f89b77fe640 1 -- 172.21.15.19:0/1938370433 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f89a8058d40 con 0x7f89c015e5a0 2024-09-12T01:57:44.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:44.397+0000 7f89c54b7640 1 -- 172.21.15.19:0/1938370433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f89c00d1ba0 con 0x7f89c015e5a0 2024-09-12T01:57:45.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.057+0000 7f89b77fe640 1 -- 172.21.15.19:0/1938370433 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) ==== 104+0+0 (secure 0 0 0) 0x7f89a805d040 con 0x7f89c015e5a0 2024-09-12T01:57:45.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.060+0000 7f89c54b7640 1 -- 172.21.15.19:0/1938370433 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89a006be30 msgr2=0x7f89a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:45.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.060+0000 7f89c54b7640 1 --2- 172.21.15.19:0/1938370433 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89a006be30 0x7f89a006e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f89b0034000 tx=0x7f89b002f000 comp rx=0 tx=0).stop 2024-09-12T01:57:45.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.060+0000 7f89c54b7640 1 -- 172.21.15.19:0/1938370433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89c015e5a0 msgr2=0x7f89c00cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:45.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.060+0000 7f89c54b7640 1 --2- 172.21.15.19:0/1938370433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89c015e5a0 0x7f89c00cfaa0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f89a800c430 tx=0x7f89a800c8f0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.060+0000 7f89c54b7640 1 -- 172.21.15.19:0/1938370433 shutdown_connections 2024-09-12T01:57:45.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.060+0000 7f89c54b7640 1 --2- 172.21.15.19:0/1938370433 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89a006be30 0x7f89a006e2f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.060+0000 7f89c54b7640 1 --2- 172.21.15.19:0/1938370433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89c015e980 0x7f89c00cffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.060+0000 7f89c54b7640 1 --2- 172.21.15.19:0/1938370433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89c015e5a0 0x7f89c00cfaa0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.060+0000 7f89c54b7640 1 --2- 172.21.15.19:0/1938370433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89c00d1500 0x7f89c01522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.060+0000 7f89c54b7640 1 -- 172.21.15.19:0/1938370433 >> 172.21.15.19:0/1938370433 conn(0x7f89c008bfc0 msgr2=0x7f89c00b1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:45.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.060+0000 7f89c54b7640 1 -- 172.21.15.19:0/1938370433 shutdown_connections 2024-09-12T01:57:45.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.060+0000 7f89c54b7640 1 -- 172.21.15.19:0/1938370433 wait complete. 2024-09-12T01:57:45.073 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T01:57:45.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.222+0000 7f10c594b640 1 Processor -- start 2024-09-12T01:57:45.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.222+0000 7f10c594b640 1 -- start start 2024-09-12T01:57:45.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.223+0000 7f10c594b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f10c015ca50 0x7f10c01594d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:45.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.223+0000 7f10c594b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10c01592a0 con 0x7f10c0158ec0 2024-09-12T01:57:45.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.223+0000 7f10c594b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10c015d010 con 0x7f10c00b4d50 2024-09-12T01:57:45.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.223+0000 7f10c594b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f10c015d2f0 con 0x7f10c015ca50 2024-09-12T01:57:45.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.223+0000 7f10beffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f10c0158ec0 0x7f10c015c310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54800/0 (socket says 172.21.15.19:54800) 2024-09-12T01:57:45.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.223+0000 7f10beffd640 1 -- 172.21.15.19:0/2186123295 learned_addr learned my addr 172.21.15.19:0/2186123295 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:45.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bdffb640 1 -- 172.21.15.19:0/2186123295 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 521679350 0 0) 0x7f10c01592a0 con 0x7f10c0158ec0 2024-09-12T01:57:45.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10be7fc640 1 --2- 172.21.15.19:0/2186123295 >> v2:172.21.15.135:3300/0 conn(0x7f10c015ca50 0x7f10c01594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:45.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bdffb640 1 -- 172.21.15.19:0/2186123295 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10ac003520 con 0x7f10c0158ec0 2024-09-12T01:57:45.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bdffb640 1 -- 172.21.15.19:0/2186123295 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2494272747 0 0) 0x7f10ac003520 con 0x7f10c0158ec0 2024-09-12T01:57:45.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bdffb640 1 -- 172.21.15.19:0/2186123295 >> v2:172.21.15.135:3300/0 conn(0x7f10c015ca50 msgr2=0x7f10c01594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:45.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bdffb640 1 --2- 172.21.15.19:0/2186123295 >> v2:172.21.15.135:3300/0 conn(0x7f10c015ca50 0x7f10c01594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bdffb640 1 -- 172.21.15.19:0/2186123295 >> v1:172.21.15.135:6789/0 conn(0x7f10c00b4d50 legacy=0x7f10c00b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:45.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bdffb640 1 -- 172.21.15.19:0/2186123295 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c015d5d0 con 0x7f10c0158ec0 2024-09-12T01:57:45.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bdffb640 1 -- 172.21.15.19:0/2186123295 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f10b8001670 con 0x7f10c0158ec0 2024-09-12T01:57:45.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bdffb640 1 -- 172.21.15.19:0/2186123295 >> v1:172.21.15.19:6789/0 conn(0x7f10c0158ec0 legacy=0x7f10c015c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:45.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bdffb640 1 --2- 172.21.15.19:0/2186123295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10ac0039b0 0x7f10ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:45.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bdffb640 1 --2- 172.21.15.19:0/2186123295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10ac004800 0x7f10ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:45.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bdffb640 1 --2- 172.21.15.19:0/2186123295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ac0051c0 0x7f10ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:45.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bdffb640 1 -- 172.21.15.19:0/2186123295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f10c015d2f0 con 0x7f10ac0051c0 2024-09-12T01:57:45.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bdffb640 1 -- 172.21.15.19:0/2186123295 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac00c060 con 0x7f10ac0039b0 2024-09-12T01:57:45.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bdffb640 1 -- 172.21.15.19:0/2186123295 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f10ac00c260 con 0x7f10ac004800 2024-09-12T01:57:45.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bf7fe640 1 --2- 172.21.15.19:0/2186123295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ac0051c0 0x7f10ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:45.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10beffd640 1 --2- 172.21.15.19:0/2186123295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10ac0039b0 0x7f10ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:45.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10be7fc640 1 --2- 172.21.15.19:0/2186123295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10ac004800 0x7f10ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:45.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bf7fe640 1 -- 172.21.15.19:0/2186123295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10ac004800 msgr2=0x7f10ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:45.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bf7fe640 1 --2- 172.21.15.19:0/2186123295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10ac004800 0x7f10ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bf7fe640 1 -- 172.21.15.19:0/2186123295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10ac0039b0 msgr2=0x7f10ac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:45.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bf7fe640 1 --2- 172.21.15.19:0/2186123295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10ac0039b0 0x7f10ac003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.224+0000 7f10bf7fe640 1 -- 172.21.15.19:0/2186123295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10ac003520 con 0x7f10ac0051c0 2024-09-12T01:57:45.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.225+0000 7f10bf7fe640 1 -- 172.21.15.19:0/2186123295 reap_dead start 2024-09-12T01:57:45.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.225+0000 7f10bf7fe640 1 --2- 172.21.15.19:0/2186123295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ac0051c0 0x7f10ac00b9c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f10b0001e50 tx=0x7f10ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46ec24735713361 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:45.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.225+0000 7f10bdffb640 1 -- 172.21.15.19:0/2186123295 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b0001a70 con 0x7f10ac0051c0 2024-09-12T01:57:45.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.225+0000 7f10bdffb640 1 -- 172.21.15.19:0/2186123295 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b0003970 con 0x7f10ac0051c0 2024-09-12T01:57:45.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.225+0000 7f10bdffb640 1 -- 172.21.15.19:0/2186123295 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b0003d60 con 0x7f10ac0051c0 2024-09-12T01:57:45.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.226+0000 7f10c594b640 1 -- 172.21.15.19:0/2186123295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ac0051c0 msgr2=0x7f10ac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:45.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.226+0000 7f10c594b640 1 --2- 172.21.15.19:0/2186123295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ac0051c0 0x7f10ac00b9c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f10b0001e50 tx=0x7f10ac005830 comp rx=0 tx=0).stop 2024-09-12T01:57:45.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.226+0000 7f10c594b640 1 -- 172.21.15.19:0/2186123295 shutdown_connections 2024-09-12T01:57:45.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.226+0000 7f10c594b640 1 --2- 172.21.15.19:0/2186123295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ac0051c0 0x7f10ac00b9c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.226+0000 7f10c594b640 1 -- 172.21.15.19:0/2186123295 >> 172.21.15.19:0/2186123295 conn(0x7f10c009aa30 msgr2=0x7f10c00b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:45.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.226+0000 7f10c594b640 1 -- 172.21.15.19:0/2186123295 shutdown_connections 2024-09-12T01:57:45.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.226+0000 7f10c594b640 1 -- 172.21.15.19:0/2186123295 wait complete. 2024-09-12T01:57:45.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.227+0000 7f10c594b640 1 Processor -- start 2024-09-12T01:57:45.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.227+0000 7f10c594b640 1 -- start start 2024-09-12T01:57:45.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.228+0000 7f10c594b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10ac0051c0 0x7f10c01f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:45.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.228+0000 7f10c594b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10c014af70 0x7f10c00cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:45.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.228+0000 7f10c594b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10c00ceb90 0x7f10c00cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:45.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.228+0000 7f10c594b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f10c00b5160 con 0x7f10c014af70 2024-09-12T01:57:45.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.228+0000 7f10c594b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f10c015db90 con 0x7f10ac0051c0 2024-09-12T01:57:45.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.228+0000 7f10c594b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f10c00b52e0 con 0x7f10c00ceb90 2024-09-12T01:57:45.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.228+0000 7f10be7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10c014af70 0x7f10c00cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:45.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.228+0000 7f10be7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10c014af70 0x7f10c00cb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43060/0 (socket says 172.21.15.19:43060) 2024-09-12T01:57:45.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.228+0000 7f10be7fc640 1 -- 172.21.15.19:0/3027365056 learned_addr learned my addr 172.21.15.19:0/3027365056 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:45.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.228+0000 7f10beffd640 1 --2- 172.21.15.19:0/3027365056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10ac0051c0 0x7f10c01f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:45.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.228+0000 7f10bf7fe640 1 --2- 172.21.15.19:0/3027365056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10c00ceb90 0x7f10c00cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:45.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.228+0000 7f10be7fc640 1 -- 172.21.15.19:0/3027365056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10c00ceb90 msgr2=0x7f10c00cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:45.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.228+0000 7f10be7fc640 1 --2- 172.21.15.19:0/3027365056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10c00ceb90 0x7f10c00cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.228+0000 7f10be7fc640 1 -- 172.21.15.19:0/3027365056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10ac0051c0 msgr2=0x7f10c01f5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:45.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.228+0000 7f10be7fc640 1 --2- 172.21.15.19:0/3027365056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10ac0051c0 0x7f10c01f5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.228+0000 7f10be7fc640 1 -- 172.21.15.19:0/3027365056 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c00cb570 con 0x7f10c014af70 2024-09-12T01:57:45.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.229+0000 7f10be7fc640 1 --2- 172.21.15.19:0/3027365056 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10c014af70 0x7f10c00cb030 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f10a8011910 tx=0x7f10a8011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:45.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.229+0000 7f10b7fff640 1 -- 172.21.15.19:0/3027365056 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a800fa30 con 0x7f10c014af70 2024-09-12T01:57:45.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.229+0000 7f10b7fff640 1 -- 172.21.15.19:0/3027365056 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a800fbd0 con 0x7f10c014af70 2024-09-12T01:57:45.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.229+0000 7f10c594b640 1 -- 172.21.15.19:0/3027365056 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c00cb840 con 0x7f10c014af70 2024-09-12T01:57:45.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.229+0000 7f10b7fff640 1 -- 172.21.15.19:0/3027365056 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8014440 con 0x7f10c014af70 2024-09-12T01:57:45.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.229+0000 7f10c594b640 1 -- 172.21.15.19:0/3027365056 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c006f5f0 con 0x7f10c014af70 2024-09-12T01:57:45.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.230+0000 7f10c594b640 1 -- 172.21.15.19:0/3027365056 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10c00b5670 con 0x7f10c014af70 2024-09-12T01:57:45.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.230+0000 7f10b7fff640 1 -- 172.21.15.19:0/3027365056 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f10a8012040 con 0x7f10c014af70 2024-09-12T01:57:45.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.231+0000 7f10b7fff640 1 --2- 172.21.15.19:0/3027365056 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f10a006be60 0x7f10a006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:45.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.231+0000 7f10b7fff640 1 -- 172.21.15.19:0/3027365056 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6302+0+0 (secure 0 0 0) 0x7f10a808b470 con 0x7f10c014af70 2024-09-12T01:57:45.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.231+0000 7f10beffd640 1 --2- 172.21.15.19:0/3027365056 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f10a006be60 0x7f10a006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:45.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.231+0000 7f10beffd640 1 --2- 172.21.15.19:0/3027365056 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f10a006be60 0x7f10a006e320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f10b8001eb0 tx=0x7f10b80015b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:45.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.235+0000 7f10b7fff640 1 -- 172.21.15.19:0/3027365056 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f10a8019030 con 0x7f10c014af70 2024-09-12T01:57:45.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:45.410+0000 7f10c594b640 1 -- 172.21.15.19:0/3027365056 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f10c00d19e0 con 0x7f10c014af70 2024-09-12T01:57:46.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.059+0000 7f10b7fff640 1 -- 172.21.15.19:0/3027365056 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) ==== 181+0+0 (secure 0 0 0) 0x7f10a8059c60 con 0x7f10c014af70 2024-09-12T01:57:46.059 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-09-12T01:57:46.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.063+0000 7f10c594b640 1 -- 172.21.15.19:0/3027365056 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f10a006be60 msgr2=0x7f10a006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:46.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.063+0000 7f10c594b640 1 --2- 172.21.15.19:0/3027365056 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f10a006be60 0x7f10a006e320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f10b8001eb0 tx=0x7f10b80015b0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.063+0000 7f10c594b640 1 -- 172.21.15.19:0/3027365056 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10c014af70 msgr2=0x7f10c00cb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:46.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.063+0000 7f10c594b640 1 --2- 172.21.15.19:0/3027365056 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10c014af70 0x7f10c00cb030 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f10a8011910 tx=0x7f10a8011d10 comp rx=0 tx=0).stop 2024-09-12T01:57:46.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.063+0000 7f10c594b640 1 -- 172.21.15.19:0/3027365056 shutdown_connections 2024-09-12T01:57:46.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.063+0000 7f10c594b640 1 --2- 172.21.15.19:0/3027365056 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f10a006be60 0x7f10a006e320 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.063+0000 7f10c594b640 1 --2- 172.21.15.19:0/3027365056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10c00ceb90 0x7f10c00cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.063+0000 7f10c594b640 1 --2- 172.21.15.19:0/3027365056 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10c014af70 0x7f10c00cb030 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.063+0000 7f10c594b640 1 --2- 172.21.15.19:0/3027365056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10ac0051c0 0x7f10c01f5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.063+0000 7f10c594b640 1 -- 172.21.15.19:0/3027365056 >> 172.21.15.19:0/3027365056 conn(0x7f10c009aa30 msgr2=0x7f10c00d0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.063+0000 7f10c594b640 1 -- 172.21.15.19:0/3027365056 shutdown_connections 2024-09-12T01:57:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.063+0000 7f10c594b640 1 -- 172.21.15.19:0/3027365056 wait complete. 2024-09-12T01:57:46.078 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T01:57:46.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.191+0000 7f4f356d0640 1 Processor -- start 2024-09-12T01:57:46.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.191+0000 7f4f356d0640 1 -- start start 2024-09-12T01:57:46.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.191+0000 7f4f356d0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4f3015e7f0 0x7f4f300b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.192+0000 7f4f356d0640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3006cdc0 con 0x7f4f300af210 2024-09-12T01:57:46.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.192+0000 7f4f356d0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3006d0a0 con 0x7f4f30071180 2024-09-12T01:57:46.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.192+0000 7f4f356d0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f4f3006d380 con 0x7f4f3015e7f0 2024-09-12T01:57:46.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.192+0000 7f4f2e7fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4f300af210 0x7f4f30070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54804/0 (socket says 172.21.15.19:54804) 2024-09-12T01:57:46.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.192+0000 7f4f2e7fc640 1 -- 172.21.15.19:0/1710347926 learned_addr learned my addr 172.21.15.19:0/1710347926 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:46.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.192+0000 7f4f2effd640 1 --2- 172.21.15.19:0/1710347926 >> v2:172.21.15.135:3300/0 conn(0x7f4f3015e7f0 0x7f4f300b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.192+0000 7f4f2dffb640 1 -- 172.21.15.19:0/1710347926 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3694286003 0 0) 0x7f4f3006cdc0 con 0x7f4f300af210 2024-09-12T01:57:46.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.192+0000 7f4f2dffb640 1 -- 172.21.15.19:0/1710347926 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f18003520 con 0x7f4f300af210 2024-09-12T01:57:46.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.192+0000 7f4f2effd640 1 -- 172.21.15.19:0/1710347926 >> v1:172.21.15.135:6789/0 conn(0x7f4f30071180 legacy=0x7f4f3006de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:46.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.192+0000 7f4f2dffb640 1 -- 172.21.15.19:0/1710347926 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 838474332 0 0) 0x7f4f18003520 con 0x7f4f300af210 2024-09-12T01:57:46.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.192+0000 7f4f2effd640 1 -- 172.21.15.19:0/1710347926 >> v1:172.21.15.19:6789/0 conn(0x7f4f300af210 legacy=0x7f4f30070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:46.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.192+0000 7f4f2effd640 1 -- 172.21.15.19:0/1710347926 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f3006d660 con 0x7f4f3015e7f0 2024-09-12T01:57:46.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.193+0000 7f4f2effd640 1 --2- 172.21.15.19:0/1710347926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f3015e7f0 0x7f4f300b6d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4f200097a0 tx=0x7f4f2002a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=692edbffe2214c23 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:46.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.193+0000 7f4f2dffb640 1 -- 172.21.15.19:0/1710347926 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f20037070 con 0x7f4f3015e7f0 2024-09-12T01:57:46.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.193+0000 7f4f2dffb640 1 -- 172.21.15.19:0/1710347926 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2002ab60 con 0x7f4f3015e7f0 2024-09-12T01:57:46.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.193+0000 7f4f2dffb640 1 -- 172.21.15.19:0/1710347926 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f24001670 con 0x7f4f3015e7f0 2024-09-12T01:57:46.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.194+0000 7f4f356d0640 1 -- 172.21.15.19:0/1710347926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f3015e7f0 msgr2=0x7f4f300b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:46.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.194+0000 7f4f356d0640 1 --2- 172.21.15.19:0/1710347926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f3015e7f0 0x7f4f300b6d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4f200097a0 tx=0x7f4f2002a0d0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.194+0000 7f4f356d0640 1 -- 172.21.15.19:0/1710347926 shutdown_connections 2024-09-12T01:57:46.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.194+0000 7f4f356d0640 1 --2- 172.21.15.19:0/1710347926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f3015e7f0 0x7f4f300b6d10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.194+0000 7f4f356d0640 1 -- 172.21.15.19:0/1710347926 >> 172.21.15.19:0/1710347926 conn(0x7f4f300b3f30 msgr2=0x7f4f300b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:46.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.194+0000 7f4f356d0640 1 -- 172.21.15.19:0/1710347926 shutdown_connections 2024-09-12T01:57:46.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.194+0000 7f4f356d0640 1 -- 172.21.15.19:0/1710347926 wait complete. 2024-09-12T01:57:46.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.195+0000 7f4f356d0640 1 Processor -- start 2024-09-12T01:57:46.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.195+0000 7f4f356d0640 1 -- start start 2024-09-12T01:57:46.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.196+0000 7f4f356d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30071180 0x7f4f3014fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.196+0000 7f4f356d0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f300af210 0x7f4f301613e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.196+0000 7f4f356d0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f3015e7f0 0x7f4f301505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.196+0000 7f4f356d0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4f300b73d0 con 0x7f4f30071180 2024-09-12T01:57:46.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.196+0000 7f4f356d0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f300b7250 con 0x7f4f300af210 2024-09-12T01:57:46.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.196+0000 7f4f356d0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4f300b7550 con 0x7f4f3015e7f0 2024-09-12T01:57:46.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.196+0000 7f4f2effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30071180 0x7f4f3014fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.196+0000 7f4f2effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30071180 0x7f4f3014fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43076/0 (socket says 172.21.15.19:43076) 2024-09-12T01:57:46.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.196+0000 7f4f2effd640 1 -- 172.21.15.19:0/2485078645 learned_addr learned my addr 172.21.15.19:0/2485078645 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:46.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.196+0000 7f4f2e7fc640 1 --2- 172.21.15.19:0/2485078645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f300af210 0x7f4f301613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.196+0000 7f4f2f7fe640 1 --2- 172.21.15.19:0/2485078645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f3015e7f0 0x7f4f301505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.196+0000 7f4f2effd640 1 -- 172.21.15.19:0/2485078645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f3015e7f0 msgr2=0x7f4f301505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:46.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.196+0000 7f4f2effd640 1 --2- 172.21.15.19:0/2485078645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f3015e7f0 0x7f4f301505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.196+0000 7f4f2effd640 1 -- 172.21.15.19:0/2485078645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f300af210 msgr2=0x7f4f301613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:46.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.196+0000 7f4f2effd640 1 --2- 172.21.15.19:0/2485078645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f300af210 0x7f4f301613e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.197+0000 7f4f2effd640 1 -- 172.21.15.19:0/2485078645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f300cdd80 con 0x7f4f30071180 2024-09-12T01:57:46.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.197+0000 7f4f2e7fc640 1 --2- 172.21.15.19:0/2485078645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f300af210 0x7f4f301613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:46.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.197+0000 7f4f2f7fe640 1 --2- 172.21.15.19:0/2485078645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f3015e7f0 0x7f4f301505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:46.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.197+0000 7f4f2effd640 1 --2- 172.21.15.19:0/2485078645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30071180 0x7f4f3014fdf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4f200097a0 tx=0x7f4f200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:46.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.197+0000 7f4f177fe640 1 -- 172.21.15.19:0/2485078645 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f20037040 con 0x7f4f30071180 2024-09-12T01:57:46.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.197+0000 7f4f177fe640 1 -- 172.21.15.19:0/2485078645 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f20004030 con 0x7f4f30071180 2024-09-12T01:57:46.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.197+0000 7f4f177fe640 1 -- 172.21.15.19:0/2485078645 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f20004420 con 0x7f4f30071180 2024-09-12T01:57:46.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.197+0000 7f4f356d0640 1 -- 172.21.15.19:0/2485078645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f300ce060 con 0x7f4f30071180 2024-09-12T01:57:46.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.197+0000 7f4f356d0640 1 -- 172.21.15.19:0/2485078645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f30150330 con 0x7f4f30071180 2024-09-12T01:57:46.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.198+0000 7f4f356d0640 1 -- 172.21.15.19:0/2485078645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f300ce230 con 0x7f4f30071180 2024-09-12T01:57:46.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.199+0000 7f4f177fe640 1 -- 172.21.15.19:0/2485078645 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f2003a040 con 0x7f4f30071180 2024-09-12T01:57:46.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.199+0000 7f4f177fe640 1 --2- 172.21.15.19:0/2485078645 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4f1c06be30 0x7f4f1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.199+0000 7f4f177fe640 1 -- 172.21.15.19:0/2485078645 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5864+0+0 (secure 0 0 0) 0x7f4f200ab420 con 0x7f4f30071180 2024-09-12T01:57:46.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.199+0000 7f4f2e7fc640 1 --2- 172.21.15.19:0/2485078645 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4f1c06be30 0x7f4f1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.200+0000 7f4f2e7fc640 1 --2- 172.21.15.19:0/2485078645 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4f1c06be30 0x7f4f1c06e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4f240017e0 tx=0x7f4f24009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:46.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.203+0000 7f4f177fe640 1 -- 172.21.15.19:0/2485078645 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f20042020 con 0x7f4f30071180 2024-09-12T01:57:46.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:46.379+0000 7f4f356d0640 1 -- 172.21.15.19:0/2485078645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4f300b0f70 con 0x7f4f30071180 2024-09-12T01:57:47.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.064+0000 7f4f177fe640 1 -- 172.21.15.19:0/2485078645 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) ==== 169+0+0 (secure 0 0 0) 0x7f4f20079e50 con 0x7f4f30071180 2024-09-12T01:57:47.064 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-09-12T01:57:47.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.068+0000 7f4f356d0640 1 -- 172.21.15.19:0/2485078645 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4f1c06be30 msgr2=0x7f4f1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:47.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.068+0000 7f4f356d0640 1 --2- 172.21.15.19:0/2485078645 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4f1c06be30 0x7f4f1c06e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4f240017e0 tx=0x7f4f24009040 comp rx=0 tx=0).stop 2024-09-12T01:57:47.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.068+0000 7f4f356d0640 1 -- 172.21.15.19:0/2485078645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30071180 msgr2=0x7f4f3014fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:47.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.068+0000 7f4f356d0640 1 --2- 172.21.15.19:0/2485078645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30071180 0x7f4f3014fdf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4f200097a0 tx=0x7f4f200046c0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.069+0000 7f4f356d0640 1 -- 172.21.15.19:0/2485078645 shutdown_connections 2024-09-12T01:57:47.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.069+0000 7f4f356d0640 1 --2- 172.21.15.19:0/2485078645 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4f1c06be30 0x7f4f1c06e2f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.069+0000 7f4f356d0640 1 --2- 172.21.15.19:0/2485078645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f3015e7f0 0x7f4f301505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.069+0000 7f4f356d0640 1 --2- 172.21.15.19:0/2485078645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f300af210 0x7f4f301613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.069+0000 7f4f356d0640 1 --2- 172.21.15.19:0/2485078645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30071180 0x7f4f3014fdf0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.069+0000 7f4f356d0640 1 -- 172.21.15.19:0/2485078645 >> 172.21.15.19:0/2485078645 conn(0x7f4f300b3f30 msgr2=0x7f4f300b1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:47.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.069+0000 7f4f356d0640 1 -- 172.21.15.19:0/2485078645 shutdown_connections 2024-09-12T01:57:47.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.069+0000 7f4f356d0640 1 -- 172.21.15.19:0/2485078645 wait complete. 2024-09-12T01:57:47.085 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T01:57:47.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.195+0000 7f0bafe5c640 1 Processor -- start 2024-09-12T01:57:47.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.195+0000 7f0bafe5c640 1 -- start start 2024-09-12T01:57:47.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.196+0000 7f0bafe5c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0ba80d5100 0x7f0ba80cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:47.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.196+0000 7f0bafe5c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0ba81621b0 0x7f0ba8162620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:47.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.196+0000 7f0bafe5c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ba80d3a60 con 0x7f0ba815e640 2024-09-12T01:57:47.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.196+0000 7f0bafe5c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f0ba8162b60 con 0x7f0ba81621b0 2024-09-12T01:57:47.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.196+0000 7f0bafe5c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0ba80cec40 con 0x7f0ba80d5100 2024-09-12T01:57:47.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.196+0000 7f0bae3f9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0ba81621b0 0x7f0ba8162620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:47.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.196+0000 7f0bae3f9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0ba81621b0 0x7f0ba8162620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43082/0 (socket says 172.21.15.19:43082) 2024-09-12T01:57:47.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.196+0000 7f0bae3f9640 1 -- 172.21.15.19:0/979629626 learned_addr learned my addr 172.21.15.19:0/979629626 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:47.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.196+0000 7f0bad3f7640 1 --2- 172.21.15.19:0/979629626 >> v2:172.21.15.135:3300/0 conn(0x7f0ba80d5100 0x7f0ba80cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:47.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.196+0000 7f0bae3f9640 1 -- 172.21.15.19:0/979629626 >> v2:172.21.15.135:3300/0 conn(0x7f0ba80d5100 msgr2=0x7f0ba80cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:47.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.196+0000 7f0bae3f9640 1 --2- 172.21.15.19:0/979629626 >> v2:172.21.15.135:3300/0 conn(0x7f0ba80d5100 0x7f0ba80cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.196+0000 7f0bae3f9640 1 -- 172.21.15.19:0/979629626 >> v1:172.21.15.135:6789/0 conn(0x7f0ba815e640 legacy=0x7f0ba80d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:47.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.197+0000 7f0bae3f9640 1 -- 172.21.15.19:0/979629626 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba80cef20 con 0x7f0ba81621b0 2024-09-12T01:57:47.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.197+0000 7f0bae3f9640 1 --2- 172.21.15.19:0/979629626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ba81621b0 0x7f0ba8162620 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0ba808d4d0 tx=0x7f0ba002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c5be3b7d84c7fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:47.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.197+0000 7f0bacbf6640 1 -- 172.21.15.19:0/979629626 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0036070 con 0x7f0ba81621b0 2024-09-12T01:57:47.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.197+0000 7f0bacbf6640 1 -- 172.21.15.19:0/979629626 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba0031600 con 0x7f0ba81621b0 2024-09-12T01:57:47.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.197+0000 7f0bacbf6640 1 -- 172.21.15.19:0/979629626 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba00319d0 con 0x7f0ba81621b0 2024-09-12T01:57:47.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.198+0000 7f0bafe5c640 1 -- 172.21.15.19:0/979629626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ba81621b0 msgr2=0x7f0ba8162620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.198+0000 7f0bafe5c640 1 --2- 172.21.15.19:0/979629626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ba81621b0 0x7f0ba8162620 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0ba808d4d0 tx=0x7f0ba002a780 comp rx=0 tx=0).stop 2024-09-12T01:57:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.198+0000 7f0bafe5c640 1 -- 172.21.15.19:0/979629626 shutdown_connections 2024-09-12T01:57:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.198+0000 7f0bafe5c640 1 --2- 172.21.15.19:0/979629626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ba81621b0 0x7f0ba8162620 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.198+0000 7f0bafe5c640 1 --2- 172.21.15.19:0/979629626 >> v2:172.21.15.135:3300/0 conn(0x7f0ba80d5100 0x7f0ba80cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.198+0000 7f0bafe5c640 1 -- 172.21.15.19:0/979629626 >> 172.21.15.19:0/979629626 conn(0x7f0ba808bfc0 msgr2=0x7f0ba80d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.198+0000 7f0bafe5c640 1 -- 172.21.15.19:0/979629626 shutdown_connections 2024-09-12T01:57:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.198+0000 7f0bafe5c640 1 -- 172.21.15.19:0/979629626 wait complete. 2024-09-12T01:57:47.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.199+0000 7f0bafe5c640 1 Processor -- start 2024-09-12T01:57:47.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.199+0000 7f0bafe5c640 1 -- start start 2024-09-12T01:57:47.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.200+0000 7f0bafe5c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ba80d5100 0x7f0ba81f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:47.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.200+0000 7f0bafe5c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ba815e640 0x7f0ba80b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:47.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.200+0000 7f0bafe5c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba81621b0 0x7f0ba80c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:47.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.200+0000 7f0bafe5c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba815ea20 con 0x7f0ba80d5100 2024-09-12T01:57:47.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.200+0000 7f0bafe5c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba80cf4e0 con 0x7f0ba81621b0 2024-09-12T01:57:47.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.200+0000 7f0bafe5c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0ba80cff40 con 0x7f0ba815e640 2024-09-12T01:57:47.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.200+0000 7f0badbf8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ba80d5100 0x7f0ba81f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:47.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.200+0000 7f0badbf8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ba80d5100 0x7f0ba81f5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43096/0 (socket says 172.21.15.19:43096) 2024-09-12T01:57:47.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.200+0000 7f0badbf8640 1 -- 172.21.15.19:0/2926291596 learned_addr learned my addr 172.21.15.19:0/2926291596 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:47.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.200+0000 7f0bad3f7640 1 --2- 172.21.15.19:0/2926291596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ba815e640 0x7f0ba80b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:47.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.200+0000 7f0bae3f9640 1 --2- 172.21.15.19:0/2926291596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba81621b0 0x7f0ba80c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:47.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.200+0000 7f0badbf8640 1 -- 172.21.15.19:0/2926291596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ba815e640 msgr2=0x7f0ba80b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:47.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.200+0000 7f0badbf8640 1 --2- 172.21.15.19:0/2926291596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ba815e640 0x7f0ba80b66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.200+0000 7f0badbf8640 1 -- 172.21.15.19:0/2926291596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba81621b0 msgr2=0x7f0ba80c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:47.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.200+0000 7f0badbf8640 1 --2- 172.21.15.19:0/2926291596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba81621b0 0x7f0ba80c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.200+0000 7f0badbf8640 1 -- 172.21.15.19:0/2926291596 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba80b4050 con 0x7f0ba80d5100 2024-09-12T01:57:47.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.201+0000 7f0badbf8640 1 --2- 172.21.15.19:0/2926291596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ba80d5100 0x7f0ba81f5a60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0ba400c430 tx=0x7f0ba400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:47.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.201+0000 7f0b9e7fc640 1 -- 172.21.15.19:0/2926291596 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4011790 con 0x7f0ba80d5100 2024-09-12T01:57:47.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.201+0000 7f0b9e7fc640 1 -- 172.21.15.19:0/2926291596 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba4017070 con 0x7f0ba80d5100 2024-09-12T01:57:47.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.201+0000 7f0bafe5c640 1 -- 172.21.15.19:0/2926291596 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ba80b4330 con 0x7f0ba80d5100 2024-09-12T01:57:47.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.201+0000 7f0b9e7fc640 1 -- 172.21.15.19:0/2926291596 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4011b70 con 0x7f0ba80d5100 2024-09-12T01:57:47.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.201+0000 7f0bafe5c640 1 -- 172.21.15.19:0/2926291596 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ba80b48f0 con 0x7f0ba80d5100 2024-09-12T01:57:47.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.202+0000 7f0bafe5c640 1 -- 172.21.15.19:0/2926291596 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ba80cfa00 con 0x7f0ba80d5100 2024-09-12T01:57:47.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.202+0000 7f0b9e7fc640 1 -- 172.21.15.19:0/2926291596 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ba4011d10 con 0x7f0ba80d5100 2024-09-12T01:57:47.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.203+0000 7f0b9e7fc640 1 --2- 172.21.15.19:0/2926291596 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0b8c06be30 0x7f0b8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:47.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.203+0000 7f0b9e7fc640 1 -- 172.21.15.19:0/2926291596 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f0ba408a9c0 con 0x7f0ba80d5100 2024-09-12T01:57:47.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.203+0000 7f0bad3f7640 1 --2- 172.21.15.19:0/2926291596 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0b8c06be30 0x7f0b8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:47.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.204+0000 7f0bad3f7640 1 --2- 172.21.15.19:0/2926291596 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0b8c06be30 0x7f0b8c06e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0ba81f7df0 tx=0x7f0b98008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:47.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.208+0000 7f0b9e7fc640 1 -- 172.21.15.19:0/2926291596 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ba408ce20 con 0x7f0ba80d5100 2024-09-12T01:57:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.385+0000 7f0bafe5c640 1 -- 172.21.15.19:0/2926291596 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f0ba80ba4d0 con 0x7f0ba80d5100 2024-09-12T01:57:47.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.388+0000 7f0b9e7fc640 1 -- 172.21.15.19:0/2926291596 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f0ba4058ed0 con 0x7f0ba80d5100 2024-09-12T01:57:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.390+0000 7f0bafe5c640 1 -- 172.21.15.19:0/2926291596 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0b8c06be30 msgr2=0x7f0b8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.390+0000 7f0bafe5c640 1 --2- 172.21.15.19:0/2926291596 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0b8c06be30 0x7f0b8c06e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0ba81f7df0 tx=0x7f0b98008040 comp rx=0 tx=0).stop 2024-09-12T01:57:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.390+0000 7f0bafe5c640 1 -- 172.21.15.19:0/2926291596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ba80d5100 msgr2=0x7f0ba81f5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.390+0000 7f0bafe5c640 1 --2- 172.21.15.19:0/2926291596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ba80d5100 0x7f0ba81f5a60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0ba400c430 tx=0x7f0ba400c8f0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.390+0000 7f0bafe5c640 1 -- 172.21.15.19:0/2926291596 shutdown_connections 2024-09-12T01:57:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.390+0000 7f0bafe5c640 1 --2- 172.21.15.19:0/2926291596 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0b8c06be30 0x7f0b8c06e2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.390+0000 7f0bafe5c640 1 --2- 172.21.15.19:0/2926291596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba81621b0 0x7f0ba80c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.390+0000 7f0bafe5c640 1 --2- 172.21.15.19:0/2926291596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ba815e640 0x7f0ba80b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.390+0000 7f0bafe5c640 1 --2- 172.21.15.19:0/2926291596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ba80d5100 0x7f0ba81f5a60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.390+0000 7f0bafe5c640 1 -- 172.21.15.19:0/2926291596 >> 172.21.15.19:0/2926291596 conn(0x7f0ba808bfc0 msgr2=0x7f0ba80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:47.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.390+0000 7f0bafe5c640 1 -- 172.21.15.19:0/2926291596 shutdown_connections 2024-09-12T01:57:47.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.390+0000 7f0bafe5c640 1 -- 172.21.15.19:0/2926291596 wait complete. 2024-09-12T01:57:47.402 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_damage.TestDamage.test_damaged_dentry' 2024-09-12T01:57:47.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.503+0000 7f0c9cdc4640 1 Processor -- start 2024-09-12T01:57:47.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.503+0000 7f0c9cdc4640 1 -- start start 2024-09-12T01:57:47.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.504+0000 7f0c9cdc4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c9815c520 0x7f0c9809b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:47.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.504+0000 7f0c9cdc4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0c980d1090 0x7f0c980b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:47.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.504+0000 7f0c9cdc4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c980cec00 con 0x7f0c980b1620 2024-09-12T01:57:47.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.504+0000 7f0c9cdc4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f0c9809bd90 con 0x7f0c9815c520 2024-09-12T01:57:47.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.504+0000 7f0c9cdc4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0c980d0010 con 0x7f0c980d1090 2024-09-12T01:57:47.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.505+0000 7f0c9659c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c9815c520 0x7f0c9809b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:47.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.505+0000 7f0c95d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0c980b1620 0x7f0c980d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54808/0 (socket says 172.21.15.19:54808) 2024-09-12T01:57:47.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.505+0000 7f0c95d9b640 1 -- 172.21.15.19:0/468860652 learned_addr learned my addr 172.21.15.19:0/468860652 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:47.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.505+0000 7f0c9659c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c9815c520 0x7f0c9809b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43108/0 (socket says 172.21.15.19:43108) 2024-09-12T01:57:47.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.505+0000 7f0c96d9d640 1 --2- 172.21.15.19:0/468860652 >> v2:172.21.15.135:3300/0 conn(0x7f0c980d1090 0x7f0c980b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:47.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.505+0000 7f0c9659c640 1 -- 172.21.15.19:0/468860652 >> v2:172.21.15.135:3300/0 conn(0x7f0c980d1090 msgr2=0x7f0c980b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:47.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.505+0000 7f0c9659c640 1 --2- 172.21.15.19:0/468860652 >> v2:172.21.15.135:3300/0 conn(0x7f0c980d1090 0x7f0c980b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.505+0000 7f0c9659c640 1 -- 172.21.15.19:0/468860652 >> v1:172.21.15.19:6789/0 conn(0x7f0c980b1620 legacy=0x7f0c980d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:47.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.505+0000 7f0c9659c640 1 -- 172.21.15.19:0/468860652 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c980d02f0 con 0x7f0c9815c520 2024-09-12T01:57:47.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.505+0000 7f0c9559a640 1 -- 172.21.15.19:0/468860652 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2731066847 0 0) 0x7f0c980cec00 con 0x7f0c980b1620 2024-09-12T01:57:47.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.506+0000 7f0c9659c640 1 --2- 172.21.15.19:0/468860652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c9815c520 0x7f0c9809b720 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0c980b3ea0 tx=0x7f0c8802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994db6b794f92056 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:47.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.506+0000 7f0c9559a640 1 -- 172.21.15.19:0/468860652 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c88037070 con 0x7f0c9815c520 2024-09-12T01:57:47.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.506+0000 7f0c9559a640 1 -- 172.21.15.19:0/468860652 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c88032440 con 0x7f0c9815c520 2024-09-12T01:57:47.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.506+0000 7f0c9559a640 1 -- 172.21.15.19:0/468860652 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c88032810 con 0x7f0c9815c520 2024-09-12T01:57:47.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.506+0000 7f0c9cdc4640 1 -- 172.21.15.19:0/468860652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c9815c520 msgr2=0x7f0c9809b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:47.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.506+0000 7f0c9cdc4640 1 --2- 172.21.15.19:0/468860652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c9815c520 0x7f0c9809b720 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0c980b3ea0 tx=0x7f0c8802a1a0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.506+0000 7f0c9cdc4640 1 -- 172.21.15.19:0/468860652 shutdown_connections 2024-09-12T01:57:47.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.506+0000 7f0c9cdc4640 1 --2- 172.21.15.19:0/468860652 >> v2:172.21.15.135:3300/0 conn(0x7f0c980d1090 0x7f0c980b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.506+0000 7f0c9cdc4640 1 --2- 172.21.15.19:0/468860652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c9815c520 0x7f0c9809b720 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.506+0000 7f0c9cdc4640 1 -- 172.21.15.19:0/468860652 >> 172.21.15.19:0/468860652 conn(0x7f0c980d23a0 msgr2=0x7f0c980d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:47.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.506+0000 7f0c9cdc4640 1 -- 172.21.15.19:0/468860652 shutdown_connections 2024-09-12T01:57:47.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.506+0000 7f0c9cdc4640 1 -- 172.21.15.19:0/468860652 wait complete. 2024-09-12T01:57:47.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.508+0000 7f0c9cdc4640 1 Processor -- start 2024-09-12T01:57:47.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.508+0000 7f0c9cdc4640 1 -- start start 2024-09-12T01:57:47.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c9cdc4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c980b1620 0x7f0c9809d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:47.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c9cdc4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c980d1090 0x7f0c980c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:47.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c9cdc4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c9815c520 0x7f0c980c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:47.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c9cdc4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9815c900 con 0x7f0c980b1620 2024-09-12T01:57:47.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c9cdc4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0c980d05d0 con 0x7f0c9815c520 2024-09-12T01:57:47.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c9cdc4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0c980c6070 con 0x7f0c980d1090 2024-09-12T01:57:47.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c9659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c980b1620 0x7f0c9809d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:47.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c9659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c980b1620 0x7f0c9809d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43120/0 (socket says 172.21.15.19:43120) 2024-09-12T01:57:47.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c9659c640 1 -- 172.21.15.19:0/1042391610 learned_addr learned my addr 172.21.15.19:0/1042391610 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:47.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c96d9d640 1 --2- 172.21.15.19:0/1042391610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c9815c520 0x7f0c980c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:47.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c9659c640 1 -- 172.21.15.19:0/1042391610 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c980d1090 msgr2=0x7f0c980c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:47.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c95d9b640 1 --2- 172.21.15.19:0/1042391610 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c980d1090 0x7f0c980c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:47.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c9659c640 1 --2- 172.21.15.19:0/1042391610 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c980d1090 0x7f0c980c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c9659c640 1 -- 172.21.15.19:0/1042391610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c9815c520 msgr2=0x7f0c980c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:47.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c9659c640 1 --2- 172.21.15.19:0/1042391610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c9815c520 0x7f0c980c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c9659c640 1 -- 172.21.15.19:0/1042391610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c980c6350 con 0x7f0c980b1620 2024-09-12T01:57:47.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c96d9d640 1 --2- 172.21.15.19:0/1042391610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c9815c520 0x7f0c980c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:47.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c95d9b640 1 --2- 172.21.15.19:0/1042391610 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c980d1090 0x7f0c980c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:47.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c9659c640 1 --2- 172.21.15.19:0/1042391610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c980b1620 0x7f0c9809d390 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0c88000c00 tx=0x7f0c880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:47.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c86ffd640 1 -- 172.21.15.19:0/1042391610 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c88037050 con 0x7f0c980b1620 2024-09-12T01:57:47.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c86ffd640 1 -- 172.21.15.19:0/1042391610 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c88038040 con 0x7f0c980b1620 2024-09-12T01:57:47.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c86ffd640 1 -- 172.21.15.19:0/1042391610 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c88004450 con 0x7f0c980b1620 2024-09-12T01:57:47.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.509+0000 7f0c9cdc4640 1 -- 172.21.15.19:0/1042391610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c980c6630 con 0x7f0c980b1620 2024-09-12T01:57:47.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.510+0000 7f0c9cdc4640 1 -- 172.21.15.19:0/1042391610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c980c8d70 con 0x7f0c980b1620 2024-09-12T01:57:47.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.510+0000 7f0c9cdc4640 1 -- 172.21.15.19:0/1042391610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c980b1d40 con 0x7f0c980b1620 2024-09-12T01:57:47.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.511+0000 7f0c86ffd640 1 -- 172.21.15.19:0/1042391610 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c88030980 con 0x7f0c980b1620 2024-09-12T01:57:47.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.511+0000 7f0c86ffd640 1 --2- 172.21.15.19:0/1042391610 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0c7806be30 0x7f0c7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:47.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.512+0000 7f0c86ffd640 1 -- 172.21.15.19:0/1042391610 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f0c880ab980 con 0x7f0c980b1620 2024-09-12T01:57:47.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.512+0000 7f0c95d9b640 1 --2- 172.21.15.19:0/1042391610 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0c7806be30 0x7f0c7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:47.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.512+0000 7f0c95d9b640 1 --2- 172.21.15.19:0/1042391610 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0c7806be30 0x7f0c7806e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0c980718b0 tx=0x7f0c8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:47.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.516+0000 7f0c86ffd640 1 -- 172.21.15.19:0/1042391610 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c8807a600 con 0x7f0c980b1620 2024-09-12T01:57:47.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:47.762+0000 7f0c9cdc4640 1 -- 172.21.15.19:0/1042391610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_damaged_dentry"]} v 0) -- 0x7f0c980b8320 con 0x7f0c980b1620 2024-09-12T01:57:48.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.065+0000 7f0c86ffd640 1 -- 172.21.15.19:0/1042391610 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_damaged_dentry"]}]=0 v113) ==== 134+0+0 (secure 0 0 0) 0x7f0c88079f00 con 0x7f0c980b1620 2024-09-12T01:57:48.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.068+0000 7f0c9cdc4640 1 -- 172.21.15.19:0/1042391610 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0c7806be30 msgr2=0x7f0c7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.068+0000 7f0c9cdc4640 1 --2- 172.21.15.19:0/1042391610 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0c7806be30 0x7f0c7806e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0c980718b0 tx=0x7f0c8c009040 comp rx=0 tx=0).stop 2024-09-12T01:57:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.068+0000 7f0c9cdc4640 1 -- 172.21.15.19:0/1042391610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c980b1620 msgr2=0x7f0c9809d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.068+0000 7f0c9cdc4640 1 --2- 172.21.15.19:0/1042391610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c980b1620 0x7f0c9809d390 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0c88000c00 tx=0x7f0c880046c0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.068+0000 7f0c9cdc4640 1 -- 172.21.15.19:0/1042391610 shutdown_connections 2024-09-12T01:57:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.068+0000 7f0c9cdc4640 1 --2- 172.21.15.19:0/1042391610 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0c7806be30 0x7f0c7806e2f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.068+0000 7f0c9cdc4640 1 --2- 172.21.15.19:0/1042391610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c9815c520 0x7f0c980c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.068+0000 7f0c9cdc4640 1 --2- 172.21.15.19:0/1042391610 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c980d1090 0x7f0c980c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.068+0000 7f0c9cdc4640 1 --2- 172.21.15.19:0/1042391610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c980b1620 0x7f0c9809d390 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.068+0000 7f0c9cdc4640 1 -- 172.21.15.19:0/1042391610 >> 172.21.15.19:0/1042391610 conn(0x7f0c980d23a0 msgr2=0x7f0c9815b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.068+0000 7f0c9cdc4640 1 -- 172.21.15.19:0/1042391610 shutdown_connections 2024-09-12T01:57:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.068+0000 7f0c9cdc4640 1 -- 172.21.15.19:0/1042391610 wait complete. 2024-09-12T01:57:48.080 INFO:tasks.cephfs_test_runner:test_damaged_dentry (tasks.cephfs.test_damage.TestDamage) ... ok 2024-09-12T01:57:48.080 INFO:tasks.cephfs_test_runner:Starting test: test_dentry_first_existing (tasks.cephfs.test_damage.TestDamage) That the MDS won't abort when the dentry is already known to be damaged. 2024-09-12T01:57:48.081 INFO:tasks.cephfs_test_runner:test_dentry_first_existing (tasks.cephfs.test_damage.TestDamage) 2024-09-12T01:57:48.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:57:48.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.183+0000 7f242ef5b640 1 Processor -- start 2024-09-12T01:57:48.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.183+0000 7f242ef5b640 1 -- start start 2024-09-12T01:57:48.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.184+0000 7f242ef5b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2428161c80 0x7f242806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.184+0000 7f242ef5b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2428162060 0x7f24280b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.184+0000 7f242ef5b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f24280b64b0 0x7f24280b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.184+0000 7f242ef5b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f242806e870 con 0x7f24280b64b0 2024-09-12T01:57:48.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.184+0000 7f242ef5b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f242806d9f0 con 0x7f2428162060 2024-09-12T01:57:48.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.184+0000 7f242ef5b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f242806dcd0 con 0x7f2428161c80 2024-09-12T01:57:48.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.184+0000 7f242d4f8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f24280b64b0 0x7f24280b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.184+0000 7f242d4f8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f24280b64b0 0x7f24280b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43132/0 (socket says 172.21.15.19:43132) 2024-09-12T01:57:48.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.184+0000 7f242d4f8640 1 -- 172.21.15.19:0/3829493454 learned_addr learned my addr 172.21.15.19:0/3829493454 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:48.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.185+0000 7f2427fff640 1 --2- 172.21.15.19:0/3829493454 >> v2:172.21.15.135:3300/0 conn(0x7f2428162060 0x7f24280b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.185+0000 7f242d4f8640 1 -- 172.21.15.19:0/3829493454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2428161c80 msgr2=0x7f242806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:48.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.185+0000 7f242ccf7640 1 --2- 172.21.15.19:0/3829493454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2428161c80 0x7f242806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.185+0000 7f242d4f8640 1 --2- 172.21.15.19:0/3829493454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2428161c80 0x7f242806e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.185+0000 7f242d4f8640 1 -- 172.21.15.19:0/3829493454 >> v2:172.21.15.135:3300/0 conn(0x7f2428162060 msgr2=0x7f24280b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:48.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.185+0000 7f242d4f8640 1 --2- 172.21.15.19:0/3829493454 >> v2:172.21.15.135:3300/0 conn(0x7f2428162060 0x7f24280b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.185+0000 7f242d4f8640 1 -- 172.21.15.19:0/3829493454 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f242806dfb0 con 0x7f24280b64b0 2024-09-12T01:57:48.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.185+0000 7f2427fff640 1 --2- 172.21.15.19:0/3829493454 >> v2:172.21.15.135:3300/0 conn(0x7f2428162060 0x7f24280b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:48.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.185+0000 7f242d4f8640 1 --2- 172.21.15.19:0/3829493454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24280b64b0 0x7f24280b6960 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f24280d0cb0 tx=0x7f242002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b1b6b453def1b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:48.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.186+0000 7f24277fe640 1 -- 172.21.15.19:0/3829493454 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2420036070 con 0x7f24280b64b0 2024-09-12T01:57:48.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.186+0000 7f24277fe640 1 -- 172.21.15.19:0/3829493454 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2420031600 con 0x7f24280b64b0 2024-09-12T01:57:48.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.186+0000 7f24277fe640 1 -- 172.21.15.19:0/3829493454 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24200319d0 con 0x7f24280b64b0 2024-09-12T01:57:48.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.186+0000 7f242ef5b640 1 -- 172.21.15.19:0/3829493454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24280b64b0 msgr2=0x7f24280b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.186+0000 7f242ef5b640 1 --2- 172.21.15.19:0/3829493454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24280b64b0 0x7f24280b6960 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f24280d0cb0 tx=0x7f242002a6a0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.186+0000 7f242ef5b640 1 -- 172.21.15.19:0/3829493454 shutdown_connections 2024-09-12T01:57:48.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.186+0000 7f242ef5b640 1 --2- 172.21.15.19:0/3829493454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24280b64b0 0x7f24280b6960 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.186+0000 7f242ef5b640 1 --2- 172.21.15.19:0/3829493454 >> v2:172.21.15.135:3300/0 conn(0x7f2428162060 0x7f24280b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.186+0000 7f242ef5b640 1 --2- 172.21.15.19:0/3829493454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2428161c80 0x7f242806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.186+0000 7f242ef5b640 1 -- 172.21.15.19:0/3829493454 >> 172.21.15.19:0/3829493454 conn(0x7f24280d44f0 msgr2=0x7f24280d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:48.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.186+0000 7f242ef5b640 1 -- 172.21.15.19:0/3829493454 shutdown_connections 2024-09-12T01:57:48.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.186+0000 7f242ef5b640 1 -- 172.21.15.19:0/3829493454 wait complete. 2024-09-12T01:57:48.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.187+0000 7f242ef5b640 1 Processor -- start 2024-09-12T01:57:48.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.187+0000 7f242ef5b640 1 -- start start 2024-09-12T01:57:48.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.188+0000 7f242ef5b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24280b64b0 0x7f2428155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.188+0000 7f242ef5b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2428161c80 0x7f24280cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.188+0000 7f242ef5b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2428162060 0x7f24280b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.188+0000 7f242ef5b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2428162500 con 0x7f2428161c80 2024-09-12T01:57:48.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.188+0000 7f242ef5b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f24280d2aa0 con 0x7f2428162060 2024-09-12T01:57:48.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.188+0000 7f242ef5b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2428162680 con 0x7f24280b64b0 2024-09-12T01:57:48.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.188+0000 7f2427fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2428161c80 0x7f24280cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.188+0000 7f2427fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2428161c80 0x7f24280cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43146/0 (socket says 172.21.15.19:43146) 2024-09-12T01:57:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.188+0000 7f2427fff640 1 -- 172.21.15.19:0/2380696245 learned_addr learned my addr 172.21.15.19:0/2380696245 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.189+0000 7f242ccf7640 1 --2- 172.21.15.19:0/2380696245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24280b64b0 0x7f2428155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.189+0000 7f242d4f8640 1 --2- 172.21.15.19:0/2380696245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2428162060 0x7f24280b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.189+0000 7f2427fff640 1 -- 172.21.15.19:0/2380696245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24280b64b0 msgr2=0x7f2428155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.189+0000 7f2427fff640 1 --2- 172.21.15.19:0/2380696245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24280b64b0 0x7f2428155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.189+0000 7f2427fff640 1 -- 172.21.15.19:0/2380696245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2428162060 msgr2=0x7f24280b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.189+0000 7f2427fff640 1 --2- 172.21.15.19:0/2380696245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2428162060 0x7f24280b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.189+0000 7f2427fff640 1 -- 172.21.15.19:0/2380696245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24280cadf0 con 0x7f2428161c80 2024-09-12T01:57:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.189+0000 7f2427fff640 1 --2- 172.21.15.19:0/2380696245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2428161c80 0x7f24280cb5c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f241c00c820 tx=0x7f241c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.189+0000 7f24257fa640 1 -- 172.21.15.19:0/2380696245 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c015070 con 0x7f2428161c80 2024-09-12T01:57:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.189+0000 7f24257fa640 1 -- 172.21.15.19:0/2380696245 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f241c007a30 con 0x7f2428161c80 2024-09-12T01:57:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.189+0000 7f242ef5b640 1 -- 172.21.15.19:0/2380696245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24280b85a0 con 0x7f2428161c80 2024-09-12T01:57:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.189+0000 7f24257fa640 1 -- 172.21.15.19:0/2380696245 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c007e20 con 0x7f2428161c80 2024-09-12T01:57:48.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.189+0000 7f242ef5b640 1 -- 172.21.15.19:0/2380696245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24280cbb00 con 0x7f2428161c80 2024-09-12T01:57:48.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.190+0000 7f242ef5b640 1 -- 172.21.15.19:0/2380696245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f242806e330 con 0x7f2428161c80 2024-09-12T01:57:48.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.191+0000 7f24257fa640 1 -- 172.21.15.19:0/2380696245 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f241c018070 con 0x7f2428161c80 2024-09-12T01:57:48.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.191+0000 7f24257fa640 1 --2- 172.21.15.19:0/2380696245 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f241406be30 0x7f241406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.191+0000 7f24257fa640 1 -- 172.21.15.19:0/2380696245 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f241c08aaf0 con 0x7f2428161c80 2024-09-12T01:57:48.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.192+0000 7f242ccf7640 1 --2- 172.21.15.19:0/2380696245 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f241406be30 0x7f241406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.192+0000 7f242ccf7640 1 --2- 172.21.15.19:0/2380696245 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f241406be30 0x7f241406e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f241800aaf0 tx=0x7f2418008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:48.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.195+0000 7f24257fa640 1 -- 172.21.15.19:0/2380696245 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f241c058f80 con 0x7f2428161c80 2024-09-12T01:57:48.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.374+0000 7f242ef5b640 1 -- 172.21.15.19:0/2380696245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24280d22c0 con 0x7f2428161c80 2024-09-12T01:57:48.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.375+0000 7f24257fa640 1 -- 172.21.15.19:0/2380696245 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+13423 (secure 0 0 0) 0x7f241c05d280 con 0x7f2428161c80 2024-09-12T01:57:48.375 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:48.375 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":46,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:57:47.060658+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6834/3554496273":"2024-09-13T01:57:44.051661+0000","172.21.15.19:6832/3554496273":"2024-09-13T01:57:44.051661+0000","172.21.15.19:6834/1994815169":"2024-09-13T01:57:00.902156+0000","172.21.15.19:6832/1994815169":"2024-09-13T01:57:00.902156+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:57:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.376+0000 7f242ef5b640 1 -- 172.21.15.19:0/2380696245 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f241406be30 msgr2=0x7f241406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.376+0000 7f242ef5b640 1 --2- 172.21.15.19:0/2380696245 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f241406be30 0x7f241406e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f241800aaf0 tx=0x7f2418008040 comp rx=0 tx=0).stop 2024-09-12T01:57:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.376+0000 7f242ef5b640 1 -- 172.21.15.19:0/2380696245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2428161c80 msgr2=0x7f24280cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.376+0000 7f242ef5b640 1 --2- 172.21.15.19:0/2380696245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2428161c80 0x7f24280cb5c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f241c00c820 tx=0x7f241c00cce0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.377+0000 7f242ef5b640 1 -- 172.21.15.19:0/2380696245 shutdown_connections 2024-09-12T01:57:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.377+0000 7f242ef5b640 1 --2- 172.21.15.19:0/2380696245 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f241406be30 0x7f241406e2f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.377+0000 7f242ef5b640 1 --2- 172.21.15.19:0/2380696245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2428162060 0x7f24280b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.377+0000 7f242ef5b640 1 --2- 172.21.15.19:0/2380696245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2428161c80 0x7f24280cb5c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.377+0000 7f242ef5b640 1 --2- 172.21.15.19:0/2380696245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24280b64b0 0x7f2428155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.377+0000 7f242ef5b640 1 -- 172.21.15.19:0/2380696245 >> 172.21.15.19:0/2380696245 conn(0x7f24280d44f0 msgr2=0x7f242806ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:48.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.377+0000 7f242ef5b640 1 -- 172.21.15.19:0/2380696245 shutdown_connections 2024-09-12T01:57:48.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.377+0000 7f242ef5b640 1 -- 172.21.15.19:0/2380696245 wait complete. 2024-09-12T01:57:48.388 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:55:44.127030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:57:48.388 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:57:48.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.492+0000 7f73104e4640 1 Processor -- start 2024-09-12T01:57:48.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.493+0000 7f73104e4640 1 -- start start 2024-09-12T01:57:48.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.493+0000 7f73104e4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7308162e30 0x7f730806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.493+0000 7f73104e4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f73080cf280 0x7f73080d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.493+0000 7f73104e4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f730815ff70 con 0x7f7308162340 2024-09-12T01:57:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.493+0000 7f73104e4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f730806de90 con 0x7f7308162e30 2024-09-12T01:57:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.493+0000 7f73104e4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f7308163270 con 0x7f73080cf280 2024-09-12T01:57:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.494+0000 7f730da7f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7308162e30 0x7f730806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.494+0000 7f730da7f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7308162e30 0x7f730806d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43158/0 (socket says 172.21.15.19:43158) 2024-09-12T01:57:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.494+0000 7f730da7f640 1 -- 172.21.15.19:0/3145181604 learned_addr learned my addr 172.21.15.19:0/3145181604 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.494+0000 7f730da7f640 1 -- 172.21.15.19:0/3145181604 >> v2:172.21.15.135:3300/0 conn(0x7f73080cf280 msgr2=0x7f73080d2990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:57:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.494+0000 7f730da7f640 1 --2- 172.21.15.19:0/3145181604 >> v2:172.21.15.135:3300/0 conn(0x7f73080cf280 0x7f73080d2990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.494+0000 7f730da7f640 1 -- 172.21.15.19:0/3145181604 >> v1:172.21.15.135:6789/0 conn(0x7f7308162340 legacy=0x7f7308162720 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:57:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.494+0000 7f730da7f640 1 -- 172.21.15.19:0/3145181604 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73080d4d10 con 0x7f7308162e30 2024-09-12T01:57:48.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.495+0000 7f730da7f640 1 --2- 172.21.15.19:0/3145181604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7308162e30 0x7f730806d740 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f730806c3d0 tx=0x7f72f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5c752b22af903b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:48.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.495+0000 7f730d27e640 1 -- 172.21.15.19:0/3145181604 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8004030 con 0x7f7308162e30 2024-09-12T01:57:48.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.495+0000 7f730d27e640 1 -- 172.21.15.19:0/3145181604 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f80041d0 con 0x7f7308162e30 2024-09-12T01:57:48.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.495+0000 7f730d27e640 1 -- 172.21.15.19:0/3145181604 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8003610 con 0x7f7308162e30 2024-09-12T01:57:48.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.495+0000 7f73104e4640 1 -- 172.21.15.19:0/3145181604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7308162e30 msgr2=0x7f730806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.495+0000 7f73104e4640 1 --2- 172.21.15.19:0/3145181604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7308162e30 0x7f730806d740 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f730806c3d0 tx=0x7f72f802a1a0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.495+0000 7f73104e4640 1 -- 172.21.15.19:0/3145181604 shutdown_connections 2024-09-12T01:57:48.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.495+0000 7f73104e4640 1 --2- 172.21.15.19:0/3145181604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7308162e30 0x7f730806d740 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.495+0000 7f73104e4640 1 --2- 172.21.15.19:0/3145181604 >> v2:172.21.15.135:3300/0 conn(0x7f73080cf280 0x7f73080d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.495+0000 7f73104e4640 1 -- 172.21.15.19:0/3145181604 >> 172.21.15.19:0/3145181604 conn(0x7f730808bfc0 msgr2=0x7f73080d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:48.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.496+0000 7f73104e4640 1 -- 172.21.15.19:0/3145181604 shutdown_connections 2024-09-12T01:57:48.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.496+0000 7f73104e4640 1 -- 172.21.15.19:0/3145181604 wait complete. 2024-09-12T01:57:48.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.497+0000 7f73104e4640 1 Processor -- start 2024-09-12T01:57:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.497+0000 7f73104e4640 1 -- start start 2024-09-12T01:57:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.497+0000 7f73104e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73080cf280 0x7f73081f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.497+0000 7f73104e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7308162340 0x7f730815a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.497+0000 7f73104e4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7308162e30 0x7f73080b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.498+0000 7f73104e4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f73080cf6f0 con 0x7f7308162340 2024-09-12T01:57:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.498+0000 7f73104e4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f73080d2470 con 0x7f7308162e30 2024-09-12T01:57:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.498+0000 7f73104e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f73080d52d0 con 0x7f73080cf280 2024-09-12T01:57:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.498+0000 7f730da7f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7308162340 0x7f730815a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.498+0000 7f730da7f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7308162340 0x7f730815a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43162/0 (socket says 172.21.15.19:43162) 2024-09-12T01:57:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.498+0000 7f730da7f640 1 -- 172.21.15.19:0/3690836067 learned_addr learned my addr 172.21.15.19:0/3690836067 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.498+0000 7f730da7f640 1 -- 172.21.15.19:0/3690836067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73080cf280 msgr2=0x7f73081f5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.498+0000 7f730da7f640 1 --2- 172.21.15.19:0/3690836067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73080cf280 0x7f73081f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.498+0000 7f730da7f640 1 -- 172.21.15.19:0/3690836067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7308162e30 msgr2=0x7f73080b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.498+0000 7f730ea81640 1 --2- 172.21.15.19:0/3690836067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7308162e30 0x7f73080b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.498+0000 7f730da7f640 1 --2- 172.21.15.19:0/3690836067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7308162e30 0x7f73080b6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.498+0000 7f730da7f640 1 -- 172.21.15.19:0/3690836067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73081f5fe0 con 0x7f7308162340 2024-09-12T01:57:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.498+0000 7f730da7f640 1 --2- 172.21.15.19:0/3690836067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7308162340 0x7f730815a130 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f72f802a1e0 tx=0x7f72f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.498+0000 7f72feffd640 1 -- 172.21.15.19:0/3690836067 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8042020 con 0x7f7308162340 2024-09-12T01:57:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.498+0000 7f72feffd640 1 -- 172.21.15.19:0/3690836067 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f8003a20 con 0x7f7308162340 2024-09-12T01:57:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.498+0000 7f73104e4640 1 -- 172.21.15.19:0/3690836067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730815a670 con 0x7f7308162340 2024-09-12T01:57:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.498+0000 7f72feffd640 1 -- 172.21.15.19:0/3690836067 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8003dd0 con 0x7f7308162340 2024-09-12T01:57:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.499+0000 7f73104e4640 1 -- 172.21.15.19:0/3690836067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73080b43b0 con 0x7f7308162340 2024-09-12T01:57:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.499+0000 7f73104e4640 1 -- 172.21.15.19:0/3690836067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73080b45b0 con 0x7f7308162340 2024-09-12T01:57:48.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.500+0000 7f72feffd640 1 -- 172.21.15.19:0/3690836067 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72f8045020 con 0x7f7308162340 2024-09-12T01:57:48.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.500+0000 7f72feffd640 1 --2- 172.21.15.19:0/3690836067 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f72ec06be60 0x7f72ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.500+0000 7f72feffd640 1 -- 172.21.15.19:0/3690836067 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f72f80ab9c0 con 0x7f7308162340 2024-09-12T01:57:48.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.501+0000 7f730e280640 1 --2- 172.21.15.19:0/3690836067 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f72ec06be60 0x7f72ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.501+0000 7f730e280640 1 --2- 172.21.15.19:0/3690836067 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f72ec06be60 0x7f72ec06e320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f730815aaa0 tx=0x7f7304006c40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:48.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.505+0000 7f72feffd640 1 -- 172.21.15.19:0/3690836067 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72f80ade20 con 0x7f7308162340 2024-09-12T01:57:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.679+0000 7f73104e4640 1 -- 172.21.15.19:0/3690836067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f730806d740 con 0x7f7308162340 2024-09-12T01:57:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.679+0000 7f72feffd640 1 -- 172.21.15.19:0/3690836067 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) ==== 93+0+10 (secure 0 0 0) 0x7f72f804c030 con 0x7f7308162340 2024-09-12T01:57:48.680 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-09-12T01:57:48.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.681+0000 7f73104e4640 1 -- 172.21.15.19:0/3690836067 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f72ec06be60 msgr2=0x7f72ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.681+0000 7f73104e4640 1 --2- 172.21.15.19:0/3690836067 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f72ec06be60 0x7f72ec06e320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f730815aaa0 tx=0x7f7304006c40 comp rx=0 tx=0).stop 2024-09-12T01:57:48.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.681+0000 7f73104e4640 1 -- 172.21.15.19:0/3690836067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7308162340 msgr2=0x7f730815a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.681+0000 7f73104e4640 1 --2- 172.21.15.19:0/3690836067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7308162340 0x7f730815a130 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f72f802a1e0 tx=0x7f72f80046c0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.682+0000 7f73104e4640 1 -- 172.21.15.19:0/3690836067 shutdown_connections 2024-09-12T01:57:48.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.682+0000 7f73104e4640 1 --2- 172.21.15.19:0/3690836067 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f72ec06be60 0x7f72ec06e320 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.682+0000 7f73104e4640 1 --2- 172.21.15.19:0/3690836067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7308162e30 0x7f73080b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.682+0000 7f73104e4640 1 --2- 172.21.15.19:0/3690836067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7308162340 0x7f730815a130 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.682+0000 7f73104e4640 1 --2- 172.21.15.19:0/3690836067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73080cf280 0x7f73081f5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.682+0000 7f73104e4640 1 -- 172.21.15.19:0/3690836067 >> 172.21.15.19:0/3690836067 conn(0x7f730808bfc0 msgr2=0x7f73080d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:48.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.682+0000 7f73104e4640 1 -- 172.21.15.19:0/3690836067 shutdown_connections 2024-09-12T01:57:48.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.682+0000 7f73104e4640 1 -- 172.21.15.19:0/3690836067 wait complete. 2024-09-12T01:57:48.693 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_existing' 2024-09-12T01:57:48.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.795+0000 7f56367c4640 1 Processor -- start 2024-09-12T01:57:48.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.795+0000 7f56367c4640 1 -- start start 2024-09-12T01:57:48.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.796+0000 7f56367c4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f563015e740 0x7f56300d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.796+0000 7f56367c4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f563006e040 con 0x7f563009b690 2024-09-12T01:57:48.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.796+0000 7f56367c4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56300d0780 con 0x7f563006dbd0 2024-09-12T01:57:48.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.796+0000 7f56367c4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f563015eb20 con 0x7f563015e740 2024-09-12T01:57:48.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.796+0000 7f562f7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f563009b690 0x7f563006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54812/0 (socket says 172.21.15.19:54812) 2024-09-12T01:57:48.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.796+0000 7f562f7fe640 1 -- 172.21.15.19:0/3586421528 learned_addr learned my addr 172.21.15.19:0/3586421528 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:48.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.796+0000 7f562ffff640 1 --2- 172.21.15.19:0/3586421528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f563015e740 0x7f56300d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.796+0000 7f562effd640 1 -- 172.21.15.19:0/3586421528 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 44894553 0 0) 0x7f563006e040 con 0x7f563009b690 2024-09-12T01:57:48.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.796+0000 7f562effd640 1 -- 172.21.15.19:0/3586421528 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5618003520 con 0x7f563009b690 2024-09-12T01:57:48.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.797+0000 7f562effd640 1 -- 172.21.15.19:0/3586421528 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2487242312 0 0) 0x7f56300d0780 con 0x7f563006dbd0 2024-09-12T01:57:48.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.797+0000 7f562effd640 1 -- 172.21.15.19:0/3586421528 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f563006e040 con 0x7f563006dbd0 2024-09-12T01:57:48.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.797+0000 7f562effd640 1 -- 172.21.15.19:0/3586421528 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3265123701 0 0) 0x7f5618003520 con 0x7f563009b690 2024-09-12T01:57:48.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.797+0000 7f562ffff640 1 -- 172.21.15.19:0/3586421528 >> v1:172.21.15.135:6789/0 conn(0x7f563006dbd0 legacy=0x7f5630070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.797+0000 7f562ffff640 1 -- 172.21.15.19:0/3586421528 >> v1:172.21.15.19:6789/0 conn(0x7f563009b690 legacy=0x7f563006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.797+0000 7f562ffff640 1 -- 172.21.15.19:0/3586421528 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56300d0a60 con 0x7f563015e740 2024-09-12T01:57:48.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.798+0000 7f562ffff640 1 --2- 172.21.15.19:0/3586421528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f563015e740 0x7f56300d1540 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f56200097d0 tx=0x7f562002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0986540a7e09c30 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:48.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.798+0000 7f562effd640 1 -- 172.21.15.19:0/3586421528 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620037070 con 0x7f563015e740 2024-09-12T01:57:48.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.798+0000 7f562effd640 1 -- 172.21.15.19:0/3586421528 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f562002acc0 con 0x7f563015e740 2024-09-12T01:57:48.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.798+0000 7f562effd640 1 -- 172.21.15.19:0/3586421528 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5624001670 con 0x7f563015e740 2024-09-12T01:57:48.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.798+0000 7f56367c4640 1 -- 172.21.15.19:0/3586421528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f563015e740 msgr2=0x7f56300d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.798+0000 7f56367c4640 1 --2- 172.21.15.19:0/3586421528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f563015e740 0x7f56300d1540 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f56200097d0 tx=0x7f562002a230 comp rx=0 tx=0).stop 2024-09-12T01:57:48.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.798+0000 7f56367c4640 1 -- 172.21.15.19:0/3586421528 shutdown_connections 2024-09-12T01:57:48.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.798+0000 7f56367c4640 1 --2- 172.21.15.19:0/3586421528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f563015e740 0x7f56300d1540 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.798+0000 7f56367c4640 1 -- 172.21.15.19:0/3586421528 >> 172.21.15.19:0/3586421528 conn(0x7f56300d23a0 msgr2=0x7f56300d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:48.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.798+0000 7f56367c4640 1 -- 172.21.15.19:0/3586421528 shutdown_connections 2024-09-12T01:57:48.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.798+0000 7f56367c4640 1 -- 172.21.15.19:0/3586421528 wait complete. 2024-09-12T01:57:48.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.799+0000 7f56367c4640 1 Processor -- start 2024-09-12T01:57:48.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.800+0000 7f56367c4640 1 -- start start 2024-09-12T01:57:48.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.800+0000 7f56367c4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f563006dbd0 0x7f56300cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.800+0000 7f56367c4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f563009b690 0x7f563015ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.800+0000 7f56367c4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f563015e740 0x7f563015cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.800+0000 7f56367c4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f563009ba90 con 0x7f563006dbd0 2024-09-12T01:57:48.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.800+0000 7f56367c4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f56300d1020 con 0x7f563015e740 2024-09-12T01:57:48.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.800+0000 7f56367c4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f563006cd20 con 0x7f563009b690 2024-09-12T01:57:48.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.801+0000 7f562ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f563006dbd0 0x7f56300cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.801+0000 7f562ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f563006dbd0 0x7f56300cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43168/0 (socket says 172.21.15.19:43168) 2024-09-12T01:57:48.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.801+0000 7f562ffff640 1 -- 172.21.15.19:0/1364919485 learned_addr learned my addr 172.21.15.19:0/1364919485 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:48.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.801+0000 7f562ffff640 1 -- 172.21.15.19:0/1364919485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f563009b690 msgr2=0x7f563015ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.801+0000 7f562ffff640 1 --2- 172.21.15.19:0/1364919485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f563009b690 0x7f563015ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.801+0000 7f562ffff640 1 -- 172.21.15.19:0/1364919485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f563015e740 msgr2=0x7f563015cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.801+0000 7f5634d61640 1 --2- 172.21.15.19:0/1364919485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f563015e740 0x7f563015cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.801+0000 7f562ffff640 1 --2- 172.21.15.19:0/1364919485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f563015e740 0x7f563015cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.801+0000 7f562ffff640 1 -- 172.21.15.19:0/1364919485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56300ca3b0 con 0x7f563006dbd0 2024-09-12T01:57:48.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.801+0000 7f5634d61640 1 --2- 172.21.15.19:0/1364919485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f563015e740 0x7f563015cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:48.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.801+0000 7f562ffff640 1 --2- 172.21.15.19:0/1364919485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f563006dbd0 0x7f56300cbd10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5620035040 tx=0x7f56200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:48.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.801+0000 7f562cff9640 1 -- 172.21.15.19:0/1364919485 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620037050 con 0x7f563006dbd0 2024-09-12T01:57:48.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.801+0000 7f562cff9640 1 -- 172.21.15.19:0/1364919485 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5620038040 con 0x7f563006dbd0 2024-09-12T01:57:48.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.801+0000 7f56367c4640 1 -- 172.21.15.19:0/1364919485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56300c6d50 con 0x7f563006dbd0 2024-09-12T01:57:48.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.801+0000 7f562cff9640 1 -- 172.21.15.19:0/1364919485 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620006e10 con 0x7f563006dbd0 2024-09-12T01:57:48.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.801+0000 7f56367c4640 1 -- 172.21.15.19:0/1364919485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56300c7310 con 0x7f563006dbd0 2024-09-12T01:57:48.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.802+0000 7f56367c4640 1 -- 172.21.15.19:0/1364919485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56300ce740 con 0x7f563006dbd0 2024-09-12T01:57:48.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.803+0000 7f562cff9640 1 -- 172.21.15.19:0/1364919485 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5620045020 con 0x7f563006dbd0 2024-09-12T01:57:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.803+0000 7f562cff9640 1 --2- 172.21.15.19:0/1364919485 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f561c06be30 0x7f561c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.803+0000 7f562cff9640 1 -- 172.21.15.19:0/1364919485 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f56200aabf0 con 0x7f563006dbd0 2024-09-12T01:57:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.804+0000 7f562f7fe640 1 --2- 172.21.15.19:0/1364919485 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f561c06be30 0x7f561c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.804+0000 7f562f7fe640 1 --2- 172.21.15.19:0/1364919485 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f561c06be30 0x7f561c06e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5624005880 tx=0x7f5624001080 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:48.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:48.808+0000 7f562cff9640 1 -- 172.21.15.19:0/1364919485 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f56300ce740 con 0x7f563006dbd0 2024-09-12T01:57:49.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.051+0000 7f56367c4640 1 -- 172.21.15.19:0/1364919485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_existing"]} v 0) -- 0x7f56300d1cb0 con 0x7f563006dbd0 2024-09-12T01:57:49.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.067+0000 7f562cff9640 1 -- 172.21.15.19:0/1364919485 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_existing"]}]=0 v114) ==== 144+0+0 (secure 0 0 0) 0x7f562004c020 con 0x7f563006dbd0 2024-09-12T01:57:49.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.069+0000 7f56367c4640 1 -- 172.21.15.19:0/1364919485 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f561c06be30 msgr2=0x7f561c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.069+0000 7f56367c4640 1 --2- 172.21.15.19:0/1364919485 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f561c06be30 0x7f561c06e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5624005880 tx=0x7f5624001080 comp rx=0 tx=0).stop 2024-09-12T01:57:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.069+0000 7f56367c4640 1 -- 172.21.15.19:0/1364919485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f563006dbd0 msgr2=0x7f56300cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.069+0000 7f56367c4640 1 --2- 172.21.15.19:0/1364919485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f563006dbd0 0x7f56300cbd10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5620035040 tx=0x7f56200046c0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.069+0000 7f56367c4640 1 -- 172.21.15.19:0/1364919485 shutdown_connections 2024-09-12T01:57:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.069+0000 7f56367c4640 1 --2- 172.21.15.19:0/1364919485 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f561c06be30 0x7f561c06e2f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.069+0000 7f56367c4640 1 --2- 172.21.15.19:0/1364919485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f563015e740 0x7f563015cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.069+0000 7f56367c4640 1 --2- 172.21.15.19:0/1364919485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f563009b690 0x7f563015ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.069+0000 7f56367c4640 1 --2- 172.21.15.19:0/1364919485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f563006dbd0 0x7f56300cbd10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.069+0000 7f56367c4640 1 -- 172.21.15.19:0/1364919485 >> 172.21.15.19:0/1364919485 conn(0x7f56300d23a0 msgr2=0x7f56300b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.069+0000 7f56367c4640 1 -- 172.21.15.19:0/1364919485 shutdown_connections 2024-09-12T01:57:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.069+0000 7f56367c4640 1 -- 172.21.15.19:0/1364919485 wait complete. 2024-09-12T01:57:49.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T01:57:49.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.185+0000 7f94dde8d640 1 Processor -- start 2024-09-12T01:57:49.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.185+0000 7f94dde8d640 1 -- start start 2024-09-12T01:57:49.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.186+0000 7f94dde8d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94d8156740 0x7f94d80b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.186+0000 7f94dde8d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f94d80cfea0 0x7f94d80ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.186+0000 7f94dde8d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94d80b30e0 con 0x7f94d80b4af0 2024-09-12T01:57:49.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.186+0000 7f94dde8d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f94d806edc0 con 0x7f94d80cfea0 2024-09-12T01:57:49.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.186+0000 7f94dde8d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f94d80b33c0 con 0x7f94d8156740 2024-09-12T01:57:49.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.186+0000 7f94d7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f94d80cfea0 0x7f94d80ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.186+0000 7f94d6ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f94d80b4af0 0x7f94d80cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54816/0 (socket says 172.21.15.19:54816) 2024-09-12T01:57:49.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.186+0000 7f94d6ffd640 1 -- 172.21.15.19:0/3943500096 learned_addr learned my addr 172.21.15.19:0/3943500096 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:49.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.187+0000 7f94d77fe640 1 --2- 172.21.15.19:0/3943500096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94d8156740 0x7f94d80b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.187+0000 7f94d67fc640 1 -- 172.21.15.19:0/3943500096 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1954195007 0 0) 0x7f94d80b30e0 con 0x7f94d80b4af0 2024-09-12T01:57:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.187+0000 7f94d67fc640 1 -- 172.21.15.19:0/3943500096 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94c0003520 con 0x7f94d80b4af0 2024-09-12T01:57:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.187+0000 7f94d7fff640 1 -- 172.21.15.19:0/3943500096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94d8156740 msgr2=0x7f94d80b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.187+0000 7f94d7fff640 1 --2- 172.21.15.19:0/3943500096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94d8156740 0x7f94d80b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.187+0000 7f94d7fff640 1 -- 172.21.15.19:0/3943500096 >> v1:172.21.15.19:6789/0 conn(0x7f94d80b4af0 legacy=0x7f94d80cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.187+0000 7f94d7fff640 1 -- 172.21.15.19:0/3943500096 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d80b36a0 con 0x7f94d80cfea0 2024-09-12T01:57:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.188+0000 7f94d7fff640 1 --2- 172.21.15.19:0/3943500096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94d80cfea0 0x7f94d80ce060 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009d90 tx=0x7f94d002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbadac001f3bcdf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.188+0000 7f94d67fc640 1 -- 172.21.15.19:0/3943500096 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0007740 con 0x7f94d80cfea0 2024-09-12T01:57:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.188+0000 7f94d67fc640 1 -- 172.21.15.19:0/3943500096 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d00078e0 con 0x7f94d80cfea0 2024-09-12T01:57:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.188+0000 7f94d67fc640 1 -- 172.21.15.19:0/3943500096 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0007c90 con 0x7f94d80cfea0 2024-09-12T01:57:49.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.188+0000 7f94dde8d640 1 -- 172.21.15.19:0/3943500096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94d80cfea0 msgr2=0x7f94d80ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.188+0000 7f94dde8d640 1 --2- 172.21.15.19:0/3943500096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94d80cfea0 0x7f94d80ce060 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009d90 tx=0x7f94d002a660 comp rx=0 tx=0).stop 2024-09-12T01:57:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.188+0000 7f94dde8d640 1 -- 172.21.15.19:0/3943500096 shutdown_connections 2024-09-12T01:57:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.188+0000 7f94dde8d640 1 --2- 172.21.15.19:0/3943500096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94d80cfea0 0x7f94d80ce060 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.188+0000 7f94dde8d640 1 --2- 172.21.15.19:0/3943500096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94d8156740 0x7f94d80b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.188+0000 7f94dde8d640 1 -- 172.21.15.19:0/3943500096 >> 172.21.15.19:0/3943500096 conn(0x7f94d806bdf0 msgr2=0x7f94d806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.188+0000 7f94dde8d640 1 -- 172.21.15.19:0/3943500096 shutdown_connections 2024-09-12T01:57:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.188+0000 7f94dde8d640 1 -- 172.21.15.19:0/3943500096 wait complete. 2024-09-12T01:57:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.189+0000 7f94dde8d640 1 Processor -- start 2024-09-12T01:57:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.190+0000 7f94dde8d640 1 -- start start 2024-09-12T01:57:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.190+0000 7f94dde8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94d80b4af0 0x7f94d8151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.190+0000 7f94dde8d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d80cfea0 0x7f94d8151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.190+0000 7f94dde8d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94d8156740 0x7f94d809b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.190+0000 7f94dde8d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f94d80d0890 con 0x7f94d80b4af0 2024-09-12T01:57:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.190+0000 7f94dde8d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f94d80b3c60 con 0x7f94d80cfea0 2024-09-12T01:57:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.190+0000 7f94dde8d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f94d80d0a10 con 0x7f94d8156740 2024-09-12T01:57:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.190+0000 7f94d77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94d80b4af0 0x7f94d8151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.191+0000 7f94d77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94d80b4af0 0x7f94d8151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43196/0 (socket says 172.21.15.19:43196) 2024-09-12T01:57:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.191+0000 7f94d77fe640 1 -- 172.21.15.19:0/3418371300 learned_addr learned my addr 172.21.15.19:0/3418371300 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.191+0000 7f94d7fff640 1 --2- 172.21.15.19:0/3418371300 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94d8156740 0x7f94d809b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.191+0000 7f94d6ffd640 1 --2- 172.21.15.19:0/3418371300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d80cfea0 0x7f94d8151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.191+0000 7f94d77fe640 1 -- 172.21.15.19:0/3418371300 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94d8156740 msgr2=0x7f94d809b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.191+0000 7f94d77fe640 1 --2- 172.21.15.19:0/3418371300 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94d8156740 0x7f94d809b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.191+0000 7f94d77fe640 1 -- 172.21.15.19:0/3418371300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d80cfea0 msgr2=0x7f94d8151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.191+0000 7f94d77fe640 1 --2- 172.21.15.19:0/3418371300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d80cfea0 0x7f94d8151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.191+0000 7f94d77fe640 1 -- 172.21.15.19:0/3418371300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d809a5c0 con 0x7f94d80b4af0 2024-09-12T01:57:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.191+0000 7f94d6ffd640 1 --2- 172.21.15.19:0/3418371300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d80cfea0 0x7f94d8151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.191+0000 7f94d77fe640 1 --2- 172.21.15.19:0/3418371300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94d80b4af0 0x7f94d8151820 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f94c800e9e0 tx=0x7f94c800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.191+0000 7f94bffff640 1 -- 172.21.15.19:0/3418371300 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8017070 con 0x7f94d80b4af0 2024-09-12T01:57:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.191+0000 7f94bffff640 1 -- 172.21.15.19:0/3418371300 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94c800c9d0 con 0x7f94d80b4af0 2024-09-12T01:57:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.191+0000 7f94bffff640 1 -- 172.21.15.19:0/3418371300 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c800cdc0 con 0x7f94d80b4af0 2024-09-12T01:57:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.191+0000 7f94dde8d640 1 -- 172.21.15.19:0/3418371300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d809a8a0 con 0x7f94d80b4af0 2024-09-12T01:57:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.191+0000 7f94dde8d640 1 -- 172.21.15.19:0/3418371300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d809ae60 con 0x7f94d80b4af0 2024-09-12T01:57:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.192+0000 7f94dde8d640 1 -- 172.21.15.19:0/3418371300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d8068f50 con 0x7f94d80b4af0 2024-09-12T01:57:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.193+0000 7f94bffff640 1 -- 172.21.15.19:0/3418371300 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f94c801a070 con 0x7f94d80b4af0 2024-09-12T01:57:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.193+0000 7f94bffff640 1 --2- 172.21.15.19:0/3418371300 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f94c406be30 0x7f94c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.193+0000 7f94bffff640 1 -- 172.21.15.19:0/3418371300 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f94c808b060 con 0x7f94d80b4af0 2024-09-12T01:57:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.193+0000 7f94d6ffd640 1 --2- 172.21.15.19:0/3418371300 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f94c406be30 0x7f94c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.194+0000 7f94d6ffd640 1 --2- 172.21.15.19:0/3418371300 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f94c406be30 0x7f94c406e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f94d8075950 tx=0x7f94cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:49.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.198+0000 7f94bffff640 1 -- 172.21.15.19:0/3418371300 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f94c80594e0 con 0x7f94d80b4af0 2024-09-12T01:57:49.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.373+0000 7f94dde8d640 1 -- 172.21.15.19:0/3418371300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f94d80cf0f0 con 0x7f94d80b4af0 2024-09-12T01:57:49.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.376+0000 7f94bffff640 1 -- 172.21.15.19:0/3418371300 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f94c805d7e0 con 0x7f94d80b4af0 2024-09-12T01:57:49.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.378+0000 7f94dde8d640 1 -- 172.21.15.19:0/3418371300 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f94c406be30 msgr2=0x7f94c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.378+0000 7f94dde8d640 1 --2- 172.21.15.19:0/3418371300 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f94c406be30 0x7f94c406e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f94d8075950 tx=0x7f94cc009040 comp rx=0 tx=0).stop 2024-09-12T01:57:49.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.378+0000 7f94dde8d640 1 -- 172.21.15.19:0/3418371300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94d80b4af0 msgr2=0x7f94d8151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.378+0000 7f94dde8d640 1 --2- 172.21.15.19:0/3418371300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94d80b4af0 0x7f94d8151820 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f94c800e9e0 tx=0x7f94c800eea0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.378+0000 7f94dde8d640 1 -- 172.21.15.19:0/3418371300 shutdown_connections 2024-09-12T01:57:49.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.378+0000 7f94dde8d640 1 --2- 172.21.15.19:0/3418371300 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f94c406be30 0x7f94c406e2f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.378+0000 7f94dde8d640 1 --2- 172.21.15.19:0/3418371300 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94d8156740 0x7f94d809b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.378+0000 7f94dde8d640 1 --2- 172.21.15.19:0/3418371300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d80cfea0 0x7f94d8151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.378+0000 7f94dde8d640 1 --2- 172.21.15.19:0/3418371300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94d80b4af0 0x7f94d8151820 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.378+0000 7f94dde8d640 1 -- 172.21.15.19:0/3418371300 >> 172.21.15.19:0/3418371300 conn(0x7f94d806bdf0 msgr2=0x7f94d815d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.378+0000 7f94dde8d640 1 -- 172.21.15.19:0/3418371300 shutdown_connections 2024-09-12T01:57:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.378+0000 7f94dde8d640 1 -- 172.21.15.19:0/3418371300 wait complete. 2024-09-12T01:57:49.390 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:57:49.391 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:57:49.435 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:57:49.472 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:57:49.472 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:57:49.472 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:57:49.491 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:57:49.491 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:57:49.491 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:57:49.530 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:57:49.530 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:57:49.530 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:57:49.547 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:57:49.547 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:57:49.547 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:57:49.587 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:57:49.588 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T01:57:49.588 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:57:49.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.689+0000 7fba3bfff640 1 Processor -- start 2024-09-12T01:57:49.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.689+0000 7fba3bfff640 1 -- start start 2024-09-12T01:57:49.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.690+0000 7fba3bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba3c147270 0x7fba3c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.690+0000 7fba3bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fba3c0af320 0x7fba3c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.690+0000 7fba3bfff640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba3c0b40f0 con 0x7fba3c147770 2024-09-12T01:57:49.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.690+0000 7fba3bfff640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fba3c0b46b0 con 0x7fba3c0af320 2024-09-12T01:57:49.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.690+0000 7fba3bfff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fba3c0b43d0 con 0x7fba3c147270 2024-09-12T01:57:49.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.690+0000 7fba3b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fba3c0af320 0x7fba3c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.690+0000 7fba3b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fba3c0af320 0x7fba3c06c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43200/0 (socket says 172.21.15.19:43200) 2024-09-12T01:57:49.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.690+0000 7fba3b7fe640 1 -- 172.21.15.19:0/696702549 learned_addr learned my addr 172.21.15.19:0/696702549 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:49.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.691+0000 7fba3affd640 1 --2- 172.21.15.19:0/696702549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba3c147270 0x7fba3c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.691+0000 7fba3b7fe640 1 -- 172.21.15.19:0/696702549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba3c147270 msgr2=0x7fba3c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:49.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.691+0000 7fba3b7fe640 1 --2- 172.21.15.19:0/696702549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba3c147270 0x7fba3c06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.691+0000 7fba3b7fe640 1 -- 172.21.15.19:0/696702549 >> v1:172.21.15.19:6789/0 conn(0x7fba3c147770 legacy=0x7fba3c0b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.691+0000 7fba3b7fe640 1 -- 172.21.15.19:0/696702549 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c0b2500 con 0x7fba3c0af320 2024-09-12T01:57:49.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.691+0000 7fba39ffb640 1 -- 172.21.15.19:0/696702549 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2085665620 0 0) 0x7fba3c0b40f0 con 0x7fba3c147770 2024-09-12T01:57:49.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.691+0000 7fba3b7fe640 1 --2- 172.21.15.19:0/696702549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba3c0af320 0x7fba3c06c150 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fba34009870 tx=0x7fba3402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa14a66e3b252172 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:49.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.692+0000 7fba39ffb640 1 -- 172.21.15.19:0/696702549 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba34037070 con 0x7fba3c0af320 2024-09-12T01:57:49.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.692+0000 7fba39ffb640 1 -- 172.21.15.19:0/696702549 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba34032440 con 0x7fba3c0af320 2024-09-12T01:57:49.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.692+0000 7fba39ffb640 1 -- 172.21.15.19:0/696702549 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba34032810 con 0x7fba3c0af320 2024-09-12T01:57:49.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.692+0000 7fba3bfff640 1 -- 172.21.15.19:0/696702549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba3c0af320 msgr2=0x7fba3c06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.692+0000 7fba3bfff640 1 --2- 172.21.15.19:0/696702549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba3c0af320 0x7fba3c06c150 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fba34009870 tx=0x7fba3402a270 comp rx=0 tx=0).stop 2024-09-12T01:57:49.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.692+0000 7fba3bfff640 1 -- 172.21.15.19:0/696702549 shutdown_connections 2024-09-12T01:57:49.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.692+0000 7fba3bfff640 1 --2- 172.21.15.19:0/696702549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba3c0af320 0x7fba3c06c150 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.692+0000 7fba3bfff640 1 --2- 172.21.15.19:0/696702549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba3c147270 0x7fba3c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.692+0000 7fba3bfff640 1 -- 172.21.15.19:0/696702549 >> 172.21.15.19:0/696702549 conn(0x7fba3c09aa30 msgr2=0x7fba3c0b6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:49.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.692+0000 7fba3bfff640 1 -- 172.21.15.19:0/696702549 shutdown_connections 2024-09-12T01:57:49.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.692+0000 7fba3bfff640 1 -- 172.21.15.19:0/696702549 wait complete. 2024-09-12T01:57:49.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.693+0000 7fba3bfff640 1 Processor -- start 2024-09-12T01:57:49.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.694+0000 7fba3bfff640 1 -- start start 2024-09-12T01:57:49.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.694+0000 7fba3bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba3c0af320 0x7fba3c131540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.694+0000 7fba3bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba3c147270 0x7fba3c15dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.694+0000 7fba3bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba3c147770 0x7fba3c0b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.694+0000 7fba3bfff640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c147cc0 con 0x7fba3c147770 2024-09-12T01:57:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.694+0000 7fba3bfff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c0b2ac0 con 0x7fba3c0af320 2024-09-12T01:57:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.694+0000 7fba3bfff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fba3c147e40 con 0x7fba3c147270 2024-09-12T01:57:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.694+0000 7fba3b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba3c147770 0x7fba3c0b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.694+0000 7fba3b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba3c147770 0x7fba3c0b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43204/0 (socket says 172.21.15.19:43204) 2024-09-12T01:57:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.694+0000 7fba3b7fe640 1 -- 172.21.15.19:0/548984022 learned_addr learned my addr 172.21.15.19:0/548984022 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.694+0000 7fba3affd640 1 --2- 172.21.15.19:0/548984022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba3c0af320 0x7fba3c131540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.695+0000 7fba3a7fc640 1 --2- 172.21.15.19:0/548984022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba3c147270 0x7fba3c15dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.695+0000 7fba3b7fe640 1 -- 172.21.15.19:0/548984022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba3c147270 msgr2=0x7fba3c15dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.695+0000 7fba3b7fe640 1 --2- 172.21.15.19:0/548984022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba3c147270 0x7fba3c15dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.695+0000 7fba3b7fe640 1 -- 172.21.15.19:0/548984022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba3c0af320 msgr2=0x7fba3c131540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.695+0000 7fba3b7fe640 1 --2- 172.21.15.19:0/548984022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba3c0af320 0x7fba3c131540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.695+0000 7fba3b7fe640 1 -- 172.21.15.19:0/548984022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c131a80 con 0x7fba3c147770 2024-09-12T01:57:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.695+0000 7fba3affd640 1 --2- 172.21.15.19:0/548984022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba3c0af320 0x7fba3c131540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:49.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.695+0000 7fba3b7fe640 1 --2- 172.21.15.19:0/548984022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba3c147770 0x7fba3c0b0c00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fba34009870 tx=0x7fba340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:49.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.695+0000 7fba337fe640 1 -- 172.21.15.19:0/548984022 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba34041070 con 0x7fba3c147770 2024-09-12T01:57:49.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.695+0000 7fba337fe640 1 -- 172.21.15.19:0/548984022 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3403c950 con 0x7fba3c147770 2024-09-12T01:57:49.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.695+0000 7fba3bfff640 1 -- 172.21.15.19:0/548984022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3c15e2c0 con 0x7fba3c147770 2024-09-12T01:57:49.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.695+0000 7fba337fe640 1 -- 172.21.15.19:0/548984022 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba34037040 con 0x7fba3c147770 2024-09-12T01:57:49.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.695+0000 7fba3bfff640 1 -- 172.21.15.19:0/548984022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba3c15fbb0 con 0x7fba3c147770 2024-09-12T01:57:49.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.696+0000 7fba3bfff640 1 -- 172.21.15.19:0/548984022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba3c06bc10 con 0x7fba3c147770 2024-09-12T01:57:49.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.697+0000 7fba337fe640 1 -- 172.21.15.19:0/548984022 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba34044070 con 0x7fba3c147770 2024-09-12T01:57:49.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.697+0000 7fba337fe640 1 --2- 172.21.15.19:0/548984022 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fba1c06be30 0x7fba1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.697+0000 7fba337fe640 1 -- 172.21.15.19:0/548984022 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7fba340ab9b0 con 0x7fba3c147770 2024-09-12T01:57:49.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.697+0000 7fba3affd640 1 --2- 172.21.15.19:0/548984022 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fba1c06be30 0x7fba1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.698+0000 7fba3affd640 1 --2- 172.21.15.19:0/548984022 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fba1c06be30 0x7fba1c06e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00e4a0 tx=0x7fba2c007650 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:49.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.701+0000 7fba337fe640 1 -- 172.21.15.19:0/548984022 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba3c15e2c0 con 0x7fba3c147770 2024-09-12T01:57:49.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.915+0000 7fba3bfff640 1 -- 172.21.15.19:0/548984022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba3c0b5b40 con 0x7fba3c147770 2024-09-12T01:57:49.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.916+0000 7fba337fe640 1 -- 172.21.15.19:0/548984022 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+3911 (secure 0 0 0) 0x7fba3407a630 con 0x7fba3c147770 2024-09-12T01:57:49.916 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:49.916 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"btime":"2024-09-12T01:57:45:053862+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1979542220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1979542220},{"type":"v1","addr":"172.21.15.135:6836","nonce":1979542220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/809710386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":809710386},{"type":"v1","addr":"172.21.15.19:6835","nonce":809710386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1005776280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1005776280},{"type":"v1","addr":"172.21.15.135:6837","nonce":1005776280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/343386589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":343386589},{"type":"v1","addr":"172.21.15.19:6834","nonce":343386589}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[]} 2024-09-12T01:57:49.917 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 22 2024-09-12T01:57:49.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.918+0000 7fba3bfff640 1 -- 172.21.15.19:0/548984022 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fba1c06be30 msgr2=0x7fba1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.918+0000 7fba3bfff640 1 --2- 172.21.15.19:0/548984022 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fba1c06be30 0x7fba1c06e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00e4a0 tx=0x7fba2c007650 comp rx=0 tx=0).stop 2024-09-12T01:57:49.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.918+0000 7fba3bfff640 1 -- 172.21.15.19:0/548984022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba3c147770 msgr2=0x7fba3c0b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.918+0000 7fba3bfff640 1 --2- 172.21.15.19:0/548984022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba3c147770 0x7fba3c0b0c00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fba34009870 tx=0x7fba340046c0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.918+0000 7fba3bfff640 1 -- 172.21.15.19:0/548984022 shutdown_connections 2024-09-12T01:57:49.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.918+0000 7fba3bfff640 1 --2- 172.21.15.19:0/548984022 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fba1c06be30 0x7fba1c06e2f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.918+0000 7fba3bfff640 1 --2- 172.21.15.19:0/548984022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba3c147770 0x7fba3c0b0c00 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.918+0000 7fba3bfff640 1 --2- 172.21.15.19:0/548984022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba3c147270 0x7fba3c15dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.918+0000 7fba3bfff640 1 --2- 172.21.15.19:0/548984022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba3c0af320 0x7fba3c131540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.918+0000 7fba3bfff640 1 -- 172.21.15.19:0/548984022 >> 172.21.15.19:0/548984022 conn(0x7fba3c09aa30 msgr2=0x7fba3c06f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:49.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.918+0000 7fba3bfff640 1 -- 172.21.15.19:0/548984022 shutdown_connections 2024-09-12T01:57:49.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:49.918+0000 7fba3bfff640 1 -- 172.21.15.19:0/548984022 wait complete. 2024-09-12T01:57:49.930 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T01:57:49.930 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T01:57:49.930 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T01:57:49.930 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:57:49.930 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T01:57:49.931 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T01:57:49.931 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T01:57:49.931 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:57:49.931 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T01:57:49.931 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T01:57:49.931 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T01:57:49.932 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:57:49.932 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T01:57:49.932 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T01:57:49.932 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T01:57:49.932 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:57:49.940 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T01:57:49.940 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T01:57:49.941 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T01:57:49.941 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T01:57:49.943 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T01:57:49.943 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T01:57:49.944 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T01:57:49.944 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T01:57:49.983 INFO:tasks.ceph.mds.a:Started 2024-09-12T01:57:49.983 DEBUG:teuthology.parallel:result is None 2024-09-12T01:57:49.983 INFO:tasks.ceph.mds.c:Started 2024-09-12T01:57:49.984 DEBUG:teuthology.parallel:result is None 2024-09-12T01:57:49.986 INFO:tasks.ceph.mds.b:Started 2024-09-12T01:57:49.987 DEBUG:teuthology.parallel:result is None 2024-09-12T01:57:49.988 INFO:tasks.ceph.mds.d:Started 2024-09-12T01:57:49.988 DEBUG:teuthology.parallel:result is None 2024-09-12T01:57:49.988 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T01:57:50.061 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T01:57:50.062 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-09-12T01:57:50.065 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T01:57:50.065 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2024-09-12T01:57:50.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.096+0000 7fa05d0ba640 1 Processor -- start 2024-09-12T01:57:50.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.096+0000 7fa05d0ba640 1 -- start start 2024-09-12T01:57:50.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.097+0000 7fa05d0ba640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa058161c80 0x7fa05806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:50.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.097+0000 7fa05d0ba640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa058162060 0x7fa0580b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:50.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.097+0000 7fa05d0ba640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa05806e870 con 0x7fa0580b64b0 2024-09-12T01:57:50.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.097+0000 7fa05d0ba640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa05806d9f0 con 0x7fa058161c80 2024-09-12T01:57:50.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.097+0000 7fa056d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa058161c80 0x7fa05806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:50.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.097+0000 7fa056d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa058161c80 0x7fa05806e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43240/0 (socket says 172.21.15.19:43240) 2024-09-12T01:57:50.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.097+0000 7fa05659c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa058162060 0x7fa0580b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:50.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.097+0000 7fa056d9d640 1 -- 172.21.15.19:0/949062066 learned_addr learned my addr 172.21.15.19:0/949062066 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:50.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.097+0000 7fa05d0ba640 1 -- 172.21.15.19:0/949062066 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa05806dcd0 con 0x7fa058162060 2024-09-12T01:57:50.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.097+0000 7fa055d9b640 1 -- 172.21.15.19:0/949062066 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3909034958 0 0) 0x7fa050001490 con 0x7fa0580b64b0 2024-09-12T01:57:50.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.097+0000 7fa056d9d640 1 -- 172.21.15.19:0/949062066 >> v2:172.21.15.135:3300/0 conn(0x7fa058162060 msgr2=0x7fa0580b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:50.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.097+0000 7fa056d9d640 1 --2- 172.21.15.19:0/949062066 >> v2:172.21.15.135:3300/0 conn(0x7fa058162060 0x7fa0580b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:50.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.097+0000 7fa056d9d640 1 -- 172.21.15.19:0/949062066 >> v1:172.21.15.19:6789/0 conn(0x7fa0580b64b0 legacy=0x7fa058162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:50.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.097+0000 7fa056d9d640 1 -- 172.21.15.19:0/949062066 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05806dfb0 con 0x7fa058161c80 2024-09-12T01:57:50.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.097+0000 7fa05659c640 1 --2- 172.21.15.19:0/949062066 >> v2:172.21.15.135:3300/0 conn(0x7fa058162060 0x7fa0580b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:50.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.098+0000 7fa056d9d640 1 --2- 172.21.15.19:0/949062066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa058161c80 0x7fa05806e330 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa05808e830 tx=0x7fa04802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16e6099455a42a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:50.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.098+0000 7fa055d9b640 1 -- 172.21.15.19:0/949062066 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa048037070 con 0x7fa058161c80 2024-09-12T01:57:50.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.098+0000 7fa055d9b640 1 -- 172.21.15.19:0/949062066 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa048032440 con 0x7fa058161c80 2024-09-12T01:57:50.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.098+0000 7fa055d9b640 1 -- 172.21.15.19:0/949062066 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa048032810 con 0x7fa058161c80 2024-09-12T01:57:50.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.099+0000 7fa05d0ba640 1 -- 172.21.15.19:0/949062066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa058161c80 msgr2=0x7fa05806e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:50.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.099+0000 7fa05d0ba640 1 --2- 172.21.15.19:0/949062066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa058161c80 0x7fa05806e330 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa05808e830 tx=0x7fa04802a270 comp rx=0 tx=0).stop 2024-09-12T01:57:50.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.099+0000 7fa05d0ba640 1 -- 172.21.15.19:0/949062066 shutdown_connections 2024-09-12T01:57:50.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.099+0000 7fa05d0ba640 1 --2- 172.21.15.19:0/949062066 >> v2:172.21.15.135:3300/0 conn(0x7fa058162060 0x7fa0580b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:50.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.099+0000 7fa05d0ba640 1 --2- 172.21.15.19:0/949062066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa058161c80 0x7fa05806e330 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:50.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.099+0000 7fa05d0ba640 1 -- 172.21.15.19:0/949062066 >> 172.21.15.19:0/949062066 conn(0x7fa0580d44f0 msgr2=0x7fa0580d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:50.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.099+0000 7fa05d0ba640 1 -- 172.21.15.19:0/949062066 shutdown_connections 2024-09-12T01:57:50.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.099+0000 7fa05d0ba640 1 -- 172.21.15.19:0/949062066 wait complete. 2024-09-12T01:57:50.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.100+0000 7fa05d0ba640 1 Processor -- start 2024-09-12T01:57:50.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.100+0000 7fa05d0ba640 1 -- start start 2024-09-12T01:57:50.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.101+0000 7fa05d0ba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0580b64b0 0x7fa0580ce800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:50.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.101+0000 7fa05d0ba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa058161c80 0x7fa0580b9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:50.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.101+0000 7fa05d0ba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa058162060 0x7fa058155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:50.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.101+0000 7fa05d0ba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa0580d2a10 con 0x7fa0580b64b0 2024-09-12T01:57:50.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.101+0000 7fa05d0ba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa0580d2890 con 0x7fa058162060 2024-09-12T01:57:50.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.101+0000 7fa05d0ba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa0580b6960 con 0x7fa058161c80 2024-09-12T01:57:50.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.101+0000 7fa056d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0580b64b0 0x7fa0580ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:50.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.101+0000 7fa056d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0580b64b0 0x7fa0580ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43250/0 (socket says 172.21.15.19:43250) 2024-09-12T01:57:50.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.101+0000 7fa056d9d640 1 -- 172.21.15.19:0/4072054043 learned_addr learned my addr 172.21.15.19:0/4072054043 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:50.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.101+0000 7fa05759e640 1 --2- 172.21.15.19:0/4072054043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa058162060 0x7fa058155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:50.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.101+0000 7fa05659c640 1 --2- 172.21.15.19:0/4072054043 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa058161c80 0x7fa0580b9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:50.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.102+0000 7fa056d9d640 1 -- 172.21.15.19:0/4072054043 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa058161c80 msgr2=0x7fa0580b9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:50.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.102+0000 7fa056d9d640 1 --2- 172.21.15.19:0/4072054043 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa058161c80 0x7fa0580b9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:50.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.102+0000 7fa056d9d640 1 -- 172.21.15.19:0/4072054043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa058162060 msgr2=0x7fa058155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:50.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.102+0000 7fa056d9d640 1 --2- 172.21.15.19:0/4072054043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa058162060 0x7fa058155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:50.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.102+0000 7fa056d9d640 1 -- 172.21.15.19:0/4072054043 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0580b74e0 con 0x7fa0580b64b0 2024-09-12T01:57:50.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.102+0000 7fa05659c640 1 --2- 172.21.15.19:0/4072054043 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa058161c80 0x7fa0580b9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:50.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.102+0000 7fa056d9d640 1 --2- 172.21.15.19:0/4072054043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0580b64b0 0x7fa0580ce800 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa048000c00 tx=0x7fa0480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:50.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.102+0000 7fa03f7fe640 1 -- 172.21.15.19:0/4072054043 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa048037040 con 0x7fa0580b64b0 2024-09-12T01:57:50.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.102+0000 7fa03f7fe640 1 -- 172.21.15.19:0/4072054043 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa048004030 con 0x7fa0580b64b0 2024-09-12T01:57:50.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.102+0000 7fa03f7fe640 1 -- 172.21.15.19:0/4072054043 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa048004400 con 0x7fa0580b64b0 2024-09-12T01:57:50.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.102+0000 7fa05d0ba640 1 -- 172.21.15.19:0/4072054043 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0580b77c0 con 0x7fa0580b64b0 2024-09-12T01:57:50.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.102+0000 7fa05d0ba640 1 -- 172.21.15.19:0/4072054043 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0580b7d80 con 0x7fa0580b64b0 2024-09-12T01:57:50.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.103+0000 7fa05d0ba640 1 -- 172.21.15.19:0/4072054043 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0580ba470 con 0x7fa0580b64b0 2024-09-12T01:57:50.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.104+0000 7fa03f7fe640 1 -- 172.21.15.19:0/4072054043 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa04803a070 con 0x7fa0580b64b0 2024-09-12T01:57:50.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.104+0000 7fa03f7fe640 1 --2- 172.21.15.19:0/4072054043 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa04406be30 0x7fa04406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:50.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.104+0000 7fa03f7fe640 1 -- 172.21.15.19:0/4072054043 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5421+0+0 (secure 0 0 0) 0x7fa0480ab320 con 0x7fa0580b64b0 2024-09-12T01:57:50.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.105+0000 7fa05659c640 1 --2- 172.21.15.19:0/4072054043 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa04406be30 0x7fa04406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:50.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.105+0000 7fa05659c640 1 --2- 172.21.15.19:0/4072054043 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa04406be30 0x7fa04406e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa05815fb10 tx=0x7fa04c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:50.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.109+0000 7fa03f7fe640 1 -- 172.21.15.19:0/4072054043 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa048041020 con 0x7fa0580b64b0 2024-09-12T01:57:50.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:50.298+0000 7fa05d0ba640 1 -- 172.21.15.19:0/4072054043 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa058160950 con 0x7fa0580b64b0 2024-09-12T01:57:51.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.078+0000 7fa03f7fe640 1 -- 172.21.15.19:0/4072054043 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v50) ==== 97+0+0 (secure 0 0 0) 0x7fa048079d60 con 0x7fa0580b64b0 2024-09-12T01:57:51.078 INFO:teuthology.orchestra.run.smithi019.stderr: removed all blocklist entries 2024-09-12T01:57:51.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.081+0000 7fa05d0ba640 1 -- 172.21.15.19:0/4072054043 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa04406be30 msgr2=0x7fa04406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.081+0000 7fa05d0ba640 1 --2- 172.21.15.19:0/4072054043 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa04406be30 0x7fa04406e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa05815fb10 tx=0x7fa04c008040 comp rx=0 tx=0).stop 2024-09-12T01:57:51.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.081+0000 7fa05d0ba640 1 -- 172.21.15.19:0/4072054043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0580b64b0 msgr2=0x7fa0580ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.081+0000 7fa05d0ba640 1 --2- 172.21.15.19:0/4072054043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0580b64b0 0x7fa0580ce800 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa048000c00 tx=0x7fa0480046c0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.081+0000 7fa05d0ba640 1 -- 172.21.15.19:0/4072054043 shutdown_connections 2024-09-12T01:57:51.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.081+0000 7fa05d0ba640 1 --2- 172.21.15.19:0/4072054043 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa04406be30 0x7fa04406e2f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.081+0000 7fa05d0ba640 1 --2- 172.21.15.19:0/4072054043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa058162060 0x7fa058155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.081+0000 7fa05d0ba640 1 --2- 172.21.15.19:0/4072054043 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa058161c80 0x7fa0580b9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.081+0000 7fa05d0ba640 1 --2- 172.21.15.19:0/4072054043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0580b64b0 0x7fa0580ce800 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.081+0000 7fa05d0ba640 1 -- 172.21.15.19:0/4072054043 >> 172.21.15.19:0/4072054043 conn(0x7fa0580d44f0 msgr2=0x7fa0580d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:51.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.081+0000 7fa05d0ba640 1 -- 172.21.15.19:0/4072054043 shutdown_connections 2024-09-12T01:57:51.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.081+0000 7fa05d0ba640 1 -- 172.21.15.19:0/4072054043 wait complete. 2024-09-12T01:57:51.095 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T01:57:51.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.204+0000 7fdeb76dd640 1 Processor -- start 2024-09-12T01:57:51.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.204+0000 7fdeb76dd640 1 -- start start 2024-09-12T01:57:51.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.205+0000 7fdeb76dd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdeb00b6680 0x7fdeb0169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.205+0000 7fdeb76dd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeb006d9f0 con 0x7fdeb0161c80 2024-09-12T01:57:51.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.205+0000 7fdeb76dd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeb006dcd0 con 0x7fdeb0162060 2024-09-12T01:57:51.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.205+0000 7fdeb76dd640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fdeb006dfb0 con 0x7fdeb00b6680 2024-09-12T01:57:51.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.205+0000 7fdeb5479640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdeb0161c80 0x7fdeb006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59674/0 (socket says 172.21.15.19:59674) 2024-09-12T01:57:51.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.205+0000 7fdeb5479640 1 -- 172.21.15.19:0/2476547288 learned_addr learned my addr 172.21.15.19:0/2476547288 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:51.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.205+0000 7fdea7fff640 1 -- 172.21.15.19:0/2476547288 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 782443133 0 0) 0x7fdeb006d9f0 con 0x7fdeb0161c80 2024-09-12T01:57:51.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.205+0000 7fdeb5c7a640 1 --2- 172.21.15.19:0/2476547288 >> v2:172.21.15.135:3300/0 conn(0x7fdeb00b6680 0x7fdeb0169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.205+0000 7fdea7fff640 1 -- 172.21.15.19:0/2476547288 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde9c003520 con 0x7fdeb0161c80 2024-09-12T01:57:51.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.205+0000 7fdea7fff640 1 -- 172.21.15.19:0/2476547288 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2799321179 0 0) 0x7fde9c003520 con 0x7fdeb0161c80 2024-09-12T01:57:51.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.205+0000 7fdea7fff640 1 -- 172.21.15.19:0/2476547288 >> v2:172.21.15.135:3300/0 conn(0x7fdeb00b6680 msgr2=0x7fdeb0169830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:51.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdea7fff640 1 --2- 172.21.15.19:0/2476547288 >> v2:172.21.15.135:3300/0 conn(0x7fdeb00b6680 0x7fdeb0169830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdea7fff640 1 -- 172.21.15.19:0/2476547288 >> v1:172.21.15.135:6789/0 conn(0x7fdeb0162060 legacy=0x7fdeb00b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdea7fff640 1 -- 172.21.15.19:0/2476547288 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb00d01f0 con 0x7fdeb0161c80 2024-09-12T01:57:51.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdea7fff640 1 -- 172.21.15.19:0/2476547288 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fdeac001670 con 0x7fdeb0161c80 2024-09-12T01:57:51.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdea7fff640 1 -- 172.21.15.19:0/2476547288 >> v1:172.21.15.19:6789/0 conn(0x7fdeb0161c80 legacy=0x7fdeb006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdea7fff640 1 --2- 172.21.15.19:0/2476547288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde9c0039b0 0x7fde9c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdea7fff640 1 --2- 172.21.15.19:0/2476547288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde9c004800 0x7fde9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdea7fff640 1 --2- 172.21.15.19:0/2476547288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde9c0051c0 0x7fde9c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdea7fff640 1 -- 172.21.15.19:0/2476547288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb006dfb0 con 0x7fde9c0039b0 2024-09-12T01:57:51.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdea7fff640 1 -- 172.21.15.19:0/2476547288 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c00c060 con 0x7fde9c004800 2024-09-12T01:57:51.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdea7fff640 1 -- 172.21.15.19:0/2476547288 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fde9c00c260 con 0x7fde9c0051c0 2024-09-12T01:57:51.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdeb5479640 1 --2- 172.21.15.19:0/2476547288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde9c0039b0 0x7fde9c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdeb5c7a640 1 --2- 172.21.15.19:0/2476547288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde9c0051c0 0x7fde9c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdeb4c78640 1 --2- 172.21.15.19:0/2476547288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde9c004800 0x7fde9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdeb5479640 1 -- 172.21.15.19:0/2476547288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde9c0051c0 msgr2=0x7fde9c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:51.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdeb5479640 1 --2- 172.21.15.19:0/2476547288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde9c0051c0 0x7fde9c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdeb5479640 1 -- 172.21.15.19:0/2476547288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde9c004800 msgr2=0x7fde9c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:51.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdeb5479640 1 --2- 172.21.15.19:0/2476547288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde9c004800 0x7fde9c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdeb5479640 1 -- 172.21.15.19:0/2476547288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9c003520 con 0x7fde9c0039b0 2024-09-12T01:57:51.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdeb4c78640 1 --2- 172.21.15.19:0/2476547288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde9c004800 0x7fde9c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:51.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdeb5c7a640 1 --2- 172.21.15.19:0/2476547288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde9c0051c0 0x7fde9c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:51.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.206+0000 7fdeb5c7a640 1 -- 172.21.15.19:0/2476547288 reap_dead start 2024-09-12T01:57:51.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.207+0000 7fdeb5479640 1 --2- 172.21.15.19:0/2476547288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde9c0039b0 0x7fde9c003dd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdeac00c210 tx=0x7fde9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9d93143dd27d01 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:51.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.207+0000 7fdea7fff640 1 -- 172.21.15.19:0/2476547288 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac007d30 con 0x7fde9c0039b0 2024-09-12T01:57:51.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.207+0000 7fdea7fff640 1 -- 172.21.15.19:0/2476547288 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeac005af0 con 0x7fde9c0039b0 2024-09-12T01:57:51.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.207+0000 7fdea7fff640 1 -- 172.21.15.19:0/2476547288 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac007070 con 0x7fde9c0039b0 2024-09-12T01:57:51.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.207+0000 7fdeb76dd640 1 -- 172.21.15.19:0/2476547288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde9c0039b0 msgr2=0x7fde9c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.207+0000 7fdeb76dd640 1 --2- 172.21.15.19:0/2476547288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde9c0039b0 0x7fde9c003dd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdeac00c210 tx=0x7fde9c005830 comp rx=0 tx=0).stop 2024-09-12T01:57:51.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.207+0000 7fdeb76dd640 1 -- 172.21.15.19:0/2476547288 shutdown_connections 2024-09-12T01:57:51.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.207+0000 7fdeb76dd640 1 --2- 172.21.15.19:0/2476547288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde9c0039b0 0x7fde9c003dd0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.207+0000 7fdeb76dd640 1 -- 172.21.15.19:0/2476547288 >> 172.21.15.19:0/2476547288 conn(0x7fdeb00d44f0 msgr2=0x7fdeb00d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:51.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.208+0000 7fdeb76dd640 1 -- 172.21.15.19:0/2476547288 shutdown_connections 2024-09-12T01:57:51.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.208+0000 7fdeb76dd640 1 -- 172.21.15.19:0/2476547288 wait complete. 2024-09-12T01:57:51.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.209+0000 7fdeb76dd640 1 Processor -- start 2024-09-12T01:57:51.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.209+0000 7fdeb76dd640 1 -- start start 2024-09-12T01:57:51.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdeb76dd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde9c0039b0 0x7fdeb015e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdeb76dd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb00cb6e0 0x7fdeb00cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdeb76dd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeb009f7a0 0x7fdeb009fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdeb76dd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb00b6b30 con 0x7fdeb009f7a0 2024-09-12T01:57:51.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdeb76dd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb00d2aa0 con 0x7fdeb00cb6e0 2024-09-12T01:57:51.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdeb76dd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdeb00b6cb0 con 0x7fde9c0039b0 2024-09-12T01:57:51.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdeb5c7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeb009f7a0 0x7fdeb009fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdeb5c7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeb009f7a0 0x7fdeb009fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33350/0 (socket says 172.21.15.19:33350) 2024-09-12T01:57:51.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdeb5c7a640 1 -- 172.21.15.19:0/839216412 learned_addr learned my addr 172.21.15.19:0/839216412 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:51.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdeb4c78640 1 --2- 172.21.15.19:0/839216412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb00cb6e0 0x7fdeb00cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdeb5479640 1 --2- 172.21.15.19:0/839216412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde9c0039b0 0x7fdeb015e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdeb5c7a640 1 -- 172.21.15.19:0/839216412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde9c0039b0 msgr2=0x7fdeb015e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdeb5c7a640 1 --2- 172.21.15.19:0/839216412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde9c0039b0 0x7fdeb015e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdeb5c7a640 1 -- 172.21.15.19:0/839216412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb00cb6e0 msgr2=0x7fdeb00cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdeb5c7a640 1 --2- 172.21.15.19:0/839216412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb00cb6e0 0x7fdeb00cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdeb5c7a640 1 -- 172.21.15.19:0/839216412 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb00cc0a0 con 0x7fdeb009f7a0 2024-09-12T01:57:51.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdeb5c7a640 1 --2- 172.21.15.19:0/839216412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeb009f7a0 0x7fdeb009fc20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdeb006ed60 tx=0x7fdea8010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:51.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdea5ffb640 1 -- 172.21.15.19:0/839216412 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea8010da0 con 0x7fdeb009f7a0 2024-09-12T01:57:51.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdea5ffb640 1 -- 172.21.15.19:0/839216412 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdea8003990 con 0x7fdeb009f7a0 2024-09-12T01:57:51.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdeb76dd640 1 -- 172.21.15.19:0/839216412 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeb015f020 con 0x7fdeb009f7a0 2024-09-12T01:57:51.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.210+0000 7fdea5ffb640 1 -- 172.21.15.19:0/839216412 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea8003d80 con 0x7fdeb009f7a0 2024-09-12T01:57:51.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.211+0000 7fdeb76dd640 1 -- 172.21.15.19:0/839216412 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeb00cc310 con 0x7fdeb009f7a0 2024-09-12T01:57:51.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.212+0000 7fdeb76dd640 1 -- 172.21.15.19:0/839216412 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeb00b5f70 con 0x7fdeb009f7a0 2024-09-12T01:57:51.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.212+0000 7fdea5ffb640 1 -- 172.21.15.19:0/839216412 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdea8005d10 con 0x7fdeb009f7a0 2024-09-12T01:57:51.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.213+0000 7fdea5ffb640 1 --2- 172.21.15.19:0/839216412 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fde9406be60 0x7fde9406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.213+0000 7fdea5ffb640 1 -- 172.21.15.19:0/839216412 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5249+0+0 (secure 0 0 0) 0x7fdea808b2d0 con 0x7fdeb009f7a0 2024-09-12T01:57:51.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.213+0000 7fdeb5479640 1 --2- 172.21.15.19:0/839216412 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fde9406be60 0x7fde9406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.213+0000 7fdeb5479640 1 --2- 172.21.15.19:0/839216412 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fde9406be60 0x7fde9406e320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdeac001eb0 tx=0x7fdeac02d000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:51.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.217+0000 7fdea5ffb640 1 -- 172.21.15.19:0/839216412 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdea8025020 con 0x7fdeb009f7a0 2024-09-12T01:57:51.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.459+0000 7fdeb76dd640 1 -- 172.21.15.19:0/839216412 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fdeb006d610 con 0x7fdeb009f7a0 2024-09-12T01:57:51.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.460+0000 7fdea5ffb640 1 -- 172.21.15.19:0/839216412 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7fdeb015f020 con 0x7fdeb009f7a0 2024-09-12T01:57:51.460 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:51.460 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:57:51.460 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_dump": [ 2024-09-12T01:57:51.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.461 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.a", 2024-09-12T01:57:51.461 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJm5rSjChAA4H0OW7ubTgq4vmUaoGvvNA==", 2024-09-12T01:57:51.461 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.461 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:57:51.461 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T01:57:51.461 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T01:57:51.461 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:57:51.461 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:57:51.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.462 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.b", 2024-09-12T01:57:51.462 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmyaCyFhAAV87Ogacs5CmiAuG0p/61Fw==", 2024-09-12T01:57:51.462 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.462 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:57:51.462 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T01:57:51.462 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T01:57:51.462 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:57:51.462 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:57:51.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.463 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.c", 2024-09-12T01:57:51.463 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmVLrfERAAlIw2yLSJubtZ1o4NB9IDsg==", 2024-09-12T01:57:51.463 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.463 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:57:51.463 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T01:57:51.463 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T01:57:51.463 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:57:51.463 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:57:51.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.463 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.d", 2024-09-12T01:57:51.463 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmd6a1HRAA04/r87MKfFM1VQvG1Tjj8A==", 2024-09-12T01:57:51.463 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.464 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:57:51.464 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T01:57:51.464 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T01:57:51.464 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:57:51.464 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:57:51.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.464 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.0", 2024-09-12T01:57:51.464 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD0SeJme7ETBRAA/8v8aJcEzpHYmAPg5Hxdzg==", 2024-09-12T01:57:51.464 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.464 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:57:51.464 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:57:51.464 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:57:51.465 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:57:51.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.465 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.1", 2024-09-12T01:57:51.465 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD3SeJmfXQyFhAALiZjnIoDw+OtH9of5IUu0w==", 2024-09-12T01:57:51.465 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.465 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:57:51.465 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:57:51.465 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:57:51.465 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:57:51.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.465 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.2", 2024-09-12T01:57:51.466 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD6SeJmMDNwJxAABb+94TBxpZx3GovP1g1Q2A==", 2024-09-12T01:57:51.466 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.466 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:57:51.466 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:57:51.466 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:57:51.466 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:57:51.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.467 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.3", 2024-09-12T01:57:51.467 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD9SeJmZMgKOBAAgU+mzTBmPSHE7mUElUA9lA==", 2024-09-12T01:57:51.467 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.467 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:57:51.467 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:57:51.467 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:57:51.467 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:57:51.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.467 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.4", 2024-09-12T01:57:51.467 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAESuJmnb9kBBAA6PmrEGSckixHv73r9ogheQ==", 2024-09-12T01:57:51.467 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.468 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:57:51.468 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:57:51.468 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:57:51.468 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:57:51.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.468 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.5", 2024-09-12T01:57:51.468 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAHSuJmLU1hBhAAlFooSVxCEmIHSjqscaFnhQ==", 2024-09-12T01:57:51.468 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.468 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:57:51.468 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:57:51.468 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:57:51.468 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:57:51.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.469 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.6", 2024-09-12T01:57:51.469 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAKSuJmeIj7BxAADTmZtK8dk94LSGa88+xq3Q==", 2024-09-12T01:57:51.469 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.469 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:57:51.469 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:57:51.469 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:57:51.469 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:57:51.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.469 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.7", 2024-09-12T01:57:51.469 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQANSuJmw92iJxAAsjNKRSdndTUGmBtaN3g/pQ==", 2024-09-12T01:57:51.470 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.470 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:57:51.470 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:57:51.470 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:57:51.470 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:57:51.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.470 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.0", 2024-09-12T01:57:51.470 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmfHbXIRAALAvdYAlaB6WxWtubFnlxRw==", 2024-09-12T01:57:51.470 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.470 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:57:51.470 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow r", 2024-09-12T01:57:51.470 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T01:57:51.470 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:57:51.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.471 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.1", 2024-09-12T01:57:51.471 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmOjfDKhAA8h0ldWP6mNPgoqtIejhF+Q==", 2024-09-12T01:57:51.471 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.471 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:57:51.471 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T01:57:51.471 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T01:57:51.471 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T01:57:51.471 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:57:51.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.471 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.2", 2024-09-12T01:57:51.472 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmLQSOJxAA2RhDLfjVzPpg1kiJe++WHg==", 2024-09-12T01:57:51.472 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.472 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:57:51.472 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T01:57:51.472 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T01:57:51.472 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T01:57:51.472 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:57:51.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.472 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.3", 2024-09-12T01:57:51.472 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmXS5YMBAAXSS+3Omu0PYIz1bJcSxefw==", 2024-09-12T01:57:51.472 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.472 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:57:51.472 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T01:57:51.473 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T01:57:51.473 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T01:57:51.473 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:57:51.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.473 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.admin", 2024-09-12T01:57:51.473 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDvSeJmCljiKRAAQmsy5rl4ZPpm2pD1kXMO3g==", 2024-09-12T01:57:51.473 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.473 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-09-12T01:57:51.473 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T01:57:51.473 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T01:57:51.473 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:57:51.474 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:57:51.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.474 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.x", 2024-09-12T01:57:51.474 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmjx1VBxAAF80kgsMnFJn+gL44QZn6bg==", 2024-09-12T01:57:51.474 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.474 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-09-12T01:57:51.474 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-09-12T01:57:51.474 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:57:51.474 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:57:51.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.474 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.y", 2024-09-12T01:57:51.475 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmXphnAxAAUnmZ3JPOt1Yzk0zqWh5+kg==", 2024-09-12T01:57:51.475 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:57:51.475 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-09-12T01:57:51.475 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-09-12T01:57:51.475 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:57:51.475 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.475 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.475 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T01:57:51.475 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:57:51.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.461+0000 7fdeb76dd640 1 -- 172.21.15.19:0/839216412 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fde9406be60 msgr2=0x7fde9406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.461+0000 7fdeb76dd640 1 --2- 172.21.15.19:0/839216412 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fde9406be60 0x7fde9406e320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdeac001eb0 tx=0x7fdeac02d000 comp rx=0 tx=0).stop 2024-09-12T01:57:51.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.461+0000 7fdeb76dd640 1 -- 172.21.15.19:0/839216412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeb009f7a0 msgr2=0x7fdeb009fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.461+0000 7fdeb76dd640 1 --2- 172.21.15.19:0/839216412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeb009f7a0 0x7fdeb009fc20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdeb006ed60 tx=0x7fdea8010590 comp rx=0 tx=0).stop 2024-09-12T01:57:51.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.461+0000 7fdeb76dd640 1 -- 172.21.15.19:0/839216412 shutdown_connections 2024-09-12T01:57:51.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.461+0000 7fdeb76dd640 1 --2- 172.21.15.19:0/839216412 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fde9406be60 0x7fde9406e320 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.461+0000 7fdeb76dd640 1 --2- 172.21.15.19:0/839216412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeb009f7a0 0x7fdeb009fc20 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.461+0000 7fdeb76dd640 1 --2- 172.21.15.19:0/839216412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb00cb6e0 0x7fdeb00cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.462+0000 7fdeb76dd640 1 --2- 172.21.15.19:0/839216412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde9c0039b0 0x7fdeb015e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.462+0000 7fdeb76dd640 1 -- 172.21.15.19:0/839216412 >> 172.21.15.19:0/839216412 conn(0x7fdeb00d44f0 msgr2=0x7fdeb00d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:51.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.462+0000 7fdeb76dd640 1 -- 172.21.15.19:0/839216412 shutdown_connections 2024-09-12T01:57:51.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.462+0000 7fdeb76dd640 1 -- 172.21.15.19:0/839216412 wait complete. 2024-09-12T01:57:51.478 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T01:57:51.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.580+0000 7efe5f91a640 1 Processor -- start 2024-09-12T01:57:51.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.580+0000 7efe5f91a640 1 -- start start 2024-09-12T01:57:51.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.581+0000 7efe5f91a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efe580d30f0 0x7efe580b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.581+0000 7efe5f91a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efe580b64c0 0x7efe5806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.581+0000 7efe5f91a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe580d3690 con 0x7efe5815e5f0 2024-09-12T01:57:51.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.581+0000 7efe5f91a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7efe5806d530 con 0x7efe580b64c0 2024-09-12T01:57:51.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.581+0000 7efe5f91a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7efe580d3970 con 0x7efe580d30f0 2024-09-12T01:57:51.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.581+0000 7efe5deb7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efe580b64c0 0x7efe5806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.581+0000 7efe5d6b6640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efe5815e5f0 0x7efe580d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59690/0 (socket says 172.21.15.19:59690) 2024-09-12T01:57:51.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.581+0000 7efe5d6b6640 1 -- 172.21.15.19:0/3429182403 learned_addr learned my addr 172.21.15.19:0/3429182403 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:51.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.582+0000 7efe5ceb5640 1 --2- 172.21.15.19:0/3429182403 >> v2:172.21.15.135:3300/0 conn(0x7efe580d30f0 0x7efe580b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.582+0000 7efe5deb7640 1 -- 172.21.15.19:0/3429182403 >> v2:172.21.15.135:3300/0 conn(0x7efe580d30f0 msgr2=0x7efe580b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:51.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.582+0000 7efe5deb7640 1 --2- 172.21.15.19:0/3429182403 >> v2:172.21.15.135:3300/0 conn(0x7efe580d30f0 0x7efe580b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.582+0000 7efe5deb7640 1 -- 172.21.15.19:0/3429182403 >> v1:172.21.15.19:6789/0 conn(0x7efe5815e5f0 legacy=0x7efe580d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.582+0000 7efe5deb7640 1 -- 172.21.15.19:0/3429182403 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5806cee0 con 0x7efe580b64c0 2024-09-12T01:57:51.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.582+0000 7efe57fff640 1 -- 172.21.15.19:0/3429182403 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 535189156 0 0) 0x7efe580d3690 con 0x7efe5815e5f0 2024-09-12T01:57:51.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.582+0000 7efe5deb7640 1 --2- 172.21.15.19:0/3429182403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe580b64c0 0x7efe5806d9c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efe5808e520 tx=0x7efe4802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cf63a543f0e5c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:51.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.583+0000 7efe57fff640 1 -- 172.21.15.19:0/3429182403 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe48007740 con 0x7efe580b64c0 2024-09-12T01:57:51.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.583+0000 7efe57fff640 1 -- 172.21.15.19:0/3429182403 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe480078e0 con 0x7efe580b64c0 2024-09-12T01:57:51.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.583+0000 7efe57fff640 1 -- 172.21.15.19:0/3429182403 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe48007cb0 con 0x7efe580b64c0 2024-09-12T01:57:51.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.583+0000 7efe5f91a640 1 -- 172.21.15.19:0/3429182403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe580b64c0 msgr2=0x7efe5806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.583+0000 7efe5f91a640 1 --2- 172.21.15.19:0/3429182403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe580b64c0 0x7efe5806d9c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efe5808e520 tx=0x7efe4802a680 comp rx=0 tx=0).stop 2024-09-12T01:57:51.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.583+0000 7efe5f91a640 1 -- 172.21.15.19:0/3429182403 shutdown_connections 2024-09-12T01:57:51.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.583+0000 7efe5f91a640 1 --2- 172.21.15.19:0/3429182403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe580b64c0 0x7efe5806d9c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.583+0000 7efe5f91a640 1 --2- 172.21.15.19:0/3429182403 >> v2:172.21.15.135:3300/0 conn(0x7efe580d30f0 0x7efe580b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.583+0000 7efe5f91a640 1 -- 172.21.15.19:0/3429182403 >> 172.21.15.19:0/3429182403 conn(0x7efe5808bfc0 msgr2=0x7efe580d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:51.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.583+0000 7efe5f91a640 1 -- 172.21.15.19:0/3429182403 shutdown_connections 2024-09-12T01:57:51.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.583+0000 7efe5f91a640 1 -- 172.21.15.19:0/3429182403 wait complete. 2024-09-12T01:57:51.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.584+0000 7efe5f91a640 1 Processor -- start 2024-09-12T01:57:51.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.584+0000 7efe5f91a640 1 -- start start 2024-09-12T01:57:51.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.585+0000 7efe5f91a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe580b64c0 0x7efe580ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.585+0000 7efe5f91a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe580d30f0 0x7efe5809e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.585+0000 7efe5f91a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe5815e5f0 0x7efe580b83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.585+0000 7efe5f91a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efe5806df00 con 0x7efe580b64c0 2024-09-12T01:57:51.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.585+0000 7efe5f91a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efe5815e9d0 con 0x7efe5815e5f0 2024-09-12T01:57:51.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.585+0000 7efe5f91a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7efe5806e080 con 0x7efe580d30f0 2024-09-12T01:57:51.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.585+0000 7efe5d6b6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe580b64c0 0x7efe580ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.585+0000 7efe5d6b6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe580b64c0 0x7efe580ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33376/0 (socket says 172.21.15.19:33376) 2024-09-12T01:57:51.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.585+0000 7efe5d6b6640 1 -- 172.21.15.19:0/2518342768 learned_addr learned my addr 172.21.15.19:0/2518342768 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:51.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.586+0000 7efe5deb7640 1 --2- 172.21.15.19:0/2518342768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe5815e5f0 0x7efe580b83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.586+0000 7efe5ceb5640 1 --2- 172.21.15.19:0/2518342768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe580d30f0 0x7efe5809e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.586+0000 7efe5d6b6640 1 -- 172.21.15.19:0/2518342768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe580d30f0 msgr2=0x7efe5809e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.586+0000 7efe5d6b6640 1 --2- 172.21.15.19:0/2518342768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe580d30f0 0x7efe5809e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.586+0000 7efe5d6b6640 1 -- 172.21.15.19:0/2518342768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe5815e5f0 msgr2=0x7efe580b83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.586+0000 7efe5d6b6640 1 --2- 172.21.15.19:0/2518342768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe5815e5f0 0x7efe580b83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.586+0000 7efe5d6b6640 1 -- 172.21.15.19:0/2518342768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5809f0b0 con 0x7efe580b64c0 2024-09-12T01:57:51.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.586+0000 7efe5d6b6640 1 --2- 172.21.15.19:0/2518342768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe580b64c0 0x7efe580ca730 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efe5000c460 tx=0x7efe5000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:51.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.586+0000 7efe55ffb640 1 -- 172.21.15.19:0/2518342768 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50018070 con 0x7efe580b64c0 2024-09-12T01:57:51.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.586+0000 7efe55ffb640 1 -- 172.21.15.19:0/2518342768 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe50007500 con 0x7efe580b64c0 2024-09-12T01:57:51.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.586+0000 7efe5f91a640 1 -- 172.21.15.19:0/2518342768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe581f7600 con 0x7efe580b64c0 2024-09-12T01:57:51.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.586+0000 7efe55ffb640 1 -- 172.21.15.19:0/2518342768 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50004a20 con 0x7efe580b64c0 2024-09-12T01:57:51.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.586+0000 7efe5f91a640 1 -- 172.21.15.19:0/2518342768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe581f7bc0 con 0x7efe580b64c0 2024-09-12T01:57:51.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.587+0000 7efe5f91a640 1 -- 172.21.15.19:0/2518342768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe580ba1f0 con 0x7efe580b64c0 2024-09-12T01:57:51.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.587+0000 7efe55ffb640 1 -- 172.21.15.19:0/2518342768 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efe5001b070 con 0x7efe580b64c0 2024-09-12T01:57:51.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.588+0000 7efe55ffb640 1 --2- 172.21.15.19:0/2518342768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7efe4406be30 0x7efe4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.588+0000 7efe55ffb640 1 -- 172.21.15.19:0/2518342768 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5249+0+0 (secure 0 0 0) 0x7efe50089f50 con 0x7efe580b64c0 2024-09-12T01:57:51.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.588+0000 7efe5ceb5640 1 --2- 172.21.15.19:0/2518342768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7efe4406be30 0x7efe4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.589+0000 7efe5ceb5640 1 --2- 172.21.15.19:0/2518342768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7efe4406be30 0x7efe4406e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efe580cb530 tx=0x7efe4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:51.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.592+0000 7efe55ffb640 1 -- 172.21.15.19:0/2518342768 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efe50058ac0 con 0x7efe580b64c0 2024-09-12T01:57:51.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.770+0000 7efe5f91a640 1 -- 172.21.15.19:0/2518342768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7efe5806d9a0 con 0x7efe580b64c0 2024-09-12T01:57:51.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.770+0000 7efe55ffb640 1 -- 172.21.15.19:0/2518342768 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) ==== 84+0+65 (secure 0 0 0) 0x7efe500583c0 con 0x7efe580b64c0 2024-09-12T01:57:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:51.771 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-09-12T01:57:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:57:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-09-12T01:57:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-09-12T01:57:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:57:51.771 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-09-12T01:57:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.773+0000 7efe5f91a640 1 -- 172.21.15.19:0/2518342768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7efe4406be30 msgr2=0x7efe4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.773+0000 7efe5f91a640 1 --2- 172.21.15.19:0/2518342768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7efe4406be30 0x7efe4406e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efe580cb530 tx=0x7efe4c008040 comp rx=0 tx=0).stop 2024-09-12T01:57:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.773+0000 7efe5f91a640 1 -- 172.21.15.19:0/2518342768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe580b64c0 msgr2=0x7efe580ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.773+0000 7efe5f91a640 1 --2- 172.21.15.19:0/2518342768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe580b64c0 0x7efe580ca730 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efe5000c460 tx=0x7efe5000c920 comp rx=0 tx=0).stop 2024-09-12T01:57:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.773+0000 7efe5f91a640 1 -- 172.21.15.19:0/2518342768 shutdown_connections 2024-09-12T01:57:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.773+0000 7efe5f91a640 1 --2- 172.21.15.19:0/2518342768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7efe4406be30 0x7efe4406e2f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.773+0000 7efe5f91a640 1 --2- 172.21.15.19:0/2518342768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe5815e5f0 0x7efe580b83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.773+0000 7efe5f91a640 1 --2- 172.21.15.19:0/2518342768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe580d30f0 0x7efe5809e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.773+0000 7efe5f91a640 1 --2- 172.21.15.19:0/2518342768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe580b64c0 0x7efe580ca730 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.773+0000 7efe5f91a640 1 -- 172.21.15.19:0/2518342768 >> 172.21.15.19:0/2518342768 conn(0x7efe5808bfc0 msgr2=0x7efe580b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:51.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.773+0000 7efe5f91a640 1 -- 172.21.15.19:0/2518342768 shutdown_connections 2024-09-12T01:57:51.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.773+0000 7efe5f91a640 1 -- 172.21.15.19:0/2518342768 wait complete. 2024-09-12T01:57:51.784 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:57:51.784 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:57:51.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.889+0000 7f3a64ba6640 1 Processor -- start 2024-09-12T01:57:51.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.889+0000 7f3a64ba6640 1 -- start start 2024-09-12T01:57:51.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.890+0000 7f3a64ba6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3a60161a20 0x7f3a600d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.890+0000 7f3a64ba6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3a600d1420 0x7f3a600cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.890+0000 7f3a64ba6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a600cf160 0x7f3a600b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.890+0000 7f3a64ba6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f3a60161e00 con 0x7f3a60161a20 2024-09-12T01:57:51.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.890+0000 7f3a64ba6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f3a600d1830 con 0x7f3a600d1420 2024-09-12T01:57:51.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.890+0000 7f3a64ba6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3a600cf980 con 0x7f3a600cf160 2024-09-12T01:57:51.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.891+0000 7f3a5e59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3a60161a20 0x7f3a600d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.891+0000 7f3a5e59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3a60161a20 0x7f3a600d0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33392/0 (socket says 172.21.15.19:33392) 2024-09-12T01:57:51.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.891+0000 7f3a5e59c640 1 -- 172.21.15.19:0/1486454421 learned_addr learned my addr 172.21.15.19:0/1486454421 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:51.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.891+0000 7f3a5dd9b640 1 --2- 172.21.15.19:0/1486454421 >> v2:172.21.15.135:3300/0 conn(0x7f3a600d1420 0x7f3a600cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.891+0000 7f3a5ed9d640 1 --2- 172.21.15.19:0/1486454421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a600cf160 0x7f3a600b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.891+0000 7f3a5e59c640 1 -- 172.21.15.19:0/1486454421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a600cf160 msgr2=0x7f3a600b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:51.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.891+0000 7f3a5e59c640 1 --2- 172.21.15.19:0/1486454421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a600cf160 0x7f3a600b5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.891+0000 7f3a5e59c640 1 -- 172.21.15.19:0/1486454421 >> v2:172.21.15.135:3300/0 conn(0x7f3a600d1420 msgr2=0x7f3a600cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:51.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.891+0000 7f3a5e59c640 1 --2- 172.21.15.19:0/1486454421 >> v2:172.21.15.135:3300/0 conn(0x7f3a600d1420 0x7f3a600cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.891+0000 7f3a5e59c640 1 -- 172.21.15.19:0/1486454421 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6006d050 con 0x7f3a60161a20 2024-09-12T01:57:51.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.892+0000 7f3a5e59c640 1 --2- 172.21.15.19:0/1486454421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a60161a20 0x7f3a600d0ee0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3a6006d220 tx=0x7f3a5802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f52df1db6219ced server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:51.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.892+0000 7f3a5d59a640 1 -- 172.21.15.19:0/1486454421 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58037070 con 0x7f3a60161a20 2024-09-12T01:57:51.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.892+0000 7f3a5d59a640 1 -- 172.21.15.19:0/1486454421 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a58032440 con 0x7f3a60161a20 2024-09-12T01:57:51.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.892+0000 7f3a5d59a640 1 -- 172.21.15.19:0/1486454421 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58032810 con 0x7f3a60161a20 2024-09-12T01:57:51.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.892+0000 7f3a64ba6640 1 -- 172.21.15.19:0/1486454421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a60161a20 msgr2=0x7f3a600d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.892+0000 7f3a64ba6640 1 --2- 172.21.15.19:0/1486454421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a60161a20 0x7f3a600d0ee0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3a6006d220 tx=0x7f3a5802a1c0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.892+0000 7f3a64ba6640 1 -- 172.21.15.19:0/1486454421 shutdown_connections 2024-09-12T01:57:51.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.892+0000 7f3a64ba6640 1 --2- 172.21.15.19:0/1486454421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a600cf160 0x7f3a600b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.892+0000 7f3a64ba6640 1 --2- 172.21.15.19:0/1486454421 >> v2:172.21.15.135:3300/0 conn(0x7f3a600d1420 0x7f3a600cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.892+0000 7f3a64ba6640 1 --2- 172.21.15.19:0/1486454421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a60161a20 0x7f3a600d0ee0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.892+0000 7f3a64ba6640 1 -- 172.21.15.19:0/1486454421 >> 172.21.15.19:0/1486454421 conn(0x7f3a6009d850 msgr2=0x7f3a6008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:51.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.893+0000 7f3a64ba6640 1 -- 172.21.15.19:0/1486454421 shutdown_connections 2024-09-12T01:57:51.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.893+0000 7f3a64ba6640 1 -- 172.21.15.19:0/1486454421 wait complete. 2024-09-12T01:57:51.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.894+0000 7f3a64ba6640 1 Processor -- start 2024-09-12T01:57:51.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.894+0000 7f3a64ba6640 1 -- start start 2024-09-12T01:57:51.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.895+0000 7f3a64ba6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a600cf160 0x7f3a601f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.895+0000 7f3a64ba6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a600d1420 0x7f3a60158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.895+0000 7f3a64ba6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a60161a20 0x7f3a600c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.895+0000 7f3a64ba6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6006d2f0 con 0x7f3a600d1420 2024-09-12T01:57:51.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.895+0000 7f3a64ba6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3a600cff00 con 0x7f3a600cf160 2024-09-12T01:57:51.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.895+0000 7f3a64ba6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3a600b1040 con 0x7f3a60161a20 2024-09-12T01:57:51.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.895+0000 7f3a5dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a600d1420 0x7f3a60158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.895+0000 7f3a5dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a600d1420 0x7f3a60158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33394/0 (socket says 172.21.15.19:33394) 2024-09-12T01:57:51.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.895+0000 7f3a5dd9b640 1 -- 172.21.15.19:0/2473650657 learned_addr learned my addr 172.21.15.19:0/2473650657 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:51.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.895+0000 7f3a5e59c640 1 --2- 172.21.15.19:0/2473650657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a600cf160 0x7f3a601f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.895+0000 7f3a5ed9d640 1 --2- 172.21.15.19:0/2473650657 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a60161a20 0x7f3a600c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.895+0000 7f3a5dd9b640 1 -- 172.21.15.19:0/2473650657 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a60161a20 msgr2=0x7f3a600c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.895+0000 7f3a5dd9b640 1 --2- 172.21.15.19:0/2473650657 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a60161a20 0x7f3a600c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.895+0000 7f3a5dd9b640 1 -- 172.21.15.19:0/2473650657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a600cf160 msgr2=0x7f3a601f3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.895+0000 7f3a5dd9b640 1 --2- 172.21.15.19:0/2473650657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a600cf160 0x7f3a601f3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.895+0000 7f3a5dd9b640 1 -- 172.21.15.19:0/2473650657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a60158f60 con 0x7f3a600d1420 2024-09-12T01:57:51.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.895+0000 7f3a5dd9b640 1 --2- 172.21.15.19:0/2473650657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a600d1420 0x7f3a60158a20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3a4800d800 tx=0x7f3a4800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:51.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.895+0000 7f3a56ffd640 1 -- 172.21.15.19:0/2473650657 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4800b6c0 con 0x7f3a600d1420 2024-09-12T01:57:51.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.896+0000 7f3a56ffd640 1 -- 172.21.15.19:0/2473650657 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a48019070 con 0x7f3a600d1420 2024-09-12T01:57:51.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.896+0000 7f3a56ffd640 1 -- 172.21.15.19:0/2473650657 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4800ba80 con 0x7f3a600d1420 2024-09-12T01:57:51.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.896+0000 7f3a64ba6640 1 -- 172.21.15.19:0/2473650657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a600c8b70 con 0x7f3a600d1420 2024-09-12T01:57:51.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.896+0000 7f3a64ba6640 1 -- 172.21.15.19:0/2473650657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a600c9130 con 0x7f3a600d1420 2024-09-12T01:57:51.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.897+0000 7f3a64ba6640 1 -- 172.21.15.19:0/2473650657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a60075670 con 0x7f3a600d1420 2024-09-12T01:57:51.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.897+0000 7f3a56ffd640 1 -- 172.21.15.19:0/2473650657 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a4800bc20 con 0x7f3a600d1420 2024-09-12T01:57:51.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.897+0000 7f3a56ffd640 1 --2- 172.21.15.19:0/2473650657 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3a4006be30 0x7f3a4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.897+0000 7f3a56ffd640 1 -- 172.21.15.19:0/2473650657 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5249+0+0 (secure 0 0 0) 0x7f3a4808af60 con 0x7f3a600d1420 2024-09-12T01:57:51.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.898+0000 7f3a5e59c640 1 --2- 172.21.15.19:0/2473650657 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3a4006be30 0x7f3a4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.898+0000 7f3a5e59c640 1 --2- 172.21.15.19:0/2473650657 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3a4006be30 0x7f3a4006e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3a58034000 tx=0x7f3a5802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:51.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:51.902+0000 7f3a56ffd640 1 -- 172.21.15.19:0/2473650657 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a60075670 con 0x7f3a600d1420 2024-09-12T01:57:52.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:52.081+0000 7f3a64ba6640 1 -- 172.21.15.19:0/2473650657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3a600cec30 con 0x7f3a600d1420 2024-09-12T01:57:53.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.083+0000 7f3a56ffd640 1 -- 172.21.15.19:0/2473650657 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v51) ==== 138+0+0 (secure 0 0 0) 0x7f3a60158f60 con 0x7f3a600d1420 2024-09-12T01:57:53.084 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-09-12T01:57:53.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.087+0000 7f3a64ba6640 1 -- 172.21.15.19:0/2473650657 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3a4006be30 msgr2=0x7f3a4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:53.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.087+0000 7f3a64ba6640 1 --2- 172.21.15.19:0/2473650657 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3a4006be30 0x7f3a4006e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3a58034000 tx=0x7f3a5802e000 comp rx=0 tx=0).stop 2024-09-12T01:57:53.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.087+0000 7f3a64ba6640 1 -- 172.21.15.19:0/2473650657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a600d1420 msgr2=0x7f3a60158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:53.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.087+0000 7f3a64ba6640 1 --2- 172.21.15.19:0/2473650657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a600d1420 0x7f3a60158a20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3a4800d800 tx=0x7f3a4800dcc0 comp rx=0 tx=0).stop 2024-09-12T01:57:53.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.087+0000 7f3a64ba6640 1 -- 172.21.15.19:0/2473650657 shutdown_connections 2024-09-12T01:57:53.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.087+0000 7f3a64ba6640 1 --2- 172.21.15.19:0/2473650657 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3a4006be30 0x7f3a4006e2f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:53.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.087+0000 7f3a64ba6640 1 --2- 172.21.15.19:0/2473650657 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a60161a20 0x7f3a600c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:53.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.087+0000 7f3a64ba6640 1 --2- 172.21.15.19:0/2473650657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a600d1420 0x7f3a60158a20 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:53.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.087+0000 7f3a64ba6640 1 --2- 172.21.15.19:0/2473650657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a600cf160 0x7f3a601f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:53.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.087+0000 7f3a64ba6640 1 -- 172.21.15.19:0/2473650657 >> 172.21.15.19:0/2473650657 conn(0x7f3a6009d850 msgr2=0x7f3a60160810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:53.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.087+0000 7f3a64ba6640 1 -- 172.21.15.19:0/2473650657 shutdown_connections 2024-09-12T01:57:53.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.087+0000 7f3a64ba6640 1 -- 172.21.15.19:0/2473650657 wait complete. 2024-09-12T01:57:53.105 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:57:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.220+0000 7f4c1f51a640 1 Processor -- start 2024-09-12T01:57:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.220+0000 7f4c1f51a640 1 -- start start 2024-09-12T01:57:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.221+0000 7f4c1f51a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4c18161a20 0x7f4c180d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.221+0000 7f4c1f51a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180cf330 0x7f4c1806d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.221+0000 7f4c1f51a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c180d1830 con 0x7f4c180d1420 2024-09-12T01:57:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.221+0000 7f4c1f51a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f4c180cf760 con 0x7f4c18161a20 2024-09-12T01:57:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.221+0000 7f4c1f51a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4c18161e00 con 0x7f4c180cf330 2024-09-12T01:57:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.221+0000 7f4c1cab5640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4c180d1420 0x7f4c180cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59692/0 (socket says 172.21.15.19:59692) 2024-09-12T01:57:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.221+0000 7f4c1cab5640 1 -- 172.21.15.19:0/322948093 learned_addr learned my addr 172.21.15.19:0/322948093 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.221+0000 7f4c1d2b6640 1 --2- 172.21.15.19:0/322948093 >> v2:172.21.15.135:3300/0 conn(0x7f4c18161a20 0x7f4c180d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.221+0000 7f4c1dab7640 1 --2- 172.21.15.19:0/322948093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180cf330 0x7f4c1806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.221+0000 7f4c0ffff640 1 -- 172.21.15.19:0/322948093 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 712308613 0 0) 0x7f4c08001110 con 0x7f4c180d1420 2024-09-12T01:57:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.221+0000 7f4c0ffff640 1 -- 172.21.15.19:0/322948093 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c04003520 con 0x7f4c180d1420 2024-09-12T01:57:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c0ffff640 1 -- 172.21.15.19:0/322948093 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3714269311 0 0) 0x7f4c04003520 con 0x7f4c180d1420 2024-09-12T01:57:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c0ffff640 1 -- 172.21.15.19:0/322948093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180cf330 msgr2=0x7f4c1806d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c0ffff640 1 --2- 172.21.15.19:0/322948093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180cf330 0x7f4c1806d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c0ffff640 1 -- 172.21.15.19:0/322948093 >> v2:172.21.15.135:3300/0 conn(0x7f4c18161a20 msgr2=0x7f4c180d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c0ffff640 1 --2- 172.21.15.19:0/322948093 >> v2:172.21.15.135:3300/0 conn(0x7f4c18161a20 0x7f4c180d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c0ffff640 1 -- 172.21.15.19:0/322948093 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c180cf980 con 0x7f4c180d1420 2024-09-12T01:57:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c0ffff640 1 -- 172.21.15.19:0/322948093 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f4c08001860 con 0x7f4c180d1420 2024-09-12T01:57:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c0ffff640 1 -- 172.21.15.19:0/322948093 >> v1:172.21.15.19:6789/0 conn(0x7f4c180d1420 legacy=0x7f4c180cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c0ffff640 1 --2- 172.21.15.19:0/322948093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180cf330 0x7f4c040039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c0ffff640 1 --2- 172.21.15.19:0/322948093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c04003f60 0x7f4c04004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c0ffff640 1 --2- 172.21.15.19:0/322948093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c04004d40 0x7f4c040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c0ffff640 1 -- 172.21.15.19:0/322948093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4c180cf760 con 0x7f4c04003f60 2024-09-12T01:57:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c0ffff640 1 -- 172.21.15.19:0/322948093 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4c18161e00 con 0x7f4c04004d40 2024-09-12T01:57:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c0ffff640 1 -- 172.21.15.19:0/322948093 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0400b9c0 con 0x7f4c180cf330 2024-09-12T01:57:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c1cab5640 1 --2- 172.21.15.19:0/322948093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c04003f60 0x7f4c04004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c1d2b6640 1 --2- 172.21.15.19:0/322948093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180cf330 0x7f4c040039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c1dab7640 1 --2- 172.21.15.19:0/322948093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c04004d40 0x7f4c040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c1cab5640 1 -- 172.21.15.19:0/322948093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180cf330 msgr2=0x7f4c040039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c1cab5640 1 --2- 172.21.15.19:0/322948093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180cf330 0x7f4c040039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c1cab5640 1 -- 172.21.15.19:0/322948093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c04004d40 msgr2=0x7f4c040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c1cab5640 1 --2- 172.21.15.19:0/322948093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c04004d40 0x7f4c040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.222+0000 7f4c1cab5640 1 -- 172.21.15.19:0/322948093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c04003520 con 0x7f4c04003f60 2024-09-12T01:57:53.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.223+0000 7f4c1cab5640 1 --2- 172.21.15.19:0/322948093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c04003f60 0x7f4c04004800 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c490 tx=0x7f4c04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1e4d94c0787d4d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:53.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.223+0000 7f4c0ffff640 1 -- 172.21.15.19:0/322948093 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0800c0e0 con 0x7f4c04003f60 2024-09-12T01:57:53.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.223+0000 7f4c0ffff640 1 -- 172.21.15.19:0/322948093 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c08034070 con 0x7f4c04003f60 2024-09-12T01:57:53.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.223+0000 7f4c0ffff640 1 -- 172.21.15.19:0/322948093 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08005d10 con 0x7f4c04003f60 2024-09-12T01:57:53.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.224+0000 7f4c1f51a640 1 -- 172.21.15.19:0/322948093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c04003f60 msgr2=0x7f4c04004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:53.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.224+0000 7f4c1f51a640 1 --2- 172.21.15.19:0/322948093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c04003f60 0x7f4c04004800 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c490 tx=0x7f4c04005830 comp rx=0 tx=0).stop 2024-09-12T01:57:53.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.224+0000 7f4c1dab7640 1 -- 172.21.15.19:0/322948093 reap_dead start 2024-09-12T01:57:53.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.224+0000 7f4c1f51a640 1 -- 172.21.15.19:0/322948093 shutdown_connections 2024-09-12T01:57:53.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.224+0000 7f4c1f51a640 1 -- 172.21.15.19:0/322948093 >> 172.21.15.19:0/322948093 conn(0x7f4c1809d850 msgr2=0x7f4c1808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:53.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.224+0000 7f4c1f51a640 1 -- 172.21.15.19:0/322948093 shutdown_connections 2024-09-12T01:57:53.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.224+0000 7f4c1f51a640 1 -- 172.21.15.19:0/322948093 wait complete. 2024-09-12T01:57:53.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.225+0000 7f4c1f51a640 1 Processor -- start 2024-09-12T01:57:53.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.225+0000 7f4c1f51a640 1 -- start start 2024-09-12T01:57:53.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.226+0000 7f4c1f51a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c04003f60 0x7f4c180a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:53.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.226+0000 7f4c1f51a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c180b8370 0x7f4c180ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:53.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.226+0000 7f4c1f51a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c1815bd90 0x7f4c1809e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:53.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.226+0000 7f4c1f51a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4c180cff00 con 0x7f4c04003f60 2024-09-12T01:57:53.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.226+0000 7f4c1f51a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1806d050 con 0x7f4c180b8370 2024-09-12T01:57:53.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.226+0000 7f4c1f51a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4c1806d2f0 con 0x7f4c1815bd90 2024-09-12T01:57:53.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.226+0000 7f4c1d2b6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c04003f60 0x7f4c180a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:53.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.226+0000 7f4c1d2b6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c04003f60 0x7f4c180a0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33416/0 (socket says 172.21.15.19:33416) 2024-09-12T01:57:53.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.226+0000 7f4c1d2b6640 1 -- 172.21.15.19:0/3428931368 learned_addr learned my addr 172.21.15.19:0/3428931368 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:53.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.226+0000 7f4c1dab7640 1 --2- 172.21.15.19:0/3428931368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c1815bd90 0x7f4c1809e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:53.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.226+0000 7f4c1cab5640 1 --2- 172.21.15.19:0/3428931368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c180b8370 0x7f4c180ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:53.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.226+0000 7f4c1d2b6640 1 -- 172.21.15.19:0/3428931368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c1815bd90 msgr2=0x7f4c1809e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:53.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.226+0000 7f4c1d2b6640 1 --2- 172.21.15.19:0/3428931368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c1815bd90 0x7f4c1809e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:53.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.226+0000 7f4c1d2b6640 1 -- 172.21.15.19:0/3428931368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c180b8370 msgr2=0x7f4c180ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:53.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.226+0000 7f4c1d2b6640 1 --2- 172.21.15.19:0/3428931368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c180b8370 0x7f4c180ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:53.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.226+0000 7f4c1d2b6640 1 -- 172.21.15.19:0/3428931368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c180cb240 con 0x7f4c04003f60 2024-09-12T01:57:53.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.226+0000 7f4c1cab5640 1 --2- 172.21.15.19:0/3428931368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c180b8370 0x7f4c180ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:53.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.226+0000 7f4c1d2b6640 1 --2- 172.21.15.19:0/3428931368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c04003f60 0x7f4c180a0e10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4c14011960 tx=0x7f4c14011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:53.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.227+0000 7f4c0dffb640 1 -- 172.21.15.19:0/3428931368 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c14009590 con 0x7f4c04003f60 2024-09-12T01:57:53.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.227+0000 7f4c0dffb640 1 -- 172.21.15.19:0/3428931368 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c1400fa90 con 0x7f4c04003f60 2024-09-12T01:57:53.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.227+0000 7f4c1f51a640 1 -- 172.21.15.19:0/3428931368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c180a13f0 con 0x7f4c04003f60 2024-09-12T01:57:53.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.227+0000 7f4c0dffb640 1 -- 172.21.15.19:0/3428931368 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1400fe80 con 0x7f4c04003f60 2024-09-12T01:57:53.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.227+0000 7f4c1f51a640 1 -- 172.21.15.19:0/3428931368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c180c8f30 con 0x7f4c04003f60 2024-09-12T01:57:53.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.228+0000 7f4c1f51a640 1 -- 172.21.15.19:0/3428931368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c180a1910 con 0x7f4c04003f60 2024-09-12T01:57:53.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.228+0000 7f4c0dffb640 1 -- 172.21.15.19:0/3428931368 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c14012040 con 0x7f4c04003f60 2024-09-12T01:57:53.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.229+0000 7f4c0dffb640 1 --2- 172.21.15.19:0/3428931368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4bfc06be60 0x7f4bfc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:53.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.229+0000 7f4c0dffb640 1 -- 172.21.15.19:0/3428931368 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5619+0+0 (secure 0 0 0) 0x7f4c1408b340 con 0x7f4c04003f60 2024-09-12T01:57:53.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.229+0000 7f4c1cab5640 1 --2- 172.21.15.19:0/3428931368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4bfc06be60 0x7f4bfc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:53.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.229+0000 7f4c1cab5640 1 --2- 172.21.15.19:0/3428931368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4bfc06be60 0x7f4bfc06e320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4c08033000 tx=0x7f4c0802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:53.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.233+0000 7f4c0dffb640 1 -- 172.21.15.19:0/3428931368 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c14019030 con 0x7f4c04003f60 2024-09-12T01:57:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:53.408+0000 7f4c1f51a640 1 -- 172.21.15.19:0/3428931368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4c180b1040 con 0x7f4c04003f60 2024-09-12T01:57:54.040 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:57:54.043 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:57:54.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.085+0000 7f4c0dffb640 1 -- 172.21.15.19:0/3428931368 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v52) ==== 170+0+0 (secure 0 0 0) 0x7f4c14059780 con 0x7f4c04003f60 2024-09-12T01:57:54.086 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-09-12T01:57:54.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.089+0000 7f4c1f51a640 1 -- 172.21.15.19:0/3428931368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4bfc06be60 msgr2=0x7f4bfc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.089+0000 7f4c1f51a640 1 --2- 172.21.15.19:0/3428931368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4bfc06be60 0x7f4bfc06e320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4c08033000 tx=0x7f4c0802e000 comp rx=0 tx=0).stop 2024-09-12T01:57:54.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.090+0000 7f4c1f51a640 1 -- 172.21.15.19:0/3428931368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c04003f60 msgr2=0x7f4c180a0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.090+0000 7f4c1f51a640 1 --2- 172.21.15.19:0/3428931368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c04003f60 0x7f4c180a0e10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4c14011960 tx=0x7f4c14011e20 comp rx=0 tx=0).stop 2024-09-12T01:57:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.099+0000 7f4c1f51a640 1 -- 172.21.15.19:0/3428931368 shutdown_connections 2024-09-12T01:57:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.099+0000 7f4c1f51a640 1 --2- 172.21.15.19:0/3428931368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4bfc06be60 0x7f4bfc06e320 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.099+0000 7f4c1f51a640 1 --2- 172.21.15.19:0/3428931368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c1815bd90 0x7f4c1809e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.099+0000 7f4c1f51a640 1 --2- 172.21.15.19:0/3428931368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c180b8370 0x7f4c180ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.099+0000 7f4c1f51a640 1 --2- 172.21.15.19:0/3428931368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c04003f60 0x7f4c180a0e10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.100+0000 7f4c1f51a640 1 -- 172.21.15.19:0/3428931368 >> 172.21.15.19:0/3428931368 conn(0x7f4c1809d850 msgr2=0x7f4c180cbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.104+0000 7f4c1f51a640 1 -- 172.21.15.19:0/3428931368 shutdown_connections 2024-09-12T01:57:54.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.105+0000 7f4c1f51a640 1 -- 172.21.15.19:0/3428931368 wait complete. 2024-09-12T01:57:54.123 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:57:54.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.276+0000 7fc4ab798640 1 Processor -- start 2024-09-12T01:57:54.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.276+0000 7fc4ab798640 1 -- start start 2024-09-12T01:57:54.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.277+0000 7fc4ab798640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc4a40d15f0 0x7fc4a40cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.277+0000 7fc4ab798640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc4a40cf160 0x7fc4a406d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.277+0000 7fc4ab798640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4a40cf980 con 0x7fc4a4161a20 2024-09-12T01:57:54.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.277+0000 7fc4ab798640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fc4a4161e00 con 0x7fc4a40cf160 2024-09-12T01:57:54.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.277+0000 7fc4ab798640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc4a406d050 con 0x7fc4a40d15f0 2024-09-12T01:57:54.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.277+0000 7fc4a9d35640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc4a40cf160 0x7fc4a406d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.277+0000 7fc4a9d35640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc4a40cf160 0x7fc4a406d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33420/0 (socket says 172.21.15.19:33420) 2024-09-12T01:57:54.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.277+0000 7fc4a9d35640 1 -- 172.21.15.19:0/575864384 learned_addr learned my addr 172.21.15.19:0/575864384 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:54.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.277+0000 7fc4a9d35640 1 -- 172.21.15.19:0/575864384 >> v2:172.21.15.135:3300/0 conn(0x7fc4a40d15f0 msgr2=0x7fc4a40cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:54.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.277+0000 7fc4a9d35640 1 --2- 172.21.15.19:0/575864384 >> v2:172.21.15.135:3300/0 conn(0x7fc4a40d15f0 0x7fc4a40cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.278+0000 7fc4a9d35640 1 -- 172.21.15.19:0/575864384 >> v1:172.21.15.135:6789/0 conn(0x7fc4a4161a20 legacy=0x7fc4a40d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:54.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.278+0000 7fc4a9d35640 1 -- 172.21.15.19:0/575864384 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a40cfc20 con 0x7fc4a40cf160 2024-09-12T01:57:54.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.278+0000 7fc4a9d35640 1 --2- 172.21.15.19:0/575864384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4a40cf160 0x7fc4a406d810 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40d4410 tx=0x7fc49c02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd93b46aa218c54 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.278+0000 7fc49bfff640 1 -- 172.21.15.19:0/575864384 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c036070 con 0x7fc4a40cf160 2024-09-12T01:57:54.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.278+0000 7fc49bfff640 1 -- 172.21.15.19:0/575864384 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc49c031600 con 0x7fc4a40cf160 2024-09-12T01:57:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.278+0000 7fc49bfff640 1 -- 172.21.15.19:0/575864384 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c0319d0 con 0x7fc4a40cf160 2024-09-12T01:57:54.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.279+0000 7fc4ab798640 1 -- 172.21.15.19:0/575864384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4a40cf160 msgr2=0x7fc4a406d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.279+0000 7fc4ab798640 1 --2- 172.21.15.19:0/575864384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4a40cf160 0x7fc4a406d810 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40d4410 tx=0x7fc49c02a6d0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.279+0000 7fc4ab798640 1 -- 172.21.15.19:0/575864384 shutdown_connections 2024-09-12T01:57:54.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.279+0000 7fc4ab798640 1 --2- 172.21.15.19:0/575864384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4a40cf160 0x7fc4a406d810 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.279+0000 7fc4ab798640 1 --2- 172.21.15.19:0/575864384 >> v2:172.21.15.135:3300/0 conn(0x7fc4a40d15f0 0x7fc4a40cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.279+0000 7fc4ab798640 1 -- 172.21.15.19:0/575864384 >> 172.21.15.19:0/575864384 conn(0x7fc4a409d850 msgr2=0x7fc4a408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.279+0000 7fc4ab798640 1 -- 172.21.15.19:0/575864384 shutdown_connections 2024-09-12T01:57:54.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.279+0000 7fc4ab798640 1 -- 172.21.15.19:0/575864384 wait complete. 2024-09-12T01:57:54.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.280+0000 7fc4ab798640 1 Processor -- start 2024-09-12T01:57:54.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.280+0000 7fc4ab798640 1 -- start start 2024-09-12T01:57:54.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.281+0000 7fc4ab798640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4a40cf160 0x7fc4a40c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.281+0000 7fc4ab798640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4a40d15f0 0x7fc4a4150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.281+0000 7fc4ab798640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4a4161a20 0x7fc4a40b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.281+0000 7fc4ab798640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a40b1040 con 0x7fc4a4161a20 2024-09-12T01:57:54.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.281+0000 7fc4ab798640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a406d2f0 con 0x7fc4a40cf160 2024-09-12T01:57:54.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.281+0000 7fc4ab798640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a40cf590 con 0x7fc4a40d15f0 2024-09-12T01:57:54.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.281+0000 7fc4a9d35640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4a4161a20 0x7fc4a40b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.281+0000 7fc4a9d35640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4a4161a20 0x7fc4a40b67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33426/0 (socket says 172.21.15.19:33426) 2024-09-12T01:57:54.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.281+0000 7fc4a9d35640 1 -- 172.21.15.19:0/2461334889 learned_addr learned my addr 172.21.15.19:0/2461334889 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:54.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.281+0000 7fc4a9534640 1 --2- 172.21.15.19:0/2461334889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4a40cf160 0x7fc4a40c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.281+0000 7fc4a8d33640 1 --2- 172.21.15.19:0/2461334889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4a40d15f0 0x7fc4a4150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.281+0000 7fc4a9d35640 1 -- 172.21.15.19:0/2461334889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4a40d15f0 msgr2=0x7fc4a4150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.281+0000 7fc4a9d35640 1 --2- 172.21.15.19:0/2461334889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4a40d15f0 0x7fc4a4150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.281+0000 7fc4a9d35640 1 -- 172.21.15.19:0/2461334889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4a40cf160 msgr2=0x7fc4a40c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.281+0000 7fc4a9d35640 1 --2- 172.21.15.19:0/2461334889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4a40cf160 0x7fc4a40c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.281+0000 7fc4a9d35640 1 -- 172.21.15.19:0/2461334889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a4151120 con 0x7fc4a4161a20 2024-09-12T01:57:54.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.281+0000 7fc4a9534640 1 --2- 172.21.15.19:0/2461334889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4a40cf160 0x7fc4a40c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:54.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.282+0000 7fc4a9d35640 1 --2- 172.21.15.19:0/2461334889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4a4161a20 0x7fc4a40b67c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc49c034040 tx=0x7fc49c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.282+0000 7fc499ffb640 1 -- 172.21.15.19:0/2461334889 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c041020 con 0x7fc4a4161a20 2024-09-12T01:57:54.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.282+0000 7fc499ffb640 1 -- 172.21.15.19:0/2461334889 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc49c0094d0 con 0x7fc4a4161a20 2024-09-12T01:57:54.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.282+0000 7fc4ab798640 1 -- 172.21.15.19:0/2461334889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a40c9f60 con 0x7fc4a4161a20 2024-09-12T01:57:54.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.282+0000 7fc499ffb640 1 -- 172.21.15.19:0/2461334889 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c036040 con 0x7fc4a4161a20 2024-09-12T01:57:54.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.282+0000 7fc4ab798640 1 -- 172.21.15.19:0/2461334889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a40ca520 con 0x7fc4a4161a20 2024-09-12T01:57:54.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.283+0000 7fc4ab798640 1 -- 172.21.15.19:0/2461334889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a40c7df0 con 0x7fc4a4161a20 2024-09-12T01:57:54.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.284+0000 7fc499ffb640 1 -- 172.21.15.19:0/2461334889 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc49c044020 con 0x7fc4a4161a20 2024-09-12T01:57:54.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.284+0000 7fc499ffb640 1 --2- 172.21.15.19:0/2461334889 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc48806be30 0x7fc48806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.284+0000 7fc499ffb640 1 -- 172.21.15.19:0/2461334889 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6001+0+0 (secure 0 0 0) 0x7fc49c0abd10 con 0x7fc4a4161a20 2024-09-12T01:57:54.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.285+0000 7fc4a9534640 1 --2- 172.21.15.19:0/2461334889 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc48806be30 0x7fc48806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.285+0000 7fc4a9534640 1 --2- 172.21.15.19:0/2461334889 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc48806be30 0x7fc48806e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0001750 tx=0x7fc4a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.289+0000 7fc499ffb640 1 -- 172.21.15.19:0/2461334889 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc4a40c7df0 con 0x7fc4a4161a20 2024-09-12T01:57:54.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:54.503+0000 7fc4ab798640 1 -- 172.21.15.19:0/2461334889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc4a40b50b0 con 0x7fc4a4161a20 2024-09-12T01:57:55.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.096+0000 7fc499ffb640 1 -- 172.21.15.19:0/2461334889 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v25) ==== 172+0+0 (secure 0 0 0) 0x7fc49c04b030 con 0x7fc4a4161a20 2024-09-12T01:57:55.097 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 7 and data pool 8 2024-09-12T01:57:55.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.102+0000 7fc4ab798640 1 -- 172.21.15.19:0/2461334889 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc48806be30 msgr2=0x7fc48806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.102+0000 7fc4ab798640 1 --2- 172.21.15.19:0/2461334889 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc48806be30 0x7fc48806e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0001750 tx=0x7fc4a0009040 comp rx=0 tx=0).stop 2024-09-12T01:57:55.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.102+0000 7fc4ab798640 1 -- 172.21.15.19:0/2461334889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4a4161a20 msgr2=0x7fc4a40b67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.102+0000 7fc4ab798640 1 --2- 172.21.15.19:0/2461334889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4a4161a20 0x7fc4a40b67c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc49c034040 tx=0x7fc49c004a40 comp rx=0 tx=0).stop 2024-09-12T01:57:55.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.103+0000 7fc4ab798640 1 -- 172.21.15.19:0/2461334889 shutdown_connections 2024-09-12T01:57:55.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.103+0000 7fc4ab798640 1 --2- 172.21.15.19:0/2461334889 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc48806be30 0x7fc48806e2f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.103+0000 7fc4ab798640 1 --2- 172.21.15.19:0/2461334889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4a4161a20 0x7fc4a40b67c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.103+0000 7fc4ab798640 1 --2- 172.21.15.19:0/2461334889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4a40d15f0 0x7fc4a4150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.103+0000 7fc4ab798640 1 --2- 172.21.15.19:0/2461334889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4a40cf160 0x7fc4a40c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.103+0000 7fc4ab798640 1 -- 172.21.15.19:0/2461334889 >> 172.21.15.19:0/2461334889 conn(0x7fc4a409d850 msgr2=0x7fc4a415e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:55.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.113+0000 7fc4ab798640 1 -- 172.21.15.19:0/2461334889 shutdown_connections 2024-09-12T01:57:55.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.114+0000 7fc4ab798640 1 -- 172.21.15.19:0/2461334889 wait complete. 2024-09-12T01:57:55.142 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:57:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.249+0000 7f24360dd640 1 Processor -- start 2024-09-12T01:57:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.249+0000 7f24360dd640 1 -- start start 2024-09-12T01:57:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.250+0000 7f24360dd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f24300d1540 0x7f243006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.250+0000 7f24360dd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f243009b690 0x7f243006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.250+0000 7f24360dd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24300d1970 con 0x7f243015e740 2024-09-12T01:57:55.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.250+0000 7f24360dd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f243015eb20 con 0x7f24300d1540 2024-09-12T01:57:55.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.250+0000 7f24360dd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f243006d260 con 0x7f243009b690 2024-09-12T01:57:55.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.250+0000 7f242effd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f24300d1540 0x7f243006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.250+0000 7f242effd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f24300d1540 0x7f243006dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33432/0 (socket says 172.21.15.19:33432) 2024-09-12T01:57:55.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.250+0000 7f242effd640 1 -- 172.21.15.19:0/2470153622 learned_addr learned my addr 172.21.15.19:0/2470153622 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:55.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.250+0000 7f242ffff640 1 --2- 172.21.15.19:0/2470153622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f243009b690 0x7f243006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.250+0000 7f242effd640 1 -- 172.21.15.19:0/2470153622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f243009b690 msgr2=0x7f243006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:55.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.250+0000 7f242effd640 1 --2- 172.21.15.19:0/2470153622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f243009b690 0x7f243006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.250+0000 7f242effd640 1 -- 172.21.15.19:0/2470153622 >> v1:172.21.15.135:6789/0 conn(0x7f243015e740 legacy=0x7f243006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.250+0000 7f242effd640 1 -- 172.21.15.19:0/2470153622 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24300d0780 con 0x7f24300d1540 2024-09-12T01:57:55.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.251+0000 7f242effd640 1 --2- 172.21.15.19:0/2470153622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24300d1540 0x7f243006dbd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f24240098a0 tx=0x7f242402a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265c9f47fc488d76 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:55.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.251+0000 7f242e7fc640 1 -- 172.21.15.19:0/2470153622 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424037070 con 0x7f24300d1540 2024-09-12T01:57:55.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.251+0000 7f242e7fc640 1 -- 172.21.15.19:0/2470153622 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2424032640 con 0x7f24300d1540 2024-09-12T01:57:55.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.251+0000 7f242e7fc640 1 -- 172.21.15.19:0/2470153622 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424032a10 con 0x7f24300d1540 2024-09-12T01:57:55.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.252+0000 7f24360dd640 1 -- 172.21.15.19:0/2470153622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24300d1540 msgr2=0x7f243006dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.252+0000 7f24360dd640 1 --2- 172.21.15.19:0/2470153622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24300d1540 0x7f243006dbd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f24240098a0 tx=0x7f242402a320 comp rx=0 tx=0).stop 2024-09-12T01:57:55.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.252+0000 7f24360dd640 1 -- 172.21.15.19:0/2470153622 shutdown_connections 2024-09-12T01:57:55.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.252+0000 7f24360dd640 1 --2- 172.21.15.19:0/2470153622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f243009b690 0x7f243006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.252+0000 7f24360dd640 1 --2- 172.21.15.19:0/2470153622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24300d1540 0x7f243006dbd0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.252+0000 7f24360dd640 1 -- 172.21.15.19:0/2470153622 >> 172.21.15.19:0/2470153622 conn(0x7f24300d23a0 msgr2=0x7f24300d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:55.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.252+0000 7f24360dd640 1 -- 172.21.15.19:0/2470153622 shutdown_connections 2024-09-12T01:57:55.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.252+0000 7f24360dd640 1 -- 172.21.15.19:0/2470153622 wait complete. 2024-09-12T01:57:55.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.253+0000 7f24360dd640 1 Processor -- start 2024-09-12T01:57:55.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.253+0000 7f24360dd640 1 -- start start 2024-09-12T01:57:55.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.254+0000 7f24360dd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f243009b690 0x7f243015bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.254+0000 7f24360dd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24300d1540 0x7f24301f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.254+0000 7f24360dd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f243015e740 0x7f243015b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.254+0000 7f24360dd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f24300d1020 con 0x7f243015e740 2024-09-12T01:57:55.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.254+0000 7f24360dd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f24300d0d40 con 0x7f24300d1540 2024-09-12T01:57:55.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.254+0000 7f24360dd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f243009bac0 con 0x7f243009b690 2024-09-12T01:57:55.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.254+0000 7f242ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f243015e740 0x7f243015b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.254+0000 7f242ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f243015e740 0x7f243015b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33440/0 (socket says 172.21.15.19:33440) 2024-09-12T01:57:55.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.254+0000 7f242ffff640 1 -- 172.21.15.19:0/334411215 learned_addr learned my addr 172.21.15.19:0/334411215 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:55.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.254+0000 7f242effd640 1 --2- 172.21.15.19:0/334411215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24300d1540 0x7f24301f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.254+0000 7f242f7fe640 1 --2- 172.21.15.19:0/334411215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f243009b690 0x7f243015bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.254+0000 7f242ffff640 1 -- 172.21.15.19:0/334411215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f243009b690 msgr2=0x7f243015bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.254+0000 7f242ffff640 1 --2- 172.21.15.19:0/334411215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f243009b690 0x7f243015bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.254+0000 7f242ffff640 1 -- 172.21.15.19:0/334411215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24300d1540 msgr2=0x7f24301f50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.254+0000 7f242ffff640 1 --2- 172.21.15.19:0/334411215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24300d1540 0x7f24301f50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.254+0000 7f242ffff640 1 -- 172.21.15.19:0/334411215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243015c380 con 0x7f243015e740 2024-09-12T01:57:55.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.254+0000 7f242f7fe640 1 --2- 172.21.15.19:0/334411215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f243009b690 0x7f243015bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:55.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.254+0000 7f242ffff640 1 --2- 172.21.15.19:0/334411215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f243015e740 0x7f243015b480 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f242800efc0 tx=0x7f242800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:55.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.255+0000 7f2417fff640 1 -- 172.21.15.19:0/334411215 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2428018020 con 0x7f243015e740 2024-09-12T01:57:55.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.255+0000 7f2417fff640 1 -- 172.21.15.19:0/334411215 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2428014480 con 0x7f243015e740 2024-09-12T01:57:55.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.255+0000 7f24360dd640 1 -- 172.21.15.19:0/334411215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f243015c660 con 0x7f243015e740 2024-09-12T01:57:55.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.255+0000 7f2417fff640 1 -- 172.21.15.19:0/334411215 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2428014870 con 0x7f243015e740 2024-09-12T01:57:55.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.255+0000 7f24360dd640 1 -- 172.21.15.19:0/334411215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f243015cc20 con 0x7f243015e740 2024-09-12T01:57:55.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.256+0000 7f24360dd640 1 -- 172.21.15.19:0/334411215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f243015ce60 con 0x7f243015e740 2024-09-12T01:57:55.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.256+0000 7f2417fff640 1 -- 172.21.15.19:0/334411215 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f242801b020 con 0x7f243015e740 2024-09-12T01:57:55.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.257+0000 7f2417fff640 1 --2- 172.21.15.19:0/334411215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f241c06be30 0x7f241c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.257+0000 7f2417fff640 1 -- 172.21.15.19:0/334411215 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f242808be80 con 0x7f243015e740 2024-09-12T01:57:55.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.257+0000 7f242f7fe640 1 --2- 172.21.15.19:0/334411215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f241c06be30 0x7f241c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.257+0000 7f242f7fe640 1 --2- 172.21.15.19:0/334411215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f241c06be30 0x7f241c06e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2420001680 tx=0x7f2420009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:55.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.261+0000 7f2417fff640 1 -- 172.21.15.19:0/334411215 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f243015ce60 con 0x7f243015e740 2024-09-12T01:57:55.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.438+0000 7f24360dd640 1 -- 172.21.15.19:0/334411215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f243006cd20 con 0x7f243015e740 2024-09-12T01:57:55.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.439+0000 7f2417fff640 1 -- 172.21.15.19:0/334411215 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+17003 (secure 0 0 0) 0x7f2428022020 con 0x7f243015e740 2024-09-12T01:57:55.440 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:55.440 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":53,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:57:54.505305+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:57:52.113320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-12T01:57:53.439514+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:57:55.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.441+0000 7f24360dd640 1 -- 172.21.15.19:0/334411215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f241c06be30 msgr2=0x7f241c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.441+0000 7f24360dd640 1 --2- 172.21.15.19:0/334411215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f241c06be30 0x7f241c06e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2420001680 tx=0x7f2420009040 comp rx=0 tx=0).stop 2024-09-12T01:57:55.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.441+0000 7f24360dd640 1 -- 172.21.15.19:0/334411215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f243015e740 msgr2=0x7f243015b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.441+0000 7f24360dd640 1 --2- 172.21.15.19:0/334411215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f243015e740 0x7f243015b480 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f242800efc0 tx=0x7f242800c490 comp rx=0 tx=0).stop 2024-09-12T01:57:55.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.441+0000 7f24360dd640 1 -- 172.21.15.19:0/334411215 shutdown_connections 2024-09-12T01:57:55.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.441+0000 7f24360dd640 1 --2- 172.21.15.19:0/334411215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f241c06be30 0x7f241c06e2f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.441+0000 7f24360dd640 1 --2- 172.21.15.19:0/334411215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f243015e740 0x7f243015b480 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.441+0000 7f24360dd640 1 --2- 172.21.15.19:0/334411215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24300d1540 0x7f24301f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.441+0000 7f24360dd640 1 --2- 172.21.15.19:0/334411215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f243009b690 0x7f243015bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.441+0000 7f24360dd640 1 -- 172.21.15.19:0/334411215 >> 172.21.15.19:0/334411215 conn(0x7f24300d23a0 msgr2=0x7f24300b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:55.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.441+0000 7f24360dd640 1 -- 172.21.15.19:0/334411215 shutdown_connections 2024-09-12T01:57:55.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.441+0000 7f24360dd640 1 -- 172.21.15.19:0/334411215 wait complete. 2024-09-12T01:57:55.452 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:57:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.554+0000 7f99b1e1e640 1 Processor -- start 2024-09-12T01:57:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.554+0000 7f99b1e1e640 1 -- start start 2024-09-12T01:57:55.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.555+0000 7f99b1e1e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f99ac15e740 0x7f99ac0d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.555+0000 7f99b1e1e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99ac0d0780 con 0x7f99ac09b690 2024-09-12T01:57:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.555+0000 7f99b1e1e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99ac0d0a60 con 0x7f99ac06dbd0 2024-09-12T01:57:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.555+0000 7f99b1e1e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f99ac15eb20 con 0x7f99ac15e740 2024-09-12T01:57:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.555+0000 7f99ab7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f99ac15e740 0x7f99ac0d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.555+0000 7f99aaffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f99ac09b690 0x7f99ac06d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59706/0 (socket says 172.21.15.19:59706) 2024-09-12T01:57:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.555+0000 7f99aaffd640 1 -- 172.21.15.19:0/1640615593 learned_addr learned my addr 172.21.15.19:0/1640615593 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.555+0000 7f99ab7fe640 1 -- 172.21.15.19:0/1640615593 >> v1:172.21.15.135:6789/0 conn(0x7f99ac06dbd0 legacy=0x7f99ac070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.555+0000 7f99ab7fe640 1 -- 172.21.15.19:0/1640615593 >> v1:172.21.15.19:6789/0 conn(0x7f99ac09b690 legacy=0x7f99ac06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.555+0000 7f99ab7fe640 1 -- 172.21.15.19:0/1640615593 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ac0d0d40 con 0x7f99ac15e740 2024-09-12T01:57:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.556+0000 7f99ab7fe640 1 --2- 172.21.15.19:0/1640615593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac15e740 0x7f99ac0d1540 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f999c0097a0 tx=0x7f999c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0e6667269255dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.556+0000 7f99aa7fc640 1 -- 172.21.15.19:0/1640615593 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c037070 con 0x7f99ac15e740 2024-09-12T01:57:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.556+0000 7f99aa7fc640 1 -- 172.21.15.19:0/1640615593 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f999c032640 con 0x7f99ac15e740 2024-09-12T01:57:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.556+0000 7f99aa7fc640 1 -- 172.21.15.19:0/1640615593 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c032a10 con 0x7f99ac15e740 2024-09-12T01:57:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.557+0000 7f99b1e1e640 1 -- 172.21.15.19:0/1640615593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac15e740 msgr2=0x7f99ac0d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.557+0000 7f99b1e1e640 1 --2- 172.21.15.19:0/1640615593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac15e740 0x7f99ac0d1540 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f999c0097a0 tx=0x7f999c02a2c0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.557+0000 7f99b1e1e640 1 -- 172.21.15.19:0/1640615593 shutdown_connections 2024-09-12T01:57:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.557+0000 7f99b1e1e640 1 --2- 172.21.15.19:0/1640615593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac15e740 0x7f99ac0d1540 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.557+0000 7f99b1e1e640 1 -- 172.21.15.19:0/1640615593 >> 172.21.15.19:0/1640615593 conn(0x7f99ac0d23a0 msgr2=0x7f99ac0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.557+0000 7f99b1e1e640 1 -- 172.21.15.19:0/1640615593 shutdown_connections 2024-09-12T01:57:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.557+0000 7f99b1e1e640 1 -- 172.21.15.19:0/1640615593 wait complete. 2024-09-12T01:57:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.558+0000 7f99b1e1e640 1 Processor -- start 2024-09-12T01:57:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.558+0000 7f99b1e1e640 1 -- start start 2024-09-12T01:57:55.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.559+0000 7f99b1e1e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99ac06dbd0 0x7f99ac0cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.559+0000 7f99b1e1e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac09b690 0x7f99ac15d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.559+0000 7f99b1e1e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99ac15e740 0x7f99ac1e92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.559+0000 7f99b1e1e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac06dfe0 con 0x7f99ac09b690 2024-09-12T01:57:55.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.559+0000 7f99b1e1e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac09bac0 con 0x7f99ac06dbd0 2024-09-12T01:57:55.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.559+0000 7f99b1e1e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f99ac06cd20 con 0x7f99ac15e740 2024-09-12T01:57:55.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.559+0000 7f99aaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac09b690 0x7f99ac15d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.559+0000 7f99aaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac09b690 0x7f99ac15d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33458/0 (socket says 172.21.15.19:33458) 2024-09-12T01:57:55.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.559+0000 7f99aaffd640 1 -- 172.21.15.19:0/3178586182 learned_addr learned my addr 172.21.15.19:0/3178586182 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:55.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.559+0000 7f99ab7fe640 1 --2- 172.21.15.19:0/3178586182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99ac06dbd0 0x7f99ac0cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.559+0000 7f99abfff640 1 --2- 172.21.15.19:0/3178586182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99ac15e740 0x7f99ac1e92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.559+0000 7f99aaffd640 1 -- 172.21.15.19:0/3178586182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99ac15e740 msgr2=0x7f99ac1e92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.560+0000 7f99aaffd640 1 --2- 172.21.15.19:0/3178586182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99ac15e740 0x7f99ac1e92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.560+0000 7f99aaffd640 1 -- 172.21.15.19:0/3178586182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99ac06dbd0 msgr2=0x7f99ac0cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.560+0000 7f99aaffd640 1 --2- 172.21.15.19:0/3178586182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99ac06dbd0 0x7f99ac0cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.560+0000 7f99aaffd640 1 -- 172.21.15.19:0/3178586182 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ac1e97e0 con 0x7f99ac09b690 2024-09-12T01:57:55.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.560+0000 7f99aaffd640 1 --2- 172.21.15.19:0/3178586182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac09b690 0x7f99ac15d8f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f99a000c4d0 tx=0x7f99a000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:55.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.560+0000 7f9993fff640 1 -- 172.21.15.19:0/3178586182 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a0017070 con 0x7f99ac09b690 2024-09-12T01:57:55.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.560+0000 7f9993fff640 1 -- 172.21.15.19:0/3178586182 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a0005ce0 con 0x7f99ac09b690 2024-09-12T01:57:55.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.560+0000 7f99b1e1e640 1 -- 172.21.15.19:0/3178586182 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99ac1e9a90 con 0x7f99ac09b690 2024-09-12T01:57:55.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.560+0000 7f9993fff640 1 -- 172.21.15.19:0/3178586182 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a0007270 con 0x7f99ac09b690 2024-09-12T01:57:55.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.560+0000 7f99b1e1e640 1 -- 172.21.15.19:0/3178586182 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99ac1e8320 con 0x7f99ac09b690 2024-09-12T01:57:55.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.561+0000 7f99b1e1e640 1 -- 172.21.15.19:0/3178586182 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99ac0cc8a0 con 0x7f99ac09b690 2024-09-12T01:57:55.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.561+0000 7f9993fff640 1 -- 172.21.15.19:0/3178586182 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f99a001a070 con 0x7f99ac09b690 2024-09-12T01:57:55.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.562+0000 7f9993fff640 1 --2- 172.21.15.19:0/3178586182 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f999806be30 0x7f999806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.562+0000 7f9993fff640 1 -- 172.21.15.19:0/3178586182 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f99a008a140 con 0x7f99ac09b690 2024-09-12T01:57:55.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.562+0000 7f99ab7fe640 1 --2- 172.21.15.19:0/3178586182 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f999806be30 0x7f999806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.563+0000 7f99ab7fe640 1 --2- 172.21.15.19:0/3178586182 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f999806be30 0x7f999806e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f999c034000 tx=0x7f999c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:55.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.566+0000 7f9993fff640 1 -- 172.21.15.19:0/3178586182 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f99ac0cc8a0 con 0x7f99ac09b690 2024-09-12T01:57:55.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.741+0000 7f99b1e1e640 1 -- 172.21.15.19:0/3178586182 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99ac163020 con 0x7f99ac09b690 2024-09-12T01:57:55.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.742+0000 7f9993fff640 1 -- 172.21.15.19:0/3178586182 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+17003 (secure 0 0 0) 0x7f99a00583a0 con 0x7f99ac09b690 2024-09-12T01:57:55.742 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:55.743 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":53,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:57:54.505305+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:57:52.113320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-12T01:57:53.439514+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:57:55.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.744+0000 7f99b1e1e640 1 -- 172.21.15.19:0/3178586182 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f999806be30 msgr2=0x7f999806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.744+0000 7f99b1e1e640 1 --2- 172.21.15.19:0/3178586182 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f999806be30 0x7f999806e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f999c034000 tx=0x7f999c02e000 comp rx=0 tx=0).stop 2024-09-12T01:57:55.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.744+0000 7f99b1e1e640 1 -- 172.21.15.19:0/3178586182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac09b690 msgr2=0x7f99ac15d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.744+0000 7f99b1e1e640 1 --2- 172.21.15.19:0/3178586182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac09b690 0x7f99ac15d8f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f99a000c4d0 tx=0x7f99a000c990 comp rx=0 tx=0).stop 2024-09-12T01:57:55.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.744+0000 7f99b1e1e640 1 -- 172.21.15.19:0/3178586182 shutdown_connections 2024-09-12T01:57:55.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.744+0000 7f99b1e1e640 1 --2- 172.21.15.19:0/3178586182 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f999806be30 0x7f999806e2f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.744+0000 7f99b1e1e640 1 --2- 172.21.15.19:0/3178586182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99ac15e740 0x7f99ac1e92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.744+0000 7f99b1e1e640 1 --2- 172.21.15.19:0/3178586182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac09b690 0x7f99ac15d8f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.744+0000 7f99b1e1e640 1 --2- 172.21.15.19:0/3178586182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99ac06dbd0 0x7f99ac0cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.744+0000 7f99b1e1e640 1 -- 172.21.15.19:0/3178586182 >> 172.21.15.19:0/3178586182 conn(0x7f99ac0d23a0 msgr2=0x7f99ac0cd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:55.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.744+0000 7f99b1e1e640 1 -- 172.21.15.19:0/3178586182 shutdown_connections 2024-09-12T01:57:55.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.744+0000 7f99b1e1e640 1 -- 172.21.15.19:0/3178586182 wait complete. 2024-09-12T01:57:55.757 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:57:55.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.862+0000 7f312e5d6640 1 Processor -- start 2024-09-12T01:57:55.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.862+0000 7f312e5d6640 1 -- start start 2024-09-12T01:57:55.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.863+0000 7f312e5d6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31280b5f80 0x7f3128162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.863+0000 7f312e5d6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f31280d4c10 0x7f31280b6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.863+0000 7f312e5d6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31280d2600 con 0x7f31280d3320 2024-09-12T01:57:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.863+0000 7f312e5d6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f31280d5420 con 0x7f31280d4c10 2024-09-12T01:57:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.863+0000 7f312e5d6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f31280d2e90 con 0x7f31280b5f80 2024-09-12T01:57:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.863+0000 7f31277fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f31280d4c10 0x7f31280b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.863+0000 7f312cb73640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f31280d3320 0x7f31280ceb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59712/0 (socket says 172.21.15.19:59712) 2024-09-12T01:57:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.863+0000 7f31277fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f31280d4c10 0x7f31280b6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33460/0 (socket says 172.21.15.19:33460) 2024-09-12T01:57:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.863+0000 7f312cb73640 1 -- 172.21.15.19:0/2093208104 learned_addr learned my addr 172.21.15.19:0/2093208104 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.863+0000 7f3127fff640 1 --2- 172.21.15.19:0/2093208104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31280b5f80 0x7f3128162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.863+0000 7f31277fe640 1 -- 172.21.15.19:0/2093208104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31280b5f80 msgr2=0x7f3128162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.863+0000 7f31277fe640 1 --2- 172.21.15.19:0/2093208104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31280b5f80 0x7f3128162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.863+0000 7f31277fe640 1 -- 172.21.15.19:0/2093208104 >> v1:172.21.15.19:6789/0 conn(0x7f31280d3320 legacy=0x7f31280ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.863+0000 7f3126ffd640 1 -- 172.21.15.19:0/2093208104 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715507605 0 0) 0x7f3120001490 con 0x7f31280d3320 2024-09-12T01:57:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.863+0000 7f31277fe640 1 -- 172.21.15.19:0/2093208104 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31280b3c10 con 0x7f31280d4c10 2024-09-12T01:57:55.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.864+0000 7f31277fe640 1 --2- 172.21.15.19:0/2093208104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31280d4c10 0x7f31280b6360 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f311c0097a0 tx=0x7f311c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b32fb541381117 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:55.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.864+0000 7f3126ffd640 1 -- 172.21.15.19:0/2093208104 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c037070 con 0x7f31280d4c10 2024-09-12T01:57:55.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.864+0000 7f3126ffd640 1 -- 172.21.15.19:0/2093208104 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f311c032440 con 0x7f31280d4c10 2024-09-12T01:57:55.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.864+0000 7f3126ffd640 1 -- 172.21.15.19:0/2093208104 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c032810 con 0x7f31280d4c10 2024-09-12T01:57:55.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.865+0000 7f312e5d6640 1 -- 172.21.15.19:0/2093208104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31280d4c10 msgr2=0x7f31280b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.865+0000 7f312e5d6640 1 --2- 172.21.15.19:0/2093208104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31280d4c10 0x7f31280b6360 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f311c0097a0 tx=0x7f311c02a180 comp rx=0 tx=0).stop 2024-09-12T01:57:55.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.865+0000 7f312e5d6640 1 -- 172.21.15.19:0/2093208104 shutdown_connections 2024-09-12T01:57:55.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.865+0000 7f312e5d6640 1 --2- 172.21.15.19:0/2093208104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31280d4c10 0x7f31280b6360 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.865+0000 7f312e5d6640 1 --2- 172.21.15.19:0/2093208104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31280b5f80 0x7f3128162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.865+0000 7f312e5d6640 1 -- 172.21.15.19:0/2093208104 >> 172.21.15.19:0/2093208104 conn(0x7f312808bfc0 msgr2=0x7f31280d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.865+0000 7f312e5d6640 1 -- 172.21.15.19:0/2093208104 shutdown_connections 2024-09-12T01:57:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.865+0000 7f312e5d6640 1 -- 172.21.15.19:0/2093208104 wait complete. 2024-09-12T01:57:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.866+0000 7f312e5d6640 1 Processor -- start 2024-09-12T01:57:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.866+0000 7f312e5d6640 1 -- start start 2024-09-12T01:57:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.867+0000 7f312e5d6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31280b5f80 0x7f31281f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.867+0000 7f312e5d6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31280d3320 0x7f31280b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.867+0000 7f312e5d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31280d4c10 0x7f312815b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.867+0000 7f312e5d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f31280d5140 con 0x7f31280d4c10 2024-09-12T01:57:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.867+0000 7f312e5d6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f31280d2880 con 0x7f31280b5f80 2024-09-12T01:57:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.867+0000 7f312e5d6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f31280d2b20 con 0x7f31280d3320 2024-09-12T01:57:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.867+0000 7f312cb73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31280d4c10 0x7f312815b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.867+0000 7f312cb73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31280d4c10 0x7f312815b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33468/0 (socket says 172.21.15.19:33468) 2024-09-12T01:57:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.867+0000 7f312cb73640 1 -- 172.21.15.19:0/4091678002 learned_addr learned my addr 172.21.15.19:0/4091678002 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.867+0000 7f3127fff640 1 --2- 172.21.15.19:0/4091678002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31280b5f80 0x7f31281f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.867+0000 7f31277fe640 1 --2- 172.21.15.19:0/4091678002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31280d3320 0x7f31280b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.867+0000 7f312cb73640 1 -- 172.21.15.19:0/4091678002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31280d3320 msgr2=0x7f31280b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.867+0000 7f312cb73640 1 --2- 172.21.15.19:0/4091678002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31280d3320 0x7f31280b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.867+0000 7f312cb73640 1 -- 172.21.15.19:0/4091678002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31280b5f80 msgr2=0x7f31281f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.867+0000 7f312cb73640 1 --2- 172.21.15.19:0/4091678002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31280b5f80 0x7f31281f4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.867+0000 7f312cb73640 1 -- 172.21.15.19:0/4091678002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31280b3470 con 0x7f31280d4c10 2024-09-12T01:57:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.868+0000 7f312cb73640 1 --2- 172.21.15.19:0/4091678002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31280d4c10 0x7f312815b100 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f312000c7f0 tx=0x7f312000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.868+0000 7f3124ff9640 1 -- 172.21.15.19:0/4091678002 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3120018070 con 0x7f31280d4c10 2024-09-12T01:57:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.868+0000 7f3124ff9640 1 -- 172.21.15.19:0/4091678002 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f312000a5e0 con 0x7f31280d4c10 2024-09-12T01:57:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.868+0000 7f3124ff9640 1 -- 172.21.15.19:0/4091678002 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312000aa10 con 0x7f31280d4c10 2024-09-12T01:57:55.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.868+0000 7f312e5d6640 1 -- 172.21.15.19:0/4091678002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31280b7580 con 0x7f31280d4c10 2024-09-12T01:57:55.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.868+0000 7f312e5d6640 1 -- 172.21.15.19:0/4091678002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31280b20a0 con 0x7f31280d4c10 2024-09-12T01:57:55.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.869+0000 7f312e5d6640 1 -- 172.21.15.19:0/4091678002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31280b6360 con 0x7f31280d4c10 2024-09-12T01:57:55.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.869+0000 7f3124ff9640 1 -- 172.21.15.19:0/4091678002 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f312001b070 con 0x7f31280d4c10 2024-09-12T01:57:55.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.870+0000 7f3124ff9640 1 --2- 172.21.15.19:0/4091678002 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f311406be60 0x7f311406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.870+0000 7f3124ff9640 1 -- 172.21.15.19:0/4091678002 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f312008a4a0 con 0x7f31280d4c10 2024-09-12T01:57:55.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.870+0000 7f3127fff640 1 --2- 172.21.15.19:0/4091678002 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f311406be60 0x7f311406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.871+0000 7f3127fff640 1 --2- 172.21.15.19:0/4091678002 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f311406be60 0x7f311406e320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3118006fd0 tx=0x7f3118008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:55.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:55.875+0000 7f3124ff9640 1 -- 172.21.15.19:0/4091678002 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f31280d2600 con 0x7f31280d4c10 2024-09-12T01:57:56.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.086+0000 7f312e5d6640 1 -- 172.21.15.19:0/4091678002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f31280c7bb0 con 0x7f31280d4c10 2024-09-12T01:57:56.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.113+0000 7f3124ff9640 1 -- 172.21.15.19:0/4091678002 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7f3120058700 con 0x7f31280d4c10 2024-09-12T01:57:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.115+0000 7f312e5d6640 1 -- 172.21.15.19:0/4091678002 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f311406be60 msgr2=0x7f311406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.115+0000 7f312e5d6640 1 --2- 172.21.15.19:0/4091678002 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f311406be60 0x7f311406e320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3118006fd0 tx=0x7f3118008040 comp rx=0 tx=0).stop 2024-09-12T01:57:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.115+0000 7f312e5d6640 1 -- 172.21.15.19:0/4091678002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31280d4c10 msgr2=0x7f312815b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.115+0000 7f312e5d6640 1 --2- 172.21.15.19:0/4091678002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31280d4c10 0x7f312815b100 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f312000c7f0 tx=0x7f312000ccb0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.115+0000 7f312e5d6640 1 -- 172.21.15.19:0/4091678002 shutdown_connections 2024-09-12T01:57:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.115+0000 7f312e5d6640 1 --2- 172.21.15.19:0/4091678002 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f311406be60 0x7f311406e320 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.115+0000 7f312e5d6640 1 --2- 172.21.15.19:0/4091678002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31280d4c10 0x7f312815b100 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.115+0000 7f312e5d6640 1 --2- 172.21.15.19:0/4091678002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31280d3320 0x7f31280b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.115+0000 7f312e5d6640 1 --2- 172.21.15.19:0/4091678002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31280b5f80 0x7f31281f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.115+0000 7f312e5d6640 1 -- 172.21.15.19:0/4091678002 >> 172.21.15.19:0/4091678002 conn(0x7f312808bfc0 msgr2=0x7f31280d3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.115+0000 7f312e5d6640 1 -- 172.21.15.19:0/4091678002 shutdown_connections 2024-09-12T01:57:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.116+0000 7f312e5d6640 1 -- 172.21.15.19:0/4091678002 wait complete. 2024-09-12T01:57:56.127 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T01:57:56.127 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T01:57:56.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.233+0000 7fa4a558d640 1 Processor -- start 2024-09-12T01:57:56.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.233+0000 7fa4a558d640 1 -- start start 2024-09-12T01:57:56.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.234+0000 7fa4a558d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa4a0162340 0x7fa4a006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:56.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.234+0000 7fa4a558d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa4a0162e30 0x7fa4a00d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:56.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.234+0000 7fa4a558d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4a015ff70 con 0x7fa4a00cf280 2024-09-12T01:57:56.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.234+0000 7fa4a558d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa4a01632a0 con 0x7fa4a0162e30 2024-09-12T01:57:56.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.234+0000 7fa4a558d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa4a006de90 con 0x7fa4a0162340 2024-09-12T01:57:56.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.234+0000 7fa49f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa4a0162e30 0x7fa4a00d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:56.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.234+0000 7fa49f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa4a0162e30 0x7fa4a00d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33484/0 (socket says 172.21.15.19:33484) 2024-09-12T01:57:56.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.234+0000 7fa49e7fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa4a00cf280 0x7fa4a0162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59718/0 (socket says 172.21.15.19:59718) 2024-09-12T01:57:56.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.234+0000 7fa49f7fe640 1 -- 172.21.15.19:0/1809528070 learned_addr learned my addr 172.21.15.19:0/1809528070 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:56.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.234+0000 7fa49effd640 1 --2- 172.21.15.19:0/1809528070 >> v2:172.21.15.135:3300/0 conn(0x7fa4a0162340 0x7fa4a006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:56.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.235+0000 7fa49f7fe640 1 -- 172.21.15.19:0/1809528070 >> v2:172.21.15.135:3300/0 conn(0x7fa4a0162340 msgr2=0x7fa4a006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:56.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.235+0000 7fa49f7fe640 1 --2- 172.21.15.19:0/1809528070 >> v2:172.21.15.135:3300/0 conn(0x7fa4a0162340 0x7fa4a006d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.235+0000 7fa49f7fe640 1 -- 172.21.15.19:0/1809528070 >> v1:172.21.15.19:6789/0 conn(0x7fa4a00cf280 legacy=0x7fa4a0162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:56.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.235+0000 7fa49f7fe640 1 -- 172.21.15.19:0/1809528070 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a00d4d10 con 0x7fa4a0162e30 2024-09-12T01:57:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.235+0000 7fa49f7fe640 1 --2- 172.21.15.19:0/1809528070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4a0162e30 0x7fa4a00d2990 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa4a008e4c0 tx=0x7fa49802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac45fcdd9cbd14f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.235+0000 7fa49dffb640 1 -- 172.21.15.19:0/1809528070 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa498037070 con 0x7fa4a0162e30 2024-09-12T01:57:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.235+0000 7fa49dffb640 1 -- 172.21.15.19:0/1809528070 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa498032440 con 0x7fa4a0162e30 2024-09-12T01:57:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.235+0000 7fa49dffb640 1 -- 172.21.15.19:0/1809528070 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa498032810 con 0x7fa4a0162e30 2024-09-12T01:57:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.236+0000 7fa4a558d640 1 -- 172.21.15.19:0/1809528070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4a0162e30 msgr2=0x7fa4a00d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.236+0000 7fa4a558d640 1 --2- 172.21.15.19:0/1809528070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4a0162e30 0x7fa4a00d2990 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa4a008e4c0 tx=0x7fa49802a1e0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.236+0000 7fa4a558d640 1 -- 172.21.15.19:0/1809528070 shutdown_connections 2024-09-12T01:57:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.236+0000 7fa4a558d640 1 --2- 172.21.15.19:0/1809528070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4a0162e30 0x7fa4a00d2990 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.236+0000 7fa4a558d640 1 --2- 172.21.15.19:0/1809528070 >> v2:172.21.15.135:3300/0 conn(0x7fa4a0162340 0x7fa4a006d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.236+0000 7fa4a558d640 1 -- 172.21.15.19:0/1809528070 >> 172.21.15.19:0/1809528070 conn(0x7fa4a008bfc0 msgr2=0x7fa4a00d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.236+0000 7fa4a558d640 1 -- 172.21.15.19:0/1809528070 shutdown_connections 2024-09-12T01:57:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.236+0000 7fa4a558d640 1 -- 172.21.15.19:0/1809528070 wait complete. 2024-09-12T01:57:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.237+0000 7fa4a558d640 1 Processor -- start 2024-09-12T01:57:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.237+0000 7fa4a558d640 1 -- start start 2024-09-12T01:57:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.238+0000 7fa4a558d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4a00cf280 0x7fa4a015a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.238+0000 7fa4a558d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4a0162340 0x7fa4a015a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.238+0000 7fa4a558d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4a0162e30 0x7fa4a015c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.238+0000 7fa4a558d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a00d52d0 con 0x7fa4a0162e30 2024-09-12T01:57:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.238+0000 7fa4a558d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a00d2470 con 0x7fa4a00cf280 2024-09-12T01:57:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.238+0000 7fa4a558d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a00cf6c0 con 0x7fa4a0162340 2024-09-12T01:57:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.238+0000 7fa49f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4a0162e30 0x7fa4a015c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.238+0000 7fa49f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4a0162e30 0x7fa4a015c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33498/0 (socket says 172.21.15.19:33498) 2024-09-12T01:57:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.238+0000 7fa49f7fe640 1 -- 172.21.15.19:0/3859572337 learned_addr learned my addr 172.21.15.19:0/3859572337 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.238+0000 7fa49effd640 1 --2- 172.21.15.19:0/3859572337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4a00cf280 0x7fa4a015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.238+0000 7fa49e7fc640 1 --2- 172.21.15.19:0/3859572337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4a0162340 0x7fa4a015a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.239+0000 7fa49f7fe640 1 -- 172.21.15.19:0/3859572337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4a0162340 msgr2=0x7fa4a015a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.239+0000 7fa49f7fe640 1 --2- 172.21.15.19:0/3859572337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4a0162340 0x7fa4a015a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.239+0000 7fa49f7fe640 1 -- 172.21.15.19:0/3859572337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4a00cf280 msgr2=0x7fa4a015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.239+0000 7fa49f7fe640 1 --2- 172.21.15.19:0/3859572337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4a00cf280 0x7fa4a015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.239+0000 7fa49f7fe640 1 -- 172.21.15.19:0/3859572337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a00b4310 con 0x7fa4a0162e30 2024-09-12T01:57:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.239+0000 7fa49f7fe640 1 --2- 172.21.15.19:0/3859572337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4a0162e30 0x7fa4a015c2f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa49802a220 tx=0x7fa4980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.239+0000 7fa4977fe640 1 -- 172.21.15.19:0/3859572337 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa498037040 con 0x7fa4a0162e30 2024-09-12T01:57:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.239+0000 7fa4977fe640 1 -- 172.21.15.19:0/3859572337 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa498042070 con 0x7fa4a0162e30 2024-09-12T01:57:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.239+0000 7fa4a558d640 1 -- 172.21.15.19:0/3859572337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a00b45f0 con 0x7fa4a0162e30 2024-09-12T01:57:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.239+0000 7fa4977fe640 1 -- 172.21.15.19:0/3859572337 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa498030920 con 0x7fa4a0162e30 2024-09-12T01:57:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.239+0000 7fa4a558d640 1 -- 172.21.15.19:0/3859572337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a00b4bb0 con 0x7fa4a0162e30 2024-09-12T01:57:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.240+0000 7fa4a558d640 1 -- 172.21.15.19:0/3859572337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a006d740 con 0x7fa4a0162e30 2024-09-12T01:57:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.241+0000 7fa4977fe640 1 -- 172.21.15.19:0/3859572337 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa498030ac0 con 0x7fa4a0162e30 2024-09-12T01:57:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.241+0000 7fa4977fe640 1 --2- 172.21.15.19:0/3859572337 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa48006be30 0x7fa48006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.241+0000 7fa4977fe640 1 -- 172.21.15.19:0/3859572337 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fa4980ab730 con 0x7fa4a0162e30 2024-09-12T01:57:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.241+0000 7fa49effd640 1 --2- 172.21.15.19:0/3859572337 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa48006be30 0x7fa48006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.242+0000 7fa49effd640 1 --2- 172.21.15.19:0/3859572337 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa48006be30 0x7fa48006e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00ba3e0 tx=0x7fa4900098d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:56.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.246+0000 7fa4977fe640 1 -- 172.21.15.19:0/3859572337 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa498079990 con 0x7fa4a0162e30 2024-09-12T01:57:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:56.456+0000 7fa4a558d640 1 -- 172.21.15.19:0/3859572337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa4a008e640 con 0x7fa4a0162e30 2024-09-12T01:57:57.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.126+0000 7fa4977fe640 1 -- 172.21.15.19:0/3859572337 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v27) ==== 122+0+0 (secure 0 0 0) 0x7fa49807ee20 con 0x7fa4a0162e30 2024-09-12T01:57:57.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.129+0000 7fa4a558d640 1 -- 172.21.15.19:0/3859572337 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa48006be30 msgr2=0x7fa48006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.129+0000 7fa4a558d640 1 --2- 172.21.15.19:0/3859572337 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa48006be30 0x7fa48006e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00ba3e0 tx=0x7fa4900098d0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.129+0000 7fa4a558d640 1 -- 172.21.15.19:0/3859572337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4a0162e30 msgr2=0x7fa4a015c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.129+0000 7fa4a558d640 1 --2- 172.21.15.19:0/3859572337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4a0162e30 0x7fa4a015c2f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa49802a220 tx=0x7fa4980046c0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.129+0000 7fa4a558d640 1 -- 172.21.15.19:0/3859572337 shutdown_connections 2024-09-12T01:57:57.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.129+0000 7fa4a558d640 1 --2- 172.21.15.19:0/3859572337 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa48006be30 0x7fa48006e2f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.129+0000 7fa4a558d640 1 --2- 172.21.15.19:0/3859572337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4a0162e30 0x7fa4a015c2f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.129+0000 7fa4a558d640 1 --2- 172.21.15.19:0/3859572337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4a0162340 0x7fa4a015a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.129+0000 7fa4a558d640 1 --2- 172.21.15.19:0/3859572337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4a00cf280 0x7fa4a015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.129+0000 7fa4a558d640 1 -- 172.21.15.19:0/3859572337 >> 172.21.15.19:0/3859572337 conn(0x7fa4a008bfc0 msgr2=0x7fa4a0162720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:57.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.129+0000 7fa4a558d640 1 -- 172.21.15.19:0/3859572337 shutdown_connections 2024-09-12T01:57:57.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.129+0000 7fa4a558d640 1 -- 172.21.15.19:0/3859572337 wait complete. 2024-09-12T01:57:57.143 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T01:57:57.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:57:57.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.252+0000 7ff870853640 1 Processor -- start 2024-09-12T01:57:57.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.252+0000 7ff870853640 1 -- start start 2024-09-12T01:57:57.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.253+0000 7ff870853640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff86c072320 0x7ff86c0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.253+0000 7ff870853640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff86c072de0 0x7ff86c06e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.253+0000 7ff870853640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff86c146140 con 0x7ff86c072700 2024-09-12T01:57:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.253+0000 7ff870853640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff86c0cd740 con 0x7ff86c072de0 2024-09-12T01:57:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.253+0000 7ff870853640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff86c0cda20 con 0x7ff86c072320 2024-09-12T01:57:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.253+0000 7ff869d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff86c072de0 0x7ff86c06e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.253+0000 7ff86ad9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff86c072700 0x7ff86c06e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59726/0 (socket says 172.21.15.19:59726) 2024-09-12T01:57:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.253+0000 7ff86ad9d640 1 -- 172.21.15.19:0/3812877914 learned_addr learned my addr 172.21.15.19:0/3812877914 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.253+0000 7ff86a59c640 1 --2- 172.21.15.19:0/3812877914 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff86c072320 0x7ff86c0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.253+0000 7ff869d9b640 1 -- 172.21.15.19:0/3812877914 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff86c072320 msgr2=0x7ff86c0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.253+0000 7ff869d9b640 1 --2- 172.21.15.19:0/3812877914 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff86c072320 0x7ff86c0cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.253+0000 7ff869d9b640 1 -- 172.21.15.19:0/3812877914 >> v1:172.21.15.19:6789/0 conn(0x7ff86c072700 legacy=0x7ff86c06e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.253+0000 7ff869d9b640 1 -- 172.21.15.19:0/3812877914 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86c0cdd00 con 0x7ff86c072de0 2024-09-12T01:57:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.253+0000 7ff86959a640 1 -- 172.21.15.19:0/3812877914 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 712960525 0 0) 0x7ff86c146140 con 0x7ff86c072700 2024-09-12T01:57:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.253+0000 7ff86a59c640 1 --2- 172.21.15.19:0/3812877914 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff86c072320 0x7ff86c0cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.254+0000 7ff869d9b640 1 --2- 172.21.15.19:0/3812877914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff86c072de0 0x7ff86c06e0b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff8600097a0 tx=0x7ff86002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcec91d5ab19fcc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.254+0000 7ff86959a640 1 -- 172.21.15.19:0/3812877914 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860037070 con 0x7ff86c072de0 2024-09-12T01:57:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.254+0000 7ff86959a640 1 -- 172.21.15.19:0/3812877914 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff86002ae50 con 0x7ff86c072de0 2024-09-12T01:57:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.254+0000 7ff86959a640 1 -- 172.21.15.19:0/3812877914 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860032660 con 0x7ff86c072de0 2024-09-12T01:57:57.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.255+0000 7ff870853640 1 -- 172.21.15.19:0/3812877914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff86c072de0 msgr2=0x7ff86c06e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.255+0000 7ff870853640 1 --2- 172.21.15.19:0/3812877914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff86c072de0 0x7ff86c06e0b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff8600097a0 tx=0x7ff86002a100 comp rx=0 tx=0).stop 2024-09-12T01:57:57.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.255+0000 7ff870853640 1 -- 172.21.15.19:0/3812877914 shutdown_connections 2024-09-12T01:57:57.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.255+0000 7ff870853640 1 --2- 172.21.15.19:0/3812877914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff86c072de0 0x7ff86c06e0b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.255+0000 7ff870853640 1 --2- 172.21.15.19:0/3812877914 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff86c072320 0x7ff86c0cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.255+0000 7ff870853640 1 -- 172.21.15.19:0/3812877914 >> 172.21.15.19:0/3812877914 conn(0x7ff86c067d70 msgr2=0x7ff86c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:57.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.255+0000 7ff870853640 1 -- 172.21.15.19:0/3812877914 shutdown_connections 2024-09-12T01:57:57.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.255+0000 7ff870853640 1 -- 172.21.15.19:0/3812877914 wait complete. 2024-09-12T01:57:57.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.256+0000 7ff870853640 1 Processor -- start 2024-09-12T01:57:57.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.256+0000 7ff870853640 1 -- start start 2024-09-12T01:57:57.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.257+0000 7ff870853640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff86c072320 0x7ff86c133a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.257+0000 7ff870853640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff86c072700 0x7ff86c134360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.257+0000 7ff870853640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff86c072de0 0x7ff86c1348a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.257+0000 7ff870853640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c0cd520 con 0x7ff86c072320 2024-09-12T01:57:57.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.257+0000 7ff870853640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c0cd3a0 con 0x7ff86c072de0 2024-09-12T01:57:57.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.257+0000 7ff870853640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff86c06ed00 con 0x7ff86c072700 2024-09-12T01:57:57.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.257+0000 7ff86a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff86c072320 0x7ff86c133a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.257+0000 7ff86a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff86c072320 0x7ff86c133a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33524/0 (socket says 172.21.15.19:33524) 2024-09-12T01:57:57.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.257+0000 7ff86a59c640 1 -- 172.21.15.19:0/2977781681 learned_addr learned my addr 172.21.15.19:0/2977781681 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:57.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.258+0000 7ff86a59c640 1 -- 172.21.15.19:0/2977781681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff86c072700 msgr2=0x7ff86c134360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.258+0000 7ff86a59c640 1 --2- 172.21.15.19:0/2977781681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff86c072700 0x7ff86c134360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.258+0000 7ff86a59c640 1 -- 172.21.15.19:0/2977781681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff86c072de0 msgr2=0x7ff86c1348a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.258+0000 7ff86a59c640 1 --2- 172.21.15.19:0/2977781681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff86c072de0 0x7ff86c1348a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.258+0000 7ff86a59c640 1 -- 172.21.15.19:0/2977781681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86c13a610 con 0x7ff86c072320 2024-09-12T01:57:57.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.258+0000 7ff86a59c640 1 --2- 172.21.15.19:0/2977781681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff86c072320 0x7ff86c133a20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00c7f0 tx=0x7ff85c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:57.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.258+0000 7ff85affd640 1 -- 172.21.15.19:0/2977781681 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c015070 con 0x7ff86c072320 2024-09-12T01:57:57.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.258+0000 7ff85affd640 1 -- 172.21.15.19:0/2977781681 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff85c007820 con 0x7ff86c072320 2024-09-12T01:57:57.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.258+0000 7ff85affd640 1 -- 172.21.15.19:0/2977781681 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c007bd0 con 0x7ff86c072320 2024-09-12T01:57:57.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.258+0000 7ff870853640 1 -- 172.21.15.19:0/2977781681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff86c134eb0 con 0x7ff86c072320 2024-09-12T01:57:57.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.258+0000 7ff870853640 1 -- 172.21.15.19:0/2977781681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff86c135470 con 0x7ff86c072320 2024-09-12T01:57:57.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.259+0000 7ff870853640 1 -- 172.21.15.19:0/2977781681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff86c0cce60 con 0x7ff86c072320 2024-09-12T01:57:57.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.259+0000 7ff85affd640 1 -- 172.21.15.19:0/2977781681 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff85c018070 con 0x7ff86c072320 2024-09-12T01:57:57.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.260+0000 7ff85affd640 1 --2- 172.21.15.19:0/2977781681 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff84c06be30 0x7ff84c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.260+0000 7ff85affd640 1 -- 172.21.15.19:0/2977781681 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7ff85c08b0d0 con 0x7ff86c072320 2024-09-12T01:57:57.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.260+0000 7ff869d9b640 1 --2- 172.21.15.19:0/2977781681 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff84c06be30 0x7ff84c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.261+0000 7ff869d9b640 1 --2- 172.21.15.19:0/2977781681 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff84c06be30 0x7ff84c06e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff860034000 tx=0x7ff86002c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:57.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.264+0000 7ff85affd640 1 -- 172.21.15.19:0/2977781681 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff85c059980 con 0x7ff86c072320 2024-09-12T01:57:57.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.477+0000 7ff870853640 1 -- 172.21.15.19:0/2977781681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff86c075790 con 0x7ff86c072320 2024-09-12T01:57:57.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.478+0000 7ff85affd640 1 -- 172.21.15.19:0/2977781681 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7ff85c059280 con 0x7ff86c072320 2024-09-12T01:57:57.479 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:57.479 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-12T01:57:57:118704+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/4076449352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4076449352},{"type":"v1","addr":"172.21.15.135:6836","nonce":4076449352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1361756714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1361756714},{"type":"v1","addr":"172.21.15.135:6837","nonce":1361756714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3926640523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3926640523},{"type":"v1","addr":"172.21.15.19:6833","nonce":3926640523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:57:54.505612+0000","modified":"2024-09-12T01:57:56.457812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5421":{"gid":5421,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/1076479859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1076479859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1076479859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5421,"qdb_cluster":[5421]},"id":3}]} 2024-09-12T01:57:57.479 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-12T01:57:57.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.480+0000 7ff870853640 1 -- 172.21.15.19:0/2977781681 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff84c06be30 msgr2=0x7ff84c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.480+0000 7ff870853640 1 --2- 172.21.15.19:0/2977781681 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff84c06be30 0x7ff84c06e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff860034000 tx=0x7ff86002c000 comp rx=0 tx=0).stop 2024-09-12T01:57:57.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.480+0000 7ff870853640 1 -- 172.21.15.19:0/2977781681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff86c072320 msgr2=0x7ff86c133a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.480+0000 7ff870853640 1 --2- 172.21.15.19:0/2977781681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff86c072320 0x7ff86c133a20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00c7f0 tx=0x7ff85c00ccb0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.480+0000 7ff870853640 1 -- 172.21.15.19:0/2977781681 shutdown_connections 2024-09-12T01:57:57.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.480+0000 7ff870853640 1 --2- 172.21.15.19:0/2977781681 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff84c06be30 0x7ff84c06e2f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.480+0000 7ff870853640 1 --2- 172.21.15.19:0/2977781681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff86c072de0 0x7ff86c1348a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.480+0000 7ff870853640 1 --2- 172.21.15.19:0/2977781681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff86c072700 0x7ff86c134360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.480+0000 7ff870853640 1 --2- 172.21.15.19:0/2977781681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff86c072320 0x7ff86c133a20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.480+0000 7ff870853640 1 -- 172.21.15.19:0/2977781681 >> 172.21.15.19:0/2977781681 conn(0x7ff86c067d70 msgr2=0x7ff86c0c6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:57.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.480+0000 7ff870853640 1 -- 172.21.15.19:0/2977781681 shutdown_connections 2024-09-12T01:57:57.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.480+0000 7ff870853640 1 -- 172.21.15.19:0/2977781681 wait complete. 2024-09-12T01:57:57.493 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:57:57.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.594+0000 7f59b94a5640 1 Processor -- start 2024-09-12T01:57:57.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.594+0000 7f59b94a5640 1 -- start start 2024-09-12T01:57:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.595+0000 7f59b94a5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59b40d30f0 0x7f59b40b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.595+0000 7f59b94a5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f59b40b64c0 0x7f59b406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.595+0000 7f59b94a5640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59b40d3690 con 0x7f59b415e5f0 2024-09-12T01:57:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.595+0000 7f59b94a5640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f59b406d530 con 0x7f59b40b64c0 2024-09-12T01:57:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.595+0000 7f59b94a5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f59b40d3970 con 0x7f59b40d30f0 2024-09-12T01:57:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.595+0000 7f59b37fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f59b40b64c0 0x7f59b406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.595+0000 7f59b2ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f59b415e5f0 0x7f59b40d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59732/0 (socket says 172.21.15.19:59732) 2024-09-12T01:57:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.595+0000 7f59b2ffd640 1 -- 172.21.15.19:0/4256501848 learned_addr learned my addr 172.21.15.19:0/4256501848 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.595+0000 7f59b37fe640 1 -- 172.21.15.19:0/4256501848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59b40d30f0 msgr2=0x7f59b40b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.595+0000 7f59b37fe640 1 --2- 172.21.15.19:0/4256501848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59b40d30f0 0x7f59b40b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.595+0000 7f59b37fe640 1 -- 172.21.15.19:0/4256501848 >> v1:172.21.15.19:6789/0 conn(0x7f59b415e5f0 legacy=0x7f59b40d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.595+0000 7f59b37fe640 1 -- 172.21.15.19:0/4256501848 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b406cee0 con 0x7f59b40b64c0 2024-09-12T01:57:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.596+0000 7f59b37fe640 1 --2- 172.21.15.19:0/4256501848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b40b64c0 0x7f59b406d9c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f59ac009d90 tx=0x7f59ac02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba49fffbb77a49a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.596+0000 7f59b27fc640 1 -- 172.21.15.19:0/4256501848 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac007740 con 0x7f59b40b64c0 2024-09-12T01:57:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.596+0000 7f59b27fc640 1 -- 172.21.15.19:0/4256501848 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59ac0078e0 con 0x7f59b40b64c0 2024-09-12T01:57:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.596+0000 7f59b27fc640 1 -- 172.21.15.19:0/4256501848 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac007cb0 con 0x7f59b40b64c0 2024-09-12T01:57:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.597+0000 7f59b94a5640 1 -- 172.21.15.19:0/4256501848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b40b64c0 msgr2=0x7f59b406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.597+0000 7f59b94a5640 1 --2- 172.21.15.19:0/4256501848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b40b64c0 0x7f59b406d9c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f59ac009d90 tx=0x7f59ac02a660 comp rx=0 tx=0).stop 2024-09-12T01:57:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.597+0000 7f59b94a5640 1 -- 172.21.15.19:0/4256501848 shutdown_connections 2024-09-12T01:57:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.597+0000 7f59b94a5640 1 --2- 172.21.15.19:0/4256501848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b40b64c0 0x7f59b406d9c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.597+0000 7f59b94a5640 1 --2- 172.21.15.19:0/4256501848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59b40d30f0 0x7f59b40b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.597+0000 7f59b94a5640 1 -- 172.21.15.19:0/4256501848 >> 172.21.15.19:0/4256501848 conn(0x7f59b408bfc0 msgr2=0x7f59b40d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.597+0000 7f59b94a5640 1 -- 172.21.15.19:0/4256501848 shutdown_connections 2024-09-12T01:57:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.597+0000 7f59b94a5640 1 -- 172.21.15.19:0/4256501848 wait complete. 2024-09-12T01:57:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.598+0000 7f59b94a5640 1 Processor -- start 2024-09-12T01:57:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.598+0000 7f59b94a5640 1 -- start start 2024-09-12T01:57:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b94a5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59b40b64c0 0x7f59b414e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b94a5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59b40d30f0 0x7f59b40b9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b94a5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b415e5f0 0x7f59b40b98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b94a5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f59b406df00 con 0x7f59b415e5f0 2024-09-12T01:57:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b94a5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f59b415e9d0 con 0x7f59b40d30f0 2024-09-12T01:57:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b94a5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f59b406e080 con 0x7f59b40b64c0 2024-09-12T01:57:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b415e5f0 0x7f59b40b98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b415e5f0 0x7f59b40b98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33538/0 (socket says 172.21.15.19:33538) 2024-09-12T01:57:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b37fe640 1 -- 172.21.15.19:0/4230834436 learned_addr learned my addr 172.21.15.19:0/4230834436 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59abfff640 1 --2- 172.21.15.19:0/4230834436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59b40d30f0 0x7f59b40b9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b2ffd640 1 --2- 172.21.15.19:0/4230834436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59b40b64c0 0x7f59b414e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b37fe640 1 -- 172.21.15.19:0/4230834436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59b40b64c0 msgr2=0x7f59b414e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b37fe640 1 --2- 172.21.15.19:0/4230834436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59b40b64c0 0x7f59b414e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b37fe640 1 -- 172.21.15.19:0/4230834436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59b40d30f0 msgr2=0x7f59b40b9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b37fe640 1 --2- 172.21.15.19:0/4230834436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59b40d30f0 0x7f59b40b9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b37fe640 1 -- 172.21.15.19:0/4230834436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b40b85b0 con 0x7f59b415e5f0 2024-09-12T01:57:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b2ffd640 1 --2- 172.21.15.19:0/4230834436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59b40b64c0 0x7f59b414e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b37fe640 1 --2- 172.21.15.19:0/4230834436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b415e5f0 0x7f59b40b98b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f59ac009d90 tx=0x7f59ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59ab7fe640 1 -- 172.21.15.19:0/4230834436 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac040070 con 0x7f59b415e5f0 2024-09-12T01:57:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59ab7fe640 1 -- 172.21.15.19:0/4230834436 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59ac031c90 con 0x7f59b415e5f0 2024-09-12T01:57:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b94a5640 1 -- 172.21.15.19:0/4230834436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b40b8890 con 0x7f59b415e5f0 2024-09-12T01:57:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59ab7fe640 1 -- 172.21.15.19:0/4230834436 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac03c640 con 0x7f59b415e5f0 2024-09-12T01:57:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.599+0000 7f59b94a5640 1 -- 172.21.15.19:0/4230834436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b414ed30 con 0x7f59b415e5f0 2024-09-12T01:57:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.600+0000 7f59b94a5640 1 -- 172.21.15.19:0/4230834436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59b406d9c0 con 0x7f59b415e5f0 2024-09-12T01:57:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.601+0000 7f59ab7fe640 1 -- 172.21.15.19:0/4230834436 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f59ac039040 con 0x7f59b415e5f0 2024-09-12T01:57:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.601+0000 7f59ab7fe640 1 --2- 172.21.15.19:0/4230834436 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f599406be30 0x7f599406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.601+0000 7f59ab7fe640 1 -- 172.21.15.19:0/4230834436 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f59ac0ac600 con 0x7f59b415e5f0 2024-09-12T01:57:57.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.602+0000 7f59b2ffd640 1 --2- 172.21.15.19:0/4230834436 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f599406be30 0x7f599406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.602+0000 7f59b2ffd640 1 --2- 172.21.15.19:0/4230834436 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f599406be30 0x7f599406e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f59a4000f60 tx=0x7f59a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.606+0000 7f59ab7fe640 1 -- 172.21.15.19:0/4230834436 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59ac07af70 con 0x7f59b415e5f0 2024-09-12T01:57:57.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.782+0000 7f59b94a5640 1 -- 172.21.15.19:0/4230834436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59b40d0610 con 0x7f59b415e5f0 2024-09-12T01:57:57.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.783+0000 7f59ab7fe640 1 -- 172.21.15.19:0/4230834436 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+16990 (secure 0 0 0) 0x7f59ac07a870 con 0x7f59b415e5f0 2024-09-12T01:57:57.784 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:57.784 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":54,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:57:56.097964+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:57:52.113320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-12T01:57:53.439514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:57:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.785+0000 7f59b94a5640 1 -- 172.21.15.19:0/4230834436 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f599406be30 msgr2=0x7f599406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.785+0000 7f59b94a5640 1 --2- 172.21.15.19:0/4230834436 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f599406be30 0x7f599406e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f59a4000f60 tx=0x7f59a4009040 comp rx=0 tx=0).stop 2024-09-12T01:57:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.785+0000 7f59b94a5640 1 -- 172.21.15.19:0/4230834436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b415e5f0 msgr2=0x7f59b40b98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.785+0000 7f59b94a5640 1 --2- 172.21.15.19:0/4230834436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b415e5f0 0x7f59b40b98b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f59ac009d90 tx=0x7f59ac004a40 comp rx=0 tx=0).stop 2024-09-12T01:57:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.785+0000 7f59b94a5640 1 -- 172.21.15.19:0/4230834436 shutdown_connections 2024-09-12T01:57:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.785+0000 7f59b94a5640 1 --2- 172.21.15.19:0/4230834436 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f599406be30 0x7f599406e2f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.785+0000 7f59b94a5640 1 --2- 172.21.15.19:0/4230834436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b415e5f0 0x7f59b40b98b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.785+0000 7f59b94a5640 1 --2- 172.21.15.19:0/4230834436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59b40d30f0 0x7f59b40b9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.785+0000 7f59b94a5640 1 --2- 172.21.15.19:0/4230834436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59b40b64c0 0x7f59b414e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.785+0000 7f59b94a5640 1 -- 172.21.15.19:0/4230834436 >> 172.21.15.19:0/4230834436 conn(0x7f59b408bfc0 msgr2=0x7f59b40d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:57.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.785+0000 7f59b94a5640 1 -- 172.21.15.19:0/4230834436 shutdown_connections 2024-09-12T01:57:57.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.785+0000 7f59b94a5640 1 -- 172.21.15.19:0/4230834436 wait complete. 2024-09-12T01:57:57.797 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:57:57.797 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.899+0000 7f085ba8d640 1 Processor -- start 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.899+0000 7f085ba8d640 1 -- start start 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.900+0000 7f085ba8d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f085415e5f0 0x7f08540d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.900+0000 7f085ba8d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f08540d30f0 0x7f08540b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.900+0000 7f085ba8d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f08540b64c0 0x7f08540cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.900+0000 7f085ba8d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f085406d530 con 0x7f08540d30f0 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.900+0000 7f085ba8d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f08540d3690 con 0x7f08540b64c0 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.900+0000 7f085ba8d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f08540d3970 con 0x7f085415e5f0 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.900+0000 7f0859028640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f08540d30f0 0x7f08540b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.900+0000 7f0859028640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f08540d30f0 0x7f08540b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33552/0 (socket says 172.21.15.19:33552) 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.900+0000 7f0859028640 1 -- 172.21.15.19:0/3592845894 learned_addr learned my addr 172.21.15.19:0/3592845894 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.900+0000 7f085a02a640 1 --2- 172.21.15.19:0/3592845894 >> v2:172.21.15.135:3300/0 conn(0x7f08540b64c0 0x7f08540cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.900+0000 7f0859829640 1 --2- 172.21.15.19:0/3592845894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f085415e5f0 0x7f08540d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.901+0000 7f0859028640 1 -- 172.21.15.19:0/3592845894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f085415e5f0 msgr2=0x7f08540d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.901+0000 7f0859028640 1 --2- 172.21.15.19:0/3592845894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f085415e5f0 0x7f08540d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.901+0000 7f0859028640 1 -- 172.21.15.19:0/3592845894 >> v2:172.21.15.135:3300/0 conn(0x7f08540b64c0 msgr2=0x7f08540cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.901+0000 7f0859028640 1 --2- 172.21.15.19:0/3592845894 >> v2:172.21.15.135:3300/0 conn(0x7f08540b64c0 0x7f08540cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.901+0000 7f0859028640 1 -- 172.21.15.19:0/3592845894 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085406cee0 con 0x7f08540d30f0 2024-09-12T01:57:57.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.901+0000 7f0859028640 1 --2- 172.21.15.19:0/3592845894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08540d30f0 0x7f08540b5f80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f08540a23f0 tx=0x7f084402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a7931f4cbd1247 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:57.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.902+0000 7f0858827640 1 -- 172.21.15.19:0/3592845894 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844037070 con 0x7f08540d30f0 2024-09-12T01:57:57.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.902+0000 7f0858827640 1 -- 172.21.15.19:0/3592845894 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0844032440 con 0x7f08540d30f0 2024-09-12T01:57:57.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.902+0000 7f0858827640 1 -- 172.21.15.19:0/3592845894 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844032810 con 0x7f08540d30f0 2024-09-12T01:57:57.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.902+0000 7f085ba8d640 1 -- 172.21.15.19:0/3592845894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08540d30f0 msgr2=0x7f08540b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.902+0000 7f085ba8d640 1 --2- 172.21.15.19:0/3592845894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08540d30f0 0x7f08540b5f80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f08540a23f0 tx=0x7f084402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.902+0000 7f085ba8d640 1 -- 172.21.15.19:0/3592845894 shutdown_connections 2024-09-12T01:57:57.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.902+0000 7f085ba8d640 1 --2- 172.21.15.19:0/3592845894 >> v2:172.21.15.135:3300/0 conn(0x7f08540b64c0 0x7f08540cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.902+0000 7f085ba8d640 1 --2- 172.21.15.19:0/3592845894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08540d30f0 0x7f08540b5f80 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.902+0000 7f085ba8d640 1 --2- 172.21.15.19:0/3592845894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f085415e5f0 0x7f08540d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.902+0000 7f085ba8d640 1 -- 172.21.15.19:0/3592845894 >> 172.21.15.19:0/3592845894 conn(0x7f085408bfc0 msgr2=0x7f08540d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:57.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.902+0000 7f085ba8d640 1 -- 172.21.15.19:0/3592845894 shutdown_connections 2024-09-12T01:57:57.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.902+0000 7f085ba8d640 1 -- 172.21.15.19:0/3592845894 wait complete. 2024-09-12T01:57:57.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.903+0000 7f085ba8d640 1 Processor -- start 2024-09-12T01:57:57.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.904+0000 7f085ba8d640 1 -- start start 2024-09-12T01:57:57.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.904+0000 7f085ba8d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08540b64c0 0x7f08540b83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.904+0000 7f085ba8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08540d30f0 0x7f08540b88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.904+0000 7f085ba8d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f085415e5f0 0x7f08541608e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.904+0000 7f085ba8d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f08540d5310 con 0x7f08540d30f0 2024-09-12T01:57:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.904+0000 7f085ba8d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f085415e9d0 con 0x7f08540b64c0 2024-09-12T01:57:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.904+0000 7f085ba8d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f08540cf540 con 0x7f085415e5f0 2024-09-12T01:57:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.904+0000 7f0859028640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08540d30f0 0x7f08540b88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.904+0000 7f0859028640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08540d30f0 0x7f08540b88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33566/0 (socket says 172.21.15.19:33566) 2024-09-12T01:57:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.904+0000 7f0859028640 1 -- 172.21.15.19:0/522454958 learned_addr learned my addr 172.21.15.19:0/522454958 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.904+0000 7f0859829640 1 --2- 172.21.15.19:0/522454958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08540b64c0 0x7f08540b83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.905+0000 7f085a02a640 1 --2- 172.21.15.19:0/522454958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f085415e5f0 0x7f08541608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.905+0000 7f0859028640 1 -- 172.21.15.19:0/522454958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f085415e5f0 msgr2=0x7f08541608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.905+0000 7f0859028640 1 --2- 172.21.15.19:0/522454958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f085415e5f0 0x7f08541608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.905+0000 7f0859028640 1 -- 172.21.15.19:0/522454958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08540b64c0 msgr2=0x7f08540b83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.905+0000 7f0859028640 1 --2- 172.21.15.19:0/522454958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08540b64c0 0x7f08540b83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.905+0000 7f0859028640 1 -- 172.21.15.19:0/522454958 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085415dc30 con 0x7f08540d30f0 2024-09-12T01:57:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.905+0000 7f0859028640 1 --2- 172.21.15.19:0/522454958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08540d30f0 0x7f08540b88e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0844000c00 tx=0x7f08440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:57.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.905+0000 7f084a7fc640 1 -- 172.21.15.19:0/522454958 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844041020 con 0x7f08540d30f0 2024-09-12T01:57:57.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.905+0000 7f084a7fc640 1 -- 172.21.15.19:0/522454958 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f084403d620 con 0x7f08540d30f0 2024-09-12T01:57:57.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.905+0000 7f085ba8d640 1 -- 172.21.15.19:0/522454958 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08540b8fd0 con 0x7f08540d30f0 2024-09-12T01:57:57.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.905+0000 7f084a7fc640 1 -- 172.21.15.19:0/522454958 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844037040 con 0x7f08540d30f0 2024-09-12T01:57:57.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.905+0000 7f085ba8d640 1 -- 172.21.15.19:0/522454958 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08540b9590 con 0x7f08540d30f0 2024-09-12T01:57:57.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.906+0000 7f085ba8d640 1 -- 172.21.15.19:0/522454958 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08540b5f80 con 0x7f08540d30f0 2024-09-12T01:57:57.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.906+0000 7f084a7fc640 1 -- 172.21.15.19:0/522454958 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0844044020 con 0x7f08540d30f0 2024-09-12T01:57:57.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.907+0000 7f084a7fc640 1 --2- 172.21.15.19:0/522454958 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f083806be30 0x7f083806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.907+0000 7f084a7fc640 1 -- 172.21.15.19:0/522454958 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f08440ab620 con 0x7f08540d30f0 2024-09-12T01:57:57.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.907+0000 7f0859829640 1 --2- 172.21.15.19:0/522454958 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f083806be30 0x7f083806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.908+0000 7f0859829640 1 --2- 172.21.15.19:0/522454958 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f083806be30 0x7f083806e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f08540b3430 tx=0x7f0850009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:57.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:57.911+0000 7f084a7fc640 1 -- 172.21.15.19:0/522454958 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f084404b030 con 0x7f08540d30f0 2024-09-12T01:57:58.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.084+0000 7f085ba8d640 1 -- 172.21.15.19:0/522454958 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f085415d6b0 con 0x7f083806be30 2024-09-12T01:57:58.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.091+0000 7f084a7fc640 1 -- 172.21.15.19:0/522454958 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242096 (secure 0 0 0) 0x7f085415d6b0 con 0x7f083806be30 2024-09-12T01:57:58.094 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:58.095 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:57:58.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.094+0000 7f085ba8d640 1 -- 172.21.15.19:0/522454958 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f083806be30 msgr2=0x7f083806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.094+0000 7f085ba8d640 1 --2- 172.21.15.19:0/522454958 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f083806be30 0x7f083806e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f08540b3430 tx=0x7f0850009190 comp rx=0 tx=0).stop 2024-09-12T01:57:58.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.094+0000 7f085ba8d640 1 -- 172.21.15.19:0/522454958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08540d30f0 msgr2=0x7f08540b88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.094+0000 7f085ba8d640 1 --2- 172.21.15.19:0/522454958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08540d30f0 0x7f08540b88e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0844000c00 tx=0x7f08440046c0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.094+0000 7f085ba8d640 1 -- 172.21.15.19:0/522454958 shutdown_connections 2024-09-12T01:57:58.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.094+0000 7f085ba8d640 1 --2- 172.21.15.19:0/522454958 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f083806be30 0x7f083806e2f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.094+0000 7f085ba8d640 1 --2- 172.21.15.19:0/522454958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f085415e5f0 0x7f08541608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.094+0000 7f085ba8d640 1 --2- 172.21.15.19:0/522454958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08540d30f0 0x7f08540b88e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.094+0000 7f085ba8d640 1 --2- 172.21.15.19:0/522454958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08540b64c0 0x7f08540b83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.094+0000 7f085ba8d640 1 -- 172.21.15.19:0/522454958 >> 172.21.15.19:0/522454958 conn(0x7f085408bfc0 msgr2=0x7f08541e8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:58.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.094+0000 7f085ba8d640 1 -- 172.21.15.19:0/522454958 shutdown_connections 2024-09-12T01:57:58.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.094+0000 7f085ba8d640 1 -- 172.21.15.19:0/522454958 wait complete. 2024-09-12T01:57:58.108 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-09-12T01:57:56.112021+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":226184,"kb_used_data":5784,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748536,"statfs":{"total":773094113280,"available":772862500864,"internally_reserved":0,"allocated":5922816,"data_stored":3271908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000660"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.095167+0000","last_change":"2024-09-12T01:57:54.095167+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.095167+0000","last_undegraded":"2024-09-12T01:57:54.095167+0000","last_fullsized":"2024-09-12T01:57:54.095167+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.094597+0000","last_change":"2024-09-12T01:57:54.094597+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.094597+0000","last_undegraded":"2024-09-12T01:57:54.094597+0000","last_fullsized":"2024-09-12T01:57:54.094597+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.095097+0000","last_change":"2024-09-12T01:57:54.095097+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.095097+0000","last_undegraded":"2024-09-12T01:57:54.095097+0000","last_fullsized":"2024-09-12T01:57:54.095097+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.094741+0000","last_change":"2024-09-12T01:57:54.094741+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.094741+0000","last_undegraded":"2024-09-12T01:57:54.094741+0000","last_fullsized":"2024-09-12T01:57:54.094741+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091834+0000","last_change":"2024-09-12T01:57:54.091834+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091834+0000","last_undegraded":"2024-09-12T01:57:54.091834+0000","last_fullsized":"2024-09-12T01:57:54.091834+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.090692+0000","last_change":"2024-09-12T01:57:54.090692+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.090692+0000","last_undegraded":"2024-09-12T01:57:54.090692+0000","last_fullsized":"2024-09-12T01:57:54.090692+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091405+0000","last_change":"2024-09-12T01:57:54.091405+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091405+0000","last_undegraded":"2024-09-12T01:57:54.091405+0000","last_fullsized":"2024-09-12T01:57:54.091405+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.094252+0000","last_change":"2024-09-12T01:57:54.094252+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.094252+0000","last_undegraded":"2024-09-12T01:57:54.094252+0000","last_fullsized":"2024-09-12T01:57:54.094252+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091889+0000","last_change":"2024-09-12T01:57:54.091889+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091889+0000","last_undegraded":"2024-09-12T01:57:54.091889+0000","last_fullsized":"2024-09-12T01:57:54.091889+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.094239+0000","last_change":"2024-09-12T01:57:54.094239+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.094239+0000","last_undegraded":"2024-09-12T01:57:54.094239+0000","last_fullsized":"2024-09-12T01:57:54.094239+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.100535+0000","last_change":"2024-09-12T01:57:54.099411+0000","last_active":"2024-09-12T01:57:54.100535+0000","last_peered":"2024-09-12T01:57:54.100535+0000","last_clean":"2024-09-12T01:57:54.100535+0000","last_became_active":"2024-09-12T01:57:54.099087+0000","last_became_peered":"2024-09-12T01:57:54.099087+0000","last_unstale":"2024-09-12T01:57:54.100535+0000","last_undegraded":"2024-09-12T01:57:54.100535+0000","last_fullsized":"2024-09-12T01:57:54.100535+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:44.513454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.092378+0000","last_change":"2024-09-12T01:57:54.092378+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.092378+0000","last_undegraded":"2024-09-12T01:57:54.092378+0000","last_fullsized":"2024-09-12T01:57:54.092378+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092999+0000","last_change":"2024-09-12T01:57:53.092999+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092999+0000","last_undegraded":"2024-09-12T01:57:53.092999+0000","last_fullsized":"2024-09-12T01:57:53.092999+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.090402+0000","last_change":"2024-09-12T01:57:54.090402+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.090402+0000","last_undegraded":"2024-09-12T01:57:54.090402+0000","last_fullsized":"2024-09-12T01:57:54.090402+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092925+0000","last_change":"2024-09-12T01:57:53.092925+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092925+0000","last_undegraded":"2024-09-12T01:57:53.092925+0000","last_fullsized":"2024-09-12T01:57:53.092925+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.104257+0000","last_change":"2024-09-12T01:57:54.102087+0000","last_active":"2024-09-12T01:57:54.104257+0000","last_peered":"2024-09-12T01:57:54.104257+0000","last_clean":"2024-09-12T01:57:54.104257+0000","last_became_active":"2024-09-12T01:57:54.101812+0000","last_became_peered":"2024-09-12T01:57:54.101812+0000","last_unstale":"2024-09-12T01:57:54.104257+0000","last_undegraded":"2024-09-12T01:57:54.104257+0000","last_fullsized":"2024-09-12T01:57:54.104257+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:57.124282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092146+0000","last_change":"2024-09-12T01:57:53.092146+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092146+0000","last_undegraded":"2024-09-12T01:57:53.092146+0000","last_fullsized":"2024-09-12T01:57:53.092146+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.095015+0000","last_change":"2024-09-12T01:57:54.095015+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.095015+0000","last_undegraded":"2024-09-12T01:57:54.095015+0000","last_fullsized":"2024-09-12T01:57:54.095015+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:53.080263+0000","last_change":"2024-09-12T01:57:53.080263+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.080263+0000","last_undegraded":"2024-09-12T01:57:53.080263+0000","last_fullsized":"2024-09-12T01:57:53.080263+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.105446+0000","last_change":"2024-09-12T01:57:54.103416+0000","last_active":"2024-09-12T01:57:54.105446+0000","last_peered":"2024-09-12T01:57:54.105446+0000","last_clean":"2024-09-12T01:57:54.105446+0000","last_became_active":"2024-09-12T01:57:54.103089+0000","last_became_peered":"2024-09-12T01:57:54.103089+0000","last_unstale":"2024-09-12T01:57:54.105446+0000","last_undegraded":"2024-09-12T01:57:54.105446+0000","last_fullsized":"2024-09-12T01:57:54.105446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:33.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.096539+0000","last_change":"2024-09-12T01:57:54.096539+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.096539+0000","last_undegraded":"2024-09-12T01:57:54.096539+0000","last_fullsized":"2024-09-12T01:57:54.096539+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092260+0000","last_change":"2024-09-12T01:57:53.092260+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092260+0000","last_undegraded":"2024-09-12T01:57:53.092260+0000","last_fullsized":"2024-09-12T01:57:53.092260+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.105942+0000","last_change":"2024-09-12T01:57:54.104891+0000","last_active":"2024-09-12T01:57:54.105942+0000","last_peered":"2024-09-12T01:57:54.105942+0000","last_clean":"2024-09-12T01:57:54.105942+0000","last_became_active":"2024-09-12T01:57:54.104595+0000","last_became_peered":"2024-09-12T01:57:54.104595+0000","last_unstale":"2024-09-12T01:57:54.105942+0000","last_undegraded":"2024-09-12T01:57:54.105942+0000","last_fullsized":"2024-09-12T01:57:54.105942+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:55.138013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.092841+0000","last_change":"2024-09-12T01:57:54.092841+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.092841+0000","last_undegraded":"2024-09-12T01:57:54.092841+0000","last_fullsized":"2024-09-12T01:57:54.092841+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:53.080263+0000","last_change":"2024-09-12T01:57:53.080263+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.080263+0000","last_undegraded":"2024-09-12T01:57:53.080263+0000","last_fullsized":"2024-09-12T01:57:53.080263+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.108836+0000","last_change":"2024-09-12T01:57:54.107407+0000","last_active":"2024-09-12T01:57:54.108836+0000","last_peered":"2024-09-12T01:57:54.108836+0000","last_clean":"2024-09-12T01:57:54.108836+0000","last_became_active":"2024-09-12T01:57:54.107149+0000","last_became_peered":"2024-09-12T01:57:54.107149+0000","last_unstale":"2024-09-12T01:57:54.108836+0000","last_undegraded":"2024-09-12T01:57:54.108836+0000","last_fullsized":"2024-09-12T01:57:54.108836+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:04.470684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091785+0000","last_change":"2024-09-12T01:57:53.091785+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091785+0000","last_undegraded":"2024-09-12T01:57:53.091785+0000","last_fullsized":"2024-09-12T01:57:53.091785+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091534+0000","last_change":"2024-09-12T01:57:54.091534+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091534+0000","last_undegraded":"2024-09-12T01:57:54.091534+0000","last_fullsized":"2024-09-12T01:57:54.091534+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091646+0000","last_change":"2024-09-12T01:57:53.091646+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091646+0000","last_undegraded":"2024-09-12T01:57:53.091646+0000","last_fullsized":"2024-09-12T01:57:53.091646+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.107135+0000","last_change":"2024-09-12T01:57:54.106202+0000","last_active":"2024-09-12T01:57:54.107135+0000","last_peered":"2024-09-12T01:57:54.107135+0000","last_clean":"2024-09-12T01:57:54.107135+0000","last_became_active":"2024-09-12T01:57:54.105898+0000","last_became_peered":"2024-09-12T01:57:54.105898+0000","last_unstale":"2024-09-12T01:57:54.107135+0000","last_undegraded":"2024-09-12T01:57:54.107135+0000","last_fullsized":"2024-09-12T01:57:54.107135+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:37.565639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.105954+0000","last_change":"2024-09-12T01:57:54.104923+0000","last_active":"2024-09-12T01:57:54.105954+0000","last_peered":"2024-09-12T01:57:54.105954+0000","last_clean":"2024-09-12T01:57:54.105954+0000","last_became_active":"2024-09-12T01:57:54.104376+0000","last_became_peered":"2024-09-12T01:57:54.104376+0000","last_unstale":"2024-09-12T01:57:54.105954+0000","last_undegraded":"2024-09-12T01:57:54.105954+0000","last_fullsized":"2024-09-12T01:57:54.105954+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:54.961365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091523+0000","last_change":"2024-09-12T01:57:53.091523+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091523+0000","last_undegraded":"2024-09-12T01:57:53.091523+0000","last_fullsized":"2024-09-12T01:57:53.091523+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.094626+0000","last_change":"2024-09-12T01:57:53.094626+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.094626+0000","last_undegraded":"2024-09-12T01:57:53.094626+0000","last_fullsized":"2024-09-12T01:57:53.094626+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.089521+0000","last_change":"2024-09-12T01:57:53.089521+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.089521+0000","last_undegraded":"2024-09-12T01:57:53.089521+0000","last_fullsized":"2024-09-12T01:57:53.089521+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.107907+0000","last_change":"2024-09-12T01:57:54.106589+0000","last_active":"2024-09-12T01:57:54.107907+0000","last_peered":"2024-09-12T01:57:54.107907+0000","last_clean":"2024-09-12T01:57:54.107907+0000","last_became_active":"2024-09-12T01:57:54.106261+0000","last_became_peered":"2024-09-12T01:57:54.106261+0000","last_unstale":"2024-09-12T01:57:54.107907+0000","last_undegraded":"2024-09-12T01:57:54.107907+0000","last_fullsized":"2024-09-12T01:57:54.107907+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:31.979861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.103092+0000","last_change":"2024-09-12T01:57:54.101095+0000","last_active":"2024-09-12T01:57:54.103092+0000","last_peered":"2024-09-12T01:57:54.103092+0000","last_clean":"2024-09-12T01:57:54.103092+0000","last_became_active":"2024-09-12T01:57:54.100822+0000","last_became_peered":"2024-09-12T01:57:54.100822+0000","last_unstale":"2024-09-12T01:57:54.103092+0000","last_undegraded":"2024-09-12T01:57:54.103092+0000","last_fullsized":"2024-09-12T01:57:54.103092+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:59.910848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091074+0000","last_change":"2024-09-12T01:57:54.091074+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091074+0000","last_undegraded":"2024-09-12T01:57:54.091074+0000","last_fullsized":"2024-09-12T01:57:54.091074+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092130+0000","last_change":"2024-09-12T01:57:53.092130+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092130+0000","last_undegraded":"2024-09-12T01:57:53.092130+0000","last_fullsized":"2024-09-12T01:57:53.092130+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.092693+0000","last_change":"2024-09-12T01:57:54.092693+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.092693+0000","last_undegraded":"2024-09-12T01:57:54.092693+0000","last_fullsized":"2024-09-12T01:57:54.092693+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092974+0000","last_change":"2024-09-12T01:57:53.092974+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092974+0000","last_undegraded":"2024-09-12T01:57:53.092974+0000","last_fullsized":"2024-09-12T01:57:53.092974+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092426+0000","last_change":"2024-09-12T01:57:53.092426+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092426+0000","last_undegraded":"2024-09-12T01:57:53.092426+0000","last_fullsized":"2024-09-12T01:57:53.092426+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.089523+0000","last_change":"2024-09-12T01:57:53.089523+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.089523+0000","last_undegraded":"2024-09-12T01:57:53.089523+0000","last_fullsized":"2024-09-12T01:57:53.089523+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091461+0000","last_change":"2024-09-12T01:57:54.091461+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091461+0000","last_undegraded":"2024-09-12T01:57:54.091461+0000","last_fullsized":"2024-09-12T01:57:54.091461+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.107157+0000","last_change":"2024-09-12T01:57:54.106206+0000","last_active":"2024-09-12T01:57:54.107157+0000","last_peered":"2024-09-12T01:57:54.107157+0000","last_clean":"2024-09-12T01:57:54.107157+0000","last_became_active":"2024-09-12T01:57:54.105890+0000","last_became_peered":"2024-09-12T01:57:54.105890+0000","last_unstale":"2024-09-12T01:57:54.107157+0000","last_undegraded":"2024-09-12T01:57:54.107157+0000","last_fullsized":"2024-09-12T01:57:54.107157+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:54.271270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.107746+0000","last_change":"2024-09-12T01:57:54.106811+0000","last_active":"2024-09-12T01:57:54.107746+0000","last_peered":"2024-09-12T01:57:54.107746+0000","last_clean":"2024-09-12T01:57:54.107746+0000","last_became_active":"2024-09-12T01:57:54.106499+0000","last_became_peered":"2024-09-12T01:57:54.106499+0000","last_unstale":"2024-09-12T01:57:54.107746+0000","last_undegraded":"2024-09-12T01:57:54.107746+0000","last_fullsized":"2024-09-12T01:57:54.107746+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:12.616086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.095103+0000","last_change":"2024-09-12T01:57:53.095103+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.095103+0000","last_undegraded":"2024-09-12T01:57:53.095103+0000","last_fullsized":"2024-09-12T01:57:53.095103+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091478+0000","last_change":"2024-09-12T01:57:53.091478+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091478+0000","last_undegraded":"2024-09-12T01:57:53.091478+0000","last_fullsized":"2024-09-12T01:57:53.091478+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.092168+0000","last_change":"2024-09-12T01:57:54.092168+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.092168+0000","last_undegraded":"2024-09-12T01:57:54.092168+0000","last_fullsized":"2024-09-12T01:57:54.092168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091966+0000","last_change":"2024-09-12T01:57:53.091966+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091966+0000","last_undegraded":"2024-09-12T01:57:53.091966+0000","last_fullsized":"2024-09-12T01:57:53.091966+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:53.080263+0000","last_change":"2024-09-12T01:57:53.080263+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.080263+0000","last_undegraded":"2024-09-12T01:57:53.080263+0000","last_fullsized":"2024-09-12T01:57:53.080263+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.104202+0000","last_change":"2024-09-12T01:57:54.101287+0000","last_active":"2024-09-12T01:57:54.104202+0000","last_peered":"2024-09-12T01:57:54.104202+0000","last_clean":"2024-09-12T01:57:54.104202+0000","last_became_active":"2024-09-12T01:57:54.101005+0000","last_became_peered":"2024-09-12T01:57:54.101005+0000","last_unstale":"2024-09-12T01:57:54.104202+0000","last_undegraded":"2024-09-12T01:57:54.104202+0000","last_fullsized":"2024-09-12T01:57:54.104202+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:55.997442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.090384+0000","last_change":"2024-09-12T01:57:54.090384+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.090384+0000","last_undegraded":"2024-09-12T01:57:54.090384+0000","last_fullsized":"2024-09-12T01:57:54.090384+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.095386+0000","last_change":"2024-09-12T01:57:53.095386+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.095386+0000","last_undegraded":"2024-09-12T01:57:53.095386+0000","last_fullsized":"2024-09-12T01:57:53.095386+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":227,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.097536+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:57:54.097536+0000","last_peered":"2024-09-12T01:57:54.097536+0000","last_clean":"2024-09-12T01:57:54.097536+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:57:54.097536+0000","last_undegraded":"2024-09-12T01:57:54.097536+0000","last_fullsized":"2024-09-12T01:57:54.097536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":3},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1191936,"data_stored":854869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":598016,"data_stored":264501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":598016,"data_stored":264501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542174,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":598016,"data_stored":264501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":258292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":585728,"data_stored":258292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542174,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1179648,"data_stored":848660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27604,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":585728,"data_stored":258292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:57:58.112 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:57:58.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.247+0000 7f58194a5640 1 Processor -- start 2024-09-12T01:57:58.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.247+0000 7f58194a5640 1 -- start start 2024-09-12T01:57:58.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.247+0000 7f58194a5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f581415e5f0 0x7f58140d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.247+0000 7f58194a5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f58140b6690 0x7f581406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.248+0000 7f58194a5640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58140d3690 con 0x7f58140d30f0 2024-09-12T01:57:58.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.248+0000 7f58194a5640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f581406d530 con 0x7f581415e5f0 2024-09-12T01:57:58.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.248+0000 7f58194a5640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f58140d3970 con 0x7f58140b6690 2024-09-12T01:57:58.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.248+0000 7f5812ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f581415e5f0 0x7f58140d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.248+0000 7f5812ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f581415e5f0 0x7f58140d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33572/0 (socket says 172.21.15.19:33572) 2024-09-12T01:57:58.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.248+0000 7f5812ffd640 1 -- 172.21.15.19:0/4095006743 learned_addr learned my addr 172.21.15.19:0/4095006743 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:58.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.248+0000 7f5812ffd640 1 -- 172.21.15.19:0/4095006743 >> v2:172.21.15.135:3300/0 conn(0x7f58140b6690 msgr2=0x7f581406d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:58.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.248+0000 7f58137fe640 1 --2- 172.21.15.19:0/4095006743 >> v2:172.21.15.135:3300/0 conn(0x7f58140b6690 0x7f581406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.248+0000 7f5812ffd640 1 --2- 172.21.15.19:0/4095006743 >> v2:172.21.15.135:3300/0 conn(0x7f58140b6690 0x7f581406d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.248+0000 7f5812ffd640 1 -- 172.21.15.19:0/4095006743 >> v1:172.21.15.135:6789/0 conn(0x7f58140d30f0 legacy=0x7f58140b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:58.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.248+0000 7f5812ffd640 1 -- 172.21.15.19:0/4095006743 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581406cee0 con 0x7f581415e5f0 2024-09-12T01:57:58.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.249+0000 7f5812ffd640 1 --2- 172.21.15.19:0/4095006743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f581415e5f0 0x7f58140d4dd0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5804009870 tx=0x7f580402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae479ca305dd7013 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.249+0000 7f5811ffb640 1 -- 172.21.15.19:0/4095006743 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804037070 con 0x7f581415e5f0 2024-09-12T01:57:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.249+0000 7f5811ffb640 1 -- 172.21.15.19:0/4095006743 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5804032440 con 0x7f581415e5f0 2024-09-12T01:57:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.249+0000 7f5811ffb640 1 -- 172.21.15.19:0/4095006743 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804032810 con 0x7f581415e5f0 2024-09-12T01:57:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.249+0000 7f58194a5640 1 -- 172.21.15.19:0/4095006743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f581415e5f0 msgr2=0x7f58140d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.249+0000 7f58194a5640 1 --2- 172.21.15.19:0/4095006743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f581415e5f0 0x7f58140d4dd0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5804009870 tx=0x7f580402a270 comp rx=0 tx=0).stop 2024-09-12T01:57:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.249+0000 7f58194a5640 1 -- 172.21.15.19:0/4095006743 shutdown_connections 2024-09-12T01:57:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.249+0000 7f58194a5640 1 --2- 172.21.15.19:0/4095006743 >> v2:172.21.15.135:3300/0 conn(0x7f58140b6690 0x7f581406d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.249+0000 7f58194a5640 1 --2- 172.21.15.19:0/4095006743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f581415e5f0 0x7f58140d4dd0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.249+0000 7f58194a5640 1 -- 172.21.15.19:0/4095006743 >> 172.21.15.19:0/4095006743 conn(0x7f581408bfc0 msgr2=0x7f58140d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.250+0000 7f58194a5640 1 -- 172.21.15.19:0/4095006743 shutdown_connections 2024-09-12T01:57:58.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.250+0000 7f58194a5640 1 -- 172.21.15.19:0/4095006743 wait complete. 2024-09-12T01:57:58.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.251+0000 7f58194a5640 1 Processor -- start 2024-09-12T01:57:58.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.251+0000 7f58194a5640 1 -- start start 2024-09-12T01:57:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f58194a5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f58140b6690 0x7f58141610d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f58194a5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58140d30f0 0x7f5814157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f58194a5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f581415e5f0 0x7f5814157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f58194a5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f58140d5310 con 0x7f581415e5f0 2024-09-12T01:57:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f58194a5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f581415e9d0 con 0x7f58140d30f0 2024-09-12T01:57:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f58194a5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f581406df00 con 0x7f58140b6690 2024-09-12T01:57:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f58137fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f581415e5f0 0x7f5814157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f58137fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f581415e5f0 0x7f5814157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33580/0 (socket says 172.21.15.19:33580) 2024-09-12T01:57:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f58137fe640 1 -- 172.21.15.19:0/790456017 learned_addr learned my addr 172.21.15.19:0/790456017 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f58127fc640 1 --2- 172.21.15.19:0/790456017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58140d30f0 0x7f5814157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f5812ffd640 1 --2- 172.21.15.19:0/790456017 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f58140b6690 0x7f58141610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f58137fe640 1 -- 172.21.15.19:0/790456017 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f58140b6690 msgr2=0x7f58141610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f58137fe640 1 --2- 172.21.15.19:0/790456017 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f58140b6690 0x7f58141610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f58137fe640 1 -- 172.21.15.19:0/790456017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58140d30f0 msgr2=0x7f5814157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f58137fe640 1 --2- 172.21.15.19:0/790456017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58140d30f0 0x7f5814157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f58137fe640 1 -- 172.21.15.19:0/790456017 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58140b75a0 con 0x7f581415e5f0 2024-09-12T01:57:58.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f58127fc640 1 --2- 172.21.15.19:0/790456017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58140d30f0 0x7f5814157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:58.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f58137fe640 1 --2- 172.21.15.19:0/790456017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f581415e5f0 0x7f5814157b70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f580c00cd40 tx=0x7f580c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:58.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.252+0000 7f57fb7fe640 1 -- 172.21.15.19:0/790456017 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c003b90 con 0x7f581415e5f0 2024-09-12T01:57:58.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.253+0000 7f57fb7fe640 1 -- 172.21.15.19:0/790456017 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c003d30 con 0x7f581415e5f0 2024-09-12T01:57:58.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.253+0000 7f58194a5640 1 -- 172.21.15.19:0/790456017 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58140b7880 con 0x7f581415e5f0 2024-09-12T01:57:58.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.253+0000 7f57fb7fe640 1 -- 172.21.15.19:0/790456017 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c004240 con 0x7f581415e5f0 2024-09-12T01:57:58.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.253+0000 7f58194a5640 1 -- 172.21.15.19:0/790456017 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58140b7e40 con 0x7f581415e5f0 2024-09-12T01:57:58.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.253+0000 7f58194a5640 1 -- 172.21.15.19:0/790456017 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f581406d9a0 con 0x7f581415e5f0 2024-09-12T01:57:58.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.254+0000 7f57fb7fe640 1 -- 172.21.15.19:0/790456017 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f580c0043e0 con 0x7f581415e5f0 2024-09-12T01:57:58.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.254+0000 7f57fb7fe640 1 --2- 172.21.15.19:0/790456017 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f580006be30 0x7f580006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.255+0000 7f57fb7fe640 1 -- 172.21.15.19:0/790456017 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f580c08ba60 con 0x7f581415e5f0 2024-09-12T01:57:58.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.255+0000 7f5812ffd640 1 --2- 172.21.15.19:0/790456017 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f580006be30 0x7f580006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.255+0000 7f5812ffd640 1 --2- 172.21.15.19:0/790456017 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f580006be30 0x7f580006e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5804034000 tx=0x7f580402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.259+0000 7f57fb7fe640 1 -- 172.21.15.19:0/790456017 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f580c05a310 con 0x7f581415e5f0 2024-09-12T01:57:58.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.433+0000 7f58194a5640 1 -- 172.21.15.19:0/790456017 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f58140d3d80 con 0x7f580006be30 2024-09-12T01:57:58.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.440+0000 7f57fb7fe640 1 -- 172.21.15.19:0/790456017 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243490 (secure 0 0 0) 0x7f58140d3d80 con 0x7f580006be30 2024-09-12T01:57:58.442 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:58.443 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:57:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.443+0000 7f58194a5640 1 -- 172.21.15.19:0/790456017 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f580006be30 msgr2=0x7f580006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.443+0000 7f58194a5640 1 --2- 172.21.15.19:0/790456017 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f580006be30 0x7f580006e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5804034000 tx=0x7f580402e000 comp rx=0 tx=0).stop 2024-09-12T01:57:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.443+0000 7f58194a5640 1 -- 172.21.15.19:0/790456017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f581415e5f0 msgr2=0x7f5814157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.443+0000 7f58194a5640 1 --2- 172.21.15.19:0/790456017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f581415e5f0 0x7f5814157b70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f580c00cd40 tx=0x7f580c00a660 comp rx=0 tx=0).stop 2024-09-12T01:57:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.443+0000 7f58194a5640 1 -- 172.21.15.19:0/790456017 shutdown_connections 2024-09-12T01:57:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.443+0000 7f58194a5640 1 --2- 172.21.15.19:0/790456017 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f580006be30 0x7f580006e2f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.443+0000 7f58194a5640 1 --2- 172.21.15.19:0/790456017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f581415e5f0 0x7f5814157b70 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.443+0000 7f58194a5640 1 --2- 172.21.15.19:0/790456017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58140d30f0 0x7f5814157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.443+0000 7f58194a5640 1 --2- 172.21.15.19:0/790456017 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f58140b6690 0x7f58141610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.443+0000 7f58194a5640 1 -- 172.21.15.19:0/790456017 >> 172.21.15.19:0/790456017 conn(0x7f581408bfc0 msgr2=0x7f58140b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.443+0000 7f58194a5640 1 -- 172.21.15.19:0/790456017 shutdown_connections 2024-09-12T01:57:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.443+0000 7f58194a5640 1 -- 172.21.15.19:0/790456017 wait complete. 2024-09-12T01:57:58.454 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-09-12T01:57:58.112378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226232,"kb_used_data":5836,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748488,"statfs":{"total":773094113280,"available":772862451712,"internally_reserved":0,"allocated":5976064,"data_stored":3299225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.025380"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.095167+0000","last_change":"2024-09-12T01:57:54.095167+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.095167+0000","last_undegraded":"2024-09-12T01:57:54.095167+0000","last_fullsized":"2024-09-12T01:57:54.095167+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.094597+0000","last_change":"2024-09-12T01:57:54.094597+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.094597+0000","last_undegraded":"2024-09-12T01:57:54.094597+0000","last_fullsized":"2024-09-12T01:57:54.094597+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677962+0000","last_change":"2024-09-12T01:57:55.118598+0000","last_active":"2024-09-12T01:57:56.677962+0000","last_peered":"2024-09-12T01:57:56.677962+0000","last_clean":"2024-09-12T01:57:56.677962+0000","last_became_active":"2024-09-12T01:57:55.118325+0000","last_became_peered":"2024-09-12T01:57:55.118325+0000","last_unstale":"2024-09-12T01:57:56.677962+0000","last_undegraded":"2024-09-12T01:57:56.677962+0000","last_fullsized":"2024-09-12T01:57:56.677962+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:07.515102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.095097+0000","last_change":"2024-09-12T01:57:54.095097+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.095097+0000","last_undegraded":"2024-09-12T01:57:54.095097+0000","last_fullsized":"2024-09-12T01:57:54.095097+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.094741+0000","last_change":"2024-09-12T01:57:54.094741+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.094741+0000","last_undegraded":"2024-09-12T01:57:54.094741+0000","last_fullsized":"2024-09-12T01:57:54.094741+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091834+0000","last_change":"2024-09-12T01:57:54.091834+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091834+0000","last_undegraded":"2024-09-12T01:57:54.091834+0000","last_fullsized":"2024-09-12T01:57:54.091834+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.090692+0000","last_change":"2024-09-12T01:57:54.090692+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.090692+0000","last_undegraded":"2024-09-12T01:57:54.090692+0000","last_fullsized":"2024-09-12T01:57:54.090692+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091405+0000","last_change":"2024-09-12T01:57:54.091405+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091405+0000","last_undegraded":"2024-09-12T01:57:54.091405+0000","last_fullsized":"2024-09-12T01:57:54.091405+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.094252+0000","last_change":"2024-09-12T01:57:54.094252+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.094252+0000","last_undegraded":"2024-09-12T01:57:54.094252+0000","last_fullsized":"2024-09-12T01:57:54.094252+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091889+0000","last_change":"2024-09-12T01:57:54.091889+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091889+0000","last_undegraded":"2024-09-12T01:57:54.091889+0000","last_fullsized":"2024-09-12T01:57:54.091889+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.094239+0000","last_change":"2024-09-12T01:57:54.094239+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.094239+0000","last_undegraded":"2024-09-12T01:57:54.094239+0000","last_fullsized":"2024-09-12T01:57:54.094239+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.100535+0000","last_change":"2024-09-12T01:57:54.099411+0000","last_active":"2024-09-12T01:57:54.100535+0000","last_peered":"2024-09-12T01:57:54.100535+0000","last_clean":"2024-09-12T01:57:54.100535+0000","last_became_active":"2024-09-12T01:57:54.099087+0000","last_became_peered":"2024-09-12T01:57:54.099087+0000","last_unstale":"2024-09-12T01:57:54.100535+0000","last_undegraded":"2024-09-12T01:57:54.100535+0000","last_fullsized":"2024-09-12T01:57:54.100535+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:44.513454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.092378+0000","last_change":"2024-09-12T01:57:54.092378+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.092378+0000","last_undegraded":"2024-09-12T01:57:54.092378+0000","last_fullsized":"2024-09-12T01:57:54.092378+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092999+0000","last_change":"2024-09-12T01:57:53.092999+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092999+0000","last_undegraded":"2024-09-12T01:57:53.092999+0000","last_fullsized":"2024-09-12T01:57:53.092999+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.090402+0000","last_change":"2024-09-12T01:57:54.090402+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.090402+0000","last_undegraded":"2024-09-12T01:57:54.090402+0000","last_fullsized":"2024-09-12T01:57:54.090402+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092925+0000","last_change":"2024-09-12T01:57:53.092925+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092925+0000","last_undegraded":"2024-09-12T01:57:53.092925+0000","last_fullsized":"2024-09-12T01:57:53.092925+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.104257+0000","last_change":"2024-09-12T01:57:54.102087+0000","last_active":"2024-09-12T01:57:54.104257+0000","last_peered":"2024-09-12T01:57:54.104257+0000","last_clean":"2024-09-12T01:57:54.104257+0000","last_became_active":"2024-09-12T01:57:54.101812+0000","last_became_peered":"2024-09-12T01:57:54.101812+0000","last_unstale":"2024-09-12T01:57:54.104257+0000","last_undegraded":"2024-09-12T01:57:54.104257+0000","last_fullsized":"2024-09-12T01:57:54.104257+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:57.124282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678046+0000","last_change":"2024-09-12T01:57:55.119789+0000","last_active":"2024-09-12T01:57:56.678046+0000","last_peered":"2024-09-12T01:57:56.678046+0000","last_clean":"2024-09-12T01:57:56.678046+0000","last_became_active":"2024-09-12T01:57:55.119517+0000","last_became_peered":"2024-09-12T01:57:55.119517+0000","last_unstale":"2024-09-12T01:57:56.678046+0000","last_undegraded":"2024-09-12T01:57:56.678046+0000","last_fullsized":"2024-09-12T01:57:56.678046+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:22.674136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092146+0000","last_change":"2024-09-12T01:57:53.092146+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092146+0000","last_undegraded":"2024-09-12T01:57:53.092146+0000","last_fullsized":"2024-09-12T01:57:53.092146+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.095015+0000","last_change":"2024-09-12T01:57:54.095015+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.095015+0000","last_undegraded":"2024-09-12T01:57:54.095015+0000","last_fullsized":"2024-09-12T01:57:54.095015+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677687+0000","last_change":"2024-09-12T01:57:54.099653+0000","last_active":"2024-09-12T01:57:56.677687+0000","last_peered":"2024-09-12T01:57:56.677687+0000","last_clean":"2024-09-12T01:57:56.677687+0000","last_became_active":"2024-09-12T01:57:54.099411+0000","last_became_peered":"2024-09-12T01:57:54.099411+0000","last_unstale":"2024-09-12T01:57:56.677687+0000","last_undegraded":"2024-09-12T01:57:56.677687+0000","last_fullsized":"2024-09-12T01:57:56.677687+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:54.567633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.105446+0000","last_change":"2024-09-12T01:57:54.103416+0000","last_active":"2024-09-12T01:57:54.105446+0000","last_peered":"2024-09-12T01:57:54.105446+0000","last_clean":"2024-09-12T01:57:54.105446+0000","last_became_active":"2024-09-12T01:57:54.103089+0000","last_became_peered":"2024-09-12T01:57:54.103089+0000","last_unstale":"2024-09-12T01:57:54.105446+0000","last_undegraded":"2024-09-12T01:57:54.105446+0000","last_fullsized":"2024-09-12T01:57:54.105446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:33.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.096539+0000","last_change":"2024-09-12T01:57:54.096539+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.096539+0000","last_undegraded":"2024-09-12T01:57:54.096539+0000","last_fullsized":"2024-09-12T01:57:54.096539+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092260+0000","last_change":"2024-09-12T01:57:53.092260+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092260+0000","last_undegraded":"2024-09-12T01:57:53.092260+0000","last_fullsized":"2024-09-12T01:57:53.092260+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677710+0000","last_change":"2024-09-12T01:57:55.118509+0000","last_active":"2024-09-12T01:57:56.677710+0000","last_peered":"2024-09-12T01:57:56.677710+0000","last_clean":"2024-09-12T01:57:56.677710+0000","last_became_active":"2024-09-12T01:57:55.118172+0000","last_became_peered":"2024-09-12T01:57:55.118172+0000","last_unstale":"2024-09-12T01:57:56.677710+0000","last_undegraded":"2024-09-12T01:57:56.677710+0000","last_fullsized":"2024-09-12T01:57:56.677710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:55.332410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.105942+0000","last_change":"2024-09-12T01:57:54.104891+0000","last_active":"2024-09-12T01:57:54.105942+0000","last_peered":"2024-09-12T01:57:54.105942+0000","last_clean":"2024-09-12T01:57:54.105942+0000","last_became_active":"2024-09-12T01:57:54.104595+0000","last_became_peered":"2024-09-12T01:57:54.104595+0000","last_unstale":"2024-09-12T01:57:54.105942+0000","last_undegraded":"2024-09-12T01:57:54.105942+0000","last_fullsized":"2024-09-12T01:57:54.105942+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:55.138013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.092841+0000","last_change":"2024-09-12T01:57:54.092841+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.092841+0000","last_undegraded":"2024-09-12T01:57:54.092841+0000","last_fullsized":"2024-09-12T01:57:54.092841+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678055+0000","last_change":"2024-09-12T01:57:54.111175+0000","last_active":"2024-09-12T01:57:56.678055+0000","last_peered":"2024-09-12T01:57:56.678055+0000","last_clean":"2024-09-12T01:57:56.678055+0000","last_became_active":"2024-09-12T01:57:54.110900+0000","last_became_peered":"2024-09-12T01:57:54.110900+0000","last_unstale":"2024-09-12T01:57:56.678055+0000","last_undegraded":"2024-09-12T01:57:56.678055+0000","last_fullsized":"2024-09-12T01:57:56.678055+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:01.720274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.108836+0000","last_change":"2024-09-12T01:57:54.107407+0000","last_active":"2024-09-12T01:57:54.108836+0000","last_peered":"2024-09-12T01:57:54.108836+0000","last_clean":"2024-09-12T01:57:54.108836+0000","last_became_active":"2024-09-12T01:57:54.107149+0000","last_became_peered":"2024-09-12T01:57:54.107149+0000","last_unstale":"2024-09-12T01:57:54.108836+0000","last_undegraded":"2024-09-12T01:57:54.108836+0000","last_fullsized":"2024-09-12T01:57:54.108836+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:04.470684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678003+0000","last_change":"2024-09-12T01:57:55.113826+0000","last_active":"2024-09-12T01:57:56.678003+0000","last_peered":"2024-09-12T01:57:56.678003+0000","last_clean":"2024-09-12T01:57:56.678003+0000","last_became_active":"2024-09-12T01:57:55.113488+0000","last_became_peered":"2024-09-12T01:57:55.113488+0000","last_unstale":"2024-09-12T01:57:56.678003+0000","last_undegraded":"2024-09-12T01:57:56.678003+0000","last_fullsized":"2024-09-12T01:57:56.678003+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:14.826705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091785+0000","last_change":"2024-09-12T01:57:53.091785+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091785+0000","last_undegraded":"2024-09-12T01:57:53.091785+0000","last_fullsized":"2024-09-12T01:57:53.091785+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091534+0000","last_change":"2024-09-12T01:57:54.091534+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091534+0000","last_undegraded":"2024-09-12T01:57:54.091534+0000","last_fullsized":"2024-09-12T01:57:54.091534+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091646+0000","last_change":"2024-09-12T01:57:53.091646+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091646+0000","last_undegraded":"2024-09-12T01:57:53.091646+0000","last_fullsized":"2024-09-12T01:57:53.091646+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.107135+0000","last_change":"2024-09-12T01:57:54.106202+0000","last_active":"2024-09-12T01:57:54.107135+0000","last_peered":"2024-09-12T01:57:54.107135+0000","last_clean":"2024-09-12T01:57:54.107135+0000","last_became_active":"2024-09-12T01:57:54.105898+0000","last_became_peered":"2024-09-12T01:57:54.105898+0000","last_unstale":"2024-09-12T01:57:54.107135+0000","last_undegraded":"2024-09-12T01:57:54.107135+0000","last_fullsized":"2024-09-12T01:57:54.107135+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:37.565639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.105954+0000","last_change":"2024-09-12T01:57:54.104923+0000","last_active":"2024-09-12T01:57:54.105954+0000","last_peered":"2024-09-12T01:57:54.105954+0000","last_clean":"2024-09-12T01:57:54.105954+0000","last_became_active":"2024-09-12T01:57:54.104376+0000","last_became_peered":"2024-09-12T01:57:54.104376+0000","last_unstale":"2024-09-12T01:57:54.105954+0000","last_undegraded":"2024-09-12T01:57:54.105954+0000","last_fullsized":"2024-09-12T01:57:54.105954+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:54.961365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091523+0000","last_change":"2024-09-12T01:57:53.091523+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091523+0000","last_undegraded":"2024-09-12T01:57:53.091523+0000","last_fullsized":"2024-09-12T01:57:53.091523+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.094626+0000","last_change":"2024-09-12T01:57:53.094626+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.094626+0000","last_undegraded":"2024-09-12T01:57:53.094626+0000","last_fullsized":"2024-09-12T01:57:53.094626+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.089521+0000","last_change":"2024-09-12T01:57:53.089521+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.089521+0000","last_undegraded":"2024-09-12T01:57:53.089521+0000","last_fullsized":"2024-09-12T01:57:53.089521+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677708+0000","last_change":"2024-09-12T01:57:55.127378+0000","last_active":"2024-09-12T01:57:56.677708+0000","last_peered":"2024-09-12T01:57:56.677708+0000","last_clean":"2024-09-12T01:57:56.677708+0000","last_became_active":"2024-09-12T01:57:55.127170+0000","last_became_peered":"2024-09-12T01:57:55.127170+0000","last_unstale":"2024-09-12T01:57:56.677708+0000","last_undegraded":"2024-09-12T01:57:56.677708+0000","last_fullsized":"2024-09-12T01:57:56.677708+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:53.385927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.107907+0000","last_change":"2024-09-12T01:57:54.106589+0000","last_active":"2024-09-12T01:57:54.107907+0000","last_peered":"2024-09-12T01:57:54.107907+0000","last_clean":"2024-09-12T01:57:54.107907+0000","last_became_active":"2024-09-12T01:57:54.106261+0000","last_became_peered":"2024-09-12T01:57:54.106261+0000","last_unstale":"2024-09-12T01:57:54.107907+0000","last_undegraded":"2024-09-12T01:57:54.107907+0000","last_fullsized":"2024-09-12T01:57:54.107907+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:31.979861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.103092+0000","last_change":"2024-09-12T01:57:54.101095+0000","last_active":"2024-09-12T01:57:54.103092+0000","last_peered":"2024-09-12T01:57:54.103092+0000","last_clean":"2024-09-12T01:57:54.103092+0000","last_became_active":"2024-09-12T01:57:54.100822+0000","last_became_peered":"2024-09-12T01:57:54.100822+0000","last_unstale":"2024-09-12T01:57:54.103092+0000","last_undegraded":"2024-09-12T01:57:54.103092+0000","last_fullsized":"2024-09-12T01:57:54.103092+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:59.910848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091074+0000","last_change":"2024-09-12T01:57:54.091074+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091074+0000","last_undegraded":"2024-09-12T01:57:54.091074+0000","last_fullsized":"2024-09-12T01:57:54.091074+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092130+0000","last_change":"2024-09-12T01:57:53.092130+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092130+0000","last_undegraded":"2024-09-12T01:57:53.092130+0000","last_fullsized":"2024-09-12T01:57:53.092130+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.092693+0000","last_change":"2024-09-12T01:57:54.092693+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.092693+0000","last_undegraded":"2024-09-12T01:57:54.092693+0000","last_fullsized":"2024-09-12T01:57:54.092693+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092974+0000","last_change":"2024-09-12T01:57:53.092974+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092974+0000","last_undegraded":"2024-09-12T01:57:53.092974+0000","last_fullsized":"2024-09-12T01:57:53.092974+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092426+0000","last_change":"2024-09-12T01:57:53.092426+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092426+0000","last_undegraded":"2024-09-12T01:57:53.092426+0000","last_fullsized":"2024-09-12T01:57:53.092426+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.089523+0000","last_change":"2024-09-12T01:57:53.089523+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.089523+0000","last_undegraded":"2024-09-12T01:57:53.089523+0000","last_fullsized":"2024-09-12T01:57:53.089523+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091461+0000","last_change":"2024-09-12T01:57:54.091461+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091461+0000","last_undegraded":"2024-09-12T01:57:54.091461+0000","last_fullsized":"2024-09-12T01:57:54.091461+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.107157+0000","last_change":"2024-09-12T01:57:54.106206+0000","last_active":"2024-09-12T01:57:54.107157+0000","last_peered":"2024-09-12T01:57:54.107157+0000","last_clean":"2024-09-12T01:57:54.107157+0000","last_became_active":"2024-09-12T01:57:54.105890+0000","last_became_peered":"2024-09-12T01:57:54.105890+0000","last_unstale":"2024-09-12T01:57:54.107157+0000","last_undegraded":"2024-09-12T01:57:54.107157+0000","last_fullsized":"2024-09-12T01:57:54.107157+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:54.271270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.107746+0000","last_change":"2024-09-12T01:57:54.106811+0000","last_active":"2024-09-12T01:57:54.107746+0000","last_peered":"2024-09-12T01:57:54.107746+0000","last_clean":"2024-09-12T01:57:54.107746+0000","last_became_active":"2024-09-12T01:57:54.106499+0000","last_became_peered":"2024-09-12T01:57:54.106499+0000","last_unstale":"2024-09-12T01:57:54.107746+0000","last_undegraded":"2024-09-12T01:57:54.107746+0000","last_fullsized":"2024-09-12T01:57:54.107746+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:12.616086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.095103+0000","last_change":"2024-09-12T01:57:53.095103+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.095103+0000","last_undegraded":"2024-09-12T01:57:53.095103+0000","last_fullsized":"2024-09-12T01:57:53.095103+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091478+0000","last_change":"2024-09-12T01:57:53.091478+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091478+0000","last_undegraded":"2024-09-12T01:57:53.091478+0000","last_fullsized":"2024-09-12T01:57:53.091478+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.092168+0000","last_change":"2024-09-12T01:57:54.092168+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.092168+0000","last_undegraded":"2024-09-12T01:57:54.092168+0000","last_fullsized":"2024-09-12T01:57:54.092168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091966+0000","last_change":"2024-09-12T01:57:53.091966+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091966+0000","last_undegraded":"2024-09-12T01:57:53.091966+0000","last_fullsized":"2024-09-12T01:57:53.091966+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677686+0000","last_change":"2024-09-12T01:57:54.101888+0000","last_active":"2024-09-12T01:57:56.677686+0000","last_peered":"2024-09-12T01:57:56.677686+0000","last_clean":"2024-09-12T01:57:56.677686+0000","last_became_active":"2024-09-12T01:57:54.101626+0000","last_became_peered":"2024-09-12T01:57:54.101626+0000","last_unstale":"2024-09-12T01:57:56.677686+0000","last_undegraded":"2024-09-12T01:57:56.677686+0000","last_fullsized":"2024-09-12T01:57:56.677686+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:00.857513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.104202+0000","last_change":"2024-09-12T01:57:54.101287+0000","last_active":"2024-09-12T01:57:54.104202+0000","last_peered":"2024-09-12T01:57:54.104202+0000","last_clean":"2024-09-12T01:57:54.104202+0000","last_became_active":"2024-09-12T01:57:54.101005+0000","last_became_peered":"2024-09-12T01:57:54.101005+0000","last_unstale":"2024-09-12T01:57:54.104202+0000","last_undegraded":"2024-09-12T01:57:54.104202+0000","last_fullsized":"2024-09-12T01:57:54.104202+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:55.997442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.090384+0000","last_change":"2024-09-12T01:57:54.090384+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.090384+0000","last_undegraded":"2024-09-12T01:57:54.090384+0000","last_fullsized":"2024-09-12T01:57:54.090384+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.095386+0000","last_change":"2024-09-12T01:57:53.095386+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.095386+0000","last_undegraded":"2024-09-12T01:57:53.095386+0000","last_fullsized":"2024-09-12T01:57:53.095386+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":227,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.097536+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:57:54.097536+0000","last_peered":"2024-09-12T01:57:54.097536+0000","last_clean":"2024-09-12T01:57:54.097536+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:57:54.097536+0000","last_undegraded":"2024-09-12T01:57:54.097536+0000","last_fullsized":"2024-09-12T01:57:54.097536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1191936,"data_stored":854869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":598016,"data_stored":264501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":598016,"data_stored":264501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542174,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":598016,"data_stored":264501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":258292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":585728,"data_stored":258292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542174,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1179648,"data_stored":848660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":285609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:57:58.458 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:57:58.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.596+0000 7fc82fa53640 1 Processor -- start 2024-09-12T01:57:58.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.596+0000 7fc82fa53640 1 -- start start 2024-09-12T01:57:58.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.597+0000 7fc82fa53640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc8280af560 0x7fc8281691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.597+0000 7fc82fa53640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc82806cb30 con 0x7fc8280d04a0 2024-09-12T01:57:58.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.597+0000 7fc82fa53640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc82806bfb0 con 0x7fc828147360 2024-09-12T01:57:58.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.597+0000 7fc82fa53640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc82806c290 con 0x7fc8280af560 2024-09-12T01:57:58.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.597+0000 7fc82cfee640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc8280d04a0 0x7fc8280d0910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59740/0 (socket says 172.21.15.19:59740) 2024-09-12T01:57:58.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.597+0000 7fc82cfee640 1 -- 172.21.15.19:0/3222170131 learned_addr learned my addr 172.21.15.19:0/3222170131 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:58.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.597+0000 7fc82dff0640 1 --2- 172.21.15.19:0/3222170131 >> v2:172.21.15.135:3300/0 conn(0x7fc8280af560 0x7fc8281691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.597+0000 7fc81ffff640 1 -- 172.21.15.19:0/3222170131 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2994195157 0 0) 0x7fc82806cb30 con 0x7fc8280d04a0 2024-09-12T01:57:58.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.597+0000 7fc81ffff640 1 -- 172.21.15.19:0/3222170131 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc814003520 con 0x7fc8280d04a0 2024-09-12T01:57:58.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc81ffff640 1 -- 172.21.15.19:0/3222170131 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3724878442 0 0) 0x7fc814003520 con 0x7fc8280d04a0 2024-09-12T01:57:58.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc81ffff640 1 -- 172.21.15.19:0/3222170131 >> v2:172.21.15.135:3300/0 conn(0x7fc8280af560 msgr2=0x7fc8281691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:58.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc81ffff640 1 --2- 172.21.15.19:0/3222170131 >> v2:172.21.15.135:3300/0 conn(0x7fc8280af560 0x7fc8281691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc81ffff640 1 -- 172.21.15.19:0/3222170131 >> v1:172.21.15.135:6789/0 conn(0x7fc828147360 legacy=0x7fc828070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc81ffff640 1 -- 172.21.15.19:0/3222170131 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82806c570 con 0x7fc8280d04a0 2024-09-12T01:57:58.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc81ffff640 1 -- 172.21.15.19:0/3222170131 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fc818001670 con 0x7fc8280d04a0 2024-09-12T01:57:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc81ffff640 1 -- 172.21.15.19:0/3222170131 >> v1:172.21.15.19:6789/0 conn(0x7fc8280d04a0 legacy=0x7fc8280d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc81ffff640 1 --2- 172.21.15.19:0/3222170131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8140039b0 0x7fc814003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc81ffff640 1 --2- 172.21.15.19:0/3222170131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8140043b0 0x7fc814004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc81ffff640 1 --2- 172.21.15.19:0/3222170131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc814005120 0x7fc81400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc81ffff640 1 -- 172.21.15.19:0/3222170131 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc82806c290 con 0x7fc8140043b0 2024-09-12T01:57:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc81ffff640 1 -- 172.21.15.19:0/3222170131 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc81400c060 con 0x7fc814005120 2024-09-12T01:57:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc81ffff640 1 -- 172.21.15.19:0/3222170131 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc81400c260 con 0x7fc8140039b0 2024-09-12T01:57:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc82cfee640 1 --2- 172.21.15.19:0/3222170131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8140043b0 0x7fc814004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc82dff0640 1 --2- 172.21.15.19:0/3222170131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc814005120 0x7fc81400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc82d7ef640 1 --2- 172.21.15.19:0/3222170131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8140039b0 0x7fc814003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc82cfee640 1 -- 172.21.15.19:0/3222170131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8140039b0 msgr2=0x7fc814003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc82cfee640 1 --2- 172.21.15.19:0/3222170131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8140039b0 0x7fc814003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc82cfee640 1 -- 172.21.15.19:0/3222170131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc814005120 msgr2=0x7fc81400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:58.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc82cfee640 1 --2- 172.21.15.19:0/3222170131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc814005120 0x7fc81400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc82cfee640 1 -- 172.21.15.19:0/3222170131 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc814003520 con 0x7fc8140043b0 2024-09-12T01:57:58.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.598+0000 7fc82dff0640 1 -- 172.21.15.19:0/3222170131 reap_dead start 2024-09-12T01:57:58.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.599+0000 7fc82cfee640 1 --2- 172.21.15.19:0/3222170131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8140043b0 0x7fc814004880 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc81800c240 tx=0x7fc814005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76fb5a91043bd62 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:58.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.599+0000 7fc81ffff640 1 -- 172.21.15.19:0/3222170131 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818007d30 con 0x7fc8140043b0 2024-09-12T01:57:58.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.599+0000 7fc81ffff640 1 -- 172.21.15.19:0/3222170131 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc818005af0 con 0x7fc8140043b0 2024-09-12T01:57:58.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.599+0000 7fc81ffff640 1 -- 172.21.15.19:0/3222170131 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818007070 con 0x7fc8140043b0 2024-09-12T01:57:58.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.600+0000 7fc82fa53640 1 -- 172.21.15.19:0/3222170131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8140043b0 msgr2=0x7fc814004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.600+0000 7fc82fa53640 1 --2- 172.21.15.19:0/3222170131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8140043b0 0x7fc814004880 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc81800c240 tx=0x7fc814005830 comp rx=0 tx=0).stop 2024-09-12T01:57:58.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.600+0000 7fc82fa53640 1 -- 172.21.15.19:0/3222170131 shutdown_connections 2024-09-12T01:57:58.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.600+0000 7fc82fa53640 1 --2- 172.21.15.19:0/3222170131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8140043b0 0x7fc814004880 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.600+0000 7fc82fa53640 1 -- 172.21.15.19:0/3222170131 >> 172.21.15.19:0/3222170131 conn(0x7fc8280b2f40 msgr2=0x7fc8280b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:58.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.600+0000 7fc82fa53640 1 -- 172.21.15.19:0/3222170131 shutdown_connections 2024-09-12T01:57:58.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.600+0000 7fc82fa53640 1 -- 172.21.15.19:0/3222170131 wait complete. 2024-09-12T01:57:58.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.601+0000 7fc82fa53640 1 Processor -- start 2024-09-12T01:57:58.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.601+0000 7fc82fa53640 1 -- start start 2024-09-12T01:57:58.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.602+0000 7fc82fa53640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8140043b0 0x7fc8280b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.602+0000 7fc82fa53640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8281f3b60 0x7fc8281616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.602+0000 7fc82fa53640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8281f77f0 0x7fc8280b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.602+0000 7fc82fa53640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc82806bd90 con 0x7fc8281f77f0 2024-09-12T01:57:58.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.602+0000 7fc82fa53640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc82806bc10 con 0x7fc8281f3b60 2024-09-12T01:57:58.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.602+0000 7fc82fa53640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc8280d0910 con 0x7fc8140043b0 2024-09-12T01:57:58.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.602+0000 7fc82dff0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8281f77f0 0x7fc8280b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.602+0000 7fc82dff0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8281f77f0 0x7fc8280b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33600/0 (socket says 172.21.15.19:33600) 2024-09-12T01:57:58.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.602+0000 7fc82dff0640 1 -- 172.21.15.19:0/1529502641 learned_addr learned my addr 172.21.15.19:0/1529502641 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:58.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.602+0000 7fc82cfee640 1 --2- 172.21.15.19:0/1529502641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8281f3b60 0x7fc8281616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.602+0000 7fc82d7ef640 1 --2- 172.21.15.19:0/1529502641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8140043b0 0x7fc8280b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.602+0000 7fc82dff0640 1 -- 172.21.15.19:0/1529502641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8140043b0 msgr2=0x7fc8280b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.602+0000 7fc82dff0640 1 --2- 172.21.15.19:0/1529502641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8140043b0 0x7fc8280b6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.602+0000 7fc82dff0640 1 -- 172.21.15.19:0/1529502641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8281f3b60 msgr2=0x7fc8281616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.602+0000 7fc82dff0640 1 --2- 172.21.15.19:0/1529502641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8281f3b60 0x7fc8281616a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.602+0000 7fc82dff0640 1 -- 172.21.15.19:0/1529502641 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8281f42d0 con 0x7fc8281f77f0 2024-09-12T01:57:58.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.602+0000 7fc82dff0640 1 --2- 172.21.15.19:0/1529502641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8281f77f0 0x7fc8280b4240 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc8280706e0 tx=0x7fc82000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:58.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.603+0000 7fc81dffb640 1 -- 172.21.15.19:0/1529502641 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82000fde0 con 0x7fc8281f77f0 2024-09-12T01:57:58.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.603+0000 7fc81dffb640 1 -- 172.21.15.19:0/1529502641 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82001d070 con 0x7fc8281f77f0 2024-09-12T01:57:58.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.603+0000 7fc82fa53640 1 -- 172.21.15.19:0/1529502641 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8281f45b0 con 0x7fc8281f77f0 2024-09-12T01:57:58.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.603+0000 7fc81dffb640 1 -- 172.21.15.19:0/1529502641 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820015670 con 0x7fc8281f77f0 2024-09-12T01:57:58.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.603+0000 7fc82fa53640 1 -- 172.21.15.19:0/1529502641 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8281f72d0 con 0x7fc8281f77f0 2024-09-12T01:57:58.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.604+0000 7fc82fa53640 1 -- 172.21.15.19:0/1529502641 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8281f74d0 con 0x7fc8281f77f0 2024-09-12T01:57:58.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.604+0000 7fc81dffb640 1 -- 172.21.15.19:0/1529502641 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc820015810 con 0x7fc8281f77f0 2024-09-12T01:57:58.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.605+0000 7fc81dffb640 1 --2- 172.21.15.19:0/1529502641 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc80c06be60 0x7fc80c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.605+0000 7fc81dffb640 1 -- 172.21.15.19:0/1529502641 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fc82008b8b0 con 0x7fc8281f77f0 2024-09-12T01:57:58.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.605+0000 7fc82d7ef640 1 --2- 172.21.15.19:0/1529502641 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc80c06be60 0x7fc80c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.606+0000 7fc82d7ef640 1 --2- 172.21.15.19:0/1529502641 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc80c06be60 0x7fc80c06e320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc824001890 tx=0x7fc824009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:58.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.609+0000 7fc81dffb640 1 -- 172.21.15.19:0/1529502641 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc8281f74d0 con 0x7fc8281f77f0 2024-09-12T01:57:58.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.779+0000 7fc82fa53640 1 -- 172.21.15.19:0/1529502641 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc8281f4ad0 con 0x7fc80c06be60 2024-09-12T01:57:58.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.785+0000 7fc81dffb640 1 -- 172.21.15.19:0/1529502641 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243490 (secure 0 0 0) 0x7fc8240128c0 con 0x7fc80c06be60 2024-09-12T01:57:58.788 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:58.789 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:57:58.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.788+0000 7fc82fa53640 1 -- 172.21.15.19:0/1529502641 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc80c06be60 msgr2=0x7fc80c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.788+0000 7fc82fa53640 1 --2- 172.21.15.19:0/1529502641 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc80c06be60 0x7fc80c06e320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc824001890 tx=0x7fc824009040 comp rx=0 tx=0).stop 2024-09-12T01:57:58.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.788+0000 7fc82fa53640 1 -- 172.21.15.19:0/1529502641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8281f77f0 msgr2=0x7fc8280b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.788+0000 7fc82fa53640 1 --2- 172.21.15.19:0/1529502641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8281f77f0 0x7fc8280b4240 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc8280706e0 tx=0x7fc82000f580 comp rx=0 tx=0).stop 2024-09-12T01:57:58.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.788+0000 7fc82fa53640 1 -- 172.21.15.19:0/1529502641 shutdown_connections 2024-09-12T01:57:58.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.788+0000 7fc82fa53640 1 --2- 172.21.15.19:0/1529502641 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc80c06be60 0x7fc80c06e320 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.788+0000 7fc82fa53640 1 --2- 172.21.15.19:0/1529502641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8281f77f0 0x7fc8280b4240 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.788+0000 7fc82fa53640 1 --2- 172.21.15.19:0/1529502641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8281f3b60 0x7fc8281616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.788+0000 7fc82fa53640 1 --2- 172.21.15.19:0/1529502641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8140043b0 0x7fc8280b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.788+0000 7fc82fa53640 1 -- 172.21.15.19:0/1529502641 >> 172.21.15.19:0/1529502641 conn(0x7fc8280b2f40 msgr2=0x7fc82806fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:58.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.788+0000 7fc82fa53640 1 -- 172.21.15.19:0/1529502641 shutdown_connections 2024-09-12T01:57:58.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.788+0000 7fc82fa53640 1 -- 172.21.15.19:0/1529502641 wait complete. 2024-09-12T01:57:58.799 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-09-12T01:57:58.112378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226232,"kb_used_data":5836,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748488,"statfs":{"total":773094113280,"available":772862451712,"internally_reserved":0,"allocated":5976064,"data_stored":3299225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.025380"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.095167+0000","last_change":"2024-09-12T01:57:54.095167+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.095167+0000","last_undegraded":"2024-09-12T01:57:54.095167+0000","last_fullsized":"2024-09-12T01:57:54.095167+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.094597+0000","last_change":"2024-09-12T01:57:54.094597+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.094597+0000","last_undegraded":"2024-09-12T01:57:54.094597+0000","last_fullsized":"2024-09-12T01:57:54.094597+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677962+0000","last_change":"2024-09-12T01:57:55.118598+0000","last_active":"2024-09-12T01:57:56.677962+0000","last_peered":"2024-09-12T01:57:56.677962+0000","last_clean":"2024-09-12T01:57:56.677962+0000","last_became_active":"2024-09-12T01:57:55.118325+0000","last_became_peered":"2024-09-12T01:57:55.118325+0000","last_unstale":"2024-09-12T01:57:56.677962+0000","last_undegraded":"2024-09-12T01:57:56.677962+0000","last_fullsized":"2024-09-12T01:57:56.677962+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:07.515102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.095097+0000","last_change":"2024-09-12T01:57:54.095097+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.095097+0000","last_undegraded":"2024-09-12T01:57:54.095097+0000","last_fullsized":"2024-09-12T01:57:54.095097+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.094741+0000","last_change":"2024-09-12T01:57:54.094741+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.094741+0000","last_undegraded":"2024-09-12T01:57:54.094741+0000","last_fullsized":"2024-09-12T01:57:54.094741+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091834+0000","last_change":"2024-09-12T01:57:54.091834+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091834+0000","last_undegraded":"2024-09-12T01:57:54.091834+0000","last_fullsized":"2024-09-12T01:57:54.091834+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.090692+0000","last_change":"2024-09-12T01:57:54.090692+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.090692+0000","last_undegraded":"2024-09-12T01:57:54.090692+0000","last_fullsized":"2024-09-12T01:57:54.090692+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091405+0000","last_change":"2024-09-12T01:57:54.091405+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091405+0000","last_undegraded":"2024-09-12T01:57:54.091405+0000","last_fullsized":"2024-09-12T01:57:54.091405+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.094252+0000","last_change":"2024-09-12T01:57:54.094252+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.094252+0000","last_undegraded":"2024-09-12T01:57:54.094252+0000","last_fullsized":"2024-09-12T01:57:54.094252+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091889+0000","last_change":"2024-09-12T01:57:54.091889+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091889+0000","last_undegraded":"2024-09-12T01:57:54.091889+0000","last_fullsized":"2024-09-12T01:57:54.091889+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.094239+0000","last_change":"2024-09-12T01:57:54.094239+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.094239+0000","last_undegraded":"2024-09-12T01:57:54.094239+0000","last_fullsized":"2024-09-12T01:57:54.094239+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.100535+0000","last_change":"2024-09-12T01:57:54.099411+0000","last_active":"2024-09-12T01:57:54.100535+0000","last_peered":"2024-09-12T01:57:54.100535+0000","last_clean":"2024-09-12T01:57:54.100535+0000","last_became_active":"2024-09-12T01:57:54.099087+0000","last_became_peered":"2024-09-12T01:57:54.099087+0000","last_unstale":"2024-09-12T01:57:54.100535+0000","last_undegraded":"2024-09-12T01:57:54.100535+0000","last_fullsized":"2024-09-12T01:57:54.100535+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:44.513454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.092378+0000","last_change":"2024-09-12T01:57:54.092378+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.092378+0000","last_undegraded":"2024-09-12T01:57:54.092378+0000","last_fullsized":"2024-09-12T01:57:54.092378+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092999+0000","last_change":"2024-09-12T01:57:53.092999+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092999+0000","last_undegraded":"2024-09-12T01:57:53.092999+0000","last_fullsized":"2024-09-12T01:57:53.092999+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.090402+0000","last_change":"2024-09-12T01:57:54.090402+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.090402+0000","last_undegraded":"2024-09-12T01:57:54.090402+0000","last_fullsized":"2024-09-12T01:57:54.090402+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092925+0000","last_change":"2024-09-12T01:57:53.092925+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092925+0000","last_undegraded":"2024-09-12T01:57:53.092925+0000","last_fullsized":"2024-09-12T01:57:53.092925+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.104257+0000","last_change":"2024-09-12T01:57:54.102087+0000","last_active":"2024-09-12T01:57:54.104257+0000","last_peered":"2024-09-12T01:57:54.104257+0000","last_clean":"2024-09-12T01:57:54.104257+0000","last_became_active":"2024-09-12T01:57:54.101812+0000","last_became_peered":"2024-09-12T01:57:54.101812+0000","last_unstale":"2024-09-12T01:57:54.104257+0000","last_undegraded":"2024-09-12T01:57:54.104257+0000","last_fullsized":"2024-09-12T01:57:54.104257+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:57.124282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678046+0000","last_change":"2024-09-12T01:57:55.119789+0000","last_active":"2024-09-12T01:57:56.678046+0000","last_peered":"2024-09-12T01:57:56.678046+0000","last_clean":"2024-09-12T01:57:56.678046+0000","last_became_active":"2024-09-12T01:57:55.119517+0000","last_became_peered":"2024-09-12T01:57:55.119517+0000","last_unstale":"2024-09-12T01:57:56.678046+0000","last_undegraded":"2024-09-12T01:57:56.678046+0000","last_fullsized":"2024-09-12T01:57:56.678046+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:22.674136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092146+0000","last_change":"2024-09-12T01:57:53.092146+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092146+0000","last_undegraded":"2024-09-12T01:57:53.092146+0000","last_fullsized":"2024-09-12T01:57:53.092146+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.095015+0000","last_change":"2024-09-12T01:57:54.095015+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.095015+0000","last_undegraded":"2024-09-12T01:57:54.095015+0000","last_fullsized":"2024-09-12T01:57:54.095015+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677687+0000","last_change":"2024-09-12T01:57:54.099653+0000","last_active":"2024-09-12T01:57:56.677687+0000","last_peered":"2024-09-12T01:57:56.677687+0000","last_clean":"2024-09-12T01:57:56.677687+0000","last_became_active":"2024-09-12T01:57:54.099411+0000","last_became_peered":"2024-09-12T01:57:54.099411+0000","last_unstale":"2024-09-12T01:57:56.677687+0000","last_undegraded":"2024-09-12T01:57:56.677687+0000","last_fullsized":"2024-09-12T01:57:56.677687+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:54.567633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.105446+0000","last_change":"2024-09-12T01:57:54.103416+0000","last_active":"2024-09-12T01:57:54.105446+0000","last_peered":"2024-09-12T01:57:54.105446+0000","last_clean":"2024-09-12T01:57:54.105446+0000","last_became_active":"2024-09-12T01:57:54.103089+0000","last_became_peered":"2024-09-12T01:57:54.103089+0000","last_unstale":"2024-09-12T01:57:54.105446+0000","last_undegraded":"2024-09-12T01:57:54.105446+0000","last_fullsized":"2024-09-12T01:57:54.105446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:33.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.096539+0000","last_change":"2024-09-12T01:57:54.096539+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.096539+0000","last_undegraded":"2024-09-12T01:57:54.096539+0000","last_fullsized":"2024-09-12T01:57:54.096539+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092260+0000","last_change":"2024-09-12T01:57:53.092260+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092260+0000","last_undegraded":"2024-09-12T01:57:53.092260+0000","last_fullsized":"2024-09-12T01:57:53.092260+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677710+0000","last_change":"2024-09-12T01:57:55.118509+0000","last_active":"2024-09-12T01:57:56.677710+0000","last_peered":"2024-09-12T01:57:56.677710+0000","last_clean":"2024-09-12T01:57:56.677710+0000","last_became_active":"2024-09-12T01:57:55.118172+0000","last_became_peered":"2024-09-12T01:57:55.118172+0000","last_unstale":"2024-09-12T01:57:56.677710+0000","last_undegraded":"2024-09-12T01:57:56.677710+0000","last_fullsized":"2024-09-12T01:57:56.677710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:55.332410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.105942+0000","last_change":"2024-09-12T01:57:54.104891+0000","last_active":"2024-09-12T01:57:54.105942+0000","last_peered":"2024-09-12T01:57:54.105942+0000","last_clean":"2024-09-12T01:57:54.105942+0000","last_became_active":"2024-09-12T01:57:54.104595+0000","last_became_peered":"2024-09-12T01:57:54.104595+0000","last_unstale":"2024-09-12T01:57:54.105942+0000","last_undegraded":"2024-09-12T01:57:54.105942+0000","last_fullsized":"2024-09-12T01:57:54.105942+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:55.138013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.092841+0000","last_change":"2024-09-12T01:57:54.092841+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.092841+0000","last_undegraded":"2024-09-12T01:57:54.092841+0000","last_fullsized":"2024-09-12T01:57:54.092841+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678055+0000","last_change":"2024-09-12T01:57:54.111175+0000","last_active":"2024-09-12T01:57:56.678055+0000","last_peered":"2024-09-12T01:57:56.678055+0000","last_clean":"2024-09-12T01:57:56.678055+0000","last_became_active":"2024-09-12T01:57:54.110900+0000","last_became_peered":"2024-09-12T01:57:54.110900+0000","last_unstale":"2024-09-12T01:57:56.678055+0000","last_undegraded":"2024-09-12T01:57:56.678055+0000","last_fullsized":"2024-09-12T01:57:56.678055+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:01.720274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.108836+0000","last_change":"2024-09-12T01:57:54.107407+0000","last_active":"2024-09-12T01:57:54.108836+0000","last_peered":"2024-09-12T01:57:54.108836+0000","last_clean":"2024-09-12T01:57:54.108836+0000","last_became_active":"2024-09-12T01:57:54.107149+0000","last_became_peered":"2024-09-12T01:57:54.107149+0000","last_unstale":"2024-09-12T01:57:54.108836+0000","last_undegraded":"2024-09-12T01:57:54.108836+0000","last_fullsized":"2024-09-12T01:57:54.108836+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:04.470684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678003+0000","last_change":"2024-09-12T01:57:55.113826+0000","last_active":"2024-09-12T01:57:56.678003+0000","last_peered":"2024-09-12T01:57:56.678003+0000","last_clean":"2024-09-12T01:57:56.678003+0000","last_became_active":"2024-09-12T01:57:55.113488+0000","last_became_peered":"2024-09-12T01:57:55.113488+0000","last_unstale":"2024-09-12T01:57:56.678003+0000","last_undegraded":"2024-09-12T01:57:56.678003+0000","last_fullsized":"2024-09-12T01:57:56.678003+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:14.826705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091785+0000","last_change":"2024-09-12T01:57:53.091785+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091785+0000","last_undegraded":"2024-09-12T01:57:53.091785+0000","last_fullsized":"2024-09-12T01:57:53.091785+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091534+0000","last_change":"2024-09-12T01:57:54.091534+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091534+0000","last_undegraded":"2024-09-12T01:57:54.091534+0000","last_fullsized":"2024-09-12T01:57:54.091534+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091646+0000","last_change":"2024-09-12T01:57:53.091646+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091646+0000","last_undegraded":"2024-09-12T01:57:53.091646+0000","last_fullsized":"2024-09-12T01:57:53.091646+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.107135+0000","last_change":"2024-09-12T01:57:54.106202+0000","last_active":"2024-09-12T01:57:54.107135+0000","last_peered":"2024-09-12T01:57:54.107135+0000","last_clean":"2024-09-12T01:57:54.107135+0000","last_became_active":"2024-09-12T01:57:54.105898+0000","last_became_peered":"2024-09-12T01:57:54.105898+0000","last_unstale":"2024-09-12T01:57:54.107135+0000","last_undegraded":"2024-09-12T01:57:54.107135+0000","last_fullsized":"2024-09-12T01:57:54.107135+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:37.565639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.105954+0000","last_change":"2024-09-12T01:57:54.104923+0000","last_active":"2024-09-12T01:57:54.105954+0000","last_peered":"2024-09-12T01:57:54.105954+0000","last_clean":"2024-09-12T01:57:54.105954+0000","last_became_active":"2024-09-12T01:57:54.104376+0000","last_became_peered":"2024-09-12T01:57:54.104376+0000","last_unstale":"2024-09-12T01:57:54.105954+0000","last_undegraded":"2024-09-12T01:57:54.105954+0000","last_fullsized":"2024-09-12T01:57:54.105954+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:54.961365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091523+0000","last_change":"2024-09-12T01:57:53.091523+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091523+0000","last_undegraded":"2024-09-12T01:57:53.091523+0000","last_fullsized":"2024-09-12T01:57:53.091523+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.094626+0000","last_change":"2024-09-12T01:57:53.094626+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.094626+0000","last_undegraded":"2024-09-12T01:57:53.094626+0000","last_fullsized":"2024-09-12T01:57:53.094626+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.089521+0000","last_change":"2024-09-12T01:57:53.089521+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.089521+0000","last_undegraded":"2024-09-12T01:57:53.089521+0000","last_fullsized":"2024-09-12T01:57:53.089521+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677708+0000","last_change":"2024-09-12T01:57:55.127378+0000","last_active":"2024-09-12T01:57:56.677708+0000","last_peered":"2024-09-12T01:57:56.677708+0000","last_clean":"2024-09-12T01:57:56.677708+0000","last_became_active":"2024-09-12T01:57:55.127170+0000","last_became_peered":"2024-09-12T01:57:55.127170+0000","last_unstale":"2024-09-12T01:57:56.677708+0000","last_undegraded":"2024-09-12T01:57:56.677708+0000","last_fullsized":"2024-09-12T01:57:56.677708+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:53.385927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.107907+0000","last_change":"2024-09-12T01:57:54.106589+0000","last_active":"2024-09-12T01:57:54.107907+0000","last_peered":"2024-09-12T01:57:54.107907+0000","last_clean":"2024-09-12T01:57:54.107907+0000","last_became_active":"2024-09-12T01:57:54.106261+0000","last_became_peered":"2024-09-12T01:57:54.106261+0000","last_unstale":"2024-09-12T01:57:54.107907+0000","last_undegraded":"2024-09-12T01:57:54.107907+0000","last_fullsized":"2024-09-12T01:57:54.107907+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:31.979861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.103092+0000","last_change":"2024-09-12T01:57:54.101095+0000","last_active":"2024-09-12T01:57:54.103092+0000","last_peered":"2024-09-12T01:57:54.103092+0000","last_clean":"2024-09-12T01:57:54.103092+0000","last_became_active":"2024-09-12T01:57:54.100822+0000","last_became_peered":"2024-09-12T01:57:54.100822+0000","last_unstale":"2024-09-12T01:57:54.103092+0000","last_undegraded":"2024-09-12T01:57:54.103092+0000","last_fullsized":"2024-09-12T01:57:54.103092+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:59.910848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091074+0000","last_change":"2024-09-12T01:57:54.091074+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091074+0000","last_undegraded":"2024-09-12T01:57:54.091074+0000","last_fullsized":"2024-09-12T01:57:54.091074+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092130+0000","last_change":"2024-09-12T01:57:53.092130+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092130+0000","last_undegraded":"2024-09-12T01:57:53.092130+0000","last_fullsized":"2024-09-12T01:57:53.092130+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.092693+0000","last_change":"2024-09-12T01:57:54.092693+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.092693+0000","last_undegraded":"2024-09-12T01:57:54.092693+0000","last_fullsized":"2024-09-12T01:57:54.092693+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092974+0000","last_change":"2024-09-12T01:57:53.092974+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092974+0000","last_undegraded":"2024-09-12T01:57:53.092974+0000","last_fullsized":"2024-09-12T01:57:53.092974+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092426+0000","last_change":"2024-09-12T01:57:53.092426+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092426+0000","last_undegraded":"2024-09-12T01:57:53.092426+0000","last_fullsized":"2024-09-12T01:57:53.092426+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.089523+0000","last_change":"2024-09-12T01:57:53.089523+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.089523+0000","last_undegraded":"2024-09-12T01:57:53.089523+0000","last_fullsized":"2024-09-12T01:57:53.089523+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091461+0000","last_change":"2024-09-12T01:57:54.091461+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091461+0000","last_undegraded":"2024-09-12T01:57:54.091461+0000","last_fullsized":"2024-09-12T01:57:54.091461+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.107157+0000","last_change":"2024-09-12T01:57:54.106206+0000","last_active":"2024-09-12T01:57:54.107157+0000","last_peered":"2024-09-12T01:57:54.107157+0000","last_clean":"2024-09-12T01:57:54.107157+0000","last_became_active":"2024-09-12T01:57:54.105890+0000","last_became_peered":"2024-09-12T01:57:54.105890+0000","last_unstale":"2024-09-12T01:57:54.107157+0000","last_undegraded":"2024-09-12T01:57:54.107157+0000","last_fullsized":"2024-09-12T01:57:54.107157+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:54.271270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.107746+0000","last_change":"2024-09-12T01:57:54.106811+0000","last_active":"2024-09-12T01:57:54.107746+0000","last_peered":"2024-09-12T01:57:54.107746+0000","last_clean":"2024-09-12T01:57:54.107746+0000","last_became_active":"2024-09-12T01:57:54.106499+0000","last_became_peered":"2024-09-12T01:57:54.106499+0000","last_unstale":"2024-09-12T01:57:54.107746+0000","last_undegraded":"2024-09-12T01:57:54.107746+0000","last_fullsized":"2024-09-12T01:57:54.107746+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:12.616086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.095103+0000","last_change":"2024-09-12T01:57:53.095103+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.095103+0000","last_undegraded":"2024-09-12T01:57:53.095103+0000","last_fullsized":"2024-09-12T01:57:53.095103+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091478+0000","last_change":"2024-09-12T01:57:53.091478+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091478+0000","last_undegraded":"2024-09-12T01:57:53.091478+0000","last_fullsized":"2024-09-12T01:57:53.091478+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.092168+0000","last_change":"2024-09-12T01:57:54.092168+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.092168+0000","last_undegraded":"2024-09-12T01:57:54.092168+0000","last_fullsized":"2024-09-12T01:57:54.092168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091966+0000","last_change":"2024-09-12T01:57:53.091966+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091966+0000","last_undegraded":"2024-09-12T01:57:53.091966+0000","last_fullsized":"2024-09-12T01:57:53.091966+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677686+0000","last_change":"2024-09-12T01:57:54.101888+0000","last_active":"2024-09-12T01:57:56.677686+0000","last_peered":"2024-09-12T01:57:56.677686+0000","last_clean":"2024-09-12T01:57:56.677686+0000","last_became_active":"2024-09-12T01:57:54.101626+0000","last_became_peered":"2024-09-12T01:57:54.101626+0000","last_unstale":"2024-09-12T01:57:56.677686+0000","last_undegraded":"2024-09-12T01:57:56.677686+0000","last_fullsized":"2024-09-12T01:57:56.677686+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:00.857513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.104202+0000","last_change":"2024-09-12T01:57:54.101287+0000","last_active":"2024-09-12T01:57:54.104202+0000","last_peered":"2024-09-12T01:57:54.104202+0000","last_clean":"2024-09-12T01:57:54.104202+0000","last_became_active":"2024-09-12T01:57:54.101005+0000","last_became_peered":"2024-09-12T01:57:54.101005+0000","last_unstale":"2024-09-12T01:57:54.104202+0000","last_undegraded":"2024-09-12T01:57:54.104202+0000","last_fullsized":"2024-09-12T01:57:54.104202+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:55.997442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.090384+0000","last_change":"2024-09-12T01:57:54.090384+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.090384+0000","last_undegraded":"2024-09-12T01:57:54.090384+0000","last_fullsized":"2024-09-12T01:57:54.090384+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.095386+0000","last_change":"2024-09-12T01:57:53.095386+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.095386+0000","last_undegraded":"2024-09-12T01:57:53.095386+0000","last_fullsized":"2024-09-12T01:57:53.095386+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":227,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.097536+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:57:54.097536+0000","last_peered":"2024-09-12T01:57:54.097536+0000","last_clean":"2024-09-12T01:57:54.097536+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:57:54.097536+0000","last_undegraded":"2024-09-12T01:57:54.097536+0000","last_fullsized":"2024-09-12T01:57:54.097536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1191936,"data_stored":854869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":598016,"data_stored":264501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":598016,"data_stored":264501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542174,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":598016,"data_stored":264501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":258292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":585728,"data_stored":258292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542174,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1179648,"data_stored":848660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":285609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:57:58.803 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3f is not active+clean 2024-09-12T01:57:58.803 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.803 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3e is not active+clean 2024-09-12T01:57:58.803 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.095167+0000', 'last_change': '2024-09-12T01:57:54.095167+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.095167+0000', 'last_undegraded': '2024-09-12T01:57:54.095167+0000', 'last_fullsized': '2024-09-12T01:57:54.095167+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:57:58.803 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3d is not active+clean 2024-09-12T01:57:58.804 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.804 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3c is not active+clean 2024-09-12T01:57:58.804 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.094597+0000', 'last_change': '2024-09-12T01:57:54.094597+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.094597+0000', 'last_undegraded': '2024-09-12T01:57:54.094597+0000', 'last_fullsized': '2024-09-12T01:57:54.094597+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:57:58.804 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3a is not active+clean 2024-09-12T01:57:58.804 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.804 INFO:tasks.ceph.ceph_manager.ceph:PG 8.39 is not active+clean 2024-09-12T01:57:58.804 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.804 INFO:tasks.ceph.ceph_manager.ceph:PG 8.38 is not active+clean 2024-09-12T01:57:58.804 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.804 INFO:tasks.ceph.ceph_manager.ceph:PG 8.37 is not active+clean 2024-09-12T01:57:58.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.805 INFO:tasks.ceph.ceph_manager.ceph:PG 8.36 is not active+clean 2024-09-12T01:57:58.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.805 INFO:tasks.ceph.ceph_manager.ceph:PG 8.35 is not active+clean 2024-09-12T01:57:58.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.805 INFO:tasks.ceph.ceph_manager.ceph:PG 8.34 is not active+clean 2024-09-12T01:57:58.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.805 INFO:tasks.ceph.ceph_manager.ceph:PG 8.33 is not active+clean 2024-09-12T01:57:58.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.805 INFO:tasks.ceph.ceph_manager.ceph:PG 8.32 is not active+clean 2024-09-12T01:57:58.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.806 INFO:tasks.ceph.ceph_manager.ceph:PG 8.31 is not active+clean 2024-09-12T01:57:58.806 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.095097+0000', 'last_change': '2024-09-12T01:57:54.095097+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.095097+0000', 'last_undegraded': '2024-09-12T01:57:54.095097+0000', 'last_fullsized': '2024-09-12T01:57:54.095097+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:57:58.806 INFO:tasks.ceph.ceph_manager.ceph:PG 8.30 is not active+clean 2024-09-12T01:57:58.806 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.806 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2f is not active+clean 2024-09-12T01:57:58.806 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.806 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2e is not active+clean 2024-09-12T01:57:58.806 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.094741+0000', 'last_change': '2024-09-12T01:57:54.094741+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.094741+0000', 'last_undegraded': '2024-09-12T01:57:54.094741+0000', 'last_fullsized': '2024-09-12T01:57:54.094741+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:57:58.806 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2d is not active+clean 2024-09-12T01:57:58.806 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.806 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2c is not active+clean 2024-09-12T01:57:58.807 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.091834+0000', 'last_change': '2024-09-12T01:57:54.091834+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.091834+0000', 'last_undegraded': '2024-09-12T01:57:54.091834+0000', 'last_fullsized': '2024-09-12T01:57:54.091834+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:57:58.807 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2b is not active+clean 2024-09-12T01:57:58.807 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.090692+0000', 'last_change': '2024-09-12T01:57:54.090692+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.090692+0000', 'last_undegraded': '2024-09-12T01:57:54.090692+0000', 'last_fullsized': '2024-09-12T01:57:54.090692+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:57:58.807 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2a is not active+clean 2024-09-12T01:57:58.807 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.807 INFO:tasks.ceph.ceph_manager.ceph:PG 8.29 is not active+clean 2024-09-12T01:57:58.807 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.807 INFO:tasks.ceph.ceph_manager.ceph:PG 8.28 is not active+clean 2024-09-12T01:57:58.807 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.807 INFO:tasks.ceph.ceph_manager.ceph:PG 8.27 is not active+clean 2024-09-12T01:57:58.807 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.808 INFO:tasks.ceph.ceph_manager.ceph:PG 8.26 is not active+clean 2024-09-12T01:57:58.808 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.808 INFO:tasks.ceph.ceph_manager.ceph:PG 8.25 is not active+clean 2024-09-12T01:57:58.808 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.808 INFO:tasks.ceph.ceph_manager.ceph:PG 8.24 is not active+clean 2024-09-12T01:57:58.808 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.091405+0000', 'last_change': '2024-09-12T01:57:54.091405+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.091405+0000', 'last_undegraded': '2024-09-12T01:57:54.091405+0000', 'last_fullsized': '2024-09-12T01:57:54.091405+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:57:58.808 INFO:tasks.ceph.ceph_manager.ceph:PG 8.23 is not active+clean 2024-09-12T01:57:58.808 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.808 INFO:tasks.ceph.ceph_manager.ceph:PG 8.22 is not active+clean 2024-09-12T01:57:58.808 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.094252+0000', 'last_change': '2024-09-12T01:57:54.094252+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.094252+0000', 'last_undegraded': '2024-09-12T01:57:54.094252+0000', 'last_fullsized': '2024-09-12T01:57:54.094252+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:57:58.808 INFO:tasks.ceph.ceph_manager.ceph:PG 8.21 is not active+clean 2024-09-12T01:57:58.809 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.809 INFO:tasks.ceph.ceph_manager.ceph:PG 8.20 is not active+clean 2024-09-12T01:57:58.809 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.091889+0000', 'last_change': '2024-09-12T01:57:54.091889+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.091889+0000', 'last_undegraded': '2024-09-12T01:57:54.091889+0000', 'last_fullsized': '2024-09-12T01:57:54.091889+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:57:58.809 INFO:tasks.ceph.ceph_manager.ceph:PG 8.10 is not active+clean 2024-09-12T01:57:58.809 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.094239+0000', 'last_change': '2024-09-12T01:57:54.094239+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.094239+0000', 'last_undegraded': '2024-09-12T01:57:54.094239+0000', 'last_fullsized': '2024-09-12T01:57:54.094239+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:57:58.809 INFO:tasks.ceph.ceph_manager.ceph:PG 8.11 is not active+clean 2024-09-12T01:57:58.809 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.092378+0000', 'last_change': '2024-09-12T01:57:54.092378+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.092378+0000', 'last_undegraded': '2024-09-12T01:57:54.092378+0000', 'last_fullsized': '2024-09-12T01:57:54.092378+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:57:58.809 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1e is not active+clean 2024-09-12T01:57:58.809 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:53.092999+0000', 'last_change': '2024-09-12T01:57:53.092999+0000', 'last_active': '2024-09-12T01:57:53.080263+0000', 'last_peered': '2024-09-12T01:57:53.080263+0000', 'last_clean': '2024-09-12T01:57:53.080263+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:53.092999+0000', 'last_undegraded': '2024-09-12T01:57:53.092999+0000', 'last_fullsized': '2024-09-12T01:57:53.092999+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:57:58.809 INFO:tasks.ceph.ceph_manager.ceph:PG 8.12 is not active+clean 2024-09-12T01:57:58.809 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.090402+0000', 'last_change': '2024-09-12T01:57:54.090402+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.090402+0000', 'last_undegraded': '2024-09-12T01:57:54.090402+0000', 'last_fullsized': '2024-09-12T01:57:54.090402+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:57:58.810 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1d is not active+clean 2024-09-12T01:57:58.810 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:53.092925+0000', 'last_change': '2024-09-12T01:57:53.092925+0000', 'last_active': '2024-09-12T01:57:53.080263+0000', 'last_peered': '2024-09-12T01:57:53.080263+0000', 'last_clean': '2024-09-12T01:57:53.080263+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:53.092925+0000', 'last_undegraded': '2024-09-12T01:57:53.092925+0000', 'last_fullsized': '2024-09-12T01:57:53.092925+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:57:58.810 INFO:tasks.ceph.ceph_manager.ceph:PG 8.13 is not active+clean 2024-09-12T01:57:58.810 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.810 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1b is not active+clean 2024-09-12T01:57:58.810 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:53.092146+0000', 'last_change': '2024-09-12T01:57:53.092146+0000', 'last_active': '2024-09-12T01:57:53.080263+0000', 'last_peered': '2024-09-12T01:57:53.080263+0000', 'last_clean': '2024-09-12T01:57:53.080263+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:53.092146+0000', 'last_undegraded': '2024-09-12T01:57:53.092146+0000', 'last_fullsized': '2024-09-12T01:57:53.092146+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:57:58.810 INFO:tasks.ceph.ceph_manager.ceph:PG 8.15 is not active+clean 2024-09-12T01:57:58.810 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.095015+0000', 'last_change': '2024-09-12T01:57:54.095015+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.095015+0000', 'last_undegraded': '2024-09-12T01:57:54.095015+0000', 'last_fullsized': '2024-09-12T01:57:54.095015+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:57:58.810 INFO:tasks.ceph.ceph_manager.ceph:PG 8.16 is not active+clean 2024-09-12T01:57:58.810 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.810 INFO:tasks.ceph.ceph_manager.ceph:PG 8.17 is not active+clean 2024-09-12T01:57:58.810 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.096539+0000', 'last_change': '2024-09-12T01:57:54.096539+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.096539+0000', 'last_undegraded': '2024-09-12T01:57:54.096539+0000', 'last_fullsized': '2024-09-12T01:57:54.096539+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:57:58.811 INFO:tasks.ceph.ceph_manager.ceph:PG 7.18 is not active+clean 2024-09-12T01:57:58.811 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:53.092260+0000', 'last_change': '2024-09-12T01:57:53.092260+0000', 'last_active': '2024-09-12T01:57:53.080263+0000', 'last_peered': '2024-09-12T01:57:53.080263+0000', 'last_clean': '2024-09-12T01:57:53.080263+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:53.092260+0000', 'last_undegraded': '2024-09-12T01:57:53.092260+0000', 'last_fullsized': '2024-09-12T01:57:53.092260+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:57:58.811 INFO:tasks.ceph.ceph_manager.ceph:PG 8.19 is not active+clean 2024-09-12T01:57:58.811 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.092841+0000', 'last_change': '2024-09-12T01:57:54.092841+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.092841+0000', 'last_undegraded': '2024-09-12T01:57:54.092841+0000', 'last_fullsized': '2024-09-12T01:57:54.092841+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:57:58.811 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1a is not active+clean 2024-09-12T01:57:58.811 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.811 INFO:tasks.ceph.ceph_manager.ceph:PG 7.14 is not active+clean 2024-09-12T01:57:58.811 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:53.091785+0000', 'last_change': '2024-09-12T01:57:53.091785+0000', 'last_active': '2024-09-12T01:57:53.080263+0000', 'last_peered': '2024-09-12T01:57:53.080263+0000', 'last_clean': '2024-09-12T01:57:53.080263+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:53.091785+0000', 'last_undegraded': '2024-09-12T01:57:53.091785+0000', 'last_fullsized': '2024-09-12T01:57:53.091785+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:57:58.811 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1c is not active+clean 2024-09-12T01:57:58.811 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.091534+0000', 'last_change': '2024-09-12T01:57:54.091534+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.091534+0000', 'last_undegraded': '2024-09-12T01:57:54.091534+0000', 'last_fullsized': '2024-09-12T01:57:54.091534+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:57:58.811 INFO:tasks.ceph.ceph_manager.ceph:PG 7.13 is not active+clean 2024-09-12T01:57:58.812 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:53.091646+0000', 'last_change': '2024-09-12T01:57:53.091646+0000', 'last_active': '2024-09-12T01:57:53.080263+0000', 'last_peered': '2024-09-12T01:57:53.080263+0000', 'last_clean': '2024-09-12T01:57:53.080263+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:53.091646+0000', 'last_undegraded': '2024-09-12T01:57:53.091646+0000', 'last_fullsized': '2024-09-12T01:57:53.091646+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:57:58.812 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1d is not active+clean 2024-09-12T01:57:58.812 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.812 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1e is not active+clean 2024-09-12T01:57:58.812 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.812 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1f is not active+clean 2024-09-12T01:57:58.812 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.812 INFO:tasks.ceph.ceph_manager.ceph:PG 7.10 is not active+clean 2024-09-12T01:57:58.812 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:53.091523+0000', 'last_change': '2024-09-12T01:57:53.091523+0000', 'last_active': '2024-09-12T01:57:53.080263+0000', 'last_peered': '2024-09-12T01:57:53.080263+0000', 'last_clean': '2024-09-12T01:57:53.080263+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:53.091523+0000', 'last_undegraded': '2024-09-12T01:57:53.091523+0000', 'last_fullsized': '2024-09-12T01:57:53.091523+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:57:58.812 INFO:tasks.ceph.ceph_manager.ceph:PG 8.0 is not active+clean 2024-09-12T01:57:58.812 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.813 INFO:tasks.ceph.ceph_manager.ceph:PG 7.f is not active+clean 2024-09-12T01:57:58.813 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:53.094626+0000', 'last_change': '2024-09-12T01:57:53.094626+0000', 'last_active': '2024-09-12T01:57:53.080263+0000', 'last_peered': '2024-09-12T01:57:53.080263+0000', 'last_clean': '2024-09-12T01:57:53.080263+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:53.094626+0000', 'last_undegraded': '2024-09-12T01:57:53.094626+0000', 'last_fullsized': '2024-09-12T01:57:53.094626+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:57:58.813 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1 is not active+clean 2024-09-12T01:57:58.813 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.813 INFO:tasks.ceph.ceph_manager.ceph:PG 7.e is not active+clean 2024-09-12T01:57:58.813 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:53.089521+0000', 'last_change': '2024-09-12T01:57:53.089521+0000', 'last_active': '2024-09-12T01:57:53.080263+0000', 'last_peered': '2024-09-12T01:57:53.080263+0000', 'last_clean': '2024-09-12T01:57:53.080263+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:53.089521+0000', 'last_undegraded': '2024-09-12T01:57:53.089521+0000', 'last_fullsized': '2024-09-12T01:57:53.089521+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:57:58.813 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3 is not active+clean 2024-09-12T01:57:58.813 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.813 INFO:tasks.ceph.ceph_manager.ceph:PG 8.4 is not active+clean 2024-09-12T01:57:58.813 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.091074+0000', 'last_change': '2024-09-12T01:57:54.091074+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.091074+0000', 'last_undegraded': '2024-09-12T01:57:54.091074+0000', 'last_fullsized': '2024-09-12T01:57:54.091074+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:57:58.813 INFO:tasks.ceph.ceph_manager.ceph:PG 7.b is not active+clean 2024-09-12T01:57:58.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:53.092130+0000', 'last_change': '2024-09-12T01:57:53.092130+0000', 'last_active': '2024-09-12T01:57:53.080263+0000', 'last_peered': '2024-09-12T01:57:53.080263+0000', 'last_clean': '2024-09-12T01:57:53.080263+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:53.092130+0000', 'last_undegraded': '2024-09-12T01:57:53.092130+0000', 'last_fullsized': '2024-09-12T01:57:53.092130+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:57:58.814 INFO:tasks.ceph.ceph_manager.ceph:PG 8.5 is not active+clean 2024-09-12T01:57:58.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.092693+0000', 'last_change': '2024-09-12T01:57:54.092693+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.092693+0000', 'last_undegraded': '2024-09-12T01:57:54.092693+0000', 'last_fullsized': '2024-09-12T01:57:54.092693+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:57:58.814 INFO:tasks.ceph.ceph_manager.ceph:PG 7.a is not active+clean 2024-09-12T01:57:58.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:53.092974+0000', 'last_change': '2024-09-12T01:57:53.092974+0000', 'last_active': '2024-09-12T01:57:53.080263+0000', 'last_peered': '2024-09-12T01:57:53.080263+0000', 'last_clean': '2024-09-12T01:57:53.080263+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:53.092974+0000', 'last_undegraded': '2024-09-12T01:57:53.092974+0000', 'last_fullsized': '2024-09-12T01:57:53.092974+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:57:58.814 INFO:tasks.ceph.ceph_manager.ceph:PG 8.6 is not active+clean 2024-09-12T01:57:58.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.814 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-09-12T01:57:58.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:53.092426+0000', 'last_change': '2024-09-12T01:57:53.092426+0000', 'last_active': '2024-09-12T01:57:53.080263+0000', 'last_peered': '2024-09-12T01:57:53.080263+0000', 'last_clean': '2024-09-12T01:57:53.080263+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:53.092426+0000', 'last_undegraded': '2024-09-12T01:57:53.092426+0000', 'last_fullsized': '2024-09-12T01:57:53.092426+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:57:58.814 INFO:tasks.ceph.ceph_manager.ceph:PG 8.7 is not active+clean 2024-09-12T01:57:58.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.815 INFO:tasks.ceph.ceph_manager.ceph:PG 7.8 is not active+clean 2024-09-12T01:57:58.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:53.089523+0000', 'last_change': '2024-09-12T01:57:53.089523+0000', 'last_active': '2024-09-12T01:57:53.080263+0000', 'last_peered': '2024-09-12T01:57:53.080263+0000', 'last_clean': '2024-09-12T01:57:53.080263+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:53.089523+0000', 'last_undegraded': '2024-09-12T01:57:53.089523+0000', 'last_fullsized': '2024-09-12T01:57:53.089523+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:57:58.815 INFO:tasks.ceph.ceph_manager.ceph:PG 8.8 is not active+clean 2024-09-12T01:57:58.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.091461+0000', 'last_change': '2024-09-12T01:57:54.091461+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.091461+0000', 'last_undegraded': '2024-09-12T01:57:54.091461+0000', 'last_fullsized': '2024-09-12T01:57:54.091461+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:57:58.815 INFO:tasks.ceph.ceph_manager.ceph:PG 8.a is not active+clean 2024-09-12T01:57:58.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.815 INFO:tasks.ceph.ceph_manager.ceph:PG 8.b is not active+clean 2024-09-12T01:57:58.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.815 INFO:tasks.ceph.ceph_manager.ceph:PG 7.4 is not active+clean 2024-09-12T01:57:58.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:53.095103+0000', 'last_change': '2024-09-12T01:57:53.095103+0000', 'last_active': '2024-09-12T01:57:53.080263+0000', 'last_peered': '2024-09-12T01:57:53.080263+0000', 'last_clean': '2024-09-12T01:57:53.080263+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:53.095103+0000', 'last_undegraded': '2024-09-12T01:57:53.095103+0000', 'last_fullsized': '2024-09-12T01:57:53.095103+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:57:58.815 INFO:tasks.ceph.ceph_manager.ceph:PG 8.c is not active+clean 2024-09-12T01:57:58.816 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.816 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3 is not active+clean 2024-09-12T01:57:58.816 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:53.091478+0000', 'last_change': '2024-09-12T01:57:53.091478+0000', 'last_active': '2024-09-12T01:57:53.080263+0000', 'last_peered': '2024-09-12T01:57:53.080263+0000', 'last_clean': '2024-09-12T01:57:53.080263+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:53.091478+0000', 'last_undegraded': '2024-09-12T01:57:53.091478+0000', 'last_fullsized': '2024-09-12T01:57:53.091478+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:57:58.816 INFO:tasks.ceph.ceph_manager.ceph:PG 8.d is not active+clean 2024-09-12T01:57:58.816 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.092168+0000', 'last_change': '2024-09-12T01:57:54.092168+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.092168+0000', 'last_undegraded': '2024-09-12T01:57:54.092168+0000', 'last_fullsized': '2024-09-12T01:57:54.092168+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:57:58.816 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2 is not active+clean 2024-09-12T01:57:58.816 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:53.091966+0000', 'last_change': '2024-09-12T01:57:53.091966+0000', 'last_active': '2024-09-12T01:57:53.080263+0000', 'last_peered': '2024-09-12T01:57:53.080263+0000', 'last_clean': '2024-09-12T01:57:53.080263+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:53.091966+0000', 'last_undegraded': '2024-09-12T01:57:53.091966+0000', 'last_fullsized': '2024-09-12T01:57:53.091966+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:57:58.816 INFO:tasks.ceph.ceph_manager.ceph:PG 8.e is not active+clean 2024-09-12T01:57:58.816 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.816 INFO:tasks.ceph.ceph_manager.ceph:PG 8.f is not active+clean 2024-09-12T01:57:58.816 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:57:54.084725+0000', 'last_change': '2024-09-12T01:57:54.084725+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.084725+0000', 'last_undegraded': '2024-09-12T01:57:54.084725+0000', 'last_fullsized': '2024-09-12T01:57:54.084725+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:57:58.817 INFO:tasks.ceph.ceph_manager.ceph:PG 8.9 is not active+clean 2024-09-12T01:57:58.817 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:54.090384+0000', 'last_change': '2024-09-12T01:57:54.090384+0000', 'last_active': '2024-09-12T01:57:54.084725+0000', 'last_peered': '2024-09-12T01:57:54.084725+0000', 'last_clean': '2024-09-12T01:57:54.084725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:54.090384+0000', 'last_undegraded': '2024-09-12T01:57:54.090384+0000', 'last_fullsized': '2024-09-12T01:57:54.090384+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:54.084725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:57:58.817 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-09-12T01:57:58.817 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:57:53.095386+0000', 'last_change': '2024-09-12T01:57:53.095386+0000', 'last_active': '2024-09-12T01:57:53.080263+0000', 'last_peered': '2024-09-12T01:57:53.080263+0000', 'last_clean': '2024-09-12T01:57:53.080263+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:57:53.095386+0000', 'last_undegraded': '2024-09-12T01:57:53.095386+0000', 'last_fullsized': '2024-09-12T01:57:53.095386+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'last_clean_scrub_stamp': '2024-09-12T01:57:53.080263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:57:58.817 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T01:57:58.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.941+0000 7f6214cac640 1 Processor -- start 2024-09-12T01:57:58.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.941+0000 7f6214cac640 1 -- start start 2024-09-12T01:57:58.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.942+0000 7f6214cac640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f621006dbd0 0x7f621009b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.942+0000 7f6214cac640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62100d1970 con 0x7f621015e740 2024-09-12T01:57:58.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.942+0000 7f6214cac640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62100d0780 con 0x7f62100d1540 2024-09-12T01:57:58.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.942+0000 7f6214cac640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f621015eb20 con 0x7f621006dbd0 2024-09-12T01:57:58.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.942+0000 7f620e59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f621015e740 0x7f621006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59744/0 (socket says 172.21.15.19:59744) 2024-09-12T01:57:58.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.942+0000 7f620e59c640 1 -- 172.21.15.19:0/775038404 learned_addr learned my addr 172.21.15.19:0/775038404 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:58.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.943+0000 7f620ed9d640 1 --2- 172.21.15.19:0/775038404 >> v2:172.21.15.135:3300/0 conn(0x7f621006dbd0 0x7f621009b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.943+0000 7f620dd9b640 1 -- 172.21.15.19:0/775038404 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 373223595 0 0) 0x7f62100d1970 con 0x7f621015e740 2024-09-12T01:57:58.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.943+0000 7f620dd9b640 1 -- 172.21.15.19:0/775038404 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61fc003520 con 0x7f621015e740 2024-09-12T01:57:58.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.943+0000 7f620ed9d640 1 -- 172.21.15.19:0/775038404 >> v1:172.21.15.135:6789/0 conn(0x7f62100d1540 legacy=0x7f6210070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.943+0000 7f620ed9d640 1 -- 172.21.15.19:0/775038404 >> v1:172.21.15.19:6789/0 conn(0x7f621015e740 legacy=0x7f621006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.943+0000 7f620dd9b640 1 -- 172.21.15.19:0/775038404 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3659182513 0 0) 0x7f61fc003520 con 0x7f621015e740 2024-09-12T01:57:58.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.943+0000 7f620ed9d640 1 -- 172.21.15.19:0/775038404 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62100d0a60 con 0x7f621006dbd0 2024-09-12T01:57:58.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.944+0000 7f620ed9d640 1 --2- 172.21.15.19:0/775038404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f621006dbd0 0x7f621009b690 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6208009d90 tx=0x7f620802a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88fa26d01a2e002c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:58.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.944+0000 7f620dd9b640 1 -- 172.21.15.19:0/775038404 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200001670 con 0x7f621006dbd0 2024-09-12T01:57:58.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.944+0000 7f620dd9b640 1 -- 172.21.15.19:0/775038404 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6208007540 con 0x7f621006dbd0 2024-09-12T01:57:58.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.944+0000 7f620dd9b640 1 -- 172.21.15.19:0/775038404 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208007910 con 0x7f621006dbd0 2024-09-12T01:57:58.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.944+0000 7f6214cac640 1 -- 172.21.15.19:0/775038404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f621006dbd0 msgr2=0x7f621009b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.944+0000 7f6214cac640 1 --2- 172.21.15.19:0/775038404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f621006dbd0 0x7f621009b690 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6208009d90 tx=0x7f620802a710 comp rx=0 tx=0).stop 2024-09-12T01:57:58.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.944+0000 7f6214cac640 1 -- 172.21.15.19:0/775038404 shutdown_connections 2024-09-12T01:57:58.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.944+0000 7f6214cac640 1 --2- 172.21.15.19:0/775038404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f621006dbd0 0x7f621009b690 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.944+0000 7f6214cac640 1 -- 172.21.15.19:0/775038404 >> 172.21.15.19:0/775038404 conn(0x7f62100d23a0 msgr2=0x7f62100d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:58.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.944+0000 7f6214cac640 1 -- 172.21.15.19:0/775038404 shutdown_connections 2024-09-12T01:57:58.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.944+0000 7f6214cac640 1 -- 172.21.15.19:0/775038404 wait complete. 2024-09-12T01:57:58.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.946+0000 7f6214cac640 1 Processor -- start 2024-09-12T01:57:58.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.946+0000 7f6214cac640 1 -- start start 2024-09-12T01:57:58.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.946+0000 7f6214cac640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f621006dbd0 0x7f62100b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.946+0000 7f6214cac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62100d1540 0x7f62100c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.946+0000 7f6214cac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f621015e740 0x7f62100cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.946+0000 7f6214cac640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f621006dfe0 con 0x7f621015e740 2024-09-12T01:57:58.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.946+0000 7f6214cac640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f62100d1020 con 0x7f62100d1540 2024-09-12T01:57:58.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.946+0000 7f6214cac640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f621006cd20 con 0x7f621006dbd0 2024-09-12T01:57:58.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.947+0000 7f620ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f621015e740 0x7f62100cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.947+0000 7f620ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f621015e740 0x7f62100cb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33612/0 (socket says 172.21.15.19:33612) 2024-09-12T01:57:58.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.947+0000 7f620ed9d640 1 -- 172.21.15.19:0/359695857 learned_addr learned my addr 172.21.15.19:0/359695857 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:58.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.947+0000 7f6207fff640 1 --2- 172.21.15.19:0/359695857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62100d1540 0x7f62100c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.947+0000 7f620e59c640 1 --2- 172.21.15.19:0/359695857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f621006dbd0 0x7f62100b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.947+0000 7f620ed9d640 1 -- 172.21.15.19:0/359695857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f621006dbd0 msgr2=0x7f62100b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.947+0000 7f620ed9d640 1 --2- 172.21.15.19:0/359695857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f621006dbd0 0x7f62100b51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.947+0000 7f620ed9d640 1 -- 172.21.15.19:0/359695857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62100d1540 msgr2=0x7f62100c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.947+0000 7f620ed9d640 1 --2- 172.21.15.19:0/359695857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62100d1540 0x7f62100c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.947+0000 7f620ed9d640 1 -- 172.21.15.19:0/359695857 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62100c7250 con 0x7f621015e740 2024-09-12T01:57:58.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.947+0000 7f6207fff640 1 --2- 172.21.15.19:0/359695857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62100d1540 0x7f62100c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:58.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.947+0000 7f620ed9d640 1 --2- 172.21.15.19:0/359695857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f621015e740 0x7f62100cb720 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6208009d90 tx=0x7f6208004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:58.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.947+0000 7f6206ffd640 1 -- 172.21.15.19:0/359695857 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208040070 con 0x7f621015e740 2024-09-12T01:57:58.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.947+0000 7f6206ffd640 1 -- 172.21.15.19:0/359695857 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6208031bc0 con 0x7f621015e740 2024-09-12T01:57:58.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.947+0000 7f6206ffd640 1 -- 172.21.15.19:0/359695857 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208009450 con 0x7f621015e740 2024-09-12T01:57:58.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.947+0000 7f6214cac640 1 -- 172.21.15.19:0/359695857 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62100cac40 con 0x7f621015e740 2024-09-12T01:57:58.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.947+0000 7f6214cac640 1 -- 172.21.15.19:0/359695857 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6210155c20 con 0x7f621015e740 2024-09-12T01:57:58.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.948+0000 7f6214cac640 1 -- 172.21.15.19:0/359695857 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f621006d0b0 con 0x7f621015e740 2024-09-12T01:57:58.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.949+0000 7f6206ffd640 1 -- 172.21.15.19:0/359695857 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6208039040 con 0x7f621015e740 2024-09-12T01:57:58.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.949+0000 7f6206ffd640 1 --2- 172.21.15.19:0/359695857 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f61f006be30 0x7f61f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.949+0000 7f6206ffd640 1 -- 172.21.15.19:0/359695857 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f62080ac490 con 0x7f621015e740 2024-09-12T01:57:58.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.949+0000 7f620e59c640 1 --2- 172.21.15.19:0/359695857 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f61f006be30 0x7f61f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.950+0000 7f620e59c640 1 --2- 172.21.15.19:0/359695857 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f61f006be30 0x7f61f006e2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f62000011e0 tx=0x7f6200009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:58.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:58.953+0000 7f6206ffd640 1 -- 172.21.15.19:0/359695857 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6208038350 con 0x7f621015e740 2024-09-12T01:57:59.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.198+0000 7f6214cac640 1 -- 172.21.15.19:0/359695857 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f62100d1cb0 con 0x7f621015e740 2024-09-12T01:57:59.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.199+0000 7f6206ffd640 1 -- 172.21.15.19:0/359695857 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1152 (secure 0 0 0) 0x7f620807ad40 con 0x7f621015e740 2024-09-12T01:57:59.199 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:59.199 INFO:teuthology.orchestra.run.smithi019.stdout:{"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":147,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":54,"num_osds":8,"num_up_osds":8,"osd_up_since":1726106143,"num_in_osds":8,"osd_in_since":1726106133,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":38},{"state_name":"creating+peering","count":38},{"state_name":"active+clean","count":21}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":231661568,"bytes_avail":772862451712,"bytes_total":773094113280,"unknown_pgs_ratio":0.39175257086753845,"inactive_pgs_ratio":0.39175257086753845},"fsmap":{"epoch":27,"btime":"2024-09-12T01:57:57:118704+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5421}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-12T01:57:44.109844+0000","services":{}},"progress_events":{}} 2024-09-12T01:57:59.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.201+0000 7f6214cac640 1 -- 172.21.15.19:0/359695857 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f61f006be30 msgr2=0x7f61f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.201+0000 7f6214cac640 1 --2- 172.21.15.19:0/359695857 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f61f006be30 0x7f61f006e2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f62000011e0 tx=0x7f6200009040 comp rx=0 tx=0).stop 2024-09-12T01:57:59.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.201+0000 7f6214cac640 1 -- 172.21.15.19:0/359695857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f621015e740 msgr2=0x7f62100cb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.201+0000 7f6214cac640 1 --2- 172.21.15.19:0/359695857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f621015e740 0x7f62100cb720 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6208009d90 tx=0x7f6208004a40 comp rx=0 tx=0).stop 2024-09-12T01:57:59.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.201+0000 7f6214cac640 1 -- 172.21.15.19:0/359695857 shutdown_connections 2024-09-12T01:57:59.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.201+0000 7f6214cac640 1 --2- 172.21.15.19:0/359695857 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f61f006be30 0x7f61f006e2f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.201+0000 7f6214cac640 1 --2- 172.21.15.19:0/359695857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f621015e740 0x7f62100cb720 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.201+0000 7f6214cac640 1 --2- 172.21.15.19:0/359695857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62100d1540 0x7f62100c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.201+0000 7f6214cac640 1 --2- 172.21.15.19:0/359695857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f621006dbd0 0x7f62100b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.201+0000 7f6214cac640 1 -- 172.21.15.19:0/359695857 >> 172.21.15.19:0/359695857 conn(0x7f62100d23a0 msgr2=0x7f621006d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:59.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.201+0000 7f6214cac640 1 -- 172.21.15.19:0/359695857 shutdown_connections 2024-09-12T01:57:59.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.201+0000 7f6214cac640 1 -- 172.21.15.19:0/359695857 wait complete. 2024-09-12T01:57:59.212 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T01:57:59.212 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:57:59.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.314+0000 7f579ad2c640 1 Processor -- start 2024-09-12T01:57:59.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.314+0000 7f579ad2c640 1 -- start start 2024-09-12T01:57:59.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.314+0000 7f579ad2c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f579409b140 0x7f5794169570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.314+0000 7f579ad2c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f579406cec0 con 0x7f579406df60 2024-09-12T01:57:59.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.314+0000 7f579ad2c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f579406d1a0 con 0x7f579415e5d0 2024-09-12T01:57:59.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.314+0000 7f579ad2c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f579406dad0 con 0x7f579409b140 2024-09-12T01:57:59.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.315+0000 7f57992c9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f579409b140 0x7f5794169570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.315+0000 7f5793fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f579406df60 0x7f579409aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59746/0 (socket says 172.21.15.19:59746) 2024-09-12T01:57:59.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.315+0000 7f5793fff640 1 -- 172.21.15.19:0/1048024938 learned_addr learned my addr 172.21.15.19:0/1048024938 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:57:59.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.315+0000 7f57992c9640 1 -- 172.21.15.19:0/1048024938 >> v1:172.21.15.135:6789/0 conn(0x7f579415e5d0 legacy=0x7f57940d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:59.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.315+0000 7f57992c9640 1 -- 172.21.15.19:0/1048024938 >> v1:172.21.15.19:6789/0 conn(0x7f579406df60 legacy=0x7f579409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.315+0000 7f57992c9640 1 -- 172.21.15.19:0/1048024938 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579406d480 con 0x7f579409b140 2024-09-12T01:57:59.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.315+0000 7f57937fe640 1 -- 172.21.15.19:0/1048024938 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2993398317 0 0) 0x7f579406cec0 con 0x7f579406df60 2024-09-12T01:57:59.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.316+0000 7f57992c9640 1 --2- 172.21.15.19:0/1048024938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f579409b140 0x7f5794169570 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f578c009dc0 tx=0x7f578c02a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd1964df280c56e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:59.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.316+0000 7f57937fe640 1 -- 172.21.15.19:0/1048024938 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c007740 con 0x7f579409b140 2024-09-12T01:57:59.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.316+0000 7f57937fe640 1 -- 172.21.15.19:0/1048024938 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f578c0078e0 con 0x7f579409b140 2024-09-12T01:57:59.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.316+0000 7f57937fe640 1 -- 172.21.15.19:0/1048024938 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c007cb0 con 0x7f579409b140 2024-09-12T01:57:59.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.316+0000 7f579ad2c640 1 -- 172.21.15.19:0/1048024938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f579409b140 msgr2=0x7f5794169570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.316+0000 7f579ad2c640 1 --2- 172.21.15.19:0/1048024938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f579409b140 0x7f5794169570 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f578c009dc0 tx=0x7f578c02a760 comp rx=0 tx=0).stop 2024-09-12T01:57:59.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.316+0000 7f579ad2c640 1 -- 172.21.15.19:0/1048024938 shutdown_connections 2024-09-12T01:57:59.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.316+0000 7f579ad2c640 1 --2- 172.21.15.19:0/1048024938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f579409b140 0x7f5794169570 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.316+0000 7f579ad2c640 1 -- 172.21.15.19:0/1048024938 >> 172.21.15.19:0/1048024938 conn(0x7f57940d23a0 msgr2=0x7f57940d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:59.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.316+0000 7f579ad2c640 1 -- 172.21.15.19:0/1048024938 shutdown_connections 2024-09-12T01:57:59.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.316+0000 7f579ad2c640 1 -- 172.21.15.19:0/1048024938 wait complete. 2024-09-12T01:57:59.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.318+0000 7f579ad2c640 1 Processor -- start 2024-09-12T01:57:59.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.318+0000 7f579ad2c640 1 -- start start 2024-09-12T01:57:59.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.318+0000 7f579ad2c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f579406df60 0x7f5794159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f579ad2c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f579409b140 0x7f5794156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f579ad2c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f579415e5d0 0x7f57940c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f579ad2c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f57940d1980 con 0x7f579406df60 2024-09-12T01:57:59.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f579ad2c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f57940d1800 con 0x7f579409b140 2024-09-12T01:57:59.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f579ad2c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f579415e9b0 con 0x7f579415e5d0 2024-09-12T01:57:59.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f5798ac8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f579406df60 0x7f5794159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f5798ac8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f579406df60 0x7f5794159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33628/0 (socket says 172.21.15.19:33628) 2024-09-12T01:57:59.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f5798ac8640 1 -- 172.21.15.19:0/837231934 learned_addr learned my addr 172.21.15.19:0/837231934 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:57:59.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f5793fff640 1 --2- 172.21.15.19:0/837231934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f579409b140 0x7f5794156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f57992c9640 1 --2- 172.21.15.19:0/837231934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f579415e5d0 0x7f57940c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f5798ac8640 1 -- 172.21.15.19:0/837231934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f579415e5d0 msgr2=0x7f57940c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f5798ac8640 1 --2- 172.21.15.19:0/837231934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f579415e5d0 0x7f57940c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f5798ac8640 1 -- 172.21.15.19:0/837231934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f579409b140 msgr2=0x7f5794156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f5798ac8640 1 --2- 172.21.15.19:0/837231934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f579409b140 0x7f5794156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f5798ac8640 1 -- 172.21.15.19:0/837231934 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5794159790 con 0x7f579406df60 2024-09-12T01:57:59.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f57992c9640 1 --2- 172.21.15.19:0/837231934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f579415e5d0 0x7f57940c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:59.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f5798ac8640 1 --2- 172.21.15.19:0/837231934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f579406df60 0x7f5794159120 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f578800b3f0 tx=0x7f578800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:59.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f57917fa640 1 -- 172.21.15.19:0/837231934 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5788015020 con 0x7f579406df60 2024-09-12T01:57:59.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f57917fa640 1 -- 172.21.15.19:0/837231934 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5788011830 con 0x7f579406df60 2024-09-12T01:57:59.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f579ad2c640 1 -- 172.21.15.19:0/837231934 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5794159a70 con 0x7f579406df60 2024-09-12T01:57:59.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f57917fa640 1 -- 172.21.15.19:0/837231934 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5788011c20 con 0x7f579406df60 2024-09-12T01:57:59.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.319+0000 7f579ad2c640 1 -- 172.21.15.19:0/837231934 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f579415a030 con 0x7f579406df60 2024-09-12T01:57:59.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.320+0000 7f579ad2c640 1 -- 172.21.15.19:0/837231934 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f579409aa30 con 0x7f579406df60 2024-09-12T01:57:59.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.321+0000 7f57917fa640 1 -- 172.21.15.19:0/837231934 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5788018020 con 0x7f579406df60 2024-09-12T01:57:59.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.321+0000 7f57917fa640 1 --2- 172.21.15.19:0/837231934 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f577806be30 0x7f577806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.321+0000 7f57917fa640 1 -- 172.21.15.19:0/837231934 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f578808ac00 con 0x7f579406df60 2024-09-12T01:57:59.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.321+0000 7f5793fff640 1 --2- 172.21.15.19:0/837231934 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f577806be30 0x7f577806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.322+0000 7f5793fff640 1 --2- 172.21.15.19:0/837231934 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f577806be30 0x7f577806e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f57940ce970 tx=0x7f5780007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:59.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.325+0000 7f57917fa640 1 -- 172.21.15.19:0/837231934 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5788091080 con 0x7f579406df60 2024-09-12T01:57:59.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.497+0000 7f579ad2c640 1 -- 172.21.15.19:0/837231934 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f57940b8320 con 0x7f577806be30 2024-09-12T01:57:59.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.503+0000 7f57917fa640 1 -- 172.21.15.19:0/837231934 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243490 (secure 0 0 0) 0x7f57940b8320 con 0x7f577806be30 2024-09-12T01:57:59.506 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:57:59.507 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:57:59.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.506+0000 7f579ad2c640 1 -- 172.21.15.19:0/837231934 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f577806be30 msgr2=0x7f577806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.506+0000 7f579ad2c640 1 --2- 172.21.15.19:0/837231934 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f577806be30 0x7f577806e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f57940ce970 tx=0x7f5780007b50 comp rx=0 tx=0).stop 2024-09-12T01:57:59.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.506+0000 7f579ad2c640 1 -- 172.21.15.19:0/837231934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f579406df60 msgr2=0x7f5794159120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.506+0000 7f579ad2c640 1 --2- 172.21.15.19:0/837231934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f579406df60 0x7f5794159120 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f578800b3f0 tx=0x7f578800b8b0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.506+0000 7f579ad2c640 1 -- 172.21.15.19:0/837231934 shutdown_connections 2024-09-12T01:57:59.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.506+0000 7f579ad2c640 1 --2- 172.21.15.19:0/837231934 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f577806be30 0x7f577806e2f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.506+0000 7f579ad2c640 1 --2- 172.21.15.19:0/837231934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f579415e5d0 0x7f57940c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.506+0000 7f579ad2c640 1 --2- 172.21.15.19:0/837231934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f579409b140 0x7f5794156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.506+0000 7f579ad2c640 1 --2- 172.21.15.19:0/837231934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f579406df60 0x7f5794159120 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.506+0000 7f579ad2c640 1 -- 172.21.15.19:0/837231934 >> 172.21.15.19:0/837231934 conn(0x7f57940d23a0 msgr2=0x7f579409b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:59.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.506+0000 7f579ad2c640 1 -- 172.21.15.19:0/837231934 shutdown_connections 2024-09-12T01:57:59.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:57:59.506+0000 7f579ad2c640 1 -- 172.21.15.19:0/837231934 wait complete. 2024-09-12T01:57:59.517 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-09-12T01:57:58.112378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226232,"kb_used_data":5836,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748488,"statfs":{"total":773094113280,"available":772862451712,"internally_reserved":0,"allocated":5976064,"data_stored":3299225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.025380"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.095167+0000","last_change":"2024-09-12T01:57:54.095167+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.095167+0000","last_undegraded":"2024-09-12T01:57:54.095167+0000","last_fullsized":"2024-09-12T01:57:54.095167+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.094597+0000","last_change":"2024-09-12T01:57:54.094597+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.094597+0000","last_undegraded":"2024-09-12T01:57:54.094597+0000","last_fullsized":"2024-09-12T01:57:54.094597+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677962+0000","last_change":"2024-09-12T01:57:55.118598+0000","last_active":"2024-09-12T01:57:56.677962+0000","last_peered":"2024-09-12T01:57:56.677962+0000","last_clean":"2024-09-12T01:57:56.677962+0000","last_became_active":"2024-09-12T01:57:55.118325+0000","last_became_peered":"2024-09-12T01:57:55.118325+0000","last_unstale":"2024-09-12T01:57:56.677962+0000","last_undegraded":"2024-09-12T01:57:56.677962+0000","last_fullsized":"2024-09-12T01:57:56.677962+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:07.515102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.095097+0000","last_change":"2024-09-12T01:57:54.095097+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.095097+0000","last_undegraded":"2024-09-12T01:57:54.095097+0000","last_fullsized":"2024-09-12T01:57:54.095097+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.094741+0000","last_change":"2024-09-12T01:57:54.094741+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.094741+0000","last_undegraded":"2024-09-12T01:57:54.094741+0000","last_fullsized":"2024-09-12T01:57:54.094741+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091834+0000","last_change":"2024-09-12T01:57:54.091834+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091834+0000","last_undegraded":"2024-09-12T01:57:54.091834+0000","last_fullsized":"2024-09-12T01:57:54.091834+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.090692+0000","last_change":"2024-09-12T01:57:54.090692+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.090692+0000","last_undegraded":"2024-09-12T01:57:54.090692+0000","last_fullsized":"2024-09-12T01:57:54.090692+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091405+0000","last_change":"2024-09-12T01:57:54.091405+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091405+0000","last_undegraded":"2024-09-12T01:57:54.091405+0000","last_fullsized":"2024-09-12T01:57:54.091405+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.094252+0000","last_change":"2024-09-12T01:57:54.094252+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.094252+0000","last_undegraded":"2024-09-12T01:57:54.094252+0000","last_fullsized":"2024-09-12T01:57:54.094252+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091889+0000","last_change":"2024-09-12T01:57:54.091889+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091889+0000","last_undegraded":"2024-09-12T01:57:54.091889+0000","last_fullsized":"2024-09-12T01:57:54.091889+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.094239+0000","last_change":"2024-09-12T01:57:54.094239+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.094239+0000","last_undegraded":"2024-09-12T01:57:54.094239+0000","last_fullsized":"2024-09-12T01:57:54.094239+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.100535+0000","last_change":"2024-09-12T01:57:54.099411+0000","last_active":"2024-09-12T01:57:54.100535+0000","last_peered":"2024-09-12T01:57:54.100535+0000","last_clean":"2024-09-12T01:57:54.100535+0000","last_became_active":"2024-09-12T01:57:54.099087+0000","last_became_peered":"2024-09-12T01:57:54.099087+0000","last_unstale":"2024-09-12T01:57:54.100535+0000","last_undegraded":"2024-09-12T01:57:54.100535+0000","last_fullsized":"2024-09-12T01:57:54.100535+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:44.513454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.092378+0000","last_change":"2024-09-12T01:57:54.092378+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.092378+0000","last_undegraded":"2024-09-12T01:57:54.092378+0000","last_fullsized":"2024-09-12T01:57:54.092378+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092999+0000","last_change":"2024-09-12T01:57:53.092999+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092999+0000","last_undegraded":"2024-09-12T01:57:53.092999+0000","last_fullsized":"2024-09-12T01:57:53.092999+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.090402+0000","last_change":"2024-09-12T01:57:54.090402+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.090402+0000","last_undegraded":"2024-09-12T01:57:54.090402+0000","last_fullsized":"2024-09-12T01:57:54.090402+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092925+0000","last_change":"2024-09-12T01:57:53.092925+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092925+0000","last_undegraded":"2024-09-12T01:57:53.092925+0000","last_fullsized":"2024-09-12T01:57:53.092925+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.104257+0000","last_change":"2024-09-12T01:57:54.102087+0000","last_active":"2024-09-12T01:57:54.104257+0000","last_peered":"2024-09-12T01:57:54.104257+0000","last_clean":"2024-09-12T01:57:54.104257+0000","last_became_active":"2024-09-12T01:57:54.101812+0000","last_became_peered":"2024-09-12T01:57:54.101812+0000","last_unstale":"2024-09-12T01:57:54.104257+0000","last_undegraded":"2024-09-12T01:57:54.104257+0000","last_fullsized":"2024-09-12T01:57:54.104257+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:57.124282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678046+0000","last_change":"2024-09-12T01:57:55.119789+0000","last_active":"2024-09-12T01:57:56.678046+0000","last_peered":"2024-09-12T01:57:56.678046+0000","last_clean":"2024-09-12T01:57:56.678046+0000","last_became_active":"2024-09-12T01:57:55.119517+0000","last_became_peered":"2024-09-12T01:57:55.119517+0000","last_unstale":"2024-09-12T01:57:56.678046+0000","last_undegraded":"2024-09-12T01:57:56.678046+0000","last_fullsized":"2024-09-12T01:57:56.678046+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:22.674136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092146+0000","last_change":"2024-09-12T01:57:53.092146+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092146+0000","last_undegraded":"2024-09-12T01:57:53.092146+0000","last_fullsized":"2024-09-12T01:57:53.092146+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.095015+0000","last_change":"2024-09-12T01:57:54.095015+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.095015+0000","last_undegraded":"2024-09-12T01:57:54.095015+0000","last_fullsized":"2024-09-12T01:57:54.095015+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677687+0000","last_change":"2024-09-12T01:57:54.099653+0000","last_active":"2024-09-12T01:57:56.677687+0000","last_peered":"2024-09-12T01:57:56.677687+0000","last_clean":"2024-09-12T01:57:56.677687+0000","last_became_active":"2024-09-12T01:57:54.099411+0000","last_became_peered":"2024-09-12T01:57:54.099411+0000","last_unstale":"2024-09-12T01:57:56.677687+0000","last_undegraded":"2024-09-12T01:57:56.677687+0000","last_fullsized":"2024-09-12T01:57:56.677687+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:54.567633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.105446+0000","last_change":"2024-09-12T01:57:54.103416+0000","last_active":"2024-09-12T01:57:54.105446+0000","last_peered":"2024-09-12T01:57:54.105446+0000","last_clean":"2024-09-12T01:57:54.105446+0000","last_became_active":"2024-09-12T01:57:54.103089+0000","last_became_peered":"2024-09-12T01:57:54.103089+0000","last_unstale":"2024-09-12T01:57:54.105446+0000","last_undegraded":"2024-09-12T01:57:54.105446+0000","last_fullsized":"2024-09-12T01:57:54.105446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:33.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.096539+0000","last_change":"2024-09-12T01:57:54.096539+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.096539+0000","last_undegraded":"2024-09-12T01:57:54.096539+0000","last_fullsized":"2024-09-12T01:57:54.096539+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092260+0000","last_change":"2024-09-12T01:57:53.092260+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092260+0000","last_undegraded":"2024-09-12T01:57:53.092260+0000","last_fullsized":"2024-09-12T01:57:53.092260+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677710+0000","last_change":"2024-09-12T01:57:55.118509+0000","last_active":"2024-09-12T01:57:56.677710+0000","last_peered":"2024-09-12T01:57:56.677710+0000","last_clean":"2024-09-12T01:57:56.677710+0000","last_became_active":"2024-09-12T01:57:55.118172+0000","last_became_peered":"2024-09-12T01:57:55.118172+0000","last_unstale":"2024-09-12T01:57:56.677710+0000","last_undegraded":"2024-09-12T01:57:56.677710+0000","last_fullsized":"2024-09-12T01:57:56.677710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:55.332410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.105942+0000","last_change":"2024-09-12T01:57:54.104891+0000","last_active":"2024-09-12T01:57:54.105942+0000","last_peered":"2024-09-12T01:57:54.105942+0000","last_clean":"2024-09-12T01:57:54.105942+0000","last_became_active":"2024-09-12T01:57:54.104595+0000","last_became_peered":"2024-09-12T01:57:54.104595+0000","last_unstale":"2024-09-12T01:57:54.105942+0000","last_undegraded":"2024-09-12T01:57:54.105942+0000","last_fullsized":"2024-09-12T01:57:54.105942+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:55.138013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.092841+0000","last_change":"2024-09-12T01:57:54.092841+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.092841+0000","last_undegraded":"2024-09-12T01:57:54.092841+0000","last_fullsized":"2024-09-12T01:57:54.092841+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678055+0000","last_change":"2024-09-12T01:57:54.111175+0000","last_active":"2024-09-12T01:57:56.678055+0000","last_peered":"2024-09-12T01:57:56.678055+0000","last_clean":"2024-09-12T01:57:56.678055+0000","last_became_active":"2024-09-12T01:57:54.110900+0000","last_became_peered":"2024-09-12T01:57:54.110900+0000","last_unstale":"2024-09-12T01:57:56.678055+0000","last_undegraded":"2024-09-12T01:57:56.678055+0000","last_fullsized":"2024-09-12T01:57:56.678055+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:01.720274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.108836+0000","last_change":"2024-09-12T01:57:54.107407+0000","last_active":"2024-09-12T01:57:54.108836+0000","last_peered":"2024-09-12T01:57:54.108836+0000","last_clean":"2024-09-12T01:57:54.108836+0000","last_became_active":"2024-09-12T01:57:54.107149+0000","last_became_peered":"2024-09-12T01:57:54.107149+0000","last_unstale":"2024-09-12T01:57:54.108836+0000","last_undegraded":"2024-09-12T01:57:54.108836+0000","last_fullsized":"2024-09-12T01:57:54.108836+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:04.470684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678003+0000","last_change":"2024-09-12T01:57:55.113826+0000","last_active":"2024-09-12T01:57:56.678003+0000","last_peered":"2024-09-12T01:57:56.678003+0000","last_clean":"2024-09-12T01:57:56.678003+0000","last_became_active":"2024-09-12T01:57:55.113488+0000","last_became_peered":"2024-09-12T01:57:55.113488+0000","last_unstale":"2024-09-12T01:57:56.678003+0000","last_undegraded":"2024-09-12T01:57:56.678003+0000","last_fullsized":"2024-09-12T01:57:56.678003+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:14.826705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091785+0000","last_change":"2024-09-12T01:57:53.091785+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091785+0000","last_undegraded":"2024-09-12T01:57:53.091785+0000","last_fullsized":"2024-09-12T01:57:53.091785+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091534+0000","last_change":"2024-09-12T01:57:54.091534+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091534+0000","last_undegraded":"2024-09-12T01:57:54.091534+0000","last_fullsized":"2024-09-12T01:57:54.091534+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091646+0000","last_change":"2024-09-12T01:57:53.091646+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091646+0000","last_undegraded":"2024-09-12T01:57:53.091646+0000","last_fullsized":"2024-09-12T01:57:53.091646+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.107135+0000","last_change":"2024-09-12T01:57:54.106202+0000","last_active":"2024-09-12T01:57:54.107135+0000","last_peered":"2024-09-12T01:57:54.107135+0000","last_clean":"2024-09-12T01:57:54.107135+0000","last_became_active":"2024-09-12T01:57:54.105898+0000","last_became_peered":"2024-09-12T01:57:54.105898+0000","last_unstale":"2024-09-12T01:57:54.107135+0000","last_undegraded":"2024-09-12T01:57:54.107135+0000","last_fullsized":"2024-09-12T01:57:54.107135+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:37.565639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.105954+0000","last_change":"2024-09-12T01:57:54.104923+0000","last_active":"2024-09-12T01:57:54.105954+0000","last_peered":"2024-09-12T01:57:54.105954+0000","last_clean":"2024-09-12T01:57:54.105954+0000","last_became_active":"2024-09-12T01:57:54.104376+0000","last_became_peered":"2024-09-12T01:57:54.104376+0000","last_unstale":"2024-09-12T01:57:54.105954+0000","last_undegraded":"2024-09-12T01:57:54.105954+0000","last_fullsized":"2024-09-12T01:57:54.105954+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:54.961365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091523+0000","last_change":"2024-09-12T01:57:53.091523+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091523+0000","last_undegraded":"2024-09-12T01:57:53.091523+0000","last_fullsized":"2024-09-12T01:57:53.091523+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.094626+0000","last_change":"2024-09-12T01:57:53.094626+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.094626+0000","last_undegraded":"2024-09-12T01:57:53.094626+0000","last_fullsized":"2024-09-12T01:57:53.094626+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.089521+0000","last_change":"2024-09-12T01:57:53.089521+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.089521+0000","last_undegraded":"2024-09-12T01:57:53.089521+0000","last_fullsized":"2024-09-12T01:57:53.089521+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677708+0000","last_change":"2024-09-12T01:57:55.127378+0000","last_active":"2024-09-12T01:57:56.677708+0000","last_peered":"2024-09-12T01:57:56.677708+0000","last_clean":"2024-09-12T01:57:56.677708+0000","last_became_active":"2024-09-12T01:57:55.127170+0000","last_became_peered":"2024-09-12T01:57:55.127170+0000","last_unstale":"2024-09-12T01:57:56.677708+0000","last_undegraded":"2024-09-12T01:57:56.677708+0000","last_fullsized":"2024-09-12T01:57:56.677708+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:53.385927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.107907+0000","last_change":"2024-09-12T01:57:54.106589+0000","last_active":"2024-09-12T01:57:54.107907+0000","last_peered":"2024-09-12T01:57:54.107907+0000","last_clean":"2024-09-12T01:57:54.107907+0000","last_became_active":"2024-09-12T01:57:54.106261+0000","last_became_peered":"2024-09-12T01:57:54.106261+0000","last_unstale":"2024-09-12T01:57:54.107907+0000","last_undegraded":"2024-09-12T01:57:54.107907+0000","last_fullsized":"2024-09-12T01:57:54.107907+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:31.979861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.103092+0000","last_change":"2024-09-12T01:57:54.101095+0000","last_active":"2024-09-12T01:57:54.103092+0000","last_peered":"2024-09-12T01:57:54.103092+0000","last_clean":"2024-09-12T01:57:54.103092+0000","last_became_active":"2024-09-12T01:57:54.100822+0000","last_became_peered":"2024-09-12T01:57:54.100822+0000","last_unstale":"2024-09-12T01:57:54.103092+0000","last_undegraded":"2024-09-12T01:57:54.103092+0000","last_fullsized":"2024-09-12T01:57:54.103092+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:59.910848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091074+0000","last_change":"2024-09-12T01:57:54.091074+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091074+0000","last_undegraded":"2024-09-12T01:57:54.091074+0000","last_fullsized":"2024-09-12T01:57:54.091074+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092130+0000","last_change":"2024-09-12T01:57:53.092130+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092130+0000","last_undegraded":"2024-09-12T01:57:53.092130+0000","last_fullsized":"2024-09-12T01:57:53.092130+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.092693+0000","last_change":"2024-09-12T01:57:54.092693+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.092693+0000","last_undegraded":"2024-09-12T01:57:54.092693+0000","last_fullsized":"2024-09-12T01:57:54.092693+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092974+0000","last_change":"2024-09-12T01:57:53.092974+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092974+0000","last_undegraded":"2024-09-12T01:57:53.092974+0000","last_fullsized":"2024-09-12T01:57:53.092974+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.092426+0000","last_change":"2024-09-12T01:57:53.092426+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.092426+0000","last_undegraded":"2024-09-12T01:57:53.092426+0000","last_fullsized":"2024-09-12T01:57:53.092426+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.089523+0000","last_change":"2024-09-12T01:57:53.089523+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.089523+0000","last_undegraded":"2024-09-12T01:57:53.089523+0000","last_fullsized":"2024-09-12T01:57:53.089523+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.091461+0000","last_change":"2024-09-12T01:57:54.091461+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.091461+0000","last_undegraded":"2024-09-12T01:57:54.091461+0000","last_fullsized":"2024-09-12T01:57:54.091461+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.107157+0000","last_change":"2024-09-12T01:57:54.106206+0000","last_active":"2024-09-12T01:57:54.107157+0000","last_peered":"2024-09-12T01:57:54.107157+0000","last_clean":"2024-09-12T01:57:54.107157+0000","last_became_active":"2024-09-12T01:57:54.105890+0000","last_became_peered":"2024-09-12T01:57:54.105890+0000","last_unstale":"2024-09-12T01:57:54.107157+0000","last_undegraded":"2024-09-12T01:57:54.107157+0000","last_fullsized":"2024-09-12T01:57:54.107157+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:54.271270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.107746+0000","last_change":"2024-09-12T01:57:54.106811+0000","last_active":"2024-09-12T01:57:54.107746+0000","last_peered":"2024-09-12T01:57:54.107746+0000","last_clean":"2024-09-12T01:57:54.107746+0000","last_became_active":"2024-09-12T01:57:54.106499+0000","last_became_peered":"2024-09-12T01:57:54.106499+0000","last_unstale":"2024-09-12T01:57:54.107746+0000","last_undegraded":"2024-09-12T01:57:54.107746+0000","last_fullsized":"2024-09-12T01:57:54.107746+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:12.616086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.095103+0000","last_change":"2024-09-12T01:57:53.095103+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.095103+0000","last_undegraded":"2024-09-12T01:57:53.095103+0000","last_fullsized":"2024-09-12T01:57:53.095103+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091478+0000","last_change":"2024-09-12T01:57:53.091478+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091478+0000","last_undegraded":"2024-09-12T01:57:53.091478+0000","last_fullsized":"2024-09-12T01:57:53.091478+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.092168+0000","last_change":"2024-09-12T01:57:54.092168+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.092168+0000","last_undegraded":"2024-09-12T01:57:54.092168+0000","last_fullsized":"2024-09-12T01:57:54.092168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.091966+0000","last_change":"2024-09-12T01:57:53.091966+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.091966+0000","last_undegraded":"2024-09-12T01:57:53.091966+0000","last_fullsized":"2024-09-12T01:57:53.091966+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677686+0000","last_change":"2024-09-12T01:57:54.101888+0000","last_active":"2024-09-12T01:57:56.677686+0000","last_peered":"2024-09-12T01:57:56.677686+0000","last_clean":"2024-09-12T01:57:56.677686+0000","last_became_active":"2024-09-12T01:57:54.101626+0000","last_became_peered":"2024-09-12T01:57:54.101626+0000","last_unstale":"2024-09-12T01:57:56.677686+0000","last_undegraded":"2024-09-12T01:57:56.677686+0000","last_fullsized":"2024-09-12T01:57:56.677686+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:00.857513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:57:54.084725+0000","last_change":"2024-09-12T01:57:54.084725+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.084725+0000","last_undegraded":"2024-09-12T01:57:54.084725+0000","last_fullsized":"2024-09-12T01:57:54.084725+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.104202+0000","last_change":"2024-09-12T01:57:54.101287+0000","last_active":"2024-09-12T01:57:54.104202+0000","last_peered":"2024-09-12T01:57:54.104202+0000","last_clean":"2024-09-12T01:57:54.104202+0000","last_became_active":"2024-09-12T01:57:54.101005+0000","last_became_peered":"2024-09-12T01:57:54.101005+0000","last_unstale":"2024-09-12T01:57:54.104202+0000","last_undegraded":"2024-09-12T01:57:54.104202+0000","last_fullsized":"2024-09-12T01:57:54.104202+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:55.997442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T01:57:54.090384+0000","last_change":"2024-09-12T01:57:54.090384+0000","last_active":"2024-09-12T01:57:54.084725+0000","last_peered":"2024-09-12T01:57:54.084725+0000","last_clean":"2024-09-12T01:57:54.084725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:54.090384+0000","last_undegraded":"2024-09-12T01:57:54.090384+0000","last_fullsized":"2024-09-12T01:57:54.090384+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-12T01:57:53.095386+0000","last_change":"2024-09-12T01:57:53.095386+0000","last_active":"2024-09-12T01:57:53.080263+0000","last_peered":"2024-09-12T01:57:53.080263+0000","last_clean":"2024-09-12T01:57:53.080263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:57:53.095386+0000","last_undegraded":"2024-09-12T01:57:53.095386+0000","last_fullsized":"2024-09-12T01:57:53.095386+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":227,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T01:57:54.097536+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:57:54.097536+0000","last_peered":"2024-09-12T01:57:54.097536+0000","last_clean":"2024-09-12T01:57:54.097536+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:57:54.097536+0000","last_undegraded":"2024-09-12T01:57:54.097536+0000","last_fullsized":"2024-09-12T01:57:54.097536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1191936,"data_stored":854869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":598016,"data_stored":264501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":598016,"data_stored":264501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542174,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":598016,"data_stored":264501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":258292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":585728,"data_stored":258292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542174,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1179648,"data_stored":848660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":285609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:58:00.383 INFO:tasks.ceph.mds.a.smithi019.stderr:2024-09-12T01:58:00.383+0000 7f769fd7f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:58:02.522 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:58:02.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.637+0000 7ffb37077640 1 Processor -- start 2024-09-12T01:58:02.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.638+0000 7ffb37077640 1 -- start start 2024-09-12T01:58:02.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.638+0000 7ffb37077640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb30162060 0x7ffb300b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.638+0000 7ffb37077640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffb300b64b0 0x7ffb300b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.638+0000 7ffb37077640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb3006d9f0 con 0x7ffb30161c80 2024-09-12T01:58:02.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.638+0000 7ffb37077640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ffb3006dcd0 con 0x7ffb30162060 2024-09-12T01:58:02.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.638+0000 7ffb37077640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ffb3006dfb0 con 0x7ffb300b64b0 2024-09-12T01:58:02.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.638+0000 7ffb2ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb30162060 0x7ffb300b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.638+0000 7ffb34e13640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ffb30161c80 0x7ffb3006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56964/0 (socket says 172.21.15.19:56964) 2024-09-12T01:58:02.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.639+0000 7ffb34e13640 1 -- 172.21.15.19:0/729307248 learned_addr learned my addr 172.21.15.19:0/729307248 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:02.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.639+0000 7ffb2ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb30162060 0x7ffb300b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49958/0 (socket says 172.21.15.19:49958) 2024-09-12T01:58:02.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.639+0000 7ffb35614640 1 --2- 172.21.15.19:0/729307248 >> v2:172.21.15.135:3300/0 conn(0x7ffb300b64b0 0x7ffb300b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.639+0000 7ffb2ffff640 1 -- 172.21.15.19:0/729307248 >> v2:172.21.15.135:3300/0 conn(0x7ffb300b64b0 msgr2=0x7ffb300b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:02.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.639+0000 7ffb2ffff640 1 --2- 172.21.15.19:0/729307248 >> v2:172.21.15.135:3300/0 conn(0x7ffb300b64b0 0x7ffb300b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.639+0000 7ffb2ffff640 1 -- 172.21.15.19:0/729307248 >> v1:172.21.15.19:6789/0 conn(0x7ffb30161c80 legacy=0x7ffb3006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.639+0000 7ffb2ffff640 1 -- 172.21.15.19:0/729307248 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb300d01f0 con 0x7ffb30162060 2024-09-12T01:58:02.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.639+0000 7ffb2f7fe640 1 -- 172.21.15.19:0/729307248 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4181904507 0 0) 0x7ffb3006d9f0 con 0x7ffb30161c80 2024-09-12T01:58:02.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.640+0000 7ffb2ffff640 1 --2- 172.21.15.19:0/729307248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb30162060 0x7ffb300b5f70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ffb3008d750 tx=0x7ffb2402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b72c9550c51f94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:02.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.640+0000 7ffb2f7fe640 1 -- 172.21.15.19:0/729307248 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24037070 con 0x7ffb30162060 2024-09-12T01:58:02.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.640+0000 7ffb2f7fe640 1 -- 172.21.15.19:0/729307248 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb24032440 con 0x7ffb30162060 2024-09-12T01:58:02.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.640+0000 7ffb2f7fe640 1 -- 172.21.15.19:0/729307248 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24032810 con 0x7ffb30162060 2024-09-12T01:58:02.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.640+0000 7ffb37077640 1 -- 172.21.15.19:0/729307248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb30162060 msgr2=0x7ffb300b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.640+0000 7ffb37077640 1 --2- 172.21.15.19:0/729307248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb30162060 0x7ffb300b5f70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ffb3008d750 tx=0x7ffb2402a1a0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.640+0000 7ffb37077640 1 -- 172.21.15.19:0/729307248 shutdown_connections 2024-09-12T01:58:02.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.640+0000 7ffb37077640 1 --2- 172.21.15.19:0/729307248 >> v2:172.21.15.135:3300/0 conn(0x7ffb300b64b0 0x7ffb300b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.640+0000 7ffb37077640 1 --2- 172.21.15.19:0/729307248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb30162060 0x7ffb300b5f70 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.640+0000 7ffb37077640 1 -- 172.21.15.19:0/729307248 >> 172.21.15.19:0/729307248 conn(0x7ffb300d44f0 msgr2=0x7ffb300d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:02.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.640+0000 7ffb37077640 1 -- 172.21.15.19:0/729307248 shutdown_connections 2024-09-12T01:58:02.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.641+0000 7ffb37077640 1 -- 172.21.15.19:0/729307248 wait complete. 2024-09-12T01:58:02.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.642+0000 7ffb37077640 1 Processor -- start 2024-09-12T01:58:02.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.642+0000 7ffb37077640 1 -- start start 2024-09-12T01:58:02.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.643+0000 7ffb37077640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb300b64b0 0x7ffb30159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.643+0000 7ffb37077640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb30161c80 0x7ffb301f4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.643+0000 7ffb37077640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb30162060 0x7ffb300b88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.643+0000 7ffb37077640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ffb300cf1e0 con 0x7ffb30161c80 2024-09-12T01:58:02.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.643+0000 7ffb37077640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffb300d2aa0 con 0x7ffb30162060 2024-09-12T01:58:02.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.643+0000 7ffb37077640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ffb300cf360 con 0x7ffb300b64b0 2024-09-12T01:58:02.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.643+0000 7ffb2ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb30161c80 0x7ffb301f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.643+0000 7ffb2ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb30161c80 0x7ffb301f4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49970/0 (socket says 172.21.15.19:49970) 2024-09-12T01:58:02.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.643+0000 7ffb2ffff640 1 -- 172.21.15.19:0/4136007184 learned_addr learned my addr 172.21.15.19:0/4136007184 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:02.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.643+0000 7ffb35614640 1 --2- 172.21.15.19:0/4136007184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb30162060 0x7ffb300b88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.643+0000 7ffb34e13640 1 --2- 172.21.15.19:0/4136007184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb300b64b0 0x7ffb30159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.643+0000 7ffb2ffff640 1 -- 172.21.15.19:0/4136007184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb300b64b0 msgr2=0x7ffb30159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.643+0000 7ffb2ffff640 1 --2- 172.21.15.19:0/4136007184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb300b64b0 0x7ffb30159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.643+0000 7ffb2ffff640 1 -- 172.21.15.19:0/4136007184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb30162060 msgr2=0x7ffb300b88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.643+0000 7ffb2ffff640 1 --2- 172.21.15.19:0/4136007184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb30162060 0x7ffb300b88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.643+0000 7ffb2ffff640 1 -- 172.21.15.19:0/4136007184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb301f4fe0 con 0x7ffb30161c80 2024-09-12T01:58:02.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.643+0000 7ffb34e13640 1 --2- 172.21.15.19:0/4136007184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb300b64b0 0x7ffb30159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:02.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.644+0000 7ffb2ffff640 1 --2- 172.21.15.19:0/4136007184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb30161c80 0x7ffb301f4060 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ffb24000c00 tx=0x7ffb240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:02.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.644+0000 7ffb2d7fa640 1 -- 172.21.15.19:0/4136007184 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24037050 con 0x7ffb30161c80 2024-09-12T01:58:02.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.644+0000 7ffb2d7fa640 1 -- 172.21.15.19:0/4136007184 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb24038040 con 0x7ffb30161c80 2024-09-12T01:58:02.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.644+0000 7ffb37077640 1 -- 172.21.15.19:0/4136007184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb301f4a20 con 0x7ffb30161c80 2024-09-12T01:58:02.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.644+0000 7ffb2d7fa640 1 -- 172.21.15.19:0/4136007184 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24004470 con 0x7ffb30161c80 2024-09-12T01:58:02.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.644+0000 7ffb37077640 1 -- 172.21.15.19:0/4136007184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb300cbd30 con 0x7ffb30161c80 2024-09-12T01:58:02.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.645+0000 7ffb37077640 1 -- 172.21.15.19:0/4136007184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb300b5f70 con 0x7ffb30161c80 2024-09-12T01:58:02.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.645+0000 7ffb2d7fa640 1 -- 172.21.15.19:0/4136007184 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb24030900 con 0x7ffb30161c80 2024-09-12T01:58:02.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.646+0000 7ffb2d7fa640 1 --2- 172.21.15.19:0/4136007184 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffb1c06be30 0x7ffb1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.646+0000 7ffb2d7fa640 1 -- 172.21.15.19:0/4136007184 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7ffb240aba90 con 0x7ffb30161c80 2024-09-12T01:58:02.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.646+0000 7ffb34e13640 1 --2- 172.21.15.19:0/4136007184 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffb1c06be30 0x7ffb1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.646+0000 7ffb34e13640 1 --2- 172.21.15.19:0/4136007184 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffb1c06be30 0x7ffb1c06e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffb200012e0 tx=0x7ffb20007f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:02.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.650+0000 7ffb2d7fa640 1 -- 172.21.15.19:0/4136007184 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffb2407a460 con 0x7ffb30161c80 2024-09-12T01:58:02.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.824+0000 7ffb37077640 1 -- 172.21.15.19:0/4136007184 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb300b5b30 con 0x7ffb1c06be30 2024-09-12T01:58:02.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.830+0000 7ffb2d7fa640 1 -- 172.21.15.19:0/4136007184 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251944 (secure 0 0 0) 0x7ffb300b5b30 con 0x7ffb1c06be30 2024-09-12T01:58:02.833 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:58:02.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.833+0000 7ffb37077640 1 -- 172.21.15.19:0/4136007184 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffb1c06be30 msgr2=0x7ffb1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.833+0000 7ffb37077640 1 --2- 172.21.15.19:0/4136007184 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffb1c06be30 0x7ffb1c06e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffb200012e0 tx=0x7ffb20007f90 comp rx=0 tx=0).stop 2024-09-12T01:58:02.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.833+0000 7ffb37077640 1 -- 172.21.15.19:0/4136007184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb30161c80 msgr2=0x7ffb301f4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.833+0000 7ffb37077640 1 --2- 172.21.15.19:0/4136007184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb30161c80 0x7ffb301f4060 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ffb24000c00 tx=0x7ffb240046c0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.833+0000 7ffb37077640 1 -- 172.21.15.19:0/4136007184 shutdown_connections 2024-09-12T01:58:02.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.833+0000 7ffb37077640 1 --2- 172.21.15.19:0/4136007184 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffb1c06be30 0x7ffb1c06e2f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.833+0000 7ffb37077640 1 --2- 172.21.15.19:0/4136007184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb30162060 0x7ffb300b88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.833+0000 7ffb37077640 1 --2- 172.21.15.19:0/4136007184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb30161c80 0x7ffb301f4060 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.833+0000 7ffb37077640 1 --2- 172.21.15.19:0/4136007184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb300b64b0 0x7ffb30159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.833+0000 7ffb37077640 1 -- 172.21.15.19:0/4136007184 >> 172.21.15.19:0/4136007184 conn(0x7ffb300d44f0 msgr2=0x7ffb300cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:02.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.833+0000 7ffb37077640 1 -- 172.21.15.19:0/4136007184 shutdown_connections 2024-09-12T01:58:02.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.833+0000 7ffb37077640 1 -- 172.21.15.19:0/4136007184 wait complete. 2024-09-12T01:58:02.845 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2024-09-12T01:58:02.113525+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226608,"kb_used_data":6184,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748112,"statfs":{"total":773094113280,"available":772862066688,"internally_reserved":0,"allocated":6332416,"data_stored":3465772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001894"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.101190+0000","last_change":"2024-09-12T01:57:55.106977+0000","last_active":"2024-09-12T01:57:56.101190+0000","last_peered":"2024-09-12T01:57:56.101190+0000","last_clean":"2024-09-12T01:57:56.101190+0000","last_became_active":"2024-09-12T01:57:55.106579+0000","last_became_peered":"2024-09-12T01:57:55.106579+0000","last_unstale":"2024-09-12T01:57:56.101190+0000","last_undegraded":"2024-09-12T01:57:56.101190+0000","last_fullsized":"2024-09-12T01:57:56.101190+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:14.826705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.474561+0000","last_change":"2024-09-12T01:57:55.113924+0000","last_active":"2024-09-12T01:57:56.474561+0000","last_peered":"2024-09-12T01:57:56.474561+0000","last_clean":"2024-09-12T01:57:56.474561+0000","last_became_active":"2024-09-12T01:57:55.112727+0000","last_became_peered":"2024-09-12T01:57:55.112727+0000","last_unstale":"2024-09-12T01:57:56.474561+0000","last_undegraded":"2024-09-12T01:57:56.474561+0000","last_fullsized":"2024-09-12T01:57:56.474561+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:20.569630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678309+0000","last_change":"2024-09-12T01:57:55.131003+0000","last_active":"2024-09-12T01:57:56.678309+0000","last_peered":"2024-09-12T01:57:56.678309+0000","last_clean":"2024-09-12T01:57:56.678309+0000","last_became_active":"2024-09-12T01:57:55.130691+0000","last_became_peered":"2024-09-12T01:57:55.130691+0000","last_unstale":"2024-09-12T01:57:56.678309+0000","last_undegraded":"2024-09-12T01:57:56.678309+0000","last_fullsized":"2024-09-12T01:57:56.678309+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:12.190967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.474303+0000","last_change":"2024-09-12T01:57:55.119349+0000","last_active":"2024-09-12T01:57:56.474303+0000","last_peered":"2024-09-12T01:57:56.474303+0000","last_clean":"2024-09-12T01:57:56.474303+0000","last_became_active":"2024-09-12T01:57:55.119118+0000","last_became_peered":"2024-09-12T01:57:55.119118+0000","last_unstale":"2024-09-12T01:57:56.474303+0000","last_undegraded":"2024-09-12T01:57:56.474303+0000","last_fullsized":"2024-09-12T01:57:56.474303+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:26.619222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677962+0000","last_change":"2024-09-12T01:57:55.118598+0000","last_active":"2024-09-12T01:57:56.677962+0000","last_peered":"2024-09-12T01:57:56.677962+0000","last_clean":"2024-09-12T01:57:56.677962+0000","last_became_active":"2024-09-12T01:57:55.118325+0000","last_became_peered":"2024-09-12T01:57:55.118325+0000","last_unstale":"2024-09-12T01:57:56.677962+0000","last_undegraded":"2024-09-12T01:57:56.677962+0000","last_fullsized":"2024-09-12T01:57:56.677962+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:07.515102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.101050+0000","last_change":"2024-09-12T01:57:55.120041+0000","last_active":"2024-09-12T01:57:56.101050+0000","last_peered":"2024-09-12T01:57:56.101050+0000","last_clean":"2024-09-12T01:57:56.101050+0000","last_became_active":"2024-09-12T01:57:55.119206+0000","last_became_peered":"2024-09-12T01:57:55.119206+0000","last_unstale":"2024-09-12T01:57:56.101050+0000","last_undegraded":"2024-09-12T01:57:56.101050+0000","last_fullsized":"2024-09-12T01:57:56.101050+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:53.385927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677398+0000","last_change":"2024-09-12T01:57:55.127790+0000","last_active":"2024-09-12T01:57:56.677398+0000","last_peered":"2024-09-12T01:57:56.677398+0000","last_clean":"2024-09-12T01:57:56.677398+0000","last_became_active":"2024-09-12T01:57:55.127389+0000","last_became_peered":"2024-09-12T01:57:55.127389+0000","last_unstale":"2024-09-12T01:57:56.677398+0000","last_undegraded":"2024-09-12T01:57:56.677398+0000","last_fullsized":"2024-09-12T01:57:56.677398+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:58.671278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677710+0000","last_change":"2024-09-12T01:57:55.131369+0000","last_active":"2024-09-12T01:57:56.677710+0000","last_peered":"2024-09-12T01:57:56.677710+0000","last_clean":"2024-09-12T01:57:56.677710+0000","last_became_active":"2024-09-12T01:57:55.130921+0000","last_became_peered":"2024-09-12T01:57:55.130921+0000","last_unstale":"2024-09-12T01:57:56.677710+0000","last_undegraded":"2024-09-12T01:57:56.677710+0000","last_fullsized":"2024-09-12T01:57:56.677710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:34.446353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678096+0000","last_change":"2024-09-12T01:57:55.132071+0000","last_active":"2024-09-12T01:57:56.678096+0000","last_peered":"2024-09-12T01:57:56.678096+0000","last_clean":"2024-09-12T01:57:56.678096+0000","last_became_active":"2024-09-12T01:57:55.131818+0000","last_became_peered":"2024-09-12T01:57:55.131818+0000","last_unstale":"2024-09-12T01:57:56.678096+0000","last_undegraded":"2024-09-12T01:57:56.678096+0000","last_fullsized":"2024-09-12T01:57:56.678096+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:36.276973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.101147+0000","last_change":"2024-09-12T01:57:55.114105+0000","last_active":"2024-09-12T01:57:56.101147+0000","last_peered":"2024-09-12T01:57:56.101147+0000","last_clean":"2024-09-12T01:57:56.101147+0000","last_became_active":"2024-09-12T01:57:55.113796+0000","last_became_peered":"2024-09-12T01:57:55.113796+0000","last_unstale":"2024-09-12T01:57:56.101147+0000","last_undegraded":"2024-09-12T01:57:56.101147+0000","last_fullsized":"2024-09-12T01:57:56.101147+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:07.515102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.227660+0000","last_change":"2024-09-12T01:57:55.118561+0000","last_active":"2024-09-12T01:57:56.227660+0000","last_peered":"2024-09-12T01:57:56.227660+0000","last_clean":"2024-09-12T01:57:56.227660+0000","last_became_active":"2024-09-12T01:57:55.118205+0000","last_became_peered":"2024-09-12T01:57:55.118205+0000","last_unstale":"2024-09-12T01:57:56.227660+0000","last_undegraded":"2024-09-12T01:57:56.227660+0000","last_fullsized":"2024-09-12T01:57:56.227660+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:00.915309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678117+0000","last_change":"2024-09-12T01:57:55.126559+0000","last_active":"2024-09-12T01:57:56.678117+0000","last_peered":"2024-09-12T01:57:56.678117+0000","last_clean":"2024-09-12T01:57:56.678117+0000","last_became_active":"2024-09-12T01:57:55.126278+0000","last_became_peered":"2024-09-12T01:57:55.126278+0000","last_unstale":"2024-09-12T01:57:56.678117+0000","last_undegraded":"2024-09-12T01:57:56.678117+0000","last_fullsized":"2024-09-12T01:57:56.678117+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:48.932820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.101327+0000","last_change":"2024-09-12T01:57:55.112671+0000","last_active":"2024-09-12T01:57:56.101327+0000","last_peered":"2024-09-12T01:57:56.101327+0000","last_clean":"2024-09-12T01:57:56.101327+0000","last_became_active":"2024-09-12T01:57:55.112365+0000","last_became_peered":"2024-09-12T01:57:55.112365+0000","last_unstale":"2024-09-12T01:57:56.101327+0000","last_undegraded":"2024-09-12T01:57:56.101327+0000","last_fullsized":"2024-09-12T01:57:56.101327+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:34.382649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678324+0000","last_change":"2024-09-12T01:57:55.128917+0000","last_active":"2024-09-12T01:57:56.678324+0000","last_peered":"2024-09-12T01:57:56.678324+0000","last_clean":"2024-09-12T01:57:56.678324+0000","last_became_active":"2024-09-12T01:57:55.128660+0000","last_became_peered":"2024-09-12T01:57:55.128660+0000","last_unstale":"2024-09-12T01:57:56.678324+0000","last_undegraded":"2024-09-12T01:57:56.678324+0000","last_fullsized":"2024-09-12T01:57:56.678324+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:29.986998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.474295+0000","last_change":"2024-09-12T01:57:55.113439+0000","last_active":"2024-09-12T01:57:56.474295+0000","last_peered":"2024-09-12T01:57:56.474295+0000","last_clean":"2024-09-12T01:57:56.474295+0000","last_became_active":"2024-09-12T01:57:55.113167+0000","last_became_peered":"2024-09-12T01:57:55.113167+0000","last_unstale":"2024-09-12T01:57:56.474295+0000","last_undegraded":"2024-09-12T01:57:56.474295+0000","last_fullsized":"2024-09-12T01:57:56.474295+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:25.587634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.100954+0000","last_change":"2024-09-12T01:57:55.112312+0000","last_active":"2024-09-12T01:57:56.100954+0000","last_peered":"2024-09-12T01:57:56.100954+0000","last_clean":"2024-09-12T01:57:56.100954+0000","last_became_active":"2024-09-12T01:57:55.112013+0000","last_became_peered":"2024-09-12T01:57:55.112013+0000","last_unstale":"2024-09-12T01:57:56.100954+0000","last_undegraded":"2024-09-12T01:57:56.100954+0000","last_fullsized":"2024-09-12T01:57:56.100954+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:41.047820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678758+0000","last_change":"2024-09-12T01:57:55.133436+0000","last_active":"2024-09-12T01:57:56.678758+0000","last_peered":"2024-09-12T01:57:56.678758+0000","last_clean":"2024-09-12T01:57:56.678758+0000","last_became_active":"2024-09-12T01:57:55.133012+0000","last_became_peered":"2024-09-12T01:57:55.133012+0000","last_unstale":"2024-09-12T01:57:56.678758+0000","last_undegraded":"2024-09-12T01:57:56.678758+0000","last_fullsized":"2024-09-12T01:57:56.678758+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:14.670175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.474575+0000","last_change":"2024-09-12T01:57:55.114401+0000","last_active":"2024-09-12T01:57:56.474575+0000","last_peered":"2024-09-12T01:57:56.474575+0000","last_clean":"2024-09-12T01:57:56.474575+0000","last_became_active":"2024-09-12T01:57:55.113081+0000","last_became_peered":"2024-09-12T01:57:55.113081+0000","last_unstale":"2024-09-12T01:57:56.474575+0000","last_undegraded":"2024-09-12T01:57:56.474575+0000","last_fullsized":"2024-09-12T01:57:56.474575+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:26.681307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678402+0000","last_change":"2024-09-12T01:57:55.119413+0000","last_active":"2024-09-12T01:57:56.678402+0000","last_peered":"2024-09-12T01:57:56.678402+0000","last_clean":"2024-09-12T01:57:56.678402+0000","last_became_active":"2024-09-12T01:57:55.119144+0000","last_became_peered":"2024-09-12T01:57:55.119144+0000","last_unstale":"2024-09-12T01:57:56.678402+0000","last_undegraded":"2024-09-12T01:57:56.678402+0000","last_fullsized":"2024-09-12T01:57:56.678402+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:10.066232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.106698+0000","last_change":"2024-09-12T01:57:55.113260+0000","last_active":"2024-09-12T01:57:56.106698+0000","last_peered":"2024-09-12T01:57:56.106698+0000","last_clean":"2024-09-12T01:57:56.106698+0000","last_became_active":"2024-09-12T01:57:55.112625+0000","last_became_peered":"2024-09-12T01:57:55.112625+0000","last_unstale":"2024-09-12T01:57:56.106698+0000","last_undegraded":"2024-09-12T01:57:56.106698+0000","last_fullsized":"2024-09-12T01:57:56.106698+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:56.142475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.106593+0000","last_change":"2024-09-12T01:57:55.112353+0000","last_active":"2024-09-12T01:57:56.106593+0000","last_peered":"2024-09-12T01:57:56.106593+0000","last_clean":"2024-09-12T01:57:56.106593+0000","last_became_active":"2024-09-12T01:57:55.112116+0000","last_became_peered":"2024-09-12T01:57:55.112116+0000","last_unstale":"2024-09-12T01:57:56.106593+0000","last_undegraded":"2024-09-12T01:57:56.106593+0000","last_fullsized":"2024-09-12T01:57:56.106593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:51.959969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677658+0000","last_change":"2024-09-12T01:57:55.131387+0000","last_active":"2024-09-12T01:57:56.677658+0000","last_peered":"2024-09-12T01:57:56.677658+0000","last_clean":"2024-09-12T01:57:56.677658+0000","last_became_active":"2024-09-12T01:57:55.131108+0000","last_became_peered":"2024-09-12T01:57:55.131108+0000","last_unstale":"2024-09-12T01:57:56.677658+0000","last_undegraded":"2024-09-12T01:57:56.677658+0000","last_fullsized":"2024-09-12T01:57:56.677658+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:48.437851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.227480+0000","last_change":"2024-09-12T01:57:55.119963+0000","last_active":"2024-09-12T01:57:56.227480+0000","last_peered":"2024-09-12T01:57:56.227480+0000","last_clean":"2024-09-12T01:57:56.227480+0000","last_became_active":"2024-09-12T01:57:55.119677+0000","last_became_peered":"2024-09-12T01:57:55.119677+0000","last_unstale":"2024-09-12T01:57:56.227480+0000","last_undegraded":"2024-09-12T01:57:56.227480+0000","last_fullsized":"2024-09-12T01:57:56.227480+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:45.517915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677380+0000","last_change":"2024-09-12T01:57:55.116286+0000","last_active":"2024-09-12T01:57:56.677380+0000","last_peered":"2024-09-12T01:57:56.677380+0000","last_clean":"2024-09-12T01:57:56.677380+0000","last_became_active":"2024-09-12T01:57:55.115554+0000","last_became_peered":"2024-09-12T01:57:55.115554+0000","last_unstale":"2024-09-12T01:57:56.677380+0000","last_undegraded":"2024-09-12T01:57:56.677380+0000","last_fullsized":"2024-09-12T01:57:56.677380+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:20.569630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678743+0000","last_change":"2024-09-12T01:57:55.121816+0000","last_active":"2024-09-12T01:57:56.678743+0000","last_peered":"2024-09-12T01:57:56.678743+0000","last_clean":"2024-09-12T01:57:56.678743+0000","last_became_active":"2024-09-12T01:57:55.121203+0000","last_became_peered":"2024-09-12T01:57:55.121203+0000","last_unstale":"2024-09-12T01:57:56.678743+0000","last_undegraded":"2024-09-12T01:57:56.678743+0000","last_fullsized":"2024-09-12T01:57:56.678743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:06.070128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677923+0000","last_change":"2024-09-12T01:57:55.118772+0000","last_active":"2024-09-12T01:57:56.677923+0000","last_peered":"2024-09-12T01:57:56.677923+0000","last_clean":"2024-09-12T01:57:56.677923+0000","last_became_active":"2024-09-12T01:57:55.118442+0000","last_became_peered":"2024-09-12T01:57:55.118442+0000","last_unstale":"2024-09-12T01:57:56.677923+0000","last_undegraded":"2024-09-12T01:57:56.677923+0000","last_fullsized":"2024-09-12T01:57:56.677923+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:01.969725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.101412+0000","last_change":"2024-09-12T01:57:55.112727+0000","last_active":"2024-09-12T01:57:56.101412+0000","last_peered":"2024-09-12T01:57:56.101412+0000","last_clean":"2024-09-12T01:57:56.101412+0000","last_became_active":"2024-09-12T01:57:55.112399+0000","last_became_peered":"2024-09-12T01:57:55.112399+0000","last_unstale":"2024-09-12T01:57:56.101412+0000","last_undegraded":"2024-09-12T01:57:56.101412+0000","last_fullsized":"2024-09-12T01:57:56.101412+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:03.784424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.106858+0000","last_change":"2024-09-12T01:57:55.110933+0000","last_active":"2024-09-12T01:57:56.106858+0000","last_peered":"2024-09-12T01:57:56.106858+0000","last_clean":"2024-09-12T01:57:56.106858+0000","last_became_active":"2024-09-12T01:57:55.110644+0000","last_became_peered":"2024-09-12T01:57:55.110644+0000","last_unstale":"2024-09-12T01:57:56.106858+0000","last_undegraded":"2024-09-12T01:57:56.106858+0000","last_fullsized":"2024-09-12T01:57:56.106858+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:32.485948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678372+0000","last_change":"2024-09-12T01:57:55.112456+0000","last_active":"2024-09-12T01:57:56.678372+0000","last_peered":"2024-09-12T01:57:56.678372+0000","last_clean":"2024-09-12T01:57:56.678372+0000","last_became_active":"2024-09-12T01:57:55.112185+0000","last_became_peered":"2024-09-12T01:57:55.112185+0000","last_unstale":"2024-09-12T01:57:56.678372+0000","last_undegraded":"2024-09-12T01:57:56.678372+0000","last_fullsized":"2024-09-12T01:57:56.678372+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:25.787843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.474260+0000","last_change":"2024-09-12T01:57:55.118444+0000","last_active":"2024-09-12T01:57:56.474260+0000","last_peered":"2024-09-12T01:57:56.474260+0000","last_clean":"2024-09-12T01:57:56.474260+0000","last_became_active":"2024-09-12T01:57:55.118162+0000","last_became_peered":"2024-09-12T01:57:55.118162+0000","last_unstale":"2024-09-12T01:57:56.474260+0000","last_undegraded":"2024-09-12T01:57:56.474260+0000","last_fullsized":"2024-09-12T01:57:56.474260+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:09.423062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678514+0000","last_change":"2024-09-12T01:57:55.126662+0000","last_active":"2024-09-12T01:57:56.678514+0000","last_peered":"2024-09-12T01:57:56.678514+0000","last_clean":"2024-09-12T01:57:56.678514+0000","last_became_active":"2024-09-12T01:57:55.126406+0000","last_became_peered":"2024-09-12T01:57:55.126406+0000","last_unstale":"2024-09-12T01:57:56.678514+0000","last_undegraded":"2024-09-12T01:57:56.678514+0000","last_fullsized":"2024-09-12T01:57:56.678514+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:29.602055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.107396+0000","last_change":"2024-09-12T01:57:55.116569+0000","last_active":"2024-09-12T01:57:56.107396+0000","last_peered":"2024-09-12T01:57:56.107396+0000","last_clean":"2024-09-12T01:57:56.107396+0000","last_became_active":"2024-09-12T01:57:55.116313+0000","last_became_peered":"2024-09-12T01:57:55.116313+0000","last_unstale":"2024-09-12T01:57:56.107396+0000","last_undegraded":"2024-09-12T01:57:56.107396+0000","last_fullsized":"2024-09-12T01:57:56.107396+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:09.423062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.473992+0000","last_change":"2024-09-12T01:57:55.112225+0000","last_active":"2024-09-12T01:57:56.473992+0000","last_peered":"2024-09-12T01:57:56.473992+0000","last_clean":"2024-09-12T01:57:56.473992+0000","last_became_active":"2024-09-12T01:57:55.111959+0000","last_became_peered":"2024-09-12T01:57:55.111959+0000","last_unstale":"2024-09-12T01:57:56.473992+0000","last_undegraded":"2024-09-12T01:57:56.473992+0000","last_fullsized":"2024-09-12T01:57:56.473992+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:15.002702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"53'4","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.106562+0000","last_change":"2024-09-12T01:57:54.099411+0000","last_active":"2024-09-12T01:57:56.106562+0000","last_peered":"2024-09-12T01:57:56.106562+0000","last_clean":"2024-09-12T01:57:56.106562+0000","last_became_active":"2024-09-12T01:57:54.099087+0000","last_became_peered":"2024-09-12T01:57:54.099087+0000","last_unstale":"2024-09-12T01:57:56.106562+0000","last_undegraded":"2024-09-12T01:57:56.106562+0000","last_fullsized":"2024-09-12T01:57:56.106562+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:04.696803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.107482+0000","last_change":"2024-09-12T01:57:55.117128+0000","last_active":"2024-09-12T01:57:56.107482+0000","last_peered":"2024-09-12T01:57:56.107482+0000","last_clean":"2024-09-12T01:57:56.107482+0000","last_became_active":"2024-09-12T01:57:55.116880+0000","last_became_peered":"2024-09-12T01:57:55.116880+0000","last_unstale":"2024-09-12T01:57:56.107482+0000","last_undegraded":"2024-09-12T01:57:56.107482+0000","last_fullsized":"2024-09-12T01:57:56.107482+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:26.619222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.101069+0000","last_change":"2024-09-12T01:57:54.100145+0000","last_active":"2024-09-12T01:57:56.101069+0000","last_peered":"2024-09-12T01:57:56.101069+0000","last_clean":"2024-09-12T01:57:56.101069+0000","last_became_active":"2024-09-12T01:57:54.099885+0000","last_became_peered":"2024-09-12T01:57:54.099885+0000","last_unstale":"2024-09-12T01:57:56.101069+0000","last_undegraded":"2024-09-12T01:57:56.101069+0000","last_fullsized":"2024-09-12T01:57:56.101069+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:33.909362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.106797+0000","last_change":"2024-09-12T01:57:55.120690+0000","last_active":"2024-09-12T01:57:56.106797+0000","last_peered":"2024-09-12T01:57:56.106797+0000","last_clean":"2024-09-12T01:57:56.106797+0000","last_became_active":"2024-09-12T01:57:55.120370+0000","last_became_peered":"2024-09-12T01:57:55.120370+0000","last_unstale":"2024-09-12T01:57:56.106797+0000","last_undegraded":"2024-09-12T01:57:56.106797+0000","last_fullsized":"2024-09-12T01:57:56.106797+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:13.620548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.101327+0000","last_change":"2024-09-12T01:57:54.098924+0000","last_active":"2024-09-12T01:57:56.101327+0000","last_peered":"2024-09-12T01:57:56.101327+0000","last_clean":"2024-09-12T01:57:56.101327+0000","last_became_active":"2024-09-12T01:57:54.098372+0000","last_became_peered":"2024-09-12T01:57:54.098372+0000","last_unstale":"2024-09-12T01:57:56.101327+0000","last_undegraded":"2024-09-12T01:57:56.101327+0000","last_fullsized":"2024-09-12T01:57:56.101327+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:09.514443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677728+0000","last_change":"2024-09-12T01:57:55.117206+0000","last_active":"2024-09-12T01:57:56.677728+0000","last_peered":"2024-09-12T01:57:56.677728+0000","last_clean":"2024-09-12T01:57:56.677728+0000","last_became_active":"2024-09-12T01:57:55.116919+0000","last_became_peered":"2024-09-12T01:57:55.116919+0000","last_unstale":"2024-09-12T01:57:56.677728+0000","last_undegraded":"2024-09-12T01:57:56.677728+0000","last_fullsized":"2024-09-12T01:57:56.677728+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:57.077842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.107585+0000","last_change":"2024-09-12T01:57:54.102087+0000","last_active":"2024-09-12T01:57:56.107585+0000","last_peered":"2024-09-12T01:57:56.107585+0000","last_clean":"2024-09-12T01:57:56.107585+0000","last_became_active":"2024-09-12T01:57:54.101812+0000","last_became_peered":"2024-09-12T01:57:54.101812+0000","last_unstale":"2024-09-12T01:57:56.107585+0000","last_undegraded":"2024-09-12T01:57:56.107585+0000","last_fullsized":"2024-09-12T01:57:56.107585+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:28.273865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678046+0000","last_change":"2024-09-12T01:57:55.119789+0000","last_active":"2024-09-12T01:57:56.678046+0000","last_peered":"2024-09-12T01:57:56.678046+0000","last_clean":"2024-09-12T01:57:56.678046+0000","last_became_active":"2024-09-12T01:57:55.119517+0000","last_became_peered":"2024-09-12T01:57:55.119517+0000","last_unstale":"2024-09-12T01:57:56.678046+0000","last_undegraded":"2024-09-12T01:57:56.678046+0000","last_fullsized":"2024-09-12T01:57:56.678046+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:22.674136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678308+0000","last_change":"2024-09-12T01:57:54.111137+0000","last_active":"2024-09-12T01:57:56.678308+0000","last_peered":"2024-09-12T01:57:56.678308+0000","last_clean":"2024-09-12T01:57:56.678308+0000","last_became_active":"2024-09-12T01:57:54.110441+0000","last_became_peered":"2024-09-12T01:57:54.110441+0000","last_unstale":"2024-09-12T01:57:56.678308+0000","last_undegraded":"2024-09-12T01:57:56.678308+0000","last_fullsized":"2024-09-12T01:57:56.678308+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:31.481486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.474391+0000","last_change":"2024-09-12T01:57:55.117707+0000","last_active":"2024-09-12T01:57:56.474391+0000","last_peered":"2024-09-12T01:57:56.474391+0000","last_clean":"2024-09-12T01:57:56.474391+0000","last_became_active":"2024-09-12T01:57:55.117383+0000","last_became_peered":"2024-09-12T01:57:55.117383+0000","last_unstale":"2024-09-12T01:57:56.474391+0000","last_undegraded":"2024-09-12T01:57:56.474391+0000","last_fullsized":"2024-09-12T01:57:56.474391+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:23.760530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677687+0000","last_change":"2024-09-12T01:57:54.099653+0000","last_active":"2024-09-12T01:57:56.677687+0000","last_peered":"2024-09-12T01:57:56.677687+0000","last_clean":"2024-09-12T01:57:56.677687+0000","last_became_active":"2024-09-12T01:57:54.099411+0000","last_became_peered":"2024-09-12T01:57:54.099411+0000","last_unstale":"2024-09-12T01:57:56.677687+0000","last_undegraded":"2024-09-12T01:57:56.677687+0000","last_fullsized":"2024-09-12T01:57:56.677687+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:54.567633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678217+0000","last_change":"2024-09-12T01:57:55.117205+0000","last_active":"2024-09-12T01:57:56.678217+0000","last_peered":"2024-09-12T01:57:56.678217+0000","last_clean":"2024-09-12T01:57:56.678217+0000","last_became_active":"2024-09-12T01:57:55.116970+0000","last_became_peered":"2024-09-12T01:57:55.116970+0000","last_unstale":"2024-09-12T01:57:56.678217+0000","last_undegraded":"2024-09-12T01:57:56.678217+0000","last_fullsized":"2024-09-12T01:57:56.678217+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:35.578175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.106692+0000","last_change":"2024-09-12T01:57:54.103416+0000","last_active":"2024-09-12T01:57:56.106692+0000","last_peered":"2024-09-12T01:57:56.106692+0000","last_clean":"2024-09-12T01:57:56.106692+0000","last_became_active":"2024-09-12T01:57:54.103089+0000","last_became_peered":"2024-09-12T01:57:54.103089+0000","last_unstale":"2024-09-12T01:57:56.106692+0000","last_undegraded":"2024-09-12T01:57:56.106692+0000","last_fullsized":"2024-09-12T01:57:56.106692+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:08.214183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.474558+0000","last_change":"2024-09-12T01:57:55.124158+0000","last_active":"2024-09-12T01:57:56.474558+0000","last_peered":"2024-09-12T01:57:56.474558+0000","last_clean":"2024-09-12T01:57:56.474558+0000","last_became_active":"2024-09-12T01:57:55.123890+0000","last_became_peered":"2024-09-12T01:57:55.123890+0000","last_unstale":"2024-09-12T01:57:56.474558+0000","last_undegraded":"2024-09-12T01:57:56.474558+0000","last_fullsized":"2024-09-12T01:57:56.474558+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:58.671278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677316+0000","last_change":"2024-09-12T01:57:54.106092+0000","last_active":"2024-09-12T01:57:56.677316+0000","last_peered":"2024-09-12T01:57:56.677316+0000","last_clean":"2024-09-12T01:57:56.677316+0000","last_became_active":"2024-09-12T01:57:54.105571+0000","last_became_peered":"2024-09-12T01:57:54.105571+0000","last_unstale":"2024-09-12T01:57:56.677316+0000","last_undegraded":"2024-09-12T01:57:56.677316+0000","last_fullsized":"2024-09-12T01:57:56.677316+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:04.470684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677710+0000","last_change":"2024-09-12T01:57:55.118509+0000","last_active":"2024-09-12T01:57:56.677710+0000","last_peered":"2024-09-12T01:57:56.677710+0000","last_clean":"2024-09-12T01:57:56.677710+0000","last_became_active":"2024-09-12T01:57:55.118172+0000","last_became_peered":"2024-09-12T01:57:55.118172+0000","last_unstale":"2024-09-12T01:57:56.677710+0000","last_undegraded":"2024-09-12T01:57:56.677710+0000","last_fullsized":"2024-09-12T01:57:56.677710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:55.332410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.474492+0000","last_change":"2024-09-12T01:57:54.104891+0000","last_active":"2024-09-12T01:57:56.474492+0000","last_peered":"2024-09-12T01:57:56.474492+0000","last_clean":"2024-09-12T01:57:56.474492+0000","last_became_active":"2024-09-12T01:57:54.104595+0000","last_became_peered":"2024-09-12T01:57:54.104595+0000","last_unstale":"2024-09-12T01:57:56.474492+0000","last_undegraded":"2024-09-12T01:57:56.474492+0000","last_fullsized":"2024-09-12T01:57:56.474492+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:38.148403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.107329+0000","last_change":"2024-09-12T01:57:55.112173+0000","last_active":"2024-09-12T01:57:56.107329+0000","last_peered":"2024-09-12T01:57:56.107329+0000","last_clean":"2024-09-12T01:57:56.107329+0000","last_became_active":"2024-09-12T01:57:55.111916+0000","last_became_peered":"2024-09-12T01:57:55.111916+0000","last_unstale":"2024-09-12T01:57:56.107329+0000","last_undegraded":"2024-09-12T01:57:56.107329+0000","last_fullsized":"2024-09-12T01:57:56.107329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:15.002702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678055+0000","last_change":"2024-09-12T01:57:54.111175+0000","last_active":"2024-09-12T01:57:56.678055+0000","last_peered":"2024-09-12T01:57:56.678055+0000","last_clean":"2024-09-12T01:57:56.678055+0000","last_became_active":"2024-09-12T01:57:54.110900+0000","last_became_peered":"2024-09-12T01:57:54.110900+0000","last_unstale":"2024-09-12T01:57:56.678055+0000","last_undegraded":"2024-09-12T01:57:56.678055+0000","last_fullsized":"2024-09-12T01:57:56.678055+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:01.720274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678410+0000","last_change":"2024-09-12T01:57:55.120472+0000","last_active":"2024-09-12T01:57:56.678410+0000","last_peered":"2024-09-12T01:57:56.678410+0000","last_clean":"2024-09-12T01:57:56.678410+0000","last_became_active":"2024-09-12T01:57:55.115818+0000","last_became_peered":"2024-09-12T01:57:55.115818+0000","last_unstale":"2024-09-12T01:57:56.678410+0000","last_undegraded":"2024-09-12T01:57:56.678410+0000","last_fullsized":"2024-09-12T01:57:56.678410+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:32.044748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"53'3","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.474483+0000","last_change":"2024-09-12T01:57:54.107407+0000","last_active":"2024-09-12T01:57:56.474483+0000","last_peered":"2024-09-12T01:57:56.474483+0000","last_clean":"2024-09-12T01:57:56.474483+0000","last_became_active":"2024-09-12T01:57:54.107149+0000","last_became_peered":"2024-09-12T01:57:54.107149+0000","last_unstale":"2024-09-12T01:57:56.474483+0000","last_undegraded":"2024-09-12T01:57:56.474483+0000","last_fullsized":"2024-09-12T01:57:56.474483+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:55.997442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678003+0000","last_change":"2024-09-12T01:57:55.113826+0000","last_active":"2024-09-12T01:57:56.678003+0000","last_peered":"2024-09-12T01:57:56.678003+0000","last_clean":"2024-09-12T01:57:56.678003+0000","last_became_active":"2024-09-12T01:57:55.113488+0000","last_became_peered":"2024-09-12T01:57:55.113488+0000","last_unstale":"2024-09-12T01:57:56.678003+0000","last_undegraded":"2024-09-12T01:57:56.678003+0000","last_fullsized":"2024-09-12T01:57:56.678003+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:14.826705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"53'6","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678103+0000","last_change":"2024-09-12T01:57:54.102129+0000","last_active":"2024-09-12T01:57:56.678103+0000","last_peered":"2024-09-12T01:57:56.678103+0000","last_clean":"2024-09-12T01:57:56.678103+0000","last_became_active":"2024-09-12T01:57:54.101835+0000","last_became_peered":"2024-09-12T01:57:54.101835+0000","last_unstale":"2024-09-12T01:57:56.678103+0000","last_undegraded":"2024-09-12T01:57:56.678103+0000","last_fullsized":"2024-09-12T01:57:56.678103+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:13.545683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.107394+0000","last_change":"2024-09-12T01:57:55.116056+0000","last_active":"2024-09-12T01:57:56.107394+0000","last_peered":"2024-09-12T01:57:56.107394+0000","last_clean":"2024-09-12T01:57:56.107394+0000","last_became_active":"2024-09-12T01:57:55.115789+0000","last_became_peered":"2024-09-12T01:57:55.115789+0000","last_unstale":"2024-09-12T01:57:56.107394+0000","last_undegraded":"2024-09-12T01:57:56.107394+0000","last_fullsized":"2024-09-12T01:57:56.107394+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:25.587634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678432+0000","last_change":"2024-09-12T01:57:54.109222+0000","last_active":"2024-09-12T01:57:56.678432+0000","last_peered":"2024-09-12T01:57:56.678432+0000","last_clean":"2024-09-12T01:57:56.678432+0000","last_became_active":"2024-09-12T01:57:54.107686+0000","last_became_peered":"2024-09-12T01:57:54.107686+0000","last_unstale":"2024-09-12T01:57:56.678432+0000","last_undegraded":"2024-09-12T01:57:56.678432+0000","last_fullsized":"2024-09-12T01:57:56.678432+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:38.148403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678484+0000","last_change":"2024-09-12T01:57:55.118624+0000","last_active":"2024-09-12T01:57:56.678484+0000","last_peered":"2024-09-12T01:57:56.678484+0000","last_clean":"2024-09-12T01:57:56.678484+0000","last_became_active":"2024-09-12T01:57:55.110940+0000","last_became_peered":"2024-09-12T01:57:55.110940+0000","last_unstale":"2024-09-12T01:57:56.678484+0000","last_undegraded":"2024-09-12T01:57:56.678484+0000","last_fullsized":"2024-09-12T01:57:56.678484+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:27.668925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.106558+0000","last_change":"2024-09-12T01:57:54.106202+0000","last_active":"2024-09-12T01:57:56.106558+0000","last_peered":"2024-09-12T01:57:56.106558+0000","last_clean":"2024-09-12T01:57:56.106558+0000","last_became_active":"2024-09-12T01:57:54.105898+0000","last_became_peered":"2024-09-12T01:57:54.105898+0000","last_unstale":"2024-09-12T01:57:56.106558+0000","last_undegraded":"2024-09-12T01:57:56.106558+0000","last_fullsized":"2024-09-12T01:57:56.106558+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:55.877810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677973+0000","last_change":"2024-09-12T01:57:55.121171+0000","last_active":"2024-09-12T01:57:56.677973+0000","last_peered":"2024-09-12T01:57:56.677973+0000","last_clean":"2024-09-12T01:57:56.677973+0000","last_became_active":"2024-09-12T01:57:55.120912+0000","last_became_peered":"2024-09-12T01:57:55.120912+0000","last_unstale":"2024-09-12T01:57:56.677973+0000","last_undegraded":"2024-09-12T01:57:56.677973+0000","last_fullsized":"2024-09-12T01:57:56.677973+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:20.033870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.474168+0000","last_change":"2024-09-12T01:57:54.104923+0000","last_active":"2024-09-12T01:57:56.474168+0000","last_peered":"2024-09-12T01:57:56.474168+0000","last_clean":"2024-09-12T01:57:56.474168+0000","last_became_active":"2024-09-12T01:57:54.104376+0000","last_became_peered":"2024-09-12T01:57:54.104376+0000","last_unstale":"2024-09-12T01:57:56.474168+0000","last_undegraded":"2024-09-12T01:57:56.474168+0000","last_fullsized":"2024-09-12T01:57:56.474168+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:31.481486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678615+0000","last_change":"2024-09-12T01:57:55.133976+0000","last_active":"2024-09-12T01:57:56.678615+0000","last_peered":"2024-09-12T01:57:56.678615+0000","last_clean":"2024-09-12T01:57:56.678615+0000","last_became_active":"2024-09-12T01:57:55.133712+0000","last_became_peered":"2024-09-12T01:57:55.133712+0000","last_unstale":"2024-09-12T01:57:56.678615+0000","last_undegraded":"2024-09-12T01:57:56.678615+0000","last_fullsized":"2024-09-12T01:57:56.678615+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:43.435169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"53'8","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677778+0000","last_change":"2024-09-12T01:57:54.103730+0000","last_active":"2024-09-12T01:57:56.677778+0000","last_peered":"2024-09-12T01:57:56.677778+0000","last_clean":"2024-09-12T01:57:56.677778+0000","last_became_active":"2024-09-12T01:57:54.103455+0000","last_became_peered":"2024-09-12T01:57:54.103455+0000","last_unstale":"2024-09-12T01:57:56.677778+0000","last_undegraded":"2024-09-12T01:57:56.677778+0000","last_fullsized":"2024-09-12T01:57:56.677778+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:02.779962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677814+0000","last_change":"2024-09-12T01:57:55.123006+0000","last_active":"2024-09-12T01:57:56.677814+0000","last_peered":"2024-09-12T01:57:56.677814+0000","last_clean":"2024-09-12T01:57:56.677814+0000","last_became_active":"2024-09-12T01:57:55.122724+0000","last_became_peered":"2024-09-12T01:57:55.122724+0000","last_unstale":"2024-09-12T01:57:56.677814+0000","last_undegraded":"2024-09-12T01:57:56.677814+0000","last_fullsized":"2024-09-12T01:57:56.677814+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:11.338822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678645+0000","last_change":"2024-09-12T01:57:54.113521+0000","last_active":"2024-09-12T01:57:56.678645+0000","last_peered":"2024-09-12T01:57:56.678645+0000","last_clean":"2024-09-12T01:57:56.678645+0000","last_became_active":"2024-09-12T01:57:54.113194+0000","last_became_peered":"2024-09-12T01:57:54.113194+0000","last_unstale":"2024-09-12T01:57:56.678645+0000","last_undegraded":"2024-09-12T01:57:56.678645+0000","last_fullsized":"2024-09-12T01:57:56.678645+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:14.378924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.100954+0000","last_change":"2024-09-12T01:57:55.111975+0000","last_active":"2024-09-12T01:57:56.100954+0000","last_peered":"2024-09-12T01:57:56.100954+0000","last_clean":"2024-09-12T01:57:56.100954+0000","last_became_active":"2024-09-12T01:57:55.111696+0000","last_became_peered":"2024-09-12T01:57:55.111696+0000","last_unstale":"2024-09-12T01:57:56.100954+0000","last_undegraded":"2024-09-12T01:57:56.100954+0000","last_fullsized":"2024-09-12T01:57:56.100954+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:50.557018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.227645+0000","last_change":"2024-09-12T01:57:54.099141+0000","last_active":"2024-09-12T01:57:56.227645+0000","last_peered":"2024-09-12T01:57:56.227645+0000","last_clean":"2024-09-12T01:57:56.227645+0000","last_became_active":"2024-09-12T01:57:54.098789+0000","last_became_peered":"2024-09-12T01:57:54.098789+0000","last_unstale":"2024-09-12T01:57:56.227645+0000","last_undegraded":"2024-09-12T01:57:56.227645+0000","last_fullsized":"2024-09-12T01:57:56.227645+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:18.612580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677708+0000","last_change":"2024-09-12T01:57:55.127378+0000","last_active":"2024-09-12T01:57:56.677708+0000","last_peered":"2024-09-12T01:57:56.677708+0000","last_clean":"2024-09-12T01:57:56.677708+0000","last_became_active":"2024-09-12T01:57:55.127170+0000","last_became_peered":"2024-09-12T01:57:55.127170+0000","last_unstale":"2024-09-12T01:57:56.677708+0000","last_undegraded":"2024-09-12T01:57:56.677708+0000","last_fullsized":"2024-09-12T01:57:56.677708+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:53.385927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.106674+0000","last_change":"2024-09-12T01:57:54.106589+0000","last_active":"2024-09-12T01:57:56.106674+0000","last_peered":"2024-09-12T01:57:56.106674+0000","last_clean":"2024-09-12T01:57:56.106674+0000","last_became_active":"2024-09-12T01:57:54.106261+0000","last_became_peered":"2024-09-12T01:57:54.106261+0000","last_unstale":"2024-09-12T01:57:56.106674+0000","last_undegraded":"2024-09-12T01:57:56.106674+0000","last_fullsized":"2024-09-12T01:57:56.106674+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:07.417751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.101065+0000","last_change":"2024-09-12T01:57:55.105649+0000","last_active":"2024-09-12T01:57:56.101065+0000","last_peered":"2024-09-12T01:57:56.101065+0000","last_clean":"2024-09-12T01:57:56.101065+0000","last_became_active":"2024-09-12T01:57:55.105370+0000","last_became_peered":"2024-09-12T01:57:55.105370+0000","last_unstale":"2024-09-12T01:57:56.101065+0000","last_undegraded":"2024-09-12T01:57:56.101065+0000","last_fullsized":"2024-09-12T01:57:56.101065+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:55.332410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.106848+0000","last_change":"2024-09-12T01:57:54.101095+0000","last_active":"2024-09-12T01:57:56.106848+0000","last_peered":"2024-09-12T01:57:56.106848+0000","last_clean":"2024-09-12T01:57:56.106848+0000","last_became_active":"2024-09-12T01:57:54.100822+0000","last_became_peered":"2024-09-12T01:57:54.100822+0000","last_unstale":"2024-09-12T01:57:56.106848+0000","last_undegraded":"2024-09-12T01:57:56.106848+0000","last_fullsized":"2024-09-12T01:57:56.106848+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:25.203446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.107484+0000","last_change":"2024-09-12T01:57:55.112872+0000","last_active":"2024-09-12T01:57:56.107484+0000","last_peered":"2024-09-12T01:57:56.107484+0000","last_clean":"2024-09-12T01:57:56.107484+0000","last_became_active":"2024-09-12T01:57:55.112580+0000","last_became_peered":"2024-09-12T01:57:55.112580+0000","last_unstale":"2024-09-12T01:57:56.107484+0000","last_undegraded":"2024-09-12T01:57:56.107484+0000","last_fullsized":"2024-09-12T01:57:56.107484+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:23.760530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.101123+0000","last_change":"2024-09-12T01:57:54.094652+0000","last_active":"2024-09-12T01:57:56.101123+0000","last_peered":"2024-09-12T01:57:56.101123+0000","last_clean":"2024-09-12T01:57:56.101123+0000","last_became_active":"2024-09-12T01:57:54.094306+0000","last_became_peered":"2024-09-12T01:57:54.094306+0000","last_unstale":"2024-09-12T01:57:56.101123+0000","last_undegraded":"2024-09-12T01:57:56.101123+0000","last_fullsized":"2024-09-12T01:57:56.101123+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:09.210962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.106636+0000","last_change":"2024-09-12T01:57:55.112279+0000","last_active":"2024-09-12T01:57:56.106636+0000","last_peered":"2024-09-12T01:57:56.106636+0000","last_clean":"2024-09-12T01:57:56.106636+0000","last_became_active":"2024-09-12T01:57:55.112010+0000","last_became_peered":"2024-09-12T01:57:55.112010+0000","last_unstale":"2024-09-12T01:57:56.106636+0000","last_undegraded":"2024-09-12T01:57:56.106636+0000","last_fullsized":"2024-09-12T01:57:56.106636+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:05.475146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677541+0000","last_change":"2024-09-12T01:57:54.101548+0000","last_active":"2024-09-12T01:57:56.677541+0000","last_peered":"2024-09-12T01:57:56.677541+0000","last_clean":"2024-09-12T01:57:56.677541+0000","last_became_active":"2024-09-12T01:57:54.101241+0000","last_became_peered":"2024-09-12T01:57:54.101241+0000","last_unstale":"2024-09-12T01:57:56.677541+0000","last_undegraded":"2024-09-12T01:57:56.677541+0000","last_fullsized":"2024-09-12T01:57:56.677541+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:43.136489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677757+0000","last_change":"2024-09-12T01:57:55.113098+0000","last_active":"2024-09-12T01:57:56.677757+0000","last_peered":"2024-09-12T01:57:56.677757+0000","last_clean":"2024-09-12T01:57:56.677757+0000","last_became_active":"2024-09-12T01:57:55.112821+0000","last_became_peered":"2024-09-12T01:57:55.112821+0000","last_unstale":"2024-09-12T01:57:56.677757+0000","last_undegraded":"2024-09-12T01:57:56.677757+0000","last_fullsized":"2024-09-12T01:57:56.677757+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:05.586608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677911+0000","last_change":"2024-09-12T01:57:54.109040+0000","last_active":"2024-09-12T01:57:56.677911+0000","last_peered":"2024-09-12T01:57:56.677911+0000","last_clean":"2024-09-12T01:57:56.677911+0000","last_became_active":"2024-09-12T01:57:54.108701+0000","last_became_peered":"2024-09-12T01:57:54.108701+0000","last_unstale":"2024-09-12T01:57:56.677911+0000","last_undegraded":"2024-09-12T01:57:56.677911+0000","last_fullsized":"2024-09-12T01:57:56.677911+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:12.616086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.101196+0000","last_change":"2024-09-12T01:57:55.127842+0000","last_active":"2024-09-12T01:57:56.101196+0000","last_peered":"2024-09-12T01:57:56.101196+0000","last_clean":"2024-09-12T01:57:56.101196+0000","last_became_active":"2024-09-12T01:57:55.127582+0000","last_became_peered":"2024-09-12T01:57:55.127582+0000","last_unstale":"2024-09-12T01:57:56.101196+0000","last_undegraded":"2024-09-12T01:57:56.101196+0000","last_fullsized":"2024-09-12T01:57:56.101196+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:22.674136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.227356+0000","last_change":"2024-09-12T01:57:54.102136+0000","last_active":"2024-09-12T01:57:56.227356+0000","last_peered":"2024-09-12T01:57:56.227356+0000","last_clean":"2024-09-12T01:57:56.227356+0000","last_became_active":"2024-09-12T01:57:54.101854+0000","last_became_peered":"2024-09-12T01:57:54.101854+0000","last_unstale":"2024-09-12T01:57:56.227356+0000","last_undegraded":"2024-09-12T01:57:56.227356+0000","last_fullsized":"2024-09-12T01:57:56.227356+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:44.607041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.107702+0000","last_change":"2024-09-12T01:57:55.116306+0000","last_active":"2024-09-12T01:57:56.107702+0000","last_peered":"2024-09-12T01:57:56.107702+0000","last_clean":"2024-09-12T01:57:56.107702+0000","last_became_active":"2024-09-12T01:57:55.116053+0000","last_became_peered":"2024-09-12T01:57:55.116053+0000","last_unstale":"2024-09-12T01:57:56.107702+0000","last_undegraded":"2024-09-12T01:57:56.107702+0000","last_fullsized":"2024-09-12T01:57:56.107702+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:58.671278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.106688+0000","last_change":"2024-09-12T01:57:54.106206+0000","last_active":"2024-09-12T01:57:56.106688+0000","last_peered":"2024-09-12T01:57:56.106688+0000","last_clean":"2024-09-12T01:57:56.106688+0000","last_became_active":"2024-09-12T01:57:54.105890+0000","last_became_peered":"2024-09-12T01:57:54.105890+0000","last_unstale":"2024-09-12T01:57:56.106688+0000","last_undegraded":"2024-09-12T01:57:56.106688+0000","last_fullsized":"2024-09-12T01:57:56.106688+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:48.062278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.101264+0000","last_change":"2024-09-12T01:57:55.110711+0000","last_active":"2024-09-12T01:57:56.101264+0000","last_peered":"2024-09-12T01:57:56.101264+0000","last_clean":"2024-09-12T01:57:56.101264+0000","last_became_active":"2024-09-12T01:57:55.110421+0000","last_became_peered":"2024-09-12T01:57:55.110421+0000","last_unstale":"2024-09-12T01:57:56.101264+0000","last_undegraded":"2024-09-12T01:57:56.101264+0000","last_fullsized":"2024-09-12T01:57:56.101264+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:44.140951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.474492+0000","last_change":"2024-09-12T01:57:54.106811+0000","last_active":"2024-09-12T01:57:56.474492+0000","last_peered":"2024-09-12T01:57:56.474492+0000","last_clean":"2024-09-12T01:57:56.474492+0000","last_became_active":"2024-09-12T01:57:54.106499+0000","last_became_peered":"2024-09-12T01:57:54.106499+0000","last_unstale":"2024-09-12T01:57:56.474492+0000","last_undegraded":"2024-09-12T01:57:56.474492+0000","last_fullsized":"2024-09-12T01:57:56.474492+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:57.124282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677701+0000","last_change":"2024-09-12T01:57:55.123175+0000","last_active":"2024-09-12T01:57:56.677701+0000","last_peered":"2024-09-12T01:57:56.677701+0000","last_clean":"2024-09-12T01:57:56.677701+0000","last_became_active":"2024-09-12T01:57:55.122909+0000","last_became_peered":"2024-09-12T01:57:55.122909+0000","last_unstale":"2024-09-12T01:57:56.677701+0000","last_undegraded":"2024-09-12T01:57:56.677701+0000","last_fullsized":"2024-09-12T01:57:56.677701+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:45.377030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678122+0000","last_change":"2024-09-12T01:57:54.108741+0000","last_active":"2024-09-12T01:57:56.678122+0000","last_peered":"2024-09-12T01:57:56.678122+0000","last_clean":"2024-09-12T01:57:56.678122+0000","last_became_active":"2024-09-12T01:57:54.108438+0000","last_became_peered":"2024-09-12T01:57:54.108438+0000","last_unstale":"2024-09-12T01:57:56.678122+0000","last_undegraded":"2024-09-12T01:57:56.678122+0000","last_fullsized":"2024-09-12T01:57:56.678122+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:55.997442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678076+0000","last_change":"2024-09-12T01:57:55.120230+0000","last_active":"2024-09-12T01:57:56.678076+0000","last_peered":"2024-09-12T01:57:56.678076+0000","last_clean":"2024-09-12T01:57:56.678076+0000","last_became_active":"2024-09-12T01:57:55.119950+0000","last_became_peered":"2024-09-12T01:57:55.119950+0000","last_unstale":"2024-09-12T01:57:56.678076+0000","last_undegraded":"2024-09-12T01:57:56.678076+0000","last_fullsized":"2024-09-12T01:57:56.678076+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:53.162142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677753+0000","last_change":"2024-09-12T01:57:54.100767+0000","last_active":"2024-09-12T01:57:56.677753+0000","last_peered":"2024-09-12T01:57:56.677753+0000","last_clean":"2024-09-12T01:57:56.677753+0000","last_became_active":"2024-09-12T01:57:54.100477+0000","last_became_peered":"2024-09-12T01:57:54.100477+0000","last_unstale":"2024-09-12T01:57:56.677753+0000","last_undegraded":"2024-09-12T01:57:56.677753+0000","last_fullsized":"2024-09-12T01:57:56.677753+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:48.798561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.107494+0000","last_change":"2024-09-12T01:57:55.115547+0000","last_active":"2024-09-12T01:57:56.107494+0000","last_peered":"2024-09-12T01:57:56.107494+0000","last_clean":"2024-09-12T01:57:56.107494+0000","last_became_active":"2024-09-12T01:57:55.115272+0000","last_became_peered":"2024-09-12T01:57:55.115272+0000","last_unstale":"2024-09-12T01:57:56.107494+0000","last_undegraded":"2024-09-12T01:57:56.107494+0000","last_fullsized":"2024-09-12T01:57:56.107494+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:20.569630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677698+0000","last_change":"2024-09-12T01:57:54.103283+0000","last_active":"2024-09-12T01:57:56.677698+0000","last_peered":"2024-09-12T01:57:56.677698+0000","last_clean":"2024-09-12T01:57:56.677698+0000","last_became_active":"2024-09-12T01:57:54.102991+0000","last_became_peered":"2024-09-12T01:57:54.102991+0000","last_unstale":"2024-09-12T01:57:56.677698+0000","last_undegraded":"2024-09-12T01:57:56.677698+0000","last_fullsized":"2024-09-12T01:57:56.677698+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:33.378187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677613+0000","last_change":"2024-09-12T01:57:55.132106+0000","last_active":"2024-09-12T01:57:56.677613+0000","last_peered":"2024-09-12T01:57:56.677613+0000","last_clean":"2024-09-12T01:57:56.677613+0000","last_became_active":"2024-09-12T01:57:55.131810+0000","last_became_peered":"2024-09-12T01:57:55.131810+0000","last_unstale":"2024-09-12T01:57:56.677613+0000","last_undegraded":"2024-09-12T01:57:56.677613+0000","last_fullsized":"2024-09-12T01:57:56.677613+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:26.681307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677686+0000","last_change":"2024-09-12T01:57:54.101888+0000","last_active":"2024-09-12T01:57:56.677686+0000","last_peered":"2024-09-12T01:57:56.677686+0000","last_clean":"2024-09-12T01:57:56.677686+0000","last_became_active":"2024-09-12T01:57:54.101626+0000","last_became_peered":"2024-09-12T01:57:54.101626+0000","last_unstale":"2024-09-12T01:57:56.677686+0000","last_undegraded":"2024-09-12T01:57:56.677686+0000","last_fullsized":"2024-09-12T01:57:56.677686+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:00.857513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.678157+0000","last_change":"2024-09-12T01:57:55.117995+0000","last_active":"2024-09-12T01:57:56.678157+0000","last_peered":"2024-09-12T01:57:56.678157+0000","last_clean":"2024-09-12T01:57:56.678157+0000","last_became_active":"2024-09-12T01:57:55.117702+0000","last_became_peered":"2024-09-12T01:57:55.117702+0000","last_unstale":"2024-09-12T01:57:56.678157+0000","last_undegraded":"2024-09-12T01:57:56.678157+0000","last_fullsized":"2024-09-12T01:57:56.678157+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:16.506163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.107513+0000","last_change":"2024-09-12T01:57:54.101287+0000","last_active":"2024-09-12T01:57:56.107513+0000","last_peered":"2024-09-12T01:57:56.107513+0000","last_clean":"2024-09-12T01:57:56.107513+0000","last_became_active":"2024-09-12T01:57:54.101005+0000","last_became_peered":"2024-09-12T01:57:54.101005+0000","last_unstale":"2024-09-12T01:57:56.107513+0000","last_undegraded":"2024-09-12T01:57:56.107513+0000","last_fullsized":"2024-09-12T01:57:56.107513+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:22.945753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.106499+0000","last_change":"2024-09-12T01:57:55.105460+0000","last_active":"2024-09-12T01:57:56.106499+0000","last_peered":"2024-09-12T01:57:56.106499+0000","last_clean":"2024-09-12T01:57:56.106499+0000","last_became_active":"2024-09-12T01:57:55.105115+0000","last_became_peered":"2024-09-12T01:57:55.105115+0000","last_unstale":"2024-09-12T01:57:56.106499+0000","last_undegraded":"2024-09-12T01:57:56.106499+0000","last_fullsized":"2024-09-12T01:57:56.106499+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:54.084725+0000","last_clean_scrub_stamp":"2024-09-12T01:57:54.084725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:55.965827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"54'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.677849+0000","last_change":"2024-09-12T01:57:54.106709+0000","last_active":"2024-09-12T01:57:56.677849+0000","last_peered":"2024-09-12T01:57:56.677849+0000","last_clean":"2024-09-12T01:57:56.677849+0000","last_became_active":"2024-09-12T01:57:54.106446+0000","last_became_peered":"2024-09-12T01:57:54.106446+0000","last_unstale":"2024-09-12T01:57:56.677849+0000","last_undegraded":"2024-09-12T01:57:56.677849+0000","last_fullsized":"2024-09-12T01:57:56.677849+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:57:53.080263+0000","last_clean_scrub_stamp":"2024-09-12T01:57:53.080263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:57.124282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":231,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T01:57:56.473960+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:57:56.473960+0000","last_peered":"2024-09-12T01:57:56.473960+0000","last_clean":"2024-09-12T01:57:56.473960+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:57:56.473960+0000","last_undegraded":"2024-09-12T01:57:56.473960+0000","last_fullsized":"2024-09-12T01:57:56.473960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509471,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1236992,"data_stored":875519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":643072,"data_stored":285679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509471,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":634880,"data_stored":285027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542175,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":286661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542175,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":647168,"data_stored":286639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":643072,"data_stored":285187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542175,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1236992,"data_stored":875451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":285609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:58:02.849 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:58:02.849 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T01:58:02.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.995+0000 7f69217cf640 1 Processor -- start 2024-09-12T01:58:02.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.995+0000 7f69217cf640 1 -- start start 2024-09-12T01:58:02.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.995+0000 7f69217cf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f691c145e50 0x7f691c0b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.995+0000 7f69217cf640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f691c06c320 0x7f691c165ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.995+0000 7f69217cf640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f691c15d8a0 con 0x7f691c15d350 2024-09-12T01:58:02.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.996+0000 7f69217cf640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f691c0b7230 con 0x7f691c145e50 2024-09-12T01:58:02.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.996+0000 7f69217cf640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f691c0ae420 con 0x7f691c06c320 2024-09-12T01:58:02.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.996+0000 7f691affd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f691c145e50 0x7f691c0b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.996+0000 7f691a7fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f691c15d350 0x7f691c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56968/0 (socket says 172.21.15.19:56968) 2024-09-12T01:58:02.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.996+0000 7f691a7fc640 1 -- 172.21.15.19:0/675027832 learned_addr learned my addr 172.21.15.19:0/675027832 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:02.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.996+0000 7f691b7fe640 1 --2- 172.21.15.19:0/675027832 >> v2:172.21.15.135:3300/0 conn(0x7f691c06c320 0x7f691c165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.996+0000 7f691affd640 1 -- 172.21.15.19:0/675027832 >> v2:172.21.15.135:3300/0 conn(0x7f691c06c320 msgr2=0x7f691c165ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:02.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.996+0000 7f691affd640 1 --2- 172.21.15.19:0/675027832 >> v2:172.21.15.135:3300/0 conn(0x7f691c06c320 0x7f691c165ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.996+0000 7f691affd640 1 -- 172.21.15.19:0/675027832 >> v1:172.21.15.19:6789/0 conn(0x7f691c15d350 legacy=0x7f691c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.996+0000 7f691affd640 1 -- 172.21.15.19:0/675027832 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691c15dba0 con 0x7f691c145e50 2024-09-12T01:58:02.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.996+0000 7f6919ffb640 1 -- 172.21.15.19:0/675027832 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 68539570 0 0) 0x7f691c15d8a0 con 0x7f691c15d350 2024-09-12T01:58:02.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.996+0000 7f691b7fe640 1 --2- 172.21.15.19:0/675027832 >> v2:172.21.15.135:3300/0 conn(0x7f691c06c320 0x7f691c165ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:02.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.997+0000 7f691affd640 1 --2- 172.21.15.19:0/675027832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f691c145e50 0x7f691c0b6cf0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f691c073f00 tx=0x7f690c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20030ad74f6dcb48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:02.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.997+0000 7f6919ffb640 1 -- 172.21.15.19:0/675027832 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690c037070 con 0x7f691c145e50 2024-09-12T01:58:02.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.997+0000 7f6919ffb640 1 -- 172.21.15.19:0/675027832 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f690c032440 con 0x7f691c145e50 2024-09-12T01:58:02.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.997+0000 7f6919ffb640 1 -- 172.21.15.19:0/675027832 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690c032810 con 0x7f691c145e50 2024-09-12T01:58:02.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.997+0000 7f69217cf640 1 -- 172.21.15.19:0/675027832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f691c145e50 msgr2=0x7f691c0b6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.997+0000 7f69217cf640 1 --2- 172.21.15.19:0/675027832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f691c145e50 0x7f691c0b6cf0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f691c073f00 tx=0x7f690c02a1a0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.998+0000 7f69217cf640 1 -- 172.21.15.19:0/675027832 shutdown_connections 2024-09-12T01:58:03.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.998+0000 7f69217cf640 1 --2- 172.21.15.19:0/675027832 >> v2:172.21.15.135:3300/0 conn(0x7f691c06c320 0x7f691c165ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.998+0000 7f69217cf640 1 --2- 172.21.15.19:0/675027832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f691c145e50 0x7f691c0b6cf0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.998+0000 7f69217cf640 1 -- 172.21.15.19:0/675027832 >> 172.21.15.19:0/675027832 conn(0x7f691c09aa30 msgr2=0x7f691c0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:03.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.998+0000 7f69217cf640 1 -- 172.21.15.19:0/675027832 shutdown_connections 2024-09-12T01:58:03.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.998+0000 7f69217cf640 1 -- 172.21.15.19:0/675027832 wait complete. 2024-09-12T01:58:03.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.999+0000 7f69217cf640 1 Processor -- start 2024-09-12T01:58:03.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:02.999+0000 7f69217cf640 1 -- start start 2024-09-12T01:58:03.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f69217cf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f691c06c320 0x7f691c0b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:03.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f69217cf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f691c145e50 0x7f691c13af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:03.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f69217cf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f691c15d350 0x7f691c15bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:03.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f69217cf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f691c15e160 con 0x7f691c06c320 2024-09-12T01:58:03.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f69217cf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f691c15e4d0 con 0x7f691c15d350 2024-09-12T01:58:03.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f69217cf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f691c15f970 con 0x7f691c145e50 2024-09-12T01:58:03.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f691affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f691c06c320 0x7f691c0b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:03.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f691affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f691c06c320 0x7f691c0b5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49998/0 (socket says 172.21.15.19:49998) 2024-09-12T01:58:03.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f691affd640 1 -- 172.21.15.19:0/2502744886 learned_addr learned my addr 172.21.15.19:0/2502744886 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:03.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f691b7fe640 1 --2- 172.21.15.19:0/2502744886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f691c15d350 0x7f691c15bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:03.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f691a7fc640 1 --2- 172.21.15.19:0/2502744886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f691c145e50 0x7f691c13af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:03.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f691affd640 1 -- 172.21.15.19:0/2502744886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f691c145e50 msgr2=0x7f691c13af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f691affd640 1 --2- 172.21.15.19:0/2502744886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f691c145e50 0x7f691c13af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f691affd640 1 -- 172.21.15.19:0/2502744886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f691c15d350 msgr2=0x7f691c15bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f691affd640 1 --2- 172.21.15.19:0/2502744886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f691c15d350 0x7f691c15bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f691affd640 1 -- 172.21.15.19:0/2502744886 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691c13a940 con 0x7f691c06c320 2024-09-12T01:58:03.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f691b7fe640 1 --2- 172.21.15.19:0/2502744886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f691c15d350 0x7f691c15bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:03.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f691affd640 1 --2- 172.21.15.19:0/2502744886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f691c06c320 0x7f691c0b5920 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f690c000c00 tx=0x7f690c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:03.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f69037fe640 1 -- 172.21.15.19:0/2502744886 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690c037050 con 0x7f691c06c320 2024-09-12T01:58:03.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f69037fe640 1 -- 172.21.15.19:0/2502744886 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f690c038040 con 0x7f691c06c320 2024-09-12T01:58:03.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.000+0000 7f69037fe640 1 -- 172.21.15.19:0/2502744886 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690c004470 con 0x7f691c06c320 2024-09-12T01:58:03.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.001+0000 7f69217cf640 1 -- 172.21.15.19:0/2502744886 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f691c137da0 con 0x7f691c06c320 2024-09-12T01:58:03.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.001+0000 7f69217cf640 1 -- 172.21.15.19:0/2502744886 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f691c138360 con 0x7f691c06c320 2024-09-12T01:58:03.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.002+0000 7f69217cf640 1 -- 172.21.15.19:0/2502744886 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f691c156e10 con 0x7f691c06c320 2024-09-12T01:58:03.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.002+0000 7f69037fe640 1 -- 172.21.15.19:0/2502744886 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f690c030900 con 0x7f691c06c320 2024-09-12T01:58:03.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.003+0000 7f69037fe640 1 --2- 172.21.15.19:0/2502744886 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f690806be30 0x7f690806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:03.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.003+0000 7f69037fe640 1 -- 172.21.15.19:0/2502744886 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f690c0abba0 con 0x7f691c06c320 2024-09-12T01:58:03.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.003+0000 7f691a7fc640 1 --2- 172.21.15.19:0/2502744886 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f690806be30 0x7f690806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:03.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.003+0000 7f691a7fc640 1 --2- 172.21.15.19:0/2502744886 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f690806be30 0x7f690806e2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f691c1f7360 tx=0x7f6910007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:03.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.007+0000 7f69037fe640 1 -- 172.21.15.19:0/2502744886 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f691c13a940 con 0x7f691c06c320 2024-09-12T01:58:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.253+0000 7f69217cf640 1 -- 172.21.15.19:0/2502744886 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f691c06dec0 con 0x7f691c06c320 2024-09-12T01:58:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.255+0000 7f69037fe640 1 -- 172.21.15.19:0/2502744886 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f690c07a570 con 0x7f691c06c320 2024-09-12T01:58:03.256 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-09-12T01:58:03.256 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDwSeJmfHbXIRAALAvdYAlaB6WxWtubFnlxRw== 2024-09-12T01:58:03.256 INFO:teuthology.orchestra.run.smithi019.stdout: caps mds = "allow" 2024-09-12T01:58:03.256 INFO:teuthology.orchestra.run.smithi019.stdout: caps mon = "allow r" 2024-09-12T01:58:03.256 INFO:teuthology.orchestra.run.smithi019.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T01:58:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:updated caps for client.0 2024-09-12T01:58:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.257+0000 7f69217cf640 1 -- 172.21.15.19:0/2502744886 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f690806be30 msgr2=0x7f690806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.257+0000 7f69217cf640 1 --2- 172.21.15.19:0/2502744886 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f690806be30 0x7f690806e2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f691c1f7360 tx=0x7f6910007c00 comp rx=0 tx=0).stop 2024-09-12T01:58:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.257+0000 7f69217cf640 1 -- 172.21.15.19:0/2502744886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f691c06c320 msgr2=0x7f691c0b5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.257+0000 7f69217cf640 1 --2- 172.21.15.19:0/2502744886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f691c06c320 0x7f691c0b5920 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f690c000c00 tx=0x7f690c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.257+0000 7f69217cf640 1 -- 172.21.15.19:0/2502744886 shutdown_connections 2024-09-12T01:58:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.257+0000 7f69217cf640 1 --2- 172.21.15.19:0/2502744886 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f690806be30 0x7f690806e2f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.257+0000 7f69217cf640 1 --2- 172.21.15.19:0/2502744886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f691c15d350 0x7f691c15bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.257+0000 7f69217cf640 1 --2- 172.21.15.19:0/2502744886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f691c145e50 0x7f691c13af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.257+0000 7f69217cf640 1 --2- 172.21.15.19:0/2502744886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f691c06c320 0x7f691c0b5920 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.257+0000 7f69217cf640 1 -- 172.21.15.19:0/2502744886 >> 172.21.15.19:0/2502744886 conn(0x7f691c09aa30 msgr2=0x7f691c0b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:03.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.258+0000 7f69217cf640 1 -- 172.21.15.19:0/2502744886 shutdown_connections 2024-09-12T01:58:03.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.258+0000 7f69217cf640 1 -- 172.21.15.19:0/2502744886 wait complete. 2024-09-12T01:58:03.269 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:58:03.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.371+0000 7f18b6d4b640 1 Processor -- start 2024-09-12T01:58:03.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.371+0000 7f18b6d4b640 1 -- start start 2024-09-12T01:58:03.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.372+0000 7f18b6d4b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f18b0162060 0x7f18b00b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.372+0000 7f18b6d4b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f18b00b64b0 0x7f18b00b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.372+0000 7f18b6d4b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18b006d9f0 con 0x7f18b0161c80 2024-09-12T01:58:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.372+0000 7f18b6d4b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f18b006dcd0 con 0x7f18b0162060 2024-09-12T01:58:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.372+0000 7f18b6d4b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f18b006dfb0 con 0x7f18b00b64b0 2024-09-12T01:58:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.372+0000 7f18affff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f18b0162060 0x7f18b00b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.373+0000 7f18affff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f18b0162060 0x7f18b00b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50006/0 (socket says 172.21.15.19:50006) 2024-09-12T01:58:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.373+0000 7f18affff640 1 -- 172.21.15.19:0/2726822893 learned_addr learned my addr 172.21.15.19:0/2726822893 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.373+0000 7f18b52e8640 1 --2- 172.21.15.19:0/2726822893 >> v2:172.21.15.135:3300/0 conn(0x7f18b00b64b0 0x7f18b00b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.373+0000 7f18affff640 1 -- 172.21.15.19:0/2726822893 >> v2:172.21.15.135:3300/0 conn(0x7f18b00b64b0 msgr2=0x7f18b00b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.373+0000 7f18affff640 1 --2- 172.21.15.19:0/2726822893 >> v2:172.21.15.135:3300/0 conn(0x7f18b00b64b0 0x7f18b00b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.373+0000 7f18affff640 1 -- 172.21.15.19:0/2726822893 >> v1:172.21.15.135:6789/0 conn(0x7f18b0161c80 legacy=0x7f18b006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:03.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.373+0000 7f18affff640 1 -- 172.21.15.19:0/2726822893 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b00d01f0 con 0x7f18b0162060 2024-09-12T01:58:03.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.373+0000 7f18b52e8640 1 --2- 172.21.15.19:0/2726822893 >> v2:172.21.15.135:3300/0 conn(0x7f18b00b64b0 0x7f18b00b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:03.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.374+0000 7f18affff640 1 --2- 172.21.15.19:0/2726822893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b0162060 0x7f18b00b5f70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f18b008d750 tx=0x7f18a402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f817e44df0bfb92a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:03.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.374+0000 7f18af7fe640 1 -- 172.21.15.19:0/2726822893 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4037070 con 0x7f18b0162060 2024-09-12T01:58:03.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.374+0000 7f18af7fe640 1 -- 172.21.15.19:0/2726822893 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a4032440 con 0x7f18b0162060 2024-09-12T01:58:03.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.374+0000 7f18af7fe640 1 -- 172.21.15.19:0/2726822893 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4032810 con 0x7f18b0162060 2024-09-12T01:58:03.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.374+0000 7f18b6d4b640 1 -- 172.21.15.19:0/2726822893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b0162060 msgr2=0x7f18b00b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.374+0000 7f18b6d4b640 1 --2- 172.21.15.19:0/2726822893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b0162060 0x7f18b00b5f70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f18b008d750 tx=0x7f18a402a230 comp rx=0 tx=0).stop 2024-09-12T01:58:03.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.374+0000 7f18b6d4b640 1 -- 172.21.15.19:0/2726822893 shutdown_connections 2024-09-12T01:58:03.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.374+0000 7f18b6d4b640 1 --2- 172.21.15.19:0/2726822893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b0162060 0x7f18b00b5f70 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.374+0000 7f18b6d4b640 1 --2- 172.21.15.19:0/2726822893 >> v2:172.21.15.135:3300/0 conn(0x7f18b00b64b0 0x7f18b00b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.374+0000 7f18b6d4b640 1 -- 172.21.15.19:0/2726822893 >> 172.21.15.19:0/2726822893 conn(0x7f18b00d44f0 msgr2=0x7f18b00d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:03.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.374+0000 7f18b6d4b640 1 -- 172.21.15.19:0/2726822893 shutdown_connections 2024-09-12T01:58:03.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.374+0000 7f18b6d4b640 1 -- 172.21.15.19:0/2726822893 wait complete. 2024-09-12T01:58:03.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.376+0000 7f18b6d4b640 1 Processor -- start 2024-09-12T01:58:03.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.376+0000 7f18b6d4b640 1 -- start start 2024-09-12T01:58:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18b6d4b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18b00b64b0 0x7f18b00ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18b6d4b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b0161c80 0x7f18b014f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18b6d4b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18b0162060 0x7f18b00cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18b6d4b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f18b00cf1e0 con 0x7f18b0161c80 2024-09-12T01:58:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18b6d4b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f18b00d2aa0 con 0x7f18b0162060 2024-09-12T01:58:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18b6d4b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f18b00cf360 con 0x7f18b00b64b0 2024-09-12T01:58:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18affff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b0161c80 0x7f18b014f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18affff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b0161c80 0x7f18b014f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50014/0 (socket says 172.21.15.19:50014) 2024-09-12T01:58:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18affff640 1 -- 172.21.15.19:0/119363821 learned_addr learned my addr 172.21.15.19:0/119363821 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18b52e8640 1 --2- 172.21.15.19:0/119363821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18b0162060 0x7f18b00cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18b4ae7640 1 --2- 172.21.15.19:0/119363821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18b00b64b0 0x7f18b00ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18affff640 1 -- 172.21.15.19:0/119363821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18b00b64b0 msgr2=0x7f18b00ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18affff640 1 --2- 172.21.15.19:0/119363821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18b00b64b0 0x7f18b00ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18affff640 1 -- 172.21.15.19:0/119363821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18b0162060 msgr2=0x7f18b00cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18affff640 1 --2- 172.21.15.19:0/119363821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18b0162060 0x7f18b00cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18affff640 1 -- 172.21.15.19:0/119363821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b00cbec0 con 0x7f18b0161c80 2024-09-12T01:58:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18affff640 1 --2- 172.21.15.19:0/119363821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b0161c80 0x7f18b014f810 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f18a402a270 tx=0x7f18a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18ad7fa640 1 -- 172.21.15.19:0/119363821 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4037040 con 0x7f18b0161c80 2024-09-12T01:58:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18ad7fa640 1 -- 172.21.15.19:0/119363821 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a4042070 con 0x7f18b0161c80 2024-09-12T01:58:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18b6d4b640 1 -- 172.21.15.19:0/119363821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b00cc1a0 con 0x7f18b0161c80 2024-09-12T01:58:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.377+0000 7f18ad7fa640 1 -- 172.21.15.19:0/119363821 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4030bb0 con 0x7f18b0161c80 2024-09-12T01:58:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.378+0000 7f18b6d4b640 1 -- 172.21.15.19:0/119363821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b00cc760 con 0x7f18b0161c80 2024-09-12T01:58:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.378+0000 7f18b6d4b640 1 -- 172.21.15.19:0/119363821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b00b5f70 con 0x7f18b0161c80 2024-09-12T01:58:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.379+0000 7f18ad7fa640 1 -- 172.21.15.19:0/119363821 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18a4047460 con 0x7f18b0161c80 2024-09-12T01:58:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.379+0000 7f18ad7fa640 1 --2- 172.21.15.19:0/119363821 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f189c06be30 0x7f189c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.379+0000 7f18ad7fa640 1 -- 172.21.15.19:0/119363821 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f18a40abb30 con 0x7f18b0161c80 2024-09-12T01:58:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.380+0000 7f18b4ae7640 1 --2- 172.21.15.19:0/119363821 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f189c06be30 0x7f189c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.380+0000 7f18b4ae7640 1 --2- 172.21.15.19:0/119363821 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f189c06be30 0x7f189c06e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f18b015f720 tx=0x7f18a0007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:03.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.384+0000 7f18ad7fa640 1 -- 172.21.15.19:0/119363821 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18a4079d00 con 0x7f18b0161c80 2024-09-12T01:58:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.595+0000 7f18b6d4b640 1 -- 172.21.15.19:0/119363821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18b00d07c0 con 0x7f18b0161c80 2024-09-12T01:58:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.595+0000 7f18ad7fa640 1 -- 172.21.15.19:0/119363821 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7f18a407e000 con 0x7f18b0161c80 2024-09-12T01:58:03.596 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:03.596 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-12T01:57:57:118704+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/4076449352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4076449352},{"type":"v1","addr":"172.21.15.135:6836","nonce":4076449352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1361756714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1361756714},{"type":"v1","addr":"172.21.15.135:6837","nonce":1361756714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3926640523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3926640523},{"type":"v1","addr":"172.21.15.19:6833","nonce":3926640523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:57:54.505612+0000","modified":"2024-09-12T01:57:56.457812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5421":{"gid":5421,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/1076479859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1076479859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1076479859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5421,"qdb_cluster":[5421]},"id":3}]} 2024-09-12T01:58:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-12T01:58:03.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.598+0000 7f18b6d4b640 1 -- 172.21.15.19:0/119363821 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f189c06be30 msgr2=0x7f189c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.598+0000 7f18b6d4b640 1 --2- 172.21.15.19:0/119363821 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f189c06be30 0x7f189c06e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f18b015f720 tx=0x7f18a0007e30 comp rx=0 tx=0).stop 2024-09-12T01:58:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.598+0000 7f18b6d4b640 1 -- 172.21.15.19:0/119363821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b0161c80 msgr2=0x7f18b014f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.598+0000 7f18b6d4b640 1 --2- 172.21.15.19:0/119363821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b0161c80 0x7f18b014f810 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f18a402a270 tx=0x7f18a40046c0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.598+0000 7f18b6d4b640 1 -- 172.21.15.19:0/119363821 shutdown_connections 2024-09-12T01:58:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.598+0000 7f18b6d4b640 1 --2- 172.21.15.19:0/119363821 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f189c06be30 0x7f189c06e2f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.598+0000 7f18b6d4b640 1 --2- 172.21.15.19:0/119363821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18b0162060 0x7f18b00cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.598+0000 7f18b6d4b640 1 --2- 172.21.15.19:0/119363821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18b0161c80 0x7f18b014f810 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.598+0000 7f18b6d4b640 1 --2- 172.21.15.19:0/119363821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18b00b64b0 0x7f18b00ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.598+0000 7f18b6d4b640 1 -- 172.21.15.19:0/119363821 >> 172.21.15.19:0/119363821 conn(0x7f18b00d44f0 msgr2=0x7f18b00b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.598+0000 7f18b6d4b640 1 -- 172.21.15.19:0/119363821 shutdown_connections 2024-09-12T01:58:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:03.598+0000 7f18b6d4b640 1 -- 172.21.15.19:0/119363821 wait complete. 2024-09-12T01:58:04.012 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:57:54.505612+0000', 'modified': '2024-09-12T01:57:56.457812+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5421}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5421': {'gid': 5421, 'name': 'a', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.19:6835/1076479859', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6834', 'nonce': 1076479859}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 1076479859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5421, 'qdb_cluster': [5421]} 2024-09-12T01:58:04.013 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:58:04.013 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T01:58:04.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.120+0000 7f22410af640 1 Processor -- start 2024-09-12T01:58:04.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.121+0000 7f22410af640 1 -- start start 2024-09-12T01:58:04.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.121+0000 7f22410af640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f223c161c80 0x7f223c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.121+0000 7f22410af640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f223c162060 0x7f223c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.121+0000 7f22410af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f223c0b64b0 0x7f223c0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.121+0000 7f22410af640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f223c06e870 con 0x7f223c161c80 2024-09-12T01:58:04.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.121+0000 7f22410af640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f223c06d9f0 con 0x7f223c162060 2024-09-12T01:58:04.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.121+0000 7f22410af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f223c06dcd0 con 0x7f223c0b64b0 2024-09-12T01:58:04.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.121+0000 7f223ad9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f223c161c80 0x7f223c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.122+0000 7f223ad9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f223c161c80 0x7f223c06e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50030/0 (socket says 172.21.15.19:50030) 2024-09-12T01:58:04.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.122+0000 7f223ad9d640 1 -- 172.21.15.19:0/1000496383 learned_addr learned my addr 172.21.15.19:0/1000496383 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:04.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.122+0000 7f223a59c640 1 --2- 172.21.15.19:0/1000496383 >> v2:172.21.15.135:3300/0 conn(0x7f223c162060 0x7f223c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.122+0000 7f223b59e640 1 --2- 172.21.15.19:0/1000496383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f223c0b64b0 0x7f223c0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.122+0000 7f223ad9d640 1 -- 172.21.15.19:0/1000496383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f223c0b64b0 msgr2=0x7f223c0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:04.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.122+0000 7f223ad9d640 1 --2- 172.21.15.19:0/1000496383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f223c0b64b0 0x7f223c0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.122+0000 7f223ad9d640 1 -- 172.21.15.19:0/1000496383 >> v2:172.21.15.135:3300/0 conn(0x7f223c162060 msgr2=0x7f223c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:04.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.122+0000 7f223ad9d640 1 --2- 172.21.15.19:0/1000496383 >> v2:172.21.15.135:3300/0 conn(0x7f223c162060 0x7f223c0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.122+0000 7f223ad9d640 1 -- 172.21.15.19:0/1000496383 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223c06dfb0 con 0x7f223c161c80 2024-09-12T01:58:04.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.122+0000 7f223a59c640 1 --2- 172.21.15.19:0/1000496383 >> v2:172.21.15.135:3300/0 conn(0x7f223c162060 0x7f223c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:04.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.122+0000 7f223ad9d640 1 --2- 172.21.15.19:0/1000496383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223c161c80 0x7f223c06e330 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f223c08e830 tx=0x7f222c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc3d522a4af5703 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.123+0000 7f2239d9b640 1 -- 172.21.15.19:0/1000496383 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c037070 con 0x7f223c161c80 2024-09-12T01:58:04.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.123+0000 7f2239d9b640 1 -- 172.21.15.19:0/1000496383 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f222c032440 con 0x7f223c161c80 2024-09-12T01:58:04.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.123+0000 7f2239d9b640 1 -- 172.21.15.19:0/1000496383 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c032810 con 0x7f223c161c80 2024-09-12T01:58:04.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.123+0000 7f22410af640 1 -- 172.21.15.19:0/1000496383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223c161c80 msgr2=0x7f223c06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.123+0000 7f22410af640 1 --2- 172.21.15.19:0/1000496383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223c161c80 0x7f223c06e330 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f223c08e830 tx=0x7f222c02a1e0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.123+0000 7f22410af640 1 -- 172.21.15.19:0/1000496383 shutdown_connections 2024-09-12T01:58:04.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.123+0000 7f22410af640 1 --2- 172.21.15.19:0/1000496383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f223c0b64b0 0x7f223c0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.123+0000 7f22410af640 1 --2- 172.21.15.19:0/1000496383 >> v2:172.21.15.135:3300/0 conn(0x7f223c162060 0x7f223c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.123+0000 7f22410af640 1 --2- 172.21.15.19:0/1000496383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223c161c80 0x7f223c06e330 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.123+0000 7f22410af640 1 -- 172.21.15.19:0/1000496383 >> 172.21.15.19:0/1000496383 conn(0x7f223c0d44f0 msgr2=0x7f223c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:04.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.123+0000 7f22410af640 1 -- 172.21.15.19:0/1000496383 shutdown_connections 2024-09-12T01:58:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.123+0000 7f22410af640 1 -- 172.21.15.19:0/1000496383 wait complete. 2024-09-12T01:58:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.125+0000 7f22410af640 1 Processor -- start 2024-09-12T01:58:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.125+0000 7f22410af640 1 -- start start 2024-09-12T01:58:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.125+0000 7f22410af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f223c0b64b0 0x7f223c0b9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.125+0000 7f22410af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223c161c80 0x7f223c15b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.125+0000 7f22410af640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f223c162060 0x7f223c15eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.125+0000 7f22410af640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f223c162500 con 0x7f223c161c80 2024-09-12T01:58:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.125+0000 7f22410af640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f223c0d2aa0 con 0x7f223c162060 2024-09-12T01:58:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.126+0000 7f22410af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f223c162680 con 0x7f223c0b64b0 2024-09-12T01:58:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.126+0000 7f223a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223c161c80 0x7f223c15b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.126+0000 7f223a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223c161c80 0x7f223c15b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50040/0 (socket says 172.21.15.19:50040) 2024-09-12T01:58:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.126+0000 7f223a59c640 1 -- 172.21.15.19:0/171688797 learned_addr learned my addr 172.21.15.19:0/171688797 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.126+0000 7f223ad9d640 1 --2- 172.21.15.19:0/171688797 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f223c0b64b0 0x7f223c0b9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.126+0000 7f223a59c640 1 -- 172.21.15.19:0/171688797 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f223c0b64b0 msgr2=0x7f223c0b9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.126+0000 7f223a59c640 1 --2- 172.21.15.19:0/171688797 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f223c0b64b0 0x7f223c0b9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.126+0000 7f223b59e640 1 --2- 172.21.15.19:0/171688797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f223c162060 0x7f223c15eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.126+0000 7f223a59c640 1 -- 172.21.15.19:0/171688797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f223c162060 msgr2=0x7f223c15eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.126+0000 7f223a59c640 1 --2- 172.21.15.19:0/171688797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f223c162060 0x7f223c15eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.126+0000 7f223a59c640 1 -- 172.21.15.19:0/171688797 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223c0b9390 con 0x7f223c161c80 2024-09-12T01:58:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.126+0000 7f223b59e640 1 --2- 172.21.15.19:0/171688797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f223c162060 0x7f223c15eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.126+0000 7f223a59c640 1 --2- 172.21.15.19:0/171688797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223c161c80 0x7f223c15b010 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f223000d800 tx=0x7f223000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.126+0000 7f22237fe640 1 -- 172.21.15.19:0/171688797 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2230004030 con 0x7f223c161c80 2024-09-12T01:58:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.126+0000 7f22237fe640 1 -- 172.21.15.19:0/171688797 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22300041d0 con 0x7f223c161c80 2024-09-12T01:58:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.126+0000 7f22410af640 1 -- 172.21.15.19:0/171688797 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f223c15a530 con 0x7f223c161c80 2024-09-12T01:58:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.126+0000 7f22237fe640 1 -- 172.21.15.19:0/171688797 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22300096a0 con 0x7f223c161c80 2024-09-12T01:58:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.126+0000 7f22410af640 1 -- 172.21.15.19:0/171688797 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f223c15aaf0 con 0x7f223c161c80 2024-09-12T01:58:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.128+0000 7f22237fe640 1 -- 172.21.15.19:0/171688797 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2230009840 con 0x7f223c161c80 2024-09-12T01:58:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.129+0000 7f22237fe640 1 --2- 172.21.15.19:0/171688797 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f222806be30 0x7f222806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.129+0000 7f22237fe640 1 -- 172.21.15.19:0/171688797 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f223008b310 con 0x7f223c161c80 2024-09-12T01:58:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.129+0000 7f223ad9d640 1 --2- 172.21.15.19:0/171688797 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f222806be30 0x7f222806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.129+0000 7f2243e40740 1 Processor -- start 2024-09-12T01:58:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.129+0000 7f223ad9d640 1 --2- 172.21.15.19:0/171688797 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f222806be30 0x7f222806e2f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f222c034000 tx=0x7f222c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.130+0000 7f2243e40740 1 -- start start 2024-09-12T01:58:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.130+0000 7f2243e40740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bc9c2c0 0x55fc6bce1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.130+0000 7f2243e40740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bc99a80 0x55fc6bc9c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.130+0000 7f2243e40740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9da50 0x55fc6bc968b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.130+0000 7f2243e40740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fc6bbfe520 con 0x55fc6bc9c2c0 2024-09-12T01:58:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.130+0000 7f2243e40740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fc6bba63e0 con 0x55fc6bc99a80 2024-09-12T01:58:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.130+0000 7f2243e40740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55fc6bbfa4e0 con 0x55fc6bc9da50 2024-09-12T01:58:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.130+0000 7f223ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bc9c2c0 0x55fc6bce1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.130+0000 7f223ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bc9c2c0 0x55fc6bce1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50052/0 (socket says 172.21.15.19:50052) 2024-09-12T01:58:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.130+0000 7f223ad9d640 1 -- 172.21.15.19:0/1413484673 learned_addr learned my addr 172.21.15.19:0/1413484673 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.130+0000 7f223b59e640 1 --2- 172.21.15.19:0/1413484673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9da50 0x55fc6bc968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.130+0000 7f223a59c640 1 --2- 172.21.15.19:0/1413484673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bc99a80 0x55fc6bc9c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.131+0000 7f223ad9d640 1 -- 172.21.15.19:0/1413484673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9da50 msgr2=0x55fc6bc968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:04.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.131+0000 7f223ad9d640 1 --2- 172.21.15.19:0/1413484673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9da50 0x55fc6bc968b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.131+0000 7f223ad9d640 1 -- 172.21.15.19:0/1413484673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bc99a80 msgr2=0x55fc6bc9c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:04.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.131+0000 7f223ad9d640 1 --2- 172.21.15.19:0/1413484673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bc99a80 0x55fc6bc9c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.131+0000 7f223ad9d640 1 -- 172.21.15.19:0/1413484673 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc6bbc12f0 con 0x55fc6bc9c2c0 2024-09-12T01:58:04.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.131+0000 7f223a59c640 1 --2- 172.21.15.19:0/1413484673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bc99a80 0x55fc6bc9c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:04.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.131+0000 7f223ad9d640 1 --2- 172.21.15.19:0/1413484673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bc9c2c0 0x55fc6bce1a60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f222c009930 tx=0x7f222c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c168d8058edc98f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.131+0000 7f2220ff9640 1 -- 172.21.15.19:0/1413484673 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c04b070 con 0x55fc6bc9c2c0 2024-09-12T01:58:04.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.131+0000 7f2220ff9640 1 -- 172.21.15.19:0/1413484673 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f222c032df0 con 0x55fc6bc9c2c0 2024-09-12T01:58:04.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.131+0000 7f2220ff9640 1 -- 172.21.15.19:0/1413484673 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c037040 con 0x55fc6bc9c2c0 2024-09-12T01:58:04.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.132+0000 7f2243e40740 1 -- 172.21.15.19:0/1413484673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bc9c2c0 msgr2=0x55fc6bce1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.132+0000 7f2243e40740 1 --2- 172.21.15.19:0/1413484673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bc9c2c0 0x55fc6bce1a60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f222c009930 tx=0x7f222c02c000 comp rx=0 tx=0).stop 2024-09-12T01:58:04.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.132+0000 7f2243e40740 1 -- 172.21.15.19:0/1413484673 shutdown_connections 2024-09-12T01:58:04.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.132+0000 7f2243e40740 1 --2- 172.21.15.19:0/1413484673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9da50 0x55fc6bc968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.132+0000 7f2243e40740 1 --2- 172.21.15.19:0/1413484673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bc99a80 0x55fc6bc9c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.132+0000 7f2243e40740 1 --2- 172.21.15.19:0/1413484673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bc9c2c0 0x55fc6bce1a60 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.132+0000 7f2243e40740 1 -- 172.21.15.19:0/1413484673 >> 172.21.15.19:0/1413484673 conn(0x55fc6bc98a80 msgr2=0x55fc6bce0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:04.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.132+0000 7f2243e40740 1 -- 172.21.15.19:0/1413484673 shutdown_connections 2024-09-12T01:58:04.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.132+0000 7f2243e40740 1 -- 172.21.15.19:0/1413484673 wait complete. 2024-09-12T01:58:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.132+0000 7f2243e40740 1 -- start start 2024-09-12T01:58:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.132+0000 7f2243e40740 1 Processor -- start 2024-09-12T01:58:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.133+0000 7f2243e40740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9c2c0 0x55fc6bc976b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.133+0000 7f2243e40740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bc9da50 0x55fc6bcba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.133+0000 7f2243e40740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bcc6a00 0x55fc6bc9a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.133+0000 7f2243e40740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fc6bc97f20 con 0x55fc6bc9da50 2024-09-12T01:58:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.133+0000 7f2243e40740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fc6bb87450 con 0x55fc6bcc6a00 2024-09-12T01:58:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.133+0000 7f2243e40740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55fc6bce2290 con 0x55fc6bc9c2c0 2024-09-12T01:58:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.133+0000 7f2243e40740 10 client.0 _ll_register_callbacks cb 0x55fc6b910ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.133+0000 7f223a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bc9da50 0x55fc6bcba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.133+0000 7f223a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bc9da50 0x55fc6bcba4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50060/0 (socket says 172.21.15.19:50060) 2024-09-12T01:58:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.133+0000 7f223a59c640 1 -- 172.21.15.19:0/389621552 learned_addr learned my addr 172.21.15.19:0/389621552 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.133+0000 7f223ad9d640 1 --2- 172.21.15.19:0/389621552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9c2c0 0x55fc6bc976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.133+0000 7f223b59e640 1 --2- 172.21.15.19:0/389621552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bcc6a00 0x55fc6bc9a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f223a59c640 1 -- 172.21.15.19:0/389621552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9c2c0 msgr2=0x55fc6bc976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f223a59c640 1 --2- 172.21.15.19:0/389621552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9c2c0 0x55fc6bc976b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f223a59c640 1 -- 172.21.15.19:0/389621552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bcc6a00 msgr2=0x55fc6bc9a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f223a59c640 1 --2- 172.21.15.19:0/389621552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bcc6a00 0x55fc6bc9a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f223a59c640 1 -- 172.21.15.19:0/389621552 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc6b9112d0 con 0x55fc6bc9da50 2024-09-12T01:58:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f223a59c640 1 --2- 172.21.15.19:0/389621552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bc9da50 0x55fc6bcba4f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2230009490 tx=0x7f2230059c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf339cac2e1a60ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f2219ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:58:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f2219ffb640 1 -- 172.21.15.19:0/389621552 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2230087060 con 0x55fc6bc9da50 2024-09-12T01:58:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f2219ffb640 1 -- 172.21.15.19:0/389621552 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f2230055a90 con 0x55fc6bc9da50 2024-09-12T01:58:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f2243e40740 1 -- 172.21.15.19:0/389621552 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f222c032df0 con 0x55fc6bc9da50 2024-09-12T01:58:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f2219ffb640 1 -- 172.21.15.19:0/389621552 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2230076050 con 0x55fc6bc9da50 2024-09-12T01:58:04.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f2243e40740 10 client.5589 fetch_fsmap learned FSMap version 27 2024-09-12T01:58:04.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f2243e40740 1 -- 172.21.15.19:0/389621552 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55fc6b9db6b0 con 0x55fc6bc9da50 2024-09-12T01:58:04.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f2219ffb640 1 -- 172.21.15.19:0/389621552 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f222c032df0 con 0x55fc6bc9da50 2024-09-12T01:58:04.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f2219ffb640 1 -- 172.21.15.19:0/389621552 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f2230013070 con 0x55fc6bc9da50 2024-09-12T01:58:04.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f2243e40740 10 client.5589 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:58:04.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f2243e40740 10 client.5589 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T01:58:04.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f2243e40740 20 client.5589 populate_metadata read hostname 'smithi019' 2024-09-12T01:58:04.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f2243e40740 1 --2- 172.21.15.19:0/389621552 >> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] conn(0x55fc6bc95850 0x55fc6bc95c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f2243e40740 4 client.5589 mds_command: new command op to 5421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:04.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.134+0000 7f2243e40740 1 -- 172.21.15.19:0/389621552 --> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc6bc0bc50 con 0x55fc6bc95850 2024-09-12T01:58:04.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.135+0000 7f223ad9d640 1 --2- 172.21.15.19:0/389621552 >> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] conn(0x55fc6bc95850 0x55fc6bc95c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.135+0000 7f223ad9d640 1 --2- 172.21.15.19:0/389621552 >> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] conn(0x55fc6bc95850 0x55fc6bc95c30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=614fbebbefa8c0c2 server_cookie=868834fe9682f67 in_seq=0 out_seq=0 2024-09-12T01:58:04.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.135+0000 7f2219ffb640 10 client.5589 ms_handle_connect on v2:172.21.15.19:6834/1076479859 2024-09-12T01:58:04.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.135+0000 7f2219ffb640 1 -- 172.21.15.19:0/389621552 <== mds.0 v2:172.21.15.19:6834/1076479859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fc6bc0bc50 con 0x55fc6bc95850 2024-09-12T01:58:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.135+0000 7f2219ffb640 10 client.5589 handle_command_reply: tid=0 2024-09-12T01:58:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.136+0000 7f2243e40740 1 client.5589 shutdown 2024-09-12T01:58:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.136+0000 7f2243e40740 1 -- 172.21.15.19:0/389621552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bc9da50 msgr2=0x55fc6bcba4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.136+0000 7f2243e40740 1 --2- 172.21.15.19:0/389621552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bc9da50 0x55fc6bcba4f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2230009490 tx=0x7f2230059c60 comp rx=0 tx=0).stop 2024-09-12T01:58:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.136+0000 7f2243e40740 1 -- 172.21.15.19:0/389621552 shutdown_connections 2024-09-12T01:58:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.136+0000 7f2243e40740 1 --2- 172.21.15.19:0/389621552 >> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] conn(0x55fc6bc95850 0x55fc6bc95c30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.136+0000 7f2243e40740 1 --2- 172.21.15.19:0/389621552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bcc6a00 0x55fc6bc9a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.136+0000 7f2219ffb640 0 client.5589 ms_handle_reset on v2:172.21.15.19:6834/1076479859 2024-09-12T01:58:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.136+0000 7f2243e40740 1 --2- 172.21.15.19:0/389621552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bc9da50 0x55fc6bcba4f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.136+0000 7f2243e40740 1 --2- 172.21.15.19:0/389621552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9c2c0 0x55fc6bc976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.136+0000 7f2243e40740 1 -- 172.21.15.19:0/389621552 >> 172.21.15.19:0/389621552 conn(0x55fc6bc99a80 msgr2=0x55fc6bce0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.136+0000 7f2243e40740 1 -- 172.21.15.19:0/389621552 shutdown_connections 2024-09-12T01:58:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.136+0000 7f2243e40740 1 -- 172.21.15.19:0/389621552 wait complete. 2024-09-12T01:58:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.136+0000 7f2243e40740 20 client.5589 trim_cache size 0 max 16384 2024-09-12T01:58:04.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.156+0000 7f2243e40740 1 Processor -- start 2024-09-12T01:58:04.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.156+0000 7f2243e40740 1 -- start start 2024-09-12T01:58:04.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.156+0000 7f2243e40740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9c2c0 0x55fc6bce15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f2243e40740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bc9da50 0x55fc6bd050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f2243e40740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bcc6a00 0x55fc6bce2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f2243e40740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f223c2002a0 con 0x55fc6bcc6a00 2024-09-12T01:58:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f2243e40740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f223c0b8100 con 0x55fc6bc9da50 2024-09-12T01:58:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f2243e40740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f223c0cc240 con 0x55fc6bc9c2c0 2024-09-12T01:58:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f223b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bcc6a00 0x55fc6bce2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f223b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bcc6a00 0x55fc6bce2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50070/0 (socket says 172.21.15.19:50070) 2024-09-12T01:58:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f223b59e640 1 -- 172.21.15.19:0/1764970109 learned_addr learned my addr 172.21.15.19:0/1764970109 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f223ad9d640 1 --2- 172.21.15.19:0/1764970109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9c2c0 0x55fc6bce15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f223a59c640 1 --2- 172.21.15.19:0/1764970109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bc9da50 0x55fc6bd050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f223b59e640 1 -- 172.21.15.19:0/1764970109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9c2c0 msgr2=0x55fc6bce15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f223b59e640 1 --2- 172.21.15.19:0/1764970109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9c2c0 0x55fc6bce15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f223b59e640 1 -- 172.21.15.19:0/1764970109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bc9da50 msgr2=0x55fc6bd050f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f223b59e640 1 --2- 172.21.15.19:0/1764970109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bc9da50 0x55fc6bd050f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f223b59e640 1 -- 172.21.15.19:0/1764970109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc6bcc4e70 con 0x55fc6bcc6a00 2024-09-12T01:58:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f223b59e640 1 --2- 172.21.15.19:0/1764970109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bcc6a00 0x55fc6bce2a90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55fc6bcc6e00 tx=0x7f2234009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3be0edfb690b8e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f221bfff640 1 -- 172.21.15.19:0/1764970109 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223401e070 con 0x55fc6bcc6a00 2024-09-12T01:58:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f221bfff640 1 -- 172.21.15.19:0/1764970109 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22340158c0 con 0x55fc6bcc6a00 2024-09-12T01:58:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.157+0000 7f221bfff640 1 -- 172.21.15.19:0/1764970109 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2234015c70 con 0x55fc6bcc6a00 2024-09-12T01:58:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.158+0000 7f2243e40740 1 -- 172.21.15.19:0/1764970109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bcc6a00 msgr2=0x55fc6bce2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.158+0000 7f2243e40740 1 --2- 172.21.15.19:0/1764970109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bcc6a00 0x55fc6bce2a90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55fc6bcc6e00 tx=0x7f2234009750 comp rx=0 tx=0).stop 2024-09-12T01:58:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.158+0000 7f2243e40740 1 -- 172.21.15.19:0/1764970109 shutdown_connections 2024-09-12T01:58:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.158+0000 7f2243e40740 1 --2- 172.21.15.19:0/1764970109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bcc6a00 0x55fc6bce2a90 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.158+0000 7f2243e40740 1 --2- 172.21.15.19:0/1764970109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bc9da50 0x55fc6bd050f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.158+0000 7f2243e40740 1 --2- 172.21.15.19:0/1764970109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9c2c0 0x55fc6bce15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.158+0000 7f2243e40740 1 -- 172.21.15.19:0/1764970109 >> 172.21.15.19:0/1764970109 conn(0x55fc6bc99a80 msgr2=0x55fc6bce0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.158+0000 7f2243e40740 1 -- 172.21.15.19:0/1764970109 shutdown_connections 2024-09-12T01:58:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.158+0000 7f2243e40740 1 -- 172.21.15.19:0/1764970109 wait complete. 2024-09-12T01:58:04.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.159+0000 7f2243e40740 1 -- start start 2024-09-12T01:58:04.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.159+0000 7f2243e40740 1 Processor -- start 2024-09-12T01:58:04.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.159+0000 7f2243e40740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9c2c0 0x55fc6bc9b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.159+0000 7f2243e40740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bc9da50 0x55fc6bc9ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.159+0000 7f2243e40740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bcc6a00 0x55fc6bc95c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f2243e40740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fc6bcc5370 con 0x55fc6bcc6a00 2024-09-12T01:58:04.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f2243e40740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fc6bcbaa30 con 0x55fc6bc9da50 2024-09-12T01:58:04.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f2243e40740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55fc6bcbcd10 con 0x55fc6bc9c2c0 2024-09-12T01:58:04.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f2243e40740 10 client.0 _ll_register_callbacks cb 0x7f2230059210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:04.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f223b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bcc6a00 0x55fc6bc95c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f223b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bcc6a00 0x55fc6bc95c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50082/0 (socket says 172.21.15.19:50082) 2024-09-12T01:58:04.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f223b59e640 1 -- 172.21.15.19:0/1210943215 learned_addr learned my addr 172.21.15.19:0/1210943215 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:04.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f223a59c640 1 --2- 172.21.15.19:0/1210943215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bc9da50 0x55fc6bc9ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f223ad9d640 1 --2- 172.21.15.19:0/1210943215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9c2c0 0x55fc6bc9b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f223b59e640 1 -- 172.21.15.19:0/1210943215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9c2c0 msgr2=0x55fc6bc9b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:04.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f223b59e640 1 --2- 172.21.15.19:0/1210943215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9c2c0 0x55fc6bc9b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f223b59e640 1 -- 172.21.15.19:0/1210943215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bc9da50 msgr2=0x55fc6bc9ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:04.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f223b59e640 1 --2- 172.21.15.19:0/1210943215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bc9da50 0x55fc6bc9ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f223b59e640 1 -- 172.21.15.19:0/1210943215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc6bcc5bb0 con 0x55fc6bcc6a00 2024-09-12T01:58:04.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f223b59e640 1 --2- 172.21.15.19:0/1210943215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bcc6a00 0x55fc6bc95c30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x55fc6bb87550 tx=0x7f2234004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dc30454859ddb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f2219ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:58:04.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f2219ffb640 1 -- 172.21.15.19:0/1210943215 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223401e040 con 0x55fc6bcc6a00 2024-09-12T01:58:04.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f2243e40740 1 -- 172.21.15.19:0/1210943215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22340158c0 con 0x55fc6bcc6a00 2024-09-12T01:58:04.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f2219ffb640 1 -- 172.21.15.19:0/1210943215 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f2234023660 con 0x55fc6bcc6a00 2024-09-12T01:58:04.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f2219ffb640 1 -- 172.21.15.19:0/1210943215 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2234035050 con 0x55fc6bcc6a00 2024-09-12T01:58:04.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f2243e40740 10 client.5595 fetch_fsmap learned FSMap version 27 2024-09-12T01:58:04.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.160+0000 7f2243e40740 1 -- 172.21.15.19:0/1210943215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55fc6bcc28c0 con 0x55fc6bcc6a00 2024-09-12T01:58:04.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.161+0000 7f2219ffb640 1 -- 172.21.15.19:0/1210943215 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22340158c0 con 0x55fc6bcc6a00 2024-09-12T01:58:04.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.161+0000 7f2219ffb640 1 -- 172.21.15.19:0/1210943215 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f2234038020 con 0x55fc6bcc6a00 2024-09-12T01:58:04.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.161+0000 7f2243e40740 10 client.5595 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:58:04.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.161+0000 7f2243e40740 10 client.5595 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T01:58:04.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.161+0000 7f2243e40740 20 client.5595 populate_metadata read hostname 'smithi019' 2024-09-12T01:58:04.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.161+0000 7f2243e40740 1 --2- 172.21.15.19:0/1210943215 >> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] conn(0x55fc6bd5eae0 0x55fc6bd5eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.161+0000 7f2243e40740 4 client.5595 mds_command: new command op to 5421 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:58:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.161+0000 7f2243e40740 1 -- 172.21.15.19:0/1210943215 --> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] -- command(tid 0: {"prefix": "status"}) -- 0x55fc6bc05fa0 con 0x55fc6bd5eae0 2024-09-12T01:58:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.161+0000 7f223ad9d640 1 --2- 172.21.15.19:0/1210943215 >> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] conn(0x55fc6bd5eae0 0x55fc6bd5eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.161+0000 7f2219ffb640 10 client.5595 ms_handle_connect on v2:172.21.15.19:6834/1076479859 2024-09-12T01:58:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.161+0000 7f223ad9d640 1 --2- 172.21.15.19:0/1210943215 >> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] conn(0x55fc6bd5eae0 0x55fc6bd5eec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=847d783600cab50e server_cookie=edb758780948c0a9 in_seq=0 out_seq=0 2024-09-12T01:58:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.161+0000 7f2219ffb640 1 -- 172.21.15.19:0/1210943215 <== mds.0 v2:172.21.15.19:6834/1076479859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55fc6bc05fa0 con 0x55fc6bd5eae0 2024-09-12T01:58:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.161+0000 7f2219ffb640 10 client.5595 handle_command_reply: tid=0 2024-09-12T01:58:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.161+0000 7f2243e40740 1 client.5595 shutdown 2024-09-12T01:58:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f2243e40740 1 -- 172.21.15.19:0/1210943215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bcc6a00 msgr2=0x55fc6bc95c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f2243e40740 1 --2- 172.21.15.19:0/1210943215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bcc6a00 0x55fc6bc95c30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x55fc6bb87550 tx=0x7f2234004ab0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f2243e40740 1 -- 172.21.15.19:0/1210943215 shutdown_connections 2024-09-12T01:58:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f2243e40740 1 --2- 172.21.15.19:0/1210943215 >> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] conn(0x55fc6bd5eae0 0x55fc6bd5eec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f2243e40740 1 --2- 172.21.15.19:0/1210943215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc6bcc6a00 0x55fc6bc95c30 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f2243e40740 1 --2- 172.21.15.19:0/1210943215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6bc9da50 0x55fc6bc9ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f2219ffb640 0 client.5595 ms_handle_reset on v2:172.21.15.19:6834/1076479859 2024-09-12T01:58:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f2243e40740 1 --2- 172.21.15.19:0/1210943215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fc6bc9c2c0 0x55fc6bc9b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f2243e40740 1 -- 172.21.15.19:0/1210943215 >> 172.21.15.19:0/1210943215 conn(0x55fc6bc99a80 msgr2=0x55fc6bce0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f2243e40740 1 -- 172.21.15.19:0/1210943215 shutdown_connections 2024-09-12T01:58:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f2243e40740 1 -- 172.21.15.19:0/1210943215 wait complete. 2024-09-12T01:58:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f2243e40740 20 client.5595 trim_cache size 0 max 16384 2024-09-12T01:58:04.168 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:58:04.168 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T01:58:04.168 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T01:58:04.168 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 5421, 2024-09-12T01:58:04.168 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T01:58:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T01:58:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T01:58:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 9.0644322349999999, 2024-09-12T01:58:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 27, 2024-09-12T01:58:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 54, 2024-09-12T01:58:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 54, 2024-09-12T01:58:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 14.097430105999999 2024-09-12T01:58:04.169 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:58:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f22410af640 1 -- 172.21.15.19:0/171688797 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f222806be30 msgr2=0x7f222806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f22410af640 1 --2- 172.21.15.19:0/171688797 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f222806be30 0x7f222806e2f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f222c034000 tx=0x7f222c02e000 comp rx=0 tx=0).stop 2024-09-12T01:58:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f22410af640 1 -- 172.21.15.19:0/171688797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223c161c80 msgr2=0x7f223c15b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f22410af640 1 --2- 172.21.15.19:0/171688797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223c161c80 0x7f223c15b010 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f223000d800 tx=0x7f223000dcc0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f22410af640 1 -- 172.21.15.19:0/171688797 shutdown_connections 2024-09-12T01:58:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f22410af640 1 --2- 172.21.15.19:0/171688797 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f222806be30 0x7f222806e2f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f22410af640 1 --2- 172.21.15.19:0/171688797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f223c162060 0x7f223c15eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f22410af640 1 --2- 172.21.15.19:0/171688797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223c161c80 0x7f223c15b010 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f22410af640 1 --2- 172.21.15.19:0/171688797 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f223c0b64b0 0x7f223c0b9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f22410af640 1 -- 172.21.15.19:0/171688797 >> 172.21.15.19:0/171688797 conn(0x7f223c0d44f0 msgr2=0x7f223c06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:04.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f22410af640 1 -- 172.21.15.19:0/171688797 shutdown_connections 2024-09-12T01:58:04.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.162+0000 7f22410af640 1 -- 172.21.15.19:0/171688797 wait complete. 2024-09-12T01:58:04.174 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:58:04.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.275+0000 7ff043bb7640 1 Processor -- start 2024-09-12T01:58:04.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.276+0000 7ff043bb7640 1 -- start start 2024-09-12T01:58:04.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.276+0000 7ff043bb7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff03c162060 0x7ff03c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.276+0000 7ff043bb7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff03c0b64b0 0x7ff03c0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.276+0000 7ff043bb7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff03c06d9f0 con 0x7ff03c161c80 2024-09-12T01:58:04.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.276+0000 7ff043bb7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff03c06dcd0 con 0x7ff03c0b64b0 2024-09-12T01:58:04.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.276+0000 7ff043bb7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff03c06dfb0 con 0x7ff03c162060 2024-09-12T01:58:04.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.277+0000 7ff041953640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff03c161c80 0x7ff03c06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56972/0 (socket says 172.21.15.19:56972) 2024-09-12T01:58:04.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.277+0000 7ff042154640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff03c0b64b0 0x7ff03c0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.277+0000 7ff041953640 1 -- 172.21.15.19:0/1308879060 learned_addr learned my addr 172.21.15.19:0/1308879060 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:04.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.277+0000 7ff041152640 1 --2- 172.21.15.19:0/1308879060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff03c162060 0x7ff03c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.277+0000 7ff040951640 1 -- 172.21.15.19:0/1308879060 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1995065881 0 0) 0x7ff03c06d9f0 con 0x7ff03c161c80 2024-09-12T01:58:04.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.277+0000 7ff040951640 1 -- 172.21.15.19:0/1308879060 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff024003520 con 0x7ff03c161c80 2024-09-12T01:58:04.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.277+0000 7ff042154640 1 -- 172.21.15.19:0/1308879060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff03c162060 msgr2=0x7ff03c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:04.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.277+0000 7ff042154640 1 --2- 172.21.15.19:0/1308879060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff03c162060 0x7ff03c0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.277+0000 7ff042154640 1 -- 172.21.15.19:0/1308879060 >> v1:172.21.15.19:6789/0 conn(0x7ff03c161c80 legacy=0x7ff03c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.277+0000 7ff042154640 1 -- 172.21.15.19:0/1308879060 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03c0d01f0 con 0x7ff03c0b64b0 2024-09-12T01:58:04.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.278+0000 7ff042154640 1 --2- 172.21.15.19:0/1308879060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff03c0b64b0 0x7ff03c0b6960 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0097a0 tx=0x7ff02c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a3584ecd6aba51 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.278+0000 7ff040951640 1 -- 172.21.15.19:0/1308879060 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02c037070 con 0x7ff03c0b64b0 2024-09-12T01:58:04.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.278+0000 7ff040951640 1 -- 172.21.15.19:0/1308879060 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff02c032440 con 0x7ff03c0b64b0 2024-09-12T01:58:04.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.278+0000 7ff040951640 1 -- 172.21.15.19:0/1308879060 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02c0327f0 con 0x7ff03c0b64b0 2024-09-12T01:58:04.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.278+0000 7ff043bb7640 1 -- 172.21.15.19:0/1308879060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff03c0b64b0 msgr2=0x7ff03c0b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.278+0000 7ff043bb7640 1 --2- 172.21.15.19:0/1308879060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff03c0b64b0 0x7ff03c0b6960 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0097a0 tx=0x7ff02c02a180 comp rx=0 tx=0).stop 2024-09-12T01:58:04.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.278+0000 7ff043bb7640 1 -- 172.21.15.19:0/1308879060 shutdown_connections 2024-09-12T01:58:04.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.278+0000 7ff043bb7640 1 --2- 172.21.15.19:0/1308879060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff03c0b64b0 0x7ff03c0b6960 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.278+0000 7ff043bb7640 1 --2- 172.21.15.19:0/1308879060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff03c162060 0x7ff03c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.278+0000 7ff043bb7640 1 -- 172.21.15.19:0/1308879060 >> 172.21.15.19:0/1308879060 conn(0x7ff03c0d44f0 msgr2=0x7ff03c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:04.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.279+0000 7ff043bb7640 1 -- 172.21.15.19:0/1308879060 shutdown_connections 2024-09-12T01:58:04.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.279+0000 7ff043bb7640 1 -- 172.21.15.19:0/1308879060 wait complete. 2024-09-12T01:58:04.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.280+0000 7ff043bb7640 1 Processor -- start 2024-09-12T01:58:04.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.280+0000 7ff043bb7640 1 -- start start 2024-09-12T01:58:04.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff043bb7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff03c0b64b0 0x7ff03c159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff043bb7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff03c161c80 0x7ff03c0c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff043bb7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c162060 0x7ff03c15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff043bb7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c0cf1e0 con 0x7ff03c0b64b0 2024-09-12T01:58:04.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff043bb7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c0d2aa0 con 0x7ff03c162060 2024-09-12T01:58:04.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff043bb7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff03c0cf360 con 0x7ff03c161c80 2024-09-12T01:58:04.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff041953640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff03c0b64b0 0x7ff03c159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff041953640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff03c0b64b0 0x7ff03c159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50098/0 (socket says 172.21.15.19:50098) 2024-09-12T01:58:04.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff041953640 1 -- 172.21.15.19:0/3390482104 learned_addr learned my addr 172.21.15.19:0/3390482104 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:04.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff041953640 1 -- 172.21.15.19:0/3390482104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff03c161c80 msgr2=0x7ff03c0c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff041953640 1 --2- 172.21.15.19:0/3390482104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff03c161c80 0x7ff03c0c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff041953640 1 -- 172.21.15.19:0/3390482104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c162060 msgr2=0x7ff03c15a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff041953640 1 --2- 172.21.15.19:0/3390482104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c162060 0x7ff03c15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff041953640 1 -- 172.21.15.19:0/3390482104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03c1f8af0 con 0x7ff03c0b64b0 2024-09-12T01:58:04.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff041953640 1 --2- 172.21.15.19:0/3390482104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff03c0b64b0 0x7ff03c159970 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff03400cb40 tx=0x7ff03400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff03a7fc640 1 -- 172.21.15.19:0/3390482104 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034017070 con 0x7ff03c0b64b0 2024-09-12T01:58:04.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff03a7fc640 1 -- 172.21.15.19:0/3390482104 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff03400aca0 con 0x7ff03c0b64b0 2024-09-12T01:58:04.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff03a7fc640 1 -- 172.21.15.19:0/3390482104 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034012620 con 0x7ff03c0b64b0 2024-09-12T01:58:04.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff043bb7640 1 -- 172.21.15.19:0/3390482104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff03c0cb810 con 0x7ff03c0b64b0 2024-09-12T01:58:04.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.281+0000 7ff043bb7640 1 -- 172.21.15.19:0/3390482104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff03c0cbdd0 con 0x7ff03c0b64b0 2024-09-12T01:58:04.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.282+0000 7ff043bb7640 1 -- 172.21.15.19:0/3390482104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff03c0b5f70 con 0x7ff03c0b64b0 2024-09-12T01:58:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.283+0000 7ff03a7fc640 1 -- 172.21.15.19:0/3390482104 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff03401a070 con 0x7ff03c0b64b0 2024-09-12T01:58:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.283+0000 7ff03a7fc640 1 --2- 172.21.15.19:0/3390482104 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff02806be30 0x7ff02806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.284+0000 7ff03a7fc640 1 -- 172.21.15.19:0/3390482104 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7ff03408aee0 con 0x7ff03c0b64b0 2024-09-12T01:58:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.284+0000 7ff041152640 1 --2- 172.21.15.19:0/3390482104 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff02806be30 0x7ff02806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.284+0000 7ff041152640 1 --2- 172.21.15.19:0/3390482104 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff02806be30 0x7ff02806e2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff030006fd0 tx=0x7ff030008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.288+0000 7ff03a7fc640 1 -- 172.21.15.19:0/3390482104 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff034059670 con 0x7ff03c0b64b0 2024-09-12T01:58:04.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.502+0000 7ff043bb7640 1 -- 172.21.15.19:0/3390482104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff03c0d3a70 con 0x7ff03c0b64b0 2024-09-12T01:58:04.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.503+0000 7ff03a7fc640 1 -- 172.21.15.19:0/3390482104 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7ff034058f70 con 0x7ff03c0b64b0 2024-09-12T01:58:04.503 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:58:04.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.505+0000 7ff043bb7640 1 -- 172.21.15.19:0/3390482104 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff02806be30 msgr2=0x7ff02806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.505+0000 7ff043bb7640 1 --2- 172.21.15.19:0/3390482104 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff02806be30 0x7ff02806e2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff030006fd0 tx=0x7ff030008040 comp rx=0 tx=0).stop 2024-09-12T01:58:04.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.505+0000 7ff043bb7640 1 -- 172.21.15.19:0/3390482104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff03c0b64b0 msgr2=0x7ff03c159970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.505+0000 7ff043bb7640 1 --2- 172.21.15.19:0/3390482104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff03c0b64b0 0x7ff03c159970 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff03400cb40 tx=0x7ff03400a060 comp rx=0 tx=0).stop 2024-09-12T01:58:04.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.505+0000 7ff043bb7640 1 -- 172.21.15.19:0/3390482104 shutdown_connections 2024-09-12T01:58:04.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.505+0000 7ff043bb7640 1 --2- 172.21.15.19:0/3390482104 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff02806be30 0x7ff02806e2f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.505+0000 7ff043bb7640 1 --2- 172.21.15.19:0/3390482104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c162060 0x7ff03c15a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.505+0000 7ff043bb7640 1 --2- 172.21.15.19:0/3390482104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff03c161c80 0x7ff03c0c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.505+0000 7ff043bb7640 1 --2- 172.21.15.19:0/3390482104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff03c0b64b0 0x7ff03c159970 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.505+0000 7ff043bb7640 1 -- 172.21.15.19:0/3390482104 >> 172.21.15.19:0/3390482104 conn(0x7ff03c0d44f0 msgr2=0x7ff03c06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:04.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.505+0000 7ff043bb7640 1 -- 172.21.15.19:0/3390482104 shutdown_connections 2024-09-12T01:58:04.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04.505+0000 7ff043bb7640 1 -- 172.21.15.19:0/3390482104 wait complete. 2024-09-12T01:58:04.516 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:58:04.516 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:58:04.516 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T01:58:04.516 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:58:04.517 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:58:04.517 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:58:04.517 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:58:04.517 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:58:04.517 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:58:04.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:04.518 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T01:58:04.534 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:58:04.534 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:58:04.534 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:58:04.534 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:04.534 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T01:58:04.534 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:04.534 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:58:04.535 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:58:04.535 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T01:58:04.535 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:58:04.535 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:58:04.535 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T01:58:04.535 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:58:04.535 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T01:58:04.535 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T01:58:04.535 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:58:04.535 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42676sec preferred_lft 42676sec 2024-09-12T01:58:04.535 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T01:58:04.535 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:04.535 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:58:04.535 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T01:58:04.536 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T01:58:04.536 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:58:04.536 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T01:58:04.536 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:58:04.536 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:04.536 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T01:58:04.536 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:04.536 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:58:04.536 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:58:04.536 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T01:58:04.536 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:04.536 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:58:04.536 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:58:04.537 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T01:58:04.537 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:04.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:04.537 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:58:04.598 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T01:58:04.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:04.600 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T01:58:04.657 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T01:58:04.657 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:58:04.657 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:58:04.657 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:58:04.657 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:58:04.658 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:58:04.658 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:58:04.658 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:58:04.658 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:58:04.658 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:58:04.658 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:58:04.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:58:04.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:58:04.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:04.786 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T01:58:04.801 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T01:58:04.801 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:58:04.801 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:58:04.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:04.802 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T01:58:04.866 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:58:04.867 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:58:04.923 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:58:04.923 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:58:04.923 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:58:04.978 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T01:58:04.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:04.978 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:58:05.063 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:58:05.063 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:58:05.064 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:58:05.072 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:58:05.072 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:58:05.072 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:58:05.072 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:58:05.072 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:58:05.077 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:58:05.077 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:58:05.077 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:58:05.077 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:58:05.077 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:58:05.077 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T01:58:05.077 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T01:58:05.077 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T01:58:05.078 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:58:05.078 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:58:05.078 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:58:05.078 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:58:05.078 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:58:05.080 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:58:05.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:05.080 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:58:05.105 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:58:05.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:58:05.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:58:05.207 INFO:teuthology.orchestra.run.smithi019.stdout:client5607 2024-09-12T01:58:05.208 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:58:05.208 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:58:05.224 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p a/b') 2024-09-12T01:58:05.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:58:05.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:58:05.328 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush journal 2024-09-12T01:58:05.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.432+0000 7fdaaa15f640 1 Processor -- start 2024-09-12T01:58:05.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.432+0000 7fdaaa15f640 1 -- start start 2024-09-12T01:58:05.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.433+0000 7fdaaa15f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdaa415c310 0x7fdaa4160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.433+0000 7fdaaa15f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdaa40d0370 0x7fdaa40d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.433+0000 7fdaaa15f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa4160e70 con 0x7fdaa40b4800 2024-09-12T01:58:05.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.433+0000 7fdaaa15f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa40af7a0 con 0x7fdaa415c310 2024-09-12T01:58:05.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.433+0000 7fdaaa15f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa40afa80 con 0x7fdaa40d0370 2024-09-12T01:58:05.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.433+0000 7fda9affd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdaa40b4800 0x7fdaa40aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56978/0 (socket says 172.21.15.19:56978) 2024-09-12T01:58:05.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.433+0000 7fda9affd640 1 -- 172.21.15.19:0/3844393787 learned_addr learned my addr 172.21.15.19:0/3844393787 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:05.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.433+0000 7fdaa37fe640 1 --2- 172.21.15.19:0/3844393787 >> v2:172.21.15.135:3300/0 conn(0x7fdaa415c310 0x7fdaa4160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.433+0000 7fdaa3fff640 1 --2- 172.21.15.19:0/3844393787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdaa40d0370 0x7fdaa40d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.433+0000 7fdaa2ffd640 1 -- 172.21.15.19:0/3844393787 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1180529320 0 0) 0x7fdaa4160e70 con 0x7fdaa40b4800 2024-09-12T01:58:05.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.433+0000 7fdaa2ffd640 1 -- 172.21.15.19:0/3844393787 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda90003520 con 0x7fdaa40b4800 2024-09-12T01:58:05.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fdaa2ffd640 1 -- 172.21.15.19:0/3844393787 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 281939551 0 0) 0x7fda90003520 con 0x7fdaa40b4800 2024-09-12T01:58:05.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fdaa2ffd640 1 -- 172.21.15.19:0/3844393787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdaa40d0370 msgr2=0x7fdaa40d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:05.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fdaa2ffd640 1 --2- 172.21.15.19:0/3844393787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdaa40d0370 0x7fdaa40d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fdaa2ffd640 1 -- 172.21.15.19:0/3844393787 >> v2:172.21.15.135:3300/0 conn(0x7fdaa415c310 msgr2=0x7fdaa4160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:05.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fdaa2ffd640 1 --2- 172.21.15.19:0/3844393787 >> v2:172.21.15.135:3300/0 conn(0x7fdaa415c310 0x7fdaa4160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fdaa2ffd640 1 -- 172.21.15.19:0/3844393787 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa4160130 con 0x7fdaa40b4800 2024-09-12T01:58:05.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fdaa2ffd640 1 -- 172.21.15.19:0/3844393787 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fda8c001670 con 0x7fdaa40b4800 2024-09-12T01:58:05.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fdaa2ffd640 1 -- 172.21.15.19:0/3844393787 >> v1:172.21.15.19:6789/0 conn(0x7fdaa40b4800 legacy=0x7fdaa40aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fdaa2ffd640 1 --2- 172.21.15.19:0/3844393787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda900039b0 0x7fda90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fdaa2ffd640 1 --2- 172.21.15.19:0/3844393787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda90004800 0x7fda90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fdaa2ffd640 1 --2- 172.21.15.19:0/3844393787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdaa40d0370 0x7fda900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fdaa2ffd640 1 -- 172.21.15.19:0/3844393787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa40af7a0 con 0x7fda90004800 2024-09-12T01:58:05.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fdaa2ffd640 1 -- 172.21.15.19:0/3844393787 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa40afa80 con 0x7fda900039b0 2024-09-12T01:58:05.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fdaa2ffd640 1 -- 172.21.15.19:0/3844393787 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fda9000fdd0 con 0x7fdaa40d0370 2024-09-12T01:58:05.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fda9affd640 1 --2- 172.21.15.19:0/3844393787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda90004800 0x7fda90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fdaa37fe640 1 --2- 172.21.15.19:0/3844393787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda900039b0 0x7fda90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fdaa3fff640 1 --2- 172.21.15.19:0/3844393787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdaa40d0370 0x7fda900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fda9affd640 1 -- 172.21.15.19:0/3844393787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdaa40d0370 msgr2=0x7fda900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:05.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fda9affd640 1 --2- 172.21.15.19:0/3844393787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdaa40d0370 0x7fda900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fda9affd640 1 -- 172.21.15.19:0/3844393787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda900039b0 msgr2=0x7fda90003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:05.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fda9affd640 1 --2- 172.21.15.19:0/3844393787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda900039b0 0x7fda90003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.434+0000 7fda9affd640 1 -- 172.21.15.19:0/3844393787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda90003520 con 0x7fda90004800 2024-09-12T01:58:05.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.435+0000 7fda9affd640 1 --2- 172.21.15.19:0/3844393787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda90004800 0x7fda90004c80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00c240 tx=0x7fda90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9715c59fd097b03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:05.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.435+0000 7fdaa2ffd640 1 -- 172.21.15.19:0/3844393787 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c02e070 con 0x7fda90004800 2024-09-12T01:58:05.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.435+0000 7fdaa2ffd640 1 -- 172.21.15.19:0/3844393787 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8c005af0 con 0x7fda90004800 2024-09-12T01:58:05.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.435+0000 7fdaa2ffd640 1 -- 172.21.15.19:0/3844393787 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c007d30 con 0x7fda90004800 2024-09-12T01:58:05.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.436+0000 7fdaaa15f640 1 -- 172.21.15.19:0/3844393787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda90004800 msgr2=0x7fda90004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.436+0000 7fdaaa15f640 1 --2- 172.21.15.19:0/3844393787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda90004800 0x7fda90004c80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00c240 tx=0x7fda90005830 comp rx=0 tx=0).stop 2024-09-12T01:58:05.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.436+0000 7fdaa3fff640 1 -- 172.21.15.19:0/3844393787 reap_dead start 2024-09-12T01:58:05.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.436+0000 7fdaaa15f640 1 -- 172.21.15.19:0/3844393787 shutdown_connections 2024-09-12T01:58:05.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.436+0000 7fdaaa15f640 1 -- 172.21.15.19:0/3844393787 >> 172.21.15.19:0/3844393787 conn(0x7fdaa406bdf0 msgr2=0x7fdaa406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:05.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.436+0000 7fdaaa15f640 1 -- 172.21.15.19:0/3844393787 shutdown_connections 2024-09-12T01:58:05.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.436+0000 7fdaaa15f640 1 -- 172.21.15.19:0/3844393787 wait complete. 2024-09-12T01:58:05.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.437+0000 7fdaaa15f640 1 Processor -- start 2024-09-12T01:58:05.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.437+0000 7fdaaa15f640 1 -- start start 2024-09-12T01:58:05.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.438+0000 7fdaaa15f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda90004800 0x7fdaa41f0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.438+0000 7fdaaa15f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaa414e610 0x7fdaa41536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.438+0000 7fdaaa15f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdaa4153bf0 0x7fdaa4157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.438+0000 7fdaaa15f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa40d0980 con 0x7fdaa4153bf0 2024-09-12T01:58:05.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.438+0000 7fdaaa15f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa40d0800 con 0x7fdaa414e610 2024-09-12T01:58:05.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.438+0000 7fdaaa15f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa40d0b00 con 0x7fda90004800 2024-09-12T01:58:05.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.438+0000 7fdaa3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdaa4153bf0 0x7fdaa4157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.438+0000 7fdaa3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdaa4153bf0 0x7fdaa4157060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50130/0 (socket says 172.21.15.19:50130) 2024-09-12T01:58:05.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.438+0000 7fdaa3fff640 1 -- 172.21.15.19:0/4254237666 learned_addr learned my addr 172.21.15.19:0/4254237666 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:05.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.438+0000 7fda9affd640 1 --2- 172.21.15.19:0/4254237666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaa414e610 0x7fdaa41536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.438+0000 7fdaa37fe640 1 --2- 172.21.15.19:0/4254237666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda90004800 0x7fdaa41f0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.438+0000 7fdaa3fff640 1 -- 172.21.15.19:0/4254237666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda90004800 msgr2=0x7fdaa41f0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.438+0000 7fdaa3fff640 1 --2- 172.21.15.19:0/4254237666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda90004800 0x7fdaa41f0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.438+0000 7fdaa3fff640 1 -- 172.21.15.19:0/4254237666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaa414e610 msgr2=0x7fdaa41536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.438+0000 7fdaa3fff640 1 --2- 172.21.15.19:0/4254237666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaa414e610 0x7fdaa41536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.438+0000 7fdaa3fff640 1 -- 172.21.15.19:0/4254237666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa4150d40 con 0x7fdaa4153bf0 2024-09-12T01:58:05.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.439+0000 7fdaa3fff640 1 --2- 172.21.15.19:0/4254237666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdaa4153bf0 0x7fdaa4157060 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40d1230 tx=0x7fda9c00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:05.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.439+0000 7fdaa0ff9640 1 -- 172.21.15.19:0/4254237666 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c00fc80 con 0x7fdaa4153bf0 2024-09-12T01:58:05.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.439+0000 7fdaa0ff9640 1 -- 172.21.15.19:0/4254237666 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda9c01d070 con 0x7fdaa4153bf0 2024-09-12T01:58:05.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.439+0000 7fdaaa15f640 1 -- 172.21.15.19:0/4254237666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa4151020 con 0x7fdaa4153bf0 2024-09-12T01:58:05.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.439+0000 7fdaa0ff9640 1 -- 172.21.15.19:0/4254237666 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c015430 con 0x7fdaa4153bf0 2024-09-12T01:58:05.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.439+0000 7fdaaa15f640 1 -- 172.21.15.19:0/4254237666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa41515e0 con 0x7fdaa4153bf0 2024-09-12T01:58:05.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.440+0000 7fdaa0ff9640 1 -- 172.21.15.19:0/4254237666 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda9c0155d0 con 0x7fdaa4153bf0 2024-09-12T01:58:05.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.441+0000 7fdaa0ff9640 1 --2- 172.21.15.19:0/4254237666 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fda8406be30 0x7fda8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.441+0000 7fdaa0ff9640 1 -- 172.21.15.19:0/4254237666 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fda9c08b7c0 con 0x7fdaa4153bf0 2024-09-12T01:58:05.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.441+0000 7fdaa37fe640 1 --2- 172.21.15.19:0/4254237666 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fda8406be30 0x7fda8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.441+0000 7fdaacfd8740 1 Processor -- start 2024-09-12T01:58:05.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.441+0000 7fdaa37fe640 1 --2- 172.21.15.19:0/4254237666 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fda8406be30 0x7fda8406e2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4159140 tx=0x7fda94009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:05.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.442+0000 7fdaacfd8740 1 -- start start 2024-09-12T01:58:05.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.442+0000 7fdaacfd8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda16920 0x5577bda5c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.442+0000 7fdaacfd8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda140e0 0x5577bda16d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.442+0000 7fdaacfd8740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda180b0 0x5577bda111a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.442+0000 7fdaacfd8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5577bd9796f0 con 0x5577bda16920 2024-09-12T01:58:05.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.442+0000 7fdaacfd8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5577bd921330 con 0x5577bda140e0 2024-09-12T01:58:05.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.442+0000 7fdaacfd8740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5577bd9756b0 con 0x5577bda180b0 2024-09-12T01:58:05.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.442+0000 7fdaa37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda16920 0x5577bda5c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.442+0000 7fdaa37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda16920 0x5577bda5c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50132/0 (socket says 172.21.15.19:50132) 2024-09-12T01:58:05.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.443+0000 7fdaa37fe640 1 -- 172.21.15.19:0/808935342 learned_addr learned my addr 172.21.15.19:0/808935342 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:05.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.443+0000 7fda9affd640 1 --2- 172.21.15.19:0/808935342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda140e0 0x5577bda16d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.443+0000 7fdaa3fff640 1 --2- 172.21.15.19:0/808935342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda180b0 0x5577bda111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.443+0000 7fdaa37fe640 1 -- 172.21.15.19:0/808935342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda180b0 msgr2=0x5577bda111a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:05.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.443+0000 7fdaa37fe640 1 --2- 172.21.15.19:0/808935342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda180b0 0x5577bda111a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.443+0000 7fdaa37fe640 1 -- 172.21.15.19:0/808935342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda140e0 msgr2=0x5577bda16d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:05.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.443+0000 7fdaa37fe640 1 --2- 172.21.15.19:0/808935342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda140e0 0x5577bda16d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.443+0000 7fdaa37fe640 1 -- 172.21.15.19:0/808935342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577bd9470d0 con 0x5577bda16920 2024-09-12T01:58:05.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.443+0000 7fdaa37fe640 1 --2- 172.21.15.19:0/808935342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda16920 0x5577bda5c0c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fda94015010 tx=0x7fda94017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a23aaf9ced18f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:05.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.443+0000 7fda997fa640 1 -- 172.21.15.19:0/808935342 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9401b070 con 0x5577bda16920 2024-09-12T01:58:05.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.443+0000 7fda997fa640 1 -- 172.21.15.19:0/808935342 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda94004020 con 0x5577bda16920 2024-09-12T01:58:05.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.443+0000 7fda997fa640 1 -- 172.21.15.19:0/808935342 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda940043d0 con 0x5577bda16920 2024-09-12T01:58:05.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.444+0000 7fdaacfd8740 1 -- 172.21.15.19:0/808935342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda16920 msgr2=0x5577bda5c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.444+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/808935342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda16920 0x5577bda5c0c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fda94015010 tx=0x7fda94017000 comp rx=0 tx=0).stop 2024-09-12T01:58:05.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.444+0000 7fdaacfd8740 1 -- 172.21.15.19:0/808935342 shutdown_connections 2024-09-12T01:58:05.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.444+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/808935342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda180b0 0x5577bda111a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.444+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/808935342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda140e0 0x5577bda16d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.444+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/808935342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda16920 0x5577bda5c0c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.444+0000 7fdaacfd8740 1 -- 172.21.15.19:0/808935342 >> 172.21.15.19:0/808935342 conn(0x5577bda13370 msgr2=0x5577bda5b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:05.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.444+0000 7fdaacfd8740 1 -- 172.21.15.19:0/808935342 shutdown_connections 2024-09-12T01:58:05.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.444+0000 7fdaacfd8740 1 -- 172.21.15.19:0/808935342 wait complete. 2024-09-12T01:58:05.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.444+0000 7fdaacfd8740 1 -- start start 2024-09-12T01:58:05.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.445+0000 7fdaacfd8740 1 Processor -- start 2024-09-12T01:58:05.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.445+0000 7fdaacfd8740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda16920 0x5577bda56560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.445+0000 7fdaacfd8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda180b0 0x5577bda6b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.445+0000 7fdaacfd8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 0x5577bda6c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.445+0000 7fdaacfd8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5577bda12810 con 0x5577bda6bd60 2024-09-12T01:58:05.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.445+0000 7fdaacfd8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5577bd9024f0 con 0x5577bda180b0 2024-09-12T01:58:05.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.445+0000 7fdaacfd8740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5577bda5c8f0 con 0x5577bda16920 2024-09-12T01:58:05.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.445+0000 7fdaacfd8740 10 client.0 _ll_register_callbacks cb 0x5577bd923b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:05.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.445+0000 7fdaa3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 0x5577bda6c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.445+0000 7fdaa3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 0x5577bda6c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50146/0 (socket says 172.21.15.19:50146) 2024-09-12T01:58:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.445+0000 7fdaa3fff640 1 -- 172.21.15.19:0/1989453545 learned_addr learned my addr 172.21.15.19:0/1989453545 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.446+0000 7fdaa37fe640 1 --2- 172.21.15.19:0/1989453545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda16920 0x5577bda56560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.446+0000 7fda9affd640 1 --2- 172.21.15.19:0/1989453545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda180b0 0x5577bda6b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.446+0000 7fdaa3fff640 1 -- 172.21.15.19:0/1989453545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda16920 msgr2=0x5577bda56560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.446+0000 7fdaa3fff640 1 --2- 172.21.15.19:0/1989453545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda16920 0x5577bda56560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.446+0000 7fdaa3fff640 1 -- 172.21.15.19:0/1989453545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda180b0 msgr2=0x5577bda6b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.446+0000 7fdaa3fff640 1 --2- 172.21.15.19:0/1989453545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda180b0 0x5577bda6b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.446+0000 7fdaa3fff640 1 -- 172.21.15.19:0/1989453545 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577bd7567d0 con 0x5577bda6bd60 2024-09-12T01:58:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.446+0000 7fda9affd640 1 --2- 172.21.15.19:0/1989453545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda180b0 0x5577bda6b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.446+0000 7fdaa3fff640 1 --2- 172.21.15.19:0/1989453545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 0x5577bda6c1a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0597d0 tx=0x7fda9c05dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d38c0b5dd073303 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.446+0000 7fda827fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:58:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.446+0000 7fda827fc640 1 -- 172.21.15.19:0/1989453545 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c062190 con 0x5577bda6bd60 2024-09-12T01:58:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.446+0000 7fda827fc640 1 -- 172.21.15.19:0/1989453545 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fda9c05ab70 con 0x5577bda6bd60 2024-09-12T01:58:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.446+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1989453545 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda94004020 con 0x5577bda6bd60 2024-09-12T01:58:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.446+0000 7fda827fc640 1 -- 172.21.15.19:0/1989453545 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fda9c05ad70 con 0x5577bda6bd60 2024-09-12T01:58:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.446+0000 7fdaacfd8740 10 client.5619 fetch_fsmap learned FSMap version 27 2024-09-12T01:58:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.446+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1989453545 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5577bd68c3f0 con 0x5577bda6bd60 2024-09-12T01:58:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.446+0000 7fda827fc640 1 -- 172.21.15.19:0/1989453545 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda94004020 con 0x5577bda6bd60 2024-09-12T01:58:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.447+0000 7fda827fc640 1 -- 172.21.15.19:0/1989453545 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fda9c058c90 con 0x5577bda6bd60 2024-09-12T01:58:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.447+0000 7fdaacfd8740 10 client.5619 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:58:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.447+0000 7fdaacfd8740 10 client.5619 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T01:58:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.447+0000 7fdaacfd8740 20 client.5619 populate_metadata read hostname 'smithi019' 2024-09-12T01:58:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.447+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/1989453545 >> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] conn(0x5577bda10bb0 0x5577bda11010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.447+0000 7fdaacfd8740 4 client.5619 mds_command: new command op to 5421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.447+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1989453545 --> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577bd986e20 con 0x5577bda10bb0 2024-09-12T01:58:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.447+0000 7fdaa37fe640 1 --2- 172.21.15.19:0/1989453545 >> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] conn(0x5577bda10bb0 0x5577bda11010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.447+0000 7fda827fc640 10 client.5619 ms_handle_connect on v2:172.21.15.19:6834/1076479859 2024-09-12T01:58:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.447+0000 7fdaa37fe640 1 --2- 172.21.15.19:0/1989453545 >> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] conn(0x5577bda10bb0 0x5577bda11010 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0b4280e84966642 server_cookie=bd0e61b5822aee14 in_seq=0 out_seq=0 2024-09-12T01:58:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.448+0000 7fda827fc640 1 -- 172.21.15.19:0/1989453545 <== mds.0 v2:172.21.15.19:6834/1076479859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5577bd986e20 con 0x5577bda10bb0 2024-09-12T01:58:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.448+0000 7fda827fc640 10 client.5619 handle_command_reply: tid=0 2024-09-12T01:58:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.448+0000 7fdaacfd8740 1 client.5619 shutdown 2024-09-12T01:58:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.448+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1989453545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 msgr2=0x5577bda6c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.448+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/1989453545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 0x5577bda6c1a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0597d0 tx=0x7fda9c05dd30 comp rx=0 tx=0).stop 2024-09-12T01:58:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.448+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1989453545 shutdown_connections 2024-09-12T01:58:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.448+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/1989453545 >> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] conn(0x5577bda10bb0 0x5577bda11010 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.448+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/1989453545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 0x5577bda6c1a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.448+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/1989453545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda180b0 0x5577bda6b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.448+0000 7fda827fc640 0 client.5619 ms_handle_reset on v2:172.21.15.19:6834/1076479859 2024-09-12T01:58:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.448+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/1989453545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda16920 0x5577bda56560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.448+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1989453545 >> 172.21.15.19:0/1989453545 conn(0x5577bda140e0 msgr2=0x5577bda5a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:05.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.448+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1989453545 shutdown_connections 2024-09-12T01:58:05.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.448+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1989453545 wait complete. 2024-09-12T01:58:05.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.448+0000 7fdaacfd8740 20 client.5619 trim_cache size 0 max 16384 2024-09-12T01:58:05.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.463+0000 7fdaacfd8740 1 Processor -- start 2024-09-12T01:58:05.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.463+0000 7fdaacfd8740 1 -- start start 2024-09-12T01:58:05.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fdaacfd8740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda16920 0x5577bda5b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fdaacfd8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda180b0 0x5577bda5b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fdaacfd8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 0x5577bda54710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fdaacfd8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa41fd3b0 con 0x5577bda6bd60 2024-09-12T01:58:05.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fdaacfd8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa41fc410 con 0x5577bda180b0 2024-09-12T01:58:05.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fdaacfd8740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa4150060 con 0x5577bda16920 2024-09-12T01:58:05.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fdaa3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 0x5577bda54710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fdaa3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 0x5577bda54710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50158/0 (socket says 172.21.15.19:50158) 2024-09-12T01:58:05.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fdaa3fff640 1 -- 172.21.15.19:0/1721904604 learned_addr learned my addr 172.21.15.19:0/1721904604 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:05.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fdaa3fff640 1 -- 172.21.15.19:0/1721904604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda16920 msgr2=0x5577bda5b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:05.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fdaa3fff640 1 --2- 172.21.15.19:0/1721904604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda16920 0x5577bda5b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fdaa3fff640 1 -- 172.21.15.19:0/1721904604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda180b0 msgr2=0x5577bda5b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:05.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fda9affd640 1 --2- 172.21.15.19:0/1721904604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda180b0 0x5577bda5b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fdaa3fff640 1 --2- 172.21.15.19:0/1721904604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda180b0 0x5577bda5b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fdaa3fff640 1 -- 172.21.15.19:0/1721904604 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577bd64c0f0 con 0x5577bda6bd60 2024-09-12T01:58:05.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fdaa3fff640 1 --2- 172.21.15.19:0/1721904604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 0x5577bda54710 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fda9c059110 tx=0x7fda9c060050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e41197b4ee9677 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:05.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fda98ff9640 1 -- 172.21.15.19:0/1721904604 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c058c90 con 0x5577bda6bd60 2024-09-12T01:58:05.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fda98ff9640 1 -- 172.21.15.19:0/1721904604 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda9c061f90 con 0x5577bda6bd60 2024-09-12T01:58:05.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.464+0000 7fda98ff9640 1 -- 172.21.15.19:0/1721904604 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c0555e0 con 0x5577bda6bd60 2024-09-12T01:58:05.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.465+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1721904604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 msgr2=0x5577bda54710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.465+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/1721904604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 0x5577bda54710 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fda9c059110 tx=0x7fda9c060050 comp rx=0 tx=0).stop 2024-09-12T01:58:05.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.465+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1721904604 shutdown_connections 2024-09-12T01:58:05.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.465+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/1721904604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 0x5577bda54710 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.465+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/1721904604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda180b0 0x5577bda5b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.465+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/1721904604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda16920 0x5577bda5b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.465+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1721904604 >> 172.21.15.19:0/1721904604 conn(0x5577bda140e0 msgr2=0x5577bda6a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:05.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.465+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1721904604 shutdown_connections 2024-09-12T01:58:05.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.465+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1721904604 wait complete. 2024-09-12T01:58:05.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.466+0000 7fdaacfd8740 1 -- start start 2024-09-12T01:58:05.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.466+0000 7fdaacfd8740 1 Processor -- start 2024-09-12T01:58:05.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.466+0000 7fdaacfd8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda16920 0x5577bda5b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.466+0000 7fdaacfd8740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda180b0 0x5577bda3ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.466+0000 7fdaacfd8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 0x5577bda3f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.466+0000 7fdaacfd8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa41fbdc0 con 0x5577bda6bd60 2024-09-12T01:58:05.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.466+0000 7fdaacfd8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5577bda0ca50 con 0x5577bda16920 2024-09-12T01:58:05.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.466+0000 7fdaacfd8740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5577bdadb250 con 0x5577bda180b0 2024-09-12T01:58:05.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fdaacfd8740 10 client.0 _ll_register_callbacks cb 0x7fda9c059200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:05.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fdaa3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 0x5577bda3f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fdaa3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 0x5577bda3f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50168/0 (socket says 172.21.15.19:50168) 2024-09-12T01:58:05.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fdaa3fff640 1 -- 172.21.15.19:0/1633056662 learned_addr learned my addr 172.21.15.19:0/1633056662 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:05.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fdaa37fe640 1 --2- 172.21.15.19:0/1633056662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda16920 0x5577bda5b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fda9affd640 1 --2- 172.21.15.19:0/1633056662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda180b0 0x5577bda3ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fdaa3fff640 1 -- 172.21.15.19:0/1633056662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda180b0 msgr2=0x5577bda3ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:05.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fdaa3fff640 1 --2- 172.21.15.19:0/1633056662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda180b0 0x5577bda3ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fdaa3fff640 1 -- 172.21.15.19:0/1633056662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda16920 msgr2=0x5577bda5b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fdaa3fff640 1 --2- 172.21.15.19:0/1633056662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda16920 0x5577bda5b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fdaa3fff640 1 -- 172.21.15.19:0/1633056662 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577bda74960 con 0x5577bda6bd60 2024-09-12T01:58:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fdaa37fe640 1 --2- 172.21.15.19:0/1633056662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda16920 0x5577bda5b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fda9affd640 1 --2- 172.21.15.19:0/1633056662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda180b0 0x5577bda3ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fdaa3fff640 1 --2- 172.21.15.19:0/1633056662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 0x5577bda3f180 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0597d0 tx=0x7fda9c089990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321cb4c2accc7e6c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fda827fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:58:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fda827fc640 1 -- 172.21.15.19:0/1633056662 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c07d060 con 0x5577bda6bd60 2024-09-12T01:58:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fda827fc640 1 -- 172.21.15.19:0/1633056662 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fda9c05ab70 con 0x5577bda6bd60 2024-09-12T01:58:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1633056662 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda9c061f90 con 0x5577bda6bd60 2024-09-12T01:58:05.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fda827fc640 1 -- 172.21.15.19:0/1633056662 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fda9c059380 con 0x5577bda6bd60 2024-09-12T01:58:05.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fdaacfd8740 10 client.5625 fetch_fsmap learned FSMap version 27 2024-09-12T01:58:05.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.467+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1633056662 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5577bda74960 con 0x5577bda6bd60 2024-09-12T01:58:05.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.468+0000 7fda827fc640 1 -- 172.21.15.19:0/1633056662 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda9c061f90 con 0x5577bda6bd60 2024-09-12T01:58:05.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.468+0000 7fda827fc640 1 -- 172.21.15.19:0/1633056662 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fda9c078be0 con 0x5577bda6bd60 2024-09-12T01:58:05.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.468+0000 7fdaacfd8740 10 client.5625 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:58:05.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.468+0000 7fdaacfd8740 10 client.5625 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T01:58:05.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.468+0000 7fdaacfd8740 20 client.5625 populate_metadata read hostname 'smithi019' 2024-09-12T01:58:05.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.468+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/1633056662 >> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] conn(0x5577bda7d1c0 0x5577bda3f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.468+0000 7fdaacfd8740 4 client.5625 mds_command: new command op to 5421 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:58:05.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.468+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1633056662 --> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5577bd981170 con 0x5577bda7d1c0 2024-09-12T01:58:05.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.468+0000 7fdaa37fe640 1 --2- 172.21.15.19:0/1633056662 >> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] conn(0x5577bda7d1c0 0x5577bda3f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.468+0000 7fda827fc640 10 client.5625 ms_handle_connect on v2:172.21.15.19:6834/1076479859 2024-09-12T01:58:05.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.468+0000 7fdaa37fe640 1 --2- 172.21.15.19:0/1633056662 >> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] conn(0x5577bda7d1c0 0x5577bda3f6c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87462bf802caf3fd server_cookie=a54e0b6038642080 in_seq=0 out_seq=0 2024-09-12T01:58:05.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.486+0000 7fda827fc640 1 -- 172.21.15.19:0/1633056662 <== mds.0 v2:172.21.15.19:6834/1076479859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5577bd981170 con 0x5577bda7d1c0 2024-09-12T01:58:05.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.486+0000 7fda827fc640 10 client.5625 handle_command_reply: tid=0 2024-09-12T01:58:05.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.486+0000 7fdaacfd8740 1 client.5625 shutdown 2024-09-12T01:58:05.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1633056662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 msgr2=0x5577bda3f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/1633056662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 0x5577bda3f180 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0597d0 tx=0x7fda9c089990 comp rx=0 tx=0).stop 2024-09-12T01:58:05.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1633056662 shutdown_connections 2024-09-12T01:58:05.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/1633056662 >> [v2:172.21.15.19:6834/1076479859,v1:172.21.15.19:6835/1076479859] conn(0x5577bda7d1c0 0x5577bda3f6c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/1633056662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577bda6bd60 0x5577bda3f180 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fda827fc640 0 client.5625 ms_handle_reset on v2:172.21.15.19:6834/1076479859 2024-09-12T01:58:05.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/1633056662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5577bda180b0 0x5577bda3ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaacfd8740 1 --2- 172.21.15.19:0/1633056662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577bda16920 0x5577bda5b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1633056662 >> 172.21.15.19:0/1633056662 conn(0x5577bda140e0 msgr2=0x5577bda570b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:05.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1633056662 shutdown_connections 2024-09-12T01:58:05.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaacfd8740 1 -- 172.21.15.19:0/1633056662 wait complete. 2024-09-12T01:58:05.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaacfd8740 20 client.5625 trim_cache size 0 max 16384 2024-09-12T01:58:05.489 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:58:05.489 INFO:teuthology.orchestra.run.smithi019.stdout: "message": "", 2024-09-12T01:58:05.489 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0 2024-09-12T01:58:05.489 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:58:05.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaaa15f640 1 -- 172.21.15.19:0/4254237666 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fda8406be30 msgr2=0x7fda8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaaa15f640 1 --2- 172.21.15.19:0/4254237666 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fda8406be30 0x7fda8406e2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4159140 tx=0x7fda94009190 comp rx=0 tx=0).stop 2024-09-12T01:58:05.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaaa15f640 1 -- 172.21.15.19:0/4254237666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdaa4153bf0 msgr2=0x7fdaa4157060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaaa15f640 1 --2- 172.21.15.19:0/4254237666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdaa4153bf0 0x7fdaa4157060 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40d1230 tx=0x7fda9c00f1b0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaaa15f640 1 -- 172.21.15.19:0/4254237666 shutdown_connections 2024-09-12T01:58:05.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaaa15f640 1 --2- 172.21.15.19:0/4254237666 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fda8406be30 0x7fda8406e2f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaaa15f640 1 --2- 172.21.15.19:0/4254237666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdaa4153bf0 0x7fdaa4157060 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaaa15f640 1 --2- 172.21.15.19:0/4254237666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaa414e610 0x7fdaa41536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.487+0000 7fdaaa15f640 1 --2- 172.21.15.19:0/4254237666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda90004800 0x7fdaa41f0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.488+0000 7fdaaa15f640 1 -- 172.21.15.19:0/4254237666 >> 172.21.15.19:0/4254237666 conn(0x7fdaa406bdf0 msgr2=0x7fdaa40b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.488+0000 7fdaaa15f640 1 -- 172.21.15.19:0/4254237666 shutdown_connections 2024-09-12T01:58:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.488+0000 7fdaaa15f640 1 -- 172.21.15.19:0/4254237666 wait complete. 2024-09-12T01:58:05.499 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_abort_on_newly_corrupt_dentry False 2024-09-12T01:58:05.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.604+0000 7f2b35996640 1 Processor -- start 2024-09-12T01:58:05.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.604+0000 7f2b35996640 1 -- start start 2024-09-12T01:58:05.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.605+0000 7f2b35996640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b30161a20 0x7f2b300d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.605+0000 7f2b35996640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b300d1830 con 0x7f2b300d1420 2024-09-12T01:58:05.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.605+0000 7f2b35996640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b300cf980 con 0x7f2b300cf330 2024-09-12T01:58:05.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.605+0000 7f2b35996640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2b300cf760 con 0x7f2b30161a20 2024-09-12T01:58:05.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.605+0000 7f2b2e7fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2b300d1420 0x7f2b300cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56992/0 (socket says 172.21.15.19:56992) 2024-09-12T01:58:05.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.605+0000 7f2b2effd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b30161a20 0x7f2b300d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.605+0000 7f2b2e7fc640 1 -- 172.21.15.19:0/1314533837 learned_addr learned my addr 172.21.15.19:0/1314533837 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:05.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.605+0000 7f2b2effd640 1 -- 172.21.15.19:0/1314533837 >> v1:172.21.15.135:6789/0 conn(0x7f2b300cf330 legacy=0x7f2b3006d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.605+0000 7f2b2effd640 1 -- 172.21.15.19:0/1314533837 >> v1:172.21.15.19:6789/0 conn(0x7f2b300d1420 legacy=0x7f2b300cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.605+0000 7f2b2effd640 1 -- 172.21.15.19:0/1314533837 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b3006d050 con 0x7f2b30161a20 2024-09-12T01:58:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.606+0000 7f2b2effd640 1 --2- 172.21.15.19:0/1314533837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b30161a20 0x7f2b300d0ee0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2b200097a0 tx=0x7f2b2002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37543fe41b35647 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.606+0000 7f2b2dffb640 1 -- 172.21.15.19:0/1314533837 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b20037070 con 0x7f2b30161a20 2024-09-12T01:58:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.606+0000 7f2b2dffb640 1 -- 172.21.15.19:0/1314533837 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b20032440 con 0x7f2b30161a20 2024-09-12T01:58:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.606+0000 7f2b2dffb640 1 -- 172.21.15.19:0/1314533837 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b20032810 con 0x7f2b30161a20 2024-09-12T01:58:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.607+0000 7f2b35996640 1 -- 172.21.15.19:0/1314533837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b30161a20 msgr2=0x7f2b300d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.607+0000 7f2b35996640 1 --2- 172.21.15.19:0/1314533837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b30161a20 0x7f2b300d0ee0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2b200097a0 tx=0x7f2b2002a230 comp rx=0 tx=0).stop 2024-09-12T01:58:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.607+0000 7f2b35996640 1 -- 172.21.15.19:0/1314533837 shutdown_connections 2024-09-12T01:58:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.607+0000 7f2b35996640 1 --2- 172.21.15.19:0/1314533837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b30161a20 0x7f2b300d0ee0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.607+0000 7f2b35996640 1 -- 172.21.15.19:0/1314533837 >> 172.21.15.19:0/1314533837 conn(0x7f2b3009d850 msgr2=0x7f2b3008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.607+0000 7f2b35996640 1 -- 172.21.15.19:0/1314533837 shutdown_connections 2024-09-12T01:58:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.607+0000 7f2b35996640 1 -- 172.21.15.19:0/1314533837 wait complete. 2024-09-12T01:58:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.608+0000 7f2b35996640 1 Processor -- start 2024-09-12T01:58:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.608+0000 7f2b35996640 1 -- start start 2024-09-12T01:58:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.609+0000 7f2b35996640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b300cf330 0x7f2b300b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.609+0000 7f2b35996640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b300d1420 0x7f2b301f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.609+0000 7f2b35996640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b300cb5a0 0x7f2b301f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.609+0000 7f2b35996640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2b300cff00 con 0x7f2b300cb5a0 2024-09-12T01:58:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.609+0000 7f2b35996640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2b30161e00 con 0x7f2b300cf330 2024-09-12T01:58:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.609+0000 7f2b35996640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2b3006d2f0 con 0x7f2b300d1420 2024-09-12T01:58:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.609+0000 7f2b2f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b300cb5a0 0x7f2b301f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.609+0000 7f2b2effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b300cf330 0x7f2b300b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.609+0000 7f2b2f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b300cb5a0 0x7f2b301f4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50180/0 (socket says 172.21.15.19:50180) 2024-09-12T01:58:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.609+0000 7f2b2f7fe640 1 -- 172.21.15.19:0/1627307888 learned_addr learned my addr 172.21.15.19:0/1627307888 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.609+0000 7f2b2e7fc640 1 --2- 172.21.15.19:0/1627307888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b300d1420 0x7f2b301f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.610+0000 7f2b2f7fe640 1 -- 172.21.15.19:0/1627307888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b300d1420 msgr2=0x7f2b301f3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.610+0000 7f2b2f7fe640 1 --2- 172.21.15.19:0/1627307888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b300d1420 0x7f2b301f3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.610+0000 7f2b2f7fe640 1 -- 172.21.15.19:0/1627307888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b300cf330 msgr2=0x7f2b300b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.610+0000 7f2b2f7fe640 1 --2- 172.21.15.19:0/1627307888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b300cf330 0x7f2b300b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.610+0000 7f2b2f7fe640 1 -- 172.21.15.19:0/1627307888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b300b9bc0 con 0x7f2b300cb5a0 2024-09-12T01:58:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.610+0000 7f2b2f7fe640 1 --2- 172.21.15.19:0/1627307888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b300cb5a0 0x7f2b301f4410 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800c7a0 tx=0x7f2b2800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.610+0000 7f2b17fff640 1 -- 172.21.15.19:0/1627307888 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b28003b70 con 0x7f2b300cb5a0 2024-09-12T01:58:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.610+0000 7f2b17fff640 1 -- 172.21.15.19:0/1627307888 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b28003d30 con 0x7f2b300cb5a0 2024-09-12T01:58:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.610+0000 7f2b35996640 1 -- 172.21.15.19:0/1627307888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b300b5ac0 con 0x7f2b300cb5a0 2024-09-12T01:58:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.610+0000 7f2b17fff640 1 -- 172.21.15.19:0/1627307888 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2800aa90 con 0x7f2b300cb5a0 2024-09-12T01:58:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.610+0000 7f2b35996640 1 -- 172.21.15.19:0/1627307888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b300b6080 con 0x7f2b300cb5a0 2024-09-12T01:58:05.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.611+0000 7f2b35996640 1 -- 172.21.15.19:0/1627307888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b300b1040 con 0x7f2b300cb5a0 2024-09-12T01:58:05.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.612+0000 7f2b17fff640 1 -- 172.21.15.19:0/1627307888 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b2800ac30 con 0x7f2b300cb5a0 2024-09-12T01:58:05.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.612+0000 7f2b17fff640 1 --2- 172.21.15.19:0/1627307888 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2b1c06be30 0x7f2b1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.612+0000 7f2b17fff640 1 -- 172.21.15.19:0/1627307888 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f2b2808ad70 con 0x7f2b300cb5a0 2024-09-12T01:58:05.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.612+0000 7f2b2effd640 1 --2- 172.21.15.19:0/1627307888 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2b1c06be30 0x7f2b1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.613+0000 7f2b2effd640 1 --2- 172.21.15.19:0/1627307888 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2b1c06be30 0x7f2b1c06e2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2b20034000 tx=0x7f2b2002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:05.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.617+0000 7f2b17fff640 1 -- 172.21.15.19:0/1627307888 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b28058fd0 con 0x7f2b300cb5a0 2024-09-12T01:58:05.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.792+0000 7f2b35996640 1 -- 172.21.15.19:0/1627307888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_abort_on_newly_corrupt_dentry}] v 0) -- 0x7f2b300ce7c0 con 0x7f2b300cb5a0 2024-09-12T01:58:05.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.795+0000 7f2b17fff640 1 -- 172.21.15.19:0/1627307888 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_abort_on_newly_corrupt_dentry}]=0 v13)=0 v13) ==== 135+0+0 (secure 0 0 0) 0x7f2b2805d2d0 con 0x7f2b300cb5a0 2024-09-12T01:58:05.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.798+0000 7f2b35996640 1 -- 172.21.15.19:0/1627307888 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2b1c06be30 msgr2=0x7f2b1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.798+0000 7f2b35996640 1 --2- 172.21.15.19:0/1627307888 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2b1c06be30 0x7f2b1c06e2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2b20034000 tx=0x7f2b2002e000 comp rx=0 tx=0).stop 2024-09-12T01:58:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.798+0000 7f2b35996640 1 -- 172.21.15.19:0/1627307888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b300cb5a0 msgr2=0x7f2b301f4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.798+0000 7f2b35996640 1 --2- 172.21.15.19:0/1627307888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b300cb5a0 0x7f2b301f4410 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800c7a0 tx=0x7f2b2800cc60 comp rx=0 tx=0).stop 2024-09-12T01:58:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.798+0000 7f2b35996640 1 -- 172.21.15.19:0/1627307888 shutdown_connections 2024-09-12T01:58:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.798+0000 7f2b35996640 1 --2- 172.21.15.19:0/1627307888 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2b1c06be30 0x7f2b1c06e2f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.798+0000 7f2b35996640 1 --2- 172.21.15.19:0/1627307888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b300cb5a0 0x7f2b301f4410 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.798+0000 7f2b35996640 1 --2- 172.21.15.19:0/1627307888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b300d1420 0x7f2b301f3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.798+0000 7f2b35996640 1 --2- 172.21.15.19:0/1627307888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b300cf330 0x7f2b300b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.798+0000 7f2b35996640 1 -- 172.21.15.19:0/1627307888 >> 172.21.15.19:0/1627307888 conn(0x7f2b3009d850 msgr2=0x7f2b3014f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:05.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.798+0000 7f2b35996640 1 -- 172.21.15.19:0/1627307888 shutdown_connections 2024-09-12T01:58:05.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.798+0000 7f2b35996640 1 -- 172.21.15.19:0/1627307888 wait complete. 2024-09-12T01:58:05.809 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_inject_rename_corrupt_dentry_first 1.0 2024-09-12T01:58:05.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.915+0000 7fd5a01d6640 1 Processor -- start 2024-09-12T01:58:05.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.916+0000 7fd5a01d6640 1 -- start start 2024-09-12T01:58:05.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.916+0000 7fd5a01d6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd598162340 0x7fd59806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.916+0000 7fd5a01d6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd598162e30 0x7fd5980d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.916+0000 7fd5a01d6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd59815ff70 con 0x7fd5980cf280 2024-09-12T01:58:05.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.916+0000 7fd5a01d6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd5981632a0 con 0x7fd598162340 2024-09-12T01:58:05.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.916+0000 7fd5a01d6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd59806de90 con 0x7fd598162e30 2024-09-12T01:58:05.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.917+0000 7fd59df72640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd598162340 0x7fd59806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.917+0000 7fd59d771640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd5980cf280 0x7fd598162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56996/0 (socket says 172.21.15.19:56996) 2024-09-12T01:58:05.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.917+0000 7fd59d771640 1 -- 172.21.15.19:0/125644748 learned_addr learned my addr 172.21.15.19:0/125644748 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:05.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.917+0000 7fd59e773640 1 --2- 172.21.15.19:0/125644748 >> v2:172.21.15.135:3300/0 conn(0x7fd598162e30 0x7fd5980d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.917+0000 7fd59df72640 1 -- 172.21.15.19:0/125644748 >> v2:172.21.15.135:3300/0 conn(0x7fd598162e30 msgr2=0x7fd5980d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:05.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.917+0000 7fd59df72640 1 --2- 172.21.15.19:0/125644748 >> v2:172.21.15.135:3300/0 conn(0x7fd598162e30 0x7fd5980d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.917+0000 7fd59df72640 1 -- 172.21.15.19:0/125644748 >> v1:172.21.15.19:6789/0 conn(0x7fd5980cf280 legacy=0x7fd598162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.917+0000 7fd59df72640 1 -- 172.21.15.19:0/125644748 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5980d4d10 con 0x7fd598162340 2024-09-12T01:58:05.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.917+0000 7fd59cf70640 1 -- 172.21.15.19:0/125644748 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2054353975 0 0) 0x7fd59815ff70 con 0x7fd5980cf280 2024-09-12T01:58:05.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.918+0000 7fd59df72640 1 --2- 172.21.15.19:0/125644748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd598162340 0x7fd59806d740 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd59806c3d0 tx=0x7fd59402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806ca9f33a62c884 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:05.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.918+0000 7fd59cf70640 1 -- 172.21.15.19:0/125644748 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd594037070 con 0x7fd598162340 2024-09-12T01:58:05.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.918+0000 7fd59cf70640 1 -- 172.21.15.19:0/125644748 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd594032440 con 0x7fd598162340 2024-09-12T01:58:05.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.918+0000 7fd59cf70640 1 -- 172.21.15.19:0/125644748 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59402ae60 con 0x7fd598162340 2024-09-12T01:58:05.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.918+0000 7fd5a01d6640 1 -- 172.21.15.19:0/125644748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd598162340 msgr2=0x7fd59806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.918+0000 7fd5a01d6640 1 --2- 172.21.15.19:0/125644748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd598162340 0x7fd59806d740 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd59806c3d0 tx=0x7fd59402a110 comp rx=0 tx=0).stop 2024-09-12T01:58:05.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.918+0000 7fd5a01d6640 1 -- 172.21.15.19:0/125644748 shutdown_connections 2024-09-12T01:58:05.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.918+0000 7fd5a01d6640 1 --2- 172.21.15.19:0/125644748 >> v2:172.21.15.135:3300/0 conn(0x7fd598162e30 0x7fd5980d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.918+0000 7fd5a01d6640 1 --2- 172.21.15.19:0/125644748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd598162340 0x7fd59806d740 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.918+0000 7fd5a01d6640 1 -- 172.21.15.19:0/125644748 >> 172.21.15.19:0/125644748 conn(0x7fd59808bfc0 msgr2=0x7fd5980d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:05.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.918+0000 7fd5a01d6640 1 -- 172.21.15.19:0/125644748 shutdown_connections 2024-09-12T01:58:05.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.918+0000 7fd5a01d6640 1 -- 172.21.15.19:0/125644748 wait complete. 2024-09-12T01:58:05.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.920+0000 7fd5a01d6640 1 Processor -- start 2024-09-12T01:58:05.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.920+0000 7fd5a01d6640 1 -- start start 2024-09-12T01:58:05.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.920+0000 7fd5a01d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5980cf280 0x7fd5980cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.920+0000 7fd5a01d6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd598162340 0x7fd598153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.920+0000 7fd5a01d6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd598162e30 0x7fd5980cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.920+0000 7fd5a01d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd5980d52d0 con 0x7fd5980cf280 2024-09-12T01:58:05.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.920+0000 7fd5a01d6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd5980d2470 con 0x7fd598162340 2024-09-12T01:58:05.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.920+0000 7fd5a01d6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd5980cf6c0 con 0x7fd598162e30 2024-09-12T01:58:05.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.920+0000 7fd59df72640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5980cf280 0x7fd5980cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.920+0000 7fd59df72640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5980cf280 0x7fd5980cde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50208/0 (socket says 172.21.15.19:50208) 2024-09-12T01:58:05.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.920+0000 7fd59df72640 1 -- 172.21.15.19:0/1109448352 learned_addr learned my addr 172.21.15.19:0/1109448352 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:05.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.921+0000 7fd59d771640 1 --2- 172.21.15.19:0/1109448352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd598162340 0x7fd598153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.921+0000 7fd59e773640 1 --2- 172.21.15.19:0/1109448352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd598162e30 0x7fd5980cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.921+0000 7fd59df72640 1 -- 172.21.15.19:0/1109448352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd598162e30 msgr2=0x7fd5980cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.921+0000 7fd59df72640 1 --2- 172.21.15.19:0/1109448352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd598162e30 0x7fd5980cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.921+0000 7fd59df72640 1 -- 172.21.15.19:0/1109448352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd598162340 msgr2=0x7fd598153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.921+0000 7fd59df72640 1 --2- 172.21.15.19:0/1109448352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd598162340 0x7fd598153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.921+0000 7fd59df72640 1 -- 172.21.15.19:0/1109448352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5980c8a10 con 0x7fd5980cf280 2024-09-12T01:58:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.921+0000 7fd59d771640 1 --2- 172.21.15.19:0/1109448352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd598162340 0x7fd598153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.921+0000 7fd59df72640 1 --2- 172.21.15.19:0/1109448352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5980cf280 0x7fd5980cde50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd594009890 tx=0x7fd5940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.921+0000 7fd58e7fc640 1 -- 172.21.15.19:0/1109448352 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd594037040 con 0x7fd5980cf280 2024-09-12T01:58:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.921+0000 7fd58e7fc640 1 -- 172.21.15.19:0/1109448352 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd594042070 con 0x7fd5980cf280 2024-09-12T01:58:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.921+0000 7fd5a01d6640 1 -- 172.21.15.19:0/1109448352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5980ce390 con 0x7fd5980cf280 2024-09-12T01:58:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.921+0000 7fd58e7fc640 1 -- 172.21.15.19:0/1109448352 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd594030bd0 con 0x7fd5980cf280 2024-09-12T01:58:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.921+0000 7fd5a01d6640 1 -- 172.21.15.19:0/1109448352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5980cd090 con 0x7fd5980cf280 2024-09-12T01:58:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.922+0000 7fd5a01d6640 1 -- 172.21.15.19:0/1109448352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd59806d740 con 0x7fd5980cf280 2024-09-12T01:58:05.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.923+0000 7fd58e7fc640 1 -- 172.21.15.19:0/1109448352 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd594047460 con 0x7fd5980cf280 2024-09-12T01:58:05.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.923+0000 7fd58e7fc640 1 --2- 172.21.15.19:0/1109448352 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd57c06be30 0x7fd57c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.923+0000 7fd58e7fc640 1 -- 172.21.15.19:0/1109448352 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fd5940abc60 con 0x7fd5980cf280 2024-09-12T01:58:05.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.924+0000 7fd59d771640 1 --2- 172.21.15.19:0/1109448352 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd57c06be30 0x7fd57c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.924+0000 7fd59d771640 1 --2- 172.21.15.19:0/1109448352 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd57c06be30 0x7fd57c06e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd59815ad00 tx=0x7fd588007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:05.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:05.928+0000 7fd58e7fc640 1 -- 172.21.15.19:0/1109448352 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5980c8a10 con 0x7fd5980cf280 2024-09-12T01:58:06.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:06.103+0000 7fd5a01d6640 1 -- 172.21.15.19:0/1109448352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_inject_rename_corrupt_dentry_first}] v 0) -- 0x7fd5980ba450 con 0x7fd5980cf280 2024-09-12T01:58:06.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:06.106+0000 7fd58e7fc640 1 -- 172.21.15.19:0/1109448352 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_inject_rename_corrupt_dentry_first}]=0 v14)=0 v14) ==== 138+0+0 (secure 0 0 0) 0x7fd594032e20 con 0x7fd5980cf280 2024-09-12T01:58:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:06.108+0000 7fd5a01d6640 1 -- 172.21.15.19:0/1109448352 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd57c06be30 msgr2=0x7fd57c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:06.108+0000 7fd5a01d6640 1 --2- 172.21.15.19:0/1109448352 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd57c06be30 0x7fd57c06e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd59815ad00 tx=0x7fd588007d40 comp rx=0 tx=0).stop 2024-09-12T01:58:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:06.108+0000 7fd5a01d6640 1 -- 172.21.15.19:0/1109448352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5980cf280 msgr2=0x7fd5980cde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:06.108+0000 7fd5a01d6640 1 --2- 172.21.15.19:0/1109448352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5980cf280 0x7fd5980cde50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd594009890 tx=0x7fd5940046c0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:06.108+0000 7fd5a01d6640 1 -- 172.21.15.19:0/1109448352 shutdown_connections 2024-09-12T01:58:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:06.108+0000 7fd5a01d6640 1 --2- 172.21.15.19:0/1109448352 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd57c06be30 0x7fd57c06e2f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:06.108+0000 7fd5a01d6640 1 --2- 172.21.15.19:0/1109448352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd598162e30 0x7fd5980cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:06.108+0000 7fd5a01d6640 1 --2- 172.21.15.19:0/1109448352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd598162340 0x7fd598153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:06.108+0000 7fd5a01d6640 1 --2- 172.21.15.19:0/1109448352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5980cf280 0x7fd5980cde50 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:06.108+0000 7fd5a01d6640 1 -- 172.21.15.19:0/1109448352 >> 172.21.15.19:0/1109448352 conn(0x7fd59808bfc0 msgr2=0x7fd59806e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:06.108+0000 7fd5a01d6640 1 -- 172.21.15.19:0/1109448352 shutdown_connections 2024-09-12T01:58:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:06.108+0000 7fd5a01d6640 1 -- 172.21.15.19:0/1109448352 wait complete. 2024-09-12T01:58:11.121 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mv a/b a/c; sync .') 2024-09-12T01:58:11.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:58:11.181 INFO:tasks.ceph.mds.a.smithi019.stderr:2024-09-12T01:58:11.181+0000 7f76a2584640 -1 mds.0.cache.den(0x10000000000 c) newly corrupt dentry to be committed: [dentry #0x1/a/c [fffffffffffffff6,head] auth NULL (dn xlock x=1 by request(client.5607:44 nref=7 cr=0x55a5f2cfbc00)) (dversion lock w=1 last_client=5607) pv=4 v=3 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x55a5f2ea7400] 2024-09-12T01:58:11.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:58:11.189 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:58:11.189 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:58:11.207 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:58:11.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.353+0000 7f4b01986640 1 Processor -- start 2024-09-12T01:58:11.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.353+0000 7f4b01986640 1 -- start start 2024-09-12T01:58:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.354+0000 7f4b01986640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4afc0b63d0 0x7f4afc0cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.354+0000 7f4b01986640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4afc06fdb0 con 0x7f4afc0afd70 2024-09-12T01:58:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.354+0000 7f4b01986640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4afc070090 con 0x7f4afc0b5f80 2024-09-12T01:58:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.354+0000 7f4b01986640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f4afc070370 con 0x7f4afc0b63d0 2024-09-12T01:58:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.354+0000 7f4afb7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4afc0b63d0 0x7f4afc0cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.354+0000 7f4afb7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4afc0b63d0 0x7f4afc0cdd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52080/0 (socket says 172.21.15.19:52080) 2024-09-12T01:58:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.354+0000 7f4afaffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4afc0afd70 0x7f4afc160820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58236/0 (socket says 172.21.15.19:58236) 2024-09-12T01:58:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.354+0000 7f4afb7fe640 1 -- 172.21.15.19:0/2511648478 learned_addr learned my addr 172.21.15.19:0/2511648478 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.354+0000 7f4afb7fe640 1 -- 172.21.15.19:0/2511648478 >> v1:172.21.15.135:6789/0 conn(0x7f4afc0b5f80 legacy=0x7f4afc0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.354+0000 7f4afb7fe640 1 -- 172.21.15.19:0/2511648478 >> v1:172.21.15.19:6789/0 conn(0x7f4afc0afd70 legacy=0x7f4afc160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.354+0000 7f4afb7fe640 1 -- 172.21.15.19:0/2511648478 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4afc070650 con 0x7f4afc0b63d0 2024-09-12T01:58:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.354+0000 7f4af9ffb640 1 -- 172.21.15.19:0/2511648478 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 34065563 0 0) 0x7f4afc06fdb0 con 0x7f4afc0afd70 2024-09-12T01:58:11.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.355+0000 7f4afb7fe640 1 --2- 172.21.15.19:0/2511648478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc0b63d0 0x7f4afc0cdd60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4af4009870 tx=0x7f4af402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3542f05ca681cd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:11.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.355+0000 7f4af9ffb640 1 -- 172.21.15.19:0/2511648478 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af4037070 con 0x7f4afc0b63d0 2024-09-12T01:58:11.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.355+0000 7f4af9ffb640 1 -- 172.21.15.19:0/2511648478 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af402ae50 con 0x7f4afc0b63d0 2024-09-12T01:58:11.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.355+0000 7f4af9ffb640 1 -- 172.21.15.19:0/2511648478 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af4032860 con 0x7f4afc0b63d0 2024-09-12T01:58:11.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.356+0000 7f4b01986640 1 -- 172.21.15.19:0/2511648478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc0b63d0 msgr2=0x7f4afc0cdd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:11.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.356+0000 7f4b01986640 1 --2- 172.21.15.19:0/2511648478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc0b63d0 0x7f4afc0cdd60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4af4009870 tx=0x7f4af402a300 comp rx=0 tx=0).stop 2024-09-12T01:58:11.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.356+0000 7f4b01986640 1 -- 172.21.15.19:0/2511648478 shutdown_connections 2024-09-12T01:58:11.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.356+0000 7f4b01986640 1 --2- 172.21.15.19:0/2511648478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc0b63d0 0x7f4afc0cdd60 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.356+0000 7f4b01986640 1 -- 172.21.15.19:0/2511648478 >> 172.21.15.19:0/2511648478 conn(0x7f4afc06bc10 msgr2=0x7f4afc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:11.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.356+0000 7f4b01986640 1 -- 172.21.15.19:0/2511648478 shutdown_connections 2024-09-12T01:58:11.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.356+0000 7f4b01986640 1 -- 172.21.15.19:0/2511648478 wait complete. 2024-09-12T01:58:11.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.357+0000 7f4b01986640 1 Processor -- start 2024-09-12T01:58:11.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.357+0000 7f4b01986640 1 -- start start 2024-09-12T01:58:11.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.358+0000 7f4b01986640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4afc0afd70 0x7f4afc0aa630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:11.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.358+0000 7f4b01986640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc0b5f80 0x7f4afc0abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:11.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.358+0000 7f4b01986640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4afc0b63d0 0x7f4afc153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:11.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.358+0000 7f4b01986640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4afc0b0150 con 0x7f4afc0b5f80 2024-09-12T01:58:11.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.358+0000 7f4b01986640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4afc06fa80 con 0x7f4afc0afd70 2024-09-12T01:58:11.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.358+0000 7f4b01986640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4afc160060 con 0x7f4afc0b63d0 2024-09-12T01:58:11.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.358+0000 7f4afa7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc0b5f80 0x7f4afc0abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:11.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.358+0000 7f4afa7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc0b5f80 0x7f4afc0abf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52088/0 (socket says 172.21.15.19:52088) 2024-09-12T01:58:11.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.358+0000 7f4afa7fc640 1 -- 172.21.15.19:0/318249089 learned_addr learned my addr 172.21.15.19:0/318249089 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:11.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.358+0000 7f4afaffd640 1 --2- 172.21.15.19:0/318249089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4afc0afd70 0x7f4afc0aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:11.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.358+0000 7f4afb7fe640 1 --2- 172.21.15.19:0/318249089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4afc0b63d0 0x7f4afc153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:11.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.358+0000 7f4afa7fc640 1 -- 172.21.15.19:0/318249089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4afc0b63d0 msgr2=0x7f4afc153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:11.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.358+0000 7f4afa7fc640 1 --2- 172.21.15.19:0/318249089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4afc0b63d0 0x7f4afc153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.358+0000 7f4afa7fc640 1 -- 172.21.15.19:0/318249089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4afc0afd70 msgr2=0x7f4afc0aa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:11.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.358+0000 7f4afa7fc640 1 --2- 172.21.15.19:0/318249089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4afc0afd70 0x7f4afc0aa630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.358+0000 7f4afa7fc640 1 -- 172.21.15.19:0/318249089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4afc0aaef0 con 0x7f4afc0b5f80 2024-09-12T01:58:11.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.359+0000 7f4afa7fc640 1 --2- 172.21.15.19:0/318249089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc0b5f80 0x7f4afc0abf10 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400c450 tx=0x7f4ae400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:11.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.359+0000 7f4af3fff640 1 -- 172.21.15.19:0/318249089 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae40052d0 con 0x7f4afc0b5f80 2024-09-12T01:58:11.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.359+0000 7f4af3fff640 1 -- 172.21.15.19:0/318249089 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae4005470 con 0x7f4afc0b5f80 2024-09-12T01:58:11.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.359+0000 7f4b01986640 1 -- 172.21.15.19:0/318249089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4afc0adf80 con 0x7f4afc0b5f80 2024-09-12T01:58:11.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.359+0000 7f4af3fff640 1 -- 172.21.15.19:0/318249089 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4012870 con 0x7f4afc0b5f80 2024-09-12T01:58:11.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.359+0000 7f4b01986640 1 -- 172.21.15.19:0/318249089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4afc0aab70 con 0x7f4afc0b5f80 2024-09-12T01:58:11.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.360+0000 7f4b01986640 1 -- 172.21.15.19:0/318249089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4afc160820 con 0x7f4afc0b5f80 2024-09-12T01:58:11.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.360+0000 7f4af3fff640 1 -- 172.21.15.19:0/318249089 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ae4012a10 con 0x7f4afc0b5f80 2024-09-12T01:58:11.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.361+0000 7f4af3fff640 1 --2- 172.21.15.19:0/318249089 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4adc06be30 0x7f4adc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:11.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.361+0000 7f4af3fff640 1 -- 172.21.15.19:0/318249089 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f4ae408ab10 con 0x7f4afc0b5f80 2024-09-12T01:58:11.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.361+0000 7f4afaffd640 1 --2- 172.21.15.19:0/318249089 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4adc06be30 0x7f4adc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:11.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.362+0000 7f4afaffd640 1 --2- 172.21.15.19:0/318249089 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4adc06be30 0x7f4adc06e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0012e0 tx=0x7f4aec004d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:11.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.365+0000 7f4af3fff640 1 -- 172.21.15.19:0/318249089 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ae4058cd0 con 0x7f4afc0b5f80 2024-09-12T01:58:11.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.552+0000 7f4b01986640 1 -- 172.21.15.19:0/318249089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4afc067fc0 con 0x7f4afc0b5f80 2024-09-12T01:58:11.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.552+0000 7f4af3fff640 1 -- 172.21.15.19:0/318249089 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) ==== 80+0+0 (secure 0 0 0) 0x7f4ae405cfd0 con 0x7f4afc0b5f80 2024-09-12T01:58:11.553 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-09-12T01:58:11.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.554+0000 7f4b01986640 1 -- 172.21.15.19:0/318249089 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4adc06be30 msgr2=0x7f4adc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:11.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.554+0000 7f4b01986640 1 --2- 172.21.15.19:0/318249089 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4adc06be30 0x7f4adc06e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0012e0 tx=0x7f4aec004d40 comp rx=0 tx=0).stop 2024-09-12T01:58:11.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.554+0000 7f4b01986640 1 -- 172.21.15.19:0/318249089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc0b5f80 msgr2=0x7f4afc0abf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:11.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.554+0000 7f4b01986640 1 --2- 172.21.15.19:0/318249089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc0b5f80 0x7f4afc0abf10 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400c450 tx=0x7f4ae400c910 comp rx=0 tx=0).stop 2024-09-12T01:58:11.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.554+0000 7f4b01986640 1 -- 172.21.15.19:0/318249089 shutdown_connections 2024-09-12T01:58:11.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.554+0000 7f4b01986640 1 --2- 172.21.15.19:0/318249089 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4adc06be30 0x7f4adc06e2f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.554+0000 7f4b01986640 1 --2- 172.21.15.19:0/318249089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4afc0b63d0 0x7f4afc153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.554+0000 7f4b01986640 1 --2- 172.21.15.19:0/318249089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc0b5f80 0x7f4afc0abf10 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.554+0000 7f4b01986640 1 --2- 172.21.15.19:0/318249089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4afc0afd70 0x7f4afc0aa630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.554+0000 7f4b01986640 1 -- 172.21.15.19:0/318249089 >> 172.21.15.19:0/318249089 conn(0x7f4afc06bc10 msgr2=0x7f4afc06f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:11.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.555+0000 7f4b01986640 1 -- 172.21.15.19:0/318249089 shutdown_connections 2024-09-12T01:58:11.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.555+0000 7f4b01986640 1 -- 172.21.15.19:0/318249089 wait complete. 2024-09-12T01:58:11.566 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:58:11.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:11.566 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:58:11.597 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:58:11.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:11.598 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:58:11.654 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:58:11.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.796+0000 7f5d962ba640 1 Processor -- start 2024-09-12T01:58:11.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.796+0000 7f5d962ba640 1 -- start start 2024-09-12T01:58:11.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.797+0000 7f5d962ba640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d9015e760 0x7f5d9006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:11.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.797+0000 7f5d962ba640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5d900d4fd0 0x7f5d900cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.797+0000 7f5d962ba640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d900d2700 con 0x7f5d900b3650 2024-09-12T01:58:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.797+0000 7f5d962ba640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f5d900cedb0 con 0x7f5d9015e760 2024-09-12T01:58:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.797+0000 7f5d962ba640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f5d900cf090 con 0x7f5d900d4fd0 2024-09-12T01:58:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.797+0000 7f5d8ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d9015e760 0x7f5d9006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.797+0000 7f5d8ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d9015e760 0x7f5d9006cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52090/0 (socket says 172.21.15.19:52090) 2024-09-12T01:58:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.797+0000 7f5d8ffff640 1 -- 172.21.15.19:0/3907878580 learned_addr learned my addr 172.21.15.19:0/3907878580 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.797+0000 7f5d8ffff640 1 -- 172.21.15.19:0/3907878580 >> v2:172.21.15.135:3300/0 conn(0x7f5d900d4fd0 msgr2=0x7f5d900cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.797+0000 7f5d8f7fe640 1 --2- 172.21.15.19:0/3907878580 >> v2:172.21.15.135:3300/0 conn(0x7f5d900d4fd0 0x7f5d900cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.797+0000 7f5d8ffff640 1 --2- 172.21.15.19:0/3907878580 >> v2:172.21.15.135:3300/0 conn(0x7f5d900d4fd0 0x7f5d900cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.797+0000 7f5d8ffff640 1 -- 172.21.15.19:0/3907878580 >> v1:172.21.15.135:6789/0 conn(0x7f5d900b3650 legacy=0x7f5d900d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.797+0000 7f5d8ffff640 1 -- 172.21.15.19:0/3907878580 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d900b3c80 con 0x7f5d9015e760 2024-09-12T01:58:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.797+0000 7f5d8f7fe640 1 --2- 172.21.15.19:0/3907878580 >> v2:172.21.15.135:3300/0 conn(0x7f5d900d4fd0 0x7f5d900cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:11.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.798+0000 7f5d8ffff640 1 --2- 172.21.15.19:0/3907878580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9015e760 0x7f5d9006cdd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5d9008ca80 tx=0x7f5d8002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2539c0dd5063805d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:11.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.798+0000 7f5d8effd640 1 -- 172.21.15.19:0/3907878580 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80037070 con 0x7f5d9015e760 2024-09-12T01:58:11.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.798+0000 7f5d8effd640 1 -- 172.21.15.19:0/3907878580 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d80032440 con 0x7f5d9015e760 2024-09-12T01:58:11.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.798+0000 7f5d8effd640 1 -- 172.21.15.19:0/3907878580 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80032810 con 0x7f5d9015e760 2024-09-12T01:58:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.799+0000 7f5d962ba640 1 -- 172.21.15.19:0/3907878580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9015e760 msgr2=0x7f5d9006cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.799+0000 7f5d962ba640 1 --2- 172.21.15.19:0/3907878580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9015e760 0x7f5d9006cdd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5d9008ca80 tx=0x7f5d8002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.799+0000 7f5d962ba640 1 -- 172.21.15.19:0/3907878580 shutdown_connections 2024-09-12T01:58:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.799+0000 7f5d962ba640 1 --2- 172.21.15.19:0/3907878580 >> v2:172.21.15.135:3300/0 conn(0x7f5d900d4fd0 0x7f5d900cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.799+0000 7f5d962ba640 1 --2- 172.21.15.19:0/3907878580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9015e760 0x7f5d9006cdd0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.799+0000 7f5d962ba640 1 -- 172.21.15.19:0/3907878580 >> 172.21.15.19:0/3907878580 conn(0x7f5d9008bfc0 msgr2=0x7f5d900d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.799+0000 7f5d962ba640 1 -- 172.21.15.19:0/3907878580 shutdown_connections 2024-09-12T01:58:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.799+0000 7f5d962ba640 1 -- 172.21.15.19:0/3907878580 wait complete. 2024-09-12T01:58:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.800+0000 7f5d962ba640 1 Processor -- start 2024-09-12T01:58:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.800+0000 7f5d962ba640 1 -- start start 2024-09-12T01:58:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.801+0000 7f5d962ba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d900b3650 0x7f5d900b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.801+0000 7f5d962ba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d900d4fd0 0x7f5d9006da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.801+0000 7f5d962ba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d9015e760 0x7f5d900cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.801+0000 7f5d962ba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5d900cff00 con 0x7f5d900b3650 2024-09-12T01:58:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.801+0000 7f5d962ba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d900cfd80 con 0x7f5d900d4fd0 2024-09-12T01:58:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.801+0000 7f5d962ba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5d900d35b0 con 0x7f5d9015e760 2024-09-12T01:58:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.801+0000 7f5d8ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d900b3650 0x7f5d900b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.801+0000 7f5d8ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d900b3650 0x7f5d900b5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52094/0 (socket says 172.21.15.19:52094) 2024-09-12T01:58:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.801+0000 7f5d8ffff640 1 -- 172.21.15.19:0/3458498833 learned_addr learned my addr 172.21.15.19:0/3458498833 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.801+0000 7f5d8f7fe640 1 --2- 172.21.15.19:0/3458498833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d900d4fd0 0x7f5d9006da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.801+0000 7f5d94857640 1 --2- 172.21.15.19:0/3458498833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d9015e760 0x7f5d900cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.801+0000 7f5d8ffff640 1 -- 172.21.15.19:0/3458498833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d9015e760 msgr2=0x7f5d900cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.801+0000 7f5d8ffff640 1 --2- 172.21.15.19:0/3458498833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d9015e760 0x7f5d900cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.801+0000 7f5d8ffff640 1 -- 172.21.15.19:0/3458498833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d900d4fd0 msgr2=0x7f5d9006da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.801+0000 7f5d8ffff640 1 --2- 172.21.15.19:0/3458498833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d900d4fd0 0x7f5d9006da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.801+0000 7f5d8ffff640 1 -- 172.21.15.19:0/3458498833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d900b4ec0 con 0x7f5d900b3650 2024-09-12T01:58:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.802+0000 7f5d8ffff640 1 --2- 172.21.15.19:0/3458498833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d900b3650 0x7f5d900b5820 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5d80000c00 tx=0x7f5d800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.802+0000 7f5d8cff9640 1 -- 172.21.15.19:0/3458498833 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80041020 con 0x7f5d900b3650 2024-09-12T01:58:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.802+0000 7f5d8cff9640 1 -- 172.21.15.19:0/3458498833 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d80030970 con 0x7f5d900b3650 2024-09-12T01:58:11.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.802+0000 7f5d962ba640 1 -- 172.21.15.19:0/3458498833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d900b4340 con 0x7f5d900b3650 2024-09-12T01:58:11.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.802+0000 7f5d8cff9640 1 -- 172.21.15.19:0/3458498833 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80037040 con 0x7f5d900b3650 2024-09-12T01:58:11.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.802+0000 7f5d962ba640 1 -- 172.21.15.19:0/3458498833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d900b4900 con 0x7f5d900b3650 2024-09-12T01:58:11.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.803+0000 7f5d962ba640 1 -- 172.21.15.19:0/3458498833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d900d3880 con 0x7f5d900b3650 2024-09-12T01:58:11.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.803+0000 7f5d8cff9640 1 -- 172.21.15.19:0/3458498833 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d80044020 con 0x7f5d900b3650 2024-09-12T01:58:11.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.804+0000 7f5d8cff9640 1 --2- 172.21.15.19:0/3458498833 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5d7c06be60 0x7f5d7c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:11.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.804+0000 7f5d8cff9640 1 -- 172.21.15.19:0/3458498833 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f5d800ab890 con 0x7f5d900b3650 2024-09-12T01:58:11.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.804+0000 7f5d8f7fe640 1 --2- 172.21.15.19:0/3458498833 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5d7c06be60 0x7f5d7c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:11.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.805+0000 7f5d8f7fe640 1 --2- 172.21.15.19:0/3458498833 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5d7c06be60 0x7f5d7c06e320 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5d9006ed10 tx=0x7f5d84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:11.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:11.809+0000 7f5d8cff9640 1 -- 172.21.15.19:0/3458498833 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d8004b030 con 0x7f5d900b3650 2024-09-12T01:58:12.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.021+0000 7f5d962ba640 1 -- 172.21.15.19:0/3458498833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d900b5f90 con 0x7f5d900b3650 2024-09-12T01:58:12.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.022+0000 7f5d8cff9640 1 -- 172.21.15.19:0/3458498833 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7f5d900d2700 con 0x7f5d900b3650 2024-09-12T01:58:12.022 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:12.023 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-12T01:57:57:118704+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/4076449352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4076449352},{"type":"v1","addr":"172.21.15.135:6836","nonce":4076449352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1361756714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1361756714},{"type":"v1","addr":"172.21.15.135:6837","nonce":1361756714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3926640523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3926640523},{"type":"v1","addr":"172.21.15.19:6833","nonce":3926640523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:57:54.505612+0000","modified":"2024-09-12T01:57:56.457812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5421":{"gid":5421,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/1076479859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1076479859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1076479859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5421,"qdb_cluster":[5421]},"id":3}]} 2024-09-12T01:58:12.023 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-12T01:58:12.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.024+0000 7f5d962ba640 1 -- 172.21.15.19:0/3458498833 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5d7c06be60 msgr2=0x7f5d7c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.024+0000 7f5d962ba640 1 --2- 172.21.15.19:0/3458498833 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5d7c06be60 0x7f5d7c06e320 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5d9006ed10 tx=0x7f5d84008040 comp rx=0 tx=0).stop 2024-09-12T01:58:12.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.024+0000 7f5d962ba640 1 -- 172.21.15.19:0/3458498833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d900b3650 msgr2=0x7f5d900b5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.024+0000 7f5d962ba640 1 --2- 172.21.15.19:0/3458498833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d900b3650 0x7f5d900b5820 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5d80000c00 tx=0x7f5d800046c0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.024+0000 7f5d962ba640 1 -- 172.21.15.19:0/3458498833 shutdown_connections 2024-09-12T01:58:12.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.024+0000 7f5d962ba640 1 --2- 172.21.15.19:0/3458498833 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5d7c06be60 0x7f5d7c06e320 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.024+0000 7f5d962ba640 1 --2- 172.21.15.19:0/3458498833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d9015e760 0x7f5d900cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.024+0000 7f5d962ba640 1 --2- 172.21.15.19:0/3458498833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d900d4fd0 0x7f5d9006da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.024+0000 7f5d962ba640 1 --2- 172.21.15.19:0/3458498833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d900b3650 0x7f5d900b5820 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.024+0000 7f5d962ba640 1 -- 172.21.15.19:0/3458498833 >> 172.21.15.19:0/3458498833 conn(0x7f5d9008bfc0 msgr2=0x7f5d900d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:12.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.024+0000 7f5d962ba640 1 -- 172.21.15.19:0/3458498833 shutdown_connections 2024-09-12T01:58:12.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.024+0000 7f5d962ba640 1 -- 172.21.15.19:0/3458498833 wait complete. 2024-09-12T01:58:12.035 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:58:12.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.137+0000 7f24acce6640 1 Processor -- start 2024-09-12T01:58:12.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.137+0000 7f24acce6640 1 -- start start 2024-09-12T01:58:12.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.138+0000 7f24acce6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24a8161c80 0x7f24a806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.138+0000 7f24acce6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f24a8162060 0x7f24a80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.138+0000 7f24acce6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24a806e870 con 0x7f24a80b64b0 2024-09-12T01:58:12.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.138+0000 7f24acce6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f24a806d9f0 con 0x7f24a8162060 2024-09-12T01:58:12.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.138+0000 7f24acce6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f24a806dcd0 con 0x7f24a8161c80 2024-09-12T01:58:12.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.138+0000 7f24a659c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24a8161c80 0x7f24a806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.138+0000 7f24a5d9b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f24a8162060 0x7f24a80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.138+0000 7f24a6d9d640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f24a80b64b0 0x7f24a8162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:56424/0 (socket says 172.21.15.19:56424) 2024-09-12T01:58:12.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.138+0000 7f24a6d9d640 1 -- 172.21.15.19:0/3971871112 learned_addr learned my addr 172.21.15.19:0/3971871112 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:12.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.138+0000 7f24a5d9b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f24a8162060 0x7f24a80b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:52328/0 (socket says 172.21.15.19:52328) 2024-09-12T01:58:12.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.139+0000 7f24a5d9b640 1 -- 172.21.15.19:0/3971871112 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24a8161c80 msgr2=0x7f24a806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:12.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.139+0000 7f24a5d9b640 1 --2- 172.21.15.19:0/3971871112 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24a8161c80 0x7f24a806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.139+0000 7f24a5d9b640 1 -- 172.21.15.19:0/3971871112 >> v1:172.21.15.135:6789/0 conn(0x7f24a80b64b0 legacy=0x7f24a8162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.139+0000 7f24a5d9b640 1 -- 172.21.15.19:0/3971871112 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a806dfb0 con 0x7f24a8162060 2024-09-12T01:58:12.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.139+0000 7f24a659c640 1 --2- 172.21.15.19:0/3971871112 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24a8161c80 0x7f24a806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:12.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.140+0000 7f24a5d9b640 1 --2- 172.21.15.19:0/3971871112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24a8162060 0x7f24a80b5f70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f249c0097a0 tx=0x7f249c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2caf69f1adebe571 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:12.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.140+0000 7f24a559a640 1 -- 172.21.15.19:0/3971871112 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c037070 con 0x7f24a8162060 2024-09-12T01:58:12.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.140+0000 7f24a559a640 1 -- 172.21.15.19:0/3971871112 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f249c032440 con 0x7f24a8162060 2024-09-12T01:58:12.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.140+0000 7f24a559a640 1 -- 172.21.15.19:0/3971871112 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c032810 con 0x7f24a8162060 2024-09-12T01:58:12.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.140+0000 7f24acce6640 1 -- 172.21.15.19:0/3971871112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24a8162060 msgr2=0x7f24a80b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.140+0000 7f24acce6640 1 --2- 172.21.15.19:0/3971871112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24a8162060 0x7f24a80b5f70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f249c0097a0 tx=0x7f249c02a180 comp rx=0 tx=0).stop 2024-09-12T01:58:12.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.140+0000 7f24acce6640 1 -- 172.21.15.19:0/3971871112 shutdown_connections 2024-09-12T01:58:12.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.140+0000 7f24acce6640 1 --2- 172.21.15.19:0/3971871112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24a8162060 0x7f24a80b5f70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.140+0000 7f24acce6640 1 --2- 172.21.15.19:0/3971871112 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24a8161c80 0x7f24a806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.140+0000 7f24acce6640 1 -- 172.21.15.19:0/3971871112 >> 172.21.15.19:0/3971871112 conn(0x7f24a80d44f0 msgr2=0x7f24a80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:12.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.140+0000 7f24acce6640 1 -- 172.21.15.19:0/3971871112 shutdown_connections 2024-09-12T01:58:12.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.140+0000 7f24acce6640 1 -- 172.21.15.19:0/3971871112 wait complete. 2024-09-12T01:58:12.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.142+0000 7f24acce6640 1 Processor -- start 2024-09-12T01:58:12.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.142+0000 7f24acce6640 1 -- start start 2024-09-12T01:58:12.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.142+0000 7f24acce6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24a80b64b0 0x7f24a81564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.142+0000 7f24acce6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24a8161c80 0x7f24a815e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.142+0000 7f24acce6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24a8162060 0x7f24a815eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.142+0000 7f24acce6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f24a80d2a10 con 0x7f24a8161c80 2024-09-12T01:58:12.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.142+0000 7f24acce6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f24a80d2890 con 0x7f24a80b64b0 2024-09-12T01:58:12.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.142+0000 7f24acce6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f24a80b6960 con 0x7f24a8162060 2024-09-12T01:58:12.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.143+0000 7f24a5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24a8161c80 0x7f24a815e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.143+0000 7f24a5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24a8161c80 0x7f24a815e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52110/0 (socket says 172.21.15.19:52110) 2024-09-12T01:58:12.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.143+0000 7f24a5d9b640 1 -- 172.21.15.19:0/4269726553 learned_addr learned my addr 172.21.15.19:0/4269726553 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:12.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.143+0000 7f24a6d9d640 1 --2- 172.21.15.19:0/4269726553 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24a8162060 0x7f24a815eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.143+0000 7f24a659c640 1 --2- 172.21.15.19:0/4269726553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24a80b64b0 0x7f24a81564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.143+0000 7f24a5d9b640 1 -- 172.21.15.19:0/4269726553 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24a8162060 msgr2=0x7f24a815eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.143+0000 7f24a5d9b640 1 --2- 172.21.15.19:0/4269726553 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24a8162060 0x7f24a815eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.143+0000 7f24a5d9b640 1 -- 172.21.15.19:0/4269726553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24a80b64b0 msgr2=0x7f24a81564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.143+0000 7f24a5d9b640 1 --2- 172.21.15.19:0/4269726553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24a80b64b0 0x7f24a81564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.143+0000 7f24a5d9b640 1 -- 172.21.15.19:0/4269726553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a80c9210 con 0x7f24a8161c80 2024-09-12T01:58:12.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.143+0000 7f24a5d9b640 1 --2- 172.21.15.19:0/4269726553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24a8161c80 0x7f24a815e860 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f249c000c00 tx=0x7f249c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:12.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.143+0000 7f2496ffd640 1 -- 172.21.15.19:0/4269726553 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c037040 con 0x7f24a8161c80 2024-09-12T01:58:12.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.143+0000 7f2496ffd640 1 -- 172.21.15.19:0/4269726553 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f249c042070 con 0x7f24a8161c80 2024-09-12T01:58:12.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.143+0000 7f2496ffd640 1 -- 172.21.15.19:0/4269726553 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c030920 con 0x7f24a8161c80 2024-09-12T01:58:12.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.143+0000 7f24acce6640 1 -- 172.21.15.19:0/4269726553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a80c94f0 con 0x7f24a8161c80 2024-09-12T01:58:12.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.144+0000 7f24acce6640 1 -- 172.21.15.19:0/4269726553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a80c97d0 con 0x7f24a8161c80 2024-09-12T01:58:12.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.144+0000 7f24acce6640 1 -- 172.21.15.19:0/4269726553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a8068ea0 con 0x7f24a8161c80 2024-09-12T01:58:12.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.145+0000 7f2496ffd640 1 -- 172.21.15.19:0/4269726553 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f249c030ac0 con 0x7f24a8161c80 2024-09-12T01:58:12.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.145+0000 7f2496ffd640 1 --2- 172.21.15.19:0/4269726553 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f248806be30 0x7f248806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.145+0000 7f2496ffd640 1 -- 172.21.15.19:0/4269726553 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f249c0ab8a0 con 0x7f24a8161c80 2024-09-12T01:58:12.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.146+0000 7f24a659c640 1 --2- 172.21.15.19:0/4269726553 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f248806be30 0x7f248806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.146+0000 7f24a659c640 1 --2- 172.21.15.19:0/4269726553 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f248806be30 0x7f248806e2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2498009560 tx=0x7f2498008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:12.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.150+0000 7f2496ffd640 1 -- 172.21.15.19:0/4269726553 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f249c07a150 con 0x7f24a8161c80 2024-09-12T01:58:12.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.361+0000 7f24acce6640 1 -- 172.21.15.19:0/4269726553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24a80b5d90 con 0x7f24a8161c80 2024-09-12T01:58:12.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.361+0000 7f2496ffd640 1 -- 172.21.15.19:0/4269726553 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7f249c079a50 con 0x7f24a8161c80 2024-09-12T01:58:12.362 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:12.362 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-12T01:57:57:118704+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/4076449352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4076449352},{"type":"v1","addr":"172.21.15.135:6836","nonce":4076449352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1361756714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1361756714},{"type":"v1","addr":"172.21.15.135:6837","nonce":1361756714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3926640523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3926640523},{"type":"v1","addr":"172.21.15.19:6833","nonce":3926640523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:57:54.505612+0000","modified":"2024-09-12T01:57:56.457812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5421":{"gid":5421,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/1076479859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1076479859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1076479859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5421,"qdb_cluster":[5421]},"id":3}]} 2024-09-12T01:58:12.362 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-12T01:58:12.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.363+0000 7f24acce6640 1 -- 172.21.15.19:0/4269726553 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f248806be30 msgr2=0x7f248806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.363+0000 7f24acce6640 1 --2- 172.21.15.19:0/4269726553 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f248806be30 0x7f248806e2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2498009560 tx=0x7f2498008040 comp rx=0 tx=0).stop 2024-09-12T01:58:12.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.363+0000 7f24acce6640 1 -- 172.21.15.19:0/4269726553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24a8161c80 msgr2=0x7f24a815e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.363+0000 7f24acce6640 1 --2- 172.21.15.19:0/4269726553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24a8161c80 0x7f24a815e860 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f249c000c00 tx=0x7f249c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.363+0000 7f24acce6640 1 -- 172.21.15.19:0/4269726553 shutdown_connections 2024-09-12T01:58:12.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.363+0000 7f24acce6640 1 --2- 172.21.15.19:0/4269726553 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f248806be30 0x7f248806e2f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.363+0000 7f24acce6640 1 --2- 172.21.15.19:0/4269726553 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24a8162060 0x7f24a815eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.363+0000 7f24acce6640 1 --2- 172.21.15.19:0/4269726553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24a8161c80 0x7f24a815e860 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.363+0000 7f24acce6640 1 --2- 172.21.15.19:0/4269726553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24a80b64b0 0x7f24a81564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.363+0000 7f24acce6640 1 -- 172.21.15.19:0/4269726553 >> 172.21.15.19:0/4269726553 conn(0x7f24a80d44f0 msgr2=0x7f24a80b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:12.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.363+0000 7f24acce6640 1 -- 172.21.15.19:0/4269726553 shutdown_connections 2024-09-12T01:58:12.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.363+0000 7f24acce6640 1 -- 172.21.15.19:0/4269726553 wait complete. 2024-09-12T01:58:12.375 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump tree /a 0 2024-09-12T01:58:12.493 INFO:teuthology.orchestra.run.smithi019.stdout:[{"ino":1099511627776,"rdev":0,"ctime":"2024-09-12T01:58:11.180617+0000","btime":"2024-09-12T01:58:05.318680+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-12T01:58:11.180617+0000","atime":"2024-09-12T01:58:05.318680+0000","time_warp_seq":0,"change_attr":3,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-12T01:58:11.180617+0000","num_files":0,"num_subdirs":1,"change_attr":3},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":2,"rsnaps":0,"rctime":"2024-09-12T01:58:11.180617+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":2,"rsnaps":0,"rctime":"2024-09-12T01:58:11.180617+0000"},"version":9,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"dirfrag":1,"caps":0,"dirtyparent":0,"dirty":1,"authpin":0},"nref":2,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[{"path":"/a","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"7","version":"7","committing_version":"3","committed_version":"3","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"a/c","alternate_name":"","path_ino":1,"snap_first":18446744073709551606,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511627777,"remote_type":"","version":4,"projected_version":4,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]},{"path":"a/b","alternate_name":"","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":false,"is_remote":false,"is_null":true,"is_new":false,"inode":0,"remote_type":"","version":5,"projected_version":5,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":0,"dirty":1,"authpin":0},"nref":1,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}],"is_subvolume":false}] 2024-09-12T01:58:12.494 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 0, "rctime": "2024-09-12T01:58:11.180617+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 2, "version": 0 }, "atime": "2024-09-12T01:58:05.318680+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-12T01:58:05.318680+0000", "change_attr": 3, "client_caps": [], "client_ranges": [], "ctime": "2024-09-12T01:58:11.180617+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "3", "committing_version": "3", "dentries": [ { "alternate_name": "", "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511627777, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "a/c", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 4, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 18446744073709551606, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } }, { "alternate_name": "", "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 0, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": true, "is_primary": false, "is_remote": false, "lock": {}, "nref": 1, "path": "a/b", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 0, "lock": 0, "request": 0 }, "projected_version": 5, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 5, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/a", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 3, "mtime": "2024-09-12T01:58:11.180617+0000", "num_files": 0, "num_subdirs": 1, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-12T01:58:11.180617+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 2, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 0, "dirfrag": 1, "dirty": 1, "dirtyparent": 0, "lock": 0, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2024-09-12T01:58:11.180617+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 2, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 9, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } ] 2024-09-12T01:58:12.495 DEBUG:tasks.cephfs.test_damage:[{'ino': 1099511627776, 'rdev': 0, 'ctime': '2024-09-12T01:58:11.180617+0000', 'btime': '2024-09-12T01:58:05.318680+0000', 'mode': 16877, 'uid': 1000, 'gid': 1333, 'nlink': 1, 'dir_layout': {'dir_hash': 2, 'unused1': 0, 'unused2': 0, 'unused3': 0}, 'layout': {'stripe_unit': 0, 'stripe_count': 0, 'object_size': 0, 'pool_id': -1, 'pool_ns': ''}, 'old_pools': [], 'size': 0, 'truncate_seq': 1, 'truncate_size': 18446744073709551615, 'truncate_from': 0, 'truncate_pending': 0, 'mtime': '2024-09-12T01:58:11.180617+0000', 'atime': '2024-09-12T01:58:05.318680+0000', 'time_warp_seq': 0, 'change_attr': 3, 'export_pin': -1, 'export_ephemeral_random_pin': 0, 'export_ephemeral_distributed_pin': False, 'quiesce_block': False, 'client_ranges': [], 'dirstat': {'version': 0, 'mtime': '2024-09-12T01:58:11.180617+0000', 'num_files': 0, 'num_subdirs': 1, 'change_attr': 3}, 'rstat': {'version': 0, 'rbytes': 0, 'rfiles': 0, 'rsubdirs': 2, 'rsnaps': 0, 'rctime': '2024-09-12T01:58:11.180617+0000'}, 'accounted_rstat': {'version': 0, 'rbytes': 0, 'rfiles': 0, 'rsubdirs': 2, 'rsnaps': 0, 'rctime': '2024-09-12T01:58:11.180617+0000'}, 'version': 9, 'file_data_version': 0, 'xattr_version': 1, 'backtrace_version': 2, 'stray_prior_path': '', 'max_size_ever': 0, 'quota': {'max_bytes': 0, 'max_files': 0}, 'last_scrub_stamp': '0.000000', 'last_scrub_version': 0, 'symlink': '', 'xattrs': [{'key': 'security.selinux', 'val': 'unconfined_u:object_r:unlabeled_t:s0\x00'}], 'dirfragtree': {'splits': []}, 'old_inodes': [], 'oldest_snap': 18446744073709551614, 'damage_flags': 0, 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'request': 0, 'lock': 0, 'dirfrag': 1, 'caps': 0, 'dirtyparent': 0, 'dirty': 1, 'authpin': 0}, 'nref': 2, 'versionlock': {'gather_set': [], 'state': 'lock', 'type': 'iversion', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'authlock': {}, 'linklock': {}, 'dirfragtreelock': {}, 'filelock': {}, 'xattrlock': {}, 'snaplock': {}, 'nestlock': {'gather_set': [], 'state': 'lock', 'type': 'inest', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'flocklock': {}, 'policylock': {}, 'quiescelock': {'gather_set': [], 'state': 'lock', 'type': 'iquiesce', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'states': ['auth', 'dirty'], 'client_caps': [], 'loner': -1, 'want_loner': -1, 'mds_caps_wanted': [], 'dirfrags': [{'path': '/a', 'dirfrag': '0x10000000000', 'snapid_first': 2, 'projected_version': '7', 'version': '7', 'committing_version': '3', 'committed_version': '3', 'is_rep': False, 'dir_auth': '', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'child': 1, 'dirty': 1, 'authpin': 0}, 'nref': 2, 'dentries': [{'path': 'a/c', 'alternate_name': '', 'path_ino': 1, 'snap_first': 18446744073709551606, 'snap_last': 18446744073709551614, 'is_primary': True, 'is_remote': False, 'is_null': False, 'is_new': False, 'inode': 1099511627777, 'remote_type': '', 'version': 4, 'projected_version': 4, 'auth_pins': 0, 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'is_frozen': False, 'is_freezing': False, 'pins': {'request': 0, 'lock': 0, 'inodepin': 1, 'dirty': 1, 'authpin': 0}, 'nref': 2, 'lock': {}, 'versionlock': {'gather_set': [], 'state': 'lock', 'type': 'dversion', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'states': ['auth', 'dirty']}, {'path': 'a/b', 'alternate_name': '', 'path_ino': 1, 'snap_first': 2, 'snap_last': 18446744073709551614, 'is_primary': False, 'is_remote': False, 'is_null': True, 'is_new': False, 'inode': 0, 'remote_type': '', 'version': 5, 'projected_version': 5, 'auth_pins': 0, 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'is_frozen': False, 'is_freezing': False, 'pins': {'request': 0, 'lock': 0, 'inodepin': 0, 'dirty': 1, 'authpin': 0}, 'nref': 1, 'lock': {}, 'versionlock': {'gather_set': [], 'state': 'lock', 'type': 'dversion', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'states': ['auth', 'dirty']}]}], 'is_subvolume': False}] 2024-09-12T01:58:12.495 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T01:58:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.598+0000 7fce5710a640 1 Processor -- start 2024-09-12T01:58:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.598+0000 7fce5710a640 1 -- start start 2024-09-12T01:58:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.598+0000 7fce5710a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce500d04a0 0x7fce500d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.598+0000 7fce5710a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce500ae550 0x7fce500ae980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.598+0000 7fce5710a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce5006cb30 con 0x7fce50147360 2024-09-12T01:58:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.598+0000 7fce5710a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fce500d0e50 con 0x7fce500ae550 2024-09-12T01:58:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.598+0000 7fce5710a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fce5006bfb0 con 0x7fce500d04a0 2024-09-12T01:58:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.599+0000 7fce556a7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce500ae550 0x7fce500ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.599+0000 7fce556a7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce500ae550 0x7fce500ae980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52118/0 (socket says 172.21.15.19:52118) 2024-09-12T01:58:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.599+0000 7fce556a7640 1 -- 172.21.15.19:0/3234303538 learned_addr learned my addr 172.21.15.19:0/3234303538 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.599+0000 7fce54ea6640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fce50147360 0x7fce50070890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58240/0 (socket says 172.21.15.19:58240) 2024-09-12T01:58:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.599+0000 7fce4ffff640 1 --2- 172.21.15.19:0/3234303538 >> v2:172.21.15.135:3300/0 conn(0x7fce500d04a0 0x7fce500d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.599+0000 7fce556a7640 1 -- 172.21.15.19:0/3234303538 >> v2:172.21.15.135:3300/0 conn(0x7fce500d04a0 msgr2=0x7fce500d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.599+0000 7fce556a7640 1 --2- 172.21.15.19:0/3234303538 >> v2:172.21.15.135:3300/0 conn(0x7fce500d04a0 0x7fce500d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.599+0000 7fce556a7640 1 -- 172.21.15.19:0/3234303538 >> v1:172.21.15.19:6789/0 conn(0x7fce50147360 legacy=0x7fce50070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.599+0000 7fce556a7640 1 -- 172.21.15.19:0/3234303538 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5006c290 con 0x7fce500ae550 2024-09-12T01:58:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.599+0000 7fce4ffff640 1 --2- 172.21.15.19:0/3234303538 >> v2:172.21.15.135:3300/0 conn(0x7fce500d04a0 0x7fce500d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.600+0000 7fce556a7640 1 --2- 172.21.15.19:0/3234303538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce500ae550 0x7fce500ae980 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fce500cec70 tx=0x7fce4802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df40d83d37696fc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.600+0000 7fce4f7fe640 1 -- 172.21.15.19:0/3234303538 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce48036070 con 0x7fce500ae550 2024-09-12T01:58:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.600+0000 7fce4f7fe640 1 -- 172.21.15.19:0/3234303538 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce48031600 con 0x7fce500ae550 2024-09-12T01:58:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.600+0000 7fce4f7fe640 1 -- 172.21.15.19:0/3234303538 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce480319d0 con 0x7fce500ae550 2024-09-12T01:58:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.600+0000 7fce5710a640 1 -- 172.21.15.19:0/3234303538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce500ae550 msgr2=0x7fce500ae980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.600+0000 7fce5710a640 1 --2- 172.21.15.19:0/3234303538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce500ae550 0x7fce500ae980 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fce500cec70 tx=0x7fce4802a6a0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.600+0000 7fce5710a640 1 -- 172.21.15.19:0/3234303538 shutdown_connections 2024-09-12T01:58:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.600+0000 7fce5710a640 1 --2- 172.21.15.19:0/3234303538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce500ae550 0x7fce500ae980 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.600+0000 7fce5710a640 1 --2- 172.21.15.19:0/3234303538 >> v2:172.21.15.135:3300/0 conn(0x7fce500d04a0 0x7fce500d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.600+0000 7fce5710a640 1 -- 172.21.15.19:0/3234303538 >> 172.21.15.19:0/3234303538 conn(0x7fce500b2f40 msgr2=0x7fce500b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.600+0000 7fce5710a640 1 -- 172.21.15.19:0/3234303538 shutdown_connections 2024-09-12T01:58:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.601+0000 7fce5710a640 1 -- 172.21.15.19:0/3234303538 wait complete. 2024-09-12T01:58:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.602+0000 7fce5710a640 1 Processor -- start 2024-09-12T01:58:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.602+0000 7fce5710a640 1 -- start start 2024-09-12T01:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce5710a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce500ae550 0x7fce50141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce5710a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce500d04a0 0x7fce50141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce5710a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce50147360 0x7fce5015e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce5710a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fce50070fa0 con 0x7fce500d04a0 2024-09-12T01:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce5710a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce5006c850 con 0x7fce50147360 2024-09-12T01:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce5710a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fce5006bc10 con 0x7fce500ae550 2024-09-12T01:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce4ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce500d04a0 0x7fce50141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce4ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce500d04a0 0x7fce50141500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52126/0 (socket says 172.21.15.19:52126) 2024-09-12T01:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce4ffff640 1 -- 172.21.15.19:0/3377875948 learned_addr learned my addr 172.21.15.19:0/3377875948 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce556a7640 1 --2- 172.21.15.19:0/3377875948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce50147360 0x7fce5015e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce54ea6640 1 --2- 172.21.15.19:0/3377875948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce500ae550 0x7fce50141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce4ffff640 1 -- 172.21.15.19:0/3377875948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce500ae550 msgr2=0x7fce50141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce4ffff640 1 --2- 172.21.15.19:0/3377875948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce500ae550 0x7fce50141ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce4ffff640 1 -- 172.21.15.19:0/3377875948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce50147360 msgr2=0x7fce5015e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce4ffff640 1 --2- 172.21.15.19:0/3377875948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce50147360 0x7fce5015e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce4ffff640 1 -- 172.21.15.19:0/3377875948 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce50142150 con 0x7fce500d04a0 2024-09-12T01:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce556a7640 1 --2- 172.21.15.19:0/3377875948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce50147360 0x7fce5015e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce4ffff640 1 --2- 172.21.15.19:0/3377875948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce500d04a0 0x7fce50141500 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00c7f0 tx=0x7fce3c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce4d7fa640 1 -- 172.21.15.19:0/3377875948 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c015070 con 0x7fce500d04a0 2024-09-12T01:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce4d7fa640 1 -- 172.21.15.19:0/3377875948 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce3c007820 con 0x7fce500d04a0 2024-09-12T01:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce5710a640 1 -- 172.21.15.19:0/3377875948 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce5015e860 con 0x7fce500d04a0 2024-09-12T01:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce4d7fa640 1 -- 172.21.15.19:0/3377875948 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c007bd0 con 0x7fce500d04a0 2024-09-12T01:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.603+0000 7fce5710a640 1 -- 172.21.15.19:0/3377875948 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce5015ee20 con 0x7fce500d04a0 2024-09-12T01:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.605+0000 7fce5710a640 1 -- 172.21.15.19:0/3377875948 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce500d0910 con 0x7fce500d04a0 2024-09-12T01:58:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.605+0000 7fce4d7fa640 1 -- 172.21.15.19:0/3377875948 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce3c018070 con 0x7fce500d04a0 2024-09-12T01:58:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.606+0000 7fce4d7fa640 1 --2- 172.21.15.19:0/3377875948 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce3406be30 0x7fce3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.606+0000 7fce4d7fa640 1 -- 172.21.15.19:0/3377875948 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fce3c08aec0 con 0x7fce500d04a0 2024-09-12T01:58:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.606+0000 7fce54ea6640 1 --2- 172.21.15.19:0/3377875948 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce3406be30 0x7fce3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.606+0000 7fce54ea6640 1 --2- 172.21.15.19:0/3377875948 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce3406be30 0x7fce3406e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fce44000f60 tx=0x7fce44007cc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.610+0000 7fce4d7fa640 1 -- 172.21.15.19:0/3377875948 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce3c0596e0 con 0x7fce500d04a0 2024-09-12T01:58:12.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.822+0000 7fce5710a640 1 -- 172.21.15.19:0/3377875948 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fce5006fd70 con 0x7fce500d04a0 2024-09-12T01:58:12.823 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T01:58:12.822+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:58:12.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.824+0000 7fce4d7fa640 1 -- 172.21.15.19:0/3377875948 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) ==== 161+0+0 (secure 0 0 0) 0x7fce3c058fe0 con 0x7fce500d04a0 2024-09-12T01:58:12.824 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:58:12.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.826+0000 7fce5710a640 1 -- 172.21.15.19:0/3377875948 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce3406be30 msgr2=0x7fce3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.826+0000 7fce5710a640 1 --2- 172.21.15.19:0/3377875948 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce3406be30 0x7fce3406e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fce44000f60 tx=0x7fce44007cc0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.826+0000 7fce5710a640 1 -- 172.21.15.19:0/3377875948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce500d04a0 msgr2=0x7fce50141500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.826+0000 7fce5710a640 1 --2- 172.21.15.19:0/3377875948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce500d04a0 0x7fce50141500 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00c7f0 tx=0x7fce3c00ccb0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.826+0000 7fce5710a640 1 -- 172.21.15.19:0/3377875948 shutdown_connections 2024-09-12T01:58:12.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.826+0000 7fce5710a640 1 --2- 172.21.15.19:0/3377875948 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce3406be30 0x7fce3406e2f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.826+0000 7fce5710a640 1 --2- 172.21.15.19:0/3377875948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce50147360 0x7fce5015e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.826+0000 7fce5710a640 1 --2- 172.21.15.19:0/3377875948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce500d04a0 0x7fce50141500 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.826+0000 7fce5710a640 1 --2- 172.21.15.19:0/3377875948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce500ae550 0x7fce50141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.826+0000 7fce5710a640 1 -- 172.21.15.19:0/3377875948 >> 172.21.15.19:0/3377875948 conn(0x7fce500b2f40 msgr2=0x7fce500b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:12.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.826+0000 7fce5710a640 1 -- 172.21.15.19:0/3377875948 shutdown_connections 2024-09-12T01:58:12.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.826+0000 7fce5710a640 1 -- 172.21.15.19:0/3377875948 wait complete. 2024-09-12T01:58:12.831 INFO:tasks.ceph.mds.a.smithi019.stderr: -4091> 2024-09-12T01:58:00.383+0000 7f769fd7f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:58:12.834 INFO:tasks.ceph.mds.a.smithi019.stderr: -289> 2024-09-12T01:58:11.181+0000 7f76a2584640 -1 mds.0.cache.den(0x10000000000 c) newly corrupt dentry to be committed: [dentry #0x1/a/c [fffffffffffffff6,head] auth NULL (dn xlock x=1 by request(client.5607:44 nref=7 cr=0x55a5f2cfbc00)) (dversion lock w=1 last_client=5607) pv=4 v=3 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x55a5f2ea7400] 2024-09-12T01:58:12.838 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_inject_rename_corrupt_dentry_first 2024-09-12T01:58:12.861 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-09-12T01:58:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.944+0000 7fa19c4a4640 1 Processor -- start 2024-09-12T01:58:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.944+0000 7fa19c4a4640 1 -- start start 2024-09-12T01:58:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.945+0000 7fa19c4a4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa194162340 0x7fa19406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.945+0000 7fa19c4a4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1940cf280 0x7fa194162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.945+0000 7fa19c4a4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa194162c60 0x7fa1940d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.945+0000 7fa19c4a4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa19406de90 con 0x7fa194162c60 2024-09-12T01:58:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.945+0000 7fa19c4a4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa19415ff70 con 0x7fa194162340 2024-09-12T01:58:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.945+0000 7fa19c4a4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa1940d4d10 con 0x7fa1940cf280 2024-09-12T01:58:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.946+0000 7fa19aa41640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa194162c60 0x7fa1940d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.946+0000 7fa19aa41640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa194162c60 0x7fa1940d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52148/0 (socket says 172.21.15.19:52148) 2024-09-12T01:58:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.946+0000 7fa19aa41640 1 -- 172.21.15.19:0/1240538373 learned_addr learned my addr 172.21.15.19:0/1240538373 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.946+0000 7fa19a240640 1 --2- 172.21.15.19:0/1240538373 >> v2:172.21.15.135:3300/0 conn(0x7fa194162340 0x7fa19406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.946+0000 7fa19aa41640 1 -- 172.21.15.19:0/1240538373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1940cf280 msgr2=0x7fa194162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.946+0000 7fa19aa41640 1 --2- 172.21.15.19:0/1240538373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1940cf280 0x7fa194162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.946+0000 7fa19aa41640 1 -- 172.21.15.19:0/1240538373 >> v2:172.21.15.135:3300/0 conn(0x7fa194162340 msgr2=0x7fa19406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.946+0000 7fa19aa41640 1 --2- 172.21.15.19:0/1240538373 >> v2:172.21.15.135:3300/0 conn(0x7fa194162340 0x7fa19406d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.946+0000 7fa19aa41640 1 -- 172.21.15.19:0/1240538373 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1940d4ff0 con 0x7fa194162c60 2024-09-12T01:58:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.946+0000 7fa19a240640 1 --2- 172.21.15.19:0/1240538373 >> v2:172.21.15.135:3300/0 conn(0x7fa194162340 0x7fa19406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:12.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.947+0000 7fa19aa41640 1 --2- 172.21.15.19:0/1240538373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa194162c60 0x7fa1940d2990 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa19408e4c0 tx=0x7fa18c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2fffe793d3a806c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:12.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.947+0000 7fa19923e640 1 -- 172.21.15.19:0/1240538373 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c036070 con 0x7fa194162c60 2024-09-12T01:58:12.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.947+0000 7fa19923e640 1 -- 172.21.15.19:0/1240538373 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa18c031600 con 0x7fa194162c60 2024-09-12T01:58:12.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.947+0000 7fa19923e640 1 -- 172.21.15.19:0/1240538373 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0319d0 con 0x7fa194162c60 2024-09-12T01:58:12.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.947+0000 7fa19c4a4640 1 -- 172.21.15.19:0/1240538373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa194162c60 msgr2=0x7fa1940d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.947+0000 7fa19c4a4640 1 --2- 172.21.15.19:0/1240538373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa194162c60 0x7fa1940d2990 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa19408e4c0 tx=0x7fa18c02a610 comp rx=0 tx=0).stop 2024-09-12T01:58:12.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.947+0000 7fa19c4a4640 1 -- 172.21.15.19:0/1240538373 shutdown_connections 2024-09-12T01:58:12.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.947+0000 7fa19c4a4640 1 --2- 172.21.15.19:0/1240538373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa194162c60 0x7fa1940d2990 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.947+0000 7fa19c4a4640 1 --2- 172.21.15.19:0/1240538373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1940cf280 0x7fa194162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.947+0000 7fa19c4a4640 1 --2- 172.21.15.19:0/1240538373 >> v2:172.21.15.135:3300/0 conn(0x7fa194162340 0x7fa19406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.947+0000 7fa19c4a4640 1 -- 172.21.15.19:0/1240538373 >> 172.21.15.19:0/1240538373 conn(0x7fa19408bfc0 msgr2=0x7fa1940d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:12.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.947+0000 7fa19c4a4640 1 -- 172.21.15.19:0/1240538373 shutdown_connections 2024-09-12T01:58:12.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.947+0000 7fa19c4a4640 1 -- 172.21.15.19:0/1240538373 wait complete. 2024-09-12T01:58:12.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.949+0000 7fa19c4a4640 1 Processor -- start 2024-09-12T01:58:12.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.949+0000 7fa19c4a4640 1 -- start start 2024-09-12T01:58:12.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.949+0000 7fa19c4a4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1940cf280 0x7fa19415b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.949+0000 7fa19c4a4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa194162340 0x7fa1941e89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.949+0000 7fa19c4a4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa194162c60 0x7fa1941e8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.949+0000 7fa19c4a4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa1940cf6c0 con 0x7fa194162340 2024-09-12T01:58:12.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.949+0000 7fa19c4a4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa1940d52d0 con 0x7fa194162c60 2024-09-12T01:58:12.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.949+0000 7fa19c4a4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa1941630f0 con 0x7fa1940cf280 2024-09-12T01:58:12.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.950+0000 7fa199a3f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa194162340 0x7fa1941e89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.950+0000 7fa199a3f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa194162340 0x7fa1941e89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52150/0 (socket says 172.21.15.19:52150) 2024-09-12T01:58:12.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.950+0000 7fa199a3f640 1 -- 172.21.15.19:0/3108467119 learned_addr learned my addr 172.21.15.19:0/3108467119 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:12.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.950+0000 7fa19a240640 1 --2- 172.21.15.19:0/3108467119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1940cf280 0x7fa19415b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.950+0000 7fa19aa41640 1 --2- 172.21.15.19:0/3108467119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa194162c60 0x7fa1941e8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.950+0000 7fa199a3f640 1 -- 172.21.15.19:0/3108467119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1940cf280 msgr2=0x7fa19415b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.950+0000 7fa199a3f640 1 --2- 172.21.15.19:0/3108467119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1940cf280 0x7fa19415b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.950+0000 7fa199a3f640 1 -- 172.21.15.19:0/3108467119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa194162c60 msgr2=0x7fa1941e8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.950+0000 7fa199a3f640 1 --2- 172.21.15.19:0/3108467119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa194162c60 0x7fa1941e8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.950+0000 7fa199a3f640 1 -- 172.21.15.19:0/3108467119 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1941e85a0 con 0x7fa194162340 2024-09-12T01:58:12.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.950+0000 7fa199a3f640 1 --2- 172.21.15.19:0/3108467119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa194162340 0x7fa1941e89f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa18400b3f0 tx=0x7fa18400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:12.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.950+0000 7fa18affd640 1 -- 172.21.15.19:0/3108467119 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184015030 con 0x7fa194162340 2024-09-12T01:58:12.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.950+0000 7fa18affd640 1 -- 172.21.15.19:0/3108467119 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa184005970 con 0x7fa194162340 2024-09-12T01:58:12.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.950+0000 7fa18affd640 1 -- 172.21.15.19:0/3108467119 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184005d60 con 0x7fa194162340 2024-09-12T01:58:12.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.950+0000 7fa19c4a4640 1 -- 172.21.15.19:0/3108467119 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1941e96c0 con 0x7fa194162340 2024-09-12T01:58:12.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.950+0000 7fa19c4a4640 1 -- 172.21.15.19:0/3108467119 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1941e99a0 con 0x7fa194162340 2024-09-12T01:58:12.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.951+0000 7fa19c4a4640 1 -- 172.21.15.19:0/3108467119 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa194162720 con 0x7fa194162340 2024-09-12T01:58:12.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.952+0000 7fa18affd640 1 -- 172.21.15.19:0/3108467119 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa184018070 con 0x7fa194162340 2024-09-12T01:58:12.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.952+0000 7fa18affd640 1 --2- 172.21.15.19:0/3108467119 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa17806be30 0x7fa17806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.952+0000 7fa18affd640 1 -- 172.21.15.19:0/3108467119 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7fa18408aa60 con 0x7fa194162340 2024-09-12T01:58:12.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.952+0000 7fa19a240640 1 --2- 172.21.15.19:0/3108467119 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa17806be30 0x7fa17806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.953+0000 7fa19a240640 1 --2- 172.21.15.19:0/3108467119 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa17806be30 0x7fa17806e2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa1941f7af0 tx=0x7fa190008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:12.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:12.957+0000 7fa18affd640 1 -- 172.21.15.19:0/3108467119 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa184058bd0 con 0x7fa194162340 2024-09-12T01:58:13.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.132+0000 7fa19c4a4640 1 -- 172.21.15.19:0/3108467119 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"} v 0) -- 0x7fa19408e640 con 0x7fa194162340 2024-09-12T01:58:13.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.135+0000 7fa18affd640 1 -- 172.21.15.19:0/3108467119 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"}]=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7fa18405ced0 con 0x7fa194162340 2024-09-12T01:58:13.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.137+0000 7fa19c4a4640 1 -- 172.21.15.19:0/3108467119 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa17806be30 msgr2=0x7fa17806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:13.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.137+0000 7fa19c4a4640 1 --2- 172.21.15.19:0/3108467119 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa17806be30 0x7fa17806e2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa1941f7af0 tx=0x7fa190008040 comp rx=0 tx=0).stop 2024-09-12T01:58:13.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.137+0000 7fa19c4a4640 1 -- 172.21.15.19:0/3108467119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa194162340 msgr2=0x7fa1941e89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:13.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.137+0000 7fa19c4a4640 1 --2- 172.21.15.19:0/3108467119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa194162340 0x7fa1941e89f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa18400b3f0 tx=0x7fa18400b8b0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.137+0000 7fa19c4a4640 1 -- 172.21.15.19:0/3108467119 shutdown_connections 2024-09-12T01:58:13.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.137+0000 7fa19c4a4640 1 --2- 172.21.15.19:0/3108467119 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa17806be30 0x7fa17806e2f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.137+0000 7fa19c4a4640 1 --2- 172.21.15.19:0/3108467119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa194162c60 0x7fa1941e8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.137+0000 7fa19c4a4640 1 --2- 172.21.15.19:0/3108467119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa194162340 0x7fa1941e89f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.137+0000 7fa19c4a4640 1 --2- 172.21.15.19:0/3108467119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1940cf280 0x7fa19415b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.137+0000 7fa19c4a4640 1 -- 172.21.15.19:0/3108467119 >> 172.21.15.19:0/3108467119 conn(0x7fa19408bfc0 msgr2=0x7fa1940b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:13.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.137+0000 7fa19c4a4640 1 -- 172.21.15.19:0/3108467119 shutdown_connections 2024-09-12T01:58:13.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.137+0000 7fa19c4a4640 1 -- 172.21.15.19:0/3108467119 wait complete. 2024-09-12T01:58:13.149 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_abort_on_newly_corrupt_dentry False 2024-09-12T01:58:13.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.295+0000 7f57d04c9640 1 Processor -- start 2024-09-12T01:58:13.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.295+0000 7f57d04c9640 1 -- start start 2024-09-12T01:58:13.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.296+0000 7f57d04c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57c8162980 0x7f57c80ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:13.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.296+0000 7f57d04c9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57c80d2600 con 0x7f57c80d4c10 2024-09-12T01:58:13.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.296+0000 7f57d04c9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57c80b3c10 con 0x7f57c80b5f80 2024-09-12T01:58:13.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.296+0000 7f57d04c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f57c80d5420 con 0x7f57c8162980 2024-09-12T01:58:13.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.296+0000 7f57cda64640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f57c80d4c10 0x7f57c80d3320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58242/0 (socket says 172.21.15.19:58242) 2024-09-12T01:58:13.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.296+0000 7f57cda64640 1 -- 172.21.15.19:0/3863716042 learned_addr learned my addr 172.21.15.19:0/3863716042 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:13.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.296+0000 7f57cea66640 1 --2- 172.21.15.19:0/3863716042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57c8162980 0x7f57c80ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:13.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cd263640 1 -- 172.21.15.19:0/3863716042 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3001231879 0 0) 0x7f57b8001110 con 0x7f57c80d4c10 2024-09-12T01:58:13.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cd263640 1 -- 172.21.15.19:0/3863716042 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57b4003520 con 0x7f57c80d4c10 2024-09-12T01:58:13.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cd263640 1 -- 172.21.15.19:0/3863716042 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 743499250 0 0) 0x7f57c4001110 con 0x7f57c80b5f80 2024-09-12T01:58:13.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cd263640 1 -- 172.21.15.19:0/3863716042 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57b8001110 con 0x7f57c80b5f80 2024-09-12T01:58:13.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cd263640 1 -- 172.21.15.19:0/3863716042 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2536651021 0 0) 0x7f57b4003520 con 0x7f57c80d4c10 2024-09-12T01:58:13.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cd263640 1 -- 172.21.15.19:0/3863716042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57c8162980 msgr2=0x7f57c80ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:13.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cd263640 1 --2- 172.21.15.19:0/3863716042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57c8162980 0x7f57c80ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cd263640 1 -- 172.21.15.19:0/3863716042 >> v1:172.21.15.135:6789/0 conn(0x7f57c80b5f80 legacy=0x7f57c80b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:13.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cd263640 1 -- 172.21.15.19:0/3863716042 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c80d2880 con 0x7f57c80d4c10 2024-09-12T01:58:13.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cd263640 1 -- 172.21.15.19:0/3863716042 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f57b8001840 con 0x7f57c80d4c10 2024-09-12T01:58:13.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cd263640 1 -- 172.21.15.19:0/3863716042 >> v1:172.21.15.19:6789/0 conn(0x7f57c80d4c10 legacy=0x7f57c80d3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:13.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cd263640 1 --2- 172.21.15.19:0/3863716042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57b4003b70 0x7f57b4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:13.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cd263640 1 --2- 172.21.15.19:0/3863716042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57b4004800 0x7f57b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:13.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cd263640 1 --2- 172.21.15.19:0/3863716042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57b40051c0 0x7f57b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:13.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cd263640 1 -- 172.21.15.19:0/3863716042 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f57c80d5420 con 0x7f57b4004800 2024-09-12T01:58:13.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cd263640 1 -- 172.21.15.19:0/3863716042 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f57b400bfb0 con 0x7f57b4003b70 2024-09-12T01:58:13.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cd263640 1 -- 172.21.15.19:0/3863716042 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f57b400c1b0 con 0x7f57b40051c0 2024-09-12T01:58:13.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cea66640 1 --2- 172.21.15.19:0/3863716042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57c8162980 0x7f57c80ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:13.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cda64640 1 --2- 172.21.15.19:0/3863716042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57b4004800 0x7f57b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:13.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57ce265640 1 --2- 172.21.15.19:0/3863716042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57b4003b70 0x7f57b4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:13.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cea66640 1 --2- 172.21.15.19:0/3863716042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57b40051c0 0x7f57b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:13.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cda64640 1 -- 172.21.15.19:0/3863716042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57b40051c0 msgr2=0x7f57b400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:13.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cda64640 1 --2- 172.21.15.19:0/3863716042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57b40051c0 0x7f57b400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cda64640 1 -- 172.21.15.19:0/3863716042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57b4003b70 msgr2=0x7f57b4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:13.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cda64640 1 --2- 172.21.15.19:0/3863716042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57b4003b70 0x7f57b4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.297+0000 7f57cda64640 1 -- 172.21.15.19:0/3863716042 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b4003520 con 0x7f57b4004800 2024-09-12T01:58:13.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.298+0000 7f57cda64640 1 --2- 172.21.15.19:0/3863716042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57b4004800 0x7f57b4004c80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f57b800c490 tx=0x7f57b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a0957f84ed3227 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:13.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.298+0000 7f57cd263640 1 -- 172.21.15.19:0/3863716042 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b800c0e0 con 0x7f57b4004800 2024-09-12T01:58:13.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.298+0000 7f57cd263640 1 -- 172.21.15.19:0/3863716042 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57b8034070 con 0x7f57b4004800 2024-09-12T01:58:13.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.298+0000 7f57cd263640 1 -- 172.21.15.19:0/3863716042 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b8005d10 con 0x7f57b4004800 2024-09-12T01:58:13.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.299+0000 7f57d04c9640 1 -- 172.21.15.19:0/3863716042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57b4004800 msgr2=0x7f57b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:13.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.299+0000 7f57d04c9640 1 --2- 172.21.15.19:0/3863716042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57b4004800 0x7f57b4004c80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f57b800c490 tx=0x7f57b4005830 comp rx=0 tx=0).stop 2024-09-12T01:58:13.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.299+0000 7f57cea66640 1 -- 172.21.15.19:0/3863716042 reap_dead start 2024-09-12T01:58:13.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.299+0000 7f57d04c9640 1 -- 172.21.15.19:0/3863716042 shutdown_connections 2024-09-12T01:58:13.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.299+0000 7f57d04c9640 1 -- 172.21.15.19:0/3863716042 >> 172.21.15.19:0/3863716042 conn(0x7f57c808bfc0 msgr2=0x7f57c80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:13.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.299+0000 7f57d04c9640 1 -- 172.21.15.19:0/3863716042 shutdown_connections 2024-09-12T01:58:13.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.299+0000 7f57d04c9640 1 -- 172.21.15.19:0/3863716042 wait complete. 2024-09-12T01:58:13.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.300+0000 7f57d04c9640 1 Processor -- start 2024-09-12T01:58:13.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.300+0000 7f57d04c9640 1 -- start start 2024-09-12T01:58:13.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57d04c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57b4004800 0x7f57c815e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:13.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57d04c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57c815cac0 0x7f57c815fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:13.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57d04c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c8160e40 0x7f57c8150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:13.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57d04c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f57c80d5140 con 0x7f57c8160e40 2024-09-12T01:58:13.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57d04c9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f57c80d2e90 con 0x7f57b4004800 2024-09-12T01:58:13.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57d04c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f57c80d2b20 con 0x7f57c815cac0 2024-09-12T01:58:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57cea66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c8160e40 0x7f57c8150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57cea66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c8160e40 0x7f57c8150550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52166/0 (socket says 172.21.15.19:52166) 2024-09-12T01:58:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57cea66640 1 -- 172.21.15.19:0/1590610983 learned_addr learned my addr 172.21.15.19:0/1590610983 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57cda64640 1 --2- 172.21.15.19:0/1590610983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57c815cac0 0x7f57c815fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57ce265640 1 --2- 172.21.15.19:0/1590610983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57b4004800 0x7f57c815e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57cea66640 1 -- 172.21.15.19:0/1590610983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57c815cac0 msgr2=0x7f57c815fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57cea66640 1 --2- 172.21.15.19:0/1590610983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57c815cac0 0x7f57c815fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57cea66640 1 -- 172.21.15.19:0/1590610983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57b4004800 msgr2=0x7f57c815e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57cea66640 1 --2- 172.21.15.19:0/1590610983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57b4004800 0x7f57c815e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57cea66640 1 -- 172.21.15.19:0/1590610983 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c815ed10 con 0x7f57c8160e40 2024-09-12T01:58:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57cda64640 1 --2- 172.21.15.19:0/1590610983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57c815cac0 0x7f57c815fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57ce265640 1 --2- 172.21.15.19:0/1590610983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57b4004800 0x7f57c815e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57cea66640 1 --2- 172.21.15.19:0/1590610983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c8160e40 0x7f57c8150550 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f57c80d4ff0 tx=0x7f57c0011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.301+0000 7f57beffd640 1 -- 172.21.15.19:0/1590610983 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0003990 con 0x7f57c8160e40 2024-09-12T01:58:13.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.302+0000 7f57beffd640 1 -- 172.21.15.19:0/1590610983 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c001b070 con 0x7f57c8160e40 2024-09-12T01:58:13.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.302+0000 7f57d04c9640 1 -- 172.21.15.19:0/1590610983 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57c815eff0 con 0x7f57c8160e40 2024-09-12T01:58:13.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.302+0000 7f57beffd640 1 -- 172.21.15.19:0/1590610983 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0003b70 con 0x7f57c8160e40 2024-09-12T01:58:13.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.302+0000 7f57d04c9640 1 -- 172.21.15.19:0/1590610983 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57c815f5b0 con 0x7f57c8160e40 2024-09-12T01:58:13.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.303+0000 7f57d04c9640 1 -- 172.21.15.19:0/1590610983 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57c80d41f0 con 0x7f57c8160e40 2024-09-12T01:58:13.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.303+0000 7f57beffd640 1 -- 172.21.15.19:0/1590610983 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f57c0005d10 con 0x7f57c8160e40 2024-09-12T01:58:13.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.303+0000 7f57beffd640 1 --2- 172.21.15.19:0/1590610983 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f57ac06be30 0x7f57ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:13.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.303+0000 7f57beffd640 1 -- 172.21.15.19:0/1590610983 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7f57c008b8d0 con 0x7f57c8160e40 2024-09-12T01:58:13.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.304+0000 7f57ce265640 1 --2- 172.21.15.19:0/1590610983 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f57ac06be30 0x7f57ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:13.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.304+0000 7f57ce265640 1 --2- 172.21.15.19:0/1590610983 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f57ac06be30 0x7f57ac06e2f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f57c40053b0 tx=0x7f57c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:13.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.308+0000 7f57beffd640 1 -- 172.21.15.19:0/1590610983 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f57c80d41f0 con 0x7f57c8160e40 2024-09-12T01:58:13.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.482+0000 7f57d04c9640 1 -- 172.21.15.19:0/1590610983 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_abort_on_newly_corrupt_dentry}] v 0) -- 0x7f57c80b5b60 con 0x7f57c8160e40 2024-09-12T01:58:13.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.483+0000 7f57beffd640 1 -- 172.21.15.19:0/1590610983 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_abort_on_newly_corrupt_dentry}]=0 v15)=0 v15) ==== 135+0+0 (secure 0 0 0) 0x7f57c0025020 con 0x7f57c8160e40 2024-09-12T01:58:13.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.485+0000 7f57d04c9640 1 -- 172.21.15.19:0/1590610983 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f57ac06be30 msgr2=0x7f57ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:13.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.485+0000 7f57d04c9640 1 --2- 172.21.15.19:0/1590610983 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f57ac06be30 0x7f57ac06e2f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f57c40053b0 tx=0x7f57c4009040 comp rx=0 tx=0).stop 2024-09-12T01:58:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.485+0000 7f57d04c9640 1 -- 172.21.15.19:0/1590610983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c8160e40 msgr2=0x7f57c8150550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.485+0000 7f57d04c9640 1 --2- 172.21.15.19:0/1590610983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c8160e40 0x7f57c8150550 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f57c80d4ff0 tx=0x7f57c0011890 comp rx=0 tx=0).stop 2024-09-12T01:58:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.485+0000 7f57d04c9640 1 -- 172.21.15.19:0/1590610983 shutdown_connections 2024-09-12T01:58:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.485+0000 7f57d04c9640 1 --2- 172.21.15.19:0/1590610983 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f57ac06be30 0x7f57ac06e2f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.485+0000 7f57d04c9640 1 --2- 172.21.15.19:0/1590610983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c8160e40 0x7f57c8150550 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.485+0000 7f57d04c9640 1 --2- 172.21.15.19:0/1590610983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57c815cac0 0x7f57c815fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.485+0000 7f57d04c9640 1 --2- 172.21.15.19:0/1590610983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57b4004800 0x7f57c815e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.485+0000 7f57d04c9640 1 -- 172.21.15.19:0/1590610983 >> 172.21.15.19:0/1590610983 conn(0x7f57c808bfc0 msgr2=0x7f57c806ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.485+0000 7f57d04c9640 1 -- 172.21.15.19:0/1590610983 shutdown_connections 2024-09-12T01:58:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.485+0000 7f57d04c9640 1 -- 172.21.15.19:0/1590610983 wait complete. 2024-09-12T01:58:13.497 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T01:58:13.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.602+0000 7f9d4da3c640 1 Processor -- start 2024-09-12T01:58:13.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.602+0000 7f9d4da3c640 1 -- start start 2024-09-12T01:58:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.603+0000 7f9d4da3c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d48156740 0x7f9d480b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.603+0000 7f9d4da3c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9d480b4af0 0x7f9d480cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.603+0000 7f9d4da3c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9d480cfcd0 0x7f9d4815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.603+0000 7f9d4da3c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f9d4806edc0 con 0x7f9d480cfcd0 2024-09-12T01:58:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.603+0000 7f9d4da3c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f9d480b30e0 con 0x7f9d480b4af0 2024-09-12T01:58:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.603+0000 7f9d4da3c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9d480b33c0 con 0x7f9d48156740 2024-09-12T01:58:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.603+0000 7f9d477fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9d480cfcd0 0x7f9d4815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.603+0000 7f9d477fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9d480cfcd0 0x7f9d4815fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52176/0 (socket says 172.21.15.19:52176) 2024-09-12T01:58:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.603+0000 7f9d477fe640 1 -- 172.21.15.19:0/2451907603 learned_addr learned my addr 172.21.15.19:0/2451907603 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.603+0000 7f9d467fc640 1 --2- 172.21.15.19:0/2451907603 >> v2:172.21.15.135:3300/0 conn(0x7f9d480b4af0 0x7f9d480cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.603+0000 7f9d46ffd640 1 --2- 172.21.15.19:0/2451907603 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d48156740 0x7f9d480b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.603+0000 7f9d477fe640 1 -- 172.21.15.19:0/2451907603 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d48156740 msgr2=0x7f9d480b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.603+0000 7f9d477fe640 1 --2- 172.21.15.19:0/2451907603 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d48156740 0x7f9d480b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.603+0000 7f9d477fe640 1 -- 172.21.15.19:0/2451907603 >> v2:172.21.15.135:3300/0 conn(0x7f9d480b4af0 msgr2=0x7f9d480cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.603+0000 7f9d477fe640 1 --2- 172.21.15.19:0/2451907603 >> v2:172.21.15.135:3300/0 conn(0x7f9d480b4af0 0x7f9d480cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.603+0000 7f9d477fe640 1 -- 172.21.15.19:0/2451907603 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d480b36a0 con 0x7f9d480cfcd0 2024-09-12T01:58:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.603+0000 7f9d467fc640 1 --2- 172.21.15.19:0/2451907603 >> v2:172.21.15.135:3300/0 conn(0x7f9d480b4af0 0x7f9d480cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.603+0000 7f9d46ffd640 1 --2- 172.21.15.19:0/2451907603 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d48156740 0x7f9d480b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:13.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.604+0000 7f9d477fe640 1 --2- 172.21.15.19:0/2451907603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d480cfcd0 0x7f9d4815fe20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9d480cd9a0 tx=0x7f9d4002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49dde4d4663e354b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:13.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.604+0000 7f9d45ffb640 1 -- 172.21.15.19:0/2451907603 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d40036070 con 0x7f9d480cfcd0 2024-09-12T01:58:13.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.604+0000 7f9d45ffb640 1 -- 172.21.15.19:0/2451907603 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d40031600 con 0x7f9d480cfcd0 2024-09-12T01:58:13.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.604+0000 7f9d45ffb640 1 -- 172.21.15.19:0/2451907603 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d400319d0 con 0x7f9d480cfcd0 2024-09-12T01:58:13.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.605+0000 7f9d4da3c640 1 -- 172.21.15.19:0/2451907603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d480cfcd0 msgr2=0x7f9d4815fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:13.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.605+0000 7f9d4da3c640 1 --2- 172.21.15.19:0/2451907603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d480cfcd0 0x7f9d4815fe20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9d480cd9a0 tx=0x7f9d4002a6a0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.605+0000 7f9d4da3c640 1 -- 172.21.15.19:0/2451907603 shutdown_connections 2024-09-12T01:58:13.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.605+0000 7f9d4da3c640 1 --2- 172.21.15.19:0/2451907603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d480cfcd0 0x7f9d4815fe20 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.605+0000 7f9d4da3c640 1 --2- 172.21.15.19:0/2451907603 >> v2:172.21.15.135:3300/0 conn(0x7f9d480b4af0 0x7f9d480cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.605+0000 7f9d4da3c640 1 --2- 172.21.15.19:0/2451907603 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d48156740 0x7f9d480b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.605+0000 7f9d4da3c640 1 -- 172.21.15.19:0/2451907603 >> 172.21.15.19:0/2451907603 conn(0x7f9d4806bdf0 msgr2=0x7f9d4806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:13.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.605+0000 7f9d4da3c640 1 -- 172.21.15.19:0/2451907603 shutdown_connections 2024-09-12T01:58:13.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.605+0000 7f9d4da3c640 1 -- 172.21.15.19:0/2451907603 wait complete. 2024-09-12T01:58:13.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.606+0000 7f9d4da3c640 1 Processor -- start 2024-09-12T01:58:13.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.606+0000 7f9d4da3c640 1 -- start start 2024-09-12T01:58:13.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.607+0000 7f9d4da3c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d480b4af0 0x7f9d48158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:13.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.607+0000 7f9d4da3c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d480cfcd0 0x7f9d480b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:13.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.607+0000 7f9d4da3c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d48156740 0x7f9d480b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:13.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.607+0000 7f9d4da3c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9d480d0890 con 0x7f9d48156740 2024-09-12T01:58:13.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.607+0000 7f9d4da3c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d480b3c60 con 0x7f9d480cfcd0 2024-09-12T01:58:13.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.607+0000 7f9d4da3c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9d480d0a10 con 0x7f9d480b4af0 2024-09-12T01:58:13.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.607+0000 7f9d477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d48156740 0x7f9d480b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:13.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.607+0000 7f9d477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d48156740 0x7f9d480b10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52186/0 (socket says 172.21.15.19:52186) 2024-09-12T01:58:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.607+0000 7f9d477fe640 1 -- 172.21.15.19:0/3868076318 learned_addr learned my addr 172.21.15.19:0/3868076318 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.607+0000 7f9d467fc640 1 --2- 172.21.15.19:0/3868076318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d480cfcd0 0x7f9d480b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.607+0000 7f9d46ffd640 1 --2- 172.21.15.19:0/3868076318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d480b4af0 0x7f9d48158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.607+0000 7f9d477fe640 1 -- 172.21.15.19:0/3868076318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d480b4af0 msgr2=0x7f9d48158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.607+0000 7f9d477fe640 1 --2- 172.21.15.19:0/3868076318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d480b4af0 0x7f9d48158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.607+0000 7f9d477fe640 1 -- 172.21.15.19:0/3868076318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d480cfcd0 msgr2=0x7f9d480b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.607+0000 7f9d477fe640 1 --2- 172.21.15.19:0/3868076318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d480cfcd0 0x7f9d480b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.607+0000 7f9d477fe640 1 -- 172.21.15.19:0/3868076318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d481594a0 con 0x7f9d48156740 2024-09-12T01:58:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.607+0000 7f9d467fc640 1 --2- 172.21.15.19:0/3868076318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d480cfcd0 0x7f9d480b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.607+0000 7f9d46ffd640 1 --2- 172.21.15.19:0/3868076318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d480b4af0 0x7f9d48158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.608+0000 7f9d477fe640 1 --2- 172.21.15.19:0/3868076318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d48156740 0x7f9d480b10a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009f40 tx=0x7f9d40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.608+0000 7f9d2ffff640 1 -- 172.21.15.19:0/3868076318 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d40036050 con 0x7f9d48156740 2024-09-12T01:58:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.608+0000 7f9d2ffff640 1 -- 172.21.15.19:0/3868076318 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d40042070 con 0x7f9d48156740 2024-09-12T01:58:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.608+0000 7f9d4da3c640 1 -- 172.21.15.19:0/3868076318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d48157c60 con 0x7f9d48156740 2024-09-12T01:58:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.608+0000 7f9d2ffff640 1 -- 172.21.15.19:0/3868076318 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d40009510 con 0x7f9d48156740 2024-09-12T01:58:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.608+0000 7f9d4da3c640 1 -- 172.21.15.19:0/3868076318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d48158480 con 0x7f9d48156740 2024-09-12T01:58:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.609+0000 7f9d4da3c640 1 -- 172.21.15.19:0/3868076318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d48156b20 con 0x7f9d48156740 2024-09-12T01:58:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.609+0000 7f9d2ffff640 1 -- 172.21.15.19:0/3868076318 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d40007bd0 con 0x7f9d48156740 2024-09-12T01:58:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.610+0000 7f9d2ffff640 1 --2- 172.21.15.19:0/3868076318 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9d3406be30 0x7f9d3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.610+0000 7f9d2ffff640 1 -- 172.21.15.19:0/3868076318 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7f9d400abf40 con 0x7f9d48156740 2024-09-12T01:58:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.610+0000 7f9d46ffd640 1 --2- 172.21.15.19:0/3868076318 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9d3406be30 0x7f9d3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.611+0000 7f9d46ffd640 1 --2- 172.21.15.19:0/3868076318 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9d3406be30 0x7f9d3406e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9d38006fd0 tx=0x7f9d38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:13.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.614+0000 7f9d2ffff640 1 -- 172.21.15.19:0/3868076318 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9d4007a710 con 0x7f9d48156740 2024-09-12T01:58:13.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:13.830+0000 7f9d4da3c640 1 -- 172.21.15.19:0/3868076318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f9d480ceb50 con 0x7f9d48156740 2024-09-12T01:58:14.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.831+0000 7f9d2ffff640 1 -- 172.21.15.19:0/3868076318 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v30) ==== 162+0+0 (secure 0 0 0) 0x7f9d4007a010 con 0x7f9d48156740 2024-09-12T01:58:14.831 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T01:58:14.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.834+0000 7f9d4da3c640 1 -- 172.21.15.19:0/3868076318 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9d3406be30 msgr2=0x7f9d3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:14.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.834+0000 7f9d4da3c640 1 --2- 172.21.15.19:0/3868076318 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9d3406be30 0x7f9d3406e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9d38006fd0 tx=0x7f9d38008040 comp rx=0 tx=0).stop 2024-09-12T01:58:14.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.834+0000 7f9d4da3c640 1 -- 172.21.15.19:0/3868076318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d48156740 msgr2=0x7f9d480b10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:14.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.834+0000 7f9d4da3c640 1 --2- 172.21.15.19:0/3868076318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d48156740 0x7f9d480b10a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009f40 tx=0x7f9d40004a40 comp rx=0 tx=0).stop 2024-09-12T01:58:14.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.834+0000 7f9d4da3c640 1 -- 172.21.15.19:0/3868076318 shutdown_connections 2024-09-12T01:58:14.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.834+0000 7f9d4da3c640 1 --2- 172.21.15.19:0/3868076318 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9d3406be30 0x7f9d3406e2f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:14.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.834+0000 7f9d4da3c640 1 --2- 172.21.15.19:0/3868076318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d48156740 0x7f9d480b10a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:14.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.834+0000 7f9d4da3c640 1 --2- 172.21.15.19:0/3868076318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d480cfcd0 0x7f9d480b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:14.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.834+0000 7f9d4da3c640 1 --2- 172.21.15.19:0/3868076318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d480b4af0 0x7f9d48158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:14.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.834+0000 7f9d4da3c640 1 -- 172.21.15.19:0/3868076318 >> 172.21.15.19:0/3868076318 conn(0x7f9d4806bdf0 msgr2=0x7f9d4815ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:14.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.834+0000 7f9d4da3c640 1 -- 172.21.15.19:0/3868076318 shutdown_connections 2024-09-12T01:58:14.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.834+0000 7f9d4da3c640 1 -- 172.21.15.19:0/3868076318 wait complete. 2024-09-12T01:58:14.851 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:58:14.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.959+0000 7f471ca65640 1 Processor -- start 2024-09-12T01:58:14.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.960+0000 7f471ca65640 1 -- start start 2024-09-12T01:58:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.960+0000 7f471ca65640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4718161c80 0x7f471806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.961+0000 7f471ca65640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f471806e870 con 0x7f4718162060 2024-09-12T01:58:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.961+0000 7f471ca65640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f471806d9f0 con 0x7f47180b6680 2024-09-12T01:58:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.961+0000 7f471ca65640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f471806dcd0 con 0x7f4718161c80 2024-09-12T01:58:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.961+0000 7f4715d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4718162060 0x7f47180b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58256/0 (socket says 172.21.15.19:58256) 2024-09-12T01:58:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.961+0000 7f4715d9b640 1 -- 172.21.15.19:0/1432788966 learned_addr learned my addr 172.21.15.19:0/1432788966 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.961+0000 7f471659c640 1 --2- 172.21.15.19:0/1432788966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4718161c80 0x7f471806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.961+0000 7f471559a640 1 -- 172.21.15.19:0/1432788966 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3677185857 0 0) 0x7f470c001490 con 0x7f4718162060 2024-09-12T01:58:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.961+0000 7f471559a640 1 -- 172.21.15.19:0/1432788966 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4700003520 con 0x7f4718162060 2024-09-12T01:58:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.961+0000 7f471559a640 1 -- 172.21.15.19:0/1432788966 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2906244428 0 0) 0x7f471806d9f0 con 0x7f47180b6680 2024-09-12T01:58:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.961+0000 7f471559a640 1 -- 172.21.15.19:0/1432788966 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f470c001490 con 0x7f47180b6680 2024-09-12T01:58:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.961+0000 7f471659c640 1 -- 172.21.15.19:0/1432788966 >> v1:172.21.15.135:6789/0 conn(0x7f47180b6680 legacy=0x7f47180cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:14.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.961+0000 7f471659c640 1 -- 172.21.15.19:0/1432788966 >> v1:172.21.15.19:6789/0 conn(0x7f4718162060 legacy=0x7f47180b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:14.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.961+0000 7f471659c640 1 -- 172.21.15.19:0/1432788966 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f471806dfb0 con 0x7f4718161c80 2024-09-12T01:58:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.962+0000 7f471659c640 1 --2- 172.21.15.19:0/1432788966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4718161c80 0x7f471806e330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f47080097d0 tx=0x7f470802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=848a3b2f8c40bdba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.962+0000 7f471559a640 1 -- 172.21.15.19:0/1432788966 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4708037070 con 0x7f4718161c80 2024-09-12T01:58:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.962+0000 7f471559a640 1 -- 172.21.15.19:0/1432788966 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4708032440 con 0x7f4718161c80 2024-09-12T01:58:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.962+0000 7f471559a640 1 -- 172.21.15.19:0/1432788966 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47080327f0 con 0x7f4718161c80 2024-09-12T01:58:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.963+0000 7f471ca65640 1 -- 172.21.15.19:0/1432788966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4718161c80 msgr2=0x7f471806e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.963+0000 7f471ca65640 1 --2- 172.21.15.19:0/1432788966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4718161c80 0x7f471806e330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f47080097d0 tx=0x7f470802a210 comp rx=0 tx=0).stop 2024-09-12T01:58:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.963+0000 7f471ca65640 1 -- 172.21.15.19:0/1432788966 shutdown_connections 2024-09-12T01:58:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.963+0000 7f471ca65640 1 --2- 172.21.15.19:0/1432788966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4718161c80 0x7f471806e330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.963+0000 7f471ca65640 1 -- 172.21.15.19:0/1432788966 >> 172.21.15.19:0/1432788966 conn(0x7f47180d44f0 msgr2=0x7f47180d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:14.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.963+0000 7f471ca65640 1 -- 172.21.15.19:0/1432788966 shutdown_connections 2024-09-12T01:58:14.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.963+0000 7f471ca65640 1 -- 172.21.15.19:0/1432788966 wait complete. 2024-09-12T01:58:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.965+0000 7f471ca65640 1 Processor -- start 2024-09-12T01:58:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.965+0000 7f471ca65640 1 -- start start 2024-09-12T01:58:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.965+0000 7f471ca65640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47180b6680 0x7f47180b9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.965+0000 7f471ca65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4718161c80 0x7f4718156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.965+0000 7f471ca65640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4718162060 0x7f47180b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.965+0000 7f471ca65640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f47180b6b30 con 0x7f4718161c80 2024-09-12T01:58:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.965+0000 7f471ca65640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f47180d2aa0 con 0x7f47180b6680 2024-09-12T01:58:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.965+0000 7f471ca65640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f47180b6cb0 con 0x7f4718162060 2024-09-12T01:58:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.966+0000 7f4715d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4718161c80 0x7f4718156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.966+0000 7f4715d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4718161c80 0x7f4718156560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52202/0 (socket says 172.21.15.19:52202) 2024-09-12T01:58:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.966+0000 7f471659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47180b6680 0x7f47180b9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.966+0000 7f4715d9b640 1 -- 172.21.15.19:0/3727742330 learned_addr learned my addr 172.21.15.19:0/3727742330 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.966+0000 7f4716d9d640 1 --2- 172.21.15.19:0/3727742330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4718162060 0x7f47180b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.966+0000 7f4715d9b640 1 -- 172.21.15.19:0/3727742330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4718162060 msgr2=0x7f47180b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.966+0000 7f4715d9b640 1 --2- 172.21.15.19:0/3727742330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4718162060 0x7f47180b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.966+0000 7f4715d9b640 1 -- 172.21.15.19:0/3727742330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47180b6680 msgr2=0x7f47180b9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.966+0000 7f4715d9b640 1 --2- 172.21.15.19:0/3727742330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47180b6680 0x7f47180b9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.966+0000 7f4715d9b640 1 -- 172.21.15.19:0/3727742330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47180cd4f0 con 0x7f4718161c80 2024-09-12T01:58:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.966+0000 7f4715d9b640 1 --2- 172.21.15.19:0/3727742330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4718161c80 0x7f4718156560 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f470c001f50 tx=0x7f470c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.966+0000 7f4706ffd640 1 -- 172.21.15.19:0/3727742330 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c017070 con 0x7f4718161c80 2024-09-12T01:58:14.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.966+0000 7f4706ffd640 1 -- 172.21.15.19:0/3727742330 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f470c012400 con 0x7f4718161c80 2024-09-12T01:58:14.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.966+0000 7f471ca65640 1 -- 172.21.15.19:0/3727742330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47180b9790 con 0x7f4718161c80 2024-09-12T01:58:14.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.966+0000 7f4706ffd640 1 -- 172.21.15.19:0/3727742330 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c0127d0 con 0x7f4718161c80 2024-09-12T01:58:14.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.966+0000 7f471ca65640 1 -- 172.21.15.19:0/3727742330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47180cbda0 con 0x7f4718161c80 2024-09-12T01:58:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.967+0000 7f471ca65640 1 -- 172.21.15.19:0/3727742330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47180b3c50 con 0x7f4718161c80 2024-09-12T01:58:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.968+0000 7f4706ffd640 1 -- 172.21.15.19:0/3727742330 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f470c01a070 con 0x7f4718161c80 2024-09-12T01:58:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.968+0000 7f4706ffd640 1 --2- 172.21.15.19:0/3727742330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f46f806be30 0x7f46f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.968+0000 7f4706ffd640 1 -- 172.21.15.19:0/3727742330 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7f470c08af40 con 0x7f4718161c80 2024-09-12T01:58:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.968+0000 7f471659c640 1 --2- 172.21.15.19:0/3727742330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f46f806be30 0x7f46f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.969+0000 7f471659c640 1 --2- 172.21.15.19:0/3727742330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f46f806be30 0x7f46f806e2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4708034000 tx=0x7f470802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:14.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:14.972+0000 7f4706ffd640 1 -- 172.21.15.19:0/3727742330 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f47180b3c50 con 0x7f4718161c80 2024-09-12T01:58:15.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.185+0000 7f471ca65640 1 -- 172.21.15.19:0/3727742330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f471806e330 con 0x7f4718161c80 2024-09-12T01:58:15.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.185+0000 7f4706ffd640 1 -- 172.21.15.19:0/3727742330 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5223 (secure 0 0 0) 0x7f471806e870 con 0x7f4718161c80 2024-09-12T01:58:15.186 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:15.186 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":31,"btime":"2024-09-12T01:58:14:834957+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/4076449352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4076449352},{"type":"v1","addr":"172.21.15.135:6836","nonce":4076449352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1361756714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1361756714},{"type":"v1","addr":"172.21.15.135:6837","nonce":1361756714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3926640523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3926640523},{"type":"v1","addr":"172.21.15.19:6833","nonce":3926640523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:57:54.505612+0000","modified":"2024-09-12T01:58:14.834942+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5676":{"gid":5676,"name":"a","rank":0,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.19:6835/3491125255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":3491125255},{"type":"v1","addr":"172.21.15.19:6835","nonce":3491125255}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-09-12T01:58:15.186 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 31 2024-09-12T01:58:15.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.187+0000 7f471ca65640 1 -- 172.21.15.19:0/3727742330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f46f806be30 msgr2=0x7f46f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.187+0000 7f471ca65640 1 --2- 172.21.15.19:0/3727742330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f46f806be30 0x7f46f806e2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4708034000 tx=0x7f470802e000 comp rx=0 tx=0).stop 2024-09-12T01:58:15.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.187+0000 7f471ca65640 1 -- 172.21.15.19:0/3727742330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4718161c80 msgr2=0x7f4718156560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.187+0000 7f471ca65640 1 --2- 172.21.15.19:0/3727742330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4718161c80 0x7f4718156560 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f470c001f50 tx=0x7f470c00a430 comp rx=0 tx=0).stop 2024-09-12T01:58:15.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.187+0000 7f471ca65640 1 -- 172.21.15.19:0/3727742330 shutdown_connections 2024-09-12T01:58:15.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.187+0000 7f471ca65640 1 --2- 172.21.15.19:0/3727742330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f46f806be30 0x7f46f806e2f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.187+0000 7f471ca65640 1 --2- 172.21.15.19:0/3727742330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4718162060 0x7f47180b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.187+0000 7f471ca65640 1 --2- 172.21.15.19:0/3727742330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4718161c80 0x7f4718156560 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.187+0000 7f471ca65640 1 --2- 172.21.15.19:0/3727742330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47180b6680 0x7f47180b9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.187+0000 7f471ca65640 1 -- 172.21.15.19:0/3727742330 >> 172.21.15.19:0/3727742330 conn(0x7f47180d44f0 msgr2=0x7f47180b5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:15.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.187+0000 7f471ca65640 1 -- 172.21.15.19:0/3727742330 shutdown_connections 2024-09-12T01:58:15.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.187+0000 7f471ca65640 1 -- 172.21.15.19:0/3727742330 wait complete. 2024-09-12T01:58:15.202 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush journal 2024-09-12T01:58:15.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.306+0000 7fda3eb6f640 1 Processor -- start 2024-09-12T01:58:15.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.306+0000 7fda3eb6f640 1 -- start start 2024-09-12T01:58:15.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.306+0000 7fda3eb6f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda3815e640 0x7fda380d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.306+0000 7fda3eb6f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fda381621b0 0x7fda38162660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.306+0000 7fda3eb6f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda380d0110 con 0x7fda380d5100 2024-09-12T01:58:15.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.306+0000 7fda3eb6f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fda380d3a60 con 0x7fda381621b0 2024-09-12T01:58:15.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.306+0000 7fda3eb6f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fda380cec40 con 0x7fda3815e640 2024-09-12T01:58:15.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.307+0000 7fda3c90b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda3815e640 0x7fda380d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.307+0000 7fda3d10c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fda381621b0 0x7fda38162660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.307+0000 7fda3c90b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda3815e640 0x7fda380d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:48822/0 (socket says 172.21.15.19:48822) 2024-09-12T01:58:15.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.307+0000 7fda3c90b640 1 -- 172.21.15.19:0/1206418496 learned_addr learned my addr 172.21.15.19:0/1206418496 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:15.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.307+0000 7fda3c90b640 1 -- 172.21.15.19:0/1206418496 >> v2:172.21.15.135:3300/0 conn(0x7fda381621b0 msgr2=0x7fda38162660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:15.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.307+0000 7fda3c90b640 1 --2- 172.21.15.19:0/1206418496 >> v2:172.21.15.135:3300/0 conn(0x7fda381621b0 0x7fda38162660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.307+0000 7fda3c90b640 1 -- 172.21.15.19:0/1206418496 >> v1:172.21.15.135:6789/0 conn(0x7fda380d5100 legacy=0x7fda380cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.307+0000 7fda3c90b640 1 -- 172.21.15.19:0/1206418496 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda380cef20 con 0x7fda3815e640 2024-09-12T01:58:15.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.308+0000 7fda3c90b640 1 --2- 172.21.15.19:0/1206418496 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda3815e640 0x7fda380d31e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fda30009e50 tx=0x7fda3002a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b41f35a8098fb74 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.308+0000 7fda377fe640 1 -- 172.21.15.19:0/1206418496 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30036070 con 0x7fda3815e640 2024-09-12T01:58:15.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.308+0000 7fda377fe640 1 -- 172.21.15.19:0/1206418496 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda30031600 con 0x7fda3815e640 2024-09-12T01:58:15.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.308+0000 7fda377fe640 1 -- 172.21.15.19:0/1206418496 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda300319d0 con 0x7fda3815e640 2024-09-12T01:58:15.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.309+0000 7fda3eb6f640 1 -- 172.21.15.19:0/1206418496 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda3815e640 msgr2=0x7fda380d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.309+0000 7fda3eb6f640 1 --2- 172.21.15.19:0/1206418496 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda3815e640 0x7fda380d31e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fda30009e50 tx=0x7fda3002a7a0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.309+0000 7fda3eb6f640 1 -- 172.21.15.19:0/1206418496 shutdown_connections 2024-09-12T01:58:15.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.309+0000 7fda3eb6f640 1 --2- 172.21.15.19:0/1206418496 >> v2:172.21.15.135:3300/0 conn(0x7fda381621b0 0x7fda38162660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.309+0000 7fda3eb6f640 1 --2- 172.21.15.19:0/1206418496 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda3815e640 0x7fda380d31e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.309+0000 7fda3eb6f640 1 -- 172.21.15.19:0/1206418496 >> 172.21.15.19:0/1206418496 conn(0x7fda3808bfc0 msgr2=0x7fda380d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:15.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.309+0000 7fda3eb6f640 1 -- 172.21.15.19:0/1206418496 shutdown_connections 2024-09-12T01:58:15.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.309+0000 7fda3eb6f640 1 -- 172.21.15.19:0/1206418496 wait complete. 2024-09-12T01:58:15.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.310+0000 7fda3eb6f640 1 Processor -- start 2024-09-12T01:58:15.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.310+0000 7fda3eb6f640 1 -- start start 2024-09-12T01:58:15.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.311+0000 7fda3eb6f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda380d5100 0x7fda380b6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.311+0000 7fda3eb6f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda3815e640 0x7fda380c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.311+0000 7fda3eb6f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda381621b0 0x7fda380c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.311+0000 7fda3eb6f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fda3815ea20 con 0x7fda380d5100 2024-09-12T01:58:15.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.311+0000 7fda3eb6f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fda380cf4e0 con 0x7fda3815e640 2024-09-12T01:58:15.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.311+0000 7fda3eb6f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fda380d3720 con 0x7fda381621b0 2024-09-12T01:58:15.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.311+0000 7fda3c90b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda380d5100 0x7fda380b6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.311+0000 7fda3c90b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda380d5100 0x7fda380b6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52218/0 (socket says 172.21.15.19:52218) 2024-09-12T01:58:15.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.311+0000 7fda3c90b640 1 -- 172.21.15.19:0/3471454753 learned_addr learned my addr 172.21.15.19:0/3471454753 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:15.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.311+0000 7fda37fff640 1 --2- 172.21.15.19:0/3471454753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda3815e640 0x7fda380c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.311+0000 7fda3d10c640 1 --2- 172.21.15.19:0/3471454753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda381621b0 0x7fda380c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.311+0000 7fda3c90b640 1 -- 172.21.15.19:0/3471454753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda381621b0 msgr2=0x7fda380c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.311+0000 7fda3c90b640 1 --2- 172.21.15.19:0/3471454753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda381621b0 0x7fda380c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.311+0000 7fda3c90b640 1 -- 172.21.15.19:0/3471454753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda3815e640 msgr2=0x7fda380c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.311+0000 7fda3c90b640 1 --2- 172.21.15.19:0/3471454753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda3815e640 0x7fda380c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.311+0000 7fda3c90b640 1 -- 172.21.15.19:0/3471454753 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3815cb50 con 0x7fda380d5100 2024-09-12T01:58:15.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.312+0000 7fda3c90b640 1 --2- 172.21.15.19:0/3471454753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda380d5100 0x7fda380b6380 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fda30009e50 tx=0x7fda30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.312+0000 7fda357fa640 1 -- 172.21.15.19:0/3471454753 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30041020 con 0x7fda380d5100 2024-09-12T01:58:15.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.312+0000 7fda357fa640 1 -- 172.21.15.19:0/3471454753 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda30007820 con 0x7fda380d5100 2024-09-12T01:58:15.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.312+0000 7fda357fa640 1 -- 172.21.15.19:0/3471454753 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30036040 con 0x7fda380d5100 2024-09-12T01:58:15.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.312+0000 7fda3eb6f640 1 -- 172.21.15.19:0/3471454753 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda380c91e0 con 0x7fda380d5100 2024-09-12T01:58:15.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.312+0000 7fda3eb6f640 1 -- 172.21.15.19:0/3471454753 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda380c97a0 con 0x7fda380d5100 2024-09-12T01:58:15.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.313+0000 7fda357fa640 1 -- 172.21.15.19:0/3471454753 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda30044020 con 0x7fda380d5100 2024-09-12T01:58:15.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.314+0000 7fda357fa640 1 --2- 172.21.15.19:0/3471454753 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fda2406be30 0x7fda2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.314+0000 7fda357fa640 1 -- 172.21.15.19:0/3471454753 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7fda300abc00 con 0x7fda380d5100 2024-09-12T01:58:15.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.314+0000 7fda37fff640 1 --2- 172.21.15.19:0/3471454753 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fda2406be30 0x7fda2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.315+0000 7fda37fff640 1 --2- 172.21.15.19:0/3471454753 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fda2406be30 0x7fda2406e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fda380d35d0 tx=0x7fda2c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.315+0000 7fda419e2740 1 Processor -- start 2024-09-12T01:58:15.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.315+0000 7fda419e2740 1 -- start start 2024-09-12T01:58:15.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.315+0000 7fda419e2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bd920 0x555e207030c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.315+0000 7fda419e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206bb0e0 0x555e206bdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.316+0000 7fda419e2740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206bf0b0 0x555e206b81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.316+0000 7fda419e2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x555e206206f0 con 0x555e206bd920 2024-09-12T01:58:15.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.316+0000 7fda419e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555e205c8330 con 0x555e206bb0e0 2024-09-12T01:58:15.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.316+0000 7fda419e2740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x555e2061c6b0 con 0x555e206bf0b0 2024-09-12T01:58:15.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.316+0000 7fda3c90b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bd920 0x555e207030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.316+0000 7fda3c90b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bd920 0x555e207030c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52234/0 (socket says 172.21.15.19:52234) 2024-09-12T01:58:15.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.316+0000 7fda3c90b640 1 -- 172.21.15.19:0/1446428245 learned_addr learned my addr 172.21.15.19:0/1446428245 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:15.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.316+0000 7fda3d10c640 1 --2- 172.21.15.19:0/1446428245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206bf0b0 0x555e206b81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.316+0000 7fda37fff640 1 --2- 172.21.15.19:0/1446428245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206bb0e0 0x555e206bdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.316+0000 7fda3c90b640 1 -- 172.21.15.19:0/1446428245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206bf0b0 msgr2=0x555e206b81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:15.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.316+0000 7fda3c90b640 1 --2- 172.21.15.19:0/1446428245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206bf0b0 0x555e206b81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.316+0000 7fda3c90b640 1 -- 172.21.15.19:0/1446428245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206bb0e0 msgr2=0x555e206bdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.316+0000 7fda3c90b640 1 --2- 172.21.15.19:0/1446428245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206bb0e0 0x555e206bdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.316+0000 7fda3c90b640 1 -- 172.21.15.19:0/1446428245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e205ee0d0 con 0x555e206bd920 2024-09-12T01:58:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.316+0000 7fda3c90b640 1 --2- 172.21.15.19:0/1446428245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bd920 0x555e207030c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fda30034040 tx=0x7fda30079700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f6f32059cd4498 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.316+0000 7fda1e7fc640 1 -- 172.21.15.19:0/1446428245 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda300a8070 con 0x555e206bd920 2024-09-12T01:58:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.316+0000 7fda1e7fc640 1 -- 172.21.15.19:0/1446428245 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda3007dfe0 con 0x555e206bd920 2024-09-12T01:58:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.316+0000 7fda1e7fc640 1 -- 172.21.15.19:0/1446428245 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30080040 con 0x555e206bd920 2024-09-12T01:58:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.317+0000 7fda419e2740 1 -- 172.21.15.19:0/1446428245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bd920 msgr2=0x555e207030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.317+0000 7fda419e2740 1 --2- 172.21.15.19:0/1446428245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bd920 0x555e207030c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fda30034040 tx=0x7fda30079700 comp rx=0 tx=0).stop 2024-09-12T01:58:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.317+0000 7fda419e2740 1 -- 172.21.15.19:0/1446428245 shutdown_connections 2024-09-12T01:58:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.317+0000 7fda419e2740 1 --2- 172.21.15.19:0/1446428245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206bf0b0 0x555e206b81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.317+0000 7fda419e2740 1 --2- 172.21.15.19:0/1446428245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206bb0e0 0x555e206bdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.317+0000 7fda419e2740 1 --2- 172.21.15.19:0/1446428245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bd920 0x555e207030c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.317+0000 7fda419e2740 1 -- 172.21.15.19:0/1446428245 >> 172.21.15.19:0/1446428245 conn(0x555e206ba370 msgr2=0x555e20702590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:15.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.317+0000 7fda419e2740 1 -- 172.21.15.19:0/1446428245 shutdown_connections 2024-09-12T01:58:15.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.317+0000 7fda419e2740 1 -- 172.21.15.19:0/1446428245 wait complete. 2024-09-12T01:58:15.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.317+0000 7fda419e2740 1 -- start start 2024-09-12T01:58:15.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.318+0000 7fda419e2740 1 Processor -- start 2024-09-12T01:58:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.318+0000 7fda419e2740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206bd920 0x555e206e0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.318+0000 7fda419e2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 0x555e206dc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda419e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206e13c0 0x555e206bbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda419e2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x555e206206f0 con 0x555e206bf0b0 2024-09-12T01:58:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda419e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555e205a94f0 con 0x555e206e13c0 2024-09-12T01:58:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda419e2740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x555e206b9810 con 0x555e206bd920 2024-09-12T01:58:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda419e2740 10 client.0 _ll_register_callbacks cb 0x555e205cab50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 0x555e206dc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 0x555e206dc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52236/0 (socket says 172.21.15.19:52236) 2024-09-12T01:58:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda37fff640 1 -- 172.21.15.19:0/2732355708 learned_addr learned my addr 172.21.15.19:0/2732355708 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda3d10c640 1 --2- 172.21.15.19:0/2732355708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206e13c0 0x555e206bbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda3c90b640 1 --2- 172.21.15.19:0/2732355708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206bd920 0x555e206e0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda37fff640 1 -- 172.21.15.19:0/2732355708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206bd920 msgr2=0x555e206e0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda37fff640 1 --2- 172.21.15.19:0/2732355708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206bd920 0x555e206e0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda37fff640 1 -- 172.21.15.19:0/2732355708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206e13c0 msgr2=0x555e206bbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda37fff640 1 --2- 172.21.15.19:0/2732355708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206e13c0 0x555e206bbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda37fff640 1 -- 172.21.15.19:0/2732355708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e203fd7d0 con 0x555e206bf0b0 2024-09-12T01:58:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda37fff640 1 --2- 172.21.15.19:0/2732355708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 0x555e206dc1d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fda2c010010 tx=0x7fda2c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3801d47e2044e4d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda177fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:58:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda177fe640 1 -- 172.21.15.19:0/2732355708 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c027060 con 0x555e206bf0b0 2024-09-12T01:58:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda177fe640 1 -- 172.21.15.19:0/2732355708 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7fda2c022c90 con 0x555e206bf0b0 2024-09-12T01:58:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda419e2740 1 -- 172.21.15.19:0/2732355708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda3007dfe0 con 0x555e206bf0b0 2024-09-12T01:58:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda177fe640 1 -- 172.21.15.19:0/2732355708 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fda2c007480 con 0x555e206bf0b0 2024-09-12T01:58:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.319+0000 7fda419e2740 10 client.5709 fetch_fsmap learned FSMap version 31 2024-09-12T01:58:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.320+0000 7fda419e2740 1 -- 172.21.15.19:0/2732355708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x555e203333f0 con 0x555e206bf0b0 2024-09-12T01:58:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.320+0000 7fda177fe640 1 -- 172.21.15.19:0/2732355708 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda3007dfe0 con 0x555e206bf0b0 2024-09-12T01:58:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.320+0000 7fda177fe640 1 -- 172.21.15.19:0/2732355708 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 31) ==== 3494+0+0 (secure 0 0 0) 0x7fda2c0133f0 con 0x555e206bf0b0 2024-09-12T01:58:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.320+0000 7fda419e2740 10 client.5709 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T01:58:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.320+0000 7fda419e2740 10 client.5709 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T01:58:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.320+0000 7fda419e2740 20 client.5709 populate_metadata read hostname 'smithi019' 2024-09-12T01:58:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.320+0000 7fda419e2740 1 --2- 172.21.15.19:0/2732355708 >> [v2:172.21.15.19:6834/3491125255,v1:172.21.15.19:6835/3491125255] conn(0x555e206e6b00 0x555e206e6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.320+0000 7fda419e2740 4 client.5709 mds_command: new command op to 5676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.320+0000 7fda419e2740 1 -- 172.21.15.19:0/2732355708 --> [v2:172.21.15.19:6834/3491125255,v1:172.21.15.19:6835/3491125255] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e2062de20 con 0x555e206e6b00 2024-09-12T01:58:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.320+0000 7fda3c90b640 1 --2- 172.21.15.19:0/2732355708 >> [v2:172.21.15.19:6834/3491125255,v1:172.21.15.19:6835/3491125255] conn(0x555e206e6b00 0x555e206e6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.320+0000 7fda177fe640 10 client.5709 ms_handle_connect on v2:172.21.15.19:6834/3491125255 2024-09-12T01:58:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.320+0000 7fda3c90b640 1 --2- 172.21.15.19:0/2732355708 >> [v2:172.21.15.19:6834/3491125255,v1:172.21.15.19:6835/3491125255] conn(0x555e206e6b00 0x555e206e6ee0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cc0525d19bebb35 server_cookie=360b304c58f3d659 in_seq=0 out_seq=0 2024-09-12T01:58:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.321+0000 7fda177fe640 1 -- 172.21.15.19:0/2732355708 <== mds.0 v2:172.21.15.19:6834/3491125255 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555e2062de20 con 0x555e206e6b00 2024-09-12T01:58:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.321+0000 7fda177fe640 10 client.5709 handle_command_reply: tid=0 2024-09-12T01:58:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.321+0000 7fda419e2740 1 client.5709 shutdown 2024-09-12T01:58:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.321+0000 7fda419e2740 1 -- 172.21.15.19:0/2732355708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 msgr2=0x555e206dc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.321+0000 7fda419e2740 1 --2- 172.21.15.19:0/2732355708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 0x555e206dc1d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fda2c010010 tx=0x7fda2c000ed0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.321+0000 7fda419e2740 1 -- 172.21.15.19:0/2732355708 shutdown_connections 2024-09-12T01:58:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.321+0000 7fda419e2740 1 --2- 172.21.15.19:0/2732355708 >> [v2:172.21.15.19:6834/3491125255,v1:172.21.15.19:6835/3491125255] conn(0x555e206e6b00 0x555e206e6ee0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.321+0000 7fda419e2740 1 --2- 172.21.15.19:0/2732355708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206e13c0 0x555e206bbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.321+0000 7fda419e2740 1 --2- 172.21.15.19:0/2732355708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 0x555e206dc1d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.321+0000 7fda419e2740 1 --2- 172.21.15.19:0/2732355708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206bd920 0x555e206e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.321+0000 7fda177fe640 0 client.5709 ms_handle_reset on v2:172.21.15.19:6834/3491125255 2024-09-12T01:58:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.321+0000 7fda419e2740 1 -- 172.21.15.19:0/2732355708 >> 172.21.15.19:0/2732355708 conn(0x555e206bb0e0 msgr2=0x555e20701b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.321+0000 7fda419e2740 1 -- 172.21.15.19:0/2732355708 shutdown_connections 2024-09-12T01:58:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.321+0000 7fda419e2740 1 -- 172.21.15.19:0/2732355708 wait complete. 2024-09-12T01:58:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.321+0000 7fda419e2740 20 client.5709 trim_cache size 0 max 16384 2024-09-12T01:58:15.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.336+0000 7fda419e2740 1 Processor -- start 2024-09-12T01:58:15.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.336+0000 7fda419e2740 1 -- start start 2024-09-12T01:58:15.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda419e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206bd920 0x555e20705a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda419e2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 0x555e20705f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda419e2740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206e13c0 0x555e206db830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda419e2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x555e2071ce60 con 0x555e206bf0b0 2024-09-12T01:58:15.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda419e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fda382013e0 con 0x555e206bd920 2024-09-12T01:58:15.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda419e2740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fda38200440 con 0x555e206e13c0 2024-09-12T01:58:15.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 0x555e20705f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 0x555e20705f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52248/0 (socket says 172.21.15.19:52248) 2024-09-12T01:58:15.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda37fff640 1 -- 172.21.15.19:0/2549112833 learned_addr learned my addr 172.21.15.19:0/2549112833 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:15.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda3d10c640 1 --2- 172.21.15.19:0/2549112833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206e13c0 0x555e206db830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda3c90b640 1 --2- 172.21.15.19:0/2549112833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206bd920 0x555e20705a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda37fff640 1 -- 172.21.15.19:0/2549112833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206e13c0 msgr2=0x555e206db830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:15.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda37fff640 1 --2- 172.21.15.19:0/2549112833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206e13c0 0x555e206db830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda37fff640 1 -- 172.21.15.19:0/2549112833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206bd920 msgr2=0x555e20705a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:15.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda37fff640 1 --2- 172.21.15.19:0/2549112833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206bd920 0x555e20705a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda37fff640 1 -- 172.21.15.19:0/2549112833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e202f30f0 con 0x555e206bf0b0 2024-09-12T01:58:15.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda3d10c640 1 --2- 172.21.15.19:0/2549112833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206e13c0 0x555e206db830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:15.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda37fff640 1 --2- 172.21.15.19:0/2549112833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 0x555e20705f40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fda2c007c20 tx=0x7fda2c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a2fce230881ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda1dffb640 1 -- 172.21.15.19:0/2549112833 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c007620 con 0x555e206bf0b0 2024-09-12T01:58:15.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda1dffb640 1 -- 172.21.15.19:0/2549112833 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda2c0133f0 con 0x555e206bf0b0 2024-09-12T01:58:15.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.337+0000 7fda1dffb640 1 -- 172.21.15.19:0/2549112833 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c013b60 con 0x555e206bf0b0 2024-09-12T01:58:15.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.338+0000 7fda419e2740 1 -- 172.21.15.19:0/2549112833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 msgr2=0x555e20705f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.338+0000 7fda419e2740 1 --2- 172.21.15.19:0/2549112833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 0x555e20705f40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fda2c007c20 tx=0x7fda2c020000 comp rx=0 tx=0).stop 2024-09-12T01:58:15.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.338+0000 7fda419e2740 1 -- 172.21.15.19:0/2549112833 shutdown_connections 2024-09-12T01:58:15.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.338+0000 7fda419e2740 1 --2- 172.21.15.19:0/2549112833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206e13c0 0x555e206db830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.338+0000 7fda419e2740 1 --2- 172.21.15.19:0/2549112833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 0x555e20705f40 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.338+0000 7fda419e2740 1 --2- 172.21.15.19:0/2549112833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206bd920 0x555e20705a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.338+0000 7fda419e2740 1 -- 172.21.15.19:0/2549112833 >> 172.21.15.19:0/2549112833 conn(0x555e206bb0e0 msgr2=0x555e20700610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:15.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.338+0000 7fda419e2740 1 -- 172.21.15.19:0/2549112833 shutdown_connections 2024-09-12T01:58:15.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.338+0000 7fda419e2740 1 -- 172.21.15.19:0/2549112833 wait complete. 2024-09-12T01:58:15.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.338+0000 7fda419e2740 1 -- start start 2024-09-12T01:58:15.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.339+0000 7fda419e2740 1 Processor -- start 2024-09-12T01:58:15.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda419e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206bd920 0x555e206e4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda419e2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 0x555e2077de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda419e2740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206e13c0 0x555e206e5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda419e2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fda381ffdf0 con 0x555e206bf0b0 2024-09-12T01:58:15.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda419e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fda381e8aa0 con 0x555e206bd920 2024-09-12T01:58:15.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda419e2740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x555e206e7210 con 0x555e206e13c0 2024-09-12T01:58:15.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda419e2740 10 client.0 _ll_register_callbacks cb 0x7fda2c001380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:15.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 0x555e2077de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 0x555e2077de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52250/0 (socket says 172.21.15.19:52250) 2024-09-12T01:58:15.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda37fff640 1 -- 172.21.15.19:0/4105955273 learned_addr learned my addr 172.21.15.19:0/4105955273 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:15.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda3c90b640 1 --2- 172.21.15.19:0/4105955273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206bd920 0x555e206e4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda3d10c640 1 --2- 172.21.15.19:0/4105955273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206e13c0 0x555e206e5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda37fff640 1 -- 172.21.15.19:0/4105955273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206e13c0 msgr2=0x555e206e5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:15.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda37fff640 1 --2- 172.21.15.19:0/4105955273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206e13c0 0x555e206e5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda37fff640 1 -- 172.21.15.19:0/4105955273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206bd920 msgr2=0x555e206e4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda37fff640 1 --2- 172.21.15.19:0/4105955273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206bd920 0x555e206e4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda37fff640 1 -- 172.21.15.19:0/4105955273 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e20780c30 con 0x555e206bf0b0 2024-09-12T01:58:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda37fff640 1 --2- 172.21.15.19:0/4105955273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 0x555e2077de70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fda2c025040 tx=0x7fda2c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936d943130844bee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda177fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:58:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda177fe640 1 -- 172.21.15.19:0/4105955273 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c013b00 con 0x555e206bf0b0 2024-09-12T01:58:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda177fe640 1 -- 172.21.15.19:0/4105955273 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7fda2c013ca0 con 0x555e206bf0b0 2024-09-12T01:58:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.340+0000 7fda419e2740 1 -- 172.21.15.19:0/4105955273 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda2c0133f0 con 0x555e206bf0b0 2024-09-12T01:58:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.341+0000 7fda177fe640 1 -- 172.21.15.19:0/4105955273 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fda2c047050 con 0x555e206bf0b0 2024-09-12T01:58:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.341+0000 7fda419e2740 10 client.5715 fetch_fsmap learned FSMap version 31 2024-09-12T01:58:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.341+0000 7fda419e2740 1 -- 172.21.15.19:0/4105955273 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x555e20721650 con 0x555e206bf0b0 2024-09-12T01:58:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.341+0000 7fda177fe640 1 -- 172.21.15.19:0/4105955273 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda2c0133f0 con 0x555e206bf0b0 2024-09-12T01:58:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.341+0000 7fda177fe640 1 -- 172.21.15.19:0/4105955273 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 31) ==== 3494+0+0 (secure 0 0 0) 0x7fda2c04a020 con 0x555e206bf0b0 2024-09-12T01:58:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.341+0000 7fda419e2740 10 client.5715 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T01:58:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.341+0000 7fda419e2740 10 client.5715 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T01:58:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.341+0000 7fda419e2740 20 client.5715 populate_metadata read hostname 'smithi019' 2024-09-12T01:58:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.341+0000 7fda419e2740 1 --2- 172.21.15.19:0/4105955273 >> [v2:172.21.15.19:6834/3491125255,v1:172.21.15.19:6835/3491125255] conn(0x555e206e5960 0x555e207205d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.341+0000 7fda419e2740 4 client.5715 mds_command: new command op to 5676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:58:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.341+0000 7fda419e2740 1 -- 172.21.15.19:0/4105955273 --> [v2:172.21.15.19:6834/3491125255,v1:172.21.15.19:6835/3491125255] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555e206e6390 con 0x555e206e5960 2024-09-12T01:58:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.341+0000 7fda3c90b640 1 --2- 172.21.15.19:0/4105955273 >> [v2:172.21.15.19:6834/3491125255,v1:172.21.15.19:6835/3491125255] conn(0x555e206e5960 0x555e207205d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.341+0000 7fda177fe640 10 client.5715 ms_handle_connect on v2:172.21.15.19:6834/3491125255 2024-09-12T01:58:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.341+0000 7fda3c90b640 1 --2- 172.21.15.19:0/4105955273 >> [v2:172.21.15.19:6834/3491125255,v1:172.21.15.19:6835/3491125255] conn(0x555e206e5960 0x555e207205d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f6d6e6b15255ca7 server_cookie=d42c74df14ab4f96 in_seq=0 out_seq=0 2024-09-12T01:58:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.341+0000 7fda177fe640 1 -- 172.21.15.19:0/4105955273 <== mds.0 v2:172.21.15.19:6834/3491125255 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555e206e6390 con 0x555e206e5960 2024-09-12T01:58:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.342+0000 7fda177fe640 10 client.5715 handle_command_reply: tid=0 2024-09-12T01:58:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.342+0000 7fda419e2740 1 client.5715 shutdown 2024-09-12T01:58:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.342+0000 7fda419e2740 1 -- 172.21.15.19:0/4105955273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 msgr2=0x555e2077de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.342+0000 7fda419e2740 1 --2- 172.21.15.19:0/4105955273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 0x555e2077de70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fda2c025040 tx=0x7fda2c014000 comp rx=0 tx=0).stop 2024-09-12T01:58:15.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.342+0000 7fda419e2740 1 -- 172.21.15.19:0/4105955273 shutdown_connections 2024-09-12T01:58:15.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.342+0000 7fda419e2740 1 --2- 172.21.15.19:0/4105955273 >> [v2:172.21.15.19:6834/3491125255,v1:172.21.15.19:6835/3491125255] conn(0x555e206e5960 0x555e207205d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.342+0000 7fda419e2740 1 --2- 172.21.15.19:0/4105955273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555e206e13c0 0x555e206e5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.342+0000 7fda419e2740 1 --2- 172.21.15.19:0/4105955273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555e206bf0b0 0x555e2077de70 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.342+0000 7fda419e2740 1 --2- 172.21.15.19:0/4105955273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e206bd920 0x555e206e4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.342+0000 7fda177fe640 0 client.5715 ms_handle_reset on v2:172.21.15.19:6834/3491125255 2024-09-12T01:58:15.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.342+0000 7fda419e2740 1 -- 172.21.15.19:0/4105955273 >> 172.21.15.19:0/4105955273 conn(0x555e206bb0e0 msgr2=0x555e207264e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:15.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.342+0000 7fda419e2740 1 -- 172.21.15.19:0/4105955273 shutdown_connections 2024-09-12T01:58:15.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.342+0000 7fda419e2740 1 -- 172.21.15.19:0/4105955273 wait complete. 2024-09-12T01:58:15.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.342+0000 7fda419e2740 20 client.5715 trim_cache size 0 max 16384 2024-09-12T01:58:15.349 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:58:15.350 INFO:teuthology.orchestra.run.smithi019.stdout: "message": "", 2024-09-12T01:58:15.350 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0 2024-09-12T01:58:15.350 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:58:15.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.342+0000 7fda3eb6f640 1 -- 172.21.15.19:0/3471454753 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fda2406be30 msgr2=0x7fda2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.342+0000 7fda3eb6f640 1 --2- 172.21.15.19:0/3471454753 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fda2406be30 0x7fda2406e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fda380d35d0 tx=0x7fda2c009040 comp rx=0 tx=0).stop 2024-09-12T01:58:15.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.342+0000 7fda3eb6f640 1 -- 172.21.15.19:0/3471454753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda380d5100 msgr2=0x7fda380b6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.342+0000 7fda3eb6f640 1 --2- 172.21.15.19:0/3471454753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda380d5100 0x7fda380b6380 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fda30009e50 tx=0x7fda30004a40 comp rx=0 tx=0).stop 2024-09-12T01:58:15.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.343+0000 7fda3eb6f640 1 -- 172.21.15.19:0/3471454753 shutdown_connections 2024-09-12T01:58:15.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.343+0000 7fda3eb6f640 1 --2- 172.21.15.19:0/3471454753 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fda2406be30 0x7fda2406e2f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.343+0000 7fda3eb6f640 1 --2- 172.21.15.19:0/3471454753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda381621b0 0x7fda380c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.343+0000 7fda3eb6f640 1 --2- 172.21.15.19:0/3471454753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda3815e640 0x7fda380c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.343+0000 7fda3eb6f640 1 --2- 172.21.15.19:0/3471454753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda380d5100 0x7fda380b6380 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.343+0000 7fda3eb6f640 1 -- 172.21.15.19:0/3471454753 >> 172.21.15.19:0/3471454753 conn(0x7fda3808bfc0 msgr2=0x7fda380b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:15.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.343+0000 7fda3eb6f640 1 -- 172.21.15.19:0/3471454753 shutdown_connections 2024-09-12T01:58:15.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.343+0000 7fda3eb6f640 1 -- 172.21.15.19:0/3471454753 wait complete. 2024-09-12T01:58:15.354 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:58:15.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.455+0000 7f92c436f640 1 Processor -- start 2024-09-12T01:58:15.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.456+0000 7f92c436f640 1 -- start start 2024-09-12T01:58:15.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.456+0000 7f92c436f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92bc15e740 0x7f92bc0d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.456+0000 7f92c436f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f92bc09b690 0x7f92bc06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.457+0000 7f92c436f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f92bc06d4c0 0x7f92bc06d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.457+0000 7f92c436f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f92bc15eb20 con 0x7f92bc06d4c0 2024-09-12T01:58:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.457+0000 7f92c436f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f92bc06d260 con 0x7f92bc09b690 2024-09-12T01:58:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.457+0000 7f92c436f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f92bc0d0780 con 0x7f92bc15e740 2024-09-12T01:58:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.457+0000 7f92c290c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f92bc06d4c0 0x7f92bc06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.457+0000 7f92c290c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f92bc06d4c0 0x7f92bc06d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52260/0 (socket says 172.21.15.19:52260) 2024-09-12T01:58:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.457+0000 7f92c290c640 1 -- 172.21.15.19:0/775025354 learned_addr learned my addr 172.21.15.19:0/775025354 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.457+0000 7f92c210b640 1 --2- 172.21.15.19:0/775025354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92bc15e740 0x7f92bc0d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.457+0000 7f92c190a640 1 --2- 172.21.15.19:0/775025354 >> v2:172.21.15.135:3300/0 conn(0x7f92bc09b690 0x7f92bc06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.457+0000 7f92c290c640 1 -- 172.21.15.19:0/775025354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92bc15e740 msgr2=0x7f92bc0d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.457+0000 7f92c290c640 1 --2- 172.21.15.19:0/775025354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92bc15e740 0x7f92bc0d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.457+0000 7f92c290c640 1 -- 172.21.15.19:0/775025354 >> v2:172.21.15.135:3300/0 conn(0x7f92bc09b690 msgr2=0x7f92bc06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.457+0000 7f92c290c640 1 --2- 172.21.15.19:0/775025354 >> v2:172.21.15.135:3300/0 conn(0x7f92bc09b690 0x7f92bc06cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.457+0000 7f92c290c640 1 -- 172.21.15.19:0/775025354 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92bc0d0a60 con 0x7f92bc06d4c0 2024-09-12T01:58:15.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.458+0000 7f92c290c640 1 --2- 172.21.15.19:0/775025354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f92bc06d4c0 0x7f92bc06d910 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0738c0 tx=0x7f92b402a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6764819fd163c8e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.458+0000 7f92c1109640 1 -- 172.21.15.19:0/775025354 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4036070 con 0x7f92bc06d4c0 2024-09-12T01:58:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.458+0000 7f92c1109640 1 -- 172.21.15.19:0/775025354 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b4031600 con 0x7f92bc06d4c0 2024-09-12T01:58:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.458+0000 7f92c1109640 1 -- 172.21.15.19:0/775025354 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b40319d0 con 0x7f92bc06d4c0 2024-09-12T01:58:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.458+0000 7f92c436f640 1 -- 172.21.15.19:0/775025354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f92bc06d4c0 msgr2=0x7f92bc06d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.458+0000 7f92c436f640 1 --2- 172.21.15.19:0/775025354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f92bc06d4c0 0x7f92bc06d910 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0738c0 tx=0x7f92b402a750 comp rx=0 tx=0).stop 2024-09-12T01:58:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.459+0000 7f92c436f640 1 -- 172.21.15.19:0/775025354 shutdown_connections 2024-09-12T01:58:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.459+0000 7f92c436f640 1 --2- 172.21.15.19:0/775025354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f92bc06d4c0 0x7f92bc06d910 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.459+0000 7f92c436f640 1 --2- 172.21.15.19:0/775025354 >> v2:172.21.15.135:3300/0 conn(0x7f92bc09b690 0x7f92bc06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.459+0000 7f92c436f640 1 --2- 172.21.15.19:0/775025354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92bc15e740 0x7f92bc0d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.459+0000 7f92c436f640 1 -- 172.21.15.19:0/775025354 >> 172.21.15.19:0/775025354 conn(0x7f92bc0d23a0 msgr2=0x7f92bc0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.459+0000 7f92c436f640 1 -- 172.21.15.19:0/775025354 shutdown_connections 2024-09-12T01:58:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.459+0000 7f92c436f640 1 -- 172.21.15.19:0/775025354 wait complete. 2024-09-12T01:58:15.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.460+0000 7f92c436f640 1 Processor -- start 2024-09-12T01:58:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.460+0000 7f92c436f640 1 -- start start 2024-09-12T01:58:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.460+0000 7f92c436f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92bc06d4c0 0x7f92bc1e7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.460+0000 7f92c436f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92bc09b690 0x7f92bc09ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92c436f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f92bc15e740 0x7f92bc15cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92c436f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc09ba90 con 0x7f92bc15e740 2024-09-12T01:58:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92c436f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc0d1020 con 0x7f92bc09b690 2024-09-12T01:58:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92c436f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f92bc06de50 con 0x7f92bc06d4c0 2024-09-12T01:58:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92c290c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f92bc15e740 0x7f92bc15cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92c290c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f92bc15e740 0x7f92bc15cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52276/0 (socket says 172.21.15.19:52276) 2024-09-12T01:58:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92c290c640 1 -- 172.21.15.19:0/3389513187 learned_addr learned my addr 172.21.15.19:0/3389513187 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92c210b640 1 --2- 172.21.15.19:0/3389513187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92bc06d4c0 0x7f92bc1e7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92c190a640 1 --2- 172.21.15.19:0/3389513187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92bc09b690 0x7f92bc09ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92c290c640 1 -- 172.21.15.19:0/3389513187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92bc06d4c0 msgr2=0x7f92bc1e7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92c290c640 1 --2- 172.21.15.19:0/3389513187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92bc06d4c0 0x7f92bc1e7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92c290c640 1 -- 172.21.15.19:0/3389513187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92bc09b690 msgr2=0x7f92bc09ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92c290c640 1 --2- 172.21.15.19:0/3389513187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92bc09b690 0x7f92bc09ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92c290c640 1 -- 172.21.15.19:0/3389513187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92bc0c89d0 con 0x7f92bc15e740 2024-09-12T01:58:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92c290c640 1 --2- 172.21.15.19:0/3389513187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f92bc15e740 0x7f92bc15cb00 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f92b4034040 tx=0x7f92b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92b2ffd640 1 -- 172.21.15.19:0/3389513187 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4036050 con 0x7f92bc15e740 2024-09-12T01:58:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92b2ffd640 1 -- 172.21.15.19:0/3389513187 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b4042070 con 0x7f92bc15e740 2024-09-12T01:58:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92c436f640 1 -- 172.21.15.19:0/3389513187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92bc09f610 con 0x7f92bc15e740 2024-09-12T01:58:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92b2ffd640 1 -- 172.21.15.19:0/3389513187 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4009510 con 0x7f92bc15e740 2024-09-12T01:58:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.461+0000 7f92c436f640 1 -- 172.21.15.19:0/3389513187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92bc0c6da0 con 0x7f92bc15e740 2024-09-12T01:58:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.462+0000 7f92c436f640 1 -- 172.21.15.19:0/3389513187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92bc06d910 con 0x7f92bc15e740 2024-09-12T01:58:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.463+0000 7f92b2ffd640 1 -- 172.21.15.19:0/3389513187 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92b4007c50 con 0x7f92bc15e740 2024-09-12T01:58:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.463+0000 7f92b2ffd640 1 --2- 172.21.15.19:0/3389513187 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f92a006be30 0x7f92a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.463+0000 7f92b2ffd640 1 -- 172.21.15.19:0/3389513187 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7f92b40abf20 con 0x7f92bc15e740 2024-09-12T01:58:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.464+0000 7f92c210b640 1 --2- 172.21.15.19:0/3389513187 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f92a006be30 0x7f92a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.464+0000 7f92c210b640 1 --2- 172.21.15.19:0/3389513187 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f92a006be30 0x7f92a006e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f92b800a9a0 tx=0x7f92b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.468+0000 7f92b2ffd640 1 -- 172.21.15.19:0/3389513187 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f92b407a130 con 0x7f92bc15e740 2024-09-12T01:58:15.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.679+0000 7f92c436f640 1 -- 172.21.15.19:0/3389513187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92bc0d1cb0 con 0x7f92bc15e740 2024-09-12T01:58:15.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.679+0000 7f92b2ffd640 1 -- 172.21.15.19:0/3389513187 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5223 (secure 0 0 0) 0x7f92b407e430 con 0x7f92bc15e740 2024-09-12T01:58:15.680 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:15.680 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":31,"btime":"2024-09-12T01:58:14:834957+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/4076449352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4076449352},{"type":"v1","addr":"172.21.15.135:6836","nonce":4076449352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1361756714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1361756714},{"type":"v1","addr":"172.21.15.135:6837","nonce":1361756714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3926640523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3926640523},{"type":"v1","addr":"172.21.15.19:6833","nonce":3926640523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:57:54.505612+0000","modified":"2024-09-12T01:58:14.834942+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5676":{"gid":5676,"name":"a","rank":0,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.19:6835/3491125255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":3491125255},{"type":"v1","addr":"172.21.15.19:6835","nonce":3491125255}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-09-12T01:58:15.680 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 31 2024-09-12T01:58:15.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.681+0000 7f92c436f640 1 -- 172.21.15.19:0/3389513187 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f92a006be30 msgr2=0x7f92a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.681+0000 7f92c436f640 1 --2- 172.21.15.19:0/3389513187 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f92a006be30 0x7f92a006e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f92b800a9a0 tx=0x7f92b8008040 comp rx=0 tx=0).stop 2024-09-12T01:58:15.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.681+0000 7f92c436f640 1 -- 172.21.15.19:0/3389513187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f92bc15e740 msgr2=0x7f92bc15cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.681+0000 7f92c436f640 1 --2- 172.21.15.19:0/3389513187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f92bc15e740 0x7f92bc15cb00 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f92b4034040 tx=0x7f92b4004a40 comp rx=0 tx=0).stop 2024-09-12T01:58:15.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.681+0000 7f92c436f640 1 -- 172.21.15.19:0/3389513187 shutdown_connections 2024-09-12T01:58:15.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.681+0000 7f92c436f640 1 --2- 172.21.15.19:0/3389513187 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f92a006be30 0x7f92a006e2f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.681+0000 7f92c436f640 1 --2- 172.21.15.19:0/3389513187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f92bc15e740 0x7f92bc15cb00 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.681+0000 7f92c436f640 1 --2- 172.21.15.19:0/3389513187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92bc09b690 0x7f92bc09ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.681+0000 7f92c436f640 1 --2- 172.21.15.19:0/3389513187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92bc06d4c0 0x7f92bc1e7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.681+0000 7f92c436f640 1 -- 172.21.15.19:0/3389513187 >> 172.21.15.19:0/3389513187 conn(0x7f92bc0d23a0 msgr2=0x7f92bc0b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:15.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.681+0000 7f92c436f640 1 -- 172.21.15.19:0/3389513187 shutdown_connections 2024-09-12T01:58:15.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.681+0000 7f92c436f640 1 -- 172.21.15.19:0/3389513187 wait complete. 2024-09-12T01:58:15.693 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:58:15.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.794+0000 7f481d2c9640 1 Processor -- start 2024-09-12T01:58:15.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.794+0000 7f481d2c9640 1 -- start start 2024-09-12T01:58:15.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.795+0000 7f481d2c9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4818162060 0x7f48180b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.795+0000 7f481d2c9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f48180b64b0 0x7f48180b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.795+0000 7f481d2c9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f481806d9f0 con 0x7f4818161c80 2024-09-12T01:58:15.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.795+0000 7f481d2c9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f481806dcd0 con 0x7f4818162060 2024-09-12T01:58:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.795+0000 7f481d2c9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f481806dfb0 con 0x7f48180b64b0 2024-09-12T01:58:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.795+0000 7f48167fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4818162060 0x7f48180b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.795+0000 7f4816ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4818161c80 0x7f481806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58264/0 (socket says 172.21.15.19:58264) 2024-09-12T01:58:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.795+0000 7f4816ffd640 1 -- 172.21.15.19:0/2849010804 learned_addr learned my addr 172.21.15.19:0/2849010804 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.796+0000 7f48177fe640 1 --2- 172.21.15.19:0/2849010804 >> v2:172.21.15.135:3300/0 conn(0x7f48180b64b0 0x7f48180b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.796+0000 7f48167fc640 1 -- 172.21.15.19:0/2849010804 >> v2:172.21.15.135:3300/0 conn(0x7f48180b64b0 msgr2=0x7f48180b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.796+0000 7f48167fc640 1 --2- 172.21.15.19:0/2849010804 >> v2:172.21.15.135:3300/0 conn(0x7f48180b64b0 0x7f48180b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.796+0000 7f48167fc640 1 -- 172.21.15.19:0/2849010804 >> v1:172.21.15.19:6789/0 conn(0x7f4818161c80 legacy=0x7f481806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.796+0000 7f4815ffb640 1 -- 172.21.15.19:0/2849010804 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2805972524 0 0) 0x7f481806d9f0 con 0x7f4818161c80 2024-09-12T01:58:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.796+0000 7f48167fc640 1 -- 172.21.15.19:0/2849010804 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48180d01f0 con 0x7f4818162060 2024-09-12T01:58:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.797+0000 7f48167fc640 1 --2- 172.21.15.19:0/2849010804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4818162060 0x7f48180b5f70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f481808d750 tx=0x7f480002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa355c0aa18a0ef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.797+0000 7f4815ffb640 1 -- 172.21.15.19:0/2849010804 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4800037070 con 0x7f4818162060 2024-09-12T01:58:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.797+0000 7f4815ffb640 1 -- 172.21.15.19:0/2849010804 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4800032440 con 0x7f4818162060 2024-09-12T01:58:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.797+0000 7f4815ffb640 1 -- 172.21.15.19:0/2849010804 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4800032810 con 0x7f4818162060 2024-09-12T01:58:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.797+0000 7f481d2c9640 1 -- 172.21.15.19:0/2849010804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4818162060 msgr2=0x7f48180b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.797+0000 7f481d2c9640 1 --2- 172.21.15.19:0/2849010804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4818162060 0x7f48180b5f70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f481808d750 tx=0x7f480002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.797+0000 7f481d2c9640 1 -- 172.21.15.19:0/2849010804 shutdown_connections 2024-09-12T01:58:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.797+0000 7f481d2c9640 1 --2- 172.21.15.19:0/2849010804 >> v2:172.21.15.135:3300/0 conn(0x7f48180b64b0 0x7f48180b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.797+0000 7f481d2c9640 1 --2- 172.21.15.19:0/2849010804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4818162060 0x7f48180b5f70 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.797+0000 7f481d2c9640 1 -- 172.21.15.19:0/2849010804 >> 172.21.15.19:0/2849010804 conn(0x7f48180d44f0 msgr2=0x7f48180d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.797+0000 7f481d2c9640 1 -- 172.21.15.19:0/2849010804 shutdown_connections 2024-09-12T01:58:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.797+0000 7f481d2c9640 1 -- 172.21.15.19:0/2849010804 wait complete. 2024-09-12T01:58:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.799+0000 7f481d2c9640 1 Processor -- start 2024-09-12T01:58:15.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.799+0000 7f481d2c9640 1 -- start start 2024-09-12T01:58:15.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.799+0000 7f481d2c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48180b64b0 0x7f48181f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.799+0000 7f481d2c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4818161c80 0x7f48180b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.799+0000 7f481d2c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4818162060 0x7f4818160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.799+0000 7f481d2c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f48180cf1e0 con 0x7f48180b64b0 2024-09-12T01:58:15.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.799+0000 7f481d2c9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f48180d2aa0 con 0x7f4818161c80 2024-09-12T01:58:15.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.799+0000 7f481d2c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f48180cf360 con 0x7f4818162060 2024-09-12T01:58:15.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.799+0000 7f4816ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48180b64b0 0x7f48181f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.799+0000 7f4816ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48180b64b0 0x7f48181f3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52294/0 (socket says 172.21.15.19:52294) 2024-09-12T01:58:15.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.799+0000 7f4816ffd640 1 -- 172.21.15.19:0/2634392700 learned_addr learned my addr 172.21.15.19:0/2634392700 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:15.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.800+0000 7f48167fc640 1 --2- 172.21.15.19:0/2634392700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4818161c80 0x7f48180b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.800+0000 7f4816ffd640 1 -- 172.21.15.19:0/2634392700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4818162060 msgr2=0x7f4818160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.800+0000 7f48177fe640 1 --2- 172.21.15.19:0/2634392700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4818162060 0x7f4818160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.800+0000 7f4816ffd640 1 --2- 172.21.15.19:0/2634392700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4818162060 0x7f4818160070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.800+0000 7f4816ffd640 1 -- 172.21.15.19:0/2634392700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4818161c80 msgr2=0x7f48180b8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.800+0000 7f4816ffd640 1 --2- 172.21.15.19:0/2634392700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4818161c80 0x7f48180b8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.800+0000 7f4816ffd640 1 -- 172.21.15.19:0/2634392700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48180c8e40 con 0x7f48180b64b0 2024-09-12T01:58:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.800+0000 7f48167fc640 1 --2- 172.21.15.19:0/2634392700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4818161c80 0x7f48180b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.800+0000 7f48177fe640 1 --2- 172.21.15.19:0/2634392700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4818162060 0x7f4818160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.800+0000 7f4816ffd640 1 --2- 172.21.15.19:0/2634392700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48180b64b0 0x7f48181f3d10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f481000c890 tx=0x7f481000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.800+0000 7f480f7fe640 1 -- 172.21.15.19:0/2634392700 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4810018070 con 0x7f48180b64b0 2024-09-12T01:58:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.800+0000 7f480f7fe640 1 -- 172.21.15.19:0/2634392700 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f481000a640 con 0x7f48180b64b0 2024-09-12T01:58:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.800+0000 7f481d2c9640 1 -- 172.21.15.19:0/2634392700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48180c9120 con 0x7f48180b64b0 2024-09-12T01:58:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.800+0000 7f480f7fe640 1 -- 172.21.15.19:0/2634392700 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481000aa30 con 0x7f48180b64b0 2024-09-12T01:58:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.800+0000 7f481d2c9640 1 -- 172.21.15.19:0/2634392700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48180c96e0 con 0x7f48180b64b0 2024-09-12T01:58:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.801+0000 7f481d2c9640 1 -- 172.21.15.19:0/2634392700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48180c9ac0 con 0x7f48180b64b0 2024-09-12T01:58:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.802+0000 7f480f7fe640 1 -- 172.21.15.19:0/2634392700 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f481001b070 con 0x7f48180b64b0 2024-09-12T01:58:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.802+0000 7f480f7fe640 1 --2- 172.21.15.19:0/2634392700 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f47f806be30 0x7f47f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.802+0000 7f480f7fe640 1 -- 172.21.15.19:0/2634392700 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7f481008a750 con 0x7f48180b64b0 2024-09-12T01:58:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.802+0000 7f48167fc640 1 --2- 172.21.15.19:0/2634392700 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f47f806be30 0x7f47f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.803+0000 7f48167fc640 1 --2- 172.21.15.19:0/2634392700 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f47f806be30 0x7f47f806e2f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4800034000 tx=0x7f480002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:15.807+0000 7f480f7fe640 1 -- 172.21.15.19:0/2634392700 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f48180c9ac0 con 0x7f48180b64b0 2024-09-12T01:58:16.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.018+0000 7f481d2c9640 1 -- 172.21.15.19:0/2634392700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48180b5f70 con 0x7f48180b64b0 2024-09-12T01:58:16.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.019+0000 7f480f7fe640 1 -- 172.21.15.19:0/2634392700 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5226 (secure 0 0 0) 0x7f4810058f20 con 0x7f48180b64b0 2024-09-12T01:58:16.019 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:16.020 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":32,"btime":"2024-09-12T01:58:15:836600+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/4076449352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4076449352},{"type":"v1","addr":"172.21.15.135:6836","nonce":4076449352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1361756714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1361756714},{"type":"v1","addr":"172.21.15.135:6837","nonce":1361756714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3926640523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3926640523},{"type":"v1","addr":"172.21.15.19:6833","nonce":3926640523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:57:54.505612+0000","modified":"2024-09-12T01:58:14.844908+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5676":{"gid":5676,"name":"a","rank":0,"incarnation":31,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.19:6835/3491125255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":3491125255},{"type":"v1","addr":"172.21.15.19:6835","nonce":3491125255}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-09-12T01:58:16.020 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 32 2024-09-12T01:58:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.021+0000 7f481d2c9640 1 -- 172.21.15.19:0/2634392700 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f47f806be30 msgr2=0x7f47f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.021+0000 7f481d2c9640 1 --2- 172.21.15.19:0/2634392700 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f47f806be30 0x7f47f806e2f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4800034000 tx=0x7f480002e000 comp rx=0 tx=0).stop 2024-09-12T01:58:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.021+0000 7f481d2c9640 1 -- 172.21.15.19:0/2634392700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48180b64b0 msgr2=0x7f48181f3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.021+0000 7f481d2c9640 1 --2- 172.21.15.19:0/2634392700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48180b64b0 0x7f48181f3d10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f481000c890 tx=0x7f481000cd50 comp rx=0 tx=0).stop 2024-09-12T01:58:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.021+0000 7f481d2c9640 1 -- 172.21.15.19:0/2634392700 shutdown_connections 2024-09-12T01:58:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.021+0000 7f481d2c9640 1 --2- 172.21.15.19:0/2634392700 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f47f806be30 0x7f47f806e2f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.021+0000 7f481d2c9640 1 --2- 172.21.15.19:0/2634392700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4818162060 0x7f4818160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.021+0000 7f481d2c9640 1 --2- 172.21.15.19:0/2634392700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4818161c80 0x7f48180b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.021+0000 7f481d2c9640 1 --2- 172.21.15.19:0/2634392700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48180b64b0 0x7f48181f3d10 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.021+0000 7f481d2c9640 1 -- 172.21.15.19:0/2634392700 >> 172.21.15.19:0/2634392700 conn(0x7f48180d44f0 msgr2=0x7f48180b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.021+0000 7f481d2c9640 1 -- 172.21.15.19:0/2634392700 shutdown_connections 2024-09-12T01:58:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.021+0000 7f481d2c9640 1 -- 172.21.15.19:0/2634392700 wait complete. 2024-09-12T01:58:16.033 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:58:16.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.135+0000 7ff70ae9b640 1 Processor -- start 2024-09-12T01:58:16.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.135+0000 7ff70ae9b640 1 -- start start 2024-09-12T01:58:16.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.136+0000 7ff70ae9b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff704161c80 0x7ff70406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:16.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.136+0000 7ff70ae9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff704162060 0x7ff7040b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:16.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.136+0000 7ff70ae9b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff70406e870 con 0x7ff7040b64b0 2024-09-12T01:58:16.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.136+0000 7ff70ae9b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff70406d9f0 con 0x7ff704162060 2024-09-12T01:58:16.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.136+0000 7ff70ae9b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff70406dcd0 con 0x7ff704161c80 2024-09-12T01:58:16.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.136+0000 7ff6fbfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff704162060 0x7ff7040b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:16.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.136+0000 7ff6fbfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff704162060 0x7ff7040b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52298/0 (socket says 172.21.15.19:52298) 2024-09-12T01:58:16.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.136+0000 7ff6fbfff640 1 -- 172.21.15.19:0/346691041 learned_addr learned my addr 172.21.15.19:0/346691041 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:16.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.136+0000 7ff6fbfff640 1 -- 172.21.15.19:0/346691041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff704161c80 msgr2=0x7ff70406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:16.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.136+0000 7ff708c37640 1 --2- 172.21.15.19:0/346691041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff704161c80 0x7ff70406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:16.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.136+0000 7ff6fbfff640 1 --2- 172.21.15.19:0/346691041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff704161c80 0x7ff70406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.136+0000 7ff6fbfff640 1 -- 172.21.15.19:0/346691041 >> v1:172.21.15.135:6789/0 conn(0x7ff7040b64b0 legacy=0x7ff704162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:16.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.136+0000 7ff6fbfff640 1 -- 172.21.15.19:0/346691041 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70406dfb0 con 0x7ff704162060 2024-09-12T01:58:16.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.136+0000 7ff708c37640 1 --2- 172.21.15.19:0/346691041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff704161c80 0x7ff70406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:16.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.137+0000 7ff6fbfff640 1 --2- 172.21.15.19:0/346691041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff704162060 0x7ff7040b5f70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009870 tx=0x7ff6f402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5329678a3a3aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:16.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.137+0000 7ff6fb7fe640 1 -- 172.21.15.19:0/346691041 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4037070 con 0x7ff704162060 2024-09-12T01:58:16.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.137+0000 7ff6fb7fe640 1 -- 172.21.15.19:0/346691041 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6f4032440 con 0x7ff704162060 2024-09-12T01:58:16.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.137+0000 7ff6fb7fe640 1 -- 172.21.15.19:0/346691041 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4032810 con 0x7ff704162060 2024-09-12T01:58:16.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.138+0000 7ff70ae9b640 1 -- 172.21.15.19:0/346691041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff704162060 msgr2=0x7ff7040b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:16.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.138+0000 7ff70ae9b640 1 --2- 172.21.15.19:0/346691041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff704162060 0x7ff7040b5f70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009870 tx=0x7ff6f402a210 comp rx=0 tx=0).stop 2024-09-12T01:58:16.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.138+0000 7ff70ae9b640 1 -- 172.21.15.19:0/346691041 shutdown_connections 2024-09-12T01:58:16.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.138+0000 7ff70ae9b640 1 --2- 172.21.15.19:0/346691041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff704162060 0x7ff7040b5f70 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.138+0000 7ff70ae9b640 1 --2- 172.21.15.19:0/346691041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff704161c80 0x7ff70406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.138+0000 7ff70ae9b640 1 -- 172.21.15.19:0/346691041 >> 172.21.15.19:0/346691041 conn(0x7ff7040d44f0 msgr2=0x7ff7040d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:16.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.138+0000 7ff70ae9b640 1 -- 172.21.15.19:0/346691041 shutdown_connections 2024-09-12T01:58:16.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.138+0000 7ff70ae9b640 1 -- 172.21.15.19:0/346691041 wait complete. 2024-09-12T01:58:16.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.139+0000 7ff70ae9b640 1 Processor -- start 2024-09-12T01:58:16.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.139+0000 7ff70ae9b640 1 -- start start 2024-09-12T01:58:16.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.140+0000 7ff70ae9b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7040b64b0 0x7ff7040b9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:16.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.140+0000 7ff70ae9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff704161c80 0x7ff704155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:16.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.140+0000 7ff70ae9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff704162060 0x7ff7040cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:16.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.140+0000 7ff70ae9b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff7040d2a10 con 0x7ff704162060 2024-09-12T01:58:16.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.140+0000 7ff70ae9b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7040d2890 con 0x7ff704161c80 2024-09-12T01:58:16.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.140+0000 7ff70ae9b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff7040b6960 con 0x7ff7040b64b0 2024-09-12T01:58:16.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.140+0000 7ff709438640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff704162060 0x7ff7040cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:16.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.140+0000 7ff709438640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff704162060 0x7ff7040cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52310/0 (socket says 172.21.15.19:52310) 2024-09-12T01:58:16.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.140+0000 7ff709438640 1 -- 172.21.15.19:0/2487778125 learned_addr learned my addr 172.21.15.19:0/2487778125 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:16.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.140+0000 7ff708c37640 1 --2- 172.21.15.19:0/2487778125 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7040b64b0 0x7ff7040b9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:16.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.140+0000 7ff6fbfff640 1 --2- 172.21.15.19:0/2487778125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff704161c80 0x7ff704155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:16.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.141+0000 7ff709438640 1 -- 172.21.15.19:0/2487778125 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7040b64b0 msgr2=0x7ff7040b9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:16.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.141+0000 7ff709438640 1 --2- 172.21.15.19:0/2487778125 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7040b64b0 0x7ff7040b9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.141+0000 7ff709438640 1 -- 172.21.15.19:0/2487778125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff704161c80 msgr2=0x7ff704155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:16.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.141+0000 7ff709438640 1 --2- 172.21.15.19:0/2487778125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff704161c80 0x7ff704155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.141+0000 7ff709438640 1 -- 172.21.15.19:0/2487778125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7040c8ae0 con 0x7ff704162060 2024-09-12T01:58:16.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.141+0000 7ff709438640 1 --2- 172.21.15.19:0/2487778125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff704162060 0x7ff7040cb7a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00c780 tx=0x7ff6fc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:16.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.141+0000 7ff6f97fa640 1 -- 172.21.15.19:0/2487778125 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc004b60 con 0x7ff704162060 2024-09-12T01:58:16.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.141+0000 7ff6f97fa640 1 -- 172.21.15.19:0/2487778125 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6fc004d00 con 0x7ff704162060 2024-09-12T01:58:16.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.141+0000 7ff70ae9b640 1 -- 172.21.15.19:0/2487778125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff704156190 con 0x7ff704162060 2024-09-12T01:58:16.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.141+0000 7ff6f97fa640 1 -- 172.21.15.19:0/2487778125 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc00aa90 con 0x7ff704162060 2024-09-12T01:58:16.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.141+0000 7ff70ae9b640 1 -- 172.21.15.19:0/2487778125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7040c8d80 con 0x7ff704162060 2024-09-12T01:58:16.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.142+0000 7ff70ae9b640 1 -- 172.21.15.19:0/2487778125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff704068ea0 con 0x7ff704162060 2024-09-12T01:58:16.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.142+0000 7ff6f97fa640 1 -- 172.21.15.19:0/2487778125 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6fc00ac30 con 0x7ff704162060 2024-09-12T01:58:16.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.143+0000 7ff6f97fa640 1 --2- 172.21.15.19:0/2487778125 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff6f006be30 0x7ff6f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:16.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.143+0000 7ff6f97fa640 1 -- 172.21.15.19:0/2487778125 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7ff6fc08b410 con 0x7ff704162060 2024-09-12T01:58:16.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.143+0000 7ff708c37640 1 --2- 172.21.15.19:0/2487778125 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff6f006be30 0x7ff6f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:16.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.144+0000 7ff708c37640 1 --2- 172.21.15.19:0/2487778125 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff6f006be30 0x7ff6f006e2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff70000ab60 tx=0x7ff700008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:16.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.147+0000 7ff6f97fa640 1 -- 172.21.15.19:0/2487778125 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff6fc059580 con 0x7ff704162060 2024-09-12T01:58:16.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.358+0000 7ff70ae9b640 1 -- 172.21.15.19:0/2487778125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7040ba470 con 0x7ff704162060 2024-09-12T01:58:16.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.358+0000 7ff6f97fa640 1 -- 172.21.15.19:0/2487778125 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5226 (secure 0 0 0) 0x7ff6fc05d880 con 0x7ff704162060 2024-09-12T01:58:16.359 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:16.359 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":32,"btime":"2024-09-12T01:58:15:836600+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/4076449352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4076449352},{"type":"v1","addr":"172.21.15.135:6836","nonce":4076449352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1361756714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1361756714},{"type":"v1","addr":"172.21.15.135:6837","nonce":1361756714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3926640523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3926640523},{"type":"v1","addr":"172.21.15.19:6833","nonce":3926640523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:57:54.505612+0000","modified":"2024-09-12T01:58:14.844908+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5676":{"gid":5676,"name":"a","rank":0,"incarnation":31,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.19:6835/3491125255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":3491125255},{"type":"v1","addr":"172.21.15.19:6835","nonce":3491125255}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-09-12T01:58:16.359 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 32 2024-09-12T01:58:16.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.360+0000 7ff70ae9b640 1 -- 172.21.15.19:0/2487778125 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff6f006be30 msgr2=0x7ff6f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:16.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.360+0000 7ff70ae9b640 1 --2- 172.21.15.19:0/2487778125 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff6f006be30 0x7ff6f006e2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff70000ab60 tx=0x7ff700008040 comp rx=0 tx=0).stop 2024-09-12T01:58:16.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.360+0000 7ff70ae9b640 1 -- 172.21.15.19:0/2487778125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff704162060 msgr2=0x7ff7040cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:16.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.360+0000 7ff70ae9b640 1 --2- 172.21.15.19:0/2487778125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff704162060 0x7ff7040cb7a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00c780 tx=0x7ff6fc00cc40 comp rx=0 tx=0).stop 2024-09-12T01:58:16.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.360+0000 7ff70ae9b640 1 -- 172.21.15.19:0/2487778125 shutdown_connections 2024-09-12T01:58:16.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.360+0000 7ff70ae9b640 1 --2- 172.21.15.19:0/2487778125 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff6f006be30 0x7ff6f006e2f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.360+0000 7ff70ae9b640 1 --2- 172.21.15.19:0/2487778125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff704162060 0x7ff7040cb7a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.360+0000 7ff70ae9b640 1 --2- 172.21.15.19:0/2487778125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff704161c80 0x7ff704155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.360+0000 7ff70ae9b640 1 --2- 172.21.15.19:0/2487778125 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7040b64b0 0x7ff7040b9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.360+0000 7ff70ae9b640 1 -- 172.21.15.19:0/2487778125 >> 172.21.15.19:0/2487778125 conn(0x7ff7040d44f0 msgr2=0x7ff70406ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:16.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.360+0000 7ff70ae9b640 1 -- 172.21.15.19:0/2487778125 shutdown_connections 2024-09-12T01:58:16.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.360+0000 7ff70ae9b640 1 -- 172.21.15.19:0/2487778125 wait complete. 2024-09-12T01:58:16.372 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump tree /a 0 2024-09-12T01:58:16.489 INFO:teuthology.orchestra.run.smithi019.stdout:[{"ino":1099511627776,"rdev":0,"ctime":"2024-09-12T01:58:11.180617+0000","btime":"2024-09-12T01:58:05.318680+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-12T01:58:11.180617+0000","atime":"2024-09-12T01:58:05.318680+0000","time_warp_seq":0,"change_attr":3,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-12T01:58:11.180617+0000","num_files":0,"num_subdirs":1,"change_attr":3},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":2,"rsnaps":0,"rctime":"2024-09-12T01:58:11.180617+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":2,"rsnaps":0,"rctime":"2024-09-12T01:58:11.180617+0000"},"version":9,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirfrag":1,"dirty":1},"nref":2,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[{"path":"/a","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"7","version":"7","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1},"nref":1,"dentries":[{"path":"a/c","alternate_name":"","path_ino":1,"snap_first":18446744073709551606,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511627777,"remote_type":"","version":4,"projected_version":4,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"inodepin":1,"dirty":1},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]},{"path":"a/b","alternate_name":"","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":false,"is_remote":false,"is_null":true,"is_new":false,"inode":0,"remote_type":"","version":5,"projected_version":5,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirty":1},"nref":1,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}],"is_subvolume":false}] 2024-09-12T01:58:16.490 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 0, "rctime": "2024-09-12T01:58:11.180617+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 2, "version": 0 }, "atime": "2024-09-12T01:58:05.318680+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-12T01:58:05.318680+0000", "change_attr": 3, "client_caps": [], "client_ranges": [], "ctime": "2024-09-12T01:58:11.180617+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "alternate_name": "", "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511627777, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "a/c", "path_ino": 1, "pins": { "dirty": 1, "inodepin": 1 }, "projected_version": 4, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 18446744073709551606, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } }, { "alternate_name": "", "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 0, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": true, "is_primary": false, "is_remote": false, "lock": {}, "nref": 1, "path": "a/b", "path_ino": 1, "pins": { "dirty": 1 }, "projected_version": 5, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 5, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/a", "pins": { "child": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth" ], "version": "7" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 3, "mtime": "2024-09-12T01:58:11.180617+0000", "num_files": 0, "num_subdirs": 1, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-12T01:58:11.180617+0000", "nestlock": {}, "nlink": 1, "nref": 2, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "dirfrag": 1, "dirty": 1 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2024-09-12T01:58:11.180617+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 2, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 9, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } ] 2024-09-12T01:58:16.490 DEBUG:tasks.cephfs.test_damage:[{'ino': 1099511627776, 'rdev': 0, 'ctime': '2024-09-12T01:58:11.180617+0000', 'btime': '2024-09-12T01:58:05.318680+0000', 'mode': 16877, 'uid': 1000, 'gid': 1333, 'nlink': 1, 'dir_layout': {'dir_hash': 2, 'unused1': 0, 'unused2': 0, 'unused3': 0}, 'layout': {'stripe_unit': 0, 'stripe_count': 0, 'object_size': 0, 'pool_id': -1, 'pool_ns': ''}, 'old_pools': [], 'size': 0, 'truncate_seq': 1, 'truncate_size': 18446744073709551615, 'truncate_from': 0, 'truncate_pending': 0, 'mtime': '2024-09-12T01:58:11.180617+0000', 'atime': '2024-09-12T01:58:05.318680+0000', 'time_warp_seq': 0, 'change_attr': 3, 'export_pin': -1, 'export_ephemeral_random_pin': 0, 'export_ephemeral_distributed_pin': False, 'quiesce_block': False, 'client_ranges': [], 'dirstat': {'version': 0, 'mtime': '2024-09-12T01:58:11.180617+0000', 'num_files': 0, 'num_subdirs': 1, 'change_attr': 3}, 'rstat': {'version': 0, 'rbytes': 0, 'rfiles': 0, 'rsubdirs': 2, 'rsnaps': 0, 'rctime': '2024-09-12T01:58:11.180617+0000'}, 'accounted_rstat': {'version': 0, 'rbytes': 0, 'rfiles': 0, 'rsubdirs': 2, 'rsnaps': 0, 'rctime': '2024-09-12T01:58:11.180617+0000'}, 'version': 9, 'file_data_version': 0, 'xattr_version': 1, 'backtrace_version': 2, 'stray_prior_path': '', 'max_size_ever': 0, 'quota': {'max_bytes': 0, 'max_files': 0}, 'last_scrub_stamp': '0.000000', 'last_scrub_version': 0, 'symlink': '', 'xattrs': [{'key': 'security.selinux', 'val': 'unconfined_u:object_r:unlabeled_t:s0\x00'}], 'dirfragtree': {'splits': []}, 'old_inodes': [], 'oldest_snap': 18446744073709551614, 'damage_flags': 0, 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'dirfrag': 1, 'dirty': 1}, 'nref': 2, 'versionlock': {'gather_set': [], 'state': 'lock', 'type': 'iversion', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'authlock': {}, 'linklock': {}, 'dirfragtreelock': {}, 'filelock': {}, 'xattrlock': {}, 'snaplock': {}, 'nestlock': {}, 'flocklock': {}, 'policylock': {}, 'quiescelock': {'gather_set': [], 'state': 'lock', 'type': 'iquiesce', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'states': ['auth', 'dirty'], 'client_caps': [], 'loner': -1, 'want_loner': -1, 'mds_caps_wanted': [], 'dirfrags': [{'path': '/a', 'dirfrag': '0x10000000000', 'snapid_first': 2, 'projected_version': '7', 'version': '7', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '', 'states': ['auth'], 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'child': 1}, 'nref': 1, 'dentries': [{'path': 'a/c', 'alternate_name': '', 'path_ino': 1, 'snap_first': 18446744073709551606, 'snap_last': 18446744073709551614, 'is_primary': True, 'is_remote': False, 'is_null': False, 'is_new': False, 'inode': 1099511627777, 'remote_type': '', 'version': 4, 'projected_version': 4, 'auth_pins': 0, 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'is_frozen': False, 'is_freezing': False, 'pins': {'inodepin': 1, 'dirty': 1}, 'nref': 2, 'lock': {}, 'versionlock': {'gather_set': [], 'state': 'lock', 'type': 'dversion', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'states': ['auth', 'dirty']}, {'path': 'a/b', 'alternate_name': '', 'path_ino': 1, 'snap_first': 2, 'snap_last': 18446744073709551614, 'is_primary': False, 'is_remote': False, 'is_null': True, 'is_new': False, 'inode': 0, 'remote_type': '', 'version': 5, 'projected_version': 5, 'auth_pins': 0, 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'is_frozen': False, 'is_freezing': False, 'pins': {'dirty': 1}, 'nref': 1, 'lock': {}, 'versionlock': {'gather_set': [], 'state': 'lock', 'type': 'dversion', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'states': ['auth', 'dirty']}]}], 'is_subvolume': False}] 2024-09-12T01:58:16.490 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:58:16.491 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:58:16.530 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:58:16.574 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:58:16.574 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:58:16.575 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:58:16.575 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:58:16.590 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:58:16.591 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:58:16.591 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:58:16.591 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:58:16.632 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:58:16.633 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:58:16.633 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:58:16.633 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:58:16.649 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:58:16.649 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:58:16.650 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:58:16.650 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:58:16.690 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:58:16.691 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:58:16.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.793+0000 7f7b0b5e8640 1 Processor -- start 2024-09-12T01:58:16.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.793+0000 7f7b0b5e8640 1 -- start start 2024-09-12T01:58:16.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.794+0000 7f7b0b5e8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7b0415b300 0x7f7b040cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.794+0000 7f7b0b5e8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b040cd3f0 0x7f7b0406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.794+0000 7f7b0b5e8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b040cdbe0 con 0x7f7b04072d30 2024-09-12T01:58:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.794+0000 7f7b0b5e8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f7b040728a0 con 0x7f7b0415b300 2024-09-12T01:58:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.794+0000 7f7b0b5e8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7b040cd900 con 0x7f7b040cd3f0 2024-09-12T01:58:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.794+0000 7f7b09384640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7b0415b300 0x7f7b040cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.794+0000 7f7b09b85640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7b04072d30 0x7f7b040b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58268/0 (socket says 172.21.15.19:58268) 2024-09-12T01:58:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.794+0000 7f7b09b85640 1 -- 172.21.15.19:0/1524692382 learned_addr learned my addr 172.21.15.19:0/1524692382 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.794+0000 7f7b09384640 1 -- 172.21.15.19:0/1524692382 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b040cd3f0 msgr2=0x7f7b0406f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.794+0000 7f7b09384640 1 --2- 172.21.15.19:0/1524692382 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b040cd3f0 0x7f7b0406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.794+0000 7f7b09384640 1 -- 172.21.15.19:0/1524692382 >> v1:172.21.15.19:6789/0 conn(0x7f7b04072d30 legacy=0x7f7b040b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.794+0000 7f7afbfff640 1 -- 172.21.15.19:0/1524692382 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 143686327 0 0) 0x7f7b040cdbe0 con 0x7f7b04072d30 2024-09-12T01:58:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.794+0000 7f7b09384640 1 -- 172.21.15.19:0/1524692382 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b04072250 con 0x7f7b0415b300 2024-09-12T01:58:16.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.795+0000 7f7b09384640 1 --2- 172.21.15.19:0/1524692382 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b0415b300 0x7f7b040cceb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000bfa0 tx=0x7f7b0002c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71adb55240015e33 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:16.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.795+0000 7f7afbfff640 1 -- 172.21.15.19:0/1524692382 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00039070 con 0x7f7b0415b300 2024-09-12T01:58:16.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.795+0000 7f7afbfff640 1 -- 172.21.15.19:0/1524692382 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b00009540 con 0x7f7b0415b300 2024-09-12T01:58:16.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.795+0000 7f7afbfff640 1 -- 172.21.15.19:0/1524692382 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00009910 con 0x7f7b0415b300 2024-09-12T01:58:16.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.796+0000 7f7b0b5e8640 1 -- 172.21.15.19:0/1524692382 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b0415b300 msgr2=0x7f7b040cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:16.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.796+0000 7f7b0b5e8640 1 --2- 172.21.15.19:0/1524692382 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b0415b300 0x7f7b040cceb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000bfa0 tx=0x7f7b0002c860 comp rx=0 tx=0).stop 2024-09-12T01:58:16.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.796+0000 7f7b0b5e8640 1 -- 172.21.15.19:0/1524692382 shutdown_connections 2024-09-12T01:58:16.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.796+0000 7f7b0b5e8640 1 --2- 172.21.15.19:0/1524692382 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b040cd3f0 0x7f7b0406f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.796+0000 7f7b0b5e8640 1 --2- 172.21.15.19:0/1524692382 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b0415b300 0x7f7b040cceb0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.796+0000 7f7b0b5e8640 1 -- 172.21.15.19:0/1524692382 >> 172.21.15.19:0/1524692382 conn(0x7f7b04067d70 msgr2=0x7f7b0406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:16.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.796+0000 7f7b0b5e8640 1 -- 172.21.15.19:0/1524692382 shutdown_connections 2024-09-12T01:58:16.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.796+0000 7f7b0b5e8640 1 -- 172.21.15.19:0/1524692382 wait complete. 2024-09-12T01:58:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.797+0000 7f7b0b5e8640 1 Processor -- start 2024-09-12T01:58:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.797+0000 7f7b0b5e8640 1 -- start start 2024-09-12T01:58:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.798+0000 7f7b0b5e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b04072d30 0x7f7b041f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.798+0000 7f7b0b5e8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b040cd3f0 0x7f7b041f1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.798+0000 7f7b0b5e8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b0415b300 0x7f7b040c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.798+0000 7f7b0b5e8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7b040d0160 con 0x7f7b04072d30 2024-09-12T01:58:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.798+0000 7f7b0b5e8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7b040cffe0 con 0x7f7b0415b300 2024-09-12T01:58:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.798+0000 7f7b0b5e8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7b0406f700 con 0x7f7b040cd3f0 2024-09-12T01:58:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.798+0000 7f7b09384640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b04072d30 0x7f7b041f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.798+0000 7f7b09384640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b04072d30 0x7f7b041f1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52340/0 (socket says 172.21.15.19:52340) 2024-09-12T01:58:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.798+0000 7f7b09384640 1 -- 172.21.15.19:0/33910372 learned_addr learned my addr 172.21.15.19:0/33910372 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.798+0000 7f7b08b83640 1 --2- 172.21.15.19:0/33910372 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b040cd3f0 0x7f7b041f1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.798+0000 7f7b09b85640 1 --2- 172.21.15.19:0/33910372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b0415b300 0x7f7b040c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.798+0000 7f7b09384640 1 -- 172.21.15.19:0/33910372 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b040cd3f0 msgr2=0x7f7b041f1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.798+0000 7f7b09384640 1 --2- 172.21.15.19:0/33910372 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b040cd3f0 0x7f7b041f1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.798+0000 7f7b09384640 1 -- 172.21.15.19:0/33910372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b0415b300 msgr2=0x7f7b040c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.798+0000 7f7b09384640 1 --2- 172.21.15.19:0/33910372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b0415b300 0x7f7b040c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.798+0000 7f7b09384640 1 -- 172.21.15.19:0/33910372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b041f2120 con 0x7f7b04072d30 2024-09-12T01:58:16.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.799+0000 7f7b09384640 1 --2- 172.21.15.19:0/33910372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b04072d30 0x7f7b041f1be0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7b00037040 tx=0x7f7b00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:16.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.799+0000 7f7af9ffb640 1 -- 172.21.15.19:0/33910372 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00044020 con 0x7f7b04072d30 2024-09-12T01:58:16.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.799+0000 7f7af9ffb640 1 -- 172.21.15.19:0/33910372 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0003f670 con 0x7f7b04072d30 2024-09-12T01:58:16.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.799+0000 7f7af9ffb640 1 -- 172.21.15.19:0/33910372 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00039040 con 0x7f7b04072d30 2024-09-12T01:58:16.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.799+0000 7f7b0b5e8640 1 -- 172.21.15.19:0/33910372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b04155840 con 0x7f7b04072d30 2024-09-12T01:58:16.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.799+0000 7f7b0b5e8640 1 -- 172.21.15.19:0/33910372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b04155e00 con 0x7f7b04072d30 2024-09-12T01:58:16.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.800+0000 7f7b0b5e8640 1 -- 172.21.15.19:0/33910372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b040cb960 con 0x7f7b04072d30 2024-09-12T01:58:16.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.800+0000 7f7af9ffb640 1 -- 172.21.15.19:0/33910372 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b00047020 con 0x7f7b04072d30 2024-09-12T01:58:16.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.801+0000 7f7af9ffb640 1 --2- 172.21.15.19:0/33910372 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7ae806be60 0x7f7ae806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:16.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.801+0000 7f7af9ffb640 1 -- 172.21.15.19:0/33910372 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7f7b000ae0a0 con 0x7f7b04072d30 2024-09-12T01:58:16.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.801+0000 7f7b08b83640 1 --2- 172.21.15.19:0/33910372 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7ae806be60 0x7f7ae806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:16.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.802+0000 7f7b08b83640 1 --2- 172.21.15.19:0/33910372 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7ae806be60 0x7f7ae806e320 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7b040cea10 tx=0x7f7af4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:16.805+0000 7f7af9ffb640 1 -- 172.21.15.19:0/33910372 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b0004e030 con 0x7f7b04072d30 2024-09-12T01:58:17.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.017+0000 7f7b0b5e8640 1 -- 172.21.15.19:0/33910372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b0415c830 con 0x7f7b04072d30 2024-09-12T01:58:17.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.017+0000 7f7af9ffb640 1 -- 172.21.15.19:0/33910372 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+5223 (secure 0 0 0) 0x7f7b0007c860 con 0x7f7b04072d30 2024-09-12T01:58:17.018 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:17.018 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":33,"btime":"2024-09-12T01:58:16:837717+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/4076449352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4076449352},{"type":"v1","addr":"172.21.15.135:6836","nonce":4076449352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1361756714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1361756714},{"type":"v1","addr":"172.21.15.135:6837","nonce":1361756714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3926640523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3926640523},{"type":"v1","addr":"172.21.15.19:6833","nonce":3926640523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:57:54.505612+0000","modified":"2024-09-12T01:58:15.839578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5676":{"gid":5676,"name":"a","rank":0,"incarnation":31,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.19:6835/3491125255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":3491125255},{"type":"v1","addr":"172.21.15.19:6835","nonce":3491125255}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-09-12T01:58:17.018 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 33 2024-09-12T01:58:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.019+0000 7f7b0b5e8640 1 -- 172.21.15.19:0/33910372 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7ae806be60 msgr2=0x7f7ae806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.019+0000 7f7b0b5e8640 1 --2- 172.21.15.19:0/33910372 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7ae806be60 0x7f7ae806e320 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7b040cea10 tx=0x7f7af4008040 comp rx=0 tx=0).stop 2024-09-12T01:58:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.019+0000 7f7b0b5e8640 1 -- 172.21.15.19:0/33910372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b04072d30 msgr2=0x7f7b041f1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.019+0000 7f7b0b5e8640 1 --2- 172.21.15.19:0/33910372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b04072d30 0x7f7b041f1be0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7b00037040 tx=0x7f7b00004a40 comp rx=0 tx=0).stop 2024-09-12T01:58:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.019+0000 7f7b0b5e8640 1 -- 172.21.15.19:0/33910372 shutdown_connections 2024-09-12T01:58:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.019+0000 7f7b0b5e8640 1 --2- 172.21.15.19:0/33910372 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7ae806be60 0x7f7ae806e320 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.019+0000 7f7b0b5e8640 1 --2- 172.21.15.19:0/33910372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b0415b300 0x7f7b040c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.019+0000 7f7b0b5e8640 1 --2- 172.21.15.19:0/33910372 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b040cd3f0 0x7f7b041f1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.019+0000 7f7b0b5e8640 1 --2- 172.21.15.19:0/33910372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b04072d30 0x7f7b041f1be0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.019+0000 7f7b0b5e8640 1 -- 172.21.15.19:0/33910372 >> 172.21.15.19:0/33910372 conn(0x7f7b04067d70 msgr2=0x7f7b040cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:17.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.019+0000 7f7b0b5e8640 1 -- 172.21.15.19:0/33910372 shutdown_connections 2024-09-12T01:58:17.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.019+0000 7f7b0b5e8640 1 -- 172.21.15.19:0/33910372 wait complete. 2024-09-12T01:58:17.031 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:58:17.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.132+0000 7fd67871f640 1 Processor -- start 2024-09-12T01:58:17.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.132+0000 7fd67871f640 1 -- start start 2024-09-12T01:58:17.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.133+0000 7fd67871f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd670072de0 0x7fd67015d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.133+0000 7fd67871f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd670072700 0x7fd67015d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.133+0000 7fd67871f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd670146140 con 0x7fd670072320 2024-09-12T01:58:17.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.133+0000 7fd67871f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd6700cd740 con 0x7fd670072de0 2024-09-12T01:58:17.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.133+0000 7fd67871f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd6700cda20 con 0x7fd670072700 2024-09-12T01:58:17.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.133+0000 7fd675cba640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd670072de0 0x7fd67015d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.133+0000 7fd6764bb640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fd670072320 0x7fd6700cce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:56488/0 (socket says 172.21.15.19:56488) 2024-09-12T01:58:17.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.133+0000 7fd6764bb640 1 -- 172.21.15.19:0/3660000673 learned_addr learned my addr 172.21.15.19:0/3660000673 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:17.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.134+0000 7fd676cbc640 1 --2- 172.21.15.19:0/3660000673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd670072700 0x7fd67015d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.134+0000 7fd675cba640 1 -- 172.21.15.19:0/3660000673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd670072700 msgr2=0x7fd67015d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:17.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.134+0000 7fd675cba640 1 --2- 172.21.15.19:0/3660000673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd670072700 0x7fd67015d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.134+0000 7fd675cba640 1 -- 172.21.15.19:0/3660000673 >> v1:172.21.15.135:6789/0 conn(0x7fd670072320 legacy=0x7fd6700cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.134+0000 7fd675cba640 1 -- 172.21.15.19:0/3660000673 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6700cdd00 con 0x7fd670072de0 2024-09-12T01:58:17.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.134+0000 7fd676cbc640 1 --2- 172.21.15.19:0/3660000673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd670072700 0x7fd67015d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:17.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.135+0000 7fd675cba640 1 --2- 172.21.15.19:0/3660000673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670072de0 0x7fd67015d1e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd6640097a0 tx=0x7fd66402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38d6b6a9cd8a88be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:17.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.135+0000 7fd6754b9640 1 -- 172.21.15.19:0/3660000673 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664037070 con 0x7fd670072de0 2024-09-12T01:58:17.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.135+0000 7fd6754b9640 1 -- 172.21.15.19:0/3660000673 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd66402ae50 con 0x7fd670072de0 2024-09-12T01:58:17.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.135+0000 7fd6754b9640 1 -- 172.21.15.19:0/3660000673 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664032660 con 0x7fd670072de0 2024-09-12T01:58:17.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.135+0000 7fd67871f640 1 -- 172.21.15.19:0/3660000673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670072de0 msgr2=0x7fd67015d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.135+0000 7fd67871f640 1 --2- 172.21.15.19:0/3660000673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670072de0 0x7fd67015d1e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd6640097a0 tx=0x7fd66402a100 comp rx=0 tx=0).stop 2024-09-12T01:58:17.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.136+0000 7fd67871f640 1 -- 172.21.15.19:0/3660000673 shutdown_connections 2024-09-12T01:58:17.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.136+0000 7fd67871f640 1 --2- 172.21.15.19:0/3660000673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd670072700 0x7fd67015d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.136+0000 7fd67871f640 1 --2- 172.21.15.19:0/3660000673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670072de0 0x7fd67015d1e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.136+0000 7fd67871f640 1 -- 172.21.15.19:0/3660000673 >> 172.21.15.19:0/3660000673 conn(0x7fd670067d70 msgr2=0x7fd67006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:17.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.136+0000 7fd67871f640 1 -- 172.21.15.19:0/3660000673 shutdown_connections 2024-09-12T01:58:17.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.136+0000 7fd67871f640 1 -- 172.21.15.19:0/3660000673 wait complete. 2024-09-12T01:58:17.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.137+0000 7fd67871f640 1 Processor -- start 2024-09-12T01:58:17.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.137+0000 7fd67871f640 1 -- start start 2024-09-12T01:58:17.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.137+0000 7fd67871f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670072320 0x7fd670135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.137+0000 7fd67871f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd670072700 0x7fd670144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.137+0000 7fd67871f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd670072de0 0x7fd6701e7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.137+0000 7fd67871f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd67015dde0 con 0x7fd670072de0 2024-09-12T01:58:17.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.137+0000 7fd67871f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd67015dc60 con 0x7fd670072320 2024-09-12T01:58:17.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.137+0000 7fd67871f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd67015df60 con 0x7fd670072700 2024-09-12T01:58:17.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.138+0000 7fd676cbc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd670072de0 0x7fd6701e7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.138+0000 7fd676cbc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd670072de0 0x7fd6701e7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52352/0 (socket says 172.21.15.19:52352) 2024-09-12T01:58:17.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.138+0000 7fd676cbc640 1 -- 172.21.15.19:0/1527635852 learned_addr learned my addr 172.21.15.19:0/1527635852 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:17.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.138+0000 7fd6764bb640 1 --2- 172.21.15.19:0/1527635852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670072320 0x7fd670135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.138+0000 7fd675cba640 1 --2- 172.21.15.19:0/1527635852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd670072700 0x7fd670144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.138+0000 7fd676cbc640 1 -- 172.21.15.19:0/1527635852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd670072700 msgr2=0x7fd670144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.138+0000 7fd676cbc640 1 --2- 172.21.15.19:0/1527635852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd670072700 0x7fd670144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.138+0000 7fd676cbc640 1 -- 172.21.15.19:0/1527635852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670072320 msgr2=0x7fd670135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.138+0000 7fd676cbc640 1 --2- 172.21.15.19:0/1527635852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670072320 0x7fd670135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.138+0000 7fd676cbc640 1 -- 172.21.15.19:0/1527635852 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6700b4530 con 0x7fd670072de0 2024-09-12T01:58:17.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.138+0000 7fd676cbc640 1 --2- 172.21.15.19:0/1527635852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd670072de0 0x7fd6701e7660 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd66800e930 tx=0x7fd66800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:17.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.138+0000 7fd66effd640 1 -- 172.21.15.19:0/1527635852 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd668017070 con 0x7fd670072de0 2024-09-12T01:58:17.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.138+0000 7fd67871f640 1 -- 172.21.15.19:0/1527635852 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6700b4810 con 0x7fd670072de0 2024-09-12T01:58:17.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.138+0000 7fd66effd640 1 -- 172.21.15.19:0/1527635852 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd66800ca00 con 0x7fd670072de0 2024-09-12T01:58:17.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.138+0000 7fd66effd640 1 -- 172.21.15.19:0/1527635852 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66800cdf0 con 0x7fd670072de0 2024-09-12T01:58:17.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.138+0000 7fd67871f640 1 -- 172.21.15.19:0/1527635852 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6700b4dd0 con 0x7fd670072de0 2024-09-12T01:58:17.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.139+0000 7fd67871f640 1 -- 172.21.15.19:0/1527635852 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd67015e370 con 0x7fd670072de0 2024-09-12T01:58:17.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.140+0000 7fd66effd640 1 -- 172.21.15.19:0/1527635852 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd66801a070 con 0x7fd670072de0 2024-09-12T01:58:17.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.140+0000 7fd66effd640 1 --2- 172.21.15.19:0/1527635852 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd65c06be30 0x7fd65c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.141+0000 7fd66effd640 1 -- 172.21.15.19:0/1527635852 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7fd66808b2e0 con 0x7fd670072de0 2024-09-12T01:58:17.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.141+0000 7fd6764bb640 1 --2- 172.21.15.19:0/1527635852 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd65c06be30 0x7fd65c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.141+0000 7fd6764bb640 1 --2- 172.21.15.19:0/1527635852 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd65c06be30 0x7fd65c06e2f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd6600012e0 tx=0x7fd660001a30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:17.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.145+0000 7fd66effd640 1 -- 172.21.15.19:0/1527635852 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd6680593e0 con 0x7fd670072de0 2024-09-12T01:58:17.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.356+0000 7fd67871f640 1 -- 172.21.15.19:0/1527635852 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd67006ec60 con 0x7fd670072de0 2024-09-12T01:58:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.356+0000 7fd66effd640 1 -- 172.21.15.19:0/1527635852 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+5223 (secure 0 0 0) 0x7fd66805d6e0 con 0x7fd670072de0 2024-09-12T01:58:17.357 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:17.357 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":33,"btime":"2024-09-12T01:58:16:837717+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/4076449352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4076449352},{"type":"v1","addr":"172.21.15.135:6836","nonce":4076449352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1361756714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1361756714},{"type":"v1","addr":"172.21.15.135:6837","nonce":1361756714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3926640523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3926640523},{"type":"v1","addr":"172.21.15.19:6833","nonce":3926640523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:57:54.505612+0000","modified":"2024-09-12T01:58:15.839578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5676":{"gid":5676,"name":"a","rank":0,"incarnation":31,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.19:6835/3491125255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":3491125255},{"type":"v1","addr":"172.21.15.19:6835","nonce":3491125255}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-09-12T01:58:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 33 2024-09-12T01:58:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.358+0000 7fd67871f640 1 -- 172.21.15.19:0/1527635852 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd65c06be30 msgr2=0x7fd65c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.358+0000 7fd67871f640 1 --2- 172.21.15.19:0/1527635852 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd65c06be30 0x7fd65c06e2f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd6600012e0 tx=0x7fd660001a30 comp rx=0 tx=0).stop 2024-09-12T01:58:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.358+0000 7fd67871f640 1 -- 172.21.15.19:0/1527635852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd670072de0 msgr2=0x7fd6701e7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.358+0000 7fd67871f640 1 --2- 172.21.15.19:0/1527635852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd670072de0 0x7fd6701e7660 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd66800e930 tx=0x7fd66800edf0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.358+0000 7fd67871f640 1 -- 172.21.15.19:0/1527635852 shutdown_connections 2024-09-12T01:58:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.358+0000 7fd67871f640 1 --2- 172.21.15.19:0/1527635852 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd65c06be30 0x7fd65c06e2f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.358+0000 7fd67871f640 1 --2- 172.21.15.19:0/1527635852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd670072de0 0x7fd6701e7660 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.358+0000 7fd67871f640 1 --2- 172.21.15.19:0/1527635852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd670072700 0x7fd670144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.358+0000 7fd67871f640 1 --2- 172.21.15.19:0/1527635852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670072320 0x7fd670135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.359+0000 7fd67871f640 1 -- 172.21.15.19:0/1527635852 >> 172.21.15.19:0/1527635852 conn(0x7fd670067d70 msgr2=0x7fd67006e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.359+0000 7fd67871f640 1 -- 172.21.15.19:0/1527635852 shutdown_connections 2024-09-12T01:58:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.359+0000 7fd67871f640 1 -- 172.21.15.19:0/1527635852 wait complete. 2024-09-12T01:58:17.370 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:58:17.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.472+0000 7fe82dc96640 1 Processor -- start 2024-09-12T01:58:17.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.472+0000 7fe82dc96640 1 -- start start 2024-09-12T01:58:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.472+0000 7fe82dc96640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe828161c80 0x7fe82806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.472+0000 7fe82dc96640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe828162060 0x7fe8280b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.473+0000 7fe82dc96640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe82806e870 con 0x7fe8280b64b0 2024-09-12T01:58:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.473+0000 7fe82dc96640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe82806d9f0 con 0x7fe828162060 2024-09-12T01:58:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.473+0000 7fe82dc96640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe82806dcd0 con 0x7fe828161c80 2024-09-12T01:58:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.473+0000 7fe827fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe8280b64b0 0x7fe828162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58282/0 (socket says 172.21.15.19:58282) 2024-09-12T01:58:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.473+0000 7fe827fff640 1 -- 172.21.15.19:0/3615850824 learned_addr learned my addr 172.21.15.19:0/3615850824 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.473+0000 7fe8277fe640 1 --2- 172.21.15.19:0/3615850824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe828161c80 0x7fe82806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.473+0000 7fe81effd640 1 --2- 172.21.15.19:0/3615850824 >> v2:172.21.15.135:3300/0 conn(0x7fe828162060 0x7fe8280b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.473+0000 7fe826ffd640 1 -- 172.21.15.19:0/3615850824 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3978871740 0 0) 0x7fe820001490 con 0x7fe8280b64b0 2024-09-12T01:58:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.473+0000 7fe826ffd640 1 -- 172.21.15.19:0/3615850824 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe814003520 con 0x7fe8280b64b0 2024-09-12T01:58:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.473+0000 7fe81effd640 1 -- 172.21.15.19:0/3615850824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe828161c80 msgr2=0x7fe82806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.473+0000 7fe81effd640 1 --2- 172.21.15.19:0/3615850824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe828161c80 0x7fe82806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.473+0000 7fe81effd640 1 -- 172.21.15.19:0/3615850824 >> v1:172.21.15.19:6789/0 conn(0x7fe8280b64b0 legacy=0x7fe828162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.473+0000 7fe81effd640 1 -- 172.21.15.19:0/3615850824 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82806dfb0 con 0x7fe828162060 2024-09-12T01:58:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.473+0000 7fe8277fe640 1 --2- 172.21.15.19:0/3615850824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe828161c80 0x7fe82806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.474+0000 7fe81effd640 1 --2- 172.21.15.19:0/3615850824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe828162060 0x7fe8280b5f70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe8100097a0 tx=0x7fe81002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78d5360588483247 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.474+0000 7fe826ffd640 1 -- 172.21.15.19:0/3615850824 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810037070 con 0x7fe828162060 2024-09-12T01:58:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.474+0000 7fe826ffd640 1 -- 172.21.15.19:0/3615850824 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe810032440 con 0x7fe828162060 2024-09-12T01:58:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.474+0000 7fe826ffd640 1 -- 172.21.15.19:0/3615850824 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8100327f0 con 0x7fe828162060 2024-09-12T01:58:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.475+0000 7fe82dc96640 1 -- 172.21.15.19:0/3615850824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe828162060 msgr2=0x7fe8280b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.475+0000 7fe82dc96640 1 --2- 172.21.15.19:0/3615850824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe828162060 0x7fe8280b5f70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe8100097a0 tx=0x7fe81002a180 comp rx=0 tx=0).stop 2024-09-12T01:58:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.475+0000 7fe82dc96640 1 -- 172.21.15.19:0/3615850824 shutdown_connections 2024-09-12T01:58:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.475+0000 7fe82dc96640 1 --2- 172.21.15.19:0/3615850824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe828162060 0x7fe8280b5f70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.475+0000 7fe82dc96640 1 --2- 172.21.15.19:0/3615850824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe828161c80 0x7fe82806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.475+0000 7fe82dc96640 1 -- 172.21.15.19:0/3615850824 >> 172.21.15.19:0/3615850824 conn(0x7fe8280d44f0 msgr2=0x7fe8280d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.475+0000 7fe82dc96640 1 -- 172.21.15.19:0/3615850824 shutdown_connections 2024-09-12T01:58:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.475+0000 7fe82dc96640 1 -- 172.21.15.19:0/3615850824 wait complete. 2024-09-12T01:58:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.476+0000 7fe82dc96640 1 Processor -- start 2024-09-12T01:58:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.476+0000 7fe82dc96640 1 -- start start 2024-09-12T01:58:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.477+0000 7fe82dc96640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8280b64b0 0x7fe8280b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.477+0000 7fe82dc96640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe828161c80 0x7fe8281f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.477+0000 7fe82dc96640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe828162060 0x7fe8280cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.477+0000 7fe82dc96640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe8280d2a10 con 0x7fe828161c80 2024-09-12T01:58:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.477+0000 7fe82dc96640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe8280d2890 con 0x7fe8280b64b0 2024-09-12T01:58:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.477+0000 7fe82dc96640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe8280b6960 con 0x7fe828162060 2024-09-12T01:58:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.477+0000 7fe81effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe828161c80 0x7fe8281f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.477+0000 7fe81effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe828161c80 0x7fe8281f3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52366/0 (socket says 172.21.15.19:52366) 2024-09-12T01:58:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.477+0000 7fe81effd640 1 -- 172.21.15.19:0/2092939951 learned_addr learned my addr 172.21.15.19:0/2092939951 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.477+0000 7fe8277fe640 1 --2- 172.21.15.19:0/2092939951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8280b64b0 0x7fe8280b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.477+0000 7fe827fff640 1 --2- 172.21.15.19:0/2092939951 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe828162060 0x7fe8280cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.477+0000 7fe81effd640 1 -- 172.21.15.19:0/2092939951 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe828162060 msgr2=0x7fe8280cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.477+0000 7fe81effd640 1 --2- 172.21.15.19:0/2092939951 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe828162060 0x7fe8280cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.477+0000 7fe81effd640 1 -- 172.21.15.19:0/2092939951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8280b64b0 msgr2=0x7fe8280b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.477+0000 7fe81effd640 1 --2- 172.21.15.19:0/2092939951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8280b64b0 0x7fe8280b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.477+0000 7fe81effd640 1 -- 172.21.15.19:0/2092939951 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8280b2540 con 0x7fe828161c80 2024-09-12T01:58:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.478+0000 7fe81effd640 1 --2- 172.21.15.19:0/2092939951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe828161c80 0x7fe8281f3d20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe810000c00 tx=0x7fe8100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.478+0000 7fe824ff9640 1 -- 172.21.15.19:0/2092939951 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810037040 con 0x7fe828161c80 2024-09-12T01:58:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.478+0000 7fe824ff9640 1 -- 172.21.15.19:0/2092939951 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe810042070 con 0x7fe828161c80 2024-09-12T01:58:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.478+0000 7fe82dc96640 1 -- 172.21.15.19:0/2092939951 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8280b2820 con 0x7fe828161c80 2024-09-12T01:58:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.478+0000 7fe824ff9640 1 -- 172.21.15.19:0/2092939951 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810032810 con 0x7fe828161c80 2024-09-12T01:58:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.478+0000 7fe82dc96640 1 -- 172.21.15.19:0/2092939951 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8280b2de0 con 0x7fe828161c80 2024-09-12T01:58:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.479+0000 7fe82dc96640 1 -- 172.21.15.19:0/2092939951 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe828068ea0 con 0x7fe828161c80 2024-09-12T01:58:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.479+0000 7fe824ff9640 1 -- 172.21.15.19:0/2092939951 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8100329b0 con 0x7fe828161c80 2024-09-12T01:58:17.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.480+0000 7fe824ff9640 1 --2- 172.21.15.19:0/2092939951 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe80806be30 0x7fe80806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.480+0000 7fe824ff9640 1 -- 172.21.15.19:0/2092939951 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7fe8100ab7c0 con 0x7fe828161c80 2024-09-12T01:58:17.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.480+0000 7fe8277fe640 1 --2- 172.21.15.19:0/2092939951 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe80806be30 0x7fe80806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.480+0000 7fe8277fe640 1 --2- 172.21.15.19:0/2092939951 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe80806be30 0x7fe80806e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe818009560 tx=0x7fe818009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:17.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.484+0000 7fe824ff9640 1 -- 172.21.15.19:0/2092939951 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe81007a140 con 0x7fe828161c80 2024-09-12T01:58:17.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.660+0000 7fe82dc96640 1 -- 172.21.15.19:0/2092939951 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe828160330 con 0x7fe828161c80 2024-09-12T01:58:17.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.661+0000 7fe824ff9640 1 -- 172.21.15.19:0/2092939951 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+17119 (secure 0 0 0) 0x7fe810079a40 con 0x7fe828161c80 2024-09-12T01:58:17.662 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:17.662 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":55,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:58:12.823986+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:57:52.113320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-12T01:57:53.439514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6835/1076479859":"2024-09-13T01:58:12.823966+0000","172.21.15.19:6834/1076479859":"2024-09-13T01:58:12.823966+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:58:17.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.663+0000 7fe82dc96640 1 -- 172.21.15.19:0/2092939951 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe80806be30 msgr2=0x7fe80806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.663+0000 7fe82dc96640 1 --2- 172.21.15.19:0/2092939951 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe80806be30 0x7fe80806e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe818009560 tx=0x7fe818009190 comp rx=0 tx=0).stop 2024-09-12T01:58:17.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.663+0000 7fe82dc96640 1 -- 172.21.15.19:0/2092939951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe828161c80 msgr2=0x7fe8281f3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.663+0000 7fe82dc96640 1 --2- 172.21.15.19:0/2092939951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe828161c80 0x7fe8281f3d20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe810000c00 tx=0x7fe8100046c0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.663+0000 7fe82dc96640 1 -- 172.21.15.19:0/2092939951 shutdown_connections 2024-09-12T01:58:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.663+0000 7fe82dc96640 1 --2- 172.21.15.19:0/2092939951 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe80806be30 0x7fe80806e2f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.663+0000 7fe82dc96640 1 --2- 172.21.15.19:0/2092939951 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe828162060 0x7fe8280cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.663+0000 7fe82dc96640 1 --2- 172.21.15.19:0/2092939951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe828161c80 0x7fe8281f3d20 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.663+0000 7fe82dc96640 1 --2- 172.21.15.19:0/2092939951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8280b64b0 0x7fe8280b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.663+0000 7fe82dc96640 1 -- 172.21.15.19:0/2092939951 >> 172.21.15.19:0/2092939951 conn(0x7fe8280d44f0 msgr2=0x7fe82806ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.664+0000 7fe82dc96640 1 -- 172.21.15.19:0/2092939951 shutdown_connections 2024-09-12T01:58:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.664+0000 7fe82dc96640 1 -- 172.21.15.19:0/2092939951 wait complete. 2024-09-12T01:58:17.676 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T01:58:17.676 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:58:17.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.777+0000 7f63cf568640 1 Processor -- start 2024-09-12T01:58:17.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.777+0000 7f63cf568640 1 -- start start 2024-09-12T01:58:17.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.778+0000 7f63cf568640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63c80d30f0 0x7f63c80b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.778+0000 7f63cf568640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f63c80b64c0 0x7f63c806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.778+0000 7f63cf568640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63c80d3690 con 0x7f63c815e5f0 2024-09-12T01:58:17.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.778+0000 7f63cf568640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f63c806d530 con 0x7f63c80b64c0 2024-09-12T01:58:17.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.778+0000 7f63cf568640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f63c80d3970 con 0x7f63c80d30f0 2024-09-12T01:58:17.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.778+0000 7f63cd304640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f63c815e5f0 0x7f63c80d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58290/0 (socket says 172.21.15.19:58290) 2024-09-12T01:58:17.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.778+0000 7f63cd304640 1 -- 172.21.15.19:0/434339470 learned_addr learned my addr 172.21.15.19:0/434339470 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:17.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.778+0000 7f63cdb05640 1 --2- 172.21.15.19:0/434339470 >> v2:172.21.15.135:3300/0 conn(0x7f63c80b64c0 0x7f63c806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.778+0000 7f63bffff640 1 -- 172.21.15.19:0/434339470 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1756990427 0 0) 0x7f63c80d3690 con 0x7f63c815e5f0 2024-09-12T01:58:17.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.778+0000 7f63ccb03640 1 --2- 172.21.15.19:0/434339470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63c80d30f0 0x7f63c80b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.778+0000 7f63bffff640 1 -- 172.21.15.19:0/434339470 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63b4003520 con 0x7f63c815e5f0 2024-09-12T01:58:17.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.778+0000 7f63bffff640 1 -- 172.21.15.19:0/434339470 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1747840548 0 0) 0x7f63b4003520 con 0x7f63c815e5f0 2024-09-12T01:58:17.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63bffff640 1 -- 172.21.15.19:0/434339470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63c80d30f0 msgr2=0x7f63c80b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:17.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63bffff640 1 --2- 172.21.15.19:0/434339470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63c80d30f0 0x7f63c80b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63bffff640 1 -- 172.21.15.19:0/434339470 >> v2:172.21.15.135:3300/0 conn(0x7f63c80b64c0 msgr2=0x7f63c806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:17.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63bffff640 1 --2- 172.21.15.19:0/434339470 >> v2:172.21.15.135:3300/0 conn(0x7f63c80b64c0 0x7f63c806d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63bffff640 1 -- 172.21.15.19:0/434339470 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c806cee0 con 0x7f63c815e5f0 2024-09-12T01:58:17.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63bffff640 1 -- 172.21.15.19:0/434339470 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f63c4001670 con 0x7f63c815e5f0 2024-09-12T01:58:17.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63bffff640 1 -- 172.21.15.19:0/434339470 >> v1:172.21.15.19:6789/0 conn(0x7f63c815e5f0 legacy=0x7f63c80d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63bffff640 1 --2- 172.21.15.19:0/434339470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63c80d30f0 0x7f63b40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63bffff640 1 --2- 172.21.15.19:0/434339470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63b4003f30 0x7f63b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63bffff640 1 --2- 172.21.15.19:0/434339470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63b4004d40 0x7f63b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63bffff640 1 -- 172.21.15.19:0/434339470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f63c806d530 con 0x7f63b4004d40 2024-09-12T01:58:17.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63bffff640 1 -- 172.21.15.19:0/434339470 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f63c80d3970 con 0x7f63b4003f30 2024-09-12T01:58:17.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63bffff640 1 -- 172.21.15.19:0/434339470 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f63b400b9c0 con 0x7f63c80d30f0 2024-09-12T01:58:17.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63cdb05640 1 --2- 172.21.15.19:0/434339470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63b4004d40 0x7f63b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63cd304640 1 --2- 172.21.15.19:0/434339470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63c80d30f0 0x7f63b40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63ccb03640 1 --2- 172.21.15.19:0/434339470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63b4003f30 0x7f63b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63cdb05640 1 -- 172.21.15.19:0/434339470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63c80d30f0 msgr2=0x7f63b40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:17.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63cdb05640 1 --2- 172.21.15.19:0/434339470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63c80d30f0 0x7f63b40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63cdb05640 1 -- 172.21.15.19:0/434339470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63b4003f30 msgr2=0x7f63b4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:17.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63cdb05640 1 --2- 172.21.15.19:0/434339470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63b4003f30 0x7f63b4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63cdb05640 1 -- 172.21.15.19:0/434339470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b4003520 con 0x7f63b4004d40 2024-09-12T01:58:17.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.779+0000 7f63ccb03640 1 --2- 172.21.15.19:0/434339470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63b4003f30 0x7f63b4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:17.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.780+0000 7f63cdb05640 1 --2- 172.21.15.19:0/434339470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63b4004d40 0x7f63b40051c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009fc0 tx=0x7f63b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d56a474d134cf29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:17.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.780+0000 7f63bffff640 1 -- 172.21.15.19:0/434339470 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c0009c10 con 0x7f63b4004d40 2024-09-12T01:58:17.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.780+0000 7f63bffff640 1 -- 172.21.15.19:0/434339470 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c0036070 con 0x7f63b4004d40 2024-09-12T01:58:17.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.780+0000 7f63bffff640 1 -- 172.21.15.19:0/434339470 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c002d070 con 0x7f63b4004d40 2024-09-12T01:58:17.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.780+0000 7f63cf568640 1 -- 172.21.15.19:0/434339470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63b4004d40 msgr2=0x7f63b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.780+0000 7f63cf568640 1 --2- 172.21.15.19:0/434339470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63b4004d40 0x7f63b40051c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009fc0 tx=0x7f63b4005830 comp rx=0 tx=0).stop 2024-09-12T01:58:17.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.780+0000 7f63cdb05640 1 -- 172.21.15.19:0/434339470 reap_dead start 2024-09-12T01:58:17.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.780+0000 7f63cf568640 1 -- 172.21.15.19:0/434339470 shutdown_connections 2024-09-12T01:58:17.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.780+0000 7f63cf568640 1 -- 172.21.15.19:0/434339470 >> 172.21.15.19:0/434339470 conn(0x7f63c808bfc0 msgr2=0x7f63c80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:17.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.781+0000 7f63cf568640 1 -- 172.21.15.19:0/434339470 shutdown_connections 2024-09-12T01:58:17.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.781+0000 7f63cf568640 1 -- 172.21.15.19:0/434339470 wait complete. 2024-09-12T01:58:17.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.782+0000 7f63cf568640 1 Processor -- start 2024-09-12T01:58:17.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.782+0000 7f63cf568640 1 -- start start 2024-09-12T01:58:17.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63cf568640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63b4004d40 0x7f63c815eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63cf568640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63c8153a20 0x7f63c80c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63cf568640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63c806e180 0x7f63c806e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63cf568640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f63c80b5f80 con 0x7f63c8153a20 2024-09-12T01:58:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63cf568640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f63c815e9d0 con 0x7f63c806e180 2024-09-12T01:58:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63cf568640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f63c80b6100 con 0x7f63b4004d40 2024-09-12T01:58:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63ccb03640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63c8153a20 0x7f63c80c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63ccb03640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63c8153a20 0x7f63c80c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52380/0 (socket says 172.21.15.19:52380) 2024-09-12T01:58:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63ccb03640 1 -- 172.21.15.19:0/844698435 learned_addr learned my addr 172.21.15.19:0/844698435 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63cdb05640 1 --2- 172.21.15.19:0/844698435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63c806e180 0x7f63c806e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63cd304640 1 --2- 172.21.15.19:0/844698435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63b4004d40 0x7f63c815eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63ccb03640 1 -- 172.21.15.19:0/844698435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63b4004d40 msgr2=0x7f63c815eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63ccb03640 1 --2- 172.21.15.19:0/844698435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63b4004d40 0x7f63c815eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63ccb03640 1 -- 172.21.15.19:0/844698435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63c806e180 msgr2=0x7f63c806e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63ccb03640 1 --2- 172.21.15.19:0/844698435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63c806e180 0x7f63c806e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63ccb03640 1 -- 172.21.15.19:0/844698435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c8153ea0 con 0x7f63c8153a20 2024-09-12T01:58:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63ccb03640 1 --2- 172.21.15.19:0/844698435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63c8153a20 0x7f63c80c9a90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f63b8011540 tx=0x7f63b8011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63bdffb640 1 -- 172.21.15.19:0/844698435 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b8015870 con 0x7f63c8153a20 2024-09-12T01:58:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63bdffb640 1 -- 172.21.15.19:0/844698435 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63b8015a10 con 0x7f63c8153a20 2024-09-12T01:58:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63cf568640 1 -- 172.21.15.19:0/844698435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63c815f130 con 0x7f63c8153a20 2024-09-12T01:58:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.783+0000 7f63bdffb640 1 -- 172.21.15.19:0/844698435 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b8015dc0 con 0x7f63c8153a20 2024-09-12T01:58:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.784+0000 7f63cf568640 1 -- 172.21.15.19:0/844698435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63c815f6f0 con 0x7f63c8153a20 2024-09-12T01:58:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.785+0000 7f63cf568640 1 -- 172.21.15.19:0/844698435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63c80d3690 con 0x7f63c8153a20 2024-09-12T01:58:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.785+0000 7f63bdffb640 1 -- 172.21.15.19:0/844698435 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f63b8013400 con 0x7f63c8153a20 2024-09-12T01:58:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.785+0000 7f63bdffb640 1 --2- 172.21.15.19:0/844698435 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f63ac06be60 0x7f63ac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.786+0000 7f63bdffb640 1 -- 172.21.15.19:0/844698435 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7f63b808b750 con 0x7f63c8153a20 2024-09-12T01:58:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.786+0000 7f63cd304640 1 --2- 172.21.15.19:0/844698435 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f63ac06be60 0x7f63ac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:17.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.786+0000 7f63cd304640 1 --2- 172.21.15.19:0/844698435 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f63ac06be60 0x7f63ac06e320 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f63c4007df0 tx=0x7f63c40078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:17.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:17.790+0000 7f63bdffb640 1 -- 172.21.15.19:0/844698435 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f63b8019030 con 0x7f63c8153a20 2024-09-12T01:58:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.001+0000 7f63cf568640 1 -- 172.21.15.19:0/844698435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63c80b1490 con 0x7f63c8153a20 2024-09-12T01:58:18.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.002+0000 7f63bdffb640 1 -- 172.21.15.19:0/844698435 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5230 (secure 0 0 0) 0x7f63b8059830 con 0x7f63c8153a20 2024-09-12T01:58:18.002 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:18.002 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":34,"btime":"2024-09-12T01:58:17:842367+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/4076449352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4076449352},{"type":"v1","addr":"172.21.15.135:6836","nonce":4076449352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1361756714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1361756714},{"type":"v1","addr":"172.21.15.135:6837","nonce":1361756714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3926640523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3926640523},{"type":"v1","addr":"172.21.15.19:6833","nonce":3926640523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:57:54.505612+0000","modified":"2024-09-12T01:58:17.842361+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5676":{"gid":5676,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/3491125255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":3491125255},{"type":"v1","addr":"172.21.15.19:6835","nonce":3491125255}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5676,"qdb_cluster":[5676]},"id":3}]} 2024-09-12T01:58:18.002 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 34 2024-09-12T01:58:18.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.004+0000 7f63cf568640 1 -- 172.21.15.19:0/844698435 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f63ac06be60 msgr2=0x7f63ac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.004+0000 7f63cf568640 1 --2- 172.21.15.19:0/844698435 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f63ac06be60 0x7f63ac06e320 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f63c4007df0 tx=0x7f63c40078f0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.004+0000 7f63cf568640 1 -- 172.21.15.19:0/844698435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63c8153a20 msgr2=0x7f63c80c9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.004+0000 7f63cf568640 1 --2- 172.21.15.19:0/844698435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63c8153a20 0x7f63c80c9a90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f63b8011540 tx=0x7f63b8011a00 comp rx=0 tx=0).stop 2024-09-12T01:58:18.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.004+0000 7f63cf568640 1 -- 172.21.15.19:0/844698435 shutdown_connections 2024-09-12T01:58:18.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.004+0000 7f63cf568640 1 --2- 172.21.15.19:0/844698435 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f63ac06be60 0x7f63ac06e320 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.004+0000 7f63cf568640 1 --2- 172.21.15.19:0/844698435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63c806e180 0x7f63c806e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.004+0000 7f63cf568640 1 --2- 172.21.15.19:0/844698435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63c8153a20 0x7f63c80c9a90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.004+0000 7f63cf568640 1 --2- 172.21.15.19:0/844698435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63b4004d40 0x7f63c815eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.004+0000 7f63cf568640 1 -- 172.21.15.19:0/844698435 >> 172.21.15.19:0/844698435 conn(0x7f63c808bfc0 msgr2=0x7f63c80cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:18.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.004+0000 7f63cf568640 1 -- 172.21.15.19:0/844698435 shutdown_connections 2024-09-12T01:58:18.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.004+0000 7f63cf568640 1 -- 172.21.15.19:0/844698435 wait complete. 2024-09-12T01:58:18.015 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:58:18.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.119+0000 7fa945b9a640 1 Processor -- start 2024-09-12T01:58:18.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.119+0000 7fa945b9a640 1 -- start start 2024-09-12T01:58:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.120+0000 7fa945b9a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa940162060 0x7fa9400b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.120+0000 7fa945b9a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa9400b64b0 0x7fa9400b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.120+0000 7fa945b9a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa94006d9f0 con 0x7fa940161c80 2024-09-12T01:58:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.120+0000 7fa945b9a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa94006dcd0 con 0x7fa9400b64b0 2024-09-12T01:58:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.120+0000 7fa945b9a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa94006dfb0 con 0x7fa940162060 2024-09-12T01:58:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.120+0000 7fa93ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa9400b64b0 0x7fa9400b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.120+0000 7fa93ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa9400b64b0 0x7fa9400b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52386/0 (socket says 172.21.15.19:52386) 2024-09-12T01:58:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.120+0000 7fa93ffff640 1 -- 172.21.15.19:0/1415423307 learned_addr learned my addr 172.21.15.19:0/1415423307 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.120+0000 7fa937fff640 1 --2- 172.21.15.19:0/1415423307 >> v2:172.21.15.135:3300/0 conn(0x7fa940162060 0x7fa9400b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.120+0000 7fa93ffff640 1 -- 172.21.15.19:0/1415423307 >> v2:172.21.15.135:3300/0 conn(0x7fa940162060 msgr2=0x7fa9400b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.120+0000 7fa93ffff640 1 --2- 172.21.15.19:0/1415423307 >> v2:172.21.15.135:3300/0 conn(0x7fa940162060 0x7fa9400b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.120+0000 7fa93ffff640 1 -- 172.21.15.19:0/1415423307 >> v1:172.21.15.135:6789/0 conn(0x7fa940161c80 legacy=0x7fa94006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.120+0000 7fa93ffff640 1 -- 172.21.15.19:0/1415423307 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9400d01f0 con 0x7fa9400b64b0 2024-09-12T01:58:18.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.121+0000 7fa93ffff640 1 --2- 172.21.15.19:0/1415423307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9400b64b0 0x7fa9400b6960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa94008e830 tx=0x7fa93802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e107afd7fcaaa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:18.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.121+0000 7fa93effd640 1 -- 172.21.15.19:0/1415423307 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa938036070 con 0x7fa9400b64b0 2024-09-12T01:58:18.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.121+0000 7fa93effd640 1 -- 172.21.15.19:0/1415423307 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa938031600 con 0x7fa9400b64b0 2024-09-12T01:58:18.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.121+0000 7fa93effd640 1 -- 172.21.15.19:0/1415423307 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9380319d0 con 0x7fa9400b64b0 2024-09-12T01:58:18.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.122+0000 7fa945b9a640 1 -- 172.21.15.19:0/1415423307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9400b64b0 msgr2=0x7fa9400b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.122+0000 7fa945b9a640 1 --2- 172.21.15.19:0/1415423307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9400b64b0 0x7fa9400b6960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa94008e830 tx=0x7fa93802a730 comp rx=0 tx=0).stop 2024-09-12T01:58:18.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.122+0000 7fa945b9a640 1 -- 172.21.15.19:0/1415423307 shutdown_connections 2024-09-12T01:58:18.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.122+0000 7fa945b9a640 1 --2- 172.21.15.19:0/1415423307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9400b64b0 0x7fa9400b6960 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.122+0000 7fa945b9a640 1 --2- 172.21.15.19:0/1415423307 >> v2:172.21.15.135:3300/0 conn(0x7fa940162060 0x7fa9400b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.122+0000 7fa945b9a640 1 -- 172.21.15.19:0/1415423307 >> 172.21.15.19:0/1415423307 conn(0x7fa9400d44f0 msgr2=0x7fa9400d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:18.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.122+0000 7fa945b9a640 1 -- 172.21.15.19:0/1415423307 shutdown_connections 2024-09-12T01:58:18.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.122+0000 7fa945b9a640 1 -- 172.21.15.19:0/1415423307 wait complete. 2024-09-12T01:58:18.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.123+0000 7fa945b9a640 1 Processor -- start 2024-09-12T01:58:18.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.123+0000 7fa945b9a640 1 -- start start 2024-09-12T01:58:18.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.124+0000 7fa945b9a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9400b64b0 0x7fa9400b7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.124+0000 7fa945b9a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa940161c80 0x7fa94015ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.124+0000 7fa945b9a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa940162060 0x7fa94015ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.124+0000 7fa945b9a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa9400cf1e0 con 0x7fa940161c80 2024-09-12T01:58:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.124+0000 7fa945b9a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa9400d2aa0 con 0x7fa940162060 2024-09-12T01:58:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.124+0000 7fa945b9a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa9400cf360 con 0x7fa9400b64b0 2024-09-12T01:58:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.124+0000 7fa937fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa940161c80 0x7fa94015ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.124+0000 7fa937fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa940161c80 0x7fa94015ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52398/0 (socket says 172.21.15.19:52398) 2024-09-12T01:58:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.124+0000 7fa937fff640 1 -- 172.21.15.19:0/2898286720 learned_addr learned my addr 172.21.15.19:0/2898286720 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.124+0000 7fa93f7fe640 1 --2- 172.21.15.19:0/2898286720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9400b64b0 0x7fa9400b7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.124+0000 7fa93ffff640 1 --2- 172.21.15.19:0/2898286720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa940162060 0x7fa94015ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.125+0000 7fa937fff640 1 -- 172.21.15.19:0/2898286720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9400b64b0 msgr2=0x7fa9400b7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.125+0000 7fa937fff640 1 --2- 172.21.15.19:0/2898286720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9400b64b0 0x7fa9400b7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.125+0000 7fa937fff640 1 -- 172.21.15.19:0/2898286720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa940162060 msgr2=0x7fa94015ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.125+0000 7fa937fff640 1 --2- 172.21.15.19:0/2898286720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa940162060 0x7fa94015ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.125+0000 7fa937fff640 1 -- 172.21.15.19:0/2898286720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9400b87a0 con 0x7fa940161c80 2024-09-12T01:58:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.125+0000 7fa937fff640 1 --2- 172.21.15.19:0/2898286720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa940161c80 0x7fa94015ea20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa92800e840 tx=0x7fa92800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:18.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.125+0000 7fa93cff9640 1 -- 172.21.15.19:0/2898286720 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa928017070 con 0x7fa940161c80 2024-09-12T01:58:18.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.125+0000 7fa93cff9640 1 -- 172.21.15.19:0/2898286720 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa92800c940 con 0x7fa940161c80 2024-09-12T01:58:18.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.125+0000 7fa945b9a640 1 -- 172.21.15.19:0/2898286720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9400b8a80 con 0x7fa940161c80 2024-09-12T01:58:18.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.125+0000 7fa93cff9640 1 -- 172.21.15.19:0/2898286720 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92800cd10 con 0x7fa940161c80 2024-09-12T01:58:18.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.125+0000 7fa945b9a640 1 -- 172.21.15.19:0/2898286720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9400b9040 con 0x7fa940161c80 2024-09-12T01:58:18.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.126+0000 7fa945b9a640 1 -- 172.21.15.19:0/2898286720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9400b5f70 con 0x7fa940161c80 2024-09-12T01:58:18.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.126+0000 7fa93cff9640 1 -- 172.21.15.19:0/2898286720 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa92801a070 con 0x7fa940161c80 2024-09-12T01:58:18.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.127+0000 7fa93cff9640 1 --2- 172.21.15.19:0/2898286720 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa92006be30 0x7fa92006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.127+0000 7fa93cff9640 1 -- 172.21.15.19:0/2898286720 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7fa92808b120 con 0x7fa940161c80 2024-09-12T01:58:18.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.127+0000 7fa93f7fe640 1 --2- 172.21.15.19:0/2898286720 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa92006be30 0x7fa92006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.128+0000 7fa93f7fe640 1 --2- 172.21.15.19:0/2898286720 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa92006be30 0x7fa92006e2f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa940161650 tx=0x7fa930009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:18.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.131+0000 7fa93cff9640 1 -- 172.21.15.19:0/2898286720 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa928059330 con 0x7fa940161c80 2024-09-12T01:58:18.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.343+0000 7fa945b9a640 1 -- 172.21.15.19:0/2898286720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9400ba470 con 0x7fa940161c80 2024-09-12T01:58:18.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.343+0000 7fa93cff9640 1 -- 172.21.15.19:0/2898286720 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5230 (secure 0 0 0) 0x7fa92805d630 con 0x7fa940161c80 2024-09-12T01:58:18.343 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:18.344 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":34,"btime":"2024-09-12T01:58:17:842367+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/4076449352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4076449352},{"type":"v1","addr":"172.21.15.135:6836","nonce":4076449352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1361756714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1361756714},{"type":"v1","addr":"172.21.15.135:6837","nonce":1361756714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3926640523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3926640523},{"type":"v1","addr":"172.21.15.19:6833","nonce":3926640523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:57:54.505612+0000","modified":"2024-09-12T01:58:17.842361+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5676":{"gid":5676,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/3491125255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":3491125255},{"type":"v1","addr":"172.21.15.19:6835","nonce":3491125255}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5676,"qdb_cluster":[5676]},"id":3}]} 2024-09-12T01:58:18.344 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 34 2024-09-12T01:58:18.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.345+0000 7fa945b9a640 1 -- 172.21.15.19:0/2898286720 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa92006be30 msgr2=0x7fa92006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.345+0000 7fa945b9a640 1 --2- 172.21.15.19:0/2898286720 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa92006be30 0x7fa92006e2f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa940161650 tx=0x7fa930009040 comp rx=0 tx=0).stop 2024-09-12T01:58:18.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.345+0000 7fa945b9a640 1 -- 172.21.15.19:0/2898286720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa940161c80 msgr2=0x7fa94015ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.345+0000 7fa945b9a640 1 --2- 172.21.15.19:0/2898286720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa940161c80 0x7fa94015ea20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa92800e840 tx=0x7fa92800ed00 comp rx=0 tx=0).stop 2024-09-12T01:58:18.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.345+0000 7fa945b9a640 1 -- 172.21.15.19:0/2898286720 shutdown_connections 2024-09-12T01:58:18.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.345+0000 7fa945b9a640 1 --2- 172.21.15.19:0/2898286720 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa92006be30 0x7fa92006e2f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.345+0000 7fa945b9a640 1 --2- 172.21.15.19:0/2898286720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa940162060 0x7fa94015ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.345+0000 7fa945b9a640 1 --2- 172.21.15.19:0/2898286720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa940161c80 0x7fa94015ea20 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.345+0000 7fa945b9a640 1 --2- 172.21.15.19:0/2898286720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9400b64b0 0x7fa9400b7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.345+0000 7fa945b9a640 1 -- 172.21.15.19:0/2898286720 >> 172.21.15.19:0/2898286720 conn(0x7fa9400d44f0 msgr2=0x7fa9400d3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:18.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.345+0000 7fa945b9a640 1 -- 172.21.15.19:0/2898286720 shutdown_connections 2024-09-12T01:58:18.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.345+0000 7fa945b9a640 1 -- 172.21.15.19:0/2898286720 wait complete. 2024-09-12T01:58:18.357 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:58:18.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.459+0000 7fac34d31640 1 Processor -- start 2024-09-12T01:58:18.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.459+0000 7fac34d31640 1 -- start start 2024-09-12T01:58:18.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.460+0000 7fac34d31640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac3015e760 0x7fac3006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.460+0000 7fac34d31640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fac300d4fd0 0x7fac300cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.460+0000 7fac34d31640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac300d2700 con 0x7fac300b3650 2024-09-12T01:58:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.460+0000 7fac34d31640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fac300cedb0 con 0x7fac3015e760 2024-09-12T01:58:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.460+0000 7fac34d31640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fac300cf090 con 0x7fac300d4fd0 2024-09-12T01:58:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.460+0000 7fac2e59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac3015e760 0x7fac3006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.460+0000 7fac2ed9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fac300b3650 0x7fac300d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58300/0 (socket says 172.21.15.19:58300) 2024-09-12T01:58:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.460+0000 7fac2ed9d640 1 -- 172.21.15.19:0/1580705282 learned_addr learned my addr 172.21.15.19:0/1580705282 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.460+0000 7fac2dd9b640 1 --2- 172.21.15.19:0/1580705282 >> v2:172.21.15.135:3300/0 conn(0x7fac300d4fd0 0x7fac300cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.460+0000 7fac2e59c640 1 -- 172.21.15.19:0/1580705282 >> v2:172.21.15.135:3300/0 conn(0x7fac300d4fd0 msgr2=0x7fac300cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.460+0000 7fac2e59c640 1 --2- 172.21.15.19:0/1580705282 >> v2:172.21.15.135:3300/0 conn(0x7fac300d4fd0 0x7fac300cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.460+0000 7fac2e59c640 1 -- 172.21.15.19:0/1580705282 >> v1:172.21.15.19:6789/0 conn(0x7fac300b3650 legacy=0x7fac300d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.460+0000 7fac2e59c640 1 -- 172.21.15.19:0/1580705282 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac300b3c80 con 0x7fac3015e760 2024-09-12T01:58:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.460+0000 7fac2d59a640 1 -- 172.21.15.19:0/1580705282 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2945651769 0 0) 0x7fac28001490 con 0x7fac300b3650 2024-09-12T01:58:18.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.461+0000 7fac2e59c640 1 --2- 172.21.15.19:0/1580705282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac3015e760 0x7fac3006cdd0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fac3008ca80 tx=0x7fac2002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf56d8295fc20a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:18.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.461+0000 7fac2d59a640 1 -- 172.21.15.19:0/1580705282 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20037070 con 0x7fac3015e760 2024-09-12T01:58:18.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.461+0000 7fac2d59a640 1 -- 172.21.15.19:0/1580705282 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac20032440 con 0x7fac3015e760 2024-09-12T01:58:18.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.461+0000 7fac2d59a640 1 -- 172.21.15.19:0/1580705282 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2002ae60 con 0x7fac3015e760 2024-09-12T01:58:18.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.461+0000 7fac34d31640 1 -- 172.21.15.19:0/1580705282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac3015e760 msgr2=0x7fac3006cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.461+0000 7fac34d31640 1 --2- 172.21.15.19:0/1580705282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac3015e760 0x7fac3006cdd0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fac3008ca80 tx=0x7fac2002a110 comp rx=0 tx=0).stop 2024-09-12T01:58:18.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.462+0000 7fac34d31640 1 -- 172.21.15.19:0/1580705282 shutdown_connections 2024-09-12T01:58:18.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.462+0000 7fac34d31640 1 --2- 172.21.15.19:0/1580705282 >> v2:172.21.15.135:3300/0 conn(0x7fac300d4fd0 0x7fac300cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.462+0000 7fac34d31640 1 --2- 172.21.15.19:0/1580705282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac3015e760 0x7fac3006cdd0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.462+0000 7fac34d31640 1 -- 172.21.15.19:0/1580705282 >> 172.21.15.19:0/1580705282 conn(0x7fac3008bfc0 msgr2=0x7fac300d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:18.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.462+0000 7fac34d31640 1 -- 172.21.15.19:0/1580705282 shutdown_connections 2024-09-12T01:58:18.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.462+0000 7fac34d31640 1 -- 172.21.15.19:0/1580705282 wait complete. 2024-09-12T01:58:18.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.463+0000 7fac34d31640 1 Processor -- start 2024-09-12T01:58:18.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.463+0000 7fac34d31640 1 -- start start 2024-09-12T01:58:18.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac34d31640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac300b3650 0x7fac30155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac34d31640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac300d4fd0 0x7fac301f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac34d31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac3015e760 0x7fac300cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac34d31640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fac300cff00 con 0x7fac3015e760 2024-09-12T01:58:18.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac34d31640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fac300cfd80 con 0x7fac300d4fd0 2024-09-12T01:58:18.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac34d31640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fac300d35b0 con 0x7fac300b3650 2024-09-12T01:58:18.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac2ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac3015e760 0x7fac300cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac2ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac3015e760 0x7fac300cd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52408/0 (socket says 172.21.15.19:52408) 2024-09-12T01:58:18.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac2ed9d640 1 -- 172.21.15.19:0/1989195910 learned_addr learned my addr 172.21.15.19:0/1989195910 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:18.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac2dd9b640 1 --2- 172.21.15.19:0/1989195910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac300d4fd0 0x7fac301f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac2e59c640 1 --2- 172.21.15.19:0/1989195910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac300b3650 0x7fac30155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac2ed9d640 1 -- 172.21.15.19:0/1989195910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac300b3650 msgr2=0x7fac30155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac2ed9d640 1 --2- 172.21.15.19:0/1989195910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac300b3650 0x7fac30155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac2ed9d640 1 -- 172.21.15.19:0/1989195910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac300d4fd0 msgr2=0x7fac301f5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac2ed9d640 1 --2- 172.21.15.19:0/1989195910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac300d4fd0 0x7fac301f5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac2ed9d640 1 -- 172.21.15.19:0/1989195910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac30156360 con 0x7fac3015e760 2024-09-12T01:58:18.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac2dd9b640 1 --2- 172.21.15.19:0/1989195910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac300d4fd0 0x7fac301f5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:18.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac2e59c640 1 --2- 172.21.15.19:0/1989195910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac300b3650 0x7fac30155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:18.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.464+0000 7fac2ed9d640 1 --2- 172.21.15.19:0/1989195910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac3015e760 0x7fac300cd8f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fac2800c6e0 tx=0x7fac2800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:18.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.465+0000 7fac1effd640 1 -- 172.21.15.19:0/1989195910 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac28018070 con 0x7fac3015e760 2024-09-12T01:58:18.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.465+0000 7fac1effd640 1 -- 172.21.15.19:0/1989195910 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac28004d80 con 0x7fac3015e760 2024-09-12T01:58:18.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.465+0000 7fac1effd640 1 -- 172.21.15.19:0/1989195910 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2800a880 con 0x7fac3015e760 2024-09-12T01:58:18.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.465+0000 7fac34d31640 1 -- 172.21.15.19:0/1989195910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac300cb620 con 0x7fac3015e760 2024-09-12T01:58:18.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.465+0000 7fac34d31640 1 -- 172.21.15.19:0/1989195910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac300cbe80 con 0x7fac3015e760 2024-09-12T01:58:18.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.466+0000 7fac34d31640 1 -- 172.21.15.19:0/1989195910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac300d3880 con 0x7fac3015e760 2024-09-12T01:58:18.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.466+0000 7fac1effd640 1 -- 172.21.15.19:0/1989195910 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac2801b070 con 0x7fac3015e760 2024-09-12T01:58:18.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.467+0000 7fac1effd640 1 --2- 172.21.15.19:0/1989195910 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac1006be30 0x7fac1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.467+0000 7fac1effd640 1 -- 172.21.15.19:0/1989195910 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7fac2808a590 con 0x7fac3015e760 2024-09-12T01:58:18.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.467+0000 7fac2e59c640 1 --2- 172.21.15.19:0/1989195910 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac1006be30 0x7fac1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.467+0000 7fac2e59c640 1 --2- 172.21.15.19:0/1989195910 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac1006be30 0x7fac1006e2f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fac20034000 tx=0x7fac2002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:18.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.471+0000 7fac1effd640 1 -- 172.21.15.19:0/1989195910 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac300d2700 con 0x7fac3015e760 2024-09-12T01:58:18.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.649+0000 7fac34d31640 1 -- 172.21.15.19:0/1989195910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac301f62c0 con 0x7fac3015e760 2024-09-12T01:58:18.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.651+0000 7fac1effd640 1 -- 172.21.15.19:0/1989195910 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+17119 (secure 0 0 0) 0x7fac28058d60 con 0x7fac3015e760 2024-09-12T01:58:18.651 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:18.651 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":55,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:58:12.823986+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:57:52.113320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-12T01:57:53.439514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6835/1076479859":"2024-09-13T01:58:12.823966+0000","172.21.15.19:6834/1076479859":"2024-09-13T01:58:12.823966+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:58:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.653+0000 7fac34d31640 1 -- 172.21.15.19:0/1989195910 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac1006be30 msgr2=0x7fac1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.653+0000 7fac34d31640 1 --2- 172.21.15.19:0/1989195910 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac1006be30 0x7fac1006e2f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fac20034000 tx=0x7fac2002e000 comp rx=0 tx=0).stop 2024-09-12T01:58:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.653+0000 7fac34d31640 1 -- 172.21.15.19:0/1989195910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac3015e760 msgr2=0x7fac300cd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.653+0000 7fac34d31640 1 --2- 172.21.15.19:0/1989195910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac3015e760 0x7fac300cd8f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fac2800c6e0 tx=0x7fac2800cba0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.653+0000 7fac34d31640 1 -- 172.21.15.19:0/1989195910 shutdown_connections 2024-09-12T01:58:18.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.653+0000 7fac34d31640 1 --2- 172.21.15.19:0/1989195910 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac1006be30 0x7fac1006e2f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.653+0000 7fac34d31640 1 --2- 172.21.15.19:0/1989195910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac3015e760 0x7fac300cd8f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.653+0000 7fac34d31640 1 --2- 172.21.15.19:0/1989195910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac300d4fd0 0x7fac301f5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.653+0000 7fac34d31640 1 --2- 172.21.15.19:0/1989195910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac300b3650 0x7fac30155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.653+0000 7fac34d31640 1 -- 172.21.15.19:0/1989195910 >> 172.21.15.19:0/1989195910 conn(0x7fac3008bfc0 msgr2=0x7fac30157bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:18.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.653+0000 7fac34d31640 1 -- 172.21.15.19:0/1989195910 shutdown_connections 2024-09-12T01:58:18.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.653+0000 7fac34d31640 1 -- 172.21.15.19:0/1989195910 wait complete. 2024-09-12T01:58:18.665 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T01:58:18.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.769+0000 7f2a0ca00640 1 Processor -- start 2024-09-12T01:58:18.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.769+0000 7f2a0ca00640 1 -- start start 2024-09-12T01:58:18.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.770+0000 7f2a0ca00640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a080d1f90 0x7f2a080cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.770+0000 7f2a0ca00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a080cf000 con 0x7f2a080d0dd0 2024-09-12T01:58:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.770+0000 7f2a0ca00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a080d29a0 con 0x7f2a0815e660 2024-09-12T01:58:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.770+0000 7f2a0ca00640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0806d3e0 con 0x7f2a080d1f90 2024-09-12T01:58:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.770+0000 7f2a06d9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2a080d0dd0 0x7f2a080d11b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58316/0 (socket says 172.21.15.19:58316) 2024-09-12T01:58:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.770+0000 7f2a06d9d640 1 -- 172.21.15.19:0/3404813810 learned_addr learned my addr 172.21.15.19:0/3404813810 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a0759e640 1 --2- 172.21.15.19:0/3404813810 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a080d1f90 0x7f2a080cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a05d9b640 1 -- 172.21.15.19:0/3404813810 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1021756018 0 0) 0x7f2a080cf000 con 0x7f2a080d0dd0 2024-09-12T01:58:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a05d9b640 1 -- 172.21.15.19:0/3404813810 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29f4003520 con 0x7f2a080d0dd0 2024-09-12T01:58:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a05d9b640 1 -- 172.21.15.19:0/3404813810 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3926373193 0 0) 0x7f29f4003520 con 0x7f2a080d0dd0 2024-09-12T01:58:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a05d9b640 1 -- 172.21.15.19:0/3404813810 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a080d1f90 msgr2=0x7f2a080cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a05d9b640 1 --2- 172.21.15.19:0/3404813810 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a080d1f90 0x7f2a080cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a05d9b640 1 -- 172.21.15.19:0/3404813810 >> v1:172.21.15.135:6789/0 conn(0x7f2a0815e660 legacy=0x7f2a0806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a05d9b640 1 -- 172.21.15.19:0/3404813810 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a080d2c60 con 0x7f2a080d0dd0 2024-09-12T01:58:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a05d9b640 1 -- 172.21.15.19:0/3404813810 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f2a00001670 con 0x7f2a080d0dd0 2024-09-12T01:58:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a05d9b640 1 -- 172.21.15.19:0/3404813810 >> v1:172.21.15.19:6789/0 conn(0x7f2a080d0dd0 legacy=0x7f2a080d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a05d9b640 1 --2- 172.21.15.19:0/3404813810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29f40039e0 0x7f29f4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a05d9b640 1 --2- 172.21.15.19:0/3404813810 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a080d1f90 0x7f29f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a05d9b640 1 --2- 172.21.15.19:0/3404813810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29f4004d40 0x7f29f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a05d9b640 1 -- 172.21.15.19:0/3404813810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0806d3e0 con 0x7f29f4004d40 2024-09-12T01:58:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a05d9b640 1 -- 172.21.15.19:0/3404813810 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f29f400b9f0 con 0x7f29f40039e0 2024-09-12T01:58:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a05d9b640 1 -- 172.21.15.19:0/3404813810 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f29f400bbf0 con 0x7f2a080d1f90 2024-09-12T01:58:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a0759e640 1 --2- 172.21.15.19:0/3404813810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29f4004d40 0x7f29f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a0659c640 1 --2- 172.21.15.19:0/3404813810 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a080d1f90 0x7f29f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a06d9d640 1 --2- 172.21.15.19:0/3404813810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29f40039e0 0x7f29f4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a0759e640 1 -- 172.21.15.19:0/3404813810 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a080d1f90 msgr2=0x7f29f4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a0759e640 1 --2- 172.21.15.19:0/3404813810 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a080d1f90 0x7f29f4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a0759e640 1 -- 172.21.15.19:0/3404813810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29f40039e0 msgr2=0x7f29f4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a0759e640 1 --2- 172.21.15.19:0/3404813810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29f40039e0 0x7f29f4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.771+0000 7f2a0759e640 1 -- 172.21.15.19:0/3404813810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f4003520 con 0x7f29f4004d40 2024-09-12T01:58:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.772+0000 7f2a0759e640 1 --2- 172.21.15.19:0/3404813810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29f4004d40 0x7f29f40051c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009fc0 tx=0x7f29f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d254b05b22bcf38a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.772+0000 7f2a05d9b640 1 -- 172.21.15.19:0/3404813810 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f8009c10 con 0x7f29f4004d40 2024-09-12T01:58:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.772+0000 7f2a05d9b640 1 -- 172.21.15.19:0/3404813810 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f8036070 con 0x7f29f4004d40 2024-09-12T01:58:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.772+0000 7f2a05d9b640 1 -- 172.21.15.19:0/3404813810 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f8031880 con 0x7f29f4004d40 2024-09-12T01:58:18.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.773+0000 7f2a0ca00640 1 -- 172.21.15.19:0/3404813810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29f4004d40 msgr2=0x7f29f40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.773+0000 7f2a0ca00640 1 --2- 172.21.15.19:0/3404813810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29f4004d40 0x7f29f40051c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009fc0 tx=0x7f29f4005830 comp rx=0 tx=0).stop 2024-09-12T01:58:18.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.773+0000 7f2a0759e640 1 -- 172.21.15.19:0/3404813810 reap_dead start 2024-09-12T01:58:18.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.773+0000 7f2a0ca00640 1 -- 172.21.15.19:0/3404813810 shutdown_connections 2024-09-12T01:58:18.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.773+0000 7f2a0ca00640 1 -- 172.21.15.19:0/3404813810 >> 172.21.15.19:0/3404813810 conn(0x7f2a0808bfc0 msgr2=0x7f2a080d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:18.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.773+0000 7f2a0ca00640 1 -- 172.21.15.19:0/3404813810 shutdown_connections 2024-09-12T01:58:18.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.773+0000 7f2a0ca00640 1 -- 172.21.15.19:0/3404813810 wait complete. 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.774+0000 7f2a0ca00640 1 Processor -- start 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.775+0000 7f2a0ca00640 1 -- start start 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.775+0000 7f2a0ca00640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29f4004d40 0x7f2a080cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.775+0000 7f2a0ca00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a080b6940 0x7f2a0815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.775+0000 7f2a0ca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a0815b520 0x7f2a0815c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.775+0000 7f2a0ca00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2a080cf330 con 0x7f2a080b6940 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.775+0000 7f2a0ca00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2a080d3220 con 0x7f2a0815b520 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.775+0000 7f2a0ca00640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2a080d33a0 con 0x7f29f4004d40 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.775+0000 7f2a0659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a080b6940 0x7f2a0815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.775+0000 7f2a0659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a080b6940 0x7f2a0815afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52430/0 (socket says 172.21.15.19:52430) 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.775+0000 7f2a0659c640 1 -- 172.21.15.19:0/3403909358 learned_addr learned my addr 172.21.15.19:0/3403909358 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.775+0000 7f2a06d9d640 1 --2- 172.21.15.19:0/3403909358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29f4004d40 0x7f2a080cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.775+0000 7f2a0759e640 1 --2- 172.21.15.19:0/3403909358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a0815b520 0x7f2a0815c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.776+0000 7f2a0659c640 1 -- 172.21.15.19:0/3403909358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29f4004d40 msgr2=0x7f2a080cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.776+0000 7f2a0659c640 1 --2- 172.21.15.19:0/3403909358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29f4004d40 0x7f2a080cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.776+0000 7f2a0659c640 1 -- 172.21.15.19:0/3403909358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a0815b520 msgr2=0x7f2a0815c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.776+0000 7f2a0659c640 1 --2- 172.21.15.19:0/3403909358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a0815b520 0x7f2a0815c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.776+0000 7f2a0659c640 1 -- 172.21.15.19:0/3403909358 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a080cba40 con 0x7f2a080b6940 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.776+0000 7f2a0759e640 1 --2- 172.21.15.19:0/3403909358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a0815b520 0x7f2a0815c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.776+0000 7f2a0659c640 1 --2- 172.21.15.19:0/3403909358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a080b6940 0x7f2a0815afe0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f29f000f800 tx=0x7f29f000fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.776+0000 7f29ff7fe640 1 -- 172.21.15.19:0/3403909358 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f00052e0 con 0x7f2a080b6940 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.776+0000 7f29ff7fe640 1 -- 172.21.15.19:0/3403909358 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f0018070 con 0x7f2a080b6940 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.776+0000 7f2a0ca00640 1 -- 172.21.15.19:0/3403909358 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a080cbd00 con 0x7f2a080b6940 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.776+0000 7f29ff7fe640 1 -- 172.21.15.19:0/3403909358 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f000d970 con 0x7f2a080b6940 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.776+0000 7f2a0ca00640 1 -- 172.21.15.19:0/3403909358 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a080cc2c0 con 0x7f2a080b6940 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.777+0000 7f2a0ca00640 1 -- 172.21.15.19:0/3403909358 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a08068c60 con 0x7f2a080b6940 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.778+0000 7f29ff7fe640 1 -- 172.21.15.19:0/3403909358 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29f000db10 con 0x7f2a080b6940 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.778+0000 7f29ff7fe640 1 --2- 172.21.15.19:0/3403909358 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f29e806be30 0x7f29e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.778+0000 7f29ff7fe640 1 -- 172.21.15.19:0/3403909358 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7f29f008af60 con 0x7f2a080b6940 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.778+0000 7f2a06d9d640 1 --2- 172.21.15.19:0/3403909358 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f29e806be30 0x7f29e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.779+0000 7f2a06d9d640 1 --2- 172.21.15.19:0/3403909358 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f29e806be30 0x7f29e806e2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2a00001050 tx=0x7f2a00000f80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:18.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:18.782+0000 7f29ff7fe640 1 -- 172.21.15.19:0/3403909358 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29f00597c0 con 0x7f2a080b6940 2024-09-12T01:58:18.829 INFO:tasks.ceph.mds.a.smithi019.stderr:2024-09-12T01:58:18.829+0000 7f1d8afe5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:58:19.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.000+0000 7f2a0ca00640 1 -- 172.21.15.19:0/3403909358 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2a0806ce60 con 0x7f2a080b6940 2024-09-12T01:58:19.001 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T01:58:19.001+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:58:19.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.004+0000 7f29ff7fe640 1 -- 172.21.15.19:0/3403909358 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) ==== 161+0+0 (secure 0 0 0) 0x7f29f00590c0 con 0x7f2a080b6940 2024-09-12T01:58:19.004 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:58:19.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.006+0000 7f2a0ca00640 1 -- 172.21.15.19:0/3403909358 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f29e806be30 msgr2=0x7f29e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:19.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.006+0000 7f2a0ca00640 1 --2- 172.21.15.19:0/3403909358 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f29e806be30 0x7f29e806e2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2a00001050 tx=0x7f2a00000f80 comp rx=0 tx=0).stop 2024-09-12T01:58:19.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.006+0000 7f2a0ca00640 1 -- 172.21.15.19:0/3403909358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a080b6940 msgr2=0x7f2a0815afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:19.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.006+0000 7f2a0ca00640 1 --2- 172.21.15.19:0/3403909358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a080b6940 0x7f2a0815afe0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f29f000f800 tx=0x7f29f000fcc0 comp rx=0 tx=0).stop 2024-09-12T01:58:19.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.006+0000 7f2a0ca00640 1 -- 172.21.15.19:0/3403909358 shutdown_connections 2024-09-12T01:58:19.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.006+0000 7f2a0ca00640 1 --2- 172.21.15.19:0/3403909358 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f29e806be30 0x7f29e806e2f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:19.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.006+0000 7f2a0ca00640 1 --2- 172.21.15.19:0/3403909358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a0815b520 0x7f2a0815c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:19.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.006+0000 7f2a0ca00640 1 --2- 172.21.15.19:0/3403909358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a080b6940 0x7f2a0815afe0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:19.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.006+0000 7f2a0ca00640 1 --2- 172.21.15.19:0/3403909358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29f4004d40 0x7f2a080cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:19.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.006+0000 7f2a0ca00640 1 -- 172.21.15.19:0/3403909358 >> 172.21.15.19:0/3403909358 conn(0x7f2a0808bfc0 msgr2=0x7f2a0815d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:19.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.006+0000 7f2a0ca00640 1 -- 172.21.15.19:0/3403909358 shutdown_connections 2024-09-12T01:58:19.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.006+0000 7f2a0ca00640 1 -- 172.21.15.19:0/3403909358 wait complete. 2024-09-12T01:58:19.008 INFO:tasks.ceph.mds.a.smithi019.stderr: -40> 2024-09-12T01:58:18.829+0000 7f1d8afe5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:58:19.022 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T01:58:19.037 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-09-12T01:58:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.129+0000 7f39e47f6640 1 Processor -- start 2024-09-12T01:58:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.129+0000 7f39e47f6640 1 -- start start 2024-09-12T01:58:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.130+0000 7f39e47f6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f39dc15c310 0x7f39dc160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.130+0000 7f39e47f6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39dc0d0370 0x7f39dc0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.130+0000 7f39e47f6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39dc160e70 con 0x7f39dc0b4800 2024-09-12T01:58:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.130+0000 7f39e47f6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f39dc0af7a0 con 0x7f39dc15c310 2024-09-12T01:58:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.130+0000 7f39e47f6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f39dc0afa80 con 0x7f39dc0d0370 2024-09-12T01:58:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.130+0000 7f39e2d93640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39dc0d0370 0x7f39dc0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.130+0000 7f39e2592640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f39dc15c310 0x7f39dc160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.130+0000 7f39e2d93640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39dc0d0370 0x7f39dc0d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:49002/0 (socket says 172.21.15.19:49002) 2024-09-12T01:58:19.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.130+0000 7f39e2d93640 1 -- 172.21.15.19:0/1883045625 learned_addr learned my addr 172.21.15.19:0/1883045625 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:19.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.130+0000 7f39e1d91640 1 --1- 172.21.15.19:0/1883045625 >> v1:172.21.15.135:6789/0 conn(0x7f39dc0b4800 0x7f39dc0aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:56516/0 (socket says 172.21.15.19:56516) 2024-09-12T01:58:19.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.131+0000 7f39e1590640 1 -- 172.21.15.19:0/1883045625 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3655008511 0 0) 0x7f39dc160e70 con 0x7f39dc0b4800 2024-09-12T01:58:19.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.131+0000 7f39e2592640 1 -- 172.21.15.19:0/1883045625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39dc0d0370 msgr2=0x7f39dc0d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:19.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.131+0000 7f39e2592640 1 --2- 172.21.15.19:0/1883045625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39dc0d0370 0x7f39dc0d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:19.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.131+0000 7f39e2592640 1 -- 172.21.15.19:0/1883045625 >> v1:172.21.15.135:6789/0 conn(0x7f39dc0b4800 legacy=0x7f39dc0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:19.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.131+0000 7f39e2592640 1 -- 172.21.15.19:0/1883045625 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39dc160130 con 0x7f39dc15c310 2024-09-12T01:58:19.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.131+0000 7f39e2d93640 1 --2- 172.21.15.19:0/1883045625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39dc0d0370 0x7f39dc0d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:19.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.131+0000 7f39e2592640 1 --2- 172.21.15.19:0/1883045625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39dc15c310 0x7f39dc160930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f39d80097a0 tx=0x7f39d802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85d46a2be1bd47e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:19.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.132+0000 7f39e1590640 1 -- 172.21.15.19:0/1883045625 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8037070 con 0x7f39dc15c310 2024-09-12T01:58:19.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.132+0000 7f39e1590640 1 -- 172.21.15.19:0/1883045625 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d8032440 con 0x7f39dc15c310 2024-09-12T01:58:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.132+0000 7f39e1590640 1 -- 172.21.15.19:0/1883045625 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8032810 con 0x7f39dc15c310 2024-09-12T01:58:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.132+0000 7f39e47f6640 1 -- 172.21.15.19:0/1883045625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39dc15c310 msgr2=0x7f39dc160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.132+0000 7f39e47f6640 1 --2- 172.21.15.19:0/1883045625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39dc15c310 0x7f39dc160930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f39d80097a0 tx=0x7f39d802a180 comp rx=0 tx=0).stop 2024-09-12T01:58:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.132+0000 7f39e47f6640 1 -- 172.21.15.19:0/1883045625 shutdown_connections 2024-09-12T01:58:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.132+0000 7f39e47f6640 1 --2- 172.21.15.19:0/1883045625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39dc0d0370 0x7f39dc0d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.132+0000 7f39e47f6640 1 --2- 172.21.15.19:0/1883045625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39dc15c310 0x7f39dc160930 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.132+0000 7f39e47f6640 1 -- 172.21.15.19:0/1883045625 >> 172.21.15.19:0/1883045625 conn(0x7f39dc06bdf0 msgr2=0x7f39dc06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.132+0000 7f39e47f6640 1 -- 172.21.15.19:0/1883045625 shutdown_connections 2024-09-12T01:58:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.132+0000 7f39e47f6640 1 -- 172.21.15.19:0/1883045625 wait complete. 2024-09-12T01:58:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.133+0000 7f39e47f6640 1 Processor -- start 2024-09-12T01:58:19.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.134+0000 7f39e47f6640 1 -- start start 2024-09-12T01:58:19.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.134+0000 7f39e47f6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39dc0b4800 0x7f39dc15f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:19.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.134+0000 7f39e47f6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39dc0d0370 0x7f39dc1511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:19.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.134+0000 7f39e47f6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39dc15c310 0x7f39dc15e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:19.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.134+0000 7f39e47f6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc06e090 con 0x7f39dc15c310 2024-09-12T01:58:19.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.134+0000 7f39e47f6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc06df10 con 0x7f39dc0b4800 2024-09-12T01:58:19.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.134+0000 7f39e47f6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f39dc06e210 con 0x7f39dc0d0370 2024-09-12T01:58:19.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.134+0000 7f39e2d93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39dc15c310 0x7f39dc15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:19.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.134+0000 7f39e2d93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39dc15c310 0x7f39dc15e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52466/0 (socket says 172.21.15.19:52466) 2024-09-12T01:58:19.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.134+0000 7f39e2d93640 1 -- 172.21.15.19:0/1925939494 learned_addr learned my addr 172.21.15.19:0/1925939494 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:19.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.135+0000 7f39e2592640 1 --2- 172.21.15.19:0/1925939494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39dc0b4800 0x7f39dc15f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:19.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.135+0000 7f39e1d91640 1 --2- 172.21.15.19:0/1925939494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39dc0d0370 0x7f39dc1511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:19.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.135+0000 7f39e2d93640 1 -- 172.21.15.19:0/1925939494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39dc0d0370 msgr2=0x7f39dc1511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:19.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.135+0000 7f39e2d93640 1 --2- 172.21.15.19:0/1925939494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39dc0d0370 0x7f39dc1511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:19.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.135+0000 7f39e2d93640 1 -- 172.21.15.19:0/1925939494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39dc0b4800 msgr2=0x7f39dc15f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:19.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.135+0000 7f39e2d93640 1 --2- 172.21.15.19:0/1925939494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39dc0b4800 0x7f39dc15f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:19.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.135+0000 7f39e2d93640 1 -- 172.21.15.19:0/1925939494 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39dc15ec10 con 0x7f39dc15c310 2024-09-12T01:58:19.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.135+0000 7f39e2592640 1 --2- 172.21.15.19:0/1925939494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39dc0b4800 0x7f39dc15f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:19.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.135+0000 7f39e2d93640 1 --2- 172.21.15.19:0/1925939494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39dc15c310 0x7f39dc15e430 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f39d400efc0 tx=0x7f39d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:19.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.135+0000 7f39d2ffd640 1 -- 172.21.15.19:0/1925939494 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d400cbe0 con 0x7f39dc15c310 2024-09-12T01:58:19.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.135+0000 7f39d2ffd640 1 -- 172.21.15.19:0/1925939494 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d400cd80 con 0x7f39dc15c310 2024-09-12T01:58:19.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.135+0000 7f39e47f6640 1 -- 172.21.15.19:0/1925939494 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39dc1529c0 con 0x7f39dc15c310 2024-09-12T01:58:19.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.135+0000 7f39d2ffd640 1 -- 172.21.15.19:0/1925939494 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d4003bb0 con 0x7f39dc15c310 2024-09-12T01:58:19.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.135+0000 7f39e47f6640 1 -- 172.21.15.19:0/1925939494 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39dc152c60 con 0x7f39dc15c310 2024-09-12T01:58:19.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.136+0000 7f39e47f6640 1 -- 172.21.15.19:0/1925939494 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39dc0d0800 con 0x7f39dc15c310 2024-09-12T01:58:19.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.137+0000 7f39d2ffd640 1 -- 172.21.15.19:0/1925939494 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39d401b030 con 0x7f39dc15c310 2024-09-12T01:58:19.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.138+0000 7f39d2ffd640 1 --2- 172.21.15.19:0/1925939494 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f39c006be30 0x7f39c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:19.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.138+0000 7f39d2ffd640 1 -- 172.21.15.19:0/1925939494 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6273+0+0 (secure 0 0 0) 0x7f39d408b520 con 0x7f39dc15c310 2024-09-12T01:58:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.140+0000 7f39e2592640 1 --2- 172.21.15.19:0/1925939494 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f39c006be30 0x7f39c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.140+0000 7f39e2592640 1 --2- 172.21.15.19:0/1925939494 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f39c006be30 0x7f39c006e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f39d8034000 tx=0x7f39d802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:19.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.143+0000 7f39d2ffd640 1 -- 172.21.15.19:0/1925939494 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39d4022020 con 0x7f39dc15c310 2024-09-12T01:58:19.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:19.354+0000 7f39e47f6640 1 -- 172.21.15.19:0/1925939494 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f39dc06ce90 con 0x7f39dc15c310 2024-09-12T01:58:20.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.007+0000 7f39d2ffd640 1 -- 172.21.15.19:0/1925939494 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) ==== 104+0+0 (secure 0 0 0) 0x7f39d4010040 con 0x7f39dc15c310 2024-09-12T01:58:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.011+0000 7f39e47f6640 1 -- 172.21.15.19:0/1925939494 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f39c006be30 msgr2=0x7f39c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.011+0000 7f39e47f6640 1 --2- 172.21.15.19:0/1925939494 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f39c006be30 0x7f39c006e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f39d8034000 tx=0x7f39d802e000 comp rx=0 tx=0).stop 2024-09-12T01:58:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.011+0000 7f39e47f6640 1 -- 172.21.15.19:0/1925939494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39dc15c310 msgr2=0x7f39dc15e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.011+0000 7f39e47f6640 1 --2- 172.21.15.19:0/1925939494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39dc15c310 0x7f39dc15e430 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f39d400efc0 tx=0x7f39d400c490 comp rx=0 tx=0).stop 2024-09-12T01:58:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.011+0000 7f39e47f6640 1 -- 172.21.15.19:0/1925939494 shutdown_connections 2024-09-12T01:58:20.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.011+0000 7f39e47f6640 1 --2- 172.21.15.19:0/1925939494 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f39c006be30 0x7f39c006e2f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.011+0000 7f39e47f6640 1 --2- 172.21.15.19:0/1925939494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39dc15c310 0x7f39dc15e430 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.011+0000 7f39e47f6640 1 --2- 172.21.15.19:0/1925939494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39dc0d0370 0x7f39dc1511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.011+0000 7f39e47f6640 1 --2- 172.21.15.19:0/1925939494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39dc0b4800 0x7f39dc15f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.011+0000 7f39e47f6640 1 -- 172.21.15.19:0/1925939494 >> 172.21.15.19:0/1925939494 conn(0x7f39dc06bdf0 msgr2=0x7f39dc0b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:20.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.011+0000 7f39e47f6640 1 -- 172.21.15.19:0/1925939494 shutdown_connections 2024-09-12T01:58:20.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.011+0000 7f39e47f6640 1 -- 172.21.15.19:0/1925939494 wait complete. 2024-09-12T01:58:20.026 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T01:58:20.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.184+0000 7fbb3eb6f640 1 Processor -- start 2024-09-12T01:58:20.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.184+0000 7fbb3eb6f640 1 -- start start 2024-09-12T01:58:20.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.184+0000 7fbb3eb6f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb380b7c30 0x7fbb380cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.184+0000 7fbb3eb6f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbb380cd510 0x7fbb380b5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.184+0000 7fbb3eb6f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb380ce1a0 con 0x7fbb380b4a50 2024-09-12T01:58:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.184+0000 7fbb3eb6f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fbb380b3010 con 0x7fbb380cd510 2024-09-12T01:58:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.184+0000 7fbb3eb6f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbb380b32f0 con 0x7fbb380b7c30 2024-09-12T01:58:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.185+0000 7fbb3c90b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb380b7c30 0x7fbb380cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.185+0000 7fbb3d10c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbb380cd510 0x7fbb380b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.185+0000 7fbb37fff640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fbb380b4a50 0x7fbb380cce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:56530/0 (socket says 172.21.15.19:56530) 2024-09-12T01:58:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.185+0000 7fbb3c90b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb380b7c30 0x7fbb380cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:49018/0 (socket says 172.21.15.19:49018) 2024-09-12T01:58:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.185+0000 7fbb3d10c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbb380cd510 0x7fbb380b5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:52682/0 (socket says 172.21.15.19:52682) 2024-09-12T01:58:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.185+0000 7fbb37fff640 1 -- 172.21.15.19:0/1555747733 learned_addr learned my addr 172.21.15.19:0/1555747733 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.185+0000 7fbb3c90b640 1 -- 172.21.15.19:0/1555747733 >> v2:172.21.15.135:3300/0 conn(0x7fbb380cd510 msgr2=0x7fbb380b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.185+0000 7fbb3c90b640 1 --2- 172.21.15.19:0/1555747733 >> v2:172.21.15.135:3300/0 conn(0x7fbb380cd510 0x7fbb380b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.185+0000 7fbb3c90b640 1 -- 172.21.15.19:0/1555747733 >> v1:172.21.15.135:6789/0 conn(0x7fbb380b4a50 legacy=0x7fbb380cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:20.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.185+0000 7fbb3c90b640 1 -- 172.21.15.19:0/1555747733 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb380b35d0 con 0x7fbb380b7c30 2024-09-12T01:58:20.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.185+0000 7fbb3d10c640 1 --2- 172.21.15.19:0/1555747733 >> v2:172.21.15.135:3300/0 conn(0x7fbb380cd510 0x7fbb380b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:20.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.186+0000 7fbb3c90b640 1 --2- 172.21.15.19:0/1555747733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb380b7c30 0x7fbb380cfec0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbb300097a0 tx=0x7fbb3002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=749ed9297f0cc25d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:20.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.186+0000 7fbb377fe640 1 -- 172.21.15.19:0/1555747733 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30037070 con 0x7fbb380b7c30 2024-09-12T01:58:20.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.186+0000 7fbb377fe640 1 -- 172.21.15.19:0/1555747733 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb3002ae50 con 0x7fbb380b7c30 2024-09-12T01:58:20.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.186+0000 7fbb377fe640 1 -- 172.21.15.19:0/1555747733 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30032660 con 0x7fbb380b7c30 2024-09-12T01:58:20.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.187+0000 7fbb3eb6f640 1 -- 172.21.15.19:0/1555747733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb380b7c30 msgr2=0x7fbb380cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:20.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.187+0000 7fbb3eb6f640 1 --2- 172.21.15.19:0/1555747733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb380b7c30 0x7fbb380cfec0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbb300097a0 tx=0x7fbb3002a100 comp rx=0 tx=0).stop 2024-09-12T01:58:20.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.187+0000 7fbb3eb6f640 1 -- 172.21.15.19:0/1555747733 shutdown_connections 2024-09-12T01:58:20.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.187+0000 7fbb3eb6f640 1 --2- 172.21.15.19:0/1555747733 >> v2:172.21.15.135:3300/0 conn(0x7fbb380cd510 0x7fbb380b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.187+0000 7fbb3eb6f640 1 --2- 172.21.15.19:0/1555747733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb380b7c30 0x7fbb380cfec0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.187+0000 7fbb3eb6f640 1 -- 172.21.15.19:0/1555747733 >> 172.21.15.19:0/1555747733 conn(0x7fbb380b3de0 msgr2=0x7fbb380b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:20.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.187+0000 7fbb3eb6f640 1 -- 172.21.15.19:0/1555747733 shutdown_connections 2024-09-12T01:58:20.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.187+0000 7fbb3eb6f640 1 -- 172.21.15.19:0/1555747733 wait complete. 2024-09-12T01:58:20.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.188+0000 7fbb3eb6f640 1 Processor -- start 2024-09-12T01:58:20.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.188+0000 7fbb3eb6f640 1 -- start start 2024-09-12T01:58:20.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.189+0000 7fbb3eb6f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb380b4a50 0x7fbb3815cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:20.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.189+0000 7fbb3eb6f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb380b7c30 0x7fbb380ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:20.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.189+0000 7fbb3eb6f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb380cd510 0x7fbb380ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:20.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.189+0000 7fbb3eb6f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbb380d0400 con 0x7fbb380b4a50 2024-09-12T01:58:20.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.189+0000 7fbb3eb6f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbb380cd9a0 con 0x7fbb380b7c30 2024-09-12T01:58:20.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.189+0000 7fbb3eb6f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbb380d0580 con 0x7fbb380cd510 2024-09-12T01:58:20.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.189+0000 7fbb3c90b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb380b4a50 0x7fbb3815cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:20.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.189+0000 7fbb3c90b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb380b4a50 0x7fbb3815cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52482/0 (socket says 172.21.15.19:52482) 2024-09-12T01:58:20.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.189+0000 7fbb3c90b640 1 -- 172.21.15.19:0/3824328135 learned_addr learned my addr 172.21.15.19:0/3824328135 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:20.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.189+0000 7fbb37fff640 1 --2- 172.21.15.19:0/3824328135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb380b7c30 0x7fbb380ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:20.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.189+0000 7fbb3d10c640 1 --2- 172.21.15.19:0/3824328135 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb380cd510 0x7fbb380ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:20.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.190+0000 7fbb3c90b640 1 -- 172.21.15.19:0/3824328135 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb380cd510 msgr2=0x7fbb380ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:20.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.190+0000 7fbb3c90b640 1 --2- 172.21.15.19:0/3824328135 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb380cd510 0x7fbb380ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.190+0000 7fbb3c90b640 1 -- 172.21.15.19:0/3824328135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb380b7c30 msgr2=0x7fbb380ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:20.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.190+0000 7fbb3c90b640 1 --2- 172.21.15.19:0/3824328135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb380b7c30 0x7fbb380ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.190+0000 7fbb3c90b640 1 -- 172.21.15.19:0/3824328135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3815a5b0 con 0x7fbb380b4a50 2024-09-12T01:58:20.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.190+0000 7fbb3c90b640 1 --2- 172.21.15.19:0/3824328135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb380b4a50 0x7fbb3815cfa0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fbb3002a140 tx=0x7fbb300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:20.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.190+0000 7fbb357fa640 1 -- 172.21.15.19:0/3824328135 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30041070 con 0x7fbb380b4a50 2024-09-12T01:58:20.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.190+0000 7fbb357fa640 1 -- 172.21.15.19:0/3824328135 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb3003c670 con 0x7fbb380b4a50 2024-09-12T01:58:20.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.190+0000 7fbb3eb6f640 1 -- 172.21.15.19:0/3824328135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3815a890 con 0x7fbb380b4a50 2024-09-12T01:58:20.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.190+0000 7fbb357fa640 1 -- 172.21.15.19:0/3824328135 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30037040 con 0x7fbb380b4a50 2024-09-12T01:58:20.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.190+0000 7fbb3eb6f640 1 -- 172.21.15.19:0/3824328135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb3815aec0 con 0x7fbb380b4a50 2024-09-12T01:58:20.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.191+0000 7fbb3eb6f640 1 -- 172.21.15.19:0/3824328135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb380b8010 con 0x7fbb380b4a50 2024-09-12T01:58:20.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.192+0000 7fbb357fa640 1 -- 172.21.15.19:0/3824328135 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb30044070 con 0x7fbb380b4a50 2024-09-12T01:58:20.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.192+0000 7fbb357fa640 1 --2- 172.21.15.19:0/3824328135 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbb1806be30 0x7fbb1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:20.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.192+0000 7fbb357fa640 1 -- 172.21.15.19:0/3824328135 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6273+0+0 (secure 0 0 0) 0x7fbb300ab2d0 con 0x7fbb380b4a50 2024-09-12T01:58:20.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.192+0000 7fbb37fff640 1 --2- 172.21.15.19:0/3824328135 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbb1806be30 0x7fbb1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:20.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.193+0000 7fbb37fff640 1 --2- 172.21.15.19:0/3824328135 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbb1806be30 0x7fbb1806e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbb380b2a60 tx=0x7fbb28001990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:20.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.196+0000 7fbb357fa640 1 -- 172.21.15.19:0/3824328135 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb30079480 con 0x7fbb380b4a50 2024-09-12T01:58:20.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:20.374+0000 7fbb3eb6f640 1 -- 172.21.15.19:0/3824328135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbb380b2a90 con 0x7fbb380b4a50 2024-09-12T01:58:21.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.016+0000 7fbb357fa640 1 -- 172.21.15.19:0/3824328135 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) ==== 181+0+0 (secure 0 0 0) 0x7fbb3007d780 con 0x7fbb380b4a50 2024-09-12T01:58:21.017 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-09-12T01:58:21.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.019+0000 7fbb3eb6f640 1 -- 172.21.15.19:0/3824328135 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbb1806be30 msgr2=0x7fbb1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:21.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.019+0000 7fbb3eb6f640 1 --2- 172.21.15.19:0/3824328135 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbb1806be30 0x7fbb1806e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbb380b2a60 tx=0x7fbb28001990 comp rx=0 tx=0).stop 2024-09-12T01:58:21.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.019+0000 7fbb3eb6f640 1 -- 172.21.15.19:0/3824328135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb380b4a50 msgr2=0x7fbb3815cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:21.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.019+0000 7fbb3eb6f640 1 --2- 172.21.15.19:0/3824328135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb380b4a50 0x7fbb3815cfa0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fbb3002a140 tx=0x7fbb300046c0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.019+0000 7fbb3eb6f640 1 -- 172.21.15.19:0/3824328135 shutdown_connections 2024-09-12T01:58:21.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.019+0000 7fbb3eb6f640 1 --2- 172.21.15.19:0/3824328135 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbb1806be30 0x7fbb1806e2f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.019+0000 7fbb3eb6f640 1 --2- 172.21.15.19:0/3824328135 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb380cd510 0x7fbb380ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.019+0000 7fbb3eb6f640 1 --2- 172.21.15.19:0/3824328135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb380b7c30 0x7fbb380ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.019+0000 7fbb3eb6f640 1 --2- 172.21.15.19:0/3824328135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb380b4a50 0x7fbb3815cfa0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.019+0000 7fbb3eb6f640 1 -- 172.21.15.19:0/3824328135 >> 172.21.15.19:0/3824328135 conn(0x7fbb380b3de0 msgr2=0x7fbb380cc180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:21.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.019+0000 7fbb3eb6f640 1 -- 172.21.15.19:0/3824328135 shutdown_connections 2024-09-12T01:58:21.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.019+0000 7fbb3eb6f640 1 -- 172.21.15.19:0/3824328135 wait complete. 2024-09-12T01:58:21.035 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T01:58:21.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.148+0000 7f7240a77640 1 Processor -- start 2024-09-12T01:58:21.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.148+0000 7f7240a77640 1 -- start start 2024-09-12T01:58:21.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.149+0000 7f7240a77640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f723c0b5f80 0x7f723c162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.149+0000 7f7240a77640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f723c0d4c10 0x7f723c0b6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.149+0000 7f7240a77640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f723c0d3320 0x7f723c0d37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.149+0000 7f7240a77640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f723c0d5420 con 0x7f723c0d4c10 2024-09-12T01:58:21.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.149+0000 7f7240a77640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f723c0d2e90 con 0x7f723c0d3320 2024-09-12T01:58:21.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.149+0000 7f7240a77640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f723c0d2600 con 0x7f723c0b5f80 2024-09-12T01:58:21.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.149+0000 7f7239d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f723c0d4c10 0x7f723c0b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.149+0000 7f7239d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f723c0d4c10 0x7f723c0b6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50178/0 (socket says 172.21.15.19:50178) 2024-09-12T01:58:21.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.149+0000 7f7239d9b640 1 -- 172.21.15.19:0/1099593683 learned_addr learned my addr 172.21.15.19:0/1099593683 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:21.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.149+0000 7f723a59c640 1 --2- 172.21.15.19:0/1099593683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f723c0b5f80 0x7f723c162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.149+0000 7f723ad9d640 1 --2- 172.21.15.19:0/1099593683 >> v2:172.21.15.135:3300/0 conn(0x7f723c0d3320 0x7f723c0d37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.149+0000 7f7239d9b640 1 -- 172.21.15.19:0/1099593683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f723c0b5f80 msgr2=0x7f723c162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:21.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.149+0000 7f7239d9b640 1 --2- 172.21.15.19:0/1099593683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f723c0b5f80 0x7f723c162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.149+0000 7f7239d9b640 1 -- 172.21.15.19:0/1099593683 >> v2:172.21.15.135:3300/0 conn(0x7f723c0d3320 msgr2=0x7f723c0d37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:21.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.149+0000 7f7239d9b640 1 --2- 172.21.15.19:0/1099593683 >> v2:172.21.15.135:3300/0 conn(0x7f723c0d3320 0x7f723c0d37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.149+0000 7f7239d9b640 1 -- 172.21.15.19:0/1099593683 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723c0b3c10 con 0x7f723c0d4c10 2024-09-12T01:58:21.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.149+0000 7f723a59c640 1 --2- 172.21.15.19:0/1099593683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f723c0b5f80 0x7f723c162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:21.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.149+0000 7f723ad9d640 1 --2- 172.21.15.19:0/1099593683 >> v2:172.21.15.135:3300/0 conn(0x7f723c0d3320 0x7f723c0d37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:21.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.150+0000 7f7239d9b640 1 --2- 172.21.15.19:0/1099593683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f723c0d4c10 0x7f723c0b6360 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f723c08e490 tx=0x7f722402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e81b6b3923c107 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:21.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.150+0000 7f723959a640 1 -- 172.21.15.19:0/1099593683 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7224037070 con 0x7f723c0d4c10 2024-09-12T01:58:21.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.150+0000 7f723959a640 1 -- 172.21.15.19:0/1099593683 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7224032440 con 0x7f723c0d4c10 2024-09-12T01:58:21.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.150+0000 7f723959a640 1 -- 172.21.15.19:0/1099593683 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7224032810 con 0x7f723c0d4c10 2024-09-12T01:58:21.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.151+0000 7f7240a77640 1 -- 172.21.15.19:0/1099593683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f723c0d4c10 msgr2=0x7f723c0b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:21.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.151+0000 7f7240a77640 1 --2- 172.21.15.19:0/1099593683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f723c0d4c10 0x7f723c0b6360 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f723c08e490 tx=0x7f722402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.151+0000 7f7240a77640 1 -- 172.21.15.19:0/1099593683 shutdown_connections 2024-09-12T01:58:21.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.151+0000 7f7240a77640 1 --2- 172.21.15.19:0/1099593683 >> v2:172.21.15.135:3300/0 conn(0x7f723c0d3320 0x7f723c0d37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.151+0000 7f7240a77640 1 --2- 172.21.15.19:0/1099593683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f723c0d4c10 0x7f723c0b6360 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.151+0000 7f7240a77640 1 --2- 172.21.15.19:0/1099593683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f723c0b5f80 0x7f723c162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.151+0000 7f7240a77640 1 -- 172.21.15.19:0/1099593683 >> 172.21.15.19:0/1099593683 conn(0x7f723c08bfc0 msgr2=0x7f723c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:21.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.151+0000 7f7240a77640 1 -- 172.21.15.19:0/1099593683 shutdown_connections 2024-09-12T01:58:21.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.151+0000 7f7240a77640 1 -- 172.21.15.19:0/1099593683 wait complete. 2024-09-12T01:58:21.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.152+0000 7f7240a77640 1 Processor -- start 2024-09-12T01:58:21.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.152+0000 7f7240a77640 1 -- start start 2024-09-12T01:58:21.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.153+0000 7f7240a77640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f723c0b5f80 0x7f723c0cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.153+0000 7f7240a77640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f723c0d3320 0x7f723c0b98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.153+0000 7f7240a77640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f723c0d4c10 0x7f723c15c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.153+0000 7f7240a77640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f723c0d5140 con 0x7f723c0b5f80 2024-09-12T01:58:21.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.153+0000 7f7240a77640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f723c0d2880 con 0x7f723c0d3320 2024-09-12T01:58:21.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.153+0000 7f7240a77640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f723c0d2b20 con 0x7f723c0d4c10 2024-09-12T01:58:21.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.153+0000 7f723a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f723c0b5f80 0x7f723c0cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.153+0000 7f723a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f723c0b5f80 0x7f723c0cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50182/0 (socket says 172.21.15.19:50182) 2024-09-12T01:58:21.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.153+0000 7f723a59c640 1 -- 172.21.15.19:0/1322050180 learned_addr learned my addr 172.21.15.19:0/1322050180 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:21.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.153+0000 7f7239d9b640 1 --2- 172.21.15.19:0/1322050180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f723c0d3320 0x7f723c0b98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.153+0000 7f723ad9d640 1 --2- 172.21.15.19:0/1322050180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f723c0d4c10 0x7f723c15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.153+0000 7f723a59c640 1 -- 172.21.15.19:0/1322050180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f723c0d4c10 msgr2=0x7f723c15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:21.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.153+0000 7f723a59c640 1 --2- 172.21.15.19:0/1322050180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f723c0d4c10 0x7f723c15c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.153+0000 7f723a59c640 1 -- 172.21.15.19:0/1322050180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f723c0d3320 msgr2=0x7f723c0b98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:21.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.153+0000 7f723a59c640 1 --2- 172.21.15.19:0/1322050180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f723c0d3320 0x7f723c0b98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.153+0000 7f723a59c640 1 -- 172.21.15.19:0/1322050180 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723c0c9940 con 0x7f723c0b5f80 2024-09-12T01:58:21.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.154+0000 7f723a59c640 1 --2- 172.21.15.19:0/1322050180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f723c0b5f80 0x7f723c0cacb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7234007ef0 tx=0x7f723400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:21.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.154+0000 7f7232ffd640 1 -- 172.21.15.19:0/1322050180 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723401a070 con 0x7f723c0b5f80 2024-09-12T01:58:21.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.154+0000 7f7232ffd640 1 -- 172.21.15.19:0/1322050180 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7234003b90 con 0x7f723c0b5f80 2024-09-12T01:58:21.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.154+0000 7f7240a77640 1 -- 172.21.15.19:0/1322050180 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723c0c8b80 con 0x7f723c0b5f80 2024-09-12T01:58:21.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.154+0000 7f7232ffd640 1 -- 172.21.15.19:0/1322050180 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7234004030 con 0x7f723c0b5f80 2024-09-12T01:58:21.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.154+0000 7f7240a77640 1 -- 172.21.15.19:0/1322050180 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f723c0c9140 con 0x7f723c0b5f80 2024-09-12T01:58:21.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.155+0000 7f7240a77640 1 -- 172.21.15.19:0/1322050180 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f723c0d37b0 con 0x7f723c0b5f80 2024-09-12T01:58:21.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.155+0000 7f7232ffd640 1 -- 172.21.15.19:0/1322050180 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f723401d070 con 0x7f723c0b5f80 2024-09-12T01:58:21.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.156+0000 7f7232ffd640 1 --2- 172.21.15.19:0/1322050180 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f721c06be30 0x7f721c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.156+0000 7f7232ffd640 1 -- 172.21.15.19:0/1322050180 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5835+0+0 (secure 0 0 0) 0x7f723408b080 con 0x7f723c0b5f80 2024-09-12T01:58:21.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.156+0000 7f7239d9b640 1 --2- 172.21.15.19:0/1322050180 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f721c06be30 0x7f721c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.156+0000 7f7239d9b640 1 --2- 172.21.15.19:0/1322050180 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f721c06be30 0x7f721c06e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7224034000 tx=0x7f722402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:21.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.160+0000 7f7232ffd640 1 -- 172.21.15.19:0/1322050180 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7234010070 con 0x7f723c0b5f80 2024-09-12T01:58:21.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:21.337+0000 7f7240a77640 1 -- 172.21.15.19:0/1322050180 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f723c162900 con 0x7f723c0b5f80 2024-09-12T01:58:22.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.018+0000 7f7232ffd640 1 -- 172.21.15.19:0/1322050180 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) ==== 169+0+0 (secure 0 0 0) 0x7f7234059360 con 0x7f723c0b5f80 2024-09-12T01:58:22.018 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-09-12T01:58:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.022+0000 7f7240a77640 1 -- 172.21.15.19:0/1322050180 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f721c06be30 msgr2=0x7f721c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.022+0000 7f7240a77640 1 --2- 172.21.15.19:0/1322050180 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f721c06be30 0x7f721c06e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7224034000 tx=0x7f722402e000 comp rx=0 tx=0).stop 2024-09-12T01:58:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.022+0000 7f7240a77640 1 -- 172.21.15.19:0/1322050180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f723c0b5f80 msgr2=0x7f723c0cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.022+0000 7f7240a77640 1 --2- 172.21.15.19:0/1322050180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f723c0b5f80 0x7f723c0cacb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7234007ef0 tx=0x7f723400d4a0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.023+0000 7f7240a77640 1 -- 172.21.15.19:0/1322050180 shutdown_connections 2024-09-12T01:58:22.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.023+0000 7f7240a77640 1 --2- 172.21.15.19:0/1322050180 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f721c06be30 0x7f721c06e2f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.023+0000 7f7240a77640 1 --2- 172.21.15.19:0/1322050180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f723c0d4c10 0x7f723c15c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.023+0000 7f7240a77640 1 --2- 172.21.15.19:0/1322050180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f723c0d3320 0x7f723c0b98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.023+0000 7f7240a77640 1 --2- 172.21.15.19:0/1322050180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f723c0b5f80 0x7f723c0cacb0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.023+0000 7f7240a77640 1 -- 172.21.15.19:0/1322050180 >> 172.21.15.19:0/1322050180 conn(0x7f723c08bfc0 msgr2=0x7f723c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:22.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.023+0000 7f7240a77640 1 -- 172.21.15.19:0/1322050180 shutdown_connections 2024-09-12T01:58:22.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.023+0000 7f7240a77640 1 -- 172.21.15.19:0/1322050180 wait complete. 2024-09-12T01:58:22.038 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_inject_rename_corrupt_dentry_first 2024-09-12T01:58:22.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.150+0000 7f416c837640 1 Processor -- start 2024-09-12T01:58:22.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.150+0000 7f416c837640 1 -- start start 2024-09-12T01:58:22.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.151+0000 7f416c837640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f416815c310 0x7f4168160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.151+0000 7f416c837640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41680d0370 0x7f41680d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.151+0000 7f416c837640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4168160e70 con 0x7f41680b4800 2024-09-12T01:58:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.151+0000 7f416c837640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f41680af7a0 con 0x7f416815c310 2024-09-12T01:58:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.151+0000 7f416c837640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f41680afa80 con 0x7f41680d0370 2024-09-12T01:58:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.151+0000 7f4166d9d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41680d0370 0x7f41680d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.151+0000 7f416659c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f416815c310 0x7f4168160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.151+0000 7f4166d9d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41680d0370 0x7f41680d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:51522/0 (socket says 172.21.15.19:51522) 2024-09-12T01:58:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.151+0000 7f4166d9d640 1 -- 172.21.15.19:0/1764505313 learned_addr learned my addr 172.21.15.19:0/1764505313 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.151+0000 7f4165d9b640 1 --1- 172.21.15.19:0/1764505313 >> v1:172.21.15.135:6789/0 conn(0x7f41680b4800 0x7f41680aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:41144/0 (socket says 172.21.15.19:41144) 2024-09-12T01:58:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.151+0000 7f4166d9d640 1 -- 172.21.15.19:0/1764505313 >> v2:172.21.15.135:3300/0 conn(0x7f416815c310 msgr2=0x7f4168160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.151+0000 7f4166d9d640 1 --2- 172.21.15.19:0/1764505313 >> v2:172.21.15.135:3300/0 conn(0x7f416815c310 0x7f4168160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.151+0000 7f4166d9d640 1 -- 172.21.15.19:0/1764505313 >> v1:172.21.15.135:6789/0 conn(0x7f41680b4800 legacy=0x7f41680aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.151+0000 7f4166d9d640 1 -- 172.21.15.19:0/1764505313 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4168160130 con 0x7f41680d0370 2024-09-12T01:58:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.151+0000 7f416659c640 1 --2- 172.21.15.19:0/1764505313 >> v2:172.21.15.135:3300/0 conn(0x7f416815c310 0x7f4168160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:22.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.152+0000 7f4166d9d640 1 --2- 172.21.15.19:0/1764505313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41680d0370 0x7f41680d0800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4160009e50 tx=0x7f416002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d8225f2e10b13a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.152+0000 7f416559a640 1 -- 172.21.15.19:0/1764505313 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160036070 con 0x7f41680d0370 2024-09-12T01:58:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.152+0000 7f416559a640 1 -- 172.21.15.19:0/1764505313 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4160031600 con 0x7f41680d0370 2024-09-12T01:58:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.152+0000 7f416559a640 1 -- 172.21.15.19:0/1764505313 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41600319d0 con 0x7f41680d0370 2024-09-12T01:58:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.153+0000 7f416c837640 1 -- 172.21.15.19:0/1764505313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41680d0370 msgr2=0x7f41680d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.153+0000 7f416c837640 1 --2- 172.21.15.19:0/1764505313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41680d0370 0x7f41680d0800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4160009e50 tx=0x7f416002a710 comp rx=0 tx=0).stop 2024-09-12T01:58:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.153+0000 7f416c837640 1 -- 172.21.15.19:0/1764505313 shutdown_connections 2024-09-12T01:58:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.153+0000 7f416c837640 1 --2- 172.21.15.19:0/1764505313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41680d0370 0x7f41680d0800 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.153+0000 7f416c837640 1 --2- 172.21.15.19:0/1764505313 >> v2:172.21.15.135:3300/0 conn(0x7f416815c310 0x7f4168160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.153+0000 7f416c837640 1 -- 172.21.15.19:0/1764505313 >> 172.21.15.19:0/1764505313 conn(0x7f416806bdf0 msgr2=0x7f416806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.153+0000 7f416c837640 1 -- 172.21.15.19:0/1764505313 shutdown_connections 2024-09-12T01:58:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.153+0000 7f416c837640 1 -- 172.21.15.19:0/1764505313 wait complete. 2024-09-12T01:58:22.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.154+0000 7f416c837640 1 Processor -- start 2024-09-12T01:58:22.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.154+0000 7f416c837640 1 -- start start 2024-09-12T01:58:22.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.155+0000 7f416c837640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41680b4800 0x7f4168154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.155+0000 7f416c837640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41680d0370 0x7f4168073920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.155+0000 7f416c837640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f416815c310 0x7f4168156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.155+0000 7f416c837640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f416806e090 con 0x7f41680d0370 2024-09-12T01:58:22.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.155+0000 7f416c837640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f416806df10 con 0x7f41680b4800 2024-09-12T01:58:22.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.155+0000 7f416c837640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f416806e210 con 0x7f416815c310 2024-09-12T01:58:22.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.155+0000 7f4165d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41680d0370 0x7f4168073920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.155+0000 7f4165d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41680d0370 0x7f4168073920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50184/0 (socket says 172.21.15.19:50184) 2024-09-12T01:58:22.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.155+0000 7f4165d9b640 1 -- 172.21.15.19:0/1549073940 learned_addr learned my addr 172.21.15.19:0/1549073940 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:22.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.156+0000 7f4166d9d640 1 --2- 172.21.15.19:0/1549073940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f416815c310 0x7f4168156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.156+0000 7f416659c640 1 --2- 172.21.15.19:0/1549073940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41680b4800 0x7f4168154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.156+0000 7f4165d9b640 1 -- 172.21.15.19:0/1549073940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f416815c310 msgr2=0x7f4168156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.156+0000 7f4165d9b640 1 --2- 172.21.15.19:0/1549073940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f416815c310 0x7f4168156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.156+0000 7f4165d9b640 1 -- 172.21.15.19:0/1549073940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41680b4800 msgr2=0x7f4168154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.156+0000 7f4165d9b640 1 --2- 172.21.15.19:0/1549073940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41680b4800 0x7f4168154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.156+0000 7f4165d9b640 1 -- 172.21.15.19:0/1549073940 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4168073e60 con 0x7f41680d0370 2024-09-12T01:58:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.156+0000 7f4166d9d640 1 --2- 172.21.15.19:0/1549073940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f416815c310 0x7f4168156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.156+0000 7f416659c640 1 --2- 172.21.15.19:0/1549073940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41680b4800 0x7f4168154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.156+0000 7f4165d9b640 1 --2- 172.21.15.19:0/1549073940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41680d0370 0x7f4168073920 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f415c00c430 tx=0x7f415c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.156+0000 7f4156ffd640 1 -- 172.21.15.19:0/1549073940 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c0074e0 con 0x7f41680d0370 2024-09-12T01:58:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.156+0000 7f4156ffd640 1 -- 172.21.15.19:0/1549073940 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f415c007680 con 0x7f41680d0370 2024-09-12T01:58:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.156+0000 7f4156ffd640 1 -- 172.21.15.19:0/1549073940 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c004a00 con 0x7f41680d0370 2024-09-12T01:58:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.156+0000 7f416c837640 1 -- 172.21.15.19:0/1549073940 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41681f7bc0 con 0x7f41680d0370 2024-09-12T01:58:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.156+0000 7f416c837640 1 -- 172.21.15.19:0/1549073940 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41681f8180 con 0x7f41680d0370 2024-09-12T01:58:22.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.157+0000 7f416c837640 1 -- 172.21.15.19:0/1549073940 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4168160930 con 0x7f41680d0370 2024-09-12T01:58:22.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.158+0000 7f4156ffd640 1 -- 172.21.15.19:0/1549073940 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f415c01a020 con 0x7f41680d0370 2024-09-12T01:58:22.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.158+0000 7f4156ffd640 1 --2- 172.21.15.19:0/1549073940 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f414806be30 0x7f414806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.158+0000 7f4156ffd640 1 -- 172.21.15.19:0/1549073940 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5421+0+0 (secure 0 0 0) 0x7f415c08a550 con 0x7f41680d0370 2024-09-12T01:58:22.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.159+0000 7f416659c640 1 --2- 172.21.15.19:0/1549073940 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f414806be30 0x7f414806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.159+0000 7f416659c640 1 --2- 172.21.15.19:0/1549073940 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f414806be30 0x7f414806e2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4158009af0 tx=0x7f4158008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:22.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.163+0000 7f4156ffd640 1 -- 172.21.15.19:0/1549073940 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f415c059020 con 0x7f41680d0370 2024-09-12T01:58:22.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.339+0000 7f416c837640 1 -- 172.21.15.19:0/1549073940 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"} v 0) -- 0x7f41680cfea0 con 0x7f41680d0370 2024-09-12T01:58:22.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.339+0000 7f4156ffd640 1 -- 172.21.15.19:0/1549073940 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"}]=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7f415c058920 con 0x7f41680d0370 2024-09-12T01:58:22.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.341+0000 7f416c837640 1 -- 172.21.15.19:0/1549073940 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f414806be30 msgr2=0x7f414806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.341+0000 7f416c837640 1 --2- 172.21.15.19:0/1549073940 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f414806be30 0x7f414806e2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4158009af0 tx=0x7f4158008040 comp rx=0 tx=0).stop 2024-09-12T01:58:22.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.341+0000 7f416c837640 1 -- 172.21.15.19:0/1549073940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41680d0370 msgr2=0x7f4168073920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.341+0000 7f416c837640 1 --2- 172.21.15.19:0/1549073940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41680d0370 0x7f4168073920 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f415c00c430 tx=0x7f415c00c8f0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.341+0000 7f416c837640 1 -- 172.21.15.19:0/1549073940 shutdown_connections 2024-09-12T01:58:22.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.341+0000 7f416c837640 1 --2- 172.21.15.19:0/1549073940 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f414806be30 0x7f414806e2f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.341+0000 7f416c837640 1 --2- 172.21.15.19:0/1549073940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f416815c310 0x7f4168156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.341+0000 7f416c837640 1 --2- 172.21.15.19:0/1549073940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41680d0370 0x7f4168073920 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.341+0000 7f416c837640 1 --2- 172.21.15.19:0/1549073940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41680b4800 0x7f4168154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.341+0000 7f416c837640 1 -- 172.21.15.19:0/1549073940 >> 172.21.15.19:0/1549073940 conn(0x7f416806bdf0 msgr2=0x7f416806e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:22.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.341+0000 7f416c837640 1 -- 172.21.15.19:0/1549073940 shutdown_connections 2024-09-12T01:58:22.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.341+0000 7f416c837640 1 -- 172.21.15.19:0/1549073940 wait complete. 2024-09-12T01:58:22.352 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_abort_on_newly_corrupt_dentry 2024-09-12T01:58:22.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.456+0000 7f933c22e640 1 Processor -- start 2024-09-12T01:58:22.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.456+0000 7f933c22e640 1 -- start start 2024-09-12T01:58:22.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.457+0000 7f933c22e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f933415e650 0x7f93340cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.457+0000 7f933c22e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93340cf0f0 0x7f93340cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.457+0000 7f933c22e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93340d2790 con 0x7f93340cfae0 2024-09-12T01:58:22.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.457+0000 7f933c22e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f93340b3e40 con 0x7f933415e650 2024-09-12T01:58:22.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.457+0000 7f933c22e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f93340d2a30 con 0x7f93340cf0f0 2024-09-12T01:58:22.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.457+0000 7f93397c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93340cf0f0 0x7f93340cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.457+0000 7f9339fca640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f933415e650 0x7f93340cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.457+0000 7f93397c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93340cf0f0 0x7f93340cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:51550/0 (socket says 172.21.15.19:51550) 2024-09-12T01:58:22.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.457+0000 7f933a7cb640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f93340cfae0 0x7f93341622d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:41152/0 (socket says 172.21.15.19:41152) 2024-09-12T01:58:22.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.457+0000 7f93397c9640 1 -- 172.21.15.19:0/671195458 learned_addr learned my addr 172.21.15.19:0/671195458 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:22.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.458+0000 7f9339fca640 1 -- 172.21.15.19:0/671195458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93340cf0f0 msgr2=0x7f93340cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:22.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.458+0000 7f9339fca640 1 --2- 172.21.15.19:0/671195458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93340cf0f0 0x7f93340cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.458+0000 7f9339fca640 1 -- 172.21.15.19:0/671195458 >> v1:172.21.15.135:6789/0 conn(0x7f93340cfae0 legacy=0x7f93341622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.458+0000 7f9339fca640 1 -- 172.21.15.19:0/671195458 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93340d2d10 con 0x7f933415e650 2024-09-12T01:58:22.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.458+0000 7f93397c9640 1 --2- 172.21.15.19:0/671195458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93340cf0f0 0x7f93340cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:22.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.458+0000 7f9339fca640 1 --2- 172.21.15.19:0/671195458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f933415e650 0x7f93340cebb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f93300097a0 tx=0x7f933002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fad4dc6bee56cea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:22.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.459+0000 7f9338fc8640 1 -- 172.21.15.19:0/671195458 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9330037070 con 0x7f933415e650 2024-09-12T01:58:22.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.459+0000 7f9338fc8640 1 -- 172.21.15.19:0/671195458 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9330032440 con 0x7f933415e650 2024-09-12T01:58:22.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.459+0000 7f9338fc8640 1 -- 172.21.15.19:0/671195458 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9330032810 con 0x7f933415e650 2024-09-12T01:58:22.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.459+0000 7f933c22e640 1 -- 172.21.15.19:0/671195458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f933415e650 msgr2=0x7f93340cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.459+0000 7f933c22e640 1 --2- 172.21.15.19:0/671195458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f933415e650 0x7f93340cebb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f93300097a0 tx=0x7f933002a180 comp rx=0 tx=0).stop 2024-09-12T01:58:22.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.459+0000 7f933c22e640 1 -- 172.21.15.19:0/671195458 shutdown_connections 2024-09-12T01:58:22.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.459+0000 7f933c22e640 1 --2- 172.21.15.19:0/671195458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93340cf0f0 0x7f93340cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.459+0000 7f933c22e640 1 --2- 172.21.15.19:0/671195458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f933415e650 0x7f93340cebb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.459+0000 7f933c22e640 1 -- 172.21.15.19:0/671195458 >> 172.21.15.19:0/671195458 conn(0x7f933408bfc0 msgr2=0x7f93340d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:22.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.459+0000 7f933c22e640 1 -- 172.21.15.19:0/671195458 shutdown_connections 2024-09-12T01:58:22.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.459+0000 7f933c22e640 1 -- 172.21.15.19:0/671195458 wait complete. 2024-09-12T01:58:22.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.460+0000 7f933c22e640 1 Processor -- start 2024-09-12T01:58:22.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.460+0000 7f933c22e640 1 -- start start 2024-09-12T01:58:22.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.461+0000 7f933c22e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93340cf0f0 0x7f93340ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.461+0000 7f933c22e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93340cfae0 0x7f933415c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.461+0000 7f933c22e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f933415e650 0x7f933415d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.461+0000 7f933c22e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f93340d5040 con 0x7f93340cf0f0 2024-09-12T01:58:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.461+0000 7f933c22e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93340d32d0 con 0x7f93340cfae0 2024-09-12T01:58:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.461+0000 7f933c22e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f93340d51c0 con 0x7f933415e650 2024-09-12T01:58:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.461+0000 7f9339fca640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93340cf0f0 0x7f93340ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.461+0000 7f9339fca640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93340cf0f0 0x7f93340ca4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50190/0 (socket says 172.21.15.19:50190) 2024-09-12T01:58:22.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.461+0000 7f9339fca640 1 -- 172.21.15.19:0/2118008040 learned_addr learned my addr 172.21.15.19:0/2118008040 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:22.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.461+0000 7f93397c9640 1 --2- 172.21.15.19:0/2118008040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93340cfae0 0x7f933415c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.461+0000 7f933a7cb640 1 --2- 172.21.15.19:0/2118008040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f933415e650 0x7f933415d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.462+0000 7f9339fca640 1 -- 172.21.15.19:0/2118008040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f933415e650 msgr2=0x7f933415d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.462+0000 7f9339fca640 1 --2- 172.21.15.19:0/2118008040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f933415e650 0x7f933415d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.462+0000 7f9339fca640 1 -- 172.21.15.19:0/2118008040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93340cfae0 msgr2=0x7f933415c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.462+0000 7f9339fca640 1 --2- 172.21.15.19:0/2118008040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93340cfae0 0x7f933415c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.462+0000 7f9339fca640 1 -- 172.21.15.19:0/2118008040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933415cb70 con 0x7f93340cf0f0 2024-09-12T01:58:22.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.462+0000 7f93397c9640 1 --2- 172.21.15.19:0/2118008040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93340cfae0 0x7f933415c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:22.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.462+0000 7f9339fca640 1 --2- 172.21.15.19:0/2118008040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93340cf0f0 0x7f93340ca4f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f933002a6f0 tx=0x7f93300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:22.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.462+0000 7f932a7fc640 1 -- 172.21.15.19:0/2118008040 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9330037040 con 0x7f93340cf0f0 2024-09-12T01:58:22.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.462+0000 7f932a7fc640 1 -- 172.21.15.19:0/2118008040 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93300304c0 con 0x7f93340cf0f0 2024-09-12T01:58:22.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.462+0000 7f932a7fc640 1 -- 172.21.15.19:0/2118008040 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93300308b0 con 0x7f93340cf0f0 2024-09-12T01:58:22.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.462+0000 7f933c22e640 1 -- 172.21.15.19:0/2118008040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93340b8060 con 0x7f93340cf0f0 2024-09-12T01:58:22.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.462+0000 7f933c22e640 1 -- 172.21.15.19:0/2118008040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93340c9cf0 con 0x7f93340cf0f0 2024-09-12T01:58:22.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.463+0000 7f933c22e640 1 -- 172.21.15.19:0/2118008040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f933415ea30 con 0x7f93340cf0f0 2024-09-12T01:58:22.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.464+0000 7f932a7fc640 1 -- 172.21.15.19:0/2118008040 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9330044020 con 0x7f93340cf0f0 2024-09-12T01:58:22.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.464+0000 7f932a7fc640 1 --2- 172.21.15.19:0/2118008040 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f931806be60 0x7f931806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.464+0000 7f932a7fc640 1 -- 172.21.15.19:0/2118008040 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5421+0+0 (secure 0 0 0) 0x7f93300aadf0 con 0x7f93340cf0f0 2024-09-12T01:58:22.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.464+0000 7f93397c9640 1 --2- 172.21.15.19:0/2118008040 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f931806be60 0x7f931806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.465+0000 7f93397c9640 1 --2- 172.21.15.19:0/2118008040 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f931806be60 0x7f931806e320 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9324009630 tx=0x7f9324008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:22.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.468+0000 7f932a7fc640 1 -- 172.21.15.19:0/2118008040 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f933004b020 con 0x7f93340cf0f0 2024-09-12T01:58:22.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.643+0000 7f933c22e640 1 -- 172.21.15.19:0/2118008040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_abort_on_newly_corrupt_dentry"} v 0) -- 0x7f93340b4c30 con 0x7f93340cf0f0 2024-09-12T01:58:22.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.646+0000 7f932a7fc640 1 -- 172.21.15.19:0/2118008040 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_abort_on_newly_corrupt_dentry"}]=0 v16) ==== 116+0+0 (secure 0 0 0) 0x7f93300798c0 con 0x7f93340cf0f0 2024-09-12T01:58:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.648+0000 7f933c22e640 1 -- 172.21.15.19:0/2118008040 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f931806be60 msgr2=0x7f931806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.648+0000 7f933c22e640 1 --2- 172.21.15.19:0/2118008040 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f931806be60 0x7f931806e320 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9324009630 tx=0x7f9324008040 comp rx=0 tx=0).stop 2024-09-12T01:58:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.648+0000 7f933c22e640 1 -- 172.21.15.19:0/2118008040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93340cf0f0 msgr2=0x7f93340ca4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.648+0000 7f933c22e640 1 --2- 172.21.15.19:0/2118008040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93340cf0f0 0x7f93340ca4f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f933002a6f0 tx=0x7f93300046c0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.648+0000 7f933c22e640 1 -- 172.21.15.19:0/2118008040 shutdown_connections 2024-09-12T01:58:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.648+0000 7f933c22e640 1 --2- 172.21.15.19:0/2118008040 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f931806be60 0x7f931806e320 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.648+0000 7f933c22e640 1 --2- 172.21.15.19:0/2118008040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f933415e650 0x7f933415d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.648+0000 7f933c22e640 1 --2- 172.21.15.19:0/2118008040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93340cfae0 0x7f933415c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.648+0000 7f933c22e640 1 --2- 172.21.15.19:0/2118008040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93340cf0f0 0x7f93340ca4f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.648+0000 7f933c22e640 1 -- 172.21.15.19:0/2118008040 >> 172.21.15.19:0/2118008040 conn(0x7f933408bfc0 msgr2=0x7f93340b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.648+0000 7f933c22e640 1 -- 172.21.15.19:0/2118008040 shutdown_connections 2024-09-12T01:58:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.648+0000 7f933c22e640 1 -- 172.21.15.19:0/2118008040 wait complete. 2024-09-12T01:58:22.660 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T01:58:22.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.763+0000 7f83bd08c640 1 Processor -- start 2024-09-12T01:58:22.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.763+0000 7f83bd08c640 1 -- start start 2024-09-12T01:58:22.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.764+0000 7f83bd08c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b80d5100 0x7f83b80cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.764+0000 7f83bd08c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f83b81621b0 0x7f83b8162640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.764+0000 7f83bd08c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83b80d3a60 con 0x7f83b815e640 2024-09-12T01:58:22.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.764+0000 7f83bd08c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f83b80cec40 con 0x7f83b81621b0 2024-09-12T01:58:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.764+0000 7f83bd08c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f83b80cef20 con 0x7f83b80d5100 2024-09-12T01:58:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.764+0000 7f83b6d9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f83b815e640 0x7f83b80d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41052/0 (socket says 172.21.15.19:41052) 2024-09-12T01:58:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.764+0000 7f83b6d9d640 1 -- 172.21.15.19:0/1361942441 learned_addr learned my addr 172.21.15.19:0/1361942441 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:22.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.764+0000 7f83b759e640 1 --2- 172.21.15.19:0/1361942441 >> v2:172.21.15.135:3300/0 conn(0x7f83b81621b0 0x7f83b8162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.764+0000 7f83b5d9b640 1 -- 172.21.15.19:0/1361942441 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 685406354 0 0) 0x7f83b80d3a60 con 0x7f83b815e640 2024-09-12T01:58:22.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.764+0000 7f83b659c640 1 --2- 172.21.15.19:0/1361942441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b80d5100 0x7f83b80cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b5d9b640 1 -- 172.21.15.19:0/1361942441 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83a0003520 con 0x7f83b815e640 2024-09-12T01:58:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b5d9b640 1 -- 172.21.15.19:0/1361942441 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2061949481 0 0) 0x7f83a0003520 con 0x7f83b815e640 2024-09-12T01:58:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b5d9b640 1 -- 172.21.15.19:0/1361942441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b80d5100 msgr2=0x7f83b80cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b5d9b640 1 --2- 172.21.15.19:0/1361942441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b80d5100 0x7f83b80cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b5d9b640 1 -- 172.21.15.19:0/1361942441 >> v2:172.21.15.135:3300/0 conn(0x7f83b81621b0 msgr2=0x7f83b8162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b5d9b640 1 --2- 172.21.15.19:0/1361942441 >> v2:172.21.15.135:3300/0 conn(0x7f83b81621b0 0x7f83b8162640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b5d9b640 1 -- 172.21.15.19:0/1361942441 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b80cf200 con 0x7f83b815e640 2024-09-12T01:58:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b5d9b640 1 -- 172.21.15.19:0/1361942441 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f83a8001670 con 0x7f83b815e640 2024-09-12T01:58:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b5d9b640 1 -- 172.21.15.19:0/1361942441 >> v1:172.21.15.19:6789/0 conn(0x7f83b815e640 legacy=0x7f83b80d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b5d9b640 1 --2- 172.21.15.19:0/1361942441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a00039b0 0x7f83a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b5d9b640 1 --2- 172.21.15.19:0/1361942441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b80d5100 0x7f83a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b5d9b640 1 --2- 172.21.15.19:0/1361942441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a0004d40 0x7f83a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b5d9b640 1 -- 172.21.15.19:0/1361942441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f83b80cec40 con 0x7f83a00039b0 2024-09-12T01:58:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b5d9b640 1 -- 172.21.15.19:0/1361942441 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f83b80cef20 con 0x7f83a0004d40 2024-09-12T01:58:22.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b5d9b640 1 -- 172.21.15.19:0/1361942441 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f83a000b9c0 con 0x7f83b80d5100 2024-09-12T01:58:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b6d9d640 1 --2- 172.21.15.19:0/1361942441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a00039b0 0x7f83a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b659c640 1 --2- 172.21.15.19:0/1361942441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b80d5100 0x7f83a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b759e640 1 --2- 172.21.15.19:0/1361942441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a0004d40 0x7f83a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b6d9d640 1 -- 172.21.15.19:0/1361942441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b80d5100 msgr2=0x7f83a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b6d9d640 1 --2- 172.21.15.19:0/1361942441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b80d5100 0x7f83a0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b6d9d640 1 -- 172.21.15.19:0/1361942441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a0004d40 msgr2=0x7f83a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b6d9d640 1 --2- 172.21.15.19:0/1361942441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a0004d40 0x7f83a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b6d9d640 1 -- 172.21.15.19:0/1361942441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a0003520 con 0x7f83a00039b0 2024-09-12T01:58:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b659c640 1 --2- 172.21.15.19:0/1361942441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b80d5100 0x7f83a0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.765+0000 7f83b759e640 1 --2- 172.21.15.19:0/1361942441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a0004d40 0x7f83a00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.766+0000 7f83b6d9d640 1 --2- 172.21.15.19:0/1361942441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a00039b0 0x7f83a0003dd0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f83a800c210 tx=0x7f83a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299feaeadd70d6ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.766+0000 7f83b5d9b640 1 -- 172.21.15.19:0/1361942441 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a8007d50 con 0x7f83a00039b0 2024-09-12T01:58:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.766+0000 7f83b5d9b640 1 -- 172.21.15.19:0/1361942441 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a8005ad0 con 0x7f83a00039b0 2024-09-12T01:58:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.766+0000 7f83b5d9b640 1 -- 172.21.15.19:0/1361942441 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a8007070 con 0x7f83a00039b0 2024-09-12T01:58:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.767+0000 7f83bd08c640 1 -- 172.21.15.19:0/1361942441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a00039b0 msgr2=0x7f83a0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.767+0000 7f83bd08c640 1 --2- 172.21.15.19:0/1361942441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a00039b0 0x7f83a0003dd0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f83a800c210 tx=0x7f83a0005830 comp rx=0 tx=0).stop 2024-09-12T01:58:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.767+0000 7f83b759e640 1 -- 172.21.15.19:0/1361942441 reap_dead start 2024-09-12T01:58:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.767+0000 7f83bd08c640 1 -- 172.21.15.19:0/1361942441 shutdown_connections 2024-09-12T01:58:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.767+0000 7f83bd08c640 1 -- 172.21.15.19:0/1361942441 >> 172.21.15.19:0/1361942441 conn(0x7f83b808bfc0 msgr2=0x7f83b80d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.767+0000 7f83bd08c640 1 -- 172.21.15.19:0/1361942441 shutdown_connections 2024-09-12T01:58:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.767+0000 7f83bd08c640 1 -- 172.21.15.19:0/1361942441 wait complete. 2024-09-12T01:58:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.768+0000 7f83bd08c640 1 Processor -- start 2024-09-12T01:58:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.768+0000 7f83bd08c640 1 -- start start 2024-09-12T01:58:22.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.769+0000 7f83bd08c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83a00039b0 0x7f83b8153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.769+0000 7f83bd08c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83b80cb620 0x7f83b81f5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.769+0000 7f83bd08c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b80c8f30 0x7f83b80cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.769+0000 7f83bd08c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f83b80cfa00 con 0x7f83b80cb620 2024-09-12T01:58:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.769+0000 7f83bd08c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f83b815ea20 con 0x7f83b80c8f30 2024-09-12T01:58:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.769+0000 7f83bd08c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f83b80cfb80 con 0x7f83a00039b0 2024-09-12T01:58:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.769+0000 7f83b659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83b80cb620 0x7f83b81f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.769+0000 7f83b659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83b80cb620 0x7f83b81f5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50216/0 (socket says 172.21.15.19:50216) 2024-09-12T01:58:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.769+0000 7f83b659c640 1 -- 172.21.15.19:0/830736466 learned_addr learned my addr 172.21.15.19:0/830736466 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.769+0000 7f83b6d9d640 1 --2- 172.21.15.19:0/830736466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83a00039b0 0x7f83b8153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.769+0000 7f83b759e640 1 --2- 172.21.15.19:0/830736466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b80c8f30 0x7f83b80cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.769+0000 7f83b659c640 1 -- 172.21.15.19:0/830736466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83a00039b0 msgr2=0x7f83b8153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.769+0000 7f83b659c640 1 --2- 172.21.15.19:0/830736466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83a00039b0 0x7f83b8153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.769+0000 7f83b659c640 1 -- 172.21.15.19:0/830736466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b80c8f30 msgr2=0x7f83b80cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.769+0000 7f83b659c640 1 --2- 172.21.15.19:0/830736466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b80c8f30 0x7f83b80cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.769+0000 7f83b659c640 1 -- 172.21.15.19:0/830736466 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b80cd220 con 0x7f83b80cb620 2024-09-12T01:58:22.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.770+0000 7f83b659c640 1 --2- 172.21.15.19:0/830736466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83b80cb620 0x7f83b81f5540 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f83ac011600 tx=0x7f83ac011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:22.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.770+0000 7f839f7fe640 1 -- 172.21.15.19:0/830736466 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00f920 con 0x7f83b80cb620 2024-09-12T01:58:22.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.770+0000 7f839f7fe640 1 -- 172.21.15.19:0/830736466 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ac00fac0 con 0x7f83b80cb620 2024-09-12T01:58:22.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.770+0000 7f83bd08c640 1 -- 172.21.15.19:0/830736466 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b81f5a80 con 0x7f83b80cb620 2024-09-12T01:58:22.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.770+0000 7f839f7fe640 1 -- 172.21.15.19:0/830736466 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00fe90 con 0x7f83b80cb620 2024-09-12T01:58:22.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.770+0000 7f83bd08c640 1 -- 172.21.15.19:0/830736466 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b80cd4c0 con 0x7f83b80cb620 2024-09-12T01:58:22.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.771+0000 7f83bd08c640 1 -- 172.21.15.19:0/830736466 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83b806d160 con 0x7f83b80cb620 2024-09-12T01:58:22.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.772+0000 7f839f7fe640 1 -- 172.21.15.19:0/830736466 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83ac015460 con 0x7f83b80cb620 2024-09-12T01:58:22.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.772+0000 7f839f7fe640 1 --2- 172.21.15.19:0/830736466 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f83a406bfd0 0x7f83a406e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.772+0000 7f839f7fe640 1 -- 172.21.15.19:0/830736466 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5421+0+0 (secure 0 0 0) 0x7f83ac08b4f0 con 0x7f83b80cb620 2024-09-12T01:58:22.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.772+0000 7f83b6d9d640 1 --2- 172.21.15.19:0/830736466 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f83a406bfd0 0x7f83a406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.773+0000 7f83b6d9d640 1 --2- 172.21.15.19:0/830736466 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f83a406bfd0 0x7f83a406e490 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f83a8033000 tx=0x7f83a8009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:22.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.776+0000 7f839f7fe640 1 -- 172.21.15.19:0/830736466 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f83b806d160 con 0x7f83b80cb620 2024-09-12T01:58:22.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.962+0000 7f83bd08c640 1 -- 172.21.15.19:0/830736466 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f83b80cff10 con 0x7f83b80cb620 2024-09-12T01:58:22.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.965+0000 7f839f7fe640 1 -- 172.21.15.19:0/830736466 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f83ac019030 con 0x7f83b80cb620 2024-09-12T01:58:22.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.967+0000 7f83bd08c640 1 -- 172.21.15.19:0/830736466 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f83a406bfd0 msgr2=0x7f83a406e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.967+0000 7f83bd08c640 1 --2- 172.21.15.19:0/830736466 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f83a406bfd0 0x7f83a406e490 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f83a8033000 tx=0x7f83a8009030 comp rx=0 tx=0).stop 2024-09-12T01:58:22.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.967+0000 7f83bd08c640 1 -- 172.21.15.19:0/830736466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83b80cb620 msgr2=0x7f83b81f5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.967+0000 7f83bd08c640 1 --2- 172.21.15.19:0/830736466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83b80cb620 0x7f83b81f5540 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f83ac011600 tx=0x7f83ac011ac0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.967+0000 7f83bd08c640 1 -- 172.21.15.19:0/830736466 shutdown_connections 2024-09-12T01:58:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.967+0000 7f83bd08c640 1 --2- 172.21.15.19:0/830736466 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f83a406bfd0 0x7f83a406e490 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.967+0000 7f83bd08c640 1 --2- 172.21.15.19:0/830736466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b80c8f30 0x7f83b80cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.967+0000 7f83bd08c640 1 --2- 172.21.15.19:0/830736466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83b80cb620 0x7f83b81f5540 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.967+0000 7f83bd08c640 1 --2- 172.21.15.19:0/830736466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83a00039b0 0x7f83b8153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.968+0000 7f83bd08c640 1 -- 172.21.15.19:0/830736466 >> 172.21.15.19:0/830736466 conn(0x7f83b808bfc0 msgr2=0x7f83b80d2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.968+0000 7f83bd08c640 1 -- 172.21.15.19:0/830736466 shutdown_connections 2024-09-12T01:58:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:22.968+0000 7f83bd08c640 1 -- 172.21.15.19:0/830736466 wait complete. 2024-09-12T01:58:22.979 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_existing' 2024-09-12T01:58:23.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.083+0000 7ff6a3352640 1 Processor -- start 2024-09-12T01:58:23.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.084+0000 7ff6a3352640 1 -- start start 2024-09-12T01:58:23.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.084+0000 7ff6a3352640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff69c0b6680 0x7ff69c169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:23.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.084+0000 7ff6a3352640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69c06d9f0 con 0x7ff69c162060 2024-09-12T01:58:23.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.084+0000 7ff6a3352640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69c06dcd0 con 0x7ff69c161c80 2024-09-12T01:58:23.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.084+0000 7ff6a3352640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff69c06dfb0 con 0x7ff69c0b6680 2024-09-12T01:58:23.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff6a08ed640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff69c162060 0x7ff69c0b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41066/0 (socket says 172.21.15.19:41066) 2024-09-12T01:58:23.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff6a08ed640 1 -- 172.21.15.19:0/447177894 learned_addr learned my addr 172.21.15.19:0/447177894 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:23.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff69bfff640 1 -- 172.21.15.19:0/447177894 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3601310505 0 0) 0x7ff69c06d9f0 con 0x7ff69c162060 2024-09-12T01:58:23.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff6a18ef640 1 --2- 172.21.15.19:0/447177894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff69c0b6680 0x7ff69c169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:23.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff69bfff640 1 -- 172.21.15.19:0/447177894 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff684003520 con 0x7ff69c162060 2024-09-12T01:58:23.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff69bfff640 1 -- 172.21.15.19:0/447177894 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1743544741 0 0) 0x7ff684003520 con 0x7ff69c162060 2024-09-12T01:58:23.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff69bfff640 1 -- 172.21.15.19:0/447177894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff69c0b6680 msgr2=0x7ff69c169830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:23.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff69bfff640 1 --2- 172.21.15.19:0/447177894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff69c0b6680 0x7ff69c169830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:23.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff69bfff640 1 -- 172.21.15.19:0/447177894 >> v1:172.21.15.135:6789/0 conn(0x7ff69c161c80 legacy=0x7ff69c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:23.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff69bfff640 1 -- 172.21.15.19:0/447177894 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c0d01f0 con 0x7ff69c162060 2024-09-12T01:58:23.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff69bfff640 1 -- 172.21.15.19:0/447177894 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7ff690001670 con 0x7ff69c162060 2024-09-12T01:58:23.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff69bfff640 1 -- 172.21.15.19:0/447177894 >> v1:172.21.15.19:6789/0 conn(0x7ff69c162060 legacy=0x7ff69c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:23.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff69bfff640 1 --2- 172.21.15.19:0/447177894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6840039e0 0x7ff684003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:23.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff69bfff640 1 --2- 172.21.15.19:0/447177894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff684004390 0x7ff684004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:23.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff69bfff640 1 --2- 172.21.15.19:0/447177894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff69c0b6680 0x7ff6840050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:23.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff69bfff640 1 -- 172.21.15.19:0/447177894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c06dfb0 con 0x7ff6840039e0 2024-09-12T01:58:23.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff69bfff640 1 -- 172.21.15.19:0/447177894 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff68400b9f0 con 0x7ff684004390 2024-09-12T01:58:23.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff69bfff640 1 -- 172.21.15.19:0/447177894 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff68400bbf0 con 0x7ff69c0b6680 2024-09-12T01:58:23.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.085+0000 7ff6a10ee640 1 --2- 172.21.15.19:0/447177894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6840039e0 0x7ff684003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:23.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.086+0000 7ff6a18ef640 1 --2- 172.21.15.19:0/447177894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff69c0b6680 0x7ff6840050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:23.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.086+0000 7ff6a08ed640 1 --2- 172.21.15.19:0/447177894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff684004390 0x7ff684004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:23.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.086+0000 7ff6a10ee640 1 -- 172.21.15.19:0/447177894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff69c0b6680 msgr2=0x7ff6840050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:23.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.086+0000 7ff6a10ee640 1 --2- 172.21.15.19:0/447177894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff69c0b6680 0x7ff6840050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:23.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.086+0000 7ff6a10ee640 1 -- 172.21.15.19:0/447177894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff684004390 msgr2=0x7ff684004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:23.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.086+0000 7ff6a10ee640 1 --2- 172.21.15.19:0/447177894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff684004390 0x7ff684004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:23.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.086+0000 7ff6a10ee640 1 -- 172.21.15.19:0/447177894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff684003520 con 0x7ff6840039e0 2024-09-12T01:58:23.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.086+0000 7ff6a10ee640 1 --2- 172.21.15.19:0/447177894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6840039e0 0x7ff684003dc0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff694001860 tx=0x7ff684005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efbd2d859afe4123 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:23.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.087+0000 7ff69bfff640 1 -- 172.21.15.19:0/447177894 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff694037070 con 0x7ff6840039e0 2024-09-12T01:58:23.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.087+0000 7ff69bfff640 1 -- 172.21.15.19:0/447177894 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff69402ac30 con 0x7ff6840039e0 2024-09-12T01:58:23.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.087+0000 7ff69bfff640 1 -- 172.21.15.19:0/447177894 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff694001430 con 0x7ff6840039e0 2024-09-12T01:58:23.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.087+0000 7ff6a3352640 1 -- 172.21.15.19:0/447177894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6840039e0 msgr2=0x7ff684003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:23.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.087+0000 7ff6a3352640 1 --2- 172.21.15.19:0/447177894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6840039e0 0x7ff684003dc0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff694001860 tx=0x7ff684005830 comp rx=0 tx=0).stop 2024-09-12T01:58:23.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.087+0000 7ff6a18ef640 1 -- 172.21.15.19:0/447177894 reap_dead start 2024-09-12T01:58:23.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.087+0000 7ff6a3352640 1 -- 172.21.15.19:0/447177894 shutdown_connections 2024-09-12T01:58:23.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.087+0000 7ff6a3352640 1 -- 172.21.15.19:0/447177894 >> 172.21.15.19:0/447177894 conn(0x7ff69c0d44f0 msgr2=0x7ff69c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:23.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.087+0000 7ff6a3352640 1 -- 172.21.15.19:0/447177894 shutdown_connections 2024-09-12T01:58:23.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.087+0000 7ff6a3352640 1 -- 172.21.15.19:0/447177894 wait complete. 2024-09-12T01:58:23.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.088+0000 7ff6a3352640 1 Processor -- start 2024-09-12T01:58:23.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.088+0000 7ff6a3352640 1 -- start start 2024-09-12T01:58:23.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.089+0000 7ff6a3352640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6840039e0 0x7ff69c157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:23.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.089+0000 7ff6a3352640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff69c1580d0 0x7ff69c146030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:23.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.089+0000 7ff6a3352640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff69c146570 0x7ff69c146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:23.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.089+0000 7ff6a3352640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c0b6cb0 con 0x7ff6840039e0 2024-09-12T01:58:23.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.089+0000 7ff6a3352640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c0b6b30 con 0x7ff69c1580d0 2024-09-12T01:58:23.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.089+0000 7ff6a3352640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff69c167820 con 0x7ff69c146570 2024-09-12T01:58:23.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.089+0000 7ff6a10ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6840039e0 0x7ff69c157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:23.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.089+0000 7ff6a10ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6840039e0 0x7ff69c157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50240/0 (socket says 172.21.15.19:50240) 2024-09-12T01:58:23.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.089+0000 7ff6a10ee640 1 -- 172.21.15.19:0/350374352 learned_addr learned my addr 172.21.15.19:0/350374352 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:23.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.089+0000 7ff6a08ed640 1 --2- 172.21.15.19:0/350374352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff69c1580d0 0x7ff69c146030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:23.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.089+0000 7ff6a18ef640 1 --2- 172.21.15.19:0/350374352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff69c146570 0x7ff69c146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:23.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.090+0000 7ff6a10ee640 1 -- 172.21.15.19:0/350374352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff69c146570 msgr2=0x7ff69c146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:23.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.090+0000 7ff6a10ee640 1 --2- 172.21.15.19:0/350374352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff69c146570 0x7ff69c146a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:23.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.090+0000 7ff6a10ee640 1 -- 172.21.15.19:0/350374352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff69c1580d0 msgr2=0x7ff69c146030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:23.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.090+0000 7ff6a10ee640 1 --2- 172.21.15.19:0/350374352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff69c1580d0 0x7ff69c146030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:23.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.090+0000 7ff6a10ee640 1 -- 172.21.15.19:0/350374352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c15fb60 con 0x7ff6840039e0 2024-09-12T01:58:23.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.090+0000 7ff6a10ee640 1 --2- 172.21.15.19:0/350374352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6840039e0 0x7ff69c157880 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff694001950 tx=0x7ff694001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:23.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.090+0000 7ff699ffb640 1 -- 172.21.15.19:0/350374352 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff694040020 con 0x7ff6840039e0 2024-09-12T01:58:23.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.090+0000 7ff699ffb640 1 -- 172.21.15.19:0/350374352 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff694005270 con 0x7ff6840039e0 2024-09-12T01:58:23.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.090+0000 7ff6a3352640 1 -- 172.21.15.19:0/350374352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff69c146f60 con 0x7ff6840039e0 2024-09-12T01:58:23.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.090+0000 7ff699ffb640 1 -- 172.21.15.19:0/350374352 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff694037040 con 0x7ff6840039e0 2024-09-12T01:58:23.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.090+0000 7ff6a3352640 1 -- 172.21.15.19:0/350374352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff69c15f880 con 0x7ff6840039e0 2024-09-12T01:58:23.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.091+0000 7ff6a3352640 1 -- 172.21.15.19:0/350374352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69c06dcd0 con 0x7ff6840039e0 2024-09-12T01:58:23.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.092+0000 7ff699ffb640 1 -- 172.21.15.19:0/350374352 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff694043020 con 0x7ff6840039e0 2024-09-12T01:58:23.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.092+0000 7ff699ffb640 1 --2- 172.21.15.19:0/350374352 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff68806be60 0x7ff68806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:23.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.092+0000 7ff699ffb640 1 -- 172.21.15.19:0/350374352 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5421+0+0 (secure 0 0 0) 0x7ff6940aad80 con 0x7ff6840039e0 2024-09-12T01:58:23.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.092+0000 7ff6a08ed640 1 --2- 172.21.15.19:0/350374352 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff68806be60 0x7ff68806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:23.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.093+0000 7ff6a08ed640 1 --2- 172.21.15.19:0/350374352 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff68806be60 0x7ff68806e320 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff69c159130 tx=0x7ff690001b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:23.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.096+0000 7ff699ffb640 1 -- 172.21.15.19:0/350374352 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff69c06dcd0 con 0x7ff6840039e0 2024-09-12T01:58:23.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:23.337+0000 7ff6a3352640 1 -- 172.21.15.19:0/350374352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_existing"]} v 0) -- 0x7ff69c068ea0 con 0x7ff6840039e0 2024-09-12T01:58:24.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.024+0000 7ff699ffb640 1 -- 172.21.15.19:0/350374352 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_existing"]}]=0 v145) ==== 141+0+0 (secure 0 0 0) 0x7ff69c068ea0 con 0x7ff6840039e0 2024-09-12T01:58:24.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.027+0000 7ff6a3352640 1 -- 172.21.15.19:0/350374352 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff68806be60 msgr2=0x7ff68806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.027+0000 7ff6a3352640 1 --2- 172.21.15.19:0/350374352 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff68806be60 0x7ff68806e320 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff69c159130 tx=0x7ff690001b80 comp rx=0 tx=0).stop 2024-09-12T01:58:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.027+0000 7ff6a3352640 1 -- 172.21.15.19:0/350374352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6840039e0 msgr2=0x7ff69c157880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.027+0000 7ff6a3352640 1 --2- 172.21.15.19:0/350374352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6840039e0 0x7ff69c157880 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff694001950 tx=0x7ff694001230 comp rx=0 tx=0).stop 2024-09-12T01:58:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.027+0000 7ff6a3352640 1 -- 172.21.15.19:0/350374352 shutdown_connections 2024-09-12T01:58:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.027+0000 7ff6a3352640 1 --2- 172.21.15.19:0/350374352 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff68806be60 0x7ff68806e320 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.027+0000 7ff6a3352640 1 --2- 172.21.15.19:0/350374352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff69c146570 0x7ff69c146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.027+0000 7ff6a3352640 1 --2- 172.21.15.19:0/350374352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff69c1580d0 0x7ff69c146030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.027+0000 7ff6a3352640 1 --2- 172.21.15.19:0/350374352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6840039e0 0x7ff69c157880 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.027+0000 7ff6a3352640 1 -- 172.21.15.19:0/350374352 >> 172.21.15.19:0/350374352 conn(0x7ff69c0d44f0 msgr2=0x7ff69c0b5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.027+0000 7ff6a3352640 1 -- 172.21.15.19:0/350374352 shutdown_connections 2024-09-12T01:58:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.027+0000 7ff6a3352640 1 -- 172.21.15.19:0/350374352 wait complete. 2024-09-12T01:58:24.041 INFO:tasks.cephfs_test_runner:That the MDS won't abort when the dentry is already known to be damaged. ... ok 2024-09-12T01:58:24.042 INFO:tasks.cephfs_test_runner:Starting test: test_dentry_first_precommit (tasks.cephfs.test_damage.TestDamage) That the MDS won't write a dentry with new damage to CDentry::first 2024-09-12T01:58:24.042 INFO:tasks.cephfs_test_runner:test_dentry_first_precommit (tasks.cephfs.test_damage.TestDamage) 2024-09-12T01:58:24.042 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:58:24.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.151+0000 7f1d3674b640 1 Processor -- start 2024-09-12T01:58:24.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.151+0000 7f1d3674b640 1 -- start start 2024-09-12T01:58:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.151+0000 7f1d3674b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d3015b300 0x7f1d300cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d3674b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d300cdbe0 con 0x7f1d300cd3f0 2024-09-12T01:58:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d3674b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d300cd900 con 0x7f1d3006f8d0 2024-09-12T01:58:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d3674b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1d300728a0 con 0x7f1d3015b300 2024-09-12T01:58:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d2f7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1d300cd3f0 0x7f1d3006f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41070/0 (socket says 172.21.15.19:41070) 2024-09-12T01:58:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d2f7fe640 1 -- 172.21.15.19:0/1425555839 learned_addr learned my addr 172.21.15.19:0/1425555839 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d2effd640 1 -- 172.21.15.19:0/1425555839 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2202429311 0 0) 0x7f1d300cdbe0 con 0x7f1d300cd3f0 2024-09-12T01:58:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d2effd640 1 -- 172.21.15.19:0/1425555839 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d18003520 con 0x7f1d300cd3f0 2024-09-12T01:58:24.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d2effd640 1 -- 172.21.15.19:0/1425555839 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2113990454 0 0) 0x7f1d18003520 con 0x7f1d300cd3f0 2024-09-12T01:58:24.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d2effd640 1 -- 172.21.15.19:0/1425555839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d3015b300 msgr2=0x7f1d300cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:24.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d2effd640 1 --2- 172.21.15.19:0/1425555839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d3015b300 0x7f1d300cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d2effd640 1 -- 172.21.15.19:0/1425555839 >> v1:172.21.15.135:6789/0 conn(0x7f1d3006f8d0 legacy=0x7f1d3015b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:24.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d2effd640 1 -- 172.21.15.19:0/1425555839 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d30072250 con 0x7f1d300cd3f0 2024-09-12T01:58:24.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d2effd640 1 -- 172.21.15.19:0/1425555839 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f1d24001670 con 0x7f1d300cd3f0 2024-09-12T01:58:24.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d2effd640 1 -- 172.21.15.19:0/1425555839 >> v1:172.21.15.19:6789/0 conn(0x7f1d300cd3f0 legacy=0x7f1d3006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d2effd640 1 --2- 172.21.15.19:0/1425555839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d180039e0 0x7f1d18003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d2effd640 1 --2- 172.21.15.19:0/1425555839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d3015b300 0x7f1d18004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d2effd640 1 --2- 172.21.15.19:0/1425555839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d18004db0 0x7f1d18005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d2effd640 1 -- 172.21.15.19:0/1425555839 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1d300728a0 con 0x7f1d180039e0 2024-09-12T01:58:24.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d2effd640 1 -- 172.21.15.19:0/1425555839 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1800bbd0 con 0x7f1d18004db0 2024-09-12T01:58:24.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d2effd640 1 -- 172.21.15.19:0/1425555839 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1d1800bdd0 con 0x7f1d3015b300 2024-09-12T01:58:24.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.152+0000 7f1d2ffff640 1 --2- 172.21.15.19:0/1425555839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d180039e0 0x7f1d18003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.153+0000 7f1d2ffff640 1 -- 172.21.15.19:0/1425555839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d3015b300 msgr2=0x7f1d18004800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:58:24.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.153+0000 7f1d2ffff640 1 --2- 172.21.15.19:0/1425555839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d3015b300 0x7f1d18004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.153+0000 7f1d2ffff640 1 -- 172.21.15.19:0/1425555839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d18004db0 msgr2=0x7f1d18005230 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:58:24.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.153+0000 7f1d2ffff640 1 --2- 172.21.15.19:0/1425555839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d18004db0 0x7f1d18005230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.153+0000 7f1d2ffff640 1 -- 172.21.15.19:0/1425555839 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d18003520 con 0x7f1d180039e0 2024-09-12T01:58:24.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.153+0000 7f1d2ffff640 1 --2- 172.21.15.19:0/1425555839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d180039e0 0x7f1d18003de0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1d20006fd0 tx=0x7f1d18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fe1268ccdf1b90 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:24.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.154+0000 7f1d2effd640 1 -- 172.21.15.19:0/1425555839 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d20037070 con 0x7f1d180039e0 2024-09-12T01:58:24.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.154+0000 7f1d2effd640 1 -- 172.21.15.19:0/1425555839 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d2002a9a0 con 0x7f1d180039e0 2024-09-12T01:58:24.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.154+0000 7f1d2effd640 1 -- 172.21.15.19:0/1425555839 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d20009460 con 0x7f1d180039e0 2024-09-12T01:58:24.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.154+0000 7f1d3674b640 1 -- 172.21.15.19:0/1425555839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d180039e0 msgr2=0x7f1d18003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.154+0000 7f1d3674b640 1 --2- 172.21.15.19:0/1425555839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d180039e0 0x7f1d18003de0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1d20006fd0 tx=0x7f1d18005830 comp rx=0 tx=0).stop 2024-09-12T01:58:24.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.154+0000 7f1d34ce8640 1 -- 172.21.15.19:0/1425555839 reap_dead start 2024-09-12T01:58:24.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.154+0000 7f1d3674b640 1 -- 172.21.15.19:0/1425555839 shutdown_connections 2024-09-12T01:58:24.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.154+0000 7f1d3674b640 1 -- 172.21.15.19:0/1425555839 >> 172.21.15.19:0/1425555839 conn(0x7f1d30067d70 msgr2=0x7f1d3006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:24.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.154+0000 7f1d3674b640 1 -- 172.21.15.19:0/1425555839 shutdown_connections 2024-09-12T01:58:24.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.154+0000 7f1d3674b640 1 -- 172.21.15.19:0/1425555839 wait complete. 2024-09-12T01:58:24.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.155+0000 7f1d3674b640 1 Processor -- start 2024-09-12T01:58:24.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.156+0000 7f1d3674b640 1 -- start start 2024-09-12T01:58:24.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.156+0000 7f1d3674b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d180039e0 0x7f1d3015d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.156+0000 7f1d3674b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d301592d0 0x7f1d3014adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.156+0000 7f1d3674b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d3014b6e0 0x7f1d301e7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.156+0000 7f1d3674b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1d300d0160 con 0x7f1d3014b6e0 2024-09-12T01:58:24.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.156+0000 7f1d3674b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1d300cffe0 con 0x7f1d301592d0 2024-09-12T01:58:24.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.156+0000 7f1d3674b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1d30072d30 con 0x7f1d180039e0 2024-09-12T01:58:24.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.157+0000 7f1d34ce8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d3014b6e0 0x7f1d301e7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.157+0000 7f1d34ce8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d3014b6e0 0x7f1d301e7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50262/0 (socket says 172.21.15.19:50262) 2024-09-12T01:58:24.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.157+0000 7f1d34ce8640 1 -- 172.21.15.19:0/3223317093 learned_addr learned my addr 172.21.15.19:0/3223317093 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:24.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.157+0000 7f1d2f7fe640 1 --2- 172.21.15.19:0/3223317093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d301592d0 0x7f1d3014adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.157+0000 7f1d2ffff640 1 --2- 172.21.15.19:0/3223317093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d180039e0 0x7f1d3015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.157+0000 7f1d34ce8640 1 -- 172.21.15.19:0/3223317093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d180039e0 msgr2=0x7f1d3015d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.157+0000 7f1d34ce8640 1 --2- 172.21.15.19:0/3223317093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d180039e0 0x7f1d3015d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.157+0000 7f1d34ce8640 1 -- 172.21.15.19:0/3223317093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d301592d0 msgr2=0x7f1d3014adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.157+0000 7f1d34ce8640 1 --2- 172.21.15.19:0/3223317093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d301592d0 0x7f1d3014adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.157+0000 7f1d34ce8640 1 -- 172.21.15.19:0/3223317093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3014b2f0 con 0x7f1d3014b6e0 2024-09-12T01:58:24.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.157+0000 7f1d34ce8640 1 --2- 172.21.15.19:0/3223317093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d3014b6e0 0x7f1d301e7e70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1d300b57e0 tx=0x7f1d2800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:24.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.157+0000 7f1d2cff9640 1 -- 172.21.15.19:0/3223317093 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d28004d10 con 0x7f1d3014b6e0 2024-09-12T01:58:24.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.157+0000 7f1d2cff9640 1 -- 172.21.15.19:0/3223317093 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d28007110 con 0x7f1d3014b6e0 2024-09-12T01:58:24.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.157+0000 7f1d3674b640 1 -- 172.21.15.19:0/3223317093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d300a9800 con 0x7f1d3014b6e0 2024-09-12T01:58:24.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.157+0000 7f1d2cff9640 1 -- 172.21.15.19:0/3223317093 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d28007500 con 0x7f1d3014b6e0 2024-09-12T01:58:24.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.157+0000 7f1d3674b640 1 -- 172.21.15.19:0/3223317093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d300a9dc0 con 0x7f1d3014b6e0 2024-09-12T01:58:24.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.158+0000 7f1d3674b640 1 -- 172.21.15.19:0/3223317093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d3006f220 con 0x7f1d3014b6e0 2024-09-12T01:58:24.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.159+0000 7f1d2cff9640 1 -- 172.21.15.19:0/3223317093 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1d28011070 con 0x7f1d3014b6e0 2024-09-12T01:58:24.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.159+0000 7f1d2cff9640 1 --2- 172.21.15.19:0/3223317093 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1d1c06be30 0x7f1d1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.160+0000 7f1d2cff9640 1 -- 172.21.15.19:0/3223317093 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5421+0+0 (secure 0 0 0) 0x7f1d2808a460 con 0x7f1d3014b6e0 2024-09-12T01:58:24.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.160+0000 7f1d2ffff640 1 --2- 172.21.15.19:0/3223317093 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1d1c06be30 0x7f1d1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.160+0000 7f1d2ffff640 1 --2- 172.21.15.19:0/3223317093 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1d1c06be30 0x7f1d1c06e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1d20034000 tx=0x7f1d2002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:24.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.164+0000 7f1d2cff9640 1 -- 172.21.15.19:0/3223317093 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1d2801a060 con 0x7f1d3014b6e0 2024-09-12T01:58:24.246 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:58:24.249 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:58:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.340+0000 7f1d3674b640 1 -- 172.21.15.19:0/3223317093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d3006d090 con 0x7f1d3014b6e0 2024-09-12T01:58:24.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.341+0000 7f1d2cff9640 1 -- 172.21.15.19:0/3223317093 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+13423 (secure 0 0 0) 0x7f1d3014b2f0 con 0x7f1d3014b6e0 2024-09-12T01:58:24.342 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:24.342 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":58,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:58:22.017729+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6835/3491125255":"2024-09-13T01:58:19.002043+0000","172.21.15.19:6834/3491125255":"2024-09-13T01:58:19.002043+0000","172.21.15.19:6835/1076479859":"2024-09-13T01:58:12.823966+0000","172.21.15.19:6834/1076479859":"2024-09-13T01:58:12.823966+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:58:24.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.343+0000 7f1d3674b640 1 -- 172.21.15.19:0/3223317093 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1d1c06be30 msgr2=0x7f1d1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.343+0000 7f1d3674b640 1 --2- 172.21.15.19:0/3223317093 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1d1c06be30 0x7f1d1c06e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1d20034000 tx=0x7f1d2002e000 comp rx=0 tx=0).stop 2024-09-12T01:58:24.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.344+0000 7f1d3674b640 1 -- 172.21.15.19:0/3223317093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d3014b6e0 msgr2=0x7f1d301e7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.344+0000 7f1d3674b640 1 --2- 172.21.15.19:0/3223317093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d3014b6e0 0x7f1d301e7e70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1d300b57e0 tx=0x7f1d2800cb90 comp rx=0 tx=0).stop 2024-09-12T01:58:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.344+0000 7f1d3674b640 1 -- 172.21.15.19:0/3223317093 shutdown_connections 2024-09-12T01:58:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.344+0000 7f1d3674b640 1 --2- 172.21.15.19:0/3223317093 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1d1c06be30 0x7f1d1c06e2f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.344+0000 7f1d3674b640 1 --2- 172.21.15.19:0/3223317093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d3014b6e0 0x7f1d301e7e70 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.344+0000 7f1d3674b640 1 --2- 172.21.15.19:0/3223317093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d301592d0 0x7f1d3014adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.344+0000 7f1d3674b640 1 --2- 172.21.15.19:0/3223317093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d180039e0 0x7f1d3015d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.344+0000 7f1d3674b640 1 -- 172.21.15.19:0/3223317093 >> 172.21.15.19:0/3223317093 conn(0x7f1d30067d70 msgr2=0x7f1d300c6750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.344+0000 7f1d3674b640 1 -- 172.21.15.19:0/3223317093 shutdown_connections 2024-09-12T01:58:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.344+0000 7f1d3674b640 1 -- 172.21.15.19:0/3223317093 wait complete. 2024-09-12T01:58:24.355 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:55:44.127030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:58:24.356 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:58:24.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.500+0000 7f8d250d7640 1 Processor -- start 2024-09-12T01:58:24.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.500+0000 7f8d250d7640 1 -- start start 2024-09-12T01:58:24.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.501+0000 7f8d250d7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d2006d740 0x7f8d200cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.501+0000 7f8d250d7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d2015ff70 con 0x7f8d20162340 2024-09-12T01:58:24.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.501+0000 7f8d250d7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d200d4d10 con 0x7f8d20162e30 2024-09-12T01:58:24.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.501+0000 7f8d250d7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8d2006de90 con 0x7f8d2006d740 2024-09-12T01:58:24.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.501+0000 7f8d1f59e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d2006d740 0x7f8d200cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.501+0000 7f8d1ed9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8d20162340 0x7f8d20162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41082/0 (socket says 172.21.15.19:41082) 2024-09-12T01:58:24.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.501+0000 7f8d1ed9d640 1 -- 172.21.15.19:0/3440090297 learned_addr learned my addr 172.21.15.19:0/3440090297 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:24.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.502+0000 7f8d1dd9b640 1 -- 172.21.15.19:0/3440090297 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3743434202 0 0) 0x7f8d2015ff70 con 0x7f8d20162340 2024-09-12T01:58:24.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.502+0000 7f8d1dd9b640 1 -- 172.21.15.19:0/3440090297 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d0c003520 con 0x7f8d20162340 2024-09-12T01:58:24.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.502+0000 7f8d1f59e640 1 -- 172.21.15.19:0/3440090297 >> v1:172.21.15.135:6789/0 conn(0x7f8d20162e30 legacy=0x7f8d200d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:24.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.502+0000 7f8d1f59e640 1 -- 172.21.15.19:0/3440090297 >> v1:172.21.15.19:6789/0 conn(0x7f8d20162340 legacy=0x7f8d20162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.502+0000 7f8d1f59e640 1 -- 172.21.15.19:0/3440090297 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d200d4ff0 con 0x7f8d2006d740 2024-09-12T01:58:24.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.502+0000 7f8d1f59e640 1 --2- 172.21.15.19:0/3440090297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d2006d740 0x7f8d200cf280 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8d180097a0 tx=0x7f8d1802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715fe7715929b7d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:24.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.503+0000 7f8d1dd9b640 1 -- 172.21.15.19:0/3440090297 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18037070 con 0x7f8d2006d740 2024-09-12T01:58:24.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.503+0000 7f8d1dd9b640 1 -- 172.21.15.19:0/3440090297 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1802ae50 con 0x7f8d2006d740 2024-09-12T01:58:24.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.503+0000 7f8d1dd9b640 1 -- 172.21.15.19:0/3440090297 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18032640 con 0x7f8d2006d740 2024-09-12T01:58:24.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.503+0000 7f8d250d7640 1 -- 172.21.15.19:0/3440090297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d2006d740 msgr2=0x7f8d200cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.503+0000 7f8d250d7640 1 --2- 172.21.15.19:0/3440090297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d2006d740 0x7f8d200cf280 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8d180097a0 tx=0x7f8d1802a140 comp rx=0 tx=0).stop 2024-09-12T01:58:24.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.503+0000 7f8d250d7640 1 -- 172.21.15.19:0/3440090297 shutdown_connections 2024-09-12T01:58:24.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.503+0000 7f8d250d7640 1 --2- 172.21.15.19:0/3440090297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d2006d740 0x7f8d200cf280 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.503+0000 7f8d250d7640 1 -- 172.21.15.19:0/3440090297 >> 172.21.15.19:0/3440090297 conn(0x7f8d2008bfc0 msgr2=0x7f8d200d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:24.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.503+0000 7f8d250d7640 1 -- 172.21.15.19:0/3440090297 shutdown_connections 2024-09-12T01:58:24.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.503+0000 7f8d250d7640 1 -- 172.21.15.19:0/3440090297 wait complete. 2024-09-12T01:58:24.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.505+0000 7f8d250d7640 1 Processor -- start 2024-09-12T01:58:24.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.505+0000 7f8d250d7640 1 -- start start 2024-09-12T01:58:24.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.505+0000 7f8d250d7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d2006d740 0x7f8d201f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.505+0000 7f8d250d7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d20162340 0x7f8d2015b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.505+0000 7f8d250d7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d20162e30 0x7f8d2015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.505+0000 7f8d250d7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8d20163270 con 0x7f8d2006d740 2024-09-12T01:58:24.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.505+0000 7f8d250d7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8d200cf7c0 con 0x7f8d20162e30 2024-09-12T01:58:24.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.505+0000 7f8d250d7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8d2006dbb0 con 0x7f8d20162340 2024-09-12T01:58:24.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.506+0000 7f8d1ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d2006d740 0x7f8d201f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.506+0000 7f8d1ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d2006d740 0x7f8d201f4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50280/0 (socket says 172.21.15.19:50280) 2024-09-12T01:58:24.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.506+0000 7f8d1ed9d640 1 -- 172.21.15.19:0/2576658201 learned_addr learned my addr 172.21.15.19:0/2576658201 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:24.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.506+0000 7f8d1ed9d640 1 -- 172.21.15.19:0/2576658201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d20162340 msgr2=0x7f8d2015b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.506+0000 7f8d1ed9d640 1 --2- 172.21.15.19:0/2576658201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d20162340 0x7f8d2015b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.506+0000 7f8d1ed9d640 1 -- 172.21.15.19:0/2576658201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d20162e30 msgr2=0x7f8d2015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.506+0000 7f8d1ed9d640 1 --2- 172.21.15.19:0/2576658201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d20162e30 0x7f8d2015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.506+0000 7f8d1ed9d640 1 -- 172.21.15.19:0/2576658201 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d200c8140 con 0x7f8d2006d740 2024-09-12T01:58:24.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.506+0000 7f8d1ed9d640 1 --2- 172.21.15.19:0/2576658201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d2006d740 0x7f8d201f4330 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000cb70 tx=0x7f8d1000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:24.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.506+0000 7f8d177fe640 1 -- 172.21.15.19:0/2576658201 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d10017070 con 0x7f8d2006d740 2024-09-12T01:58:24.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.506+0000 7f8d177fe640 1 -- 172.21.15.19:0/2576658201 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1000ad40 con 0x7f8d2006d740 2024-09-12T01:58:24.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.506+0000 7f8d250d7640 1 -- 172.21.15.19:0/2576658201 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d200cd1f0 con 0x7f8d2006d740 2024-09-12T01:58:24.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.506+0000 7f8d177fe640 1 -- 172.21.15.19:0/2576658201 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d10012620 con 0x7f8d2006d740 2024-09-12T01:58:24.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.506+0000 7f8d250d7640 1 -- 172.21.15.19:0/2576658201 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d200c86c0 con 0x7f8d2006d740 2024-09-12T01:58:24.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.507+0000 7f8d250d7640 1 -- 172.21.15.19:0/2576658201 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d200d52d0 con 0x7f8d2006d740 2024-09-12T01:58:24.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.508+0000 7f8d177fe640 1 -- 172.21.15.19:0/2576658201 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d1001a070 con 0x7f8d2006d740 2024-09-12T01:58:24.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.508+0000 7f8d177fe640 1 --2- 172.21.15.19:0/2576658201 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d0006be30 0x7f8d0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.508+0000 7f8d177fe640 1 -- 172.21.15.19:0/2576658201 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5421+0+0 (secure 0 0 0) 0x7f8d1008ab20 con 0x7f8d2006d740 2024-09-12T01:58:24.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.509+0000 7f8d1e59c640 1 --2- 172.21.15.19:0/2576658201 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d0006be30 0x7f8d0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.509+0000 7f8d1e59c640 1 --2- 172.21.15.19:0/2576658201 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d0006be30 0x7f8d0006e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8d201f7e10 tx=0x7f8d08006bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:24.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.512+0000 7f8d177fe640 1 -- 172.21.15.19:0/2576658201 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d10059680 con 0x7f8d2006d740 2024-09-12T01:58:24.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.690+0000 7f8d250d7640 1 -- 172.21.15.19:0/2576658201 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8d2008e640 con 0x7f8d2006d740 2024-09-12T01:58:24.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.690+0000 7f8d177fe640 1 -- 172.21.15.19:0/2576658201 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) ==== 93+0+10 (secure 0 0 0) 0x7f8d10058f80 con 0x7f8d2006d740 2024-09-12T01:58:24.691 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-09-12T01:58:24.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.692+0000 7f8d250d7640 1 -- 172.21.15.19:0/2576658201 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d0006be30 msgr2=0x7f8d0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.692+0000 7f8d250d7640 1 --2- 172.21.15.19:0/2576658201 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d0006be30 0x7f8d0006e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8d201f7e10 tx=0x7f8d08006bb0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.692+0000 7f8d250d7640 1 -- 172.21.15.19:0/2576658201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d2006d740 msgr2=0x7f8d201f4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.692+0000 7f8d250d7640 1 --2- 172.21.15.19:0/2576658201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d2006d740 0x7f8d201f4330 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000cb70 tx=0x7f8d1000a430 comp rx=0 tx=0).stop 2024-09-12T01:58:24.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.692+0000 7f8d250d7640 1 -- 172.21.15.19:0/2576658201 shutdown_connections 2024-09-12T01:58:24.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.692+0000 7f8d250d7640 1 --2- 172.21.15.19:0/2576658201 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d0006be30 0x7f8d0006e2f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.692+0000 7f8d250d7640 1 --2- 172.21.15.19:0/2576658201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d20162e30 0x7f8d2015bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.692+0000 7f8d250d7640 1 --2- 172.21.15.19:0/2576658201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d20162340 0x7f8d2015b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.692+0000 7f8d250d7640 1 --2- 172.21.15.19:0/2576658201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d2006d740 0x7f8d201f4330 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.692+0000 7f8d250d7640 1 -- 172.21.15.19:0/2576658201 >> 172.21.15.19:0/2576658201 conn(0x7f8d2008bfc0 msgr2=0x7f8d20160300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:24.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.692+0000 7f8d250d7640 1 -- 172.21.15.19:0/2576658201 shutdown_connections 2024-09-12T01:58:24.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.692+0000 7f8d250d7640 1 -- 172.21.15.19:0/2576658201 wait complete. 2024-09-12T01:58:24.704 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_precommit' 2024-09-12T01:58:24.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.807+0000 7fe905aba640 1 Processor -- start 2024-09-12T01:58:24.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.807+0000 7fe905aba640 1 -- start start 2024-09-12T01:58:24.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.808+0000 7fe905aba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe90009b140 0x7fe900169570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.808+0000 7fe905aba640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe90006cec0 con 0x7fe90015e5d0 2024-09-12T01:58:24.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.808+0000 7fe905aba640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe90006d1a0 con 0x7fe90006df60 2024-09-12T01:58:24.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.808+0000 7fe905aba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe90006dad0 con 0x7fe90009b140 2024-09-12T01:58:24.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.808+0000 7fe8ff7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe90015e5d0 0x7fe9000d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41086/0 (socket says 172.21.15.19:41086) 2024-09-12T01:58:24.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.808+0000 7fe8ff7fe640 1 -- 172.21.15.19:0/3994678578 learned_addr learned my addr 172.21.15.19:0/3994678578 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:24.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.808+0000 7fe8fffff640 1 --2- 172.21.15.19:0/3994678578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe90009b140 0x7fe900169570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.808+0000 7fe8fe7fc640 1 -- 172.21.15.19:0/3994678578 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3407478357 0 0) 0x7fe90006cec0 con 0x7fe90015e5d0 2024-09-12T01:58:24.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.808+0000 7fe8fe7fc640 1 -- 172.21.15.19:0/3994678578 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8e8003520 con 0x7fe90015e5d0 2024-09-12T01:58:24.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.808+0000 7fe8fe7fc640 1 -- 172.21.15.19:0/3994678578 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3790937841 0 0) 0x7fe90006d1a0 con 0x7fe90006df60 2024-09-12T01:58:24.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.808+0000 7fe8fe7fc640 1 -- 172.21.15.19:0/3994678578 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe90006cec0 con 0x7fe90006df60 2024-09-12T01:58:24.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.808+0000 7fe8fe7fc640 1 -- 172.21.15.19:0/3994678578 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1584006308 0 0) 0x7fe8e8003520 con 0x7fe90015e5d0 2024-09-12T01:58:24.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8fe7fc640 1 -- 172.21.15.19:0/3994678578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe90009b140 msgr2=0x7fe900169570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:24.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8fe7fc640 1 --2- 172.21.15.19:0/3994678578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe90009b140 0x7fe900169570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8fe7fc640 1 -- 172.21.15.19:0/3994678578 >> v1:172.21.15.135:6789/0 conn(0x7fe90006df60 legacy=0x7fe90009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8fe7fc640 1 -- 172.21.15.19:0/3994678578 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90006d480 con 0x7fe90015e5d0 2024-09-12T01:58:24.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8fe7fc640 1 -- 172.21.15.19:0/3994678578 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fe8f0001670 con 0x7fe90015e5d0 2024-09-12T01:58:24.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8fe7fc640 1 -- 172.21.15.19:0/3994678578 >> v1:172.21.15.19:6789/0 conn(0x7fe90015e5d0 legacy=0x7fe9000d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8fe7fc640 1 --2- 172.21.15.19:0/3994678578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e8003b70 0x7fe8e8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8fe7fc640 1 --2- 172.21.15.19:0/3994678578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe90009b140 0x7fe8e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8fe7fc640 1 --2- 172.21.15.19:0/3994678578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8e8004d40 0x7fe8e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8fe7fc640 1 -- 172.21.15.19:0/3994678578 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe90006dad0 con 0x7fe8e8004d40 2024-09-12T01:58:24.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8fe7fc640 1 -- 172.21.15.19:0/3994678578 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e800baa0 con 0x7fe8e8003b70 2024-09-12T01:58:24.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8fe7fc640 1 -- 172.21.15.19:0/3994678578 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e800bca0 con 0x7fe90009b140 2024-09-12T01:58:24.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8fffff640 1 --2- 172.21.15.19:0/3994678578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8e8004d40 0x7fe8e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8ff7fe640 1 --2- 172.21.15.19:0/3994678578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e8003b70 0x7fe8e8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8feffd640 1 --2- 172.21.15.19:0/3994678578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe90009b140 0x7fe8e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8fffff640 1 -- 172.21.15.19:0/3994678578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe90009b140 msgr2=0x7fe8e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:24.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8fffff640 1 --2- 172.21.15.19:0/3994678578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe90009b140 0x7fe8e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8fffff640 1 -- 172.21.15.19:0/3994678578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e8003b70 msgr2=0x7fe8e8003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:24.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8fffff640 1 --2- 172.21.15.19:0/3994678578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e8003b70 0x7fe8e8003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.809+0000 7fe8fffff640 1 -- 172.21.15.19:0/3994678578 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e8003520 con 0x7fe8e8004d40 2024-09-12T01:58:24.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.810+0000 7fe8fffff640 1 --2- 172.21.15.19:0/3994678578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8e8004d40 0x7fe8e80051c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8009fc0 tx=0x7fe8e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c500cebc5c0950e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:24.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.810+0000 7fe8fe7fc640 1 -- 172.21.15.19:0/3994678578 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8009c10 con 0x7fe8e8004d40 2024-09-12T01:58:24.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.810+0000 7fe8fe7fc640 1 -- 172.21.15.19:0/3994678578 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f8036070 con 0x7fe8e8004d40 2024-09-12T01:58:24.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.810+0000 7fe8fe7fc640 1 -- 172.21.15.19:0/3994678578 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8031880 con 0x7fe8e8004d40 2024-09-12T01:58:24.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.810+0000 7fe905aba640 1 -- 172.21.15.19:0/3994678578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8e8004d40 msgr2=0x7fe8e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.810+0000 7fe905aba640 1 --2- 172.21.15.19:0/3994678578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8e8004d40 0x7fe8e80051c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8009fc0 tx=0x7fe8e8005830 comp rx=0 tx=0).stop 2024-09-12T01:58:24.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.810+0000 7fe8fffff640 1 -- 172.21.15.19:0/3994678578 reap_dead start 2024-09-12T01:58:24.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.810+0000 7fe905aba640 1 -- 172.21.15.19:0/3994678578 shutdown_connections 2024-09-12T01:58:24.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.810+0000 7fe905aba640 1 -- 172.21.15.19:0/3994678578 >> 172.21.15.19:0/3994678578 conn(0x7fe9000d23a0 msgr2=0x7fe9000d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:24.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.811+0000 7fe905aba640 1 -- 172.21.15.19:0/3994678578 shutdown_connections 2024-09-12T01:58:24.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.811+0000 7fe905aba640 1 -- 172.21.15.19:0/3994678578 wait complete. 2024-09-12T01:58:24.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.812+0000 7fe905aba640 1 Processor -- start 2024-09-12T01:58:24.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.812+0000 7fe905aba640 1 -- start start 2024-09-12T01:58:24.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe905aba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e8004d40 0x7fe9001562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe905aba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9000c67e0 0x7fe9000c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe905aba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9000c85d0 0x7fe9000c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe905aba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe9000d1980 con 0x7fe9000c67e0 2024-09-12T01:58:24.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe905aba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe9000d1800 con 0x7fe8e8004d40 2024-09-12T01:58:24.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe905aba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe90015e9b0 con 0x7fe9000c85d0 2024-09-12T01:58:24.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe8feffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9000c67e0 0x7fe9000c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe8feffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9000c67e0 0x7fe9000c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50294/0 (socket says 172.21.15.19:50294) 2024-09-12T01:58:24.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe8feffd640 1 -- 172.21.15.19:0/190040809 learned_addr learned my addr 172.21.15.19:0/190040809 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:24.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe8ff7fe640 1 --2- 172.21.15.19:0/190040809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e8004d40 0x7fe9001562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe8fffff640 1 --2- 172.21.15.19:0/190040809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9000c85d0 0x7fe9000c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe8feffd640 1 -- 172.21.15.19:0/190040809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9000c85d0 msgr2=0x7fe9000c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe8feffd640 1 --2- 172.21.15.19:0/190040809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9000c85d0 0x7fe9000c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe8feffd640 1 -- 172.21.15.19:0/190040809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e8004d40 msgr2=0x7fe9001562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe8feffd640 1 --2- 172.21.15.19:0/190040809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e8004d40 0x7fe9001562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe8feffd640 1 -- 172.21.15.19:0/190040809 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9000c7810 con 0x7fe9000c67e0 2024-09-12T01:58:24.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe8ff7fe640 1 --2- 172.21.15.19:0/190040809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e8004d40 0x7fe9001562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:24.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe8fffff640 1 --2- 172.21.15.19:0/190040809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9000c85d0 0x7fe9000c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:24.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe8feffd640 1 --2- 172.21.15.19:0/190040809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9000c67e0 0x7fe9000c6c40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400f7a0 tx=0x7fe8f400fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:24.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe8e7fff640 1 -- 172.21.15.19:0/190040809 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f401a070 con 0x7fe9000c67e0 2024-09-12T01:58:24.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.813+0000 7fe8e7fff640 1 -- 172.21.15.19:0/190040809 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f400fe50 con 0x7fe9000c67e0 2024-09-12T01:58:24.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.814+0000 7fe8e7fff640 1 -- 172.21.15.19:0/190040809 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4007050 con 0x7fe9000c67e0 2024-09-12T01:58:24.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.814+0000 7fe905aba640 1 -- 172.21.15.19:0/190040809 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9000c7af0 con 0x7fe9000c67e0 2024-09-12T01:58:24.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.814+0000 7fe905aba640 1 -- 172.21.15.19:0/190040809 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9000c80b0 con 0x7fe9000c67e0 2024-09-12T01:58:24.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.814+0000 7fe905aba640 1 -- 172.21.15.19:0/190040809 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe90006d1a0 con 0x7fe9000c67e0 2024-09-12T01:58:24.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.815+0000 7fe8e7fff640 1 -- 172.21.15.19:0/190040809 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8f401d070 con 0x7fe9000c67e0 2024-09-12T01:58:24.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.815+0000 7fe8e7fff640 1 --2- 172.21.15.19:0/190040809 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe8ec06be60 0x7fe8ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.815+0000 7fe8e7fff640 1 -- 172.21.15.19:0/190040809 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5421+0+0 (secure 0 0 0) 0x7fe8f408a530 con 0x7fe9000c67e0 2024-09-12T01:58:24.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.816+0000 7fe8ff7fe640 1 --2- 172.21.15.19:0/190040809 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe8ec06be60 0x7fe8ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.816+0000 7fe8ff7fe640 1 --2- 172.21.15.19:0/190040809 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe8ec06be60 0x7fe8ec06e320 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0001050 tx=0x7fe8f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:24.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:24.820+0000 7fe8e7fff640 1 -- 172.21.15.19:0/190040809 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe8f4059000 con 0x7fe9000c67e0 2024-09-12T01:58:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:25.067+0000 7fe905aba640 1 -- 172.21.15.19:0/190040809 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_precommit"]} v 0) -- 0x7fe9000c8280 con 0x7fe9000c67e0 2024-09-12T01:58:26.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.033+0000 7fe8e7fff640 1 -- 172.21.15.19:0/190040809 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_precommit"]}]=0 v147) ==== 145+0+0 (secure 0 0 0) 0x7fe8f4058900 con 0x7fe9000c67e0 2024-09-12T01:58:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.036+0000 7fe905aba640 1 -- 172.21.15.19:0/190040809 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe8ec06be60 msgr2=0x7fe8ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.036+0000 7fe905aba640 1 --2- 172.21.15.19:0/190040809 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe8ec06be60 0x7fe8ec06e320 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0001050 tx=0x7fe8f0009040 comp rx=0 tx=0).stop 2024-09-12T01:58:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.036+0000 7fe905aba640 1 -- 172.21.15.19:0/190040809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9000c67e0 msgr2=0x7fe9000c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.036+0000 7fe905aba640 1 --2- 172.21.15.19:0/190040809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9000c67e0 0x7fe9000c6c40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400f7a0 tx=0x7fe8f400fc60 comp rx=0 tx=0).stop 2024-09-12T01:58:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.036+0000 7fe905aba640 1 -- 172.21.15.19:0/190040809 shutdown_connections 2024-09-12T01:58:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.036+0000 7fe905aba640 1 --2- 172.21.15.19:0/190040809 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe8ec06be60 0x7fe8ec06e320 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.036+0000 7fe905aba640 1 --2- 172.21.15.19:0/190040809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9000c85d0 0x7fe9000c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.036+0000 7fe905aba640 1 --2- 172.21.15.19:0/190040809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9000c67e0 0x7fe9000c6c40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.036+0000 7fe905aba640 1 --2- 172.21.15.19:0/190040809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e8004d40 0x7fe9001562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.036+0000 7fe905aba640 1 -- 172.21.15.19:0/190040809 >> 172.21.15.19:0/190040809 conn(0x7fe9000d23a0 msgr2=0x7fe9000b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:26.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.036+0000 7fe905aba640 1 -- 172.21.15.19:0/190040809 shutdown_connections 2024-09-12T01:58:26.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.036+0000 7fe905aba640 1 -- 172.21.15.19:0/190040809 wait complete. 2024-09-12T01:58:26.050 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T01:58:26.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.162+0000 7f190b823640 1 Processor -- start 2024-09-12T01:58:26.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.162+0000 7f190b823640 1 -- start start 2024-09-12T01:58:26.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.163+0000 7f190b823640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f190415e2e0 0x7f19040b0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.163+0000 7f190b823640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f19040adce0 0x7f19040ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.163+0000 7f190b823640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19040ae690 con 0x7f1904067ae0 2024-09-12T01:58:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.163+0000 7f190b823640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f19040aec30 con 0x7f19040adce0 2024-09-12T01:58:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.163+0000 7f190b823640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1904067ff0 con 0x7f190415e2e0 2024-09-12T01:58:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.163+0000 7f1909dc0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f19040adce0 0x7f19040ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.163+0000 7f1909dc0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f19040adce0 0x7f19040ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50308/0 (socket says 172.21.15.19:50308) 2024-09-12T01:58:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.163+0000 7f1909dc0640 1 -- 172.21.15.19:0/319027154 learned_addr learned my addr 172.21.15.19:0/319027154 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.163+0000 7f19095bf640 1 --2- 172.21.15.19:0/319027154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f190415e2e0 0x7f19040b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.164+0000 7f1909dc0640 1 -- 172.21.15.19:0/319027154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f190415e2e0 msgr2=0x7f19040b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.164+0000 7f1909dc0640 1 --2- 172.21.15.19:0/319027154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f190415e2e0 0x7f19040b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.164+0000 7f1909dc0640 1 -- 172.21.15.19:0/319027154 >> v1:172.21.15.135:6789/0 conn(0x7f1904067ae0 legacy=0x7f190415f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.164+0000 7f1909dc0640 1 -- 172.21.15.19:0/319027154 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19040af390 con 0x7f19040adce0 2024-09-12T01:58:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.164+0000 7f19095bf640 1 --2- 172.21.15.19:0/319027154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f190415e2e0 0x7f19040b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:26.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.164+0000 7f1909dc0640 1 --2- 172.21.15.19:0/319027154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19040adce0 0x7f19040ae150 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009870 tx=0x7f18fc02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a8c4df0787c3e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:26.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.164+0000 7f1903fff640 1 -- 172.21.15.19:0/319027154 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc037070 con 0x7f19040adce0 2024-09-12T01:58:26.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.164+0000 7f1903fff640 1 -- 172.21.15.19:0/319027154 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18fc032440 con 0x7f19040adce0 2024-09-12T01:58:26.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.164+0000 7f1903fff640 1 -- 172.21.15.19:0/319027154 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc032810 con 0x7f19040adce0 2024-09-12T01:58:26.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.165+0000 7f190b823640 1 -- 172.21.15.19:0/319027154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19040adce0 msgr2=0x7f19040ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.165+0000 7f190b823640 1 --2- 172.21.15.19:0/319027154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19040adce0 0x7f19040ae150 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009870 tx=0x7f18fc02a200 comp rx=0 tx=0).stop 2024-09-12T01:58:26.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.165+0000 7f190b823640 1 -- 172.21.15.19:0/319027154 shutdown_connections 2024-09-12T01:58:26.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.165+0000 7f190b823640 1 --2- 172.21.15.19:0/319027154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19040adce0 0x7f19040ae150 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.165+0000 7f190b823640 1 --2- 172.21.15.19:0/319027154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f190415e2e0 0x7f19040b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.165+0000 7f190b823640 1 -- 172.21.15.19:0/319027154 >> 172.21.15.19:0/319027154 conn(0x7f1904073590 msgr2=0x7f190406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:26.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.165+0000 7f190b823640 1 -- 172.21.15.19:0/319027154 shutdown_connections 2024-09-12T01:58:26.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.165+0000 7f190b823640 1 -- 172.21.15.19:0/319027154 wait complete. 2024-09-12T01:58:26.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.166+0000 7f190b823640 1 Processor -- start 2024-09-12T01:58:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.166+0000 7f190b823640 1 -- start start 2024-09-12T01:58:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.167+0000 7f190b823640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1904067ae0 0x7f1904150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.167+0000 7f190b823640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19040adce0 0x7f19040cf580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.167+0000 7f190b823640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f190415e2e0 0x7f1904155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.167+0000 7f190b823640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f19040afc30 con 0x7f19040adce0 2024-09-12T01:58:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.167+0000 7f190b823640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f19040af950 con 0x7f190415e2e0 2024-09-12T01:58:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.167+0000 7f190b823640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f190415e6c0 con 0x7f1904067ae0 2024-09-12T01:58:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.167+0000 7f1908dbe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19040adce0 0x7f19040cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.167+0000 7f1908dbe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19040adce0 0x7f19040cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50310/0 (socket says 172.21.15.19:50310) 2024-09-12T01:58:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.167+0000 7f1908dbe640 1 -- 172.21.15.19:0/1522797562 learned_addr learned my addr 172.21.15.19:0/1522797562 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.167+0000 7f19095bf640 1 --2- 172.21.15.19:0/1522797562 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1904067ae0 0x7f1904150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.167+0000 7f1909dc0640 1 --2- 172.21.15.19:0/1522797562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f190415e2e0 0x7f1904155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.168+0000 7f1908dbe640 1 -- 172.21.15.19:0/1522797562 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1904067ae0 msgr2=0x7f1904150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.168+0000 7f1908dbe640 1 --2- 172.21.15.19:0/1522797562 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1904067ae0 0x7f1904150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.168+0000 7f1908dbe640 1 -- 172.21.15.19:0/1522797562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f190415e2e0 msgr2=0x7f1904155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.168+0000 7f1908dbe640 1 --2- 172.21.15.19:0/1522797562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f190415e2e0 0x7f1904155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.168+0000 7f1908dbe640 1 -- 172.21.15.19:0/1522797562 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19041f5260 con 0x7f19040adce0 2024-09-12T01:58:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.168+0000 7f1909dc0640 1 --2- 172.21.15.19:0/1522797562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f190415e2e0 0x7f1904155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.168+0000 7f1908dbe640 1 --2- 172.21.15.19:0/1522797562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19040adce0 0x7f19040cf580 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f18f800c3f0 tx=0x7f18f800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.168+0000 7f1901ffb640 1 -- 172.21.15.19:0/1522797562 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8007020 con 0x7f19040adce0 2024-09-12T01:58:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.168+0000 7f1901ffb640 1 -- 172.21.15.19:0/1522797562 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f80071c0 con 0x7f19040adce0 2024-09-12T01:58:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.168+0000 7f190b823640 1 -- 172.21.15.19:0/1522797562 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19040ceaa0 con 0x7f19040adce0 2024-09-12T01:58:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.168+0000 7f1901ffb640 1 -- 172.21.15.19:0/1522797562 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8007590 con 0x7f19040adce0 2024-09-12T01:58:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.168+0000 7f190b823640 1 -- 172.21.15.19:0/1522797562 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19040cfac0 con 0x7f19040adce0 2024-09-12T01:58:26.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.169+0000 7f190b823640 1 -- 172.21.15.19:0/1522797562 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19040ae150 con 0x7f19040adce0 2024-09-12T01:58:26.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.170+0000 7f1901ffb640 1 -- 172.21.15.19:0/1522797562 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18f8019020 con 0x7f19040adce0 2024-09-12T01:58:26.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.170+0000 7f1901ffb640 1 --2- 172.21.15.19:0/1522797562 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18f006be30 0x7f18f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.171+0000 7f1901ffb640 1 -- 172.21.15.19:0/1522797562 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5421+0+0 (secure 0 0 0) 0x7f18f808a440 con 0x7f19040adce0 2024-09-12T01:58:26.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.171+0000 7f19095bf640 1 --2- 172.21.15.19:0/1522797562 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18f006be30 0x7f18f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.171+0000 7f19095bf640 1 --2- 172.21.15.19:0/1522797562 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18f006be30 0x7f18f006e2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f18f400f500 tx=0x7f18f4007770 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:26.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.175+0000 7f1901ffb640 1 -- 172.21.15.19:0/1522797562 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18f8058f10 con 0x7f19040adce0 2024-09-12T01:58:26.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.352+0000 7f190b823640 1 -- 172.21.15.19:0/1522797562 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f190406d0a0 con 0x7f19040adce0 2024-09-12T01:58:26.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.355+0000 7f1901ffb640 1 -- 172.21.15.19:0/1522797562 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f18f8058810 con 0x7f19040adce0 2024-09-12T01:58:26.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.357+0000 7f190b823640 1 -- 172.21.15.19:0/1522797562 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18f006be30 msgr2=0x7f18f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.357+0000 7f190b823640 1 --2- 172.21.15.19:0/1522797562 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18f006be30 0x7f18f006e2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f18f400f500 tx=0x7f18f4007770 comp rx=0 tx=0).stop 2024-09-12T01:58:26.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.357+0000 7f190b823640 1 -- 172.21.15.19:0/1522797562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19040adce0 msgr2=0x7f19040cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.357+0000 7f190b823640 1 --2- 172.21.15.19:0/1522797562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19040adce0 0x7f19040cf580 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f18f800c3f0 tx=0x7f18f800c8b0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.357+0000 7f190b823640 1 -- 172.21.15.19:0/1522797562 shutdown_connections 2024-09-12T01:58:26.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.357+0000 7f190b823640 1 --2- 172.21.15.19:0/1522797562 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18f006be30 0x7f18f006e2f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.357+0000 7f190b823640 1 --2- 172.21.15.19:0/1522797562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f190415e2e0 0x7f1904155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.357+0000 7f190b823640 1 --2- 172.21.15.19:0/1522797562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19040adce0 0x7f19040cf580 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.357+0000 7f190b823640 1 --2- 172.21.15.19:0/1522797562 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1904067ae0 0x7f1904150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.357+0000 7f190b823640 1 -- 172.21.15.19:0/1522797562 >> 172.21.15.19:0/1522797562 conn(0x7f1904073590 msgr2=0x7f190406e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:26.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.357+0000 7f190b823640 1 -- 172.21.15.19:0/1522797562 shutdown_connections 2024-09-12T01:58:26.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.357+0000 7f190b823640 1 -- 172.21.15.19:0/1522797562 wait complete. 2024-09-12T01:58:26.368 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:58:26.369 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:58:26.413 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:58:26.465 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:58:26.465 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:58:26.465 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:58:26.481 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:58:26.481 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:58:26.482 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:58:26.500 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:58:26.500 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:58:26.500 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:58:26.538 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:58:26.539 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T01:58:26.539 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:58:26.556 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:58:26.556 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T01:58:26.557 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:58:26.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.681+0000 7fc3e6be4640 1 Processor -- start 2024-09-12T01:58:26.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.681+0000 7fc3e6be4640 1 -- start start 2024-09-12T01:58:26.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.681+0000 7fc3e6be4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc3e0161c80 0x7fc3e006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.681+0000 7fc3e6be4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3e0162060 0x7fc3e00b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.681+0000 7fc3e6be4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3e006e870 con 0x7fc3e00b64b0 2024-09-12T01:58:26.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.681+0000 7fc3e6be4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fc3e006d9f0 con 0x7fc3e0161c80 2024-09-12T01:58:26.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.681+0000 7fc3e6be4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e006dcd0 con 0x7fc3e0162060 2024-09-12T01:58:26.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.682+0000 7fc3e4980640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc3e0161c80 0x7fc3e006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.682+0000 7fc3e5181640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc3e00b64b0 0x7fc3e0162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41102/0 (socket says 172.21.15.19:41102) 2024-09-12T01:58:26.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.682+0000 7fc3e5181640 1 -- 172.21.15.19:0/3164757859 learned_addr learned my addr 172.21.15.19:0/3164757859 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:26.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.682+0000 7fc3dffff640 1 --2- 172.21.15.19:0/3164757859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3e0162060 0x7fc3e00b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.682+0000 7fc3e4980640 1 -- 172.21.15.19:0/3164757859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3e0162060 msgr2=0x7fc3e00b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:26.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.682+0000 7fc3e4980640 1 --2- 172.21.15.19:0/3164757859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3e0162060 0x7fc3e00b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.682+0000 7fc3e4980640 1 -- 172.21.15.19:0/3164757859 >> v1:172.21.15.19:6789/0 conn(0x7fc3e00b64b0 legacy=0x7fc3e0162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.682+0000 7fc3e4980640 1 -- 172.21.15.19:0/3164757859 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e006dfb0 con 0x7fc3e0161c80 2024-09-12T01:58:26.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.682+0000 7fc3df7fe640 1 -- 172.21.15.19:0/3164757859 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4192647181 0 0) 0x7fc3d8001490 con 0x7fc3e00b64b0 2024-09-12T01:58:26.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.682+0000 7fc3dffff640 1 --2- 172.21.15.19:0/3164757859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3e0162060 0x7fc3e00b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:26.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.683+0000 7fc3e4980640 1 --2- 172.21.15.19:0/3164757859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e0161c80 0x7fc3e006e330 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40097a0 tx=0x7fc3d402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6896f00778a0fa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:26.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.683+0000 7fc3df7fe640 1 -- 172.21.15.19:0/3164757859 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4037070 con 0x7fc3e0161c80 2024-09-12T01:58:26.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.683+0000 7fc3df7fe640 1 -- 172.21.15.19:0/3164757859 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d4032440 con 0x7fc3e0161c80 2024-09-12T01:58:26.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.683+0000 7fc3df7fe640 1 -- 172.21.15.19:0/3164757859 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4032810 con 0x7fc3e0161c80 2024-09-12T01:58:26.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.683+0000 7fc3e6be4640 1 -- 172.21.15.19:0/3164757859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e0161c80 msgr2=0x7fc3e006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.683+0000 7fc3e6be4640 1 --2- 172.21.15.19:0/3164757859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e0161c80 0x7fc3e006e330 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40097a0 tx=0x7fc3d402a180 comp rx=0 tx=0).stop 2024-09-12T01:58:26.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.683+0000 7fc3e6be4640 1 -- 172.21.15.19:0/3164757859 shutdown_connections 2024-09-12T01:58:26.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.683+0000 7fc3e6be4640 1 --2- 172.21.15.19:0/3164757859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3e0162060 0x7fc3e00b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.683+0000 7fc3e6be4640 1 --2- 172.21.15.19:0/3164757859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e0161c80 0x7fc3e006e330 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.683+0000 7fc3e6be4640 1 -- 172.21.15.19:0/3164757859 >> 172.21.15.19:0/3164757859 conn(0x7fc3e00d44f0 msgr2=0x7fc3e00d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:26.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.683+0000 7fc3e6be4640 1 -- 172.21.15.19:0/3164757859 shutdown_connections 2024-09-12T01:58:26.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.683+0000 7fc3e6be4640 1 -- 172.21.15.19:0/3164757859 wait complete. 2024-09-12T01:58:26.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.685+0000 7fc3e6be4640 1 Processor -- start 2024-09-12T01:58:26.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.685+0000 7fc3e6be4640 1 -- start start 2024-09-12T01:58:26.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.685+0000 7fc3e6be4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3e00b64b0 0x7fc3e00b9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.685+0000 7fc3e6be4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e0161c80 0x7fc3e0156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3e6be4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3e0162060 0x7fc3e0157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3e6be4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e00d2a10 con 0x7fc3e0161c80 2024-09-12T01:58:26.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3e6be4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e00d2890 con 0x7fc3e0162060 2024-09-12T01:58:26.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3e6be4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e00b6960 con 0x7fc3e00b64b0 2024-09-12T01:58:26.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3dffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e0161c80 0x7fc3e0156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3dffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e0161c80 0x7fc3e0156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50330/0 (socket says 172.21.15.19:50330) 2024-09-12T01:58:26.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3dffff640 1 -- 172.21.15.19:0/1351354299 learned_addr learned my addr 172.21.15.19:0/1351354299 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:26.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3e4980640 1 --2- 172.21.15.19:0/1351354299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3e00b64b0 0x7fc3e00b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3e5181640 1 --2- 172.21.15.19:0/1351354299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3e0162060 0x7fc3e0157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3dffff640 1 -- 172.21.15.19:0/1351354299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3e00b64b0 msgr2=0x7fc3e00b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3dffff640 1 --2- 172.21.15.19:0/1351354299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3e00b64b0 0x7fc3e00b9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3dffff640 1 -- 172.21.15.19:0/1351354299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3e0162060 msgr2=0x7fc3e0157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3dffff640 1 --2- 172.21.15.19:0/1351354299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3e0162060 0x7fc3e0157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3dffff640 1 -- 172.21.15.19:0/1351354299 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e00b9a90 con 0x7fc3e0161c80 2024-09-12T01:58:26.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3dffff640 1 --2- 172.21.15.19:0/1351354299 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e0161c80 0x7fc3e0156330 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00c7f0 tx=0x7fc3cc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:26.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3dd7fa640 1 -- 172.21.15.19:0/1351354299 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc015070 con 0x7fc3e0161c80 2024-09-12T01:58:26.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3dd7fa640 1 -- 172.21.15.19:0/1351354299 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3cc007820 con 0x7fc3e0161c80 2024-09-12T01:58:26.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3e6be4640 1 -- 172.21.15.19:0/1351354299 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e00b9d70 con 0x7fc3e0161c80 2024-09-12T01:58:26.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3dd7fa640 1 -- 172.21.15.19:0/1351354299 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc007c10 con 0x7fc3e0161c80 2024-09-12T01:58:26.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.686+0000 7fc3e6be4640 1 -- 172.21.15.19:0/1351354299 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e0156c00 con 0x7fc3e0161c80 2024-09-12T01:58:26.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.687+0000 7fc3e6be4640 1 -- 172.21.15.19:0/1351354299 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e006e330 con 0x7fc3e0161c80 2024-09-12T01:58:26.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.688+0000 7fc3dd7fa640 1 -- 172.21.15.19:0/1351354299 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3cc018070 con 0x7fc3e0161c80 2024-09-12T01:58:26.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.688+0000 7fc3dd7fa640 1 --2- 172.21.15.19:0/1351354299 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc3c406be30 0x7fc3c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.689+0000 7fc3dd7fa640 1 -- 172.21.15.19:0/1351354299 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5421+0+0 (secure 0 0 0) 0x7fc3cc08ae30 con 0x7fc3e0161c80 2024-09-12T01:58:26.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.689+0000 7fc3e4980640 1 --2- 172.21.15.19:0/1351354299 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc3c406be30 0x7fc3c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.689+0000 7fc3e4980640 1 --2- 172.21.15.19:0/1351354299 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc3c406be30 0x7fc3c406e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4034000 tx=0x7fc3d402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:26.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.693+0000 7fc3dd7fa640 1 -- 172.21.15.19:0/1351354299 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc3cc059910 con 0x7fc3e0161c80 2024-09-12T01:58:26.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.904+0000 7fc3e6be4640 1 -- 172.21.15.19:0/1351354299 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3e00d2270 con 0x7fc3e0161c80 2024-09-12T01:58:26.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.904+0000 7fc3dd7fa640 1 -- 172.21.15.19:0/1351354299 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+3911 (secure 0 0 0) 0x7fc3cc059210 con 0x7fc3e0161c80 2024-09-12T01:58:26.905 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:26.905 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":36,"btime":"2024-09-12T01:58:20:005591+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/4076449352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4076449352},{"type":"v1","addr":"172.21.15.135:6836","nonce":4076449352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1361756714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1361756714},{"type":"v1","addr":"172.21.15.135:6837","nonce":1361756714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3926640523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3926640523},{"type":"v1","addr":"172.21.15.19:6833","nonce":3926640523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5787,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/51359531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":51359531},{"type":"v1","addr":"172.21.15.19:6835","nonce":51359531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[]} 2024-09-12T01:58:26.905 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 36 2024-09-12T01:58:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.906+0000 7fc3e6be4640 1 -- 172.21.15.19:0/1351354299 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc3c406be30 msgr2=0x7fc3c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.906+0000 7fc3e6be4640 1 --2- 172.21.15.19:0/1351354299 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc3c406be30 0x7fc3c406e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4034000 tx=0x7fc3d402e000 comp rx=0 tx=0).stop 2024-09-12T01:58:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.906+0000 7fc3e6be4640 1 -- 172.21.15.19:0/1351354299 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e0161c80 msgr2=0x7fc3e0156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.906+0000 7fc3e6be4640 1 --2- 172.21.15.19:0/1351354299 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e0161c80 0x7fc3e0156330 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00c7f0 tx=0x7fc3cc00ccb0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.906+0000 7fc3e6be4640 1 -- 172.21.15.19:0/1351354299 shutdown_connections 2024-09-12T01:58:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.906+0000 7fc3e6be4640 1 --2- 172.21.15.19:0/1351354299 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc3c406be30 0x7fc3c406e2f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.906+0000 7fc3e6be4640 1 --2- 172.21.15.19:0/1351354299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3e0162060 0x7fc3e0157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.906+0000 7fc3e6be4640 1 --2- 172.21.15.19:0/1351354299 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e0161c80 0x7fc3e0156330 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.906+0000 7fc3e6be4640 1 --2- 172.21.15.19:0/1351354299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3e00b64b0 0x7fc3e00b9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.906+0000 7fc3e6be4640 1 -- 172.21.15.19:0/1351354299 >> 172.21.15.19:0/1351354299 conn(0x7fc3e00d44f0 msgr2=0x7fc3e015fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.906+0000 7fc3e6be4640 1 -- 172.21.15.19:0/1351354299 shutdown_connections 2024-09-12T01:58:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:26.906+0000 7fc3e6be4640 1 -- 172.21.15.19:0/1351354299 wait complete. 2024-09-12T01:58:26.918 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T01:58:26.918 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T01:58:26.919 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T01:58:26.919 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:58:26.919 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T01:58:26.919 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T01:58:26.919 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T01:58:26.919 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:58:26.919 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T01:58:26.920 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T01:58:26.920 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T01:58:26.920 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:58:26.920 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T01:58:26.920 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T01:58:26.921 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T01:58:26.921 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:58:26.929 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T01:58:26.929 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T01:58:26.930 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T01:58:26.930 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T01:58:26.932 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T01:58:26.932 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T01:58:26.933 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T01:58:26.934 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T01:58:26.972 INFO:tasks.ceph.mds.a:Started 2024-09-12T01:58:26.972 DEBUG:teuthology.parallel:result is None 2024-09-12T01:58:26.973 INFO:tasks.ceph.mds.c:Started 2024-09-12T01:58:26.973 DEBUG:teuthology.parallel:result is None 2024-09-12T01:58:26.975 INFO:tasks.ceph.mds.b:Started 2024-09-12T01:58:26.975 DEBUG:teuthology.parallel:result is None 2024-09-12T01:58:26.976 INFO:tasks.ceph.mds.d:Started 2024-09-12T01:58:26.976 DEBUG:teuthology.parallel:result is None 2024-09-12T01:58:26.977 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T01:58:27.049 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T01:58:27.050 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-09-12T01:58:27.057 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2024-09-12T01:58:27.058 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T01:58:27.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.084+0000 7f02adb52640 1 Processor -- start 2024-09-12T01:58:27.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.084+0000 7f02adb52640 1 -- start start 2024-09-12T01:58:27.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.084+0000 7f02adb52640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f02a815b340 0x7f02a809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:27.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.085+0000 7f02adb52640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f02a80b43f0 0x7f02a80b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.085+0000 7f02adb52640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02a80b3830 con 0x7f02a80b4e80 2024-09-12T01:58:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.085+0000 7f02adb52640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f02a80b5bd0 con 0x7f02a80b43f0 2024-09-12T01:58:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.085+0000 7f02adb52640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f02a80b5610 con 0x7f02a815b340 2024-09-12T01:58:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.085+0000 7f02a7fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f02a80b4e80 0x7f02a815de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41122/0 (socket says 172.21.15.19:41122) 2024-09-12T01:58:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.085+0000 7f02a7fff640 1 -- 172.21.15.19:0/1426923899 learned_addr learned my addr 172.21.15.19:0/1426923899 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.085+0000 7f029effd640 1 --2- 172.21.15.19:0/1426923899 >> v2:172.21.15.19:3300/0 conn(0x7f02a80b43f0 0x7f02a80b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.085+0000 7f02a77fe640 1 --2- 172.21.15.19:0/1426923899 >> v2:172.21.15.135:3300/0 conn(0x7f02a815b340 0x7f02a809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.085+0000 7f029effd640 1 -- 172.21.15.19:0/1426923899 >> v2:172.21.15.135:3300/0 conn(0x7f02a815b340 msgr2=0x7f02a809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.085+0000 7f029effd640 1 --2- 172.21.15.19:0/1426923899 >> v2:172.21.15.135:3300/0 conn(0x7f02a815b340 0x7f02a809aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.085+0000 7f029effd640 1 -- 172.21.15.19:0/1426923899 >> v1:172.21.15.19:6789/0 conn(0x7f02a80b4e80 legacy=0x7f02a815de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.085+0000 7f029effd640 1 -- 172.21.15.19:0/1426923899 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a80b58f0 con 0x7f02a80b43f0 2024-09-12T01:58:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.085+0000 7f02a6ffd640 1 -- 172.21.15.19:0/1426923899 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3278000208 0 0) 0x7f02a80b3830 con 0x7f02a80b4e80 2024-09-12T01:58:27.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.086+0000 7f029effd640 1 --2- 172.21.15.19:0/1426923899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a80b43f0 0x7f02a80b4940 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f02a8068830 tx=0x7f029002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67bfbdcd1bbff52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:27.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.086+0000 7f02a6ffd640 1 -- 172.21.15.19:0/1426923899 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0290037070 con 0x7f02a80b43f0 2024-09-12T01:58:27.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.086+0000 7f02a6ffd640 1 -- 172.21.15.19:0/1426923899 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0290032440 con 0x7f02a80b43f0 2024-09-12T01:58:27.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.086+0000 7f02a6ffd640 1 -- 172.21.15.19:0/1426923899 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0290032810 con 0x7f02a80b43f0 2024-09-12T01:58:27.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.086+0000 7f02adb52640 1 -- 172.21.15.19:0/1426923899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a80b43f0 msgr2=0x7f02a80b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:27.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.086+0000 7f02adb52640 1 --2- 172.21.15.19:0/1426923899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a80b43f0 0x7f02a80b4940 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f02a8068830 tx=0x7f029002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:58:27.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.087+0000 7f02adb52640 1 -- 172.21.15.19:0/1426923899 shutdown_connections 2024-09-12T01:58:27.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.087+0000 7f02adb52640 1 --2- 172.21.15.19:0/1426923899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a80b43f0 0x7f02a80b4940 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:27.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.087+0000 7f02adb52640 1 --2- 172.21.15.19:0/1426923899 >> v2:172.21.15.135:3300/0 conn(0x7f02a815b340 0x7f02a809aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:27.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.087+0000 7f02adb52640 1 -- 172.21.15.19:0/1426923899 >> 172.21.15.19:0/1426923899 conn(0x7f02a8073490 msgr2=0x7f02a80b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:27.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.087+0000 7f02adb52640 1 -- 172.21.15.19:0/1426923899 shutdown_connections 2024-09-12T01:58:27.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.087+0000 7f02adb52640 1 -- 172.21.15.19:0/1426923899 wait complete. 2024-09-12T01:58:27.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.088+0000 7f02adb52640 1 Processor -- start 2024-09-12T01:58:27.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.088+0000 7f02adb52640 1 -- start start 2024-09-12T01:58:27.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.089+0000 7f02adb52640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a80b43f0 0x7f02a8149760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:27.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.089+0000 7f02adb52640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02a80b4e80 0x7f02a813fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:27.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.089+0000 7f02adb52640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02a815b340 0x7f02a8158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:27.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.089+0000 7f02a77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a80b43f0 0x7f02a8149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:27.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.089+0000 7f02adb52640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f02a80b52c0 con 0x7f02a80b43f0 2024-09-12T01:58:27.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.089+0000 7f02a77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a80b43f0 0x7f02a8149760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50380/0 (socket says 172.21.15.19:50380) 2024-09-12T01:58:27.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.089+0000 7f02a77fe640 1 -- 172.21.15.19:0/1350378230 learned_addr learned my addr 172.21.15.19:0/1350378230 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:27.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.089+0000 7f02adb52640 1 -- 172.21.15.19:0/1350378230 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f02a815d8f0 con 0x7f02a80b4e80 2024-09-12T01:58:27.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.089+0000 7f02adb52640 1 -- 172.21.15.19:0/1350378230 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f02a815c730 con 0x7f02a815b340 2024-09-12T01:58:27.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.089+0000 7f029effd640 1 --2- 172.21.15.19:0/1350378230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02a80b4e80 0x7f02a813fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:27.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.089+0000 7f02a7fff640 1 --2- 172.21.15.19:0/1350378230 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02a815b340 0x7f02a8158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:27.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.089+0000 7f02a77fe640 1 -- 172.21.15.19:0/1350378230 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02a815b340 msgr2=0x7f02a8158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:27.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.089+0000 7f02a77fe640 1 --2- 172.21.15.19:0/1350378230 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02a815b340 0x7f02a8158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:27.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.089+0000 7f02a77fe640 1 -- 172.21.15.19:0/1350378230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02a80b4e80 msgr2=0x7f02a813fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:27.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.089+0000 7f02a77fe640 1 --2- 172.21.15.19:0/1350378230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02a80b4e80 0x7f02a813fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:27.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.089+0000 7f02a77fe640 1 -- 172.21.15.19:0/1350378230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a80ce880 con 0x7f02a80b43f0 2024-09-12T01:58:27.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.089+0000 7f02a7fff640 1 --2- 172.21.15.19:0/1350378230 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02a815b340 0x7f02a8158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:27.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.089+0000 7f02a77fe640 1 --2- 172.21.15.19:0/1350378230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a80b43f0 0x7f02a8149760 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f029800e9e0 tx=0x7f029800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:27.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.090+0000 7f02a4ff9640 1 -- 172.21.15.19:0/1350378230 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0298017070 con 0x7f02a80b43f0 2024-09-12T01:58:27.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.090+0000 7f02a4ff9640 1 -- 172.21.15.19:0/1350378230 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f029800c9d0 con 0x7f02a80b43f0 2024-09-12T01:58:27.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.090+0000 7f02adb52640 1 -- 172.21.15.19:0/1350378230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a80ceb60 con 0x7f02a80b43f0 2024-09-12T01:58:27.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.090+0000 7f02a4ff9640 1 -- 172.21.15.19:0/1350378230 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029800cdc0 con 0x7f02a80b43f0 2024-09-12T01:58:27.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.090+0000 7f02adb52640 1 -- 172.21.15.19:0/1350378230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a81f00a0 con 0x7f02a80b43f0 2024-09-12T01:58:27.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.091+0000 7f02adb52640 1 -- 172.21.15.19:0/1350378230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a80cdb30 con 0x7f02a80b43f0 2024-09-12T01:58:27.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.091+0000 7f02a4ff9640 1 -- 172.21.15.19:0/1350378230 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f029801a070 con 0x7f02a80b43f0 2024-09-12T01:58:27.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.092+0000 7f02a4ff9640 1 --2- 172.21.15.19:0/1350378230 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f028806be30 0x7f028806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:27.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.092+0000 7f02a4ff9640 1 -- 172.21.15.19:0/1350378230 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5421+0+0 (secure 0 0 0) 0x7f029808b060 con 0x7f02a80b43f0 2024-09-12T01:58:27.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.092+0000 7f029effd640 1 --2- 172.21.15.19:0/1350378230 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f028806be30 0x7f028806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:27.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.093+0000 7f029effd640 1 --2- 172.21.15.19:0/1350378230 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f028806be30 0x7f028806e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0290034000 tx=0x7f029002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:27.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.096+0000 7f02a4ff9640 1 -- 172.21.15.19:0/1350378230 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02980594e0 con 0x7f02a80b43f0 2024-09-12T01:58:27.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:27.283+0000 7f02adb52640 1 -- 172.21.15.19:0/1350378230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f02a80ced30 con 0x7f02a80b43f0 2024-09-12T01:58:28.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.055+0000 7f02a4ff9640 1 -- 172.21.15.19:0/1350378230 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v60) ==== 97+0+0 (secure 0 0 0) 0x7f029805d7e0 con 0x7f02a80b43f0 2024-09-12T01:58:28.056 INFO:teuthology.orchestra.run.smithi019.stderr: removed all blocklist entries 2024-09-12T01:58:28.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.059+0000 7f02adb52640 1 -- 172.21.15.19:0/1350378230 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f028806be30 msgr2=0x7f028806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.059+0000 7f02adb52640 1 --2- 172.21.15.19:0/1350378230 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f028806be30 0x7f028806e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0290034000 tx=0x7f029002e000 comp rx=0 tx=0).stop 2024-09-12T01:58:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.059+0000 7f02adb52640 1 -- 172.21.15.19:0/1350378230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a80b43f0 msgr2=0x7f02a8149760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.059+0000 7f02adb52640 1 --2- 172.21.15.19:0/1350378230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a80b43f0 0x7f02a8149760 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f029800e9e0 tx=0x7f029800eea0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.059+0000 7f02adb52640 1 -- 172.21.15.19:0/1350378230 shutdown_connections 2024-09-12T01:58:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.059+0000 7f02adb52640 1 --2- 172.21.15.19:0/1350378230 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f028806be30 0x7f028806e2f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.059+0000 7f02adb52640 1 --2- 172.21.15.19:0/1350378230 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02a815b340 0x7f02a8158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.059+0000 7f02adb52640 1 --2- 172.21.15.19:0/1350378230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02a80b4e80 0x7f02a813fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.059+0000 7f02adb52640 1 --2- 172.21.15.19:0/1350378230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a80b43f0 0x7f02a8149760 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.059+0000 7f02adb52640 1 -- 172.21.15.19:0/1350378230 >> 172.21.15.19:0/1350378230 conn(0x7f02a8073490 msgr2=0x7f02a806be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:28.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.059+0000 7f02adb52640 1 -- 172.21.15.19:0/1350378230 shutdown_connections 2024-09-12T01:58:28.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.059+0000 7f02adb52640 1 -- 172.21.15.19:0/1350378230 wait complete. 2024-09-12T01:58:28.074 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T01:58:28.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.183+0000 7f657fd2c640 1 Processor -- start 2024-09-12T01:58:28.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.183+0000 7f657fd2c640 1 -- start start 2024-09-12T01:58:28.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.184+0000 7f657fd2c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f65780cfcc0 0x7f657806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.184+0000 7f657fd2c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f65780d4fd0 0x7f65780d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.184+0000 7f657fd2c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65780d2700 con 0x7f657815e760 2024-09-12T01:58:28.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.184+0000 7f657fd2c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f65780cedb0 con 0x7f65780cfcc0 2024-09-12T01:58:28.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.184+0000 7f657fd2c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f65780cf090 con 0x7f65780d4fd0 2024-09-12T01:58:28.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.184+0000 7f657d2c7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f65780cfcc0 0x7f657806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.184+0000 7f657dac8640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f657815e760 0x7f65780cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41128/0 (socket says 172.21.15.19:41128) 2024-09-12T01:58:28.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.184+0000 7f657dac8640 1 -- 172.21.15.19:0/1743910899 learned_addr learned my addr 172.21.15.19:0/1743910899 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:28.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.185+0000 7f657e2c9640 1 --2- 172.21.15.19:0/1743910899 >> v2:172.21.15.135:3300/0 conn(0x7f65780d4fd0 0x7f65780d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.185+0000 7f657d2c7640 1 -- 172.21.15.19:0/1743910899 >> v2:172.21.15.135:3300/0 conn(0x7f65780d4fd0 msgr2=0x7f65780d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:28.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.185+0000 7f657d2c7640 1 --2- 172.21.15.19:0/1743910899 >> v2:172.21.15.135:3300/0 conn(0x7f65780d4fd0 0x7f65780d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.185+0000 7f657d2c7640 1 -- 172.21.15.19:0/1743910899 >> v1:172.21.15.19:6789/0 conn(0x7f657815e760 legacy=0x7f65780cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.185+0000 7f657cac6640 1 -- 172.21.15.19:0/1743910899 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3049948421 0 0) 0x7f6574001110 con 0x7f657815e760 2024-09-12T01:58:28.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.185+0000 7f657d2c7640 1 -- 172.21.15.19:0/1743910899 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65780b3c80 con 0x7f65780cfcc0 2024-09-12T01:58:28.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.185+0000 7f657d2c7640 1 --2- 172.21.15.19:0/1743910899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65780cfcc0 0x7f657806cdd0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f657806ee50 tx=0x7f656802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85774ada9fcccdc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:28.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.186+0000 7f657cac6640 1 -- 172.21.15.19:0/1743910899 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568037070 con 0x7f65780cfcc0 2024-09-12T01:58:28.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.186+0000 7f657cac6640 1 -- 172.21.15.19:0/1743910899 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6568032440 con 0x7f65780cfcc0 2024-09-12T01:58:28.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.186+0000 7f657cac6640 1 -- 172.21.15.19:0/1743910899 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568032810 con 0x7f65780cfcc0 2024-09-12T01:58:28.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.186+0000 7f657fd2c640 1 -- 172.21.15.19:0/1743910899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65780cfcc0 msgr2=0x7f657806cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.186+0000 7f657fd2c640 1 --2- 172.21.15.19:0/1743910899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65780cfcc0 0x7f657806cdd0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f657806ee50 tx=0x7f656802a1a0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.186+0000 7f657fd2c640 1 -- 172.21.15.19:0/1743910899 shutdown_connections 2024-09-12T01:58:28.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.186+0000 7f657fd2c640 1 --2- 172.21.15.19:0/1743910899 >> v2:172.21.15.135:3300/0 conn(0x7f65780d4fd0 0x7f65780d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.186+0000 7f657fd2c640 1 --2- 172.21.15.19:0/1743910899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65780cfcc0 0x7f657806cdd0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.186+0000 7f657fd2c640 1 -- 172.21.15.19:0/1743910899 >> 172.21.15.19:0/1743910899 conn(0x7f657808bfc0 msgr2=0x7f65780d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:28.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.186+0000 7f657fd2c640 1 -- 172.21.15.19:0/1743910899 shutdown_connections 2024-09-12T01:58:28.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.186+0000 7f657fd2c640 1 -- 172.21.15.19:0/1743910899 wait complete. 2024-09-12T01:58:28.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.187+0000 7f657fd2c640 1 Processor -- start 2024-09-12T01:58:28.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.187+0000 7f657fd2c640 1 -- start start 2024-09-12T01:58:28.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.188+0000 7f657fd2c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65780cfcc0 0x7f657814b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.188+0000 7f657fd2c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65780d4fd0 0x7f65780b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.188+0000 7f657fd2c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f657815e760 0x7f65780d3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.188+0000 7f657fd2c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f65780d33e0 con 0x7f65780d4fd0 2024-09-12T01:58:28.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.188+0000 7f657fd2c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f65780b38e0 con 0x7f657815e760 2024-09-12T01:58:28.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.188+0000 7f657fd2c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f65780d3560 con 0x7f65780cfcc0 2024-09-12T01:58:28.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.188+0000 7f657d2c7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65780d4fd0 0x7f65780b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.188+0000 7f657d2c7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65780d4fd0 0x7f65780b7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50390/0 (socket says 172.21.15.19:50390) 2024-09-12T01:58:28.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.188+0000 7f657d2c7640 1 -- 172.21.15.19:0/2592258453 learned_addr learned my addr 172.21.15.19:0/2592258453 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:28.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.188+0000 7f657e2c9640 1 --2- 172.21.15.19:0/2592258453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f657815e760 0x7f65780d3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.188+0000 7f657dac8640 1 --2- 172.21.15.19:0/2592258453 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65780cfcc0 0x7f657814b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.189+0000 7f657d2c7640 1 -- 172.21.15.19:0/2592258453 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65780cfcc0 msgr2=0x7f657814b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.189+0000 7f657d2c7640 1 --2- 172.21.15.19:0/2592258453 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65780cfcc0 0x7f657814b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.189+0000 7f657d2c7640 1 -- 172.21.15.19:0/2592258453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f657815e760 msgr2=0x7f65780d3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.189+0000 7f657d2c7640 1 --2- 172.21.15.19:0/2592258453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f657815e760 0x7f65780d3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.189+0000 7f657d2c7640 1 -- 172.21.15.19:0/2592258453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65780b7c80 con 0x7f65780d4fd0 2024-09-12T01:58:28.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.189+0000 7f657d2c7640 1 --2- 172.21.15.19:0/2592258453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65780d4fd0 0x7f65780b7380 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6568000c00 tx=0x7f65680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:28.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.189+0000 7f656e7fc640 1 -- 172.21.15.19:0/2592258453 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568043070 con 0x7f65780d4fd0 2024-09-12T01:58:28.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.189+0000 7f656e7fc640 1 -- 172.21.15.19:0/2592258453 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6568038040 con 0x7f65780d4fd0 2024-09-12T01:58:28.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.189+0000 7f657fd2c640 1 -- 172.21.15.19:0/2592258453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65780b7f60 con 0x7f65780d4fd0 2024-09-12T01:58:28.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.189+0000 7f656e7fc640 1 -- 172.21.15.19:0/2592258453 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568037050 con 0x7f65780d4fd0 2024-09-12T01:58:28.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.189+0000 7f657fd2c640 1 -- 172.21.15.19:0/2592258453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f657814c320 con 0x7f65780d4fd0 2024-09-12T01:58:28.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.190+0000 7f657fd2c640 1 -- 172.21.15.19:0/2592258453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65780b8180 con 0x7f65780d4fd0 2024-09-12T01:58:28.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.191+0000 7f656e7fc640 1 -- 172.21.15.19:0/2592258453 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6568046070 con 0x7f65780d4fd0 2024-09-12T01:58:28.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.191+0000 7f656e7fc640 1 --2- 172.21.15.19:0/2592258453 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f655c06be30 0x7f655c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.191+0000 7f656e7fc640 1 -- 172.21.15.19:0/2592258453 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5249+0+0 (secure 0 0 0) 0x7f65680aad50 con 0x7f65780d4fd0 2024-09-12T01:58:28.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.192+0000 7f657dac8640 1 --2- 172.21.15.19:0/2592258453 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f655c06be30 0x7f655c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.192+0000 7f657dac8640 1 --2- 172.21.15.19:0/2592258453 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f655c06be30 0x7f655c06e2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6574007fd0 tx=0x7f6574007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:28.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.196+0000 7f656e7fc640 1 -- 172.21.15.19:0/2592258453 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f65780b8180 con 0x7f65780d4fd0 2024-09-12T01:58:28.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.441+0000 7f657fd2c640 1 -- 172.21.15.19:0/2592258453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f65780d3890 con 0x7f65780d4fd0 2024-09-12T01:58:28.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.441+0000 7f656e7fc640 1 -- 172.21.15.19:0/2592258453 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f65680ae030 con 0x7f65780d4fd0 2024-09-12T01:58:28.442 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:28.442 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:58:28.442 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_dump": [ 2024-09-12T01:58:28.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.442 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.a", 2024-09-12T01:58:28.442 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJm5rSjChAA4H0OW7ubTgq4vmUaoGvvNA==", 2024-09-12T01:58:28.442 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.442 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:58:28.443 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T01:58:28.443 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T01:58:28.443 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:58:28.443 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:58:28.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.443 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.b", 2024-09-12T01:58:28.443 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmyaCyFhAAV87Ogacs5CmiAuG0p/61Fw==", 2024-09-12T01:58:28.443 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.443 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:58:28.443 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T01:58:28.443 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T01:58:28.443 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:58:28.443 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:58:28.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.444 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.c", 2024-09-12T01:58:28.444 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmVLrfERAAlIw2yLSJubtZ1o4NB9IDsg==", 2024-09-12T01:58:28.444 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.444 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:58:28.444 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T01:58:28.444 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T01:58:28.444 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:58:28.444 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:58:28.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.444 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.d", 2024-09-12T01:58:28.445 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmd6a1HRAA04/r87MKfFM1VQvG1Tjj8A==", 2024-09-12T01:58:28.445 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.445 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:58:28.445 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T01:58:28.445 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T01:58:28.445 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:58:28.445 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:58:28.445 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.445 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.0", 2024-09-12T01:58:28.445 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD0SeJme7ETBRAA/8v8aJcEzpHYmAPg5Hxdzg==", 2024-09-12T01:58:28.445 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.445 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:58:28.445 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:58:28.446 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:58:28.446 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:58:28.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.446 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.1", 2024-09-12T01:58:28.446 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD3SeJmfXQyFhAALiZjnIoDw+OtH9of5IUu0w==", 2024-09-12T01:58:28.446 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.446 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:58:28.446 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:58:28.446 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:58:28.446 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:58:28.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.446 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.2", 2024-09-12T01:58:28.447 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD6SeJmMDNwJxAABb+94TBxpZx3GovP1g1Q2A==", 2024-09-12T01:58:28.447 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.447 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:58:28.447 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:58:28.447 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:58:28.447 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:58:28.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.447 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.3", 2024-09-12T01:58:28.447 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD9SeJmZMgKOBAAgU+mzTBmPSHE7mUElUA9lA==", 2024-09-12T01:58:28.447 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.447 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:58:28.447 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:58:28.447 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:58:28.448 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:58:28.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.448 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.4", 2024-09-12T01:58:28.448 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAESuJmnb9kBBAA6PmrEGSckixHv73r9ogheQ==", 2024-09-12T01:58:28.448 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.448 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:58:28.448 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:58:28.448 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:58:28.448 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:58:28.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.448 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.5", 2024-09-12T01:58:28.448 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAHSuJmLU1hBhAAlFooSVxCEmIHSjqscaFnhQ==", 2024-09-12T01:58:28.448 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.449 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:58:28.449 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:58:28.449 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:58:28.449 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:58:28.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.449 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.6", 2024-09-12T01:58:28.449 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAKSuJmeIj7BxAADTmZtK8dk94LSGa88+xq3Q==", 2024-09-12T01:58:28.449 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.449 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:58:28.449 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:58:28.449 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:58:28.449 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:58:28.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.450 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.7", 2024-09-12T01:58:28.450 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQANSuJmw92iJxAAsjNKRSdndTUGmBtaN3g/pQ==", 2024-09-12T01:58:28.450 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.450 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T01:58:28.450 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T01:58:28.450 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:58:28.450 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:58:28.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.450 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.0", 2024-09-12T01:58:28.450 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmfHbXIRAALAvdYAlaB6WxWtubFnlxRw==", 2024-09-12T01:58:28.451 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.451 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:58:28.451 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow r", 2024-09-12T01:58:28.451 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T01:58:28.451 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:58:28.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.451 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.1", 2024-09-12T01:58:28.451 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmOjfDKhAA8h0ldWP6mNPgoqtIejhF+Q==", 2024-09-12T01:58:28.451 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.451 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:58:28.451 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T01:58:28.451 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T01:58:28.451 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T01:58:28.452 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:58:28.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.452 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.2", 2024-09-12T01:58:28.452 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmLQSOJxAA2RhDLfjVzPpg1kiJe++WHg==", 2024-09-12T01:58:28.452 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.452 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:58:28.452 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T01:58:28.452 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T01:58:28.452 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T01:58:28.452 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:58:28.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.453 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.3", 2024-09-12T01:58:28.453 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmXS5YMBAAXSS+3Omu0PYIz1bJcSxefw==", 2024-09-12T01:58:28.453 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.453 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T01:58:28.453 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T01:58:28.453 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T01:58:28.453 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T01:58:28.453 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:58:28.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.454 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.admin", 2024-09-12T01:58:28.454 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDvSeJmCljiKRAAQmsy5rl4ZPpm2pD1kXMO3g==", 2024-09-12T01:58:28.454 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.454 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-09-12T01:58:28.454 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T01:58:28.454 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T01:58:28.454 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:58:28.454 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:58:28.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.454 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.x", 2024-09-12T01:58:28.454 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmjx1VBxAAF80kgsMnFJn+gL44QZn6bg==", 2024-09-12T01:58:28.454 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.454 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-09-12T01:58:28.454 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-09-12T01:58:28.455 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:58:28.455 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:58:28.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.455 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.y", 2024-09-12T01:58:28.455 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmXphnAxAAUnmZ3JPOt1Yzk0zqWh5+kg==", 2024-09-12T01:58:28.455 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T01:58:28.455 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-09-12T01:58:28.455 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-09-12T01:58:28.455 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T01:58:28.455 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.455 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.455 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T01:58:28.456 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:58:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.443+0000 7f657fd2c640 1 -- 172.21.15.19:0/2592258453 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f655c06be30 msgr2=0x7f655c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.443+0000 7f657fd2c640 1 --2- 172.21.15.19:0/2592258453 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f655c06be30 0x7f655c06e2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6574007fd0 tx=0x7f6574007de0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.443+0000 7f657fd2c640 1 -- 172.21.15.19:0/2592258453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65780d4fd0 msgr2=0x7f65780b7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.443+0000 7f657fd2c640 1 --2- 172.21.15.19:0/2592258453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65780d4fd0 0x7f65780b7380 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6568000c00 tx=0x7f65680046c0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.443+0000 7f657fd2c640 1 -- 172.21.15.19:0/2592258453 shutdown_connections 2024-09-12T01:58:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.443+0000 7f657fd2c640 1 --2- 172.21.15.19:0/2592258453 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f655c06be30 0x7f655c06e2f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.443+0000 7f657fd2c640 1 --2- 172.21.15.19:0/2592258453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f657815e760 0x7f65780d3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.443+0000 7f657fd2c640 1 --2- 172.21.15.19:0/2592258453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65780d4fd0 0x7f65780b7380 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.443+0000 7f657fd2c640 1 --2- 172.21.15.19:0/2592258453 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65780cfcc0 0x7f657814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.443+0000 7f657fd2c640 1 -- 172.21.15.19:0/2592258453 >> 172.21.15.19:0/2592258453 conn(0x7f657808bfc0 msgr2=0x7f65780b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.444+0000 7f657fd2c640 1 -- 172.21.15.19:0/2592258453 shutdown_connections 2024-09-12T01:58:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.444+0000 7f657fd2c640 1 -- 172.21.15.19:0/2592258453 wait complete. 2024-09-12T01:58:28.458 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T01:58:28.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.561+0000 7f243df9f640 1 Processor -- start 2024-09-12T01:58:28.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.561+0000 7f243df9f640 1 -- start start 2024-09-12T01:58:28.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.562+0000 7f243df9f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2438072d30 0x7f243806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.562+0000 7f243df9f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f243806f700 0x7f243815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.562+0000 7f243df9f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24380cdbe0 con 0x7f243815b300 2024-09-12T01:58:28.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.562+0000 7f243df9f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f243806fb50 con 0x7f243806f700 2024-09-12T01:58:28.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.562+0000 7f243df9f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f24380728a0 con 0x7f2438072d30 2024-09-12T01:58:28.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.562+0000 7f2437fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f243806f700 0x7f243815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.562+0000 7f2436ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2438072d30 0x7f243806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.562+0000 7f24377fe640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f243815b300 0x7f24380cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:41234/0 (socket says 172.21.15.19:41234) 2024-09-12T01:58:28.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.562+0000 7f24377fe640 1 -- 172.21.15.19:0/2644479875 learned_addr learned my addr 172.21.15.19:0/2644479875 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:28.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.563+0000 7f2437fff640 1 -- 172.21.15.19:0/2644479875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2438072d30 msgr2=0x7f243806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:28.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.563+0000 7f2437fff640 1 --2- 172.21.15.19:0/2644479875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2438072d30 0x7f243806f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.563+0000 7f2437fff640 1 -- 172.21.15.19:0/2644479875 >> v1:172.21.15.135:6789/0 conn(0x7f243815b300 legacy=0x7f24380cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.563+0000 7f2437fff640 1 -- 172.21.15.19:0/2644479875 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24380cd900 con 0x7f243806f700 2024-09-12T01:58:28.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.563+0000 7f2437fff640 1 --2- 172.21.15.19:0/2644479875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243806f700 0x7f243815b6e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2430009d90 tx=0x7f243002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d38e2f1e6939a3cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:28.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.564+0000 7f24367fc640 1 -- 172.21.15.19:0/2644479875 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430007740 con 0x7f243806f700 2024-09-12T01:58:28.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.564+0000 7f24367fc640 1 -- 172.21.15.19:0/2644479875 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24300078e0 con 0x7f243806f700 2024-09-12T01:58:28.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.564+0000 7f24367fc640 1 -- 172.21.15.19:0/2644479875 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430007cb0 con 0x7f243806f700 2024-09-12T01:58:28.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.564+0000 7f243df9f640 1 -- 172.21.15.19:0/2644479875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243806f700 msgr2=0x7f243815b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.564+0000 7f243df9f640 1 --2- 172.21.15.19:0/2644479875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243806f700 0x7f243815b6e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2430009d90 tx=0x7f243002a660 comp rx=0 tx=0).stop 2024-09-12T01:58:28.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.564+0000 7f243df9f640 1 -- 172.21.15.19:0/2644479875 shutdown_connections 2024-09-12T01:58:28.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.564+0000 7f243df9f640 1 --2- 172.21.15.19:0/2644479875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2438072d30 0x7f243806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.564+0000 7f243df9f640 1 --2- 172.21.15.19:0/2644479875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243806f700 0x7f243815b6e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.564+0000 7f243df9f640 1 -- 172.21.15.19:0/2644479875 >> 172.21.15.19:0/2644479875 conn(0x7f2438067d70 msgr2=0x7f243806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:28.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.564+0000 7f243df9f640 1 -- 172.21.15.19:0/2644479875 shutdown_connections 2024-09-12T01:58:28.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.564+0000 7f243df9f640 1 -- 172.21.15.19:0/2644479875 wait complete. 2024-09-12T01:58:28.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.565+0000 7f243df9f640 1 Processor -- start 2024-09-12T01:58:28.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.566+0000 7f243df9f640 1 -- start start 2024-09-12T01:58:28.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.566+0000 7f243df9f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243806f700 0x7f243814e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.566+0000 7f243df9f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2438072d30 0x7f24381e5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.566+0000 7f243df9f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f243815b300 0x7f24381e6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.566+0000 7f243df9f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f24380cd5c0 con 0x7f243815b300 2024-09-12T01:58:28.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.566+0000 7f243df9f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2438072530 con 0x7f243806f700 2024-09-12T01:58:28.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.566+0000 7f243df9f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f24380cffe0 con 0x7f2438072d30 2024-09-12T01:58:28.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.566+0000 7f2437fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f243815b300 0x7f24381e6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.566+0000 7f2437fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f243815b300 0x7f24381e6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50398/0 (socket says 172.21.15.19:50398) 2024-09-12T01:58:28.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.566+0000 7f2437fff640 1 -- 172.21.15.19:0/1023159036 learned_addr learned my addr 172.21.15.19:0/1023159036 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:28.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.567+0000 7f2436ffd640 1 --2- 172.21.15.19:0/1023159036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2438072d30 0x7f24381e5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.567+0000 7f24377fe640 1 --2- 172.21.15.19:0/1023159036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243806f700 0x7f243814e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.567+0000 7f2437fff640 1 -- 172.21.15.19:0/1023159036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2438072d30 msgr2=0x7f24381e5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.567+0000 7f2437fff640 1 --2- 172.21.15.19:0/1023159036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2438072d30 0x7f24381e5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.567+0000 7f2437fff640 1 -- 172.21.15.19:0/1023159036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243806f700 msgr2=0x7f243814e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.567+0000 7f2437fff640 1 --2- 172.21.15.19:0/1023159036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243806f700 0x7f243814e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.567+0000 7f2437fff640 1 -- 172.21.15.19:0/1023159036 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243814ecb0 con 0x7f243815b300 2024-09-12T01:58:28.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.567+0000 7f2437fff640 1 --2- 172.21.15.19:0/1023159036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f243815b300 0x7f24381e6060 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2430009eb0 tx=0x7f2430004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:28.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.567+0000 7f241ffff640 1 -- 172.21.15.19:0/1023159036 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430040070 con 0x7f243815b300 2024-09-12T01:58:28.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.567+0000 7f241ffff640 1 -- 172.21.15.19:0/1023159036 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2430031c60 con 0x7f243815b300 2024-09-12T01:58:28.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.567+0000 7f243df9f640 1 -- 172.21.15.19:0/1023159036 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2438157130 con 0x7f243815b300 2024-09-12T01:58:28.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.567+0000 7f241ffff640 1 -- 172.21.15.19:0/1023159036 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430009450 con 0x7f243815b300 2024-09-12T01:58:28.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.567+0000 7f243df9f640 1 -- 172.21.15.19:0/1023159036 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24381576f0 con 0x7f243815b300 2024-09-12T01:58:28.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.568+0000 7f243df9f640 1 -- 172.21.15.19:0/1023159036 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2438158eb0 con 0x7f243815b300 2024-09-12T01:58:28.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.569+0000 7f241ffff640 1 -- 172.21.15.19:0/1023159036 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2430039040 con 0x7f243815b300 2024-09-12T01:58:28.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.569+0000 7f241ffff640 1 --2- 172.21.15.19:0/1023159036 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f242406be30 0x7f242406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.569+0000 7f241ffff640 1 -- 172.21.15.19:0/1023159036 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5249+0+0 (secure 0 0 0) 0x7f24300ac020 con 0x7f243815b300 2024-09-12T01:58:28.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.569+0000 7f24377fe640 1 --2- 172.21.15.19:0/1023159036 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f242406be30 0x7f242406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.570+0000 7f24377fe640 1 --2- 172.21.15.19:0/1023159036 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f242406be30 0x7f242406e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2428007fd0 tx=0x7f2428007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:28.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.573+0000 7f241ffff640 1 -- 172.21.15.19:0/1023159036 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f243007a5d0 con 0x7f243815b300 2024-09-12T01:58:28.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.750+0000 7f243df9f640 1 -- 172.21.15.19:0/1023159036 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2438158bd0 con 0x7f243815b300 2024-09-12T01:58:28.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.751+0000 7f241ffff640 1 -- 172.21.15.19:0/1023159036 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v62) ==== 84+0+65 (secure 0 0 0) 0x7f243007e8d0 con 0x7f243815b300 2024-09-12T01:58:28.751 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:28.751 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-09-12T01:58:28.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:58:28.752 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-09-12T01:58:28.752 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-09-12T01:58:28.752 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:58:28.752 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-09-12T01:58:28.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.752+0000 7f243df9f640 1 -- 172.21.15.19:0/1023159036 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f242406be30 msgr2=0x7f242406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.752+0000 7f243df9f640 1 --2- 172.21.15.19:0/1023159036 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f242406be30 0x7f242406e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2428007fd0 tx=0x7f2428007e80 comp rx=0 tx=0).stop 2024-09-12T01:58:28.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.752+0000 7f243df9f640 1 -- 172.21.15.19:0/1023159036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f243815b300 msgr2=0x7f24381e6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.752+0000 7f243df9f640 1 --2- 172.21.15.19:0/1023159036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f243815b300 0x7f24381e6060 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2430009eb0 tx=0x7f2430004a40 comp rx=0 tx=0).stop 2024-09-12T01:58:28.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.752+0000 7f243df9f640 1 -- 172.21.15.19:0/1023159036 shutdown_connections 2024-09-12T01:58:28.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.752+0000 7f243df9f640 1 --2- 172.21.15.19:0/1023159036 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f242406be30 0x7f242406e2f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.752+0000 7f243df9f640 1 --2- 172.21.15.19:0/1023159036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f243815b300 0x7f24381e6060 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.752+0000 7f243df9f640 1 --2- 172.21.15.19:0/1023159036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2438072d30 0x7f24381e5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.752+0000 7f243df9f640 1 --2- 172.21.15.19:0/1023159036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243806f700 0x7f243814e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.752+0000 7f243df9f640 1 -- 172.21.15.19:0/1023159036 >> 172.21.15.19:0/1023159036 conn(0x7f2438067d70 msgr2=0x7f24380b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:28.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.753+0000 7f243df9f640 1 -- 172.21.15.19:0/1023159036 shutdown_connections 2024-09-12T01:58:28.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.753+0000 7f243df9f640 1 -- 172.21.15.19:0/1023159036 wait complete. 2024-09-12T01:58:28.764 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:58:28.764 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:58:28.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.870+0000 7fdd235d6640 1 Processor -- start 2024-09-12T01:58:28.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.870+0000 7fdd235d6640 1 -- start start 2024-09-12T01:58:28.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.871+0000 7fdd235d6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd1c15e6c0 0x7fdd1c0cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.871+0000 7fdd235d6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdd1c0d5090 0x7fdd1c0cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.871+0000 7fdd235d6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdd1c0cfae0 0x7fdd1c1622d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.871+0000 7fdd235d6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fdd1c0cf400 con 0x7fdd1c0d5090 2024-09-12T01:58:28.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.871+0000 7fdd235d6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fdd1c0b10d0 con 0x7fdd1c0cfae0 2024-09-12T01:58:28.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.871+0000 7fdd235d6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdd1c0cfef0 con 0x7fdd1c15e6c0 2024-09-12T01:58:28.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.871+0000 7fdd20b71640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdd1c0d5090 0x7fdd1c0cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.871+0000 7fdd20b71640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdd1c0d5090 0x7fdd1c0cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50404/0 (socket says 172.21.15.19:50404) 2024-09-12T01:58:28.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.871+0000 7fdd20b71640 1 -- 172.21.15.19:0/1090838709 learned_addr learned my addr 172.21.15.19:0/1090838709 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:28.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.872+0000 7fdd21b73640 1 --2- 172.21.15.19:0/1090838709 >> v2:172.21.15.135:3300/0 conn(0x7fdd1c0cfae0 0x7fdd1c1622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.872+0000 7fdd21372640 1 --2- 172.21.15.19:0/1090838709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd1c15e6c0 0x7fdd1c0cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.872+0000 7fdd20b71640 1 -- 172.21.15.19:0/1090838709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd1c15e6c0 msgr2=0x7fdd1c0cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:28.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.872+0000 7fdd20b71640 1 --2- 172.21.15.19:0/1090838709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd1c15e6c0 0x7fdd1c0cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.872+0000 7fdd20b71640 1 -- 172.21.15.19:0/1090838709 >> v2:172.21.15.135:3300/0 conn(0x7fdd1c0cfae0 msgr2=0x7fdd1c1622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:28.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.872+0000 7fdd20b71640 1 --2- 172.21.15.19:0/1090838709 >> v2:172.21.15.135:3300/0 conn(0x7fdd1c0cfae0 0x7fdd1c1622d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.872+0000 7fdd20b71640 1 -- 172.21.15.19:0/1090838709 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1c0d34f0 con 0x7fdd1c0d5090 2024-09-12T01:58:28.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.872+0000 7fdd21b73640 1 --2- 172.21.15.19:0/1090838709 >> v2:172.21.15.135:3300/0 conn(0x7fdd1c0cfae0 0x7fdd1c1622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:28.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.872+0000 7fdd21372640 1 --2- 172.21.15.19:0/1090838709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd1c15e6c0 0x7fdd1c0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:28.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.872+0000 7fdd20b71640 1 --2- 172.21.15.19:0/1090838709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c0d5090 0x7fdd1c0cf5a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c08c740 tx=0x7fdd0c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3beb81f8d5c1d2b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:28.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.873+0000 7fdd13fff640 1 -- 172.21.15.19:0/1090838709 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c037070 con 0x7fdd1c0d5090 2024-09-12T01:58:28.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.873+0000 7fdd13fff640 1 -- 172.21.15.19:0/1090838709 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd0c02ae00 con 0x7fdd1c0d5090 2024-09-12T01:58:28.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.873+0000 7fdd13fff640 1 -- 172.21.15.19:0/1090838709 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c032660 con 0x7fdd1c0d5090 2024-09-12T01:58:28.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.873+0000 7fdd235d6640 1 -- 172.21.15.19:0/1090838709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c0d5090 msgr2=0x7fdd1c0cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.873+0000 7fdd235d6640 1 --2- 172.21.15.19:0/1090838709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c0d5090 0x7fdd1c0cf5a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c08c740 tx=0x7fdd0c02a0b0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.873+0000 7fdd235d6640 1 -- 172.21.15.19:0/1090838709 shutdown_connections 2024-09-12T01:58:28.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.873+0000 7fdd235d6640 1 --2- 172.21.15.19:0/1090838709 >> v2:172.21.15.135:3300/0 conn(0x7fdd1c0cfae0 0x7fdd1c1622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.873+0000 7fdd235d6640 1 --2- 172.21.15.19:0/1090838709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c0d5090 0x7fdd1c0cf5a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.873+0000 7fdd235d6640 1 --2- 172.21.15.19:0/1090838709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd1c15e6c0 0x7fdd1c0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.873+0000 7fdd235d6640 1 -- 172.21.15.19:0/1090838709 >> 172.21.15.19:0/1090838709 conn(0x7fdd1c08bfc0 msgr2=0x7fdd1c0d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:28.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.873+0000 7fdd235d6640 1 -- 172.21.15.19:0/1090838709 shutdown_connections 2024-09-12T01:58:28.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.873+0000 7fdd235d6640 1 -- 172.21.15.19:0/1090838709 wait complete. 2024-09-12T01:58:28.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.874+0000 7fdd235d6640 1 Processor -- start 2024-09-12T01:58:28.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.875+0000 7fdd235d6640 1 -- start start 2024-09-12T01:58:28.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.875+0000 7fdd235d6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd1c0cfae0 0x7fdd1c1f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.875+0000 7fdd235d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c0d5090 0x7fdd1c0b8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.875+0000 7fdd235d6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd1c15e6c0 0x7fdd1c0cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.875+0000 7fdd235d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c0cf0f0 con 0x7fdd1c0d5090 2024-09-12T01:58:28.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.875+0000 7fdd235d6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c0d3a70 con 0x7fdd1c0cfae0 2024-09-12T01:58:28.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.875+0000 7fdd235d6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdd1c15eaa0 con 0x7fdd1c15e6c0 2024-09-12T01:58:28.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.875+0000 7fdd20b71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c0d5090 0x7fdd1c0b8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.875+0000 7fdd20b71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c0d5090 0x7fdd1c0b8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50418/0 (socket says 172.21.15.19:50418) 2024-09-12T01:58:28.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.875+0000 7fdd20b71640 1 -- 172.21.15.19:0/1809639942 learned_addr learned my addr 172.21.15.19:0/1809639942 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:28.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.875+0000 7fdd21372640 1 --2- 172.21.15.19:0/1809639942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd1c0cfae0 0x7fdd1c1f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.876+0000 7fdd21b73640 1 --2- 172.21.15.19:0/1809639942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd1c15e6c0 0x7fdd1c0cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.876+0000 7fdd20b71640 1 -- 172.21.15.19:0/1809639942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd1c15e6c0 msgr2=0x7fdd1c0cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.876+0000 7fdd20b71640 1 --2- 172.21.15.19:0/1809639942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd1c15e6c0 0x7fdd1c0cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.876+0000 7fdd20b71640 1 -- 172.21.15.19:0/1809639942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd1c0cfae0 msgr2=0x7fdd1c1f5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.876+0000 7fdd20b71640 1 --2- 172.21.15.19:0/1809639942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd1c0cfae0 0x7fdd1c1f5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.876+0000 7fdd20b71640 1 -- 172.21.15.19:0/1809639942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1c1f5d80 con 0x7fdd1c0d5090 2024-09-12T01:58:28.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.876+0000 7fdd21372640 1 --2- 172.21.15.19:0/1809639942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd1c0cfae0 0x7fdd1c1f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:28.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.876+0000 7fdd20b71640 1 --2- 172.21.15.19:0/1809639942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c0d5090 0x7fdd1c0b8fe0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c000c00 tx=0x7fdd0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:28.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.876+0000 7fdd11ffb640 1 -- 172.21.15.19:0/1809639942 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c041030 con 0x7fdd1c0d5090 2024-09-12T01:58:28.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.876+0000 7fdd11ffb640 1 -- 172.21.15.19:0/1809639942 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd0c02ac00 con 0x7fdd1c0d5090 2024-09-12T01:58:28.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.876+0000 7fdd235d6640 1 -- 172.21.15.19:0/1809639942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd1c159180 con 0x7fdd1c0d5090 2024-09-12T01:58:28.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.876+0000 7fdd11ffb640 1 -- 172.21.15.19:0/1809639942 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c037040 con 0x7fdd1c0d5090 2024-09-12T01:58:28.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.876+0000 7fdd235d6640 1 -- 172.21.15.19:0/1809639942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd1c159740 con 0x7fdd1c0d5090 2024-09-12T01:58:28.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.877+0000 7fdd235d6640 1 -- 172.21.15.19:0/1809639942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd1c0cf5a0 con 0x7fdd1c0d5090 2024-09-12T01:58:28.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.878+0000 7fdd11ffb640 1 -- 172.21.15.19:0/1809639942 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd0c044070 con 0x7fdd1c0d5090 2024-09-12T01:58:28.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.878+0000 7fdd11ffb640 1 --2- 172.21.15.19:0/1809639942 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdd0006be60 0x7fdd0006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.878+0000 7fdd11ffb640 1 -- 172.21.15.19:0/1809639942 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5249+0+0 (secure 0 0 0) 0x7fdd0c0aafa0 con 0x7fdd1c0d5090 2024-09-12T01:58:28.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.879+0000 7fdd21372640 1 --2- 172.21.15.19:0/1809639942 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdd0006be60 0x7fdd0006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.879+0000 7fdd21372640 1 --2- 172.21.15.19:0/1809639942 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdd0006be60 0x7fdd0006e320 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800e550 tx=0x7fdd18007ab0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:28.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:28.882+0000 7fdd11ffb640 1 -- 172.21.15.19:0/1809639942 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd0c04b070 con 0x7fdd1c0d5090 2024-09-12T01:58:29.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:29.061+0000 7fdd235d6640 1 -- 172.21.15.19:0/1809639942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fdd1c0ceed0 con 0x7fdd1c0d5090 2024-09-12T01:58:30.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.058+0000 7fdd11ffb640 1 -- 172.21.15.19:0/1809639942 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v63) ==== 138+0+0 (secure 0 0 0) 0x7fdd0c032e20 con 0x7fdd1c0d5090 2024-09-12T01:58:30.094 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-09-12T01:58:30.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.062+0000 7fdd235d6640 1 -- 172.21.15.19:0/1809639942 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdd0006be60 msgr2=0x7fdd0006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:30.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.062+0000 7fdd235d6640 1 --2- 172.21.15.19:0/1809639942 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdd0006be60 0x7fdd0006e320 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800e550 tx=0x7fdd18007ab0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.062+0000 7fdd235d6640 1 -- 172.21.15.19:0/1809639942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c0d5090 msgr2=0x7fdd1c0b8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:30.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.062+0000 7fdd235d6640 1 --2- 172.21.15.19:0/1809639942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c0d5090 0x7fdd1c0b8fe0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c000c00 tx=0x7fdd0c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.062+0000 7fdd235d6640 1 -- 172.21.15.19:0/1809639942 shutdown_connections 2024-09-12T01:58:30.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.062+0000 7fdd235d6640 1 --2- 172.21.15.19:0/1809639942 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdd0006be60 0x7fdd0006e320 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.062+0000 7fdd235d6640 1 --2- 172.21.15.19:0/1809639942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd1c15e6c0 0x7fdd1c0cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.062+0000 7fdd235d6640 1 --2- 172.21.15.19:0/1809639942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c0d5090 0x7fdd1c0b8fe0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.062+0000 7fdd235d6640 1 --2- 172.21.15.19:0/1809639942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd1c0cfae0 0x7fdd1c1f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.062+0000 7fdd235d6640 1 -- 172.21.15.19:0/1809639942 >> 172.21.15.19:0/1809639942 conn(0x7fdd1c08bfc0 msgr2=0x7fdd1c0b3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:30.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.062+0000 7fdd235d6640 1 -- 172.21.15.19:0/1809639942 shutdown_connections 2024-09-12T01:58:30.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.062+0000 7fdd235d6640 1 -- 172.21.15.19:0/1809639942 wait complete. 2024-09-12T01:58:30.097 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:58:30.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.214+0000 7fcd39f5b640 1 Processor -- start 2024-09-12T01:58:30.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.214+0000 7fcd39f5b640 1 -- start start 2024-09-12T01:58:30.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.215+0000 7fcd39f5b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcd340b5fe0 0x7fcd340aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:30.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.215+0000 7fcd39f5b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd340ae240 con 0x7fcd3406bc10 2024-09-12T01:58:30.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.215+0000 7fcd39f5b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd340ae520 con 0x7fcd3415e410 2024-09-12T01:58:30.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.215+0000 7fcd39f5b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fcd340b6430 con 0x7fcd340b5fe0 2024-09-12T01:58:30.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.215+0000 7fcd33fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcd3406bc10 0x7fcd340aefe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41142/0 (socket says 172.21.15.19:41142) 2024-09-12T01:58:30.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.215+0000 7fcd33fff640 1 -- 172.21.15.19:0/2519645857 learned_addr learned my addr 172.21.15.19:0/2519645857 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:30.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd2affd640 1 --2- 172.21.15.19:0/2519645857 >> v2:172.21.15.135:3300/0 conn(0x7fcd340b5fe0 0x7fcd340aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:30.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd32ffd640 1 -- 172.21.15.19:0/2519645857 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4277173501 0 0) 0x7fcd340ae240 con 0x7fcd3406bc10 2024-09-12T01:58:30.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd32ffd640 1 -- 172.21.15.19:0/2519645857 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd20003520 con 0x7fcd3406bc10 2024-09-12T01:58:30.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd32ffd640 1 -- 172.21.15.19:0/2519645857 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1086404370 0 0) 0x7fcd340ae520 con 0x7fcd3415e410 2024-09-12T01:58:30.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd32ffd640 1 -- 172.21.15.19:0/2519645857 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd340ae240 con 0x7fcd3415e410 2024-09-12T01:58:30.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd32ffd640 1 -- 172.21.15.19:0/2519645857 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2752870089 0 0) 0x7fcd20003520 con 0x7fcd3406bc10 2024-09-12T01:58:30.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd32ffd640 1 -- 172.21.15.19:0/2519645857 >> v2:172.21.15.135:3300/0 conn(0x7fcd340b5fe0 msgr2=0x7fcd340aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:30.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd32ffd640 1 --2- 172.21.15.19:0/2519645857 >> v2:172.21.15.135:3300/0 conn(0x7fcd340b5fe0 0x7fcd340aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd32ffd640 1 -- 172.21.15.19:0/2519645857 >> v1:172.21.15.135:6789/0 conn(0x7fcd3415e410 legacy=0x7fcd340b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:30.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd32ffd640 1 -- 172.21.15.19:0/2519645857 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd340ae800 con 0x7fcd3406bc10 2024-09-12T01:58:30.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd32ffd640 1 -- 172.21.15.19:0/2519645857 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fcd2c0019f0 con 0x7fcd3406bc10 2024-09-12T01:58:30.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd32ffd640 1 -- 172.21.15.19:0/2519645857 >> v1:172.21.15.19:6789/0 conn(0x7fcd3406bc10 legacy=0x7fcd340aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:30.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd32ffd640 1 --2- 172.21.15.19:0/2519645857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd20003b40 0x7fcd20003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:30.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd32ffd640 1 --2- 172.21.15.19:0/2519645857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd20004800 0x7fcd20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:30.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd32ffd640 1 --2- 172.21.15.19:0/2519645857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd200051c0 0x7fcd2000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:30.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd32ffd640 1 -- 172.21.15.19:0/2519645857 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2000c0c0 con 0x7fcd20003b40 2024-09-12T01:58:30.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd32ffd640 1 -- 172.21.15.19:0/2519645857 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2000c270 con 0x7fcd20004800 2024-09-12T01:58:30.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd32ffd640 1 -- 172.21.15.19:0/2519645857 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcd2000c470 con 0x7fcd200051c0 2024-09-12T01:58:30.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd337fe640 1 --2- 172.21.15.19:0/2519645857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd20003b40 0x7fcd20003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:30.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd2affd640 1 --2- 172.21.15.19:0/2519645857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd20004800 0x7fcd20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:30.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd33fff640 1 --2- 172.21.15.19:0/2519645857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd200051c0 0x7fcd2000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:30.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd337fe640 1 -- 172.21.15.19:0/2519645857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd200051c0 msgr2=0x7fcd2000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:30.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd337fe640 1 --2- 172.21.15.19:0/2519645857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd200051c0 0x7fcd2000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd337fe640 1 -- 172.21.15.19:0/2519645857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd20004800 msgr2=0x7fcd20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:30.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd337fe640 1 --2- 172.21.15.19:0/2519645857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd20004800 0x7fcd20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd33fff640 1 -- 172.21.15.19:0/2519645857 reap_dead start 2024-09-12T01:58:30.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.216+0000 7fcd337fe640 1 -- 172.21.15.19:0/2519645857 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd20003520 con 0x7fcd20003b40 2024-09-12T01:58:30.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.217+0000 7fcd337fe640 1 --2- 172.21.15.19:0/2519645857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd20003b40 0x7fcd20003f40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcd240018d0 tx=0x7fcd20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296cffa840558c5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:30.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.217+0000 7fcd32ffd640 1 -- 172.21.15.19:0/2519645857 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd240014f0 con 0x7fcd20003b40 2024-09-12T01:58:30.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.217+0000 7fcd32ffd640 1 -- 172.21.15.19:0/2519645857 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd240052d0 con 0x7fcd20003b40 2024-09-12T01:58:30.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.217+0000 7fcd32ffd640 1 -- 172.21.15.19:0/2519645857 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2402ac60 con 0x7fcd20003b40 2024-09-12T01:58:30.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.218+0000 7fcd39f5b640 1 -- 172.21.15.19:0/2519645857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd20003b40 msgr2=0x7fcd20003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:30.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.218+0000 7fcd39f5b640 1 --2- 172.21.15.19:0/2519645857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd20003b40 0x7fcd20003f40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcd240018d0 tx=0x7fcd20005830 comp rx=0 tx=0).stop 2024-09-12T01:58:30.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.218+0000 7fcd39f5b640 1 -- 172.21.15.19:0/2519645857 shutdown_connections 2024-09-12T01:58:30.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.218+0000 7fcd39f5b640 1 --2- 172.21.15.19:0/2519645857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd20003b40 0x7fcd20003f40 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.218+0000 7fcd39f5b640 1 -- 172.21.15.19:0/2519645857 >> 172.21.15.19:0/2519645857 conn(0x7fcd3409aa30 msgr2=0x7fcd340b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:30.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.218+0000 7fcd39f5b640 1 -- 172.21.15.19:0/2519645857 shutdown_connections 2024-09-12T01:58:30.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.218+0000 7fcd39f5b640 1 -- 172.21.15.19:0/2519645857 wait complete. 2024-09-12T01:58:30.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.219+0000 7fcd39f5b640 1 Processor -- start 2024-09-12T01:58:30.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.219+0000 7fcd39f5b640 1 -- start start 2024-09-12T01:58:30.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.220+0000 7fcd39f5b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd20003b40 0x7fcd34142880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:30.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.220+0000 7fcd39f5b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd34142dc0 0x7fcd340cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:30.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.220+0000 7fcd39f5b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd340cc9e0 0x7fcd3415a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:30.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.220+0000 7fcd39f5b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3415e970 con 0x7fcd340cc9e0 2024-09-12T01:58:30.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.220+0000 7fcd39f5b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3415e7f0 con 0x7fcd34142dc0 2024-09-12T01:58:30.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.220+0000 7fcd39f5b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcd3406c080 con 0x7fcd20003b40 2024-09-12T01:58:30.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.220+0000 7fcd33fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd340cc9e0 0x7fcd3415a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:30.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.220+0000 7fcd33fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd340cc9e0 0x7fcd3415a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50440/0 (socket says 172.21.15.19:50440) 2024-09-12T01:58:30.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.220+0000 7fcd33fff640 1 -- 172.21.15.19:0/133645832 learned_addr learned my addr 172.21.15.19:0/133645832 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:30.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.220+0000 7fcd337fe640 1 --2- 172.21.15.19:0/133645832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd20003b40 0x7fcd34142880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:30.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.220+0000 7fcd2affd640 1 --2- 172.21.15.19:0/133645832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd34142dc0 0x7fcd340cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:30.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.221+0000 7fcd33fff640 1 -- 172.21.15.19:0/133645832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd20003b40 msgr2=0x7fcd34142880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:30.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.221+0000 7fcd33fff640 1 --2- 172.21.15.19:0/133645832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd20003b40 0x7fcd34142880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.221+0000 7fcd33fff640 1 -- 172.21.15.19:0/133645832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd34142dc0 msgr2=0x7fcd340cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:30.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.221+0000 7fcd33fff640 1 --2- 172.21.15.19:0/133645832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd34142dc0 0x7fcd340cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.221+0000 7fcd33fff640 1 -- 172.21.15.19:0/133645832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd340cb6e0 con 0x7fcd340cc9e0 2024-09-12T01:58:30.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.221+0000 7fcd337fe640 1 --2- 172.21.15.19:0/133645832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd20003b40 0x7fcd34142880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:30.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.221+0000 7fcd33fff640 1 --2- 172.21.15.19:0/133645832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd340cc9e0 0x7fcd3415a500 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c000f80 tx=0x7fcd2c007b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:30.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.221+0000 7fcd30ff9640 1 -- 172.21.15.19:0/133645832 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c017020 con 0x7fcd340cc9e0 2024-09-12T01:58:30.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.221+0000 7fcd30ff9640 1 -- 172.21.15.19:0/133645832 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd2c00ab70 con 0x7fcd340cc9e0 2024-09-12T01:58:30.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.221+0000 7fcd39f5b640 1 -- 172.21.15.19:0/133645832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd340cb9c0 con 0x7fcd340cc9e0 2024-09-12T01:58:30.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.221+0000 7fcd30ff9640 1 -- 172.21.15.19:0/133645832 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c0133f0 con 0x7fcd340cc9e0 2024-09-12T01:58:30.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.221+0000 7fcd39f5b640 1 -- 172.21.15.19:0/133645832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd34153110 con 0x7fcd340cc9e0 2024-09-12T01:58:30.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.222+0000 7fcd39f5b640 1 -- 172.21.15.19:0/133645832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd3406c410 con 0x7fcd340cc9e0 2024-09-12T01:58:30.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.222+0000 7fcd30ff9640 1 -- 172.21.15.19:0/133645832 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd2c01a020 con 0x7fcd340cc9e0 2024-09-12T01:58:30.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.223+0000 7fcd30ff9640 1 --2- 172.21.15.19:0/133645832 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd1406be30 0x7fcd1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:30.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.223+0000 7fcd30ff9640 1 -- 172.21.15.19:0/133645832 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5619+0+0 (secure 0 0 0) 0x7fcd2c08b570 con 0x7fcd340cc9e0 2024-09-12T01:58:30.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.223+0000 7fcd337fe640 1 --2- 172.21.15.19:0/133645832 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd1406be30 0x7fcd1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:30.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.224+0000 7fcd337fe640 1 --2- 172.21.15.19:0/133645832 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd1406be30 0x7fcd1406e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcd24032000 tx=0x7fcd24009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:30.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.227+0000 7fcd30ff9640 1 -- 172.21.15.19:0/133645832 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcd2c021020 con 0x7fcd340cc9e0 2024-09-12T01:58:30.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:30.406+0000 7fcd39f5b640 1 -- 172.21.15.19:0/133645832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcd34161750 con 0x7fcd340cc9e0 2024-09-12T01:58:31.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.063+0000 7fcd30ff9640 1 -- 172.21.15.19:0/133645832 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v64) ==== 170+0+0 (secure 0 0 0) 0x7fcd2c05a000 con 0x7fcd340cc9e0 2024-09-12T01:58:31.064 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-09-12T01:58:31.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.067+0000 7fcd39f5b640 1 -- 172.21.15.19:0/133645832 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd1406be30 msgr2=0x7fcd1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:31.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.067+0000 7fcd39f5b640 1 --2- 172.21.15.19:0/133645832 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd1406be30 0x7fcd1406e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcd24032000 tx=0x7fcd24009030 comp rx=0 tx=0).stop 2024-09-12T01:58:31.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.067+0000 7fcd39f5b640 1 -- 172.21.15.19:0/133645832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd340cc9e0 msgr2=0x7fcd3415a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:31.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.067+0000 7fcd39f5b640 1 --2- 172.21.15.19:0/133645832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd340cc9e0 0x7fcd3415a500 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c000f80 tx=0x7fcd2c007b60 comp rx=0 tx=0).stop 2024-09-12T01:58:31.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.067+0000 7fcd39f5b640 1 -- 172.21.15.19:0/133645832 shutdown_connections 2024-09-12T01:58:31.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.067+0000 7fcd39f5b640 1 --2- 172.21.15.19:0/133645832 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd1406be30 0x7fcd1406e2f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:31.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.067+0000 7fcd39f5b640 1 --2- 172.21.15.19:0/133645832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd340cc9e0 0x7fcd3415a500 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:31.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.067+0000 7fcd39f5b640 1 --2- 172.21.15.19:0/133645832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd34142dc0 0x7fcd340cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:31.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.067+0000 7fcd39f5b640 1 --2- 172.21.15.19:0/133645832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd20003b40 0x7fcd34142880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:31.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.067+0000 7fcd39f5b640 1 -- 172.21.15.19:0/133645832 >> 172.21.15.19:0/133645832 conn(0x7fcd3409aa30 msgr2=0x7fcd341607a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:31.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.067+0000 7fcd39f5b640 1 -- 172.21.15.19:0/133645832 shutdown_connections 2024-09-12T01:58:31.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.067+0000 7fcd39f5b640 1 -- 172.21.15.19:0/133645832 wait complete. 2024-09-12T01:58:31.092 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:58:31.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.202+0000 7f6523830640 1 Processor -- start 2024-09-12T01:58:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.203+0000 7f6523830640 1 -- start start 2024-09-12T01:58:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.203+0000 7f6523830640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f651c15b570 0x7f651c071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.203+0000 7f6523830640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f651c15b950 0x7f651c0cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.203+0000 7f6523830640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f651c073b20 con 0x7f651c0ccf50 2024-09-12T01:58:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.203+0000 7f6523830640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f651c0740e0 con 0x7f651c15b950 2024-09-12T01:58:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.203+0000 7f6523830640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f651c073e00 con 0x7f651c15b570 2024-09-12T01:58:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.204+0000 7f6520dcb640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f651c15b950 0x7f651c0cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.204+0000 7f6520dcb640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f651c15b950 0x7f651c0cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:37166/0 (socket says 172.21.15.19:37166) 2024-09-12T01:58:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.204+0000 7f65215cc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f651c15b570 0x7f651c071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.204+0000 7f6520dcb640 1 -- 172.21.15.19:0/3244909113 learned_addr learned my addr 172.21.15.19:0/3244909113 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.204+0000 7f6521dcd640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f651c0ccf50 0x7f651c0cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:48324/0 (socket says 172.21.15.19:48324) 2024-09-12T01:58:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.204+0000 7f6520dcb640 1 -- 172.21.15.19:0/3244909113 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f651c15b570 msgr2=0x7f651c071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:31.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.204+0000 7f6520dcb640 1 --2- 172.21.15.19:0/3244909113 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f651c15b570 0x7f651c071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:31.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.204+0000 7f6520dcb640 1 -- 172.21.15.19:0/3244909113 >> v1:172.21.15.135:6789/0 conn(0x7f651c0ccf50 legacy=0x7f651c0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:31.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.204+0000 7f6520dcb640 1 -- 172.21.15.19:0/3244909113 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f651c0cf320 con 0x7f651c15b950 2024-09-12T01:58:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.205+0000 7f6520dcb640 1 --2- 172.21.15.19:0/3244909113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f651c15b950 0x7f651c0cca10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f650c00bb00 tx=0x7f650c02c650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee3a96a9580c0fff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.205+0000 7f6513fff640 1 -- 172.21.15.19:0/3244909113 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650c03a070 con 0x7f651c15b950 2024-09-12T01:58:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.205+0000 7f6513fff640 1 -- 172.21.15.19:0/3244909113 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f650c032480 con 0x7f651c15b950 2024-09-12T01:58:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.205+0000 7f6513fff640 1 -- 172.21.15.19:0/3244909113 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650c032850 con 0x7f651c15b950 2024-09-12T01:58:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.206+0000 7f6523830640 1 -- 172.21.15.19:0/3244909113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f651c15b950 msgr2=0x7f651c0cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.206+0000 7f6523830640 1 --2- 172.21.15.19:0/3244909113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f651c15b950 0x7f651c0cca10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f650c00bb00 tx=0x7f650c02c650 comp rx=0 tx=0).stop 2024-09-12T01:58:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.206+0000 7f6523830640 1 -- 172.21.15.19:0/3244909113 shutdown_connections 2024-09-12T01:58:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.206+0000 7f6523830640 1 --2- 172.21.15.19:0/3244909113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f651c15b950 0x7f651c0cca10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.206+0000 7f6523830640 1 --2- 172.21.15.19:0/3244909113 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f651c15b570 0x7f651c071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:31.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.206+0000 7f6523830640 1 -- 172.21.15.19:0/3244909113 >> 172.21.15.19:0/3244909113 conn(0x7f651c06bdf0 msgr2=0x7f651c06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:31.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.206+0000 7f6523830640 1 -- 172.21.15.19:0/3244909113 shutdown_connections 2024-09-12T01:58:31.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.206+0000 7f6523830640 1 -- 172.21.15.19:0/3244909113 wait complete. 2024-09-12T01:58:31.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.207+0000 7f6523830640 1 Processor -- start 2024-09-12T01:58:31.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.207+0000 7f6523830640 1 -- start start 2024-09-12T01:58:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.208+0000 7f6523830640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f651c0ccf50 0x7f651c1f39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.208+0000 7f6523830640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f651c15b570 0x7f651c0cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.208+0000 7f6523830640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f651c15b950 0x7f651c157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.208+0000 7f6523830640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f651c0cf840 con 0x7f651c0ccf50 2024-09-12T01:58:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.208+0000 7f6523830640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f651c072450 con 0x7f651c15b950 2024-09-12T01:58:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.208+0000 7f6523830640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f651c0cf9c0 con 0x7f651c15b570 2024-09-12T01:58:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.208+0000 7f65215cc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f651c0ccf50 0x7f651c1f39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.208+0000 7f65215cc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f651c0ccf50 0x7f651c1f39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35750/0 (socket says 172.21.15.19:35750) 2024-09-12T01:58:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.208+0000 7f65215cc640 1 -- 172.21.15.19:0/571040097 learned_addr learned my addr 172.21.15.19:0/571040097 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.208+0000 7f6520dcb640 1 --2- 172.21.15.19:0/571040097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f651c15b570 0x7f651c0cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.208+0000 7f6521dcd640 1 --2- 172.21.15.19:0/571040097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f651c15b950 0x7f651c157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.208+0000 7f65215cc640 1 -- 172.21.15.19:0/571040097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f651c15b570 msgr2=0x7f651c0cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.208+0000 7f65215cc640 1 --2- 172.21.15.19:0/571040097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f651c15b570 0x7f651c0cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.208+0000 7f65215cc640 1 -- 172.21.15.19:0/571040097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f651c15b950 msgr2=0x7f651c157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.208+0000 7f65215cc640 1 --2- 172.21.15.19:0/571040097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f651c15b950 0x7f651c157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.208+0000 7f65215cc640 1 -- 172.21.15.19:0/571040097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f651c0cb780 con 0x7f651c0ccf50 2024-09-12T01:58:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.209+0000 7f65215cc640 1 --2- 172.21.15.19:0/571040097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f651c0ccf50 0x7f651c1f39e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f651800e9b0 tx=0x7f651800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.209+0000 7f6511ffb640 1 -- 172.21.15.19:0/571040097 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518017070 con 0x7f651c0ccf50 2024-09-12T01:58:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.209+0000 7f6523830640 1 -- 172.21.15.19:0/571040097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f651c0c95d0 con 0x7f651c0ccf50 2024-09-12T01:58:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.209+0000 7f6511ffb640 1 -- 172.21.15.19:0/571040097 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651800c9a0 con 0x7f651c0ccf50 2024-09-12T01:58:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.209+0000 7f6511ffb640 1 -- 172.21.15.19:0/571040097 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651800cd90 con 0x7f651c0ccf50 2024-09-12T01:58:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.209+0000 7f6523830640 1 -- 172.21.15.19:0/571040097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f651c0c9b90 con 0x7f651c0ccf50 2024-09-12T01:58:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.210+0000 7f6523830640 1 -- 172.21.15.19:0/571040097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f651c0c93c0 con 0x7f651c0ccf50 2024-09-12T01:58:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.211+0000 7f6511ffb640 1 -- 172.21.15.19:0/571040097 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f651801a070 con 0x7f651c0ccf50 2024-09-12T01:58:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.211+0000 7f6511ffb640 1 --2- 172.21.15.19:0/571040097 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f650006be30 0x7f650006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.211+0000 7f6511ffb640 1 -- 172.21.15.19:0/571040097 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6001+0+0 (secure 0 0 0) 0x7f651808b350 con 0x7f651c0ccf50 2024-09-12T01:58:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.211+0000 7f6520dcb640 1 --2- 172.21.15.19:0/571040097 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f650006be30 0x7f650006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.212+0000 7f6520dcb640 1 --2- 172.21.15.19:0/571040097 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f650006be30 0x7f650006e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f650c037000 tx=0x7f650c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:31.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.216+0000 7f6511ffb640 1 -- 172.21.15.19:0/571040097 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6518059500 con 0x7f651c0ccf50 2024-09-12T01:58:31.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:31.429+0000 7f6523830640 1 -- 172.21.15.19:0/571040097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f651c0afdc0 con 0x7f651c0ccf50 2024-09-12T01:58:32.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.065+0000 7f6511ffb640 1 -- 172.21.15.19:0/571040097 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v39) ==== 173+0+0 (secure 0 0 0) 0x7f651805d800 con 0x7f651c0ccf50 2024-09-12T01:58:32.066 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 9 and data pool 10 2024-09-12T01:58:32.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.069+0000 7f6523830640 1 -- 172.21.15.19:0/571040097 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f650006be30 msgr2=0x7f650006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.069+0000 7f6523830640 1 --2- 172.21.15.19:0/571040097 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f650006be30 0x7f650006e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f650c037000 tx=0x7f650c030000 comp rx=0 tx=0).stop 2024-09-12T01:58:32.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.069+0000 7f6523830640 1 -- 172.21.15.19:0/571040097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f651c0ccf50 msgr2=0x7f651c1f39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.069+0000 7f6523830640 1 --2- 172.21.15.19:0/571040097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f651c0ccf50 0x7f651c1f39e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f651800e9b0 tx=0x7f651800ee70 comp rx=0 tx=0).stop 2024-09-12T01:58:32.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.070+0000 7f6523830640 1 -- 172.21.15.19:0/571040097 shutdown_connections 2024-09-12T01:58:32.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.070+0000 7f6523830640 1 --2- 172.21.15.19:0/571040097 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f650006be30 0x7f650006e2f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.070+0000 7f6523830640 1 --2- 172.21.15.19:0/571040097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f651c15b950 0x7f651c157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.070+0000 7f6523830640 1 --2- 172.21.15.19:0/571040097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f651c15b570 0x7f651c0cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.070+0000 7f6523830640 1 --2- 172.21.15.19:0/571040097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f651c0ccf50 0x7f651c1f39e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.070+0000 7f6523830640 1 -- 172.21.15.19:0/571040097 >> 172.21.15.19:0/571040097 conn(0x7f651c06bdf0 msgr2=0x7f651c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:32.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.071+0000 7f6523830640 1 -- 172.21.15.19:0/571040097 shutdown_connections 2024-09-12T01:58:32.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.071+0000 7f6523830640 1 -- 172.21.15.19:0/571040097 wait complete. 2024-09-12T01:58:32.104 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:58:32.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.211+0000 7fa3ab3e4640 1 Processor -- start 2024-09-12T01:58:32.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.211+0000 7fa3ab3e4640 1 -- start start 2024-09-12T01:58:32.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.212+0000 7fa3ab3e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3a415e740 0x7fa3a40d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.212+0000 7fa3ab3e4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa3a406dbd0 0x7fa3a406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.212+0000 7fa3ab3e4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3a406e040 con 0x7fa3a409b690 2024-09-12T01:58:32.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.212+0000 7fa3ab3e4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa3a415eb20 con 0x7fa3a406dbd0 2024-09-12T01:58:32.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.212+0000 7fa3ab3e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a406d260 con 0x7fa3a415e740 2024-09-12T01:58:32.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.212+0000 7fa3a9981640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa3a406dbd0 0x7fa3a406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.212+0000 7fa3a9981640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa3a406dbd0 0x7fa3a406cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35760/0 (socket says 172.21.15.19:35760) 2024-09-12T01:58:32.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.212+0000 7fa3a9981640 1 -- 172.21.15.19:0/1393583089 learned_addr learned my addr 172.21.15.19:0/1393583089 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:32.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.212+0000 7fa3a9180640 1 --2- 172.21.15.19:0/1393583089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3a415e740 0x7fa3a40d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.212+0000 7fa3a9981640 1 -- 172.21.15.19:0/1393583089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3a415e740 msgr2=0x7fa3a40d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:32.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.212+0000 7fa3a9981640 1 --2- 172.21.15.19:0/1393583089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3a415e740 0x7fa3a40d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.212+0000 7fa3a9981640 1 -- 172.21.15.19:0/1393583089 >> v1:172.21.15.135:6789/0 conn(0x7fa3a409b690 legacy=0x7fa3a406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.212+0000 7fa3a9981640 1 -- 172.21.15.19:0/1393583089 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a40d0780 con 0x7fa3a406dbd0 2024-09-12T01:58:32.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.213+0000 7fa3a9981640 1 --2- 172.21.15.19:0/1393583089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a406dbd0 0x7fa3a406cd20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009e80 tx=0x7fa39c02a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642eaae4d6f2028e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:32.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.213+0000 7fa39bfff640 1 -- 172.21.15.19:0/1393583089 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c036070 con 0x7fa3a406dbd0 2024-09-12T01:58:32.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.213+0000 7fa39bfff640 1 -- 172.21.15.19:0/1393583089 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39c031600 con 0x7fa3a406dbd0 2024-09-12T01:58:32.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.213+0000 7fa39bfff640 1 -- 172.21.15.19:0/1393583089 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0319d0 con 0x7fa3a406dbd0 2024-09-12T01:58:32.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.214+0000 7fa3ab3e4640 1 -- 172.21.15.19:0/1393583089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a406dbd0 msgr2=0x7fa3a406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.214+0000 7fa3ab3e4640 1 --2- 172.21.15.19:0/1393583089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a406dbd0 0x7fa3a406cd20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009e80 tx=0x7fa39c02a7e0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.214+0000 7fa3ab3e4640 1 -- 172.21.15.19:0/1393583089 shutdown_connections 2024-09-12T01:58:32.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.214+0000 7fa3ab3e4640 1 --2- 172.21.15.19:0/1393583089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a406dbd0 0x7fa3a406cd20 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.214+0000 7fa3ab3e4640 1 --2- 172.21.15.19:0/1393583089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3a415e740 0x7fa3a40d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.214+0000 7fa3ab3e4640 1 -- 172.21.15.19:0/1393583089 >> 172.21.15.19:0/1393583089 conn(0x7fa3a40d23a0 msgr2=0x7fa3a40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:32.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.214+0000 7fa3ab3e4640 1 -- 172.21.15.19:0/1393583089 shutdown_connections 2024-09-12T01:58:32.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.214+0000 7fa3ab3e4640 1 -- 172.21.15.19:0/1393583089 wait complete. 2024-09-12T01:58:32.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.215+0000 7fa3ab3e4640 1 Processor -- start 2024-09-12T01:58:32.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.215+0000 7fa3ab3e4640 1 -- start start 2024-09-12T01:58:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.216+0000 7fa3ab3e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3a406dbd0 0x7fa3a40b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.216+0000 7fa3ab3e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a409b690 0x7fa3a40c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.216+0000 7fa3ab3e4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a415e740 0x7fa3a415b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.216+0000 7fa3ab3e4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a40d1020 con 0x7fa3a409b690 2024-09-12T01:58:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.216+0000 7fa3ab3e4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a40d0d40 con 0x7fa3a415e740 2024-09-12T01:58:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.216+0000 7fa3ab3e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a409ba90 con 0x7fa3a406dbd0 2024-09-12T01:58:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.216+0000 7fa3a897f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a409b690 0x7fa3a40c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.216+0000 7fa3a897f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a409b690 0x7fa3a40c78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35774/0 (socket says 172.21.15.19:35774) 2024-09-12T01:58:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.216+0000 7fa3a897f640 1 -- 172.21.15.19:0/3511811870 learned_addr learned my addr 172.21.15.19:0/3511811870 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.216+0000 7fa3a9981640 1 --2- 172.21.15.19:0/3511811870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a415e740 0x7fa3a415b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.216+0000 7fa3a9180640 1 --2- 172.21.15.19:0/3511811870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3a406dbd0 0x7fa3a40b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.216+0000 7fa3a897f640 1 -- 172.21.15.19:0/3511811870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3a406dbd0 msgr2=0x7fa3a40b79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.216+0000 7fa3a897f640 1 --2- 172.21.15.19:0/3511811870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3a406dbd0 0x7fa3a40b79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.216+0000 7fa3a897f640 1 -- 172.21.15.19:0/3511811870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a415e740 msgr2=0x7fa3a415b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.216+0000 7fa3a897f640 1 --2- 172.21.15.19:0/3511811870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a415e740 0x7fa3a415b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.216+0000 7fa3a897f640 1 -- 172.21.15.19:0/3511811870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a40c7f80 con 0x7fa3a409b690 2024-09-12T01:58:32.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.217+0000 7fa3a897f640 1 --2- 172.21.15.19:0/3511811870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a409b690 0x7fa3a40c78f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa39400c440 tx=0x7fa39400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:32.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.217+0000 7fa399ffb640 1 -- 172.21.15.19:0/3511811870 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3940052d0 con 0x7fa3a409b690 2024-09-12T01:58:32.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.217+0000 7fa399ffb640 1 -- 172.21.15.19:0/3511811870 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa394005470 con 0x7fa3a409b690 2024-09-12T01:58:32.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.217+0000 7fa3ab3e4640 1 -- 172.21.15.19:0/3511811870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a40b5320 con 0x7fa3a409b690 2024-09-12T01:58:32.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.217+0000 7fa399ffb640 1 -- 172.21.15.19:0/3511811870 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa394007260 con 0x7fa3a409b690 2024-09-12T01:58:32.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.217+0000 7fa3ab3e4640 1 -- 172.21.15.19:0/3511811870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a40b02c0 con 0x7fa3a409b690 2024-09-12T01:58:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.218+0000 7fa3ab3e4640 1 -- 172.21.15.19:0/3511811870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a406cd20 con 0x7fa3a409b690 2024-09-12T01:58:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.218+0000 7fa399ffb640 1 -- 172.21.15.19:0/3511811870 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa3940074c0 con 0x7fa3a409b690 2024-09-12T01:58:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.219+0000 7fa399ffb640 1 --2- 172.21.15.19:0/3511811870 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa38806be30 0x7fa38806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.219+0000 7fa399ffb640 1 -- 172.21.15.19:0/3511811870 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6101+0+0 (secure 0 0 0) 0x7fa39408a370 con 0x7fa3a409b690 2024-09-12T01:58:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.219+0000 7fa3a9180640 1 --2- 172.21.15.19:0/3511811870 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa38806be30 0x7fa38806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.219+0000 7fa3a9180640 1 --2- 172.21.15.19:0/3511811870 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa38806be30 0x7fa38806e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0009b40 tx=0x7fa3a0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:32.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.223+0000 7fa399ffb640 1 -- 172.21.15.19:0/3511811870 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa394058540 con 0x7fa3a409b690 2024-09-12T01:58:32.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.398+0000 7fa3ab3e4640 1 -- 172.21.15.19:0/3511811870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3a40d1cb0 con 0x7fa3a409b690 2024-09-12T01:58:32.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.399+0000 7fa399ffb640 1 -- 172.21.15.19:0/3511811870 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+16945 (secure 0 0 0) 0x7fa39405c840 con 0x7fa3a409b690 2024-09-12T01:58:32.400 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:32.400 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":65,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:58:31.430984+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:58:29.092441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-12T01:58:30.437695+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:58:32.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.401+0000 7fa3ab3e4640 1 -- 172.21.15.19:0/3511811870 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa38806be30 msgr2=0x7fa38806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.401+0000 7fa3ab3e4640 1 --2- 172.21.15.19:0/3511811870 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa38806be30 0x7fa38806e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0009b40 tx=0x7fa3a0009190 comp rx=0 tx=0).stop 2024-09-12T01:58:32.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.401+0000 7fa3ab3e4640 1 -- 172.21.15.19:0/3511811870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a409b690 msgr2=0x7fa3a40c78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.401+0000 7fa3ab3e4640 1 --2- 172.21.15.19:0/3511811870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a409b690 0x7fa3a40c78f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa39400c440 tx=0x7fa39400c900 comp rx=0 tx=0).stop 2024-09-12T01:58:32.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.401+0000 7fa3ab3e4640 1 -- 172.21.15.19:0/3511811870 shutdown_connections 2024-09-12T01:58:32.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.401+0000 7fa3ab3e4640 1 --2- 172.21.15.19:0/3511811870 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa38806be30 0x7fa38806e2f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.401+0000 7fa3ab3e4640 1 --2- 172.21.15.19:0/3511811870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a415e740 0x7fa3a415b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.401+0000 7fa3ab3e4640 1 --2- 172.21.15.19:0/3511811870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a409b690 0x7fa3a40c78f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.401+0000 7fa3ab3e4640 1 --2- 172.21.15.19:0/3511811870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3a406dbd0 0x7fa3a40b79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.401+0000 7fa3ab3e4640 1 -- 172.21.15.19:0/3511811870 >> 172.21.15.19:0/3511811870 conn(0x7fa3a40d23a0 msgr2=0x7fa3a41e7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:32.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.402+0000 7fa3ab3e4640 1 -- 172.21.15.19:0/3511811870 shutdown_connections 2024-09-12T01:58:32.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.402+0000 7fa3ab3e4640 1 -- 172.21.15.19:0/3511811870 wait complete. 2024-09-12T01:58:32.413 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:58:32.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.515+0000 7f8642152640 1 Processor -- start 2024-09-12T01:58:32.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.515+0000 7f8642152640 1 -- start start 2024-09-12T01:58:32.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.516+0000 7f8642152640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f863c072de0 0x7f863c15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.516+0000 7f8642152640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f863c072700 0x7f863c15d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.516+0000 7f8642152640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f863c146140 con 0x7f863c072320 2024-09-12T01:58:32.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.516+0000 7f8642152640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f863c0cd740 con 0x7f863c072de0 2024-09-12T01:58:32.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.516+0000 7f8642152640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f863c0cda20 con 0x7f863c072700 2024-09-12T01:58:32.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.516+0000 7f863affd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f863c072de0 0x7f863c15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.516+0000 7f863affd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f863c072de0 0x7f863c15d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35776/0 (socket says 172.21.15.19:35776) 2024-09-12T01:58:32.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.516+0000 7f863affd640 1 -- 172.21.15.19:0/1703778225 learned_addr learned my addr 172.21.15.19:0/1703778225 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:32.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.517+0000 7f863bfff640 1 --2- 172.21.15.19:0/1703778225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f863c072700 0x7f863c15d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.517+0000 7f863affd640 1 -- 172.21.15.19:0/1703778225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f863c072700 msgr2=0x7f863c15d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:32.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.517+0000 7f863affd640 1 --2- 172.21.15.19:0/1703778225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f863c072700 0x7f863c15d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.517+0000 7f863affd640 1 -- 172.21.15.19:0/1703778225 >> v1:172.21.15.135:6789/0 conn(0x7f863c072320 legacy=0x7f863c0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:32.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.517+0000 7f863affd640 1 -- 172.21.15.19:0/1703778225 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863c0cdd00 con 0x7f863c072de0 2024-09-12T01:58:32.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.517+0000 7f863bfff640 1 --2- 172.21.15.19:0/1703778225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f863c072700 0x7f863c15d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:32.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.517+0000 7f863affd640 1 --2- 172.21.15.19:0/1703778225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f863c072de0 0x7f863c15d1e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8630009870 tx=0x7f863002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb030312997a0dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:32.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.518+0000 7f863a7fc640 1 -- 172.21.15.19:0/1703778225 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8630037070 con 0x7f863c072de0 2024-09-12T01:58:32.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.518+0000 7f863a7fc640 1 -- 172.21.15.19:0/1703778225 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8630032440 con 0x7f863c072de0 2024-09-12T01:58:32.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.518+0000 7f863a7fc640 1 -- 172.21.15.19:0/1703778225 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8630032810 con 0x7f863c072de0 2024-09-12T01:58:32.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.518+0000 7f8642152640 1 -- 172.21.15.19:0/1703778225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f863c072de0 msgr2=0x7f863c15d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.518+0000 7f8642152640 1 --2- 172.21.15.19:0/1703778225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f863c072de0 0x7f863c15d1e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8630009870 tx=0x7f863002a180 comp rx=0 tx=0).stop 2024-09-12T01:58:32.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.518+0000 7f8642152640 1 -- 172.21.15.19:0/1703778225 shutdown_connections 2024-09-12T01:58:32.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.518+0000 7f8642152640 1 --2- 172.21.15.19:0/1703778225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f863c072700 0x7f863c15d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.518+0000 7f8642152640 1 --2- 172.21.15.19:0/1703778225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f863c072de0 0x7f863c15d1e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.518+0000 7f8642152640 1 -- 172.21.15.19:0/1703778225 >> 172.21.15.19:0/1703778225 conn(0x7f863c067d70 msgr2=0x7f863c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:32.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.518+0000 7f8642152640 1 -- 172.21.15.19:0/1703778225 shutdown_connections 2024-09-12T01:58:32.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.518+0000 7f8642152640 1 -- 172.21.15.19:0/1703778225 wait complete. 2024-09-12T01:58:32.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.519+0000 7f8642152640 1 Processor -- start 2024-09-12T01:58:32.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.520+0000 7f8642152640 1 -- start start 2024-09-12T01:58:32.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.520+0000 7f8642152640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f863c072320 0x7f863c15bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.520+0000 7f8642152640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f863c072700 0x7f863c1e72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.520+0000 7f8642152640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f863c072de0 0x7f863c1e7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.520+0000 7f8642152640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f863c15dde0 con 0x7f863c072de0 2024-09-12T01:58:32.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.520+0000 7f8642152640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f863c15dc60 con 0x7f863c072700 2024-09-12T01:58:32.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.520+0000 7f8642152640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f863c15df60 con 0x7f863c072320 2024-09-12T01:58:32.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.520+0000 7f863bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f863c072de0 0x7f863c1e7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.521+0000 7f863bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f863c072de0 0x7f863c1e7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35790/0 (socket says 172.21.15.19:35790) 2024-09-12T01:58:32.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.521+0000 7f863bfff640 1 -- 172.21.15.19:0/678448030 learned_addr learned my addr 172.21.15.19:0/678448030 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:32.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.521+0000 7f863b7fe640 1 --2- 172.21.15.19:0/678448030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f863c072320 0x7f863c15bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.521+0000 7f863affd640 1 --2- 172.21.15.19:0/678448030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f863c072700 0x7f863c1e72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.521+0000 7f863bfff640 1 -- 172.21.15.19:0/678448030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f863c072320 msgr2=0x7f863c15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.521+0000 7f863bfff640 1 --2- 172.21.15.19:0/678448030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f863c072320 0x7f863c15bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.521+0000 7f863bfff640 1 -- 172.21.15.19:0/678448030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f863c072700 msgr2=0x7f863c1e72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.521+0000 7f863bfff640 1 --2- 172.21.15.19:0/678448030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f863c072700 0x7f863c1e72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.521+0000 7f863bfff640 1 -- 172.21.15.19:0/678448030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863c1f6140 con 0x7f863c072de0 2024-09-12T01:58:32.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.521+0000 7f863bfff640 1 --2- 172.21.15.19:0/678448030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f863c072de0 0x7f863c1e7800 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f863400ced0 tx=0x7f863400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:32.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.521+0000 7f8623fff640 1 -- 172.21.15.19:0/678448030 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8634003b90 con 0x7f863c072de0 2024-09-12T01:58:32.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.521+0000 7f8623fff640 1 -- 172.21.15.19:0/678448030 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8634003d50 con 0x7f863c072de0 2024-09-12T01:58:32.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.521+0000 7f8642152640 1 -- 172.21.15.19:0/678448030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f863c132070 con 0x7f863c072de0 2024-09-12T01:58:32.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.521+0000 7f8623fff640 1 -- 172.21.15.19:0/678448030 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8634004260 con 0x7f863c072de0 2024-09-12T01:58:32.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.521+0000 7f8642152640 1 -- 172.21.15.19:0/678448030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f863c132630 con 0x7f863c072de0 2024-09-12T01:58:32.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.522+0000 7f8642152640 1 -- 172.21.15.19:0/678448030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f863c131e70 con 0x7f863c072de0 2024-09-12T01:58:32.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.523+0000 7f8623fff640 1 -- 172.21.15.19:0/678448030 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8634004400 con 0x7f863c072de0 2024-09-12T01:58:32.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.523+0000 7f8623fff640 1 --2- 172.21.15.19:0/678448030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f862806be60 0x7f862806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.523+0000 7f8623fff640 1 -- 172.21.15.19:0/678448030 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6101+0+0 (secure 0 0 0) 0x7f863408b840 con 0x7f863c072de0 2024-09-12T01:58:32.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.523+0000 7f863b7fe640 1 --2- 172.21.15.19:0/678448030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f862806be60 0x7f862806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.524+0000 7f863b7fe640 1 --2- 172.21.15.19:0/678448030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f862806be60 0x7f862806e320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f862c004f60 tx=0x7f862c007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:32.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.528+0000 7f8623fff640 1 -- 172.21.15.19:0/678448030 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8634059b60 con 0x7f863c072de0 2024-09-12T01:58:32.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.711+0000 7f8642152640 1 -- 172.21.15.19:0/678448030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f863c15e370 con 0x7f863c072de0 2024-09-12T01:58:32.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.712+0000 7f8623fff640 1 -- 172.21.15.19:0/678448030 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+16945 (secure 0 0 0) 0x7f863405de60 con 0x7f863c072de0 2024-09-12T01:58:32.712 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:32.713 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":65,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:58:31.430984+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:58:29.092441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-12T01:58:30.437695+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:58:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.714+0000 7f8642152640 1 -- 172.21.15.19:0/678448030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f862806be60 msgr2=0x7f862806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.714+0000 7f8642152640 1 --2- 172.21.15.19:0/678448030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f862806be60 0x7f862806e320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f862c004f60 tx=0x7f862c007e30 comp rx=0 tx=0).stop 2024-09-12T01:58:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.714+0000 7f8642152640 1 -- 172.21.15.19:0/678448030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f863c072de0 msgr2=0x7f863c1e7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.714+0000 7f8642152640 1 --2- 172.21.15.19:0/678448030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f863c072de0 0x7f863c1e7800 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f863400ced0 tx=0x7f863400a710 comp rx=0 tx=0).stop 2024-09-12T01:58:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.714+0000 7f8642152640 1 -- 172.21.15.19:0/678448030 shutdown_connections 2024-09-12T01:58:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.714+0000 7f8642152640 1 --2- 172.21.15.19:0/678448030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f862806be60 0x7f862806e320 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.714+0000 7f8642152640 1 --2- 172.21.15.19:0/678448030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f863c072de0 0x7f863c1e7800 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.714+0000 7f8642152640 1 --2- 172.21.15.19:0/678448030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f863c072700 0x7f863c1e72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.714+0000 7f8642152640 1 --2- 172.21.15.19:0/678448030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f863c072320 0x7f863c15bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.714+0000 7f8642152640 1 -- 172.21.15.19:0/678448030 >> 172.21.15.19:0/678448030 conn(0x7f863c067d70 msgr2=0x7f863c06e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.714+0000 7f8642152640 1 -- 172.21.15.19:0/678448030 shutdown_connections 2024-09-12T01:58:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.714+0000 7f8642152640 1 -- 172.21.15.19:0/678448030 wait complete. 2024-09-12T01:58:32.726 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:58:32.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.830+0000 7fdde001e640 1 Processor -- start 2024-09-12T01:58:32.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.830+0000 7fdde001e640 1 -- start start 2024-09-12T01:58:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.831+0000 7fdde001e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fddd8162e30 0x7fddd806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.831+0000 7fdde001e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddd80cf280 0x7fddd80d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.831+0000 7fdde001e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd815ff70 con 0x7fddd8162340 2024-09-12T01:58:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.831+0000 7fdde001e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fddd806de90 con 0x7fddd8162e30 2024-09-12T01:58:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.831+0000 7fdde001e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fddd8163270 con 0x7fddd80cf280 2024-09-12T01:58:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.831+0000 7fdddd5b9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fddd8162e30 0x7fddd806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.831+0000 7fdddddba640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fddd8162340 0x7fddd8162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38332/0 (socket says 172.21.15.19:38332) 2024-09-12T01:58:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.831+0000 7fdddd5b9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fddd8162e30 0x7fddd806d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35796/0 (socket says 172.21.15.19:35796) 2024-09-12T01:58:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.831+0000 7fdddd5b9640 1 -- 172.21.15.19:0/4287977500 learned_addr learned my addr 172.21.15.19:0/4287977500 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.831+0000 7fddde5bb640 1 --2- 172.21.15.19:0/4287977500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddd80cf280 0x7fddd80d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.831+0000 7fdddd5b9640 1 -- 172.21.15.19:0/4287977500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddd80cf280 msgr2=0x7fddd80d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.831+0000 7fdddd5b9640 1 --2- 172.21.15.19:0/4287977500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddd80cf280 0x7fddd80d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.832+0000 7fdddd5b9640 1 -- 172.21.15.19:0/4287977500 >> v1:172.21.15.19:6789/0 conn(0x7fddd8162340 legacy=0x7fddd8162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.832+0000 7fdddcdb8640 1 -- 172.21.15.19:0/4287977500 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3360019729 0 0) 0x7fddd815ff70 con 0x7fddd8162340 2024-09-12T01:58:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.832+0000 7fdddd5b9640 1 -- 172.21.15.19:0/4287977500 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd80d4d10 con 0x7fddd8162e30 2024-09-12T01:58:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.832+0000 7fddde5bb640 1 --2- 172.21.15.19:0/4287977500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddd80cf280 0x7fddd80d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:32.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.832+0000 7fdddd5b9640 1 --2- 172.21.15.19:0/4287977500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd8162e30 0x7fddd806d740 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009850 tx=0x7fddc802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c497c76afeeec013 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:32.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.832+0000 7fdddcdb8640 1 -- 172.21.15.19:0/4287977500 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8004030 con 0x7fddd8162e30 2024-09-12T01:58:32.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.832+0000 7fdddcdb8640 1 -- 172.21.15.19:0/4287977500 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc80041d0 con 0x7fddd8162e30 2024-09-12T01:58:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.832+0000 7fdddcdb8640 1 -- 172.21.15.19:0/4287977500 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8003610 con 0x7fddd8162e30 2024-09-12T01:58:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.833+0000 7fdde001e640 1 -- 172.21.15.19:0/4287977500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd8162e30 msgr2=0x7fddd806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.833+0000 7fdde001e640 1 --2- 172.21.15.19:0/4287977500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd8162e30 0x7fddd806d740 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009850 tx=0x7fddc802a1a0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.833+0000 7fdde001e640 1 -- 172.21.15.19:0/4287977500 shutdown_connections 2024-09-12T01:58:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.833+0000 7fdde001e640 1 --2- 172.21.15.19:0/4287977500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddd80cf280 0x7fddd80d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.833+0000 7fdde001e640 1 --2- 172.21.15.19:0/4287977500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd8162e30 0x7fddd806d740 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.833+0000 7fdde001e640 1 -- 172.21.15.19:0/4287977500 >> 172.21.15.19:0/4287977500 conn(0x7fddd808bfc0 msgr2=0x7fddd80d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.833+0000 7fdde001e640 1 -- 172.21.15.19:0/4287977500 shutdown_connections 2024-09-12T01:58:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.833+0000 7fdde001e640 1 -- 172.21.15.19:0/4287977500 wait complete. 2024-09-12T01:58:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.834+0000 7fdde001e640 1 Processor -- start 2024-09-12T01:58:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.834+0000 7fdde001e640 1 -- start start 2024-09-12T01:58:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.835+0000 7fdde001e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddd80cf280 0x7fddd80b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.835+0000 7fdde001e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddd8162340 0x7fddd815c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.835+0000 7fdde001e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd8162e30 0x7fddd80cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.835+0000 7fdde001e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fddd80cf710 con 0x7fddd8162e30 2024-09-12T01:58:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.835+0000 7fdde001e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fddd80d2470 con 0x7fddd80cf280 2024-09-12T01:58:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.835+0000 7fdde001e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fddd80d52d0 con 0x7fddd8162340 2024-09-12T01:58:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.835+0000 7fddde5bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd8162e30 0x7fddd80cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.835+0000 7fddde5bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd8162e30 0x7fddd80cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35806/0 (socket says 172.21.15.19:35806) 2024-09-12T01:58:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.835+0000 7fddde5bb640 1 -- 172.21.15.19:0/3071184659 learned_addr learned my addr 172.21.15.19:0/3071184659 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.835+0000 7fddde5bb640 1 -- 172.21.15.19:0/3071184659 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddd8162340 msgr2=0x7fddd815c8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:58:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.835+0000 7fddde5bb640 1 --2- 172.21.15.19:0/3071184659 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddd8162340 0x7fddd815c8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.835+0000 7fddde5bb640 1 -- 172.21.15.19:0/3071184659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddd80cf280 msgr2=0x7fddd80b69f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:58:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.835+0000 7fddde5bb640 1 --2- 172.21.15.19:0/3071184659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddd80cf280 0x7fddd80b69f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.835+0000 7fddde5bb640 1 -- 172.21.15.19:0/3071184659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd80cd540 con 0x7fddd8162e30 2024-09-12T01:58:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.835+0000 7fddde5bb640 1 --2- 172.21.15.19:0/3071184659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd8162e30 0x7fddd80cd000 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fddd0007df0 tx=0x7fddd000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.836+0000 7fddce7fc640 1 -- 172.21.15.19:0/3071184659 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd001a070 con 0x7fddd8162e30 2024-09-12T01:58:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.836+0000 7fddce7fc640 1 -- 172.21.15.19:0/3071184659 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd0003990 con 0x7fddd8162e30 2024-09-12T01:58:32.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.836+0000 7fdde001e640 1 -- 172.21.15.19:0/3071184659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd80cd7e0 con 0x7fddd8162e30 2024-09-12T01:58:32.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.836+0000 7fddce7fc640 1 -- 172.21.15.19:0/3071184659 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd0003d80 con 0x7fddd8162e30 2024-09-12T01:58:32.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.836+0000 7fdde001e640 1 -- 172.21.15.19:0/3071184659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd80cdda0 con 0x7fddd8162e30 2024-09-12T01:58:32.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.837+0000 7fdde001e640 1 -- 172.21.15.19:0/3071184659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd80cdfe0 con 0x7fddd8162e30 2024-09-12T01:58:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.837+0000 7fddce7fc640 1 -- 172.21.15.19:0/3071184659 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fddd001d070 con 0x7fddd8162e30 2024-09-12T01:58:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.838+0000 7fddce7fc640 1 --2- 172.21.15.19:0/3071184659 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fddbc06be30 0x7fddbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.838+0000 7fddce7fc640 1 -- 172.21.15.19:0/3071184659 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6101+0+0 (secure 0 0 0) 0x7fddd008b1f0 con 0x7fddd8162e30 2024-09-12T01:58:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.838+0000 7fdddddba640 1 --2- 172.21.15.19:0/3071184659 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fddbc06be30 0x7fddbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.839+0000 7fdddddba640 1 --2- 172.21.15.19:0/3071184659 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fddbc06be30 0x7fddbc06e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fddd40011e0 tx=0x7fddd40078b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:32.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:32.842+0000 7fddce7fc640 1 -- 172.21.15.19:0/3071184659 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fddd0010070 con 0x7fddd8162e30 2024-09-12T01:58:33.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.054+0000 7fdde001e640 1 -- 172.21.15.19:0/3071184659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fddd806d740 con 0x7fddd8162e30 2024-09-12T01:58:33.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.090+0000 7fddce7fc640 1 -- 172.21.15.19:0/3071184659 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v40) ==== 118+0+0 (secure 0 0 0) 0x7fddd0059aa0 con 0x7fddd8162e30 2024-09-12T01:58:33.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.092+0000 7fdde001e640 1 -- 172.21.15.19:0/3071184659 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fddbc06be30 msgr2=0x7fddbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:33.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.092+0000 7fdde001e640 1 --2- 172.21.15.19:0/3071184659 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fddbc06be30 0x7fddbc06e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fddd40011e0 tx=0x7fddd40078b0 comp rx=0 tx=0).stop 2024-09-12T01:58:33.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.092+0000 7fdde001e640 1 -- 172.21.15.19:0/3071184659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd8162e30 msgr2=0x7fddd80cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:33.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.092+0000 7fdde001e640 1 --2- 172.21.15.19:0/3071184659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd8162e30 0x7fddd80cd000 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fddd0007df0 tx=0x7fddd000d4a0 comp rx=0 tx=0).stop 2024-09-12T01:58:33.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.092+0000 7fdde001e640 1 -- 172.21.15.19:0/3071184659 shutdown_connections 2024-09-12T01:58:33.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.092+0000 7fdde001e640 1 --2- 172.21.15.19:0/3071184659 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fddbc06be30 0x7fddbc06e2f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:33.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.092+0000 7fdde001e640 1 --2- 172.21.15.19:0/3071184659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd8162e30 0x7fddd80cd000 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:33.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.092+0000 7fdde001e640 1 --2- 172.21.15.19:0/3071184659 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddd8162340 0x7fddd815c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:33.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.092+0000 7fdde001e640 1 --2- 172.21.15.19:0/3071184659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddd80cf280 0x7fddd80b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:33.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.092+0000 7fdde001e640 1 -- 172.21.15.19:0/3071184659 >> 172.21.15.19:0/3071184659 conn(0x7fddd808bfc0 msgr2=0x7fddd80cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:33.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.092+0000 7fdde001e640 1 -- 172.21.15.19:0/3071184659 shutdown_connections 2024-09-12T01:58:33.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.092+0000 7fdde001e640 1 -- 172.21.15.19:0/3071184659 wait complete. 2024-09-12T01:58:33.103 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T01:58:33.103 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T01:58:33.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.208+0000 7f33a808d640 1 Processor -- start 2024-09-12T01:58:33.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.208+0000 7f33a808d640 1 -- start start 2024-09-12T01:58:33.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.209+0000 7f33a808d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f33a00d15f0 0x7f33a00cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:33.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.209+0000 7f33a808d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f33a00cf160 0x7f33a006d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:33.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.209+0000 7f33a808d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33a00cf980 con 0x7f33a0161a20 2024-09-12T01:58:33.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.209+0000 7f33a808d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f33a0161e00 con 0x7f33a00d15f0 2024-09-12T01:58:33.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.209+0000 7f33a808d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f33a006d050 con 0x7f33a00cf160 2024-09-12T01:58:33.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.209+0000 7f33a5628640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f33a00d15f0 0x7f33a00cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:33.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.209+0000 7f33a5628640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f33a00d15f0 0x7f33a00cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35814/0 (socket says 172.21.15.19:35814) 2024-09-12T01:58:33.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.209+0000 7f33a5628640 1 -- 172.21.15.19:0/1718916643 learned_addr learned my addr 172.21.15.19:0/1718916643 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:33.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.209+0000 7f33a662a640 1 --2- 172.21.15.19:0/1718916643 >> v2:172.21.15.135:3300/0 conn(0x7f33a00cf160 0x7f33a006d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:33.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.209+0000 7f33a5628640 1 -- 172.21.15.19:0/1718916643 >> v2:172.21.15.135:3300/0 conn(0x7f33a00cf160 msgr2=0x7f33a006d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:33.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.209+0000 7f33a5628640 1 --2- 172.21.15.19:0/1718916643 >> v2:172.21.15.135:3300/0 conn(0x7f33a00cf160 0x7f33a006d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:33.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.209+0000 7f33a5628640 1 -- 172.21.15.19:0/1718916643 >> v1:172.21.15.135:6789/0 conn(0x7f33a0161a20 legacy=0x7f33a00d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:33.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.209+0000 7f33a5628640 1 -- 172.21.15.19:0/1718916643 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a00cfc20 con 0x7f33a00d15f0 2024-09-12T01:58:33.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.210+0000 7f33a5628640 1 --2- 172.21.15.19:0/1718916643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a00d15f0 0x7f33a00cec20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f33a00d4410 tx=0x7f339c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ac08f2845204bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:33.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.210+0000 7f33a4e27640 1 -- 172.21.15.19:0/1718916643 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c037070 con 0x7f33a00d15f0 2024-09-12T01:58:33.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.210+0000 7f33a4e27640 1 -- 172.21.15.19:0/1718916643 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f339c032440 con 0x7f33a00d15f0 2024-09-12T01:58:33.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.210+0000 7f33a4e27640 1 -- 172.21.15.19:0/1718916643 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c032810 con 0x7f33a00d15f0 2024-09-12T01:58:33.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.211+0000 7f33a808d640 1 -- 172.21.15.19:0/1718916643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a00d15f0 msgr2=0x7f33a00cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:33.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.211+0000 7f33a808d640 1 --2- 172.21.15.19:0/1718916643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a00d15f0 0x7f33a00cec20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f33a00d4410 tx=0x7f339c02a270 comp rx=0 tx=0).stop 2024-09-12T01:58:33.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.211+0000 7f33a808d640 1 -- 172.21.15.19:0/1718916643 shutdown_connections 2024-09-12T01:58:33.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.211+0000 7f33a808d640 1 --2- 172.21.15.19:0/1718916643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a00d15f0 0x7f33a00cec20 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:33.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.211+0000 7f33a808d640 1 --2- 172.21.15.19:0/1718916643 >> v2:172.21.15.135:3300/0 conn(0x7f33a00cf160 0x7f33a006d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:33.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.211+0000 7f33a808d640 1 -- 172.21.15.19:0/1718916643 >> 172.21.15.19:0/1718916643 conn(0x7f33a009d850 msgr2=0x7f33a008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:33.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.211+0000 7f33a808d640 1 -- 172.21.15.19:0/1718916643 shutdown_connections 2024-09-12T01:58:33.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.211+0000 7f33a808d640 1 -- 172.21.15.19:0/1718916643 wait complete. 2024-09-12T01:58:33.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.212+0000 7f33a808d640 1 Processor -- start 2024-09-12T01:58:33.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.212+0000 7f33a808d640 1 -- start start 2024-09-12T01:58:33.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.213+0000 7f33a808d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a00cf160 0x7f33a00cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:33.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.213+0000 7f33a808d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a00d15f0 0x7f33a015bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:33.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.213+0000 7f33a808d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33a0161a20 0x7f33a00b7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:33.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.213+0000 7f33a808d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f33a00b1040 con 0x7f33a00d15f0 2024-09-12T01:58:33.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.213+0000 7f33a808d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33a006d2f0 con 0x7f33a00cf160 2024-09-12T01:58:33.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.213+0000 7f33a808d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f33a00cf590 con 0x7f33a0161a20 2024-09-12T01:58:33.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.213+0000 7f33a5628640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a00d15f0 0x7f33a015bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:33.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.213+0000 7f33a5628640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a00d15f0 0x7f33a015bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35828/0 (socket says 172.21.15.19:35828) 2024-09-12T01:58:33.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.213+0000 7f33a5628640 1 -- 172.21.15.19:0/3374089060 learned_addr learned my addr 172.21.15.19:0/3374089060 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:33.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.213+0000 7f33a5e29640 1 --2- 172.21.15.19:0/3374089060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a00cf160 0x7f33a00cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:33.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.213+0000 7f33a5628640 1 -- 172.21.15.19:0/3374089060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33a0161a20 msgr2=0x7f33a00b7670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:58:33.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.213+0000 7f33a5628640 1 --2- 172.21.15.19:0/3374089060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33a0161a20 0x7f33a00b7670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:33.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.213+0000 7f33a5628640 1 -- 172.21.15.19:0/3374089060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a00cf160 msgr2=0x7f33a00cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:33.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.213+0000 7f33a5628640 1 --2- 172.21.15.19:0/3374089060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a00cf160 0x7f33a00cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:33.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.213+0000 7f33a5628640 1 -- 172.21.15.19:0/3374089060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a00cd540 con 0x7f33a00d15f0 2024-09-12T01:58:33.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.214+0000 7f33a5628640 1 --2- 172.21.15.19:0/3374089060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a00d15f0 0x7f33a015bbf0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f339c02a2b0 tx=0x7f339c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:33.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.214+0000 7f33927fc640 1 -- 172.21.15.19:0/3374089060 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c037040 con 0x7f33a00d15f0 2024-09-12T01:58:33.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.214+0000 7f33927fc640 1 -- 172.21.15.19:0/3374089060 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f339c042070 con 0x7f33a00d15f0 2024-09-12T01:58:33.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.214+0000 7f33a808d640 1 -- 172.21.15.19:0/3374089060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a00cd260 con 0x7f33a00d15f0 2024-09-12T01:58:33.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.214+0000 7f33927fc640 1 -- 172.21.15.19:0/3374089060 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c03b870 con 0x7f33a00d15f0 2024-09-12T01:58:33.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.214+0000 7f33a808d640 1 -- 172.21.15.19:0/3374089060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a015b6d0 con 0x7f33a00d15f0 2024-09-12T01:58:33.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.215+0000 7f33a808d640 1 -- 172.21.15.19:0/3374089060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a00cec20 con 0x7f33a00d15f0 2024-09-12T01:58:33.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.215+0000 7f33927fc640 1 -- 172.21.15.19:0/3374089060 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f339c03ba10 con 0x7f33a00d15f0 2024-09-12T01:58:33.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.216+0000 7f33927fc640 1 --2- 172.21.15.19:0/3374089060 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f338406be30 0x7f338406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:33.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.216+0000 7f33927fc640 1 -- 172.21.15.19:0/3374089060 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6101+0+0 (secure 0 0 0) 0x7f339c0ab7c0 con 0x7f33a00d15f0 2024-09-12T01:58:33.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.216+0000 7f33a5e29640 1 --2- 172.21.15.19:0/3374089060 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f338406be30 0x7f338406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:33.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.217+0000 7f33a5e29640 1 --2- 172.21.15.19:0/3374089060 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f338406be30 0x7f338406e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3394000f60 tx=0x7f3394009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:33.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.220+0000 7f33927fc640 1 -- 172.21.15.19:0/3374089060 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f339c079fe0 con 0x7f33a00d15f0 2024-09-12T01:58:33.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:33.433+0000 7f33a808d640 1 -- 172.21.15.19:0/3374089060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f33a015f360 con 0x7f33a00d15f0 2024-09-12T01:58:34.059 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T01:58:34.059+0000 7f8f82c52640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:58:34.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.095+0000 7f33927fc640 1 -- 172.21.15.19:0/3374089060 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v41) ==== 122+0+0 (secure 0 0 0) 0x7f339c07ee20 con 0x7f33a00d15f0 2024-09-12T01:58:34.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.098+0000 7f33a808d640 1 -- 172.21.15.19:0/3374089060 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f338406be30 msgr2=0x7f338406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.098+0000 7f33a808d640 1 --2- 172.21.15.19:0/3374089060 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f338406be30 0x7f338406e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3394000f60 tx=0x7f3394009040 comp rx=0 tx=0).stop 2024-09-12T01:58:34.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.098+0000 7f33a808d640 1 -- 172.21.15.19:0/3374089060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a00d15f0 msgr2=0x7f33a015bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.098+0000 7f33a808d640 1 --2- 172.21.15.19:0/3374089060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a00d15f0 0x7f33a015bbf0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f339c02a2b0 tx=0x7f339c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.098+0000 7f33a808d640 1 -- 172.21.15.19:0/3374089060 shutdown_connections 2024-09-12T01:58:34.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.098+0000 7f33a808d640 1 --2- 172.21.15.19:0/3374089060 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f338406be30 0x7f338406e2f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.098+0000 7f33a808d640 1 --2- 172.21.15.19:0/3374089060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33a0161a20 0x7f33a00b7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.098+0000 7f33a808d640 1 --2- 172.21.15.19:0/3374089060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a00d15f0 0x7f33a015bbf0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.098+0000 7f33a808d640 1 --2- 172.21.15.19:0/3374089060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a00cf160 0x7f33a00cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.098+0000 7f33a808d640 1 -- 172.21.15.19:0/3374089060 >> 172.21.15.19:0/3374089060 conn(0x7f33a009d850 msgr2=0x7f33a00d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:34.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.098+0000 7f33a808d640 1 -- 172.21.15.19:0/3374089060 shutdown_connections 2024-09-12T01:58:34.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.098+0000 7f33a808d640 1 -- 172.21.15.19:0/3374089060 wait complete. 2024-09-12T01:58:34.112 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T01:58:34.112 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:58:34.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.220+0000 7eff615c4640 1 Processor -- start 2024-09-12T01:58:34.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.220+0000 7eff615c4640 1 -- start start 2024-09-12T01:58:34.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.221+0000 7eff615c4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5c15c520 0x7eff5c09b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.221+0000 7eff615c4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff5c0cec00 con 0x7eff5c0d1090 2024-09-12T01:58:34.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.221+0000 7eff615c4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff5c09bd90 con 0x7eff5c0b1620 2024-09-12T01:58:34.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.221+0000 7eff615c4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7eff5c0d0010 con 0x7eff5c15c520 2024-09-12T01:58:34.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.221+0000 7eff5b7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7eff5c0d1090 0x7eff5c0cd570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38340/0 (socket says 172.21.15.19:38340) 2024-09-12T01:58:34.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.221+0000 7eff5b7fe640 1 -- 172.21.15.19:0/16251828 learned_addr learned my addr 172.21.15.19:0/16251828 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:34.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff5affd640 1 --2- 172.21.15.19:0/16251828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5c15c520 0x7eff5c09b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff59ffb640 1 -- 172.21.15.19:0/16251828 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2765541345 0 0) 0x7eff5c0cec00 con 0x7eff5c0d1090 2024-09-12T01:58:34.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff59ffb640 1 -- 172.21.15.19:0/16251828 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff44003520 con 0x7eff5c0d1090 2024-09-12T01:58:34.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff59ffb640 1 -- 172.21.15.19:0/16251828 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1570906247 0 0) 0x7eff44003520 con 0x7eff5c0d1090 2024-09-12T01:58:34.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff59ffb640 1 -- 172.21.15.19:0/16251828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5c15c520 msgr2=0x7eff5c09b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:34.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff59ffb640 1 --2- 172.21.15.19:0/16251828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5c15c520 0x7eff5c09b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff59ffb640 1 -- 172.21.15.19:0/16251828 >> v1:172.21.15.135:6789/0 conn(0x7eff5c0b1620 legacy=0x7eff5c0d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff59ffb640 1 -- 172.21.15.19:0/16251828 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5c0d02f0 con 0x7eff5c0d1090 2024-09-12T01:58:34.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff59ffb640 1 -- 172.21.15.19:0/16251828 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7eff54001670 con 0x7eff5c0d1090 2024-09-12T01:58:34.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff59ffb640 1 -- 172.21.15.19:0/16251828 >> v1:172.21.15.19:6789/0 conn(0x7eff5c0d1090 legacy=0x7eff5c0cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff59ffb640 1 --2- 172.21.15.19:0/16251828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5c15c520 0x7eff440039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff59ffb640 1 --2- 172.21.15.19:0/16251828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff44003f60 0x7eff44004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff59ffb640 1 --2- 172.21.15.19:0/16251828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44004d40 0x7eff440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff59ffb640 1 -- 172.21.15.19:0/16251828 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c0d0010 con 0x7eff44003f60 2024-09-12T01:58:34.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff59ffb640 1 -- 172.21.15.19:0/16251828 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7eff4400baa0 con 0x7eff44004d40 2024-09-12T01:58:34.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff59ffb640 1 -- 172.21.15.19:0/16251828 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7eff4400bca0 con 0x7eff5c15c520 2024-09-12T01:58:34.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff5a7fc640 1 --2- 172.21.15.19:0/16251828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff44003f60 0x7eff44004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff5affd640 1 --2- 172.21.15.19:0/16251828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5c15c520 0x7eff440039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.222+0000 7eff5b7fe640 1 --2- 172.21.15.19:0/16251828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44004d40 0x7eff440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.223+0000 7eff5a7fc640 1 -- 172.21.15.19:0/16251828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5c15c520 msgr2=0x7eff440039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:34.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.223+0000 7eff5a7fc640 1 --2- 172.21.15.19:0/16251828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5c15c520 0x7eff440039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.223+0000 7eff5a7fc640 1 -- 172.21.15.19:0/16251828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44004d40 msgr2=0x7eff440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:34.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.223+0000 7eff5a7fc640 1 --2- 172.21.15.19:0/16251828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44004d40 0x7eff440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.223+0000 7eff5a7fc640 1 -- 172.21.15.19:0/16251828 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff44003520 con 0x7eff44003f60 2024-09-12T01:58:34.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.223+0000 7eff5b7fe640 1 --2- 172.21.15.19:0/16251828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44004d40 0x7eff440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:34.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.223+0000 7eff5a7fc640 1 --2- 172.21.15.19:0/16251828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff44003f60 0x7eff44004800 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7eff50001750 tx=0x7eff44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbeff26a1c6c254 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.223+0000 7eff59ffb640 1 -- 172.21.15.19:0/16251828 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff50001370 con 0x7eff44003f60 2024-09-12T01:58:34.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.223+0000 7eff59ffb640 1 -- 172.21.15.19:0/16251828 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff500052d0 con 0x7eff44003f60 2024-09-12T01:58:34.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.223+0000 7eff59ffb640 1 -- 172.21.15.19:0/16251828 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5002abe0 con 0x7eff44003f60 2024-09-12T01:58:34.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.224+0000 7eff615c4640 1 -- 172.21.15.19:0/16251828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff44003f60 msgr2=0x7eff44004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.224+0000 7eff615c4640 1 --2- 172.21.15.19:0/16251828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff44003f60 0x7eff44004800 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7eff50001750 tx=0x7eff44005830 comp rx=0 tx=0).stop 2024-09-12T01:58:34.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.224+0000 7eff5b7fe640 1 -- 172.21.15.19:0/16251828 reap_dead start 2024-09-12T01:58:34.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.224+0000 7eff615c4640 1 -- 172.21.15.19:0/16251828 shutdown_connections 2024-09-12T01:58:34.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.224+0000 7eff615c4640 1 -- 172.21.15.19:0/16251828 >> 172.21.15.19:0/16251828 conn(0x7eff5c0d23a0 msgr2=0x7eff5c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:34.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.224+0000 7eff615c4640 1 -- 172.21.15.19:0/16251828 shutdown_connections 2024-09-12T01:58:34.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.224+0000 7eff615c4640 1 -- 172.21.15.19:0/16251828 wait complete. 2024-09-12T01:58:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.225+0000 7eff615c4640 1 Processor -- start 2024-09-12T01:58:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.225+0000 7eff615c4640 1 -- start start 2024-09-12T01:58:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.226+0000 7eff615c4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44003f60 0x7eff5c0ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.226+0000 7eff615c4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5c1f64c0 0x7eff5c0b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.226+0000 7eff615c4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff5c0c9470 0x7eff5c0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.226+0000 7eff615c4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c15c900 con 0x7eff5c0c9470 2024-09-12T01:58:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.226+0000 7eff615c4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c0d05d0 con 0x7eff44003f60 2024-09-12T01:58:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.226+0000 7eff615c4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7eff5c0b6fe0 con 0x7eff5c1f64c0 2024-09-12T01:58:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.226+0000 7eff5b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff5c0c9470 0x7eff5c0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.226+0000 7eff5b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff5c0c9470 0x7eff5c0c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35854/0 (socket says 172.21.15.19:35854) 2024-09-12T01:58:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.226+0000 7eff5b7fe640 1 -- 172.21.15.19:0/4148402330 learned_addr learned my addr 172.21.15.19:0/4148402330 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.226+0000 7eff5a7fc640 1 --2- 172.21.15.19:0/4148402330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5c1f64c0 0x7eff5c0b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.226+0000 7eff5affd640 1 --2- 172.21.15.19:0/4148402330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44003f60 0x7eff5c0ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.227+0000 7eff5b7fe640 1 -- 172.21.15.19:0/4148402330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5c1f64c0 msgr2=0x7eff5c0b7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.227+0000 7eff5b7fe640 1 --2- 172.21.15.19:0/4148402330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5c1f64c0 0x7eff5c0b7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.227+0000 7eff5b7fe640 1 -- 172.21.15.19:0/4148402330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44003f60 msgr2=0x7eff5c0ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.227+0000 7eff5b7fe640 1 --2- 172.21.15.19:0/4148402330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44003f60 0x7eff5c0ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.227+0000 7eff5b7fe640 1 -- 172.21.15.19:0/4148402330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5c0cbf60 con 0x7eff5c0c9470 2024-09-12T01:58:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.227+0000 7eff5affd640 1 --2- 172.21.15.19:0/4148402330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44003f60 0x7eff5c0ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.227+0000 7eff5b7fe640 1 --2- 172.21.15.19:0/4148402330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff5c0c9470 0x7eff5c0c98f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0733e0 tx=0x7eff5400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.227+0000 7eff437fe640 1 -- 172.21.15.19:0/4148402330 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff54019070 con 0x7eff5c0c9470 2024-09-12T01:58:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.227+0000 7eff437fe640 1 -- 172.21.15.19:0/4148402330 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff5400c560 con 0x7eff5c0c9470 2024-09-12T01:58:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.227+0000 7eff615c4640 1 -- 172.21.15.19:0/4148402330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff5c0cc240 con 0x7eff5c0c9470 2024-09-12T01:58:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.227+0000 7eff437fe640 1 -- 172.21.15.19:0/4148402330 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5400c950 con 0x7eff5c0c9470 2024-09-12T01:58:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.227+0000 7eff615c4640 1 -- 172.21.15.19:0/4148402330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff5c0b7510 con 0x7eff5c0c9470 2024-09-12T01:58:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.228+0000 7eff615c4640 1 -- 172.21.15.19:0/4148402330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff5c09b720 con 0x7eff5c0c9470 2024-09-12T01:58:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.229+0000 7eff437fe640 1 -- 172.21.15.19:0/4148402330 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff5401c070 con 0x7eff5c0c9470 2024-09-12T01:58:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.229+0000 7eff437fe640 1 --2- 172.21.15.19:0/4148402330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7eff4806be30 0x7eff4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.229+0000 7eff437fe640 1 -- 172.21.15.19:0/4148402330 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6101+0+0 (secure 0 0 0) 0x7eff5408a410 con 0x7eff5c0c9470 2024-09-12T01:58:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.229+0000 7eff5affd640 1 --2- 172.21.15.19:0/4148402330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7eff4806be30 0x7eff4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.230+0000 7eff5affd640 1 --2- 172.21.15.19:0/4148402330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7eff4806be30 0x7eff4806e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7eff4c012850 tx=0x7eff4c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.233+0000 7eff437fe640 1 -- 172.21.15.19:0/4148402330 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff540585e0 con 0x7eff5c0c9470 2024-09-12T01:58:34.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.448+0000 7eff615c4640 1 -- 172.21.15.19:0/4148402330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff5c0b8320 con 0x7eff5c0c9470 2024-09-12T01:58:34.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.448+0000 7eff437fe640 1 -- 172.21.15.19:0/4148402330 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5227 (secure 0 0 0) 0x7eff5405c8e0 con 0x7eff5c0c9470 2024-09-12T01:58:34.449 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:34.449 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":41,"btime":"2024-09-12T01:58:34:091092+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2176310149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2176310149},{"type":"v1","addr":"172.21.15.135:6836","nonce":2176310149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/222313950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":222313950},{"type":"v1","addr":"172.21.15.135:6837","nonce":222313950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/2113904472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2113904472},{"type":"v1","addr":"172.21.15.19:6834","nonce":2113904472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:58:31.431304+0000","modified":"2024-09-12T01:58:33.435055+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/1551156711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1551156711},{"type":"v1","addr":"172.21.15.19:6835","nonce":1551156711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":4}]} 2024-09-12T01:58:34.449 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 41 2024-09-12T01:58:34.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.451+0000 7eff615c4640 1 -- 172.21.15.19:0/4148402330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7eff4806be30 msgr2=0x7eff4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.451+0000 7eff615c4640 1 --2- 172.21.15.19:0/4148402330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7eff4806be30 0x7eff4806e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7eff4c012850 tx=0x7eff4c00b040 comp rx=0 tx=0).stop 2024-09-12T01:58:34.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.451+0000 7eff615c4640 1 -- 172.21.15.19:0/4148402330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff5c0c9470 msgr2=0x7eff5c0c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.451+0000 7eff615c4640 1 --2- 172.21.15.19:0/4148402330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff5c0c9470 0x7eff5c0c98f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0733e0 tx=0x7eff5400eb90 comp rx=0 tx=0).stop 2024-09-12T01:58:34.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.451+0000 7eff615c4640 1 -- 172.21.15.19:0/4148402330 shutdown_connections 2024-09-12T01:58:34.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.451+0000 7eff615c4640 1 --2- 172.21.15.19:0/4148402330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7eff4806be30 0x7eff4806e2f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.451+0000 7eff615c4640 1 --2- 172.21.15.19:0/4148402330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff5c0c9470 0x7eff5c0c98f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.451+0000 7eff615c4640 1 --2- 172.21.15.19:0/4148402330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5c1f64c0 0x7eff5c0b7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.451+0000 7eff615c4640 1 --2- 172.21.15.19:0/4148402330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44003f60 0x7eff5c0ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.451+0000 7eff615c4640 1 -- 172.21.15.19:0/4148402330 >> 172.21.15.19:0/4148402330 conn(0x7eff5c0d23a0 msgr2=0x7eff5c15b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:34.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.451+0000 7eff615c4640 1 -- 172.21.15.19:0/4148402330 shutdown_connections 2024-09-12T01:58:34.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.451+0000 7eff615c4640 1 -- 172.21.15.19:0/4148402330 wait complete. 2024-09-12T01:58:34.462 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:58:34.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.564+0000 7fdfd4c74640 1 Processor -- start 2024-09-12T01:58:34.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.564+0000 7fdfd4c74640 1 -- start start 2024-09-12T01:58:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.565+0000 7fdfd4c74640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdfd00d06e0 0x7fdfd00ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.565+0000 7fdfd4c74640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdfd015d3e0 0x7fdfd00d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.565+0000 7fdfd4c74640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfd00d1000 con 0x7fdfd009b510 2024-09-12T01:58:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.565+0000 7fdfd4c74640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fdfd009b080 con 0x7fdfd015d3e0 2024-09-12T01:58:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.565+0000 7fdfd4c74640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fdfd00d00a0 con 0x7fdfd00d06e0 2024-09-12T01:58:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.565+0000 7fdfcdd9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdfd015d3e0 0x7fdfd00d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.565+0000 7fdfcdd9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdfd015d3e0 0x7fdfd00d0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35858/0 (socket says 172.21.15.19:35858) 2024-09-12T01:58:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.565+0000 7fdfced9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdfd009b510 0x7fdfd00ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38342/0 (socket says 172.21.15.19:38342) 2024-09-12T01:58:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.565+0000 7fdfcdd9b640 1 -- 172.21.15.19:0/1723308739 learned_addr learned my addr 172.21.15.19:0/1723308739 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.565+0000 7fdfce59c640 1 --2- 172.21.15.19:0/1723308739 >> v2:172.21.15.135:3300/0 conn(0x7fdfd00d06e0 0x7fdfd00ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.565+0000 7fdfcdd9b640 1 -- 172.21.15.19:0/1723308739 >> v2:172.21.15.135:3300/0 conn(0x7fdfd00d06e0 msgr2=0x7fdfd00ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.565+0000 7fdfcdd9b640 1 --2- 172.21.15.19:0/1723308739 >> v2:172.21.15.135:3300/0 conn(0x7fdfd00d06e0 0x7fdfd00ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.565+0000 7fdfcdd9b640 1 -- 172.21.15.19:0/1723308739 >> v1:172.21.15.19:6789/0 conn(0x7fdfd009b510 legacy=0x7fdfd00ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.565+0000 7fdfcd59a640 1 -- 172.21.15.19:0/1723308739 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 870169446 0 0) 0x7fdfd00d1000 con 0x7fdfd009b510 2024-09-12T01:58:34.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.565+0000 7fdfcdd9b640 1 -- 172.21.15.19:0/1723308739 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd00d0380 con 0x7fdfd015d3e0 2024-09-12T01:58:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.566+0000 7fdfcdd9b640 1 --2- 172.21.15.19:0/1723308739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfd015d3e0 0x7fdfd00d0ac0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00734a0 tx=0x7fdfc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea5b0ae65502818 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.566+0000 7fdfcd59a640 1 -- 172.21.15.19:0/1723308739 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4037070 con 0x7fdfd015d3e0 2024-09-12T01:58:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.566+0000 7fdfcd59a640 1 -- 172.21.15.19:0/1723308739 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfc4032440 con 0x7fdfd015d3e0 2024-09-12T01:58:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.566+0000 7fdfcd59a640 1 -- 172.21.15.19:0/1723308739 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4032810 con 0x7fdfd015d3e0 2024-09-12T01:58:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.567+0000 7fdfd4c74640 1 -- 172.21.15.19:0/1723308739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfd015d3e0 msgr2=0x7fdfd00d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.567+0000 7fdfd4c74640 1 --2- 172.21.15.19:0/1723308739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfd015d3e0 0x7fdfd00d0ac0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00734a0 tx=0x7fdfc402a270 comp rx=0 tx=0).stop 2024-09-12T01:58:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.567+0000 7fdfd4c74640 1 -- 172.21.15.19:0/1723308739 shutdown_connections 2024-09-12T01:58:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.567+0000 7fdfd4c74640 1 --2- 172.21.15.19:0/1723308739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfd015d3e0 0x7fdfd00d0ac0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.567+0000 7fdfd4c74640 1 --2- 172.21.15.19:0/1723308739 >> v2:172.21.15.135:3300/0 conn(0x7fdfd00d06e0 0x7fdfd00ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.567+0000 7fdfd4c74640 1 -- 172.21.15.19:0/1723308739 >> 172.21.15.19:0/1723308739 conn(0x7fdfd00d23a0 msgr2=0x7fdfd00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.567+0000 7fdfd4c74640 1 -- 172.21.15.19:0/1723308739 shutdown_connections 2024-09-12T01:58:34.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.567+0000 7fdfd4c74640 1 -- 172.21.15.19:0/1723308739 wait complete. 2024-09-12T01:58:34.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.568+0000 7fdfd4c74640 1 Processor -- start 2024-09-12T01:58:34.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.568+0000 7fdfd4c74640 1 -- start start 2024-09-12T01:58:34.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.569+0000 7fdfd4c74640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdfd009b510 0x7fdfd0157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.569+0000 7fdfd4c74640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfd00d06e0 0x7fdfd00b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.569+0000 7fdfd4c74640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd015d3e0 0x7fdfd0159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.569+0000 7fdfd4c74640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd015d800 con 0x7fdfd00d06e0 2024-09-12T01:58:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.569+0000 7fdfd4c74640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd009ad10 con 0x7fdfd015d3e0 2024-09-12T01:58:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.569+0000 7fdfd4c74640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdfd015c740 con 0x7fdfd009b510 2024-09-12T01:58:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.569+0000 7fdfcdd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfd00d06e0 0x7fdfd00b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.569+0000 7fdfcdd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfd00d06e0 0x7fdfd00b7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35866/0 (socket says 172.21.15.19:35866) 2024-09-12T01:58:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.569+0000 7fdfcdd9b640 1 -- 172.21.15.19:0/992998112 learned_addr learned my addr 172.21.15.19:0/992998112 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.569+0000 7fdfced9d640 1 --2- 172.21.15.19:0/992998112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd015d3e0 0x7fdfd0159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.569+0000 7fdfce59c640 1 --2- 172.21.15.19:0/992998112 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdfd009b510 0x7fdfd0157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.569+0000 7fdfcdd9b640 1 -- 172.21.15.19:0/992998112 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdfd009b510 msgr2=0x7fdfd0157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.569+0000 7fdfcdd9b640 1 --2- 172.21.15.19:0/992998112 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdfd009b510 0x7fdfd0157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.569+0000 7fdfcdd9b640 1 -- 172.21.15.19:0/992998112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd015d3e0 msgr2=0x7fdfd0159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.569+0000 7fdfcdd9b640 1 --2- 172.21.15.19:0/992998112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd015d3e0 0x7fdfd0159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.569+0000 7fdfcdd9b640 1 -- 172.21.15.19:0/992998112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd006d220 con 0x7fdfd00d06e0 2024-09-12T01:58:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.569+0000 7fdfcdd9b640 1 --2- 172.21.15.19:0/992998112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfd00d06e0 0x7fdfd00b7610 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fdfc402a2b0 tx=0x7fdfc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.570+0000 7fdfbeffd640 1 -- 172.21.15.19:0/992998112 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4041020 con 0x7fdfd00d06e0 2024-09-12T01:58:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.570+0000 7fdfbeffd640 1 -- 172.21.15.19:0/992998112 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfc40306c0 con 0x7fdfd00d06e0 2024-09-12T01:58:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.570+0000 7fdfd4c74640 1 -- 172.21.15.19:0/992998112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfd006d500 con 0x7fdfd00d06e0 2024-09-12T01:58:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.570+0000 7fdfbeffd640 1 -- 172.21.15.19:0/992998112 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4037040 con 0x7fdfd00d06e0 2024-09-12T01:58:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.570+0000 7fdfd4c74640 1 -- 172.21.15.19:0/992998112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfd006dac0 con 0x7fdfd00d06e0 2024-09-12T01:58:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.571+0000 7fdfd4c74640 1 -- 172.21.15.19:0/992998112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfd00ce8b0 con 0x7fdfd00d06e0 2024-09-12T01:58:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.571+0000 7fdfbeffd640 1 -- 172.21.15.19:0/992998112 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdfc4044020 con 0x7fdfd00d06e0 2024-09-12T01:58:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.572+0000 7fdfbeffd640 1 --2- 172.21.15.19:0/992998112 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdfb006be30 0x7fdfb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.572+0000 7fdfbeffd640 1 -- 172.21.15.19:0/992998112 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6101+0+0 (secure 0 0 0) 0x7fdfc40ab860 con 0x7fdfd00d06e0 2024-09-12T01:58:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.572+0000 7fdfce59c640 1 --2- 172.21.15.19:0/992998112 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdfb006be30 0x7fdfb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.572+0000 7fdfce59c640 1 --2- 172.21.15.19:0/992998112 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdfb006be30 0x7fdfb006e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0006fd0 tx=0x7fdfc0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.576+0000 7fdfbeffd640 1 -- 172.21.15.19:0/992998112 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdfc404b030 con 0x7fdfd00d06e0 2024-09-12T01:58:34.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.754+0000 7fdfd4c74640 1 -- 172.21.15.19:0/992998112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdfd00d31d0 con 0x7fdfd00d06e0 2024-09-12T01:58:34.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.755+0000 7fdfbeffd640 1 -- 172.21.15.19:0/992998112 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+16932 (secure 0 0 0) 0x7fdfc407a080 con 0x7fdfd00d06e0 2024-09-12T01:58:34.755 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:34.756 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":66,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:58:33.066471+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:58:29.092441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-12T01:58:30.437695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:58:34.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.757+0000 7fdfd4c74640 1 -- 172.21.15.19:0/992998112 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdfb006be30 msgr2=0x7fdfb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.757+0000 7fdfd4c74640 1 --2- 172.21.15.19:0/992998112 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdfb006be30 0x7fdfb006e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0006fd0 tx=0x7fdfc0008040 comp rx=0 tx=0).stop 2024-09-12T01:58:34.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.757+0000 7fdfd4c74640 1 -- 172.21.15.19:0/992998112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfd00d06e0 msgr2=0x7fdfd00b7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.757+0000 7fdfd4c74640 1 --2- 172.21.15.19:0/992998112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfd00d06e0 0x7fdfd00b7610 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fdfc402a2b0 tx=0x7fdfc40046c0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.757+0000 7fdfd4c74640 1 -- 172.21.15.19:0/992998112 shutdown_connections 2024-09-12T01:58:34.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.757+0000 7fdfd4c74640 1 --2- 172.21.15.19:0/992998112 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdfb006be30 0x7fdfb006e2f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.757+0000 7fdfd4c74640 1 --2- 172.21.15.19:0/992998112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd015d3e0 0x7fdfd0159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.757+0000 7fdfd4c74640 1 --2- 172.21.15.19:0/992998112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfd00d06e0 0x7fdfd00b7610 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.757+0000 7fdfd4c74640 1 --2- 172.21.15.19:0/992998112 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdfd009b510 0x7fdfd0157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.757+0000 7fdfd4c74640 1 -- 172.21.15.19:0/992998112 >> 172.21.15.19:0/992998112 conn(0x7fdfd00d23a0 msgr2=0x7fdfd00b22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:34.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.757+0000 7fdfd4c74640 1 -- 172.21.15.19:0/992998112 shutdown_connections 2024-09-12T01:58:34.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.757+0000 7fdfd4c74640 1 -- 172.21.15.19:0/992998112 wait complete. 2024-09-12T01:58:34.769 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:58:34.769 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:58:34.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.871+0000 7fde1eed0640 1 Processor -- start 2024-09-12T01:58:34.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.871+0000 7fde1eed0640 1 -- start start 2024-09-12T01:58:34.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.872+0000 7fde1eed0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fde1815e760 0x7fde1806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.872+0000 7fde1eed0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fde180d4fd0 0x7fde180cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.872+0000 7fde1eed0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde180d2700 con 0x7fde180b3650 2024-09-12T01:58:34.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.872+0000 7fde1eed0640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fde180cedb0 con 0x7fde180d4fd0 2024-09-12T01:58:34.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.872+0000 7fde1eed0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fde180cf090 con 0x7fde1815e760 2024-09-12T01:58:34.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.872+0000 7fde17fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fde180d4fd0 0x7fde180cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.872+0000 7fde17fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fde180d4fd0 0x7fde180cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35882/0 (socket says 172.21.15.19:35882) 2024-09-12T01:58:34.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.872+0000 7fde17fff640 1 -- 172.21.15.19:0/1963493865 learned_addr learned my addr 172.21.15.19:0/1963493865 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:34.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.872+0000 7fde1cc6c640 1 --2- 172.21.15.19:0/1963493865 >> v2:172.21.15.135:3300/0 conn(0x7fde1815e760 0x7fde1806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.872+0000 7fde17fff640 1 -- 172.21.15.19:0/1963493865 >> v2:172.21.15.135:3300/0 conn(0x7fde1815e760 msgr2=0x7fde1806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:34.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.872+0000 7fde17fff640 1 --2- 172.21.15.19:0/1963493865 >> v2:172.21.15.135:3300/0 conn(0x7fde1815e760 0x7fde1806cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.872+0000 7fde17fff640 1 -- 172.21.15.19:0/1963493865 >> v1:172.21.15.135:6789/0 conn(0x7fde180b3650 legacy=0x7fde180d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:34.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.872+0000 7fde17fff640 1 -- 172.21.15.19:0/1963493865 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde180b3c80 con 0x7fde180d4fd0 2024-09-12T01:58:34.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.872+0000 7fde1cc6c640 1 --2- 172.21.15.19:0/1963493865 >> v2:172.21.15.135:3300/0 conn(0x7fde1815e760 0x7fde1806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:34.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.873+0000 7fde17fff640 1 --2- 172.21.15.19:0/1963493865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde180d4fd0 0x7fde180cf5b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fde1808ca50 tx=0x7fde0402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92801f336902c134 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.873+0000 7fde177fe640 1 -- 172.21.15.19:0/1963493865 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde04004030 con 0x7fde180d4fd0 2024-09-12T01:58:34.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.873+0000 7fde177fe640 1 -- 172.21.15.19:0/1963493865 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde040041d0 con 0x7fde180d4fd0 2024-09-12T01:58:34.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.873+0000 7fde177fe640 1 -- 172.21.15.19:0/1963493865 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde04003610 con 0x7fde180d4fd0 2024-09-12T01:58:34.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.874+0000 7fde1eed0640 1 -- 172.21.15.19:0/1963493865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde180d4fd0 msgr2=0x7fde180cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.874+0000 7fde1eed0640 1 --2- 172.21.15.19:0/1963493865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde180d4fd0 0x7fde180cf5b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fde1808ca50 tx=0x7fde0402a180 comp rx=0 tx=0).stop 2024-09-12T01:58:34.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.874+0000 7fde1eed0640 1 -- 172.21.15.19:0/1963493865 shutdown_connections 2024-09-12T01:58:34.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.874+0000 7fde1eed0640 1 --2- 172.21.15.19:0/1963493865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde180d4fd0 0x7fde180cf5b0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.874+0000 7fde1eed0640 1 --2- 172.21.15.19:0/1963493865 >> v2:172.21.15.135:3300/0 conn(0x7fde1815e760 0x7fde1806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.874+0000 7fde1eed0640 1 -- 172.21.15.19:0/1963493865 >> 172.21.15.19:0/1963493865 conn(0x7fde1808bfc0 msgr2=0x7fde180d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:34.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.874+0000 7fde1eed0640 1 -- 172.21.15.19:0/1963493865 shutdown_connections 2024-09-12T01:58:34.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.874+0000 7fde1eed0640 1 -- 172.21.15.19:0/1963493865 wait complete. 2024-09-12T01:58:34.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.875+0000 7fde1eed0640 1 Processor -- start 2024-09-12T01:58:34.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.875+0000 7fde1eed0640 1 -- start start 2024-09-12T01:58:34.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde1eed0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde180b3650 0x7fde181f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde1eed0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde180d4fd0 0x7fde1815da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde1eed0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1815e760 0x7fde180cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde1eed0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fde180cff00 con 0x7fde180b3650 2024-09-12T01:58:34.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde1eed0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fde180cfd80 con 0x7fde180d4fd0 2024-09-12T01:58:34.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde1eed0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fde180d35b0 con 0x7fde1815e760 2024-09-12T01:58:34.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde1cc6c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde180b3650 0x7fde181f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde1cc6c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde180b3650 0x7fde181f4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35892/0 (socket says 172.21.15.19:35892) 2024-09-12T01:58:34.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde1cc6c640 1 -- 172.21.15.19:0/2533252321 learned_addr learned my addr 172.21.15.19:0/2533252321 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:34.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde1d46d640 1 --2- 172.21.15.19:0/2533252321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1815e760 0x7fde180cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde17fff640 1 --2- 172.21.15.19:0/2533252321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde180d4fd0 0x7fde1815da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde1cc6c640 1 -- 172.21.15.19:0/2533252321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1815e760 msgr2=0x7fde180cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde1cc6c640 1 --2- 172.21.15.19:0/2533252321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1815e760 0x7fde180cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde1cc6c640 1 -- 172.21.15.19:0/2533252321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde180d4fd0 msgr2=0x7fde1815da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde1cc6c640 1 --2- 172.21.15.19:0/2533252321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde180d4fd0 0x7fde1815da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde1cc6c640 1 -- 172.21.15.19:0/2533252321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde181f7f90 con 0x7fde180b3650 2024-09-12T01:58:34.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde1cc6c640 1 --2- 172.21.15.19:0/2533252321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde180b3650 0x7fde181f4f40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fde0c00c820 tx=0x7fde0c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde157fa640 1 -- 172.21.15.19:0/2533252321 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0c015070 con 0x7fde180b3650 2024-09-12T01:58:34.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde157fa640 1 -- 172.21.15.19:0/2533252321 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde0c007a30 con 0x7fde180b3650 2024-09-12T01:58:34.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde157fa640 1 -- 172.21.15.19:0/2533252321 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0c007de0 con 0x7fde180b3650 2024-09-12T01:58:34.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.876+0000 7fde1eed0640 1 -- 172.21.15.19:0/2533252321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde181f8270 con 0x7fde180b3650 2024-09-12T01:58:34.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.877+0000 7fde1eed0640 1 -- 172.21.15.19:0/2533252321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde181f8830 con 0x7fde180b3650 2024-09-12T01:58:34.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.877+0000 7fde1eed0640 1 -- 172.21.15.19:0/2533252321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde180d3880 con 0x7fde180b3650 2024-09-12T01:58:34.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.878+0000 7fde157fa640 1 -- 172.21.15.19:0/2533252321 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde0c018070 con 0x7fde180b3650 2024-09-12T01:58:34.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.878+0000 7fde157fa640 1 --2- 172.21.15.19:0/2533252321 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fddfc06be30 0x7fddfc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.879+0000 7fde157fa640 1 -- 172.21.15.19:0/2533252321 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6101+0+0 (secure 0 0 0) 0x7fde0c08af10 con 0x7fde180b3650 2024-09-12T01:58:34.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.879+0000 7fde17fff640 1 --2- 172.21.15.19:0/2533252321 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fddfc06be30 0x7fddfc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.879+0000 7fde17fff640 1 --2- 172.21.15.19:0/2533252321 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fddfc06be30 0x7fddfc06e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fde04033000 tx=0x7fde0402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:34.883+0000 7fde157fa640 1 -- 172.21.15.19:0/2533252321 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde0c059730 con 0x7fde180b3650 2024-09-12T01:58:35.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.055+0000 7fde1eed0640 1 -- 172.21.15.19:0/2533252321 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde180d17b0 con 0x7fddfc06be30 2024-09-12T01:58:35.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.061+0000 7fde157fa640 1 -- 172.21.15.19:0/2533252321 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245519 (secure 0 0 0) 0x7fde180d17b0 con 0x7fddfc06be30 2024-09-12T01:58:35.064 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:35.065 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:58:35.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.064+0000 7fde1eed0640 1 -- 172.21.15.19:0/2533252321 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fddfc06be30 msgr2=0x7fddfc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:35.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.064+0000 7fde1eed0640 1 --2- 172.21.15.19:0/2533252321 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fddfc06be30 0x7fddfc06e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fde04033000 tx=0x7fde0402e000 comp rx=0 tx=0).stop 2024-09-12T01:58:35.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.064+0000 7fde1eed0640 1 -- 172.21.15.19:0/2533252321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde180b3650 msgr2=0x7fde181f4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:35.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.064+0000 7fde1eed0640 1 --2- 172.21.15.19:0/2533252321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde180b3650 0x7fde181f4f40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fde0c00c820 tx=0x7fde0c00cce0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.064+0000 7fde1eed0640 1 -- 172.21.15.19:0/2533252321 shutdown_connections 2024-09-12T01:58:35.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.064+0000 7fde1eed0640 1 --2- 172.21.15.19:0/2533252321 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fddfc06be30 0x7fddfc06e2f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.064+0000 7fde1eed0640 1 --2- 172.21.15.19:0/2533252321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1815e760 0x7fde180cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.064+0000 7fde1eed0640 1 --2- 172.21.15.19:0/2533252321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde180d4fd0 0x7fde1815da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.064+0000 7fde1eed0640 1 --2- 172.21.15.19:0/2533252321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde180b3650 0x7fde181f4f40 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.064+0000 7fde1eed0640 1 -- 172.21.15.19:0/2533252321 >> 172.21.15.19:0/2533252321 conn(0x7fde1808bfc0 msgr2=0x7fde180b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:35.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.064+0000 7fde1eed0640 1 -- 172.21.15.19:0/2533252321 shutdown_connections 2024-09-12T01:58:35.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.064+0000 7fde1eed0640 1 -- 172.21.15.19:0/2533252321 wait complete. 2024-09-12T01:58:35.075 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-09-12T01:58:34.120978+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592562,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":106,"acting":106,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":231732,"kb_used_data":7148,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742988,"statfs":{"total":773094113280,"available":772856819712,"internally_reserved":0,"allocated":7319552,"data_stored":3937648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2194,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.060490"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102871+0000","last_change":"2024-09-12T01:58:32.098775+0000","last_active":"2024-09-12T01:58:32.102871+0000","last_peered":"2024-09-12T01:58:32.102871+0000","last_clean":"2024-09-12T01:58:32.102871+0000","last_became_active":"2024-09-12T01:58:32.098472+0000","last_became_peered":"2024-09-12T01:58:32.098472+0000","last_unstale":"2024-09-12T01:58:32.102871+0000","last_undegraded":"2024-09-12T01:58:32.102871+0000","last_fullsized":"2024-09-12T01:58:32.102871+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:25.908231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098986+0000","last_change":"2024-09-12T01:58:32.092794+0000","last_active":"2024-09-12T01:58:32.098986+0000","last_peered":"2024-09-12T01:58:32.098986+0000","last_clean":"2024-09-12T01:58:32.098986+0000","last_became_active":"2024-09-12T01:58:32.092525+0000","last_became_peered":"2024-09-12T01:58:32.092525+0000","last_unstale":"2024-09-12T01:58:32.098986+0000","last_undegraded":"2024-09-12T01:58:32.098986+0000","last_fullsized":"2024-09-12T01:58:32.098986+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:38.945135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088755+0000","last_change":"2024-09-12T01:58:32.086522+0000","last_active":"2024-09-12T01:58:32.088755+0000","last_peered":"2024-09-12T01:58:32.088755+0000","last_clean":"2024-09-12T01:58:32.088755+0000","last_became_active":"2024-09-12T01:58:32.086029+0000","last_became_peered":"2024-09-12T01:58:32.086029+0000","last_unstale":"2024-09-12T01:58:32.088755+0000","last_undegraded":"2024-09-12T01:58:32.088755+0000","last_fullsized":"2024-09-12T01:58:32.088755+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:09.934393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072181+0000","last_change":"2024-09-12T01:58:32.090868+0000","last_active":"2024-09-12T01:58:33.072181+0000","last_peered":"2024-09-12T01:58:33.072181+0000","last_clean":"2024-09-12T01:58:33.072181+0000","last_became_active":"2024-09-12T01:58:32.090596+0000","last_became_peered":"2024-09-12T01:58:32.090596+0000","last_unstale":"2024-09-12T01:58:33.072181+0000","last_undegraded":"2024-09-12T01:58:33.072181+0000","last_fullsized":"2024-09-12T01:58:33.072181+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:19.012343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.092799+0000","last_change":"2024-09-12T01:58:32.091013+0000","last_active":"2024-09-12T01:58:32.092799+0000","last_peered":"2024-09-12T01:58:32.092799+0000","last_clean":"2024-09-12T01:58:32.092799+0000","last_became_active":"2024-09-12T01:58:32.090711+0000","last_became_peered":"2024-09-12T01:58:32.090711+0000","last_unstale":"2024-09-12T01:58:32.092799+0000","last_undegraded":"2024-09-12T01:58:32.092799+0000","last_fullsized":"2024-09-12T01:58:32.092799+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:16.569815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098161+0000","last_change":"2024-09-12T01:58:32.093435+0000","last_active":"2024-09-12T01:58:32.098161+0000","last_peered":"2024-09-12T01:58:32.098161+0000","last_clean":"2024-09-12T01:58:32.098161+0000","last_became_active":"2024-09-12T01:58:32.092950+0000","last_became_peered":"2024-09-12T01:58:32.092950+0000","last_unstale":"2024-09-12T01:58:32.098161+0000","last_undegraded":"2024-09-12T01:58:32.098161+0000","last_fullsized":"2024-09-12T01:58:32.098161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:38.945135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098644+0000","last_change":"2024-09-12T01:58:32.092337+0000","last_active":"2024-09-12T01:58:32.098644+0000","last_peered":"2024-09-12T01:58:32.098644+0000","last_clean":"2024-09-12T01:58:32.098644+0000","last_became_active":"2024-09-12T01:58:32.091794+0000","last_became_peered":"2024-09-12T01:58:32.091794+0000","last_unstale":"2024-09-12T01:58:32.098644+0000","last_undegraded":"2024-09-12T01:58:32.098644+0000","last_fullsized":"2024-09-12T01:58:32.098644+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:03.685856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102947+0000","last_change":"2024-09-12T01:58:32.099798+0000","last_active":"2024-09-12T01:58:32.102947+0000","last_peered":"2024-09-12T01:58:32.102947+0000","last_clean":"2024-09-12T01:58:32.102947+0000","last_became_active":"2024-09-12T01:58:32.099440+0000","last_became_peered":"2024-09-12T01:58:32.099440+0000","last_unstale":"2024-09-12T01:58:32.102947+0000","last_undegraded":"2024-09-12T01:58:32.102947+0000","last_fullsized":"2024-09-12T01:58:32.102947+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:12.553586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088709+0000","last_change":"2024-09-12T01:58:32.086299+0000","last_active":"2024-09-12T01:58:32.088709+0000","last_peered":"2024-09-12T01:58:32.088709+0000","last_clean":"2024-09-12T01:58:32.088709+0000","last_became_active":"2024-09-12T01:58:32.085968+0000","last_became_peered":"2024-09-12T01:58:32.085968+0000","last_unstale":"2024-09-12T01:58:32.088709+0000","last_undegraded":"2024-09-12T01:58:32.088709+0000","last_fullsized":"2024-09-12T01:58:32.088709+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:14.575171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.092452+0000","last_change":"2024-09-12T01:58:32.089658+0000","last_active":"2024-09-12T01:58:32.092452+0000","last_peered":"2024-09-12T01:58:32.092452+0000","last_clean":"2024-09-12T01:58:32.092452+0000","last_became_active":"2024-09-12T01:58:32.089374+0000","last_became_peered":"2024-09-12T01:58:32.089374+0000","last_unstale":"2024-09-12T01:58:32.092452+0000","last_undegraded":"2024-09-12T01:58:32.092452+0000","last_fullsized":"2024-09-12T01:58:32.092452+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:21.967038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.093607+0000","last_change":"2024-09-12T01:58:32.091442+0000","last_active":"2024-09-12T01:58:32.093607+0000","last_peered":"2024-09-12T01:58:32.093607+0000","last_clean":"2024-09-12T01:58:32.093607+0000","last_became_active":"2024-09-12T01:58:32.091113+0000","last_became_peered":"2024-09-12T01:58:32.091113+0000","last_unstale":"2024-09-12T01:58:32.093607+0000","last_undegraded":"2024-09-12T01:58:32.093607+0000","last_fullsized":"2024-09-12T01:58:32.093607+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:29.150750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.092420+0000","last_change":"2024-09-12T01:58:32.090771+0000","last_active":"2024-09-12T01:58:32.092420+0000","last_peered":"2024-09-12T01:58:32.092420+0000","last_clean":"2024-09-12T01:58:32.092420+0000","last_became_active":"2024-09-12T01:58:32.090506+0000","last_became_peered":"2024-09-12T01:58:32.090506+0000","last_unstale":"2024-09-12T01:58:32.092420+0000","last_undegraded":"2024-09-12T01:58:32.092420+0000","last_fullsized":"2024-09-12T01:58:32.092420+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:21.707987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098121+0000","last_change":"2024-09-12T01:58:32.088553+0000","last_active":"2024-09-12T01:58:32.098121+0000","last_peered":"2024-09-12T01:58:32.098121+0000","last_clean":"2024-09-12T01:58:32.098121+0000","last_became_active":"2024-09-12T01:58:32.087827+0000","last_became_peered":"2024-09-12T01:58:32.087827+0000","last_unstale":"2024-09-12T01:58:32.098121+0000","last_undegraded":"2024-09-12T01:58:32.098121+0000","last_fullsized":"2024-09-12T01:58:32.098121+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:11.421763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102392+0000","last_change":"2024-09-12T01:58:32.095548+0000","last_active":"2024-09-12T01:58:32.102392+0000","last_peered":"2024-09-12T01:58:32.102392+0000","last_clean":"2024-09-12T01:58:32.102392+0000","last_became_active":"2024-09-12T01:58:32.094714+0000","last_became_peered":"2024-09-12T01:58:32.094714+0000","last_unstale":"2024-09-12T01:58:32.102392+0000","last_undegraded":"2024-09-12T01:58:32.102392+0000","last_fullsized":"2024-09-12T01:58:32.102392+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:13.252384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098544+0000","last_change":"2024-09-12T01:58:32.088560+0000","last_active":"2024-09-12T01:58:32.098544+0000","last_peered":"2024-09-12T01:58:32.098544+0000","last_clean":"2024-09-12T01:58:32.098544+0000","last_became_active":"2024-09-12T01:58:32.088317+0000","last_became_peered":"2024-09-12T01:58:32.088317+0000","last_unstale":"2024-09-12T01:58:32.098544+0000","last_undegraded":"2024-09-12T01:58:32.098544+0000","last_fullsized":"2024-09-12T01:58:32.098544+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:22.352441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071936+0000","last_change":"2024-09-12T01:58:32.085708+0000","last_active":"2024-09-12T01:58:33.071936+0000","last_peered":"2024-09-12T01:58:33.071936+0000","last_clean":"2024-09-12T01:58:33.071936+0000","last_became_active":"2024-09-12T01:58:32.085394+0000","last_became_peered":"2024-09-12T01:58:32.085394+0000","last_unstale":"2024-09-12T01:58:33.071936+0000","last_undegraded":"2024-09-12T01:58:33.071936+0000","last_fullsized":"2024-09-12T01:58:33.071936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:02.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"65'4","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.101459+0000","last_change":"2024-09-12T01:58:31.085572+0000","last_active":"2024-09-12T01:58:32.101459+0000","last_peered":"2024-09-12T01:58:32.101459+0000","last_clean":"2024-09-12T01:58:32.101459+0000","last_became_active":"2024-09-12T01:58:31.085308+0000","last_became_peered":"2024-09-12T01:58:31.085308+0000","last_unstale":"2024-09-12T01:58:32.101459+0000","last_undegraded":"2024-09-12T01:58:32.101459+0000","last_fullsized":"2024-09-12T01:58:32.101459+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:47.308955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098144+0000","last_change":"2024-09-12T01:58:32.093055+0000","last_active":"2024-09-12T01:58:32.098144+0000","last_peered":"2024-09-12T01:58:32.098144+0000","last_clean":"2024-09-12T01:58:32.098144+0000","last_became_active":"2024-09-12T01:58:32.092801+0000","last_became_peered":"2024-09-12T01:58:32.092801+0000","last_unstale":"2024-09-12T01:58:32.098144+0000","last_undegraded":"2024-09-12T01:58:32.098144+0000","last_fullsized":"2024-09-12T01:58:32.098144+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:48.314232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072473+0000","last_change":"2024-09-12T01:58:31.082993+0000","last_active":"2024-09-12T01:58:33.072473+0000","last_peered":"2024-09-12T01:58:33.072473+0000","last_clean":"2024-09-12T01:58:33.072473+0000","last_became_active":"2024-09-12T01:58:31.082679+0000","last_became_peered":"2024-09-12T01:58:31.082679+0000","last_unstale":"2024-09-12T01:58:33.072473+0000","last_undegraded":"2024-09-12T01:58:33.072473+0000","last_fullsized":"2024-09-12T01:58:33.072473+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:16.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072371+0000","last_change":"2024-09-12T01:58:32.078918+0000","last_active":"2024-09-12T01:58:33.072371+0000","last_peered":"2024-09-12T01:58:33.072371+0000","last_clean":"2024-09-12T01:58:33.072371+0000","last_became_active":"2024-09-12T01:58:32.078659+0000","last_became_peered":"2024-09-12T01:58:32.078659+0000","last_unstale":"2024-09-12T01:58:33.072371+0000","last_undegraded":"2024-09-12T01:58:33.072371+0000","last_fullsized":"2024-09-12T01:58:33.072371+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:02.012816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072329+0000","last_change":"2024-09-12T01:58:31.085752+0000","last_active":"2024-09-12T01:58:33.072329+0000","last_peered":"2024-09-12T01:58:33.072329+0000","last_clean":"2024-09-12T01:58:33.072329+0000","last_became_active":"2024-09-12T01:58:31.085456+0000","last_became_peered":"2024-09-12T01:58:31.085456+0000","last_unstale":"2024-09-12T01:58:33.072329+0000","last_undegraded":"2024-09-12T01:58:33.072329+0000","last_fullsized":"2024-09-12T01:58:33.072329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:44.704921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072133+0000","last_change":"2024-09-12T01:58:31.082135+0000","last_active":"2024-09-12T01:58:33.072133+0000","last_peered":"2024-09-12T01:58:33.072133+0000","last_clean":"2024-09-12T01:58:33.072133+0000","last_became_active":"2024-09-12T01:58:31.081834+0000","last_became_peered":"2024-09-12T01:58:31.081834+0000","last_unstale":"2024-09-12T01:58:33.072133+0000","last_undegraded":"2024-09-12T01:58:33.072133+0000","last_fullsized":"2024-09-12T01:58:33.072133+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:59.204264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098668+0000","last_change":"2024-09-12T01:58:32.092057+0000","last_active":"2024-09-12T01:58:32.098668+0000","last_peered":"2024-09-12T01:58:32.098668+0000","last_clean":"2024-09-12T01:58:32.098668+0000","last_became_active":"2024-09-12T01:58:32.091372+0000","last_became_peered":"2024-09-12T01:58:32.091372+0000","last_unstale":"2024-09-12T01:58:32.098668+0000","last_undegraded":"2024-09-12T01:58:32.098668+0000","last_fullsized":"2024-09-12T01:58:32.098668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:55.460525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"65'1","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088984+0000","last_change":"2024-09-12T01:58:31.085302+0000","last_active":"2024-09-12T01:58:32.088984+0000","last_peered":"2024-09-12T01:58:32.088984+0000","last_clean":"2024-09-12T01:58:32.088984+0000","last_became_active":"2024-09-12T01:58:31.084995+0000","last_became_peered":"2024-09-12T01:58:31.084995+0000","last_unstale":"2024-09-12T01:58:32.088984+0000","last_undegraded":"2024-09-12T01:58:32.088984+0000","last_fullsized":"2024-09-12T01:58:32.088984+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:18.228685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102960+0000","last_change":"2024-09-12T01:58:32.099965+0000","last_active":"2024-09-12T01:58:32.102960+0000","last_peered":"2024-09-12T01:58:32.102960+0000","last_clean":"2024-09-12T01:58:32.102960+0000","last_became_active":"2024-09-12T01:58:32.099518+0000","last_became_peered":"2024-09-12T01:58:32.099518+0000","last_unstale":"2024-09-12T01:58:32.102960+0000","last_undegraded":"2024-09-12T01:58:32.102960+0000","last_fullsized":"2024-09-12T01:58:32.102960+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:27.155936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"65'1","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.091456+0000","last_change":"2024-09-12T01:58:31.086015+0000","last_active":"2024-09-12T01:58:32.091456+0000","last_peered":"2024-09-12T01:58:32.091456+0000","last_clean":"2024-09-12T01:58:32.091456+0000","last_became_active":"2024-09-12T01:58:31.085736+0000","last_became_peered":"2024-09-12T01:58:31.085736+0000","last_unstale":"2024-09-12T01:58:32.091456+0000","last_undegraded":"2024-09-12T01:58:32.091456+0000","last_fullsized":"2024-09-12T01:58:32.091456+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:58.281292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.076913+0000","last_change":"2024-09-12T01:58:31.078913+0000","last_active":"2024-09-12T01:58:32.076913+0000","last_peered":"2024-09-12T01:58:32.076913+0000","last_clean":"2024-09-12T01:58:32.076913+0000","last_became_active":"2024-09-12T01:58:31.078594+0000","last_became_peered":"2024-09-12T01:58:31.078594+0000","last_unstale":"2024-09-12T01:58:32.076913+0000","last_undegraded":"2024-09-12T01:58:32.076913+0000","last_fullsized":"2024-09-12T01:58:32.076913+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:32.332146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.086767+0000","last_change":"2024-09-12T01:58:32.082690+0000","last_active":"2024-09-12T01:58:32.086767+0000","last_peered":"2024-09-12T01:58:32.086767+0000","last_clean":"2024-09-12T01:58:32.086767+0000","last_became_active":"2024-09-12T01:58:32.082372+0000","last_became_peered":"2024-09-12T01:58:32.082372+0000","last_unstale":"2024-09-12T01:58:32.086767+0000","last_undegraded":"2024-09-12T01:58:32.086767+0000","last_fullsized":"2024-09-12T01:58:32.086767+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:47.657299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102369+0000","last_change":"2024-09-12T01:58:32.095478+0000","last_active":"2024-09-12T01:58:32.102369+0000","last_peered":"2024-09-12T01:58:32.102369+0000","last_clean":"2024-09-12T01:58:32.102369+0000","last_became_active":"2024-09-12T01:58:32.094996+0000","last_became_peered":"2024-09-12T01:58:32.094996+0000","last_unstale":"2024-09-12T01:58:32.102369+0000","last_undegraded":"2024-09-12T01:58:32.102369+0000","last_fullsized":"2024-09-12T01:58:32.102369+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.009280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.101344+0000","last_change":"2024-09-12T01:58:32.093516+0000","last_active":"2024-09-12T01:58:32.101344+0000","last_peered":"2024-09-12T01:58:32.101344+0000","last_clean":"2024-09-12T01:58:32.101344+0000","last_became_active":"2024-09-12T01:58:32.093213+0000","last_became_peered":"2024-09-12T01:58:32.093213+0000","last_unstale":"2024-09-12T01:58:32.101344+0000","last_undegraded":"2024-09-12T01:58:32.101344+0000","last_fullsized":"2024-09-12T01:58:32.101344+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:18.062819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.075513+0000","last_change":"2024-09-12T01:58:31.076858+0000","last_active":"2024-09-12T01:58:32.075513+0000","last_peered":"2024-09-12T01:58:32.075513+0000","last_clean":"2024-09-12T01:58:32.075513+0000","last_became_active":"2024-09-12T01:58:31.076593+0000","last_became_peered":"2024-09-12T01:58:31.076593+0000","last_unstale":"2024-09-12T01:58:32.075513+0000","last_undegraded":"2024-09-12T01:58:32.075513+0000","last_fullsized":"2024-09-12T01:58:32.075513+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:30.358255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088733+0000","last_change":"2024-09-12T01:58:32.086718+0000","last_active":"2024-09-12T01:58:32.088733+0000","last_peered":"2024-09-12T01:58:32.088733+0000","last_clean":"2024-09-12T01:58:32.088733+0000","last_became_active":"2024-09-12T01:58:32.086444+0000","last_became_peered":"2024-09-12T01:58:32.086444+0000","last_unstale":"2024-09-12T01:58:32.088733+0000","last_undegraded":"2024-09-12T01:58:32.088733+0000","last_fullsized":"2024-09-12T01:58:32.088733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:25.413262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"65'6","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.108469+0000","last_change":"2024-09-12T01:58:31.079583+0000","last_active":"2024-09-12T01:58:32.108469+0000","last_peered":"2024-09-12T01:58:32.108469+0000","last_clean":"2024-09-12T01:58:32.108469+0000","last_became_active":"2024-09-12T01:58:31.079317+0000","last_became_peered":"2024-09-12T01:58:31.079317+0000","last_unstale":"2024-09-12T01:58:32.108469+0000","last_undegraded":"2024-09-12T01:58:32.108469+0000","last_fullsized":"2024-09-12T01:58:32.108469+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:33.047976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.100470+0000","last_change":"2024-09-12T01:58:32.097734+0000","last_active":"2024-09-12T01:58:32.100470+0000","last_peered":"2024-09-12T01:58:32.100470+0000","last_clean":"2024-09-12T01:58:32.100470+0000","last_became_active":"2024-09-12T01:58:32.095245+0000","last_became_peered":"2024-09-12T01:58:32.095245+0000","last_unstale":"2024-09-12T01:58:32.100470+0000","last_undegraded":"2024-09-12T01:58:32.100470+0000","last_fullsized":"2024-09-12T01:58:32.100470+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.009280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.103028+0000","last_change":"2024-09-12T01:58:32.101742+0000","last_active":"2024-09-12T01:58:32.103028+0000","last_peered":"2024-09-12T01:58:32.103028+0000","last_clean":"2024-09-12T01:58:32.103028+0000","last_became_active":"2024-09-12T01:58:32.100985+0000","last_became_peered":"2024-09-12T01:58:32.100985+0000","last_unstale":"2024-09-12T01:58:32.103028+0000","last_undegraded":"2024-09-12T01:58:32.103028+0000","last_fullsized":"2024-09-12T01:58:32.103028+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:06.911951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"65'8","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.097968+0000","last_change":"2024-09-12T01:58:31.080233+0000","last_active":"2024-09-12T01:58:32.097968+0000","last_peered":"2024-09-12T01:58:32.097968+0000","last_clean":"2024-09-12T01:58:32.097968+0000","last_became_active":"2024-09-12T01:58:31.079923+0000","last_became_peered":"2024-09-12T01:58:31.079923+0000","last_unstale":"2024-09-12T01:58:32.097968+0000","last_undegraded":"2024-09-12T01:58:32.097968+0000","last_fullsized":"2024-09-12T01:58:32.097968+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:18.045768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088494+0000","last_change":"2024-09-12T01:58:32.083451+0000","last_active":"2024-09-12T01:58:32.088494+0000","last_peered":"2024-09-12T01:58:32.088494+0000","last_clean":"2024-09-12T01:58:32.088494+0000","last_became_active":"2024-09-12T01:58:32.083176+0000","last_became_peered":"2024-09-12T01:58:32.083176+0000","last_unstale":"2024-09-12T01:58:32.088494+0000","last_undegraded":"2024-09-12T01:58:32.088494+0000","last_fullsized":"2024-09-12T01:58:32.088494+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:29.187288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.077108+0000","last_change":"2024-09-12T01:58:31.074406+0000","last_active":"2024-09-12T01:58:32.077108+0000","last_peered":"2024-09-12T01:58:32.077108+0000","last_clean":"2024-09-12T01:58:32.077108+0000","last_became_active":"2024-09-12T01:58:31.074068+0000","last_became_peered":"2024-09-12T01:58:31.074068+0000","last_unstale":"2024-09-12T01:58:32.077108+0000","last_undegraded":"2024-09-12T01:58:32.077108+0000","last_fullsized":"2024-09-12T01:58:32.077108+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:26.113685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071998+0000","last_change":"2024-09-12T01:58:32.078981+0000","last_active":"2024-09-12T01:58:33.071998+0000","last_peered":"2024-09-12T01:58:33.071998+0000","last_clean":"2024-09-12T01:58:33.071998+0000","last_became_active":"2024-09-12T01:58:32.078680+0000","last_became_peered":"2024-09-12T01:58:32.078680+0000","last_unstale":"2024-09-12T01:58:33.071998+0000","last_undegraded":"2024-09-12T01:58:33.071998+0000","last_fullsized":"2024-09-12T01:58:33.071998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:11.561895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072046+0000","last_change":"2024-09-12T01:58:31.084085+0000","last_active":"2024-09-12T01:58:33.072046+0000","last_peered":"2024-09-12T01:58:33.072046+0000","last_clean":"2024-09-12T01:58:33.072046+0000","last_became_active":"2024-09-12T01:58:31.083740+0000","last_became_peered":"2024-09-12T01:58:31.083740+0000","last_unstale":"2024-09-12T01:58:33.072046+0000","last_undegraded":"2024-09-12T01:58:33.072046+0000","last_fullsized":"2024-09-12T01:58:33.072046+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:23.301991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071936+0000","last_change":"2024-09-12T01:58:31.079762+0000","last_active":"2024-09-12T01:58:33.071936+0000","last_peered":"2024-09-12T01:58:33.071936+0000","last_clean":"2024-09-12T01:58:33.071936+0000","last_became_active":"2024-09-12T01:58:31.079490+0000","last_became_peered":"2024-09-12T01:58:31.079490+0000","last_unstale":"2024-09-12T01:58:33.071936+0000","last_undegraded":"2024-09-12T01:58:33.071936+0000","last_fullsized":"2024-09-12T01:58:33.071936+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:40.366109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072065+0000","last_change":"2024-09-12T01:58:32.088285+0000","last_active":"2024-09-12T01:58:33.072065+0000","last_peered":"2024-09-12T01:58:33.072065+0000","last_clean":"2024-09-12T01:58:33.072065+0000","last_became_active":"2024-09-12T01:58:32.087918+0000","last_became_peered":"2024-09-12T01:58:32.087918+0000","last_unstale":"2024-09-12T01:58:33.072065+0000","last_undegraded":"2024-09-12T01:58:33.072065+0000","last_fullsized":"2024-09-12T01:58:33.072065+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:19.787633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.090260+0000","last_change":"2024-09-12T01:58:32.084136+0000","last_active":"2024-09-12T01:58:32.090260+0000","last_peered":"2024-09-12T01:58:32.090260+0000","last_clean":"2024-09-12T01:58:32.090260+0000","last_became_active":"2024-09-12T01:58:32.083827+0000","last_became_peered":"2024-09-12T01:58:32.083827+0000","last_unstale":"2024-09-12T01:58:32.090260+0000","last_undegraded":"2024-09-12T01:58:32.090260+0000","last_fullsized":"2024-09-12T01:58:32.090260+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:25.550979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072377+0000","last_change":"2024-09-12T01:58:31.086458+0000","last_active":"2024-09-12T01:58:33.072377+0000","last_peered":"2024-09-12T01:58:33.072377+0000","last_clean":"2024-09-12T01:58:33.072377+0000","last_became_active":"2024-09-12T01:58:31.086155+0000","last_became_peered":"2024-09-12T01:58:31.086155+0000","last_unstale":"2024-09-12T01:58:33.072377+0000","last_undegraded":"2024-09-12T01:58:33.072377+0000","last_fullsized":"2024-09-12T01:58:33.072377+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:58.472371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.079990+0000","last_change":"2024-09-12T01:58:31.077535+0000","last_active":"2024-09-12T01:58:32.079990+0000","last_peered":"2024-09-12T01:58:32.079990+0000","last_clean":"2024-09-12T01:58:32.079990+0000","last_became_active":"2024-09-12T01:58:31.077058+0000","last_became_peered":"2024-09-12T01:58:31.077058+0000","last_unstale":"2024-09-12T01:58:32.079990+0000","last_undegraded":"2024-09-12T01:58:32.079990+0000","last_fullsized":"2024-09-12T01:58:32.079990+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:10.416486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098577+0000","last_change":"2024-09-12T01:58:32.089933+0000","last_active":"2024-09-12T01:58:32.098577+0000","last_peered":"2024-09-12T01:58:32.098577+0000","last_clean":"2024-09-12T01:58:32.098577+0000","last_became_active":"2024-09-12T01:58:32.089694+0000","last_became_peered":"2024-09-12T01:58:32.089694+0000","last_unstale":"2024-09-12T01:58:32.098577+0000","last_undegraded":"2024-09-12T01:58:32.098577+0000","last_fullsized":"2024-09-12T01:58:32.098577+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:34.053253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.076856+0000","last_change":"2024-09-12T01:58:31.076859+0000","last_active":"2024-09-12T01:58:32.076856+0000","last_peered":"2024-09-12T01:58:32.076856+0000","last_clean":"2024-09-12T01:58:32.076856+0000","last_became_active":"2024-09-12T01:58:31.076488+0000","last_became_peered":"2024-09-12T01:58:31.076488+0000","last_unstale":"2024-09-12T01:58:32.076856+0000","last_undegraded":"2024-09-12T01:58:32.076856+0000","last_fullsized":"2024-09-12T01:58:32.076856+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:47.205697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102944+0000","last_change":"2024-09-12T01:58:32.099717+0000","last_active":"2024-09-12T01:58:32.102944+0000","last_peered":"2024-09-12T01:58:32.102944+0000","last_clean":"2024-09-12T01:58:32.102944+0000","last_became_active":"2024-09-12T01:58:32.099398+0000","last_became_peered":"2024-09-12T01:58:32.099398+0000","last_unstale":"2024-09-12T01:58:32.102944+0000","last_undegraded":"2024-09-12T01:58:32.102944+0000","last_fullsized":"2024-09-12T01:58:32.102944+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:53.481574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.077079+0000","last_change":"2024-09-12T01:58:31.078174+0000","last_active":"2024-09-12T01:58:32.077079+0000","last_peered":"2024-09-12T01:58:32.077079+0000","last_clean":"2024-09-12T01:58:32.077079+0000","last_became_active":"2024-09-12T01:58:31.077722+0000","last_became_peered":"2024-09-12T01:58:31.077722+0000","last_unstale":"2024-09-12T01:58:32.077079+0000","last_undegraded":"2024-09-12T01:58:32.077079+0000","last_fullsized":"2024-09-12T01:58:32.077079+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:04.459773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098702+0000","last_change":"2024-09-12T01:58:32.092706+0000","last_active":"2024-09-12T01:58:32.098702+0000","last_peered":"2024-09-12T01:58:32.098702+0000","last_clean":"2024-09-12T01:58:32.098702+0000","last_became_active":"2024-09-12T01:58:32.092407+0000","last_became_peered":"2024-09-12T01:58:32.092407+0000","last_unstale":"2024-09-12T01:58:32.098702+0000","last_undegraded":"2024-09-12T01:58:32.098702+0000","last_fullsized":"2024-09-12T01:58:32.098702+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:28.935380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.079005+0000","last_change":"2024-09-12T01:58:31.083451+0000","last_active":"2024-09-12T01:58:32.079005+0000","last_peered":"2024-09-12T01:58:32.079005+0000","last_clean":"2024-09-12T01:58:32.079005+0000","last_became_active":"2024-09-12T01:58:31.083133+0000","last_became_peered":"2024-09-12T01:58:31.083133+0000","last_unstale":"2024-09-12T01:58:32.079005+0000","last_undegraded":"2024-09-12T01:58:32.079005+0000","last_fullsized":"2024-09-12T01:58:32.079005+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:21.347164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.076598+0000","last_change":"2024-09-12T01:58:31.084470+0000","last_active":"2024-09-12T01:58:32.076598+0000","last_peered":"2024-09-12T01:58:32.076598+0000","last_clean":"2024-09-12T01:58:32.076598+0000","last_became_active":"2024-09-12T01:58:31.084172+0000","last_became_peered":"2024-09-12T01:58:31.084172+0000","last_unstale":"2024-09-12T01:58:32.076598+0000","last_undegraded":"2024-09-12T01:58:32.076598+0000","last_fullsized":"2024-09-12T01:58:32.076598+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:29.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":243,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-12T01:58:28.469115+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:58:28.469115+0000","last_peered":"2024-09-12T01:58:28.469115+0000","last_clean":"2024-09-12T01:58:28.469115+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:58:28.469115+0000","last_undegraded":"2024-09-12T01:58:28.469115+0000","last_fullsized":"2024-09-12T01:58:28.469115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":66,"acting":66,"num_store_stats":5},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2194,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":38,"acting":38,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1335296,"data_stored":923059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27764,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":741376,"data_stored":332691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":332691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542182,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":778240,"data_stored":352726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":778240,"data_stored":352726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":806912,"data_stored":355102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542182,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1372160,"data_stored":943094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":765952,"data_stored":345559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:58:35.080 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:58:35.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.217+0000 7fd542de4640 1 Processor -- start 2024-09-12T01:58:35.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.217+0000 7fd542de4640 1 -- start start 2024-09-12T01:58:35.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.218+0000 7fd542de4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd53c161c80 0x7fd53c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.218+0000 7fd542de4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd53c0b6680 0x7fd53c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.218+0000 7fd542de4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd53c06e870 con 0x7fd53c162060 2024-09-12T01:58:35.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.218+0000 7fd542de4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd53c06d9f0 con 0x7fd53c0b6680 2024-09-12T01:58:35.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.218+0000 7fd542de4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd53c06dcd0 con 0x7fd53c161c80 2024-09-12T01:58:35.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.218+0000 7fd541381640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd53c0b6680 0x7fd53c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:35.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.218+0000 7fd53bfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd53c162060 0x7fd53c0b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38352/0 (socket says 172.21.15.19:38352) 2024-09-12T01:58:35.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.218+0000 7fd53bfff640 1 -- 172.21.15.19:0/2489747647 learned_addr learned my addr 172.21.15.19:0/2489747647 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:35.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.218+0000 7fd541381640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd53c0b6680 0x7fd53c0cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35894/0 (socket says 172.21.15.19:35894) 2024-09-12T01:58:35.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.219+0000 7fd540b80640 1 --2- 172.21.15.19:0/2489747647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd53c161c80 0x7fd53c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:35.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.219+0000 7fd541381640 1 -- 172.21.15.19:0/2489747647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd53c161c80 msgr2=0x7fd53c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:35.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.219+0000 7fd541381640 1 --2- 172.21.15.19:0/2489747647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd53c161c80 0x7fd53c06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.219+0000 7fd541381640 1 -- 172.21.15.19:0/2489747647 >> v1:172.21.15.19:6789/0 conn(0x7fd53c162060 legacy=0x7fd53c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:35.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.219+0000 7fd53b7fe640 1 -- 172.21.15.19:0/2489747647 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4193136780 0 0) 0x7fd530001110 con 0x7fd53c162060 2024-09-12T01:58:35.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.219+0000 7fd541381640 1 -- 172.21.15.19:0/2489747647 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53c06dfb0 con 0x7fd53c0b6680 2024-09-12T01:58:35.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.219+0000 7fd540b80640 1 --2- 172.21.15.19:0/2489747647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd53c161c80 0x7fd53c06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:35.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.219+0000 7fd541381640 1 --2- 172.21.15.19:0/2489747647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53c0b6680 0x7fd53c0cf1e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd534009d90 tx=0x7fd53402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de4d600ddaa1842 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:35.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.219+0000 7fd53b7fe640 1 -- 172.21.15.19:0/2489747647 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd534007740 con 0x7fd53c0b6680 2024-09-12T01:58:35.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.220+0000 7fd53b7fe640 1 -- 172.21.15.19:0/2489747647 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5340078e0 con 0x7fd53c0b6680 2024-09-12T01:58:35.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.220+0000 7fd53b7fe640 1 -- 172.21.15.19:0/2489747647 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd534007cb0 con 0x7fd53c0b6680 2024-09-12T01:58:35.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.220+0000 7fd542de4640 1 -- 172.21.15.19:0/2489747647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53c0b6680 msgr2=0x7fd53c0cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:35.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.220+0000 7fd542de4640 1 --2- 172.21.15.19:0/2489747647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53c0b6680 0x7fd53c0cf1e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd534009d90 tx=0x7fd53402a680 comp rx=0 tx=0).stop 2024-09-12T01:58:35.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.220+0000 7fd542de4640 1 -- 172.21.15.19:0/2489747647 shutdown_connections 2024-09-12T01:58:35.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.220+0000 7fd542de4640 1 --2- 172.21.15.19:0/2489747647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53c0b6680 0x7fd53c0cf1e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.220+0000 7fd542de4640 1 --2- 172.21.15.19:0/2489747647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd53c161c80 0x7fd53c06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.220+0000 7fd542de4640 1 -- 172.21.15.19:0/2489747647 >> 172.21.15.19:0/2489747647 conn(0x7fd53c0d44f0 msgr2=0x7fd53c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:35.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.220+0000 7fd542de4640 1 -- 172.21.15.19:0/2489747647 shutdown_connections 2024-09-12T01:58:35.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.220+0000 7fd542de4640 1 -- 172.21.15.19:0/2489747647 wait complete. 2024-09-12T01:58:35.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.221+0000 7fd542de4640 1 Processor -- start 2024-09-12T01:58:35.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.221+0000 7fd542de4640 1 -- start start 2024-09-12T01:58:35.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.222+0000 7fd542de4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd53c0b6680 0x7fd53c1566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.222+0000 7fd542de4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd53c161c80 0x7fd53c0b9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.222+0000 7fd542de4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53c162060 0x7fd53c160300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.222+0000 7fd542de4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd53c0b6b30 con 0x7fd53c162060 2024-09-12T01:58:35.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.222+0000 7fd542de4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd53c0d2aa0 con 0x7fd53c161c80 2024-09-12T01:58:35.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.222+0000 7fd542de4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd53c0b6cb0 con 0x7fd53c0b6680 2024-09-12T01:58:35.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.222+0000 7fd541381640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53c162060 0x7fd53c160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:35.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.222+0000 7fd541381640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53c162060 0x7fd53c160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35906/0 (socket says 172.21.15.19:35906) 2024-09-12T01:58:35.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.222+0000 7fd541381640 1 -- 172.21.15.19:0/1469098534 learned_addr learned my addr 172.21.15.19:0/1469098534 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:35.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.223+0000 7fd540b80640 1 --2- 172.21.15.19:0/1469098534 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd53c0b6680 0x7fd53c1566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:35.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.223+0000 7fd53bfff640 1 --2- 172.21.15.19:0/1469098534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd53c161c80 0x7fd53c0b9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:35.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.223+0000 7fd541381640 1 -- 172.21.15.19:0/1469098534 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd53c0b6680 msgr2=0x7fd53c1566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:35.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.223+0000 7fd541381640 1 --2- 172.21.15.19:0/1469098534 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd53c0b6680 0x7fd53c1566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.223+0000 7fd541381640 1 -- 172.21.15.19:0/1469098534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd53c161c80 msgr2=0x7fd53c0b9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:35.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.223+0000 7fd541381640 1 --2- 172.21.15.19:0/1469098534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd53c161c80 0x7fd53c0b9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.223+0000 7fd541381640 1 -- 172.21.15.19:0/1469098534 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53c0cba50 con 0x7fd53c162060 2024-09-12T01:58:35.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.223+0000 7fd541381640 1 --2- 172.21.15.19:0/1469098534 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53c162060 0x7fd53c160300 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd534009d90 tx=0x7fd534004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:35.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.223+0000 7fd5397fa640 1 -- 172.21.15.19:0/1469098534 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53403f070 con 0x7fd53c162060 2024-09-12T01:58:35.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.223+0000 7fd5397fa640 1 -- 172.21.15.19:0/1469098534 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd534031c40 con 0x7fd53c162060 2024-09-12T01:58:35.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.223+0000 7fd542de4640 1 -- 172.21.15.19:0/1469098534 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd53c0cbd30 con 0x7fd53c162060 2024-09-12T01:58:35.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.223+0000 7fd5397fa640 1 -- 172.21.15.19:0/1469098534 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd534003990 con 0x7fd53c162060 2024-09-12T01:58:35.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.223+0000 7fd542de4640 1 -- 172.21.15.19:0/1469098534 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd53c0cc2f0 con 0x7fd53c162060 2024-09-12T01:58:35.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.224+0000 7fd542de4640 1 -- 172.21.15.19:0/1469098534 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd53c06e330 con 0x7fd53c162060 2024-09-12T01:58:35.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.225+0000 7fd5397fa640 1 -- 172.21.15.19:0/1469098534 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd534003b30 con 0x7fd53c162060 2024-09-12T01:58:35.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.225+0000 7fd5397fa640 1 --2- 172.21.15.19:0/1469098534 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd52806be30 0x7fd52806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.225+0000 7fd5397fa640 1 -- 172.21.15.19:0/1469098534 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6101+0+0 (secure 0 0 0) 0x7fd5340ac160 con 0x7fd53c162060 2024-09-12T01:58:35.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.225+0000 7fd540b80640 1 --2- 172.21.15.19:0/1469098534 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd52806be30 0x7fd52806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:35.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.226+0000 7fd540b80640 1 --2- 172.21.15.19:0/1469098534 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd52806be30 0x7fd52806e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0c7be0 tx=0x7fd52c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:35.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.229+0000 7fd5397fa640 1 -- 172.21.15.19:0/1469098534 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd53407a330 con 0x7fd53c162060 2024-09-12T01:58:35.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.400+0000 7fd542de4640 1 -- 172.21.15.19:0/1469098534 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd53c156c30 con 0x7fd52806be30 2024-09-12T01:58:35.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.407+0000 7fd5397fa640 1 -- 172.21.15.19:0/1469098534 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245519 (secure 0 0 0) 0x7fd52c00f980 con 0x7fd52806be30 2024-09-12T01:58:35.410 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:35.411 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:58:35.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.410+0000 7fd542de4640 1 -- 172.21.15.19:0/1469098534 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd52806be30 msgr2=0x7fd52806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:35.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.410+0000 7fd542de4640 1 --2- 172.21.15.19:0/1469098534 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd52806be30 0x7fd52806e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0c7be0 tx=0x7fd52c008040 comp rx=0 tx=0).stop 2024-09-12T01:58:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.410+0000 7fd542de4640 1 -- 172.21.15.19:0/1469098534 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53c162060 msgr2=0x7fd53c160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.410+0000 7fd542de4640 1 --2- 172.21.15.19:0/1469098534 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53c162060 0x7fd53c160300 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd534009d90 tx=0x7fd534004a40 comp rx=0 tx=0).stop 2024-09-12T01:58:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.410+0000 7fd542de4640 1 -- 172.21.15.19:0/1469098534 shutdown_connections 2024-09-12T01:58:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.410+0000 7fd542de4640 1 --2- 172.21.15.19:0/1469098534 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd52806be30 0x7fd52806e2f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.410+0000 7fd542de4640 1 --2- 172.21.15.19:0/1469098534 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53c162060 0x7fd53c160300 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.410+0000 7fd542de4640 1 --2- 172.21.15.19:0/1469098534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd53c161c80 0x7fd53c0b9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.410+0000 7fd542de4640 1 --2- 172.21.15.19:0/1469098534 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd53c0b6680 0x7fd53c1566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.410+0000 7fd542de4640 1 -- 172.21.15.19:0/1469098534 >> 172.21.15.19:0/1469098534 conn(0x7fd53c0d44f0 msgr2=0x7fd53c0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.410+0000 7fd542de4640 1 -- 172.21.15.19:0/1469098534 shutdown_connections 2024-09-12T01:58:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.410+0000 7fd542de4640 1 -- 172.21.15.19:0/1469098534 wait complete. 2024-09-12T01:58:35.421 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-09-12T01:58:34.120978+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592562,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":106,"acting":106,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":231732,"kb_used_data":7148,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742988,"statfs":{"total":773094113280,"available":772856819712,"internally_reserved":0,"allocated":7319552,"data_stored":3937648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2194,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.060490"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102871+0000","last_change":"2024-09-12T01:58:32.098775+0000","last_active":"2024-09-12T01:58:32.102871+0000","last_peered":"2024-09-12T01:58:32.102871+0000","last_clean":"2024-09-12T01:58:32.102871+0000","last_became_active":"2024-09-12T01:58:32.098472+0000","last_became_peered":"2024-09-12T01:58:32.098472+0000","last_unstale":"2024-09-12T01:58:32.102871+0000","last_undegraded":"2024-09-12T01:58:32.102871+0000","last_fullsized":"2024-09-12T01:58:32.102871+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:25.908231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098986+0000","last_change":"2024-09-12T01:58:32.092794+0000","last_active":"2024-09-12T01:58:32.098986+0000","last_peered":"2024-09-12T01:58:32.098986+0000","last_clean":"2024-09-12T01:58:32.098986+0000","last_became_active":"2024-09-12T01:58:32.092525+0000","last_became_peered":"2024-09-12T01:58:32.092525+0000","last_unstale":"2024-09-12T01:58:32.098986+0000","last_undegraded":"2024-09-12T01:58:32.098986+0000","last_fullsized":"2024-09-12T01:58:32.098986+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:38.945135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088755+0000","last_change":"2024-09-12T01:58:32.086522+0000","last_active":"2024-09-12T01:58:32.088755+0000","last_peered":"2024-09-12T01:58:32.088755+0000","last_clean":"2024-09-12T01:58:32.088755+0000","last_became_active":"2024-09-12T01:58:32.086029+0000","last_became_peered":"2024-09-12T01:58:32.086029+0000","last_unstale":"2024-09-12T01:58:32.088755+0000","last_undegraded":"2024-09-12T01:58:32.088755+0000","last_fullsized":"2024-09-12T01:58:32.088755+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:09.934393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072181+0000","last_change":"2024-09-12T01:58:32.090868+0000","last_active":"2024-09-12T01:58:33.072181+0000","last_peered":"2024-09-12T01:58:33.072181+0000","last_clean":"2024-09-12T01:58:33.072181+0000","last_became_active":"2024-09-12T01:58:32.090596+0000","last_became_peered":"2024-09-12T01:58:32.090596+0000","last_unstale":"2024-09-12T01:58:33.072181+0000","last_undegraded":"2024-09-12T01:58:33.072181+0000","last_fullsized":"2024-09-12T01:58:33.072181+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:19.012343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.092799+0000","last_change":"2024-09-12T01:58:32.091013+0000","last_active":"2024-09-12T01:58:32.092799+0000","last_peered":"2024-09-12T01:58:32.092799+0000","last_clean":"2024-09-12T01:58:32.092799+0000","last_became_active":"2024-09-12T01:58:32.090711+0000","last_became_peered":"2024-09-12T01:58:32.090711+0000","last_unstale":"2024-09-12T01:58:32.092799+0000","last_undegraded":"2024-09-12T01:58:32.092799+0000","last_fullsized":"2024-09-12T01:58:32.092799+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:16.569815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098161+0000","last_change":"2024-09-12T01:58:32.093435+0000","last_active":"2024-09-12T01:58:32.098161+0000","last_peered":"2024-09-12T01:58:32.098161+0000","last_clean":"2024-09-12T01:58:32.098161+0000","last_became_active":"2024-09-12T01:58:32.092950+0000","last_became_peered":"2024-09-12T01:58:32.092950+0000","last_unstale":"2024-09-12T01:58:32.098161+0000","last_undegraded":"2024-09-12T01:58:32.098161+0000","last_fullsized":"2024-09-12T01:58:32.098161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:38.945135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098644+0000","last_change":"2024-09-12T01:58:32.092337+0000","last_active":"2024-09-12T01:58:32.098644+0000","last_peered":"2024-09-12T01:58:32.098644+0000","last_clean":"2024-09-12T01:58:32.098644+0000","last_became_active":"2024-09-12T01:58:32.091794+0000","last_became_peered":"2024-09-12T01:58:32.091794+0000","last_unstale":"2024-09-12T01:58:32.098644+0000","last_undegraded":"2024-09-12T01:58:32.098644+0000","last_fullsized":"2024-09-12T01:58:32.098644+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:03.685856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102947+0000","last_change":"2024-09-12T01:58:32.099798+0000","last_active":"2024-09-12T01:58:32.102947+0000","last_peered":"2024-09-12T01:58:32.102947+0000","last_clean":"2024-09-12T01:58:32.102947+0000","last_became_active":"2024-09-12T01:58:32.099440+0000","last_became_peered":"2024-09-12T01:58:32.099440+0000","last_unstale":"2024-09-12T01:58:32.102947+0000","last_undegraded":"2024-09-12T01:58:32.102947+0000","last_fullsized":"2024-09-12T01:58:32.102947+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:12.553586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088709+0000","last_change":"2024-09-12T01:58:32.086299+0000","last_active":"2024-09-12T01:58:32.088709+0000","last_peered":"2024-09-12T01:58:32.088709+0000","last_clean":"2024-09-12T01:58:32.088709+0000","last_became_active":"2024-09-12T01:58:32.085968+0000","last_became_peered":"2024-09-12T01:58:32.085968+0000","last_unstale":"2024-09-12T01:58:32.088709+0000","last_undegraded":"2024-09-12T01:58:32.088709+0000","last_fullsized":"2024-09-12T01:58:32.088709+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:14.575171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.092452+0000","last_change":"2024-09-12T01:58:32.089658+0000","last_active":"2024-09-12T01:58:32.092452+0000","last_peered":"2024-09-12T01:58:32.092452+0000","last_clean":"2024-09-12T01:58:32.092452+0000","last_became_active":"2024-09-12T01:58:32.089374+0000","last_became_peered":"2024-09-12T01:58:32.089374+0000","last_unstale":"2024-09-12T01:58:32.092452+0000","last_undegraded":"2024-09-12T01:58:32.092452+0000","last_fullsized":"2024-09-12T01:58:32.092452+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:21.967038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.093607+0000","last_change":"2024-09-12T01:58:32.091442+0000","last_active":"2024-09-12T01:58:32.093607+0000","last_peered":"2024-09-12T01:58:32.093607+0000","last_clean":"2024-09-12T01:58:32.093607+0000","last_became_active":"2024-09-12T01:58:32.091113+0000","last_became_peered":"2024-09-12T01:58:32.091113+0000","last_unstale":"2024-09-12T01:58:32.093607+0000","last_undegraded":"2024-09-12T01:58:32.093607+0000","last_fullsized":"2024-09-12T01:58:32.093607+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:29.150750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.092420+0000","last_change":"2024-09-12T01:58:32.090771+0000","last_active":"2024-09-12T01:58:32.092420+0000","last_peered":"2024-09-12T01:58:32.092420+0000","last_clean":"2024-09-12T01:58:32.092420+0000","last_became_active":"2024-09-12T01:58:32.090506+0000","last_became_peered":"2024-09-12T01:58:32.090506+0000","last_unstale":"2024-09-12T01:58:32.092420+0000","last_undegraded":"2024-09-12T01:58:32.092420+0000","last_fullsized":"2024-09-12T01:58:32.092420+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:21.707987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098121+0000","last_change":"2024-09-12T01:58:32.088553+0000","last_active":"2024-09-12T01:58:32.098121+0000","last_peered":"2024-09-12T01:58:32.098121+0000","last_clean":"2024-09-12T01:58:32.098121+0000","last_became_active":"2024-09-12T01:58:32.087827+0000","last_became_peered":"2024-09-12T01:58:32.087827+0000","last_unstale":"2024-09-12T01:58:32.098121+0000","last_undegraded":"2024-09-12T01:58:32.098121+0000","last_fullsized":"2024-09-12T01:58:32.098121+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:11.421763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102392+0000","last_change":"2024-09-12T01:58:32.095548+0000","last_active":"2024-09-12T01:58:32.102392+0000","last_peered":"2024-09-12T01:58:32.102392+0000","last_clean":"2024-09-12T01:58:32.102392+0000","last_became_active":"2024-09-12T01:58:32.094714+0000","last_became_peered":"2024-09-12T01:58:32.094714+0000","last_unstale":"2024-09-12T01:58:32.102392+0000","last_undegraded":"2024-09-12T01:58:32.102392+0000","last_fullsized":"2024-09-12T01:58:32.102392+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:13.252384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098544+0000","last_change":"2024-09-12T01:58:32.088560+0000","last_active":"2024-09-12T01:58:32.098544+0000","last_peered":"2024-09-12T01:58:32.098544+0000","last_clean":"2024-09-12T01:58:32.098544+0000","last_became_active":"2024-09-12T01:58:32.088317+0000","last_became_peered":"2024-09-12T01:58:32.088317+0000","last_unstale":"2024-09-12T01:58:32.098544+0000","last_undegraded":"2024-09-12T01:58:32.098544+0000","last_fullsized":"2024-09-12T01:58:32.098544+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:22.352441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071936+0000","last_change":"2024-09-12T01:58:32.085708+0000","last_active":"2024-09-12T01:58:33.071936+0000","last_peered":"2024-09-12T01:58:33.071936+0000","last_clean":"2024-09-12T01:58:33.071936+0000","last_became_active":"2024-09-12T01:58:32.085394+0000","last_became_peered":"2024-09-12T01:58:32.085394+0000","last_unstale":"2024-09-12T01:58:33.071936+0000","last_undegraded":"2024-09-12T01:58:33.071936+0000","last_fullsized":"2024-09-12T01:58:33.071936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:02.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"65'4","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.101459+0000","last_change":"2024-09-12T01:58:31.085572+0000","last_active":"2024-09-12T01:58:32.101459+0000","last_peered":"2024-09-12T01:58:32.101459+0000","last_clean":"2024-09-12T01:58:32.101459+0000","last_became_active":"2024-09-12T01:58:31.085308+0000","last_became_peered":"2024-09-12T01:58:31.085308+0000","last_unstale":"2024-09-12T01:58:32.101459+0000","last_undegraded":"2024-09-12T01:58:32.101459+0000","last_fullsized":"2024-09-12T01:58:32.101459+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:47.308955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098144+0000","last_change":"2024-09-12T01:58:32.093055+0000","last_active":"2024-09-12T01:58:32.098144+0000","last_peered":"2024-09-12T01:58:32.098144+0000","last_clean":"2024-09-12T01:58:32.098144+0000","last_became_active":"2024-09-12T01:58:32.092801+0000","last_became_peered":"2024-09-12T01:58:32.092801+0000","last_unstale":"2024-09-12T01:58:32.098144+0000","last_undegraded":"2024-09-12T01:58:32.098144+0000","last_fullsized":"2024-09-12T01:58:32.098144+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:48.314232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072473+0000","last_change":"2024-09-12T01:58:31.082993+0000","last_active":"2024-09-12T01:58:33.072473+0000","last_peered":"2024-09-12T01:58:33.072473+0000","last_clean":"2024-09-12T01:58:33.072473+0000","last_became_active":"2024-09-12T01:58:31.082679+0000","last_became_peered":"2024-09-12T01:58:31.082679+0000","last_unstale":"2024-09-12T01:58:33.072473+0000","last_undegraded":"2024-09-12T01:58:33.072473+0000","last_fullsized":"2024-09-12T01:58:33.072473+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:16.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072371+0000","last_change":"2024-09-12T01:58:32.078918+0000","last_active":"2024-09-12T01:58:33.072371+0000","last_peered":"2024-09-12T01:58:33.072371+0000","last_clean":"2024-09-12T01:58:33.072371+0000","last_became_active":"2024-09-12T01:58:32.078659+0000","last_became_peered":"2024-09-12T01:58:32.078659+0000","last_unstale":"2024-09-12T01:58:33.072371+0000","last_undegraded":"2024-09-12T01:58:33.072371+0000","last_fullsized":"2024-09-12T01:58:33.072371+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:02.012816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072329+0000","last_change":"2024-09-12T01:58:31.085752+0000","last_active":"2024-09-12T01:58:33.072329+0000","last_peered":"2024-09-12T01:58:33.072329+0000","last_clean":"2024-09-12T01:58:33.072329+0000","last_became_active":"2024-09-12T01:58:31.085456+0000","last_became_peered":"2024-09-12T01:58:31.085456+0000","last_unstale":"2024-09-12T01:58:33.072329+0000","last_undegraded":"2024-09-12T01:58:33.072329+0000","last_fullsized":"2024-09-12T01:58:33.072329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:44.704921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072133+0000","last_change":"2024-09-12T01:58:31.082135+0000","last_active":"2024-09-12T01:58:33.072133+0000","last_peered":"2024-09-12T01:58:33.072133+0000","last_clean":"2024-09-12T01:58:33.072133+0000","last_became_active":"2024-09-12T01:58:31.081834+0000","last_became_peered":"2024-09-12T01:58:31.081834+0000","last_unstale":"2024-09-12T01:58:33.072133+0000","last_undegraded":"2024-09-12T01:58:33.072133+0000","last_fullsized":"2024-09-12T01:58:33.072133+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:59.204264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098668+0000","last_change":"2024-09-12T01:58:32.092057+0000","last_active":"2024-09-12T01:58:32.098668+0000","last_peered":"2024-09-12T01:58:32.098668+0000","last_clean":"2024-09-12T01:58:32.098668+0000","last_became_active":"2024-09-12T01:58:32.091372+0000","last_became_peered":"2024-09-12T01:58:32.091372+0000","last_unstale":"2024-09-12T01:58:32.098668+0000","last_undegraded":"2024-09-12T01:58:32.098668+0000","last_fullsized":"2024-09-12T01:58:32.098668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:55.460525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"65'1","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088984+0000","last_change":"2024-09-12T01:58:31.085302+0000","last_active":"2024-09-12T01:58:32.088984+0000","last_peered":"2024-09-12T01:58:32.088984+0000","last_clean":"2024-09-12T01:58:32.088984+0000","last_became_active":"2024-09-12T01:58:31.084995+0000","last_became_peered":"2024-09-12T01:58:31.084995+0000","last_unstale":"2024-09-12T01:58:32.088984+0000","last_undegraded":"2024-09-12T01:58:32.088984+0000","last_fullsized":"2024-09-12T01:58:32.088984+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:18.228685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102960+0000","last_change":"2024-09-12T01:58:32.099965+0000","last_active":"2024-09-12T01:58:32.102960+0000","last_peered":"2024-09-12T01:58:32.102960+0000","last_clean":"2024-09-12T01:58:32.102960+0000","last_became_active":"2024-09-12T01:58:32.099518+0000","last_became_peered":"2024-09-12T01:58:32.099518+0000","last_unstale":"2024-09-12T01:58:32.102960+0000","last_undegraded":"2024-09-12T01:58:32.102960+0000","last_fullsized":"2024-09-12T01:58:32.102960+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:27.155936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"65'1","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.091456+0000","last_change":"2024-09-12T01:58:31.086015+0000","last_active":"2024-09-12T01:58:32.091456+0000","last_peered":"2024-09-12T01:58:32.091456+0000","last_clean":"2024-09-12T01:58:32.091456+0000","last_became_active":"2024-09-12T01:58:31.085736+0000","last_became_peered":"2024-09-12T01:58:31.085736+0000","last_unstale":"2024-09-12T01:58:32.091456+0000","last_undegraded":"2024-09-12T01:58:32.091456+0000","last_fullsized":"2024-09-12T01:58:32.091456+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:58.281292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.076913+0000","last_change":"2024-09-12T01:58:31.078913+0000","last_active":"2024-09-12T01:58:32.076913+0000","last_peered":"2024-09-12T01:58:32.076913+0000","last_clean":"2024-09-12T01:58:32.076913+0000","last_became_active":"2024-09-12T01:58:31.078594+0000","last_became_peered":"2024-09-12T01:58:31.078594+0000","last_unstale":"2024-09-12T01:58:32.076913+0000","last_undegraded":"2024-09-12T01:58:32.076913+0000","last_fullsized":"2024-09-12T01:58:32.076913+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:32.332146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.086767+0000","last_change":"2024-09-12T01:58:32.082690+0000","last_active":"2024-09-12T01:58:32.086767+0000","last_peered":"2024-09-12T01:58:32.086767+0000","last_clean":"2024-09-12T01:58:32.086767+0000","last_became_active":"2024-09-12T01:58:32.082372+0000","last_became_peered":"2024-09-12T01:58:32.082372+0000","last_unstale":"2024-09-12T01:58:32.086767+0000","last_undegraded":"2024-09-12T01:58:32.086767+0000","last_fullsized":"2024-09-12T01:58:32.086767+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:47.657299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102369+0000","last_change":"2024-09-12T01:58:32.095478+0000","last_active":"2024-09-12T01:58:32.102369+0000","last_peered":"2024-09-12T01:58:32.102369+0000","last_clean":"2024-09-12T01:58:32.102369+0000","last_became_active":"2024-09-12T01:58:32.094996+0000","last_became_peered":"2024-09-12T01:58:32.094996+0000","last_unstale":"2024-09-12T01:58:32.102369+0000","last_undegraded":"2024-09-12T01:58:32.102369+0000","last_fullsized":"2024-09-12T01:58:32.102369+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.009280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.101344+0000","last_change":"2024-09-12T01:58:32.093516+0000","last_active":"2024-09-12T01:58:32.101344+0000","last_peered":"2024-09-12T01:58:32.101344+0000","last_clean":"2024-09-12T01:58:32.101344+0000","last_became_active":"2024-09-12T01:58:32.093213+0000","last_became_peered":"2024-09-12T01:58:32.093213+0000","last_unstale":"2024-09-12T01:58:32.101344+0000","last_undegraded":"2024-09-12T01:58:32.101344+0000","last_fullsized":"2024-09-12T01:58:32.101344+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:18.062819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.075513+0000","last_change":"2024-09-12T01:58:31.076858+0000","last_active":"2024-09-12T01:58:32.075513+0000","last_peered":"2024-09-12T01:58:32.075513+0000","last_clean":"2024-09-12T01:58:32.075513+0000","last_became_active":"2024-09-12T01:58:31.076593+0000","last_became_peered":"2024-09-12T01:58:31.076593+0000","last_unstale":"2024-09-12T01:58:32.075513+0000","last_undegraded":"2024-09-12T01:58:32.075513+0000","last_fullsized":"2024-09-12T01:58:32.075513+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:30.358255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088733+0000","last_change":"2024-09-12T01:58:32.086718+0000","last_active":"2024-09-12T01:58:32.088733+0000","last_peered":"2024-09-12T01:58:32.088733+0000","last_clean":"2024-09-12T01:58:32.088733+0000","last_became_active":"2024-09-12T01:58:32.086444+0000","last_became_peered":"2024-09-12T01:58:32.086444+0000","last_unstale":"2024-09-12T01:58:32.088733+0000","last_undegraded":"2024-09-12T01:58:32.088733+0000","last_fullsized":"2024-09-12T01:58:32.088733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:25.413262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"65'6","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.108469+0000","last_change":"2024-09-12T01:58:31.079583+0000","last_active":"2024-09-12T01:58:32.108469+0000","last_peered":"2024-09-12T01:58:32.108469+0000","last_clean":"2024-09-12T01:58:32.108469+0000","last_became_active":"2024-09-12T01:58:31.079317+0000","last_became_peered":"2024-09-12T01:58:31.079317+0000","last_unstale":"2024-09-12T01:58:32.108469+0000","last_undegraded":"2024-09-12T01:58:32.108469+0000","last_fullsized":"2024-09-12T01:58:32.108469+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:33.047976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.100470+0000","last_change":"2024-09-12T01:58:32.097734+0000","last_active":"2024-09-12T01:58:32.100470+0000","last_peered":"2024-09-12T01:58:32.100470+0000","last_clean":"2024-09-12T01:58:32.100470+0000","last_became_active":"2024-09-12T01:58:32.095245+0000","last_became_peered":"2024-09-12T01:58:32.095245+0000","last_unstale":"2024-09-12T01:58:32.100470+0000","last_undegraded":"2024-09-12T01:58:32.100470+0000","last_fullsized":"2024-09-12T01:58:32.100470+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.009280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.103028+0000","last_change":"2024-09-12T01:58:32.101742+0000","last_active":"2024-09-12T01:58:32.103028+0000","last_peered":"2024-09-12T01:58:32.103028+0000","last_clean":"2024-09-12T01:58:32.103028+0000","last_became_active":"2024-09-12T01:58:32.100985+0000","last_became_peered":"2024-09-12T01:58:32.100985+0000","last_unstale":"2024-09-12T01:58:32.103028+0000","last_undegraded":"2024-09-12T01:58:32.103028+0000","last_fullsized":"2024-09-12T01:58:32.103028+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:06.911951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"65'8","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.097968+0000","last_change":"2024-09-12T01:58:31.080233+0000","last_active":"2024-09-12T01:58:32.097968+0000","last_peered":"2024-09-12T01:58:32.097968+0000","last_clean":"2024-09-12T01:58:32.097968+0000","last_became_active":"2024-09-12T01:58:31.079923+0000","last_became_peered":"2024-09-12T01:58:31.079923+0000","last_unstale":"2024-09-12T01:58:32.097968+0000","last_undegraded":"2024-09-12T01:58:32.097968+0000","last_fullsized":"2024-09-12T01:58:32.097968+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:18.045768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088494+0000","last_change":"2024-09-12T01:58:32.083451+0000","last_active":"2024-09-12T01:58:32.088494+0000","last_peered":"2024-09-12T01:58:32.088494+0000","last_clean":"2024-09-12T01:58:32.088494+0000","last_became_active":"2024-09-12T01:58:32.083176+0000","last_became_peered":"2024-09-12T01:58:32.083176+0000","last_unstale":"2024-09-12T01:58:32.088494+0000","last_undegraded":"2024-09-12T01:58:32.088494+0000","last_fullsized":"2024-09-12T01:58:32.088494+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:29.187288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.077108+0000","last_change":"2024-09-12T01:58:31.074406+0000","last_active":"2024-09-12T01:58:32.077108+0000","last_peered":"2024-09-12T01:58:32.077108+0000","last_clean":"2024-09-12T01:58:32.077108+0000","last_became_active":"2024-09-12T01:58:31.074068+0000","last_became_peered":"2024-09-12T01:58:31.074068+0000","last_unstale":"2024-09-12T01:58:32.077108+0000","last_undegraded":"2024-09-12T01:58:32.077108+0000","last_fullsized":"2024-09-12T01:58:32.077108+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:26.113685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071998+0000","last_change":"2024-09-12T01:58:32.078981+0000","last_active":"2024-09-12T01:58:33.071998+0000","last_peered":"2024-09-12T01:58:33.071998+0000","last_clean":"2024-09-12T01:58:33.071998+0000","last_became_active":"2024-09-12T01:58:32.078680+0000","last_became_peered":"2024-09-12T01:58:32.078680+0000","last_unstale":"2024-09-12T01:58:33.071998+0000","last_undegraded":"2024-09-12T01:58:33.071998+0000","last_fullsized":"2024-09-12T01:58:33.071998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:11.561895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072046+0000","last_change":"2024-09-12T01:58:31.084085+0000","last_active":"2024-09-12T01:58:33.072046+0000","last_peered":"2024-09-12T01:58:33.072046+0000","last_clean":"2024-09-12T01:58:33.072046+0000","last_became_active":"2024-09-12T01:58:31.083740+0000","last_became_peered":"2024-09-12T01:58:31.083740+0000","last_unstale":"2024-09-12T01:58:33.072046+0000","last_undegraded":"2024-09-12T01:58:33.072046+0000","last_fullsized":"2024-09-12T01:58:33.072046+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:23.301991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071936+0000","last_change":"2024-09-12T01:58:31.079762+0000","last_active":"2024-09-12T01:58:33.071936+0000","last_peered":"2024-09-12T01:58:33.071936+0000","last_clean":"2024-09-12T01:58:33.071936+0000","last_became_active":"2024-09-12T01:58:31.079490+0000","last_became_peered":"2024-09-12T01:58:31.079490+0000","last_unstale":"2024-09-12T01:58:33.071936+0000","last_undegraded":"2024-09-12T01:58:33.071936+0000","last_fullsized":"2024-09-12T01:58:33.071936+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:40.366109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072065+0000","last_change":"2024-09-12T01:58:32.088285+0000","last_active":"2024-09-12T01:58:33.072065+0000","last_peered":"2024-09-12T01:58:33.072065+0000","last_clean":"2024-09-12T01:58:33.072065+0000","last_became_active":"2024-09-12T01:58:32.087918+0000","last_became_peered":"2024-09-12T01:58:32.087918+0000","last_unstale":"2024-09-12T01:58:33.072065+0000","last_undegraded":"2024-09-12T01:58:33.072065+0000","last_fullsized":"2024-09-12T01:58:33.072065+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:19.787633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.090260+0000","last_change":"2024-09-12T01:58:32.084136+0000","last_active":"2024-09-12T01:58:32.090260+0000","last_peered":"2024-09-12T01:58:32.090260+0000","last_clean":"2024-09-12T01:58:32.090260+0000","last_became_active":"2024-09-12T01:58:32.083827+0000","last_became_peered":"2024-09-12T01:58:32.083827+0000","last_unstale":"2024-09-12T01:58:32.090260+0000","last_undegraded":"2024-09-12T01:58:32.090260+0000","last_fullsized":"2024-09-12T01:58:32.090260+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:25.550979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072377+0000","last_change":"2024-09-12T01:58:31.086458+0000","last_active":"2024-09-12T01:58:33.072377+0000","last_peered":"2024-09-12T01:58:33.072377+0000","last_clean":"2024-09-12T01:58:33.072377+0000","last_became_active":"2024-09-12T01:58:31.086155+0000","last_became_peered":"2024-09-12T01:58:31.086155+0000","last_unstale":"2024-09-12T01:58:33.072377+0000","last_undegraded":"2024-09-12T01:58:33.072377+0000","last_fullsized":"2024-09-12T01:58:33.072377+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:58.472371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.079990+0000","last_change":"2024-09-12T01:58:31.077535+0000","last_active":"2024-09-12T01:58:32.079990+0000","last_peered":"2024-09-12T01:58:32.079990+0000","last_clean":"2024-09-12T01:58:32.079990+0000","last_became_active":"2024-09-12T01:58:31.077058+0000","last_became_peered":"2024-09-12T01:58:31.077058+0000","last_unstale":"2024-09-12T01:58:32.079990+0000","last_undegraded":"2024-09-12T01:58:32.079990+0000","last_fullsized":"2024-09-12T01:58:32.079990+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:10.416486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098577+0000","last_change":"2024-09-12T01:58:32.089933+0000","last_active":"2024-09-12T01:58:32.098577+0000","last_peered":"2024-09-12T01:58:32.098577+0000","last_clean":"2024-09-12T01:58:32.098577+0000","last_became_active":"2024-09-12T01:58:32.089694+0000","last_became_peered":"2024-09-12T01:58:32.089694+0000","last_unstale":"2024-09-12T01:58:32.098577+0000","last_undegraded":"2024-09-12T01:58:32.098577+0000","last_fullsized":"2024-09-12T01:58:32.098577+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:34.053253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.076856+0000","last_change":"2024-09-12T01:58:31.076859+0000","last_active":"2024-09-12T01:58:32.076856+0000","last_peered":"2024-09-12T01:58:32.076856+0000","last_clean":"2024-09-12T01:58:32.076856+0000","last_became_active":"2024-09-12T01:58:31.076488+0000","last_became_peered":"2024-09-12T01:58:31.076488+0000","last_unstale":"2024-09-12T01:58:32.076856+0000","last_undegraded":"2024-09-12T01:58:32.076856+0000","last_fullsized":"2024-09-12T01:58:32.076856+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:47.205697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102944+0000","last_change":"2024-09-12T01:58:32.099717+0000","last_active":"2024-09-12T01:58:32.102944+0000","last_peered":"2024-09-12T01:58:32.102944+0000","last_clean":"2024-09-12T01:58:32.102944+0000","last_became_active":"2024-09-12T01:58:32.099398+0000","last_became_peered":"2024-09-12T01:58:32.099398+0000","last_unstale":"2024-09-12T01:58:32.102944+0000","last_undegraded":"2024-09-12T01:58:32.102944+0000","last_fullsized":"2024-09-12T01:58:32.102944+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:53.481574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.077079+0000","last_change":"2024-09-12T01:58:31.078174+0000","last_active":"2024-09-12T01:58:32.077079+0000","last_peered":"2024-09-12T01:58:32.077079+0000","last_clean":"2024-09-12T01:58:32.077079+0000","last_became_active":"2024-09-12T01:58:31.077722+0000","last_became_peered":"2024-09-12T01:58:31.077722+0000","last_unstale":"2024-09-12T01:58:32.077079+0000","last_undegraded":"2024-09-12T01:58:32.077079+0000","last_fullsized":"2024-09-12T01:58:32.077079+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:04.459773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098702+0000","last_change":"2024-09-12T01:58:32.092706+0000","last_active":"2024-09-12T01:58:32.098702+0000","last_peered":"2024-09-12T01:58:32.098702+0000","last_clean":"2024-09-12T01:58:32.098702+0000","last_became_active":"2024-09-12T01:58:32.092407+0000","last_became_peered":"2024-09-12T01:58:32.092407+0000","last_unstale":"2024-09-12T01:58:32.098702+0000","last_undegraded":"2024-09-12T01:58:32.098702+0000","last_fullsized":"2024-09-12T01:58:32.098702+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:28.935380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.079005+0000","last_change":"2024-09-12T01:58:31.083451+0000","last_active":"2024-09-12T01:58:32.079005+0000","last_peered":"2024-09-12T01:58:32.079005+0000","last_clean":"2024-09-12T01:58:32.079005+0000","last_became_active":"2024-09-12T01:58:31.083133+0000","last_became_peered":"2024-09-12T01:58:31.083133+0000","last_unstale":"2024-09-12T01:58:32.079005+0000","last_undegraded":"2024-09-12T01:58:32.079005+0000","last_fullsized":"2024-09-12T01:58:32.079005+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:21.347164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.076598+0000","last_change":"2024-09-12T01:58:31.084470+0000","last_active":"2024-09-12T01:58:32.076598+0000","last_peered":"2024-09-12T01:58:32.076598+0000","last_clean":"2024-09-12T01:58:32.076598+0000","last_became_active":"2024-09-12T01:58:31.084172+0000","last_became_peered":"2024-09-12T01:58:31.084172+0000","last_unstale":"2024-09-12T01:58:32.076598+0000","last_undegraded":"2024-09-12T01:58:32.076598+0000","last_fullsized":"2024-09-12T01:58:32.076598+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:29.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":243,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-12T01:58:28.469115+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:58:28.469115+0000","last_peered":"2024-09-12T01:58:28.469115+0000","last_clean":"2024-09-12T01:58:28.469115+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:58:28.469115+0000","last_undegraded":"2024-09-12T01:58:28.469115+0000","last_fullsized":"2024-09-12T01:58:28.469115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":66,"acting":66,"num_store_stats":5},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2194,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":38,"acting":38,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1335296,"data_stored":923059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27764,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":741376,"data_stored":332691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":332691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542182,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":778240,"data_stored":352726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":778240,"data_stored":352726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":806912,"data_stored":355102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542182,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1372160,"data_stored":943094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":765952,"data_stored":345559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:58:35.425 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:58:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.564+0000 7f2d1bcc9640 1 Processor -- start 2024-09-12T01:58:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.564+0000 7f2d1bcc9640 1 -- start start 2024-09-12T01:58:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.565+0000 7f2d1bcc9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2d1415e760 0x7f2d1406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.565+0000 7f2d1bcc9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d140d4fd0 0x7f2d140cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.565+0000 7f2d1bcc9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d140b3650 0x7f2d140cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.565+0000 7f2d1bcc9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2d140d2700 con 0x7f2d140b3650 2024-09-12T01:58:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.565+0000 7f2d1bcc9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f2d140cedb0 con 0x7f2d1415e760 2024-09-12T01:58:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.565+0000 7f2d1bcc9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2d140cf090 con 0x7f2d140d4fd0 2024-09-12T01:58:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.565+0000 7f2d1a266640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d140b3650 0x7f2d140cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.565+0000 7f2d1a266640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d140b3650 0x7f2d140cfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35920/0 (socket says 172.21.15.19:35920) 2024-09-12T01:58:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.565+0000 7f2d1a266640 1 -- 172.21.15.19:0/1533671665 learned_addr learned my addr 172.21.15.19:0/1533671665 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.565+0000 7f2d1a266640 1 -- 172.21.15.19:0/1533671665 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d140d4fd0 msgr2=0x7f2d140cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.565+0000 7f2d1a266640 1 --2- 172.21.15.19:0/1533671665 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d140d4fd0 0x7f2d140cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.565+0000 7f2d1a266640 1 -- 172.21.15.19:0/1533671665 >> v2:172.21.15.135:3300/0 conn(0x7f2d1415e760 msgr2=0x7f2d1406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.565+0000 7f2d19a65640 1 --2- 172.21.15.19:0/1533671665 >> v2:172.21.15.135:3300/0 conn(0x7f2d1415e760 0x7f2d1406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.565+0000 7f2d1a266640 1 --2- 172.21.15.19:0/1533671665 >> v2:172.21.15.135:3300/0 conn(0x7f2d1415e760 0x7f2d1406cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.565+0000 7f2d1a266640 1 -- 172.21.15.19:0/1533671665 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d140b3c80 con 0x7f2d140b3650 2024-09-12T01:58:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.566+0000 7f2d1a266640 1 --2- 172.21.15.19:0/1533671665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d140b3650 0x7f2d140cfaf0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2d1408ca50 tx=0x7f2d0c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e3b75bbca997b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.566+0000 7f2d18a63640 1 -- 172.21.15.19:0/1533671665 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c036070 con 0x7f2d140b3650 2024-09-12T01:58:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.566+0000 7f2d18a63640 1 -- 172.21.15.19:0/1533671665 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0c031600 con 0x7f2d140b3650 2024-09-12T01:58:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.566+0000 7f2d18a63640 1 -- 172.21.15.19:0/1533671665 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c0319d0 con 0x7f2d140b3650 2024-09-12T01:58:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.567+0000 7f2d1bcc9640 1 -- 172.21.15.19:0/1533671665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d140b3650 msgr2=0x7f2d140cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.567+0000 7f2d1bcc9640 1 --2- 172.21.15.19:0/1533671665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d140b3650 0x7f2d140cfaf0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2d1408ca50 tx=0x7f2d0c02a610 comp rx=0 tx=0).stop 2024-09-12T01:58:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.567+0000 7f2d1bcc9640 1 -- 172.21.15.19:0/1533671665 shutdown_connections 2024-09-12T01:58:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.567+0000 7f2d1bcc9640 1 --2- 172.21.15.19:0/1533671665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d140b3650 0x7f2d140cfaf0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.567+0000 7f2d1bcc9640 1 --2- 172.21.15.19:0/1533671665 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d140d4fd0 0x7f2d140cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.567+0000 7f2d1bcc9640 1 --2- 172.21.15.19:0/1533671665 >> v2:172.21.15.135:3300/0 conn(0x7f2d1415e760 0x7f2d1406cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.567+0000 7f2d1bcc9640 1 -- 172.21.15.19:0/1533671665 >> 172.21.15.19:0/1533671665 conn(0x7f2d1408bfc0 msgr2=0x7f2d140d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.567+0000 7f2d1bcc9640 1 -- 172.21.15.19:0/1533671665 shutdown_connections 2024-09-12T01:58:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.567+0000 7f2d1bcc9640 1 -- 172.21.15.19:0/1533671665 wait complete. 2024-09-12T01:58:35.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.568+0000 7f2d1bcc9640 1 Processor -- start 2024-09-12T01:58:35.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.568+0000 7f2d1bcc9640 1 -- start start 2024-09-12T01:58:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.569+0000 7f2d1bcc9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d140b3650 0x7f2d14161230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.569+0000 7f2d1bcc9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d140d4fd0 0x7f2d140c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.569+0000 7f2d1bcc9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d1415e760 0x7f2d140c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.569+0000 7f2d1bcc9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2d140d3230 con 0x7f2d1415e760 2024-09-12T01:58:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.569+0000 7f2d1bcc9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2d140d30b0 con 0x7f2d140b3650 2024-09-12T01:58:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.569+0000 7f2d1bcc9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2d140d33b0 con 0x7f2d140d4fd0 2024-09-12T01:58:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.569+0000 7f2d1a266640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d1415e760 0x7f2d140c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.569+0000 7f2d1a266640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d1415e760 0x7f2d140c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35930/0 (socket says 172.21.15.19:35930) 2024-09-12T01:58:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.569+0000 7f2d1a266640 1 -- 172.21.15.19:0/2137269262 learned_addr learned my addr 172.21.15.19:0/2137269262 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.569+0000 7f2d19a65640 1 --2- 172.21.15.19:0/2137269262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d140b3650 0x7f2d14161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.569+0000 7f2d19264640 1 --2- 172.21.15.19:0/2137269262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d140d4fd0 0x7f2d140c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.569+0000 7f2d1a266640 1 -- 172.21.15.19:0/2137269262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d140d4fd0 msgr2=0x7f2d140c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.569+0000 7f2d1a266640 1 --2- 172.21.15.19:0/2137269262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d140d4fd0 0x7f2d140c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.569+0000 7f2d1a266640 1 -- 172.21.15.19:0/2137269262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d140b3650 msgr2=0x7f2d14161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.569+0000 7f2d1a266640 1 --2- 172.21.15.19:0/2137269262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d140b3650 0x7f2d14161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.569+0000 7f2d1a266640 1 -- 172.21.15.19:0/2137269262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d140b56c0 con 0x7f2d1415e760 2024-09-12T01:58:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.569+0000 7f2d19a65640 1 --2- 172.21.15.19:0/2137269262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d140b3650 0x7f2d14161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.569+0000 7f2d1a266640 1 --2- 172.21.15.19:0/2137269262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d1415e760 0x7f2d140c8a00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c034040 tx=0x7f2d0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.570+0000 7f2d0a7fc640 1 -- 172.21.15.19:0/2137269262 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c036050 con 0x7f2d1415e760 2024-09-12T01:58:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.570+0000 7f2d0a7fc640 1 -- 172.21.15.19:0/2137269262 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0c042070 con 0x7f2d1415e760 2024-09-12T01:58:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.570+0000 7f2d1bcc9640 1 -- 172.21.15.19:0/2137269262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d140b59a0 con 0x7f2d1415e760 2024-09-12T01:58:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.570+0000 7f2d0a7fc640 1 -- 172.21.15.19:0/2137269262 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c009510 con 0x7f2d1415e760 2024-09-12T01:58:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.570+0000 7f2d1bcc9640 1 -- 172.21.15.19:0/2137269262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d14153b20 con 0x7f2d1415e760 2024-09-12T01:58:35.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.571+0000 7f2d1bcc9640 1 -- 172.21.15.19:0/2137269262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d140b2ff0 con 0x7f2d1415e760 2024-09-12T01:58:35.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.571+0000 7f2d0a7fc640 1 -- 172.21.15.19:0/2137269262 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d0c007bf0 con 0x7f2d1415e760 2024-09-12T01:58:35.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.572+0000 7f2d0a7fc640 1 --2- 172.21.15.19:0/2137269262 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2cf806be30 0x7f2cf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.572+0000 7f2d0a7fc640 1 -- 172.21.15.19:0/2137269262 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6101+0+0 (secure 0 0 0) 0x7f2d0c0abf00 con 0x7f2d1415e760 2024-09-12T01:58:35.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.572+0000 7f2d19a65640 1 --2- 172.21.15.19:0/2137269262 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2cf806be30 0x7f2cf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:35.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.572+0000 7f2d19a65640 1 --2- 172.21.15.19:0/2137269262 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2cf806be30 0x7f2cf806e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2d10006fd0 tx=0x7f2d10008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.576+0000 7f2d0a7fc640 1 -- 172.21.15.19:0/2137269262 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2d140b2ff0 con 0x7f2d1415e760 2024-09-12T01:58:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.747+0000 7f2d1bcc9640 1 -- 172.21.15.19:0/2137269262 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d14161770 con 0x7f2cf806be30 2024-09-12T01:58:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.754+0000 7f2d0a7fc640 1 -- 172.21.15.19:0/2137269262 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245519 (secure 0 0 0) 0x7f2d14161770 con 0x7f2cf806be30 2024-09-12T01:58:35.756 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:35.757 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:58:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.756+0000 7f2d1bcc9640 1 -- 172.21.15.19:0/2137269262 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2cf806be30 msgr2=0x7f2cf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.756+0000 7f2d1bcc9640 1 --2- 172.21.15.19:0/2137269262 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2cf806be30 0x7f2cf806e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2d10006fd0 tx=0x7f2d10008040 comp rx=0 tx=0).stop 2024-09-12T01:58:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.756+0000 7f2d1bcc9640 1 -- 172.21.15.19:0/2137269262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d1415e760 msgr2=0x7f2d140c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.756+0000 7f2d1bcc9640 1 --2- 172.21.15.19:0/2137269262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d1415e760 0x7f2d140c8a00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c034040 tx=0x7f2d0c004a40 comp rx=0 tx=0).stop 2024-09-12T01:58:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.756+0000 7f2d1bcc9640 1 -- 172.21.15.19:0/2137269262 shutdown_connections 2024-09-12T01:58:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.756+0000 7f2d1bcc9640 1 --2- 172.21.15.19:0/2137269262 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2cf806be30 0x7f2cf806e2f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.756+0000 7f2d1bcc9640 1 --2- 172.21.15.19:0/2137269262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d1415e760 0x7f2d140c8a00 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.756+0000 7f2d1bcc9640 1 --2- 172.21.15.19:0/2137269262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d140d4fd0 0x7f2d140c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.756+0000 7f2d1bcc9640 1 --2- 172.21.15.19:0/2137269262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d140b3650 0x7f2d14161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.756+0000 7f2d1bcc9640 1 -- 172.21.15.19:0/2137269262 >> 172.21.15.19:0/2137269262 conn(0x7f2d1408bfc0 msgr2=0x7f2d140cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:35.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.756+0000 7f2d1bcc9640 1 -- 172.21.15.19:0/2137269262 shutdown_connections 2024-09-12T01:58:35.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.756+0000 7f2d1bcc9640 1 -- 172.21.15.19:0/2137269262 wait complete. 2024-09-12T01:58:35.767 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-09-12T01:58:34.120978+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592562,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":106,"acting":106,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":231732,"kb_used_data":7148,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742988,"statfs":{"total":773094113280,"available":772856819712,"internally_reserved":0,"allocated":7319552,"data_stored":3937648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2194,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.060490"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102871+0000","last_change":"2024-09-12T01:58:32.098775+0000","last_active":"2024-09-12T01:58:32.102871+0000","last_peered":"2024-09-12T01:58:32.102871+0000","last_clean":"2024-09-12T01:58:32.102871+0000","last_became_active":"2024-09-12T01:58:32.098472+0000","last_became_peered":"2024-09-12T01:58:32.098472+0000","last_unstale":"2024-09-12T01:58:32.102871+0000","last_undegraded":"2024-09-12T01:58:32.102871+0000","last_fullsized":"2024-09-12T01:58:32.102871+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:25.908231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098986+0000","last_change":"2024-09-12T01:58:32.092794+0000","last_active":"2024-09-12T01:58:32.098986+0000","last_peered":"2024-09-12T01:58:32.098986+0000","last_clean":"2024-09-12T01:58:32.098986+0000","last_became_active":"2024-09-12T01:58:32.092525+0000","last_became_peered":"2024-09-12T01:58:32.092525+0000","last_unstale":"2024-09-12T01:58:32.098986+0000","last_undegraded":"2024-09-12T01:58:32.098986+0000","last_fullsized":"2024-09-12T01:58:32.098986+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:38.945135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088755+0000","last_change":"2024-09-12T01:58:32.086522+0000","last_active":"2024-09-12T01:58:32.088755+0000","last_peered":"2024-09-12T01:58:32.088755+0000","last_clean":"2024-09-12T01:58:32.088755+0000","last_became_active":"2024-09-12T01:58:32.086029+0000","last_became_peered":"2024-09-12T01:58:32.086029+0000","last_unstale":"2024-09-12T01:58:32.088755+0000","last_undegraded":"2024-09-12T01:58:32.088755+0000","last_fullsized":"2024-09-12T01:58:32.088755+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:09.934393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072181+0000","last_change":"2024-09-12T01:58:32.090868+0000","last_active":"2024-09-12T01:58:33.072181+0000","last_peered":"2024-09-12T01:58:33.072181+0000","last_clean":"2024-09-12T01:58:33.072181+0000","last_became_active":"2024-09-12T01:58:32.090596+0000","last_became_peered":"2024-09-12T01:58:32.090596+0000","last_unstale":"2024-09-12T01:58:33.072181+0000","last_undegraded":"2024-09-12T01:58:33.072181+0000","last_fullsized":"2024-09-12T01:58:33.072181+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:19.012343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.092799+0000","last_change":"2024-09-12T01:58:32.091013+0000","last_active":"2024-09-12T01:58:32.092799+0000","last_peered":"2024-09-12T01:58:32.092799+0000","last_clean":"2024-09-12T01:58:32.092799+0000","last_became_active":"2024-09-12T01:58:32.090711+0000","last_became_peered":"2024-09-12T01:58:32.090711+0000","last_unstale":"2024-09-12T01:58:32.092799+0000","last_undegraded":"2024-09-12T01:58:32.092799+0000","last_fullsized":"2024-09-12T01:58:32.092799+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:16.569815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098161+0000","last_change":"2024-09-12T01:58:32.093435+0000","last_active":"2024-09-12T01:58:32.098161+0000","last_peered":"2024-09-12T01:58:32.098161+0000","last_clean":"2024-09-12T01:58:32.098161+0000","last_became_active":"2024-09-12T01:58:32.092950+0000","last_became_peered":"2024-09-12T01:58:32.092950+0000","last_unstale":"2024-09-12T01:58:32.098161+0000","last_undegraded":"2024-09-12T01:58:32.098161+0000","last_fullsized":"2024-09-12T01:58:32.098161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:38.945135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098644+0000","last_change":"2024-09-12T01:58:32.092337+0000","last_active":"2024-09-12T01:58:32.098644+0000","last_peered":"2024-09-12T01:58:32.098644+0000","last_clean":"2024-09-12T01:58:32.098644+0000","last_became_active":"2024-09-12T01:58:32.091794+0000","last_became_peered":"2024-09-12T01:58:32.091794+0000","last_unstale":"2024-09-12T01:58:32.098644+0000","last_undegraded":"2024-09-12T01:58:32.098644+0000","last_fullsized":"2024-09-12T01:58:32.098644+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:03.685856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102947+0000","last_change":"2024-09-12T01:58:32.099798+0000","last_active":"2024-09-12T01:58:32.102947+0000","last_peered":"2024-09-12T01:58:32.102947+0000","last_clean":"2024-09-12T01:58:32.102947+0000","last_became_active":"2024-09-12T01:58:32.099440+0000","last_became_peered":"2024-09-12T01:58:32.099440+0000","last_unstale":"2024-09-12T01:58:32.102947+0000","last_undegraded":"2024-09-12T01:58:32.102947+0000","last_fullsized":"2024-09-12T01:58:32.102947+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:12.553586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088709+0000","last_change":"2024-09-12T01:58:32.086299+0000","last_active":"2024-09-12T01:58:32.088709+0000","last_peered":"2024-09-12T01:58:32.088709+0000","last_clean":"2024-09-12T01:58:32.088709+0000","last_became_active":"2024-09-12T01:58:32.085968+0000","last_became_peered":"2024-09-12T01:58:32.085968+0000","last_unstale":"2024-09-12T01:58:32.088709+0000","last_undegraded":"2024-09-12T01:58:32.088709+0000","last_fullsized":"2024-09-12T01:58:32.088709+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:14.575171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.092452+0000","last_change":"2024-09-12T01:58:32.089658+0000","last_active":"2024-09-12T01:58:32.092452+0000","last_peered":"2024-09-12T01:58:32.092452+0000","last_clean":"2024-09-12T01:58:32.092452+0000","last_became_active":"2024-09-12T01:58:32.089374+0000","last_became_peered":"2024-09-12T01:58:32.089374+0000","last_unstale":"2024-09-12T01:58:32.092452+0000","last_undegraded":"2024-09-12T01:58:32.092452+0000","last_fullsized":"2024-09-12T01:58:32.092452+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:21.967038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.093607+0000","last_change":"2024-09-12T01:58:32.091442+0000","last_active":"2024-09-12T01:58:32.093607+0000","last_peered":"2024-09-12T01:58:32.093607+0000","last_clean":"2024-09-12T01:58:32.093607+0000","last_became_active":"2024-09-12T01:58:32.091113+0000","last_became_peered":"2024-09-12T01:58:32.091113+0000","last_unstale":"2024-09-12T01:58:32.093607+0000","last_undegraded":"2024-09-12T01:58:32.093607+0000","last_fullsized":"2024-09-12T01:58:32.093607+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:29.150750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.092420+0000","last_change":"2024-09-12T01:58:32.090771+0000","last_active":"2024-09-12T01:58:32.092420+0000","last_peered":"2024-09-12T01:58:32.092420+0000","last_clean":"2024-09-12T01:58:32.092420+0000","last_became_active":"2024-09-12T01:58:32.090506+0000","last_became_peered":"2024-09-12T01:58:32.090506+0000","last_unstale":"2024-09-12T01:58:32.092420+0000","last_undegraded":"2024-09-12T01:58:32.092420+0000","last_fullsized":"2024-09-12T01:58:32.092420+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:21.707987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098121+0000","last_change":"2024-09-12T01:58:32.088553+0000","last_active":"2024-09-12T01:58:32.098121+0000","last_peered":"2024-09-12T01:58:32.098121+0000","last_clean":"2024-09-12T01:58:32.098121+0000","last_became_active":"2024-09-12T01:58:32.087827+0000","last_became_peered":"2024-09-12T01:58:32.087827+0000","last_unstale":"2024-09-12T01:58:32.098121+0000","last_undegraded":"2024-09-12T01:58:32.098121+0000","last_fullsized":"2024-09-12T01:58:32.098121+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:11.421763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102392+0000","last_change":"2024-09-12T01:58:32.095548+0000","last_active":"2024-09-12T01:58:32.102392+0000","last_peered":"2024-09-12T01:58:32.102392+0000","last_clean":"2024-09-12T01:58:32.102392+0000","last_became_active":"2024-09-12T01:58:32.094714+0000","last_became_peered":"2024-09-12T01:58:32.094714+0000","last_unstale":"2024-09-12T01:58:32.102392+0000","last_undegraded":"2024-09-12T01:58:32.102392+0000","last_fullsized":"2024-09-12T01:58:32.102392+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:13.252384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098544+0000","last_change":"2024-09-12T01:58:32.088560+0000","last_active":"2024-09-12T01:58:32.098544+0000","last_peered":"2024-09-12T01:58:32.098544+0000","last_clean":"2024-09-12T01:58:32.098544+0000","last_became_active":"2024-09-12T01:58:32.088317+0000","last_became_peered":"2024-09-12T01:58:32.088317+0000","last_unstale":"2024-09-12T01:58:32.098544+0000","last_undegraded":"2024-09-12T01:58:32.098544+0000","last_fullsized":"2024-09-12T01:58:32.098544+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:22.352441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071936+0000","last_change":"2024-09-12T01:58:32.085708+0000","last_active":"2024-09-12T01:58:33.071936+0000","last_peered":"2024-09-12T01:58:33.071936+0000","last_clean":"2024-09-12T01:58:33.071936+0000","last_became_active":"2024-09-12T01:58:32.085394+0000","last_became_peered":"2024-09-12T01:58:32.085394+0000","last_unstale":"2024-09-12T01:58:33.071936+0000","last_undegraded":"2024-09-12T01:58:33.071936+0000","last_fullsized":"2024-09-12T01:58:33.071936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:02.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"65'4","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.101459+0000","last_change":"2024-09-12T01:58:31.085572+0000","last_active":"2024-09-12T01:58:32.101459+0000","last_peered":"2024-09-12T01:58:32.101459+0000","last_clean":"2024-09-12T01:58:32.101459+0000","last_became_active":"2024-09-12T01:58:31.085308+0000","last_became_peered":"2024-09-12T01:58:31.085308+0000","last_unstale":"2024-09-12T01:58:32.101459+0000","last_undegraded":"2024-09-12T01:58:32.101459+0000","last_fullsized":"2024-09-12T01:58:32.101459+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:47.308955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098144+0000","last_change":"2024-09-12T01:58:32.093055+0000","last_active":"2024-09-12T01:58:32.098144+0000","last_peered":"2024-09-12T01:58:32.098144+0000","last_clean":"2024-09-12T01:58:32.098144+0000","last_became_active":"2024-09-12T01:58:32.092801+0000","last_became_peered":"2024-09-12T01:58:32.092801+0000","last_unstale":"2024-09-12T01:58:32.098144+0000","last_undegraded":"2024-09-12T01:58:32.098144+0000","last_fullsized":"2024-09-12T01:58:32.098144+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:48.314232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072473+0000","last_change":"2024-09-12T01:58:31.082993+0000","last_active":"2024-09-12T01:58:33.072473+0000","last_peered":"2024-09-12T01:58:33.072473+0000","last_clean":"2024-09-12T01:58:33.072473+0000","last_became_active":"2024-09-12T01:58:31.082679+0000","last_became_peered":"2024-09-12T01:58:31.082679+0000","last_unstale":"2024-09-12T01:58:33.072473+0000","last_undegraded":"2024-09-12T01:58:33.072473+0000","last_fullsized":"2024-09-12T01:58:33.072473+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:16.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072371+0000","last_change":"2024-09-12T01:58:32.078918+0000","last_active":"2024-09-12T01:58:33.072371+0000","last_peered":"2024-09-12T01:58:33.072371+0000","last_clean":"2024-09-12T01:58:33.072371+0000","last_became_active":"2024-09-12T01:58:32.078659+0000","last_became_peered":"2024-09-12T01:58:32.078659+0000","last_unstale":"2024-09-12T01:58:33.072371+0000","last_undegraded":"2024-09-12T01:58:33.072371+0000","last_fullsized":"2024-09-12T01:58:33.072371+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:02.012816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072329+0000","last_change":"2024-09-12T01:58:31.085752+0000","last_active":"2024-09-12T01:58:33.072329+0000","last_peered":"2024-09-12T01:58:33.072329+0000","last_clean":"2024-09-12T01:58:33.072329+0000","last_became_active":"2024-09-12T01:58:31.085456+0000","last_became_peered":"2024-09-12T01:58:31.085456+0000","last_unstale":"2024-09-12T01:58:33.072329+0000","last_undegraded":"2024-09-12T01:58:33.072329+0000","last_fullsized":"2024-09-12T01:58:33.072329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:44.704921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072133+0000","last_change":"2024-09-12T01:58:31.082135+0000","last_active":"2024-09-12T01:58:33.072133+0000","last_peered":"2024-09-12T01:58:33.072133+0000","last_clean":"2024-09-12T01:58:33.072133+0000","last_became_active":"2024-09-12T01:58:31.081834+0000","last_became_peered":"2024-09-12T01:58:31.081834+0000","last_unstale":"2024-09-12T01:58:33.072133+0000","last_undegraded":"2024-09-12T01:58:33.072133+0000","last_fullsized":"2024-09-12T01:58:33.072133+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:59.204264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098668+0000","last_change":"2024-09-12T01:58:32.092057+0000","last_active":"2024-09-12T01:58:32.098668+0000","last_peered":"2024-09-12T01:58:32.098668+0000","last_clean":"2024-09-12T01:58:32.098668+0000","last_became_active":"2024-09-12T01:58:32.091372+0000","last_became_peered":"2024-09-12T01:58:32.091372+0000","last_unstale":"2024-09-12T01:58:32.098668+0000","last_undegraded":"2024-09-12T01:58:32.098668+0000","last_fullsized":"2024-09-12T01:58:32.098668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:55.460525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"65'1","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088984+0000","last_change":"2024-09-12T01:58:31.085302+0000","last_active":"2024-09-12T01:58:32.088984+0000","last_peered":"2024-09-12T01:58:32.088984+0000","last_clean":"2024-09-12T01:58:32.088984+0000","last_became_active":"2024-09-12T01:58:31.084995+0000","last_became_peered":"2024-09-12T01:58:31.084995+0000","last_unstale":"2024-09-12T01:58:32.088984+0000","last_undegraded":"2024-09-12T01:58:32.088984+0000","last_fullsized":"2024-09-12T01:58:32.088984+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:18.228685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102960+0000","last_change":"2024-09-12T01:58:32.099965+0000","last_active":"2024-09-12T01:58:32.102960+0000","last_peered":"2024-09-12T01:58:32.102960+0000","last_clean":"2024-09-12T01:58:32.102960+0000","last_became_active":"2024-09-12T01:58:32.099518+0000","last_became_peered":"2024-09-12T01:58:32.099518+0000","last_unstale":"2024-09-12T01:58:32.102960+0000","last_undegraded":"2024-09-12T01:58:32.102960+0000","last_fullsized":"2024-09-12T01:58:32.102960+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:27.155936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"65'1","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.091456+0000","last_change":"2024-09-12T01:58:31.086015+0000","last_active":"2024-09-12T01:58:32.091456+0000","last_peered":"2024-09-12T01:58:32.091456+0000","last_clean":"2024-09-12T01:58:32.091456+0000","last_became_active":"2024-09-12T01:58:31.085736+0000","last_became_peered":"2024-09-12T01:58:31.085736+0000","last_unstale":"2024-09-12T01:58:32.091456+0000","last_undegraded":"2024-09-12T01:58:32.091456+0000","last_fullsized":"2024-09-12T01:58:32.091456+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:58.281292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.076913+0000","last_change":"2024-09-12T01:58:31.078913+0000","last_active":"2024-09-12T01:58:32.076913+0000","last_peered":"2024-09-12T01:58:32.076913+0000","last_clean":"2024-09-12T01:58:32.076913+0000","last_became_active":"2024-09-12T01:58:31.078594+0000","last_became_peered":"2024-09-12T01:58:31.078594+0000","last_unstale":"2024-09-12T01:58:32.076913+0000","last_undegraded":"2024-09-12T01:58:32.076913+0000","last_fullsized":"2024-09-12T01:58:32.076913+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:32.332146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.086767+0000","last_change":"2024-09-12T01:58:32.082690+0000","last_active":"2024-09-12T01:58:32.086767+0000","last_peered":"2024-09-12T01:58:32.086767+0000","last_clean":"2024-09-12T01:58:32.086767+0000","last_became_active":"2024-09-12T01:58:32.082372+0000","last_became_peered":"2024-09-12T01:58:32.082372+0000","last_unstale":"2024-09-12T01:58:32.086767+0000","last_undegraded":"2024-09-12T01:58:32.086767+0000","last_fullsized":"2024-09-12T01:58:32.086767+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:47.657299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102369+0000","last_change":"2024-09-12T01:58:32.095478+0000","last_active":"2024-09-12T01:58:32.102369+0000","last_peered":"2024-09-12T01:58:32.102369+0000","last_clean":"2024-09-12T01:58:32.102369+0000","last_became_active":"2024-09-12T01:58:32.094996+0000","last_became_peered":"2024-09-12T01:58:32.094996+0000","last_unstale":"2024-09-12T01:58:32.102369+0000","last_undegraded":"2024-09-12T01:58:32.102369+0000","last_fullsized":"2024-09-12T01:58:32.102369+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.009280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.101344+0000","last_change":"2024-09-12T01:58:32.093516+0000","last_active":"2024-09-12T01:58:32.101344+0000","last_peered":"2024-09-12T01:58:32.101344+0000","last_clean":"2024-09-12T01:58:32.101344+0000","last_became_active":"2024-09-12T01:58:32.093213+0000","last_became_peered":"2024-09-12T01:58:32.093213+0000","last_unstale":"2024-09-12T01:58:32.101344+0000","last_undegraded":"2024-09-12T01:58:32.101344+0000","last_fullsized":"2024-09-12T01:58:32.101344+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:18.062819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.075513+0000","last_change":"2024-09-12T01:58:31.076858+0000","last_active":"2024-09-12T01:58:32.075513+0000","last_peered":"2024-09-12T01:58:32.075513+0000","last_clean":"2024-09-12T01:58:32.075513+0000","last_became_active":"2024-09-12T01:58:31.076593+0000","last_became_peered":"2024-09-12T01:58:31.076593+0000","last_unstale":"2024-09-12T01:58:32.075513+0000","last_undegraded":"2024-09-12T01:58:32.075513+0000","last_fullsized":"2024-09-12T01:58:32.075513+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:30.358255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088733+0000","last_change":"2024-09-12T01:58:32.086718+0000","last_active":"2024-09-12T01:58:32.088733+0000","last_peered":"2024-09-12T01:58:32.088733+0000","last_clean":"2024-09-12T01:58:32.088733+0000","last_became_active":"2024-09-12T01:58:32.086444+0000","last_became_peered":"2024-09-12T01:58:32.086444+0000","last_unstale":"2024-09-12T01:58:32.088733+0000","last_undegraded":"2024-09-12T01:58:32.088733+0000","last_fullsized":"2024-09-12T01:58:32.088733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:25.413262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"65'6","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.108469+0000","last_change":"2024-09-12T01:58:31.079583+0000","last_active":"2024-09-12T01:58:32.108469+0000","last_peered":"2024-09-12T01:58:32.108469+0000","last_clean":"2024-09-12T01:58:32.108469+0000","last_became_active":"2024-09-12T01:58:31.079317+0000","last_became_peered":"2024-09-12T01:58:31.079317+0000","last_unstale":"2024-09-12T01:58:32.108469+0000","last_undegraded":"2024-09-12T01:58:32.108469+0000","last_fullsized":"2024-09-12T01:58:32.108469+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:33.047976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.100470+0000","last_change":"2024-09-12T01:58:32.097734+0000","last_active":"2024-09-12T01:58:32.100470+0000","last_peered":"2024-09-12T01:58:32.100470+0000","last_clean":"2024-09-12T01:58:32.100470+0000","last_became_active":"2024-09-12T01:58:32.095245+0000","last_became_peered":"2024-09-12T01:58:32.095245+0000","last_unstale":"2024-09-12T01:58:32.100470+0000","last_undegraded":"2024-09-12T01:58:32.100470+0000","last_fullsized":"2024-09-12T01:58:32.100470+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.009280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.103028+0000","last_change":"2024-09-12T01:58:32.101742+0000","last_active":"2024-09-12T01:58:32.103028+0000","last_peered":"2024-09-12T01:58:32.103028+0000","last_clean":"2024-09-12T01:58:32.103028+0000","last_became_active":"2024-09-12T01:58:32.100985+0000","last_became_peered":"2024-09-12T01:58:32.100985+0000","last_unstale":"2024-09-12T01:58:32.103028+0000","last_undegraded":"2024-09-12T01:58:32.103028+0000","last_fullsized":"2024-09-12T01:58:32.103028+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:06.911951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"65'8","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.097968+0000","last_change":"2024-09-12T01:58:31.080233+0000","last_active":"2024-09-12T01:58:32.097968+0000","last_peered":"2024-09-12T01:58:32.097968+0000","last_clean":"2024-09-12T01:58:32.097968+0000","last_became_active":"2024-09-12T01:58:31.079923+0000","last_became_peered":"2024-09-12T01:58:31.079923+0000","last_unstale":"2024-09-12T01:58:32.097968+0000","last_undegraded":"2024-09-12T01:58:32.097968+0000","last_fullsized":"2024-09-12T01:58:32.097968+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:18.045768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088494+0000","last_change":"2024-09-12T01:58:32.083451+0000","last_active":"2024-09-12T01:58:32.088494+0000","last_peered":"2024-09-12T01:58:32.088494+0000","last_clean":"2024-09-12T01:58:32.088494+0000","last_became_active":"2024-09-12T01:58:32.083176+0000","last_became_peered":"2024-09-12T01:58:32.083176+0000","last_unstale":"2024-09-12T01:58:32.088494+0000","last_undegraded":"2024-09-12T01:58:32.088494+0000","last_fullsized":"2024-09-12T01:58:32.088494+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:29.187288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.077108+0000","last_change":"2024-09-12T01:58:31.074406+0000","last_active":"2024-09-12T01:58:32.077108+0000","last_peered":"2024-09-12T01:58:32.077108+0000","last_clean":"2024-09-12T01:58:32.077108+0000","last_became_active":"2024-09-12T01:58:31.074068+0000","last_became_peered":"2024-09-12T01:58:31.074068+0000","last_unstale":"2024-09-12T01:58:32.077108+0000","last_undegraded":"2024-09-12T01:58:32.077108+0000","last_fullsized":"2024-09-12T01:58:32.077108+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:26.113685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071998+0000","last_change":"2024-09-12T01:58:32.078981+0000","last_active":"2024-09-12T01:58:33.071998+0000","last_peered":"2024-09-12T01:58:33.071998+0000","last_clean":"2024-09-12T01:58:33.071998+0000","last_became_active":"2024-09-12T01:58:32.078680+0000","last_became_peered":"2024-09-12T01:58:32.078680+0000","last_unstale":"2024-09-12T01:58:33.071998+0000","last_undegraded":"2024-09-12T01:58:33.071998+0000","last_fullsized":"2024-09-12T01:58:33.071998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:11.561895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072046+0000","last_change":"2024-09-12T01:58:31.084085+0000","last_active":"2024-09-12T01:58:33.072046+0000","last_peered":"2024-09-12T01:58:33.072046+0000","last_clean":"2024-09-12T01:58:33.072046+0000","last_became_active":"2024-09-12T01:58:31.083740+0000","last_became_peered":"2024-09-12T01:58:31.083740+0000","last_unstale":"2024-09-12T01:58:33.072046+0000","last_undegraded":"2024-09-12T01:58:33.072046+0000","last_fullsized":"2024-09-12T01:58:33.072046+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:23.301991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071936+0000","last_change":"2024-09-12T01:58:31.079762+0000","last_active":"2024-09-12T01:58:33.071936+0000","last_peered":"2024-09-12T01:58:33.071936+0000","last_clean":"2024-09-12T01:58:33.071936+0000","last_became_active":"2024-09-12T01:58:31.079490+0000","last_became_peered":"2024-09-12T01:58:31.079490+0000","last_unstale":"2024-09-12T01:58:33.071936+0000","last_undegraded":"2024-09-12T01:58:33.071936+0000","last_fullsized":"2024-09-12T01:58:33.071936+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:40.366109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072065+0000","last_change":"2024-09-12T01:58:32.088285+0000","last_active":"2024-09-12T01:58:33.072065+0000","last_peered":"2024-09-12T01:58:33.072065+0000","last_clean":"2024-09-12T01:58:33.072065+0000","last_became_active":"2024-09-12T01:58:32.087918+0000","last_became_peered":"2024-09-12T01:58:32.087918+0000","last_unstale":"2024-09-12T01:58:33.072065+0000","last_undegraded":"2024-09-12T01:58:33.072065+0000","last_fullsized":"2024-09-12T01:58:33.072065+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:19.787633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.090260+0000","last_change":"2024-09-12T01:58:32.084136+0000","last_active":"2024-09-12T01:58:32.090260+0000","last_peered":"2024-09-12T01:58:32.090260+0000","last_clean":"2024-09-12T01:58:32.090260+0000","last_became_active":"2024-09-12T01:58:32.083827+0000","last_became_peered":"2024-09-12T01:58:32.083827+0000","last_unstale":"2024-09-12T01:58:32.090260+0000","last_undegraded":"2024-09-12T01:58:32.090260+0000","last_fullsized":"2024-09-12T01:58:32.090260+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:25.550979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072377+0000","last_change":"2024-09-12T01:58:31.086458+0000","last_active":"2024-09-12T01:58:33.072377+0000","last_peered":"2024-09-12T01:58:33.072377+0000","last_clean":"2024-09-12T01:58:33.072377+0000","last_became_active":"2024-09-12T01:58:31.086155+0000","last_became_peered":"2024-09-12T01:58:31.086155+0000","last_unstale":"2024-09-12T01:58:33.072377+0000","last_undegraded":"2024-09-12T01:58:33.072377+0000","last_fullsized":"2024-09-12T01:58:33.072377+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:58.472371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.079990+0000","last_change":"2024-09-12T01:58:31.077535+0000","last_active":"2024-09-12T01:58:32.079990+0000","last_peered":"2024-09-12T01:58:32.079990+0000","last_clean":"2024-09-12T01:58:32.079990+0000","last_became_active":"2024-09-12T01:58:31.077058+0000","last_became_peered":"2024-09-12T01:58:31.077058+0000","last_unstale":"2024-09-12T01:58:32.079990+0000","last_undegraded":"2024-09-12T01:58:32.079990+0000","last_fullsized":"2024-09-12T01:58:32.079990+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:10.416486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:30.054858+0000","last_change":"2024-09-12T01:58:30.054858+0000","last_active":"2024-09-12T01:58:30.054858+0000","last_peered":"2024-09-12T01:58:30.054858+0000","last_clean":"2024-09-12T01:58:30.054858+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:30.054858+0000","last_undegraded":"2024-09-12T01:58:30.054858+0000","last_fullsized":"2024-09-12T01:58:30.054858+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098577+0000","last_change":"2024-09-12T01:58:32.089933+0000","last_active":"2024-09-12T01:58:32.098577+0000","last_peered":"2024-09-12T01:58:32.098577+0000","last_clean":"2024-09-12T01:58:32.098577+0000","last_became_active":"2024-09-12T01:58:32.089694+0000","last_became_peered":"2024-09-12T01:58:32.089694+0000","last_unstale":"2024-09-12T01:58:32.098577+0000","last_undegraded":"2024-09-12T01:58:32.098577+0000","last_fullsized":"2024-09-12T01:58:32.098577+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:34.053253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.076856+0000","last_change":"2024-09-12T01:58:31.076859+0000","last_active":"2024-09-12T01:58:32.076856+0000","last_peered":"2024-09-12T01:58:32.076856+0000","last_clean":"2024-09-12T01:58:32.076856+0000","last_became_active":"2024-09-12T01:58:31.076488+0000","last_became_peered":"2024-09-12T01:58:31.076488+0000","last_unstale":"2024-09-12T01:58:32.076856+0000","last_undegraded":"2024-09-12T01:58:32.076856+0000","last_fullsized":"2024-09-12T01:58:32.076856+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:47.205697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102944+0000","last_change":"2024-09-12T01:58:32.099717+0000","last_active":"2024-09-12T01:58:32.102944+0000","last_peered":"2024-09-12T01:58:32.102944+0000","last_clean":"2024-09-12T01:58:32.102944+0000","last_became_active":"2024-09-12T01:58:32.099398+0000","last_became_peered":"2024-09-12T01:58:32.099398+0000","last_unstale":"2024-09-12T01:58:32.102944+0000","last_undegraded":"2024-09-12T01:58:32.102944+0000","last_fullsized":"2024-09-12T01:58:32.102944+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:53.481574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.077079+0000","last_change":"2024-09-12T01:58:31.078174+0000","last_active":"2024-09-12T01:58:32.077079+0000","last_peered":"2024-09-12T01:58:32.077079+0000","last_clean":"2024-09-12T01:58:32.077079+0000","last_became_active":"2024-09-12T01:58:31.077722+0000","last_became_peered":"2024-09-12T01:58:31.077722+0000","last_unstale":"2024-09-12T01:58:32.077079+0000","last_undegraded":"2024-09-12T01:58:32.077079+0000","last_fullsized":"2024-09-12T01:58:32.077079+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:04.459773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098702+0000","last_change":"2024-09-12T01:58:32.092706+0000","last_active":"2024-09-12T01:58:32.098702+0000","last_peered":"2024-09-12T01:58:32.098702+0000","last_clean":"2024-09-12T01:58:32.098702+0000","last_became_active":"2024-09-12T01:58:32.092407+0000","last_became_peered":"2024-09-12T01:58:32.092407+0000","last_unstale":"2024-09-12T01:58:32.098702+0000","last_undegraded":"2024-09-12T01:58:32.098702+0000","last_fullsized":"2024-09-12T01:58:32.098702+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:28.935380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.079005+0000","last_change":"2024-09-12T01:58:31.083451+0000","last_active":"2024-09-12T01:58:32.079005+0000","last_peered":"2024-09-12T01:58:32.079005+0000","last_clean":"2024-09-12T01:58:32.079005+0000","last_became_active":"2024-09-12T01:58:31.083133+0000","last_became_peered":"2024-09-12T01:58:31.083133+0000","last_unstale":"2024-09-12T01:58:32.079005+0000","last_undegraded":"2024-09-12T01:58:32.079005+0000","last_fullsized":"2024-09-12T01:58:32.079005+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:21.347164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:58:31.060135+0000","last_change":"2024-09-12T01:58:31.060135+0000","last_active":"2024-09-12T01:58:31.060135+0000","last_peered":"2024-09-12T01:58:31.060135+0000","last_clean":"2024-09-12T01:58:31.060135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:31.060135+0000","last_undegraded":"2024-09-12T01:58:31.060135+0000","last_fullsized":"2024-09-12T01:58:31.060135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.076598+0000","last_change":"2024-09-12T01:58:31.084470+0000","last_active":"2024-09-12T01:58:32.076598+0000","last_peered":"2024-09-12T01:58:32.076598+0000","last_clean":"2024-09-12T01:58:32.076598+0000","last_became_active":"2024-09-12T01:58:31.084172+0000","last_became_peered":"2024-09-12T01:58:31.084172+0000","last_unstale":"2024-09-12T01:58:32.076598+0000","last_undegraded":"2024-09-12T01:58:32.076598+0000","last_fullsized":"2024-09-12T01:58:32.076598+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:29.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":243,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-12T01:58:28.469115+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:58:28.469115+0000","last_peered":"2024-09-12T01:58:28.469115+0000","last_clean":"2024-09-12T01:58:28.469115+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:58:28.469115+0000","last_undegraded":"2024-09-12T01:58:28.469115+0000","last_fullsized":"2024-09-12T01:58:28.469115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":66,"acting":66,"num_store_stats":5},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2194,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":38,"acting":38,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1335296,"data_stored":923059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27764,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":741376,"data_stored":332691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":332691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542182,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":778240,"data_stored":352726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":778240,"data_stored":352726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":806912,"data_stored":355102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542182,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1372160,"data_stored":943094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":765952,"data_stored":345559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:58:35.771 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3d is not active+clean 2024-09-12T01:58:35.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.771 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3b is not active+clean 2024-09-12T01:58:35.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.771 INFO:tasks.ceph.ceph_manager.ceph:PG 10.38 is not active+clean 2024-09-12T01:58:35.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.772 INFO:tasks.ceph.ceph_manager.ceph:PG 10.37 is not active+clean 2024-09-12T01:58:35.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.772 INFO:tasks.ceph.ceph_manager.ceph:PG 10.36 is not active+clean 2024-09-12T01:58:35.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.772 INFO:tasks.ceph.ceph_manager.ceph:PG 10.34 is not active+clean 2024-09-12T01:58:35.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.772 INFO:tasks.ceph.ceph_manager.ceph:PG 10.33 is not active+clean 2024-09-12T01:58:35.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.772 INFO:tasks.ceph.ceph_manager.ceph:PG 10.32 is not active+clean 2024-09-12T01:58:35.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.772 INFO:tasks.ceph.ceph_manager.ceph:PG 10.31 is not active+clean 2024-09-12T01:58:35.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.773 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2d is not active+clean 2024-09-12T01:58:35.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.773 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2b is not active+clean 2024-09-12T01:58:35.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.773 INFO:tasks.ceph.ceph_manager.ceph:PG 10.28 is not active+clean 2024-09-12T01:58:35.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.773 INFO:tasks.ceph.ceph_manager.ceph:PG 10.27 is not active+clean 2024-09-12T01:58:35.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.773 INFO:tasks.ceph.ceph_manager.ceph:PG 10.26 is not active+clean 2024-09-12T01:58:35.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.773 INFO:tasks.ceph.ceph_manager.ceph:PG 10.23 is not active+clean 2024-09-12T01:58:35.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.774 INFO:tasks.ceph.ceph_manager.ceph:PG 10.22 is not active+clean 2024-09-12T01:58:35.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.774 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1c is not active+clean 2024-09-12T01:58:35.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.774 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1f is not active+clean 2024-09-12T01:58:35.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.774 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1a is not active+clean 2024-09-12T01:58:35.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.774 INFO:tasks.ceph.ceph_manager.ceph:PG 9.18 is not active+clean 2024-09-12T01:58:35.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:30.054858+0000', 'last_change': '2024-09-12T01:58:30.054858+0000', 'last_active': '2024-09-12T01:58:30.054858+0000', 'last_peered': '2024-09-12T01:58:30.054858+0000', 'last_clean': '2024-09-12T01:58:30.054858+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:30.054858+0000', 'last_undegraded': '2024-09-12T01:58:30.054858+0000', 'last_fullsized': '2024-09-12T01:58:30.054858+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.774 INFO:tasks.ceph.ceph_manager.ceph:PG 9.17 is not active+clean 2024-09-12T01:58:35.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:30.054858+0000', 'last_change': '2024-09-12T01:58:30.054858+0000', 'last_active': '2024-09-12T01:58:30.054858+0000', 'last_peered': '2024-09-12T01:58:30.054858+0000', 'last_clean': '2024-09-12T01:58:30.054858+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:30.054858+0000', 'last_undegraded': '2024-09-12T01:58:30.054858+0000', 'last_fullsized': '2024-09-12T01:58:30.054858+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.775 INFO:tasks.ceph.ceph_manager.ceph:PG 10.16 is not active+clean 2024-09-12T01:58:35.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.775 INFO:tasks.ceph.ceph_manager.ceph:PG 9.15 is not active+clean 2024-09-12T01:58:35.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:30.054858+0000', 'last_change': '2024-09-12T01:58:30.054858+0000', 'last_active': '2024-09-12T01:58:30.054858+0000', 'last_peered': '2024-09-12T01:58:30.054858+0000', 'last_clean': '2024-09-12T01:58:30.054858+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:30.054858+0000', 'last_undegraded': '2024-09-12T01:58:30.054858+0000', 'last_fullsized': '2024-09-12T01:58:30.054858+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.775 INFO:tasks.ceph.ceph_manager.ceph:PG 9.13 is not active+clean 2024-09-12T01:58:35.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:30.054858+0000', 'last_change': '2024-09-12T01:58:30.054858+0000', 'last_active': '2024-09-12T01:58:30.054858+0000', 'last_peered': '2024-09-12T01:58:30.054858+0000', 'last_clean': '2024-09-12T01:58:30.054858+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:30.054858+0000', 'last_undegraded': '2024-09-12T01:58:30.054858+0000', 'last_fullsized': '2024-09-12T01:58:30.054858+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.775 INFO:tasks.ceph.ceph_manager.ceph:PG 10.11 is not active+clean 2024-09-12T01:58:35.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.775 INFO:tasks.ceph.ceph_manager.ceph:PG 9.12 is not active+clean 2024-09-12T01:58:35.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:30.054858+0000', 'last_change': '2024-09-12T01:58:30.054858+0000', 'last_active': '2024-09-12T01:58:30.054858+0000', 'last_peered': '2024-09-12T01:58:30.054858+0000', 'last_clean': '2024-09-12T01:58:30.054858+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:30.054858+0000', 'last_undegraded': '2024-09-12T01:58:30.054858+0000', 'last_fullsized': '2024-09-12T01:58:30.054858+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.775 INFO:tasks.ceph.ceph_manager.ceph:PG 10.12 is not active+clean 2024-09-12T01:58:35.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.776 INFO:tasks.ceph.ceph_manager.ceph:PG 9.11 is not active+clean 2024-09-12T01:58:35.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:30.054858+0000', 'last_change': '2024-09-12T01:58:30.054858+0000', 'last_active': '2024-09-12T01:58:30.054858+0000', 'last_peered': '2024-09-12T01:58:30.054858+0000', 'last_clean': '2024-09-12T01:58:30.054858+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:30.054858+0000', 'last_undegraded': '2024-09-12T01:58:30.054858+0000', 'last_fullsized': '2024-09-12T01:58:30.054858+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.776 INFO:tasks.ceph.ceph_manager.ceph:PG 10.c is not active+clean 2024-09-12T01:58:35.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.776 INFO:tasks.ceph.ceph_manager.ceph:PG 9.f is not active+clean 2024-09-12T01:58:35.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:30.054858+0000', 'last_change': '2024-09-12T01:58:30.054858+0000', 'last_active': '2024-09-12T01:58:30.054858+0000', 'last_peered': '2024-09-12T01:58:30.054858+0000', 'last_clean': '2024-09-12T01:58:30.054858+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:30.054858+0000', 'last_undegraded': '2024-09-12T01:58:30.054858+0000', 'last_fullsized': '2024-09-12T01:58:30.054858+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.776 INFO:tasks.ceph.ceph_manager.ceph:PG 10.d is not active+clean 2024-09-12T01:58:35.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.776 INFO:tasks.ceph.ceph_manager.ceph:PG 9.e is not active+clean 2024-09-12T01:58:35.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:30.054858+0000', 'last_change': '2024-09-12T01:58:30.054858+0000', 'last_active': '2024-09-12T01:58:30.054858+0000', 'last_peered': '2024-09-12T01:58:30.054858+0000', 'last_clean': '2024-09-12T01:58:30.054858+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:30.054858+0000', 'last_undegraded': '2024-09-12T01:58:30.054858+0000', 'last_fullsized': '2024-09-12T01:58:30.054858+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.776 INFO:tasks.ceph.ceph_manager.ceph:PG 9.d is not active+clean 2024-09-12T01:58:35.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:30.054858+0000', 'last_change': '2024-09-12T01:58:30.054858+0000', 'last_active': '2024-09-12T01:58:30.054858+0000', 'last_peered': '2024-09-12T01:58:30.054858+0000', 'last_clean': '2024-09-12T01:58:30.054858+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:30.054858+0000', 'last_undegraded': '2024-09-12T01:58:30.054858+0000', 'last_fullsized': '2024-09-12T01:58:30.054858+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.777 INFO:tasks.ceph.ceph_manager.ceph:PG 10.f is not active+clean 2024-09-12T01:58:35.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.777 INFO:tasks.ceph.ceph_manager.ceph:PG 10.9 is not active+clean 2024-09-12T01:58:35.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.777 INFO:tasks.ceph.ceph_manager.ceph:PG 9.a is not active+clean 2024-09-12T01:58:35.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:30.054858+0000', 'last_change': '2024-09-12T01:58:30.054858+0000', 'last_active': '2024-09-12T01:58:30.054858+0000', 'last_peered': '2024-09-12T01:58:30.054858+0000', 'last_clean': '2024-09-12T01:58:30.054858+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:30.054858+0000', 'last_undegraded': '2024-09-12T01:58:30.054858+0000', 'last_fullsized': '2024-09-12T01:58:30.054858+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.777 INFO:tasks.ceph.ceph_manager.ceph:PG 10.a is not active+clean 2024-09-12T01:58:35.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.777 INFO:tasks.ceph.ceph_manager.ceph:PG 9.7 is not active+clean 2024-09-12T01:58:35.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:30.054858+0000', 'last_change': '2024-09-12T01:58:30.054858+0000', 'last_active': '2024-09-12T01:58:30.054858+0000', 'last_peered': '2024-09-12T01:58:30.054858+0000', 'last_clean': '2024-09-12T01:58:30.054858+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:30.054858+0000', 'last_undegraded': '2024-09-12T01:58:30.054858+0000', 'last_fullsized': '2024-09-12T01:58:30.054858+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.777 INFO:tasks.ceph.ceph_manager.ceph:PG 9.6 is not active+clean 2024-09-12T01:58:35.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:30.054858+0000', 'last_change': '2024-09-12T01:58:30.054858+0000', 'last_active': '2024-09-12T01:58:30.054858+0000', 'last_peered': '2024-09-12T01:58:30.054858+0000', 'last_clean': '2024-09-12T01:58:30.054858+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:30.054858+0000', 'last_undegraded': '2024-09-12T01:58:30.054858+0000', 'last_fullsized': '2024-09-12T01:58:30.054858+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.778 INFO:tasks.ceph.ceph_manager.ceph:PG 10.6 is not active+clean 2024-09-12T01:58:35.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.778 INFO:tasks.ceph.ceph_manager.ceph:PG 10.7 is not active+clean 2024-09-12T01:58:35.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.778 INFO:tasks.ceph.ceph_manager.ceph:PG 10.0 is not active+clean 2024-09-12T01:58:35.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.778 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3 is not active+clean 2024-09-12T01:58:35.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:30.054858+0000', 'last_change': '2024-09-12T01:58:30.054858+0000', 'last_active': '2024-09-12T01:58:30.054858+0000', 'last_peered': '2024-09-12T01:58:30.054858+0000', 'last_clean': '2024-09-12T01:58:30.054858+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:30.054858+0000', 'last_undegraded': '2024-09-12T01:58:30.054858+0000', 'last_fullsized': '2024-09-12T01:58:30.054858+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.778 INFO:tasks.ceph.ceph_manager.ceph:PG 10.b is not active+clean 2024-09-12T01:58:35.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:58:31.060135+0000', 'last_change': '2024-09-12T01:58:31.060135+0000', 'last_active': '2024-09-12T01:58:31.060135+0000', 'last_peered': '2024-09-12T01:58:31.060135+0000', 'last_clean': '2024-09-12T01:58:31.060135+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:31.060135+0000', 'last_undegraded': '2024-09-12T01:58:31.060135+0000', 'last_fullsized': '2024-09-12T01:58:31.060135+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:58:35.779 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T01:58:35.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.909+0000 7f20abc23640 1 Processor -- start 2024-09-12T01:58:35.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.909+0000 7f20abc23640 1 -- start start 2024-09-12T01:58:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.910+0000 7f20abc23640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f20a415e5d0 0x7f20a40d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.910+0000 7f20abc23640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f20a409b140 0x7f20a4168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.910+0000 7f20abc23640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20a406cec0 con 0x7f20a406df60 2024-09-12T01:58:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.910+0000 7f20abc23640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f20a406dad0 con 0x7f20a409b140 2024-09-12T01:58:35.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.910+0000 7f20abc23640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f20a406d1a0 con 0x7f20a415e5d0 2024-09-12T01:58:35.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.910+0000 7f20aa1c0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f20a409b140 0x7f20a4168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:35.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.910+0000 7f20aa1c0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f20a409b140 0x7f20a4168560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35946/0 (socket says 172.21.15.19:35946) 2024-09-12T01:58:35.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.910+0000 7f20aa1c0640 1 -- 172.21.15.19:0/931028770 learned_addr learned my addr 172.21.15.19:0/931028770 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:35.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.910+0000 7f20a99bf640 1 --2- 172.21.15.19:0/931028770 >> v2:172.21.15.135:3300/0 conn(0x7f20a415e5d0 0x7f20a40d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:35.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.910+0000 7f20aa1c0640 1 -- 172.21.15.19:0/931028770 >> v2:172.21.15.135:3300/0 conn(0x7f20a415e5d0 msgr2=0x7f20a40d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:35.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.910+0000 7f20aa1c0640 1 --2- 172.21.15.19:0/931028770 >> v2:172.21.15.135:3300/0 conn(0x7f20a415e5d0 0x7f20a40d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.910+0000 7f20aa1c0640 1 -- 172.21.15.19:0/931028770 >> v1:172.21.15.135:6789/0 conn(0x7f20a406df60 legacy=0x7f20a409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:35.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.910+0000 7f20aa1c0640 1 -- 172.21.15.19:0/931028770 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a406d480 con 0x7f20a409b140 2024-09-12T01:58:35.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.911+0000 7f20aa1c0640 1 --2- 172.21.15.19:0/931028770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a409b140 0x7f20a4168560 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f209c009e50 tx=0x7f209c02a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f16e10f71c8c0fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:35.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.911+0000 7f20a89bd640 1 -- 172.21.15.19:0/931028770 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c036070 con 0x7f20a409b140 2024-09-12T01:58:35.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.911+0000 7f20a89bd640 1 -- 172.21.15.19:0/931028770 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c031600 con 0x7f20a409b140 2024-09-12T01:58:35.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.911+0000 7f20a89bd640 1 -- 172.21.15.19:0/931028770 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c0319d0 con 0x7f20a409b140 2024-09-12T01:58:35.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.912+0000 7f20abc23640 1 -- 172.21.15.19:0/931028770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a409b140 msgr2=0x7f20a4168560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:35.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.912+0000 7f20abc23640 1 --2- 172.21.15.19:0/931028770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a409b140 0x7f20a4168560 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f209c009e50 tx=0x7f209c02a7f0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.912+0000 7f20abc23640 1 -- 172.21.15.19:0/931028770 shutdown_connections 2024-09-12T01:58:35.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.912+0000 7f20abc23640 1 --2- 172.21.15.19:0/931028770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a409b140 0x7f20a4168560 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.912+0000 7f20abc23640 1 --2- 172.21.15.19:0/931028770 >> v2:172.21.15.135:3300/0 conn(0x7f20a415e5d0 0x7f20a40d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.912+0000 7f20abc23640 1 -- 172.21.15.19:0/931028770 >> 172.21.15.19:0/931028770 conn(0x7f20a40d23a0 msgr2=0x7f20a40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:35.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.912+0000 7f20abc23640 1 -- 172.21.15.19:0/931028770 shutdown_connections 2024-09-12T01:58:35.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.912+0000 7f20abc23640 1 -- 172.21.15.19:0/931028770 wait complete. 2024-09-12T01:58:35.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.913+0000 7f20abc23640 1 Processor -- start 2024-09-12T01:58:35.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.913+0000 7f20abc23640 1 -- start start 2024-09-12T01:58:35.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20abc23640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20a406df60 0x7f20a40b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20abc23640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20a409b140 0x7f20a4157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20abc23640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a415e5d0 0x7f20a40b7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20abc23640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f20a415eb30 con 0x7f20a415e5d0 2024-09-12T01:58:35.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20abc23640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f20a415e9b0 con 0x7f20a409b140 2024-09-12T01:58:35.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20abc23640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f20a40d1630 con 0x7f20a406df60 2024-09-12T01:58:35.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20aa1c0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a415e5d0 0x7f20a40b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:35.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20aa1c0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a415e5d0 0x7f20a40b7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35956/0 (socket says 172.21.15.19:35956) 2024-09-12T01:58:35.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20aa1c0640 1 -- 172.21.15.19:0/467045145 learned_addr learned my addr 172.21.15.19:0/467045145 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:35.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20a99bf640 1 --2- 172.21.15.19:0/467045145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20a406df60 0x7f20a40b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:35.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20a91be640 1 --2- 172.21.15.19:0/467045145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20a409b140 0x7f20a4157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:35.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20aa1c0640 1 -- 172.21.15.19:0/467045145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20a406df60 msgr2=0x7f20a40b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:35.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20aa1c0640 1 --2- 172.21.15.19:0/467045145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20a406df60 0x7f20a40b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20aa1c0640 1 -- 172.21.15.19:0/467045145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20a409b140 msgr2=0x7f20a4157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:35.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20aa1c0640 1 --2- 172.21.15.19:0/467045145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20a409b140 0x7f20a4157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:35.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20aa1c0640 1 -- 172.21.15.19:0/467045145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a40b5dc0 con 0x7f20a415e5d0 2024-09-12T01:58:35.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20a91be640 1 --2- 172.21.15.19:0/467045145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20a409b140 0x7f20a4157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:35.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20a99bf640 1 --2- 172.21.15.19:0/467045145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20a406df60 0x7f20a40b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:35.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.914+0000 7f20aa1c0640 1 --2- 172.21.15.19:0/467045145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a415e5d0 0x7f20a40b7660 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f209c009f70 tx=0x7f209c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:35.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.915+0000 7f20967fc640 1 -- 172.21.15.19:0/467045145 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c040030 con 0x7f20a415e5d0 2024-09-12T01:58:35.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.915+0000 7f20967fc640 1 -- 172.21.15.19:0/467045145 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c031400 con 0x7f20a415e5d0 2024-09-12T01:58:35.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.915+0000 7f20abc23640 1 -- 172.21.15.19:0/467045145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a40b60a0 con 0x7f20a415e5d0 2024-09-12T01:58:35.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.915+0000 7f20967fc640 1 -- 172.21.15.19:0/467045145 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c036040 con 0x7f20a415e5d0 2024-09-12T01:58:35.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.915+0000 7f20abc23640 1 -- 172.21.15.19:0/467045145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a41e4880 con 0x7f20a415e5d0 2024-09-12T01:58:35.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.916+0000 7f20abc23640 1 -- 172.21.15.19:0/467045145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a40d10f0 con 0x7f20a415e5d0 2024-09-12T01:58:35.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.916+0000 7f20967fc640 1 -- 172.21.15.19:0/467045145 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f209c043070 con 0x7f20a415e5d0 2024-09-12T01:58:35.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.917+0000 7f20967fc640 1 --2- 172.21.15.19:0/467045145 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f208806be30 0x7f208806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:35.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.917+0000 7f20967fc640 1 -- 172.21.15.19:0/467045145 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6101+0+0 (secure 0 0 0) 0x7f209c0ab230 con 0x7f20a415e5d0 2024-09-12T01:58:35.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.917+0000 7f20a99bf640 1 --2- 172.21.15.19:0/467045145 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f208806be30 0x7f208806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:35.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.917+0000 7f20a99bf640 1 --2- 172.21.15.19:0/467045145 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f208806be30 0x7f208806e2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2098009af0 tx=0x7f2098008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:35.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:35.921+0000 7f20967fc640 1 -- 172.21.15.19:0/467045145 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f209c04b020 con 0x7f20a415e5d0 2024-09-12T01:58:36.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.167+0000 7f20abc23640 1 -- 172.21.15.19:0/467045145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f20a40b8320 con 0x7f20a415e5d0 2024-09-12T01:58:36.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.168+0000 7f20967fc640 1 -- 172.21.15.19:0/467045145 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1131 (secure 0 0 0) 0x7f209c079a00 con 0x7f20a415e5d0 2024-09-12T01:58:36.168 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:36.168 INFO:teuthology.orchestra.run.smithi019.stdout:{"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":184,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":66,"num_osds":8,"num_up_osds":8,"osd_up_since":1726106143,"num_in_osds":8,"osd_in_since":1726106133,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":53},{"state_name":"unknown","count":44}],"num_pgs":97,"num_pools":3,"num_objects":15,"data_bytes":592562,"bytes_used":237293568,"bytes_avail":772856819712,"bytes_total":773094113280,"unknown_pgs_ratio":0.45360824465751648,"write_bytes_sec":1008,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":41,"btime":"2024-09-12T01:58:34:091092+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5868}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-12T01:57:44.109844+0000","services":{}},"progress_events":{}} 2024-09-12T01:58:36.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.170+0000 7f20abc23640 1 -- 172.21.15.19:0/467045145 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f208806be30 msgr2=0x7f208806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:36.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.170+0000 7f20abc23640 1 --2- 172.21.15.19:0/467045145 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f208806be30 0x7f208806e2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2098009af0 tx=0x7f2098008040 comp rx=0 tx=0).stop 2024-09-12T01:58:36.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.170+0000 7f20abc23640 1 -- 172.21.15.19:0/467045145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a415e5d0 msgr2=0x7f20a40b7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:36.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.170+0000 7f20abc23640 1 --2- 172.21.15.19:0/467045145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a415e5d0 0x7f20a40b7660 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f209c009f70 tx=0x7f209c004a40 comp rx=0 tx=0).stop 2024-09-12T01:58:36.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.170+0000 7f20abc23640 1 -- 172.21.15.19:0/467045145 shutdown_connections 2024-09-12T01:58:36.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.170+0000 7f20abc23640 1 --2- 172.21.15.19:0/467045145 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f208806be30 0x7f208806e2f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.170+0000 7f20abc23640 1 --2- 172.21.15.19:0/467045145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a415e5d0 0x7f20a40b7660 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.170+0000 7f20abc23640 1 --2- 172.21.15.19:0/467045145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20a409b140 0x7f20a4157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.170+0000 7f20abc23640 1 --2- 172.21.15.19:0/467045145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20a406df60 0x7f20a40b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.170+0000 7f20abc23640 1 -- 172.21.15.19:0/467045145 >> 172.21.15.19:0/467045145 conn(0x7f20a40d23a0 msgr2=0x7f20a409aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:36.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.170+0000 7f20abc23640 1 -- 172.21.15.19:0/467045145 shutdown_connections 2024-09-12T01:58:36.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.170+0000 7f20abc23640 1 -- 172.21.15.19:0/467045145 wait complete. 2024-09-12T01:58:36.181 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T01:58:36.182 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:58:36.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.283+0000 7ff39021e640 1 Processor -- start 2024-09-12T01:58:36.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.283+0000 7ff39021e640 1 -- start start 2024-09-12T01:58:36.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.284+0000 7ff39021e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff3880d30f0 0x7ff3880b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:36.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.284+0000 7ff39021e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3880b64c0 0x7ff38806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:36.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.284+0000 7ff39021e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3880d3690 con 0x7ff38815e5f0 2024-09-12T01:58:36.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.284+0000 7ff39021e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff38806d530 con 0x7ff3880d30f0 2024-09-12T01:58:36.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.284+0000 7ff39021e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff3880d3970 con 0x7ff3880b64c0 2024-09-12T01:58:36.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.284+0000 7ff38d7b9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff3880d30f0 0x7ff3880b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:36.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.284+0000 7ff38dfba640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff38815e5f0 0x7ff3880d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38362/0 (socket says 172.21.15.19:38362) 2024-09-12T01:58:36.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.284+0000 7ff38dfba640 1 -- 172.21.15.19:0/650353350 learned_addr learned my addr 172.21.15.19:0/650353350 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:36.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.285+0000 7ff38e7bb640 1 --2- 172.21.15.19:0/650353350 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3880b64c0 0x7ff38806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:36.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.285+0000 7ff38d7b9640 1 -- 172.21.15.19:0/650353350 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3880b64c0 msgr2=0x7ff38806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:36.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.285+0000 7ff38d7b9640 1 --2- 172.21.15.19:0/650353350 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3880b64c0 0x7ff38806d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.285+0000 7ff38d7b9640 1 -- 172.21.15.19:0/650353350 >> v1:172.21.15.19:6789/0 conn(0x7ff38815e5f0 legacy=0x7ff3880d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:36.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.285+0000 7ff38d7b9640 1 -- 172.21.15.19:0/650353350 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38806cee0 con 0x7ff3880d30f0 2024-09-12T01:58:36.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.285+0000 7ff38cfb8640 1 -- 172.21.15.19:0/650353350 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2215651719 0 0) 0x7ff3880d3690 con 0x7ff38815e5f0 2024-09-12T01:58:36.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.285+0000 7ff38e7bb640 1 --2- 172.21.15.19:0/650353350 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3880b64c0 0x7ff38806d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:36.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.285+0000 7ff38d7b9640 1 --2- 172.21.15.19:0/650353350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3880d30f0 0x7ff3880b5f80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff37c0097a0 tx=0x7ff37c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1208818810be5d76 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:36.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.286+0000 7ff38cfb8640 1 -- 172.21.15.19:0/650353350 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37c037070 con 0x7ff3880d30f0 2024-09-12T01:58:36.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.286+0000 7ff38cfb8640 1 -- 172.21.15.19:0/650353350 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37c032440 con 0x7ff3880d30f0 2024-09-12T01:58:36.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.286+0000 7ff38cfb8640 1 -- 172.21.15.19:0/650353350 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37c032810 con 0x7ff3880d30f0 2024-09-12T01:58:36.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.286+0000 7ff39021e640 1 -- 172.21.15.19:0/650353350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3880d30f0 msgr2=0x7ff3880b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:36.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.286+0000 7ff39021e640 1 --2- 172.21.15.19:0/650353350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3880d30f0 0x7ff3880b5f80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff37c0097a0 tx=0x7ff37c02a180 comp rx=0 tx=0).stop 2024-09-12T01:58:36.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.286+0000 7ff39021e640 1 -- 172.21.15.19:0/650353350 shutdown_connections 2024-09-12T01:58:36.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.286+0000 7ff39021e640 1 --2- 172.21.15.19:0/650353350 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3880b64c0 0x7ff38806d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.286+0000 7ff39021e640 1 --2- 172.21.15.19:0/650353350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3880d30f0 0x7ff3880b5f80 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.286+0000 7ff39021e640 1 -- 172.21.15.19:0/650353350 >> 172.21.15.19:0/650353350 conn(0x7ff38808bfc0 msgr2=0x7ff3880d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:36.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.286+0000 7ff39021e640 1 -- 172.21.15.19:0/650353350 shutdown_connections 2024-09-12T01:58:36.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.286+0000 7ff39021e640 1 -- 172.21.15.19:0/650353350 wait complete. 2024-09-12T01:58:36.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.287+0000 7ff39021e640 1 Processor -- start 2024-09-12T01:58:36.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.287+0000 7ff39021e640 1 -- start start 2024-09-12T01:58:36.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.288+0000 7ff39021e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3880b64c0 0x7ff3881f0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:36.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.288+0000 7ff39021e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3880d30f0 0x7ff3881f13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:36.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.288+0000 7ff39021e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff38815e5f0 0x7ff3881f7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:36.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.288+0000 7ff39021e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff38806df00 con 0x7ff3880b64c0 2024-09-12T01:58:36.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.288+0000 7ff39021e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff38815e9d0 con 0x7ff3880d30f0 2024-09-12T01:58:36.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.288+0000 7ff39021e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff38806e080 con 0x7ff38815e5f0 2024-09-12T01:58:36.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.288+0000 7ff38dfba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3880b64c0 0x7ff3881f0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:36.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.288+0000 7ff38dfba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3880b64c0 0x7ff3881f0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35972/0 (socket says 172.21.15.19:35972) 2024-09-12T01:58:36.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.288+0000 7ff38dfba640 1 -- 172.21.15.19:0/3890733342 learned_addr learned my addr 172.21.15.19:0/3890733342 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:36.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.288+0000 7ff38e7bb640 1 --2- 172.21.15.19:0/3890733342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff38815e5f0 0x7ff3881f7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:36.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.288+0000 7ff38d7b9640 1 --2- 172.21.15.19:0/3890733342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3880d30f0 0x7ff3881f13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:36.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.288+0000 7ff38dfba640 1 -- 172.21.15.19:0/3890733342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff38815e5f0 msgr2=0x7ff3881f7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:36.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.289+0000 7ff38dfba640 1 --2- 172.21.15.19:0/3890733342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff38815e5f0 0x7ff3881f7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.289+0000 7ff38dfba640 1 -- 172.21.15.19:0/3890733342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3880d30f0 msgr2=0x7ff3881f13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:36.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.289+0000 7ff38dfba640 1 --2- 172.21.15.19:0/3890733342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3880d30f0 0x7ff3881f13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.289+0000 7ff38dfba640 1 -- 172.21.15.19:0/3890733342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3880ca740 con 0x7ff3880b64c0 2024-09-12T01:58:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.289+0000 7ff38d7b9640 1 --2- 172.21.15.19:0/3890733342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3880d30f0 0x7ff3881f13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.289+0000 7ff38dfba640 1 --2- 172.21.15.19:0/3890733342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3880b64c0 0x7ff3881f0ea0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff37800c7c0 tx=0x7ff37800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.289+0000 7ff3867fc640 1 -- 172.21.15.19:0/3890733342 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378018070 con 0x7ff3880b64c0 2024-09-12T01:58:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.289+0000 7ff3867fc640 1 -- 172.21.15.19:0/3890733342 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37800a640 con 0x7ff3880b64c0 2024-09-12T01:58:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.289+0000 7ff39021e640 1 -- 172.21.15.19:0/3890733342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3880caa20 con 0x7ff3880b64c0 2024-09-12T01:58:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.289+0000 7ff3867fc640 1 -- 172.21.15.19:0/3890733342 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37800aa30 con 0x7ff3880b64c0 2024-09-12T01:58:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.289+0000 7ff39021e640 1 -- 172.21.15.19:0/3890733342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff388161a70 con 0x7ff3880b64c0 2024-09-12T01:58:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.290+0000 7ff39021e640 1 -- 172.21.15.19:0/3890733342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3880d3690 con 0x7ff3880b64c0 2024-09-12T01:58:36.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.290+0000 7ff3867fc640 1 -- 172.21.15.19:0/3890733342 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff37801b070 con 0x7ff3880b64c0 2024-09-12T01:58:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.291+0000 7ff3867fc640 1 --2- 172.21.15.19:0/3890733342 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff37406be30 0x7ff37406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.291+0000 7ff3867fc640 1 -- 172.21.15.19:0/3890733342 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6101+0+0 (secure 0 0 0) 0x7ff37808a5f0 con 0x7ff3880b64c0 2024-09-12T01:58:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.291+0000 7ff38d7b9640 1 --2- 172.21.15.19:0/3890733342 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff37406be30 0x7ff37406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.291+0000 7ff38d7b9640 1 --2- 172.21.15.19:0/3890733342 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff37406be30 0x7ff37406e2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff37c034000 tx=0x7ff37c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:36.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.295+0000 7ff3867fc640 1 -- 172.21.15.19:0/3890733342 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff378058ea0 con 0x7ff3880b64c0 2024-09-12T01:58:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.466+0000 7ff39021e640 1 -- 172.21.15.19:0/3890733342 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff3880c85f0 con 0x7ff37406be30 2024-09-12T01:58:36.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.472+0000 7ff3867fc640 1 -- 172.21.15.19:0/3890733342 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251985 (secure 0 0 0) 0x7ff3880c85f0 con 0x7ff37406be30 2024-09-12T01:58:36.475 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:36.476 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:58:36.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.475+0000 7ff39021e640 1 -- 172.21.15.19:0/3890733342 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff37406be30 msgr2=0x7ff37406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:36.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.475+0000 7ff39021e640 1 --2- 172.21.15.19:0/3890733342 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff37406be30 0x7ff37406e2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff37c034000 tx=0x7ff37c02e000 comp rx=0 tx=0).stop 2024-09-12T01:58:36.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.475+0000 7ff39021e640 1 -- 172.21.15.19:0/3890733342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3880b64c0 msgr2=0x7ff3881f0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:36.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.475+0000 7ff39021e640 1 --2- 172.21.15.19:0/3890733342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3880b64c0 0x7ff3881f0ea0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff37800c7c0 tx=0x7ff37800cc80 comp rx=0 tx=0).stop 2024-09-12T01:58:36.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.475+0000 7ff39021e640 1 -- 172.21.15.19:0/3890733342 shutdown_connections 2024-09-12T01:58:36.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.475+0000 7ff39021e640 1 --2- 172.21.15.19:0/3890733342 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff37406be30 0x7ff37406e2f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.475+0000 7ff39021e640 1 --2- 172.21.15.19:0/3890733342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff38815e5f0 0x7ff3881f7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.475+0000 7ff39021e640 1 --2- 172.21.15.19:0/3890733342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3880d30f0 0x7ff3881f13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.475+0000 7ff39021e640 1 --2- 172.21.15.19:0/3890733342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3880b64c0 0x7ff3881f0ea0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.475+0000 7ff39021e640 1 -- 172.21.15.19:0/3890733342 >> 172.21.15.19:0/3890733342 conn(0x7ff38808bfc0 msgr2=0x7ff3880cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:36.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.475+0000 7ff39021e640 1 -- 172.21.15.19:0/3890733342 shutdown_connections 2024-09-12T01:58:36.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:36.475+0000 7ff39021e640 1 -- 172.21.15.19:0/3890733342 wait complete. 2024-09-12T01:58:36.486 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-09-12T01:58:36.121531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231892,"kb_used_data":7304,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742828,"statfs":{"total":773094113280,"available":772856655872,"internally_reserved":0,"allocated":7479296,"data_stored":4011969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001221"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102871+0000","last_change":"2024-09-12T01:58:32.098775+0000","last_active":"2024-09-12T01:58:32.102871+0000","last_peered":"2024-09-12T01:58:32.102871+0000","last_clean":"2024-09-12T01:58:32.102871+0000","last_became_active":"2024-09-12T01:58:32.098472+0000","last_became_peered":"2024-09-12T01:58:32.098472+0000","last_unstale":"2024-09-12T01:58:32.102871+0000","last_undegraded":"2024-09-12T01:58:32.102871+0000","last_fullsized":"2024-09-12T01:58:32.102871+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:25.908231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098986+0000","last_change":"2024-09-12T01:58:32.092794+0000","last_active":"2024-09-12T01:58:32.098986+0000","last_peered":"2024-09-12T01:58:32.098986+0000","last_clean":"2024-09-12T01:58:32.098986+0000","last_became_active":"2024-09-12T01:58:32.092525+0000","last_became_peered":"2024-09-12T01:58:32.092525+0000","last_unstale":"2024-09-12T01:58:32.098986+0000","last_undegraded":"2024-09-12T01:58:32.098986+0000","last_fullsized":"2024-09-12T01:58:32.098986+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:38.945135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916646+0000","last_change":"2024-09-12T01:58:32.099017+0000","last_active":"2024-09-12T01:58:33.916646+0000","last_peered":"2024-09-12T01:58:33.916646+0000","last_clean":"2024-09-12T01:58:33.916646+0000","last_became_active":"2024-09-12T01:58:32.095848+0000","last_became_peered":"2024-09-12T01:58:32.095848+0000","last_unstale":"2024-09-12T01:58:33.916646+0000","last_undegraded":"2024-09-12T01:58:33.916646+0000","last_fullsized":"2024-09-12T01:58:33.916646+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:50.997517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088755+0000","last_change":"2024-09-12T01:58:32.086522+0000","last_active":"2024-09-12T01:58:32.088755+0000","last_peered":"2024-09-12T01:58:32.088755+0000","last_clean":"2024-09-12T01:58:32.088755+0000","last_became_active":"2024-09-12T01:58:32.086029+0000","last_became_peered":"2024-09-12T01:58:32.086029+0000","last_unstale":"2024-09-12T01:58:32.088755+0000","last_undegraded":"2024-09-12T01:58:32.088755+0000","last_fullsized":"2024-09-12T01:58:32.088755+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:09.934393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.070789+0000","last_change":"2024-09-12T01:58:32.084133+0000","last_active":"2024-09-12T01:58:33.070789+0000","last_peered":"2024-09-12T01:58:33.070789+0000","last_clean":"2024-09-12T01:58:33.070789+0000","last_became_active":"2024-09-12T01:58:32.083847+0000","last_became_peered":"2024-09-12T01:58:32.083847+0000","last_unstale":"2024-09-12T01:58:33.070789+0000","last_undegraded":"2024-09-12T01:58:33.070789+0000","last_fullsized":"2024-09-12T01:58:33.070789+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:43.045539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072181+0000","last_change":"2024-09-12T01:58:32.090868+0000","last_active":"2024-09-12T01:58:33.072181+0000","last_peered":"2024-09-12T01:58:33.072181+0000","last_clean":"2024-09-12T01:58:33.072181+0000","last_became_active":"2024-09-12T01:58:32.090596+0000","last_became_peered":"2024-09-12T01:58:32.090596+0000","last_unstale":"2024-09-12T01:58:33.072181+0000","last_undegraded":"2024-09-12T01:58:33.072181+0000","last_fullsized":"2024-09-12T01:58:33.072181+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:19.012343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.092799+0000","last_change":"2024-09-12T01:58:32.091013+0000","last_active":"2024-09-12T01:58:32.092799+0000","last_peered":"2024-09-12T01:58:32.092799+0000","last_clean":"2024-09-12T01:58:32.092799+0000","last_became_active":"2024-09-12T01:58:32.090711+0000","last_became_peered":"2024-09-12T01:58:32.090711+0000","last_unstale":"2024-09-12T01:58:32.092799+0000","last_undegraded":"2024-09-12T01:58:32.092799+0000","last_fullsized":"2024-09-12T01:58:32.092799+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:16.569815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915658+0000","last_change":"2024-09-12T01:58:32.100103+0000","last_active":"2024-09-12T01:58:33.915658+0000","last_peered":"2024-09-12T01:58:33.915658+0000","last_clean":"2024-09-12T01:58:33.915658+0000","last_became_active":"2024-09-12T01:58:32.099846+0000","last_became_peered":"2024-09-12T01:58:32.099846+0000","last_unstale":"2024-09-12T01:58:33.915658+0000","last_undegraded":"2024-09-12T01:58:33.915658+0000","last_fullsized":"2024-09-12T01:58:33.915658+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:46.632781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916628+0000","last_change":"2024-09-12T01:58:32.099992+0000","last_active":"2024-09-12T01:58:33.916628+0000","last_peered":"2024-09-12T01:58:33.916628+0000","last_clean":"2024-09-12T01:58:33.916628+0000","last_became_active":"2024-09-12T01:58:32.099721+0000","last_became_peered":"2024-09-12T01:58:32.099721+0000","last_unstale":"2024-09-12T01:58:33.916628+0000","last_undegraded":"2024-09-12T01:58:33.916628+0000","last_fullsized":"2024-09-12T01:58:33.916628+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:38.169564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916829+0000","last_change":"2024-09-12T01:58:32.101085+0000","last_active":"2024-09-12T01:58:33.916829+0000","last_peered":"2024-09-12T01:58:33.916829+0000","last_clean":"2024-09-12T01:58:33.916829+0000","last_became_active":"2024-09-12T01:58:32.100128+0000","last_became_peered":"2024-09-12T01:58:32.100128+0000","last_unstale":"2024-09-12T01:58:33.916829+0000","last_undegraded":"2024-09-12T01:58:33.916829+0000","last_fullsized":"2024-09-12T01:58:33.916829+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:02.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098161+0000","last_change":"2024-09-12T01:58:32.093435+0000","last_active":"2024-09-12T01:58:32.098161+0000","last_peered":"2024-09-12T01:58:32.098161+0000","last_clean":"2024-09-12T01:58:32.098161+0000","last_became_active":"2024-09-12T01:58:32.092950+0000","last_became_peered":"2024-09-12T01:58:32.092950+0000","last_unstale":"2024-09-12T01:58:32.098161+0000","last_undegraded":"2024-09-12T01:58:32.098161+0000","last_fullsized":"2024-09-12T01:58:32.098161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:38.945135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916206+0000","last_change":"2024-09-12T01:58:32.096884+0000","last_active":"2024-09-12T01:58:33.916206+0000","last_peered":"2024-09-12T01:58:33.916206+0000","last_clean":"2024-09-12T01:58:33.916206+0000","last_became_active":"2024-09-12T01:58:32.096608+0000","last_became_peered":"2024-09-12T01:58:32.096608+0000","last_unstale":"2024-09-12T01:58:33.916206+0000","last_undegraded":"2024-09-12T01:58:33.916206+0000","last_fullsized":"2024-09-12T01:58:33.916206+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:50.997517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915938+0000","last_change":"2024-09-12T01:58:32.091527+0000","last_active":"2024-09-12T01:58:33.915938+0000","last_peered":"2024-09-12T01:58:33.915938+0000","last_clean":"2024-09-12T01:58:33.915938+0000","last_became_active":"2024-09-12T01:58:32.090919+0000","last_became_peered":"2024-09-12T01:58:32.090919+0000","last_unstale":"2024-09-12T01:58:33.915938+0000","last_undegraded":"2024-09-12T01:58:33.915938+0000","last_fullsized":"2024-09-12T01:58:33.915938+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:00.209541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916694+0000","last_change":"2024-09-12T01:58:32.099040+0000","last_active":"2024-09-12T01:58:33.916694+0000","last_peered":"2024-09-12T01:58:33.916694+0000","last_clean":"2024-09-12T01:58:33.916694+0000","last_became_active":"2024-09-12T01:58:32.098246+0000","last_became_peered":"2024-09-12T01:58:32.098246+0000","last_unstale":"2024-09-12T01:58:33.916694+0000","last_undegraded":"2024-09-12T01:58:33.916694+0000","last_fullsized":"2024-09-12T01:58:33.916694+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:27.519989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916273+0000","last_change":"2024-09-12T01:58:32.099874+0000","last_active":"2024-09-12T01:58:33.916273+0000","last_peered":"2024-09-12T01:58:33.916273+0000","last_clean":"2024-09-12T01:58:33.916273+0000","last_became_active":"2024-09-12T01:58:32.099591+0000","last_became_peered":"2024-09-12T01:58:32.099591+0000","last_unstale":"2024-09-12T01:58:33.916273+0000","last_undegraded":"2024-09-12T01:58:33.916273+0000","last_fullsized":"2024-09-12T01:58:33.916273+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:00.209541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098644+0000","last_change":"2024-09-12T01:58:32.092337+0000","last_active":"2024-09-12T01:58:32.098644+0000","last_peered":"2024-09-12T01:58:32.098644+0000","last_clean":"2024-09-12T01:58:32.098644+0000","last_became_active":"2024-09-12T01:58:32.091794+0000","last_became_peered":"2024-09-12T01:58:32.091794+0000","last_unstale":"2024-09-12T01:58:32.098644+0000","last_undegraded":"2024-09-12T01:58:32.098644+0000","last_fullsized":"2024-09-12T01:58:32.098644+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:03.685856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102947+0000","last_change":"2024-09-12T01:58:32.099798+0000","last_active":"2024-09-12T01:58:32.102947+0000","last_peered":"2024-09-12T01:58:32.102947+0000","last_clean":"2024-09-12T01:58:32.102947+0000","last_became_active":"2024-09-12T01:58:32.099440+0000","last_became_peered":"2024-09-12T01:58:32.099440+0000","last_unstale":"2024-09-12T01:58:32.102947+0000","last_undegraded":"2024-09-12T01:58:32.102947+0000","last_fullsized":"2024-09-12T01:58:32.102947+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:12.553586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088709+0000","last_change":"2024-09-12T01:58:32.086299+0000","last_active":"2024-09-12T01:58:32.088709+0000","last_peered":"2024-09-12T01:58:32.088709+0000","last_clean":"2024-09-12T01:58:32.088709+0000","last_became_active":"2024-09-12T01:58:32.085968+0000","last_became_peered":"2024-09-12T01:58:32.085968+0000","last_unstale":"2024-09-12T01:58:32.088709+0000","last_undegraded":"2024-09-12T01:58:32.088709+0000","last_fullsized":"2024-09-12T01:58:32.088709+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:14.575171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.070726+0000","last_change":"2024-09-12T01:58:32.089146+0000","last_active":"2024-09-12T01:58:33.070726+0000","last_peered":"2024-09-12T01:58:33.070726+0000","last_clean":"2024-09-12T01:58:33.070726+0000","last_became_active":"2024-09-12T01:58:32.088503+0000","last_became_peered":"2024-09-12T01:58:32.088503+0000","last_unstale":"2024-09-12T01:58:33.070726+0000","last_undegraded":"2024-09-12T01:58:33.070726+0000","last_fullsized":"2024-09-12T01:58:33.070726+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:06.577465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.092452+0000","last_change":"2024-09-12T01:58:32.089658+0000","last_active":"2024-09-12T01:58:32.092452+0000","last_peered":"2024-09-12T01:58:32.092452+0000","last_clean":"2024-09-12T01:58:32.092452+0000","last_became_active":"2024-09-12T01:58:32.089374+0000","last_became_peered":"2024-09-12T01:58:32.089374+0000","last_unstale":"2024-09-12T01:58:32.092452+0000","last_undegraded":"2024-09-12T01:58:32.092452+0000","last_fullsized":"2024-09-12T01:58:32.092452+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:21.967038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916136+0000","last_change":"2024-09-12T01:58:32.097896+0000","last_active":"2024-09-12T01:58:33.916136+0000","last_peered":"2024-09-12T01:58:33.916136+0000","last_clean":"2024-09-12T01:58:33.916136+0000","last_became_active":"2024-09-12T01:58:32.097631+0000","last_became_peered":"2024-09-12T01:58:32.097631+0000","last_unstale":"2024-09-12T01:58:33.916136+0000","last_undegraded":"2024-09-12T01:58:33.916136+0000","last_fullsized":"2024-09-12T01:58:33.916136+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:38.169564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.093607+0000","last_change":"2024-09-12T01:58:32.091442+0000","last_active":"2024-09-12T01:58:32.093607+0000","last_peered":"2024-09-12T01:58:32.093607+0000","last_clean":"2024-09-12T01:58:32.093607+0000","last_became_active":"2024-09-12T01:58:32.091113+0000","last_became_peered":"2024-09-12T01:58:32.091113+0000","last_unstale":"2024-09-12T01:58:32.093607+0000","last_undegraded":"2024-09-12T01:58:32.093607+0000","last_fullsized":"2024-09-12T01:58:32.093607+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:29.150750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.092420+0000","last_change":"2024-09-12T01:58:32.090771+0000","last_active":"2024-09-12T01:58:32.092420+0000","last_peered":"2024-09-12T01:58:32.092420+0000","last_clean":"2024-09-12T01:58:32.092420+0000","last_became_active":"2024-09-12T01:58:32.090506+0000","last_became_peered":"2024-09-12T01:58:32.090506+0000","last_unstale":"2024-09-12T01:58:32.092420+0000","last_undegraded":"2024-09-12T01:58:32.092420+0000","last_fullsized":"2024-09-12T01:58:32.092420+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:21.707987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915961+0000","last_change":"2024-09-12T01:58:32.095936+0000","last_active":"2024-09-12T01:58:33.915961+0000","last_peered":"2024-09-12T01:58:33.915961+0000","last_clean":"2024-09-12T01:58:33.915961+0000","last_became_active":"2024-09-12T01:58:32.095625+0000","last_became_peered":"2024-09-12T01:58:32.095625+0000","last_unstale":"2024-09-12T01:58:33.915961+0000","last_undegraded":"2024-09-12T01:58:33.915961+0000","last_fullsized":"2024-09-12T01:58:33.915961+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:59.477648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916062+0000","last_change":"2024-09-12T01:58:32.094671+0000","last_active":"2024-09-12T01:58:33.916062+0000","last_peered":"2024-09-12T01:58:33.916062+0000","last_clean":"2024-09-12T01:58:33.916062+0000","last_became_active":"2024-09-12T01:58:32.093934+0000","last_became_peered":"2024-09-12T01:58:32.093934+0000","last_unstale":"2024-09-12T01:58:33.916062+0000","last_undegraded":"2024-09-12T01:58:33.916062+0000","last_fullsized":"2024-09-12T01:58:33.916062+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:15.459156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915852+0000","last_change":"2024-09-12T01:58:32.094546+0000","last_active":"2024-09-12T01:58:33.915852+0000","last_peered":"2024-09-12T01:58:33.915852+0000","last_clean":"2024-09-12T01:58:33.915852+0000","last_became_active":"2024-09-12T01:58:32.094242+0000","last_became_peered":"2024-09-12T01:58:32.094242+0000","last_unstale":"2024-09-12T01:58:33.915852+0000","last_undegraded":"2024-09-12T01:58:33.915852+0000","last_fullsized":"2024-09-12T01:58:33.915852+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:24.307268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098121+0000","last_change":"2024-09-12T01:58:32.088553+0000","last_active":"2024-09-12T01:58:32.098121+0000","last_peered":"2024-09-12T01:58:32.098121+0000","last_clean":"2024-09-12T01:58:32.098121+0000","last_became_active":"2024-09-12T01:58:32.087827+0000","last_became_peered":"2024-09-12T01:58:32.087827+0000","last_unstale":"2024-09-12T01:58:32.098121+0000","last_undegraded":"2024-09-12T01:58:32.098121+0000","last_fullsized":"2024-09-12T01:58:32.098121+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:11.421763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102392+0000","last_change":"2024-09-12T01:58:32.095548+0000","last_active":"2024-09-12T01:58:32.102392+0000","last_peered":"2024-09-12T01:58:32.102392+0000","last_clean":"2024-09-12T01:58:32.102392+0000","last_became_active":"2024-09-12T01:58:32.094714+0000","last_became_peered":"2024-09-12T01:58:32.094714+0000","last_unstale":"2024-09-12T01:58:32.102392+0000","last_undegraded":"2024-09-12T01:58:32.102392+0000","last_fullsized":"2024-09-12T01:58:32.102392+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:13.252384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916517+0000","last_change":"2024-09-12T01:58:32.089782+0000","last_active":"2024-09-12T01:58:33.916517+0000","last_peered":"2024-09-12T01:58:33.916517+0000","last_clean":"2024-09-12T01:58:33.916517+0000","last_became_active":"2024-09-12T01:58:32.089548+0000","last_became_peered":"2024-09-12T01:58:32.089548+0000","last_unstale":"2024-09-12T01:58:33.916517+0000","last_undegraded":"2024-09-12T01:58:33.916517+0000","last_fullsized":"2024-09-12T01:58:33.916517+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.413296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915864+0000","last_change":"2024-09-12T01:58:32.099407+0000","last_active":"2024-09-12T01:58:33.915864+0000","last_peered":"2024-09-12T01:58:33.915864+0000","last_clean":"2024-09-12T01:58:33.915864+0000","last_became_active":"2024-09-12T01:58:32.099119+0000","last_became_peered":"2024-09-12T01:58:32.099119+0000","last_unstale":"2024-09-12T01:58:33.915864+0000","last_undegraded":"2024-09-12T01:58:33.915864+0000","last_fullsized":"2024-09-12T01:58:33.915864+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:45.710198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098544+0000","last_change":"2024-09-12T01:58:32.088560+0000","last_active":"2024-09-12T01:58:32.098544+0000","last_peered":"2024-09-12T01:58:32.098544+0000","last_clean":"2024-09-12T01:58:32.098544+0000","last_became_active":"2024-09-12T01:58:32.088317+0000","last_became_peered":"2024-09-12T01:58:32.088317+0000","last_unstale":"2024-09-12T01:58:32.098544+0000","last_undegraded":"2024-09-12T01:58:32.098544+0000","last_fullsized":"2024-09-12T01:58:32.098544+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:22.352441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071936+0000","last_change":"2024-09-12T01:58:32.085708+0000","last_active":"2024-09-12T01:58:33.071936+0000","last_peered":"2024-09-12T01:58:33.071936+0000","last_clean":"2024-09-12T01:58:33.071936+0000","last_became_active":"2024-09-12T01:58:32.085394+0000","last_became_peered":"2024-09-12T01:58:32.085394+0000","last_unstale":"2024-09-12T01:58:33.071936+0000","last_undegraded":"2024-09-12T01:58:33.071936+0000","last_fullsized":"2024-09-12T01:58:33.071936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:02.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.070900+0000","last_change":"2024-09-12T01:58:32.096958+0000","last_active":"2024-09-12T01:58:33.070900+0000","last_peered":"2024-09-12T01:58:33.070900+0000","last_clean":"2024-09-12T01:58:33.070900+0000","last_became_active":"2024-09-12T01:58:32.096288+0000","last_became_peered":"2024-09-12T01:58:32.096288+0000","last_unstale":"2024-09-12T01:58:33.070900+0000","last_undegraded":"2024-09-12T01:58:33.070900+0000","last_fullsized":"2024-09-12T01:58:33.070900+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:51.645585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"65'4","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.101459+0000","last_change":"2024-09-12T01:58:31.085572+0000","last_active":"2024-09-12T01:58:32.101459+0000","last_peered":"2024-09-12T01:58:32.101459+0000","last_clean":"2024-09-12T01:58:32.101459+0000","last_became_active":"2024-09-12T01:58:31.085308+0000","last_became_peered":"2024-09-12T01:58:31.085308+0000","last_unstale":"2024-09-12T01:58:32.101459+0000","last_undegraded":"2024-09-12T01:58:32.101459+0000","last_fullsized":"2024-09-12T01:58:32.101459+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:47.308955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098144+0000","last_change":"2024-09-12T01:58:32.093055+0000","last_active":"2024-09-12T01:58:32.098144+0000","last_peered":"2024-09-12T01:58:32.098144+0000","last_clean":"2024-09-12T01:58:32.098144+0000","last_became_active":"2024-09-12T01:58:32.092801+0000","last_became_peered":"2024-09-12T01:58:32.092801+0000","last_unstale":"2024-09-12T01:58:32.098144+0000","last_undegraded":"2024-09-12T01:58:32.098144+0000","last_fullsized":"2024-09-12T01:58:32.098144+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:48.314232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072473+0000","last_change":"2024-09-12T01:58:31.082993+0000","last_active":"2024-09-12T01:58:33.072473+0000","last_peered":"2024-09-12T01:58:33.072473+0000","last_clean":"2024-09-12T01:58:33.072473+0000","last_became_active":"2024-09-12T01:58:31.082679+0000","last_became_peered":"2024-09-12T01:58:31.082679+0000","last_unstale":"2024-09-12T01:58:33.072473+0000","last_undegraded":"2024-09-12T01:58:33.072473+0000","last_fullsized":"2024-09-12T01:58:33.072473+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:16.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072371+0000","last_change":"2024-09-12T01:58:32.078918+0000","last_active":"2024-09-12T01:58:33.072371+0000","last_peered":"2024-09-12T01:58:33.072371+0000","last_clean":"2024-09-12T01:58:33.072371+0000","last_became_active":"2024-09-12T01:58:32.078659+0000","last_became_peered":"2024-09-12T01:58:32.078659+0000","last_unstale":"2024-09-12T01:58:33.072371+0000","last_undegraded":"2024-09-12T01:58:33.072371+0000","last_fullsized":"2024-09-12T01:58:33.072371+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:02.012816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072329+0000","last_change":"2024-09-12T01:58:31.085752+0000","last_active":"2024-09-12T01:58:33.072329+0000","last_peered":"2024-09-12T01:58:33.072329+0000","last_clean":"2024-09-12T01:58:33.072329+0000","last_became_active":"2024-09-12T01:58:31.085456+0000","last_became_peered":"2024-09-12T01:58:31.085456+0000","last_unstale":"2024-09-12T01:58:33.072329+0000","last_undegraded":"2024-09-12T01:58:33.072329+0000","last_fullsized":"2024-09-12T01:58:33.072329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:44.704921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916567+0000","last_change":"2024-09-12T01:58:32.098820+0000","last_active":"2024-09-12T01:58:33.916567+0000","last_peered":"2024-09-12T01:58:33.916567+0000","last_clean":"2024-09-12T01:58:33.916567+0000","last_became_active":"2024-09-12T01:58:32.098562+0000","last_became_peered":"2024-09-12T01:58:32.098562+0000","last_unstale":"2024-09-12T01:58:33.916567+0000","last_undegraded":"2024-09-12T01:58:33.916567+0000","last_fullsized":"2024-09-12T01:58:33.916567+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:15.459156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072133+0000","last_change":"2024-09-12T01:58:31.082135+0000","last_active":"2024-09-12T01:58:33.072133+0000","last_peered":"2024-09-12T01:58:33.072133+0000","last_clean":"2024-09-12T01:58:33.072133+0000","last_became_active":"2024-09-12T01:58:31.081834+0000","last_became_peered":"2024-09-12T01:58:31.081834+0000","last_unstale":"2024-09-12T01:58:33.072133+0000","last_undegraded":"2024-09-12T01:58:33.072133+0000","last_fullsized":"2024-09-12T01:58:33.072133+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:59.204264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098668+0000","last_change":"2024-09-12T01:58:32.092057+0000","last_active":"2024-09-12T01:58:32.098668+0000","last_peered":"2024-09-12T01:58:32.098668+0000","last_clean":"2024-09-12T01:58:32.098668+0000","last_became_active":"2024-09-12T01:58:32.091372+0000","last_became_peered":"2024-09-12T01:58:32.091372+0000","last_unstale":"2024-09-12T01:58:32.098668+0000","last_undegraded":"2024-09-12T01:58:32.098668+0000","last_fullsized":"2024-09-12T01:58:32.098668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:55.460525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"65'1","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088984+0000","last_change":"2024-09-12T01:58:31.085302+0000","last_active":"2024-09-12T01:58:32.088984+0000","last_peered":"2024-09-12T01:58:32.088984+0000","last_clean":"2024-09-12T01:58:32.088984+0000","last_became_active":"2024-09-12T01:58:31.084995+0000","last_became_peered":"2024-09-12T01:58:31.084995+0000","last_unstale":"2024-09-12T01:58:32.088984+0000","last_undegraded":"2024-09-12T01:58:32.088984+0000","last_fullsized":"2024-09-12T01:58:32.088984+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:18.228685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102960+0000","last_change":"2024-09-12T01:58:32.099965+0000","last_active":"2024-09-12T01:58:32.102960+0000","last_peered":"2024-09-12T01:58:32.102960+0000","last_clean":"2024-09-12T01:58:32.102960+0000","last_became_active":"2024-09-12T01:58:32.099518+0000","last_became_peered":"2024-09-12T01:58:32.099518+0000","last_unstale":"2024-09-12T01:58:32.102960+0000","last_undegraded":"2024-09-12T01:58:32.102960+0000","last_fullsized":"2024-09-12T01:58:32.102960+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:27.155936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"65'1","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.091456+0000","last_change":"2024-09-12T01:58:31.086015+0000","last_active":"2024-09-12T01:58:32.091456+0000","last_peered":"2024-09-12T01:58:32.091456+0000","last_clean":"2024-09-12T01:58:32.091456+0000","last_became_active":"2024-09-12T01:58:31.085736+0000","last_became_peered":"2024-09-12T01:58:31.085736+0000","last_unstale":"2024-09-12T01:58:32.091456+0000","last_undegraded":"2024-09-12T01:58:32.091456+0000","last_fullsized":"2024-09-12T01:58:32.091456+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:58.281292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.070750+0000","last_change":"2024-09-12T01:58:32.092252+0000","last_active":"2024-09-12T01:58:33.070750+0000","last_peered":"2024-09-12T01:58:33.070750+0000","last_clean":"2024-09-12T01:58:33.070750+0000","last_became_active":"2024-09-12T01:58:32.091933+0000","last_became_peered":"2024-09-12T01:58:32.091933+0000","last_unstale":"2024-09-12T01:58:33.070750+0000","last_undegraded":"2024-09-12T01:58:33.070750+0000","last_fullsized":"2024-09-12T01:58:33.070750+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:20.410580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.076913+0000","last_change":"2024-09-12T01:58:31.078913+0000","last_active":"2024-09-12T01:58:32.076913+0000","last_peered":"2024-09-12T01:58:32.076913+0000","last_clean":"2024-09-12T01:58:32.076913+0000","last_became_active":"2024-09-12T01:58:31.078594+0000","last_became_peered":"2024-09-12T01:58:31.078594+0000","last_unstale":"2024-09-12T01:58:32.076913+0000","last_undegraded":"2024-09-12T01:58:32.076913+0000","last_fullsized":"2024-09-12T01:58:32.076913+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:32.332146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.086767+0000","last_change":"2024-09-12T01:58:32.082690+0000","last_active":"2024-09-12T01:58:32.086767+0000","last_peered":"2024-09-12T01:58:32.086767+0000","last_clean":"2024-09-12T01:58:32.086767+0000","last_became_active":"2024-09-12T01:58:32.082372+0000","last_became_peered":"2024-09-12T01:58:32.082372+0000","last_unstale":"2024-09-12T01:58:32.086767+0000","last_undegraded":"2024-09-12T01:58:32.086767+0000","last_fullsized":"2024-09-12T01:58:32.086767+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:47.657299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.070466+0000","last_change":"2024-09-12T01:58:31.084452+0000","last_active":"2024-09-12T01:58:33.070466+0000","last_peered":"2024-09-12T01:58:33.070466+0000","last_clean":"2024-09-12T01:58:33.070466+0000","last_became_active":"2024-09-12T01:58:31.084091+0000","last_became_peered":"2024-09-12T01:58:31.084091+0000","last_unstale":"2024-09-12T01:58:33.070466+0000","last_undegraded":"2024-09-12T01:58:33.070466+0000","last_fullsized":"2024-09-12T01:58:33.070466+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:02.589355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102369+0000","last_change":"2024-09-12T01:58:32.095478+0000","last_active":"2024-09-12T01:58:32.102369+0000","last_peered":"2024-09-12T01:58:32.102369+0000","last_clean":"2024-09-12T01:58:32.102369+0000","last_became_active":"2024-09-12T01:58:32.094996+0000","last_became_peered":"2024-09-12T01:58:32.094996+0000","last_unstale":"2024-09-12T01:58:32.102369+0000","last_undegraded":"2024-09-12T01:58:32.102369+0000","last_fullsized":"2024-09-12T01:58:32.102369+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.009280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916818+0000","last_change":"2024-09-12T01:58:31.091023+0000","last_active":"2024-09-12T01:58:33.916818+0000","last_peered":"2024-09-12T01:58:33.916818+0000","last_clean":"2024-09-12T01:58:33.916818+0000","last_became_active":"2024-09-12T01:58:31.090814+0000","last_became_peered":"2024-09-12T01:58:31.090814+0000","last_unstale":"2024-09-12T01:58:33.916818+0000","last_undegraded":"2024-09-12T01:58:33.916818+0000","last_fullsized":"2024-09-12T01:58:33.916818+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:13.812313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.101344+0000","last_change":"2024-09-12T01:58:32.093516+0000","last_active":"2024-09-12T01:58:32.101344+0000","last_peered":"2024-09-12T01:58:32.101344+0000","last_clean":"2024-09-12T01:58:32.101344+0000","last_became_active":"2024-09-12T01:58:32.093213+0000","last_became_peered":"2024-09-12T01:58:32.093213+0000","last_unstale":"2024-09-12T01:58:32.101344+0000","last_undegraded":"2024-09-12T01:58:32.101344+0000","last_fullsized":"2024-09-12T01:58:32.101344+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:18.062819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.075513+0000","last_change":"2024-09-12T01:58:31.076858+0000","last_active":"2024-09-12T01:58:32.075513+0000","last_peered":"2024-09-12T01:58:32.075513+0000","last_clean":"2024-09-12T01:58:32.075513+0000","last_became_active":"2024-09-12T01:58:31.076593+0000","last_became_peered":"2024-09-12T01:58:31.076593+0000","last_unstale":"2024-09-12T01:58:32.075513+0000","last_undegraded":"2024-09-12T01:58:32.075513+0000","last_fullsized":"2024-09-12T01:58:32.075513+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:30.358255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071153+0000","last_change":"2024-09-12T01:58:32.096897+0000","last_active":"2024-09-12T01:58:33.071153+0000","last_peered":"2024-09-12T01:58:33.071153+0000","last_clean":"2024-09-12T01:58:33.071153+0000","last_became_active":"2024-09-12T01:58:32.095734+0000","last_became_peered":"2024-09-12T01:58:32.095734+0000","last_unstale":"2024-09-12T01:58:33.071153+0000","last_undegraded":"2024-09-12T01:58:33.071153+0000","last_fullsized":"2024-09-12T01:58:33.071153+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:58.521341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"65'3","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916627+0000","last_change":"2024-09-12T01:58:31.085278+0000","last_active":"2024-09-12T01:58:33.916627+0000","last_peered":"2024-09-12T01:58:33.916627+0000","last_clean":"2024-09-12T01:58:33.916627+0000","last_became_active":"2024-09-12T01:58:31.084951+0000","last_became_peered":"2024-09-12T01:58:31.084951+0000","last_unstale":"2024-09-12T01:58:33.916627+0000","last_undegraded":"2024-09-12T01:58:33.916627+0000","last_fullsized":"2024-09-12T01:58:33.916627+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:41.804439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088733+0000","last_change":"2024-09-12T01:58:32.086718+0000","last_active":"2024-09-12T01:58:32.088733+0000","last_peered":"2024-09-12T01:58:32.088733+0000","last_clean":"2024-09-12T01:58:32.088733+0000","last_became_active":"2024-09-12T01:58:32.086444+0000","last_became_peered":"2024-09-12T01:58:32.086444+0000","last_unstale":"2024-09-12T01:58:32.088733+0000","last_undegraded":"2024-09-12T01:58:32.088733+0000","last_fullsized":"2024-09-12T01:58:32.088733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:25.413262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"65'6","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.108469+0000","last_change":"2024-09-12T01:58:31.079583+0000","last_active":"2024-09-12T01:58:32.108469+0000","last_peered":"2024-09-12T01:58:32.108469+0000","last_clean":"2024-09-12T01:58:32.108469+0000","last_became_active":"2024-09-12T01:58:31.079317+0000","last_became_peered":"2024-09-12T01:58:31.079317+0000","last_unstale":"2024-09-12T01:58:32.108469+0000","last_undegraded":"2024-09-12T01:58:32.108469+0000","last_fullsized":"2024-09-12T01:58:32.108469+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:33.047976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.100470+0000","last_change":"2024-09-12T01:58:32.097734+0000","last_active":"2024-09-12T01:58:32.100470+0000","last_peered":"2024-09-12T01:58:32.100470+0000","last_clean":"2024-09-12T01:58:32.100470+0000","last_became_active":"2024-09-12T01:58:32.095245+0000","last_became_peered":"2024-09-12T01:58:32.095245+0000","last_unstale":"2024-09-12T01:58:32.100470+0000","last_undegraded":"2024-09-12T01:58:32.100470+0000","last_fullsized":"2024-09-12T01:58:32.100470+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.009280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916484+0000","last_change":"2024-09-12T01:58:31.085938+0000","last_active":"2024-09-12T01:58:33.916484+0000","last_peered":"2024-09-12T01:58:33.916484+0000","last_clean":"2024-09-12T01:58:33.916484+0000","last_became_active":"2024-09-12T01:58:31.085635+0000","last_became_peered":"2024-09-12T01:58:31.085635+0000","last_unstale":"2024-09-12T01:58:33.916484+0000","last_undegraded":"2024-09-12T01:58:33.916484+0000","last_fullsized":"2024-09-12T01:58:33.916484+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:39.540230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915898+0000","last_change":"2024-09-12T01:58:32.093963+0000","last_active":"2024-09-12T01:58:33.915898+0000","last_peered":"2024-09-12T01:58:33.915898+0000","last_clean":"2024-09-12T01:58:33.915898+0000","last_became_active":"2024-09-12T01:58:32.093588+0000","last_became_peered":"2024-09-12T01:58:32.093588+0000","last_unstale":"2024-09-12T01:58:33.915898+0000","last_undegraded":"2024-09-12T01:58:33.915898+0000","last_fullsized":"2024-09-12T01:58:33.915898+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:59.477648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915708+0000","last_change":"2024-09-12T01:58:31.083496+0000","last_active":"2024-09-12T01:58:33.915708+0000","last_peered":"2024-09-12T01:58:33.915708+0000","last_clean":"2024-09-12T01:58:33.915708+0000","last_became_active":"2024-09-12T01:58:31.083282+0000","last_became_peered":"2024-09-12T01:58:31.083282+0000","last_unstale":"2024-09-12T01:58:33.915708+0000","last_undegraded":"2024-09-12T01:58:33.915708+0000","last_fullsized":"2024-09-12T01:58:33.915708+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:39.540230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071311+0000","last_change":"2024-09-12T01:58:32.085515+0000","last_active":"2024-09-12T01:58:33.071311+0000","last_peered":"2024-09-12T01:58:33.071311+0000","last_clean":"2024-09-12T01:58:33.071311+0000","last_became_active":"2024-09-12T01:58:32.085180+0000","last_became_peered":"2024-09-12T01:58:32.085180+0000","last_unstale":"2024-09-12T01:58:33.071311+0000","last_undegraded":"2024-09-12T01:58:33.071311+0000","last_fullsized":"2024-09-12T01:58:33.071311+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:46.112207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916416+0000","last_change":"2024-09-12T01:58:31.085595+0000","last_active":"2024-09-12T01:58:33.916416+0000","last_peered":"2024-09-12T01:58:33.916416+0000","last_clean":"2024-09-12T01:58:33.916416+0000","last_became_active":"2024-09-12T01:58:31.085333+0000","last_became_peered":"2024-09-12T01:58:31.085333+0000","last_unstale":"2024-09-12T01:58:33.916416+0000","last_undegraded":"2024-09-12T01:58:33.916416+0000","last_fullsized":"2024-09-12T01:58:33.916416+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:47.588497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.103028+0000","last_change":"2024-09-12T01:58:32.101742+0000","last_active":"2024-09-12T01:58:32.103028+0000","last_peered":"2024-09-12T01:58:32.103028+0000","last_clean":"2024-09-12T01:58:32.103028+0000","last_became_active":"2024-09-12T01:58:32.100985+0000","last_became_peered":"2024-09-12T01:58:32.100985+0000","last_unstale":"2024-09-12T01:58:32.103028+0000","last_undegraded":"2024-09-12T01:58:32.103028+0000","last_fullsized":"2024-09-12T01:58:32.103028+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:06.911951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"65'8","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.097968+0000","last_change":"2024-09-12T01:58:31.080233+0000","last_active":"2024-09-12T01:58:32.097968+0000","last_peered":"2024-09-12T01:58:32.097968+0000","last_clean":"2024-09-12T01:58:32.097968+0000","last_became_active":"2024-09-12T01:58:31.079923+0000","last_became_peered":"2024-09-12T01:58:31.079923+0000","last_unstale":"2024-09-12T01:58:32.097968+0000","last_undegraded":"2024-09-12T01:58:32.097968+0000","last_fullsized":"2024-09-12T01:58:32.097968+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:18.045768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916645+0000","last_change":"2024-09-12T01:58:32.095870+0000","last_active":"2024-09-12T01:58:33.916645+0000","last_peered":"2024-09-12T01:58:33.916645+0000","last_clean":"2024-09-12T01:58:33.916645+0000","last_became_active":"2024-09-12T01:58:32.095589+0000","last_became_peered":"2024-09-12T01:58:32.095589+0000","last_unstale":"2024-09-12T01:58:33.916645+0000","last_undegraded":"2024-09-12T01:58:33.916645+0000","last_fullsized":"2024-09-12T01:58:33.916645+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:50.976465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916031+0000","last_change":"2024-09-12T01:58:31.085862+0000","last_active":"2024-09-12T01:58:33.916031+0000","last_peered":"2024-09-12T01:58:33.916031+0000","last_clean":"2024-09-12T01:58:33.916031+0000","last_became_active":"2024-09-12T01:58:31.085601+0000","last_became_peered":"2024-09-12T01:58:31.085601+0000","last_unstale":"2024-09-12T01:58:33.916031+0000","last_undegraded":"2024-09-12T01:58:33.916031+0000","last_fullsized":"2024-09-12T01:58:33.916031+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:20.505778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.070924+0000","last_change":"2024-09-12T01:58:32.089389+0000","last_active":"2024-09-12T01:58:33.070924+0000","last_peered":"2024-09-12T01:58:33.070924+0000","last_clean":"2024-09-12T01:58:33.070924+0000","last_became_active":"2024-09-12T01:58:32.088821+0000","last_became_peered":"2024-09-12T01:58:32.088821+0000","last_unstale":"2024-09-12T01:58:33.070924+0000","last_undegraded":"2024-09-12T01:58:33.070924+0000","last_fullsized":"2024-09-12T01:58:33.070924+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:23.327759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916881+0000","last_change":"2024-09-12T01:58:31.084137+0000","last_active":"2024-09-12T01:58:33.916881+0000","last_peered":"2024-09-12T01:58:33.916881+0000","last_clean":"2024-09-12T01:58:33.916881+0000","last_became_active":"2024-09-12T01:58:31.083868+0000","last_became_peered":"2024-09-12T01:58:31.083868+0000","last_unstale":"2024-09-12T01:58:33.916881+0000","last_undegraded":"2024-09-12T01:58:33.916881+0000","last_fullsized":"2024-09-12T01:58:33.916881+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:22.755424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.088494+0000","last_change":"2024-09-12T01:58:32.083451+0000","last_active":"2024-09-12T01:58:32.088494+0000","last_peered":"2024-09-12T01:58:32.088494+0000","last_clean":"2024-09-12T01:58:32.088494+0000","last_became_active":"2024-09-12T01:58:32.083176+0000","last_became_peered":"2024-09-12T01:58:32.083176+0000","last_unstale":"2024-09-12T01:58:32.088494+0000","last_undegraded":"2024-09-12T01:58:32.088494+0000","last_fullsized":"2024-09-12T01:58:32.088494+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:29.187288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916757+0000","last_change":"2024-09-12T01:58:31.087815+0000","last_active":"2024-09-12T01:58:33.916757+0000","last_peered":"2024-09-12T01:58:33.916757+0000","last_clean":"2024-09-12T01:58:33.916757+0000","last_became_active":"2024-09-12T01:58:31.087594+0000","last_became_peered":"2024-09-12T01:58:31.087594+0000","last_unstale":"2024-09-12T01:58:33.916757+0000","last_undegraded":"2024-09-12T01:58:33.916757+0000","last_fullsized":"2024-09-12T01:58:33.916757+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.106930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071213+0000","last_change":"2024-09-12T01:58:32.089687+0000","last_active":"2024-09-12T01:58:33.071213+0000","last_peered":"2024-09-12T01:58:33.071213+0000","last_clean":"2024-09-12T01:58:33.071213+0000","last_became_active":"2024-09-12T01:58:32.088371+0000","last_became_peered":"2024-09-12T01:58:32.088371+0000","last_unstale":"2024-09-12T01:58:33.071213+0000","last_undegraded":"2024-09-12T01:58:33.071213+0000","last_fullsized":"2024-09-12T01:58:33.071213+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:56.306443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.077108+0000","last_change":"2024-09-12T01:58:31.074406+0000","last_active":"2024-09-12T01:58:32.077108+0000","last_peered":"2024-09-12T01:58:32.077108+0000","last_clean":"2024-09-12T01:58:32.077108+0000","last_became_active":"2024-09-12T01:58:31.074068+0000","last_became_peered":"2024-09-12T01:58:31.074068+0000","last_unstale":"2024-09-12T01:58:32.077108+0000","last_undegraded":"2024-09-12T01:58:32.077108+0000","last_fullsized":"2024-09-12T01:58:32.077108+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:26.113685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071998+0000","last_change":"2024-09-12T01:58:32.078981+0000","last_active":"2024-09-12T01:58:33.071998+0000","last_peered":"2024-09-12T01:58:33.071998+0000","last_clean":"2024-09-12T01:58:33.071998+0000","last_became_active":"2024-09-12T01:58:32.078680+0000","last_became_peered":"2024-09-12T01:58:32.078680+0000","last_unstale":"2024-09-12T01:58:33.071998+0000","last_undegraded":"2024-09-12T01:58:33.071998+0000","last_fullsized":"2024-09-12T01:58:33.071998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:11.561895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072046+0000","last_change":"2024-09-12T01:58:31.084085+0000","last_active":"2024-09-12T01:58:33.072046+0000","last_peered":"2024-09-12T01:58:33.072046+0000","last_clean":"2024-09-12T01:58:33.072046+0000","last_became_active":"2024-09-12T01:58:31.083740+0000","last_became_peered":"2024-09-12T01:58:31.083740+0000","last_unstale":"2024-09-12T01:58:33.072046+0000","last_undegraded":"2024-09-12T01:58:33.072046+0000","last_fullsized":"2024-09-12T01:58:33.072046+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:23.301991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915806+0000","last_change":"2024-09-12T01:58:32.092045+0000","last_active":"2024-09-12T01:58:33.915806+0000","last_peered":"2024-09-12T01:58:33.915806+0000","last_clean":"2024-09-12T01:58:33.915806+0000","last_became_active":"2024-09-12T01:58:32.091550+0000","last_became_peered":"2024-09-12T01:58:32.091550+0000","last_unstale":"2024-09-12T01:58:33.915806+0000","last_undegraded":"2024-09-12T01:58:33.915806+0000","last_fullsized":"2024-09-12T01:58:33.915806+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:41.371386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915847+0000","last_change":"2024-09-12T01:58:31.083500+0000","last_active":"2024-09-12T01:58:33.915847+0000","last_peered":"2024-09-12T01:58:33.915847+0000","last_clean":"2024-09-12T01:58:33.915847+0000","last_became_active":"2024-09-12T01:58:31.083304+0000","last_became_peered":"2024-09-12T01:58:31.083304+0000","last_unstale":"2024-09-12T01:58:33.915847+0000","last_undegraded":"2024-09-12T01:58:33.915847+0000","last_fullsized":"2024-09-12T01:58:33.915847+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:41.804439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071065+0000","last_change":"2024-09-12T01:58:32.092142+0000","last_active":"2024-09-12T01:58:33.071065+0000","last_peered":"2024-09-12T01:58:33.071065+0000","last_clean":"2024-09-12T01:58:33.071065+0000","last_became_active":"2024-09-12T01:58:32.091877+0000","last_became_peered":"2024-09-12T01:58:32.091877+0000","last_unstale":"2024-09-12T01:58:33.071065+0000","last_undegraded":"2024-09-12T01:58:33.071065+0000","last_fullsized":"2024-09-12T01:58:33.071065+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:47.089578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071936+0000","last_change":"2024-09-12T01:58:31.079762+0000","last_active":"2024-09-12T01:58:33.071936+0000","last_peered":"2024-09-12T01:58:33.071936+0000","last_clean":"2024-09-12T01:58:33.071936+0000","last_became_active":"2024-09-12T01:58:31.079490+0000","last_became_peered":"2024-09-12T01:58:31.079490+0000","last_unstale":"2024-09-12T01:58:33.071936+0000","last_undegraded":"2024-09-12T01:58:33.071936+0000","last_fullsized":"2024-09-12T01:58:33.071936+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:40.366109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072065+0000","last_change":"2024-09-12T01:58:32.088285+0000","last_active":"2024-09-12T01:58:33.072065+0000","last_peered":"2024-09-12T01:58:33.072065+0000","last_clean":"2024-09-12T01:58:33.072065+0000","last_became_active":"2024-09-12T01:58:32.087918+0000","last_became_peered":"2024-09-12T01:58:32.087918+0000","last_unstale":"2024-09-12T01:58:33.072065+0000","last_undegraded":"2024-09-12T01:58:33.072065+0000","last_fullsized":"2024-09-12T01:58:33.072065+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:19.787633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916177+0000","last_change":"2024-09-12T01:58:31.085470+0000","last_active":"2024-09-12T01:58:33.916177+0000","last_peered":"2024-09-12T01:58:33.916177+0000","last_clean":"2024-09-12T01:58:33.916177+0000","last_became_active":"2024-09-12T01:58:31.085216+0000","last_became_peered":"2024-09-12T01:58:31.085216+0000","last_unstale":"2024-09-12T01:58:33.916177+0000","last_undegraded":"2024-09-12T01:58:33.916177+0000","last_fullsized":"2024-09-12T01:58:33.916177+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:57.516064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.090260+0000","last_change":"2024-09-12T01:58:32.084136+0000","last_active":"2024-09-12T01:58:32.090260+0000","last_peered":"2024-09-12T01:58:32.090260+0000","last_clean":"2024-09-12T01:58:32.090260+0000","last_became_active":"2024-09-12T01:58:32.083827+0000","last_became_peered":"2024-09-12T01:58:32.083827+0000","last_unstale":"2024-09-12T01:58:32.090260+0000","last_undegraded":"2024-09-12T01:58:32.090260+0000","last_fullsized":"2024-09-12T01:58:32.090260+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:25.550979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"66'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:34.073664+0000","last_change":"2024-09-12T01:58:31.082854+0000","last_active":"2024-09-12T01:58:34.073664+0000","last_peered":"2024-09-12T01:58:34.073664+0000","last_clean":"2024-09-12T01:58:34.073664+0000","last_became_active":"2024-09-12T01:58:31.082576+0000","last_became_peered":"2024-09-12T01:58:31.082576+0000","last_unstale":"2024-09-12T01:58:34.073664+0000","last_undegraded":"2024-09-12T01:58:34.073664+0000","last_fullsized":"2024-09-12T01:58:34.073664+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:55.301165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915954+0000","last_change":"2024-09-12T01:58:32.094795+0000","last_active":"2024-09-12T01:58:33.915954+0000","last_peered":"2024-09-12T01:58:33.915954+0000","last_clean":"2024-09-12T01:58:33.915954+0000","last_became_active":"2024-09-12T01:58:32.093598+0000","last_became_peered":"2024-09-12T01:58:32.093598+0000","last_unstale":"2024-09-12T01:58:33.915954+0000","last_undegraded":"2024-09-12T01:58:33.915954+0000","last_fullsized":"2024-09-12T01:58:33.915954+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.413296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072377+0000","last_change":"2024-09-12T01:58:31.086458+0000","last_active":"2024-09-12T01:58:33.072377+0000","last_peered":"2024-09-12T01:58:33.072377+0000","last_clean":"2024-09-12T01:58:33.072377+0000","last_became_active":"2024-09-12T01:58:31.086155+0000","last_became_peered":"2024-09-12T01:58:31.086155+0000","last_unstale":"2024-09-12T01:58:33.072377+0000","last_undegraded":"2024-09-12T01:58:33.072377+0000","last_fullsized":"2024-09-12T01:58:33.072377+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:58.472371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071077+0000","last_change":"2024-09-12T01:58:32.083243+0000","last_active":"2024-09-12T01:58:33.071077+0000","last_peered":"2024-09-12T01:58:33.071077+0000","last_clean":"2024-09-12T01:58:33.071077+0000","last_became_active":"2024-09-12T01:58:32.082988+0000","last_became_peered":"2024-09-12T01:58:32.082988+0000","last_unstale":"2024-09-12T01:58:33.071077+0000","last_undegraded":"2024-09-12T01:58:33.071077+0000","last_fullsized":"2024-09-12T01:58:33.071077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:21.511055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.079990+0000","last_change":"2024-09-12T01:58:31.077535+0000","last_active":"2024-09-12T01:58:32.079990+0000","last_peered":"2024-09-12T01:58:32.079990+0000","last_clean":"2024-09-12T01:58:32.079990+0000","last_became_active":"2024-09-12T01:58:31.077058+0000","last_became_peered":"2024-09-12T01:58:31.077058+0000","last_unstale":"2024-09-12T01:58:32.079990+0000","last_undegraded":"2024-09-12T01:58:32.079990+0000","last_fullsized":"2024-09-12T01:58:32.079990+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:10.416486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071267+0000","last_change":"2024-09-12T01:58:32.099028+0000","last_active":"2024-09-12T01:58:33.071267+0000","last_peered":"2024-09-12T01:58:33.071267+0000","last_clean":"2024-09-12T01:58:33.071267+0000","last_became_active":"2024-09-12T01:58:32.098748+0000","last_became_peered":"2024-09-12T01:58:32.098748+0000","last_unstale":"2024-09-12T01:58:33.071267+0000","last_undegraded":"2024-09-12T01:58:33.071267+0000","last_fullsized":"2024-09-12T01:58:33.071267+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:42.809716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.916708+0000","last_change":"2024-09-12T01:58:31.090527+0000","last_active":"2024-09-12T01:58:33.916708+0000","last_peered":"2024-09-12T01:58:33.916708+0000","last_clean":"2024-09-12T01:58:33.916708+0000","last_became_active":"2024-09-12T01:58:31.090284+0000","last_became_peered":"2024-09-12T01:58:31.090284+0000","last_unstale":"2024-09-12T01:58:33.916708+0000","last_undegraded":"2024-09-12T01:58:33.916708+0000","last_fullsized":"2024-09-12T01:58:33.916708+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:55.301165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098577+0000","last_change":"2024-09-12T01:58:32.089933+0000","last_active":"2024-09-12T01:58:32.098577+0000","last_peered":"2024-09-12T01:58:32.098577+0000","last_clean":"2024-09-12T01:58:32.098577+0000","last_became_active":"2024-09-12T01:58:32.089694+0000","last_became_peered":"2024-09-12T01:58:32.089694+0000","last_unstale":"2024-09-12T01:58:32.098577+0000","last_undegraded":"2024-09-12T01:58:32.098577+0000","last_fullsized":"2024-09-12T01:58:32.098577+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:34.053253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.076856+0000","last_change":"2024-09-12T01:58:31.076859+0000","last_active":"2024-09-12T01:58:32.076856+0000","last_peered":"2024-09-12T01:58:32.076856+0000","last_clean":"2024-09-12T01:58:32.076856+0000","last_became_active":"2024-09-12T01:58:31.076488+0000","last_became_peered":"2024-09-12T01:58:31.076488+0000","last_unstale":"2024-09-12T01:58:32.076856+0000","last_undegraded":"2024-09-12T01:58:32.076856+0000","last_fullsized":"2024-09-12T01:58:32.076856+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:47.205697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.102944+0000","last_change":"2024-09-12T01:58:32.099717+0000","last_active":"2024-09-12T01:58:32.102944+0000","last_peered":"2024-09-12T01:58:32.102944+0000","last_clean":"2024-09-12T01:58:32.102944+0000","last_became_active":"2024-09-12T01:58:32.099398+0000","last_became_peered":"2024-09-12T01:58:32.099398+0000","last_unstale":"2024-09-12T01:58:32.102944+0000","last_undegraded":"2024-09-12T01:58:32.102944+0000","last_fullsized":"2024-09-12T01:58:32.102944+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:53.481574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.077079+0000","last_change":"2024-09-12T01:58:31.078174+0000","last_active":"2024-09-12T01:58:32.077079+0000","last_peered":"2024-09-12T01:58:32.077079+0000","last_clean":"2024-09-12T01:58:32.077079+0000","last_became_active":"2024-09-12T01:58:31.077722+0000","last_became_peered":"2024-09-12T01:58:31.077722+0000","last_unstale":"2024-09-12T01:58:32.077079+0000","last_undegraded":"2024-09-12T01:58:32.077079+0000","last_fullsized":"2024-09-12T01:58:32.077079+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:04.459773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.098702+0000","last_change":"2024-09-12T01:58:32.092706+0000","last_active":"2024-09-12T01:58:32.098702+0000","last_peered":"2024-09-12T01:58:32.098702+0000","last_clean":"2024-09-12T01:58:32.098702+0000","last_became_active":"2024-09-12T01:58:32.092407+0000","last_became_peered":"2024-09-12T01:58:32.092407+0000","last_unstale":"2024-09-12T01:58:32.098702+0000","last_undegraded":"2024-09-12T01:58:32.098702+0000","last_fullsized":"2024-09-12T01:58:32.098702+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:28.935380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.079005+0000","last_change":"2024-09-12T01:58:31.083451+0000","last_active":"2024-09-12T01:58:32.079005+0000","last_peered":"2024-09-12T01:58:32.079005+0000","last_clean":"2024-09-12T01:58:32.079005+0000","last_became_active":"2024-09-12T01:58:31.083133+0000","last_became_peered":"2024-09-12T01:58:31.083133+0000","last_unstale":"2024-09-12T01:58:32.079005+0000","last_undegraded":"2024-09-12T01:58:32.079005+0000","last_fullsized":"2024-09-12T01:58:32.079005+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:21.347164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071277+0000","last_change":"2024-09-12T01:58:32.096326+0000","last_active":"2024-09-12T01:58:33.071277+0000","last_peered":"2024-09-12T01:58:33.071277+0000","last_clean":"2024-09-12T01:58:33.071277+0000","last_became_active":"2024-09-12T01:58:32.096061+0000","last_became_peered":"2024-09-12T01:58:32.096061+0000","last_unstale":"2024-09-12T01:58:33.071277+0000","last_undegraded":"2024-09-12T01:58:33.071277+0000","last_fullsized":"2024-09-12T01:58:33.071277+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:40.545508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T01:58:32.076598+0000","last_change":"2024-09-12T01:58:31.084470+0000","last_active":"2024-09-12T01:58:32.076598+0000","last_peered":"2024-09-12T01:58:32.076598+0000","last_clean":"2024-09-12T01:58:32.076598+0000","last_became_active":"2024-09-12T01:58:31.084172+0000","last_became_peered":"2024-09-12T01:58:31.084172+0000","last_unstale":"2024-09-12T01:58:32.076598+0000","last_undegraded":"2024-09-12T01:58:32.076598+0000","last_fullsized":"2024-09-12T01:58:32.076598+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:29.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":251,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915936+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:58:33.915936+0000","last_peered":"2024-09-12T01:58:33.915936+0000","last_clean":"2024-09-12T01:58:33.915936+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:58:33.915936+0000","last_undegraded":"2024-09-12T01:58:33.915936+0000","last_fullsized":"2024-09-12T01:58:33.915936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28392,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343448,"statfs":{"total":96636764160,"available":96607690752,"internally_reserved":0,"allocated":1388544,"data_stored":943870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":794624,"data_stored":359452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509478,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":359440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542182,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":778240,"data_stored":352726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":778240,"data_stored":352726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":806912,"data_stored":355102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542182,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1372160,"data_stored":943094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":765952,"data_stored":345559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:58:39.491 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:58:39.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.606+0000 7fb768e74640 1 Processor -- start 2024-09-12T01:58:39.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.606+0000 7fb768e74640 1 -- start start 2024-09-12T01:58:39.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.607+0000 7fb768e74640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb76415e5f0 0x7fb7640d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.607+0000 7fb768e74640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb7640d30f0 0x7fb7640b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.607+0000 7fb768e74640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7640d3690 con 0x7fb7640b64c0 2024-09-12T01:58:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.607+0000 7fb768e74640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb76406d530 con 0x7fb76415e5f0 2024-09-12T01:58:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.607+0000 7fb768e74640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb7640d3970 con 0x7fb7640d30f0 2024-09-12T01:58:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.607+0000 7fb76259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb76415e5f0 0x7fb7640d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.607+0000 7fb762d9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb7640b64c0 0x7fb7640cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38368/0 (socket says 172.21.15.19:38368) 2024-09-12T01:58:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.607+0000 7fb762d9d640 1 -- 172.21.15.19:0/2096961524 learned_addr learned my addr 172.21.15.19:0/2096961524 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.607+0000 7fb76259c640 1 -- 172.21.15.19:0/2096961524 >> v2:172.21.15.135:3300/0 conn(0x7fb7640d30f0 msgr2=0x7fb7640b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.607+0000 7fb761d9b640 1 --2- 172.21.15.19:0/2096961524 >> v2:172.21.15.135:3300/0 conn(0x7fb7640d30f0 0x7fb7640b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.607+0000 7fb76159a640 1 -- 172.21.15.19:0/2096961524 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2010499865 0 0) 0x7fb7640d3690 con 0x7fb7640b64c0 2024-09-12T01:58:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.607+0000 7fb76259c640 1 --2- 172.21.15.19:0/2096961524 >> v2:172.21.15.135:3300/0 conn(0x7fb7640d30f0 0x7fb7640b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.607+0000 7fb76259c640 1 -- 172.21.15.19:0/2096961524 >> v1:172.21.15.19:6789/0 conn(0x7fb7640b64c0 legacy=0x7fb7640cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.607+0000 7fb76259c640 1 -- 172.21.15.19:0/2096961524 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76406cee0 con 0x7fb76415e5f0 2024-09-12T01:58:39.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.607+0000 7fb761d9b640 1 --2- 172.21.15.19:0/2096961524 >> v2:172.21.15.135:3300/0 conn(0x7fb7640d30f0 0x7fb7640b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:39.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.608+0000 7fb76259c640 1 --2- 172.21.15.19:0/2096961524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb76415e5f0 0x7fb7640d4dd0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb76408e520 tx=0x7fb75402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41614b8f2fcb4dff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:39.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.608+0000 7fb76159a640 1 -- 172.21.15.19:0/2096961524 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb754037070 con 0x7fb76415e5f0 2024-09-12T01:58:39.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.608+0000 7fb76159a640 1 -- 172.21.15.19:0/2096961524 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb754032440 con 0x7fb76415e5f0 2024-09-12T01:58:39.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.608+0000 7fb76159a640 1 -- 172.21.15.19:0/2096961524 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb754032810 con 0x7fb76415e5f0 2024-09-12T01:58:39.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.609+0000 7fb768e74640 1 -- 172.21.15.19:0/2096961524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb76415e5f0 msgr2=0x7fb7640d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.609+0000 7fb768e74640 1 --2- 172.21.15.19:0/2096961524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb76415e5f0 0x7fb7640d4dd0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb76408e520 tx=0x7fb75402a1a0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.609+0000 7fb768e74640 1 -- 172.21.15.19:0/2096961524 shutdown_connections 2024-09-12T01:58:39.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.609+0000 7fb768e74640 1 --2- 172.21.15.19:0/2096961524 >> v2:172.21.15.135:3300/0 conn(0x7fb7640d30f0 0x7fb7640b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.609+0000 7fb768e74640 1 --2- 172.21.15.19:0/2096961524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb76415e5f0 0x7fb7640d4dd0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.609+0000 7fb768e74640 1 -- 172.21.15.19:0/2096961524 >> 172.21.15.19:0/2096961524 conn(0x7fb76408bfc0 msgr2=0x7fb7640d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:39.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.609+0000 7fb768e74640 1 -- 172.21.15.19:0/2096961524 shutdown_connections 2024-09-12T01:58:39.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.609+0000 7fb768e74640 1 -- 172.21.15.19:0/2096961524 wait complete. 2024-09-12T01:58:39.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.610+0000 7fb768e74640 1 Processor -- start 2024-09-12T01:58:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.610+0000 7fb768e74640 1 -- start start 2024-09-12T01:58:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.611+0000 7fb768e74640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7640b64c0 0x7fb7640a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.611+0000 7fb768e74640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7640d30f0 0x7fb76415b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.611+0000 7fb768e74640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76415e5f0 0x7fb76415ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.611+0000 7fb768e74640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb7640d5310 con 0x7fb7640d30f0 2024-09-12T01:58:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.611+0000 7fb768e74640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb76415e9d0 con 0x7fb76415e5f0 2024-09-12T01:58:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.611+0000 7fb768e74640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb76406e9d0 con 0x7fb7640b64c0 2024-09-12T01:58:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.611+0000 7fb761d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7640d30f0 0x7fb76415b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.611+0000 7fb761d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7640d30f0 0x7fb76415b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35984/0 (socket says 172.21.15.19:35984) 2024-09-12T01:58:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.611+0000 7fb761d9b640 1 -- 172.21.15.19:0/3090177372 learned_addr learned my addr 172.21.15.19:0/3090177372 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.611+0000 7fb76259c640 1 --2- 172.21.15.19:0/3090177372 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7640b64c0 0x7fb7640a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.611+0000 7fb762d9d640 1 --2- 172.21.15.19:0/3090177372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76415e5f0 0x7fb76415ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.612+0000 7fb761d9b640 1 -- 172.21.15.19:0/3090177372 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7640b64c0 msgr2=0x7fb7640a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.612+0000 7fb761d9b640 1 --2- 172.21.15.19:0/3090177372 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7640b64c0 0x7fb7640a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.612+0000 7fb761d9b640 1 -- 172.21.15.19:0/3090177372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76415e5f0 msgr2=0x7fb76415ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.612+0000 7fb761d9b640 1 --2- 172.21.15.19:0/3090177372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76415e5f0 0x7fb76415ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.612+0000 7fb761d9b640 1 -- 172.21.15.19:0/3090177372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7640a0c00 con 0x7fb7640d30f0 2024-09-12T01:58:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.612+0000 7fb761d9b640 1 --2- 172.21.15.19:0/3090177372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7640d30f0 0x7fb76415b2c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb75800c7f0 tx=0x7fb75800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.612+0000 7fb752ffd640 1 -- 172.21.15.19:0/3090177372 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb758015070 con 0x7fb7640d30f0 2024-09-12T01:58:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.612+0000 7fb752ffd640 1 -- 172.21.15.19:0/3090177372 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb758007a30 con 0x7fb7640d30f0 2024-09-12T01:58:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.612+0000 7fb768e74640 1 -- 172.21.15.19:0/3090177372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7640a0e70 con 0x7fb7640d30f0 2024-09-12T01:58:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.612+0000 7fb752ffd640 1 -- 172.21.15.19:0/3090177372 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb758007e00 con 0x7fb7640d30f0 2024-09-12T01:58:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.612+0000 7fb768e74640 1 -- 172.21.15.19:0/3090177372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7640a1430 con 0x7fb7640d30f0 2024-09-12T01:58:39.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.613+0000 7fb768e74640 1 -- 172.21.15.19:0/3090177372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7640b5f80 con 0x7fb7640d30f0 2024-09-12T01:58:39.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.613+0000 7fb752ffd640 1 -- 172.21.15.19:0/3090177372 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb758018070 con 0x7fb7640d30f0 2024-09-12T01:58:39.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.614+0000 7fb752ffd640 1 --2- 172.21.15.19:0/3090177372 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb74406be30 0x7fb74406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.614+0000 7fb752ffd640 1 -- 172.21.15.19:0/3090177372 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6217+0+0 (secure 0 0 0) 0x7fb75808af10 con 0x7fb7640d30f0 2024-09-12T01:58:39.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.614+0000 7fb76259c640 1 --2- 172.21.15.19:0/3090177372 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb74406be30 0x7fb74406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.615+0000 7fb76259c640 1 --2- 172.21.15.19:0/3090177372 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb74406be30 0x7fb74406e2f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb754034000 tx=0x7fb75402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:39.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.618+0000 7fb752ffd640 1 -- 172.21.15.19:0/3090177372 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb758059100 con 0x7fb7640d30f0 2024-09-12T01:58:39.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.790+0000 7fb768e74640 1 -- 172.21.15.19:0/3090177372 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb7640b5010 con 0x7fb74406be30 2024-09-12T01:58:39.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.797+0000 7fb752ffd640 1 -- 172.21.15.19:0/3090177372 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251758 (secure 0 0 0) 0x7fb7640b5010 con 0x7fb74406be30 2024-09-12T01:58:39.800 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:39.801 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:58:39.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.800+0000 7fb768e74640 1 -- 172.21.15.19:0/3090177372 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb74406be30 msgr2=0x7fb74406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.800+0000 7fb768e74640 1 --2- 172.21.15.19:0/3090177372 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb74406be30 0x7fb74406e2f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb754034000 tx=0x7fb75402e000 comp rx=0 tx=0).stop 2024-09-12T01:58:39.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.800+0000 7fb768e74640 1 -- 172.21.15.19:0/3090177372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7640d30f0 msgr2=0x7fb76415b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.800+0000 7fb768e74640 1 --2- 172.21.15.19:0/3090177372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7640d30f0 0x7fb76415b2c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb75800c7f0 tx=0x7fb75800cbf0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.800+0000 7fb768e74640 1 -- 172.21.15.19:0/3090177372 shutdown_connections 2024-09-12T01:58:39.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.800+0000 7fb768e74640 1 --2- 172.21.15.19:0/3090177372 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb74406be30 0x7fb74406e2f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.800+0000 7fb768e74640 1 --2- 172.21.15.19:0/3090177372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76415e5f0 0x7fb76415ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.800+0000 7fb768e74640 1 --2- 172.21.15.19:0/3090177372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7640d30f0 0x7fb76415b2c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.800+0000 7fb768e74640 1 --2- 172.21.15.19:0/3090177372 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7640b64c0 0x7fb7640a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.800+0000 7fb768e74640 1 -- 172.21.15.19:0/3090177372 >> 172.21.15.19:0/3090177372 conn(0x7fb76408bfc0 msgr2=0x7fb7640b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:39.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.800+0000 7fb768e74640 1 -- 172.21.15.19:0/3090177372 shutdown_connections 2024-09-12T01:58:39.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.800+0000 7fb768e74640 1 -- 172.21.15.19:0/3090177372 wait complete. 2024-09-12T01:58:39.811 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-12T01:58:39.123016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231996,"kb_used_data":7436,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742724,"statfs":{"total":773094113280,"available":772856549376,"internally_reserved":0,"allocated":7614464,"data_stored":4080499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.002393"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666882+0000","last_change":"2024-09-12T01:58:32.098775+0000","last_active":"2024-09-12T01:58:33.666882+0000","last_peered":"2024-09-12T01:58:33.666882+0000","last_clean":"2024-09-12T01:58:33.666882+0000","last_became_active":"2024-09-12T01:58:32.098472+0000","last_became_peered":"2024-09-12T01:58:32.098472+0000","last_unstale":"2024-09-12T01:58:33.666882+0000","last_undegraded":"2024-09-12T01:58:33.666882+0000","last_fullsized":"2024-09-12T01:58:33.666882+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:34.058890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666728+0000","last_change":"2024-09-12T01:58:32.092794+0000","last_active":"2024-09-12T01:58:33.666728+0000","last_peered":"2024-09-12T01:58:33.666728+0000","last_clean":"2024-09-12T01:58:33.666728+0000","last_became_active":"2024-09-12T01:58:32.092525+0000","last_became_peered":"2024-09-12T01:58:32.092525+0000","last_unstale":"2024-09-12T01:58:33.666728+0000","last_undegraded":"2024-09-12T01:58:33.666728+0000","last_fullsized":"2024-09-12T01:58:33.666728+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:05.445047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127514+0000","last_change":"2024-09-12T01:58:32.099017+0000","last_active":"2024-09-12T01:58:38.127514+0000","last_peered":"2024-09-12T01:58:38.127514+0000","last_clean":"2024-09-12T01:58:38.127514+0000","last_became_active":"2024-09-12T01:58:32.095848+0000","last_became_peered":"2024-09-12T01:58:32.095848+0000","last_unstale":"2024-09-12T01:58:38.127514+0000","last_undegraded":"2024-09-12T01:58:38.127514+0000","last_fullsized":"2024-09-12T01:58:38.127514+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:50.997517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071261+0000","last_change":"2024-09-12T01:58:32.086522+0000","last_active":"2024-09-12T01:58:33.071261+0000","last_peered":"2024-09-12T01:58:33.071261+0000","last_clean":"2024-09-12T01:58:33.071261+0000","last_became_active":"2024-09-12T01:58:32.086029+0000","last_became_peered":"2024-09-12T01:58:32.086029+0000","last_unstale":"2024-09-12T01:58:33.071261+0000","last_undegraded":"2024-09-12T01:58:33.071261+0000","last_fullsized":"2024-09-12T01:58:33.071261+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:53.481574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T01:58:34.120954+0000","last_change":"2024-09-12T01:58:38.120334+0000","last_active":"2024-09-12T01:58:38.120334+0000","last_peered":"2024-09-12T01:58:34.120954+0000","last_clean":"2024-09-12T01:58:34.120954+0000","last_became_active":"2024-09-12T01:58:32.083847+0000","last_became_peered":"2024-09-12T01:58:32.083847+0000","last_unstale":"2024-09-12T01:58:34.120954+0000","last_undegraded":"2024-09-12T01:58:34.120954+0000","last_fullsized":"2024-09-12T01:58:34.120954+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072181+0000","last_change":"2024-09-12T01:58:32.090868+0000","last_active":"2024-09-12T01:58:33.072181+0000","last_peered":"2024-09-12T01:58:33.072181+0000","last_clean":"2024-09-12T01:58:33.072181+0000","last_became_active":"2024-09-12T01:58:32.090596+0000","last_became_peered":"2024-09-12T01:58:32.090596+0000","last_unstale":"2024-09-12T01:58:33.072181+0000","last_undegraded":"2024-09-12T01:58:33.072181+0000","last_fullsized":"2024-09-12T01:58:33.072181+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:19.012343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.122213+0000","last_change":"2024-09-12T01:58:32.091013+0000","last_active":"2024-09-12T01:58:38.122213+0000","last_peered":"2024-09-12T01:58:38.122213+0000","last_clean":"2024-09-12T01:58:38.122213+0000","last_became_active":"2024-09-12T01:58:32.090711+0000","last_became_peered":"2024-09-12T01:58:32.090711+0000","last_unstale":"2024-09-12T01:58:38.122213+0000","last_undegraded":"2024-09-12T01:58:38.122213+0000","last_fullsized":"2024-09-12T01:58:38.122213+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:42.450557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615856+0000","last_change":"2024-09-12T01:58:32.100103+0000","last_active":"2024-09-12T01:58:38.615856+0000","last_peered":"2024-09-12T01:58:38.615856+0000","last_clean":"2024-09-12T01:58:38.615856+0000","last_became_active":"2024-09-12T01:58:32.099846+0000","last_became_peered":"2024-09-12T01:58:32.099846+0000","last_unstale":"2024-09-12T01:58:38.615856+0000","last_undegraded":"2024-09-12T01:58:38.615856+0000","last_fullsized":"2024-09-12T01:58:38.615856+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:46.632781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127748+0000","last_change":"2024-09-12T01:58:32.099992+0000","last_active":"2024-09-12T01:58:38.127748+0000","last_peered":"2024-09-12T01:58:38.127748+0000","last_clean":"2024-09-12T01:58:38.127748+0000","last_became_active":"2024-09-12T01:58:32.099721+0000","last_became_peered":"2024-09-12T01:58:32.099721+0000","last_unstale":"2024-09-12T01:58:38.127748+0000","last_undegraded":"2024-09-12T01:58:38.127748+0000","last_fullsized":"2024-09-12T01:58:38.127748+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:38.169564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127632+0000","last_change":"2024-09-12T01:58:32.101085+0000","last_active":"2024-09-12T01:58:38.127632+0000","last_peered":"2024-09-12T01:58:38.127632+0000","last_clean":"2024-09-12T01:58:38.127632+0000","last_became_active":"2024-09-12T01:58:32.100128+0000","last_became_peered":"2024-09-12T01:58:32.100128+0000","last_unstale":"2024-09-12T01:58:38.127632+0000","last_undegraded":"2024-09-12T01:58:38.127632+0000","last_fullsized":"2024-09-12T01:58:38.127632+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:02.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071172+0000","last_change":"2024-09-12T01:58:32.093435+0000","last_active":"2024-09-12T01:58:33.071172+0000","last_peered":"2024-09-12T01:58:33.071172+0000","last_clean":"2024-09-12T01:58:33.071172+0000","last_became_active":"2024-09-12T01:58:32.092950+0000","last_became_peered":"2024-09-12T01:58:32.092950+0000","last_unstale":"2024-09-12T01:58:33.071172+0000","last_undegraded":"2024-09-12T01:58:33.071172+0000","last_fullsized":"2024-09-12T01:58:33.071172+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:25.908231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615981+0000","last_change":"2024-09-12T01:58:32.096884+0000","last_active":"2024-09-12T01:58:38.615981+0000","last_peered":"2024-09-12T01:58:38.615981+0000","last_clean":"2024-09-12T01:58:38.615981+0000","last_became_active":"2024-09-12T01:58:32.096608+0000","last_became_peered":"2024-09-12T01:58:32.096608+0000","last_unstale":"2024-09-12T01:58:38.615981+0000","last_undegraded":"2024-09-12T01:58:38.615981+0000","last_fullsized":"2024-09-12T01:58:38.615981+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:50.997517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615968+0000","last_change":"2024-09-12T01:58:32.091527+0000","last_active":"2024-09-12T01:58:38.615968+0000","last_peered":"2024-09-12T01:58:38.615968+0000","last_clean":"2024-09-12T01:58:38.615968+0000","last_became_active":"2024-09-12T01:58:32.090919+0000","last_became_peered":"2024-09-12T01:58:32.090919+0000","last_unstale":"2024-09-12T01:58:38.615968+0000","last_undegraded":"2024-09-12T01:58:38.615968+0000","last_fullsized":"2024-09-12T01:58:38.615968+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:00.209541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127393+0000","last_change":"2024-09-12T01:58:32.099040+0000","last_active":"2024-09-12T01:58:38.127393+0000","last_peered":"2024-09-12T01:58:38.127393+0000","last_clean":"2024-09-12T01:58:38.127393+0000","last_became_active":"2024-09-12T01:58:32.098246+0000","last_became_peered":"2024-09-12T01:58:32.098246+0000","last_unstale":"2024-09-12T01:58:38.127393+0000","last_undegraded":"2024-09-12T01:58:38.127393+0000","last_fullsized":"2024-09-12T01:58:38.127393+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:27.519989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127321+0000","last_change":"2024-09-12T01:58:32.099874+0000","last_active":"2024-09-12T01:58:38.127321+0000","last_peered":"2024-09-12T01:58:38.127321+0000","last_clean":"2024-09-12T01:58:38.127321+0000","last_became_active":"2024-09-12T01:58:32.099591+0000","last_became_peered":"2024-09-12T01:58:32.099591+0000","last_unstale":"2024-09-12T01:58:38.127321+0000","last_undegraded":"2024-09-12T01:58:38.127321+0000","last_fullsized":"2024-09-12T01:58:38.127321+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:00.209541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.122728+0000","last_change":"2024-09-12T01:58:32.092337+0000","last_active":"2024-09-12T01:58:38.122728+0000","last_peered":"2024-09-12T01:58:38.122728+0000","last_clean":"2024-09-12T01:58:38.122728+0000","last_became_active":"2024-09-12T01:58:32.091794+0000","last_became_peered":"2024-09-12T01:58:32.091794+0000","last_unstale":"2024-09-12T01:58:38.122728+0000","last_undegraded":"2024-09-12T01:58:38.122728+0000","last_fullsized":"2024-09-12T01:58:38.122728+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:32.941238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666916+0000","last_change":"2024-09-12T01:58:32.099798+0000","last_active":"2024-09-12T01:58:33.666916+0000","last_peered":"2024-09-12T01:58:33.666916+0000","last_clean":"2024-09-12T01:58:33.666916+0000","last_became_active":"2024-09-12T01:58:32.099440+0000","last_became_peered":"2024-09-12T01:58:32.099440+0000","last_unstale":"2024-09-12T01:58:33.666916+0000","last_undegraded":"2024-09-12T01:58:33.666916+0000","last_fullsized":"2024-09-12T01:58:33.666916+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:53.552573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071740+0000","last_change":"2024-09-12T01:58:32.086299+0000","last_active":"2024-09-12T01:58:33.071740+0000","last_peered":"2024-09-12T01:58:33.071740+0000","last_clean":"2024-09-12T01:58:33.071740+0000","last_became_active":"2024-09-12T01:58:32.085968+0000","last_became_peered":"2024-09-12T01:58:32.085968+0000","last_unstale":"2024-09-12T01:58:33.071740+0000","last_undegraded":"2024-09-12T01:58:33.071740+0000","last_fullsized":"2024-09-12T01:58:33.071740+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:55.745348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.121003+0000","last_change":"2024-09-12T01:58:32.089146+0000","last_active":"2024-09-12T01:58:38.121003+0000","last_peered":"2024-09-12T01:58:38.121003+0000","last_clean":"2024-09-12T01:58:38.121003+0000","last_became_active":"2024-09-12T01:58:32.088503+0000","last_became_peered":"2024-09-12T01:58:32.088503+0000","last_unstale":"2024-09-12T01:58:38.121003+0000","last_undegraded":"2024-09-12T01:58:38.121003+0000","last_fullsized":"2024-09-12T01:58:38.121003+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:06.577465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915709+0000","last_change":"2024-09-12T01:58:32.089658+0000","last_active":"2024-09-12T01:58:33.915709+0000","last_peered":"2024-09-12T01:58:33.915709+0000","last_clean":"2024-09-12T01:58:33.915709+0000","last_became_active":"2024-09-12T01:58:32.089374+0000","last_became_peered":"2024-09-12T01:58:32.089374+0000","last_unstale":"2024-09-12T01:58:33.915709+0000","last_undegraded":"2024-09-12T01:58:33.915709+0000","last_fullsized":"2024-09-12T01:58:33.915709+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:31.386141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616083+0000","last_change":"2024-09-12T01:58:32.097896+0000","last_active":"2024-09-12T01:58:38.616083+0000","last_peered":"2024-09-12T01:58:38.616083+0000","last_clean":"2024-09-12T01:58:38.616083+0000","last_became_active":"2024-09-12T01:58:32.097631+0000","last_became_peered":"2024-09-12T01:58:32.097631+0000","last_unstale":"2024-09-12T01:58:38.616083+0000","last_undegraded":"2024-09-12T01:58:38.616083+0000","last_fullsized":"2024-09-12T01:58:38.616083+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:38.169564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915664+0000","last_change":"2024-09-12T01:58:32.091442+0000","last_active":"2024-09-12T01:58:33.915664+0000","last_peered":"2024-09-12T01:58:33.915664+0000","last_clean":"2024-09-12T01:58:33.915664+0000","last_became_active":"2024-09-12T01:58:32.091113+0000","last_became_peered":"2024-09-12T01:58:32.091113+0000","last_unstale":"2024-09-12T01:58:33.915664+0000","last_undegraded":"2024-09-12T01:58:33.915664+0000","last_fullsized":"2024-09-12T01:58:33.915664+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:42.748051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915663+0000","last_change":"2024-09-12T01:58:32.090771+0000","last_active":"2024-09-12T01:58:33.915663+0000","last_peered":"2024-09-12T01:58:33.915663+0000","last_clean":"2024-09-12T01:58:33.915663+0000","last_became_active":"2024-09-12T01:58:32.090506+0000","last_became_peered":"2024-09-12T01:58:32.090506+0000","last_unstale":"2024-09-12T01:58:33.915663+0000","last_undegraded":"2024-09-12T01:58:33.915663+0000","last_fullsized":"2024-09-12T01:58:33.915663+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:57.559803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127749+0000","last_change":"2024-09-12T01:58:32.095936+0000","last_active":"2024-09-12T01:58:38.127749+0000","last_peered":"2024-09-12T01:58:38.127749+0000","last_clean":"2024-09-12T01:58:38.127749+0000","last_became_active":"2024-09-12T01:58:32.095625+0000","last_became_peered":"2024-09-12T01:58:32.095625+0000","last_unstale":"2024-09-12T01:58:38.127749+0000","last_undegraded":"2024-09-12T01:58:38.127749+0000","last_fullsized":"2024-09-12T01:58:38.127749+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:59.477648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616166+0000","last_change":"2024-09-12T01:58:32.094671+0000","last_active":"2024-09-12T01:58:38.616166+0000","last_peered":"2024-09-12T01:58:38.616166+0000","last_clean":"2024-09-12T01:58:38.616166+0000","last_became_active":"2024-09-12T01:58:32.093934+0000","last_became_peered":"2024-09-12T01:58:32.093934+0000","last_unstale":"2024-09-12T01:58:38.616166+0000","last_undegraded":"2024-09-12T01:58:38.616166+0000","last_fullsized":"2024-09-12T01:58:38.616166+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:15.459156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616162+0000","last_change":"2024-09-12T01:58:32.094546+0000","last_active":"2024-09-12T01:58:38.616162+0000","last_peered":"2024-09-12T01:58:38.616162+0000","last_clean":"2024-09-12T01:58:38.616162+0000","last_became_active":"2024-09-12T01:58:32.094242+0000","last_became_peered":"2024-09-12T01:58:32.094242+0000","last_unstale":"2024-09-12T01:58:38.616162+0000","last_undegraded":"2024-09-12T01:58:38.616162+0000","last_fullsized":"2024-09-12T01:58:38.616162+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:24.307268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071322+0000","last_change":"2024-09-12T01:58:32.088553+0000","last_active":"2024-09-12T01:58:33.071322+0000","last_peered":"2024-09-12T01:58:33.071322+0000","last_clean":"2024-09-12T01:58:33.071322+0000","last_became_active":"2024-09-12T01:58:32.087827+0000","last_became_peered":"2024-09-12T01:58:32.087827+0000","last_unstale":"2024-09-12T01:58:33.071322+0000","last_undegraded":"2024-09-12T01:58:33.071322+0000","last_fullsized":"2024-09-12T01:58:33.071322+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:12.553586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666813+0000","last_change":"2024-09-12T01:58:32.095548+0000","last_active":"2024-09-12T01:58:33.666813+0000","last_peered":"2024-09-12T01:58:33.666813+0000","last_clean":"2024-09-12T01:58:33.666813+0000","last_became_active":"2024-09-12T01:58:32.094714+0000","last_became_peered":"2024-09-12T01:58:32.094714+0000","last_unstale":"2024-09-12T01:58:33.666813+0000","last_undegraded":"2024-09-12T01:58:33.666813+0000","last_fullsized":"2024-09-12T01:58:33.666813+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:52.686475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127402+0000","last_change":"2024-09-12T01:58:32.089782+0000","last_active":"2024-09-12T01:58:38.127402+0000","last_peered":"2024-09-12T01:58:38.127402+0000","last_clean":"2024-09-12T01:58:38.127402+0000","last_became_active":"2024-09-12T01:58:32.089548+0000","last_became_peered":"2024-09-12T01:58:32.089548+0000","last_unstale":"2024-09-12T01:58:38.127402+0000","last_undegraded":"2024-09-12T01:58:38.127402+0000","last_fullsized":"2024-09-12T01:58:38.127402+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.413296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615869+0000","last_change":"2024-09-12T01:58:32.099407+0000","last_active":"2024-09-12T01:58:38.615869+0000","last_peered":"2024-09-12T01:58:38.615869+0000","last_clean":"2024-09-12T01:58:38.615869+0000","last_became_active":"2024-09-12T01:58:32.099119+0000","last_became_peered":"2024-09-12T01:58:32.099119+0000","last_unstale":"2024-09-12T01:58:38.615869+0000","last_undegraded":"2024-09-12T01:58:38.615869+0000","last_fullsized":"2024-09-12T01:58:38.615869+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:45.710198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071526+0000","last_change":"2024-09-12T01:58:32.088560+0000","last_active":"2024-09-12T01:58:33.071526+0000","last_peered":"2024-09-12T01:58:33.071526+0000","last_clean":"2024-09-12T01:58:33.071526+0000","last_became_active":"2024-09-12T01:58:32.088317+0000","last_became_peered":"2024-09-12T01:58:32.088317+0000","last_unstale":"2024-09-12T01:58:33.071526+0000","last_undegraded":"2024-09-12T01:58:33.071526+0000","last_fullsized":"2024-09-12T01:58:33.071526+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:06.911951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071936+0000","last_change":"2024-09-12T01:58:32.085708+0000","last_active":"2024-09-12T01:58:33.071936+0000","last_peered":"2024-09-12T01:58:33.071936+0000","last_clean":"2024-09-12T01:58:33.071936+0000","last_became_active":"2024-09-12T01:58:32.085394+0000","last_became_peered":"2024-09-12T01:58:32.085394+0000","last_unstale":"2024-09-12T01:58:33.071936+0000","last_undegraded":"2024-09-12T01:58:33.071936+0000","last_fullsized":"2024-09-12T01:58:33.071936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:02.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.120111+0000","last_change":"2024-09-12T01:58:32.096958+0000","last_active":"2024-09-12T01:58:38.120111+0000","last_peered":"2024-09-12T01:58:38.120111+0000","last_clean":"2024-09-12T01:58:38.120111+0000","last_became_active":"2024-09-12T01:58:32.096288+0000","last_became_peered":"2024-09-12T01:58:32.096288+0000","last_unstale":"2024-09-12T01:58:38.120111+0000","last_undegraded":"2024-09-12T01:58:38.120111+0000","last_fullsized":"2024-09-12T01:58:38.120111+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:51.645585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"65'4","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666944+0000","last_change":"2024-09-12T01:58:31.085572+0000","last_active":"2024-09-12T01:58:33.666944+0000","last_peered":"2024-09-12T01:58:33.666944+0000","last_clean":"2024-09-12T01:58:33.666944+0000","last_became_active":"2024-09-12T01:58:31.085308+0000","last_became_peered":"2024-09-12T01:58:31.085308+0000","last_unstale":"2024-09-12T01:58:33.666944+0000","last_undegraded":"2024-09-12T01:58:33.666944+0000","last_fullsized":"2024-09-12T01:58:33.666944+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:47.308955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071403+0000","last_change":"2024-09-12T01:58:32.093055+0000","last_active":"2024-09-12T01:58:33.071403+0000","last_peered":"2024-09-12T01:58:33.071403+0000","last_clean":"2024-09-12T01:58:33.071403+0000","last_became_active":"2024-09-12T01:58:32.092801+0000","last_became_peered":"2024-09-12T01:58:32.092801+0000","last_unstale":"2024-09-12T01:58:33.071403+0000","last_undegraded":"2024-09-12T01:58:33.071403+0000","last_fullsized":"2024-09-12T01:58:33.071403+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:27.155936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072473+0000","last_change":"2024-09-12T01:58:31.082993+0000","last_active":"2024-09-12T01:58:33.072473+0000","last_peered":"2024-09-12T01:58:33.072473+0000","last_clean":"2024-09-12T01:58:33.072473+0000","last_became_active":"2024-09-12T01:58:31.082679+0000","last_became_peered":"2024-09-12T01:58:31.082679+0000","last_unstale":"2024-09-12T01:58:33.072473+0000","last_undegraded":"2024-09-12T01:58:33.072473+0000","last_fullsized":"2024-09-12T01:58:33.072473+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:16.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072371+0000","last_change":"2024-09-12T01:58:32.078918+0000","last_active":"2024-09-12T01:58:33.072371+0000","last_peered":"2024-09-12T01:58:33.072371+0000","last_clean":"2024-09-12T01:58:33.072371+0000","last_became_active":"2024-09-12T01:58:32.078659+0000","last_became_peered":"2024-09-12T01:58:32.078659+0000","last_unstale":"2024-09-12T01:58:33.072371+0000","last_undegraded":"2024-09-12T01:58:33.072371+0000","last_fullsized":"2024-09-12T01:58:33.072371+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:02.012816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072329+0000","last_change":"2024-09-12T01:58:31.085752+0000","last_active":"2024-09-12T01:58:33.072329+0000","last_peered":"2024-09-12T01:58:33.072329+0000","last_clean":"2024-09-12T01:58:33.072329+0000","last_became_active":"2024-09-12T01:58:31.085456+0000","last_became_peered":"2024-09-12T01:58:31.085456+0000","last_unstale":"2024-09-12T01:58:33.072329+0000","last_undegraded":"2024-09-12T01:58:33.072329+0000","last_fullsized":"2024-09-12T01:58:33.072329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:44.704921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127603+0000","last_change":"2024-09-12T01:58:32.098820+0000","last_active":"2024-09-12T01:58:38.127603+0000","last_peered":"2024-09-12T01:58:38.127603+0000","last_clean":"2024-09-12T01:58:38.127603+0000","last_became_active":"2024-09-12T01:58:32.098562+0000","last_became_peered":"2024-09-12T01:58:32.098562+0000","last_unstale":"2024-09-12T01:58:38.127603+0000","last_undegraded":"2024-09-12T01:58:38.127603+0000","last_fullsized":"2024-09-12T01:58:38.127603+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:15.459156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072133+0000","last_change":"2024-09-12T01:58:31.082135+0000","last_active":"2024-09-12T01:58:33.072133+0000","last_peered":"2024-09-12T01:58:33.072133+0000","last_clean":"2024-09-12T01:58:33.072133+0000","last_became_active":"2024-09-12T01:58:31.081834+0000","last_became_peered":"2024-09-12T01:58:31.081834+0000","last_unstale":"2024-09-12T01:58:33.072133+0000","last_undegraded":"2024-09-12T01:58:33.072133+0000","last_fullsized":"2024-09-12T01:58:33.072133+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:59.204264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.122155+0000","last_change":"2024-09-12T01:58:32.092057+0000","last_active":"2024-09-12T01:58:38.122155+0000","last_peered":"2024-09-12T01:58:38.122155+0000","last_clean":"2024-09-12T01:58:38.122155+0000","last_became_active":"2024-09-12T01:58:32.091372+0000","last_became_peered":"2024-09-12T01:58:32.091372+0000","last_unstale":"2024-09-12T01:58:38.122155+0000","last_undegraded":"2024-09-12T01:58:38.122155+0000","last_fullsized":"2024-09-12T01:58:38.122155+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:50.595958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915799+0000","last_change":"2024-09-12T01:58:31.085302+0000","last_active":"2024-09-12T01:58:33.915799+0000","last_peered":"2024-09-12T01:58:33.915799+0000","last_clean":"2024-09-12T01:58:33.915799+0000","last_became_active":"2024-09-12T01:58:31.084995+0000","last_became_peered":"2024-09-12T01:58:31.084995+0000","last_unstale":"2024-09-12T01:58:33.915799+0000","last_undegraded":"2024-09-12T01:58:33.915799+0000","last_fullsized":"2024-09-12T01:58:33.915799+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:18.228685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666540+0000","last_change":"2024-09-12T01:58:32.099965+0000","last_active":"2024-09-12T01:58:33.666540+0000","last_peered":"2024-09-12T01:58:33.666540+0000","last_clean":"2024-09-12T01:58:33.666540+0000","last_became_active":"2024-09-12T01:58:32.099518+0000","last_became_peered":"2024-09-12T01:58:32.099518+0000","last_unstale":"2024-09-12T01:58:33.666540+0000","last_undegraded":"2024-09-12T01:58:33.666540+0000","last_fullsized":"2024-09-12T01:58:33.666540+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:55.745348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915580+0000","last_change":"2024-09-12T01:58:31.086015+0000","last_active":"2024-09-12T01:58:33.915580+0000","last_peered":"2024-09-12T01:58:33.915580+0000","last_clean":"2024-09-12T01:58:33.915580+0000","last_became_active":"2024-09-12T01:58:31.085736+0000","last_became_peered":"2024-09-12T01:58:31.085736+0000","last_unstale":"2024-09-12T01:58:33.915580+0000","last_undegraded":"2024-09-12T01:58:33.915580+0000","last_fullsized":"2024-09-12T01:58:33.915580+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:58.281292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.121032+0000","last_change":"2024-09-12T01:58:32.092252+0000","last_active":"2024-09-12T01:58:38.121032+0000","last_peered":"2024-09-12T01:58:38.121032+0000","last_clean":"2024-09-12T01:58:38.121032+0000","last_became_active":"2024-09-12T01:58:32.091933+0000","last_became_peered":"2024-09-12T01:58:32.091933+0000","last_unstale":"2024-09-12T01:58:38.121032+0000","last_undegraded":"2024-09-12T01:58:38.121032+0000","last_fullsized":"2024-09-12T01:58:38.121032+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:20.410580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915595+0000","last_change":"2024-09-12T01:58:31.078913+0000","last_active":"2024-09-12T01:58:33.915595+0000","last_peered":"2024-09-12T01:58:33.915595+0000","last_clean":"2024-09-12T01:58:33.915595+0000","last_became_active":"2024-09-12T01:58:31.078594+0000","last_became_peered":"2024-09-12T01:58:31.078594+0000","last_unstale":"2024-09-12T01:58:33.915595+0000","last_undegraded":"2024-09-12T01:58:33.915595+0000","last_fullsized":"2024-09-12T01:58:33.915595+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:32.332146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915900+0000","last_change":"2024-09-12T01:58:32.082690+0000","last_active":"2024-09-12T01:58:33.915900+0000","last_peered":"2024-09-12T01:58:33.915900+0000","last_clean":"2024-09-12T01:58:33.915900+0000","last_became_active":"2024-09-12T01:58:32.082372+0000","last_became_peered":"2024-09-12T01:58:32.082372+0000","last_unstale":"2024-09-12T01:58:33.915900+0000","last_undegraded":"2024-09-12T01:58:33.915900+0000","last_fullsized":"2024-09-12T01:58:33.915900+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:13.919476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.119793+0000","last_change":"2024-09-12T01:58:31.084452+0000","last_active":"2024-09-12T01:58:38.119793+0000","last_peered":"2024-09-12T01:58:38.119793+0000","last_clean":"2024-09-12T01:58:38.119793+0000","last_became_active":"2024-09-12T01:58:31.084091+0000","last_became_peered":"2024-09-12T01:58:31.084091+0000","last_unstale":"2024-09-12T01:58:38.119793+0000","last_undegraded":"2024-09-12T01:58:38.119793+0000","last_fullsized":"2024-09-12T01:58:38.119793+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:02.589355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666914+0000","last_change":"2024-09-12T01:58:32.095478+0000","last_active":"2024-09-12T01:58:33.666914+0000","last_peered":"2024-09-12T01:58:33.666914+0000","last_clean":"2024-09-12T01:58:33.666914+0000","last_became_active":"2024-09-12T01:58:32.094996+0000","last_became_peered":"2024-09-12T01:58:32.094996+0000","last_unstale":"2024-09-12T01:58:33.666914+0000","last_undegraded":"2024-09-12T01:58:33.666914+0000","last_fullsized":"2024-09-12T01:58:33.666914+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:15.825443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127848+0000","last_change":"2024-09-12T01:58:31.091023+0000","last_active":"2024-09-12T01:58:38.127848+0000","last_peered":"2024-09-12T01:58:38.127848+0000","last_clean":"2024-09-12T01:58:38.127848+0000","last_became_active":"2024-09-12T01:58:31.090814+0000","last_became_peered":"2024-09-12T01:58:31.090814+0000","last_unstale":"2024-09-12T01:58:38.127848+0000","last_undegraded":"2024-09-12T01:58:38.127848+0000","last_fullsized":"2024-09-12T01:58:38.127848+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:13.812313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915828+0000","last_change":"2024-09-12T01:58:32.093516+0000","last_active":"2024-09-12T01:58:33.915828+0000","last_peered":"2024-09-12T01:58:33.915828+0000","last_clean":"2024-09-12T01:58:33.915828+0000","last_became_active":"2024-09-12T01:58:32.093213+0000","last_became_peered":"2024-09-12T01:58:32.093213+0000","last_unstale":"2024-09-12T01:58:33.915828+0000","last_undegraded":"2024-09-12T01:58:33.915828+0000","last_fullsized":"2024-09-12T01:58:33.915828+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:23.467846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071892+0000","last_change":"2024-09-12T01:58:31.076858+0000","last_active":"2024-09-12T01:58:33.071892+0000","last_peered":"2024-09-12T01:58:33.071892+0000","last_clean":"2024-09-12T01:58:33.071892+0000","last_became_active":"2024-09-12T01:58:31.076593+0000","last_became_peered":"2024-09-12T01:58:31.076593+0000","last_unstale":"2024-09-12T01:58:33.071892+0000","last_undegraded":"2024-09-12T01:58:33.071892+0000","last_fullsized":"2024-09-12T01:58:33.071892+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:30.358255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.120631+0000","last_change":"2024-09-12T01:58:32.096897+0000","last_active":"2024-09-12T01:58:38.120631+0000","last_peered":"2024-09-12T01:58:38.120631+0000","last_clean":"2024-09-12T01:58:38.120631+0000","last_became_active":"2024-09-12T01:58:32.095734+0000","last_became_peered":"2024-09-12T01:58:32.095734+0000","last_unstale":"2024-09-12T01:58:38.120631+0000","last_undegraded":"2024-09-12T01:58:38.120631+0000","last_fullsized":"2024-09-12T01:58:38.120631+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:58.521341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"65'3","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127537+0000","last_change":"2024-09-12T01:58:31.085278+0000","last_active":"2024-09-12T01:58:38.127537+0000","last_peered":"2024-09-12T01:58:38.127537+0000","last_clean":"2024-09-12T01:58:38.127537+0000","last_became_active":"2024-09-12T01:58:31.084951+0000","last_became_peered":"2024-09-12T01:58:31.084951+0000","last_unstale":"2024-09-12T01:58:38.127537+0000","last_undegraded":"2024-09-12T01:58:38.127537+0000","last_fullsized":"2024-09-12T01:58:38.127537+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:41.804439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.070832+0000","last_change":"2024-09-12T01:58:32.086718+0000","last_active":"2024-09-12T01:58:33.070832+0000","last_peered":"2024-09-12T01:58:33.070832+0000","last_clean":"2024-09-12T01:58:33.070832+0000","last_became_active":"2024-09-12T01:58:32.086444+0000","last_became_peered":"2024-09-12T01:58:32.086444+0000","last_unstale":"2024-09-12T01:58:33.070832+0000","last_undegraded":"2024-09-12T01:58:33.070832+0000","last_fullsized":"2024-09-12T01:58:33.070832+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:13.252384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"65'6","reported_seq":20,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666897+0000","last_change":"2024-09-12T01:58:31.079583+0000","last_active":"2024-09-12T01:58:33.666897+0000","last_peered":"2024-09-12T01:58:33.666897+0000","last_clean":"2024-09-12T01:58:33.666897+0000","last_became_active":"2024-09-12T01:58:31.079317+0000","last_became_peered":"2024-09-12T01:58:31.079317+0000","last_unstale":"2024-09-12T01:58:33.666897+0000","last_undegraded":"2024-09-12T01:58:33.666897+0000","last_fullsized":"2024-09-12T01:58:33.666897+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:33.047976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071905+0000","last_change":"2024-09-12T01:58:32.097734+0000","last_active":"2024-09-12T01:58:33.071905+0000","last_peered":"2024-09-12T01:58:33.071905+0000","last_clean":"2024-09-12T01:58:33.071905+0000","last_became_active":"2024-09-12T01:58:32.095245+0000","last_became_peered":"2024-09-12T01:58:32.095245+0000","last_unstale":"2024-09-12T01:58:33.071905+0000","last_undegraded":"2024-09-12T01:58:33.071905+0000","last_fullsized":"2024-09-12T01:58:33.071905+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:13.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"65'2","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127434+0000","last_change":"2024-09-12T01:58:31.085938+0000","last_active":"2024-09-12T01:58:38.127434+0000","last_peered":"2024-09-12T01:58:38.127434+0000","last_clean":"2024-09-12T01:58:38.127434+0000","last_became_active":"2024-09-12T01:58:31.085635+0000","last_became_peered":"2024-09-12T01:58:31.085635+0000","last_unstale":"2024-09-12T01:58:38.127434+0000","last_undegraded":"2024-09-12T01:58:38.127434+0000","last_fullsized":"2024-09-12T01:58:38.127434+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:39.540230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615859+0000","last_change":"2024-09-12T01:58:32.093963+0000","last_active":"2024-09-12T01:58:38.615859+0000","last_peered":"2024-09-12T01:58:38.615859+0000","last_clean":"2024-09-12T01:58:38.615859+0000","last_became_active":"2024-09-12T01:58:32.093588+0000","last_became_peered":"2024-09-12T01:58:32.093588+0000","last_unstale":"2024-09-12T01:58:38.615859+0000","last_undegraded":"2024-09-12T01:58:38.615859+0000","last_fullsized":"2024-09-12T01:58:38.615859+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:59.477648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615888+0000","last_change":"2024-09-12T01:58:31.083496+0000","last_active":"2024-09-12T01:58:38.615888+0000","last_peered":"2024-09-12T01:58:38.615888+0000","last_clean":"2024-09-12T01:58:38.615888+0000","last_became_active":"2024-09-12T01:58:31.083282+0000","last_became_peered":"2024-09-12T01:58:31.083282+0000","last_unstale":"2024-09-12T01:58:38.615888+0000","last_undegraded":"2024-09-12T01:58:38.615888+0000","last_fullsized":"2024-09-12T01:58:38.615888+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:39.540230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.121073+0000","last_change":"2024-09-12T01:58:32.085515+0000","last_active":"2024-09-12T01:58:38.121073+0000","last_peered":"2024-09-12T01:58:38.121073+0000","last_clean":"2024-09-12T01:58:38.121073+0000","last_became_active":"2024-09-12T01:58:32.085180+0000","last_became_peered":"2024-09-12T01:58:32.085180+0000","last_unstale":"2024-09-12T01:58:38.121073+0000","last_undegraded":"2024-09-12T01:58:38.121073+0000","last_fullsized":"2024-09-12T01:58:38.121073+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:46.112207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127552+0000","last_change":"2024-09-12T01:58:31.085595+0000","last_active":"2024-09-12T01:58:38.127552+0000","last_peered":"2024-09-12T01:58:38.127552+0000","last_clean":"2024-09-12T01:58:38.127552+0000","last_became_active":"2024-09-12T01:58:31.085333+0000","last_became_peered":"2024-09-12T01:58:31.085333+0000","last_unstale":"2024-09-12T01:58:38.127552+0000","last_undegraded":"2024-09-12T01:58:38.127552+0000","last_fullsized":"2024-09-12T01:58:38.127552+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:47.588497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666733+0000","last_change":"2024-09-12T01:58:32.101742+0000","last_active":"2024-09-12T01:58:33.666733+0000","last_peered":"2024-09-12T01:58:33.666733+0000","last_clean":"2024-09-12T01:58:33.666733+0000","last_became_active":"2024-09-12T01:58:32.100985+0000","last_became_peered":"2024-09-12T01:58:32.100985+0000","last_unstale":"2024-09-12T01:58:33.666733+0000","last_undegraded":"2024-09-12T01:58:33.666733+0000","last_fullsized":"2024-09-12T01:58:33.666733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:13.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"65'8","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071852+0000","last_change":"2024-09-12T01:58:31.080233+0000","last_active":"2024-09-12T01:58:33.071852+0000","last_peered":"2024-09-12T01:58:33.071852+0000","last_clean":"2024-09-12T01:58:33.071852+0000","last_became_active":"2024-09-12T01:58:31.079923+0000","last_became_peered":"2024-09-12T01:58:31.079923+0000","last_unstale":"2024-09-12T01:58:33.071852+0000","last_undegraded":"2024-09-12T01:58:33.071852+0000","last_fullsized":"2024-09-12T01:58:33.071852+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:18.045768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127654+0000","last_change":"2024-09-12T01:58:32.095870+0000","last_active":"2024-09-12T01:58:38.127654+0000","last_peered":"2024-09-12T01:58:38.127654+0000","last_clean":"2024-09-12T01:58:38.127654+0000","last_became_active":"2024-09-12T01:58:32.095589+0000","last_became_peered":"2024-09-12T01:58:32.095589+0000","last_unstale":"2024-09-12T01:58:38.127654+0000","last_undegraded":"2024-09-12T01:58:38.127654+0000","last_fullsized":"2024-09-12T01:58:38.127654+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:50.976465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"65'1","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616189+0000","last_change":"2024-09-12T01:58:31.085862+0000","last_active":"2024-09-12T01:58:38.616189+0000","last_peered":"2024-09-12T01:58:38.616189+0000","last_clean":"2024-09-12T01:58:38.616189+0000","last_became_active":"2024-09-12T01:58:31.085601+0000","last_became_peered":"2024-09-12T01:58:31.085601+0000","last_unstale":"2024-09-12T01:58:38.616189+0000","last_undegraded":"2024-09-12T01:58:38.616189+0000","last_fullsized":"2024-09-12T01:58:38.616189+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:20.505778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.121093+0000","last_change":"2024-09-12T01:58:32.089389+0000","last_active":"2024-09-12T01:58:38.121093+0000","last_peered":"2024-09-12T01:58:38.121093+0000","last_clean":"2024-09-12T01:58:38.121093+0000","last_became_active":"2024-09-12T01:58:32.088821+0000","last_became_peered":"2024-09-12T01:58:32.088821+0000","last_unstale":"2024-09-12T01:58:38.121093+0000","last_undegraded":"2024-09-12T01:58:38.121093+0000","last_fullsized":"2024-09-12T01:58:38.121093+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:23.327759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T01:58:38.122341+0000","last_change":"2024-09-12T01:58:38.122341+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:38.122341+0000","last_undegraded":"2024-09-12T01:58:38.122341+0000","last_fullsized":"2024-09-12T01:58:38.122341+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071827+0000","last_change":"2024-09-12T01:58:32.083451+0000","last_active":"2024-09-12T01:58:33.071827+0000","last_peered":"2024-09-12T01:58:33.071827+0000","last_clean":"2024-09-12T01:58:33.071827+0000","last_became_active":"2024-09-12T01:58:32.083176+0000","last_became_peered":"2024-09-12T01:58:32.083176+0000","last_unstale":"2024-09-12T01:58:33.071827+0000","last_undegraded":"2024-09-12T01:58:33.071827+0000","last_fullsized":"2024-09-12T01:58:33.071827+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:56.968157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"65'1","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127666+0000","last_change":"2024-09-12T01:58:31.087815+0000","last_active":"2024-09-12T01:58:38.127666+0000","last_peered":"2024-09-12T01:58:38.127666+0000","last_clean":"2024-09-12T01:58:38.127666+0000","last_became_active":"2024-09-12T01:58:31.087594+0000","last_became_peered":"2024-09-12T01:58:31.087594+0000","last_unstale":"2024-09-12T01:58:38.127666+0000","last_undegraded":"2024-09-12T01:58:38.127666+0000","last_fullsized":"2024-09-12T01:58:38.127666+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.106930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.120745+0000","last_change":"2024-09-12T01:58:32.089687+0000","last_active":"2024-09-12T01:58:38.120745+0000","last_peered":"2024-09-12T01:58:38.120745+0000","last_clean":"2024-09-12T01:58:38.120745+0000","last_became_active":"2024-09-12T01:58:32.088371+0000","last_became_peered":"2024-09-12T01:58:32.088371+0000","last_unstale":"2024-09-12T01:58:38.120745+0000","last_undegraded":"2024-09-12T01:58:38.120745+0000","last_fullsized":"2024-09-12T01:58:38.120745+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:56.306443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915671+0000","last_change":"2024-09-12T01:58:31.074406+0000","last_active":"2024-09-12T01:58:33.915671+0000","last_peered":"2024-09-12T01:58:33.915671+0000","last_clean":"2024-09-12T01:58:33.915671+0000","last_became_active":"2024-09-12T01:58:31.074068+0000","last_became_peered":"2024-09-12T01:58:31.074068+0000","last_unstale":"2024-09-12T01:58:33.915671+0000","last_undegraded":"2024-09-12T01:58:33.915671+0000","last_fullsized":"2024-09-12T01:58:33.915671+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:26.113685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071998+0000","last_change":"2024-09-12T01:58:32.078981+0000","last_active":"2024-09-12T01:58:33.071998+0000","last_peered":"2024-09-12T01:58:33.071998+0000","last_clean":"2024-09-12T01:58:33.071998+0000","last_became_active":"2024-09-12T01:58:32.078680+0000","last_became_peered":"2024-09-12T01:58:32.078680+0000","last_unstale":"2024-09-12T01:58:33.071998+0000","last_undegraded":"2024-09-12T01:58:33.071998+0000","last_fullsized":"2024-09-12T01:58:33.071998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:11.561895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072046+0000","last_change":"2024-09-12T01:58:31.084085+0000","last_active":"2024-09-12T01:58:33.072046+0000","last_peered":"2024-09-12T01:58:33.072046+0000","last_clean":"2024-09-12T01:58:33.072046+0000","last_became_active":"2024-09-12T01:58:31.083740+0000","last_became_peered":"2024-09-12T01:58:31.083740+0000","last_unstale":"2024-09-12T01:58:33.072046+0000","last_undegraded":"2024-09-12T01:58:33.072046+0000","last_fullsized":"2024-09-12T01:58:33.072046+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:23.301991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615869+0000","last_change":"2024-09-12T01:58:32.092045+0000","last_active":"2024-09-12T01:58:38.615869+0000","last_peered":"2024-09-12T01:58:38.615869+0000","last_clean":"2024-09-12T01:58:38.615869+0000","last_became_active":"2024-09-12T01:58:32.091550+0000","last_became_peered":"2024-09-12T01:58:32.091550+0000","last_unstale":"2024-09-12T01:58:38.615869+0000","last_undegraded":"2024-09-12T01:58:38.615869+0000","last_fullsized":"2024-09-12T01:58:38.615869+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:41.371386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616035+0000","last_change":"2024-09-12T01:58:31.083500+0000","last_active":"2024-09-12T01:58:38.616035+0000","last_peered":"2024-09-12T01:58:38.616035+0000","last_clean":"2024-09-12T01:58:38.616035+0000","last_became_active":"2024-09-12T01:58:31.083304+0000","last_became_peered":"2024-09-12T01:58:31.083304+0000","last_unstale":"2024-09-12T01:58:38.616035+0000","last_undegraded":"2024-09-12T01:58:38.616035+0000","last_fullsized":"2024-09-12T01:58:38.616035+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:41.804439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.121127+0000","last_change":"2024-09-12T01:58:32.092142+0000","last_active":"2024-09-12T01:58:38.121127+0000","last_peered":"2024-09-12T01:58:38.121127+0000","last_clean":"2024-09-12T01:58:38.121127+0000","last_became_active":"2024-09-12T01:58:32.091877+0000","last_became_peered":"2024-09-12T01:58:32.091877+0000","last_unstale":"2024-09-12T01:58:38.121127+0000","last_undegraded":"2024-09-12T01:58:38.121127+0000","last_fullsized":"2024-09-12T01:58:38.121127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:47.089578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071936+0000","last_change":"2024-09-12T01:58:31.079762+0000","last_active":"2024-09-12T01:58:33.071936+0000","last_peered":"2024-09-12T01:58:33.071936+0000","last_clean":"2024-09-12T01:58:33.071936+0000","last_became_active":"2024-09-12T01:58:31.079490+0000","last_became_peered":"2024-09-12T01:58:31.079490+0000","last_unstale":"2024-09-12T01:58:33.071936+0000","last_undegraded":"2024-09-12T01:58:33.071936+0000","last_fullsized":"2024-09-12T01:58:33.071936+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:40.366109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072065+0000","last_change":"2024-09-12T01:58:32.088285+0000","last_active":"2024-09-12T01:58:33.072065+0000","last_peered":"2024-09-12T01:58:33.072065+0000","last_clean":"2024-09-12T01:58:33.072065+0000","last_became_active":"2024-09-12T01:58:32.087918+0000","last_became_peered":"2024-09-12T01:58:32.087918+0000","last_unstale":"2024-09-12T01:58:33.072065+0000","last_undegraded":"2024-09-12T01:58:33.072065+0000","last_fullsized":"2024-09-12T01:58:33.072065+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:19.787633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"65'2","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616272+0000","last_change":"2024-09-12T01:58:31.085470+0000","last_active":"2024-09-12T01:58:38.616272+0000","last_peered":"2024-09-12T01:58:38.616272+0000","last_clean":"2024-09-12T01:58:38.616272+0000","last_became_active":"2024-09-12T01:58:31.085216+0000","last_became_peered":"2024-09-12T01:58:31.085216+0000","last_unstale":"2024-09-12T01:58:38.616272+0000","last_undegraded":"2024-09-12T01:58:38.616272+0000","last_fullsized":"2024-09-12T01:58:38.616272+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:57.516064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.122643+0000","last_change":"2024-09-12T01:58:32.084136+0000","last_active":"2024-09-12T01:58:38.122643+0000","last_peered":"2024-09-12T01:58:38.122643+0000","last_clean":"2024-09-12T01:58:38.122643+0000","last_became_active":"2024-09-12T01:58:32.083827+0000","last_became_peered":"2024-09-12T01:58:32.083827+0000","last_unstale":"2024-09-12T01:58:38.122643+0000","last_undegraded":"2024-09-12T01:58:38.122643+0000","last_fullsized":"2024-09-12T01:58:38.122643+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:16.128275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"66'1","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616297+0000","last_change":"2024-09-12T01:58:31.082854+0000","last_active":"2024-09-12T01:58:38.616297+0000","last_peered":"2024-09-12T01:58:38.616297+0000","last_clean":"2024-09-12T01:58:38.616297+0000","last_became_active":"2024-09-12T01:58:31.082576+0000","last_became_peered":"2024-09-12T01:58:31.082576+0000","last_unstale":"2024-09-12T01:58:38.616297+0000","last_undegraded":"2024-09-12T01:58:38.616297+0000","last_fullsized":"2024-09-12T01:58:38.616297+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:55.301165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616216+0000","last_change":"2024-09-12T01:58:32.094795+0000","last_active":"2024-09-12T01:58:38.616216+0000","last_peered":"2024-09-12T01:58:38.616216+0000","last_clean":"2024-09-12T01:58:38.616216+0000","last_became_active":"2024-09-12T01:58:32.093598+0000","last_became_peered":"2024-09-12T01:58:32.093598+0000","last_unstale":"2024-09-12T01:58:38.616216+0000","last_undegraded":"2024-09-12T01:58:38.616216+0000","last_fullsized":"2024-09-12T01:58:38.616216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.413296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072377+0000","last_change":"2024-09-12T01:58:31.086458+0000","last_active":"2024-09-12T01:58:33.072377+0000","last_peered":"2024-09-12T01:58:33.072377+0000","last_clean":"2024-09-12T01:58:33.072377+0000","last_became_active":"2024-09-12T01:58:31.086155+0000","last_became_peered":"2024-09-12T01:58:31.086155+0000","last_unstale":"2024-09-12T01:58:33.072377+0000","last_undegraded":"2024-09-12T01:58:33.072377+0000","last_fullsized":"2024-09-12T01:58:33.072377+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:58.472371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.120841+0000","last_change":"2024-09-12T01:58:32.083243+0000","last_active":"2024-09-12T01:58:38.120841+0000","last_peered":"2024-09-12T01:58:38.120841+0000","last_clean":"2024-09-12T01:58:38.120841+0000","last_became_active":"2024-09-12T01:58:32.082988+0000","last_became_peered":"2024-09-12T01:58:32.082988+0000","last_unstale":"2024-09-12T01:58:38.120841+0000","last_undegraded":"2024-09-12T01:58:38.120841+0000","last_fullsized":"2024-09-12T01:58:38.120841+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:21.511055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666966+0000","last_change":"2024-09-12T01:58:31.077535+0000","last_active":"2024-09-12T01:58:33.666966+0000","last_peered":"2024-09-12T01:58:33.666966+0000","last_clean":"2024-09-12T01:58:33.666966+0000","last_became_active":"2024-09-12T01:58:31.077058+0000","last_became_peered":"2024-09-12T01:58:31.077058+0000","last_unstale":"2024-09-12T01:58:33.666966+0000","last_undegraded":"2024-09-12T01:58:33.666966+0000","last_fullsized":"2024-09-12T01:58:33.666966+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:10.416486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.119688+0000","last_change":"2024-09-12T01:58:32.099028+0000","last_active":"2024-09-12T01:58:38.119688+0000","last_peered":"2024-09-12T01:58:38.119688+0000","last_clean":"2024-09-12T01:58:38.119688+0000","last_became_active":"2024-09-12T01:58:32.098748+0000","last_became_peered":"2024-09-12T01:58:32.098748+0000","last_unstale":"2024-09-12T01:58:38.119688+0000","last_undegraded":"2024-09-12T01:58:38.119688+0000","last_fullsized":"2024-09-12T01:58:38.119688+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:42.809716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127507+0000","last_change":"2024-09-12T01:58:31.090527+0000","last_active":"2024-09-12T01:58:38.127507+0000","last_peered":"2024-09-12T01:58:38.127507+0000","last_clean":"2024-09-12T01:58:38.127507+0000","last_became_active":"2024-09-12T01:58:31.090284+0000","last_became_peered":"2024-09-12T01:58:31.090284+0000","last_unstale":"2024-09-12T01:58:38.127507+0000","last_undegraded":"2024-09-12T01:58:38.127507+0000","last_fullsized":"2024-09-12T01:58:38.127507+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:55.301165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071598+0000","last_change":"2024-09-12T01:58:32.089933+0000","last_active":"2024-09-12T01:58:33.071598+0000","last_peered":"2024-09-12T01:58:33.071598+0000","last_clean":"2024-09-12T01:58:33.071598+0000","last_became_active":"2024-09-12T01:58:32.089694+0000","last_became_peered":"2024-09-12T01:58:32.089694+0000","last_unstale":"2024-09-12T01:58:33.071598+0000","last_undegraded":"2024-09-12T01:58:33.071598+0000","last_fullsized":"2024-09-12T01:58:33.071598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:33.295546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915715+0000","last_change":"2024-09-12T01:58:31.076859+0000","last_active":"2024-09-12T01:58:33.915715+0000","last_peered":"2024-09-12T01:58:33.915715+0000","last_clean":"2024-09-12T01:58:33.915715+0000","last_became_active":"2024-09-12T01:58:31.076488+0000","last_became_peered":"2024-09-12T01:58:31.076488+0000","last_unstale":"2024-09-12T01:58:33.915715+0000","last_undegraded":"2024-09-12T01:58:33.915715+0000","last_fullsized":"2024-09-12T01:58:33.915715+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:47.205697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666577+0000","last_change":"2024-09-12T01:58:32.099717+0000","last_active":"2024-09-12T01:58:33.666577+0000","last_peered":"2024-09-12T01:58:33.666577+0000","last_clean":"2024-09-12T01:58:33.666577+0000","last_became_active":"2024-09-12T01:58:32.099398+0000","last_became_peered":"2024-09-12T01:58:32.099398+0000","last_unstale":"2024-09-12T01:58:33.666577+0000","last_undegraded":"2024-09-12T01:58:33.666577+0000","last_fullsized":"2024-09-12T01:58:33.666577+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:56.968157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915720+0000","last_change":"2024-09-12T01:58:31.078174+0000","last_active":"2024-09-12T01:58:33.915720+0000","last_peered":"2024-09-12T01:58:33.915720+0000","last_clean":"2024-09-12T01:58:33.915720+0000","last_became_active":"2024-09-12T01:58:31.077722+0000","last_became_peered":"2024-09-12T01:58:31.077722+0000","last_unstale":"2024-09-12T01:58:33.915720+0000","last_undegraded":"2024-09-12T01:58:33.915720+0000","last_fullsized":"2024-09-12T01:58:33.915720+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:04.459773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.122515+0000","last_change":"2024-09-12T01:58:32.092706+0000","last_active":"2024-09-12T01:58:38.122515+0000","last_peered":"2024-09-12T01:58:38.122515+0000","last_clean":"2024-09-12T01:58:38.122515+0000","last_became_active":"2024-09-12T01:58:32.092407+0000","last_became_peered":"2024-09-12T01:58:32.092407+0000","last_unstale":"2024-09-12T01:58:38.122515+0000","last_undegraded":"2024-09-12T01:58:38.122515+0000","last_fullsized":"2024-09-12T01:58:38.122515+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:09.461358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666535+0000","last_change":"2024-09-12T01:58:31.083451+0000","last_active":"2024-09-12T01:58:33.666535+0000","last_peered":"2024-09-12T01:58:33.666535+0000","last_clean":"2024-09-12T01:58:33.666535+0000","last_became_active":"2024-09-12T01:58:31.083133+0000","last_became_peered":"2024-09-12T01:58:31.083133+0000","last_unstale":"2024-09-12T01:58:33.666535+0000","last_undegraded":"2024-09-12T01:58:33.666535+0000","last_fullsized":"2024-09-12T01:58:33.666535+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:21.347164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.120569+0000","last_change":"2024-09-12T01:58:32.096326+0000","last_active":"2024-09-12T01:58:38.120569+0000","last_peered":"2024-09-12T01:58:38.120569+0000","last_clean":"2024-09-12T01:58:38.120569+0000","last_became_active":"2024-09-12T01:58:32.096061+0000","last_became_peered":"2024-09-12T01:58:32.096061+0000","last_unstale":"2024-09-12T01:58:38.120569+0000","last_undegraded":"2024-09-12T01:58:38.120569+0000","last_fullsized":"2024-09-12T01:58:38.120569+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:40.545508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915509+0000","last_change":"2024-09-12T01:58:31.084470+0000","last_active":"2024-09-12T01:58:33.915509+0000","last_peered":"2024-09-12T01:58:33.915509+0000","last_clean":"2024-09-12T01:58:33.915509+0000","last_became_active":"2024-09-12T01:58:31.084172+0000","last_became_peered":"2024-09-12T01:58:31.084172+0000","last_unstale":"2024-09-12T01:58:33.915509+0000","last_undegraded":"2024-09-12T01:58:33.915509+0000","last_fullsized":"2024-09-12T01:58:33.915509+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:29.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":253,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127848+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:58:38.127848+0000","last_peered":"2024-09-12T01:58:38.127848+0000","last_clean":"2024-09-12T01:58:38.127848+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:58:38.127848+0000","last_undegraded":"2024-09-12T01:58:38.127848+0000","last_fullsized":"2024-09-12T01:58:38.127848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28408,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343432,"statfs":{"total":96636764160,"available":96607674368,"internally_reserved":0,"allocated":1413120,"data_stored":957095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509478,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":365985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":365973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":359418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":790528,"data_stored":359418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":361794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1384448,"data_stored":949786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":802816,"data_stored":361030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:58:39.815 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:58:39.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.953+0000 7fb6cb3b7640 1 Processor -- start 2024-09-12T01:58:39.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.954+0000 7fb6cb3b7640 1 -- start start 2024-09-12T01:58:39.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.954+0000 7fb6cb3b7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb6c40d04a0 0x7fb6c40d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.954+0000 7fb6cb3b7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6c40ae550 0x7fb6c40ae980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.954+0000 7fb6cb3b7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6c406cb30 con 0x7fb6c4147360 2024-09-12T01:58:39.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.954+0000 7fb6cb3b7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb6c40d0e50 con 0x7fb6c40d04a0 2024-09-12T01:58:39.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.954+0000 7fb6cb3b7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c406bfb0 con 0x7fb6c40ae550 2024-09-12T01:58:39.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6c9153640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb6c4147360 0x7fb6c4070890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38384/0 (socket says 172.21.15.19:38384) 2024-09-12T01:58:39.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6c9153640 1 -- 172.21.15.19:0/3258273745 learned_addr learned my addr 172.21.15.19:0/3258273745 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:39.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6c8952640 1 --2- 172.21.15.19:0/3258273745 >> v2:172.21.15.135:3300/0 conn(0x7fb6c40d04a0 0x7fb6c40d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6bbfff640 1 -- 172.21.15.19:0/3258273745 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4013734350 0 0) 0x7fb6c406cb30 con 0x7fb6c4147360 2024-09-12T01:58:39.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6c9954640 1 --2- 172.21.15.19:0/3258273745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6c40ae550 0x7fb6c40ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6bbfff640 1 -- 172.21.15.19:0/3258273745 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6b0003520 con 0x7fb6c4147360 2024-09-12T01:58:39.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6bbfff640 1 -- 172.21.15.19:0/3258273745 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1253547526 0 0) 0x7fb6b0003520 con 0x7fb6c4147360 2024-09-12T01:58:39.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6bbfff640 1 -- 172.21.15.19:0/3258273745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6c40ae550 msgr2=0x7fb6c40ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:39.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6bbfff640 1 --2- 172.21.15.19:0/3258273745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6c40ae550 0x7fb6c40ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6bbfff640 1 -- 172.21.15.19:0/3258273745 >> v2:172.21.15.135:3300/0 conn(0x7fb6c40d04a0 msgr2=0x7fb6c40d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:39.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6bbfff640 1 --2- 172.21.15.19:0/3258273745 >> v2:172.21.15.135:3300/0 conn(0x7fb6c40d04a0 0x7fb6c40d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6bbfff640 1 -- 172.21.15.19:0/3258273745 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c406c290 con 0x7fb6c4147360 2024-09-12T01:58:39.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6bbfff640 1 -- 172.21.15.19:0/3258273745 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fb6c0001670 con 0x7fb6c4147360 2024-09-12T01:58:39.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6bbfff640 1 -- 172.21.15.19:0/3258273745 >> v1:172.21.15.19:6789/0 conn(0x7fb6c4147360 legacy=0x7fb6c4070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6bbfff640 1 --2- 172.21.15.19:0/3258273745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b00039b0 0x7fb6b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6bbfff640 1 --2- 172.21.15.19:0/3258273745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6b0004800 0x7fb6b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6bbfff640 1 --2- 172.21.15.19:0/3258273745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6c40ae550 0x7fb6b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6bbfff640 1 -- 172.21.15.19:0/3258273745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c40d0e50 con 0x7fb6b0004800 2024-09-12T01:58:39.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6bbfff640 1 -- 172.21.15.19:0/3258273745 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c406bfb0 con 0x7fb6b00039b0 2024-09-12T01:58:39.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6bbfff640 1 -- 172.21.15.19:0/3258273745 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b000bb50 con 0x7fb6c40ae550 2024-09-12T01:58:39.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6c8952640 1 --2- 172.21.15.19:0/3258273745 >> v2:172.21.15.135:3300/0 conn(0x7fb6c40d04a0 0x7fb6c40d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:39.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6c9153640 1 --2- 172.21.15.19:0/3258273745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b00039b0 0x7fb6b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.955+0000 7fb6c8952640 1 --2- 172.21.15.19:0/3258273745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6b0004800 0x7fb6b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.956+0000 7fb6c9954640 1 --2- 172.21.15.19:0/3258273745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6c40ae550 0x7fb6b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.956+0000 7fb6c8952640 1 -- 172.21.15.19:0/3258273745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6c40ae550 msgr2=0x7fb6b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:39.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.956+0000 7fb6c8952640 1 --2- 172.21.15.19:0/3258273745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6c40ae550 0x7fb6b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.956+0000 7fb6c8952640 1 -- 172.21.15.19:0/3258273745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b00039b0 msgr2=0x7fb6b0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:39.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.956+0000 7fb6c8952640 1 --2- 172.21.15.19:0/3258273745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b00039b0 0x7fb6b0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.956+0000 7fb6c8952640 1 -- 172.21.15.19:0/3258273745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b0003520 con 0x7fb6b0004800 2024-09-12T01:58:39.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.956+0000 7fb6c8952640 1 --2- 172.21.15.19:0/3258273745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6b0004800 0x7fb6b0004c80 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4006fd0 tx=0x7fb6b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae30839d2d72088 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:39.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.957+0000 7fb6bbfff640 1 -- 172.21.15.19:0/3258273745 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4037070 con 0x7fb6b0004800 2024-09-12T01:58:39.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.957+0000 7fb6bbfff640 1 -- 172.21.15.19:0/3258273745 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b402ace0 con 0x7fb6b0004800 2024-09-12T01:58:39.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.957+0000 7fb6bbfff640 1 -- 172.21.15.19:0/3258273745 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b400f040 con 0x7fb6b0004800 2024-09-12T01:58:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.957+0000 7fb6cb3b7640 1 -- 172.21.15.19:0/3258273745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6b0004800 msgr2=0x7fb6b0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.957+0000 7fb6cb3b7640 1 --2- 172.21.15.19:0/3258273745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6b0004800 0x7fb6b0004c80 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4006fd0 tx=0x7fb6b0005830 comp rx=0 tx=0).stop 2024-09-12T01:58:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.957+0000 7fb6c9954640 1 -- 172.21.15.19:0/3258273745 reap_dead start 2024-09-12T01:58:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.957+0000 7fb6cb3b7640 1 -- 172.21.15.19:0/3258273745 shutdown_connections 2024-09-12T01:58:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.957+0000 7fb6cb3b7640 1 -- 172.21.15.19:0/3258273745 >> 172.21.15.19:0/3258273745 conn(0x7fb6c40b2f40 msgr2=0x7fb6c40b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.957+0000 7fb6cb3b7640 1 -- 172.21.15.19:0/3258273745 shutdown_connections 2024-09-12T01:58:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.957+0000 7fb6cb3b7640 1 -- 172.21.15.19:0/3258273745 wait complete. 2024-09-12T01:58:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.959+0000 7fb6cb3b7640 1 Processor -- start 2024-09-12T01:58:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.959+0000 7fb6cb3b7640 1 -- start start 2024-09-12T01:58:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.959+0000 7fb6cb3b7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b0004800 0x7fb6c41618b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.959+0000 7fb6cb3b7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6c40cdbf0 0x7fb6c40cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.959+0000 7fb6cb3b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6c40700b0 0x7fb6c4070530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.959+0000 7fb6cb3b7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4070fa0 con 0x7fb6c40700b0 2024-09-12T01:58:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.959+0000 7fb6cb3b7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c406c850 con 0x7fb6b0004800 2024-09-12T01:58:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.959+0000 7fb6cb3b7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c406bc10 con 0x7fb6c40cdbf0 2024-09-12T01:58:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.959+0000 7fb6c9954640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6c40700b0 0x7fb6c4070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.960+0000 7fb6c9954640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6c40700b0 0x7fb6c4070530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36008/0 (socket says 172.21.15.19:36008) 2024-09-12T01:58:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.960+0000 7fb6c9954640 1 -- 172.21.15.19:0/3845538149 learned_addr learned my addr 172.21.15.19:0/3845538149 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.960+0000 7fb6c8952640 1 --2- 172.21.15.19:0/3845538149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6c40cdbf0 0x7fb6c40cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.960+0000 7fb6c9153640 1 --2- 172.21.15.19:0/3845538149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b0004800 0x7fb6c41618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.960+0000 7fb6c9954640 1 -- 172.21.15.19:0/3845538149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6c40cdbf0 msgr2=0x7fb6c40cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.960+0000 7fb6c9954640 1 --2- 172.21.15.19:0/3845538149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6c40cdbf0 0x7fb6c40cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.960+0000 7fb6c9954640 1 -- 172.21.15.19:0/3845538149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b0004800 msgr2=0x7fb6c41618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.960+0000 7fb6c9954640 1 --2- 172.21.15.19:0/3845538149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b0004800 0x7fb6c41618b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.960+0000 7fb6c9954640 1 -- 172.21.15.19:0/3845538149 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c40ce160 con 0x7fb6c40700b0 2024-09-12T01:58:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.960+0000 7fb6c9954640 1 --2- 172.21.15.19:0/3845538149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6c40700b0 0x7fb6c4070530 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4072f50 tx=0x7fb6bc003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.960+0000 7fb6b9ffb640 1 -- 172.21.15.19:0/3845538149 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc007b70 con 0x7fb6c40700b0 2024-09-12T01:58:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.960+0000 7fb6b9ffb640 1 -- 172.21.15.19:0/3845538149 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6bc01a070 con 0x7fb6c40700b0 2024-09-12T01:58:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.960+0000 7fb6cb3b7640 1 -- 172.21.15.19:0/3845538149 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c40ce440 con 0x7fb6c40700b0 2024-09-12T01:58:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.960+0000 7fb6b9ffb640 1 -- 172.21.15.19:0/3845538149 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc015420 con 0x7fb6c40700b0 2024-09-12T01:58:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.960+0000 7fb6cb3b7640 1 -- 172.21.15.19:0/3845538149 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c409d8c0 con 0x7fb6c40700b0 2024-09-12T01:58:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.962+0000 7fb6cb3b7640 1 -- 172.21.15.19:0/3845538149 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c4070a70 con 0x7fb6c40700b0 2024-09-12T01:58:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.962+0000 7fb6b9ffb640 1 -- 172.21.15.19:0/3845538149 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb6bc0155c0 con 0x7fb6c40700b0 2024-09-12T01:58:39.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.962+0000 7fb6b9ffb640 1 --2- 172.21.15.19:0/3845538149 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb6a806be60 0x7fb6a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.962+0000 7fb6b9ffb640 1 -- 172.21.15.19:0/3845538149 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6217+0+0 (secure 0 0 0) 0x7fb6bc08b410 con 0x7fb6c40700b0 2024-09-12T01:58:39.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.963+0000 7fb6c9153640 1 --2- 172.21.15.19:0/3845538149 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb6a806be60 0x7fb6a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.963+0000 7fb6c9153640 1 --2- 172.21.15.19:0/3845538149 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb6a806be60 0x7fb6a806e320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0007fd0 tx=0x7fb6c0007c20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:39.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:39.967+0000 7fb6b9ffb640 1 -- 172.21.15.19:0/3845538149 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb6bc059bb0 con 0x7fb6c40700b0 2024-09-12T01:58:40.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.142+0000 7fb6cb3b7640 1 -- 172.21.15.19:0/3845538149 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6c40d0910 con 0x7fb6a806be60 2024-09-12T01:58:40.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.148+0000 7fb6b9ffb640 1 -- 172.21.15.19:0/3845538149 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251758 (secure 0 0 0) 0x7fb6c40d0910 con 0x7fb6a806be60 2024-09-12T01:58:40.151 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:40.152 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:58:40.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.151+0000 7fb6cb3b7640 1 -- 172.21.15.19:0/3845538149 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb6a806be60 msgr2=0x7fb6a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:40.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.151+0000 7fb6cb3b7640 1 --2- 172.21.15.19:0/3845538149 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb6a806be60 0x7fb6a806e320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0007fd0 tx=0x7fb6c0007c20 comp rx=0 tx=0).stop 2024-09-12T01:58:40.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.151+0000 7fb6cb3b7640 1 -- 172.21.15.19:0/3845538149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6c40700b0 msgr2=0x7fb6c4070530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:40.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.151+0000 7fb6cb3b7640 1 --2- 172.21.15.19:0/3845538149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6c40700b0 0x7fb6c4070530 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4072f50 tx=0x7fb6bc003eb0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.151+0000 7fb6cb3b7640 1 -- 172.21.15.19:0/3845538149 shutdown_connections 2024-09-12T01:58:40.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.151+0000 7fb6cb3b7640 1 --2- 172.21.15.19:0/3845538149 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb6a806be60 0x7fb6a806e320 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.151+0000 7fb6cb3b7640 1 --2- 172.21.15.19:0/3845538149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6c40700b0 0x7fb6c4070530 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.151+0000 7fb6cb3b7640 1 --2- 172.21.15.19:0/3845538149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6c40cdbf0 0x7fb6c40cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.151+0000 7fb6cb3b7640 1 --2- 172.21.15.19:0/3845538149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b0004800 0x7fb6c41618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.151+0000 7fb6cb3b7640 1 -- 172.21.15.19:0/3845538149 >> 172.21.15.19:0/3845538149 conn(0x7fb6c40b2f40 msgr2=0x7fb6c40d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:40.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.151+0000 7fb6cb3b7640 1 -- 172.21.15.19:0/3845538149 shutdown_connections 2024-09-12T01:58:40.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.151+0000 7fb6cb3b7640 1 -- 172.21.15.19:0/3845538149 wait complete. 2024-09-12T01:58:40.163 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-12T01:58:40.122395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231996,"kb_used_data":7436,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742724,"statfs":{"total":773094113280,"available":772856549376,"internally_reserved":0,"allocated":7614464,"data_stored":4080499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.053543"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666882+0000","last_change":"2024-09-12T01:58:32.098775+0000","last_active":"2024-09-12T01:58:33.666882+0000","last_peered":"2024-09-12T01:58:33.666882+0000","last_clean":"2024-09-12T01:58:33.666882+0000","last_became_active":"2024-09-12T01:58:32.098472+0000","last_became_peered":"2024-09-12T01:58:32.098472+0000","last_unstale":"2024-09-12T01:58:33.666882+0000","last_undegraded":"2024-09-12T01:58:33.666882+0000","last_fullsized":"2024-09-12T01:58:33.666882+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:34.058890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666728+0000","last_change":"2024-09-12T01:58:32.092794+0000","last_active":"2024-09-12T01:58:33.666728+0000","last_peered":"2024-09-12T01:58:33.666728+0000","last_clean":"2024-09-12T01:58:33.666728+0000","last_became_active":"2024-09-12T01:58:32.092525+0000","last_became_peered":"2024-09-12T01:58:32.092525+0000","last_unstale":"2024-09-12T01:58:33.666728+0000","last_undegraded":"2024-09-12T01:58:33.666728+0000","last_fullsized":"2024-09-12T01:58:33.666728+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:05.445047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127514+0000","last_change":"2024-09-12T01:58:32.099017+0000","last_active":"2024-09-12T01:58:38.127514+0000","last_peered":"2024-09-12T01:58:38.127514+0000","last_clean":"2024-09-12T01:58:38.127514+0000","last_became_active":"2024-09-12T01:58:32.095848+0000","last_became_peered":"2024-09-12T01:58:32.095848+0000","last_unstale":"2024-09-12T01:58:38.127514+0000","last_undegraded":"2024-09-12T01:58:38.127514+0000","last_fullsized":"2024-09-12T01:58:38.127514+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:50.997517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071261+0000","last_change":"2024-09-12T01:58:32.086522+0000","last_active":"2024-09-12T01:58:33.071261+0000","last_peered":"2024-09-12T01:58:33.071261+0000","last_clean":"2024-09-12T01:58:33.071261+0000","last_became_active":"2024-09-12T01:58:32.086029+0000","last_became_peered":"2024-09-12T01:58:32.086029+0000","last_unstale":"2024-09-12T01:58:33.071261+0000","last_undegraded":"2024-09-12T01:58:33.071261+0000","last_fullsized":"2024-09-12T01:58:33.071261+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:53.481574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T01:58:34.120954+0000","last_change":"2024-09-12T01:58:38.120334+0000","last_active":"2024-09-12T01:58:38.120334+0000","last_peered":"2024-09-12T01:58:34.120954+0000","last_clean":"2024-09-12T01:58:34.120954+0000","last_became_active":"2024-09-12T01:58:32.083847+0000","last_became_peered":"2024-09-12T01:58:32.083847+0000","last_unstale":"2024-09-12T01:58:34.120954+0000","last_undegraded":"2024-09-12T01:58:34.120954+0000","last_fullsized":"2024-09-12T01:58:34.120954+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072181+0000","last_change":"2024-09-12T01:58:32.090868+0000","last_active":"2024-09-12T01:58:33.072181+0000","last_peered":"2024-09-12T01:58:33.072181+0000","last_clean":"2024-09-12T01:58:33.072181+0000","last_became_active":"2024-09-12T01:58:32.090596+0000","last_became_peered":"2024-09-12T01:58:32.090596+0000","last_unstale":"2024-09-12T01:58:33.072181+0000","last_undegraded":"2024-09-12T01:58:33.072181+0000","last_fullsized":"2024-09-12T01:58:33.072181+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:19.012343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.122213+0000","last_change":"2024-09-12T01:58:32.091013+0000","last_active":"2024-09-12T01:58:38.122213+0000","last_peered":"2024-09-12T01:58:38.122213+0000","last_clean":"2024-09-12T01:58:38.122213+0000","last_became_active":"2024-09-12T01:58:32.090711+0000","last_became_peered":"2024-09-12T01:58:32.090711+0000","last_unstale":"2024-09-12T01:58:38.122213+0000","last_undegraded":"2024-09-12T01:58:38.122213+0000","last_fullsized":"2024-09-12T01:58:38.122213+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:42.450557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615856+0000","last_change":"2024-09-12T01:58:32.100103+0000","last_active":"2024-09-12T01:58:38.615856+0000","last_peered":"2024-09-12T01:58:38.615856+0000","last_clean":"2024-09-12T01:58:38.615856+0000","last_became_active":"2024-09-12T01:58:32.099846+0000","last_became_peered":"2024-09-12T01:58:32.099846+0000","last_unstale":"2024-09-12T01:58:38.615856+0000","last_undegraded":"2024-09-12T01:58:38.615856+0000","last_fullsized":"2024-09-12T01:58:38.615856+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:46.632781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127748+0000","last_change":"2024-09-12T01:58:32.099992+0000","last_active":"2024-09-12T01:58:38.127748+0000","last_peered":"2024-09-12T01:58:38.127748+0000","last_clean":"2024-09-12T01:58:38.127748+0000","last_became_active":"2024-09-12T01:58:32.099721+0000","last_became_peered":"2024-09-12T01:58:32.099721+0000","last_unstale":"2024-09-12T01:58:38.127748+0000","last_undegraded":"2024-09-12T01:58:38.127748+0000","last_fullsized":"2024-09-12T01:58:38.127748+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:38.169564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127632+0000","last_change":"2024-09-12T01:58:32.101085+0000","last_active":"2024-09-12T01:58:38.127632+0000","last_peered":"2024-09-12T01:58:38.127632+0000","last_clean":"2024-09-12T01:58:38.127632+0000","last_became_active":"2024-09-12T01:58:32.100128+0000","last_became_peered":"2024-09-12T01:58:32.100128+0000","last_unstale":"2024-09-12T01:58:38.127632+0000","last_undegraded":"2024-09-12T01:58:38.127632+0000","last_fullsized":"2024-09-12T01:58:38.127632+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:02.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071172+0000","last_change":"2024-09-12T01:58:32.093435+0000","last_active":"2024-09-12T01:58:33.071172+0000","last_peered":"2024-09-12T01:58:33.071172+0000","last_clean":"2024-09-12T01:58:33.071172+0000","last_became_active":"2024-09-12T01:58:32.092950+0000","last_became_peered":"2024-09-12T01:58:32.092950+0000","last_unstale":"2024-09-12T01:58:33.071172+0000","last_undegraded":"2024-09-12T01:58:33.071172+0000","last_fullsized":"2024-09-12T01:58:33.071172+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:25.908231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615981+0000","last_change":"2024-09-12T01:58:32.096884+0000","last_active":"2024-09-12T01:58:38.615981+0000","last_peered":"2024-09-12T01:58:38.615981+0000","last_clean":"2024-09-12T01:58:38.615981+0000","last_became_active":"2024-09-12T01:58:32.096608+0000","last_became_peered":"2024-09-12T01:58:32.096608+0000","last_unstale":"2024-09-12T01:58:38.615981+0000","last_undegraded":"2024-09-12T01:58:38.615981+0000","last_fullsized":"2024-09-12T01:58:38.615981+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:50.997517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615968+0000","last_change":"2024-09-12T01:58:32.091527+0000","last_active":"2024-09-12T01:58:38.615968+0000","last_peered":"2024-09-12T01:58:38.615968+0000","last_clean":"2024-09-12T01:58:38.615968+0000","last_became_active":"2024-09-12T01:58:32.090919+0000","last_became_peered":"2024-09-12T01:58:32.090919+0000","last_unstale":"2024-09-12T01:58:38.615968+0000","last_undegraded":"2024-09-12T01:58:38.615968+0000","last_fullsized":"2024-09-12T01:58:38.615968+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:00.209541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127393+0000","last_change":"2024-09-12T01:58:32.099040+0000","last_active":"2024-09-12T01:58:38.127393+0000","last_peered":"2024-09-12T01:58:38.127393+0000","last_clean":"2024-09-12T01:58:38.127393+0000","last_became_active":"2024-09-12T01:58:32.098246+0000","last_became_peered":"2024-09-12T01:58:32.098246+0000","last_unstale":"2024-09-12T01:58:38.127393+0000","last_undegraded":"2024-09-12T01:58:38.127393+0000","last_fullsized":"2024-09-12T01:58:38.127393+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:27.519989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127321+0000","last_change":"2024-09-12T01:58:32.099874+0000","last_active":"2024-09-12T01:58:38.127321+0000","last_peered":"2024-09-12T01:58:38.127321+0000","last_clean":"2024-09-12T01:58:38.127321+0000","last_became_active":"2024-09-12T01:58:32.099591+0000","last_became_peered":"2024-09-12T01:58:32.099591+0000","last_unstale":"2024-09-12T01:58:38.127321+0000","last_undegraded":"2024-09-12T01:58:38.127321+0000","last_fullsized":"2024-09-12T01:58:38.127321+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:00.209541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.122728+0000","last_change":"2024-09-12T01:58:32.092337+0000","last_active":"2024-09-12T01:58:38.122728+0000","last_peered":"2024-09-12T01:58:38.122728+0000","last_clean":"2024-09-12T01:58:38.122728+0000","last_became_active":"2024-09-12T01:58:32.091794+0000","last_became_peered":"2024-09-12T01:58:32.091794+0000","last_unstale":"2024-09-12T01:58:38.122728+0000","last_undegraded":"2024-09-12T01:58:38.122728+0000","last_fullsized":"2024-09-12T01:58:38.122728+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:32.941238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666916+0000","last_change":"2024-09-12T01:58:32.099798+0000","last_active":"2024-09-12T01:58:33.666916+0000","last_peered":"2024-09-12T01:58:33.666916+0000","last_clean":"2024-09-12T01:58:33.666916+0000","last_became_active":"2024-09-12T01:58:32.099440+0000","last_became_peered":"2024-09-12T01:58:32.099440+0000","last_unstale":"2024-09-12T01:58:33.666916+0000","last_undegraded":"2024-09-12T01:58:33.666916+0000","last_fullsized":"2024-09-12T01:58:33.666916+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:53.552573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071740+0000","last_change":"2024-09-12T01:58:32.086299+0000","last_active":"2024-09-12T01:58:33.071740+0000","last_peered":"2024-09-12T01:58:33.071740+0000","last_clean":"2024-09-12T01:58:33.071740+0000","last_became_active":"2024-09-12T01:58:32.085968+0000","last_became_peered":"2024-09-12T01:58:32.085968+0000","last_unstale":"2024-09-12T01:58:33.071740+0000","last_undegraded":"2024-09-12T01:58:33.071740+0000","last_fullsized":"2024-09-12T01:58:33.071740+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:55.745348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.121003+0000","last_change":"2024-09-12T01:58:32.089146+0000","last_active":"2024-09-12T01:58:38.121003+0000","last_peered":"2024-09-12T01:58:38.121003+0000","last_clean":"2024-09-12T01:58:38.121003+0000","last_became_active":"2024-09-12T01:58:32.088503+0000","last_became_peered":"2024-09-12T01:58:32.088503+0000","last_unstale":"2024-09-12T01:58:38.121003+0000","last_undegraded":"2024-09-12T01:58:38.121003+0000","last_fullsized":"2024-09-12T01:58:38.121003+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:06.577465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915709+0000","last_change":"2024-09-12T01:58:32.089658+0000","last_active":"2024-09-12T01:58:33.915709+0000","last_peered":"2024-09-12T01:58:33.915709+0000","last_clean":"2024-09-12T01:58:33.915709+0000","last_became_active":"2024-09-12T01:58:32.089374+0000","last_became_peered":"2024-09-12T01:58:32.089374+0000","last_unstale":"2024-09-12T01:58:33.915709+0000","last_undegraded":"2024-09-12T01:58:33.915709+0000","last_fullsized":"2024-09-12T01:58:33.915709+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:31.386141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616083+0000","last_change":"2024-09-12T01:58:32.097896+0000","last_active":"2024-09-12T01:58:38.616083+0000","last_peered":"2024-09-12T01:58:38.616083+0000","last_clean":"2024-09-12T01:58:38.616083+0000","last_became_active":"2024-09-12T01:58:32.097631+0000","last_became_peered":"2024-09-12T01:58:32.097631+0000","last_unstale":"2024-09-12T01:58:38.616083+0000","last_undegraded":"2024-09-12T01:58:38.616083+0000","last_fullsized":"2024-09-12T01:58:38.616083+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:38.169564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915664+0000","last_change":"2024-09-12T01:58:32.091442+0000","last_active":"2024-09-12T01:58:33.915664+0000","last_peered":"2024-09-12T01:58:33.915664+0000","last_clean":"2024-09-12T01:58:33.915664+0000","last_became_active":"2024-09-12T01:58:32.091113+0000","last_became_peered":"2024-09-12T01:58:32.091113+0000","last_unstale":"2024-09-12T01:58:33.915664+0000","last_undegraded":"2024-09-12T01:58:33.915664+0000","last_fullsized":"2024-09-12T01:58:33.915664+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:42.748051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915663+0000","last_change":"2024-09-12T01:58:32.090771+0000","last_active":"2024-09-12T01:58:33.915663+0000","last_peered":"2024-09-12T01:58:33.915663+0000","last_clean":"2024-09-12T01:58:33.915663+0000","last_became_active":"2024-09-12T01:58:32.090506+0000","last_became_peered":"2024-09-12T01:58:32.090506+0000","last_unstale":"2024-09-12T01:58:33.915663+0000","last_undegraded":"2024-09-12T01:58:33.915663+0000","last_fullsized":"2024-09-12T01:58:33.915663+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:57.559803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127749+0000","last_change":"2024-09-12T01:58:32.095936+0000","last_active":"2024-09-12T01:58:38.127749+0000","last_peered":"2024-09-12T01:58:38.127749+0000","last_clean":"2024-09-12T01:58:38.127749+0000","last_became_active":"2024-09-12T01:58:32.095625+0000","last_became_peered":"2024-09-12T01:58:32.095625+0000","last_unstale":"2024-09-12T01:58:38.127749+0000","last_undegraded":"2024-09-12T01:58:38.127749+0000","last_fullsized":"2024-09-12T01:58:38.127749+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:59.477648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616166+0000","last_change":"2024-09-12T01:58:32.094671+0000","last_active":"2024-09-12T01:58:38.616166+0000","last_peered":"2024-09-12T01:58:38.616166+0000","last_clean":"2024-09-12T01:58:38.616166+0000","last_became_active":"2024-09-12T01:58:32.093934+0000","last_became_peered":"2024-09-12T01:58:32.093934+0000","last_unstale":"2024-09-12T01:58:38.616166+0000","last_undegraded":"2024-09-12T01:58:38.616166+0000","last_fullsized":"2024-09-12T01:58:38.616166+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:15.459156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616162+0000","last_change":"2024-09-12T01:58:32.094546+0000","last_active":"2024-09-12T01:58:38.616162+0000","last_peered":"2024-09-12T01:58:38.616162+0000","last_clean":"2024-09-12T01:58:38.616162+0000","last_became_active":"2024-09-12T01:58:32.094242+0000","last_became_peered":"2024-09-12T01:58:32.094242+0000","last_unstale":"2024-09-12T01:58:38.616162+0000","last_undegraded":"2024-09-12T01:58:38.616162+0000","last_fullsized":"2024-09-12T01:58:38.616162+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:24.307268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071322+0000","last_change":"2024-09-12T01:58:32.088553+0000","last_active":"2024-09-12T01:58:33.071322+0000","last_peered":"2024-09-12T01:58:33.071322+0000","last_clean":"2024-09-12T01:58:33.071322+0000","last_became_active":"2024-09-12T01:58:32.087827+0000","last_became_peered":"2024-09-12T01:58:32.087827+0000","last_unstale":"2024-09-12T01:58:33.071322+0000","last_undegraded":"2024-09-12T01:58:33.071322+0000","last_fullsized":"2024-09-12T01:58:33.071322+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:12.553586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666813+0000","last_change":"2024-09-12T01:58:32.095548+0000","last_active":"2024-09-12T01:58:33.666813+0000","last_peered":"2024-09-12T01:58:33.666813+0000","last_clean":"2024-09-12T01:58:33.666813+0000","last_became_active":"2024-09-12T01:58:32.094714+0000","last_became_peered":"2024-09-12T01:58:32.094714+0000","last_unstale":"2024-09-12T01:58:33.666813+0000","last_undegraded":"2024-09-12T01:58:33.666813+0000","last_fullsized":"2024-09-12T01:58:33.666813+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:52.686475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127402+0000","last_change":"2024-09-12T01:58:32.089782+0000","last_active":"2024-09-12T01:58:38.127402+0000","last_peered":"2024-09-12T01:58:38.127402+0000","last_clean":"2024-09-12T01:58:38.127402+0000","last_became_active":"2024-09-12T01:58:32.089548+0000","last_became_peered":"2024-09-12T01:58:32.089548+0000","last_unstale":"2024-09-12T01:58:38.127402+0000","last_undegraded":"2024-09-12T01:58:38.127402+0000","last_fullsized":"2024-09-12T01:58:38.127402+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.413296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615869+0000","last_change":"2024-09-12T01:58:32.099407+0000","last_active":"2024-09-12T01:58:38.615869+0000","last_peered":"2024-09-12T01:58:38.615869+0000","last_clean":"2024-09-12T01:58:38.615869+0000","last_became_active":"2024-09-12T01:58:32.099119+0000","last_became_peered":"2024-09-12T01:58:32.099119+0000","last_unstale":"2024-09-12T01:58:38.615869+0000","last_undegraded":"2024-09-12T01:58:38.615869+0000","last_fullsized":"2024-09-12T01:58:38.615869+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:45.710198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071526+0000","last_change":"2024-09-12T01:58:32.088560+0000","last_active":"2024-09-12T01:58:33.071526+0000","last_peered":"2024-09-12T01:58:33.071526+0000","last_clean":"2024-09-12T01:58:33.071526+0000","last_became_active":"2024-09-12T01:58:32.088317+0000","last_became_peered":"2024-09-12T01:58:32.088317+0000","last_unstale":"2024-09-12T01:58:33.071526+0000","last_undegraded":"2024-09-12T01:58:33.071526+0000","last_fullsized":"2024-09-12T01:58:33.071526+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:06.911951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071936+0000","last_change":"2024-09-12T01:58:32.085708+0000","last_active":"2024-09-12T01:58:33.071936+0000","last_peered":"2024-09-12T01:58:33.071936+0000","last_clean":"2024-09-12T01:58:33.071936+0000","last_became_active":"2024-09-12T01:58:32.085394+0000","last_became_peered":"2024-09-12T01:58:32.085394+0000","last_unstale":"2024-09-12T01:58:33.071936+0000","last_undegraded":"2024-09-12T01:58:33.071936+0000","last_fullsized":"2024-09-12T01:58:33.071936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:02.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.120111+0000","last_change":"2024-09-12T01:58:32.096958+0000","last_active":"2024-09-12T01:58:38.120111+0000","last_peered":"2024-09-12T01:58:38.120111+0000","last_clean":"2024-09-12T01:58:38.120111+0000","last_became_active":"2024-09-12T01:58:32.096288+0000","last_became_peered":"2024-09-12T01:58:32.096288+0000","last_unstale":"2024-09-12T01:58:38.120111+0000","last_undegraded":"2024-09-12T01:58:38.120111+0000","last_fullsized":"2024-09-12T01:58:38.120111+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:51.645585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"65'4","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666944+0000","last_change":"2024-09-12T01:58:31.085572+0000","last_active":"2024-09-12T01:58:33.666944+0000","last_peered":"2024-09-12T01:58:33.666944+0000","last_clean":"2024-09-12T01:58:33.666944+0000","last_became_active":"2024-09-12T01:58:31.085308+0000","last_became_peered":"2024-09-12T01:58:31.085308+0000","last_unstale":"2024-09-12T01:58:33.666944+0000","last_undegraded":"2024-09-12T01:58:33.666944+0000","last_fullsized":"2024-09-12T01:58:33.666944+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:47.308955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071403+0000","last_change":"2024-09-12T01:58:32.093055+0000","last_active":"2024-09-12T01:58:33.071403+0000","last_peered":"2024-09-12T01:58:33.071403+0000","last_clean":"2024-09-12T01:58:33.071403+0000","last_became_active":"2024-09-12T01:58:32.092801+0000","last_became_peered":"2024-09-12T01:58:32.092801+0000","last_unstale":"2024-09-12T01:58:33.071403+0000","last_undegraded":"2024-09-12T01:58:33.071403+0000","last_fullsized":"2024-09-12T01:58:33.071403+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:27.155936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072473+0000","last_change":"2024-09-12T01:58:31.082993+0000","last_active":"2024-09-12T01:58:33.072473+0000","last_peered":"2024-09-12T01:58:33.072473+0000","last_clean":"2024-09-12T01:58:33.072473+0000","last_became_active":"2024-09-12T01:58:31.082679+0000","last_became_peered":"2024-09-12T01:58:31.082679+0000","last_unstale":"2024-09-12T01:58:33.072473+0000","last_undegraded":"2024-09-12T01:58:33.072473+0000","last_fullsized":"2024-09-12T01:58:33.072473+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:16.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072371+0000","last_change":"2024-09-12T01:58:32.078918+0000","last_active":"2024-09-12T01:58:33.072371+0000","last_peered":"2024-09-12T01:58:33.072371+0000","last_clean":"2024-09-12T01:58:33.072371+0000","last_became_active":"2024-09-12T01:58:32.078659+0000","last_became_peered":"2024-09-12T01:58:32.078659+0000","last_unstale":"2024-09-12T01:58:33.072371+0000","last_undegraded":"2024-09-12T01:58:33.072371+0000","last_fullsized":"2024-09-12T01:58:33.072371+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:02.012816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072329+0000","last_change":"2024-09-12T01:58:31.085752+0000","last_active":"2024-09-12T01:58:33.072329+0000","last_peered":"2024-09-12T01:58:33.072329+0000","last_clean":"2024-09-12T01:58:33.072329+0000","last_became_active":"2024-09-12T01:58:31.085456+0000","last_became_peered":"2024-09-12T01:58:31.085456+0000","last_unstale":"2024-09-12T01:58:33.072329+0000","last_undegraded":"2024-09-12T01:58:33.072329+0000","last_fullsized":"2024-09-12T01:58:33.072329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:44.704921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127603+0000","last_change":"2024-09-12T01:58:32.098820+0000","last_active":"2024-09-12T01:58:38.127603+0000","last_peered":"2024-09-12T01:58:38.127603+0000","last_clean":"2024-09-12T01:58:38.127603+0000","last_became_active":"2024-09-12T01:58:32.098562+0000","last_became_peered":"2024-09-12T01:58:32.098562+0000","last_unstale":"2024-09-12T01:58:38.127603+0000","last_undegraded":"2024-09-12T01:58:38.127603+0000","last_fullsized":"2024-09-12T01:58:38.127603+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:15.459156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072133+0000","last_change":"2024-09-12T01:58:31.082135+0000","last_active":"2024-09-12T01:58:33.072133+0000","last_peered":"2024-09-12T01:58:33.072133+0000","last_clean":"2024-09-12T01:58:33.072133+0000","last_became_active":"2024-09-12T01:58:31.081834+0000","last_became_peered":"2024-09-12T01:58:31.081834+0000","last_unstale":"2024-09-12T01:58:33.072133+0000","last_undegraded":"2024-09-12T01:58:33.072133+0000","last_fullsized":"2024-09-12T01:58:33.072133+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:59.204264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.122155+0000","last_change":"2024-09-12T01:58:32.092057+0000","last_active":"2024-09-12T01:58:38.122155+0000","last_peered":"2024-09-12T01:58:38.122155+0000","last_clean":"2024-09-12T01:58:38.122155+0000","last_became_active":"2024-09-12T01:58:32.091372+0000","last_became_peered":"2024-09-12T01:58:32.091372+0000","last_unstale":"2024-09-12T01:58:38.122155+0000","last_undegraded":"2024-09-12T01:58:38.122155+0000","last_fullsized":"2024-09-12T01:58:38.122155+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:50.595958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915799+0000","last_change":"2024-09-12T01:58:31.085302+0000","last_active":"2024-09-12T01:58:33.915799+0000","last_peered":"2024-09-12T01:58:33.915799+0000","last_clean":"2024-09-12T01:58:33.915799+0000","last_became_active":"2024-09-12T01:58:31.084995+0000","last_became_peered":"2024-09-12T01:58:31.084995+0000","last_unstale":"2024-09-12T01:58:33.915799+0000","last_undegraded":"2024-09-12T01:58:33.915799+0000","last_fullsized":"2024-09-12T01:58:33.915799+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:18.228685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666540+0000","last_change":"2024-09-12T01:58:32.099965+0000","last_active":"2024-09-12T01:58:33.666540+0000","last_peered":"2024-09-12T01:58:33.666540+0000","last_clean":"2024-09-12T01:58:33.666540+0000","last_became_active":"2024-09-12T01:58:32.099518+0000","last_became_peered":"2024-09-12T01:58:32.099518+0000","last_unstale":"2024-09-12T01:58:33.666540+0000","last_undegraded":"2024-09-12T01:58:33.666540+0000","last_fullsized":"2024-09-12T01:58:33.666540+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:55.745348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915580+0000","last_change":"2024-09-12T01:58:31.086015+0000","last_active":"2024-09-12T01:58:33.915580+0000","last_peered":"2024-09-12T01:58:33.915580+0000","last_clean":"2024-09-12T01:58:33.915580+0000","last_became_active":"2024-09-12T01:58:31.085736+0000","last_became_peered":"2024-09-12T01:58:31.085736+0000","last_unstale":"2024-09-12T01:58:33.915580+0000","last_undegraded":"2024-09-12T01:58:33.915580+0000","last_fullsized":"2024-09-12T01:58:33.915580+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:58.281292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.121032+0000","last_change":"2024-09-12T01:58:32.092252+0000","last_active":"2024-09-12T01:58:38.121032+0000","last_peered":"2024-09-12T01:58:38.121032+0000","last_clean":"2024-09-12T01:58:38.121032+0000","last_became_active":"2024-09-12T01:58:32.091933+0000","last_became_peered":"2024-09-12T01:58:32.091933+0000","last_unstale":"2024-09-12T01:58:38.121032+0000","last_undegraded":"2024-09-12T01:58:38.121032+0000","last_fullsized":"2024-09-12T01:58:38.121032+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:20.410580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915595+0000","last_change":"2024-09-12T01:58:31.078913+0000","last_active":"2024-09-12T01:58:33.915595+0000","last_peered":"2024-09-12T01:58:33.915595+0000","last_clean":"2024-09-12T01:58:33.915595+0000","last_became_active":"2024-09-12T01:58:31.078594+0000","last_became_peered":"2024-09-12T01:58:31.078594+0000","last_unstale":"2024-09-12T01:58:33.915595+0000","last_undegraded":"2024-09-12T01:58:33.915595+0000","last_fullsized":"2024-09-12T01:58:33.915595+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:32.332146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915900+0000","last_change":"2024-09-12T01:58:32.082690+0000","last_active":"2024-09-12T01:58:33.915900+0000","last_peered":"2024-09-12T01:58:33.915900+0000","last_clean":"2024-09-12T01:58:33.915900+0000","last_became_active":"2024-09-12T01:58:32.082372+0000","last_became_peered":"2024-09-12T01:58:32.082372+0000","last_unstale":"2024-09-12T01:58:33.915900+0000","last_undegraded":"2024-09-12T01:58:33.915900+0000","last_fullsized":"2024-09-12T01:58:33.915900+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:13.919476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.119793+0000","last_change":"2024-09-12T01:58:31.084452+0000","last_active":"2024-09-12T01:58:38.119793+0000","last_peered":"2024-09-12T01:58:38.119793+0000","last_clean":"2024-09-12T01:58:38.119793+0000","last_became_active":"2024-09-12T01:58:31.084091+0000","last_became_peered":"2024-09-12T01:58:31.084091+0000","last_unstale":"2024-09-12T01:58:38.119793+0000","last_undegraded":"2024-09-12T01:58:38.119793+0000","last_fullsized":"2024-09-12T01:58:38.119793+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:02.589355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666914+0000","last_change":"2024-09-12T01:58:32.095478+0000","last_active":"2024-09-12T01:58:33.666914+0000","last_peered":"2024-09-12T01:58:33.666914+0000","last_clean":"2024-09-12T01:58:33.666914+0000","last_became_active":"2024-09-12T01:58:32.094996+0000","last_became_peered":"2024-09-12T01:58:32.094996+0000","last_unstale":"2024-09-12T01:58:33.666914+0000","last_undegraded":"2024-09-12T01:58:33.666914+0000","last_fullsized":"2024-09-12T01:58:33.666914+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:15.825443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127848+0000","last_change":"2024-09-12T01:58:31.091023+0000","last_active":"2024-09-12T01:58:38.127848+0000","last_peered":"2024-09-12T01:58:38.127848+0000","last_clean":"2024-09-12T01:58:38.127848+0000","last_became_active":"2024-09-12T01:58:31.090814+0000","last_became_peered":"2024-09-12T01:58:31.090814+0000","last_unstale":"2024-09-12T01:58:38.127848+0000","last_undegraded":"2024-09-12T01:58:38.127848+0000","last_fullsized":"2024-09-12T01:58:38.127848+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:13.812313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915828+0000","last_change":"2024-09-12T01:58:32.093516+0000","last_active":"2024-09-12T01:58:33.915828+0000","last_peered":"2024-09-12T01:58:33.915828+0000","last_clean":"2024-09-12T01:58:33.915828+0000","last_became_active":"2024-09-12T01:58:32.093213+0000","last_became_peered":"2024-09-12T01:58:32.093213+0000","last_unstale":"2024-09-12T01:58:33.915828+0000","last_undegraded":"2024-09-12T01:58:33.915828+0000","last_fullsized":"2024-09-12T01:58:33.915828+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:23.467846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071892+0000","last_change":"2024-09-12T01:58:31.076858+0000","last_active":"2024-09-12T01:58:33.071892+0000","last_peered":"2024-09-12T01:58:33.071892+0000","last_clean":"2024-09-12T01:58:33.071892+0000","last_became_active":"2024-09-12T01:58:31.076593+0000","last_became_peered":"2024-09-12T01:58:31.076593+0000","last_unstale":"2024-09-12T01:58:33.071892+0000","last_undegraded":"2024-09-12T01:58:33.071892+0000","last_fullsized":"2024-09-12T01:58:33.071892+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:30.358255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.120631+0000","last_change":"2024-09-12T01:58:32.096897+0000","last_active":"2024-09-12T01:58:38.120631+0000","last_peered":"2024-09-12T01:58:38.120631+0000","last_clean":"2024-09-12T01:58:38.120631+0000","last_became_active":"2024-09-12T01:58:32.095734+0000","last_became_peered":"2024-09-12T01:58:32.095734+0000","last_unstale":"2024-09-12T01:58:38.120631+0000","last_undegraded":"2024-09-12T01:58:38.120631+0000","last_fullsized":"2024-09-12T01:58:38.120631+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:58.521341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"65'3","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127537+0000","last_change":"2024-09-12T01:58:31.085278+0000","last_active":"2024-09-12T01:58:38.127537+0000","last_peered":"2024-09-12T01:58:38.127537+0000","last_clean":"2024-09-12T01:58:38.127537+0000","last_became_active":"2024-09-12T01:58:31.084951+0000","last_became_peered":"2024-09-12T01:58:31.084951+0000","last_unstale":"2024-09-12T01:58:38.127537+0000","last_undegraded":"2024-09-12T01:58:38.127537+0000","last_fullsized":"2024-09-12T01:58:38.127537+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:41.804439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.070832+0000","last_change":"2024-09-12T01:58:32.086718+0000","last_active":"2024-09-12T01:58:33.070832+0000","last_peered":"2024-09-12T01:58:33.070832+0000","last_clean":"2024-09-12T01:58:33.070832+0000","last_became_active":"2024-09-12T01:58:32.086444+0000","last_became_peered":"2024-09-12T01:58:32.086444+0000","last_unstale":"2024-09-12T01:58:33.070832+0000","last_undegraded":"2024-09-12T01:58:33.070832+0000","last_fullsized":"2024-09-12T01:58:33.070832+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:13.252384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"65'6","reported_seq":20,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666897+0000","last_change":"2024-09-12T01:58:31.079583+0000","last_active":"2024-09-12T01:58:33.666897+0000","last_peered":"2024-09-12T01:58:33.666897+0000","last_clean":"2024-09-12T01:58:33.666897+0000","last_became_active":"2024-09-12T01:58:31.079317+0000","last_became_peered":"2024-09-12T01:58:31.079317+0000","last_unstale":"2024-09-12T01:58:33.666897+0000","last_undegraded":"2024-09-12T01:58:33.666897+0000","last_fullsized":"2024-09-12T01:58:33.666897+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:33.047976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071905+0000","last_change":"2024-09-12T01:58:32.097734+0000","last_active":"2024-09-12T01:58:33.071905+0000","last_peered":"2024-09-12T01:58:33.071905+0000","last_clean":"2024-09-12T01:58:33.071905+0000","last_became_active":"2024-09-12T01:58:32.095245+0000","last_became_peered":"2024-09-12T01:58:32.095245+0000","last_unstale":"2024-09-12T01:58:33.071905+0000","last_undegraded":"2024-09-12T01:58:33.071905+0000","last_fullsized":"2024-09-12T01:58:33.071905+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:13.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"65'2","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127434+0000","last_change":"2024-09-12T01:58:31.085938+0000","last_active":"2024-09-12T01:58:38.127434+0000","last_peered":"2024-09-12T01:58:38.127434+0000","last_clean":"2024-09-12T01:58:38.127434+0000","last_became_active":"2024-09-12T01:58:31.085635+0000","last_became_peered":"2024-09-12T01:58:31.085635+0000","last_unstale":"2024-09-12T01:58:38.127434+0000","last_undegraded":"2024-09-12T01:58:38.127434+0000","last_fullsized":"2024-09-12T01:58:38.127434+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:39.540230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615859+0000","last_change":"2024-09-12T01:58:32.093963+0000","last_active":"2024-09-12T01:58:38.615859+0000","last_peered":"2024-09-12T01:58:38.615859+0000","last_clean":"2024-09-12T01:58:38.615859+0000","last_became_active":"2024-09-12T01:58:32.093588+0000","last_became_peered":"2024-09-12T01:58:32.093588+0000","last_unstale":"2024-09-12T01:58:38.615859+0000","last_undegraded":"2024-09-12T01:58:38.615859+0000","last_fullsized":"2024-09-12T01:58:38.615859+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:59.477648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615888+0000","last_change":"2024-09-12T01:58:31.083496+0000","last_active":"2024-09-12T01:58:38.615888+0000","last_peered":"2024-09-12T01:58:38.615888+0000","last_clean":"2024-09-12T01:58:38.615888+0000","last_became_active":"2024-09-12T01:58:31.083282+0000","last_became_peered":"2024-09-12T01:58:31.083282+0000","last_unstale":"2024-09-12T01:58:38.615888+0000","last_undegraded":"2024-09-12T01:58:38.615888+0000","last_fullsized":"2024-09-12T01:58:38.615888+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:39.540230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.121073+0000","last_change":"2024-09-12T01:58:32.085515+0000","last_active":"2024-09-12T01:58:38.121073+0000","last_peered":"2024-09-12T01:58:38.121073+0000","last_clean":"2024-09-12T01:58:38.121073+0000","last_became_active":"2024-09-12T01:58:32.085180+0000","last_became_peered":"2024-09-12T01:58:32.085180+0000","last_unstale":"2024-09-12T01:58:38.121073+0000","last_undegraded":"2024-09-12T01:58:38.121073+0000","last_fullsized":"2024-09-12T01:58:38.121073+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:46.112207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127552+0000","last_change":"2024-09-12T01:58:31.085595+0000","last_active":"2024-09-12T01:58:38.127552+0000","last_peered":"2024-09-12T01:58:38.127552+0000","last_clean":"2024-09-12T01:58:38.127552+0000","last_became_active":"2024-09-12T01:58:31.085333+0000","last_became_peered":"2024-09-12T01:58:31.085333+0000","last_unstale":"2024-09-12T01:58:38.127552+0000","last_undegraded":"2024-09-12T01:58:38.127552+0000","last_fullsized":"2024-09-12T01:58:38.127552+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:47.588497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666733+0000","last_change":"2024-09-12T01:58:32.101742+0000","last_active":"2024-09-12T01:58:33.666733+0000","last_peered":"2024-09-12T01:58:33.666733+0000","last_clean":"2024-09-12T01:58:33.666733+0000","last_became_active":"2024-09-12T01:58:32.100985+0000","last_became_peered":"2024-09-12T01:58:32.100985+0000","last_unstale":"2024-09-12T01:58:33.666733+0000","last_undegraded":"2024-09-12T01:58:33.666733+0000","last_fullsized":"2024-09-12T01:58:33.666733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:13.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"65'8","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071852+0000","last_change":"2024-09-12T01:58:31.080233+0000","last_active":"2024-09-12T01:58:33.071852+0000","last_peered":"2024-09-12T01:58:33.071852+0000","last_clean":"2024-09-12T01:58:33.071852+0000","last_became_active":"2024-09-12T01:58:31.079923+0000","last_became_peered":"2024-09-12T01:58:31.079923+0000","last_unstale":"2024-09-12T01:58:33.071852+0000","last_undegraded":"2024-09-12T01:58:33.071852+0000","last_fullsized":"2024-09-12T01:58:33.071852+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:18.045768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127654+0000","last_change":"2024-09-12T01:58:32.095870+0000","last_active":"2024-09-12T01:58:38.127654+0000","last_peered":"2024-09-12T01:58:38.127654+0000","last_clean":"2024-09-12T01:58:38.127654+0000","last_became_active":"2024-09-12T01:58:32.095589+0000","last_became_peered":"2024-09-12T01:58:32.095589+0000","last_unstale":"2024-09-12T01:58:38.127654+0000","last_undegraded":"2024-09-12T01:58:38.127654+0000","last_fullsized":"2024-09-12T01:58:38.127654+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:50.976465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"65'1","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616189+0000","last_change":"2024-09-12T01:58:31.085862+0000","last_active":"2024-09-12T01:58:38.616189+0000","last_peered":"2024-09-12T01:58:38.616189+0000","last_clean":"2024-09-12T01:58:38.616189+0000","last_became_active":"2024-09-12T01:58:31.085601+0000","last_became_peered":"2024-09-12T01:58:31.085601+0000","last_unstale":"2024-09-12T01:58:38.616189+0000","last_undegraded":"2024-09-12T01:58:38.616189+0000","last_fullsized":"2024-09-12T01:58:38.616189+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:20.505778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.121093+0000","last_change":"2024-09-12T01:58:32.089389+0000","last_active":"2024-09-12T01:58:38.121093+0000","last_peered":"2024-09-12T01:58:38.121093+0000","last_clean":"2024-09-12T01:58:38.121093+0000","last_became_active":"2024-09-12T01:58:32.088821+0000","last_became_peered":"2024-09-12T01:58:32.088821+0000","last_unstale":"2024-09-12T01:58:38.121093+0000","last_undegraded":"2024-09-12T01:58:38.121093+0000","last_fullsized":"2024-09-12T01:58:38.121093+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:23.327759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T01:58:38.122341+0000","last_change":"2024-09-12T01:58:38.122341+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:38.122341+0000","last_undegraded":"2024-09-12T01:58:38.122341+0000","last_fullsized":"2024-09-12T01:58:38.122341+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071827+0000","last_change":"2024-09-12T01:58:32.083451+0000","last_active":"2024-09-12T01:58:33.071827+0000","last_peered":"2024-09-12T01:58:33.071827+0000","last_clean":"2024-09-12T01:58:33.071827+0000","last_became_active":"2024-09-12T01:58:32.083176+0000","last_became_peered":"2024-09-12T01:58:32.083176+0000","last_unstale":"2024-09-12T01:58:33.071827+0000","last_undegraded":"2024-09-12T01:58:33.071827+0000","last_fullsized":"2024-09-12T01:58:33.071827+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:56.968157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"65'1","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127666+0000","last_change":"2024-09-12T01:58:31.087815+0000","last_active":"2024-09-12T01:58:38.127666+0000","last_peered":"2024-09-12T01:58:38.127666+0000","last_clean":"2024-09-12T01:58:38.127666+0000","last_became_active":"2024-09-12T01:58:31.087594+0000","last_became_peered":"2024-09-12T01:58:31.087594+0000","last_unstale":"2024-09-12T01:58:38.127666+0000","last_undegraded":"2024-09-12T01:58:38.127666+0000","last_fullsized":"2024-09-12T01:58:38.127666+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.106930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.120745+0000","last_change":"2024-09-12T01:58:32.089687+0000","last_active":"2024-09-12T01:58:38.120745+0000","last_peered":"2024-09-12T01:58:38.120745+0000","last_clean":"2024-09-12T01:58:38.120745+0000","last_became_active":"2024-09-12T01:58:32.088371+0000","last_became_peered":"2024-09-12T01:58:32.088371+0000","last_unstale":"2024-09-12T01:58:38.120745+0000","last_undegraded":"2024-09-12T01:58:38.120745+0000","last_fullsized":"2024-09-12T01:58:38.120745+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:56.306443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915671+0000","last_change":"2024-09-12T01:58:31.074406+0000","last_active":"2024-09-12T01:58:33.915671+0000","last_peered":"2024-09-12T01:58:33.915671+0000","last_clean":"2024-09-12T01:58:33.915671+0000","last_became_active":"2024-09-12T01:58:31.074068+0000","last_became_peered":"2024-09-12T01:58:31.074068+0000","last_unstale":"2024-09-12T01:58:33.915671+0000","last_undegraded":"2024-09-12T01:58:33.915671+0000","last_fullsized":"2024-09-12T01:58:33.915671+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:26.113685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071998+0000","last_change":"2024-09-12T01:58:32.078981+0000","last_active":"2024-09-12T01:58:33.071998+0000","last_peered":"2024-09-12T01:58:33.071998+0000","last_clean":"2024-09-12T01:58:33.071998+0000","last_became_active":"2024-09-12T01:58:32.078680+0000","last_became_peered":"2024-09-12T01:58:32.078680+0000","last_unstale":"2024-09-12T01:58:33.071998+0000","last_undegraded":"2024-09-12T01:58:33.071998+0000","last_fullsized":"2024-09-12T01:58:33.071998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:11.561895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072046+0000","last_change":"2024-09-12T01:58:31.084085+0000","last_active":"2024-09-12T01:58:33.072046+0000","last_peered":"2024-09-12T01:58:33.072046+0000","last_clean":"2024-09-12T01:58:33.072046+0000","last_became_active":"2024-09-12T01:58:31.083740+0000","last_became_peered":"2024-09-12T01:58:31.083740+0000","last_unstale":"2024-09-12T01:58:33.072046+0000","last_undegraded":"2024-09-12T01:58:33.072046+0000","last_fullsized":"2024-09-12T01:58:33.072046+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:23.301991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615869+0000","last_change":"2024-09-12T01:58:32.092045+0000","last_active":"2024-09-12T01:58:38.615869+0000","last_peered":"2024-09-12T01:58:38.615869+0000","last_clean":"2024-09-12T01:58:38.615869+0000","last_became_active":"2024-09-12T01:58:32.091550+0000","last_became_peered":"2024-09-12T01:58:32.091550+0000","last_unstale":"2024-09-12T01:58:38.615869+0000","last_undegraded":"2024-09-12T01:58:38.615869+0000","last_fullsized":"2024-09-12T01:58:38.615869+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:41.371386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616035+0000","last_change":"2024-09-12T01:58:31.083500+0000","last_active":"2024-09-12T01:58:38.616035+0000","last_peered":"2024-09-12T01:58:38.616035+0000","last_clean":"2024-09-12T01:58:38.616035+0000","last_became_active":"2024-09-12T01:58:31.083304+0000","last_became_peered":"2024-09-12T01:58:31.083304+0000","last_unstale":"2024-09-12T01:58:38.616035+0000","last_undegraded":"2024-09-12T01:58:38.616035+0000","last_fullsized":"2024-09-12T01:58:38.616035+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:41.804439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.121127+0000","last_change":"2024-09-12T01:58:32.092142+0000","last_active":"2024-09-12T01:58:38.121127+0000","last_peered":"2024-09-12T01:58:38.121127+0000","last_clean":"2024-09-12T01:58:38.121127+0000","last_became_active":"2024-09-12T01:58:32.091877+0000","last_became_peered":"2024-09-12T01:58:32.091877+0000","last_unstale":"2024-09-12T01:58:38.121127+0000","last_undegraded":"2024-09-12T01:58:38.121127+0000","last_fullsized":"2024-09-12T01:58:38.121127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:47.089578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071936+0000","last_change":"2024-09-12T01:58:31.079762+0000","last_active":"2024-09-12T01:58:33.071936+0000","last_peered":"2024-09-12T01:58:33.071936+0000","last_clean":"2024-09-12T01:58:33.071936+0000","last_became_active":"2024-09-12T01:58:31.079490+0000","last_became_peered":"2024-09-12T01:58:31.079490+0000","last_unstale":"2024-09-12T01:58:33.071936+0000","last_undegraded":"2024-09-12T01:58:33.071936+0000","last_fullsized":"2024-09-12T01:58:33.071936+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:40.366109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072065+0000","last_change":"2024-09-12T01:58:32.088285+0000","last_active":"2024-09-12T01:58:33.072065+0000","last_peered":"2024-09-12T01:58:33.072065+0000","last_clean":"2024-09-12T01:58:33.072065+0000","last_became_active":"2024-09-12T01:58:32.087918+0000","last_became_peered":"2024-09-12T01:58:32.087918+0000","last_unstale":"2024-09-12T01:58:33.072065+0000","last_undegraded":"2024-09-12T01:58:33.072065+0000","last_fullsized":"2024-09-12T01:58:33.072065+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:19.787633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"65'2","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616272+0000","last_change":"2024-09-12T01:58:31.085470+0000","last_active":"2024-09-12T01:58:38.616272+0000","last_peered":"2024-09-12T01:58:38.616272+0000","last_clean":"2024-09-12T01:58:38.616272+0000","last_became_active":"2024-09-12T01:58:31.085216+0000","last_became_peered":"2024-09-12T01:58:31.085216+0000","last_unstale":"2024-09-12T01:58:38.616272+0000","last_undegraded":"2024-09-12T01:58:38.616272+0000","last_fullsized":"2024-09-12T01:58:38.616272+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:57.516064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.122643+0000","last_change":"2024-09-12T01:58:32.084136+0000","last_active":"2024-09-12T01:58:38.122643+0000","last_peered":"2024-09-12T01:58:38.122643+0000","last_clean":"2024-09-12T01:58:38.122643+0000","last_became_active":"2024-09-12T01:58:32.083827+0000","last_became_peered":"2024-09-12T01:58:32.083827+0000","last_unstale":"2024-09-12T01:58:38.122643+0000","last_undegraded":"2024-09-12T01:58:38.122643+0000","last_fullsized":"2024-09-12T01:58:38.122643+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:16.128275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"66'1","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616297+0000","last_change":"2024-09-12T01:58:31.082854+0000","last_active":"2024-09-12T01:58:38.616297+0000","last_peered":"2024-09-12T01:58:38.616297+0000","last_clean":"2024-09-12T01:58:38.616297+0000","last_became_active":"2024-09-12T01:58:31.082576+0000","last_became_peered":"2024-09-12T01:58:31.082576+0000","last_unstale":"2024-09-12T01:58:38.616297+0000","last_undegraded":"2024-09-12T01:58:38.616297+0000","last_fullsized":"2024-09-12T01:58:38.616297+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:55.301165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616216+0000","last_change":"2024-09-12T01:58:32.094795+0000","last_active":"2024-09-12T01:58:38.616216+0000","last_peered":"2024-09-12T01:58:38.616216+0000","last_clean":"2024-09-12T01:58:38.616216+0000","last_became_active":"2024-09-12T01:58:32.093598+0000","last_became_peered":"2024-09-12T01:58:32.093598+0000","last_unstale":"2024-09-12T01:58:38.616216+0000","last_undegraded":"2024-09-12T01:58:38.616216+0000","last_fullsized":"2024-09-12T01:58:38.616216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.413296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072377+0000","last_change":"2024-09-12T01:58:31.086458+0000","last_active":"2024-09-12T01:58:33.072377+0000","last_peered":"2024-09-12T01:58:33.072377+0000","last_clean":"2024-09-12T01:58:33.072377+0000","last_became_active":"2024-09-12T01:58:31.086155+0000","last_became_peered":"2024-09-12T01:58:31.086155+0000","last_unstale":"2024-09-12T01:58:33.072377+0000","last_undegraded":"2024-09-12T01:58:33.072377+0000","last_fullsized":"2024-09-12T01:58:33.072377+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:58.472371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.120841+0000","last_change":"2024-09-12T01:58:32.083243+0000","last_active":"2024-09-12T01:58:38.120841+0000","last_peered":"2024-09-12T01:58:38.120841+0000","last_clean":"2024-09-12T01:58:38.120841+0000","last_became_active":"2024-09-12T01:58:32.082988+0000","last_became_peered":"2024-09-12T01:58:32.082988+0000","last_unstale":"2024-09-12T01:58:38.120841+0000","last_undegraded":"2024-09-12T01:58:38.120841+0000","last_fullsized":"2024-09-12T01:58:38.120841+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:21.511055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666966+0000","last_change":"2024-09-12T01:58:31.077535+0000","last_active":"2024-09-12T01:58:33.666966+0000","last_peered":"2024-09-12T01:58:33.666966+0000","last_clean":"2024-09-12T01:58:33.666966+0000","last_became_active":"2024-09-12T01:58:31.077058+0000","last_became_peered":"2024-09-12T01:58:31.077058+0000","last_unstale":"2024-09-12T01:58:33.666966+0000","last_undegraded":"2024-09-12T01:58:33.666966+0000","last_fullsized":"2024-09-12T01:58:33.666966+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:10.416486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.119688+0000","last_change":"2024-09-12T01:58:32.099028+0000","last_active":"2024-09-12T01:58:38.119688+0000","last_peered":"2024-09-12T01:58:38.119688+0000","last_clean":"2024-09-12T01:58:38.119688+0000","last_became_active":"2024-09-12T01:58:32.098748+0000","last_became_peered":"2024-09-12T01:58:32.098748+0000","last_unstale":"2024-09-12T01:58:38.119688+0000","last_undegraded":"2024-09-12T01:58:38.119688+0000","last_fullsized":"2024-09-12T01:58:38.119688+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:42.809716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127507+0000","last_change":"2024-09-12T01:58:31.090527+0000","last_active":"2024-09-12T01:58:38.127507+0000","last_peered":"2024-09-12T01:58:38.127507+0000","last_clean":"2024-09-12T01:58:38.127507+0000","last_became_active":"2024-09-12T01:58:31.090284+0000","last_became_peered":"2024-09-12T01:58:31.090284+0000","last_unstale":"2024-09-12T01:58:38.127507+0000","last_undegraded":"2024-09-12T01:58:38.127507+0000","last_fullsized":"2024-09-12T01:58:38.127507+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:55.301165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071598+0000","last_change":"2024-09-12T01:58:32.089933+0000","last_active":"2024-09-12T01:58:33.071598+0000","last_peered":"2024-09-12T01:58:33.071598+0000","last_clean":"2024-09-12T01:58:33.071598+0000","last_became_active":"2024-09-12T01:58:32.089694+0000","last_became_peered":"2024-09-12T01:58:32.089694+0000","last_unstale":"2024-09-12T01:58:33.071598+0000","last_undegraded":"2024-09-12T01:58:33.071598+0000","last_fullsized":"2024-09-12T01:58:33.071598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:33.295546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915715+0000","last_change":"2024-09-12T01:58:31.076859+0000","last_active":"2024-09-12T01:58:33.915715+0000","last_peered":"2024-09-12T01:58:33.915715+0000","last_clean":"2024-09-12T01:58:33.915715+0000","last_became_active":"2024-09-12T01:58:31.076488+0000","last_became_peered":"2024-09-12T01:58:31.076488+0000","last_unstale":"2024-09-12T01:58:33.915715+0000","last_undegraded":"2024-09-12T01:58:33.915715+0000","last_fullsized":"2024-09-12T01:58:33.915715+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:47.205697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666577+0000","last_change":"2024-09-12T01:58:32.099717+0000","last_active":"2024-09-12T01:58:33.666577+0000","last_peered":"2024-09-12T01:58:33.666577+0000","last_clean":"2024-09-12T01:58:33.666577+0000","last_became_active":"2024-09-12T01:58:32.099398+0000","last_became_peered":"2024-09-12T01:58:32.099398+0000","last_unstale":"2024-09-12T01:58:33.666577+0000","last_undegraded":"2024-09-12T01:58:33.666577+0000","last_fullsized":"2024-09-12T01:58:33.666577+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:56.968157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915720+0000","last_change":"2024-09-12T01:58:31.078174+0000","last_active":"2024-09-12T01:58:33.915720+0000","last_peered":"2024-09-12T01:58:33.915720+0000","last_clean":"2024-09-12T01:58:33.915720+0000","last_became_active":"2024-09-12T01:58:31.077722+0000","last_became_peered":"2024-09-12T01:58:31.077722+0000","last_unstale":"2024-09-12T01:58:33.915720+0000","last_undegraded":"2024-09-12T01:58:33.915720+0000","last_fullsized":"2024-09-12T01:58:33.915720+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:04.459773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.122515+0000","last_change":"2024-09-12T01:58:32.092706+0000","last_active":"2024-09-12T01:58:38.122515+0000","last_peered":"2024-09-12T01:58:38.122515+0000","last_clean":"2024-09-12T01:58:38.122515+0000","last_became_active":"2024-09-12T01:58:32.092407+0000","last_became_peered":"2024-09-12T01:58:32.092407+0000","last_unstale":"2024-09-12T01:58:38.122515+0000","last_undegraded":"2024-09-12T01:58:38.122515+0000","last_fullsized":"2024-09-12T01:58:38.122515+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:09.461358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666535+0000","last_change":"2024-09-12T01:58:31.083451+0000","last_active":"2024-09-12T01:58:33.666535+0000","last_peered":"2024-09-12T01:58:33.666535+0000","last_clean":"2024-09-12T01:58:33.666535+0000","last_became_active":"2024-09-12T01:58:31.083133+0000","last_became_peered":"2024-09-12T01:58:31.083133+0000","last_unstale":"2024-09-12T01:58:33.666535+0000","last_undegraded":"2024-09-12T01:58:33.666535+0000","last_fullsized":"2024-09-12T01:58:33.666535+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:21.347164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.120569+0000","last_change":"2024-09-12T01:58:32.096326+0000","last_active":"2024-09-12T01:58:38.120569+0000","last_peered":"2024-09-12T01:58:38.120569+0000","last_clean":"2024-09-12T01:58:38.120569+0000","last_became_active":"2024-09-12T01:58:32.096061+0000","last_became_peered":"2024-09-12T01:58:32.096061+0000","last_unstale":"2024-09-12T01:58:38.120569+0000","last_undegraded":"2024-09-12T01:58:38.120569+0000","last_fullsized":"2024-09-12T01:58:38.120569+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:40.545508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915509+0000","last_change":"2024-09-12T01:58:31.084470+0000","last_active":"2024-09-12T01:58:33.915509+0000","last_peered":"2024-09-12T01:58:33.915509+0000","last_clean":"2024-09-12T01:58:33.915509+0000","last_became_active":"2024-09-12T01:58:31.084172+0000","last_became_peered":"2024-09-12T01:58:31.084172+0000","last_unstale":"2024-09-12T01:58:33.915509+0000","last_undegraded":"2024-09-12T01:58:33.915509+0000","last_fullsized":"2024-09-12T01:58:33.915509+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:29.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":253,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127848+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:58:38.127848+0000","last_peered":"2024-09-12T01:58:38.127848+0000","last_clean":"2024-09-12T01:58:38.127848+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:58:38.127848+0000","last_undegraded":"2024-09-12T01:58:38.127848+0000","last_fullsized":"2024-09-12T01:58:38.127848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28408,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343432,"statfs":{"total":96636764160,"available":96607674368,"internally_reserved":0,"allocated":1413120,"data_stored":957095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509478,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":365985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":365973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":359418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":790528,"data_stored":359418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":361794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1384448,"data_stored":949786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":802816,"data_stored":361030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:58:40.167 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3b is not active+clean 2024-09-12T01:58:40.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 13, 'reported_epoch': 66, 'state': 'peering', 'last_fresh': '2024-09-12T01:58:34.120954+0000', 'last_change': '2024-09-12T01:58:38.120334+0000', 'last_active': '2024-09-12T01:58:38.120334+0000', 'last_peered': '2024-09-12T01:58:34.120954+0000', 'last_clean': '2024-09-12T01:58:34.120954+0000', 'last_became_active': '2024-09-12T01:58:32.083847+0000', 'last_became_peered': '2024-09-12T01:58:32.083847+0000', 'last_unstale': '2024-09-12T01:58:34.120954+0000', 'last_undegraded': '2024-09-12T01:58:34.120954+0000', 'last_fullsized': '2024-09-12T01:58:34.120954+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 65, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:31.060135+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3, 4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:58:40.167 INFO:tasks.ceph.ceph_manager.ceph:PG 9.e is not active+clean 2024-09-12T01:58:40.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'peering', 'last_fresh': '2024-09-12T01:58:38.122341+0000', 'last_change': '2024-09-12T01:58:38.122341+0000', 'last_active': '0.000000', 'last_peered': '0.000000', 'last_clean': '0.000000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:58:38.122341+0000', 'last_undegraded': '2024-09-12T01:58:38.122341+0000', 'last_fullsized': '2024-09-12T01:58:38.122341+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 64, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'last_clean_scrub_stamp': '2024-09-12T01:58:30.054858+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:58:40.167 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T01:58:40.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.305+0000 7fab9f3d8640 1 Processor -- start 2024-09-12T01:58:40.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.305+0000 7fab9f3d8640 1 -- start start 2024-09-12T01:58:40.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.306+0000 7fab9f3d8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fab9815b300 0x7fab980cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:40.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.306+0000 7fab9f3d8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab980cdbe0 con 0x7fab9806f8d0 2024-09-12T01:58:40.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.306+0000 7fab9f3d8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab980cd900 con 0x7fab980cd3f0 2024-09-12T01:58:40.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.306+0000 7fab9f3d8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fab980728a0 con 0x7fab9815b300 2024-09-12T01:58:40.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.306+0000 7fab9d174640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fab9815b300 0x7fab980cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:40.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.306+0000 7fab9d975640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fab9806f8d0 0x7fab9815b6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38390/0 (socket says 172.21.15.19:38390) 2024-09-12T01:58:40.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.306+0000 7fab9d975640 1 -- 172.21.15.19:0/597778497 learned_addr learned my addr 172.21.15.19:0/597778497 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:40.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.306+0000 7fab9d174640 1 -- 172.21.15.19:0/597778497 >> v1:172.21.15.135:6789/0 conn(0x7fab980cd3f0 legacy=0x7fab9806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:40.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.306+0000 7fab9d174640 1 -- 172.21.15.19:0/597778497 >> v1:172.21.15.19:6789/0 conn(0x7fab9806f8d0 legacy=0x7fab9815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:40.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.306+0000 7fab9d174640 1 -- 172.21.15.19:0/597778497 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab98072250 con 0x7fab9815b300 2024-09-12T01:58:40.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.307+0000 7fab9d174640 1 --2- 172.21.15.19:0/597778497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab9815b300 0x7fab980cceb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fab940097a0 tx=0x7fab9402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3282cb9187fb03ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:40.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.307+0000 7fab8ffff640 1 -- 172.21.15.19:0/597778497 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94037070 con 0x7fab9815b300 2024-09-12T01:58:40.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.307+0000 7fab8ffff640 1 -- 172.21.15.19:0/597778497 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab94032440 con 0x7fab9815b300 2024-09-12T01:58:40.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.307+0000 7fab8ffff640 1 -- 172.21.15.19:0/597778497 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94032810 con 0x7fab9815b300 2024-09-12T01:58:40.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.307+0000 7fab9f3d8640 1 -- 172.21.15.19:0/597778497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab9815b300 msgr2=0x7fab980cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:40.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.308+0000 7fab9f3d8640 1 --2- 172.21.15.19:0/597778497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab9815b300 0x7fab980cceb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fab940097a0 tx=0x7fab9402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.308+0000 7fab9f3d8640 1 -- 172.21.15.19:0/597778497 shutdown_connections 2024-09-12T01:58:40.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.308+0000 7fab9f3d8640 1 --2- 172.21.15.19:0/597778497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab9815b300 0x7fab980cceb0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.308+0000 7fab9f3d8640 1 -- 172.21.15.19:0/597778497 >> 172.21.15.19:0/597778497 conn(0x7fab98067d70 msgr2=0x7fab9806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:40.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.308+0000 7fab9f3d8640 1 -- 172.21.15.19:0/597778497 shutdown_connections 2024-09-12T01:58:40.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.308+0000 7fab9f3d8640 1 -- 172.21.15.19:0/597778497 wait complete. 2024-09-12T01:58:40.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.309+0000 7fab9f3d8640 1 Processor -- start 2024-09-12T01:58:40.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.309+0000 7fab9f3d8640 1 -- start start 2024-09-12T01:58:40.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9f3d8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab9806f8d0 0x7fab98144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:40.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9f3d8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab980cd3f0 0x7fab980a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:40.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9f3d8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab9815b300 0x7fab980aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:40.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9f3d8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fab980d0160 con 0x7fab980cd3f0 2024-09-12T01:58:40.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9f3d8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fab980cffe0 con 0x7fab9815b300 2024-09-12T01:58:40.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9f3d8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fab98072d30 con 0x7fab9806f8d0 2024-09-12T01:58:40.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9c973640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab980cd3f0 0x7fab980a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:40.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9c973640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab980cd3f0 0x7fab980a9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36026/0 (socket says 172.21.15.19:36026) 2024-09-12T01:58:40.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9c973640 1 -- 172.21.15.19:0/105057248 learned_addr learned my addr 172.21.15.19:0/105057248 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:40.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9d975640 1 --2- 172.21.15.19:0/105057248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab9815b300 0x7fab980aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:40.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9d174640 1 --2- 172.21.15.19:0/105057248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab9806f8d0 0x7fab98144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:40.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9c973640 1 -- 172.21.15.19:0/105057248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab9806f8d0 msgr2=0x7fab98144160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:40.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9c973640 1 --2- 172.21.15.19:0/105057248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab9806f8d0 0x7fab98144160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9c973640 1 -- 172.21.15.19:0/105057248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab9815b300 msgr2=0x7fab980aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:40.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9c973640 1 --2- 172.21.15.19:0/105057248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab9815b300 0x7fab980aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9c973640 1 -- 172.21.15.19:0/105057248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab981591d0 con 0x7fab980cd3f0 2024-09-12T01:58:40.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9d174640 1 --2- 172.21.15.19:0/105057248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab9806f8d0 0x7fab98144160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:40.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9c973640 1 --2- 172.21.15.19:0/105057248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab980cd3f0 0x7fab980a9ea0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fab8800c440 tx=0x7fab8800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:40.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab8dffb640 1 -- 172.21.15.19:0/105057248 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab88017070 con 0x7fab980cd3f0 2024-09-12T01:58:40.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab8dffb640 1 -- 172.21.15.19:0/105057248 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab880035f0 con 0x7fab980cd3f0 2024-09-12T01:58:40.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab8dffb640 1 -- 172.21.15.19:0/105057248 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab880039e0 con 0x7fab980cd3f0 2024-09-12T01:58:40.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.310+0000 7fab9f3d8640 1 -- 172.21.15.19:0/105057248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab981594b0 con 0x7fab980cd3f0 2024-09-12T01:58:40.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.311+0000 7fab9f3d8640 1 -- 172.21.15.19:0/105057248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab981567f0 con 0x7fab980cd3f0 2024-09-12T01:58:40.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.312+0000 7fab9f3d8640 1 -- 172.21.15.19:0/105057248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab981599d0 con 0x7fab980cd3f0 2024-09-12T01:58:40.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.312+0000 7fab8dffb640 1 -- 172.21.15.19:0/105057248 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab8801a070 con 0x7fab980cd3f0 2024-09-12T01:58:40.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.313+0000 7fab8dffb640 1 --2- 172.21.15.19:0/105057248 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fab7c06be60 0x7fab7c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:40.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.313+0000 7fab8dffb640 1 -- 172.21.15.19:0/105057248 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6217+0+0 (secure 0 0 0) 0x7fab8808a380 con 0x7fab980cd3f0 2024-09-12T01:58:40.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.313+0000 7fab9d174640 1 --2- 172.21.15.19:0/105057248 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fab7c06be60 0x7fab7c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:40.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.314+0000 7fab9d174640 1 --2- 172.21.15.19:0/105057248 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fab7c06be60 0x7fab7c06e320 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fab94034000 tx=0x7fab9402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:40.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.317+0000 7fab8dffb640 1 -- 172.21.15.19:0/105057248 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab981599d0 con 0x7fab980cd3f0 2024-09-12T01:58:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.558+0000 7fab9f3d8640 1 -- 172.21.15.19:0/105057248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fab9815c220 con 0x7fab980cd3f0 2024-09-12T01:58:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.558+0000 7fab8dffb640 1 -- 172.21.15.19:0/105057248 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1055 (secure 0 0 0) 0x7fab88058b20 con 0x7fab980cd3f0 2024-09-12T01:58:40.559 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:40.559 INFO:teuthology.orchestra.run.smithi019.stdout:{"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":188,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":68,"num_osds":8,"num_up_osds":8,"osd_up_since":1726106143,"num_in_osds":8,"osd_in_since":1726106133,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":237498368,"bytes_avail":772856614912,"bytes_total":773094113280,"write_bytes_sec":2369,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":41,"btime":"2024-09-12T01:58:34:091092+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5868}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-12T01:57:44.109844+0000","services":{}},"progress_events":{}} 2024-09-12T01:58:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.560+0000 7fab9f3d8640 1 -- 172.21.15.19:0/105057248 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fab7c06be60 msgr2=0x7fab7c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.560+0000 7fab9f3d8640 1 --2- 172.21.15.19:0/105057248 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fab7c06be60 0x7fab7c06e320 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fab94034000 tx=0x7fab9402e000 comp rx=0 tx=0).stop 2024-09-12T01:58:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.560+0000 7fab9f3d8640 1 -- 172.21.15.19:0/105057248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab980cd3f0 msgr2=0x7fab980a9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.560+0000 7fab9f3d8640 1 --2- 172.21.15.19:0/105057248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab980cd3f0 0x7fab980a9ea0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fab8800c440 tx=0x7fab8800c900 comp rx=0 tx=0).stop 2024-09-12T01:58:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.560+0000 7fab9f3d8640 1 -- 172.21.15.19:0/105057248 shutdown_connections 2024-09-12T01:58:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.560+0000 7fab9f3d8640 1 --2- 172.21.15.19:0/105057248 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fab7c06be60 0x7fab7c06e320 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.560+0000 7fab9f3d8640 1 --2- 172.21.15.19:0/105057248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab9815b300 0x7fab980aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.560+0000 7fab9f3d8640 1 --2- 172.21.15.19:0/105057248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab980cd3f0 0x7fab980a9ea0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.560+0000 7fab9f3d8640 1 --2- 172.21.15.19:0/105057248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab9806f8d0 0x7fab98144160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.560+0000 7fab9f3d8640 1 -- 172.21.15.19:0/105057248 >> 172.21.15.19:0/105057248 conn(0x7fab98067d70 msgr2=0x7fab980af9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:40.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.560+0000 7fab9f3d8640 1 -- 172.21.15.19:0/105057248 shutdown_connections 2024-09-12T01:58:40.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.560+0000 7fab9f3d8640 1 -- 172.21.15.19:0/105057248 wait complete. 2024-09-12T01:58:40.572 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T01:58:40.572 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:58:40.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.674+0000 7fe309723640 1 Processor -- start 2024-09-12T01:58:40.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.674+0000 7fe309723640 1 -- start start 2024-09-12T01:58:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.674+0000 7fe309723640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe304162060 0x7fe3040b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.674+0000 7fe309723640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3040b64b0 0x7fe3040b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.674+0000 7fe309723640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe30406d9f0 con 0x7fe304161c80 2024-09-12T01:58:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.674+0000 7fe309723640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe30406dcd0 con 0x7fe304162060 2024-09-12T01:58:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.674+0000 7fe309723640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe30406dfb0 con 0x7fe3040b64b0 2024-09-12T01:58:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe302ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe304161c80 0x7fe30406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38398/0 (socket says 172.21.15.19:38398) 2024-09-12T01:58:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe302ffd640 1 -- 172.21.15.19:0/34394753 learned_addr learned my addr 172.21.15.19:0/34394753 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe3037fe640 1 --2- 172.21.15.19:0/34394753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3040b64b0 0x7fe3040b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe2fbfff640 1 --2- 172.21.15.19:0/34394753 >> v2:172.21.15.135:3300/0 conn(0x7fe304162060 0x7fe3040b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe3027fc640 1 -- 172.21.15.19:0/34394753 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3983882267 0 0) 0x7fe30406d9f0 con 0x7fe304161c80 2024-09-12T01:58:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe3027fc640 1 -- 172.21.15.19:0/34394753 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2f0003520 con 0x7fe304161c80 2024-09-12T01:58:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe3027fc640 1 -- 172.21.15.19:0/34394753 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 956210274 0 0) 0x7fe2f0003520 con 0x7fe304161c80 2024-09-12T01:58:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe3027fc640 1 -- 172.21.15.19:0/34394753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3040b64b0 msgr2=0x7fe3040b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe3027fc640 1 --2- 172.21.15.19:0/34394753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3040b64b0 0x7fe3040b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe3027fc640 1 -- 172.21.15.19:0/34394753 >> v2:172.21.15.135:3300/0 conn(0x7fe304162060 msgr2=0x7fe3040b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe3027fc640 1 --2- 172.21.15.19:0/34394753 >> v2:172.21.15.135:3300/0 conn(0x7fe304162060 0x7fe3040b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe3027fc640 1 -- 172.21.15.19:0/34394753 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3040d01f0 con 0x7fe304161c80 2024-09-12T01:58:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe3027fc640 1 -- 172.21.15.19:0/34394753 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fe2f4001670 con 0x7fe304161c80 2024-09-12T01:58:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe3027fc640 1 -- 172.21.15.19:0/34394753 >> v1:172.21.15.19:6789/0 conn(0x7fe304161c80 legacy=0x7fe30406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe3027fc640 1 --2- 172.21.15.19:0/34394753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2f00039b0 0x7fe2f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe3027fc640 1 --2- 172.21.15.19:0/34394753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3040b64b0 0x7fe2f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe3027fc640 1 --2- 172.21.15.19:0/34394753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2f0004d40 0x7fe2f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe3027fc640 1 -- 172.21.15.19:0/34394753 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe30406dcd0 con 0x7fe2f0004d40 2024-09-12T01:58:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe3027fc640 1 -- 172.21.15.19:0/34394753 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe30406dfb0 con 0x7fe2f00039b0 2024-09-12T01:58:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe3027fc640 1 -- 172.21.15.19:0/34394753 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f000b9c0 con 0x7fe3040b64b0 2024-09-12T01:58:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe3037fe640 1 --2- 172.21.15.19:0/34394753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2f0004d40 0x7fe2f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.675+0000 7fe302ffd640 1 --2- 172.21.15.19:0/34394753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2f00039b0 0x7fe2f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.676+0000 7fe2fbfff640 1 --2- 172.21.15.19:0/34394753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3040b64b0 0x7fe2f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.676+0000 7fe3037fe640 1 -- 172.21.15.19:0/34394753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3040b64b0 msgr2=0x7fe2f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.676+0000 7fe3037fe640 1 --2- 172.21.15.19:0/34394753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3040b64b0 0x7fe2f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.676+0000 7fe3037fe640 1 -- 172.21.15.19:0/34394753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2f00039b0 msgr2=0x7fe2f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.676+0000 7fe3037fe640 1 --2- 172.21.15.19:0/34394753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2f00039b0 0x7fe2f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.676+0000 7fe3037fe640 1 -- 172.21.15.19:0/34394753 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f0003520 con 0x7fe2f0004d40 2024-09-12T01:58:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.676+0000 7fe3037fe640 1 --2- 172.21.15.19:0/34394753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2f0004d40 0x7fe2f00051c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00e170 tx=0x7fe2f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b0e93bca7e9154 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.677+0000 7fe3027fc640 1 -- 172.21.15.19:0/34394753 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc034020 con 0x7fe2f0004d40 2024-09-12T01:58:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.677+0000 7fe3027fc640 1 -- 172.21.15.19:0/34394753 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2fc0305f0 con 0x7fe2f0004d40 2024-09-12T01:58:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.677+0000 7fe3027fc640 1 -- 172.21.15.19:0/34394753 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc009c10 con 0x7fe2f0004d40 2024-09-12T01:58:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.677+0000 7fe309723640 1 -- 172.21.15.19:0/34394753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2f0004d40 msgr2=0x7fe2f00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.677+0000 7fe309723640 1 --2- 172.21.15.19:0/34394753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2f0004d40 0x7fe2f00051c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00e170 tx=0x7fe2f0005830 comp rx=0 tx=0).stop 2024-09-12T01:58:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.677+0000 7fe3037fe640 1 -- 172.21.15.19:0/34394753 reap_dead start 2024-09-12T01:58:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.677+0000 7fe309723640 1 -- 172.21.15.19:0/34394753 shutdown_connections 2024-09-12T01:58:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.677+0000 7fe309723640 1 -- 172.21.15.19:0/34394753 >> 172.21.15.19:0/34394753 conn(0x7fe3040d44f0 msgr2=0x7fe3040d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.677+0000 7fe309723640 1 -- 172.21.15.19:0/34394753 shutdown_connections 2024-09-12T01:58:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.677+0000 7fe309723640 1 -- 172.21.15.19:0/34394753 wait complete. 2024-09-12T01:58:40.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.678+0000 7fe309723640 1 Processor -- start 2024-09-12T01:58:40.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.678+0000 7fe309723640 1 -- start start 2024-09-12T01:58:40.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.679+0000 7fe309723640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe304159840 0x7fe3040cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:40.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.679+0000 7fe309723640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3040cc2f0 0x7fe3040b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:40.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.679+0000 7fe309723640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe304159c20 0x7fe3040b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:40.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.679+0000 7fe309723640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe3040b6960 con 0x7fe304159c20 2024-09-12T01:58:40.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.679+0000 7fe309723640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe3040d2aa0 con 0x7fe3040cc2f0 2024-09-12T01:58:40.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.679+0000 7fe309723640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe3040b6ae0 con 0x7fe304159840 2024-09-12T01:58:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.679+0000 7fe3037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe304159c20 0x7fe3040b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.679+0000 7fe3037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe304159c20 0x7fe3040b25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36042/0 (socket says 172.21.15.19:36042) 2024-09-12T01:58:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.679+0000 7fe3037fe640 1 -- 172.21.15.19:0/4056063299 learned_addr learned my addr 172.21.15.19:0/4056063299 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.679+0000 7fe302ffd640 1 --2- 172.21.15.19:0/4056063299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe304159840 0x7fe3040cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.679+0000 7fe2fbfff640 1 --2- 172.21.15.19:0/4056063299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3040cc2f0 0x7fe3040b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.680+0000 7fe3037fe640 1 -- 172.21.15.19:0/4056063299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe304159840 msgr2=0x7fe3040cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.680+0000 7fe3037fe640 1 --2- 172.21.15.19:0/4056063299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe304159840 0x7fe3040cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.680+0000 7fe3037fe640 1 -- 172.21.15.19:0/4056063299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3040cc2f0 msgr2=0x7fe3040b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.680+0000 7fe3037fe640 1 --2- 172.21.15.19:0/4056063299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3040cc2f0 0x7fe3040b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.680+0000 7fe3037fe640 1 -- 172.21.15.19:0/4056063299 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3040cc830 con 0x7fe304159c20 2024-09-12T01:58:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.680+0000 7fe3037fe640 1 --2- 172.21.15.19:0/4056063299 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe304159c20 0x7fe3040b25f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009f90 tx=0x7fe2fc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.680+0000 7fe2fb7fe640 1 -- 172.21.15.19:0/4056063299 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc034070 con 0x7fe304159c20 2024-09-12T01:58:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.680+0000 7fe2fb7fe640 1 -- 172.21.15.19:0/4056063299 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2fc003990 con 0x7fe304159c20 2024-09-12T01:58:40.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.680+0000 7fe2fb7fe640 1 -- 172.21.15.19:0/4056063299 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc009c10 con 0x7fe304159c20 2024-09-12T01:58:40.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.680+0000 7fe309723640 1 -- 172.21.15.19:0/4056063299 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3040ccb10 con 0x7fe304159c20 2024-09-12T01:58:40.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.680+0000 7fe309723640 1 -- 172.21.15.19:0/4056063299 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3040b8840 con 0x7fe304159c20 2024-09-12T01:58:40.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.681+0000 7fe309723640 1 -- 172.21.15.19:0/4056063299 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3040b5f70 con 0x7fe304159c20 2024-09-12T01:58:40.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.682+0000 7fe2fb7fe640 1 -- 172.21.15.19:0/4056063299 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe2fc037020 con 0x7fe304159c20 2024-09-12T01:58:40.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.682+0000 7fe2fb7fe640 1 --2- 172.21.15.19:0/4056063299 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe2e406be60 0x7fe2e406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:40.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.682+0000 7fe2fb7fe640 1 -- 172.21.15.19:0/4056063299 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6217+0+0 (secure 0 0 0) 0x7fe2fc0ab4a0 con 0x7fe304159c20 2024-09-12T01:58:40.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.682+0000 7fe302ffd640 1 --2- 172.21.15.19:0/4056063299 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe2e406be60 0x7fe2e406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:40.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.683+0000 7fe302ffd640 1 --2- 172.21.15.19:0/4056063299 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe2e406be60 0x7fe2e406e320 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe3040b2c00 tx=0x7fe2f40078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:40.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.686+0000 7fe2fb7fe640 1 -- 172.21.15.19:0/4056063299 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe2fc079570 con 0x7fe304159c20 2024-09-12T01:58:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.861+0000 7fe309723640 1 -- 172.21.15.19:0/4056063299 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe3040b5ad0 con 0x7fe2e406be60 2024-09-12T01:58:40.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.867+0000 7fe2fb7fe640 1 -- 172.21.15.19:0/4056063299 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251758 (secure 0 0 0) 0x7fe3040b5ad0 con 0x7fe2e406be60 2024-09-12T01:58:40.870 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:58:40.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.870+0000 7fe309723640 1 -- 172.21.15.19:0/4056063299 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe2e406be60 msgr2=0x7fe2e406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:40.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.870+0000 7fe309723640 1 --2- 172.21.15.19:0/4056063299 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe2e406be60 0x7fe2e406e320 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe3040b2c00 tx=0x7fe2f40078f0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.870+0000 7fe309723640 1 -- 172.21.15.19:0/4056063299 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe304159c20 msgr2=0x7fe3040b25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.870+0000 7fe309723640 1 --2- 172.21.15.19:0/4056063299 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe304159c20 0x7fe3040b25f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009f90 tx=0x7fe2fc009750 comp rx=0 tx=0).stop 2024-09-12T01:58:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.870+0000 7fe309723640 1 -- 172.21.15.19:0/4056063299 shutdown_connections 2024-09-12T01:58:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.870+0000 7fe309723640 1 --2- 172.21.15.19:0/4056063299 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe2e406be60 0x7fe2e406e320 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.870+0000 7fe309723640 1 --2- 172.21.15.19:0/4056063299 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe304159c20 0x7fe3040b25f0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.870+0000 7fe309723640 1 --2- 172.21.15.19:0/4056063299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3040cc2f0 0x7fe3040b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.870+0000 7fe309723640 1 --2- 172.21.15.19:0/4056063299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe304159840 0x7fe3040cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.870+0000 7fe309723640 1 -- 172.21.15.19:0/4056063299 >> 172.21.15.19:0/4056063299 conn(0x7fe3040d44f0 msgr2=0x7fe304162b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.870+0000 7fe309723640 1 -- 172.21.15.19:0/4056063299 shutdown_connections 2024-09-12T01:58:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:40.870+0000 7fe309723640 1 -- 172.21.15.19:0/4056063299 wait complete. 2024-09-12T01:58:40.881 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-12T01:58:40.122395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231996,"kb_used_data":7436,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742724,"statfs":{"total":773094113280,"available":772856549376,"internally_reserved":0,"allocated":7614464,"data_stored":4080499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.053543"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666882+0000","last_change":"2024-09-12T01:58:32.098775+0000","last_active":"2024-09-12T01:58:33.666882+0000","last_peered":"2024-09-12T01:58:33.666882+0000","last_clean":"2024-09-12T01:58:33.666882+0000","last_became_active":"2024-09-12T01:58:32.098472+0000","last_became_peered":"2024-09-12T01:58:32.098472+0000","last_unstale":"2024-09-12T01:58:33.666882+0000","last_undegraded":"2024-09-12T01:58:33.666882+0000","last_fullsized":"2024-09-12T01:58:33.666882+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:34.058890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666728+0000","last_change":"2024-09-12T01:58:32.092794+0000","last_active":"2024-09-12T01:58:33.666728+0000","last_peered":"2024-09-12T01:58:33.666728+0000","last_clean":"2024-09-12T01:58:33.666728+0000","last_became_active":"2024-09-12T01:58:32.092525+0000","last_became_peered":"2024-09-12T01:58:32.092525+0000","last_unstale":"2024-09-12T01:58:33.666728+0000","last_undegraded":"2024-09-12T01:58:33.666728+0000","last_fullsized":"2024-09-12T01:58:33.666728+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:05.445047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127514+0000","last_change":"2024-09-12T01:58:32.099017+0000","last_active":"2024-09-12T01:58:38.127514+0000","last_peered":"2024-09-12T01:58:38.127514+0000","last_clean":"2024-09-12T01:58:38.127514+0000","last_became_active":"2024-09-12T01:58:32.095848+0000","last_became_peered":"2024-09-12T01:58:32.095848+0000","last_unstale":"2024-09-12T01:58:38.127514+0000","last_undegraded":"2024-09-12T01:58:38.127514+0000","last_fullsized":"2024-09-12T01:58:38.127514+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:50.997517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071261+0000","last_change":"2024-09-12T01:58:32.086522+0000","last_active":"2024-09-12T01:58:33.071261+0000","last_peered":"2024-09-12T01:58:33.071261+0000","last_clean":"2024-09-12T01:58:33.071261+0000","last_became_active":"2024-09-12T01:58:32.086029+0000","last_became_peered":"2024-09-12T01:58:32.086029+0000","last_unstale":"2024-09-12T01:58:33.071261+0000","last_undegraded":"2024-09-12T01:58:33.071261+0000","last_fullsized":"2024-09-12T01:58:33.071261+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:53.481574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T01:58:34.120954+0000","last_change":"2024-09-12T01:58:38.120334+0000","last_active":"2024-09-12T01:58:38.120334+0000","last_peered":"2024-09-12T01:58:34.120954+0000","last_clean":"2024-09-12T01:58:34.120954+0000","last_became_active":"2024-09-12T01:58:32.083847+0000","last_became_peered":"2024-09-12T01:58:32.083847+0000","last_unstale":"2024-09-12T01:58:34.120954+0000","last_undegraded":"2024-09-12T01:58:34.120954+0000","last_fullsized":"2024-09-12T01:58:34.120954+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072181+0000","last_change":"2024-09-12T01:58:32.090868+0000","last_active":"2024-09-12T01:58:33.072181+0000","last_peered":"2024-09-12T01:58:33.072181+0000","last_clean":"2024-09-12T01:58:33.072181+0000","last_became_active":"2024-09-12T01:58:32.090596+0000","last_became_peered":"2024-09-12T01:58:32.090596+0000","last_unstale":"2024-09-12T01:58:33.072181+0000","last_undegraded":"2024-09-12T01:58:33.072181+0000","last_fullsized":"2024-09-12T01:58:33.072181+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:19.012343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.122213+0000","last_change":"2024-09-12T01:58:32.091013+0000","last_active":"2024-09-12T01:58:38.122213+0000","last_peered":"2024-09-12T01:58:38.122213+0000","last_clean":"2024-09-12T01:58:38.122213+0000","last_became_active":"2024-09-12T01:58:32.090711+0000","last_became_peered":"2024-09-12T01:58:32.090711+0000","last_unstale":"2024-09-12T01:58:38.122213+0000","last_undegraded":"2024-09-12T01:58:38.122213+0000","last_fullsized":"2024-09-12T01:58:38.122213+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:42.450557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615856+0000","last_change":"2024-09-12T01:58:32.100103+0000","last_active":"2024-09-12T01:58:38.615856+0000","last_peered":"2024-09-12T01:58:38.615856+0000","last_clean":"2024-09-12T01:58:38.615856+0000","last_became_active":"2024-09-12T01:58:32.099846+0000","last_became_peered":"2024-09-12T01:58:32.099846+0000","last_unstale":"2024-09-12T01:58:38.615856+0000","last_undegraded":"2024-09-12T01:58:38.615856+0000","last_fullsized":"2024-09-12T01:58:38.615856+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:46.632781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127748+0000","last_change":"2024-09-12T01:58:32.099992+0000","last_active":"2024-09-12T01:58:38.127748+0000","last_peered":"2024-09-12T01:58:38.127748+0000","last_clean":"2024-09-12T01:58:38.127748+0000","last_became_active":"2024-09-12T01:58:32.099721+0000","last_became_peered":"2024-09-12T01:58:32.099721+0000","last_unstale":"2024-09-12T01:58:38.127748+0000","last_undegraded":"2024-09-12T01:58:38.127748+0000","last_fullsized":"2024-09-12T01:58:38.127748+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:38.169564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127632+0000","last_change":"2024-09-12T01:58:32.101085+0000","last_active":"2024-09-12T01:58:38.127632+0000","last_peered":"2024-09-12T01:58:38.127632+0000","last_clean":"2024-09-12T01:58:38.127632+0000","last_became_active":"2024-09-12T01:58:32.100128+0000","last_became_peered":"2024-09-12T01:58:32.100128+0000","last_unstale":"2024-09-12T01:58:38.127632+0000","last_undegraded":"2024-09-12T01:58:38.127632+0000","last_fullsized":"2024-09-12T01:58:38.127632+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:02.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071172+0000","last_change":"2024-09-12T01:58:32.093435+0000","last_active":"2024-09-12T01:58:33.071172+0000","last_peered":"2024-09-12T01:58:33.071172+0000","last_clean":"2024-09-12T01:58:33.071172+0000","last_became_active":"2024-09-12T01:58:32.092950+0000","last_became_peered":"2024-09-12T01:58:32.092950+0000","last_unstale":"2024-09-12T01:58:33.071172+0000","last_undegraded":"2024-09-12T01:58:33.071172+0000","last_fullsized":"2024-09-12T01:58:33.071172+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:25.908231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615981+0000","last_change":"2024-09-12T01:58:32.096884+0000","last_active":"2024-09-12T01:58:38.615981+0000","last_peered":"2024-09-12T01:58:38.615981+0000","last_clean":"2024-09-12T01:58:38.615981+0000","last_became_active":"2024-09-12T01:58:32.096608+0000","last_became_peered":"2024-09-12T01:58:32.096608+0000","last_unstale":"2024-09-12T01:58:38.615981+0000","last_undegraded":"2024-09-12T01:58:38.615981+0000","last_fullsized":"2024-09-12T01:58:38.615981+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:50.997517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615968+0000","last_change":"2024-09-12T01:58:32.091527+0000","last_active":"2024-09-12T01:58:38.615968+0000","last_peered":"2024-09-12T01:58:38.615968+0000","last_clean":"2024-09-12T01:58:38.615968+0000","last_became_active":"2024-09-12T01:58:32.090919+0000","last_became_peered":"2024-09-12T01:58:32.090919+0000","last_unstale":"2024-09-12T01:58:38.615968+0000","last_undegraded":"2024-09-12T01:58:38.615968+0000","last_fullsized":"2024-09-12T01:58:38.615968+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:00.209541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127393+0000","last_change":"2024-09-12T01:58:32.099040+0000","last_active":"2024-09-12T01:58:38.127393+0000","last_peered":"2024-09-12T01:58:38.127393+0000","last_clean":"2024-09-12T01:58:38.127393+0000","last_became_active":"2024-09-12T01:58:32.098246+0000","last_became_peered":"2024-09-12T01:58:32.098246+0000","last_unstale":"2024-09-12T01:58:38.127393+0000","last_undegraded":"2024-09-12T01:58:38.127393+0000","last_fullsized":"2024-09-12T01:58:38.127393+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:27.519989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127321+0000","last_change":"2024-09-12T01:58:32.099874+0000","last_active":"2024-09-12T01:58:38.127321+0000","last_peered":"2024-09-12T01:58:38.127321+0000","last_clean":"2024-09-12T01:58:38.127321+0000","last_became_active":"2024-09-12T01:58:32.099591+0000","last_became_peered":"2024-09-12T01:58:32.099591+0000","last_unstale":"2024-09-12T01:58:38.127321+0000","last_undegraded":"2024-09-12T01:58:38.127321+0000","last_fullsized":"2024-09-12T01:58:38.127321+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:00.209541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.122728+0000","last_change":"2024-09-12T01:58:32.092337+0000","last_active":"2024-09-12T01:58:38.122728+0000","last_peered":"2024-09-12T01:58:38.122728+0000","last_clean":"2024-09-12T01:58:38.122728+0000","last_became_active":"2024-09-12T01:58:32.091794+0000","last_became_peered":"2024-09-12T01:58:32.091794+0000","last_unstale":"2024-09-12T01:58:38.122728+0000","last_undegraded":"2024-09-12T01:58:38.122728+0000","last_fullsized":"2024-09-12T01:58:38.122728+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:32.941238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666916+0000","last_change":"2024-09-12T01:58:32.099798+0000","last_active":"2024-09-12T01:58:33.666916+0000","last_peered":"2024-09-12T01:58:33.666916+0000","last_clean":"2024-09-12T01:58:33.666916+0000","last_became_active":"2024-09-12T01:58:32.099440+0000","last_became_peered":"2024-09-12T01:58:32.099440+0000","last_unstale":"2024-09-12T01:58:33.666916+0000","last_undegraded":"2024-09-12T01:58:33.666916+0000","last_fullsized":"2024-09-12T01:58:33.666916+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:53.552573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071740+0000","last_change":"2024-09-12T01:58:32.086299+0000","last_active":"2024-09-12T01:58:33.071740+0000","last_peered":"2024-09-12T01:58:33.071740+0000","last_clean":"2024-09-12T01:58:33.071740+0000","last_became_active":"2024-09-12T01:58:32.085968+0000","last_became_peered":"2024-09-12T01:58:32.085968+0000","last_unstale":"2024-09-12T01:58:33.071740+0000","last_undegraded":"2024-09-12T01:58:33.071740+0000","last_fullsized":"2024-09-12T01:58:33.071740+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:55.745348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.121003+0000","last_change":"2024-09-12T01:58:32.089146+0000","last_active":"2024-09-12T01:58:38.121003+0000","last_peered":"2024-09-12T01:58:38.121003+0000","last_clean":"2024-09-12T01:58:38.121003+0000","last_became_active":"2024-09-12T01:58:32.088503+0000","last_became_peered":"2024-09-12T01:58:32.088503+0000","last_unstale":"2024-09-12T01:58:38.121003+0000","last_undegraded":"2024-09-12T01:58:38.121003+0000","last_fullsized":"2024-09-12T01:58:38.121003+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:06.577465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915709+0000","last_change":"2024-09-12T01:58:32.089658+0000","last_active":"2024-09-12T01:58:33.915709+0000","last_peered":"2024-09-12T01:58:33.915709+0000","last_clean":"2024-09-12T01:58:33.915709+0000","last_became_active":"2024-09-12T01:58:32.089374+0000","last_became_peered":"2024-09-12T01:58:32.089374+0000","last_unstale":"2024-09-12T01:58:33.915709+0000","last_undegraded":"2024-09-12T01:58:33.915709+0000","last_fullsized":"2024-09-12T01:58:33.915709+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:31.386141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616083+0000","last_change":"2024-09-12T01:58:32.097896+0000","last_active":"2024-09-12T01:58:38.616083+0000","last_peered":"2024-09-12T01:58:38.616083+0000","last_clean":"2024-09-12T01:58:38.616083+0000","last_became_active":"2024-09-12T01:58:32.097631+0000","last_became_peered":"2024-09-12T01:58:32.097631+0000","last_unstale":"2024-09-12T01:58:38.616083+0000","last_undegraded":"2024-09-12T01:58:38.616083+0000","last_fullsized":"2024-09-12T01:58:38.616083+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:38.169564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915664+0000","last_change":"2024-09-12T01:58:32.091442+0000","last_active":"2024-09-12T01:58:33.915664+0000","last_peered":"2024-09-12T01:58:33.915664+0000","last_clean":"2024-09-12T01:58:33.915664+0000","last_became_active":"2024-09-12T01:58:32.091113+0000","last_became_peered":"2024-09-12T01:58:32.091113+0000","last_unstale":"2024-09-12T01:58:33.915664+0000","last_undegraded":"2024-09-12T01:58:33.915664+0000","last_fullsized":"2024-09-12T01:58:33.915664+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:42.748051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915663+0000","last_change":"2024-09-12T01:58:32.090771+0000","last_active":"2024-09-12T01:58:33.915663+0000","last_peered":"2024-09-12T01:58:33.915663+0000","last_clean":"2024-09-12T01:58:33.915663+0000","last_became_active":"2024-09-12T01:58:32.090506+0000","last_became_peered":"2024-09-12T01:58:32.090506+0000","last_unstale":"2024-09-12T01:58:33.915663+0000","last_undegraded":"2024-09-12T01:58:33.915663+0000","last_fullsized":"2024-09-12T01:58:33.915663+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:57.559803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127749+0000","last_change":"2024-09-12T01:58:32.095936+0000","last_active":"2024-09-12T01:58:38.127749+0000","last_peered":"2024-09-12T01:58:38.127749+0000","last_clean":"2024-09-12T01:58:38.127749+0000","last_became_active":"2024-09-12T01:58:32.095625+0000","last_became_peered":"2024-09-12T01:58:32.095625+0000","last_unstale":"2024-09-12T01:58:38.127749+0000","last_undegraded":"2024-09-12T01:58:38.127749+0000","last_fullsized":"2024-09-12T01:58:38.127749+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:59.477648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616166+0000","last_change":"2024-09-12T01:58:32.094671+0000","last_active":"2024-09-12T01:58:38.616166+0000","last_peered":"2024-09-12T01:58:38.616166+0000","last_clean":"2024-09-12T01:58:38.616166+0000","last_became_active":"2024-09-12T01:58:32.093934+0000","last_became_peered":"2024-09-12T01:58:32.093934+0000","last_unstale":"2024-09-12T01:58:38.616166+0000","last_undegraded":"2024-09-12T01:58:38.616166+0000","last_fullsized":"2024-09-12T01:58:38.616166+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:15.459156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616162+0000","last_change":"2024-09-12T01:58:32.094546+0000","last_active":"2024-09-12T01:58:38.616162+0000","last_peered":"2024-09-12T01:58:38.616162+0000","last_clean":"2024-09-12T01:58:38.616162+0000","last_became_active":"2024-09-12T01:58:32.094242+0000","last_became_peered":"2024-09-12T01:58:32.094242+0000","last_unstale":"2024-09-12T01:58:38.616162+0000","last_undegraded":"2024-09-12T01:58:38.616162+0000","last_fullsized":"2024-09-12T01:58:38.616162+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:24.307268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071322+0000","last_change":"2024-09-12T01:58:32.088553+0000","last_active":"2024-09-12T01:58:33.071322+0000","last_peered":"2024-09-12T01:58:33.071322+0000","last_clean":"2024-09-12T01:58:33.071322+0000","last_became_active":"2024-09-12T01:58:32.087827+0000","last_became_peered":"2024-09-12T01:58:32.087827+0000","last_unstale":"2024-09-12T01:58:33.071322+0000","last_undegraded":"2024-09-12T01:58:33.071322+0000","last_fullsized":"2024-09-12T01:58:33.071322+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:12.553586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666813+0000","last_change":"2024-09-12T01:58:32.095548+0000","last_active":"2024-09-12T01:58:33.666813+0000","last_peered":"2024-09-12T01:58:33.666813+0000","last_clean":"2024-09-12T01:58:33.666813+0000","last_became_active":"2024-09-12T01:58:32.094714+0000","last_became_peered":"2024-09-12T01:58:32.094714+0000","last_unstale":"2024-09-12T01:58:33.666813+0000","last_undegraded":"2024-09-12T01:58:33.666813+0000","last_fullsized":"2024-09-12T01:58:33.666813+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:52.686475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127402+0000","last_change":"2024-09-12T01:58:32.089782+0000","last_active":"2024-09-12T01:58:38.127402+0000","last_peered":"2024-09-12T01:58:38.127402+0000","last_clean":"2024-09-12T01:58:38.127402+0000","last_became_active":"2024-09-12T01:58:32.089548+0000","last_became_peered":"2024-09-12T01:58:32.089548+0000","last_unstale":"2024-09-12T01:58:38.127402+0000","last_undegraded":"2024-09-12T01:58:38.127402+0000","last_fullsized":"2024-09-12T01:58:38.127402+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.413296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615869+0000","last_change":"2024-09-12T01:58:32.099407+0000","last_active":"2024-09-12T01:58:38.615869+0000","last_peered":"2024-09-12T01:58:38.615869+0000","last_clean":"2024-09-12T01:58:38.615869+0000","last_became_active":"2024-09-12T01:58:32.099119+0000","last_became_peered":"2024-09-12T01:58:32.099119+0000","last_unstale":"2024-09-12T01:58:38.615869+0000","last_undegraded":"2024-09-12T01:58:38.615869+0000","last_fullsized":"2024-09-12T01:58:38.615869+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:45.710198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071526+0000","last_change":"2024-09-12T01:58:32.088560+0000","last_active":"2024-09-12T01:58:33.071526+0000","last_peered":"2024-09-12T01:58:33.071526+0000","last_clean":"2024-09-12T01:58:33.071526+0000","last_became_active":"2024-09-12T01:58:32.088317+0000","last_became_peered":"2024-09-12T01:58:32.088317+0000","last_unstale":"2024-09-12T01:58:33.071526+0000","last_undegraded":"2024-09-12T01:58:33.071526+0000","last_fullsized":"2024-09-12T01:58:33.071526+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:06.911951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071936+0000","last_change":"2024-09-12T01:58:32.085708+0000","last_active":"2024-09-12T01:58:33.071936+0000","last_peered":"2024-09-12T01:58:33.071936+0000","last_clean":"2024-09-12T01:58:33.071936+0000","last_became_active":"2024-09-12T01:58:32.085394+0000","last_became_peered":"2024-09-12T01:58:32.085394+0000","last_unstale":"2024-09-12T01:58:33.071936+0000","last_undegraded":"2024-09-12T01:58:33.071936+0000","last_fullsized":"2024-09-12T01:58:33.071936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:02.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.120111+0000","last_change":"2024-09-12T01:58:32.096958+0000","last_active":"2024-09-12T01:58:38.120111+0000","last_peered":"2024-09-12T01:58:38.120111+0000","last_clean":"2024-09-12T01:58:38.120111+0000","last_became_active":"2024-09-12T01:58:32.096288+0000","last_became_peered":"2024-09-12T01:58:32.096288+0000","last_unstale":"2024-09-12T01:58:38.120111+0000","last_undegraded":"2024-09-12T01:58:38.120111+0000","last_fullsized":"2024-09-12T01:58:38.120111+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:51.645585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"65'4","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666944+0000","last_change":"2024-09-12T01:58:31.085572+0000","last_active":"2024-09-12T01:58:33.666944+0000","last_peered":"2024-09-12T01:58:33.666944+0000","last_clean":"2024-09-12T01:58:33.666944+0000","last_became_active":"2024-09-12T01:58:31.085308+0000","last_became_peered":"2024-09-12T01:58:31.085308+0000","last_unstale":"2024-09-12T01:58:33.666944+0000","last_undegraded":"2024-09-12T01:58:33.666944+0000","last_fullsized":"2024-09-12T01:58:33.666944+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:47.308955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071403+0000","last_change":"2024-09-12T01:58:32.093055+0000","last_active":"2024-09-12T01:58:33.071403+0000","last_peered":"2024-09-12T01:58:33.071403+0000","last_clean":"2024-09-12T01:58:33.071403+0000","last_became_active":"2024-09-12T01:58:32.092801+0000","last_became_peered":"2024-09-12T01:58:32.092801+0000","last_unstale":"2024-09-12T01:58:33.071403+0000","last_undegraded":"2024-09-12T01:58:33.071403+0000","last_fullsized":"2024-09-12T01:58:33.071403+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:27.155936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072473+0000","last_change":"2024-09-12T01:58:31.082993+0000","last_active":"2024-09-12T01:58:33.072473+0000","last_peered":"2024-09-12T01:58:33.072473+0000","last_clean":"2024-09-12T01:58:33.072473+0000","last_became_active":"2024-09-12T01:58:31.082679+0000","last_became_peered":"2024-09-12T01:58:31.082679+0000","last_unstale":"2024-09-12T01:58:33.072473+0000","last_undegraded":"2024-09-12T01:58:33.072473+0000","last_fullsized":"2024-09-12T01:58:33.072473+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:16.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072371+0000","last_change":"2024-09-12T01:58:32.078918+0000","last_active":"2024-09-12T01:58:33.072371+0000","last_peered":"2024-09-12T01:58:33.072371+0000","last_clean":"2024-09-12T01:58:33.072371+0000","last_became_active":"2024-09-12T01:58:32.078659+0000","last_became_peered":"2024-09-12T01:58:32.078659+0000","last_unstale":"2024-09-12T01:58:33.072371+0000","last_undegraded":"2024-09-12T01:58:33.072371+0000","last_fullsized":"2024-09-12T01:58:33.072371+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:02.012816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072329+0000","last_change":"2024-09-12T01:58:31.085752+0000","last_active":"2024-09-12T01:58:33.072329+0000","last_peered":"2024-09-12T01:58:33.072329+0000","last_clean":"2024-09-12T01:58:33.072329+0000","last_became_active":"2024-09-12T01:58:31.085456+0000","last_became_peered":"2024-09-12T01:58:31.085456+0000","last_unstale":"2024-09-12T01:58:33.072329+0000","last_undegraded":"2024-09-12T01:58:33.072329+0000","last_fullsized":"2024-09-12T01:58:33.072329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:44.704921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127603+0000","last_change":"2024-09-12T01:58:32.098820+0000","last_active":"2024-09-12T01:58:38.127603+0000","last_peered":"2024-09-12T01:58:38.127603+0000","last_clean":"2024-09-12T01:58:38.127603+0000","last_became_active":"2024-09-12T01:58:32.098562+0000","last_became_peered":"2024-09-12T01:58:32.098562+0000","last_unstale":"2024-09-12T01:58:38.127603+0000","last_undegraded":"2024-09-12T01:58:38.127603+0000","last_fullsized":"2024-09-12T01:58:38.127603+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:15.459156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072133+0000","last_change":"2024-09-12T01:58:31.082135+0000","last_active":"2024-09-12T01:58:33.072133+0000","last_peered":"2024-09-12T01:58:33.072133+0000","last_clean":"2024-09-12T01:58:33.072133+0000","last_became_active":"2024-09-12T01:58:31.081834+0000","last_became_peered":"2024-09-12T01:58:31.081834+0000","last_unstale":"2024-09-12T01:58:33.072133+0000","last_undegraded":"2024-09-12T01:58:33.072133+0000","last_fullsized":"2024-09-12T01:58:33.072133+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:59.204264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.122155+0000","last_change":"2024-09-12T01:58:32.092057+0000","last_active":"2024-09-12T01:58:38.122155+0000","last_peered":"2024-09-12T01:58:38.122155+0000","last_clean":"2024-09-12T01:58:38.122155+0000","last_became_active":"2024-09-12T01:58:32.091372+0000","last_became_peered":"2024-09-12T01:58:32.091372+0000","last_unstale":"2024-09-12T01:58:38.122155+0000","last_undegraded":"2024-09-12T01:58:38.122155+0000","last_fullsized":"2024-09-12T01:58:38.122155+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:50.595958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915799+0000","last_change":"2024-09-12T01:58:31.085302+0000","last_active":"2024-09-12T01:58:33.915799+0000","last_peered":"2024-09-12T01:58:33.915799+0000","last_clean":"2024-09-12T01:58:33.915799+0000","last_became_active":"2024-09-12T01:58:31.084995+0000","last_became_peered":"2024-09-12T01:58:31.084995+0000","last_unstale":"2024-09-12T01:58:33.915799+0000","last_undegraded":"2024-09-12T01:58:33.915799+0000","last_fullsized":"2024-09-12T01:58:33.915799+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:18.228685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666540+0000","last_change":"2024-09-12T01:58:32.099965+0000","last_active":"2024-09-12T01:58:33.666540+0000","last_peered":"2024-09-12T01:58:33.666540+0000","last_clean":"2024-09-12T01:58:33.666540+0000","last_became_active":"2024-09-12T01:58:32.099518+0000","last_became_peered":"2024-09-12T01:58:32.099518+0000","last_unstale":"2024-09-12T01:58:33.666540+0000","last_undegraded":"2024-09-12T01:58:33.666540+0000","last_fullsized":"2024-09-12T01:58:33.666540+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:55.745348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915580+0000","last_change":"2024-09-12T01:58:31.086015+0000","last_active":"2024-09-12T01:58:33.915580+0000","last_peered":"2024-09-12T01:58:33.915580+0000","last_clean":"2024-09-12T01:58:33.915580+0000","last_became_active":"2024-09-12T01:58:31.085736+0000","last_became_peered":"2024-09-12T01:58:31.085736+0000","last_unstale":"2024-09-12T01:58:33.915580+0000","last_undegraded":"2024-09-12T01:58:33.915580+0000","last_fullsized":"2024-09-12T01:58:33.915580+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:58.281292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.121032+0000","last_change":"2024-09-12T01:58:32.092252+0000","last_active":"2024-09-12T01:58:38.121032+0000","last_peered":"2024-09-12T01:58:38.121032+0000","last_clean":"2024-09-12T01:58:38.121032+0000","last_became_active":"2024-09-12T01:58:32.091933+0000","last_became_peered":"2024-09-12T01:58:32.091933+0000","last_unstale":"2024-09-12T01:58:38.121032+0000","last_undegraded":"2024-09-12T01:58:38.121032+0000","last_fullsized":"2024-09-12T01:58:38.121032+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:20.410580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915595+0000","last_change":"2024-09-12T01:58:31.078913+0000","last_active":"2024-09-12T01:58:33.915595+0000","last_peered":"2024-09-12T01:58:33.915595+0000","last_clean":"2024-09-12T01:58:33.915595+0000","last_became_active":"2024-09-12T01:58:31.078594+0000","last_became_peered":"2024-09-12T01:58:31.078594+0000","last_unstale":"2024-09-12T01:58:33.915595+0000","last_undegraded":"2024-09-12T01:58:33.915595+0000","last_fullsized":"2024-09-12T01:58:33.915595+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:32.332146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915900+0000","last_change":"2024-09-12T01:58:32.082690+0000","last_active":"2024-09-12T01:58:33.915900+0000","last_peered":"2024-09-12T01:58:33.915900+0000","last_clean":"2024-09-12T01:58:33.915900+0000","last_became_active":"2024-09-12T01:58:32.082372+0000","last_became_peered":"2024-09-12T01:58:32.082372+0000","last_unstale":"2024-09-12T01:58:33.915900+0000","last_undegraded":"2024-09-12T01:58:33.915900+0000","last_fullsized":"2024-09-12T01:58:33.915900+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:13.919476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.119793+0000","last_change":"2024-09-12T01:58:31.084452+0000","last_active":"2024-09-12T01:58:38.119793+0000","last_peered":"2024-09-12T01:58:38.119793+0000","last_clean":"2024-09-12T01:58:38.119793+0000","last_became_active":"2024-09-12T01:58:31.084091+0000","last_became_peered":"2024-09-12T01:58:31.084091+0000","last_unstale":"2024-09-12T01:58:38.119793+0000","last_undegraded":"2024-09-12T01:58:38.119793+0000","last_fullsized":"2024-09-12T01:58:38.119793+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:02.589355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666914+0000","last_change":"2024-09-12T01:58:32.095478+0000","last_active":"2024-09-12T01:58:33.666914+0000","last_peered":"2024-09-12T01:58:33.666914+0000","last_clean":"2024-09-12T01:58:33.666914+0000","last_became_active":"2024-09-12T01:58:32.094996+0000","last_became_peered":"2024-09-12T01:58:32.094996+0000","last_unstale":"2024-09-12T01:58:33.666914+0000","last_undegraded":"2024-09-12T01:58:33.666914+0000","last_fullsized":"2024-09-12T01:58:33.666914+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:15.825443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127848+0000","last_change":"2024-09-12T01:58:31.091023+0000","last_active":"2024-09-12T01:58:38.127848+0000","last_peered":"2024-09-12T01:58:38.127848+0000","last_clean":"2024-09-12T01:58:38.127848+0000","last_became_active":"2024-09-12T01:58:31.090814+0000","last_became_peered":"2024-09-12T01:58:31.090814+0000","last_unstale":"2024-09-12T01:58:38.127848+0000","last_undegraded":"2024-09-12T01:58:38.127848+0000","last_fullsized":"2024-09-12T01:58:38.127848+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:13.812313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915828+0000","last_change":"2024-09-12T01:58:32.093516+0000","last_active":"2024-09-12T01:58:33.915828+0000","last_peered":"2024-09-12T01:58:33.915828+0000","last_clean":"2024-09-12T01:58:33.915828+0000","last_became_active":"2024-09-12T01:58:32.093213+0000","last_became_peered":"2024-09-12T01:58:32.093213+0000","last_unstale":"2024-09-12T01:58:33.915828+0000","last_undegraded":"2024-09-12T01:58:33.915828+0000","last_fullsized":"2024-09-12T01:58:33.915828+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:23.467846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071892+0000","last_change":"2024-09-12T01:58:31.076858+0000","last_active":"2024-09-12T01:58:33.071892+0000","last_peered":"2024-09-12T01:58:33.071892+0000","last_clean":"2024-09-12T01:58:33.071892+0000","last_became_active":"2024-09-12T01:58:31.076593+0000","last_became_peered":"2024-09-12T01:58:31.076593+0000","last_unstale":"2024-09-12T01:58:33.071892+0000","last_undegraded":"2024-09-12T01:58:33.071892+0000","last_fullsized":"2024-09-12T01:58:33.071892+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:30.358255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.120631+0000","last_change":"2024-09-12T01:58:32.096897+0000","last_active":"2024-09-12T01:58:38.120631+0000","last_peered":"2024-09-12T01:58:38.120631+0000","last_clean":"2024-09-12T01:58:38.120631+0000","last_became_active":"2024-09-12T01:58:32.095734+0000","last_became_peered":"2024-09-12T01:58:32.095734+0000","last_unstale":"2024-09-12T01:58:38.120631+0000","last_undegraded":"2024-09-12T01:58:38.120631+0000","last_fullsized":"2024-09-12T01:58:38.120631+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:58.521341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"65'3","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127537+0000","last_change":"2024-09-12T01:58:31.085278+0000","last_active":"2024-09-12T01:58:38.127537+0000","last_peered":"2024-09-12T01:58:38.127537+0000","last_clean":"2024-09-12T01:58:38.127537+0000","last_became_active":"2024-09-12T01:58:31.084951+0000","last_became_peered":"2024-09-12T01:58:31.084951+0000","last_unstale":"2024-09-12T01:58:38.127537+0000","last_undegraded":"2024-09-12T01:58:38.127537+0000","last_fullsized":"2024-09-12T01:58:38.127537+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:41.804439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.070832+0000","last_change":"2024-09-12T01:58:32.086718+0000","last_active":"2024-09-12T01:58:33.070832+0000","last_peered":"2024-09-12T01:58:33.070832+0000","last_clean":"2024-09-12T01:58:33.070832+0000","last_became_active":"2024-09-12T01:58:32.086444+0000","last_became_peered":"2024-09-12T01:58:32.086444+0000","last_unstale":"2024-09-12T01:58:33.070832+0000","last_undegraded":"2024-09-12T01:58:33.070832+0000","last_fullsized":"2024-09-12T01:58:33.070832+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:13.252384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"65'6","reported_seq":20,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666897+0000","last_change":"2024-09-12T01:58:31.079583+0000","last_active":"2024-09-12T01:58:33.666897+0000","last_peered":"2024-09-12T01:58:33.666897+0000","last_clean":"2024-09-12T01:58:33.666897+0000","last_became_active":"2024-09-12T01:58:31.079317+0000","last_became_peered":"2024-09-12T01:58:31.079317+0000","last_unstale":"2024-09-12T01:58:33.666897+0000","last_undegraded":"2024-09-12T01:58:33.666897+0000","last_fullsized":"2024-09-12T01:58:33.666897+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:33.047976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071905+0000","last_change":"2024-09-12T01:58:32.097734+0000","last_active":"2024-09-12T01:58:33.071905+0000","last_peered":"2024-09-12T01:58:33.071905+0000","last_clean":"2024-09-12T01:58:33.071905+0000","last_became_active":"2024-09-12T01:58:32.095245+0000","last_became_peered":"2024-09-12T01:58:32.095245+0000","last_unstale":"2024-09-12T01:58:33.071905+0000","last_undegraded":"2024-09-12T01:58:33.071905+0000","last_fullsized":"2024-09-12T01:58:33.071905+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:13.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"65'2","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127434+0000","last_change":"2024-09-12T01:58:31.085938+0000","last_active":"2024-09-12T01:58:38.127434+0000","last_peered":"2024-09-12T01:58:38.127434+0000","last_clean":"2024-09-12T01:58:38.127434+0000","last_became_active":"2024-09-12T01:58:31.085635+0000","last_became_peered":"2024-09-12T01:58:31.085635+0000","last_unstale":"2024-09-12T01:58:38.127434+0000","last_undegraded":"2024-09-12T01:58:38.127434+0000","last_fullsized":"2024-09-12T01:58:38.127434+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:39.540230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615859+0000","last_change":"2024-09-12T01:58:32.093963+0000","last_active":"2024-09-12T01:58:38.615859+0000","last_peered":"2024-09-12T01:58:38.615859+0000","last_clean":"2024-09-12T01:58:38.615859+0000","last_became_active":"2024-09-12T01:58:32.093588+0000","last_became_peered":"2024-09-12T01:58:32.093588+0000","last_unstale":"2024-09-12T01:58:38.615859+0000","last_undegraded":"2024-09-12T01:58:38.615859+0000","last_fullsized":"2024-09-12T01:58:38.615859+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:59.477648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615888+0000","last_change":"2024-09-12T01:58:31.083496+0000","last_active":"2024-09-12T01:58:38.615888+0000","last_peered":"2024-09-12T01:58:38.615888+0000","last_clean":"2024-09-12T01:58:38.615888+0000","last_became_active":"2024-09-12T01:58:31.083282+0000","last_became_peered":"2024-09-12T01:58:31.083282+0000","last_unstale":"2024-09-12T01:58:38.615888+0000","last_undegraded":"2024-09-12T01:58:38.615888+0000","last_fullsized":"2024-09-12T01:58:38.615888+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:39.540230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.121073+0000","last_change":"2024-09-12T01:58:32.085515+0000","last_active":"2024-09-12T01:58:38.121073+0000","last_peered":"2024-09-12T01:58:38.121073+0000","last_clean":"2024-09-12T01:58:38.121073+0000","last_became_active":"2024-09-12T01:58:32.085180+0000","last_became_peered":"2024-09-12T01:58:32.085180+0000","last_unstale":"2024-09-12T01:58:38.121073+0000","last_undegraded":"2024-09-12T01:58:38.121073+0000","last_fullsized":"2024-09-12T01:58:38.121073+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:46.112207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127552+0000","last_change":"2024-09-12T01:58:31.085595+0000","last_active":"2024-09-12T01:58:38.127552+0000","last_peered":"2024-09-12T01:58:38.127552+0000","last_clean":"2024-09-12T01:58:38.127552+0000","last_became_active":"2024-09-12T01:58:31.085333+0000","last_became_peered":"2024-09-12T01:58:31.085333+0000","last_unstale":"2024-09-12T01:58:38.127552+0000","last_undegraded":"2024-09-12T01:58:38.127552+0000","last_fullsized":"2024-09-12T01:58:38.127552+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:47.588497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666733+0000","last_change":"2024-09-12T01:58:32.101742+0000","last_active":"2024-09-12T01:58:33.666733+0000","last_peered":"2024-09-12T01:58:33.666733+0000","last_clean":"2024-09-12T01:58:33.666733+0000","last_became_active":"2024-09-12T01:58:32.100985+0000","last_became_peered":"2024-09-12T01:58:32.100985+0000","last_unstale":"2024-09-12T01:58:33.666733+0000","last_undegraded":"2024-09-12T01:58:33.666733+0000","last_fullsized":"2024-09-12T01:58:33.666733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:13.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"65'8","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071852+0000","last_change":"2024-09-12T01:58:31.080233+0000","last_active":"2024-09-12T01:58:33.071852+0000","last_peered":"2024-09-12T01:58:33.071852+0000","last_clean":"2024-09-12T01:58:33.071852+0000","last_became_active":"2024-09-12T01:58:31.079923+0000","last_became_peered":"2024-09-12T01:58:31.079923+0000","last_unstale":"2024-09-12T01:58:33.071852+0000","last_undegraded":"2024-09-12T01:58:33.071852+0000","last_fullsized":"2024-09-12T01:58:33.071852+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:18.045768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127654+0000","last_change":"2024-09-12T01:58:32.095870+0000","last_active":"2024-09-12T01:58:38.127654+0000","last_peered":"2024-09-12T01:58:38.127654+0000","last_clean":"2024-09-12T01:58:38.127654+0000","last_became_active":"2024-09-12T01:58:32.095589+0000","last_became_peered":"2024-09-12T01:58:32.095589+0000","last_unstale":"2024-09-12T01:58:38.127654+0000","last_undegraded":"2024-09-12T01:58:38.127654+0000","last_fullsized":"2024-09-12T01:58:38.127654+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:50.976465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"65'1","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616189+0000","last_change":"2024-09-12T01:58:31.085862+0000","last_active":"2024-09-12T01:58:38.616189+0000","last_peered":"2024-09-12T01:58:38.616189+0000","last_clean":"2024-09-12T01:58:38.616189+0000","last_became_active":"2024-09-12T01:58:31.085601+0000","last_became_peered":"2024-09-12T01:58:31.085601+0000","last_unstale":"2024-09-12T01:58:38.616189+0000","last_undegraded":"2024-09-12T01:58:38.616189+0000","last_fullsized":"2024-09-12T01:58:38.616189+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:20.505778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.121093+0000","last_change":"2024-09-12T01:58:32.089389+0000","last_active":"2024-09-12T01:58:38.121093+0000","last_peered":"2024-09-12T01:58:38.121093+0000","last_clean":"2024-09-12T01:58:38.121093+0000","last_became_active":"2024-09-12T01:58:32.088821+0000","last_became_peered":"2024-09-12T01:58:32.088821+0000","last_unstale":"2024-09-12T01:58:38.121093+0000","last_undegraded":"2024-09-12T01:58:38.121093+0000","last_fullsized":"2024-09-12T01:58:38.121093+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:23.327759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T01:58:38.122341+0000","last_change":"2024-09-12T01:58:38.122341+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:58:38.122341+0000","last_undegraded":"2024-09-12T01:58:38.122341+0000","last_fullsized":"2024-09-12T01:58:38.122341+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071827+0000","last_change":"2024-09-12T01:58:32.083451+0000","last_active":"2024-09-12T01:58:33.071827+0000","last_peered":"2024-09-12T01:58:33.071827+0000","last_clean":"2024-09-12T01:58:33.071827+0000","last_became_active":"2024-09-12T01:58:32.083176+0000","last_became_peered":"2024-09-12T01:58:32.083176+0000","last_unstale":"2024-09-12T01:58:33.071827+0000","last_undegraded":"2024-09-12T01:58:33.071827+0000","last_fullsized":"2024-09-12T01:58:33.071827+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:56.968157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"65'1","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127666+0000","last_change":"2024-09-12T01:58:31.087815+0000","last_active":"2024-09-12T01:58:38.127666+0000","last_peered":"2024-09-12T01:58:38.127666+0000","last_clean":"2024-09-12T01:58:38.127666+0000","last_became_active":"2024-09-12T01:58:31.087594+0000","last_became_peered":"2024-09-12T01:58:31.087594+0000","last_unstale":"2024-09-12T01:58:38.127666+0000","last_undegraded":"2024-09-12T01:58:38.127666+0000","last_fullsized":"2024-09-12T01:58:38.127666+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.106930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.120745+0000","last_change":"2024-09-12T01:58:32.089687+0000","last_active":"2024-09-12T01:58:38.120745+0000","last_peered":"2024-09-12T01:58:38.120745+0000","last_clean":"2024-09-12T01:58:38.120745+0000","last_became_active":"2024-09-12T01:58:32.088371+0000","last_became_peered":"2024-09-12T01:58:32.088371+0000","last_unstale":"2024-09-12T01:58:38.120745+0000","last_undegraded":"2024-09-12T01:58:38.120745+0000","last_fullsized":"2024-09-12T01:58:38.120745+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:56.306443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915671+0000","last_change":"2024-09-12T01:58:31.074406+0000","last_active":"2024-09-12T01:58:33.915671+0000","last_peered":"2024-09-12T01:58:33.915671+0000","last_clean":"2024-09-12T01:58:33.915671+0000","last_became_active":"2024-09-12T01:58:31.074068+0000","last_became_peered":"2024-09-12T01:58:31.074068+0000","last_unstale":"2024-09-12T01:58:33.915671+0000","last_undegraded":"2024-09-12T01:58:33.915671+0000","last_fullsized":"2024-09-12T01:58:33.915671+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:26.113685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071998+0000","last_change":"2024-09-12T01:58:32.078981+0000","last_active":"2024-09-12T01:58:33.071998+0000","last_peered":"2024-09-12T01:58:33.071998+0000","last_clean":"2024-09-12T01:58:33.071998+0000","last_became_active":"2024-09-12T01:58:32.078680+0000","last_became_peered":"2024-09-12T01:58:32.078680+0000","last_unstale":"2024-09-12T01:58:33.071998+0000","last_undegraded":"2024-09-12T01:58:33.071998+0000","last_fullsized":"2024-09-12T01:58:33.071998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:11.561895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072046+0000","last_change":"2024-09-12T01:58:31.084085+0000","last_active":"2024-09-12T01:58:33.072046+0000","last_peered":"2024-09-12T01:58:33.072046+0000","last_clean":"2024-09-12T01:58:33.072046+0000","last_became_active":"2024-09-12T01:58:31.083740+0000","last_became_peered":"2024-09-12T01:58:31.083740+0000","last_unstale":"2024-09-12T01:58:33.072046+0000","last_undegraded":"2024-09-12T01:58:33.072046+0000","last_fullsized":"2024-09-12T01:58:33.072046+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:23.301991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.615869+0000","last_change":"2024-09-12T01:58:32.092045+0000","last_active":"2024-09-12T01:58:38.615869+0000","last_peered":"2024-09-12T01:58:38.615869+0000","last_clean":"2024-09-12T01:58:38.615869+0000","last_became_active":"2024-09-12T01:58:32.091550+0000","last_became_peered":"2024-09-12T01:58:32.091550+0000","last_unstale":"2024-09-12T01:58:38.615869+0000","last_undegraded":"2024-09-12T01:58:38.615869+0000","last_fullsized":"2024-09-12T01:58:38.615869+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:41.371386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616035+0000","last_change":"2024-09-12T01:58:31.083500+0000","last_active":"2024-09-12T01:58:38.616035+0000","last_peered":"2024-09-12T01:58:38.616035+0000","last_clean":"2024-09-12T01:58:38.616035+0000","last_became_active":"2024-09-12T01:58:31.083304+0000","last_became_peered":"2024-09-12T01:58:31.083304+0000","last_unstale":"2024-09-12T01:58:38.616035+0000","last_undegraded":"2024-09-12T01:58:38.616035+0000","last_fullsized":"2024-09-12T01:58:38.616035+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:41.804439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.121127+0000","last_change":"2024-09-12T01:58:32.092142+0000","last_active":"2024-09-12T01:58:38.121127+0000","last_peered":"2024-09-12T01:58:38.121127+0000","last_clean":"2024-09-12T01:58:38.121127+0000","last_became_active":"2024-09-12T01:58:32.091877+0000","last_became_peered":"2024-09-12T01:58:32.091877+0000","last_unstale":"2024-09-12T01:58:38.121127+0000","last_undegraded":"2024-09-12T01:58:38.121127+0000","last_fullsized":"2024-09-12T01:58:38.121127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:47.089578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071936+0000","last_change":"2024-09-12T01:58:31.079762+0000","last_active":"2024-09-12T01:58:33.071936+0000","last_peered":"2024-09-12T01:58:33.071936+0000","last_clean":"2024-09-12T01:58:33.071936+0000","last_became_active":"2024-09-12T01:58:31.079490+0000","last_became_peered":"2024-09-12T01:58:31.079490+0000","last_unstale":"2024-09-12T01:58:33.071936+0000","last_undegraded":"2024-09-12T01:58:33.071936+0000","last_fullsized":"2024-09-12T01:58:33.071936+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:40.366109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072065+0000","last_change":"2024-09-12T01:58:32.088285+0000","last_active":"2024-09-12T01:58:33.072065+0000","last_peered":"2024-09-12T01:58:33.072065+0000","last_clean":"2024-09-12T01:58:33.072065+0000","last_became_active":"2024-09-12T01:58:32.087918+0000","last_became_peered":"2024-09-12T01:58:32.087918+0000","last_unstale":"2024-09-12T01:58:33.072065+0000","last_undegraded":"2024-09-12T01:58:33.072065+0000","last_fullsized":"2024-09-12T01:58:33.072065+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:19.787633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"65'2","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616272+0000","last_change":"2024-09-12T01:58:31.085470+0000","last_active":"2024-09-12T01:58:38.616272+0000","last_peered":"2024-09-12T01:58:38.616272+0000","last_clean":"2024-09-12T01:58:38.616272+0000","last_became_active":"2024-09-12T01:58:31.085216+0000","last_became_peered":"2024-09-12T01:58:31.085216+0000","last_unstale":"2024-09-12T01:58:38.616272+0000","last_undegraded":"2024-09-12T01:58:38.616272+0000","last_fullsized":"2024-09-12T01:58:38.616272+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:57.516064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.122643+0000","last_change":"2024-09-12T01:58:32.084136+0000","last_active":"2024-09-12T01:58:38.122643+0000","last_peered":"2024-09-12T01:58:38.122643+0000","last_clean":"2024-09-12T01:58:38.122643+0000","last_became_active":"2024-09-12T01:58:32.083827+0000","last_became_peered":"2024-09-12T01:58:32.083827+0000","last_unstale":"2024-09-12T01:58:38.122643+0000","last_undegraded":"2024-09-12T01:58:38.122643+0000","last_fullsized":"2024-09-12T01:58:38.122643+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:16.128275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"66'1","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616297+0000","last_change":"2024-09-12T01:58:31.082854+0000","last_active":"2024-09-12T01:58:38.616297+0000","last_peered":"2024-09-12T01:58:38.616297+0000","last_clean":"2024-09-12T01:58:38.616297+0000","last_became_active":"2024-09-12T01:58:31.082576+0000","last_became_peered":"2024-09-12T01:58:31.082576+0000","last_unstale":"2024-09-12T01:58:38.616297+0000","last_undegraded":"2024-09-12T01:58:38.616297+0000","last_fullsized":"2024-09-12T01:58:38.616297+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:55.301165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.616216+0000","last_change":"2024-09-12T01:58:32.094795+0000","last_active":"2024-09-12T01:58:38.616216+0000","last_peered":"2024-09-12T01:58:38.616216+0000","last_clean":"2024-09-12T01:58:38.616216+0000","last_became_active":"2024-09-12T01:58:32.093598+0000","last_became_peered":"2024-09-12T01:58:32.093598+0000","last_unstale":"2024-09-12T01:58:38.616216+0000","last_undegraded":"2024-09-12T01:58:38.616216+0000","last_fullsized":"2024-09-12T01:58:38.616216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.413296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.072377+0000","last_change":"2024-09-12T01:58:31.086458+0000","last_active":"2024-09-12T01:58:33.072377+0000","last_peered":"2024-09-12T01:58:33.072377+0000","last_clean":"2024-09-12T01:58:33.072377+0000","last_became_active":"2024-09-12T01:58:31.086155+0000","last_became_peered":"2024-09-12T01:58:31.086155+0000","last_unstale":"2024-09-12T01:58:33.072377+0000","last_undegraded":"2024-09-12T01:58:33.072377+0000","last_fullsized":"2024-09-12T01:58:33.072377+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:58.472371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.120841+0000","last_change":"2024-09-12T01:58:32.083243+0000","last_active":"2024-09-12T01:58:38.120841+0000","last_peered":"2024-09-12T01:58:38.120841+0000","last_clean":"2024-09-12T01:58:38.120841+0000","last_became_active":"2024-09-12T01:58:32.082988+0000","last_became_peered":"2024-09-12T01:58:32.082988+0000","last_unstale":"2024-09-12T01:58:38.120841+0000","last_undegraded":"2024-09-12T01:58:38.120841+0000","last_fullsized":"2024-09-12T01:58:38.120841+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:21.511055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666966+0000","last_change":"2024-09-12T01:58:31.077535+0000","last_active":"2024-09-12T01:58:33.666966+0000","last_peered":"2024-09-12T01:58:33.666966+0000","last_clean":"2024-09-12T01:58:33.666966+0000","last_became_active":"2024-09-12T01:58:31.077058+0000","last_became_peered":"2024-09-12T01:58:31.077058+0000","last_unstale":"2024-09-12T01:58:33.666966+0000","last_undegraded":"2024-09-12T01:58:33.666966+0000","last_fullsized":"2024-09-12T01:58:33.666966+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:10.416486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.119688+0000","last_change":"2024-09-12T01:58:32.099028+0000","last_active":"2024-09-12T01:58:38.119688+0000","last_peered":"2024-09-12T01:58:38.119688+0000","last_clean":"2024-09-12T01:58:38.119688+0000","last_became_active":"2024-09-12T01:58:32.098748+0000","last_became_peered":"2024-09-12T01:58:32.098748+0000","last_unstale":"2024-09-12T01:58:38.119688+0000","last_undegraded":"2024-09-12T01:58:38.119688+0000","last_fullsized":"2024-09-12T01:58:38.119688+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:42.809716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127507+0000","last_change":"2024-09-12T01:58:31.090527+0000","last_active":"2024-09-12T01:58:38.127507+0000","last_peered":"2024-09-12T01:58:38.127507+0000","last_clean":"2024-09-12T01:58:38.127507+0000","last_became_active":"2024-09-12T01:58:31.090284+0000","last_became_peered":"2024-09-12T01:58:31.090284+0000","last_unstale":"2024-09-12T01:58:38.127507+0000","last_undegraded":"2024-09-12T01:58:38.127507+0000","last_fullsized":"2024-09-12T01:58:38.127507+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:55.301165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.071598+0000","last_change":"2024-09-12T01:58:32.089933+0000","last_active":"2024-09-12T01:58:33.071598+0000","last_peered":"2024-09-12T01:58:33.071598+0000","last_clean":"2024-09-12T01:58:33.071598+0000","last_became_active":"2024-09-12T01:58:32.089694+0000","last_became_peered":"2024-09-12T01:58:32.089694+0000","last_unstale":"2024-09-12T01:58:33.071598+0000","last_undegraded":"2024-09-12T01:58:33.071598+0000","last_fullsized":"2024-09-12T01:58:33.071598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:33.295546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915715+0000","last_change":"2024-09-12T01:58:31.076859+0000","last_active":"2024-09-12T01:58:33.915715+0000","last_peered":"2024-09-12T01:58:33.915715+0000","last_clean":"2024-09-12T01:58:33.915715+0000","last_became_active":"2024-09-12T01:58:31.076488+0000","last_became_peered":"2024-09-12T01:58:31.076488+0000","last_unstale":"2024-09-12T01:58:33.915715+0000","last_undegraded":"2024-09-12T01:58:33.915715+0000","last_fullsized":"2024-09-12T01:58:33.915715+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:47.205697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666577+0000","last_change":"2024-09-12T01:58:32.099717+0000","last_active":"2024-09-12T01:58:33.666577+0000","last_peered":"2024-09-12T01:58:33.666577+0000","last_clean":"2024-09-12T01:58:33.666577+0000","last_became_active":"2024-09-12T01:58:32.099398+0000","last_became_peered":"2024-09-12T01:58:32.099398+0000","last_unstale":"2024-09-12T01:58:33.666577+0000","last_undegraded":"2024-09-12T01:58:33.666577+0000","last_fullsized":"2024-09-12T01:58:33.666577+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:56.968157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915720+0000","last_change":"2024-09-12T01:58:31.078174+0000","last_active":"2024-09-12T01:58:33.915720+0000","last_peered":"2024-09-12T01:58:33.915720+0000","last_clean":"2024-09-12T01:58:33.915720+0000","last_became_active":"2024-09-12T01:58:31.077722+0000","last_became_peered":"2024-09-12T01:58:31.077722+0000","last_unstale":"2024-09-12T01:58:33.915720+0000","last_undegraded":"2024-09-12T01:58:33.915720+0000","last_fullsized":"2024-09-12T01:58:33.915720+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:04.459773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.122515+0000","last_change":"2024-09-12T01:58:32.092706+0000","last_active":"2024-09-12T01:58:38.122515+0000","last_peered":"2024-09-12T01:58:38.122515+0000","last_clean":"2024-09-12T01:58:38.122515+0000","last_became_active":"2024-09-12T01:58:32.092407+0000","last_became_peered":"2024-09-12T01:58:32.092407+0000","last_unstale":"2024-09-12T01:58:38.122515+0000","last_undegraded":"2024-09-12T01:58:38.122515+0000","last_fullsized":"2024-09-12T01:58:38.122515+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:09.461358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.666535+0000","last_change":"2024-09-12T01:58:31.083451+0000","last_active":"2024-09-12T01:58:33.666535+0000","last_peered":"2024-09-12T01:58:33.666535+0000","last_clean":"2024-09-12T01:58:33.666535+0000","last_became_active":"2024-09-12T01:58:31.083133+0000","last_became_peered":"2024-09-12T01:58:31.083133+0000","last_unstale":"2024-09-12T01:58:33.666535+0000","last_undegraded":"2024-09-12T01:58:33.666535+0000","last_fullsized":"2024-09-12T01:58:33.666535+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:21.347164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.120569+0000","last_change":"2024-09-12T01:58:32.096326+0000","last_active":"2024-09-12T01:58:38.120569+0000","last_peered":"2024-09-12T01:58:38.120569+0000","last_clean":"2024-09-12T01:58:38.120569+0000","last_became_active":"2024-09-12T01:58:32.096061+0000","last_became_peered":"2024-09-12T01:58:32.096061+0000","last_unstale":"2024-09-12T01:58:38.120569+0000","last_undegraded":"2024-09-12T01:58:38.120569+0000","last_fullsized":"2024-09-12T01:58:38.120569+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:40.545508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:58:33.915509+0000","last_change":"2024-09-12T01:58:31.084470+0000","last_active":"2024-09-12T01:58:33.915509+0000","last_peered":"2024-09-12T01:58:33.915509+0000","last_clean":"2024-09-12T01:58:33.915509+0000","last_became_active":"2024-09-12T01:58:31.084172+0000","last_became_peered":"2024-09-12T01:58:31.084172+0000","last_unstale":"2024-09-12T01:58:33.915509+0000","last_undegraded":"2024-09-12T01:58:33.915509+0000","last_fullsized":"2024-09-12T01:58:33.915509+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:29.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":253,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T01:58:38.127848+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:58:38.127848+0000","last_peered":"2024-09-12T01:58:38.127848+0000","last_clean":"2024-09-12T01:58:38.127848+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:58:38.127848+0000","last_undegraded":"2024-09-12T01:58:38.127848+0000","last_fullsized":"2024-09-12T01:58:38.127848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28408,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343432,"statfs":{"total":96636764160,"available":96607674368,"internally_reserved":0,"allocated":1413120,"data_stored":957095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509478,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":365985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":365973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":359418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":790528,"data_stored":359418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":361794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1384448,"data_stored":949786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":802816,"data_stored":361030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:58:43.888 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:58:44.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.004+0000 7efc3d7c4640 1 Processor -- start 2024-09-12T01:58:44.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.004+0000 7efc3d7c4640 1 -- start start 2024-09-12T01:58:44.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.004+0000 7efc3d7c4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efc380ae850 0x7efc380b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.004+0000 7efc3d7c4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc380b6520 con 0x7efc3815e5b0 2024-09-12T01:58:44.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.004+0000 7efc3d7c4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc380b1a40 con 0x7efc3815e990 2024-09-12T01:58:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.004+0000 7efc3d7c4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7efc380b2c30 con 0x7efc380ae850 2024-09-12T01:58:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc36ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efc3815e5b0 0x7efc380b2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56502/0 (socket says 172.21.15.19:56502) 2024-09-12T01:58:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc36ffd640 1 -- 172.21.15.19:0/3161007333 learned_addr learned my addr 172.21.15.19:0/3161007333 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc377fe640 1 --2- 172.21.15.19:0/3161007333 >> v2:172.21.15.135:3300/0 conn(0x7efc380ae850 0x7efc380b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc35ffb640 1 -- 172.21.15.19:0/3161007333 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2068033420 0 0) 0x7efc380b6520 con 0x7efc3815e5b0 2024-09-12T01:58:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc35ffb640 1 -- 172.21.15.19:0/3161007333 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc20003520 con 0x7efc3815e5b0 2024-09-12T01:58:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc35ffb640 1 -- 172.21.15.19:0/3161007333 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1237531988 0 0) 0x7efc20003520 con 0x7efc3815e5b0 2024-09-12T01:58:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc35ffb640 1 -- 172.21.15.19:0/3161007333 >> v2:172.21.15.135:3300/0 conn(0x7efc380ae850 msgr2=0x7efc380b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc35ffb640 1 --2- 172.21.15.19:0/3161007333 >> v2:172.21.15.135:3300/0 conn(0x7efc380ae850 0x7efc380b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc35ffb640 1 -- 172.21.15.19:0/3161007333 >> v1:172.21.15.135:6789/0 conn(0x7efc3815e990 legacy=0x7efc380ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc35ffb640 1 -- 172.21.15.19:0/3161007333 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc380b1d20 con 0x7efc3815e5b0 2024-09-12T01:58:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc35ffb640 1 -- 172.21.15.19:0/3161007333 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7efc28001670 con 0x7efc3815e5b0 2024-09-12T01:58:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc35ffb640 1 -- 172.21.15.19:0/3161007333 >> v1:172.21.15.19:6789/0 conn(0x7efc3815e5b0 legacy=0x7efc380b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc35ffb640 1 --2- 172.21.15.19:0/3161007333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc200039b0 0x7efc20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc35ffb640 1 --2- 172.21.15.19:0/3161007333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc20004800 0x7efc20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc35ffb640 1 --2- 172.21.15.19:0/3161007333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc200051c0 0x7efc2000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc35ffb640 1 -- 172.21.15.19:0/3161007333 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efc380b2c30 con 0x7efc20004800 2024-09-12T01:58:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc35ffb640 1 -- 172.21.15.19:0/3161007333 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efc2000c060 con 0x7efc200051c0 2024-09-12T01:58:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc35ffb640 1 -- 172.21.15.19:0/3161007333 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7efc2000c260 con 0x7efc200039b0 2024-09-12T01:58:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.005+0000 7efc367fc640 1 --2- 172.21.15.19:0/3161007333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc20004800 0x7efc20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.006+0000 7efc36ffd640 1 --2- 172.21.15.19:0/3161007333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc200039b0 0x7efc20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.006+0000 7efc377fe640 1 --2- 172.21.15.19:0/3161007333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc200051c0 0x7efc2000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.006+0000 7efc367fc640 1 -- 172.21.15.19:0/3161007333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc200039b0 msgr2=0x7efc20003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.006+0000 7efc367fc640 1 --2- 172.21.15.19:0/3161007333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc200039b0 0x7efc20003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.006+0000 7efc367fc640 1 -- 172.21.15.19:0/3161007333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc200051c0 msgr2=0x7efc2000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.006+0000 7efc367fc640 1 --2- 172.21.15.19:0/3161007333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc200051c0 0x7efc2000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.006+0000 7efc367fc640 1 -- 172.21.15.19:0/3161007333 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc20003520 con 0x7efc20004800 2024-09-12T01:58:44.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.006+0000 7efc377fe640 1 -- 172.21.15.19:0/3161007333 reap_dead start 2024-09-12T01:58:44.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.007+0000 7efc367fc640 1 --2- 172.21.15.19:0/3161007333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc20004800 0x7efc20004c80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7efc2c001750 tx=0x7efc20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660400f189a7987 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:44.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.007+0000 7efc35ffb640 1 -- 172.21.15.19:0/3161007333 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c001370 con 0x7efc20004800 2024-09-12T01:58:44.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.007+0000 7efc35ffb640 1 -- 172.21.15.19:0/3161007333 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2c0052d0 con 0x7efc20004800 2024-09-12T01:58:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.007+0000 7efc35ffb640 1 -- 172.21.15.19:0/3161007333 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c02abc0 con 0x7efc20004800 2024-09-12T01:58:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.007+0000 7efc3d7c4640 1 -- 172.21.15.19:0/3161007333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc20004800 msgr2=0x7efc20004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.007+0000 7efc3d7c4640 1 --2- 172.21.15.19:0/3161007333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc20004800 0x7efc20004c80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7efc2c001750 tx=0x7efc20005830 comp rx=0 tx=0).stop 2024-09-12T01:58:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.007+0000 7efc3d7c4640 1 -- 172.21.15.19:0/3161007333 shutdown_connections 2024-09-12T01:58:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.007+0000 7efc3d7c4640 1 --2- 172.21.15.19:0/3161007333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc20004800 0x7efc20004c80 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.007+0000 7efc3d7c4640 1 -- 172.21.15.19:0/3161007333 >> 172.21.15.19:0/3161007333 conn(0x7efc38073490 msgr2=0x7efc380b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.007+0000 7efc3d7c4640 1 -- 172.21.15.19:0/3161007333 shutdown_connections 2024-09-12T01:58:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.007+0000 7efc3d7c4640 1 -- 172.21.15.19:0/3161007333 wait complete. 2024-09-12T01:58:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.009+0000 7efc3d7c4640 1 Processor -- start 2024-09-12T01:58:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.009+0000 7efc3d7c4640 1 -- start start 2024-09-12T01:58:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.009+0000 7efc3d7c4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc20004800 0x7efc38147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.009+0000 7efc3d7c4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc38154c20 0x7efc38161100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.009+0000 7efc3d7c4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc381604f0 0x7efc380af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.009+0000 7efc3d7c4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efc380b5f40 con 0x7efc20004800 2024-09-12T01:58:44.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.009+0000 7efc3d7c4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efc380b0490 con 0x7efc38154c20 2024-09-12T01:58:44.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.009+0000 7efc3d7c4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7efc380b60c0 con 0x7efc381604f0 2024-09-12T01:58:44.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.010+0000 7efc36ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc20004800 0x7efc38147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.010+0000 7efc36ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc20004800 0x7efc38147e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58044/0 (socket says 172.21.15.19:58044) 2024-09-12T01:58:44.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.010+0000 7efc36ffd640 1 -- 172.21.15.19:0/2100771284 learned_addr learned my addr 172.21.15.19:0/2100771284 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:44.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.010+0000 7efc367fc640 1 --2- 172.21.15.19:0/2100771284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc38154c20 0x7efc38161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.010+0000 7efc377fe640 1 --2- 172.21.15.19:0/2100771284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc381604f0 0x7efc380af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.010+0000 7efc36ffd640 1 -- 172.21.15.19:0/2100771284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc381604f0 msgr2=0x7efc380af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.010+0000 7efc36ffd640 1 --2- 172.21.15.19:0/2100771284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc381604f0 0x7efc380af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.010+0000 7efc36ffd640 1 -- 172.21.15.19:0/2100771284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc38154c20 msgr2=0x7efc38161100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.010+0000 7efc36ffd640 1 --2- 172.21.15.19:0/2100771284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc38154c20 0x7efc38161100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.010+0000 7efc36ffd640 1 -- 172.21.15.19:0/2100771284 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc38161790 con 0x7efc20004800 2024-09-12T01:58:44.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.010+0000 7efc36ffd640 1 --2- 172.21.15.19:0/2100771284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc20004800 0x7efc38147e00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7efc28004ef0 tx=0x7efc28007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:44.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.010+0000 7efc1f7fe640 1 -- 172.21.15.19:0/2100771284 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2800f750 con 0x7efc20004800 2024-09-12T01:58:44.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.010+0000 7efc1f7fe640 1 -- 172.21.15.19:0/2100771284 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc28018070 con 0x7efc20004800 2024-09-12T01:58:44.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.010+0000 7efc3d7c4640 1 -- 172.21.15.19:0/2100771284 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc38161a70 con 0x7efc20004800 2024-09-12T01:58:44.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.010+0000 7efc1f7fe640 1 -- 172.21.15.19:0/2100771284 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2800fb70 con 0x7efc20004800 2024-09-12T01:58:44.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.010+0000 7efc3d7c4640 1 -- 172.21.15.19:0/2100771284 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc3815ffd0 con 0x7efc20004800 2024-09-12T01:58:44.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.012+0000 7efc3d7c4640 1 -- 172.21.15.19:0/2100771284 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc380b2520 con 0x7efc20004800 2024-09-12T01:58:44.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.012+0000 7efc1f7fe640 1 -- 172.21.15.19:0/2100771284 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc2800fd10 con 0x7efc20004800 2024-09-12T01:58:44.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.012+0000 7efc1f7fe640 1 --2- 172.21.15.19:0/2100771284 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7efc2406be60 0x7efc2406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.013+0000 7efc1f7fe640 1 -- 172.21.15.19:0/2100771284 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6217+0+0 (secure 0 0 0) 0x7efc2808ad10 con 0x7efc20004800 2024-09-12T01:58:44.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.013+0000 7efc367fc640 1 --2- 172.21.15.19:0/2100771284 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7efc2406be60 0x7efc2406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.014+0000 7efc367fc640 1 --2- 172.21.15.19:0/2100771284 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7efc2406be60 0x7efc2406e320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efc2c032000 tx=0x7efc2c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:44.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.017+0000 7efc1f7fe640 1 -- 172.21.15.19:0/2100771284 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc28058f00 con 0x7efc20004800 2024-09-12T01:58:44.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.191+0000 7efc3d7c4640 1 -- 172.21.15.19:0/2100771284 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc38161f90 con 0x7efc2406be60 2024-09-12T01:58:44.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.198+0000 7efc1f7fe640 1 -- 172.21.15.19:0/2100771284 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7efc2c07f840 con 0x7efc2406be60 2024-09-12T01:58:44.200 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:44.201 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:58:44.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.200+0000 7efc3d7c4640 1 -- 172.21.15.19:0/2100771284 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7efc2406be60 msgr2=0x7efc2406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.200+0000 7efc3d7c4640 1 --2- 172.21.15.19:0/2100771284 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7efc2406be60 0x7efc2406e320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efc2c032000 tx=0x7efc2c02e000 comp rx=0 tx=0).stop 2024-09-12T01:58:44.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.200+0000 7efc3d7c4640 1 -- 172.21.15.19:0/2100771284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc20004800 msgr2=0x7efc38147e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.200+0000 7efc3d7c4640 1 --2- 172.21.15.19:0/2100771284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc20004800 0x7efc38147e00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7efc28004ef0 tx=0x7efc28007430 comp rx=0 tx=0).stop 2024-09-12T01:58:44.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.200+0000 7efc3d7c4640 1 -- 172.21.15.19:0/2100771284 shutdown_connections 2024-09-12T01:58:44.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.200+0000 7efc3d7c4640 1 --2- 172.21.15.19:0/2100771284 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7efc2406be60 0x7efc2406e320 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.200+0000 7efc3d7c4640 1 --2- 172.21.15.19:0/2100771284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc381604f0 0x7efc380af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.200+0000 7efc3d7c4640 1 --2- 172.21.15.19:0/2100771284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc38154c20 0x7efc38161100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.200+0000 7efc3d7c4640 1 --2- 172.21.15.19:0/2100771284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc20004800 0x7efc38147e00 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.200+0000 7efc3d7c4640 1 -- 172.21.15.19:0/2100771284 >> 172.21.15.19:0/2100771284 conn(0x7efc38073490 msgr2=0x7efc3815d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:44.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.200+0000 7efc3d7c4640 1 -- 172.21.15.19:0/2100771284 shutdown_connections 2024-09-12T01:58:44.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.201+0000 7efc3d7c4640 1 -- 172.21.15.19:0/2100771284 wait complete. 2024-09-12T01:58:44.212 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-12T01:58:44.123239+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":197,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232144,"kb_used_data":7592,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742576,"statfs":{"total":773094113280,"available":772856397824,"internally_reserved":0,"allocated":7774208,"data_stored":4164692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001707"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184832+0000","last_change":"2024-09-12T01:58:32.098775+0000","last_active":"2024-09-12T01:58:40.184832+0000","last_peered":"2024-09-12T01:58:40.184832+0000","last_clean":"2024-09-12T01:58:40.184832+0000","last_became_active":"2024-09-12T01:58:32.098472+0000","last_became_peered":"2024-09-12T01:58:32.098472+0000","last_unstale":"2024-09-12T01:58:40.184832+0000","last_undegraded":"2024-09-12T01:58:40.184832+0000","last_fullsized":"2024-09-12T01:58:40.184832+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:34.058890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184683+0000","last_change":"2024-09-12T01:58:32.092794+0000","last_active":"2024-09-12T01:58:40.184683+0000","last_peered":"2024-09-12T01:58:40.184683+0000","last_clean":"2024-09-12T01:58:40.184683+0000","last_became_active":"2024-09-12T01:58:32.092525+0000","last_became_peered":"2024-09-12T01:58:32.092525+0000","last_unstale":"2024-09-12T01:58:40.184683+0000","last_undegraded":"2024-09-12T01:58:40.184683+0000","last_fullsized":"2024-09-12T01:58:40.184683+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:05.445047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.125886+0000","last_change":"2024-09-12T01:58:32.099017+0000","last_active":"2024-09-12T01:58:39.125886+0000","last_peered":"2024-09-12T01:58:39.125886+0000","last_clean":"2024-09-12T01:58:39.125886+0000","last_became_active":"2024-09-12T01:58:32.095848+0000","last_became_peered":"2024-09-12T01:58:32.095848+0000","last_unstale":"2024-09-12T01:58:39.125886+0000","last_undegraded":"2024-09-12T01:58:39.125886+0000","last_fullsized":"2024-09-12T01:58:39.125886+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:50.997517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.127785+0000","last_change":"2024-09-12T01:58:32.086522+0000","last_active":"2024-09-12T01:58:39.127785+0000","last_peered":"2024-09-12T01:58:39.127785+0000","last_clean":"2024-09-12T01:58:39.127785+0000","last_became_active":"2024-09-12T01:58:32.086029+0000","last_became_peered":"2024-09-12T01:58:32.086029+0000","last_unstale":"2024-09-12T01:58:39.127785+0000","last_undegraded":"2024-09-12T01:58:39.127785+0000","last_fullsized":"2024-09-12T01:58:39.127785+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:53.481574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.128721+0000","last_change":"2024-09-12T01:58:39.128721+0000","last_active":"2024-09-12T01:58:39.128721+0000","last_peered":"2024-09-12T01:58:39.128721+0000","last_clean":"2024-09-12T01:58:39.128721+0000","last_became_active":"2024-09-12T01:58:39.128414+0000","last_became_peered":"2024-09-12T01:58:39.128414+0000","last_unstale":"2024-09-12T01:58:39.128721+0000","last_undegraded":"2024-09-12T01:58:39.128721+0000","last_fullsized":"2024-09-12T01:58:39.128721+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:23.760701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.097610+0000","last_change":"2024-09-12T01:58:32.090868+0000","last_active":"2024-09-12T01:58:40.097610+0000","last_peered":"2024-09-12T01:58:40.097610+0000","last_clean":"2024-09-12T01:58:40.097610+0000","last_became_active":"2024-09-12T01:58:32.090596+0000","last_became_peered":"2024-09-12T01:58:32.090596+0000","last_unstale":"2024-09-12T01:58:40.097610+0000","last_undegraded":"2024-09-12T01:58:40.097610+0000","last_fullsized":"2024-09-12T01:58:40.097610+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:19.012343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.124416+0000","last_change":"2024-09-12T01:58:32.091013+0000","last_active":"2024-09-12T01:58:39.124416+0000","last_peered":"2024-09-12T01:58:39.124416+0000","last_clean":"2024-09-12T01:58:39.124416+0000","last_became_active":"2024-09-12T01:58:32.090711+0000","last_became_peered":"2024-09-12T01:58:32.090711+0000","last_unstale":"2024-09-12T01:58:39.124416+0000","last_undegraded":"2024-09-12T01:58:39.124416+0000","last_fullsized":"2024-09-12T01:58:39.124416+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:42.450557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184432+0000","last_change":"2024-09-12T01:58:32.100103+0000","last_active":"2024-09-12T01:58:40.184432+0000","last_peered":"2024-09-12T01:58:40.184432+0000","last_clean":"2024-09-12T01:58:40.184432+0000","last_became_active":"2024-09-12T01:58:32.099846+0000","last_became_peered":"2024-09-12T01:58:32.099846+0000","last_unstale":"2024-09-12T01:58:40.184432+0000","last_undegraded":"2024-09-12T01:58:40.184432+0000","last_fullsized":"2024-09-12T01:58:40.184432+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:46.632781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.125263+0000","last_change":"2024-09-12T01:58:32.099992+0000","last_active":"2024-09-12T01:58:39.125263+0000","last_peered":"2024-09-12T01:58:39.125263+0000","last_clean":"2024-09-12T01:58:39.125263+0000","last_became_active":"2024-09-12T01:58:32.099721+0000","last_became_peered":"2024-09-12T01:58:32.099721+0000","last_unstale":"2024-09-12T01:58:39.125263+0000","last_undegraded":"2024-09-12T01:58:39.125263+0000","last_fullsized":"2024-09-12T01:58:39.125263+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:38.169564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.126186+0000","last_change":"2024-09-12T01:58:32.101085+0000","last_active":"2024-09-12T01:58:39.126186+0000","last_peered":"2024-09-12T01:58:39.126186+0000","last_clean":"2024-09-12T01:58:39.126186+0000","last_became_active":"2024-09-12T01:58:32.100128+0000","last_became_peered":"2024-09-12T01:58:32.100128+0000","last_unstale":"2024-09-12T01:58:39.126186+0000","last_undegraded":"2024-09-12T01:58:39.126186+0000","last_fullsized":"2024-09-12T01:58:39.126186+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:02.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.127868+0000","last_change":"2024-09-12T01:58:32.093435+0000","last_active":"2024-09-12T01:58:39.127868+0000","last_peered":"2024-09-12T01:58:39.127868+0000","last_clean":"2024-09-12T01:58:39.127868+0000","last_became_active":"2024-09-12T01:58:32.092950+0000","last_became_peered":"2024-09-12T01:58:32.092950+0000","last_unstale":"2024-09-12T01:58:39.127868+0000","last_undegraded":"2024-09-12T01:58:39.127868+0000","last_fullsized":"2024-09-12T01:58:39.127868+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:25.908231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184449+0000","last_change":"2024-09-12T01:58:32.096884+0000","last_active":"2024-09-12T01:58:40.184449+0000","last_peered":"2024-09-12T01:58:40.184449+0000","last_clean":"2024-09-12T01:58:40.184449+0000","last_became_active":"2024-09-12T01:58:32.096608+0000","last_became_peered":"2024-09-12T01:58:32.096608+0000","last_unstale":"2024-09-12T01:58:40.184449+0000","last_undegraded":"2024-09-12T01:58:40.184449+0000","last_fullsized":"2024-09-12T01:58:40.184449+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:50.997517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184431+0000","last_change":"2024-09-12T01:58:32.091527+0000","last_active":"2024-09-12T01:58:40.184431+0000","last_peered":"2024-09-12T01:58:40.184431+0000","last_clean":"2024-09-12T01:58:40.184431+0000","last_became_active":"2024-09-12T01:58:32.090919+0000","last_became_peered":"2024-09-12T01:58:32.090919+0000","last_unstale":"2024-09-12T01:58:40.184431+0000","last_undegraded":"2024-09-12T01:58:40.184431+0000","last_fullsized":"2024-09-12T01:58:40.184431+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:00.209541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.125318+0000","last_change":"2024-09-12T01:58:32.099040+0000","last_active":"2024-09-12T01:58:39.125318+0000","last_peered":"2024-09-12T01:58:39.125318+0000","last_clean":"2024-09-12T01:58:39.125318+0000","last_became_active":"2024-09-12T01:58:32.098246+0000","last_became_peered":"2024-09-12T01:58:32.098246+0000","last_unstale":"2024-09-12T01:58:39.125318+0000","last_undegraded":"2024-09-12T01:58:39.125318+0000","last_fullsized":"2024-09-12T01:58:39.125318+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:27.519989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.125074+0000","last_change":"2024-09-12T01:58:32.099874+0000","last_active":"2024-09-12T01:58:39.125074+0000","last_peered":"2024-09-12T01:58:39.125074+0000","last_clean":"2024-09-12T01:58:39.125074+0000","last_became_active":"2024-09-12T01:58:32.099591+0000","last_became_peered":"2024-09-12T01:58:32.099591+0000","last_unstale":"2024-09-12T01:58:39.125074+0000","last_undegraded":"2024-09-12T01:58:39.125074+0000","last_fullsized":"2024-09-12T01:58:39.125074+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:00.209541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.124391+0000","last_change":"2024-09-12T01:58:32.092337+0000","last_active":"2024-09-12T01:58:39.124391+0000","last_peered":"2024-09-12T01:58:39.124391+0000","last_clean":"2024-09-12T01:58:39.124391+0000","last_became_active":"2024-09-12T01:58:32.091794+0000","last_became_peered":"2024-09-12T01:58:32.091794+0000","last_unstale":"2024-09-12T01:58:39.124391+0000","last_undegraded":"2024-09-12T01:58:39.124391+0000","last_fullsized":"2024-09-12T01:58:39.124391+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:32.941238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184280+0000","last_change":"2024-09-12T01:58:32.099798+0000","last_active":"2024-09-12T01:58:40.184280+0000","last_peered":"2024-09-12T01:58:40.184280+0000","last_clean":"2024-09-12T01:58:40.184280+0000","last_became_active":"2024-09-12T01:58:32.099440+0000","last_became_peered":"2024-09-12T01:58:32.099440+0000","last_unstale":"2024-09-12T01:58:40.184280+0000","last_undegraded":"2024-09-12T01:58:40.184280+0000","last_fullsized":"2024-09-12T01:58:40.184280+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:53.552573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.127287+0000","last_change":"2024-09-12T01:58:32.086299+0000","last_active":"2024-09-12T01:58:39.127287+0000","last_peered":"2024-09-12T01:58:39.127287+0000","last_clean":"2024-09-12T01:58:39.127287+0000","last_became_active":"2024-09-12T01:58:32.085968+0000","last_became_peered":"2024-09-12T01:58:32.085968+0000","last_unstale":"2024-09-12T01:58:39.127287+0000","last_undegraded":"2024-09-12T01:58:39.127287+0000","last_fullsized":"2024-09-12T01:58:39.127287+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:55.745348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.124980+0000","last_change":"2024-09-12T01:58:32.089146+0000","last_active":"2024-09-12T01:58:39.124980+0000","last_peered":"2024-09-12T01:58:39.124980+0000","last_clean":"2024-09-12T01:58:39.124980+0000","last_became_active":"2024-09-12T01:58:32.088503+0000","last_became_peered":"2024-09-12T01:58:32.088503+0000","last_unstale":"2024-09-12T01:58:39.124980+0000","last_undegraded":"2024-09-12T01:58:39.124980+0000","last_fullsized":"2024-09-12T01:58:39.124980+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:06.577465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.127062+0000","last_change":"2024-09-12T01:58:32.089658+0000","last_active":"2024-09-12T01:58:39.127062+0000","last_peered":"2024-09-12T01:58:39.127062+0000","last_clean":"2024-09-12T01:58:39.127062+0000","last_became_active":"2024-09-12T01:58:32.089374+0000","last_became_peered":"2024-09-12T01:58:32.089374+0000","last_unstale":"2024-09-12T01:58:39.127062+0000","last_undegraded":"2024-09-12T01:58:39.127062+0000","last_fullsized":"2024-09-12T01:58:39.127062+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:31.386141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.185102+0000","last_change":"2024-09-12T01:58:32.097896+0000","last_active":"2024-09-12T01:58:40.185102+0000","last_peered":"2024-09-12T01:58:40.185102+0000","last_clean":"2024-09-12T01:58:40.185102+0000","last_became_active":"2024-09-12T01:58:32.097631+0000","last_became_peered":"2024-09-12T01:58:32.097631+0000","last_unstale":"2024-09-12T01:58:40.185102+0000","last_undegraded":"2024-09-12T01:58:40.185102+0000","last_fullsized":"2024-09-12T01:58:40.185102+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:38.169564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.126882+0000","last_change":"2024-09-12T01:58:32.091442+0000","last_active":"2024-09-12T01:58:39.126882+0000","last_peered":"2024-09-12T01:58:39.126882+0000","last_clean":"2024-09-12T01:58:39.126882+0000","last_became_active":"2024-09-12T01:58:32.091113+0000","last_became_peered":"2024-09-12T01:58:32.091113+0000","last_unstale":"2024-09-12T01:58:39.126882+0000","last_undegraded":"2024-09-12T01:58:39.126882+0000","last_fullsized":"2024-09-12T01:58:39.126882+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:42.748051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.126846+0000","last_change":"2024-09-12T01:58:32.090771+0000","last_active":"2024-09-12T01:58:39.126846+0000","last_peered":"2024-09-12T01:58:39.126846+0000","last_clean":"2024-09-12T01:58:39.126846+0000","last_became_active":"2024-09-12T01:58:32.090506+0000","last_became_peered":"2024-09-12T01:58:32.090506+0000","last_unstale":"2024-09-12T01:58:39.126846+0000","last_undegraded":"2024-09-12T01:58:39.126846+0000","last_fullsized":"2024-09-12T01:58:39.126846+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:57.559803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.124569+0000","last_change":"2024-09-12T01:58:32.095936+0000","last_active":"2024-09-12T01:58:39.124569+0000","last_peered":"2024-09-12T01:58:39.124569+0000","last_clean":"2024-09-12T01:58:39.124569+0000","last_became_active":"2024-09-12T01:58:32.095625+0000","last_became_peered":"2024-09-12T01:58:32.095625+0000","last_unstale":"2024-09-12T01:58:39.124569+0000","last_undegraded":"2024-09-12T01:58:39.124569+0000","last_fullsized":"2024-09-12T01:58:39.124569+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:59.477648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184789+0000","last_change":"2024-09-12T01:58:32.094671+0000","last_active":"2024-09-12T01:58:40.184789+0000","last_peered":"2024-09-12T01:58:40.184789+0000","last_clean":"2024-09-12T01:58:40.184789+0000","last_became_active":"2024-09-12T01:58:32.093934+0000","last_became_peered":"2024-09-12T01:58:32.093934+0000","last_unstale":"2024-09-12T01:58:40.184789+0000","last_undegraded":"2024-09-12T01:58:40.184789+0000","last_fullsized":"2024-09-12T01:58:40.184789+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:15.459156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184635+0000","last_change":"2024-09-12T01:58:32.094546+0000","last_active":"2024-09-12T01:58:40.184635+0000","last_peered":"2024-09-12T01:58:40.184635+0000","last_clean":"2024-09-12T01:58:40.184635+0000","last_became_active":"2024-09-12T01:58:32.094242+0000","last_became_peered":"2024-09-12T01:58:32.094242+0000","last_unstale":"2024-09-12T01:58:40.184635+0000","last_undegraded":"2024-09-12T01:58:40.184635+0000","last_fullsized":"2024-09-12T01:58:40.184635+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:24.307268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.127470+0000","last_change":"2024-09-12T01:58:32.088553+0000","last_active":"2024-09-12T01:58:39.127470+0000","last_peered":"2024-09-12T01:58:39.127470+0000","last_clean":"2024-09-12T01:58:39.127470+0000","last_became_active":"2024-09-12T01:58:32.087827+0000","last_became_peered":"2024-09-12T01:58:32.087827+0000","last_unstale":"2024-09-12T01:58:39.127470+0000","last_undegraded":"2024-09-12T01:58:39.127470+0000","last_fullsized":"2024-09-12T01:58:39.127470+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:12.553586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184454+0000","last_change":"2024-09-12T01:58:32.095548+0000","last_active":"2024-09-12T01:58:40.184454+0000","last_peered":"2024-09-12T01:58:40.184454+0000","last_clean":"2024-09-12T01:58:40.184454+0000","last_became_active":"2024-09-12T01:58:32.094714+0000","last_became_peered":"2024-09-12T01:58:32.094714+0000","last_unstale":"2024-09-12T01:58:40.184454+0000","last_undegraded":"2024-09-12T01:58:40.184454+0000","last_fullsized":"2024-09-12T01:58:40.184454+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:52.686475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.125492+0000","last_change":"2024-09-12T01:58:32.089782+0000","last_active":"2024-09-12T01:58:39.125492+0000","last_peered":"2024-09-12T01:58:39.125492+0000","last_clean":"2024-09-12T01:58:39.125492+0000","last_became_active":"2024-09-12T01:58:32.089548+0000","last_became_peered":"2024-09-12T01:58:32.089548+0000","last_unstale":"2024-09-12T01:58:39.125492+0000","last_undegraded":"2024-09-12T01:58:39.125492+0000","last_fullsized":"2024-09-12T01:58:39.125492+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.413296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184415+0000","last_change":"2024-09-12T01:58:32.099407+0000","last_active":"2024-09-12T01:58:40.184415+0000","last_peered":"2024-09-12T01:58:40.184415+0000","last_clean":"2024-09-12T01:58:40.184415+0000","last_became_active":"2024-09-12T01:58:32.099119+0000","last_became_peered":"2024-09-12T01:58:32.099119+0000","last_unstale":"2024-09-12T01:58:40.184415+0000","last_undegraded":"2024-09-12T01:58:40.184415+0000","last_fullsized":"2024-09-12T01:58:40.184415+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:45.710198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.127652+0000","last_change":"2024-09-12T01:58:32.088560+0000","last_active":"2024-09-12T01:58:39.127652+0000","last_peered":"2024-09-12T01:58:39.127652+0000","last_clean":"2024-09-12T01:58:39.127652+0000","last_became_active":"2024-09-12T01:58:32.088317+0000","last_became_peered":"2024-09-12T01:58:32.088317+0000","last_unstale":"2024-09-12T01:58:39.127652+0000","last_undegraded":"2024-09-12T01:58:39.127652+0000","last_fullsized":"2024-09-12T01:58:39.127652+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:06.911951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.097478+0000","last_change":"2024-09-12T01:58:32.085708+0000","last_active":"2024-09-12T01:58:40.097478+0000","last_peered":"2024-09-12T01:58:40.097478+0000","last_clean":"2024-09-12T01:58:40.097478+0000","last_became_active":"2024-09-12T01:58:32.085394+0000","last_became_peered":"2024-09-12T01:58:32.085394+0000","last_unstale":"2024-09-12T01:58:40.097478+0000","last_undegraded":"2024-09-12T01:58:40.097478+0000","last_fullsized":"2024-09-12T01:58:40.097478+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:02.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.124904+0000","last_change":"2024-09-12T01:58:32.096958+0000","last_active":"2024-09-12T01:58:39.124904+0000","last_peered":"2024-09-12T01:58:39.124904+0000","last_clean":"2024-09-12T01:58:39.124904+0000","last_became_active":"2024-09-12T01:58:32.096288+0000","last_became_peered":"2024-09-12T01:58:32.096288+0000","last_unstale":"2024-09-12T01:58:39.124904+0000","last_undegraded":"2024-09-12T01:58:39.124904+0000","last_fullsized":"2024-09-12T01:58:39.124904+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:51.645585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"65'4","reported_seq":22,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184850+0000","last_change":"2024-09-12T01:58:31.085572+0000","last_active":"2024-09-12T01:58:40.184850+0000","last_peered":"2024-09-12T01:58:40.184850+0000","last_clean":"2024-09-12T01:58:40.184850+0000","last_became_active":"2024-09-12T01:58:31.085308+0000","last_became_peered":"2024-09-12T01:58:31.085308+0000","last_unstale":"2024-09-12T01:58:40.184850+0000","last_undegraded":"2024-09-12T01:58:40.184850+0000","last_fullsized":"2024-09-12T01:58:40.184850+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:47.308955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.127626+0000","last_change":"2024-09-12T01:58:32.093055+0000","last_active":"2024-09-12T01:58:39.127626+0000","last_peered":"2024-09-12T01:58:39.127626+0000","last_clean":"2024-09-12T01:58:39.127626+0000","last_became_active":"2024-09-12T01:58:32.092801+0000","last_became_peered":"2024-09-12T01:58:32.092801+0000","last_unstale":"2024-09-12T01:58:39.127626+0000","last_undegraded":"2024-09-12T01:58:39.127626+0000","last_fullsized":"2024-09-12T01:58:39.127626+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:27.155936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"65'1","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.098226+0000","last_change":"2024-09-12T01:58:31.082993+0000","last_active":"2024-09-12T01:58:40.098226+0000","last_peered":"2024-09-12T01:58:40.098226+0000","last_clean":"2024-09-12T01:58:40.098226+0000","last_became_active":"2024-09-12T01:58:31.082679+0000","last_became_peered":"2024-09-12T01:58:31.082679+0000","last_unstale":"2024-09-12T01:58:40.098226+0000","last_undegraded":"2024-09-12T01:58:40.098226+0000","last_fullsized":"2024-09-12T01:58:40.098226+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:16.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.098033+0000","last_change":"2024-09-12T01:58:32.078918+0000","last_active":"2024-09-12T01:58:40.098033+0000","last_peered":"2024-09-12T01:58:40.098033+0000","last_clean":"2024-09-12T01:58:40.098033+0000","last_became_active":"2024-09-12T01:58:32.078659+0000","last_became_peered":"2024-09-12T01:58:32.078659+0000","last_unstale":"2024-09-12T01:58:40.098033+0000","last_undegraded":"2024-09-12T01:58:40.098033+0000","last_fullsized":"2024-09-12T01:58:40.098033+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:02.012816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"65'2","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.097955+0000","last_change":"2024-09-12T01:58:31.085752+0000","last_active":"2024-09-12T01:58:40.097955+0000","last_peered":"2024-09-12T01:58:40.097955+0000","last_clean":"2024-09-12T01:58:40.097955+0000","last_became_active":"2024-09-12T01:58:31.085456+0000","last_became_peered":"2024-09-12T01:58:31.085456+0000","last_unstale":"2024-09-12T01:58:40.097955+0000","last_undegraded":"2024-09-12T01:58:40.097955+0000","last_fullsized":"2024-09-12T01:58:40.097955+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:44.704921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.125167+0000","last_change":"2024-09-12T01:58:32.098820+0000","last_active":"2024-09-12T01:58:39.125167+0000","last_peered":"2024-09-12T01:58:39.125167+0000","last_clean":"2024-09-12T01:58:39.125167+0000","last_became_active":"2024-09-12T01:58:32.098562+0000","last_became_peered":"2024-09-12T01:58:32.098562+0000","last_unstale":"2024-09-12T01:58:39.125167+0000","last_undegraded":"2024-09-12T01:58:39.125167+0000","last_fullsized":"2024-09-12T01:58:39.125167+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:15.459156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"65'2","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.097878+0000","last_change":"2024-09-12T01:58:31.082135+0000","last_active":"2024-09-12T01:58:40.097878+0000","last_peered":"2024-09-12T01:58:40.097878+0000","last_clean":"2024-09-12T01:58:40.097878+0000","last_became_active":"2024-09-12T01:58:31.081834+0000","last_became_peered":"2024-09-12T01:58:31.081834+0000","last_unstale":"2024-09-12T01:58:40.097878+0000","last_undegraded":"2024-09-12T01:58:40.097878+0000","last_fullsized":"2024-09-12T01:58:40.097878+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:59.204264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.124391+0000","last_change":"2024-09-12T01:58:32.092057+0000","last_active":"2024-09-12T01:58:39.124391+0000","last_peered":"2024-09-12T01:58:39.124391+0000","last_clean":"2024-09-12T01:58:39.124391+0000","last_became_active":"2024-09-12T01:58:32.091372+0000","last_became_peered":"2024-09-12T01:58:32.091372+0000","last_unstale":"2024-09-12T01:58:39.124391+0000","last_undegraded":"2024-09-12T01:58:39.124391+0000","last_fullsized":"2024-09-12T01:58:39.124391+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:50.595958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"65'1","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.127186+0000","last_change":"2024-09-12T01:58:31.085302+0000","last_active":"2024-09-12T01:58:39.127186+0000","last_peered":"2024-09-12T01:58:39.127186+0000","last_clean":"2024-09-12T01:58:39.127186+0000","last_became_active":"2024-09-12T01:58:31.084995+0000","last_became_peered":"2024-09-12T01:58:31.084995+0000","last_unstale":"2024-09-12T01:58:39.127186+0000","last_undegraded":"2024-09-12T01:58:39.127186+0000","last_fullsized":"2024-09-12T01:58:39.127186+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:18.228685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184112+0000","last_change":"2024-09-12T01:58:32.099965+0000","last_active":"2024-09-12T01:58:40.184112+0000","last_peered":"2024-09-12T01:58:40.184112+0000","last_clean":"2024-09-12T01:58:40.184112+0000","last_became_active":"2024-09-12T01:58:32.099518+0000","last_became_peered":"2024-09-12T01:58:32.099518+0000","last_unstale":"2024-09-12T01:58:40.184112+0000","last_undegraded":"2024-09-12T01:58:40.184112+0000","last_fullsized":"2024-09-12T01:58:40.184112+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:55.745348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"65'1","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.126893+0000","last_change":"2024-09-12T01:58:31.086015+0000","last_active":"2024-09-12T01:58:39.126893+0000","last_peered":"2024-09-12T01:58:39.126893+0000","last_clean":"2024-09-12T01:58:39.126893+0000","last_became_active":"2024-09-12T01:58:31.085736+0000","last_became_peered":"2024-09-12T01:58:31.085736+0000","last_unstale":"2024-09-12T01:58:39.126893+0000","last_undegraded":"2024-09-12T01:58:39.126893+0000","last_fullsized":"2024-09-12T01:58:39.126893+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:58.281292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.125377+0000","last_change":"2024-09-12T01:58:32.092252+0000","last_active":"2024-09-12T01:58:39.125377+0000","last_peered":"2024-09-12T01:58:39.125377+0000","last_clean":"2024-09-12T01:58:39.125377+0000","last_became_active":"2024-09-12T01:58:32.091933+0000","last_became_peered":"2024-09-12T01:58:32.091933+0000","last_unstale":"2024-09-12T01:58:39.125377+0000","last_undegraded":"2024-09-12T01:58:39.125377+0000","last_fullsized":"2024-09-12T01:58:39.125377+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:20.410580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.126905+0000","last_change":"2024-09-12T01:58:31.078913+0000","last_active":"2024-09-12T01:58:39.126905+0000","last_peered":"2024-09-12T01:58:39.126905+0000","last_clean":"2024-09-12T01:58:39.126905+0000","last_became_active":"2024-09-12T01:58:31.078594+0000","last_became_peered":"2024-09-12T01:58:31.078594+0000","last_unstale":"2024-09-12T01:58:39.126905+0000","last_undegraded":"2024-09-12T01:58:39.126905+0000","last_fullsized":"2024-09-12T01:58:39.126905+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:32.332146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.127133+0000","last_change":"2024-09-12T01:58:32.082690+0000","last_active":"2024-09-12T01:58:39.127133+0000","last_peered":"2024-09-12T01:58:39.127133+0000","last_clean":"2024-09-12T01:58:39.127133+0000","last_became_active":"2024-09-12T01:58:32.082372+0000","last_became_peered":"2024-09-12T01:58:32.082372+0000","last_unstale":"2024-09-12T01:58:39.127133+0000","last_undegraded":"2024-09-12T01:58:39.127133+0000","last_fullsized":"2024-09-12T01:58:39.127133+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:13.919476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.124434+0000","last_change":"2024-09-12T01:58:31.084452+0000","last_active":"2024-09-12T01:58:39.124434+0000","last_peered":"2024-09-12T01:58:39.124434+0000","last_clean":"2024-09-12T01:58:39.124434+0000","last_became_active":"2024-09-12T01:58:31.084091+0000","last_became_peered":"2024-09-12T01:58:31.084091+0000","last_unstale":"2024-09-12T01:58:39.124434+0000","last_undegraded":"2024-09-12T01:58:39.124434+0000","last_fullsized":"2024-09-12T01:58:39.124434+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:02.589355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184222+0000","last_change":"2024-09-12T01:58:32.095478+0000","last_active":"2024-09-12T01:58:40.184222+0000","last_peered":"2024-09-12T01:58:40.184222+0000","last_clean":"2024-09-12T01:58:40.184222+0000","last_became_active":"2024-09-12T01:58:32.094996+0000","last_became_peered":"2024-09-12T01:58:32.094996+0000","last_unstale":"2024-09-12T01:58:40.184222+0000","last_undegraded":"2024-09-12T01:58:40.184222+0000","last_fullsized":"2024-09-12T01:58:40.184222+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:15.825443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.125784+0000","last_change":"2024-09-12T01:58:31.091023+0000","last_active":"2024-09-12T01:58:39.125784+0000","last_peered":"2024-09-12T01:58:39.125784+0000","last_clean":"2024-09-12T01:58:39.125784+0000","last_became_active":"2024-09-12T01:58:31.090814+0000","last_became_peered":"2024-09-12T01:58:31.090814+0000","last_unstale":"2024-09-12T01:58:39.125784+0000","last_undegraded":"2024-09-12T01:58:39.125784+0000","last_fullsized":"2024-09-12T01:58:39.125784+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:13.812313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.127051+0000","last_change":"2024-09-12T01:58:32.093516+0000","last_active":"2024-09-12T01:58:39.127051+0000","last_peered":"2024-09-12T01:58:39.127051+0000","last_clean":"2024-09-12T01:58:39.127051+0000","last_became_active":"2024-09-12T01:58:32.093213+0000","last_became_peered":"2024-09-12T01:58:32.093213+0000","last_unstale":"2024-09-12T01:58:39.127051+0000","last_undegraded":"2024-09-12T01:58:39.127051+0000","last_fullsized":"2024-09-12T01:58:39.127051+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:23.467846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.127559+0000","last_change":"2024-09-12T01:58:31.076858+0000","last_active":"2024-09-12T01:58:39.127559+0000","last_peered":"2024-09-12T01:58:39.127559+0000","last_clean":"2024-09-12T01:58:39.127559+0000","last_became_active":"2024-09-12T01:58:31.076593+0000","last_became_peered":"2024-09-12T01:58:31.076593+0000","last_unstale":"2024-09-12T01:58:39.127559+0000","last_undegraded":"2024-09-12T01:58:39.127559+0000","last_fullsized":"2024-09-12T01:58:39.127559+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:30.358255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.124656+0000","last_change":"2024-09-12T01:58:32.096897+0000","last_active":"2024-09-12T01:58:39.124656+0000","last_peered":"2024-09-12T01:58:39.124656+0000","last_clean":"2024-09-12T01:58:39.124656+0000","last_became_active":"2024-09-12T01:58:32.095734+0000","last_became_peered":"2024-09-12T01:58:32.095734+0000","last_unstale":"2024-09-12T01:58:39.124656+0000","last_undegraded":"2024-09-12T01:58:39.124656+0000","last_fullsized":"2024-09-12T01:58:39.124656+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:58.521341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"65'3","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.125987+0000","last_change":"2024-09-12T01:58:31.085278+0000","last_active":"2024-09-12T01:58:39.125987+0000","last_peered":"2024-09-12T01:58:39.125987+0000","last_clean":"2024-09-12T01:58:39.125987+0000","last_became_active":"2024-09-12T01:58:31.084951+0000","last_became_peered":"2024-09-12T01:58:31.084951+0000","last_unstale":"2024-09-12T01:58:39.125987+0000","last_undegraded":"2024-09-12T01:58:39.125987+0000","last_fullsized":"2024-09-12T01:58:39.125987+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:41.804439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.127796+0000","last_change":"2024-09-12T01:58:32.086718+0000","last_active":"2024-09-12T01:58:39.127796+0000","last_peered":"2024-09-12T01:58:39.127796+0000","last_clean":"2024-09-12T01:58:39.127796+0000","last_became_active":"2024-09-12T01:58:32.086444+0000","last_became_peered":"2024-09-12T01:58:32.086444+0000","last_unstale":"2024-09-12T01:58:39.127796+0000","last_undegraded":"2024-09-12T01:58:39.127796+0000","last_fullsized":"2024-09-12T01:58:39.127796+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:13.252384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"65'6","reported_seq":24,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184721+0000","last_change":"2024-09-12T01:58:31.079583+0000","last_active":"2024-09-12T01:58:40.184721+0000","last_peered":"2024-09-12T01:58:40.184721+0000","last_clean":"2024-09-12T01:58:40.184721+0000","last_became_active":"2024-09-12T01:58:31.079317+0000","last_became_peered":"2024-09-12T01:58:31.079317+0000","last_unstale":"2024-09-12T01:58:40.184721+0000","last_undegraded":"2024-09-12T01:58:40.184721+0000","last_fullsized":"2024-09-12T01:58:40.184721+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:33.047976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.129673+0000","last_change":"2024-09-12T01:58:39.128663+0000","last_active":"2024-09-12T01:58:39.129673+0000","last_peered":"2024-09-12T01:58:39.129673+0000","last_clean":"2024-09-12T01:58:39.129673+0000","last_became_active":"2024-09-12T01:58:39.128300+0000","last_became_peered":"2024-09-12T01:58:39.128300+0000","last_unstale":"2024-09-12T01:58:39.129673+0000","last_undegraded":"2024-09-12T01:58:39.129673+0000","last_fullsized":"2024-09-12T01:58:39.129673+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:16.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"65'2","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.125580+0000","last_change":"2024-09-12T01:58:31.085938+0000","last_active":"2024-09-12T01:58:39.125580+0000","last_peered":"2024-09-12T01:58:39.125580+0000","last_clean":"2024-09-12T01:58:39.125580+0000","last_became_active":"2024-09-12T01:58:31.085635+0000","last_became_peered":"2024-09-12T01:58:31.085635+0000","last_unstale":"2024-09-12T01:58:39.125580+0000","last_undegraded":"2024-09-12T01:58:39.125580+0000","last_fullsized":"2024-09-12T01:58:39.125580+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:39.540230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184606+0000","last_change":"2024-09-12T01:58:32.093963+0000","last_active":"2024-09-12T01:58:40.184606+0000","last_peered":"2024-09-12T01:58:40.184606+0000","last_clean":"2024-09-12T01:58:40.184606+0000","last_became_active":"2024-09-12T01:58:32.093588+0000","last_became_peered":"2024-09-12T01:58:32.093588+0000","last_unstale":"2024-09-12T01:58:40.184606+0000","last_undegraded":"2024-09-12T01:58:40.184606+0000","last_fullsized":"2024-09-12T01:58:40.184606+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:59.477648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184650+0000","last_change":"2024-09-12T01:58:31.083496+0000","last_active":"2024-09-12T01:58:40.184650+0000","last_peered":"2024-09-12T01:58:40.184650+0000","last_clean":"2024-09-12T01:58:40.184650+0000","last_became_active":"2024-09-12T01:58:31.083282+0000","last_became_peered":"2024-09-12T01:58:31.083282+0000","last_unstale":"2024-09-12T01:58:40.184650+0000","last_undegraded":"2024-09-12T01:58:40.184650+0000","last_fullsized":"2024-09-12T01:58:40.184650+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:39.540230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.125470+0000","last_change":"2024-09-12T01:58:32.085515+0000","last_active":"2024-09-12T01:58:39.125470+0000","last_peered":"2024-09-12T01:58:39.125470+0000","last_clean":"2024-09-12T01:58:39.125470+0000","last_became_active":"2024-09-12T01:58:32.085180+0000","last_became_peered":"2024-09-12T01:58:32.085180+0000","last_unstale":"2024-09-12T01:58:39.125470+0000","last_undegraded":"2024-09-12T01:58:39.125470+0000","last_fullsized":"2024-09-12T01:58:39.125470+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:46.112207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.125465+0000","last_change":"2024-09-12T01:58:31.085595+0000","last_active":"2024-09-12T01:58:39.125465+0000","last_peered":"2024-09-12T01:58:39.125465+0000","last_clean":"2024-09-12T01:58:39.125465+0000","last_became_active":"2024-09-12T01:58:31.085333+0000","last_became_peered":"2024-09-12T01:58:31.085333+0000","last_unstale":"2024-09-12T01:58:39.125465+0000","last_undegraded":"2024-09-12T01:58:39.125465+0000","last_fullsized":"2024-09-12T01:58:39.125465+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:47.588497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184128+0000","last_change":"2024-09-12T01:58:32.101742+0000","last_active":"2024-09-12T01:58:40.184128+0000","last_peered":"2024-09-12T01:58:40.184128+0000","last_clean":"2024-09-12T01:58:40.184128+0000","last_became_active":"2024-09-12T01:58:32.100985+0000","last_became_peered":"2024-09-12T01:58:32.100985+0000","last_unstale":"2024-09-12T01:58:40.184128+0000","last_undegraded":"2024-09-12T01:58:40.184128+0000","last_fullsized":"2024-09-12T01:58:40.184128+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:13.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"65'8","reported_seq":26,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.127190+0000","last_change":"2024-09-12T01:58:31.080233+0000","last_active":"2024-09-12T01:58:39.127190+0000","last_peered":"2024-09-12T01:58:39.127190+0000","last_clean":"2024-09-12T01:58:39.127190+0000","last_became_active":"2024-09-12T01:58:31.079923+0000","last_became_peered":"2024-09-12T01:58:31.079923+0000","last_unstale":"2024-09-12T01:58:39.127190+0000","last_undegraded":"2024-09-12T01:58:39.127190+0000","last_fullsized":"2024-09-12T01:58:39.127190+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:18.045768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.124993+0000","last_change":"2024-09-12T01:58:32.095870+0000","last_active":"2024-09-12T01:58:39.124993+0000","last_peered":"2024-09-12T01:58:39.124993+0000","last_clean":"2024-09-12T01:58:39.124993+0000","last_became_active":"2024-09-12T01:58:32.095589+0000","last_became_peered":"2024-09-12T01:58:32.095589+0000","last_unstale":"2024-09-12T01:58:39.124993+0000","last_undegraded":"2024-09-12T01:58:39.124993+0000","last_fullsized":"2024-09-12T01:58:39.124993+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:50.976465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"65'1","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.185134+0000","last_change":"2024-09-12T01:58:31.085862+0000","last_active":"2024-09-12T01:58:40.185134+0000","last_peered":"2024-09-12T01:58:40.185134+0000","last_clean":"2024-09-12T01:58:40.185134+0000","last_became_active":"2024-09-12T01:58:31.085601+0000","last_became_peered":"2024-09-12T01:58:31.085601+0000","last_unstale":"2024-09-12T01:58:40.185134+0000","last_undegraded":"2024-09-12T01:58:40.185134+0000","last_fullsized":"2024-09-12T01:58:40.185134+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:20.505778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.125078+0000","last_change":"2024-09-12T01:58:32.089389+0000","last_active":"2024-09-12T01:58:39.125078+0000","last_peered":"2024-09-12T01:58:39.125078+0000","last_clean":"2024-09-12T01:58:39.125078+0000","last_became_active":"2024-09-12T01:58:32.088821+0000","last_became_peered":"2024-09-12T01:58:32.088821+0000","last_unstale":"2024-09-12T01:58:39.125078+0000","last_undegraded":"2024-09-12T01:58:39.125078+0000","last_fullsized":"2024-09-12T01:58:39.125078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:23.327759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"65'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.130988+0000","last_change":"2024-09-12T01:58:39.130988+0000","last_active":"2024-09-12T01:58:39.130988+0000","last_peered":"2024-09-12T01:58:39.130988+0000","last_clean":"2024-09-12T01:58:39.130988+0000","last_became_active":"2024-09-12T01:58:39.128408+0000","last_became_peered":"2024-09-12T01:58:39.128408+0000","last_unstale":"2024-09-12T01:58:39.130988+0000","last_undegraded":"2024-09-12T01:58:39.130988+0000","last_fullsized":"2024-09-12T01:58:39.130988+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:59.920348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.129675+0000","last_change":"2024-09-12T01:58:39.128506+0000","last_active":"2024-09-12T01:58:39.129675+0000","last_peered":"2024-09-12T01:58:39.129675+0000","last_clean":"2024-09-12T01:58:39.129675+0000","last_became_active":"2024-09-12T01:58:39.128141+0000","last_became_peered":"2024-09-12T01:58:39.128141+0000","last_unstale":"2024-09-12T01:58:39.129675+0000","last_undegraded":"2024-09-12T01:58:39.129675+0000","last_fullsized":"2024-09-12T01:58:39.129675+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:45.094165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"65'1","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.126028+0000","last_change":"2024-09-12T01:58:31.087815+0000","last_active":"2024-09-12T01:58:39.126028+0000","last_peered":"2024-09-12T01:58:39.126028+0000","last_clean":"2024-09-12T01:58:39.126028+0000","last_became_active":"2024-09-12T01:58:31.087594+0000","last_became_peered":"2024-09-12T01:58:31.087594+0000","last_unstale":"2024-09-12T01:58:39.126028+0000","last_undegraded":"2024-09-12T01:58:39.126028+0000","last_fullsized":"2024-09-12T01:58:39.126028+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.106930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.124598+0000","last_change":"2024-09-12T01:58:32.089687+0000","last_active":"2024-09-12T01:58:39.124598+0000","last_peered":"2024-09-12T01:58:39.124598+0000","last_clean":"2024-09-12T01:58:39.124598+0000","last_became_active":"2024-09-12T01:58:32.088371+0000","last_became_peered":"2024-09-12T01:58:32.088371+0000","last_unstale":"2024-09-12T01:58:39.124598+0000","last_undegraded":"2024-09-12T01:58:39.124598+0000","last_fullsized":"2024-09-12T01:58:39.124598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:56.306443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.127232+0000","last_change":"2024-09-12T01:58:31.074406+0000","last_active":"2024-09-12T01:58:39.127232+0000","last_peered":"2024-09-12T01:58:39.127232+0000","last_clean":"2024-09-12T01:58:39.127232+0000","last_became_active":"2024-09-12T01:58:31.074068+0000","last_became_peered":"2024-09-12T01:58:31.074068+0000","last_unstale":"2024-09-12T01:58:39.127232+0000","last_undegraded":"2024-09-12T01:58:39.127232+0000","last_fullsized":"2024-09-12T01:58:39.127232+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:26.113685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.097463+0000","last_change":"2024-09-12T01:58:32.078981+0000","last_active":"2024-09-12T01:58:40.097463+0000","last_peered":"2024-09-12T01:58:40.097463+0000","last_clean":"2024-09-12T01:58:40.097463+0000","last_became_active":"2024-09-12T01:58:32.078680+0000","last_became_peered":"2024-09-12T01:58:32.078680+0000","last_unstale":"2024-09-12T01:58:40.097463+0000","last_undegraded":"2024-09-12T01:58:40.097463+0000","last_fullsized":"2024-09-12T01:58:40.097463+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:11.561895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"65'2","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.097924+0000","last_change":"2024-09-12T01:58:31.084085+0000","last_active":"2024-09-12T01:58:40.097924+0000","last_peered":"2024-09-12T01:58:40.097924+0000","last_clean":"2024-09-12T01:58:40.097924+0000","last_became_active":"2024-09-12T01:58:31.083740+0000","last_became_peered":"2024-09-12T01:58:31.083740+0000","last_unstale":"2024-09-12T01:58:40.097924+0000","last_undegraded":"2024-09-12T01:58:40.097924+0000","last_fullsized":"2024-09-12T01:58:40.097924+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:23.301991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184410+0000","last_change":"2024-09-12T01:58:32.092045+0000","last_active":"2024-09-12T01:58:40.184410+0000","last_peered":"2024-09-12T01:58:40.184410+0000","last_clean":"2024-09-12T01:58:40.184410+0000","last_became_active":"2024-09-12T01:58:32.091550+0000","last_became_peered":"2024-09-12T01:58:32.091550+0000","last_unstale":"2024-09-12T01:58:40.184410+0000","last_undegraded":"2024-09-12T01:58:40.184410+0000","last_fullsized":"2024-09-12T01:58:40.184410+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:41.371386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184920+0000","last_change":"2024-09-12T01:58:31.083500+0000","last_active":"2024-09-12T01:58:40.184920+0000","last_peered":"2024-09-12T01:58:40.184920+0000","last_clean":"2024-09-12T01:58:40.184920+0000","last_became_active":"2024-09-12T01:58:31.083304+0000","last_became_peered":"2024-09-12T01:58:31.083304+0000","last_unstale":"2024-09-12T01:58:40.184920+0000","last_undegraded":"2024-09-12T01:58:40.184920+0000","last_fullsized":"2024-09-12T01:58:40.184920+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:41.804439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.125551+0000","last_change":"2024-09-12T01:58:32.092142+0000","last_active":"2024-09-12T01:58:39.125551+0000","last_peered":"2024-09-12T01:58:39.125551+0000","last_clean":"2024-09-12T01:58:39.125551+0000","last_became_active":"2024-09-12T01:58:32.091877+0000","last_became_peered":"2024-09-12T01:58:32.091877+0000","last_unstale":"2024-09-12T01:58:39.125551+0000","last_undegraded":"2024-09-12T01:58:39.125551+0000","last_fullsized":"2024-09-12T01:58:39.125551+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:47.089578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.097694+0000","last_change":"2024-09-12T01:58:31.079762+0000","last_active":"2024-09-12T01:58:40.097694+0000","last_peered":"2024-09-12T01:58:40.097694+0000","last_clean":"2024-09-12T01:58:40.097694+0000","last_became_active":"2024-09-12T01:58:31.079490+0000","last_became_peered":"2024-09-12T01:58:31.079490+0000","last_unstale":"2024-09-12T01:58:40.097694+0000","last_undegraded":"2024-09-12T01:58:40.097694+0000","last_fullsized":"2024-09-12T01:58:40.097694+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:40.366109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.097515+0000","last_change":"2024-09-12T01:58:32.088285+0000","last_active":"2024-09-12T01:58:40.097515+0000","last_peered":"2024-09-12T01:58:40.097515+0000","last_clean":"2024-09-12T01:58:40.097515+0000","last_became_active":"2024-09-12T01:58:32.087918+0000","last_became_peered":"2024-09-12T01:58:32.087918+0000","last_unstale":"2024-09-12T01:58:40.097515+0000","last_undegraded":"2024-09-12T01:58:40.097515+0000","last_fullsized":"2024-09-12T01:58:40.097515+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:19.787633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"65'2","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.185200+0000","last_change":"2024-09-12T01:58:31.085470+0000","last_active":"2024-09-12T01:58:40.185200+0000","last_peered":"2024-09-12T01:58:40.185200+0000","last_clean":"2024-09-12T01:58:40.185200+0000","last_became_active":"2024-09-12T01:58:31.085216+0000","last_became_peered":"2024-09-12T01:58:31.085216+0000","last_unstale":"2024-09-12T01:58:40.185200+0000","last_undegraded":"2024-09-12T01:58:40.185200+0000","last_fullsized":"2024-09-12T01:58:40.185200+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:57.516064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.124593+0000","last_change":"2024-09-12T01:58:32.084136+0000","last_active":"2024-09-12T01:58:39.124593+0000","last_peered":"2024-09-12T01:58:39.124593+0000","last_clean":"2024-09-12T01:58:39.124593+0000","last_became_active":"2024-09-12T01:58:32.083827+0000","last_became_peered":"2024-09-12T01:58:32.083827+0000","last_unstale":"2024-09-12T01:58:39.124593+0000","last_undegraded":"2024-09-12T01:58:39.124593+0000","last_fullsized":"2024-09-12T01:58:39.124593+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:16.128275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"66'1","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184984+0000","last_change":"2024-09-12T01:58:31.082854+0000","last_active":"2024-09-12T01:58:40.184984+0000","last_peered":"2024-09-12T01:58:40.184984+0000","last_clean":"2024-09-12T01:58:40.184984+0000","last_became_active":"2024-09-12T01:58:31.082576+0000","last_became_peered":"2024-09-12T01:58:31.082576+0000","last_unstale":"2024-09-12T01:58:40.184984+0000","last_undegraded":"2024-09-12T01:58:40.184984+0000","last_fullsized":"2024-09-12T01:58:40.184984+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:55.301165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184767+0000","last_change":"2024-09-12T01:58:32.094795+0000","last_active":"2024-09-12T01:58:40.184767+0000","last_peered":"2024-09-12T01:58:40.184767+0000","last_clean":"2024-09-12T01:58:40.184767+0000","last_became_active":"2024-09-12T01:58:32.093598+0000","last_became_peered":"2024-09-12T01:58:32.093598+0000","last_unstale":"2024-09-12T01:58:40.184767+0000","last_undegraded":"2024-09-12T01:58:40.184767+0000","last_fullsized":"2024-09-12T01:58:40.184767+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.413296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.097998+0000","last_change":"2024-09-12T01:58:31.086458+0000","last_active":"2024-09-12T01:58:40.097998+0000","last_peered":"2024-09-12T01:58:40.097998+0000","last_clean":"2024-09-12T01:58:40.097998+0000","last_became_active":"2024-09-12T01:58:31.086155+0000","last_became_peered":"2024-09-12T01:58:31.086155+0000","last_unstale":"2024-09-12T01:58:40.097998+0000","last_undegraded":"2024-09-12T01:58:40.097998+0000","last_fullsized":"2024-09-12T01:58:40.097998+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:58.472371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.124518+0000","last_change":"2024-09-12T01:58:32.083243+0000","last_active":"2024-09-12T01:58:39.124518+0000","last_peered":"2024-09-12T01:58:39.124518+0000","last_clean":"2024-09-12T01:58:39.124518+0000","last_became_active":"2024-09-12T01:58:32.082988+0000","last_became_peered":"2024-09-12T01:58:32.082988+0000","last_unstale":"2024-09-12T01:58:39.124518+0000","last_undegraded":"2024-09-12T01:58:39.124518+0000","last_fullsized":"2024-09-12T01:58:39.124518+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:21.511055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184718+0000","last_change":"2024-09-12T01:58:31.077535+0000","last_active":"2024-09-12T01:58:40.184718+0000","last_peered":"2024-09-12T01:58:40.184718+0000","last_clean":"2024-09-12T01:58:40.184718+0000","last_became_active":"2024-09-12T01:58:31.077058+0000","last_became_peered":"2024-09-12T01:58:31.077058+0000","last_unstale":"2024-09-12T01:58:40.184718+0000","last_undegraded":"2024-09-12T01:58:40.184718+0000","last_fullsized":"2024-09-12T01:58:40.184718+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:10.416486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.124343+0000","last_change":"2024-09-12T01:58:32.099028+0000","last_active":"2024-09-12T01:58:39.124343+0000","last_peered":"2024-09-12T01:58:39.124343+0000","last_clean":"2024-09-12T01:58:39.124343+0000","last_became_active":"2024-09-12T01:58:32.098748+0000","last_became_peered":"2024-09-12T01:58:32.098748+0000","last_unstale":"2024-09-12T01:58:39.124343+0000","last_undegraded":"2024-09-12T01:58:39.124343+0000","last_fullsized":"2024-09-12T01:58:39.124343+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:42.809716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.125674+0000","last_change":"2024-09-12T01:58:31.090527+0000","last_active":"2024-09-12T01:58:39.125674+0000","last_peered":"2024-09-12T01:58:39.125674+0000","last_clean":"2024-09-12T01:58:39.125674+0000","last_became_active":"2024-09-12T01:58:31.090284+0000","last_became_peered":"2024-09-12T01:58:31.090284+0000","last_unstale":"2024-09-12T01:58:39.125674+0000","last_undegraded":"2024-09-12T01:58:39.125674+0000","last_fullsized":"2024-09-12T01:58:39.125674+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:55.301165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.127161+0000","last_change":"2024-09-12T01:58:32.089933+0000","last_active":"2024-09-12T01:58:39.127161+0000","last_peered":"2024-09-12T01:58:39.127161+0000","last_clean":"2024-09-12T01:58:39.127161+0000","last_became_active":"2024-09-12T01:58:32.089694+0000","last_became_peered":"2024-09-12T01:58:32.089694+0000","last_unstale":"2024-09-12T01:58:39.127161+0000","last_undegraded":"2024-09-12T01:58:39.127161+0000","last_fullsized":"2024-09-12T01:58:39.127161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:33.295546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.127154+0000","last_change":"2024-09-12T01:58:31.076859+0000","last_active":"2024-09-12T01:58:39.127154+0000","last_peered":"2024-09-12T01:58:39.127154+0000","last_clean":"2024-09-12T01:58:39.127154+0000","last_became_active":"2024-09-12T01:58:31.076488+0000","last_became_peered":"2024-09-12T01:58:31.076488+0000","last_unstale":"2024-09-12T01:58:39.127154+0000","last_undegraded":"2024-09-12T01:58:39.127154+0000","last_fullsized":"2024-09-12T01:58:39.127154+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:47.205697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184123+0000","last_change":"2024-09-12T01:58:32.099717+0000","last_active":"2024-09-12T01:58:40.184123+0000","last_peered":"2024-09-12T01:58:40.184123+0000","last_clean":"2024-09-12T01:58:40.184123+0000","last_became_active":"2024-09-12T01:58:32.099398+0000","last_became_peered":"2024-09-12T01:58:32.099398+0000","last_unstale":"2024-09-12T01:58:40.184123+0000","last_undegraded":"2024-09-12T01:58:40.184123+0000","last_fullsized":"2024-09-12T01:58:40.184123+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:56.968157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.127016+0000","last_change":"2024-09-12T01:58:31.078174+0000","last_active":"2024-09-12T01:58:39.127016+0000","last_peered":"2024-09-12T01:58:39.127016+0000","last_clean":"2024-09-12T01:58:39.127016+0000","last_became_active":"2024-09-12T01:58:31.077722+0000","last_became_peered":"2024-09-12T01:58:31.077722+0000","last_unstale":"2024-09-12T01:58:39.127016+0000","last_undegraded":"2024-09-12T01:58:39.127016+0000","last_fullsized":"2024-09-12T01:58:39.127016+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:04.459773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.124561+0000","last_change":"2024-09-12T01:58:32.092706+0000","last_active":"2024-09-12T01:58:39.124561+0000","last_peered":"2024-09-12T01:58:39.124561+0000","last_clean":"2024-09-12T01:58:39.124561+0000","last_became_active":"2024-09-12T01:58:32.092407+0000","last_became_peered":"2024-09-12T01:58:32.092407+0000","last_unstale":"2024-09-12T01:58:39.124561+0000","last_undegraded":"2024-09-12T01:58:39.124561+0000","last_fullsized":"2024-09-12T01:58:39.124561+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:09.461358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:40.184390+0000","last_change":"2024-09-12T01:58:31.083451+0000","last_active":"2024-09-12T01:58:40.184390+0000","last_peered":"2024-09-12T01:58:40.184390+0000","last_clean":"2024-09-12T01:58:40.184390+0000","last_became_active":"2024-09-12T01:58:31.083133+0000","last_became_peered":"2024-09-12T01:58:31.083133+0000","last_unstale":"2024-09-12T01:58:40.184390+0000","last_undegraded":"2024-09-12T01:58:40.184390+0000","last_fullsized":"2024-09-12T01:58:40.184390+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:21.347164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.125024+0000","last_change":"2024-09-12T01:58:32.096326+0000","last_active":"2024-09-12T01:58:39.125024+0000","last_peered":"2024-09-12T01:58:39.125024+0000","last_clean":"2024-09-12T01:58:39.125024+0000","last_became_active":"2024-09-12T01:58:32.096061+0000","last_became_peered":"2024-09-12T01:58:32.096061+0000","last_unstale":"2024-09-12T01:58:39.125024+0000","last_undegraded":"2024-09-12T01:58:39.125024+0000","last_fullsized":"2024-09-12T01:58:39.125024+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:31.060135+0000","last_clean_scrub_stamp":"2024-09-12T01:58:31.060135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:40.545508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.126831+0000","last_change":"2024-09-12T01:58:31.084470+0000","last_active":"2024-09-12T01:58:39.126831+0000","last_peered":"2024-09-12T01:58:39.126831+0000","last_clean":"2024-09-12T01:58:39.126831+0000","last_became_active":"2024-09-12T01:58:31.084172+0000","last_became_peered":"2024-09-12T01:58:31.084172+0000","last_unstale":"2024-09-12T01:58:39.126831+0000","last_undegraded":"2024-09-12T01:58:39.126831+0000","last_fullsized":"2024-09-12T01:58:39.126831+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:58:30.054858+0000","last_clean_scrub_stamp":"2024-09-12T01:58:30.054858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:29.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":255,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:58:39.124680+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T01:58:39.124680+0000","last_peered":"2024-09-12T01:58:39.124680+0000","last_clean":"2024-09-12T01:58:39.124680+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T01:58:39.124680+0000","last_undegraded":"2024-09-12T01:58:39.124680+0000","last_fullsized":"2024-09-12T01:58:39.124680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28420,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343420,"statfs":{"total":96636764160,"available":96607662080,"internally_reserved":0,"allocated":1425408,"data_stored":963536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":372426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":372414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":372392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542184,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":372392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542184,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":843776,"data_stored":374768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542184,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1409024,"data_stored":962760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":827392,"data_stored":374004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:58:44.216 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:58:44.216 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T01:58:44.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.362+0000 7f4cf701e640 1 Processor -- start 2024-09-12T01:58:44.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.362+0000 7f4cf701e640 1 -- start start 2024-09-12T01:58:44.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.363+0000 7f4cf701e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4cf00d5090 0x7f4cf00cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.363+0000 7f4cf701e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf00cfee0 con 0x7f4cf015e6c0 2024-09-12T01:58:44.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.363+0000 7f4cf701e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf00d34f0 con 0x7f4cf00cfae0 2024-09-12T01:58:44.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.363+0000 7f4cf701e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf00cf400 con 0x7f4cf00d5090 2024-09-12T01:58:44.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.363+0000 7f4cf4dba640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4cf015e6c0 0x7f4cf00cebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56506/0 (socket says 172.21.15.19:56506) 2024-09-12T01:58:44.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.363+0000 7f4cf4dba640 1 -- 172.21.15.19:0/1956300173 learned_addr learned my addr 172.21.15.19:0/1956300173 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:44.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4ceffff640 1 --2- 172.21.15.19:0/1956300173 >> v2:172.21.15.135:3300/0 conn(0x7f4cf00d5090 0x7f4cf00cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cef7fe640 1 -- 172.21.15.19:0/1956300173 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2150173901 0 0) 0x7f4cf00cfee0 con 0x7f4cf015e6c0 2024-09-12T01:58:44.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cef7fe640 1 -- 172.21.15.19:0/1956300173 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cd8003520 con 0x7f4cf015e6c0 2024-09-12T01:58:44.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cef7fe640 1 -- 172.21.15.19:0/1956300173 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3458483366 0 0) 0x7f4cd8003520 con 0x7f4cf015e6c0 2024-09-12T01:58:44.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cef7fe640 1 -- 172.21.15.19:0/1956300173 >> v2:172.21.15.135:3300/0 conn(0x7f4cf00d5090 msgr2=0x7f4cf00cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:44.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cef7fe640 1 --2- 172.21.15.19:0/1956300173 >> v2:172.21.15.135:3300/0 conn(0x7f4cf00d5090 0x7f4cf00cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cef7fe640 1 -- 172.21.15.19:0/1956300173 >> v1:172.21.15.135:6789/0 conn(0x7f4cf00cfae0 legacy=0x7f4cf00b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cef7fe640 1 -- 172.21.15.19:0/1956300173 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf00d3790 con 0x7f4cf015e6c0 2024-09-12T01:58:44.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cef7fe640 1 -- 172.21.15.19:0/1956300173 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f4ce0001670 con 0x7f4cf015e6c0 2024-09-12T01:58:44.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cef7fe640 1 -- 172.21.15.19:0/1956300173 >> v1:172.21.15.19:6789/0 conn(0x7f4cf015e6c0 legacy=0x7f4cf00cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cef7fe640 1 --2- 172.21.15.19:0/1956300173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cd80039b0 0x7f4cd8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cef7fe640 1 --2- 172.21.15.19:0/1956300173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cd8004800 0x7f4cd8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cef7fe640 1 --2- 172.21.15.19:0/1956300173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cd80051c0 0x7f4cd800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cef7fe640 1 -- 172.21.15.19:0/1956300173 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf00cf400 con 0x7f4cd8004800 2024-09-12T01:58:44.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cef7fe640 1 -- 172.21.15.19:0/1956300173 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd800c160 con 0x7f4cd80051c0 2024-09-12T01:58:44.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cef7fe640 1 -- 172.21.15.19:0/1956300173 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd800c360 con 0x7f4cd80039b0 2024-09-12T01:58:44.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4ceffff640 1 --2- 172.21.15.19:0/1956300173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cd8004800 0x7f4cd8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cf4dba640 1 --2- 172.21.15.19:0/1956300173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cd80039b0 0x7f4cd8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cf55bb640 1 --2- 172.21.15.19:0/1956300173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cd80051c0 0x7f4cd800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4ceffff640 1 -- 172.21.15.19:0/1956300173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cd80039b0 msgr2=0x7f4cd8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:44.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4ceffff640 1 --2- 172.21.15.19:0/1956300173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cd80039b0 0x7f4cd8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4ceffff640 1 -- 172.21.15.19:0/1956300173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cd80051c0 msgr2=0x7f4cd800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:44.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4ceffff640 1 --2- 172.21.15.19:0/1956300173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cd80051c0 0x7f4cd800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4ceffff640 1 -- 172.21.15.19:0/1956300173 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd8003520 con 0x7f4cd8004800 2024-09-12T01:58:44.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cf4dba640 1 --2- 172.21.15.19:0/1956300173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cd80039b0 0x7f4cd8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:44.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cf55bb640 1 --2- 172.21.15.19:0/1956300173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cd80051c0 0x7f4cd800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:44.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.364+0000 7f4cf55bb640 1 -- 172.21.15.19:0/1956300173 reap_dead start 2024-09-12T01:58:44.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.365+0000 7f4ceffff640 1 --2- 172.21.15.19:0/1956300173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cd8004800 0x7f4cd8004c80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4009ac0 tx=0x7f4cd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4523dc4d59018c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:44.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.365+0000 7f4cef7fe640 1 -- 172.21.15.19:0/1956300173 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4036070 con 0x7f4cd8004800 2024-09-12T01:58:44.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.365+0000 7f4cef7fe640 1 -- 172.21.15.19:0/1956300173 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce4031400 con 0x7f4cd8004800 2024-09-12T01:58:44.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.365+0000 7f4cef7fe640 1 -- 172.21.15.19:0/1956300173 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4009690 con 0x7f4cd8004800 2024-09-12T01:58:44.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.366+0000 7f4cf701e640 1 -- 172.21.15.19:0/1956300173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cd8004800 msgr2=0x7f4cd8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.366+0000 7f4cf701e640 1 --2- 172.21.15.19:0/1956300173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cd8004800 0x7f4cd8004c80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4009ac0 tx=0x7f4cd8005830 comp rx=0 tx=0).stop 2024-09-12T01:58:44.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.366+0000 7f4cf701e640 1 -- 172.21.15.19:0/1956300173 shutdown_connections 2024-09-12T01:58:44.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.366+0000 7f4cf701e640 1 --2- 172.21.15.19:0/1956300173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cd8004800 0x7f4cd8004c80 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.366+0000 7f4cf701e640 1 -- 172.21.15.19:0/1956300173 >> 172.21.15.19:0/1956300173 conn(0x7f4cf008bfc0 msgr2=0x7f4cf00d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:44.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.366+0000 7f4cf701e640 1 -- 172.21.15.19:0/1956300173 shutdown_connections 2024-09-12T01:58:44.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.366+0000 7f4cf701e640 1 -- 172.21.15.19:0/1956300173 wait complete. 2024-09-12T01:58:44.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.367+0000 7f4cf701e640 1 Processor -- start 2024-09-12T01:58:44.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.367+0000 7f4cf701e640 1 -- start start 2024-09-12T01:58:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.368+0000 7f4cf701e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cd8004800 0x7f4cf0156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.368+0000 7f4cf701e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cf00b24b0 0x7f4cf00b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.368+0000 7f4cf701e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cf01600a0 0x7f4cf0160500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.368+0000 7f4cf701e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf015eaa0 con 0x7f4cf01600a0 2024-09-12T01:58:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.368+0000 7f4cf701e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf00b10d0 con 0x7f4cf00b24b0 2024-09-12T01:58:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.368+0000 7f4cf701e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf015ec20 con 0x7f4cd8004800 2024-09-12T01:58:44.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.368+0000 7f4cf55bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cf01600a0 0x7f4cf0160500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.368+0000 7f4cf55bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cf01600a0 0x7f4cf0160500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58052/0 (socket says 172.21.15.19:58052) 2024-09-12T01:58:44.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.368+0000 7f4cf55bb640 1 -- 172.21.15.19:0/2664226177 learned_addr learned my addr 172.21.15.19:0/2664226177 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:44.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.368+0000 7f4ceffff640 1 --2- 172.21.15.19:0/2664226177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cf00b24b0 0x7f4cf00b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.368+0000 7f4cf4dba640 1 --2- 172.21.15.19:0/2664226177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cd8004800 0x7f4cf0156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.369+0000 7f4cf55bb640 1 -- 172.21.15.19:0/2664226177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cd8004800 msgr2=0x7f4cf0156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.369+0000 7f4cf55bb640 1 --2- 172.21.15.19:0/2664226177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cd8004800 0x7f4cf0156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.369+0000 7f4cf55bb640 1 -- 172.21.15.19:0/2664226177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cf00b24b0 msgr2=0x7f4cf00b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.369+0000 7f4cf55bb640 1 --2- 172.21.15.19:0/2664226177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cf00b24b0 0x7f4cf00b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.369+0000 7f4cf55bb640 1 -- 172.21.15.19:0/2664226177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf0160a40 con 0x7f4cf01600a0 2024-09-12T01:58:44.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.369+0000 7f4cf55bb640 1 --2- 172.21.15.19:0/2664226177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cf01600a0 0x7f4cf0160500 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00b7130 tx=0x7f4ce800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:44.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.369+0000 7f4ced7fa640 1 -- 172.21.15.19:0/2664226177 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8003970 con 0x7f4cf01600a0 2024-09-12T01:58:44.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.369+0000 7f4ced7fa640 1 -- 172.21.15.19:0/2664226177 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce8018070 con 0x7f4cf01600a0 2024-09-12T01:58:44.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.369+0000 7f4cf701e640 1 -- 172.21.15.19:0/2664226177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf015eff0 con 0x7f4cf01600a0 2024-09-12T01:58:44.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.369+0000 7f4ced7fa640 1 -- 172.21.15.19:0/2664226177 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8003d50 con 0x7f4cf01600a0 2024-09-12T01:58:44.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.369+0000 7f4cf701e640 1 -- 172.21.15.19:0/2664226177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf015f5b0 con 0x7f4cf01600a0 2024-09-12T01:58:44.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.370+0000 7f4cf701e640 1 -- 172.21.15.19:0/2664226177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf00cf5a0 con 0x7f4cf01600a0 2024-09-12T01:58:44.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.371+0000 7f4ced7fa640 1 -- 172.21.15.19:0/2664226177 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ce80050d0 con 0x7f4cf01600a0 2024-09-12T01:58:44.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.371+0000 7f4ced7fa640 1 --2- 172.21.15.19:0/2664226177 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4cdc06be30 0x7f4cdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.371+0000 7f4ced7fa640 1 -- 172.21.15.19:0/2664226177 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6217+0+0 (secure 0 0 0) 0x7f4ce808ab00 con 0x7f4cf01600a0 2024-09-12T01:58:44.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.371+0000 7f4cf4dba640 1 --2- 172.21.15.19:0/2664226177 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4cdc06be30 0x7f4cdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.372+0000 7f4cf4dba640 1 --2- 172.21.15.19:0/2664226177 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4cdc06be30 0x7f4cdc06e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00b3350 tx=0x7f4ce0007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:44.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.375+0000 7f4ced7fa640 1 -- 172.21.15.19:0/2664226177 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ce8058db0 con 0x7f4cf01600a0 2024-09-12T01:58:44.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.615+0000 7f4cf701e640 1 -- 172.21.15.19:0/2664226177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f4cf015ce40 con 0x7f4cf01600a0 2024-09-12T01:58:44.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.620+0000 7f4ced7fa640 1 -- 172.21.15.19:0/2664226177 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f4ce805d0b0 con 0x7f4cf01600a0 2024-09-12T01:58:44.620 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-09-12T01:58:44.620 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDwSeJmfHbXIRAALAvdYAlaB6WxWtubFnlxRw== 2024-09-12T01:58:44.620 INFO:teuthology.orchestra.run.smithi019.stdout: caps mds = "allow" 2024-09-12T01:58:44.620 INFO:teuthology.orchestra.run.smithi019.stdout: caps mon = "allow r" 2024-09-12T01:58:44.620 INFO:teuthology.orchestra.run.smithi019.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T01:58:44.620 INFO:teuthology.orchestra.run.smithi019.stderr:updated caps for client.0 2024-09-12T01:58:44.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.622+0000 7f4cf701e640 1 -- 172.21.15.19:0/2664226177 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4cdc06be30 msgr2=0x7f4cdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.622+0000 7f4cf701e640 1 --2- 172.21.15.19:0/2664226177 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4cdc06be30 0x7f4cdc06e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00b3350 tx=0x7f4ce0007040 comp rx=0 tx=0).stop 2024-09-12T01:58:44.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.622+0000 7f4cf701e640 1 -- 172.21.15.19:0/2664226177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cf01600a0 msgr2=0x7f4cf0160500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.622+0000 7f4cf701e640 1 --2- 172.21.15.19:0/2664226177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cf01600a0 0x7f4cf0160500 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00b7130 tx=0x7f4ce800eb90 comp rx=0 tx=0).stop 2024-09-12T01:58:44.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.622+0000 7f4cf701e640 1 -- 172.21.15.19:0/2664226177 shutdown_connections 2024-09-12T01:58:44.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.622+0000 7f4cf701e640 1 --2- 172.21.15.19:0/2664226177 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4cdc06be30 0x7f4cdc06e2f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.622+0000 7f4cf701e640 1 --2- 172.21.15.19:0/2664226177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cf01600a0 0x7f4cf0160500 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.622+0000 7f4cf701e640 1 --2- 172.21.15.19:0/2664226177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cf00b24b0 0x7f4cf00b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.622+0000 7f4cf701e640 1 --2- 172.21.15.19:0/2664226177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cd8004800 0x7f4cf0156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.622+0000 7f4cf701e640 1 -- 172.21.15.19:0/2664226177 >> 172.21.15.19:0/2664226177 conn(0x7f4cf008bfc0 msgr2=0x7f4cf00b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:44.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.622+0000 7f4cf701e640 1 -- 172.21.15.19:0/2664226177 shutdown_connections 2024-09-12T01:58:44.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.622+0000 7f4cf701e640 1 -- 172.21.15.19:0/2664226177 wait complete. 2024-09-12T01:58:44.633 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:58:44.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.734+0000 7fc74a2b7640 1 Processor -- start 2024-09-12T01:58:44.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.735+0000 7fc74a2b7640 1 -- start start 2024-09-12T01:58:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.735+0000 7fc74a2b7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc74415d3e0 0x7fc7440ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.735+0000 7fc74a2b7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc74415d870 con 0x7fc7440ce8b0 2024-09-12T01:58:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.735+0000 7fc74a2b7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7440d00a0 con 0x7fc7440d06e0 2024-09-12T01:58:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.735+0000 7fc74a2b7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc74409b080 con 0x7fc74415d3e0 2024-09-12T01:58:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc7437fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc7440ce8b0 0x7fc74409b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56510/0 (socket says 172.21.15.19:56510) 2024-09-12T01:58:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc7437fe640 1 -- 172.21.15.19:0/3086809852 learned_addr learned my addr 172.21.15.19:0/3086809852 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc742ffd640 1 -- 172.21.15.19:0/3086809852 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2495951607 0 0) 0x7fc74415d870 con 0x7fc7440ce8b0 2024-09-12T01:58:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc748854640 1 --2- 172.21.15.19:0/3086809852 >> v2:172.21.15.135:3300/0 conn(0x7fc74415d3e0 0x7fc7440ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc742ffd640 1 -- 172.21.15.19:0/3086809852 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc72c003520 con 0x7fc7440ce8b0 2024-09-12T01:58:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc742ffd640 1 -- 172.21.15.19:0/3086809852 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3919553226 0 0) 0x7fc72c003520 con 0x7fc7440ce8b0 2024-09-12T01:58:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc742ffd640 1 -- 172.21.15.19:0/3086809852 >> v2:172.21.15.135:3300/0 conn(0x7fc74415d3e0 msgr2=0x7fc7440ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc742ffd640 1 --2- 172.21.15.19:0/3086809852 >> v2:172.21.15.135:3300/0 conn(0x7fc74415d3e0 0x7fc7440ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc742ffd640 1 -- 172.21.15.19:0/3086809852 >> v1:172.21.15.135:6789/0 conn(0x7fc7440d06e0 legacy=0x7fc7440d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc742ffd640 1 -- 172.21.15.19:0/3086809852 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7440d0380 con 0x7fc7440ce8b0 2024-09-12T01:58:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc742ffd640 1 -- 172.21.15.19:0/3086809852 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fc738001670 con 0x7fc7440ce8b0 2024-09-12T01:58:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc742ffd640 1 -- 172.21.15.19:0/3086809852 >> v1:172.21.15.19:6789/0 conn(0x7fc7440ce8b0 legacy=0x7fc74409b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc742ffd640 1 --2- 172.21.15.19:0/3086809852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc72c003a00 0x7fc72c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc742ffd640 1 --2- 172.21.15.19:0/3086809852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc72c004800 0x7fc72c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc742ffd640 1 --2- 172.21.15.19:0/3086809852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc72c0051c0 0x7fc72c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc742ffd640 1 -- 172.21.15.19:0/3086809852 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc74409b080 con 0x7fc72c003a00 2024-09-12T01:58:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc742ffd640 1 -- 172.21.15.19:0/3086809852 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc72c00c0c0 con 0x7fc72c004800 2024-09-12T01:58:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc742ffd640 1 -- 172.21.15.19:0/3086809852 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc72c00c2c0 con 0x7fc72c0051c0 2024-09-12T01:58:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc743fff640 1 --2- 172.21.15.19:0/3086809852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc72c003a00 0x7fc72c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc7437fe640 1 --2- 172.21.15.19:0/3086809852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc72c004800 0x7fc72c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.736+0000 7fc748854640 1 --2- 172.21.15.19:0/3086809852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc72c0051c0 0x7fc72c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.737+0000 7fc743fff640 1 -- 172.21.15.19:0/3086809852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc72c0051c0 msgr2=0x7fc72c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:44.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.737+0000 7fc743fff640 1 --2- 172.21.15.19:0/3086809852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc72c0051c0 0x7fc72c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.737+0000 7fc743fff640 1 -- 172.21.15.19:0/3086809852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc72c004800 msgr2=0x7fc72c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:44.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.737+0000 7fc743fff640 1 --2- 172.21.15.19:0/3086809852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc72c004800 0x7fc72c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.737+0000 7fc743fff640 1 -- 172.21.15.19:0/3086809852 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72c003520 con 0x7fc72c003a00 2024-09-12T01:58:44.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.737+0000 7fc748854640 1 -- 172.21.15.19:0/3086809852 reap_dead start 2024-09-12T01:58:44.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.737+0000 7fc743fff640 1 --2- 172.21.15.19:0/3086809852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc72c003a00 0x7fc72c003e20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc734001750 tx=0x7fc72c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3b82dcb12e5f54 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:44.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.737+0000 7fc742ffd640 1 -- 172.21.15.19:0/3086809852 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc734001370 con 0x7fc72c003a00 2024-09-12T01:58:44.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.737+0000 7fc742ffd640 1 -- 172.21.15.19:0/3086809852 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7340052d0 con 0x7fc72c003a00 2024-09-12T01:58:44.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.737+0000 7fc742ffd640 1 -- 172.21.15.19:0/3086809852 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73402abc0 con 0x7fc72c003a00 2024-09-12T01:58:44.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.738+0000 7fc74a2b7640 1 -- 172.21.15.19:0/3086809852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc72c003a00 msgr2=0x7fc72c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.738+0000 7fc74a2b7640 1 --2- 172.21.15.19:0/3086809852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc72c003a00 0x7fc72c003e20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc734001750 tx=0x7fc72c005830 comp rx=0 tx=0).stop 2024-09-12T01:58:44.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.738+0000 7fc74a2b7640 1 -- 172.21.15.19:0/3086809852 shutdown_connections 2024-09-12T01:58:44.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.738+0000 7fc74a2b7640 1 --2- 172.21.15.19:0/3086809852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc72c003a00 0x7fc72c003e20 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.738+0000 7fc74a2b7640 1 -- 172.21.15.19:0/3086809852 >> 172.21.15.19:0/3086809852 conn(0x7fc7440d23a0 msgr2=0x7fc7440d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:44.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.738+0000 7fc74a2b7640 1 -- 172.21.15.19:0/3086809852 shutdown_connections 2024-09-12T01:58:44.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.738+0000 7fc74a2b7640 1 -- 172.21.15.19:0/3086809852 wait complete. 2024-09-12T01:58:44.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.739+0000 7fc74a2b7640 1 Processor -- start 2024-09-12T01:58:44.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.739+0000 7fc74a2b7640 1 -- start start 2024-09-12T01:58:44.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.740+0000 7fc74a2b7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc72c003a00 0x7fc7440b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.740+0000 7fc74a2b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc744159680 0x7fc7440b79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.740+0000 7fc74a2b7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7440c9470 0x7fc7440c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.740+0000 7fc74a2b7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc74415c740 con 0x7fc744159680 2024-09-12T01:58:44.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.740+0000 7fc74a2b7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc74409ad10 con 0x7fc72c003a00 2024-09-12T01:58:44.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.740+0000 7fc74a2b7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc7440d0ac0 con 0x7fc7440c9470 2024-09-12T01:58:44.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.740+0000 7fc7437fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc744159680 0x7fc7440b79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.740+0000 7fc7437fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc744159680 0x7fc7440b79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58066/0 (socket says 172.21.15.19:58066) 2024-09-12T01:58:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.740+0000 7fc7437fe640 1 -- 172.21.15.19:0/947433281 learned_addr learned my addr 172.21.15.19:0/947433281 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.740+0000 7fc748854640 1 --2- 172.21.15.19:0/947433281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7440c9470 0x7fc7440c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.740+0000 7fc743fff640 1 --2- 172.21.15.19:0/947433281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc72c003a00 0x7fc7440b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.741+0000 7fc7437fe640 1 -- 172.21.15.19:0/947433281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7440c9470 msgr2=0x7fc7440c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.741+0000 7fc7437fe640 1 --2- 172.21.15.19:0/947433281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7440c9470 0x7fc7440c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.741+0000 7fc7437fe640 1 -- 172.21.15.19:0/947433281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc72c003a00 msgr2=0x7fc7440b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.741+0000 7fc7437fe640 1 --2- 172.21.15.19:0/947433281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc72c003a00 0x7fc7440b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.741+0000 7fc7437fe640 1 -- 172.21.15.19:0/947433281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7440c7e30 con 0x7fc744159680 2024-09-12T01:58:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.741+0000 7fc7437fe640 1 --2- 172.21.15.19:0/947433281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc744159680 0x7fc7440b79e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc73800e730 tx=0x7fc73800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.741+0000 7fc740ff9640 1 -- 172.21.15.19:0/947433281 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73800c660 con 0x7fc744159680 2024-09-12T01:58:44.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.741+0000 7fc740ff9640 1 -- 172.21.15.19:0/947433281 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc738018070 con 0x7fc744159680 2024-09-12T01:58:44.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.741+0000 7fc740ff9640 1 -- 172.21.15.19:0/947433281 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73800ca40 con 0x7fc744159680 2024-09-12T01:58:44.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.741+0000 7fc74a2b7640 1 -- 172.21.15.19:0/947433281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7440c8110 con 0x7fc744159680 2024-09-12T01:58:44.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.741+0000 7fc74a2b7640 1 -- 172.21.15.19:0/947433281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7441e7bc0 con 0x7fc744159680 2024-09-12T01:58:44.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.742+0000 7fc74a2b7640 1 -- 172.21.15.19:0/947433281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7441e7dc0 con 0x7fc744159680 2024-09-12T01:58:44.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.743+0000 7fc740ff9640 1 -- 172.21.15.19:0/947433281 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc73800cbe0 con 0x7fc744159680 2024-09-12T01:58:44.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.743+0000 7fc740ff9640 1 --2- 172.21.15.19:0/947433281 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc73006be60 0x7fc73006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.743+0000 7fc740ff9640 1 -- 172.21.15.19:0/947433281 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6217+0+0 (secure 0 0 0) 0x7fc73808ab70 con 0x7fc744159680 2024-09-12T01:58:44.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.743+0000 7fc743fff640 1 --2- 172.21.15.19:0/947433281 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc73006be60 0x7fc73006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.744+0000 7fc743fff640 1 --2- 172.21.15.19:0/947433281 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc73006be60 0x7fc73006e320 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc734032000 tx=0x7fc73402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:44.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.747+0000 7fc740ff9640 1 -- 172.21.15.19:0/947433281 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc7441e7dc0 con 0x7fc744159680 2024-09-12T01:58:44.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.960+0000 7fc74a2b7640 1 -- 172.21.15.19:0/947433281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7440d0e20 con 0x7fc744159680 2024-09-12T01:58:44.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.961+0000 7fc740ff9640 1 -- 172.21.15.19:0/947433281 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5227 (secure 0 0 0) 0x7fc7440d0e20 con 0x7fc744159680 2024-09-12T01:58:44.961 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:44.962 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":41,"btime":"2024-09-12T01:58:34:091092+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2176310149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2176310149},{"type":"v1","addr":"172.21.15.135:6836","nonce":2176310149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/222313950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":222313950},{"type":"v1","addr":"172.21.15.135:6837","nonce":222313950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/2113904472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2113904472},{"type":"v1","addr":"172.21.15.19:6834","nonce":2113904472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:58:31.431304+0000","modified":"2024-09-12T01:58:33.435055+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/1551156711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1551156711},{"type":"v1","addr":"172.21.15.19:6835","nonce":1551156711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":4}]} 2024-09-12T01:58:44.962 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 41 2024-09-12T01:58:44.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.963+0000 7fc74a2b7640 1 -- 172.21.15.19:0/947433281 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc73006be60 msgr2=0x7fc73006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.963+0000 7fc74a2b7640 1 --2- 172.21.15.19:0/947433281 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc73006be60 0x7fc73006e320 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc734032000 tx=0x7fc73402e000 comp rx=0 tx=0).stop 2024-09-12T01:58:44.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.963+0000 7fc74a2b7640 1 -- 172.21.15.19:0/947433281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc744159680 msgr2=0x7fc7440b79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.963+0000 7fc74a2b7640 1 --2- 172.21.15.19:0/947433281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc744159680 0x7fc7440b79e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc73800e730 tx=0x7fc73800ebf0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.963+0000 7fc74a2b7640 1 -- 172.21.15.19:0/947433281 shutdown_connections 2024-09-12T01:58:44.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.963+0000 7fc74a2b7640 1 --2- 172.21.15.19:0/947433281 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc73006be60 0x7fc73006e320 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.963+0000 7fc74a2b7640 1 --2- 172.21.15.19:0/947433281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7440c9470 0x7fc7440c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.963+0000 7fc74a2b7640 1 --2- 172.21.15.19:0/947433281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc744159680 0x7fc7440b79e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.963+0000 7fc74a2b7640 1 --2- 172.21.15.19:0/947433281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc72c003a00 0x7fc7440b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.963+0000 7fc74a2b7640 1 -- 172.21.15.19:0/947433281 >> 172.21.15.19:0/947433281 conn(0x7fc7440d23a0 msgr2=0x7fc74409b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:44.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.963+0000 7fc74a2b7640 1 -- 172.21.15.19:0/947433281 shutdown_connections 2024-09-12T01:58:44.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:44.963+0000 7fc74a2b7640 1 -- 172.21.15.19:0/947433281 wait complete. 2024-09-12T01:58:45.378 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:58:31.431304+0000', 'modified': '2024-09-12T01:58:33.435055+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5868}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5868': {'gid': 5868, 'name': 'c', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.19:6835/1551156711', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6833', 'nonce': 1551156711}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 1551156711}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5868, 'qdb_cluster': [5868]} 2024-09-12T01:58:45.378 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:58:45.378 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T01:58:45.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.485+0000 7f89f6991640 1 Processor -- start 2024-09-12T01:58:45.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.485+0000 7f89f6991640 1 -- start start 2024-09-12T01:58:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.485+0000 7f89f6991640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f89f015e740 0x7f89f00d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.485+0000 7f89f6991640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f89f006dbd0 0x7f89f006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.485+0000 7f89f6991640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89f00d0780 con 0x7f89f009b690 2024-09-12T01:58:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.485+0000 7f89f6991640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f89f015eb20 con 0x7f89f006dbd0 2024-09-12T01:58:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.485+0000 7f89f6991640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f89f006d260 con 0x7f89f015e740 2024-09-12T01:58:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.486+0000 7f89f4f2e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f89f006dbd0 0x7f89f006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.486+0000 7f89ef7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f89f009b690 0x7f89f006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56512/0 (socket says 172.21.15.19:56512) 2024-09-12T01:58:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.486+0000 7f89f4f2e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f89f006dbd0 0x7f89f006cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58076/0 (socket says 172.21.15.19:58076) 2024-09-12T01:58:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.486+0000 7f89ef7fe640 1 -- 172.21.15.19:0/2558768913 learned_addr learned my addr 172.21.15.19:0/2558768913 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.486+0000 7f89effff640 1 --2- 172.21.15.19:0/2558768913 >> v2:172.21.15.135:3300/0 conn(0x7f89f015e740 0x7f89f00d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.486+0000 7f89f4f2e640 1 -- 172.21.15.19:0/2558768913 >> v2:172.21.15.135:3300/0 conn(0x7f89f015e740 msgr2=0x7f89f00d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.486+0000 7f89f4f2e640 1 --2- 172.21.15.19:0/2558768913 >> v2:172.21.15.135:3300/0 conn(0x7f89f015e740 0x7f89f00d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.486+0000 7f89f4f2e640 1 -- 172.21.15.19:0/2558768913 >> v1:172.21.15.19:6789/0 conn(0x7f89f009b690 legacy=0x7f89f006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.486+0000 7f89f4f2e640 1 -- 172.21.15.19:0/2558768913 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f00d0a60 con 0x7f89f006dbd0 2024-09-12T01:58:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.486+0000 7f89eeffd640 1 -- 172.21.15.19:0/2558768913 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 159472285 0 0) 0x7f89f00d0780 con 0x7f89f009b690 2024-09-12T01:58:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.487+0000 7f89f4f2e640 1 --2- 172.21.15.19:0/2558768913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f006dbd0 0x7f89f006cd20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f89f0074070 tx=0x7f89e802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2093c2f307b3cfd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.487+0000 7f89eeffd640 1 -- 172.21.15.19:0/2558768913 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e8007740 con 0x7f89f006dbd0 2024-09-12T01:58:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.487+0000 7f89eeffd640 1 -- 172.21.15.19:0/2558768913 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e80078e0 con 0x7f89f006dbd0 2024-09-12T01:58:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.487+0000 7f89eeffd640 1 -- 172.21.15.19:0/2558768913 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e8007cb0 con 0x7f89f006dbd0 2024-09-12T01:58:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.487+0000 7f89f6991640 1 -- 172.21.15.19:0/2558768913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f006dbd0 msgr2=0x7f89f006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:45.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.487+0000 7f89f6991640 1 --2- 172.21.15.19:0/2558768913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f006dbd0 0x7f89f006cd20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f89f0074070 tx=0x7f89e802a710 comp rx=0 tx=0).stop 2024-09-12T01:58:45.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.487+0000 7f89f6991640 1 -- 172.21.15.19:0/2558768913 shutdown_connections 2024-09-12T01:58:45.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.487+0000 7f89f6991640 1 --2- 172.21.15.19:0/2558768913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f006dbd0 0x7f89f006cd20 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.487+0000 7f89f6991640 1 --2- 172.21.15.19:0/2558768913 >> v2:172.21.15.135:3300/0 conn(0x7f89f015e740 0x7f89f00d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.487+0000 7f89f6991640 1 -- 172.21.15.19:0/2558768913 >> 172.21.15.19:0/2558768913 conn(0x7f89f00d23a0 msgr2=0x7f89f00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:45.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.487+0000 7f89f6991640 1 -- 172.21.15.19:0/2558768913 shutdown_connections 2024-09-12T01:58:45.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.487+0000 7f89f6991640 1 -- 172.21.15.19:0/2558768913 wait complete. 2024-09-12T01:58:45.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89f6991640 1 Processor -- start 2024-09-12T01:58:45.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89f6991640 1 -- start start 2024-09-12T01:58:45.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89f6991640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f006dbd0 0x7f89f014b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89f6991640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89f009b690 0x7f89f00cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89f6991640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f015e740 0x7f89f00ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89f6991640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f89f009bac0 con 0x7f89f015e740 2024-09-12T01:58:45.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89f6991640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f89f00d1020 con 0x7f89f006dbd0 2024-09-12T01:58:45.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89f6991640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f89f006dfe0 con 0x7f89f009b690 2024-09-12T01:58:45.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89f4f2e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f015e740 0x7f89f00ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89f4f2e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f015e740 0x7f89f00ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58092/0 (socket says 172.21.15.19:58092) 2024-09-12T01:58:45.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89f4f2e640 1 -- 172.21.15.19:0/851193837 learned_addr learned my addr 172.21.15.19:0/851193837 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:45.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89effff640 1 --2- 172.21.15.19:0/851193837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f006dbd0 0x7f89f014b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89ef7fe640 1 --2- 172.21.15.19:0/851193837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89f009b690 0x7f89f00cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89f4f2e640 1 -- 172.21.15.19:0/851193837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89f009b690 msgr2=0x7f89f00cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:45.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89f4f2e640 1 --2- 172.21.15.19:0/851193837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89f009b690 0x7f89f00cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89f4f2e640 1 -- 172.21.15.19:0/851193837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f006dbd0 msgr2=0x7f89f014b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:45.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89f4f2e640 1 --2- 172.21.15.19:0/851193837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f006dbd0 0x7f89f014b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89f4f2e640 1 -- 172.21.15.19:0/851193837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f00c9690 con 0x7f89f015e740 2024-09-12T01:58:45.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89f4f2e640 1 --2- 172.21.15.19:0/851193837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f015e740 0x7f89f00ce470 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f89e802ad00 tx=0x7f89e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:45.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89ecff9640 1 -- 172.21.15.19:0/851193837 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e803f070 con 0x7f89f015e740 2024-09-12T01:58:45.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89ecff9640 1 -- 172.21.15.19:0/851193837 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e8031bc0 con 0x7f89f015e740 2024-09-12T01:58:45.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.490+0000 7f89f6991640 1 -- 172.21.15.19:0/851193837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f00c9900 con 0x7f89f015e740 2024-09-12T01:58:45.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.491+0000 7f89ecff9640 1 -- 172.21.15.19:0/851193837 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e8044460 con 0x7f89f015e740 2024-09-12T01:58:45.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.491+0000 7f89f6991640 1 -- 172.21.15.19:0/851193837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f00c9ec0 con 0x7f89f015e740 2024-09-12T01:58:45.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.492+0000 7f89ecff9640 1 -- 172.21.15.19:0/851193837 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89e8007790 con 0x7f89f015e740 2024-09-12T01:58:45.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.492+0000 7f89ecff9640 1 --2- 172.21.15.19:0/851193837 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89dc06be30 0x7f89dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.493+0000 7f89ecff9640 1 -- 172.21.15.19:0/851193837 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6217+0+0 (secure 0 0 0) 0x7f89e80ac7f0 con 0x7f89f015e740 2024-09-12T01:58:45.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.493+0000 7f89effff640 1 --2- 172.21.15.19:0/851193837 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89dc06be30 0x7f89dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.493+0000 7f89effff640 1 --2- 172.21.15.19:0/851193837 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89dc06be30 0x7f89dc06e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f89e0006fd0 tx=0x7f89e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:45.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.493+0000 7f89f980a740 1 Processor -- start 2024-09-12T01:58:45.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.494+0000 7f89f980a740 1 -- start start 2024-09-12T01:58:45.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.494+0000 7f89f980a740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0b2c0 0x56451cf50a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.494+0000 7f89f980a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf08a80 0x56451cf0b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.494+0000 7f89f980a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf0ca50 0x56451cf058b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.494+0000 7f89f980a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56451ce6d520 con 0x56451cf08a80 2024-09-12T01:58:45.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.494+0000 7f89f980a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56451ce153e0 con 0x56451cf0ca50 2024-09-12T01:58:45.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.494+0000 7f89f980a740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56451ce694e0 con 0x56451cf0b2c0 2024-09-12T01:58:45.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.494+0000 7f89ef7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf08a80 0x56451cf0b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.494+0000 7f89ef7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf08a80 0x56451cf0b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58102/0 (socket says 172.21.15.19:58102) 2024-09-12T01:58:45.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.494+0000 7f89ef7fe640 1 -- 172.21.15.19:0/1459490751 learned_addr learned my addr 172.21.15.19:0/1459490751 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:45.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.495+0000 7f89effff640 1 --2- 172.21.15.19:0/1459490751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0b2c0 0x56451cf50a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.495+0000 7f89ef7fe640 1 -- 172.21.15.19:0/1459490751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0b2c0 msgr2=0x56451cf50a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:45.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.495+0000 7f89ef7fe640 1 --2- 172.21.15.19:0/1459490751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0b2c0 0x56451cf50a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.495+0000 7f89ef7fe640 1 -- 172.21.15.19:0/1459490751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf0ca50 msgr2=0x56451cf058b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:45.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.495+0000 7f89ef7fe640 1 --2- 172.21.15.19:0/1459490751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf0ca50 0x56451cf058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.495+0000 7f89ef7fe640 1 -- 172.21.15.19:0/1459490751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56451ce302f0 con 0x56451cf08a80 2024-09-12T01:58:45.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.495+0000 7f89effff640 1 --2- 172.21.15.19:0/1459490751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0b2c0 0x56451cf50a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:45.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.495+0000 7f89ef7fe640 1 --2- 172.21.15.19:0/1459490751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf08a80 0x56451cf0b6a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f89e4007680 tx=0x7f89e4004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9ca9dfbc37cc3c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:45.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.495+0000 7f89d5ffb640 1 -- 172.21.15.19:0/1459490751 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e401a070 con 0x56451cf08a80 2024-09-12T01:58:45.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.495+0000 7f89d5ffb640 1 -- 172.21.15.19:0/1459490751 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e40017f0 con 0x56451cf08a80 2024-09-12T01:58:45.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.495+0000 7f89d5ffb640 1 -- 172.21.15.19:0/1459490751 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e4001be0 con 0x56451cf08a80 2024-09-12T01:58:45.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f980a740 1 -- 172.21.15.19:0/1459490751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf08a80 msgr2=0x56451cf0b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:45.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f980a740 1 --2- 172.21.15.19:0/1459490751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf08a80 0x56451cf0b6a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f89e4007680 tx=0x7f89e4004bb0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f980a740 1 -- 172.21.15.19:0/1459490751 shutdown_connections 2024-09-12T01:58:45.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f980a740 1 --2- 172.21.15.19:0/1459490751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf0ca50 0x56451cf058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f980a740 1 --2- 172.21.15.19:0/1459490751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf08a80 0x56451cf0b6a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f980a740 1 --2- 172.21.15.19:0/1459490751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0b2c0 0x56451cf50a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f980a740 1 -- 172.21.15.19:0/1459490751 >> 172.21.15.19:0/1459490751 conn(0x56451cf07a80 msgr2=0x56451cf4ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:45.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f980a740 1 -- 172.21.15.19:0/1459490751 shutdown_connections 2024-09-12T01:58:45.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f980a740 1 -- 172.21.15.19:0/1459490751 wait complete. 2024-09-12T01:58:45.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f980a740 1 -- start start 2024-09-12T01:58:45.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f980a740 1 Processor -- start 2024-09-12T01:58:45.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f980a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf0b2c0 0x56451cf4d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f980a740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0ca50 0x56451cf2ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f980a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf2cf40 0x56451cf35260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f980a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56451cf06f20 con 0x56451cf0b2c0 2024-09-12T01:58:45.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f980a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56451cdf6450 con 0x56451cf2cf40 2024-09-12T01:58:45.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f980a740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56451cf51290 con 0x56451cf0ca50 2024-09-12T01:58:45.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f980a740 10 client.0 _ll_register_callbacks cb 0x56451cb7fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:45.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89effff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf0b2c0 0x56451cf4d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89effff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf0b2c0 0x56451cf4d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58104/0 (socket says 172.21.15.19:58104) 2024-09-12T01:58:45.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89effff640 1 -- 172.21.15.19:0/3389679559 learned_addr learned my addr 172.21.15.19:0/3389679559 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:45.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89ef7fe640 1 --2- 172.21.15.19:0/3389679559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0ca50 0x56451cf2ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.497+0000 7f89f4f2e640 1 --2- 172.21.15.19:0/3389679559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf2cf40 0x56451cf35260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.498+0000 7f89effff640 1 -- 172.21.15.19:0/3389679559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0ca50 msgr2=0x56451cf2ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:45.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.498+0000 7f89effff640 1 --2- 172.21.15.19:0/3389679559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0ca50 0x56451cf2ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.498+0000 7f89effff640 1 -- 172.21.15.19:0/3389679559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf2cf40 msgr2=0x56451cf35260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:45.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.498+0000 7f89effff640 1 --2- 172.21.15.19:0/3389679559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf2cf40 0x56451cf35260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.498+0000 7f89effff640 1 -- 172.21.15.19:0/3389679559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56451cb802d0 con 0x56451cf0b2c0 2024-09-12T01:58:45.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.498+0000 7f89effff640 1 --2- 172.21.15.19:0/3389679559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf0b2c0 0x56451cf4d460 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f89e0016a30 tx=0x7f89e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32723d6b8a747a9e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:45.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.498+0000 7f89ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:58:45.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.498+0000 7f89ceffd640 1 -- 172.21.15.19:0/3389679559 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0014bc0 con 0x56451cf0b2c0 2024-09-12T01:58:45.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.498+0000 7f89ceffd640 1 -- 172.21.15.19:0/3389679559 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6217+0+0 (secure 0 0 0) 0x7f89e0014d60 con 0x56451cf0b2c0 2024-09-12T01:58:45.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.498+0000 7f89f980a740 1 -- 172.21.15.19:0/3389679559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89e40017f0 con 0x56451cf0b2c0 2024-09-12T01:58:45.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.498+0000 7f89ceffd640 1 -- 172.21.15.19:0/3389679559 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f89e002f050 con 0x56451cf0b2c0 2024-09-12T01:58:45.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.498+0000 7f89f980a740 10 client.6054 fetch_fsmap learned FSMap version 41 2024-09-12T01:58:45.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.498+0000 7f89f980a740 1 -- 172.21.15.19:0/3389679559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x56451cc4a6b0 con 0x56451cf0b2c0 2024-09-12T01:58:45.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.498+0000 7f89ceffd640 1 -- 172.21.15.19:0/3389679559 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e40017f0 con 0x56451cf0b2c0 2024-09-12T01:58:45.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.498+0000 7f89ceffd640 1 -- 172.21.15.19:0/3389679559 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 41) ==== 3502+0+0 (secure 0 0 0) 0x7f89e0032020 con 0x56451cf0b2c0 2024-09-12T01:58:45.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.498+0000 7f89f980a740 10 client.6054 fetch_fsmap finished waiting for FSMap version 41 2024-09-12T01:58:45.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.498+0000 7f89f980a740 10 client.6054 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T01:58:45.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.498+0000 7f89f980a740 20 client.6054 populate_metadata read hostname 'smithi019' 2024-09-12T01:58:45.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.499+0000 7f89f980a740 1 --2- 172.21.15.19:0/3389679559 >> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] conn(0x56451cf33380 0x56451cf33760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.499+0000 7f89f980a740 4 client.6054 mds_command: new command op to 5868 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:45.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.499+0000 7f89f980a740 1 -- 172.21.15.19:0/3389679559 --> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56451ce7ac50 con 0x56451cf33380 2024-09-12T01:58:45.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.499+0000 7f89ef7fe640 1 --2- 172.21.15.19:0/3389679559 >> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] conn(0x56451cf33380 0x56451cf33760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.499+0000 7f89ef7fe640 1 --2- 172.21.15.19:0/3389679559 >> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] conn(0x56451cf33380 0x56451cf33760 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9829245709aa411 server_cookie=3be9141c16ab267e in_seq=0 out_seq=0 2024-09-12T01:58:45.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.499+0000 7f89ceffd640 10 client.6054 ms_handle_connect on v2:172.21.15.19:6833/1551156711 2024-09-12T01:58:45.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.500+0000 7f89ceffd640 1 -- 172.21.15.19:0/3389679559 <== mds.0 v2:172.21.15.19:6833/1551156711 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56451ce7ac50 con 0x56451cf33380 2024-09-12T01:58:45.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.500+0000 7f89ceffd640 10 client.6054 handle_command_reply: tid=0 2024-09-12T01:58:45.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.500+0000 7f89f980a740 1 client.6054 shutdown 2024-09-12T01:58:45.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.500+0000 7f89f980a740 1 -- 172.21.15.19:0/3389679559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf0b2c0 msgr2=0x56451cf4d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:45.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.500+0000 7f89f980a740 1 --2- 172.21.15.19:0/3389679559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf0b2c0 0x56451cf4d460 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f89e0016a30 tx=0x7f89e0004730 comp rx=0 tx=0).stop 2024-09-12T01:58:45.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.500+0000 7f89f980a740 1 -- 172.21.15.19:0/3389679559 shutdown_connections 2024-09-12T01:58:45.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.500+0000 7f89f980a740 1 --2- 172.21.15.19:0/3389679559 >> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] conn(0x56451cf33380 0x56451cf33760 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.500+0000 7f89f980a740 1 --2- 172.21.15.19:0/3389679559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf2cf40 0x56451cf35260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.500+0000 7f89f980a740 1 --2- 172.21.15.19:0/3389679559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0ca50 0x56451cf2ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.500+0000 7f89ceffd640 0 client.6054 ms_handle_reset on v2:172.21.15.19:6833/1551156711 2024-09-12T01:58:45.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.500+0000 7f89f980a740 1 --2- 172.21.15.19:0/3389679559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf0b2c0 0x56451cf4d460 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.500+0000 7f89f980a740 1 -- 172.21.15.19:0/3389679559 >> 172.21.15.19:0/3389679559 conn(0x56451cf08a80 msgr2=0x56451cf09020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:45.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.500+0000 7f89f980a740 1 -- 172.21.15.19:0/3389679559 shutdown_connections 2024-09-12T01:58:45.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.500+0000 7f89f980a740 1 -- 172.21.15.19:0/3389679559 wait complete. 2024-09-12T01:58:45.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.500+0000 7f89f980a740 20 client.6054 trim_cache size 0 max 16384 2024-09-12T01:58:45.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.518+0000 7f89f980a740 1 Processor -- start 2024-09-12T01:58:45.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.518+0000 7f89f980a740 1 -- start start 2024-09-12T01:58:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.518+0000 7f89f980a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf0b2c0 0x56451cf4d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.518+0000 7f89f980a740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0ca50 0x56451cf33760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.518+0000 7f89f980a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf2cf40 0x56451cf73ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.518+0000 7f89f980a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f89f0201230 con 0x56451cf0b2c0 2024-09-12T01:58:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.519+0000 7f89f980a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f89f0200250 con 0x56451cf2cf40 2024-09-12T01:58:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.519+0000 7f89f980a740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f89f00cb3b0 con 0x56451cf0ca50 2024-09-12T01:58:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.519+0000 7f89effff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf0b2c0 0x56451cf4d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.519+0000 7f89effff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf0b2c0 0x56451cf4d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58108/0 (socket says 172.21.15.19:58108) 2024-09-12T01:58:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.519+0000 7f89effff640 1 -- 172.21.15.19:0/4256384133 learned_addr learned my addr 172.21.15.19:0/4256384133 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.519+0000 7f89effff640 1 -- 172.21.15.19:0/4256384133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0ca50 msgr2=0x56451cf33760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.519+0000 7f89f4f2e640 1 --2- 172.21.15.19:0/4256384133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf2cf40 0x56451cf73ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.519+0000 7f89ef7fe640 1 --2- 172.21.15.19:0/4256384133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0ca50 0x56451cf33760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.519+0000 7f89effff640 1 --2- 172.21.15.19:0/4256384133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0ca50 0x56451cf33760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.519+0000 7f89effff640 1 -- 172.21.15.19:0/4256384133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf2cf40 msgr2=0x56451cf73ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.519+0000 7f89effff640 1 --2- 172.21.15.19:0/4256384133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf2cf40 0x56451cf73ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.519+0000 7f89effff640 1 -- 172.21.15.19:0/4256384133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56451cf52170 con 0x56451cf0b2c0 2024-09-12T01:58:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.519+0000 7f89f4f2e640 1 --2- 172.21.15.19:0/4256384133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf2cf40 0x56451cf73ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.519+0000 7f89ef7fe640 1 --2- 172.21.15.19:0/4256384133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0ca50 0x56451cf33760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.519+0000 7f89effff640 1 --2- 172.21.15.19:0/4256384133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf0b2c0 0x56451cf4d050 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f89e0007860 tx=0x7f89e0020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8cf47b73da1106d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.519+0000 7f89d57fa640 1 -- 172.21.15.19:0/4256384133 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0038070 con 0x56451cf0b2c0 2024-09-12T01:58:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.519+0000 7f89d57fa640 1 -- 172.21.15.19:0/4256384133 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e0027070 con 0x56451cf0b2c0 2024-09-12T01:58:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.519+0000 7f89d57fa640 1 -- 172.21.15.19:0/4256384133 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0014dc0 con 0x56451cf0b2c0 2024-09-12T01:58:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.520+0000 7f89f980a740 1 -- 172.21.15.19:0/4256384133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf0b2c0 msgr2=0x56451cf4d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.520+0000 7f89f980a740 1 --2- 172.21.15.19:0/4256384133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf0b2c0 0x56451cf4d050 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f89e0007860 tx=0x7f89e0020000 comp rx=0 tx=0).stop 2024-09-12T01:58:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.520+0000 7f89f980a740 1 -- 172.21.15.19:0/4256384133 shutdown_connections 2024-09-12T01:58:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.520+0000 7f89f980a740 1 --2- 172.21.15.19:0/4256384133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf2cf40 0x56451cf73ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.520+0000 7f89f980a740 1 --2- 172.21.15.19:0/4256384133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0ca50 0x56451cf33760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.520+0000 7f89f980a740 1 --2- 172.21.15.19:0/4256384133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf0b2c0 0x56451cf4d050 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.520+0000 7f89f980a740 1 -- 172.21.15.19:0/4256384133 >> 172.21.15.19:0/4256384133 conn(0x56451cf08a80 msgr2=0x56451cf502b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:45.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.520+0000 7f89f980a740 1 -- 172.21.15.19:0/4256384133 shutdown_connections 2024-09-12T01:58:45.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.520+0000 7f89f980a740 1 -- 172.21.15.19:0/4256384133 wait complete. 2024-09-12T01:58:45.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.520+0000 7f89f980a740 1 -- start start 2024-09-12T01:58:45.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.521+0000 7f89f980a740 1 Processor -- start 2024-09-12T01:58:45.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.521+0000 7f89f980a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf0b2c0 0x56451cf72a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.521+0000 7f89f980a740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0ca50 0x56451cf09110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.521+0000 7f89f980a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf2cf40 0x56451cfd1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.521+0000 7f89f980a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56451cf639b0 con 0x56451cf2cf40 2024-09-12T01:58:45.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.521+0000 7f89f980a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56451cf4da70 con 0x56451cf0b2c0 2024-09-12T01:58:45.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.521+0000 7f89f980a740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56451cf64000 con 0x56451cf0ca50 2024-09-12T01:58:45.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.521+0000 7f89f980a740 10 client.0 _ll_register_callbacks cb 0x7f89e00166b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.521+0000 7f89f4f2e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf2cf40 0x56451cfd1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.521+0000 7f89f4f2e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf2cf40 0x56451cfd1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58116/0 (socket says 172.21.15.19:58116) 2024-09-12T01:58:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.521+0000 7f89f4f2e640 1 -- 172.21.15.19:0/4009807945 learned_addr learned my addr 172.21.15.19:0/4009807945 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.521+0000 7f89ef7fe640 1 --2- 172.21.15.19:0/4009807945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0ca50 0x56451cf09110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89effff640 1 --2- 172.21.15.19:0/4009807945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf0b2c0 0x56451cf72a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89f4f2e640 1 -- 172.21.15.19:0/4009807945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0ca50 msgr2=0x56451cf09110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89f4f2e640 1 --2- 172.21.15.19:0/4009807945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0ca50 0x56451cf09110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89f4f2e640 1 -- 172.21.15.19:0/4009807945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf0b2c0 msgr2=0x56451cf72a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89f4f2e640 1 --2- 172.21.15.19:0/4009807945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf0b2c0 0x56451cf72a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89f4f2e640 1 -- 172.21.15.19:0/4009807945 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56451cf5ea50 con 0x56451cf2cf40 2024-09-12T01:58:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89f4f2e640 1 --2- 172.21.15.19:0/4009807945 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf2cf40 0x56451cfd1d00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f89e8082f40 tx=0x7f89e807a940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47102e57526539a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:58:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89ceffd640 1 -- 172.21.15.19:0/4009807945 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e8092020 con 0x56451cf2cf40 2024-09-12T01:58:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89ceffd640 1 -- 172.21.15.19:0/4009807945 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6217+0+0 (secure 0 0 0) 0x7f89e80a5d20 con 0x56451cf2cf40 2024-09-12T01:58:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89f980a740 1 -- 172.21.15.19:0/4009807945 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89e0027070 con 0x56451cf2cf40 2024-09-12T01:58:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89ceffd640 1 -- 172.21.15.19:0/4009807945 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f89e807aba0 con 0x56451cf2cf40 2024-09-12T01:58:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89f980a740 10 client.6060 fetch_fsmap learned FSMap version 41 2024-09-12T01:58:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89f980a740 1 -- 172.21.15.19:0/4009807945 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x56451cfd2840 con 0x56451cf2cf40 2024-09-12T01:58:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89ceffd640 1 -- 172.21.15.19:0/4009807945 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e0027070 con 0x56451cf2cf40 2024-09-12T01:58:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89ceffd640 1 -- 172.21.15.19:0/4009807945 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 41) ==== 3502+0+0 (secure 0 0 0) 0x7f89e8082fe0 con 0x56451cf2cf40 2024-09-12T01:58:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89f980a740 10 client.6060 fetch_fsmap finished waiting for FSMap version 41 2024-09-12T01:58:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89f980a740 10 client.6060 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T01:58:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89f980a740 20 client.6060 populate_metadata read hostname 'smithi019' 2024-09-12T01:58:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89f980a740 1 --2- 172.21.15.19:0/4009807945 >> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] conn(0x56451cfb4390 0x56451cf2df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89f980a740 4 client.6060 mds_command: new command op to 5868 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:58:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.522+0000 7f89f980a740 1 -- 172.21.15.19:0/4009807945 --> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] -- command(tid 0: {"prefix": "status"}) -- 0x56451ce74fa0 con 0x56451cfb4390 2024-09-12T01:58:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.523+0000 7f89effff640 1 --2- 172.21.15.19:0/4009807945 >> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] conn(0x56451cfb4390 0x56451cf2df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.523+0000 7f89ceffd640 10 client.6060 ms_handle_connect on v2:172.21.15.19:6833/1551156711 2024-09-12T01:58:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.523+0000 7f89effff640 1 --2- 172.21.15.19:0/4009807945 >> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] conn(0x56451cfb4390 0x56451cf2df90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20ea843f85775deb server_cookie=807126350744799d in_seq=0 out_seq=0 2024-09-12T01:58:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.523+0000 7f89ceffd640 1 -- 172.21.15.19:0/4009807945 <== mds.0 v2:172.21.15.19:6833/1551156711 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x56451ce74fa0 con 0x56451cfb4390 2024-09-12T01:58:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.523+0000 7f89ceffd640 10 client.6060 handle_command_reply: tid=0 2024-09-12T01:58:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.523+0000 7f89f980a740 1 client.6060 shutdown 2024-09-12T01:58:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.523+0000 7f89f980a740 1 -- 172.21.15.19:0/4009807945 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf2cf40 msgr2=0x56451cfd1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.523+0000 7f89f980a740 1 --2- 172.21.15.19:0/4009807945 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf2cf40 0x56451cfd1d00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f89e8082f40 tx=0x7f89e807a940 comp rx=0 tx=0).stop 2024-09-12T01:58:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.523+0000 7f89f980a740 1 -- 172.21.15.19:0/4009807945 shutdown_connections 2024-09-12T01:58:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.523+0000 7f89f980a740 1 --2- 172.21.15.19:0/4009807945 >> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] conn(0x56451cfb4390 0x56451cf2df90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.523+0000 7f89f980a740 1 --2- 172.21.15.19:0/4009807945 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56451cf2cf40 0x56451cfd1d00 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.523+0000 7f89f980a740 1 --2- 172.21.15.19:0/4009807945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56451cf0ca50 0x56451cf09110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.523+0000 7f89ceffd640 0 client.6060 ms_handle_reset on v2:172.21.15.19:6833/1551156711 2024-09-12T01:58:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.523+0000 7f89f980a740 1 --2- 172.21.15.19:0/4009807945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56451cf0b2c0 0x56451cf72a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.523+0000 7f89f980a740 1 -- 172.21.15.19:0/4009807945 >> 172.21.15.19:0/4009807945 conn(0x56451cf08a80 msgr2=0x56451cf07290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.523+0000 7f89f980a740 1 -- 172.21.15.19:0/4009807945 shutdown_connections 2024-09-12T01:58:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.523+0000 7f89f980a740 1 -- 172.21.15.19:0/4009807945 wait complete. 2024-09-12T01:58:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.524+0000 7f89f980a740 20 client.6060 trim_cache size 0 max 16384 2024-09-12T01:58:45.531 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:58:45.532 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T01:58:45.532 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T01:58:45.532 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 5868, 2024-09-12T01:58:45.532 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T01:58:45.532 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T01:58:45.532 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T01:58:45.532 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 13.457437055, 2024-09-12T01:58:45.532 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 41, 2024-09-12T01:58:45.532 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 68, 2024-09-12T01:58:45.532 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 66, 2024-09-12T01:58:45.532 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 18.472134960999998 2024-09-12T01:58:45.532 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:58:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.524+0000 7f89f6991640 1 -- 172.21.15.19:0/851193837 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89dc06be30 msgr2=0x7f89dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.524+0000 7f89f6991640 1 --2- 172.21.15.19:0/851193837 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89dc06be30 0x7f89dc06e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f89e0006fd0 tx=0x7f89e0008040 comp rx=0 tx=0).stop 2024-09-12T01:58:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.524+0000 7f89f6991640 1 -- 172.21.15.19:0/851193837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f015e740 msgr2=0x7f89f00ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.524+0000 7f89f6991640 1 --2- 172.21.15.19:0/851193837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f015e740 0x7f89f00ce470 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f89e802ad00 tx=0x7f89e8004a40 comp rx=0 tx=0).stop 2024-09-12T01:58:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.524+0000 7f89f6991640 1 -- 172.21.15.19:0/851193837 shutdown_connections 2024-09-12T01:58:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.524+0000 7f89f6991640 1 --2- 172.21.15.19:0/851193837 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89dc06be30 0x7f89dc06e2f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.524+0000 7f89f6991640 1 --2- 172.21.15.19:0/851193837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f015e740 0x7f89f00ce470 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.524+0000 7f89f6991640 1 --2- 172.21.15.19:0/851193837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89f009b690 0x7f89f00cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.524+0000 7f89f6991640 1 --2- 172.21.15.19:0/851193837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f006dbd0 0x7f89f014b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.524+0000 7f89f6991640 1 -- 172.21.15.19:0/851193837 >> 172.21.15.19:0/851193837 conn(0x7f89f00d23a0 msgr2=0x7f89f00af220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.524+0000 7f89f6991640 1 -- 172.21.15.19:0/851193837 shutdown_connections 2024-09-12T01:58:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.524+0000 7f89f6991640 1 -- 172.21.15.19:0/851193837 wait complete. 2024-09-12T01:58:45.536 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:58:45.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.638+0000 7f1a8c4d0640 1 Processor -- start 2024-09-12T01:58:45.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.638+0000 7f1a8c4d0640 1 -- start start 2024-09-12T01:58:45.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.639+0000 7f1a8c4d0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a84161c80 0x7f1a8406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.639+0000 7f1a8c4d0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1a84162060 0x7f1a840b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.639+0000 7f1a8c4d0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a8406e870 con 0x7f1a840b64b0 2024-09-12T01:58:45.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.639+0000 7f1a8c4d0640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f1a8406d9f0 con 0x7f1a84161c80 2024-09-12T01:58:45.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.639+0000 7f1a8c4d0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f1a8406dcd0 con 0x7f1a84162060 2024-09-12T01:58:45.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.639+0000 7f1a8a26c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a84161c80 0x7f1a8406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.639+0000 7f1a8a26c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a84161c80 0x7f1a8406e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58122/0 (socket says 172.21.15.19:58122) 2024-09-12T01:58:45.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.639+0000 7f1a8a26c640 1 -- 172.21.15.19:0/2243652092 learned_addr learned my addr 172.21.15.19:0/2243652092 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:45.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.640+0000 7f1a89a6b640 1 --2- 172.21.15.19:0/2243652092 >> v2:172.21.15.135:3300/0 conn(0x7f1a84162060 0x7f1a840b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.640+0000 7f1a8a26c640 1 -- 172.21.15.19:0/2243652092 >> v2:172.21.15.135:3300/0 conn(0x7f1a84162060 msgr2=0x7f1a840b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:45.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.640+0000 7f1a8a26c640 1 --2- 172.21.15.19:0/2243652092 >> v2:172.21.15.135:3300/0 conn(0x7f1a84162060 0x7f1a840b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.640+0000 7f1a8a26c640 1 -- 172.21.15.19:0/2243652092 >> v1:172.21.15.135:6789/0 conn(0x7f1a840b64b0 legacy=0x7f1a84162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:45.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.640+0000 7f1a8a26c640 1 -- 172.21.15.19:0/2243652092 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a8406dfb0 con 0x7f1a84161c80 2024-09-12T01:58:45.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.640+0000 7f1a8a26c640 1 --2- 172.21.15.19:0/2243652092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a84161c80 0x7f1a8406e330 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1a8408e830 tx=0x7f1a7c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e49b22cd79334f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:45.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.641+0000 7f1a8926a640 1 -- 172.21.15.19:0/2243652092 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c037070 con 0x7f1a84161c80 2024-09-12T01:58:45.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.641+0000 7f1a8926a640 1 -- 172.21.15.19:0/2243652092 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a7c032440 con 0x7f1a84161c80 2024-09-12T01:58:45.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.641+0000 7f1a8926a640 1 -- 172.21.15.19:0/2243652092 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c032810 con 0x7f1a84161c80 2024-09-12T01:58:45.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.641+0000 7f1a8c4d0640 1 -- 172.21.15.19:0/2243652092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a84161c80 msgr2=0x7f1a8406e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:45.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.641+0000 7f1a8c4d0640 1 --2- 172.21.15.19:0/2243652092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a84161c80 0x7f1a8406e330 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1a8408e830 tx=0x7f1a7c02a230 comp rx=0 tx=0).stop 2024-09-12T01:58:45.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.641+0000 7f1a8c4d0640 1 -- 172.21.15.19:0/2243652092 shutdown_connections 2024-09-12T01:58:45.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.641+0000 7f1a8c4d0640 1 --2- 172.21.15.19:0/2243652092 >> v2:172.21.15.135:3300/0 conn(0x7f1a84162060 0x7f1a840b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.641+0000 7f1a8c4d0640 1 --2- 172.21.15.19:0/2243652092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a84161c80 0x7f1a8406e330 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.641+0000 7f1a8c4d0640 1 -- 172.21.15.19:0/2243652092 >> 172.21.15.19:0/2243652092 conn(0x7f1a840d44f0 msgr2=0x7f1a840d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:45.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.641+0000 7f1a8c4d0640 1 -- 172.21.15.19:0/2243652092 shutdown_connections 2024-09-12T01:58:45.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.641+0000 7f1a8c4d0640 1 -- 172.21.15.19:0/2243652092 wait complete. 2024-09-12T01:58:45.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.642+0000 7f1a8c4d0640 1 Processor -- start 2024-09-12T01:58:45.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.642+0000 7f1a8c4d0640 1 -- start start 2024-09-12T01:58:45.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.643+0000 7f1a8c4d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a840b64b0 0x7f1a841f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.643+0000 7f1a8c4d0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a84161c80 0x7f1a840c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.643+0000 7f1a8c4d0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a84162060 0x7f1a840b95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.643+0000 7f1a8c4d0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1a840d2a10 con 0x7f1a840b64b0 2024-09-12T01:58:45.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.643+0000 7f1a8c4d0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1a840d2890 con 0x7f1a84162060 2024-09-12T01:58:45.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.643+0000 7f1a8c4d0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1a840b6960 con 0x7f1a84161c80 2024-09-12T01:58:45.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.643+0000 7f1a8a26c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a840b64b0 0x7f1a841f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.643+0000 7f1a8a26c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a840b64b0 0x7f1a841f3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58126/0 (socket says 172.21.15.19:58126) 2024-09-12T01:58:45.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.643+0000 7f1a8a26c640 1 -- 172.21.15.19:0/720670600 learned_addr learned my addr 172.21.15.19:0/720670600 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:45.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.643+0000 7f1a89a6b640 1 --2- 172.21.15.19:0/720670600 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a84161c80 0x7f1a840c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.643+0000 7f1a8aa6d640 1 --2- 172.21.15.19:0/720670600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a84162060 0x7f1a840b95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.644+0000 7f1a8a26c640 1 -- 172.21.15.19:0/720670600 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a84161c80 msgr2=0x7f1a840c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:45.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.644+0000 7f1a8a26c640 1 --2- 172.21.15.19:0/720670600 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a84161c80 0x7f1a840c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.644+0000 7f1a8a26c640 1 -- 172.21.15.19:0/720670600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a84162060 msgr2=0x7f1a840b95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.644+0000 7f1a8a26c640 1 --2- 172.21.15.19:0/720670600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a84162060 0x7f1a840b95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.644+0000 7f1a8a26c640 1 -- 172.21.15.19:0/720670600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a840b9b10 con 0x7f1a840b64b0 2024-09-12T01:58:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.644+0000 7f1a8a26c640 1 --2- 172.21.15.19:0/720670600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a840b64b0 0x7f1a841f3e10 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c000c00 tx=0x7f1a7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.644+0000 7f1a82ffd640 1 -- 172.21.15.19:0/720670600 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c041020 con 0x7f1a840b64b0 2024-09-12T01:58:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.644+0000 7f1a82ffd640 1 -- 172.21.15.19:0/720670600 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a7c0306c0 con 0x7f1a840b64b0 2024-09-12T01:58:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.644+0000 7f1a82ffd640 1 -- 172.21.15.19:0/720670600 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c037040 con 0x7f1a840b64b0 2024-09-12T01:58:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.644+0000 7f1a8c4d0640 1 -- 172.21.15.19:0/720670600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a840b8770 con 0x7f1a840b64b0 2024-09-12T01:58:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.644+0000 7f1a8c4d0640 1 -- 172.21.15.19:0/720670600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a840c8450 con 0x7f1a840b64b0 2024-09-12T01:58:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.645+0000 7f1a8c4d0640 1 -- 172.21.15.19:0/720670600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a840ba470 con 0x7f1a840b64b0 2024-09-12T01:58:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.646+0000 7f1a82ffd640 1 -- 172.21.15.19:0/720670600 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a7c044020 con 0x7f1a840b64b0 2024-09-12T01:58:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.646+0000 7f1a82ffd640 1 --2- 172.21.15.19:0/720670600 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1a7006be30 0x7f1a7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.646+0000 7f1a82ffd640 1 -- 172.21.15.19:0/720670600 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6217+0+0 (secure 0 0 0) 0x7f1a7c0ab750 con 0x7f1a840b64b0 2024-09-12T01:58:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.646+0000 7f1a89a6b640 1 --2- 172.21.15.19:0/720670600 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1a7006be30 0x7f1a7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.647+0000 7f1a89a6b640 1 --2- 172.21.15.19:0/720670600 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1a7006be30 0x7f1a7006e2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1a84161620 tx=0x7f1a78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:45.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.650+0000 7f1a82ffd640 1 -- 172.21.15.19:0/720670600 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a7c04b030 con 0x7f1a840b64b0 2024-09-12T01:58:45.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.862+0000 7f1a8c4d0640 1 -- 172.21.15.19:0/720670600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1a840d31f0 con 0x7f1a840b64b0 2024-09-12T01:58:45.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.863+0000 7f1a82ffd640 1 -- 172.21.15.19:0/720670600 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) ==== 53+0+73 (secure 0 0 0) 0x7f1a8406e870 con 0x7f1a840b64b0 2024-09-12T01:58:45.863 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:58:45.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.865+0000 7f1a8c4d0640 1 -- 172.21.15.19:0/720670600 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1a7006be30 msgr2=0x7f1a7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.865+0000 7f1a8c4d0640 1 --2- 172.21.15.19:0/720670600 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1a7006be30 0x7f1a7006e2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1a84161620 tx=0x7f1a78008040 comp rx=0 tx=0).stop 2024-09-12T01:58:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.865+0000 7f1a8c4d0640 1 -- 172.21.15.19:0/720670600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a840b64b0 msgr2=0x7f1a841f3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.865+0000 7f1a8c4d0640 1 --2- 172.21.15.19:0/720670600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a840b64b0 0x7f1a841f3e10 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c000c00 tx=0x7f1a7c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.865+0000 7f1a8c4d0640 1 -- 172.21.15.19:0/720670600 shutdown_connections 2024-09-12T01:58:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.865+0000 7f1a8c4d0640 1 --2- 172.21.15.19:0/720670600 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1a7006be30 0x7f1a7006e2f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.865+0000 7f1a8c4d0640 1 --2- 172.21.15.19:0/720670600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a84162060 0x7f1a840b95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.865+0000 7f1a8c4d0640 1 --2- 172.21.15.19:0/720670600 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a84161c80 0x7f1a840c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.865+0000 7f1a8c4d0640 1 --2- 172.21.15.19:0/720670600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a840b64b0 0x7f1a841f3e10 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.865+0000 7f1a8c4d0640 1 -- 172.21.15.19:0/720670600 >> 172.21.15.19:0/720670600 conn(0x7f1a840d44f0 msgr2=0x7f1a840b4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.865+0000 7f1a8c4d0640 1 -- 172.21.15.19:0/720670600 shutdown_connections 2024-09-12T01:58:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:45.865+0000 7f1a8c4d0640 1 -- 172.21.15.19:0/720670600 wait complete. 2024-09-12T01:58:45.876 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:58:45.876 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:58:45.876 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T01:58:45.876 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:58:45.877 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:58:45.877 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:58:45.877 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:58:45.877 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:58:45.877 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:58:45.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:45.877 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T01:58:45.895 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:58:45.895 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:58:45.895 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:58:45.895 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:45.895 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T01:58:45.895 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:45.895 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:58:45.895 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:58:45.896 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T01:58:45.896 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:58:45.896 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:58:45.896 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T01:58:45.896 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:58:45.896 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T01:58:45.896 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T01:58:45.896 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:58:45.896 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42635sec preferred_lft 42635sec 2024-09-12T01:58:45.897 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T01:58:45.897 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:45.897 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:58:45.897 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T01:58:45.897 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T01:58:45.897 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:58:45.897 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T01:58:45.898 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:58:45.898 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:45.898 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T01:58:45.898 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:45.898 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:58:45.898 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:58:45.898 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T01:58:45.898 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:45.898 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:58:45.899 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:58:45.899 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T01:58:45.899 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:45.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:45.899 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:58:45.960 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T01:58:45.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:45.962 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T01:58:46.018 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T01:58:46.019 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:58:46.019 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:58:46.019 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:58:46.019 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:58:46.019 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:58:46.019 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:58:46.019 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:58:46.019 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:58:46.019 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:58:46.020 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:58:46.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:58:46.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:58:46.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:46.149 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T01:58:46.165 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T01:58:46.166 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:58:46.166 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:58:46.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:46.166 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T01:58:46.232 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:58:46.232 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:58:46.288 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:58:46.289 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:58:46.289 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:58:46.345 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T01:58:46.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:46.345 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:58:46.430 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:58:46.430 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:58:46.430 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:58:46.439 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:58:46.439 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:58:46.439 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:58:46.439 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:58:46.439 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:58:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:58:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:58:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:58:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:58:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:58:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T01:58:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T01:58:46.448 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T01:58:46.449 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:58:46.449 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:58:46.449 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:58:46.449 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:58:46.449 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:58:46.450 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:58:46.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:46.450 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:58:46.479 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:58:46.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:58:46.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:58:46.581 INFO:teuthology.orchestra.run.smithi019.stdout:client5797 2024-09-12T01:58:46.581 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:58:46.582 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:58:46.598 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p a/{b,c}/d; sync .') 2024-09-12T01:58:46.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:58:46.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:58:46.705 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:58:46.705 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:58:46.722 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:58:46.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.866+0000 7ff55ec4c640 1 Processor -- start 2024-09-12T01:58:46.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.866+0000 7ff55ec4c640 1 -- start start 2024-09-12T01:58:46.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.867+0000 7ff55ec4c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5580afd60 0x7ff5580726b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.867+0000 7ff55ec4c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff558072bf0 0x7ff5580b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.867+0000 7ff55ec4c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5580b44c0 con 0x7ff5580b3c90 2024-09-12T01:58:46.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.867+0000 7ff55ec4c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff5580b0140 con 0x7ff558072bf0 2024-09-12T01:58:46.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.867+0000 7ff55ec4c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff558073030 con 0x7ff5580afd60 2024-09-12T01:58:46.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.867+0000 7ff557fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff558072bf0 0x7ff5580b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.867+0000 7ff55d1e9640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff5580b3c90 0x7ff558161fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56522/0 (socket says 172.21.15.19:56522) 2024-09-12T01:58:46.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.867+0000 7ff55d1e9640 1 -- 172.21.15.19:0/467336183 learned_addr learned my addr 172.21.15.19:0/467336183 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:46.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.867+0000 7ff55c9e8640 1 --2- 172.21.15.19:0/467336183 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5580afd60 0x7ff5580726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.868+0000 7ff557fff640 1 -- 172.21.15.19:0/467336183 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5580afd60 msgr2=0x7ff5580726b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:46.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.868+0000 7ff557fff640 1 --2- 172.21.15.19:0/467336183 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5580afd60 0x7ff5580726b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.868+0000 7ff557fff640 1 -- 172.21.15.19:0/467336183 >> v1:172.21.15.19:6789/0 conn(0x7ff5580b3c90 legacy=0x7ff558161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:46.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.868+0000 7ff557fff640 1 -- 172.21.15.19:0/467336183 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55815ead0 con 0x7ff558072bf0 2024-09-12T01:58:46.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.868+0000 7ff5577fe640 1 -- 172.21.15.19:0/467336183 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1826518640 0 0) 0x7ff5580b44c0 con 0x7ff5580b3c90 2024-09-12T01:58:46.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.868+0000 7ff557fff640 1 --2- 172.21.15.19:0/467336183 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff558072bf0 0x7ff5580b3750 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff5400097a0 tx=0x7ff54002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5016d334d7a304 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:46.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.868+0000 7ff5577fe640 1 -- 172.21.15.19:0/467336183 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540037070 con 0x7ff558072bf0 2024-09-12T01:58:46.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.868+0000 7ff5577fe640 1 -- 172.21.15.19:0/467336183 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff540032440 con 0x7ff558072bf0 2024-09-12T01:58:46.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.868+0000 7ff5577fe640 1 -- 172.21.15.19:0/467336183 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540032810 con 0x7ff558072bf0 2024-09-12T01:58:46.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.869+0000 7ff55ec4c640 1 -- 172.21.15.19:0/467336183 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff558072bf0 msgr2=0x7ff5580b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:46.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.869+0000 7ff55ec4c640 1 --2- 172.21.15.19:0/467336183 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff558072bf0 0x7ff5580b3750 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff5400097a0 tx=0x7ff54002a180 comp rx=0 tx=0).stop 2024-09-12T01:58:46.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.869+0000 7ff55ec4c640 1 -- 172.21.15.19:0/467336183 shutdown_connections 2024-09-12T01:58:46.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.869+0000 7ff55ec4c640 1 --2- 172.21.15.19:0/467336183 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff558072bf0 0x7ff5580b3750 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.869+0000 7ff55ec4c640 1 --2- 172.21.15.19:0/467336183 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5580afd60 0x7ff5580726b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.869+0000 7ff55ec4c640 1 -- 172.21.15.19:0/467336183 >> 172.21.15.19:0/467336183 conn(0x7ff55806c030 msgr2=0x7ff55806c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:46.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.869+0000 7ff55ec4c640 1 -- 172.21.15.19:0/467336183 shutdown_connections 2024-09-12T01:58:46.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.869+0000 7ff55ec4c640 1 -- 172.21.15.19:0/467336183 wait complete. 2024-09-12T01:58:46.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.870+0000 7ff55ec4c640 1 Processor -- start 2024-09-12T01:58:46.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.870+0000 7ff55ec4c640 1 -- start start 2024-09-12T01:58:46.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.871+0000 7ff55ec4c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff558072bf0 0x7ff558151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.871+0000 7ff55ec4c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5580afd60 0x7ff5580b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.871+0000 7ff55ec4c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5580b3c90 0x7ff558158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.871+0000 7ff55ec4c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff55815f370 con 0x7ff5580b3c90 2024-09-12T01:58:46.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.871+0000 7ff55ec4c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff55815f090 con 0x7ff558072bf0 2024-09-12T01:58:46.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.871+0000 7ff55ec4c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff5580705b0 con 0x7ff5580afd60 2024-09-12T01:58:46.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.871+0000 7ff55d1e9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5580b3c90 0x7ff558158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.871+0000 7ff55d1e9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5580b3c90 0x7ff558158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58134/0 (socket says 172.21.15.19:58134) 2024-09-12T01:58:46.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.871+0000 7ff55d1e9640 1 -- 172.21.15.19:0/753950167 learned_addr learned my addr 172.21.15.19:0/753950167 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:46.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.872+0000 7ff55d1e9640 1 -- 172.21.15.19:0/753950167 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5580afd60 msgr2=0x7ff5580b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:46.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.872+0000 7ff55d1e9640 1 --2- 172.21.15.19:0/753950167 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5580afd60 0x7ff5580b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.872+0000 7ff55d1e9640 1 -- 172.21.15.19:0/753950167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff558072bf0 msgr2=0x7ff558151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:46.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.872+0000 7ff55d1e9640 1 --2- 172.21.15.19:0/753950167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff558072bf0 0x7ff558151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.872+0000 7ff55d1e9640 1 -- 172.21.15.19:0/753950167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5580b1500 con 0x7ff5580b3c90 2024-09-12T01:58:46.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.872+0000 7ff55d1e9640 1 --2- 172.21.15.19:0/753950167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5580b3c90 0x7ff558158d40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff55000c780 tx=0x7ff55000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:46.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.872+0000 7ff5557fa640 1 -- 172.21.15.19:0/753950167 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff550018070 con 0x7ff5580b3c90 2024-09-12T01:58:46.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.872+0000 7ff5557fa640 1 -- 172.21.15.19:0/753950167 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff55000a5e0 con 0x7ff5580b3c90 2024-09-12T01:58:46.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.872+0000 7ff55ec4c640 1 -- 172.21.15.19:0/753950167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5580b17e0 con 0x7ff5580b3c90 2024-09-12T01:58:46.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.872+0000 7ff5557fa640 1 -- 172.21.15.19:0/753950167 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55000a9d0 con 0x7ff5580b3c90 2024-09-12T01:58:46.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.872+0000 7ff55ec4c640 1 -- 172.21.15.19:0/753950167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5580b1da0 con 0x7ff5580b3c90 2024-09-12T01:58:46.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.873+0000 7ff55ec4c640 1 -- 172.21.15.19:0/753950167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff55815f890 con 0x7ff5580b3c90 2024-09-12T01:58:46.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.873+0000 7ff5557fa640 1 -- 172.21.15.19:0/753950167 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff55001b070 con 0x7ff5580b3c90 2024-09-12T01:58:46.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.874+0000 7ff5557fa640 1 --2- 172.21.15.19:0/753950167 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff53806be30 0x7ff53806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.874+0000 7ff5557fa640 1 -- 172.21.15.19:0/753950167 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6217+0+0 (secure 0 0 0) 0x7ff55008a590 con 0x7ff5580b3c90 2024-09-12T01:58:46.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.874+0000 7ff55c9e8640 1 --2- 172.21.15.19:0/753950167 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff53806be30 0x7ff53806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.875+0000 7ff55c9e8640 1 --2- 172.21.15.19:0/753950167 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff53806be30 0x7ff53806e2f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff548006a90 tx=0x7ff548006a20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:46.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:46.878+0000 7ff5557fa640 1 -- 172.21.15.19:0/753950167 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff550058dd0 con 0x7ff5580b3c90 2024-09-12T01:58:47.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.066+0000 7ff55ec4c640 1 -- 172.21.15.19:0/753950167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff5580b5080 con 0x7ff5580b3c90 2024-09-12T01:58:47.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.066+0000 7ff5557fa640 1 -- 172.21.15.19:0/753950167 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v68) ==== 80+0+0 (secure 0 0 0) 0x7ff5500586d0 con 0x7ff5580b3c90 2024-09-12T01:58:47.065 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-09-12T01:58:47.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.068+0000 7ff55ec4c640 1 -- 172.21.15.19:0/753950167 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff53806be30 msgr2=0x7ff53806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:47.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.068+0000 7ff55ec4c640 1 --2- 172.21.15.19:0/753950167 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff53806be30 0x7ff53806e2f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff548006a90 tx=0x7ff548006a20 comp rx=0 tx=0).stop 2024-09-12T01:58:47.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.068+0000 7ff55ec4c640 1 -- 172.21.15.19:0/753950167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5580b3c90 msgr2=0x7ff558158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:47.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.068+0000 7ff55ec4c640 1 --2- 172.21.15.19:0/753950167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5580b3c90 0x7ff558158d40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff55000c780 tx=0x7ff55000cc40 comp rx=0 tx=0).stop 2024-09-12T01:58:47.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.068+0000 7ff55ec4c640 1 -- 172.21.15.19:0/753950167 shutdown_connections 2024-09-12T01:58:47.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.068+0000 7ff55ec4c640 1 --2- 172.21.15.19:0/753950167 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff53806be30 0x7ff53806e2f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.068+0000 7ff55ec4c640 1 --2- 172.21.15.19:0/753950167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5580b3c90 0x7ff558158d40 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.068+0000 7ff55ec4c640 1 --2- 172.21.15.19:0/753950167 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5580afd60 0x7ff5580b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.068+0000 7ff55ec4c640 1 --2- 172.21.15.19:0/753950167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff558072bf0 0x7ff558151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.068+0000 7ff55ec4c640 1 -- 172.21.15.19:0/753950167 >> 172.21.15.19:0/753950167 conn(0x7ff55806c030 msgr2=0x7ff55815fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:47.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.068+0000 7ff55ec4c640 1 -- 172.21.15.19:0/753950167 shutdown_connections 2024-09-12T01:58:47.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.068+0000 7ff55ec4c640 1 -- 172.21.15.19:0/753950167 wait complete. 2024-09-12T01:58:47.079 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:58:47.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:47.079 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:58:47.109 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:58:47.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:47.109 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:58:47.165 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2024-09-12T01:58:47.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.311+0000 7f4f4cb13640 1 Processor -- start 2024-09-12T01:58:47.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.311+0000 7f4f4cb13640 1 -- start start 2024-09-12T01:58:47.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.312+0000 7f4f4cb13640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f48158b50 0x7f4f480b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.312+0000 7f4f4cb13640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4f4809b140 0x7f4f4806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.312+0000 7f4f4cb13640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f480b6820 con 0x7f4f480b6360 2024-09-12T01:58:47.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.312+0000 7f4f4cb13640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f4f480b6b00 con 0x7f4f4809b140 2024-09-12T01:58:47.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.312+0000 7f4f4cb13640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4f480b6de0 con 0x7f4f48158b50 2024-09-12T01:58:47.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.312+0000 7f4f46d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4f4809b140 0x7f4f4806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.312+0000 7f4f46d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4f4809b140 0x7f4f4806fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58138/0 (socket says 172.21.15.19:58138) 2024-09-12T01:58:47.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.312+0000 7f4f46d9d640 1 -- 172.21.15.19:0/1216870839 learned_addr learned my addr 172.21.15.19:0/1216870839 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:47.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.312+0000 7f4f46d9d640 1 -- 172.21.15.19:0/1216870839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f48158b50 msgr2=0x7f4f480b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:47.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.312+0000 7f4f46d9d640 1 --2- 172.21.15.19:0/1216870839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f48158b50 0x7f4f480b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.312+0000 7f4f46d9d640 1 -- 172.21.15.19:0/1216870839 >> v1:172.21.15.19:6789/0 conn(0x7f4f480b6360 legacy=0x7f4f4809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:47.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.312+0000 7f4f46d9d640 1 -- 172.21.15.19:0/1216870839 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f480b70c0 con 0x7f4f4809b140 2024-09-12T01:58:47.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.313+0000 7f4f46d9d640 1 --2- 172.21.15.19:0/1216870839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f4809b140 0x7f4f4806fe90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009e50 tx=0x7f4f4002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915313fd8540e063 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:47.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.313+0000 7f4f4559a640 1 -- 172.21.15.19:0/1216870839 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40036070 con 0x7f4f4809b140 2024-09-12T01:58:47.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.313+0000 7f4f4559a640 1 -- 172.21.15.19:0/1216870839 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f40031600 con 0x7f4f4809b140 2024-09-12T01:58:47.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.313+0000 7f4f4559a640 1 -- 172.21.15.19:0/1216870839 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f400319d0 con 0x7f4f4809b140 2024-09-12T01:58:47.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.314+0000 7f4f4cb13640 1 -- 172.21.15.19:0/1216870839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f4809b140 msgr2=0x7f4f4806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:47.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.314+0000 7f4f4cb13640 1 --2- 172.21.15.19:0/1216870839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f4809b140 0x7f4f4806fe90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009e50 tx=0x7f4f4002a710 comp rx=0 tx=0).stop 2024-09-12T01:58:47.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.314+0000 7f4f4cb13640 1 -- 172.21.15.19:0/1216870839 shutdown_connections 2024-09-12T01:58:47.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.314+0000 7f4f4cb13640 1 --2- 172.21.15.19:0/1216870839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f4809b140 0x7f4f4806fe90 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.314+0000 7f4f4cb13640 1 --2- 172.21.15.19:0/1216870839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f48158b50 0x7f4f480b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.314+0000 7f4f4cb13640 1 -- 172.21.15.19:0/1216870839 >> 172.21.15.19:0/1216870839 conn(0x7f4f480b79e0 msgr2=0x7f4f480b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:47.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.314+0000 7f4f4cb13640 1 -- 172.21.15.19:0/1216870839 shutdown_connections 2024-09-12T01:58:47.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.314+0000 7f4f4cb13640 1 -- 172.21.15.19:0/1216870839 wait complete. 2024-09-12T01:58:47.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.315+0000 7f4f4cb13640 1 Processor -- start 2024-09-12T01:58:47.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.315+0000 7f4f4cb13640 1 -- start start 2024-09-12T01:58:47.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f4cb13640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f4809b140 0x7f4f4809faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f4cb13640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f480b6360 0x7f4f481f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f4cb13640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f48158b50 0x7f4f4809dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f4cb13640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4f481590b0 con 0x7f4f480b6360 2024-09-12T01:58:47.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f4cb13640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f48158f30 con 0x7f4f4809b140 2024-09-12T01:58:47.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f4cb13640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4f4815f950 con 0x7f4f48158b50 2024-09-12T01:58:47.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f45d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f480b6360 0x7f4f481f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f45d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f480b6360 0x7f4f481f4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58154/0 (socket says 172.21.15.19:58154) 2024-09-12T01:58:47.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f45d9b640 1 -- 172.21.15.19:0/3423752065 learned_addr learned my addr 172.21.15.19:0/3423752065 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:47.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f46d9d640 1 --2- 172.21.15.19:0/3423752065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f48158b50 0x7f4f4809dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f4659c640 1 --2- 172.21.15.19:0/3423752065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f4809b140 0x7f4f4809faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f45d9b640 1 -- 172.21.15.19:0/3423752065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f48158b50 msgr2=0x7f4f4809dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f45d9b640 1 --2- 172.21.15.19:0/3423752065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f48158b50 0x7f4f4809dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f45d9b640 1 -- 172.21.15.19:0/3423752065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f4809b140 msgr2=0x7f4f4809faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f45d9b640 1 --2- 172.21.15.19:0/3423752065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f4809b140 0x7f4f4809faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f45d9b640 1 -- 172.21.15.19:0/3423752065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f481f7740 con 0x7f4f480b6360 2024-09-12T01:58:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f46d9d640 1 --2- 172.21.15.19:0/3423752065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f48158b50 0x7f4f4809dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f4659c640 1 --2- 172.21.15.19:0/3423752065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f4809b140 0x7f4f4809faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.316+0000 7f4f45d9b640 1 --2- 172.21.15.19:0/3423752065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f480b6360 0x7f4f481f4a70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00c400 tx=0x7f4f3c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.317+0000 7f4f36ffd640 1 -- 172.21.15.19:0/3423752065 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c0052d0 con 0x7f4f480b6360 2024-09-12T01:58:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.317+0000 7f4f36ffd640 1 -- 172.21.15.19:0/3423752065 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f3c005490 con 0x7f4f480b6360 2024-09-12T01:58:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.317+0000 7f4f36ffd640 1 -- 172.21.15.19:0/3423752065 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c007260 con 0x7f4f480b6360 2024-09-12T01:58:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.317+0000 7f4f4cb13640 1 -- 172.21.15.19:0/3423752065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f481f7a00 con 0x7f4f480b6360 2024-09-12T01:58:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.317+0000 7f4f4cb13640 1 -- 172.21.15.19:0/3423752065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f481f7fc0 con 0x7f4f480b6360 2024-09-12T01:58:47.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.318+0000 7f4f36ffd640 1 -- 172.21.15.19:0/3423752065 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f3c007400 con 0x7f4f480b6360 2024-09-12T01:58:47.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.319+0000 7f4f36ffd640 1 --2- 172.21.15.19:0/3423752065 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4f2806be30 0x7f4f2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.319+0000 7f4f36ffd640 1 -- 172.21.15.19:0/3423752065 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6217+0+0 (secure 0 0 0) 0x7f4f3c08a5a0 con 0x7f4f480b6360 2024-09-12T01:58:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.319+0000 7f4f4659c640 1 --2- 172.21.15.19:0/3423752065 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4f2806be30 0x7f4f2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.320+0000 7f4f4659c640 1 --2- 172.21.15.19:0/3423752065 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4f2806be30 0x7f4f2806e2f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800a870 tx=0x7f4f38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.320+0000 7f4f4f8a3740 1 Processor -- start 2024-09-12T01:58:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.320+0000 7f4f4f8a3740 1 -- start start 2024-09-12T01:58:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f4f8a3740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5533fc920 0x55c5534420c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f4f8a3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c5533fa0e0 0x55c5533fcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f4f8a3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 0x55c5533f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f4f8a3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c55335f6f0 con 0x55c5533fe0b0 2024-09-12T01:58:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f4f8a3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c553307330 con 0x55c5533fa0e0 2024-09-12T01:58:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f4f8a3740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55c55335b6b0 con 0x55c5533fc920 2024-09-12T01:58:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f46d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 0x55c5533f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f46d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 0x55c5533f71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58162/0 (socket says 172.21.15.19:58162) 2024-09-12T01:58:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f46d9d640 1 -- 172.21.15.19:0/2196272538 learned_addr learned my addr 172.21.15.19:0/2196272538 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f45d9b640 1 --2- 172.21.15.19:0/2196272538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c5533fa0e0 0x55c5533fcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f4659c640 1 --2- 172.21.15.19:0/2196272538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5533fc920 0x55c5534420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f46d9d640 1 -- 172.21.15.19:0/2196272538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5533fc920 msgr2=0x55c5534420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f46d9d640 1 --2- 172.21.15.19:0/2196272538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5533fc920 0x55c5534420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f46d9d640 1 -- 172.21.15.19:0/2196272538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c5533fa0e0 msgr2=0x55c5533fcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f46d9d640 1 --2- 172.21.15.19:0/2196272538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c5533fa0e0 0x55c5533fcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f46d9d640 1 -- 172.21.15.19:0/2196272538 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c55332d0d0 con 0x55c5533fe0b0 2024-09-12T01:58:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f45d9b640 1 --2- 172.21.15.19:0/2196272538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c5533fa0e0 0x55c5533fcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f4659c640 1 --2- 172.21.15.19:0/2196272538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5533fc920 0x55c5534420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f46d9d640 1 --2- 172.21.15.19:0/2196272538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 0x55c5533f71a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009f40 tx=0x7f4f4002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9aebd64176fb68f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f27fff640 1 -- 172.21.15.19:0/2196272538 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40036040 con 0x55c5533fe0b0 2024-09-12T01:58:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f27fff640 1 -- 172.21.15.19:0/2196272538 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f40042070 con 0x55c5533fe0b0 2024-09-12T01:58:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.321+0000 7f4f27fff640 1 -- 172.21.15.19:0/2196272538 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40031a40 con 0x55c5533fe0b0 2024-09-12T01:58:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.322+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/2196272538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 msgr2=0x55c5533f71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.322+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/2196272538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 0x55c5533f71a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009f40 tx=0x7f4f4002e000 comp rx=0 tx=0).stop 2024-09-12T01:58:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.322+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/2196272538 shutdown_connections 2024-09-12T01:58:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.322+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/2196272538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 0x55c5533f71a0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.322+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/2196272538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c5533fa0e0 0x55c5533fcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.322+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/2196272538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5533fc920 0x55c5534420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.322+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/2196272538 >> 172.21.15.19:0/2196272538 conn(0x55c5533f9370 msgr2=0x55c553441590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:47.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.322+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/2196272538 shutdown_connections 2024-09-12T01:58:47.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.322+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/2196272538 wait complete. 2024-09-12T01:58:47.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.323+0000 7f4f4f8a3740 1 -- start start 2024-09-12T01:58:47.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.323+0000 7f4f4f8a3740 1 Processor -- start 2024-09-12T01:58:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f4f8a3740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5533fc920 0x55c55343eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f4f8a3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 0x55c55342a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f4f8a3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c55342aab0 0x55c553424890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f4f8a3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c5533f8810 con 0x55c5533fe0b0 2024-09-12T01:58:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f4f8a3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c5532e84f0 con 0x55c55342aab0 2024-09-12T01:58:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f4f8a3740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55c5534428f0 con 0x55c5533fc920 2024-09-12T01:58:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f4f8a3740 10 client.0 _ll_register_callbacks cb 0x55c553309b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f45d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 0x55c55342a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f45d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 0x55c55342a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58170/0 (socket says 172.21.15.19:58170) 2024-09-12T01:58:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f45d9b640 1 -- 172.21.15.19:0/3173701708 learned_addr learned my addr 172.21.15.19:0/3173701708 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f4659c640 1 --2- 172.21.15.19:0/3173701708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5533fc920 0x55c55343eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f46d9d640 1 --2- 172.21.15.19:0/3173701708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c55342aab0 0x55c553424890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f45d9b640 1 -- 172.21.15.19:0/3173701708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5533fc920 msgr2=0x55c55343eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f45d9b640 1 --2- 172.21.15.19:0/3173701708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5533fc920 0x55c55343eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f45d9b640 1 -- 172.21.15.19:0/3173701708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c55342aab0 msgr2=0x55c553424890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f45d9b640 1 --2- 172.21.15.19:0/3173701708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c55342aab0 0x55c553424890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f45d9b640 1 -- 172.21.15.19:0/3173701708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c55313c7d0 con 0x55c5533fe0b0 2024-09-12T01:58:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f45d9b640 1 --2- 172.21.15.19:0/3173701708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 0x55c55342a570 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c007810 tx=0x7f4f3c058710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0a25ea025924cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f257fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:58:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f257fa640 1 -- 172.21.15.19:0/3173701708 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c05db90 con 0x55c5533fe0b0 2024-09-12T01:58:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f257fa640 1 -- 172.21.15.19:0/3173701708 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6217+0+0 (secure 0 0 0) 0x7f4f3c05dd30 con 0x55c5533fe0b0 2024-09-12T01:58:47.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.324+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/3173701708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f40042070 con 0x55c5533fe0b0 2024-09-12T01:58:47.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.325+0000 7f4f257fa640 1 -- 172.21.15.19:0/3173701708 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f4f3c057aa0 con 0x55c5533fe0b0 2024-09-12T01:58:47.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.325+0000 7f4f4f8a3740 10 client.6090 fetch_fsmap learned FSMap version 41 2024-09-12T01:58:47.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.325+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/3173701708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x55c5530723f0 con 0x55c5533fe0b0 2024-09-12T01:58:47.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.325+0000 7f4f257fa640 1 -- 172.21.15.19:0/3173701708 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f40042070 con 0x55c5533fe0b0 2024-09-12T01:58:47.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.325+0000 7f4f257fa640 1 -- 172.21.15.19:0/3173701708 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 41) ==== 3502+0+0 (secure 0 0 0) 0x7f4f3c057c40 con 0x55c5533fe0b0 2024-09-12T01:58:47.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.325+0000 7f4f4f8a3740 10 client.6090 fetch_fsmap finished waiting for FSMap version 41 2024-09-12T01:58:47.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.325+0000 7f4f4f8a3740 10 client.6090 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-12T01:58:47.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.325+0000 7f4f4f8a3740 20 client.6090 populate_metadata read hostname 'smithi019' 2024-09-12T01:58:47.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.325+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/3173701708 >> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] conn(0x55c55345bfe0 0x55c55345e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.325+0000 7f4f4f8a3740 4 client.6090 mds_command: new command op to 5868 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:47.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.325+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/3173701708 --> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c55336ce20 con 0x55c55345bfe0 2024-09-12T01:58:47.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.325+0000 7f4f4659c640 1 --2- 172.21.15.19:0/3173701708 >> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] conn(0x55c55345bfe0 0x55c55345e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.325+0000 7f4f257fa640 10 client.6090 ms_handle_connect on v2:172.21.15.19:6833/1551156711 2024-09-12T01:58:47.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.325+0000 7f4f4659c640 1 --2- 172.21.15.19:0/3173701708 >> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] conn(0x55c55345bfe0 0x55c55345e3d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36c7cf0214b09811 server_cookie=490807c3b84c9a85 in_seq=0 out_seq=0 2024-09-12T01:58:47.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.326+0000 7f4f257fa640 1 -- 172.21.15.19:0/3173701708 <== mds.0 v2:172.21.15.19:6833/1551156711 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c55336ce20 con 0x55c55345bfe0 2024-09-12T01:58:47.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.326+0000 7f4f257fa640 10 client.6090 handle_command_reply: tid=0 2024-09-12T01:58:47.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.326+0000 7f4f4f8a3740 1 client.6090 shutdown 2024-09-12T01:58:47.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.326+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/3173701708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 msgr2=0x55c55342a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:47.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.326+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/3173701708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 0x55c55342a570 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c007810 tx=0x7f4f3c058710 comp rx=0 tx=0).stop 2024-09-12T01:58:47.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.326+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/3173701708 shutdown_connections 2024-09-12T01:58:47.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.326+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/3173701708 >> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] conn(0x55c55345bfe0 0x55c55345e3d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.326+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/3173701708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c55342aab0 0x55c553424890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.326+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/3173701708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 0x55c55342a570 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.326+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/3173701708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5533fc920 0x55c55343eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.326+0000 7f4f257fa640 0 client.6090 ms_handle_reset on v2:172.21.15.19:6833/1551156711 2024-09-12T01:58:47.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.326+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/3173701708 >> 172.21.15.19:0/3173701708 conn(0x55c5533fa0e0 msgr2=0x55c5533fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:47.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.326+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/3173701708 shutdown_connections 2024-09-12T01:58:47.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.326+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/3173701708 wait complete. 2024-09-12T01:58:47.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.326+0000 7f4f4f8a3740 20 client.6090 trim_cache size 0 max 16384 2024-09-12T01:58:47.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.341+0000 7f4f4f8a3740 1 Processor -- start 2024-09-12T01:58:47.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.341+0000 7f4f4f8a3740 1 -- start start 2024-09-12T01:58:47.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.341+0000 7f4f4f8a3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c5533fc920 0x55c553410c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.341+0000 7f4f4f8a3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 0x55c553441560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.341+0000 7f4f4f8a3740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c55342aab0 0x55c553441aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.341+0000 7f4f4f8a3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c5534269f0 con 0x55c5533fe0b0 2024-09-12T01:58:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.341+0000 7f4f4f8a3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f482012b0 con 0x55c5533fc920 2024-09-12T01:58:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.341+0000 7f4f4f8a3740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4f48200290 con 0x55c55342aab0 2024-09-12T01:58:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.342+0000 7f4f45d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 0x55c553441560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.342+0000 7f4f45d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 0x55c553441560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58174/0 (socket says 172.21.15.19:58174) 2024-09-12T01:58:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.342+0000 7f4f45d9b640 1 -- 172.21.15.19:0/1292454388 learned_addr learned my addr 172.21.15.19:0/1292454388 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.342+0000 7f4f45d9b640 1 -- 172.21.15.19:0/1292454388 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c55342aab0 msgr2=0x55c553441aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.342+0000 7f4f45d9b640 1 --2- 172.21.15.19:0/1292454388 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c55342aab0 0x55c553441aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.342+0000 7f4f45d9b640 1 -- 172.21.15.19:0/1292454388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c5533fc920 msgr2=0x55c553410c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.342+0000 7f4f45d9b640 1 --2- 172.21.15.19:0/1292454388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c5533fc920 0x55c553410c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.342+0000 7f4f45d9b640 1 -- 172.21.15.19:0/1292454388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c55345e740 con 0x55c5533fe0b0 2024-09-12T01:58:47.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.342+0000 7f4f45d9b640 1 --2- 172.21.15.19:0/1292454388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 0x55c553441560 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0585e0 tx=0x7f4f3c08a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbcb1bda37fab113 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:47.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.342+0000 7f4f277fe640 1 -- 172.21.15.19:0/1292454388 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c057c40 con 0x55c5533fe0b0 2024-09-12T01:58:47.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.342+0000 7f4f277fe640 1 -- 172.21.15.19:0/1292454388 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f3c08a190 con 0x55c5533fe0b0 2024-09-12T01:58:47.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.342+0000 7f4f277fe640 1 -- 172.21.15.19:0/1292454388 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c05db90 con 0x55c5533fe0b0 2024-09-12T01:58:47.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.343+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/1292454388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 msgr2=0x55c553441560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:47.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.343+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/1292454388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 0x55c553441560 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0585e0 tx=0x7f4f3c08a050 comp rx=0 tx=0).stop 2024-09-12T01:58:47.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.343+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/1292454388 shutdown_connections 2024-09-12T01:58:47.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.343+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/1292454388 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c55342aab0 0x55c553441aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.343+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/1292454388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fe0b0 0x55c553441560 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.343+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/1292454388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c5533fc920 0x55c553410c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.343+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/1292454388 >> 172.21.15.19:0/1292454388 conn(0x55c5533fa0e0 msgr2=0x55c5533f8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.343+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/1292454388 shutdown_connections 2024-09-12T01:58:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.343+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/1292454388 wait complete. 2024-09-12T01:58:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.343+0000 7f4f4f8a3740 1 -- start start 2024-09-12T01:58:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.343+0000 7f4f4f8a3740 1 Processor -- start 2024-09-12T01:58:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.344+0000 7f4f4f8a3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fc920 0x55c5534c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.344+0000 7f4f4f8a3740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5533fe0b0 0x55c553463370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.344+0000 7f4f4f8a3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c55342aab0 0x55c5534bee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.344+0000 7f4f4f8a3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4f481ffca0 con 0x55c5533fc920 2024-09-12T01:58:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.344+0000 7f4f4f8a3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f481e9100 con 0x55c55342aab0 2024-09-12T01:58:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.344+0000 7f4f4f8a3740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55c5534bf980 con 0x55c5533fe0b0 2024-09-12T01:58:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.344+0000 7f4f4f8a3740 10 client.0 _ll_register_callbacks cb 0x7f4f3c054970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.344+0000 7f4f4659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fc920 0x55c5534c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.344+0000 7f4f4659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fc920 0x55c5534c33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58180/0 (socket says 172.21.15.19:58180) 2024-09-12T01:58:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.344+0000 7f4f4659c640 1 -- 172.21.15.19:0/3770796264 learned_addr learned my addr 172.21.15.19:0/3770796264 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f46d9d640 1 --2- 172.21.15.19:0/3770796264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c55342aab0 0x55c5534bee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f45d9b640 1 --2- 172.21.15.19:0/3770796264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5533fe0b0 0x55c553463370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f4659c640 1 -- 172.21.15.19:0/3770796264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5533fe0b0 msgr2=0x55c553463370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f4659c640 1 --2- 172.21.15.19:0/3770796264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5533fe0b0 0x55c553463370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f4659c640 1 -- 172.21.15.19:0/3770796264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c55342aab0 msgr2=0x55c5534bee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f4659c640 1 --2- 172.21.15.19:0/3770796264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c55342aab0 0x55c5534bee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f4659c640 1 -- 172.21.15.19:0/3770796264 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c55342a8e0 con 0x55c5533fc920 2024-09-12T01:58:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f4659c640 1 --2- 172.21.15.19:0/3770796264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fc920 0x55c5534c33e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x55c55345e910 tx=0x7f4f38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec72ec99284e73e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f257fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:58:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f257fa640 1 -- 172.21.15.19:0/3770796264 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38022b40 con 0x55c5533fc920 2024-09-12T01:58:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f257fa640 1 -- 172.21.15.19:0/3770796264 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6217+0+0 (secure 0 0 0) 0x7f4f38022ce0 con 0x55c5533fc920 2024-09-12T01:58:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/3770796264 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f3c08a190 con 0x55c5533fc920 2024-09-12T01:58:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f257fa640 1 -- 172.21.15.19:0/3770796264 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f4f38036050 con 0x55c5533fc920 2024-09-12T01:58:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f4f8a3740 10 client.6096 fetch_fsmap learned FSMap version 41 2024-09-12T01:58:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/3770796264 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x55c5530320f0 con 0x55c5533fc920 2024-09-12T01:58:47.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f257fa640 1 -- 172.21.15.19:0/3770796264 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f3c08a190 con 0x55c5533fc920 2024-09-12T01:58:47.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f257fa640 1 -- 172.21.15.19:0/3770796264 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 41) ==== 3502+0+0 (secure 0 0 0) 0x7f4f38039020 con 0x55c5533fc920 2024-09-12T01:58:47.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f4f8a3740 10 client.6096 fetch_fsmap finished waiting for FSMap version 41 2024-09-12T01:58:47.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f4f8a3740 10 client.6096 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-12T01:58:47.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f4f8a3740 20 client.6096 populate_metadata read hostname 'smithi019' 2024-09-12T01:58:47.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/3770796264 >> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] conn(0x55c5534bf3a0 0x55c553441560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f4f8a3740 4 client.6096 mds_command: new command op to 5868 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:58:47.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.345+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/3770796264 --> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c55342ba30 con 0x55c5534bf3a0 2024-09-12T01:58:47.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.346+0000 7f4f45d9b640 1 --2- 172.21.15.19:0/3770796264 >> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] conn(0x55c5534bf3a0 0x55c553441560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.346+0000 7f4f257fa640 10 client.6096 ms_handle_connect on v2:172.21.15.19:6833/1551156711 2024-09-12T01:58:47.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.346+0000 7f4f45d9b640 1 --2- 172.21.15.19:0/3770796264 >> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] conn(0x55c5534bf3a0 0x55c553441560 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=340e393a5366331b server_cookie=e2649a50ec0f8720 in_seq=0 out_seq=0 2024-09-12T01:58:47.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.360+0000 7f4f257fa640 1 -- 172.21.15.19:0/3770796264 <== mds.0 v2:172.21.15.19:6833/1551156711 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c55342ba30 con 0x55c5534bf3a0 2024-09-12T01:58:47.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.360+0000 7f4f257fa640 10 client.6096 handle_command_reply: tid=0 2024-09-12T01:58:47.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.360+0000 7f4f4f8a3740 1 client.6096 shutdown 2024-09-12T01:58:47.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.360+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/3770796264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fc920 msgr2=0x55c5534c33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:47.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.360+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/3770796264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fc920 0x55c5534c33e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x55c55345e910 tx=0x7f4f38004730 comp rx=0 tx=0).stop 2024-09-12T01:58:47.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/3770796264 shutdown_connections 2024-09-12T01:58:47.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/3770796264 >> [v2:172.21.15.19:6833/1551156711,v1:172.21.15.19:6835/1551156711] conn(0x55c5534bf3a0 0x55c553441560 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/3770796264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c55342aab0 0x55c5534bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f257fa640 0 client.6096 ms_handle_reset on v2:172.21.15.19:6833/1551156711 2024-09-12T01:58:47.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/3770796264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5533fe0b0 0x55c553463370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4f8a3740 1 --2- 172.21.15.19:0/3770796264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5533fc920 0x55c5534c33e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/3770796264 >> 172.21.15.19:0/3770796264 conn(0x55c5533fa0e0 msgr2=0x55c5533f2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:47.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/3770796264 shutdown_connections 2024-09-12T01:58:47.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4f8a3740 1 -- 172.21.15.19:0/3770796264 wait complete. 2024-09-12T01:58:47.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4f8a3740 20 client.6096 trim_cache size 0 max 16384 2024-09-12T01:58:47.362 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:58:47.362 INFO:teuthology.orchestra.run.smithi019.stdout: "message": "", 2024-09-12T01:58:47.362 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0 2024-09-12T01:58:47.362 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:58:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4cb13640 1 -- 172.21.15.19:0/3423752065 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4f2806be30 msgr2=0x7f4f2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4cb13640 1 --2- 172.21.15.19:0/3423752065 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4f2806be30 0x7f4f2806e2f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800a870 tx=0x7f4f38008040 comp rx=0 tx=0).stop 2024-09-12T01:58:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4cb13640 1 -- 172.21.15.19:0/3423752065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f480b6360 msgr2=0x7f4f481f4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4cb13640 1 --2- 172.21.15.19:0/3423752065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f480b6360 0x7f4f481f4a70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00c400 tx=0x7f4f3c00c8c0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4cb13640 1 -- 172.21.15.19:0/3423752065 shutdown_connections 2024-09-12T01:58:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4cb13640 1 --2- 172.21.15.19:0/3423752065 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4f2806be30 0x7f4f2806e2f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4cb13640 1 --2- 172.21.15.19:0/3423752065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f48158b50 0x7f4f4809dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4cb13640 1 --2- 172.21.15.19:0/3423752065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f480b6360 0x7f4f481f4a70 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4cb13640 1 --2- 172.21.15.19:0/3423752065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f4809b140 0x7f4f4809faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.361+0000 7f4f4cb13640 1 -- 172.21.15.19:0/3423752065 >> 172.21.15.19:0/3423752065 conn(0x7f4f480b79e0 msgr2=0x7f4f4806fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:47.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.362+0000 7f4f4cb13640 1 -- 172.21.15.19:0/3423752065 shutdown_connections 2024-09-12T01:58:47.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.362+0000 7f4f4cb13640 1 -- 172.21.15.19:0/3423752065 wait complete. 2024-09-12T01:58:47.372 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:58:47.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.474+0000 7f8780552640 1 Processor -- start 2024-09-12T01:58:47.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.474+0000 7f8780552640 1 -- start start 2024-09-12T01:58:47.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.475+0000 7f8780552640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8778161c80 0x7f877806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.475+0000 7f8780552640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f87780b6680 0x7f87780cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.475+0000 7f8780552640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f877806e870 con 0x7f8778162060 2024-09-12T01:58:47.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.475+0000 7f8780552640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f877806d9f0 con 0x7f87780b6680 2024-09-12T01:58:47.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.475+0000 7f8780552640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f877806dcd0 con 0x7f8778161c80 2024-09-12T01:58:47.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.475+0000 7f877eaef640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f87780b6680 0x7f87780cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.475+0000 7f877eaef640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f87780b6680 0x7f87780cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58194/0 (socket says 172.21.15.19:58194) 2024-09-12T01:58:47.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.475+0000 7f877eaef640 1 -- 172.21.15.19:0/2705559906 learned_addr learned my addr 172.21.15.19:0/2705559906 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:47.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.475+0000 7f877e2ee640 1 --2- 172.21.15.19:0/2705559906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8778161c80 0x7f877806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.475+0000 7f877eaef640 1 -- 172.21.15.19:0/2705559906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8778161c80 msgr2=0x7f877806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:47.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.475+0000 7f877eaef640 1 --2- 172.21.15.19:0/2705559906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8778161c80 0x7f877806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.475+0000 7f877eaef640 1 -- 172.21.15.19:0/2705559906 >> v1:172.21.15.135:6789/0 conn(0x7f8778162060 legacy=0x7f87780b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:47.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.475+0000 7f877eaef640 1 -- 172.21.15.19:0/2705559906 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877806dfb0 con 0x7f87780b6680 2024-09-12T01:58:47.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.476+0000 7f877eaef640 1 --2- 172.21.15.19:0/2705559906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87780b6680 0x7f87780cf1e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8770009e50 tx=0x7f877002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3507f2d065b8f21 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.476+0000 7f877d2ec640 1 -- 172.21.15.19:0/2705559906 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770036070 con 0x7f87780b6680 2024-09-12T01:58:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.476+0000 7f877d2ec640 1 -- 172.21.15.19:0/2705559906 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8770031600 con 0x7f87780b6680 2024-09-12T01:58:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.476+0000 7f877d2ec640 1 -- 172.21.15.19:0/2705559906 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87700319d0 con 0x7f87780b6680 2024-09-12T01:58:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.477+0000 7f8780552640 1 -- 172.21.15.19:0/2705559906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87780b6680 msgr2=0x7f87780cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.477+0000 7f8780552640 1 --2- 172.21.15.19:0/2705559906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87780b6680 0x7f87780cf1e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8770009e50 tx=0x7f877002a710 comp rx=0 tx=0).stop 2024-09-12T01:58:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.477+0000 7f8780552640 1 -- 172.21.15.19:0/2705559906 shutdown_connections 2024-09-12T01:58:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.477+0000 7f8780552640 1 --2- 172.21.15.19:0/2705559906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87780b6680 0x7f87780cf1e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.477+0000 7f8780552640 1 --2- 172.21.15.19:0/2705559906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8778161c80 0x7f877806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.477+0000 7f8780552640 1 -- 172.21.15.19:0/2705559906 >> 172.21.15.19:0/2705559906 conn(0x7f87780d44f0 msgr2=0x7f87780d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.477+0000 7f8780552640 1 -- 172.21.15.19:0/2705559906 shutdown_connections 2024-09-12T01:58:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.477+0000 7f8780552640 1 -- 172.21.15.19:0/2705559906 wait complete. 2024-09-12T01:58:47.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.478+0000 7f8780552640 1 Processor -- start 2024-09-12T01:58:47.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.478+0000 7f8780552640 1 -- start start 2024-09-12T01:58:47.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.479+0000 7f8780552640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87780b6680 0x7f87780b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.479+0000 7f8780552640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8778161c80 0x7f87781563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.479+0000 7f8780552640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8778162060 0x7f87780b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.479+0000 7f8780552640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f87780b6b30 con 0x7f8778162060 2024-09-12T01:58:47.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.479+0000 7f8780552640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f87780d2aa0 con 0x7f8778161c80 2024-09-12T01:58:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.479+0000 7f8780552640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f87780b6cb0 con 0x7f87780b6680 2024-09-12T01:58:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.479+0000 7f877eaef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8778162060 0x7f87780b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.479+0000 7f877eaef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8778162060 0x7f87780b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58200/0 (socket says 172.21.15.19:58200) 2024-09-12T01:58:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.479+0000 7f877eaef640 1 -- 172.21.15.19:0/4107318680 learned_addr learned my addr 172.21.15.19:0/4107318680 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.479+0000 7f877e2ee640 1 --2- 172.21.15.19:0/4107318680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87780b6680 0x7f87780b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.479+0000 7f877daed640 1 --2- 172.21.15.19:0/4107318680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8778161c80 0x7f87781563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.479+0000 7f877eaef640 1 -- 172.21.15.19:0/4107318680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87780b6680 msgr2=0x7f87780b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.479+0000 7f877eaef640 1 --2- 172.21.15.19:0/4107318680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87780b6680 0x7f87780b7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.479+0000 7f877eaef640 1 -- 172.21.15.19:0/4107318680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8778161c80 msgr2=0x7f87781563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.479+0000 7f877eaef640 1 --2- 172.21.15.19:0/4107318680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8778161c80 0x7f87781563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.479+0000 7f877eaef640 1 -- 172.21.15.19:0/4107318680 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87780b7920 con 0x7f8778162060 2024-09-12T01:58:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.480+0000 7f877eaef640 1 --2- 172.21.15.19:0/4107318680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8778162060 0x7f87780b20b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8770009f70 tx=0x7f8770004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.480+0000 7f876effd640 1 -- 172.21.15.19:0/4107318680 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877003f020 con 0x7f8778162060 2024-09-12T01:58:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.480+0000 7f876effd640 1 -- 172.21.15.19:0/4107318680 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8770037040 con 0x7f8778162060 2024-09-12T01:58:47.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.480+0000 7f876effd640 1 -- 172.21.15.19:0/4107318680 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770036070 con 0x7f8778162060 2024-09-12T01:58:47.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.480+0000 7f8780552640 1 -- 172.21.15.19:0/4107318680 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87780b7c00 con 0x7f8778162060 2024-09-12T01:58:47.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.480+0000 7f8780552640 1 -- 172.21.15.19:0/4107318680 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f877815a4a0 con 0x7f8778162060 2024-09-12T01:58:47.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.481+0000 7f8780552640 1 -- 172.21.15.19:0/4107318680 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87780ba470 con 0x7f8778162060 2024-09-12T01:58:47.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.481+0000 7f876effd640 1 -- 172.21.15.19:0/4107318680 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8770042020 con 0x7f8778162060 2024-09-12T01:58:47.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.482+0000 7f876effd640 1 --2- 172.21.15.19:0/4107318680 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f875c06be30 0x7f875c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.482+0000 7f876effd640 1 -- 172.21.15.19:0/4107318680 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6217+0+0 (secure 0 0 0) 0x7f87700ab300 con 0x7f8778162060 2024-09-12T01:58:47.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.482+0000 7f877e2ee640 1 --2- 172.21.15.19:0/4107318680 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f875c06be30 0x7f875c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.483+0000 7f877e2ee640 1 --2- 172.21.15.19:0/4107318680 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f875c06be30 0x7f875c06e2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f87740079a0 tx=0x7f8774008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:47.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.486+0000 7f876effd640 1 -- 172.21.15.19:0/4107318680 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8770049030 con 0x7f8778162060 2024-09-12T01:58:47.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.696+0000 7f8780552640 1 -- 172.21.15.19:0/4107318680 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f87780b5f80 con 0x7f8778162060 2024-09-12T01:58:47.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.697+0000 7f876effd640 1 -- 172.21.15.19:0/4107318680 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) ==== 53+0+73 (secure 0 0 0) 0x7f87700794f0 con 0x7f8778162060 2024-09-12T01:58:47.696 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:58:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.699+0000 7f8780552640 1 -- 172.21.15.19:0/4107318680 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f875c06be30 msgr2=0x7f875c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.699+0000 7f8780552640 1 --2- 172.21.15.19:0/4107318680 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f875c06be30 0x7f875c06e2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f87740079a0 tx=0x7f8774008040 comp rx=0 tx=0).stop 2024-09-12T01:58:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.699+0000 7f8780552640 1 -- 172.21.15.19:0/4107318680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8778162060 msgr2=0x7f87780b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.699+0000 7f8780552640 1 --2- 172.21.15.19:0/4107318680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8778162060 0x7f87780b20b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8770009f70 tx=0x7f8770004a40 comp rx=0 tx=0).stop 2024-09-12T01:58:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.699+0000 7f8780552640 1 -- 172.21.15.19:0/4107318680 shutdown_connections 2024-09-12T01:58:47.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.699+0000 7f8780552640 1 --2- 172.21.15.19:0/4107318680 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f875c06be30 0x7f875c06e2f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.699+0000 7f8780552640 1 --2- 172.21.15.19:0/4107318680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8778162060 0x7f87780b20b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.699+0000 7f8780552640 1 --2- 172.21.15.19:0/4107318680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8778161c80 0x7f87781563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.699+0000 7f8780552640 1 --2- 172.21.15.19:0/4107318680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87780b6680 0x7f87780b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.699+0000 7f8780552640 1 -- 172.21.15.19:0/4107318680 >> 172.21.15.19:0/4107318680 conn(0x7f87780d44f0 msgr2=0x7f87780cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:47.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.699+0000 7f8780552640 1 -- 172.21.15.19:0/4107318680 shutdown_connections 2024-09-12T01:58:47.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47.699+0000 7f8780552640 1 -- 172.21.15.19:0/4107318680 wait complete. 2024-09-12T01:58:47.709 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:58:47.709 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:58:47.709 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T01:58:47.709 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:58:47.710 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:58:47.710 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:58:47.710 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:58:47.710 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:58:47.710 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:58:47.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:47.710 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T01:58:47.727 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:58:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:58:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:58:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T01:58:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:47.727 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:58:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:58:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T01:58:47.728 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:58:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:58:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T01:58:47.728 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:58:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T01:58:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T01:58:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:58:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42633sec preferred_lft 42633sec 2024-09-12T01:58:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T01:58:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:47.728 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:58:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T01:58:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T01:58:47.729 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:58:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T01:58:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:58:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T01:58:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:47.729 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:58:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:58:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T01:58:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:47.729 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:58:47.730 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:58:47.730 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T01:58:47.730 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:58:47.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:47.730 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:58:47.791 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T01:58:47.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:47.793 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T01:58:47.849 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T01:58:47.850 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:58:47.850 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:58:47.850 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:58:47.850 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:58:47.850 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:58:47.850 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T01:58:47.850 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:58:47.850 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:58:47.850 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:58:47.850 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T01:58:47.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:58:47.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:58:47.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:47.978 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T01:58:47.994 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T01:58:47.994 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:58:47.994 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:58:47.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:47.995 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T01:58:48.059 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:58:48.060 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:58:48.116 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:58:48.116 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:58:48.116 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:58:48.172 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T01:58:48.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:48.172 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:58:48.257 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:58:48.257 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:58:48.257 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:58:48.266 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:58:48.266 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:58:48.266 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:58:48.266 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:58:48.266 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:58:48.271 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:58:48.271 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:58:48.271 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T01:58:48.271 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T01:58:48.271 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:58:48.271 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T01:58:48.271 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T01:58:48.272 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T01:58:48.272 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:58:48.272 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:58:48.272 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:58:48.272 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:58:48.272 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:58:48.274 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:58:48.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:48.274 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:58:48.299 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:58:48.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:58:48.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:58:48.397 INFO:teuthology.orchestra.run.smithi019.stdout:client5384 2024-09-12T01:58:48.397 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:58:48.398 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:58:48.414 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'chmod 711 a/b/d; sync .') 2024-09-12T01:58:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:58:48.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:58:48.512 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:58:48.513 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:58:48.529 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:58:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.673+0000 7f36e13e8640 1 Processor -- start 2024-09-12T01:58:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.673+0000 7f36e13e8640 1 -- start start 2024-09-12T01:58:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.674+0000 7f36e13e8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36dc072de0 0x7f36dc15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.674+0000 7f36e13e8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f36dc072700 0x7f36dc15d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.674+0000 7f36e13e8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36dc146140 con 0x7f36dc072320 2024-09-12T01:58:48.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.674+0000 7f36e13e8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f36dc0cd740 con 0x7f36dc072700 2024-09-12T01:58:48.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.674+0000 7f36e13e8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f36dc0cda20 con 0x7f36dc072de0 2024-09-12T01:58:48.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.674+0000 7f36db7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f36dc072700 0x7f36dc15d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.674+0000 7f36db7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f36dc072700 0x7f36dc15d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58204/0 (socket says 172.21.15.19:58204) 2024-09-12T01:58:48.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.674+0000 7f36db7fe640 1 -- 172.21.15.19:0/3394349341 learned_addr learned my addr 172.21.15.19:0/3394349341 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:48.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.674+0000 7f36db7fe640 1 -- 172.21.15.19:0/3394349341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36dc072de0 msgr2=0x7f36dc15d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:48.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.674+0000 7f36db7fe640 1 --2- 172.21.15.19:0/3394349341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36dc072de0 0x7f36dc15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.674+0000 7f36db7fe640 1 -- 172.21.15.19:0/3394349341 >> v1:172.21.15.135:6789/0 conn(0x7f36dc072320 legacy=0x7f36dc0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:48.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.674+0000 7f36db7fe640 1 -- 172.21.15.19:0/3394349341 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36dc0cdd00 con 0x7f36dc072700 2024-09-12T01:58:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.675+0000 7f36db7fe640 1 --2- 172.21.15.19:0/3394349341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36dc072700 0x7f36dc15d720 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009870 tx=0x7f36d402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22484f4d697bf9b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.675+0000 7f36d9ffb640 1 -- 172.21.15.19:0/3394349341 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d4037070 con 0x7f36dc072700 2024-09-12T01:58:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.675+0000 7f36d9ffb640 1 -- 172.21.15.19:0/3394349341 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36d4032440 con 0x7f36dc072700 2024-09-12T01:58:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.675+0000 7f36d9ffb640 1 -- 172.21.15.19:0/3394349341 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d4032810 con 0x7f36dc072700 2024-09-12T01:58:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.676+0000 7f36e13e8640 1 -- 172.21.15.19:0/3394349341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36dc072700 msgr2=0x7f36dc15d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.676+0000 7f36e13e8640 1 --2- 172.21.15.19:0/3394349341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36dc072700 0x7f36dc15d720 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009870 tx=0x7f36d402a180 comp rx=0 tx=0).stop 2024-09-12T01:58:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.676+0000 7f36e13e8640 1 -- 172.21.15.19:0/3394349341 shutdown_connections 2024-09-12T01:58:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.676+0000 7f36e13e8640 1 --2- 172.21.15.19:0/3394349341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36dc072700 0x7f36dc15d720 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.676+0000 7f36e13e8640 1 --2- 172.21.15.19:0/3394349341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36dc072de0 0x7f36dc15d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.676+0000 7f36e13e8640 1 -- 172.21.15.19:0/3394349341 >> 172.21.15.19:0/3394349341 conn(0x7f36dc067d70 msgr2=0x7f36dc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:48.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.676+0000 7f36e13e8640 1 -- 172.21.15.19:0/3394349341 shutdown_connections 2024-09-12T01:58:48.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.676+0000 7f36e13e8640 1 -- 172.21.15.19:0/3394349341 wait complete. 2024-09-12T01:58:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.677+0000 7f36e13e8640 1 Processor -- start 2024-09-12T01:58:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.677+0000 7f36e13e8640 1 -- start start 2024-09-12T01:58:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.678+0000 7f36e13e8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36dc072320 0x7f36dc142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.678+0000 7f36e13e8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36dc072700 0x7f36dc0ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.678+0000 7f36e13e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36dc072de0 0x7f36dc0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.678+0000 7f36e13e8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f36dc15dde0 con 0x7f36dc072de0 2024-09-12T01:58:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.678+0000 7f36e13e8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f36dc15dc60 con 0x7f36dc072320 2024-09-12T01:58:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.678+0000 7f36e13e8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f36dc15df60 con 0x7f36dc072700 2024-09-12T01:58:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.678+0000 7f36db7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36dc072de0 0x7f36dc0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.678+0000 7f36db7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36dc072de0 0x7f36dc0b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58208/0 (socket says 172.21.15.19:58208) 2024-09-12T01:58:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.678+0000 7f36db7fe640 1 -- 172.21.15.19:0/2393851308 learned_addr learned my addr 172.21.15.19:0/2393851308 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.678+0000 7f36db7fe640 1 -- 172.21.15.19:0/2393851308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36dc072700 msgr2=0x7f36dc0ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.678+0000 7f36da7fc640 1 --2- 172.21.15.19:0/2393851308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36dc072700 0x7f36dc0ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.678+0000 7f36daffd640 1 --2- 172.21.15.19:0/2393851308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36dc072320 0x7f36dc142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.678+0000 7f36db7fe640 1 --2- 172.21.15.19:0/2393851308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36dc072700 0x7f36dc0ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.678+0000 7f36db7fe640 1 -- 172.21.15.19:0/2393851308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36dc072320 msgr2=0x7f36dc142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.678+0000 7f36db7fe640 1 --2- 172.21.15.19:0/2393851308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36dc072320 0x7f36dc142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.678+0000 7f36db7fe640 1 -- 172.21.15.19:0/2393851308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36dc0c9f50 con 0x7f36dc072de0 2024-09-12T01:58:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.678+0000 7f36db7fe640 1 --2- 172.21.15.19:0/2393851308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36dc072de0 0x7f36dc0b41b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f36d402a1c0 tx=0x7f36d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.679+0000 7f36d37fe640 1 -- 172.21.15.19:0/2393851308 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d4041070 con 0x7f36dc072de0 2024-09-12T01:58:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.679+0000 7f36d37fe640 1 -- 172.21.15.19:0/2393851308 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36d403c950 con 0x7f36dc072de0 2024-09-12T01:58:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.679+0000 7f36e13e8640 1 -- 172.21.15.19:0/2393851308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36dc0ca230 con 0x7f36dc072de0 2024-09-12T01:58:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.679+0000 7f36d37fe640 1 -- 172.21.15.19:0/2393851308 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d4037040 con 0x7f36dc072de0 2024-09-12T01:58:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.679+0000 7f36e13e8640 1 -- 172.21.15.19:0/2393851308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36dc0ca7f0 con 0x7f36dc072de0 2024-09-12T01:58:48.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.680+0000 7f36e13e8640 1 -- 172.21.15.19:0/2393851308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36dc15e390 con 0x7f36dc072de0 2024-09-12T01:58:48.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.680+0000 7f36d37fe640 1 -- 172.21.15.19:0/2393851308 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f36d4044070 con 0x7f36dc072de0 2024-09-12T01:58:48.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.681+0000 7f36d37fe640 1 --2- 172.21.15.19:0/2393851308 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f36bc06be30 0x7f36bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.681+0000 7f36d37fe640 1 -- 172.21.15.19:0/2393851308 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6217+0+0 (secure 0 0 0) 0x7f36d40abcb0 con 0x7f36dc072de0 2024-09-12T01:58:48.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.681+0000 7f36daffd640 1 --2- 172.21.15.19:0/2393851308 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f36bc06be30 0x7f36bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.682+0000 7f36daffd640 1 --2- 172.21.15.19:0/2393851308 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f36bc06be30 0x7f36bc06e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f36cc007fd0 tx=0x7f36cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:48.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.685+0000 7f36d37fe640 1 -- 172.21.15.19:0/2393851308 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f36d407a610 con 0x7f36dc072de0 2024-09-12T01:58:48.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.871+0000 7f36e13e8640 1 -- 172.21.15.19:0/2393851308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f36dc142bd0 con 0x7f36dc072de0 2024-09-12T01:58:48.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.872+0000 7f36d37fe640 1 -- 172.21.15.19:0/2393851308 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v68) ==== 80+0+0 (secure 0 0 0) 0x7f36d4079f10 con 0x7f36dc072de0 2024-09-12T01:58:48.871 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-09-12T01:58:48.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.874+0000 7f36e13e8640 1 -- 172.21.15.19:0/2393851308 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f36bc06be30 msgr2=0x7f36bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.874+0000 7f36e13e8640 1 --2- 172.21.15.19:0/2393851308 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f36bc06be30 0x7f36bc06e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f36cc007fd0 tx=0x7f36cc009040 comp rx=0 tx=0).stop 2024-09-12T01:58:48.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.874+0000 7f36e13e8640 1 -- 172.21.15.19:0/2393851308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36dc072de0 msgr2=0x7f36dc0b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.874+0000 7f36e13e8640 1 --2- 172.21.15.19:0/2393851308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36dc072de0 0x7f36dc0b41b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f36d402a1c0 tx=0x7f36d40046c0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.874+0000 7f36e13e8640 1 -- 172.21.15.19:0/2393851308 shutdown_connections 2024-09-12T01:58:48.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.874+0000 7f36e13e8640 1 --2- 172.21.15.19:0/2393851308 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f36bc06be30 0x7f36bc06e2f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.874+0000 7f36e13e8640 1 --2- 172.21.15.19:0/2393851308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36dc072de0 0x7f36dc0b41b0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.874+0000 7f36e13e8640 1 --2- 172.21.15.19:0/2393851308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36dc072700 0x7f36dc0ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.874+0000 7f36e13e8640 1 --2- 172.21.15.19:0/2393851308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36dc072320 0x7f36dc142690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.874+0000 7f36e13e8640 1 -- 172.21.15.19:0/2393851308 >> 172.21.15.19:0/2393851308 conn(0x7f36dc067d70 msgr2=0x7f36dc06e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:48.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.874+0000 7f36e13e8640 1 -- 172.21.15.19:0/2393851308 shutdown_connections 2024-09-12T01:58:48.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:48.874+0000 7f36e13e8640 1 -- 172.21.15.19:0/2393851308 wait complete. 2024-09-12T01:58:48.884 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:58:48.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:48.885 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:58:48.916 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:58:48.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:58:48.916 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:58:48.972 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T01:58:49.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.116+0000 7fbfe7949640 1 Processor -- start 2024-09-12T01:58:49.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.116+0000 7fbfe7949640 1 -- start start 2024-09-12T01:58:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.117+0000 7fbfe7949640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbfe015e760 0x7fbfe006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.117+0000 7fbfe7949640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbfe00cfcc0 0x7fbfe00d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.117+0000 7fbfe7949640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfe00d2700 con 0x7fbfe00d4fd0 2024-09-12T01:58:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.117+0000 7fbfe7949640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fbfe00cedb0 con 0x7fbfe00cfcc0 2024-09-12T01:58:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.117+0000 7fbfe7949640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fbfe00cf090 con 0x7fbfe015e760 2024-09-12T01:58:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.117+0000 7fbfe5ee6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbfe00cfcc0 0x7fbfe00d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.117+0000 7fbfe5ee6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbfe00cfcc0 0x7fbfe00d2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58216/0 (socket says 172.21.15.19:58216) 2024-09-12T01:58:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.117+0000 7fbfe5ee6640 1 -- 172.21.15.19:0/2331024733 learned_addr learned my addr 172.21.15.19:0/2331024733 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.117+0000 7fbfe56e5640 1 --2- 172.21.15.19:0/2331024733 >> v2:172.21.15.135:3300/0 conn(0x7fbfe015e760 0x7fbfe006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.117+0000 7fbfe5ee6640 1 -- 172.21.15.19:0/2331024733 >> v2:172.21.15.135:3300/0 conn(0x7fbfe015e760 msgr2=0x7fbfe006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.117+0000 7fbfe5ee6640 1 --2- 172.21.15.19:0/2331024733 >> v2:172.21.15.135:3300/0 conn(0x7fbfe015e760 0x7fbfe006cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.117+0000 7fbfe5ee6640 1 -- 172.21.15.19:0/2331024733 >> v1:172.21.15.135:6789/0 conn(0x7fbfe00d4fd0 legacy=0x7fbfe00cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.117+0000 7fbfe5ee6640 1 -- 172.21.15.19:0/2331024733 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe00b3c80 con 0x7fbfe00cfcc0 2024-09-12T01:58:49.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.118+0000 7fbfe5ee6640 1 --2- 172.21.15.19:0/2331024733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfe00cfcc0 0x7fbfe00d2ea0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fbfe008ca50 tx=0x7fbfd802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55303b1b4e31866e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.118+0000 7fbfd7fff640 1 -- 172.21.15.19:0/2331024733 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8036070 con 0x7fbfe00cfcc0 2024-09-12T01:58:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.118+0000 7fbfd7fff640 1 -- 172.21.15.19:0/2331024733 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd8031600 con 0x7fbfe00cfcc0 2024-09-12T01:58:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.118+0000 7fbfd7fff640 1 -- 172.21.15.19:0/2331024733 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80319d0 con 0x7fbfe00cfcc0 2024-09-12T01:58:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.118+0000 7fbfe7949640 1 -- 172.21.15.19:0/2331024733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfe00cfcc0 msgr2=0x7fbfe00d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.118+0000 7fbfe7949640 1 --2- 172.21.15.19:0/2331024733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfe00cfcc0 0x7fbfe00d2ea0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fbfe008ca50 tx=0x7fbfd802a6f0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.119+0000 7fbfe7949640 1 -- 172.21.15.19:0/2331024733 shutdown_connections 2024-09-12T01:58:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.119+0000 7fbfe7949640 1 --2- 172.21.15.19:0/2331024733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfe00cfcc0 0x7fbfe00d2ea0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.119+0000 7fbfe7949640 1 --2- 172.21.15.19:0/2331024733 >> v2:172.21.15.135:3300/0 conn(0x7fbfe015e760 0x7fbfe006cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.119+0000 7fbfe7949640 1 -- 172.21.15.19:0/2331024733 >> 172.21.15.19:0/2331024733 conn(0x7fbfe008bfc0 msgr2=0x7fbfe00d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.119+0000 7fbfe7949640 1 -- 172.21.15.19:0/2331024733 shutdown_connections 2024-09-12T01:58:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.119+0000 7fbfe7949640 1 -- 172.21.15.19:0/2331024733 wait complete. 2024-09-12T01:58:49.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.120+0000 7fbfe7949640 1 Processor -- start 2024-09-12T01:58:49.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.120+0000 7fbfe7949640 1 -- start start 2024-09-12T01:58:49.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfe7949640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfe00cfcc0 0x7fbfe00cd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:49.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfe7949640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfe00d4fd0 0x7fbfe00b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfe7949640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfe015e760 0x7fbfe00ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfe7949640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe00d33e0 con 0x7fbfe00cfcc0 2024-09-12T01:58:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfe7949640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe00b38e0 con 0x7fbfe015e760 2024-09-12T01:58:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfe7949640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe00d3560 con 0x7fbfe00d4fd0 2024-09-12T01:58:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfe56e5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfe00cfcc0 0x7fbfe00cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfe56e5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfe00cfcc0 0x7fbfe00cd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58218/0 (socket says 172.21.15.19:58218) 2024-09-12T01:58:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfe56e5640 1 -- 172.21.15.19:0/287374217 learned_addr learned my addr 172.21.15.19:0/287374217 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfe5ee6640 1 --2- 172.21.15.19:0/287374217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfe015e760 0x7fbfe00ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfe4ee4640 1 --2- 172.21.15.19:0/287374217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfe00d4fd0 0x7fbfe00b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfe56e5640 1 -- 172.21.15.19:0/287374217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfe00d4fd0 msgr2=0x7fbfe00b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfe56e5640 1 --2- 172.21.15.19:0/287374217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfe00d4fd0 0x7fbfe00b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfe56e5640 1 -- 172.21.15.19:0/287374217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfe015e760 msgr2=0x7fbfe00ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfe56e5640 1 --2- 172.21.15.19:0/287374217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfe015e760 0x7fbfe00ce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfe56e5640 1 -- 172.21.15.19:0/287374217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe00b44f0 con 0x7fbfe00cfcc0 2024-09-12T01:58:49.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfe56e5640 1 --2- 172.21.15.19:0/287374217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfe00cfcc0 0x7fbfe00cd530 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00d620 tx=0x7fbfdc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:49.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfd5ffb640 1 -- 172.21.15.19:0/287374217 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00b620 con 0x7fbfe00cfcc0 2024-09-12T01:58:49.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfd5ffb640 1 -- 172.21.15.19:0/287374217 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfdc019070 con 0x7fbfe00cfcc0 2024-09-12T01:58:49.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfe7949640 1 -- 172.21.15.19:0/287374217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe00b4790 con 0x7fbfe00cfcc0 2024-09-12T01:58:49.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.121+0000 7fbfd5ffb640 1 -- 172.21.15.19:0/287374217 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00ba00 con 0x7fbfe00cfcc0 2024-09-12T01:58:49.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.122+0000 7fbfe7949640 1 -- 172.21.15.19:0/287374217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe00b4d50 con 0x7fbfe00cfcc0 2024-09-12T01:58:49.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.123+0000 7fbfe7949640 1 -- 172.21.15.19:0/287374217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe00d3890 con 0x7fbfe00cfcc0 2024-09-12T01:58:49.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.123+0000 7fbfd5ffb640 1 -- 172.21.15.19:0/287374217 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbfdc00bba0 con 0x7fbfe00cfcc0 2024-09-12T01:58:49.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.124+0000 7fbfd5ffb640 1 --2- 172.21.15.19:0/287374217 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbfc406be30 0x7fbfc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:49.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.124+0000 7fbfd5ffb640 1 -- 172.21.15.19:0/287374217 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6217+0+0 (secure 0 0 0) 0x7fbfdc08b470 con 0x7fbfe00cfcc0 2024-09-12T01:58:49.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.124+0000 7fbfe4ee4640 1 --2- 172.21.15.19:0/287374217 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbfc406be30 0x7fbfc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:49.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.125+0000 7fbfe4ee4640 1 --2- 172.21.15.19:0/287374217 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbfc406be30 0x7fbfc406e2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00ba510 tx=0x7fbfd0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:49.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.128+0000 7fbfd5ffb640 1 -- 172.21.15.19:0/287374217 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbfdc059c20 con 0x7fbfe00cfcc0 2024-09-12T01:58:49.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.340+0000 7fbfe7949640 1 -- 172.21.15.19:0/287374217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbfe015ca80 con 0x7fbfe00cfcc0 2024-09-12T01:58:49.340 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T01:58:49.340+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:58:49.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.342+0000 7fbfd5ffb640 1 -- 172.21.15.19:0/287374217 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) ==== 161+0+0 (secure 0 0 0) 0x7fbfdc059520 con 0x7fbfe00cfcc0 2024-09-12T01:58:49.341 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:58:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.345+0000 7fbfe7949640 1 -- 172.21.15.19:0/287374217 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbfc406be30 msgr2=0x7fbfc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.345+0000 7fbfe7949640 1 --2- 172.21.15.19:0/287374217 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbfc406be30 0x7fbfc406e2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00ba510 tx=0x7fbfd0009040 comp rx=0 tx=0).stop 2024-09-12T01:58:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.345+0000 7fbfe7949640 1 -- 172.21.15.19:0/287374217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfe00cfcc0 msgr2=0x7fbfe00cd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.345+0000 7fbfe7949640 1 --2- 172.21.15.19:0/287374217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfe00cfcc0 0x7fbfe00cd530 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00d620 tx=0x7fbfdc00dae0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.345+0000 7fbfe7949640 1 -- 172.21.15.19:0/287374217 shutdown_connections 2024-09-12T01:58:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.345+0000 7fbfe7949640 1 --2- 172.21.15.19:0/287374217 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbfc406be30 0x7fbfc406e2f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.345+0000 7fbfe7949640 1 --2- 172.21.15.19:0/287374217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfe015e760 0x7fbfe00ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.345+0000 7fbfe7949640 1 --2- 172.21.15.19:0/287374217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfe00d4fd0 0x7fbfe00b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.345+0000 7fbfe7949640 1 --2- 172.21.15.19:0/287374217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfe00cfcc0 0x7fbfe00cd530 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.345+0000 7fbfe7949640 1 -- 172.21.15.19:0/287374217 >> 172.21.15.19:0/287374217 conn(0x7fbfe008bfc0 msgr2=0x7fbfe00b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:49.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.345+0000 7fbfe7949640 1 -- 172.21.15.19:0/287374217 shutdown_connections 2024-09-12T01:58:49.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.345+0000 7fbfe7949640 1 -- 172.21.15.19:0/287374217 wait complete. 2024-09-12T01:58:49.347 INFO:tasks.ceph.mds.c.smithi019.stderr: -5556> 2024-09-12T01:58:34.059+0000 7f8f82c52640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:58:49.356 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_inject_journal_corrupt_dentry_first 1.0 2024-09-12T01:58:49.379 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T01:58:49.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.463+0000 7f5f1c9b7640 1 Processor -- start 2024-09-12T01:58:49.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.463+0000 7f5f1c9b7640 1 -- start start 2024-09-12T01:58:49.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.464+0000 7f5f1c9b7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5f180cf330 0x7f5f18169070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:49.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.464+0000 7f5f1c9b7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f1806e820 con 0x7f5f180d15f0 2024-09-12T01:58:49.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.464+0000 7f5f1c9b7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f180cf980 con 0x7f5f18161a20 2024-09-12T01:58:49.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.464+0000 7f5f1c9b7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f5f180cf760 con 0x7f5f180cf330 2024-09-12T01:58:49.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.464+0000 7f5f16d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5f180cf330 0x7f5f18169070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:49.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.464+0000 7f5f15d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5f180d15f0 0x7f5f180cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56550/0 (socket says 172.21.15.19:56550) 2024-09-12T01:58:49.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.464+0000 7f5f15d9b640 1 -- 172.21.15.19:0/2046030141 learned_addr learned my addr 172.21.15.19:0/2046030141 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:49.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.464+0000 7f5f16d9d640 1 -- 172.21.15.19:0/2046030141 >> v1:172.21.15.135:6789/0 conn(0x7f5f18161a20 legacy=0x7f5f180d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:49.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.464+0000 7f5f16d9d640 1 -- 172.21.15.19:0/2046030141 >> v1:172.21.15.19:6789/0 conn(0x7f5f180d15f0 legacy=0x7f5f180cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:49.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.464+0000 7f5f16d9d640 1 -- 172.21.15.19:0/2046030141 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1806d050 con 0x7f5f180cf330 2024-09-12T01:58:49.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.464+0000 7f5f1559a640 1 -- 172.21.15.19:0/2046030141 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1969531590 0 0) 0x7f5f1806e820 con 0x7f5f180d15f0 2024-09-12T01:58:49.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.465+0000 7f5f16d9d640 1 --2- 172.21.15.19:0/2046030141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f180cf330 0x7f5f18169070 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5f10009d90 tx=0x7f5f1002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7cd8a8b8f52dcac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:49.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.465+0000 7f5f1559a640 1 -- 172.21.15.19:0/2046030141 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10007740 con 0x7f5f180cf330 2024-09-12T01:58:49.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.465+0000 7f5f1559a640 1 -- 172.21.15.19:0/2046030141 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f100078e0 con 0x7f5f180cf330 2024-09-12T01:58:49.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.465+0000 7f5f1559a640 1 -- 172.21.15.19:0/2046030141 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10007cb0 con 0x7f5f180cf330 2024-09-12T01:58:49.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.466+0000 7f5f1c9b7640 1 -- 172.21.15.19:0/2046030141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f180cf330 msgr2=0x7f5f18169070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:49.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.466+0000 7f5f1c9b7640 1 --2- 172.21.15.19:0/2046030141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f180cf330 0x7f5f18169070 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5f10009d90 tx=0x7f5f1002a6f0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.466+0000 7f5f1c9b7640 1 -- 172.21.15.19:0/2046030141 shutdown_connections 2024-09-12T01:58:49.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.466+0000 7f5f1c9b7640 1 --2- 172.21.15.19:0/2046030141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f180cf330 0x7f5f18169070 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.466+0000 7f5f1c9b7640 1 -- 172.21.15.19:0/2046030141 >> 172.21.15.19:0/2046030141 conn(0x7f5f1809d850 msgr2=0x7f5f1808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:49.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.466+0000 7f5f1c9b7640 1 -- 172.21.15.19:0/2046030141 shutdown_connections 2024-09-12T01:58:49.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.466+0000 7f5f1c9b7640 1 -- 172.21.15.19:0/2046030141 wait complete. 2024-09-12T01:58:49.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.467+0000 7f5f1c9b7640 1 Processor -- start 2024-09-12T01:58:49.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.467+0000 7f5f1c9b7640 1 -- start start 2024-09-12T01:58:49.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.468+0000 7f5f1c9b7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f180cf330 0x7f5f180ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:49.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.468+0000 7f5f1c9b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f180d15f0 0x7f5f1815f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:49.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.468+0000 7f5f1c9b7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f18161a20 0x7f5f1815bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:49.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.468+0000 7f5f1c9b7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5f180cff00 con 0x7f5f180d15f0 2024-09-12T01:58:49.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.468+0000 7f5f1c9b7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5f18161e00 con 0x7f5f180cf330 2024-09-12T01:58:49.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.468+0000 7f5f1c9b7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5f1806d2f0 con 0x7f5f18161a20 2024-09-12T01:58:49.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.468+0000 7f5f15d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f180d15f0 0x7f5f1815f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:49.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.468+0000 7f5f15d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f180d15f0 0x7f5f1815f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58236/0 (socket says 172.21.15.19:58236) 2024-09-12T01:58:49.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.468+0000 7f5f15d9b640 1 -- 172.21.15.19:0/2898746078 learned_addr learned my addr 172.21.15.19:0/2898746078 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:49.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.468+0000 7f5f1659c640 1 --2- 172.21.15.19:0/2898746078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f180cf330 0x7f5f180ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:49.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.468+0000 7f5f16d9d640 1 --2- 172.21.15.19:0/2898746078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f18161a20 0x7f5f1815bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:49.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.468+0000 7f5f15d9b640 1 -- 172.21.15.19:0/2898746078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f18161a20 msgr2=0x7f5f1815bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:49.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.469+0000 7f5f15d9b640 1 --2- 172.21.15.19:0/2898746078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f18161a20 0x7f5f1815bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.469+0000 7f5f15d9b640 1 -- 172.21.15.19:0/2898746078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f180cf330 msgr2=0x7f5f180ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:49.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.469+0000 7f5f15d9b640 1 --2- 172.21.15.19:0/2898746078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f180cf330 0x7f5f180ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.469+0000 7f5f15d9b640 1 -- 172.21.15.19:0/2898746078 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f180c9700 con 0x7f5f180d15f0 2024-09-12T01:58:49.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.469+0000 7f5f15d9b640 1 --2- 172.21.15.19:0/2898746078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f180d15f0 0x7f5f1815f280 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00c4a0 tx=0x7f5f0c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:49.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.469+0000 7f5f06ffd640 1 -- 172.21.15.19:0/2898746078 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c018070 con 0x7f5f180d15f0 2024-09-12T01:58:49.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.469+0000 7f5f06ffd640 1 -- 172.21.15.19:0/2898746078 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f0c0074e0 con 0x7f5f180d15f0 2024-09-12T01:58:49.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.469+0000 7f5f1c9b7640 1 -- 172.21.15.19:0/2898746078 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f180c99e0 con 0x7f5f180d15f0 2024-09-12T01:58:49.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.469+0000 7f5f06ffd640 1 -- 172.21.15.19:0/2898746078 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c004a20 con 0x7f5f180d15f0 2024-09-12T01:58:49.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.469+0000 7f5f1c9b7640 1 -- 172.21.15.19:0/2898746078 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f180caa00 con 0x7f5f180d15f0 2024-09-12T01:58:49.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.470+0000 7f5f1c9b7640 1 -- 172.21.15.19:0/2898746078 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f180c9bb0 con 0x7f5f180d15f0 2024-09-12T01:58:49.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.470+0000 7f5f06ffd640 1 -- 172.21.15.19:0/2898746078 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5f0c01b070 con 0x7f5f180d15f0 2024-09-12T01:58:49.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.471+0000 7f5f06ffd640 1 --2- 172.21.15.19:0/2898746078 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5ef806be30 0x7f5ef806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:49.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.471+0000 7f5f06ffd640 1 -- 172.21.15.19:0/2898746078 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7f5f0c08a3a0 con 0x7f5f180d15f0 2024-09-12T01:58:49.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.471+0000 7f5f1659c640 1 --2- 172.21.15.19:0/2898746078 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5ef806be30 0x7f5ef806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:49.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.472+0000 7f5f1659c640 1 --2- 172.21.15.19:0/2898746078 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5ef806be30 0x7f5ef806e2f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5f08000f60 tx=0x7f5f08009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:49.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.476+0000 7f5f06ffd640 1 -- 172.21.15.19:0/2898746078 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5f0c0584b0 con 0x7f5f180d15f0 2024-09-12T01:58:49.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.654+0000 7f5f1c9b7640 1 -- 172.21.15.19:0/2898746078 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_inject_journal_corrupt_dentry_first}] v 0) -- 0x7f5f180b1040 con 0x7f5f180d15f0 2024-09-12T01:58:49.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.657+0000 7f5f06ffd640 1 -- 172.21.15.19:0/2898746078 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_inject_journal_corrupt_dentry_first}]=0 v19)=0 v19) ==== 139+0+0 (secure 0 0 0) 0x7f5f0c05c7b0 con 0x7f5f180d15f0 2024-09-12T01:58:49.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.660+0000 7f5f1c9b7640 1 -- 172.21.15.19:0/2898746078 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5ef806be30 msgr2=0x7f5ef806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:49.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.660+0000 7f5f1c9b7640 1 --2- 172.21.15.19:0/2898746078 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5ef806be30 0x7f5ef806e2f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5f08000f60 tx=0x7f5f08009040 comp rx=0 tx=0).stop 2024-09-12T01:58:49.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.660+0000 7f5f1c9b7640 1 -- 172.21.15.19:0/2898746078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f180d15f0 msgr2=0x7f5f1815f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:49.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.660+0000 7f5f1c9b7640 1 --2- 172.21.15.19:0/2898746078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f180d15f0 0x7f5f1815f280 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00c4a0 tx=0x7f5f0c00c960 comp rx=0 tx=0).stop 2024-09-12T01:58:49.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.660+0000 7f5f1c9b7640 1 -- 172.21.15.19:0/2898746078 shutdown_connections 2024-09-12T01:58:49.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.660+0000 7f5f1c9b7640 1 --2- 172.21.15.19:0/2898746078 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5ef806be30 0x7f5ef806e2f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.660+0000 7f5f1c9b7640 1 --2- 172.21.15.19:0/2898746078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f18161a20 0x7f5f1815bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.660+0000 7f5f1c9b7640 1 --2- 172.21.15.19:0/2898746078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f180d15f0 0x7f5f1815f280 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.660+0000 7f5f1c9b7640 1 --2- 172.21.15.19:0/2898746078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f180cf330 0x7f5f180ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.660+0000 7f5f1c9b7640 1 -- 172.21.15.19:0/2898746078 >> 172.21.15.19:0/2898746078 conn(0x7f5f1809d850 msgr2=0x7f5f180d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:49.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.660+0000 7f5f1c9b7640 1 -- 172.21.15.19:0/2898746078 shutdown_connections 2024-09-12T01:58:49.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:49.660+0000 7f5f1c9b7640 1 -- 172.21.15.19:0/2898746078 wait complete. 2024-09-12T01:58:54.402 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:58:54.405 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:58:54.670 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T01:58:54.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.790+0000 7f95904e6640 1 Processor -- start 2024-09-12T01:58:54.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.790+0000 7f95904e6640 1 -- start start 2024-09-12T01:58:54.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.791+0000 7f95904e6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f95880b14d0 0x7f9588166fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:54.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.791+0000 7f95904e6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9588072180 con 0x7f958809b140 2024-09-12T01:58:54.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.791+0000 7f95904e6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f958815c870 con 0x7f958815c490 2024-09-12T01:58:54.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.791+0000 7f95904e6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f9588071bc0 con 0x7f95880b14d0 2024-09-12T01:58:54.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.791+0000 7f958da81640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f958809b140 0x7f95880700f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60866/0 (socket says 172.21.15.19:60866) 2024-09-12T01:58:54.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.791+0000 7f958da81640 1 -- 172.21.15.19:0/2807017875 learned_addr learned my addr 172.21.15.19:0/2807017875 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:54.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.791+0000 7f958ea83640 1 --2- 172.21.15.19:0/2807017875 >> v2:172.21.15.135:3300/0 conn(0x7f95880b14d0 0x7f9588166fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:54.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.792+0000 7f958d280640 1 -- 172.21.15.19:0/2807017875 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2059822695 0 0) 0x7f9588072180 con 0x7f958809b140 2024-09-12T01:58:54.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.792+0000 7f958d280640 1 -- 172.21.15.19:0/2807017875 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9574003520 con 0x7f958809b140 2024-09-12T01:58:54.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.792+0000 7f958d280640 1 -- 172.21.15.19:0/2807017875 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3779056936 0 0) 0x7f9574003520 con 0x7f958809b140 2024-09-12T01:58:54.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.792+0000 7f958ea83640 1 -- 172.21.15.19:0/2807017875 >> v1:172.21.15.135:6789/0 conn(0x7f958815c490 legacy=0x7f958809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:54.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.792+0000 7f958ea83640 1 -- 172.21.15.19:0/2807017875 >> v1:172.21.15.19:6789/0 conn(0x7f958809b140 legacy=0x7f95880700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:54.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.792+0000 7f958ea83640 1 -- 172.21.15.19:0/2807017875 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9588071ea0 con 0x7f95880b14d0 2024-09-12T01:58:54.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.793+0000 7f958ea83640 1 --2- 172.21.15.19:0/2807017875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95880b14d0 0x7f9588166fd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9580009d90 tx=0x7f958002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9aebf4d1067e21de server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:54.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.793+0000 7f958d280640 1 -- 172.21.15.19:0/2807017875 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9578001670 con 0x7f95880b14d0 2024-09-12T01:58:54.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.793+0000 7f958d280640 1 -- 172.21.15.19:0/2807017875 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9580007540 con 0x7f95880b14d0 2024-09-12T01:58:54.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.793+0000 7f958d280640 1 -- 172.21.15.19:0/2807017875 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580007910 con 0x7f95880b14d0 2024-09-12T01:58:54.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.793+0000 7f95904e6640 1 -- 172.21.15.19:0/2807017875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95880b14d0 msgr2=0x7f9588166fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:54.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.793+0000 7f95904e6640 1 --2- 172.21.15.19:0/2807017875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95880b14d0 0x7f9588166fd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9580009d90 tx=0x7f958002a680 comp rx=0 tx=0).stop 2024-09-12T01:58:54.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.793+0000 7f95904e6640 1 -- 172.21.15.19:0/2807017875 shutdown_connections 2024-09-12T01:58:54.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.794+0000 7f95904e6640 1 --2- 172.21.15.19:0/2807017875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95880b14d0 0x7f9588166fd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.794+0000 7f95904e6640 1 -- 172.21.15.19:0/2807017875 >> 172.21.15.19:0/2807017875 conn(0x7f95880b3f30 msgr2=0x7f95880b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:54.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.794+0000 7f95904e6640 1 -- 172.21.15.19:0/2807017875 shutdown_connections 2024-09-12T01:58:54.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.794+0000 7f95904e6640 1 -- 172.21.15.19:0/2807017875 wait complete. 2024-09-12T01:58:54.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.795+0000 7f95904e6640 1 Processor -- start 2024-09-12T01:58:54.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.795+0000 7f95904e6640 1 -- start start 2024-09-12T01:58:54.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f95904e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f958809b140 0x7f958815e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:54.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f95904e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95880b14d0 0x7f9588151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:54.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f95904e6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f958815c490 0x7f958815ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:54.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f95904e6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f958809b8f0 con 0x7f958809b140 2024-09-12T01:58:54.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f95904e6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f95880affa0 con 0x7f95880b14d0 2024-09-12T01:58:54.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f95904e6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9588071810 con 0x7f958815c490 2024-09-12T01:58:54.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f958e282640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f958809b140 0x7f958815e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f958e282640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f958809b140 0x7f958815e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36662/0 (socket says 172.21.15.19:36662) 2024-09-12T01:58:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f958e282640 1 -- 172.21.15.19:0/623928368 learned_addr learned my addr 172.21.15.19:0/623928368 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f958da81640 1 --2- 172.21.15.19:0/623928368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95880b14d0 0x7f9588151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f958ea83640 1 --2- 172.21.15.19:0/623928368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f958815c490 0x7f958815ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f958e282640 1 -- 172.21.15.19:0/623928368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f958815c490 msgr2=0x7f958815ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f958e282640 1 --2- 172.21.15.19:0/623928368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f958815c490 0x7f958815ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f958e282640 1 -- 172.21.15.19:0/623928368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95880b14d0 msgr2=0x7f9588151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f958e282640 1 --2- 172.21.15.19:0/623928368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95880b14d0 0x7f9588151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f958e282640 1 -- 172.21.15.19:0/623928368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958815d2a0 con 0x7f958809b140 2024-09-12T01:58:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f958da81640 1 --2- 172.21.15.19:0/623928368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95880b14d0 0x7f9588151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f958e282640 1 --2- 172.21.15.19:0/623928368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f958809b140 0x7f958815e680 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f958400c450 tx=0x7f958400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f957effd640 1 -- 172.21.15.19:0/623928368 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95840052d0 con 0x7f958809b140 2024-09-12T01:58:54.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f957effd640 1 -- 172.21.15.19:0/623928368 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9584005470 con 0x7f958809b140 2024-09-12T01:58:54.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f95904e6640 1 -- 172.21.15.19:0/623928368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958815d580 con 0x7f958809b140 2024-09-12T01:58:54.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.796+0000 7f957effd640 1 -- 172.21.15.19:0/623928368 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584012870 con 0x7f958809b140 2024-09-12T01:58:54.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.797+0000 7f95904e6640 1 -- 172.21.15.19:0/623928368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f958815db40 con 0x7f958809b140 2024-09-12T01:58:54.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.797+0000 7f95904e6640 1 -- 172.21.15.19:0/623928368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f958809aa30 con 0x7f958809b140 2024-09-12T01:58:54.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.798+0000 7f957effd640 1 -- 172.21.15.19:0/623928368 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9584012a10 con 0x7f958809b140 2024-09-12T01:58:54.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.798+0000 7f957effd640 1 --2- 172.21.15.19:0/623928368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f956c06be60 0x7f956c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:54.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.799+0000 7f957effd640 1 -- 172.21.15.19:0/623928368 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7f958408ac80 con 0x7f958809b140 2024-09-12T01:58:54.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.799+0000 7f958da81640 1 --2- 172.21.15.19:0/623928368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f956c06be60 0x7f956c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:54.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.799+0000 7f958da81640 1 --2- 172.21.15.19:0/623928368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f956c06be60 0x7f956c06e320 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9578005880 tx=0x7f9578009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:54.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:54.803+0000 7f957effd640 1 -- 172.21.15.19:0/623928368 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95840593d0 con 0x7f958809b140 2024-09-12T01:58:55.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.015+0000 7f95904e6640 1 -- 172.21.15.19:0/623928368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f95880b5880 con 0x7f958809b140 2024-09-12T01:58:55.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.351+0000 7f957effd640 1 -- 172.21.15.19:0/623928368 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v44) ==== 162+0+0 (secure 0 0 0) 0x7f9584058cd0 con 0x7f958809b140 2024-09-12T01:58:55.351 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T01:58:55.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.354+0000 7f95904e6640 1 -- 172.21.15.19:0/623928368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f956c06be60 msgr2=0x7f956c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:55.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.354+0000 7f95904e6640 1 --2- 172.21.15.19:0/623928368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f956c06be60 0x7f956c06e320 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9578005880 tx=0x7f9578009040 comp rx=0 tx=0).stop 2024-09-12T01:58:55.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.354+0000 7f95904e6640 1 -- 172.21.15.19:0/623928368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f958809b140 msgr2=0x7f958815e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:55.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.354+0000 7f95904e6640 1 --2- 172.21.15.19:0/623928368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f958809b140 0x7f958815e680 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f958400c450 tx=0x7f958400c910 comp rx=0 tx=0).stop 2024-09-12T01:58:55.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.354+0000 7f95904e6640 1 -- 172.21.15.19:0/623928368 shutdown_connections 2024-09-12T01:58:55.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.354+0000 7f95904e6640 1 --2- 172.21.15.19:0/623928368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f956c06be60 0x7f956c06e320 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:55.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.354+0000 7f95904e6640 1 --2- 172.21.15.19:0/623928368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f958815c490 0x7f958815ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:55.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.354+0000 7f95904e6640 1 --2- 172.21.15.19:0/623928368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95880b14d0 0x7f9588151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:55.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.354+0000 7f95904e6640 1 --2- 172.21.15.19:0/623928368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f958809b140 0x7f958815e680 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:55.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.354+0000 7f95904e6640 1 -- 172.21.15.19:0/623928368 >> 172.21.15.19:0/623928368 conn(0x7f95880b3f30 msgr2=0x7f95880b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:55.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.354+0000 7f95904e6640 1 -- 172.21.15.19:0/623928368 shutdown_connections 2024-09-12T01:58:55.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.354+0000 7f95904e6640 1 -- 172.21.15.19:0/623928368 wait complete. 2024-09-12T01:58:55.367 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:58:55.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.470+0000 7f453541e640 1 Processor -- start 2024-09-12T01:58:55.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.470+0000 7f453541e640 1 -- start start 2024-09-12T01:58:55.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.471+0000 7f453541e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f453015e5f0 0x7f45300d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:55.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.471+0000 7f453541e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f45300b6690 0x7f453006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:55.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.471+0000 7f453541e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45300d3690 con 0x7f45300d30f0 2024-09-12T01:58:55.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.471+0000 7f453541e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f453006d530 con 0x7f45300b6690 2024-09-12T01:58:55.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.471+0000 7f453541e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f45300d3970 con 0x7f453015e5f0 2024-09-12T01:58:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.471+0000 7f452e7fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f45300d30f0 0x7f45300b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60878/0 (socket says 172.21.15.19:60878) 2024-09-12T01:58:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.471+0000 7f452e7fc640 1 -- 172.21.15.19:0/3996520743 learned_addr learned my addr 172.21.15.19:0/3996520743 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.471+0000 7f452effd640 1 --2- 172.21.15.19:0/3996520743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f453015e5f0 0x7f45300d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.471+0000 7f452f7fe640 1 --2- 172.21.15.19:0/3996520743 >> v2:172.21.15.135:3300/0 conn(0x7f45300b6690 0x7f453006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.471+0000 7f452dffb640 1 -- 172.21.15.19:0/3996520743 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1782595406 0 0) 0x7f45300d3690 con 0x7f45300d30f0 2024-09-12T01:58:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.471+0000 7f452dffb640 1 -- 172.21.15.19:0/3996520743 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4518003520 con 0x7f45300d30f0 2024-09-12T01:58:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452dffb640 1 -- 172.21.15.19:0/3996520743 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 972348209 0 0) 0x7f4518003520 con 0x7f45300d30f0 2024-09-12T01:58:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452dffb640 1 -- 172.21.15.19:0/3996520743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f453015e5f0 msgr2=0x7f45300d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452dffb640 1 --2- 172.21.15.19:0/3996520743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f453015e5f0 0x7f45300d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452dffb640 1 -- 172.21.15.19:0/3996520743 >> v2:172.21.15.135:3300/0 conn(0x7f45300b6690 msgr2=0x7f453006d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452dffb640 1 --2- 172.21.15.19:0/3996520743 >> v2:172.21.15.135:3300/0 conn(0x7f45300b6690 0x7f453006d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452dffb640 1 -- 172.21.15.19:0/3996520743 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453006cee0 con 0x7f45300d30f0 2024-09-12T01:58:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452dffb640 1 -- 172.21.15.19:0/3996520743 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f4524001670 con 0x7f45300d30f0 2024-09-12T01:58:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452dffb640 1 -- 172.21.15.19:0/3996520743 >> v1:172.21.15.19:6789/0 conn(0x7f45300d30f0 legacy=0x7f45300b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452dffb640 1 --2- 172.21.15.19:0/3996520743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45180039b0 0x7f4518003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:55.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452dffb640 1 --2- 172.21.15.19:0/3996520743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f453015e5f0 0x7f4518004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:55.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452dffb640 1 --2- 172.21.15.19:0/3996520743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4518004d40 0x7f45180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:55.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452dffb640 1 -- 172.21.15.19:0/3996520743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f453006d530 con 0x7f4518004d40 2024-09-12T01:58:55.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452dffb640 1 -- 172.21.15.19:0/3996520743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f45300d3970 con 0x7f45180039b0 2024-09-12T01:58:55.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452dffb640 1 -- 172.21.15.19:0/3996520743 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f451800b9c0 con 0x7f453015e5f0 2024-09-12T01:58:55.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452f7fe640 1 --2- 172.21.15.19:0/3996520743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4518004d40 0x7f45180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:55.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452effd640 1 --2- 172.21.15.19:0/3996520743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45180039b0 0x7f4518003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:55.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452e7fc640 1 --2- 172.21.15.19:0/3996520743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f453015e5f0 0x7f4518004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:55.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452f7fe640 1 -- 172.21.15.19:0/3996520743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f453015e5f0 msgr2=0x7f4518004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452f7fe640 1 --2- 172.21.15.19:0/3996520743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f453015e5f0 0x7f4518004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452f7fe640 1 -- 172.21.15.19:0/3996520743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45180039b0 msgr2=0x7f4518003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452f7fe640 1 --2- 172.21.15.19:0/3996520743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45180039b0 0x7f4518003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.472+0000 7f452f7fe640 1 -- 172.21.15.19:0/3996520743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4518003520 con 0x7f4518004d40 2024-09-12T01:58:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.473+0000 7f452f7fe640 1 --2- 172.21.15.19:0/3996520743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4518004d40 0x7f45180051c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4528009fc0 tx=0x7f4518005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4bb5c12be6562d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.473+0000 7f452dffb640 1 -- 172.21.15.19:0/3996520743 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528009c10 con 0x7f4518004d40 2024-09-12T01:58:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.473+0000 7f452dffb640 1 -- 172.21.15.19:0/3996520743 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4528036070 con 0x7f4518004d40 2024-09-12T01:58:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.473+0000 7f452dffb640 1 -- 172.21.15.19:0/3996520743 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452802d070 con 0x7f4518004d40 2024-09-12T01:58:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.474+0000 7f453541e640 1 -- 172.21.15.19:0/3996520743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4518004d40 msgr2=0x7f45180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:55.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.474+0000 7f453541e640 1 --2- 172.21.15.19:0/3996520743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4518004d40 0x7f45180051c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4528009fc0 tx=0x7f4518005830 comp rx=0 tx=0).stop 2024-09-12T01:58:55.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.474+0000 7f452f7fe640 1 -- 172.21.15.19:0/3996520743 reap_dead start 2024-09-12T01:58:55.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.474+0000 7f453541e640 1 -- 172.21.15.19:0/3996520743 shutdown_connections 2024-09-12T01:58:55.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.474+0000 7f453541e640 1 -- 172.21.15.19:0/3996520743 >> 172.21.15.19:0/3996520743 conn(0x7f453008bfc0 msgr2=0x7f45300d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:55.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.474+0000 7f453541e640 1 -- 172.21.15.19:0/3996520743 shutdown_connections 2024-09-12T01:58:55.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.474+0000 7f453541e640 1 -- 172.21.15.19:0/3996520743 wait complete. 2024-09-12T01:58:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.475+0000 7f453541e640 1 Processor -- start 2024-09-12T01:58:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.475+0000 7f453541e640 1 -- start start 2024-09-12T01:58:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.476+0000 7f453541e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4518004d40 0x7f4530153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.476+0000 7f453541e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45300b7350 0x7f45301f37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.476+0000 7f453541e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4530161010 0x7f4530161490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.476+0000 7f453541e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f45300d4dd0 con 0x7f4530161010 2024-09-12T01:58:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.476+0000 7f453541e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f453015e9d0 con 0x7f4518004d40 2024-09-12T01:58:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.476+0000 7f453541e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f45300d4f50 con 0x7f45300b7350 2024-09-12T01:58:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.476+0000 7f452f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4530161010 0x7f4530161490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.476+0000 7f452f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4530161010 0x7f4530161490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36688/0 (socket says 172.21.15.19:36688) 2024-09-12T01:58:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.476+0000 7f452f7fe640 1 -- 172.21.15.19:0/3497834270 learned_addr learned my addr 172.21.15.19:0/3497834270 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.476+0000 7f452e7fc640 1 --2- 172.21.15.19:0/3497834270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45300b7350 0x7f45301f37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.476+0000 7f452effd640 1 --2- 172.21.15.19:0/3497834270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4518004d40 0x7f4530153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.476+0000 7f452f7fe640 1 -- 172.21.15.19:0/3497834270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45300b7350 msgr2=0x7f45301f37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.476+0000 7f452f7fe640 1 --2- 172.21.15.19:0/3497834270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45300b7350 0x7f45301f37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.476+0000 7f452f7fe640 1 -- 172.21.15.19:0/3497834270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4518004d40 msgr2=0x7f4530153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.476+0000 7f452f7fe640 1 --2- 172.21.15.19:0/3497834270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4518004d40 0x7f4530153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.476+0000 7f452f7fe640 1 -- 172.21.15.19:0/3497834270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45301f3cf0 con 0x7f4530161010 2024-09-12T01:58:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.476+0000 7f452f7fe640 1 --2- 172.21.15.19:0/3497834270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4530161010 0x7f4530161490 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f452802af10 tx=0x7f4528009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.477+0000 7f45177fe640 1 -- 172.21.15.19:0/3497834270 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528009c10 con 0x7f4530161010 2024-09-12T01:58:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.477+0000 7f45177fe640 1 -- 172.21.15.19:0/3497834270 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4528040030 con 0x7f4530161010 2024-09-12T01:58:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.477+0000 7f45177fe640 1 -- 172.21.15.19:0/3497834270 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528003dd0 con 0x7f4530161010 2024-09-12T01:58:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.477+0000 7f453541e640 1 -- 172.21.15.19:0/3497834270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45300b8960 con 0x7f4530161010 2024-09-12T01:58:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.477+0000 7f453541e640 1 -- 172.21.15.19:0/3497834270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45300b7ba0 con 0x7f4530161010 2024-09-12T01:58:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.478+0000 7f453541e640 1 -- 172.21.15.19:0/3497834270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45300d5360 con 0x7f4530161010 2024-09-12T01:58:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.478+0000 7f45177fe640 1 -- 172.21.15.19:0/3497834270 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4528005d10 con 0x7f4530161010 2024-09-12T01:58:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.479+0000 7f45177fe640 1 --2- 172.21.15.19:0/3497834270 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f451c06be30 0x7f451c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.479+0000 7f45177fe640 1 -- 172.21.15.19:0/3497834270 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7f45280ac460 con 0x7f4530161010 2024-09-12T01:58:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.479+0000 7f452effd640 1 --2- 172.21.15.19:0/3497834270 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f451c06be30 0x7f451c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.480+0000 7f452effd640 1 --2- 172.21.15.19:0/3497834270 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f451c06be30 0x7f451c06e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4520009b40 tx=0x7f4520009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:55.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.483+0000 7f45177fe640 1 -- 172.21.15.19:0/3497834270 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f452804a020 con 0x7f4530161010 2024-09-12T01:58:55.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.693+0000 7f453541e640 1 -- 172.21.15.19:0/3497834270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45300d2d80 con 0x7f4530161010 2024-09-12T01:58:55.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.693+0000 7f45177fe640 1 -- 172.21.15.19:0/3497834270 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5218 (secure 0 0 0) 0x7f452807aba0 con 0x7f4530161010 2024-09-12T01:58:55.693 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:55.693 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":45,"btime":"2024-09-12T01:58:55:354147+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2176310149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2176310149},{"type":"v1","addr":"172.21.15.135:6836","nonce":2176310149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/222313950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":222313950},{"type":"v1","addr":"172.21.15.135:6837","nonce":222313950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/2113904472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2113904472},{"type":"v1","addr":"172.21.15.19:6834","nonce":2113904472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:58:31.431304+0000","modified":"2024-09-12T01:58:55.354136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6120":{"gid":6120,"name":"c","rank":0,"incarnation":45,"state":"up:replay","state_seq":1,"addr":"172.21.15.19:6835/740310996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":740310996},{"type":"v1","addr":"172.21.15.19:6835","nonce":740310996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-12T01:58:55.693 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 45 2024-09-12T01:58:55.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.695+0000 7f453541e640 1 -- 172.21.15.19:0/3497834270 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f451c06be30 msgr2=0x7f451c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:55.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.695+0000 7f453541e640 1 --2- 172.21.15.19:0/3497834270 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f451c06be30 0x7f451c06e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4520009b40 tx=0x7f4520009190 comp rx=0 tx=0).stop 2024-09-12T01:58:55.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.695+0000 7f453541e640 1 -- 172.21.15.19:0/3497834270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4530161010 msgr2=0x7f4530161490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:55.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.695+0000 7f453541e640 1 --2- 172.21.15.19:0/3497834270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4530161010 0x7f4530161490 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f452802af10 tx=0x7f4528009750 comp rx=0 tx=0).stop 2024-09-12T01:58:55.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.696+0000 7f453541e640 1 -- 172.21.15.19:0/3497834270 shutdown_connections 2024-09-12T01:58:55.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.696+0000 7f453541e640 1 --2- 172.21.15.19:0/3497834270 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f451c06be30 0x7f451c06e2f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:55.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.696+0000 7f453541e640 1 --2- 172.21.15.19:0/3497834270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4530161010 0x7f4530161490 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:55.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.696+0000 7f453541e640 1 --2- 172.21.15.19:0/3497834270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45300b7350 0x7f45301f37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:55.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.696+0000 7f453541e640 1 --2- 172.21.15.19:0/3497834270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4518004d40 0x7f4530153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:55.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.696+0000 7f453541e640 1 -- 172.21.15.19:0/3497834270 >> 172.21.15.19:0/3497834270 conn(0x7f453008bfc0 msgr2=0x7f45300b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:55.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.696+0000 7f453541e640 1 -- 172.21.15.19:0/3497834270 shutdown_connections 2024-09-12T01:58:55.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:55.696+0000 7f453541e640 1 -- 172.21.15.19:0/3497834270 wait complete. 2024-09-12T01:58:56.109 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:58:31.431304+0000', 'modified': '2024-09-12T01:58:55.354136+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 69, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6120}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6120': {'gid': 6120, 'name': 'c', 'rank': 0, 'incarnation': 45, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.19:6835/740310996', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6833', 'nonce': 740310996}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 740310996}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T01:58:56.109 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6120:up:replay 2024-09-12T01:58:57.110 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:58:57.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.226+0000 7fca8394b640 1 Processor -- start 2024-09-12T01:58:57.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.226+0000 7fca8394b640 1 -- start start 2024-09-12T01:58:57.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.227+0000 7fca8394b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fca7c15e5f0 0x7fca7c0d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:57.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.227+0000 7fca8394b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca7c0b6690 0x7fca7c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:57.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.227+0000 7fca8394b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca7c0d3690 con 0x7fca7c0d30f0 2024-09-12T01:58:57.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.227+0000 7fca8394b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fca7c06d530 con 0x7fca7c15e5f0 2024-09-12T01:58:57.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.227+0000 7fca8394b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fca7c0d3970 con 0x7fca7c0b6690 2024-09-12T01:58:57.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.227+0000 7fca816e7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fca7c15e5f0 0x7fca7c0d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:57.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.227+0000 7fca816e7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fca7c15e5f0 0x7fca7c0d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36702/0 (socket says 172.21.15.19:36702) 2024-09-12T01:58:57.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.227+0000 7fca816e7640 1 -- 172.21.15.19:0/1602639560 learned_addr learned my addr 172.21.15.19:0/1602639560 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:57.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.227+0000 7fca81ee8640 1 --2- 172.21.15.19:0/1602639560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca7c0b6690 0x7fca7c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:57.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.227+0000 7fca816e7640 1 -- 172.21.15.19:0/1602639560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca7c0b6690 msgr2=0x7fca7c06d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:57.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.227+0000 7fca816e7640 1 --2- 172.21.15.19:0/1602639560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca7c0b6690 0x7fca7c06d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:57.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.227+0000 7fca816e7640 1 -- 172.21.15.19:0/1602639560 >> v1:172.21.15.135:6789/0 conn(0x7fca7c0d30f0 legacy=0x7fca7c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:57.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.228+0000 7fca816e7640 1 -- 172.21.15.19:0/1602639560 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7c06cee0 con 0x7fca7c15e5f0 2024-09-12T01:58:57.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.228+0000 7fca816e7640 1 --2- 172.21.15.19:0/1602639560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca7c15e5f0 0x7fca7c0d4dd0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fca78009870 tx=0x7fca7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8693cc9a889babe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:57.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.228+0000 7fca73fff640 1 -- 172.21.15.19:0/1602639560 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78037070 con 0x7fca7c15e5f0 2024-09-12T01:58:57.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.229+0000 7fca73fff640 1 -- 172.21.15.19:0/1602639560 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca78032440 con 0x7fca7c15e5f0 2024-09-12T01:58:57.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.229+0000 7fca73fff640 1 -- 172.21.15.19:0/1602639560 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78032810 con 0x7fca7c15e5f0 2024-09-12T01:58:57.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.229+0000 7fca8394b640 1 -- 172.21.15.19:0/1602639560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca7c15e5f0 msgr2=0x7fca7c0d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:57.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.229+0000 7fca8394b640 1 --2- 172.21.15.19:0/1602639560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca7c15e5f0 0x7fca7c0d4dd0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fca78009870 tx=0x7fca7802a270 comp rx=0 tx=0).stop 2024-09-12T01:58:57.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.229+0000 7fca8394b640 1 -- 172.21.15.19:0/1602639560 shutdown_connections 2024-09-12T01:58:57.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.229+0000 7fca8394b640 1 --2- 172.21.15.19:0/1602639560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca7c0b6690 0x7fca7c06d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:57.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.229+0000 7fca8394b640 1 --2- 172.21.15.19:0/1602639560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca7c15e5f0 0x7fca7c0d4dd0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:57.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.229+0000 7fca8394b640 1 -- 172.21.15.19:0/1602639560 >> 172.21.15.19:0/1602639560 conn(0x7fca7c08bfc0 msgr2=0x7fca7c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:57.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.229+0000 7fca8394b640 1 -- 172.21.15.19:0/1602639560 shutdown_connections 2024-09-12T01:58:57.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.229+0000 7fca8394b640 1 -- 172.21.15.19:0/1602639560 wait complete. 2024-09-12T01:58:57.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.230+0000 7fca8394b640 1 Processor -- start 2024-09-12T01:58:57.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.230+0000 7fca8394b640 1 -- start start 2024-09-12T01:58:57.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.231+0000 7fca8394b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca7c0b6690 0x7fca7c0cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:57.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.231+0000 7fca8394b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca7c0d30f0 0x7fca7c158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:57.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.231+0000 7fca8394b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca7c15e5f0 0x7fca7c0c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:57.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.231+0000 7fca8394b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c0d5310 con 0x7fca7c15e5f0 2024-09-12T01:58:57.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.231+0000 7fca8394b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c15e9d0 con 0x7fca7c0d30f0 2024-09-12T01:58:57.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.231+0000 7fca8394b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fca7c06df00 con 0x7fca7c0b6690 2024-09-12T01:58:57.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.231+0000 7fca81ee8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca7c15e5f0 0x7fca7c0c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:57.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.231+0000 7fca81ee8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca7c15e5f0 0x7fca7c0c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36714/0 (socket says 172.21.15.19:36714) 2024-09-12T01:58:57.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.231+0000 7fca81ee8640 1 -- 172.21.15.19:0/3784352500 learned_addr learned my addr 172.21.15.19:0/3784352500 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:57.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.231+0000 7fca816e7640 1 --2- 172.21.15.19:0/3784352500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca7c0b6690 0x7fca7c0cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:57.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.231+0000 7fca80ee6640 1 --2- 172.21.15.19:0/3784352500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca7c0d30f0 0x7fca7c158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:57.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.232+0000 7fca81ee8640 1 -- 172.21.15.19:0/3784352500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca7c0b6690 msgr2=0x7fca7c0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:57.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.232+0000 7fca81ee8640 1 --2- 172.21.15.19:0/3784352500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca7c0b6690 0x7fca7c0cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:57.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.232+0000 7fca81ee8640 1 -- 172.21.15.19:0/3784352500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca7c0d30f0 msgr2=0x7fca7c158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:57.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.232+0000 7fca81ee8640 1 --2- 172.21.15.19:0/3784352500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca7c0d30f0 0x7fca7c158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:57.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.232+0000 7fca81ee8640 1 -- 172.21.15.19:0/3784352500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7c0b7e00 con 0x7fca7c15e5f0 2024-09-12T01:58:57.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.232+0000 7fca81ee8640 1 --2- 172.21.15.19:0/3784352500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca7c15e5f0 0x7fca7c0c8c50 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fca74007e70 tx=0x7fca7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:57.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.232+0000 7fca71ffb640 1 -- 172.21.15.19:0/3784352500 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca74014620 con 0x7fca7c15e5f0 2024-09-12T01:58:57.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.232+0000 7fca71ffb640 1 -- 172.21.15.19:0/3784352500 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca74019070 con 0x7fca7c15e5f0 2024-09-12T01:58:57.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.232+0000 7fca8394b640 1 -- 172.21.15.19:0/3784352500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca7c0b80e0 con 0x7fca7c15e5f0 2024-09-12T01:58:57.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.232+0000 7fca71ffb640 1 -- 172.21.15.19:0/3784352500 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca74014a20 con 0x7fca7c15e5f0 2024-09-12T01:58:57.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.232+0000 7fca8394b640 1 -- 172.21.15.19:0/3784352500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca7c0b86a0 con 0x7fca7c15e5f0 2024-09-12T01:58:57.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.233+0000 7fca8394b640 1 -- 172.21.15.19:0/3784352500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca7c06d9a0 con 0x7fca7c15e5f0 2024-09-12T01:58:57.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.234+0000 7fca71ffb640 1 -- 172.21.15.19:0/3784352500 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca74014bc0 con 0x7fca7c15e5f0 2024-09-12T01:58:57.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.234+0000 7fca71ffb640 1 --2- 172.21.15.19:0/3784352500 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca6006be30 0x7fca6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:57.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.234+0000 7fca71ffb640 1 -- 172.21.15.19:0/3784352500 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7fca7408b860 con 0x7fca7c15e5f0 2024-09-12T01:58:57.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.234+0000 7fca816e7640 1 --2- 172.21.15.19:0/3784352500 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca6006be30 0x7fca6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:57.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.235+0000 7fca816e7640 1 --2- 172.21.15.19:0/3784352500 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca6006be30 0x7fca6006e2f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fca78034000 tx=0x7fca7802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:57.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.239+0000 7fca71ffb640 1 -- 172.21.15.19:0/3784352500 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca74059970 con 0x7fca7c15e5f0 2024-09-12T01:58:57.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.453+0000 7fca8394b640 1 -- 172.21.15.19:0/3784352500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca7c0c97f0 con 0x7fca7c15e5f0 2024-09-12T01:58:57.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.453+0000 7fca71ffb640 1 -- 172.21.15.19:0/3784352500 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5218 (secure 0 0 0) 0x7fca7405dc70 con 0x7fca7c15e5f0 2024-09-12T01:58:57.453 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:57.453 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":47,"btime":"2024-09-12T01:58:57:361381+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2176310149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2176310149},{"type":"v1","addr":"172.21.15.135:6836","nonce":2176310149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/222313950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":222313950},{"type":"v1","addr":"172.21.15.135:6837","nonce":222313950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/2113904472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2113904472},{"type":"v1","addr":"172.21.15.19:6834","nonce":2113904472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:58:31.431304+0000","modified":"2024-09-12T01:58:56.363168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6120":{"gid":6120,"name":"c","rank":0,"incarnation":45,"state":"up:rejoin","state_seq":4,"addr":"172.21.15.19:6835/740310996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":740310996},{"type":"v1","addr":"172.21.15.19:6835","nonce":740310996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-12T01:58:57.453 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 47 2024-09-12T01:58:57.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.456+0000 7fca8394b640 1 -- 172.21.15.19:0/3784352500 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca6006be30 msgr2=0x7fca6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:57.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.456+0000 7fca8394b640 1 --2- 172.21.15.19:0/3784352500 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca6006be30 0x7fca6006e2f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fca78034000 tx=0x7fca7802e000 comp rx=0 tx=0).stop 2024-09-12T01:58:57.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.456+0000 7fca8394b640 1 -- 172.21.15.19:0/3784352500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca7c15e5f0 msgr2=0x7fca7c0c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:57.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.456+0000 7fca8394b640 1 --2- 172.21.15.19:0/3784352500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca7c15e5f0 0x7fca7c0c8c50 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fca74007e70 tx=0x7fca7400e4b0 comp rx=0 tx=0).stop 2024-09-12T01:58:57.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.456+0000 7fca8394b640 1 -- 172.21.15.19:0/3784352500 shutdown_connections 2024-09-12T01:58:57.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.456+0000 7fca8394b640 1 --2- 172.21.15.19:0/3784352500 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca6006be30 0x7fca6006e2f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:57.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.456+0000 7fca8394b640 1 --2- 172.21.15.19:0/3784352500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca7c15e5f0 0x7fca7c0c8c50 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:57.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.456+0000 7fca8394b640 1 --2- 172.21.15.19:0/3784352500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca7c0d30f0 0x7fca7c158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:57.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.456+0000 7fca8394b640 1 --2- 172.21.15.19:0/3784352500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca7c0b6690 0x7fca7c0cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:57.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.456+0000 7fca8394b640 1 -- 172.21.15.19:0/3784352500 >> 172.21.15.19:0/3784352500 conn(0x7fca7c08bfc0 msgr2=0x7fca7c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:57.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.456+0000 7fca8394b640 1 -- 172.21.15.19:0/3784352500 shutdown_connections 2024-09-12T01:58:57.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:57.456+0000 7fca8394b640 1 -- 172.21.15.19:0/3784352500 wait complete. 2024-09-12T01:58:57.870 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:58:31.431304+0000', 'modified': '2024-09-12T01:58:56.363168+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 69, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6120}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6120': {'gid': 6120, 'name': 'c', 'rank': 0, 'incarnation': 45, 'state': 'up:rejoin', 'state_seq': 4, 'addr': '172.21.15.19:6835/740310996', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6833', 'nonce': 740310996}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 740310996}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T01:58:57.870 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6120:up:rejoin 2024-09-12T01:58:58.871 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:58:58.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.987+0000 7f64932ac640 1 Processor -- start 2024-09-12T01:58:58.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.987+0000 7f64932ac640 1 -- start start 2024-09-12T01:58:58.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.988+0000 7f64932ac640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f648c15ba30 0x7f648c06f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:58.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.988+0000 7f64932ac640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f648c06fd50 0x7f648c072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:58.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.988+0000 7f64932ac640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f648c072e80 0x7f648c06e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:58.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.988+0000 7f64932ac640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f648c0b4180 con 0x7f648c06fd50 2024-09-12T01:58:58.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.988+0000 7f64932ac640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f648c0b3570 con 0x7f648c072e80 2024-09-12T01:58:58.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.988+0000 7f64932ac640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f648c0b3850 con 0x7f648c15ba30 2024-09-12T01:58:58.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.988+0000 7f6490847640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f648c06fd50 0x7f648c072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:58.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.988+0000 7f6490847640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f648c06fd50 0x7f648c072940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36716/0 (socket says 172.21.15.19:36716) 2024-09-12T01:58:58.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.988+0000 7f6490847640 1 -- 172.21.15.19:0/2439914292 learned_addr learned my addr 172.21.15.19:0/2439914292 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:58.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.988+0000 7f6491048640 1 --2- 172.21.15.19:0/2439914292 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f648c15ba30 0x7f648c06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:58.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.988+0000 7f6491849640 1 --2- 172.21.15.19:0/2439914292 >> v2:172.21.15.135:3300/0 conn(0x7f648c072e80 0x7f648c06e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:58.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.989+0000 7f6490847640 1 -- 172.21.15.19:0/2439914292 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f648c15ba30 msgr2=0x7f648c06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:58.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.989+0000 7f6490847640 1 --2- 172.21.15.19:0/2439914292 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f648c15ba30 0x7f648c06f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:58.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.989+0000 7f6490847640 1 -- 172.21.15.19:0/2439914292 >> v2:172.21.15.135:3300/0 conn(0x7f648c072e80 msgr2=0x7f648c06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:58.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.989+0000 7f6490847640 1 --2- 172.21.15.19:0/2439914292 >> v2:172.21.15.135:3300/0 conn(0x7f648c072e80 0x7f648c06e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:58.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.989+0000 7f6490847640 1 -- 172.21.15.19:0/2439914292 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c0b3b30 con 0x7f648c06fd50 2024-09-12T01:58:58.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.989+0000 7f6491849640 1 --2- 172.21.15.19:0/2439914292 >> v2:172.21.15.135:3300/0 conn(0x7f648c072e80 0x7f648c06e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:58.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.989+0000 7f6490847640 1 --2- 172.21.15.19:0/2439914292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f648c06fd50 0x7f648c072940 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f648c0b4610 tx=0x7f648002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb7b72cafd9143f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:58.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.990+0000 7f648bfff640 1 -- 172.21.15.19:0/2439914292 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480037070 con 0x7f648c06fd50 2024-09-12T01:58:58.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.990+0000 7f648bfff640 1 -- 172.21.15.19:0/2439914292 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6480032440 con 0x7f648c06fd50 2024-09-12T01:58:58.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.990+0000 7f648bfff640 1 -- 172.21.15.19:0/2439914292 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480032810 con 0x7f648c06fd50 2024-09-12T01:58:58.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.990+0000 7f64932ac640 1 -- 172.21.15.19:0/2439914292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f648c06fd50 msgr2=0x7f648c072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:58.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.990+0000 7f64932ac640 1 --2- 172.21.15.19:0/2439914292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f648c06fd50 0x7f648c072940 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f648c0b4610 tx=0x7f648002a1e0 comp rx=0 tx=0).stop 2024-09-12T01:58:58.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.990+0000 7f64932ac640 1 -- 172.21.15.19:0/2439914292 shutdown_connections 2024-09-12T01:58:58.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.990+0000 7f64932ac640 1 --2- 172.21.15.19:0/2439914292 >> v2:172.21.15.135:3300/0 conn(0x7f648c072e80 0x7f648c06e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:58.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.990+0000 7f64932ac640 1 --2- 172.21.15.19:0/2439914292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f648c06fd50 0x7f648c072940 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:58.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.990+0000 7f64932ac640 1 --2- 172.21.15.19:0/2439914292 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f648c15ba30 0x7f648c06f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:58.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.990+0000 7f64932ac640 1 -- 172.21.15.19:0/2439914292 >> 172.21.15.19:0/2439914292 conn(0x7f648c067d70 msgr2=0x7f648c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:58.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.990+0000 7f64932ac640 1 -- 172.21.15.19:0/2439914292 shutdown_connections 2024-09-12T01:58:58.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.990+0000 7f64932ac640 1 -- 172.21.15.19:0/2439914292 wait complete. 2024-09-12T01:58:58.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.992+0000 7f64932ac640 1 Processor -- start 2024-09-12T01:58:58.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.992+0000 7f64932ac640 1 -- start start 2024-09-12T01:58:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.992+0000 7f64932ac640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f648c06fd50 0x7f648c144c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.992+0000 7f64932ac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f648c072e80 0x7f648c146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.992+0000 7f64932ac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f648c15ba30 0x7f648c14f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.992+0000 7f64932ac640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f648c0ce810 con 0x7f648c15ba30 2024-09-12T01:58:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.992+0000 7f64932ac640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f648c0b5990 con 0x7f648c072e80 2024-09-12T01:58:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.992+0000 7f64932ac640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f648c0ccfe0 con 0x7f648c06fd50 2024-09-12T01:58:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.993+0000 7f6491849640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f648c15ba30 0x7f648c14f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.993+0000 7f6491849640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f648c15ba30 0x7f648c14f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36722/0 (socket says 172.21.15.19:36722) 2024-09-12T01:58:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.993+0000 7f6491849640 1 -- 172.21.15.19:0/860811416 learned_addr learned my addr 172.21.15.19:0/860811416 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.993+0000 7f6490847640 1 --2- 172.21.15.19:0/860811416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f648c072e80 0x7f648c146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.993+0000 7f6491048640 1 --2- 172.21.15.19:0/860811416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f648c06fd50 0x7f648c144c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.993+0000 7f6491849640 1 -- 172.21.15.19:0/860811416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f648c06fd50 msgr2=0x7f648c144c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.993+0000 7f6491849640 1 --2- 172.21.15.19:0/860811416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f648c06fd50 0x7f648c144c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.993+0000 7f6491849640 1 -- 172.21.15.19:0/860811416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f648c072e80 msgr2=0x7f648c146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.993+0000 7f6491849640 1 --2- 172.21.15.19:0/860811416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f648c072e80 0x7f648c146c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.993+0000 7f6491849640 1 -- 172.21.15.19:0/860811416 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c1475c0 con 0x7f648c15ba30 2024-09-12T01:58:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.993+0000 7f6491849640 1 --2- 172.21.15.19:0/860811416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f648c15ba30 0x7f648c14f8c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f648400e810 tx=0x7f648400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.993+0000 7f6489ffb640 1 -- 172.21.15.19:0/860811416 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648400f040 con 0x7f648c15ba30 2024-09-12T01:58:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.993+0000 7f6489ffb640 1 -- 172.21.15.19:0/860811416 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6484004030 con 0x7f648c15ba30 2024-09-12T01:58:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.993+0000 7f64932ac640 1 -- 172.21.15.19:0/860811416 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648c1478a0 con 0x7f648c15ba30 2024-09-12T01:58:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.993+0000 7f6489ffb640 1 -- 172.21.15.19:0/860811416 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64840043e0 con 0x7f648c15ba30 2024-09-12T01:58:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.994+0000 7f64932ac640 1 -- 172.21.15.19:0/860811416 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f648c156500 con 0x7f648c15ba30 2024-09-12T01:58:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.995+0000 7f64932ac640 1 -- 172.21.15.19:0/860811416 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f648c073260 con 0x7f648c15ba30 2024-09-12T01:58:58.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.995+0000 7f6489ffb640 1 -- 172.21.15.19:0/860811416 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f648400c6d0 con 0x7f648c15ba30 2024-09-12T01:58:58.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.995+0000 7f6489ffb640 1 --2- 172.21.15.19:0/860811416 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f647806be60 0x7f647806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:58.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.995+0000 7f6489ffb640 1 -- 172.21.15.19:0/860811416 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7f648408ac30 con 0x7f648c15ba30 2024-09-12T01:58:58.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.996+0000 7f6491048640 1 --2- 172.21.15.19:0/860811416 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f647806be60 0x7f647806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:58.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:58.996+0000 7f6491048640 1 --2- 172.21.15.19:0/860811416 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f647806be60 0x7f647806e320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f648c150790 tx=0x7f647c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:58.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.000+0000 7f6489ffb640 1 -- 172.21.15.19:0/860811416 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f648c073260 con 0x7f648c15ba30 2024-09-12T01:58:59.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.213+0000 7f64932ac640 1 -- 172.21.15.19:0/860811416 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f648c0cedf0 con 0x7f648c15ba30 2024-09-12T01:58:59.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.213+0000 7f6489ffb640 1 -- 172.21.15.19:0/860811416 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5225 (secure 0 0 0) 0x7f6484017020 con 0x7f648c15ba30 2024-09-12T01:58:59.213 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:58:59.213 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":48,"btime":"2024-09-12T01:58:58:367390+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2176310149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2176310149},{"type":"v1","addr":"172.21.15.135:6836","nonce":2176310149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/222313950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":222313950},{"type":"v1","addr":"172.21.15.135:6837","nonce":222313950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/2113904472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2113904472},{"type":"v1","addr":"172.21.15.19:6834","nonce":2113904472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:58:31.431304+0000","modified":"2024-09-12T01:58:58.367383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6120":{"gid":6120,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.19:6835/740310996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":740310996},{"type":"v1","addr":"172.21.15.19:6835","nonce":740310996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6120,"qdb_cluster":[6120]},"id":4}]} 2024-09-12T01:58:59.213 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 48 2024-09-12T01:58:59.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.215+0000 7f64932ac640 1 -- 172.21.15.19:0/860811416 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f647806be60 msgr2=0x7f647806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:59.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.215+0000 7f64932ac640 1 --2- 172.21.15.19:0/860811416 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f647806be60 0x7f647806e320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f648c150790 tx=0x7f647c00b040 comp rx=0 tx=0).stop 2024-09-12T01:58:59.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.215+0000 7f64932ac640 1 -- 172.21.15.19:0/860811416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f648c15ba30 msgr2=0x7f648c14f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:59.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.215+0000 7f64932ac640 1 --2- 172.21.15.19:0/860811416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f648c15ba30 0x7f648c14f8c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f648400e810 tx=0x7f648400ecd0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.215+0000 7f64932ac640 1 -- 172.21.15.19:0/860811416 shutdown_connections 2024-09-12T01:58:59.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.215+0000 7f64932ac640 1 --2- 172.21.15.19:0/860811416 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f647806be60 0x7f647806e320 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.215+0000 7f64932ac640 1 --2- 172.21.15.19:0/860811416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f648c15ba30 0x7f648c14f8c0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.215+0000 7f64932ac640 1 --2- 172.21.15.19:0/860811416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f648c072e80 0x7f648c146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.215+0000 7f64932ac640 1 --2- 172.21.15.19:0/860811416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f648c06fd50 0x7f648c144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.215+0000 7f64932ac640 1 -- 172.21.15.19:0/860811416 >> 172.21.15.19:0/860811416 conn(0x7f648c067d70 msgr2=0x7f648c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:59.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.215+0000 7f64932ac640 1 -- 172.21.15.19:0/860811416 shutdown_connections 2024-09-12T01:58:59.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.215+0000 7f64932ac640 1 -- 172.21.15.19:0/860811416 wait complete. 2024-09-12T01:58:59.630 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:58:31.431304+0000', 'modified': '2024-09-12T01:58:58.367383+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 69, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6120}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6120': {'gid': 6120, 'name': 'c', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.19:6835/740310996', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6833', 'nonce': 740310996}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 740310996}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6120, 'qdb_cluster': [6120]} 2024-09-12T01:58:59.630 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:58:59.630 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T01:58:59.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.737+0000 7f5a0e978640 1 Processor -- start 2024-09-12T01:58:59.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.737+0000 7f5a0e978640 1 -- start start 2024-09-12T01:58:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a0e978640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5a0815c520 0x7f5a0809b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a0e978640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a080b1620 0x7f5a080b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a0e978640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a080cec00 con 0x7f5a080d0980 2024-09-12T01:58:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a0e978640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f5a0809bd90 con 0x7f5a0815c520 2024-09-12T01:58:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a0e978640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5a080d0010 con 0x7f5a080b1620 2024-09-12T01:58:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a0cf15640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5a080d0980 0x7f5a080cd570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60880/0 (socket says 172.21.15.19:60880) 2024-09-12T01:58:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a0cf15640 1 -- 172.21.15.19:0/1279654195 learned_addr learned my addr 172.21.15.19:0/1279654195 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a07fff640 1 --2- 172.21.15.19:0/1279654195 >> v2:172.21.15.135:3300/0 conn(0x7f5a0815c520 0x7f5a0809b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a077fe640 1 --2- 172.21.15.19:0/1279654195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a080b1620 0x7f5a080b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a06ffd640 1 -- 172.21.15.19:0/1279654195 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2852809398 0 0) 0x7f5a080cec00 con 0x7f5a080d0980 2024-09-12T01:58:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a06ffd640 1 -- 172.21.15.19:0/1279654195 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59f0003520 con 0x7f5a080d0980 2024-09-12T01:58:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a06ffd640 1 -- 172.21.15.19:0/1279654195 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3103456792 0 0) 0x7f59f0003520 con 0x7f5a080d0980 2024-09-12T01:58:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a06ffd640 1 -- 172.21.15.19:0/1279654195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a080b1620 msgr2=0x7f5a080b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a06ffd640 1 --2- 172.21.15.19:0/1279654195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a080b1620 0x7f5a080b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a06ffd640 1 -- 172.21.15.19:0/1279654195 >> v2:172.21.15.135:3300/0 conn(0x7f5a0815c520 msgr2=0x7f5a0809b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a06ffd640 1 --2- 172.21.15.19:0/1279654195 >> v2:172.21.15.135:3300/0 conn(0x7f5a0815c520 0x7f5a0809b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a06ffd640 1 -- 172.21.15.19:0/1279654195 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a080d02f0 con 0x7f5a080d0980 2024-09-12T01:58:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a06ffd640 1 -- 172.21.15.19:0/1279654195 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f5a000019f0 con 0x7f5a080d0980 2024-09-12T01:58:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a06ffd640 1 -- 172.21.15.19:0/1279654195 >> v1:172.21.15.19:6789/0 conn(0x7f5a080d0980 legacy=0x7f5a080cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a06ffd640 1 --2- 172.21.15.19:0/1279654195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59f00039b0 0x7f59f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a06ffd640 1 --2- 172.21.15.19:0/1279654195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59f0004800 0x7f59f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a06ffd640 1 --2- 172.21.15.19:0/1279654195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a080b1620 0x7f59f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a06ffd640 1 -- 172.21.15.19:0/1279654195 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0809bd90 con 0x7f59f0004800 2024-09-12T01:58:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a06ffd640 1 -- 172.21.15.19:0/1279654195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a080d0010 con 0x7f59f00039b0 2024-09-12T01:58:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a06ffd640 1 -- 172.21.15.19:0/1279654195 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f59f000b9c0 con 0x7f5a080b1620 2024-09-12T01:58:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.738+0000 7f5a077fe640 1 --2- 172.21.15.19:0/1279654195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59f0004800 0x7f59f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.739+0000 7f5a07fff640 1 --2- 172.21.15.19:0/1279654195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59f00039b0 0x7f59f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.739+0000 7f5a0cf15640 1 --2- 172.21.15.19:0/1279654195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a080b1620 0x7f59f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.739+0000 7f5a077fe640 1 -- 172.21.15.19:0/1279654195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a080b1620 msgr2=0x7f59f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.739+0000 7f5a077fe640 1 --2- 172.21.15.19:0/1279654195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a080b1620 0x7f59f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.739+0000 7f5a077fe640 1 -- 172.21.15.19:0/1279654195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59f00039b0 msgr2=0x7f59f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.739+0000 7f5a077fe640 1 --2- 172.21.15.19:0/1279654195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59f00039b0 0x7f59f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.739+0000 7f5a077fe640 1 -- 172.21.15.19:0/1279654195 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f0003520 con 0x7f59f0004800 2024-09-12T01:58:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.739+0000 7f5a077fe640 1 --2- 172.21.15.19:0/1279654195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59f0004800 0x7f59f0004c80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f59fc009ac0 tx=0x7f59f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aec5ce0dbdaab5e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.740+0000 7f5a06ffd640 1 -- 172.21.15.19:0/1279654195 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59fc036070 con 0x7f59f0004800 2024-09-12T01:58:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.740+0000 7f5a06ffd640 1 -- 172.21.15.19:0/1279654195 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59fc031400 con 0x7f59f0004800 2024-09-12T01:58:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.740+0000 7f5a06ffd640 1 -- 172.21.15.19:0/1279654195 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59fc009690 con 0x7f59f0004800 2024-09-12T01:58:59.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.740+0000 7f5a0e978640 1 -- 172.21.15.19:0/1279654195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59f0004800 msgr2=0x7f59f0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.740+0000 7f5a0e978640 1 --2- 172.21.15.19:0/1279654195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59f0004800 0x7f59f0004c80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f59fc009ac0 tx=0x7f59f0005830 comp rx=0 tx=0).stop 2024-09-12T01:58:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.740+0000 7f5a0cf15640 1 -- 172.21.15.19:0/1279654195 reap_dead start 2024-09-12T01:58:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.740+0000 7f5a0e978640 1 -- 172.21.15.19:0/1279654195 shutdown_connections 2024-09-12T01:58:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.740+0000 7f5a0e978640 1 -- 172.21.15.19:0/1279654195 >> 172.21.15.19:0/1279654195 conn(0x7f5a080d23a0 msgr2=0x7f5a080d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.740+0000 7f5a0e978640 1 -- 172.21.15.19:0/1279654195 shutdown_connections 2024-09-12T01:58:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.740+0000 7f5a0e978640 1 -- 172.21.15.19:0/1279654195 wait complete. 2024-09-12T01:58:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.741+0000 7f5a0e978640 1 Processor -- start 2024-09-12T01:58:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.742+0000 7f5a0e978640 1 -- start start 2024-09-12T01:58:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.742+0000 7f5a0e978640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59f0004800 0x7f5a0815b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.742+0000 7f5a0e978640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a0815b250 0x7f5a081f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.742+0000 7f5a0e978640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a0815aae0 0x7f5a080b6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.742+0000 7f5a0e978640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0815c900 con 0x7f5a0815aae0 2024-09-12T01:58:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.742+0000 7f5a0e978640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a080d05d0 con 0x7f5a0815b250 2024-09-12T01:58:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.742+0000 7f5a0e978640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5a080c9470 con 0x7f59f0004800 2024-09-12T01:58:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.742+0000 7f5a0cf15640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a0815aae0 0x7f5a080b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.743+0000 7f5a0cf15640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a0815aae0 0x7f5a080b6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36750/0 (socket says 172.21.15.19:36750) 2024-09-12T01:58:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.743+0000 7f5a0cf15640 1 -- 172.21.15.19:0/1573517893 learned_addr learned my addr 172.21.15.19:0/1573517893 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.743+0000 7f5a0cf15640 1 -- 172.21.15.19:0/1573517893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59f0004800 msgr2=0x7f5a0815b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.743+0000 7f5a0cf15640 1 --2- 172.21.15.19:0/1573517893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59f0004800 0x7f5a0815b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.743+0000 7f5a0cf15640 1 -- 172.21.15.19:0/1573517893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a0815b250 msgr2=0x7f5a081f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.743+0000 7f5a0cf15640 1 --2- 172.21.15.19:0/1573517893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a0815b250 0x7f5a081f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.743+0000 7f5a0cf15640 1 -- 172.21.15.19:0/1573517893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a081f5b30 con 0x7f5a0815aae0 2024-09-12T01:58:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.743+0000 7f5a0cf15640 1 --2- 172.21.15.19:0/1573517893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a0815aae0 0x7f5a080b6750 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5a00002070 tx=0x7f5a0000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:59.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.743+0000 7f5a04ff9640 1 -- 172.21.15.19:0/1573517893 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0000ee20 con 0x7f5a0815aae0 2024-09-12T01:58:59.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.743+0000 7f5a04ff9640 1 -- 172.21.15.19:0/1573517893 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a00018070 con 0x7f5a0815aae0 2024-09-12T01:58:59.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.743+0000 7f5a0e978640 1 -- 172.21.15.19:0/1573517893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a080caa50 con 0x7f5a0815aae0 2024-09-12T01:58:59.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.743+0000 7f5a04ff9640 1 -- 172.21.15.19:0/1573517893 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00013660 con 0x7f5a0815aae0 2024-09-12T01:58:59.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.743+0000 7f5a0e978640 1 -- 172.21.15.19:0/1573517893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a080c96c0 con 0x7f5a0815aae0 2024-09-12T01:58:59.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.745+0000 7f5a04ff9640 1 -- 172.21.15.19:0/1573517893 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a00013800 con 0x7f5a0815aae0 2024-09-12T01:58:59.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.745+0000 7f5a04ff9640 1 --2- 172.21.15.19:0/1573517893 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f59f406be60 0x7f59f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.745+0000 7f5a04ff9640 1 -- 172.21.15.19:0/1573517893 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7f5a0008b440 con 0x7f5a0815aae0 2024-09-12T01:58:59.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.746+0000 7f5a07fff640 1 --2- 172.21.15.19:0/1573517893 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f59f406be60 0x7f59f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.746+0000 7f5a117ee740 1 Processor -- start 2024-09-12T01:58:59.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.746+0000 7f5a117ee740 1 -- start start 2024-09-12T01:58:59.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.746+0000 7f5a07fff640 1 --2- 172.21.15.19:0/1573517893 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f59f406be60 0x7f59f406e320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f59f8006e80 tx=0x7f59f8006df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:59.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.747+0000 7f5a117ee740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45012c0 0x55aec4546a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.747+0000 7f5a117ee740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec44fea80 0x55aec45016a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.747+0000 7f5a117ee740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec4502a50 0x55aec44fb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.747+0000 7f5a117ee740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55aec4463520 con 0x55aec45012c0 2024-09-12T01:58:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.747+0000 7f5a117ee740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55aec440b3e0 con 0x55aec44fea80 2024-09-12T01:58:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.747+0000 7f5a117ee740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55aec445f4e0 con 0x55aec4502a50 2024-09-12T01:58:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.747+0000 7f5a07fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45012c0 0x55aec4546a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.747+0000 7f5a07fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45012c0 0x55aec4546a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36754/0 (socket says 172.21.15.19:36754) 2024-09-12T01:58:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.747+0000 7f5a07fff640 1 -- 172.21.15.19:0/3472194465 learned_addr learned my addr 172.21.15.19:0/3472194465 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.747+0000 7f5a07fff640 1 -- 172.21.15.19:0/3472194465 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec4502a50 msgr2=0x55aec44fb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.747+0000 7f5a07fff640 1 --2- 172.21.15.19:0/3472194465 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec4502a50 0x55aec44fb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.747+0000 7f5a07fff640 1 -- 172.21.15.19:0/3472194465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec44fea80 msgr2=0x55aec45016a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.747+0000 7f5a07fff640 1 --2- 172.21.15.19:0/3472194465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec44fea80 0x55aec45016a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.747+0000 7f5a07fff640 1 -- 172.21.15.19:0/3472194465 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aec44262f0 con 0x55aec45012c0 2024-09-12T01:58:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.747+0000 7f5a07fff640 1 --2- 172.21.15.19:0/3472194465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45012c0 0x55aec4546a60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f59f8004520 tx=0x7f59f8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc00539942e32907 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.748+0000 7f59edffb640 1 -- 172.21.15.19:0/3472194465 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f801d050 con 0x55aec45012c0 2024-09-12T01:58:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.748+0000 7f59edffb640 1 -- 172.21.15.19:0/3472194465 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f8027070 con 0x55aec45012c0 2024-09-12T01:58:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.748+0000 7f59edffb640 1 -- 172.21.15.19:0/3472194465 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f8003a20 con 0x55aec45012c0 2024-09-12T01:58:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.748+0000 7f5a117ee740 1 -- 172.21.15.19:0/3472194465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45012c0 msgr2=0x55aec4546a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.748+0000 7f5a117ee740 1 --2- 172.21.15.19:0/3472194465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45012c0 0x55aec4546a60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f59f8004520 tx=0x7f59f8014000 comp rx=0 tx=0).stop 2024-09-12T01:58:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.748+0000 7f5a117ee740 1 -- 172.21.15.19:0/3472194465 shutdown_connections 2024-09-12T01:58:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.748+0000 7f5a117ee740 1 --2- 172.21.15.19:0/3472194465 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec4502a50 0x55aec44fb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.748+0000 7f5a117ee740 1 --2- 172.21.15.19:0/3472194465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec44fea80 0x55aec45016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.748+0000 7f5a117ee740 1 --2- 172.21.15.19:0/3472194465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45012c0 0x55aec4546a60 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.748+0000 7f5a117ee740 1 -- 172.21.15.19:0/3472194465 >> 172.21.15.19:0/3472194465 conn(0x55aec44fda80 msgr2=0x55aec4545f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.748+0000 7f5a117ee740 1 -- 172.21.15.19:0/3472194465 shutdown_connections 2024-09-12T01:58:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.748+0000 7f5a117ee740 1 -- 172.21.15.19:0/3472194465 wait complete. 2024-09-12T01:58:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.749+0000 7f5a117ee740 1 -- start start 2024-09-12T01:58:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.749+0000 7f5a117ee740 1 Processor -- start 2024-09-12T01:58:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a117ee740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec45012c0 0x55aec4541660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a117ee740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec4502a50 0x55aec4541d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a117ee740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec45256d0 0x55aec4555e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a117ee740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55aec44fcf20 con 0x55aec4502a50 2024-09-12T01:58:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a117ee740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55aec43ec450 con 0x55aec45256d0 2024-09-12T01:58:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a117ee740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55aec4547290 con 0x55aec45012c0 2024-09-12T01:58:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a117ee740 10 client.0 _ll_register_callbacks cb 0x55aec4175ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a077fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec4502a50 0x55aec4541d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a077fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec4502a50 0x55aec4541d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36756/0 (socket says 172.21.15.19:36756) 2024-09-12T01:58:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a077fe640 1 -- 172.21.15.19:0/297378121 learned_addr learned my addr 172.21.15.19:0/297378121 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a077fe640 1 -- 172.21.15.19:0/297378121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec45012c0 msgr2=0x55aec4541660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a0cf15640 1 --2- 172.21.15.19:0/297378121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec45256d0 0x55aec4555e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a07fff640 1 --2- 172.21.15.19:0/297378121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec45012c0 0x55aec4541660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a077fe640 1 --2- 172.21.15.19:0/297378121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec45012c0 0x55aec4541660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a077fe640 1 -- 172.21.15.19:0/297378121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec45256d0 msgr2=0x55aec4555e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a077fe640 1 --2- 172.21.15.19:0/297378121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec45256d0 0x55aec4555e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a077fe640 1 -- 172.21.15.19:0/297378121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aec41762d0 con 0x55aec4502a50 2024-09-12T01:58:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a0cf15640 1 --2- 172.21.15.19:0/297378121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec45256d0 0x55aec4555e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a07fff640 1 --2- 172.21.15.19:0/297378121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec45012c0 0x55aec4541660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f5a077fe640 1 --2- 172.21.15.19:0/297378121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec4502a50 0x55aec4541d80 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f59fc02abb0 tx=0x7f59fc031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe73054be8f9431b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.750+0000 7f59e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:58:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.751+0000 7f59e6ffd640 1 -- 172.21.15.19:0/297378121 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59fc041020 con 0x55aec4502a50 2024-09-12T01:58:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.751+0000 7f59e6ffd640 1 -- 172.21.15.19:0/297378121 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7f59fc009690 con 0x55aec4502a50 2024-09-12T01:58:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.751+0000 7f5a117ee740 1 -- 172.21.15.19:0/297378121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59f8027070 con 0x55aec4502a50 2024-09-12T01:58:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.751+0000 7f59e6ffd640 1 -- 172.21.15.19:0/297378121 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f59fc04b050 con 0x55aec4502a50 2024-09-12T01:58:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.751+0000 7f5a117ee740 10 client.6165 fetch_fsmap learned FSMap version 48 2024-09-12T01:58:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.751+0000 7f5a117ee740 1 -- 172.21.15.19:0/297378121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) -- 0x55aec42406b0 con 0x55aec4502a50 2024-09-12T01:58:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.751+0000 7f59e6ffd640 1 -- 172.21.15.19:0/297378121 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f8027070 con 0x55aec4502a50 2024-09-12T01:58:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.751+0000 7f59e6ffd640 1 -- 172.21.15.19:0/297378121 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 48) ==== 3502+0+0 (secure 0 0 0) 0x7f59fc04e020 con 0x55aec4502a50 2024-09-12T01:58:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.751+0000 7f5a117ee740 10 client.6165 fetch_fsmap finished waiting for FSMap version 48 2024-09-12T01:58:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.751+0000 7f5a117ee740 10 client.6165 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T01:58:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.751+0000 7f5a117ee740 20 client.6165 populate_metadata read hostname 'smithi019' 2024-09-12T01:58:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.751+0000 7f5a117ee740 1 --2- 172.21.15.19:0/297378121 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x55aec4528f50 0x55aec4529330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.751+0000 7f5a117ee740 4 client.6165 mds_command: new command op to 6120 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.751+0000 7f5a117ee740 1 -- 172.21.15.19:0/297378121 --> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aec4470c50 con 0x55aec4528f50 2024-09-12T01:58:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.751+0000 7f5a07fff640 1 --2- 172.21.15.19:0/297378121 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x55aec4528f50 0x55aec4529330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.752+0000 7f5a07fff640 1 --2- 172.21.15.19:0/297378121 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x55aec4528f50 0x55aec4529330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90fecf9acde6b414 server_cookie=6b03c86e5eaa3175 in_seq=0 out_seq=0 2024-09-12T01:58:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.752+0000 7f59e6ffd640 10 client.6165 ms_handle_connect on v2:172.21.15.19:6833/740310996 2024-09-12T01:58:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.752+0000 7f59e6ffd640 1 -- 172.21.15.19:0/297378121 <== mds.0 v2:172.21.15.19:6833/740310996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aec4470c50 con 0x55aec4528f50 2024-09-12T01:58:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.752+0000 7f59e6ffd640 10 client.6165 handle_command_reply: tid=0 2024-09-12T01:58:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.752+0000 7f5a117ee740 1 client.6165 shutdown 2024-09-12T01:58:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.752+0000 7f5a117ee740 1 -- 172.21.15.19:0/297378121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec4502a50 msgr2=0x55aec4541d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.752+0000 7f5a117ee740 1 --2- 172.21.15.19:0/297378121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec4502a50 0x55aec4541d80 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f59fc02abb0 tx=0x7f59fc031a10 comp rx=0 tx=0).stop 2024-09-12T01:58:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.752+0000 7f5a117ee740 1 -- 172.21.15.19:0/297378121 shutdown_connections 2024-09-12T01:58:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.752+0000 7f5a117ee740 1 --2- 172.21.15.19:0/297378121 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x55aec4528f50 0x55aec4529330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.752+0000 7f5a117ee740 1 --2- 172.21.15.19:0/297378121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec45256d0 0x55aec4555e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.752+0000 7f5a117ee740 1 --2- 172.21.15.19:0/297378121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec4502a50 0x55aec4541d80 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.752+0000 7f59e6ffd640 0 client.6165 ms_handle_reset on v2:172.21.15.19:6833/740310996 2024-09-12T01:58:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.752+0000 7f5a117ee740 1 --2- 172.21.15.19:0/297378121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec45012c0 0x55aec4541660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.752+0000 7f5a117ee740 1 -- 172.21.15.19:0/297378121 >> 172.21.15.19:0/297378121 conn(0x55aec44fea80 msgr2=0x55aec4545520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.753+0000 7f5a117ee740 1 -- 172.21.15.19:0/297378121 shutdown_connections 2024-09-12T01:58:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.753+0000 7f5a117ee740 1 -- 172.21.15.19:0/297378121 wait complete. 2024-09-12T01:58:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.753+0000 7f5a117ee740 20 client.6165 trim_cache size 0 max 16384 2024-09-12T01:58:59.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.771+0000 7f5a117ee740 1 Processor -- start 2024-09-12T01:58:59.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.771+0000 7f5a117ee740 1 -- start start 2024-09-12T01:58:59.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.771+0000 7f5a117ee740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45012c0 0x55aec4501a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.771+0000 7f5a117ee740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec4502a50 0x55aec4569ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.771+0000 7f5a117ee740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec45256d0 0x55aec452acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.771+0000 7f5a117ee740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5a081fe890 con 0x55aec45012c0 2024-09-12T01:58:59.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.771+0000 7f5a117ee740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a081fdbc0 con 0x55aec4502a50 2024-09-12T01:58:59.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.771+0000 7f5a117ee740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5a081fe1e0 con 0x55aec45256d0 2024-09-12T01:58:59.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.772+0000 7f5a07fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45012c0 0x55aec4501a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.772+0000 7f5a07fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45012c0 0x55aec4501a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36762/0 (socket says 172.21.15.19:36762) 2024-09-12T01:58:59.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.772+0000 7f5a07fff640 1 -- 172.21.15.19:0/3176001153 learned_addr learned my addr 172.21.15.19:0/3176001153 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:59.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.772+0000 7f5a07fff640 1 -- 172.21.15.19:0/3176001153 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec45256d0 msgr2=0x55aec452acf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:58:59.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.772+0000 7f5a07fff640 1 --2- 172.21.15.19:0/3176001153 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec45256d0 0x55aec452acf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.772+0000 7f5a07fff640 1 -- 172.21.15.19:0/3176001153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec4502a50 msgr2=0x55aec4569ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:58:59.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.772+0000 7f5a07fff640 1 --2- 172.21.15.19:0/3176001153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec4502a50 0x55aec4569ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.772+0000 7f5a07fff640 1 -- 172.21.15.19:0/3176001153 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aec45402b0 con 0x55aec45012c0 2024-09-12T01:58:59.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.772+0000 7f5a07fff640 1 --2- 172.21.15.19:0/3176001153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45012c0 0x55aec4501a10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f59f8011d20 tx=0x7f59f8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d755adfe96d0f46f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:59.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.772+0000 7f59ed7fa640 1 -- 172.21.15.19:0/3176001153 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f801d070 con 0x55aec45012c0 2024-09-12T01:58:59.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.772+0000 7f59ed7fa640 1 -- 172.21.15.19:0/3176001153 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f8027040 con 0x55aec45012c0 2024-09-12T01:58:59.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.772+0000 7f59ed7fa640 1 -- 172.21.15.19:0/3176001153 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f8035380 con 0x55aec45012c0 2024-09-12T01:58:59.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.773+0000 7f5a117ee740 1 -- 172.21.15.19:0/3176001153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45012c0 msgr2=0x55aec4501a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:59.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.773+0000 7f5a117ee740 1 --2- 172.21.15.19:0/3176001153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45012c0 0x55aec4501a10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f59f8011d20 tx=0x7f59f8015000 comp rx=0 tx=0).stop 2024-09-12T01:58:59.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.773+0000 7f5a117ee740 1 -- 172.21.15.19:0/3176001153 shutdown_connections 2024-09-12T01:58:59.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.773+0000 7f5a117ee740 1 --2- 172.21.15.19:0/3176001153 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec45256d0 0x55aec452acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.773+0000 7f5a117ee740 1 --2- 172.21.15.19:0/3176001153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec4502a50 0x55aec4569ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.773+0000 7f5a117ee740 1 --2- 172.21.15.19:0/3176001153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45012c0 0x55aec4501a10 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.773+0000 7f5a117ee740 1 -- 172.21.15.19:0/3176001153 >> 172.21.15.19:0/3176001153 conn(0x55aec44fea80 msgr2=0x55aec45249a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:59.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.773+0000 7f5a117ee740 1 -- 172.21.15.19:0/3176001153 shutdown_connections 2024-09-12T01:58:59.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.773+0000 7f5a117ee740 1 -- 172.21.15.19:0/3176001153 wait complete. 2024-09-12T01:58:59.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.773+0000 7f5a117ee740 1 -- start start 2024-09-12T01:58:59.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.773+0000 7f5a117ee740 1 Processor -- start 2024-09-12T01:58:59.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.774+0000 7f5a117ee740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec45012c0 0x55aec4527ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.774+0000 7f5a117ee740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec4502a50 0x55aec45aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.774+0000 7f5a117ee740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45256d0 0x55aec452aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.774+0000 7f5a117ee740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55aec4525b30 con 0x55aec45256d0 2024-09-12T01:58:59.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.774+0000 7f5a117ee740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55aec4556960 con 0x55aec4502a50 2024-09-12T01:58:59.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.774+0000 7f5a117ee740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55aec44fc040 con 0x55aec45012c0 2024-09-12T01:58:59.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.774+0000 7f5a117ee740 10 client.0 _ll_register_callbacks cb 0x7f59fc034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:59.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.774+0000 7f5a0cf15640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45256d0 0x55aec452aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.774+0000 7f5a0cf15640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45256d0 0x55aec452aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36766/0 (socket says 172.21.15.19:36766) 2024-09-12T01:58:59.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.774+0000 7f5a0cf15640 1 -- 172.21.15.19:0/3657964528 learned_addr learned my addr 172.21.15.19:0/3657964528 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:59.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.774+0000 7f5a07fff640 1 --2- 172.21.15.19:0/3657964528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec45012c0 0x55aec4527ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.774+0000 7f5a077fe640 1 --2- 172.21.15.19:0/3657964528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec4502a50 0x55aec45aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f5a0cf15640 1 -- 172.21.15.19:0/3657964528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec45012c0 msgr2=0x55aec4527ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:59.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f5a0cf15640 1 --2- 172.21.15.19:0/3657964528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec45012c0 0x55aec4527ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f5a0cf15640 1 -- 172.21.15.19:0/3657964528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec4502a50 msgr2=0x55aec45aa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:59.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f5a0cf15640 1 --2- 172.21.15.19:0/3657964528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec4502a50 0x55aec45aa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f5a0cf15640 1 -- 172.21.15.19:0/3657964528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aec455ecc0 con 0x55aec45256d0 2024-09-12T01:58:59.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f5a077fe640 1 --2- 172.21.15.19:0/3657964528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec4502a50 0x55aec45aa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:59.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f5a07fff640 1 --2- 172.21.15.19:0/3657964528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec45012c0 0x55aec4527ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:59.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f5a0cf15640 1 --2- 172.21.15.19:0/3657964528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45256d0 0x55aec452aae0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5a00061b50 tx=0x7f5a00059ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1224867bf2c32b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:59.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f59e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:58:59.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f59e6ffd640 1 -- 172.21.15.19:0/3657964528 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00055b10 con 0x55aec45256d0 2024-09-12T01:58:59.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f59e6ffd640 1 -- 172.21.15.19:0/3657964528 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7f5a0008b0b0 con 0x55aec45256d0 2024-09-12T01:58:59.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f5a117ee740 1 -- 172.21.15.19:0/3657964528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59f8027040 con 0x55aec45256d0 2024-09-12T01:58:59.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f59e6ffd640 1 -- 172.21.15.19:0/3657964528 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f5a00055cb0 con 0x55aec45256d0 2024-09-12T01:58:59.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f5a117ee740 10 client.6171 fetch_fsmap learned FSMap version 48 2024-09-12T01:58:59.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f5a117ee740 1 -- 172.21.15.19:0/3657964528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) -- 0x55aec45aa960 con 0x55aec45256d0 2024-09-12T01:58:59.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f59e6ffd640 1 -- 172.21.15.19:0/3657964528 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f8027040 con 0x55aec45256d0 2024-09-12T01:58:59.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f59e6ffd640 1 -- 172.21.15.19:0/3657964528 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 48) ==== 3502+0+0 (secure 0 0 0) 0x7f5a00089330 con 0x55aec45256d0 2024-09-12T01:58:59.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f5a117ee740 10 client.6171 fetch_fsmap finished waiting for FSMap version 48 2024-09-12T01:58:59.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f5a117ee740 10 client.6171 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T01:58:59.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f5a117ee740 20 client.6171 populate_metadata read hostname 'smithi019' 2024-09-12T01:58:59.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f5a117ee740 1 --2- 172.21.15.19:0/3657964528 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x55aec44fb5f0 0x55aec45551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f5a117ee740 4 client.6171 mds_command: new command op to 6120 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:58:59.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.775+0000 7f5a117ee740 1 -- 172.21.15.19:0/3657964528 --> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] -- command(tid 0: {"prefix": "status"}) -- 0x55aec446afa0 con 0x55aec44fb5f0 2024-09-12T01:58:59.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.776+0000 7f5a07fff640 1 --2- 172.21.15.19:0/3657964528 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x55aec44fb5f0 0x55aec45551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.776+0000 7f59e6ffd640 10 client.6171 ms_handle_connect on v2:172.21.15.19:6833/740310996 2024-09-12T01:58:59.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.776+0000 7f5a07fff640 1 --2- 172.21.15.19:0/3657964528 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x55aec44fb5f0 0x55aec45551c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efc09cbadde4c71e server_cookie=3a843a0813eb9da2 in_seq=0 out_seq=0 2024-09-12T01:58:59.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.776+0000 7f59e6ffd640 1 -- 172.21.15.19:0/3657964528 <== mds.0 v2:172.21.15.19:6833/740310996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55aec446afa0 con 0x55aec44fb5f0 2024-09-12T01:58:59.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.776+0000 7f59e6ffd640 10 client.6171 handle_command_reply: tid=0 2024-09-12T01:58:59.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.776+0000 7f5a117ee740 1 client.6171 shutdown 2024-09-12T01:58:59.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.776+0000 7f5a117ee740 1 -- 172.21.15.19:0/3657964528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45256d0 msgr2=0x55aec452aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:59.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.776+0000 7f5a117ee740 1 --2- 172.21.15.19:0/3657964528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45256d0 0x55aec452aae0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5a00061b50 tx=0x7f5a00059ce0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.776+0000 7f5a117ee740 1 -- 172.21.15.19:0/3657964528 shutdown_connections 2024-09-12T01:58:59.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.776+0000 7f5a117ee740 1 --2- 172.21.15.19:0/3657964528 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x55aec44fb5f0 0x55aec45551c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.776+0000 7f5a117ee740 1 --2- 172.21.15.19:0/3657964528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aec45256d0 0x55aec452aae0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.776+0000 7f5a117ee740 1 --2- 172.21.15.19:0/3657964528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aec4502a50 0x55aec45aa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.776+0000 7f59e6ffd640 0 client.6171 ms_handle_reset on v2:172.21.15.19:6833/740310996 2024-09-12T01:58:59.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.776+0000 7f5a117ee740 1 --2- 172.21.15.19:0/3657964528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aec45012c0 0x55aec4527ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.776+0000 7f5a117ee740 1 -- 172.21.15.19:0/3657964528 >> 172.21.15.19:0/3657964528 conn(0x55aec44fea80 msgr2=0x55aec4547d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:59.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.776+0000 7f5a117ee740 1 -- 172.21.15.19:0/3657964528 shutdown_connections 2024-09-12T01:58:59.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.776+0000 7f5a117ee740 1 -- 172.21.15.19:0/3657964528 wait complete. 2024-09-12T01:58:59.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.777+0000 7f5a117ee740 20 client.6171 trim_cache size 0 max 16384 2024-09-12T01:58:59.782 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:58:59.782 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T01:58:59.782 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T01:58:59.782 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 6120, 2024-09-12T01:58:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T01:58:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T01:58:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T01:58:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 4.4198595389999999, 2024-09-12T01:58:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 48, 2024-09-12T01:58:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 69, 2024-09-12T01:58:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 69, 2024-09-12T01:58:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 10.394788187 2024-09-12T01:58:59.783 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:58:59.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.777+0000 7f5a0e978640 1 -- 172.21.15.19:0/1573517893 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f59f406be60 msgr2=0x7f59f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:59.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.777+0000 7f5a0e978640 1 --2- 172.21.15.19:0/1573517893 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f59f406be60 0x7f59f406e320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f59f8006e80 tx=0x7f59f8006df0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.777+0000 7f5a0e978640 1 -- 172.21.15.19:0/1573517893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a0815aae0 msgr2=0x7f5a080b6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:59.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.777+0000 7f5a0e978640 1 --2- 172.21.15.19:0/1573517893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a0815aae0 0x7f5a080b6750 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5a00002070 tx=0x7f5a0000e530 comp rx=0 tx=0).stop 2024-09-12T01:58:59.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.777+0000 7f5a0e978640 1 -- 172.21.15.19:0/1573517893 shutdown_connections 2024-09-12T01:58:59.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.777+0000 7f5a0e978640 1 --2- 172.21.15.19:0/1573517893 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f59f406be60 0x7f59f406e320 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.777+0000 7f5a0e978640 1 --2- 172.21.15.19:0/1573517893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a0815aae0 0x7f5a080b6750 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.777+0000 7f5a0e978640 1 --2- 172.21.15.19:0/1573517893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a0815b250 0x7f5a081f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.777+0000 7f5a0e978640 1 --2- 172.21.15.19:0/1573517893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59f0004800 0x7f5a0815b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.777+0000 7f5a0e978640 1 -- 172.21.15.19:0/1573517893 >> 172.21.15.19:0/1573517893 conn(0x7f5a080d23a0 msgr2=0x7f5a080b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:59.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.777+0000 7f5a0e978640 1 -- 172.21.15.19:0/1573517893 shutdown_connections 2024-09-12T01:58:59.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.777+0000 7f5a0e978640 1 -- 172.21.15.19:0/1573517893 wait complete. 2024-09-12T01:58:59.787 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:58:59.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.890+0000 7fd2d9ca5640 1 Processor -- start 2024-09-12T01:58:59.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.890+0000 7fd2d9ca5640 1 -- start start 2024-09-12T01:58:59.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.890+0000 7fd2d9ca5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2d4161c80 0x7fd2d406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.890+0000 7fd2d9ca5640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d406e870 con 0x7fd2d4162060 2024-09-12T01:58:59.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.890+0000 7fd2d9ca5640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d406d9f0 con 0x7fd2d40b6680 2024-09-12T01:58:59.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.890+0000 7fd2d9ca5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d406dcd0 con 0x7fd2d4161c80 2024-09-12T01:58:59.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.891+0000 7fd2caffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd2d4162060 0x7fd2d40b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60894/0 (socket says 172.21.15.19:60894) 2024-09-12T01:58:59.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.891+0000 7fd2caffd640 1 -- 172.21.15.19:0/2862408081 learned_addr learned my addr 172.21.15.19:0/2862408081 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:58:59.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.891+0000 7fd2d37fe640 1 --2- 172.21.15.19:0/2862408081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2d4161c80 0x7fd2d406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.891+0000 7fd2d2ffd640 1 -- 172.21.15.19:0/2862408081 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1835881795 0 0) 0x7fd2bc001110 con 0x7fd2d4162060 2024-09-12T01:58:59.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.891+0000 7fd2d2ffd640 1 -- 172.21.15.19:0/2862408081 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2c0003520 con 0x7fd2d4162060 2024-09-12T01:58:59.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.891+0000 7fd2d2ffd640 1 -- 172.21.15.19:0/2862408081 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2890795466 0 0) 0x7fd2d406d9f0 con 0x7fd2d40b6680 2024-09-12T01:58:59.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.891+0000 7fd2d2ffd640 1 -- 172.21.15.19:0/2862408081 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2bc001110 con 0x7fd2d40b6680 2024-09-12T01:58:59.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.891+0000 7fd2d2ffd640 1 -- 172.21.15.19:0/2862408081 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4004616020 0 0) 0x7fd2c0003520 con 0x7fd2d4162060 2024-09-12T01:58:59.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.891+0000 7fd2d37fe640 1 -- 172.21.15.19:0/2862408081 >> v1:172.21.15.135:6789/0 conn(0x7fd2d40b6680 legacy=0x7fd2d40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:59.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.891+0000 7fd2d37fe640 1 -- 172.21.15.19:0/2862408081 >> v1:172.21.15.19:6789/0 conn(0x7fd2d4162060 legacy=0x7fd2d40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:59.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.891+0000 7fd2d37fe640 1 -- 172.21.15.19:0/2862408081 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d406dfb0 con 0x7fd2d4161c80 2024-09-12T01:58:59.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.892+0000 7fd2d37fe640 1 --2- 172.21.15.19:0/2862408081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2d4161c80 0x7fd2d406e330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40097d0 tx=0x7fd2c402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=483b6235c46d14a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:59.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.892+0000 7fd2d2ffd640 1 -- 172.21.15.19:0/2862408081 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4037070 con 0x7fd2d4161c80 2024-09-12T01:58:59.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.892+0000 7fd2d2ffd640 1 -- 172.21.15.19:0/2862408081 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c402ac30 con 0x7fd2d4161c80 2024-09-12T01:58:59.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.892+0000 7fd2d2ffd640 1 -- 172.21.15.19:0/2862408081 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc001840 con 0x7fd2d4161c80 2024-09-12T01:58:59.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.893+0000 7fd2d9ca5640 1 -- 172.21.15.19:0/2862408081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2d4161c80 msgr2=0x7fd2d406e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:59.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.893+0000 7fd2d9ca5640 1 --2- 172.21.15.19:0/2862408081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2d4161c80 0x7fd2d406e330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40097d0 tx=0x7fd2c402a1a0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.893+0000 7fd2d9ca5640 1 -- 172.21.15.19:0/2862408081 shutdown_connections 2024-09-12T01:58:59.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.893+0000 7fd2d9ca5640 1 --2- 172.21.15.19:0/2862408081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2d4161c80 0x7fd2d406e330 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.893+0000 7fd2d9ca5640 1 -- 172.21.15.19:0/2862408081 >> 172.21.15.19:0/2862408081 conn(0x7fd2d40d44f0 msgr2=0x7fd2d40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:59.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.893+0000 7fd2d9ca5640 1 -- 172.21.15.19:0/2862408081 shutdown_connections 2024-09-12T01:58:59.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.893+0000 7fd2d9ca5640 1 -- 172.21.15.19:0/2862408081 wait complete. 2024-09-12T01:58:59.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.894+0000 7fd2d9ca5640 1 Processor -- start 2024-09-12T01:58:59.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.894+0000 7fd2d9ca5640 1 -- start start 2024-09-12T01:58:59.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.895+0000 7fd2d9ca5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2d40b6680 0x7fd2d40b8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.895+0000 7fd2d9ca5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2d4161c80 0x7fd2d40cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.895+0000 7fd2d9ca5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2d4162060 0x7fd2d4156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.895+0000 7fd2d9ca5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d40b6cb0 con 0x7fd2d4162060 2024-09-12T01:58:59.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.895+0000 7fd2d9ca5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d40b6b30 con 0x7fd2d40b6680 2024-09-12T01:58:59.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.895+0000 7fd2d9ca5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d40cf8f0 con 0x7fd2d4161c80 2024-09-12T01:58:59.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.895+0000 7fd2d3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2d4162060 0x7fd2d4156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.895+0000 7fd2d3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2d4162060 0x7fd2d4156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36770/0 (socket says 172.21.15.19:36770) 2024-09-12T01:58:59.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.895+0000 7fd2d3fff640 1 -- 172.21.15.19:0/542946557 learned_addr learned my addr 172.21.15.19:0/542946557 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:58:59.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.895+0000 7fd2d37fe640 1 --2- 172.21.15.19:0/542946557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2d40b6680 0x7fd2d40b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.895+0000 7fd2caffd640 1 --2- 172.21.15.19:0/542946557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2d4161c80 0x7fd2d40cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.895+0000 7fd2d3fff640 1 -- 172.21.15.19:0/542946557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2d4161c80 msgr2=0x7fd2d40cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:59.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.895+0000 7fd2d3fff640 1 --2- 172.21.15.19:0/542946557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2d4161c80 0x7fd2d40cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.895+0000 7fd2d3fff640 1 -- 172.21.15.19:0/542946557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2d40b6680 msgr2=0x7fd2d40b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:59.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.895+0000 7fd2d3fff640 1 --2- 172.21.15.19:0/542946557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2d40b6680 0x7fd2d40b8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.895+0000 7fd2d3fff640 1 -- 172.21.15.19:0/542946557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d40b8f60 con 0x7fd2d4162060 2024-09-12T01:58:59.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.896+0000 7fd2d3fff640 1 --2- 172.21.15.19:0/542946557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2d4162060 0x7fd2d4156780 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00c790 tx=0x7fd2cc00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:59.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.896+0000 7fd2d0ff9640 1 -- 172.21.15.19:0/542946557 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc003b70 con 0x7fd2d4162060 2024-09-12T01:58:59.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.896+0000 7fd2d0ff9640 1 -- 172.21.15.19:0/542946557 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2cc003d10 con 0x7fd2d4162060 2024-09-12T01:58:59.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.896+0000 7fd2d9ca5640 1 -- 172.21.15.19:0/542946557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d40b9240 con 0x7fd2d4162060 2024-09-12T01:58:59.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.896+0000 7fd2d0ff9640 1 -- 172.21.15.19:0/542946557 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc00aa50 con 0x7fd2d4162060 2024-09-12T01:58:59.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.896+0000 7fd2d9ca5640 1 -- 172.21.15.19:0/542946557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d40b9800 con 0x7fd2d4162060 2024-09-12T01:58:59.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.897+0000 7fd2d9ca5640 1 -- 172.21.15.19:0/542946557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2d406e330 con 0x7fd2d4162060 2024-09-12T01:58:59.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.897+0000 7fd2d0ff9640 1 -- 172.21.15.19:0/542946557 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2cc00abf0 con 0x7fd2d4162060 2024-09-12T01:58:59.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.898+0000 7fd2d0ff9640 1 --2- 172.21.15.19:0/542946557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd2b406be30 0x7fd2b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.898+0000 7fd2d0ff9640 1 -- 172.21.15.19:0/542946557 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7fd2cc08b030 con 0x7fd2d4162060 2024-09-12T01:58:59.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.898+0000 7fd2d37fe640 1 --2- 172.21.15.19:0/542946557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd2b406be30 0x7fd2b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.899+0000 7fd2d37fe640 1 --2- 172.21.15.19:0/542946557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd2b406be30 0x7fd2b406e2f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4034000 tx=0x7fd2c402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:59.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:58:59.902+0000 7fd2d0ff9640 1 -- 172.21.15.19:0/542946557 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2cc059030 con 0x7fd2d4162060 2024-09-12T01:59:00.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.116+0000 7fd2d9ca5640 1 -- 172.21.15.19:0/542946557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2d40ba470 con 0x7fd2d4162060 2024-09-12T01:59:00.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.116+0000 7fd2d0ff9640 1 -- 172.21.15.19:0/542946557 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5225 (secure 0 0 0) 0x7fd2cc05d330 con 0x7fd2d4162060 2024-09-12T01:59:00.116 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:59:00.116 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":48,"btime":"2024-09-12T01:58:58:367390+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2176310149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2176310149},{"type":"v1","addr":"172.21.15.135:6836","nonce":2176310149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/222313950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":222313950},{"type":"v1","addr":"172.21.15.135:6837","nonce":222313950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/2113904472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2113904472},{"type":"v1","addr":"172.21.15.19:6834","nonce":2113904472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:58:31.431304+0000","modified":"2024-09-12T01:58:58.367383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6120":{"gid":6120,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.19:6835/740310996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":740310996},{"type":"v1","addr":"172.21.15.19:6835","nonce":740310996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6120,"qdb_cluster":[6120]},"id":4}]} 2024-09-12T01:59:00.116 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 48 2024-09-12T01:59:00.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.119+0000 7fd2d9ca5640 1 -- 172.21.15.19:0/542946557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd2b406be30 msgr2=0x7fd2b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.119+0000 7fd2d9ca5640 1 --2- 172.21.15.19:0/542946557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd2b406be30 0x7fd2b406e2f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4034000 tx=0x7fd2c402e000 comp rx=0 tx=0).stop 2024-09-12T01:59:00.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.119+0000 7fd2d9ca5640 1 -- 172.21.15.19:0/542946557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2d4162060 msgr2=0x7fd2d4156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.119+0000 7fd2d9ca5640 1 --2- 172.21.15.19:0/542946557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2d4162060 0x7fd2d4156780 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00c790 tx=0x7fd2cc00cc50 comp rx=0 tx=0).stop 2024-09-12T01:59:00.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.119+0000 7fd2d9ca5640 1 -- 172.21.15.19:0/542946557 shutdown_connections 2024-09-12T01:59:00.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.119+0000 7fd2d9ca5640 1 --2- 172.21.15.19:0/542946557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd2b406be30 0x7fd2b406e2f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.119+0000 7fd2d9ca5640 1 --2- 172.21.15.19:0/542946557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2d4162060 0x7fd2d4156780 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.119+0000 7fd2d9ca5640 1 --2- 172.21.15.19:0/542946557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2d4161c80 0x7fd2d40cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.119+0000 7fd2d9ca5640 1 --2- 172.21.15.19:0/542946557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2d40b6680 0x7fd2d40b8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.119+0000 7fd2d9ca5640 1 -- 172.21.15.19:0/542946557 >> 172.21.15.19:0/542946557 conn(0x7fd2d40d44f0 msgr2=0x7fd2d40d31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:00.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.119+0000 7fd2d9ca5640 1 -- 172.21.15.19:0/542946557 shutdown_connections 2024-09-12T01:59:00.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.119+0000 7fd2d9ca5640 1 -- 172.21.15.19:0/542946557 wait complete. 2024-09-12T01:59:00.129 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 4:0 true 2024-09-12T01:59:00.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.234+0000 7f2f4b4af640 1 Processor -- start 2024-09-12T01:59:00.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.235+0000 7f2f4b4af640 1 -- start start 2024-09-12T01:59:00.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.235+0000 7f2f4b4af640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2f44158b50 0x7f2f440b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.235+0000 7f2f4b4af640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2f440b6360 0x7f2f4409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.235+0000 7f2f4b4af640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f440b6820 con 0x7f2f4415f950 2024-09-12T01:59:00.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.235+0000 7f2f4b4af640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2f440b6b00 con 0x7f2f440b6360 2024-09-12T01:59:00.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.235+0000 7f2f4b4af640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f2f440b6de0 con 0x7f2f44158b50 2024-09-12T01:59:00.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.236+0000 7f2f48a4a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2f440b6360 0x7f2f4409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.236+0000 7f2f49a4c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2f4415f950 0x7f2f44162220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60900/0 (socket says 172.21.15.19:60900) 2024-09-12T01:59:00.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.236+0000 7f2f49a4c640 1 -- 172.21.15.19:0/3489677312 learned_addr learned my addr 172.21.15.19:0/3489677312 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:59:00.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.236+0000 7f2f4924b640 1 --2- 172.21.15.19:0/3489677312 >> v2:172.21.15.135:3300/0 conn(0x7f2f44158b50 0x7f2f440b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.236+0000 7f2f48a4a640 1 -- 172.21.15.19:0/3489677312 >> v2:172.21.15.135:3300/0 conn(0x7f2f44158b50 msgr2=0x7f2f440b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:00.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.236+0000 7f2f48a4a640 1 --2- 172.21.15.19:0/3489677312 >> v2:172.21.15.135:3300/0 conn(0x7f2f44158b50 0x7f2f440b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.236+0000 7f2f48a4a640 1 -- 172.21.15.19:0/3489677312 >> v1:172.21.15.19:6789/0 conn(0x7f2f4415f950 legacy=0x7f2f44162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.236+0000 7f2f43fff640 1 -- 172.21.15.19:0/3489677312 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1935466811 0 0) 0x7f2f440b6820 con 0x7f2f4415f950 2024-09-12T01:59:00.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.236+0000 7f2f48a4a640 1 -- 172.21.15.19:0/3489677312 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f440b70c0 con 0x7f2f440b6360 2024-09-12T01:59:00.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.237+0000 7f2f48a4a640 1 --2- 172.21.15.19:0/3489677312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f440b6360 0x7f2f4409aa30 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2f440b8510 tx=0x7f2f3802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2347604fb8ef05c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:00.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.237+0000 7f2f43fff640 1 -- 172.21.15.19:0/3489677312 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38037070 con 0x7f2f440b6360 2024-09-12T01:59:00.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.237+0000 7f2f43fff640 1 -- 172.21.15.19:0/3489677312 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f38032440 con 0x7f2f440b6360 2024-09-12T01:59:00.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.237+0000 7f2f43fff640 1 -- 172.21.15.19:0/3489677312 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38032810 con 0x7f2f440b6360 2024-09-12T01:59:00.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.237+0000 7f2f4b4af640 1 -- 172.21.15.19:0/3489677312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f440b6360 msgr2=0x7f2f4409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.237+0000 7f2f4b4af640 1 --2- 172.21.15.19:0/3489677312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f440b6360 0x7f2f4409aa30 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2f440b8510 tx=0x7f2f3802a1a0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.237+0000 7f2f4b4af640 1 -- 172.21.15.19:0/3489677312 shutdown_connections 2024-09-12T01:59:00.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.237+0000 7f2f4b4af640 1 --2- 172.21.15.19:0/3489677312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f440b6360 0x7f2f4409aa30 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.237+0000 7f2f4b4af640 1 --2- 172.21.15.19:0/3489677312 >> v2:172.21.15.135:3300/0 conn(0x7f2f44158b50 0x7f2f440b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.237+0000 7f2f4b4af640 1 -- 172.21.15.19:0/3489677312 >> 172.21.15.19:0/3489677312 conn(0x7f2f440b79e0 msgr2=0x7f2f440b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:00.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.238+0000 7f2f4b4af640 1 -- 172.21.15.19:0/3489677312 shutdown_connections 2024-09-12T01:59:00.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.238+0000 7f2f4b4af640 1 -- 172.21.15.19:0/3489677312 wait complete. 2024-09-12T01:59:00.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.239+0000 7f2f4b4af640 1 Processor -- start 2024-09-12T01:59:00.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.239+0000 7f2f4b4af640 1 -- start start 2024-09-12T01:59:00.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.239+0000 7f2f4b4af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f440b6360 0x7f2f4414d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f4b4af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f44158b50 0x7f2f440cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f4b4af640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f4415f950 0x7f2f440b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f4b4af640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2f441590b0 con 0x7f2f44158b50 2024-09-12T01:59:00.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f4b4af640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2f44158f30 con 0x7f2f4415f950 2024-09-12T01:59:00.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f4b4af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2f44070ea0 con 0x7f2f440b6360 2024-09-12T01:59:00.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f48a4a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f44158b50 0x7f2f440cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f48a4a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f44158b50 0x7f2f440cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36780/0 (socket says 172.21.15.19:36780) 2024-09-12T01:59:00.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f48a4a640 1 -- 172.21.15.19:0/3395080764 learned_addr learned my addr 172.21.15.19:0/3395080764 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:00.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f4924b640 1 --2- 172.21.15.19:0/3395080764 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f440b6360 0x7f2f4414d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f49a4c640 1 --2- 172.21.15.19:0/3395080764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f4415f950 0x7f2f440b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f48a4a640 1 -- 172.21.15.19:0/3395080764 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f440b6360 msgr2=0x7f2f4414d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f48a4a640 1 --2- 172.21.15.19:0/3395080764 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f440b6360 0x7f2f4414d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f48a4a640 1 -- 172.21.15.19:0/3395080764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f4415f950 msgr2=0x7f2f440b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f48a4a640 1 --2- 172.21.15.19:0/3395080764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f4415f950 0x7f2f440b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f48a4a640 1 -- 172.21.15.19:0/3395080764 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f44156b30 con 0x7f2f44158b50 2024-09-12T01:59:00.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f48a4a640 1 --2- 172.21.15.19:0/3395080764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f44158b50 0x7f2f440cdc40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2f38000c00 tx=0x7f2f380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:00.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f41ffb640 1 -- 172.21.15.19:0/3395080764 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38037050 con 0x7f2f44158b50 2024-09-12T01:59:00.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f41ffb640 1 -- 172.21.15.19:0/3395080764 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f38038040 con 0x7f2f44158b50 2024-09-12T01:59:00.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f4b4af640 1 -- 172.21.15.19:0/3395080764 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f440cc910 con 0x7f2f44158b50 2024-09-12T01:59:00.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.240+0000 7f2f41ffb640 1 -- 172.21.15.19:0/3395080764 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38006e10 con 0x7f2f44158b50 2024-09-12T01:59:00.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.241+0000 7f2f4b4af640 1 -- 172.21.15.19:0/3395080764 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f440cbb50 con 0x7f2f44158b50 2024-09-12T01:59:00.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.242+0000 7f2f4b4af640 1 -- 172.21.15.19:0/3395080764 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f440b5e20 con 0x7f2f44158b50 2024-09-12T01:59:00.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.242+0000 7f2f41ffb640 1 -- 172.21.15.19:0/3395080764 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f38030980 con 0x7f2f44158b50 2024-09-12T01:59:00.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.243+0000 7f2f41ffb640 1 --2- 172.21.15.19:0/3395080764 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2f3006be30 0x7f2f3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.243+0000 7f2f41ffb640 1 -- 172.21.15.19:0/3395080764 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7f2f380abcf0 con 0x7f2f44158b50 2024-09-12T01:59:00.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.243+0000 7f2f4924b640 1 --2- 172.21.15.19:0/3395080764 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2f3006be30 0x7f2f3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.243+0000 7f2f4924b640 1 --2- 172.21.15.19:0/3395080764 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2f3006be30 0x7f2f3006e2f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009a60 tx=0x7f2f34003990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:00.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.247+0000 7f2f41ffb640 1 -- 172.21.15.19:0/3395080764 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f3807a440 con 0x7f2f44158b50 2024-09-12T01:59:00.349 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T01:59:00.349+0000 7f7a57a8a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:59:00.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:00.492+0000 7f2f4b4af640 1 -- 172.21.15.19:0/3395080764 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "4:0", "val": "true"} v 0) -- 0x7f2f440b77a0 con 0x7f2f44158b50 2024-09-12T01:59:01.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.382+0000 7f2f41ffb640 1 -- 172.21.15.19:0/3395080764 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "4:0", "val": "true"}]=0 freezing mds.6120 v49) ==== 112+0+0 (secure 0 0 0) 0x7f2f38079d40 con 0x7f2f44158b50 2024-09-12T01:59:01.382 INFO:teuthology.orchestra.run.smithi019.stderr:freezing mds.6120 2024-09-12T01:59:01.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.385+0000 7f2f4b4af640 1 -- 172.21.15.19:0/3395080764 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2f3006be30 msgr2=0x7f2f3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.385+0000 7f2f4b4af640 1 --2- 172.21.15.19:0/3395080764 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2f3006be30 0x7f2f3006e2f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009a60 tx=0x7f2f34003990 comp rx=0 tx=0).stop 2024-09-12T01:59:01.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.385+0000 7f2f4b4af640 1 -- 172.21.15.19:0/3395080764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f44158b50 msgr2=0x7f2f440cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.385+0000 7f2f4b4af640 1 --2- 172.21.15.19:0/3395080764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f44158b50 0x7f2f440cdc40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2f38000c00 tx=0x7f2f380046c0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.385+0000 7f2f4b4af640 1 -- 172.21.15.19:0/3395080764 shutdown_connections 2024-09-12T01:59:01.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.385+0000 7f2f4b4af640 1 --2- 172.21.15.19:0/3395080764 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2f3006be30 0x7f2f3006e2f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.385+0000 7f2f4b4af640 1 --2- 172.21.15.19:0/3395080764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f4415f950 0x7f2f440b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.385+0000 7f2f4b4af640 1 --2- 172.21.15.19:0/3395080764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f44158b50 0x7f2f440cdc40 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.385+0000 7f2f4b4af640 1 --2- 172.21.15.19:0/3395080764 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f440b6360 0x7f2f4414d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.385+0000 7f2f4b4af640 1 -- 172.21.15.19:0/3395080764 >> 172.21.15.19:0/3395080764 conn(0x7f2f440b79e0 msgr2=0x7f2f4406dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:01.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.385+0000 7f2f4b4af640 1 -- 172.21.15.19:0/3395080764 shutdown_connections 2024-09-12T01:59:01.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.385+0000 7f2f4b4af640 1 -- 172.21.15.19:0/3395080764 wait complete. 2024-09-12T01:59:01.398 DEBUG:teuthology.orchestra.run.smithi019:> sudo daemon-helper kill ceph --cluster ceph -w 2024-09-12T01:59:01.400 DEBUG:teuthology.orchestra.run.smithi019:> timeout 30 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --connect-timeout=60 tell mds.4:0 flush journal 2024-09-12T01:59:01.403 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2024-09-12T01:59:01.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.514+0000 7f18d38f1640 1 Processor -- start 2024-09-12T01:59:01.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.514+0000 7f18d38f1640 1 -- start start 2024-09-12T01:59:01.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.515+0000 7f18d38f1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18cc162340 0x7f18cc06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.515+0000 7f18d38f1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f18cc0cf280 0x7f18cc162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.515+0000 7f18d38f1640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18cc15ff70 con 0x7f18cc162c60 2024-09-12T01:59:01.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.515+0000 7f18d38f1640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f18cc06de90 con 0x7f18cc0cf280 2024-09-12T01:59:01.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.515+0000 7f18d38f1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f18cc0d4d10 con 0x7f18cc162340 2024-09-12T01:59:01.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.515+0000 7f18d0e8c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f18cc0cf280 0x7f18cc162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.515+0000 7f18d0e8c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f18cc0cf280 0x7f18cc162720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53488/0 (socket says 172.21.15.19:53488) 2024-09-12T01:59:01.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.515+0000 7f18d0e8c640 1 -- 172.21.15.19:0/779491089 learned_addr learned my addr 172.21.15.19:0/779491089 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:01.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.515+0000 7f18d168d640 1 --2- 172.21.15.19:0/779491089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18cc162340 0x7f18cc06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.515+0000 7f18d0e8c640 1 -- 172.21.15.19:0/779491089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18cc162340 msgr2=0x7f18cc06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.515+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/779491089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18cc162340 0x7f18cc06d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.515+0000 7f18d0e8c640 1 -- 172.21.15.19:0/779491089 >> v1:172.21.15.135:6789/0 conn(0x7f18cc162c60 legacy=0x7f18cc0d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.515+0000 7f18d0e8c640 1 -- 172.21.15.19:0/779491089 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc0d4ff0 con 0x7f18cc0cf280 2024-09-12T01:59:01.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.516+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/779491089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18cc0cf280 0x7f18cc162720 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009850 tx=0x7f18bc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e8687820a644b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.516+0000 7f18c3fff640 1 -- 172.21.15.19:0/779491089 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc004030 con 0x7f18cc0cf280 2024-09-12T01:59:01.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.516+0000 7f18c3fff640 1 -- 172.21.15.19:0/779491089 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18bc0041d0 con 0x7f18cc0cf280 2024-09-12T01:59:01.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.516+0000 7f18c3fff640 1 -- 172.21.15.19:0/779491089 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc003610 con 0x7f18cc0cf280 2024-09-12T01:59:01.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.517+0000 7f18d38f1640 1 -- 172.21.15.19:0/779491089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18cc0cf280 msgr2=0x7f18cc162720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.517+0000 7f18d38f1640 1 --2- 172.21.15.19:0/779491089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18cc0cf280 0x7f18cc162720 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009850 tx=0x7f18bc02a1a0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.517+0000 7f18d38f1640 1 -- 172.21.15.19:0/779491089 shutdown_connections 2024-09-12T01:59:01.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.517+0000 7f18d38f1640 1 --2- 172.21.15.19:0/779491089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18cc0cf280 0x7f18cc162720 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.517+0000 7f18d38f1640 1 --2- 172.21.15.19:0/779491089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18cc162340 0x7f18cc06d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.517+0000 7f18d38f1640 1 -- 172.21.15.19:0/779491089 >> 172.21.15.19:0/779491089 conn(0x7f18cc08bfc0 msgr2=0x7f18cc0d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:01.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.518+0000 7f18d38f1640 1 -- 172.21.15.19:0/779491089 shutdown_connections 2024-09-12T01:59:01.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.518+0000 7f18d38f1640 1 -- 172.21.15.19:0/779491089 wait complete. 2024-09-12T01:59:01.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.519+0000 7f18d38f1640 1 Processor -- start 2024-09-12T01:59:01.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.519+0000 7f18d38f1640 1 -- start start 2024-09-12T01:59:01.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.520+0000 7f18d38f1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18cc0cf280 0x7f18cc1f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.520+0000 7f18d38f1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18cc162340 0x7f18cc0b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.520+0000 7f18d38f1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18cc162c60 0x7f18cc15eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.520+0000 7f18d38f1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc0cf6c0 con 0x7f18cc0cf280 2024-09-12T01:59:01.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.520+0000 7f18d38f1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc0d52d0 con 0x7f18cc162340 2024-09-12T01:59:01.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.520+0000 7f18d38f1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f18cc163110 con 0x7f18cc162c60 2024-09-12T01:59:01.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.520+0000 7f18d168d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18cc0cf280 0x7f18cc1f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.520+0000 7f18d168d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18cc0cf280 0x7f18cc1f45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53504/0 (socket says 172.21.15.19:53504) 2024-09-12T01:59:01.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.520+0000 7f18d168d640 1 -- 172.21.15.19:0/3498536772 learned_addr learned my addr 172.21.15.19:0/3498536772 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:01.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.520+0000 7f18d1e8e640 1 --2- 172.21.15.19:0/3498536772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18cc162c60 0x7f18cc15eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.520+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3498536772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18cc162340 0x7f18cc0b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.520+0000 7f18d168d640 1 -- 172.21.15.19:0/3498536772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18cc162c60 msgr2=0x7f18cc15eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.520+0000 7f18d168d640 1 --2- 172.21.15.19:0/3498536772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18cc162c60 0x7f18cc15eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.520+0000 7f18d168d640 1 -- 172.21.15.19:0/3498536772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18cc162340 msgr2=0x7f18cc0b7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.520+0000 7f18d168d640 1 --2- 172.21.15.19:0/3498536772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18cc162340 0x7f18cc0b7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.520+0000 7f18d168d640 1 -- 172.21.15.19:0/3498536772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc0b8a10 con 0x7f18cc0cf280 2024-09-12T01:59:01.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.520+0000 7f18d168d640 1 --2- 172.21.15.19:0/3498536772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18cc0cf280 0x7f18cc1f45a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f18c800d830 tx=0x7f18c800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.521+0000 7f18c1ffb640 1 -- 172.21.15.19:0/3498536772 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c800b6c0 con 0x7f18cc0cf280 2024-09-12T01:59:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.521+0000 7f18c1ffb640 1 -- 172.21.15.19:0/3498536772 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c8019070 con 0x7f18cc0cf280 2024-09-12T01:59:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.521+0000 7f18c1ffb640 1 -- 172.21.15.19:0/3498536772 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c800ba80 con 0x7f18cc0cf280 2024-09-12T01:59:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.521+0000 7f18d38f1640 1 -- 172.21.15.19:0/3498536772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18cc0b7970 con 0x7f18cc0cf280 2024-09-12T01:59:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.521+0000 7f18d38f1640 1 -- 172.21.15.19:0/3498536772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18cc0b7f30 con 0x7f18cc0cf280 2024-09-12T01:59:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.522+0000 7f18c1ffb640 1 -- 172.21.15.19:0/3498536772 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18c801e460 con 0x7f18cc0cf280 2024-09-12T01:59:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.523+0000 7f18c1ffb640 1 --2- 172.21.15.19:0/3498536772 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18b006be30 0x7f18b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.523+0000 7f18c1ffb640 1 -- 172.21.15.19:0/3498536772 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7f18c808b580 con 0x7f18cc0cf280 2024-09-12T01:59:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.524+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3498536772 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18b006be30 0x7f18b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.524+0000 7f18d668e740 1 Processor -- start 2024-09-12T01:59:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.524+0000 7f18d668e740 1 -- start start 2024-09-12T01:59:01.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.524+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3498536772 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f18b006be30 0x7f18b006e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f18bc033000 tx=0x7f18bc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.525+0000 7f18d668e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a1c530 0x562c70a1c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.525+0000 7f18d668e740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a17c30 0x562c70a16b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.525+0000 7f18d668e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a19cf0 0x562c70a17060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.525+0000 7f18d668e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562c7097f5e0 con 0x562c70a19cf0 2024-09-12T01:59:01.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.525+0000 7f18d668e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562c70927360 con 0x562c70a1c530 2024-09-12T01:59:01.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.525+0000 7f18d668e740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562c7097b5a0 con 0x562c70a17c30 2024-09-12T01:59:01.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.525+0000 7f18d1e8e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a19cf0 0x562c70a17060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.525+0000 7f18d1e8e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a19cf0 0x562c70a17060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53506/0 (socket says 172.21.15.19:53506) 2024-09-12T01:59:01.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.525+0000 7f18d1e8e640 1 -- 172.21.15.19:0/305852273 learned_addr learned my addr 172.21.15.19:0/305852273 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:01.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.525+0000 7f18d168d640 1 --2- 172.21.15.19:0/305852273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a1c530 0x562c70a1c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.525+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/305852273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a17c30 0x562c70a16b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.525+0000 7f18d1e8e640 1 -- 172.21.15.19:0/305852273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a17c30 msgr2=0x562c70a16b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.525+0000 7f18d1e8e640 1 --2- 172.21.15.19:0/305852273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a17c30 0x562c70a16b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.525+0000 7f18d1e8e640 1 -- 172.21.15.19:0/305852273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a1c530 msgr2=0x562c70a1c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.525+0000 7f18d1e8e640 1 --2- 172.21.15.19:0/305852273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a1c530 0x562c70a1c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.525+0000 7f18d1e8e640 1 -- 172.21.15.19:0/305852273 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c709e34c0 con 0x562c70a19cf0 2024-09-12T01:59:01.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.526+0000 7f18d1e8e640 1 --2- 172.21.15.19:0/305852273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a19cf0 0x562c70a17060 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f18c4001ec0 tx=0x7f18c40015d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84f14491e417be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.526+0000 7f18aeffd640 1 -- 172.21.15.19:0/305852273 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c400fe50 con 0x562c70a19cf0 2024-09-12T01:59:01.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.526+0000 7f18aeffd640 1 -- 172.21.15.19:0/305852273 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c4018070 con 0x562c70a19cf0 2024-09-12T01:59:01.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.526+0000 7f18aeffd640 1 -- 172.21.15.19:0/305852273 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c4003b70 con 0x562c70a19cf0 2024-09-12T01:59:01.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.526+0000 7f18d668e740 1 -- 172.21.15.19:0/305852273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a19cf0 msgr2=0x562c70a17060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.527+0000 7f18d668e740 1 --2- 172.21.15.19:0/305852273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a19cf0 0x562c70a17060 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f18c4001ec0 tx=0x7f18c40015d0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.527+0000 7f18d668e740 1 -- 172.21.15.19:0/305852273 shutdown_connections 2024-09-12T01:59:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.527+0000 7f18d668e740 1 --2- 172.21.15.19:0/305852273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a19cf0 0x562c70a17060 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.527+0000 7f18d668e740 1 --2- 172.21.15.19:0/305852273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a17c30 0x562c70a16b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.527+0000 7f18d668e740 1 --2- 172.21.15.19:0/305852273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a1c530 0x562c70a1c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.527+0000 7f18d668e740 1 -- 172.21.15.19:0/305852273 >> 172.21.15.19:0/305852273 conn(0x562c70a18cf0 msgr2=0x562c70a613b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.527+0000 7f18d668e740 1 -- 172.21.15.19:0/305852273 shutdown_connections 2024-09-12T01:59:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.527+0000 7f18d668e740 1 -- 172.21.15.19:0/305852273 wait complete. 2024-09-12T01:59:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.527+0000 7f18d668e740 1 -- start start 2024-09-12T01:59:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.527+0000 7f18d668e740 1 Processor -- start 2024-09-12T01:59:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.528+0000 7f18d668e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a19cf0 0x562c70a5bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.528+0000 7f18d668e740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a1c530 0x562c70a713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.528+0000 7f18d668e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a71920 0x562c70a62480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.528+0000 7f18d668e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562c70a46dc0 con 0x562c70a19cf0 2024-09-12T01:59:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.528+0000 7f18d668e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562c709084b0 con 0x562c70a71920 2024-09-12T01:59:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.528+0000 7f18d668e740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562c70a61ac0 con 0x562c70a1c530 2024-09-12T01:59:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.528+0000 7f18d668e740 10 client.0 _ll_register_callbacks cb 0x562c70904c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.528+0000 7f18d168d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a19cf0 0x562c70a5bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.528+0000 7f18d168d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a19cf0 0x562c70a5bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53514/0 (socket says 172.21.15.19:53514) 2024-09-12T01:59:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.528+0000 7f18d168d640 1 -- 172.21.15.19:0/742683963 learned_addr learned my addr 172.21.15.19:0/742683963 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.528+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/742683963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a1c530 0x562c70a713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.529+0000 7f18d1e8e640 1 --2- 172.21.15.19:0/742683963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a71920 0x562c70a62480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.529+0000 7f18d168d640 1 -- 172.21.15.19:0/742683963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a1c530 msgr2=0x562c70a713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.529+0000 7f18d168d640 1 --2- 172.21.15.19:0/742683963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a1c530 0x562c70a713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.529+0000 7f18d168d640 1 -- 172.21.15.19:0/742683963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a71920 msgr2=0x562c70a62480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.529+0000 7f18d168d640 1 --2- 172.21.15.19:0/742683963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a71920 0x562c70a62480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.529+0000 7f18d168d640 1 -- 172.21.15.19:0/742683963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c7075ea30 con 0x562c70a19cf0 2024-09-12T01:59:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.529+0000 7f18d168d640 1 --2- 172.21.15.19:0/742683963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a19cf0 0x562c70a5bc10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f18c80898f0 tx=0x7f18c8059720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1ead041d68b6eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.529+0000 7f18a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:59:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.529+0000 7f18a7fff640 1 -- 172.21.15.19:0/742683963 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8062250 con 0x562c70a19cf0 2024-09-12T01:59:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.529+0000 7f18a7fff640 1 -- 172.21.15.19:0/742683963 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7f18c805ebb0 con 0x562c70a19cf0 2024-09-12T01:59:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.529+0000 7f18d668e740 1 -- 172.21.15.19:0/742683963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18c4018070 con 0x562c70a19cf0 2024-09-12T01:59:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.529+0000 7f18a7fff640 1 -- 172.21.15.19:0/742683963 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f18c805edd0 con 0x562c70a19cf0 2024-09-12T01:59:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.529+0000 7f18d668e740 10 client.6198 fetch_fsmap learned FSMap version 49 2024-09-12T01:59:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.529+0000 7f18d668e740 1 -- 172.21.15.19:0/742683963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) -- 0x562c70692620 con 0x562c70a19cf0 2024-09-12T01:59:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.530+0000 7f18a7fff640 1 -- 172.21.15.19:0/742683963 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c4018070 con 0x562c70a19cf0 2024-09-12T01:59:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.530+0000 7f18a7fff640 1 -- 172.21.15.19:0/742683963 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 49) ==== 3502+0+0 (secure 0 0 0) 0x7f18c8013070 con 0x562c70a19cf0 2024-09-12T01:59:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.530+0000 7f18d668e740 10 client.6198 fetch_fsmap finished waiting for FSMap version 49 2024-09-12T01:59:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.530+0000 7f18d668e740 10 client.6198 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-12T01:59:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.530+0000 7f18d668e740 20 client.6198 populate_metadata read hostname 'smithi019' 2024-09-12T01:59:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.530+0000 7f18d668e740 1 --2- 172.21.15.19:0/742683963 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70a34500 0x562c70a37020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.530+0000 7f18d668e740 4 client.6198 mds_command: new command op to 6120 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:59:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.530+0000 7f18d668e740 1 -- 172.21.15.19:0/742683963 --> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c7098cd10 con 0x562c70a34500 2024-09-12T01:59:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.530+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/742683963 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70a34500 0x562c70a37020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.530+0000 7f18a7fff640 10 client.6198 ms_handle_connect on v2:172.21.15.19:6833/740310996 2024-09-12T01:59:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.530+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/742683963 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70a34500 0x562c70a37020 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed94c44c4d77a973 server_cookie=f9b961308c55bbcf in_seq=0 out_seq=0 2024-09-12T01:59:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.531+0000 7f18a7fff640 1 -- 172.21.15.19:0/742683963 <== mds.0 v2:172.21.15.19:6833/740310996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c7098cd10 con 0x562c70a34500 2024-09-12T01:59:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.531+0000 7f18a7fff640 10 client.6198 handle_command_reply: tid=0 2024-09-12T01:59:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.531+0000 7f18d668e740 1 client.6198 shutdown 2024-09-12T01:59:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.531+0000 7f18d668e740 1 -- 172.21.15.19:0/742683963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a19cf0 msgr2=0x562c70a5bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.531+0000 7f18d668e740 1 --2- 172.21.15.19:0/742683963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a19cf0 0x562c70a5bc10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f18c80898f0 tx=0x7f18c8059720 comp rx=0 tx=0).stop 2024-09-12T01:59:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.531+0000 7f18d668e740 1 -- 172.21.15.19:0/742683963 shutdown_connections 2024-09-12T01:59:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.531+0000 7f18d668e740 1 --2- 172.21.15.19:0/742683963 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70a34500 0x562c70a37020 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.531+0000 7f18d668e740 1 --2- 172.21.15.19:0/742683963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a71920 0x562c70a62480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.531+0000 7f18d668e740 1 --2- 172.21.15.19:0/742683963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a1c530 0x562c70a713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.531+0000 7f18d668e740 1 --2- 172.21.15.19:0/742683963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a19cf0 0x562c70a5bc10 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.531+0000 7f18d668e740 1 -- 172.21.15.19:0/742683963 >> 172.21.15.19:0/742683963 conn(0x562c70a17c30 msgr2=0x562c70a5f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:01.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.531+0000 7f18a7fff640 0 client.6198 ms_handle_reset on v2:172.21.15.19:6833/740310996 2024-09-12T01:59:01.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.532+0000 7f18d668e740 1 -- 172.21.15.19:0/742683963 shutdown_connections 2024-09-12T01:59:01.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.532+0000 7f18d668e740 1 -- 172.21.15.19:0/742683963 wait complete. 2024-09-12T01:59:01.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.532+0000 7f18d668e740 20 client.6198 trim_cache size 0 max 16384 2024-09-12T01:59:01.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.540+0000 7fcd3814b640 1 Processor -- start 2024-09-12T01:59:01.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.540+0000 7fcd3814b640 1 -- start start 2024-09-12T01:59:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd3814b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcd300cd080 0x7fcd300d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd3814b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd300d1780 0x7fcd300d2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd3814b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd300d07b0 con 0x7fcd3015f5d0 2024-09-12T01:59:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd3814b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fcd300d0a90 con 0x7fcd300cd080 2024-09-12T01:59:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd3814b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcd300d0d70 con 0x7fcd300d1780 2024-09-12T01:59:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd35ee7640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcd3015f5d0 0x7fcd300cc970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59502/0 (socket says 172.21.15.19:59502) 2024-09-12T01:59:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd35ee7640 1 -- 172.21.15.19:0/3557279511 learned_addr learned my addr 172.21.15.19:0/3557279511 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:59:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd34ee5640 1 -- 172.21.15.19:0/3557279511 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3220969972 0 0) 0x7fcd300d07b0 con 0x7fcd3015f5d0 2024-09-12T01:59:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd366e8640 1 --2- 172.21.15.19:0/3557279511 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd300d1780 0x7fcd300d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd356e6640 1 --2- 172.21.15.19:0/3557279511 >> v2:172.21.15.135:3300/0 conn(0x7fcd300cd080 0x7fcd300d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd34ee5640 1 -- 172.21.15.19:0/3557279511 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd1c003520 con 0x7fcd3015f5d0 2024-09-12T01:59:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd34ee5640 1 -- 172.21.15.19:0/3557279511 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 790062979 0 0) 0x7fcd1c003520 con 0x7fcd3015f5d0 2024-09-12T01:59:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd34ee5640 1 -- 172.21.15.19:0/3557279511 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd300d1780 msgr2=0x7fcd300d2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd34ee5640 1 --2- 172.21.15.19:0/3557279511 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd300d1780 0x7fcd300d2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd34ee5640 1 -- 172.21.15.19:0/3557279511 >> v2:172.21.15.135:3300/0 conn(0x7fcd300cd080 msgr2=0x7fcd300d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd34ee5640 1 --2- 172.21.15.19:0/3557279511 >> v2:172.21.15.135:3300/0 conn(0x7fcd300cd080 0x7fcd300d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd34ee5640 1 -- 172.21.15.19:0/3557279511 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd300d1050 con 0x7fcd3015f5d0 2024-09-12T01:59:01.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd34ee5640 1 -- 172.21.15.19:0/3557279511 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fcd2c001670 con 0x7fcd3015f5d0 2024-09-12T01:59:01.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.542+0000 7fcd34ee5640 1 -- 172.21.15.19:0/3557279511 >> v1:172.21.15.19:6789/0 conn(0x7fcd3015f5d0 legacy=0x7fcd300cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.543+0000 7fcd34ee5640 1 --2- 172.21.15.19:0/3557279511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd1c0039b0 0x7fcd1c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.543+0000 7fcd34ee5640 1 --2- 172.21.15.19:0/3557279511 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd300d1780 0x7fcd1c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.543+0000 7fcd34ee5640 1 --2- 172.21.15.19:0/3557279511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd1c004d40 0x7fcd1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.543+0000 7fcd34ee5640 1 -- 172.21.15.19:0/3557279511 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcd300d0a90 con 0x7fcd1c0039b0 2024-09-12T01:59:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.543+0000 7fcd34ee5640 1 -- 172.21.15.19:0/3557279511 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd300d0d70 con 0x7fcd1c004d40 2024-09-12T01:59:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.543+0000 7fcd34ee5640 1 -- 172.21.15.19:0/3557279511 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcd1c00b9c0 con 0x7fcd300d1780 2024-09-12T01:59:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.543+0000 7fcd35ee7640 1 --2- 172.21.15.19:0/3557279511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd1c0039b0 0x7fcd1c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.543+0000 7fcd356e6640 1 --2- 172.21.15.19:0/3557279511 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd300d1780 0x7fcd1c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.543+0000 7fcd366e8640 1 --2- 172.21.15.19:0/3557279511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd1c004d40 0x7fcd1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.543+0000 7fcd35ee7640 1 -- 172.21.15.19:0/3557279511 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd300d1780 msgr2=0x7fcd1c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.543+0000 7fcd35ee7640 1 --2- 172.21.15.19:0/3557279511 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd300d1780 0x7fcd1c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.543+0000 7fcd35ee7640 1 -- 172.21.15.19:0/3557279511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd1c004d40 msgr2=0x7fcd1c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.543+0000 7fcd35ee7640 1 --2- 172.21.15.19:0/3557279511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd1c004d40 0x7fcd1c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.543+0000 7fcd35ee7640 1 -- 172.21.15.19:0/3557279511 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1c003520 con 0x7fcd1c0039b0 2024-09-12T01:59:01.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.544+0000 7fcd35ee7640 1 --2- 172.21.15.19:0/3557279511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd1c0039b0 0x7fcd1c003dd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c007fd0 tx=0x7fcd1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f0d7e8be1c0735 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.544+0000 7fcd34ee5640 1 -- 172.21.15.19:0/3557279511 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c007d50 con 0x7fcd1c0039b0 2024-09-12T01:59:01.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.544+0000 7fcd34ee5640 1 -- 172.21.15.19:0/3557279511 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd2c005ad0 con 0x7fcd1c0039b0 2024-09-12T01:59:01.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.544+0000 7fcd34ee5640 1 -- 172.21.15.19:0/3557279511 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c007070 con 0x7fcd1c0039b0 2024-09-12T01:59:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.545+0000 7fcd3814b640 1 -- 172.21.15.19:0/3557279511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd1c0039b0 msgr2=0x7fcd1c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.545+0000 7fcd3814b640 1 --2- 172.21.15.19:0/3557279511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd1c0039b0 0x7fcd1c003dd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c007fd0 tx=0x7fcd1c005830 comp rx=0 tx=0).stop 2024-09-12T01:59:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.545+0000 7fcd366e8640 1 -- 172.21.15.19:0/3557279511 reap_dead start 2024-09-12T01:59:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.545+0000 7fcd3814b640 1 -- 172.21.15.19:0/3557279511 shutdown_connections 2024-09-12T01:59:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.545+0000 7fcd3814b640 1 -- 172.21.15.19:0/3557279511 >> 172.21.15.19:0/3557279511 conn(0x7fcd30067950 msgr2=0x7fcd30067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.545+0000 7fcd3814b640 1 -- 172.21.15.19:0/3557279511 shutdown_connections 2024-09-12T01:59:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.545+0000 7fcd3814b640 1 -- 172.21.15.19:0/3557279511 wait complete. 2024-09-12T01:59:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.546+0000 7fcd3814b640 1 Processor -- start 2024-09-12T01:59:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.547+0000 7fcd3814b640 1 -- start start 2024-09-12T01:59:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.547+0000 7fcd3814b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd1c0039b0 0x7fcd3015a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.547+0000 7fcd3814b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd3014e810 0x7fcd300cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.547+0000 7fcd3814b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd300cb9e0 0x7fcd301efe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.547+0000 7fcd3814b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcd300b5210 con 0x7fcd300cb9e0 2024-09-12T01:59:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.547+0000 7fcd3814b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd300d1330 con 0x7fcd1c0039b0 2024-09-12T01:59:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.547+0000 7fcd3814b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcd300b5390 con 0x7fcd3014e810 2024-09-12T01:59:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.548+0000 7fcd366e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd300cb9e0 0x7fcd301efe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.548+0000 7fcd366e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd300cb9e0 0x7fcd301efe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53526/0 (socket says 172.21.15.19:53526) 2024-09-12T01:59:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.548+0000 7fcd366e8640 1 -- 172.21.15.19:0/3774649179 learned_addr learned my addr 172.21.15.19:0/3774649179 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.548+0000 7fcd35ee7640 1 --2- 172.21.15.19:0/3774649179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd1c0039b0 0x7fcd3015a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.548+0000 7fcd356e6640 1 --2- 172.21.15.19:0/3774649179 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd3014e810 0x7fcd300cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.548+0000 7fcd366e8640 1 -- 172.21.15.19:0/3774649179 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd3014e810 msgr2=0x7fcd300cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.548+0000 7fcd366e8640 1 --2- 172.21.15.19:0/3774649179 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd3014e810 0x7fcd300cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.548+0000 7fcd366e8640 1 -- 172.21.15.19:0/3774649179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd1c0039b0 msgr2=0x7fcd3015a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.548+0000 7fcd366e8640 1 --2- 172.21.15.19:0/3774649179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd1c0039b0 0x7fcd3015a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.548+0000 7fcd366e8640 1 -- 172.21.15.19:0/3774649179 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3014ec90 con 0x7fcd300cb9e0 2024-09-12T01:59:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.548+0000 7fcd35ee7640 1 --2- 172.21.15.19:0/3774649179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd1c0039b0 0x7fcd3015a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.548+0000 7fcd366e8640 1 --2- 172.21.15.19:0/3774649179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd300cb9e0 0x7fcd301efe60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fcd300cf7a0 tx=0x7fcd2800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.548+0000 7fcd267fc640 1 -- 172.21.15.19:0/3774649179 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2800fce0 con 0x7fcd300cb9e0 2024-09-12T01:59:01.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.548+0000 7fcd267fc640 1 -- 172.21.15.19:0/3774649179 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd2800fe80 con 0x7fcd300cb9e0 2024-09-12T01:59:01.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.548+0000 7fcd3814b640 1 -- 172.21.15.19:0/3774649179 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd3015b930 con 0x7fcd300cb9e0 2024-09-12T01:59:01.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.548+0000 7fcd267fc640 1 -- 172.21.15.19:0/3774649179 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd28015670 con 0x7fcd300cb9e0 2024-09-12T01:59:01.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.548+0000 7fcd3814b640 1 -- 172.21.15.19:0/3774649179 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd3015ae90 con 0x7fcd300cb9e0 2024-09-12T01:59:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.549+0000 7fcd3814b640 1 -- 172.21.15.19:0/3774649179 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fcd3015f9b0 con 0x7fcd300cb9e0 2024-09-12T01:59:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.550+0000 7fcd267fc640 1 -- 172.21.15.19:0/3774649179 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd28015810 con 0x7fcd300cb9e0 2024-09-12T01:59:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.551+0000 7fcd267fc640 1 --2- 172.21.15.19:0/3774649179 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd1406be60 0x7fcd1406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.551+0000 7fcd267fc640 1 -- 172.21.15.19:0/3774649179 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7fcd2808bd60 con 0x7fcd300cb9e0 2024-09-12T01:59:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.551+0000 7fcd35ee7640 1 --2- 172.21.15.19:0/3774649179 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd1406be60 0x7fcd1406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.551+0000 7fcd267fc640 1 -- 172.21.15.19:0/3774649179 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+513 (secure 0 0 0) 0x7fcd28019030 con 0x7fcd300cb9e0 2024-09-12T01:59:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.551+0000 7fcd3814b640 1 -- 172.21.15.19:0/3774649179 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7fcd300b2120 con 0x7fcd300cb9e0 2024-09-12T01:59:01.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.551+0000 7fcd35ee7640 1 --2- 172.21.15.19:0/3774649179 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd1406be60 0x7fcd1406e320 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c033000 tx=0x7fcd2c009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.552+0000 7fcd267fc640 1 -- 172.21.15.19:0/3774649179 <== mon.0 v2:172.21.15.19:3300/0 7 ==== log(1 entries from seq 603 at 2024-09-12T01:59:00.492641+0000) ==== 309+0+0 (secure 0 0 0) 0x7fcd2808a150 con 0x7fcd300cb9e0 2024-09-12T01:59:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.553+0000 7f18d668e740 1 Processor -- start 2024-09-12T01:59:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.553+0000 7f18d668e740 1 -- start start 2024-09-12T01:59:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.553+0000 7f18d668e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a19cf0 0x562c70a462b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.553+0000 7f18d668e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a1c530 0x562c70a46b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.553+0000 7f18d668e740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a71920 0x562c70ad8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.553+0000 7f18d668e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc201560 con 0x562c70a1c530 2024-09-12T01:59:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.553+0000 7f18d668e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc200540 con 0x562c70a19cf0 2024-09-12T01:59:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.553+0000 7f18d668e740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f18cc1ff850 con 0x562c70a71920 2024-09-12T01:59:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.553+0000 7f18d0e8c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a1c530 0x562c70a46b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.554+0000 7f18d0e8c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a1c530 0x562c70a46b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53528/0 (socket says 172.21.15.19:53528) 2024-09-12T01:59:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.554+0000 7f18d0e8c640 1 -- 172.21.15.19:0/1375438577 learned_addr learned my addr 172.21.15.19:0/1375438577 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.554+0000 7f18d168d640 1 --2- 172.21.15.19:0/1375438577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a19cf0 0x562c70a462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.554+0000 7f18d1e8e640 1 --2- 172.21.15.19:0/1375438577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a71920 0x562c70ad8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.554+0000 7f18d0e8c640 1 -- 172.21.15.19:0/1375438577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a71920 msgr2=0x562c70ad8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.554+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/1375438577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a71920 0x562c70ad8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.554+0000 7f18d0e8c640 1 -- 172.21.15.19:0/1375438577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a19cf0 msgr2=0x562c70a462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.554+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/1375438577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a19cf0 0x562c70a462b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.554+0000 7f18d0e8c640 1 -- 172.21.15.19:0/1375438577 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c70a38b90 con 0x562c70a1c530 2024-09-12T01:59:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.554+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/1375438577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a1c530 0x562c70a46b00 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f18bc02a790 tx=0x7f18bc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f24bdf58dd48f2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.554+0000 7f18ae7fc640 1 -- 172.21.15.19:0/1375438577 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc005cd0 con 0x562c70a1c530 2024-09-12T01:59:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.554+0000 7f18ae7fc640 1 -- 172.21.15.19:0/1375438577 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18bc003610 con 0x562c70a1c530 2024-09-12T01:59:01.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.554+0000 7f18ae7fc640 1 -- 172.21.15.19:0/1375438577 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc0037c0 con 0x562c70a1c530 2024-09-12T01:59:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.555+0000 7f18d668e740 1 -- 172.21.15.19:0/1375438577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a1c530 msgr2=0x562c70a46b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.555+0000 7f18d668e740 1 --2- 172.21.15.19:0/1375438577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a1c530 0x562c70a46b00 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f18bc02a790 tx=0x7f18bc02c000 comp rx=0 tx=0).stop 2024-09-12T01:59:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.555+0000 7f18d668e740 1 -- 172.21.15.19:0/1375438577 shutdown_connections 2024-09-12T01:59:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.555+0000 7f18d668e740 1 --2- 172.21.15.19:0/1375438577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a71920 0x562c70ad8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.555+0000 7f18d668e740 1 --2- 172.21.15.19:0/1375438577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a1c530 0x562c70a46b00 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.555+0000 7f18d668e740 1 --2- 172.21.15.19:0/1375438577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a19cf0 0x562c70a462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.555+0000 7f18d668e740 1 -- 172.21.15.19:0/1375438577 >> 172.21.15.19:0/1375438577 conn(0x562c70a17c30 msgr2=0x562c70a648c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.555+0000 7f18d668e740 1 -- 172.21.15.19:0/1375438577 shutdown_connections 2024-09-12T01:59:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.555+0000 7f18d668e740 1 -- 172.21.15.19:0/1375438577 wait complete. 2024-09-12T01:59:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.555+0000 7f18d668e740 1 -- start start 2024-09-12T01:59:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.556+0000 7f18d668e740 1 Processor -- start 2024-09-12T01:59:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.556+0000 7f18d668e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a19cf0 0x562c70ad3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.556+0000 7f18d668e740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a1c530 0x562c70a60fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18d668e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a71920 0x562c70a61500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18d668e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562c70a47040 con 0x562c70a19cf0 2024-09-12T01:59:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18d668e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc1ffea0 con 0x562c70a71920 2024-09-12T01:59:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18d668e740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562c70a5ef20 con 0x562c70a1c530 2024-09-12T01:59:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18d668e740 10 client.0 _ll_register_callbacks cb 0x7f18c80559c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18d168d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a19cf0 0x562c70ad3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18d168d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a19cf0 0x562c70ad3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53530/0 (socket says 172.21.15.19:53530) 2024-09-12T01:59:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18d168d640 1 -- 172.21.15.19:0/3864360722 learned_addr learned my addr 172.21.15.19:0/3864360722 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a1c530 0x562c70a60fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18d1e8e640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a71920 0x562c70a61500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18d168d640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a1c530 msgr2=0x562c70a60fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18d168d640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562c70a1c530 0x562c70a60fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18d168d640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a71920 msgr2=0x562c70a61500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18d168d640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c70a71920 0x562c70a61500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18d168d640 1 -- 172.21.15.19:0/3864360722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c70652320 con 0x562c70a19cf0 2024-09-12T01:59:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18d168d640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562c70a19cf0 0x562c70ad3050 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f18c800d800 tx=0x7f18c8020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8ca355223e74c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:59:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18a7fff640 1 -- 172.21.15.19:0/3864360722 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8075050 con 0x562c70a19cf0 2024-09-12T01:59:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18a7fff640 1 -- 172.21.15.19:0/3864360722 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7f18c8058b70 con 0x562c70a19cf0 2024-09-12T01:59:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18d668e740 1 -- 172.21.15.19:0/3864360722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18bc003610 con 0x562c70a19cf0 2024-09-12T01:59:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.557+0000 7f18a7fff640 1 -- 172.21.15.19:0/3864360722 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f18c8062250 con 0x562c70a19cf0 2024-09-12T01:59:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.558+0000 7f18d668e740 10 client.6210 fetch_fsmap learned FSMap version 49 2024-09-12T01:59:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.558+0000 7f18d668e740 1 -- 172.21.15.19:0/3864360722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) -- 0x562c70a5e560 con 0x562c70a19cf0 2024-09-12T01:59:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.558+0000 7f18a7fff640 1 -- 172.21.15.19:0/3864360722 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18bc003610 con 0x562c70a19cf0 2024-09-12T01:59:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.558+0000 7f18a7fff640 1 -- 172.21.15.19:0/3864360722 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 49) ==== 3502+0+0 (secure 0 0 0) 0x7f18c8078070 con 0x562c70a19cf0 2024-09-12T01:59:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.558+0000 7f18d668e740 10 client.6210 fetch_fsmap finished waiting for FSMap version 49 2024-09-12T01:59:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.558+0000 7f18d668e740 10 client.6210 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-12T01:59:01.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.558+0000 7f18d668e740 20 client.6210 populate_metadata read hostname 'smithi019' 2024-09-12T01:59:01.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.558+0000 7f18d668e740 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.558+0000 7f18d668e740 4 client.6210 mds_command: new command op to 6120 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:59:01.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.558+0000 7f18d668e740 1 -- 172.21.15.19:0/3864360722 --> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562c70987060 con 0x562c70ad36f0 2024-09-12T01:59:01.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.558+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.558+0000 7f18a7fff640 10 client.6210 ms_handle_connect on v2:172.21.15.19:6833/740310996 2024-09-12T01:59:01.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.559+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4162a2545fcd9ca server_cookie=b5bf0febce6325d6 in_seq=0 out_seq=0 2024-09-12T01:59:01.564 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T01:59:01.561+0000 7f7a53a82640 -1 mds.0.cache.den(0x1 a) newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x5613d5294f00] 2024-09-12T01:59:01.564 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T01:59:01.561+0000 7f7a53a82640 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x5613d5294f00] 2024-09-12T01:59:01.564 INFO:tasks.ceph.mds.c.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.1-298-gb53b6d3e/rpm/el9/BUILD/ceph-19.1.1-298-gb53b6d3e/src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7f7a53a82640 time 2024-09-12T01:59:01.561545+0000 2024-09-12T01:59:01.564 INFO:tasks.ceph.mds.c.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.1-298-gb53b6d3e/rpm/el9/BUILD/ceph-19.1.1-298-gb53b6d3e/src/mds/MDSRank.cc: 952: ceph_abort_msg("abort() called") 2024-09-12T01:59:01.564 INFO:tasks.ceph.mds.c.smithi019.stderr: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T01:59:01.565 INFO:tasks.ceph.mds.c.smithi019.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7f7a5ff83417] 2024-09-12T01:59:01.565 INFO:tasks.ceph.mds.c.smithi019.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x5613d2e502d1] 2024-09-12T01:59:01.565 INFO:tasks.ceph.mds.c.smithi019.stderr: 3: (CDentry::check_corruption(bool)+0x4d4) [0x5613d307b4e4] 2024-09-12T01:59:01.565 INFO:tasks.ceph.mds.c.smithi019.stderr: 4: ceph-mds(+0x3cd2fc) [0x5613d30952fc] 2024-09-12T01:59:01.565 INFO:tasks.ceph.mds.c.smithi019.stderr: 5: (CDir::_omap_commit(int)+0x93a) [0x5613d3096c2a] 2024-09-12T01:59:01.565 INFO:tasks.ceph.mds.c.smithi019.stderr: 6: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x265) [0x5613d3098205] 2024-09-12T01:59:01.565 INFO:tasks.ceph.mds.c.smithi019.stderr: 7: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xaf7) [0x5613d2e9d417] 2024-09-12T01:59:01.565 INFO:tasks.ceph.mds.c.smithi019.stderr: 8: (MDLog::try_expire(LogSegment*, int)+0x62) [0x5613d311c4d2] 2024-09-12T01:59:01.565 INFO:tasks.ceph.mds.c.smithi019.stderr: 9: (MDLog::trim_all()+0x769) [0x5613d311f399] 2024-09-12T01:59:01.565 INFO:tasks.ceph.mds.c.smithi019.stderr: 10: ceph-mds(+0x1bfd71) [0x5613d2e87d71] 2024-09-12T01:59:01.565 INFO:tasks.ceph.mds.c.smithi019.stderr: 11: ceph-mds(+0x16033d) [0x5613d2e2833d] 2024-09-12T01:59:01.565 INFO:tasks.ceph.mds.c.smithi019.stderr: 12: (MDSContext::complete(int)+0x5c) [0x5613d31148ec] 2024-09-12T01:59:01.565 INFO:tasks.ceph.mds.c.smithi019.stderr: 13: ceph-mds(+0x160602) [0x5613d2e28602] 2024-09-12T01:59:01.565 INFO:tasks.ceph.mds.c.smithi019.stderr: 14: (MDSContext::complete(int)+0x5c) [0x5613d31148ec] 2024-09-12T01:59:01.566 INFO:tasks.ceph.mds.c.smithi019.stderr: 15: (MDSIOContextBase::complete(int)+0x31c) [0x5613d3114d3c] 2024-09-12T01:59:01.566 INFO:tasks.ceph.mds.c.smithi019.stderr: 16: (Finisher::finisher_thread_entry()+0x175) [0x7f7a60041b65] 2024-09-12T01:59:01.566 INFO:tasks.ceph.mds.c.smithi019.stderr: 17: /lib64/libc.so.6(+0x89c52) [0x7f7a5f689c52] 2024-09-12T01:59:01.566 INFO:tasks.ceph.mds.c.smithi019.stderr: 18: /lib64/libc.so.6(+0x10ec80) [0x7f7a5f70ec80] 2024-09-12T01:59:01.566 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T01:59:01.562+0000 7f7a53a82640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.1-298-gb53b6d3e/rpm/el9/BUILD/ceph-19.1.1-298-gb53b6d3e/src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7f7a53a82640 time 2024-09-12T01:59:01.561545+0000 2024-09-12T01:59:01.566 INFO:tasks.ceph.mds.c.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.1-298-gb53b6d3e/rpm/el9/BUILD/ceph-19.1.1-298-gb53b6d3e/src/mds/MDSRank.cc: 952: ceph_abort_msg("abort() called") 2024-09-12T01:59:01.566 INFO:tasks.ceph.mds.c.smithi019.stderr: 2024-09-12T01:59:01.566 INFO:tasks.ceph.mds.c.smithi019.stderr: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T01:59:01.566 INFO:tasks.ceph.mds.c.smithi019.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7f7a5ff83417] 2024-09-12T01:59:01.566 INFO:tasks.ceph.mds.c.smithi019.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x5613d2e502d1] 2024-09-12T01:59:01.566 INFO:tasks.ceph.mds.c.smithi019.stderr: 3: (CDentry::check_corruption(bool)+0x4d4) [0x5613d307b4e4] 2024-09-12T01:59:01.566 INFO:tasks.ceph.mds.c.smithi019.stderr: 4: ceph-mds(+0x3cd2fc) [0x5613d30952fc] 2024-09-12T01:59:01.566 INFO:tasks.ceph.mds.c.smithi019.stderr: 5: (CDir::_omap_commit(int)+0x93a) [0x5613d3096c2a] 2024-09-12T01:59:01.567 INFO:tasks.ceph.mds.c.smithi019.stderr: 6: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x265) [0x5613d3098205] 2024-09-12T01:59:01.568 INFO:tasks.ceph.mds.c.smithi019.stderr: 7: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xaf7) [0x5613d2e9d417] 2024-09-12T01:59:01.568 INFO:tasks.ceph.mds.c.smithi019.stderr: 8: (MDLog::try_expire(LogSegment*, int)+0x62) [0x5613d311c4d2] 2024-09-12T01:59:01.568 INFO:tasks.ceph.mds.c.smithi019.stderr: 9: (MDLog::trim_all()+0x769) [0x5613d311f399] 2024-09-12T01:59:01.568 INFO:tasks.ceph.mds.c.smithi019.stderr: 10: ceph-mds(+0x1bfd71) [0x5613d2e87d71] 2024-09-12T01:59:01.568 INFO:tasks.ceph.mds.c.smithi019.stderr: 11: ceph-mds(+0x16033d) [0x5613d2e2833d] 2024-09-12T01:59:01.568 INFO:tasks.ceph.mds.c.smithi019.stderr: 12: (MDSContext::complete(int)+0x5c) [0x5613d31148ec] 2024-09-12T01:59:01.568 INFO:tasks.ceph.mds.c.smithi019.stderr: 13: ceph-mds(+0x160602) [0x5613d2e28602] 2024-09-12T01:59:01.568 INFO:tasks.ceph.mds.c.smithi019.stderr: 14: (MDSContext::complete(int)+0x5c) [0x5613d31148ec] 2024-09-12T01:59:01.568 INFO:tasks.ceph.mds.c.smithi019.stderr: 15: (MDSIOContextBase::complete(int)+0x31c) [0x5613d3114d3c] 2024-09-12T01:59:01.568 INFO:tasks.ceph.mds.c.smithi019.stderr: 16: (Finisher::finisher_thread_entry()+0x175) [0x7f7a60041b65] 2024-09-12T01:59:01.569 INFO:tasks.ceph.mds.c.smithi019.stderr: 17: /lib64/libc.so.6(+0x89c52) [0x7f7a5f689c52] 2024-09-12T01:59:01.569 INFO:tasks.ceph.mds.c.smithi019.stderr: 18: /lib64/libc.so.6(+0x10ec80) [0x7f7a5f70ec80] 2024-09-12T01:59:01.569 INFO:tasks.ceph.mds.c.smithi019.stderr: 2024-09-12T01:59:01.569 INFO:tasks.ceph.mds.c.smithi019.stderr:*** Caught signal (Aborted) ** 2024-09-12T01:59:01.569 INFO:tasks.ceph.mds.c.smithi019.stderr: in thread 7f7a53a82640 thread_name:MR_Finisher 2024-09-12T01:59:01.569 INFO:tasks.ceph.mds.c.smithi019.stderr: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T01:59:01.569 INFO:tasks.ceph.mds.c.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7a5f63e6f0] 2024-09-12T01:59:01.569 INFO:tasks.ceph.mds.c.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7a5f68b99c] 2024-09-12T01:59:01.569 INFO:tasks.ceph.mds.c.smithi019.stderr: 3: raise() 2024-09-12T01:59:01.569 INFO:tasks.ceph.mds.c.smithi019.stderr: 4: abort() 2024-09-12T01:59:01.569 INFO:tasks.ceph.mds.c.smithi019.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7f7a5ff834d4] 2024-09-12T01:59:01.569 INFO:tasks.ceph.mds.c.smithi019.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x5613d2e502d1] 2024-09-12T01:59:01.569 INFO:tasks.ceph.mds.c.smithi019.stderr: 7: (CDentry::check_corruption(bool)+0x4d4) [0x5613d307b4e4] 2024-09-12T01:59:01.569 INFO:tasks.ceph.mds.c.smithi019.stderr: 8: ceph-mds(+0x3cd2fc) [0x5613d30952fc] 2024-09-12T01:59:01.570 INFO:tasks.ceph.mds.c.smithi019.stderr: 9: (CDir::_omap_commit(int)+0x93a) [0x5613d3096c2a] 2024-09-12T01:59:01.570 INFO:tasks.ceph.mds.c.smithi019.stderr: 10: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x265) [0x5613d3098205] 2024-09-12T01:59:01.570 INFO:tasks.ceph.mds.c.smithi019.stderr: 11: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xaf7) [0x5613d2e9d417] 2024-09-12T01:59:01.570 INFO:tasks.ceph.mds.c.smithi019.stderr: 12: (MDLog::try_expire(LogSegment*, int)+0x62) [0x5613d311c4d2] 2024-09-12T01:59:01.570 INFO:tasks.ceph.mds.c.smithi019.stderr: 13: (MDLog::trim_all()+0x769) [0x5613d311f399] 2024-09-12T01:59:01.570 INFO:tasks.ceph.mds.c.smithi019.stderr: 14: ceph-mds(+0x1bfd71) [0x5613d2e87d71] 2024-09-12T01:59:01.570 INFO:tasks.ceph.mds.c.smithi019.stderr: 15: ceph-mds(+0x16033d) [0x5613d2e2833d] 2024-09-12T01:59:01.570 INFO:tasks.ceph.mds.c.smithi019.stderr: 16: (MDSContext::complete(int)+0x5c) [0x5613d31148ec] 2024-09-12T01:59:01.570 INFO:tasks.ceph.mds.c.smithi019.stderr: 17: ceph-mds(+0x160602) [0x5613d2e28602] 2024-09-12T01:59:01.570 INFO:tasks.ceph.mds.c.smithi019.stderr: 18: (MDSContext::complete(int)+0x5c) [0x5613d31148ec] 2024-09-12T01:59:01.570 INFO:tasks.ceph.mds.c.smithi019.stderr: 19: (MDSIOContextBase::complete(int)+0x31c) [0x5613d3114d3c] 2024-09-12T01:59:01.570 INFO:tasks.ceph.mds.c.smithi019.stderr: 20: (Finisher::finisher_thread_entry()+0x175) [0x7f7a60041b65] 2024-09-12T01:59:01.570 INFO:tasks.ceph.mds.c.smithi019.stderr: 21: /lib64/libc.so.6(+0x89c52) [0x7f7a5f689c52] 2024-09-12T01:59:01.570 INFO:tasks.ceph.mds.c.smithi019.stderr: 22: /lib64/libc.so.6(+0x10ec80) [0x7f7a5f70ec80] 2024-09-12T01:59:01.571 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T01:59:01.563+0000 7f7a53a82640 -1 *** Caught signal (Aborted) ** 2024-09-12T01:59:01.571 INFO:tasks.ceph.mds.c.smithi019.stderr: in thread 7f7a53a82640 thread_name:MR_Finisher 2024-09-12T01:59:01.571 INFO:tasks.ceph.mds.c.smithi019.stderr: 2024-09-12T01:59:01.571 INFO:tasks.ceph.mds.c.smithi019.stderr: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T01:59:01.571 INFO:tasks.ceph.mds.c.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7a5f63e6f0] 2024-09-12T01:59:01.571 INFO:tasks.ceph.mds.c.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7a5f68b99c] 2024-09-12T01:59:01.571 INFO:tasks.ceph.mds.c.smithi019.stderr: 3: raise() 2024-09-12T01:59:01.571 INFO:tasks.ceph.mds.c.smithi019.stderr: 4: abort() 2024-09-12T01:59:01.571 INFO:tasks.ceph.mds.c.smithi019.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7f7a5ff834d4] 2024-09-12T01:59:01.571 INFO:tasks.ceph.mds.c.smithi019.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x5613d2e502d1] 2024-09-12T01:59:01.571 INFO:tasks.ceph.mds.c.smithi019.stderr: 7: (CDentry::check_corruption(bool)+0x4d4) [0x5613d307b4e4] 2024-09-12T01:59:01.571 INFO:tasks.ceph.mds.c.smithi019.stderr: 8: ceph-mds(+0x3cd2fc) [0x5613d30952fc] 2024-09-12T01:59:01.571 INFO:tasks.ceph.mds.c.smithi019.stderr: 9: (CDir::_omap_commit(int)+0x93a) [0x5613d3096c2a] 2024-09-12T01:59:01.571 INFO:tasks.ceph.mds.c.smithi019.stderr: 10: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x265) [0x5613d3098205] 2024-09-12T01:59:01.572 INFO:tasks.ceph.mds.c.smithi019.stderr: 11: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xaf7) [0x5613d2e9d417] 2024-09-12T01:59:01.572 INFO:tasks.ceph.mds.c.smithi019.stderr: 12: (MDLog::try_expire(LogSegment*, int)+0x62) [0x5613d311c4d2] 2024-09-12T01:59:01.572 INFO:tasks.ceph.mds.c.smithi019.stderr: 13: (MDLog::trim_all()+0x769) [0x5613d311f399] 2024-09-12T01:59:01.572 INFO:tasks.ceph.mds.c.smithi019.stderr: 14: ceph-mds(+0x1bfd71) [0x5613d2e87d71] 2024-09-12T01:59:01.572 INFO:tasks.ceph.mds.c.smithi019.stderr: 15: ceph-mds(+0x16033d) [0x5613d2e2833d] 2024-09-12T01:59:01.572 INFO:tasks.ceph.mds.c.smithi019.stderr: 16: (MDSContext::complete(int)+0x5c) [0x5613d31148ec] 2024-09-12T01:59:01.572 INFO:tasks.ceph.mds.c.smithi019.stderr: 17: ceph-mds(+0x160602) [0x5613d2e28602] 2024-09-12T01:59:01.572 INFO:tasks.ceph.mds.c.smithi019.stderr: 18: (MDSContext::complete(int)+0x5c) [0x5613d31148ec] 2024-09-12T01:59:01.572 INFO:tasks.ceph.mds.c.smithi019.stderr: 19: (MDSIOContextBase::complete(int)+0x31c) [0x5613d3114d3c] 2024-09-12T01:59:01.572 INFO:tasks.ceph.mds.c.smithi019.stderr: 20: (Finisher::finisher_thread_entry()+0x175) [0x7f7a60041b65] 2024-09-12T01:59:01.572 INFO:tasks.ceph.mds.c.smithi019.stderr: 21: /lib64/libc.so.6(+0x89c52) [0x7f7a5f689c52] 2024-09-12T01:59:01.572 INFO:tasks.ceph.mds.c.smithi019.stderr: 22: /lib64/libc.so.6(+0x10ec80) [0x7f7a5f70ec80] 2024-09-12T01:59:01.572 INFO:tasks.ceph.mds.c.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T01:59:01.572 INFO:tasks.ceph.mds.c.smithi019.stderr: 2024-09-12T01:59:01.573 INFO:teuthology.orchestra.run.smithi019.stdout:{"mds_beacon_grace":"15.000000"} 2024-09-12T01:59:01.574 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2024-09-12T01:59:01.574 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:59:01.575 INFO:tasks.ceph.mds.c.smithi019.stderr: -191> 2024-09-12T01:59:00.349+0000 7f7a57a8a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:59:01.575 INFO:tasks.ceph.mds.c.smithi019.stderr: -11> 2024-09-12T01:59:01.561+0000 7f7a53a82640 -1 mds.0.cache.den(0x1 a) newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x5613d5294f00] 2024-09-12T01:59:01.575 INFO:tasks.ceph.mds.c.smithi019.stderr: -9> 2024-09-12T01:59:01.561+0000 7f7a53a82640 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x5613d5294f00] 2024-09-12T01:59:01.575 INFO:tasks.ceph.mds.c.smithi019.stderr: -3> 2024-09-12T01:59:01.562+0000 7f7a53a82640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.1-298-gb53b6d3e/rpm/el9/BUILD/ceph-19.1.1-298-gb53b6d3e/src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7f7a53a82640 time 2024-09-12T01:59:01.561545+0000 2024-09-12T01:59:01.575 INFO:tasks.ceph.mds.c.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.1-298-gb53b6d3e/rpm/el9/BUILD/ceph-19.1.1-298-gb53b6d3e/src/mds/MDSRank.cc: 952: ceph_abort_msg("abort() called") 2024-09-12T01:59:01.575 INFO:tasks.ceph.mds.c.smithi019.stderr: 2024-09-12T01:59:01.575 INFO:tasks.ceph.mds.c.smithi019.stderr: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T01:59:01.575 INFO:tasks.ceph.mds.c.smithi019.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7f7a5ff83417] 2024-09-12T01:59:01.576 INFO:tasks.ceph.mds.c.smithi019.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x5613d2e502d1] 2024-09-12T01:59:01.576 INFO:tasks.ceph.mds.c.smithi019.stderr: 3: (CDentry::check_corruption(bool)+0x4d4) [0x5613d307b4e4] 2024-09-12T01:59:01.576 INFO:tasks.ceph.mds.c.smithi019.stderr: 4: ceph-mds(+0x3cd2fc) [0x5613d30952fc] 2024-09-12T01:59:01.576 INFO:tasks.ceph.mds.c.smithi019.stderr: 5: (CDir::_omap_commit(int)+0x93a) [0x5613d3096c2a] 2024-09-12T01:59:01.576 INFO:tasks.ceph.mds.c.smithi019.stderr: 6: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x265) [0x5613d3098205] 2024-09-12T01:59:01.576 INFO:tasks.ceph.mds.c.smithi019.stderr: 7: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xaf7) [0x5613d2e9d417] 2024-09-12T01:59:01.576 INFO:tasks.ceph.mds.c.smithi019.stderr: 8: (MDLog::try_expire(LogSegment*, int)+0x62) [0x5613d311c4d2] 2024-09-12T01:59:01.576 INFO:tasks.ceph.mds.c.smithi019.stderr: 9: (MDLog::trim_all()+0x769) [0x5613d311f399] 2024-09-12T01:59:01.576 INFO:tasks.ceph.mds.c.smithi019.stderr: 10: ceph-mds(+0x1bfd71) [0x5613d2e87d71] 2024-09-12T01:59:01.576 INFO:tasks.ceph.mds.c.smithi019.stderr: 11: ceph-mds(+0x16033d) [0x5613d2e2833d] 2024-09-12T01:59:01.576 INFO:tasks.ceph.mds.c.smithi019.stderr: 12: (MDSContext::complete(int)+0x5c) [0x5613d31148ec] 2024-09-12T01:59:01.576 INFO:tasks.ceph.mds.c.smithi019.stderr: 13: ceph-mds(+0x160602) [0x5613d2e28602] 2024-09-12T01:59:01.576 INFO:tasks.ceph.mds.c.smithi019.stderr: 14: (MDSContext::complete(int)+0x5c) [0x5613d31148ec] 2024-09-12T01:59:01.577 INFO:tasks.ceph.mds.c.smithi019.stderr: 15: (MDSIOContextBase::complete(int)+0x31c) [0x5613d3114d3c] 2024-09-12T01:59:01.577 INFO:tasks.ceph.mds.c.smithi019.stderr: 16: (Finisher::finisher_thread_entry()+0x175) [0x7f7a60041b65] 2024-09-12T01:59:01.577 INFO:tasks.ceph.mds.c.smithi019.stderr: 17: /lib64/libc.so.6(+0x89c52) [0x7f7a5f689c52] 2024-09-12T01:59:01.577 INFO:tasks.ceph.mds.c.smithi019.stderr: 18: /lib64/libc.so.6(+0x10ec80) [0x7f7a5f70ec80] 2024-09-12T01:59:01.577 INFO:tasks.ceph.mds.c.smithi019.stderr: 2024-09-12T01:59:01.577 INFO:tasks.ceph.mds.c.smithi019.stderr: 0> 2024-09-12T01:59:01.563+0000 7f7a53a82640 -1 *** Caught signal (Aborted) ** 2024-09-12T01:59:01.577 INFO:tasks.ceph.mds.c.smithi019.stderr: in thread 7f7a53a82640 thread_name:MR_Finisher 2024-09-12T01:59:01.577 INFO:tasks.ceph.mds.c.smithi019.stderr: 2024-09-12T01:59:01.577 INFO:tasks.ceph.mds.c.smithi019.stderr: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T01:59:01.577 INFO:tasks.ceph.mds.c.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7a5f63e6f0] 2024-09-12T01:59:01.577 INFO:tasks.ceph.mds.c.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7a5f68b99c] 2024-09-12T01:59:01.577 INFO:tasks.ceph.mds.c.smithi019.stderr: 3: raise() 2024-09-12T01:59:01.577 INFO:tasks.ceph.mds.c.smithi019.stderr: 4: abort() 2024-09-12T01:59:01.578 INFO:tasks.ceph.mds.c.smithi019.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7f7a5ff834d4] 2024-09-12T01:59:01.578 INFO:tasks.ceph.mds.c.smithi019.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x5613d2e502d1] 2024-09-12T01:59:01.578 INFO:tasks.ceph.mds.c.smithi019.stderr: 7: (CDentry::check_corruption(bool)+0x4d4) [0x5613d307b4e4] 2024-09-12T01:59:01.578 INFO:tasks.ceph.mds.c.smithi019.stderr: 8: ceph-mds(+0x3cd2fc) [0x5613d30952fc] 2024-09-12T01:59:01.578 INFO:tasks.ceph.mds.c.smithi019.stderr: 9: (CDir::_omap_commit(int)+0x93a) [0x5613d3096c2a] 2024-09-12T01:59:01.578 INFO:tasks.ceph.mds.c.smithi019.stderr: 10: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x265) [0x5613d3098205] 2024-09-12T01:59:01.578 INFO:tasks.ceph.mds.c.smithi019.stderr: 11: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xaf7) [0x5613d2e9d417] 2024-09-12T01:59:01.578 INFO:tasks.ceph.mds.c.smithi019.stderr: 12: (MDLog::try_expire(LogSegment*, int)+0x62) [0x5613d311c4d2] 2024-09-12T01:59:01.578 INFO:tasks.ceph.mds.c.smithi019.stderr: 13: (MDLog::trim_all()+0x769) [0x5613d311f399] 2024-09-12T01:59:01.578 INFO:tasks.ceph.mds.c.smithi019.stderr: 14: ceph-mds(+0x1bfd71) [0x5613d2e87d71] 2024-09-12T01:59:01.578 INFO:tasks.ceph.mds.c.smithi019.stderr: 15: ceph-mds(+0x16033d) [0x5613d2e2833d] 2024-09-12T01:59:01.578 INFO:tasks.ceph.mds.c.smithi019.stderr: 16: (MDSContext::complete(int)+0x5c) [0x5613d31148ec] 2024-09-12T01:59:01.578 INFO:tasks.ceph.mds.c.smithi019.stderr: 17: ceph-mds(+0x160602) [0x5613d2e28602] 2024-09-12T01:59:01.578 INFO:tasks.ceph.mds.c.smithi019.stderr: 18: (MDSContext::complete(int)+0x5c) [0x5613d31148ec] 2024-09-12T01:59:01.579 INFO:tasks.ceph.mds.c.smithi019.stderr: 19: (MDSIOContextBase::complete(int)+0x31c) [0x5613d3114d3c] 2024-09-12T01:59:01.579 INFO:tasks.ceph.mds.c.smithi019.stderr: 20: (Finisher::finisher_thread_entry()+0x175) [0x7f7a60041b65] 2024-09-12T01:59:01.579 INFO:tasks.ceph.mds.c.smithi019.stderr: 21: /lib64/libc.so.6(+0x89c52) [0x7f7a5f689c52] 2024-09-12T01:59:01.579 INFO:tasks.ceph.mds.c.smithi019.stderr: 22: /lib64/libc.so.6(+0x10ec80) [0x7f7a5f70ec80] 2024-09-12T01:59:01.579 INFO:tasks.ceph.mds.c.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T01:59:01.579 INFO:tasks.ceph.mds.c.smithi019.stderr: 2024-09-12T01:59:01.579 INFO:tasks.ceph.mds.c.smithi019.stderr: -191> 2024-09-12T01:59:00.349+0000 7f7a57a8a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:59:01.579 INFO:tasks.ceph.mds.c.smithi019.stderr: -11> 2024-09-12T01:59:01.561+0000 7f7a53a82640 -1 mds.0.cache.den(0x1 a) newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x5613d5294f00] 2024-09-12T01:59:01.579 INFO:tasks.ceph.mds.c.smithi019.stderr: -9> 2024-09-12T01:59:01.561+0000 7f7a53a82640 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x5613d5294f00] 2024-09-12T01:59:01.579 INFO:tasks.ceph.mds.c.smithi019.stderr: -3> 2024-09-12T01:59:01.562+0000 7f7a53a82640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.1-298-gb53b6d3e/rpm/el9/BUILD/ceph-19.1.1-298-gb53b6d3e/src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7f7a53a82640 time 2024-09-12T01:59:01.561545+0000 2024-09-12T01:59:01.579 INFO:tasks.ceph.mds.c.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.1-298-gb53b6d3e/rpm/el9/BUILD/ceph-19.1.1-298-gb53b6d3e/src/mds/MDSRank.cc: 952: ceph_abort_msg("abort() called") 2024-09-12T01:59:01.579 INFO:tasks.ceph.mds.c.smithi019.stderr: 2024-09-12T01:59:01.579 INFO:tasks.ceph.mds.c.smithi019.stderr: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T01:59:01.580 INFO:tasks.ceph.mds.c.smithi019.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7f7a5ff83417] 2024-09-12T01:59:01.580 INFO:tasks.ceph.mds.c.smithi019.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x5613d2e502d1] 2024-09-12T01:59:01.580 INFO:tasks.ceph.mds.c.smithi019.stderr: 3: (CDentry::check_corruption(bool)+0x4d4) [0x5613d307b4e4] 2024-09-12T01:59:01.580 INFO:tasks.ceph.mds.c.smithi019.stderr: 4: ceph-mds(+0x3cd2fc) [0x5613d30952fc] 2024-09-12T01:59:01.580 INFO:tasks.ceph.mds.c.smithi019.stderr: 5: (CDir::_omap_commit(int)+0x93a) [0x5613d3096c2a] 2024-09-12T01:59:01.580 INFO:tasks.ceph.mds.c.smithi019.stderr: 6: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x265) [0x5613d3098205] 2024-09-12T01:59:01.580 INFO:tasks.ceph.mds.c.smithi019.stderr: 7: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xaf7) [0x5613d2e9d417] 2024-09-12T01:59:01.580 INFO:tasks.ceph.mds.c.smithi019.stderr: 8: (MDLog::try_expire(LogSegment*, int)+0x62) [0x5613d311c4d2] 2024-09-12T01:59:01.580 INFO:tasks.ceph.mds.c.smithi019.stderr: 9: (MDLog::trim_all()+0x769) [0x5613d311f399] 2024-09-12T01:59:01.580 INFO:tasks.ceph.mds.c.smithi019.stderr: 10: ceph-mds(+0x1bfd71) [0x5613d2e87d71] 2024-09-12T01:59:01.580 INFO:tasks.ceph.mds.c.smithi019.stderr: 11: ceph-mds(+0x16033d) [0x5613d2e2833d] 2024-09-12T01:59:01.580 INFO:tasks.ceph.mds.c.smithi019.stderr: 12: (MDSContext::complete(int)+0x5c) [0x5613d31148ec] 2024-09-12T01:59:01.580 INFO:tasks.ceph.mds.c.smithi019.stderr: 13: ceph-mds(+0x160602) [0x5613d2e28602] 2024-09-12T01:59:01.581 INFO:tasks.ceph.mds.c.smithi019.stderr: 14: (MDSContext::complete(int)+0x5c) [0x5613d31148ec] 2024-09-12T01:59:01.581 INFO:tasks.ceph.mds.c.smithi019.stderr: 15: (MDSIOContextBase::complete(int)+0x31c) [0x5613d3114d3c] 2024-09-12T01:59:01.581 INFO:tasks.ceph.mds.c.smithi019.stderr: 16: (Finisher::finisher_thread_entry()+0x175) [0x7f7a60041b65] 2024-09-12T01:59:01.581 INFO:tasks.ceph.mds.c.smithi019.stderr: 17: /lib64/libc.so.6(+0x89c52) [0x7f7a5f689c52] 2024-09-12T01:59:01.581 INFO:tasks.ceph.mds.c.smithi019.stderr: 18: /lib64/libc.so.6(+0x10ec80) [0x7f7a5f70ec80] 2024-09-12T01:59:01.581 INFO:tasks.ceph.mds.c.smithi019.stderr: 2024-09-12T01:59:01.581 INFO:tasks.ceph.mds.c.smithi019.stderr: 0> 2024-09-12T01:59:01.563+0000 7f7a53a82640 -1 *** Caught signal (Aborted) ** 2024-09-12T01:59:01.581 INFO:tasks.ceph.mds.c.smithi019.stderr: in thread 7f7a53a82640 thread_name:MR_Finisher 2024-09-12T01:59:01.581 INFO:tasks.ceph.mds.c.smithi019.stderr: 2024-09-12T01:59:01.581 INFO:tasks.ceph.mds.c.smithi019.stderr: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T01:59:01.581 INFO:tasks.ceph.mds.c.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7a5f63e6f0] 2024-09-12T01:59:01.581 INFO:tasks.ceph.mds.c.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7a5f68b99c] 2024-09-12T01:59:01.581 INFO:tasks.ceph.mds.c.smithi019.stderr: 3: raise() 2024-09-12T01:59:01.581 INFO:tasks.ceph.mds.c.smithi019.stderr: 4: abort() 2024-09-12T01:59:01.582 INFO:tasks.ceph.mds.c.smithi019.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7f7a5ff834d4] 2024-09-12T01:59:01.582 INFO:tasks.ceph.mds.c.smithi019.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x5613d2e502d1] 2024-09-12T01:59:01.582 INFO:tasks.ceph.mds.c.smithi019.stderr: 7: (CDentry::check_corruption(bool)+0x4d4) [0x5613d307b4e4] 2024-09-12T01:59:01.582 INFO:tasks.ceph.mds.c.smithi019.stderr: 8: ceph-mds(+0x3cd2fc) [0x5613d30952fc] 2024-09-12T01:59:01.582 INFO:tasks.ceph.mds.c.smithi019.stderr: 9: (CDir::_omap_commit(int)+0x93a) [0x5613d3096c2a] 2024-09-12T01:59:01.582 INFO:tasks.ceph.mds.c.smithi019.stderr: 10: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x265) [0x5613d3098205] 2024-09-12T01:59:01.582 INFO:tasks.ceph.mds.c.smithi019.stderr: 11: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xaf7) [0x5613d2e9d417] 2024-09-12T01:59:01.582 INFO:tasks.ceph.mds.c.smithi019.stderr: 12: (MDLog::try_expire(LogSegment*, int)+0x62) [0x5613d311c4d2] 2024-09-12T01:59:01.582 INFO:tasks.ceph.mds.c.smithi019.stderr: 13: (MDLog::trim_all()+0x769) [0x5613d311f399] 2024-09-12T01:59:01.582 INFO:tasks.ceph.mds.c.smithi019.stderr: 14: ceph-mds(+0x1bfd71) [0x5613d2e87d71] 2024-09-12T01:59:01.582 INFO:tasks.ceph.mds.c.smithi019.stderr: 15: ceph-mds(+0x16033d) [0x5613d2e2833d] 2024-09-12T01:59:01.582 INFO:tasks.ceph.mds.c.smithi019.stderr: 16: (MDSContext::complete(int)+0x5c) [0x5613d31148ec] 2024-09-12T01:59:01.582 INFO:tasks.ceph.mds.c.smithi019.stderr: 17: ceph-mds(+0x160602) [0x5613d2e28602] 2024-09-12T01:59:01.583 INFO:tasks.ceph.mds.c.smithi019.stderr: 18: (MDSContext::complete(int)+0x5c) [0x5613d31148ec] 2024-09-12T01:59:01.583 INFO:tasks.ceph.mds.c.smithi019.stderr: 19: (MDSIOContextBase::complete(int)+0x31c) [0x5613d3114d3c] 2024-09-12T01:59:01.583 INFO:tasks.ceph.mds.c.smithi019.stderr: 20: (Finisher::finisher_thread_entry()+0x175) [0x7f7a60041b65] 2024-09-12T01:59:01.583 INFO:tasks.ceph.mds.c.smithi019.stderr: 21: /lib64/libc.so.6(+0x89c52) [0x7f7a5f689c52] 2024-09-12T01:59:01.583 INFO:tasks.ceph.mds.c.smithi019.stderr: 22: /lib64/libc.so.6(+0x10ec80) [0x7f7a5f70ec80] 2024-09-12T01:59:01.583 INFO:tasks.ceph.mds.c.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T01:59:01.583 INFO:tasks.ceph.mds.c.smithi019.stderr: 2024-09-12T01:59:01.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.590+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-09-12T01:59:01.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.590+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:59:01.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.590+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:59:01.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.590+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-09-12T01:59:01.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.590+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.19:6833/740310996 2024-09-12T01:59:01.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.591+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=START_CONNECT pgs=15 cs=2 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:59:01.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.591+0000 7f18a7fff640 1 client.6210 ms_handle_refused on v2:172.21.15.19:6833/740310996 2024-09-12T01:59:01.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.686+0000 7fd3232e4640 1 Processor -- start 2024-09-12T01:59:01.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.687+0000 7fd3232e4640 1 -- start start 2024-09-12T01:59:01.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.687+0000 7fd3232e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd31c15b340 0x7fd31c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.687+0000 7fd3232e4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd31c0b43f0 0x7fd31c0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.688+0000 7fd3232e4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd31c0b3830 con 0x7fd31c0b4e80 2024-09-12T01:59:01.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.688+0000 7fd3232e4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd31c0b5bd0 con 0x7fd31c0b43f0 2024-09-12T01:59:01.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.688+0000 7fd3232e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd31c0b5610 con 0x7fd31c15b340 2024-09-12T01:59:01.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.688+0000 7fd32087f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd31c0b43f0 0x7fd31c0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.688+0000 7fd32087f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd31c0b43f0 0x7fd31c0b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53534/0 (socket says 172.21.15.19:53534) 2024-09-12T01:59:01.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.688+0000 7fd32087f640 1 -- 172.21.15.19:0/642192389 learned_addr learned my addr 172.21.15.19:0/642192389 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:01.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.688+0000 7fd321881640 1 --1- 172.21.15.19:0/642192389 >> v1:172.21.15.19:6789/0 conn(0x7fd31c0b4e80 0x7fd31c15de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59514/0 (socket says 172.21.15.19:59514) 2024-09-12T01:59:01.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.688+0000 7fd321080640 1 --2- 172.21.15.19:0/642192389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd31c15b340 0x7fd31c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.688+0000 7fd32087f640 1 -- 172.21.15.19:0/642192389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd31c15b340 msgr2=0x7fd31c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.688+0000 7fd32087f640 1 --2- 172.21.15.19:0/642192389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd31c15b340 0x7fd31c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.688+0000 7fd32087f640 1 -- 172.21.15.19:0/642192389 >> v1:172.21.15.19:6789/0 conn(0x7fd31c0b4e80 legacy=0x7fd31c15de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.688+0000 7fd32087f640 1 -- 172.21.15.19:0/642192389 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c0b58f0 con 0x7fd31c0b43f0 2024-09-12T01:59:01.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.688+0000 7fd313fff640 1 -- 172.21.15.19:0/642192389 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3439025754 0 0) 0x7fd31c0b3830 con 0x7fd31c0b4e80 2024-09-12T01:59:01.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.689+0000 7fd32087f640 1 --2- 172.21.15.19:0/642192389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd31c0b43f0 0x7fd31c0b4940 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009870 tx=0x7fd30c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c574312888c14a3c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.689+0000 7fd313fff640 1 -- 172.21.15.19:0/642192389 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c037070 con 0x7fd31c0b43f0 2024-09-12T01:59:01.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.689+0000 7fd313fff640 1 -- 172.21.15.19:0/642192389 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30c02ae50 con 0x7fd31c0b43f0 2024-09-12T01:59:01.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.689+0000 7fd313fff640 1 -- 172.21.15.19:0/642192389 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c032860 con 0x7fd31c0b43f0 2024-09-12T01:59:01.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.689+0000 7fd3232e4640 1 -- 172.21.15.19:0/642192389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd31c0b43f0 msgr2=0x7fd31c0b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.689+0000 7fd3232e4640 1 --2- 172.21.15.19:0/642192389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd31c0b43f0 0x7fd31c0b4940 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009870 tx=0x7fd30c02a300 comp rx=0 tx=0).stop 2024-09-12T01:59:01.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.689+0000 7fd3232e4640 1 -- 172.21.15.19:0/642192389 shutdown_connections 2024-09-12T01:59:01.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.689+0000 7fd3232e4640 1 --2- 172.21.15.19:0/642192389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd31c0b43f0 0x7fd31c0b4940 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.689+0000 7fd3232e4640 1 --2- 172.21.15.19:0/642192389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd31c15b340 0x7fd31c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.690+0000 7fd3232e4640 1 -- 172.21.15.19:0/642192389 >> 172.21.15.19:0/642192389 conn(0x7fd31c073490 msgr2=0x7fd31c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:01.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.690+0000 7fd3232e4640 1 -- 172.21.15.19:0/642192389 shutdown_connections 2024-09-12T01:59:01.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.690+0000 7fd3232e4640 1 -- 172.21.15.19:0/642192389 wait complete. 2024-09-12T01:59:01.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.691+0000 7fd3232e4640 1 Processor -- start 2024-09-12T01:59:01.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.691+0000 7fd3232e4640 1 -- start start 2024-09-12T01:59:01.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd3232e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd31c0b43f0 0x7fd31c1f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd3232e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd31c0b4e80 0x7fd31c06c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd3232e4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd31c15b340 0x7fd31c0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd3232e4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c0b5330 con 0x7fd31c0b43f0 2024-09-12T01:59:01.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd3232e4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c15d8f0 con 0x7fd31c15b340 2024-09-12T01:59:01.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd3232e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd31c15c730 con 0x7fd31c0b4e80 2024-09-12T01:59:01.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd321080640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd31c0b43f0 0x7fd31c1f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd321080640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd31c0b43f0 0x7fd31c1f7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53536/0 (socket says 172.21.15.19:53536) 2024-09-12T01:59:01.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd321080640 1 -- 172.21.15.19:0/383699344 learned_addr learned my addr 172.21.15.19:0/383699344 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:01.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd321080640 1 -- 172.21.15.19:0/383699344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd31c0b4e80 msgr2=0x7fd31c06c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd321080640 1 --2- 172.21.15.19:0/383699344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd31c0b4e80 0x7fd31c06c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd321080640 1 -- 172.21.15.19:0/383699344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd31c15b340 msgr2=0x7fd31c0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd321080640 1 --2- 172.21.15.19:0/383699344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd31c15b340 0x7fd31c0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd321080640 1 -- 172.21.15.19:0/383699344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c1f8250 con 0x7fd31c0b43f0 2024-09-12T01:59:01.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd321080640 1 --2- 172.21.15.19:0/383699344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd31c0b43f0 0x7fd31c1f7a20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd31800e8a0 tx=0x7fd31800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd311ffb640 1 -- 172.21.15.19:0/383699344 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd318017070 con 0x7fd31c0b43f0 2024-09-12T01:59:01.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd311ffb640 1 -- 172.21.15.19:0/383699344 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd31800c940 con 0x7fd31c0b43f0 2024-09-12T01:59:01.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd3232e4640 1 -- 172.21.15.19:0/383699344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31c1f8530 con 0x7fd31c0b43f0 2024-09-12T01:59:01.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.692+0000 7fd311ffb640 1 -- 172.21.15.19:0/383699344 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31800cd30 con 0x7fd31c0b43f0 2024-09-12T01:59:01.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.693+0000 7fd3232e4640 1 -- 172.21.15.19:0/383699344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31c0ca730 con 0x7fd31c0b43f0 2024-09-12T01:59:01.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.693+0000 7fd3232e4640 1 -- 172.21.15.19:0/383699344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd31c0cdb30 con 0x7fd31c0b43f0 2024-09-12T01:59:01.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.694+0000 7fd311ffb640 1 -- 172.21.15.19:0/383699344 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd31801a070 con 0x7fd31c0b43f0 2024-09-12T01:59:01.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.694+0000 7fd311ffb640 1 --2- 172.21.15.19:0/383699344 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd30006be60 0x7fd30006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.694+0000 7fd311ffb640 1 -- 172.21.15.19:0/383699344 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7fd31808b230 con 0x7fd31c0b43f0 2024-09-12T01:59:01.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.695+0000 7fd32087f640 1 --2- 172.21.15.19:0/383699344 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd30006be60 0x7fd30006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.695+0000 7fd32087f640 1 --2- 172.21.15.19:0/383699344 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd30006be60 0x7fd30006e320 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd30c034000 tx=0x7fd30c02c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.699+0000 7fd311ffb640 1 -- 172.21.15.19:0/383699344 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd318059a20 con 0x7fd31c0b43f0 2024-09-12T01:59:01.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.792+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.19:6833/740310996 2024-09-12T01:59:01.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.792+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=START_CONNECT pgs=15 cs=3 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:59:01.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.792+0000 7f18a7fff640 1 client.6210 ms_handle_refused on v2:172.21.15.19:6833/740310996 2024-09-12T01:59:01.873 INFO:tasks.ceph.mds.c.smithi019.stderr:daemon-helper: command crashed with signal 6 2024-09-12T01:59:01.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.911+0000 7fd3232e4640 1 -- 172.21.15.19:0/383699344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd31c1526d0 con 0x7fd31c0b43f0 2024-09-12T01:59:01.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.912+0000 7fd311ffb640 1 -- 172.21.15.19:0/383699344 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5225 (secure 0 0 0) 0x7fd318059320 con 0x7fd31c0b43f0 2024-09-12T01:59:01.911 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:59:01.911 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":49,"btime":"2024-09-12T01:59:01:374773+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2176310149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2176310149},{"type":"v1","addr":"172.21.15.135:6836","nonce":2176310149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/222313950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":222313950},{"type":"v1","addr":"172.21.15.135:6837","nonce":222313950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/2113904472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2113904472},{"type":"v1","addr":"172.21.15.19:6834","nonce":2113904472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:58:31.431304+0000","modified":"2024-09-12T01:59:00.492717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6120":{"gid":6120,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.19:6835/740310996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":740310996},{"type":"v1","addr":"172.21.15.19:6835","nonce":740310996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6120,"qdb_cluster":[6120]},"id":4}]} 2024-09-12T01:59:01.911 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 49 2024-09-12T01:59:01.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.914+0000 7fd3232e4640 1 -- 172.21.15.19:0/383699344 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd30006be60 msgr2=0x7fd30006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.914+0000 7fd3232e4640 1 --2- 172.21.15.19:0/383699344 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd30006be60 0x7fd30006e320 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd30c034000 tx=0x7fd30c02c000 comp rx=0 tx=0).stop 2024-09-12T01:59:01.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.914+0000 7fd3232e4640 1 -- 172.21.15.19:0/383699344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd31c0b43f0 msgr2=0x7fd31c1f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.914+0000 7fd3232e4640 1 --2- 172.21.15.19:0/383699344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd31c0b43f0 0x7fd31c1f7a20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd31800e8a0 tx=0x7fd31800ed60 comp rx=0 tx=0).stop 2024-09-12T01:59:01.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.914+0000 7fd3232e4640 1 -- 172.21.15.19:0/383699344 shutdown_connections 2024-09-12T01:59:01.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.914+0000 7fd3232e4640 1 --2- 172.21.15.19:0/383699344 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd30006be60 0x7fd30006e320 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.914+0000 7fd3232e4640 1 --2- 172.21.15.19:0/383699344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd31c15b340 0x7fd31c0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.914+0000 7fd3232e4640 1 --2- 172.21.15.19:0/383699344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd31c0b4e80 0x7fd31c06c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.914+0000 7fd3232e4640 1 --2- 172.21.15.19:0/383699344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd31c0b43f0 0x7fd31c1f7a20 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.914+0000 7fd3232e4640 1 -- 172.21.15.19:0/383699344 >> 172.21.15.19:0/383699344 conn(0x7fd31c073490 msgr2=0x7fd31c15a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:01.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.914+0000 7fd3232e4640 1 -- 172.21.15.19:0/383699344 shutdown_connections 2024-09-12T01:59:01.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:01.914+0000 7fd3232e4640 1 -- 172.21.15.19:0/383699344 wait complete. 2024-09-12T01:59:01.924 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-12T01:59:02.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:02.193+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.19:6833/740310996 2024-09-12T01:59:02.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:02.193+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=START_CONNECT pgs=15 cs=4 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T01:59:02.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:02.193+0000 7f18a7fff640 1 client.6210 ms_handle_refused on v2:172.21.15.19:6833/740310996 2024-09-12T01:59:02.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:02.389+0000 7fcd267fc640 1 -- 172.21.15.19:0/3774649179 <== mon.0 v2:172.21.15.19:3300/0 8 ==== log(2 entries from seq 604 at 2024-09-12T01:59:01.382491+0000) ==== 635+0+0 (secure 0 0 0) 0x7fcd28057ef0 con 0x7fcd300cb9e0 2024-09-12T01:59:02.389 INFO:teuthology.orchestra.run.smithi019.stdout: cluster: 2024-09-12T01:59:02.389 INFO:teuthology.orchestra.run.smithi019.stdout: id: 978259a0-e3d5-47df-8e62-5e92f95d9388 2024-09-12T01:59:02.389 INFO:teuthology.orchestra.run.smithi019.stdout: health: HEALTH_OK 2024-09-12T01:59:02.389 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:59:02.389 INFO:teuthology.orchestra.run.smithi019.stdout: services: 2024-09-12T01:59:02.389 INFO:teuthology.orchestra.run.smithi019.stdout: mon: 3 daemons, quorum a,b,c (age 3m) 2024-09-12T01:59:02.389 INFO:teuthology.orchestra.run.smithi019.stdout: mgr: x(active, since 3m), standbys: y 2024-09-12T01:59:02.390 INFO:teuthology.orchestra.run.smithi019.stdout: mds: 1/1 daemons up, 3 standby 2024-09-12T01:59:02.390 INFO:teuthology.orchestra.run.smithi019.stdout: osd: 8 osds: 8 up (since 3m), 8 in (since 3m) 2024-09-12T01:59:02.390 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:59:02.390 INFO:teuthology.orchestra.run.smithi019.stdout: data: 2024-09-12T01:59:02.390 INFO:teuthology.orchestra.run.smithi019.stdout: volumes: 1/1 healthy 2024-09-12T01:59:02.390 INFO:teuthology.orchestra.run.smithi019.stdout: pools: 3 pools, 97 pgs 2024-09-12T01:59:02.390 INFO:teuthology.orchestra.run.smithi019.stdout: objects: 29 objects, 602 KiB 2024-09-12T01:59:02.390 INFO:teuthology.orchestra.run.smithi019.stdout: usage: 227 MiB used, 720 GiB / 720 GiB avail 2024-09-12T01:59:02.390 INFO:teuthology.orchestra.run.smithi019.stdout: pgs: 97 active+clean 2024-09-12T01:59:02.390 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:59:02.390 INFO:teuthology.orchestra.run.smithi019.stdout: io: 2024-09-12T01:59:02.390 INFO:teuthology.orchestra.run.smithi019.stdout: client: 3.8 KiB/s rd, 949 B/s wr, 2 op/s rd, 0 op/s wr 2024-09-12T01:59:02.391 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:59:02.391 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:59:02.391 INFO:teuthology.orchestra.run.smithi019.stdout:2024-09-12T01:59:01.561521+0000 mds.c [ERR] MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x5613d5294f00] 2024-09-12T01:59:02.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:02.994+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.19:6833/740310996 2024-09-12T01:59:02.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:02.994+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=START_CONNECT pgs=15 cs=5 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T01:59:02.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:02.994+0000 7f18a7fff640 1 client.6210 ms_handle_refused on v2:172.21.15.19:6833/740310996 2024-09-12T01:59:04.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:04.595+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.19:6833/740310996 2024-09-12T01:59:04.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:04.595+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=START_CONNECT pgs=15 cs=6 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-12T01:59:04.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:04.595+0000 7f18a7fff640 1 client.6210 ms_handle_refused on v2:172.21.15.19:6833/740310996 2024-09-12T01:59:05.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-12T01:59:06.926 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:59:07.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.042+0000 7f7b31aba640 1 Processor -- start 2024-09-12T01:59:07.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.043+0000 7f7b31aba640 1 -- start start 2024-09-12T01:59:07.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.043+0000 7f7b31aba640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7b2c15c520 0x7f7b2c09b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:07.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.043+0000 7f7b31aba640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7b2c0d1090 0x7f7b2c0b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:07.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.043+0000 7f7b31aba640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b2c0cec00 con 0x7f7b2c0b1620 2024-09-12T01:59:07.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.043+0000 7f7b31aba640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f7b2c09bd90 con 0x7f7b2c15c520 2024-09-12T01:59:07.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.043+0000 7f7b31aba640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f7b2c0d0010 con 0x7f7b2c0d1090 2024-09-12T01:59:07.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.044+0000 7f7b2b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7b2c15c520 0x7f7b2c09b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:07.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.044+0000 7f7b2b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7b2c15c520 0x7f7b2c09b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53550/0 (socket says 172.21.15.19:53550) 2024-09-12T01:59:07.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.044+0000 7f7b2affd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7b2c0b1620 0x7f7b2c0d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59526/0 (socket says 172.21.15.19:59526) 2024-09-12T01:59:07.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.044+0000 7f7b2b7fe640 1 -- 172.21.15.19:0/3140490241 learned_addr learned my addr 172.21.15.19:0/3140490241 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:07.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.044+0000 7f7b2bfff640 1 --2- 172.21.15.19:0/3140490241 >> v2:172.21.15.135:3300/0 conn(0x7f7b2c0d1090 0x7f7b2c0b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:07.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.044+0000 7f7b2b7fe640 1 -- 172.21.15.19:0/3140490241 >> v2:172.21.15.135:3300/0 conn(0x7f7b2c0d1090 msgr2=0x7f7b2c0b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:07.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.044+0000 7f7b2b7fe640 1 --2- 172.21.15.19:0/3140490241 >> v2:172.21.15.135:3300/0 conn(0x7f7b2c0d1090 0x7f7b2c0b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.044+0000 7f7b2b7fe640 1 -- 172.21.15.19:0/3140490241 >> v1:172.21.15.19:6789/0 conn(0x7f7b2c0b1620 legacy=0x7f7b2c0d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:07.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.044+0000 7f7b2a7fc640 1 -- 172.21.15.19:0/3140490241 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2422037422 0 0) 0x7f7b2c0cec00 con 0x7f7b2c0b1620 2024-09-12T01:59:07.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.044+0000 7f7b2b7fe640 1 -- 172.21.15.19:0/3140490241 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c0d02f0 con 0x7f7b2c15c520 2024-09-12T01:59:07.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.045+0000 7f7b2b7fe640 1 --2- 172.21.15.19:0/3140490241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b2c15c520 0x7f7b2c09b720 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0b3ea0 tx=0x7f7b1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a3e34ef4b2d150 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:07.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.045+0000 7f7b2a7fc640 1 -- 172.21.15.19:0/3140490241 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c037070 con 0x7f7b2c15c520 2024-09-12T01:59:07.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.045+0000 7f7b2a7fc640 1 -- 172.21.15.19:0/3140490241 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c032440 con 0x7f7b2c15c520 2024-09-12T01:59:07.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.045+0000 7f7b2a7fc640 1 -- 172.21.15.19:0/3140490241 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c032810 con 0x7f7b2c15c520 2024-09-12T01:59:07.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.045+0000 7f7b31aba640 1 -- 172.21.15.19:0/3140490241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b2c15c520 msgr2=0x7f7b2c09b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.045+0000 7f7b31aba640 1 --2- 172.21.15.19:0/3140490241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b2c15c520 0x7f7b2c09b720 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0b3ea0 tx=0x7f7b1c02a270 comp rx=0 tx=0).stop 2024-09-12T01:59:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.045+0000 7f7b31aba640 1 -- 172.21.15.19:0/3140490241 shutdown_connections 2024-09-12T01:59:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.045+0000 7f7b31aba640 1 --2- 172.21.15.19:0/3140490241 >> v2:172.21.15.135:3300/0 conn(0x7f7b2c0d1090 0x7f7b2c0b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.045+0000 7f7b31aba640 1 --2- 172.21.15.19:0/3140490241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b2c15c520 0x7f7b2c09b720 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.045+0000 7f7b31aba640 1 -- 172.21.15.19:0/3140490241 >> 172.21.15.19:0/3140490241 conn(0x7f7b2c0d23a0 msgr2=0x7f7b2c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.046+0000 7f7b31aba640 1 -- 172.21.15.19:0/3140490241 shutdown_connections 2024-09-12T01:59:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.046+0000 7f7b31aba640 1 -- 172.21.15.19:0/3140490241 wait complete. 2024-09-12T01:59:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.047+0000 7f7b31aba640 1 Processor -- start 2024-09-12T01:59:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.047+0000 7f7b31aba640 1 -- start start 2024-09-12T01:59:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.048+0000 7f7b31aba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b2c0b1620 0x7f7b2c159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.048+0000 7f7b31aba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b2c0d1090 0x7f7b2c0c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.048+0000 7f7b31aba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b2c15c520 0x7f7b2c0b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.048+0000 7f7b31aba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c15c900 con 0x7f7b2c15c520 2024-09-12T01:59:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.048+0000 7f7b31aba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c0d05d0 con 0x7f7b2c0d1090 2024-09-12T01:59:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.048+0000 7f7b31aba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2c0c97e0 con 0x7f7b2c0b1620 2024-09-12T01:59:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.048+0000 7f7b2bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b2c15c520 0x7f7b2c0b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.048+0000 7f7b2bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b2c15c520 0x7f7b2c0b2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53562/0 (socket says 172.21.15.19:53562) 2024-09-12T01:59:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.048+0000 7f7b2bfff640 1 -- 172.21.15.19:0/2777065165 learned_addr learned my addr 172.21.15.19:0/2777065165 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.048+0000 7f7b2affd640 1 --2- 172.21.15.19:0/2777065165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b2c0d1090 0x7f7b2c0c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.048+0000 7f7b2b7fe640 1 --2- 172.21.15.19:0/2777065165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b2c0b1620 0x7f7b2c159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.048+0000 7f7b2bfff640 1 -- 172.21.15.19:0/2777065165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b2c0b1620 msgr2=0x7f7b2c159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.048+0000 7f7b2bfff640 1 --2- 172.21.15.19:0/2777065165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b2c0b1620 0x7f7b2c159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.048+0000 7f7b2bfff640 1 -- 172.21.15.19:0/2777065165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b2c0d1090 msgr2=0x7f7b2c0c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.048+0000 7f7b2bfff640 1 --2- 172.21.15.19:0/2777065165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b2c0d1090 0x7f7b2c0c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.048+0000 7f7b2bfff640 1 -- 172.21.15.19:0/2777065165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c0c9ac0 con 0x7f7b2c15c520 2024-09-12T01:59:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.048+0000 7f7b2b7fe640 1 --2- 172.21.15.19:0/2777065165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b2c0b1620 0x7f7b2c159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:59:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.048+0000 7f7b2bfff640 1 --2- 172.21.15.19:0/2777065165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b2c15c520 0x7f7b2c0b2310 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7b24007e60 tx=0x7f7b2400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.049+0000 7f7b13fff640 1 -- 172.21.15.19:0/2777065165 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24014620 con 0x7f7b2c15c520 2024-09-12T01:59:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.049+0000 7f7b13fff640 1 -- 172.21.15.19:0/2777065165 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b24019070 con 0x7f7b2c15c520 2024-09-12T01:59:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.049+0000 7f7b31aba640 1 -- 172.21.15.19:0/2777065165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2c0c9da0 con 0x7f7b2c15c520 2024-09-12T01:59:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.049+0000 7f7b13fff640 1 -- 172.21.15.19:0/2777065165 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24014a00 con 0x7f7b2c15c520 2024-09-12T01:59:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.049+0000 7f7b31aba640 1 -- 172.21.15.19:0/2777065165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b2c0ca360 con 0x7f7b2c15c520 2024-09-12T01:59:07.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.050+0000 7f7b31aba640 1 -- 172.21.15.19:0/2777065165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b2c0b1d40 con 0x7f7b2c15c520 2024-09-12T01:59:07.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.050+0000 7f7b13fff640 1 -- 172.21.15.19:0/2777065165 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b24014ba0 con 0x7f7b2c15c520 2024-09-12T01:59:07.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.051+0000 7f7b13fff640 1 --2- 172.21.15.19:0/2777065165 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7b1806be30 0x7f7b1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:07.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.051+0000 7f7b13fff640 1 -- 172.21.15.19:0/2777065165 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7f7b2408b950 con 0x7f7b2c15c520 2024-09-12T01:59:07.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.051+0000 7f7b2b7fe640 1 --2- 172.21.15.19:0/2777065165 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7b1806be30 0x7f7b1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:07.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.052+0000 7f7b2b7fe640 1 --2- 172.21.15.19:0/2777065165 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7b1806be30 0x7f7b1806e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c034000 tx=0x7f7b1c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:07.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.055+0000 7f7b13fff640 1 -- 172.21.15.19:0/2777065165 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b2405a0b0 con 0x7f7b2c15c520 2024-09-12T01:59:07.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.266+0000 7f7b31aba640 1 -- 172.21.15.19:0/2777065165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b2c0b8320 con 0x7f7b2c15c520 2024-09-12T01:59:07.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.267+0000 7f7b13fff640 1 -- 172.21.15.19:0/2777065165 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5225 (secure 0 0 0) 0x7f7b240599b0 con 0x7f7b2c15c520 2024-09-12T01:59:07.266 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:59:07.266 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":49,"btime":"2024-09-12T01:59:01:374773+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2176310149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2176310149},{"type":"v1","addr":"172.21.15.135:6836","nonce":2176310149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/222313950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":222313950},{"type":"v1","addr":"172.21.15.135:6837","nonce":222313950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/2113904472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2113904472},{"type":"v1","addr":"172.21.15.19:6834","nonce":2113904472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:58:31.431304+0000","modified":"2024-09-12T01:59:00.492717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6120":{"gid":6120,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.19:6835/740310996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":740310996},{"type":"v1","addr":"172.21.15.19:6835","nonce":740310996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6120,"qdb_cluster":[6120]},"id":4}]} 2024-09-12T01:59:07.267 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 49 2024-09-12T01:59:07.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.269+0000 7f7b31aba640 1 -- 172.21.15.19:0/2777065165 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7b1806be30 msgr2=0x7f7b1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:07.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.269+0000 7f7b31aba640 1 --2- 172.21.15.19:0/2777065165 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7b1806be30 0x7f7b1806e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c034000 tx=0x7f7b1c02e000 comp rx=0 tx=0).stop 2024-09-12T01:59:07.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.269+0000 7f7b31aba640 1 -- 172.21.15.19:0/2777065165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b2c15c520 msgr2=0x7f7b2c0b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:07.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.269+0000 7f7b31aba640 1 --2- 172.21.15.19:0/2777065165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b2c15c520 0x7f7b2c0b2310 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7b24007e60 tx=0x7f7b2400e4b0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.269+0000 7f7b31aba640 1 -- 172.21.15.19:0/2777065165 shutdown_connections 2024-09-12T01:59:07.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.269+0000 7f7b31aba640 1 --2- 172.21.15.19:0/2777065165 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7b1806be30 0x7f7b1806e2f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.269+0000 7f7b31aba640 1 --2- 172.21.15.19:0/2777065165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b2c15c520 0x7f7b2c0b2310 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.269+0000 7f7b31aba640 1 --2- 172.21.15.19:0/2777065165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b2c0d1090 0x7f7b2c0c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.269+0000 7f7b31aba640 1 --2- 172.21.15.19:0/2777065165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b2c0b1620 0x7f7b2c159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.269+0000 7f7b31aba640 1 -- 172.21.15.19:0/2777065165 >> 172.21.15.19:0/2777065165 conn(0x7f7b2c0d23a0 msgr2=0x7f7b2c09b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:07.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.269+0000 7f7b31aba640 1 -- 172.21.15.19:0/2777065165 shutdown_connections 2024-09-12T01:59:07.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.269+0000 7f7b31aba640 1 -- 172.21.15.19:0/2777065165 wait complete. 2024-09-12T01:59:07.280 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-12T01:59:07.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.799+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.19:6833/740310996 2024-09-12T01:59:07.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.799+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=START_CONNECT pgs=15 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-09-12T01:59:07.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:07.799+0000 7f18a7fff640 1 client.6210 ms_handle_refused on v2:172.21.15.19:6833/740310996 2024-09-12T01:59:12.234 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2024-09-12T01:59:12.281 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:59:12.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.398+0000 7f823b1cf640 1 Processor -- start 2024-09-12T01:59:12.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.398+0000 7f823b1cf640 1 -- start start 2024-09-12T01:59:12.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.399+0000 7f823b1cf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f82340b6690 0x7f82341691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:12.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.399+0000 7f823b1cf640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82340d3690 con 0x7f82340d30f0 2024-09-12T01:59:12.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.399+0000 7f823b1cf640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82340d3970 con 0x7f823415e5f0 2024-09-12T01:59:12.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.399+0000 7f823b1cf640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f823406d530 con 0x7f82340b6690 2024-09-12T01:59:12.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.399+0000 7f823976c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f82340b6690 0x7f82341691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:12.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.399+0000 7f8233fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f82340d30f0 0x7f82340b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37736/0 (socket says 172.21.15.19:37736) 2024-09-12T01:59:12.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.399+0000 7f8233fff640 1 -- 172.21.15.19:0/636538078 learned_addr learned my addr 172.21.15.19:0/636538078 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:59:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.400+0000 7f823976c640 1 -- 172.21.15.19:0/636538078 >> v1:172.21.15.135:6789/0 conn(0x7f823415e5f0 legacy=0x7f82340d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.400+0000 7f823976c640 1 -- 172.21.15.19:0/636538078 >> v1:172.21.15.19:6789/0 conn(0x7f82340d30f0 legacy=0x7f82340b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.400+0000 7f823976c640 1 -- 172.21.15.19:0/636538078 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823406cee0 con 0x7f82340b6690 2024-09-12T01:59:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.400+0000 7f82337fe640 1 -- 172.21.15.19:0/636538078 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 408754632 0 0) 0x7f82340d3690 con 0x7f82340d30f0 2024-09-12T01:59:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.401+0000 7f823976c640 1 --2- 172.21.15.19:0/636538078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82340b6690 0x7f82341691a0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f822c009dc0 tx=0x7f822c02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f883467d030c00f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.401+0000 7f82337fe640 1 -- 172.21.15.19:0/636538078 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c007740 con 0x7f82340b6690 2024-09-12T01:59:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.401+0000 7f82337fe640 1 -- 172.21.15.19:0/636538078 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f822c0078e0 con 0x7f82340b6690 2024-09-12T01:59:12.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.401+0000 7f82337fe640 1 -- 172.21.15.19:0/636538078 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c007cb0 con 0x7f82340b6690 2024-09-12T01:59:12.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.401+0000 7f823b1cf640 1 -- 172.21.15.19:0/636538078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82340b6690 msgr2=0x7f82341691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:12.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.401+0000 7f823b1cf640 1 --2- 172.21.15.19:0/636538078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82340b6690 0x7f82341691a0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f822c009dc0 tx=0x7f822c02a6d0 comp rx=0 tx=0).stop 2024-09-12T01:59:12.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.401+0000 7f823b1cf640 1 -- 172.21.15.19:0/636538078 shutdown_connections 2024-09-12T01:59:12.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.401+0000 7f823b1cf640 1 --2- 172.21.15.19:0/636538078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82340b6690 0x7f82341691a0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:12.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.401+0000 7f823b1cf640 1 -- 172.21.15.19:0/636538078 >> 172.21.15.19:0/636538078 conn(0x7f823408bfc0 msgr2=0x7f82340d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:12.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.401+0000 7f823b1cf640 1 -- 172.21.15.19:0/636538078 shutdown_connections 2024-09-12T01:59:12.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.401+0000 7f823b1cf640 1 -- 172.21.15.19:0/636538078 wait complete. 2024-09-12T01:59:12.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.403+0000 7f823b1cf640 1 Processor -- start 2024-09-12T01:59:12.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.403+0000 7f823b1cf640 1 -- start start 2024-09-12T01:59:12.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.404+0000 7f823b1cf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82340b6690 0x7f8234161880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:12.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.404+0000 7f823b1cf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82340d30f0 0x7f823415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:12.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.404+0000 7f823b1cf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f823415e5f0 0x7f82340b9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:12.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.404+0000 7f823b1cf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f823406e9d0 con 0x7f823415e5f0 2024-09-12T01:59:12.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.404+0000 7f823b1cf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f823415e9d0 con 0x7f82340d30f0 2024-09-12T01:59:12.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.404+0000 7f823b1cf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f823406eb50 con 0x7f82340b6690 2024-09-12T01:59:12.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.404+0000 7f823976c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f823415e5f0 0x7f82340b9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:12.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.404+0000 7f823976c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f823415e5f0 0x7f82340b9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41942/0 (socket says 172.21.15.19:41942) 2024-09-12T01:59:12.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.404+0000 7f823976c640 1 -- 172.21.15.19:0/1634217608 learned_addr learned my addr 172.21.15.19:0/1634217608 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:12.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.404+0000 7f8238f6b640 1 --2- 172.21.15.19:0/1634217608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82340b6690 0x7f8234161880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:12.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.404+0000 7f8233fff640 1 --2- 172.21.15.19:0/1634217608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82340d30f0 0x7f823415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:12.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.404+0000 7f823976c640 1 -- 172.21.15.19:0/1634217608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82340b6690 msgr2=0x7f8234161880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:12.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.404+0000 7f823976c640 1 --2- 172.21.15.19:0/1634217608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82340b6690 0x7f8234161880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:12.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.404+0000 7f823976c640 1 -- 172.21.15.19:0/1634217608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82340d30f0 msgr2=0x7f823415c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:12.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.404+0000 7f823976c640 1 --2- 172.21.15.19:0/1634217608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82340d30f0 0x7f823415c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:12.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.404+0000 7f823976c640 1 -- 172.21.15.19:0/1634217608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82340c80d0 con 0x7f823415e5f0 2024-09-12T01:59:12.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.404+0000 7f8233fff640 1 --2- 172.21.15.19:0/1634217608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82340d30f0 0x7f823415c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:59:12.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.404+0000 7f823976c640 1 --2- 172.21.15.19:0/1634217608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f823415e5f0 0x7f82340b9520 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f822c009ee0 tx=0x7f822c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:12.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.406+0000 7f82317fa640 1 -- 172.21.15.19:0/1634217608 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c040070 con 0x7f823415e5f0 2024-09-12T01:59:12.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.406+0000 7f82317fa640 1 -- 172.21.15.19:0/1634217608 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f822c031bc0 con 0x7f823415e5f0 2024-09-12T01:59:12.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.406+0000 7f823b1cf640 1 -- 172.21.15.19:0/1634217608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8234161dc0 con 0x7f823415e5f0 2024-09-12T01:59:12.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.406+0000 7f82317fa640 1 -- 172.21.15.19:0/1634217608 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c045460 con 0x7f823415e5f0 2024-09-12T01:59:12.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.406+0000 7f823b1cf640 1 -- 172.21.15.19:0/1634217608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82340c8620 con 0x7f823415e5f0 2024-09-12T01:59:12.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.407+0000 7f823b1cf640 1 -- 172.21.15.19:0/1634217608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82340b5f80 con 0x7f823415e5f0 2024-09-12T01:59:12.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.408+0000 7f82317fa640 1 -- 172.21.15.19:0/1634217608 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f822c039040 con 0x7f823415e5f0 2024-09-12T01:59:12.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.408+0000 7f82317fa640 1 --2- 172.21.15.19:0/1634217608 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f821806be30 0x7f821806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:12.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.409+0000 7f82317fa640 1 -- 172.21.15.19:0/1634217608 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7f822c0aca00 con 0x7f823415e5f0 2024-09-12T01:59:12.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.409+0000 7f8238f6b640 1 --2- 172.21.15.19:0/1634217608 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f821806be30 0x7f821806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:12.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.409+0000 7f8238f6b640 1 --2- 172.21.15.19:0/1634217608 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f821806be30 0x7f821806e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8228004f60 tx=0x7f8228007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:12.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.413+0000 7f82317fa640 1 -- 172.21.15.19:0/1634217608 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f822c07b220 con 0x7f823415e5f0 2024-09-12T01:59:12.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.626+0000 7f823b1cf640 1 -- 172.21.15.19:0/1634217608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82340d1cc0 con 0x7f823415e5f0 2024-09-12T01:59:12.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.626+0000 7f82317fa640 1 -- 172.21.15.19:0/1634217608 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5225 (secure 0 0 0) 0x7f822c07ab20 con 0x7f823415e5f0 2024-09-12T01:59:12.627 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:59:12.627 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":49,"btime":"2024-09-12T01:59:01:374773+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2176310149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2176310149},{"type":"v1","addr":"172.21.15.135:6836","nonce":2176310149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/222313950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":222313950},{"type":"v1","addr":"172.21.15.135:6837","nonce":222313950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/2113904472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2113904472},{"type":"v1","addr":"172.21.15.19:6834","nonce":2113904472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:58:31.431304+0000","modified":"2024-09-12T01:59:00.492717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6120":{"gid":6120,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.19:6835/740310996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":740310996},{"type":"v1","addr":"172.21.15.19:6835","nonce":740310996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6120,"qdb_cluster":[6120]},"id":4}]} 2024-09-12T01:59:12.627 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 49 2024-09-12T01:59:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.628+0000 7f823b1cf640 1 -- 172.21.15.19:0/1634217608 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f821806be30 msgr2=0x7f821806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.628+0000 7f823b1cf640 1 --2- 172.21.15.19:0/1634217608 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f821806be30 0x7f821806e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8228004f60 tx=0x7f8228007e30 comp rx=0 tx=0).stop 2024-09-12T01:59:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.628+0000 7f823b1cf640 1 -- 172.21.15.19:0/1634217608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f823415e5f0 msgr2=0x7f82340b9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.628+0000 7f823b1cf640 1 --2- 172.21.15.19:0/1634217608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f823415e5f0 0x7f82340b9520 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f822c009ee0 tx=0x7f822c004a40 comp rx=0 tx=0).stop 2024-09-12T01:59:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.628+0000 7f823b1cf640 1 -- 172.21.15.19:0/1634217608 shutdown_connections 2024-09-12T01:59:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.628+0000 7f823b1cf640 1 --2- 172.21.15.19:0/1634217608 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f821806be30 0x7f821806e2f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.628+0000 7f823b1cf640 1 --2- 172.21.15.19:0/1634217608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f823415e5f0 0x7f82340b9520 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.628+0000 7f823b1cf640 1 --2- 172.21.15.19:0/1634217608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82340d30f0 0x7f823415c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.628+0000 7f823b1cf640 1 --2- 172.21.15.19:0/1634217608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82340b6690 0x7f8234161880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:12.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.628+0000 7f823b1cf640 1 -- 172.21.15.19:0/1634217608 >> 172.21.15.19:0/1634217608 conn(0x7f823408bfc0 msgr2=0x7f82340d0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:12.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.628+0000 7f823b1cf640 1 -- 172.21.15.19:0/1634217608 shutdown_connections 2024-09-12T01:59:12.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:12.628+0000 7f823b1cf640 1 -- 172.21.15.19:0/1634217608 wait complete. 2024-09-12T01:59:12.640 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-12T01:59:14.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:14.205+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.19:6833/740310996 2024-09-12T01:59:14.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:14.205+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=START_CONNECT pgs=15 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-09-12T01:59:14.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:14.205+0000 7f18a7fff640 1 client.6210 ms_handle_refused on v2:172.21.15.19:6833/740310996 2024-09-12T01:59:17.641 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:59:17.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.757+0000 7f2c9aaaf640 1 Processor -- start 2024-09-12T01:59:17.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.757+0000 7f2c9aaaf640 1 -- start start 2024-09-12T01:59:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.758+0000 7f2c9aaaf640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2c9415b300 0x7f2c940cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.758+0000 7f2c9aaaf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c9406f8d0 0x7f2c9415b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.758+0000 7f2c9aaaf640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c940cdbe0 con 0x7f2c940cd3f0 2024-09-12T01:59:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.758+0000 7f2c9aaaf640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f2c940728a0 con 0x7f2c9415b300 2024-09-12T01:59:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.758+0000 7f2c9aaaf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2c940cd900 con 0x7f2c9406f8d0 2024-09-12T01:59:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.758+0000 7f2c93fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2c940cd3f0 0x7f2c9406f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37738/0 (socket says 172.21.15.19:37738) 2024-09-12T01:59:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.758+0000 7f2c93fff640 1 -- 172.21.15.19:0/843905237 learned_addr learned my addr 172.21.15.19:0/843905237 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:59:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.758+0000 7f2c9904c640 1 --2- 172.21.15.19:0/843905237 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c9406f8d0 0x7f2c9415b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.758+0000 7f2c9884b640 1 --2- 172.21.15.19:0/843905237 >> v2:172.21.15.135:3300/0 conn(0x7f2c9415b300 0x7f2c940cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.758+0000 7f2c937fe640 1 -- 172.21.15.19:0/843905237 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 627907301 0 0) 0x7f2c940cdbe0 con 0x7f2c940cd3f0 2024-09-12T01:59:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.758+0000 7f2c937fe640 1 -- 172.21.15.19:0/843905237 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c84003520 con 0x7f2c940cd3f0 2024-09-12T01:59:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.759+0000 7f2c9904c640 1 -- 172.21.15.19:0/843905237 >> v2:172.21.15.135:3300/0 conn(0x7f2c9415b300 msgr2=0x7f2c940cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.759+0000 7f2c9904c640 1 --2- 172.21.15.19:0/843905237 >> v2:172.21.15.135:3300/0 conn(0x7f2c9415b300 0x7f2c940cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.759+0000 7f2c937fe640 1 -- 172.21.15.19:0/843905237 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3960983953 0 0) 0x7f2c84003520 con 0x7f2c940cd3f0 2024-09-12T01:59:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.759+0000 7f2c9904c640 1 -- 172.21.15.19:0/843905237 >> v1:172.21.15.19:6789/0 conn(0x7f2c940cd3f0 legacy=0x7f2c9406f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.759+0000 7f2c9904c640 1 -- 172.21.15.19:0/843905237 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c94072250 con 0x7f2c9406f8d0 2024-09-12T01:59:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.759+0000 7f2c9884b640 1 --2- 172.21.15.19:0/843905237 >> v2:172.21.15.135:3300/0 conn(0x7f2c9415b300 0x7f2c940cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:17.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.759+0000 7f2c9904c640 1 --2- 172.21.15.19:0/843905237 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c9406f8d0 0x7f2c9415b6e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009d90 tx=0x7f2c8c02a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b092568decadeeb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:17.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.760+0000 7f2c937fe640 1 -- 172.21.15.19:0/843905237 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c80001670 con 0x7f2c9406f8d0 2024-09-12T01:59:17.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.760+0000 7f2c937fe640 1 -- 172.21.15.19:0/843905237 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c8c007540 con 0x7f2c9406f8d0 2024-09-12T01:59:17.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.760+0000 7f2c937fe640 1 -- 172.21.15.19:0/843905237 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c007910 con 0x7f2c9406f8d0 2024-09-12T01:59:17.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.760+0000 7f2c9aaaf640 1 -- 172.21.15.19:0/843905237 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c9406f8d0 msgr2=0x7f2c9415b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:17.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.760+0000 7f2c9aaaf640 1 --2- 172.21.15.19:0/843905237 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c9406f8d0 0x7f2c9415b6e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009d90 tx=0x7f2c8c02a5f0 comp rx=0 tx=0).stop 2024-09-12T01:59:17.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.760+0000 7f2c9aaaf640 1 -- 172.21.15.19:0/843905237 shutdown_connections 2024-09-12T01:59:17.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.760+0000 7f2c9aaaf640 1 --2- 172.21.15.19:0/843905237 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c9406f8d0 0x7f2c9415b6e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:17.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.760+0000 7f2c9aaaf640 1 --2- 172.21.15.19:0/843905237 >> v2:172.21.15.135:3300/0 conn(0x7f2c9415b300 0x7f2c940cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:17.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.760+0000 7f2c9aaaf640 1 -- 172.21.15.19:0/843905237 >> 172.21.15.19:0/843905237 conn(0x7f2c94067d70 msgr2=0x7f2c9406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:17.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.760+0000 7f2c9aaaf640 1 -- 172.21.15.19:0/843905237 shutdown_connections 2024-09-12T01:59:17.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.760+0000 7f2c9aaaf640 1 -- 172.21.15.19:0/843905237 wait complete. 2024-09-12T01:59:17.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.761+0000 7f2c9aaaf640 1 Processor -- start 2024-09-12T01:59:17.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.762+0000 7f2c9aaaf640 1 -- start start 2024-09-12T01:59:17.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.762+0000 7f2c9aaaf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c9406f8d0 0x7f2c941403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:17.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.762+0000 7f2c9aaaf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c940cd3f0 0x7f2c9413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:17.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.762+0000 7f2c9aaaf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c9415b300 0x7f2c94141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:17.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.762+0000 7f2c9aaaf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2c940d0160 con 0x7f2c9406f8d0 2024-09-12T01:59:17.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.762+0000 7f2c9aaaf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2c940cffe0 con 0x7f2c940cd3f0 2024-09-12T01:59:17.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.762+0000 7f2c9aaaf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2c94072d30 con 0x7f2c9415b300 2024-09-12T01:59:17.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.763+0000 7f2c9884b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c9406f8d0 0x7f2c941403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:17.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.763+0000 7f2c9884b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c9406f8d0 0x7f2c941403f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41952/0 (socket says 172.21.15.19:41952) 2024-09-12T01:59:17.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.763+0000 7f2c9884b640 1 -- 172.21.15.19:0/3613338147 learned_addr learned my addr 172.21.15.19:0/3613338147 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:17.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.763+0000 7f2c93fff640 1 --2- 172.21.15.19:0/3613338147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c940cd3f0 0x7f2c9413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:17.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.763+0000 7f2c9904c640 1 --2- 172.21.15.19:0/3613338147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c9415b300 0x7f2c94141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:17.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.763+0000 7f2c9884b640 1 -- 172.21.15.19:0/3613338147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c9415b300 msgr2=0x7f2c94141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:17.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.763+0000 7f2c9884b640 1 --2- 172.21.15.19:0/3613338147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c9415b300 0x7f2c94141140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:17.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.763+0000 7f2c9884b640 1 -- 172.21.15.19:0/3613338147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c940cd3f0 msgr2=0x7f2c9413e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:17.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.763+0000 7f2c9884b640 1 --2- 172.21.15.19:0/3613338147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c940cd3f0 0x7f2c9413e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:17.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.763+0000 7f2c9884b640 1 -- 172.21.15.19:0/3613338147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9413f350 con 0x7f2c9406f8d0 2024-09-12T01:59:17.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.763+0000 7f2c93fff640 1 --2- 172.21.15.19:0/3613338147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c940cd3f0 0x7f2c9413e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:59:17.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.763+0000 7f2c9904c640 1 --2- 172.21.15.19:0/3613338147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c9415b300 0x7f2c94141140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:59:17.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.763+0000 7f2c9884b640 1 --2- 172.21.15.19:0/3613338147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c9406f8d0 0x7f2c941403f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800e960 tx=0x7f2c8800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:17.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.763+0000 7f2c917fa640 1 -- 172.21.15.19:0/3613338147 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c88017070 con 0x7f2c9406f8d0 2024-09-12T01:59:17.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.763+0000 7f2c917fa640 1 -- 172.21.15.19:0/3613338147 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c8800ca00 con 0x7f2c9406f8d0 2024-09-12T01:59:17.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.763+0000 7f2c9aaaf640 1 -- 172.21.15.19:0/3613338147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c9413f630 con 0x7f2c9406f8d0 2024-09-12T01:59:17.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.763+0000 7f2c917fa640 1 -- 172.21.15.19:0/3613338147 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8800cdd0 con 0x7f2c9406f8d0 2024-09-12T01:59:17.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.763+0000 7f2c9aaaf640 1 -- 172.21.15.19:0/3613338147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c9413fbf0 con 0x7f2c9406f8d0 2024-09-12T01:59:17.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.764+0000 7f2c9aaaf640 1 -- 172.21.15.19:0/3613338147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c940cdb80 con 0x7f2c9406f8d0 2024-09-12T01:59:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.765+0000 7f2c917fa640 1 -- 172.21.15.19:0/3613338147 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c8801a070 con 0x7f2c9406f8d0 2024-09-12T01:59:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.765+0000 7f2c917fa640 1 --2- 172.21.15.19:0/3613338147 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2c7806be30 0x7f2c7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.766+0000 7f2c917fa640 1 -- 172.21.15.19:0/3613338147 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7f2c8808b2e0 con 0x7f2c9406f8d0 2024-09-12T01:59:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.766+0000 7f2c93fff640 1 --2- 172.21.15.19:0/3613338147 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2c7806be30 0x7f2c7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.766+0000 7f2c93fff640 1 --2- 172.21.15.19:0/3613338147 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2c7806be30 0x7f2c7806e2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2c9414ffc0 tx=0x7f2c80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:17.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.770+0000 7f2c917fa640 1 -- 172.21.15.19:0/3613338147 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c88059a40 con 0x7f2c9406f8d0 2024-09-12T01:59:17.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.982+0000 7f2c9aaaf640 1 -- 172.21.15.19:0/3613338147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c940b47c0 con 0x7f2c9406f8d0 2024-09-12T01:59:17.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.982+0000 7f2c917fa640 1 -- 172.21.15.19:0/3613338147 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5273 (secure 0 0 0) 0x7f2c88059340 con 0x7f2c9406f8d0 2024-09-12T01:59:17.983 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:59:17.983 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":50,"btime":"2024-09-12T01:59:16:683896+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2176310149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2176310149},{"type":"v1","addr":"172.21.15.135:6836","nonce":2176310149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/222313950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":222313950},{"type":"v1","addr":"172.21.15.135:6837","nonce":222313950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/2113904472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2113904472},{"type":"v1","addr":"172.21.15.19:6834","nonce":2113904472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:58:31.431304+0000","modified":"2024-09-12T01:59:16.683854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6120":{"gid":6120,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.19:6835/740310996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":740310996},{"type":"v1","addr":"172.21.15.19:6835","nonce":740310996}]},"join_fscid":-1,"laggy_since":"2024-09-12T01:59:16.683854+0000","export_targets":[],"features":4540701547738038271,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6120,"qdb_cluster":[6120]},"id":4}]} 2024-09-12T01:59:17.985 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 50 2024-09-12T01:59:17.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.984+0000 7f2c9aaaf640 1 -- 172.21.15.19:0/3613338147 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2c7806be30 msgr2=0x7f2c7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:17.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.984+0000 7f2c9aaaf640 1 --2- 172.21.15.19:0/3613338147 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2c7806be30 0x7f2c7806e2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2c9414ffc0 tx=0x7f2c80009040 comp rx=0 tx=0).stop 2024-09-12T01:59:17.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.984+0000 7f2c9aaaf640 1 -- 172.21.15.19:0/3613338147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c9406f8d0 msgr2=0x7f2c941403f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:17.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.984+0000 7f2c9aaaf640 1 --2- 172.21.15.19:0/3613338147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c9406f8d0 0x7f2c941403f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800e960 tx=0x7f2c8800ee20 comp rx=0 tx=0).stop 2024-09-12T01:59:17.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.984+0000 7f2c9aaaf640 1 -- 172.21.15.19:0/3613338147 shutdown_connections 2024-09-12T01:59:17.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.984+0000 7f2c9aaaf640 1 --2- 172.21.15.19:0/3613338147 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2c7806be30 0x7f2c7806e2f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:17.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.984+0000 7f2c9aaaf640 1 --2- 172.21.15.19:0/3613338147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c9415b300 0x7f2c94141140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:17.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.984+0000 7f2c9aaaf640 1 --2- 172.21.15.19:0/3613338147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c940cd3f0 0x7f2c9413e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:17.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.984+0000 7f2c9aaaf640 1 --2- 172.21.15.19:0/3613338147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c9406f8d0 0x7f2c941403f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:17.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.984+0000 7f2c9aaaf640 1 -- 172.21.15.19:0/3613338147 >> 172.21.15.19:0/3613338147 conn(0x7f2c94067d70 msgr2=0x7f2c9415c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:17.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.984+0000 7f2c9aaaf640 1 -- 172.21.15.19:0/3613338147 shutdown_connections 2024-09-12T01:59:17.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:17.984+0000 7f2c9aaaf640 1 -- 172.21.15.19:0/3613338147 wait complete. 2024-09-12T01:59:17.996 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2024-09-12T01:59:18.097 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_inject_journal_corrupt_dentry_first 2024-09-12T01:59:18.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.202+0000 7f16c9ac9640 1 Processor -- start 2024-09-12T01:59:18.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.203+0000 7f16c9ac9640 1 -- start start 2024-09-12T01:59:18.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.203+0000 7f16c9ac9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f16c4162e30 0x7f16c406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:18.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.203+0000 7f16c9ac9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f16c40cf280 0x7f16c40d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.203+0000 7f16c9ac9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16c415ff70 con 0x7f16c4162340 2024-09-12T01:59:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.203+0000 7f16c9ac9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f16c406de90 con 0x7f16c4162e30 2024-09-12T01:59:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.203+0000 7f16c9ac9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f16c4163270 con 0x7f16c40cf280 2024-09-12T01:59:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.204+0000 7f16c2ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f16c4162e30 0x7f16c406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.204+0000 7f16c37fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f16c4162340 0x7f16c4162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37740/0 (socket says 172.21.15.19:37740) 2024-09-12T01:59:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.204+0000 7f16c37fe640 1 -- 172.21.15.19:0/746152753 learned_addr learned my addr 172.21.15.19:0/746152753 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:59:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.204+0000 7f16c3fff640 1 --2- 172.21.15.19:0/746152753 >> v2:172.21.15.135:3300/0 conn(0x7f16c40cf280 0x7f16c40d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.204+0000 7f16c2ffd640 1 -- 172.21.15.19:0/746152753 >> v2:172.21.15.135:3300/0 conn(0x7f16c40cf280 msgr2=0x7f16c40d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.204+0000 7f16c2ffd640 1 --2- 172.21.15.19:0/746152753 >> v2:172.21.15.135:3300/0 conn(0x7f16c40cf280 0x7f16c40d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.204+0000 7f16c2ffd640 1 -- 172.21.15.19:0/746152753 >> v1:172.21.15.19:6789/0 conn(0x7f16c4162340 legacy=0x7f16c4162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.204+0000 7f16c2ffd640 1 -- 172.21.15.19:0/746152753 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c40d4d10 con 0x7f16c4162e30 2024-09-12T01:59:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.204+0000 7f16c27fc640 1 -- 172.21.15.19:0/746152753 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 587017568 0 0) 0x7f16c415ff70 con 0x7f16c4162340 2024-09-12T01:59:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.205+0000 7f16c2ffd640 1 --2- 172.21.15.19:0/746152753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16c4162e30 0x7f16c406d740 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f16c406c3d0 tx=0x7f16b802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a11e1e9efca61a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.205+0000 7f16c27fc640 1 -- 172.21.15.19:0/746152753 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8037070 con 0x7f16c4162e30 2024-09-12T01:59:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.205+0000 7f16c27fc640 1 -- 172.21.15.19:0/746152753 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b8032440 con 0x7f16c4162e30 2024-09-12T01:59:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.205+0000 7f16c27fc640 1 -- 172.21.15.19:0/746152753 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b802ae60 con 0x7f16c4162e30 2024-09-12T01:59:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.205+0000 7f16c9ac9640 1 -- 172.21.15.19:0/746152753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16c4162e30 msgr2=0x7f16c406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.205+0000 7f16c9ac9640 1 --2- 172.21.15.19:0/746152753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16c4162e30 0x7f16c406d740 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f16c406c3d0 tx=0x7f16b802a110 comp rx=0 tx=0).stop 2024-09-12T01:59:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.205+0000 7f16c9ac9640 1 -- 172.21.15.19:0/746152753 shutdown_connections 2024-09-12T01:59:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.205+0000 7f16c9ac9640 1 --2- 172.21.15.19:0/746152753 >> v2:172.21.15.135:3300/0 conn(0x7f16c40cf280 0x7f16c40d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.205+0000 7f16c9ac9640 1 --2- 172.21.15.19:0/746152753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16c4162e30 0x7f16c406d740 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.205+0000 7f16c9ac9640 1 -- 172.21.15.19:0/746152753 >> 172.21.15.19:0/746152753 conn(0x7f16c408bfc0 msgr2=0x7f16c40d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.205+0000 7f16c9ac9640 1 -- 172.21.15.19:0/746152753 shutdown_connections 2024-09-12T01:59:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.205+0000 7f16c9ac9640 1 -- 172.21.15.19:0/746152753 wait complete. 2024-09-12T01:59:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.206+0000 7f16c9ac9640 1 Processor -- start 2024-09-12T01:59:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.207+0000 7f16c9ac9640 1 -- start start 2024-09-12T01:59:18.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.207+0000 7f16c9ac9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c40cf280 0x7f16c415b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:18.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.207+0000 7f16c9ac9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16c4162340 0x7f16c40b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.207+0000 7f16c9ac9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16c4162e30 0x7f16c40cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.207+0000 7f16c9ac9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f16c40cf6f0 con 0x7f16c4162340 2024-09-12T01:59:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.207+0000 7f16c9ac9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f16c40d2470 con 0x7f16c4162e30 2024-09-12T01:59:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.207+0000 7f16c9ac9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f16c40d52d0 con 0x7f16c40cf280 2024-09-12T01:59:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.208+0000 7f16c2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16c4162340 0x7f16c40b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.208+0000 7f16c2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16c4162340 0x7f16c40b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41966/0 (socket says 172.21.15.19:41966) 2024-09-12T01:59:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.208+0000 7f16c2ffd640 1 -- 172.21.15.19:0/2239514165 learned_addr learned my addr 172.21.15.19:0/2239514165 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.208+0000 7f16c3fff640 1 --2- 172.21.15.19:0/2239514165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16c4162e30 0x7f16c40cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.208+0000 7f16c37fe640 1 --2- 172.21.15.19:0/2239514165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c40cf280 0x7f16c415b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.208+0000 7f16c2ffd640 1 -- 172.21.15.19:0/2239514165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c40cf280 msgr2=0x7f16c415b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.208+0000 7f16c2ffd640 1 --2- 172.21.15.19:0/2239514165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c40cf280 0x7f16c415b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.208+0000 7f16c2ffd640 1 -- 172.21.15.19:0/2239514165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16c4162e30 msgr2=0x7f16c40cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.208+0000 7f16c2ffd640 1 --2- 172.21.15.19:0/2239514165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16c4162e30 0x7f16c40cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.208+0000 7f16c2ffd640 1 -- 172.21.15.19:0/2239514165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c40ccfb0 con 0x7f16c4162340 2024-09-12T01:59:18.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.208+0000 7f16c3fff640 1 --2- 172.21.15.19:0/2239514165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16c4162e30 0x7f16c40cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:59:18.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.208+0000 7f16c2ffd640 1 --2- 172.21.15.19:0/2239514165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16c4162340 0x7f16c40b6b00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f16b8035040 tx=0x7f16b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:18.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.208+0000 7f16abfff640 1 -- 172.21.15.19:0/2239514165 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8040020 con 0x7f16c4162340 2024-09-12T01:59:18.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.208+0000 7f16abfff640 1 -- 172.21.15.19:0/2239514165 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b8038040 con 0x7f16c4162340 2024-09-12T01:59:18.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.208+0000 7f16abfff640 1 -- 172.21.15.19:0/2239514165 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8037070 con 0x7f16c4162340 2024-09-12T01:59:18.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.208+0000 7f16c9ac9640 1 -- 172.21.15.19:0/2239514165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c4161cc0 con 0x7f16c4162340 2024-09-12T01:59:18.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.208+0000 7f16c9ac9640 1 -- 172.21.15.19:0/2239514165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c40cd250 con 0x7f16c4162340 2024-09-12T01:59:18.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.209+0000 7f16c9ac9640 1 -- 172.21.15.19:0/2239514165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16c406d740 con 0x7f16c4162340 2024-09-12T01:59:18.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.210+0000 7f16abfff640 1 -- 172.21.15.19:0/2239514165 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f16b8043020 con 0x7f16c4162340 2024-09-12T01:59:18.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.210+0000 7f16abfff640 1 --2- 172.21.15.19:0/2239514165 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f16b006be30 0x7f16b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:18.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.211+0000 7f16abfff640 1 -- 172.21.15.19:0/2239514165 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7f16b80ab430 con 0x7f16c4162340 2024-09-12T01:59:18.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.211+0000 7f16c37fe640 1 --2- 172.21.15.19:0/2239514165 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f16b006be30 0x7f16b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:18.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.211+0000 7f16c37fe640 1 --2- 172.21.15.19:0/2239514165 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f16b006be30 0x7f16b006e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f16b4000f60 tx=0x7f16b4007b70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:18.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.215+0000 7f16abfff640 1 -- 172.21.15.19:0/2239514165 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f16b804a070 con 0x7f16c4162340 2024-09-12T01:59:18.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.391+0000 7f16c9ac9640 1 -- 172.21.15.19:0/2239514165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_inject_journal_corrupt_dentry_first"} v 0) -- 0x7f16c408e640 con 0x7f16c4162340 2024-09-12T01:59:18.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.394+0000 7f16abfff640 1 -- 172.21.15.19:0/2239514165 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_inject_journal_corrupt_dentry_first"}]=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f16b8032e20 con 0x7f16c4162340 2024-09-12T01:59:18.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.396+0000 7f16c9ac9640 1 -- 172.21.15.19:0/2239514165 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f16b006be30 msgr2=0x7f16b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:18.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.396+0000 7f16c9ac9640 1 --2- 172.21.15.19:0/2239514165 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f16b006be30 0x7f16b006e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f16b4000f60 tx=0x7f16b4007b70 comp rx=0 tx=0).stop 2024-09-12T01:59:18.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.396+0000 7f16c9ac9640 1 -- 172.21.15.19:0/2239514165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16c4162340 msgr2=0x7f16c40b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:18.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.396+0000 7f16c9ac9640 1 --2- 172.21.15.19:0/2239514165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16c4162340 0x7f16c40b6b00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f16b8035040 tx=0x7f16b80046c0 comp rx=0 tx=0).stop 2024-09-12T01:59:18.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.396+0000 7f16c9ac9640 1 -- 172.21.15.19:0/2239514165 shutdown_connections 2024-09-12T01:59:18.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.396+0000 7f16c9ac9640 1 --2- 172.21.15.19:0/2239514165 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f16b006be30 0x7f16b006e2f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:18.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.396+0000 7f16c9ac9640 1 --2- 172.21.15.19:0/2239514165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16c4162e30 0x7f16c40cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:18.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.396+0000 7f16c9ac9640 1 --2- 172.21.15.19:0/2239514165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16c4162340 0x7f16c40b6b00 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:18.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.396+0000 7f16c9ac9640 1 --2- 172.21.15.19:0/2239514165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c40cf280 0x7f16c415b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:18.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.396+0000 7f16c9ac9640 1 -- 172.21.15.19:0/2239514165 >> 172.21.15.19:0/2239514165 conn(0x7f16c408bfc0 msgr2=0x7f16c40d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:18.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.397+0000 7f16c9ac9640 1 -- 172.21.15.19:0/2239514165 shutdown_connections 2024-09-12T01:59:18.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.397+0000 7f16c9ac9640 1 -- 172.21.15.19:0/2239514165 wait complete. 2024-09-12T01:59:18.408 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 4:0 false 2024-09-12T01:59:18.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.512+0000 7fe223037640 1 Processor -- start 2024-09-12T01:59:18.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.512+0000 7fe223037640 1 -- start start 2024-09-12T01:59:18.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.513+0000 7fe223037640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe21c0d3140 0x7fe21c0d1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:18.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.513+0000 7fe223037640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe21c15e4f0 0x7fe21c0cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:18.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.513+0000 7fe223037640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c0d0a10 con 0x7fe21c15e110 2024-09-12T01:59:18.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.513+0000 7fe223037640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe21c0d1620 con 0x7fe21c15e4f0 2024-09-12T01:59:18.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.513+0000 7fe223037640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe21c0d0cf0 con 0x7fe21c0d3140 2024-09-12T01:59:18.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.513+0000 7fe2215d4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe21c15e4f0 0x7fe21c0cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:18.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.513+0000 7fe21bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe21c0d3140 0x7fe21c0d1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:18.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.513+0000 7fe220dd3640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fe21c15e110 0x7fe21c0d2a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:45672/0 (socket says 172.21.15.19:45672) 2024-09-12T01:59:18.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.513+0000 7fe220dd3640 1 -- 172.21.15.19:0/2039978374 learned_addr learned my addr 172.21.15.19:0/2039978374 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:59:18.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.513+0000 7fe21bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe21c0d3140 0x7fe21c0d1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:37232/0 (socket says 172.21.15.19:37232) 2024-09-12T01:59:18.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.514+0000 7fe21b7fe640 1 -- 172.21.15.19:0/2039978374 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2812669045 0 0) 0x7fe21c0d0a10 con 0x7fe21c15e110 2024-09-12T01:59:18.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.514+0000 7fe21b7fe640 1 -- 172.21.15.19:0/2039978374 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe204003520 con 0x7fe21c15e110 2024-09-12T01:59:18.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.514+0000 7fe21bfff640 1 -- 172.21.15.19:0/2039978374 >> v2:172.21.15.135:3300/0 conn(0x7fe21c15e4f0 msgr2=0x7fe21c0cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:18.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.514+0000 7fe21bfff640 1 --2- 172.21.15.19:0/2039978374 >> v2:172.21.15.135:3300/0 conn(0x7fe21c15e4f0 0x7fe21c0cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:18.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.514+0000 7fe21bfff640 1 -- 172.21.15.19:0/2039978374 >> v1:172.21.15.135:6789/0 conn(0x7fe21c15e110 legacy=0x7fe21c0d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:18.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.514+0000 7fe21bfff640 1 -- 172.21.15.19:0/2039978374 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c0d0fd0 con 0x7fe21c0d3140 2024-09-12T01:59:18.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.514+0000 7fe2215d4640 1 --2- 172.21.15.19:0/2039978374 >> v2:172.21.15.135:3300/0 conn(0x7fe21c15e4f0 0x7fe21c0cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:18.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.515+0000 7fe21bfff640 1 --2- 172.21.15.19:0/2039978374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe21c0d3140 0x7fe21c0d1ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe2100097a0 tx=0x7fe21002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=599645594aee3add server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:18.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.515+0000 7fe21b7fe640 1 -- 172.21.15.19:0/2039978374 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe210037070 con 0x7fe21c0d3140 2024-09-12T01:59:18.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.515+0000 7fe21b7fe640 1 -- 172.21.15.19:0/2039978374 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe210032440 con 0x7fe21c0d3140 2024-09-12T01:59:18.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.515+0000 7fe21b7fe640 1 -- 172.21.15.19:0/2039978374 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe210032810 con 0x7fe21c0d3140 2024-09-12T01:59:18.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.515+0000 7fe223037640 1 -- 172.21.15.19:0/2039978374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe21c0d3140 msgr2=0x7fe21c0d1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:18.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.515+0000 7fe223037640 1 --2- 172.21.15.19:0/2039978374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe21c0d3140 0x7fe21c0d1ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe2100097a0 tx=0x7fe21002a180 comp rx=0 tx=0).stop 2024-09-12T01:59:18.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.515+0000 7fe223037640 1 -- 172.21.15.19:0/2039978374 shutdown_connections 2024-09-12T01:59:18.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.515+0000 7fe223037640 1 --2- 172.21.15.19:0/2039978374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe21c0d3140 0x7fe21c0d1ab0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:18.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.515+0000 7fe223037640 1 --2- 172.21.15.19:0/2039978374 >> v2:172.21.15.135:3300/0 conn(0x7fe21c15e4f0 0x7fe21c0cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:18.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.515+0000 7fe223037640 1 -- 172.21.15.19:0/2039978374 >> 172.21.15.19:0/2039978374 conn(0x7fe21c08bfc0 msgr2=0x7fe21c0d44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:18.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.515+0000 7fe223037640 1 -- 172.21.15.19:0/2039978374 shutdown_connections 2024-09-12T01:59:18.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.515+0000 7fe223037640 1 -- 172.21.15.19:0/2039978374 wait complete. 2024-09-12T01:59:18.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.517+0000 7fe223037640 1 Processor -- start 2024-09-12T01:59:18.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.517+0000 7fe223037640 1 -- start start 2024-09-12T01:59:18.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.517+0000 7fe223037640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe21c0d3140 0x7fe21c0c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:18.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe223037640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe21c15e110 0x7fe21c0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:18.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe223037640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe21c15e4f0 0x7fe21c1f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:18.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe223037640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c0d0300 con 0x7fe21c15e4f0 2024-09-12T01:59:18.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe223037640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c15e930 con 0x7fe21c0d3140 2024-09-12T01:59:18.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe223037640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe21c0d0480 con 0x7fe21c15e110 2024-09-12T01:59:18.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe2215d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe21c15e4f0 0x7fe21c1f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:18.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe2215d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe21c15e4f0 0x7fe21c1f42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41980/0 (socket says 172.21.15.19:41980) 2024-09-12T01:59:18.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe2215d4640 1 -- 172.21.15.19:0/4249216208 learned_addr learned my addr 172.21.15.19:0/4249216208 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:18.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe21bfff640 1 --2- 172.21.15.19:0/4249216208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe21c15e110 0x7fe21c0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:18.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe220dd3640 1 --2- 172.21.15.19:0/4249216208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe21c0d3140 0x7fe21c0c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:18.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe2215d4640 1 -- 172.21.15.19:0/4249216208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe21c15e110 msgr2=0x7fe21c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:18.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe2215d4640 1 --2- 172.21.15.19:0/4249216208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe21c15e110 0x7fe21c0cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:18.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe2215d4640 1 -- 172.21.15.19:0/4249216208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe21c0d3140 msgr2=0x7fe21c0c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:18.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe2215d4640 1 --2- 172.21.15.19:0/4249216208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe21c0d3140 0x7fe21c0c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:18.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe2215d4640 1 -- 172.21.15.19:0/4249216208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c0c8270 con 0x7fe21c15e4f0 2024-09-12T01:59:18.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe21bfff640 1 --2- 172.21.15.19:0/4249216208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe21c15e110 0x7fe21c0cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:18.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe2215d4640 1 --2- 172.21.15.19:0/4249216208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe21c15e4f0 0x7fe21c1f42a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe214009f00 tx=0x7fe21400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:18.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe2197fa640 1 -- 172.21.15.19:0/4249216208 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214018030 con 0x7fe21c15e4f0 2024-09-12T01:59:18.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe2197fa640 1 -- 172.21.15.19:0/4249216208 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe21400cdf0 con 0x7fe21c15e4f0 2024-09-12T01:59:18.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe223037640 1 -- 172.21.15.19:0/4249216208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21c0c8550 con 0x7fe21c15e4f0 2024-09-12T01:59:18.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.518+0000 7fe2197fa640 1 -- 172.21.15.19:0/4249216208 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214003bb0 con 0x7fe21c15e4f0 2024-09-12T01:59:18.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.519+0000 7fe223037640 1 -- 172.21.15.19:0/4249216208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe21c0c8b10 con 0x7fe21c15e4f0 2024-09-12T01:59:18.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.520+0000 7fe223037640 1 -- 172.21.15.19:0/4249216208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe21c0d1ab0 con 0x7fe21c15e4f0 2024-09-12T01:59:18.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.520+0000 7fe2197fa640 1 -- 172.21.15.19:0/4249216208 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe21401b070 con 0x7fe21c15e4f0 2024-09-12T01:59:18.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.521+0000 7fe2197fa640 1 --2- 172.21.15.19:0/4249216208 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe20806be30 0x7fe20806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:18.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.521+0000 7fe2197fa640 1 -- 172.21.15.19:0/4249216208 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6303+0+0 (secure 0 0 0) 0x7fe21408b930 con 0x7fe21c15e4f0 2024-09-12T01:59:18.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.521+0000 7fe220dd3640 1 --2- 172.21.15.19:0/4249216208 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe20806be30 0x7fe20806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:18.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.521+0000 7fe220dd3640 1 --2- 172.21.15.19:0/4249216208 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe20806be30 0x7fe20806e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe20c005880 tx=0x7fe20c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:18.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.525+0000 7fe2197fa640 1 -- 172.21.15.19:0/4249216208 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe214010040 con 0x7fe21c15e4f0 2024-09-12T01:59:18.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:18.772+0000 7fe223037640 1 -- 172.21.15.19:0/4249216208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "4:0", "val": "false"} v 0) -- 0x7fe21c06d370 con 0x7fe21c15e4f0 2024-09-12T01:59:18.846 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2024-09-12T01:59:19.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:19.694+0000 7fe2197fa640 1 -- 172.21.15.19:0/4249216208 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "4:0", "val": "false"}]=0 unfreezing mds.6120 v51) ==== 115+0+0 (secure 0 0 0) 0x7fe214059ad0 con 0x7fe21c15e4f0 2024-09-12T01:59:19.695 INFO:teuthology.orchestra.run.smithi019.stderr:unfreezing mds.6120 2024-09-12T01:59:19.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:19.697+0000 7fe223037640 1 -- 172.21.15.19:0/4249216208 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe20806be30 msgr2=0x7fe20806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:19.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:19.697+0000 7fe223037640 1 --2- 172.21.15.19:0/4249216208 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe20806be30 0x7fe20806e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe20c005880 tx=0x7fe20c009040 comp rx=0 tx=0).stop 2024-09-12T01:59:19.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:19.697+0000 7fe223037640 1 -- 172.21.15.19:0/4249216208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe21c15e4f0 msgr2=0x7fe21c1f42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:19.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:19.697+0000 7fe223037640 1 --2- 172.21.15.19:0/4249216208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe21c15e4f0 0x7fe21c1f42a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe214009f00 tx=0x7fe21400c490 comp rx=0 tx=0).stop 2024-09-12T01:59:19.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:19.698+0000 7fe223037640 1 -- 172.21.15.19:0/4249216208 shutdown_connections 2024-09-12T01:59:19.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:19.698+0000 7fe223037640 1 --2- 172.21.15.19:0/4249216208 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe20806be30 0x7fe20806e2f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:19.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:19.698+0000 7fe223037640 1 --2- 172.21.15.19:0/4249216208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe21c15e4f0 0x7fe21c1f42a0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:19.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:19.698+0000 7fe223037640 1 --2- 172.21.15.19:0/4249216208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe21c15e110 0x7fe21c0cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:19.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:19.698+0000 7fe223037640 1 --2- 172.21.15.19:0/4249216208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe21c0d3140 0x7fe21c0c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:19.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:19.698+0000 7fe223037640 1 -- 172.21.15.19:0/4249216208 >> 172.21.15.19:0/4249216208 conn(0x7fe21c08bfc0 msgr2=0x7fe21c0b84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:19.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:19.698+0000 7fe223037640 1 -- 172.21.15.19:0/4249216208 shutdown_connections 2024-09-12T01:59:19.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:19.698+0000 7fe223037640 1 -- 172.21.15.19:0/4249216208 wait complete. 2024-09-12T01:59:19.716 DEBUG:teuthology.orchestra.run.smithi019:> sudo sysctl -n kernel.core_pattern 2024-09-12T01:59:19.743 INFO:teuthology.orchestra.run.smithi019.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:59:19.744 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:59:19.745 DEBUG:teuthology.orchestra.run.smithi019:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2024-09-12T01:59:19.815 INFO:teuthology.orchestra.run.smithi019.stdout:1726106341.54652.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/proc/self/exe', platform: 'x86_64' 2024-09-12T01:59:19.818 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1726106341.54652.core'] 2024-09-12T01:59:19.818 INFO:tasks.cephfs.cephfs_test_case:Found core file 1726106341.54652.core, deleting it 2024-09-12T01:59:19.818 DEBUG:teuthology.orchestra.run.smithi019:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1726106341.54652.core 2024-09-12T01:59:19.888 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T01:59:19.888 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T01:59:19.888 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T01:59:19.888 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:59:19.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:59:19.889 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/daemon/state.py", line 146, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2024-09-12T01:59:19.890 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T01:59:19.890 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T01:59:19.931 INFO:tasks.ceph.mds.c:Started 2024-09-12T01:59:19.931 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:59:20.010 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T01:59:20.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.036+0000 7f8ae8d66640 1 Processor -- start 2024-09-12T01:59:20.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.036+0000 7f8ae8d66640 1 -- start start 2024-09-12T01:59:20.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.037+0000 7f8ae8d66640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8ae415e5b0 0x7f8ae40b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:20.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.037+0000 7f8ae8d66640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ae40ae140 0x7f8ae40ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:20.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.037+0000 7f8ae8d66640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ae40aeb10 con 0x7f8ae415e990 2024-09-12T01:59:20.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.037+0000 7f8ae8d66640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8ae40b2c30 con 0x7f8ae415e5b0 2024-09-12T01:59:20.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.037+0000 7f8ae8d66640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae40b17f0 con 0x7f8ae40ae140 2024-09-12T01:59:20.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.037+0000 7f8ae259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8ae415e5b0 0x7f8ae40b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:20.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.037+0000 7f8ae259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8ae415e5b0 0x7f8ae40b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42012/0 (socket says 172.21.15.19:42012) 2024-09-12T01:59:20.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.037+0000 7f8ae259c640 1 -- 172.21.15.19:0/372523785 learned_addr learned my addr 172.21.15.19:0/372523785 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:20.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.037+0000 7f8ae2d9d640 1 --2- 172.21.15.19:0/372523785 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ae40ae140 0x7f8ae40ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:20.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.037+0000 7f8ae259c640 1 -- 172.21.15.19:0/372523785 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ae40ae140 msgr2=0x7f8ae40ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:20.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.037+0000 7f8ae259c640 1 --2- 172.21.15.19:0/372523785 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ae40ae140 0x7f8ae40ae5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:20.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.037+0000 7f8ae259c640 1 -- 172.21.15.19:0/372523785 >> v1:172.21.15.135:6789/0 conn(0x7f8ae415e990 legacy=0x7f8ae40b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:20.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.037+0000 7f8ae259c640 1 -- 172.21.15.19:0/372523785 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae40b6520 con 0x7f8ae415e5b0 2024-09-12T01:59:20.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.038+0000 7f8ae259c640 1 --2- 172.21.15.19:0/372523785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ae415e5b0 0x7f8ae40b5f40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009870 tx=0x7f8ad402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7602c4d387c46c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:20.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.038+0000 7f8ae1d9b640 1 -- 172.21.15.19:0/372523785 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4037070 con 0x7f8ae415e5b0 2024-09-12T01:59:20.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.038+0000 7f8ae1d9b640 1 -- 172.21.15.19:0/372523785 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad4032440 con 0x7f8ae415e5b0 2024-09-12T01:59:20.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.038+0000 7f8ae1d9b640 1 -- 172.21.15.19:0/372523785 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4032810 con 0x7f8ae415e5b0 2024-09-12T01:59:20.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.039+0000 7f8ae8d66640 1 -- 172.21.15.19:0/372523785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ae415e5b0 msgr2=0x7f8ae40b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:20.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.039+0000 7f8ae8d66640 1 --2- 172.21.15.19:0/372523785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ae415e5b0 0x7f8ae40b5f40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009870 tx=0x7f8ad402a210 comp rx=0 tx=0).stop 2024-09-12T01:59:20.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.039+0000 7f8ae8d66640 1 -- 172.21.15.19:0/372523785 shutdown_connections 2024-09-12T01:59:20.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.039+0000 7f8ae8d66640 1 --2- 172.21.15.19:0/372523785 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ae40ae140 0x7f8ae40ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:20.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.039+0000 7f8ae8d66640 1 --2- 172.21.15.19:0/372523785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ae415e5b0 0x7f8ae40b5f40 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:20.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.039+0000 7f8ae8d66640 1 -- 172.21.15.19:0/372523785 >> 172.21.15.19:0/372523785 conn(0x7f8ae4073490 msgr2=0x7f8ae40b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:20.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.039+0000 7f8ae8d66640 1 -- 172.21.15.19:0/372523785 shutdown_connections 2024-09-12T01:59:20.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.039+0000 7f8ae8d66640 1 -- 172.21.15.19:0/372523785 wait complete. 2024-09-12T01:59:20.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.040+0000 7f8ae8d66640 1 Processor -- start 2024-09-12T01:59:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.040+0000 7f8ae8d66640 1 -- start start 2024-09-12T01:59:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8ae8d66640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ae40ae140 0x7f8ae40caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8ae8d66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ae415e5b0 0x7f8ae4153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8ae8d66640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ae415e990 0x7f8ae4151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8ae8d66640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae40b2000 con 0x7f8ae415e5b0 2024-09-12T01:59:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8ae8d66640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae40b1d20 con 0x7f8ae40ae140 2024-09-12T01:59:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8ae8d66640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae40b0490 con 0x7f8ae415e990 2024-09-12T01:59:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8adbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ae415e5b0 0x7f8ae4153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8adbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ae415e5b0 0x7f8ae4153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42024/0 (socket says 172.21.15.19:42024) 2024-09-12T01:59:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8adbfff640 1 -- 172.21.15.19:0/2745729097 learned_addr learned my addr 172.21.15.19:0/2745729097 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8ae2d9d640 1 --2- 172.21.15.19:0/2745729097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ae415e990 0x7f8ae4151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8ae259c640 1 --2- 172.21.15.19:0/2745729097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ae40ae140 0x7f8ae40caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8adbfff640 1 -- 172.21.15.19:0/2745729097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ae415e990 msgr2=0x7f8ae4151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8adbfff640 1 --2- 172.21.15.19:0/2745729097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ae415e990 0x7f8ae4151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8adbfff640 1 -- 172.21.15.19:0/2745729097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ae40ae140 msgr2=0x7f8ae40caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8adbfff640 1 --2- 172.21.15.19:0/2745729097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ae40ae140 0x7f8ae40caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8adbfff640 1 -- 172.21.15.19:0/2745729097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae415d1f0 con 0x7f8ae415e5b0 2024-09-12T01:59:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8ae2d9d640 1 --2- 172.21.15.19:0/2745729097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ae415e990 0x7f8ae4151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:59:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8ae259c640 1 --2- 172.21.15.19:0/2745729097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ae40ae140 0x7f8ae40caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:59:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.041+0000 7f8adbfff640 1 --2- 172.21.15.19:0/2745729097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ae415e5b0 0x7f8ae4153a20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8acc00b3f0 tx=0x7f8acc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.042+0000 7f8adaffd640 1 -- 172.21.15.19:0/2745729097 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc015020 con 0x7f8ae415e5b0 2024-09-12T01:59:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.042+0000 7f8adaffd640 1 -- 172.21.15.19:0/2745729097 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8acc011830 con 0x7f8ae415e5b0 2024-09-12T01:59:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.042+0000 7f8ae8d66640 1 -- 172.21.15.19:0/2745729097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae415d4b0 con 0x7f8ae415e5b0 2024-09-12T01:59:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.042+0000 7f8adaffd640 1 -- 172.21.15.19:0/2745729097 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc011c20 con 0x7f8ae415e5b0 2024-09-12T01:59:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.042+0000 7f8ae8d66640 1 -- 172.21.15.19:0/2745729097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae40ca6f0 con 0x7f8ae415e5b0 2024-09-12T01:59:20.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.043+0000 7f8ae8d66640 1 -- 172.21.15.19:0/2745729097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ae40ae5d0 con 0x7f8ae415e5b0 2024-09-12T01:59:20.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.043+0000 7f8adaffd640 1 -- 172.21.15.19:0/2745729097 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8acc018020 con 0x7f8ae415e5b0 2024-09-12T01:59:20.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.044+0000 7f8adaffd640 1 --2- 172.21.15.19:0/2745729097 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8ac406be30 0x7f8ac406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:20.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.044+0000 7f8adaffd640 1 -- 172.21.15.19:0/2745729097 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6389+0+0 (secure 0 0 0) 0x7f8acc08ad20 con 0x7f8ae415e5b0 2024-09-12T01:59:20.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.044+0000 7f8ae259c640 1 --2- 172.21.15.19:0/2745729097 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8ac406be30 0x7f8ac406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:20.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.044+0000 7f8ae259c640 1 --2- 172.21.15.19:0/2745729097 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8ac406be30 0x7f8ac406e2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4034000 tx=0x7f8ad402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:20.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.048+0000 7f8adaffd640 1 -- 172.21.15.19:0/2745729097 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8acc01f030 con 0x7f8ae415e5b0 2024-09-12T01:59:20.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.260+0000 7f8ae8d66640 1 -- 172.21.15.19:0/2745729097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ae406fef0 con 0x7f8ae415e5b0 2024-09-12T01:59:20.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.261+0000 7f8adaffd640 1 -- 172.21.15.19:0/2745729097 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+4396 (secure 0 0 0) 0x7f8acc0172c0 con 0x7f8ae415e5b0 2024-09-12T01:59:20.261 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:59:20.261 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":52,"btime":"2024-09-12T01:59:19:698355+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2176310149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2176310149},{"type":"v1","addr":"172.21.15.135:6836","nonce":2176310149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/222313950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":222313950},{"type":"v1","addr":"172.21.15.135:6837","nonce":222313950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:58:31.431304+0000","modified":"2024-09-12T01:59:19.698350+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"a","rank":0,"incarnation":52,"state":"up:replay","state_seq":1,"addr":"172.21.15.19:6834/2113904472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2113904472},{"type":"v1","addr":"172.21.15.19:6834","nonce":2113904472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-12T01:59:20.262 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 52 2024-09-12T01:59:20.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.262+0000 7f8ae8d66640 1 -- 172.21.15.19:0/2745729097 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8ac406be30 msgr2=0x7f8ac406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:20.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.262+0000 7f8ae8d66640 1 --2- 172.21.15.19:0/2745729097 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8ac406be30 0x7f8ac406e2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4034000 tx=0x7f8ad402e000 comp rx=0 tx=0).stop 2024-09-12T01:59:20.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.262+0000 7f8ae8d66640 1 -- 172.21.15.19:0/2745729097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ae415e5b0 msgr2=0x7f8ae4153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:20.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.262+0000 7f8ae8d66640 1 --2- 172.21.15.19:0/2745729097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ae415e5b0 0x7f8ae4153a20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8acc00b3f0 tx=0x7f8acc00b8b0 comp rx=0 tx=0).stop 2024-09-12T01:59:20.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.263+0000 7f8ae8d66640 1 -- 172.21.15.19:0/2745729097 shutdown_connections 2024-09-12T01:59:20.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.263+0000 7f8ae8d66640 1 --2- 172.21.15.19:0/2745729097 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8ac406be30 0x7f8ac406e2f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:20.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.263+0000 7f8ae8d66640 1 --2- 172.21.15.19:0/2745729097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ae415e990 0x7f8ae4151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:20.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.263+0000 7f8ae8d66640 1 --2- 172.21.15.19:0/2745729097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ae415e5b0 0x7f8ae4153a20 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:20.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.263+0000 7f8ae8d66640 1 --2- 172.21.15.19:0/2745729097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ae40ae140 0x7f8ae40caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:20.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.263+0000 7f8ae8d66640 1 -- 172.21.15.19:0/2745729097 >> 172.21.15.19:0/2745729097 conn(0x7f8ae4073490 msgr2=0x7f8ae40706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:20.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.263+0000 7f8ae8d66640 1 -- 172.21.15.19:0/2745729097 shutdown_connections 2024-09-12T01:59:20.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:20.263+0000 7f8ae8d66640 1 -- 172.21.15.19:0/2745729097 wait complete. 2024-09-12T01:59:20.677 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:58:31.431304+0000', 'modified': '2024-09-12T01:59:19.698350+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5865}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5865': {'gid': 5865, 'name': 'a', 'rank': 0, 'incarnation': 52, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.19:6834/2113904472', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 2113904472}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 2113904472}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T01:59:20.677 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5865:up:replay 2024-09-12T01:59:21.678 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:59:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.794+0000 7f0aa664c640 1 Processor -- start 2024-09-12T01:59:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.794+0000 7f0aa664c640 1 -- start start 2024-09-12T01:59:21.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.795+0000 7f0aa664c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0aa0072700 0x7f0aa015d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:21.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.795+0000 7f0aa664c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aa0146140 con 0x7f0aa0072320 2024-09-12T01:59:21.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.795+0000 7f0aa664c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aa00cd740 con 0x7f0aa0072de0 2024-09-12T01:59:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.795+0000 7f0aa664c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa00cda20 con 0x7f0aa0072700 2024-09-12T01:59:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.795+0000 7f0a9ffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0aa0072320 0x7f0aa00cce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42578/0 (socket says 172.21.15.19:42578) 2024-09-12T01:59:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.795+0000 7f0a9ffff640 1 -- 172.21.15.19:0/1799280217 learned_addr learned my addr 172.21.15.19:0/1799280217 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:59:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.795+0000 7f0a9effd640 1 -- 172.21.15.19:0/1799280217 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1766281886 0 0) 0x7f0aa0146140 con 0x7f0aa0072320 2024-09-12T01:59:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.795+0000 7f0aa4be9640 1 --2- 172.21.15.19:0/1799280217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0aa0072700 0x7f0aa015d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.795+0000 7f0a9effd640 1 -- 172.21.15.19:0/1799280217 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a88003520 con 0x7f0aa0072320 2024-09-12T01:59:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9effd640 1 -- 172.21.15.19:0/1799280217 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2227481195 0 0) 0x7f0a88003520 con 0x7f0aa0072320 2024-09-12T01:59:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9effd640 1 -- 172.21.15.19:0/1799280217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0aa0072700 msgr2=0x7f0aa015d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9effd640 1 --2- 172.21.15.19:0/1799280217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0aa0072700 0x7f0aa015d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:21.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9effd640 1 -- 172.21.15.19:0/1799280217 >> v1:172.21.15.135:6789/0 conn(0x7f0aa0072de0 legacy=0x7f0aa015d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:21.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9effd640 1 -- 172.21.15.19:0/1799280217 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa00cdd00 con 0x7f0aa0072320 2024-09-12T01:59:21.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9effd640 1 -- 172.21.15.19:0/1799280217 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f0a90001670 con 0x7f0aa0072320 2024-09-12T01:59:21.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9effd640 1 -- 172.21.15.19:0/1799280217 >> v1:172.21.15.19:6789/0 conn(0x7f0aa0072320 legacy=0x7f0aa00cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:21.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9effd640 1 --2- 172.21.15.19:0/1799280217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a880039e0 0x7f0a88003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:21.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9effd640 1 --2- 172.21.15.19:0/1799280217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0aa0072700 0x7f0a88004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:21.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9effd640 1 --2- 172.21.15.19:0/1799280217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a88004d40 0x7f0a880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:21.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9effd640 1 -- 172.21.15.19:0/1799280217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa00cda20 con 0x7f0a880039e0 2024-09-12T01:59:21.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9effd640 1 -- 172.21.15.19:0/1799280217 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8800ba70 con 0x7f0a88004d40 2024-09-12T01:59:21.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9effd640 1 -- 172.21.15.19:0/1799280217 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0a8800bc70 con 0x7f0aa0072700 2024-09-12T01:59:21.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9ffff640 1 --2- 172.21.15.19:0/1799280217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a880039e0 0x7f0a88003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:21.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0aa4be9640 1 --2- 172.21.15.19:0/1799280217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a88004d40 0x7f0a880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:21.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9f7fe640 1 --2- 172.21.15.19:0/1799280217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0aa0072700 0x7f0a88004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:21.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9ffff640 1 -- 172.21.15.19:0/1799280217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0aa0072700 msgr2=0x7f0a88004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:21.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9ffff640 1 --2- 172.21.15.19:0/1799280217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0aa0072700 0x7f0a88004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:21.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9ffff640 1 -- 172.21.15.19:0/1799280217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a88004d40 msgr2=0x7f0a880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:21.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9ffff640 1 --2- 172.21.15.19:0/1799280217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a88004d40 0x7f0a880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:21.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.796+0000 7f0a9ffff640 1 -- 172.21.15.19:0/1799280217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a88003520 con 0x7f0a880039e0 2024-09-12T01:59:21.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.797+0000 7f0a9ffff640 1 --2- 172.21.15.19:0/1799280217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a880039e0 0x7f0a88003dc0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000c240 tx=0x7f0a88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ef063c9d497c95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:21.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.797+0000 7f0a9effd640 1 -- 172.21.15.19:0/1799280217 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90007d10 con 0x7f0a880039e0 2024-09-12T01:59:21.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.797+0000 7f0a9effd640 1 -- 172.21.15.19:0/1799280217 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a90005ad0 con 0x7f0a880039e0 2024-09-12T01:59:21.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.797+0000 7f0a9effd640 1 -- 172.21.15.19:0/1799280217 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90007070 con 0x7f0a880039e0 2024-09-12T01:59:21.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.798+0000 7f0aa664c640 1 -- 172.21.15.19:0/1799280217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a880039e0 msgr2=0x7f0a88003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:21.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.798+0000 7f0aa664c640 1 --2- 172.21.15.19:0/1799280217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a880039e0 0x7f0a88003dc0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000c240 tx=0x7f0a88005830 comp rx=0 tx=0).stop 2024-09-12T01:59:21.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.798+0000 7f0aa4be9640 1 -- 172.21.15.19:0/1799280217 reap_dead start 2024-09-12T01:59:21.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.798+0000 7f0aa664c640 1 -- 172.21.15.19:0/1799280217 shutdown_connections 2024-09-12T01:59:21.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.798+0000 7f0aa664c640 1 -- 172.21.15.19:0/1799280217 >> 172.21.15.19:0/1799280217 conn(0x7f0aa0067d70 msgr2=0x7f0aa006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:21.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.798+0000 7f0aa664c640 1 -- 172.21.15.19:0/1799280217 shutdown_connections 2024-09-12T01:59:21.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.798+0000 7f0aa664c640 1 -- 172.21.15.19:0/1799280217 wait complete. 2024-09-12T01:59:21.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.799+0000 7f0aa664c640 1 Processor -- start 2024-09-12T01:59:21.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.799+0000 7f0aa664c640 1 -- start start 2024-09-12T01:59:21.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.800+0000 7f0aa664c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a880039e0 0x7f0aa01e2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:21.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.800+0000 7f0aa664c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0aa00b1220 0x7f0aa0141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:21.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.800+0000 7f0aa664c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0aa01e4700 0x7f0aa00b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:21.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.800+0000 7f0aa664c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa015da70 con 0x7f0a880039e0 2024-09-12T01:59:21.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.800+0000 7f0aa664c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa015d8f0 con 0x7f0aa00b1220 2024-09-12T01:59:21.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.800+0000 7f0aa664c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa015dbf0 con 0x7f0aa01e4700 2024-09-12T01:59:21.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.800+0000 7f0a9ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a880039e0 0x7f0aa01e2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:21.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.800+0000 7f0a9ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a880039e0 0x7f0aa01e2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37008/0 (socket says 172.21.15.19:37008) 2024-09-12T01:59:21.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.800+0000 7f0a9ffff640 1 -- 172.21.15.19:0/3380619564 learned_addr learned my addr 172.21.15.19:0/3380619564 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:21.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.800+0000 7f0aa4be9640 1 --2- 172.21.15.19:0/3380619564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0aa01e4700 0x7f0aa00b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:21.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.800+0000 7f0a9f7fe640 1 --2- 172.21.15.19:0/3380619564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0aa00b1220 0x7f0aa0141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:21.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.801+0000 7f0a9ffff640 1 -- 172.21.15.19:0/3380619564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0aa01e4700 msgr2=0x7f0aa00b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:21.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.801+0000 7f0a9ffff640 1 --2- 172.21.15.19:0/3380619564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0aa01e4700 0x7f0aa00b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:21.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.801+0000 7f0a9ffff640 1 -- 172.21.15.19:0/3380619564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0aa00b1220 msgr2=0x7f0aa0141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:21.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.801+0000 7f0a9ffff640 1 --2- 172.21.15.19:0/3380619564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0aa00b1220 0x7f0aa0141020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:21.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.801+0000 7f0a9ffff640 1 -- 172.21.15.19:0/3380619564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa01e3660 con 0x7f0a880039e0 2024-09-12T01:59:21.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.801+0000 7f0a9ffff640 1 --2- 172.21.15.19:0/3380619564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a880039e0 0x7f0aa01e2ef0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0a90034040 tx=0x7f0aa00cded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:21.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.801+0000 7f0a9cff9640 1 -- 172.21.15.19:0/3380619564 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90042070 con 0x7f0a880039e0 2024-09-12T01:59:21.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.801+0000 7f0a9cff9640 1 -- 172.21.15.19:0/3380619564 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a90007270 con 0x7f0a880039e0 2024-09-12T01:59:21.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.801+0000 7f0aa664c640 1 -- 172.21.15.19:0/3380619564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa01e3940 con 0x7f0a880039e0 2024-09-12T01:59:21.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.801+0000 7f0a9cff9640 1 -- 172.21.15.19:0/3380619564 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90007660 con 0x7f0a880039e0 2024-09-12T01:59:21.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.801+0000 7f0aa664c640 1 -- 172.21.15.19:0/3380619564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa01e3f00 con 0x7f0a880039e0 2024-09-12T01:59:21.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.802+0000 7f0aa664c640 1 -- 172.21.15.19:0/3380619564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aa015dfd0 con 0x7f0a880039e0 2024-09-12T01:59:21.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.803+0000 7f0a9cff9640 1 -- 172.21.15.19:0/3380619564 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a90045070 con 0x7f0a880039e0 2024-09-12T01:59:21.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.803+0000 7f0a9cff9640 1 --2- 172.21.15.19:0/3380619564 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0a8c06be60 0x7f0a8c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:21.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.803+0000 7f0a9cff9640 1 -- 172.21.15.19:0/3380619564 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6389+0+0 (secure 0 0 0) 0x7f0a900abdb0 con 0x7f0a880039e0 2024-09-12T01:59:21.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.803+0000 7f0a9f7fe640 1 --2- 172.21.15.19:0/3380619564 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0a8c06be60 0x7f0a8c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:21.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.804+0000 7f0a9f7fe640 1 --2- 172.21.15.19:0/3380619564 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0a8c06be60 0x7f0a8c06e320 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0aa01e9110 tx=0x7f0a94009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:21.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:21.808+0000 7f0a9cff9640 1 -- 172.21.15.19:0/3380619564 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0a9004c030 con 0x7f0a880039e0 2024-09-12T01:59:22.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:22.018+0000 7f0aa664c640 1 -- 172.21.15.19:0/3380619564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0aa00ca620 con 0x7f0a880039e0 2024-09-12T01:59:22.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:22.019+0000 7f0a9cff9640 1 -- 172.21.15.19:0/3380619564 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5222 (secure 0 0 0) 0x7f0a90079d50 con 0x7f0a880039e0 2024-09-12T01:59:22.020 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:59:22.020 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":54,"btime":"2024-09-12T01:59:21:705668+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2176310149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2176310149},{"type":"v1","addr":"172.21.15.135:6836","nonce":2176310149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/222313950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":222313950},{"type":"v1","addr":"172.21.15.135:6837","nonce":222313950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1314663735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1314663735},{"type":"v1","addr":"172.21.15.19:6835","nonce":1314663735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:58:31.431304+0000","modified":"2024-09-12T01:59:20.707144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"a","rank":0,"incarnation":52,"state":"up:rejoin","state_seq":16,"addr":"172.21.15.19:6834/2113904472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2113904472},{"type":"v1","addr":"172.21.15.19:6834","nonce":2113904472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-12T01:59:22.020 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 54 2024-09-12T01:59:22.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:22.021+0000 7f0aa664c640 1 -- 172.21.15.19:0/3380619564 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0a8c06be60 msgr2=0x7f0a8c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:22.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:22.021+0000 7f0aa664c640 1 --2- 172.21.15.19:0/3380619564 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0a8c06be60 0x7f0a8c06e320 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0aa01e9110 tx=0x7f0a94009040 comp rx=0 tx=0).stop 2024-09-12T01:59:22.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:22.021+0000 7f0aa664c640 1 -- 172.21.15.19:0/3380619564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a880039e0 msgr2=0x7f0aa01e2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:22.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:22.021+0000 7f0aa664c640 1 --2- 172.21.15.19:0/3380619564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a880039e0 0x7f0aa01e2ef0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0a90034040 tx=0x7f0aa00cded0 comp rx=0 tx=0).stop 2024-09-12T01:59:22.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:22.021+0000 7f0aa664c640 1 -- 172.21.15.19:0/3380619564 shutdown_connections 2024-09-12T01:59:22.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:22.021+0000 7f0aa664c640 1 --2- 172.21.15.19:0/3380619564 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0a8c06be60 0x7f0a8c06e320 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:22.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:22.021+0000 7f0aa664c640 1 --2- 172.21.15.19:0/3380619564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0aa01e4700 0x7f0aa00b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:22.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:22.021+0000 7f0aa664c640 1 --2- 172.21.15.19:0/3380619564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0aa00b1220 0x7f0aa0141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:22.021+0000 7f0aa664c640 1 --2- 172.21.15.19:0/3380619564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a880039e0 0x7f0aa01e2ef0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:22.021+0000 7f0aa664c640 1 -- 172.21.15.19:0/3380619564 >> 172.21.15.19:0/3380619564 conn(0x7f0aa0067d70 msgr2=0x7f0aa00c9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:22.021+0000 7f0aa664c640 1 -- 172.21.15.19:0/3380619564 shutdown_connections 2024-09-12T01:59:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:22.021+0000 7f0aa664c640 1 -- 172.21.15.19:0/3380619564 wait complete. 2024-09-12T01:59:22.436 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:58:31.431304+0000', 'modified': '2024-09-12T01:59:20.707144+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5865}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5865': {'gid': 5865, 'name': 'a', 'rank': 0, 'incarnation': 52, 'state': 'up:rejoin', 'state_seq': 16, 'addr': '172.21.15.19:6834/2113904472', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 2113904472}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 2113904472}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T01:59:22.436 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5865:up:rejoin 2024-09-12T01:59:23.061 INFO:tasks.ceph.mds.a.smithi019.stderr:2024-09-12T01:59:23.060+0000 7f6c37138640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:59:23.437 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:59:23.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.553+0000 7f9ff30d9640 1 Processor -- start 2024-09-12T01:59:23.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.553+0000 7f9ff30d9640 1 -- start start 2024-09-12T01:59:23.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.554+0000 7f9ff30d9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9fec15e740 0x7f9fec0d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:23.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.554+0000 7f9ff30d9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fec09b690 0x7f9fec06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:23.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.554+0000 7f9ff30d9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fec06e000 con 0x7f9fec06d4c0 2024-09-12T01:59:23.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.554+0000 7f9ff30d9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f9fec15eb20 con 0x7f9fec15e740 2024-09-12T01:59:23.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.554+0000 7f9ff30d9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9fec06d260 con 0x7f9fec09b690 2024-09-12T01:59:23.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.554+0000 7f9ff0e75640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9fec15e740 0x7f9fec0d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:23.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.554+0000 7f9ff1676640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9fec06d4c0 0x7f9fec06d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42586/0 (socket says 172.21.15.19:42586) 2024-09-12T01:59:23.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.554+0000 7f9ff1676640 1 -- 172.21.15.19:0/783417525 learned_addr learned my addr 172.21.15.19:0/783417525 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T01:59:23.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.554+0000 7f9febfff640 1 --2- 172.21.15.19:0/783417525 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fec09b690 0x7f9fec06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:23.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.554+0000 7f9feb7fe640 1 -- 172.21.15.19:0/783417525 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1499853531 0 0) 0x7f9fec06e000 con 0x7f9fec06d4c0 2024-09-12T01:59:23.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.554+0000 7f9feb7fe640 1 -- 172.21.15.19:0/783417525 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fdc003520 con 0x7f9fec06d4c0 2024-09-12T01:59:23.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.554+0000 7f9ff0e75640 1 -- 172.21.15.19:0/783417525 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fec09b690 msgr2=0x7f9fec06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:23.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.554+0000 7f9ff0e75640 1 --2- 172.21.15.19:0/783417525 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fec09b690 0x7f9fec06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:23.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.554+0000 7f9ff0e75640 1 -- 172.21.15.19:0/783417525 >> v1:172.21.15.19:6789/0 conn(0x7f9fec06d4c0 legacy=0x7f9fec06d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:23.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.554+0000 7f9ff0e75640 1 -- 172.21.15.19:0/783417525 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fec0d0780 con 0x7f9fec15e740 2024-09-12T01:59:23.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.555+0000 7f9ff0e75640 1 --2- 172.21.15.19:0/783417525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fec15e740 0x7f9fec0d1540 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00097a0 tx=0x7f9fe002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f0c484a02c09ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:23.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.555+0000 7f9feb7fe640 1 -- 172.21.15.19:0/783417525 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0037070 con 0x7f9fec15e740 2024-09-12T01:59:23.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.555+0000 7f9feb7fe640 1 -- 172.21.15.19:0/783417525 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe0032440 con 0x7f9fec15e740 2024-09-12T01:59:23.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.555+0000 7f9feb7fe640 1 -- 172.21.15.19:0/783417525 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0032810 con 0x7f9fec15e740 2024-09-12T01:59:23.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.556+0000 7f9ff30d9640 1 -- 172.21.15.19:0/783417525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fec15e740 msgr2=0x7f9fec0d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:23.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.556+0000 7f9ff30d9640 1 --2- 172.21.15.19:0/783417525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fec15e740 0x7f9fec0d1540 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00097a0 tx=0x7f9fe002a210 comp rx=0 tx=0).stop 2024-09-12T01:59:23.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.556+0000 7f9ff30d9640 1 -- 172.21.15.19:0/783417525 shutdown_connections 2024-09-12T01:59:23.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.556+0000 7f9ff30d9640 1 --2- 172.21.15.19:0/783417525 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fec09b690 0x7f9fec06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:23.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.556+0000 7f9ff30d9640 1 --2- 172.21.15.19:0/783417525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fec15e740 0x7f9fec0d1540 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:23.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.556+0000 7f9ff30d9640 1 -- 172.21.15.19:0/783417525 >> 172.21.15.19:0/783417525 conn(0x7f9fec0d23a0 msgr2=0x7f9fec0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:23.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.556+0000 7f9ff30d9640 1 -- 172.21.15.19:0/783417525 shutdown_connections 2024-09-12T01:59:23.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.556+0000 7f9ff30d9640 1 -- 172.21.15.19:0/783417525 wait complete. 2024-09-12T01:59:23.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.557+0000 7f9ff30d9640 1 Processor -- start 2024-09-12T01:59:23.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.557+0000 7f9ff30d9640 1 -- start start 2024-09-12T01:59:23.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.558+0000 7f9ff30d9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fec06d4c0 0x7f9fec157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:23.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.558+0000 7f9ff30d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fec09b690 0x7f9fec1f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:23.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.558+0000 7f9ff30d9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fec15e740 0x7f9fec15cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:23.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.558+0000 7f9ff30d9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec0d1020 con 0x7f9fec09b690 2024-09-12T01:59:23.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.558+0000 7f9ff30d9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec0d0d40 con 0x7f9fec06d4c0 2024-09-12T01:59:23.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.558+0000 7f9ff30d9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9fec09ba90 con 0x7f9fec15e740 2024-09-12T01:59:23.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.558+0000 7f9febfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fec09b690 0x7f9fec1f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:23.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.558+0000 7f9febfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fec09b690 0x7f9fec1f4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37024/0 (socket says 172.21.15.19:37024) 2024-09-12T01:59:23.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.558+0000 7f9febfff640 1 -- 172.21.15.19:0/266383612 learned_addr learned my addr 172.21.15.19:0/266383612 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:23.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.558+0000 7f9ff1676640 1 --2- 172.21.15.19:0/266383612 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fec15e740 0x7f9fec15cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:23.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.558+0000 7f9ff0e75640 1 --2- 172.21.15.19:0/266383612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fec06d4c0 0x7f9fec157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:23.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.558+0000 7f9febfff640 1 -- 172.21.15.19:0/266383612 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fec15e740 msgr2=0x7f9fec15cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:23.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.558+0000 7f9febfff640 1 --2- 172.21.15.19:0/266383612 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fec15e740 0x7f9fec15cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:23.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.559+0000 7f9febfff640 1 -- 172.21.15.19:0/266383612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fec06d4c0 msgr2=0x7f9fec157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:23.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.559+0000 7f9febfff640 1 --2- 172.21.15.19:0/266383612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fec06d4c0 0x7f9fec157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:23.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.559+0000 7f9febfff640 1 -- 172.21.15.19:0/266383612 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fec1f5100 con 0x7f9fec09b690 2024-09-12T01:59:23.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.559+0000 7f9febfff640 1 --2- 172.21.15.19:0/266383612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fec09b690 0x7f9fec1f4bc0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800d830 tx=0x7f9fd800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:23.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.559+0000 7f9fe97fa640 1 -- 172.21.15.19:0/266383612 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd800b6c0 con 0x7f9fec09b690 2024-09-12T01:59:23.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.559+0000 7f9fe97fa640 1 -- 172.21.15.19:0/266383612 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd8019070 con 0x7f9fec09b690 2024-09-12T01:59:23.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.559+0000 7f9ff30d9640 1 -- 172.21.15.19:0/266383612 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fec1e8540 con 0x7f9fec09b690 2024-09-12T01:59:23.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.559+0000 7f9fe97fa640 1 -- 172.21.15.19:0/266383612 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd800ba80 con 0x7f9fec09b690 2024-09-12T01:59:23.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.559+0000 7f9ff30d9640 1 -- 172.21.15.19:0/266383612 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fec1e8b00 con 0x7f9fec09b690 2024-09-12T01:59:23.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.560+0000 7f9ff30d9640 1 -- 172.21.15.19:0/266383612 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fec06cd20 con 0x7f9fec09b690 2024-09-12T01:59:23.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.561+0000 7f9fe97fa640 1 -- 172.21.15.19:0/266383612 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9fd801e460 con 0x7f9fec09b690 2024-09-12T01:59:23.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.561+0000 7f9fe97fa640 1 --2- 172.21.15.19:0/266383612 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9fd006be30 0x7f9fd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:23.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.561+0000 7f9fe97fa640 1 -- 172.21.15.19:0/266383612 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6389+0+0 (secure 0 0 0) 0x7f9fd808b670 con 0x7f9fec09b690 2024-09-12T01:59:23.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.561+0000 7f9ff0e75640 1 --2- 172.21.15.19:0/266383612 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9fd006be30 0x7f9fd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:23.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.562+0000 7f9ff0e75640 1 --2- 172.21.15.19:0/266383612 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9fd006be30 0x7f9fd006e2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0034000 tx=0x7f9fe002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:23.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.565+0000 7f9fe97fa640 1 -- 172.21.15.19:0/266383612 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9fec1f5100 con 0x7f9fec09b690 2024-09-12T01:59:23.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.777+0000 7f9ff30d9640 1 -- 172.21.15.19:0/266383612 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fec0b51f0 con 0x7f9fec09b690 2024-09-12T01:59:23.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.778+0000 7f9fe97fa640 1 -- 172.21.15.19:0/266383612 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5229 (secure 0 0 0) 0x7f9fd8059720 con 0x7f9fec09b690 2024-09-12T01:59:23.779 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:59:23.779 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":55,"btime":"2024-09-12T01:59:22:714201+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2176310149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2176310149},{"type":"v1","addr":"172.21.15.135:6836","nonce":2176310149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/222313950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":222313950},{"type":"v1","addr":"172.21.15.135:6837","nonce":222313950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1314663735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1314663735},{"type":"v1","addr":"172.21.15.19:6835","nonce":1314663735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:58:31.431304+0000","modified":"2024-09-12T01:59:22.714194+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":17,"addr":"172.21.15.19:6834/2113904472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2113904472},{"type":"v1","addr":"172.21.15.19:6834","nonce":2113904472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5865,"qdb_cluster":[5865]},"id":4}]} 2024-09-12T01:59:23.779 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 55 2024-09-12T01:59:23.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.780+0000 7f9ff30d9640 1 -- 172.21.15.19:0/266383612 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9fd006be30 msgr2=0x7f9fd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:23.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.780+0000 7f9ff30d9640 1 --2- 172.21.15.19:0/266383612 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9fd006be30 0x7f9fd006e2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0034000 tx=0x7f9fe002e000 comp rx=0 tx=0).stop 2024-09-12T01:59:23.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.780+0000 7f9ff30d9640 1 -- 172.21.15.19:0/266383612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fec09b690 msgr2=0x7f9fec1f4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:23.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.780+0000 7f9ff30d9640 1 --2- 172.21.15.19:0/266383612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fec09b690 0x7f9fec1f4bc0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800d830 tx=0x7f9fd800dcf0 comp rx=0 tx=0).stop 2024-09-12T01:59:23.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.780+0000 7f9ff30d9640 1 -- 172.21.15.19:0/266383612 shutdown_connections 2024-09-12T01:59:23.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.780+0000 7f9ff30d9640 1 --2- 172.21.15.19:0/266383612 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9fd006be30 0x7f9fd006e2f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:23.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.780+0000 7f9ff30d9640 1 --2- 172.21.15.19:0/266383612 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fec15e740 0x7f9fec15cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:23.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.780+0000 7f9ff30d9640 1 --2- 172.21.15.19:0/266383612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fec09b690 0x7f9fec1f4bc0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:23.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.780+0000 7f9ff30d9640 1 --2- 172.21.15.19:0/266383612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fec06d4c0 0x7f9fec157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:23.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.780+0000 7f9ff30d9640 1 -- 172.21.15.19:0/266383612 >> 172.21.15.19:0/266383612 conn(0x7f9fec0d23a0 msgr2=0x7f9fec0ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:23.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.780+0000 7f9ff30d9640 1 -- 172.21.15.19:0/266383612 shutdown_connections 2024-09-12T01:59:23.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:23.780+0000 7f9ff30d9640 1 -- 172.21.15.19:0/266383612 wait complete. 2024-09-12T01:59:24.195 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:58:31.431304+0000', 'modified': '2024-09-12T01:59:22.714194+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5865}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5865': {'gid': 5865, 'name': 'a', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.19:6834/2113904472', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 2113904472}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 2113904472}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5865, 'qdb_cluster': [5865]} 2024-09-12T01:59:24.195 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:59:24.196 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T01:59:24.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.303+0000 7f82fed4b640 1 Processor -- start 2024-09-12T01:59:24.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.303+0000 7f82fed4b640 1 -- start start 2024-09-12T01:59:24.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.304+0000 7f82fed4b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82f815e5f0 0x7f82f80d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.304+0000 7f82fed4b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f82f80b6690 0x7f82f806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.304+0000 7f82fed4b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f80d3690 con 0x7f82f80d30f0 2024-09-12T01:59:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.304+0000 7f82fed4b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f82f806d530 con 0x7f82f80b6690 2024-09-12T01:59:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.304+0000 7f82fed4b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f82f80d3970 con 0x7f82f815e5f0 2024-09-12T01:59:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.304+0000 7f82fd2e8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f82f80b6690 0x7f82f806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.304+0000 7f82fd2e8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f82f80b6690 0x7f82f806d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37034/0 (socket says 172.21.15.19:37034) 2024-09-12T01:59:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.304+0000 7f82f7fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f82f80d30f0 0x7f82f80b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42596/0 (socket says 172.21.15.19:42596) 2024-09-12T01:59:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.304+0000 7f82fd2e8640 1 -- 172.21.15.19:0/3248489905 learned_addr learned my addr 172.21.15.19:0/3248489905 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.305+0000 7f82fcae7640 1 --2- 172.21.15.19:0/3248489905 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82f815e5f0 0x7f82f80d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.305+0000 7f82fd2e8640 1 -- 172.21.15.19:0/3248489905 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82f815e5f0 msgr2=0x7f82f80d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:24.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.305+0000 7f82f77fe640 1 -- 172.21.15.19:0/3248489905 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2695578115 0 0) 0x7f82f80d3690 con 0x7f82f80d30f0 2024-09-12T01:59:24.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.305+0000 7f82fd2e8640 1 --2- 172.21.15.19:0/3248489905 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82f815e5f0 0x7f82f80d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.305+0000 7f82fd2e8640 1 -- 172.21.15.19:0/3248489905 >> v1:172.21.15.19:6789/0 conn(0x7f82f80d30f0 legacy=0x7f82f80b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.305+0000 7f82fd2e8640 1 -- 172.21.15.19:0/3248489905 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f806cee0 con 0x7f82f80b6690 2024-09-12T01:59:24.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.305+0000 7f82fcae7640 1 --2- 172.21.15.19:0/3248489905 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82f815e5f0 0x7f82f80d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:59:24.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.305+0000 7f82fd2e8640 1 --2- 172.21.15.19:0/3248489905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82f80b6690 0x7f82f806d9c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009e50 tx=0x7f82f002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e020c78d8fa3878 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:24.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.306+0000 7f82f77fe640 1 -- 172.21.15.19:0/3248489905 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0036070 con 0x7f82f80b6690 2024-09-12T01:59:24.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.306+0000 7f82f77fe640 1 -- 172.21.15.19:0/3248489905 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f0031600 con 0x7f82f80b6690 2024-09-12T01:59:24.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.306+0000 7f82f77fe640 1 -- 172.21.15.19:0/3248489905 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f00319d0 con 0x7f82f80b6690 2024-09-12T01:59:24.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.306+0000 7f82fed4b640 1 -- 172.21.15.19:0/3248489905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82f80b6690 msgr2=0x7f82f806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.306+0000 7f82fed4b640 1 --2- 172.21.15.19:0/3248489905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82f80b6690 0x7f82f806d9c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009e50 tx=0x7f82f002a710 comp rx=0 tx=0).stop 2024-09-12T01:59:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.306+0000 7f82fed4b640 1 -- 172.21.15.19:0/3248489905 shutdown_connections 2024-09-12T01:59:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.306+0000 7f82fed4b640 1 --2- 172.21.15.19:0/3248489905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82f80b6690 0x7f82f806d9c0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.306+0000 7f82fed4b640 1 --2- 172.21.15.19:0/3248489905 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82f815e5f0 0x7f82f80d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.306+0000 7f82fed4b640 1 -- 172.21.15.19:0/3248489905 >> 172.21.15.19:0/3248489905 conn(0x7f82f808bfc0 msgr2=0x7f82f80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.306+0000 7f82fed4b640 1 -- 172.21.15.19:0/3248489905 shutdown_connections 2024-09-12T01:59:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.306+0000 7f82fed4b640 1 -- 172.21.15.19:0/3248489905 wait complete. 2024-09-12T01:59:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.307+0000 7f82fed4b640 1 Processor -- start 2024-09-12T01:59:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.307+0000 7f82fed4b640 1 -- start start 2024-09-12T01:59:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.308+0000 7f82fed4b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82f80b6690 0x7f82f8154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.308+0000 7f82fed4b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82f80d30f0 0x7f82f80a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.308+0000 7f82fed4b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82f815e5f0 0x7f82f80b7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.308+0000 7f82fed4b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f82f80d5310 con 0x7f82f80d30f0 2024-09-12T01:59:24.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.308+0000 7f82fed4b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f82f815e9d0 con 0x7f82f80b6690 2024-09-12T01:59:24.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.308+0000 7f82fed4b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f82f806df00 con 0x7f82f815e5f0 2024-09-12T01:59:24.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.308+0000 7f82f7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82f80d30f0 0x7f82f80a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.308+0000 7f82f7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82f80d30f0 0x7f82f80a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37042/0 (socket says 172.21.15.19:37042) 2024-09-12T01:59:24.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.308+0000 7f82f7fff640 1 -- 172.21.15.19:0/1825078332 learned_addr learned my addr 172.21.15.19:0/1825078332 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:24.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.309+0000 7f82fd2e8640 1 --2- 172.21.15.19:0/1825078332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82f815e5f0 0x7f82f80b7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.309+0000 7f82fcae7640 1 --2- 172.21.15.19:0/1825078332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82f80b6690 0x7f82f8154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.309+0000 7f82f7fff640 1 -- 172.21.15.19:0/1825078332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82f815e5f0 msgr2=0x7f82f80b7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.309+0000 7f82f7fff640 1 --2- 172.21.15.19:0/1825078332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82f815e5f0 0x7f82f80b7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.309+0000 7f82f7fff640 1 -- 172.21.15.19:0/1825078332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82f80b6690 msgr2=0x7f82f8154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.309+0000 7f82f7fff640 1 --2- 172.21.15.19:0/1825078332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82f80b6690 0x7f82f8154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.309+0000 7f82f7fff640 1 -- 172.21.15.19:0/1825078332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f80a2200 con 0x7f82f80d30f0 2024-09-12T01:59:24.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.309+0000 7f82f7fff640 1 --2- 172.21.15.19:0/1825078332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82f80d30f0 0x7f82f80a0ba0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00c4b0 tx=0x7f82ec00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:24.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.309+0000 7f82f57fa640 1 -- 172.21.15.19:0/1825078332 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec018070 con 0x7f82f80d30f0 2024-09-12T01:59:24.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.309+0000 7f82f57fa640 1 -- 172.21.15.19:0/1825078332 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82ec007500 con 0x7f82f80d30f0 2024-09-12T01:59:24.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.309+0000 7f82fed4b640 1 -- 172.21.15.19:0/1825078332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f8154db0 con 0x7f82f80d30f0 2024-09-12T01:59:24.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.309+0000 7f82f57fa640 1 -- 172.21.15.19:0/1825078332 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec004a20 con 0x7f82f80d30f0 2024-09-12T01:59:24.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.309+0000 7f82fed4b640 1 -- 172.21.15.19:0/1825078332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f80a1960 con 0x7f82f80d30f0 2024-09-12T01:59:24.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.311+0000 7f82f57fa640 1 -- 172.21.15.19:0/1825078332 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f82ec01b070 con 0x7f82f80d30f0 2024-09-12T01:59:24.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.311+0000 7f82f57fa640 1 --2- 172.21.15.19:0/1825078332 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f82e406be30 0x7f82e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.311+0000 7f82f57fa640 1 -- 172.21.15.19:0/1825078332 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6389+0+0 (secure 0 0 0) 0x7f82ec08a440 con 0x7f82f80d30f0 2024-09-12T01:59:24.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.311+0000 7f82fcae7640 1 --2- 172.21.15.19:0/1825078332 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f82e406be30 0x7f82e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.312+0000 7f82fcae7640 1 --2- 172.21.15.19:0/1825078332 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f82e406be30 0x7f82e406e2f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f82e800a950 tx=0x7f82e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.312+0000 7f8301bc3740 1 Processor -- start 2024-09-12T01:59:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.312+0000 7f8301bc3740 1 -- start start 2024-09-12T01:59:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.313+0000 7f8301bc3740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03b92c0 0x55b2f03fea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.313+0000 7f8301bc3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03b6a80 0x55b2f03b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.313+0000 7f8301bc3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03baa50 0x55b2f03b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.313+0000 7f8301bc3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b2f031b520 con 0x55b2f03b6a80 2024-09-12T01:59:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.313+0000 7f8301bc3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b2f02c33e0 con 0x55b2f03baa50 2024-09-12T01:59:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.313+0000 7f8301bc3740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55b2f03174e0 con 0x55b2f03b92c0 2024-09-12T01:59:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.313+0000 7f82f7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03b6a80 0x55b2f03b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.313+0000 7f82f7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03b6a80 0x55b2f03b96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37052/0 (socket says 172.21.15.19:37052) 2024-09-12T01:59:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.313+0000 7f82f7fff640 1 -- 172.21.15.19:0/3104249668 learned_addr learned my addr 172.21.15.19:0/3104249668 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.313+0000 7f82fcae7640 1 --2- 172.21.15.19:0/3104249668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03b92c0 0x55b2f03fea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.313+0000 7f82fd2e8640 1 --2- 172.21.15.19:0/3104249668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03baa50 0x55b2f03b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.313+0000 7f82f7fff640 1 -- 172.21.15.19:0/3104249668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03b92c0 msgr2=0x55b2f03fea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:24.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.313+0000 7f82f7fff640 1 --2- 172.21.15.19:0/3104249668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03b92c0 0x55b2f03fea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.313+0000 7f82f7fff640 1 -- 172.21.15.19:0/3104249668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03baa50 msgr2=0x55b2f03b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:24.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.313+0000 7f82f7fff640 1 --2- 172.21.15.19:0/3104249668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03baa50 0x55b2f03b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.313+0000 7f82f7fff640 1 -- 172.21.15.19:0/3104249668 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2f02de2f0 con 0x55b2f03b6a80 2024-09-12T01:59:24.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.313+0000 7f82f7fff640 1 --2- 172.21.15.19:0/3104249668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03b6a80 0x55b2f03b96a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f82ec060bb0 tx=0x7f82ec058640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6b28d096df8ee7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.314+0000 7f82de7fc640 1 -- 172.21.15.19:0/3104249668 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec056800 con 0x55b2f03b6a80 2024-09-12T01:59:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.314+0000 7f82de7fc640 1 -- 172.21.15.19:0/3104249668 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82ec054b70 con 0x55b2f03b6a80 2024-09-12T01:59:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.314+0000 7f82de7fc640 1 -- 172.21.15.19:0/3104249668 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec060e90 con 0x55b2f03b6a80 2024-09-12T01:59:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.314+0000 7f8301bc3740 1 -- 172.21.15.19:0/3104249668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03b6a80 msgr2=0x55b2f03b96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.314+0000 7f8301bc3740 1 --2- 172.21.15.19:0/3104249668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03b6a80 0x55b2f03b96a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f82ec060bb0 tx=0x7f82ec058640 comp rx=0 tx=0).stop 2024-09-12T01:59:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.314+0000 7f8301bc3740 1 -- 172.21.15.19:0/3104249668 shutdown_connections 2024-09-12T01:59:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.314+0000 7f8301bc3740 1 --2- 172.21.15.19:0/3104249668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03baa50 0x55b2f03b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.314+0000 7f8301bc3740 1 --2- 172.21.15.19:0/3104249668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03b6a80 0x55b2f03b96a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.314+0000 7f8301bc3740 1 --2- 172.21.15.19:0/3104249668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03b92c0 0x55b2f03fea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.314+0000 7f8301bc3740 1 -- 172.21.15.19:0/3104249668 >> 172.21.15.19:0/3104249668 conn(0x55b2f03b5a80 msgr2=0x55b2f03fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.314+0000 7f8301bc3740 1 -- 172.21.15.19:0/3104249668 shutdown_connections 2024-09-12T01:59:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.314+0000 7f8301bc3740 1 -- 172.21.15.19:0/3104249668 wait complete. 2024-09-12T01:59:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.315+0000 7f8301bc3740 1 -- start start 2024-09-12T01:59:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.315+0000 7f8301bc3740 1 Processor -- start 2024-09-12T01:59:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.316+0000 7f8301bc3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03b92c0 0x55b2f03d81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.316+0000 7f8301bc3740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03baa50 0x55b2f03b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.316+0000 7f8301bc3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03b4580 0x55b2f03b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.316+0000 7f8301bc3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b2f03b4f20 con 0x55b2f03b92c0 2024-09-12T01:59:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.316+0000 7f8301bc3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b2f02a4450 con 0x55b2f03b4580 2024-09-12T01:59:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.316+0000 7f8301bc3740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55b2f03ff290 con 0x55b2f03baa50 2024-09-12T01:59:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.316+0000 7f8301bc3740 10 client.0 _ll_register_callbacks cb 0x55b2f002dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.316+0000 7f82fcae7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03b92c0 0x55b2f03d81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.316+0000 7f82fcae7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03b92c0 0x55b2f03d81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37068/0 (socket says 172.21.15.19:37068) 2024-09-12T01:59:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.316+0000 7f82fcae7640 1 -- 172.21.15.19:0/1160808624 learned_addr learned my addr 172.21.15.19:0/1160808624 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.316+0000 7f82f7fff640 1 --2- 172.21.15.19:0/1160808624 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03baa50 0x55b2f03b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.316+0000 7f82fd2e8640 1 --2- 172.21.15.19:0/1160808624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03b4580 0x55b2f03b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.316+0000 7f82fcae7640 1 -- 172.21.15.19:0/1160808624 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03baa50 msgr2=0x55b2f03b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.316+0000 7f82fcae7640 1 --2- 172.21.15.19:0/1160808624 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03baa50 0x55b2f03b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.316+0000 7f82fcae7640 1 -- 172.21.15.19:0/1160808624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03b4580 msgr2=0x55b2f03b7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.316+0000 7f82fcae7640 1 --2- 172.21.15.19:0/1160808624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03b4580 0x55b2f03b7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.316+0000 7f82fcae7640 1 -- 172.21.15.19:0/1160808624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2f002e2d0 con 0x55b2f03b92c0 2024-09-12T01:59:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.316+0000 7f82fd2e8640 1 --2- 172.21.15.19:0/1160808624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03b4580 0x55b2f03b7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:59:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.317+0000 7f82fcae7640 1 --2- 172.21.15.19:0/1160808624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03b92c0 0x55b2f03d81a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f82e8013760 tx=0x7f82e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d6c7e0665e0bbb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.317+0000 7f82d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:59:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.317+0000 7f82d77fe640 1 -- 172.21.15.19:0/1160808624 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e8024070 con 0x55b2f03b92c0 2024-09-12T01:59:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.317+0000 7f8301bc3740 1 -- 172.21.15.19:0/1160808624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82ec054b70 con 0x55b2f03b92c0 2024-09-12T01:59:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.317+0000 7f82d77fe640 1 -- 172.21.15.19:0/1160808624 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6389+0+0 (secure 0 0 0) 0x7f82e8014940 con 0x55b2f03b92c0 2024-09-12T01:59:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.317+0000 7f82d77fe640 1 -- 172.21.15.19:0/1160808624 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f82e802f050 con 0x55b2f03b92c0 2024-09-12T01:59:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.317+0000 7f8301bc3740 10 client.6297 fetch_fsmap learned FSMap version 55 2024-09-12T01:59:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.317+0000 7f8301bc3740 1 -- 172.21.15.19:0/1160808624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55b2f00f86b0 con 0x55b2f03b92c0 2024-09-12T01:59:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.317+0000 7f82d77fe640 1 -- 172.21.15.19:0/1160808624 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82ec054b70 con 0x55b2f03b92c0 2024-09-12T01:59:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.317+0000 7f82d77fe640 1 -- 172.21.15.19:0/1160808624 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 55) ==== 3502+0+0 (secure 0 0 0) 0x7f82e8032020 con 0x55b2f03b92c0 2024-09-12T01:59:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.317+0000 7f8301bc3740 10 client.6297 fetch_fsmap finished waiting for FSMap version 55 2024-09-12T01:59:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.317+0000 7f8301bc3740 10 client.6297 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T01:59:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.317+0000 7f8301bc3740 20 client.6297 populate_metadata read hostname 'smithi019' 2024-09-12T01:59:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.317+0000 7f8301bc3740 1 --2- 172.21.15.19:0/1160808624 >> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] conn(0x55b2f040e4a0 0x55b2f03b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.317+0000 7f8301bc3740 4 client.6297 mds_command: new command op to 5865 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:59:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.317+0000 7f8301bc3740 1 -- 172.21.15.19:0/1160808624 --> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2f0328c50 con 0x55b2f040e4a0 2024-09-12T01:59:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.317+0000 7f82f7fff640 1 --2- 172.21.15.19:0/1160808624 >> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] conn(0x55b2f040e4a0 0x55b2f03b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.318+0000 7f82f7fff640 1 --2- 172.21.15.19:0/1160808624 >> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] conn(0x55b2f040e4a0 0x55b2f03b2960 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66f4de1c107239f2 server_cookie=cfafbba1f5d3885a in_seq=0 out_seq=0 2024-09-12T01:59:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.318+0000 7f82d77fe640 10 client.6297 ms_handle_connect on v2:172.21.15.19:6832/2113904472 2024-09-12T01:59:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.318+0000 7f82d77fe640 1 -- 172.21.15.19:0/1160808624 <== mds.0 v2:172.21.15.19:6832/2113904472 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b2f0328c50 con 0x55b2f040e4a0 2024-09-12T01:59:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.318+0000 7f82d77fe640 10 client.6297 handle_command_reply: tid=0 2024-09-12T01:59:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.318+0000 7f8301bc3740 1 client.6297 shutdown 2024-09-12T01:59:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.319+0000 7f8301bc3740 1 -- 172.21.15.19:0/1160808624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03b92c0 msgr2=0x55b2f03d81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.319+0000 7f8301bc3740 1 --2- 172.21.15.19:0/1160808624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03b92c0 0x55b2f03d81a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f82e8013760 tx=0x7f82e80046c0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.319+0000 7f8301bc3740 1 -- 172.21.15.19:0/1160808624 shutdown_connections 2024-09-12T01:59:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.319+0000 7f8301bc3740 1 --2- 172.21.15.19:0/1160808624 >> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] conn(0x55b2f040e4a0 0x55b2f03b2960 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.319+0000 7f8301bc3740 1 --2- 172.21.15.19:0/1160808624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03b4580 0x55b2f03b7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.319+0000 7f8301bc3740 1 --2- 172.21.15.19:0/1160808624 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03baa50 0x55b2f03b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.319+0000 7f82d77fe640 0 client.6297 ms_handle_reset on v2:172.21.15.19:6832/2113904472 2024-09-12T01:59:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.319+0000 7f8301bc3740 1 --2- 172.21.15.19:0/1160808624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03b92c0 0x55b2f03d81a0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.319+0000 7f8301bc3740 1 -- 172.21.15.19:0/1160808624 >> 172.21.15.19:0/1160808624 conn(0x55b2f03b6a80 msgr2=0x55b2f03fbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:24.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.319+0000 7f8301bc3740 1 -- 172.21.15.19:0/1160808624 shutdown_connections 2024-09-12T01:59:24.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.319+0000 7f8301bc3740 1 -- 172.21.15.19:0/1160808624 wait complete. 2024-09-12T01:59:24.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.319+0000 7f8301bc3740 20 client.6297 trim_cache size 0 max 16384 2024-09-12T01:59:24.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.337+0000 7f8301bc3740 1 Processor -- start 2024-09-12T01:59:24.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.337+0000 7f8301bc3740 1 -- start start 2024-09-12T01:59:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f8301bc3740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03b4580 0x55b2f0421e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f8301bc3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03b92c0 0x55b2f03de6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f8301bc3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03baa50 0x55b2f03dec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f8301bc3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f82f82002c0 con 0x55b2f03baa50 2024-09-12T01:59:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f8301bc3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f82f80ca5a0 con 0x55b2f03b92c0 2024-09-12T01:59:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f8301bc3740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f82f81ffd70 con 0x55b2f03b4580 2024-09-12T01:59:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f82fd2e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03baa50 0x55b2f03dec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f82fd2e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03baa50 0x55b2f03dec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37076/0 (socket says 172.21.15.19:37076) 2024-09-12T01:59:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f82fd2e8640 1 -- 172.21.15.19:0/1264197551 learned_addr learned my addr 172.21.15.19:0/1264197551 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:24.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f82fcae7640 1 --2- 172.21.15.19:0/1264197551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03b4580 0x55b2f0421e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f82f7fff640 1 --2- 172.21.15.19:0/1264197551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03b92c0 0x55b2f03de6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f82fd2e8640 1 -- 172.21.15.19:0/1264197551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03b4580 msgr2=0x55b2f0421e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:24.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f82fd2e8640 1 --2- 172.21.15.19:0/1264197551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03b4580 0x55b2f0421e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f82fd2e8640 1 -- 172.21.15.19:0/1264197551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03b92c0 msgr2=0x55b2f03de6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:24.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f82fd2e8640 1 --2- 172.21.15.19:0/1264197551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03b92c0 0x55b2f03de6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f82fd2e8640 1 -- 172.21.15.19:0/1264197551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2f03e3bc0 con 0x55b2f03baa50 2024-09-12T01:59:24.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f82fd2e8640 1 --2- 172.21.15.19:0/1264197551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03baa50 0x55b2f03dec10 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f82f0034040 tx=0x7f82f002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408c8d3294e2f0e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:24.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f82ddffb640 1 -- 172.21.15.19:0/1264197551 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0043070 con 0x55b2f03baa50 2024-09-12T01:59:24.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.338+0000 7f82ddffb640 1 -- 172.21.15.19:0/1264197551 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f0037040 con 0x55b2f03baa50 2024-09-12T01:59:24.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.339+0000 7f82ddffb640 1 -- 172.21.15.19:0/1264197551 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0036040 con 0x55b2f03baa50 2024-09-12T01:59:24.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.339+0000 7f8301bc3740 1 -- 172.21.15.19:0/1264197551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03baa50 msgr2=0x55b2f03dec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.339+0000 7f8301bc3740 1 --2- 172.21.15.19:0/1264197551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03baa50 0x55b2f03dec10 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f82f0034040 tx=0x7f82f002e000 comp rx=0 tx=0).stop 2024-09-12T01:59:24.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.339+0000 7f8301bc3740 1 -- 172.21.15.19:0/1264197551 shutdown_connections 2024-09-12T01:59:24.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.339+0000 7f8301bc3740 1 --2- 172.21.15.19:0/1264197551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03baa50 0x55b2f03dec10 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.339+0000 7f8301bc3740 1 --2- 172.21.15.19:0/1264197551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03b92c0 0x55b2f03de6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.339+0000 7f8301bc3740 1 --2- 172.21.15.19:0/1264197551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03b4580 0x55b2f0421e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.339+0000 7f8301bc3740 1 -- 172.21.15.19:0/1264197551 >> 172.21.15.19:0/1264197551 conn(0x55b2f03b6a80 msgr2=0x55b2f03b8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:24.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.339+0000 7f8301bc3740 1 -- 172.21.15.19:0/1264197551 shutdown_connections 2024-09-12T01:59:24.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.339+0000 7f8301bc3740 1 -- 172.21.15.19:0/1264197551 wait complete. 2024-09-12T01:59:24.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.340+0000 7f8301bc3740 1 -- start start 2024-09-12T01:59:24.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.340+0000 7f8301bc3740 1 Processor -- start 2024-09-12T01:59:24.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f8301bc3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03b4580 0x55b2f047c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f8301bc3740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03b92c0 0x55b2f0480970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f8301bc3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03baa50 0x55b2f0480eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f8301bc3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b2f040e320 con 0x55b2f03baa50 2024-09-12T01:59:24.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f8301bc3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b2f03e2830 con 0x55b2f03b4580 2024-09-12T01:59:24.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f8301bc3740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55b2f040ef60 con 0x55b2f03b92c0 2024-09-12T01:59:24.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f8301bc3740 10 client.0 _ll_register_callbacks cb 0x7f82e800a1f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:24.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f82fd2e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03baa50 0x55b2f0480eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f82fd2e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03baa50 0x55b2f0480eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37090/0 (socket says 172.21.15.19:37090) 2024-09-12T01:59:24.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f82fd2e8640 1 -- 172.21.15.19:0/1234182449 learned_addr learned my addr 172.21.15.19:0/1234182449 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T01:59:24.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f82fcae7640 1 --2- 172.21.15.19:0/1234182449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03b4580 0x55b2f047c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f82f7fff640 1 --2- 172.21.15.19:0/1234182449 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03b92c0 0x55b2f0480970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f82fd2e8640 1 -- 172.21.15.19:0/1234182449 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03b92c0 msgr2=0x55b2f0480970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:24.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f82fd2e8640 1 --2- 172.21.15.19:0/1234182449 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03b92c0 0x55b2f0480970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f82fd2e8640 1 -- 172.21.15.19:0/1234182449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03b4580 msgr2=0x55b2f047c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:24.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f82fd2e8640 1 --2- 172.21.15.19:0/1234182449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03b4580 0x55b2f047c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f82fd2e8640 1 -- 172.21.15.19:0/1234182449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2f03dec80 con 0x55b2f03baa50 2024-09-12T01:59:24.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f82fd2e8640 1 --2- 172.21.15.19:0/1234182449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03baa50 0x55b2f0480eb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f82f0042040 tx=0x7f82f0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3361ee27facbc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:24.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f82d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T01:59:24.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f82d77fe640 1 -- 172.21.15.19:0/1234182449 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0043070 con 0x55b2f03baa50 2024-09-12T01:59:24.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f82d77fe640 1 -- 172.21.15.19:0/1234182449 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6389+0+0 (secure 0 0 0) 0x7f82f003fb90 con 0x55b2f03baa50 2024-09-12T01:59:24.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.341+0000 7f8301bc3740 1 -- 172.21.15.19:0/1234182449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82f0037040 con 0x55b2f03baa50 2024-09-12T01:59:24.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.342+0000 7f82d77fe640 1 -- 172.21.15.19:0/1234182449 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f82f0058050 con 0x55b2f03baa50 2024-09-12T01:59:24.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.342+0000 7f8301bc3740 10 client.6303 fetch_fsmap learned FSMap version 55 2024-09-12T01:59:24.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.342+0000 7f8301bc3740 1 -- 172.21.15.19:0/1234182449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55b2f03fa970 con 0x55b2f03baa50 2024-09-12T01:59:24.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.342+0000 7f82d77fe640 1 -- 172.21.15.19:0/1234182449 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f0037040 con 0x55b2f03baa50 2024-09-12T01:59:24.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.342+0000 7f82d77fe640 1 -- 172.21.15.19:0/1234182449 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 55) ==== 3502+0+0 (secure 0 0 0) 0x7f82f005b020 con 0x55b2f03baa50 2024-09-12T01:59:24.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.342+0000 7f8301bc3740 10 client.6303 fetch_fsmap finished waiting for FSMap version 55 2024-09-12T01:59:24.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.342+0000 7f8301bc3740 10 client.6303 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T01:59:24.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.342+0000 7f8301bc3740 20 client.6303 populate_metadata read hostname 'smithi019' 2024-09-12T01:59:24.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.342+0000 7f8301bc3740 1 --2- 172.21.15.19:0/1234182449 >> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] conn(0x55b2f03e3090 0x55b2f040cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.342+0000 7f8301bc3740 4 client.6303 mds_command: new command op to 5865 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:59:24.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.342+0000 7f8301bc3740 1 -- 172.21.15.19:0/1234182449 --> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] -- command(tid 0: {"prefix": "status"}) -- 0x55b2f0322fa0 con 0x55b2f03e3090 2024-09-12T01:59:24.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.342+0000 7f82fcae7640 1 --2- 172.21.15.19:0/1234182449 >> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] conn(0x55b2f03e3090 0x55b2f040cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.342+0000 7f82d77fe640 10 client.6303 ms_handle_connect on v2:172.21.15.19:6832/2113904472 2024-09-12T01:59:24.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.342+0000 7f82fcae7640 1 --2- 172.21.15.19:0/1234182449 >> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] conn(0x55b2f03e3090 0x55b2f040cee0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ab14b5a70cf74b1 server_cookie=cbfeb27f4cf9f772 in_seq=0 out_seq=0 2024-09-12T01:59:24.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.343+0000 7f82d77fe640 1 -- 172.21.15.19:0/1234182449 <== mds.0 v2:172.21.15.19:6832/2113904472 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55b2f0322fa0 con 0x55b2f03e3090 2024-09-12T01:59:24.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.343+0000 7f82d77fe640 10 client.6303 handle_command_reply: tid=0 2024-09-12T01:59:24.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.343+0000 7f8301bc3740 1 client.6303 shutdown 2024-09-12T01:59:24.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.343+0000 7f8301bc3740 1 -- 172.21.15.19:0/1234182449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03baa50 msgr2=0x55b2f0480eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.343+0000 7f8301bc3740 1 --2- 172.21.15.19:0/1234182449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03baa50 0x55b2f0480eb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f82f0042040 tx=0x7f82f0004ab0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.343+0000 7f8301bc3740 1 -- 172.21.15.19:0/1234182449 shutdown_connections 2024-09-12T01:59:24.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.343+0000 7f8301bc3740 1 --2- 172.21.15.19:0/1234182449 >> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] conn(0x55b2f03e3090 0x55b2f040cee0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.343+0000 7f8301bc3740 1 --2- 172.21.15.19:0/1234182449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f03baa50 0x55b2f0480eb0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.343+0000 7f8301bc3740 1 --2- 172.21.15.19:0/1234182449 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2f03b92c0 0x55b2f0480970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.343+0000 7f82d77fe640 0 client.6303 ms_handle_reset on v2:172.21.15.19:6832/2113904472 2024-09-12T01:59:24.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.343+0000 7f8301bc3740 1 --2- 172.21.15.19:0/1234182449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2f03b4580 0x55b2f047c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.343+0000 7f8301bc3740 1 -- 172.21.15.19:0/1234182449 >> 172.21.15.19:0/1234182449 conn(0x55b2f03b6a80 msgr2=0x55b2f03fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:24.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.343+0000 7f8301bc3740 1 -- 172.21.15.19:0/1234182449 shutdown_connections 2024-09-12T01:59:24.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.343+0000 7f8301bc3740 1 -- 172.21.15.19:0/1234182449 wait complete. 2024-09-12T01:59:24.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.343+0000 7f8301bc3740 20 client.6303 trim_cache size 0 max 16384 2024-09-12T01:59:24.355 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:59:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T01:59:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T01:59:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 5865, 2024-09-12T01:59:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T01:59:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T01:59:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T01:59:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 4.6433481910000003, 2024-09-12T01:59:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 55, 2024-09-12T01:59:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 70, 2024-09-12T01:59:24.356 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 70, 2024-09-12T01:59:24.356 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 57.291932275000001 2024-09-12T01:59:24.356 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:59:24.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.343+0000 7f82fed4b640 1 -- 172.21.15.19:0/1825078332 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f82e406be30 msgr2=0x7f82e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.343+0000 7f82fed4b640 1 --2- 172.21.15.19:0/1825078332 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f82e406be30 0x7f82e406e2f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f82e800a950 tx=0x7f82e8008040 comp rx=0 tx=0).stop 2024-09-12T01:59:24.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.344+0000 7f82fed4b640 1 -- 172.21.15.19:0/1825078332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82f80d30f0 msgr2=0x7f82f80a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.344+0000 7f82fed4b640 1 --2- 172.21.15.19:0/1825078332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82f80d30f0 0x7f82f80a0ba0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00c4b0 tx=0x7f82ec00c970 comp rx=0 tx=0).stop 2024-09-12T01:59:24.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.344+0000 7f82fed4b640 1 -- 172.21.15.19:0/1825078332 shutdown_connections 2024-09-12T01:59:24.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.344+0000 7f82fed4b640 1 --2- 172.21.15.19:0/1825078332 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f82e406be30 0x7f82e406e2f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.344+0000 7f82fed4b640 1 --2- 172.21.15.19:0/1825078332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82f815e5f0 0x7f82f80b7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.344+0000 7f82fed4b640 1 --2- 172.21.15.19:0/1825078332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82f80d30f0 0x7f82f80a0ba0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.344+0000 7f82fed4b640 1 --2- 172.21.15.19:0/1825078332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82f80b6690 0x7f82f8154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.344+0000 7f82fed4b640 1 -- 172.21.15.19:0/1825078332 >> 172.21.15.19:0/1825078332 conn(0x7f82f808bfc0 msgr2=0x7f82f80b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:24.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.344+0000 7f82fed4b640 1 -- 172.21.15.19:0/1825078332 shutdown_connections 2024-09-12T01:59:24.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:24.344+0000 7f82fed4b640 1 -- 172.21.15.19:0/1825078332 wait complete. 2024-09-12T01:59:24.465 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:59:24.468 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:59:25.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-12T01:59:27.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:27.018+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=BANNER_CONNECTING pgs=15 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:27.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:27.018+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 crc :-1 s=SESSION_RECONNECTING pgs=15 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_session_reset received session reset full=1 2024-09-12T01:59:27.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:27.018+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 crc :-1 s=SESSION_RECONNECTING pgs=15 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).reset_session 2024-09-12T01:59:27.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:27.018+0000 7f18a7fff640 0 client.6210 ms_handle_remote_reset on v2:172.21.15.19:6833/740310996 2024-09-12T01:59:27.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:27.018+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-09-12T01:59:27.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:27.018+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:59:27.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:27.018+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:59:27.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:27.018+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-12T01:59:42.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:42.034+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:42.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:42.034+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-09-12T01:59:42.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:42.034+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:59:42.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:42.034+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:59:42.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:42.034+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-12T01:59:54.722 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:59:54.725 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:59:57.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:57.049+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:57.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:57.049+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-09-12T01:59:57.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:57.049+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:59:57.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:57.049+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:59:57.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:59:57.049+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-12T02:00:12.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:12.065+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:12.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:12.065+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-09-12T02:00:12.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:12.065+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:00:12.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:12.065+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:00:12.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:12.065+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-12T02:00:24.784 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:00:24.788 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:00:27.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:27.078+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:27.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:27.078+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-09-12T02:00:27.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:27.078+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:00:27.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:27.078+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:00:27.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:27.078+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-12T02:00:42.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:42.093+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:42.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:42.093+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-09-12T02:00:42.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:42.093+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:00:42.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:42.093+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:00:42.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:42.093+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-12T02:00:54.865 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:00:54.868 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:00:57.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:57.108+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:57.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:57.108+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-09-12T02:00:57.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:57.108+0000 7f18d0e8c640 1 -- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 msgr2=0x562c70ad7530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:00:57.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:57.108+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:00:57.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:00:57.108+0000 7f18d0e8c640 1 --2- 172.21.15.19:0/3864360722 >> [v2:172.21.15.19:6833/740310996,v1:172.21.15.19:6835/740310996] conn(0x562c70ad36f0 0x562c70ad7530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-12T02:01:01.435 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-12T02:01:01.436 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:01:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.551+0000 7f6ba05cf640 1 Processor -- start 2024-09-12T02:01:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.551+0000 7f6ba05cf640 1 -- start start 2024-09-12T02:01:01.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.552+0000 7f6ba05cf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b98158210 0x7f6b980b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:01.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.553+0000 7f6ba05cf640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6b981585f0 0x7f6b98072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:01.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.553+0000 7f6ba05cf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b980b5430 0x7f6b98072e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:01.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.553+0000 7f6ba05cf640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f6b980b4330 con 0x7f6b980b5430 2024-09-12T02:01:01.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.553+0000 7f6ba05cf640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6b980b59b0 con 0x7f6b981585f0 2024-09-12T02:01:01.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.553+0000 7f6ba05cf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6b980b3570 con 0x7f6b98158210 2024-09-12T02:01:01.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.553+0000 7f6b9eb6c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b980b5430 0x7f6b98072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:01.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.553+0000 7f6b9eb6c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b980b5430 0x7f6b98072e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34408/0 (socket says 172.21.15.19:34408) 2024-09-12T02:01:01.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.553+0000 7f6b9eb6c640 1 -- 172.21.15.19:0/2775822536 learned_addr learned my addr 172.21.15.19:0/2775822536 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:01.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.553+0000 7f6b9e36b640 1 --2- 172.21.15.19:0/2775822536 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b98158210 0x7f6b980b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:01.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.553+0000 7f6b9db6a640 1 --2- 172.21.15.19:0/2775822536 >> v2:172.21.15.135:3300/0 conn(0x7f6b981585f0 0x7f6b98072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:01.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.553+0000 7f6b9eb6c640 1 -- 172.21.15.19:0/2775822536 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b98158210 msgr2=0x7f6b980b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:01.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.553+0000 7f6b9eb6c640 1 --2- 172.21.15.19:0/2775822536 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b98158210 0x7f6b980b4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:01.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.553+0000 7f6b9eb6c640 1 -- 172.21.15.19:0/2775822536 >> v2:172.21.15.135:3300/0 conn(0x7f6b981585f0 msgr2=0x7f6b98072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:01.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.553+0000 7f6b9eb6c640 1 --2- 172.21.15.19:0/2775822536 >> v2:172.21.15.135:3300/0 conn(0x7f6b981585f0 0x7f6b98072940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.553+0000 7f6b9eb6c640 1 -- 172.21.15.19:0/2775822536 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b980b3850 con 0x7f6b980b5430 2024-09-12T02:01:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.554+0000 7f6b9eb6c640 1 --2- 172.21.15.19:0/2775822536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b980b5430 0x7f6b98072e80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6b980b5bc0 tx=0x7f6b9002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4b51a6369360d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.554+0000 7f6b9d369640 1 -- 172.21.15.19:0/2775822536 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b90036070 con 0x7f6b980b5430 2024-09-12T02:01:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.554+0000 7f6b9d369640 1 -- 172.21.15.19:0/2775822536 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b90031600 con 0x7f6b980b5430 2024-09-12T02:01:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.554+0000 7f6b9d369640 1 -- 172.21.15.19:0/2775822536 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b900319d0 con 0x7f6b980b5430 2024-09-12T02:01:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.555+0000 7f6ba05cf640 1 -- 172.21.15.19:0/2775822536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b980b5430 msgr2=0x7f6b98072e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.555+0000 7f6ba05cf640 1 --2- 172.21.15.19:0/2775822536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b980b5430 0x7f6b98072e80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6b980b5bc0 tx=0x7f6b9002a680 comp rx=0 tx=0).stop 2024-09-12T02:01:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.555+0000 7f6ba05cf640 1 -- 172.21.15.19:0/2775822536 shutdown_connections 2024-09-12T02:01:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.555+0000 7f6ba05cf640 1 --2- 172.21.15.19:0/2775822536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b980b5430 0x7f6b98072e80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:01.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.555+0000 7f6ba05cf640 1 --2- 172.21.15.19:0/2775822536 >> v2:172.21.15.135:3300/0 conn(0x7f6b981585f0 0x7f6b98072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:01.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.555+0000 7f6ba05cf640 1 --2- 172.21.15.19:0/2775822536 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b98158210 0x7f6b980b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:01.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.555+0000 7f6ba05cf640 1 -- 172.21.15.19:0/2775822536 >> 172.21.15.19:0/2775822536 conn(0x7f6b98067d70 msgr2=0x7f6b9806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:01.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.555+0000 7f6ba05cf640 1 -- 172.21.15.19:0/2775822536 shutdown_connections 2024-09-12T02:01:01.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.555+0000 7f6ba05cf640 1 -- 172.21.15.19:0/2775822536 wait complete. 2024-09-12T02:01:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.556+0000 7f6ba05cf640 1 Processor -- start 2024-09-12T02:01:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.556+0000 7f6ba05cf640 1 -- start start 2024-09-12T02:01:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.557+0000 7f6ba05cf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b980b5430 0x7f6b98154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.557+0000 7f6ba05cf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b98158210 0x7f6b9815b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.557+0000 7f6ba05cf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b981585f0 0x7f6b9815d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.557+0000 7f6ba05cf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6b980cd0e0 con 0x7f6b98158210 2024-09-12T02:01:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.557+0000 7f6ba05cf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b980b3e10 con 0x7f6b981585f0 2024-09-12T02:01:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.557+0000 7f6ba05cf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6b980720b0 con 0x7f6b980b5430 2024-09-12T02:01:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.557+0000 7f6b9db6a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b98158210 0x7f6b9815b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.557+0000 7f6b9db6a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b98158210 0x7f6b9815b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34418/0 (socket says 172.21.15.19:34418) 2024-09-12T02:01:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.557+0000 7f6b9db6a640 1 -- 172.21.15.19:0/2918120356 learned_addr learned my addr 172.21.15.19:0/2918120356 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:01.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.557+0000 7f6b9e36b640 1 --2- 172.21.15.19:0/2918120356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b980b5430 0x7f6b98154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.557+0000 7f6b9eb6c640 1 --2- 172.21.15.19:0/2918120356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b981585f0 0x7f6b9815d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.558+0000 7f6b9db6a640 1 -- 172.21.15.19:0/2918120356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b980b5430 msgr2=0x7f6b98154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.558+0000 7f6b9db6a640 1 --2- 172.21.15.19:0/2918120356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b980b5430 0x7f6b98154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.558+0000 7f6b9db6a640 1 -- 172.21.15.19:0/2918120356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b981585f0 msgr2=0x7f6b9815d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.558+0000 7f6b9db6a640 1 --2- 172.21.15.19:0/2918120356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b981585f0 0x7f6b9815d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.558+0000 7f6b9db6a640 1 -- 172.21.15.19:0/2918120356 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9815a8e0 con 0x7f6b98158210 2024-09-12T02:01:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.558+0000 7f6b9db6a640 1 --2- 172.21.15.19:0/2918120356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b98158210 0x7f6b9815b2f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800e870 tx=0x7f6b8800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.558+0000 7f6b8effd640 1 -- 172.21.15.19:0/2918120356 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88017070 con 0x7f6b98158210 2024-09-12T02:01:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.558+0000 7f6b8effd640 1 -- 172.21.15.19:0/2918120356 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8800c940 con 0x7f6b98158210 2024-09-12T02:01:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.558+0000 7f6ba05cf640 1 -- 172.21.15.19:0/2918120356 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9815aba0 con 0x7f6b98158210 2024-09-12T02:01:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.558+0000 7f6b8effd640 1 -- 172.21.15.19:0/2918120356 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8800cd30 con 0x7f6b98158210 2024-09-12T02:01:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.558+0000 7f6ba05cf640 1 -- 172.21.15.19:0/2918120356 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b9815d5e0 con 0x7f6b98158210 2024-09-12T02:01:01.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.559+0000 7f6ba05cf640 1 -- 172.21.15.19:0/2918120356 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b980b4ef0 con 0x7f6b98158210 2024-09-12T02:01:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.560+0000 7f6b8effd640 1 -- 172.21.15.19:0/2918120356 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b8801a070 con 0x7f6b98158210 2024-09-12T02:01:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.560+0000 7f6b8effd640 1 --2- 172.21.15.19:0/2918120356 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b7c06be30 0x7f6b7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.560+0000 7f6b8effd640 1 -- 172.21.15.19:0/2918120356 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6389+0+0 (secure 0 0 0) 0x7f6b8808ae20 con 0x7f6b98158210 2024-09-12T02:01:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.560+0000 7f6b9e36b640 1 --2- 172.21.15.19:0/2918120356 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b7c06be30 0x7f6b7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:01.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.561+0000 7f6b9e36b640 1 --2- 172.21.15.19:0/2918120356 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b7c06be30 0x7f6b7c06e2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400b240 tx=0x7f6b9400b3a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.565+0000 7f6b8effd640 1 -- 172.21.15.19:0/2918120356 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b88058f60 con 0x7f6b98158210 2024-09-12T02:01:01.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.778+0000 7f6ba05cf640 1 -- 172.21.15.19:0/2918120356 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6b9806e8d0 con 0x7f6b98158210 2024-09-12T02:01:01.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.778+0000 7f6b8effd640 1 -- 172.21.15.19:0/2918120356 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) ==== 53+0+73 (secure 0 0 0) 0x7f6b8805d260 con 0x7f6b98158210 2024-09-12T02:01:01.779 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:01:01.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.780+0000 7f6ba05cf640 1 -- 172.21.15.19:0/2918120356 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b7c06be30 msgr2=0x7f6b7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:01.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.780+0000 7f6ba05cf640 1 --2- 172.21.15.19:0/2918120356 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b7c06be30 0x7f6b7c06e2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400b240 tx=0x7f6b9400b3a0 comp rx=0 tx=0).stop 2024-09-12T02:01:01.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.780+0000 7f6ba05cf640 1 -- 172.21.15.19:0/2918120356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b98158210 msgr2=0x7f6b9815b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:01.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.780+0000 7f6ba05cf640 1 --2- 172.21.15.19:0/2918120356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b98158210 0x7f6b9815b2f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800e870 tx=0x7f6b8800ed30 comp rx=0 tx=0).stop 2024-09-12T02:01:01.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.780+0000 7f6ba05cf640 1 -- 172.21.15.19:0/2918120356 shutdown_connections 2024-09-12T02:01:01.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.780+0000 7f6ba05cf640 1 --2- 172.21.15.19:0/2918120356 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b7c06be30 0x7f6b7c06e2f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:01.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.780+0000 7f6ba05cf640 1 --2- 172.21.15.19:0/2918120356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b981585f0 0x7f6b9815d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:01.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.780+0000 7f6ba05cf640 1 --2- 172.21.15.19:0/2918120356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b98158210 0x7f6b9815b2f0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:01.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.780+0000 7f6ba05cf640 1 --2- 172.21.15.19:0/2918120356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b980b5430 0x7f6b98154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:01.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.780+0000 7f6ba05cf640 1 -- 172.21.15.19:0/2918120356 >> 172.21.15.19:0/2918120356 conn(0x7f6b98067d70 msgr2=0x7f6b9806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:01.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.780+0000 7f6ba05cf640 1 -- 172.21.15.19:0/2918120356 shutdown_connections 2024-09-12T02:01:01.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:01.780+0000 7f6ba05cf640 1 -- 172.21.15.19:0/2918120356 wait complete. 2024-09-12T02:01:01.792 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:01:01.792 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:01:01.792 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T02:01:01.792 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:01:01.792 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:01:01.792 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:01:01.792 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:01:01.792 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:01:01.792 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:01:01.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:01:01.793 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T02:01:01.811 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:01:01.811 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:01:01.811 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:01:01.811 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:01:01.811 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T02:01:01.812 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:01:01.812 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:01:01.812 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:01:01.812 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T02:01:01.812 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:01:01.812 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:01:01.812 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T02:01:01.813 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:01:01.813 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:01:01.813 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T02:01:01.813 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:01:01.813 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42499sec preferred_lft 42499sec 2024-09-12T02:01:01.813 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T02:01:01.813 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:01:01.814 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:01:01.814 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:01:01.814 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T02:01:01.814 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:01:01.814 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T02:01:01.814 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:01:01.814 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:01:01.814 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T02:01:01.814 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:01:01.814 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:01:01.814 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:01:01.814 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T02:01:01.814 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:01:01.814 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:01:01.815 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:01:01.815 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T02:01:01.815 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:01:01.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:01:01.815 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:01:01.875 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T02:01:01.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:01:01.877 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T02:01:01.934 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T02:01:01.935 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:01:01.935 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:01:01.935 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:01:01.935 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:01:01.935 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:01:01.935 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T02:01:01.935 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:01:01.935 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:01:01.935 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:01:01.936 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T02:01:02.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:01:02.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:01:02.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:01:02.064 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T02:01:02.080 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:01:02.080 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:01:02.080 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:01:02.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:01:02.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T02:01:02.146 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:01:02.146 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:01:02.202 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:01:02.202 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:01:02.202 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:01:02.258 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:01:02.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:01:02.258 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:01:02.344 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:01:02.344 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:01:02.344 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:01:02.353 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:01:02.353 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:01:02.353 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:01:02.353 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:01:02.353 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:01:02.359 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:01:02.359 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:01:02.359 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:01:02.359 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:01:02.359 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:01:02.359 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T02:01:02.359 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T02:01:02.360 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T02:01:02.360 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:01:02.360 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:01:02.360 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:01:02.360 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:01:02.360 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:01:02.361 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:01:02.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:01:02.362 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:01:02.387 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:01:02.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:01:02.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:01:02.484 INFO:teuthology.orchestra.run.smithi019.stdout:client5953 2024-09-12T02:01:02.485 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:01:02.485 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:01:02.502 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat a/ && find a/') 2024-09-12T02:01:02.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:01:02.593 INFO:teuthology.orchestra.run.smithi019.stdout: File: a/ 2024-09-12T02:01:02.593 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 2 Blocks: 0 IO Block: 65536 directory 2024-09-12T02:01:02.593 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 29h/41d Inode: 1099511627776 Links: 4 2024-09-12T02:01:02.594 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0755/drwxr-xr-x) Uid: ( 1000/ ubuntu) Gid: ( 1333/ ubuntu) 2024-09-12T02:01:02.594 INFO:teuthology.orchestra.run.smithi019.stdout:Context: unconfined_u:object_r:unlabeled_t:s0 2024-09-12T02:01:02.594 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-12 01:58:46.693236198 +0000 2024-09-12T02:01:02.594 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-12 01:58:46.696236166 +0000 2024-09-12T02:01:02.594 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-12 01:58:46.696236166 +0000 2024-09-12T02:01:02.594 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-12 01:58:46.693236198 +0000 2024-09-12T02:01:02.598 INFO:teuthology.orchestra.run.smithi019.stdout:a/ 2024-09-12T02:01:02.598 INFO:teuthology.orchestra.run.smithi019.stdout:a/c 2024-09-12T02:01:02.598 INFO:teuthology.orchestra.run.smithi019.stdout:a/c/d 2024-09-12T02:01:02.598 INFO:teuthology.orchestra.run.smithi019.stdout:a/b 2024-09-12T02:01:02.598 INFO:teuthology.orchestra.run.smithi019.stdout:a/b/d 2024-09-12T02:01:02.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:01:02.604 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2024-09-12T02:01:02.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.710+0000 7f5a175d8640 1 Processor -- start 2024-09-12T02:01:02.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.710+0000 7f5a175d8640 1 -- start start 2024-09-12T02:01:02.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.711+0000 7f5a175d8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5a10162340 0x7f5a1006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.711+0000 7f5a175d8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5a100cf280 0x7f5a10162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.711+0000 7f5a175d8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a1015ff70 con 0x7f5a10162c60 2024-09-12T02:01:02.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.711+0000 7f5a175d8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f5a1006de90 con 0x7f5a100cf280 2024-09-12T02:01:02.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.711+0000 7f5a175d8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f5a100d4d10 con 0x7f5a10162340 2024-09-12T02:01:02.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.711+0000 7f5a14b73640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5a100cf280 0x7f5a10162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.711+0000 7f5a15b75640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5a10162c60 0x7f5a100d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58926/0 (socket says 172.21.15.19:58926) 2024-09-12T02:01:02.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.711+0000 7f5a15b75640 1 -- 172.21.15.19:0/3270449122 learned_addr learned my addr 172.21.15.19:0/3270449122 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:02.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.711+0000 7f5a15374640 1 --2- 172.21.15.19:0/3270449122 >> v2:172.21.15.135:3300/0 conn(0x7f5a10162340 0x7f5a1006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.711+0000 7f5a14b73640 1 -- 172.21.15.19:0/3270449122 >> v2:172.21.15.135:3300/0 conn(0x7f5a10162340 msgr2=0x7f5a1006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:02.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.711+0000 7f5a14b73640 1 --2- 172.21.15.19:0/3270449122 >> v2:172.21.15.135:3300/0 conn(0x7f5a10162340 0x7f5a1006d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.711+0000 7f5a14b73640 1 -- 172.21.15.19:0/3270449122 >> v1:172.21.15.19:6789/0 conn(0x7f5a10162c60 legacy=0x7f5a100d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:02.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.711+0000 7f5a14b73640 1 -- 172.21.15.19:0/3270449122 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a100d4ff0 con 0x7f5a100cf280 2024-09-12T02:01:02.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.711+0000 7f5a07fff640 1 -- 172.21.15.19:0/3270449122 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3647430205 0 0) 0x7f5a1015ff70 con 0x7f5a10162c60 2024-09-12T02:01:02.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.712+0000 7f5a14b73640 1 --2- 172.21.15.19:0/3270449122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a100cf280 0x7f5a10162720 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5a1008e4c0 tx=0x7f5a0002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737fb5c93cf26777 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:02.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.713+0000 7f5a07fff640 1 -- 172.21.15.19:0/3270449122 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00037070 con 0x7f5a100cf280 2024-09-12T02:01:02.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.713+0000 7f5a07fff640 1 -- 172.21.15.19:0/3270449122 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a00032440 con 0x7f5a100cf280 2024-09-12T02:01:02.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.713+0000 7f5a07fff640 1 -- 172.21.15.19:0/3270449122 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0002ae60 con 0x7f5a100cf280 2024-09-12T02:01:02.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.713+0000 7f5a175d8640 1 -- 172.21.15.19:0/3270449122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a100cf280 msgr2=0x7f5a10162720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:02.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.713+0000 7f5a175d8640 1 --2- 172.21.15.19:0/3270449122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a100cf280 0x7f5a10162720 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5a1008e4c0 tx=0x7f5a0002a110 comp rx=0 tx=0).stop 2024-09-12T02:01:02.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.713+0000 7f5a175d8640 1 -- 172.21.15.19:0/3270449122 shutdown_connections 2024-09-12T02:01:02.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.713+0000 7f5a175d8640 1 --2- 172.21.15.19:0/3270449122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a100cf280 0x7f5a10162720 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.713+0000 7f5a175d8640 1 --2- 172.21.15.19:0/3270449122 >> v2:172.21.15.135:3300/0 conn(0x7f5a10162340 0x7f5a1006d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.713+0000 7f5a175d8640 1 -- 172.21.15.19:0/3270449122 >> 172.21.15.19:0/3270449122 conn(0x7f5a1008bfc0 msgr2=0x7f5a100d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:02.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.713+0000 7f5a175d8640 1 -- 172.21.15.19:0/3270449122 shutdown_connections 2024-09-12T02:01:02.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.713+0000 7f5a175d8640 1 -- 172.21.15.19:0/3270449122 wait complete. 2024-09-12T02:01:02.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.714+0000 7f5a175d8640 1 Processor -- start 2024-09-12T02:01:02.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.715+0000 7f5a175d8640 1 -- start start 2024-09-12T02:01:02.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.715+0000 7f5a175d8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a100cf280 0x7f5a101f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.715+0000 7f5a175d8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a10162340 0x7f5a100cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.715+0000 7f5a175d8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a10162c60 0x7f5a10154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.715+0000 7f5a175d8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5a100cf6c0 con 0x7f5a100cf280 2024-09-12T02:01:02.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.715+0000 7f5a175d8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a100d52d0 con 0x7f5a10162340 2024-09-12T02:01:02.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.715+0000 7f5a175d8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5a101630d0 con 0x7f5a10162c60 2024-09-12T02:01:02.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.715+0000 7f5a15374640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a100cf280 0x7f5a101f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.715+0000 7f5a15374640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a100cf280 0x7f5a101f5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34442/0 (socket says 172.21.15.19:34442) 2024-09-12T02:01:02.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.715+0000 7f5a15374640 1 -- 172.21.15.19:0/1349459305 learned_addr learned my addr 172.21.15.19:0/1349459305 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:02.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.716+0000 7f5a14b73640 1 --2- 172.21.15.19:0/1349459305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a10162340 0x7f5a100cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.716+0000 7f5a15b75640 1 --2- 172.21.15.19:0/1349459305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a10162c60 0x7f5a10154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.716+0000 7f5a15374640 1 -- 172.21.15.19:0/1349459305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a10162c60 msgr2=0x7f5a10154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:02.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.716+0000 7f5a15374640 1 --2- 172.21.15.19:0/1349459305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a10162c60 0x7f5a10154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.716+0000 7f5a15374640 1 -- 172.21.15.19:0/1349459305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a10162340 msgr2=0x7f5a100cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:02.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.716+0000 7f5a15374640 1 --2- 172.21.15.19:0/1349459305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a10162340 0x7f5a100cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.716+0000 7f5a15374640 1 -- 172.21.15.19:0/1349459305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a100cbae0 con 0x7f5a100cf280 2024-09-12T02:01:02.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.716+0000 7f5a14b73640 1 --2- 172.21.15.19:0/1349459305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a10162340 0x7f5a100cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:02.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.716+0000 7f5a15374640 1 --2- 172.21.15.19:0/1349459305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a100cf280 0x7f5a101f5890 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00d800 tx=0x7f5a0c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:02.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.716+0000 7f5a05ffb640 1 -- 172.21.15.19:0/1349459305 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c00b6c0 con 0x7f5a100cf280 2024-09-12T02:01:02.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.716+0000 7f5a05ffb640 1 -- 172.21.15.19:0/1349459305 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a0c019070 con 0x7f5a100cf280 2024-09-12T02:01:02.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.716+0000 7f5a05ffb640 1 -- 172.21.15.19:0/1349459305 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c00ba80 con 0x7f5a100cf280 2024-09-12T02:01:02.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.716+0000 7f5a175d8640 1 -- 172.21.15.19:0/1349459305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a100cbdb0 con 0x7f5a100cf280 2024-09-12T02:01:02.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.716+0000 7f5a175d8640 1 -- 172.21.15.19:0/1349459305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a100cc370 con 0x7f5a100cf280 2024-09-12T02:01:02.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.718+0000 7f5a05ffb640 1 -- 172.21.15.19:0/1349459305 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a0c00bc20 con 0x7f5a100cf280 2024-09-12T02:01:02.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.719+0000 7f5a05ffb640 1 --2- 172.21.15.19:0/1349459305 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f59f406be30 0x7f59f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.719+0000 7f5a05ffb640 1 -- 172.21.15.19:0/1349459305 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6389+0+0 (secure 0 0 0) 0x7f5a0c08b600 con 0x7f5a100cf280 2024-09-12T02:01:02.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.719+0000 7f5a14b73640 1 --2- 172.21.15.19:0/1349459305 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f59f406be30 0x7f59f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.720+0000 7f5a14b73640 1 --2- 172.21.15.19:0/1349459305 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f59f406be30 0x7f59f406e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5a00034000 tx=0x7f5a0002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:02.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.720+0000 7f5a1a44d740 1 Processor -- start 2024-09-12T02:01:02.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.720+0000 7f5a1a44d740 1 -- start start 2024-09-12T02:01:02.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.720+0000 7f5a1a44d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4b96920 0x5644a4bdc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.720+0000 7f5a1a44d740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b940e0 0x5644a4b96d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.720+0000 7f5a1a44d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b980b0 0x5644a4b911a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.720+0000 7f5a1a44d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5644a4af96f0 con 0x5644a4b980b0 2024-09-12T02:01:02.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.720+0000 7f5a1a44d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5644a4aa1330 con 0x5644a4b96920 2024-09-12T02:01:02.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.720+0000 7f5a1a44d740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5644a4af56b0 con 0x5644a4b940e0 2024-09-12T02:01:02.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.720+0000 7f5a15b75640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b980b0 0x5644a4b911a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.721+0000 7f5a15b75640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b980b0 0x5644a4b911a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34448/0 (socket says 172.21.15.19:34448) 2024-09-12T02:01:02.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.721+0000 7f5a15b75640 1 -- 172.21.15.19:0/3907728161 learned_addr learned my addr 172.21.15.19:0/3907728161 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:02.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.721+0000 7f5a15374640 1 --2- 172.21.15.19:0/3907728161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4b96920 0x5644a4bdc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.721+0000 7f5a14b73640 1 --2- 172.21.15.19:0/3907728161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b940e0 0x5644a4b96d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.721+0000 7f5a15b75640 1 -- 172.21.15.19:0/3907728161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b940e0 msgr2=0x5644a4b96d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:02.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.721+0000 7f5a15b75640 1 --2- 172.21.15.19:0/3907728161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b940e0 0x5644a4b96d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.721+0000 7f5a15b75640 1 -- 172.21.15.19:0/3907728161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4b96920 msgr2=0x5644a4bdc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:02.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.721+0000 7f5a15b75640 1 --2- 172.21.15.19:0/3907728161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4b96920 0x5644a4bdc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.721+0000 7f5a15b75640 1 -- 172.21.15.19:0/3907728161 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a4ac70d0 con 0x5644a4b980b0 2024-09-12T02:01:02.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.721+0000 7f5a15b75640 1 --2- 172.21.15.19:0/3907728161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b980b0 0x5644a4b911a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f5a08007480 tx=0x7f5a08007940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f68a5ff0152dee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:02.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.721+0000 7f59f2ffd640 1 -- 172.21.15.19:0/3907728161 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08019070 con 0x5644a4b980b0 2024-09-12T02:01:02.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.721+0000 7f59f2ffd640 1 -- 172.21.15.19:0/3907728161 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a08001c50 con 0x5644a4b980b0 2024-09-12T02:01:02.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.721+0000 7f59f2ffd640 1 -- 172.21.15.19:0/3907728161 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08002020 con 0x5644a4b980b0 2024-09-12T02:01:02.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.722+0000 7f5a1a44d740 1 -- 172.21.15.19:0/3907728161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b980b0 msgr2=0x5644a4b911a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:02.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.722+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/3907728161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b980b0 0x5644a4b911a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f5a08007480 tx=0x7f5a08007940 comp rx=0 tx=0).stop 2024-09-12T02:01:02.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.722+0000 7f5a1a44d740 1 -- 172.21.15.19:0/3907728161 shutdown_connections 2024-09-12T02:01:02.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.722+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/3907728161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b980b0 0x5644a4b911a0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.722+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/3907728161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b940e0 0x5644a4b96d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.722+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/3907728161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4b96920 0x5644a4bdc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.722+0000 7f5a1a44d740 1 -- 172.21.15.19:0/3907728161 >> 172.21.15.19:0/3907728161 conn(0x5644a4b93370 msgr2=0x5644a4bdb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:02.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.722+0000 7f5a1a44d740 1 -- 172.21.15.19:0/3907728161 shutdown_connections 2024-09-12T02:01:02.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.722+0000 7f5a1a44d740 1 -- 172.21.15.19:0/3907728161 wait complete. 2024-09-12T02:01:02.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.722+0000 7f5a1a44d740 1 -- start start 2024-09-12T02:01:02.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.723+0000 7f5a1a44d740 1 Processor -- start 2024-09-12T02:01:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.723+0000 7f5a1a44d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b96920 0x5644a4bc0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.723+0000 7f5a1a44d740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b980b0 0x5644a4bb8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.723+0000 7f5a1a44d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4bb9d60 0x5644a4bba1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.723+0000 7f5a1a44d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5644a4b92810 con 0x5644a4b96920 2024-09-12T02:01:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.723+0000 7f5a1a44d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5644a4a824f0 con 0x5644a4bb9d60 2024-09-12T02:01:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.723+0000 7f5a1a44d740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5644a4bdc8f0 con 0x5644a4b980b0 2024-09-12T02:01:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f5a1a44d740 10 client.0 _ll_register_callbacks cb 0x5644a4aa3b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f5a15374640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b96920 0x5644a4bc0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f5a15374640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b96920 0x5644a4bc0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34454/0 (socket says 172.21.15.19:34454) 2024-09-12T02:01:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f5a15374640 1 -- 172.21.15.19:0/1833462314 learned_addr learned my addr 172.21.15.19:0/1833462314 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f5a15b75640 1 --2- 172.21.15.19:0/1833462314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4bb9d60 0x5644a4bba1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f5a14b73640 1 --2- 172.21.15.19:0/1833462314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b980b0 0x5644a4bb8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f5a15374640 1 -- 172.21.15.19:0/1833462314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b980b0 msgr2=0x5644a4bb8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f5a15374640 1 --2- 172.21.15.19:0/1833462314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b980b0 0x5644a4bb8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f5a15374640 1 -- 172.21.15.19:0/1833462314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4bb9d60 msgr2=0x5644a4bba1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f5a15374640 1 --2- 172.21.15.19:0/1833462314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4bb9d60 0x5644a4bba1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f5a15374640 1 -- 172.21.15.19:0/1833462314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644a48d67d0 con 0x5644a4b96920 2024-09-12T02:01:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f5a15b75640 1 --2- 172.21.15.19:0/1833462314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4bb9d60 0x5644a4bba1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f5a15374640 1 --2- 172.21.15.19:0/1833462314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b96920 0x5644a4bc0f80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c0592e0 tx=0x7f5a0c0595e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff05e5ffbc939d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f59ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:01:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f59ebfff640 1 -- 172.21.15.19:0/1833462314 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c071070 con 0x5644a4b96920 2024-09-12T02:01:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f59ebfff640 1 -- 172.21.15.19:0/1833462314 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6389+0+0 (secure 0 0 0) 0x7f5a0c058a30 con 0x5644a4b96920 2024-09-12T02:01:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f5a1a44d740 1 -- 172.21.15.19:0/1833462314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a08001c50 con 0x5644a4b96920 2024-09-12T02:01:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f59ebfff640 1 -- 172.21.15.19:0/1833462314 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f5a0c076050 con 0x5644a4b96920 2024-09-12T02:01:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f5a1a44d740 10 client.6324 fetch_fsmap learned FSMap version 55 2024-09-12T02:01:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.724+0000 7f5a1a44d740 1 -- 172.21.15.19:0/1833462314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x5644a480c3f0 con 0x5644a4b96920 2024-09-12T02:01:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.725+0000 7f59ebfff640 1 -- 172.21.15.19:0/1833462314 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a08001c50 con 0x5644a4b96920 2024-09-12T02:01:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.725+0000 7f59ebfff640 1 -- 172.21.15.19:0/1833462314 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 55) ==== 3502+0+0 (secure 0 0 0) 0x7f5a0c013070 con 0x5644a4b96920 2024-09-12T02:01:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.725+0000 7f5a1a44d740 10 client.6324 fetch_fsmap finished waiting for FSMap version 55 2024-09-12T02:01:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.725+0000 7f5a1a44d740 10 client.6324 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-12T02:01:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.725+0000 7f5a1a44d740 20 client.6324 populate_metadata read hostname 'smithi019' 2024-09-12T02:01:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.725+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/1833462314 >> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] conn(0x5644a4bbe8f0 0x5644a4bbecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.725+0000 7f5a1a44d740 4 client.6324 mds_command: new command op to 5865 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:01:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.725+0000 7f5a1a44d740 1 -- 172.21.15.19:0/1833462314 --> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644a4b06e20 con 0x5644a4bbe8f0 2024-09-12T02:01:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.725+0000 7f5a14b73640 1 --2- 172.21.15.19:0/1833462314 >> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] conn(0x5644a4bbe8f0 0x5644a4bbecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.725+0000 7f59ebfff640 10 client.6324 ms_handle_connect on v2:172.21.15.19:6832/2113904472 2024-09-12T02:01:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.725+0000 7f5a14b73640 1 --2- 172.21.15.19:0/1833462314 >> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] conn(0x5644a4bbe8f0 0x5644a4bbecf0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8a7de8427679ef0 server_cookie=a3070dda3c23436e in_seq=0 out_seq=0 2024-09-12T02:01:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.726+0000 7f59ebfff640 1 -- 172.21.15.19:0/1833462314 <== mds.0 v2:172.21.15.19:6832/2113904472 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5644a4b06e20 con 0x5644a4bbe8f0 2024-09-12T02:01:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.726+0000 7f59ebfff640 10 client.6324 handle_command_reply: tid=0 2024-09-12T02:01:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.726+0000 7f5a1a44d740 1 client.6324 shutdown 2024-09-12T02:01:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.726+0000 7f5a1a44d740 1 -- 172.21.15.19:0/1833462314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b96920 msgr2=0x5644a4bc0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.726+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/1833462314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b96920 0x5644a4bc0f80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c0592e0 tx=0x7f5a0c0595e0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.726+0000 7f5a1a44d740 1 -- 172.21.15.19:0/1833462314 shutdown_connections 2024-09-12T02:01:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.726+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/1833462314 >> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] conn(0x5644a4bbe8f0 0x5644a4bbecf0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.726+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/1833462314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4bb9d60 0x5644a4bba1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.726+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/1833462314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b980b0 0x5644a4bb8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.726+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/1833462314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b96920 0x5644a4bc0f80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.726+0000 7f5a1a44d740 1 -- 172.21.15.19:0/1833462314 >> 172.21.15.19:0/1833462314 conn(0x5644a4b940e0 msgr2=0x5644a4bd9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.726+0000 7f59ebfff640 0 client.6324 ms_handle_reset on v2:172.21.15.19:6832/2113904472 2024-09-12T02:01:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.726+0000 7f5a1a44d740 1 -- 172.21.15.19:0/1833462314 shutdown_connections 2024-09-12T02:01:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.726+0000 7f5a1a44d740 1 -- 172.21.15.19:0/1833462314 wait complete. 2024-09-12T02:01:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.726+0000 7f5a1a44d740 20 client.6324 trim_cache size 0 max 16384 2024-09-12T02:01:02.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.741+0000 7f5a1a44d740 1 Processor -- start 2024-09-12T02:01:02.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.741+0000 7f5a1a44d740 1 -- start start 2024-09-12T02:01:02.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a1a44d740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b96920 0x5644a4b916d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a1a44d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b980b0 0x5644a4b8c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a1a44d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4bb9d60 0x5644a4bedfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a1a44d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5a10201440 con 0x5644a4b980b0 2024-09-12T02:01:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a1a44d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a102004c0 con 0x5644a4bb9d60 2024-09-12T02:01:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a1a44d740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5a10159e30 con 0x5644a4b96920 2024-09-12T02:01:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a14b73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b980b0 0x5644a4b8c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a14b73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b980b0 0x5644a4b8c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34466/0 (socket says 172.21.15.19:34466) 2024-09-12T02:01:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a14b73640 1 -- 172.21.15.19:0/1671784356 learned_addr learned my addr 172.21.15.19:0/1671784356 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a15b75640 1 --2- 172.21.15.19:0/1671784356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4bb9d60 0x5644a4bedfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a14b73640 1 -- 172.21.15.19:0/1671784356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b96920 msgr2=0x5644a4b916d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a15374640 1 --2- 172.21.15.19:0/1671784356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b96920 0x5644a4b916d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a14b73640 1 --2- 172.21.15.19:0/1671784356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b96920 0x5644a4b916d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a14b73640 1 -- 172.21.15.19:0/1671784356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4bb9d60 msgr2=0x5644a4bedfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a14b73640 1 --2- 172.21.15.19:0/1671784356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4bb9d60 0x5644a4bedfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a14b73640 1 -- 172.21.15.19:0/1671784356 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a47cc0f0 con 0x5644a4b980b0 2024-09-12T02:01:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a15b75640 1 --2- 172.21.15.19:0/1671784356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4bb9d60 0x5644a4bedfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a15374640 1 --2- 172.21.15.19:0/1671784356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b96920 0x5644a4b916d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.742+0000 7f5a14b73640 1 --2- 172.21.15.19:0/1671784356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b980b0 0x5644a4b8c9f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f5a0002a700 tx=0x7f5a0002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5239ef0d6aad76 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.743+0000 7f59f27fc640 1 -- 172.21.15.19:0/1671784356 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00037040 con 0x5644a4b980b0 2024-09-12T02:01:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.743+0000 7f59f27fc640 1 -- 172.21.15.19:0/1671784356 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a0003e860 con 0x5644a4b980b0 2024-09-12T02:01:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.743+0000 7f59f27fc640 1 -- 172.21.15.19:0/1671784356 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0003ec10 con 0x5644a4b980b0 2024-09-12T02:01:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.743+0000 7f5a1a44d740 1 -- 172.21.15.19:0/1671784356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b980b0 msgr2=0x5644a4b8c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.743+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/1671784356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b980b0 0x5644a4b8c9f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f5a0002a700 tx=0x7f5a0002c000 comp rx=0 tx=0).stop 2024-09-12T02:01:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.743+0000 7f5a1a44d740 1 -- 172.21.15.19:0/1671784356 shutdown_connections 2024-09-12T02:01:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.743+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/1671784356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4bb9d60 0x5644a4bedfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.743+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/1671784356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4b980b0 0x5644a4b8c9f0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.743+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/1671784356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b96920 0x5644a4b916d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.743+0000 7f5a1a44d740 1 -- 172.21.15.19:0/1671784356 >> 172.21.15.19:0/1671784356 conn(0x5644a4b940e0 msgr2=0x5644a4bbd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:02.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.743+0000 7f5a1a44d740 1 -- 172.21.15.19:0/1671784356 shutdown_connections 2024-09-12T02:01:02.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.743+0000 7f5a1a44d740 1 -- 172.21.15.19:0/1671784356 wait complete. 2024-09-12T02:01:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.744+0000 7f5a1a44d740 1 -- start start 2024-09-12T02:01:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.744+0000 7f5a1a44d740 1 Processor -- start 2024-09-12T02:01:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.745+0000 7f5a1a44d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4b96920 0x5644a4beae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.745+0000 7f5a1a44d740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b980b0 0x5644a4beb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.745+0000 7f5a1a44d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4bb9d60 0x5644a4bbb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.745+0000 7f5a1a44d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5644a4bbf580 con 0x5644a4bb9d60 2024-09-12T02:01:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.745+0000 7f5a1a44d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1015a480 con 0x5644a4b96920 2024-09-12T02:01:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.745+0000 7f5a1a44d740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5644a4b927c0 con 0x5644a4b980b0 2024-09-12T02:01:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.745+0000 7f5a1a44d740 10 client.0 _ll_register_callbacks cb 0x7f5a0c006d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.745+0000 7f5a15b75640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4bb9d60 0x5644a4bbb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.745+0000 7f5a15b75640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4bb9d60 0x5644a4bbb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34478/0 (socket says 172.21.15.19:34478) 2024-09-12T02:01:02.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.745+0000 7f5a15b75640 1 -- 172.21.15.19:0/3054503856 learned_addr learned my addr 172.21.15.19:0/3054503856 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:02.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.745+0000 7f5a15374640 1 --2- 172.21.15.19:0/3054503856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4b96920 0x5644a4beae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.745+0000 7f5a14b73640 1 --2- 172.21.15.19:0/3054503856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b980b0 0x5644a4beb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.745+0000 7f5a15b75640 1 -- 172.21.15.19:0/3054503856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b980b0 msgr2=0x5644a4beb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:02.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.745+0000 7f5a15b75640 1 --2- 172.21.15.19:0/3054503856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b980b0 0x5644a4beb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.745+0000 7f5a15b75640 1 -- 172.21.15.19:0/3054503856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4b96920 msgr2=0x5644a4beae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:02.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.745+0000 7f5a15b75640 1 --2- 172.21.15.19:0/3054503856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4b96920 0x5644a4beae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.745+0000 7f5a15b75640 1 -- 172.21.15.19:0/3054503856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644a4bc0a70 con 0x5644a4bb9d60 2024-09-12T02:01:02.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.746+0000 7f5a15b75640 1 --2- 172.21.15.19:0/3054503856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4bb9d60 0x5644a4bbb720 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5a08017040 tx=0x7f5a08007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21034198b582a4be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:02.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.746+0000 7f59ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:01:02.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.746+0000 7f59ebfff640 1 -- 172.21.15.19:0/3054503856 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08025060 con 0x5644a4bb9d60 2024-09-12T02:01:02.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.746+0000 7f59ebfff640 1 -- 172.21.15.19:0/3054503856 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6389+0+0 (secure 0 0 0) 0x7f5a08014480 con 0x5644a4bb9d60 2024-09-12T02:01:02.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.746+0000 7f5a1a44d740 1 -- 172.21.15.19:0/3054503856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a0003e860 con 0x5644a4bb9d60 2024-09-12T02:01:02.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.746+0000 7f59ebfff640 1 -- 172.21.15.19:0/3054503856 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f5a0802b050 con 0x5644a4bb9d60 2024-09-12T02:01:02.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.746+0000 7f5a1a44d740 10 client.6330 fetch_fsmap learned FSMap version 55 2024-09-12T02:01:02.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.746+0000 7f5a1a44d740 1 -- 172.21.15.19:0/3054503856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x5644a4bc0270 con 0x5644a4bb9d60 2024-09-12T02:01:02.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.746+0000 7f59ebfff640 1 -- 172.21.15.19:0/3054503856 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a0003e860 con 0x5644a4bb9d60 2024-09-12T02:01:02.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.746+0000 7f59ebfff640 1 -- 172.21.15.19:0/3054503856 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 55) ==== 3502+0+0 (secure 0 0 0) 0x7f5a0802e020 con 0x5644a4bb9d60 2024-09-12T02:01:02.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.746+0000 7f5a1a44d740 10 client.6330 fetch_fsmap finished waiting for FSMap version 55 2024-09-12T02:01:02.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.746+0000 7f5a1a44d740 10 client.6330 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-12T02:01:02.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.746+0000 7f5a1a44d740 20 client.6330 populate_metadata read hostname 'smithi019' 2024-09-12T02:01:02.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.746+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/3054503856 >> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] conn(0x5644a4bd9e90 0x5644a4bbbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:02.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.746+0000 7f5a1a44d740 4 client.6330 mds_command: new command op to 5865 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:01:02.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.746+0000 7f5a1a44d740 1 -- 172.21.15.19:0/3054503856 --> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5644a4b01170 con 0x5644a4bd9e90 2024-09-12T02:01:02.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.746+0000 7f5a15374640 1 --2- 172.21.15.19:0/3054503856 >> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] conn(0x5644a4bd9e90 0x5644a4bbbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:02.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.747+0000 7f59ebfff640 10 client.6330 ms_handle_connect on v2:172.21.15.19:6832/2113904472 2024-09-12T02:01:02.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.747+0000 7f5a15374640 1 --2- 172.21.15.19:0/3054503856 >> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] conn(0x5644a4bd9e90 0x5644a4bbbc60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7489c2182e26645e server_cookie=932d23cca460611f in_seq=0 out_seq=0 2024-09-12T02:01:02.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.765+0000 7f59ebfff640 1 -- 172.21.15.19:0/3054503856 <== mds.0 v2:172.21.15.19:6832/2113904472 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5644a4b01170 con 0x5644a4bd9e90 2024-09-12T02:01:02.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.765+0000 7f59ebfff640 10 client.6330 handle_command_reply: tid=0 2024-09-12T02:01:02.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.765+0000 7f5a1a44d740 1 client.6330 shutdown 2024-09-12T02:01:02.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.766+0000 7f5a1a44d740 1 -- 172.21.15.19:0/3054503856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4bb9d60 msgr2=0x5644a4bbb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:02.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.766+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/3054503856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4bb9d60 0x5644a4bbb720 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5a08017040 tx=0x7f5a08007ec0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.766+0000 7f5a1a44d740 1 -- 172.21.15.19:0/3054503856 shutdown_connections 2024-09-12T02:01:02.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.766+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/3054503856 >> [v2:172.21.15.19:6832/2113904472,v1:172.21.15.19:6834/2113904472] conn(0x5644a4bd9e90 0x5644a4bbbc60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.766+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/3054503856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644a4bb9d60 0x5644a4bbb720 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.766+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/3054503856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5644a4b980b0 0x5644a4beb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.766+0000 7f59ebfff640 0 client.6330 ms_handle_reset on v2:172.21.15.19:6832/2113904472 2024-09-12T02:01:02.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.766+0000 7f5a1a44d740 1 --2- 172.21.15.19:0/3054503856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5644a4b96920 0x5644a4beae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.766+0000 7f5a1a44d740 1 -- 172.21.15.19:0/3054503856 >> 172.21.15.19:0/3054503856 conn(0x5644a4b940e0 msgr2=0x5644a4bbd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:02.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.766+0000 7f5a1a44d740 1 -- 172.21.15.19:0/3054503856 shutdown_connections 2024-09-12T02:01:02.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.766+0000 7f5a1a44d740 1 -- 172.21.15.19:0/3054503856 wait complete. 2024-09-12T02:01:02.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.766+0000 7f5a1a44d740 20 client.6330 trim_cache size 0 max 16384 2024-09-12T02:01:02.768 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:01:02.768 INFO:teuthology.orchestra.run.smithi019.stdout: "message": "", 2024-09-12T02:01:02.768 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0 2024-09-12T02:01:02.768 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:01:02.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.767+0000 7f5a175d8640 1 -- 172.21.15.19:0/1349459305 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f59f406be30 msgr2=0x7f59f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:02.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.767+0000 7f5a175d8640 1 --2- 172.21.15.19:0/1349459305 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f59f406be30 0x7f59f406e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5a00034000 tx=0x7f5a0002e000 comp rx=0 tx=0).stop 2024-09-12T02:01:02.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.767+0000 7f5a175d8640 1 -- 172.21.15.19:0/1349459305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a100cf280 msgr2=0x7f5a101f5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:02.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.767+0000 7f5a175d8640 1 --2- 172.21.15.19:0/1349459305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a100cf280 0x7f5a101f5890 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00d800 tx=0x7f5a0c00dcc0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.767+0000 7f5a175d8640 1 -- 172.21.15.19:0/1349459305 shutdown_connections 2024-09-12T02:01:02.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.767+0000 7f5a175d8640 1 --2- 172.21.15.19:0/1349459305 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f59f406be30 0x7f59f406e2f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.767+0000 7f5a175d8640 1 --2- 172.21.15.19:0/1349459305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a10162c60 0x7f5a10154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.767+0000 7f5a175d8640 1 --2- 172.21.15.19:0/1349459305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a10162340 0x7f5a100cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.767+0000 7f5a175d8640 1 --2- 172.21.15.19:0/1349459305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a100cf280 0x7f5a101f5890 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:02.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.767+0000 7f5a175d8640 1 -- 172.21.15.19:0/1349459305 >> 172.21.15.19:0/1349459305 conn(0x7f5a1008bfc0 msgr2=0x7f5a100b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:02.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.767+0000 7f5a175d8640 1 -- 172.21.15.19:0/1349459305 shutdown_connections 2024-09-12T02:01:02.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:02.767+0000 7f5a175d8640 1 -- 172.21.15.19:0/1349459305 wait complete. 2024-09-12T02:01:02.778 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:01:02.778 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:01:02.816 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:01:02.858 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:01:02.858 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:01:02.859 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:01:02.859 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:01:02.875 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:01:02.875 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:01:02.932 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:01:03.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.076+0000 7fe52caac640 1 Processor -- start 2024-09-12T02:01:03.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.076+0000 7fe52caac640 1 -- start start 2024-09-12T02:01:03.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.078+0000 7fe52caac640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe528162060 0x7fe5280b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.078+0000 7fe52caac640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe5280b64b0 0x7fe5280b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.078+0000 7fe52caac640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe52806d9f0 con 0x7fe528161c80 2024-09-12T02:01:03.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.078+0000 7fe52caac640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fe52806dcd0 con 0x7fe5280b64b0 2024-09-12T02:01:03.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.078+0000 7fe52caac640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe52806dfb0 con 0x7fe528162060 2024-09-12T02:01:03.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.078+0000 7fe526d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe5280b64b0 0x7fe5280b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.078+0000 7fe526d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe5280b64b0 0x7fe5280b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34486/0 (socket says 172.21.15.19:34486) 2024-09-12T02:01:03.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.078+0000 7fe526d9d640 1 -- 172.21.15.19:0/2681797960 learned_addr learned my addr 172.21.15.19:0/2681797960 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:03.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.078+0000 7fe525d9b640 1 --2- 172.21.15.19:0/2681797960 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe528162060 0x7fe5280b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.078+0000 7fe526d9d640 1 -- 172.21.15.19:0/2681797960 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe528162060 msgr2=0x7fe5280b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:03.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.078+0000 7fe526d9d640 1 --2- 172.21.15.19:0/2681797960 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe528162060 0x7fe5280b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.078+0000 7fe526d9d640 1 -- 172.21.15.19:0/2681797960 >> v1:172.21.15.135:6789/0 conn(0x7fe528161c80 legacy=0x7fe52806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:03.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.078+0000 7fe526d9d640 1 -- 172.21.15.19:0/2681797960 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5280d01f0 con 0x7fe5280b64b0 2024-09-12T02:01:03.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.079+0000 7fe526d9d640 1 --2- 172.21.15.19:0/2681797960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5280b64b0 0x7fe5280b6960 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe520009870 tx=0x7fe52002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94a8568f1d2baba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:03.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.079+0000 7fe52559a640 1 -- 172.21.15.19:0/2681797960 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe520037070 con 0x7fe5280b64b0 2024-09-12T02:01:03.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.079+0000 7fe52559a640 1 -- 172.21.15.19:0/2681797960 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe520032440 con 0x7fe5280b64b0 2024-09-12T02:01:03.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.079+0000 7fe52559a640 1 -- 172.21.15.19:0/2681797960 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe520032810 con 0x7fe5280b64b0 2024-09-12T02:01:03.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.080+0000 7fe52caac640 1 -- 172.21.15.19:0/2681797960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5280b64b0 msgr2=0x7fe5280b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:03.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.080+0000 7fe52caac640 1 --2- 172.21.15.19:0/2681797960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5280b64b0 0x7fe5280b6960 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe520009870 tx=0x7fe52002a270 comp rx=0 tx=0).stop 2024-09-12T02:01:03.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.080+0000 7fe52caac640 1 -- 172.21.15.19:0/2681797960 shutdown_connections 2024-09-12T02:01:03.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.080+0000 7fe52caac640 1 --2- 172.21.15.19:0/2681797960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5280b64b0 0x7fe5280b6960 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.080+0000 7fe52caac640 1 --2- 172.21.15.19:0/2681797960 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe528162060 0x7fe5280b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.080+0000 7fe52caac640 1 -- 172.21.15.19:0/2681797960 >> 172.21.15.19:0/2681797960 conn(0x7fe5280d44f0 msgr2=0x7fe5280d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:03.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.080+0000 7fe52caac640 1 -- 172.21.15.19:0/2681797960 shutdown_connections 2024-09-12T02:01:03.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.080+0000 7fe52caac640 1 -- 172.21.15.19:0/2681797960 wait complete. 2024-09-12T02:01:03.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.082+0000 7fe52caac640 1 Processor -- start 2024-09-12T02:01:03.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.082+0000 7fe52caac640 1 -- start start 2024-09-12T02:01:03.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.082+0000 7fe52caac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5280b64b0 0x7fe5280b93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.082+0000 7fe52caac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe528161c80 0x7fe52815ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.082+0000 7fe52caac640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe528162060 0x7fe5281604b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.082+0000 7fe52caac640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe5280cf1e0 con 0x7fe528161c80 2024-09-12T02:01:03.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.082+0000 7fe52caac640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe5280d2aa0 con 0x7fe5280b64b0 2024-09-12T02:01:03.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.082+0000 7fe52caac640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe5280cf360 con 0x7fe528162060 2024-09-12T02:01:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.083+0000 7fe525d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe528161c80 0x7fe52815ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.083+0000 7fe525d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe528161c80 0x7fe52815ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34492/0 (socket says 172.21.15.19:34492) 2024-09-12T02:01:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.083+0000 7fe525d9b640 1 -- 172.21.15.19:0/2874504736 learned_addr learned my addr 172.21.15.19:0/2874504736 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.083+0000 7fe52659c640 1 --2- 172.21.15.19:0/2874504736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5280b64b0 0x7fe5280b93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.083+0000 7fe526d9d640 1 --2- 172.21.15.19:0/2874504736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe528162060 0x7fe5281604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.083+0000 7fe525d9b640 1 -- 172.21.15.19:0/2874504736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe528162060 msgr2=0x7fe5281604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.083+0000 7fe525d9b640 1 --2- 172.21.15.19:0/2874504736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe528162060 0x7fe5281604b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.083+0000 7fe525d9b640 1 -- 172.21.15.19:0/2874504736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5280b64b0 msgr2=0x7fe5280b93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.083+0000 7fe525d9b640 1 --2- 172.21.15.19:0/2874504736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5280b64b0 0x7fe5280b93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.083+0000 7fe525d9b640 1 -- 172.21.15.19:0/2874504736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5280cb950 con 0x7fe528161c80 2024-09-12T02:01:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.083+0000 7fe52659c640 1 --2- 172.21.15.19:0/2874504736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5280b64b0 0x7fe5280b93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.083+0000 7fe525d9b640 1 --2- 172.21.15.19:0/2874504736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe528161c80 0x7fe52815ff70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00e870 tx=0x7fe51c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.083+0000 7fe516ffd640 1 -- 172.21.15.19:0/2874504736 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51c017070 con 0x7fe528161c80 2024-09-12T02:01:03.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.083+0000 7fe516ffd640 1 -- 172.21.15.19:0/2874504736 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe51c00ee60 con 0x7fe528161c80 2024-09-12T02:01:03.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.083+0000 7fe516ffd640 1 -- 172.21.15.19:0/2874504736 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51c00cb40 con 0x7fe528161c80 2024-09-12T02:01:03.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.083+0000 7fe52caac640 1 -- 172.21.15.19:0/2874504736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5280b98e0 con 0x7fe528161c80 2024-09-12T02:01:03.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.084+0000 7fe52caac640 1 -- 172.21.15.19:0/2874504736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5281f8390 con 0x7fe528161c80 2024-09-12T02:01:03.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.084+0000 7fe52caac640 1 -- 172.21.15.19:0/2874504736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5280b5f70 con 0x7fe528161c80 2024-09-12T02:01:03.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.086+0000 7fe516ffd640 1 -- 172.21.15.19:0/2874504736 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe51c01a070 con 0x7fe528161c80 2024-09-12T02:01:03.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.086+0000 7fe516ffd640 1 --2- 172.21.15.19:0/2874504736 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe50806be30 0x7fe50806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.086+0000 7fe516ffd640 1 -- 172.21.15.19:0/2874504736 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6389+0+0 (secure 0 0 0) 0x7fe51c08b1e0 con 0x7fe528161c80 2024-09-12T02:01:03.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.087+0000 7fe52659c640 1 --2- 172.21.15.19:0/2874504736 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe50806be30 0x7fe50806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.087+0000 7fe52659c640 1 --2- 172.21.15.19:0/2874504736 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe50806be30 0x7fe50806e2f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe5180012e0 tx=0x7fe518009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:03.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.095+0000 7fe516ffd640 1 -- 172.21.15.19:0/2874504736 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5280cb950 con 0x7fe528161c80 2024-09-12T02:01:03.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.284+0000 7fe52caac640 1 -- 172.21.15.19:0/2874504736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe5280ba470 con 0x7fe528161c80 2024-09-12T02:01:03.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.284+0000 7fe516ffd640 1 -- 172.21.15.19:0/2874504736 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v70) ==== 80+0+242 (secure 0 0 0) 0x7fe51c059290 con 0x7fe528161c80 2024-09-12T02:01:03.285 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6835/740310996 2024-09-13T01:59:19.698070+0000 2024-09-12T02:01:03.285 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6833/740310996 2024-09-13T01:59:19.698070+0000 2024-09-12T02:01:03.285 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6835/1551156711 2024-09-13T01:58:49.340791+0000 2024-09-12T02:01:03.285 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6833/1551156711 2024-09-13T01:58:49.340791+0000 2024-09-12T02:01:03.285 INFO:teuthology.orchestra.run.smithi019.stderr:listed 4 entries 2024-09-12T02:01:03.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.286+0000 7fe52caac640 1 -- 172.21.15.19:0/2874504736 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe50806be30 msgr2=0x7fe50806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:03.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.286+0000 7fe52caac640 1 --2- 172.21.15.19:0/2874504736 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe50806be30 0x7fe50806e2f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe5180012e0 tx=0x7fe518009040 comp rx=0 tx=0).stop 2024-09-12T02:01:03.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.286+0000 7fe52caac640 1 -- 172.21.15.19:0/2874504736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe528161c80 msgr2=0x7fe52815ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:03.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.286+0000 7fe52caac640 1 --2- 172.21.15.19:0/2874504736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe528161c80 0x7fe52815ff70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00e870 tx=0x7fe51c00ed30 comp rx=0 tx=0).stop 2024-09-12T02:01:03.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.286+0000 7fe52caac640 1 -- 172.21.15.19:0/2874504736 shutdown_connections 2024-09-12T02:01:03.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.286+0000 7fe52caac640 1 --2- 172.21.15.19:0/2874504736 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe50806be30 0x7fe50806e2f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.286+0000 7fe52caac640 1 --2- 172.21.15.19:0/2874504736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe528162060 0x7fe5281604b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.286+0000 7fe52caac640 1 --2- 172.21.15.19:0/2874504736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe528161c80 0x7fe52815ff70 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.286+0000 7fe52caac640 1 --2- 172.21.15.19:0/2874504736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5280b64b0 0x7fe5280b93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.286+0000 7fe52caac640 1 -- 172.21.15.19:0/2874504736 >> 172.21.15.19:0/2874504736 conn(0x7fe5280d44f0 msgr2=0x7fe5280d3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:03.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.286+0000 7fe52caac640 1 -- 172.21.15.19:0/2874504736 shutdown_connections 2024-09-12T02:01:03.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.286+0000 7fe52caac640 1 -- 172.21.15.19:0/2874504736 wait complete. 2024-09-12T02:01:03.298 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:01:03.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:01:03.298 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:01:03.328 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:01:03.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:01:03.328 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:01:03.384 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:01:03.385 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T02:01:03.385 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:01:03.405 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:01:03.405 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:01:03.406 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:01:03.406 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:01:03.441 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:01:03.441 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:01:03.441 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T02:01:03.441 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:01:03.464 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:01:03.464 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.583+0000 7f031e665640 1 Processor -- start 2024-09-12T02:01:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.583+0000 7f031e665640 1 -- start start 2024-09-12T02:01:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.584+0000 7f031e665640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f03180720b0 0x7f03180cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.584+0000 7f031e665640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0318162ad0 0x7f031806f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.584+0000 7f031e665640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0318072490 0x7f03180b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.584+0000 7f031e665640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f03180afa20 con 0x7f03180720b0 2024-09-12T02:01:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.584+0000 7f031e665640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f03180afce0 con 0x7f0318162ad0 2024-09-12T02:01:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.584+0000 7f031e665640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f03180b34d0 con 0x7f0318072490 2024-09-12T02:01:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.584+0000 7f0317fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f03180720b0 0x7f03180cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.584+0000 7f0317fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f03180720b0 0x7f03180cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34498/0 (socket says 172.21.15.19:34498) 2024-09-12T02:01:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.584+0000 7f0317fff640 1 -- 172.21.15.19:0/40064486 learned_addr learned my addr 172.21.15.19:0/40064486 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.584+0000 7f03177fe640 1 --2- 172.21.15.19:0/40064486 >> v2:172.21.15.135:3300/0 conn(0x7f0318162ad0 0x7f031806f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.584+0000 7f031cc02640 1 --2- 172.21.15.19:0/40064486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0318072490 0x7f03180b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.584+0000 7f0317fff640 1 -- 172.21.15.19:0/40064486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0318072490 msgr2=0x7f03180b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:03.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.584+0000 7f0317fff640 1 --2- 172.21.15.19:0/40064486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0318072490 0x7f03180b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.584+0000 7f0317fff640 1 -- 172.21.15.19:0/40064486 >> v2:172.21.15.135:3300/0 conn(0x7f0318162ad0 msgr2=0x7f031806f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:03.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.584+0000 7f0317fff640 1 --2- 172.21.15.19:0/40064486 >> v2:172.21.15.135:3300/0 conn(0x7f0318162ad0 0x7f031806f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.584+0000 7f0317fff640 1 -- 172.21.15.19:0/40064486 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03180b37b0 con 0x7f03180720b0 2024-09-12T02:01:03.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.585+0000 7f0317fff640 1 --2- 172.21.15.19:0/40064486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03180720b0 0x7f03180cfca0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0318072d20 tx=0x7f030802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf95f663be7188ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.585+0000 7f0316ffd640 1 -- 172.21.15.19:0/40064486 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308037070 con 0x7f03180720b0 2024-09-12T02:01:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.585+0000 7f0316ffd640 1 -- 172.21.15.19:0/40064486 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0308032440 con 0x7f03180720b0 2024-09-12T02:01:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.585+0000 7f0316ffd640 1 -- 172.21.15.19:0/40064486 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308032810 con 0x7f03180720b0 2024-09-12T02:01:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.586+0000 7f031e665640 1 -- 172.21.15.19:0/40064486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03180720b0 msgr2=0x7f03180cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.586+0000 7f031e665640 1 --2- 172.21.15.19:0/40064486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03180720b0 0x7f03180cfca0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0318072d20 tx=0x7f030802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.586+0000 7f031e665640 1 -- 172.21.15.19:0/40064486 shutdown_connections 2024-09-12T02:01:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.586+0000 7f031e665640 1 --2- 172.21.15.19:0/40064486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0318072490 0x7f03180b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.586+0000 7f031e665640 1 --2- 172.21.15.19:0/40064486 >> v2:172.21.15.135:3300/0 conn(0x7f0318162ad0 0x7f031806f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.586+0000 7f031e665640 1 --2- 172.21.15.19:0/40064486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03180720b0 0x7f03180cfca0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.586+0000 7f031e665640 1 -- 172.21.15.19:0/40064486 >> 172.21.15.19:0/40064486 conn(0x7f0318067d70 msgr2=0x7f031806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.586+0000 7f031e665640 1 -- 172.21.15.19:0/40064486 shutdown_connections 2024-09-12T02:01:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.586+0000 7f031e665640 1 -- 172.21.15.19:0/40064486 wait complete. 2024-09-12T02:01:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.587+0000 7f031e665640 1 Processor -- start 2024-09-12T02:01:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.587+0000 7f031e665640 1 -- start start 2024-09-12T02:01:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.588+0000 7f031e665640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03180720b0 0x7f0318147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.588+0000 7f031e665640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0318072490 0x7f03181f8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.588+0000 7f031e665640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0318162ad0 0x7f0318159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.588+0000 7f031e665640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0318072900 con 0x7f03180720b0 2024-09-12T02:01:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.588+0000 7f031e665640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f03180b3d70 con 0x7f0318072490 2024-09-12T02:01:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.588+0000 7f031e665640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f03180b47d0 con 0x7f0318162ad0 2024-09-12T02:01:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.588+0000 7f0317fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03180720b0 0x7f0318147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.588+0000 7f0317fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03180720b0 0x7f0318147670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34502/0 (socket says 172.21.15.19:34502) 2024-09-12T02:01:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.588+0000 7f0317fff640 1 -- 172.21.15.19:0/160163177 learned_addr learned my addr 172.21.15.19:0/160163177 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.588+0000 7f03177fe640 1 --2- 172.21.15.19:0/160163177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0318072490 0x7f03181f8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.588+0000 7f031cc02640 1 --2- 172.21.15.19:0/160163177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0318162ad0 0x7f0318159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.589+0000 7f0317fff640 1 -- 172.21.15.19:0/160163177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0318162ad0 msgr2=0x7f0318159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.589+0000 7f0317fff640 1 --2- 172.21.15.19:0/160163177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0318162ad0 0x7f0318159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.589+0000 7f0317fff640 1 -- 172.21.15.19:0/160163177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0318072490 msgr2=0x7f03181f8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.589+0000 7f0317fff640 1 --2- 172.21.15.19:0/160163177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0318072490 0x7f03181f8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.589+0000 7f0317fff640 1 -- 172.21.15.19:0/160163177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03181f94b0 con 0x7f03180720b0 2024-09-12T02:01:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.589+0000 7f0317fff640 1 --2- 172.21.15.19:0/160163177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03180720b0 0x7f0318147670 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0308000c00 tx=0x7f03080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.589+0000 7f0314ff9640 1 -- 172.21.15.19:0/160163177 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308041020 con 0x7f03180720b0 2024-09-12T02:01:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.589+0000 7f0314ff9640 1 -- 172.21.15.19:0/160163177 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03080306c0 con 0x7f03180720b0 2024-09-12T02:01:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.589+0000 7f031e665640 1 -- 172.21.15.19:0/160163177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03181f9c50 con 0x7f03180720b0 2024-09-12T02:01:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.589+0000 7f0314ff9640 1 -- 172.21.15.19:0/160163177 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308037040 con 0x7f03180720b0 2024-09-12T02:01:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.589+0000 7f031e665640 1 -- 172.21.15.19:0/160163177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03181fa210 con 0x7f03180720b0 2024-09-12T02:01:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.590+0000 7f031e665640 1 -- 172.21.15.19:0/160163177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f031806c140 con 0x7f03180720b0 2024-09-12T02:01:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.591+0000 7f0314ff9640 1 -- 172.21.15.19:0/160163177 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0308044020 con 0x7f03180720b0 2024-09-12T02:01:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.591+0000 7f0314ff9640 1 --2- 172.21.15.19:0/160163177 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f030406be30 0x7f030406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.591+0000 7f0314ff9640 1 -- 172.21.15.19:0/160163177 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6389+0+0 (secure 0 0 0) 0x7f03080ab7b0 con 0x7f03180720b0 2024-09-12T02:01:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.591+0000 7f03177fe640 1 --2- 172.21.15.19:0/160163177 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f030406be30 0x7f030406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.592+0000 7f03177fe640 1 --2- 172.21.15.19:0/160163177 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f030406be30 0x7f030406e2f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0318159e10 tx=0x7f030c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.596+0000 7f0314ff9640 1 -- 172.21.15.19:0/160163177 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f031806c140 con 0x7f03180720b0 2024-09-12T02:01:03.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.827+0000 7f031e665640 1 -- 172.21.15.19:0/160163177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03180b4290 con 0x7f03180720b0 2024-09-12T02:01:03.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.828+0000 7f0314ff9640 1 -- 172.21.15.19:0/160163177 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5229 (secure 0 0 0) 0x7f030804b030 con 0x7f03180720b0 2024-09-12T02:01:03.828 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:03.829 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":55,"btime":"2024-09-12T01:59:22:714201+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2176310149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2176310149},{"type":"v1","addr":"172.21.15.135:6836","nonce":2176310149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/222313950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":222313950},{"type":"v1","addr":"172.21.15.135:6837","nonce":222313950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1314663735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1314663735},{"type":"v1","addr":"172.21.15.19:6835","nonce":1314663735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:58:31.431304+0000","modified":"2024-09-12T01:59:22.714194+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":17,"addr":"172.21.15.19:6834/2113904472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2113904472},{"type":"v1","addr":"172.21.15.19:6834","nonce":2113904472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5865,"qdb_cluster":[5865]},"id":4}]} 2024-09-12T02:01:03.829 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 55 2024-09-12T02:01:03.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.830+0000 7f031e665640 1 -- 172.21.15.19:0/160163177 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f030406be30 msgr2=0x7f030406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:03.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.830+0000 7f031e665640 1 --2- 172.21.15.19:0/160163177 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f030406be30 0x7f030406e2f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0318159e10 tx=0x7f030c008040 comp rx=0 tx=0).stop 2024-09-12T02:01:03.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.830+0000 7f031e665640 1 -- 172.21.15.19:0/160163177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03180720b0 msgr2=0x7f0318147670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:03.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.830+0000 7f031e665640 1 --2- 172.21.15.19:0/160163177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03180720b0 0x7f0318147670 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0308000c00 tx=0x7f03080046c0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.830+0000 7f031e665640 1 -- 172.21.15.19:0/160163177 shutdown_connections 2024-09-12T02:01:03.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.830+0000 7f031e665640 1 --2- 172.21.15.19:0/160163177 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f030406be30 0x7f030406e2f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.830+0000 7f031e665640 1 --2- 172.21.15.19:0/160163177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0318162ad0 0x7f0318159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.830+0000 7f031e665640 1 --2- 172.21.15.19:0/160163177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0318072490 0x7f03181f8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.830+0000 7f031e665640 1 --2- 172.21.15.19:0/160163177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03180720b0 0x7f0318147670 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.830+0000 7f031e665640 1 -- 172.21.15.19:0/160163177 >> 172.21.15.19:0/160163177 conn(0x7f0318067d70 msgr2=0x7f03180ce020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:03.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.830+0000 7f031e665640 1 -- 172.21.15.19:0/160163177 shutdown_connections 2024-09-12T02:01:03.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.830+0000 7f031e665640 1 -- 172.21.15.19:0/160163177 wait complete. 2024-09-12T02:01:03.842 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:03.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.945+0000 7f939e2ba640 1 Processor -- start 2024-09-12T02:01:03.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.945+0000 7f939e2ba640 1 -- start start 2024-09-12T02:01:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.946+0000 7f939e2ba640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f939815e5b0 0x7f93980b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.946+0000 7f939e2ba640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f939815e990 0x7f93980b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.946+0000 7f939e2ba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93980ae140 0x7f93980ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.946+0000 7f939e2ba640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f93980aeb10 con 0x7f939815e990 2024-09-12T02:01:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.946+0000 7f939e2ba640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f93980b6520 con 0x7f939815e5b0 2024-09-12T02:01:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.946+0000 7f939e2ba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f93980b1a40 con 0x7f93980ae140 2024-09-12T02:01:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.946+0000 7f938ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f939815e990 0x7f93980b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.946+0000 7f938ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f939815e990 0x7f93980b2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34518/0 (socket says 172.21.15.19:34518) 2024-09-12T02:01:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.946+0000 7f938ffff640 1 -- 172.21.15.19:0/49568843 learned_addr learned my addr 172.21.15.19:0/49568843 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.947+0000 7f939c857640 1 --2- 172.21.15.19:0/49568843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93980ae140 0x7f93980ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.947+0000 7f9397fff640 1 --2- 172.21.15.19:0/49568843 >> v2:172.21.15.135:3300/0 conn(0x7f939815e5b0 0x7f93980b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.947+0000 7f938ffff640 1 -- 172.21.15.19:0/49568843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93980ae140 msgr2=0x7f93980ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:03.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.947+0000 7f938ffff640 1 --2- 172.21.15.19:0/49568843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93980ae140 0x7f93980ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.947+0000 7f938ffff640 1 -- 172.21.15.19:0/49568843 >> v2:172.21.15.135:3300/0 conn(0x7f939815e5b0 msgr2=0x7f93980b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:03.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.947+0000 7f938ffff640 1 --2- 172.21.15.19:0/49568843 >> v2:172.21.15.135:3300/0 conn(0x7f939815e5b0 0x7f93980b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.947+0000 7f938ffff640 1 -- 172.21.15.19:0/49568843 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93980b1d20 con 0x7f939815e990 2024-09-12T02:01:03.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.948+0000 7f938ffff640 1 --2- 172.21.15.19:0/49568843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f939815e990 0x7f93980b2520 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9398068830 tx=0x7f938002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f0f7175e197be2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:03.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.948+0000 7f93977fe640 1 -- 172.21.15.19:0/49568843 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9380037070 con 0x7f939815e990 2024-09-12T02:01:03.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.948+0000 7f93977fe640 1 -- 172.21.15.19:0/49568843 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9380032440 con 0x7f939815e990 2024-09-12T02:01:03.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.948+0000 7f93977fe640 1 -- 172.21.15.19:0/49568843 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9380032810 con 0x7f939815e990 2024-09-12T02:01:03.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.949+0000 7f939e2ba640 1 -- 172.21.15.19:0/49568843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f939815e990 msgr2=0x7f93980b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:03.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.949+0000 7f939e2ba640 1 --2- 172.21.15.19:0/49568843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f939815e990 0x7f93980b2520 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9398068830 tx=0x7f938002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.949+0000 7f939e2ba640 1 -- 172.21.15.19:0/49568843 shutdown_connections 2024-09-12T02:01:03.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.949+0000 7f939e2ba640 1 --2- 172.21.15.19:0/49568843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93980ae140 0x7f93980ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.949+0000 7f939e2ba640 1 --2- 172.21.15.19:0/49568843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f939815e990 0x7f93980b2520 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.949+0000 7f939e2ba640 1 --2- 172.21.15.19:0/49568843 >> v2:172.21.15.135:3300/0 conn(0x7f939815e5b0 0x7f93980b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.949+0000 7f939e2ba640 1 -- 172.21.15.19:0/49568843 >> 172.21.15.19:0/49568843 conn(0x7f9398073490 msgr2=0x7f93980b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:03.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.949+0000 7f939e2ba640 1 -- 172.21.15.19:0/49568843 shutdown_connections 2024-09-12T02:01:03.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.949+0000 7f939e2ba640 1 -- 172.21.15.19:0/49568843 wait complete. 2024-09-12T02:01:03.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.950+0000 7f939e2ba640 1 Processor -- start 2024-09-12T02:01:03.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.950+0000 7f939e2ba640 1 -- start start 2024-09-12T02:01:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.951+0000 7f939e2ba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93980ae140 0x7f939815f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.951+0000 7f939e2ba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f939815e5b0 0x7f939815a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.951+0000 7f939e2ba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939815e990 0x7f93981525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.951+0000 7f939e2ba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f93980b2a60 con 0x7f93980ae140 2024-09-12T02:01:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.951+0000 7f939e2ba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93980b0490 con 0x7f939815e5b0 2024-09-12T02:01:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.951+0000 7f939e2ba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f93980b2be0 con 0x7f939815e990 2024-09-12T02:01:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.951+0000 7f9397fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93980ae140 0x7f939815f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.951+0000 7f9397fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93980ae140 0x7f939815f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34524/0 (socket says 172.21.15.19:34524) 2024-09-12T02:01:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.951+0000 7f9397fff640 1 -- 172.21.15.19:0/15838781 learned_addr learned my addr 172.21.15.19:0/15838781 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.951+0000 7f939c857640 1 --2- 172.21.15.19:0/15838781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939815e990 0x7f93981525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.951+0000 7f938ffff640 1 --2- 172.21.15.19:0/15838781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f939815e5b0 0x7f939815a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.951+0000 7f9397fff640 1 -- 172.21.15.19:0/15838781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939815e990 msgr2=0x7f93981525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:03.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.951+0000 7f9397fff640 1 --2- 172.21.15.19:0/15838781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939815e990 0x7f93981525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.951+0000 7f9397fff640 1 -- 172.21.15.19:0/15838781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f939815e5b0 msgr2=0x7f939815a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:03.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.951+0000 7f9397fff640 1 --2- 172.21.15.19:0/15838781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f939815e5b0 0x7f939815a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:03.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.951+0000 7f9397fff640 1 -- 172.21.15.19:0/15838781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939815b140 con 0x7f93980ae140 2024-09-12T02:01:03.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.951+0000 7f938ffff640 1 --2- 172.21.15.19:0/15838781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f939815e5b0 0x7f939815a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:03.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.951+0000 7f9397fff640 1 --2- 172.21.15.19:0/15838781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93980ae140 0x7f939815f090 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f938800d830 tx=0x7f938800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:03.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.952+0000 7f93957fa640 1 -- 172.21.15.19:0/15838781 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938800b6c0 con 0x7f93980ae140 2024-09-12T02:01:03.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.952+0000 7f93957fa640 1 -- 172.21.15.19:0/15838781 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9388019070 con 0x7f93980ae140 2024-09-12T02:01:03.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.952+0000 7f93957fa640 1 -- 172.21.15.19:0/15838781 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938800ba80 con 0x7f93980ae140 2024-09-12T02:01:03.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.952+0000 7f939e2ba640 1 -- 172.21.15.19:0/15838781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f939815b420 con 0x7f93980ae140 2024-09-12T02:01:03.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.952+0000 7f939e2ba640 1 -- 172.21.15.19:0/15838781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f939815b9e0 con 0x7f93980ae140 2024-09-12T02:01:03.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.953+0000 7f939e2ba640 1 -- 172.21.15.19:0/15838781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93980b5f40 con 0x7f93980ae140 2024-09-12T02:01:03.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.953+0000 7f93957fa640 1 -- 172.21.15.19:0/15838781 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f938801e460 con 0x7f93980ae140 2024-09-12T02:01:03.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.954+0000 7f93957fa640 1 --2- 172.21.15.19:0/15838781 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f937806be30 0x7f937806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:03.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.954+0000 7f93957fa640 1 -- 172.21.15.19:0/15838781 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6389+0+0 (secure 0 0 0) 0x7f938808b720 con 0x7f93980ae140 2024-09-12T02:01:03.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.954+0000 7f938ffff640 1 --2- 172.21.15.19:0/15838781 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f937806be30 0x7f937806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:03.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.954+0000 7f938ffff640 1 --2- 172.21.15.19:0/15838781 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f937806be30 0x7f937806e2f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9380034000 tx=0x7f938002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:03.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:03.958+0000 7f93957fa640 1 -- 172.21.15.19:0/15838781 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9388059e20 con 0x7f93980ae140 2024-09-12T02:01:04.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.173+0000 7f939e2ba640 1 -- 172.21.15.19:0/15838781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93980b0e10 con 0x7f93980ae140 2024-09-12T02:01:04.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.173+0000 7f93957fa640 1 -- 172.21.15.19:0/15838781 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5229 (secure 0 0 0) 0x7f9388059720 con 0x7f93980ae140 2024-09-12T02:01:04.174 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:04.174 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":55,"btime":"2024-09-12T01:59:22:714201+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2176310149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2176310149},{"type":"v1","addr":"172.21.15.135:6836","nonce":2176310149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/222313950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":222313950},{"type":"v1","addr":"172.21.15.135:6837","nonce":222313950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1314663735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1314663735},{"type":"v1","addr":"172.21.15.19:6835","nonce":1314663735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:58:31.431304+0000","modified":"2024-09-12T01:59:22.714194+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":17,"addr":"172.21.15.19:6834/2113904472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2113904472},{"type":"v1","addr":"172.21.15.19:6834","nonce":2113904472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5865,"qdb_cluster":[5865]},"id":4}]} 2024-09-12T02:01:04.174 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 55 2024-09-12T02:01:04.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.175+0000 7f939e2ba640 1 -- 172.21.15.19:0/15838781 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f937806be30 msgr2=0x7f937806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.175+0000 7f939e2ba640 1 --2- 172.21.15.19:0/15838781 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f937806be30 0x7f937806e2f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9380034000 tx=0x7f938002e000 comp rx=0 tx=0).stop 2024-09-12T02:01:04.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.175+0000 7f939e2ba640 1 -- 172.21.15.19:0/15838781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93980ae140 msgr2=0x7f939815f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.175+0000 7f939e2ba640 1 --2- 172.21.15.19:0/15838781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93980ae140 0x7f939815f090 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f938800d830 tx=0x7f938800dcf0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.175+0000 7f939e2ba640 1 -- 172.21.15.19:0/15838781 shutdown_connections 2024-09-12T02:01:04.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.175+0000 7f939e2ba640 1 --2- 172.21.15.19:0/15838781 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f937806be30 0x7f937806e2f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.175+0000 7f939e2ba640 1 --2- 172.21.15.19:0/15838781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939815e990 0x7f93981525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.175+0000 7f939e2ba640 1 --2- 172.21.15.19:0/15838781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f939815e5b0 0x7f939815a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.175+0000 7f939e2ba640 1 --2- 172.21.15.19:0/15838781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93980ae140 0x7f939815f090 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.175+0000 7f939e2ba640 1 -- 172.21.15.19:0/15838781 >> 172.21.15.19:0/15838781 conn(0x7f9398073490 msgr2=0x7f939815ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:04.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.175+0000 7f939e2ba640 1 -- 172.21.15.19:0/15838781 shutdown_connections 2024-09-12T02:01:04.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.175+0000 7f939e2ba640 1 -- 172.21.15.19:0/15838781 wait complete. 2024-09-12T02:01:04.186 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:01:04.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.289+0000 7f14e9786640 1 Processor -- start 2024-09-12T02:01:04.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.289+0000 7f14e9786640 1 -- start start 2024-09-12T02:01:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.290+0000 7f14e9786640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f14e4165260 0x7f14e4167650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.290+0000 7f14e9786640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e40d01c0 con 0x7f14e415c870 2024-09-12T02:01:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.290+0000 7f14e9786640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e40d04a0 con 0x7f14e415c490 2024-09-12T02:01:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.290+0000 7f14e9786640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f14e40cff70 con 0x7f14e4165260 2024-09-12T02:01:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.290+0000 7f14e27fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f14e415c870 0x7f14e415cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58940/0 (socket says 172.21.15.19:58940) 2024-09-12T02:01:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.290+0000 7f14e27fc640 1 -- 172.21.15.19:0/530837481 learned_addr learned my addr 172.21.15.19:0/530837481 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.290+0000 7f14e37fe640 1 --2- 172.21.15.19:0/530837481 >> v2:172.21.15.135:3300/0 conn(0x7f14e4165260 0x7f14e4167650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.290+0000 7f14e1ffb640 1 -- 172.21.15.19:0/530837481 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1164042789 0 0) 0x7f14e40d01c0 con 0x7f14e415c870 2024-09-12T02:01:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.290+0000 7f14e1ffb640 1 -- 172.21.15.19:0/530837481 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14d0003520 con 0x7f14e415c870 2024-09-12T02:01:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e1ffb640 1 -- 172.21.15.19:0/530837481 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1730536701 0 0) 0x7f14e40d04a0 con 0x7f14e415c490 2024-09-12T02:01:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e1ffb640 1 -- 172.21.15.19:0/530837481 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14e40d01c0 con 0x7f14e415c490 2024-09-12T02:01:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e1ffb640 1 -- 172.21.15.19:0/530837481 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1449907384 0 0) 0x7f14d0003520 con 0x7f14e415c870 2024-09-12T02:01:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e1ffb640 1 -- 172.21.15.19:0/530837481 >> v2:172.21.15.135:3300/0 conn(0x7f14e4165260 msgr2=0x7f14e4167650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e1ffb640 1 --2- 172.21.15.19:0/530837481 >> v2:172.21.15.135:3300/0 conn(0x7f14e4165260 0x7f14e4167650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e1ffb640 1 -- 172.21.15.19:0/530837481 >> v1:172.21.15.135:6789/0 conn(0x7f14e415c490 legacy=0x7f14e409b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e1ffb640 1 -- 172.21.15.19:0/530837481 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e40d0780 con 0x7f14e415c870 2024-09-12T02:01:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e1ffb640 1 -- 172.21.15.19:0/530837481 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f14cc001670 con 0x7f14e415c870 2024-09-12T02:01:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e1ffb640 1 -- 172.21.15.19:0/530837481 >> v1:172.21.15.19:6789/0 conn(0x7f14e415c870 legacy=0x7f14e415cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e1ffb640 1 --2- 172.21.15.19:0/530837481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14d0003b90 0x7f14d0003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e1ffb640 1 --2- 172.21.15.19:0/530837481 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14d0004800 0x7f14d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e1ffb640 1 --2- 172.21.15.19:0/530837481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14d00051c0 0x7f14d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e1ffb640 1 -- 172.21.15.19:0/530837481 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f14e40cff70 con 0x7f14d0003b90 2024-09-12T02:01:04.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e1ffb640 1 -- 172.21.15.19:0/530837481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f14d000bfe0 con 0x7f14d00051c0 2024-09-12T02:01:04.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e1ffb640 1 -- 172.21.15.19:0/530837481 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f14d000c1e0 con 0x7f14d0004800 2024-09-12T02:01:04.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e2ffd640 1 --2- 172.21.15.19:0/530837481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14d0003b90 0x7f14d0003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e37fe640 1 --2- 172.21.15.19:0/530837481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14d00051c0 0x7f14d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e27fc640 1 --2- 172.21.15.19:0/530837481 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14d0004800 0x7f14d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e2ffd640 1 -- 172.21.15.19:0/530837481 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14d0004800 msgr2=0x7f14d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:04.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e2ffd640 1 --2- 172.21.15.19:0/530837481 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14d0004800 0x7f14d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e2ffd640 1 -- 172.21.15.19:0/530837481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14d00051c0 msgr2=0x7f14d000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:04.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e2ffd640 1 --2- 172.21.15.19:0/530837481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14d00051c0 0x7f14d000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e2ffd640 1 -- 172.21.15.19:0/530837481 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d0003520 con 0x7f14d0003b90 2024-09-12T02:01:04.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e37fe640 1 --2- 172.21.15.19:0/530837481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14d00051c0 0x7f14d000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:04.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.291+0000 7f14e37fe640 1 -- 172.21.15.19:0/530837481 reap_dead start 2024-09-12T02:01:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.292+0000 7f14e2ffd640 1 --2- 172.21.15.19:0/530837481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14d0003b90 0x7f14d0003f90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f14d4001fd0 tx=0x7f14d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e088d6656d4760a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.292+0000 7f14e1ffb640 1 -- 172.21.15.19:0/530837481 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d4001bf0 con 0x7f14d0003b90 2024-09-12T02:01:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.292+0000 7f14e1ffb640 1 -- 172.21.15.19:0/530837481 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d4003b70 con 0x7f14d0003b90 2024-09-12T02:01:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.292+0000 7f14e1ffb640 1 -- 172.21.15.19:0/530837481 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d40050d0 con 0x7f14d0003b90 2024-09-12T02:01:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.293+0000 7f14e9786640 1 -- 172.21.15.19:0/530837481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14d0003b90 msgr2=0x7f14d0003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.293+0000 7f14e9786640 1 --2- 172.21.15.19:0/530837481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14d0003b90 0x7f14d0003f90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f14d4001fd0 tx=0x7f14d0005830 comp rx=0 tx=0).stop 2024-09-12T02:01:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.293+0000 7f14e9786640 1 -- 172.21.15.19:0/530837481 shutdown_connections 2024-09-12T02:01:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.293+0000 7f14e9786640 1 --2- 172.21.15.19:0/530837481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14d0003b90 0x7f14d0003f90 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.293+0000 7f14e9786640 1 -- 172.21.15.19:0/530837481 >> 172.21.15.19:0/530837481 conn(0x7f14e40d23a0 msgr2=0x7f14e40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.293+0000 7f14e9786640 1 -- 172.21.15.19:0/530837481 shutdown_connections 2024-09-12T02:01:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.293+0000 7f14e9786640 1 -- 172.21.15.19:0/530837481 wait complete. 2024-09-12T02:01:04.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.294+0000 7f14e9786640 1 Processor -- start 2024-09-12T02:01:04.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.294+0000 7f14e9786640 1 -- start start 2024-09-12T02:01:04.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.295+0000 7f14e9786640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14d0003b90 0x7f14e415b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.295+0000 7f14e9786640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14e40c68f0 0x7f14e415afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.295+0000 7f14e9786640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14e40c9470 0x7f14e40b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.295+0000 7f14e9786640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f14e40d1260 con 0x7f14e40c68f0 2024-09-12T02:01:04.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.295+0000 7f14e9786640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f14e40d0dd0 con 0x7f14e40c9470 2024-09-12T02:01:04.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.295+0000 7f14e9786640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f14e415b4e0 con 0x7f14d0003b90 2024-09-12T02:01:04.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.295+0000 7f14e27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14e40c68f0 0x7f14e415afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.295+0000 7f14e27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14e40c68f0 0x7f14e415afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34550/0 (socket says 172.21.15.19:34550) 2024-09-12T02:01:04.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.295+0000 7f14e27fc640 1 -- 172.21.15.19:0/1186584122 learned_addr learned my addr 172.21.15.19:0/1186584122 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:04.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.295+0000 7f14e2ffd640 1 --2- 172.21.15.19:0/1186584122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14d0003b90 0x7f14e415b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.295+0000 7f14e37fe640 1 --2- 172.21.15.19:0/1186584122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14e40c9470 0x7f14e40b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.295+0000 7f14e27fc640 1 -- 172.21.15.19:0/1186584122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14d0003b90 msgr2=0x7f14e415b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.295+0000 7f14e27fc640 1 --2- 172.21.15.19:0/1186584122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14d0003b90 0x7f14e415b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.295+0000 7f14e27fc640 1 -- 172.21.15.19:0/1186584122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14e40c9470 msgr2=0x7f14e40b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.295+0000 7f14e27fc640 1 --2- 172.21.15.19:0/1186584122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14e40c9470 0x7f14e40b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.295+0000 7f14e27fc640 1 -- 172.21.15.19:0/1186584122 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e415bca0 con 0x7f14e40c68f0 2024-09-12T02:01:04.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.295+0000 7f14e37fe640 1 --2- 172.21.15.19:0/1186584122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14e40c9470 0x7f14e40b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:04.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.295+0000 7f14e27fc640 1 --2- 172.21.15.19:0/1186584122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14e40c68f0 0x7f14e415afa0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00e730 tx=0x7f14cc00eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:04.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.296+0000 7f14db7fe640 1 -- 172.21.15.19:0/1186584122 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc00c660 con 0x7f14e40c68f0 2024-09-12T02:01:04.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.296+0000 7f14db7fe640 1 -- 172.21.15.19:0/1186584122 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14cc018070 con 0x7f14e40c68f0 2024-09-12T02:01:04.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.296+0000 7f14db7fe640 1 -- 172.21.15.19:0/1186584122 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc00ca20 con 0x7f14e40c68f0 2024-09-12T02:01:04.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.296+0000 7f14e9786640 1 -- 172.21.15.19:0/1186584122 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e40b68d0 con 0x7f14e40c68f0 2024-09-12T02:01:04.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.296+0000 7f14e9786640 1 -- 172.21.15.19:0/1186584122 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e40b6e90 con 0x7f14e40c68f0 2024-09-12T02:01:04.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.297+0000 7f14e9786640 1 -- 172.21.15.19:0/1186584122 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e415cd70 con 0x7f14e40c68f0 2024-09-12T02:01:04.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.297+0000 7f14db7fe640 1 -- 172.21.15.19:0/1186584122 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f14cc00cbc0 con 0x7f14e40c68f0 2024-09-12T02:01:04.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.298+0000 7f14db7fe640 1 --2- 172.21.15.19:0/1186584122 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14c406be30 0x7f14c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.298+0000 7f14db7fe640 1 -- 172.21.15.19:0/1186584122 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6389+0+0 (secure 0 0 0) 0x7f14cc08ae10 con 0x7f14e40c68f0 2024-09-12T02:01:04.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.298+0000 7f14e2ffd640 1 --2- 172.21.15.19:0/1186584122 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14c406be30 0x7f14c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.298+0000 7f14e2ffd640 1 --2- 172.21.15.19:0/1186584122 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14c406be30 0x7f14c406e2f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f14d4032000 tx=0x7f14d402f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:04.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.302+0000 7f14db7fe640 1 -- 172.21.15.19:0/1186584122 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f14cc059510 con 0x7f14e40c68f0 2024-09-12T02:01:04.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.481+0000 7f14e9786640 1 -- 172.21.15.19:0/1186584122 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14e40d3190 con 0x7f14e40c68f0 2024-09-12T02:01:04.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.482+0000 7f14db7fe640 1 -- 172.21.15.19:0/1186584122 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+17380 (secure 0 0 0) 0x7f14cc058e10 con 0x7f14e40c68f0 2024-09-12T02:01:04.483 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:04.483 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":70,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:59:19.698116+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:58:29.092441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-12T01:58:30.437695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.e","mappings":[{"from":7,"to":2}]},{"pgid":"10.e","mappings":[{"from":4,"to":3}]},{"pgid":"10.10","mappings":[{"from":4,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6835/740310996":"2024-09-13T01:59:19.698070+0000","172.21.15.19:6833/740310996":"2024-09-13T01:59:19.698070+0000","172.21.15.19:6835/1551156711":"2024-09-13T01:58:49.340791+0000","172.21.15.19:6833/1551156711":"2024-09-13T01:58:49.340791+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:01:04.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.484+0000 7f14e9786640 1 -- 172.21.15.19:0/1186584122 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14c406be30 msgr2=0x7f14c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.484+0000 7f14e9786640 1 --2- 172.21.15.19:0/1186584122 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14c406be30 0x7f14c406e2f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f14d4032000 tx=0x7f14d402f000 comp rx=0 tx=0).stop 2024-09-12T02:01:04.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.484+0000 7f14e9786640 1 -- 172.21.15.19:0/1186584122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14e40c68f0 msgr2=0x7f14e415afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.484+0000 7f14e9786640 1 --2- 172.21.15.19:0/1186584122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14e40c68f0 0x7f14e415afa0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00e730 tx=0x7f14cc00eb30 comp rx=0 tx=0).stop 2024-09-12T02:01:04.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.484+0000 7f14e9786640 1 -- 172.21.15.19:0/1186584122 shutdown_connections 2024-09-12T02:01:04.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.484+0000 7f14e9786640 1 --2- 172.21.15.19:0/1186584122 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14c406be30 0x7f14c406e2f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.484+0000 7f14e9786640 1 --2- 172.21.15.19:0/1186584122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14e40c9470 0x7f14e40b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.484+0000 7f14e9786640 1 --2- 172.21.15.19:0/1186584122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14e40c68f0 0x7f14e415afa0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.484+0000 7f14e9786640 1 --2- 172.21.15.19:0/1186584122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14d0003b90 0x7f14e415b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.484+0000 7f14e9786640 1 -- 172.21.15.19:0/1186584122 >> 172.21.15.19:0/1186584122 conn(0x7f14e40d23a0 msgr2=0x7f14e4070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:04.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.484+0000 7f14e9786640 1 -- 172.21.15.19:0/1186584122 shutdown_connections 2024-09-12T02:01:04.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.484+0000 7f14e9786640 1 -- 172.21.15.19:0/1186584122 wait complete. 2024-09-12T02:01:04.496 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:01:04.496 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:04.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.597+0000 7f6c9284c640 1 Processor -- start 2024-09-12T02:01:04.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.597+0000 7f6c9284c640 1 -- start start 2024-09-12T02:01:04.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.598+0000 7f6c9284c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6c8c15c520 0x7f6c8c09b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.598+0000 7f6c9284c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c8c0d1090 0x7f6c8c0b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.598+0000 7f6c9284c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c8c0cec00 con 0x7f6c8c0b1620 2024-09-12T02:01:04.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.598+0000 7f6c9284c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f6c8c09bd90 con 0x7f6c8c15c520 2024-09-12T02:01:04.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.598+0000 7f6c9284c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8c0d0010 con 0x7f6c8c0d1090 2024-09-12T02:01:04.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.598+0000 7f6c8bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6c8c15c520 0x7f6c8c09b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.598+0000 7f6c8bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6c8c15c520 0x7f6c8c09b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34552/0 (socket says 172.21.15.19:34552) 2024-09-12T02:01:04.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.598+0000 7f6c8bfff640 1 -- 172.21.15.19:0/183887554 learned_addr learned my addr 172.21.15.19:0/183887554 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:04.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.599+0000 7f6c90de9640 1 --2- 172.21.15.19:0/183887554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c8c0d1090 0x7f6c8c0b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.599+0000 7f6c8bfff640 1 -- 172.21.15.19:0/183887554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c8c0d1090 msgr2=0x7f6c8c0b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:04.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.599+0000 7f6c8bfff640 1 --2- 172.21.15.19:0/183887554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c8c0d1090 0x7f6c8c0b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.599+0000 7f6c8bfff640 1 -- 172.21.15.19:0/183887554 >> v1:172.21.15.135:6789/0 conn(0x7f6c8c0b1620 legacy=0x7f6c8c0d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.599+0000 7f6c8bfff640 1 -- 172.21.15.19:0/183887554 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8c0d02f0 con 0x7f6c8c15c520 2024-09-12T02:01:04.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.599+0000 7f6c8bfff640 1 --2- 172.21.15.19:0/183887554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c8c15c520 0x7f6c8c09b720 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009870 tx=0x7f6c7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123d8f1cc60789bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:04.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.600+0000 7f6c8affd640 1 -- 172.21.15.19:0/183887554 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c037070 con 0x7f6c8c15c520 2024-09-12T02:01:04.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.600+0000 7f6c8affd640 1 -- 172.21.15.19:0/183887554 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c7c032440 con 0x7f6c8c15c520 2024-09-12T02:01:04.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.600+0000 7f6c8affd640 1 -- 172.21.15.19:0/183887554 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c032810 con 0x7f6c8c15c520 2024-09-12T02:01:04.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.600+0000 7f6c9284c640 1 -- 172.21.15.19:0/183887554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c8c15c520 msgr2=0x7f6c8c09b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.600+0000 7f6c9284c640 1 --2- 172.21.15.19:0/183887554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c8c15c520 0x7f6c8c09b720 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009870 tx=0x7f6c7c02a270 comp rx=0 tx=0).stop 2024-09-12T02:01:04.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.600+0000 7f6c9284c640 1 -- 172.21.15.19:0/183887554 shutdown_connections 2024-09-12T02:01:04.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.600+0000 7f6c9284c640 1 --2- 172.21.15.19:0/183887554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c8c0d1090 0x7f6c8c0b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.600+0000 7f6c9284c640 1 --2- 172.21.15.19:0/183887554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c8c15c520 0x7f6c8c09b720 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.600+0000 7f6c9284c640 1 -- 172.21.15.19:0/183887554 >> 172.21.15.19:0/183887554 conn(0x7f6c8c0d23a0 msgr2=0x7f6c8c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:04.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.600+0000 7f6c9284c640 1 -- 172.21.15.19:0/183887554 shutdown_connections 2024-09-12T02:01:04.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.600+0000 7f6c9284c640 1 -- 172.21.15.19:0/183887554 wait complete. 2024-09-12T02:01:04.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.601+0000 7f6c9284c640 1 Processor -- start 2024-09-12T02:01:04.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.602+0000 7f6c9284c640 1 -- start start 2024-09-12T02:01:04.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.602+0000 7f6c9284c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c8c0b1620 0x7f6c8c0b7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.602+0000 7f6c9284c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c8c0d1090 0x7f6c8c1e2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.602+0000 7f6c9284c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c8c15c520 0x7f6c8c153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.602+0000 7f6c9284c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c15c900 con 0x7f6c8c0b1620 2024-09-12T02:01:04.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.602+0000 7f6c9284c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c0d05d0 con 0x7f6c8c0d1090 2024-09-12T02:01:04.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.602+0000 7f6c9284c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8c1e2870 con 0x7f6c8c15c520 2024-09-12T02:01:04.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.602+0000 7f6c8bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c8c0b1620 0x7f6c8c0b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.602+0000 7f6c8bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c8c0b1620 0x7f6c8c0b7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34562/0 (socket says 172.21.15.19:34562) 2024-09-12T02:01:04.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.603+0000 7f6c8bfff640 1 -- 172.21.15.19:0/1572433168 learned_addr learned my addr 172.21.15.19:0/1572433168 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:04.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.603+0000 7f6c90de9640 1 --2- 172.21.15.19:0/1572433168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c8c15c520 0x7f6c8c153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.603+0000 7f6c8b7fe640 1 --2- 172.21.15.19:0/1572433168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c8c0d1090 0x7f6c8c1e2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.603+0000 7f6c8bfff640 1 -- 172.21.15.19:0/1572433168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c8c15c520 msgr2=0x7f6c8c153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.603+0000 7f6c8bfff640 1 --2- 172.21.15.19:0/1572433168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c8c15c520 0x7f6c8c153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.603+0000 7f6c8bfff640 1 -- 172.21.15.19:0/1572433168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c8c0d1090 msgr2=0x7f6c8c1e2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.603+0000 7f6c8bfff640 1 --2- 172.21.15.19:0/1572433168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c8c0d1090 0x7f6c8c1e2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.603+0000 7f6c8bfff640 1 -- 172.21.15.19:0/1572433168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8c1e2b10 con 0x7f6c8c0b1620 2024-09-12T02:01:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.603+0000 7f6c90de9640 1 --2- 172.21.15.19:0/1572433168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c8c15c520 0x7f6c8c153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.603+0000 7f6c8bfff640 1 --2- 172.21.15.19:0/1572433168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c8c0b1620 0x7f6c8c0b7440 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c000c00 tx=0x7f6c7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.603+0000 7f6c88ff9640 1 -- 172.21.15.19:0/1572433168 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c037040 con 0x7f6c8c0b1620 2024-09-12T02:01:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.603+0000 7f6c88ff9640 1 -- 172.21.15.19:0/1572433168 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c7c042070 con 0x7f6c8c0b1620 2024-09-12T02:01:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.603+0000 7f6c9284c640 1 -- 172.21.15.19:0/1572433168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c8c1e2df0 con 0x7f6c8c0b1620 2024-09-12T02:01:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.603+0000 7f6c88ff9640 1 -- 172.21.15.19:0/1572433168 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c030880 con 0x7f6c8c0b1620 2024-09-12T02:01:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.603+0000 7f6c9284c640 1 -- 172.21.15.19:0/1572433168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c8c1e33b0 con 0x7f6c8c0b1620 2024-09-12T02:01:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.604+0000 7f6c9284c640 1 -- 172.21.15.19:0/1572433168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c8c0b1d40 con 0x7f6c8c0b1620 2024-09-12T02:01:04.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.605+0000 7f6c88ff9640 1 -- 172.21.15.19:0/1572433168 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c7c030a20 con 0x7f6c8c0b1620 2024-09-12T02:01:04.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.605+0000 7f6c88ff9640 1 --2- 172.21.15.19:0/1572433168 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6c7806be30 0x7f6c7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.605+0000 7f6c88ff9640 1 -- 172.21.15.19:0/1572433168 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6389+0+0 (secure 0 0 0) 0x7f6c7c0ab9d0 con 0x7f6c8c0b1620 2024-09-12T02:01:04.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.605+0000 7f6c8b7fe640 1 --2- 172.21.15.19:0/1572433168 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6c7806be30 0x7f6c7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.606+0000 7f6c8b7fe640 1 --2- 172.21.15.19:0/1572433168 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6c7806be30 0x7f6c7806e2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c15c030 tx=0x7f6c80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:04.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.610+0000 7f6c88ff9640 1 -- 172.21.15.19:0/1572433168 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c7c07a0d0 con 0x7f6c8c0b1620 2024-09-12T02:01:04.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.820+0000 7f6c9284c640 1 -- 172.21.15.19:0/1572433168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c8c0b8320 con 0x7f6c8c0b1620 2024-09-12T02:01:04.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.821+0000 7f6c88ff9640 1 -- 172.21.15.19:0/1572433168 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5229 (secure 0 0 0) 0x7f6c7c0799d0 con 0x7f6c8c0b1620 2024-09-12T02:01:04.822 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:04.822 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":55,"btime":"2024-09-12T01:59:22:714201+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2176310149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2176310149},{"type":"v1","addr":"172.21.15.135:6836","nonce":2176310149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/222313950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":222313950},{"type":"v1","addr":"172.21.15.135:6837","nonce":222313950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1314663735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1314663735},{"type":"v1","addr":"172.21.15.19:6835","nonce":1314663735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:58:31.431304+0000","modified":"2024-09-12T01:59:22.714194+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":17,"addr":"172.21.15.19:6834/2113904472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2113904472},{"type":"v1","addr":"172.21.15.19:6834","nonce":2113904472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5865,"qdb_cluster":[5865]},"id":4}]} 2024-09-12T02:01:04.822 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 55 2024-09-12T02:01:04.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.823+0000 7f6c9284c640 1 -- 172.21.15.19:0/1572433168 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6c7806be30 msgr2=0x7f6c7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.823+0000 7f6c9284c640 1 --2- 172.21.15.19:0/1572433168 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6c7806be30 0x7f6c7806e2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c15c030 tx=0x7f6c80009040 comp rx=0 tx=0).stop 2024-09-12T02:01:04.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.823+0000 7f6c9284c640 1 -- 172.21.15.19:0/1572433168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c8c0b1620 msgr2=0x7f6c8c0b7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.823+0000 7f6c9284c640 1 --2- 172.21.15.19:0/1572433168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c8c0b1620 0x7f6c8c0b7440 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c000c00 tx=0x7f6c7c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.823+0000 7f6c9284c640 1 -- 172.21.15.19:0/1572433168 shutdown_connections 2024-09-12T02:01:04.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.823+0000 7f6c9284c640 1 --2- 172.21.15.19:0/1572433168 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6c7806be30 0x7f6c7806e2f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.823+0000 7f6c9284c640 1 --2- 172.21.15.19:0/1572433168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c8c15c520 0x7f6c8c153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.823+0000 7f6c9284c640 1 --2- 172.21.15.19:0/1572433168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c8c0d1090 0x7f6c8c1e2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.823+0000 7f6c9284c640 1 --2- 172.21.15.19:0/1572433168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c8c0b1620 0x7f6c8c0b7440 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.823+0000 7f6c9284c640 1 -- 172.21.15.19:0/1572433168 >> 172.21.15.19:0/1572433168 conn(0x7f6c8c0d23a0 msgr2=0x7f6c8c0d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:04.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.823+0000 7f6c9284c640 1 -- 172.21.15.19:0/1572433168 shutdown_connections 2024-09-12T02:01:04.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.823+0000 7f6c9284c640 1 -- 172.21.15.19:0/1572433168 wait complete. 2024-09-12T02:01:04.835 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.937+0000 7fe757d03640 1 Processor -- start 2024-09-12T02:01:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.937+0000 7fe757d03640 1 -- start start 2024-09-12T02:01:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.938+0000 7fe757d03640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe75015e5d0 0x7fe7500d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.938+0000 7fe757d03640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe75006df60 0x7fe75009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.938+0000 7fe757d03640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe75006cec0 con 0x7fe7500d1630 2024-09-12T02:01:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.938+0000 7fe757d03640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fe75006dad0 con 0x7fe75015e5d0 2024-09-12T02:01:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.938+0000 7fe757d03640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe75006d1a0 con 0x7fe75006df60 2024-09-12T02:01:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.938+0000 7fe755a9f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe75015e5d0 0x7fe7500d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.938+0000 7fe755a9f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe75015e5d0 0x7fe7500d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34572/0 (socket says 172.21.15.19:34572) 2024-09-12T02:01:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.938+0000 7fe755a9f640 1 -- 172.21.15.19:0/3217127262 learned_addr learned my addr 172.21.15.19:0/3217127262 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.938+0000 7fe7562a0640 1 --1- 172.21.15.19:0/3217127262 >> v1:172.21.15.19:6789/0 conn(0x7fe7500d1630 0x7fe750162230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58952/0 (socket says 172.21.15.19:58952) 2024-09-12T02:01:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.938+0000 7fe75529e640 1 --2- 172.21.15.19:0/3217127262 >> v2:172.21.15.135:3300/0 conn(0x7fe75006df60 0x7fe75009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.938+0000 7fe755a9f640 1 -- 172.21.15.19:0/3217127262 >> v2:172.21.15.135:3300/0 conn(0x7fe75006df60 msgr2=0x7fe75009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.938+0000 7fe755a9f640 1 --2- 172.21.15.19:0/3217127262 >> v2:172.21.15.135:3300/0 conn(0x7fe75006df60 0x7fe75009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.938+0000 7fe755a9f640 1 -- 172.21.15.19:0/3217127262 >> v1:172.21.15.19:6789/0 conn(0x7fe7500d1630 legacy=0x7fe750162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.938+0000 7fe755a9f640 1 -- 172.21.15.19:0/3217127262 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75006d480 con 0x7fe75015e5d0 2024-09-12T02:01:04.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.938+0000 7fe754a9d640 1 -- 172.21.15.19:0/3217127262 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1168390150 0 0) 0x7fe75006cec0 con 0x7fe7500d1630 2024-09-12T02:01:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.939+0000 7fe755a9f640 1 --2- 172.21.15.19:0/3217127262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe75015e5d0 0x7fe7500d10f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe7500a0490 tx=0x7fe74c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d772c9e0047f683c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.939+0000 7fe754a9d640 1 -- 172.21.15.19:0/3217127262 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c037070 con 0x7fe75015e5d0 2024-09-12T02:01:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.939+0000 7fe754a9d640 1 -- 172.21.15.19:0/3217127262 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe74c02ae50 con 0x7fe75015e5d0 2024-09-12T02:01:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.939+0000 7fe754a9d640 1 -- 172.21.15.19:0/3217127262 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c032860 con 0x7fe75015e5d0 2024-09-12T02:01:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.940+0000 7fe757d03640 1 -- 172.21.15.19:0/3217127262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe75015e5d0 msgr2=0x7fe7500d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.940+0000 7fe757d03640 1 --2- 172.21.15.19:0/3217127262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe75015e5d0 0x7fe7500d10f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe7500a0490 tx=0x7fe74c02a300 comp rx=0 tx=0).stop 2024-09-12T02:01:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.940+0000 7fe757d03640 1 -- 172.21.15.19:0/3217127262 shutdown_connections 2024-09-12T02:01:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.940+0000 7fe757d03640 1 --2- 172.21.15.19:0/3217127262 >> v2:172.21.15.135:3300/0 conn(0x7fe75006df60 0x7fe75009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.940+0000 7fe757d03640 1 --2- 172.21.15.19:0/3217127262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe75015e5d0 0x7fe7500d10f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.940+0000 7fe757d03640 1 -- 172.21.15.19:0/3217127262 >> 172.21.15.19:0/3217127262 conn(0x7fe7500d23a0 msgr2=0x7fe7500d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.940+0000 7fe757d03640 1 -- 172.21.15.19:0/3217127262 shutdown_connections 2024-09-12T02:01:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.940+0000 7fe757d03640 1 -- 172.21.15.19:0/3217127262 wait complete. 2024-09-12T02:01:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.941+0000 7fe757d03640 1 Processor -- start 2024-09-12T02:01:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.941+0000 7fe757d03640 1 -- start start 2024-09-12T02:01:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.942+0000 7fe757d03640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe75006df60 0x7fe7500c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.942+0000 7fe757d03640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7500d1630 0x7fe750156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.942+0000 7fe757d03640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe75015e5d0 0x7fe7501f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.942+0000 7fe757d03640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe75015eb30 con 0x7fe7500d1630 2024-09-12T02:01:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.942+0000 7fe757d03640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe75015e9b0 con 0x7fe75006df60 2024-09-12T02:01:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.942+0000 7fe757d03640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe75009af70 con 0x7fe75015e5d0 2024-09-12T02:01:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.942+0000 7fe75529e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7500d1630 0x7fe750156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.942+0000 7fe75529e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7500d1630 0x7fe750156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34578/0 (socket says 172.21.15.19:34578) 2024-09-12T02:01:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.942+0000 7fe75529e640 1 -- 172.21.15.19:0/2221091942 learned_addr learned my addr 172.21.15.19:0/2221091942 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.942+0000 7fe755a9f640 1 --2- 172.21.15.19:0/2221091942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe75006df60 0x7fe7500c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.942+0000 7fe7562a0640 1 --2- 172.21.15.19:0/2221091942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe75015e5d0 0x7fe7501f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.942+0000 7fe75529e640 1 -- 172.21.15.19:0/2221091942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe75015e5d0 msgr2=0x7fe7501f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.942+0000 7fe75529e640 1 --2- 172.21.15.19:0/2221091942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe75015e5d0 0x7fe7501f48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.942+0000 7fe75529e640 1 -- 172.21.15.19:0/2221091942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe75006df60 msgr2=0x7fe7500c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.942+0000 7fe75529e640 1 --2- 172.21.15.19:0/2221091942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe75006df60 0x7fe7500c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.942+0000 7fe75529e640 1 -- 172.21.15.19:0/2221091942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7500b51d0 con 0x7fe7500d1630 2024-09-12T02:01:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.943+0000 7fe75529e640 1 --2- 172.21.15.19:0/2221091942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7500d1630 0x7fe750156990 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe74000d830 tx=0x7fe74000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.943+0000 7fe7467fc640 1 -- 172.21.15.19:0/2221091942 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74000b660 con 0x7fe7500d1630 2024-09-12T02:01:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.943+0000 7fe7467fc640 1 -- 172.21.15.19:0/2221091942 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe740019070 con 0x7fe7500d1630 2024-09-12T02:01:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.943+0000 7fe757d03640 1 -- 172.21.15.19:0/2221091942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7501f5190 con 0x7fe7500d1630 2024-09-12T02:01:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.943+0000 7fe7467fc640 1 -- 172.21.15.19:0/2221091942 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74000ba20 con 0x7fe7500d1630 2024-09-12T02:01:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.943+0000 7fe757d03640 1 -- 172.21.15.19:0/2221091942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7501f5750 con 0x7fe7500d1630 2024-09-12T02:01:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.944+0000 7fe757d03640 1 -- 172.21.15.19:0/2221091942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7500cfff0 con 0x7fe7500d1630 2024-09-12T02:01:04.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.944+0000 7fe7467fc640 1 -- 172.21.15.19:0/2221091942 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe74001e460 con 0x7fe7500d1630 2024-09-12T02:01:04.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.945+0000 7fe7467fc640 1 --2- 172.21.15.19:0/2221091942 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe73406be30 0x7fe73406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:04.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.945+0000 7fe7467fc640 1 -- 172.21.15.19:0/2221091942 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6389+0+0 (secure 0 0 0) 0x7fe74008b590 con 0x7fe7500d1630 2024-09-12T02:01:04.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.945+0000 7fe755a9f640 1 --2- 172.21.15.19:0/2221091942 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe73406be30 0x7fe73406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:04.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.946+0000 7fe755a9f640 1 --2- 172.21.15.19:0/2221091942 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe73406be30 0x7fe73406e2f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe74c034000 tx=0x7fe74c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:04.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:04.949+0000 7fe7467fc640 1 -- 172.21.15.19:0/2221091942 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe7500cfff0 con 0x7fe7500d1630 2024-09-12T02:01:05.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.162+0000 7fe757d03640 1 -- 172.21.15.19:0/2221091942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe75009aa30 con 0x7fe7500d1630 2024-09-12T02:01:05.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.163+0000 7fe7467fc640 1 -- 172.21.15.19:0/2221091942 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5229 (secure 0 0 0) 0x7fe7400596d0 con 0x7fe7500d1630 2024-09-12T02:01:05.163 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:05.163 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":55,"btime":"2024-09-12T01:59:22:714201+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2176310149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2176310149},{"type":"v1","addr":"172.21.15.135:6836","nonce":2176310149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/222313950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":222313950},{"type":"v1","addr":"172.21.15.135:6837","nonce":222313950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1314663735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1314663735},{"type":"v1","addr":"172.21.15.19:6835","nonce":1314663735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:58:31.431304+0000","modified":"2024-09-12T01:59:22.714194+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":17,"addr":"172.21.15.19:6834/2113904472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2113904472},{"type":"v1","addr":"172.21.15.19:6834","nonce":2113904472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5865,"qdb_cluster":[5865]},"id":4}]} 2024-09-12T02:01:05.164 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 55 2024-09-12T02:01:05.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.165+0000 7fe757d03640 1 -- 172.21.15.19:0/2221091942 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe73406be30 msgr2=0x7fe73406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:05.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.165+0000 7fe757d03640 1 --2- 172.21.15.19:0/2221091942 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe73406be30 0x7fe73406e2f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe74c034000 tx=0x7fe74c02e000 comp rx=0 tx=0).stop 2024-09-12T02:01:05.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.165+0000 7fe757d03640 1 -- 172.21.15.19:0/2221091942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7500d1630 msgr2=0x7fe750156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:05.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.165+0000 7fe757d03640 1 --2- 172.21.15.19:0/2221091942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7500d1630 0x7fe750156990 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe74000d830 tx=0x7fe74000dcf0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.165+0000 7fe757d03640 1 -- 172.21.15.19:0/2221091942 shutdown_connections 2024-09-12T02:01:05.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.165+0000 7fe757d03640 1 --2- 172.21.15.19:0/2221091942 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe73406be30 0x7fe73406e2f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.165+0000 7fe757d03640 1 --2- 172.21.15.19:0/2221091942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe75015e5d0 0x7fe7501f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.165+0000 7fe757d03640 1 --2- 172.21.15.19:0/2221091942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7500d1630 0x7fe750156990 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.165+0000 7fe757d03640 1 --2- 172.21.15.19:0/2221091942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe75006df60 0x7fe7500c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.165+0000 7fe757d03640 1 -- 172.21.15.19:0/2221091942 >> 172.21.15.19:0/2221091942 conn(0x7fe7500d23a0 msgr2=0x7fe7500b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:05.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.165+0000 7fe757d03640 1 -- 172.21.15.19:0/2221091942 shutdown_connections 2024-09-12T02:01:05.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.165+0000 7fe757d03640 1 -- 172.21.15.19:0/2221091942 wait complete. 2024-09-12T02:01:05.176 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:01:05.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.278+0000 7f69cbaa5640 1 Processor -- start 2024-09-12T02:01:05.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.278+0000 7f69cbaa5640 1 -- start start 2024-09-12T02:01:05.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.279+0000 7f69cbaa5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f69c40d1540 0x7f69c406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:05.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.279+0000 7f69cbaa5640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69c40d1970 con 0x7f69c409b690 2024-09-12T02:01:05.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.279+0000 7f69cbaa5640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69c40d0780 con 0x7f69c415e740 2024-09-12T02:01:05.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.279+0000 7f69cbaa5640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f69c415eb20 con 0x7f69c40d1540 2024-09-12T02:01:05.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.279+0000 7f69c9040640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f69c40d1540 0x7f69c406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:05.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.279+0000 7f69c9040640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f69c40d1540 0x7f69c406dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34592/0 (socket says 172.21.15.19:34592) 2024-09-12T02:01:05.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.279+0000 7f69c9040640 1 -- 172.21.15.19:0/3084335895 learned_addr learned my addr 172.21.15.19:0/3084335895 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:05.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.279+0000 7f69ca042640 1 --1- 172.21.15.19:0/3084335895 >> v1:172.21.15.19:6789/0 conn(0x7f69c409b690 0x7f69c4070160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58956/0 (socket says 172.21.15.19:58956) 2024-09-12T02:01:05.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.279+0000 7f69c9040640 1 -- 172.21.15.19:0/3084335895 >> v1:172.21.15.135:6789/0 conn(0x7f69c415e740 legacy=0x7f69c406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:05.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.279+0000 7f69c9040640 1 -- 172.21.15.19:0/3084335895 >> v1:172.21.15.19:6789/0 conn(0x7f69c409b690 legacy=0x7f69c4070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:05.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.279+0000 7f69c9040640 1 -- 172.21.15.19:0/3084335895 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c40d0a60 con 0x7f69c40d1540 2024-09-12T02:01:05.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.280+0000 7f69c9040640 1 --2- 172.21.15.19:0/3084335895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69c40d1540 0x7f69c406dbd0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009870 tx=0x7f69b402a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49dcda895de0660 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:05.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.280+0000 7f69c883f640 1 -- 172.21.15.19:0/3084335895 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4037070 con 0x7f69c40d1540 2024-09-12T02:01:05.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.280+0000 7f69c883f640 1 -- 172.21.15.19:0/3084335895 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b4032640 con 0x7f69c40d1540 2024-09-12T02:01:05.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.280+0000 7f69c883f640 1 -- 172.21.15.19:0/3084335895 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4032a10 con 0x7f69c40d1540 2024-09-12T02:01:05.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.281+0000 7f69cbaa5640 1 -- 172.21.15.19:0/3084335895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69c40d1540 msgr2=0x7f69c406dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:05.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.281+0000 7f69cbaa5640 1 --2- 172.21.15.19:0/3084335895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69c40d1540 0x7f69c406dbd0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009870 tx=0x7f69b402a330 comp rx=0 tx=0).stop 2024-09-12T02:01:05.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.281+0000 7f69cbaa5640 1 -- 172.21.15.19:0/3084335895 shutdown_connections 2024-09-12T02:01:05.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.281+0000 7f69cbaa5640 1 --2- 172.21.15.19:0/3084335895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69c40d1540 0x7f69c406dbd0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.281+0000 7f69cbaa5640 1 -- 172.21.15.19:0/3084335895 >> 172.21.15.19:0/3084335895 conn(0x7f69c40d23a0 msgr2=0x7f69c40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:05.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.281+0000 7f69cbaa5640 1 -- 172.21.15.19:0/3084335895 shutdown_connections 2024-09-12T02:01:05.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.281+0000 7f69cbaa5640 1 -- 172.21.15.19:0/3084335895 wait complete. 2024-09-12T02:01:05.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.282+0000 7f69cbaa5640 1 Processor -- start 2024-09-12T02:01:05.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.282+0000 7f69cbaa5640 1 -- start start 2024-09-12T02:01:05.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69cbaa5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69c409b690 0x7f69c40cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:05.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69cbaa5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69c40d1540 0x7f69c40c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:05.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69cbaa5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69c415e740 0x7f69c409f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:05.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69cbaa5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f69c409baa0 con 0x7f69c409b690 2024-09-12T02:01:05.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69cbaa5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f69c40d1020 con 0x7f69c40d1540 2024-09-12T02:01:05.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69cbaa5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f69c406cd20 con 0x7f69c415e740 2024-09-12T02:01:05.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69c9841640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69c409b690 0x7f69c40cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:05.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69c9841640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69c409b690 0x7f69c40cc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34606/0 (socket says 172.21.15.19:34606) 2024-09-12T02:01:05.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69c9841640 1 -- 172.21.15.19:0/1405181444 learned_addr learned my addr 172.21.15.19:0/1405181444 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:05.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69ca042640 1 --2- 172.21.15.19:0/1405181444 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69c415e740 0x7f69c409f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:05.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69c9040640 1 --2- 172.21.15.19:0/1405181444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69c40d1540 0x7f69c40c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:05.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69c9841640 1 -- 172.21.15.19:0/1405181444 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69c415e740 msgr2=0x7f69c409f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:05.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69c9841640 1 --2- 172.21.15.19:0/1405181444 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69c415e740 0x7f69c409f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69c9841640 1 -- 172.21.15.19:0/1405181444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69c40d1540 msgr2=0x7f69c40c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:05.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69c9841640 1 --2- 172.21.15.19:0/1405181444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69c40d1540 0x7f69c40c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69c9841640 1 -- 172.21.15.19:0/1405181444 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c409fc80 con 0x7f69c409b690 2024-09-12T02:01:05.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69ca042640 1 --2- 172.21.15.19:0/1405181444 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69c415e740 0x7f69c409f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:05.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69c9040640 1 --2- 172.21.15.19:0/1405181444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69c40d1540 0x7f69c40c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:05.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.283+0000 7f69c9841640 1 --2- 172.21.15.19:0/1405181444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69c409b690 0x7f69c40cc150 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f69c000b3f0 tx=0x7f69c000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:05.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.284+0000 7f69ba7fc640 1 -- 172.21.15.19:0/1405181444 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c0015020 con 0x7f69c409b690 2024-09-12T02:01:05.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.284+0000 7f69ba7fc640 1 -- 172.21.15.19:0/1405181444 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69c0011830 con 0x7f69c409b690 2024-09-12T02:01:05.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.284+0000 7f69cbaa5640 1 -- 172.21.15.19:0/1405181444 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c409ff60 con 0x7f69c409b690 2024-09-12T02:01:05.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.284+0000 7f69ba7fc640 1 -- 172.21.15.19:0/1405181444 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c0011c20 con 0x7f69c409b690 2024-09-12T02:01:05.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.284+0000 7f69cbaa5640 1 -- 172.21.15.19:0/1405181444 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c40ca330 con 0x7f69c409b690 2024-09-12T02:01:05.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.285+0000 7f69cbaa5640 1 -- 172.21.15.19:0/1405181444 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69c406d0b0 con 0x7f69c409b690 2024-09-12T02:01:05.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.285+0000 7f69ba7fc640 1 -- 172.21.15.19:0/1405181444 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f69c0018020 con 0x7f69c409b690 2024-09-12T02:01:05.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.286+0000 7f69ba7fc640 1 --2- 172.21.15.19:0/1405181444 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f69a806be30 0x7f69a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:05.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.286+0000 7f69ba7fc640 1 -- 172.21.15.19:0/1405181444 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6389+0+0 (secure 0 0 0) 0x7f69c008ac70 con 0x7f69c409b690 2024-09-12T02:01:05.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.286+0000 7f69c9040640 1 --2- 172.21.15.19:0/1405181444 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f69a806be30 0x7f69a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:05.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.287+0000 7f69c9040640 1 --2- 172.21.15.19:0/1405181444 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f69a806be30 0x7f69a806e2f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f69b4034000 tx=0x7f69b402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:05.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.290+0000 7f69ba7fc640 1 -- 172.21.15.19:0/1405181444 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f69c001f030 con 0x7f69c409b690 2024-09-12T02:01:05.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.468+0000 7f69cbaa5640 1 -- 172.21.15.19:0/1405181444 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69c40a0130 con 0x7f69c409b690 2024-09-12T02:01:05.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.470+0000 7f69ba7fc640 1 -- 172.21.15.19:0/1405181444 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+17380 (secure 0 0 0) 0x7f69c00172c0 con 0x7f69c409b690 2024-09-12T02:01:05.470 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:05.470 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":70,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T01:59:19.698116+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:58:29.092441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-12T01:58:30.437695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.e","mappings":[{"from":7,"to":2}]},{"pgid":"10.e","mappings":[{"from":4,"to":3}]},{"pgid":"10.10","mappings":[{"from":4,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6835/740310996":"2024-09-13T01:59:19.698070+0000","172.21.15.19:6833/740310996":"2024-09-13T01:59:19.698070+0000","172.21.15.19:6835/1551156711":"2024-09-13T01:58:49.340791+0000","172.21.15.19:6833/1551156711":"2024-09-13T01:58:49.340791+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:01:05.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.472+0000 7f69cbaa5640 1 -- 172.21.15.19:0/1405181444 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f69a806be30 msgr2=0x7f69a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:05.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.472+0000 7f69cbaa5640 1 --2- 172.21.15.19:0/1405181444 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f69a806be30 0x7f69a806e2f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f69b4034000 tx=0x7f69b402e000 comp rx=0 tx=0).stop 2024-09-12T02:01:05.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.472+0000 7f69cbaa5640 1 -- 172.21.15.19:0/1405181444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69c409b690 msgr2=0x7f69c40cc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.472+0000 7f69cbaa5640 1 --2- 172.21.15.19:0/1405181444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69c409b690 0x7f69c40cc150 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f69c000b3f0 tx=0x7f69c000b8b0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.472+0000 7f69cbaa5640 1 -- 172.21.15.19:0/1405181444 shutdown_connections 2024-09-12T02:01:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.472+0000 7f69cbaa5640 1 --2- 172.21.15.19:0/1405181444 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f69a806be30 0x7f69a806e2f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.472+0000 7f69cbaa5640 1 --2- 172.21.15.19:0/1405181444 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69c415e740 0x7f69c409f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.472+0000 7f69cbaa5640 1 --2- 172.21.15.19:0/1405181444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69c40d1540 0x7f69c40c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.472+0000 7f69cbaa5640 1 --2- 172.21.15.19:0/1405181444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69c409b690 0x7f69c40cc150 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.472+0000 7f69cbaa5640 1 -- 172.21.15.19:0/1405181444 >> 172.21.15.19:0/1405181444 conn(0x7f69c40d23a0 msgr2=0x7f69c40cee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.472+0000 7f69cbaa5640 1 -- 172.21.15.19:0/1405181444 shutdown_connections 2024-09-12T02:01:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.472+0000 7f69cbaa5640 1 -- 172.21.15.19:0/1405181444 wait complete. 2024-09-12T02:01:05.483 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:01:05.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.586+0000 7f76c4b7f640 1 Processor -- start 2024-09-12T02:01:05.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.586+0000 7f76c4b7f640 1 -- start start 2024-09-12T02:01:05.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.587+0000 7f76c4b7f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f76c009b140 0x7f76c0169570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:05.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.587+0000 7f76c4b7f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76c006cec0 con 0x7f76c015e5d0 2024-09-12T02:01:05.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.587+0000 7f76c4b7f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76c006d1a0 con 0x7f76c006df60 2024-09-12T02:01:05.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.587+0000 7f76c4b7f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f76c006dad0 con 0x7f76c009b140 2024-09-12T02:01:05.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.587+0000 7f76bed9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f76c009b140 0x7f76c0169570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:05.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.587+0000 7f76be59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f76c015e5d0 0x7f76c00d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58966/0 (socket says 172.21.15.19:58966) 2024-09-12T02:01:05.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.587+0000 7f76bed9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f76c009b140 0x7f76c0169570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34612/0 (socket says 172.21.15.19:34612) 2024-09-12T02:01:05.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.587+0000 7f76be59c640 1 -- 172.21.15.19:0/3543402589 learned_addr learned my addr 172.21.15.19:0/3543402589 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:05.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.587+0000 7f76bed9d640 1 -- 172.21.15.19:0/3543402589 >> v1:172.21.15.135:6789/0 conn(0x7f76c006df60 legacy=0x7f76c009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:05.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.587+0000 7f76bed9d640 1 -- 172.21.15.19:0/3543402589 >> v1:172.21.15.19:6789/0 conn(0x7f76c015e5d0 legacy=0x7f76c00d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:05.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.588+0000 7f76bed9d640 1 -- 172.21.15.19:0/3543402589 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c006d480 con 0x7f76c009b140 2024-09-12T02:01:05.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.588+0000 7f76bd59a640 1 -- 172.21.15.19:0/3543402589 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3458950674 0 0) 0x7f76c006cec0 con 0x7f76c015e5d0 2024-09-12T02:01:05.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.588+0000 7f76bed9d640 1 --2- 172.21.15.19:0/3543402589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76c009b140 0x7f76c0169570 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009dc0 tx=0x7f76b802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76a657ef6b523a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:05.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.588+0000 7f76bd59a640 1 -- 172.21.15.19:0/3543402589 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8007740 con 0x7f76c009b140 2024-09-12T02:01:05.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.588+0000 7f76bd59a640 1 -- 172.21.15.19:0/3543402589 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b80078e0 con 0x7f76c009b140 2024-09-12T02:01:05.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.588+0000 7f76bd59a640 1 -- 172.21.15.19:0/3543402589 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8007cb0 con 0x7f76c009b140 2024-09-12T02:01:05.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.589+0000 7f76c4b7f640 1 -- 172.21.15.19:0/3543402589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76c009b140 msgr2=0x7f76c0169570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:05.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.589+0000 7f76c4b7f640 1 --2- 172.21.15.19:0/3543402589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76c009b140 0x7f76c0169570 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009dc0 tx=0x7f76b802a760 comp rx=0 tx=0).stop 2024-09-12T02:01:05.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.589+0000 7f76c4b7f640 1 -- 172.21.15.19:0/3543402589 shutdown_connections 2024-09-12T02:01:05.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.589+0000 7f76c4b7f640 1 --2- 172.21.15.19:0/3543402589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76c009b140 0x7f76c0169570 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.589+0000 7f76c4b7f640 1 -- 172.21.15.19:0/3543402589 >> 172.21.15.19:0/3543402589 conn(0x7f76c00d23a0 msgr2=0x7f76c00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:05.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.589+0000 7f76c4b7f640 1 -- 172.21.15.19:0/3543402589 shutdown_connections 2024-09-12T02:01:05.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.589+0000 7f76c4b7f640 1 -- 172.21.15.19:0/3543402589 wait complete. 2024-09-12T02:01:05.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.590+0000 7f76c4b7f640 1 Processor -- start 2024-09-12T02:01:05.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.590+0000 7f76c4b7f640 1 -- start start 2024-09-12T02:01:05.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.591+0000 7f76c4b7f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76c006df60 0x7f76c00b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:05.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.591+0000 7f76c4b7f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76c009b140 0x7f76c00c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:05.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.591+0000 7f76c4b7f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76c015e5d0 0x7f76c01f7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:05.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.591+0000 7f76c4b7f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f76c00d1980 con 0x7f76c015e5d0 2024-09-12T02:01:05.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.591+0000 7f76c4b7f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f76c00d1800 con 0x7f76c006df60 2024-09-12T02:01:05.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.591+0000 7f76c4b7f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f76c015e9b0 con 0x7f76c009b140 2024-09-12T02:01:05.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.591+0000 7f76bed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76c015e5d0 0x7f76c01f7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:05.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.591+0000 7f76bed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76c015e5d0 0x7f76c01f7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34622/0 (socket says 172.21.15.19:34622) 2024-09-12T02:01:05.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.591+0000 7f76bed9d640 1 -- 172.21.15.19:0/2946361919 learned_addr learned my addr 172.21.15.19:0/2946361919 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:05.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.591+0000 7f76be59c640 1 --2- 172.21.15.19:0/2946361919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76c006df60 0x7f76c00b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:05.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.591+0000 7f76bdd9b640 1 --2- 172.21.15.19:0/2946361919 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76c009b140 0x7f76c00c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:05.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.592+0000 7f76bed9d640 1 -- 172.21.15.19:0/2946361919 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76c009b140 msgr2=0x7f76c00c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:05.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.592+0000 7f76bed9d640 1 --2- 172.21.15.19:0/2946361919 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76c009b140 0x7f76c00c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.592+0000 7f76bed9d640 1 -- 172.21.15.19:0/2946361919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76c006df60 msgr2=0x7f76c00b7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:05.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.592+0000 7f76bed9d640 1 --2- 172.21.15.19:0/2946361919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76c006df60 0x7f76c00b7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.592+0000 7f76bed9d640 1 -- 172.21.15.19:0/2946361919 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c00b80c0 con 0x7f76c015e5d0 2024-09-12T02:01:05.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.592+0000 7f76bed9d640 1 --2- 172.21.15.19:0/2946361919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76c015e5d0 0x7f76c01f7dc0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009ee0 tx=0x7f76b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:05.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.592+0000 7f76aeffd640 1 -- 172.21.15.19:0/2946361919 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8040070 con 0x7f76c015e5d0 2024-09-12T02:01:05.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.592+0000 7f76aeffd640 1 -- 172.21.15.19:0/2946361919 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b8031bc0 con 0x7f76c015e5d0 2024-09-12T02:01:05.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.592+0000 7f76c4b7f640 1 -- 172.21.15.19:0/2946361919 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c01e4c80 con 0x7f76c015e5d0 2024-09-12T02:01:05.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.592+0000 7f76aeffd640 1 -- 172.21.15.19:0/2946361919 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8045460 con 0x7f76c015e5d0 2024-09-12T02:01:05.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.592+0000 7f76c4b7f640 1 -- 172.21.15.19:0/2946361919 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c01575b0 con 0x7f76c015e5d0 2024-09-12T02:01:05.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.593+0000 7f76c4b7f640 1 -- 172.21.15.19:0/2946361919 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c009aa30 con 0x7f76c015e5d0 2024-09-12T02:01:05.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.593+0000 7f76aeffd640 1 -- 172.21.15.19:0/2946361919 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76b8039040 con 0x7f76c015e5d0 2024-09-12T02:01:05.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.594+0000 7f76aeffd640 1 --2- 172.21.15.19:0/2946361919 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f76a006be60 0x7f76a006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:05.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.594+0000 7f76aeffd640 1 -- 172.21.15.19:0/2946361919 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6389+0+0 (secure 0 0 0) 0x7f76b80ac9d0 con 0x7f76c015e5d0 2024-09-12T02:01:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.594+0000 7f76be59c640 1 --2- 172.21.15.19:0/2946361919 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f76a006be60 0x7f76a006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.595+0000 7f76be59c640 1 --2- 172.21.15.19:0/2946361919 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f76a006be60 0x7f76a006e320 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f76b0007fd0 tx=0x7f76b0007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:05.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.599+0000 7f76aeffd640 1 -- 172.21.15.19:0/2946361919 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76b807b180 con 0x7f76c015e5d0 2024-09-12T02:01:05.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.810+0000 7f76c4b7f640 1 -- 172.21.15.19:0/2946361919 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f76c00b1380 con 0x7f76c015e5d0 2024-09-12T02:01:05.811 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:01:05.811+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:01:05.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.812+0000 7f76aeffd640 1 -- 172.21.15.19:0/2946361919 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) ==== 161+0+0 (secure 0 0 0) 0x7f76b807aa80 con 0x7f76c015e5d0 2024-09-12T02:01:05.812 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:01:05.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.815+0000 7f76c4b7f640 1 -- 172.21.15.19:0/2946361919 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f76a006be60 msgr2=0x7f76a006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:05.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.815+0000 7f76c4b7f640 1 --2- 172.21.15.19:0/2946361919 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f76a006be60 0x7f76a006e320 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f76b0007fd0 tx=0x7f76b0007de0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.815+0000 7f76c4b7f640 1 -- 172.21.15.19:0/2946361919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76c015e5d0 msgr2=0x7f76c01f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:05.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.815+0000 7f76c4b7f640 1 --2- 172.21.15.19:0/2946361919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76c015e5d0 0x7f76c01f7dc0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009ee0 tx=0x7f76b8004a40 comp rx=0 tx=0).stop 2024-09-12T02:01:05.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.815+0000 7f76c4b7f640 1 -- 172.21.15.19:0/2946361919 shutdown_connections 2024-09-12T02:01:05.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.815+0000 7f76c4b7f640 1 --2- 172.21.15.19:0/2946361919 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f76a006be60 0x7f76a006e320 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.815+0000 7f76c4b7f640 1 --2- 172.21.15.19:0/2946361919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76c015e5d0 0x7f76c01f7dc0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.815+0000 7f76c4b7f640 1 --2- 172.21.15.19:0/2946361919 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76c009b140 0x7f76c00c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.815+0000 7f76c4b7f640 1 --2- 172.21.15.19:0/2946361919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76c006df60 0x7f76c00b7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.815+0000 7f76c4b7f640 1 -- 172.21.15.19:0/2946361919 >> 172.21.15.19:0/2946361919 conn(0x7f76c00d23a0 msgr2=0x7f76c00b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:05.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.815+0000 7f76c4b7f640 1 -- 172.21.15.19:0/2946361919 shutdown_connections 2024-09-12T02:01:05.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.815+0000 7f76c4b7f640 1 -- 172.21.15.19:0/2946361919 wait complete. 2024-09-12T02:01:05.819 INFO:tasks.ceph.mds.a.smithi019.stderr: -4333> 2024-09-12T01:59:23.060+0000 7f6c37138640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:01:05.827 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:01:05.849 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-09-12T02:01:05.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.934+0000 7fcc84f86640 1 Processor -- start 2024-09-12T02:01:05.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.934+0000 7fcc84f86640 1 -- start start 2024-09-12T02:01:05.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.935+0000 7fcc84f86640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcc80161d00 0x7fcc800b5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:05.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.935+0000 7fcc84f86640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc800b62b0 0x7fcc800d2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:05.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.935+0000 7fcc84f86640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc800d4300 con 0x7fcc80161920 2024-09-12T02:01:05.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.935+0000 7fcc84f86640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fcc800b49a0 con 0x7fcc80161d00 2024-09-12T02:01:05.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.935+0000 7fcc84f86640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcc800b4c40 con 0x7fcc800b62b0 2024-09-12T02:01:05.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.935+0000 7fcc7dd9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcc80161d00 0x7fcc800b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:05.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.935+0000 7fcc7dd9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcc80161d00 0x7fcc800b5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34656/0 (socket says 172.21.15.19:34656) 2024-09-12T02:01:05.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.935+0000 7fcc7dd9b640 1 -- 172.21.15.19:0/1824645524 learned_addr learned my addr 172.21.15.19:0/1824645524 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:05.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.935+0000 7fcc7ed9d640 1 --2- 172.21.15.19:0/1824645524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc800b62b0 0x7fcc800d2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:05.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.935+0000 7fcc7dd9b640 1 -- 172.21.15.19:0/1824645524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc800b62b0 msgr2=0x7fcc800d2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:05.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.935+0000 7fcc7dd9b640 1 --2- 172.21.15.19:0/1824645524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc800b62b0 0x7fcc800d2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.935+0000 7fcc7dd9b640 1 -- 172.21.15.19:0/1824645524 >> v1:172.21.15.135:6789/0 conn(0x7fcc80161920 legacy=0x7fcc800b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:05.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.935+0000 7fcc7dd9b640 1 -- 172.21.15.19:0/1824645524 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc800d4db0 con 0x7fcc80161d00 2024-09-12T02:01:05.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.936+0000 7fcc7dd9b640 1 --2- 172.21.15.19:0/1824645524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc80161d00 0x7fcc800b5090 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fcc8008d9a0 tx=0x7fcc7402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f9e9ca04e3b487 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:05.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.936+0000 7fcc7d59a640 1 -- 172.21.15.19:0/1824645524 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74037070 con 0x7fcc80161d00 2024-09-12T02:01:05.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.936+0000 7fcc7d59a640 1 -- 172.21.15.19:0/1824645524 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc7402adc0 con 0x7fcc80161d00 2024-09-12T02:01:05.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.936+0000 7fcc7d59a640 1 -- 172.21.15.19:0/1824645524 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74032660 con 0x7fcc80161d00 2024-09-12T02:01:05.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.937+0000 7fcc84f86640 1 -- 172.21.15.19:0/1824645524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc80161d00 msgr2=0x7fcc800b5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:05.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.937+0000 7fcc84f86640 1 --2- 172.21.15.19:0/1824645524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc80161d00 0x7fcc800b5090 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fcc8008d9a0 tx=0x7fcc7402a0b0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.937+0000 7fcc84f86640 1 -- 172.21.15.19:0/1824645524 shutdown_connections 2024-09-12T02:01:05.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.937+0000 7fcc84f86640 1 --2- 172.21.15.19:0/1824645524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc800b62b0 0x7fcc800d2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.937+0000 7fcc84f86640 1 --2- 172.21.15.19:0/1824645524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc80161d00 0x7fcc800b5090 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.937+0000 7fcc84f86640 1 -- 172.21.15.19:0/1824645524 >> 172.21.15.19:0/1824645524 conn(0x7fcc8008bfc0 msgr2=0x7fcc800d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:05.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.937+0000 7fcc84f86640 1 -- 172.21.15.19:0/1824645524 shutdown_connections 2024-09-12T02:01:05.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.937+0000 7fcc84f86640 1 -- 172.21.15.19:0/1824645524 wait complete. 2024-09-12T02:01:05.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.938+0000 7fcc84f86640 1 Processor -- start 2024-09-12T02:01:05.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.938+0000 7fcc84f86640 1 -- start start 2024-09-12T02:01:05.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.939+0000 7fcc84f86640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc800b62b0 0x7fcc800b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:05.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.939+0000 7fcc84f86640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc80161920 0x7fcc8015b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:05.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.939+0000 7fcc84f86640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc80161d00 0x7fcc8015bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:05.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.939+0000 7fcc84f86640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcc800d2b40 con 0x7fcc80161d00 2024-09-12T02:01:05.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.939+0000 7fcc84f86640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcc800b68d0 con 0x7fcc80161920 2024-09-12T02:01:05.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.939+0000 7fcc84f86640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcc800d2cc0 con 0x7fcc800b62b0 2024-09-12T02:01:05.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.939+0000 7fcc7ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc80161d00 0x7fcc8015bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:05.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.939+0000 7fcc7ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc80161d00 0x7fcc8015bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34668/0 (socket says 172.21.15.19:34668) 2024-09-12T02:01:05.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.939+0000 7fcc7ed9d640 1 -- 172.21.15.19:0/2409030495 learned_addr learned my addr 172.21.15.19:0/2409030495 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:05.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.939+0000 7fcc7dd9b640 1 --2- 172.21.15.19:0/2409030495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc80161920 0x7fcc8015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:05.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.939+0000 7fcc7e59c640 1 --2- 172.21.15.19:0/2409030495 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc800b62b0 0x7fcc800b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:05.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.939+0000 7fcc7ed9d640 1 -- 172.21.15.19:0/2409030495 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc800b62b0 msgr2=0x7fcc800b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:05.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.939+0000 7fcc7ed9d640 1 --2- 172.21.15.19:0/2409030495 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc800b62b0 0x7fcc800b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.939+0000 7fcc7ed9d640 1 -- 172.21.15.19:0/2409030495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc80161920 msgr2=0x7fcc8015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:05.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.939+0000 7fcc7ed9d640 1 --2- 172.21.15.19:0/2409030495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc80161920 0x7fcc8015b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:05.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.939+0000 7fcc7ed9d640 1 -- 172.21.15.19:0/2409030495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc8014a660 con 0x7fcc80161d00 2024-09-12T02:01:05.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.940+0000 7fcc7ed9d640 1 --2- 172.21.15.19:0/2409030495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc80161d00 0x7fcc8015bcd0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fcc78007e40 tx=0x7fcc7800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:05.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.940+0000 7fcc6effd640 1 -- 172.21.15.19:0/2409030495 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc78014620 con 0x7fcc80161d00 2024-09-12T02:01:05.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.940+0000 7fcc6effd640 1 -- 172.21.15.19:0/2409030495 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc78019070 con 0x7fcc80161d00 2024-09-12T02:01:05.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.940+0000 7fcc84f86640 1 -- 172.21.15.19:0/2409030495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc8015d9a0 con 0x7fcc80161d00 2024-09-12T02:01:05.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.940+0000 7fcc6effd640 1 -- 172.21.15.19:0/2409030495 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc78014a20 con 0x7fcc80161d00 2024-09-12T02:01:05.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.940+0000 7fcc84f86640 1 -- 172.21.15.19:0/2409030495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc8015d5c0 con 0x7fcc80161d00 2024-09-12T02:01:05.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.941+0000 7fcc84f86640 1 -- 172.21.15.19:0/2409030495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc800d2600 con 0x7fcc80161d00 2024-09-12T02:01:05.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.941+0000 7fcc6effd640 1 -- 172.21.15.19:0/2409030495 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc78014bc0 con 0x7fcc80161d00 2024-09-12T02:01:05.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.942+0000 7fcc6effd640 1 --2- 172.21.15.19:0/2409030495 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcc6006be60 0x7fcc6006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:05.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.942+0000 7fcc6effd640 1 -- 172.21.15.19:0/2409030495 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6475+0+0 (secure 0 0 0) 0x7fcc7808b850 con 0x7fcc80161d00 2024-09-12T02:01:05.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.942+0000 7fcc7e59c640 1 --2- 172.21.15.19:0/2409030495 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcc6006be60 0x7fcc6006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:05.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.942+0000 7fcc7e59c640 1 --2- 172.21.15.19:0/2409030495 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcc6006be60 0x7fcc6006e320 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcc70004f60 tx=0x7fcc70007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:05.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:05.946+0000 7fcc6effd640 1 -- 172.21.15.19:0/2409030495 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcc78059940 con 0x7fcc80161d00 2024-09-12T02:01:06.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.160+0000 7fcc84f86640 1 -- 172.21.15.19:0/2409030495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcc800b6c20 con 0x7fcc80161d00 2024-09-12T02:01:06.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.814+0000 7fcc6effd640 1 -- 172.21.15.19:0/2409030495 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v57) ==== 104+0+0 (secure 0 0 0) 0x7fcc7805dc40 con 0x7fcc80161d00 2024-09-12T02:01:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.816+0000 7fcc84f86640 1 -- 172.21.15.19:0/2409030495 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcc6006be60 msgr2=0x7fcc6006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.816+0000 7fcc84f86640 1 --2- 172.21.15.19:0/2409030495 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcc6006be60 0x7fcc6006e320 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcc70004f60 tx=0x7fcc70007e30 comp rx=0 tx=0).stop 2024-09-12T02:01:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.816+0000 7fcc84f86640 1 -- 172.21.15.19:0/2409030495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc80161d00 msgr2=0x7fcc8015bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.816+0000 7fcc84f86640 1 --2- 172.21.15.19:0/2409030495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc80161d00 0x7fcc8015bcd0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fcc78007e40 tx=0x7fcc7800e4b0 comp rx=0 tx=0).stop 2024-09-12T02:01:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.816+0000 7fcc84f86640 1 -- 172.21.15.19:0/2409030495 shutdown_connections 2024-09-12T02:01:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.816+0000 7fcc84f86640 1 --2- 172.21.15.19:0/2409030495 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcc6006be60 0x7fcc6006e320 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.816+0000 7fcc84f86640 1 --2- 172.21.15.19:0/2409030495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc80161d00 0x7fcc8015bcd0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.816+0000 7fcc84f86640 1 --2- 172.21.15.19:0/2409030495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc80161920 0x7fcc8015b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.816+0000 7fcc84f86640 1 --2- 172.21.15.19:0/2409030495 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc800b62b0 0x7fcc800b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.816+0000 7fcc84f86640 1 -- 172.21.15.19:0/2409030495 >> 172.21.15.19:0/2409030495 conn(0x7fcc8008bfc0 msgr2=0x7fcc800b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.817+0000 7fcc84f86640 1 -- 172.21.15.19:0/2409030495 shutdown_connections 2024-09-12T02:01:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.817+0000 7fcc84f86640 1 -- 172.21.15.19:0/2409030495 wait complete. 2024-09-12T02:01:06.831 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:01:06.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.986+0000 7f2543dd6640 1 Processor -- start 2024-09-12T02:01:06.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.986+0000 7f2543dd6640 1 -- start start 2024-09-12T02:01:06.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.987+0000 7f2543dd6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f253c0d15f0 0x7f253c0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:06.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.987+0000 7f2543dd6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f253c0cf160 0x7f253c06d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:06.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.987+0000 7f2543dd6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253c0cf980 con 0x7f253c161a20 2024-09-12T02:01:06.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.987+0000 7f2543dd6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f253c161e00 con 0x7f253c0d15f0 2024-09-12T02:01:06.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.987+0000 7f2543dd6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f253c06d050 con 0x7f253c0cf160 2024-09-12T02:01:06.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.987+0000 7f2541371640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f253c0d15f0 0x7f253c0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:06.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.987+0000 7f2541b72640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f253c161a20 0x7f253c0d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58978/0 (socket says 172.21.15.19:58978) 2024-09-12T02:01:06.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.987+0000 7f2541b72640 1 -- 172.21.15.19:0/1998047501 learned_addr learned my addr 172.21.15.19:0/1998047501 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:06.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.987+0000 7f2541371640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f253c0d15f0 0x7f253c0cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34670/0 (socket says 172.21.15.19:34670) 2024-09-12T02:01:06.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.987+0000 7f2542373640 1 --2- 172.21.15.19:0/1998047501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f253c0cf160 0x7f253c06d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:06.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.987+0000 7f2541371640 1 -- 172.21.15.19:0/1998047501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f253c0cf160 msgr2=0x7f253c06d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:06.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.987+0000 7f2541371640 1 --2- 172.21.15.19:0/1998047501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f253c0cf160 0x7f253c06d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:06.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.987+0000 7f2541371640 1 -- 172.21.15.19:0/1998047501 >> v1:172.21.15.19:6789/0 conn(0x7f253c161a20 legacy=0x7f253c0d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:06.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.987+0000 7f2540b70640 1 -- 172.21.15.19:0/1998047501 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 381127061 0 0) 0x7f253c0cf980 con 0x7f253c161a20 2024-09-12T02:01:06.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.987+0000 7f2541371640 1 -- 172.21.15.19:0/1998047501 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c0cfc20 con 0x7f253c0d15f0 2024-09-12T02:01:06.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.988+0000 7f2541371640 1 --2- 172.21.15.19:0/1998047501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c0d15f0 0x7f253c0cec20 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f252c0097a0 tx=0x7f252c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ce43f2b2650f83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:06.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.988+0000 7f2540b70640 1 -- 172.21.15.19:0/1998047501 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c037070 con 0x7f253c0d15f0 2024-09-12T02:01:06.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.988+0000 7f2540b70640 1 -- 172.21.15.19:0/1998047501 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f252c032440 con 0x7f253c0d15f0 2024-09-12T02:01:06.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.988+0000 7f2540b70640 1 -- 172.21.15.19:0/1998047501 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c032810 con 0x7f253c0d15f0 2024-09-12T02:01:06.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.989+0000 7f2543dd6640 1 -- 172.21.15.19:0/1998047501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c0d15f0 msgr2=0x7f253c0cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:06.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.989+0000 7f2543dd6640 1 --2- 172.21.15.19:0/1998047501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c0d15f0 0x7f253c0cec20 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f252c0097a0 tx=0x7f252c02a180 comp rx=0 tx=0).stop 2024-09-12T02:01:06.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.989+0000 7f2543dd6640 1 -- 172.21.15.19:0/1998047501 shutdown_connections 2024-09-12T02:01:06.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.989+0000 7f2543dd6640 1 --2- 172.21.15.19:0/1998047501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f253c0cf160 0x7f253c06d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:06.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.989+0000 7f2543dd6640 1 --2- 172.21.15.19:0/1998047501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c0d15f0 0x7f253c0cec20 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:06.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.989+0000 7f2543dd6640 1 -- 172.21.15.19:0/1998047501 >> 172.21.15.19:0/1998047501 conn(0x7f253c09d850 msgr2=0x7f253c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:06.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.989+0000 7f2543dd6640 1 -- 172.21.15.19:0/1998047501 shutdown_connections 2024-09-12T02:01:06.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.989+0000 7f2543dd6640 1 -- 172.21.15.19:0/1998047501 wait complete. 2024-09-12T02:01:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.990+0000 7f2543dd6640 1 Processor -- start 2024-09-12T02:01:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.990+0000 7f2543dd6640 1 -- start start 2024-09-12T02:01:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.991+0000 7f2543dd6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f253c0cf160 0x7f253c0c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.991+0000 7f2543dd6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f253c0d15f0 0x7f253c15f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.991+0000 7f2543dd6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c161a20 0x7f253c1522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.991+0000 7f2543dd6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f253c0b1040 con 0x7f253c161a20 2024-09-12T02:01:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.991+0000 7f2543dd6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f253c06d2f0 con 0x7f253c0cf160 2024-09-12T02:01:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.991+0000 7f2543dd6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f253c0cf590 con 0x7f253c0d15f0 2024-09-12T02:01:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.991+0000 7f2542373640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c161a20 0x7f253c1522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.991+0000 7f2542373640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c161a20 0x7f253c1522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34672/0 (socket says 172.21.15.19:34672) 2024-09-12T02:01:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.991+0000 7f2542373640 1 -- 172.21.15.19:0/3049439977 learned_addr learned my addr 172.21.15.19:0/3049439977 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.991+0000 7f2541b72640 1 --2- 172.21.15.19:0/3049439977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f253c0cf160 0x7f253c0c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.991+0000 7f2541371640 1 --2- 172.21.15.19:0/3049439977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f253c0d15f0 0x7f253c15f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:06.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.991+0000 7f2542373640 1 -- 172.21.15.19:0/3049439977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f253c0d15f0 msgr2=0x7f253c15f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:06.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.991+0000 7f2542373640 1 --2- 172.21.15.19:0/3049439977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f253c0d15f0 0x7f253c15f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:06.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.991+0000 7f2542373640 1 -- 172.21.15.19:0/3049439977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f253c0cf160 msgr2=0x7f253c0c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:06.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.991+0000 7f2542373640 1 --2- 172.21.15.19:0/3049439977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f253c0cf160 0x7f253c0c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:06.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.991+0000 7f2542373640 1 -- 172.21.15.19:0/3049439977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c152d50 con 0x7f253c161a20 2024-09-12T02:01:06.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.991+0000 7f2541371640 1 --2- 172.21.15.19:0/3049439977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f253c0d15f0 0x7f253c15f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:06.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.992+0000 7f2542373640 1 --2- 172.21.15.19:0/3049439977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c161a20 0x7f253c1522d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2534007e40 tx=0x7f253400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:06.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.992+0000 7f25327fc640 1 -- 172.21.15.19:0/3049439977 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534014620 con 0x7f253c161a20 2024-09-12T02:01:06.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.992+0000 7f25327fc640 1 -- 172.21.15.19:0/3049439977 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2534019070 con 0x7f253c161a20 2024-09-12T02:01:06.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.992+0000 7f2543dd6640 1 -- 172.21.15.19:0/3049439977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f253c152810 con 0x7f253c161a20 2024-09-12T02:01:06.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.992+0000 7f25327fc640 1 -- 172.21.15.19:0/3049439977 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534014a20 con 0x7f253c161a20 2024-09-12T02:01:06.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.992+0000 7f2543dd6640 1 -- 172.21.15.19:0/3049439977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f253c1f4cf0 con 0x7f253c161a20 2024-09-12T02:01:06.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.993+0000 7f2543dd6640 1 -- 172.21.15.19:0/3049439977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f253c0cec20 con 0x7f253c161a20 2024-09-12T02:01:06.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.993+0000 7f25327fc640 1 -- 172.21.15.19:0/3049439977 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2534014bc0 con 0x7f253c161a20 2024-09-12T02:01:06.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.994+0000 7f25327fc640 1 --2- 172.21.15.19:0/3049439977 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f252006be60 0x7f252006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:06.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.994+0000 7f25327fc640 1 -- 172.21.15.19:0/3049439977 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6475+0+0 (secure 0 0 0) 0x7f253408ba60 con 0x7f253c161a20 2024-09-12T02:01:06.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.994+0000 7f2541b72640 1 --2- 172.21.15.19:0/3049439977 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f252006be60 0x7f252006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:06.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.995+0000 7f2541b72640 1 --2- 172.21.15.19:0/3049439977 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f252006be60 0x7f252006e320 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2538000f60 tx=0x7f2538009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:06.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:06.998+0000 7f25327fc640 1 -- 172.21.15.19:0/3049439977 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f253405a100 con 0x7f253c161a20 2024-09-12T02:01:07.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:07.174+0000 7f2543dd6640 1 -- 172.21.15.19:0/3049439977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f253c075770 con 0x7f253c161a20 2024-09-12T02:01:07.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:07.895+0000 7f25327fc640 1 -- 172.21.15.19:0/3049439977 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v72) ==== 181+0+0 (secure 0 0 0) 0x7f2534059a00 con 0x7f253c161a20 2024-09-12T02:01:07.895 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:01:07.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:07.898+0000 7f2543dd6640 1 -- 172.21.15.19:0/3049439977 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f252006be60 msgr2=0x7f252006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:07.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:07.898+0000 7f2543dd6640 1 --2- 172.21.15.19:0/3049439977 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f252006be60 0x7f252006e320 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2538000f60 tx=0x7f2538009040 comp rx=0 tx=0).stop 2024-09-12T02:01:07.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:07.898+0000 7f2543dd6640 1 -- 172.21.15.19:0/3049439977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c161a20 msgr2=0x7f253c1522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:07.898+0000 7f2543dd6640 1 --2- 172.21.15.19:0/3049439977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c161a20 0x7f253c1522d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2534007e40 tx=0x7f253400e4b0 comp rx=0 tx=0).stop 2024-09-12T02:01:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:07.899+0000 7f2543dd6640 1 -- 172.21.15.19:0/3049439977 shutdown_connections 2024-09-12T02:01:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:07.899+0000 7f2543dd6640 1 --2- 172.21.15.19:0/3049439977 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f252006be60 0x7f252006e320 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:07.899+0000 7f2543dd6640 1 --2- 172.21.15.19:0/3049439977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c161a20 0x7f253c1522d0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:07.899+0000 7f2543dd6640 1 --2- 172.21.15.19:0/3049439977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f253c0d15f0 0x7f253c15f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:07.899+0000 7f2543dd6640 1 --2- 172.21.15.19:0/3049439977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f253c0cf160 0x7f253c0c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:07.899+0000 7f2543dd6640 1 -- 172.21.15.19:0/3049439977 >> 172.21.15.19:0/3049439977 conn(0x7f253c09d850 msgr2=0x7f253c0746d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:07.899+0000 7f2543dd6640 1 -- 172.21.15.19:0/3049439977 shutdown_connections 2024-09-12T02:01:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:07.899+0000 7f2543dd6640 1 -- 172.21.15.19:0/3049439977 wait complete. 2024-09-12T02:01:07.915 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:01:08.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.027+0000 7f02f0523640 1 Processor -- start 2024-09-12T02:01:08.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.027+0000 7f02f0523640 1 -- start start 2024-09-12T02:01:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.028+0000 7f02f0523640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f02e80b4270 0x7f02e8166110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.028+0000 7f02f0523640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e80cec90 con 0x7f02e8072760 2024-09-12T02:01:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.028+0000 7f02f0523640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e80cef70 con 0x7f02e815b410 2024-09-12T02:01:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.028+0000 7f02f0523640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f02e80cf250 con 0x7f02e80b4270 2024-09-12T02:01:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.028+0000 7f02edabe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f02e8072760 0x7f02e80cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58988/0 (socket says 172.21.15.19:58988) 2024-09-12T02:01:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.028+0000 7f02edabe640 1 -- 172.21.15.19:0/4053659933 learned_addr learned my addr 172.21.15.19:0/4053659933 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.028+0000 7f02eeac0640 1 --2- 172.21.15.19:0/4053659933 >> v2:172.21.15.135:3300/0 conn(0x7f02e80b4270 0x7f02e8166110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.028+0000 7f02ed2bd640 1 -- 172.21.15.19:0/4053659933 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4194267306 0 0) 0x7f02e80cec90 con 0x7f02e8072760 2024-09-12T02:01:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.028+0000 7f02ed2bd640 1 -- 172.21.15.19:0/4053659933 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02d4003520 con 0x7f02e8072760 2024-09-12T02:01:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02ed2bd640 1 -- 172.21.15.19:0/4053659933 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1865996472 0 0) 0x7f02e80cef70 con 0x7f02e815b410 2024-09-12T02:01:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02ed2bd640 1 -- 172.21.15.19:0/4053659933 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02e80cec90 con 0x7f02e815b410 2024-09-12T02:01:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02ed2bd640 1 -- 172.21.15.19:0/4053659933 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3953718972 0 0) 0x7f02d4003520 con 0x7f02e8072760 2024-09-12T02:01:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02ed2bd640 1 -- 172.21.15.19:0/4053659933 >> v2:172.21.15.135:3300/0 conn(0x7f02e80b4270 msgr2=0x7f02e8166110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02ed2bd640 1 --2- 172.21.15.19:0/4053659933 >> v2:172.21.15.135:3300/0 conn(0x7f02e80b4270 0x7f02e8166110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02ed2bd640 1 -- 172.21.15.19:0/4053659933 >> v1:172.21.15.135:6789/0 conn(0x7f02e815b410 legacy=0x7f02e8072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02ed2bd640 1 -- 172.21.15.19:0/4053659933 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e80cf530 con 0x7f02e8072760 2024-09-12T02:01:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02ed2bd640 1 -- 172.21.15.19:0/4053659933 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f02e40015f0 con 0x7f02e8072760 2024-09-12T02:01:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02ed2bd640 1 -- 172.21.15.19:0/4053659933 >> v1:172.21.15.19:6789/0 conn(0x7f02e8072760 legacy=0x7f02e80cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02ed2bd640 1 --2- 172.21.15.19:0/4053659933 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02d4003b90 0x7f02d4003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02ed2bd640 1 --2- 172.21.15.19:0/4053659933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02d4004800 0x7f02d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02ed2bd640 1 --2- 172.21.15.19:0/4053659933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02d4005210 0x7f02d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02ed2bd640 1 -- 172.21.15.19:0/4053659933 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f02e80cf250 con 0x7f02d4005210 2024-09-12T02:01:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02ed2bd640 1 -- 172.21.15.19:0/4053659933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f02d400c160 con 0x7f02d4004800 2024-09-12T02:01:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02ed2bd640 1 -- 172.21.15.19:0/4053659933 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f02d400c360 con 0x7f02d4003b90 2024-09-12T02:01:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02eeac0640 1 --2- 172.21.15.19:0/4053659933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02d4005210 0x7f02d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02edabe640 1 --2- 172.21.15.19:0/4053659933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02d4004800 0x7f02d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02ee2bf640 1 --2- 172.21.15.19:0/4053659933 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02d4003b90 0x7f02d4003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02eeac0640 1 -- 172.21.15.19:0/4053659933 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02d4003b90 msgr2=0x7f02d4003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02eeac0640 1 --2- 172.21.15.19:0/4053659933 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02d4003b90 0x7f02d4003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02eeac0640 1 -- 172.21.15.19:0/4053659933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02d4004800 msgr2=0x7f02d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02eeac0640 1 --2- 172.21.15.19:0/4053659933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02d4004800 0x7f02d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.029+0000 7f02eeac0640 1 -- 172.21.15.19:0/4053659933 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d4003520 con 0x7f02d4005210 2024-09-12T02:01:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.030+0000 7f02eeac0640 1 -- 172.21.15.19:0/4053659933 reap_dead start 2024-09-12T02:01:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.030+0000 7f02eeac0640 1 --2- 172.21.15.19:0/4053659933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02d4005210 0x7f02d400b9c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009f90 tx=0x7f02d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6c7f5f3a8d2f97 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.030+0000 7f02ed2bd640 1 -- 172.21.15.19:0/4053659933 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e0035020 con 0x7f02d4005210 2024-09-12T02:01:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.030+0000 7f02ed2bd640 1 -- 172.21.15.19:0/4053659933 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e0003b90 con 0x7f02d4005210 2024-09-12T02:01:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.030+0000 7f02ed2bd640 1 -- 172.21.15.19:0/4053659933 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e0009c10 con 0x7f02d4005210 2024-09-12T02:01:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.031+0000 7f02f0523640 1 -- 172.21.15.19:0/4053659933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02d4005210 msgr2=0x7f02d400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.031+0000 7f02f0523640 1 --2- 172.21.15.19:0/4053659933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02d4005210 0x7f02d400b9c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009f90 tx=0x7f02d4005830 comp rx=0 tx=0).stop 2024-09-12T02:01:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.031+0000 7f02f0523640 1 -- 172.21.15.19:0/4053659933 shutdown_connections 2024-09-12T02:01:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.031+0000 7f02f0523640 1 --2- 172.21.15.19:0/4053659933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02d4005210 0x7f02d400b9c0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.031+0000 7f02f0523640 1 -- 172.21.15.19:0/4053659933 >> 172.21.15.19:0/4053659933 conn(0x7f02e806bdf0 msgr2=0x7f02e806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.031+0000 7f02f0523640 1 -- 172.21.15.19:0/4053659933 shutdown_connections 2024-09-12T02:01:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.031+0000 7f02f0523640 1 -- 172.21.15.19:0/4053659933 wait complete. 2024-09-12T02:01:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.032+0000 7f02f0523640 1 Processor -- start 2024-09-12T02:01:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.032+0000 7f02f0523640 1 -- start start 2024-09-12T02:01:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.033+0000 7f02f0523640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02d4005210 0x7f02e8158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.033+0000 7f02f0523640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02e81488c0 0x7f02e81f6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.033+0000 7f02f0523640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02e8156850 0x7f02e815e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.033+0000 7f02f0523640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f02e815b970 con 0x7f02e8156850 2024-09-12T02:01:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.033+0000 7f02f0523640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f02e815b7f0 con 0x7f02e81488c0 2024-09-12T02:01:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.033+0000 7f02f0523640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f02e815baf0 con 0x7f02d4005210 2024-09-12T02:01:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.033+0000 7f02eeac0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02e8156850 0x7f02e815e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:08.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.033+0000 7f02eeac0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02e8156850 0x7f02e815e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34684/0 (socket says 172.21.15.19:34684) 2024-09-12T02:01:08.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.033+0000 7f02eeac0640 1 -- 172.21.15.19:0/1677906365 learned_addr learned my addr 172.21.15.19:0/1677906365 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:08.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.033+0000 7f02edabe640 1 --2- 172.21.15.19:0/1677906365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02e81488c0 0x7f02e81f6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:08.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.033+0000 7f02ee2bf640 1 --2- 172.21.15.19:0/1677906365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02d4005210 0x7f02e8158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:08.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.033+0000 7f02eeac0640 1 -- 172.21.15.19:0/1677906365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02d4005210 msgr2=0x7f02e8158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:08.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.033+0000 7f02eeac0640 1 --2- 172.21.15.19:0/1677906365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02d4005210 0x7f02e8158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:08.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.033+0000 7f02eeac0640 1 -- 172.21.15.19:0/1677906365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02e81488c0 msgr2=0x7f02e81f6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:08.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.033+0000 7f02eeac0640 1 --2- 172.21.15.19:0/1677906365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02e81488c0 0x7f02e81f6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:08.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.033+0000 7f02eeac0640 1 -- 172.21.15.19:0/1677906365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e81f6a80 con 0x7f02e8156850 2024-09-12T02:01:08.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.033+0000 7f02eeac0640 1 --2- 172.21.15.19:0/1677906365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02e8156850 0x7f02e815e880 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f02e000e230 tx=0x7f02e0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:08.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.034+0000 7f02daffd640 1 -- 172.21.15.19:0/1677906365 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e0035070 con 0x7f02e8156850 2024-09-12T02:01:08.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.034+0000 7f02daffd640 1 -- 172.21.15.19:0/1677906365 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e0041070 con 0x7f02e8156850 2024-09-12T02:01:08.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.034+0000 7f02f0523640 1 -- 172.21.15.19:0/1677906365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e81554b0 con 0x7f02e8156850 2024-09-12T02:01:08.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.034+0000 7f02daffd640 1 -- 172.21.15.19:0/1677906365 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e0009c10 con 0x7f02e8156850 2024-09-12T02:01:08.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.034+0000 7f02f0523640 1 -- 172.21.15.19:0/1677906365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e8155a70 con 0x7f02e8156850 2024-09-12T02:01:08.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.035+0000 7f02f0523640 1 -- 172.21.15.19:0/1677906365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e8072170 con 0x7f02e8156850 2024-09-12T02:01:08.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.035+0000 7f02daffd640 1 -- 172.21.15.19:0/1677906365 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f02e0005d10 con 0x7f02e8156850 2024-09-12T02:01:08.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.036+0000 7f02daffd640 1 --2- 172.21.15.19:0/1677906365 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f02cc06be30 0x7f02cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:08.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.036+0000 7f02daffd640 1 -- 172.21.15.19:0/1677906365 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6008+0+0 (secure 0 0 0) 0x7f02e00ab6a0 con 0x7f02e8156850 2024-09-12T02:01:08.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.036+0000 7f02ee2bf640 1 --2- 172.21.15.19:0/1677906365 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f02cc06be30 0x7f02cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:08.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.036+0000 7f02ee2bf640 1 --2- 172.21.15.19:0/1677906365 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f02cc06be30 0x7f02cc06e2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f02dc000c00 tx=0x7f02dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:08.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.040+0000 7f02daffd640 1 -- 172.21.15.19:0/1677906365 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02e0079f20 con 0x7f02e8156850 2024-09-12T02:01:08.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.220+0000 7f02f0523640 1 -- 172.21.15.19:0/1677906365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f02e80d0690 con 0x7f02e8156850 2024-09-12T02:01:08.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.907+0000 7f02daffd640 1 -- 172.21.15.19:0/1677906365 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v73) ==== 169+0+0 (secure 0 0 0) 0x7f02e0079820 con 0x7f02e8156850 2024-09-12T02:01:08.907 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-09-12T02:01:08.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.911+0000 7f02f0523640 1 -- 172.21.15.19:0/1677906365 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f02cc06be30 msgr2=0x7f02cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:08.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.911+0000 7f02f0523640 1 --2- 172.21.15.19:0/1677906365 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f02cc06be30 0x7f02cc06e2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f02dc000c00 tx=0x7f02dc009040 comp rx=0 tx=0).stop 2024-09-12T02:01:08.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.911+0000 7f02f0523640 1 -- 172.21.15.19:0/1677906365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02e8156850 msgr2=0x7f02e815e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:08.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.911+0000 7f02f0523640 1 --2- 172.21.15.19:0/1677906365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02e8156850 0x7f02e815e880 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f02e000e230 tx=0x7f02e0009750 comp rx=0 tx=0).stop 2024-09-12T02:01:08.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.911+0000 7f02f0523640 1 -- 172.21.15.19:0/1677906365 shutdown_connections 2024-09-12T02:01:08.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.911+0000 7f02f0523640 1 --2- 172.21.15.19:0/1677906365 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f02cc06be30 0x7f02cc06e2f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:08.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.911+0000 7f02f0523640 1 --2- 172.21.15.19:0/1677906365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02e8156850 0x7f02e815e880 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:08.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.911+0000 7f02f0523640 1 --2- 172.21.15.19:0/1677906365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02e81488c0 0x7f02e81f6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:08.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.911+0000 7f02f0523640 1 --2- 172.21.15.19:0/1677906365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02d4005210 0x7f02e8158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:08.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.911+0000 7f02f0523640 1 -- 172.21.15.19:0/1677906365 >> 172.21.15.19:0/1677906365 conn(0x7f02e806bdf0 msgr2=0x7f02e80ad6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:08.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.911+0000 7f02f0523640 1 -- 172.21.15.19:0/1677906365 shutdown_connections 2024-09-12T02:01:08.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:08.911+0000 7f02f0523640 1 -- 172.21.15.19:0/1677906365 wait complete. 2024-09-12T02:01:08.926 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_inject_journal_corrupt_dentry_first 2024-09-12T02:01:09.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.036+0000 7fd22a70a640 1 Processor -- start 2024-09-12T02:01:09.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.036+0000 7fd22a70a640 1 -- start start 2024-09-12T02:01:09.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.037+0000 7fd22a70a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd224161d00 0x7fd2240b5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.037+0000 7fd22a70a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd2240b62b0 0x7fd2240d2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.037+0000 7fd22a70a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2240d4300 con 0x7fd224161920 2024-09-12T02:01:09.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.037+0000 7fd22a70a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd2240b49a0 con 0x7fd2240b62b0 2024-09-12T02:01:09.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.037+0000 7fd22a70a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd2240b4c40 con 0x7fd224161d00 2024-09-12T02:01:09.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.037+0000 7fd223fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd224161920 0x7fd2240b5ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59004/0 (socket says 172.21.15.19:59004) 2024-09-12T02:01:09.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.037+0000 7fd228ca7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd2240b62b0 0x7fd2240d2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.037+0000 7fd223fff640 1 -- 172.21.15.19:0/1489908846 learned_addr learned my addr 172.21.15.19:0/1489908846 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:09.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.037+0000 7fd2237fe640 1 --2- 172.21.15.19:0/1489908846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd224161d00 0x7fd2240b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.037+0000 7fd228ca7640 1 -- 172.21.15.19:0/1489908846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd224161d00 msgr2=0x7fd2240b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:09.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.037+0000 7fd228ca7640 1 --2- 172.21.15.19:0/1489908846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd224161d00 0x7fd2240b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.037+0000 7fd228ca7640 1 -- 172.21.15.19:0/1489908846 >> v1:172.21.15.19:6789/0 conn(0x7fd224161920 legacy=0x7fd2240b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.037+0000 7fd228ca7640 1 -- 172.21.15.19:0/1489908846 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2240d4db0 con 0x7fd2240b62b0 2024-09-12T02:01:09.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.037+0000 7fd222ffd640 1 -- 172.21.15.19:0/1489908846 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3192975330 0 0) 0x7fd2240d4300 con 0x7fd224161920 2024-09-12T02:01:09.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.038+0000 7fd2237fe640 1 --2- 172.21.15.19:0/1489908846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd224161d00 0x7fd2240b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:09.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.038+0000 7fd228ca7640 1 --2- 172.21.15.19:0/1489908846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2240b62b0 0x7fd2240d2600 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009d90 tx=0x7fd21c02a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd4444f34512f2d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:09.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.038+0000 7fd222ffd640 1 -- 172.21.15.19:0/1489908846 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c007740 con 0x7fd2240b62b0 2024-09-12T02:01:09.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.038+0000 7fd222ffd640 1 -- 172.21.15.19:0/1489908846 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd21c0078e0 con 0x7fd2240b62b0 2024-09-12T02:01:09.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.038+0000 7fd222ffd640 1 -- 172.21.15.19:0/1489908846 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c007cb0 con 0x7fd2240b62b0 2024-09-12T02:01:09.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.039+0000 7fd22a70a640 1 -- 172.21.15.19:0/1489908846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2240b62b0 msgr2=0x7fd2240d2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.039+0000 7fd22a70a640 1 --2- 172.21.15.19:0/1489908846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2240b62b0 0x7fd2240d2600 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009d90 tx=0x7fd21c02a530 comp rx=0 tx=0).stop 2024-09-12T02:01:09.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.039+0000 7fd22a70a640 1 -- 172.21.15.19:0/1489908846 shutdown_connections 2024-09-12T02:01:09.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.039+0000 7fd22a70a640 1 --2- 172.21.15.19:0/1489908846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2240b62b0 0x7fd2240d2600 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.039+0000 7fd22a70a640 1 --2- 172.21.15.19:0/1489908846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd224161d00 0x7fd2240b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.039+0000 7fd22a70a640 1 -- 172.21.15.19:0/1489908846 >> 172.21.15.19:0/1489908846 conn(0x7fd22408bfc0 msgr2=0x7fd2240d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:09.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.039+0000 7fd22a70a640 1 -- 172.21.15.19:0/1489908846 shutdown_connections 2024-09-12T02:01:09.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.039+0000 7fd22a70a640 1 -- 172.21.15.19:0/1489908846 wait complete. 2024-09-12T02:01:09.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.040+0000 7fd22a70a640 1 Processor -- start 2024-09-12T02:01:09.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.040+0000 7fd22a70a640 1 -- start start 2024-09-12T02:01:09.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.041+0000 7fd22a70a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2240b62b0 0x7fd2241f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.041+0000 7fd22a70a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd224161920 0x7fd2241f3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.041+0000 7fd22a70a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd224161d00 0x7fd2240ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.041+0000 7fd22a70a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd2240d2b40 con 0x7fd224161d00 2024-09-12T02:01:09.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.041+0000 7fd22a70a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd2240b6930 con 0x7fd224161920 2024-09-12T02:01:09.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.041+0000 7fd22a70a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd2240d2cc0 con 0x7fd2240b62b0 2024-09-12T02:01:09.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.041+0000 7fd228ca7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd224161d00 0x7fd2240ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.041+0000 7fd228ca7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd224161d00 0x7fd2240ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34692/0 (socket says 172.21.15.19:34692) 2024-09-12T02:01:09.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.041+0000 7fd228ca7640 1 -- 172.21.15.19:0/3332251884 learned_addr learned my addr 172.21.15.19:0/3332251884 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:09.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.041+0000 7fd223fff640 1 --2- 172.21.15.19:0/3332251884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2240b62b0 0x7fd2241f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.042+0000 7fd2237fe640 1 --2- 172.21.15.19:0/3332251884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd224161920 0x7fd2241f3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.042+0000 7fd228ca7640 1 -- 172.21.15.19:0/3332251884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2240b62b0 msgr2=0x7fd2241f4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.042+0000 7fd228ca7640 1 --2- 172.21.15.19:0/3332251884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2240b62b0 0x7fd2241f4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.042+0000 7fd228ca7640 1 -- 172.21.15.19:0/3332251884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd224161920 msgr2=0x7fd2241f3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.042+0000 7fd228ca7640 1 --2- 172.21.15.19:0/3332251884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd224161920 0x7fd2241f3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.042+0000 7fd228ca7640 1 -- 172.21.15.19:0/3332251884 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2241f4ec0 con 0x7fd224161d00 2024-09-12T02:01:09.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.042+0000 7fd228ca7640 1 --2- 172.21.15.19:0/3332251884 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd224161d00 0x7fd2240ca040 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009eb0 tx=0x7fd21c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:09.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.042+0000 7fd220ff9640 1 -- 172.21.15.19:0/3332251884 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c040070 con 0x7fd224161d00 2024-09-12T02:01:09.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.042+0000 7fd220ff9640 1 -- 172.21.15.19:0/3332251884 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd21c031c90 con 0x7fd224161d00 2024-09-12T02:01:09.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.042+0000 7fd22a70a640 1 -- 172.21.15.19:0/3332251884 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2240c8fa0 con 0x7fd224161d00 2024-09-12T02:01:09.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.042+0000 7fd220ff9640 1 -- 172.21.15.19:0/3332251884 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c045680 con 0x7fd224161d00 2024-09-12T02:01:09.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.042+0000 7fd22a70a640 1 -- 172.21.15.19:0/3332251884 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2240c9560 con 0x7fd224161d00 2024-09-12T02:01:09.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.043+0000 7fd22a70a640 1 -- 172.21.15.19:0/3332251884 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2240b6c20 con 0x7fd224161d00 2024-09-12T02:01:09.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.044+0000 7fd220ff9640 1 -- 172.21.15.19:0/3332251884 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd21c039040 con 0x7fd224161d00 2024-09-12T02:01:09.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.044+0000 7fd220ff9640 1 --2- 172.21.15.19:0/3332251884 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd21006be30 0x7fd21006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.044+0000 7fd220ff9640 1 -- 172.21.15.19:0/3332251884 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5507+0+0 (secure 0 0 0) 0x7fd21c0ac780 con 0x7fd224161d00 2024-09-12T02:01:09.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.044+0000 7fd223fff640 1 --2- 172.21.15.19:0/3332251884 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd21006be30 0x7fd21006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.045+0000 7fd223fff640 1 --2- 172.21.15.19:0/3332251884 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd21006be30 0x7fd21006e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd214000f60 tx=0x7fd214007b70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:09.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.048+0000 7fd220ff9640 1 -- 172.21.15.19:0/3332251884 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2241f4ec0 con 0x7fd224161d00 2024-09-12T02:01:09.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.222+0000 7fd22a70a640 1 -- 172.21.15.19:0/3332251884 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_inject_journal_corrupt_dentry_first"} v 0) -- 0x7fd2240c9ce0 con 0x7fd224161d00 2024-09-12T02:01:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.223+0000 7fd220ff9640 1 -- 172.21.15.19:0/3332251884 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_inject_journal_corrupt_dentry_first"}]=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7fd21c07b2b0 con 0x7fd224161d00 2024-09-12T02:01:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.224+0000 7fd22a70a640 1 -- 172.21.15.19:0/3332251884 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd21006be30 msgr2=0x7fd21006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.224+0000 7fd22a70a640 1 --2- 172.21.15.19:0/3332251884 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd21006be30 0x7fd21006e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd214000f60 tx=0x7fd214007b70 comp rx=0 tx=0).stop 2024-09-12T02:01:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.224+0000 7fd22a70a640 1 -- 172.21.15.19:0/3332251884 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd224161d00 msgr2=0x7fd2240ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.224+0000 7fd22a70a640 1 --2- 172.21.15.19:0/3332251884 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd224161d00 0x7fd2240ca040 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009eb0 tx=0x7fd21c004a40 comp rx=0 tx=0).stop 2024-09-12T02:01:09.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.225+0000 7fd22a70a640 1 -- 172.21.15.19:0/3332251884 shutdown_connections 2024-09-12T02:01:09.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.225+0000 7fd22a70a640 1 --2- 172.21.15.19:0/3332251884 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd21006be30 0x7fd21006e2f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.225+0000 7fd22a70a640 1 --2- 172.21.15.19:0/3332251884 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd224161d00 0x7fd2240ca040 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.225+0000 7fd22a70a640 1 --2- 172.21.15.19:0/3332251884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd224161920 0x7fd2241f3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.225+0000 7fd22a70a640 1 --2- 172.21.15.19:0/3332251884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2240b62b0 0x7fd2241f4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.225+0000 7fd22a70a640 1 -- 172.21.15.19:0/3332251884 >> 172.21.15.19:0/3332251884 conn(0x7fd22408bfc0 msgr2=0x7fd2240b9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:09.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.225+0000 7fd22a70a640 1 -- 172.21.15.19:0/3332251884 shutdown_connections 2024-09-12T02:01:09.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.225+0000 7fd22a70a640 1 -- 172.21.15.19:0/3332251884 wait complete. 2024-09-12T02:01:09.235 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:01:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.339+0000 7f025d333640 1 Processor -- start 2024-09-12T02:01:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.339+0000 7f025d333640 1 -- start start 2024-09-12T02:01:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.339+0000 7f025d333640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0258070110 0x7f02580b6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.339+0000 7f025d333640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580705c0 0x7f025806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.339+0000 7f025d333640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02580b4a50 con 0x7f025815e760 2024-09-12T02:01:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.339+0000 7f025d333640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f02580b5ea0 con 0x7f0258070110 2024-09-12T02:01:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.339+0000 7f025d333640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f02580710d0 con 0x7f02580705c0 2024-09-12T02:01:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.340+0000 7f02567fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0258070110 0x7f02580b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.340+0000 7f02567fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0258070110 0x7f02580b6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34708/0 (socket says 172.21.15.19:34708) 2024-09-12T02:01:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.340+0000 7f02567fc640 1 -- 172.21.15.19:0/430596564 learned_addr learned my addr 172.21.15.19:0/430596564 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.340+0000 7f02577fe640 1 --2- 172.21.15.19:0/430596564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580705c0 0x7f025806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.340+0000 7f02567fc640 1 -- 172.21.15.19:0/430596564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580705c0 msgr2=0x7f025806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.340+0000 7f02567fc640 1 --2- 172.21.15.19:0/430596564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580705c0 0x7f025806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.340+0000 7f02567fc640 1 -- 172.21.15.19:0/430596564 >> v1:172.21.15.135:6789/0 conn(0x7f025815e760 legacy=0x7f025806fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.340+0000 7f02567fc640 1 -- 172.21.15.19:0/430596564 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0258070b10 con 0x7f0258070110 2024-09-12T02:01:09.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.341+0000 7f02567fc640 1 --2- 172.21.15.19:0/430596564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0258070110 0x7f02580b6310 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f024c009870 tx=0x7f024c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d262967f4388f9d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:09.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.341+0000 7f0255ffb640 1 -- 172.21.15.19:0/430596564 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c037070 con 0x7f0258070110 2024-09-12T02:01:09.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.341+0000 7f0255ffb640 1 -- 172.21.15.19:0/430596564 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f024c032440 con 0x7f0258070110 2024-09-12T02:01:09.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.341+0000 7f0255ffb640 1 -- 172.21.15.19:0/430596564 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c032810 con 0x7f0258070110 2024-09-12T02:01:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.341+0000 7f025d333640 1 -- 172.21.15.19:0/430596564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0258070110 msgr2=0x7f02580b6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.341+0000 7f025d333640 1 --2- 172.21.15.19:0/430596564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0258070110 0x7f02580b6310 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f024c009870 tx=0x7f024c02a270 comp rx=0 tx=0).stop 2024-09-12T02:01:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.342+0000 7f025d333640 1 -- 172.21.15.19:0/430596564 shutdown_connections 2024-09-12T02:01:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.342+0000 7f025d333640 1 --2- 172.21.15.19:0/430596564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580705c0 0x7f025806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.342+0000 7f025d333640 1 --2- 172.21.15.19:0/430596564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0258070110 0x7f02580b6310 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.342+0000 7f025d333640 1 -- 172.21.15.19:0/430596564 >> 172.21.15.19:0/430596564 conn(0x7f0258073490 msgr2=0x7f02580b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.342+0000 7f025d333640 1 -- 172.21.15.19:0/430596564 shutdown_connections 2024-09-12T02:01:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.342+0000 7f025d333640 1 -- 172.21.15.19:0/430596564 wait complete. 2024-09-12T02:01:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.343+0000 7f025d333640 1 Processor -- start 2024-09-12T02:01:09.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.343+0000 7f025d333640 1 -- start start 2024-09-12T02:01:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.344+0000 7f025d333640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0258070110 0x7f025814f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.344+0000 7f025d333640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580705c0 0x7f02581f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.344+0000 7f025d333640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025815e760 0x7f0258153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.344+0000 7f025d333640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f02580b46e0 con 0x7f025815e760 2024-09-12T02:01:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.344+0000 7f025d333640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f02580b4400 con 0x7f0258070110 2024-09-12T02:01:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.344+0000 7f025d333640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f02580ae240 con 0x7f02580705c0 2024-09-12T02:01:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.344+0000 7f02577fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025815e760 0x7f0258153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.344+0000 7f02577fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025815e760 0x7f0258153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34714/0 (socket says 172.21.15.19:34714) 2024-09-12T02:01:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.344+0000 7f02577fe640 1 -- 172.21.15.19:0/1978350048 learned_addr learned my addr 172.21.15.19:0/1978350048 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.344+0000 7f0256ffd640 1 --2- 172.21.15.19:0/1978350048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0258070110 0x7f025814f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.344+0000 7f02567fc640 1 --2- 172.21.15.19:0/1978350048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580705c0 0x7f02581f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.344+0000 7f02577fe640 1 -- 172.21.15.19:0/1978350048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580705c0 msgr2=0x7f02581f4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.344+0000 7f02577fe640 1 --2- 172.21.15.19:0/1978350048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580705c0 0x7f02581f4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.344+0000 7f02577fe640 1 -- 172.21.15.19:0/1978350048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0258070110 msgr2=0x7f025814f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.344+0000 7f02577fe640 1 --2- 172.21.15.19:0/1978350048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0258070110 0x7f025814f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.344+0000 7f02577fe640 1 -- 172.21.15.19:0/1978350048 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02581545d0 con 0x7f025815e760 2024-09-12T02:01:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.344+0000 7f02577fe640 1 --2- 172.21.15.19:0/1978350048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025815e760 0x7f0258153cd0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f025000efc0 tx=0x7f025000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.345+0000 7f023f7fe640 1 -- 172.21.15.19:0/1978350048 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0250018020 con 0x7f025815e760 2024-09-12T02:01:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.345+0000 7f023f7fe640 1 -- 172.21.15.19:0/1978350048 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0250014480 con 0x7f025815e760 2024-09-12T02:01:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.345+0000 7f025d333640 1 -- 172.21.15.19:0/1978350048 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02581548b0 con 0x7f025815e760 2024-09-12T02:01:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.345+0000 7f023f7fe640 1 -- 172.21.15.19:0/1978350048 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0250014870 con 0x7f025815e760 2024-09-12T02:01:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.345+0000 7f025d333640 1 -- 172.21.15.19:0/1978350048 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0258154e70 con 0x7f025815e760 2024-09-12T02:01:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.346+0000 7f025d333640 1 -- 172.21.15.19:0/1978350048 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02580b6310 con 0x7f025815e760 2024-09-12T02:01:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.346+0000 7f023f7fe640 1 -- 172.21.15.19:0/1978350048 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0250005d10 con 0x7f025815e760 2024-09-12T02:01:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.346+0000 7f023f7fe640 1 --2- 172.21.15.19:0/1978350048 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f024406be30 0x7f024406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.347+0000 7f023f7fe640 1 -- 172.21.15.19:0/1978350048 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5507+0+0 (secure 0 0 0) 0x7f025008b880 con 0x7f025815e760 2024-09-12T02:01:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.347+0000 7f0256ffd640 1 --2- 172.21.15.19:0/1978350048 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f024406be30 0x7f024406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.347+0000 7f0256ffd640 1 --2- 172.21.15.19:0/1978350048 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f024406be30 0x7f024406e2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f02480015a0 tx=0x7f0248009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:09.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.351+0000 7f023f7fe640 1 -- 172.21.15.19:0/1978350048 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0250022070 con 0x7f025815e760 2024-09-12T02:01:09.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.528+0000 7f025d333640 1 -- 172.21.15.19:0/1978350048 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f02580b3950 con 0x7f025815e760 2024-09-12T02:01:09.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.531+0000 7f023f7fe640 1 -- 172.21.15.19:0/1978350048 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f0250010040 con 0x7f025815e760 2024-09-12T02:01:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.533+0000 7f025d333640 1 -- 172.21.15.19:0/1978350048 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f024406be30 msgr2=0x7f024406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.533+0000 7f025d333640 1 --2- 172.21.15.19:0/1978350048 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f024406be30 0x7f024406e2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f02480015a0 tx=0x7f0248009040 comp rx=0 tx=0).stop 2024-09-12T02:01:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.533+0000 7f025d333640 1 -- 172.21.15.19:0/1978350048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025815e760 msgr2=0x7f0258153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.533+0000 7f025d333640 1 --2- 172.21.15.19:0/1978350048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025815e760 0x7f0258153cd0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f025000efc0 tx=0x7f025000c490 comp rx=0 tx=0).stop 2024-09-12T02:01:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.533+0000 7f025d333640 1 -- 172.21.15.19:0/1978350048 shutdown_connections 2024-09-12T02:01:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.533+0000 7f025d333640 1 --2- 172.21.15.19:0/1978350048 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f024406be30 0x7f024406e2f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.533+0000 7f025d333640 1 --2- 172.21.15.19:0/1978350048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025815e760 0x7f0258153cd0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.533+0000 7f025d333640 1 --2- 172.21.15.19:0/1978350048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580705c0 0x7f02581f4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.533+0000 7f025d333640 1 --2- 172.21.15.19:0/1978350048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0258070110 0x7f025814f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.533+0000 7f025d333640 1 -- 172.21.15.19:0/1978350048 >> 172.21.15.19:0/1978350048 conn(0x7f0258073490 msgr2=0x7f025806eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:09.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.533+0000 7f025d333640 1 -- 172.21.15.19:0/1978350048 shutdown_connections 2024-09-12T02:01:09.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.533+0000 7f025d333640 1 -- 172.21.15.19:0/1978350048 wait complete. 2024-09-12T02:01:09.545 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_precommit' 2024-09-12T02:01:09.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.647+0000 7ff71308c640 1 Processor -- start 2024-09-12T02:01:09.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.647+0000 7ff71308c640 1 -- start start 2024-09-12T02:01:09.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.647+0000 7ff71308c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff70c15e5d0 0x7ff70c0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.647+0000 7ff71308c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff70c06df60 0x7ff70c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.648+0000 7ff71308c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff70c06cec0 con 0x7ff70c0d1630 2024-09-12T02:01:09.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.648+0000 7ff71308c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff70c06dad0 con 0x7ff70c15e5d0 2024-09-12T02:01:09.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.648+0000 7ff71308c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff70c06d1a0 con 0x7ff70c06df60 2024-09-12T02:01:09.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.648+0000 7ff710e28640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff70c15e5d0 0x7ff70c0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.648+0000 7ff711629640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff70c0d1630 0x7ff70c162230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59012/0 (socket says 172.21.15.19:59012) 2024-09-12T02:01:09.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.648+0000 7ff711629640 1 -- 172.21.15.19:0/4128935261 learned_addr learned my addr 172.21.15.19:0/4128935261 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:09.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.648+0000 7ff70bfff640 1 --2- 172.21.15.19:0/4128935261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff70c06df60 0x7ff70c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.648+0000 7ff710e28640 1 -- 172.21.15.19:0/4128935261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff70c06df60 msgr2=0x7ff70c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:09.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.648+0000 7ff710e28640 1 --2- 172.21.15.19:0/4128935261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff70c06df60 0x7ff70c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.648+0000 7ff710e28640 1 -- 172.21.15.19:0/4128935261 >> v1:172.21.15.19:6789/0 conn(0x7ff70c0d1630 legacy=0x7ff70c162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.648+0000 7ff70b7fe640 1 -- 172.21.15.19:0/4128935261 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 187776059 0 0) 0x7ff70c06cec0 con 0x7ff70c0d1630 2024-09-12T02:01:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.648+0000 7ff710e28640 1 -- 172.21.15.19:0/4128935261 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70c06d480 con 0x7ff70c15e5d0 2024-09-12T02:01:09.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.649+0000 7ff710e28640 1 --2- 172.21.15.19:0/4128935261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff70c15e5d0 0x7ff70c0d10f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ff7000097a0 tx=0x7ff70002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37181004bd27ec42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:09.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.649+0000 7ff70b7fe640 1 -- 172.21.15.19:0/4128935261 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700037070 con 0x7ff70c15e5d0 2024-09-12T02:01:09.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.649+0000 7ff70b7fe640 1 -- 172.21.15.19:0/4128935261 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff700032440 con 0x7ff70c15e5d0 2024-09-12T02:01:09.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.649+0000 7ff70b7fe640 1 -- 172.21.15.19:0/4128935261 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700032810 con 0x7ff70c15e5d0 2024-09-12T02:01:09.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.649+0000 7ff71308c640 1 -- 172.21.15.19:0/4128935261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff70c15e5d0 msgr2=0x7ff70c0d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.649+0000 7ff71308c640 1 --2- 172.21.15.19:0/4128935261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff70c15e5d0 0x7ff70c0d10f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ff7000097a0 tx=0x7ff70002a210 comp rx=0 tx=0).stop 2024-09-12T02:01:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.649+0000 7ff71308c640 1 -- 172.21.15.19:0/4128935261 shutdown_connections 2024-09-12T02:01:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.649+0000 7ff71308c640 1 --2- 172.21.15.19:0/4128935261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff70c06df60 0x7ff70c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.649+0000 7ff71308c640 1 --2- 172.21.15.19:0/4128935261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff70c15e5d0 0x7ff70c0d10f0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.649+0000 7ff71308c640 1 -- 172.21.15.19:0/4128935261 >> 172.21.15.19:0/4128935261 conn(0x7ff70c0d23a0 msgr2=0x7ff70c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.649+0000 7ff71308c640 1 -- 172.21.15.19:0/4128935261 shutdown_connections 2024-09-12T02:01:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.649+0000 7ff71308c640 1 -- 172.21.15.19:0/4128935261 wait complete. 2024-09-12T02:01:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.651+0000 7ff71308c640 1 Processor -- start 2024-09-12T02:01:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.651+0000 7ff71308c640 1 -- start start 2024-09-12T02:01:09.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff71308c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff70c06df60 0x7ff70c153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff71308c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff70c0d1630 0x7ff70c154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff71308c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff70c15e5d0 0x7ff70c155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff71308c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff70c15eb30 con 0x7ff70c15e5d0 2024-09-12T02:01:09.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff71308c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff70c15e9b0 con 0x7ff70c0d1630 2024-09-12T02:01:09.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff71308c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff70c09af70 con 0x7ff70c06df60 2024-09-12T02:01:09.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff711629640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff70c15e5d0 0x7ff70c155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff711629640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff70c15e5d0 0x7ff70c155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34724/0 (socket says 172.21.15.19:34724) 2024-09-12T02:01:09.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff711629640 1 -- 172.21.15.19:0/4173683099 learned_addr learned my addr 172.21.15.19:0/4173683099 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff70bfff640 1 --2- 172.21.15.19:0/4173683099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff70c0d1630 0x7ff70c154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff710e28640 1 --2- 172.21.15.19:0/4173683099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff70c06df60 0x7ff70c153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff711629640 1 -- 172.21.15.19:0/4173683099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff70c06df60 msgr2=0x7ff70c153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff711629640 1 --2- 172.21.15.19:0/4173683099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff70c06df60 0x7ff70c153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff711629640 1 -- 172.21.15.19:0/4173683099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff70c0d1630 msgr2=0x7ff70c154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff711629640 1 --2- 172.21.15.19:0/4173683099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff70c0d1630 0x7ff70c154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff711629640 1 -- 172.21.15.19:0/4173683099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70c0c5fc0 con 0x7ff70c15e5d0 2024-09-12T02:01:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff70bfff640 1 --2- 172.21.15.19:0/4173683099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff70c0d1630 0x7ff70c154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff711629640 1 --2- 172.21.15.19:0/4173683099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff70c15e5d0 0x7ff70c155160 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ff70400c7a0 tx=0x7ff70400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff7097fa640 1 -- 172.21.15.19:0/4173683099 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff704018070 con 0x7ff70c15e5d0 2024-09-12T02:01:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff7097fa640 1 -- 172.21.15.19:0/4173683099 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff70400a640 con 0x7ff70c15e5d0 2024-09-12T02:01:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff71308c640 1 -- 172.21.15.19:0/4173683099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff70c0c62a0 con 0x7ff70c15e5d0 2024-09-12T02:01:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff7097fa640 1 -- 172.21.15.19:0/4173683099 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70400aab0 con 0x7ff70c15e5d0 2024-09-12T02:01:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.652+0000 7ff71308c640 1 -- 172.21.15.19:0/4173683099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff70c0c6860 con 0x7ff70c15e5d0 2024-09-12T02:01:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.653+0000 7ff71308c640 1 -- 172.21.15.19:0/4173683099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff70c06cec0 con 0x7ff70c15e5d0 2024-09-12T02:01:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.654+0000 7ff7097fa640 1 -- 172.21.15.19:0/4173683099 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff70401b070 con 0x7ff70c15e5d0 2024-09-12T02:01:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.654+0000 7ff7097fa640 1 --2- 172.21.15.19:0/4173683099 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff6f006be60 0x7ff6f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.654+0000 7ff7097fa640 1 -- 172.21.15.19:0/4173683099 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5507+0+0 (secure 0 0 0) 0x7ff70408a320 con 0x7ff70c15e5d0 2024-09-12T02:01:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.655+0000 7ff710e28640 1 --2- 172.21.15.19:0/4173683099 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff6f006be60 0x7ff6f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.655+0000 7ff710e28640 1 --2- 172.21.15.19:0/4173683099 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff6f006be60 0x7ff6f006e320 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff700034000 tx=0x7ff70002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:09.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.659+0000 7ff7097fa640 1 -- 172.21.15.19:0/4173683099 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff704058e20 con 0x7ff70c15e5d0 2024-09-12T02:01:09.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.903+0000 7ff71308c640 1 -- 172.21.15.19:0/4173683099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_precommit"]} v 0) -- 0x7ff70c06e530 con 0x7ff70c15e5d0 2024-09-12T02:01:09.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.908+0000 7ff7097fa640 1 -- 172.21.15.19:0/4173683099 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_precommit"]}]=0 v251) ==== 142+0+0 (secure 0 0 0) 0x7ff704058720 con 0x7ff70c15e5d0 2024-09-12T02:01:09.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.910+0000 7ff71308c640 1 -- 172.21.15.19:0/4173683099 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff6f006be60 msgr2=0x7ff6f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.910+0000 7ff71308c640 1 --2- 172.21.15.19:0/4173683099 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff6f006be60 0x7ff6f006e320 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff700034000 tx=0x7ff70002e000 comp rx=0 tx=0).stop 2024-09-12T02:01:09.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.910+0000 7ff71308c640 1 -- 172.21.15.19:0/4173683099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff70c15e5d0 msgr2=0x7ff70c155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.910+0000 7ff71308c640 1 --2- 172.21.15.19:0/4173683099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff70c15e5d0 0x7ff70c155160 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ff70400c7a0 tx=0x7ff70400cc60 comp rx=0 tx=0).stop 2024-09-12T02:01:09.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.910+0000 7ff71308c640 1 -- 172.21.15.19:0/4173683099 shutdown_connections 2024-09-12T02:01:09.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.910+0000 7ff71308c640 1 --2- 172.21.15.19:0/4173683099 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff6f006be60 0x7ff6f006e320 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.910+0000 7ff71308c640 1 --2- 172.21.15.19:0/4173683099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff70c15e5d0 0x7ff70c155160 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.910+0000 7ff71308c640 1 --2- 172.21.15.19:0/4173683099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff70c0d1630 0x7ff70c154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.910+0000 7ff71308c640 1 --2- 172.21.15.19:0/4173683099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff70c06df60 0x7ff70c153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.910+0000 7ff71308c640 1 -- 172.21.15.19:0/4173683099 >> 172.21.15.19:0/4173683099 conn(0x7ff70c0d23a0 msgr2=0x7ff70c0b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.910+0000 7ff71308c640 1 -- 172.21.15.19:0/4173683099 shutdown_connections 2024-09-12T02:01:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:09.910+0000 7ff71308c640 1 -- 172.21.15.19:0/4173683099 wait complete. 2024-09-12T02:01:09.922 INFO:tasks.cephfs_test_runner:That the MDS won't write a dentry with new damage to CDentry::first ... ok 2024-09-12T02:01:09.922 INFO:tasks.cephfs_test_runner:Starting test: test_dentry_first_preflush (tasks.cephfs.test_damage.TestDamage) That the MDS won't write a dentry with new damage to CDentry::first 2024-09-12T02:01:09.922 INFO:tasks.cephfs_test_runner:test_dentry_first_preflush (tasks.cephfs.test_damage.TestDamage) 2024-09-12T02:01:09.922 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:01:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.023+0000 7f6b9b103640 1 Processor -- start 2024-09-12T02:01:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.023+0000 7f6b9b103640 1 -- start start 2024-09-12T02:01:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.024+0000 7f6b9b103640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b9415b340 0x7f6b9409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:10.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.024+0000 7f6b9b103640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b940b43f0 0x7f6b940b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:10.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.024+0000 7f6b9b103640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b940b3830 con 0x7f6b940b4e80 2024-09-12T02:01:10.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.024+0000 7f6b9b103640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f6b940b5bd0 con 0x7f6b9415b340 2024-09-12T02:01:10.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.024+0000 7f6b9b103640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6b940b5610 con 0x7f6b940b43f0 2024-09-12T02:01:10.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.024+0000 7f6b98e9f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b9415b340 0x7f6b9409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:10.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.024+0000 7f6b98e9f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b9415b340 0x7f6b9409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34726/0 (socket says 172.21.15.19:34726) 2024-09-12T02:01:10.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.024+0000 7f6b98e9f640 1 -- 172.21.15.19:0/3231420022 learned_addr learned my addr 172.21.15.19:0/3231420022 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:10.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.025+0000 7f6b93fff640 1 --2- 172.21.15.19:0/3231420022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b940b43f0 0x7f6b940b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:10.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.025+0000 7f6b98e9f640 1 -- 172.21.15.19:0/3231420022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b940b43f0 msgr2=0x7f6b940b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:10.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.025+0000 7f6b98e9f640 1 --2- 172.21.15.19:0/3231420022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b940b43f0 0x7f6b940b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.025+0000 7f6b98e9f640 1 -- 172.21.15.19:0/3231420022 >> v1:172.21.15.135:6789/0 conn(0x7f6b940b4e80 legacy=0x7f6b9415de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:10.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.025+0000 7f6b98e9f640 1 -- 172.21.15.19:0/3231420022 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b940b58f0 con 0x7f6b9415b340 2024-09-12T02:01:10.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.026+0000 7f6b98e9f640 1 --2- 172.21.15.19:0/3231420022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b9415b340 0x7f6b9409aa30 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009870 tx=0x7f6b8402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e23ec0fb86b210 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:10.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.026+0000 7f6b937fe640 1 -- 172.21.15.19:0/3231420022 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b84037070 con 0x7f6b9415b340 2024-09-12T02:01:10.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.026+0000 7f6b937fe640 1 -- 172.21.15.19:0/3231420022 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8402ae50 con 0x7f6b9415b340 2024-09-12T02:01:10.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.026+0000 7f6b937fe640 1 -- 172.21.15.19:0/3231420022 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b84032860 con 0x7f6b9415b340 2024-09-12T02:01:10.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.026+0000 7f6b9b103640 1 -- 172.21.15.19:0/3231420022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b9415b340 msgr2=0x7f6b9409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:10.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.026+0000 7f6b9b103640 1 --2- 172.21.15.19:0/3231420022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b9415b340 0x7f6b9409aa30 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009870 tx=0x7f6b8402a300 comp rx=0 tx=0).stop 2024-09-12T02:01:10.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.026+0000 7f6b9b103640 1 -- 172.21.15.19:0/3231420022 shutdown_connections 2024-09-12T02:01:10.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.026+0000 7f6b9b103640 1 --2- 172.21.15.19:0/3231420022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b940b43f0 0x7f6b940b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.026+0000 7f6b9b103640 1 --2- 172.21.15.19:0/3231420022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b9415b340 0x7f6b9409aa30 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.026+0000 7f6b9b103640 1 -- 172.21.15.19:0/3231420022 >> 172.21.15.19:0/3231420022 conn(0x7f6b94073490 msgr2=0x7f6b940b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:10.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.026+0000 7f6b9b103640 1 -- 172.21.15.19:0/3231420022 shutdown_connections 2024-09-12T02:01:10.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.026+0000 7f6b9b103640 1 -- 172.21.15.19:0/3231420022 wait complete. 2024-09-12T02:01:10.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.027+0000 7f6b9b103640 1 Processor -- start 2024-09-12T02:01:10.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.028+0000 7f6b9b103640 1 -- start start 2024-09-12T02:01:10.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.028+0000 7f6b9b103640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b940b43f0 0x7f6b9415a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:10.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.028+0000 7f6b9b103640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b940b4e80 0x7f6b94144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:10.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.028+0000 7f6b9b103640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b9415b340 0x7f6b94157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:10.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.028+0000 7f6b9b103640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6b940b5310 con 0x7f6b940b4e80 2024-09-12T02:01:10.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.028+0000 7f6b9b103640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9415d8f0 con 0x7f6b9415b340 2024-09-12T02:01:10.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.028+0000 7f6b9b103640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6b9415c730 con 0x7f6b940b43f0 2024-09-12T02:01:10.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.029+0000 7f6b93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b940b4e80 0x7f6b94144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:10.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.029+0000 7f6b93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b940b4e80 0x7f6b94144b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34738/0 (socket says 172.21.15.19:34738) 2024-09-12T02:01:10.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.029+0000 7f6b93fff640 1 -- 172.21.15.19:0/1248877930 learned_addr learned my addr 172.21.15.19:0/1248877930 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:10.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.029+0000 7f6b98e9f640 1 --2- 172.21.15.19:0/1248877930 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b940b43f0 0x7f6b9415a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:10.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.029+0000 7f6b996a0640 1 --2- 172.21.15.19:0/1248877930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b9415b340 0x7f6b94157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:10.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.029+0000 7f6b93fff640 1 -- 172.21.15.19:0/1248877930 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b940b43f0 msgr2=0x7f6b9415a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:10.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.029+0000 7f6b93fff640 1 --2- 172.21.15.19:0/1248877930 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b940b43f0 0x7f6b9415a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.029+0000 7f6b93fff640 1 -- 172.21.15.19:0/1248877930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b9415b340 msgr2=0x7f6b94157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:10.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.029+0000 7f6b93fff640 1 --2- 172.21.15.19:0/1248877930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b9415b340 0x7f6b94157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.029+0000 7f6b93fff640 1 -- 172.21.15.19:0/1248877930 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9414a540 con 0x7f6b940b4e80 2024-09-12T02:01:10.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.029+0000 7f6b93fff640 1 --2- 172.21.15.19:0/1248877930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b940b4e80 0x7f6b94144b40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c007f20 tx=0x7f6b7c00e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:10.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.029+0000 7f6b917fa640 1 -- 172.21.15.19:0/1248877930 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c014620 con 0x7f6b940b4e80 2024-09-12T02:01:10.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.029+0000 7f6b917fa640 1 -- 172.21.15.19:0/1248877930 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b7c019070 con 0x7f6b940b4e80 2024-09-12T02:01:10.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.029+0000 7f6b9b103640 1 -- 172.21.15.19:0/1248877930 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9414a820 con 0x7f6b940b4e80 2024-09-12T02:01:10.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.029+0000 7f6b917fa640 1 -- 172.21.15.19:0/1248877930 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c014a00 con 0x7f6b940b4e80 2024-09-12T02:01:10.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.029+0000 7f6b9b103640 1 -- 172.21.15.19:0/1248877930 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b9414cef0 con 0x7f6b940b4e80 2024-09-12T02:01:10.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.030+0000 7f6b9b103640 1 -- 172.21.15.19:0/1248877930 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b940cdb30 con 0x7f6b940b4e80 2024-09-12T02:01:10.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.031+0000 7f6b917fa640 1 -- 172.21.15.19:0/1248877930 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b7c014ba0 con 0x7f6b940b4e80 2024-09-12T02:01:10.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.031+0000 7f6b917fa640 1 --2- 172.21.15.19:0/1248877930 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b7406be30 0x7f6b7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:10.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.032+0000 7f6b917fa640 1 -- 172.21.15.19:0/1248877930 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5507+0+0 (secure 0 0 0) 0x7f6b7c08b5c0 con 0x7f6b940b4e80 2024-09-12T02:01:10.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.032+0000 7f6b98e9f640 1 --2- 172.21.15.19:0/1248877930 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b7406be30 0x7f6b7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:10.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.032+0000 7f6b98e9f640 1 --2- 172.21.15.19:0/1248877930 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b7406be30 0x7f6b7406e2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6b84034000 tx=0x7f6b8402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:10.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.036+0000 7f6b917fa640 1 -- 172.21.15.19:0/1248877930 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b7c05a0c0 con 0x7f6b940b4e80 2024-09-12T02:01:10.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.215+0000 7f6b9b103640 1 -- 172.21.15.19:0/1248877930 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b9406f190 con 0x7f6b940b4e80 2024-09-12T02:01:10.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.216+0000 7f6b917fa640 1 -- 172.21.15.19:0/1248877930 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+13552 (secure 0 0 0) 0x7f6b7c0599c0 con 0x7f6b940b4e80 2024-09-12T02:01:10.216 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:10.217 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":73,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:01:08.902931+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6834/2113904472":"2024-09-13T02:01:05.812030+0000","172.21.15.19:6835/740310996":"2024-09-13T01:59:19.698070+0000","172.21.15.19:6833/740310996":"2024-09-13T01:59:19.698070+0000","172.21.15.19:6835/1551156711":"2024-09-13T01:58:49.340791+0000","172.21.15.19:6832/2113904472":"2024-09-13T02:01:05.812030+0000","172.21.15.19:6833/1551156711":"2024-09-13T01:58:49.340791+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:01:10.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.218+0000 7f6b9b103640 1 -- 172.21.15.19:0/1248877930 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b7406be30 msgr2=0x7f6b7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:10.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.218+0000 7f6b9b103640 1 --2- 172.21.15.19:0/1248877930 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b7406be30 0x7f6b7406e2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6b84034000 tx=0x7f6b8402e000 comp rx=0 tx=0).stop 2024-09-12T02:01:10.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.218+0000 7f6b9b103640 1 -- 172.21.15.19:0/1248877930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b940b4e80 msgr2=0x7f6b94144b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:10.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.218+0000 7f6b9b103640 1 --2- 172.21.15.19:0/1248877930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b940b4e80 0x7f6b94144b40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c007f20 tx=0x7f6b7c00e570 comp rx=0 tx=0).stop 2024-09-12T02:01:10.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.218+0000 7f6b9b103640 1 -- 172.21.15.19:0/1248877930 shutdown_connections 2024-09-12T02:01:10.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.218+0000 7f6b9b103640 1 --2- 172.21.15.19:0/1248877930 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b7406be30 0x7f6b7406e2f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.218+0000 7f6b9b103640 1 --2- 172.21.15.19:0/1248877930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b9415b340 0x7f6b94157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.218+0000 7f6b9b103640 1 --2- 172.21.15.19:0/1248877930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b940b4e80 0x7f6b94144b40 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.218+0000 7f6b9b103640 1 --2- 172.21.15.19:0/1248877930 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b940b43f0 0x7f6b9415a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.218+0000 7f6b9b103640 1 -- 172.21.15.19:0/1248877930 >> 172.21.15.19:0/1248877930 conn(0x7f6b94073490 msgr2=0x7f6b940cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:10.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.218+0000 7f6b9b103640 1 -- 172.21.15.19:0/1248877930 shutdown_connections 2024-09-12T02:01:10.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.218+0000 7f6b9b103640 1 -- 172.21.15.19:0/1248877930 wait complete. 2024-09-12T02:01:10.230 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:55:44.127030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:01:10.230 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:01:10.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.334+0000 7f82596d2640 1 Processor -- start 2024-09-12T02:01:10.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.334+0000 7f82596d2640 1 -- start start 2024-09-12T02:01:10.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.335+0000 7f82596d2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540b3220 0x7f82540cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:10.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.335+0000 7f82596d2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f825406cac0 0x7f825406cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:10.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.335+0000 7f82596d2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82540ce010 con 0x7f8254161e60 2024-09-12T02:01:10.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.335+0000 7f82596d2640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f82540ce2f0 con 0x7f825406cac0 2024-09-12T02:01:10.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.335+0000 7f82596d2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f82540d0640 con 0x7f82540b3220 2024-09-12T02:01:10.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.335+0000 7f82537fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f825406cac0 0x7f825406cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:10.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.335+0000 7f82537fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f825406cac0 0x7f825406cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34748/0 (socket says 172.21.15.19:34748) 2024-09-12T02:01:10.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.335+0000 7f82537fe640 1 -- 172.21.15.19:0/1829404503 learned_addr learned my addr 172.21.15.19:0/1829404503 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:10.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.336+0000 7f82527fc640 1 --2- 172.21.15.19:0/1829404503 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540b3220 0x7f82540cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:10.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.336+0000 7f82537fe640 1 -- 172.21.15.19:0/1829404503 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540b3220 msgr2=0x7f82540cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:10.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.336+0000 7f82537fe640 1 --2- 172.21.15.19:0/1829404503 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540b3220 0x7f82540cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.336+0000 7f82537fe640 1 -- 172.21.15.19:0/1829404503 >> v1:172.21.15.135:6789/0 conn(0x7f8254161e60 legacy=0x7f82540d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:10.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.336+0000 7f82537fe640 1 -- 172.21.15.19:0/1829404503 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82540cfff0 con 0x7f825406cac0 2024-09-12T02:01:10.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.336+0000 7f82537fe640 1 --2- 172.21.15.19:0/1829404503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f825406cac0 0x7f825406cf50 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8244009e50 tx=0x7f824402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8903607d555c3337 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:10.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.337+0000 7f8251ffb640 1 -- 172.21.15.19:0/1829404503 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244036070 con 0x7f825406cac0 2024-09-12T02:01:10.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.337+0000 7f8251ffb640 1 -- 172.21.15.19:0/1829404503 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8244031600 con 0x7f825406cac0 2024-09-12T02:01:10.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.337+0000 7f8251ffb640 1 -- 172.21.15.19:0/1829404503 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82440319d0 con 0x7f825406cac0 2024-09-12T02:01:10.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.337+0000 7f82596d2640 1 -- 172.21.15.19:0/1829404503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f825406cac0 msgr2=0x7f825406cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:10.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.337+0000 7f82596d2640 1 --2- 172.21.15.19:0/1829404503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f825406cac0 0x7f825406cf50 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8244009e50 tx=0x7f824402a680 comp rx=0 tx=0).stop 2024-09-12T02:01:10.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.337+0000 7f82596d2640 1 -- 172.21.15.19:0/1829404503 shutdown_connections 2024-09-12T02:01:10.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.337+0000 7f82596d2640 1 --2- 172.21.15.19:0/1829404503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f825406cac0 0x7f825406cf50 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.337+0000 7f82596d2640 1 --2- 172.21.15.19:0/1829404503 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540b3220 0x7f82540cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.337+0000 7f82596d2640 1 -- 172.21.15.19:0/1829404503 >> 172.21.15.19:0/1829404503 conn(0x7f82540b3de0 msgr2=0x7f82540b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:10.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.337+0000 7f82596d2640 1 -- 172.21.15.19:0/1829404503 shutdown_connections 2024-09-12T02:01:10.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.337+0000 7f82596d2640 1 -- 172.21.15.19:0/1829404503 wait complete. 2024-09-12T02:01:10.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.339+0000 7f82596d2640 1 Processor -- start 2024-09-12T02:01:10.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.339+0000 7f82596d2640 1 -- start start 2024-09-12T02:01:10.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.339+0000 7f82596d2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f825406cac0 0x7f82540c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:10.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.339+0000 7f82596d2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540b3220 0x7f82540b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:10.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.339+0000 7f82596d2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8254161e60 0x7f8254158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:10.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.339+0000 7f82596d2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f82540d1360 con 0x7f825406cac0 2024-09-12T02:01:10.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.339+0000 7f82596d2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f82540d11e0 con 0x7f8254161e60 2024-09-12T02:01:10.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.339+0000 7f82596d2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f825409b940 con 0x7f82540b3220 2024-09-12T02:01:10.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.339+0000 7f8252ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f825406cac0 0x7f82540c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:10.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.339+0000 7f8252ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f825406cac0 0x7f82540c6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34752/0 (socket says 172.21.15.19:34752) 2024-09-12T02:01:10.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.339+0000 7f8252ffd640 1 -- 172.21.15.19:0/1390589434 learned_addr learned my addr 172.21.15.19:0/1390589434 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:10.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.340+0000 7f82527fc640 1 --2- 172.21.15.19:0/1390589434 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540b3220 0x7f82540b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:10.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.340+0000 7f82537fe640 1 --2- 172.21.15.19:0/1390589434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8254161e60 0x7f8254158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:10.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.340+0000 7f8252ffd640 1 -- 172.21.15.19:0/1390589434 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540b3220 msgr2=0x7f82540b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:10.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.340+0000 7f8252ffd640 1 --2- 172.21.15.19:0/1390589434 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540b3220 0x7f82540b6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.340+0000 7f8252ffd640 1 -- 172.21.15.19:0/1390589434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8254161e60 msgr2=0x7f8254158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:10.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.340+0000 7f8252ffd640 1 --2- 172.21.15.19:0/1390589434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8254161e60 0x7f8254158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.340+0000 7f8252ffd640 1 -- 172.21.15.19:0/1390589434 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82540ca7e0 con 0x7f825406cac0 2024-09-12T02:01:10.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.340+0000 7f82527fc640 1 --2- 172.21.15.19:0/1390589434 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540b3220 0x7f82540b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:10.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.340+0000 7f82537fe640 1 --2- 172.21.15.19:0/1390589434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8254161e60 0x7f8254158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:10.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.340+0000 7f8252ffd640 1 --2- 172.21.15.19:0/1390589434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f825406cac0 0x7f82540c6f50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f824c00c400 tx=0x7f824c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:10.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.340+0000 7f824b7fe640 1 -- 172.21.15.19:0/1390589434 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c0052d0 con 0x7f825406cac0 2024-09-12T02:01:10.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.340+0000 7f824b7fe640 1 -- 172.21.15.19:0/1390589434 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824c005490 con 0x7f825406cac0 2024-09-12T02:01:10.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.340+0000 7f82596d2640 1 -- 172.21.15.19:0/1390589434 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8254161310 con 0x7f825406cac0 2024-09-12T02:01:10.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.340+0000 7f824b7fe640 1 -- 172.21.15.19:0/1390589434 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c007260 con 0x7f825406cac0 2024-09-12T02:01:10.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.340+0000 7f82596d2640 1 -- 172.21.15.19:0/1390589434 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82540c9fe0 con 0x7f825406cac0 2024-09-12T02:01:10.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.341+0000 7f82596d2640 1 -- 172.21.15.19:0/1390589434 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82540b4a70 con 0x7f825406cac0 2024-09-12T02:01:10.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.342+0000 7f824b7fe640 1 -- 172.21.15.19:0/1390589434 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f824c007400 con 0x7f825406cac0 2024-09-12T02:01:10.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.342+0000 7f824b7fe640 1 --2- 172.21.15.19:0/1390589434 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f823406be30 0x7f823406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:10.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.342+0000 7f824b7fe640 1 -- 172.21.15.19:0/1390589434 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5507+0+0 (secure 0 0 0) 0x7f824c08a230 con 0x7f825406cac0 2024-09-12T02:01:10.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.343+0000 7f82527fc640 1 --2- 172.21.15.19:0/1390589434 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f823406be30 0x7f823406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:10.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.343+0000 7f82527fc640 1 --2- 172.21.15.19:0/1390589434 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f823406be30 0x7f823406e2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f823c009af0 tx=0x7f823c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:10.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.346+0000 7f824b7fe640 1 -- 172.21.15.19:0/1390589434 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f824c058d30 con 0x7f825406cac0 2024-09-12T02:01:10.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.523+0000 7f82596d2640 1 -- 172.21.15.19:0/1390589434 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f825406e820 con 0x7f825406cac0 2024-09-12T02:01:10.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.524+0000 7f824b7fe640 1 -- 172.21.15.19:0/1390589434 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f824c058630 con 0x7f825406cac0 2024-09-12T02:01:10.524 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-09-12T02:01:10.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.526+0000 7f82596d2640 1 -- 172.21.15.19:0/1390589434 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f823406be30 msgr2=0x7f823406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:10.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.526+0000 7f82596d2640 1 --2- 172.21.15.19:0/1390589434 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f823406be30 0x7f823406e2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f823c009af0 tx=0x7f823c008040 comp rx=0 tx=0).stop 2024-09-12T02:01:10.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.526+0000 7f82596d2640 1 -- 172.21.15.19:0/1390589434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f825406cac0 msgr2=0x7f82540c6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:10.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.526+0000 7f82596d2640 1 --2- 172.21.15.19:0/1390589434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f825406cac0 0x7f82540c6f50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f824c00c400 tx=0x7f824c00c8c0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.526+0000 7f82596d2640 1 -- 172.21.15.19:0/1390589434 shutdown_connections 2024-09-12T02:01:10.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.526+0000 7f82596d2640 1 --2- 172.21.15.19:0/1390589434 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f823406be30 0x7f823406e2f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.526+0000 7f82596d2640 1 --2- 172.21.15.19:0/1390589434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8254161e60 0x7f8254158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.526+0000 7f82596d2640 1 --2- 172.21.15.19:0/1390589434 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540b3220 0x7f82540b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.526+0000 7f82596d2640 1 --2- 172.21.15.19:0/1390589434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f825406cac0 0x7f82540c6f50 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.526+0000 7f82596d2640 1 -- 172.21.15.19:0/1390589434 >> 172.21.15.19:0/1390589434 conn(0x7f82540b3de0 msgr2=0x7f825409aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:10.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.526+0000 7f82596d2640 1 -- 172.21.15.19:0/1390589434 shutdown_connections 2024-09-12T02:01:10.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.526+0000 7f82596d2640 1 -- 172.21.15.19:0/1390589434 wait complete. 2024-09-12T02:01:10.537 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_preflush' 2024-09-12T02:01:10.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.642+0000 7fa70abb9640 1 Processor -- start 2024-09-12T02:01:10.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.642+0000 7fa70abb9640 1 -- start start 2024-09-12T02:01:10.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.643+0000 7fa70abb9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa70415e5f0 0x7fa7040d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:10.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.643+0000 7fa70abb9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7040d30f0 0x7fa7040b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:10.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.643+0000 7fa70abb9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7040d3690 con 0x7fa7040b64c0 2024-09-12T02:01:10.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.643+0000 7fa70abb9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa70406d530 con 0x7fa7040d30f0 2024-09-12T02:01:10.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.643+0000 7fa70abb9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa7040d3970 con 0x7fa70415e5f0 2024-09-12T02:01:10.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.643+0000 7fa703fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7040d30f0 0x7fa7040b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:10.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.643+0000 7fa703fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7040d30f0 0x7fa7040b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34758/0 (socket says 172.21.15.19:34758) 2024-09-12T02:01:10.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.643+0000 7fa703fff640 1 -- 172.21.15.19:0/1472207760 learned_addr learned my addr 172.21.15.19:0/1472207760 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:10.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.643+0000 7fa708955640 1 --2- 172.21.15.19:0/1472207760 >> v2:172.21.15.135:3300/0 conn(0x7fa70415e5f0 0x7fa7040d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:10.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.644+0000 7fa703fff640 1 -- 172.21.15.19:0/1472207760 >> v2:172.21.15.135:3300/0 conn(0x7fa70415e5f0 msgr2=0x7fa7040d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:10.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.644+0000 7fa703fff640 1 --2- 172.21.15.19:0/1472207760 >> v2:172.21.15.135:3300/0 conn(0x7fa70415e5f0 0x7fa7040d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.644+0000 7fa703fff640 1 -- 172.21.15.19:0/1472207760 >> v1:172.21.15.135:6789/0 conn(0x7fa7040b64c0 legacy=0x7fa7040cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:10.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.644+0000 7fa703fff640 1 -- 172.21.15.19:0/1472207760 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa70406cee0 con 0x7fa7040d30f0 2024-09-12T02:01:10.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.644+0000 7fa703fff640 1 --2- 172.21.15.19:0/1472207760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040d30f0 0x7fa7040b5f80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa7040d1f90 tx=0x7fa6ec02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3631b68d1ac9a6a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:10.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.644+0000 7fa7037fe640 1 -- 172.21.15.19:0/1472207760 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec036070 con 0x7fa7040d30f0 2024-09-12T02:01:10.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.645+0000 7fa7037fe640 1 -- 172.21.15.19:0/1472207760 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6ec031600 con 0x7fa7040d30f0 2024-09-12T02:01:10.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.645+0000 7fa7037fe640 1 -- 172.21.15.19:0/1472207760 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec0319d0 con 0x7fa7040d30f0 2024-09-12T02:01:10.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.645+0000 7fa70abb9640 1 -- 172.21.15.19:0/1472207760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040d30f0 msgr2=0x7fa7040b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:10.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.645+0000 7fa70abb9640 1 --2- 172.21.15.19:0/1472207760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040d30f0 0x7fa7040b5f80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa7040d1f90 tx=0x7fa6ec02a730 comp rx=0 tx=0).stop 2024-09-12T02:01:10.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.645+0000 7fa70abb9640 1 -- 172.21.15.19:0/1472207760 shutdown_connections 2024-09-12T02:01:10.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.645+0000 7fa70abb9640 1 --2- 172.21.15.19:0/1472207760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040d30f0 0x7fa7040b5f80 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.645+0000 7fa70abb9640 1 --2- 172.21.15.19:0/1472207760 >> v2:172.21.15.135:3300/0 conn(0x7fa70415e5f0 0x7fa7040d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.645+0000 7fa70abb9640 1 -- 172.21.15.19:0/1472207760 >> 172.21.15.19:0/1472207760 conn(0x7fa70408bfc0 msgr2=0x7fa7040d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:10.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.645+0000 7fa70abb9640 1 -- 172.21.15.19:0/1472207760 shutdown_connections 2024-09-12T02:01:10.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.645+0000 7fa70abb9640 1 -- 172.21.15.19:0/1472207760 wait complete. 2024-09-12T02:01:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.646+0000 7fa70abb9640 1 Processor -- start 2024-09-12T02:01:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.646+0000 7fa70abb9640 1 -- start start 2024-09-12T02:01:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.647+0000 7fa70abb9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7040b64c0 0x7fa70409eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.647+0000 7fa70abb9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040d30f0 0x7fa7040a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.647+0000 7fa70abb9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa70415e5f0 0x7fa704154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.647+0000 7fa70abb9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa7040d5310 con 0x7fa7040d30f0 2024-09-12T02:01:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.647+0000 7fa70abb9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa70415e9d0 con 0x7fa7040b64c0 2024-09-12T02:01:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.647+0000 7fa70abb9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa70406e9d0 con 0x7fa70415e5f0 2024-09-12T02:01:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.647+0000 7fa703fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040d30f0 0x7fa7040a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.647+0000 7fa703fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040d30f0 0x7fa7040a1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34764/0 (socket says 172.21.15.19:34764) 2024-09-12T02:01:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.647+0000 7fa703fff640 1 -- 172.21.15.19:0/2741853290 learned_addr learned my addr 172.21.15.19:0/2741853290 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.647+0000 7fa708955640 1 --2- 172.21.15.19:0/2741853290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7040b64c0 0x7fa70409eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:10.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.647+0000 7fa709156640 1 --2- 172.21.15.19:0/2741853290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa70415e5f0 0x7fa704154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:10.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.648+0000 7fa703fff640 1 -- 172.21.15.19:0/2741853290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa70415e5f0 msgr2=0x7fa704154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:10.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.648+0000 7fa703fff640 1 --2- 172.21.15.19:0/2741853290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa70415e5f0 0x7fa704154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.648+0000 7fa703fff640 1 -- 172.21.15.19:0/2741853290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7040b64c0 msgr2=0x7fa70409eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:10.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.648+0000 7fa703fff640 1 --2- 172.21.15.19:0/2741853290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7040b64c0 0x7fa70409eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.648+0000 7fa703fff640 1 -- 172.21.15.19:0/2741853290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7041f4620 con 0x7fa7040d30f0 2024-09-12T02:01:10.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.648+0000 7fa703fff640 1 --2- 172.21.15.19:0/2741853290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040d30f0 0x7fa7040a1bc0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec034040 tx=0x7fa6ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:10.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.648+0000 7fa7017fa640 1 -- 172.21.15.19:0/2741853290 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec03f020 con 0x7fa7040d30f0 2024-09-12T02:01:10.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.648+0000 7fa7017fa640 1 -- 172.21.15.19:0/2741853290 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6ec037040 con 0x7fa7040d30f0 2024-09-12T02:01:10.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.648+0000 7fa70abb9640 1 -- 172.21.15.19:0/2741853290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa70409f280 con 0x7fa7040d30f0 2024-09-12T02:01:10.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.648+0000 7fa7017fa640 1 -- 172.21.15.19:0/2741853290 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec036070 con 0x7fa7040d30f0 2024-09-12T02:01:10.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.648+0000 7fa70abb9640 1 -- 172.21.15.19:0/2741853290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa704160490 con 0x7fa7040d30f0 2024-09-12T02:01:10.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.649+0000 7fa70abb9640 1 -- 172.21.15.19:0/2741853290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7040b5f80 con 0x7fa7040d30f0 2024-09-12T02:01:10.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.649+0000 7fa7017fa640 1 -- 172.21.15.19:0/2741853290 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa6ec042020 con 0x7fa7040d30f0 2024-09-12T02:01:10.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.650+0000 7fa7017fa640 1 --2- 172.21.15.19:0/2741853290 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6e406be30 0x7fa6e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:10.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.650+0000 7fa7017fa640 1 -- 172.21.15.19:0/2741853290 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5507+0+0 (secure 0 0 0) 0x7fa6ec0ab070 con 0x7fa7040d30f0 2024-09-12T02:01:10.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.650+0000 7fa708955640 1 --2- 172.21.15.19:0/2741853290 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6e406be30 0x7fa6e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:10.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.651+0000 7fa708955640 1 --2- 172.21.15.19:0/2741853290 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6e406be30 0x7fa6e406e2f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa7041600f0 tx=0x7fa6f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:10.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.655+0000 7fa7017fa640 1 -- 172.21.15.19:0/2741853290 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6ec049030 con 0x7fa7040d30f0 2024-09-12T02:01:10.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.896+0000 7fa70abb9640 1 -- 172.21.15.19:0/2741853290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_preflush"]} v 0) -- 0x7fa7040d1d00 con 0x7fa7040d30f0 2024-09-12T02:01:10.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.910+0000 7fa7017fa640 1 -- 172.21.15.19:0/2741853290 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_preflush"]}]=0 v252) ==== 144+0+0 (secure 0 0 0) 0x7fa6ec007c70 con 0x7fa7040d30f0 2024-09-12T02:01:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.912+0000 7fa70abb9640 1 -- 172.21.15.19:0/2741853290 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6e406be30 msgr2=0x7fa6e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.912+0000 7fa70abb9640 1 --2- 172.21.15.19:0/2741853290 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6e406be30 0x7fa6e406e2f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa7041600f0 tx=0x7fa6f4008040 comp rx=0 tx=0).stop 2024-09-12T02:01:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.912+0000 7fa70abb9640 1 -- 172.21.15.19:0/2741853290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040d30f0 msgr2=0x7fa7040a1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.912+0000 7fa70abb9640 1 --2- 172.21.15.19:0/2741853290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040d30f0 0x7fa7040a1bc0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec034040 tx=0x7fa6ec004a40 comp rx=0 tx=0).stop 2024-09-12T02:01:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.912+0000 7fa70abb9640 1 -- 172.21.15.19:0/2741853290 shutdown_connections 2024-09-12T02:01:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.912+0000 7fa70abb9640 1 --2- 172.21.15.19:0/2741853290 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6e406be30 0x7fa6e406e2f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.912+0000 7fa70abb9640 1 --2- 172.21.15.19:0/2741853290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa70415e5f0 0x7fa704154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.912+0000 7fa70abb9640 1 --2- 172.21.15.19:0/2741853290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040d30f0 0x7fa7040a1bc0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.912+0000 7fa70abb9640 1 --2- 172.21.15.19:0/2741853290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7040b64c0 0x7fa70409eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.912+0000 7fa70abb9640 1 -- 172.21.15.19:0/2741853290 >> 172.21.15.19:0/2741853290 conn(0x7fa70408bfc0 msgr2=0x7fa7040d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:10.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.912+0000 7fa70abb9640 1 -- 172.21.15.19:0/2741853290 shutdown_connections 2024-09-12T02:01:10.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:10.912+0000 7fa70abb9640 1 -- 172.21.15.19:0/2741853290 wait complete. 2024-09-12T02:01:10.925 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:01:11.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.029+0000 7ff458b96640 1 Processor -- start 2024-09-12T02:01:11.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.029+0000 7ff458b96640 1 -- start start 2024-09-12T02:01:11.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.030+0000 7ff458b96640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff454161a20 0x7ff4540d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.030+0000 7ff458b96640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4540cf980 con 0x7ff4540d1420 2024-09-12T02:01:11.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.030+0000 7ff458b96640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff45406d050 con 0x7ff4540cf330 2024-09-12T02:01:11.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.030+0000 7ff458b96640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff454161e00 con 0x7ff454161a20 2024-09-12T02:01:11.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff451d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff4540d1420 0x7ff4540cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59014/0 (socket says 172.21.15.19:59014) 2024-09-12T02:01:11.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff451d9b640 1 -- 172.21.15.19:0/3974926309 learned_addr learned my addr 172.21.15.19:0/3974926309 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:11.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff45259c640 1 --2- 172.21.15.19:0/3974926309 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff454161a20 0x7ff4540d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff45159a640 1 -- 172.21.15.19:0/3974926309 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4009340205 0 0) 0x7ff4540cf980 con 0x7ff4540d1420 2024-09-12T02:01:11.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff45159a640 1 -- 172.21.15.19:0/3974926309 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff440003520 con 0x7ff4540d1420 2024-09-12T02:01:11.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff45159a640 1 -- 172.21.15.19:0/3974926309 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2392070638 0 0) 0x7ff440003520 con 0x7ff4540d1420 2024-09-12T02:01:11.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff45159a640 1 -- 172.21.15.19:0/3974926309 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff454161a20 msgr2=0x7ff4540d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:11.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff45159a640 1 --2- 172.21.15.19:0/3974926309 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff454161a20 0x7ff4540d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff45159a640 1 -- 172.21.15.19:0/3974926309 >> v1:172.21.15.135:6789/0 conn(0x7ff4540cf330 legacy=0x7ff45406d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff45159a640 1 -- 172.21.15.19:0/3974926309 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4540d1800 con 0x7ff4540d1420 2024-09-12T02:01:11.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff45159a640 1 -- 172.21.15.19:0/3974926309 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7ff43c001670 con 0x7ff4540d1420 2024-09-12T02:01:11.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff45159a640 1 -- 172.21.15.19:0/3974926309 >> v1:172.21.15.19:6789/0 conn(0x7ff4540d1420 legacy=0x7ff4540cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff45159a640 1 --2- 172.21.15.19:0/3974926309 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff454161a20 0x7ff4400039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff45159a640 1 --2- 172.21.15.19:0/3974926309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff440003f60 0x7ff440004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff45159a640 1 --2- 172.21.15.19:0/3974926309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff440004d40 0x7ff4400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff45159a640 1 -- 172.21.15.19:0/3974926309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff454161e00 con 0x7ff440003f60 2024-09-12T02:01:11.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff45159a640 1 -- 172.21.15.19:0/3974926309 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff44000baa0 con 0x7ff440004d40 2024-09-12T02:01:11.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff45159a640 1 -- 172.21.15.19:0/3974926309 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff44000bca0 con 0x7ff454161a20 2024-09-12T02:01:11.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff451d9b640 1 --2- 172.21.15.19:0/3974926309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff440003f60 0x7ff440004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff45259c640 1 --2- 172.21.15.19:0/3974926309 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff454161a20 0x7ff4400039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.031+0000 7ff452d9d640 1 --2- 172.21.15.19:0/3974926309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff440004d40 0x7ff4400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.032+0000 7ff451d9b640 1 -- 172.21.15.19:0/3974926309 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff454161a20 msgr2=0x7ff4400039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:11.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.032+0000 7ff451d9b640 1 --2- 172.21.15.19:0/3974926309 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff454161a20 0x7ff4400039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.032+0000 7ff451d9b640 1 -- 172.21.15.19:0/3974926309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff440004d40 msgr2=0x7ff4400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.032+0000 7ff451d9b640 1 --2- 172.21.15.19:0/3974926309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff440004d40 0x7ff4400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.032+0000 7ff451d9b640 1 -- 172.21.15.19:0/3974926309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff440003520 con 0x7ff440003f60 2024-09-12T02:01:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.032+0000 7ff451d9b640 1 --2- 172.21.15.19:0/3974926309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff440003f60 0x7ff440004800 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ff43c00c210 tx=0x7ff440005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f62994b46f2b6a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.032+0000 7ff45159a640 1 -- 172.21.15.19:0/3974926309 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c007d30 con 0x7ff440003f60 2024-09-12T02:01:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.032+0000 7ff45159a640 1 -- 172.21.15.19:0/3974926309 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff43c005ad0 con 0x7ff440003f60 2024-09-12T02:01:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.033+0000 7ff45159a640 1 -- 172.21.15.19:0/3974926309 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c007070 con 0x7ff440003f60 2024-09-12T02:01:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.033+0000 7ff458b96640 1 -- 172.21.15.19:0/3974926309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff440003f60 msgr2=0x7ff440004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.033+0000 7ff458b96640 1 --2- 172.21.15.19:0/3974926309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff440003f60 0x7ff440004800 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ff43c00c210 tx=0x7ff440005830 comp rx=0 tx=0).stop 2024-09-12T02:01:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.033+0000 7ff452d9d640 1 -- 172.21.15.19:0/3974926309 reap_dead start 2024-09-12T02:01:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.033+0000 7ff458b96640 1 -- 172.21.15.19:0/3974926309 shutdown_connections 2024-09-12T02:01:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.033+0000 7ff458b96640 1 -- 172.21.15.19:0/3974926309 >> 172.21.15.19:0/3974926309 conn(0x7ff45409d850 msgr2=0x7ff45408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:11.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.033+0000 7ff458b96640 1 -- 172.21.15.19:0/3974926309 shutdown_connections 2024-09-12T02:01:11.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.033+0000 7ff458b96640 1 -- 172.21.15.19:0/3974926309 wait complete. 2024-09-12T02:01:11.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.035+0000 7ff458b96640 1 Processor -- start 2024-09-12T02:01:11.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.035+0000 7ff458b96640 1 -- start start 2024-09-12T02:01:11.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.035+0000 7ff458b96640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff440003f60 0x7ff454149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.035+0000 7ff458b96640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4541f34e0 0x7ff4541f3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.035+0000 7ff458b96640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4541f3ea0 0x7ff45414bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.035+0000 7ff458b96640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff45406d2f0 con 0x7ff440003f60 2024-09-12T02:01:11.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.035+0000 7ff458b96640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff4540cff00 con 0x7ff4541f34e0 2024-09-12T02:01:11.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.035+0000 7ff458b96640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff4540b1040 con 0x7ff4541f3ea0 2024-09-12T02:01:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.035+0000 7ff45259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff440003f60 0x7ff454149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.036+0000 7ff45259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff440003f60 0x7ff454149240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34776/0 (socket says 172.21.15.19:34776) 2024-09-12T02:01:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.036+0000 7ff45259c640 1 -- 172.21.15.19:0/266764609 learned_addr learned my addr 172.21.15.19:0/266764609 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.036+0000 7ff451d9b640 1 --2- 172.21.15.19:0/266764609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4541f34e0 0x7ff4541f3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.036+0000 7ff452d9d640 1 --2- 172.21.15.19:0/266764609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4541f3ea0 0x7ff45414bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.036+0000 7ff45259c640 1 -- 172.21.15.19:0/266764609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4541f3ea0 msgr2=0x7ff45414bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.036+0000 7ff45259c640 1 --2- 172.21.15.19:0/266764609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4541f3ea0 0x7ff45414bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.036+0000 7ff45259c640 1 -- 172.21.15.19:0/266764609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4541f34e0 msgr2=0x7ff4541f3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.036+0000 7ff45259c640 1 --2- 172.21.15.19:0/266764609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4541f34e0 0x7ff4541f3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.036+0000 7ff45259c640 1 -- 172.21.15.19:0/266764609 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4540c9630 con 0x7ff440003f60 2024-09-12T02:01:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.036+0000 7ff452d9d640 1 --2- 172.21.15.19:0/266764609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4541f3ea0 0x7ff45414bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.036+0000 7ff451d9b640 1 --2- 172.21.15.19:0/266764609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4541f34e0 0x7ff4541f3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.036+0000 7ff45259c640 1 --2- 172.21.15.19:0/266764609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff440003f60 0x7ff454149240 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ff444011e30 tx=0x7ff44400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.036+0000 7ff44affd640 1 -- 172.21.15.19:0/266764609 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff444015630 con 0x7ff440003f60 2024-09-12T02:01:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.036+0000 7ff44affd640 1 -- 172.21.15.19:0/266764609 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4440157d0 con 0x7ff440003f60 2024-09-12T02:01:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.036+0000 7ff44affd640 1 -- 172.21.15.19:0/266764609 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff444015ba0 con 0x7ff440003f60 2024-09-12T02:01:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.036+0000 7ff458b96640 1 -- 172.21.15.19:0/266764609 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4540c9910 con 0x7ff440003f60 2024-09-12T02:01:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.036+0000 7ff458b96640 1 -- 172.21.15.19:0/266764609 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff454149780 con 0x7ff440003f60 2024-09-12T02:01:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.037+0000 7ff458b96640 1 -- 172.21.15.19:0/266764609 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4540d0ee0 con 0x7ff440003f60 2024-09-12T02:01:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.038+0000 7ff44affd640 1 -- 172.21.15.19:0/266764609 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff44401d400 con 0x7ff440003f60 2024-09-12T02:01:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.038+0000 7ff44affd640 1 --2- 172.21.15.19:0/266764609 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff43406be60 0x7ff43406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.038+0000 7ff44affd640 1 -- 172.21.15.19:0/266764609 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5507+0+0 (secure 0 0 0) 0x7ff44408be60 con 0x7ff440003f60 2024-09-12T02:01:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.038+0000 7ff451d9b640 1 --2- 172.21.15.19:0/266764609 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff43406be60 0x7ff43406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.039+0000 7ff451d9b640 1 --2- 172.21.15.19:0/266764609 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff43406be60 0x7ff43406e320 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff43c033000 tx=0x7ff43c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:11.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.042+0000 7ff44affd640 1 -- 172.21.15.19:0/266764609 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff444019030 con 0x7ff440003f60 2024-09-12T02:01:11.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.222+0000 7ff458b96640 1 -- 172.21.15.19:0/266764609 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff45406e940 con 0x7ff440003f60 2024-09-12T02:01:11.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.225+0000 7ff44affd640 1 -- 172.21.15.19:0/266764609 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7ff444010040 con 0x7ff440003f60 2024-09-12T02:01:11.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.227+0000 7ff458b96640 1 -- 172.21.15.19:0/266764609 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff43406be60 msgr2=0x7ff43406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.227+0000 7ff458b96640 1 --2- 172.21.15.19:0/266764609 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff43406be60 0x7ff43406e320 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff43c033000 tx=0x7ff43c02e000 comp rx=0 tx=0).stop 2024-09-12T02:01:11.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.227+0000 7ff458b96640 1 -- 172.21.15.19:0/266764609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff440003f60 msgr2=0x7ff454149240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.227+0000 7ff458b96640 1 --2- 172.21.15.19:0/266764609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff440003f60 0x7ff454149240 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ff444011e30 tx=0x7ff44400f580 comp rx=0 tx=0).stop 2024-09-12T02:01:11.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.227+0000 7ff458b96640 1 -- 172.21.15.19:0/266764609 shutdown_connections 2024-09-12T02:01:11.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.227+0000 7ff458b96640 1 --2- 172.21.15.19:0/266764609 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff43406be60 0x7ff43406e320 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.227+0000 7ff458b96640 1 --2- 172.21.15.19:0/266764609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4541f3ea0 0x7ff45414bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.227+0000 7ff458b96640 1 --2- 172.21.15.19:0/266764609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4541f34e0 0x7ff4541f3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.227+0000 7ff458b96640 1 --2- 172.21.15.19:0/266764609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff440003f60 0x7ff454149240 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.227+0000 7ff458b96640 1 -- 172.21.15.19:0/266764609 >> 172.21.15.19:0/266764609 conn(0x7ff45409d850 msgr2=0x7ff4540d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:11.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.227+0000 7ff458b96640 1 -- 172.21.15.19:0/266764609 shutdown_connections 2024-09-12T02:01:11.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.227+0000 7ff458b96640 1 -- 172.21.15.19:0/266764609 wait complete. 2024-09-12T02:01:11.239 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:01:11.239 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:01:11.285 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:01:11.335 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:01:11.335 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:01:11.336 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:01:11.352 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:01:11.352 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T02:01:11.353 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:01:11.371 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:01:11.371 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:01:11.371 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:01:11.408 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:01:11.408 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T02:01:11.408 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:01:11.428 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:01:11.428 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:01:11.429 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:11.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.550+0000 7faa20ea6640 1 Processor -- start 2024-09-12T02:01:11.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.550+0000 7faa20ea6640 1 -- start start 2024-09-12T02:01:11.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.551+0000 7faa20ea6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faa1c161c80 0x7faa1c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.551+0000 7faa20ea6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faa1c0b6680 0x7faa1c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.551+0000 7faa20ea6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa1c06e870 con 0x7faa1c162060 2024-09-12T02:01:11.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.551+0000 7faa20ea6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7faa1c06d9f0 con 0x7faa1c161c80 2024-09-12T02:01:11.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.551+0000 7faa20ea6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7faa1c06dcd0 con 0x7faa1c0b6680 2024-09-12T02:01:11.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.551+0000 7faa1a59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faa1c161c80 0x7faa1c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.551+0000 7faa1a59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faa1c161c80 0x7faa1c06e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54834/0 (socket says 172.21.15.19:54834) 2024-09-12T02:01:11.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.551+0000 7faa1a59c640 1 -- 172.21.15.19:0/1966439244 learned_addr learned my addr 172.21.15.19:0/1966439244 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:11.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.551+0000 7faa1ad9d640 1 --2- 172.21.15.19:0/1966439244 >> v2:172.21.15.135:3300/0 conn(0x7faa1c0b6680 0x7faa1c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.551+0000 7faa1a59c640 1 -- 172.21.15.19:0/1966439244 >> v2:172.21.15.135:3300/0 conn(0x7faa1c0b6680 msgr2=0x7faa1c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:11.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.551+0000 7faa1a59c640 1 --2- 172.21.15.19:0/1966439244 >> v2:172.21.15.135:3300/0 conn(0x7faa1c0b6680 0x7faa1c0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.551+0000 7faa1a59c640 1 -- 172.21.15.19:0/1966439244 >> v1:172.21.15.135:6789/0 conn(0x7faa1c162060 legacy=0x7faa1c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:11.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.551+0000 7faa1a59c640 1 -- 172.21.15.19:0/1966439244 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1c06dfb0 con 0x7faa1c161c80 2024-09-12T02:01:11.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.551+0000 7faa1ad9d640 1 --2- 172.21.15.19:0/1966439244 >> v2:172.21.15.135:3300/0 conn(0x7faa1c0b6680 0x7faa1c0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:11.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.552+0000 7faa1a59c640 1 --2- 172.21.15.19:0/1966439244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa1c161c80 0x7faa1c06e330 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7faa1c08d750 tx=0x7faa0c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a95bae60dfda66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:11.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.552+0000 7faa1959a640 1 -- 172.21.15.19:0/1966439244 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c037070 con 0x7faa1c161c80 2024-09-12T02:01:11.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.552+0000 7faa1959a640 1 -- 172.21.15.19:0/1966439244 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa0c032440 con 0x7faa1c161c80 2024-09-12T02:01:11.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.552+0000 7faa1959a640 1 -- 172.21.15.19:0/1966439244 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c032810 con 0x7faa1c161c80 2024-09-12T02:01:11.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.553+0000 7faa20ea6640 1 -- 172.21.15.19:0/1966439244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa1c161c80 msgr2=0x7faa1c06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.553+0000 7faa20ea6640 1 --2- 172.21.15.19:0/1966439244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa1c161c80 0x7faa1c06e330 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7faa1c08d750 tx=0x7faa0c02a230 comp rx=0 tx=0).stop 2024-09-12T02:01:11.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.553+0000 7faa20ea6640 1 -- 172.21.15.19:0/1966439244 shutdown_connections 2024-09-12T02:01:11.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.553+0000 7faa20ea6640 1 --2- 172.21.15.19:0/1966439244 >> v2:172.21.15.135:3300/0 conn(0x7faa1c0b6680 0x7faa1c0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.553+0000 7faa20ea6640 1 --2- 172.21.15.19:0/1966439244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa1c161c80 0x7faa1c06e330 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.553+0000 7faa20ea6640 1 -- 172.21.15.19:0/1966439244 >> 172.21.15.19:0/1966439244 conn(0x7faa1c0d44f0 msgr2=0x7faa1c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:11.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.553+0000 7faa20ea6640 1 -- 172.21.15.19:0/1966439244 shutdown_connections 2024-09-12T02:01:11.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.553+0000 7faa20ea6640 1 -- 172.21.15.19:0/1966439244 wait complete. 2024-09-12T02:01:11.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.554+0000 7faa20ea6640 1 Processor -- start 2024-09-12T02:01:11.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.554+0000 7faa20ea6640 1 -- start start 2024-09-12T02:01:11.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.555+0000 7faa20ea6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa1c0b6680 0x7faa1c160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.555+0000 7faa20ea6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa1c161c80 0x7faa1c0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.555+0000 7faa20ea6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa1c162060 0x7faa1c1543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.555+0000 7faa20ea6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c0b6b30 con 0x7faa1c162060 2024-09-12T02:01:11.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.555+0000 7faa20ea6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c0d2aa0 con 0x7faa1c0b6680 2024-09-12T02:01:11.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.555+0000 7faa20ea6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7faa1c0b6cb0 con 0x7faa1c161c80 2024-09-12T02:01:11.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.555+0000 7faa1ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa1c162060 0x7faa1c1543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.555+0000 7faa1ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa1c162060 0x7faa1c1543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54848/0 (socket says 172.21.15.19:54848) 2024-09-12T02:01:11.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.555+0000 7faa1ad9d640 1 -- 172.21.15.19:0/489452361 learned_addr learned my addr 172.21.15.19:0/489452361 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:11.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.555+0000 7faa1a59c640 1 --2- 172.21.15.19:0/489452361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa1c0b6680 0x7faa1c160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.555+0000 7faa19d9b640 1 --2- 172.21.15.19:0/489452361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa1c161c80 0x7faa1c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.556+0000 7faa1ad9d640 1 -- 172.21.15.19:0/489452361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa1c161c80 msgr2=0x7faa1c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.556+0000 7faa1ad9d640 1 --2- 172.21.15.19:0/489452361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa1c161c80 0x7faa1c0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.556+0000 7faa1ad9d640 1 -- 172.21.15.19:0/489452361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa1c0b6680 msgr2=0x7faa1c160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.556+0000 7faa1ad9d640 1 --2- 172.21.15.19:0/489452361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa1c0b6680 0x7faa1c160800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.556+0000 7faa1ad9d640 1 -- 172.21.15.19:0/489452361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1c0b9e50 con 0x7faa1c162060 2024-09-12T02:01:11.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.556+0000 7faa1ad9d640 1 --2- 172.21.15.19:0/489452361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa1c162060 0x7faa1c1543f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7faa1400cd80 tx=0x7faa1400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:11.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.556+0000 7faa0affd640 1 -- 172.21.15.19:0/489452361 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1400f680 con 0x7faa1c162060 2024-09-12T02:01:11.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.556+0000 7faa0affd640 1 -- 172.21.15.19:0/489452361 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1400f840 con 0x7faa1c162060 2024-09-12T02:01:11.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.556+0000 7faa0affd640 1 -- 172.21.15.19:0/489452361 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1400fc30 con 0x7faa1c162060 2024-09-12T02:01:11.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.556+0000 7faa20ea6640 1 -- 172.21.15.19:0/489452361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa1c0ba130 con 0x7faa1c162060 2024-09-12T02:01:11.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.556+0000 7faa20ea6640 1 -- 172.21.15.19:0/489452361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa1c0c7f80 con 0x7faa1c162060 2024-09-12T02:01:11.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.557+0000 7faa20ea6640 1 -- 172.21.15.19:0/489452361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa1c0c8470 con 0x7faa1c162060 2024-09-12T02:01:11.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.558+0000 7faa0affd640 1 -- 172.21.15.19:0/489452361 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa140213f0 con 0x7faa1c162060 2024-09-12T02:01:11.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.558+0000 7faa0affd640 1 --2- 172.21.15.19:0/489452361 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa9fc06be30 0x7fa9fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.558+0000 7faa0affd640 1 -- 172.21.15.19:0/489452361 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5507+0+0 (secure 0 0 0) 0x7faa1408ba40 con 0x7faa1c162060 2024-09-12T02:01:11.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.558+0000 7faa1a59c640 1 --2- 172.21.15.19:0/489452361 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa9fc06be30 0x7fa9fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.559+0000 7faa1a59c640 1 --2- 172.21.15.19:0/489452361 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa9fc06be30 0x7fa9fc06e2f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faa0c034000 tx=0x7faa0c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:11.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.562+0000 7faa0affd640 1 -- 172.21.15.19:0/489452361 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faa14014030 con 0x7faa1c162060 2024-09-12T02:01:11.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.777+0000 7faa20ea6640 1 -- 172.21.15.19:0/489452361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa1c0cb100 con 0x7faa1c162060 2024-09-12T02:01:11.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.778+0000 7faa0affd640 1 -- 172.21.15.19:0/489452361 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+3914 (secure 0 0 0) 0x7faa1408be20 con 0x7faa1c162060 2024-09-12T02:01:11.778 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:11.778 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":57,"btime":"2024-09-12T02:01:06:813890+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2176310149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2176310149},{"type":"v1","addr":"172.21.15.135:6836","nonce":2176310149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/222313950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":222313950},{"type":"v1","addr":"172.21.15.135:6837","nonce":222313950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1314663735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1314663735},{"type":"v1","addr":"172.21.15.19:6835","nonce":1314663735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":53},{"gid":6396,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/1116615963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1116615963},{"type":"v1","addr":"172.21.15.19:6834","nonce":1116615963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[]} 2024-09-12T02:01:11.779 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 57 2024-09-12T02:01:11.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.780+0000 7faa20ea6640 1 -- 172.21.15.19:0/489452361 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa9fc06be30 msgr2=0x7fa9fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.780+0000 7faa20ea6640 1 --2- 172.21.15.19:0/489452361 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa9fc06be30 0x7fa9fc06e2f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faa0c034000 tx=0x7faa0c02e000 comp rx=0 tx=0).stop 2024-09-12T02:01:11.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.780+0000 7faa20ea6640 1 -- 172.21.15.19:0/489452361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa1c162060 msgr2=0x7faa1c1543f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.780+0000 7faa20ea6640 1 --2- 172.21.15.19:0/489452361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa1c162060 0x7faa1c1543f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7faa1400cd80 tx=0x7faa1400a650 comp rx=0 tx=0).stop 2024-09-12T02:01:11.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.780+0000 7faa20ea6640 1 -- 172.21.15.19:0/489452361 shutdown_connections 2024-09-12T02:01:11.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.780+0000 7faa20ea6640 1 --2- 172.21.15.19:0/489452361 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa9fc06be30 0x7fa9fc06e2f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.780+0000 7faa20ea6640 1 --2- 172.21.15.19:0/489452361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa1c162060 0x7faa1c1543f0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.780+0000 7faa20ea6640 1 --2- 172.21.15.19:0/489452361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa1c161c80 0x7faa1c0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.780+0000 7faa20ea6640 1 --2- 172.21.15.19:0/489452361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa1c0b6680 0x7faa1c160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.780+0000 7faa20ea6640 1 -- 172.21.15.19:0/489452361 >> 172.21.15.19:0/489452361 conn(0x7faa1c0d44f0 msgr2=0x7faa1c0d2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:11.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.780+0000 7faa20ea6640 1 -- 172.21.15.19:0/489452361 shutdown_connections 2024-09-12T02:01:11.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.780+0000 7faa20ea6640 1 -- 172.21.15.19:0/489452361 wait complete. 2024-09-12T02:01:11.792 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:01:11.792 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:01:11.792 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:01:11.792 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:01:11.792 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:01:11.792 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:01:11.793 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:01:11.793 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:01:11.793 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:01:11.793 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:01:11.793 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:01:11.793 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:01:11.793 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:01:11.793 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:01:11.794 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:01:11.794 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:01:11.801 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:01:11.802 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:01:11.802 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:01:11.802 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:01:11.804 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:01:11.805 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:01:11.806 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:01:11.806 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:01:11.845 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:01:11.845 DEBUG:teuthology.parallel:result is None 2024-09-12T02:01:11.846 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:01:11.846 DEBUG:teuthology.parallel:result is None 2024-09-12T02:01:11.847 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:01:11.848 DEBUG:teuthology.parallel:result is None 2024-09-12T02:01:11.848 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:01:11.848 DEBUG:teuthology.parallel:result is None 2024-09-12T02:01:11.850 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:01:11.924 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-09-12T02:01:11.925 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:01:11.930 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2024-09-12T02:01:11.930 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T02:01:11.930 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:01:11.931+0000 7ff53cc59640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-12T02:01:11.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.958+0000 7f7f8ae1e640 1 Processor -- start 2024-09-12T02:01:11.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.958+0000 7f7f8ae1e640 1 -- start start 2024-09-12T02:01:11.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.958+0000 7f7f8ae1e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7f84162060 0x7f7f840b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.958+0000 7f7f8ae1e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f840b64b0 0x7f7f840b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.958+0000 7f7f8ae1e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f8406d9f0 con 0x7f7f84161c80 2024-09-12T02:01:11.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.958+0000 7f7f8ae1e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f7f8406dcd0 con 0x7f7f84162060 2024-09-12T02:01:11.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.958+0000 7f7f8ae1e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7f8406dfb0 con 0x7f7f840b64b0 2024-09-12T02:01:11.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.959+0000 7f7f893bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f840b64b0 0x7f7f840b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.959+0000 7f7f83fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7f84162060 0x7f7f840b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.959+0000 7f7f88bba640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f7f84161c80 0x7f7f8406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:38452/0 (socket says 172.21.15.19:38452) 2024-09-12T02:01:11.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.959+0000 7f7f88bba640 1 -- 172.21.15.19:0/3868091339 learned_addr learned my addr 172.21.15.19:0/3868091339 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:11.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.959+0000 7f7f837fe640 1 -- 172.21.15.19:0/3868091339 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2854491868 0 0) 0x7f7f8406d9f0 con 0x7f7f84161c80 2024-09-12T02:01:11.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.959+0000 7f7f893bb640 1 -- 172.21.15.19:0/3868091339 >> v2:172.21.15.135:3300/0 conn(0x7f7f84162060 msgr2=0x7f7f840b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:11.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.959+0000 7f7f893bb640 1 --2- 172.21.15.19:0/3868091339 >> v2:172.21.15.135:3300/0 conn(0x7f7f84162060 0x7f7f840b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.959+0000 7f7f893bb640 1 -- 172.21.15.19:0/3868091339 >> v1:172.21.15.135:6789/0 conn(0x7f7f84161c80 legacy=0x7f7f8406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.959+0000 7f7f893bb640 1 -- 172.21.15.19:0/3868091339 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f840d01f0 con 0x7f7f840b64b0 2024-09-12T02:01:11.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.960+0000 7f7f893bb640 1 --2- 172.21.15.19:0/3868091339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f840b64b0 0x7f7f840b6960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c0097a0 tx=0x7f7f7c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b389710eba9820b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:11.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.960+0000 7f7f837fe640 1 -- 172.21.15.19:0/3868091339 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c037070 con 0x7f7f840b64b0 2024-09-12T02:01:11.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.960+0000 7f7f837fe640 1 -- 172.21.15.19:0/3868091339 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f7c032440 con 0x7f7f840b64b0 2024-09-12T02:01:11.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.960+0000 7f7f837fe640 1 -- 172.21.15.19:0/3868091339 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c032810 con 0x7f7f840b64b0 2024-09-12T02:01:11.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.960+0000 7f7f8ae1e640 1 -- 172.21.15.19:0/3868091339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f840b64b0 msgr2=0x7f7f840b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.960+0000 7f7f8ae1e640 1 --2- 172.21.15.19:0/3868091339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f840b64b0 0x7f7f840b6960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c0097a0 tx=0x7f7f7c02a180 comp rx=0 tx=0).stop 2024-09-12T02:01:11.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.961+0000 7f7f8ae1e640 1 -- 172.21.15.19:0/3868091339 shutdown_connections 2024-09-12T02:01:11.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.961+0000 7f7f8ae1e640 1 --2- 172.21.15.19:0/3868091339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f840b64b0 0x7f7f840b6960 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.961+0000 7f7f8ae1e640 1 --2- 172.21.15.19:0/3868091339 >> v2:172.21.15.135:3300/0 conn(0x7f7f84162060 0x7f7f840b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.961+0000 7f7f8ae1e640 1 -- 172.21.15.19:0/3868091339 >> 172.21.15.19:0/3868091339 conn(0x7f7f840d44f0 msgr2=0x7f7f840d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:11.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.961+0000 7f7f8ae1e640 1 -- 172.21.15.19:0/3868091339 shutdown_connections 2024-09-12T02:01:11.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.961+0000 7f7f8ae1e640 1 -- 172.21.15.19:0/3868091339 wait complete. 2024-09-12T02:01:11.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.962+0000 7f7f8ae1e640 1 Processor -- start 2024-09-12T02:01:11.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.962+0000 7f7f8ae1e640 1 -- start start 2024-09-12T02:01:11.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.963+0000 7f7f8ae1e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f840b64b0 0x7f7f84159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.963+0000 7f7f8ae1e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f84161c80 0x7f7f840b8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.963+0000 7f7f8ae1e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f84162060 0x7f7f8415ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.963+0000 7f7f8ae1e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7f840cf360 con 0x7f7f84162060 2024-09-12T02:01:11.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.963+0000 7f7f8ae1e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7f840cf1e0 con 0x7f7f84161c80 2024-09-12T02:01:11.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.963+0000 7f7f8ae1e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7f840cf4e0 con 0x7f7f840b64b0 2024-09-12T02:01:11.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.963+0000 7f7f893bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f84162060 0x7f7f8415ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.963+0000 7f7f893bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f84162060 0x7f7f8415ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54902/0 (socket says 172.21.15.19:54902) 2024-09-12T02:01:11.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.963+0000 7f7f893bb640 1 -- 172.21.15.19:0/420209379 learned_addr learned my addr 172.21.15.19:0/420209379 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:11.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.963+0000 7f7f83fff640 1 --2- 172.21.15.19:0/420209379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f84161c80 0x7f7f840b8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.963+0000 7f7f88bba640 1 --2- 172.21.15.19:0/420209379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f840b64b0 0x7f7f84159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.963+0000 7f7f893bb640 1 -- 172.21.15.19:0/420209379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f840b64b0 msgr2=0x7f7f84159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.963+0000 7f7f893bb640 1 --2- 172.21.15.19:0/420209379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f840b64b0 0x7f7f84159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.963+0000 7f7f893bb640 1 -- 172.21.15.19:0/420209379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f84161c80 msgr2=0x7f7f840b8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.963+0000 7f7f893bb640 1 --2- 172.21.15.19:0/420209379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f84161c80 0x7f7f840b8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.963+0000 7f7f893bb640 1 -- 172.21.15.19:0/420209379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f840b7450 con 0x7f7f84162060 2024-09-12T02:01:11.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.963+0000 7f7f893bb640 1 --2- 172.21.15.19:0/420209379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f84162060 0x7f7f8415ea20 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c035040 tx=0x7f7f7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:11.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.963+0000 7f7f817fa640 1 -- 172.21.15.19:0/420209379 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c037050 con 0x7f7f84162060 2024-09-12T02:01:11.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.964+0000 7f7f8ae1e640 1 -- 172.21.15.19:0/420209379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f840b7730 con 0x7f7f84162060 2024-09-12T02:01:11.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.964+0000 7f7f817fa640 1 -- 172.21.15.19:0/420209379 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f7c038040 con 0x7f7f84162060 2024-09-12T02:01:11.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.964+0000 7f7f817fa640 1 -- 172.21.15.19:0/420209379 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c004450 con 0x7f7f84162060 2024-09-12T02:01:11.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.964+0000 7f7f8ae1e640 1 -- 172.21.15.19:0/420209379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f840b7cf0 con 0x7f7f84162060 2024-09-12T02:01:11.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.964+0000 7f7f8ae1e640 1 -- 172.21.15.19:0/420209379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f840b5f70 con 0x7f7f84162060 2024-09-12T02:01:11.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.965+0000 7f7f817fa640 1 -- 172.21.15.19:0/420209379 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f7c03c6d0 con 0x7f7f84162060 2024-09-12T02:01:11.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.965+0000 7f7f817fa640 1 --2- 172.21.15.19:0/420209379 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7f6406be30 0x7f7f6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.966+0000 7f7f817fa640 1 -- 172.21.15.19:0/420209379 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5507+0+0 (secure 0 0 0) 0x7f7f7c0ab6e0 con 0x7f7f84162060 2024-09-12T02:01:11.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.966+0000 7f7f88bba640 1 --2- 172.21.15.19:0/420209379 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7f6406be30 0x7f7f6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.966+0000 7f7f88bba640 1 --2- 172.21.15.19:0/420209379 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7f6406be30 0x7f7f6406e2f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c000f60 tx=0x7f7f6c007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:11.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:11.970+0000 7f7f817fa640 1 -- 172.21.15.19:0/420209379 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7f7c079a80 con 0x7f7f84162060 2024-09-12T02:01:12.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:12.156+0000 7f7f8ae1e640 1 -- 172.21.15.19:0/420209379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7f840ba470 con 0x7f7f84162060 2024-09-12T02:01:12.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:12.921+0000 7f7f817fa640 1 -- 172.21.15.19:0/420209379 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v75) ==== 97+0+0 (secure 0 0 0) 0x7f7f7c07dd80 con 0x7f7f84162060 2024-09-12T02:01:12.922 INFO:teuthology.orchestra.run.smithi019.stderr: removed all blocklist entries 2024-09-12T02:01:12.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:12.924+0000 7f7f8ae1e640 1 -- 172.21.15.19:0/420209379 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7f6406be30 msgr2=0x7f7f6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:12.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:12.924+0000 7f7f8ae1e640 1 --2- 172.21.15.19:0/420209379 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7f6406be30 0x7f7f6406e2f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c000f60 tx=0x7f7f6c007d50 comp rx=0 tx=0).stop 2024-09-12T02:01:12.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:12.924+0000 7f7f8ae1e640 1 -- 172.21.15.19:0/420209379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f84162060 msgr2=0x7f7f8415ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:12.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:12.924+0000 7f7f8ae1e640 1 --2- 172.21.15.19:0/420209379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f84162060 0x7f7f8415ea20 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c035040 tx=0x7f7f7c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:01:12.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:12.924+0000 7f7f8ae1e640 1 -- 172.21.15.19:0/420209379 shutdown_connections 2024-09-12T02:01:12.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:12.924+0000 7f7f8ae1e640 1 --2- 172.21.15.19:0/420209379 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7f6406be30 0x7f7f6406e2f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:12.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:12.924+0000 7f7f8ae1e640 1 --2- 172.21.15.19:0/420209379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f84162060 0x7f7f8415ea20 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:12.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:12.924+0000 7f7f8ae1e640 1 --2- 172.21.15.19:0/420209379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f84161c80 0x7f7f840b8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:12.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:12.924+0000 7f7f8ae1e640 1 --2- 172.21.15.19:0/420209379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f840b64b0 0x7f7f84159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:12.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:12.924+0000 7f7f8ae1e640 1 -- 172.21.15.19:0/420209379 >> 172.21.15.19:0/420209379 conn(0x7f7f840d44f0 msgr2=0x7f7f840d3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:12.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:12.924+0000 7f7f8ae1e640 1 -- 172.21.15.19:0/420209379 shutdown_connections 2024-09-12T02:01:12.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:12.924+0000 7f7f8ae1e640 1 -- 172.21.15.19:0/420209379 wait complete. 2024-09-12T02:01:12.939 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:01:13.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.049+0000 7fb5331e8640 1 Processor -- start 2024-09-12T02:01:13.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.049+0000 7fb5331e8640 1 -- start start 2024-09-12T02:01:13.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.049+0000 7fb5331e8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb52c15e5f0 0x7fb52c0d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.049+0000 7fb5331e8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb52c0b6690 0x7fb52c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.049+0000 7fb5331e8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52c0d3690 con 0x7fb52c0d30f0 2024-09-12T02:01:13.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.049+0000 7fb5331e8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb52c06d530 con 0x7fb52c0b6690 2024-09-12T02:01:13.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.049+0000 7fb5331e8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb52c0d3970 con 0x7fb52c15e5f0 2024-09-12T02:01:13.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.050+0000 7fb531785640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb52c0b6690 0x7fb52c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.050+0000 7fb52bfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb52c0d30f0 0x7fb52c0b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40642/0 (socket says 172.21.15.19:40642) 2024-09-12T02:01:13.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.050+0000 7fb52bfff640 1 -- 172.21.15.19:0/4254693510 learned_addr learned my addr 172.21.15.19:0/4254693510 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:13.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.050+0000 7fb531785640 1 -- 172.21.15.19:0/4254693510 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb52c15e5f0 msgr2=0x7fb52c0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:13.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.050+0000 7fb531785640 1 --2- 172.21.15.19:0/4254693510 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb52c15e5f0 0x7fb52c0d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.050+0000 7fb531785640 1 -- 172.21.15.19:0/4254693510 >> v1:172.21.15.19:6789/0 conn(0x7fb52c0d30f0 legacy=0x7fb52c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.050+0000 7fb531785640 1 -- 172.21.15.19:0/4254693510 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52c06cee0 con 0x7fb52c0b6690 2024-09-12T02:01:13.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.050+0000 7fb52b7fe640 1 -- 172.21.15.19:0/4254693510 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1659575958 0 0) 0x7fb52c0d3690 con 0x7fb52c0d30f0 2024-09-12T02:01:13.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.051+0000 7fb531785640 1 --2- 172.21.15.19:0/4254693510 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb52c0b6690 0x7fb52c06d9c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb5240097a0 tx=0x7fb52402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79dbb26ca5d11fc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:13.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.051+0000 7fb52b7fe640 1 -- 172.21.15.19:0/4254693510 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524037070 con 0x7fb52c0b6690 2024-09-12T02:01:13.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.051+0000 7fb52b7fe640 1 -- 172.21.15.19:0/4254693510 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb524032440 con 0x7fb52c0b6690 2024-09-12T02:01:13.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.051+0000 7fb52b7fe640 1 -- 172.21.15.19:0/4254693510 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524032810 con 0x7fb52c0b6690 2024-09-12T02:01:13.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.051+0000 7fb5331e8640 1 -- 172.21.15.19:0/4254693510 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb52c0b6690 msgr2=0x7fb52c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.051+0000 7fb5331e8640 1 --2- 172.21.15.19:0/4254693510 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb52c0b6690 0x7fb52c06d9c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb5240097a0 tx=0x7fb52402a180 comp rx=0 tx=0).stop 2024-09-12T02:01:13.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.051+0000 7fb5331e8640 1 -- 172.21.15.19:0/4254693510 shutdown_connections 2024-09-12T02:01:13.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.051+0000 7fb5331e8640 1 --2- 172.21.15.19:0/4254693510 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb52c0b6690 0x7fb52c06d9c0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.051+0000 7fb5331e8640 1 --2- 172.21.15.19:0/4254693510 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb52c15e5f0 0x7fb52c0d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.051+0000 7fb5331e8640 1 -- 172.21.15.19:0/4254693510 >> 172.21.15.19:0/4254693510 conn(0x7fb52c08bfc0 msgr2=0x7fb52c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:13.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.052+0000 7fb5331e8640 1 -- 172.21.15.19:0/4254693510 shutdown_connections 2024-09-12T02:01:13.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.052+0000 7fb5331e8640 1 -- 172.21.15.19:0/4254693510 wait complete. 2024-09-12T02:01:13.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.053+0000 7fb5331e8640 1 Processor -- start 2024-09-12T02:01:13.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.053+0000 7fb5331e8640 1 -- start start 2024-09-12T02:01:13.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.054+0000 7fb5331e8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb52c0b6690 0x7fb52c0c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.054+0000 7fb5331e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb52c0d30f0 0x7fb52c0c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.054+0000 7fb5331e8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb52c15e5f0 0x7fb52c1579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.054+0000 7fb5331e8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c0d5310 con 0x7fb52c0d30f0 2024-09-12T02:01:13.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.054+0000 7fb5331e8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c15e9d0 con 0x7fb52c15e5f0 2024-09-12T02:01:13.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.054+0000 7fb5331e8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb52c06df00 con 0x7fb52c0b6690 2024-09-12T02:01:13.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.054+0000 7fb52bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb52c0d30f0 0x7fb52c0c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.054+0000 7fb52bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb52c0d30f0 0x7fb52c0c96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54920/0 (socket says 172.21.15.19:54920) 2024-09-12T02:01:13.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.054+0000 7fb52bfff640 1 -- 172.21.15.19:0/2524215787 learned_addr learned my addr 172.21.15.19:0/2524215787 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:13.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.054+0000 7fb530f84640 1 --2- 172.21.15.19:0/2524215787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb52c0b6690 0x7fb52c0c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.054+0000 7fb531785640 1 --2- 172.21.15.19:0/2524215787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb52c15e5f0 0x7fb52c1579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.054+0000 7fb52bfff640 1 -- 172.21.15.19:0/2524215787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb52c0b6690 msgr2=0x7fb52c0c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.054+0000 7fb52bfff640 1 --2- 172.21.15.19:0/2524215787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb52c0b6690 0x7fb52c0c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.054+0000 7fb52bfff640 1 -- 172.21.15.19:0/2524215787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb52c15e5f0 msgr2=0x7fb52c1579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.054+0000 7fb52bfff640 1 --2- 172.21.15.19:0/2524215787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb52c15e5f0 0x7fb52c1579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.054+0000 7fb52bfff640 1 -- 172.21.15.19:0/2524215787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52c0c8610 con 0x7fb52c0d30f0 2024-09-12T02:01:13.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.054+0000 7fb531785640 1 --2- 172.21.15.19:0/2524215787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb52c15e5f0 0x7fb52c1579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:13.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.054+0000 7fb52bfff640 1 --2- 172.21.15.19:0/2524215787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb52c0d30f0 0x7fb52c0c96b0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00c820 tx=0x7fb51c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:13.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.055+0000 7fb5297fa640 1 -- 172.21.15.19:0/2524215787 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c018070 con 0x7fb52c0d30f0 2024-09-12T02:01:13.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.055+0000 7fb5297fa640 1 -- 172.21.15.19:0/2524215787 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51c00a640 con 0x7fb52c0d30f0 2024-09-12T02:01:13.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.055+0000 7fb5297fa640 1 -- 172.21.15.19:0/2524215787 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c00aa30 con 0x7fb52c0d30f0 2024-09-12T02:01:13.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.055+0000 7fb5331e8640 1 -- 172.21.15.19:0/2524215787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb52c0c88f0 con 0x7fb52c0d30f0 2024-09-12T02:01:13.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.055+0000 7fb5331e8640 1 -- 172.21.15.19:0/2524215787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb52c0c9190 con 0x7fb52c0d30f0 2024-09-12T02:01:13.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.056+0000 7fb5331e8640 1 -- 172.21.15.19:0/2524215787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb52c0c8ce0 con 0x7fb52c0d30f0 2024-09-12T02:01:13.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.056+0000 7fb5297fa640 1 -- 172.21.15.19:0/2524215787 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb51c01b070 con 0x7fb52c0d30f0 2024-09-12T02:01:13.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.057+0000 7fb5297fa640 1 --2- 172.21.15.19:0/2524215787 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb50c06be30 0x7fb50c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.057+0000 7fb5297fa640 1 -- 172.21.15.19:0/2524215787 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5249+0+0 (secure 0 0 0) 0x7fb51c08a400 con 0x7fb52c0d30f0 2024-09-12T02:01:13.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.057+0000 7fb530f84640 1 --2- 172.21.15.19:0/2524215787 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb50c06be30 0x7fb50c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.058+0000 7fb530f84640 1 --2- 172.21.15.19:0/2524215787 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb50c06be30 0x7fb50c06e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb52c1f7a80 tx=0x7fb514008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:13.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.061+0000 7fb5297fa640 1 -- 172.21.15.19:0/2524215787 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb51c058f70 con 0x7fb52c0d30f0 2024-09-12T02:01:13.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.302+0000 7fb5331e8640 1 -- 172.21.15.19:0/2524215787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb52c0c7980 con 0x7fb52c0d30f0 2024-09-12T02:01:13.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.302+0000 7fb5297fa640 1 -- 172.21.15.19:0/2524215787 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7fb51c058870 con 0x7fb52c0d30f0 2024-09-12T02:01:13.303 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:13.303 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:01:13.303 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_dump": [ 2024-09-12T02:01:13.303 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.303 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.a", 2024-09-12T02:01:13.303 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJm5rSjChAA4H0OW7ubTgq4vmUaoGvvNA==", 2024-09-12T02:01:13.303 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.304 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:01:13.304 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T02:01:13.304 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T02:01:13.304 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:01:13.304 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:01:13.304 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.304 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.b", 2024-09-12T02:01:13.304 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmyaCyFhAAV87Ogacs5CmiAuG0p/61Fw==", 2024-09-12T02:01:13.304 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.304 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:01:13.304 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T02:01:13.304 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T02:01:13.304 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:01:13.305 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:01:13.305 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.305 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.c", 2024-09-12T02:01:13.305 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmVLrfERAAlIw2yLSJubtZ1o4NB9IDsg==", 2024-09-12T02:01:13.305 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.305 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:01:13.305 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T02:01:13.305 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T02:01:13.305 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:01:13.305 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:01:13.305 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.305 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.d", 2024-09-12T02:01:13.306 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmd6a1HRAA04/r87MKfFM1VQvG1Tjj8A==", 2024-09-12T02:01:13.306 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:01:13.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T02:01:13.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T02:01:13.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:01:13.306 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:01:13.306 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.306 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.0", 2024-09-12T02:01:13.306 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD0SeJme7ETBRAA/8v8aJcEzpHYmAPg5Hxdzg==", 2024-09-12T02:01:13.306 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:01:13.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:01:13.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:01:13.307 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:01:13.307 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.307 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.1", 2024-09-12T02:01:13.307 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD3SeJmfXQyFhAALiZjnIoDw+OtH9of5IUu0w==", 2024-09-12T02:01:13.307 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:01:13.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:01:13.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:01:13.307 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:01:13.307 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.307 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.2", 2024-09-12T02:01:13.308 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD6SeJmMDNwJxAABb+94TBxpZx3GovP1g1Q2A==", 2024-09-12T02:01:13.308 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:01:13.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:01:13.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:01:13.308 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:01:13.308 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.308 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.3", 2024-09-12T02:01:13.308 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD9SeJmZMgKOBAAgU+mzTBmPSHE7mUElUA9lA==", 2024-09-12T02:01:13.308 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:01:13.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:01:13.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:01:13.309 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:01:13.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.309 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.4", 2024-09-12T02:01:13.309 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAESuJmnb9kBBAA6PmrEGSckixHv73r9ogheQ==", 2024-09-12T02:01:13.309 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.309 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:01:13.309 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:01:13.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:01:13.309 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:01:13.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.309 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.5", 2024-09-12T02:01:13.309 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAHSuJmLU1hBhAAlFooSVxCEmIHSjqscaFnhQ==", 2024-09-12T02:01:13.309 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.309 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:01:13.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:01:13.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:01:13.310 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:01:13.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.310 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.6", 2024-09-12T02:01:13.310 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAKSuJmeIj7BxAADTmZtK8dk94LSGa88+xq3Q==", 2024-09-12T02:01:13.310 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:01:13.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:01:13.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:01:13.310 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:01:13.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.310 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.7", 2024-09-12T02:01:13.311 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQANSuJmw92iJxAAsjNKRSdndTUGmBtaN3g/pQ==", 2024-09-12T02:01:13.311 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:01:13.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:01:13.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:01:13.311 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.311 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:01:13.311 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.311 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.0", 2024-09-12T02:01:13.311 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmfHbXIRAALAvdYAlaB6WxWtubFnlxRw==", 2024-09-12T02:01:13.311 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:01:13.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow r", 2024-09-12T02:01:13.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T02:01:13.312 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.312 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:01:13.312 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.312 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.1", 2024-09-12T02:01:13.312 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmOjfDKhAA8h0ldWP6mNPgoqtIejhF+Q==", 2024-09-12T02:01:13.312 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.312 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:01:13.312 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T02:01:13.312 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T02:01:13.312 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T02:01:13.312 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.312 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:01:13.312 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.312 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.2", 2024-09-12T02:01:13.313 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmLQSOJxAA2RhDLfjVzPpg1kiJe++WHg==", 2024-09-12T02:01:13.313 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.313 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:01:13.313 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T02:01:13.313 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T02:01:13.313 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T02:01:13.313 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:01:13.313 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.313 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.3", 2024-09-12T02:01:13.313 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmXS5YMBAAXSS+3Omu0PYIz1bJcSxefw==", 2024-09-12T02:01:13.313 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.313 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:01:13.313 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T02:01:13.314 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T02:01:13.314 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T02:01:13.314 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:01:13.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.314 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.admin", 2024-09-12T02:01:13.314 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDvSeJmCljiKRAAQmsy5rl4ZPpm2pD1kXMO3g==", 2024-09-12T02:01:13.314 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.314 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-09-12T02:01:13.314 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T02:01:13.314 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T02:01:13.314 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:01:13.314 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:01:13.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.315 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.x", 2024-09-12T02:01:13.315 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmjx1VBxAAF80kgsMnFJn+gL44QZn6bg==", 2024-09-12T02:01:13.315 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.315 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-09-12T02:01:13.315 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-09-12T02:01:13.315 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:01:13.315 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:01:13.315 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.315 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.y", 2024-09-12T02:01:13.315 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmXphnAxAAUnmZ3JPOt1Yzk0zqWh5+kg==", 2024-09-12T02:01:13.315 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:01:13.315 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-09-12T02:01:13.316 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-09-12T02:01:13.316 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:01:13.316 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.316 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.316 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T02:01:13.316 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:01:13.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.304+0000 7fb5331e8640 1 -- 172.21.15.19:0/2524215787 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb50c06be30 msgr2=0x7fb50c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.304+0000 7fb5331e8640 1 --2- 172.21.15.19:0/2524215787 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb50c06be30 0x7fb50c06e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb52c1f7a80 tx=0x7fb514008040 comp rx=0 tx=0).stop 2024-09-12T02:01:13.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.304+0000 7fb5331e8640 1 -- 172.21.15.19:0/2524215787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb52c0d30f0 msgr2=0x7fb52c0c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.304+0000 7fb5331e8640 1 --2- 172.21.15.19:0/2524215787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb52c0d30f0 0x7fb52c0c96b0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00c820 tx=0x7fb51c00cce0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.304+0000 7fb5331e8640 1 -- 172.21.15.19:0/2524215787 shutdown_connections 2024-09-12T02:01:13.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.304+0000 7fb5331e8640 1 --2- 172.21.15.19:0/2524215787 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb50c06be30 0x7fb50c06e2f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.304+0000 7fb5331e8640 1 --2- 172.21.15.19:0/2524215787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb52c15e5f0 0x7fb52c1579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.304+0000 7fb5331e8640 1 --2- 172.21.15.19:0/2524215787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb52c0d30f0 0x7fb52c0c96b0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.304+0000 7fb5331e8640 1 --2- 172.21.15.19:0/2524215787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb52c0b6690 0x7fb52c0c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.304+0000 7fb5331e8640 1 -- 172.21.15.19:0/2524215787 >> 172.21.15.19:0/2524215787 conn(0x7fb52c08bfc0 msgr2=0x7fb52c0b5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:13.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.304+0000 7fb5331e8640 1 -- 172.21.15.19:0/2524215787 shutdown_connections 2024-09-12T02:01:13.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.304+0000 7fb5331e8640 1 -- 172.21.15.19:0/2524215787 wait complete. 2024-09-12T02:01:13.319 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:01:13.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.422+0000 7fbb638f8640 1 Processor -- start 2024-09-12T02:01:13.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.422+0000 7fbb638f8640 1 -- start start 2024-09-12T02:01:13.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.423+0000 7fbb638f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb5c0cf330 0x7fbb5c169070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.423+0000 7fbb638f8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb5c06e820 con 0x7fbb5c0d15f0 2024-09-12T02:01:13.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.423+0000 7fbb638f8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb5c0cf980 con 0x7fbb5c161a20 2024-09-12T02:01:13.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.423+0000 7fbb638f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5c0cf760 con 0x7fbb5c0cf330 2024-09-12T02:01:13.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.423+0000 7fbb60e93640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbb5c0d15f0 0x7fbb5c0cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40644/0 (socket says 172.21.15.19:40644) 2024-09-12T02:01:13.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.423+0000 7fbb60e93640 1 -- 172.21.15.19:0/1172272958 learned_addr learned my addr 172.21.15.19:0/1172272958 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.423+0000 7fbb61e95640 1 --2- 172.21.15.19:0/1172272958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb5c0cf330 0x7fbb5c169070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.423+0000 7fbb53fff640 1 -- 172.21.15.19:0/1172272958 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2521389797 0 0) 0x7fbb5c06e820 con 0x7fbb5c0d15f0 2024-09-12T02:01:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.423+0000 7fbb53fff640 1 -- 172.21.15.19:0/1172272958 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb48003520 con 0x7fbb5c0d15f0 2024-09-12T02:01:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.423+0000 7fbb53fff640 1 -- 172.21.15.19:0/1172272958 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 825622370 0 0) 0x7fbb5c0cf980 con 0x7fbb5c161a20 2024-09-12T02:01:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.423+0000 7fbb53fff640 1 -- 172.21.15.19:0/1172272958 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb5c06e820 con 0x7fbb5c161a20 2024-09-12T02:01:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.424+0000 7fbb61e95640 1 -- 172.21.15.19:0/1172272958 >> v1:172.21.15.135:6789/0 conn(0x7fbb5c161a20 legacy=0x7fbb5c0d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.424+0000 7fbb61e95640 1 -- 172.21.15.19:0/1172272958 >> v1:172.21.15.19:6789/0 conn(0x7fbb5c0d15f0 legacy=0x7fbb5c0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.424+0000 7fbb61e95640 1 -- 172.21.15.19:0/1172272958 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5c06d050 con 0x7fbb5c0cf330 2024-09-12T02:01:13.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.424+0000 7fbb61e95640 1 --2- 172.21.15.19:0/1172272958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb5c0cf330 0x7fbb5c169070 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c06d220 tx=0x7fbb5402a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21fa56d5eccd005d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:13.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.425+0000 7fbb53fff640 1 -- 172.21.15.19:0/1172272958 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54007740 con 0x7fbb5c0cf330 2024-09-12T02:01:13.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.425+0000 7fbb53fff640 1 -- 172.21.15.19:0/1172272958 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb540078e0 con 0x7fbb5c0cf330 2024-09-12T02:01:13.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.425+0000 7fbb53fff640 1 -- 172.21.15.19:0/1172272958 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54007c90 con 0x7fbb5c0cf330 2024-09-12T02:01:13.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.425+0000 7fbb638f8640 1 -- 172.21.15.19:0/1172272958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb5c0cf330 msgr2=0x7fbb5c169070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.425+0000 7fbb638f8640 1 --2- 172.21.15.19:0/1172272958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb5c0cf330 0x7fbb5c169070 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c06d220 tx=0x7fbb5402a6c0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.425+0000 7fbb638f8640 1 -- 172.21.15.19:0/1172272958 shutdown_connections 2024-09-12T02:01:13.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.425+0000 7fbb638f8640 1 --2- 172.21.15.19:0/1172272958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb5c0cf330 0x7fbb5c169070 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.425+0000 7fbb638f8640 1 -- 172.21.15.19:0/1172272958 >> 172.21.15.19:0/1172272958 conn(0x7fbb5c09d850 msgr2=0x7fbb5c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:13.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.425+0000 7fbb638f8640 1 -- 172.21.15.19:0/1172272958 shutdown_connections 2024-09-12T02:01:13.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.425+0000 7fbb638f8640 1 -- 172.21.15.19:0/1172272958 wait complete. 2024-09-12T02:01:13.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.426+0000 7fbb638f8640 1 Processor -- start 2024-09-12T02:01:13.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.426+0000 7fbb638f8640 1 -- start start 2024-09-12T02:01:13.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.427+0000 7fbb638f8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb5c0cf330 0x7fbb5c0ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.427+0000 7fbb638f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb5c0d15f0 0x7fbb5c0b9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.427+0000 7fbb638f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb5c161a20 0x7fbb5c1f7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.427+0000 7fbb638f8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c0cff00 con 0x7fbb5c161a20 2024-09-12T02:01:13.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.427+0000 7fbb638f8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c161e00 con 0x7fbb5c0cf330 2024-09-12T02:01:13.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.427+0000 7fbb638f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5c06d2f0 con 0x7fbb5c0d15f0 2024-09-12T02:01:13.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.427+0000 7fbb61e95640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb5c161a20 0x7fbb5c1f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.427+0000 7fbb61e95640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb5c161a20 0x7fbb5c1f7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54926/0 (socket says 172.21.15.19:54926) 2024-09-12T02:01:13.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.427+0000 7fbb61e95640 1 -- 172.21.15.19:0/1184638189 learned_addr learned my addr 172.21.15.19:0/1184638189 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:13.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.428+0000 7fbb61694640 1 --2- 172.21.15.19:0/1184638189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb5c0cf330 0x7fbb5c0ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.428+0000 7fbb60e93640 1 --2- 172.21.15.19:0/1184638189 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb5c0d15f0 0x7fbb5c0b9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.428+0000 7fbb61e95640 1 -- 172.21.15.19:0/1184638189 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb5c0d15f0 msgr2=0x7fbb5c0b9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.428+0000 7fbb61e95640 1 --2- 172.21.15.19:0/1184638189 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb5c0d15f0 0x7fbb5c0b9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.428+0000 7fbb61e95640 1 -- 172.21.15.19:0/1184638189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb5c0cf330 msgr2=0x7fbb5c0ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.428+0000 7fbb61e95640 1 --2- 172.21.15.19:0/1184638189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb5c0cf330 0x7fbb5c0ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.428+0000 7fbb61e95640 1 -- 172.21.15.19:0/1184638189 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5c1f7ca0 con 0x7fbb5c161a20 2024-09-12T02:01:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.428+0000 7fbb60e93640 1 --2- 172.21.15.19:0/1184638189 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb5c0d15f0 0x7fbb5c0b9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.428+0000 7fbb61e95640 1 --2- 172.21.15.19:0/1184638189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb5c161a20 0x7fbb5c1f7760 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009eb0 tx=0x7fbb54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.428+0000 7fbb51ffb640 1 -- 172.21.15.19:0/1184638189 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54040070 con 0x7fbb5c161a20 2024-09-12T02:01:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.428+0000 7fbb51ffb640 1 -- 172.21.15.19:0/1184638189 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb54031c60 con 0x7fbb5c161a20 2024-09-12T02:01:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.428+0000 7fbb638f8640 1 -- 172.21.15.19:0/1184638189 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb5c1f7f20 con 0x7fbb5c161a20 2024-09-12T02:01:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.428+0000 7fbb51ffb640 1 -- 172.21.15.19:0/1184638189 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54009450 con 0x7fbb5c161a20 2024-09-12T02:01:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.428+0000 7fbb638f8640 1 -- 172.21.15.19:0/1184638189 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb5c1f84e0 con 0x7fbb5c161a20 2024-09-12T02:01:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.430+0000 7fbb638f8640 1 -- 172.21.15.19:0/1184638189 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb5c0b1040 con 0x7fbb5c161a20 2024-09-12T02:01:13.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.430+0000 7fbb51ffb640 1 -- 172.21.15.19:0/1184638189 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb54039040 con 0x7fbb5c161a20 2024-09-12T02:01:13.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.430+0000 7fbb51ffb640 1 --2- 172.21.15.19:0/1184638189 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbb4006be30 0x7fbb4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.430+0000 7fbb51ffb640 1 -- 172.21.15.19:0/1184638189 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5249+0+0 (secure 0 0 0) 0x7fbb540abf90 con 0x7fbb5c161a20 2024-09-12T02:01:13.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.431+0000 7fbb61694640 1 --2- 172.21.15.19:0/1184638189 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbb4006be30 0x7fbb4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.431+0000 7fbb61694640 1 --2- 172.21.15.19:0/1184638189 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbb4006be30 0x7fbb4006e2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0c92f0 tx=0x7fbb58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:13.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.435+0000 7fbb51ffb640 1 -- 172.21.15.19:0/1184638189 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb5c1f7ca0 con 0x7fbb5c161a20 2024-09-12T02:01:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.612+0000 7fbb638f8640 1 -- 172.21.15.19:0/1184638189 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fbb5c15e760 con 0x7fbb5c161a20 2024-09-12T02:01:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.612+0000 7fbb51ffb640 1 -- 172.21.15.19:0/1184638189 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) ==== 84+0+65 (secure 0 0 0) 0x7fbb5407ab00 con 0x7fbb5c161a20 2024-09-12T02:01:13.612 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:13.613 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-09-12T02:01:13.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:01:13.613 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-09-12T02:01:13.613 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-09-12T02:01:13.613 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:01:13.613 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-09-12T02:01:13.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.614+0000 7fbb638f8640 1 -- 172.21.15.19:0/1184638189 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbb4006be30 msgr2=0x7fbb4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.614+0000 7fbb638f8640 1 --2- 172.21.15.19:0/1184638189 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbb4006be30 0x7fbb4006e2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0c92f0 tx=0x7fbb58009040 comp rx=0 tx=0).stop 2024-09-12T02:01:13.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.614+0000 7fbb638f8640 1 -- 172.21.15.19:0/1184638189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb5c161a20 msgr2=0x7fbb5c1f7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.614+0000 7fbb638f8640 1 --2- 172.21.15.19:0/1184638189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb5c161a20 0x7fbb5c1f7760 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009eb0 tx=0x7fbb54004a40 comp rx=0 tx=0).stop 2024-09-12T02:01:13.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.614+0000 7fbb638f8640 1 -- 172.21.15.19:0/1184638189 shutdown_connections 2024-09-12T02:01:13.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.614+0000 7fbb638f8640 1 --2- 172.21.15.19:0/1184638189 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbb4006be30 0x7fbb4006e2f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.614+0000 7fbb638f8640 1 --2- 172.21.15.19:0/1184638189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb5c161a20 0x7fbb5c1f7760 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.614+0000 7fbb638f8640 1 --2- 172.21.15.19:0/1184638189 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb5c0d15f0 0x7fbb5c0b9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.614+0000 7fbb638f8640 1 --2- 172.21.15.19:0/1184638189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb5c0cf330 0x7fbb5c0ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.614+0000 7fbb638f8640 1 -- 172.21.15.19:0/1184638189 >> 172.21.15.19:0/1184638189 conn(0x7fbb5c09d850 msgr2=0x7fbb5c0d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:13.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.614+0000 7fbb638f8640 1 -- 172.21.15.19:0/1184638189 shutdown_connections 2024-09-12T02:01:13.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.614+0000 7fbb638f8640 1 -- 172.21.15.19:0/1184638189 wait complete. 2024-09-12T02:01:13.625 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:01:13.625 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:01:13.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.731+0000 7f0776326640 1 Processor -- start 2024-09-12T02:01:13.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.731+0000 7f0776326640 1 -- start start 2024-09-12T02:01:13.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.732+0000 7f0776326640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f077015c490 0x7f077009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.732+0000 7f0776326640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f077009af70 0x7f07700b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.732+0000 7f0776326640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0770072180 con 0x7f07700b0a00 2024-09-12T02:01:13.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.732+0000 7f0776326640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f077009b3b0 con 0x7f077009af70 2024-09-12T02:01:13.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.732+0000 7f0776326640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f077015c870 con 0x7f077015c490 2024-09-12T02:01:13.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.732+0000 7f076f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f077009af70 0x7f07700b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.732+0000 7f07748c3640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f07700b0a00 0x7f07700b0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40648/0 (socket says 172.21.15.19:40648) 2024-09-12T02:01:13.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.732+0000 7f07748c3640 1 -- 172.21.15.19:0/2943143337 learned_addr learned my addr 172.21.15.19:0/2943143337 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:13.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.732+0000 7f076ffff640 1 --2- 172.21.15.19:0/2943143337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f077015c490 0x7f077009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.732+0000 7f076f7fe640 1 -- 172.21.15.19:0/2943143337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f077015c490 msgr2=0x7f077009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:13.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.732+0000 7f076f7fe640 1 --2- 172.21.15.19:0/2943143337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f077015c490 0x7f077009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.732+0000 7f076f7fe640 1 -- 172.21.15.19:0/2943143337 >> v1:172.21.15.19:6789/0 conn(0x7f07700b0a00 legacy=0x7f07700b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.732+0000 7f076effd640 1 -- 172.21.15.19:0/2943143337 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 856418177 0 0) 0x7f0770072180 con 0x7f07700b0a00 2024-09-12T02:01:13.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.732+0000 7f076f7fe640 1 -- 172.21.15.19:0/2943143337 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0770071bc0 con 0x7f077009af70 2024-09-12T02:01:13.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.733+0000 7f076f7fe640 1 --2- 172.21.15.19:0/2943143337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f077009af70 0x7f07700b04c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f07640097a0 tx=0x7f076402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7d3a9d4f323e0a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:13.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.733+0000 7f076effd640 1 -- 172.21.15.19:0/2943143337 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0764037070 con 0x7f077009af70 2024-09-12T02:01:13.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.733+0000 7f076effd640 1 -- 172.21.15.19:0/2943143337 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0764032440 con 0x7f077009af70 2024-09-12T02:01:13.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.733+0000 7f076effd640 1 -- 172.21.15.19:0/2943143337 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0764032810 con 0x7f077009af70 2024-09-12T02:01:13.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.734+0000 7f0776326640 1 -- 172.21.15.19:0/2943143337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f077009af70 msgr2=0x7f07700b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.734+0000 7f0776326640 1 --2- 172.21.15.19:0/2943143337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f077009af70 0x7f07700b04c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f07640097a0 tx=0x7f076402a180 comp rx=0 tx=0).stop 2024-09-12T02:01:13.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.734+0000 7f0776326640 1 -- 172.21.15.19:0/2943143337 shutdown_connections 2024-09-12T02:01:13.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.734+0000 7f0776326640 1 --2- 172.21.15.19:0/2943143337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f077009af70 0x7f07700b04c0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.734+0000 7f0776326640 1 --2- 172.21.15.19:0/2943143337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f077015c490 0x7f077009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.734+0000 7f0776326640 1 -- 172.21.15.19:0/2943143337 >> 172.21.15.19:0/2943143337 conn(0x7f07700b3f30 msgr2=0x7f07700b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:13.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.734+0000 7f0776326640 1 -- 172.21.15.19:0/2943143337 shutdown_connections 2024-09-12T02:01:13.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.734+0000 7f0776326640 1 -- 172.21.15.19:0/2943143337 wait complete. 2024-09-12T02:01:13.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.736+0000 7f0776326640 1 Processor -- start 2024-09-12T02:01:13.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.736+0000 7f0776326640 1 -- start start 2024-09-12T02:01:13.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f0776326640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f077009af70 0x7f077015da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f0776326640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07700b0a00 0x7f077006de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f0776326640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f077015c490 0x7f0770150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f0776326640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f07700affa0 con 0x7f077009af70 2024-09-12T02:01:13.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f0776326640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f07700afcc0 con 0x7f077015c490 2024-09-12T02:01:13.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f0776326640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f077009b8f0 con 0x7f07700b0a00 2024-09-12T02:01:13.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f076ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f077009af70 0x7f077015da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f076ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f077009af70 0x7f077015da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54944/0 (socket says 172.21.15.19:54944) 2024-09-12T02:01:13.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f076ffff640 1 -- 172.21.15.19:0/1924120643 learned_addr learned my addr 172.21.15.19:0/1924120643 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:13.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f076f7fe640 1 --2- 172.21.15.19:0/1924120643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07700b0a00 0x7f077006de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f07748c3640 1 --2- 172.21.15.19:0/1924120643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f077015c490 0x7f0770150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f076ffff640 1 -- 172.21.15.19:0/1924120643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07700b0a00 msgr2=0x7f077006de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f076ffff640 1 --2- 172.21.15.19:0/1924120643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07700b0a00 0x7f077006de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f076ffff640 1 -- 172.21.15.19:0/1924120643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f077015c490 msgr2=0x7f0770150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f076ffff640 1 --2- 172.21.15.19:0/1924120643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f077015c490 0x7f0770150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f076ffff640 1 -- 172.21.15.19:0/1924120643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077006cdc0 con 0x7f077009af70 2024-09-12T02:01:13.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f076ffff640 1 --2- 172.21.15.19:0/1924120643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f077009af70 0x7f077015da60 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f076000d5d0 tx=0x7f076000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:13.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f076cff9640 1 -- 172.21.15.19:0/1924120643 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07600125f0 con 0x7f077009af70 2024-09-12T02:01:13.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f076cff9640 1 -- 172.21.15.19:0/1924120643 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0760019070 con 0x7f077009af70 2024-09-12T02:01:13.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f0776326640 1 -- 172.21.15.19:0/1924120643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f077006d0a0 con 0x7f077009af70 2024-09-12T02:01:13.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f076cff9640 1 -- 172.21.15.19:0/1924120643 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07600129f0 con 0x7f077009af70 2024-09-12T02:01:13.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.737+0000 7f0776326640 1 -- 172.21.15.19:0/1924120643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f077006d660 con 0x7f077009af70 2024-09-12T02:01:13.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.738+0000 7f0776326640 1 -- 172.21.15.19:0/1924120643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07700b04c0 con 0x7f077009af70 2024-09-12T02:01:13.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.739+0000 7f076cff9640 1 -- 172.21.15.19:0/1924120643 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0760012b90 con 0x7f077009af70 2024-09-12T02:01:13.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.739+0000 7f076cff9640 1 --2- 172.21.15.19:0/1924120643 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f075c06be30 0x7f075c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.740+0000 7f076cff9640 1 -- 172.21.15.19:0/1924120643 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5249+0+0 (secure 0 0 0) 0x7f076008b0b0 con 0x7f077009af70 2024-09-12T02:01:13.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.740+0000 7f076f7fe640 1 --2- 172.21.15.19:0/1924120643 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f075c06be30 0x7f075c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.740+0000 7f076f7fe640 1 --2- 172.21.15.19:0/1924120643 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f075c06be30 0x7f075c06e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0764034000 tx=0x7f076402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:13.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.744+0000 7f076cff9640 1 -- 172.21.15.19:0/1924120643 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0760059c20 con 0x7f077009af70 2024-09-12T02:01:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:13.921+0000 7f0776326640 1 -- 172.21.15.19:0/1924120643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f07700b3ca0 con 0x7f077009af70 2024-09-12T02:01:14.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:14.924+0000 7f076cff9640 1 -- 172.21.15.19:0/1924120643 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) ==== 138+0+0 (secure 0 0 0) 0x7f0760059520 con 0x7f077009af70 2024-09-12T02:01:14.925 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-09-12T02:01:14.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:14.927+0000 7f0776326640 1 -- 172.21.15.19:0/1924120643 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f075c06be30 msgr2=0x7f075c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:14.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:14.927+0000 7f0776326640 1 --2- 172.21.15.19:0/1924120643 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f075c06be30 0x7f075c06e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0764034000 tx=0x7f076402e000 comp rx=0 tx=0).stop 2024-09-12T02:01:14.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:14.927+0000 7f0776326640 1 -- 172.21.15.19:0/1924120643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f077009af70 msgr2=0x7f077015da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:14.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:14.927+0000 7f0776326640 1 --2- 172.21.15.19:0/1924120643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f077009af70 0x7f077015da60 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f076000d5d0 tx=0x7f076000da90 comp rx=0 tx=0).stop 2024-09-12T02:01:14.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:14.927+0000 7f0776326640 1 -- 172.21.15.19:0/1924120643 shutdown_connections 2024-09-12T02:01:14.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:14.927+0000 7f0776326640 1 --2- 172.21.15.19:0/1924120643 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f075c06be30 0x7f075c06e2f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:14.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:14.927+0000 7f0776326640 1 --2- 172.21.15.19:0/1924120643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f077015c490 0x7f0770150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:14.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:14.927+0000 7f0776326640 1 --2- 172.21.15.19:0/1924120643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07700b0a00 0x7f077006de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:14.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:14.927+0000 7f0776326640 1 --2- 172.21.15.19:0/1924120643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f077009af70 0x7f077015da60 secure :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f076000d5d0 tx=0x7f076000da90 comp rx=0 tx=0).stop 2024-09-12T02:01:14.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:14.927+0000 7f0776326640 1 -- 172.21.15.19:0/1924120643 >> 172.21.15.19:0/1924120643 conn(0x7f07700b3f30 msgr2=0x7f0770146dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:14.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:14.927+0000 7f0776326640 1 -- 172.21.15.19:0/1924120643 shutdown_connections 2024-09-12T02:01:14.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:14.927+0000 7f0776326640 1 -- 172.21.15.19:0/1924120643 wait complete. 2024-09-12T02:01:14.945 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:01:15.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.060+0000 7fa6945f8640 1 Processor -- start 2024-09-12T02:01:15.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.060+0000 7fa6945f8640 1 -- start start 2024-09-12T02:01:15.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.061+0000 7fa6945f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa68c162e30 0x7fa68c06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.061+0000 7fa6945f8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa68c15ff70 con 0x7fa68c0cf280 2024-09-12T02:01:15.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.061+0000 7fa6945f8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa68c0d4d10 con 0x7fa68c162340 2024-09-12T02:01:15.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.061+0000 7fa6945f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa68c06de90 con 0x7fa68c162e30 2024-09-12T02:01:15.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.061+0000 7fa692b95640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa68c0cf280 0x7fa68c0d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40650/0 (socket says 172.21.15.19:40650) 2024-09-12T02:01:15.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.062+0000 7fa692b95640 1 -- 172.21.15.19:0/321904134 learned_addr learned my addr 172.21.15.19:0/321904134 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:15.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.062+0000 7fa691b93640 1 --2- 172.21.15.19:0/321904134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa68c162e30 0x7fa68c06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.062+0000 7fa691392640 1 -- 172.21.15.19:0/321904134 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4215735740 0 0) 0x7fa68c15ff70 con 0x7fa68c0cf280 2024-09-12T02:01:15.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.062+0000 7fa691392640 1 -- 172.21.15.19:0/321904134 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa674003520 con 0x7fa68c0cf280 2024-09-12T02:01:15.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.062+0000 7fa691392640 1 -- 172.21.15.19:0/321904134 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1178225893 0 0) 0x7fa68c0d4d10 con 0x7fa68c162340 2024-09-12T02:01:15.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.062+0000 7fa691392640 1 -- 172.21.15.19:0/321904134 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa68c15ff70 con 0x7fa68c162340 2024-09-12T02:01:15.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.062+0000 7fa691b93640 1 -- 172.21.15.19:0/321904134 >> v1:172.21.15.135:6789/0 conn(0x7fa68c162340 legacy=0x7fa68c162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:15.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.062+0000 7fa691b93640 1 -- 172.21.15.19:0/321904134 >> v1:172.21.15.19:6789/0 conn(0x7fa68c0cf280 legacy=0x7fa68c0d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:15.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.062+0000 7fa691b93640 1 -- 172.21.15.19:0/321904134 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68c0d4ff0 con 0x7fa68c162e30 2024-09-12T02:01:15.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.063+0000 7fa691b93640 1 --2- 172.21.15.19:0/321904134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa68c162e30 0x7fa68c06d740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa6800097c0 tx=0x7fa68002a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ff5fee77e8e84a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:15.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.063+0000 7fa691392640 1 -- 172.21.15.19:0/321904134 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa680037070 con 0x7fa68c162e30 2024-09-12T02:01:15.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.063+0000 7fa691392640 1 -- 172.21.15.19:0/321904134 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa680032440 con 0x7fa68c162e30 2024-09-12T02:01:15.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.063+0000 7fa691392640 1 -- 172.21.15.19:0/321904134 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6800327f0 con 0x7fa68c162e30 2024-09-12T02:01:15.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.064+0000 7fa6945f8640 1 -- 172.21.15.19:0/321904134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa68c162e30 msgr2=0x7fa68c06d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:15.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.064+0000 7fa6945f8640 1 --2- 172.21.15.19:0/321904134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa68c162e30 0x7fa68c06d740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa6800097c0 tx=0x7fa68002a160 comp rx=0 tx=0).stop 2024-09-12T02:01:15.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.064+0000 7fa6945f8640 1 -- 172.21.15.19:0/321904134 shutdown_connections 2024-09-12T02:01:15.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.064+0000 7fa6945f8640 1 --2- 172.21.15.19:0/321904134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa68c162e30 0x7fa68c06d740 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.064+0000 7fa6945f8640 1 -- 172.21.15.19:0/321904134 >> 172.21.15.19:0/321904134 conn(0x7fa68c08bfc0 msgr2=0x7fa68c0d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:15.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.064+0000 7fa6945f8640 1 -- 172.21.15.19:0/321904134 shutdown_connections 2024-09-12T02:01:15.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.064+0000 7fa6945f8640 1 -- 172.21.15.19:0/321904134 wait complete. 2024-09-12T02:01:15.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.065+0000 7fa6945f8640 1 Processor -- start 2024-09-12T02:01:15.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.065+0000 7fa6945f8640 1 -- start start 2024-09-12T02:01:15.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa6945f8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa68c0cf280 0x7fa68c152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa6945f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa68c162340 0x7fa68c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa6945f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa68c162e30 0x7fa68c14b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa6945f8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c0cf710 con 0x7fa68c162340 2024-09-12T02:01:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa6945f8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c163270 con 0x7fa68c0cf280 2024-09-12T02:01:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa6945f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa68c0d52d0 con 0x7fa68c162e30 2024-09-12T02:01:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa691b93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa68c162340 0x7fa68c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa691b93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa68c162340 0x7fa68c0cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54956/0 (socket says 172.21.15.19:54956) 2024-09-12T02:01:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa691b93640 1 -- 172.21.15.19:0/2333316692 learned_addr learned my addr 172.21.15.19:0/2333316692 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa691b93640 1 -- 172.21.15.19:0/2333316692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa68c162e30 msgr2=0x7fa68c14b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa691b93640 1 --2- 172.21.15.19:0/2333316692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa68c162e30 0x7fa68c14b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa691b93640 1 -- 172.21.15.19:0/2333316692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa68c0cf280 msgr2=0x7fa68c152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa692394640 1 --2- 172.21.15.19:0/2333316692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa68c0cf280 0x7fa68c152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa691b93640 1 --2- 172.21.15.19:0/2333316692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa68c0cf280 0x7fa68c152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa691b93640 1 -- 172.21.15.19:0/2333316692 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68c0cbae0 con 0x7fa68c162340 2024-09-12T02:01:15.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa692394640 1 --2- 172.21.15.19:0/2333316692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa68c0cf280 0x7fa68c152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:15.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa691b93640 1 --2- 172.21.15.19:0/2333316692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa68c162340 0x7fa68c0cb5a0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa68002a1a0 tx=0x7fa6800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:15.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa68affd640 1 -- 172.21.15.19:0/2333316692 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa680041020 con 0x7fa68c162340 2024-09-12T02:01:15.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa68affd640 1 -- 172.21.15.19:0/2333316692 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa68003d700 con 0x7fa68c162340 2024-09-12T02:01:15.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa6945f8640 1 -- 172.21.15.19:0/2333316692 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa68c153220 con 0x7fa68c162340 2024-09-12T02:01:15.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.066+0000 7fa68affd640 1 -- 172.21.15.19:0/2333316692 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa680037040 con 0x7fa68c162340 2024-09-12T02:01:15.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.067+0000 7fa6945f8640 1 -- 172.21.15.19:0/2333316692 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa68c1537e0 con 0x7fa68c162340 2024-09-12T02:01:15.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.068+0000 7fa6945f8640 1 -- 172.21.15.19:0/2333316692 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa68c0cfd70 con 0x7fa68c162340 2024-09-12T02:01:15.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.068+0000 7fa68affd640 1 -- 172.21.15.19:0/2333316692 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa680044020 con 0x7fa68c162340 2024-09-12T02:01:15.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.068+0000 7fa68affd640 1 --2- 172.21.15.19:0/2333316692 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa67806be30 0x7fa67806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.069+0000 7fa68affd640 1 -- 172.21.15.19:0/2333316692 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5619+0+0 (secure 0 0 0) 0x7fa6800ab5a0 con 0x7fa68c162340 2024-09-12T02:01:15.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.069+0000 7fa692394640 1 --2- 172.21.15.19:0/2333316692 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa67806be30 0x7fa67806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.069+0000 7fa692394640 1 --2- 172.21.15.19:0/2333316692 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa67806be30 0x7fa67806e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa6840016b0 tx=0x7fa684009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.073+0000 7fa68affd640 1 -- 172.21.15.19:0/2333316692 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa68c0cfd70 con 0x7fa68c162340 2024-09-12T02:01:15.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.250+0000 7fa6945f8640 1 -- 172.21.15.19:0/2333316692 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa68c06d740 con 0x7fa68c162340 2024-09-12T02:01:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.926+0000 7fa68affd640 1 -- 172.21.15.19:0/2333316692 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) ==== 170+0+0 (secure 0 0 0) 0x7fa68004b030 con 0x7fa68c162340 2024-09-12T02:01:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-09-12T02:01:15.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.929+0000 7fa6945f8640 1 -- 172.21.15.19:0/2333316692 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa67806be30 msgr2=0x7fa67806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:15.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.929+0000 7fa6945f8640 1 --2- 172.21.15.19:0/2333316692 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa67806be30 0x7fa67806e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa6840016b0 tx=0x7fa684009040 comp rx=0 tx=0).stop 2024-09-12T02:01:15.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.929+0000 7fa6945f8640 1 -- 172.21.15.19:0/2333316692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa68c162340 msgr2=0x7fa68c0cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.929+0000 7fa6945f8640 1 --2- 172.21.15.19:0/2333316692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa68c162340 0x7fa68c0cb5a0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa68002a1a0 tx=0x7fa6800046c0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.929+0000 7fa6945f8640 1 -- 172.21.15.19:0/2333316692 shutdown_connections 2024-09-12T02:01:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.929+0000 7fa6945f8640 1 --2- 172.21.15.19:0/2333316692 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa67806be30 0x7fa67806e2f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.929+0000 7fa6945f8640 1 --2- 172.21.15.19:0/2333316692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa68c162e30 0x7fa68c14b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.929+0000 7fa6945f8640 1 --2- 172.21.15.19:0/2333316692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa68c162340 0x7fa68c0cb5a0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.929+0000 7fa6945f8640 1 --2- 172.21.15.19:0/2333316692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa68c0cf280 0x7fa68c152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.929+0000 7fa6945f8640 1 -- 172.21.15.19:0/2333316692 >> 172.21.15.19:0/2333316692 conn(0x7fa68c08bfc0 msgr2=0x7fa68c162720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.929+0000 7fa6945f8640 1 -- 172.21.15.19:0/2333316692 shutdown_connections 2024-09-12T02:01:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:15.929+0000 7fa6945f8640 1 -- 172.21.15.19:0/2333316692 wait complete. 2024-09-12T02:01:15.957 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:01:16.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.066+0000 7facdc5b7640 1 Processor -- start 2024-09-12T02:01:16.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.066+0000 7facdc5b7640 1 -- start start 2024-09-12T02:01:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.067+0000 7facdc5b7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7facd4161a20 0x7facd40d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.067+0000 7facdc5b7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facd40d1830 con 0x7facd40d1420 2024-09-12T02:01:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.067+0000 7facdc5b7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facd40cf980 con 0x7facd40cf330 2024-09-12T02:01:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.067+0000 7facdc5b7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7facd40cf760 con 0x7facd4161a20 2024-09-12T02:01:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.067+0000 7facd9b52640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7facd40d1420 0x7facd40cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40666/0 (socket says 172.21.15.19:40666) 2024-09-12T02:01:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.067+0000 7facd9b52640 1 -- 172.21.15.19:0/2163169644 learned_addr learned my addr 172.21.15.19:0/2163169644 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.067+0000 7facda353640 1 --2- 172.21.15.19:0/2163169644 >> v2:172.21.15.135:3300/0 conn(0x7facd4161a20 0x7facd40d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.067+0000 7facd9351640 1 -- 172.21.15.19:0/2163169644 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1836401303 0 0) 0x7facc4001110 con 0x7facd40d1420 2024-09-12T02:01:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.067+0000 7facd9351640 1 -- 172.21.15.19:0/2163169644 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facc0003520 con 0x7facd40d1420 2024-09-12T02:01:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.067+0000 7facd9351640 1 -- 172.21.15.19:0/2163169644 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4073726912 0 0) 0x7facc0003520 con 0x7facd40d1420 2024-09-12T02:01:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.067+0000 7facd9351640 1 -- 172.21.15.19:0/2163169644 >> v2:172.21.15.135:3300/0 conn(0x7facd4161a20 msgr2=0x7facd40d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.067+0000 7facd9351640 1 --2- 172.21.15.19:0/2163169644 >> v2:172.21.15.135:3300/0 conn(0x7facd4161a20 0x7facd40d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.067+0000 7facd9351640 1 -- 172.21.15.19:0/2163169644 >> v1:172.21.15.135:6789/0 conn(0x7facd40cf330 legacy=0x7facd406d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.067+0000 7facd9351640 1 -- 172.21.15.19:0/2163169644 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd406d050 con 0x7facd40d1420 2024-09-12T02:01:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.067+0000 7facd9351640 1 -- 172.21.15.19:0/2163169644 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7facc4001840 con 0x7facd40d1420 2024-09-12T02:01:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.067+0000 7facd9351640 1 -- 172.21.15.19:0/2163169644 >> v1:172.21.15.19:6789/0 conn(0x7facd40d1420 legacy=0x7facd40cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.068+0000 7facd9351640 1 --2- 172.21.15.19:0/2163169644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facc00039b0 0x7facc0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.068+0000 7facd9351640 1 --2- 172.21.15.19:0/2163169644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facc0004800 0x7facc0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.068+0000 7facd9351640 1 --2- 172.21.15.19:0/2163169644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facc00051c0 0x7facc000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.068+0000 7facd9351640 1 -- 172.21.15.19:0/2163169644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7facd40cf760 con 0x7facc0004800 2024-09-12T02:01:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.068+0000 7facd9351640 1 -- 172.21.15.19:0/2163169644 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7facc000c060 con 0x7facc00051c0 2024-09-12T02:01:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.068+0000 7facd9351640 1 -- 172.21.15.19:0/2163169644 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7facc000c260 con 0x7facc00039b0 2024-09-12T02:01:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.068+0000 7facd9b52640 1 --2- 172.21.15.19:0/2163169644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facc0004800 0x7facc0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.068+0000 7facda353640 1 --2- 172.21.15.19:0/2163169644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facc00039b0 0x7facc0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.068+0000 7facdab54640 1 --2- 172.21.15.19:0/2163169644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facc00051c0 0x7facc000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.068+0000 7facd9b52640 1 -- 172.21.15.19:0/2163169644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facc00039b0 msgr2=0x7facc0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.068+0000 7facd9b52640 1 --2- 172.21.15.19:0/2163169644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facc00039b0 0x7facc0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.068+0000 7facd9b52640 1 -- 172.21.15.19:0/2163169644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facc00051c0 msgr2=0x7facc000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.068+0000 7facd9b52640 1 --2- 172.21.15.19:0/2163169644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facc00051c0 0x7facc000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.068+0000 7facdab54640 1 -- 172.21.15.19:0/2163169644 reap_dead start 2024-09-12T02:01:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.068+0000 7facd9b52640 1 -- 172.21.15.19:0/2163169644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc0003520 con 0x7facc0004800 2024-09-12T02:01:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.069+0000 7facd9b52640 1 --2- 172.21.15.19:0/2163169644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facc0004800 0x7facc0004c80 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7facc400c4c0 tx=0x7facc0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82152eac7103d2b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.069+0000 7facd9351640 1 -- 172.21.15.19:0/2163169644 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc400c0e0 con 0x7facc0004800 2024-09-12T02:01:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.069+0000 7facd9351640 1 -- 172.21.15.19:0/2163169644 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc4034070 con 0x7facc0004800 2024-09-12T02:01:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.069+0000 7facd9351640 1 -- 172.21.15.19:0/2163169644 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4005d70 con 0x7facc0004800 2024-09-12T02:01:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.069+0000 7facdc5b7640 1 -- 172.21.15.19:0/2163169644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facc0004800 msgr2=0x7facc0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:16.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.069+0000 7facdc5b7640 1 --2- 172.21.15.19:0/2163169644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facc0004800 0x7facc0004c80 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7facc400c4c0 tx=0x7facc0005830 comp rx=0 tx=0).stop 2024-09-12T02:01:16.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.070+0000 7facdc5b7640 1 -- 172.21.15.19:0/2163169644 shutdown_connections 2024-09-12T02:01:16.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.070+0000 7facdc5b7640 1 --2- 172.21.15.19:0/2163169644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facc0004800 0x7facc0004c80 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:16.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.070+0000 7facdc5b7640 1 -- 172.21.15.19:0/2163169644 >> 172.21.15.19:0/2163169644 conn(0x7facd409d850 msgr2=0x7facd408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:16.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.070+0000 7facdc5b7640 1 -- 172.21.15.19:0/2163169644 shutdown_connections 2024-09-12T02:01:16.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.070+0000 7facdc5b7640 1 -- 172.21.15.19:0/2163169644 wait complete. 2024-09-12T02:01:16.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.071+0000 7facdc5b7640 1 Processor -- start 2024-09-12T02:01:16.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.071+0000 7facdc5b7640 1 -- start start 2024-09-12T02:01:16.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facdc5b7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facc0004800 0x7facd4154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:16.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facdc5b7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd40b6380 0x7facd40cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:16.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facdc5b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facd40b6800 0x7facd40ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:16.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facdc5b7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7facd40cff00 con 0x7facd40b6800 2024-09-12T02:01:16.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facdc5b7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7facd4161e00 con 0x7facd40b6380 2024-09-12T02:01:16.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facdc5b7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7facd406d2f0 con 0x7facc0004800 2024-09-12T02:01:16.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facdab54640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facd40b6800 0x7facd40ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:16.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facdab54640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facd40b6800 0x7facd40ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54984/0 (socket says 172.21.15.19:54984) 2024-09-12T02:01:16.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facdab54640 1 -- 172.21.15.19:0/3281136129 learned_addr learned my addr 172.21.15.19:0/3281136129 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:16.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facda353640 1 --2- 172.21.15.19:0/3281136129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facc0004800 0x7facd4154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:16.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facd9b52640 1 --2- 172.21.15.19:0/3281136129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd40b6380 0x7facd40cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:16.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facdab54640 1 -- 172.21.15.19:0/3281136129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facc0004800 msgr2=0x7facd4154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:16.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facdab54640 1 --2- 172.21.15.19:0/3281136129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facc0004800 0x7facd4154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:16.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facdab54640 1 -- 172.21.15.19:0/3281136129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd40b6380 msgr2=0x7facd40cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:16.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facdab54640 1 --2- 172.21.15.19:0/3281136129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd40b6380 0x7facd40cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:16.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facdab54640 1 -- 172.21.15.19:0/3281136129 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd40b5060 con 0x7facd40b6800 2024-09-12T02:01:16.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facdab54640 1 --2- 172.21.15.19:0/3281136129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facd40b6800 0x7facd40ccf90 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7facd40c7fd0 tx=0x7faccc00fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:16.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7faccaffd640 1 -- 172.21.15.19:0/3281136129 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc01a070 con 0x7facd40b6800 2024-09-12T02:01:16.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7faccaffd640 1 -- 172.21.15.19:0/3281136129 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faccc006b50 con 0x7facd40b6800 2024-09-12T02:01:16.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facdc5b7640 1 -- 172.21.15.19:0/3281136129 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd40b52e0 con 0x7facd40b6800 2024-09-12T02:01:16.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7faccaffd640 1 -- 172.21.15.19:0/3281136129 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc003970 con 0x7facd40b6800 2024-09-12T02:01:16.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.072+0000 7facdc5b7640 1 -- 172.21.15.19:0/3281136129 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd40b58a0 con 0x7facd40b6800 2024-09-12T02:01:16.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.073+0000 7facdc5b7640 1 -- 172.21.15.19:0/3281136129 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd40b1040 con 0x7facd40b6800 2024-09-12T02:01:16.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.074+0000 7faccaffd640 1 -- 172.21.15.19:0/3281136129 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faccc01d070 con 0x7facd40b6800 2024-09-12T02:01:16.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.074+0000 7faccaffd640 1 --2- 172.21.15.19:0/3281136129 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7facb806be30 0x7facb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:16.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.074+0000 7faccaffd640 1 -- 172.21.15.19:0/3281136129 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6001+0+0 (secure 0 0 0) 0x7faccc08a390 con 0x7facd40b6800 2024-09-12T02:01:16.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.075+0000 7facda353640 1 --2- 172.21.15.19:0/3281136129 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7facb806be30 0x7facb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:16.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.075+0000 7facda353640 1 --2- 172.21.15.19:0/3281136129 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7facb806be30 0x7facb806e2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7facd0009c40 tx=0x7facd0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:16.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.079+0000 7faccaffd640 1 -- 172.21.15.19:0/3281136129 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7facd40b5060 con 0x7facd40b6800 2024-09-12T02:01:16.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.287+0000 7facdc5b7640 1 -- 172.21.15.19:0/3281136129 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7facd415da10 con 0x7facd40b6800 2024-09-12T02:01:16.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.955+0000 7faccaffd640 1 -- 172.21.15.19:0/3281136129 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v60) ==== 174+0+0 (secure 0 0 0) 0x7faccc058490 con 0x7facd40b6800 2024-09-12T02:01:16.956 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 11 and data pool 12 2024-09-12T02:01:16.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.963+0000 7facdc5b7640 1 -- 172.21.15.19:0/3281136129 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7facb806be30 msgr2=0x7facb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:16.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.963+0000 7facdc5b7640 1 --2- 172.21.15.19:0/3281136129 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7facb806be30 0x7facb806e2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7facd0009c40 tx=0x7facd0009190 comp rx=0 tx=0).stop 2024-09-12T02:01:16.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.963+0000 7facdc5b7640 1 -- 172.21.15.19:0/3281136129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facd40b6800 msgr2=0x7facd40ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:16.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.964+0000 7facdc5b7640 1 --2- 172.21.15.19:0/3281136129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facd40b6800 0x7facd40ccf90 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7facd40c7fd0 tx=0x7faccc00fb40 comp rx=0 tx=0).stop 2024-09-12T02:01:16.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.964+0000 7facdc5b7640 1 -- 172.21.15.19:0/3281136129 shutdown_connections 2024-09-12T02:01:16.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.964+0000 7facdc5b7640 1 --2- 172.21.15.19:0/3281136129 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7facb806be30 0x7facb806e2f0 secure :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7facd0009c40 tx=0x7facd0009190 comp rx=0 tx=0).stop 2024-09-12T02:01:16.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.964+0000 7facdc5b7640 1 --2- 172.21.15.19:0/3281136129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facd40b6800 0x7facd40ccf90 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:16.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.964+0000 7facdc5b7640 1 --2- 172.21.15.19:0/3281136129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd40b6380 0x7facd40cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:16.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.964+0000 7facdc5b7640 1 --2- 172.21.15.19:0/3281136129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facc0004800 0x7facd4154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:16.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.964+0000 7facdc5b7640 1 -- 172.21.15.19:0/3281136129 >> 172.21.15.19:0/3281136129 conn(0x7facd409d850 msgr2=0x7facd40d4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.968+0000 7facdc5b7640 1 -- 172.21.15.19:0/3281136129 shutdown_connections 2024-09-12T02:01:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:16.969+0000 7facdc5b7640 1 -- 172.21.15.19:0/3281136129 wait complete. 2024-09-12T02:01:16.990 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:01:17.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.096+0000 7f1aaefd8640 1 Processor -- start 2024-09-12T02:01:17.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.096+0000 7f1aaefd8640 1 -- start start 2024-09-12T02:01:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.097+0000 7f1aaefd8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1aa815e740 0x7f1aa80d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.097+0000 7f1aaefd8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1aa809b690 0x7f1aa806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.097+0000 7f1aaefd8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aa806e000 con 0x7f1aa806d4c0 2024-09-12T02:01:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.097+0000 7f1aaefd8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa815eb20 con 0x7f1aa815e740 2024-09-12T02:01:17.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.097+0000 7f1aaefd8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa806d260 con 0x7f1aa809b690 2024-09-12T02:01:17.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.098+0000 7f1aacd74640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1aa815e740 0x7f1aa80d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.098+0000 7f1aa7fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1aa809b690 0x7f1aa806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.098+0000 7f1aad575640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f1aa806d4c0 0x7f1aa806d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:38496/0 (socket says 172.21.15.19:38496) 2024-09-12T02:01:17.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.098+0000 7f1aad575640 1 -- 172.21.15.19:0/1658057391 learned_addr learned my addr 172.21.15.19:0/1658057391 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:17.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.098+0000 7f1aa77fe640 1 -- 172.21.15.19:0/1658057391 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1133795924 0 0) 0x7f1aa806e000 con 0x7f1aa806d4c0 2024-09-12T02:01:17.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.098+0000 7f1aa77fe640 1 -- 172.21.15.19:0/1658057391 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a90003520 con 0x7f1aa806d4c0 2024-09-12T02:01:17.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.098+0000 7f1aacd74640 1 -- 172.21.15.19:0/1658057391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1aa809b690 msgr2=0x7f1aa806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:17.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.098+0000 7f1aacd74640 1 --2- 172.21.15.19:0/1658057391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1aa809b690 0x7f1aa806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.098+0000 7f1aacd74640 1 -- 172.21.15.19:0/1658057391 >> v1:172.21.15.135:6789/0 conn(0x7f1aa806d4c0 legacy=0x7f1aa806d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.098+0000 7f1aacd74640 1 -- 172.21.15.19:0/1658057391 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa80d0780 con 0x7f1aa815e740 2024-09-12T02:01:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.098+0000 7f1aa7fff640 1 --2- 172.21.15.19:0/1658057391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1aa809b690 0x7f1aa806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.099+0000 7f1aacd74640 1 --2- 172.21.15.19:0/1658057391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1aa815e740 0x7f1aa80d1540 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1a980097a0 tx=0x7f1a9802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=127c916f966e6d58 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.099+0000 7f1aa77fe640 1 -- 172.21.15.19:0/1658057391 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98037070 con 0x7f1aa815e740 2024-09-12T02:01:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.099+0000 7f1aa77fe640 1 -- 172.21.15.19:0/1658057391 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a98032440 con 0x7f1aa815e740 2024-09-12T02:01:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.099+0000 7f1aa77fe640 1 -- 172.21.15.19:0/1658057391 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a980327f0 con 0x7f1aa815e740 2024-09-12T02:01:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.100+0000 7f1aaefd8640 1 -- 172.21.15.19:0/1658057391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1aa815e740 msgr2=0x7f1aa80d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.100+0000 7f1aaefd8640 1 --2- 172.21.15.19:0/1658057391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1aa815e740 0x7f1aa80d1540 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1a980097a0 tx=0x7f1a9802a210 comp rx=0 tx=0).stop 2024-09-12T02:01:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.100+0000 7f1aaefd8640 1 -- 172.21.15.19:0/1658057391 shutdown_connections 2024-09-12T02:01:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.100+0000 7f1aaefd8640 1 --2- 172.21.15.19:0/1658057391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1aa809b690 0x7f1aa806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.100+0000 7f1aaefd8640 1 --2- 172.21.15.19:0/1658057391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1aa815e740 0x7f1aa80d1540 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.100+0000 7f1aaefd8640 1 -- 172.21.15.19:0/1658057391 >> 172.21.15.19:0/1658057391 conn(0x7f1aa80d23a0 msgr2=0x7f1aa80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.100+0000 7f1aaefd8640 1 -- 172.21.15.19:0/1658057391 shutdown_connections 2024-09-12T02:01:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.100+0000 7f1aaefd8640 1 -- 172.21.15.19:0/1658057391 wait complete. 2024-09-12T02:01:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.101+0000 7f1aaefd8640 1 Processor -- start 2024-09-12T02:01:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.101+0000 7f1aaefd8640 1 -- start start 2024-09-12T02:01:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.102+0000 7f1aaefd8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1aa806d4c0 0x7f1aa8158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.102+0000 7f1aaefd8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aa809b690 0x7f1aa8157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.102+0000 7f1aaefd8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1aa815e740 0x7f1aa80ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.102+0000 7f1aaefd8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa80d1020 con 0x7f1aa809b690 2024-09-12T02:01:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.102+0000 7f1aaefd8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa80d0d40 con 0x7f1aa806d4c0 2024-09-12T02:01:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.102+0000 7f1aaefd8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa809ba90 con 0x7f1aa815e740 2024-09-12T02:01:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.102+0000 7f1aa7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aa809b690 0x7f1aa8157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.102+0000 7f1aa7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aa809b690 0x7f1aa8157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54994/0 (socket says 172.21.15.19:54994) 2024-09-12T02:01:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.102+0000 7f1aa7fff640 1 -- 172.21.15.19:0/3887656991 learned_addr learned my addr 172.21.15.19:0/3887656991 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.102+0000 7f1aad575640 1 --2- 172.21.15.19:0/3887656991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1aa815e740 0x7f1aa80ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.102+0000 7f1aacd74640 1 --2- 172.21.15.19:0/3887656991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1aa806d4c0 0x7f1aa8158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.102+0000 7f1aa7fff640 1 -- 172.21.15.19:0/3887656991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1aa815e740 msgr2=0x7f1aa80ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.102+0000 7f1aa7fff640 1 --2- 172.21.15.19:0/3887656991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1aa815e740 0x7f1aa80ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.102+0000 7f1aa7fff640 1 -- 172.21.15.19:0/3887656991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1aa806d4c0 msgr2=0x7f1aa8158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.102+0000 7f1aa7fff640 1 --2- 172.21.15.19:0/3887656991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1aa806d4c0 0x7f1aa8158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.102+0000 7f1aa7fff640 1 -- 172.21.15.19:0/3887656991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa8158680 con 0x7f1aa809b690 2024-09-12T02:01:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.102+0000 7f1aa7fff640 1 --2- 172.21.15.19:0/3887656991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aa809b690 0x7f1aa8157890 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00ebe0 tx=0x7f1a9c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.103+0000 7f1aa57fa640 1 -- 172.21.15.19:0/3887656991 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c017070 con 0x7f1aa809b690 2024-09-12T02:01:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.103+0000 7f1aa57fa640 1 -- 172.21.15.19:0/3887656991 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a9c00cc30 con 0x7f1aa809b690 2024-09-12T02:01:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.103+0000 7f1aa57fa640 1 -- 172.21.15.19:0/3887656991 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c013470 con 0x7f1aa809b690 2024-09-12T02:01:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.103+0000 7f1aaefd8640 1 -- 172.21.15.19:0/3887656991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa80cb000 con 0x7f1aa809b690 2024-09-12T02:01:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.103+0000 7f1aaefd8640 1 -- 172.21.15.19:0/3887656991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa80b6ce0 con 0x7f1aa809b690 2024-09-12T02:01:17.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.104+0000 7f1aaefd8640 1 -- 172.21.15.19:0/3887656991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa806cd20 con 0x7f1aa809b690 2024-09-12T02:01:17.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.104+0000 7f1aa57fa640 1 -- 172.21.15.19:0/3887656991 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a9c01a070 con 0x7f1aa809b690 2024-09-12T02:01:17.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.105+0000 7f1aa57fa640 1 --2- 172.21.15.19:0/3887656991 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1a9406be30 0x7f1a9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.105+0000 7f1aa57fa640 1 -- 172.21.15.19:0/3887656991 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6101+0+0 (secure 0 0 0) 0x7f1a9c08ae60 con 0x7f1aa809b690 2024-09-12T02:01:17.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.105+0000 7f1aacd74640 1 --2- 172.21.15.19:0/3887656991 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1a9406be30 0x7f1a9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.105+0000 7f1aacd74640 1 --2- 172.21.15.19:0/3887656991 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1a9406be30 0x7f1a9406e2f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1a98034000 tx=0x7f1a9802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:17.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.109+0000 7f1aa57fa640 1 -- 172.21.15.19:0/3887656991 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1aa80cb000 con 0x7f1aa809b690 2024-09-12T02:01:17.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.286+0000 7f1aaefd8640 1 -- 172.21.15.19:0/3887656991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1aa80d1cb0 con 0x7f1aa809b690 2024-09-12T02:01:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.287+0000 7f1aa57fa640 1 -- 172.21.15.19:0/3887656991 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+17006 (secure 0 0 0) 0x7f1a9c0590c0 con 0x7f1aa809b690 2024-09-12T02:01:17.288 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:17.288 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":80,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:01:16.289073+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:01:13.953490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-12T02:01:15.281758+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:01:17.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.289+0000 7f1aaefd8640 1 -- 172.21.15.19:0/3887656991 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1a9406be30 msgr2=0x7f1a9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.289+0000 7f1aaefd8640 1 --2- 172.21.15.19:0/3887656991 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1a9406be30 0x7f1a9406e2f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1a98034000 tx=0x7f1a9802e000 comp rx=0 tx=0).stop 2024-09-12T02:01:17.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.289+0000 7f1aaefd8640 1 -- 172.21.15.19:0/3887656991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aa809b690 msgr2=0x7f1aa8157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.289+0000 7f1aaefd8640 1 --2- 172.21.15.19:0/3887656991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aa809b690 0x7f1aa8157890 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00ebe0 tx=0x7f1a9c00c520 comp rx=0 tx=0).stop 2024-09-12T02:01:17.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.290+0000 7f1aaefd8640 1 -- 172.21.15.19:0/3887656991 shutdown_connections 2024-09-12T02:01:17.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.290+0000 7f1aaefd8640 1 --2- 172.21.15.19:0/3887656991 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1a9406be30 0x7f1a9406e2f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.290+0000 7f1aaefd8640 1 --2- 172.21.15.19:0/3887656991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1aa815e740 0x7f1aa80ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.290+0000 7f1aaefd8640 1 --2- 172.21.15.19:0/3887656991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aa809b690 0x7f1aa8157890 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.290+0000 7f1aaefd8640 1 --2- 172.21.15.19:0/3887656991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1aa806d4c0 0x7f1aa8158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.290+0000 7f1aaefd8640 1 -- 172.21.15.19:0/3887656991 >> 172.21.15.19:0/3887656991 conn(0x7f1aa80d23a0 msgr2=0x7f1aa80b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:17.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.290+0000 7f1aaefd8640 1 -- 172.21.15.19:0/3887656991 shutdown_connections 2024-09-12T02:01:17.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.290+0000 7f1aaefd8640 1 -- 172.21.15.19:0/3887656991 wait complete. 2024-09-12T02:01:17.301 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:01:17.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.403+0000 7f279e0c0640 1 Processor -- start 2024-09-12T02:01:17.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.403+0000 7f279e0c0640 1 -- start start 2024-09-12T02:01:17.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.404+0000 7f279e0c0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f27980d30f0 0x7f27980b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.404+0000 7f279e0c0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f27980b64c0 0x7f279806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.404+0000 7f279e0c0640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27980d3690 con 0x7f279815e5f0 2024-09-12T02:01:17.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.404+0000 7f279e0c0640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f279806d530 con 0x7f27980b64c0 2024-09-12T02:01:17.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.404+0000 7f279e0c0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f27980d3970 con 0x7f27980d30f0 2024-09-12T02:01:17.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.404+0000 7f2797fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f27980b64c0 0x7f279806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.404+0000 7f27977fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f279815e5f0 0x7f27980d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40672/0 (socket says 172.21.15.19:40672) 2024-09-12T02:01:17.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.404+0000 7f27977fe640 1 -- 172.21.15.19:0/1434680617 learned_addr learned my addr 172.21.15.19:0/1434680617 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:17.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.404+0000 7f2796ffd640 1 --2- 172.21.15.19:0/1434680617 >> v2:172.21.15.135:3300/0 conn(0x7f27980d30f0 0x7f27980b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.404+0000 7f2797fff640 1 -- 172.21.15.19:0/1434680617 >> v2:172.21.15.135:3300/0 conn(0x7f27980d30f0 msgr2=0x7f27980b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:17.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.404+0000 7f2797fff640 1 --2- 172.21.15.19:0/1434680617 >> v2:172.21.15.135:3300/0 conn(0x7f27980d30f0 0x7f27980b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.404+0000 7f2797fff640 1 -- 172.21.15.19:0/1434680617 >> v1:172.21.15.19:6789/0 conn(0x7f279815e5f0 legacy=0x7f27980d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.404+0000 7f27967fc640 1 -- 172.21.15.19:0/1434680617 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2919300259 0 0) 0x7f27980d3690 con 0x7f279815e5f0 2024-09-12T02:01:17.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.404+0000 7f2797fff640 1 -- 172.21.15.19:0/1434680617 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279806cee0 con 0x7f27980b64c0 2024-09-12T02:01:17.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.405+0000 7f2797fff640 1 --2- 172.21.15.19:0/1434680617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27980b64c0 0x7f279806d9c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f279808e520 tx=0x7f279002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc56fb60f3ccabf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:17.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.405+0000 7f27967fc640 1 -- 172.21.15.19:0/1434680617 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790007740 con 0x7f27980b64c0 2024-09-12T02:01:17.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.405+0000 7f27967fc640 1 -- 172.21.15.19:0/1434680617 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27900078e0 con 0x7f27980b64c0 2024-09-12T02:01:17.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.405+0000 7f27967fc640 1 -- 172.21.15.19:0/1434680617 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790007cb0 con 0x7f27980b64c0 2024-09-12T02:01:17.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.406+0000 7f279e0c0640 1 -- 172.21.15.19:0/1434680617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27980b64c0 msgr2=0x7f279806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.406+0000 7f279e0c0640 1 --2- 172.21.15.19:0/1434680617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27980b64c0 0x7f279806d9c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f279808e520 tx=0x7f279002a680 comp rx=0 tx=0).stop 2024-09-12T02:01:17.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.406+0000 7f279e0c0640 1 -- 172.21.15.19:0/1434680617 shutdown_connections 2024-09-12T02:01:17.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.406+0000 7f279e0c0640 1 --2- 172.21.15.19:0/1434680617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27980b64c0 0x7f279806d9c0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.406+0000 7f279e0c0640 1 --2- 172.21.15.19:0/1434680617 >> v2:172.21.15.135:3300/0 conn(0x7f27980d30f0 0x7f27980b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.406+0000 7f279e0c0640 1 -- 172.21.15.19:0/1434680617 >> 172.21.15.19:0/1434680617 conn(0x7f279808bfc0 msgr2=0x7f27980d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:17.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.406+0000 7f279e0c0640 1 -- 172.21.15.19:0/1434680617 shutdown_connections 2024-09-12T02:01:17.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.406+0000 7f279e0c0640 1 -- 172.21.15.19:0/1434680617 wait complete. 2024-09-12T02:01:17.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.407+0000 7f279e0c0640 1 Processor -- start 2024-09-12T02:01:17.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.407+0000 7f279e0c0640 1 -- start start 2024-09-12T02:01:17.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.408+0000 7f279e0c0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27980b64c0 0x7f2798158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.408+0000 7f279e0c0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27980d30f0 0x7f2798159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.408+0000 7f279e0c0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f279815e5f0 0x7f279815f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.408+0000 7f279e0c0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f279806df00 con 0x7f27980d30f0 2024-09-12T02:01:17.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.408+0000 7f279e0c0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f279815e9d0 con 0x7f27980b64c0 2024-09-12T02:01:17.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.408+0000 7f279e0c0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f279806e080 con 0x7f279815e5f0 2024-09-12T02:01:17.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.408+0000 7f2796ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27980d30f0 0x7f2798159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.408+0000 7f2796ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27980d30f0 0x7f2798159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55016/0 (socket says 172.21.15.19:55016) 2024-09-12T02:01:17.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.408+0000 7f2796ffd640 1 -- 172.21.15.19:0/1167362504 learned_addr learned my addr 172.21.15.19:0/1167362504 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:17.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.408+0000 7f27977fe640 1 --2- 172.21.15.19:0/1167362504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27980b64c0 0x7f2798158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.408+0000 7f2797fff640 1 --2- 172.21.15.19:0/1167362504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f279815e5f0 0x7f279815f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.408+0000 7f2796ffd640 1 -- 172.21.15.19:0/1167362504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f279815e5f0 msgr2=0x7f279815f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.408+0000 7f2796ffd640 1 --2- 172.21.15.19:0/1167362504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f279815e5f0 0x7f279815f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.408+0000 7f2796ffd640 1 -- 172.21.15.19:0/1167362504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27980b64c0 msgr2=0x7f2798158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.408+0000 7f2796ffd640 1 --2- 172.21.15.19:0/1167362504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27980b64c0 0x7f2798158b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.408+0000 7f2796ffd640 1 -- 172.21.15.19:0/1167362504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279815ff90 con 0x7f27980d30f0 2024-09-12T02:01:17.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.408+0000 7f2796ffd640 1 --2- 172.21.15.19:0/1167362504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27980d30f0 0x7f2798159f80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f278c00e9b0 tx=0x7f278c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:17.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.409+0000 7f277ffff640 1 -- 172.21.15.19:0/1167362504 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c017070 con 0x7f27980d30f0 2024-09-12T02:01:17.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.409+0000 7f277ffff640 1 -- 172.21.15.19:0/1167362504 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f278c00c9a0 con 0x7f27980d30f0 2024-09-12T02:01:17.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.409+0000 7f279e0c0640 1 -- 172.21.15.19:0/1167362504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27980c81d0 con 0x7f27980d30f0 2024-09-12T02:01:17.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.409+0000 7f277ffff640 1 -- 172.21.15.19:0/1167362504 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c00cd90 con 0x7f27980d30f0 2024-09-12T02:01:17.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.409+0000 7f279e0c0640 1 -- 172.21.15.19:0/1167362504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27980c8790 con 0x7f27980d30f0 2024-09-12T02:01:17.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.410+0000 7f279e0c0640 1 -- 172.21.15.19:0/1167362504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f279806d9c0 con 0x7f27980d30f0 2024-09-12T02:01:17.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.410+0000 7f277ffff640 1 -- 172.21.15.19:0/1167362504 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f278c01a070 con 0x7f27980d30f0 2024-09-12T02:01:17.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.411+0000 7f277ffff640 1 --2- 172.21.15.19:0/1167362504 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f278406be30 0x7f278406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.411+0000 7f277ffff640 1 -- 172.21.15.19:0/1167362504 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6101+0+0 (secure 0 0 0) 0x7f278c08b370 con 0x7f27980d30f0 2024-09-12T02:01:17.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.411+0000 7f27977fe640 1 --2- 172.21.15.19:0/1167362504 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f278406be30 0x7f278406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.411+0000 7f27977fe640 1 --2- 172.21.15.19:0/1167362504 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f278406be30 0x7f278406e2f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2788000f60 tx=0x7f2788009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:17.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.415+0000 7f277ffff640 1 -- 172.21.15.19:0/1167362504 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f278c059b90 con 0x7f27980d30f0 2024-09-12T02:01:17.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.590+0000 7f279e0c0640 1 -- 172.21.15.19:0/1167362504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27980b69d0 con 0x7f27980d30f0 2024-09-12T02:01:17.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.591+0000 7f277ffff640 1 -- 172.21.15.19:0/1167362504 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+17006 (secure 0 0 0) 0x7f278c059490 con 0x7f27980d30f0 2024-09-12T02:01:17.592 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:17.592 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":80,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:01:16.289073+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:01:13.953490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-12T02:01:15.281758+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:01:17.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.593+0000 7f279e0c0640 1 -- 172.21.15.19:0/1167362504 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f278406be30 msgr2=0x7f278406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.593+0000 7f279e0c0640 1 --2- 172.21.15.19:0/1167362504 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f278406be30 0x7f278406e2f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2788000f60 tx=0x7f2788009040 comp rx=0 tx=0).stop 2024-09-12T02:01:17.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.593+0000 7f279e0c0640 1 -- 172.21.15.19:0/1167362504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27980d30f0 msgr2=0x7f2798159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.593+0000 7f279e0c0640 1 --2- 172.21.15.19:0/1167362504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27980d30f0 0x7f2798159f80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f278c00e9b0 tx=0x7f278c00ee70 comp rx=0 tx=0).stop 2024-09-12T02:01:17.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.593+0000 7f279e0c0640 1 -- 172.21.15.19:0/1167362504 shutdown_connections 2024-09-12T02:01:17.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.593+0000 7f279e0c0640 1 --2- 172.21.15.19:0/1167362504 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f278406be30 0x7f278406e2f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.593+0000 7f279e0c0640 1 --2- 172.21.15.19:0/1167362504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f279815e5f0 0x7f279815f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.593+0000 7f279e0c0640 1 --2- 172.21.15.19:0/1167362504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27980d30f0 0x7f2798159f80 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.593+0000 7f279e0c0640 1 --2- 172.21.15.19:0/1167362504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27980b64c0 0x7f2798158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.593+0000 7f279e0c0640 1 -- 172.21.15.19:0/1167362504 >> 172.21.15.19:0/1167362504 conn(0x7f279808bfc0 msgr2=0x7f27980b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:17.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.593+0000 7f279e0c0640 1 -- 172.21.15.19:0/1167362504 shutdown_connections 2024-09-12T02:01:17.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.593+0000 7f279e0c0640 1 -- 172.21.15.19:0/1167362504 wait complete. 2024-09-12T02:01:17.605 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:01:17.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.710+0000 7fb47bd6d640 1 Processor -- start 2024-09-12T02:01:17.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.710+0000 7fb47bd6d640 1 -- start start 2024-09-12T02:01:17.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.711+0000 7fb47bd6d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb4740b4020 0x7fb4740b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.711+0000 7fb47bd6d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4740b4620 con 0x7fb474072050 2024-09-12T02:01:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.711+0000 7fb47bd6d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4740ce100 con 0x7fb47415e900 2024-09-12T02:01:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.711+0000 7fb47bd6d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb4740b4f60 con 0x7fb4740b4020 2024-09-12T02:01:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.711+0000 7fb47a30a640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb474072050 0x7fb4740cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40680/0 (socket says 172.21.15.19:40680) 2024-09-12T02:01:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.711+0000 7fb47a30a640 1 -- 172.21.15.19:0/1372651067 learned_addr learned my addr 172.21.15.19:0/1372651067 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.711+0000 7fb479308640 1 --2- 172.21.15.19:0/1372651067 >> v2:172.21.15.135:3300/0 conn(0x7fb4740b4020 0x7fb4740b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.711+0000 7fb478b07640 1 -- 172.21.15.19:0/1372651067 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3257914581 0 0) 0x7fb4740b4620 con 0x7fb474072050 2024-09-12T02:01:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.711+0000 7fb478b07640 1 -- 172.21.15.19:0/1372651067 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb460003520 con 0x7fb474072050 2024-09-12T02:01:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb478b07640 1 -- 172.21.15.19:0/1372651067 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2025461589 0 0) 0x7fb460003520 con 0x7fb474072050 2024-09-12T02:01:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb478b07640 1 -- 172.21.15.19:0/1372651067 >> v2:172.21.15.135:3300/0 conn(0x7fb4740b4020 msgr2=0x7fb4740b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb478b07640 1 --2- 172.21.15.19:0/1372651067 >> v2:172.21.15.135:3300/0 conn(0x7fb4740b4020 0x7fb4740b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb478b07640 1 -- 172.21.15.19:0/1372651067 >> v1:172.21.15.135:6789/0 conn(0x7fb47415e900 legacy=0x7fb4740ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb478b07640 1 -- 172.21.15.19:0/1372651067 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4740ce3a0 con 0x7fb474072050 2024-09-12T02:01:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb478b07640 1 -- 172.21.15.19:0/1372651067 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fb46c0019f0 con 0x7fb474072050 2024-09-12T02:01:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb479308640 1 --2- 172.21.15.19:0/1372651067 >> v2:172.21.15.135:3300/0 conn(0x7fb4740b4020 0x7fb4740b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb478b07640 1 -- 172.21.15.19:0/1372651067 >> v1:172.21.15.19:6789/0 conn(0x7fb474072050 legacy=0x7fb4740cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb478b07640 1 --2- 172.21.15.19:0/1372651067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4600039b0 0x7fb460003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb478b07640 1 --2- 172.21.15.19:0/1372651067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb460004800 0x7fb460004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb478b07640 1 --2- 172.21.15.19:0/1372651067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4600051c0 0x7fb46000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb478b07640 1 -- 172.21.15.19:0/1372651067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb4740b4f60 con 0x7fb4600039b0 2024-09-12T02:01:17.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb478b07640 1 -- 172.21.15.19:0/1372651067 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb46000c160 con 0x7fb460004800 2024-09-12T02:01:17.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb478b07640 1 -- 172.21.15.19:0/1372651067 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb46000c360 con 0x7fb4600051c0 2024-09-12T02:01:17.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb479b09640 1 --2- 172.21.15.19:0/1372651067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4600039b0 0x7fb460003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb47a30a640 1 --2- 172.21.15.19:0/1372651067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4600051c0 0x7fb46000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb479308640 1 --2- 172.21.15.19:0/1372651067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb460004800 0x7fb460004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb479b09640 1 -- 172.21.15.19:0/1372651067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4600051c0 msgr2=0x7fb46000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:17.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb479b09640 1 --2- 172.21.15.19:0/1372651067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4600051c0 0x7fb46000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb479b09640 1 -- 172.21.15.19:0/1372651067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb460004800 msgr2=0x7fb460004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:17.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb479b09640 1 --2- 172.21.15.19:0/1372651067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb460004800 0x7fb460004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb479b09640 1 -- 172.21.15.19:0/1372651067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb460003520 con 0x7fb4600039b0 2024-09-12T02:01:17.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb47a30a640 1 --2- 172.21.15.19:0/1372651067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4600051c0 0x7fb46000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:17.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.712+0000 7fb47a30a640 1 -- 172.21.15.19:0/1372651067 reap_dead start 2024-09-12T02:01:17.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.713+0000 7fb479b09640 1 --2- 172.21.15.19:0/1372651067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4600039b0 0x7fb460003dd0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb464001750 tx=0x7fb460005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ad5aecc3a4ef04 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:17.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.713+0000 7fb478b07640 1 -- 172.21.15.19:0/1372651067 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb464001370 con 0x7fb4600039b0 2024-09-12T02:01:17.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.713+0000 7fb478b07640 1 -- 172.21.15.19:0/1372651067 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4640052d0 con 0x7fb4600039b0 2024-09-12T02:01:17.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.713+0000 7fb478b07640 1 -- 172.21.15.19:0/1372651067 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46402abc0 con 0x7fb4600039b0 2024-09-12T02:01:17.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.714+0000 7fb47bd6d640 1 -- 172.21.15.19:0/1372651067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4600039b0 msgr2=0x7fb460003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.714+0000 7fb47bd6d640 1 --2- 172.21.15.19:0/1372651067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4600039b0 0x7fb460003dd0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb464001750 tx=0x7fb460005830 comp rx=0 tx=0).stop 2024-09-12T02:01:17.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.714+0000 7fb47bd6d640 1 -- 172.21.15.19:0/1372651067 shutdown_connections 2024-09-12T02:01:17.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.714+0000 7fb47bd6d640 1 --2- 172.21.15.19:0/1372651067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4600039b0 0x7fb460003dd0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.714+0000 7fb47bd6d640 1 -- 172.21.15.19:0/1372651067 >> 172.21.15.19:0/1372651067 conn(0x7fb47406bdf0 msgr2=0x7fb47406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:17.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.714+0000 7fb47bd6d640 1 -- 172.21.15.19:0/1372651067 shutdown_connections 2024-09-12T02:01:17.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.714+0000 7fb47bd6d640 1 -- 172.21.15.19:0/1372651067 wait complete. 2024-09-12T02:01:17.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.715+0000 7fb47bd6d640 1 Processor -- start 2024-09-12T02:01:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.715+0000 7fb47bd6d640 1 -- start start 2024-09-12T02:01:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb47bd6d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4600039b0 0x7fb47409dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb47bd6d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4740cd750 0x7fb4741514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb47bd6d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4740ceba0 0x7fb4740cf020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb47bd6d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb4740b4a20 con 0x7fb4600039b0 2024-09-12T02:01:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb47bd6d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb4740ce960 con 0x7fb4740cd750 2024-09-12T02:01:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb47bd6d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb4740b4ba0 con 0x7fb4740ceba0 2024-09-12T02:01:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb479b09640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4600039b0 0x7fb47409dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb479b09640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4600039b0 0x7fb47409dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55042/0 (socket says 172.21.15.19:55042) 2024-09-12T02:01:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb479b09640 1 -- 172.21.15.19:0/1020216180 learned_addr learned my addr 172.21.15.19:0/1020216180 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb479308640 1 --2- 172.21.15.19:0/1020216180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4740cd750 0x7fb4741514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb479b09640 1 -- 172.21.15.19:0/1020216180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4740ceba0 msgr2=0x7fb4740cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb479b09640 1 --2- 172.21.15.19:0/1020216180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4740ceba0 0x7fb4740cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb479b09640 1 -- 172.21.15.19:0/1020216180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4740cd750 msgr2=0x7fb4741514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb479b09640 1 --2- 172.21.15.19:0/1020216180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4740cd750 0x7fb4741514f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb479b09640 1 -- 172.21.15.19:0/1020216180 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4741f2880 con 0x7fb4600039b0 2024-09-12T02:01:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb479b09640 1 --2- 172.21.15.19:0/1020216180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4600039b0 0x7fb47409dbc0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb464005040 tx=0x7fb464001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb46a7fc640 1 -- 172.21.15.19:0/1020216180 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb464037040 con 0x7fb4600039b0 2024-09-12T02:01:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb46a7fc640 1 -- 172.21.15.19:0/1020216180 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb464005480 con 0x7fb4600039b0 2024-09-12T02:01:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb47bd6d640 1 -- 172.21.15.19:0/1020216180 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4741f2b60 con 0x7fb4600039b0 2024-09-12T02:01:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.716+0000 7fb46a7fc640 1 -- 172.21.15.19:0/1020216180 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb464007a30 con 0x7fb4600039b0 2024-09-12T02:01:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.717+0000 7fb47bd6d640 1 -- 172.21.15.19:0/1020216180 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb474155420 con 0x7fb4600039b0 2024-09-12T02:01:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.718+0000 7fb47bd6d640 1 -- 172.21.15.19:0/1020216180 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb474072480 con 0x7fb4600039b0 2024-09-12T02:01:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.718+0000 7fb46a7fc640 1 -- 172.21.15.19:0/1020216180 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb464044020 con 0x7fb4600039b0 2024-09-12T02:01:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.719+0000 7fb46a7fc640 1 --2- 172.21.15.19:0/1020216180 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb45806be30 0x7fb45806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.719+0000 7fb46a7fc640 1 -- 172.21.15.19:0/1020216180 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6101+0+0 (secure 0 0 0) 0x7fb464007640 con 0x7fb4600039b0 2024-09-12T02:01:17.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.719+0000 7fb479308640 1 --2- 172.21.15.19:0/1020216180 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb45806be30 0x7fb45806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:17.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.720+0000 7fb479308640 1 --2- 172.21.15.19:0/1020216180 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb45806be30 0x7fb45806e2f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb4740b0600 tx=0x7fb470008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.723+0000 7fb46a7fc640 1 -- 172.21.15.19:0/1020216180 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4640795d0 con 0x7fb4600039b0 2024-09-12T02:01:17.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.936+0000 7fb47bd6d640 1 -- 172.21.15.19:0/1020216180 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb4740d05d0 con 0x7fb4600039b0 2024-09-12T02:01:17.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.959+0000 7fb46a7fc640 1 -- 172.21.15.19:0/1020216180 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v61) ==== 118+0+0 (secure 0 0 0) 0x7fb464078ed0 con 0x7fb4600039b0 2024-09-12T02:01:17.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.961+0000 7fb47bd6d640 1 -- 172.21.15.19:0/1020216180 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb45806be30 msgr2=0x7fb45806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.961+0000 7fb47bd6d640 1 --2- 172.21.15.19:0/1020216180 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb45806be30 0x7fb45806e2f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb4740b0600 tx=0x7fb470008040 comp rx=0 tx=0).stop 2024-09-12T02:01:17.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.961+0000 7fb47bd6d640 1 -- 172.21.15.19:0/1020216180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4600039b0 msgr2=0x7fb47409dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:17.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.961+0000 7fb47bd6d640 1 --2- 172.21.15.19:0/1020216180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4600039b0 0x7fb47409dbc0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb464005040 tx=0x7fb464001120 comp rx=0 tx=0).stop 2024-09-12T02:01:17.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.961+0000 7fb47bd6d640 1 -- 172.21.15.19:0/1020216180 shutdown_connections 2024-09-12T02:01:17.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.961+0000 7fb47bd6d640 1 --2- 172.21.15.19:0/1020216180 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb45806be30 0x7fb45806e2f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.961+0000 7fb47bd6d640 1 --2- 172.21.15.19:0/1020216180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4740ceba0 0x7fb4740cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.961+0000 7fb47bd6d640 1 --2- 172.21.15.19:0/1020216180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4740cd750 0x7fb4741514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.961+0000 7fb47bd6d640 1 --2- 172.21.15.19:0/1020216180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4600039b0 0x7fb47409dbc0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:17.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.961+0000 7fb47bd6d640 1 -- 172.21.15.19:0/1020216180 >> 172.21.15.19:0/1020216180 conn(0x7fb47406bdf0 msgr2=0x7fb4740cc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:17.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.961+0000 7fb47bd6d640 1 -- 172.21.15.19:0/1020216180 shutdown_connections 2024-09-12T02:01:17.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:17.961+0000 7fb47bd6d640 1 -- 172.21.15.19:0/1020216180 wait complete. 2024-09-12T02:01:17.974 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:01:17.974 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:01:18.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.078+0000 7f51ec8c9640 1 Processor -- start 2024-09-12T02:01:18.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.078+0000 7f51ec8c9640 1 -- start start 2024-09-12T02:01:18.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.079+0000 7f51ec8c9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51e80b5fe0 0x7f51e80aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:18.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.079+0000 7f51ec8c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51e806bc10 0x7f51e806c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:18.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.079+0000 7f51ec8c9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e80ae240 con 0x7f51e815e410 2024-09-12T02:01:18.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.079+0000 7f51ec8c9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f51e806c5c0 con 0x7f51e80b5fe0 2024-09-12T02:01:18.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.079+0000 7f51ec8c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f51e80b6430 con 0x7f51e806bc10 2024-09-12T02:01:18.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.079+0000 7f51e5d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51e80b5fe0 0x7f51e80aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:18.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.079+0000 7f51e5d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51e80b5fe0 0x7f51e80aff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55044/0 (socket says 172.21.15.19:55044) 2024-09-12T02:01:18.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.079+0000 7f51e5d9b640 1 -- 172.21.15.19:0/1265094701 learned_addr learned my addr 172.21.15.19:0/1265094701 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:18.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.080+0000 7f51e6d9d640 1 --2- 172.21.15.19:0/1265094701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51e806bc10 0x7f51e806c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:18.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.080+0000 7f51e5d9b640 1 -- 172.21.15.19:0/1265094701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51e806bc10 msgr2=0x7f51e806c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:18.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.080+0000 7f51e5d9b640 1 --2- 172.21.15.19:0/1265094701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51e806bc10 0x7f51e806c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:18.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.080+0000 7f51e5d9b640 1 -- 172.21.15.19:0/1265094701 >> v1:172.21.15.135:6789/0 conn(0x7f51e815e410 legacy=0x7f51e80b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:18.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.080+0000 7f51e5d9b640 1 -- 172.21.15.19:0/1265094701 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e80ae520 con 0x7f51e80b5fe0 2024-09-12T02:01:18.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.080+0000 7f51e5d9b640 1 --2- 172.21.15.19:0/1265094701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51e80b5fe0 0x7f51e80aff40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009870 tx=0x7f51d002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b858cfd43c089b36 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:18.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.081+0000 7f51e559a640 1 -- 172.21.15.19:0/1265094701 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0037070 con 0x7f51e80b5fe0 2024-09-12T02:01:18.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.081+0000 7f51e559a640 1 -- 172.21.15.19:0/1265094701 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d0032440 con 0x7f51e80b5fe0 2024-09-12T02:01:18.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.081+0000 7f51e559a640 1 -- 172.21.15.19:0/1265094701 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0032810 con 0x7f51e80b5fe0 2024-09-12T02:01:18.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.081+0000 7f51ec8c9640 1 -- 172.21.15.19:0/1265094701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51e80b5fe0 msgr2=0x7f51e80aff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:18.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.081+0000 7f51ec8c9640 1 --2- 172.21.15.19:0/1265094701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51e80b5fe0 0x7f51e80aff40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009870 tx=0x7f51d002a180 comp rx=0 tx=0).stop 2024-09-12T02:01:18.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.081+0000 7f51ec8c9640 1 -- 172.21.15.19:0/1265094701 shutdown_connections 2024-09-12T02:01:18.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.081+0000 7f51ec8c9640 1 --2- 172.21.15.19:0/1265094701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51e806bc10 0x7f51e806c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:18.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.081+0000 7f51ec8c9640 1 --2- 172.21.15.19:0/1265094701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51e80b5fe0 0x7f51e80aff40 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:18.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.081+0000 7f51ec8c9640 1 -- 172.21.15.19:0/1265094701 >> 172.21.15.19:0/1265094701 conn(0x7f51e809aa30 msgr2=0x7f51e80b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:18.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.081+0000 7f51ec8c9640 1 -- 172.21.15.19:0/1265094701 shutdown_connections 2024-09-12T02:01:18.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.081+0000 7f51ec8c9640 1 -- 172.21.15.19:0/1265094701 wait complete. 2024-09-12T02:01:18.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.083+0000 7f51ec8c9640 1 Processor -- start 2024-09-12T02:01:18.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.083+0000 7f51ec8c9640 1 -- start start 2024-09-12T02:01:18.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.083+0000 7f51ec8c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51e806bc10 0x7f51e809c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.083+0000 7f51ec8c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51e80b5fe0 0x7f51e809d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.083+0000 7f51ec8c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e815e410 0x7f51e815d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.083+0000 7f51ec8c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f51e80b0480 con 0x7f51e80b5fe0 2024-09-12T02:01:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.083+0000 7f51ec8c9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f51e80aeae0 con 0x7f51e815e410 2024-09-12T02:01:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.083+0000 7f51ec8c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f51e815e7f0 con 0x7f51e806bc10 2024-09-12T02:01:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.083+0000 7f51e5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51e80b5fe0 0x7f51e809d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.084+0000 7f51e5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51e80b5fe0 0x7f51e809d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55054/0 (socket says 172.21.15.19:55054) 2024-09-12T02:01:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.084+0000 7f51e5d9b640 1 -- 172.21.15.19:0/2863594368 learned_addr learned my addr 172.21.15.19:0/2863594368 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.084+0000 7f51e6d9d640 1 --2- 172.21.15.19:0/2863594368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e815e410 0x7f51e815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.084+0000 7f51e659c640 1 --2- 172.21.15.19:0/2863594368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51e806bc10 0x7f51e809c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.084+0000 7f51e5d9b640 1 -- 172.21.15.19:0/2863594368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51e806bc10 msgr2=0x7f51e809c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.084+0000 7f51e5d9b640 1 --2- 172.21.15.19:0/2863594368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51e806bc10 0x7f51e809c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.084+0000 7f51e5d9b640 1 -- 172.21.15.19:0/2863594368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e815e410 msgr2=0x7f51e815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.084+0000 7f51e5d9b640 1 --2- 172.21.15.19:0/2863594368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e815e410 0x7f51e815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.084+0000 7f51e5d9b640 1 -- 172.21.15.19:0/2863594368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e809b400 con 0x7f51e80b5fe0 2024-09-12T02:01:18.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.084+0000 7f51e6d9d640 1 --2- 172.21.15.19:0/2863594368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e815e410 0x7f51e815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:18.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.084+0000 7f51e659c640 1 --2- 172.21.15.19:0/2863594368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51e806bc10 0x7f51e809c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:18.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.084+0000 7f51e5d9b640 1 --2- 172.21.15.19:0/2863594368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51e80b5fe0 0x7f51e809d100 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f51d0000c00 tx=0x7f51d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:18.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.084+0000 7f51deffd640 1 -- 172.21.15.19:0/2863594368 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0037040 con 0x7f51e80b5fe0 2024-09-12T02:01:18.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.084+0000 7f51deffd640 1 -- 172.21.15.19:0/2863594368 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d0042070 con 0x7f51e80b5fe0 2024-09-12T02:01:18.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.084+0000 7f51ec8c9640 1 -- 172.21.15.19:0/2863594368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e809b6e0 con 0x7f51e80b5fe0 2024-09-12T02:01:18.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.084+0000 7f51deffd640 1 -- 172.21.15.19:0/2863594368 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0030bb0 con 0x7f51e80b5fe0 2024-09-12T02:01:18.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.084+0000 7f51ec8c9640 1 -- 172.21.15.19:0/2863594368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e809bca0 con 0x7f51e80b5fe0 2024-09-12T02:01:18.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.085+0000 7f51ec8c9640 1 -- 172.21.15.19:0/2863594368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51e806c080 con 0x7f51e80b5fe0 2024-09-12T02:01:18.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.086+0000 7f51deffd640 1 -- 172.21.15.19:0/2863594368 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f51d0047460 con 0x7f51e80b5fe0 2024-09-12T02:01:18.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.086+0000 7f51deffd640 1 --2- 172.21.15.19:0/2863594368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f51c806be30 0x7f51c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:18.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.086+0000 7f51deffd640 1 -- 172.21.15.19:0/2863594368 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f51d00abc50 con 0x7f51e80b5fe0 2024-09-12T02:01:18.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.086+0000 7f51e659c640 1 --2- 172.21.15.19:0/2863594368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f51c806be30 0x7f51c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:18.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.087+0000 7f51e659c640 1 --2- 172.21.15.19:0/2863594368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f51c806be30 0x7f51c806e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f51d8006fd0 tx=0x7f51d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:18.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.091+0000 7f51deffd640 1 -- 172.21.15.19:0/2863594368 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f51d00b1020 con 0x7f51e80b5fe0 2024-09-12T02:01:18.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.304+0000 7f51ec8c9640 1 -- 172.21.15.19:0/2863594368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f51e815f240 con 0x7f51e80b5fe0 2024-09-12T02:01:18.959 INFO:tasks.ceph.mds.b.smithi135.stderr:2024-09-12T02:01:18.959+0000 7f7a85447640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:01:18.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.964+0000 7f51deffd640 1 -- 172.21.15.19:0/2863594368 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v62) ==== 122+0+0 (secure 0 0 0) 0x7f51d007a470 con 0x7f51e80b5fe0 2024-09-12T02:01:18.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.966+0000 7f51ec8c9640 1 -- 172.21.15.19:0/2863594368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f51c806be30 msgr2=0x7f51c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:18.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.966+0000 7f51ec8c9640 1 --2- 172.21.15.19:0/2863594368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f51c806be30 0x7f51c806e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f51d8006fd0 tx=0x7f51d8008040 comp rx=0 tx=0).stop 2024-09-12T02:01:18.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.966+0000 7f51ec8c9640 1 -- 172.21.15.19:0/2863594368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51e80b5fe0 msgr2=0x7f51e809d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:18.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.966+0000 7f51ec8c9640 1 --2- 172.21.15.19:0/2863594368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51e80b5fe0 0x7f51e809d100 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f51d0000c00 tx=0x7f51d00046c0 comp rx=0 tx=0).stop 2024-09-12T02:01:18.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.966+0000 7f51ec8c9640 1 -- 172.21.15.19:0/2863594368 shutdown_connections 2024-09-12T02:01:18.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.966+0000 7f51ec8c9640 1 --2- 172.21.15.19:0/2863594368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f51c806be30 0x7f51c806e2f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:18.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.966+0000 7f51ec8c9640 1 --2- 172.21.15.19:0/2863594368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e815e410 0x7f51e815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:18.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.966+0000 7f51ec8c9640 1 --2- 172.21.15.19:0/2863594368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51e80b5fe0 0x7f51e809d100 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:18.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.966+0000 7f51ec8c9640 1 --2- 172.21.15.19:0/2863594368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51e806bc10 0x7f51e809c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:18.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.966+0000 7f51ec8c9640 1 -- 172.21.15.19:0/2863594368 >> 172.21.15.19:0/2863594368 conn(0x7f51e809aa30 msgr2=0x7f51e8070670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:18.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.966+0000 7f51ec8c9640 1 -- 172.21.15.19:0/2863594368 shutdown_connections 2024-09-12T02:01:18.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:18.966+0000 7f51ec8c9640 1 -- 172.21.15.19:0/2863594368 wait complete. 2024-09-12T02:01:18.979 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:01:18.980 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:19.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.086+0000 7f2e3ecb7640 1 Processor -- start 2024-09-12T02:01:19.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.086+0000 7f2e3ecb7640 1 -- start start 2024-09-12T02:01:19.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.087+0000 7f2e3ecb7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2e380d4fd0 0x7f2e3806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.087+0000 7f2e3ecb7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e380d2700 con 0x7f2e380cfcc0 2024-09-12T02:01:19.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.087+0000 7f2e3ecb7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e380cedb0 con 0x7f2e3815e760 2024-09-12T02:01:19.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.087+0000 7f2e3ecb7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f2e380cf090 con 0x7f2e380d4fd0 2024-09-12T02:01:19.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.087+0000 7f2e37fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2e380cfcc0 0x7f2e380d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40690/0 (socket says 172.21.15.19:40690) 2024-09-12T02:01:19.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.087+0000 7f2e37fff640 1 -- 172.21.15.19:0/4107610356 learned_addr learned my addr 172.21.15.19:0/4107610356 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:19.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.087+0000 7f2e3d254640 1 --2- 172.21.15.19:0/4107610356 >> v2:172.21.15.135:3300/0 conn(0x7f2e380d4fd0 0x7f2e3806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.087+0000 7f2e377fe640 1 -- 172.21.15.19:0/4107610356 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 544861461 0 0) 0x7f2e2c001290 con 0x7f2e380cfcc0 2024-09-12T02:01:19.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e377fe640 1 -- 172.21.15.19:0/4107610356 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e20003520 con 0x7f2e380cfcc0 2024-09-12T02:01:19.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e377fe640 1 -- 172.21.15.19:0/4107610356 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3651024780 0 0) 0x7f2e20003520 con 0x7f2e380cfcc0 2024-09-12T02:01:19.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e377fe640 1 -- 172.21.15.19:0/4107610356 >> v2:172.21.15.135:3300/0 conn(0x7f2e380d4fd0 msgr2=0x7f2e3806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:19.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e377fe640 1 --2- 172.21.15.19:0/4107610356 >> v2:172.21.15.135:3300/0 conn(0x7f2e380d4fd0 0x7f2e3806cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e377fe640 1 -- 172.21.15.19:0/4107610356 >> v1:172.21.15.135:6789/0 conn(0x7f2e3815e760 legacy=0x7f2e380cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e377fe640 1 -- 172.21.15.19:0/4107610356 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e380b3c80 con 0x7f2e380cfcc0 2024-09-12T02:01:19.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e377fe640 1 -- 172.21.15.19:0/4107610356 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f2e2c0019c0 con 0x7f2e380cfcc0 2024-09-12T02:01:19.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e377fe640 1 -- 172.21.15.19:0/4107610356 >> v1:172.21.15.19:6789/0 conn(0x7f2e380cfcc0 legacy=0x7f2e380d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e377fe640 1 --2- 172.21.15.19:0/4107610356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e200039b0 0x7f2e20003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e377fe640 1 --2- 172.21.15.19:0/4107610356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e200043b0 0x7f2e20004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e377fe640 1 --2- 172.21.15.19:0/4107610356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e20005080 0x7f2e2000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e377fe640 1 -- 172.21.15.19:0/4107610356 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2e380cf090 con 0x7f2e200039b0 2024-09-12T02:01:19.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e377fe640 1 -- 172.21.15.19:0/4107610356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2000bfe0 con 0x7f2e200043b0 2024-09-12T02:01:19.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e377fe640 1 -- 172.21.15.19:0/4107610356 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2e2000c1e0 con 0x7f2e20005080 2024-09-12T02:01:19.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e3ca53640 1 --2- 172.21.15.19:0/4107610356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e200039b0 0x7f2e20003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e37fff640 1 --2- 172.21.15.19:0/4107610356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e200043b0 0x7f2e20004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e3d254640 1 --2- 172.21.15.19:0/4107610356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e20005080 0x7f2e2000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e3ca53640 1 -- 172.21.15.19:0/4107610356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e20005080 msgr2=0x7f2e2000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:19.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e3ca53640 1 --2- 172.21.15.19:0/4107610356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e20005080 0x7f2e2000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e3ca53640 1 -- 172.21.15.19:0/4107610356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e200043b0 msgr2=0x7f2e20004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:19.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e3ca53640 1 --2- 172.21.15.19:0/4107610356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e200043b0 0x7f2e20004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e3ca53640 1 -- 172.21.15.19:0/4107610356 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e20003520 con 0x7f2e200039b0 2024-09-12T02:01:19.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.088+0000 7f2e3d254640 1 -- 172.21.15.19:0/4107610356 reap_dead start 2024-09-12T02:01:19.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.089+0000 7f2e3ca53640 1 --2- 172.21.15.19:0/4107610356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e200039b0 0x7f2e20003d90 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f2e28001860 tx=0x7f2e20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ccd8fb8e41fc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:19.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.089+0000 7f2e377fe640 1 -- 172.21.15.19:0/4107610356 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e28037070 con 0x7f2e200039b0 2024-09-12T02:01:19.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.089+0000 7f2e377fe640 1 -- 172.21.15.19:0/4107610356 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e2802ac30 con 0x7f2e200039b0 2024-09-12T02:01:19.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.089+0000 7f2e377fe640 1 -- 172.21.15.19:0/4107610356 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e28001430 con 0x7f2e200039b0 2024-09-12T02:01:19.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.090+0000 7f2e3ecb7640 1 -- 172.21.15.19:0/4107610356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e200039b0 msgr2=0x7f2e20003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.090+0000 7f2e3ecb7640 1 --2- 172.21.15.19:0/4107610356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e200039b0 0x7f2e20003d90 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f2e28001860 tx=0x7f2e20005830 comp rx=0 tx=0).stop 2024-09-12T02:01:19.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.090+0000 7f2e3ecb7640 1 -- 172.21.15.19:0/4107610356 shutdown_connections 2024-09-12T02:01:19.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.090+0000 7f2e3ecb7640 1 --2- 172.21.15.19:0/4107610356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e200039b0 0x7f2e20003d90 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.090+0000 7f2e3ecb7640 1 -- 172.21.15.19:0/4107610356 >> 172.21.15.19:0/4107610356 conn(0x7f2e3808bfc0 msgr2=0x7f2e380d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:19.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.090+0000 7f2e3ecb7640 1 -- 172.21.15.19:0/4107610356 shutdown_connections 2024-09-12T02:01:19.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.090+0000 7f2e3ecb7640 1 -- 172.21.15.19:0/4107610356 wait complete. 2024-09-12T02:01:19.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.091+0000 7f2e3ecb7640 1 Processor -- start 2024-09-12T02:01:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.091+0000 7f2e3ecb7640 1 -- start start 2024-09-12T02:01:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.092+0000 7f2e3ecb7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e200039b0 0x7f2e38156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.092+0000 7f2e3ecb7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e3815bcf0 0x7f2e3815c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.092+0000 7f2e3ecb7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e380c8ae0 0x7f2e380c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.092+0000 7f2e3ecb7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3806cdd0 con 0x7f2e200039b0 2024-09-12T02:01:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.092+0000 7f2e3ecb7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e380b3860 con 0x7f2e3815bcf0 2024-09-12T02:01:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.092+0000 7f2e3ecb7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2e3806cf50 con 0x7f2e380c8ae0 2024-09-12T02:01:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.092+0000 7f2e3ca53640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e200039b0 0x7f2e38156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.092+0000 7f2e3ca53640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e200039b0 0x7f2e38156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55070/0 (socket says 172.21.15.19:55070) 2024-09-12T02:01:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.092+0000 7f2e3ca53640 1 -- 172.21.15.19:0/2641875551 learned_addr learned my addr 172.21.15.19:0/2641875551 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.092+0000 7f2e37fff640 1 --2- 172.21.15.19:0/2641875551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e3815bcf0 0x7f2e3815c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.092+0000 7f2e3d254640 1 --2- 172.21.15.19:0/2641875551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e380c8ae0 0x7f2e380c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.093+0000 7f2e3ca53640 1 -- 172.21.15.19:0/2641875551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e380c8ae0 msgr2=0x7f2e380c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.093+0000 7f2e3ca53640 1 --2- 172.21.15.19:0/2641875551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e380c8ae0 0x7f2e380c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.093+0000 7f2e3ca53640 1 -- 172.21.15.19:0/2641875551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e3815bcf0 msgr2=0x7f2e3815c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.093+0000 7f2e3ca53640 1 --2- 172.21.15.19:0/2641875551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e3815bcf0 0x7f2e3815c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.093+0000 7f2e3ca53640 1 -- 172.21.15.19:0/2641875551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e380cd430 con 0x7f2e200039b0 2024-09-12T02:01:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.093+0000 7f2e37fff640 1 --2- 172.21.15.19:0/2641875551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e3815bcf0 0x7f2e3815c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.093+0000 7f2e3ca53640 1 --2- 172.21.15.19:0/2641875551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e200039b0 0x7f2e38156a10 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f2e280075a0 tx=0x7f2e28001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.093+0000 7f2e357fa640 1 -- 172.21.15.19:0/2641875551 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e28040020 con 0x7f2e200039b0 2024-09-12T02:01:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.093+0000 7f2e357fa640 1 -- 172.21.15.19:0/2641875551 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e28005270 con 0x7f2e200039b0 2024-09-12T02:01:19.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.093+0000 7f2e3ecb7640 1 -- 172.21.15.19:0/2641875551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e380cd710 con 0x7f2e200039b0 2024-09-12T02:01:19.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.093+0000 7f2e357fa640 1 -- 172.21.15.19:0/2641875551 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e28037040 con 0x7f2e200039b0 2024-09-12T02:01:19.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.093+0000 7f2e3ecb7640 1 -- 172.21.15.19:0/2641875551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e380cdcd0 con 0x7f2e200039b0 2024-09-12T02:01:19.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.094+0000 7f2e3ecb7640 1 -- 172.21.15.19:0/2641875551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e380b6d20 con 0x7f2e200039b0 2024-09-12T02:01:19.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.094+0000 7f2e357fa640 1 -- 172.21.15.19:0/2641875551 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e28043020 con 0x7f2e200039b0 2024-09-12T02:01:19.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.095+0000 7f2e357fa640 1 --2- 172.21.15.19:0/2641875551 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e2406be30 0x7f2e2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.095+0000 7f2e357fa640 1 -- 172.21.15.19:0/2641875551 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f2e280aaf40 con 0x7f2e200039b0 2024-09-12T02:01:19.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.095+0000 7f2e37fff640 1 --2- 172.21.15.19:0/2641875551 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e2406be30 0x7f2e2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.096+0000 7f2e37fff640 1 --2- 172.21.15.19:0/2641875551 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e2406be30 0x7f2e2406e2f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c007fd0 tx=0x7f2e2c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:19.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.099+0000 7f2e357fa640 1 -- 172.21.15.19:0/2641875551 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e2804a030 con 0x7f2e200039b0 2024-09-12T02:01:19.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.309+0000 7f2e3ecb7640 1 -- 172.21.15.19:0/2641875551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e3806e3e0 con 0x7f2e200039b0 2024-09-12T02:01:19.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.309+0000 7f2e357fa640 1 -- 172.21.15.19:0/2641875551 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5228 (secure 0 0 0) 0x7f2e28079080 con 0x7f2e200039b0 2024-09-12T02:01:19.310 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:19.310 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":62,"btime":"2024-09-12T02:01:18:960990+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1065573429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1065573429},{"type":"v1","addr":"172.21.15.19:6835","nonce":1065573429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3905709264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":3905709264},{"type":"v1","addr":"172.21.15.135:6837","nonce":3905709264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6082,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/836344045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":836344045},{"type":"v1","addr":"172.21.15.19:6834","nonce":836344045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:01:16.289395+0000","modified":"2024-09-12T02:01:18.305545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6088":{"gid":6088,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/1796121402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1796121402},{"type":"v1","addr":"172.21.15.135:6836","nonce":1796121402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6088,"qdb_cluster":[6088]},"id":5}]} 2024-09-12T02:01:19.310 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 62 2024-09-12T02:01:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.311+0000 7f2e3ecb7640 1 -- 172.21.15.19:0/2641875551 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e2406be30 msgr2=0x7f2e2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.311+0000 7f2e3ecb7640 1 --2- 172.21.15.19:0/2641875551 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e2406be30 0x7f2e2406e2f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c007fd0 tx=0x7f2e2c009040 comp rx=0 tx=0).stop 2024-09-12T02:01:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.311+0000 7f2e3ecb7640 1 -- 172.21.15.19:0/2641875551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e200039b0 msgr2=0x7f2e38156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.311+0000 7f2e3ecb7640 1 --2- 172.21.15.19:0/2641875551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e200039b0 0x7f2e38156a10 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f2e280075a0 tx=0x7f2e28001230 comp rx=0 tx=0).stop 2024-09-12T02:01:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.312+0000 7f2e3ecb7640 1 -- 172.21.15.19:0/2641875551 shutdown_connections 2024-09-12T02:01:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.312+0000 7f2e3ecb7640 1 --2- 172.21.15.19:0/2641875551 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e2406be30 0x7f2e2406e2f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.312+0000 7f2e3ecb7640 1 --2- 172.21.15.19:0/2641875551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e380c8ae0 0x7f2e380c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.312+0000 7f2e3ecb7640 1 --2- 172.21.15.19:0/2641875551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e3815bcf0 0x7f2e3815c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.312+0000 7f2e3ecb7640 1 --2- 172.21.15.19:0/2641875551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e200039b0 0x7f2e38156a10 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.312+0000 7f2e3ecb7640 1 -- 172.21.15.19:0/2641875551 >> 172.21.15.19:0/2641875551 conn(0x7f2e3808bfc0 msgr2=0x7f2e3806e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.312+0000 7f2e3ecb7640 1 -- 172.21.15.19:0/2641875551 shutdown_connections 2024-09-12T02:01:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.312+0000 7f2e3ecb7640 1 -- 172.21.15.19:0/2641875551 wait complete. 2024-09-12T02:01:19.323 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:01:19.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.425+0000 7f33f0731640 1 Processor -- start 2024-09-12T02:01:19.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.425+0000 7f33f0731640 1 -- start start 2024-09-12T02:01:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.426+0000 7f33f0731640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33e815e5f0 0x7f33e80d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.426+0000 7f33f0731640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f33e80d30f0 0x7f33e80b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.426+0000 7f33f0731640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33e80d3690 con 0x7f33e80b64c0 2024-09-12T02:01:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.426+0000 7f33f0731640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f33e806d530 con 0x7f33e80d30f0 2024-09-12T02:01:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.426+0000 7f33f0731640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f33e80d3970 con 0x7f33e815e5f0 2024-09-12T02:01:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.426+0000 7f33edccc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f33e80d30f0 0x7f33e80b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.426+0000 7f33edccc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f33e80d30f0 0x7f33e80b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55086/0 (socket says 172.21.15.19:55086) 2024-09-12T02:01:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.426+0000 7f33edccc640 1 -- 172.21.15.19:0/2118269276 learned_addr learned my addr 172.21.15.19:0/2118269276 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.426+0000 7f33ee4cd640 1 --2- 172.21.15.19:0/2118269276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33e815e5f0 0x7f33e80d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.426+0000 7f33edccc640 1 -- 172.21.15.19:0/2118269276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33e815e5f0 msgr2=0x7f33e80d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.426+0000 7f33edccc640 1 --2- 172.21.15.19:0/2118269276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33e815e5f0 0x7f33e80d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.426+0000 7f33edccc640 1 -- 172.21.15.19:0/2118269276 >> v1:172.21.15.135:6789/0 conn(0x7f33e80b64c0 legacy=0x7f33e80cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.426+0000 7f33edccc640 1 -- 172.21.15.19:0/2118269276 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e806cee0 con 0x7f33e80d30f0 2024-09-12T02:01:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.427+0000 7f33edccc640 1 --2- 172.21.15.19:0/2118269276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33e80d30f0 0x7f33e80b5f80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f33d8009870 tx=0x7f33d802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc3e4200c5f12bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.427+0000 7f33ed4cb640 1 -- 172.21.15.19:0/2118269276 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d8037070 con 0x7f33e80d30f0 2024-09-12T02:01:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.427+0000 7f33ed4cb640 1 -- 172.21.15.19:0/2118269276 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33d8032440 con 0x7f33e80d30f0 2024-09-12T02:01:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.427+0000 7f33ed4cb640 1 -- 172.21.15.19:0/2118269276 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d8032810 con 0x7f33e80d30f0 2024-09-12T02:01:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.428+0000 7f33f0731640 1 -- 172.21.15.19:0/2118269276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33e80d30f0 msgr2=0x7f33e80b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.428+0000 7f33f0731640 1 --2- 172.21.15.19:0/2118269276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33e80d30f0 0x7f33e80b5f80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f33d8009870 tx=0x7f33d802a210 comp rx=0 tx=0).stop 2024-09-12T02:01:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.428+0000 7f33f0731640 1 -- 172.21.15.19:0/2118269276 shutdown_connections 2024-09-12T02:01:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.428+0000 7f33f0731640 1 --2- 172.21.15.19:0/2118269276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33e80d30f0 0x7f33e80b5f80 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.428+0000 7f33f0731640 1 --2- 172.21.15.19:0/2118269276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33e815e5f0 0x7f33e80d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.428+0000 7f33f0731640 1 -- 172.21.15.19:0/2118269276 >> 172.21.15.19:0/2118269276 conn(0x7f33e808bfc0 msgr2=0x7f33e80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.428+0000 7f33f0731640 1 -- 172.21.15.19:0/2118269276 shutdown_connections 2024-09-12T02:01:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.428+0000 7f33f0731640 1 -- 172.21.15.19:0/2118269276 wait complete. 2024-09-12T02:01:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.429+0000 7f33f0731640 1 Processor -- start 2024-09-12T02:01:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.429+0000 7f33f0731640 1 -- start start 2024-09-12T02:01:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33f0731640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e80b64c0 0x7f33e81619d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33f0731640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33e80d30f0 0x7f33e81f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33f0731640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33e815e5f0 0x7f33e81f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33f0731640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f33e80d5310 con 0x7f33e815e5f0 2024-09-12T02:01:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33f0731640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33e815e9d0 con 0x7f33e80b64c0 2024-09-12T02:01:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33f0731640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f33e806e9d0 con 0x7f33e80d30f0 2024-09-12T02:01:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33eecce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33e815e5f0 0x7f33e81f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33eecce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33e815e5f0 0x7f33e81f3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55100/0 (socket says 172.21.15.19:55100) 2024-09-12T02:01:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33eecce640 1 -- 172.21.15.19:0/3218181436 learned_addr learned my addr 172.21.15.19:0/3218181436 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33edccc640 1 --2- 172.21.15.19:0/3218181436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33e80d30f0 0x7f33e81f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33ee4cd640 1 --2- 172.21.15.19:0/3218181436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e80b64c0 0x7f33e81619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33eecce640 1 -- 172.21.15.19:0/3218181436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33e80d30f0 msgr2=0x7f33e81f39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33eecce640 1 --2- 172.21.15.19:0/3218181436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33e80d30f0 0x7f33e81f39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33eecce640 1 -- 172.21.15.19:0/3218181436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e80b64c0 msgr2=0x7f33e81619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33eecce640 1 --2- 172.21.15.19:0/3218181436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e80b64c0 0x7f33e81619d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33eecce640 1 -- 172.21.15.19:0/3218181436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e81f5070 con 0x7f33e815e5f0 2024-09-12T02:01:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33eecce640 1 --2- 172.21.15.19:0/3218181436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33e815e5f0 0x7f33e81f3f10 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f33e000c780 tx=0x7f33e000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33deffd640 1 -- 172.21.15.19:0/3218181436 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0004b60 con 0x7f33e815e5f0 2024-09-12T02:01:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33deffd640 1 -- 172.21.15.19:0/3218181436 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e0004d00 con 0x7f33e815e5f0 2024-09-12T02:01:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33deffd640 1 -- 172.21.15.19:0/3218181436 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e000aa90 con 0x7f33e815e5f0 2024-09-12T02:01:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.430+0000 7f33f0731640 1 -- 172.21.15.19:0/3218181436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e81f44f0 con 0x7f33e815e5f0 2024-09-12T02:01:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.431+0000 7f33f0731640 1 -- 172.21.15.19:0/3218181436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e81f4ab0 con 0x7f33e815e5f0 2024-09-12T02:01:19.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.431+0000 7f33f0731640 1 -- 172.21.15.19:0/3218181436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33e80b5f80 con 0x7f33e815e5f0 2024-09-12T02:01:19.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.432+0000 7f33deffd640 1 -- 172.21.15.19:0/3218181436 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f33e000ac30 con 0x7f33e815e5f0 2024-09-12T02:01:19.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.432+0000 7f33deffd640 1 --2- 172.21.15.19:0/3218181436 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f33cc06be30 0x7f33cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.433+0000 7f33deffd640 1 -- 172.21.15.19:0/3218181436 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f33e008b280 con 0x7f33e815e5f0 2024-09-12T02:01:19.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.433+0000 7f33ee4cd640 1 --2- 172.21.15.19:0/3218181436 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f33cc06be30 0x7f33cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.433+0000 7f33ee4cd640 1 --2- 172.21.15.19:0/3218181436 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f33cc06be30 0x7f33cc06e2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f33e400b7c0 tx=0x7f33e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:19.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.437+0000 7f33deffd640 1 -- 172.21.15.19:0/3218181436 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f33e0020070 con 0x7f33e815e5f0 2024-09-12T02:01:19.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.612+0000 7f33f0731640 1 -- 172.21.15.19:0/3218181436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33e806bda0 con 0x7f33e815e5f0 2024-09-12T02:01:19.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.613+0000 7f33deffd640 1 -- 172.21.15.19:0/3218181436 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+16993 (secure 0 0 0) 0x7f33e0059aa0 con 0x7f33e815e5f0 2024-09-12T02:01:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:19.614 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":81,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:01:17.943787+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:01:13.953490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-12T02:01:15.281758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:01:19.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.616+0000 7f33f0731640 1 -- 172.21.15.19:0/3218181436 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f33cc06be30 msgr2=0x7f33cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.616+0000 7f33f0731640 1 --2- 172.21.15.19:0/3218181436 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f33cc06be30 0x7f33cc06e2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f33e400b7c0 tx=0x7f33e4008040 comp rx=0 tx=0).stop 2024-09-12T02:01:19.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.616+0000 7f33f0731640 1 -- 172.21.15.19:0/3218181436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33e815e5f0 msgr2=0x7f33e81f3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.616+0000 7f33f0731640 1 --2- 172.21.15.19:0/3218181436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33e815e5f0 0x7f33e81f3f10 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f33e000c780 tx=0x7f33e000cc40 comp rx=0 tx=0).stop 2024-09-12T02:01:19.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.616+0000 7f33f0731640 1 -- 172.21.15.19:0/3218181436 shutdown_connections 2024-09-12T02:01:19.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.616+0000 7f33f0731640 1 --2- 172.21.15.19:0/3218181436 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f33cc06be30 0x7f33cc06e2f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.616+0000 7f33f0731640 1 --2- 172.21.15.19:0/3218181436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33e815e5f0 0x7f33e81f3f10 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.616+0000 7f33f0731640 1 --2- 172.21.15.19:0/3218181436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33e80d30f0 0x7f33e81f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.616+0000 7f33f0731640 1 --2- 172.21.15.19:0/3218181436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e80b64c0 0x7f33e81619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.616+0000 7f33f0731640 1 -- 172.21.15.19:0/3218181436 >> 172.21.15.19:0/3218181436 conn(0x7f33e808bfc0 msgr2=0x7f33e80b4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:19.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.616+0000 7f33f0731640 1 -- 172.21.15.19:0/3218181436 shutdown_connections 2024-09-12T02:01:19.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.616+0000 7f33f0731640 1 -- 172.21.15.19:0/3218181436 wait complete. 2024-09-12T02:01:19.627 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:01:19.628 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:01:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.729+0000 7f43662a5640 1 Processor -- start 2024-09-12T02:01:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.730+0000 7f43662a5640 1 -- start start 2024-09-12T02:01:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.730+0000 7f43662a5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4360161c80 0x7f436006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.730+0000 7f43662a5640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f436006e870 con 0x7f43600b6680 2024-09-12T02:01:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.730+0000 7f43662a5640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f436006d9f0 con 0x7f4360162060 2024-09-12T02:01:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.730+0000 7f43662a5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f436006dcd0 con 0x7f4360161c80 2024-09-12T02:01:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.730+0000 7f4364842640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f43600b6680 0x7f43600cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40698/0 (socket says 172.21.15.19:40698) 2024-09-12T02:01:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f4364842640 1 -- 172.21.15.19:0/3765930171 learned_addr learned my addr 172.21.15.19:0/3765930171 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f435effd640 1 -- 172.21.15.19:0/3765930171 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1808927864 0 0) 0x7f4358001490 con 0x7f43600b6680 2024-09-12T02:01:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f435ffff640 1 --2- 172.21.15.19:0/3765930171 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4360161c80 0x7f436006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f435effd640 1 -- 172.21.15.19:0/3765930171 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4348003520 con 0x7f43600b6680 2024-09-12T02:01:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f435effd640 1 -- 172.21.15.19:0/3765930171 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2879894017 0 0) 0x7f4348003520 con 0x7f43600b6680 2024-09-12T02:01:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f435effd640 1 -- 172.21.15.19:0/3765930171 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4360161c80 msgr2=0x7f436006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f435effd640 1 --2- 172.21.15.19:0/3765930171 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4360161c80 0x7f436006e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f435effd640 1 -- 172.21.15.19:0/3765930171 >> v1:172.21.15.135:6789/0 conn(0x7f4360162060 legacy=0x7f43600b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f435effd640 1 -- 172.21.15.19:0/3765930171 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f436006dfb0 con 0x7f43600b6680 2024-09-12T02:01:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f435effd640 1 -- 172.21.15.19:0/3765930171 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f4358001bc0 con 0x7f43600b6680 2024-09-12T02:01:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f435effd640 1 -- 172.21.15.19:0/3765930171 >> v1:172.21.15.19:6789/0 conn(0x7f43600b6680 legacy=0x7f43600cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f435effd640 1 --2- 172.21.15.19:0/3765930171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43480039e0 0x7f4348003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f435effd640 1 --2- 172.21.15.19:0/3765930171 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4360161c80 0x7f4348004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f435effd640 1 --2- 172.21.15.19:0/3765930171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4348004d40 0x7f43480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f435effd640 1 -- 172.21.15.19:0/3765930171 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f436006dcd0 con 0x7f4348004d40 2024-09-12T02:01:19.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f435effd640 1 -- 172.21.15.19:0/3765930171 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f434800ba70 con 0x7f43480039e0 2024-09-12T02:01:19.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f435effd640 1 -- 172.21.15.19:0/3765930171 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f434800bc70 con 0x7f4360161c80 2024-09-12T02:01:19.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f4364842640 1 --2- 172.21.15.19:0/3765930171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4348004d40 0x7f43480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f435f7fe640 1 --2- 172.21.15.19:0/3765930171 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4360161c80 0x7f4348004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.731+0000 7f435ffff640 1 --2- 172.21.15.19:0/3765930171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43480039e0 0x7f4348003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.732+0000 7f4364842640 1 -- 172.21.15.19:0/3765930171 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4360161c80 msgr2=0x7f4348004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:19.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.732+0000 7f4364842640 1 --2- 172.21.15.19:0/3765930171 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4360161c80 0x7f4348004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.732+0000 7f4364842640 1 -- 172.21.15.19:0/3765930171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43480039e0 msgr2=0x7f4348003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:19.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.732+0000 7f4364842640 1 --2- 172.21.15.19:0/3765930171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43480039e0 0x7f4348003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.732+0000 7f4364842640 1 -- 172.21.15.19:0/3765930171 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4348003520 con 0x7f4348004d40 2024-09-12T02:01:19.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.732+0000 7f4364842640 1 --2- 172.21.15.19:0/3765930171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4348004d40 0x7f43480051c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f435800aa00 tx=0x7f4348005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5442ab2e7914ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:19.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.732+0000 7f435effd640 1 -- 172.21.15.19:0/3765930171 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435800a650 con 0x7f4348004d40 2024-09-12T02:01:19.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.732+0000 7f435effd640 1 -- 172.21.15.19:0/3765930171 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f435802f070 con 0x7f4348004d40 2024-09-12T02:01:19.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.733+0000 7f435effd640 1 -- 172.21.15.19:0/3765930171 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4358034470 con 0x7f4348004d40 2024-09-12T02:01:19.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.733+0000 7f43662a5640 1 -- 172.21.15.19:0/3765930171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4348004d40 msgr2=0x7f43480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.733+0000 7f43662a5640 1 --2- 172.21.15.19:0/3765930171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4348004d40 0x7f43480051c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f435800aa00 tx=0x7f4348005830 comp rx=0 tx=0).stop 2024-09-12T02:01:19.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.733+0000 7f4364842640 1 -- 172.21.15.19:0/3765930171 reap_dead start 2024-09-12T02:01:19.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.733+0000 7f43662a5640 1 -- 172.21.15.19:0/3765930171 shutdown_connections 2024-09-12T02:01:19.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.733+0000 7f43662a5640 1 -- 172.21.15.19:0/3765930171 >> 172.21.15.19:0/3765930171 conn(0x7f43600d44f0 msgr2=0x7f43600d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:19.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.733+0000 7f43662a5640 1 -- 172.21.15.19:0/3765930171 shutdown_connections 2024-09-12T02:01:19.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.733+0000 7f43662a5640 1 -- 172.21.15.19:0/3765930171 wait complete. 2024-09-12T02:01:19.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.734+0000 7f43662a5640 1 Processor -- start 2024-09-12T02:01:19.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.734+0000 7f43662a5640 1 -- start start 2024-09-12T02:01:19.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.735+0000 7f43662a5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4348004d40 0x7f4360156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.735+0000 7f43662a5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43601f8670 0x7f43600b96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.735+0000 7f43662a5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43600cd7d0 0x7f43600b9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.735+0000 7f43662a5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f43600b6cb0 con 0x7f4348004d40 2024-09-12T02:01:19.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.735+0000 7f43662a5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f43600b6b30 con 0x7f43601f8670 2024-09-12T02:01:19.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.735+0000 7f43662a5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f436006e330 con 0x7f43600cd7d0 2024-09-12T02:01:19.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.735+0000 7f435ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4348004d40 0x7f4360156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.735+0000 7f435ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4348004d40 0x7f4360156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55124/0 (socket says 172.21.15.19:55124) 2024-09-12T02:01:19.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.735+0000 7f435ffff640 1 -- 172.21.15.19:0/4055247446 learned_addr learned my addr 172.21.15.19:0/4055247446 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:19.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.735+0000 7f435f7fe640 1 --2- 172.21.15.19:0/4055247446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43601f8670 0x7f43600b96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.735+0000 7f4364842640 1 --2- 172.21.15.19:0/4055247446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43600cd7d0 0x7f43600b9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.736+0000 7f435ffff640 1 -- 172.21.15.19:0/4055247446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43600cd7d0 msgr2=0x7f43600b9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.736+0000 7f435ffff640 1 --2- 172.21.15.19:0/4055247446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43600cd7d0 0x7f43600b9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.736+0000 7f435ffff640 1 -- 172.21.15.19:0/4055247446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43601f8670 msgr2=0x7f43600b96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.736+0000 7f435ffff640 1 --2- 172.21.15.19:0/4055247446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43601f8670 0x7f43600b96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.736+0000 7f435ffff640 1 -- 172.21.15.19:0/4055247446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43600cdd40 con 0x7f4348004d40 2024-09-12T02:01:19.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.736+0000 7f435f7fe640 1 --2- 172.21.15.19:0/4055247446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43601f8670 0x7f43600b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:19.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.736+0000 7f435ffff640 1 --2- 172.21.15.19:0/4055247446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4348004d40 0x7f4360156b40 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f43500119a0 tx=0x7f4350011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:19.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.736+0000 7f435cff9640 1 -- 172.21.15.19:0/4055247446 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435000fa90 con 0x7f4348004d40 2024-09-12T02:01:19.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.736+0000 7f435cff9640 1 -- 172.21.15.19:0/4055247446 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f435000fc30 con 0x7f4348004d40 2024-09-12T02:01:19.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.736+0000 7f435cff9640 1 -- 172.21.15.19:0/4055247446 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4350014440 con 0x7f4348004d40 2024-09-12T02:01:19.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.736+0000 7f43662a5640 1 -- 172.21.15.19:0/4055247446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43601f7b90 con 0x7f4348004d40 2024-09-12T02:01:19.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.736+0000 7f43662a5640 1 -- 172.21.15.19:0/4055247446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43601f8150 con 0x7f4348004d40 2024-09-12T02:01:19.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.737+0000 7f43662a5640 1 -- 172.21.15.19:0/4055247446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43600b5f70 con 0x7f4348004d40 2024-09-12T02:01:19.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.737+0000 7f435cff9640 1 -- 172.21.15.19:0/4055247446 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4350012040 con 0x7f4348004d40 2024-09-12T02:01:19.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.738+0000 7f435cff9640 1 --2- 172.21.15.19:0/4055247446 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f434c06be60 0x7f434c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:19.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.738+0000 7f435cff9640 1 -- 172.21.15.19:0/4055247446 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f435008b5c0 con 0x7f4348004d40 2024-09-12T02:01:19.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.738+0000 7f435f7fe640 1 --2- 172.21.15.19:0/4055247446 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f434c06be60 0x7f434c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:19.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.739+0000 7f435f7fe640 1 --2- 172.21.15.19:0/4055247446 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f434c06be60 0x7f434c06e320 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f43600ba410 tx=0x7f4354009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:19.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.742+0000 7f435cff9640 1 -- 172.21.15.19:0/4055247446 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4350019030 con 0x7f4348004d40 2024-09-12T02:01:19.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.913+0000 7f43662a5640 1 -- 172.21.15.19:0/4055247446 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43600ba470 con 0x7f434c06be60 2024-09-12T02:01:19.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.920+0000 7f435cff9640 1 -- 172.21.15.19:0/4055247446 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246506 (secure 0 0 0) 0x7f43600ba470 con 0x7f434c06be60 2024-09-12T02:01:19.923 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:19.924 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T02:01:19.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.922+0000 7f43662a5640 1 -- 172.21.15.19:0/4055247446 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f434c06be60 msgr2=0x7f434c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.922+0000 7f43662a5640 1 --2- 172.21.15.19:0/4055247446 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f434c06be60 0x7f434c06e320 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f43600ba410 tx=0x7f4354009040 comp rx=0 tx=0).stop 2024-09-12T02:01:19.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.922+0000 7f43662a5640 1 -- 172.21.15.19:0/4055247446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4348004d40 msgr2=0x7f4360156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.922+0000 7f43662a5640 1 --2- 172.21.15.19:0/4055247446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4348004d40 0x7f4360156b40 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f43500119a0 tx=0x7f4350011e60 comp rx=0 tx=0).stop 2024-09-12T02:01:19.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.923+0000 7f43662a5640 1 -- 172.21.15.19:0/4055247446 shutdown_connections 2024-09-12T02:01:19.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.923+0000 7f43662a5640 1 --2- 172.21.15.19:0/4055247446 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f434c06be60 0x7f434c06e320 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.923+0000 7f43662a5640 1 --2- 172.21.15.19:0/4055247446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43600cd7d0 0x7f43600b9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.923+0000 7f43662a5640 1 --2- 172.21.15.19:0/4055247446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43601f8670 0x7f43600b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.923+0000 7f43662a5640 1 --2- 172.21.15.19:0/4055247446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4348004d40 0x7f4360156b40 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.923+0000 7f43662a5640 1 -- 172.21.15.19:0/4055247446 >> 172.21.15.19:0/4055247446 conn(0x7f43600d44f0 msgr2=0x7f43600d3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:19.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.923+0000 7f43662a5640 1 -- 172.21.15.19:0/4055247446 shutdown_connections 2024-09-12T02:01:19.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:19.923+0000 7f43662a5640 1 -- 172.21.15.19:0/4055247446 wait complete. 2024-09-12T02:01:19.934 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-09-12T02:01:18.162836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":185,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":237416,"kb_used_data":8672,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754737304,"statfs":{"total":773094113280,"available":772850999296,"internally_reserved":0,"allocated":8880128,"data_stored":4708860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000828"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.967067+0000","last_change":"2024-09-12T02:01:16.974347+0000","last_active":"2024-09-12T02:01:17.967067+0000","last_peered":"2024-09-12T02:01:17.967067+0000","last_clean":"2024-09-12T02:01:17.967067+0000","last_became_active":"2024-09-12T02:01:16.973804+0000","last_became_peered":"2024-09-12T02:01:16.973804+0000","last_unstale":"2024-09-12T02:01:17.967067+0000","last_undegraded":"2024-09-12T02:01:17.967067+0000","last_fullsized":"2024-09-12T02:01:17.967067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:56.603312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.946906+0000","last_change":"2024-09-12T02:01:16.959625+0000","last_active":"2024-09-12T02:01:17.946906+0000","last_peered":"2024-09-12T02:01:17.946906+0000","last_clean":"2024-09-12T02:01:17.946906+0000","last_became_active":"2024-09-12T02:01:16.959305+0000","last_became_peered":"2024-09-12T02:01:16.959305+0000","last_unstale":"2024-09-12T02:01:17.946906+0000","last_undegraded":"2024-09-12T02:01:17.946906+0000","last_fullsized":"2024-09-12T02:01:17.946906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:50.181636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.968946+0000","last_change":"2024-09-12T02:01:16.965822+0000","last_active":"2024-09-12T02:01:17.968946+0000","last_peered":"2024-09-12T02:01:17.968946+0000","last_clean":"2024-09-12T02:01:17.968946+0000","last_became_active":"2024-09-12T02:01:16.965549+0000","last_became_peered":"2024-09-12T02:01:16.965549+0000","last_unstale":"2024-09-12T02:01:17.968946+0000","last_undegraded":"2024-09-12T02:01:17.968946+0000","last_fullsized":"2024-09-12T02:01:17.968946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:20.053614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.974930+0000","last_change":"2024-09-12T02:01:16.973111+0000","last_active":"2024-09-12T02:01:16.974930+0000","last_peered":"2024-09-12T02:01:16.974930+0000","last_clean":"2024-09-12T02:01:16.974930+0000","last_became_active":"2024-09-12T02:01:16.972776+0000","last_became_peered":"2024-09-12T02:01:16.972776+0000","last_unstale":"2024-09-12T02:01:16.974930+0000","last_undegraded":"2024-09-12T02:01:16.974930+0000","last_fullsized":"2024-09-12T02:01:16.974930+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:33.135145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.968707+0000","last_change":"2024-09-12T02:01:16.966638+0000","last_active":"2024-09-12T02:01:17.968707+0000","last_peered":"2024-09-12T02:01:17.968707+0000","last_clean":"2024-09-12T02:01:17.968707+0000","last_became_active":"2024-09-12T02:01:16.966320+0000","last_became_peered":"2024-09-12T02:01:16.966320+0000","last_unstale":"2024-09-12T02:01:17.968707+0000","last_undegraded":"2024-09-12T02:01:17.968707+0000","last_fullsized":"2024-09-12T02:01:17.968707+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:42.338926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.968476+0000","last_change":"2024-09-12T02:01:16.965696+0000","last_active":"2024-09-12T02:01:16.968476+0000","last_peered":"2024-09-12T02:01:16.968476+0000","last_clean":"2024-09-12T02:01:16.968476+0000","last_became_active":"2024-09-12T02:01:16.965372+0000","last_became_peered":"2024-09-12T02:01:16.965372+0000","last_unstale":"2024-09-12T02:01:16.968476+0000","last_undegraded":"2024-09-12T02:01:16.968476+0000","last_fullsized":"2024-09-12T02:01:16.968476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:42.251583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.967000+0000","last_change":"2024-09-12T02:01:16.965038+0000","last_active":"2024-09-12T02:01:17.967000+0000","last_peered":"2024-09-12T02:01:17.967000+0000","last_clean":"2024-09-12T02:01:17.967000+0000","last_became_active":"2024-09-12T02:01:16.964751+0000","last_became_peered":"2024-09-12T02:01:16.964751+0000","last_unstale":"2024-09-12T02:01:17.967000+0000","last_undegraded":"2024-09-12T02:01:17.967000+0000","last_fullsized":"2024-09-12T02:01:17.967000+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:31.749494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.969077+0000","last_change":"2024-09-12T02:01:16.970002+0000","last_active":"2024-09-12T02:01:17.969077+0000","last_peered":"2024-09-12T02:01:17.969077+0000","last_clean":"2024-09-12T02:01:17.969077+0000","last_became_active":"2024-09-12T02:01:16.969688+0000","last_became_peered":"2024-09-12T02:01:16.969688+0000","last_unstale":"2024-09-12T02:01:17.969077+0000","last_undegraded":"2024-09-12T02:01:17.969077+0000","last_fullsized":"2024-09-12T02:01:17.969077+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:30.364885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.971735+0000","last_change":"2024-09-12T02:01:16.970951+0000","last_active":"2024-09-12T02:01:16.971735+0000","last_peered":"2024-09-12T02:01:16.971735+0000","last_clean":"2024-09-12T02:01:16.971735+0000","last_became_active":"2024-09-12T02:01:16.969988+0000","last_became_peered":"2024-09-12T02:01:16.969988+0000","last_unstale":"2024-09-12T02:01:16.971735+0000","last_undegraded":"2024-09-12T02:01:16.971735+0000","last_fullsized":"2024-09-12T02:01:16.971735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:14.918088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.967008+0000","last_change":"2024-09-12T02:01:16.958283+0000","last_active":"2024-09-12T02:01:17.967008+0000","last_peered":"2024-09-12T02:01:17.967008+0000","last_clean":"2024-09-12T02:01:17.967008+0000","last_became_active":"2024-09-12T02:01:16.957998+0000","last_became_peered":"2024-09-12T02:01:16.957998+0000","last_unstale":"2024-09-12T02:01:17.967008+0000","last_undegraded":"2024-09-12T02:01:17.967008+0000","last_fullsized":"2024-09-12T02:01:17.967008+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:37.564902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.969349+0000","last_change":"2024-09-12T02:01:16.959827+0000","last_active":"2024-09-12T02:01:17.969349+0000","last_peered":"2024-09-12T02:01:17.969349+0000","last_clean":"2024-09-12T02:01:17.969349+0000","last_became_active":"2024-09-12T02:01:16.959482+0000","last_became_peered":"2024-09-12T02:01:16.959482+0000","last_unstale":"2024-09-12T02:01:17.969349+0000","last_undegraded":"2024-09-12T02:01:17.969349+0000","last_fullsized":"2024-09-12T02:01:17.969349+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:35.821699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.946909+0000","last_change":"2024-09-12T02:01:16.951071+0000","last_active":"2024-09-12T02:01:17.946909+0000","last_peered":"2024-09-12T02:01:17.946909+0000","last_clean":"2024-09-12T02:01:17.946909+0000","last_became_active":"2024-09-12T02:01:16.950789+0000","last_became_peered":"2024-09-12T02:01:16.950789+0000","last_unstale":"2024-09-12T02:01:17.946909+0000","last_undegraded":"2024-09-12T02:01:17.946909+0000","last_fullsized":"2024-09-12T02:01:17.946909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:32.677127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.977444+0000","last_change":"2024-09-12T02:01:16.976053+0000","last_active":"2024-09-12T02:01:16.977444+0000","last_peered":"2024-09-12T02:01:16.977444+0000","last_clean":"2024-09-12T02:01:16.977444+0000","last_became_active":"2024-09-12T02:01:16.975762+0000","last_became_peered":"2024-09-12T02:01:16.975762+0000","last_unstale":"2024-09-12T02:01:16.977444+0000","last_undegraded":"2024-09-12T02:01:16.977444+0000","last_fullsized":"2024-09-12T02:01:16.977444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:10.756563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.969012+0000","last_change":"2024-09-12T02:01:16.958259+0000","last_active":"2024-09-12T02:01:17.969012+0000","last_peered":"2024-09-12T02:01:17.969012+0000","last_clean":"2024-09-12T02:01:17.969012+0000","last_became_active":"2024-09-12T02:01:16.958054+0000","last_became_peered":"2024-09-12T02:01:16.958054+0000","last_unstale":"2024-09-12T02:01:17.969012+0000","last_undegraded":"2024-09-12T02:01:17.969012+0000","last_fullsized":"2024-09-12T02:01:17.969012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:21.171636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.959792+0000","last_change":"2024-09-12T02:01:16.957372+0000","last_active":"2024-09-12T02:01:16.959792+0000","last_peered":"2024-09-12T02:01:16.959792+0000","last_clean":"2024-09-12T02:01:16.959792+0000","last_became_active":"2024-09-12T02:01:16.957113+0000","last_became_peered":"2024-09-12T02:01:16.957113+0000","last_unstale":"2024-09-12T02:01:16.959792+0000","last_undegraded":"2024-09-12T02:01:16.959792+0000","last_fullsized":"2024-09-12T02:01:16.959792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:33.288856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.968828+0000","last_change":"2024-09-12T02:01:16.968831+0000","last_active":"2024-09-12T02:01:17.968828+0000","last_peered":"2024-09-12T02:01:17.968828+0000","last_clean":"2024-09-12T02:01:17.968828+0000","last_became_active":"2024-09-12T02:01:16.968507+0000","last_became_peered":"2024-09-12T02:01:16.968507+0000","last_unstale":"2024-09-12T02:01:17.968828+0000","last_undegraded":"2024-09-12T02:01:17.968828+0000","last_fullsized":"2024-09-12T02:01:17.968828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:05.599010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.957607+0000","last_change":"2024-09-12T02:01:16.955027+0000","last_active":"2024-09-12T02:01:16.957607+0000","last_peered":"2024-09-12T02:01:16.957607+0000","last_clean":"2024-09-12T02:01:16.957607+0000","last_became_active":"2024-09-12T02:01:16.954716+0000","last_became_peered":"2024-09-12T02:01:16.954716+0000","last_unstale":"2024-09-12T02:01:16.957607+0000","last_undegraded":"2024-09-12T02:01:16.957607+0000","last_fullsized":"2024-09-12T02:01:16.957607+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:35.198262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.966987+0000","last_change":"2024-09-12T02:01:16.967006+0000","last_active":"2024-09-12T02:01:17.966987+0000","last_peered":"2024-09-12T02:01:17.966987+0000","last_clean":"2024-09-12T02:01:17.966987+0000","last_became_active":"2024-09-12T02:01:16.966741+0000","last_became_peered":"2024-09-12T02:01:16.966741+0000","last_unstale":"2024-09-12T02:01:17.966987+0000","last_undegraded":"2024-09-12T02:01:17.966987+0000","last_fullsized":"2024-09-12T02:01:17.966987+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:54.541505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.966974+0000","last_change":"2024-09-12T02:01:16.966735+0000","last_active":"2024-09-12T02:01:17.966974+0000","last_peered":"2024-09-12T02:01:17.966974+0000","last_clean":"2024-09-12T02:01:17.966974+0000","last_became_active":"2024-09-12T02:01:16.966374+0000","last_became_peered":"2024-09-12T02:01:16.966374+0000","last_unstale":"2024-09-12T02:01:17.966974+0000","last_undegraded":"2024-09-12T02:01:17.966974+0000","last_fullsized":"2024-09-12T02:01:17.966974+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:45.782469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.969104+0000","last_change":"2024-09-12T02:01:16.956188+0000","last_active":"2024-09-12T02:01:17.969104+0000","last_peered":"2024-09-12T02:01:17.969104+0000","last_clean":"2024-09-12T02:01:17.969104+0000","last_became_active":"2024-09-12T02:01:16.955922+0000","last_became_peered":"2024-09-12T02:01:16.955922+0000","last_unstale":"2024-09-12T02:01:17.969104+0000","last_undegraded":"2024-09-12T02:01:17.969104+0000","last_fullsized":"2024-09-12T02:01:17.969104+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:18.186209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.966791+0000","last_change":"2024-09-12T02:01:16.957658+0000","last_active":"2024-09-12T02:01:17.966791+0000","last_peered":"2024-09-12T02:01:17.966791+0000","last_clean":"2024-09-12T02:01:17.966791+0000","last_became_active":"2024-09-12T02:01:16.957125+0000","last_became_peered":"2024-09-12T02:01:16.957125+0000","last_unstale":"2024-09-12T02:01:17.966791+0000","last_undegraded":"2024-09-12T02:01:17.966791+0000","last_fullsized":"2024-09-12T02:01:17.966791+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:36.856973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.946581+0000","last_change":"2024-09-12T02:01:16.955871+0000","last_active":"2024-09-12T02:01:17.946581+0000","last_peered":"2024-09-12T02:01:17.946581+0000","last_clean":"2024-09-12T02:01:17.946581+0000","last_became_active":"2024-09-12T02:01:16.955568+0000","last_became_peered":"2024-09-12T02:01:16.955568+0000","last_unstale":"2024-09-12T02:01:17.946581+0000","last_undegraded":"2024-09-12T02:01:17.946581+0000","last_fullsized":"2024-09-12T02:01:17.946581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:51.382298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.946658+0000","last_change":"2024-09-12T02:01:16.950556+0000","last_active":"2024-09-12T02:01:17.946658+0000","last_peered":"2024-09-12T02:01:17.946658+0000","last_clean":"2024-09-12T02:01:17.946658+0000","last_became_active":"2024-09-12T02:01:16.950268+0000","last_became_peered":"2024-09-12T02:01:16.950268+0000","last_unstale":"2024-09-12T02:01:17.946658+0000","last_undegraded":"2024-09-12T02:01:17.946658+0000","last_fullsized":"2024-09-12T02:01:17.946658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:02.332258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"80'4","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.969327+0000","last_change":"2024-09-12T02:01:15.950622+0000","last_active":"2024-09-12T02:01:17.969327+0000","last_peered":"2024-09-12T02:01:17.969327+0000","last_clean":"2024-09-12T02:01:17.969327+0000","last_became_active":"2024-09-12T02:01:15.950382+0000","last_became_peered":"2024-09-12T02:01:15.950382+0000","last_unstale":"2024-09-12T02:01:17.969327+0000","last_undegraded":"2024-09-12T02:01:17.969327+0000","last_fullsized":"2024-09-12T02:01:17.969327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:46.843090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.966735+0000","last_change":"2024-09-12T02:01:16.957084+0000","last_active":"2024-09-12T02:01:17.966735+0000","last_peered":"2024-09-12T02:01:17.966735+0000","last_clean":"2024-09-12T02:01:17.966735+0000","last_became_active":"2024-09-12T02:01:16.956786+0000","last_became_peered":"2024-09-12T02:01:16.956786+0000","last_unstale":"2024-09-12T02:01:17.966735+0000","last_undegraded":"2024-09-12T02:01:17.966735+0000","last_fullsized":"2024-09-12T02:01:17.966735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:41.508955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:14.920305+0000","last_change":"2024-09-12T02:01:14.920305+0000","last_active":"2024-09-12T02:01:14.920305+0000","last_peered":"2024-09-12T02:01:14.920305+0000","last_clean":"2024-09-12T02:01:14.920305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:14.920305+0000","last_undegraded":"2024-09-12T02:01:14.920305+0000","last_fullsized":"2024-09-12T02:01:14.920305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.973987+0000","last_change":"2024-09-12T02:01:16.969119+0000","last_active":"2024-09-12T02:01:16.973987+0000","last_peered":"2024-09-12T02:01:16.973987+0000","last_clean":"2024-09-12T02:01:16.973987+0000","last_became_active":"2024-09-12T02:01:16.968871+0000","last_became_peered":"2024-09-12T02:01:16.968871+0000","last_unstale":"2024-09-12T02:01:16.973987+0000","last_undegraded":"2024-09-12T02:01:16.973987+0000","last_fullsized":"2024-09-12T02:01:16.973987+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:33.614862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:14.920305+0000","last_change":"2024-09-12T02:01:14.920305+0000","last_active":"2024-09-12T02:01:14.920305+0000","last_peered":"2024-09-12T02:01:14.920305+0000","last_clean":"2024-09-12T02:01:14.920305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:14.920305+0000","last_undegraded":"2024-09-12T02:01:14.920305+0000","last_fullsized":"2024-09-12T02:01:14.920305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.959759+0000","last_change":"2024-09-12T02:01:16.956725+0000","last_active":"2024-09-12T02:01:16.959759+0000","last_peered":"2024-09-12T02:01:16.959759+0000","last_clean":"2024-09-12T02:01:16.959759+0000","last_became_active":"2024-09-12T02:01:16.956443+0000","last_became_peered":"2024-09-12T02:01:16.956443+0000","last_unstale":"2024-09-12T02:01:16.959759+0000","last_undegraded":"2024-09-12T02:01:16.959759+0000","last_fullsized":"2024-09-12T02:01:16.959759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:18.440929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:14.920305+0000","last_change":"2024-09-12T02:01:14.920305+0000","last_active":"2024-09-12T02:01:14.920305+0000","last_peered":"2024-09-12T02:01:14.920305+0000","last_clean":"2024-09-12T02:01:14.920305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:14.920305+0000","last_undegraded":"2024-09-12T02:01:14.920305+0000","last_fullsized":"2024-09-12T02:01:14.920305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.966864+0000","last_change":"2024-09-12T02:01:16.973403+0000","last_active":"2024-09-12T02:01:17.966864+0000","last_peered":"2024-09-12T02:01:17.966864+0000","last_clean":"2024-09-12T02:01:17.966864+0000","last_became_active":"2024-09-12T02:01:16.973115+0000","last_became_peered":"2024-09-12T02:01:16.973115+0000","last_unstale":"2024-09-12T02:01:17.966864+0000","last_undegraded":"2024-09-12T02:01:17.966864+0000","last_fullsized":"2024-09-12T02:01:17.966864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:36.479758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.976827+0000","last_change":"2024-09-12T02:01:15.947612+0000","last_active":"2024-09-12T02:01:16.976827+0000","last_peered":"2024-09-12T02:01:16.976827+0000","last_clean":"2024-09-12T02:01:16.976827+0000","last_became_active":"2024-09-12T02:01:15.947327+0000","last_became_peered":"2024-09-12T02:01:15.947327+0000","last_unstale":"2024-09-12T02:01:16.976827+0000","last_undegraded":"2024-09-12T02:01:16.976827+0000","last_fullsized":"2024-09-12T02:01:16.976827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:03.336881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.967154+0000","last_change":"2024-09-12T02:01:16.965031+0000","last_active":"2024-09-12T02:01:17.967154+0000","last_peered":"2024-09-12T02:01:17.967154+0000","last_clean":"2024-09-12T02:01:17.967154+0000","last_became_active":"2024-09-12T02:01:16.964734+0000","last_became_peered":"2024-09-12T02:01:16.964734+0000","last_unstale":"2024-09-12T02:01:17.967154+0000","last_undegraded":"2024-09-12T02:01:17.967154+0000","last_fullsized":"2024-09-12T02:01:17.967154+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:12.004970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:14.920305+0000","last_change":"2024-09-12T02:01:14.920305+0000","last_active":"2024-09-12T02:01:14.920305+0000","last_peered":"2024-09-12T02:01:14.920305+0000","last_clean":"2024-09-12T02:01:14.920305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:14.920305+0000","last_undegraded":"2024-09-12T02:01:14.920305+0000","last_fullsized":"2024-09-12T02:01:14.920305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.974012+0000","last_change":"2024-09-12T02:01:16.968310+0000","last_active":"2024-09-12T02:01:16.974012+0000","last_peered":"2024-09-12T02:01:16.974012+0000","last_clean":"2024-09-12T02:01:16.974012+0000","last_became_active":"2024-09-12T02:01:16.968050+0000","last_became_peered":"2024-09-12T02:01:16.968050+0000","last_unstale":"2024-09-12T02:01:16.974012+0000","last_undegraded":"2024-09-12T02:01:16.974012+0000","last_fullsized":"2024-09-12T02:01:16.974012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:44.940577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.966849+0000","last_change":"2024-09-12T02:01:15.949053+0000","last_active":"2024-09-12T02:01:17.966849+0000","last_peered":"2024-09-12T02:01:17.966849+0000","last_clean":"2024-09-12T02:01:17.966849+0000","last_became_active":"2024-09-12T02:01:15.948754+0000","last_became_peered":"2024-09-12T02:01:15.948754+0000","last_unstale":"2024-09-12T02:01:17.966849+0000","last_undegraded":"2024-09-12T02:01:17.966849+0000","last_fullsized":"2024-09-12T02:01:17.966849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:48.805030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.968729+0000","last_change":"2024-09-12T02:01:15.953945+0000","last_active":"2024-09-12T02:01:17.968729+0000","last_peered":"2024-09-12T02:01:17.968729+0000","last_clean":"2024-09-12T02:01:17.968729+0000","last_became_active":"2024-09-12T02:01:15.952853+0000","last_became_peered":"2024-09-12T02:01:15.952853+0000","last_unstale":"2024-09-12T02:01:17.968729+0000","last_undegraded":"2024-09-12T02:01:17.968729+0000","last_fullsized":"2024-09-12T02:01:17.968729+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:11.380158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.967042+0000","last_change":"2024-09-12T02:01:16.964431+0000","last_active":"2024-09-12T02:01:17.967042+0000","last_peered":"2024-09-12T02:01:17.967042+0000","last_clean":"2024-09-12T02:01:17.967042+0000","last_became_active":"2024-09-12T02:01:16.964139+0000","last_became_peered":"2024-09-12T02:01:16.964139+0000","last_unstale":"2024-09-12T02:01:17.967042+0000","last_undegraded":"2024-09-12T02:01:17.967042+0000","last_fullsized":"2024-09-12T02:01:17.967042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:13.067321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:14.920305+0000","last_change":"2024-09-12T02:01:14.920305+0000","last_active":"2024-09-12T02:01:14.920305+0000","last_peered":"2024-09-12T02:01:14.920305+0000","last_clean":"2024-09-12T02:01:14.920305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:14.920305+0000","last_undegraded":"2024-09-12T02:01:14.920305+0000","last_fullsized":"2024-09-12T02:01:14.920305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:14.920305+0000","last_change":"2024-09-12T02:01:14.920305+0000","last_active":"2024-09-12T02:01:14.920305+0000","last_peered":"2024-09-12T02:01:14.920305+0000","last_clean":"2024-09-12T02:01:14.920305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:14.920305+0000","last_undegraded":"2024-09-12T02:01:14.920305+0000","last_fullsized":"2024-09-12T02:01:14.920305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.969821+0000","last_change":"2024-09-12T02:01:16.965816+0000","last_active":"2024-09-12T02:01:16.969821+0000","last_peered":"2024-09-12T02:01:16.969821+0000","last_clean":"2024-09-12T02:01:16.969821+0000","last_became_active":"2024-09-12T02:01:16.965488+0000","last_became_peered":"2024-09-12T02:01:16.965488+0000","last_unstale":"2024-09-12T02:01:16.969821+0000","last_undegraded":"2024-09-12T02:01:16.969821+0000","last_fullsized":"2024-09-12T02:01:16.969821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:16.856137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"80'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.968987+0000","last_change":"2024-09-12T02:01:15.949446+0000","last_active":"2024-09-12T02:01:17.968987+0000","last_peered":"2024-09-12T02:01:17.968987+0000","last_clean":"2024-09-12T02:01:17.968987+0000","last_became_active":"2024-09-12T02:01:15.949175+0000","last_became_peered":"2024-09-12T02:01:15.949175+0000","last_unstale":"2024-09-12T02:01:17.968987+0000","last_undegraded":"2024-09-12T02:01:17.968987+0000","last_fullsized":"2024-09-12T02:01:17.968987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:03.647802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.946769+0000","last_change":"2024-09-12T02:01:16.958283+0000","last_active":"2024-09-12T02:01:17.946769+0000","last_peered":"2024-09-12T02:01:17.946769+0000","last_clean":"2024-09-12T02:01:17.946769+0000","last_became_active":"2024-09-12T02:01:16.957977+0000","last_became_peered":"2024-09-12T02:01:16.957977+0000","last_unstale":"2024-09-12T02:01:17.946769+0000","last_undegraded":"2024-09-12T02:01:17.946769+0000","last_fullsized":"2024-09-12T02:01:17.946769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:48.577512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:14.920305+0000","last_change":"2024-09-12T02:01:14.920305+0000","last_active":"2024-09-12T02:01:14.920305+0000","last_peered":"2024-09-12T02:01:14.920305+0000","last_clean":"2024-09-12T02:01:14.920305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:14.920305+0000","last_undegraded":"2024-09-12T02:01:14.920305+0000","last_fullsized":"2024-09-12T02:01:14.920305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:14.920305+0000","last_change":"2024-09-12T02:01:14.920305+0000","last_active":"2024-09-12T02:01:14.920305+0000","last_peered":"2024-09-12T02:01:14.920305+0000","last_clean":"2024-09-12T02:01:14.920305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:14.920305+0000","last_undegraded":"2024-09-12T02:01:14.920305+0000","last_fullsized":"2024-09-12T02:01:14.920305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:14.920305+0000","last_change":"2024-09-12T02:01:14.920305+0000","last_active":"2024-09-12T02:01:14.920305+0000","last_peered":"2024-09-12T02:01:14.920305+0000","last_clean":"2024-09-12T02:01:14.920305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:14.920305+0000","last_undegraded":"2024-09-12T02:01:14.920305+0000","last_fullsized":"2024-09-12T02:01:14.920305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.969193+0000","last_change":"2024-09-12T02:01:15.953522+0000","last_active":"2024-09-12T02:01:17.969193+0000","last_peered":"2024-09-12T02:01:17.969193+0000","last_clean":"2024-09-12T02:01:17.969193+0000","last_became_active":"2024-09-12T02:01:15.953187+0000","last_became_peered":"2024-09-12T02:01:15.953187+0000","last_unstale":"2024-09-12T02:01:17.969193+0000","last_undegraded":"2024-09-12T02:01:17.969193+0000","last_fullsized":"2024-09-12T02:01:17.969193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:55.422065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"80'8","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.967092+0000","last_change":"2024-09-12T02:01:15.945615+0000","last_active":"2024-09-12T02:01:17.967092+0000","last_peered":"2024-09-12T02:01:17.967092+0000","last_clean":"2024-09-12T02:01:17.967092+0000","last_became_active":"2024-09-12T02:01:15.945324+0000","last_became_peered":"2024-09-12T02:01:15.945324+0000","last_unstale":"2024-09-12T02:01:17.967092+0000","last_undegraded":"2024-09-12T02:01:17.967092+0000","last_fullsized":"2024-09-12T02:01:17.967092+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:17.891305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.977629+0000","last_change":"2024-09-12T02:01:16.976416+0000","last_active":"2024-09-12T02:01:16.977629+0000","last_peered":"2024-09-12T02:01:16.977629+0000","last_clean":"2024-09-12T02:01:16.977629+0000","last_became_active":"2024-09-12T02:01:16.975616+0000","last_became_peered":"2024-09-12T02:01:16.975616+0000","last_unstale":"2024-09-12T02:01:16.977629+0000","last_undegraded":"2024-09-12T02:01:16.977629+0000","last_fullsized":"2024-09-12T02:01:16.977629+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:31.196986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:14.920305+0000","last_change":"2024-09-12T02:01:14.920305+0000","last_active":"2024-09-12T02:01:14.920305+0000","last_peered":"2024-09-12T02:01:14.920305+0000","last_clean":"2024-09-12T02:01:14.920305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:14.920305+0000","last_undegraded":"2024-09-12T02:01:14.920305+0000","last_fullsized":"2024-09-12T02:01:14.920305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.968734+0000","last_change":"2024-09-12T02:01:16.959176+0000","last_active":"2024-09-12T02:01:17.968734+0000","last_peered":"2024-09-12T02:01:17.968734+0000","last_clean":"2024-09-12T02:01:17.968734+0000","last_became_active":"2024-09-12T02:01:16.958668+0000","last_became_peered":"2024-09-12T02:01:16.958668+0000","last_unstale":"2024-09-12T02:01:17.968734+0000","last_undegraded":"2024-09-12T02:01:17.968734+0000","last_fullsized":"2024-09-12T02:01:17.968734+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:43.193827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.976924+0000","last_change":"2024-09-12T02:01:15.949596+0000","last_active":"2024-09-12T02:01:16.976924+0000","last_peered":"2024-09-12T02:01:16.976924+0000","last_clean":"2024-09-12T02:01:16.976924+0000","last_became_active":"2024-09-12T02:01:15.949302+0000","last_became_peered":"2024-09-12T02:01:15.949302+0000","last_unstale":"2024-09-12T02:01:16.976924+0000","last_undegraded":"2024-09-12T02:01:16.976924+0000","last_fullsized":"2024-09-12T02:01:16.976924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:26.787961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.969011+0000","last_change":"2024-09-12T02:01:16.970628+0000","last_active":"2024-09-12T02:01:17.969011+0000","last_peered":"2024-09-12T02:01:17.969011+0000","last_clean":"2024-09-12T02:01:17.969011+0000","last_became_active":"2024-09-12T02:01:16.970322+0000","last_became_peered":"2024-09-12T02:01:16.970322+0000","last_unstale":"2024-09-12T02:01:17.969011+0000","last_undegraded":"2024-09-12T02:01:17.969011+0000","last_fullsized":"2024-09-12T02:01:17.969011+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:24.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.969010+0000","last_change":"2024-09-12T02:01:15.953248+0000","last_active":"2024-09-12T02:01:17.969010+0000","last_peered":"2024-09-12T02:01:17.969010+0000","last_clean":"2024-09-12T02:01:17.969010+0000","last_became_active":"2024-09-12T02:01:15.952940+0000","last_became_peered":"2024-09-12T02:01:15.952940+0000","last_unstale":"2024-09-12T02:01:17.969010+0000","last_undegraded":"2024-09-12T02:01:17.969010+0000","last_fullsized":"2024-09-12T02:01:17.969010+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:02.872513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.977636+0000","last_change":"2024-09-12T02:01:16.976124+0000","last_active":"2024-09-12T02:01:16.977636+0000","last_peered":"2024-09-12T02:01:16.977636+0000","last_clean":"2024-09-12T02:01:16.977636+0000","last_became_active":"2024-09-12T02:01:16.975845+0000","last_became_peered":"2024-09-12T02:01:16.975845+0000","last_unstale":"2024-09-12T02:01:16.977636+0000","last_undegraded":"2024-09-12T02:01:16.977636+0000","last_fullsized":"2024-09-12T02:01:16.977636+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:35.749442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.946728+0000","last_change":"2024-09-12T02:01:15.947948+0000","last_active":"2024-09-12T02:01:17.946728+0000","last_peered":"2024-09-12T02:01:17.946728+0000","last_clean":"2024-09-12T02:01:17.946728+0000","last_became_active":"2024-09-12T02:01:15.947652+0000","last_became_peered":"2024-09-12T02:01:15.947652+0000","last_unstale":"2024-09-12T02:01:17.946728+0000","last_undegraded":"2024-09-12T02:01:17.946728+0000","last_fullsized":"2024-09-12T02:01:17.946728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:17.435813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.967016+0000","last_change":"2024-09-12T02:01:16.962037+0000","last_active":"2024-09-12T02:01:17.967016+0000","last_peered":"2024-09-12T02:01:17.967016+0000","last_clean":"2024-09-12T02:01:17.967016+0000","last_became_active":"2024-09-12T02:01:16.959060+0000","last_became_peered":"2024-09-12T02:01:16.959060+0000","last_unstale":"2024-09-12T02:01:17.967016+0000","last_undegraded":"2024-09-12T02:01:17.967016+0000","last_fullsized":"2024-09-12T02:01:17.967016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:44.013426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.978993+0000","last_change":"2024-09-12T02:01:15.955971+0000","last_active":"2024-09-12T02:01:16.978993+0000","last_peered":"2024-09-12T02:01:16.978993+0000","last_clean":"2024-09-12T02:01:16.978993+0000","last_became_active":"2024-09-12T02:01:15.955682+0000","last_became_peered":"2024-09-12T02:01:15.955682+0000","last_unstale":"2024-09-12T02:01:16.978993+0000","last_undegraded":"2024-09-12T02:01:16.978993+0000","last_fullsized":"2024-09-12T02:01:16.978993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:38.343028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.967159+0000","last_change":"2024-09-12T02:01:16.961984+0000","last_active":"2024-09-12T02:01:17.967159+0000","last_peered":"2024-09-12T02:01:17.967159+0000","last_clean":"2024-09-12T02:01:17.967159+0000","last_became_active":"2024-09-12T02:01:16.961692+0000","last_became_peered":"2024-09-12T02:01:16.961692+0000","last_unstale":"2024-09-12T02:01:17.967159+0000","last_undegraded":"2024-09-12T02:01:17.967159+0000","last_fullsized":"2024-09-12T02:01:17.967159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:20.571930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.954581+0000","last_change":"2024-09-12T02:01:15.952198+0000","last_active":"2024-09-12T02:01:16.954581+0000","last_peered":"2024-09-12T02:01:16.954581+0000","last_clean":"2024-09-12T02:01:16.954581+0000","last_became_active":"2024-09-12T02:01:15.951781+0000","last_became_peered":"2024-09-12T02:01:15.951781+0000","last_unstale":"2024-09-12T02:01:16.954581+0000","last_undegraded":"2024-09-12T02:01:16.954581+0000","last_fullsized":"2024-09-12T02:01:16.954581+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:59.099315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.954333+0000","last_change":"2024-09-12T02:01:15.949288+0000","last_active":"2024-09-12T02:01:16.954333+0000","last_peered":"2024-09-12T02:01:16.954333+0000","last_clean":"2024-09-12T02:01:16.954333+0000","last_became_active":"2024-09-12T02:01:15.949026+0000","last_became_peered":"2024-09-12T02:01:15.949026+0000","last_unstale":"2024-09-12T02:01:16.954333+0000","last_undegraded":"2024-09-12T02:01:16.954333+0000","last_fullsized":"2024-09-12T02:01:16.954333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:56.183776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.960450+0000","last_change":"2024-09-12T02:01:16.956336+0000","last_active":"2024-09-12T02:01:16.960450+0000","last_peered":"2024-09-12T02:01:16.960450+0000","last_clean":"2024-09-12T02:01:16.960450+0000","last_became_active":"2024-09-12T02:01:16.956035+0000","last_became_peered":"2024-09-12T02:01:16.956035+0000","last_unstale":"2024-09-12T02:01:16.960450+0000","last_undegraded":"2024-09-12T02:01:16.960450+0000","last_fullsized":"2024-09-12T02:01:16.960450+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:55.248879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:14.920305+0000","last_change":"2024-09-12T02:01:14.920305+0000","last_active":"2024-09-12T02:01:14.920305+0000","last_peered":"2024-09-12T02:01:14.920305+0000","last_clean":"2024-09-12T02:01:14.920305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:14.920305+0000","last_undegraded":"2024-09-12T02:01:14.920305+0000","last_fullsized":"2024-09-12T02:01:14.920305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"81'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.968295+0000","last_change":"2024-09-12T02:01:15.955652+0000","last_active":"2024-09-12T02:01:17.968295+0000","last_peered":"2024-09-12T02:01:17.968295+0000","last_clean":"2024-09-12T02:01:17.968295+0000","last_became_active":"2024-09-12T02:01:15.954910+0000","last_became_peered":"2024-09-12T02:01:15.954910+0000","last_unstale":"2024-09-12T02:01:17.968295+0000","last_undegraded":"2024-09-12T02:01:17.968295+0000","last_fullsized":"2024-09-12T02:01:17.968295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:20.534499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.976755+0000","last_change":"2024-09-12T02:01:16.969834+0000","last_active":"2024-09-12T02:01:16.976755+0000","last_peered":"2024-09-12T02:01:16.976755+0000","last_clean":"2024-09-12T02:01:16.976755+0000","last_became_active":"2024-09-12T02:01:16.969553+0000","last_became_peered":"2024-09-12T02:01:16.969553+0000","last_unstale":"2024-09-12T02:01:16.976755+0000","last_undegraded":"2024-09-12T02:01:16.976755+0000","last_fullsized":"2024-09-12T02:01:16.976755+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:53.939479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:14.920305+0000","last_change":"2024-09-12T02:01:14.920305+0000","last_active":"2024-09-12T02:01:14.920305+0000","last_peered":"2024-09-12T02:01:14.920305+0000","last_clean":"2024-09-12T02:01:14.920305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:14.920305+0000","last_undegraded":"2024-09-12T02:01:14.920305+0000","last_fullsized":"2024-09-12T02:01:14.920305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.966910+0000","last_change":"2024-09-12T02:01:16.963656+0000","last_active":"2024-09-12T02:01:17.966910+0000","last_peered":"2024-09-12T02:01:17.966910+0000","last_clean":"2024-09-12T02:01:17.966910+0000","last_became_active":"2024-09-12T02:01:16.963379+0000","last_became_peered":"2024-09-12T02:01:16.963379+0000","last_unstale":"2024-09-12T02:01:17.966910+0000","last_undegraded":"2024-09-12T02:01:17.966910+0000","last_fullsized":"2024-09-12T02:01:17.966910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:56.681105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:14.920305+0000","last_change":"2024-09-12T02:01:14.920305+0000","last_active":"2024-09-12T02:01:14.920305+0000","last_peered":"2024-09-12T02:01:14.920305+0000","last_clean":"2024-09-12T02:01:14.920305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:14.920305+0000","last_undegraded":"2024-09-12T02:01:14.920305+0000","last_fullsized":"2024-09-12T02:01:14.920305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:14.920305+0000","last_change":"2024-09-12T02:01:14.920305+0000","last_active":"2024-09-12T02:01:14.920305+0000","last_peered":"2024-09-12T02:01:14.920305+0000","last_clean":"2024-09-12T02:01:14.920305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:14.920305+0000","last_undegraded":"2024-09-12T02:01:14.920305+0000","last_fullsized":"2024-09-12T02:01:14.920305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.968961+0000","last_change":"2024-09-12T02:01:15.950744+0000","last_active":"2024-09-12T02:01:17.968961+0000","last_peered":"2024-09-12T02:01:17.968961+0000","last_clean":"2024-09-12T02:01:17.968961+0000","last_became_active":"2024-09-12T02:01:15.950472+0000","last_became_peered":"2024-09-12T02:01:15.950472+0000","last_unstale":"2024-09-12T02:01:17.968961+0000","last_undegraded":"2024-09-12T02:01:17.968961+0000","last_fullsized":"2024-09-12T02:01:17.968961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:45.872985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.946961+0000","last_change":"2024-09-12T02:01:16.968062+0000","last_active":"2024-09-12T02:01:17.946961+0000","last_peered":"2024-09-12T02:01:17.946961+0000","last_clean":"2024-09-12T02:01:17.946961+0000","last_became_active":"2024-09-12T02:01:16.967783+0000","last_became_peered":"2024-09-12T02:01:16.967783+0000","last_unstale":"2024-09-12T02:01:17.946961+0000","last_undegraded":"2024-09-12T02:01:17.946961+0000","last_fullsized":"2024-09-12T02:01:17.946961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:51.495385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:14.920305+0000","last_change":"2024-09-12T02:01:14.920305+0000","last_active":"2024-09-12T02:01:14.920305+0000","last_peered":"2024-09-12T02:01:14.920305+0000","last_clean":"2024-09-12T02:01:14.920305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:14.920305+0000","last_undegraded":"2024-09-12T02:01:14.920305+0000","last_fullsized":"2024-09-12T02:01:14.920305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.946984+0000","last_change":"2024-09-12T02:01:16.962786+0000","last_active":"2024-09-12T02:01:17.946984+0000","last_peered":"2024-09-12T02:01:17.946984+0000","last_clean":"2024-09-12T02:01:17.946984+0000","last_became_active":"2024-09-12T02:01:16.962477+0000","last_became_peered":"2024-09-12T02:01:16.962477+0000","last_unstale":"2024-09-12T02:01:17.946984+0000","last_undegraded":"2024-09-12T02:01:17.946984+0000","last_fullsized":"2024-09-12T02:01:17.946984+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:17.615499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.946535+0000","last_change":"2024-09-12T02:01:15.948703+0000","last_active":"2024-09-12T02:01:17.946535+0000","last_peered":"2024-09-12T02:01:17.946535+0000","last_clean":"2024-09-12T02:01:17.946535+0000","last_became_active":"2024-09-12T02:01:15.948421+0000","last_became_peered":"2024-09-12T02:01:15.948421+0000","last_unstale":"2024-09-12T02:01:17.946535+0000","last_undegraded":"2024-09-12T02:01:17.946535+0000","last_fullsized":"2024-09-12T02:01:17.946535+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:32.283740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:01:15.925421+0000","last_change":"2024-09-12T02:01:15.925421+0000","last_active":"2024-09-12T02:01:15.925421+0000","last_peered":"2024-09-12T02:01:15.925421+0000","last_clean":"2024-09-12T02:01:15.925421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:01:15.925421+0000","last_undegraded":"2024-09-12T02:01:15.925421+0000","last_fullsized":"2024-09-12T02:01:15.925421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.963266+0000","last_change":"2024-09-12T02:01:15.946098+0000","last_active":"2024-09-12T02:01:16.963266+0000","last_peered":"2024-09-12T02:01:16.963266+0000","last_clean":"2024-09-12T02:01:16.963266+0000","last_became_active":"2024-09-12T02:01:15.945820+0000","last_became_peered":"2024-09-12T02:01:15.945820+0000","last_unstale":"2024-09-12T02:01:16.963266+0000","last_undegraded":"2024-09-12T02:01:16.963266+0000","last_fullsized":"2024-09-12T02:01:16.963266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:30.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":272,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T02:01:13.737085+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T02:01:13.737085+0000","last_peered":"2024-09-12T02:01:13.737085+0000","last_clean":"2024-09-12T02:01:13.737085+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T02:01:13.737085+0000","last_undegraded":"2024-09-12T02:01:13.737085+0000","last_fullsized":"2024-09-12T02:01:13.737085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":86,"acting":86,"num_store_stats":5},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":34,"acting":34,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509510,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28524,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343316,"statfs":{"total":96636764160,"available":96607555584,"internally_reserved":0,"allocated":1527808,"data_stored":1017900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27952,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":933888,"data_stored":427532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":427532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542215,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":974848,"data_stored":448157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542215,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":448317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542215,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":991232,"data_stored":454379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542215,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1576960,"data_stored":1044635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":958464,"data_stored":440408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:01:19.939 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:01:20.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.076+0000 7fee84aaf640 1 Processor -- start 2024-09-12T02:01:20.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.076+0000 7fee84aaf640 1 -- start start 2024-09-12T02:01:20.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.077+0000 7fee84aaf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fee800d1540 0x7fee8006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.077+0000 7fee84aaf640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee800d1970 con 0x7fee8009b690 2024-09-12T02:01:20.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.077+0000 7fee84aaf640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee800d0780 con 0x7fee8015e740 2024-09-12T02:01:20.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.077+0000 7fee84aaf640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fee8015eb20 con 0x7fee800d1540 2024-09-12T02:01:20.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.077+0000 7fee7dd9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fee800d1540 0x7fee8006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.077+0000 7fee7ed9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fee8009b690 0x7fee80070160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40700/0 (socket says 172.21.15.19:40700) 2024-09-12T02:01:20.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.077+0000 7fee7ed9d640 1 -- 172.21.15.19:0/1182220737 learned_addr learned my addr 172.21.15.19:0/1182220737 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:20.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.077+0000 7fee7dd9b640 1 -- 172.21.15.19:0/1182220737 >> v1:172.21.15.135:6789/0 conn(0x7fee8015e740 legacy=0x7fee8006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:20.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.077+0000 7fee7dd9b640 1 -- 172.21.15.19:0/1182220737 >> v1:172.21.15.19:6789/0 conn(0x7fee8009b690 legacy=0x7fee80070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:20.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.077+0000 7fee7dd9b640 1 -- 172.21.15.19:0/1182220737 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee800d0a60 con 0x7fee800d1540 2024-09-12T02:01:20.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.077+0000 7fee7d59a640 1 -- 172.21.15.19:0/1182220737 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1842171201 0 0) 0x7fee800d1970 con 0x7fee8009b690 2024-09-12T02:01:20.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.078+0000 7fee7dd9b640 1 --2- 172.21.15.19:0/1182220737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee800d1540 0x7fee8006dbd0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fee680097a0 tx=0x7fee6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e904f05ce270d30a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:20.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.078+0000 7fee7d59a640 1 -- 172.21.15.19:0/1182220737 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68037070 con 0x7fee800d1540 2024-09-12T02:01:20.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.078+0000 7fee7d59a640 1 -- 172.21.15.19:0/1182220737 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee68032440 con 0x7fee800d1540 2024-09-12T02:01:20.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.078+0000 7fee7d59a640 1 -- 172.21.15.19:0/1182220737 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68032810 con 0x7fee800d1540 2024-09-12T02:01:20.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.078+0000 7fee84aaf640 1 -- 172.21.15.19:0/1182220737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee800d1540 msgr2=0x7fee8006dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:20.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.078+0000 7fee84aaf640 1 --2- 172.21.15.19:0/1182220737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee800d1540 0x7fee8006dbd0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fee680097a0 tx=0x7fee6802a270 comp rx=0 tx=0).stop 2024-09-12T02:01:20.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.079+0000 7fee84aaf640 1 -- 172.21.15.19:0/1182220737 shutdown_connections 2024-09-12T02:01:20.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.079+0000 7fee84aaf640 1 --2- 172.21.15.19:0/1182220737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee800d1540 0x7fee8006dbd0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.079+0000 7fee84aaf640 1 -- 172.21.15.19:0/1182220737 >> 172.21.15.19:0/1182220737 conn(0x7fee800d23a0 msgr2=0x7fee800d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:20.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.079+0000 7fee84aaf640 1 -- 172.21.15.19:0/1182220737 shutdown_connections 2024-09-12T02:01:20.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.079+0000 7fee84aaf640 1 -- 172.21.15.19:0/1182220737 wait complete. 2024-09-12T02:01:20.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.080+0000 7fee84aaf640 1 Processor -- start 2024-09-12T02:01:20.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.080+0000 7fee84aaf640 1 -- start start 2024-09-12T02:01:20.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee84aaf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee8009b690 0x7fee80157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee84aaf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee800d1540 0x7fee800ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee84aaf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee8015e740 0x7fee80071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee84aaf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fee8009baa0 con 0x7fee8009b690 2024-09-12T02:01:20.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee84aaf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fee800d1020 con 0x7fee8015e740 2024-09-12T02:01:20.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee84aaf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fee8006cd20 con 0x7fee800d1540 2024-09-12T02:01:20.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee7e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee8009b690 0x7fee80157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee7e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee8009b690 0x7fee80157a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55142/0 (socket says 172.21.15.19:55142) 2024-09-12T02:01:20.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee7e59c640 1 -- 172.21.15.19:0/2857187098 learned_addr learned my addr 172.21.15.19:0/2857187098 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:20.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee7ed9d640 1 --2- 172.21.15.19:0/2857187098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee8015e740 0x7fee80071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee7dd9b640 1 --2- 172.21.15.19:0/2857187098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee800d1540 0x7fee800ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee7e59c640 1 -- 172.21.15.19:0/2857187098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee800d1540 msgr2=0x7fee800ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:20.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee7e59c640 1 --2- 172.21.15.19:0/2857187098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee800d1540 0x7fee800ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee7e59c640 1 -- 172.21.15.19:0/2857187098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee8015e740 msgr2=0x7fee80071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:20.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee7e59c640 1 --2- 172.21.15.19:0/2857187098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee8015e740 0x7fee80071170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee7e59c640 1 -- 172.21.15.19:0/2857187098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee800b55d0 con 0x7fee8009b690 2024-09-12T02:01:20.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee7dd9b640 1 --2- 172.21.15.19:0/2857187098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee800d1540 0x7fee800ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:20.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee7e59c640 1 --2- 172.21.15.19:0/2857187098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee8009b690 0x7fee80157a20 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fee7800ba80 tx=0x7fee7800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:20.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee76ffd640 1 -- 172.21.15.19:0/2857187098 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7800cc00 con 0x7fee8009b690 2024-09-12T02:01:20.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee76ffd640 1 -- 172.21.15.19:0/2857187098 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee7800cda0 con 0x7fee8009b690 2024-09-12T02:01:20.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.081+0000 7fee84aaf640 1 -- 172.21.15.19:0/2857187098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee800b58b0 con 0x7fee8009b690 2024-09-12T02:01:20.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.082+0000 7fee76ffd640 1 -- 172.21.15.19:0/2857187098 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee78003bb0 con 0x7fee8009b690 2024-09-12T02:01:20.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.082+0000 7fee84aaf640 1 -- 172.21.15.19:0/2857187098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee800b5e70 con 0x7fee8009b690 2024-09-12T02:01:20.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.083+0000 7fee84aaf640 1 -- 172.21.15.19:0/2857187098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee8006d0b0 con 0x7fee8009b690 2024-09-12T02:01:20.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.083+0000 7fee76ffd640 1 -- 172.21.15.19:0/2857187098 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee78014440 con 0x7fee8009b690 2024-09-12T02:01:20.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.084+0000 7fee76ffd640 1 --2- 172.21.15.19:0/2857187098 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fee6006be30 0x7fee6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.084+0000 7fee76ffd640 1 -- 172.21.15.19:0/2857187098 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fee7808af50 con 0x7fee8009b690 2024-09-12T02:01:20.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.084+0000 7fee7dd9b640 1 --2- 172.21.15.19:0/2857187098 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fee6006be30 0x7fee6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.084+0000 7fee7dd9b640 1 --2- 172.21.15.19:0/2857187098 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fee6006be30 0x7fee6006e2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fee68034000 tx=0x7fee6802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:20.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.088+0000 7fee76ffd640 1 -- 172.21.15.19:0/2857187098 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee78059090 con 0x7fee8009b690 2024-09-12T02:01:20.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.262+0000 7fee84aaf640 1 -- 172.21.15.19:0/2857187098 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee800d1cb0 con 0x7fee6006be30 2024-09-12T02:01:20.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.268+0000 7fee76ffd640 1 -- 172.21.15.19:0/2857187098 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252053 (secure 0 0 0) 0x7fee800d1cb0 con 0x7fee6006be30 2024-09-12T02:01:20.271 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:20.272 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T02:01:20.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.271+0000 7fee84aaf640 1 -- 172.21.15.19:0/2857187098 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fee6006be30 msgr2=0x7fee6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:20.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.271+0000 7fee84aaf640 1 --2- 172.21.15.19:0/2857187098 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fee6006be30 0x7fee6006e2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fee68034000 tx=0x7fee6802e000 comp rx=0 tx=0).stop 2024-09-12T02:01:20.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.271+0000 7fee84aaf640 1 -- 172.21.15.19:0/2857187098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee8009b690 msgr2=0x7fee80157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:20.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.271+0000 7fee84aaf640 1 --2- 172.21.15.19:0/2857187098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee8009b690 0x7fee80157a20 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fee7800ba80 tx=0x7fee7800bf40 comp rx=0 tx=0).stop 2024-09-12T02:01:20.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.271+0000 7fee84aaf640 1 -- 172.21.15.19:0/2857187098 shutdown_connections 2024-09-12T02:01:20.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.271+0000 7fee84aaf640 1 --2- 172.21.15.19:0/2857187098 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fee6006be30 0x7fee6006e2f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.271+0000 7fee84aaf640 1 --2- 172.21.15.19:0/2857187098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee8015e740 0x7fee80071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.271+0000 7fee84aaf640 1 --2- 172.21.15.19:0/2857187098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee800d1540 0x7fee800ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.271+0000 7fee84aaf640 1 --2- 172.21.15.19:0/2857187098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee8009b690 0x7fee80157a20 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.271+0000 7fee84aaf640 1 -- 172.21.15.19:0/2857187098 >> 172.21.15.19:0/2857187098 conn(0x7fee800d23a0 msgr2=0x7fee800b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:20.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.271+0000 7fee84aaf640 1 -- 172.21.15.19:0/2857187098 shutdown_connections 2024-09-12T02:01:20.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.271+0000 7fee84aaf640 1 -- 172.21.15.19:0/2857187098 wait complete. 2024-09-12T02:01:20.283 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2024-09-12T02:01:20.163517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245908,"kb_used_data":8836,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754728812,"statfs":{"total":773094113280,"available":772842303488,"internally_reserved":0,"allocated":9048064,"data_stored":4790733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.237274"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.166241+0000","last_change":"2024-09-12T02:01:16.962728+0000","last_active":"2024-09-12T02:01:18.166241+0000","last_peered":"2024-09-12T02:01:18.166241+0000","last_clean":"2024-09-12T02:01:18.166241+0000","last_became_active":"2024-09-12T02:01:16.962456+0000","last_became_peered":"2024-09-12T02:01:16.962456+0000","last_unstale":"2024-09-12T02:01:18.166241+0000","last_undegraded":"2024-09-12T02:01:18.166241+0000","last_fullsized":"2024-09-12T02:01:18.166241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:42.370940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.967067+0000","last_change":"2024-09-12T02:01:16.974347+0000","last_active":"2024-09-12T02:01:17.967067+0000","last_peered":"2024-09-12T02:01:17.967067+0000","last_clean":"2024-09-12T02:01:17.967067+0000","last_became_active":"2024-09-12T02:01:16.973804+0000","last_became_peered":"2024-09-12T02:01:16.973804+0000","last_unstale":"2024-09-12T02:01:17.967067+0000","last_undegraded":"2024-09-12T02:01:17.967067+0000","last_fullsized":"2024-09-12T02:01:17.967067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:56.603312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.946906+0000","last_change":"2024-09-12T02:01:16.959625+0000","last_active":"2024-09-12T02:01:17.946906+0000","last_peered":"2024-09-12T02:01:17.946906+0000","last_clean":"2024-09-12T02:01:17.946906+0000","last_became_active":"2024-09-12T02:01:16.959305+0000","last_became_peered":"2024-09-12T02:01:16.959305+0000","last_unstale":"2024-09-12T02:01:17.946906+0000","last_undegraded":"2024-09-12T02:01:17.946906+0000","last_fullsized":"2024-09-12T02:01:17.946906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:50.181636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.165699+0000","last_change":"2024-09-12T02:01:16.953674+0000","last_active":"2024-09-12T02:01:18.165699+0000","last_peered":"2024-09-12T02:01:18.165699+0000","last_clean":"2024-09-12T02:01:18.165699+0000","last_became_active":"2024-09-12T02:01:16.953389+0000","last_became_peered":"2024-09-12T02:01:16.953389+0000","last_unstale":"2024-09-12T02:01:18.165699+0000","last_undegraded":"2024-09-12T02:01:18.165699+0000","last_fullsized":"2024-09-12T02:01:18.165699+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:22.499013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.968946+0000","last_change":"2024-09-12T02:01:16.965822+0000","last_active":"2024-09-12T02:01:17.968946+0000","last_peered":"2024-09-12T02:01:17.968946+0000","last_clean":"2024-09-12T02:01:17.968946+0000","last_became_active":"2024-09-12T02:01:16.965549+0000","last_became_peered":"2024-09-12T02:01:16.965549+0000","last_unstale":"2024-09-12T02:01:17.968946+0000","last_undegraded":"2024-09-12T02:01:17.968946+0000","last_fullsized":"2024-09-12T02:01:17.968946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:20.053614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.974930+0000","last_change":"2024-09-12T02:01:16.973111+0000","last_active":"2024-09-12T02:01:16.974930+0000","last_peered":"2024-09-12T02:01:16.974930+0000","last_clean":"2024-09-12T02:01:16.974930+0000","last_became_active":"2024-09-12T02:01:16.972776+0000","last_became_peered":"2024-09-12T02:01:16.972776+0000","last_unstale":"2024-09-12T02:01:16.974930+0000","last_undegraded":"2024-09-12T02:01:16.974930+0000","last_fullsized":"2024-09-12T02:01:16.974930+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:33.135145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.948150+0000","last_change":"2024-09-12T02:01:16.959406+0000","last_active":"2024-09-12T02:01:17.948150+0000","last_peered":"2024-09-12T02:01:17.948150+0000","last_clean":"2024-09-12T02:01:17.948150+0000","last_became_active":"2024-09-12T02:01:16.959059+0000","last_became_peered":"2024-09-12T02:01:16.959059+0000","last_unstale":"2024-09-12T02:01:17.948150+0000","last_undegraded":"2024-09-12T02:01:17.948150+0000","last_fullsized":"2024-09-12T02:01:17.948150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:22.712725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.968707+0000","last_change":"2024-09-12T02:01:16.966638+0000","last_active":"2024-09-12T02:01:17.968707+0000","last_peered":"2024-09-12T02:01:17.968707+0000","last_clean":"2024-09-12T02:01:17.968707+0000","last_became_active":"2024-09-12T02:01:16.966320+0000","last_became_peered":"2024-09-12T02:01:16.966320+0000","last_unstale":"2024-09-12T02:01:17.968707+0000","last_undegraded":"2024-09-12T02:01:17.968707+0000","last_fullsized":"2024-09-12T02:01:17.968707+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:42.338926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.968476+0000","last_change":"2024-09-12T02:01:16.965696+0000","last_active":"2024-09-12T02:01:16.968476+0000","last_peered":"2024-09-12T02:01:16.968476+0000","last_clean":"2024-09-12T02:01:16.968476+0000","last_became_active":"2024-09-12T02:01:16.965372+0000","last_became_peered":"2024-09-12T02:01:16.965372+0000","last_unstale":"2024-09-12T02:01:16.968476+0000","last_undegraded":"2024-09-12T02:01:16.968476+0000","last_fullsized":"2024-09-12T02:01:16.968476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:42.251583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.165643+0000","last_change":"2024-09-12T02:01:16.960201+0000","last_active":"2024-09-12T02:01:18.165643+0000","last_peered":"2024-09-12T02:01:18.165643+0000","last_clean":"2024-09-12T02:01:18.165643+0000","last_became_active":"2024-09-12T02:01:16.959929+0000","last_became_peered":"2024-09-12T02:01:16.959929+0000","last_unstale":"2024-09-12T02:01:18.165643+0000","last_undegraded":"2024-09-12T02:01:18.165643+0000","last_fullsized":"2024-09-12T02:01:18.165643+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:48.436874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.967000+0000","last_change":"2024-09-12T02:01:16.965038+0000","last_active":"2024-09-12T02:01:17.967000+0000","last_peered":"2024-09-12T02:01:17.967000+0000","last_clean":"2024-09-12T02:01:17.967000+0000","last_became_active":"2024-09-12T02:01:16.964751+0000","last_became_peered":"2024-09-12T02:01:16.964751+0000","last_unstale":"2024-09-12T02:01:17.967000+0000","last_undegraded":"2024-09-12T02:01:17.967000+0000","last_fullsized":"2024-09-12T02:01:17.967000+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:31.749494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.165786+0000","last_change":"2024-09-12T02:01:16.959425+0000","last_active":"2024-09-12T02:01:18.165786+0000","last_peered":"2024-09-12T02:01:18.165786+0000","last_clean":"2024-09-12T02:01:18.165786+0000","last_became_active":"2024-09-12T02:01:16.959182+0000","last_became_peered":"2024-09-12T02:01:16.959182+0000","last_unstale":"2024-09-12T02:01:18.165786+0000","last_undegraded":"2024-09-12T02:01:18.165786+0000","last_fullsized":"2024-09-12T02:01:18.165786+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:06.861699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.969077+0000","last_change":"2024-09-12T02:01:16.970002+0000","last_active":"2024-09-12T02:01:17.969077+0000","last_peered":"2024-09-12T02:01:17.969077+0000","last_clean":"2024-09-12T02:01:17.969077+0000","last_became_active":"2024-09-12T02:01:16.969688+0000","last_became_peered":"2024-09-12T02:01:16.969688+0000","last_unstale":"2024-09-12T02:01:17.969077+0000","last_undegraded":"2024-09-12T02:01:17.969077+0000","last_fullsized":"2024-09-12T02:01:17.969077+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:30.364885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.971735+0000","last_change":"2024-09-12T02:01:16.970951+0000","last_active":"2024-09-12T02:01:16.971735+0000","last_peered":"2024-09-12T02:01:16.971735+0000","last_clean":"2024-09-12T02:01:16.971735+0000","last_became_active":"2024-09-12T02:01:16.969988+0000","last_became_peered":"2024-09-12T02:01:16.969988+0000","last_unstale":"2024-09-12T02:01:16.971735+0000","last_undegraded":"2024-09-12T02:01:16.971735+0000","last_fullsized":"2024-09-12T02:01:16.971735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:14.918088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.967008+0000","last_change":"2024-09-12T02:01:16.958283+0000","last_active":"2024-09-12T02:01:17.967008+0000","last_peered":"2024-09-12T02:01:17.967008+0000","last_clean":"2024-09-12T02:01:17.967008+0000","last_became_active":"2024-09-12T02:01:16.957998+0000","last_became_peered":"2024-09-12T02:01:16.957998+0000","last_unstale":"2024-09-12T02:01:17.967008+0000","last_undegraded":"2024-09-12T02:01:17.967008+0000","last_fullsized":"2024-09-12T02:01:17.967008+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:37.564902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.165952+0000","last_change":"2024-09-12T02:01:16.963692+0000","last_active":"2024-09-12T02:01:18.165952+0000","last_peered":"2024-09-12T02:01:18.165952+0000","last_clean":"2024-09-12T02:01:18.165952+0000","last_became_active":"2024-09-12T02:01:16.963423+0000","last_became_peered":"2024-09-12T02:01:16.963423+0000","last_unstale":"2024-09-12T02:01:18.165952+0000","last_undegraded":"2024-09-12T02:01:18.165952+0000","last_fullsized":"2024-09-12T02:01:18.165952+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:13.891515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.969349+0000","last_change":"2024-09-12T02:01:16.959827+0000","last_active":"2024-09-12T02:01:17.969349+0000","last_peered":"2024-09-12T02:01:17.969349+0000","last_clean":"2024-09-12T02:01:17.969349+0000","last_became_active":"2024-09-12T02:01:16.959482+0000","last_became_peered":"2024-09-12T02:01:16.959482+0000","last_unstale":"2024-09-12T02:01:17.969349+0000","last_undegraded":"2024-09-12T02:01:17.969349+0000","last_fullsized":"2024-09-12T02:01:17.969349+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:35.821699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.946909+0000","last_change":"2024-09-12T02:01:16.951071+0000","last_active":"2024-09-12T02:01:17.946909+0000","last_peered":"2024-09-12T02:01:17.946909+0000","last_clean":"2024-09-12T02:01:17.946909+0000","last_became_active":"2024-09-12T02:01:16.950789+0000","last_became_peered":"2024-09-12T02:01:16.950789+0000","last_unstale":"2024-09-12T02:01:17.946909+0000","last_undegraded":"2024-09-12T02:01:17.946909+0000","last_fullsized":"2024-09-12T02:01:17.946909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:32.677127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.977444+0000","last_change":"2024-09-12T02:01:16.976053+0000","last_active":"2024-09-12T02:01:16.977444+0000","last_peered":"2024-09-12T02:01:16.977444+0000","last_clean":"2024-09-12T02:01:16.977444+0000","last_became_active":"2024-09-12T02:01:16.975762+0000","last_became_peered":"2024-09-12T02:01:16.975762+0000","last_unstale":"2024-09-12T02:01:16.977444+0000","last_undegraded":"2024-09-12T02:01:16.977444+0000","last_fullsized":"2024-09-12T02:01:16.977444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:10.756563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.969012+0000","last_change":"2024-09-12T02:01:16.958259+0000","last_active":"2024-09-12T02:01:17.969012+0000","last_peered":"2024-09-12T02:01:17.969012+0000","last_clean":"2024-09-12T02:01:17.969012+0000","last_became_active":"2024-09-12T02:01:16.958054+0000","last_became_peered":"2024-09-12T02:01:16.958054+0000","last_unstale":"2024-09-12T02:01:17.969012+0000","last_undegraded":"2024-09-12T02:01:17.969012+0000","last_fullsized":"2024-09-12T02:01:17.969012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:21.171636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.959792+0000","last_change":"2024-09-12T02:01:16.957372+0000","last_active":"2024-09-12T02:01:16.959792+0000","last_peered":"2024-09-12T02:01:16.959792+0000","last_clean":"2024-09-12T02:01:16.959792+0000","last_became_active":"2024-09-12T02:01:16.957113+0000","last_became_peered":"2024-09-12T02:01:16.957113+0000","last_unstale":"2024-09-12T02:01:16.959792+0000","last_undegraded":"2024-09-12T02:01:16.959792+0000","last_fullsized":"2024-09-12T02:01:16.959792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:33.288856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.968828+0000","last_change":"2024-09-12T02:01:16.968831+0000","last_active":"2024-09-12T02:01:17.968828+0000","last_peered":"2024-09-12T02:01:17.968828+0000","last_clean":"2024-09-12T02:01:17.968828+0000","last_became_active":"2024-09-12T02:01:16.968507+0000","last_became_peered":"2024-09-12T02:01:16.968507+0000","last_unstale":"2024-09-12T02:01:17.968828+0000","last_undegraded":"2024-09-12T02:01:17.968828+0000","last_fullsized":"2024-09-12T02:01:17.968828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:05.599010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.957607+0000","last_change":"2024-09-12T02:01:16.955027+0000","last_active":"2024-09-12T02:01:16.957607+0000","last_peered":"2024-09-12T02:01:16.957607+0000","last_clean":"2024-09-12T02:01:16.957607+0000","last_became_active":"2024-09-12T02:01:16.954716+0000","last_became_peered":"2024-09-12T02:01:16.954716+0000","last_unstale":"2024-09-12T02:01:16.957607+0000","last_undegraded":"2024-09-12T02:01:16.957607+0000","last_fullsized":"2024-09-12T02:01:16.957607+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:35.198262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.966987+0000","last_change":"2024-09-12T02:01:16.967006+0000","last_active":"2024-09-12T02:01:17.966987+0000","last_peered":"2024-09-12T02:01:17.966987+0000","last_clean":"2024-09-12T02:01:17.966987+0000","last_became_active":"2024-09-12T02:01:16.966741+0000","last_became_peered":"2024-09-12T02:01:16.966741+0000","last_unstale":"2024-09-12T02:01:17.966987+0000","last_undegraded":"2024-09-12T02:01:17.966987+0000","last_fullsized":"2024-09-12T02:01:17.966987+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:54.541505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.966974+0000","last_change":"2024-09-12T02:01:16.966735+0000","last_active":"2024-09-12T02:01:17.966974+0000","last_peered":"2024-09-12T02:01:17.966974+0000","last_clean":"2024-09-12T02:01:17.966974+0000","last_became_active":"2024-09-12T02:01:16.966374+0000","last_became_peered":"2024-09-12T02:01:16.966374+0000","last_unstale":"2024-09-12T02:01:17.966974+0000","last_undegraded":"2024-09-12T02:01:17.966974+0000","last_fullsized":"2024-09-12T02:01:17.966974+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:45.782469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.165827+0000","last_change":"2024-09-12T02:01:16.967855+0000","last_active":"2024-09-12T02:01:18.165827+0000","last_peered":"2024-09-12T02:01:18.165827+0000","last_clean":"2024-09-12T02:01:18.165827+0000","last_became_active":"2024-09-12T02:01:16.967569+0000","last_became_peered":"2024-09-12T02:01:16.967569+0000","last_unstale":"2024-09-12T02:01:18.165827+0000","last_undegraded":"2024-09-12T02:01:18.165827+0000","last_fullsized":"2024-09-12T02:01:18.165827+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:29.765843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.165739+0000","last_change":"2024-09-12T02:01:16.963191+0000","last_active":"2024-09-12T02:01:18.165739+0000","last_peered":"2024-09-12T02:01:18.165739+0000","last_clean":"2024-09-12T02:01:18.165739+0000","last_became_active":"2024-09-12T02:01:16.962879+0000","last_became_peered":"2024-09-12T02:01:16.962879+0000","last_unstale":"2024-09-12T02:01:18.165739+0000","last_undegraded":"2024-09-12T02:01:18.165739+0000","last_fullsized":"2024-09-12T02:01:18.165739+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:11.330693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.969104+0000","last_change":"2024-09-12T02:01:16.956188+0000","last_active":"2024-09-12T02:01:17.969104+0000","last_peered":"2024-09-12T02:01:17.969104+0000","last_clean":"2024-09-12T02:01:17.969104+0000","last_became_active":"2024-09-12T02:01:16.955922+0000","last_became_peered":"2024-09-12T02:01:16.955922+0000","last_unstale":"2024-09-12T02:01:17.969104+0000","last_undegraded":"2024-09-12T02:01:17.969104+0000","last_fullsized":"2024-09-12T02:01:17.969104+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:18.186209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.966791+0000","last_change":"2024-09-12T02:01:16.957658+0000","last_active":"2024-09-12T02:01:17.966791+0000","last_peered":"2024-09-12T02:01:17.966791+0000","last_clean":"2024-09-12T02:01:17.966791+0000","last_became_active":"2024-09-12T02:01:16.957125+0000","last_became_peered":"2024-09-12T02:01:16.957125+0000","last_unstale":"2024-09-12T02:01:17.966791+0000","last_undegraded":"2024-09-12T02:01:17.966791+0000","last_fullsized":"2024-09-12T02:01:17.966791+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:36.856973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.166260+0000","last_change":"2024-09-12T02:01:16.970524+0000","last_active":"2024-09-12T02:01:18.166260+0000","last_peered":"2024-09-12T02:01:18.166260+0000","last_clean":"2024-09-12T02:01:18.166260+0000","last_became_active":"2024-09-12T02:01:16.970256+0000","last_became_peered":"2024-09-12T02:01:16.970256+0000","last_unstale":"2024-09-12T02:01:18.166260+0000","last_undegraded":"2024-09-12T02:01:18.166260+0000","last_fullsized":"2024-09-12T02:01:18.166260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:20.678819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.946581+0000","last_change":"2024-09-12T02:01:16.955871+0000","last_active":"2024-09-12T02:01:17.946581+0000","last_peered":"2024-09-12T02:01:17.946581+0000","last_clean":"2024-09-12T02:01:17.946581+0000","last_became_active":"2024-09-12T02:01:16.955568+0000","last_became_peered":"2024-09-12T02:01:16.955568+0000","last_unstale":"2024-09-12T02:01:17.946581+0000","last_undegraded":"2024-09-12T02:01:17.946581+0000","last_fullsized":"2024-09-12T02:01:17.946581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:51.382298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.165981+0000","last_change":"2024-09-12T02:01:16.963753+0000","last_active":"2024-09-12T02:01:18.165981+0000","last_peered":"2024-09-12T02:01:18.165981+0000","last_clean":"2024-09-12T02:01:18.165981+0000","last_became_active":"2024-09-12T02:01:16.963502+0000","last_became_peered":"2024-09-12T02:01:16.963502+0000","last_unstale":"2024-09-12T02:01:18.165981+0000","last_undegraded":"2024-09-12T02:01:18.165981+0000","last_fullsized":"2024-09-12T02:01:18.165981+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:31.583039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.946658+0000","last_change":"2024-09-12T02:01:16.950556+0000","last_active":"2024-09-12T02:01:17.946658+0000","last_peered":"2024-09-12T02:01:17.946658+0000","last_clean":"2024-09-12T02:01:17.946658+0000","last_became_active":"2024-09-12T02:01:16.950268+0000","last_became_peered":"2024-09-12T02:01:16.950268+0000","last_unstale":"2024-09-12T02:01:17.946658+0000","last_undegraded":"2024-09-12T02:01:17.946658+0000","last_fullsized":"2024-09-12T02:01:17.946658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:02.332258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"80'4","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.969327+0000","last_change":"2024-09-12T02:01:15.950622+0000","last_active":"2024-09-12T02:01:17.969327+0000","last_peered":"2024-09-12T02:01:17.969327+0000","last_clean":"2024-09-12T02:01:17.969327+0000","last_became_active":"2024-09-12T02:01:15.950382+0000","last_became_peered":"2024-09-12T02:01:15.950382+0000","last_unstale":"2024-09-12T02:01:17.969327+0000","last_undegraded":"2024-09-12T02:01:17.969327+0000","last_fullsized":"2024-09-12T02:01:17.969327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:46.843090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.966735+0000","last_change":"2024-09-12T02:01:16.957084+0000","last_active":"2024-09-12T02:01:17.966735+0000","last_peered":"2024-09-12T02:01:17.966735+0000","last_clean":"2024-09-12T02:01:17.966735+0000","last_became_active":"2024-09-12T02:01:16.956786+0000","last_became_peered":"2024-09-12T02:01:16.956786+0000","last_unstale":"2024-09-12T02:01:17.966735+0000","last_undegraded":"2024-09-12T02:01:17.966735+0000","last_fullsized":"2024-09-12T02:01:17.966735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:41.508955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.165901+0000","last_change":"2024-09-12T02:01:15.952475+0000","last_active":"2024-09-12T02:01:18.165901+0000","last_peered":"2024-09-12T02:01:18.165901+0000","last_clean":"2024-09-12T02:01:18.165901+0000","last_became_active":"2024-09-12T02:01:15.952207+0000","last_became_peered":"2024-09-12T02:01:15.952207+0000","last_unstale":"2024-09-12T02:01:18.165901+0000","last_undegraded":"2024-09-12T02:01:18.165901+0000","last_fullsized":"2024-09-12T02:01:18.165901+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:17.891305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.973987+0000","last_change":"2024-09-12T02:01:16.969119+0000","last_active":"2024-09-12T02:01:16.973987+0000","last_peered":"2024-09-12T02:01:16.973987+0000","last_clean":"2024-09-12T02:01:16.973987+0000","last_became_active":"2024-09-12T02:01:16.968871+0000","last_became_peered":"2024-09-12T02:01:16.968871+0000","last_unstale":"2024-09-12T02:01:16.973987+0000","last_undegraded":"2024-09-12T02:01:16.973987+0000","last_fullsized":"2024-09-12T02:01:16.973987+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:33.614862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.165811+0000","last_change":"2024-09-12T02:01:15.952824+0000","last_active":"2024-09-12T02:01:18.165811+0000","last_peered":"2024-09-12T02:01:18.165811+0000","last_clean":"2024-09-12T02:01:18.165811+0000","last_became_active":"2024-09-12T02:01:15.952509+0000","last_became_peered":"2024-09-12T02:01:15.952509+0000","last_unstale":"2024-09-12T02:01:18.165811+0000","last_undegraded":"2024-09-12T02:01:18.165811+0000","last_fullsized":"2024-09-12T02:01:18.165811+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:21.131003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.959759+0000","last_change":"2024-09-12T02:01:16.956725+0000","last_active":"2024-09-12T02:01:16.959759+0000","last_peered":"2024-09-12T02:01:16.959759+0000","last_clean":"2024-09-12T02:01:16.959759+0000","last_became_active":"2024-09-12T02:01:16.956443+0000","last_became_peered":"2024-09-12T02:01:16.956443+0000","last_unstale":"2024-09-12T02:01:16.959759+0000","last_undegraded":"2024-09-12T02:01:16.959759+0000","last_fullsized":"2024-09-12T02:01:16.959759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:18.440929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.948584+0000","last_change":"2024-09-12T02:01:15.949601+0000","last_active":"2024-09-12T02:01:17.948584+0000","last_peered":"2024-09-12T02:01:17.948584+0000","last_clean":"2024-09-12T02:01:17.948584+0000","last_became_active":"2024-09-12T02:01:15.949261+0000","last_became_peered":"2024-09-12T02:01:15.949261+0000","last_unstale":"2024-09-12T02:01:17.948584+0000","last_undegraded":"2024-09-12T02:01:17.948584+0000","last_fullsized":"2024-09-12T02:01:17.948584+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:00.982099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.966864+0000","last_change":"2024-09-12T02:01:16.973403+0000","last_active":"2024-09-12T02:01:17.966864+0000","last_peered":"2024-09-12T02:01:17.966864+0000","last_clean":"2024-09-12T02:01:17.966864+0000","last_became_active":"2024-09-12T02:01:16.973115+0000","last_became_peered":"2024-09-12T02:01:16.973115+0000","last_unstale":"2024-09-12T02:01:17.966864+0000","last_undegraded":"2024-09-12T02:01:17.966864+0000","last_fullsized":"2024-09-12T02:01:17.966864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:36.479758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.976827+0000","last_change":"2024-09-12T02:01:15.947612+0000","last_active":"2024-09-12T02:01:16.976827+0000","last_peered":"2024-09-12T02:01:16.976827+0000","last_clean":"2024-09-12T02:01:16.976827+0000","last_became_active":"2024-09-12T02:01:15.947327+0000","last_became_peered":"2024-09-12T02:01:15.947327+0000","last_unstale":"2024-09-12T02:01:16.976827+0000","last_undegraded":"2024-09-12T02:01:16.976827+0000","last_fullsized":"2024-09-12T02:01:16.976827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:03.336881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.967154+0000","last_change":"2024-09-12T02:01:16.965031+0000","last_active":"2024-09-12T02:01:17.967154+0000","last_peered":"2024-09-12T02:01:17.967154+0000","last_clean":"2024-09-12T02:01:17.967154+0000","last_became_active":"2024-09-12T02:01:16.964734+0000","last_became_peered":"2024-09-12T02:01:16.964734+0000","last_unstale":"2024-09-12T02:01:17.967154+0000","last_undegraded":"2024-09-12T02:01:17.967154+0000","last_fullsized":"2024-09-12T02:01:17.967154+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:12.004970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.165448+0000","last_change":"2024-09-12T02:01:15.950643+0000","last_active":"2024-09-12T02:01:18.165448+0000","last_peered":"2024-09-12T02:01:18.165448+0000","last_clean":"2024-09-12T02:01:18.165448+0000","last_became_active":"2024-09-12T02:01:15.950366+0000","last_became_peered":"2024-09-12T02:01:15.950366+0000","last_unstale":"2024-09-12T02:01:18.165448+0000","last_undegraded":"2024-09-12T02:01:18.165448+0000","last_fullsized":"2024-09-12T02:01:18.165448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:04.392246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.974012+0000","last_change":"2024-09-12T02:01:16.968310+0000","last_active":"2024-09-12T02:01:16.974012+0000","last_peered":"2024-09-12T02:01:16.974012+0000","last_clean":"2024-09-12T02:01:16.974012+0000","last_became_active":"2024-09-12T02:01:16.968050+0000","last_became_peered":"2024-09-12T02:01:16.968050+0000","last_unstale":"2024-09-12T02:01:16.974012+0000","last_undegraded":"2024-09-12T02:01:16.974012+0000","last_fullsized":"2024-09-12T02:01:16.974012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:44.940577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.966849+0000","last_change":"2024-09-12T02:01:15.949053+0000","last_active":"2024-09-12T02:01:17.966849+0000","last_peered":"2024-09-12T02:01:17.966849+0000","last_clean":"2024-09-12T02:01:17.966849+0000","last_became_active":"2024-09-12T02:01:15.948754+0000","last_became_peered":"2024-09-12T02:01:15.948754+0000","last_unstale":"2024-09-12T02:01:17.966849+0000","last_undegraded":"2024-09-12T02:01:17.966849+0000","last_fullsized":"2024-09-12T02:01:17.966849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:48.805030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.948443+0000","last_change":"2024-09-12T02:01:16.958350+0000","last_active":"2024-09-12T02:01:17.948443+0000","last_peered":"2024-09-12T02:01:17.948443+0000","last_clean":"2024-09-12T02:01:17.948443+0000","last_became_active":"2024-09-12T02:01:16.957389+0000","last_became_peered":"2024-09-12T02:01:16.957389+0000","last_unstale":"2024-09-12T02:01:17.948443+0000","last_undegraded":"2024-09-12T02:01:17.948443+0000","last_fullsized":"2024-09-12T02:01:17.948443+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:24.850917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.968729+0000","last_change":"2024-09-12T02:01:15.953945+0000","last_active":"2024-09-12T02:01:17.968729+0000","last_peered":"2024-09-12T02:01:17.968729+0000","last_clean":"2024-09-12T02:01:17.968729+0000","last_became_active":"2024-09-12T02:01:15.952853+0000","last_became_peered":"2024-09-12T02:01:15.952853+0000","last_unstale":"2024-09-12T02:01:17.968729+0000","last_undegraded":"2024-09-12T02:01:17.968729+0000","last_fullsized":"2024-09-12T02:01:17.968729+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:11.380158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.967042+0000","last_change":"2024-09-12T02:01:16.964431+0000","last_active":"2024-09-12T02:01:17.967042+0000","last_peered":"2024-09-12T02:01:17.967042+0000","last_clean":"2024-09-12T02:01:17.967042+0000","last_became_active":"2024-09-12T02:01:16.964139+0000","last_became_peered":"2024-09-12T02:01:16.964139+0000","last_unstale":"2024-09-12T02:01:17.967042+0000","last_undegraded":"2024-09-12T02:01:17.967042+0000","last_fullsized":"2024-09-12T02:01:17.967042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:13.067321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.166256+0000","last_change":"2024-09-12T02:01:15.952525+0000","last_active":"2024-09-12T02:01:18.166256+0000","last_peered":"2024-09-12T02:01:18.166256+0000","last_clean":"2024-09-12T02:01:18.166256+0000","last_became_active":"2024-09-12T02:01:15.952238+0000","last_became_peered":"2024-09-12T02:01:15.952238+0000","last_unstale":"2024-09-12T02:01:18.166256+0000","last_undegraded":"2024-09-12T02:01:18.166256+0000","last_fullsized":"2024-09-12T02:01:18.166256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:48.805030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.165527+0000","last_change":"2024-09-12T02:01:16.959438+0000","last_active":"2024-09-12T02:01:18.165527+0000","last_peered":"2024-09-12T02:01:18.165527+0000","last_clean":"2024-09-12T02:01:18.165527+0000","last_became_active":"2024-09-12T02:01:16.959138+0000","last_became_peered":"2024-09-12T02:01:16.959138+0000","last_unstale":"2024-09-12T02:01:18.165527+0000","last_undegraded":"2024-09-12T02:01:18.165527+0000","last_fullsized":"2024-09-12T02:01:18.165527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:07.601410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.165930+0000","last_change":"2024-09-12T02:01:15.948540+0000","last_active":"2024-09-12T02:01:18.165930+0000","last_peered":"2024-09-12T02:01:18.165930+0000","last_clean":"2024-09-12T02:01:18.165930+0000","last_became_active":"2024-09-12T02:01:15.948271+0000","last_became_peered":"2024-09-12T02:01:15.948271+0000","last_unstale":"2024-09-12T02:01:18.165930+0000","last_undegraded":"2024-09-12T02:01:18.165930+0000","last_fullsized":"2024-09-12T02:01:18.165930+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:33.958715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.969821+0000","last_change":"2024-09-12T02:01:16.965816+0000","last_active":"2024-09-12T02:01:16.969821+0000","last_peered":"2024-09-12T02:01:16.969821+0000","last_clean":"2024-09-12T02:01:16.969821+0000","last_became_active":"2024-09-12T02:01:16.965488+0000","last_became_peered":"2024-09-12T02:01:16.965488+0000","last_unstale":"2024-09-12T02:01:16.969821+0000","last_undegraded":"2024-09-12T02:01:16.969821+0000","last_fullsized":"2024-09-12T02:01:16.969821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:16.856137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"80'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.968987+0000","last_change":"2024-09-12T02:01:15.949446+0000","last_active":"2024-09-12T02:01:17.968987+0000","last_peered":"2024-09-12T02:01:17.968987+0000","last_clean":"2024-09-12T02:01:17.968987+0000","last_became_active":"2024-09-12T02:01:15.949175+0000","last_became_peered":"2024-09-12T02:01:15.949175+0000","last_unstale":"2024-09-12T02:01:17.968987+0000","last_undegraded":"2024-09-12T02:01:17.968987+0000","last_fullsized":"2024-09-12T02:01:17.968987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:03.647802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.946769+0000","last_change":"2024-09-12T02:01:16.958283+0000","last_active":"2024-09-12T02:01:17.946769+0000","last_peered":"2024-09-12T02:01:17.946769+0000","last_clean":"2024-09-12T02:01:17.946769+0000","last_became_active":"2024-09-12T02:01:16.957977+0000","last_became_peered":"2024-09-12T02:01:16.957977+0000","last_unstale":"2024-09-12T02:01:17.946769+0000","last_undegraded":"2024-09-12T02:01:17.946769+0000","last_fullsized":"2024-09-12T02:01:17.946769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:48.577512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"80'6","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.948682+0000","last_change":"2024-09-12T02:01:15.945987+0000","last_active":"2024-09-12T02:01:17.948682+0000","last_peered":"2024-09-12T02:01:17.948682+0000","last_clean":"2024-09-12T02:01:17.948682+0000","last_became_active":"2024-09-12T02:01:15.945728+0000","last_became_peered":"2024-09-12T02:01:15.945728+0000","last_unstale":"2024-09-12T02:01:17.948682+0000","last_undegraded":"2024-09-12T02:01:17.948682+0000","last_fullsized":"2024-09-12T02:01:17.948682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:13.547033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.166180+0000","last_change":"2024-09-12T02:01:16.967849+0000","last_active":"2024-09-12T02:01:18.166180+0000","last_peered":"2024-09-12T02:01:18.166180+0000","last_clean":"2024-09-12T02:01:18.166180+0000","last_became_active":"2024-09-12T02:01:16.966814+0000","last_became_peered":"2024-09-12T02:01:16.966814+0000","last_unstale":"2024-09-12T02:01:18.166180+0000","last_undegraded":"2024-09-12T02:01:18.166180+0000","last_fullsized":"2024-09-12T02:01:18.166180+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:28.068726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.165486+0000","last_change":"2024-09-12T02:01:15.946326+0000","last_active":"2024-09-12T02:01:18.165486+0000","last_peered":"2024-09-12T02:01:18.165486+0000","last_clean":"2024-09-12T02:01:18.165486+0000","last_became_active":"2024-09-12T02:01:15.946056+0000","last_became_peered":"2024-09-12T02:01:15.946056+0000","last_unstale":"2024-09-12T02:01:18.165486+0000","last_undegraded":"2024-09-12T02:01:18.165486+0000","last_fullsized":"2024-09-12T02:01:18.165486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:06.702738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.948175+0000","last_change":"2024-09-12T02:01:16.958668+0000","last_active":"2024-09-12T02:01:17.948175+0000","last_peered":"2024-09-12T02:01:17.948175+0000","last_clean":"2024-09-12T02:01:17.948175+0000","last_became_active":"2024-09-12T02:01:16.958080+0000","last_became_peered":"2024-09-12T02:01:16.958080+0000","last_unstale":"2024-09-12T02:01:17.948175+0000","last_undegraded":"2024-09-12T02:01:17.948175+0000","last_fullsized":"2024-09-12T02:01:17.948175+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:25.851356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.165751+0000","last_change":"2024-09-12T02:01:15.955323+0000","last_active":"2024-09-12T02:01:18.165751+0000","last_peered":"2024-09-12T02:01:18.165751+0000","last_clean":"2024-09-12T02:01:18.165751+0000","last_became_active":"2024-09-12T02:01:15.955132+0000","last_became_peered":"2024-09-12T02:01:15.955132+0000","last_unstale":"2024-09-12T02:01:18.165751+0000","last_undegraded":"2024-09-12T02:01:18.165751+0000","last_fullsized":"2024-09-12T02:01:18.165751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:22.424933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.948370+0000","last_change":"2024-09-12T02:01:16.959525+0000","last_active":"2024-09-12T02:01:17.948370+0000","last_peered":"2024-09-12T02:01:17.948370+0000","last_clean":"2024-09-12T02:01:17.948370+0000","last_became_active":"2024-09-12T02:01:16.959224+0000","last_became_peered":"2024-09-12T02:01:16.959224+0000","last_unstale":"2024-09-12T02:01:17.948370+0000","last_undegraded":"2024-09-12T02:01:17.948370+0000","last_fullsized":"2024-09-12T02:01:17.948370+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:31.097572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.969193+0000","last_change":"2024-09-12T02:01:15.953522+0000","last_active":"2024-09-12T02:01:17.969193+0000","last_peered":"2024-09-12T02:01:17.969193+0000","last_clean":"2024-09-12T02:01:17.969193+0000","last_became_active":"2024-09-12T02:01:15.953187+0000","last_became_peered":"2024-09-12T02:01:15.953187+0000","last_unstale":"2024-09-12T02:01:17.969193+0000","last_undegraded":"2024-09-12T02:01:17.969193+0000","last_fullsized":"2024-09-12T02:01:17.969193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:55.422065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.948508+0000","last_change":"2024-09-12T02:01:16.968175+0000","last_active":"2024-09-12T02:01:17.948508+0000","last_peered":"2024-09-12T02:01:17.948508+0000","last_clean":"2024-09-12T02:01:17.948508+0000","last_became_active":"2024-09-12T02:01:16.967131+0000","last_became_peered":"2024-09-12T02:01:16.967131+0000","last_unstale":"2024-09-12T02:01:17.948508+0000","last_undegraded":"2024-09-12T02:01:17.948508+0000","last_fullsized":"2024-09-12T02:01:17.948508+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:50.993830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"80'8","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.967092+0000","last_change":"2024-09-12T02:01:15.945615+0000","last_active":"2024-09-12T02:01:17.967092+0000","last_peered":"2024-09-12T02:01:17.967092+0000","last_clean":"2024-09-12T02:01:17.967092+0000","last_became_active":"2024-09-12T02:01:15.945324+0000","last_became_peered":"2024-09-12T02:01:15.945324+0000","last_unstale":"2024-09-12T02:01:17.967092+0000","last_undegraded":"2024-09-12T02:01:17.967092+0000","last_fullsized":"2024-09-12T02:01:17.967092+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:17.891305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.977629+0000","last_change":"2024-09-12T02:01:16.976416+0000","last_active":"2024-09-12T02:01:16.977629+0000","last_peered":"2024-09-12T02:01:16.977629+0000","last_clean":"2024-09-12T02:01:16.977629+0000","last_became_active":"2024-09-12T02:01:16.975616+0000","last_became_peered":"2024-09-12T02:01:16.975616+0000","last_unstale":"2024-09-12T02:01:16.977629+0000","last_undegraded":"2024-09-12T02:01:16.977629+0000","last_fullsized":"2024-09-12T02:01:16.977629+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:31.196986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.166328+0000","last_change":"2024-09-12T02:01:15.949912+0000","last_active":"2024-09-12T02:01:18.166328+0000","last_peered":"2024-09-12T02:01:18.166328+0000","last_clean":"2024-09-12T02:01:18.166328+0000","last_became_active":"2024-09-12T02:01:15.949648+0000","last_became_peered":"2024-09-12T02:01:15.949648+0000","last_unstale":"2024-09-12T02:01:18.166328+0000","last_undegraded":"2024-09-12T02:01:18.166328+0000","last_fullsized":"2024-09-12T02:01:18.166328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:41.598239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.968734+0000","last_change":"2024-09-12T02:01:16.959176+0000","last_active":"2024-09-12T02:01:17.968734+0000","last_peered":"2024-09-12T02:01:17.968734+0000","last_clean":"2024-09-12T02:01:17.968734+0000","last_became_active":"2024-09-12T02:01:16.958668+0000","last_became_peered":"2024-09-12T02:01:16.958668+0000","last_unstale":"2024-09-12T02:01:17.968734+0000","last_undegraded":"2024-09-12T02:01:17.968734+0000","last_fullsized":"2024-09-12T02:01:17.968734+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:43.193827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.976924+0000","last_change":"2024-09-12T02:01:15.949596+0000","last_active":"2024-09-12T02:01:16.976924+0000","last_peered":"2024-09-12T02:01:16.976924+0000","last_clean":"2024-09-12T02:01:16.976924+0000","last_became_active":"2024-09-12T02:01:15.949302+0000","last_became_peered":"2024-09-12T02:01:15.949302+0000","last_unstale":"2024-09-12T02:01:16.976924+0000","last_undegraded":"2024-09-12T02:01:16.976924+0000","last_fullsized":"2024-09-12T02:01:16.976924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:26.787961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.969011+0000","last_change":"2024-09-12T02:01:16.970628+0000","last_active":"2024-09-12T02:01:17.969011+0000","last_peered":"2024-09-12T02:01:17.969011+0000","last_clean":"2024-09-12T02:01:17.969011+0000","last_became_active":"2024-09-12T02:01:16.970322+0000","last_became_peered":"2024-09-12T02:01:16.970322+0000","last_unstale":"2024-09-12T02:01:17.969011+0000","last_undegraded":"2024-09-12T02:01:17.969011+0000","last_fullsized":"2024-09-12T02:01:17.969011+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:24.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.969010+0000","last_change":"2024-09-12T02:01:15.953248+0000","last_active":"2024-09-12T02:01:17.969010+0000","last_peered":"2024-09-12T02:01:17.969010+0000","last_clean":"2024-09-12T02:01:17.969010+0000","last_became_active":"2024-09-12T02:01:15.952940+0000","last_became_peered":"2024-09-12T02:01:15.952940+0000","last_unstale":"2024-09-12T02:01:17.969010+0000","last_undegraded":"2024-09-12T02:01:17.969010+0000","last_fullsized":"2024-09-12T02:01:17.969010+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:02.872513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.977636+0000","last_change":"2024-09-12T02:01:16.976124+0000","last_active":"2024-09-12T02:01:16.977636+0000","last_peered":"2024-09-12T02:01:16.977636+0000","last_clean":"2024-09-12T02:01:16.977636+0000","last_became_active":"2024-09-12T02:01:16.975845+0000","last_became_peered":"2024-09-12T02:01:16.975845+0000","last_unstale":"2024-09-12T02:01:16.977636+0000","last_undegraded":"2024-09-12T02:01:16.977636+0000","last_fullsized":"2024-09-12T02:01:16.977636+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:35.749442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.946728+0000","last_change":"2024-09-12T02:01:15.947948+0000","last_active":"2024-09-12T02:01:17.946728+0000","last_peered":"2024-09-12T02:01:17.946728+0000","last_clean":"2024-09-12T02:01:17.946728+0000","last_became_active":"2024-09-12T02:01:15.947652+0000","last_became_peered":"2024-09-12T02:01:15.947652+0000","last_unstale":"2024-09-12T02:01:17.946728+0000","last_undegraded":"2024-09-12T02:01:17.946728+0000","last_fullsized":"2024-09-12T02:01:17.946728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:17.435813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.967016+0000","last_change":"2024-09-12T02:01:16.962037+0000","last_active":"2024-09-12T02:01:17.967016+0000","last_peered":"2024-09-12T02:01:17.967016+0000","last_clean":"2024-09-12T02:01:17.967016+0000","last_became_active":"2024-09-12T02:01:16.959060+0000","last_became_peered":"2024-09-12T02:01:16.959060+0000","last_unstale":"2024-09-12T02:01:17.967016+0000","last_undegraded":"2024-09-12T02:01:17.967016+0000","last_fullsized":"2024-09-12T02:01:17.967016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:44.013426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.978993+0000","last_change":"2024-09-12T02:01:15.955971+0000","last_active":"2024-09-12T02:01:16.978993+0000","last_peered":"2024-09-12T02:01:16.978993+0000","last_clean":"2024-09-12T02:01:16.978993+0000","last_became_active":"2024-09-12T02:01:15.955682+0000","last_became_peered":"2024-09-12T02:01:15.955682+0000","last_unstale":"2024-09-12T02:01:16.978993+0000","last_undegraded":"2024-09-12T02:01:16.978993+0000","last_fullsized":"2024-09-12T02:01:16.978993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:38.343028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.967159+0000","last_change":"2024-09-12T02:01:16.961984+0000","last_active":"2024-09-12T02:01:17.967159+0000","last_peered":"2024-09-12T02:01:17.967159+0000","last_clean":"2024-09-12T02:01:17.967159+0000","last_became_active":"2024-09-12T02:01:16.961692+0000","last_became_peered":"2024-09-12T02:01:16.961692+0000","last_unstale":"2024-09-12T02:01:17.967159+0000","last_undegraded":"2024-09-12T02:01:17.967159+0000","last_fullsized":"2024-09-12T02:01:17.967159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:20.571930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.954581+0000","last_change":"2024-09-12T02:01:15.952198+0000","last_active":"2024-09-12T02:01:16.954581+0000","last_peered":"2024-09-12T02:01:16.954581+0000","last_clean":"2024-09-12T02:01:16.954581+0000","last_became_active":"2024-09-12T02:01:15.951781+0000","last_became_peered":"2024-09-12T02:01:15.951781+0000","last_unstale":"2024-09-12T02:01:16.954581+0000","last_undegraded":"2024-09-12T02:01:16.954581+0000","last_fullsized":"2024-09-12T02:01:16.954581+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:59.099315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.948611+0000","last_change":"2024-09-12T02:01:16.954596+0000","last_active":"2024-09-12T02:01:17.948611+0000","last_peered":"2024-09-12T02:01:17.948611+0000","last_clean":"2024-09-12T02:01:17.948611+0000","last_became_active":"2024-09-12T02:01:16.954324+0000","last_became_peered":"2024-09-12T02:01:16.954324+0000","last_unstale":"2024-09-12T02:01:17.948611+0000","last_undegraded":"2024-09-12T02:01:17.948611+0000","last_fullsized":"2024-09-12T02:01:17.948611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:07.707854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.954333+0000","last_change":"2024-09-12T02:01:15.949288+0000","last_active":"2024-09-12T02:01:16.954333+0000","last_peered":"2024-09-12T02:01:16.954333+0000","last_clean":"2024-09-12T02:01:16.954333+0000","last_became_active":"2024-09-12T02:01:15.949026+0000","last_became_peered":"2024-09-12T02:01:15.949026+0000","last_unstale":"2024-09-12T02:01:16.954333+0000","last_undegraded":"2024-09-12T02:01:16.954333+0000","last_fullsized":"2024-09-12T02:01:16.954333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:56.183776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.960450+0000","last_change":"2024-09-12T02:01:16.956336+0000","last_active":"2024-09-12T02:01:16.960450+0000","last_peered":"2024-09-12T02:01:16.960450+0000","last_clean":"2024-09-12T02:01:16.960450+0000","last_became_active":"2024-09-12T02:01:16.956035+0000","last_became_peered":"2024-09-12T02:01:16.956035+0000","last_unstale":"2024-09-12T02:01:16.960450+0000","last_undegraded":"2024-09-12T02:01:16.960450+0000","last_fullsized":"2024-09-12T02:01:16.960450+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:55.248879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.166167+0000","last_change":"2024-09-12T02:01:15.949160+0000","last_active":"2024-09-12T02:01:18.166167+0000","last_peered":"2024-09-12T02:01:18.166167+0000","last_clean":"2024-09-12T02:01:18.166167+0000","last_became_active":"2024-09-12T02:01:15.948871+0000","last_became_peered":"2024-09-12T02:01:15.948871+0000","last_unstale":"2024-09-12T02:01:18.166167+0000","last_undegraded":"2024-09-12T02:01:18.166167+0000","last_fullsized":"2024-09-12T02:01:18.166167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:56.238132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.948277+0000","last_change":"2024-09-12T02:01:16.967857+0000","last_active":"2024-09-12T02:01:17.948277+0000","last_peered":"2024-09-12T02:01:17.948277+0000","last_clean":"2024-09-12T02:01:17.948277+0000","last_became_active":"2024-09-12T02:01:16.967556+0000","last_became_peered":"2024-09-12T02:01:16.967556+0000","last_unstale":"2024-09-12T02:01:17.948277+0000","last_undegraded":"2024-09-12T02:01:17.948277+0000","last_fullsized":"2024-09-12T02:01:17.948277+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:10.411453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"81'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.968295+0000","last_change":"2024-09-12T02:01:15.955652+0000","last_active":"2024-09-12T02:01:17.968295+0000","last_peered":"2024-09-12T02:01:17.968295+0000","last_clean":"2024-09-12T02:01:17.968295+0000","last_became_active":"2024-09-12T02:01:15.954910+0000","last_became_peered":"2024-09-12T02:01:15.954910+0000","last_unstale":"2024-09-12T02:01:17.968295+0000","last_undegraded":"2024-09-12T02:01:17.968295+0000","last_fullsized":"2024-09-12T02:01:17.968295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:20.534499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.976755+0000","last_change":"2024-09-12T02:01:16.969834+0000","last_active":"2024-09-12T02:01:16.976755+0000","last_peered":"2024-09-12T02:01:16.976755+0000","last_clean":"2024-09-12T02:01:16.976755+0000","last_became_active":"2024-09-12T02:01:16.969553+0000","last_became_peered":"2024-09-12T02:01:16.969553+0000","last_unstale":"2024-09-12T02:01:16.976755+0000","last_undegraded":"2024-09-12T02:01:16.976755+0000","last_fullsized":"2024-09-12T02:01:16.976755+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:53.939479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.165913+0000","last_change":"2024-09-12T02:01:15.951331+0000","last_active":"2024-09-12T02:01:18.165913+0000","last_peered":"2024-09-12T02:01:18.165913+0000","last_clean":"2024-09-12T02:01:18.165913+0000","last_became_active":"2024-09-12T02:01:15.951069+0000","last_became_peered":"2024-09-12T02:01:15.951069+0000","last_unstale":"2024-09-12T02:01:18.165913+0000","last_undegraded":"2024-09-12T02:01:18.165913+0000","last_fullsized":"2024-09-12T02:01:18.165913+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:20.534499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.966910+0000","last_change":"2024-09-12T02:01:16.963656+0000","last_active":"2024-09-12T02:01:17.966910+0000","last_peered":"2024-09-12T02:01:17.966910+0000","last_clean":"2024-09-12T02:01:17.966910+0000","last_became_active":"2024-09-12T02:01:16.963379+0000","last_became_peered":"2024-09-12T02:01:16.963379+0000","last_unstale":"2024-09-12T02:01:17.966910+0000","last_undegraded":"2024-09-12T02:01:17.966910+0000","last_fullsized":"2024-09-12T02:01:17.966910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:56.681105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.165683+0000","last_change":"2024-09-12T02:01:15.951603+0000","last_active":"2024-09-12T02:01:18.165683+0000","last_peered":"2024-09-12T02:01:18.165683+0000","last_clean":"2024-09-12T02:01:18.165683+0000","last_became_active":"2024-09-12T02:01:15.951313+0000","last_became_peered":"2024-09-12T02:01:15.951313+0000","last_unstale":"2024-09-12T02:01:18.165683+0000","last_undegraded":"2024-09-12T02:01:18.165683+0000","last_fullsized":"2024-09-12T02:01:18.165683+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:42.911828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.948491+0000","last_change":"2024-09-12T02:01:16.967799+0000","last_active":"2024-09-12T02:01:17.948491+0000","last_peered":"2024-09-12T02:01:17.948491+0000","last_clean":"2024-09-12T02:01:17.948491+0000","last_became_active":"2024-09-12T02:01:16.967333+0000","last_became_peered":"2024-09-12T02:01:16.967333+0000","last_unstale":"2024-09-12T02:01:17.948491+0000","last_undegraded":"2024-09-12T02:01:17.948491+0000","last_fullsized":"2024-09-12T02:01:17.948491+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:33.987168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.948110+0000","last_change":"2024-09-12T02:01:15.949998+0000","last_active":"2024-09-12T02:01:17.948110+0000","last_peered":"2024-09-12T02:01:17.948110+0000","last_clean":"2024-09-12T02:01:17.948110+0000","last_became_active":"2024-09-12T02:01:15.949742+0000","last_became_peered":"2024-09-12T02:01:15.949742+0000","last_unstale":"2024-09-12T02:01:17.948110+0000","last_undegraded":"2024-09-12T02:01:17.948110+0000","last_fullsized":"2024-09-12T02:01:17.948110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:38.627259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.948339+0000","last_change":"2024-09-12T02:01:16.959808+0000","last_active":"2024-09-12T02:01:17.948339+0000","last_peered":"2024-09-12T02:01:17.948339+0000","last_clean":"2024-09-12T02:01:17.948339+0000","last_became_active":"2024-09-12T02:01:16.958422+0000","last_became_peered":"2024-09-12T02:01:16.958422+0000","last_unstale":"2024-09-12T02:01:17.948339+0000","last_undegraded":"2024-09-12T02:01:17.948339+0000","last_fullsized":"2024-09-12T02:01:17.948339+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:31.726380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.968961+0000","last_change":"2024-09-12T02:01:15.950744+0000","last_active":"2024-09-12T02:01:17.968961+0000","last_peered":"2024-09-12T02:01:17.968961+0000","last_clean":"2024-09-12T02:01:17.968961+0000","last_became_active":"2024-09-12T02:01:15.950472+0000","last_became_peered":"2024-09-12T02:01:15.950472+0000","last_unstale":"2024-09-12T02:01:17.968961+0000","last_undegraded":"2024-09-12T02:01:17.968961+0000","last_fullsized":"2024-09-12T02:01:17.968961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:45.872985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.946961+0000","last_change":"2024-09-12T02:01:16.968062+0000","last_active":"2024-09-12T02:01:17.946961+0000","last_peered":"2024-09-12T02:01:17.946961+0000","last_clean":"2024-09-12T02:01:17.946961+0000","last_became_active":"2024-09-12T02:01:16.967783+0000","last_became_peered":"2024-09-12T02:01:16.967783+0000","last_unstale":"2024-09-12T02:01:17.946961+0000","last_undegraded":"2024-09-12T02:01:17.946961+0000","last_fullsized":"2024-09-12T02:01:17.946961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:51.495385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.948307+0000","last_change":"2024-09-12T02:01:15.953500+0000","last_active":"2024-09-12T02:01:17.948307+0000","last_peered":"2024-09-12T02:01:17.948307+0000","last_clean":"2024-09-12T02:01:17.948307+0000","last_became_active":"2024-09-12T02:01:15.953157+0000","last_became_peered":"2024-09-12T02:01:15.953157+0000","last_unstale":"2024-09-12T02:01:17.948307+0000","last_undegraded":"2024-09-12T02:01:17.948307+0000","last_fullsized":"2024-09-12T02:01:17.948307+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:54.815942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.946984+0000","last_change":"2024-09-12T02:01:16.962786+0000","last_active":"2024-09-12T02:01:17.946984+0000","last_peered":"2024-09-12T02:01:17.946984+0000","last_clean":"2024-09-12T02:01:17.946984+0000","last_became_active":"2024-09-12T02:01:16.962477+0000","last_became_peered":"2024-09-12T02:01:16.962477+0000","last_unstale":"2024-09-12T02:01:17.946984+0000","last_undegraded":"2024-09-12T02:01:17.946984+0000","last_fullsized":"2024-09-12T02:01:17.946984+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:17.615499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:17.946535+0000","last_change":"2024-09-12T02:01:15.948703+0000","last_active":"2024-09-12T02:01:17.946535+0000","last_peered":"2024-09-12T02:01:17.946535+0000","last_clean":"2024-09-12T02:01:17.946535+0000","last_became_active":"2024-09-12T02:01:15.948421+0000","last_became_peered":"2024-09-12T02:01:15.948421+0000","last_unstale":"2024-09-12T02:01:17.946535+0000","last_undegraded":"2024-09-12T02:01:17.946535+0000","last_fullsized":"2024-09-12T02:01:17.946535+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:32.283740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.165912+0000","last_change":"2024-09-12T02:01:16.964795+0000","last_active":"2024-09-12T02:01:18.165912+0000","last_peered":"2024-09-12T02:01:18.165912+0000","last_clean":"2024-09-12T02:01:18.165912+0000","last_became_active":"2024-09-12T02:01:16.964530+0000","last_became_peered":"2024-09-12T02:01:16.964530+0000","last_unstale":"2024-09-12T02:01:18.165912+0000","last_undegraded":"2024-09-12T02:01:18.165912+0000","last_fullsized":"2024-09-12T02:01:18.165912+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:15.925421+0000","last_clean_scrub_stamp":"2024-09-12T02:01:15.925421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:52.013081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:01:16.963266+0000","last_change":"2024-09-12T02:01:15.946098+0000","last_active":"2024-09-12T02:01:16.963266+0000","last_peered":"2024-09-12T02:01:16.963266+0000","last_clean":"2024-09-12T02:01:16.963266+0000","last_became_active":"2024-09-12T02:01:15.945820+0000","last_became_peered":"2024-09-12T02:01:15.945820+0000","last_unstale":"2024-09-12T02:01:16.963266+0000","last_undegraded":"2024-09-12T02:01:16.963266+0000","last_fullsized":"2024-09-12T02:01:16.963266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:01:14.920305+0000","last_clean_scrub_stamp":"2024-09-12T02:01:14.920305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:30.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":280,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:01:18.166033+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T02:01:18.166033+0000","last_peered":"2024-09-12T02:01:18.166033+0000","last_clean":"2024-09-12T02:01:18.166033+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T02:01:18.166033+0000","last_undegraded":"2024-09-12T02:01:18.166033+0000","last_fullsized":"2024-09-12T02:01:18.166033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509511,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1581056,"data_stored":1044657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509510,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":995328,"data_stored":455879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509511,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":987136,"data_stored":454301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542215,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":974848,"data_stored":448157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542215,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":448317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542215,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":991232,"data_stored":454379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542215,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1576960,"data_stored":1044635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":958464,"data_stored":440408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:01:20.341 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:01:20.342 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:01:20.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.450+0000 7f5a19126640 1 Processor -- start 2024-09-12T02:01:20.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.450+0000 7f5a19126640 1 -- start start 2024-09-12T02:01:20.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.451+0000 7f5a19126640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5a14161ac0 0x7f5a140b2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.451+0000 7f5a19126640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5a140b43b0 0x7f5a1406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.451+0000 7f5a19126640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a1406c150 0x7f5a14162290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.451+0000 7f5a19126640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f5a1406c5a0 con 0x7f5a14161ac0 2024-09-12T02:01:20.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.451+0000 7f5a19126640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f5a1415f920 con 0x7f5a140b43b0 2024-09-12T02:01:20.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.451+0000 7f5a19126640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5a1415eff0 con 0x7f5a1406c150 2024-09-12T02:01:20.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.451+0000 7f5a12d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5a14161ac0 0x7f5a140b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.451+0000 7f5a12d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5a14161ac0 0x7f5a140b2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55154/0 (socket says 172.21.15.19:55154) 2024-09-12T02:01:20.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.451+0000 7f5a12d9d640 1 -- 172.21.15.19:0/758696748 learned_addr learned my addr 172.21.15.19:0/758696748 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:20.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.452+0000 7f5a1359e640 1 --2- 172.21.15.19:0/758696748 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a1406c150 0x7f5a14162290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.452+0000 7f5a1259c640 1 --2- 172.21.15.19:0/758696748 >> v2:172.21.15.135:3300/0 conn(0x7f5a140b43b0 0x7f5a1406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.452+0000 7f5a12d9d640 1 -- 172.21.15.19:0/758696748 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a1406c150 msgr2=0x7f5a14162290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:20.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.452+0000 7f5a12d9d640 1 --2- 172.21.15.19:0/758696748 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a1406c150 0x7f5a14162290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.452+0000 7f5a12d9d640 1 -- 172.21.15.19:0/758696748 >> v2:172.21.15.135:3300/0 conn(0x7f5a140b43b0 msgr2=0x7f5a1406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:20.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.452+0000 7f5a12d9d640 1 --2- 172.21.15.19:0/758696748 >> v2:172.21.15.135:3300/0 conn(0x7f5a140b43b0 0x7f5a1406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.452+0000 7f5a12d9d640 1 -- 172.21.15.19:0/758696748 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1415f2d0 con 0x7f5a14161ac0 2024-09-12T02:01:20.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.452+0000 7f5a12d9d640 1 --2- 172.21.15.19:0/758696748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a14161ac0 0x7f5a140b2650 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5a140b73b0 tx=0x7f5a0402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930d6f3c61d07f5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:20.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.453+0000 7f5a11d9b640 1 -- 172.21.15.19:0/758696748 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a04037070 con 0x7f5a14161ac0 2024-09-12T02:01:20.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.453+0000 7f5a11d9b640 1 -- 172.21.15.19:0/758696748 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a04032440 con 0x7f5a14161ac0 2024-09-12T02:01:20.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.453+0000 7f5a11d9b640 1 -- 172.21.15.19:0/758696748 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a04032810 con 0x7f5a14161ac0 2024-09-12T02:01:20.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.453+0000 7f5a19126640 1 -- 172.21.15.19:0/758696748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a14161ac0 msgr2=0x7f5a140b2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:20.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.453+0000 7f5a19126640 1 --2- 172.21.15.19:0/758696748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a14161ac0 0x7f5a140b2650 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5a140b73b0 tx=0x7f5a0402a140 comp rx=0 tx=0).stop 2024-09-12T02:01:20.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.453+0000 7f5a19126640 1 -- 172.21.15.19:0/758696748 shutdown_connections 2024-09-12T02:01:20.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.453+0000 7f5a19126640 1 --2- 172.21.15.19:0/758696748 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a1406c150 0x7f5a14162290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.453+0000 7f5a19126640 1 --2- 172.21.15.19:0/758696748 >> v2:172.21.15.135:3300/0 conn(0x7f5a140b43b0 0x7f5a1406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.453+0000 7f5a19126640 1 --2- 172.21.15.19:0/758696748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a14161ac0 0x7f5a140b2650 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.453+0000 7f5a19126640 1 -- 172.21.15.19:0/758696748 >> 172.21.15.19:0/758696748 conn(0x7f5a1409aa30 msgr2=0x7f5a140b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:20.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.453+0000 7f5a19126640 1 -- 172.21.15.19:0/758696748 shutdown_connections 2024-09-12T02:01:20.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.453+0000 7f5a19126640 1 -- 172.21.15.19:0/758696748 wait complete. 2024-09-12T02:01:20.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.455+0000 7f5a19126640 1 Processor -- start 2024-09-12T02:01:20.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.455+0000 7f5a19126640 1 -- start start 2024-09-12T02:01:20.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a19126640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a1406c150 0x7f5a14135370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a19126640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a140b43b0 0x7f5a141ea060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a19126640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a14161ac0 0x7f5a141ea5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a19126640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5a14161ea0 con 0x7f5a1406c150 2024-09-12T02:01:20.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a19126640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1415ece0 con 0x7f5a14161ac0 2024-09-12T02:01:20.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a19126640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5a14162020 con 0x7f5a140b43b0 2024-09-12T02:01:20.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a12d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a1406c150 0x7f5a14135370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a12d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a1406c150 0x7f5a14135370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55160/0 (socket says 172.21.15.19:55160) 2024-09-12T02:01:20.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a12d9d640 1 -- 172.21.15.19:0/450227018 learned_addr learned my addr 172.21.15.19:0/450227018 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:20.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a1359e640 1 --2- 172.21.15.19:0/450227018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a14161ac0 0x7f5a141ea5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a1259c640 1 --2- 172.21.15.19:0/450227018 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a140b43b0 0x7f5a141ea060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a12d9d640 1 -- 172.21.15.19:0/450227018 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a140b43b0 msgr2=0x7f5a141ea060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:20.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a12d9d640 1 --2- 172.21.15.19:0/450227018 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a140b43b0 0x7f5a141ea060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a12d9d640 1 -- 172.21.15.19:0/450227018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a14161ac0 msgr2=0x7f5a141ea5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:20.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a12d9d640 1 --2- 172.21.15.19:0/450227018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a14161ac0 0x7f5a141ea5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a12d9d640 1 -- 172.21.15.19:0/450227018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a141358b0 con 0x7f5a1406c150 2024-09-12T02:01:20.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a1259c640 1 --2- 172.21.15.19:0/450227018 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a140b43b0 0x7f5a141ea060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:20.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a12d9d640 1 --2- 172.21.15.19:0/450227018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a1406c150 0x7f5a14135370 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5a0402a180 tx=0x7f5a040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:20.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f59fb7fe640 1 -- 172.21.15.19:0/450227018 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a04041020 con 0x7f5a1406c150 2024-09-12T02:01:20.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f59fb7fe640 1 -- 172.21.15.19:0/450227018 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a040306c0 con 0x7f5a1406c150 2024-09-12T02:01:20.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a19126640 1 -- 172.21.15.19:0/450227018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a141eadc0 con 0x7f5a1406c150 2024-09-12T02:01:20.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f59fb7fe640 1 -- 172.21.15.19:0/450227018 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a04037040 con 0x7f5a1406c150 2024-09-12T02:01:20.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.456+0000 7f5a19126640 1 -- 172.21.15.19:0/450227018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a141eb380 con 0x7f5a1406c150 2024-09-12T02:01:20.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.458+0000 7f5a19126640 1 -- 172.21.15.19:0/450227018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a1406bc10 con 0x7f5a1406c150 2024-09-12T02:01:20.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.458+0000 7f59fb7fe640 1 -- 172.21.15.19:0/450227018 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a04044020 con 0x7f5a1406c150 2024-09-12T02:01:20.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.458+0000 7f59fb7fe640 1 --2- 172.21.15.19:0/450227018 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a0006be60 0x7f5a0006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.459+0000 7f59fb7fe640 1 -- 172.21.15.19:0/450227018 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f5a040ab790 con 0x7f5a1406c150 2024-09-12T02:01:20.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.459+0000 7f5a1259c640 1 --2- 172.21.15.19:0/450227018 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a0006be60 0x7f5a0006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.459+0000 7f5a1259c640 1 --2- 172.21.15.19:0/450227018 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a0006be60 0x7f5a0006e320 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5a1406c120 tx=0x7f5a08008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:20.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.463+0000 7f59fb7fe640 1 -- 172.21.15.19:0/450227018 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5a0404b030 con 0x7f5a1406c150 2024-09-12T02:01:20.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.710+0000 7f5a19126640 1 -- 172.21.15.19:0/450227018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f5a14067e50 con 0x7f5a1406c150 2024-09-12T02:01:20.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.712+0000 7f59fb7fe640 1 -- 172.21.15.19:0/450227018 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f5a04079fb0 con 0x7f5a1406c150 2024-09-12T02:01:20.713 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-09-12T02:01:20.713 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDwSeJmfHbXIRAALAvdYAlaB6WxWtubFnlxRw== 2024-09-12T02:01:20.713 INFO:teuthology.orchestra.run.smithi019.stdout: caps mds = "allow" 2024-09-12T02:01:20.713 INFO:teuthology.orchestra.run.smithi019.stdout: caps mon = "allow r" 2024-09-12T02:01:20.713 INFO:teuthology.orchestra.run.smithi019.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:01:20.713 INFO:teuthology.orchestra.run.smithi019.stderr:updated caps for client.0 2024-09-12T02:01:20.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.715+0000 7f5a19126640 1 -- 172.21.15.19:0/450227018 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a0006be60 msgr2=0x7f5a0006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:20.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.715+0000 7f5a19126640 1 --2- 172.21.15.19:0/450227018 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a0006be60 0x7f5a0006e320 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5a1406c120 tx=0x7f5a08008040 comp rx=0 tx=0).stop 2024-09-12T02:01:20.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.715+0000 7f5a19126640 1 -- 172.21.15.19:0/450227018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a1406c150 msgr2=0x7f5a14135370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:20.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.715+0000 7f5a19126640 1 --2- 172.21.15.19:0/450227018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a1406c150 0x7f5a14135370 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5a0402a180 tx=0x7f5a040046c0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.715+0000 7f5a19126640 1 -- 172.21.15.19:0/450227018 shutdown_connections 2024-09-12T02:01:20.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.715+0000 7f5a19126640 1 --2- 172.21.15.19:0/450227018 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a0006be60 0x7f5a0006e320 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.715+0000 7f5a19126640 1 --2- 172.21.15.19:0/450227018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a14161ac0 0x7f5a141ea5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.715+0000 7f5a19126640 1 --2- 172.21.15.19:0/450227018 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a140b43b0 0x7f5a141ea060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.715+0000 7f5a19126640 1 --2- 172.21.15.19:0/450227018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a1406c150 0x7f5a14135370 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.715+0000 7f5a19126640 1 -- 172.21.15.19:0/450227018 >> 172.21.15.19:0/450227018 conn(0x7f5a1409aa30 msgr2=0x7f5a14162220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:20.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.715+0000 7f5a19126640 1 -- 172.21.15.19:0/450227018 shutdown_connections 2024-09-12T02:01:20.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.715+0000 7f5a19126640 1 -- 172.21.15.19:0/450227018 wait complete. 2024-09-12T02:01:20.727 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:20.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.828+0000 7fe396f11640 1 Processor -- start 2024-09-12T02:01:20.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.828+0000 7fe396f11640 1 -- start start 2024-09-12T02:01:20.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.829+0000 7fe396f11640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39015e5f0 0x7fe3900d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.829+0000 7fe396f11640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3900d3690 con 0x7fe3900d30f0 2024-09-12T02:01:20.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.829+0000 7fe396f11640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3900d3970 con 0x7fe3900b6690 2024-09-12T02:01:20.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.829+0000 7fe396f11640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe39006d530 con 0x7fe39015e5f0 2024-09-12T02:01:20.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.829+0000 7fe38ffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe3900d30f0 0x7fe3900b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40708/0 (socket says 172.21.15.19:40708) 2024-09-12T02:01:20.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.829+0000 7fe38ffff640 1 -- 172.21.15.19:0/635199675 learned_addr learned my addr 172.21.15.19:0/635199675 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:20.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe394cad640 1 --2- 172.21.15.19:0/635199675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39015e5f0 0x7fe3900d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38f7fe640 1 -- 172.21.15.19:0/635199675 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1615469807 0 0) 0x7fe3900d3690 con 0x7fe3900d30f0 2024-09-12T02:01:20.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38f7fe640 1 -- 172.21.15.19:0/635199675 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe378003520 con 0x7fe3900d30f0 2024-09-12T02:01:20.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38f7fe640 1 -- 172.21.15.19:0/635199675 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2724849936 0 0) 0x7fe3900d3970 con 0x7fe3900b6690 2024-09-12T02:01:20.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38f7fe640 1 -- 172.21.15.19:0/635199675 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3900d3690 con 0x7fe3900b6690 2024-09-12T02:01:20.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38f7fe640 1 -- 172.21.15.19:0/635199675 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 53703867 0 0) 0x7fe378003520 con 0x7fe3900d30f0 2024-09-12T02:01:20.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38f7fe640 1 -- 172.21.15.19:0/635199675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39015e5f0 msgr2=0x7fe3900d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:20.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38f7fe640 1 --2- 172.21.15.19:0/635199675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39015e5f0 0x7fe3900d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38f7fe640 1 -- 172.21.15.19:0/635199675 >> v1:172.21.15.135:6789/0 conn(0x7fe3900b6690 legacy=0x7fe39006d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:20.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38f7fe640 1 -- 172.21.15.19:0/635199675 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39006cee0 con 0x7fe3900d30f0 2024-09-12T02:01:20.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38f7fe640 1 -- 172.21.15.19:0/635199675 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fe384001670 con 0x7fe3900d30f0 2024-09-12T02:01:20.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38f7fe640 1 -- 172.21.15.19:0/635199675 >> v1:172.21.15.19:6789/0 conn(0x7fe3900d30f0 legacy=0x7fe3900b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:20.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38f7fe640 1 --2- 172.21.15.19:0/635199675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39015e5f0 0x7fe378003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38f7fe640 1 --2- 172.21.15.19:0/635199675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3780040d0 0x7fe378004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38f7fe640 1 --2- 172.21.15.19:0/635199675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe378004d40 0x7fe3780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38f7fe640 1 -- 172.21.15.19:0/635199675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe39006d530 con 0x7fe3780040d0 2024-09-12T02:01:20.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38f7fe640 1 -- 172.21.15.19:0/635199675 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe37800baa0 con 0x7fe378004d40 2024-09-12T02:01:20.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38f7fe640 1 -- 172.21.15.19:0/635199675 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe37800bca0 con 0x7fe39015e5f0 2024-09-12T02:01:20.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38ffff640 1 --2- 172.21.15.19:0/635199675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3780040d0 0x7fe378004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe394cad640 1 --2- 172.21.15.19:0/635199675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39015e5f0 0x7fe378003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe3954ae640 1 --2- 172.21.15.19:0/635199675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe378004d40 0x7fe3780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38ffff640 1 -- 172.21.15.19:0/635199675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39015e5f0 msgr2=0x7fe378003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:20.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38ffff640 1 --2- 172.21.15.19:0/635199675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39015e5f0 0x7fe378003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38ffff640 1 -- 172.21.15.19:0/635199675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe378004d40 msgr2=0x7fe3780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:20.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38ffff640 1 --2- 172.21.15.19:0/635199675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe378004d40 0x7fe3780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.830+0000 7fe38ffff640 1 -- 172.21.15.19:0/635199675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe378003520 con 0x7fe3780040d0 2024-09-12T02:01:20.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.831+0000 7fe38ffff640 1 --2- 172.21.15.19:0/635199675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3780040d0 0x7fe378004800 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe384007fd0 tx=0x7fe378005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511974f17834bc18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:20.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.831+0000 7fe38f7fe640 1 -- 172.21.15.19:0/635199675 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe384007ce0 con 0x7fe3780040d0 2024-09-12T02:01:20.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.831+0000 7fe38f7fe640 1 -- 172.21.15.19:0/635199675 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe384005ad0 con 0x7fe3780040d0 2024-09-12T02:01:20.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.831+0000 7fe38f7fe640 1 -- 172.21.15.19:0/635199675 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe384007070 con 0x7fe3780040d0 2024-09-12T02:01:20.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.832+0000 7fe396f11640 1 -- 172.21.15.19:0/635199675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3780040d0 msgr2=0x7fe378004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:20.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.832+0000 7fe396f11640 1 --2- 172.21.15.19:0/635199675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3780040d0 0x7fe378004800 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe384007fd0 tx=0x7fe378005830 comp rx=0 tx=0).stop 2024-09-12T02:01:20.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.832+0000 7fe3954ae640 1 -- 172.21.15.19:0/635199675 reap_dead start 2024-09-12T02:01:20.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.832+0000 7fe396f11640 1 -- 172.21.15.19:0/635199675 shutdown_connections 2024-09-12T02:01:20.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.832+0000 7fe396f11640 1 -- 172.21.15.19:0/635199675 >> 172.21.15.19:0/635199675 conn(0x7fe39008bfc0 msgr2=0x7fe3900d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:20.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.832+0000 7fe396f11640 1 -- 172.21.15.19:0/635199675 shutdown_connections 2024-09-12T02:01:20.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.832+0000 7fe396f11640 1 -- 172.21.15.19:0/635199675 wait complete. 2024-09-12T02:01:20.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.833+0000 7fe396f11640 1 Processor -- start 2024-09-12T02:01:20.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.833+0000 7fe396f11640 1 -- start start 2024-09-12T02:01:20.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.834+0000 7fe396f11640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3780040d0 0x7fe390157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.834+0000 7fe396f11640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe39015f560 0x7fe3900b95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.834+0000 7fe396f11640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe39015f9c0 0x7fe3900b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.834+0000 7fe396f11640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe3900d4dd0 con 0x7fe39015f560 2024-09-12T02:01:20.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.834+0000 7fe396f11640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe39015e9d0 con 0x7fe39015f9c0 2024-09-12T02:01:20.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.834+0000 7fe396f11640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe3900d4f50 con 0x7fe3780040d0 2024-09-12T02:01:20.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.834+0000 7fe38ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe39015f560 0x7fe3900b95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.834+0000 7fe38ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe39015f560 0x7fe3900b95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55174/0 (socket says 172.21.15.19:55174) 2024-09-12T02:01:20.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.834+0000 7fe38ffff640 1 -- 172.21.15.19:0/710709873 learned_addr learned my addr 172.21.15.19:0/710709873 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:20.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.834+0000 7fe394cad640 1 --2- 172.21.15.19:0/710709873 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3780040d0 0x7fe390157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.834+0000 7fe3954ae640 1 --2- 172.21.15.19:0/710709873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe39015f9c0 0x7fe3900b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.835+0000 7fe38ffff640 1 -- 172.21.15.19:0/710709873 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3780040d0 msgr2=0x7fe390157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:20.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.835+0000 7fe38ffff640 1 --2- 172.21.15.19:0/710709873 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3780040d0 0x7fe390157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.835+0000 7fe38ffff640 1 -- 172.21.15.19:0/710709873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe39015f9c0 msgr2=0x7fe3900b9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:20.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.835+0000 7fe38ffff640 1 --2- 172.21.15.19:0/710709873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe39015f9c0 0x7fe3900b9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:20.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.835+0000 7fe38ffff640 1 -- 172.21.15.19:0/710709873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39015ff90 con 0x7fe39015f560 2024-09-12T02:01:20.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.835+0000 7fe38ffff640 1 --2- 172.21.15.19:0/710709873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe39015f560 0x7fe3900b95e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe38402ad80 tx=0x7fe3840019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:20.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.835+0000 7fe38d7fa640 1 -- 172.21.15.19:0/710709873 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe384037040 con 0x7fe39015f560 2024-09-12T02:01:20.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.835+0000 7fe38d7fa640 1 -- 172.21.15.19:0/710709873 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe384041070 con 0x7fe39015f560 2024-09-12T02:01:20.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.835+0000 7fe396f11640 1 -- 172.21.15.19:0/710709873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe390160270 con 0x7fe39015f560 2024-09-12T02:01:20.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.835+0000 7fe38d7fa640 1 -- 172.21.15.19:0/710709873 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe384001670 con 0x7fe39015f560 2024-09-12T02:01:20.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.835+0000 7fe396f11640 1 -- 172.21.15.19:0/710709873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe390160830 con 0x7fe39015f560 2024-09-12T02:01:20.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.836+0000 7fe396f11640 1 -- 172.21.15.19:0/710709873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3900d5330 con 0x7fe39015f560 2024-09-12T02:01:20.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.837+0000 7fe38d7fa640 1 -- 172.21.15.19:0/710709873 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe3840049e0 con 0x7fe39015f560 2024-09-12T02:01:20.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.837+0000 7fe38d7fa640 1 --2- 172.21.15.19:0/710709873 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe37c06be60 0x7fe37c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:20.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.837+0000 7fe38d7fa640 1 -- 172.21.15.19:0/710709873 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fe3840aa900 con 0x7fe39015f560 2024-09-12T02:01:20.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.837+0000 7fe394cad640 1 --2- 172.21.15.19:0/710709873 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe37c06be60 0x7fe37c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:20.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.838+0000 7fe394cad640 1 --2- 172.21.15.19:0/710709873 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe37c06be60 0x7fe37c06e320 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe380009ae0 tx=0x7fe380009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:20.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:20.841+0000 7fe38d7fa640 1 -- 172.21.15.19:0/710709873 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe384079120 con 0x7fe39015f560 2024-09-12T02:01:21.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.057+0000 7fe396f11640 1 -- 172.21.15.19:0/710709873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3900d3cb0 con 0x7fe39015f560 2024-09-12T02:01:21.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.057+0000 7fe38d7fa640 1 -- 172.21.15.19:0/710709873 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5228 (secure 0 0 0) 0x7fe384078a20 con 0x7fe39015f560 2024-09-12T02:01:21.058 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:21.058 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":62,"btime":"2024-09-12T02:01:18:960990+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1065573429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1065573429},{"type":"v1","addr":"172.21.15.19:6835","nonce":1065573429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3905709264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":3905709264},{"type":"v1","addr":"172.21.15.135:6837","nonce":3905709264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6082,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/836344045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":836344045},{"type":"v1","addr":"172.21.15.19:6834","nonce":836344045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:01:16.289395+0000","modified":"2024-09-12T02:01:18.305545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6088":{"gid":6088,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/1796121402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1796121402},{"type":"v1","addr":"172.21.15.135:6836","nonce":1796121402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6088,"qdb_cluster":[6088]},"id":5}]} 2024-09-12T02:01:21.058 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 62 2024-09-12T02:01:21.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.059+0000 7fe396f11640 1 -- 172.21.15.19:0/710709873 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe37c06be60 msgr2=0x7fe37c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:21.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.059+0000 7fe396f11640 1 --2- 172.21.15.19:0/710709873 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe37c06be60 0x7fe37c06e320 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe380009ae0 tx=0x7fe380009190 comp rx=0 tx=0).stop 2024-09-12T02:01:21.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.059+0000 7fe396f11640 1 -- 172.21.15.19:0/710709873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe39015f560 msgr2=0x7fe3900b95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:21.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.059+0000 7fe396f11640 1 --2- 172.21.15.19:0/710709873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe39015f560 0x7fe3900b95e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe38402ad80 tx=0x7fe3840019c0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.060+0000 7fe396f11640 1 -- 172.21.15.19:0/710709873 shutdown_connections 2024-09-12T02:01:21.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.060+0000 7fe396f11640 1 --2- 172.21.15.19:0/710709873 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe37c06be60 0x7fe37c06e320 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.060+0000 7fe396f11640 1 --2- 172.21.15.19:0/710709873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe39015f9c0 0x7fe3900b9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.060+0000 7fe396f11640 1 --2- 172.21.15.19:0/710709873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe39015f560 0x7fe3900b95e0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.060+0000 7fe396f11640 1 --2- 172.21.15.19:0/710709873 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3780040d0 0x7fe390157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.060+0000 7fe396f11640 1 -- 172.21.15.19:0/710709873 >> 172.21.15.19:0/710709873 conn(0x7fe39008bfc0 msgr2=0x7fe3900b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:21.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.060+0000 7fe396f11640 1 -- 172.21.15.19:0/710709873 shutdown_connections 2024-09-12T02:01:21.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.060+0000 7fe396f11640 1 -- 172.21.15.19:0/710709873 wait complete. 2024-09-12T02:01:21.473 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:01:16.289395+0000', 'modified': '2024-09-12T02:01:18.305545+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6088}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6088': {'gid': 6088, 'name': 'b', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6836/1796121402', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 1796121402}, {'type': 'v1', 'addr': '172.21.15.135:6836', 'nonce': 1796121402}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6088, 'qdb_cluster': [6088]} 2024-09-12T02:01:21.474 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:01:21.474 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T02:01:21.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.580+0000 7fd06716f640 1 Processor -- start 2024-09-12T02:01:21.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.580+0000 7fd06716f640 1 -- start start 2024-09-12T02:01:21.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.581+0000 7fd06716f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0600afd60 0x7fd0600726b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.581+0000 7fd06716f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd0600b3e60 0x7fd06006f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.581+0000 7fd06716f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0600b44c0 con 0x7fd060072bf0 2024-09-12T02:01:21.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.581+0000 7fd06716f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd0600b4290 con 0x7fd0600afd60 2024-09-12T02:01:21.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.581+0000 7fd06716f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd0600b0140 con 0x7fd0600b3e60 2024-09-12T02:01:21.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.581+0000 7fd064f0b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0600afd60 0x7fd0600726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.581+0000 7fd064f0b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0600afd60 0x7fd0600726b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35440/0 (socket says 172.21.15.19:35440) 2024-09-12T02:01:21.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.581+0000 7fd064f0b640 1 -- 172.21.15.19:0/1724016016 learned_addr learned my addr 172.21.15.19:0/1724016016 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:21.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.581+0000 7fd06570c640 1 --2- 172.21.15.19:0/1724016016 >> v2:172.21.15.135:3300/0 conn(0x7fd0600b3e60 0x7fd06006f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.581+0000 7fd064f0b640 1 -- 172.21.15.19:0/1724016016 >> v2:172.21.15.135:3300/0 conn(0x7fd0600b3e60 msgr2=0x7fd06006f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:21.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.581+0000 7fd064f0b640 1 --2- 172.21.15.19:0/1724016016 >> v2:172.21.15.135:3300/0 conn(0x7fd0600b3e60 0x7fd06006f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.581+0000 7fd064f0b640 1 -- 172.21.15.19:0/1724016016 >> v1:172.21.15.135:6789/0 conn(0x7fd060072bf0 legacy=0x7fd0600b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:21.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.581+0000 7fd064f0b640 1 -- 172.21.15.19:0/1724016016 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06015ead0 con 0x7fd0600afd60 2024-09-12T02:01:21.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.582+0000 7fd064f0b640 1 --2- 172.21.15.19:0/1724016016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0600afd60 0x7fd0600726b0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd060161ef0 tx=0x7fd05402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1671ee83c9fcd6d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:21.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.582+0000 7fd05f7fe640 1 -- 172.21.15.19:0/1724016016 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd054037070 con 0x7fd0600afd60 2024-09-12T02:01:21.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.582+0000 7fd05f7fe640 1 -- 172.21.15.19:0/1724016016 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd054032440 con 0x7fd0600afd60 2024-09-12T02:01:21.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.582+0000 7fd05f7fe640 1 -- 172.21.15.19:0/1724016016 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd054032810 con 0x7fd0600afd60 2024-09-12T02:01:21.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.583+0000 7fd06716f640 1 -- 172.21.15.19:0/1724016016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0600afd60 msgr2=0x7fd0600726b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:21.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.583+0000 7fd06716f640 1 --2- 172.21.15.19:0/1724016016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0600afd60 0x7fd0600726b0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd060161ef0 tx=0x7fd05402a270 comp rx=0 tx=0).stop 2024-09-12T02:01:21.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.583+0000 7fd06716f640 1 -- 172.21.15.19:0/1724016016 shutdown_connections 2024-09-12T02:01:21.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.583+0000 7fd06716f640 1 --2- 172.21.15.19:0/1724016016 >> v2:172.21.15.135:3300/0 conn(0x7fd0600b3e60 0x7fd06006f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.583+0000 7fd06716f640 1 --2- 172.21.15.19:0/1724016016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0600afd60 0x7fd0600726b0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.583+0000 7fd06716f640 1 -- 172.21.15.19:0/1724016016 >> 172.21.15.19:0/1724016016 conn(0x7fd06006c030 msgr2=0x7fd06006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:21.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.583+0000 7fd06716f640 1 -- 172.21.15.19:0/1724016016 shutdown_connections 2024-09-12T02:01:21.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.583+0000 7fd06716f640 1 -- 172.21.15.19:0/1724016016 wait complete. 2024-09-12T02:01:21.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.584+0000 7fd06716f640 1 Processor -- start 2024-09-12T02:01:21.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.584+0000 7fd06716f640 1 -- start start 2024-09-12T02:01:21.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.585+0000 7fd06716f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd060072bf0 0x7fd0601591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.585+0000 7fd06716f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0600afd60 0x7fd0601f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.585+0000 7fd06716f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0600b3e60 0x7fd060157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.585+0000 7fd06716f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd06015f090 con 0x7fd060072bf0 2024-09-12T02:01:21.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.585+0000 7fd06716f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd060073030 con 0x7fd0600afd60 2024-09-12T02:01:21.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.585+0000 7fd06716f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd06015f370 con 0x7fd0600b3e60 2024-09-12T02:01:21.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.585+0000 7fd064f0b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd060072bf0 0x7fd0601591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.585+0000 7fd064f0b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd060072bf0 0x7fd0601591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35456/0 (socket says 172.21.15.19:35456) 2024-09-12T02:01:21.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.585+0000 7fd064f0b640 1 -- 172.21.15.19:0/893800685 learned_addr learned my addr 172.21.15.19:0/893800685 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:21.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.585+0000 7fd05ffff640 1 --2- 172.21.15.19:0/893800685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0600afd60 0x7fd0601f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.585+0000 7fd06570c640 1 --2- 172.21.15.19:0/893800685 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0600b3e60 0x7fd060157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.585+0000 7fd064f0b640 1 -- 172.21.15.19:0/893800685 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0600b3e60 msgr2=0x7fd060157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:21.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.585+0000 7fd064f0b640 1 --2- 172.21.15.19:0/893800685 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0600b3e60 0x7fd060157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.585+0000 7fd064f0b640 1 -- 172.21.15.19:0/893800685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0600afd60 msgr2=0x7fd0601f4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:21.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.585+0000 7fd064f0b640 1 --2- 172.21.15.19:0/893800685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0600afd60 0x7fd0601f4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.585+0000 7fd064f0b640 1 -- 172.21.15.19:0/893800685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd060159840 con 0x7fd060072bf0 2024-09-12T02:01:21.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.585+0000 7fd064f0b640 1 --2- 172.21.15.19:0/893800685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd060072bf0 0x7fd0601591f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd05402a2b0 tx=0x7fd0540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:21.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.586+0000 7fd05d7fa640 1 -- 172.21.15.19:0/893800685 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd054041020 con 0x7fd060072bf0 2024-09-12T02:01:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.586+0000 7fd05d7fa640 1 -- 172.21.15.19:0/893800685 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0540306c0 con 0x7fd060072bf0 2024-09-12T02:01:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.586+0000 7fd06716f640 1 -- 172.21.15.19:0/893800685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd060159b20 con 0x7fd060072bf0 2024-09-12T02:01:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.586+0000 7fd05d7fa640 1 -- 172.21.15.19:0/893800685 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd054037040 con 0x7fd060072bf0 2024-09-12T02:01:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.586+0000 7fd06716f640 1 -- 172.21.15.19:0/893800685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd06015a0e0 con 0x7fd060072bf0 2024-09-12T02:01:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.587+0000 7fd05d7fa640 1 -- 172.21.15.19:0/893800685 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd054044020 con 0x7fd060072bf0 2024-09-12T02:01:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.587+0000 7fd05d7fa640 1 --2- 172.21.15.19:0/893800685 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd04406be30 0x7fd04406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.588+0000 7fd05d7fa640 1 -- 172.21.15.19:0/893800685 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fd0540ab6f0 con 0x7fd060072bf0 2024-09-12T02:01:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.588+0000 7fd05ffff640 1 --2- 172.21.15.19:0/893800685 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd04406be30 0x7fd04406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.588+0000 7fd05ffff640 1 --2- 172.21.15.19:0/893800685 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd04406be30 0x7fd04406e2f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd0600af350 tx=0x7fd04c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.588+0000 7fd069fe1740 1 Processor -- start 2024-09-12T02:01:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.588+0000 7fd069fe1740 1 -- start start 2024-09-12T02:01:21.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.589+0000 7fd069fe1740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702a42c0 0x55c3702e9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.589+0000 7fd069fe1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a1a80 0x55c3702a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.589+0000 7fd069fe1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702a5a50 0x55c37029e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.589+0000 7fd069fe1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c370206520 con 0x55c3702a1a80 2024-09-12T02:01:21.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.589+0000 7fd069fe1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c3701ae3e0 con 0x55c3702a5a50 2024-09-12T02:01:21.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.589+0000 7fd069fe1740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55c3702024e0 con 0x55c3702a42c0 2024-09-12T02:01:21.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.589+0000 7fd05ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a1a80 0x55c3702a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.589+0000 7fd05ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a1a80 0x55c3702a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35472/0 (socket says 172.21.15.19:35472) 2024-09-12T02:01:21.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.589+0000 7fd05ffff640 1 -- 172.21.15.19:0/218361368 learned_addr learned my addr 172.21.15.19:0/218361368 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:21.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.589+0000 7fd06570c640 1 --2- 172.21.15.19:0/218361368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702a5a50 0x55c37029e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.589+0000 7fd064f0b640 1 --2- 172.21.15.19:0/218361368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702a42c0 0x55c3702e9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.590+0000 7fd05ffff640 1 -- 172.21.15.19:0/218361368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702a42c0 msgr2=0x55c3702e9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.590+0000 7fd05ffff640 1 --2- 172.21.15.19:0/218361368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702a42c0 0x55c3702e9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.590+0000 7fd05ffff640 1 -- 172.21.15.19:0/218361368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702a5a50 msgr2=0x55c37029e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.590+0000 7fd05ffff640 1 --2- 172.21.15.19:0/218361368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702a5a50 0x55c37029e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.590+0000 7fd05ffff640 1 -- 172.21.15.19:0/218361368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3701c92f0 con 0x55c3702a1a80 2024-09-12T02:01:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.590+0000 7fd05ffff640 1 --2- 172.21.15.19:0/218361368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a1a80 0x55c3702a46a0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00fbd0 tx=0x7fd04c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303a109ba74adfd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.590+0000 7fd04a7fc640 1 -- 172.21.15.19:0/218361368 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c026070 con 0x55c3702a1a80 2024-09-12T02:01:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.590+0000 7fd04a7fc640 1 -- 172.21.15.19:0/218361368 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04c007030 con 0x55c3702a1a80 2024-09-12T02:01:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.590+0000 7fd04a7fc640 1 -- 172.21.15.19:0/218361368 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0073e0 con 0x55c3702a1a80 2024-09-12T02:01:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.591+0000 7fd069fe1740 1 -- 172.21.15.19:0/218361368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a1a80 msgr2=0x55c3702a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.591+0000 7fd069fe1740 1 --2- 172.21.15.19:0/218361368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a1a80 0x55c3702a46a0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00fbd0 tx=0x7fd04c012000 comp rx=0 tx=0).stop 2024-09-12T02:01:21.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.591+0000 7fd069fe1740 1 -- 172.21.15.19:0/218361368 shutdown_connections 2024-09-12T02:01:21.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.591+0000 7fd069fe1740 1 --2- 172.21.15.19:0/218361368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702a5a50 0x55c37029e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.591+0000 7fd069fe1740 1 --2- 172.21.15.19:0/218361368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a1a80 0x55c3702a46a0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.591+0000 7fd069fe1740 1 --2- 172.21.15.19:0/218361368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702a42c0 0x55c3702e9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.591+0000 7fd069fe1740 1 -- 172.21.15.19:0/218361368 >> 172.21.15.19:0/218361368 conn(0x55c3702a0a80 msgr2=0x55c3702e8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:21.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.591+0000 7fd069fe1740 1 -- 172.21.15.19:0/218361368 shutdown_connections 2024-09-12T02:01:21.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.591+0000 7fd069fe1740 1 -- 172.21.15.19:0/218361368 wait complete. 2024-09-12T02:01:21.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.591+0000 7fd069fe1740 1 -- start start 2024-09-12T02:01:21.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.591+0000 7fd069fe1740 1 Processor -- start 2024-09-12T02:01:21.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.592+0000 7fd069fe1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702a42c0 0x55c3702c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.592+0000 7fd069fe1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a5a50 0x55c3702d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.592+0000 7fd069fe1740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702d01d0 0x55c3702d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.592+0000 7fd069fe1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c37029ff20 con 0x55c3702a5a50 2024-09-12T02:01:21.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.592+0000 7fd069fe1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c37018f450 con 0x55c3702a42c0 2024-09-12T02:01:21.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.592+0000 7fd069fe1740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55c3702ea290 con 0x55c3702d01d0 2024-09-12T02:01:21.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.592+0000 7fd069fe1740 10 client.0 _ll_register_callbacks cb 0x55c36ff18ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:21.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.592+0000 7fd05ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a5a50 0x55c3702d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.592+0000 7fd05ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a5a50 0x55c3702d19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35478/0 (socket says 172.21.15.19:35478) 2024-09-12T02:01:21.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.592+0000 7fd05ffff640 1 -- 172.21.15.19:0/2719863205 learned_addr learned my addr 172.21.15.19:0/2719863205 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd06570c640 1 --2- 172.21.15.19:0/2719863205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702d01d0 0x55c3702d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd064f0b640 1 --2- 172.21.15.19:0/2719863205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702a42c0 0x55c3702c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd05ffff640 1 -- 172.21.15.19:0/2719863205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702d01d0 msgr2=0x55c3702d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd05ffff640 1 --2- 172.21.15.19:0/2719863205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702d01d0 0x55c3702d1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd05ffff640 1 -- 172.21.15.19:0/2719863205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702a42c0 msgr2=0x55c3702c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd05ffff640 1 --2- 172.21.15.19:0/2719863205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702a42c0 0x55c3702c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd05ffff640 1 -- 172.21.15.19:0/2719863205 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c36ff192d0 con 0x55c3702a5a50 2024-09-12T02:01:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd064f0b640 1 --2- 172.21.15.19:0/2719863205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702a42c0 0x55c3702c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd05ffff640 1 --2- 172.21.15.19:0/2719863205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a5a50 0x55c3702d19f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd04c024040 tx=0x7fd04c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90dd48581bfe5193 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd03f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:01:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd03f7fe640 1 -- 172.21.15.19:0/2719863205 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c026040 con 0x55c3702a5a50 2024-09-12T02:01:21.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd03f7fe640 1 -- 172.21.15.19:0/2719863205 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fd04c020620 con 0x55c3702a5a50 2024-09-12T02:01:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd069fe1740 1 -- 172.21.15.19:0/2719863205 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd04c007030 con 0x55c3702a5a50 2024-09-12T02:01:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd03f7fe640 1 -- 172.21.15.19:0/2719863205 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fd04c038050 con 0x55c3702a5a50 2024-09-12T02:01:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd069fe1740 10 client.6612 fetch_fsmap learned FSMap version 62 2024-09-12T02:01:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd069fe1740 1 -- 172.21.15.19:0/2719863205 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x55c36ffe36b0 con 0x55c3702a5a50 2024-09-12T02:01:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd03f7fe640 1 -- 172.21.15.19:0/2719863205 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04c007030 con 0x55c3702a5a50 2024-09-12T02:01:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd03f7fe640 1 -- 172.21.15.19:0/2719863205 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 62) ==== 3502+0+0 (secure 0 0 0) 0x7fd04c03b020 con 0x55c3702a5a50 2024-09-12T02:01:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd069fe1740 10 client.6612 fetch_fsmap finished waiting for FSMap version 62 2024-09-12T02:01:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd069fe1740 10 client.6612 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:01:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.593+0000 7fd069fe1740 20 client.6612 populate_metadata read hostname 'smithi019' 2024-09-12T02:01:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.594+0000 7fd069fe1740 1 --2- 172.21.15.19:0/2719863205 >> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] conn(0x55c3702fc550 0x55c3702fc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.594+0000 7fd069fe1740 4 client.6612 mds_command: new command op to 6088 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:01:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.594+0000 7fd069fe1740 1 -- 172.21.15.19:0/2719863205 --> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c370213c50 con 0x55c3702fc550 2024-09-12T02:01:21.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.594+0000 7fd064f0b640 1 --2- 172.21.15.19:0/2719863205 >> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] conn(0x55c3702fc550 0x55c3702fc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.594+0000 7fd03f7fe640 10 client.6612 ms_handle_connect on v2:172.21.15.135:6834/1796121402 2024-09-12T02:01:21.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.594+0000 7fd064f0b640 1 --2- 172.21.15.19:0/2719863205 >> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] conn(0x55c3702fc550 0x55c3702fc930 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dc2de50d2181698 server_cookie=dc016429ceabe44d in_seq=0 out_seq=0 2024-09-12T02:01:21.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.595+0000 7fd03f7fe640 1 -- 172.21.15.19:0/2719863205 <== mds.0 v2:172.21.15.135:6834/1796121402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c370213c50 con 0x55c3702fc550 2024-09-12T02:01:21.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.595+0000 7fd03f7fe640 10 client.6612 handle_command_reply: tid=0 2024-09-12T02:01:21.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.595+0000 7fd069fe1740 1 client.6612 shutdown 2024-09-12T02:01:21.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.595+0000 7fd069fe1740 1 -- 172.21.15.19:0/2719863205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a5a50 msgr2=0x55c3702d19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:21.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.595+0000 7fd069fe1740 1 --2- 172.21.15.19:0/2719863205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a5a50 0x55c3702d19f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd04c024040 tx=0x7fd04c000ed0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.595+0000 7fd069fe1740 1 -- 172.21.15.19:0/2719863205 shutdown_connections 2024-09-12T02:01:21.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.595+0000 7fd069fe1740 1 --2- 172.21.15.19:0/2719863205 >> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] conn(0x55c3702fc550 0x55c3702fc930 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.595+0000 7fd069fe1740 1 --2- 172.21.15.19:0/2719863205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702d01d0 0x55c3702d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.595+0000 7fd069fe1740 1 --2- 172.21.15.19:0/2719863205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a5a50 0x55c3702d19f0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.595+0000 7fd03f7fe640 0 client.6612 ms_handle_reset on v2:172.21.15.135:6834/1796121402 2024-09-12T02:01:21.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.595+0000 7fd069fe1740 1 --2- 172.21.15.19:0/2719863205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702a42c0 0x55c3702c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.595+0000 7fd069fe1740 1 -- 172.21.15.19:0/2719863205 >> 172.21.15.19:0/2719863205 conn(0x55c3702a1a80 msgr2=0x55c3702a2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:21.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.595+0000 7fd069fe1740 1 -- 172.21.15.19:0/2719863205 shutdown_connections 2024-09-12T02:01:21.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.595+0000 7fd069fe1740 1 -- 172.21.15.19:0/2719863205 wait complete. 2024-09-12T02:01:21.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.596+0000 7fd069fe1740 20 client.6612 trim_cache size 0 max 16384 2024-09-12T02:01:21.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.613+0000 7fd069fe1740 1 Processor -- start 2024-09-12T02:01:21.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.613+0000 7fd069fe1740 1 -- start start 2024-09-12T02:01:21.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.614+0000 7fd069fe1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702a42c0 0x55c3702e9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.614+0000 7fd069fe1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a5a50 0x55c370302da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.614+0000 7fd069fe1740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702d01d0 0x55c3702d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.614+0000 7fd069fe1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd0601f80f0 con 0x55c3702a5a50 2024-09-12T02:01:21.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.614+0000 7fd069fe1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd0601f7450 con 0x55c3702a42c0 2024-09-12T02:01:21.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.614+0000 7fd069fe1740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd0601f7aa0 con 0x55c3702d01d0 2024-09-12T02:01:21.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.614+0000 7fd05ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a5a50 0x55c370302da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.614+0000 7fd05ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a5a50 0x55c370302da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35492/0 (socket says 172.21.15.19:35492) 2024-09-12T02:01:21.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.614+0000 7fd05ffff640 1 -- 172.21.15.19:0/2734126451 learned_addr learned my addr 172.21.15.19:0/2734126451 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:21.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.614+0000 7fd05ffff640 1 -- 172.21.15.19:0/2734126451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702d01d0 msgr2=0x55c3702d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:21.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.614+0000 7fd05ffff640 1 --2- 172.21.15.19:0/2734126451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702d01d0 0x55c3702d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.615+0000 7fd05ffff640 1 -- 172.21.15.19:0/2734126451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702a42c0 msgr2=0x55c3702e9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:21.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.615+0000 7fd05ffff640 1 --2- 172.21.15.19:0/2734126451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702a42c0 0x55c3702e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.615+0000 7fd05ffff640 1 -- 172.21.15.19:0/2734126451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3702a0290 con 0x55c3702a5a50 2024-09-12T02:01:21.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.615+0000 7fd05ffff640 1 --2- 172.21.15.19:0/2734126451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a5a50 0x55c370302da0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd04c001eb0 tx=0x7fd04c02a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4a6616bfc0acea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:21.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.615+0000 7fd049ffb640 1 -- 172.21.15.19:0/2734126451 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c020620 con 0x55c3702a5a50 2024-09-12T02:01:21.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.615+0000 7fd049ffb640 1 -- 172.21.15.19:0/2734126451 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04c041070 con 0x55c3702a5a50 2024-09-12T02:01:21.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.615+0000 7fd049ffb640 1 -- 172.21.15.19:0/2734126451 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c020d60 con 0x55c3702a5a50 2024-09-12T02:01:21.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.615+0000 7fd069fe1740 1 -- 172.21.15.19:0/2734126451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a5a50 msgr2=0x55c370302da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:21.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.615+0000 7fd069fe1740 1 --2- 172.21.15.19:0/2734126451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a5a50 0x55c370302da0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd04c001eb0 tx=0x7fd04c02a000 comp rx=0 tx=0).stop 2024-09-12T02:01:21.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.615+0000 7fd069fe1740 1 -- 172.21.15.19:0/2734126451 shutdown_connections 2024-09-12T02:01:21.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.615+0000 7fd069fe1740 1 --2- 172.21.15.19:0/2734126451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702d01d0 0x55c3702d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.615+0000 7fd069fe1740 1 --2- 172.21.15.19:0/2734126451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a5a50 0x55c370302da0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.615+0000 7fd069fe1740 1 --2- 172.21.15.19:0/2734126451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702a42c0 0x55c3702e9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.615+0000 7fd069fe1740 1 -- 172.21.15.19:0/2734126451 >> 172.21.15.19:0/2734126451 conn(0x55c3702a1a80 msgr2=0x55c3702eac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:21.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.615+0000 7fd069fe1740 1 -- 172.21.15.19:0/2734126451 shutdown_connections 2024-09-12T02:01:21.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.615+0000 7fd069fe1740 1 -- 172.21.15.19:0/2734126451 wait complete. 2024-09-12T02:01:21.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.616+0000 7fd069fe1740 1 -- start start 2024-09-12T02:01:21.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.616+0000 7fd069fe1740 1 Processor -- start 2024-09-12T02:01:21.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.617+0000 7fd069fe1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a42c0 0x55c3702fb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.617+0000 7fd069fe1740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702a5a50 0x55c370367310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.617+0000 7fd069fe1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702d01d0 0x55c3702d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.617+0000 7fd069fe1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c3702f90e0 con 0x55c3702a42c0 2024-09-12T02:01:21.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.617+0000 7fd069fe1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c3702cc5b0 con 0x55c3702d01d0 2024-09-12T02:01:21.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.617+0000 7fd069fe1740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55c3702ccff0 con 0x55c3702a5a50 2024-09-12T02:01:21.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.617+0000 7fd069fe1740 10 client.0 _ll_register_callbacks cb 0x7fd04c024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:21.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.617+0000 7fd064f0b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a42c0 0x55c3702fb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.617+0000 7fd064f0b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a42c0 0x55c3702fb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35504/0 (socket says 172.21.15.19:35504) 2024-09-12T02:01:21.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.617+0000 7fd064f0b640 1 -- 172.21.15.19:0/937391528 learned_addr learned my addr 172.21.15.19:0/937391528 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:21.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.617+0000 7fd06570c640 1 --2- 172.21.15.19:0/937391528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702d01d0 0x55c3702d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.617+0000 7fd05ffff640 1 --2- 172.21.15.19:0/937391528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702a5a50 0x55c370367310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.617+0000 7fd064f0b640 1 -- 172.21.15.19:0/937391528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702a5a50 msgr2=0x55c370367310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:21.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.617+0000 7fd064f0b640 1 --2- 172.21.15.19:0/937391528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702a5a50 0x55c370367310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.617+0000 7fd064f0b640 1 -- 172.21.15.19:0/937391528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702d01d0 msgr2=0x55c3702d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:21.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.617+0000 7fd064f0b640 1 --2- 172.21.15.19:0/937391528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702d01d0 0x55c3702d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.617+0000 7fd064f0b640 1 -- 172.21.15.19:0/937391528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3702c9120 con 0x55c3702a42c0 2024-09-12T02:01:21.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.618+0000 7fd064f0b640 1 --2- 172.21.15.19:0/937391528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a42c0 0x55c3702fb370 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd054075d00 tx=0x7fd0540794a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7fc4f480b8430d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:21.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.618+0000 7fd03f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:01:21.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.618+0000 7fd03f7fe640 1 -- 172.21.15.19:0/937391528 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd054082480 con 0x55c3702a42c0 2024-09-12T02:01:21.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.618+0000 7fd03f7fe640 1 -- 172.21.15.19:0/937391528 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fd054077ba0 con 0x55c3702a42c0 2024-09-12T02:01:21.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.618+0000 7fd069fe1740 1 -- 172.21.15.19:0/937391528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd04c041070 con 0x55c3702a42c0 2024-09-12T02:01:21.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.618+0000 7fd03f7fe640 1 -- 172.21.15.19:0/937391528 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fd0540800b0 con 0x55c3702a42c0 2024-09-12T02:01:21.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.618+0000 7fd069fe1740 10 client.6618 fetch_fsmap learned FSMap version 62 2024-09-12T02:01:21.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.618+0000 7fd069fe1740 1 -- 172.21.15.19:0/937391528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x55c3702c8b10 con 0x55c3702a42c0 2024-09-12T02:01:21.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.618+0000 7fd03f7fe640 1 -- 172.21.15.19:0/937391528 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04c041070 con 0x55c3702a42c0 2024-09-12T02:01:21.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.618+0000 7fd03f7fe640 1 -- 172.21.15.19:0/937391528 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 62) ==== 3502+0+0 (secure 0 0 0) 0x7fd05403a030 con 0x55c3702a42c0 2024-09-12T02:01:21.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.618+0000 7fd069fe1740 10 client.6618 fetch_fsmap finished waiting for FSMap version 62 2024-09-12T02:01:21.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.618+0000 7fd069fe1740 10 client.6618 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:01:21.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.618+0000 7fd069fe1740 20 client.6618 populate_metadata read hostname 'smithi019' 2024-09-12T02:01:21.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.618+0000 7fd069fe1740 1 --2- 172.21.15.19:0/937391528 >> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] conn(0x55c3702a3180 0x55c37036aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.618+0000 7fd069fe1740 4 client.6618 mds_command: new command op to 6088 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:01:21.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.618+0000 7fd069fe1740 1 -- 172.21.15.19:0/937391528 --> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] -- command(tid 0: {"prefix": "status"}) -- 0x55c37020dfa0 con 0x55c3702a3180 2024-09-12T02:01:21.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.618+0000 7fd05ffff640 1 --2- 172.21.15.19:0/937391528 >> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] conn(0x55c3702a3180 0x55c37036aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.619+0000 7fd03f7fe640 10 client.6618 ms_handle_connect on v2:172.21.15.135:6834/1796121402 2024-09-12T02:01:21.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.619+0000 7fd05ffff640 1 --2- 172.21.15.19:0/937391528 >> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] conn(0x55c3702a3180 0x55c37036aec0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9dc45125107ef38 server_cookie=1587aa09253a1956 in_seq=0 out_seq=0 2024-09-12T02:01:21.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.619+0000 7fd03f7fe640 1 -- 172.21.15.19:0/937391528 <== mds.0 v2:172.21.15.135:6834/1796121402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55c37020dfa0 con 0x55c3702a3180 2024-09-12T02:01:21.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.619+0000 7fd03f7fe640 10 client.6618 handle_command_reply: tid=0 2024-09-12T02:01:21.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.619+0000 7fd069fe1740 1 client.6618 shutdown 2024-09-12T02:01:21.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.619+0000 7fd069fe1740 1 -- 172.21.15.19:0/937391528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a42c0 msgr2=0x55c3702fb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:21.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.619+0000 7fd069fe1740 1 --2- 172.21.15.19:0/937391528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a42c0 0x55c3702fb370 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd054075d00 tx=0x7fd0540794a0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.619+0000 7fd069fe1740 1 -- 172.21.15.19:0/937391528 shutdown_connections 2024-09-12T02:01:21.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.619+0000 7fd069fe1740 1 --2- 172.21.15.19:0/937391528 >> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] conn(0x55c3702a3180 0x55c37036aec0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.619+0000 7fd069fe1740 1 --2- 172.21.15.19:0/937391528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3702d01d0 0x55c3702d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.619+0000 7fd03f7fe640 0 client.6618 ms_handle_reset on v2:172.21.15.135:6834/1796121402 2024-09-12T02:01:21.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.619+0000 7fd069fe1740 1 --2- 172.21.15.19:0/937391528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c3702a5a50 0x55c370367310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.619+0000 7fd069fe1740 1 --2- 172.21.15.19:0/937391528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c3702a42c0 0x55c3702fb370 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.619+0000 7fd069fe1740 1 -- 172.21.15.19:0/937391528 >> 172.21.15.19:0/937391528 conn(0x55c3702a1a80 msgr2=0x55c3702eac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:21.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.619+0000 7fd069fe1740 1 -- 172.21.15.19:0/937391528 shutdown_connections 2024-09-12T02:01:21.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.619+0000 7fd069fe1740 1 -- 172.21.15.19:0/937391528 wait complete. 2024-09-12T02:01:21.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.619+0000 7fd069fe1740 20 client.6618 trim_cache size 0 max 16384 2024-09-12T02:01:21.627 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:01:21.627 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T02:01:21.627 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T02:01:21.627 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 6088, 2024-09-12T02:01:21.627 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T02:01:21.627 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T02:01:21.627 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T02:01:21.627 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 4.6605677710000002, 2024-09-12T02:01:21.627 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 62, 2024-09-12T02:01:21.628 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 81, 2024-09-12T02:01:21.628 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 81, 2024-09-12T02:01:21.628 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 9.6875856739999993 2024-09-12T02:01:21.628 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:01:21.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.620+0000 7fd06716f640 1 -- 172.21.15.19:0/893800685 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd04406be30 msgr2=0x7fd04406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:21.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.620+0000 7fd06716f640 1 --2- 172.21.15.19:0/893800685 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd04406be30 0x7fd04406e2f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd0600af350 tx=0x7fd04c009040 comp rx=0 tx=0).stop 2024-09-12T02:01:21.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.620+0000 7fd06716f640 1 -- 172.21.15.19:0/893800685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd060072bf0 msgr2=0x7fd0601591f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:21.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.620+0000 7fd06716f640 1 --2- 172.21.15.19:0/893800685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd060072bf0 0x7fd0601591f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd05402a2b0 tx=0x7fd0540046c0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.620+0000 7fd06716f640 1 -- 172.21.15.19:0/893800685 shutdown_connections 2024-09-12T02:01:21.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.620+0000 7fd06716f640 1 --2- 172.21.15.19:0/893800685 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd04406be30 0x7fd04406e2f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.620+0000 7fd06716f640 1 --2- 172.21.15.19:0/893800685 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0600b3e60 0x7fd060157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.620+0000 7fd06716f640 1 --2- 172.21.15.19:0/893800685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0600afd60 0x7fd0601f4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.620+0000 7fd06716f640 1 --2- 172.21.15.19:0/893800685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd060072bf0 0x7fd0601591f0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.620+0000 7fd06716f640 1 -- 172.21.15.19:0/893800685 >> 172.21.15.19:0/893800685 conn(0x7fd06006c030 msgr2=0x7fd06015dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:21.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.620+0000 7fd06716f640 1 -- 172.21.15.19:0/893800685 shutdown_connections 2024-09-12T02:01:21.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.620+0000 7fd06716f640 1 -- 172.21.15.19:0/893800685 wait complete. 2024-09-12T02:01:21.631 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:01:21.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.733+0000 7fbecdb49640 1 Processor -- start 2024-09-12T02:01:21.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.733+0000 7fbecdb49640 1 -- start start 2024-09-12T02:01:21.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.734+0000 7fbecdb49640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbec815b300 0x7fbec80cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.734+0000 7fbecdb49640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbec80cd3f0 0x7fbec806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.734+0000 7fbecdb49640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec80cdbe0 con 0x7fbec8072d30 2024-09-12T02:01:21.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.734+0000 7fbecdb49640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fbec80728a0 con 0x7fbec815b300 2024-09-12T02:01:21.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.734+0000 7fbecdb49640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbec80cd900 con 0x7fbec80cd3f0 2024-09-12T02:01:21.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.734+0000 7fbec77fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbec815b300 0x7fbec80cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.734+0000 7fbebeffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbec80cd3f0 0x7fbec806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.734+0000 7fbec7fff640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fbec8072d30 0x7fbec80b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:43198/0 (socket says 172.21.15.19:43198) 2024-09-12T02:01:21.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.734+0000 7fbec7fff640 1 -- 172.21.15.19:0/3521225358 learned_addr learned my addr 172.21.15.19:0/3521225358 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:21.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.735+0000 7fbec77fe640 1 -- 172.21.15.19:0/3521225358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbec80cd3f0 msgr2=0x7fbec806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:21.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.735+0000 7fbec77fe640 1 --2- 172.21.15.19:0/3521225358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbec80cd3f0 0x7fbec806f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.735+0000 7fbec77fe640 1 -- 172.21.15.19:0/3521225358 >> v1:172.21.15.135:6789/0 conn(0x7fbec8072d30 legacy=0x7fbec80b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:21.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.735+0000 7fbec77fe640 1 -- 172.21.15.19:0/3521225358 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec8072250 con 0x7fbec815b300 2024-09-12T02:01:21.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.735+0000 7fbec6ffd640 1 -- 172.21.15.19:0/3521225358 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2908146933 0 0) 0x7fbec80cdbe0 con 0x7fbec8072d30 2024-09-12T02:01:21.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.735+0000 7fbebeffd640 1 --2- 172.21.15.19:0/3521225358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbec80cd3f0 0x7fbec806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:21.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.735+0000 7fbec77fe640 1 --2- 172.21.15.19:0/3521225358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec815b300 0x7fbec80cceb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800ba40 tx=0x7fbeb802c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2c27ba611816ab8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:21.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.736+0000 7fbec6ffd640 1 -- 172.21.15.19:0/3521225358 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8032750 con 0x7fbec815b300 2024-09-12T02:01:21.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.736+0000 7fbec6ffd640 1 -- 172.21.15.19:0/3521225358 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb8030050 con 0x7fbec815b300 2024-09-12T02:01:21.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.736+0000 7fbec6ffd640 1 -- 172.21.15.19:0/3521225358 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8032b10 con 0x7fbec815b300 2024-09-12T02:01:21.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.736+0000 7fbecdb49640 1 -- 172.21.15.19:0/3521225358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec815b300 msgr2=0x7fbec80cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:21.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.736+0000 7fbecdb49640 1 --2- 172.21.15.19:0/3521225358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec815b300 0x7fbec80cceb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800ba40 tx=0x7fbeb802c850 comp rx=0 tx=0).stop 2024-09-12T02:01:21.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.736+0000 7fbecdb49640 1 -- 172.21.15.19:0/3521225358 shutdown_connections 2024-09-12T02:01:21.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.736+0000 7fbecdb49640 1 --2- 172.21.15.19:0/3521225358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbec80cd3f0 0x7fbec806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.736+0000 7fbecdb49640 1 --2- 172.21.15.19:0/3521225358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec815b300 0x7fbec80cceb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.736+0000 7fbecdb49640 1 -- 172.21.15.19:0/3521225358 >> 172.21.15.19:0/3521225358 conn(0x7fbec8067d70 msgr2=0x7fbec806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:21.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.736+0000 7fbecdb49640 1 -- 172.21.15.19:0/3521225358 shutdown_connections 2024-09-12T02:01:21.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.736+0000 7fbecdb49640 1 -- 172.21.15.19:0/3521225358 wait complete. 2024-09-12T02:01:21.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.737+0000 7fbecdb49640 1 Processor -- start 2024-09-12T02:01:21.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.738+0000 7fbecdb49640 1 -- start start 2024-09-12T02:01:21.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.738+0000 7fbecdb49640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec8072d30 0x7fbec81e7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.738+0000 7fbecdb49640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbec80cd3f0 0x7fbec81e5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.738+0000 7fbecdb49640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbec815b300 0x7fbec8153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.738+0000 7fbecdb49640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbec80d0160 con 0x7fbec815b300 2024-09-12T02:01:21.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.738+0000 7fbecdb49640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbec80cffe0 con 0x7fbec8072d30 2024-09-12T02:01:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.738+0000 7fbecdb49640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbec806f700 con 0x7fbec80cd3f0 2024-09-12T02:01:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.739+0000 7fbec7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbec815b300 0x7fbec8153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.739+0000 7fbec7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbec815b300 0x7fbec8153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35516/0 (socket says 172.21.15.19:35516) 2024-09-12T02:01:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.739+0000 7fbec7fff640 1 -- 172.21.15.19:0/4002209368 learned_addr learned my addr 172.21.15.19:0/4002209368 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.739+0000 7fbec77fe640 1 --2- 172.21.15.19:0/4002209368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec8072d30 0x7fbec81e7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.739+0000 7fbebeffd640 1 --2- 172.21.15.19:0/4002209368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbec80cd3f0 0x7fbec81e5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.739+0000 7fbec7fff640 1 -- 172.21.15.19:0/4002209368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbec80cd3f0 msgr2=0x7fbec81e5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.739+0000 7fbec7fff640 1 --2- 172.21.15.19:0/4002209368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbec80cd3f0 0x7fbec81e5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.739+0000 7fbec7fff640 1 -- 172.21.15.19:0/4002209368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec8072d30 msgr2=0x7fbec81e7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.739+0000 7fbec7fff640 1 --2- 172.21.15.19:0/4002209368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec8072d30 0x7fbec81e7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.739+0000 7fbec7fff640 1 -- 172.21.15.19:0/4002209368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec81e7c60 con 0x7fbec815b300 2024-09-12T02:01:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.739+0000 7fbec7fff640 1 --2- 172.21.15.19:0/4002209368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbec815b300 0x7fbec8153a10 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fbec000c7a0 tx=0x7fbec000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.739+0000 7fbec4ff9640 1 -- 172.21.15.19:0/4002209368 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec0018070 con 0x7fbec815b300 2024-09-12T02:01:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.739+0000 7fbec4ff9640 1 -- 172.21.15.19:0/4002209368 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec000a640 con 0x7fbec815b300 2024-09-12T02:01:21.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.739+0000 7fbecdb49640 1 -- 172.21.15.19:0/4002209368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec81e7f40 con 0x7fbec815b300 2024-09-12T02:01:21.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.739+0000 7fbec4ff9640 1 -- 172.21.15.19:0/4002209368 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec000aab0 con 0x7fbec815b300 2024-09-12T02:01:21.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.739+0000 7fbecdb49640 1 -- 172.21.15.19:0/4002209368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec8156730 con 0x7fbec815b300 2024-09-12T02:01:21.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.740+0000 7fbecdb49640 1 -- 172.21.15.19:0/4002209368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec8156930 con 0x7fbec815b300 2024-09-12T02:01:21.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.741+0000 7fbec4ff9640 1 -- 172.21.15.19:0/4002209368 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbec001b070 con 0x7fbec815b300 2024-09-12T02:01:21.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.741+0000 7fbec4ff9640 1 --2- 172.21.15.19:0/4002209368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbea806be30 0x7fbea806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:21.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.741+0000 7fbec4ff9640 1 -- 172.21.15.19:0/4002209368 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fbec008a580 con 0x7fbec815b300 2024-09-12T02:01:21.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.741+0000 7fbec77fe640 1 --2- 172.21.15.19:0/4002209368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbea806be30 0x7fbea806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:21.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.742+0000 7fbec77fe640 1 --2- 172.21.15.19:0/4002209368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbea806be30 0x7fbea806e2f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8037000 tx=0x7fbeb8032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:21.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.746+0000 7fbec4ff9640 1 -- 172.21.15.19:0/4002209368 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbec8156930 con 0x7fbec815b300 2024-09-12T02:01:21.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.957+0000 7fbecdb49640 1 -- 172.21.15.19:0/4002209368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbec81e8110 con 0x7fbec815b300 2024-09-12T02:01:21.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.957+0000 7fbec4ff9640 1 -- 172.21.15.19:0/4002209368 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) ==== 53+0+73 (secure 0 0 0) 0x7fbec0058750 con 0x7fbec815b300 2024-09-12T02:01:21.958 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:01:21.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.959+0000 7fbecdb49640 1 -- 172.21.15.19:0/4002209368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbea806be30 msgr2=0x7fbea806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:21.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.960+0000 7fbecdb49640 1 --2- 172.21.15.19:0/4002209368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbea806be30 0x7fbea806e2f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8037000 tx=0x7fbeb8032000 comp rx=0 tx=0).stop 2024-09-12T02:01:21.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.960+0000 7fbecdb49640 1 -- 172.21.15.19:0/4002209368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbec815b300 msgr2=0x7fbec8153a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:21.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.960+0000 7fbecdb49640 1 --2- 172.21.15.19:0/4002209368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbec815b300 0x7fbec8153a10 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fbec000c7a0 tx=0x7fbec000cc60 comp rx=0 tx=0).stop 2024-09-12T02:01:21.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.960+0000 7fbecdb49640 1 -- 172.21.15.19:0/4002209368 shutdown_connections 2024-09-12T02:01:21.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.960+0000 7fbecdb49640 1 --2- 172.21.15.19:0/4002209368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbea806be30 0x7fbea806e2f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.960+0000 7fbecdb49640 1 --2- 172.21.15.19:0/4002209368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbec815b300 0x7fbec8153a10 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.960+0000 7fbecdb49640 1 --2- 172.21.15.19:0/4002209368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbec80cd3f0 0x7fbec81e5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.960+0000 7fbecdb49640 1 --2- 172.21.15.19:0/4002209368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec8072d30 0x7fbec81e7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:21.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.960+0000 7fbecdb49640 1 -- 172.21.15.19:0/4002209368 >> 172.21.15.19:0/4002209368 conn(0x7fbec8067d70 msgr2=0x7fbec806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:21.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.960+0000 7fbecdb49640 1 -- 172.21.15.19:0/4002209368 shutdown_connections 2024-09-12T02:01:21.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:21.960+0000 7fbecdb49640 1 -- 172.21.15.19:0/4002209368 wait complete. 2024-09-12T02:01:21.971 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:01:21.971 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:01:21.971 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T02:01:21.971 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:01:21.971 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:01:21.971 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:01:21.971 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:01:21.971 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:01:21.971 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:01:21.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:01:21.972 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T02:01:21.988 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:01:21.988 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:01:21.988 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:01:21.988 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:01:21.988 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T02:01:21.988 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:01:21.988 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:01:21.988 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:01:21.989 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T02:01:21.989 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:01:21.989 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:01:21.989 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T02:01:21.989 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:01:21.989 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:01:21.989 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T02:01:21.989 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:01:21.989 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42478sec preferred_lft 42478sec 2024-09-12T02:01:21.989 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T02:01:21.989 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:01:21.989 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:01:21.989 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:01:21.989 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T02:01:21.989 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:01:21.990 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T02:01:21.990 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:01:21.990 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:01:21.990 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T02:01:21.990 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:01:21.990 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:01:21.990 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:01:21.990 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T02:01:21.990 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:01:21.990 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:01:21.990 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:01:21.990 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T02:01:21.990 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:01:21.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:01:21.991 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:01:22.053 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T02:01:22.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:01:22.054 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T02:01:22.111 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T02:01:22.111 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:01:22.111 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:01:22.111 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:01:22.112 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:01:22.112 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:01:22.112 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T02:01:22.112 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:01:22.112 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:01:22.112 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:01:22.112 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T02:01:22.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:01:22.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:01:22.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:01:22.239 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T02:01:22.256 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:01:22.256 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:01:22.256 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:01:22.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:01:22.256 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T02:01:22.322 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:01:22.322 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:01:22.378 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:01:22.378 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:01:22.378 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:01:22.434 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:01:22.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:01:22.434 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:01:22.519 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:01:22.519 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:01:22.519 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:01:22.529 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:01:22.529 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:01:22.529 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:01:22.529 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:01:22.529 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:01:22.534 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:01:22.535 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:01:22.535 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:01:22.535 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:01:22.535 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:01:22.535 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T02:01:22.535 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T02:01:22.535 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T02:01:22.535 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:01:22.535 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:01:22.536 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:01:22.536 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:01:22.536 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:01:22.537 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:01:22.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:01:22.537 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:01:22.569 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:01:22.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:01:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:01:22.675 INFO:teuthology.orchestra.run.smithi019.stdout:client5699 2024-09-12T02:01:22.675 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:01:22.676 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:01:22.692 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:22.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.834+0000 7f0c7b3c4640 1 Processor -- start 2024-09-12T02:01:22.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.834+0000 7f0c7b3c4640 1 -- start start 2024-09-12T02:01:22.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.835+0000 7f0c7b3c4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c7415e740 0x7f0c740d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:22.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.835+0000 7f0c7b3c4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0c7409b690 0x7f0c7406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:22.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.835+0000 7f0c7b3c4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c740d0780 con 0x7f0c7406d4c0 2024-09-12T02:01:22.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.835+0000 7f0c7b3c4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f0c7415eb20 con 0x7f0c7415e740 2024-09-12T02:01:22.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.835+0000 7f0c7b3c4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0c7406d260 con 0x7f0c7409b690 2024-09-12T02:01:22.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.835+0000 7f0c79160640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c7415e740 0x7f0c740d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:22.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.835+0000 7f0c79160640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c7415e740 0x7f0c740d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35530/0 (socket says 172.21.15.19:35530) 2024-09-12T02:01:22.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.835+0000 7f0c79160640 1 -- 172.21.15.19:0/1299122891 learned_addr learned my addr 172.21.15.19:0/1299122891 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:22.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.836+0000 7f0c7895f640 1 --2- 172.21.15.19:0/1299122891 >> v2:172.21.15.135:3300/0 conn(0x7f0c7409b690 0x7f0c7406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:22.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.836+0000 7f0c79160640 1 -- 172.21.15.19:0/1299122891 >> v2:172.21.15.135:3300/0 conn(0x7f0c7409b690 msgr2=0x7f0c7406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:22.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.836+0000 7f0c79160640 1 --2- 172.21.15.19:0/1299122891 >> v2:172.21.15.135:3300/0 conn(0x7f0c7409b690 0x7f0c7406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:22.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.836+0000 7f0c79160640 1 -- 172.21.15.19:0/1299122891 >> v1:172.21.15.135:6789/0 conn(0x7f0c7406d4c0 legacy=0x7f0c7406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:22.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.836+0000 7f0c79160640 1 -- 172.21.15.19:0/1299122891 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c740d0a60 con 0x7f0c7415e740 2024-09-12T02:01:22.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.837+0000 7f0c79160640 1 --2- 172.21.15.19:0/1299122891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c7415e740 0x7f0c740d1540 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0c740691b0 tx=0x7f0c7002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b28dd7b034fbe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:22.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.837+0000 7f0c6bfff640 1 -- 172.21.15.19:0/1299122891 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c70037070 con 0x7f0c7415e740 2024-09-12T02:01:22.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.837+0000 7f0c6bfff640 1 -- 172.21.15.19:0/1299122891 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7002ae50 con 0x7f0c7415e740 2024-09-12T02:01:22.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.837+0000 7f0c6bfff640 1 -- 172.21.15.19:0/1299122891 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c70032860 con 0x7f0c7415e740 2024-09-12T02:01:22.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.837+0000 7f0c7b3c4640 1 -- 172.21.15.19:0/1299122891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c7415e740 msgr2=0x7f0c740d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:22.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.837+0000 7f0c7b3c4640 1 --2- 172.21.15.19:0/1299122891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c7415e740 0x7f0c740d1540 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0c740691b0 tx=0x7f0c7002a300 comp rx=0 tx=0).stop 2024-09-12T02:01:22.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.837+0000 7f0c7b3c4640 1 -- 172.21.15.19:0/1299122891 shutdown_connections 2024-09-12T02:01:22.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.837+0000 7f0c7b3c4640 1 --2- 172.21.15.19:0/1299122891 >> v2:172.21.15.135:3300/0 conn(0x7f0c7409b690 0x7f0c7406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:22.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.837+0000 7f0c7b3c4640 1 --2- 172.21.15.19:0/1299122891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c7415e740 0x7f0c740d1540 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:22.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.837+0000 7f0c7b3c4640 1 -- 172.21.15.19:0/1299122891 >> 172.21.15.19:0/1299122891 conn(0x7f0c740d23a0 msgr2=0x7f0c740d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:22.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.837+0000 7f0c7b3c4640 1 -- 172.21.15.19:0/1299122891 shutdown_connections 2024-09-12T02:01:22.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.837+0000 7f0c7b3c4640 1 -- 172.21.15.19:0/1299122891 wait complete. 2024-09-12T02:01:22.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.839+0000 7f0c7b3c4640 1 Processor -- start 2024-09-12T02:01:22.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.839+0000 7f0c7b3c4640 1 -- start start 2024-09-12T02:01:22.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.839+0000 7f0c7b3c4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7406d4c0 0x7f0c740b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:22.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.839+0000 7f0c7b3c4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c7409b690 0x7f0c740cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:22.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.839+0000 7f0c7b3c4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c7415e740 0x7f0c740cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:22.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.839+0000 7f0c7b3c4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7409bac0 con 0x7f0c7415e740 2024-09-12T02:01:22.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.839+0000 7f0c7b3c4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0c740d1020 con 0x7f0c7406d4c0 2024-09-12T02:01:22.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.839+0000 7f0c7b3c4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0c7406dfe0 con 0x7f0c7409b690 2024-09-12T02:01:22.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.840+0000 7f0c79961640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c7415e740 0x7f0c740cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:22.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.840+0000 7f0c79160640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7406d4c0 0x7f0c740b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:22.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.840+0000 7f0c79961640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c7415e740 0x7f0c740cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35542/0 (socket says 172.21.15.19:35542) 2024-09-12T02:01:22.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.840+0000 7f0c79961640 1 -- 172.21.15.19:0/196207216 learned_addr learned my addr 172.21.15.19:0/196207216 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:22.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.840+0000 7f0c7895f640 1 --2- 172.21.15.19:0/196207216 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c7409b690 0x7f0c740cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:22.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.840+0000 7f0c79961640 1 -- 172.21.15.19:0/196207216 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c7409b690 msgr2=0x7f0c740cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:22.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.840+0000 7f0c79961640 1 --2- 172.21.15.19:0/196207216 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c7409b690 0x7f0c740cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:22.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.840+0000 7f0c79961640 1 -- 172.21.15.19:0/196207216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7406d4c0 msgr2=0x7f0c740b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:22.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.840+0000 7f0c79961640 1 --2- 172.21.15.19:0/196207216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7406d4c0 0x7f0c740b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:22.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.840+0000 7f0c79961640 1 -- 172.21.15.19:0/196207216 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c740cba70 con 0x7f0c7415e740 2024-09-12T02:01:22.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.840+0000 7f0c79961640 1 --2- 172.21.15.19:0/196207216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c7415e740 0x7f0c740cb530 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00c6e0 tx=0x7f0c6c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:22.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.840+0000 7f0c69ffb640 1 -- 172.21.15.19:0/196207216 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c003b70 con 0x7f0c7415e740 2024-09-12T02:01:22.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.840+0000 7f0c69ffb640 1 -- 172.21.15.19:0/196207216 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c6c003d30 con 0x7f0c7415e740 2024-09-12T02:01:22.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.840+0000 7f0c7b3c4640 1 -- 172.21.15.19:0/196207216 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c740b7990 con 0x7f0c7415e740 2024-09-12T02:01:22.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.840+0000 7f0c69ffb640 1 -- 172.21.15.19:0/196207216 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c005310 con 0x7f0c7415e740 2024-09-12T02:01:22.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.841+0000 7f0c7b3c4640 1 -- 172.21.15.19:0/196207216 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c740b7f50 con 0x7f0c7415e740 2024-09-12T02:01:22.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.842+0000 7f0c7b3c4640 1 -- 172.21.15.19:0/196207216 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c7406cd20 con 0x7f0c7415e740 2024-09-12T02:01:22.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.842+0000 7f0c69ffb640 1 -- 172.21.15.19:0/196207216 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c6c0054b0 con 0x7f0c7415e740 2024-09-12T02:01:22.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.842+0000 7f0c69ffb640 1 --2- 172.21.15.19:0/196207216 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0c5806be60 0x7f0c5806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:22.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.843+0000 7f0c69ffb640 1 -- 172.21.15.19:0/196207216 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f0c6c08ae20 con 0x7f0c7415e740 2024-09-12T02:01:22.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.843+0000 7f0c79160640 1 --2- 172.21.15.19:0/196207216 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0c5806be60 0x7f0c5806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:22.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.843+0000 7f0c79160640 1 --2- 172.21.15.19:0/196207216 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0c5806be60 0x7f0c5806e320 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0c70034000 tx=0x7f0c7002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:22.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:22.847+0000 7f0c69ffb640 1 -- 172.21.15.19:0/196207216 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c6c058ec0 con 0x7f0c7415e740 2024-09-12T02:01:23.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.058+0000 7f0c7b3c4640 1 -- 172.21.15.19:0/196207216 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c7415cae0 con 0x7f0c7415e740 2024-09-12T02:01:23.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.059+0000 7f0c69ffb640 1 -- 172.21.15.19:0/196207216 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5228 (secure 0 0 0) 0x7f0c6c05d1c0 con 0x7f0c7415e740 2024-09-12T02:01:23.059 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:23.059 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":62,"btime":"2024-09-12T02:01:18:960990+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1065573429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1065573429},{"type":"v1","addr":"172.21.15.19:6835","nonce":1065573429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3905709264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":3905709264},{"type":"v1","addr":"172.21.15.135:6837","nonce":3905709264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6082,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/836344045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":836344045},{"type":"v1","addr":"172.21.15.19:6834","nonce":836344045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:01:16.289395+0000","modified":"2024-09-12T02:01:18.305545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6088":{"gid":6088,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/1796121402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1796121402},{"type":"v1","addr":"172.21.15.135:6836","nonce":1796121402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6088,"qdb_cluster":[6088]},"id":5}]} 2024-09-12T02:01:23.059 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 62 2024-09-12T02:01:23.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.061+0000 7f0c7b3c4640 1 -- 172.21.15.19:0/196207216 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0c5806be60 msgr2=0x7f0c5806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:23.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.061+0000 7f0c7b3c4640 1 --2- 172.21.15.19:0/196207216 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0c5806be60 0x7f0c5806e320 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0c70034000 tx=0x7f0c7002e000 comp rx=0 tx=0).stop 2024-09-12T02:01:23.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.061+0000 7f0c7b3c4640 1 -- 172.21.15.19:0/196207216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c7415e740 msgr2=0x7f0c740cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:23.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.061+0000 7f0c7b3c4640 1 --2- 172.21.15.19:0/196207216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c7415e740 0x7f0c740cb530 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00c6e0 tx=0x7f0c6c00cba0 comp rx=0 tx=0).stop 2024-09-12T02:01:23.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.061+0000 7f0c7b3c4640 1 -- 172.21.15.19:0/196207216 shutdown_connections 2024-09-12T02:01:23.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.061+0000 7f0c7b3c4640 1 --2- 172.21.15.19:0/196207216 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0c5806be60 0x7f0c5806e320 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:23.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.061+0000 7f0c7b3c4640 1 --2- 172.21.15.19:0/196207216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c7415e740 0x7f0c740cb530 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:23.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.061+0000 7f0c7b3c4640 1 --2- 172.21.15.19:0/196207216 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c7409b690 0x7f0c740cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:23.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.061+0000 7f0c7b3c4640 1 --2- 172.21.15.19:0/196207216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7406d4c0 0x7f0c740b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:23.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.061+0000 7f0c7b3c4640 1 -- 172.21.15.19:0/196207216 >> 172.21.15.19:0/196207216 conn(0x7f0c740d23a0 msgr2=0x7f0c740ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:23.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.061+0000 7f0c7b3c4640 1 -- 172.21.15.19:0/196207216 shutdown_connections 2024-09-12T02:01:23.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.061+0000 7f0c7b3c4640 1 -- 172.21.15.19:0/196207216 wait complete. 2024-09-12T02:01:23.072 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 5:0 true 2024-09-12T02:01:23.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.176+0000 7fee55dd8640 1 Processor -- start 2024-09-12T02:01:23.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.176+0000 7fee55dd8640 1 -- start start 2024-09-12T02:01:23.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.177+0000 7fee55dd8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fee500b5bb0 0x7fee50154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.177+0000 7fee55dd8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee500b4ce0 con 0x7fee5015f500 2024-09-12T02:01:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.177+0000 7fee55dd8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee500b3c40 con 0x7fee5006f910 2024-09-12T02:01:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.177+0000 7fee55dd8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fee500b3f20 con 0x7fee500b5bb0 2024-09-12T02:01:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.177+0000 7fee4ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fee500b5bb0 0x7fee50154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.177+0000 7fee4effd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fee5015f500 0x7fee500b54a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40940/0 (socket says 172.21.15.19:40940) 2024-09-12T02:01:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.177+0000 7fee4effd640 1 -- 172.21.15.19:0/2563783667 learned_addr learned my addr 172.21.15.19:0/2563783667 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.177+0000 7fee4ffff640 1 -- 172.21.15.19:0/2563783667 >> v1:172.21.15.135:6789/0 conn(0x7fee5006f910 legacy=0x7fee50070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.177+0000 7fee4ffff640 1 -- 172.21.15.19:0/2563783667 >> v1:172.21.15.19:6789/0 conn(0x7fee5015f500 legacy=0x7fee500b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.177+0000 7fee4ffff640 1 -- 172.21.15.19:0/2563783667 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee500b4200 con 0x7fee500b5bb0 2024-09-12T02:01:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.177+0000 7fee4e7fc640 1 -- 172.21.15.19:0/2563783667 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3498138441 0 0) 0x7fee500b4ce0 con 0x7fee5015f500 2024-09-12T02:01:23.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.178+0000 7fee4ffff640 1 --2- 172.21.15.19:0/2563783667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee500b5bb0 0x7fee50154ba0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fee48009d90 tx=0x7fee4802a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5ded9919bfbcca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:23.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.178+0000 7fee4e7fc640 1 -- 172.21.15.19:0/2563783667 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48007740 con 0x7fee500b5bb0 2024-09-12T02:01:23.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.178+0000 7fee4e7fc640 1 -- 172.21.15.19:0/2563783667 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee480078e0 con 0x7fee500b5bb0 2024-09-12T02:01:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.178+0000 7fee4e7fc640 1 -- 172.21.15.19:0/2563783667 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48007cb0 con 0x7fee500b5bb0 2024-09-12T02:01:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.179+0000 7fee55dd8640 1 -- 172.21.15.19:0/2563783667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee500b5bb0 msgr2=0x7fee50154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.179+0000 7fee55dd8640 1 --2- 172.21.15.19:0/2563783667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee500b5bb0 0x7fee50154ba0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fee48009d90 tx=0x7fee4802a580 comp rx=0 tx=0).stop 2024-09-12T02:01:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.179+0000 7fee55dd8640 1 -- 172.21.15.19:0/2563783667 shutdown_connections 2024-09-12T02:01:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.179+0000 7fee55dd8640 1 --2- 172.21.15.19:0/2563783667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee500b5bb0 0x7fee50154ba0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.179+0000 7fee55dd8640 1 -- 172.21.15.19:0/2563783667 >> 172.21.15.19:0/2563783667 conn(0x7fee50073530 msgr2=0x7fee5006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.179+0000 7fee55dd8640 1 -- 172.21.15.19:0/2563783667 shutdown_connections 2024-09-12T02:01:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.179+0000 7fee55dd8640 1 -- 172.21.15.19:0/2563783667 wait complete. 2024-09-12T02:01:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.180+0000 7fee55dd8640 1 Processor -- start 2024-09-12T02:01:23.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.180+0000 7fee55dd8640 1 -- start start 2024-09-12T02:01:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.181+0000 7fee55dd8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee5006f910 0x7fee501437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.181+0000 7fee55dd8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee500b5bb0 0x7fee50142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.181+0000 7fee55dd8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee5015f500 0x7fee5013fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.181+0000 7fee55dd8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fee5006fcf0 con 0x7fee5015f500 2024-09-12T02:01:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.181+0000 7fee55dd8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fee500b47c0 con 0x7fee500b5bb0 2024-09-12T02:01:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.181+0000 7fee55dd8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fee5006fe70 con 0x7fee5006f910 2024-09-12T02:01:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.181+0000 7fee4ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee5015f500 0x7fee5013fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.181+0000 7fee4ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee5015f500 0x7fee5013fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35560/0 (socket says 172.21.15.19:35560) 2024-09-12T02:01:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.181+0000 7fee4ffff640 1 -- 172.21.15.19:0/2498434600 learned_addr learned my addr 172.21.15.19:0/2498434600 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.181+0000 7fee4effd640 1 --2- 172.21.15.19:0/2498434600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee500b5bb0 0x7fee50142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.181+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/2498434600 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee5006f910 0x7fee501437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.181+0000 7fee4ffff640 1 -- 172.21.15.19:0/2498434600 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee5006f910 msgr2=0x7fee501437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.181+0000 7fee4ffff640 1 --2- 172.21.15.19:0/2498434600 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee5006f910 0x7fee501437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.181+0000 7fee4ffff640 1 -- 172.21.15.19:0/2498434600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee500b5bb0 msgr2=0x7fee50142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.181+0000 7fee4ffff640 1 --2- 172.21.15.19:0/2498434600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee500b5bb0 0x7fee50142d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.181+0000 7fee4ffff640 1 -- 172.21.15.19:0/2498434600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee50143e50 con 0x7fee5015f500 2024-09-12T02:01:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.181+0000 7fee4effd640 1 --2- 172.21.15.19:0/2498434600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee500b5bb0 0x7fee50142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.182+0000 7fee4ffff640 1 --2- 172.21.15.19:0/2498434600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee5015f500 0x7fee5013fa50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fee48009d90 tx=0x7fee48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.182+0000 7fee37fff640 1 -- 172.21.15.19:0/2498434600 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48040070 con 0x7fee5015f500 2024-09-12T02:01:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.182+0000 7fee37fff640 1 -- 172.21.15.19:0/2498434600 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee48031c40 con 0x7fee5015f500 2024-09-12T02:01:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.182+0000 7fee55dd8640 1 -- 172.21.15.19:0/2498434600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee50143280 con 0x7fee5015f500 2024-09-12T02:01:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.182+0000 7fee37fff640 1 -- 172.21.15.19:0/2498434600 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48003990 con 0x7fee5015f500 2024-09-12T02:01:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.182+0000 7fee55dd8640 1 -- 172.21.15.19:0/2498434600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee50140900 con 0x7fee5015f500 2024-09-12T02:01:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.183+0000 7fee55dd8640 1 -- 172.21.15.19:0/2498434600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee500b54a0 con 0x7fee5015f500 2024-09-12T02:01:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.183+0000 7fee37fff640 1 -- 172.21.15.19:0/2498434600 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee48039040 con 0x7fee5015f500 2024-09-12T02:01:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.184+0000 7fee37fff640 1 --2- 172.21.15.19:0/2498434600 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fee3c06be30 0x7fee3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.184+0000 7fee37fff640 1 -- 172.21.15.19:0/2498434600 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fee480ac060 con 0x7fee5015f500 2024-09-12T02:01:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.184+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/2498434600 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fee3c06be30 0x7fee3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.185+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/2498434600 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fee3c06be30 0x7fee3c06e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fee40007fd0 tx=0x7fee40009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:23.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.188+0000 7fee37fff640 1 -- 172.21.15.19:0/2498434600 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee4807a870 con 0x7fee5015f500 2024-09-12T02:01:23.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.434+0000 7fee55dd8640 1 -- 172.21.15.19:0/2498434600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "5:0", "val": "true"} v 0) -- 0x7fee5013ff90 con 0x7fee5015f500 2024-09-12T02:01:23.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.991+0000 7fee37fff640 1 -- 172.21.15.19:0/2498434600 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "5:0", "val": "true"}]=0 freezing mds.6088 v63) ==== 112+0+0 (secure 0 0 0) 0x7fee4807a170 con 0x7fee5015f500 2024-09-12T02:01:23.992 INFO:teuthology.orchestra.run.smithi019.stderr:freezing mds.6088 2024-09-12T02:01:23.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.993+0000 7fee55dd8640 1 -- 172.21.15.19:0/2498434600 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fee3c06be30 msgr2=0x7fee3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:23.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.993+0000 7fee55dd8640 1 --2- 172.21.15.19:0/2498434600 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fee3c06be30 0x7fee3c06e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fee40007fd0 tx=0x7fee40009040 comp rx=0 tx=0).stop 2024-09-12T02:01:23.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.993+0000 7fee55dd8640 1 -- 172.21.15.19:0/2498434600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee5015f500 msgr2=0x7fee5013fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:23.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.993+0000 7fee55dd8640 1 --2- 172.21.15.19:0/2498434600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee5015f500 0x7fee5013fa50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fee48009d90 tx=0x7fee48004a40 comp rx=0 tx=0).stop 2024-09-12T02:01:23.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.993+0000 7fee55dd8640 1 -- 172.21.15.19:0/2498434600 shutdown_connections 2024-09-12T02:01:23.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.993+0000 7fee55dd8640 1 --2- 172.21.15.19:0/2498434600 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fee3c06be30 0x7fee3c06e2f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:23.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.993+0000 7fee55dd8640 1 --2- 172.21.15.19:0/2498434600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee5015f500 0x7fee5013fa50 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:23.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.993+0000 7fee55dd8640 1 --2- 172.21.15.19:0/2498434600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee500b5bb0 0x7fee50142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:23.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.993+0000 7fee55dd8640 1 --2- 172.21.15.19:0/2498434600 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee5006f910 0x7fee501437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:23.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.993+0000 7fee55dd8640 1 -- 172.21.15.19:0/2498434600 >> 172.21.15.19:0/2498434600 conn(0x7fee50073530 msgr2=0x7fee5006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:23.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.994+0000 7fee55dd8640 1 -- 172.21.15.19:0/2498434600 shutdown_connections 2024-09-12T02:01:23.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:23.994+0000 7fee55dd8640 1 -- 172.21.15.19:0/2498434600 wait complete. 2024-09-12T02:01:24.007 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p a/{b,c}/d') 2024-09-12T02:01:24.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:01:24.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:01:24.080 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 flush journal 2024-09-12T02:01:24.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.185+0000 7f4aff511640 1 Processor -- start 2024-09-12T02:01:24.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.185+0000 7f4aff511640 1 -- start start 2024-09-12T02:01:24.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.186+0000 7f4aff511640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4af80d04d0 0x7f4af80d1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.186+0000 7f4aff511640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af80d0a10 con 0x7f4af815e110 2024-09-12T02:01:24.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.186+0000 7f4aff511640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af80d0cf0 con 0x7f4af80d3140 2024-09-12T02:01:24.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.186+0000 7f4aff511640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f4af80d1620 con 0x7f4af80d04d0 2024-09-12T02:01:24.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.186+0000 7f4afd2ad640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4af815e110 0x7f4af80d2a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40952/0 (socket says 172.21.15.19:40952) 2024-09-12T02:01:24.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.186+0000 7f4afd2ad640 1 -- 172.21.15.19:0/837823131 learned_addr learned my addr 172.21.15.19:0/837823131 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:24.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.186+0000 7f4afdaae640 1 --2- 172.21.15.19:0/837823131 >> v2:172.21.15.19:3300/0 conn(0x7f4af80d04d0 0x7f4af80d1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.187+0000 7f4aeffff640 1 -- 172.21.15.19:0/837823131 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2889836608 0 0) 0x7f4af80d0a10 con 0x7f4af815e110 2024-09-12T02:01:24.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.187+0000 7f4aeffff640 1 -- 172.21.15.19:0/837823131 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ae4003520 con 0x7f4af815e110 2024-09-12T02:01:24.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.187+0000 7f4afdaae640 1 -- 172.21.15.19:0/837823131 >> v1:172.21.15.135:6789/0 conn(0x7f4af80d3140 legacy=0x7f4af80cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:24.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.187+0000 7f4afdaae640 1 -- 172.21.15.19:0/837823131 >> v1:172.21.15.19:6789/0 conn(0x7f4af815e110 legacy=0x7f4af80d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:24.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.187+0000 7f4afdaae640 1 -- 172.21.15.19:0/837823131 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af80d0fd0 con 0x7f4af80d04d0 2024-09-12T02:01:24.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.187+0000 7f4afdaae640 1 --2- 172.21.15.19:0/837823131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af80d04d0 0x7f4af80d1ab0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009d90 tx=0x7f4af002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375473f435c05e3b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:24.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.188+0000 7f4aeffff640 1 -- 172.21.15.19:0/837823131 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0007740 con 0x7f4af80d04d0 2024-09-12T02:01:24.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.188+0000 7f4aeffff640 1 -- 172.21.15.19:0/837823131 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af00078e0 con 0x7f4af80d04d0 2024-09-12T02:01:24.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.188+0000 7f4aeffff640 1 -- 172.21.15.19:0/837823131 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0007cb0 con 0x7f4af80d04d0 2024-09-12T02:01:24.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.188+0000 7f4aff511640 1 -- 172.21.15.19:0/837823131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af80d04d0 msgr2=0x7f4af80d1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:24.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.188+0000 7f4aff511640 1 --2- 172.21.15.19:0/837823131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af80d04d0 0x7f4af80d1ab0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009d90 tx=0x7f4af002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.188+0000 7f4aff511640 1 -- 172.21.15.19:0/837823131 shutdown_connections 2024-09-12T02:01:24.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.188+0000 7f4aff511640 1 --2- 172.21.15.19:0/837823131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af80d04d0 0x7f4af80d1ab0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.188+0000 7f4aff511640 1 -- 172.21.15.19:0/837823131 >> 172.21.15.19:0/837823131 conn(0x7f4af808bfc0 msgr2=0x7f4af80d44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:24.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.188+0000 7f4aff511640 1 -- 172.21.15.19:0/837823131 shutdown_connections 2024-09-12T02:01:24.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.188+0000 7f4aff511640 1 -- 172.21.15.19:0/837823131 wait complete. 2024-09-12T02:01:24.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.189+0000 7f4aff511640 1 Processor -- start 2024-09-12T02:01:24.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.189+0000 7f4aff511640 1 -- start start 2024-09-12T02:01:24.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.190+0000 7f4aff511640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4af80d04d0 0x7f4af81f72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.190+0000 7f4aff511640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af80d3140 0x7f4af80b8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.190+0000 7f4aff511640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4af815e110 0x7f4af80b8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.190+0000 7f4aff511640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4af815e670 con 0x7f4af80d3140 2024-09-12T02:01:24.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.190+0000 7f4aff511640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4af815e4f0 con 0x7f4af80d04d0 2024-09-12T02:01:24.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.190+0000 7f4aff511640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4af815e7f0 con 0x7f4af815e110 2024-09-12T02:01:24.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.190+0000 7f4afcaac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af80d3140 0x7f4af80b8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.190+0000 7f4afcaac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af80d3140 0x7f4af80b8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35564/0 (socket says 172.21.15.19:35564) 2024-09-12T02:01:24.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.190+0000 7f4afcaac640 1 -- 172.21.15.19:0/2332384588 learned_addr learned my addr 172.21.15.19:0/2332384588 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:24.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.190+0000 7f4afd2ad640 1 --2- 172.21.15.19:0/2332384588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4af80d04d0 0x7f4af81f72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.190+0000 7f4afdaae640 1 --2- 172.21.15.19:0/2332384588 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4af815e110 0x7f4af80b8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.191+0000 7f4afcaac640 1 -- 172.21.15.19:0/2332384588 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4af815e110 msgr2=0x7f4af80b8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:24.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.191+0000 7f4afcaac640 1 --2- 172.21.15.19:0/2332384588 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4af815e110 0x7f4af80b8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.191+0000 7f4afcaac640 1 -- 172.21.15.19:0/2332384588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4af80d04d0 msgr2=0x7f4af81f72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:24.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.191+0000 7f4afcaac640 1 --2- 172.21.15.19:0/2332384588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4af80d04d0 0x7f4af81f72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.191+0000 7f4afcaac640 1 -- 172.21.15.19:0/2332384588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af81f77e0 con 0x7f4af80d3140 2024-09-12T02:01:24.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.191+0000 7f4afcaac640 1 --2- 172.21.15.19:0/2332384588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af80d3140 0x7f4af80b8340 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800c3f0 tx=0x7f4ae800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:24.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.191+0000 7f4aedffb640 1 -- 172.21.15.19:0/2332384588 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8017070 con 0x7f4af80d3140 2024-09-12T02:01:24.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.191+0000 7f4aedffb640 1 -- 172.21.15.19:0/2332384588 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae80052f0 con 0x7f4af80d3140 2024-09-12T02:01:24.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.191+0000 7f4aff511640 1 -- 172.21.15.19:0/2332384588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af81f4640 con 0x7f4af80d3140 2024-09-12T02:01:24.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.191+0000 7f4aedffb640 1 -- 172.21.15.19:0/2332384588 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8003830 con 0x7f4af80d3140 2024-09-12T02:01:24.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.191+0000 7f4aff511640 1 -- 172.21.15.19:0/2332384588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af81f4c00 con 0x7f4af80d3140 2024-09-12T02:01:24.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.193+0000 7f4aedffb640 1 -- 172.21.15.19:0/2332384588 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ae801a070 con 0x7f4af80d3140 2024-09-12T02:01:24.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.193+0000 7f4aedffb640 1 --2- 172.21.15.19:0/2332384588 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4adc06be30 0x7f4adc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.193+0000 7f4aedffb640 1 -- 172.21.15.19:0/2332384588 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f4ae808a280 con 0x7f4af80d3140 2024-09-12T02:01:24.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.193+0000 7f4afd2ad640 1 --2- 172.21.15.19:0/2332384588 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4adc06be30 0x7f4adc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.194+0000 7f4afd2ad640 1 --2- 172.21.15.19:0/2332384588 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4adc06be30 0x7f4adc06e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4af40011e0 tx=0x7f4af4007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:24.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.194+0000 7f4b022ac740 1 Processor -- start 2024-09-12T02:01:24.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.194+0000 7f4b022ac740 1 -- start start 2024-09-12T02:01:24.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.195+0000 7f4b022ac740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6af3920 0x55a0c6b390c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.195+0000 7f4b022ac740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6af10e0 0x55a0c6af3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.195+0000 7f4b022ac740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 0x55a0c6aee1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.195+0000 7f4b022ac740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a0c6a566f0 con 0x55a0c6af50b0 2024-09-12T02:01:24.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.195+0000 7f4b022ac740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a0c69fe330 con 0x55a0c6af3920 2024-09-12T02:01:24.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.195+0000 7f4b022ac740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55a0c6a526b0 con 0x55a0c6af10e0 2024-09-12T02:01:24.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.195+0000 7f4afdaae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 0x55a0c6aee1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.195+0000 7f4afdaae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 0x55a0c6aee1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35576/0 (socket says 172.21.15.19:35576) 2024-09-12T02:01:24.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.195+0000 7f4afdaae640 1 -- 172.21.15.19:0/997063918 learned_addr learned my addr 172.21.15.19:0/997063918 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:24.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.195+0000 7f4afd2ad640 1 --2- 172.21.15.19:0/997063918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6af3920 0x55a0c6b390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.195+0000 7f4afcaac640 1 --2- 172.21.15.19:0/997063918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6af10e0 0x55a0c6af3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.195+0000 7f4afdaae640 1 -- 172.21.15.19:0/997063918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6af10e0 msgr2=0x55a0c6af3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:24.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.195+0000 7f4afdaae640 1 --2- 172.21.15.19:0/997063918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6af10e0 0x55a0c6af3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.195+0000 7f4afdaae640 1 -- 172.21.15.19:0/997063918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6af3920 msgr2=0x55a0c6b390c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:24.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.195+0000 7f4afdaae640 1 --2- 172.21.15.19:0/997063918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6af3920 0x55a0c6b390c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.196+0000 7f4afdaae640 1 -- 172.21.15.19:0/997063918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0c6a240d0 con 0x55a0c6af50b0 2024-09-12T02:01:24.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.196+0000 7f4afd2ad640 1 --2- 172.21.15.19:0/997063918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6af3920 0x55a0c6b390c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:24.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.196+0000 7f4afcaac640 1 --2- 172.21.15.19:0/997063918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6af10e0 0x55a0c6af3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:24.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.196+0000 7f4afdaae640 1 --2- 172.21.15.19:0/997063918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 0x55a0c6aee1a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f4af002ace0 tx=0x7f4af002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48cfb69fd67fb9e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:24.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.196+0000 7f4ae2ffd640 1 -- 172.21.15.19:0/997063918 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0007970 con 0x55a0c6af50b0 2024-09-12T02:01:24.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.196+0000 7f4ae2ffd640 1 -- 172.21.15.19:0/997063918 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af0007b10 con 0x55a0c6af50b0 2024-09-12T02:01:24.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.196+0000 7f4ae2ffd640 1 -- 172.21.15.19:0/997063918 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af003b410 con 0x55a0c6af50b0 2024-09-12T02:01:24.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.196+0000 7f4b022ac740 1 -- 172.21.15.19:0/997063918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 msgr2=0x55a0c6aee1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:24.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.196+0000 7f4b022ac740 1 --2- 172.21.15.19:0/997063918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 0x55a0c6aee1a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f4af002ace0 tx=0x7f4af002e000 comp rx=0 tx=0).stop 2024-09-12T02:01:24.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.196+0000 7f4b022ac740 1 -- 172.21.15.19:0/997063918 shutdown_connections 2024-09-12T02:01:24.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.196+0000 7f4b022ac740 1 --2- 172.21.15.19:0/997063918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 0x55a0c6aee1a0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.196+0000 7f4b022ac740 1 --2- 172.21.15.19:0/997063918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6af10e0 0x55a0c6af3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.196+0000 7f4b022ac740 1 --2- 172.21.15.19:0/997063918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6af3920 0x55a0c6b390c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.196+0000 7f4b022ac740 1 -- 172.21.15.19:0/997063918 >> 172.21.15.19:0/997063918 conn(0x55a0c6af0370 msgr2=0x55a0c6b38590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:24.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.197+0000 7f4b022ac740 1 -- 172.21.15.19:0/997063918 shutdown_connections 2024-09-12T02:01:24.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.197+0000 7f4b022ac740 1 -- 172.21.15.19:0/997063918 wait complete. 2024-09-12T02:01:24.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.197+0000 7f4b022ac740 1 -- start start 2024-09-12T02:01:24.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.197+0000 7f4b022ac740 1 Processor -- start 2024-09-12T02:01:24.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.198+0000 7f4b022ac740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6af3920 0x55a0c6b1f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.198+0000 7f4b022ac740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 0x55a0c6b1da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.198+0000 7f4b022ac740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6b1dfd0 0x55a0c6b487d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.198+0000 7f4b022ac740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a0c6aef810 con 0x55a0c6af50b0 2024-09-12T02:01:24.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.198+0000 7f4b022ac740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a0c69df4f0 con 0x55a0c6b1dfd0 2024-09-12T02:01:24.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.198+0000 7f4b022ac740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55a0c6b398f0 con 0x55a0c6af3920 2024-09-12T02:01:24.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.198+0000 7f4b022ac740 10 client.0 _ll_register_callbacks cb 0x55a0c6a00b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:24.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.198+0000 7f4afcaac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 0x55a0c6b1da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.198+0000 7f4afcaac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 0x55a0c6b1da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35592/0 (socket says 172.21.15.19:35592) 2024-09-12T02:01:24.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.198+0000 7f4afcaac640 1 -- 172.21.15.19:0/2548124643 learned_addr learned my addr 172.21.15.19:0/2548124643 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:24.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.198+0000 7f4afdaae640 1 --2- 172.21.15.19:0/2548124643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6b1dfd0 0x55a0c6b487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.198+0000 7f4afd2ad640 1 --2- 172.21.15.19:0/2548124643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6af3920 0x55a0c6b1f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.198+0000 7f4afcaac640 1 -- 172.21.15.19:0/2548124643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6af3920 msgr2=0x55a0c6b1f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:24.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.198+0000 7f4afcaac640 1 --2- 172.21.15.19:0/2548124643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6af3920 0x55a0c6b1f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.198+0000 7f4afcaac640 1 -- 172.21.15.19:0/2548124643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6b1dfd0 msgr2=0x55a0c6b487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:24.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.198+0000 7f4afcaac640 1 --2- 172.21.15.19:0/2548124643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6b1dfd0 0x55a0c6b487d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.199+0000 7f4afcaac640 1 -- 172.21.15.19:0/2548124643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0c68337d0 con 0x55a0c6af50b0 2024-09-12T02:01:24.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.199+0000 7f4afcaac640 1 --2- 172.21.15.19:0/2548124643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 0x55a0c6b1da90 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8058130 tx=0x7f4ae8058580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935c4c4e53bc9ce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:24.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.199+0000 7f4ad7fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:01:24.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.199+0000 7f4ad7fff640 1 -- 172.21.15.19:0/2548124643 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8070380 con 0x55a0c6af50b0 2024-09-12T02:01:24.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.199+0000 7f4ad7fff640 1 -- 172.21.15.19:0/2548124643 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f4ae8057880 con 0x55a0c6af50b0 2024-09-12T02:01:24.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.199+0000 7f4b022ac740 1 -- 172.21.15.19:0/2548124643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4af0007b10 con 0x55a0c6af50b0 2024-09-12T02:01:24.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.199+0000 7f4ad7fff640 1 -- 172.21.15.19:0/2548124643 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f4ae8057a80 con 0x55a0c6af50b0 2024-09-12T02:01:24.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.199+0000 7f4b022ac740 10 client.6651 fetch_fsmap learned FSMap version 63 2024-09-12T02:01:24.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.199+0000 7f4b022ac740 1 -- 172.21.15.19:0/2548124643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x55a0c67693f0 con 0x55a0c6af50b0 2024-09-12T02:01:24.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.199+0000 7f4ad7fff640 1 -- 172.21.15.19:0/2548124643 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af0007b10 con 0x55a0c6af50b0 2024-09-12T02:01:24.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.199+0000 7f4ad7fff640 1 -- 172.21.15.19:0/2548124643 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7f4ae8088120 con 0x55a0c6af50b0 2024-09-12T02:01:24.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.199+0000 7f4b022ac740 10 client.6651 fetch_fsmap finished waiting for FSMap version 63 2024-09-12T02:01:24.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.199+0000 7f4b022ac740 10 client.6651 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-09-12T02:01:24.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.199+0000 7f4b022ac740 20 client.6651 populate_metadata read hostname 'smithi019' 2024-09-12T02:01:24.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.199+0000 7f4b022ac740 1 --2- 172.21.15.19:0/2548124643 >> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] conn(0x55a0c6b1b7d0 0x55a0c6b0cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.199+0000 7f4b022ac740 4 client.6651 mds_command: new command op to 6088 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:01:24.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.199+0000 7f4b022ac740 1 -- 172.21.15.19:0/2548124643 --> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0c6a63e20 con 0x55a0c6b1b7d0 2024-09-12T02:01:24.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.200+0000 7f4afd2ad640 1 --2- 172.21.15.19:0/2548124643 >> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] conn(0x55a0c6b1b7d0 0x55a0c6b0cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.200+0000 7f4afd2ad640 1 --2- 172.21.15.19:0/2548124643 >> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] conn(0x55a0c6b1b7d0 0x55a0c6b0cc60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8abe47af79e5ae2 server_cookie=8af57be5c95e9aeb in_seq=0 out_seq=0 2024-09-12T02:01:24.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.200+0000 7f4ad7fff640 10 client.6651 ms_handle_connect on v2:172.21.15.135:6834/1796121402 2024-09-12T02:01:24.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.201+0000 7f4ad7fff640 1 -- 172.21.15.19:0/2548124643 <== mds.0 v2:172.21.15.135:6834/1796121402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0c6a63e20 con 0x55a0c6b1b7d0 2024-09-12T02:01:24.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.201+0000 7f4ad7fff640 10 client.6651 handle_command_reply: tid=0 2024-09-12T02:01:24.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.201+0000 7f4b022ac740 1 client.6651 shutdown 2024-09-12T02:01:24.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.201+0000 7f4b022ac740 1 -- 172.21.15.19:0/2548124643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 msgr2=0x55a0c6b1da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:24.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.201+0000 7f4b022ac740 1 --2- 172.21.15.19:0/2548124643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 0x55a0c6b1da90 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8058130 tx=0x7f4ae8058580 comp rx=0 tx=0).stop 2024-09-12T02:01:24.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.201+0000 7f4b022ac740 1 -- 172.21.15.19:0/2548124643 shutdown_connections 2024-09-12T02:01:24.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.201+0000 7f4b022ac740 1 --2- 172.21.15.19:0/2548124643 >> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] conn(0x55a0c6b1b7d0 0x55a0c6b0cc60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.201+0000 7f4b022ac740 1 --2- 172.21.15.19:0/2548124643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6b1dfd0 0x55a0c6b487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.201+0000 7f4b022ac740 1 --2- 172.21.15.19:0/2548124643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 0x55a0c6b1da90 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.201+0000 7f4b022ac740 1 --2- 172.21.15.19:0/2548124643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6af3920 0x55a0c6b1f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.201+0000 7f4ad7fff640 0 client.6651 ms_handle_reset on v2:172.21.15.135:6834/1796121402 2024-09-12T02:01:24.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.201+0000 7f4b022ac740 1 -- 172.21.15.19:0/2548124643 >> 172.21.15.19:0/2548124643 conn(0x55a0c6af10e0 msgr2=0x55a0c6b37630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:24.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.201+0000 7f4b022ac740 1 -- 172.21.15.19:0/2548124643 shutdown_connections 2024-09-12T02:01:24.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.201+0000 7f4b022ac740 1 -- 172.21.15.19:0/2548124643 wait complete. 2024-09-12T02:01:24.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.201+0000 7f4b022ac740 20 client.6651 trim_cache size 0 max 16384 2024-09-12T02:01:24.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.216+0000 7f4b022ac740 1 Processor -- start 2024-09-12T02:01:24.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.216+0000 7f4b022ac740 1 -- start start 2024-09-12T02:01:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.216+0000 7f4b022ac740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af3920 0x55a0c6b355e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.216+0000 7f4b022ac740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6af50b0 0x55a0c6b35b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.216+0000 7f4b022ac740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6b1dfd0 0x55a0c6b0b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.216+0000 7f4b022ac740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4af8201020 con 0x55a0c6af3920 2024-09-12T02:01:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.216+0000 7f4b022ac740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4af8200000 con 0x55a0c6b1dfd0 2024-09-12T02:01:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.216+0000 7f4b022ac740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4af81f8800 con 0x55a0c6af50b0 2024-09-12T02:01:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.216+0000 7f4afd2ad640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af3920 0x55a0c6b355e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.216+0000 7f4afd2ad640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af3920 0x55a0c6b355e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35608/0 (socket says 172.21.15.19:35608) 2024-09-12T02:01:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.216+0000 7f4afd2ad640 1 -- 172.21.15.19:0/764307419 learned_addr learned my addr 172.21.15.19:0/764307419 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.217+0000 7f4afdaae640 1 --2- 172.21.15.19:0/764307419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6b1dfd0 0x55a0c6b0b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.217+0000 7f4afcaac640 1 --2- 172.21.15.19:0/764307419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6af50b0 0x55a0c6b35b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.217+0000 7f4afd2ad640 1 -- 172.21.15.19:0/764307419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6af50b0 msgr2=0x55a0c6b35b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.217+0000 7f4afd2ad640 1 --2- 172.21.15.19:0/764307419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6af50b0 0x55a0c6b35b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.217+0000 7f4afd2ad640 1 -- 172.21.15.19:0/764307419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6b1dfd0 msgr2=0x55a0c6b0b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.217+0000 7f4afd2ad640 1 --2- 172.21.15.19:0/764307419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6b1dfd0 0x55a0c6b0b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.217+0000 7f4afd2ad640 1 -- 172.21.15.19:0/764307419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0c67290f0 con 0x55a0c6af3920 2024-09-12T02:01:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.217+0000 7f4afd2ad640 1 --2- 172.21.15.19:0/764307419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af3920 0x55a0c6b355e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f4af4000f60 tx=0x7f4af400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44fc7b13242f814 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.217+0000 7f4ae27fc640 1 -- 172.21.15.19:0/764307419 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af4005ce0 con 0x55a0c6af3920 2024-09-12T02:01:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.217+0000 7f4ae27fc640 1 -- 172.21.15.19:0/764307419 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af401b040 con 0x55a0c6af3920 2024-09-12T02:01:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.217+0000 7f4ae27fc640 1 -- 172.21.15.19:0/764307419 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af40064c0 con 0x55a0c6af3920 2024-09-12T02:01:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.218+0000 7f4b022ac740 1 -- 172.21.15.19:0/764307419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af3920 msgr2=0x55a0c6b355e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.218+0000 7f4b022ac740 1 --2- 172.21.15.19:0/764307419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af3920 0x55a0c6b355e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f4af4000f60 tx=0x7f4af400a000 comp rx=0 tx=0).stop 2024-09-12T02:01:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.218+0000 7f4b022ac740 1 -- 172.21.15.19:0/764307419 shutdown_connections 2024-09-12T02:01:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.218+0000 7f4b022ac740 1 --2- 172.21.15.19:0/764307419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6b1dfd0 0x55a0c6b0b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.218+0000 7f4b022ac740 1 --2- 172.21.15.19:0/764307419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6af50b0 0x55a0c6b35b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.218+0000 7f4b022ac740 1 --2- 172.21.15.19:0/764307419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af3920 0x55a0c6b355e0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.218+0000 7f4b022ac740 1 -- 172.21.15.19:0/764307419 >> 172.21.15.19:0/764307419 conn(0x55a0c6af10e0 msgr2=0x55a0c6b36540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:24.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.218+0000 7f4b022ac740 1 -- 172.21.15.19:0/764307419 shutdown_connections 2024-09-12T02:01:24.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.218+0000 7f4b022ac740 1 -- 172.21.15.19:0/764307419 wait complete. 2024-09-12T02:01:24.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.218+0000 7f4b022ac740 1 -- start start 2024-09-12T02:01:24.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.218+0000 7f4b022ac740 1 Processor -- start 2024-09-12T02:01:24.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.219+0000 7f4b022ac740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6af3920 0x55a0c6bacd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.219+0000 7f4b022ac740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 0x55a0c6b5b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.219+0000 7f4b022ac740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6b1dfd0 0x55a0c6b0b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.219+0000 7f4b022ac740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a0c6af3540 con 0x55a0c6af50b0 2024-09-12T02:01:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.219+0000 7f4b022ac740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a0c6b3a390 con 0x55a0c6af3920 2024-09-12T02:01:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.219+0000 7f4b022ac740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55a0c6b22150 con 0x55a0c6b1dfd0 2024-09-12T02:01:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.219+0000 7f4b022ac740 10 client.0 _ll_register_callbacks cb 0x7f4ae8057f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.219+0000 7f4afcaac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 0x55a0c6b5b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.219+0000 7f4afcaac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 0x55a0c6b5b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35622/0 (socket says 172.21.15.19:35622) 2024-09-12T02:01:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.219+0000 7f4afcaac640 1 -- 172.21.15.19:0/2267565199 learned_addr learned my addr 172.21.15.19:0/2267565199 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.219+0000 7f4afd2ad640 1 --2- 172.21.15.19:0/2267565199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6af3920 0x55a0c6bacd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.219+0000 7f4afdaae640 1 --2- 172.21.15.19:0/2267565199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6b1dfd0 0x55a0c6b0b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4afcaac640 1 -- 172.21.15.19:0/2267565199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6b1dfd0 msgr2=0x55a0c6b0b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4afcaac640 1 --2- 172.21.15.19:0/2267565199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6b1dfd0 0x55a0c6b0b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4afcaac640 1 -- 172.21.15.19:0/2267565199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6af3920 msgr2=0x55a0c6bacd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:24.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4afcaac640 1 --2- 172.21.15.19:0/2267565199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6af3920 0x55a0c6bacd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4afcaac640 1 -- 172.21.15.19:0/2267565199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0c6b36ae0 con 0x55a0c6af50b0 2024-09-12T02:01:24.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4afd2ad640 1 --2- 172.21.15.19:0/2267565199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6af3920 0x55a0c6bacd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:24.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4afcaac640 1 --2- 172.21.15.19:0/2267565199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 0x55a0c6b5b250 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8060a30 tx=0x7f4ae80884d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4988f4845711d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:24.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4ad7fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:01:24.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4ad7fff640 1 -- 172.21.15.19:0/2267565199 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8054390 con 0x55a0c6af50b0 2024-09-12T02:01:24.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4ad7fff640 1 -- 172.21.15.19:0/2267565199 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f4ae80572f0 con 0x55a0c6af50b0 2024-09-12T02:01:24.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4b022ac740 1 -- 172.21.15.19:0/2267565199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4af401b040 con 0x55a0c6af50b0 2024-09-12T02:01:24.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4ad7fff640 1 -- 172.21.15.19:0/2267565199 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f4ae8077370 con 0x55a0c6af50b0 2024-09-12T02:01:24.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4b022ac740 10 client.6657 fetch_fsmap learned FSMap version 63 2024-09-12T02:01:24.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4b022ac740 1 -- 172.21.15.19:0/2267565199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x55a0c6b36ae0 con 0x55a0c6af50b0 2024-09-12T02:01:24.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4ad7fff640 1 -- 172.21.15.19:0/2267565199 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af401b040 con 0x55a0c6af50b0 2024-09-12T02:01:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4ad7fff640 1 -- 172.21.15.19:0/2267565199 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7f4ae8077050 con 0x55a0c6af50b0 2024-09-12T02:01:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4b022ac740 10 client.6657 fetch_fsmap finished waiting for FSMap version 63 2024-09-12T02:01:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4b022ac740 10 client.6657 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-09-12T02:01:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4b022ac740 20 client.6657 populate_metadata read hostname 'smithi019' 2024-09-12T02:01:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4b022ac740 1 --2- 172.21.15.19:0/2267565199 >> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] conn(0x55a0c6b0bd30 0x55a0c6b3c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4b022ac740 4 client.6657 mds_command: new command op to 6088 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:01:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.220+0000 7f4b022ac740 1 -- 172.21.15.19:0/2267565199 --> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a0c6a5e170 con 0x55a0c6b0bd30 2024-09-12T02:01:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.221+0000 7f4afd2ad640 1 --2- 172.21.15.19:0/2267565199 >> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] conn(0x55a0c6b0bd30 0x55a0c6b3c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.221+0000 7f4afd2ad640 1 --2- 172.21.15.19:0/2267565199 >> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] conn(0x55a0c6b0bd30 0x55a0c6b3c210 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5b0e637eaf4f1ee server_cookie=95e518088f87b141 in_seq=0 out_seq=0 2024-09-12T02:01:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.221+0000 7f4ad7fff640 10 client.6657 ms_handle_connect on v2:172.21.15.135:6834/1796121402 2024-09-12T02:01:24.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.240+0000 7f4ad7fff640 1 -- 172.21.15.19:0/2267565199 <== mds.0 v2:172.21.15.135:6834/1796121402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a0c6a5e170 con 0x55a0c6b0bd30 2024-09-12T02:01:24.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.240+0000 7f4ad7fff640 10 client.6657 handle_command_reply: tid=0 2024-09-12T02:01:24.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.240+0000 7f4b022ac740 1 client.6657 shutdown 2024-09-12T02:01:24.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.240+0000 7f4b022ac740 1 -- 172.21.15.19:0/2267565199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 msgr2=0x55a0c6b5b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:24.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.240+0000 7f4b022ac740 1 --2- 172.21.15.19:0/2267565199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 0x55a0c6b5b250 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8060a30 tx=0x7f4ae80884d0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.240+0000 7f4b022ac740 1 -- 172.21.15.19:0/2267565199 shutdown_connections 2024-09-12T02:01:24.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.240+0000 7f4b022ac740 1 --2- 172.21.15.19:0/2267565199 >> [v2:172.21.15.135:6834/1796121402,v1:172.21.15.135:6836/1796121402] conn(0x55a0c6b0bd30 0x55a0c6b3c210 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.240+0000 7f4b022ac740 1 --2- 172.21.15.19:0/2267565199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0c6b1dfd0 0x55a0c6b0b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.240+0000 7f4ad7fff640 0 client.6657 ms_handle_reset on v2:172.21.15.135:6834/1796121402 2024-09-12T02:01:24.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.240+0000 7f4b022ac740 1 --2- 172.21.15.19:0/2267565199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0c6af50b0 0x55a0c6b5b250 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.240+0000 7f4b022ac740 1 --2- 172.21.15.19:0/2267565199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0c6af3920 0x55a0c6bacd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.240+0000 7f4b022ac740 1 -- 172.21.15.19:0/2267565199 >> 172.21.15.19:0/2267565199 conn(0x55a0c6af10e0 msgr2=0x55a0c6b355e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:24.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.240+0000 7f4b022ac740 1 -- 172.21.15.19:0/2267565199 shutdown_connections 2024-09-12T02:01:24.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.240+0000 7f4b022ac740 1 -- 172.21.15.19:0/2267565199 wait complete. 2024-09-12T02:01:24.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.240+0000 7f4b022ac740 20 client.6657 trim_cache size 0 max 16384 2024-09-12T02:01:24.242 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:01:24.242 INFO:teuthology.orchestra.run.smithi019.stdout: "message": "", 2024-09-12T02:01:24.242 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0 2024-09-12T02:01:24.242 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:01:24.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.241+0000 7f4aff511640 1 -- 172.21.15.19:0/2332384588 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4adc06be30 msgr2=0x7f4adc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:24.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.241+0000 7f4aff511640 1 --2- 172.21.15.19:0/2332384588 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4adc06be30 0x7f4adc06e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4af40011e0 tx=0x7f4af4007d30 comp rx=0 tx=0).stop 2024-09-12T02:01:24.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.241+0000 7f4aff511640 1 -- 172.21.15.19:0/2332384588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af80d3140 msgr2=0x7f4af80b8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:24.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.241+0000 7f4aff511640 1 --2- 172.21.15.19:0/2332384588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af80d3140 0x7f4af80b8340 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800c3f0 tx=0x7f4ae800c8b0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.241+0000 7f4aff511640 1 -- 172.21.15.19:0/2332384588 shutdown_connections 2024-09-12T02:01:24.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.241+0000 7f4aff511640 1 --2- 172.21.15.19:0/2332384588 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4adc06be30 0x7f4adc06e2f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.241+0000 7f4aff511640 1 --2- 172.21.15.19:0/2332384588 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4af815e110 0x7f4af80b8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.241+0000 7f4aff511640 1 --2- 172.21.15.19:0/2332384588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af80d3140 0x7f4af80b8340 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.241+0000 7f4aff511640 1 --2- 172.21.15.19:0/2332384588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4af80d04d0 0x7f4af81f72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.241+0000 7f4aff511640 1 -- 172.21.15.19:0/2332384588 >> 172.21.15.19:0/2332384588 conn(0x7f4af808bfc0 msgr2=0x7f4af8161000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:24.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.241+0000 7f4aff511640 1 -- 172.21.15.19:0/2332384588 shutdown_connections 2024-09-12T02:01:24.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.241+0000 7f4aff511640 1 -- 172.21.15.19:0/2332384588 wait complete. 2024-09-12T02:01:24.252 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_inject_rename_corrupt_dentry_first 1.0 2024-09-12T02:01:24.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.357+0000 7f31ccaac640 1 Processor -- start 2024-09-12T02:01:24.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.358+0000 7f31ccaac640 1 -- start start 2024-09-12T02:01:24.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.358+0000 7f31ccaac640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f31c8162340 0x7f31c806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.359+0000 7f31ccaac640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f31c80cf280 0x7f31c8162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.359+0000 7f31ccaac640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31c8162c60 0x7f31c80d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.359+0000 7f31ccaac640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f31c806de90 con 0x7f31c8162340 2024-09-12T02:01:24.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.359+0000 7f31ccaac640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f31c815ff70 con 0x7f31c80cf280 2024-09-12T02:01:24.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.359+0000 7f31ccaac640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f31c80d4d10 con 0x7f31c8162c60 2024-09-12T02:01:24.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.359+0000 7f31c659c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f31c8162340 0x7f31c806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.359+0000 7f31c659c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f31c8162340 0x7f31c806d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35638/0 (socket says 172.21.15.19:35638) 2024-09-12T02:01:24.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.359+0000 7f31c659c640 1 -- 172.21.15.19:0/1670073955 learned_addr learned my addr 172.21.15.19:0/1670073955 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:24.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.359+0000 7f31c5d9b640 1 --2- 172.21.15.19:0/1670073955 >> v2:172.21.15.135:3300/0 conn(0x7f31c80cf280 0x7f31c8162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.359+0000 7f31c6d9d640 1 --2- 172.21.15.19:0/1670073955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31c8162c60 0x7f31c80d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.359+0000 7f31c659c640 1 -- 172.21.15.19:0/1670073955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31c8162c60 msgr2=0x7f31c80d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:24.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.359+0000 7f31c659c640 1 --2- 172.21.15.19:0/1670073955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31c8162c60 0x7f31c80d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.359+0000 7f31c659c640 1 -- 172.21.15.19:0/1670073955 >> v2:172.21.15.135:3300/0 conn(0x7f31c80cf280 msgr2=0x7f31c8162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:24.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.359+0000 7f31c659c640 1 --2- 172.21.15.19:0/1670073955 >> v2:172.21.15.135:3300/0 conn(0x7f31c80cf280 0x7f31c8162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.359+0000 7f31c659c640 1 -- 172.21.15.19:0/1670073955 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c80d4ff0 con 0x7f31c8162340 2024-09-12T02:01:24.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.360+0000 7f31c659c640 1 --2- 172.21.15.19:0/1670073955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31c8162340 0x7f31c806d740 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f31c80a23d0 tx=0x7f31b802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b18012c5d976d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:24.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.360+0000 7f31c559a640 1 -- 172.21.15.19:0/1670073955 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8037070 con 0x7f31c8162340 2024-09-12T02:01:24.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.360+0000 7f31c559a640 1 -- 172.21.15.19:0/1670073955 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b8032440 con 0x7f31c8162340 2024-09-12T02:01:24.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.360+0000 7f31c559a640 1 -- 172.21.15.19:0/1670073955 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8032810 con 0x7f31c8162340 2024-09-12T02:01:24.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.360+0000 7f31ccaac640 1 -- 172.21.15.19:0/1670073955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31c8162340 msgr2=0x7f31c806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:24.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.360+0000 7f31ccaac640 1 --2- 172.21.15.19:0/1670073955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31c8162340 0x7f31c806d740 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f31c80a23d0 tx=0x7f31b802a140 comp rx=0 tx=0).stop 2024-09-12T02:01:24.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.361+0000 7f31ccaac640 1 -- 172.21.15.19:0/1670073955 shutdown_connections 2024-09-12T02:01:24.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.361+0000 7f31ccaac640 1 --2- 172.21.15.19:0/1670073955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31c8162c60 0x7f31c80d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.361+0000 7f31ccaac640 1 --2- 172.21.15.19:0/1670073955 >> v2:172.21.15.135:3300/0 conn(0x7f31c80cf280 0x7f31c8162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.361+0000 7f31ccaac640 1 --2- 172.21.15.19:0/1670073955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31c8162340 0x7f31c806d740 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.361+0000 7f31ccaac640 1 -- 172.21.15.19:0/1670073955 >> 172.21.15.19:0/1670073955 conn(0x7f31c808bfc0 msgr2=0x7f31c80d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:24.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.361+0000 7f31ccaac640 1 -- 172.21.15.19:0/1670073955 shutdown_connections 2024-09-12T02:01:24.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.361+0000 7f31ccaac640 1 -- 172.21.15.19:0/1670073955 wait complete. 2024-09-12T02:01:24.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.362+0000 7f31ccaac640 1 Processor -- start 2024-09-12T02:01:24.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.362+0000 7f31ccaac640 1 -- start start 2024-09-12T02:01:24.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31ccaac640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31c80cf280 0x7f31c80cd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31ccaac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31c8162340 0x7f31c80b9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31ccaac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c8162c60 0x7f31c80b9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31ccaac640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f31c80cf6c0 con 0x7f31c8162340 2024-09-12T02:01:24.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31ccaac640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f31c80d52d0 con 0x7f31c8162c60 2024-09-12T02:01:24.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31ccaac640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f31c81630f0 con 0x7f31c80cf280 2024-09-12T02:01:24.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31c5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31c8162340 0x7f31c80b9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31c5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31c8162340 0x7f31c80b9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35652/0 (socket says 172.21.15.19:35652) 2024-09-12T02:01:24.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31c5d9b640 1 -- 172.21.15.19:0/3047119971 learned_addr learned my addr 172.21.15.19:0/3047119971 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:24.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31c6d9d640 1 --2- 172.21.15.19:0/3047119971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c8162c60 0x7f31c80b9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31c659c640 1 --2- 172.21.15.19:0/3047119971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31c80cf280 0x7f31c80cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31c5d9b640 1 -- 172.21.15.19:0/3047119971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31c80cf280 msgr2=0x7f31c80cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:24.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31c5d9b640 1 --2- 172.21.15.19:0/3047119971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31c80cf280 0x7f31c80cd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31c5d9b640 1 -- 172.21.15.19:0/3047119971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c8162c60 msgr2=0x7f31c80b9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:24.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31c5d9b640 1 --2- 172.21.15.19:0/3047119971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c8162c60 0x7f31c80b9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31c5d9b640 1 -- 172.21.15.19:0/3047119971 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c80cc5f0 con 0x7f31c8162340 2024-09-12T02:01:24.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31c5d9b640 1 --2- 172.21.15.19:0/3047119971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31c8162340 0x7f31c80b9980 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00d830 tx=0x7f31bc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:24.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31b6ffd640 1 -- 172.21.15.19:0/3047119971 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0096a0 con 0x7f31c8162340 2024-09-12T02:01:24.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31b6ffd640 1 -- 172.21.15.19:0/3047119971 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31bc019070 con 0x7f31c8162340 2024-09-12T02:01:24.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31ccaac640 1 -- 172.21.15.19:0/3047119971 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c80cc8d0 con 0x7f31c8162340 2024-09-12T02:01:24.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.363+0000 7f31b6ffd640 1 -- 172.21.15.19:0/3047119971 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc009a60 con 0x7f31c8162340 2024-09-12T02:01:24.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.364+0000 7f31ccaac640 1 -- 172.21.15.19:0/3047119971 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c80cce90 con 0x7f31c8162340 2024-09-12T02:01:24.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.364+0000 7f31ccaac640 1 -- 172.21.15.19:0/3047119971 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31c80c7be0 con 0x7f31c8162340 2024-09-12T02:01:24.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.365+0000 7f31b6ffd640 1 -- 172.21.15.19:0/3047119971 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f31bc01e460 con 0x7f31c8162340 2024-09-12T02:01:24.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.365+0000 7f31b6ffd640 1 --2- 172.21.15.19:0/3047119971 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f31a806be30 0x7f31a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:24.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.365+0000 7f31b6ffd640 1 -- 172.21.15.19:0/3047119971 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f31bc08b5e0 con 0x7f31c8162340 2024-09-12T02:01:24.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.366+0000 7f31c659c640 1 --2- 172.21.15.19:0/3047119971 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f31a806be30 0x7f31a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:24.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.366+0000 7f31c659c640 1 --2- 172.21.15.19:0/3047119971 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f31a806be30 0x7f31a806e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f31b8034000 tx=0x7f31b802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:24.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.370+0000 7f31b6ffd640 1 -- 172.21.15.19:0/3047119971 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f31c80c7be0 con 0x7f31c8162340 2024-09-12T02:01:24.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.548+0000 7f31ccaac640 1 -- 172.21.15.19:0/3047119971 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_inject_rename_corrupt_dentry_first}] v 0) -- 0x7f31c808e640 con 0x7f31c8162340 2024-09-12T02:01:24.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.551+0000 7f31b6ffd640 1 -- 172.21.15.19:0/3047119971 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_inject_rename_corrupt_dentry_first}]=0 v23)=0 v23) ==== 138+0+0 (secure 0 0 0) 0x7f31bc059df0 con 0x7f31c8162340 2024-09-12T02:01:24.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.553+0000 7f31ccaac640 1 -- 172.21.15.19:0/3047119971 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f31a806be30 msgr2=0x7f31a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:24.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.553+0000 7f31ccaac640 1 --2- 172.21.15.19:0/3047119971 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f31a806be30 0x7f31a806e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f31b8034000 tx=0x7f31b802e000 comp rx=0 tx=0).stop 2024-09-12T02:01:24.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.553+0000 7f31ccaac640 1 -- 172.21.15.19:0/3047119971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31c8162340 msgr2=0x7f31c80b9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:24.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.553+0000 7f31ccaac640 1 --2- 172.21.15.19:0/3047119971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31c8162340 0x7f31c80b9980 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00d830 tx=0x7f31bc00dcf0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.554+0000 7f31ccaac640 1 -- 172.21.15.19:0/3047119971 shutdown_connections 2024-09-12T02:01:24.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.554+0000 7f31ccaac640 1 --2- 172.21.15.19:0/3047119971 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f31a806be30 0x7f31a806e2f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.554+0000 7f31ccaac640 1 --2- 172.21.15.19:0/3047119971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c8162c60 0x7f31c80b9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.554+0000 7f31ccaac640 1 --2- 172.21.15.19:0/3047119971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31c8162340 0x7f31c80b9980 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.554+0000 7f31ccaac640 1 --2- 172.21.15.19:0/3047119971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31c80cf280 0x7f31c80cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:24.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.554+0000 7f31ccaac640 1 -- 172.21.15.19:0/3047119971 >> 172.21.15.19:0/3047119971 conn(0x7f31c808bfc0 msgr2=0x7f31c8161ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:24.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.554+0000 7f31ccaac640 1 -- 172.21.15.19:0/3047119971 shutdown_connections 2024-09-12T02:01:24.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:24.554+0000 7f31ccaac640 1 -- 172.21.15.19:0/3047119971 wait complete. 2024-09-12T02:01:24.926 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:01:24.929 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:01:29.566 DEBUG:teuthology.orchestra.run.smithi019:> sudo daemon-helper kill ceph --cluster ceph -w 2024-09-12T02:01:29.640 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'timeout 60 mv a/b a/z') 2024-09-12T02:01:29.643 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2024-09-12T02:01:29.706 INFO:tasks.ceph.mds.b.smithi135.stderr:2024-09-12T02:01:29.706+0000 7f7a87c4c640 -1 mds.0.cache.den(0x10000000000 z) newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by request(client.5699:47 nref=7 cr=0x564458353c00)) (dversion lock w=1 last_client=5699) pv=11 v=10 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x564458261680] 2024-09-12T02:01:29.706 INFO:tasks.ceph.mds.b.smithi135.stderr:2024-09-12T02:01:29.706+0000 7f7a87c4c640 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by request(client.5699:47 nref=7 cr=0x564458353c00)) (dversion lock w=1 last_client=5699) pv=11 v=10 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x564458261680] 2024-09-12T02:01:29.707 INFO:tasks.ceph.mds.b.smithi135.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.1-298-gb53b6d3e/rpm/el9/BUILD/ceph-19.1.1-298-gb53b6d3e/src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7f7a87c4c640 time 2024-09-12T02:01:29.707669+0000 2024-09-12T02:01:29.707 INFO:tasks.ceph.mds.b.smithi135.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.1-298-gb53b6d3e/rpm/el9/BUILD/ceph-19.1.1-298-gb53b6d3e/src/mds/MDSRank.cc: 952: ceph_abort_msg("abort() called") 2024-09-12T02:01:29.707 INFO:tasks.ceph.mds.b.smithi135.stderr: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T02:01:29.707 INFO:tasks.ceph.mds.b.smithi135.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7f7a8d983417] 2024-09-12T02:01:29.707 INFO:tasks.ceph.mds.b.smithi135.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x56445490f2d1] 2024-09-12T02:01:29.707 INFO:tasks.ceph.mds.b.smithi135.stderr: 3: (CDentry::check_corruption(bool)+0x4d4) [0x564454b3a4e4] 2024-09-12T02:01:29.707 INFO:tasks.ceph.mds.b.smithi135.stderr: 4: ceph-mds(+0x1cb3e9) [0x5644549523e9] 2024-09-12T02:01:29.707 INFO:tasks.ceph.mds.b.smithi135.stderr: 5: (Server::_rename_prepare(boost::intrusive_ptr const&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x207f) [0x5644549dd2df] 2024-09-12T02:01:29.707 INFO:tasks.ceph.mds.b.smithi135.stderr: 6: (Server::handle_client_rename(boost::intrusive_ptr const&)+0x25e2) [0x5644549e05b2] 2024-09-12T02:01:29.707 INFO:tasks.ceph.mds.b.smithi135.stderr: 7: (Server::handle_client_request(boost::intrusive_ptr const&)+0x3e3) [0x5644549a6dc3] 2024-09-12T02:01:29.708 INFO:tasks.ceph.mds.b.smithi135.stderr: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x564454994cec] 2024-09-12T02:01:29.708 INFO:tasks.ceph.mds.b.smithi135.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x56445491689b] 2024-09-12T02:01:29.708 INFO:tasks.ceph.mds.b.smithi135.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564454916d6c] 2024-09-12T02:01:29.708 INFO:tasks.ceph.mds.b.smithi135.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1a6) [0x5644548fb286] 2024-09-12T02:01:29.708 INFO:tasks.ceph.mds.b.smithi135.stderr: 12: (DispatchQueue::entry()+0x4c2) [0x7f7a8db905c2] 2024-09-12T02:01:29.708 INFO:tasks.ceph.mds.b.smithi135.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x42a1d1) [0x7f7a8dc2a1d1] 2024-09-12T02:01:29.708 INFO:tasks.ceph.mds.b.smithi135.stderr: 14: /lib64/libc.so.6(+0x89c52) [0x7f7a8d089c52] 2024-09-12T02:01:29.708 INFO:tasks.ceph.mds.b.smithi135.stderr: 15: /lib64/libc.so.6(+0x10ec80) [0x7f7a8d10ec80] 2024-09-12T02:01:29.708 INFO:tasks.ceph.mds.b.smithi135.stderr:*** Caught signal (Aborted) ** 2024-09-12T02:01:29.708 INFO:tasks.ceph.mds.b.smithi135.stderr: in thread 7f7a87c4c640 thread_name:ms_dispatch 2024-09-12T02:01:29.708 INFO:tasks.ceph.mds.b.smithi135.stderr:2024-09-12T02:01:29.707+0000 7f7a87c4c640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.1-298-gb53b6d3e/rpm/el9/BUILD/ceph-19.1.1-298-gb53b6d3e/src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7f7a87c4c640 time 2024-09-12T02:01:29.707669+0000 2024-09-12T02:01:29.708 INFO:tasks.ceph.mds.b.smithi135.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.1-298-gb53b6d3e/rpm/el9/BUILD/ceph-19.1.1-298-gb53b6d3e/src/mds/MDSRank.cc: 952: ceph_abort_msg("abort() called") 2024-09-12T02:01:29.708 INFO:tasks.ceph.mds.b.smithi135.stderr: 2024-09-12T02:01:29.709 INFO:tasks.ceph.mds.b.smithi135.stderr: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T02:01:29.709 INFO:tasks.ceph.mds.b.smithi135.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7f7a8d983417] 2024-09-12T02:01:29.709 INFO:tasks.ceph.mds.b.smithi135.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x56445490f2d1] 2024-09-12T02:01:29.709 INFO:tasks.ceph.mds.b.smithi135.stderr: 3: (CDentry::check_corruption(bool)+0x4d4) [0x564454b3a4e4] 2024-09-12T02:01:29.709 INFO:tasks.ceph.mds.b.smithi135.stderr: 4: ceph-mds(+0x1cb3e9) [0x5644549523e9] 2024-09-12T02:01:29.709 INFO:tasks.ceph.mds.b.smithi135.stderr: 5: (Server::_rename_prepare(boost::intrusive_ptr const&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x207f) [0x5644549dd2df] 2024-09-12T02:01:29.709 INFO:tasks.ceph.mds.b.smithi135.stderr: 6: (Server::handle_client_rename(boost::intrusive_ptr const&)+0x25e2) [0x5644549e05b2] 2024-09-12T02:01:29.709 INFO:tasks.ceph.mds.b.smithi135.stderr: 7: (Server::handle_client_request(boost::intrusive_ptr const&)+0x3e3) [0x5644549a6dc3] 2024-09-12T02:01:29.709 INFO:tasks.ceph.mds.b.smithi135.stderr: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x564454994cec] 2024-09-12T02:01:29.709 INFO:tasks.ceph.mds.b.smithi135.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x56445491689b] 2024-09-12T02:01:29.709 INFO:tasks.ceph.mds.b.smithi135.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564454916d6c] 2024-09-12T02:01:29.709 INFO:tasks.ceph.mds.b.smithi135.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1a6) [0x5644548fb286] 2024-09-12T02:01:29.709 INFO:tasks.ceph.mds.b.smithi135.stderr: 12: (DispatchQueue::entry()+0x4c2) [0x7f7a8db905c2] 2024-09-12T02:01:29.710 INFO:tasks.ceph.mds.b.smithi135.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x42a1d1) [0x7f7a8dc2a1d1] 2024-09-12T02:01:29.710 INFO:tasks.ceph.mds.b.smithi135.stderr: 14: /lib64/libc.so.6(+0x89c52) [0x7f7a8d089c52] 2024-09-12T02:01:29.710 INFO:tasks.ceph.mds.b.smithi135.stderr: 15: /lib64/libc.so.6(+0x10ec80) [0x7f7a8d10ec80] 2024-09-12T02:01:29.710 INFO:tasks.ceph.mds.b.smithi135.stderr: 2024-09-12T02:01:29.710 INFO:tasks.ceph.mds.b.smithi135.stderr: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T02:01:29.710 INFO:tasks.ceph.mds.b.smithi135.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7a8d03e6f0] 2024-09-12T02:01:29.710 INFO:tasks.ceph.mds.b.smithi135.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7a8d08b99c] 2024-09-12T02:01:29.710 INFO:tasks.ceph.mds.b.smithi135.stderr: 3: raise() 2024-09-12T02:01:29.711 INFO:tasks.ceph.mds.b.smithi135.stderr: 4: abort() 2024-09-12T02:01:29.711 INFO:tasks.ceph.mds.b.smithi135.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7f7a8d9834d4] 2024-09-12T02:01:29.711 INFO:tasks.ceph.mds.b.smithi135.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x56445490f2d1] 2024-09-12T02:01:29.711 INFO:tasks.ceph.mds.b.smithi135.stderr: 7: (CDentry::check_corruption(bool)+0x4d4) [0x564454b3a4e4] 2024-09-12T02:01:29.711 INFO:tasks.ceph.mds.b.smithi135.stderr: 8: ceph-mds(+0x1cb3e9) [0x5644549523e9] 2024-09-12T02:01:29.711 INFO:tasks.ceph.mds.b.smithi135.stderr: 9: (Server::_rename_prepare(boost::intrusive_ptr const&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x207f) [0x5644549dd2df] 2024-09-12T02:01:29.711 INFO:tasks.ceph.mds.b.smithi135.stderr: 10: (Server::handle_client_rename(boost::intrusive_ptr const&)+0x25e2) [0x5644549e05b2] 2024-09-12T02:01:29.711 INFO:tasks.ceph.mds.b.smithi135.stderr: 11: (Server::handle_client_request(boost::intrusive_ptr const&)+0x3e3) [0x5644549a6dc3] 2024-09-12T02:01:29.711 INFO:tasks.ceph.mds.b.smithi135.stderr: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x564454994cec] 2024-09-12T02:01:29.711 INFO:tasks.ceph.mds.b.smithi135.stderr: 13: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x56445491689b] 2024-09-12T02:01:29.711 INFO:tasks.ceph.mds.b.smithi135.stderr: 14: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564454916d6c] 2024-09-12T02:01:29.711 INFO:tasks.ceph.mds.b.smithi135.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1a6) [0x5644548fb286] 2024-09-12T02:01:29.711 INFO:tasks.ceph.mds.b.smithi135.stderr: 16: (DispatchQueue::entry()+0x4c2) [0x7f7a8db905c2] 2024-09-12T02:01:29.712 INFO:tasks.ceph.mds.b.smithi135.stderr: 17: /usr/lib64/ceph/libceph-common.so.2(+0x42a1d1) [0x7f7a8dc2a1d1] 2024-09-12T02:01:29.712 INFO:tasks.ceph.mds.b.smithi135.stderr: 18: /lib64/libc.so.6(+0x89c52) [0x7f7a8d089c52] 2024-09-12T02:01:29.712 INFO:tasks.ceph.mds.b.smithi135.stderr: 19: /lib64/libc.so.6(+0x10ec80) [0x7f7a8d10ec80] 2024-09-12T02:01:29.712 INFO:tasks.ceph.mds.b.smithi135.stderr:2024-09-12T02:01:29.708+0000 7f7a87c4c640 -1 *** Caught signal (Aborted) ** 2024-09-12T02:01:29.712 INFO:tasks.ceph.mds.b.smithi135.stderr: in thread 7f7a87c4c640 thread_name:ms_dispatch 2024-09-12T02:01:29.712 INFO:tasks.ceph.mds.b.smithi135.stderr: 2024-09-12T02:01:29.712 INFO:tasks.ceph.mds.b.smithi135.stderr: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T02:01:29.712 INFO:tasks.ceph.mds.b.smithi135.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7a8d03e6f0] 2024-09-12T02:01:29.712 INFO:tasks.ceph.mds.b.smithi135.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7a8d08b99c] 2024-09-12T02:01:29.712 INFO:tasks.ceph.mds.b.smithi135.stderr: 3: raise() 2024-09-12T02:01:29.712 INFO:tasks.ceph.mds.b.smithi135.stderr: 4: abort() 2024-09-12T02:01:29.712 INFO:tasks.ceph.mds.b.smithi135.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7f7a8d9834d4] 2024-09-12T02:01:29.712 INFO:tasks.ceph.mds.b.smithi135.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x56445490f2d1] 2024-09-12T02:01:29.712 INFO:tasks.ceph.mds.b.smithi135.stderr: 7: (CDentry::check_corruption(bool)+0x4d4) [0x564454b3a4e4] 2024-09-12T02:01:29.713 INFO:tasks.ceph.mds.b.smithi135.stderr: 8: ceph-mds(+0x1cb3e9) [0x5644549523e9] 2024-09-12T02:01:29.713 INFO:tasks.ceph.mds.b.smithi135.stderr: 9: (Server::_rename_prepare(boost::intrusive_ptr const&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x207f) [0x5644549dd2df] 2024-09-12T02:01:29.713 INFO:tasks.ceph.mds.b.smithi135.stderr: 10: (Server::handle_client_rename(boost::intrusive_ptr const&)+0x25e2) [0x5644549e05b2] 2024-09-12T02:01:29.713 INFO:tasks.ceph.mds.b.smithi135.stderr: 11: (Server::handle_client_request(boost::intrusive_ptr const&)+0x3e3) [0x5644549a6dc3] 2024-09-12T02:01:29.713 INFO:tasks.ceph.mds.b.smithi135.stderr: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x564454994cec] 2024-09-12T02:01:29.713 INFO:tasks.ceph.mds.b.smithi135.stderr: 13: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x56445491689b] 2024-09-12T02:01:29.713 INFO:tasks.ceph.mds.b.smithi135.stderr: 14: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564454916d6c] 2024-09-12T02:01:29.713 INFO:tasks.ceph.mds.b.smithi135.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1a6) [0x5644548fb286] 2024-09-12T02:01:29.713 INFO:tasks.ceph.mds.b.smithi135.stderr: 16: (DispatchQueue::entry()+0x4c2) [0x7f7a8db905c2] 2024-09-12T02:01:29.713 INFO:tasks.ceph.mds.b.smithi135.stderr: 17: /usr/lib64/ceph/libceph-common.so.2(+0x42a1d1) [0x7f7a8dc2a1d1] 2024-09-12T02:01:29.713 INFO:tasks.ceph.mds.b.smithi135.stderr: 18: /lib64/libc.so.6(+0x89c52) [0x7f7a8d089c52] 2024-09-12T02:01:29.713 INFO:tasks.ceph.mds.b.smithi135.stderr: 19: /lib64/libc.so.6(+0x10ec80) [0x7f7a8d10ec80] 2024-09-12T02:01:29.713 INFO:tasks.ceph.mds.b.smithi135.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T02:01:29.714 INFO:tasks.ceph.mds.b.smithi135.stderr: 2024-09-12T02:01:29.714 INFO:tasks.ceph.mds.b.smithi135.stderr: -4845> 2024-09-12T02:01:18.959+0000 7f7a85447640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:01:29.718 INFO:tasks.ceph.mds.b.smithi135.stderr: -8> 2024-09-12T02:01:29.706+0000 7f7a87c4c640 -1 mds.0.cache.den(0x10000000000 z) newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by request(client.5699:47 nref=7 cr=0x564458353c00)) (dversion lock w=1 last_client=5699) pv=11 v=10 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x564458261680] 2024-09-12T02:01:29.718 INFO:tasks.ceph.mds.b.smithi135.stderr: -6> 2024-09-12T02:01:29.706+0000 7f7a87c4c640 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by request(client.5699:47 nref=7 cr=0x564458353c00)) (dversion lock w=1 last_client=5699) pv=11 v=10 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x564458261680] 2024-09-12T02:01:29.718 INFO:tasks.ceph.mds.b.smithi135.stderr: -1> 2024-09-12T02:01:29.707+0000 7f7a87c4c640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.1-298-gb53b6d3e/rpm/el9/BUILD/ceph-19.1.1-298-gb53b6d3e/src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7f7a87c4c640 time 2024-09-12T02:01:29.707669+0000 2024-09-12T02:01:29.718 INFO:tasks.ceph.mds.b.smithi135.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.1-298-gb53b6d3e/rpm/el9/BUILD/ceph-19.1.1-298-gb53b6d3e/src/mds/MDSRank.cc: 952: ceph_abort_msg("abort() called") 2024-09-12T02:01:29.718 INFO:tasks.ceph.mds.b.smithi135.stderr: 2024-09-12T02:01:29.719 INFO:tasks.ceph.mds.b.smithi135.stderr: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T02:01:29.719 INFO:tasks.ceph.mds.b.smithi135.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7f7a8d983417] 2024-09-12T02:01:29.719 INFO:tasks.ceph.mds.b.smithi135.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x56445490f2d1] 2024-09-12T02:01:29.719 INFO:tasks.ceph.mds.b.smithi135.stderr: 3: (CDentry::check_corruption(bool)+0x4d4) [0x564454b3a4e4] 2024-09-12T02:01:29.719 INFO:tasks.ceph.mds.b.smithi135.stderr: 4: ceph-mds(+0x1cb3e9) [0x5644549523e9] 2024-09-12T02:01:29.719 INFO:tasks.ceph.mds.b.smithi135.stderr: 5: (Server::_rename_prepare(boost::intrusive_ptr const&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x207f) [0x5644549dd2df] 2024-09-12T02:01:29.719 INFO:tasks.ceph.mds.b.smithi135.stderr: 6: (Server::handle_client_rename(boost::intrusive_ptr const&)+0x25e2) [0x5644549e05b2] 2024-09-12T02:01:29.719 INFO:tasks.ceph.mds.b.smithi135.stderr: 7: (Server::handle_client_request(boost::intrusive_ptr const&)+0x3e3) [0x5644549a6dc3] 2024-09-12T02:01:29.719 INFO:tasks.ceph.mds.b.smithi135.stderr: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x564454994cec] 2024-09-12T02:01:29.719 INFO:tasks.ceph.mds.b.smithi135.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x56445491689b] 2024-09-12T02:01:29.719 INFO:tasks.ceph.mds.b.smithi135.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564454916d6c] 2024-09-12T02:01:29.719 INFO:tasks.ceph.mds.b.smithi135.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1a6) [0x5644548fb286] 2024-09-12T02:01:29.719 INFO:tasks.ceph.mds.b.smithi135.stderr: 12: (DispatchQueue::entry()+0x4c2) [0x7f7a8db905c2] 2024-09-12T02:01:29.719 INFO:tasks.ceph.mds.b.smithi135.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x42a1d1) [0x7f7a8dc2a1d1] 2024-09-12T02:01:29.720 INFO:tasks.ceph.mds.b.smithi135.stderr: 14: /lib64/libc.so.6(+0x89c52) [0x7f7a8d089c52] 2024-09-12T02:01:29.720 INFO:tasks.ceph.mds.b.smithi135.stderr: 15: /lib64/libc.so.6(+0x10ec80) [0x7f7a8d10ec80] 2024-09-12T02:01:29.720 INFO:tasks.ceph.mds.b.smithi135.stderr: 2024-09-12T02:01:29.720 INFO:tasks.ceph.mds.b.smithi135.stderr: 0> 2024-09-12T02:01:29.708+0000 7f7a87c4c640 -1 *** Caught signal (Aborted) ** 2024-09-12T02:01:29.720 INFO:tasks.ceph.mds.b.smithi135.stderr: in thread 7f7a87c4c640 thread_name:ms_dispatch 2024-09-12T02:01:29.720 INFO:tasks.ceph.mds.b.smithi135.stderr: 2024-09-12T02:01:29.720 INFO:tasks.ceph.mds.b.smithi135.stderr: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T02:01:29.720 INFO:tasks.ceph.mds.b.smithi135.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7a8d03e6f0] 2024-09-12T02:01:29.720 INFO:tasks.ceph.mds.b.smithi135.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7a8d08b99c] 2024-09-12T02:01:29.720 INFO:tasks.ceph.mds.b.smithi135.stderr: 3: raise() 2024-09-12T02:01:29.720 INFO:tasks.ceph.mds.b.smithi135.stderr: 4: abort() 2024-09-12T02:01:29.720 INFO:tasks.ceph.mds.b.smithi135.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7f7a8d9834d4] 2024-09-12T02:01:29.720 INFO:tasks.ceph.mds.b.smithi135.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x56445490f2d1] 2024-09-12T02:01:29.720 INFO:tasks.ceph.mds.b.smithi135.stderr: 7: (CDentry::check_corruption(bool)+0x4d4) [0x564454b3a4e4] 2024-09-12T02:01:29.721 INFO:tasks.ceph.mds.b.smithi135.stderr: 8: ceph-mds(+0x1cb3e9) [0x5644549523e9] 2024-09-12T02:01:29.721 INFO:tasks.ceph.mds.b.smithi135.stderr: 9: (Server::_rename_prepare(boost::intrusive_ptr const&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x207f) [0x5644549dd2df] 2024-09-12T02:01:29.721 INFO:tasks.ceph.mds.b.smithi135.stderr: 10: (Server::handle_client_rename(boost::intrusive_ptr const&)+0x25e2) [0x5644549e05b2] 2024-09-12T02:01:29.721 INFO:tasks.ceph.mds.b.smithi135.stderr: 11: (Server::handle_client_request(boost::intrusive_ptr const&)+0x3e3) [0x5644549a6dc3] 2024-09-12T02:01:29.721 INFO:tasks.ceph.mds.b.smithi135.stderr: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x564454994cec] 2024-09-12T02:01:29.721 INFO:tasks.ceph.mds.b.smithi135.stderr: 13: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x56445491689b] 2024-09-12T02:01:29.721 INFO:tasks.ceph.mds.b.smithi135.stderr: 14: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564454916d6c] 2024-09-12T02:01:29.721 INFO:tasks.ceph.mds.b.smithi135.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1a6) [0x5644548fb286] 2024-09-12T02:01:29.721 INFO:tasks.ceph.mds.b.smithi135.stderr: 16: (DispatchQueue::entry()+0x4c2) [0x7f7a8db905c2] 2024-09-12T02:01:29.721 INFO:tasks.ceph.mds.b.smithi135.stderr: 17: /usr/lib64/ceph/libceph-common.so.2(+0x42a1d1) [0x7f7a8dc2a1d1] 2024-09-12T02:01:29.721 INFO:tasks.ceph.mds.b.smithi135.stderr: 18: /lib64/libc.so.6(+0x89c52) [0x7f7a8d089c52] 2024-09-12T02:01:29.722 INFO:tasks.ceph.mds.b.smithi135.stderr: 19: /lib64/libc.so.6(+0x10ec80) [0x7f7a8d10ec80] 2024-09-12T02:01:29.722 INFO:tasks.ceph.mds.b.smithi135.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T02:01:29.722 INFO:tasks.ceph.mds.b.smithi135.stderr: 2024-09-12T02:01:29.722 INFO:tasks.ceph.mds.b.smithi135.stderr: -4845> 2024-09-12T02:01:18.959+0000 7f7a85447640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:01:29.725 INFO:tasks.ceph.mds.b.smithi135.stderr: -8> 2024-09-12T02:01:29.706+0000 7f7a87c4c640 -1 mds.0.cache.den(0x10000000000 z) newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by request(client.5699:47 nref=7 cr=0x564458353c00)) (dversion lock w=1 last_client=5699) pv=11 v=10 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x564458261680] 2024-09-12T02:01:29.725 INFO:tasks.ceph.mds.b.smithi135.stderr: -6> 2024-09-12T02:01:29.706+0000 7f7a87c4c640 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by request(client.5699:47 nref=7 cr=0x564458353c00)) (dversion lock w=1 last_client=5699) pv=11 v=10 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x564458261680] 2024-09-12T02:01:29.725 INFO:tasks.ceph.mds.b.smithi135.stderr: -1> 2024-09-12T02:01:29.707+0000 7f7a87c4c640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.1-298-gb53b6d3e/rpm/el9/BUILD/ceph-19.1.1-298-gb53b6d3e/src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7f7a87c4c640 time 2024-09-12T02:01:29.707669+0000 2024-09-12T02:01:29.725 INFO:tasks.ceph.mds.b.smithi135.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.1-298-gb53b6d3e/rpm/el9/BUILD/ceph-19.1.1-298-gb53b6d3e/src/mds/MDSRank.cc: 952: ceph_abort_msg("abort() called") 2024-09-12T02:01:29.725 INFO:tasks.ceph.mds.b.smithi135.stderr: 2024-09-12T02:01:29.725 INFO:tasks.ceph.mds.b.smithi135.stderr: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T02:01:29.725 INFO:tasks.ceph.mds.b.smithi135.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7f7a8d983417] 2024-09-12T02:01:29.725 INFO:tasks.ceph.mds.b.smithi135.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x56445490f2d1] 2024-09-12T02:01:29.725 INFO:tasks.ceph.mds.b.smithi135.stderr: 3: (CDentry::check_corruption(bool)+0x4d4) [0x564454b3a4e4] 2024-09-12T02:01:29.725 INFO:tasks.ceph.mds.b.smithi135.stderr: 4: ceph-mds(+0x1cb3e9) [0x5644549523e9] 2024-09-12T02:01:29.725 INFO:tasks.ceph.mds.b.smithi135.stderr: 5: (Server::_rename_prepare(boost::intrusive_ptr const&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x207f) [0x5644549dd2df] 2024-09-12T02:01:29.726 INFO:tasks.ceph.mds.b.smithi135.stderr: 6: (Server::handle_client_rename(boost::intrusive_ptr const&)+0x25e2) [0x5644549e05b2] 2024-09-12T02:01:29.726 INFO:tasks.ceph.mds.b.smithi135.stderr: 7: (Server::handle_client_request(boost::intrusive_ptr const&)+0x3e3) [0x5644549a6dc3] 2024-09-12T02:01:29.726 INFO:tasks.ceph.mds.b.smithi135.stderr: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x564454994cec] 2024-09-12T02:01:29.726 INFO:tasks.ceph.mds.b.smithi135.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x56445491689b] 2024-09-12T02:01:29.726 INFO:tasks.ceph.mds.b.smithi135.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564454916d6c] 2024-09-12T02:01:29.726 INFO:tasks.ceph.mds.b.smithi135.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1a6) [0x5644548fb286] 2024-09-12T02:01:29.726 INFO:tasks.ceph.mds.b.smithi135.stderr: 12: (DispatchQueue::entry()+0x4c2) [0x7f7a8db905c2] 2024-09-12T02:01:29.726 INFO:tasks.ceph.mds.b.smithi135.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x42a1d1) [0x7f7a8dc2a1d1] 2024-09-12T02:01:29.726 INFO:tasks.ceph.mds.b.smithi135.stderr: 14: /lib64/libc.so.6(+0x89c52) [0x7f7a8d089c52] 2024-09-12T02:01:29.726 INFO:tasks.ceph.mds.b.smithi135.stderr: 15: /lib64/libc.so.6(+0x10ec80) [0x7f7a8d10ec80] 2024-09-12T02:01:29.726 INFO:tasks.ceph.mds.b.smithi135.stderr: 2024-09-12T02:01:29.726 INFO:tasks.ceph.mds.b.smithi135.stderr: 0> 2024-09-12T02:01:29.708+0000 7f7a87c4c640 -1 *** Caught signal (Aborted) ** 2024-09-12T02:01:29.726 INFO:tasks.ceph.mds.b.smithi135.stderr: in thread 7f7a87c4c640 thread_name:ms_dispatch 2024-09-12T02:01:29.726 INFO:tasks.ceph.mds.b.smithi135.stderr: 2024-09-12T02:01:29.727 INFO:tasks.ceph.mds.b.smithi135.stderr: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T02:01:29.727 INFO:tasks.ceph.mds.b.smithi135.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7a8d03e6f0] 2024-09-12T02:01:29.727 INFO:tasks.ceph.mds.b.smithi135.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7a8d08b99c] 2024-09-12T02:01:29.727 INFO:tasks.ceph.mds.b.smithi135.stderr: 3: raise() 2024-09-12T02:01:29.727 INFO:tasks.ceph.mds.b.smithi135.stderr: 4: abort() 2024-09-12T02:01:29.727 INFO:tasks.ceph.mds.b.smithi135.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7f7a8d9834d4] 2024-09-12T02:01:29.727 INFO:tasks.ceph.mds.b.smithi135.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x56445490f2d1] 2024-09-12T02:01:29.727 INFO:tasks.ceph.mds.b.smithi135.stderr: 7: (CDentry::check_corruption(bool)+0x4d4) [0x564454b3a4e4] 2024-09-12T02:01:29.727 INFO:tasks.ceph.mds.b.smithi135.stderr: 8: ceph-mds(+0x1cb3e9) [0x5644549523e9] 2024-09-12T02:01:29.727 INFO:tasks.ceph.mds.b.smithi135.stderr: 9: (Server::_rename_prepare(boost::intrusive_ptr const&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x207f) [0x5644549dd2df] 2024-09-12T02:01:29.727 INFO:tasks.ceph.mds.b.smithi135.stderr: 10: (Server::handle_client_rename(boost::intrusive_ptr const&)+0x25e2) [0x5644549e05b2] 2024-09-12T02:01:29.727 INFO:tasks.ceph.mds.b.smithi135.stderr: 11: (Server::handle_client_request(boost::intrusive_ptr const&)+0x3e3) [0x5644549a6dc3] 2024-09-12T02:01:29.727 INFO:tasks.ceph.mds.b.smithi135.stderr: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x564454994cec] 2024-09-12T02:01:29.727 INFO:tasks.ceph.mds.b.smithi135.stderr: 13: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x56445491689b] 2024-09-12T02:01:29.728 INFO:tasks.ceph.mds.b.smithi135.stderr: 14: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564454916d6c] 2024-09-12T02:01:29.728 INFO:tasks.ceph.mds.b.smithi135.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1a6) [0x5644548fb286] 2024-09-12T02:01:29.728 INFO:tasks.ceph.mds.b.smithi135.stderr: 16: (DispatchQueue::entry()+0x4c2) [0x7f7a8db905c2] 2024-09-12T02:01:29.728 INFO:tasks.ceph.mds.b.smithi135.stderr: 17: /usr/lib64/ceph/libceph-common.so.2(+0x42a1d1) [0x7f7a8dc2a1d1] 2024-09-12T02:01:29.728 INFO:tasks.ceph.mds.b.smithi135.stderr: 18: /lib64/libc.so.6(+0x89c52) [0x7f7a8d089c52] 2024-09-12T02:01:29.728 INFO:tasks.ceph.mds.b.smithi135.stderr: 19: /lib64/libc.so.6(+0x10ec80) [0x7f7a8d10ec80] 2024-09-12T02:01:29.728 INFO:tasks.ceph.mds.b.smithi135.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T02:01:29.728 INFO:tasks.ceph.mds.b.smithi135.stderr: 2024-09-12T02:01:29.769 INFO:teuthology.orchestra.run.smithi019.stdout:{"mds_beacon_grace":"15.000000"} 2024-09-12T02:01:29.769 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2024-09-12T02:01:29.770 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.782+0000 7fe13d591640 1 Processor -- start 2024-09-12T02:01:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.782+0000 7fe13d591640 1 -- start start 2024-09-12T02:01:29.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.783+0000 7fe13d591640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe13815e610 0x7fe1380b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:29.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.783+0000 7fe13d591640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe1380b2800 0x7fe1380d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:29.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.783+0000 7fe13d591640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe1380d0ac0 0x7fe138162110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:29.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.783+0000 7fe13d591640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fe13815e9f0 con 0x7fe1380b2800 2024-09-12T02:01:29.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.783+0000 7fe13d591640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe13806bc10 con 0x7fe1380d0ac0 2024-09-12T02:01:29.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.783+0000 7fe13d591640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe1380d0f70 con 0x7fe13815e610 2024-09-12T02:01:29.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.783+0000 7fe1367fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe1380b2800 0x7fe1380d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:29.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.783+0000 7fe1367fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe1380b2800 0x7fe1380d0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35662/0 (socket says 172.21.15.19:35662) 2024-09-12T02:01:29.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.783+0000 7fe1367fc640 1 -- 172.21.15.19:0/2229804091 learned_addr learned my addr 172.21.15.19:0/2229804091 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:29.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.783+0000 7fe1377fe640 1 --2- 172.21.15.19:0/2229804091 >> v2:172.21.15.135:3300/0 conn(0x7fe1380d0ac0 0x7fe138162110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:29.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.783+0000 7fe136ffd640 1 --2- 172.21.15.19:0/2229804091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe13815e610 0x7fe1380b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:29.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.783+0000 7fe1367fc640 1 -- 172.21.15.19:0/2229804091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe13815e610 msgr2=0x7fe1380b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:29.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.783+0000 7fe1367fc640 1 --2- 172.21.15.19:0/2229804091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe13815e610 0x7fe1380b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:29.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.783+0000 7fe1367fc640 1 -- 172.21.15.19:0/2229804091 >> v2:172.21.15.135:3300/0 conn(0x7fe1380d0ac0 msgr2=0x7fe138162110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:29.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.783+0000 7fe1367fc640 1 --2- 172.21.15.19:0/2229804091 >> v2:172.21.15.135:3300/0 conn(0x7fe1380d0ac0 0x7fe138162110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:29.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.783+0000 7fe1367fc640 1 -- 172.21.15.19:0/2229804091 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13806be60 con 0x7fe1380b2800 2024-09-12T02:01:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.784+0000 7fe1367fc640 1 --2- 172.21.15.19:0/2229804091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1380b2800 0x7fe1380d0580 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe1380b3e30 tx=0x7fe12c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226d5ef4eb3536c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.784+0000 7fe135ffb640 1 -- 172.21.15.19:0/2229804091 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c037070 con 0x7fe1380b2800 2024-09-12T02:01:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.784+0000 7fe135ffb640 1 -- 172.21.15.19:0/2229804091 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe12c032440 con 0x7fe1380b2800 2024-09-12T02:01:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.784+0000 7fe135ffb640 1 -- 172.21.15.19:0/2229804091 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c032810 con 0x7fe1380b2800 2024-09-12T02:01:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.785+0000 7fe13d591640 1 -- 172.21.15.19:0/2229804091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1380b2800 msgr2=0x7fe1380d0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.785+0000 7fe13d591640 1 --2- 172.21.15.19:0/2229804091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1380b2800 0x7fe1380d0580 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe1380b3e30 tx=0x7fe12c02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:01:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.785+0000 7fe13d591640 1 -- 172.21.15.19:0/2229804091 shutdown_connections 2024-09-12T02:01:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.785+0000 7fe13d591640 1 --2- 172.21.15.19:0/2229804091 >> v2:172.21.15.135:3300/0 conn(0x7fe1380d0ac0 0x7fe138162110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.785+0000 7fe13d591640 1 --2- 172.21.15.19:0/2229804091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1380b2800 0x7fe1380d0580 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.785+0000 7fe13d591640 1 --2- 172.21.15.19:0/2229804091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe13815e610 0x7fe1380b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.785+0000 7fe13d591640 1 -- 172.21.15.19:0/2229804091 >> 172.21.15.19:0/2229804091 conn(0x7fe13809aa30 msgr2=0x7fe1380d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.785+0000 7fe13d591640 1 -- 172.21.15.19:0/2229804091 shutdown_connections 2024-09-12T02:01:29.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.785+0000 7fe13d591640 1 -- 172.21.15.19:0/2229804091 wait complete. 2024-09-12T02:01:29.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.787+0000 7fe13d591640 1 Processor -- start 2024-09-12T02:01:29.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.787+0000 7fe13d591640 1 -- start start 2024-09-12T02:01:29.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.788+0000 7fe13d591640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1380b2800 0x7fe1380c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:29.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.788+0000 7fe13d591640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1380d0ac0 0x7fe1380c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:29.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.788+0000 7fe13d591640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe13815e610 0x7fe13814a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:29.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.789+0000 7fe13d591640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe13806c420 con 0x7fe1380b2800 2024-09-12T02:01:29.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.789+0000 7fe13d591640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe13806c140 con 0x7fe1380d0ac0 2024-09-12T02:01:29.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.789+0000 7fe13d591640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe13806c700 con 0x7fe13815e610 2024-09-12T02:01:29.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.789+0000 7fe136ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1380b2800 0x7fe1380c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:29.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.789+0000 7fe136ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1380b2800 0x7fe1380c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35664/0 (socket says 172.21.15.19:35664) 2024-09-12T02:01:29.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.789+0000 7fe136ffd640 1 -- 172.21.15.19:0/2840306838 learned_addr learned my addr 172.21.15.19:0/2840306838 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:29.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.789+0000 7fe1367fc640 1 --2- 172.21.15.19:0/2840306838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1380d0ac0 0x7fe1380c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:29.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.789+0000 7fe1377fe640 1 --2- 172.21.15.19:0/2840306838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe13815e610 0x7fe13814a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:29.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.789+0000 7fe136ffd640 1 -- 172.21.15.19:0/2840306838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe13815e610 msgr2=0x7fe13814a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:29.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.789+0000 7fe136ffd640 1 --2- 172.21.15.19:0/2840306838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe13815e610 0x7fe13814a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:29.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.789+0000 7fe136ffd640 1 -- 172.21.15.19:0/2840306838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1380d0ac0 msgr2=0x7fe1380c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:29.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.789+0000 7fe136ffd640 1 --2- 172.21.15.19:0/2840306838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1380d0ac0 0x7fe1380c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:29.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.789+0000 7fe136ffd640 1 -- 172.21.15.19:0/2840306838 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1380c5200 con 0x7fe1380b2800 2024-09-12T02:01:29.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.789+0000 7fe136ffd640 1 --2- 172.21.15.19:0/2840306838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1380b2800 0x7fe1380c62a0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe12800e870 tx=0x7fe12800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:29.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.789+0000 7fe11f7fe640 1 -- 172.21.15.19:0/2840306838 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe128017070 con 0x7fe1380b2800 2024-09-12T02:01:29.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.789+0000 7fe11f7fe640 1 -- 172.21.15.19:0/2840306838 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe12800c940 con 0x7fe1380b2800 2024-09-12T02:01:29.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.789+0000 7fe13d591640 1 -- 172.21.15.19:0/2840306838 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1380c54e0 con 0x7fe1380b2800 2024-09-12T02:01:29.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.789+0000 7fe11f7fe640 1 -- 172.21.15.19:0/2840306838 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12800cd30 con 0x7fe1380b2800 2024-09-12T02:01:29.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.790+0000 7fe13d591640 1 -- 172.21.15.19:0/2840306838 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1380c5aa0 con 0x7fe1380b2800 2024-09-12T02:01:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.790+0000 7fe13d591640 1 -- 172.21.15.19:0/2840306838 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fe13815f8f0 con 0x7fe1380b2800 2024-09-12T02:01:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.792+0000 7fe11f7fe640 1 -- 172.21.15.19:0/2840306838 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe12801a070 con 0x7fe1380b2800 2024-09-12T02:01:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.792+0000 7fe11f7fe640 1 --2- 172.21.15.19:0/2840306838 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe12406be60 0x7fe12406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.792+0000 7fe11f7fe640 1 -- 172.21.15.19:0/2840306838 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fe12808b5f0 con 0x7fe1380b2800 2024-09-12T02:01:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.792+0000 7fe11f7fe640 1 -- 172.21.15.19:0/2840306838 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+511 (secure 0 0 0) 0x7fe12808baa0 con 0x7fe1380b2800 2024-09-12T02:01:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.792+0000 7fe1367fc640 1 --2- 172.21.15.19:0/2840306838 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe12406be60 0x7fe12406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.793+0000 7fe13d591640 1 -- 172.21.15.19:0/2840306838 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7fe1380b71e0 con 0x7fe1380b2800 2024-09-12T02:01:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.793+0000 7fe1367fc640 1 --2- 172.21.15.19:0/2840306838 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe12406be60 0x7fe12406e320 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe12c034000 tx=0x7fe12c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:29.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.875+0000 7f49fcc2e640 1 Processor -- start 2024-09-12T02:01:29.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.875+0000 7f49fcc2e640 1 -- start start 2024-09-12T02:01:29.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.876+0000 7f49fcc2e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49f809aa30 0x7f49f80b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:29.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.876+0000 7f49fcc2e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f49f806cd20 0x7f49f8162340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:29.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.876+0000 7f49fcc2e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49f80b2790 con 0x7f49f80b3760 2024-09-12T02:01:29.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.876+0000 7f49fcc2e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f49f80d0670 con 0x7f49f806cd20 2024-09-12T02:01:29.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.876+0000 7f49fcc2e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f49f80b2a70 con 0x7f49f809aa30 2024-09-12T02:01:29.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.877+0000 7f49f6d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f49f806cd20 0x7f49f8162340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:29.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.877+0000 7f49f6d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f49f806cd20 0x7f49f8162340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35668/0 (socket says 172.21.15.19:35668) 2024-09-12T02:01:29.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.877+0000 7f49f6d9d640 1 -- 172.21.15.19:0/3354838883 learned_addr learned my addr 172.21.15.19:0/3354838883 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:29.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.877+0000 7f49f659c640 1 --2- 172.21.15.19:0/3354838883 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49f809aa30 0x7f49f80b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:29.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.877+0000 7f49f6d9d640 1 -- 172.21.15.19:0/3354838883 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49f809aa30 msgr2=0x7f49f80b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:29.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.877+0000 7f49f6d9d640 1 --2- 172.21.15.19:0/3354838883 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49f809aa30 0x7f49f80b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:29.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.877+0000 7f49f6d9d640 1 -- 172.21.15.19:0/3354838883 >> v1:172.21.15.19:6789/0 conn(0x7f49f80b3760 legacy=0x7f49f809ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:29.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.877+0000 7f49f559a640 1 -- 172.21.15.19:0/3354838883 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1296634642 0 0) 0x7f49f80b2790 con 0x7f49f80b3760 2024-09-12T02:01:29.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.877+0000 7f49f6d9d640 1 -- 172.21.15.19:0/3354838883 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f80b2d50 con 0x7f49f806cd20 2024-09-12T02:01:29.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.878+0000 7f49f6d9d640 1 --2- 172.21.15.19:0/3354838883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49f806cd20 0x7f49f8162340 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f49f0009e50 tx=0x7f49f002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e379d21c97bf0d35 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.878+0000 7f49f559a640 1 -- 172.21.15.19:0/3354838883 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f0036070 con 0x7f49f806cd20 2024-09-12T02:01:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.878+0000 7f49f559a640 1 -- 172.21.15.19:0/3354838883 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f0031600 con 0x7f49f806cd20 2024-09-12T02:01:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.878+0000 7f49f559a640 1 -- 172.21.15.19:0/3354838883 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f00319d0 con 0x7f49f806cd20 2024-09-12T02:01:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.878+0000 7f49fcc2e640 1 -- 172.21.15.19:0/3354838883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49f806cd20 msgr2=0x7f49f8162340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.878+0000 7f49fcc2e640 1 --2- 172.21.15.19:0/3354838883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49f806cd20 0x7f49f8162340 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f49f0009e50 tx=0x7f49f002a680 comp rx=0 tx=0).stop 2024-09-12T02:01:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.878+0000 7f49fcc2e640 1 -- 172.21.15.19:0/3354838883 shutdown_connections 2024-09-12T02:01:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.878+0000 7f49fcc2e640 1 --2- 172.21.15.19:0/3354838883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49f806cd20 0x7f49f8162340 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.878+0000 7f49fcc2e640 1 --2- 172.21.15.19:0/3354838883 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49f809aa30 0x7f49f80b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.878+0000 7f49fcc2e640 1 -- 172.21.15.19:0/3354838883 >> 172.21.15.19:0/3354838883 conn(0x7f49f80d23a0 msgr2=0x7f49f80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.878+0000 7f49fcc2e640 1 -- 172.21.15.19:0/3354838883 shutdown_connections 2024-09-12T02:01:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.879+0000 7f49fcc2e640 1 -- 172.21.15.19:0/3354838883 wait complete. 2024-09-12T02:01:29.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.880+0000 7f49fcc2e640 1 Processor -- start 2024-09-12T02:01:29.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.880+0000 7f49fcc2e640 1 -- start start 2024-09-12T02:01:29.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49fcc2e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49f806cd20 0x7f49f81f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:29.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49fcc2e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49f809aa30 0x7f49f815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:29.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49fcc2e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49f80b3760 0x7f49f815d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:29.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49fcc2e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f49f815fe20 con 0x7f49f809aa30 2024-09-12T02:01:29.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49fcc2e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f49f815fca0 con 0x7f49f80b3760 2024-09-12T02:01:29.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49fcc2e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f49f80d1fe0 con 0x7f49f806cd20 2024-09-12T02:01:29.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49f5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49f809aa30 0x7f49f815ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:29.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49f5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49f809aa30 0x7f49f815ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35678/0 (socket says 172.21.15.19:35678) 2024-09-12T02:01:29.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49f5d9b640 1 -- 172.21.15.19:0/1792771782 learned_addr learned my addr 172.21.15.19:0/1792771782 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:29.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49f659c640 1 --2- 172.21.15.19:0/1792771782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49f806cd20 0x7f49f81f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:29.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49f6d9d640 1 --2- 172.21.15.19:0/1792771782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49f80b3760 0x7f49f815d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:29.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49f5d9b640 1 -- 172.21.15.19:0/1792771782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49f806cd20 msgr2=0x7f49f81f47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:29.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49f5d9b640 1 --2- 172.21.15.19:0/1792771782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49f806cd20 0x7f49f81f47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:29.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49f5d9b640 1 -- 172.21.15.19:0/1792771782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49f80b3760 msgr2=0x7f49f815d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:29.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49f5d9b640 1 --2- 172.21.15.19:0/1792771782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49f80b3760 0x7f49f815d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:29.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49f5d9b640 1 -- 172.21.15.19:0/1792771782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f80ce0e0 con 0x7f49f809aa30 2024-09-12T02:01:29.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49f5d9b640 1 --2- 172.21.15.19:0/1792771782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49f809aa30 0x7f49f815ecf0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f49ec00c440 tx=0x7f49ec00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:29.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49e6ffd640 1 -- 172.21.15.19:0/1792771782 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ec017070 con 0x7f49f809aa30 2024-09-12T02:01:29.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49e6ffd640 1 -- 172.21.15.19:0/1792771782 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49ec0035f0 con 0x7f49f809aa30 2024-09-12T02:01:29.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49e6ffd640 1 -- 172.21.15.19:0/1792771782 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ec0039e0 con 0x7f49f809aa30 2024-09-12T02:01:29.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.881+0000 7f49fcc2e640 1 -- 172.21.15.19:0/1792771782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f80c99d0 con 0x7f49f809aa30 2024-09-12T02:01:29.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.882+0000 7f49fcc2e640 1 -- 172.21.15.19:0/1792771782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f815d770 con 0x7f49f809aa30 2024-09-12T02:01:29.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.882+0000 7f49fcc2e640 1 -- 172.21.15.19:0/1792771782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f80b3030 con 0x7f49f809aa30 2024-09-12T02:01:29.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.883+0000 7f49e6ffd640 1 -- 172.21.15.19:0/1792771782 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f49ec01a070 con 0x7f49f809aa30 2024-09-12T02:01:29.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.883+0000 7f49e6ffd640 1 --2- 172.21.15.19:0/1792771782 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f49d806be30 0x7f49d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:29.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.883+0000 7f49e6ffd640 1 -- 172.21.15.19:0/1792771782 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f49ec08a250 con 0x7f49f809aa30 2024-09-12T02:01:29.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.884+0000 7f49f659c640 1 --2- 172.21.15.19:0/1792771782 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f49d806be30 0x7f49d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:29.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.884+0000 7f49f659c640 1 --2- 172.21.15.19:0/1792771782 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f49d806be30 0x7f49d806e2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f49f80cf250 tx=0x7f49e8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:29.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:29.888+0000 7f49e6ffd640 1 -- 172.21.15.19:0/1792771782 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f49ec058570 con 0x7f49f809aa30 2024-09-12T02:01:30.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:30.099+0000 7f49fcc2e640 1 -- 172.21.15.19:0/1792771782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49f80b3cb0 con 0x7f49f809aa30 2024-09-12T02:01:30.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:30.100+0000 7f49e6ffd640 1 -- 172.21.15.19:0/1792771782 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5228 (secure 0 0 0) 0x7f49ec05c870 con 0x7f49f809aa30 2024-09-12T02:01:30.101 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:30.101 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":63,"btime":"2024-09-12T02:01:23:983445+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1065573429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1065573429},{"type":"v1","addr":"172.21.15.19:6835","nonce":1065573429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3905709264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":3905709264},{"type":"v1","addr":"172.21.15.135:6837","nonce":3905709264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6082,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/836344045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":836344045},{"type":"v1","addr":"172.21.15.19:6834","nonce":836344045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:01:16.289395+0000","modified":"2024-09-12T02:01:23.435588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6088":{"gid":6088,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/1796121402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1796121402},{"type":"v1","addr":"172.21.15.135:6836","nonce":1796121402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6088,"qdb_cluster":[6088]},"id":5}]} 2024-09-12T02:01:30.101 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 63 2024-09-12T02:01:30.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:30.102+0000 7f49fcc2e640 1 -- 172.21.15.19:0/1792771782 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f49d806be30 msgr2=0x7f49d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:30.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:30.102+0000 7f49fcc2e640 1 --2- 172.21.15.19:0/1792771782 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f49d806be30 0x7f49d806e2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f49f80cf250 tx=0x7f49e8009190 comp rx=0 tx=0).stop 2024-09-12T02:01:30.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:30.102+0000 7f49fcc2e640 1 -- 172.21.15.19:0/1792771782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49f809aa30 msgr2=0x7f49f815ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:30.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:30.102+0000 7f49fcc2e640 1 --2- 172.21.15.19:0/1792771782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49f809aa30 0x7f49f815ecf0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f49ec00c440 tx=0x7f49ec00c900 comp rx=0 tx=0).stop 2024-09-12T02:01:30.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:30.102+0000 7f49fcc2e640 1 -- 172.21.15.19:0/1792771782 shutdown_connections 2024-09-12T02:01:30.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:30.102+0000 7f49fcc2e640 1 --2- 172.21.15.19:0/1792771782 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f49d806be30 0x7f49d806e2f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:30.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:30.102+0000 7f49fcc2e640 1 --2- 172.21.15.19:0/1792771782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49f80b3760 0x7f49f815d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:30.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:30.102+0000 7f49fcc2e640 1 --2- 172.21.15.19:0/1792771782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49f809aa30 0x7f49f815ecf0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:30.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:30.102+0000 7f49fcc2e640 1 --2- 172.21.15.19:0/1792771782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49f806cd20 0x7f49f81f47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:30.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:30.102+0000 7f49fcc2e640 1 -- 172.21.15.19:0/1792771782 >> 172.21.15.19:0/1792771782 conn(0x7f49f80d23a0 msgr2=0x7f49f815b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:30.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:30.102+0000 7f49fcc2e640 1 -- 172.21.15.19:0/1792771782 shutdown_connections 2024-09-12T02:01:30.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:30.102+0000 7f49fcc2e640 1 -- 172.21.15.19:0/1792771782 wait complete. 2024-09-12T02:01:30.114 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-12T02:01:30.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:30.228+0000 7fe11f7fe640 1 -- 172.21.15.19:0/2840306838 <== mon.0 v2:172.21.15.19:3300/0 7 ==== log(1 entries from seq 1 at 2024-09-12T02:01:29.707638+0000) ==== 468+0+0 (secure 0 0 0) 0x7fe128089aa0 con 0x7fe1380b2800 2024-09-12T02:01:30.228 INFO:teuthology.orchestra.run.smithi019.stdout: cluster: 2024-09-12T02:01:30.229 INFO:teuthology.orchestra.run.smithi019.stdout: id: 978259a0-e3d5-47df-8e62-5e92f95d9388 2024-09-12T02:01:30.229 INFO:teuthology.orchestra.run.smithi019.stdout: health: HEALTH_OK 2024-09-12T02:01:30.229 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:30.229 INFO:teuthology.orchestra.run.smithi019.stdout: services: 2024-09-12T02:01:30.229 INFO:teuthology.orchestra.run.smithi019.stdout: mon: 3 daemons, quorum a,b,c (age 5m) 2024-09-12T02:01:30.229 INFO:teuthology.orchestra.run.smithi019.stdout: mgr: x(active, since 5m), standbys: y 2024-09-12T02:01:30.229 INFO:teuthology.orchestra.run.smithi019.stdout: mds: 1/1 daemons up, 3 standby 2024-09-12T02:01:30.229 INFO:teuthology.orchestra.run.smithi019.stdout: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-09-12T02:01:30.229 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:30.229 INFO:teuthology.orchestra.run.smithi019.stdout: data: 2024-09-12T02:01:30.229 INFO:teuthology.orchestra.run.smithi019.stdout: volumes: 1/1 healthy 2024-09-12T02:01:30.229 INFO:teuthology.orchestra.run.smithi019.stdout: pools: 3 pools, 97 pgs 2024-09-12T02:01:30.229 INFO:teuthology.orchestra.run.smithi019.stdout: objects: 25 objects, 582 KiB 2024-09-12T02:01:30.230 INFO:teuthology.orchestra.run.smithi019.stdout: usage: 240 MiB used, 720 GiB / 720 GiB avail 2024-09-12T02:01:30.230 INFO:teuthology.orchestra.run.smithi019.stdout: pgs: 97 active+clean 2024-09-12T02:01:30.230 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:30.230 INFO:teuthology.orchestra.run.smithi019.stdout: io: 2024-09-12T02:01:30.230 INFO:teuthology.orchestra.run.smithi019.stdout: client: 0 B/s rd, 2.2 KiB/s wr, 0 op/s rd, 5 op/s wr 2024-09-12T02:01:30.230 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:30.230 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:30.230 INFO:teuthology.orchestra.run.smithi019.stdout:2024-09-12T02:01:29.707638+0000 mds.b [ERR] MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by request(client.5699:47 nref=7 cr=0x564458353c00)) (dversion lock w=1 last_client=5699) pv=11 v=10 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x564458261680] 2024-09-12T02:01:30.330 INFO:tasks.ceph.mds.b.smithi135.stderr:daemon-helper: command crashed with signal 6 2024-09-12T02:01:33.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-12T02:01:35.114 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:35.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.230+0000 7f2e94542640 1 Processor -- start 2024-09-12T02:01:35.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.230+0000 7f2e94542640 1 -- start start 2024-09-12T02:01:35.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.231+0000 7f2e94542640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e8c15d3e0 0x7f2e8c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.231+0000 7f2e94542640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e8c15d870 con 0x7f2e8c0ce8b0 2024-09-12T02:01:35.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.231+0000 7f2e94542640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e8c0d00a0 con 0x7f2e8c0d06e0 2024-09-12T02:01:35.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.231+0000 7f2e94542640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2e8c09b080 con 0x7f2e8c15d3e0 2024-09-12T02:01:35.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.231+0000 7f2e92adf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e8c15d3e0 0x7f2e8c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.231+0000 7f2e92adf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e8c15d3e0 0x7f2e8c0ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55444/0 (socket says 172.21.15.19:55444) 2024-09-12T02:01:35.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.231+0000 7f2e92adf640 1 -- 172.21.15.19:0/3108000740 learned_addr learned my addr 172.21.15.19:0/3108000740 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:35.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.231+0000 7f2e91add640 1 --1- 172.21.15.19:0/3108000740 >> v1:172.21.15.19:6789/0 conn(0x7f2e8c0ce8b0 0x7f2e8c09b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48746/0 (socket says 172.21.15.19:48746) 2024-09-12T02:01:35.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.232+0000 7f2e92adf640 1 -- 172.21.15.19:0/3108000740 >> v1:172.21.15.135:6789/0 conn(0x7f2e8c0d06e0 legacy=0x7f2e8c0d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:35.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.232+0000 7f2e92adf640 1 -- 172.21.15.19:0/3108000740 >> v1:172.21.15.19:6789/0 conn(0x7f2e8c0ce8b0 legacy=0x7f2e8c09b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:35.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.232+0000 7f2e912dc640 1 -- 172.21.15.19:0/3108000740 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1593610461 0 0) 0x7f2e8c15d870 con 0x7f2e8c0ce8b0 2024-09-12T02:01:35.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.232+0000 7f2e92adf640 1 -- 172.21.15.19:0/3108000740 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c0d0380 con 0x7f2e8c15d3e0 2024-09-12T02:01:35.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.232+0000 7f2e92adf640 1 --2- 172.21.15.19:0/3108000740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c15d3e0 0x7f2e8c0ccf90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009e50 tx=0x7f2e8402a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac373e5c0ce3d86f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:35.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.233+0000 7f2e912dc640 1 -- 172.21.15.19:0/3108000740 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e84036070 con 0x7f2e8c15d3e0 2024-09-12T02:01:35.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.233+0000 7f2e912dc640 1 -- 172.21.15.19:0/3108000740 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e84031600 con 0x7f2e8c15d3e0 2024-09-12T02:01:35.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.233+0000 7f2e912dc640 1 -- 172.21.15.19:0/3108000740 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e840319d0 con 0x7f2e8c15d3e0 2024-09-12T02:01:35.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.233+0000 7f2e94542640 1 -- 172.21.15.19:0/3108000740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c15d3e0 msgr2=0x7f2e8c0ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:35.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.233+0000 7f2e94542640 1 --2- 172.21.15.19:0/3108000740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c15d3e0 0x7f2e8c0ccf90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009e50 tx=0x7f2e8402a760 comp rx=0 tx=0).stop 2024-09-12T02:01:35.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.233+0000 7f2e94542640 1 -- 172.21.15.19:0/3108000740 shutdown_connections 2024-09-12T02:01:35.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.233+0000 7f2e94542640 1 --2- 172.21.15.19:0/3108000740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c15d3e0 0x7f2e8c0ccf90 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.233+0000 7f2e94542640 1 -- 172.21.15.19:0/3108000740 >> 172.21.15.19:0/3108000740 conn(0x7f2e8c0d23a0 msgr2=0x7f2e8c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:35.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.233+0000 7f2e94542640 1 -- 172.21.15.19:0/3108000740 shutdown_connections 2024-09-12T02:01:35.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.233+0000 7f2e94542640 1 -- 172.21.15.19:0/3108000740 wait complete. 2024-09-12T02:01:35.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.235+0000 7f2e94542640 1 Processor -- start 2024-09-12T02:01:35.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.235+0000 7f2e94542640 1 -- start start 2024-09-12T02:01:35.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.235+0000 7f2e94542640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e8c0ce8b0 0x7f2e8c0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.235+0000 7f2e94542640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c0d06e0 0x7f2e8c0cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.236+0000 7f2e94542640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e8c15d3e0 0x7f2e8c0c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.236+0000 7f2e94542640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c15c740 con 0x7f2e8c0d06e0 2024-09-12T02:01:35.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.236+0000 7f2e94542640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c09ad10 con 0x7f2e8c0ce8b0 2024-09-12T02:01:35.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.236+0000 7f2e94542640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2e8c09bc20 con 0x7f2e8c15d3e0 2024-09-12T02:01:35.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.236+0000 7f2e91add640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c0d06e0 0x7f2e8c0cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.236+0000 7f2e91add640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c0d06e0 0x7f2e8c0cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55460/0 (socket says 172.21.15.19:55460) 2024-09-12T02:01:35.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.236+0000 7f2e91add640 1 -- 172.21.15.19:0/2712885445 learned_addr learned my addr 172.21.15.19:0/2712885445 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:35.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.236+0000 7f2e922de640 1 --2- 172.21.15.19:0/2712885445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e8c0ce8b0 0x7f2e8c0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.236+0000 7f2e92adf640 1 --2- 172.21.15.19:0/2712885445 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e8c15d3e0 0x7f2e8c0c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.236+0000 7f2e91add640 1 -- 172.21.15.19:0/2712885445 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e8c15d3e0 msgr2=0x7f2e8c0c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:35.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.236+0000 7f2e91add640 1 --2- 172.21.15.19:0/2712885445 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e8c15d3e0 0x7f2e8c0c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.236+0000 7f2e91add640 1 -- 172.21.15.19:0/2712885445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e8c0ce8b0 msgr2=0x7f2e8c0cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:35.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.236+0000 7f2e91add640 1 --2- 172.21.15.19:0/2712885445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e8c0ce8b0 0x7f2e8c0cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.236+0000 7f2e91add640 1 -- 172.21.15.19:0/2712885445 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c0c7b90 con 0x7f2e8c0d06e0 2024-09-12T02:01:35.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.236+0000 7f2e91add640 1 --2- 172.21.15.19:0/2712885445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c0d06e0 0x7f2e8c0cbb90 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c00c460 tx=0x7f2e7c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:35.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.237+0000 7f2e82ffd640 1 -- 172.21.15.19:0/2712885445 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c018070 con 0x7f2e8c0d06e0 2024-09-12T02:01:35.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.237+0000 7f2e82ffd640 1 -- 172.21.15.19:0/2712885445 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7c007500 con 0x7f2e8c0d06e0 2024-09-12T02:01:35.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.237+0000 7f2e94542640 1 -- 172.21.15.19:0/2712885445 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8c1f3650 con 0x7f2e8c0d06e0 2024-09-12T02:01:35.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.237+0000 7f2e82ffd640 1 -- 172.21.15.19:0/2712885445 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c004a20 con 0x7f2e8c0d06e0 2024-09-12T02:01:35.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.237+0000 7f2e94542640 1 -- 172.21.15.19:0/2712885445 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e8c1f3c10 con 0x7f2e8c0d06e0 2024-09-12T02:01:35.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.238+0000 7f2e94542640 1 -- 172.21.15.19:0/2712885445 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e8c1f3e10 con 0x7f2e8c0d06e0 2024-09-12T02:01:35.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.239+0000 7f2e82ffd640 1 -- 172.21.15.19:0/2712885445 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e7c01b070 con 0x7f2e8c0d06e0 2024-09-12T02:01:35.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.239+0000 7f2e82ffd640 1 --2- 172.21.15.19:0/2712885445 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e7006be30 0x7f2e7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.239+0000 7f2e82ffd640 1 -- 172.21.15.19:0/2712885445 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f2e7c08a200 con 0x7f2e8c0d06e0 2024-09-12T02:01:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.240+0000 7f2e922de640 1 --2- 172.21.15.19:0/2712885445 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e7006be30 0x7f2e7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.240+0000 7f2e922de640 1 --2- 172.21.15.19:0/2712885445 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e7006be30 0x7f2e7006e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0b0e80 tx=0x7f2e88007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:35.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.244+0000 7f2e82ffd640 1 -- 172.21.15.19:0/2712885445 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e8c1f3e10 con 0x7f2e8c0d06e0 2024-09-12T02:01:35.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.457+0000 7f2e94542640 1 -- 172.21.15.19:0/2712885445 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e8c0d31d0 con 0x7f2e8c0d06e0 2024-09-12T02:01:35.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.458+0000 7f2e82ffd640 1 -- 172.21.15.19:0/2712885445 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5228 (secure 0 0 0) 0x7f2e7c0583c0 con 0x7f2e8c0d06e0 2024-09-12T02:01:35.458 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:35.458 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":63,"btime":"2024-09-12T02:01:23:983445+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1065573429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1065573429},{"type":"v1","addr":"172.21.15.19:6835","nonce":1065573429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3905709264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":3905709264},{"type":"v1","addr":"172.21.15.135:6837","nonce":3905709264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6082,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/836344045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":836344045},{"type":"v1","addr":"172.21.15.19:6834","nonce":836344045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:01:16.289395+0000","modified":"2024-09-12T02:01:23.435588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6088":{"gid":6088,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/1796121402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1796121402},{"type":"v1","addr":"172.21.15.135:6836","nonce":1796121402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6088,"qdb_cluster":[6088]},"id":5}]} 2024-09-12T02:01:35.459 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 63 2024-09-12T02:01:35.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.460+0000 7f2e94542640 1 -- 172.21.15.19:0/2712885445 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e7006be30 msgr2=0x7f2e7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.460+0000 7f2e94542640 1 --2- 172.21.15.19:0/2712885445 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e7006be30 0x7f2e7006e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0b0e80 tx=0x7f2e88007e30 comp rx=0 tx=0).stop 2024-09-12T02:01:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.460+0000 7f2e94542640 1 -- 172.21.15.19:0/2712885445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c0d06e0 msgr2=0x7f2e8c0cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.460+0000 7f2e94542640 1 --2- 172.21.15.19:0/2712885445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c0d06e0 0x7f2e8c0cbb90 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c00c460 tx=0x7f2e7c00c920 comp rx=0 tx=0).stop 2024-09-12T02:01:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.460+0000 7f2e94542640 1 -- 172.21.15.19:0/2712885445 shutdown_connections 2024-09-12T02:01:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.460+0000 7f2e94542640 1 --2- 172.21.15.19:0/2712885445 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e7006be30 0x7f2e7006e2f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.460+0000 7f2e94542640 1 --2- 172.21.15.19:0/2712885445 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e8c15d3e0 0x7f2e8c0c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.460+0000 7f2e94542640 1 --2- 172.21.15.19:0/2712885445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c0d06e0 0x7f2e8c0cbb90 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.460+0000 7f2e94542640 1 --2- 172.21.15.19:0/2712885445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e8c0ce8b0 0x7f2e8c0cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.460+0000 7f2e94542640 1 -- 172.21.15.19:0/2712885445 >> 172.21.15.19:0/2712885445 conn(0x7f2e8c0d23a0 msgr2=0x7f2e8c0cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.460+0000 7f2e94542640 1 -- 172.21.15.19:0/2712885445 shutdown_connections 2024-09-12T02:01:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:35.460+0000 7f2e94542640 1 -- 172.21.15.19:0/2712885445 wait complete. 2024-09-12T02:01:35.472 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-12T02:01:39.639 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2024-09-12T02:01:40.472 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:40.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.588+0000 7f975b9b9640 1 Processor -- start 2024-09-12T02:01:40.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.588+0000 7f975b9b9640 1 -- start start 2024-09-12T02:01:40.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.589+0000 7f975b9b9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f97540720b0 0x7f97540cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:40.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.589+0000 7f975b9b9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9754162ad0 0x7f975406f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:40.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.589+0000 7f975b9b9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9754072490 0x7f97540b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:40.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.589+0000 7f975b9b9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f97540afa20 con 0x7f97540720b0 2024-09-12T02:01:40.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.589+0000 7f975b9b9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f97540afce0 con 0x7f9754072490 2024-09-12T02:01:40.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.589+0000 7f975b9b9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f97540b34d0 con 0x7f9754162ad0 2024-09-12T02:01:40.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.589+0000 7f9759755640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f97540720b0 0x7f97540cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:40.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.589+0000 7f9759755640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f97540720b0 0x7f97540cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55474/0 (socket says 172.21.15.19:55474) 2024-09-12T02:01:40.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.589+0000 7f9759755640 1 -- 172.21.15.19:0/2109987686 learned_addr learned my addr 172.21.15.19:0/2109987686 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:40.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.589+0000 7f9758f54640 1 --2- 172.21.15.19:0/2109987686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9754162ad0 0x7f975406f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:40.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.589+0000 7f9759f56640 1 --2- 172.21.15.19:0/2109987686 >> v2:172.21.15.135:3300/0 conn(0x7f9754072490 0x7f97540b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:40.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.589+0000 7f9759755640 1 -- 172.21.15.19:0/2109987686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9754162ad0 msgr2=0x7f975406f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:40.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.589+0000 7f9759755640 1 --2- 172.21.15.19:0/2109987686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9754162ad0 0x7f975406f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:40.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.589+0000 7f9759755640 1 -- 172.21.15.19:0/2109987686 >> v2:172.21.15.135:3300/0 conn(0x7f9754072490 msgr2=0x7f97540b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:40.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.589+0000 7f9759755640 1 --2- 172.21.15.19:0/2109987686 >> v2:172.21.15.135:3300/0 conn(0x7f9754072490 0x7f97540b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:40.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.589+0000 7f9759755640 1 -- 172.21.15.19:0/2109987686 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97540b37b0 con 0x7f97540720b0 2024-09-12T02:01:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.590+0000 7f9759755640 1 --2- 172.21.15.19:0/2109987686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97540720b0 0x7f97540cfca0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f97540afff0 tx=0x7f975002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24016adb2240a45 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.590+0000 7f974bfff640 1 -- 172.21.15.19:0/2109987686 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9750037070 con 0x7f97540720b0 2024-09-12T02:01:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.590+0000 7f974bfff640 1 -- 172.21.15.19:0/2109987686 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9750032440 con 0x7f97540720b0 2024-09-12T02:01:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.590+0000 7f974bfff640 1 -- 172.21.15.19:0/2109987686 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9750032810 con 0x7f97540720b0 2024-09-12T02:01:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.591+0000 7f975b9b9640 1 -- 172.21.15.19:0/2109987686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97540720b0 msgr2=0x7f97540cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.591+0000 7f975b9b9640 1 --2- 172.21.15.19:0/2109987686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97540720b0 0x7f97540cfca0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f97540afff0 tx=0x7f975002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:01:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.591+0000 7f975b9b9640 1 -- 172.21.15.19:0/2109987686 shutdown_connections 2024-09-12T02:01:40.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.591+0000 7f975b9b9640 1 --2- 172.21.15.19:0/2109987686 >> v2:172.21.15.135:3300/0 conn(0x7f9754072490 0x7f97540b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:40.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.591+0000 7f975b9b9640 1 --2- 172.21.15.19:0/2109987686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9754162ad0 0x7f975406f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:40.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.591+0000 7f975b9b9640 1 --2- 172.21.15.19:0/2109987686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97540720b0 0x7f97540cfca0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:40.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.591+0000 7f975b9b9640 1 -- 172.21.15.19:0/2109987686 >> 172.21.15.19:0/2109987686 conn(0x7f9754067d70 msgr2=0x7f975406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:40.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.591+0000 7f975b9b9640 1 -- 172.21.15.19:0/2109987686 shutdown_connections 2024-09-12T02:01:40.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.591+0000 7f975b9b9640 1 -- 172.21.15.19:0/2109987686 wait complete. 2024-09-12T02:01:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.592+0000 7f975b9b9640 1 Processor -- start 2024-09-12T02:01:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.592+0000 7f975b9b9640 1 -- start start 2024-09-12T02:01:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.593+0000 7f975b9b9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97540720b0 0x7f9754165980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.593+0000 7f975b9b9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9754072490 0x7f975415b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.593+0000 7f975b9b9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9754162ad0 0x7f9754157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.593+0000 7f975b9b9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9754072940 con 0x7f9754162ad0 2024-09-12T02:01:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.593+0000 7f975b9b9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f97540b3d70 con 0x7f97540720b0 2024-09-12T02:01:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.593+0000 7f975b9b9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f97540b47d0 con 0x7f9754072490 2024-09-12T02:01:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.593+0000 7f9759f56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9754162ad0 0x7f9754157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.593+0000 7f9759755640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97540720b0 0x7f9754165980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.593+0000 7f9759f56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9754162ad0 0x7f9754157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55478/0 (socket says 172.21.15.19:55478) 2024-09-12T02:01:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.593+0000 7f9759f56640 1 -- 172.21.15.19:0/1613897051 learned_addr learned my addr 172.21.15.19:0/1613897051 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.593+0000 7f9758f54640 1 --2- 172.21.15.19:0/1613897051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9754072490 0x7f975415b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.594+0000 7f9759f56640 1 -- 172.21.15.19:0/1613897051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9754072490 msgr2=0x7f975415b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.594+0000 7f9759f56640 1 --2- 172.21.15.19:0/1613897051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9754072490 0x7f975415b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.594+0000 7f9759f56640 1 -- 172.21.15.19:0/1613897051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97540720b0 msgr2=0x7f9754165980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.594+0000 7f9759f56640 1 --2- 172.21.15.19:0/1613897051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97540720b0 0x7f9754165980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.594+0000 7f9759f56640 1 -- 172.21.15.19:0/1613897051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97541580a0 con 0x7f9754162ad0 2024-09-12T02:01:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.594+0000 7f9759f56640 1 --2- 172.21.15.19:0/1613897051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9754162ad0 0x7f9754157b60 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f974c007e90 tx=0x7f974c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.594+0000 7f9749ffb640 1 -- 172.21.15.19:0/1613897051 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c014420 con 0x7f9754162ad0 2024-09-12T02:01:40.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.594+0000 7f9749ffb640 1 -- 172.21.15.19:0/1613897051 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f974c019070 con 0x7f9754162ad0 2024-09-12T02:01:40.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.594+0000 7f975b9b9640 1 -- 172.21.15.19:0/1613897051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9754158600 con 0x7f9754162ad0 2024-09-12T02:01:40.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.594+0000 7f9749ffb640 1 -- 172.21.15.19:0/1613897051 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c014820 con 0x7f9754162ad0 2024-09-12T02:01:40.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.594+0000 7f975b9b9640 1 -- 172.21.15.19:0/1613897051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9754162f50 con 0x7f9754162ad0 2024-09-12T02:01:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.595+0000 7f975b9b9640 1 -- 172.21.15.19:0/1613897051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97540b4290 con 0x7f9754162ad0 2024-09-12T02:01:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.596+0000 7f9749ffb640 1 -- 172.21.15.19:0/1613897051 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f974c0149c0 con 0x7f9754162ad0 2024-09-12T02:01:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.596+0000 7f9749ffb640 1 --2- 172.21.15.19:0/1613897051 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f973806be30 0x7f973806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.596+0000 7f9749ffb640 1 -- 172.21.15.19:0/1613897051 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f974c08b6e0 con 0x7f9754162ad0 2024-09-12T02:01:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.597+0000 7f9759755640 1 --2- 172.21.15.19:0/1613897051 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f973806be30 0x7f973806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.597+0000 7f9759755640 1 --2- 172.21.15.19:0/1613897051 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f973806be30 0x7f973806e2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9750034000 tx=0x7f975002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.601+0000 7f9749ffb640 1 -- 172.21.15.19:0/1613897051 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f97541580a0 con 0x7f9754162ad0 2024-09-12T02:01:40.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.811+0000 7f975b9b9640 1 -- 172.21.15.19:0/1613897051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9754156f30 con 0x7f9754162ad0 2024-09-12T02:01:40.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.811+0000 7f9749ffb640 1 -- 172.21.15.19:0/1613897051 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5228 (secure 0 0 0) 0x7f974c0598b0 con 0x7f9754162ad0 2024-09-12T02:01:40.812 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:40.812 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":63,"btime":"2024-09-12T02:01:23:983445+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1065573429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1065573429},{"type":"v1","addr":"172.21.15.19:6835","nonce":1065573429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3905709264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":3905709264},{"type":"v1","addr":"172.21.15.135:6837","nonce":3905709264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6082,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/836344045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":836344045},{"type":"v1","addr":"172.21.15.19:6834","nonce":836344045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:01:16.289395+0000","modified":"2024-09-12T02:01:23.435588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6088":{"gid":6088,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/1796121402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1796121402},{"type":"v1","addr":"172.21.15.135:6836","nonce":1796121402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6088,"qdb_cluster":[6088]},"id":5}]} 2024-09-12T02:01:40.812 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 63 2024-09-12T02:01:40.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.813+0000 7f975b9b9640 1 -- 172.21.15.19:0/1613897051 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f973806be30 msgr2=0x7f973806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:40.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.813+0000 7f975b9b9640 1 --2- 172.21.15.19:0/1613897051 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f973806be30 0x7f973806e2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9750034000 tx=0x7f975002e000 comp rx=0 tx=0).stop 2024-09-12T02:01:40.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.813+0000 7f975b9b9640 1 -- 172.21.15.19:0/1613897051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9754162ad0 msgr2=0x7f9754157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:40.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.813+0000 7f975b9b9640 1 --2- 172.21.15.19:0/1613897051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9754162ad0 0x7f9754157b60 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f974c007e90 tx=0x7f974c00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:01:40.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.813+0000 7f975b9b9640 1 -- 172.21.15.19:0/1613897051 shutdown_connections 2024-09-12T02:01:40.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.813+0000 7f975b9b9640 1 --2- 172.21.15.19:0/1613897051 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f973806be30 0x7f973806e2f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:40.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.813+0000 7f975b9b9640 1 --2- 172.21.15.19:0/1613897051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9754162ad0 0x7f9754157b60 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:40.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.813+0000 7f975b9b9640 1 --2- 172.21.15.19:0/1613897051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9754072490 0x7f975415b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:40.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.813+0000 7f975b9b9640 1 --2- 172.21.15.19:0/1613897051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97540720b0 0x7f9754165980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:40.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.813+0000 7f975b9b9640 1 -- 172.21.15.19:0/1613897051 >> 172.21.15.19:0/1613897051 conn(0x7f9754067d70 msgr2=0x7f9754161b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:40.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.813+0000 7f975b9b9640 1 -- 172.21.15.19:0/1613897051 shutdown_connections 2024-09-12T02:01:40.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:40.813+0000 7f975b9b9640 1 -- 172.21.15.19:0/1613897051 wait complete. 2024-09-12T02:01:40.825 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-12T02:01:45.826 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:45.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.942+0000 7f93d971a640 1 Processor -- start 2024-09-12T02:01:45.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.942+0000 7f93d971a640 1 -- start start 2024-09-12T02:01:45.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.943+0000 7f93d971a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f93d4161c80 0x7f93d406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:45.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.943+0000 7f93d971a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f93d4162060 0x7f93d40b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:45.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.943+0000 7f93d971a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d40b64b0 0x7f93d40b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:45.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.943+0000 7f93d971a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f93d406e870 con 0x7f93d4162060 2024-09-12T02:01:45.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.943+0000 7f93d971a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f93d406d9f0 con 0x7f93d4161c80 2024-09-12T02:01:45.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.943+0000 7f93d971a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f93d406dcd0 con 0x7f93d40b64b0 2024-09-12T02:01:45.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.943+0000 7f93d27fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f93d4162060 0x7f93d40b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:45.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.943+0000 7f93d27fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f93d4162060 0x7f93d40b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46496/0 (socket says 172.21.15.19:46496) 2024-09-12T02:01:45.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.943+0000 7f93d27fc640 1 -- 172.21.15.19:0/2596216957 learned_addr learned my addr 172.21.15.19:0/2596216957 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:45.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.944+0000 7f93d2ffd640 1 --2- 172.21.15.19:0/2596216957 >> v2:172.21.15.135:3300/0 conn(0x7f93d4161c80 0x7f93d406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:45.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.944+0000 7f93d37fe640 1 --2- 172.21.15.19:0/2596216957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d40b64b0 0x7f93d40b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:45.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.944+0000 7f93d27fc640 1 -- 172.21.15.19:0/2596216957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d40b64b0 msgr2=0x7f93d40b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:45.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.944+0000 7f93d27fc640 1 --2- 172.21.15.19:0/2596216957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d40b64b0 0x7f93d40b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:45.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.944+0000 7f93d27fc640 1 -- 172.21.15.19:0/2596216957 >> v2:172.21.15.135:3300/0 conn(0x7f93d4161c80 msgr2=0x7f93d406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:45.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.944+0000 7f93d27fc640 1 --2- 172.21.15.19:0/2596216957 >> v2:172.21.15.135:3300/0 conn(0x7f93d4161c80 0x7f93d406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:45.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.944+0000 7f93d27fc640 1 -- 172.21.15.19:0/2596216957 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d406dfb0 con 0x7f93d4162060 2024-09-12T02:01:45.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.944+0000 7f93d27fc640 1 --2- 172.21.15.19:0/2596216957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d4162060 0x7f93d40b5f70 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f93d408d7a0 tx=0x7f93c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a4e29e6da2ae3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:45.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.945+0000 7f93d1ffb640 1 -- 172.21.15.19:0/2596216957 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c8037070 con 0x7f93d4162060 2024-09-12T02:01:45.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.945+0000 7f93d1ffb640 1 -- 172.21.15.19:0/2596216957 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93c8032440 con 0x7f93d4162060 2024-09-12T02:01:45.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.945+0000 7f93d1ffb640 1 -- 172.21.15.19:0/2596216957 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c8032810 con 0x7f93d4162060 2024-09-12T02:01:45.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.945+0000 7f93d971a640 1 -- 172.21.15.19:0/2596216957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d4162060 msgr2=0x7f93d40b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:45.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.945+0000 7f93d971a640 1 --2- 172.21.15.19:0/2596216957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d4162060 0x7f93d40b5f70 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f93d408d7a0 tx=0x7f93c802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:01:45.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.945+0000 7f93d971a640 1 -- 172.21.15.19:0/2596216957 shutdown_connections 2024-09-12T02:01:45.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.945+0000 7f93d971a640 1 --2- 172.21.15.19:0/2596216957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d40b64b0 0x7f93d40b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:45.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.945+0000 7f93d971a640 1 --2- 172.21.15.19:0/2596216957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d4162060 0x7f93d40b5f70 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:45.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.945+0000 7f93d971a640 1 --2- 172.21.15.19:0/2596216957 >> v2:172.21.15.135:3300/0 conn(0x7f93d4161c80 0x7f93d406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:45.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.945+0000 7f93d971a640 1 -- 172.21.15.19:0/2596216957 >> 172.21.15.19:0/2596216957 conn(0x7f93d40d44f0 msgr2=0x7f93d40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:45.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.945+0000 7f93d971a640 1 -- 172.21.15.19:0/2596216957 shutdown_connections 2024-09-12T02:01:45.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.945+0000 7f93d971a640 1 -- 172.21.15.19:0/2596216957 wait complete. 2024-09-12T02:01:45.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.947+0000 7f93d971a640 1 Processor -- start 2024-09-12T02:01:45.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.947+0000 7f93d971a640 1 -- start start 2024-09-12T02:01:45.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93d971a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d40b64b0 0x7f93d415f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:45.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93d971a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d4161c80 0x7f93d4155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:45.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93d971a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d4162060 0x7f93d40ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:45.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93d971a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f93d4162500 con 0x7f93d4162060 2024-09-12T02:01:45.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93d971a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93d40d2aa0 con 0x7f93d4161c80 2024-09-12T02:01:45.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93d971a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f93d4162680 con 0x7f93d40b64b0 2024-09-12T02:01:45.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93d37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d4162060 0x7f93d40ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:45.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93d37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d4162060 0x7f93d40ca3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46508/0 (socket says 172.21.15.19:46508) 2024-09-12T02:01:45.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93d37fe640 1 -- 172.21.15.19:0/1236620210 learned_addr learned my addr 172.21.15.19:0/1236620210 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:45.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93d27fc640 1 --2- 172.21.15.19:0/1236620210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d4161c80 0x7f93d4155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:45.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93d2ffd640 1 --2- 172.21.15.19:0/1236620210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d40b64b0 0x7f93d415f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:45.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93d37fe640 1 -- 172.21.15.19:0/1236620210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d40b64b0 msgr2=0x7f93d415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:45.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93d37fe640 1 --2- 172.21.15.19:0/1236620210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d40b64b0 0x7f93d415f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:45.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93d37fe640 1 -- 172.21.15.19:0/1236620210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d4161c80 msgr2=0x7f93d4155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:45.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93d37fe640 1 --2- 172.21.15.19:0/1236620210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d4161c80 0x7f93d4155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:45.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93d37fe640 1 -- 172.21.15.19:0/1236620210 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d40c9920 con 0x7f93d4162060 2024-09-12T02:01:45.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93d37fe640 1 --2- 172.21.15.19:0/1236620210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d4162060 0x7f93d40ca3a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f93cc007e90 tx=0x7f93cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:45.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93bb7fe640 1 -- 172.21.15.19:0/1236620210 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc014420 con 0x7f93d4162060 2024-09-12T02:01:45.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93bb7fe640 1 -- 172.21.15.19:0/1236620210 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93cc019070 con 0x7f93d4162060 2024-09-12T02:01:45.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93d971a640 1 -- 172.21.15.19:0/1236620210 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d40b88b0 con 0x7f93d4162060 2024-09-12T02:01:45.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.948+0000 7f93bb7fe640 1 -- 172.21.15.19:0/1236620210 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc014820 con 0x7f93d4162060 2024-09-12T02:01:45.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.949+0000 7f93d971a640 1 -- 172.21.15.19:0/1236620210 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d40c9ba0 con 0x7f93d4162060 2024-09-12T02:01:45.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.950+0000 7f93d971a640 1 -- 172.21.15.19:0/1236620210 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93d406e330 con 0x7f93d4162060 2024-09-12T02:01:45.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.950+0000 7f93bb7fe640 1 -- 172.21.15.19:0/1236620210 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f93cc0149c0 con 0x7f93d4162060 2024-09-12T02:01:45.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.951+0000 7f93bb7fe640 1 --2- 172.21.15.19:0/1236620210 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93c006be30 0x7f93c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:45.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.951+0000 7f93bb7fe640 1 -- 172.21.15.19:0/1236620210 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f93cc08b6f0 con 0x7f93d4162060 2024-09-12T02:01:45.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.951+0000 7f93d2ffd640 1 --2- 172.21.15.19:0/1236620210 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93c006be30 0x7f93c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:45.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.952+0000 7f93d2ffd640 1 --2- 172.21.15.19:0/1236620210 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93c006be30 0x7f93c006e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f93c4006fd0 tx=0x7f93c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:45.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:45.955+0000 7f93bb7fe640 1 -- 172.21.15.19:0/1236620210 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f93d40c9920 con 0x7f93d4162060 2024-09-12T02:01:46.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:46.171+0000 7f93d971a640 1 -- 172.21.15.19:0/1236620210 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93d40cfa00 con 0x7f93d4162060 2024-09-12T02:01:46.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:46.171+0000 7f93bb7fe640 1 -- 172.21.15.19:0/1236620210 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5228 (secure 0 0 0) 0x7f93cc0600e0 con 0x7f93d4162060 2024-09-12T02:01:46.172 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:46.172 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":63,"btime":"2024-09-12T02:01:23:983445+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1065573429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1065573429},{"type":"v1","addr":"172.21.15.19:6835","nonce":1065573429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3905709264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":3905709264},{"type":"v1","addr":"172.21.15.135:6837","nonce":3905709264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6082,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/836344045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":836344045},{"type":"v1","addr":"172.21.15.19:6834","nonce":836344045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:01:16.289395+0000","modified":"2024-09-12T02:01:23.435588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6088":{"gid":6088,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/1796121402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1796121402},{"type":"v1","addr":"172.21.15.135:6836","nonce":1796121402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6088,"qdb_cluster":[6088]},"id":5}]} 2024-09-12T02:01:46.172 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 63 2024-09-12T02:01:46.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:46.173+0000 7f93d971a640 1 -- 172.21.15.19:0/1236620210 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93c006be30 msgr2=0x7f93c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:46.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:46.173+0000 7f93d971a640 1 --2- 172.21.15.19:0/1236620210 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93c006be30 0x7f93c006e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f93c4006fd0 tx=0x7f93c4008040 comp rx=0 tx=0).stop 2024-09-12T02:01:46.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:46.173+0000 7f93d971a640 1 -- 172.21.15.19:0/1236620210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d4162060 msgr2=0x7f93d40ca3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:46.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:46.173+0000 7f93d971a640 1 --2- 172.21.15.19:0/1236620210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d4162060 0x7f93d40ca3a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f93cc007e90 tx=0x7f93cc00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:01:46.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:46.173+0000 7f93d971a640 1 -- 172.21.15.19:0/1236620210 shutdown_connections 2024-09-12T02:01:46.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:46.173+0000 7f93d971a640 1 --2- 172.21.15.19:0/1236620210 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93c006be30 0x7f93c006e2f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:46.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:46.173+0000 7f93d971a640 1 --2- 172.21.15.19:0/1236620210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d4162060 0x7f93d40ca3a0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:46.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:46.173+0000 7f93d971a640 1 --2- 172.21.15.19:0/1236620210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d4161c80 0x7f93d4155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:46.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:46.173+0000 7f93d971a640 1 --2- 172.21.15.19:0/1236620210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d40b64b0 0x7f93d415f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:46.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:46.173+0000 7f93d971a640 1 -- 172.21.15.19:0/1236620210 >> 172.21.15.19:0/1236620210 conn(0x7f93d40d44f0 msgr2=0x7f93d40b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:46.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:46.173+0000 7f93d971a640 1 -- 172.21.15.19:0/1236620210 shutdown_connections 2024-09-12T02:01:46.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:46.173+0000 7f93d971a640 1 -- 172.21.15.19:0/1236620210 wait complete. 2024-09-12T02:01:46.185 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-12T02:01:46.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~13s 2024-09-12T02:01:51.186 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:51.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.301+0000 7faec67e4640 1 Processor -- start 2024-09-12T02:01:51.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.301+0000 7faec67e4640 1 -- start start 2024-09-12T02:01:51.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.302+0000 7faec67e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faec0072320 0x7faec00cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:51.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.302+0000 7faec67e4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faec0072de0 0x7faec006e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:51.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.302+0000 7faec67e4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faec0146140 con 0x7faec0072700 2024-09-12T02:01:51.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.302+0000 7faec67e4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7faec00cd740 con 0x7faec0072de0 2024-09-12T02:01:51.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.302+0000 7faec67e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7faec00cda20 con 0x7faec0072320 2024-09-12T02:01:51.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.302+0000 7faebf7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faec0072de0 0x7faec006e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.302+0000 7faebf7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faec0072de0 0x7faec006e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56728/0 (socket says 172.21.15.19:56728) 2024-09-12T02:01:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.302+0000 7faebf7fe640 1 -- 172.21.15.19:0/54952107 learned_addr learned my addr 172.21.15.19:0/54952107 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.302+0000 7faec4d81640 1 --1- 172.21.15.19:0/54952107 >> v1:172.21.15.19:6789/0 conn(0x7faec0072700 0x7faec006e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34970/0 (socket says 172.21.15.19:34970) 2024-09-12T02:01:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.303+0000 7faebffff640 1 --2- 172.21.15.19:0/54952107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faec0072320 0x7faec00cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.303+0000 7faebf7fe640 1 -- 172.21.15.19:0/54952107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faec0072320 msgr2=0x7faec00cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.303+0000 7faebf7fe640 1 --2- 172.21.15.19:0/54952107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faec0072320 0x7faec00cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.303+0000 7faebf7fe640 1 -- 172.21.15.19:0/54952107 >> v1:172.21.15.19:6789/0 conn(0x7faec0072700 legacy=0x7faec006e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.303+0000 7faebf7fe640 1 -- 172.21.15.19:0/54952107 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec00cdd00 con 0x7faec0072de0 2024-09-12T02:01:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.303+0000 7faebeffd640 1 -- 172.21.15.19:0/54952107 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1821044377 0 0) 0x7faec0146140 con 0x7faec0072700 2024-09-12T02:01:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.303+0000 7faebf7fe640 1 --2- 172.21.15.19:0/54952107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec0072de0 0x7faec006e0b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009870 tx=0x7faeb402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea3650cf7f13dd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.304+0000 7faebeffd640 1 -- 172.21.15.19:0/54952107 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb4037070 con 0x7faec0072de0 2024-09-12T02:01:51.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.304+0000 7faebeffd640 1 -- 172.21.15.19:0/54952107 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb4032440 con 0x7faec0072de0 2024-09-12T02:01:51.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.304+0000 7faebeffd640 1 -- 172.21.15.19:0/54952107 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb4032810 con 0x7faec0072de0 2024-09-12T02:01:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.304+0000 7faec67e4640 1 -- 172.21.15.19:0/54952107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec0072de0 msgr2=0x7faec006e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.304+0000 7faec67e4640 1 --2- 172.21.15.19:0/54952107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec0072de0 0x7faec006e0b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009870 tx=0x7faeb402a1c0 comp rx=0 tx=0).stop 2024-09-12T02:01:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.304+0000 7faec67e4640 1 -- 172.21.15.19:0/54952107 shutdown_connections 2024-09-12T02:01:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.304+0000 7faec67e4640 1 --2- 172.21.15.19:0/54952107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec0072de0 0x7faec006e0b0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.304+0000 7faec67e4640 1 --2- 172.21.15.19:0/54952107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faec0072320 0x7faec00cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.304+0000 7faec67e4640 1 -- 172.21.15.19:0/54952107 >> 172.21.15.19:0/54952107 conn(0x7faec0067d70 msgr2=0x7faec006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.304+0000 7faec67e4640 1 -- 172.21.15.19:0/54952107 shutdown_connections 2024-09-12T02:01:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.304+0000 7faec67e4640 1 -- 172.21.15.19:0/54952107 wait complete. 2024-09-12T02:01:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.305+0000 7faec67e4640 1 Processor -- start 2024-09-12T02:01:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.306+0000 7faec67e4640 1 -- start start 2024-09-12T02:01:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.306+0000 7faec67e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faec0072320 0x7faec0140f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.306+0000 7faec67e4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0072700 0x7faec00b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.306+0000 7faec67e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec0072de0 0x7faec00cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.306+0000 7faec67e4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7faec00cd520 con 0x7faec0072de0 2024-09-12T02:01:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.306+0000 7faec67e4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faec00cd3a0 con 0x7faec0072700 2024-09-12T02:01:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.306+0000 7faec67e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7faec006ed00 con 0x7faec0072320 2024-09-12T02:01:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.307+0000 7faec4d81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec0072de0 0x7faec00cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.307+0000 7faec4d81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec0072de0 0x7faec00cad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56736/0 (socket says 172.21.15.19:56736) 2024-09-12T02:01:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.307+0000 7faec4d81640 1 -- 172.21.15.19:0/1630854112 learned_addr learned my addr 172.21.15.19:0/1630854112 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.307+0000 7faebffff640 1 --2- 172.21.15.19:0/1630854112 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faec0072320 0x7faec0140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.307+0000 7faebf7fe640 1 --2- 172.21.15.19:0/1630854112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0072700 0x7faec00b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.307+0000 7faec4d81640 1 -- 172.21.15.19:0/1630854112 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faec0072320 msgr2=0x7faec0140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:51.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.307+0000 7faec4d81640 1 --2- 172.21.15.19:0/1630854112 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faec0072320 0x7faec0140f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:51.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.307+0000 7faec4d81640 1 -- 172.21.15.19:0/1630854112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0072700 msgr2=0x7faec00b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:51.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.307+0000 7faec4d81640 1 --2- 172.21.15.19:0/1630854112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0072700 0x7faec00b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:51.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.307+0000 7faec4d81640 1 -- 172.21.15.19:0/1630854112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec0141450 con 0x7faec0072de0 2024-09-12T02:01:51.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.307+0000 7faec4d81640 1 --2- 172.21.15.19:0/1630854112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec0072de0 0x7faec00cad80 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7faeb800c7e0 tx=0x7faeb800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:51.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.307+0000 7faebcff9640 1 -- 172.21.15.19:0/1630854112 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8018070 con 0x7faec0072de0 2024-09-12T02:01:51.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.307+0000 7faebcff9640 1 -- 172.21.15.19:0/1630854112 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb800a5e0 con 0x7faec0072de0 2024-09-12T02:01:51.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.307+0000 7faec67e4640 1 -- 172.21.15.19:0/1630854112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec00af1d0 con 0x7faec0072de0 2024-09-12T02:01:51.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.307+0000 7faebcff9640 1 -- 172.21.15.19:0/1630854112 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb800a9d0 con 0x7faec0072de0 2024-09-12T02:01:51.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.307+0000 7faec67e4640 1 -- 172.21.15.19:0/1630854112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec00af790 con 0x7faec0072de0 2024-09-12T02:01:51.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.309+0000 7faec67e4640 1 -- 172.21.15.19:0/1630854112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec00cce60 con 0x7faec0072de0 2024-09-12T02:01:51.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.309+0000 7faebcff9640 1 -- 172.21.15.19:0/1630854112 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faeb801b070 con 0x7faec0072de0 2024-09-12T02:01:51.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.309+0000 7faebcff9640 1 --2- 172.21.15.19:0/1630854112 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faeac06be30 0x7faeac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:51.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.310+0000 7faebcff9640 1 -- 172.21.15.19:0/1630854112 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7faeb808a540 con 0x7faec0072de0 2024-09-12T02:01:51.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.310+0000 7faebffff640 1 --2- 172.21.15.19:0/1630854112 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faeac06be30 0x7faeac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:51.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.310+0000 7faebffff640 1 --2- 172.21.15.19:0/1630854112 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faeac06be30 0x7faeac06e2f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7faeb0006fd0 tx=0x7faeb0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:51.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.314+0000 7faebcff9640 1 -- 172.21.15.19:0/1630854112 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faec0141450 con 0x7faec0072de0 2024-09-12T02:01:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.528+0000 7faec67e4640 1 -- 172.21.15.19:0/1630854112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faec0075790 con 0x7faec0072de0 2024-09-12T02:01:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.529+0000 7faebcff9640 1 -- 172.21.15.19:0/1630854112 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5276 (secure 0 0 0) 0x7faeb8058710 con 0x7faec0072de0 2024-09-12T02:01:51.529 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:51.529 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":64,"btime":"2024-09-12T02:01:46:706762+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1065573429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1065573429},{"type":"v1","addr":"172.21.15.19:6835","nonce":1065573429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3905709264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":3905709264},{"type":"v1","addr":"172.21.15.135:6837","nonce":3905709264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6082,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/836344045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":836344045},{"type":"v1","addr":"172.21.15.19:6834","nonce":836344045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:01:16.289395+0000","modified":"2024-09-12T02:01:46.706739+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6088":{"gid":6088,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/1796121402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1796121402},{"type":"v1","addr":"172.21.15.135:6836","nonce":1796121402}]},"join_fscid":-1,"laggy_since":"2024-09-12T02:01:46.706739+0000","export_targets":[],"features":4540701547738038271,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6088,"qdb_cluster":[6088]},"id":5}]} 2024-09-12T02:01:51.530 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 64 2024-09-12T02:01:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.531+0000 7faec67e4640 1 -- 172.21.15.19:0/1630854112 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faeac06be30 msgr2=0x7faeac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.531+0000 7faec67e4640 1 --2- 172.21.15.19:0/1630854112 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faeac06be30 0x7faeac06e2f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7faeb0006fd0 tx=0x7faeb0008040 comp rx=0 tx=0).stop 2024-09-12T02:01:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.531+0000 7faec67e4640 1 -- 172.21.15.19:0/1630854112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec0072de0 msgr2=0x7faec00cad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.531+0000 7faec67e4640 1 --2- 172.21.15.19:0/1630854112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec0072de0 0x7faec00cad80 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7faeb800c7e0 tx=0x7faeb800cca0 comp rx=0 tx=0).stop 2024-09-12T02:01:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.531+0000 7faec67e4640 1 -- 172.21.15.19:0/1630854112 shutdown_connections 2024-09-12T02:01:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.531+0000 7faec67e4640 1 --2- 172.21.15.19:0/1630854112 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faeac06be30 0x7faeac06e2f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.531+0000 7faec67e4640 1 --2- 172.21.15.19:0/1630854112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec0072de0 0x7faec00cad80 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.531+0000 7faec67e4640 1 --2- 172.21.15.19:0/1630854112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0072700 0x7faec00b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.531+0000 7faec67e4640 1 --2- 172.21.15.19:0/1630854112 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faec0072320 0x7faec0140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.531+0000 7faec67e4640 1 -- 172.21.15.19:0/1630854112 >> 172.21.15.19:0/1630854112 conn(0x7faec0067d70 msgr2=0x7faec00c6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.531+0000 7faec67e4640 1 -- 172.21.15.19:0/1630854112 shutdown_connections 2024-09-12T02:01:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.531+0000 7faec67e4640 1 -- 172.21.15.19:0/1630854112 wait complete. 2024-09-12T02:01:51.543 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2024-09-12T02:01:51.644 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_inject_rename_corrupt_dentry_first 2024-09-12T02:01:51.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.749+0000 7f9e2b21e640 1 Processor -- start 2024-09-12T02:01:51.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.749+0000 7f9e2b21e640 1 -- start start 2024-09-12T02:01:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.750+0000 7f9e2b21e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9e2409aa30 0x7f9e240b3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.750+0000 7f9e2b21e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e240b60c0 con 0x7f9e2415f910 2024-09-12T02:01:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.750+0000 7f9e2b21e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e240b63a0 con 0x7f9e2406c320 2024-09-12T02:01:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.750+0000 7f9e2b21e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f9e240b0d40 con 0x7f9e2409aa30 2024-09-12T02:01:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.750+0000 7f9e28fba640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9e2415f910 0x7f9e2406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34980/0 (socket says 172.21.15.19:34980) 2024-09-12T02:01:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.750+0000 7f9e28fba640 1 -- 172.21.15.19:0/388305087 learned_addr learned my addr 172.21.15.19:0/388305087 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.750+0000 7f9e297bb640 1 --2- 172.21.15.19:0/388305087 >> v2:172.21.15.19:3300/0 conn(0x7f9e2409aa30 0x7f9e240b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.750+0000 7f9e237fe640 1 -- 172.21.15.19:0/388305087 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 137282007 0 0) 0x7f9e240b60c0 con 0x7f9e2415f910 2024-09-12T02:01:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.750+0000 7f9e237fe640 1 -- 172.21.15.19:0/388305087 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e14003520 con 0x7f9e2415f910 2024-09-12T02:01:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.750+0000 7f9e297bb640 1 -- 172.21.15.19:0/388305087 >> v1:172.21.15.135:6789/0 conn(0x7f9e2406c320 legacy=0x7f9e240b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.750+0000 7f9e297bb640 1 -- 172.21.15.19:0/388305087 >> v1:172.21.15.19:6789/0 conn(0x7f9e2415f910 legacy=0x7f9e2406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.750+0000 7f9e297bb640 1 -- 172.21.15.19:0/388305087 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e240b6680 con 0x7f9e2409aa30 2024-09-12T02:01:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.751+0000 7f9e297bb640 1 --2- 172.21.15.19:0/388305087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e2409aa30 0x7f9e240b3670 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009d90 tx=0x7f9e1c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b3c4e48db93715 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.751+0000 7f9e237fe640 1 -- 172.21.15.19:0/388305087 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c007740 con 0x7f9e2409aa30 2024-09-12T02:01:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.751+0000 7f9e237fe640 1 -- 172.21.15.19:0/388305087 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e1c0078e0 con 0x7f9e2409aa30 2024-09-12T02:01:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.751+0000 7f9e237fe640 1 -- 172.21.15.19:0/388305087 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c007cb0 con 0x7f9e2409aa30 2024-09-12T02:01:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.752+0000 7f9e2b21e640 1 -- 172.21.15.19:0/388305087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e2409aa30 msgr2=0x7f9e240b3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.752+0000 7f9e2b21e640 1 --2- 172.21.15.19:0/388305087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e2409aa30 0x7f9e240b3670 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009d90 tx=0x7f9e1c02a660 comp rx=0 tx=0).stop 2024-09-12T02:01:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.752+0000 7f9e2b21e640 1 -- 172.21.15.19:0/388305087 shutdown_connections 2024-09-12T02:01:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.752+0000 7f9e2b21e640 1 --2- 172.21.15.19:0/388305087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e2409aa30 0x7f9e240b3670 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.752+0000 7f9e2b21e640 1 -- 172.21.15.19:0/388305087 >> 172.21.15.19:0/388305087 conn(0x7f9e24073490 msgr2=0x7f9e240b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.752+0000 7f9e2b21e640 1 -- 172.21.15.19:0/388305087 shutdown_connections 2024-09-12T02:01:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.752+0000 7f9e2b21e640 1 -- 172.21.15.19:0/388305087 wait complete. 2024-09-12T02:01:51.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.753+0000 7f9e2b21e640 1 Processor -- start 2024-09-12T02:01:51.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.753+0000 7f9e2b21e640 1 -- start start 2024-09-12T02:01:51.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.754+0000 7f9e2b21e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e2406c320 0x7f9e24153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.754+0000 7f9e2b21e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e2409aa30 0x7f9e241477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.754+0000 7f9e2b21e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e2415f910 0x7f9e24147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.754+0000 7f9e2b21e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2415fcf0 con 0x7f9e2415f910 2024-09-12T02:01:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.754+0000 7f9e2b21e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9e240b3bb0 con 0x7f9e2406c320 2024-09-12T02:01:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.754+0000 7f9e2b21e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9e240b0510 con 0x7f9e2409aa30 2024-09-12T02:01:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.754+0000 7f9e297bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e2415f910 0x7f9e24147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.754+0000 7f9e297bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e2415f910 0x7f9e24147d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56764/0 (socket says 172.21.15.19:56764) 2024-09-12T02:01:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.754+0000 7f9e297bb640 1 -- 172.21.15.19:0/3901016122 learned_addr learned my addr 172.21.15.19:0/3901016122 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.754+0000 7f9e28fba640 1 --2- 172.21.15.19:0/3901016122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e2406c320 0x7f9e24153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.754+0000 7f9e297bb640 1 -- 172.21.15.19:0/3901016122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e2409aa30 msgr2=0x7f9e241477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.754+0000 7f9e23fff640 1 --2- 172.21.15.19:0/3901016122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e2409aa30 0x7f9e241477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.754+0000 7f9e297bb640 1 --2- 172.21.15.19:0/3901016122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e2409aa30 0x7f9e241477f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.754+0000 7f9e297bb640 1 -- 172.21.15.19:0/3901016122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e2406c320 msgr2=0x7f9e24153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.754+0000 7f9e297bb640 1 --2- 172.21.15.19:0/3901016122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e2406c320 0x7f9e24153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.754+0000 7f9e297bb640 1 -- 172.21.15.19:0/3901016122 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e2409e7a0 con 0x7f9e2415f910 2024-09-12T02:01:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.754+0000 7f9e28fba640 1 --2- 172.21.15.19:0/3901016122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e2406c320 0x7f9e24153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.755+0000 7f9e297bb640 1 --2- 172.21.15.19:0/3901016122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e2415f910 0x7f9e24147d30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009eb0 tx=0x7f9e1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.755+0000 7f9e217fa640 1 -- 172.21.15.19:0/3901016122 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c040070 con 0x7f9e2415f910 2024-09-12T02:01:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.755+0000 7f9e217fa640 1 -- 172.21.15.19:0/3901016122 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e1c031bc0 con 0x7f9e2415f910 2024-09-12T02:01:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.755+0000 7f9e2b21e640 1 -- 172.21.15.19:0/3901016122 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e2409ea80 con 0x7f9e2415f910 2024-09-12T02:01:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.755+0000 7f9e217fa640 1 -- 172.21.15.19:0/3901016122 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c009450 con 0x7f9e2415f910 2024-09-12T02:01:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.755+0000 7f9e2b21e640 1 -- 172.21.15.19:0/3901016122 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e2409f040 con 0x7f9e2415f910 2024-09-12T02:01:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.756+0000 7f9e2b21e640 1 -- 172.21.15.19:0/3901016122 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e240b3670 con 0x7f9e2415f910 2024-09-12T02:01:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.756+0000 7f9e217fa640 1 -- 172.21.15.19:0/3901016122 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e1c039040 con 0x7f9e2415f910 2024-09-12T02:01:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.757+0000 7f9e217fa640 1 --2- 172.21.15.19:0/3901016122 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e0806be30 0x7f9e0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.757+0000 7f9e217fa640 1 -- 172.21.15.19:0/3901016122 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f9e1c0ac880 con 0x7f9e2415f910 2024-09-12T02:01:51.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.757+0000 7f9e28fba640 1 --2- 172.21.15.19:0/3901016122 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e0806be30 0x7f9e0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:51.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.758+0000 7f9e28fba640 1 --2- 172.21.15.19:0/3901016122 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e0806be30 0x7f9e0806e2f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9e180011e0 tx=0x7f9e18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:51.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.761+0000 7f9e217fa640 1 -- 172.21.15.19:0/3901016122 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e1c07b0a0 con 0x7f9e2415f910 2024-09-12T02:01:51.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.937+0000 7f9e2b21e640 1 -- 172.21.15.19:0/3901016122 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"} v 0) -- 0x7f9e2415b1b0 con 0x7f9e2415f910 2024-09-12T02:01:51.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.941+0000 7f9e217fa640 1 -- 172.21.15.19:0/3901016122 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"}]=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7f9e1c07a9a0 con 0x7f9e2415f910 2024-09-12T02:01:51.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.943+0000 7f9e2b21e640 1 -- 172.21.15.19:0/3901016122 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e0806be30 msgr2=0x7f9e0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:51.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.943+0000 7f9e2b21e640 1 --2- 172.21.15.19:0/3901016122 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e0806be30 0x7f9e0806e2f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9e180011e0 tx=0x7f9e18009040 comp rx=0 tx=0).stop 2024-09-12T02:01:51.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.943+0000 7f9e2b21e640 1 -- 172.21.15.19:0/3901016122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e2415f910 msgr2=0x7f9e24147d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:51.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.943+0000 7f9e2b21e640 1 --2- 172.21.15.19:0/3901016122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e2415f910 0x7f9e24147d30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009eb0 tx=0x7f9e1c004a40 comp rx=0 tx=0).stop 2024-09-12T02:01:51.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.943+0000 7f9e2b21e640 1 -- 172.21.15.19:0/3901016122 shutdown_connections 2024-09-12T02:01:51.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.943+0000 7f9e2b21e640 1 --2- 172.21.15.19:0/3901016122 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e0806be30 0x7f9e0806e2f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:51.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.943+0000 7f9e2b21e640 1 --2- 172.21.15.19:0/3901016122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e2415f910 0x7f9e24147d30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:51.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.943+0000 7f9e2b21e640 1 --2- 172.21.15.19:0/3901016122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e2409aa30 0x7f9e241477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:51.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.943+0000 7f9e2b21e640 1 --2- 172.21.15.19:0/3901016122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e2406c320 0x7f9e24153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:51.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.943+0000 7f9e2b21e640 1 -- 172.21.15.19:0/3901016122 >> 172.21.15.19:0/3901016122 conn(0x7f9e24073490 msgr2=0x7f9e240b5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:51.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.943+0000 7f9e2b21e640 1 -- 172.21.15.19:0/3901016122 shutdown_connections 2024-09-12T02:01:51.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:51.943+0000 7f9e2b21e640 1 -- 172.21.15.19:0/3901016122 wait complete. 2024-09-12T02:01:51.954 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 5:0 false 2024-09-12T02:01:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.058+0000 7f946854b640 1 Processor -- start 2024-09-12T02:01:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.058+0000 7f946854b640 1 -- start start 2024-09-12T02:01:52.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.059+0000 7f946854b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9460161920 0x7f94600b5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.059+0000 7f946854b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f94600b62b0 0x7f94600d2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.059+0000 7f946854b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94600d4300 con 0x7f9460161d00 2024-09-12T02:01:52.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.059+0000 7f946854b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f94600b49a0 con 0x7f94600b62b0 2024-09-12T02:01:52.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.059+0000 7f946854b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f94600b4c40 con 0x7f9460161920 2024-09-12T02:01:52.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.059+0000 7f9465ae6640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9460161d00 0x7f94600b5ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34990/0 (socket says 172.21.15.19:34990) 2024-09-12T02:01:52.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.059+0000 7f9466ae8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f94600b62b0 0x7f94600d2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.059+0000 7f9465ae6640 1 -- 172.21.15.19:0/470365550 learned_addr learned my addr 172.21.15.19:0/470365550 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:52.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.059+0000 7f94662e7640 1 --2- 172.21.15.19:0/470365550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9460161920 0x7f94600b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.059+0000 7f9466ae8640 1 -- 172.21.15.19:0/470365550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9460161920 msgr2=0x7f94600b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:52.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.059+0000 7f9466ae8640 1 --2- 172.21.15.19:0/470365550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9460161920 0x7f94600b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.059+0000 7f9466ae8640 1 -- 172.21.15.19:0/470365550 >> v1:172.21.15.19:6789/0 conn(0x7f9460161d00 legacy=0x7f94600b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:52.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.059+0000 7f9466ae8640 1 -- 172.21.15.19:0/470365550 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94600d4db0 con 0x7f94600b62b0 2024-09-12T02:01:52.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.060+0000 7f9466ae8640 1 --2- 172.21.15.19:0/470365550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94600b62b0 0x7f94600d2600 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f94600d44d0 tx=0x7f945802a520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7d37d905c9a15b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:52.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.060+0000 7f94652e5640 1 -- 172.21.15.19:0/470365550 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9458007740 con 0x7f94600b62b0 2024-09-12T02:01:52.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.060+0000 7f94652e5640 1 -- 172.21.15.19:0/470365550 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94580078e0 con 0x7f94600b62b0 2024-09-12T02:01:52.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.060+0000 7f94652e5640 1 -- 172.21.15.19:0/470365550 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9458007cb0 con 0x7f94600b62b0 2024-09-12T02:01:52.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.061+0000 7f946854b640 1 -- 172.21.15.19:0/470365550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94600b62b0 msgr2=0x7f94600d2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:52.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.061+0000 7f946854b640 1 --2- 172.21.15.19:0/470365550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94600b62b0 0x7f94600d2600 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f94600d44d0 tx=0x7f945802a520 comp rx=0 tx=0).stop 2024-09-12T02:01:52.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.061+0000 7f946854b640 1 -- 172.21.15.19:0/470365550 shutdown_connections 2024-09-12T02:01:52.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.061+0000 7f946854b640 1 --2- 172.21.15.19:0/470365550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94600b62b0 0x7f94600d2600 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.061+0000 7f946854b640 1 --2- 172.21.15.19:0/470365550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9460161920 0x7f94600b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.061+0000 7f946854b640 1 -- 172.21.15.19:0/470365550 >> 172.21.15.19:0/470365550 conn(0x7f946008bfc0 msgr2=0x7f94600d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:52.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.061+0000 7f946854b640 1 -- 172.21.15.19:0/470365550 shutdown_connections 2024-09-12T02:01:52.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.061+0000 7f946854b640 1 -- 172.21.15.19:0/470365550 wait complete. 2024-09-12T02:01:52.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.062+0000 7f946854b640 1 Processor -- start 2024-09-12T02:01:52.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.062+0000 7f946854b640 1 -- start start 2024-09-12T02:01:52.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.063+0000 7f946854b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94600b62b0 0x7f94601f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.063+0000 7f946854b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9460161920 0x7f9460152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.063+0000 7f946854b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9460161d00 0x7f94600b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.063+0000 7f946854b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f94600d2b40 con 0x7f9460161920 2024-09-12T02:01:52.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.063+0000 7f946854b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f94600b6910 con 0x7f9460161d00 2024-09-12T02:01:52.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.063+0000 7f946854b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f94600d2cc0 con 0x7f94600b62b0 2024-09-12T02:01:52.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.063+0000 7f9465ae6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9460161920 0x7f9460152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.063+0000 7f9465ae6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9460161920 0x7f9460152b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56772/0 (socket says 172.21.15.19:56772) 2024-09-12T02:01:52.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.063+0000 7f9465ae6640 1 -- 172.21.15.19:0/909592646 learned_addr learned my addr 172.21.15.19:0/909592646 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:52.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.063+0000 7f94662e7640 1 --2- 172.21.15.19:0/909592646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94600b62b0 0x7f94601f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.063+0000 7f9466ae8640 1 --2- 172.21.15.19:0/909592646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9460161d00 0x7f94600b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.063+0000 7f9465ae6640 1 -- 172.21.15.19:0/909592646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94600b62b0 msgr2=0x7f94601f43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:52.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.063+0000 7f9465ae6640 1 --2- 172.21.15.19:0/909592646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94600b62b0 0x7f94601f43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.063+0000 7f9465ae6640 1 -- 172.21.15.19:0/909592646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9460161d00 msgr2=0x7f94600b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:52.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.063+0000 7f9465ae6640 1 --2- 172.21.15.19:0/909592646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9460161d00 0x7f94600b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.063+0000 7f9465ae6640 1 -- 172.21.15.19:0/909592646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94601f4920 con 0x7f9460161920 2024-09-12T02:01:52.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.064+0000 7f9465ae6640 1 --2- 172.21.15.19:0/909592646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9460161920 0x7f9460152b10 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f945000c3c0 tx=0x7f945000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:52.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.064+0000 7f9456ffd640 1 -- 172.21.15.19:0/909592646 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9450017070 con 0x7f9460161920 2024-09-12T02:01:52.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.064+0000 7f9456ffd640 1 -- 172.21.15.19:0/909592646 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9450005ce0 con 0x7f9460161920 2024-09-12T02:01:52.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.064+0000 7f946854b640 1 -- 172.21.15.19:0/909592646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9460153050 con 0x7f9460161920 2024-09-12T02:01:52.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.064+0000 7f9456ffd640 1 -- 172.21.15.19:0/909592646 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94500072f0 con 0x7f9460161920 2024-09-12T02:01:52.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.064+0000 7f946854b640 1 -- 172.21.15.19:0/909592646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94600c91c0 con 0x7f9460161920 2024-09-12T02:01:52.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.065+0000 7f946854b640 1 -- 172.21.15.19:0/909592646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94600d2600 con 0x7f9460161920 2024-09-12T02:01:52.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.065+0000 7f9456ffd640 1 -- 172.21.15.19:0/909592646 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f945001a070 con 0x7f9460161920 2024-09-12T02:01:52.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.066+0000 7f9456ffd640 1 --2- 172.21.15.19:0/909592646 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f944406be30 0x7f944406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.066+0000 7f9456ffd640 1 -- 172.21.15.19:0/909592646 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f945008a380 con 0x7f9460161920 2024-09-12T02:01:52.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.066+0000 7f94662e7640 1 --2- 172.21.15.19:0/909592646 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f944406be30 0x7f944406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.067+0000 7f94662e7640 1 --2- 172.21.15.19:0/909592646 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f944406be30 0x7f944406e2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f945c006fd0 tx=0x7f945c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:52.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.071+0000 7f9456ffd640 1 -- 172.21.15.19:0/909592646 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9460153050 con 0x7f9460161920 2024-09-12T02:01:52.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.314+0000 7f946854b640 1 -- 172.21.15.19:0/909592646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "5:0", "val": "false"} v 0) -- 0x7f946006e0b0 con 0x7f9460161920 2024-09-12T02:01:52.869 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~20s 2024-09-12T02:01:52.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.943+0000 7f9456ffd640 1 -- 172.21.15.19:0/909592646 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "5:0", "val": "false"}]=0 unfreezing mds.6088 v65) ==== 115+0+0 (secure 0 0 0) 0x7f94500584c0 con 0x7f9460161920 2024-09-12T02:01:52.944 INFO:teuthology.orchestra.run.smithi019.stderr:unfreezing mds.6088 2024-09-12T02:01:52.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.946+0000 7f946854b640 1 -- 172.21.15.19:0/909592646 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f944406be30 msgr2=0x7f944406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:52.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.946+0000 7f946854b640 1 --2- 172.21.15.19:0/909592646 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f944406be30 0x7f944406e2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f945c006fd0 tx=0x7f945c008040 comp rx=0 tx=0).stop 2024-09-12T02:01:52.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.946+0000 7f946854b640 1 -- 172.21.15.19:0/909592646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9460161920 msgr2=0x7f9460152b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:52.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.946+0000 7f946854b640 1 --2- 172.21.15.19:0/909592646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9460161920 0x7f9460152b10 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f945000c3c0 tx=0x7f945000c880 comp rx=0 tx=0).stop 2024-09-12T02:01:52.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.946+0000 7f946854b640 1 -- 172.21.15.19:0/909592646 shutdown_connections 2024-09-12T02:01:52.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.946+0000 7f946854b640 1 --2- 172.21.15.19:0/909592646 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f944406be30 0x7f944406e2f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.946+0000 7f946854b640 1 --2- 172.21.15.19:0/909592646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9460161d00 0x7f94600b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.946+0000 7f946854b640 1 --2- 172.21.15.19:0/909592646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9460161920 0x7f9460152b10 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.946+0000 7f946854b640 1 --2- 172.21.15.19:0/909592646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94600b62b0 0x7f94601f43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.946+0000 7f946854b640 1 -- 172.21.15.19:0/909592646 >> 172.21.15.19:0/909592646 conn(0x7f946008bfc0 msgr2=0x7f94600ceb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:52.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.946+0000 7f946854b640 1 -- 172.21.15.19:0/909592646 shutdown_connections 2024-09-12T02:01:52.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:52.946+0000 7f946854b640 1 -- 172.21.15.19:0/909592646 wait complete. 2024-09-12T02:01:52.963 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -n kernel.core_pattern 2024-09-12T02:01:52.989 INFO:teuthology.orchestra.run.smithi135.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:01:52.990 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:01:52.991 DEBUG:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2024-09-12T02:01:53.060 INFO:teuthology.orchestra.run.smithi135.stdout:1726106489.44056.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i b', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2024-09-12T02:01:53.062 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1726106489.44056.core'] 2024-09-12T02:01:53.062 INFO:tasks.cephfs.cephfs_test_case:Found core file 1726106489.44056.core, deleting it 2024-09-12T02:01:53.063 DEBUG:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1726106489.44056.core 2024-09-12T02:01:53.132 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:01:53.132 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:01:53.132 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:01:53.132 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:01:53.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:01:53.133 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/daemon/state.py", line 146, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi135 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2024-09-12T02:01:53.133 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:01:53.133 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:01:53.175 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:01:53.175 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:53.249 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2024-09-12T02:01:53.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.287+0000 7f365fab7640 1 Processor -- start 2024-09-12T02:01:53.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.287+0000 7f365fab7640 1 -- start start 2024-09-12T02:01:53.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.288+0000 7f365fab7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f365815e760 0x7f365806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:53.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.288+0000 7f365fab7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36580cfcc0 0x7f36580d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:53.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.288+0000 7f365fab7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36580d2700 con 0x7f36580d4fd0 2024-09-12T02:01:53.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.288+0000 7f365fab7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f36580cedb0 con 0x7f365815e760 2024-09-12T02:01:53.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.288+0000 7f365fab7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f36580cf090 con 0x7f36580cfcc0 2024-09-12T02:01:53.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.288+0000 7f365e054640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36580cfcc0 0x7f36580d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:53.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.288+0000 7f365d853640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f365815e760 0x7f365806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:53.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.288+0000 7f365d052640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f36580d4fd0 0x7f36580cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:46484/0 (socket says 172.21.15.19:46484) 2024-09-12T02:01:53.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.289+0000 7f365d052640 1 -- 172.21.15.19:0/3438712843 learned_addr learned my addr 172.21.15.19:0/3438712843 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:53.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.289+0000 7f365e054640 1 -- 172.21.15.19:0/3438712843 >> v2:172.21.15.135:3300/0 conn(0x7f365815e760 msgr2=0x7f365806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:53.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.289+0000 7f365e054640 1 --2- 172.21.15.19:0/3438712843 >> v2:172.21.15.135:3300/0 conn(0x7f365815e760 0x7f365806cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:53.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.289+0000 7f365e054640 1 -- 172.21.15.19:0/3438712843 >> v1:172.21.15.135:6789/0 conn(0x7f36580d4fd0 legacy=0x7f36580cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:53.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.289+0000 7f365e054640 1 -- 172.21.15.19:0/3438712843 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36580b3c80 con 0x7f36580cfcc0 2024-09-12T02:01:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.289+0000 7f365d853640 1 --2- 172.21.15.19:0/3438712843 >> v2:172.21.15.135:3300/0 conn(0x7f365815e760 0x7f365806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.290+0000 7f365e054640 1 --2- 172.21.15.19:0/3438712843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36580cfcc0 0x7f36580d2ea0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3650009d90 tx=0x7f365002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37b1017a2cecd956 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.290+0000 7f365c851640 1 -- 172.21.15.19:0/3438712843 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3650007740 con 0x7f36580cfcc0 2024-09-12T02:01:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.290+0000 7f365c851640 1 -- 172.21.15.19:0/3438712843 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36500078e0 con 0x7f36580cfcc0 2024-09-12T02:01:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.290+0000 7f365c851640 1 -- 172.21.15.19:0/3438712843 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3650007cb0 con 0x7f36580cfcc0 2024-09-12T02:01:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.290+0000 7f365fab7640 1 -- 172.21.15.19:0/3438712843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36580cfcc0 msgr2=0x7f36580d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.290+0000 7f365fab7640 1 --2- 172.21.15.19:0/3438712843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36580cfcc0 0x7f36580d2ea0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3650009d90 tx=0x7f365002a660 comp rx=0 tx=0).stop 2024-09-12T02:01:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.290+0000 7f365fab7640 1 -- 172.21.15.19:0/3438712843 shutdown_connections 2024-09-12T02:01:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.290+0000 7f365fab7640 1 --2- 172.21.15.19:0/3438712843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36580cfcc0 0x7f36580d2ea0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.290+0000 7f365fab7640 1 --2- 172.21.15.19:0/3438712843 >> v2:172.21.15.135:3300/0 conn(0x7f365815e760 0x7f365806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.290+0000 7f365fab7640 1 -- 172.21.15.19:0/3438712843 >> 172.21.15.19:0/3438712843 conn(0x7f365808bfc0 msgr2=0x7f36580d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:53.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.290+0000 7f365fab7640 1 -- 172.21.15.19:0/3438712843 shutdown_connections 2024-09-12T02:01:53.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.291+0000 7f365fab7640 1 -- 172.21.15.19:0/3438712843 wait complete. 2024-09-12T02:01:53.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.292+0000 7f365fab7640 1 Processor -- start 2024-09-12T02:01:53.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.292+0000 7f365fab7640 1 -- start start 2024-09-12T02:01:53.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.293+0000 7f365fab7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36580cfcc0 0x7f36581603a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:53.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.293+0000 7f365fab7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36580d4fd0 0x7f3658160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:53.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.293+0000 7f365fab7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f365815e760 0x7f3658161420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:53.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.293+0000 7f365fab7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f36580d33e0 con 0x7f365815e760 2024-09-12T02:01:53.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.293+0000 7f365fab7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f36580b38a0 con 0x7f36580d4fd0 2024-09-12T02:01:53.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.293+0000 7f365fab7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f36580d3560 con 0x7f36580cfcc0 2024-09-12T02:01:53.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.293+0000 7f365e054640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f365815e760 0x7f3658161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:53.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.293+0000 7f365e054640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f365815e760 0x7f3658161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56784/0 (socket says 172.21.15.19:56784) 2024-09-12T02:01:53.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.293+0000 7f365e054640 1 -- 172.21.15.19:0/3540754772 learned_addr learned my addr 172.21.15.19:0/3540754772 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:53.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.293+0000 7f365d052640 1 --2- 172.21.15.19:0/3540754772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36580d4fd0 0x7f3658160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:53.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.293+0000 7f365d853640 1 --2- 172.21.15.19:0/3540754772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36580cfcc0 0x7f36581603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:53.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.293+0000 7f365e054640 1 -- 172.21.15.19:0/3540754772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36580cfcc0 msgr2=0x7f36581603a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:53.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.293+0000 7f365e054640 1 --2- 172.21.15.19:0/3540754772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36580cfcc0 0x7f36581603a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:53.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.293+0000 7f365e054640 1 -- 172.21.15.19:0/3540754772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36580d4fd0 msgr2=0x7f3658160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:53.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.293+0000 7f365e054640 1 --2- 172.21.15.19:0/3540754772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36580d4fd0 0x7f3658160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:53.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.293+0000 7f365e054640 1 -- 172.21.15.19:0/3540754772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3658155dd0 con 0x7f365815e760 2024-09-12T02:01:53.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.293+0000 7f365e054640 1 --2- 172.21.15.19:0/3540754772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f365815e760 0x7f3658161420 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3650009eb0 tx=0x7f3650004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:53.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.293+0000 7f364e7fc640 1 -- 172.21.15.19:0/3540754772 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3650040070 con 0x7f365815e760 2024-09-12T02:01:53.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.294+0000 7f364e7fc640 1 -- 172.21.15.19:0/3540754772 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3650031bc0 con 0x7f365815e760 2024-09-12T02:01:53.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.294+0000 7f365fab7640 1 -- 172.21.15.19:0/3540754772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3658154680 con 0x7f365815e760 2024-09-12T02:01:53.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.294+0000 7f364e7fc640 1 -- 172.21.15.19:0/3540754772 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3650009450 con 0x7f365815e760 2024-09-12T02:01:53.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.294+0000 7f365fab7640 1 -- 172.21.15.19:0/3540754772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3658154c40 con 0x7f365815e760 2024-09-12T02:01:53.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.295+0000 7f365fab7640 1 -- 172.21.15.19:0/3540754772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36580d3930 con 0x7f365815e760 2024-09-12T02:01:53.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.295+0000 7f364e7fc640 1 -- 172.21.15.19:0/3540754772 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3650039040 con 0x7f365815e760 2024-09-12T02:01:53.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.295+0000 7f364e7fc640 1 --2- 172.21.15.19:0/3540754772 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f363c06be30 0x7f363c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:53.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.296+0000 7f364e7fc640 1 -- 172.21.15.19:0/3540754772 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6187+0+0 (secure 0 0 0) 0x7f36500ac650 con 0x7f365815e760 2024-09-12T02:01:53.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.296+0000 7f365d853640 1 --2- 172.21.15.19:0/3540754772 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f363c06be30 0x7f363c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:53.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.296+0000 7f365d853640 1 --2- 172.21.15.19:0/3540754772 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f363c06be30 0x7f363c06e2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3654009560 tx=0x7f3654009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:53.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.300+0000 7f364e7fc640 1 -- 172.21.15.19:0/3540754772 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f365007a860 con 0x7f365815e760 2024-09-12T02:01:53.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.509+0000 7f365fab7640 1 -- 172.21.15.19:0/3540754772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36580b6d20 con 0x7f365815e760 2024-09-12T02:01:53.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.510+0000 7f364e7fc640 1 -- 172.21.15.19:0/3540754772 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+4394 (secure 0 0 0) 0x7f365007eb60 con 0x7f365815e760 2024-09-12T02:01:53.510 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:53.511 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":66,"btime":"2024-09-12T02:01:52:947085+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1065573429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1065573429},{"type":"v1","addr":"172.21.15.19:6835","nonce":1065573429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3905709264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":3905709264},{"type":"v1","addr":"172.21.15.135:6837","nonce":3905709264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:01:16.289395+0000","modified":"2024-09-12T02:01:52.947081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6082":{"gid":6082,"name":"a","rank":0,"incarnation":66,"state":"up:replay","state_seq":1,"addr":"172.21.15.19:6834/836344045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":836344045},{"type":"v1","addr":"172.21.15.19:6834","nonce":836344045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-12T02:01:53.511 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 66 2024-09-12T02:01:53.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.512+0000 7f365fab7640 1 -- 172.21.15.19:0/3540754772 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f363c06be30 msgr2=0x7f363c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:53.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.512+0000 7f365fab7640 1 --2- 172.21.15.19:0/3540754772 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f363c06be30 0x7f363c06e2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3654009560 tx=0x7f3654009190 comp rx=0 tx=0).stop 2024-09-12T02:01:53.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.512+0000 7f365fab7640 1 -- 172.21.15.19:0/3540754772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f365815e760 msgr2=0x7f3658161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:53.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.512+0000 7f365fab7640 1 --2- 172.21.15.19:0/3540754772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f365815e760 0x7f3658161420 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3650009eb0 tx=0x7f3650004a40 comp rx=0 tx=0).stop 2024-09-12T02:01:53.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.512+0000 7f365fab7640 1 -- 172.21.15.19:0/3540754772 shutdown_connections 2024-09-12T02:01:53.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.512+0000 7f365fab7640 1 --2- 172.21.15.19:0/3540754772 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f363c06be30 0x7f363c06e2f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:53.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.512+0000 7f365fab7640 1 --2- 172.21.15.19:0/3540754772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f365815e760 0x7f3658161420 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:53.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.512+0000 7f365fab7640 1 --2- 172.21.15.19:0/3540754772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36580d4fd0 0x7f3658160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:53.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.512+0000 7f365fab7640 1 --2- 172.21.15.19:0/3540754772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36580cfcc0 0x7f36581603a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.512+0000 7f365fab7640 1 -- 172.21.15.19:0/3540754772 >> 172.21.15.19:0/3540754772 conn(0x7f365808bfc0 msgr2=0x7f36580d4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.512+0000 7f365fab7640 1 -- 172.21.15.19:0/3540754772 shutdown_connections 2024-09-12T02:01:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:53.512+0000 7f365fab7640 1 -- 172.21.15.19:0/3540754772 wait complete. 2024-09-12T02:01:53.926 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:01:16.289395+0000', 'modified': '2024-09-12T02:01:52.947081+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 82, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6082}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6082': {'gid': 6082, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.19:6834/836344045', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 836344045}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 836344045}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:01:53.926 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6082:up:replay 2024-09-12T02:01:54.927 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:55.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.044+0000 7fbf55ba1640 1 Processor -- start 2024-09-12T02:01:55.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.045+0000 7fbf55ba1640 1 -- start start 2024-09-12T02:01:55.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.045+0000 7fbf55ba1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbf50162060 0x7fbf500b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.045+0000 7fbf55ba1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf500b64b0 0x7fbf500b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.045+0000 7fbf55ba1640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf5006d9f0 con 0x7fbf50161c80 2024-09-12T02:01:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.045+0000 7fbf55ba1640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fbf5006dcd0 con 0x7fbf50162060 2024-09-12T02:01:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.045+0000 7fbf55ba1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbf5006dfb0 con 0x7fbf500b64b0 2024-09-12T02:01:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.046+0000 7fbf46ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbf50162060 0x7fbf500b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.046+0000 7fbf4f7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbf50161c80 0x7fbf5006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35004/0 (socket says 172.21.15.19:35004) 2024-09-12T02:01:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.046+0000 7fbf46ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbf50162060 0x7fbf500b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56798/0 (socket says 172.21.15.19:56798) 2024-09-12T02:01:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.046+0000 7fbf4f7fe640 1 -- 172.21.15.19:0/2280155316 learned_addr learned my addr 172.21.15.19:0/2280155316 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.046+0000 7fbf4ffff640 1 --2- 172.21.15.19:0/2280155316 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf500b64b0 0x7fbf500b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.046+0000 7fbf46ffd640 1 -- 172.21.15.19:0/2280155316 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf500b64b0 msgr2=0x7fbf500b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.046+0000 7fbf46ffd640 1 --2- 172.21.15.19:0/2280155316 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf500b64b0 0x7fbf500b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.046+0000 7fbf46ffd640 1 -- 172.21.15.19:0/2280155316 >> v1:172.21.15.19:6789/0 conn(0x7fbf50161c80 legacy=0x7fbf5006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.046+0000 7fbf4effd640 1 -- 172.21.15.19:0/2280155316 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3046844394 0 0) 0x7fbf5006d9f0 con 0x7fbf50161c80 2024-09-12T02:01:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.046+0000 7fbf46ffd640 1 -- 172.21.15.19:0/2280155316 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf500d01f0 con 0x7fbf50162060 2024-09-12T02:01:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.047+0000 7fbf46ffd640 1 --2- 172.21.15.19:0/2280155316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf50162060 0x7fbf500b5f70 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fbf380097a0 tx=0x7fbf3802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd14957e507654eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.047+0000 7fbf4effd640 1 -- 172.21.15.19:0/2280155316 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38037070 con 0x7fbf50162060 2024-09-12T02:01:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.047+0000 7fbf4effd640 1 -- 172.21.15.19:0/2280155316 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf38032440 con 0x7fbf50162060 2024-09-12T02:01:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.047+0000 7fbf4effd640 1 -- 172.21.15.19:0/2280155316 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38032810 con 0x7fbf50162060 2024-09-12T02:01:55.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.047+0000 7fbf55ba1640 1 -- 172.21.15.19:0/2280155316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf50162060 msgr2=0x7fbf500b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:55.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.047+0000 7fbf55ba1640 1 --2- 172.21.15.19:0/2280155316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf50162060 0x7fbf500b5f70 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fbf380097a0 tx=0x7fbf3802a180 comp rx=0 tx=0).stop 2024-09-12T02:01:55.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.047+0000 7fbf55ba1640 1 -- 172.21.15.19:0/2280155316 shutdown_connections 2024-09-12T02:01:55.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.048+0000 7fbf55ba1640 1 --2- 172.21.15.19:0/2280155316 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf500b64b0 0x7fbf500b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:55.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.048+0000 7fbf55ba1640 1 --2- 172.21.15.19:0/2280155316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf50162060 0x7fbf500b5f70 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:55.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.048+0000 7fbf55ba1640 1 -- 172.21.15.19:0/2280155316 >> 172.21.15.19:0/2280155316 conn(0x7fbf500d44f0 msgr2=0x7fbf500d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:55.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.048+0000 7fbf55ba1640 1 -- 172.21.15.19:0/2280155316 shutdown_connections 2024-09-12T02:01:55.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.048+0000 7fbf55ba1640 1 -- 172.21.15.19:0/2280155316 wait complete. 2024-09-12T02:01:55.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.049+0000 7fbf55ba1640 1 Processor -- start 2024-09-12T02:01:55.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.049+0000 7fbf55ba1640 1 -- start start 2024-09-12T02:01:55.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf55ba1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf500b64b0 0x7fbf501f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:55.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf55ba1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf50161c80 0x7fbf501f86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:55.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf55ba1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf50162060 0x7fbf501f8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:55.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf55ba1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbf500cf360 con 0x7fbf500b64b0 2024-09-12T02:01:55.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf55ba1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbf500cf1e0 con 0x7fbf50162060 2024-09-12T02:01:55.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf55ba1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbf500cf4e0 con 0x7fbf50161c80 2024-09-12T02:01:55.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf4f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf500b64b0 0x7fbf501f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:55.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf4f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf500b64b0 0x7fbf501f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56814/0 (socket says 172.21.15.19:56814) 2024-09-12T02:01:55.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf4f7fe640 1 -- 172.21.15.19:0/533261769 learned_addr learned my addr 172.21.15.19:0/533261769 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:55.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf4ffff640 1 --2- 172.21.15.19:0/533261769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf50162060 0x7fbf501f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:55.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf46ffd640 1 --2- 172.21.15.19:0/533261769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf50161c80 0x7fbf501f86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:55.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf4f7fe640 1 -- 172.21.15.19:0/533261769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf50161c80 msgr2=0x7fbf501f86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:55.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf4f7fe640 1 --2- 172.21.15.19:0/533261769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf50161c80 0x7fbf501f86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:55.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf4f7fe640 1 -- 172.21.15.19:0/533261769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf50162060 msgr2=0x7fbf501f8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:55.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf4f7fe640 1 --2- 172.21.15.19:0/533261769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf50162060 0x7fbf501f8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:55.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf4f7fe640 1 -- 172.21.15.19:0/533261769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf501f9260 con 0x7fbf500b64b0 2024-09-12T02:01:55.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf4ffff640 1 --2- 172.21.15.19:0/533261769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf50162060 0x7fbf501f8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:55.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf4f7fe640 1 --2- 172.21.15.19:0/533261769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf500b64b0 0x7fbf501f5a90 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000c500 tx=0x7fbf4000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:55.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.050+0000 7fbf4cff9640 1 -- 172.21.15.19:0/533261769 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf40018070 con 0x7fbf500b64b0 2024-09-12T02:01:55.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.051+0000 7fbf4cff9640 1 -- 172.21.15.19:0/533261769 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf40007580 con 0x7fbf500b64b0 2024-09-12T02:01:55.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.051+0000 7fbf55ba1640 1 -- 172.21.15.19:0/533261769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf501f9540 con 0x7fbf500b64b0 2024-09-12T02:01:55.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.051+0000 7fbf4cff9640 1 -- 172.21.15.19:0/533261769 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf40004a20 con 0x7fbf500b64b0 2024-09-12T02:01:55.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.051+0000 7fbf55ba1640 1 -- 172.21.15.19:0/533261769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf500c9760 con 0x7fbf500b64b0 2024-09-12T02:01:55.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.052+0000 7fbf55ba1640 1 -- 172.21.15.19:0/533261769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf500b5f70 con 0x7fbf500b64b0 2024-09-12T02:01:55.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.052+0000 7fbf4cff9640 1 -- 172.21.15.19:0/533261769 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf40004bc0 con 0x7fbf500b64b0 2024-09-12T02:01:55.054 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:01:55.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.053+0000 7fbf4cff9640 1 --2- 172.21.15.19:0/533261769 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf3006be30 0x7fbf3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:55.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.053+0000 7fbf4cff9640 1 -- 172.21.15.19:0/533261769 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6187+0+0 (secure 0 0 0) 0x7fbf4008a340 con 0x7fbf500b64b0 2024-09-12T02:01:55.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.053+0000 7fbf46ffd640 1 --2- 172.21.15.19:0/533261769 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf3006be30 0x7fbf3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:55.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.053+0000 7fbf46ffd640 1 --2- 172.21.15.19:0/533261769 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf3006be30 0x7fbf3006e2f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbf38034000 tx=0x7fbf3802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:55.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.057+0000 7fbf4cff9640 1 -- 172.21.15.19:0/533261769 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbf40058b20 con 0x7fbf500b64b0 2024-09-12T02:01:55.057 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:01:55.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.271+0000 7fbf55ba1640 1 -- 172.21.15.19:0/533261769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf500ba470 con 0x7fbf500b64b0 2024-09-12T02:01:55.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.271+0000 7fbf4cff9640 1 -- 172.21.15.19:0/533261769 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5223 (secure 0 0 0) 0x7fbf40058420 con 0x7fbf500b64b0 2024-09-12T02:01:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:55.271 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":68,"btime":"2024-09-12T02:01:54:951961+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1065573429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1065573429},{"type":"v1","addr":"172.21.15.19:6835","nonce":1065573429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3905709264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":3905709264},{"type":"v1","addr":"172.21.15.135:6837","nonce":3905709264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5771,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2548260678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2548260678},{"type":"v1","addr":"172.21.15.135:6836","nonce":2548260678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:01:16.289395+0000","modified":"2024-09-12T02:01:53.953713+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6082":{"gid":6082,"name":"a","rank":0,"incarnation":66,"state":"up:rejoin","state_seq":13,"addr":"172.21.15.19:6834/836344045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":836344045},{"type":"v1","addr":"172.21.15.19:6834","nonce":836344045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-12T02:01:55.271 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 68 2024-09-12T02:01:55.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.273+0000 7fbf55ba1640 1 -- 172.21.15.19:0/533261769 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf3006be30 msgr2=0x7fbf3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:55.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.273+0000 7fbf55ba1640 1 --2- 172.21.15.19:0/533261769 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf3006be30 0x7fbf3006e2f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbf38034000 tx=0x7fbf3802e000 comp rx=0 tx=0).stop 2024-09-12T02:01:55.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.273+0000 7fbf55ba1640 1 -- 172.21.15.19:0/533261769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf500b64b0 msgr2=0x7fbf501f5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:55.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.273+0000 7fbf55ba1640 1 --2- 172.21.15.19:0/533261769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf500b64b0 0x7fbf501f5a90 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000c500 tx=0x7fbf4000c9c0 comp rx=0 tx=0).stop 2024-09-12T02:01:55.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.273+0000 7fbf55ba1640 1 -- 172.21.15.19:0/533261769 shutdown_connections 2024-09-12T02:01:55.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.273+0000 7fbf55ba1640 1 --2- 172.21.15.19:0/533261769 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf3006be30 0x7fbf3006e2f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:55.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.273+0000 7fbf55ba1640 1 --2- 172.21.15.19:0/533261769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf50162060 0x7fbf501f8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:55.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.273+0000 7fbf55ba1640 1 --2- 172.21.15.19:0/533261769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf50161c80 0x7fbf501f86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:55.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.273+0000 7fbf55ba1640 1 --2- 172.21.15.19:0/533261769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf500b64b0 0x7fbf501f5a90 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:55.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.273+0000 7fbf55ba1640 1 -- 172.21.15.19:0/533261769 >> 172.21.15.19:0/533261769 conn(0x7fbf500d44f0 msgr2=0x7fbf500d3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:55.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.273+0000 7fbf55ba1640 1 -- 172.21.15.19:0/533261769 shutdown_connections 2024-09-12T02:01:55.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55.273+0000 7fbf55ba1640 1 -- 172.21.15.19:0/533261769 wait complete. 2024-09-12T02:01:55.686 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:01:16.289395+0000', 'modified': '2024-09-12T02:01:53.953713+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 82, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6082}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6082': {'gid': 6082, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:rejoin', 'state_seq': 13, 'addr': '172.21.15.19:6834/836344045', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 836344045}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 836344045}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:01:55.687 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6082:up:rejoin 2024-09-12T02:01:55.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:01:56.688 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:56.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.804+0000 7f2de2a7b640 1 Processor -- start 2024-09-12T02:01:56.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.804+0000 7f2de2a7b640 1 -- start start 2024-09-12T02:01:56.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.805+0000 7f2de2a7b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ddc0d30f0 0x7f2ddc0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:56.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.805+0000 7f2de2a7b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ddc0d3690 con 0x7f2ddc0b64c0 2024-09-12T02:01:56.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.805+0000 7f2de2a7b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ddc0d3970 con 0x7f2ddc15e5f0 2024-09-12T02:01:56.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.805+0000 7f2de2a7b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2ddc06d530 con 0x7f2ddc0d30f0 2024-09-12T02:01:56.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.805+0000 7f2de1018640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2ddc0b64c0 0x7f2ddc06d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35020/0 (socket says 172.21.15.19:35020) 2024-09-12T02:01:56.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.805+0000 7f2de1018640 1 -- 172.21.15.19:0/3864824731 learned_addr learned my addr 172.21.15.19:0/3864824731 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:56.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.806+0000 7f2ddbfff640 1 --2- 172.21.15.19:0/3864824731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ddc0d30f0 0x7f2ddc0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:56.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.806+0000 7f2ddb7fe640 1 -- 172.21.15.19:0/3864824731 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3321595252 0 0) 0x7f2ddc0d3690 con 0x7f2ddc0b64c0 2024-09-12T02:01:56.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.806+0000 7f2ddb7fe640 1 -- 172.21.15.19:0/3864824731 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dc4003520 con 0x7f2ddc0b64c0 2024-09-12T02:01:56.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.806+0000 7f2ddb7fe640 1 -- 172.21.15.19:0/3864824731 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1998901077 0 0) 0x7f2ddc0d3970 con 0x7f2ddc15e5f0 2024-09-12T02:01:56.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.806+0000 7f2ddb7fe640 1 -- 172.21.15.19:0/3864824731 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ddc0d3690 con 0x7f2ddc15e5f0 2024-09-12T02:01:56.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.806+0000 7f2ddbfff640 1 -- 172.21.15.19:0/3864824731 >> v1:172.21.15.135:6789/0 conn(0x7f2ddc15e5f0 legacy=0x7f2ddc0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:56.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.806+0000 7f2ddb7fe640 1 -- 172.21.15.19:0/3864824731 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3468603306 0 0) 0x7f2dc4003520 con 0x7f2ddc0b64c0 2024-09-12T02:01:56.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.806+0000 7f2ddbfff640 1 -- 172.21.15.19:0/3864824731 >> v1:172.21.15.19:6789/0 conn(0x7f2ddc0b64c0 legacy=0x7f2ddc06d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:56.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.806+0000 7f2ddbfff640 1 -- 172.21.15.19:0/3864824731 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ddc06cee0 con 0x7f2ddc0d30f0 2024-09-12T02:01:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.807+0000 7f2ddbfff640 1 --2- 172.21.15.19:0/3864824731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ddc0d30f0 0x7f2ddc0b5f80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00097d0 tx=0x7f2dd002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aed4397322e7ac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.807+0000 7f2ddb7fe640 1 -- 172.21.15.19:0/3864824731 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0037070 con 0x7f2ddc0d30f0 2024-09-12T02:01:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.807+0000 7f2ddb7fe640 1 -- 172.21.15.19:0/3864824731 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd002ac30 con 0x7f2ddc0d30f0 2024-09-12T02:01:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.807+0000 7f2ddb7fe640 1 -- 172.21.15.19:0/3864824731 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40019f0 con 0x7f2ddc0d30f0 2024-09-12T02:01:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.808+0000 7f2de2a7b640 1 -- 172.21.15.19:0/3864824731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ddc0d30f0 msgr2=0x7f2ddc0b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.808+0000 7f2de2a7b640 1 --2- 172.21.15.19:0/3864824731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ddc0d30f0 0x7f2ddc0b5f80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00097d0 tx=0x7f2dd002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:01:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.808+0000 7f2de2a7b640 1 -- 172.21.15.19:0/3864824731 shutdown_connections 2024-09-12T02:01:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.808+0000 7f2de2a7b640 1 --2- 172.21.15.19:0/3864824731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ddc0d30f0 0x7f2ddc0b5f80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.808+0000 7f2de2a7b640 1 -- 172.21.15.19:0/3864824731 >> 172.21.15.19:0/3864824731 conn(0x7f2ddc08bfc0 msgr2=0x7f2ddc0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.808+0000 7f2de2a7b640 1 -- 172.21.15.19:0/3864824731 shutdown_connections 2024-09-12T02:01:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.808+0000 7f2de2a7b640 1 -- 172.21.15.19:0/3864824731 wait complete. 2024-09-12T02:01:56.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.809+0000 7f2de2a7b640 1 Processor -- start 2024-09-12T02:01:56.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.809+0000 7f2de2a7b640 1 -- start start 2024-09-12T02:01:56.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.810+0000 7f2de2a7b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ddc0b64c0 0x7f2ddc160b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:56.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.810+0000 7f2de2a7b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ddc0d30f0 0x7f2ddc15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:56.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.810+0000 7f2de2a7b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc15e5f0 0x7f2ddc0b2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:56.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.810+0000 7f2de2a7b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc06e0d0 con 0x7f2ddc15e5f0 2024-09-12T02:01:56.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.810+0000 7f2de2a7b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc15e9d0 con 0x7f2ddc0d30f0 2024-09-12T02:01:56.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.810+0000 7f2de2a7b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2ddc06e250 con 0x7f2ddc0b64c0 2024-09-12T02:01:56.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.810+0000 7f2de1018640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc15e5f0 0x7f2ddc0b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:56.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.810+0000 7f2de1018640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc15e5f0 0x7f2ddc0b2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56828/0 (socket says 172.21.15.19:56828) 2024-09-12T02:01:56.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.810+0000 7f2de1018640 1 -- 172.21.15.19:0/3780661701 learned_addr learned my addr 172.21.15.19:0/3780661701 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:56.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.810+0000 7f2ddbfff640 1 --2- 172.21.15.19:0/3780661701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ddc0d30f0 0x7f2ddc15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:56.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.810+0000 7f2de0817640 1 --2- 172.21.15.19:0/3780661701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ddc0b64c0 0x7f2ddc160b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:56.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.810+0000 7f2de1018640 1 -- 172.21.15.19:0/3780661701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ddc0b64c0 msgr2=0x7f2ddc160b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:56.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.810+0000 7f2de1018640 1 --2- 172.21.15.19:0/3780661701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ddc0b64c0 0x7f2ddc160b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:56.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.810+0000 7f2de1018640 1 -- 172.21.15.19:0/3780661701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ddc0d30f0 msgr2=0x7f2ddc15bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.810+0000 7f2de1018640 1 --2- 172.21.15.19:0/3780661701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ddc0d30f0 0x7f2ddc15bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.810+0000 7f2de1018640 1 -- 172.21.15.19:0/3780661701 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ddc15c0e0 con 0x7f2ddc15e5f0 2024-09-12T02:01:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.811+0000 7f2de1018640 1 --2- 172.21.15.19:0/3780661701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc15e5f0 0x7f2ddc0b2020 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4001f60 tx=0x7f2dd400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.811+0000 7f2dd97fa640 1 -- 172.21.15.19:0/3780661701 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4017070 con 0x7f2ddc15e5f0 2024-09-12T02:01:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.811+0000 7f2dd97fa640 1 -- 172.21.15.19:0/3780661701 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd4012400 con 0x7f2ddc15e5f0 2024-09-12T02:01:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.811+0000 7f2dd97fa640 1 -- 172.21.15.19:0/3780661701 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40127f0 con 0x7f2ddc15e5f0 2024-09-12T02:01:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.811+0000 7f2de2a7b640 1 -- 172.21.15.19:0/3780661701 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ddc15ef30 con 0x7f2ddc15e5f0 2024-09-12T02:01:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.811+0000 7f2de2a7b640 1 -- 172.21.15.19:0/3780661701 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ddc15f4f0 con 0x7f2ddc15e5f0 2024-09-12T02:01:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.812+0000 7f2de2a7b640 1 -- 172.21.15.19:0/3780661701 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ddc0b5f80 con 0x7f2ddc15e5f0 2024-09-12T02:01:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.812+0000 7f2dd97fa640 1 -- 172.21.15.19:0/3780661701 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2dd401a070 con 0x7f2ddc15e5f0 2024-09-12T02:01:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.813+0000 7f2dd97fa640 1 --2- 172.21.15.19:0/3780661701 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dc806be30 0x7f2dc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.813+0000 7f2dd97fa640 1 -- 172.21.15.19:0/3780661701 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6187+0+0 (secure 0 0 0) 0x7f2dd408af40 con 0x7f2ddc15e5f0 2024-09-12T02:01:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.813+0000 7f2de0817640 1 --2- 172.21.15.19:0/3780661701 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dc806be30 0x7f2dc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.814+0000 7f2de0817640 1 --2- 172.21.15.19:0/3780661701 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dc806be30 0x7f2dc806e2f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0011e0 tx=0x7f2dcc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:56.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:56.818+0000 7f2dd97fa640 1 -- 172.21.15.19:0/3780661701 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ddc15c0e0 con 0x7f2ddc15e5f0 2024-09-12T02:01:57.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.033+0000 7f2de2a7b640 1 -- 172.21.15.19:0/3780661701 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ddc0cfd90 con 0x7f2ddc15e5f0 2024-09-12T02:01:57.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.033+0000 7f2dd97fa640 1 -- 172.21.15.19:0/3780661701 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5230 (secure 0 0 0) 0x7f2dd4059030 con 0x7f2ddc15e5f0 2024-09-12T02:01:57.033 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:57.033 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":69,"btime":"2024-09-12T02:01:55:959025+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1065573429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1065573429},{"type":"v1","addr":"172.21.15.19:6835","nonce":1065573429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3905709264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":3905709264},{"type":"v1","addr":"172.21.15.135:6837","nonce":3905709264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5771,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2548260678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2548260678},{"type":"v1","addr":"172.21.15.135:6836","nonce":2548260678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:01:16.289395+0000","modified":"2024-09-12T02:01:55.959021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6082":{"gid":6082,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":14,"addr":"172.21.15.19:6834/836344045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":836344045},{"type":"v1","addr":"172.21.15.19:6834","nonce":836344045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6082,"qdb_cluster":[6082]},"id":5}]} 2024-09-12T02:01:57.033 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 69 2024-09-12T02:01:57.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.036+0000 7f2de2a7b640 1 -- 172.21.15.19:0/3780661701 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dc806be30 msgr2=0x7f2dc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.036+0000 7f2de2a7b640 1 --2- 172.21.15.19:0/3780661701 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dc806be30 0x7f2dc806e2f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0011e0 tx=0x7f2dcc009040 comp rx=0 tx=0).stop 2024-09-12T02:01:57.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.036+0000 7f2de2a7b640 1 -- 172.21.15.19:0/3780661701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc15e5f0 msgr2=0x7f2ddc0b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.036+0000 7f2de2a7b640 1 --2- 172.21.15.19:0/3780661701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc15e5f0 0x7f2ddc0b2020 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4001f60 tx=0x7f2dd400cf90 comp rx=0 tx=0).stop 2024-09-12T02:01:57.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.036+0000 7f2de2a7b640 1 -- 172.21.15.19:0/3780661701 shutdown_connections 2024-09-12T02:01:57.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.036+0000 7f2de2a7b640 1 --2- 172.21.15.19:0/3780661701 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dc806be30 0x7f2dc806e2f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.036+0000 7f2de2a7b640 1 --2- 172.21.15.19:0/3780661701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc15e5f0 0x7f2ddc0b2020 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.036+0000 7f2de2a7b640 1 --2- 172.21.15.19:0/3780661701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ddc0d30f0 0x7f2ddc15bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.036+0000 7f2de2a7b640 1 --2- 172.21.15.19:0/3780661701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ddc0b64c0 0x7f2ddc160b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.036+0000 7f2de2a7b640 1 -- 172.21.15.19:0/3780661701 >> 172.21.15.19:0/3780661701 conn(0x7f2ddc08bfc0 msgr2=0x7f2ddc0cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:57.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.036+0000 7f2de2a7b640 1 -- 172.21.15.19:0/3780661701 shutdown_connections 2024-09-12T02:01:57.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.036+0000 7f2de2a7b640 1 -- 172.21.15.19:0/3780661701 wait complete. 2024-09-12T02:01:57.449 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:01:16.289395+0000', 'modified': '2024-09-12T02:01:55.959021+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 82, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6082}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6082': {'gid': 6082, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.19:6834/836344045', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 836344045}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 836344045}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6082, 'qdb_cluster': [6082]} 2024-09-12T02:01:57.449 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:01:57.449 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T02:01:57.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.556+0000 7f39eae80640 1 Processor -- start 2024-09-12T02:01:57.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.557+0000 7f39eae80640 1 -- start start 2024-09-12T02:01:57.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.557+0000 7f39eae80640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f39e40b3760 0x7f39e40b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.557+0000 7f39eae80640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39e406cd20 0x7f39e4162340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.557+0000 7f39eae80640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39e40b2790 con 0x7f39e409aa30 2024-09-12T02:01:57.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.557+0000 7f39eae80640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f39e40d0670 con 0x7f39e40b3760 2024-09-12T02:01:57.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.557+0000 7f39eae80640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f39e40b2a70 con 0x7f39e406cd20 2024-09-12T02:01:57.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.558+0000 7f39e3fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f39e40b3760 0x7f39e40b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.558+0000 7f39e8c1c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f39e409aa30 0x7f39e409ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35030/0 (socket says 172.21.15.19:35030) 2024-09-12T02:01:57.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.558+0000 7f39e8c1c640 1 -- 172.21.15.19:0/3968385041 learned_addr learned my addr 172.21.15.19:0/3968385041 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:57.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.558+0000 7f39e941d640 1 --2- 172.21.15.19:0/3968385041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39e406cd20 0x7f39e4162340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.558+0000 7f39e3fff640 1 -- 172.21.15.19:0/3968385041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39e406cd20 msgr2=0x7f39e4162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:57.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.558+0000 7f39e3fff640 1 --2- 172.21.15.19:0/3968385041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39e406cd20 0x7f39e4162340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.558+0000 7f39e3fff640 1 -- 172.21.15.19:0/3968385041 >> v1:172.21.15.19:6789/0 conn(0x7f39e409aa30 legacy=0x7f39e409ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.558+0000 7f39e3fff640 1 -- 172.21.15.19:0/3968385041 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e40b2d50 con 0x7f39e40b3760 2024-09-12T02:01:57.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.558+0000 7f39e37fe640 1 -- 172.21.15.19:0/3968385041 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2708097256 0 0) 0x7f39e40b2790 con 0x7f39e409aa30 2024-09-12T02:01:57.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.558+0000 7f39e941d640 1 --2- 172.21.15.19:0/3968385041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39e406cd20 0x7f39e4162340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:57.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.559+0000 7f39e3fff640 1 --2- 172.21.15.19:0/3968385041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39e40b3760 0x7f39e40b3030 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f39d00097a0 tx=0x7f39d002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0647de6699fbf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:57.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.559+0000 7f39e37fe640 1 -- 172.21.15.19:0/3968385041 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0037070 con 0x7f39e40b3760 2024-09-12T02:01:57.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.559+0000 7f39e37fe640 1 -- 172.21.15.19:0/3968385041 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d002ae50 con 0x7f39e40b3760 2024-09-12T02:01:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.559+0000 7f39e37fe640 1 -- 172.21.15.19:0/3968385041 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0032660 con 0x7f39e40b3760 2024-09-12T02:01:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.559+0000 7f39eae80640 1 -- 172.21.15.19:0/3968385041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39e40b3760 msgr2=0x7f39e40b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.559+0000 7f39eae80640 1 --2- 172.21.15.19:0/3968385041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39e40b3760 0x7f39e40b3030 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f39d00097a0 tx=0x7f39d002a100 comp rx=0 tx=0).stop 2024-09-12T02:01:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.559+0000 7f39eae80640 1 -- 172.21.15.19:0/3968385041 shutdown_connections 2024-09-12T02:01:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.559+0000 7f39eae80640 1 --2- 172.21.15.19:0/3968385041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39e406cd20 0x7f39e4162340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.559+0000 7f39eae80640 1 --2- 172.21.15.19:0/3968385041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39e40b3760 0x7f39e40b3030 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.559+0000 7f39eae80640 1 -- 172.21.15.19:0/3968385041 >> 172.21.15.19:0/3968385041 conn(0x7f39e40d23a0 msgr2=0x7f39e40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.559+0000 7f39eae80640 1 -- 172.21.15.19:0/3968385041 shutdown_connections 2024-09-12T02:01:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.559+0000 7f39eae80640 1 -- 172.21.15.19:0/3968385041 wait complete. 2024-09-12T02:01:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.561+0000 7f39eae80640 1 Processor -- start 2024-09-12T02:01:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.561+0000 7f39eae80640 1 -- start start 2024-09-12T02:01:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.561+0000 7f39eae80640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39e406cd20 0x7f39e40b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.561+0000 7f39eae80640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39e409aa30 0x7f39e41f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39eae80640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39e40b3760 0x7f39e41f4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39eae80640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f39e415fe20 con 0x7f39e406cd20 2024-09-12T02:01:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39eae80640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f39e415fca0 con 0x7f39e40b3760 2024-09-12T02:01:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39eae80640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f39e40d1fe0 con 0x7f39e409aa30 2024-09-12T02:01:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39e8c1c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39e406cd20 0x7f39e40b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39e8c1c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39e406cd20 0x7f39e40b7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56850/0 (socket says 172.21.15.19:56850) 2024-09-12T02:01:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39e8c1c640 1 -- 172.21.15.19:0/926620470 learned_addr learned my addr 172.21.15.19:0/926620470 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39e3fff640 1 --2- 172.21.15.19:0/926620470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39e409aa30 0x7f39e41f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39e941d640 1 --2- 172.21.15.19:0/926620470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39e40b3760 0x7f39e41f4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39e8c1c640 1 -- 172.21.15.19:0/926620470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39e409aa30 msgr2=0x7f39e41f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39e8c1c640 1 --2- 172.21.15.19:0/926620470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39e409aa30 0x7f39e41f78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39e8c1c640 1 -- 172.21.15.19:0/926620470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39e40b3760 msgr2=0x7f39e41f4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39e8c1c640 1 --2- 172.21.15.19:0/926620470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39e40b3760 0x7f39e41f4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39e8c1c640 1 -- 172.21.15.19:0/926620470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e4151d70 con 0x7f39e406cd20 2024-09-12T02:01:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39e3fff640 1 --2- 172.21.15.19:0/926620470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39e409aa30 0x7f39e41f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39e8c1c640 1 --2- 172.21.15.19:0/926620470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39e406cd20 0x7f39e40b7050 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f39d800c4d0 tx=0x7f39d800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39e17fa640 1 -- 172.21.15.19:0/926620470 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8018070 con 0x7f39e406cd20 2024-09-12T02:01:57.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39e17fa640 1 -- 172.21.15.19:0/926620470 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d8007500 con 0x7f39e406cd20 2024-09-12T02:01:57.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39eae80640 1 -- 172.21.15.19:0/926620470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e40b76e0 con 0x7f39e406cd20 2024-09-12T02:01:57.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39e17fa640 1 -- 172.21.15.19:0/926620470 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8004a20 con 0x7f39e406cd20 2024-09-12T02:01:57.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.562+0000 7f39eae80640 1 -- 172.21.15.19:0/926620470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e41606c0 con 0x7f39e406cd20 2024-09-12T02:01:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.564+0000 7f39e17fa640 1 -- 172.21.15.19:0/926620470 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39d801b070 con 0x7f39e406cd20 2024-09-12T02:01:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.564+0000 7f39e17fa640 1 --2- 172.21.15.19:0/926620470 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f39c806be30 0x7f39c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.565+0000 7f39e17fa640 1 -- 172.21.15.19:0/926620470 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6187+0+0 (secure 0 0 0) 0x7f39d808a330 con 0x7f39e406cd20 2024-09-12T02:01:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.565+0000 7f39e3fff640 1 --2- 172.21.15.19:0/926620470 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f39c806be30 0x7f39c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.565+0000 7f39e3fff640 1 --2- 172.21.15.19:0/926620470 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f39c806be30 0x7f39c806e2f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f39d0034000 tx=0x7f39d002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.565+0000 7f39edc14740 1 Processor -- start 2024-09-12T02:01:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.565+0000 7f39edc14740 1 -- start start 2024-09-12T02:01:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.566+0000 7f39edc14740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562042bfb2c0 0x562042c40a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.566+0000 7f39edc14740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bf8a80 0x562042bfb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.566+0000 7f39edc14740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042bfca50 0x562042bf58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.566+0000 7f39edc14740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562042b5d520 con 0x562042bf8a80 2024-09-12T02:01:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.566+0000 7f39edc14740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562042b053e0 con 0x562042bfca50 2024-09-12T02:01:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.566+0000 7f39edc14740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562042b594e0 con 0x562042bfb2c0 2024-09-12T02:01:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.566+0000 7f39e3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bf8a80 0x562042bfb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.566+0000 7f39e3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bf8a80 0x562042bfb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56858/0 (socket says 172.21.15.19:56858) 2024-09-12T02:01:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.566+0000 7f39e3fff640 1 -- 172.21.15.19:0/2616491373 learned_addr learned my addr 172.21.15.19:0/2616491373 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.566+0000 7f39e941d640 1 --2- 172.21.15.19:0/2616491373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042bfca50 0x562042bf58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.566+0000 7f39e8c1c640 1 --2- 172.21.15.19:0/2616491373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562042bfb2c0 0x562042c40a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.566+0000 7f39e3fff640 1 -- 172.21.15.19:0/2616491373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562042bfb2c0 msgr2=0x562042c40a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.566+0000 7f39e3fff640 1 --2- 172.21.15.19:0/2616491373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562042bfb2c0 0x562042c40a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.566+0000 7f39e3fff640 1 -- 172.21.15.19:0/2616491373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042bfca50 msgr2=0x562042bf58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.566+0000 7f39e3fff640 1 --2- 172.21.15.19:0/2616491373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042bfca50 0x562042bf58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.566+0000 7f39e3fff640 1 -- 172.21.15.19:0/2616491373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562042b202f0 con 0x562042bf8a80 2024-09-12T02:01:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.567+0000 7f39e3fff640 1 --2- 172.21.15.19:0/2616491373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bf8a80 0x562042bfb6a0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f39d0032920 tx=0x7f39d002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbdb6e2d16d2f622 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.567+0000 7f39ce7fc640 1 -- 172.21.15.19:0/2616491373 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0037040 con 0x562042bf8a80 2024-09-12T02:01:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.567+0000 7f39ce7fc640 1 -- 172.21.15.19:0/2616491373 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d003e460 con 0x562042bf8a80 2024-09-12T02:01:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.567+0000 7f39ce7fc640 1 -- 172.21.15.19:0/2616491373 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d003e810 con 0x562042bf8a80 2024-09-12T02:01:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.567+0000 7f39edc14740 1 -- 172.21.15.19:0/2616491373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bf8a80 msgr2=0x562042bfb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.567+0000 7f39edc14740 1 --2- 172.21.15.19:0/2616491373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bf8a80 0x562042bfb6a0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f39d0032920 tx=0x7f39d002c000 comp rx=0 tx=0).stop 2024-09-12T02:01:57.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.567+0000 7f39edc14740 1 -- 172.21.15.19:0/2616491373 shutdown_connections 2024-09-12T02:01:57.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.567+0000 7f39edc14740 1 --2- 172.21.15.19:0/2616491373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042bfca50 0x562042bf58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.567+0000 7f39edc14740 1 --2- 172.21.15.19:0/2616491373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bf8a80 0x562042bfb6a0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.567+0000 7f39edc14740 1 --2- 172.21.15.19:0/2616491373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562042bfb2c0 0x562042c40a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.567+0000 7f39edc14740 1 -- 172.21.15.19:0/2616491373 >> 172.21.15.19:0/2616491373 conn(0x562042bf7a80 msgr2=0x562042c3ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:57.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.568+0000 7f39edc14740 1 -- 172.21.15.19:0/2616491373 shutdown_connections 2024-09-12T02:01:57.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.568+0000 7f39edc14740 1 -- 172.21.15.19:0/2616491373 wait complete. 2024-09-12T02:01:57.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.568+0000 7f39edc14740 1 -- start start 2024-09-12T02:01:57.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.568+0000 7f39edc14740 1 Processor -- start 2024-09-12T02:01:57.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.569+0000 7f39edc14740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562042bfb2c0 0x562042c0c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.569+0000 7f39edc14740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfca50 0x562042c3d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.569+0000 7f39edc14740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042c1b440 0x562042c1b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.569+0000 7f39edc14740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562042bf6f20 con 0x562042bfca50 2024-09-12T02:01:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.569+0000 7f39edc14740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562042ae6450 con 0x562042c1b440 2024-09-12T02:01:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.569+0000 7f39edc14740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562042c41290 con 0x562042bfb2c0 2024-09-12T02:01:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.569+0000 7f39edc14740 10 client.0 _ll_register_callbacks cb 0x56204286fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.569+0000 7f39e3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfca50 0x562042c3d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.569+0000 7f39e3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfca50 0x562042c3d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56872/0 (socket says 172.21.15.19:56872) 2024-09-12T02:01:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.569+0000 7f39e3fff640 1 -- 172.21.15.19:0/2969020556 learned_addr learned my addr 172.21.15.19:0/2969020556 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.569+0000 7f39e8c1c640 1 --2- 172.21.15.19:0/2969020556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562042bfb2c0 0x562042c0c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.569+0000 7f39e941d640 1 --2- 172.21.15.19:0/2969020556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042c1b440 0x562042c1b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.569+0000 7f39e3fff640 1 -- 172.21.15.19:0/2969020556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562042bfb2c0 msgr2=0x562042c0c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.569+0000 7f39e3fff640 1 --2- 172.21.15.19:0/2969020556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562042bfb2c0 0x562042c0c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.569+0000 7f39e3fff640 1 -- 172.21.15.19:0/2969020556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042c1b440 msgr2=0x562042c1b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.569+0000 7f39e3fff640 1 --2- 172.21.15.19:0/2969020556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042c1b440 0x562042c1b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.569+0000 7f39e3fff640 1 -- 172.21.15.19:0/2969020556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620428702d0 con 0x562042bfca50 2024-09-12T02:01:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.569+0000 7f39e941d640 1 --2- 172.21.15.19:0/2969020556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042c1b440 0x562042c1b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.570+0000 7f39e3fff640 1 --2- 172.21.15.19:0/2969020556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfca50 0x562042c3d450 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f39d00098c0 tx=0x7f39d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9d02b03bc6f0da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.570+0000 7f39c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:01:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.570+0000 7f39c37fe640 1 -- 172.21.15.19:0/2969020556 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d003ed30 con 0x562042bfca50 2024-09-12T02:01:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.570+0000 7f39c37fe640 1 -- 172.21.15.19:0/2969020556 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 6187+0+0 (secure 0 0 0) 0x7f39d0050c90 con 0x562042bfca50 2024-09-12T02:01:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.570+0000 7f39edc14740 1 -- 172.21.15.19:0/2969020556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39d003e460 con 0x562042bfca50 2024-09-12T02:01:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.570+0000 7f39c37fe640 1 -- 172.21.15.19:0/2969020556 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f39d0050e90 con 0x562042bfca50 2024-09-12T02:01:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.570+0000 7f39edc14740 10 client.6762 fetch_fsmap learned FSMap version 69 2024-09-12T02:01:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.570+0000 7f39edc14740 1 -- 172.21.15.19:0/2969020556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x56204293a6b0 con 0x562042bfca50 2024-09-12T02:01:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.570+0000 7f39c37fe640 1 -- 172.21.15.19:0/2969020556 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d003e460 con 0x562042bfca50 2024-09-12T02:01:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.570+0000 7f39c37fe640 1 -- 172.21.15.19:0/2969020556 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f39d003c430 con 0x562042bfca50 2024-09-12T02:01:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.570+0000 7f39edc14740 10 client.6762 fetch_fsmap finished waiting for FSMap version 69 2024-09-12T02:01:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.570+0000 7f39edc14740 10 client.6762 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:01:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.570+0000 7f39edc14740 20 client.6762 populate_metadata read hostname 'smithi019' 2024-09-12T02:01:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.570+0000 7f39edc14740 1 --2- 172.21.15.19:0/2969020556 >> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] conn(0x562042bf5180 0x562042bf5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.570+0000 7f39edc14740 4 client.6762 mds_command: new command op to 6082 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:01:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.570+0000 7f39edc14740 1 -- 172.21.15.19:0/2969020556 --> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562042b6ac50 con 0x562042bf5180 2024-09-12T02:01:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.570+0000 7f39e8c1c640 1 --2- 172.21.15.19:0/2969020556 >> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] conn(0x562042bf5180 0x562042bf5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.571+0000 7f39e8c1c640 1 --2- 172.21.15.19:0/2969020556 >> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] conn(0x562042bf5180 0x562042bf5560 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f31180deb80528ed server_cookie=a6c37aa23c451113 in_seq=0 out_seq=0 2024-09-12T02:01:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.571+0000 7f39c37fe640 10 client.6762 ms_handle_connect on v2:172.21.15.19:6832/836344045 2024-09-12T02:01:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.571+0000 7f39c37fe640 1 -- 172.21.15.19:0/2969020556 <== mds.0 v2:172.21.15.19:6832/836344045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562042b6ac50 con 0x562042bf5180 2024-09-12T02:01:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.571+0000 7f39c37fe640 10 client.6762 handle_command_reply: tid=0 2024-09-12T02:01:57.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.571+0000 7f39edc14740 1 client.6762 shutdown 2024-09-12T02:01:57.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.572+0000 7f39edc14740 1 -- 172.21.15.19:0/2969020556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfca50 msgr2=0x562042c3d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.572+0000 7f39edc14740 1 --2- 172.21.15.19:0/2969020556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfca50 0x562042c3d450 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f39d00098c0 tx=0x7f39d0004730 comp rx=0 tx=0).stop 2024-09-12T02:01:57.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.572+0000 7f39edc14740 1 -- 172.21.15.19:0/2969020556 shutdown_connections 2024-09-12T02:01:57.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.572+0000 7f39edc14740 1 --2- 172.21.15.19:0/2969020556 >> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] conn(0x562042bf5180 0x562042bf5560 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.572+0000 7f39edc14740 1 --2- 172.21.15.19:0/2969020556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042c1b440 0x562042c1b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.572+0000 7f39c37fe640 0 client.6762 ms_handle_reset on v2:172.21.15.19:6832/836344045 2024-09-12T02:01:57.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.572+0000 7f39edc14740 1 --2- 172.21.15.19:0/2969020556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfca50 0x562042c3d450 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.572+0000 7f39edc14740 1 --2- 172.21.15.19:0/2969020556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562042bfb2c0 0x562042c0c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.572+0000 7f39edc14740 1 -- 172.21.15.19:0/2969020556 >> 172.21.15.19:0/2969020556 conn(0x562042bf8a80 msgr2=0x562042c3f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.572+0000 7f39edc14740 1 -- 172.21.15.19:0/2969020556 shutdown_connections 2024-09-12T02:01:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.572+0000 7f39edc14740 1 -- 172.21.15.19:0/2969020556 wait complete. 2024-09-12T02:01:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.572+0000 7f39edc14740 20 client.6762 trim_cache size 0 max 16384 2024-09-12T02:01:57.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.590+0000 7f39edc14740 1 Processor -- start 2024-09-12T02:01:57.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.590+0000 7f39edc14740 1 -- start start 2024-09-12T02:01:57.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.591+0000 7f39edc14740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfb2c0 0x562042bfc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.591+0000 7f39edc14740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562042bfca50 0x562042c0b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.591+0000 7f39edc14740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042c1b440 0x562042bf5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.591+0000 7f39edc14740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f39e40b5e20 con 0x562042bfb2c0 2024-09-12T02:01:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.591+0000 7f39edc14740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f39e40b51d0 con 0x562042c1b440 2024-09-12T02:01:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.591+0000 7f39edc14740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f39e40b57d0 con 0x562042bfca50 2024-09-12T02:01:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.591+0000 7f39e8c1c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfb2c0 0x562042bfc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.591+0000 7f39e8c1c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfb2c0 0x562042bfc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56882/0 (socket says 172.21.15.19:56882) 2024-09-12T02:01:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.591+0000 7f39e8c1c640 1 -- 172.21.15.19:0/3764093934 learned_addr learned my addr 172.21.15.19:0/3764093934 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.591+0000 7f39e8c1c640 1 -- 172.21.15.19:0/3764093934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562042bfca50 msgr2=0x562042c0b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.591+0000 7f39e8c1c640 1 --2- 172.21.15.19:0/3764093934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562042bfca50 0x562042c0b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.591+0000 7f39e8c1c640 1 -- 172.21.15.19:0/3764093934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042c1b440 msgr2=0x562042bf5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.591+0000 7f39e8c1c640 1 --2- 172.21.15.19:0/3764093934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042c1b440 0x562042bf5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.591+0000 7f39e8c1c640 1 -- 172.21.15.19:0/3764093934 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562042c0b7b0 con 0x562042bfb2c0 2024-09-12T02:01:57.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.591+0000 7f39e8c1c640 1 --2- 172.21.15.19:0/3764093934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfb2c0 0x562042bfc1b0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f39d8058390 tx=0x7f39d8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46031ffbd6463f9c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:57.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.591+0000 7f39cdffb640 1 -- 172.21.15.19:0/3764093934 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d808a0c0 con 0x562042bfb2c0 2024-09-12T02:01:57.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.591+0000 7f39cdffb640 1 -- 172.21.15.19:0/3764093934 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d8056700 con 0x562042bfb2c0 2024-09-12T02:01:57.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.591+0000 7f39cdffb640 1 -- 172.21.15.19:0/3764093934 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8004bc0 con 0x562042bfb2c0 2024-09-12T02:01:57.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.592+0000 7f39edc14740 1 -- 172.21.15.19:0/3764093934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfb2c0 msgr2=0x562042bfc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.592+0000 7f39edc14740 1 --2- 172.21.15.19:0/3764093934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfb2c0 0x562042bfc1b0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f39d8058390 tx=0x7f39d8000ed0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.592+0000 7f39edc14740 1 -- 172.21.15.19:0/3764093934 shutdown_connections 2024-09-12T02:01:57.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.592+0000 7f39edc14740 1 --2- 172.21.15.19:0/3764093934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042c1b440 0x562042bf5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.592+0000 7f39edc14740 1 --2- 172.21.15.19:0/3764093934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562042bfca50 0x562042c0b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.592+0000 7f39edc14740 1 --2- 172.21.15.19:0/3764093934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfb2c0 0x562042bfc1b0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.592+0000 7f39edc14740 1 -- 172.21.15.19:0/3764093934 >> 172.21.15.19:0/3764093934 conn(0x562042bf8a80 msgr2=0x562042c3ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:57.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.592+0000 7f39edc14740 1 -- 172.21.15.19:0/3764093934 shutdown_connections 2024-09-12T02:01:57.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.592+0000 7f39edc14740 1 -- 172.21.15.19:0/3764093934 wait complete. 2024-09-12T02:01:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.592+0000 7f39edc14740 1 -- start start 2024-09-12T02:01:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.593+0000 7f39edc14740 1 Processor -- start 2024-09-12T02:01:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.593+0000 7f39edc14740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562042bfb2c0 0x562042cbbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.593+0000 7f39edc14740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfca50 0x562042bf5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.593+0000 7f39edc14740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042c1b440 0x562042bf5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.593+0000 7f39edc14740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562042bf62a0 con 0x562042bfca50 2024-09-12T02:01:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.593+0000 7f39edc14740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562042c1e3f0 con 0x562042c1b440 2024-09-12T02:01:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.593+0000 7f39edc14740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562042c3db30 con 0x562042bfb2c0 2024-09-12T02:01:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.594+0000 7f39edc14740 10 client.0 _ll_register_callbacks cb 0x7f39dc007780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.594+0000 7f39e3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfca50 0x562042bf5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.594+0000 7f39e3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfca50 0x562042bf5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56898/0 (socket says 172.21.15.19:56898) 2024-09-12T02:01:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.594+0000 7f39e3fff640 1 -- 172.21.15.19:0/1085819645 learned_addr learned my addr 172.21.15.19:0/1085819645 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.594+0000 7f39e3fff640 1 -- 172.21.15.19:0/1085819645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562042bfb2c0 msgr2=0x562042cbbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.594+0000 7f39e3fff640 1 --2- 172.21.15.19:0/1085819645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562042bfb2c0 0x562042cbbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.594+0000 7f39e941d640 1 --2- 172.21.15.19:0/1085819645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042c1b440 0x562042bf5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.594+0000 7f39e3fff640 1 -- 172.21.15.19:0/1085819645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042c1b440 msgr2=0x562042bf5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.594+0000 7f39e3fff640 1 --2- 172.21.15.19:0/1085819645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042c1b440 0x562042bf5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.594+0000 7f39e3fff640 1 -- 172.21.15.19:0/1085819645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562042c3e4c0 con 0x562042bfca50 2024-09-12T02:01:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.594+0000 7f39e941d640 1 --2- 172.21.15.19:0/1085819645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042c1b440 0x562042bf5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.594+0000 7f39e3fff640 1 --2- 172.21.15.19:0/1085819645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfca50 0x562042bf5560 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f39d00096f0 tx=0x7f39d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a135f73db720a2d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.594+0000 7f39c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:01:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.594+0000 7f39c37fe640 1 -- 172.21.15.19:0/1085819645 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0058420 con 0x562042bfca50 2024-09-12T02:01:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.594+0000 7f39c37fe640 1 -- 172.21.15.19:0/1085819645 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 6187+0+0 (secure 0 0 0) 0x7f39d0044040 con 0x562042bfca50 2024-09-12T02:01:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.594+0000 7f39edc14740 1 -- 172.21.15.19:0/1085819645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39d8056700 con 0x562042bfca50 2024-09-12T02:01:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.594+0000 7f39c37fe640 1 -- 172.21.15.19:0/1085819645 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f39d0064050 con 0x562042bfca50 2024-09-12T02:01:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.594+0000 7f39edc14740 10 client.6768 fetch_fsmap learned FSMap version 69 2024-09-12T02:01:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.595+0000 7f39edc14740 1 -- 172.21.15.19:0/1085819645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x562042c3dee0 con 0x562042bfca50 2024-09-12T02:01:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.595+0000 7f39c37fe640 1 -- 172.21.15.19:0/1085819645 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d8056700 con 0x562042bfca50 2024-09-12T02:01:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.595+0000 7f39c37fe640 1 -- 172.21.15.19:0/1085819645 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f39d0067020 con 0x562042bfca50 2024-09-12T02:01:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.595+0000 7f39edc14740 10 client.6768 fetch_fsmap finished waiting for FSMap version 69 2024-09-12T02:01:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.595+0000 7f39edc14740 10 client.6768 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:01:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.595+0000 7f39edc14740 20 client.6768 populate_metadata read hostname 'smithi019' 2024-09-12T02:01:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.595+0000 7f39edc14740 1 --2- 172.21.15.19:0/1085819645 >> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] conn(0x562042c4e5c0 0x562042c4e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.595+0000 7f39edc14740 4 client.6768 mds_command: new command op to 6082 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:01:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.595+0000 7f39edc14740 1 -- 172.21.15.19:0/1085819645 --> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] -- command(tid 0: {"prefix": "status"}) -- 0x562042b64fa0 con 0x562042c4e5c0 2024-09-12T02:01:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.595+0000 7f39e8c1c640 1 --2- 172.21.15.19:0/1085819645 >> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] conn(0x562042c4e5c0 0x562042c4e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.595+0000 7f39c37fe640 10 client.6768 ms_handle_connect on v2:172.21.15.19:6832/836344045 2024-09-12T02:01:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.595+0000 7f39e8c1c640 1 --2- 172.21.15.19:0/1085819645 >> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] conn(0x562042c4e5c0 0x562042c4e9a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6446cfc8b8cd588f server_cookie=1cc6675d583f18b2 in_seq=0 out_seq=0 2024-09-12T02:01:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.595+0000 7f39c37fe640 1 -- 172.21.15.19:0/1085819645 <== mds.0 v2:172.21.15.19:6832/836344045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x562042b64fa0 con 0x562042c4e5c0 2024-09-12T02:01:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.595+0000 7f39c37fe640 10 client.6768 handle_command_reply: tid=0 2024-09-12T02:01:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.595+0000 7f39edc14740 1 client.6768 shutdown 2024-09-12T02:01:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39edc14740 1 -- 172.21.15.19:0/1085819645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfca50 msgr2=0x562042bf5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39edc14740 1 --2- 172.21.15.19:0/1085819645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfca50 0x562042bf5560 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f39d00096f0 tx=0x7f39d00046c0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39edc14740 1 -- 172.21.15.19:0/1085819645 shutdown_connections 2024-09-12T02:01:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39edc14740 1 --2- 172.21.15.19:0/1085819645 >> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] conn(0x562042c4e5c0 0x562042c4e9a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39edc14740 1 --2- 172.21.15.19:0/1085819645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562042c1b440 0x562042bf5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39edc14740 1 --2- 172.21.15.19:0/1085819645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562042bfca50 0x562042bf5560 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39c37fe640 0 client.6768 ms_handle_reset on v2:172.21.15.19:6832/836344045 2024-09-12T02:01:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39edc14740 1 --2- 172.21.15.19:0/1085819645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562042bfb2c0 0x562042cbbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39edc14740 1 -- 172.21.15.19:0/1085819645 >> 172.21.15.19:0/1085819645 conn(0x562042bf8a80 msgr2=0x562042c59480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39edc14740 1 -- 172.21.15.19:0/1085819645 shutdown_connections 2024-09-12T02:01:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39edc14740 1 -- 172.21.15.19:0/1085819645 wait complete. 2024-09-12T02:01:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39edc14740 20 client.6768 trim_cache size 0 max 16384 2024-09-12T02:01:57.603 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:01:57.603 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T02:01:57.604 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T02:01:57.604 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 6082, 2024-09-12T02:01:57.604 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T02:01:57.604 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T02:01:57.604 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T02:01:57.604 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 4.6468692479999998, 2024-09-12T02:01:57.604 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 69, 2024-09-12T02:01:57.605 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 82, 2024-09-12T02:01:57.605 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T02:01:57.605 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 45.668626586999999 2024-09-12T02:01:57.605 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:01:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39eae80640 1 -- 172.21.15.19:0/926620470 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f39c806be30 msgr2=0x7f39c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39eae80640 1 --2- 172.21.15.19:0/926620470 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f39c806be30 0x7f39c806e2f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f39d0034000 tx=0x7f39d002e000 comp rx=0 tx=0).stop 2024-09-12T02:01:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39eae80640 1 -- 172.21.15.19:0/926620470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39e406cd20 msgr2=0x7f39e40b7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39eae80640 1 --2- 172.21.15.19:0/926620470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39e406cd20 0x7f39e40b7050 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f39d800c4d0 tx=0x7f39d800c990 comp rx=0 tx=0).stop 2024-09-12T02:01:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39eae80640 1 -- 172.21.15.19:0/926620470 shutdown_connections 2024-09-12T02:01:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39eae80640 1 --2- 172.21.15.19:0/926620470 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f39c806be30 0x7f39c806e2f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39eae80640 1 --2- 172.21.15.19:0/926620470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39e40b3760 0x7f39e41f4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39eae80640 1 --2- 172.21.15.19:0/926620470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39e409aa30 0x7f39e41f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39eae80640 1 --2- 172.21.15.19:0/926620470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39e406cd20 0x7f39e40b7050 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.596+0000 7f39eae80640 1 -- 172.21.15.19:0/926620470 >> 172.21.15.19:0/926620470 conn(0x7f39e40d23a0 msgr2=0x7f39e406d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.597+0000 7f39eae80640 1 -- 172.21.15.19:0/926620470 shutdown_connections 2024-09-12T02:01:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.597+0000 7f39eae80640 1 -- 172.21.15.19:0/926620470 wait complete. 2024-09-12T02:01:57.608 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat a/ && find a/') 2024-09-12T02:01:57.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:01:57.660 INFO:teuthology.orchestra.run.smithi019.stdout: File: a/ 2024-09-12T02:01:57.660 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 2 Blocks: 0 IO Block: 65536 directory 2024-09-12T02:01:57.660 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 29h/41d Inode: 1099511627776 Links: 4 2024-09-12T02:01:57.660 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0755/drwxr-xr-x) Uid: ( 1000/ ubuntu) Gid: ( 1333/ ubuntu) 2024-09-12T02:01:57.660 INFO:teuthology.orchestra.run.smithi019.stdout:Context: unconfined_u:object_r:unlabeled_t:s0 2024-09-12T02:01:57.661 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-12 02:01:24.066560858 +0000 2024-09-12T02:01:57.661 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-12 02:01:29.705501317 +0000 2024-09-12T02:01:57.661 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-12 02:01:29.705501317 +0000 2024-09-12T02:01:57.661 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-12 02:01:24.066560858 +0000 2024-09-12T02:01:57.664 INFO:teuthology.orchestra.run.smithi019.stdout:a/ 2024-09-12T02:01:57.664 INFO:teuthology.orchestra.run.smithi019.stdout:a/z 2024-09-12T02:01:57.665 INFO:teuthology.orchestra.run.smithi019.stdout:a/z/d 2024-09-12T02:01:57.665 INFO:teuthology.orchestra.run.smithi019.stdout:a/c 2024-09-12T02:01:57.665 INFO:teuthology.orchestra.run.smithi019.stdout:a/c/d 2024-09-12T02:01:57.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:01:57.671 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 flush journal 2024-09-12T02:01:57.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.776+0000 7f007fc65640 1 Processor -- start 2024-09-12T02:01:57.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.777+0000 7f007fc65640 1 -- start start 2024-09-12T02:01:57.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.777+0000 7f007fc65640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0078158b50 0x7f00780b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.778+0000 7f007fc65640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f00780b6360 0x7f007809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.778+0000 7f007fc65640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00780b6820 con 0x7f007815f950 2024-09-12T02:01:57.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.778+0000 7f007fc65640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f00780b6b00 con 0x7f0078158b50 2024-09-12T02:01:57.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.778+0000 7f007fc65640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f00780b6de0 con 0x7f00780b6360 2024-09-12T02:01:57.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.778+0000 7f007d200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f00780b6360 0x7f007809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.778+0000 7f007da01640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0078158b50 0x7f00780b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.778+0000 7f007d200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f00780b6360 0x7f007809aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:40590/0 (socket says 172.21.15.19:40590) 2024-09-12T02:01:57.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.778+0000 7f007d200640 1 -- 172.21.15.19:0/1483961672 learned_addr learned my addr 172.21.15.19:0/1483961672 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:57.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.778+0000 7f007da01640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0078158b50 0x7f00780b5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56912/0 (socket says 172.21.15.19:56912) 2024-09-12T02:01:57.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.778+0000 7f007d200640 1 -- 172.21.15.19:0/1483961672 >> v2:172.21.15.19:3300/0 conn(0x7f0078158b50 msgr2=0x7f00780b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:57.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.778+0000 7f007d200640 1 --2- 172.21.15.19:0/1483961672 >> v2:172.21.15.19:3300/0 conn(0x7f0078158b50 0x7f00780b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.778+0000 7f007d200640 1 -- 172.21.15.19:0/1483961672 >> v1:172.21.15.135:6789/0 conn(0x7f007815f950 legacy=0x7f0078162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.778+0000 7f007c9ff640 1 -- 172.21.15.19:0/1483961672 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2063426535 0 0) 0x7f00780b6820 con 0x7f007815f950 2024-09-12T02:01:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.778+0000 7f007d200640 1 -- 172.21.15.19:0/1483961672 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00780b70c0 con 0x7f00780b6360 2024-09-12T02:01:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.778+0000 7f007da01640 1 --2- 172.21.15.19:0/1483961672 >> v2:172.21.15.19:3300/0 conn(0x7f0078158b50 0x7f00780b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.779+0000 7f007d200640 1 --2- 172.21.15.19:0/1483961672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00780b6360 0x7f007809aa30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f00780b18c0 tx=0x7f006c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dced732c5e968378 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.779+0000 7f007c9ff640 1 -- 172.21.15.19:0/1483961672 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c037070 con 0x7f00780b6360 2024-09-12T02:01:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.779+0000 7f007c9ff640 1 -- 172.21.15.19:0/1483961672 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f006c032440 con 0x7f00780b6360 2024-09-12T02:01:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.779+0000 7f007c9ff640 1 -- 172.21.15.19:0/1483961672 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c032810 con 0x7f00780b6360 2024-09-12T02:01:57.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.780+0000 7f007fc65640 1 -- 172.21.15.19:0/1483961672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00780b6360 msgr2=0x7f007809aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.780+0000 7f007fc65640 1 --2- 172.21.15.19:0/1483961672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00780b6360 0x7f007809aa30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f00780b18c0 tx=0x7f006c02a270 comp rx=0 tx=0).stop 2024-09-12T02:01:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.780+0000 7f007fc65640 1 -- 172.21.15.19:0/1483961672 shutdown_connections 2024-09-12T02:01:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.780+0000 7f007fc65640 1 --2- 172.21.15.19:0/1483961672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00780b6360 0x7f007809aa30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.780+0000 7f007fc65640 1 --2- 172.21.15.19:0/1483961672 >> v2:172.21.15.19:3300/0 conn(0x7f0078158b50 0x7f00780b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.780+0000 7f007fc65640 1 -- 172.21.15.19:0/1483961672 >> 172.21.15.19:0/1483961672 conn(0x7f00780b79e0 msgr2=0x7f00780b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.780+0000 7f007fc65640 1 -- 172.21.15.19:0/1483961672 shutdown_connections 2024-09-12T02:01:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.780+0000 7f007fc65640 1 -- 172.21.15.19:0/1483961672 wait complete. 2024-09-12T02:01:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.781+0000 7f007fc65640 1 Processor -- start 2024-09-12T02:01:57.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.781+0000 7f007fc65640 1 -- start start 2024-09-12T02:01:57.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.782+0000 7f007fc65640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00780b6360 0x7f007814ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.782+0000 7f007fc65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0078158b50 0x7f0078160e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.782+0000 7f007fc65640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f007815f950 0x7f0078161360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.782+0000 7f007fc65640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f00781590b0 con 0x7f0078158b50 2024-09-12T02:01:57.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.782+0000 7f007fc65640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0078158f30 con 0x7f007815f950 2024-09-12T02:01:57.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.782+0000 7f007fc65640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0078070ea0 con 0x7f00780b6360 2024-09-12T02:01:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.782+0000 7f007d200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0078158b50 0x7f0078160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.782+0000 7f007d200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0078158b50 0x7f0078160e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56916/0 (socket says 172.21.15.19:56916) 2024-09-12T02:01:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.782+0000 7f007d200640 1 -- 172.21.15.19:0/3309347248 learned_addr learned my addr 172.21.15.19:0/3309347248 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.782+0000 7f007da01640 1 --2- 172.21.15.19:0/3309347248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00780b6360 0x7f007814ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.782+0000 7f007e202640 1 --2- 172.21.15.19:0/3309347248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f007815f950 0x7f0078161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.782+0000 7f007d200640 1 -- 172.21.15.19:0/3309347248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00780b6360 msgr2=0x7f007814ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.782+0000 7f007d200640 1 --2- 172.21.15.19:0/3309347248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00780b6360 0x7f007814ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.782+0000 7f007d200640 1 -- 172.21.15.19:0/3309347248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f007815f950 msgr2=0x7f0078161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.782+0000 7f007d200640 1 --2- 172.21.15.19:0/3309347248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f007815f950 0x7f0078161360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.782+0000 7f007d200640 1 -- 172.21.15.19:0/3309347248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00780cbf00 con 0x7f0078158b50 2024-09-12T02:01:57.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.783+0000 7f007d200640 1 --2- 172.21.15.19:0/3309347248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0078158b50 0x7f0078160e20 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f006c035040 tx=0x7f006c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:57.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.783+0000 7f00767fc640 1 -- 172.21.15.19:0/3309347248 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c037040 con 0x7f0078158b50 2024-09-12T02:01:57.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.783+0000 7f00767fc640 1 -- 172.21.15.19:0/3309347248 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f006c004030 con 0x7f0078158b50 2024-09-12T02:01:57.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.783+0000 7f007fc65640 1 -- 172.21.15.19:0/3309347248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00780afeb0 con 0x7f0078158b50 2024-09-12T02:01:57.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.783+0000 7f00767fc640 1 -- 172.21.15.19:0/3309347248 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c004420 con 0x7f0078158b50 2024-09-12T02:01:57.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.783+0000 7f007fc65640 1 -- 172.21.15.19:0/3309347248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00780cc1a0 con 0x7f0078158b50 2024-09-12T02:01:57.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.784+0000 7f00767fc640 1 -- 172.21.15.19:0/3309347248 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f006c03a070 con 0x7f0078158b50 2024-09-12T02:01:57.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.785+0000 7f00767fc640 1 --2- 172.21.15.19:0/3309347248 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f006406be30 0x7f006406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.785+0000 7f00767fc640 1 -- 172.21.15.19:0/3309347248 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6187+0+0 (secure 0 0 0) 0x7f006c0ab690 con 0x7f0078158b50 2024-09-12T02:01:57.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.785+0000 7f007da01640 1 --2- 172.21.15.19:0/3309347248 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f006406be30 0x7f006406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.786+0000 7f007da01640 1 --2- 172.21.15.19:0/3309347248 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f006406be30 0x7f006406e2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0070009560 tx=0x7f0070009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:57.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.786+0000 7f0082a03740 1 Processor -- start 2024-09-12T02:01:57.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.786+0000 7f0082a03740 1 -- start start 2024-09-12T02:01:57.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f0082a03740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093e1920 0x55f3094270c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f0082a03740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093df0e0 0x55f3093e1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f0082a03740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e30b0 0x55f3093dc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f0082a03740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f3093446f0 con 0x55f3093df0e0 2024-09-12T02:01:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f0082a03740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f3092ec330 con 0x55f3093e30b0 2024-09-12T02:01:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f0082a03740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55f3093406b0 con 0x55f3093e1920 2024-09-12T02:01:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f007d200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093df0e0 0x55f3093e1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f007d200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093df0e0 0x55f3093e1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56918/0 (socket says 172.21.15.19:56918) 2024-09-12T02:01:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f007d200640 1 -- 172.21.15.19:0/1590140794 learned_addr learned my addr 172.21.15.19:0/1590140794 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f007da01640 1 --2- 172.21.15.19:0/1590140794 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093e1920 0x55f3094270c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f007e202640 1 --2- 172.21.15.19:0/1590140794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e30b0 0x55f3093dc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f007d200640 1 -- 172.21.15.19:0/1590140794 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093e1920 msgr2=0x55f3094270c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f007d200640 1 --2- 172.21.15.19:0/1590140794 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093e1920 0x55f3094270c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f007d200640 1 -- 172.21.15.19:0/1590140794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e30b0 msgr2=0x55f3093dc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f007d200640 1 --2- 172.21.15.19:0/1590140794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e30b0 0x55f3093dc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f007d200640 1 -- 172.21.15.19:0/1590140794 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3093120d0 con 0x55f3093df0e0 2024-09-12T02:01:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f007d200640 1 --2- 172.21.15.19:0/1590140794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093df0e0 0x55f3093e1d00 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f006c0a98c0 tx=0x7f006c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795b0232a6708078 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f005f7fe640 1 -- 172.21.15.19:0/1590140794 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c04a040 con 0x55f3093df0e0 2024-09-12T02:01:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.787+0000 7f005f7fe640 1 -- 172.21.15.19:0/1590140794 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f006c07dbd0 con 0x55f3093df0e0 2024-09-12T02:01:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.788+0000 7f005f7fe640 1 -- 172.21.15.19:0/1590140794 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c082400 con 0x55f3093df0e0 2024-09-12T02:01:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.788+0000 7f0082a03740 1 -- 172.21.15.19:0/1590140794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093df0e0 msgr2=0x55f3093e1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.788+0000 7f0082a03740 1 --2- 172.21.15.19:0/1590140794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093df0e0 0x55f3093e1d00 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f006c0a98c0 tx=0x7f006c009240 comp rx=0 tx=0).stop 2024-09-12T02:01:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.788+0000 7f0082a03740 1 -- 172.21.15.19:0/1590140794 shutdown_connections 2024-09-12T02:01:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.788+0000 7f0082a03740 1 --2- 172.21.15.19:0/1590140794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e30b0 0x55f3093dc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.788+0000 7f0082a03740 1 --2- 172.21.15.19:0/1590140794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093df0e0 0x55f3093e1d00 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.788+0000 7f0082a03740 1 --2- 172.21.15.19:0/1590140794 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093e1920 0x55f3094270c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.788+0000 7f0082a03740 1 -- 172.21.15.19:0/1590140794 >> 172.21.15.19:0/1590140794 conn(0x55f3093de370 msgr2=0x55f309426590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.788+0000 7f0082a03740 1 -- 172.21.15.19:0/1590140794 shutdown_connections 2024-09-12T02:01:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.788+0000 7f0082a03740 1 -- 172.21.15.19:0/1590140794 wait complete. 2024-09-12T02:01:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.789+0000 7f0082a03740 1 -- start start 2024-09-12T02:01:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.789+0000 7f0082a03740 1 Processor -- start 2024-09-12T02:01:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f0082a03740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e1920 0x55f309400ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f0082a03740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093e30b0 0x55f30940c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f0082a03740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093db890 0x55f3093dbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f0082a03740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f3093446f0 con 0x55f3093e30b0 2024-09-12T02:01:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f0082a03740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f3092cd4f0 con 0x55f3093e1920 2024-09-12T02:01:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f0082a03740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55f3093dd810 con 0x55f3093db890 2024-09-12T02:01:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f0082a03740 10 client.0 _ll_register_callbacks cb 0x55f3092eeb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f007d200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093e30b0 0x55f30940c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f007d200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093e30b0 0x55f30940c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56920/0 (socket says 172.21.15.19:56920) 2024-09-12T02:01:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f007d200640 1 -- 172.21.15.19:0/3128952288 learned_addr learned my addr 172.21.15.19:0/3128952288 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f007e202640 1 --2- 172.21.15.19:0/3128952288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093db890 0x55f3093dbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f007da01640 1 --2- 172.21.15.19:0/3128952288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e1920 0x55f309400ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f007d200640 1 -- 172.21.15.19:0/3128952288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093db890 msgr2=0x55f3093dbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f007d200640 1 --2- 172.21.15.19:0/3128952288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093db890 0x55f3093dbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f007d200640 1 -- 172.21.15.19:0/3128952288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e1920 msgr2=0x55f309400ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f007d200640 1 --2- 172.21.15.19:0/3128952288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e1920 0x55f309400ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f007d200640 1 -- 172.21.15.19:0/3128952288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3091217d0 con 0x55f3093e30b0 2024-09-12T02:01:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f007d200640 1 --2- 172.21.15.19:0/3128952288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093e30b0 0x55f30940c940 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f006c000c00 tx=0x7f006c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ceb0f6204e6298 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.790+0000 7f005cff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:01:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.791+0000 7f005cff9640 1 -- 172.21.15.19:0/3128952288 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c04a040 con 0x55f3093e30b0 2024-09-12T02:01:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.791+0000 7f005cff9640 1 -- 172.21.15.19:0/3128952288 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 6187+0+0 (secure 0 0 0) 0x7f006c075f40 con 0x55f3093e30b0 2024-09-12T02:01:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.791+0000 7f0082a03740 1 -- 172.21.15.19:0/3128952288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f006c07dbd0 con 0x55f3093e30b0 2024-09-12T02:01:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.791+0000 7f005cff9640 1 -- 172.21.15.19:0/3128952288 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f006c082400 con 0x55f3093e30b0 2024-09-12T02:01:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.791+0000 7f0082a03740 10 client.6780 fetch_fsmap learned FSMap version 69 2024-09-12T02:01:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.791+0000 7f0082a03740 1 -- 172.21.15.19:0/3128952288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x55f3090573f0 con 0x55f3093e30b0 2024-09-12T02:01:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.791+0000 7f005cff9640 1 -- 172.21.15.19:0/3128952288 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f006c07dbd0 con 0x55f3093e30b0 2024-09-12T02:01:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.791+0000 7f005cff9640 1 -- 172.21.15.19:0/3128952288 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f006c081f70 con 0x55f3093e30b0 2024-09-12T02:01:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.791+0000 7f0082a03740 10 client.6780 fetch_fsmap finished waiting for FSMap version 69 2024-09-12T02:01:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.791+0000 7f0082a03740 10 client.6780 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-09-12T02:01:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.791+0000 7f0082a03740 20 client.6780 populate_metadata read hostname 'smithi019' 2024-09-12T02:01:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.791+0000 7f0082a03740 1 --2- 172.21.15.19:0/3128952288 >> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] conn(0x55f309441090 0x55f309443480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.791+0000 7f0082a03740 4 client.6780 mds_command: new command op to 6082 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:01:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.791+0000 7f0082a03740 1 -- 172.21.15.19:0/3128952288 --> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f309351e20 con 0x55f309441090 2024-09-12T02:01:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.791+0000 7f007da01640 1 --2- 172.21.15.19:0/3128952288 >> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] conn(0x55f309441090 0x55f309443480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.791+0000 7f007da01640 1 --2- 172.21.15.19:0/3128952288 >> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] conn(0x55f309441090 0x55f309443480 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4aaf7bfd632e24b server_cookie=6b90deb4b9d87441 in_seq=0 out_seq=0 2024-09-12T02:01:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.792+0000 7f005cff9640 10 client.6780 ms_handle_connect on v2:172.21.15.19:6832/836344045 2024-09-12T02:01:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.792+0000 7f005cff9640 1 -- 172.21.15.19:0/3128952288 <== mds.0 v2:172.21.15.19:6832/836344045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f309351e20 con 0x55f309441090 2024-09-12T02:01:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.792+0000 7f005cff9640 10 client.6780 handle_command_reply: tid=0 2024-09-12T02:01:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.792+0000 7f0082a03740 1 client.6780 shutdown 2024-09-12T02:01:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.792+0000 7f0082a03740 1 -- 172.21.15.19:0/3128952288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093e30b0 msgr2=0x55f30940c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.792+0000 7f0082a03740 1 --2- 172.21.15.19:0/3128952288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093e30b0 0x55f30940c940 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f006c000c00 tx=0x7f006c02a270 comp rx=0 tx=0).stop 2024-09-12T02:01:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.792+0000 7f0082a03740 1 -- 172.21.15.19:0/3128952288 shutdown_connections 2024-09-12T02:01:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.792+0000 7f0082a03740 1 --2- 172.21.15.19:0/3128952288 >> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] conn(0x55f309441090 0x55f309443480 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.792+0000 7f0082a03740 1 --2- 172.21.15.19:0/3128952288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093db890 0x55f3093dbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.792+0000 7f0082a03740 1 --2- 172.21.15.19:0/3128952288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093e30b0 0x55f30940c940 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.792+0000 7f0082a03740 1 --2- 172.21.15.19:0/3128952288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e1920 0x55f309400ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.792+0000 7f005cff9640 0 client.6780 ms_handle_reset on v2:172.21.15.19:6832/836344045 2024-09-12T02:01:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.792+0000 7f0082a03740 1 -- 172.21.15.19:0/3128952288 >> 172.21.15.19:0/3128952288 conn(0x55f3093df0e0 msgr2=0x55f309425b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.792+0000 7f0082a03740 1 -- 172.21.15.19:0/3128952288 shutdown_connections 2024-09-12T02:01:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.792+0000 7f0082a03740 1 -- 172.21.15.19:0/3128952288 wait complete. 2024-09-12T02:01:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.793+0000 7f0082a03740 20 client.6780 trim_cache size 0 max 16384 2024-09-12T02:01:57.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.807+0000 7f0082a03740 1 Processor -- start 2024-09-12T02:01:57.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.807+0000 7f0082a03740 1 -- start start 2024-09-12T02:01:57.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.808+0000 7f0082a03740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093db890 0x55f30940df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.808+0000 7f0082a03740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e1920 0x55f30949b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.808+0000 7f0082a03740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093e30b0 0x55f309424610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.808+0000 7f0082a03740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f00782012c0 con 0x55f3093db890 2024-09-12T02:01:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.808+0000 7f0082a03740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f00782002a0 con 0x55f3093e1920 2024-09-12T02:01:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.808+0000 7f0082a03740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f00781ff720 con 0x55f3093e30b0 2024-09-12T02:01:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.808+0000 7f007da01640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093db890 0x55f30940df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.808+0000 7f007da01640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093db890 0x55f30940df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56932/0 (socket says 172.21.15.19:56932) 2024-09-12T02:01:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.808+0000 7f007da01640 1 -- 172.21.15.19:0/3461328041 learned_addr learned my addr 172.21.15.19:0/3461328041 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.808+0000 7f007e202640 1 --2- 172.21.15.19:0/3461328041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093e30b0 0x55f309424610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.808+0000 7f007d200640 1 --2- 172.21.15.19:0/3461328041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e1920 0x55f30949b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.808+0000 7f007da01640 1 -- 172.21.15.19:0/3461328041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093e30b0 msgr2=0x55f309424610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.808+0000 7f007da01640 1 --2- 172.21.15.19:0/3461328041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093e30b0 0x55f309424610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.808+0000 7f007da01640 1 -- 172.21.15.19:0/3461328041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e1920 msgr2=0x55f30949b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.808+0000 7f007da01640 1 --2- 172.21.15.19:0/3461328041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e1920 0x55f30949b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.808+0000 7f007da01640 1 -- 172.21.15.19:0/3461328041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f30940ccb0 con 0x55f3093db890 2024-09-12T02:01:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.808+0000 7f007da01640 1 --2- 172.21.15.19:0/3461328041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093db890 0x55f30940df70 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0070011b10 tx=0x7f0070018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea872496f2cf66f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.808+0000 7f005effd640 1 -- 172.21.15.19:0/3461328041 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00700036d0 con 0x55f3093db890 2024-09-12T02:01:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.809+0000 7f005effd640 1 -- 172.21.15.19:0/3461328041 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0070003870 con 0x55f3093db890 2024-09-12T02:01:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.809+0000 7f005effd640 1 -- 172.21.15.19:0/3461328041 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0070003c60 con 0x55f3093db890 2024-09-12T02:01:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.809+0000 7f0082a03740 1 -- 172.21.15.19:0/3461328041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093db890 msgr2=0x55f30940df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.809+0000 7f0082a03740 1 --2- 172.21.15.19:0/3461328041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093db890 0x55f30940df70 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0070011b10 tx=0x7f0070018000 comp rx=0 tx=0).stop 2024-09-12T02:01:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.809+0000 7f0082a03740 1 -- 172.21.15.19:0/3461328041 shutdown_connections 2024-09-12T02:01:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.809+0000 7f0082a03740 1 --2- 172.21.15.19:0/3461328041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093e30b0 0x55f309424610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.809+0000 7f0082a03740 1 --2- 172.21.15.19:0/3461328041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e1920 0x55f30949b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.809+0000 7f0082a03740 1 --2- 172.21.15.19:0/3461328041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093db890 0x55f30940df70 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.809+0000 7f0082a03740 1 -- 172.21.15.19:0/3461328041 >> 172.21.15.19:0/3461328041 conn(0x55f3093df0e0 msgr2=0x55f3093d77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.809+0000 7f0082a03740 1 -- 172.21.15.19:0/3461328041 shutdown_connections 2024-09-12T02:01:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.809+0000 7f0082a03740 1 -- 172.21.15.19:0/3461328041 wait complete. 2024-09-12T02:01:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.810+0000 7f0082a03740 1 -- start start 2024-09-12T02:01:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.810+0000 7f0082a03740 1 Processor -- start 2024-09-12T02:01:57.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f0082a03740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093db890 0x55f309406c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f0082a03740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e1920 0x55f309492020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f0082a03740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093e30b0 0x55f30942a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f0082a03740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f3094240a0 con 0x55f3093db890 2024-09-12T02:01:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f0082a03740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f00781ffc40 con 0x55f3093e1920 2024-09-12T02:01:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f0082a03740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55f3093d7ef0 con 0x55f3093e30b0 2024-09-12T02:01:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f0082a03740 10 client.0 _ll_register_callbacks cb 0x7f006c090070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f007da01640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093db890 0x55f309406c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f007da01640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093db890 0x55f309406c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56942/0 (socket says 172.21.15.19:56942) 2024-09-12T02:01:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f007da01640 1 -- 172.21.15.19:0/3479110109 learned_addr learned my addr 172.21.15.19:0/3479110109 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f007d200640 1 --2- 172.21.15.19:0/3479110109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e1920 0x55f309492020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f007e202640 1 --2- 172.21.15.19:0/3479110109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093e30b0 0x55f30942a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f007da01640 1 -- 172.21.15.19:0/3479110109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093e30b0 msgr2=0x55f30942a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f007da01640 1 --2- 172.21.15.19:0/3479110109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093e30b0 0x55f30942a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f007da01640 1 -- 172.21.15.19:0/3479110109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e1920 msgr2=0x55f309492020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:57.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f007da01640 1 --2- 172.21.15.19:0/3479110109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e1920 0x55f309492020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f007da01640 1 -- 172.21.15.19:0/3479110109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3093dc060 con 0x55f3093db890 2024-09-12T02:01:57.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f007da01640 1 --2- 172.21.15.19:0/3479110109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093db890 0x55f309406c80 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f0070003cd0 tx=0x7f0070004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edddefbbd3d84679 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:57.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f005cff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:01:57.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.811+0000 7f005cff9640 1 -- 172.21.15.19:0/3479110109 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0070039020 con 0x55f3093db890 2024-09-12T02:01:57.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.812+0000 7f005cff9640 1 -- 172.21.15.19:0/3479110109 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 6187+0+0 (secure 0 0 0) 0x7f0070005da0 con 0x55f3093db890 2024-09-12T02:01:57.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.812+0000 7f0082a03740 1 -- 172.21.15.19:0/3479110109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0070003870 con 0x55f3093db890 2024-09-12T02:01:57.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.812+0000 7f005cff9640 1 -- 172.21.15.19:0/3479110109 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f00700036d0 con 0x55f3093db890 2024-09-12T02:01:57.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.812+0000 7f0082a03740 10 client.6786 fetch_fsmap learned FSMap version 69 2024-09-12T02:01:57.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.812+0000 7f0082a03740 1 -- 172.21.15.19:0/3479110109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x55f3090170f0 con 0x55f3093db890 2024-09-12T02:01:57.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.812+0000 7f005cff9640 1 -- 172.21.15.19:0/3479110109 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0070003870 con 0x55f3093db890 2024-09-12T02:01:57.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.812+0000 7f005cff9640 1 -- 172.21.15.19:0/3479110109 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f007002b020 con 0x55f3093db890 2024-09-12T02:01:57.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.812+0000 7f0082a03740 10 client.6786 fetch_fsmap finished waiting for FSMap version 69 2024-09-12T02:01:57.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.812+0000 7f0082a03740 10 client.6786 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-09-12T02:01:57.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.812+0000 7f0082a03740 20 client.6786 populate_metadata read hostname 'smithi019' 2024-09-12T02:01:57.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.812+0000 7f0082a03740 1 --2- 172.21.15.19:0/3479110109 >> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] conn(0x55f309424bb0 0x55f309491760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:57.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.812+0000 7f0082a03740 4 client.6786 mds_command: new command op to 6082 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:01:57.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.812+0000 7f0082a03740 1 -- 172.21.15.19:0/3479110109 --> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f309425930 con 0x55f309424bb0 2024-09-12T02:01:57.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.812+0000 7f007d200640 1 --2- 172.21.15.19:0/3479110109 >> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] conn(0x55f309424bb0 0x55f309491760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:57.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.812+0000 7f005cff9640 10 client.6786 ms_handle_connect on v2:172.21.15.19:6832/836344045 2024-09-12T02:01:57.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.812+0000 7f007d200640 1 --2- 172.21.15.19:0/3479110109 >> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] conn(0x55f309424bb0 0x55f309491760 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c719b8d5b72cb6b server_cookie=2987be86f7bcd5ec in_seq=0 out_seq=0 2024-09-12T02:01:57.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.824+0000 7f005cff9640 1 -- 172.21.15.19:0/3479110109 <== mds.0 v2:172.21.15.19:6832/836344045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f309425930 con 0x55f309424bb0 2024-09-12T02:01:57.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.824+0000 7f005cff9640 10 client.6786 handle_command_reply: tid=0 2024-09-12T02:01:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.824+0000 7f0082a03740 1 client.6786 shutdown 2024-09-12T02:01:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f0082a03740 1 -- 172.21.15.19:0/3479110109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093db890 msgr2=0x55f309406c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f0082a03740 1 --2- 172.21.15.19:0/3479110109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093db890 0x55f309406c80 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f0070003cd0 tx=0x7f0070004730 comp rx=0 tx=0).stop 2024-09-12T02:01:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f0082a03740 1 -- 172.21.15.19:0/3479110109 shutdown_connections 2024-09-12T02:01:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f0082a03740 1 --2- 172.21.15.19:0/3479110109 >> [v2:172.21.15.19:6832/836344045,v1:172.21.15.19:6834/836344045] conn(0x55f309424bb0 0x55f309491760 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f0082a03740 1 --2- 172.21.15.19:0/3479110109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f3093e30b0 0x55f30942a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f005cff9640 0 client.6786 ms_handle_reset on v2:172.21.15.19:6832/836344045 2024-09-12T02:01:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f0082a03740 1 --2- 172.21.15.19:0/3479110109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3093e1920 0x55f309492020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f0082a03740 1 --2- 172.21.15.19:0/3479110109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f3093db890 0x55f309406c80 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f0082a03740 1 -- 172.21.15.19:0/3479110109 >> 172.21.15.19:0/3479110109 conn(0x55f3093df0e0 msgr2=0x55f30949e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f0082a03740 1 -- 172.21.15.19:0/3479110109 shutdown_connections 2024-09-12T02:01:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f0082a03740 1 -- 172.21.15.19:0/3479110109 wait complete. 2024-09-12T02:01:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f0082a03740 20 client.6786 trim_cache size 0 max 16384 2024-09-12T02:01:57.826 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:01:57.826 INFO:teuthology.orchestra.run.smithi019.stdout: "message": "", 2024-09-12T02:01:57.826 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0 2024-09-12T02:01:57.826 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:01:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f007fc65640 1 -- 172.21.15.19:0/3309347248 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f006406be30 msgr2=0x7f006406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f007fc65640 1 --2- 172.21.15.19:0/3309347248 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f006406be30 0x7f006406e2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0070009560 tx=0x7f0070009190 comp rx=0 tx=0).stop 2024-09-12T02:01:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f007fc65640 1 -- 172.21.15.19:0/3309347248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0078158b50 msgr2=0x7f0078160e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f007fc65640 1 --2- 172.21.15.19:0/3309347248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0078158b50 0x7f0078160e20 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f006c035040 tx=0x7f006c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f007fc65640 1 -- 172.21.15.19:0/3309347248 shutdown_connections 2024-09-12T02:01:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f007fc65640 1 --2- 172.21.15.19:0/3309347248 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f006406be30 0x7f006406e2f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f007fc65640 1 --2- 172.21.15.19:0/3309347248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f007815f950 0x7f0078161360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f007fc65640 1 --2- 172.21.15.19:0/3309347248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0078158b50 0x7f0078160e20 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f007fc65640 1 --2- 172.21.15.19:0/3309347248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00780b6360 0x7f007814ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.825+0000 7f007fc65640 1 -- 172.21.15.19:0/3309347248 >> 172.21.15.19:0/3309347248 conn(0x7f00780b79e0 msgr2=0x7f00780b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.826+0000 7f007fc65640 1 -- 172.21.15.19:0/3309347248 shutdown_connections 2024-09-12T02:01:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:57.826+0000 7f007fc65640 1 -- 172.21.15.19:0/3309347248 wait complete. 2024-09-12T02:01:57.836 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:01:57.836 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:01:57.889 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:01:57.926 INFO:tasks.ceph.mds.a.smithi019.stderr:2024-09-12T02:01:57.927+0000 7fed7be90640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:01:57.934 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:01:57.934 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:01:57.934 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:01:57.935 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:01:57.951 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:01:57.951 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:01:58.009 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:01:58.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.154+0000 7fe845398640 1 Processor -- start 2024-09-12T02:01:58.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.154+0000 7fe845398640 1 -- start start 2024-09-12T02:01:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.155+0000 7fe845398640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe840072320 0x7fe8400cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.155+0000 7fe845398640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe840072de0 0x7fe84006e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.155+0000 7fe845398640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe840146140 con 0x7fe840072700 2024-09-12T02:01:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.155+0000 7fe845398640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fe8400cd740 con 0x7fe840072320 2024-09-12T02:01:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.155+0000 7fe845398640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe8400cda20 con 0x7fe840072de0 2024-09-12T02:01:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.155+0000 7fe83effd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe840072320 0x7fe8400cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.155+0000 7fe83effd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe840072320 0x7fe8400cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56956/0 (socket says 172.21.15.19:56956) 2024-09-12T02:01:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.155+0000 7fe83effd640 1 -- 172.21.15.19:0/97361101 learned_addr learned my addr 172.21.15.19:0/97361101 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.155+0000 7fe837fff640 1 --2- 172.21.15.19:0/97361101 >> v2:172.21.15.135:3300/0 conn(0x7fe840072de0 0x7fe84006e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.155+0000 7fe83effd640 1 -- 172.21.15.19:0/97361101 >> v2:172.21.15.135:3300/0 conn(0x7fe840072de0 msgr2=0x7fe84006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.155+0000 7fe83effd640 1 --2- 172.21.15.19:0/97361101 >> v2:172.21.15.135:3300/0 conn(0x7fe840072de0 0x7fe84006e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.155+0000 7fe83effd640 1 -- 172.21.15.19:0/97361101 >> v1:172.21.15.135:6789/0 conn(0x7fe840072700 legacy=0x7fe84006e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.155+0000 7fe83effd640 1 -- 172.21.15.19:0/97361101 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8400cdd00 con 0x7fe840072320 2024-09-12T02:01:58.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.156+0000 7fe83effd640 1 --2- 172.21.15.19:0/97361101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe840072320 0x7fe8400cce60 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fe84006f8c0 tx=0x7fe83002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5def42cf965b2714 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:58.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.156+0000 7fe83e7fc640 1 -- 172.21.15.19:0/97361101 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe830037070 con 0x7fe840072320 2024-09-12T02:01:58.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.156+0000 7fe83e7fc640 1 -- 172.21.15.19:0/97361101 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe830032440 con 0x7fe840072320 2024-09-12T02:01:58.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.156+0000 7fe83e7fc640 1 -- 172.21.15.19:0/97361101 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe830032810 con 0x7fe840072320 2024-09-12T02:01:58.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.157+0000 7fe845398640 1 -- 172.21.15.19:0/97361101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe840072320 msgr2=0x7fe8400cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:58.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.157+0000 7fe845398640 1 --2- 172.21.15.19:0/97361101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe840072320 0x7fe8400cce60 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fe84006f8c0 tx=0x7fe83002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.157+0000 7fe845398640 1 -- 172.21.15.19:0/97361101 shutdown_connections 2024-09-12T02:01:58.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.157+0000 7fe845398640 1 --2- 172.21.15.19:0/97361101 >> v2:172.21.15.135:3300/0 conn(0x7fe840072de0 0x7fe84006e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.157+0000 7fe845398640 1 --2- 172.21.15.19:0/97361101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe840072320 0x7fe8400cce60 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.157+0000 7fe845398640 1 -- 172.21.15.19:0/97361101 >> 172.21.15.19:0/97361101 conn(0x7fe840067d70 msgr2=0x7fe84006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:58.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.157+0000 7fe845398640 1 -- 172.21.15.19:0/97361101 shutdown_connections 2024-09-12T02:01:58.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.157+0000 7fe845398640 1 -- 172.21.15.19:0/97361101 wait complete. 2024-09-12T02:01:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.158+0000 7fe845398640 1 Processor -- start 2024-09-12T02:01:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.158+0000 7fe845398640 1 -- start start 2024-09-12T02:01:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.159+0000 7fe845398640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe840072320 0x7fe8400a9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.159+0000 7fe845398640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe840072700 0x7fe8401e69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.159+0000 7fe845398640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe840072de0 0x7fe8401e6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.159+0000 7fe845398640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe8400cd520 con 0x7fe840072700 2024-09-12T02:01:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.159+0000 7fe845398640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe8400cd3a0 con 0x7fe840072320 2024-09-12T02:01:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.159+0000 7fe845398640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe84006ed00 con 0x7fe840072de0 2024-09-12T02:01:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.159+0000 7fe837fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe840072700 0x7fe8401e69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.159+0000 7fe837fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe840072700 0x7fe8401e69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56970/0 (socket says 172.21.15.19:56970) 2024-09-12T02:01:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.159+0000 7fe837fff640 1 -- 172.21.15.19:0/2721933341 learned_addr learned my addr 172.21.15.19:0/2721933341 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.159+0000 7fe83effd640 1 --2- 172.21.15.19:0/2721933341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe840072320 0x7fe8400a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.159+0000 7fe83f7fe640 1 --2- 172.21.15.19:0/2721933341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe840072de0 0x7fe8401e6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.159+0000 7fe837fff640 1 -- 172.21.15.19:0/2721933341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe840072de0 msgr2=0x7fe8401e6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.159+0000 7fe837fff640 1 --2- 172.21.15.19:0/2721933341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe840072de0 0x7fe8401e6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.159+0000 7fe837fff640 1 -- 172.21.15.19:0/2721933341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe840072320 msgr2=0x7fe8400a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.159+0000 7fe837fff640 1 --2- 172.21.15.19:0/2721933341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe840072320 0x7fe8400a9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.159+0000 7fe837fff640 1 -- 172.21.15.19:0/2721933341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8401e7770 con 0x7fe840072700 2024-09-12T02:01:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.159+0000 7fe837fff640 1 --2- 172.21.15.19:0/2721933341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe840072700 0x7fe8401e69e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fe82800d620 tx=0x7fe82800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.159+0000 7fe8377fe640 1 -- 172.21.15.19:0/2721933341 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8280125f0 con 0x7fe840072700 2024-09-12T02:01:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.160+0000 7fe8377fe640 1 -- 172.21.15.19:0/2721933341 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe828019070 con 0x7fe840072700 2024-09-12T02:01:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.160+0000 7fe845398640 1 -- 172.21.15.19:0/2721933341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8401e7a50 con 0x7fe840072700 2024-09-12T02:01:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.160+0000 7fe8377fe640 1 -- 172.21.15.19:0/2721933341 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8280129d0 con 0x7fe840072700 2024-09-12T02:01:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.160+0000 7fe845398640 1 -- 172.21.15.19:0/2721933341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8401e8010 con 0x7fe840072700 2024-09-12T02:01:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.161+0000 7fe845398640 1 -- 172.21.15.19:0/2721933341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe840075740 con 0x7fe840072700 2024-09-12T02:01:58.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.161+0000 7fe8377fe640 1 -- 172.21.15.19:0/2721933341 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe828012b70 con 0x7fe840072700 2024-09-12T02:01:58.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.162+0000 7fe8377fe640 1 --2- 172.21.15.19:0/2721933341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe82006be30 0x7fe82006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.162+0000 7fe8377fe640 1 -- 172.21.15.19:0/2721933341 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6187+0+0 (secure 0 0 0) 0x7fe82808b380 con 0x7fe840072700 2024-09-12T02:01:58.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.162+0000 7fe83effd640 1 --2- 172.21.15.19:0/2721933341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe82006be30 0x7fe82006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:58.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.162+0000 7fe83effd640 1 --2- 172.21.15.19:0/2721933341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe82006be30 0x7fe82006e2f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe830034000 tx=0x7fe83002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:58.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.166+0000 7fe8377fe640 1 -- 172.21.15.19:0/2721933341 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe840075740 con 0x7fe840072700 2024-09-12T02:01:58.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.352+0000 7fe845398640 1 -- 172.21.15.19:0/2721933341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe8400cce60 con 0x7fe840072700 2024-09-12T02:01:58.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.352+0000 7fe8377fe640 1 -- 172.21.15.19:0/2721933341 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v82) ==== 80+0+124 (secure 0 0 0) 0x7fe828059be0 con 0x7fe840072700 2024-09-12T02:01:58.351 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6836/1796121402 2024-09-13T02:01:52.946892+0000 2024-09-12T02:01:58.352 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/1796121402 2024-09-13T02:01:52.946892+0000 2024-09-12T02:01:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:listed 2 entries 2024-09-12T02:01:58.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.354+0000 7fe845398640 1 -- 172.21.15.19:0/2721933341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe82006be30 msgr2=0x7fe82006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:58.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.354+0000 7fe845398640 1 --2- 172.21.15.19:0/2721933341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe82006be30 0x7fe82006e2f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe830034000 tx=0x7fe83002e000 comp rx=0 tx=0).stop 2024-09-12T02:01:58.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.354+0000 7fe845398640 1 -- 172.21.15.19:0/2721933341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe840072700 msgr2=0x7fe8401e69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:58.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.354+0000 7fe845398640 1 --2- 172.21.15.19:0/2721933341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe840072700 0x7fe8401e69e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fe82800d620 tx=0x7fe82800dae0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.354+0000 7fe845398640 1 -- 172.21.15.19:0/2721933341 shutdown_connections 2024-09-12T02:01:58.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.354+0000 7fe845398640 1 --2- 172.21.15.19:0/2721933341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe82006be30 0x7fe82006e2f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.354+0000 7fe845398640 1 --2- 172.21.15.19:0/2721933341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe840072de0 0x7fe8401e6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.354+0000 7fe845398640 1 --2- 172.21.15.19:0/2721933341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe840072700 0x7fe8401e69e0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.354+0000 7fe845398640 1 --2- 172.21.15.19:0/2721933341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe840072320 0x7fe8400a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.354+0000 7fe845398640 1 -- 172.21.15.19:0/2721933341 >> 172.21.15.19:0/2721933341 conn(0x7fe840067d70 msgr2=0x7fe8400ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:58.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.354+0000 7fe845398640 1 -- 172.21.15.19:0/2721933341 shutdown_connections 2024-09-12T02:01:58.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.354+0000 7fe845398640 1 -- 172.21.15.19:0/2721933341 wait complete. 2024-09-12T02:01:58.364 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:01:58.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:01:58.365 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:01:58.394 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:01:58.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:01:58.394 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:01:58.450 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:01:58.450 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T02:01:58.450 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:01:58.469 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:01:58.470 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:01:58.470 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:01:58.470 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:01:58.505 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:01:58.506 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:01:58.506 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T02:01:58.506 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:01:58.527 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:01:58.528 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:58.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.648+0000 7f175b6a6640 1 Processor -- start 2024-09-12T02:01:58.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.649+0000 7f175b6a6640 1 -- start start 2024-09-12T02:01:58.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.649+0000 7f175b6a6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f175415b340 0x7f175409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.649+0000 7f175b6a6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17540b43f0 0x7f17540b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.649+0000 7f175b6a6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17540b3830 con 0x7f17540b4e80 2024-09-12T02:01:58.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.649+0000 7f175b6a6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f17540b5bd0 con 0x7f175415b340 2024-09-12T02:01:58.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.649+0000 7f175b6a6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f17540b5610 con 0x7f17540b43f0 2024-09-12T02:01:58.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.650+0000 7f1759442640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f175415b340 0x7f175409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:58.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.650+0000 7f1758c41640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17540b43f0 0x7f17540b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:58.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.650+0000 7f1758c41640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17540b43f0 0x7f17540b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:57212/0 (socket says 172.21.15.19:57212) 2024-09-12T02:01:58.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.650+0000 7f1759442640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f175415b340 0x7f175409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:40686/0 (socket says 172.21.15.19:40686) 2024-09-12T02:01:58.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.650+0000 7f1759c43640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f17540b4e80 0x7f175415de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:46534/0 (socket says 172.21.15.19:46534) 2024-09-12T02:01:58.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.650+0000 7f1758c41640 1 -- 172.21.15.19:0/2207013259 learned_addr learned my addr 172.21.15.19:0/2207013259 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:58.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.650+0000 7f1759442640 1 -- 172.21.15.19:0/2207013259 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17540b43f0 msgr2=0x7f17540b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:58.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.650+0000 7f1759442640 1 --2- 172.21.15.19:0/2207013259 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17540b43f0 0x7f17540b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.650+0000 7f1759442640 1 -- 172.21.15.19:0/2207013259 >> v1:172.21.15.135:6789/0 conn(0x7f17540b4e80 legacy=0x7f175415de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:58.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.650+0000 7f1759442640 1 -- 172.21.15.19:0/2207013259 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17540b58f0 con 0x7f175415b340 2024-09-12T02:01:58.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.651+0000 7f1759442640 1 --2- 172.21.15.19:0/2207013259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f175415b340 0x7f175409aa30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f174c0097a0 tx=0x7f174c02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4f31711931555f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:58.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.651+0000 7f1753fff640 1 -- 172.21.15.19:0/2207013259 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c037070 con 0x7f175415b340 2024-09-12T02:01:58.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.651+0000 7f1753fff640 1 -- 172.21.15.19:0/2207013259 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174c032440 con 0x7f175415b340 2024-09-12T02:01:58.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.651+0000 7f1753fff640 1 -- 172.21.15.19:0/2207013259 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c032810 con 0x7f175415b340 2024-09-12T02:01:58.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.652+0000 7f175b6a6640 1 -- 172.21.15.19:0/2207013259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f175415b340 msgr2=0x7f175409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:58.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.652+0000 7f175b6a6640 1 --2- 172.21.15.19:0/2207013259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f175415b340 0x7f175409aa30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f174c0097a0 tx=0x7f174c02a210 comp rx=0 tx=0).stop 2024-09-12T02:01:58.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.652+0000 7f175b6a6640 1 -- 172.21.15.19:0/2207013259 shutdown_connections 2024-09-12T02:01:58.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.652+0000 7f175b6a6640 1 --2- 172.21.15.19:0/2207013259 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17540b43f0 0x7f17540b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.652+0000 7f175b6a6640 1 --2- 172.21.15.19:0/2207013259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f175415b340 0x7f175409aa30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.652+0000 7f175b6a6640 1 -- 172.21.15.19:0/2207013259 >> 172.21.15.19:0/2207013259 conn(0x7f1754073490 msgr2=0x7f17540b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:58.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.652+0000 7f175b6a6640 1 -- 172.21.15.19:0/2207013259 shutdown_connections 2024-09-12T02:01:58.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.652+0000 7f175b6a6640 1 -- 172.21.15.19:0/2207013259 wait complete. 2024-09-12T02:01:58.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.653+0000 7f175b6a6640 1 Processor -- start 2024-09-12T02:01:58.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.653+0000 7f175b6a6640 1 -- start start 2024-09-12T02:01:58.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f175b6a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17540b43f0 0x7f175414ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f175b6a6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17540b4e80 0x7f1754157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f175b6a6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f175415b340 0x7f1754157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f175b6a6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f17540b5310 con 0x7f17540b43f0 2024-09-12T02:01:58.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f175b6a6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f175415d8f0 con 0x7f17540b4e80 2024-09-12T02:01:58.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f175b6a6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f175415c730 con 0x7f175415b340 2024-09-12T02:01:58.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f1759442640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17540b43f0 0x7f175414ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:58.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f1759442640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17540b43f0 0x7f175414ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56982/0 (socket says 172.21.15.19:56982) 2024-09-12T02:01:58.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f1759442640 1 -- 172.21.15.19:0/2981972923 learned_addr learned my addr 172.21.15.19:0/2981972923 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:58.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f1758c41640 1 --2- 172.21.15.19:0/2981972923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17540b4e80 0x7f1754157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:58.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f1759c43640 1 --2- 172.21.15.19:0/2981972923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f175415b340 0x7f1754157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:58.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f1759442640 1 -- 172.21.15.19:0/2981972923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f175415b340 msgr2=0x7f1754157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:58.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f1759442640 1 --2- 172.21.15.19:0/2981972923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f175415b340 0x7f1754157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f1759442640 1 -- 172.21.15.19:0/2981972923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17540b4e80 msgr2=0x7f1754157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:58.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f1759442640 1 --2- 172.21.15.19:0/2981972923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17540b4e80 0x7f1754157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f1759442640 1 -- 172.21.15.19:0/2981972923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175414af00 con 0x7f17540b43f0 2024-09-12T02:01:58.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f1759442640 1 --2- 172.21.15.19:0/2981972923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17540b43f0 0x7f175414ee60 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f174c0098c0 tx=0x7f174c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:58.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f1751ffb640 1 -- 172.21.15.19:0/2981972923 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c037040 con 0x7f17540b43f0 2024-09-12T02:01:58.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f1751ffb640 1 -- 172.21.15.19:0/2981972923 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174c030500 con 0x7f17540b43f0 2024-09-12T02:01:58.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f175b6a6640 1 -- 172.21.15.19:0/2981972923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f175414f840 con 0x7f17540b43f0 2024-09-12T02:01:58.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.654+0000 7f1751ffb640 1 -- 172.21.15.19:0/2981972923 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c0308d0 con 0x7f17540b43f0 2024-09-12T02:01:58.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.655+0000 7f175b6a6640 1 -- 172.21.15.19:0/2981972923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f175414fe00 con 0x7f17540b43f0 2024-09-12T02:01:58.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.656+0000 7f175b6a6640 1 -- 172.21.15.19:0/2981972923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1754150040 con 0x7f17540b43f0 2024-09-12T02:01:58.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.656+0000 7f1751ffb640 1 -- 172.21.15.19:0/2981972923 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f174c044020 con 0x7f17540b43f0 2024-09-12T02:01:58.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.657+0000 7f1751ffb640 1 --2- 172.21.15.19:0/2981972923 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f174006be30 0x7f174006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.657+0000 7f1751ffb640 1 -- 172.21.15.19:0/2981972923 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6187+0+0 (secure 0 0 0) 0x7f174c0ab180 con 0x7f17540b43f0 2024-09-12T02:01:58.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.657+0000 7f1758c41640 1 --2- 172.21.15.19:0/2981972923 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f174006be30 0x7f174006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:58.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.657+0000 7f1758c41640 1 --2- 172.21.15.19:0/2981972923 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f174006be30 0x7f174006e2f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f17540d0dd0 tx=0x7f1748009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:58.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.661+0000 7f1751ffb640 1 -- 172.21.15.19:0/2981972923 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f174c0799e0 con 0x7f17540b43f0 2024-09-12T02:01:58.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.873+0000 7f175b6a6640 1 -- 172.21.15.19:0/2981972923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17540cdb30 con 0x7f17540b43f0 2024-09-12T02:01:58.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.874+0000 7f1751ffb640 1 -- 172.21.15.19:0/2981972923 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5230 (secure 0 0 0) 0x7f174c0792e0 con 0x7f17540b43f0 2024-09-12T02:01:58.873 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:58.873 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":69,"btime":"2024-09-12T02:01:55:959025+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1065573429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1065573429},{"type":"v1","addr":"172.21.15.19:6835","nonce":1065573429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3905709264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":3905709264},{"type":"v1","addr":"172.21.15.135:6837","nonce":3905709264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5771,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2548260678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2548260678},{"type":"v1","addr":"172.21.15.135:6836","nonce":2548260678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:01:16.289395+0000","modified":"2024-09-12T02:01:55.959021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6082":{"gid":6082,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":14,"addr":"172.21.15.19:6834/836344045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":836344045},{"type":"v1","addr":"172.21.15.19:6834","nonce":836344045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6082,"qdb_cluster":[6082]},"id":5}]} 2024-09-12T02:01:58.874 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 69 2024-09-12T02:01:58.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.876+0000 7f175b6a6640 1 -- 172.21.15.19:0/2981972923 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f174006be30 msgr2=0x7f174006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:58.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.876+0000 7f175b6a6640 1 --2- 172.21.15.19:0/2981972923 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f174006be30 0x7f174006e2f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f17540d0dd0 tx=0x7f1748009240 comp rx=0 tx=0).stop 2024-09-12T02:01:58.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.876+0000 7f175b6a6640 1 -- 172.21.15.19:0/2981972923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17540b43f0 msgr2=0x7f175414ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:58.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.876+0000 7f175b6a6640 1 --2- 172.21.15.19:0/2981972923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17540b43f0 0x7f175414ee60 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f174c0098c0 tx=0x7f174c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.876+0000 7f175b6a6640 1 -- 172.21.15.19:0/2981972923 shutdown_connections 2024-09-12T02:01:58.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.876+0000 7f175b6a6640 1 --2- 172.21.15.19:0/2981972923 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f174006be30 0x7f174006e2f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.876+0000 7f175b6a6640 1 --2- 172.21.15.19:0/2981972923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f175415b340 0x7f1754157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.876+0000 7f175b6a6640 1 --2- 172.21.15.19:0/2981972923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17540b4e80 0x7f1754157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.876+0000 7f175b6a6640 1 --2- 172.21.15.19:0/2981972923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17540b43f0 0x7f175414ee60 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.876+0000 7f175b6a6640 1 -- 172.21.15.19:0/2981972923 >> 172.21.15.19:0/2981972923 conn(0x7f1754073490 msgr2=0x7f17540d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:58.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.876+0000 7f175b6a6640 1 -- 172.21.15.19:0/2981972923 shutdown_connections 2024-09-12T02:01:58.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.876+0000 7f175b6a6640 1 -- 172.21.15.19:0/2981972923 wait complete. 2024-09-12T02:01:58.887 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:58.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.990+0000 7f9881de4640 1 Processor -- start 2024-09-12T02:01:58.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.990+0000 7f9881de4640 1 -- start start 2024-09-12T02:01:58.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.991+0000 7f9881de4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f987c162060 0x7f987c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.991+0000 7f9881de4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f987c06d9f0 con 0x7f987c0b64b0 2024-09-12T02:01:58.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.991+0000 7f9881de4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f987c06dcd0 con 0x7f987c161c80 2024-09-12T02:01:58.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.991+0000 7f9881de4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f987c06dfb0 con 0x7f987c162060 2024-09-12T02:01:58.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.991+0000 7f987bfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f987c0b64b0 0x7f987c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35032/0 (socket says 172.21.15.19:35032) 2024-09-12T02:01:58.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.991+0000 7f987bfff640 1 -- 172.21.15.19:0/880552069 learned_addr learned my addr 172.21.15.19:0/880552069 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:58.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.991+0000 7f987affd640 1 --2- 172.21.15.19:0/880552069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f987c162060 0x7f987c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:58.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.991+0000 7f987a7fc640 1 -- 172.21.15.19:0/880552069 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3521796397 0 0) 0x7f987c06d9f0 con 0x7f987c0b64b0 2024-09-12T02:01:58.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.991+0000 7f987a7fc640 1 -- 172.21.15.19:0/880552069 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9864003520 con 0x7f987c0b64b0 2024-09-12T02:01:58.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.991+0000 7f987a7fc640 1 -- 172.21.15.19:0/880552069 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243147944 0 0) 0x7f987c06dcd0 con 0x7f987c161c80 2024-09-12T02:01:58.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.991+0000 7f987a7fc640 1 -- 172.21.15.19:0/880552069 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f987c06d9f0 con 0x7f987c161c80 2024-09-12T02:01:58.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987a7fc640 1 -- 172.21.15.19:0/880552069 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1939529455 0 0) 0x7f9864003520 con 0x7f987c0b64b0 2024-09-12T02:01:58.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987a7fc640 1 -- 172.21.15.19:0/880552069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f987c162060 msgr2=0x7f987c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:58.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987a7fc640 1 --2- 172.21.15.19:0/880552069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f987c162060 0x7f987c0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987a7fc640 1 -- 172.21.15.19:0/880552069 >> v1:172.21.15.135:6789/0 conn(0x7f987c161c80 legacy=0x7f987c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:58.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987a7fc640 1 -- 172.21.15.19:0/880552069 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987c0d2890 con 0x7f987c0b64b0 2024-09-12T02:01:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987a7fc640 1 -- 172.21.15.19:0/880552069 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f98740019f0 con 0x7f987c0b64b0 2024-09-12T02:01:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987a7fc640 1 -- 172.21.15.19:0/880552069 >> v1:172.21.15.19:6789/0 conn(0x7f987c0b64b0 legacy=0x7f987c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987a7fc640 1 --2- 172.21.15.19:0/880552069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9864003b70 0x7f9864003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987a7fc640 1 --2- 172.21.15.19:0/880552069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9864004800 0x7f9864004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987a7fc640 1 --2- 172.21.15.19:0/880552069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f987c162060 0x7f98640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987a7fc640 1 -- 172.21.15.19:0/880552069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f987c06dfb0 con 0x7f9864004800 2024-09-12T02:01:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987a7fc640 1 -- 172.21.15.19:0/880552069 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f986400ba70 con 0x7f9864003b70 2024-09-12T02:01:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987a7fc640 1 -- 172.21.15.19:0/880552069 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f986400bc40 con 0x7f987c162060 2024-09-12T02:01:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987affd640 1 --2- 172.21.15.19:0/880552069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9864004800 0x7f9864004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987b7fe640 1 --2- 172.21.15.19:0/880552069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9864003b70 0x7f9864003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987bfff640 1 --2- 172.21.15.19:0/880552069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f987c162060 0x7f98640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987affd640 1 -- 172.21.15.19:0/880552069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f987c162060 msgr2=0x7f98640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987affd640 1 --2- 172.21.15.19:0/880552069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f987c162060 0x7f98640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987affd640 1 -- 172.21.15.19:0/880552069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9864003b70 msgr2=0x7f9864003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987affd640 1 --2- 172.21.15.19:0/880552069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9864003b70 0x7f9864003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.992+0000 7f987affd640 1 -- 172.21.15.19:0/880552069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9864003520 con 0x7f9864004800 2024-09-12T02:01:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.993+0000 7f987affd640 1 --2- 172.21.15.19:0/880552069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9864004800 0x7f9864004c80 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f987c08e830 tx=0x7f9864005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b492d5b6d5d13250 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.993+0000 7f987a7fc640 1 -- 172.21.15.19:0/880552069 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9870036070 con 0x7f9864004800 2024-09-12T02:01:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.993+0000 7f987a7fc640 1 -- 172.21.15.19:0/880552069 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9870031400 con 0x7f9864004800 2024-09-12T02:01:58.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.993+0000 7f987a7fc640 1 -- 172.21.15.19:0/880552069 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9870009690 con 0x7f9864004800 2024-09-12T02:01:58.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.993+0000 7f9881de4640 1 -- 172.21.15.19:0/880552069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9864004800 msgr2=0x7f9864004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:58.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.993+0000 7f9881de4640 1 --2- 172.21.15.19:0/880552069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9864004800 0x7f9864004c80 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f987c08e830 tx=0x7f9864005830 comp rx=0 tx=0).stop 2024-09-12T02:01:58.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.994+0000 7f987bfff640 1 -- 172.21.15.19:0/880552069 reap_dead start 2024-09-12T02:01:58.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.994+0000 7f9881de4640 1 -- 172.21.15.19:0/880552069 shutdown_connections 2024-09-12T02:01:58.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.994+0000 7f9881de4640 1 -- 172.21.15.19:0/880552069 >> 172.21.15.19:0/880552069 conn(0x7f987c0d44f0 msgr2=0x7f987c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:58.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.994+0000 7f9881de4640 1 -- 172.21.15.19:0/880552069 shutdown_connections 2024-09-12T02:01:58.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.994+0000 7f9881de4640 1 -- 172.21.15.19:0/880552069 wait complete. 2024-09-12T02:01:58.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.995+0000 7f9881de4640 1 Processor -- start 2024-09-12T02:01:58.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.995+0000 7f9881de4640 1 -- start start 2024-09-12T02:01:58.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.996+0000 7f9881de4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9864004800 0x7f987c159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.996+0000 7f9881de4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f987c0ce280 0x7f987c15a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.996+0000 7f9881de4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f987c0cc500 0x7f987c0b9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:58.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.996+0000 7f9881de4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f987c0b6300 con 0x7f9864004800 2024-09-12T02:01:58.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.996+0000 7f9881de4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f987c0b6180 con 0x7f987c0ce280 2024-09-12T02:01:58.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.996+0000 7f9881de4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f987c15a760 con 0x7f987c0cc500 2024-09-12T02:01:58.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.996+0000 7f987b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9864004800 0x7f987c159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:58.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.996+0000 7f987b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9864004800 0x7f987c159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57000/0 (socket says 172.21.15.19:57000) 2024-09-12T02:01:58.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.996+0000 7f987b7fe640 1 -- 172.21.15.19:0/2256238255 learned_addr learned my addr 172.21.15.19:0/2256238255 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:58.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.996+0000 7f987affd640 1 --2- 172.21.15.19:0/2256238255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f987c0ce280 0x7f987c15a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:58.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.996+0000 7f987bfff640 1 --2- 172.21.15.19:0/2256238255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f987c0cc500 0x7f987c0b9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.996+0000 7f987b7fe640 1 -- 172.21.15.19:0/2256238255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f987c0cc500 msgr2=0x7f987c0b9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.996+0000 7f987b7fe640 1 --2- 172.21.15.19:0/2256238255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f987c0cc500 0x7f987c0b9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.996+0000 7f987b7fe640 1 -- 172.21.15.19:0/2256238255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f987c0ce280 msgr2=0x7f987c15a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.996+0000 7f987b7fe640 1 --2- 172.21.15.19:0/2256238255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f987c0ce280 0x7f987c15a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.996+0000 7f987b7fe640 1 -- 172.21.15.19:0/2256238255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987c0c9360 con 0x7f9864004800 2024-09-12T02:01:59.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.996+0000 7f987b7fe640 1 --2- 172.21.15.19:0/2256238255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9864004800 0x7f987c159590 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f986c00f7d0 tx=0x7f986c00fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:59.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.997+0000 7f9863fff640 1 -- 172.21.15.19:0/2256238255 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c00fe80 con 0x7f9864004800 2024-09-12T02:01:59.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.997+0000 7f9863fff640 1 -- 172.21.15.19:0/2256238255 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f986c018070 con 0x7f9864004800 2024-09-12T02:01:59.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.997+0000 7f9881de4640 1 -- 172.21.15.19:0/2256238255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f987c0c9640 con 0x7f9864004800 2024-09-12T02:01:59.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.997+0000 7f9863fff640 1 -- 172.21.15.19:0/2256238255 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c00d730 con 0x7f9864004800 2024-09-12T02:01:59.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.997+0000 7f9881de4640 1 -- 172.21.15.19:0/2256238255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f987c0c9c00 con 0x7f9864004800 2024-09-12T02:01:59.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.998+0000 7f9881de4640 1 -- 172.21.15.19:0/2256238255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f987c0b6960 con 0x7f9864004800 2024-09-12T02:01:59.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.998+0000 7f9863fff640 1 -- 172.21.15.19:0/2256238255 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f986c00d8d0 con 0x7f9864004800 2024-09-12T02:01:59.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.999+0000 7f9863fff640 1 --2- 172.21.15.19:0/2256238255 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f986806be60 0x7f986806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.999+0000 7f9863fff640 1 -- 172.21.15.19:0/2256238255 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6187+0+0 (secure 0 0 0) 0x7f986c08ae80 con 0x7f9864004800 2024-09-12T02:01:59.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.999+0000 7f987affd640 1 --2- 172.21.15.19:0/2256238255 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f986806be60 0x7f986806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:58.999+0000 7f987affd640 1 --2- 172.21.15.19:0/2256238255 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f986806be60 0x7f986806e320 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9870033000 tx=0x7f9870008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:59.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.003+0000 7f9863fff640 1 -- 172.21.15.19:0/2256238255 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f986c059000 con 0x7f9864004800 2024-09-12T02:01:59.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.214+0000 7f9881de4640 1 -- 172.21.15.19:0/2256238255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f987c0ba470 con 0x7f9864004800 2024-09-12T02:01:59.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.215+0000 7f9863fff640 1 -- 172.21.15.19:0/2256238255 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5230 (secure 0 0 0) 0x7f986c05d300 con 0x7f9864004800 2024-09-12T02:01:59.215 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:59.215 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":69,"btime":"2024-09-12T02:01:55:959025+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1065573429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1065573429},{"type":"v1","addr":"172.21.15.19:6835","nonce":1065573429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3905709264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":3905709264},{"type":"v1","addr":"172.21.15.135:6837","nonce":3905709264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5771,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2548260678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2548260678},{"type":"v1","addr":"172.21.15.135:6836","nonce":2548260678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:01:16.289395+0000","modified":"2024-09-12T02:01:55.959021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6082":{"gid":6082,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":14,"addr":"172.21.15.19:6834/836344045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":836344045},{"type":"v1","addr":"172.21.15.19:6834","nonce":836344045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6082,"qdb_cluster":[6082]},"id":5}]} 2024-09-12T02:01:59.215 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 69 2024-09-12T02:01:59.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.217+0000 7f9881de4640 1 -- 172.21.15.19:0/2256238255 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f986806be60 msgr2=0x7f986806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.217+0000 7f9881de4640 1 --2- 172.21.15.19:0/2256238255 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f986806be60 0x7f986806e320 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9870033000 tx=0x7f9870008030 comp rx=0 tx=0).stop 2024-09-12T02:01:59.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.217+0000 7f9881de4640 1 -- 172.21.15.19:0/2256238255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9864004800 msgr2=0x7f987c159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.217+0000 7f9881de4640 1 --2- 172.21.15.19:0/2256238255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9864004800 0x7f987c159590 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f986c00f7d0 tx=0x7f986c00fc90 comp rx=0 tx=0).stop 2024-09-12T02:01:59.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.217+0000 7f9881de4640 1 -- 172.21.15.19:0/2256238255 shutdown_connections 2024-09-12T02:01:59.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.217+0000 7f9881de4640 1 --2- 172.21.15.19:0/2256238255 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f986806be60 0x7f986806e320 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.217+0000 7f9881de4640 1 --2- 172.21.15.19:0/2256238255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f987c0cc500 0x7f987c0b9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.217+0000 7f9881de4640 1 --2- 172.21.15.19:0/2256238255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f987c0ce280 0x7f987c15a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.217+0000 7f9881de4640 1 --2- 172.21.15.19:0/2256238255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9864004800 0x7f987c159590 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.217+0000 7f9881de4640 1 -- 172.21.15.19:0/2256238255 >> 172.21.15.19:0/2256238255 conn(0x7f987c0d44f0 msgr2=0x7f987c0b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:59.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.217+0000 7f9881de4640 1 -- 172.21.15.19:0/2256238255 shutdown_connections 2024-09-12T02:01:59.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.217+0000 7f9881de4640 1 -- 172.21.15.19:0/2256238255 wait complete. 2024-09-12T02:01:59.227 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:01:59.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.330+0000 7fb54ad9f640 1 Processor -- start 2024-09-12T02:01:59.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.330+0000 7fb54ad9f640 1 -- start start 2024-09-12T02:01:59.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.330+0000 7fb54ad9f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb5440d4180 0x7fb5440d4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.331+0000 7fb54ad9f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb54415e6a0 0x7fb54406d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.331+0000 7fb54ad9f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5440d4aa0 con 0x7fb54406dd60 2024-09-12T02:01:59.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.331+0000 7fb54ad9f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb54406e170 con 0x7fb54415e6a0 2024-09-12T02:01:59.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.331+0000 7fb54ad9f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb5440cefb0 con 0x7fb5440d4180 2024-09-12T02:01:59.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.331+0000 7fb54959c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb54415e6a0 0x7fb54406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.331+0000 7fb54959c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb54415e6a0 0x7fb54406d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57008/0 (socket says 172.21.15.19:57008) 2024-09-12T02:01:59.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.331+0000 7fb54959c640 1 -- 172.21.15.19:0/586953496 learned_addr learned my addr 172.21.15.19:0/586953496 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:59.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.331+0000 7fb549d9d640 1 --2- 172.21.15.19:0/586953496 >> v2:172.21.15.135:3300/0 conn(0x7fb5440d4180 0x7fb5440d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.331+0000 7fb54959c640 1 -- 172.21.15.19:0/586953496 >> v2:172.21.15.135:3300/0 conn(0x7fb5440d4180 msgr2=0x7fb5440d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:59.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.331+0000 7fb54959c640 1 --2- 172.21.15.19:0/586953496 >> v2:172.21.15.135:3300/0 conn(0x7fb5440d4180 0x7fb5440d4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.331+0000 7fb54959c640 1 -- 172.21.15.19:0/586953496 >> v1:172.21.15.135:6789/0 conn(0x7fb54406dd60 legacy=0x7fb5440d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:59.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.331+0000 7fb54959c640 1 -- 172.21.15.19:0/586953496 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5440d2c20 con 0x7fb54415e6a0 2024-09-12T02:01:59.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.331+0000 7fb549d9d640 1 --2- 172.21.15.19:0/586953496 >> v2:172.21.15.135:3300/0 conn(0x7fb5440d4180 0x7fb5440d4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:59.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.332+0000 7fb54959c640 1 --2- 172.21.15.19:0/586953496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb54415e6a0 0x7fb54406d820 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb5440b6ea0 tx=0x7fb53402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864c12303f4e272c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:59.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.332+0000 7fb548d9b640 1 -- 172.21.15.19:0/586953496 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb534037070 con 0x7fb54415e6a0 2024-09-12T02:01:59.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.332+0000 7fb548d9b640 1 -- 172.21.15.19:0/586953496 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb534032440 con 0x7fb54415e6a0 2024-09-12T02:01:59.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.332+0000 7fb548d9b640 1 -- 172.21.15.19:0/586953496 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb534032810 con 0x7fb54415e6a0 2024-09-12T02:01:59.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.332+0000 7fb54ad9f640 1 -- 172.21.15.19:0/586953496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb54415e6a0 msgr2=0x7fb54406d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.332+0000 7fb54ad9f640 1 --2- 172.21.15.19:0/586953496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb54415e6a0 0x7fb54406d820 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb5440b6ea0 tx=0x7fb53402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.333+0000 7fb54ad9f640 1 -- 172.21.15.19:0/586953496 shutdown_connections 2024-09-12T02:01:59.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.333+0000 7fb54ad9f640 1 --2- 172.21.15.19:0/586953496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb54415e6a0 0x7fb54406d820 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.333+0000 7fb54ad9f640 1 --2- 172.21.15.19:0/586953496 >> v2:172.21.15.135:3300/0 conn(0x7fb5440d4180 0x7fb5440d4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.333+0000 7fb54ad9f640 1 -- 172.21.15.19:0/586953496 >> 172.21.15.19:0/586953496 conn(0x7fb54409d6f0 msgr2=0x7fb54408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:59.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.333+0000 7fb54ad9f640 1 -- 172.21.15.19:0/586953496 shutdown_connections 2024-09-12T02:01:59.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.333+0000 7fb54ad9f640 1 -- 172.21.15.19:0/586953496 wait complete. 2024-09-12T02:01:59.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.334+0000 7fb54ad9f640 1 Processor -- start 2024-09-12T02:01:59.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.334+0000 7fb54ad9f640 1 -- start start 2024-09-12T02:01:59.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.334+0000 7fb54ad9f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb54406dd60 0x7fb544157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.334+0000 7fb54ad9f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5440d4180 0x7fb544159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.334+0000 7fb54ad9f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb54415e6a0 0x7fb5440b8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.334+0000 7fb54ad9f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb54406e950 con 0x7fb54415e6a0 2024-09-12T02:01:59.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.334+0000 7fb54ad9f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb54406e670 con 0x7fb54406dd60 2024-09-12T02:01:59.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.334+0000 7fb54ad9f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb5440cebd0 con 0x7fb5440d4180 2024-09-12T02:01:59.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.335+0000 7fb54a59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb54415e6a0 0x7fb5440b8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.335+0000 7fb54a59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb54415e6a0 0x7fb5440b8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57010/0 (socket says 172.21.15.19:57010) 2024-09-12T02:01:59.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.335+0000 7fb54a59e640 1 -- 172.21.15.19:0/4085647622 learned_addr learned my addr 172.21.15.19:0/4085647622 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:59.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.335+0000 7fb54959c640 1 --2- 172.21.15.19:0/4085647622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5440d4180 0x7fb544159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.335+0000 7fb549d9d640 1 --2- 172.21.15.19:0/4085647622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb54406dd60 0x7fb544157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.335+0000 7fb54a59e640 1 -- 172.21.15.19:0/4085647622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5440d4180 msgr2=0x7fb544159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.335+0000 7fb54a59e640 1 --2- 172.21.15.19:0/4085647622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5440d4180 0x7fb544159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.335+0000 7fb54a59e640 1 -- 172.21.15.19:0/4085647622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb54406dd60 msgr2=0x7fb544157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.335+0000 7fb54a59e640 1 --2- 172.21.15.19:0/4085647622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb54406dd60 0x7fb544157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.335+0000 7fb54a59e640 1 -- 172.21.15.19:0/4085647622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5440cca80 con 0x7fb54415e6a0 2024-09-12T02:01:59.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.335+0000 7fb549d9d640 1 --2- 172.21.15.19:0/4085647622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb54406dd60 0x7fb544157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:59.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.335+0000 7fb54a59e640 1 --2- 172.21.15.19:0/4085647622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb54415e6a0 0x7fb5440b8d00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb53c00b9a0 tx=0x7fb53c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:59.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.335+0000 7fb53a7fc640 1 -- 172.21.15.19:0/4085647622 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c019070 con 0x7fb54415e6a0 2024-09-12T02:01:59.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.335+0000 7fb53a7fc640 1 -- 172.21.15.19:0/4085647622 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb53c00cba0 con 0x7fb54415e6a0 2024-09-12T02:01:59.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.335+0000 7fb53a7fc640 1 -- 172.21.15.19:0/4085647622 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c014440 con 0x7fb54415e6a0 2024-09-12T02:01:59.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.335+0000 7fb54ad9f640 1 -- 172.21.15.19:0/4085647622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5440ce430 con 0x7fb54415e6a0 2024-09-12T02:01:59.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.335+0000 7fb54ad9f640 1 -- 172.21.15.19:0/4085647622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5440cbfa0 con 0x7fb54415e6a0 2024-09-12T02:01:59.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.336+0000 7fb54ad9f640 1 -- 172.21.15.19:0/4085647622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5440d4560 con 0x7fb54415e6a0 2024-09-12T02:01:59.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.337+0000 7fb53a7fc640 1 -- 172.21.15.19:0/4085647622 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb53c01c070 con 0x7fb54415e6a0 2024-09-12T02:01:59.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.337+0000 7fb53a7fc640 1 --2- 172.21.15.19:0/4085647622 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb52806be60 0x7fb52806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.337+0000 7fb53a7fc640 1 -- 172.21.15.19:0/4085647622 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6187+0+0 (secure 0 0 0) 0x7fb53c08ab60 con 0x7fb54415e6a0 2024-09-12T02:01:59.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.337+0000 7fb549d9d640 1 --2- 172.21.15.19:0/4085647622 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb52806be60 0x7fb52806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.338+0000 7fb549d9d640 1 --2- 172.21.15.19:0/4085647622 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb52806be60 0x7fb52806e320 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb54000a990 tx=0x7fb540008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:59.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.342+0000 7fb53a7fc640 1 -- 172.21.15.19:0/4085647622 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb53c058ce0 con 0x7fb54415e6a0 2024-09-12T02:01:59.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.518+0000 7fb54ad9f640 1 -- 172.21.15.19:0/4085647622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb544158190 con 0x7fb54415e6a0 2024-09-12T02:01:59.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.519+0000 7fb53a7fc640 1 -- 172.21.15.19:0/4085647622 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+17124 (secure 0 0 0) 0x7fb53c05cfe0 con 0x7fb54415e6a0 2024-09-12T02:01:59.519 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:59.519 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":82,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:01:52.946945+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:01:13.953490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-12T02:01:15.281758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6836/1796121402":"2024-09-13T02:01:52.946892+0000","172.21.15.135:6834/1796121402":"2024-09-13T02:01:52.946892+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:01:59.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.521+0000 7fb54ad9f640 1 -- 172.21.15.19:0/4085647622 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb52806be60 msgr2=0x7fb52806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.521+0000 7fb54ad9f640 1 --2- 172.21.15.19:0/4085647622 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb52806be60 0x7fb52806e320 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb54000a990 tx=0x7fb540008040 comp rx=0 tx=0).stop 2024-09-12T02:01:59.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.521+0000 7fb54ad9f640 1 -- 172.21.15.19:0/4085647622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb54415e6a0 msgr2=0x7fb5440b8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.521+0000 7fb54ad9f640 1 --2- 172.21.15.19:0/4085647622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb54415e6a0 0x7fb5440b8d00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb53c00b9a0 tx=0x7fb53c00be60 comp rx=0 tx=0).stop 2024-09-12T02:01:59.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.521+0000 7fb54ad9f640 1 -- 172.21.15.19:0/4085647622 shutdown_connections 2024-09-12T02:01:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.521+0000 7fb54ad9f640 1 --2- 172.21.15.19:0/4085647622 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb52806be60 0x7fb52806e320 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.521+0000 7fb54ad9f640 1 --2- 172.21.15.19:0/4085647622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb54415e6a0 0x7fb5440b8d00 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.521+0000 7fb54ad9f640 1 --2- 172.21.15.19:0/4085647622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5440d4180 0x7fb544159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.521+0000 7fb54ad9f640 1 --2- 172.21.15.19:0/4085647622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb54406dd60 0x7fb544157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.521+0000 7fb54ad9f640 1 -- 172.21.15.19:0/4085647622 >> 172.21.15.19:0/4085647622 conn(0x7fb54409d6f0 msgr2=0x7fb5440d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.522+0000 7fb54ad9f640 1 -- 172.21.15.19:0/4085647622 shutdown_connections 2024-09-12T02:01:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.522+0000 7fb54ad9f640 1 -- 172.21.15.19:0/4085647622 wait complete. 2024-09-12T02:01:59.532 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:01:59.532 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:59.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-12T02:01:59.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.635+0000 7f494220e640 1 Processor -- start 2024-09-12T02:01:59.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.635+0000 7f494220e640 1 -- start start 2024-09-12T02:01:59.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.635+0000 7f494220e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f493c161c80 0x7f493c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.635+0000 7f494220e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f493c162060 0x7f493c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.635+0000 7f494220e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f493c06e870 con 0x7f493c0b64b0 2024-09-12T02:01:59.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.635+0000 7f494220e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f493c06d9f0 con 0x7f493c162060 2024-09-12T02:01:59.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.635+0000 7f494220e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f493c06dcd0 con 0x7f493c161c80 2024-09-12T02:01:59.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.636+0000 7f493b7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f493c161c80 0x7f493c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.636+0000 7f493affd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f493c162060 0x7f493c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.636+0000 7f493affd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f493c162060 0x7f493c0b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:40748/0 (socket says 172.21.15.19:40748) 2024-09-12T02:01:59.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.636+0000 7f493bfff640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f493c0b64b0 0x7f493c162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:46550/0 (socket says 172.21.15.19:46550) 2024-09-12T02:01:59.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.636+0000 7f493affd640 1 -- 172.21.15.19:0/3324038186 learned_addr learned my addr 172.21.15.19:0/3324038186 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:59.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.636+0000 7f493affd640 1 -- 172.21.15.19:0/3324038186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f493c161c80 msgr2=0x7f493c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:59.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.636+0000 7f493affd640 1 --2- 172.21.15.19:0/3324038186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f493c161c80 0x7f493c06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.636+0000 7f493affd640 1 -- 172.21.15.19:0/3324038186 >> v1:172.21.15.135:6789/0 conn(0x7f493c0b64b0 legacy=0x7f493c162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.636+0000 7f493a7fc640 1 -- 172.21.15.19:0/3324038186 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2751173970 0 0) 0x7f4934001490 con 0x7f493c0b64b0 2024-09-12T02:01:59.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.636+0000 7f493affd640 1 -- 172.21.15.19:0/3324038186 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493c06dfb0 con 0x7f493c162060 2024-09-12T02:01:59.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.636+0000 7f493b7fe640 1 --2- 172.21.15.19:0/3324038186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f493c161c80 0x7f493c06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:59.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.637+0000 7f493affd640 1 --2- 172.21.15.19:0/3324038186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c162060 0x7f493c0b5f70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4924009870 tx=0x7f492402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f2d8096cbf4d248 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:59.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.637+0000 7f493a7fc640 1 -- 172.21.15.19:0/3324038186 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4924037070 con 0x7f493c162060 2024-09-12T02:01:59.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.637+0000 7f493a7fc640 1 -- 172.21.15.19:0/3324038186 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4924032440 con 0x7f493c162060 2024-09-12T02:01:59.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.637+0000 7f493a7fc640 1 -- 172.21.15.19:0/3324038186 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4924032810 con 0x7f493c162060 2024-09-12T02:01:59.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.638+0000 7f494220e640 1 -- 172.21.15.19:0/3324038186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c162060 msgr2=0x7f493c0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.638+0000 7f494220e640 1 --2- 172.21.15.19:0/3324038186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c162060 0x7f493c0b5f70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4924009870 tx=0x7f492402a270 comp rx=0 tx=0).stop 2024-09-12T02:01:59.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.638+0000 7f494220e640 1 -- 172.21.15.19:0/3324038186 shutdown_connections 2024-09-12T02:01:59.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.638+0000 7f494220e640 1 --2- 172.21.15.19:0/3324038186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c162060 0x7f493c0b5f70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.638+0000 7f494220e640 1 --2- 172.21.15.19:0/3324038186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f493c161c80 0x7f493c06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.638+0000 7f494220e640 1 -- 172.21.15.19:0/3324038186 >> 172.21.15.19:0/3324038186 conn(0x7f493c0d44f0 msgr2=0x7f493c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:59.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.638+0000 7f494220e640 1 -- 172.21.15.19:0/3324038186 shutdown_connections 2024-09-12T02:01:59.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.638+0000 7f494220e640 1 -- 172.21.15.19:0/3324038186 wait complete. 2024-09-12T02:01:59.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.639+0000 7f494220e640 1 Processor -- start 2024-09-12T02:01:59.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.639+0000 7f494220e640 1 -- start start 2024-09-12T02:01:59.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.640+0000 7f494220e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f493c0b64b0 0x7f493c15ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.640+0000 7f494220e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f493c161c80 0x7f493c15c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.640+0000 7f494220e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c162060 0x7f493c15ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.640+0000 7f494220e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f493c0d2a10 con 0x7f493c0b64b0 2024-09-12T02:01:59.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.640+0000 7f494220e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f493c0d2890 con 0x7f493c162060 2024-09-12T02:01:59.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.640+0000 7f494220e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f493c0b6960 con 0x7f493c161c80 2024-09-12T02:01:59.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.640+0000 7f493b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f493c0b64b0 0x7f493c15ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.640+0000 7f493b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f493c0b64b0 0x7f493c15ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57026/0 (socket says 172.21.15.19:57026) 2024-09-12T02:01:59.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.640+0000 7f493b7fe640 1 -- 172.21.15.19:0/3218439114 learned_addr learned my addr 172.21.15.19:0/3218439114 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:59.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.640+0000 7f493affd640 1 --2- 172.21.15.19:0/3218439114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f493c161c80 0x7f493c15c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.640+0000 7f493bfff640 1 --2- 172.21.15.19:0/3218439114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c162060 0x7f493c15ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.640+0000 7f493b7fe640 1 -- 172.21.15.19:0/3218439114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f493c161c80 msgr2=0x7f493c15c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.640+0000 7f493b7fe640 1 --2- 172.21.15.19:0/3218439114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f493c161c80 0x7f493c15c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.641+0000 7f493b7fe640 1 -- 172.21.15.19:0/3218439114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c162060 msgr2=0x7f493c15ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.641+0000 7f493b7fe640 1 --2- 172.21.15.19:0/3218439114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c162060 0x7f493c15ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.641+0000 7f493b7fe640 1 -- 172.21.15.19:0/3218439114 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493c0c9f60 con 0x7f493c0b64b0 2024-09-12T02:01:59.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.641+0000 7f493b7fe640 1 --2- 172.21.15.19:0/3218439114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f493c0b64b0 0x7f493c15ac60 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f492c00ebe0 tx=0x7f492c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:59.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.641+0000 7f4933fff640 1 -- 172.21.15.19:0/3218439114 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c017070 con 0x7f493c0b64b0 2024-09-12T02:01:59.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.641+0000 7f4933fff640 1 -- 172.21.15.19:0/3218439114 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492c00cc30 con 0x7f493c0b64b0 2024-09-12T02:01:59.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.641+0000 7f494220e640 1 -- 172.21.15.19:0/3218439114 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f493c0ca240 con 0x7f493c0b64b0 2024-09-12T02:01:59.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.641+0000 7f4933fff640 1 -- 172.21.15.19:0/3218439114 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c013470 con 0x7f493c0b64b0 2024-09-12T02:01:59.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.641+0000 7f494220e640 1 -- 172.21.15.19:0/3218439114 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f493c0b8920 con 0x7f493c0b64b0 2024-09-12T02:01:59.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.642+0000 7f494220e640 1 -- 172.21.15.19:0/3218439114 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f493c0ba470 con 0x7f493c0b64b0 2024-09-12T02:01:59.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.643+0000 7f4933fff640 1 -- 172.21.15.19:0/3218439114 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f492c01a070 con 0x7f493c0b64b0 2024-09-12T02:01:59.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.643+0000 7f4933fff640 1 --2- 172.21.15.19:0/3218439114 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f491c06be30 0x7f491c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.643+0000 7f4933fff640 1 -- 172.21.15.19:0/3218439114 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6187+0+0 (secure 0 0 0) 0x7f492c08b220 con 0x7f493c0b64b0 2024-09-12T02:01:59.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.643+0000 7f493affd640 1 --2- 172.21.15.19:0/3218439114 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f491c06be30 0x7f491c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.644+0000 7f493affd640 1 --2- 172.21.15.19:0/3218439114 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f491c06be30 0x7f491c06e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4924034000 tx=0x7f492402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:59.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.647+0000 7f4933fff640 1 -- 172.21.15.19:0/3218439114 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f492c059430 con 0x7f493c0b64b0 2024-09-12T02:01:59.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.860+0000 7f494220e640 1 -- 172.21.15.19:0/3218439114 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f493c0d37b0 con 0x7f493c0b64b0 2024-09-12T02:01:59.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.860+0000 7f4933fff640 1 -- 172.21.15.19:0/3218439114 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5230 (secure 0 0 0) 0x7f492c05d730 con 0x7f493c0b64b0 2024-09-12T02:01:59.860 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:01:59.860 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":69,"btime":"2024-09-12T02:01:55:959025+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1065573429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1065573429},{"type":"v1","addr":"172.21.15.19:6835","nonce":1065573429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3905709264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":3905709264},{"type":"v1","addr":"172.21.15.135:6837","nonce":3905709264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5771,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2548260678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2548260678},{"type":"v1","addr":"172.21.15.135:6836","nonce":2548260678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:01:16.289395+0000","modified":"2024-09-12T02:01:55.959021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6082":{"gid":6082,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":14,"addr":"172.21.15.19:6834/836344045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":836344045},{"type":"v1","addr":"172.21.15.19:6834","nonce":836344045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6082,"qdb_cluster":[6082]},"id":5}]} 2024-09-12T02:01:59.860 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 69 2024-09-12T02:01:59.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.862+0000 7f494220e640 1 -- 172.21.15.19:0/3218439114 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f491c06be30 msgr2=0x7f491c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.862+0000 7f494220e640 1 --2- 172.21.15.19:0/3218439114 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f491c06be30 0x7f491c06e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4924034000 tx=0x7f492402e000 comp rx=0 tx=0).stop 2024-09-12T02:01:59.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.862+0000 7f494220e640 1 -- 172.21.15.19:0/3218439114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f493c0b64b0 msgr2=0x7f493c15ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.862+0000 7f494220e640 1 --2- 172.21.15.19:0/3218439114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f493c0b64b0 0x7f493c15ac60 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f492c00ebe0 tx=0x7f492c00c520 comp rx=0 tx=0).stop 2024-09-12T02:01:59.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.862+0000 7f494220e640 1 -- 172.21.15.19:0/3218439114 shutdown_connections 2024-09-12T02:01:59.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.862+0000 7f494220e640 1 --2- 172.21.15.19:0/3218439114 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f491c06be30 0x7f491c06e2f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.862+0000 7f494220e640 1 --2- 172.21.15.19:0/3218439114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c162060 0x7f493c15ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.862+0000 7f494220e640 1 --2- 172.21.15.19:0/3218439114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f493c161c80 0x7f493c15c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.862+0000 7f494220e640 1 --2- 172.21.15.19:0/3218439114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f493c0b64b0 0x7f493c15ac60 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.862+0000 7f494220e640 1 -- 172.21.15.19:0/3218439114 >> 172.21.15.19:0/3218439114 conn(0x7f493c0d44f0 msgr2=0x7f493c0d3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:59.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.862+0000 7f494220e640 1 -- 172.21.15.19:0/3218439114 shutdown_connections 2024-09-12T02:01:59.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.862+0000 7f494220e640 1 -- 172.21.15.19:0/3218439114 wait complete. 2024-09-12T02:01:59.873 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:01:59.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.975+0000 7fa635531640 1 Processor -- start 2024-09-12T02:01:59.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.975+0000 7fa635531640 1 -- start start 2024-09-12T02:01:59.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.976+0000 7fa635531640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa63006cd20 0x7fa6300b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.976+0000 7fa635531640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6300b2790 con 0x7fa6300b3760 2024-09-12T02:01:59.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.976+0000 7fa635531640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6300b2a70 con 0x7fa63009aa30 2024-09-12T02:01:59.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.976+0000 7fa635531640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa6300d0670 con 0x7fa63006cd20 2024-09-12T02:01:59.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.976+0000 7fa62e7fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa6300b3760 0x7fa630162340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35042/0 (socket says 172.21.15.19:35042) 2024-09-12T02:01:59.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.976+0000 7fa62e7fc640 1 -- 172.21.15.19:0/3471304166 learned_addr learned my addr 172.21.15.19:0/3471304166 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:01:59.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62f7fe640 1 --2- 172.21.15.19:0/3471304166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa63006cd20 0x7fa6300b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62dffb640 1 -- 172.21.15.19:0/3471304166 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 386674062 0 0) 0x7fa6300b2790 con 0x7fa6300b3760 2024-09-12T02:01:59.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62dffb640 1 -- 172.21.15.19:0/3471304166 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa61c003520 con 0x7fa6300b3760 2024-09-12T02:01:59.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62dffb640 1 -- 172.21.15.19:0/3471304166 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3007080310 0 0) 0x7fa6300b2a70 con 0x7fa63009aa30 2024-09-12T02:01:59.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62dffb640 1 -- 172.21.15.19:0/3471304166 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6300b2790 con 0x7fa63009aa30 2024-09-12T02:01:59.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62dffb640 1 -- 172.21.15.19:0/3471304166 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3161570701 0 0) 0x7fa61c003520 con 0x7fa6300b3760 2024-09-12T02:01:59.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62dffb640 1 -- 172.21.15.19:0/3471304166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa63006cd20 msgr2=0x7fa6300b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:59.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62dffb640 1 --2- 172.21.15.19:0/3471304166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa63006cd20 0x7fa6300b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62dffb640 1 -- 172.21.15.19:0/3471304166 >> v1:172.21.15.135:6789/0 conn(0x7fa63009aa30 legacy=0x7fa63009ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62dffb640 1 -- 172.21.15.19:0/3471304166 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6300b2d50 con 0x7fa6300b3760 2024-09-12T02:01:59.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62dffb640 1 -- 172.21.15.19:0/3471304166 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fa618001670 con 0x7fa6300b3760 2024-09-12T02:01:59.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62dffb640 1 -- 172.21.15.19:0/3471304166 >> v1:172.21.15.19:6789/0 conn(0x7fa6300b3760 legacy=0x7fa630162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62dffb640 1 --2- 172.21.15.19:0/3471304166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa61c003b70 0x7fa61c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62dffb640 1 --2- 172.21.15.19:0/3471304166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa63006cd20 0x7fa61c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62dffb640 1 --2- 172.21.15.19:0/3471304166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa61c004d40 0x7fa61c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62dffb640 1 -- 172.21.15.19:0/3471304166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa61c00ba90 con 0x7fa61c004d40 2024-09-12T02:01:59.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62dffb640 1 -- 172.21.15.19:0/3471304166 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa61c00bc40 con 0x7fa61c003b70 2024-09-12T02:01:59.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62dffb640 1 -- 172.21.15.19:0/3471304166 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa61c00be40 con 0x7fa63006cd20 2024-09-12T02:01:59.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62f7fe640 1 --2- 172.21.15.19:0/3471304166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa61c004d40 0x7fa61c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62effd640 1 --2- 172.21.15.19:0/3471304166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa61c003b70 0x7fa61c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62e7fc640 1 --2- 172.21.15.19:0/3471304166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa63006cd20 0x7fa61c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62f7fe640 1 -- 172.21.15.19:0/3471304166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa63006cd20 msgr2=0x7fa61c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:59.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62f7fe640 1 --2- 172.21.15.19:0/3471304166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa63006cd20 0x7fa61c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62f7fe640 1 -- 172.21.15.19:0/3471304166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa61c003b70 msgr2=0x7fa61c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:59.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62f7fe640 1 --2- 172.21.15.19:0/3471304166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa61c003b70 0x7fa61c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62f7fe640 1 -- 172.21.15.19:0/3471304166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa61c003520 con 0x7fa61c004d40 2024-09-12T02:01:59.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.977+0000 7fa62e7fc640 1 --2- 172.21.15.19:0/3471304166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa63006cd20 0x7fa61c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:59.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.978+0000 7fa62f7fe640 1 --2- 172.21.15.19:0/3471304166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa61c004d40 0x7fa61c0051c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa628009ac0 tx=0x7fa61c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c28308a7475a88a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:59.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.978+0000 7fa62dffb640 1 -- 172.21.15.19:0/3471304166 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa628036070 con 0x7fa61c004d40 2024-09-12T02:01:59.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.978+0000 7fa62dffb640 1 -- 172.21.15.19:0/3471304166 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa628031400 con 0x7fa61c004d40 2024-09-12T02:01:59.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.978+0000 7fa62dffb640 1 -- 172.21.15.19:0/3471304166 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa628009690 con 0x7fa61c004d40 2024-09-12T02:01:59.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.979+0000 7fa635531640 1 -- 172.21.15.19:0/3471304166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa61c004d40 msgr2=0x7fa61c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.979+0000 7fa635531640 1 --2- 172.21.15.19:0/3471304166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa61c004d40 0x7fa61c0051c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa628009ac0 tx=0x7fa61c005830 comp rx=0 tx=0).stop 2024-09-12T02:01:59.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.979+0000 7fa62f7fe640 1 -- 172.21.15.19:0/3471304166 reap_dead start 2024-09-12T02:01:59.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.979+0000 7fa635531640 1 -- 172.21.15.19:0/3471304166 shutdown_connections 2024-09-12T02:01:59.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.979+0000 7fa635531640 1 -- 172.21.15.19:0/3471304166 >> 172.21.15.19:0/3471304166 conn(0x7fa6300d23a0 msgr2=0x7fa6300d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:59.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.979+0000 7fa635531640 1 -- 172.21.15.19:0/3471304166 shutdown_connections 2024-09-12T02:01:59.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.979+0000 7fa635531640 1 -- 172.21.15.19:0/3471304166 wait complete. 2024-09-12T02:01:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.980+0000 7fa635531640 1 Processor -- start 2024-09-12T02:01:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.980+0000 7fa635531640 1 -- start start 2024-09-12T02:01:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.981+0000 7fa635531640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa61c004d40 0x7fa63015e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.981+0000 7fa635531640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa63015af20 0x7fa63015bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.981+0000 7fa635531640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6300b7af0 0x7fa630162200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.981+0000 7fa635531640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa63015fe20 con 0x7fa61c004d40 2024-09-12T02:01:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.981+0000 7fa635531640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa63015fca0 con 0x7fa6300b7af0 2024-09-12T02:01:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.981+0000 7fa635531640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa6300d1fe0 con 0x7fa63015af20 2024-09-12T02:01:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.981+0000 7fa62effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa61c004d40 0x7fa63015e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.981+0000 7fa62effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa61c004d40 0x7fa63015e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57038/0 (socket says 172.21.15.19:57038) 2024-09-12T02:01:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.981+0000 7fa62effd640 1 -- 172.21.15.19:0/973478557 learned_addr learned my addr 172.21.15.19:0/973478557 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:01:59.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.981+0000 7fa62e7fc640 1 --2- 172.21.15.19:0/973478557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa63015af20 0x7fa63015bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.981+0000 7fa62f7fe640 1 --2- 172.21.15.19:0/973478557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6300b7af0 0x7fa630162200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.981+0000 7fa62effd640 1 -- 172.21.15.19:0/973478557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa63015af20 msgr2=0x7fa63015bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.981+0000 7fa62effd640 1 --2- 172.21.15.19:0/973478557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa63015af20 0x7fa63015bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.981+0000 7fa62effd640 1 -- 172.21.15.19:0/973478557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6300b7af0 msgr2=0x7fa630162200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:59.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.981+0000 7fa62effd640 1 --2- 172.21.15.19:0/973478557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6300b7af0 0x7fa630162200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:59.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.981+0000 7fa62effd640 1 -- 172.21.15.19:0/973478557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa63015c710 con 0x7fa61c004d40 2024-09-12T02:01:59.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.981+0000 7fa62f7fe640 1 --2- 172.21.15.19:0/973478557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6300b7af0 0x7fa630162200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:59.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.982+0000 7fa62effd640 1 --2- 172.21.15.19:0/973478557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa61c004d40 0x7fa63015e900 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fa62000fb10 tx=0x7fa620002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:59.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.982+0000 7fa6277fe640 1 -- 172.21.15.19:0/973478557 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62001a070 con 0x7fa61c004d40 2024-09-12T02:01:59.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.982+0000 7fa6277fe640 1 -- 172.21.15.19:0/973478557 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa620006d60 con 0x7fa61c004d40 2024-09-12T02:01:59.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.982+0000 7fa635531640 1 -- 172.21.15.19:0/973478557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa63015c430 con 0x7fa61c004d40 2024-09-12T02:01:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.982+0000 7fa6277fe640 1 -- 172.21.15.19:0/973478557 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa620003b90 con 0x7fa61c004d40 2024-09-12T02:01:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.982+0000 7fa635531640 1 -- 172.21.15.19:0/973478557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa63015e100 con 0x7fa61c004d40 2024-09-12T02:01:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.983+0000 7fa635531640 1 -- 172.21.15.19:0/973478557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6300b3030 con 0x7fa61c004d40 2024-09-12T02:01:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.983+0000 7fa6277fe640 1 -- 172.21.15.19:0/973478557 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa62001d070 con 0x7fa61c004d40 2024-09-12T02:01:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.984+0000 7fa6277fe640 1 --2- 172.21.15.19:0/973478557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa61006be30 0x7fa61006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.984+0000 7fa6277fe640 1 -- 172.21.15.19:0/973478557 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6187+0+0 (secure 0 0 0) 0x7fa62008ab80 con 0x7fa61c004d40 2024-09-12T02:01:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.984+0000 7fa62e7fc640 1 --2- 172.21.15.19:0/973478557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa61006be30 0x7fa61006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.984+0000 7fa62e7fc640 1 --2- 172.21.15.19:0/973478557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa61006be30 0x7fa61006e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa618001eb0 tx=0x7fa618009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:01:59.988+0000 7fa6277fe640 1 -- 172.21.15.19:0/973478557 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa620059350 con 0x7fa61c004d40 2024-09-12T02:02:00.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.202+0000 7fa635531640 1 -- 172.21.15.19:0/973478557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6300b3cb0 con 0x7fa61c004d40 2024-09-12T02:02:00.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.203+0000 7fa6277fe640 1 -- 172.21.15.19:0/973478557 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5230 (secure 0 0 0) 0x7fa620058c50 con 0x7fa61c004d40 2024-09-12T02:02:00.203 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:00.203 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":69,"btime":"2024-09-12T02:01:55:959025+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1065573429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1065573429},{"type":"v1","addr":"172.21.15.19:6835","nonce":1065573429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3905709264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":3905709264},{"type":"v1","addr":"172.21.15.135:6837","nonce":3905709264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5771,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2548260678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2548260678},{"type":"v1","addr":"172.21.15.135:6836","nonce":2548260678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:01:16.289395+0000","modified":"2024-09-12T02:01:55.959021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6082":{"gid":6082,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":14,"addr":"172.21.15.19:6834/836344045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":836344045},{"type":"v1","addr":"172.21.15.19:6834","nonce":836344045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6082,"qdb_cluster":[6082]},"id":5}]} 2024-09-12T02:02:00.203 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 69 2024-09-12T02:02:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.205+0000 7fa635531640 1 -- 172.21.15.19:0/973478557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa61006be30 msgr2=0x7fa61006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.205+0000 7fa635531640 1 --2- 172.21.15.19:0/973478557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa61006be30 0x7fa61006e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa618001eb0 tx=0x7fa618009040 comp rx=0 tx=0).stop 2024-09-12T02:02:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.205+0000 7fa635531640 1 -- 172.21.15.19:0/973478557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa61c004d40 msgr2=0x7fa63015e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.205+0000 7fa635531640 1 --2- 172.21.15.19:0/973478557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa61c004d40 0x7fa63015e900 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fa62000fb10 tx=0x7fa620002170 comp rx=0 tx=0).stop 2024-09-12T02:02:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.205+0000 7fa635531640 1 -- 172.21.15.19:0/973478557 shutdown_connections 2024-09-12T02:02:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.205+0000 7fa635531640 1 --2- 172.21.15.19:0/973478557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa61006be30 0x7fa61006e2f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.205+0000 7fa635531640 1 --2- 172.21.15.19:0/973478557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6300b7af0 0x7fa630162200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.205+0000 7fa635531640 1 --2- 172.21.15.19:0/973478557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa63015af20 0x7fa63015bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.205+0000 7fa635531640 1 --2- 172.21.15.19:0/973478557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa61c004d40 0x7fa63015e900 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.205+0000 7fa635531640 1 -- 172.21.15.19:0/973478557 >> 172.21.15.19:0/973478557 conn(0x7fa6300d23a0 msgr2=0x7fa63006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.205+0000 7fa635531640 1 -- 172.21.15.19:0/973478557 shutdown_connections 2024-09-12T02:02:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.205+0000 7fa635531640 1 -- 172.21.15.19:0/973478557 wait complete. 2024-09-12T02:02:00.216 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:02:00.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.318+0000 7f13e4eaf640 1 Processor -- start 2024-09-12T02:02:00.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.318+0000 7f13e4eaf640 1 -- start start 2024-09-12T02:02:00.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.319+0000 7f13e4eaf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13e015e5f0 0x7f13e00d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:00.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.319+0000 7f13e4eaf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f13e00d30f0 0x7f13e00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:00.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.319+0000 7f13e4eaf640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f13e00b64c0 0x7f13e00cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:00.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.319+0000 7f13e4eaf640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f13e006d530 con 0x7f13e00d30f0 2024-09-12T02:02:00.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.319+0000 7f13e4eaf640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f13e00d3690 con 0x7f13e00b64c0 2024-09-12T02:02:00.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.319+0000 7f13e4eaf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f13e00d3970 con 0x7f13e015e5f0 2024-09-12T02:02:00.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.319+0000 7f13d7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f13e00d30f0 0x7f13e00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:00.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.319+0000 7f13d7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f13e00d30f0 0x7f13e00b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57042/0 (socket says 172.21.15.19:57042) 2024-09-12T02:02:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.319+0000 7f13d7fff640 1 -- 172.21.15.19:0/4096677267 learned_addr learned my addr 172.21.15.19:0/4096677267 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.319+0000 7f13ded9d640 1 --2- 172.21.15.19:0/4096677267 >> v2:172.21.15.135:3300/0 conn(0x7f13e00b64c0 0x7f13e00cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.319+0000 7f13de59c640 1 --2- 172.21.15.19:0/4096677267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13e015e5f0 0x7f13e00d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.319+0000 7f13d7fff640 1 -- 172.21.15.19:0/4096677267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13e015e5f0 msgr2=0x7f13e00d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.319+0000 7f13d7fff640 1 --2- 172.21.15.19:0/4096677267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13e015e5f0 0x7f13e00d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.319+0000 7f13d7fff640 1 -- 172.21.15.19:0/4096677267 >> v2:172.21.15.135:3300/0 conn(0x7f13e00b64c0 msgr2=0x7f13e00cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.319+0000 7f13d7fff640 1 --2- 172.21.15.19:0/4096677267 >> v2:172.21.15.135:3300/0 conn(0x7f13e00b64c0 0x7f13e00cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.319+0000 7f13d7fff640 1 -- 172.21.15.19:0/4096677267 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e006cee0 con 0x7f13e00d30f0 2024-09-12T02:02:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.319+0000 7f13ded9d640 1 --2- 172.21.15.19:0/4096677267 >> v2:172.21.15.135:3300/0 conn(0x7f13e00b64c0 0x7f13e00cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.320+0000 7f13d7fff640 1 --2- 172.21.15.19:0/4096677267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13e00d30f0 0x7f13e00b5f80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f13e00a23f0 tx=0x7f13c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22ce275d8df5099 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:00.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.320+0000 7f13ddd9b640 1 -- 172.21.15.19:0/4096677267 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8037070 con 0x7f13e00d30f0 2024-09-12T02:02:00.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.320+0000 7f13ddd9b640 1 -- 172.21.15.19:0/4096677267 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c8032440 con 0x7f13e00d30f0 2024-09-12T02:02:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.320+0000 7f13ddd9b640 1 -- 172.21.15.19:0/4096677267 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8032810 con 0x7f13e00d30f0 2024-09-12T02:02:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.321+0000 7f13e4eaf640 1 -- 172.21.15.19:0/4096677267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13e00d30f0 msgr2=0x7f13e00b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.321+0000 7f13e4eaf640 1 --2- 172.21.15.19:0/4096677267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13e00d30f0 0x7f13e00b5f80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f13e00a23f0 tx=0x7f13c802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:02:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.321+0000 7f13e4eaf640 1 -- 172.21.15.19:0/4096677267 shutdown_connections 2024-09-12T02:02:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.321+0000 7f13e4eaf640 1 --2- 172.21.15.19:0/4096677267 >> v2:172.21.15.135:3300/0 conn(0x7f13e00b64c0 0x7f13e00cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.321+0000 7f13e4eaf640 1 --2- 172.21.15.19:0/4096677267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13e00d30f0 0x7f13e00b5f80 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.321+0000 7f13e4eaf640 1 --2- 172.21.15.19:0/4096677267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13e015e5f0 0x7f13e00d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.321+0000 7f13e4eaf640 1 -- 172.21.15.19:0/4096677267 >> 172.21.15.19:0/4096677267 conn(0x7f13e008bfc0 msgr2=0x7f13e00d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.321+0000 7f13e4eaf640 1 -- 172.21.15.19:0/4096677267 shutdown_connections 2024-09-12T02:02:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.321+0000 7f13e4eaf640 1 -- 172.21.15.19:0/4096677267 wait complete. 2024-09-12T02:02:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.322+0000 7f13e4eaf640 1 Processor -- start 2024-09-12T02:02:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.322+0000 7f13e4eaf640 1 -- start start 2024-09-12T02:02:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.323+0000 7f13e4eaf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13e00b64c0 0x7f13e0151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.323+0000 7f13e4eaf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13e00d30f0 0x7f13e00ce950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.323+0000 7f13e4eaf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13e015e5f0 0x7f13e006e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.323+0000 7f13e4eaf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f13e00d5310 con 0x7f13e00d30f0 2024-09-12T02:02:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.323+0000 7f13e4eaf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f13e015e9d0 con 0x7f13e00b64c0 2024-09-12T02:02:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.323+0000 7f13e4eaf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f13e00cf540 con 0x7f13e015e5f0 2024-09-12T02:02:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.323+0000 7f13d7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13e00d30f0 0x7f13e00ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.323+0000 7f13d7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13e00d30f0 0x7f13e00ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57048/0 (socket says 172.21.15.19:57048) 2024-09-12T02:02:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.323+0000 7f13d7fff640 1 -- 172.21.15.19:0/2514527275 learned_addr learned my addr 172.21.15.19:0/2514527275 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.323+0000 7f13de59c640 1 --2- 172.21.15.19:0/2514527275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13e00b64c0 0x7f13e0151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.323+0000 7f13ded9d640 1 --2- 172.21.15.19:0/2514527275 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13e015e5f0 0x7f13e006e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.323+0000 7f13d7fff640 1 -- 172.21.15.19:0/2514527275 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13e015e5f0 msgr2=0x7f13e006e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.323+0000 7f13d7fff640 1 --2- 172.21.15.19:0/2514527275 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13e015e5f0 0x7f13e006e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.323+0000 7f13d7fff640 1 -- 172.21.15.19:0/2514527275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13e00b64c0 msgr2=0x7f13e0151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.323+0000 7f13d7fff640 1 --2- 172.21.15.19:0/2514527275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13e00b64c0 0x7f13e0151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.323+0000 7f13d7fff640 1 -- 172.21.15.19:0/2514527275 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e00cdb90 con 0x7f13e00d30f0 2024-09-12T02:02:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.324+0000 7f13d7fff640 1 --2- 172.21.15.19:0/2514527275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13e00d30f0 0x7f13e00ce950 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f13c802a220 tx=0x7f13c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.324+0000 7f13d6ffd640 1 -- 172.21.15.19:0/2514527275 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8041020 con 0x7f13e00d30f0 2024-09-12T02:02:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.324+0000 7f13d6ffd640 1 -- 172.21.15.19:0/2514527275 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c80306c0 con 0x7f13e00d30f0 2024-09-12T02:02:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.324+0000 7f13e4eaf640 1 -- 172.21.15.19:0/2514527275 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e00cde70 con 0x7f13e00d30f0 2024-09-12T02:02:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.324+0000 7f13d6ffd640 1 -- 172.21.15.19:0/2514527275 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8037040 con 0x7f13e00d30f0 2024-09-12T02:02:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.324+0000 7f13e4eaf640 1 -- 172.21.15.19:0/2514527275 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e00cd860 con 0x7f13e00d30f0 2024-09-12T02:02:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.325+0000 7f13e4eaf640 1 -- 172.21.15.19:0/2514527275 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e00d4000 con 0x7f13e00d30f0 2024-09-12T02:02:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.325+0000 7f13d6ffd640 1 -- 172.21.15.19:0/2514527275 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f13c8044020 con 0x7f13e00d30f0 2024-09-12T02:02:00.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.326+0000 7f13d6ffd640 1 --2- 172.21.15.19:0/2514527275 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f13c006be30 0x7f13c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:00.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.326+0000 7f13d6ffd640 1 -- 172.21.15.19:0/2514527275 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6187+0+0 (secure 0 0 0) 0x7f13c80ab760 con 0x7f13e00d30f0 2024-09-12T02:02:00.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.326+0000 7f13de59c640 1 --2- 172.21.15.19:0/2514527275 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f13c006be30 0x7f13c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:00.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.326+0000 7f13de59c640 1 --2- 172.21.15.19:0/2514527275 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f13c006be30 0x7f13c006e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f13d0007920 tx=0x7f13d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:00.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.330+0000 7f13d6ffd640 1 -- 172.21.15.19:0/2514527275 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f13e00d4000 con 0x7f13e00d30f0 2024-09-12T02:02:00.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.506+0000 7f13e4eaf640 1 -- 172.21.15.19:0/2514527275 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13e00b5f80 con 0x7f13e00d30f0 2024-09-12T02:02:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.507+0000 7f13d6ffd640 1 -- 172.21.15.19:0/2514527275 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+17124 (secure 0 0 0) 0x7f13c804b030 con 0x7f13e00d30f0 2024-09-12T02:02:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:00.941 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":82,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:01:52.946945+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:01:13.953490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-12T02:01:15.281758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6836/1796121402":"2024-09-13T02:01:52.946892+0000","172.21.15.135:6834/1796121402":"2024-09-13T02:01:52.946892+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:02:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.509+0000 7f13e4eaf640 1 -- 172.21.15.19:0/2514527275 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f13c006be30 msgr2=0x7f13c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.509+0000 7f13e4eaf640 1 --2- 172.21.15.19:0/2514527275 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f13c006be30 0x7f13c006e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f13d0007920 tx=0x7f13d0008040 comp rx=0 tx=0).stop 2024-09-12T02:02:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.509+0000 7f13e4eaf640 1 -- 172.21.15.19:0/2514527275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13e00d30f0 msgr2=0x7f13e00ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.509+0000 7f13e4eaf640 1 --2- 172.21.15.19:0/2514527275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13e00d30f0 0x7f13e00ce950 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f13c802a220 tx=0x7f13c80046c0 comp rx=0 tx=0).stop 2024-09-12T02:02:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.509+0000 7f13e4eaf640 1 -- 172.21.15.19:0/2514527275 shutdown_connections 2024-09-12T02:02:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.509+0000 7f13e4eaf640 1 --2- 172.21.15.19:0/2514527275 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f13c006be30 0x7f13c006e2f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.509+0000 7f13e4eaf640 1 --2- 172.21.15.19:0/2514527275 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13e015e5f0 0x7f13e006e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.509+0000 7f13e4eaf640 1 --2- 172.21.15.19:0/2514527275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13e00d30f0 0x7f13e00ce950 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.509+0000 7f13e4eaf640 1 --2- 172.21.15.19:0/2514527275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13e00b64c0 0x7f13e0151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.509+0000 7f13e4eaf640 1 -- 172.21.15.19:0/2514527275 >> 172.21.15.19:0/2514527275 conn(0x7f13e008bfc0 msgr2=0x7f13e00d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.509+0000 7f13e4eaf640 1 -- 172.21.15.19:0/2514527275 shutdown_connections 2024-09-12T02:02:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:00.509+0000 7f13e4eaf640 1 -- 172.21.15.19:0/2514527275 wait complete. 2024-09-12T02:02:00.944 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:02:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.054+0000 7f4396a67640 1 Processor -- start 2024-09-12T02:02:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.054+0000 7f4396a67640 1 -- start start 2024-09-12T02:02:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.055+0000 7f4396a67640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f439015b300 0x7f43900cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.055+0000 7f4396a67640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f439006f8d0 0x7f439015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.055+0000 7f4396a67640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43900cdbe0 con 0x7f43900cd3f0 2024-09-12T02:02:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.055+0000 7f4396a67640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f43900728a0 con 0x7f439006f8d0 2024-09-12T02:02:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.055+0000 7f4396a67640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f43900cd900 con 0x7f439015b300 2024-09-12T02:02:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.055+0000 7f4395004640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f439006f8d0 0x7f439015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.055+0000 7f4395004640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f439006f8d0 0x7f439015b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48102/0 (socket says 172.21.15.19:48102) 2024-09-12T02:02:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.055+0000 7f4395004640 1 -- 172.21.15.19:0/2076882186 learned_addr learned my addr 172.21.15.19:0/2076882186 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.055+0000 7f4394803640 1 --2- 172.21.15.19:0/2076882186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f439015b300 0x7f43900cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.055+0000 7f4395004640 1 -- 172.21.15.19:0/2076882186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f439015b300 msgr2=0x7f43900cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.055+0000 7f4395004640 1 --2- 172.21.15.19:0/2076882186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f439015b300 0x7f43900cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.055+0000 7f4395004640 1 -- 172.21.15.19:0/2076882186 >> v1:172.21.15.135:6789/0 conn(0x7f43900cd3f0 legacy=0x7f439006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.055+0000 7f4395004640 1 -- 172.21.15.19:0/2076882186 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4390072250 con 0x7f439006f8d0 2024-09-12T02:02:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.056+0000 7f4395004640 1 --2- 172.21.15.19:0/2076882186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f439006f8d0 0x7f439015b6e0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f4388009e50 tx=0x7f438802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27360bc4fda5e177 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.056+0000 7f438f7fe640 1 -- 172.21.15.19:0/2076882186 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388036070 con 0x7f439006f8d0 2024-09-12T02:02:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.056+0000 7f438f7fe640 1 -- 172.21.15.19:0/2076882186 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4388031600 con 0x7f439006f8d0 2024-09-12T02:02:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.056+0000 7f438f7fe640 1 -- 172.21.15.19:0/2076882186 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43880319d0 con 0x7f439006f8d0 2024-09-12T02:02:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.057+0000 7f4396a67640 1 -- 172.21.15.19:0/2076882186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f439006f8d0 msgr2=0x7f439015b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.057+0000 7f4396a67640 1 --2- 172.21.15.19:0/2076882186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f439006f8d0 0x7f439015b6e0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f4388009e50 tx=0x7f438802a710 comp rx=0 tx=0).stop 2024-09-12T02:02:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.057+0000 7f4396a67640 1 -- 172.21.15.19:0/2076882186 shutdown_connections 2024-09-12T02:02:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.057+0000 7f4396a67640 1 --2- 172.21.15.19:0/2076882186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f439006f8d0 0x7f439015b6e0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.057+0000 7f4396a67640 1 --2- 172.21.15.19:0/2076882186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f439015b300 0x7f43900cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.057+0000 7f4396a67640 1 -- 172.21.15.19:0/2076882186 >> 172.21.15.19:0/2076882186 conn(0x7f4390067d70 msgr2=0x7f439006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.057+0000 7f4396a67640 1 -- 172.21.15.19:0/2076882186 shutdown_connections 2024-09-12T02:02:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.057+0000 7f4396a67640 1 -- 172.21.15.19:0/2076882186 wait complete. 2024-09-12T02:02:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.058+0000 7f4396a67640 1 Processor -- start 2024-09-12T02:02:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.058+0000 7f4396a67640 1 -- start start 2024-09-12T02:02:01.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.059+0000 7f4396a67640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f439006f8d0 0x7f43900a9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.059+0000 7f4396a67640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43900cd3f0 0x7f43900aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.059+0000 7f4396a67640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f439015b300 0x7f43901f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.059+0000 7f4396a67640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f43900d0160 con 0x7f439015b300 2024-09-12T02:02:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.059+0000 7f4396a67640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f43900cffe0 con 0x7f439006f8d0 2024-09-12T02:02:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.059+0000 7f4396a67640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4390072d30 con 0x7f43900cd3f0 2024-09-12T02:02:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.059+0000 7f4395004640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f439015b300 0x7f43901f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.059+0000 7f4395004640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f439015b300 0x7f43901f2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48118/0 (socket says 172.21.15.19:48118) 2024-09-12T02:02:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.059+0000 7f4395004640 1 -- 172.21.15.19:0/1626937283 learned_addr learned my addr 172.21.15.19:0/1626937283 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.059+0000 7f4394803640 1 --2- 172.21.15.19:0/1626937283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f439006f8d0 0x7f43900a9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.059+0000 7f438ffff640 1 --2- 172.21.15.19:0/1626937283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43900cd3f0 0x7f43900aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.060+0000 7f4395004640 1 -- 172.21.15.19:0/1626937283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43900cd3f0 msgr2=0x7f43900aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.060+0000 7f4395004640 1 --2- 172.21.15.19:0/1626937283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43900cd3f0 0x7f43900aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:01.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.060+0000 7f4395004640 1 -- 172.21.15.19:0/1626937283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f439006f8d0 msgr2=0x7f43900a9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:01.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.060+0000 7f4395004640 1 --2- 172.21.15.19:0/1626937283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f439006f8d0 0x7f43900a9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:01.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.060+0000 7f4395004640 1 -- 172.21.15.19:0/1626937283 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43900aa7f0 con 0x7f439015b300 2024-09-12T02:02:01.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.060+0000 7f4395004640 1 --2- 172.21.15.19:0/1626937283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f439015b300 0x7f43901f2520 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f4388009e50 tx=0x7f4388004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:01.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.060+0000 7f438d7fa640 1 -- 172.21.15.19:0/1626937283 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388036050 con 0x7f439015b300 2024-09-12T02:02:01.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.060+0000 7f438d7fa640 1 -- 172.21.15.19:0/1626937283 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4388042070 con 0x7f439015b300 2024-09-12T02:02:01.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.060+0000 7f4396a67640 1 -- 172.21.15.19:0/1626937283 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43900aaad0 con 0x7f439015b300 2024-09-12T02:02:01.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.060+0000 7f438d7fa640 1 -- 172.21.15.19:0/1626937283 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388009510 con 0x7f439015b300 2024-09-12T02:02:01.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.060+0000 7f4396a67640 1 -- 172.21.15.19:0/1626937283 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43900ab090 con 0x7f439015b300 2024-09-12T02:02:01.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.061+0000 7f4396a67640 1 -- 172.21.15.19:0/1626937283 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43900c9cd0 con 0x7f439015b300 2024-09-12T02:02:01.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.061+0000 7f438d7fa640 1 -- 172.21.15.19:0/1626937283 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4388007bf0 con 0x7f439015b300 2024-09-12T02:02:01.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.062+0000 7f438d7fa640 1 --2- 172.21.15.19:0/1626937283 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f437406be30 0x7f437406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:01.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.062+0000 7f438d7fa640 1 -- 172.21.15.19:0/1626937283 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6187+0+0 (secure 0 0 0) 0x7f43880abc80 con 0x7f439015b300 2024-09-12T02:02:01.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.062+0000 7f4394803640 1 --2- 172.21.15.19:0/1626937283 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f437406be30 0x7f437406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:01.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.063+0000 7f4394803640 1 --2- 172.21.15.19:0/1626937283 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f437406be30 0x7f437406e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4384009aa0 tx=0x7f4384009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:01.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.066+0000 7f438d7fa640 1 -- 172.21.15.19:0/1626937283 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4388079e90 con 0x7f439015b300 2024-09-12T02:02:01.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.278+0000 7f4396a67640 1 -- 172.21.15.19:0/1626937283 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f439006f1b0 con 0x7f439015b300 2024-09-12T02:02:01.278 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:02:01.278+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:02:01.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.280+0000 7f438d7fa640 1 -- 172.21.15.19:0/1626937283 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) ==== 161+0+0 (secure 0 0 0) 0x7f438807e190 con 0x7f439015b300 2024-09-12T02:02:01.279 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:02:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.282+0000 7f4396a67640 1 -- 172.21.15.19:0/1626937283 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f437406be30 msgr2=0x7f437406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.282+0000 7f4396a67640 1 --2- 172.21.15.19:0/1626937283 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f437406be30 0x7f437406e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4384009aa0 tx=0x7f4384009190 comp rx=0 tx=0).stop 2024-09-12T02:02:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.282+0000 7f4396a67640 1 -- 172.21.15.19:0/1626937283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f439015b300 msgr2=0x7f43901f2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.282+0000 7f4396a67640 1 --2- 172.21.15.19:0/1626937283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f439015b300 0x7f43901f2520 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f4388009e50 tx=0x7f4388004a40 comp rx=0 tx=0).stop 2024-09-12T02:02:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.282+0000 7f4396a67640 1 -- 172.21.15.19:0/1626937283 shutdown_connections 2024-09-12T02:02:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.282+0000 7f4396a67640 1 --2- 172.21.15.19:0/1626937283 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f437406be30 0x7f437406e2f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.282+0000 7f4396a67640 1 --2- 172.21.15.19:0/1626937283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f439015b300 0x7f43901f2520 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.282+0000 7f4396a67640 1 --2- 172.21.15.19:0/1626937283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43900cd3f0 0x7f43900aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.282+0000 7f4396a67640 1 --2- 172.21.15.19:0/1626937283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f439006f8d0 0x7f43900a9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.282+0000 7f4396a67640 1 -- 172.21.15.19:0/1626937283 >> 172.21.15.19:0/1626937283 conn(0x7f4390067d70 msgr2=0x7f43900c5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.282+0000 7f4396a67640 1 -- 172.21.15.19:0/1626937283 shutdown_connections 2024-09-12T02:02:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.282+0000 7f4396a67640 1 -- 172.21.15.19:0/1626937283 wait complete. 2024-09-12T02:02:01.292 INFO:tasks.ceph.mds.a.smithi019.stderr: -221> 2024-09-12T02:01:57.927+0000 7fed7be90640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:02:01.297 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:02:01.319 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-09-12T02:02:01.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.403+0000 7fcf80949640 1 Processor -- start 2024-09-12T02:02:01.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.403+0000 7fcf80949640 1 -- start start 2024-09-12T02:02:01.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.404+0000 7fcf80949640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcf7c0b7c30 0x7fcf7c0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:01.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.404+0000 7fcf80949640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf7c0b4a50 0x7fcf7c0cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:01.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.404+0000 7fcf80949640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf7c0ce1a0 con 0x7fcf7c0cd340 2024-09-12T02:02:01.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.404+0000 7fcf80949640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fcf7c0b3010 con 0x7fcf7c0b7c30 2024-09-12T02:02:01.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.404+0000 7fcf80949640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcf7c0b32f0 con 0x7fcf7c0b4a50 2024-09-12T02:02:01.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.404+0000 7fcf7ad9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcf7c0cd340 0x7fcf7c09aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52224/0 (socket says 172.21.15.19:52224) 2024-09-12T02:02:01.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.404+0000 7fcf7ad9d640 1 -- 172.21.15.19:0/3000630905 learned_addr learned my addr 172.21.15.19:0/3000630905 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:01.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.405+0000 7fcf7a59c640 1 --2- 172.21.15.19:0/3000630905 >> v2:172.21.15.135:3300/0 conn(0x7fcf7c0b7c30 0x7fcf7c0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:01.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.405+0000 7fcf79d9b640 1 --2- 172.21.15.19:0/3000630905 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf7c0b4a50 0x7fcf7c0cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:01.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.405+0000 7fcf7959a640 1 -- 172.21.15.19:0/3000630905 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1036548066 0 0) 0x7fcf7c0ce1a0 con 0x7fcf7c0cd340 2024-09-12T02:02:01.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.405+0000 7fcf7959a640 1 -- 172.21.15.19:0/3000630905 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf64003520 con 0x7fcf7c0cd340 2024-09-12T02:02:01.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.405+0000 7fcf79d9b640 1 -- 172.21.15.19:0/3000630905 >> v2:172.21.15.135:3300/0 conn(0x7fcf7c0b7c30 msgr2=0x7fcf7c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:01.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.405+0000 7fcf79d9b640 1 --2- 172.21.15.19:0/3000630905 >> v2:172.21.15.135:3300/0 conn(0x7fcf7c0b7c30 0x7fcf7c0cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:01.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.405+0000 7fcf79d9b640 1 -- 172.21.15.19:0/3000630905 >> v1:172.21.15.19:6789/0 conn(0x7fcf7c0cd340 legacy=0x7fcf7c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:01.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.405+0000 7fcf7959a640 1 -- 172.21.15.19:0/3000630905 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2932666504 0 0) 0x7fcf64003520 con 0x7fcf7c0cd340 2024-09-12T02:02:01.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.405+0000 7fcf79d9b640 1 -- 172.21.15.19:0/3000630905 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf7c0b35d0 con 0x7fcf7c0b4a50 2024-09-12T02:02:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.406+0000 7fcf79d9b640 1 --2- 172.21.15.19:0/3000630905 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf7c0b4a50 0x7fcf7c0cce00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcf700097a0 tx=0x7fcf7002a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bef230c321047e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.406+0000 7fcf7959a640 1 -- 172.21.15.19:0/3000630905 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf70037070 con 0x7fcf7c0b4a50 2024-09-12T02:02:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.406+0000 7fcf7959a640 1 -- 172.21.15.19:0/3000630905 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf7002ab10 con 0x7fcf7c0b4a50 2024-09-12T02:02:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.406+0000 7fcf7959a640 1 -- 172.21.15.19:0/3000630905 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf740019f0 con 0x7fcf7c0b4a50 2024-09-12T02:02:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.406+0000 7fcf80949640 1 -- 172.21.15.19:0/3000630905 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf7c0b4a50 msgr2=0x7fcf7c0cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.406+0000 7fcf80949640 1 --2- 172.21.15.19:0/3000630905 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf7c0b4a50 0x7fcf7c0cce00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcf700097a0 tx=0x7fcf7002a080 comp rx=0 tx=0).stop 2024-09-12T02:02:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.407+0000 7fcf80949640 1 -- 172.21.15.19:0/3000630905 shutdown_connections 2024-09-12T02:02:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.407+0000 7fcf80949640 1 --2- 172.21.15.19:0/3000630905 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf7c0b4a50 0x7fcf7c0cce00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.407+0000 7fcf80949640 1 --2- 172.21.15.19:0/3000630905 >> v2:172.21.15.135:3300/0 conn(0x7fcf7c0b7c30 0x7fcf7c0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.407+0000 7fcf80949640 1 -- 172.21.15.19:0/3000630905 >> 172.21.15.19:0/3000630905 conn(0x7fcf7c0b3de0 msgr2=0x7fcf7c0b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.407+0000 7fcf80949640 1 -- 172.21.15.19:0/3000630905 shutdown_connections 2024-09-12T02:02:01.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.407+0000 7fcf80949640 1 -- 172.21.15.19:0/3000630905 wait complete. 2024-09-12T02:02:01.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.408+0000 7fcf80949640 1 Processor -- start 2024-09-12T02:02:01.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.408+0000 7fcf80949640 1 -- start start 2024-09-12T02:02:01.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.409+0000 7fcf80949640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf7c0b4a50 0x7fcf7c1f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:01.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.409+0000 7fcf80949640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf7c0b7c30 0x7fcf7c0b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:01.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.409+0000 7fcf80949640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf7c0cd340 0x7fcf7c15f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:01.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.409+0000 7fcf80949640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7c0d0400 con 0x7fcf7c0b4a50 2024-09-12T02:02:01.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.409+0000 7fcf80949640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7c0b6130 con 0x7fcf7c0b7c30 2024-09-12T02:02:01.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.409+0000 7fcf80949640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcf7c0d0580 con 0x7fcf7c0cd340 2024-09-12T02:02:01.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.409+0000 7fcf7a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf7c0b4a50 0x7fcf7c1f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:01.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.409+0000 7fcf7a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf7c0b4a50 0x7fcf7c1f2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48144/0 (socket says 172.21.15.19:48144) 2024-09-12T02:02:01.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.409+0000 7fcf7a59c640 1 -- 172.21.15.19:0/536201960 learned_addr learned my addr 172.21.15.19:0/536201960 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:01.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.409+0000 7fcf79d9b640 1 --2- 172.21.15.19:0/536201960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf7c0b7c30 0x7fcf7c0b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:01.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.409+0000 7fcf7ad9d640 1 --2- 172.21.15.19:0/536201960 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf7c0cd340 0x7fcf7c15f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:01.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.409+0000 7fcf7a59c640 1 -- 172.21.15.19:0/536201960 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf7c0cd340 msgr2=0x7fcf7c15f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:01.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.409+0000 7fcf7a59c640 1 --2- 172.21.15.19:0/536201960 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf7c0cd340 0x7fcf7c15f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:01.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.409+0000 7fcf7a59c640 1 -- 172.21.15.19:0/536201960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf7c0b7c30 msgr2=0x7fcf7c0b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:01.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.409+0000 7fcf7a59c640 1 --2- 172.21.15.19:0/536201960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf7c0b7c30 0x7fcf7c0b6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:01.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.409+0000 7fcf7a59c640 1 -- 172.21.15.19:0/536201960 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf7c09e590 con 0x7fcf7c0b4a50 2024-09-12T02:02:01.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.409+0000 7fcf7a59c640 1 --2- 172.21.15.19:0/536201960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf7c0b4a50 0x7fcf7c1f2b00 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00e9b0 tx=0x7fcf6c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:01.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.409+0000 7fcf6affd640 1 -- 172.21.15.19:0/536201960 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c017070 con 0x7fcf7c0b4a50 2024-09-12T02:02:01.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.410+0000 7fcf6affd640 1 -- 172.21.15.19:0/536201960 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf6c00c9a0 con 0x7fcf7c0b4a50 2024-09-12T02:02:01.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.410+0000 7fcf6affd640 1 -- 172.21.15.19:0/536201960 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c00cd90 con 0x7fcf7c0b4a50 2024-09-12T02:02:01.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.410+0000 7fcf80949640 1 -- 172.21.15.19:0/536201960 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf7c1f3040 con 0x7fcf7c0b4a50 2024-09-12T02:02:01.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.410+0000 7fcf80949640 1 -- 172.21.15.19:0/536201960 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf7c0afb20 con 0x7fcf7c0b4a50 2024-09-12T02:02:01.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.411+0000 7fcf80949640 1 -- 172.21.15.19:0/536201960 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf7c0b8010 con 0x7fcf7c0b4a50 2024-09-12T02:02:01.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.411+0000 7fcf6affd640 1 -- 172.21.15.19:0/536201960 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf6c01a070 con 0x7fcf7c0b4a50 2024-09-12T02:02:01.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.412+0000 7fcf6affd640 1 --2- 172.21.15.19:0/536201960 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcf5c06be30 0x7fcf5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:01.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.412+0000 7fcf6affd640 1 -- 172.21.15.19:0/536201960 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6273+0+0 (secure 0 0 0) 0x7fcf6c08b170 con 0x7fcf7c0b4a50 2024-09-12T02:02:01.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.412+0000 7fcf79d9b640 1 --2- 172.21.15.19:0/536201960 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcf5c06be30 0x7fcf5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:01.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.412+0000 7fcf79d9b640 1 --2- 172.21.15.19:0/536201960 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcf5c06be30 0x7fcf5c06e2f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcf70034000 tx=0x7fcf7002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:01.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.416+0000 7fcf6affd640 1 -- 172.21.15.19:0/536201960 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcf7c1f3040 con 0x7fcf7c0b4a50 2024-09-12T02:02:01.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:01.627+0000 7fcf80949640 1 -- 172.21.15.19:0/536201960 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcf7c09e770 con 0x7fcf7c0b4a50 2024-09-12T02:02:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.281+0000 7fcf6affd640 1 -- 172.21.15.19:0/536201960 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v71) ==== 104+0+0 (secure 0 0 0) 0x7fcf7c09e590 con 0x7fcf7c0b4a50 2024-09-12T02:02:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.284+0000 7fcf80949640 1 -- 172.21.15.19:0/536201960 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcf5c06be30 msgr2=0x7fcf5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.284+0000 7fcf80949640 1 --2- 172.21.15.19:0/536201960 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcf5c06be30 0x7fcf5c06e2f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcf70034000 tx=0x7fcf7002e000 comp rx=0 tx=0).stop 2024-09-12T02:02:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.284+0000 7fcf80949640 1 -- 172.21.15.19:0/536201960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf7c0b4a50 msgr2=0x7fcf7c1f2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.284+0000 7fcf80949640 1 --2- 172.21.15.19:0/536201960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf7c0b4a50 0x7fcf7c1f2b00 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00e9b0 tx=0x7fcf6c00ee70 comp rx=0 tx=0).stop 2024-09-12T02:02:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.284+0000 7fcf80949640 1 -- 172.21.15.19:0/536201960 shutdown_connections 2024-09-12T02:02:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.284+0000 7fcf80949640 1 --2- 172.21.15.19:0/536201960 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcf5c06be30 0x7fcf5c06e2f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.284+0000 7fcf80949640 1 --2- 172.21.15.19:0/536201960 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf7c0cd340 0x7fcf7c15f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.284+0000 7fcf80949640 1 --2- 172.21.15.19:0/536201960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf7c0b7c30 0x7fcf7c0b6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.284+0000 7fcf80949640 1 --2- 172.21.15.19:0/536201960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf7c0b4a50 0x7fcf7c1f2b00 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.284+0000 7fcf80949640 1 -- 172.21.15.19:0/536201960 >> 172.21.15.19:0/536201960 conn(0x7fcf7c0b3de0 msgr2=0x7fcf7c0b62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.284+0000 7fcf80949640 1 -- 172.21.15.19:0/536201960 shutdown_connections 2024-09-12T02:02:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.284+0000 7fcf80949640 1 -- 172.21.15.19:0/536201960 wait complete. 2024-09-12T02:02:02.298 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:02:02.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.458+0000 7fb2fb59e640 1 Processor -- start 2024-09-12T02:02:02.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.458+0000 7fb2fb59e640 1 -- start start 2024-09-12T02:02:02.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.459+0000 7fb2fb59e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb2fc0d4360 0x7fb2fc162990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.459+0000 7fb2fb59e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb2fc06e6b0 0x7fb2fc0d4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.459+0000 7fb2fb59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2fc06dc80 0x7fb2fc06e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.459+0000 7fb2fb59e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb2fc0b3af0 con 0x7fb2fc06e6b0 2024-09-12T02:02:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.459+0000 7fb2fb59e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb2fc162ed0 con 0x7fb2fc0d4360 2024-09-12T02:02:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.459+0000 7fb2fb59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb2fc0d4c80 con 0x7fb2fc06dc80 2024-09-12T02:02:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.459+0000 7fb2f9d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb2fc06e6b0 0x7fb2fc0d4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.459+0000 7fb2f9d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb2fc06e6b0 0x7fb2fc0d4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48160/0 (socket says 172.21.15.19:48160) 2024-09-12T02:02:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.459+0000 7fb2f9d9b640 1 -- 172.21.15.19:0/3210196685 learned_addr learned my addr 172.21.15.19:0/3210196685 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.459+0000 7fb2fa59c640 1 --2- 172.21.15.19:0/3210196685 >> v2:172.21.15.135:3300/0 conn(0x7fb2fc0d4360 0x7fb2fc162990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.459+0000 7fb2fad9d640 1 --2- 172.21.15.19:0/3210196685 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2fc06dc80 0x7fb2fc06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.459+0000 7fb2f9d9b640 1 -- 172.21.15.19:0/3210196685 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2fc06dc80 msgr2=0x7fb2fc06e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.459+0000 7fb2f9d9b640 1 --2- 172.21.15.19:0/3210196685 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2fc06dc80 0x7fb2fc06e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:02.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.459+0000 7fb2f9d9b640 1 -- 172.21.15.19:0/3210196685 >> v2:172.21.15.135:3300/0 conn(0x7fb2fc0d4360 msgr2=0x7fb2fc162990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:02.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.459+0000 7fb2f9d9b640 1 --2- 172.21.15.19:0/3210196685 >> v2:172.21.15.135:3300/0 conn(0x7fb2fc0d4360 0x7fb2fc162990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:02.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.459+0000 7fb2f9d9b640 1 -- 172.21.15.19:0/3210196685 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2fc0d2b50 con 0x7fb2fc06e6b0 2024-09-12T02:02:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.460+0000 7fb2f9d9b640 1 --2- 172.21.15.19:0/3210196685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2fc06e6b0 0x7fb2fc0d4740 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc09dc70 tx=0x7fb2f002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1972514a5aa4faca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.460+0000 7fb2f959a640 1 -- 172.21.15.19:0/3210196685 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0037070 con 0x7fb2fc06e6b0 2024-09-12T02:02:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.460+0000 7fb2f959a640 1 -- 172.21.15.19:0/3210196685 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f0032440 con 0x7fb2fc06e6b0 2024-09-12T02:02:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.460+0000 7fb2f959a640 1 -- 172.21.15.19:0/3210196685 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0032810 con 0x7fb2fc06e6b0 2024-09-12T02:02:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.461+0000 7fb2fb59e640 1 -- 172.21.15.19:0/3210196685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2fc06e6b0 msgr2=0x7fb2fc0d4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.461+0000 7fb2fb59e640 1 --2- 172.21.15.19:0/3210196685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2fc06e6b0 0x7fb2fc0d4740 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc09dc70 tx=0x7fb2f002a2a0 comp rx=0 tx=0).stop 2024-09-12T02:02:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.461+0000 7fb2fb59e640 1 -- 172.21.15.19:0/3210196685 shutdown_connections 2024-09-12T02:02:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.461+0000 7fb2fb59e640 1 --2- 172.21.15.19:0/3210196685 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2fc06dc80 0x7fb2fc06e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.461+0000 7fb2fb59e640 1 --2- 172.21.15.19:0/3210196685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2fc06e6b0 0x7fb2fc0d4740 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:02.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.461+0000 7fb2fb59e640 1 --2- 172.21.15.19:0/3210196685 >> v2:172.21.15.135:3300/0 conn(0x7fb2fc0d4360 0x7fb2fc162990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:02.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.461+0000 7fb2fb59e640 1 -- 172.21.15.19:0/3210196685 >> 172.21.15.19:0/3210196685 conn(0x7fb2fc09d740 msgr2=0x7fb2fc08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:02.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.461+0000 7fb2fb59e640 1 -- 172.21.15.19:0/3210196685 shutdown_connections 2024-09-12T02:02:02.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.461+0000 7fb2fb59e640 1 -- 172.21.15.19:0/3210196685 wait complete. 2024-09-12T02:02:02.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.462+0000 7fb2fb59e640 1 Processor -- start 2024-09-12T02:02:02.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.462+0000 7fb2fb59e640 1 -- start start 2024-09-12T02:02:02.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.463+0000 7fb2fb59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2fc06dc80 0x7fb2fc15fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:02.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.463+0000 7fb2fb59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2fc06e6b0 0x7fb2fc153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:02.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.463+0000 7fb2fb59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2fc0d4360 0x7fb2fc0b9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:02.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.463+0000 7fb2fb59e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb2fc06d480 con 0x7fb2fc0d4360 2024-09-12T02:02:02.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.463+0000 7fb2fb59e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb2fc06d1a0 con 0x7fb2fc06dc80 2024-09-12T02:02:02.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.463+0000 7fb2fb59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb2fc06d760 con 0x7fb2fc06e6b0 2024-09-12T02:02:02.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.463+0000 7fb2fad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2fc0d4360 0x7fb2fc0b9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:02.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.463+0000 7fb2fad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2fc0d4360 0x7fb2fc0b9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48174/0 (socket says 172.21.15.19:48174) 2024-09-12T02:02:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.463+0000 7fb2fad9d640 1 -- 172.21.15.19:0/407195831 learned_addr learned my addr 172.21.15.19:0/407195831 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.463+0000 7fb2fa59c640 1 --2- 172.21.15.19:0/407195831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2fc06dc80 0x7fb2fc15fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.463+0000 7fb2f9d9b640 1 --2- 172.21.15.19:0/407195831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2fc06e6b0 0x7fb2fc153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.463+0000 7fb2fad9d640 1 -- 172.21.15.19:0/407195831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2fc06e6b0 msgr2=0x7fb2fc153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.463+0000 7fb2fad9d640 1 --2- 172.21.15.19:0/407195831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2fc06e6b0 0x7fb2fc153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.463+0000 7fb2fad9d640 1 -- 172.21.15.19:0/407195831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2fc06dc80 msgr2=0x7fb2fc15fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.463+0000 7fb2fad9d640 1 --2- 172.21.15.19:0/407195831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2fc06dc80 0x7fb2fc15fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.464+0000 7fb2fad9d640 1 -- 172.21.15.19:0/407195831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2fc15ede0 con 0x7fb2fc0d4360 2024-09-12T02:02:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.464+0000 7fb2fad9d640 1 --2- 172.21.15.19:0/407195831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2fc0d4360 0x7fb2fc0b9550 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4007e60 tx=0x7fb2f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.464+0000 7fb2eaffd640 1 -- 172.21.15.19:0/407195831 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4014620 con 0x7fb2fc0d4360 2024-09-12T02:02:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.464+0000 7fb2eaffd640 1 -- 172.21.15.19:0/407195831 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f4019070 con 0x7fb2fc0d4360 2024-09-12T02:02:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.464+0000 7fb2fb59e640 1 -- 172.21.15.19:0/407195831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2fc15f0c0 con 0x7fb2fc0d4360 2024-09-12T02:02:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.464+0000 7fb2eaffd640 1 -- 172.21.15.19:0/407195831 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4014a20 con 0x7fb2fc0d4360 2024-09-12T02:02:02.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.464+0000 7fb2fb59e640 1 -- 172.21.15.19:0/407195831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2fc15f680 con 0x7fb2fc0d4360 2024-09-12T02:02:02.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.465+0000 7fb2fb59e640 1 -- 172.21.15.19:0/407195831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2fc0d51a0 con 0x7fb2fc0d4360 2024-09-12T02:02:02.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.465+0000 7fb2eaffd640 1 -- 172.21.15.19:0/407195831 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb2f4014bc0 con 0x7fb2fc0d4360 2024-09-12T02:02:02.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.466+0000 7fb2eaffd640 1 --2- 172.21.15.19:0/407195831 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb2dc06be30 0x7fb2dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:02.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.466+0000 7fb2eaffd640 1 -- 172.21.15.19:0/407195831 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6273+0+0 (secure 0 0 0) 0x7fb2f408b850 con 0x7fb2fc0d4360 2024-09-12T02:02:02.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.466+0000 7fb2fa59c640 1 --2- 172.21.15.19:0/407195831 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb2dc06be30 0x7fb2dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:02.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.467+0000 7fb2fa59c640 1 --2- 172.21.15.19:0/407195831 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb2dc06be30 0x7fb2dc06e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc1618e0 tx=0x7fb2ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:02.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.471+0000 7fb2eaffd640 1 -- 172.21.15.19:0/407195831 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb2f4059970 con 0x7fb2fc0d4360 2024-09-12T02:02:02.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:02.645+0000 7fb2fb59e640 1 -- 172.21.15.19:0/407195831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb2fc0cee10 con 0x7fb2fc0d4360 2024-09-12T02:02:03.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.285+0000 7fb2eaffd640 1 -- 172.21.15.19:0/407195831 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) ==== 181+0+0 (secure 0 0 0) 0x7fb2f405dc70 con 0x7fb2fc0d4360 2024-09-12T02:02:03.284 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:02:03.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.289+0000 7fb2fb59e640 1 -- 172.21.15.19:0/407195831 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb2dc06be30 msgr2=0x7fb2dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:03.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.289+0000 7fb2fb59e640 1 --2- 172.21.15.19:0/407195831 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb2dc06be30 0x7fb2dc06e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc1618e0 tx=0x7fb2ec008040 comp rx=0 tx=0).stop 2024-09-12T02:02:03.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.289+0000 7fb2fb59e640 1 -- 172.21.15.19:0/407195831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2fc0d4360 msgr2=0x7fb2fc0b9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:03.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.289+0000 7fb2fb59e640 1 --2- 172.21.15.19:0/407195831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2fc0d4360 0x7fb2fc0b9550 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4007e60 tx=0x7fb2f400e4b0 comp rx=0 tx=0).stop 2024-09-12T02:02:03.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.289+0000 7fb2fb59e640 1 -- 172.21.15.19:0/407195831 shutdown_connections 2024-09-12T02:02:03.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.289+0000 7fb2fb59e640 1 --2- 172.21.15.19:0/407195831 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb2dc06be30 0x7fb2dc06e2f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:03.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.289+0000 7fb2fb59e640 1 --2- 172.21.15.19:0/407195831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2fc0d4360 0x7fb2fc0b9550 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:03.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.289+0000 7fb2fb59e640 1 --2- 172.21.15.19:0/407195831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2fc06e6b0 0x7fb2fc153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:03.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.289+0000 7fb2fb59e640 1 --2- 172.21.15.19:0/407195831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2fc06dc80 0x7fb2fc15fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:03.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.289+0000 7fb2fb59e640 1 -- 172.21.15.19:0/407195831 >> 172.21.15.19:0/407195831 conn(0x7fb2fc09d740 msgr2=0x7fb2fc0b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:03.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.289+0000 7fb2fb59e640 1 -- 172.21.15.19:0/407195831 shutdown_connections 2024-09-12T02:02:03.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.289+0000 7fb2fb59e640 1 -- 172.21.15.19:0/407195831 wait complete. 2024-09-12T02:02:03.303 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:02:03.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.417+0000 7fabf379f640 1 Processor -- start 2024-09-12T02:02:03.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.418+0000 7fabf379f640 1 -- start start 2024-09-12T02:02:03.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.418+0000 7fabf379f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fabec0d15f0 0x7fabec0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:03.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.418+0000 7fabf379f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fabec0cf160 0x7fabec06d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:03.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.418+0000 7fabf379f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabec0cf980 con 0x7fabec161a20 2024-09-12T02:02:03.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.418+0000 7fabf379f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fabec161e00 con 0x7fabec0cf160 2024-09-12T02:02:03.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.418+0000 7fabf379f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fabec06d050 con 0x7fabec0d15f0 2024-09-12T02:02:03.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.419+0000 7fabf1d3c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fabec0cf160 0x7fabec06d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:03.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.419+0000 7fabf153b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fabec161a20 0x7fabec0d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52226/0 (socket says 172.21.15.19:52226) 2024-09-12T02:02:03.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.419+0000 7fabf153b640 1 -- 172.21.15.19:0/2887160351 learned_addr learned my addr 172.21.15.19:0/2887160351 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:03.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.419+0000 7fabf0d3a640 1 --2- 172.21.15.19:0/2887160351 >> v2:172.21.15.135:3300/0 conn(0x7fabec0d15f0 0x7fabec0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:03.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.419+0000 7fabf1d3c640 1 -- 172.21.15.19:0/2887160351 >> v2:172.21.15.135:3300/0 conn(0x7fabec0d15f0 msgr2=0x7fabec0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:03.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.419+0000 7fabf1d3c640 1 --2- 172.21.15.19:0/2887160351 >> v2:172.21.15.135:3300/0 conn(0x7fabec0d15f0 0x7fabec0cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:03.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.419+0000 7fabf1d3c640 1 -- 172.21.15.19:0/2887160351 >> v1:172.21.15.19:6789/0 conn(0x7fabec161a20 legacy=0x7fabec0d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:03.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.419+0000 7fabe3fff640 1 -- 172.21.15.19:0/2887160351 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2372194805 0 0) 0x7fabec0cf980 con 0x7fabec161a20 2024-09-12T02:02:03.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.419+0000 7fabf1d3c640 1 -- 172.21.15.19:0/2887160351 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabec0cfc20 con 0x7fabec0cf160 2024-09-12T02:02:03.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.420+0000 7fabf1d3c640 1 --2- 172.21.15.19:0/2887160351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabec0cf160 0x7fabec06d810 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fabec06c7d0 tx=0x7fabe402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d70ca18fa1fdf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:03.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.420+0000 7fabe3fff640 1 -- 172.21.15.19:0/2887160351 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe4007740 con 0x7fabec0cf160 2024-09-12T02:02:03.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.420+0000 7fabe3fff640 1 -- 172.21.15.19:0/2887160351 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe40078e0 con 0x7fabec0cf160 2024-09-12T02:02:03.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.420+0000 7fabe3fff640 1 -- 172.21.15.19:0/2887160351 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe4007cb0 con 0x7fabec0cf160 2024-09-12T02:02:03.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.420+0000 7fabf379f640 1 -- 172.21.15.19:0/2887160351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabec0cf160 msgr2=0x7fabec06d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:03.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.420+0000 7fabf379f640 1 --2- 172.21.15.19:0/2887160351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabec0cf160 0x7fabec06d810 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fabec06c7d0 tx=0x7fabe402a680 comp rx=0 tx=0).stop 2024-09-12T02:02:03.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.420+0000 7fabf379f640 1 -- 172.21.15.19:0/2887160351 shutdown_connections 2024-09-12T02:02:03.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.420+0000 7fabf379f640 1 --2- 172.21.15.19:0/2887160351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabec0cf160 0x7fabec06d810 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:03.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.420+0000 7fabf379f640 1 --2- 172.21.15.19:0/2887160351 >> v2:172.21.15.135:3300/0 conn(0x7fabec0d15f0 0x7fabec0cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:03.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.420+0000 7fabf379f640 1 -- 172.21.15.19:0/2887160351 >> 172.21.15.19:0/2887160351 conn(0x7fabec09d850 msgr2=0x7fabec08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:03.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.421+0000 7fabf379f640 1 -- 172.21.15.19:0/2887160351 shutdown_connections 2024-09-12T02:02:03.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.421+0000 7fabf379f640 1 -- 172.21.15.19:0/2887160351 wait complete. 2024-09-12T02:02:03.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.422+0000 7fabf379f640 1 Processor -- start 2024-09-12T02:02:03.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.422+0000 7fabf379f640 1 -- start start 2024-09-12T02:02:03.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf379f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabec0cf160 0x7fabec152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:03.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf379f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabec0d15f0 0x7fabec159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:03.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf379f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabec161a20 0x7fabec15a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:03.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf379f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fabec0b1040 con 0x7fabec0cf160 2024-09-12T02:02:03.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf379f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fabec06d2f0 con 0x7fabec161a20 2024-09-12T02:02:03.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf379f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fabec0cf590 con 0x7fabec0d15f0 2024-09-12T02:02:03.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf153b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabec0cf160 0x7fabec152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:03.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf153b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabec0cf160 0x7fabec152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48198/0 (socket says 172.21.15.19:48198) 2024-09-12T02:02:03.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf153b640 1 -- 172.21.15.19:0/4202288287 learned_addr learned my addr 172.21.15.19:0/4202288287 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:03.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf0d3a640 1 --2- 172.21.15.19:0/4202288287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabec0d15f0 0x7fabec159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:03.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf1d3c640 1 --2- 172.21.15.19:0/4202288287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabec161a20 0x7fabec15a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:03.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf153b640 1 -- 172.21.15.19:0/4202288287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabec0d15f0 msgr2=0x7fabec159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:03.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf153b640 1 --2- 172.21.15.19:0/4202288287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabec0d15f0 0x7fabec159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:03.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf153b640 1 -- 172.21.15.19:0/4202288287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabec161a20 msgr2=0x7fabec15a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:03.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf153b640 1 --2- 172.21.15.19:0/4202288287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabec161a20 0x7fabec15a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:03.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf153b640 1 -- 172.21.15.19:0/4202288287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabec0b9ae0 con 0x7fabec0cf160 2024-09-12T02:02:03.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf0d3a640 1 --2- 172.21.15.19:0/4202288287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabec0d15f0 0x7fabec159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:03.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf153b640 1 --2- 172.21.15.19:0/4202288287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabec0cf160 0x7fabec152ae0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fabe800c400 tx=0x7fabe800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:03.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabe1ffb640 1 -- 172.21.15.19:0/4202288287 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8017070 con 0x7fabec0cf160 2024-09-12T02:02:03.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabe1ffb640 1 -- 172.21.15.19:0/4202288287 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe8005ce0 con 0x7fabec0cf160 2024-09-12T02:02:03.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabf379f640 1 -- 172.21.15.19:0/4202288287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabec0b9dc0 con 0x7fabec0cf160 2024-09-12T02:02:03.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.423+0000 7fabe1ffb640 1 -- 172.21.15.19:0/4202288287 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8007310 con 0x7fabec0cf160 2024-09-12T02:02:03.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.424+0000 7fabf379f640 1 -- 172.21.15.19:0/4202288287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabec0b7530 con 0x7fabec0cf160 2024-09-12T02:02:03.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.425+0000 7fabf379f640 1 -- 172.21.15.19:0/4202288287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabec0b7320 con 0x7fabec0cf160 2024-09-12T02:02:03.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.425+0000 7fabe1ffb640 1 -- 172.21.15.19:0/4202288287 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fabe801a070 con 0x7fabec0cf160 2024-09-12T02:02:03.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.426+0000 7fabe1ffb640 1 --2- 172.21.15.19:0/4202288287 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabd006be60 0x7fabd006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:03.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.426+0000 7fabe1ffb640 1 -- 172.21.15.19:0/4202288287 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5835+0+0 (secure 0 0 0) 0x7fabe808a2b0 con 0x7fabec0cf160 2024-09-12T02:02:03.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.426+0000 7fabf0d3a640 1 --2- 172.21.15.19:0/4202288287 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabd006be60 0x7fabd006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:03.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.426+0000 7fabf0d3a640 1 --2- 172.21.15.19:0/4202288287 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabd006be60 0x7fabd006e320 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fabec0cb330 tx=0x7fabdc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:03.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.430+0000 7fabe1ffb640 1 -- 172.21.15.19:0/4202288287 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fabe8058c70 con 0x7fabec0cf160 2024-09-12T02:02:03.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:03.603+0000 7fabf379f640 1 -- 172.21.15.19:0/4202288287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fabec0cec20 con 0x7fabec0cf160 2024-09-12T02:02:04.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.290+0000 7fabe1ffb640 1 -- 172.21.15.19:0/4202288287 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) ==== 169+0+0 (secure 0 0 0) 0x7fabe8058570 con 0x7fabec0cf160 2024-09-12T02:02:04.289 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-09-12T02:02:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.293+0000 7fabf379f640 1 -- 172.21.15.19:0/4202288287 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabd006be60 msgr2=0x7fabd006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.293+0000 7fabf379f640 1 --2- 172.21.15.19:0/4202288287 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabd006be60 0x7fabd006e320 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fabec0cb330 tx=0x7fabdc008040 comp rx=0 tx=0).stop 2024-09-12T02:02:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.293+0000 7fabf379f640 1 -- 172.21.15.19:0/4202288287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabec0cf160 msgr2=0x7fabec152ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.293+0000 7fabf379f640 1 --2- 172.21.15.19:0/4202288287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabec0cf160 0x7fabec152ae0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fabe800c400 tx=0x7fabe800c8c0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.293+0000 7fabf379f640 1 -- 172.21.15.19:0/4202288287 shutdown_connections 2024-09-12T02:02:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.293+0000 7fabf379f640 1 --2- 172.21.15.19:0/4202288287 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabd006be60 0x7fabd006e320 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.293+0000 7fabf379f640 1 --2- 172.21.15.19:0/4202288287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabec161a20 0x7fabec15a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.293+0000 7fabf379f640 1 --2- 172.21.15.19:0/4202288287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabec0d15f0 0x7fabec159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.293+0000 7fabf379f640 1 --2- 172.21.15.19:0/4202288287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabec0cf160 0x7fabec152ae0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.293+0000 7fabf379f640 1 -- 172.21.15.19:0/4202288287 >> 172.21.15.19:0/4202288287 conn(0x7fabec09d850 msgr2=0x7fabec06e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.293+0000 7fabf379f640 1 -- 172.21.15.19:0/4202288287 shutdown_connections 2024-09-12T02:02:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.293+0000 7fabf379f640 1 -- 172.21.15.19:0/4202288287 wait complete. 2024-09-12T02:02:04.310 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_inject_rename_corrupt_dentry_first 2024-09-12T02:02:04.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.421+0000 7fa19a053640 1 Processor -- start 2024-09-12T02:02:04.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.421+0000 7fa19a053640 1 -- start start 2024-09-12T02:02:04.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.422+0000 7fa19a053640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa19415c620 0x7fa19409b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:04.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.422+0000 7fa19a053640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1940b67a0 0x7fa1940b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:04.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.422+0000 7fa19a053640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1940b6c00 con 0x7fa19409aa30 2024-09-12T02:02:04.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.422+0000 7fa19a053640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa1940b0600 con 0x7fa19415c620 2024-09-12T02:02:04.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.422+0000 7fa19a053640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa1940afcd0 con 0x7fa1940b67a0 2024-09-12T02:02:04.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.422+0000 7fa1937fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa19415c620 0x7fa19409b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:04.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.422+0000 7fa1937fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa19415c620 0x7fa19409b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48208/0 (socket says 172.21.15.19:48208) 2024-09-12T02:02:04.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.422+0000 7fa1937fe640 1 -- 172.21.15.19:0/724108632 learned_addr learned my addr 172.21.15.19:0/724108632 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:04.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.422+0000 7fa192ffd640 1 --2- 172.21.15.19:0/724108632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1940b67a0 0x7fa1940b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:04.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.422+0000 7fa1937fe640 1 -- 172.21.15.19:0/724108632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1940b67a0 msgr2=0x7fa1940b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:04.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.422+0000 7fa1937fe640 1 --2- 172.21.15.19:0/724108632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1940b67a0 0x7fa1940b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.422+0000 7fa1937fe640 1 -- 172.21.15.19:0/724108632 >> v1:172.21.15.135:6789/0 conn(0x7fa19409aa30 legacy=0x7fa19406fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:04.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.422+0000 7fa1937fe640 1 -- 172.21.15.19:0/724108632 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1940affb0 con 0x7fa19415c620 2024-09-12T02:02:04.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.423+0000 7fa1937fe640 1 --2- 172.21.15.19:0/724108632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa19415c620 0x7fa19409b9c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fa184009870 tx=0x7fa18402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca781aea7c812775 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:04.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.423+0000 7fa1927fc640 1 -- 172.21.15.19:0/724108632 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184037070 con 0x7fa19415c620 2024-09-12T02:02:04.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.423+0000 7fa1927fc640 1 -- 172.21.15.19:0/724108632 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa184032440 con 0x7fa19415c620 2024-09-12T02:02:04.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.423+0000 7fa1927fc640 1 -- 172.21.15.19:0/724108632 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184032810 con 0x7fa19415c620 2024-09-12T02:02:04.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.424+0000 7fa19a053640 1 -- 172.21.15.19:0/724108632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa19415c620 msgr2=0x7fa19409b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:04.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.424+0000 7fa19a053640 1 --2- 172.21.15.19:0/724108632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa19415c620 0x7fa19409b9c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fa184009870 tx=0x7fa18402a210 comp rx=0 tx=0).stop 2024-09-12T02:02:04.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.424+0000 7fa19a053640 1 -- 172.21.15.19:0/724108632 shutdown_connections 2024-09-12T02:02:04.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.424+0000 7fa19a053640 1 --2- 172.21.15.19:0/724108632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1940b67a0 0x7fa1940b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.424+0000 7fa19a053640 1 --2- 172.21.15.19:0/724108632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa19415c620 0x7fa19409b9c0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.424+0000 7fa19a053640 1 -- 172.21.15.19:0/724108632 >> 172.21.15.19:0/724108632 conn(0x7fa1940b79e0 msgr2=0x7fa1940b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:04.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.424+0000 7fa19a053640 1 -- 172.21.15.19:0/724108632 shutdown_connections 2024-09-12T02:02:04.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.424+0000 7fa19a053640 1 -- 172.21.15.19:0/724108632 wait complete. 2024-09-12T02:02:04.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.425+0000 7fa19a053640 1 Processor -- start 2024-09-12T02:02:04.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.425+0000 7fa19a053640 1 -- start start 2024-09-12T02:02:04.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.426+0000 7fa19a053640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa19409aa30 0x7fa1941f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:04.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.426+0000 7fa19a053640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1940b67a0 0x7fa19414e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:04.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.426+0000 7fa19a053640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa194150f60 0x7fa19415b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.426+0000 7fa19a053640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa1940af980 con 0x7fa1940b67a0 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.426+0000 7fa19a053640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa1940b17a0 con 0x7fa19409aa30 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.426+0000 7fa19a053640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa1940b0fd0 con 0x7fa194150f60 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.426+0000 7fa192ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1940b67a0 0x7fa19414e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.426+0000 7fa192ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1940b67a0 0x7fa19414e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48210/0 (socket says 172.21.15.19:48210) 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.426+0000 7fa192ffd640 1 -- 172.21.15.19:0/1402162552 learned_addr learned my addr 172.21.15.19:0/1402162552 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.426+0000 7fa1937fe640 1 --2- 172.21.15.19:0/1402162552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa19409aa30 0x7fa1941f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.426+0000 7fa193fff640 1 --2- 172.21.15.19:0/1402162552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa194150f60 0x7fa19415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.427+0000 7fa192ffd640 1 -- 172.21.15.19:0/1402162552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa194150f60 msgr2=0x7fa19415b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.427+0000 7fa192ffd640 1 --2- 172.21.15.19:0/1402162552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa194150f60 0x7fa19415b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.427+0000 7fa192ffd640 1 -- 172.21.15.19:0/1402162552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa19409aa30 msgr2=0x7fa1941f21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.427+0000 7fa192ffd640 1 --2- 172.21.15.19:0/1402162552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa19409aa30 0x7fa1941f21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.427+0000 7fa192ffd640 1 -- 172.21.15.19:0/1402162552 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa194151500 con 0x7fa1940b67a0 2024-09-12T02:02:04.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.427+0000 7fa192ffd640 1 --2- 172.21.15.19:0/1402162552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1940b67a0 0x7fa19414e930 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fa18800d830 tx=0x7fa18800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:04.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.427+0000 7fa17bfff640 1 -- 172.21.15.19:0/1402162552 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18800b6c0 con 0x7fa1940b67a0 2024-09-12T02:02:04.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.427+0000 7fa17bfff640 1 -- 172.21.15.19:0/1402162552 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa188019070 con 0x7fa1940b67a0 2024-09-12T02:02:04.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.427+0000 7fa19a053640 1 -- 172.21.15.19:0/1402162552 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1941517e0 con 0x7fa1940b67a0 2024-09-12T02:02:04.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.427+0000 7fa17bfff640 1 -- 172.21.15.19:0/1402162552 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18800ba80 con 0x7fa1940b67a0 2024-09-12T02:02:04.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.427+0000 7fa19a053640 1 -- 172.21.15.19:0/1402162552 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa194158f80 con 0x7fa1940b67a0 2024-09-12T02:02:04.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.428+0000 7fa19a053640 1 -- 172.21.15.19:0/1402162552 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1940ceb80 con 0x7fa1940b67a0 2024-09-12T02:02:04.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.428+0000 7fa17bfff640 1 -- 172.21.15.19:0/1402162552 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa18801e460 con 0x7fa1940b67a0 2024-09-12T02:02:04.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.429+0000 7fa17bfff640 1 --2- 172.21.15.19:0/1402162552 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa18006be30 0x7fa18006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:04.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.429+0000 7fa17bfff640 1 -- 172.21.15.19:0/1402162552 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5421+0+0 (secure 0 0 0) 0x7fa18808b2f0 con 0x7fa1940b67a0 2024-09-12T02:02:04.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.429+0000 7fa1937fe640 1 --2- 172.21.15.19:0/1402162552 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa18006be30 0x7fa18006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:04.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.430+0000 7fa1937fe640 1 --2- 172.21.15.19:0/1402162552 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa18006be30 0x7fa18006e2f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa184034000 tx=0x7fa18402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:04.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.433+0000 7fa17bfff640 1 -- 172.21.15.19:0/1402162552 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa188059770 con 0x7fa1940b67a0 2024-09-12T02:02:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.607+0000 7fa19a053640 1 -- 172.21.15.19:0/1402162552 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"} v 0) -- 0x7fa19409b7a0 con 0x7fa1940b67a0 2024-09-12T02:02:04.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.607+0000 7fa17bfff640 1 -- 172.21.15.19:0/1402162552 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"}]=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7fa18808b110 con 0x7fa1940b67a0 2024-09-12T02:02:04.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.609+0000 7fa19a053640 1 -- 172.21.15.19:0/1402162552 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa18006be30 msgr2=0x7fa18006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:04.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.609+0000 7fa19a053640 1 --2- 172.21.15.19:0/1402162552 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa18006be30 0x7fa18006e2f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa184034000 tx=0x7fa18402e000 comp rx=0 tx=0).stop 2024-09-12T02:02:04.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.609+0000 7fa19a053640 1 -- 172.21.15.19:0/1402162552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1940b67a0 msgr2=0x7fa19414e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:04.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.609+0000 7fa19a053640 1 --2- 172.21.15.19:0/1402162552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1940b67a0 0x7fa19414e930 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fa18800d830 tx=0x7fa18800dcf0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.609+0000 7fa19a053640 1 -- 172.21.15.19:0/1402162552 shutdown_connections 2024-09-12T02:02:04.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.609+0000 7fa19a053640 1 --2- 172.21.15.19:0/1402162552 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa18006be30 0x7fa18006e2f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.609+0000 7fa19a053640 1 --2- 172.21.15.19:0/1402162552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa194150f60 0x7fa19415b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.609+0000 7fa19a053640 1 --2- 172.21.15.19:0/1402162552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1940b67a0 0x7fa19414e930 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.609+0000 7fa19a053640 1 --2- 172.21.15.19:0/1402162552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa19409aa30 0x7fa1941f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.609+0000 7fa19a053640 1 -- 172.21.15.19:0/1402162552 >> 172.21.15.19:0/1402162552 conn(0x7fa1940b79e0 msgr2=0x7fa1941e66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:04.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.609+0000 7fa19a053640 1 -- 172.21.15.19:0/1402162552 shutdown_connections 2024-09-12T02:02:04.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.609+0000 7fa19a053640 1 -- 172.21.15.19:0/1402162552 wait complete. 2024-09-12T02:02:04.619 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:02:04.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.724+0000 7ffa40554640 1 Processor -- start 2024-09-12T02:02:04.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.724+0000 7ffa40554640 1 -- start start 2024-09-12T02:02:04.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.725+0000 7ffa40554640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffa38162e30 0x7ffa3806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:04.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.725+0000 7ffa40554640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffa380cf280 0x7ffa380d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:04.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.725+0000 7ffa40554640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa3815ff70 con 0x7ffa38162340 2024-09-12T02:02:04.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.725+0000 7ffa40554640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ffa3806de90 con 0x7ffa38162e30 2024-09-12T02:02:04.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.725+0000 7ffa40554640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ffa38163270 con 0x7ffa380cf280 2024-09-12T02:02:04.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.726+0000 7ffa3daef640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffa38162e30 0x7ffa3806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:04.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.726+0000 7ffa3e2f0640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ffa38162340 0x7ffa38162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52234/0 (socket says 172.21.15.19:52234) 2024-09-12T02:02:04.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.726+0000 7ffa3daef640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffa38162e30 0x7ffa3806d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48214/0 (socket says 172.21.15.19:48214) 2024-09-12T02:02:04.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.726+0000 7ffa3e2f0640 1 -- 172.21.15.19:0/1512931653 learned_addr learned my addr 172.21.15.19:0/1512931653 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:04.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.726+0000 7ffa3eaf1640 1 --2- 172.21.15.19:0/1512931653 >> v2:172.21.15.135:3300/0 conn(0x7ffa380cf280 0x7ffa380d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:04.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.726+0000 7ffa3daef640 1 -- 172.21.15.19:0/1512931653 >> v2:172.21.15.135:3300/0 conn(0x7ffa380cf280 msgr2=0x7ffa380d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:04.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.726+0000 7ffa3daef640 1 --2- 172.21.15.19:0/1512931653 >> v2:172.21.15.135:3300/0 conn(0x7ffa380cf280 0x7ffa380d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.726+0000 7ffa3daef640 1 -- 172.21.15.19:0/1512931653 >> v1:172.21.15.19:6789/0 conn(0x7ffa38162340 legacy=0x7ffa38162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:04.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.726+0000 7ffa3daef640 1 -- 172.21.15.19:0/1512931653 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa380d4d10 con 0x7ffa38162e30 2024-09-12T02:02:04.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.727+0000 7ffa3daef640 1 --2- 172.21.15.19:0/1512931653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa38162e30 0x7ffa3806d740 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7ffa3806c3d0 tx=0x7ffa2802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d3a658894fc242 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:04.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.727+0000 7ffa3d2ee640 1 -- 172.21.15.19:0/1512931653 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa28037070 con 0x7ffa38162e30 2024-09-12T02:02:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.727+0000 7ffa3d2ee640 1 -- 172.21.15.19:0/1512931653 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa28032440 con 0x7ffa38162e30 2024-09-12T02:02:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.727+0000 7ffa3d2ee640 1 -- 172.21.15.19:0/1512931653 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2802ae60 con 0x7ffa38162e30 2024-09-12T02:02:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.727+0000 7ffa40554640 1 -- 172.21.15.19:0/1512931653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa38162e30 msgr2=0x7ffa3806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.727+0000 7ffa40554640 1 --2- 172.21.15.19:0/1512931653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa38162e30 0x7ffa3806d740 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7ffa3806c3d0 tx=0x7ffa2802a110 comp rx=0 tx=0).stop 2024-09-12T02:02:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.727+0000 7ffa40554640 1 -- 172.21.15.19:0/1512931653 shutdown_connections 2024-09-12T02:02:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.727+0000 7ffa40554640 1 --2- 172.21.15.19:0/1512931653 >> v2:172.21.15.135:3300/0 conn(0x7ffa380cf280 0x7ffa380d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.727+0000 7ffa40554640 1 --2- 172.21.15.19:0/1512931653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa38162e30 0x7ffa3806d740 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.727+0000 7ffa40554640 1 -- 172.21.15.19:0/1512931653 >> 172.21.15.19:0/1512931653 conn(0x7ffa3808bfc0 msgr2=0x7ffa380d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.727+0000 7ffa40554640 1 -- 172.21.15.19:0/1512931653 shutdown_connections 2024-09-12T02:02:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.727+0000 7ffa40554640 1 -- 172.21.15.19:0/1512931653 wait complete. 2024-09-12T02:02:04.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.729+0000 7ffa40554640 1 Processor -- start 2024-09-12T02:02:04.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.729+0000 7ffa40554640 1 -- start start 2024-09-12T02:02:04.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.729+0000 7ffa40554640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa380cf280 0x7ffa38159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:04.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.729+0000 7ffa40554640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa38162340 0x7ffa380b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:04.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.729+0000 7ffa40554640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa38162e30 0x7ffa380b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:04.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.729+0000 7ffa40554640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ffa380cf6f0 con 0x7ffa380cf280 2024-09-12T02:02:04.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.729+0000 7ffa40554640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffa380d2470 con 0x7ffa38162340 2024-09-12T02:02:04.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.729+0000 7ffa40554640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ffa380d52d0 con 0x7ffa38162e30 2024-09-12T02:02:04.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.730+0000 7ffa3e2f0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa380cf280 0x7ffa38159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:04.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.730+0000 7ffa3e2f0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa380cf280 0x7ffa38159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48228/0 (socket says 172.21.15.19:48228) 2024-09-12T02:02:04.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.730+0000 7ffa3e2f0640 1 -- 172.21.15.19:0/1219933906 learned_addr learned my addr 172.21.15.19:0/1219933906 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:04.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.730+0000 7ffa3daef640 1 --2- 172.21.15.19:0/1219933906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa38162340 0x7ffa380b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:04.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.730+0000 7ffa3eaf1640 1 --2- 172.21.15.19:0/1219933906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa38162e30 0x7ffa380b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:04.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.730+0000 7ffa3e2f0640 1 -- 172.21.15.19:0/1219933906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa38162e30 msgr2=0x7ffa380b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:04.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.730+0000 7ffa3e2f0640 1 --2- 172.21.15.19:0/1219933906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa38162e30 0x7ffa380b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.730+0000 7ffa3e2f0640 1 -- 172.21.15.19:0/1219933906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa38162340 msgr2=0x7ffa380b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:04.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.730+0000 7ffa3e2f0640 1 --2- 172.21.15.19:0/1219933906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa38162340 0x7ffa380b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.730+0000 7ffa3e2f0640 1 -- 172.21.15.19:0/1219933906 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa380b5dc0 con 0x7ffa380cf280 2024-09-12T02:02:04.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.730+0000 7ffa3daef640 1 --2- 172.21.15.19:0/1219933906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa38162340 0x7ffa380b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:04.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.730+0000 7ffa3eaf1640 1 --2- 172.21.15.19:0/1219933906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa38162e30 0x7ffa380b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:04.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.730+0000 7ffa3e2f0640 1 --2- 172.21.15.19:0/1219933906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa380cf280 0x7ffa38159350 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400c400 tx=0x7ffa3400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:04.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.730+0000 7ffa2effd640 1 -- 172.21.15.19:0/1219933906 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34017070 con 0x7ffa380cf280 2024-09-12T02:02:04.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.730+0000 7ffa2effd640 1 -- 172.21.15.19:0/1219933906 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa34005ce0 con 0x7ffa380cf280 2024-09-12T02:02:04.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.730+0000 7ffa2effd640 1 -- 172.21.15.19:0/1219933906 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa340072f0 con 0x7ffa380cf280 2024-09-12T02:02:04.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.730+0000 7ffa40554640 1 -- 172.21.15.19:0/1219933906 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa380b60a0 con 0x7ffa380cf280 2024-09-12T02:02:04.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.730+0000 7ffa40554640 1 -- 172.21.15.19:0/1219933906 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa380b7680 con 0x7ffa380cf280 2024-09-12T02:02:04.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.731+0000 7ffa40554640 1 -- 172.21.15.19:0/1219933906 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa380b2b60 con 0x7ffa380cf280 2024-09-12T02:02:04.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.732+0000 7ffa2effd640 1 -- 172.21.15.19:0/1219933906 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa3401a070 con 0x7ffa380cf280 2024-09-12T02:02:04.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.732+0000 7ffa2effd640 1 --2- 172.21.15.19:0/1219933906 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffa1c06be30 0x7ffa1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:04.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.732+0000 7ffa2effd640 1 -- 172.21.15.19:0/1219933906 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5421+0+0 (secure 0 0 0) 0x7ffa3408a170 con 0x7ffa380cf280 2024-09-12T02:02:04.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.733+0000 7ffa3daef640 1 --2- 172.21.15.19:0/1219933906 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffa1c06be30 0x7ffa1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:04.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.733+0000 7ffa3daef640 1 --2- 172.21.15.19:0/1219933906 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffa1c06be30 0x7ffa1c06e2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ffa28034000 tx=0x7ffa2802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:04.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.737+0000 7ffa2effd640 1 -- 172.21.15.19:0/1219933906 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa380b2b60 con 0x7ffa380cf280 2024-09-12T02:02:04.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.922+0000 7ffa40554640 1 -- 172.21.15.19:0/1219933906 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7ffa3806d740 con 0x7ffa380cf280 2024-09-12T02:02:04.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.925+0000 7ffa2effd640 1 -- 172.21.15.19:0/1219933906 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7ffa34058c40 con 0x7ffa380cf280 2024-09-12T02:02:04.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.927+0000 7ffa40554640 1 -- 172.21.15.19:0/1219933906 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffa1c06be30 msgr2=0x7ffa1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:04.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.927+0000 7ffa40554640 1 --2- 172.21.15.19:0/1219933906 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffa1c06be30 0x7ffa1c06e2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ffa28034000 tx=0x7ffa2802e000 comp rx=0 tx=0).stop 2024-09-12T02:02:04.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.927+0000 7ffa40554640 1 -- 172.21.15.19:0/1219933906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa380cf280 msgr2=0x7ffa38159350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.927+0000 7ffa40554640 1 --2- 172.21.15.19:0/1219933906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa380cf280 0x7ffa38159350 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400c400 tx=0x7ffa3400c8c0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.927+0000 7ffa40554640 1 -- 172.21.15.19:0/1219933906 shutdown_connections 2024-09-12T02:02:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.927+0000 7ffa40554640 1 --2- 172.21.15.19:0/1219933906 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffa1c06be30 0x7ffa1c06e2f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.927+0000 7ffa40554640 1 --2- 172.21.15.19:0/1219933906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa38162e30 0x7ffa380b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.927+0000 7ffa40554640 1 --2- 172.21.15.19:0/1219933906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa38162340 0x7ffa380b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.927+0000 7ffa40554640 1 --2- 172.21.15.19:0/1219933906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa380cf280 0x7ffa38159350 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.927+0000 7ffa40554640 1 -- 172.21.15.19:0/1219933906 >> 172.21.15.19:0/1219933906 conn(0x7ffa3808bfc0 msgr2=0x7ffa3806e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.927+0000 7ffa40554640 1 -- 172.21.15.19:0/1219933906 shutdown_connections 2024-09-12T02:02:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:04.927+0000 7ffa40554640 1 -- 172.21.15.19:0/1219933906 wait complete. 2024-09-12T02:02:04.937 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_preflush' 2024-09-12T02:02:05.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.041+0000 7f4beb0ba640 1 Processor -- start 2024-09-12T02:02:05.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.041+0000 7f4beb0ba640 1 -- start start 2024-09-12T02:02:05.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.041+0000 7f4beb0ba640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4be409b140 0x7f4be4071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.041+0000 7f4beb0ba640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4be409ba30 con 0x7f4be415fc30 2024-09-12T02:02:05.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.041+0000 7f4beb0ba640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4be409bcf0 con 0x7f4be40b17d0 2024-09-12T02:02:05.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.041+0000 7f4beb0ba640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f4be40b1590 con 0x7f4be409b140 2024-09-12T02:02:05.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be8e56640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4be415fc30 0x7f4be409aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52238/0 (socket says 172.21.15.19:52238) 2024-09-12T02:02:05.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be8e56640 1 -- 172.21.15.19:0/1081425431 learned_addr learned my addr 172.21.15.19:0/1081425431 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:05.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be37fe640 1 -- 172.21.15.19:0/1081425431 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3744016251 0 0) 0x7f4be409ba30 con 0x7f4be415fc30 2024-09-12T02:02:05.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be37fe640 1 -- 172.21.15.19:0/1081425431 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bcc003520 con 0x7f4be415fc30 2024-09-12T02:02:05.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be3fff640 1 --2- 172.21.15.19:0/1081425431 >> v2:172.21.15.135:3300/0 conn(0x7f4be409b140 0x7f4be4071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be37fe640 1 -- 172.21.15.19:0/1081425431 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3869008974 0 0) 0x7f4bcc003520 con 0x7f4be415fc30 2024-09-12T02:02:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be37fe640 1 -- 172.21.15.19:0/1081425431 >> v2:172.21.15.135:3300/0 conn(0x7f4be409b140 msgr2=0x7f4be4071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be37fe640 1 --2- 172.21.15.19:0/1081425431 >> v2:172.21.15.135:3300/0 conn(0x7f4be409b140 0x7f4be4071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be37fe640 1 -- 172.21.15.19:0/1081425431 >> v1:172.21.15.135:6789/0 conn(0x7f4be40b17d0 legacy=0x7f4be40704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be37fe640 1 -- 172.21.15.19:0/1081425431 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be4160d00 con 0x7f4be415fc30 2024-09-12T02:02:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be37fe640 1 -- 172.21.15.19:0/1081425431 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f4bd4001670 con 0x7f4be415fc30 2024-09-12T02:02:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be37fe640 1 -- 172.21.15.19:0/1081425431 >> v1:172.21.15.19:6789/0 conn(0x7f4be415fc30 legacy=0x7f4be409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be37fe640 1 --2- 172.21.15.19:0/1081425431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bcc0039b0 0x7f4bcc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be37fe640 1 --2- 172.21.15.19:0/1081425431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bcc004800 0x7f4bcc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be37fe640 1 --2- 172.21.15.19:0/1081425431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bcc0052e0 0x7f4bcc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be37fe640 1 -- 172.21.15.19:0/1081425431 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4be40b1590 con 0x7f4bcc0039b0 2024-09-12T02:02:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be37fe640 1 -- 172.21.15.19:0/1081425431 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc00c1b0 con 0x7f4bcc004800 2024-09-12T02:02:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be37fe640 1 -- 172.21.15.19:0/1081425431 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4bcc00c3b0 con 0x7f4bcc0052e0 2024-09-12T02:02:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be8e56640 1 --2- 172.21.15.19:0/1081425431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bcc0039b0 0x7f4bcc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be3fff640 1 --2- 172.21.15.19:0/1081425431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bcc004800 0x7f4bcc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.042+0000 7f4be9657640 1 --2- 172.21.15.19:0/1081425431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bcc0052e0 0x7f4bcc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.043+0000 7f4be8e56640 1 -- 172.21.15.19:0/1081425431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bcc0052e0 msgr2=0x7f4bcc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.043+0000 7f4be8e56640 1 --2- 172.21.15.19:0/1081425431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bcc0052e0 0x7f4bcc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.043+0000 7f4be8e56640 1 -- 172.21.15.19:0/1081425431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bcc004800 msgr2=0x7f4bcc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.043+0000 7f4be8e56640 1 --2- 172.21.15.19:0/1081425431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bcc004800 0x7f4bcc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.043+0000 7f4be8e56640 1 -- 172.21.15.19:0/1081425431 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bcc003520 con 0x7f4bcc0039b0 2024-09-12T02:02:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.043+0000 7f4be9657640 1 -- 172.21.15.19:0/1081425431 reap_dead start 2024-09-12T02:02:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.043+0000 7f4be8e56640 1 --2- 172.21.15.19:0/1081425431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bcc0039b0 0x7f4bcc003dd0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400c210 tx=0x7f4bcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207cb24b33488f4d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.044+0000 7f4be37fe640 1 -- 172.21.15.19:0/1081425431 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4007d10 con 0x7f4bcc0039b0 2024-09-12T02:02:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.044+0000 7f4be37fe640 1 -- 172.21.15.19:0/1081425431 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd4005ad0 con 0x7f4bcc0039b0 2024-09-12T02:02:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.044+0000 7f4be37fe640 1 -- 172.21.15.19:0/1081425431 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4007070 con 0x7f4bcc0039b0 2024-09-12T02:02:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.044+0000 7f4beb0ba640 1 -- 172.21.15.19:0/1081425431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bcc0039b0 msgr2=0x7f4bcc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.044+0000 7f4beb0ba640 1 --2- 172.21.15.19:0/1081425431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bcc0039b0 0x7f4bcc003dd0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400c210 tx=0x7f4bcc005830 comp rx=0 tx=0).stop 2024-09-12T02:02:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.044+0000 7f4beb0ba640 1 -- 172.21.15.19:0/1081425431 shutdown_connections 2024-09-12T02:02:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.044+0000 7f4beb0ba640 1 --2- 172.21.15.19:0/1081425431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bcc0039b0 0x7f4bcc003dd0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.044+0000 7f4beb0ba640 1 -- 172.21.15.19:0/1081425431 >> 172.21.15.19:0/1081425431 conn(0x7f4be40d23a0 msgr2=0x7f4be40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.044+0000 7f4beb0ba640 1 -- 172.21.15.19:0/1081425431 shutdown_connections 2024-09-12T02:02:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.044+0000 7f4beb0ba640 1 -- 172.21.15.19:0/1081425431 wait complete. 2024-09-12T02:02:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.045+0000 7f4beb0ba640 1 Processor -- start 2024-09-12T02:02:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.045+0000 7f4beb0ba640 1 -- start start 2024-09-12T02:02:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.046+0000 7f4beb0ba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bcc0039b0 0x7f4be414e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.046+0000 7f4beb0ba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4be415bae0 0x7f4be40b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.046+0000 7f4beb0ba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4be40b5950 0x7f4be40b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.046+0000 7f4beb0ba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4be40721d0 con 0x7f4bcc0039b0 2024-09-12T02:02:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.046+0000 7f4beb0ba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4be4072050 con 0x7f4be415bae0 2024-09-12T02:02:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.046+0000 7f4beb0ba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4be4160ab0 con 0x7f4be40b5950 2024-09-12T02:02:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.046+0000 7f4be8e56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bcc0039b0 0x7f4be414e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.046+0000 7f4be8e56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bcc0039b0 0x7f4be414e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48242/0 (socket says 172.21.15.19:48242) 2024-09-12T02:02:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.046+0000 7f4be8e56640 1 -- 172.21.15.19:0/4042408408 learned_addr learned my addr 172.21.15.19:0/4042408408 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.047+0000 7f4be3fff640 1 --2- 172.21.15.19:0/4042408408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4be415bae0 0x7f4be40b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.047+0000 7f4be8e56640 1 -- 172.21.15.19:0/4042408408 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4be40b5950 msgr2=0x7f4be40b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.047+0000 7f4be9657640 1 --2- 172.21.15.19:0/4042408408 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4be40b5950 0x7f4be40b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.047+0000 7f4be8e56640 1 --2- 172.21.15.19:0/4042408408 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4be40b5950 0x7f4be40b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.047+0000 7f4be8e56640 1 -- 172.21.15.19:0/4042408408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4be415bae0 msgr2=0x7f4be40b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.047+0000 7f4be8e56640 1 --2- 172.21.15.19:0/4042408408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4be415bae0 0x7f4be40b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.047+0000 7f4be8e56640 1 -- 172.21.15.19:0/4042408408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be414ed40 con 0x7f4bcc0039b0 2024-09-12T02:02:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.047+0000 7f4be3fff640 1 --2- 172.21.15.19:0/4042408408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4be415bae0 0x7f4be40b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.047+0000 7f4be9657640 1 --2- 172.21.15.19:0/4042408408 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4be40b5950 0x7f4be40b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.047+0000 7f4be8e56640 1 --2- 172.21.15.19:0/4042408408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bcc0039b0 0x7f4be414e800 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400c330 tx=0x7f4be409bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.047+0000 7f4be17fa640 1 -- 172.21.15.19:0/4042408408 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4041020 con 0x7f4bcc0039b0 2024-09-12T02:02:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.047+0000 7f4be17fa640 1 -- 172.21.15.19:0/4042408408 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd4038040 con 0x7f4bcc0039b0 2024-09-12T02:02:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.047+0000 7f4beb0ba640 1 -- 172.21.15.19:0/4042408408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be415ec00 con 0x7f4bcc0039b0 2024-09-12T02:02:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.047+0000 7f4be17fa640 1 -- 172.21.15.19:0/4042408408 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4007270 con 0x7f4bcc0039b0 2024-09-12T02:02:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.047+0000 7f4beb0ba640 1 -- 172.21.15.19:0/4042408408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be41e6510 con 0x7f4bcc0039b0 2024-09-12T02:02:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.048+0000 7f4beb0ba640 1 -- 172.21.15.19:0/4042408408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be4068ea0 con 0x7f4bcc0039b0 2024-09-12T02:02:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.048+0000 7f4be17fa640 1 -- 172.21.15.19:0/4042408408 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4bd4044020 con 0x7f4bcc0039b0 2024-09-12T02:02:05.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.049+0000 7f4be17fa640 1 --2- 172.21.15.19:0/4042408408 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4bd006be60 0x7f4bd006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.049+0000 7f4be17fa640 1 -- 172.21.15.19:0/4042408408 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5421+0+0 (secure 0 0 0) 0x7f4bd40ab0a0 con 0x7f4bcc0039b0 2024-09-12T02:02:05.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.049+0000 7f4be3fff640 1 --2- 172.21.15.19:0/4042408408 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4bd006be60 0x7f4bd006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.050+0000 7f4be3fff640 1 --2- 172.21.15.19:0/4042408408 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4bd006be60 0x7f4bd006e320 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4be41f5f30 tx=0x7f4bd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:05.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.054+0000 7f4be17fa640 1 -- 172.21.15.19:0/4042408408 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4bd4001630 con 0x7f4bcc0039b0 2024-09-12T02:02:05.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:05.302+0000 7f4beb0ba640 1 -- 172.21.15.19:0/4042408408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_preflush"]} v 0) -- 0x7f4be40b8320 con 0x7f4bcc0039b0 2024-09-12T02:02:06.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.299+0000 7f4be17fa640 1 -- 172.21.15.19:0/4042408408 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_preflush"]}]=0 v296) ==== 141+0+0 (secure 0 0 0) 0x7f4bd4079b70 con 0x7f4bcc0039b0 2024-09-12T02:02:06.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.302+0000 7f4beb0ba640 1 -- 172.21.15.19:0/4042408408 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4bd006be60 msgr2=0x7f4bd006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:06.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.302+0000 7f4beb0ba640 1 --2- 172.21.15.19:0/4042408408 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4bd006be60 0x7f4bd006e320 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4be41f5f30 tx=0x7f4bd8008040 comp rx=0 tx=0).stop 2024-09-12T02:02:06.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.302+0000 7f4beb0ba640 1 -- 172.21.15.19:0/4042408408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bcc0039b0 msgr2=0x7f4be414e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:06.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.302+0000 7f4beb0ba640 1 --2- 172.21.15.19:0/4042408408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bcc0039b0 0x7f4be414e800 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400c330 tx=0x7f4be409bec0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.303+0000 7f4beb0ba640 1 -- 172.21.15.19:0/4042408408 shutdown_connections 2024-09-12T02:02:06.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.303+0000 7f4beb0ba640 1 --2- 172.21.15.19:0/4042408408 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4bd006be60 0x7f4bd006e320 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.303+0000 7f4beb0ba640 1 --2- 172.21.15.19:0/4042408408 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4be40b5950 0x7f4be40b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.303+0000 7f4beb0ba640 1 --2- 172.21.15.19:0/4042408408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4be415bae0 0x7f4be40b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.303+0000 7f4beb0ba640 1 --2- 172.21.15.19:0/4042408408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bcc0039b0 0x7f4be414e800 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.303+0000 7f4beb0ba640 1 -- 172.21.15.19:0/4042408408 >> 172.21.15.19:0/4042408408 conn(0x7f4be40d23a0 msgr2=0x7f4be40ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:06.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.303+0000 7f4beb0ba640 1 -- 172.21.15.19:0/4042408408 shutdown_connections 2024-09-12T02:02:06.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.303+0000 7f4beb0ba640 1 -- 172.21.15.19:0/4042408408 wait complete. 2024-09-12T02:02:06.316 INFO:tasks.cephfs_test_runner:That the MDS won't write a dentry with new damage to CDentry::first ... ok 2024-09-12T02:02:06.316 INFO:tasks.cephfs_test_runner:Starting test: test_object_deletion (tasks.cephfs.test_damage.TestDamage) That the MDS has a clean 'damaged' response to loss of any single metadata object 2024-09-12T02:02:06.316 INFO:tasks.cephfs_test_runner:test_object_deletion (tasks.cephfs.test_damage.TestDamage) 2024-09-12T02:02:06.317 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:02:06.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.426+0000 7fbaf4166640 1 Processor -- start 2024-09-12T02:02:06.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.426+0000 7fbaf4166640 1 -- start start 2024-09-12T02:02:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.427+0000 7fbaf4166640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbaec15e760 0x7fbaec06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.427+0000 7fbaf4166640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbaec0d4fd0 0x7fbaec0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.427+0000 7fbaf4166640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaec0d2700 con 0x7fbaec0b3650 2024-09-12T02:02:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.427+0000 7fbaf4166640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fbaec0cedb0 con 0x7fbaec0d4fd0 2024-09-12T02:02:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.427+0000 7fbaf4166640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbaec0cf090 con 0x7fbaec15e760 2024-09-12T02:02:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.427+0000 7fbaf2703640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbaec0b3650 0x7fbaec0d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52240/0 (socket says 172.21.15.19:52240) 2024-09-12T02:02:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.427+0000 7fbaf2703640 1 -- 172.21.15.19:0/3065675875 learned_addr learned my addr 172.21.15.19:0/3065675875 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.428+0000 7fbaf1701640 1 --2- 172.21.15.19:0/3065675875 >> v2:172.21.15.135:3300/0 conn(0x7fbaec0d4fd0 0x7fbaec0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.428+0000 7fbaf1f02640 1 --2- 172.21.15.19:0/3065675875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbaec15e760 0x7fbaec06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.428+0000 7fbaf0f00640 1 -- 172.21.15.19:0/3065675875 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1976357277 0 0) 0x7fbae4001490 con 0x7fbaec0b3650 2024-09-12T02:02:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.428+0000 7fbaf0f00640 1 -- 172.21.15.19:0/3065675875 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbad8003520 con 0x7fbaec0b3650 2024-09-12T02:02:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.428+0000 7fbaf0f00640 1 -- 172.21.15.19:0/3065675875 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1082186948 0 0) 0x7fbad8003520 con 0x7fbaec0b3650 2024-09-12T02:02:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.428+0000 7fbaf1f02640 1 -- 172.21.15.19:0/3065675875 >> v2:172.21.15.135:3300/0 conn(0x7fbaec0d4fd0 msgr2=0x7fbaec0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:06.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.428+0000 7fbaf1f02640 1 --2- 172.21.15.19:0/3065675875 >> v2:172.21.15.135:3300/0 conn(0x7fbaec0d4fd0 0x7fbaec0cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.428+0000 7fbaf1f02640 1 -- 172.21.15.19:0/3065675875 >> v1:172.21.15.19:6789/0 conn(0x7fbaec0b3650 legacy=0x7fbaec0d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:06.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.428+0000 7fbaf1f02640 1 -- 172.21.15.19:0/3065675875 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaec0b3c80 con 0x7fbaec15e760 2024-09-12T02:02:06.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.428+0000 7fbaf1701640 1 --2- 172.21.15.19:0/3065675875 >> v2:172.21.15.135:3300/0 conn(0x7fbaec0d4fd0 0x7fbaec0cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:06.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.429+0000 7fbaf1f02640 1 --2- 172.21.15.19:0/3065675875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbaec15e760 0x7fbaec06cdd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbae80097a0 tx=0x7fbae802a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bda16d83ebb703dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:06.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.429+0000 7fbaf0f00640 1 -- 172.21.15.19:0/3065675875 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8037070 con 0x7fbaec15e760 2024-09-12T02:02:06.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.429+0000 7fbaf0f00640 1 -- 172.21.15.19:0/3065675875 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae802ab10 con 0x7fbaec15e760 2024-09-12T02:02:06.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.429+0000 7fbaf0f00640 1 -- 172.21.15.19:0/3065675875 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae4001bc0 con 0x7fbaec15e760 2024-09-12T02:02:06.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.429+0000 7fbaf4166640 1 -- 172.21.15.19:0/3065675875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbaec15e760 msgr2=0x7fbaec06cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:06.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.429+0000 7fbaf4166640 1 --2- 172.21.15.19:0/3065675875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbaec15e760 0x7fbaec06cdd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbae80097a0 tx=0x7fbae802a080 comp rx=0 tx=0).stop 2024-09-12T02:02:06.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.429+0000 7fbaf4166640 1 -- 172.21.15.19:0/3065675875 shutdown_connections 2024-09-12T02:02:06.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.430+0000 7fbaf4166640 1 --2- 172.21.15.19:0/3065675875 >> v2:172.21.15.135:3300/0 conn(0x7fbaec0d4fd0 0x7fbaec0cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.430+0000 7fbaf4166640 1 --2- 172.21.15.19:0/3065675875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbaec15e760 0x7fbaec06cdd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.430+0000 7fbaf4166640 1 -- 172.21.15.19:0/3065675875 >> 172.21.15.19:0/3065675875 conn(0x7fbaec08bfc0 msgr2=0x7fbaec0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:06.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.430+0000 7fbaf4166640 1 -- 172.21.15.19:0/3065675875 shutdown_connections 2024-09-12T02:02:06.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.430+0000 7fbaf4166640 1 -- 172.21.15.19:0/3065675875 wait complete. 2024-09-12T02:02:06.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.431+0000 7fbaf4166640 1 Processor -- start 2024-09-12T02:02:06.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.431+0000 7fbaf4166640 1 -- start start 2024-09-12T02:02:06.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.432+0000 7fbaf4166640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbaec0b3650 0x7fbaec158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:06.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.432+0000 7fbaf4166640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbaec0d4fd0 0x7fbaec0b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:06.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.432+0000 7fbaf4166640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaec15e760 0x7fbaec15cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:06.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.432+0000 7fbaf4166640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbaec0cfe80 con 0x7fbaec15e760 2024-09-12T02:02:06.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.432+0000 7fbaf4166640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbaec0cfd00 con 0x7fbaec0d4fd0 2024-09-12T02:02:06.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.432+0000 7fbaf4166640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbaec0d35b0 con 0x7fbaec0b3650 2024-09-12T02:02:06.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.432+0000 7fbaf2703640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaec15e760 0x7fbaec15cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.432+0000 7fbaf2703640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaec15e760 0x7fbaec15cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48256/0 (socket says 172.21.15.19:48256) 2024-09-12T02:02:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.432+0000 7fbaf2703640 1 -- 172.21.15.19:0/1543744795 learned_addr learned my addr 172.21.15.19:0/1543744795 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.432+0000 7fbaf1701640 1 --2- 172.21.15.19:0/1543744795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbaec0d4fd0 0x7fbaec0b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.432+0000 7fbaf1f02640 1 --2- 172.21.15.19:0/1543744795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbaec0b3650 0x7fbaec158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.432+0000 7fbaf2703640 1 -- 172.21.15.19:0/1543744795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbaec0b3650 msgr2=0x7fbaec158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.432+0000 7fbaf2703640 1 --2- 172.21.15.19:0/1543744795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbaec0b3650 0x7fbaec158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.432+0000 7fbaf2703640 1 -- 172.21.15.19:0/1543744795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbaec0d4fd0 msgr2=0x7fbaec0b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.432+0000 7fbaf2703640 1 --2- 172.21.15.19:0/1543744795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbaec0d4fd0 0x7fbaec0b7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.432+0000 7fbaf2703640 1 -- 172.21.15.19:0/1543744795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaec0b8510 con 0x7fbaec15e760 2024-09-12T02:02:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.432+0000 7fbaf2703640 1 --2- 172.21.15.19:0/1543744795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaec15e760 0x7fbaec15cf90 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fbae400cbc0 tx=0x7fbae400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.433+0000 7fbae27fc640 1 -- 172.21.15.19:0/1543744795 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae4017070 con 0x7fbaec15e760 2024-09-12T02:02:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.433+0000 7fbae27fc640 1 -- 172.21.15.19:0/1543744795 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae400ad40 con 0x7fbaec15e760 2024-09-12T02:02:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.433+0000 7fbae27fc640 1 -- 172.21.15.19:0/1543744795 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae4012640 con 0x7fbaec15e760 2024-09-12T02:02:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.433+0000 7fbaf4166640 1 -- 172.21.15.19:0/1543744795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaec0b87f0 con 0x7fbaec15e760 2024-09-12T02:02:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.433+0000 7fbaf4166640 1 -- 172.21.15.19:0/1543744795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaec0c94c0 con 0x7fbaec15e760 2024-09-12T02:02:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.434+0000 7fbaf4166640 1 -- 172.21.15.19:0/1543744795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaec0d3980 con 0x7fbaec15e760 2024-09-12T02:02:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.434+0000 7fbae27fc640 1 -- 172.21.15.19:0/1543744795 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbae401a070 con 0x7fbaec15e760 2024-09-12T02:02:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.435+0000 7fbae27fc640 1 --2- 172.21.15.19:0/1543744795 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbad006be30 0x7fbad006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.435+0000 7fbae27fc640 1 -- 172.21.15.19:0/1543744795 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5421+0+0 (secure 0 0 0) 0x7fbae408ab50 con 0x7fbaec15e760 2024-09-12T02:02:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.435+0000 7fbaf1f02640 1 --2- 172.21.15.19:0/1543744795 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbad006be30 0x7fbad006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.436+0000 7fbaf1f02640 1 --2- 172.21.15.19:0/1543744795 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbad006be30 0x7fbad006e2f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbae8034000 tx=0x7fbae802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.439+0000 7fbae27fc640 1 -- 172.21.15.19:0/1543744795 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbaec0d2700 con 0x7fbaec15e760 2024-09-12T02:02:06.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.615+0000 7fbaf4166640 1 -- 172.21.15.19:0/1543744795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbaec0b6d20 con 0x7fbaec15e760 2024-09-12T02:02:06.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.616+0000 7fbae27fc640 1 -- 172.21.15.19:0/1543744795 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+13424 (secure 0 0 0) 0x7fbae4058fd0 con 0x7fbaec15e760 2024-09-12T02:02:06.616 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:06.616 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":85,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:02:04.285520+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6834/836344045":"2024-09-13T02:02:01.278891+0000","172.21.15.19:6832/836344045":"2024-09-13T02:02:01.278891+0000","172.21.15.135:6836/1796121402":"2024-09-13T02:01:52.946892+0000","172.21.15.135:6834/1796121402":"2024-09-13T02:01:52.946892+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:02:06.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.618+0000 7fbaf4166640 1 -- 172.21.15.19:0/1543744795 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbad006be30 msgr2=0x7fbad006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:06.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.618+0000 7fbaf4166640 1 --2- 172.21.15.19:0/1543744795 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbad006be30 0x7fbad006e2f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbae8034000 tx=0x7fbae802e000 comp rx=0 tx=0).stop 2024-09-12T02:02:06.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.619+0000 7fbaf4166640 1 -- 172.21.15.19:0/1543744795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaec15e760 msgr2=0x7fbaec15cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:06.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.619+0000 7fbaf4166640 1 --2- 172.21.15.19:0/1543744795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaec15e760 0x7fbaec15cf90 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fbae400cbc0 tx=0x7fbae400a430 comp rx=0 tx=0).stop 2024-09-12T02:02:06.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.619+0000 7fbaf4166640 1 -- 172.21.15.19:0/1543744795 shutdown_connections 2024-09-12T02:02:06.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.619+0000 7fbaf4166640 1 --2- 172.21.15.19:0/1543744795 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbad006be30 0x7fbad006e2f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.619+0000 7fbaf4166640 1 --2- 172.21.15.19:0/1543744795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaec15e760 0x7fbaec15cf90 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.619+0000 7fbaf4166640 1 --2- 172.21.15.19:0/1543744795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbaec0d4fd0 0x7fbaec0b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.619+0000 7fbaf4166640 1 --2- 172.21.15.19:0/1543744795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbaec0b3650 0x7fbaec158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.619+0000 7fbaf4166640 1 -- 172.21.15.19:0/1543744795 >> 172.21.15.19:0/1543744795 conn(0x7fbaec08bfc0 msgr2=0x7fbaec0b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:06.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.619+0000 7fbaf4166640 1 -- 172.21.15.19:0/1543744795 shutdown_connections 2024-09-12T02:02:06.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.619+0000 7fbaf4166640 1 -- 172.21.15.19:0/1543744795 wait complete. 2024-09-12T02:02:06.629 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:55:44.127030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:02:06.630 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:02:06.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.736+0000 7ff7c6047640 1 Processor -- start 2024-09-12T02:02:06.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.736+0000 7ff7c6047640 1 -- start start 2024-09-12T02:02:06.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.737+0000 7ff7c6047640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7c015e5a0 0x7ff7c00cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:06.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.737+0000 7ff7c6047640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff7c015e980 0x7ff7c00d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:06.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.737+0000 7ff7c6047640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7c00d53f0 con 0x7ff7c00d0df0 2024-09-12T02:02:06.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.737+0000 7ff7c6047640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff7c006cd90 con 0x7ff7c015e980 2024-09-12T02:02:06.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.737+0000 7ff7c6047640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c006d070 con 0x7ff7c015e5a0 2024-09-12T02:02:06.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.737+0000 7ff7bf7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7c015e5a0 0x7ff7c00cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:06.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.737+0000 7ff7beffd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff7c015e980 0x7ff7c00d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:06.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.737+0000 7ff7bf7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7c015e5a0 0x7ff7c00cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:56440/0 (socket says 172.21.15.19:56440) 2024-09-12T02:02:06.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.737+0000 7ff7beffd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff7c015e980 0x7ff7c00d0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:35592/0 (socket says 172.21.15.19:35592) 2024-09-12T02:02:06.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.737+0000 7ff7bf7fe640 1 -- 172.21.15.19:0/855773093 learned_addr learned my addr 172.21.15.19:0/855773093 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:06.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.737+0000 7ff7bffff640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7ff7c00d0df0 0x7ff7c0162290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:45332/0 (socket says 172.21.15.19:45332) 2024-09-12T02:02:06.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.738+0000 7ff7beffd640 1 -- 172.21.15.19:0/855773093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7c015e5a0 msgr2=0x7ff7c00cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:06.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.738+0000 7ff7beffd640 1 --2- 172.21.15.19:0/855773093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7c015e5a0 0x7ff7c00cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.738+0000 7ff7beffd640 1 -- 172.21.15.19:0/855773093 >> v1:172.21.15.135:6789/0 conn(0x7ff7c00d0df0 legacy=0x7ff7c0162290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:06.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.738+0000 7ff7beffd640 1 -- 172.21.15.19:0/855773093 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c006d350 con 0x7ff7c015e980 2024-09-12T02:02:06.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.738+0000 7ff7be7fc640 1 -- 172.21.15.19:0/855773093 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3137843210 0 0) 0x7ff7c00d53f0 con 0x7ff7c00d0df0 2024-09-12T02:02:06.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.738+0000 7ff7bf7fe640 1 --2- 172.21.15.19:0/855773093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7c015e5a0 0x7ff7c00cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:06.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.739+0000 7ff7beffd640 1 --2- 172.21.15.19:0/855773093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7c015e980 0x7ff7c00d0210 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40097a0 tx=0x7ff7b402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=819ccb10b340820 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:06.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.739+0000 7ff7be7fc640 1 -- 172.21.15.19:0/855773093 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4037070 con 0x7ff7c015e980 2024-09-12T02:02:06.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.739+0000 7ff7be7fc640 1 -- 172.21.15.19:0/855773093 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b402ae50 con 0x7ff7c015e980 2024-09-12T02:02:06.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.739+0000 7ff7be7fc640 1 -- 172.21.15.19:0/855773093 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4032660 con 0x7ff7c015e980 2024-09-12T02:02:06.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.739+0000 7ff7c6047640 1 -- 172.21.15.19:0/855773093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7c015e980 msgr2=0x7ff7c00d0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:06.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.739+0000 7ff7c6047640 1 --2- 172.21.15.19:0/855773093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7c015e980 0x7ff7c00d0210 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40097a0 tx=0x7ff7b402a100 comp rx=0 tx=0).stop 2024-09-12T02:02:06.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.739+0000 7ff7c6047640 1 -- 172.21.15.19:0/855773093 shutdown_connections 2024-09-12T02:02:06.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.739+0000 7ff7c6047640 1 --2- 172.21.15.19:0/855773093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7c015e980 0x7ff7c00d0210 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.739+0000 7ff7c6047640 1 --2- 172.21.15.19:0/855773093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7c015e5a0 0x7ff7c00cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.739+0000 7ff7c6047640 1 -- 172.21.15.19:0/855773093 >> 172.21.15.19:0/855773093 conn(0x7ff7c008bfc0 msgr2=0x7ff7c00d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:06.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.740+0000 7ff7c6047640 1 -- 172.21.15.19:0/855773093 shutdown_connections 2024-09-12T02:02:06.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.740+0000 7ff7c6047640 1 -- 172.21.15.19:0/855773093 wait complete. 2024-09-12T02:02:06.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.741+0000 7ff7c6047640 1 Processor -- start 2024-09-12T02:02:06.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.741+0000 7ff7c6047640 1 -- start start 2024-09-12T02:02:06.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.742+0000 7ff7c6047640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7c00d0df0 0x7ff7c00ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:06.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.742+0000 7ff7c6047640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7c015e5a0 0x7ff7c00b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:06.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.742+0000 7ff7c6047640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7c015e980 0x7ff7c00b6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:06.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.742+0000 7ff7c6047640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c006de30 con 0x7ff7c00d0df0 2024-09-12T02:02:06.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.742+0000 7ff7c6047640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c006d910 con 0x7ff7c015e980 2024-09-12T02:02:06.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.742+0000 7ff7c6047640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c006dfb0 con 0x7ff7c015e5a0 2024-09-12T02:02:06.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.742+0000 7ff7bf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7c00d0df0 0x7ff7c00ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:06.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.742+0000 7ff7bf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7c00d0df0 0x7ff7c00ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48260/0 (socket says 172.21.15.19:48260) 2024-09-12T02:02:06.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.742+0000 7ff7bf7fe640 1 -- 172.21.15.19:0/1850394831 learned_addr learned my addr 172.21.15.19:0/1850394831 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:06.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.742+0000 7ff7beffd640 1 --2- 172.21.15.19:0/1850394831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7c015e5a0 0x7ff7c00b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:06.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.742+0000 7ff7bffff640 1 --2- 172.21.15.19:0/1850394831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7c015e980 0x7ff7c00b6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:06.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.742+0000 7ff7bf7fe640 1 -- 172.21.15.19:0/1850394831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7c015e5a0 msgr2=0x7ff7c00b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:06.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.742+0000 7ff7bf7fe640 1 --2- 172.21.15.19:0/1850394831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7c015e5a0 0x7ff7c00b64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.742+0000 7ff7bf7fe640 1 -- 172.21.15.19:0/1850394831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7c015e980 msgr2=0x7ff7c00b6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:06.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.742+0000 7ff7bf7fe640 1 --2- 172.21.15.19:0/1850394831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7c015e980 0x7ff7c00b6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.742+0000 7ff7bf7fe640 1 -- 172.21.15.19:0/1850394831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c0160770 con 0x7ff7c00d0df0 2024-09-12T02:02:06.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.742+0000 7ff7bf7fe640 1 --2- 172.21.15.19:0/1850394831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7c00d0df0 0x7ff7c00ca500 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000e9d0 tx=0x7ff7b000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:06.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.743+0000 7ff7a7fff640 1 -- 172.21.15.19:0/1850394831 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0017070 con 0x7ff7c00d0df0 2024-09-12T02:02:06.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.743+0000 7ff7a7fff640 1 -- 172.21.15.19:0/1850394831 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b000ca60 con 0x7ff7c00d0df0 2024-09-12T02:02:06.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.743+0000 7ff7c6047640 1 -- 172.21.15.19:0/1850394831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c0160a50 con 0x7ff7c00d0df0 2024-09-12T02:02:06.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.743+0000 7ff7a7fff640 1 -- 172.21.15.19:0/1850394831 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b000ce10 con 0x7ff7c00d0df0 2024-09-12T02:02:06.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.743+0000 7ff7c6047640 1 -- 172.21.15.19:0/1850394831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c0161010 con 0x7ff7c00d0df0 2024-09-12T02:02:06.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.744+0000 7ff7c6047640 1 -- 172.21.15.19:0/1850394831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c00d1260 con 0x7ff7c00d0df0 2024-09-12T02:02:06.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.744+0000 7ff7a7fff640 1 -- 172.21.15.19:0/1850394831 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff7b001a070 con 0x7ff7c00d0df0 2024-09-12T02:02:06.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.744+0000 7ff7a7fff640 1 --2- 172.21.15.19:0/1850394831 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff7ac06be30 0x7ff7ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:06.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.745+0000 7ff7a7fff640 1 -- 172.21.15.19:0/1850394831 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5421+0+0 (secure 0 0 0) 0x7ff7b008b000 con 0x7ff7c00d0df0 2024-09-12T02:02:06.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.745+0000 7ff7beffd640 1 --2- 172.21.15.19:0/1850394831 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff7ac06be30 0x7ff7ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:06.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.745+0000 7ff7beffd640 1 --2- 172.21.15.19:0/1850394831 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff7ac06be30 0x7ff7ac06e2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4034000 tx=0x7ff7b402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:06.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.749+0000 7ff7a7fff640 1 -- 172.21.15.19:0/1850394831 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff7b0059b60 con 0x7ff7c00d0df0 2024-09-12T02:02:06.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.923+0000 7ff7c6047640 1 -- 172.21.15.19:0/1850394831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff7c00b8860 con 0x7ff7c00d0df0 2024-09-12T02:02:06.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.924+0000 7ff7a7fff640 1 -- 172.21.15.19:0/1850394831 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) ==== 93+0+10 (secure 0 0 0) 0x7ff7b0059460 con 0x7ff7c00d0df0 2024-09-12T02:02:06.923 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-09-12T02:02:06.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.926+0000 7ff7c6047640 1 -- 172.21.15.19:0/1850394831 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff7ac06be30 msgr2=0x7ff7ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:06.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.926+0000 7ff7c6047640 1 --2- 172.21.15.19:0/1850394831 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff7ac06be30 0x7ff7ac06e2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4034000 tx=0x7ff7b402e000 comp rx=0 tx=0).stop 2024-09-12T02:02:06.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.926+0000 7ff7c6047640 1 -- 172.21.15.19:0/1850394831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7c00d0df0 msgr2=0x7ff7c00ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:06.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.926+0000 7ff7c6047640 1 --2- 172.21.15.19:0/1850394831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7c00d0df0 0x7ff7c00ca500 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000e9d0 tx=0x7ff7b000ee90 comp rx=0 tx=0).stop 2024-09-12T02:02:06.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.926+0000 7ff7c6047640 1 -- 172.21.15.19:0/1850394831 shutdown_connections 2024-09-12T02:02:06.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.926+0000 7ff7c6047640 1 --2- 172.21.15.19:0/1850394831 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff7ac06be30 0x7ff7ac06e2f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.926+0000 7ff7c6047640 1 --2- 172.21.15.19:0/1850394831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7c015e980 0x7ff7c00b6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.926+0000 7ff7c6047640 1 --2- 172.21.15.19:0/1850394831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7c015e5a0 0x7ff7c00b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.926+0000 7ff7c6047640 1 --2- 172.21.15.19:0/1850394831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7c00d0df0 0x7ff7c00ca500 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:06.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.926+0000 7ff7c6047640 1 -- 172.21.15.19:0/1850394831 >> 172.21.15.19:0/1850394831 conn(0x7ff7c008bfc0 msgr2=0x7ff7c00cfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:06.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.926+0000 7ff7c6047640 1 -- 172.21.15.19:0/1850394831 shutdown_connections 2024-09-12T02:02:06.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:06.926+0000 7ff7c6047640 1 -- 172.21.15.19:0/1850394831 wait complete. 2024-09-12T02:02:06.936 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_damage.TestDamage.test_object_deletion' 2024-09-12T02:02:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.040+0000 7f9d7ac94640 1 Processor -- start 2024-09-12T02:02:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.040+0000 7f9d7ac94640 1 -- start start 2024-09-12T02:02:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.041+0000 7f9d7ac94640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d740cfcc0 0x7f9d7406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.041+0000 7f9d7ac94640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d740d2700 con 0x7f9d740d4fd0 2024-09-12T02:02:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.041+0000 7f9d7ac94640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d740cedb0 con 0x7f9d7415e760 2024-09-12T02:02:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.041+0000 7f9d7ac94640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9d740cf090 con 0x7f9d740cfcc0 2024-09-12T02:02:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.041+0000 7f9d79231640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9d740d4fd0 0x7f9d740d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52244/0 (socket says 172.21.15.19:52244) 2024-09-12T02:02:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.041+0000 7f9d79231640 1 -- 172.21.15.19:0/3722767646 learned_addr learned my addr 172.21.15.19:0/3722767646 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.041+0000 7f9d73fff640 1 --2- 172.21.15.19:0/3722767646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d740cfcc0 0x7f9d7406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.041+0000 7f9d737fe640 1 -- 172.21.15.19:0/3722767646 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 687298106 0 0) 0x7f9d6c001490 con 0x7f9d740d4fd0 2024-09-12T02:02:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.041+0000 7f9d737fe640 1 -- 172.21.15.19:0/3722767646 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d64003520 con 0x7f9d740d4fd0 2024-09-12T02:02:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.041+0000 7f9d737fe640 1 -- 172.21.15.19:0/3722767646 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3151074020 0 0) 0x7f9d740cedb0 con 0x7f9d7415e760 2024-09-12T02:02:07.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.041+0000 7f9d737fe640 1 -- 172.21.15.19:0/3722767646 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d6c001490 con 0x7f9d7415e760 2024-09-12T02:02:07.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.041+0000 7f9d73fff640 1 -- 172.21.15.19:0/3722767646 >> v1:172.21.15.135:6789/0 conn(0x7f9d7415e760 legacy=0x7f9d740cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:07.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.041+0000 7f9d73fff640 1 -- 172.21.15.19:0/3722767646 >> v1:172.21.15.19:6789/0 conn(0x7f9d740d4fd0 legacy=0x7f9d740d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:07.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.041+0000 7f9d73fff640 1 -- 172.21.15.19:0/3722767646 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d740b3c80 con 0x7f9d740cfcc0 2024-09-12T02:02:07.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.042+0000 7f9d73fff640 1 --2- 172.21.15.19:0/3722767646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d740cfcc0 0x7f9d7406cdd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9d600097c0 tx=0x7f9d6002a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71e4905e61f3d3e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:07.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.042+0000 7f9d737fe640 1 -- 172.21.15.19:0/3722767646 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60037070 con 0x7f9d740cfcc0 2024-09-12T02:02:07.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.042+0000 7f9d737fe640 1 -- 172.21.15.19:0/3722767646 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d60032440 con 0x7f9d740cfcc0 2024-09-12T02:02:07.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.042+0000 7f9d737fe640 1 -- 172.21.15.19:0/3722767646 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60032810 con 0x7f9d740cfcc0 2024-09-12T02:02:07.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.043+0000 7f9d7ac94640 1 -- 172.21.15.19:0/3722767646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d740cfcc0 msgr2=0x7f9d7406cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:07.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.043+0000 7f9d7ac94640 1 --2- 172.21.15.19:0/3722767646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d740cfcc0 0x7f9d7406cdd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9d600097c0 tx=0x7f9d6002a200 comp rx=0 tx=0).stop 2024-09-12T02:02:07.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.043+0000 7f9d7ac94640 1 -- 172.21.15.19:0/3722767646 shutdown_connections 2024-09-12T02:02:07.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.043+0000 7f9d7ac94640 1 --2- 172.21.15.19:0/3722767646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d740cfcc0 0x7f9d7406cdd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.043+0000 7f9d7ac94640 1 -- 172.21.15.19:0/3722767646 >> 172.21.15.19:0/3722767646 conn(0x7f9d7408bfc0 msgr2=0x7f9d740d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:07.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.043+0000 7f9d7ac94640 1 -- 172.21.15.19:0/3722767646 shutdown_connections 2024-09-12T02:02:07.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.043+0000 7f9d7ac94640 1 -- 172.21.15.19:0/3722767646 wait complete. 2024-09-12T02:02:07.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.044+0000 7f9d7ac94640 1 Processor -- start 2024-09-12T02:02:07.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.044+0000 7f9d7ac94640 1 -- start start 2024-09-12T02:02:07.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.045+0000 7f9d7ac94640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d740cfcc0 0x7f9d740cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:07.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.045+0000 7f9d7ac94640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d740d4fd0 0x7f9d740caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:07.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.045+0000 7f9d7ac94640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d7415e760 0x7f9d740b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.045+0000 7f9d7ac94640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9d740d35b0 con 0x7f9d740cfcc0 2024-09-12T02:02:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.045+0000 7f9d7ac94640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d740b38a0 con 0x7f9d7415e760 2024-09-12T02:02:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.045+0000 7f9d7ac94640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9d740d3730 con 0x7f9d740d4fd0 2024-09-12T02:02:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.045+0000 7f9d78a30640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d740cfcc0 0x7f9d740cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.045+0000 7f9d78a30640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d740cfcc0 0x7f9d740cdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48274/0 (socket says 172.21.15.19:48274) 2024-09-12T02:02:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.045+0000 7f9d78a30640 1 -- 172.21.15.19:0/3531075524 learned_addr learned my addr 172.21.15.19:0/3531075524 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.045+0000 7f9d73fff640 1 --2- 172.21.15.19:0/3531075524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d740d4fd0 0x7f9d740caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.045+0000 7f9d79231640 1 --2- 172.21.15.19:0/3531075524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d7415e760 0x7f9d740b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.045+0000 7f9d78a30640 1 -- 172.21.15.19:0/3531075524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d740d4fd0 msgr2=0x7f9d740caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.045+0000 7f9d78a30640 1 --2- 172.21.15.19:0/3531075524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d740d4fd0 0x7f9d740caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.045+0000 7f9d78a30640 1 -- 172.21.15.19:0/3531075524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d7415e760 msgr2=0x7f9d740b74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.045+0000 7f9d78a30640 1 --2- 172.21.15.19:0/3531075524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d7415e760 0x7f9d740b74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.046+0000 7f9d78a30640 1 -- 172.21.15.19:0/3531075524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d740ccc30 con 0x7f9d740cfcc0 2024-09-12T02:02:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.046+0000 7f9d78a30640 1 --2- 172.21.15.19:0/3531075524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d740cfcc0 0x7f9d740cdcd0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800c430 tx=0x7f9d6800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.046+0000 7f9d717fa640 1 -- 172.21.15.19:0/3531075524 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68017070 con 0x7f9d740cfcc0 2024-09-12T02:02:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.046+0000 7f9d717fa640 1 -- 172.21.15.19:0/3531075524 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d680052f0 con 0x7f9d740cfcc0 2024-09-12T02:02:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.046+0000 7f9d7ac94640 1 -- 172.21.15.19:0/3531075524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d740ccf10 con 0x7f9d740cfcc0 2024-09-12T02:02:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.046+0000 7f9d717fa640 1 -- 172.21.15.19:0/3531075524 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68003830 con 0x7f9d740cfcc0 2024-09-12T02:02:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.046+0000 7f9d7ac94640 1 -- 172.21.15.19:0/3531075524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d740cd4d0 con 0x7f9d740cfcc0 2024-09-12T02:02:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.047+0000 7f9d7ac94640 1 -- 172.21.15.19:0/3531075524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d740cedb0 con 0x7f9d740cfcc0 2024-09-12T02:02:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.047+0000 7f9d717fa640 1 -- 172.21.15.19:0/3531075524 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d6801a070 con 0x7f9d740cfcc0 2024-09-12T02:02:07.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.048+0000 7f9d717fa640 1 --2- 172.21.15.19:0/3531075524 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9d5806be30 0x7f9d5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:07.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.048+0000 7f9d717fa640 1 -- 172.21.15.19:0/3531075524 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5421+0+0 (secure 0 0 0) 0x7f9d6808a120 con 0x7f9d740cfcc0 2024-09-12T02:02:07.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.048+0000 7f9d73fff640 1 --2- 172.21.15.19:0/3531075524 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9d5806be30 0x7f9d5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:07.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.049+0000 7f9d73fff640 1 --2- 172.21.15.19:0/3531075524 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9d5806be30 0x7f9d5806e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9d60034000 tx=0x7f9d6002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:07.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.052+0000 7f9d717fa640 1 -- 172.21.15.19:0/3531075524 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9d68058500 con 0x7f9d740cfcc0 2024-09-12T02:02:07.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.298+0000 7f9d7ac94640 1 -- 172.21.15.19:0/3531075524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_object_deletion"]} v 0) -- 0x7f9d740b6d20 con 0x7f9d740cfcc0 2024-09-12T02:02:07.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.300+0000 7f9d717fa640 1 -- 172.21.15.19:0/3531075524 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_object_deletion"]}]=0 v297) ==== 138+0+0 (secure 0 0 0) 0x7f9d6805c800 con 0x7f9d740cfcc0 2024-09-12T02:02:07.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.302+0000 7f9d7ac94640 1 -- 172.21.15.19:0/3531075524 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9d5806be30 msgr2=0x7f9d5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:07.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.302+0000 7f9d7ac94640 1 --2- 172.21.15.19:0/3531075524 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9d5806be30 0x7f9d5806e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9d60034000 tx=0x7f9d6002e000 comp rx=0 tx=0).stop 2024-09-12T02:02:07.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.302+0000 7f9d7ac94640 1 -- 172.21.15.19:0/3531075524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d740cfcc0 msgr2=0x7f9d740cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:07.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.302+0000 7f9d7ac94640 1 --2- 172.21.15.19:0/3531075524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d740cfcc0 0x7f9d740cdcd0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800c430 tx=0x7f9d6800c8f0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.302+0000 7f9d7ac94640 1 -- 172.21.15.19:0/3531075524 shutdown_connections 2024-09-12T02:02:07.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.302+0000 7f9d7ac94640 1 --2- 172.21.15.19:0/3531075524 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9d5806be30 0x7f9d5806e2f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.302+0000 7f9d7ac94640 1 --2- 172.21.15.19:0/3531075524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d7415e760 0x7f9d740b74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.302+0000 7f9d7ac94640 1 --2- 172.21.15.19:0/3531075524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d740d4fd0 0x7f9d740caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.302+0000 7f9d7ac94640 1 --2- 172.21.15.19:0/3531075524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d740cfcc0 0x7f9d740cdcd0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.302+0000 7f9d7ac94640 1 -- 172.21.15.19:0/3531075524 >> 172.21.15.19:0/3531075524 conn(0x7f9d7408bfc0 msgr2=0x7f9d740d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:07.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.302+0000 7f9d7ac94640 1 -- 172.21.15.19:0/3531075524 shutdown_connections 2024-09-12T02:02:07.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.302+0000 7f9d7ac94640 1 -- 172.21.15.19:0/3531075524 wait complete. 2024-09-12T02:02:07.312 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:02:07.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.418+0000 7fc02b4d9640 1 Processor -- start 2024-09-12T02:02:07.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.418+0000 7fc02b4d9640 1 -- start start 2024-09-12T02:02:07.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.419+0000 7fc02b4d9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc0240b5fe0 0x7fc0240aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:07.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.419+0000 7fc02b4d9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0240ae240 con 0x7fc02406bc10 2024-09-12T02:02:07.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.419+0000 7fc02b4d9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0240ae520 con 0x7fc02415e410 2024-09-12T02:02:07.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.419+0000 7fc02b4d9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fc0240b6430 con 0x7fc0240b5fe0 2024-09-12T02:02:07.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.419+0000 7fc028a74640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc0240b5fe0 0x7fc0240aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:07.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.419+0000 7fc028a74640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc0240b5fe0 0x7fc0240aff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48290/0 (socket says 172.21.15.19:48290) 2024-09-12T02:02:07.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.419+0000 7fc028a74640 1 -- 172.21.15.19:0/616891122 learned_addr learned my addr 172.21.15.19:0/616891122 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:07.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.419+0000 7fc029a76640 1 --1- 172.21.15.19:0/616891122 >> v1:172.21.15.19:6789/0 conn(0x7fc02406bc10 0x7fc0240aefe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52250/0 (socket says 172.21.15.19:52250) 2024-09-12T02:02:07.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.419+0000 7fc028a74640 1 -- 172.21.15.19:0/616891122 >> v1:172.21.15.135:6789/0 conn(0x7fc02415e410 legacy=0x7fc0240b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:07.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.419+0000 7fc028a74640 1 -- 172.21.15.19:0/616891122 >> v1:172.21.15.19:6789/0 conn(0x7fc02406bc10 legacy=0x7fc0240aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:07.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.419+0000 7fc017fff640 1 -- 172.21.15.19:0/616891122 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2899448502 0 0) 0x7fc0240ae240 con 0x7fc02406bc10 2024-09-12T02:02:07.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.419+0000 7fc028a74640 1 -- 172.21.15.19:0/616891122 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0240ae800 con 0x7fc0240b5fe0 2024-09-12T02:02:07.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.420+0000 7fc028a74640 1 --2- 172.21.15.19:0/616891122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0240b5fe0 0x7fc0240aff40 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc018009870 tx=0x7fc01802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f9bf30710b05e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:07.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.420+0000 7fc017fff640 1 -- 172.21.15.19:0/616891122 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc018037070 con 0x7fc0240b5fe0 2024-09-12T02:02:07.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.420+0000 7fc017fff640 1 -- 172.21.15.19:0/616891122 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc018032440 con 0x7fc0240b5fe0 2024-09-12T02:02:07.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.420+0000 7fc017fff640 1 -- 172.21.15.19:0/616891122 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc018032810 con 0x7fc0240b5fe0 2024-09-12T02:02:07.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.421+0000 7fc02b4d9640 1 -- 172.21.15.19:0/616891122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0240b5fe0 msgr2=0x7fc0240aff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:07.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.421+0000 7fc02b4d9640 1 --2- 172.21.15.19:0/616891122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0240b5fe0 0x7fc0240aff40 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc018009870 tx=0x7fc01802a210 comp rx=0 tx=0).stop 2024-09-12T02:02:07.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.421+0000 7fc02b4d9640 1 -- 172.21.15.19:0/616891122 shutdown_connections 2024-09-12T02:02:07.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.421+0000 7fc02b4d9640 1 --2- 172.21.15.19:0/616891122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0240b5fe0 0x7fc0240aff40 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.421+0000 7fc02b4d9640 1 -- 172.21.15.19:0/616891122 >> 172.21.15.19:0/616891122 conn(0x7fc02409aa30 msgr2=0x7fc0240b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:07.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.421+0000 7fc02b4d9640 1 -- 172.21.15.19:0/616891122 shutdown_connections 2024-09-12T02:02:07.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.421+0000 7fc02b4d9640 1 -- 172.21.15.19:0/616891122 wait complete. 2024-09-12T02:02:07.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.422+0000 7fc02b4d9640 1 Processor -- start 2024-09-12T02:02:07.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.422+0000 7fc02b4d9640 1 -- start start 2024-09-12T02:02:07.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc02b4d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc02406bc10 0x7fc024148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:07.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc02b4d9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0240b5fe0 0x7fc0240ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:07.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc02b4d9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc02415e410 0x7fc0240caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:07.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc02b4d9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc02415e7f0 con 0x7fc02406bc10 2024-09-12T02:02:07.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc02b4d9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc0240b0480 con 0x7fc02415e410 2024-09-12T02:02:07.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc02b4d9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc02415e970 con 0x7fc0240b5fe0 2024-09-12T02:02:07.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc029275640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc02406bc10 0x7fc024148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:07.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc029275640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc02406bc10 0x7fc024148b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48306/0 (socket says 172.21.15.19:48306) 2024-09-12T02:02:07.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc029275640 1 -- 172.21.15.19:0/901064909 learned_addr learned my addr 172.21.15.19:0/901064909 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:07.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc029275640 1 -- 172.21.15.19:0/901064909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0240b5fe0 msgr2=0x7fc0240ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:07.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc029275640 1 --2- 172.21.15.19:0/901064909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0240b5fe0 0x7fc0240ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc029275640 1 -- 172.21.15.19:0/901064909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc02415e410 msgr2=0x7fc0240caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:07.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc029a76640 1 --2- 172.21.15.19:0/901064909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc02415e410 0x7fc0240caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:07.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc029275640 1 --2- 172.21.15.19:0/901064909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc02415e410 0x7fc0240caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc029275640 1 -- 172.21.15.19:0/901064909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc024161050 con 0x7fc02406bc10 2024-09-12T02:02:07.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc029a76640 1 --2- 172.21.15.19:0/901064909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc02415e410 0x7fc0240caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:07.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc029275640 1 --2- 172.21.15.19:0/901064909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc02406bc10 0x7fc024148b30 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fc02000b3f0 tx=0x7fc02000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:07.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc015ffb640 1 -- 172.21.15.19:0/901064909 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc020015020 con 0x7fc02406bc10 2024-09-12T02:02:07.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc015ffb640 1 -- 172.21.15.19:0/901064909 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc020011830 con 0x7fc02406bc10 2024-09-12T02:02:07.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc015ffb640 1 -- 172.21.15.19:0/901064909 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc020011c20 con 0x7fc02406bc10 2024-09-12T02:02:07.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.423+0000 7fc02b4d9640 1 -- 172.21.15.19:0/901064909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc024161330 con 0x7fc02406bc10 2024-09-12T02:02:07.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.424+0000 7fc02b4d9640 1 -- 172.21.15.19:0/901064909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc024153260 con 0x7fc02406bc10 2024-09-12T02:02:07.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.425+0000 7fc02b4d9640 1 -- 172.21.15.19:0/901064909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0240aff40 con 0x7fc02406bc10 2024-09-12T02:02:07.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.425+0000 7fc015ffb640 1 -- 172.21.15.19:0/901064909 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc020018020 con 0x7fc02406bc10 2024-09-12T02:02:07.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.426+0000 7fc015ffb640 1 --2- 172.21.15.19:0/901064909 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc00806be30 0x7fc00806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:07.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.426+0000 7fc015ffb640 1 -- 172.21.15.19:0/901064909 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5421+0+0 (secure 0 0 0) 0x7fc02008aa00 con 0x7fc02406bc10 2024-09-12T02:02:07.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.426+0000 7fc028a74640 1 --2- 172.21.15.19:0/901064909 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc00806be30 0x7fc00806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:07.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.426+0000 7fc028a74640 1 --2- 172.21.15.19:0/901064909 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc00806be30 0x7fc00806e2f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc018034000 tx=0x7fc01802c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:07.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.430+0000 7fc015ffb640 1 -- 172.21.15.19:0/901064909 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc02001f030 con 0x7fc02406bc10 2024-09-12T02:02:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.603+0000 7fc02b4d9640 1 -- 172.21.15.19:0/901064909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc0240d1f70 con 0x7fc02406bc10 2024-09-12T02:02:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.608+0000 7fc015ffb640 1 -- 172.21.15.19:0/901064909 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7fc0200172c0 con 0x7fc02406bc10 2024-09-12T02:02:07.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.610+0000 7fc02b4d9640 1 -- 172.21.15.19:0/901064909 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc00806be30 msgr2=0x7fc00806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:07.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.610+0000 7fc02b4d9640 1 --2- 172.21.15.19:0/901064909 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc00806be30 0x7fc00806e2f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc018034000 tx=0x7fc01802c000 comp rx=0 tx=0).stop 2024-09-12T02:02:07.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.610+0000 7fc02b4d9640 1 -- 172.21.15.19:0/901064909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc02406bc10 msgr2=0x7fc024148b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:07.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.610+0000 7fc02b4d9640 1 --2- 172.21.15.19:0/901064909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc02406bc10 0x7fc024148b30 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fc02000b3f0 tx=0x7fc02000b8b0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.610+0000 7fc02b4d9640 1 -- 172.21.15.19:0/901064909 shutdown_connections 2024-09-12T02:02:07.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.610+0000 7fc02b4d9640 1 --2- 172.21.15.19:0/901064909 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc00806be30 0x7fc00806e2f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.610+0000 7fc02b4d9640 1 --2- 172.21.15.19:0/901064909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc02415e410 0x7fc0240caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.610+0000 7fc02b4d9640 1 --2- 172.21.15.19:0/901064909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0240b5fe0 0x7fc0240ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.610+0000 7fc02b4d9640 1 --2- 172.21.15.19:0/901064909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc02406bc10 0x7fc024148b30 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.610+0000 7fc02b4d9640 1 -- 172.21.15.19:0/901064909 >> 172.21.15.19:0/901064909 conn(0x7fc02409aa30 msgr2=0x7fc0240b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:07.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.610+0000 7fc02b4d9640 1 -- 172.21.15.19:0/901064909 shutdown_connections 2024-09-12T02:02:07.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.610+0000 7fc02b4d9640 1 -- 172.21.15.19:0/901064909 wait complete. 2024-09-12T02:02:07.621 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:02:07.621 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:02:07.658 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:02:07.706 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:02:07.706 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:02:07.707 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:02:07.723 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:02:07.723 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T02:02:07.723 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:02:07.740 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:02:07.740 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:02:07.740 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:02:07.779 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:02:07.780 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T02:02:07.780 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:02:07.797 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:02:07.797 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:02:07.798 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:07.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.923+0000 7fd946d42640 1 Processor -- start 2024-09-12T02:02:07.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.923+0000 7fd946d42640 1 -- start start 2024-09-12T02:02:07.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.923+0000 7fd946d42640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd94015b300 0x7fd9400cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:07.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.923+0000 7fd946d42640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9400cdbe0 con 0x7fd94006f8d0 2024-09-12T02:02:07.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.923+0000 7fd946d42640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9400cd900 con 0x7fd9400cd3f0 2024-09-12T02:02:07.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.923+0000 7fd946d42640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd9400728a0 con 0x7fd94015b300 2024-09-12T02:02:07.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd9452df640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd94006f8d0 0x7fd94015b6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52258/0 (socket says 172.21.15.19:52258) 2024-09-12T02:02:07.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd9452df640 1 -- 172.21.15.19:0/2638707976 learned_addr learned my addr 172.21.15.19:0/2638707976 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:07.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd944ade640 1 --2- 172.21.15.19:0/2638707976 >> v2:172.21.15.135:3300/0 conn(0x7fd94015b300 0x7fd9400cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:07.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd93f7fe640 1 -- 172.21.15.19:0/2638707976 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175997234 0 0) 0x7fd9400cdbe0 con 0x7fd94006f8d0 2024-09-12T02:02:07.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd93f7fe640 1 -- 172.21.15.19:0/2638707976 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd930003520 con 0x7fd94006f8d0 2024-09-12T02:02:07.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd93f7fe640 1 -- 172.21.15.19:0/2638707976 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3625571611 0 0) 0x7fd930003520 con 0x7fd94006f8d0 2024-09-12T02:02:07.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd93f7fe640 1 -- 172.21.15.19:0/2638707976 >> v2:172.21.15.135:3300/0 conn(0x7fd94015b300 msgr2=0x7fd9400cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:07.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd93f7fe640 1 --2- 172.21.15.19:0/2638707976 >> v2:172.21.15.135:3300/0 conn(0x7fd94015b300 0x7fd9400cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd93f7fe640 1 -- 172.21.15.19:0/2638707976 >> v1:172.21.15.135:6789/0 conn(0x7fd9400cd3f0 legacy=0x7fd94006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:07.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd93f7fe640 1 -- 172.21.15.19:0/2638707976 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd940072250 con 0x7fd94006f8d0 2024-09-12T02:02:07.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd93f7fe640 1 -- 172.21.15.19:0/2638707976 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fd9380019f0 con 0x7fd94006f8d0 2024-09-12T02:02:07.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd93f7fe640 1 -- 172.21.15.19:0/2638707976 >> v1:172.21.15.19:6789/0 conn(0x7fd94006f8d0 legacy=0x7fd94015b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:07.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd93f7fe640 1 --2- 172.21.15.19:0/2638707976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9300039b0 0x7fd930003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:07.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd93f7fe640 1 --2- 172.21.15.19:0/2638707976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd930004800 0x7fd930004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:07.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd93f7fe640 1 --2- 172.21.15.19:0/2638707976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9300051c0 0x7fd93000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:07.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd93f7fe640 1 -- 172.21.15.19:0/2638707976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd9400728a0 con 0x7fd930004800 2024-09-12T02:02:07.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd93f7fe640 1 -- 172.21.15.19:0/2638707976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd93000c060 con 0x7fd9300039b0 2024-09-12T02:02:07.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd93f7fe640 1 -- 172.21.15.19:0/2638707976 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd93000c260 con 0x7fd9300051c0 2024-09-12T02:02:07.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd93ffff640 1 --2- 172.21.15.19:0/2638707976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd930004800 0x7fd930004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:07.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.924+0000 7fd944ade640 1 --2- 172.21.15.19:0/2638707976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9300039b0 0x7fd930003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:07.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.925+0000 7fd9452df640 1 --2- 172.21.15.19:0/2638707976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9300051c0 0x7fd93000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:07.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.925+0000 7fd93ffff640 1 -- 172.21.15.19:0/2638707976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9300051c0 msgr2=0x7fd93000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:07.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.925+0000 7fd93ffff640 1 --2- 172.21.15.19:0/2638707976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9300051c0 0x7fd93000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.925+0000 7fd93ffff640 1 -- 172.21.15.19:0/2638707976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9300039b0 msgr2=0x7fd930003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:07.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.925+0000 7fd93ffff640 1 --2- 172.21.15.19:0/2638707976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9300039b0 0x7fd930003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.925+0000 7fd93ffff640 1 -- 172.21.15.19:0/2638707976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd930003520 con 0x7fd930004800 2024-09-12T02:02:07.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.925+0000 7fd9452df640 1 --2- 172.21.15.19:0/2638707976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9300051c0 0x7fd93000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:07.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.925+0000 7fd9452df640 1 -- 172.21.15.19:0/2638707976 reap_dead start 2024-09-12T02:02:07.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.925+0000 7fd93ffff640 1 --2- 172.21.15.19:0/2638707976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd930004800 0x7fd930004c80 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd92c001750 tx=0x7fd930005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1606864db49d14cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:07.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.926+0000 7fd93f7fe640 1 -- 172.21.15.19:0/2638707976 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c001370 con 0x7fd930004800 2024-09-12T02:02:07.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.926+0000 7fd93f7fe640 1 -- 172.21.15.19:0/2638707976 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c0052d0 con 0x7fd930004800 2024-09-12T02:02:07.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.926+0000 7fd93f7fe640 1 -- 172.21.15.19:0/2638707976 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c02abc0 con 0x7fd930004800 2024-09-12T02:02:07.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.926+0000 7fd946d42640 1 -- 172.21.15.19:0/2638707976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd930004800 msgr2=0x7fd930004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:07.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.926+0000 7fd946d42640 1 --2- 172.21.15.19:0/2638707976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd930004800 0x7fd930004c80 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd92c001750 tx=0x7fd930005830 comp rx=0 tx=0).stop 2024-09-12T02:02:07.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.926+0000 7fd946d42640 1 -- 172.21.15.19:0/2638707976 shutdown_connections 2024-09-12T02:02:07.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.926+0000 7fd946d42640 1 --2- 172.21.15.19:0/2638707976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd930004800 0x7fd930004c80 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.926+0000 7fd946d42640 1 -- 172.21.15.19:0/2638707976 >> 172.21.15.19:0/2638707976 conn(0x7fd940067d70 msgr2=0x7fd94006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:07.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.926+0000 7fd946d42640 1 -- 172.21.15.19:0/2638707976 shutdown_connections 2024-09-12T02:02:07.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.926+0000 7fd946d42640 1 -- 172.21.15.19:0/2638707976 wait complete. 2024-09-12T02:02:07.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.927+0000 7fd946d42640 1 Processor -- start 2024-09-12T02:02:07.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.927+0000 7fd946d42640 1 -- start start 2024-09-12T02:02:07.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.928+0000 7fd946d42640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd930004800 0x7fd9401428e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:07.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.928+0000 7fd946d42640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9400cc040 0x7fd940144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:07.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.928+0000 7fd946d42640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd940144b70 0x7fd940155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.928+0000 7fd946d42640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd9400d0160 con 0x7fd940144b70 2024-09-12T02:02:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.928+0000 7fd946d42640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9400cffe0 con 0x7fd930004800 2024-09-12T02:02:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.928+0000 7fd946d42640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd940072d30 con 0x7fd9400cc040 2024-09-12T02:02:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.928+0000 7fd9452df640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd940144b70 0x7fd940155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.928+0000 7fd9452df640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd940144b70 0x7fd940155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48320/0 (socket says 172.21.15.19:48320) 2024-09-12T02:02:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.928+0000 7fd9452df640 1 -- 172.21.15.19:0/3973997761 learned_addr learned my addr 172.21.15.19:0/3973997761 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.928+0000 7fd93ffff640 1 --2- 172.21.15.19:0/3973997761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9400cc040 0x7fd940144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.928+0000 7fd944ade640 1 --2- 172.21.15.19:0/3973997761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd930004800 0x7fd9401428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.929+0000 7fd9452df640 1 -- 172.21.15.19:0/3973997761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9400cc040 msgr2=0x7fd940144630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.929+0000 7fd9452df640 1 --2- 172.21.15.19:0/3973997761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9400cc040 0x7fd940144630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.929+0000 7fd9452df640 1 -- 172.21.15.19:0/3973997761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd930004800 msgr2=0x7fd9401428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.929+0000 7fd9452df640 1 --2- 172.21.15.19:0/3973997761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd930004800 0x7fd9401428e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.929+0000 7fd9452df640 1 -- 172.21.15.19:0/3973997761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd940142e20 con 0x7fd940144b70 2024-09-12T02:02:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.929+0000 7fd9452df640 1 --2- 172.21.15.19:0/3973997761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd940144b70 0x7fd940155040 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd94006c910 tx=0x7fd93800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.929+0000 7fd93d7fa640 1 -- 172.21.15.19:0/3973997761 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93800eb90 con 0x7fd940144b70 2024-09-12T02:02:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.929+0000 7fd93d7fa640 1 -- 172.21.15.19:0/3973997761 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd93800ed50 con 0x7fd940144b70 2024-09-12T02:02:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.929+0000 7fd93d7fa640 1 -- 172.21.15.19:0/3973997761 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd938014670 con 0x7fd940144b70 2024-09-12T02:02:07.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.929+0000 7fd946d42640 1 -- 172.21.15.19:0/3973997761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd940143590 con 0x7fd940144b70 2024-09-12T02:02:07.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.929+0000 7fd946d42640 1 -- 172.21.15.19:0/3973997761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd940143b50 con 0x7fd940144b70 2024-09-12T02:02:07.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.930+0000 7fd946d42640 1 -- 172.21.15.19:0/3973997761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9401e4860 con 0x7fd940144b70 2024-09-12T02:02:07.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.931+0000 7fd93d7fa640 1 -- 172.21.15.19:0/3973997761 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd938014810 con 0x7fd940144b70 2024-09-12T02:02:07.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.931+0000 7fd93d7fa640 1 --2- 172.21.15.19:0/3973997761 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd92406be30 0x7fd92406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:07.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.931+0000 7fd93d7fa640 1 -- 172.21.15.19:0/3973997761 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5421+0+0 (secure 0 0 0) 0x7fd93808aa20 con 0x7fd940144b70 2024-09-12T02:02:07.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.931+0000 7fd944ade640 1 --2- 172.21.15.19:0/3973997761 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd92406be30 0x7fd92406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:07.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.932+0000 7fd944ade640 1 --2- 172.21.15.19:0/3973997761 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd92406be30 0x7fd92406e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd934009c40 tx=0x7fd934009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:07.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:07.936+0000 7fd93d7fa640 1 -- 172.21.15.19:0/3973997761 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd938058e10 con 0x7fd940144b70 2024-09-12T02:02:08.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.148+0000 7fd946d42640 1 -- 172.21.15.19:0/3973997761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9401e4580 con 0x7fd940144b70 2024-09-12T02:02:08.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.149+0000 7fd93d7fa640 1 -- 172.21.15.19:0/3973997761 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+3917 (secure 0 0 0) 0x7fd93805d110 con 0x7fd940144b70 2024-09-12T02:02:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:08.148 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":71,"btime":"2024-09-12T02:02:02:280478+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1065573429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1065573429},{"type":"v1","addr":"172.21.15.19:6835","nonce":1065573429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3905709264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":3905709264},{"type":"v1","addr":"172.21.15.135:6837","nonce":3905709264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5771,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2548260678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2548260678},{"type":"v1","addr":"172.21.15.135:6836","nonce":2548260678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":6837,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3219630356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3219630356},{"type":"v1","addr":"172.21.15.19:6834","nonce":3219630356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[]} 2024-09-12T02:02:08.149 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 71 2024-09-12T02:02:08.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.151+0000 7fd946d42640 1 -- 172.21.15.19:0/3973997761 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd92406be30 msgr2=0x7fd92406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:08.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.151+0000 7fd946d42640 1 --2- 172.21.15.19:0/3973997761 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd92406be30 0x7fd92406e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd934009c40 tx=0x7fd934009190 comp rx=0 tx=0).stop 2024-09-12T02:02:08.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.151+0000 7fd946d42640 1 -- 172.21.15.19:0/3973997761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd940144b70 msgr2=0x7fd940155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:08.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.151+0000 7fd946d42640 1 --2- 172.21.15.19:0/3973997761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd940144b70 0x7fd940155040 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd94006c910 tx=0x7fd93800e530 comp rx=0 tx=0).stop 2024-09-12T02:02:08.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.151+0000 7fd946d42640 1 -- 172.21.15.19:0/3973997761 shutdown_connections 2024-09-12T02:02:08.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.151+0000 7fd946d42640 1 --2- 172.21.15.19:0/3973997761 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd92406be30 0x7fd92406e2f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.151+0000 7fd946d42640 1 --2- 172.21.15.19:0/3973997761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd940144b70 0x7fd940155040 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.151+0000 7fd946d42640 1 --2- 172.21.15.19:0/3973997761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9400cc040 0x7fd940144630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.151+0000 7fd946d42640 1 --2- 172.21.15.19:0/3973997761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd930004800 0x7fd9401428e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.151+0000 7fd946d42640 1 -- 172.21.15.19:0/3973997761 >> 172.21.15.19:0/3973997761 conn(0x7fd940067d70 msgr2=0x7fd9400b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:08.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.151+0000 7fd946d42640 1 -- 172.21.15.19:0/3973997761 shutdown_connections 2024-09-12T02:02:08.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.151+0000 7fd946d42640 1 -- 172.21.15.19:0/3973997761 wait complete. 2024-09-12T02:02:08.161 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:02:08.161 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:02:08.162 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:02:08.162 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:02:08.162 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:02:08.162 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:02:08.162 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:02:08.162 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:02:08.162 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:02:08.162 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:02:08.163 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:02:08.163 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:02:08.163 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:02:08.163 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:02:08.163 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:02:08.163 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:02:08.170 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:02:08.171 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:02:08.171 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:02:08.172 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:02:08.174 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:02:08.174 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:02:08.175 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:02:08.175 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:02:08.214 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:02:08.215 DEBUG:teuthology.parallel:result is None 2024-09-12T02:02:08.216 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:02:08.216 DEBUG:teuthology.parallel:result is None 2024-09-12T02:02:08.220 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:02:08.221 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:02:08.221 DEBUG:teuthology.parallel:result is None 2024-09-12T02:02:08.221 DEBUG:teuthology.parallel:result is None 2024-09-12T02:02:08.221 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:02:08.292 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-09-12T02:02:08.292 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:02:08.301 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2024-09-12T02:02:08.301 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T02:02:08.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.329+0000 7f7d590ba640 1 Processor -- start 2024-09-12T02:02:08.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.329+0000 7f7d590ba640 1 -- start start 2024-09-12T02:02:08.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.330+0000 7f7d590ba640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7d54161c80 0x7f7d5406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:08.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.330+0000 7f7d590ba640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7d540b6680 0x7f7d540cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:08.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.330+0000 7f7d590ba640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d5406e870 con 0x7f7d54162060 2024-09-12T02:02:08.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.330+0000 7f7d590ba640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f7d5406d9f0 con 0x7f7d540b6680 2024-09-12T02:02:08.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.330+0000 7f7d590ba640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f7d5406dcd0 con 0x7f7d54161c80 2024-09-12T02:02:08.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.330+0000 7f7d5359e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7d540b6680 0x7f7d540cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:08.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.330+0000 7f7d5259c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7d54162060 0x7f7d540b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52276/0 (socket says 172.21.15.19:52276) 2024-09-12T02:02:08.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.330+0000 7f7d5359e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7d540b6680 0x7f7d540cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48380/0 (socket says 172.21.15.19:48380) 2024-09-12T02:02:08.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.330+0000 7f7d5259c640 1 -- 172.21.15.19:0/2074108343 learned_addr learned my addr 172.21.15.19:0/2074108343 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:08.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.330+0000 7f7d52d9d640 1 --2- 172.21.15.19:0/2074108343 >> v2:172.21.15.135:3300/0 conn(0x7f7d54161c80 0x7f7d5406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:08.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.330+0000 7f7d5359e640 1 -- 172.21.15.19:0/2074108343 >> v2:172.21.15.135:3300/0 conn(0x7f7d54161c80 msgr2=0x7f7d5406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:08.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.330+0000 7f7d5359e640 1 --2- 172.21.15.19:0/2074108343 >> v2:172.21.15.135:3300/0 conn(0x7f7d54161c80 0x7f7d5406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.330+0000 7f7d5359e640 1 -- 172.21.15.19:0/2074108343 >> v1:172.21.15.19:6789/0 conn(0x7f7d54162060 legacy=0x7f7d540b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:08.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.330+0000 7f7d5359e640 1 -- 172.21.15.19:0/2074108343 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5406dfb0 con 0x7f7d540b6680 2024-09-12T02:02:08.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.331+0000 7f7d5359e640 1 --2- 172.21.15.19:0/2074108343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d540b6680 0x7f7d540cf1e0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f7d5408d7a0 tx=0x7f7d4c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d775f73da77f1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:08.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.331+0000 7f7d51d9b640 1 -- 172.21.15.19:0/2074108343 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c007740 con 0x7f7d540b6680 2024-09-12T02:02:08.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.331+0000 7f7d51d9b640 1 -- 172.21.15.19:0/2074108343 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4c0078e0 con 0x7f7d540b6680 2024-09-12T02:02:08.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.331+0000 7f7d51d9b640 1 -- 172.21.15.19:0/2074108343 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c007cb0 con 0x7f7d540b6680 2024-09-12T02:02:08.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.332+0000 7f7d590ba640 1 -- 172.21.15.19:0/2074108343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d540b6680 msgr2=0x7f7d540cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:08.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.332+0000 7f7d590ba640 1 --2- 172.21.15.19:0/2074108343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d540b6680 0x7f7d540cf1e0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f7d5408d7a0 tx=0x7f7d4c02a680 comp rx=0 tx=0).stop 2024-09-12T02:02:08.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.332+0000 7f7d590ba640 1 -- 172.21.15.19:0/2074108343 shutdown_connections 2024-09-12T02:02:08.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.332+0000 7f7d590ba640 1 --2- 172.21.15.19:0/2074108343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d540b6680 0x7f7d540cf1e0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.332+0000 7f7d590ba640 1 --2- 172.21.15.19:0/2074108343 >> v2:172.21.15.135:3300/0 conn(0x7f7d54161c80 0x7f7d5406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.332+0000 7f7d590ba640 1 -- 172.21.15.19:0/2074108343 >> 172.21.15.19:0/2074108343 conn(0x7f7d540d44f0 msgr2=0x7f7d540d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:08.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.332+0000 7f7d590ba640 1 -- 172.21.15.19:0/2074108343 shutdown_connections 2024-09-12T02:02:08.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.332+0000 7f7d590ba640 1 -- 172.21.15.19:0/2074108343 wait complete. 2024-09-12T02:02:08.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.333+0000 7f7d590ba640 1 Processor -- start 2024-09-12T02:02:08.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.333+0000 7f7d590ba640 1 -- start start 2024-09-12T02:02:08.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.334+0000 7f7d590ba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d540b6680 0x7f7d54159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:08.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.334+0000 7f7d590ba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d54161c80 0x7f7d540c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:08.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.334+0000 7f7d590ba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d54162060 0x7f7d540c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:08.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.334+0000 7f7d590ba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7d540b6b30 con 0x7f7d540b6680 2024-09-12T02:02:08.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.334+0000 7f7d590ba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7d540d2aa0 con 0x7f7d54161c80 2024-09-12T02:02:08.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.334+0000 7f7d590ba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7d540b6cb0 con 0x7f7d54162060 2024-09-12T02:02:08.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.334+0000 7f7d52d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d540b6680 0x7f7d54159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:08.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.334+0000 7f7d52d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d540b6680 0x7f7d54159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48396/0 (socket says 172.21.15.19:48396) 2024-09-12T02:02:08.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.334+0000 7f7d52d9d640 1 -- 172.21.15.19:0/4250887178 learned_addr learned my addr 172.21.15.19:0/4250887178 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:08.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.335+0000 7f7d5259c640 1 --2- 172.21.15.19:0/4250887178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d54161c80 0x7f7d540c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:08.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.335+0000 7f7d5359e640 1 --2- 172.21.15.19:0/4250887178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d54162060 0x7f7d540c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:08.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.335+0000 7f7d52d9d640 1 -- 172.21.15.19:0/4250887178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d54162060 msgr2=0x7f7d540c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:08.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.335+0000 7f7d52d9d640 1 --2- 172.21.15.19:0/4250887178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d54162060 0x7f7d540c99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.335+0000 7f7d52d9d640 1 -- 172.21.15.19:0/4250887178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d54161c80 msgr2=0x7f7d540c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:08.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.335+0000 7f7d52d9d640 1 --2- 172.21.15.19:0/4250887178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d54161c80 0x7f7d540c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.335+0000 7f7d52d9d640 1 -- 172.21.15.19:0/4250887178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d54159fc0 con 0x7f7d540b6680 2024-09-12T02:02:08.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.335+0000 7f7d5259c640 1 --2- 172.21.15.19:0/4250887178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d54161c80 0x7f7d540c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:08.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.335+0000 7f7d52d9d640 1 --2- 172.21.15.19:0/4250887178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d540b6680 0x7f7d54159a80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400d830 tx=0x7f7d4400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:08.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.335+0000 7f7d3b7fe640 1 -- 172.21.15.19:0/4250887178 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400b6c0 con 0x7f7d540b6680 2024-09-12T02:02:08.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.335+0000 7f7d3b7fe640 1 -- 172.21.15.19:0/4250887178 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d44019070 con 0x7f7d540b6680 2024-09-12T02:02:08.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.335+0000 7f7d590ba640 1 -- 172.21.15.19:0/4250887178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d540ca010 con 0x7f7d540b6680 2024-09-12T02:02:08.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.335+0000 7f7d3b7fe640 1 -- 172.21.15.19:0/4250887178 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400ba80 con 0x7f7d540b6680 2024-09-12T02:02:08.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.335+0000 7f7d590ba640 1 -- 172.21.15.19:0/4250887178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d540ca5d0 con 0x7f7d540b6680 2024-09-12T02:02:08.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.336+0000 7f7d590ba640 1 -- 172.21.15.19:0/4250887178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d5406e330 con 0x7f7d540b6680 2024-09-12T02:02:08.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.336+0000 7f7d3b7fe640 1 -- 172.21.15.19:0/4250887178 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d4401e460 con 0x7f7d540b6680 2024-09-12T02:02:08.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.337+0000 7f7d3b7fe640 1 --2- 172.21.15.19:0/4250887178 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7d4006be30 0x7f7d4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:08.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.337+0000 7f7d3b7fe640 1 -- 172.21.15.19:0/4250887178 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5421+0+0 (secure 0 0 0) 0x7f7d4408b420 con 0x7f7d540b6680 2024-09-12T02:02:08.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.337+0000 7f7d5259c640 1 --2- 172.21.15.19:0/4250887178 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7d4006be30 0x7f7d4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:08.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.338+0000 7f7d5259c640 1 --2- 172.21.15.19:0/4250887178 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7d4006be30 0x7f7d4006e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7d540b6600 tx=0x7f7d48009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:08.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.341+0000 7f7d3b7fe640 1 -- 172.21.15.19:0/4250887178 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d44059ef0 con 0x7f7d540b6680 2024-09-12T02:02:08.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.528+0000 7f7d590ba640 1 -- 172.21.15.19:0/4250887178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7d540ba470 con 0x7f7d540b6680 2024-09-12T02:02:08.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.614+0000 7f7d3b7fe640 1 -- 172.21.15.19:0/4250887178 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v89) ==== 97+0+0 (secure 0 0 0) 0x7f7d440597f0 con 0x7f7d540b6680 2024-09-12T02:02:08.614 INFO:teuthology.orchestra.run.smithi019.stderr: removed all blocklist entries 2024-09-12T02:02:08.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.617+0000 7f7d590ba640 1 -- 172.21.15.19:0/4250887178 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7d4006be30 msgr2=0x7f7d4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:08.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.617+0000 7f7d590ba640 1 --2- 172.21.15.19:0/4250887178 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7d4006be30 0x7f7d4006e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7d540b6600 tx=0x7f7d48009040 comp rx=0 tx=0).stop 2024-09-12T02:02:08.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.617+0000 7f7d590ba640 1 -- 172.21.15.19:0/4250887178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d540b6680 msgr2=0x7f7d54159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:08.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.617+0000 7f7d590ba640 1 --2- 172.21.15.19:0/4250887178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d540b6680 0x7f7d54159a80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400d830 tx=0x7f7d4400dcf0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.617+0000 7f7d590ba640 1 -- 172.21.15.19:0/4250887178 shutdown_connections 2024-09-12T02:02:08.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.617+0000 7f7d590ba640 1 --2- 172.21.15.19:0/4250887178 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7d4006be30 0x7f7d4006e2f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.617+0000 7f7d590ba640 1 --2- 172.21.15.19:0/4250887178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d54162060 0x7f7d540c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.617+0000 7f7d590ba640 1 --2- 172.21.15.19:0/4250887178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d54161c80 0x7f7d540c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.617+0000 7f7d590ba640 1 --2- 172.21.15.19:0/4250887178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d540b6680 0x7f7d54159a80 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.617+0000 7f7d590ba640 1 -- 172.21.15.19:0/4250887178 >> 172.21.15.19:0/4250887178 conn(0x7f7d540d44f0 msgr2=0x7f7d5406ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:08.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.617+0000 7f7d590ba640 1 -- 172.21.15.19:0/4250887178 shutdown_connections 2024-09-12T02:02:08.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.618+0000 7f7d590ba640 1 -- 172.21.15.19:0/4250887178 wait complete. 2024-09-12T02:02:08.629 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:02:08.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.732+0000 7f7e6212c640 1 Processor -- start 2024-09-12T02:02:08.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.732+0000 7f7e6212c640 1 -- start start 2024-09-12T02:02:08.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.733+0000 7f7e6212c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7e5c06dbd0 0x7f7e5c09b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:08.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.733+0000 7f7e6212c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e5c0d1970 con 0x7f7e5c0d1540 2024-09-12T02:02:08.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.733+0000 7f7e6212c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e5c0d0780 con 0x7f7e5c15e740 2024-09-12T02:02:08.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.733+0000 7f7e6212c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f7e5c15eb20 con 0x7f7e5c06dbd0 2024-09-12T02:02:08.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.733+0000 7f7e5bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7e5c06dbd0 0x7f7e5c09b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:08.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.733+0000 7f7e5affd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7e5c0d1540 0x7f7e5c070160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52288/0 (socket says 172.21.15.19:52288) 2024-09-12T02:02:08.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.733+0000 7f7e5affd640 1 -- 172.21.15.19:0/3230218880 learned_addr learned my addr 172.21.15.19:0/3230218880 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:08.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.733+0000 7f7e5bfff640 1 -- 172.21.15.19:0/3230218880 >> v1:172.21.15.135:6789/0 conn(0x7f7e5c15e740 legacy=0x7f7e5c06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:08.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.733+0000 7f7e5bfff640 1 -- 172.21.15.19:0/3230218880 >> v1:172.21.15.19:6789/0 conn(0x7f7e5c0d1540 legacy=0x7f7e5c070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:08.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.733+0000 7f7e5bfff640 1 -- 172.21.15.19:0/3230218880 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5c0d0a60 con 0x7f7e5c06dbd0 2024-09-12T02:02:08.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.733+0000 7f7e5a7fc640 1 -- 172.21.15.19:0/3230218880 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 738434257 0 0) 0x7f7e5c0d1970 con 0x7f7e5c0d1540 2024-09-12T02:02:08.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.734+0000 7f7e5bfff640 1 --2- 172.21.15.19:0/3230218880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e5c06dbd0 0x7f7e5c09b690 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009d90 tx=0x7f7e5402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185105297d101517 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:08.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.734+0000 7f7e5a7fc640 1 -- 172.21.15.19:0/3230218880 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54007740 con 0x7f7e5c06dbd0 2024-09-12T02:02:08.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.734+0000 7f7e5a7fc640 1 -- 172.21.15.19:0/3230218880 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e540078e0 con 0x7f7e5c06dbd0 2024-09-12T02:02:08.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.734+0000 7f7e5a7fc640 1 -- 172.21.15.19:0/3230218880 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54007cb0 con 0x7f7e5c06dbd0 2024-09-12T02:02:08.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.735+0000 7f7e6212c640 1 -- 172.21.15.19:0/3230218880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e5c06dbd0 msgr2=0x7f7e5c09b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:08.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.735+0000 7f7e6212c640 1 --2- 172.21.15.19:0/3230218880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e5c06dbd0 0x7f7e5c09b690 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009d90 tx=0x7f7e5402a730 comp rx=0 tx=0).stop 2024-09-12T02:02:08.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.735+0000 7f7e6212c640 1 -- 172.21.15.19:0/3230218880 shutdown_connections 2024-09-12T02:02:08.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.735+0000 7f7e6212c640 1 --2- 172.21.15.19:0/3230218880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e5c06dbd0 0x7f7e5c09b690 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.735+0000 7f7e6212c640 1 -- 172.21.15.19:0/3230218880 >> 172.21.15.19:0/3230218880 conn(0x7f7e5c0d23a0 msgr2=0x7f7e5c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:08.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.735+0000 7f7e6212c640 1 -- 172.21.15.19:0/3230218880 shutdown_connections 2024-09-12T02:02:08.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.735+0000 7f7e6212c640 1 -- 172.21.15.19:0/3230218880 wait complete. 2024-09-12T02:02:08.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.736+0000 7f7e6212c640 1 Processor -- start 2024-09-12T02:02:08.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.736+0000 7f7e6212c640 1 -- start start 2024-09-12T02:02:08.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.737+0000 7f7e6212c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e5c06dbd0 0x7f7e5c1e8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:08.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.737+0000 7f7e6212c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e5c0d1540 0x7f7e5c15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:08.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.737+0000 7f7e6212c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e5c15e740 0x7f7e5c0b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:08.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.737+0000 7f7e6212c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c06dfe0 con 0x7f7e5c15e740 2024-09-12T02:02:08.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.737+0000 7f7e6212c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c0d1020 con 0x7f7e5c06dbd0 2024-09-12T02:02:08.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.737+0000 7f7e6212c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7e5c06cd20 con 0x7f7e5c0d1540 2024-09-12T02:02:08.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.737+0000 7f7e5bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e5c15e740 0x7f7e5c0b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:08.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.737+0000 7f7e5bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e5c15e740 0x7f7e5c0b6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48406/0 (socket says 172.21.15.19:48406) 2024-09-12T02:02:08.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.737+0000 7f7e5bfff640 1 -- 172.21.15.19:0/2681776593 learned_addr learned my addr 172.21.15.19:0/2681776593 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:08.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.737+0000 7f7e5b7fe640 1 --2- 172.21.15.19:0/2681776593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e5c06dbd0 0x7f7e5c1e8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:08.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.737+0000 7f7e5affd640 1 --2- 172.21.15.19:0/2681776593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e5c0d1540 0x7f7e5c15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:08.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.737+0000 7f7e5bfff640 1 -- 172.21.15.19:0/2681776593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e5c0d1540 msgr2=0x7f7e5c15d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:08.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.737+0000 7f7e5bfff640 1 --2- 172.21.15.19:0/2681776593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e5c0d1540 0x7f7e5c15d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.737+0000 7f7e5bfff640 1 -- 172.21.15.19:0/2681776593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e5c06dbd0 msgr2=0x7f7e5c1e8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:08.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.737+0000 7f7e5bfff640 1 --2- 172.21.15.19:0/2681776593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e5c06dbd0 0x7f7e5c1e8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.737+0000 7f7e5bfff640 1 -- 172.21.15.19:0/2681776593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5c0cb0e0 con 0x7f7e5c15e740 2024-09-12T02:02:08.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.738+0000 7f7e5bfff640 1 --2- 172.21.15.19:0/2681776593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e5c15e740 0x7f7e5c0b6d90 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009d90 tx=0x7f7e54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:08.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.738+0000 7f7e43fff640 1 -- 172.21.15.19:0/2681776593 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54040070 con 0x7f7e5c15e740 2024-09-12T02:02:08.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.738+0000 7f7e43fff640 1 -- 172.21.15.19:0/2681776593 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e54031c40 con 0x7f7e5c15e740 2024-09-12T02:02:08.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.738+0000 7f7e6212c640 1 -- 172.21.15.19:0/2681776593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e5c0cb3c0 con 0x7f7e5c15e740 2024-09-12T02:02:08.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.738+0000 7f7e43fff640 1 -- 172.21.15.19:0/2681776593 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54003990 con 0x7f7e5c15e740 2024-09-12T02:02:08.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.738+0000 7f7e6212c640 1 -- 172.21.15.19:0/2681776593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e5c0cb980 con 0x7f7e5c15e740 2024-09-12T02:02:08.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.739+0000 7f7e6212c640 1 -- 172.21.15.19:0/2681776593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e5c06d0b0 con 0x7f7e5c15e740 2024-09-12T02:02:08.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.739+0000 7f7e43fff640 1 -- 172.21.15.19:0/2681776593 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e54039040 con 0x7f7e5c15e740 2024-09-12T02:02:08.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.740+0000 7f7e43fff640 1 --2- 172.21.15.19:0/2681776593 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7e4806be30 0x7f7e4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:08.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.740+0000 7f7e43fff640 1 -- 172.21.15.19:0/2681776593 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5249+0+0 (secure 0 0 0) 0x7f7e540abc50 con 0x7f7e5c15e740 2024-09-12T02:02:08.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.740+0000 7f7e5b7fe640 1 --2- 172.21.15.19:0/2681776593 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7e4806be30 0x7f7e4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:08.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.741+0000 7f7e5b7fe640 1 --2- 172.21.15.19:0/2681776593 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7e4806be30 0x7f7e4806e2f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c006fd0 tx=0x7f7e4c009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:08.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.744+0000 7f7e43fff640 1 -- 172.21.15.19:0/2681776593 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e540b1020 con 0x7f7e5c15e740 2024-09-12T02:02:08.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.984+0000 7f7e6212c640 1 -- 172.21.15.19:0/2681776593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7e5c0d1cb0 con 0x7f7e5c15e740 2024-09-12T02:02:08.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.984+0000 7f7e43fff640 1 -- 172.21.15.19:0/2681776593 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f7e5407a200 con 0x7f7e5c15e740 2024-09-12T02:02:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:08.984 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:02:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_dump": [ 2024-09-12T02:02:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.a", 2024-09-12T02:02:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJm5rSjChAA4H0OW7ubTgq4vmUaoGvvNA==", 2024-09-12T02:02:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:02:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T02:02:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T02:02:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:02:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:02:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.b", 2024-09-12T02:02:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmyaCyFhAAV87Ogacs5CmiAuG0p/61Fw==", 2024-09-12T02:02:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:02:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T02:02:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T02:02:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:02:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:02:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.c", 2024-09-12T02:02:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmVLrfERAAlIw2yLSJubtZ1o4NB9IDsg==", 2024-09-12T02:02:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:02:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T02:02:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T02:02:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:02:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:02:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.d", 2024-09-12T02:02:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmd6a1HRAA04/r87MKfFM1VQvG1Tjj8A==", 2024-09-12T02:02:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:02:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T02:02:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T02:02:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:02:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:02:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.0", 2024-09-12T02:02:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD0SeJme7ETBRAA/8v8aJcEzpHYmAPg5Hxdzg==", 2024-09-12T02:02:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:02:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:02:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:02:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:02:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.1", 2024-09-12T02:02:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD3SeJmfXQyFhAALiZjnIoDw+OtH9of5IUu0w==", 2024-09-12T02:02:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:02:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:02:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:02:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:02:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.2", 2024-09-12T02:02:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD6SeJmMDNwJxAABb+94TBxpZx3GovP1g1Q2A==", 2024-09-12T02:02:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:02:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:02:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:02:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:02:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.3", 2024-09-12T02:02:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD9SeJmZMgKOBAAgU+mzTBmPSHE7mUElUA9lA==", 2024-09-12T02:02:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:02:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:02:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:02:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:02:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.4", 2024-09-12T02:02:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAESuJmnb9kBBAA6PmrEGSckixHv73r9ogheQ==", 2024-09-12T02:02:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:02:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:02:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:02:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:02:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.5", 2024-09-12T02:02:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAHSuJmLU1hBhAAlFooSVxCEmIHSjqscaFnhQ==", 2024-09-12T02:02:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:02:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:02:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:02:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:02:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.6", 2024-09-12T02:02:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAKSuJmeIj7BxAADTmZtK8dk94LSGa88+xq3Q==", 2024-09-12T02:02:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:02:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:02:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:02:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:02:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.7", 2024-09-12T02:02:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQANSuJmw92iJxAAsjNKRSdndTUGmBtaN3g/pQ==", 2024-09-12T02:02:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:02:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:02:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:02:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:02:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.0", 2024-09-12T02:02:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmfHbXIRAALAvdYAlaB6WxWtubFnlxRw==", 2024-09-12T02:02:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:02:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow r", 2024-09-12T02:02:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T02:02:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:02:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.1", 2024-09-12T02:02:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmOjfDKhAA8h0ldWP6mNPgoqtIejhF+Q==", 2024-09-12T02:02:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:02:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T02:02:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T02:02:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T02:02:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:02:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.2", 2024-09-12T02:02:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmLQSOJxAA2RhDLfjVzPpg1kiJe++WHg==", 2024-09-12T02:02:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:02:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T02:02:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T02:02:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T02:02:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:02:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.3", 2024-09-12T02:02:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmXS5YMBAAXSS+3Omu0PYIz1bJcSxefw==", 2024-09-12T02:02:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:02:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T02:02:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T02:02:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T02:02:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:02:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.admin", 2024-09-12T02:02:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDvSeJmCljiKRAAQmsy5rl4ZPpm2pD1kXMO3g==", 2024-09-12T02:02:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-09-12T02:02:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T02:02:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T02:02:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:02:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:02:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.x", 2024-09-12T02:02:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmjx1VBxAAF80kgsMnFJn+gL44QZn6bg==", 2024-09-12T02:02:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-09-12T02:02:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-09-12T02:02:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:02:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:02:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.y", 2024-09-12T02:02:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmXphnAxAAUnmZ3JPOt1Yzk0zqWh5+kg==", 2024-09-12T02:02:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:02:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-09-12T02:02:08.997 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-09-12T02:02:08.997 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:02:08.997 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.997 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:08.997 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T02:02:08.997 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:02:08.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.986+0000 7f7e6212c640 1 -- 172.21.15.19:0/2681776593 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7e4806be30 msgr2=0x7f7e4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:08.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.986+0000 7f7e6212c640 1 --2- 172.21.15.19:0/2681776593 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7e4806be30 0x7f7e4806e2f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c006fd0 tx=0x7f7e4c009060 comp rx=0 tx=0).stop 2024-09-12T02:02:08.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.986+0000 7f7e6212c640 1 -- 172.21.15.19:0/2681776593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e5c15e740 msgr2=0x7f7e5c0b6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:08.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.986+0000 7f7e6212c640 1 --2- 172.21.15.19:0/2681776593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e5c15e740 0x7f7e5c0b6d90 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009d90 tx=0x7f7e54004a40 comp rx=0 tx=0).stop 2024-09-12T02:02:08.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.986+0000 7f7e6212c640 1 -- 172.21.15.19:0/2681776593 shutdown_connections 2024-09-12T02:02:08.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.986+0000 7f7e6212c640 1 --2- 172.21.15.19:0/2681776593 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7e4806be30 0x7f7e4806e2f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.986+0000 7f7e6212c640 1 --2- 172.21.15.19:0/2681776593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e5c15e740 0x7f7e5c0b6d90 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.986+0000 7f7e6212c640 1 --2- 172.21.15.19:0/2681776593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e5c0d1540 0x7f7e5c15d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.986+0000 7f7e6212c640 1 --2- 172.21.15.19:0/2681776593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e5c06dbd0 0x7f7e5c1e8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.986+0000 7f7e6212c640 1 -- 172.21.15.19:0/2681776593 >> 172.21.15.19:0/2681776593 conn(0x7f7e5c0d23a0 msgr2=0x7f7e5c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:08.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.986+0000 7f7e6212c640 1 -- 172.21.15.19:0/2681776593 shutdown_connections 2024-09-12T02:02:08.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:08.986+0000 7f7e6212c640 1 -- 172.21.15.19:0/2681776593 wait complete. 2024-09-12T02:02:09.000 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:02:09.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.103+0000 7fe0fec47640 1 Processor -- start 2024-09-12T02:02:09.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.103+0000 7fe0fec47640 1 -- start start 2024-09-12T02:02:09.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.104+0000 7fe0fec47640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe0f815e5f0 0x7fe0f80d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:09.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.104+0000 7fe0fec47640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0f80d30f0 0x7fe0f80b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:09.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.104+0000 7fe0fec47640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe0f80b64c0 0x7fe0f80cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:09.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.104+0000 7fe0fec47640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fe0f806d530 con 0x7fe0f815e5f0 2024-09-12T02:02:09.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.104+0000 7fe0fec47640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe0f80d3690 con 0x7fe0f80b64c0 2024-09-12T02:02:09.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.104+0000 7fe0fec47640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f80d3970 con 0x7fe0f80d30f0 2024-09-12T02:02:09.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.104+0000 7fe0fc9e3640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe0f815e5f0 0x7fe0f80d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:09.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.104+0000 7fe0fc9e3640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe0f815e5f0 0x7fe0f80d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48416/0 (socket says 172.21.15.19:48416) 2024-09-12T02:02:09.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.104+0000 7fe0fc9e3640 1 -- 172.21.15.19:0/1548637773 learned_addr learned my addr 172.21.15.19:0/1548637773 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:09.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.104+0000 7fe0f7fff640 1 --2- 172.21.15.19:0/1548637773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0f80d30f0 0x7fe0f80b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:09.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.104+0000 7fe0fd1e4640 1 --2- 172.21.15.19:0/1548637773 >> v2:172.21.15.135:3300/0 conn(0x7fe0f80b64c0 0x7fe0f80cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:09.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.104+0000 7fe0fc9e3640 1 -- 172.21.15.19:0/1548637773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0f80d30f0 msgr2=0x7fe0f80b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:09.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.104+0000 7fe0fc9e3640 1 --2- 172.21.15.19:0/1548637773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0f80d30f0 0x7fe0f80b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.104+0000 7fe0fc9e3640 1 -- 172.21.15.19:0/1548637773 >> v2:172.21.15.135:3300/0 conn(0x7fe0f80b64c0 msgr2=0x7fe0f80cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:09.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.104+0000 7fe0fc9e3640 1 --2- 172.21.15.19:0/1548637773 >> v2:172.21.15.135:3300/0 conn(0x7fe0f80b64c0 0x7fe0f80cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.104+0000 7fe0fc9e3640 1 -- 172.21.15.19:0/1548637773 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f806cee0 con 0x7fe0f815e5f0 2024-09-12T02:02:09.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.104+0000 7fe0f7fff640 1 --2- 172.21.15.19:0/1548637773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0f80d30f0 0x7fe0f80b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:09.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.104+0000 7fe0fd1e4640 1 --2- 172.21.15.19:0/1548637773 >> v2:172.21.15.135:3300/0 conn(0x7fe0f80b64c0 0x7fe0f80cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:09.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.105+0000 7fe0fc9e3640 1 --2- 172.21.15.19:0/1548637773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0f815e5f0 0x7fe0f80d4dd0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80a23f0 tx=0x7fe0e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803767c8ea21e884 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:09.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.105+0000 7fe0f77fe640 1 -- 172.21.15.19:0/1548637773 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0037070 con 0x7fe0f815e5f0 2024-09-12T02:02:09.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.105+0000 7fe0f77fe640 1 -- 172.21.15.19:0/1548637773 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e0032440 con 0x7fe0f815e5f0 2024-09-12T02:02:09.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.105+0000 7fe0f77fe640 1 -- 172.21.15.19:0/1548637773 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0032810 con 0x7fe0f815e5f0 2024-09-12T02:02:09.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.106+0000 7fe0fec47640 1 -- 172.21.15.19:0/1548637773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0f815e5f0 msgr2=0x7fe0f80d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:09.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.106+0000 7fe0fec47640 1 --2- 172.21.15.19:0/1548637773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0f815e5f0 0x7fe0f80d4dd0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80a23f0 tx=0x7fe0e002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.106+0000 7fe0fec47640 1 -- 172.21.15.19:0/1548637773 shutdown_connections 2024-09-12T02:02:09.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.106+0000 7fe0fec47640 1 --2- 172.21.15.19:0/1548637773 >> v2:172.21.15.135:3300/0 conn(0x7fe0f80b64c0 0x7fe0f80cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.106+0000 7fe0fec47640 1 --2- 172.21.15.19:0/1548637773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0f80d30f0 0x7fe0f80b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.106+0000 7fe0fec47640 1 --2- 172.21.15.19:0/1548637773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0f815e5f0 0x7fe0f80d4dd0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.106+0000 7fe0fec47640 1 -- 172.21.15.19:0/1548637773 >> 172.21.15.19:0/1548637773 conn(0x7fe0f808bfc0 msgr2=0x7fe0f80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:09.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.106+0000 7fe0fec47640 1 -- 172.21.15.19:0/1548637773 shutdown_connections 2024-09-12T02:02:09.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.106+0000 7fe0fec47640 1 -- 172.21.15.19:0/1548637773 wait complete. 2024-09-12T02:02:09.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.107+0000 7fe0fec47640 1 Processor -- start 2024-09-12T02:02:09.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.107+0000 7fe0fec47640 1 -- start start 2024-09-12T02:02:09.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.108+0000 7fe0fec47640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0f80b64c0 0x7fe0f80ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:09.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.108+0000 7fe0fec47640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0f80d30f0 0x7fe0f815da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:09.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.108+0000 7fe0fec47640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0f815e5f0 0x7fe0f80b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:09.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.108+0000 7fe0fec47640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f80d5310 con 0x7fe0f80b64c0 2024-09-12T02:02:09.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.108+0000 7fe0fec47640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f815e9d0 con 0x7fe0f815e5f0 2024-09-12T02:02:09.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.108+0000 7fe0fec47640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f80cf540 con 0x7fe0f80d30f0 2024-09-12T02:02:09.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.108+0000 7fe0fc9e3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0f80b64c0 0x7fe0f80ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:09.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.108+0000 7fe0fc9e3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0f80b64c0 0x7fe0f80ce6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48422/0 (socket says 172.21.15.19:48422) 2024-09-12T02:02:09.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.108+0000 7fe0fc9e3640 1 -- 172.21.15.19:0/1879070768 learned_addr learned my addr 172.21.15.19:0/1879070768 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:09.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.108+0000 7fe0f7fff640 1 --2- 172.21.15.19:0/1879070768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0f80d30f0 0x7fe0f815da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:09.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.108+0000 7fe0fd1e4640 1 --2- 172.21.15.19:0/1879070768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0f815e5f0 0x7fe0f80b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:09.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.108+0000 7fe0fc9e3640 1 -- 172.21.15.19:0/1879070768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0f80d30f0 msgr2=0x7fe0f815da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:09.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.108+0000 7fe0fc9e3640 1 --2- 172.21.15.19:0/1879070768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0f80d30f0 0x7fe0f815da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.108+0000 7fe0fc9e3640 1 -- 172.21.15.19:0/1879070768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0f815e5f0 msgr2=0x7fe0f80b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:09.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.108+0000 7fe0fc9e3640 1 --2- 172.21.15.19:0/1879070768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0f815e5f0 0x7fe0f80b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.108+0000 7fe0fc9e3640 1 -- 172.21.15.19:0/1879070768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f815df70 con 0x7fe0f80b64c0 2024-09-12T02:02:09.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.108+0000 7fe0f7fff640 1 --2- 172.21.15.19:0/1879070768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0f80d30f0 0x7fe0f815da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:09.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.108+0000 7fe0fc9e3640 1 --2- 172.21.15.19:0/1879070768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0f80b64c0 0x7fe0f80ce6f0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fe0e002a220 tx=0x7fe0e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:09.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.109+0000 7fe0f57fa640 1 -- 172.21.15.19:0/1879070768 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0041020 con 0x7fe0f80b64c0 2024-09-12T02:02:09.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.109+0000 7fe0f57fa640 1 -- 172.21.15.19:0/1879070768 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e00306c0 con 0x7fe0f80b64c0 2024-09-12T02:02:09.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.109+0000 7fe0f57fa640 1 -- 172.21.15.19:0/1879070768 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0037040 con 0x7fe0f80b64c0 2024-09-12T02:02:09.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.109+0000 7fe0fec47640 1 -- 172.21.15.19:0/1879070768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f80cd650 con 0x7fe0f80b64c0 2024-09-12T02:02:09.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.109+0000 7fe0fec47640 1 -- 172.21.15.19:0/1879070768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f80cdc10 con 0x7fe0f80b64c0 2024-09-12T02:02:09.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.110+0000 7fe0fec47640 1 -- 172.21.15.19:0/1879070768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0f80b5f80 con 0x7fe0f80b64c0 2024-09-12T02:02:09.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.110+0000 7fe0f57fa640 1 -- 172.21.15.19:0/1879070768 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe0e0044020 con 0x7fe0f80b64c0 2024-09-12T02:02:09.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.111+0000 7fe0f57fa640 1 --2- 172.21.15.19:0/1879070768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe0d806be30 0x7fe0d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:09.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.111+0000 7fe0f57fa640 1 -- 172.21.15.19:0/1879070768 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5249+0+0 (secure 0 0 0) 0x7fe0e00ab420 con 0x7fe0f80b64c0 2024-09-12T02:02:09.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.111+0000 7fe0f7fff640 1 --2- 172.21.15.19:0/1879070768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe0d806be30 0x7fe0d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:09.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.111+0000 7fe0f7fff640 1 --2- 172.21.15.19:0/1879070768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe0d806be30 0x7fe0d806e2f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80095c0 tx=0x7fe0e80094f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:09.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.115+0000 7fe0f57fa640 1 -- 172.21.15.19:0/1879070768 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe0e004b030 con 0x7fe0f80b64c0 2024-09-12T02:02:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.293+0000 7fe0fec47640 1 -- 172.21.15.19:0/1879070768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe0f80d08c0 con 0x7fe0f80b64c0 2024-09-12T02:02:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.294+0000 7fe0f57fa640 1 -- 172.21.15.19:0/1879070768 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v89) ==== 84+0+65 (secure 0 0 0) 0x7fe0f815df70 con 0x7fe0f80b64c0 2024-09-12T02:02:09.293 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:09.293 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-09-12T02:02:09.293 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:02:09.293 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-09-12T02:02:09.293 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-09-12T02:02:09.293 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:02:09.293 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-09-12T02:02:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.295+0000 7fe0fec47640 1 -- 172.21.15.19:0/1879070768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe0d806be30 msgr2=0x7fe0d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.295+0000 7fe0fec47640 1 --2- 172.21.15.19:0/1879070768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe0d806be30 0x7fe0d806e2f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80095c0 tx=0x7fe0e80094f0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.295+0000 7fe0fec47640 1 -- 172.21.15.19:0/1879070768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0f80b64c0 msgr2=0x7fe0f80ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.295+0000 7fe0fec47640 1 --2- 172.21.15.19:0/1879070768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0f80b64c0 0x7fe0f80ce6f0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fe0e002a220 tx=0x7fe0e00046c0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.296+0000 7fe0fec47640 1 -- 172.21.15.19:0/1879070768 shutdown_connections 2024-09-12T02:02:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.296+0000 7fe0fec47640 1 --2- 172.21.15.19:0/1879070768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe0d806be30 0x7fe0d806e2f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.296+0000 7fe0fec47640 1 --2- 172.21.15.19:0/1879070768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0f815e5f0 0x7fe0f80b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.296+0000 7fe0fec47640 1 --2- 172.21.15.19:0/1879070768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0f80d30f0 0x7fe0f815da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.296+0000 7fe0fec47640 1 --2- 172.21.15.19:0/1879070768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0f80b64c0 0x7fe0f80ce6f0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.296+0000 7fe0fec47640 1 -- 172.21.15.19:0/1879070768 >> 172.21.15.19:0/1879070768 conn(0x7fe0f808bfc0 msgr2=0x7fe0f80b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:09.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.296+0000 7fe0fec47640 1 -- 172.21.15.19:0/1879070768 shutdown_connections 2024-09-12T02:02:09.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.296+0000 7fe0fec47640 1 -- 172.21.15.19:0/1879070768 wait complete. 2024-09-12T02:02:09.306 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:02:09.307 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:02:09.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.413+0000 7ff7affdf640 1 Processor -- start 2024-09-12T02:02:09.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.413+0000 7ff7affdf640 1 -- start start 2024-09-12T02:02:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.414+0000 7ff7affdf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff7a815e7f0 0x7ff7a80b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.414+0000 7ff7affdf640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff7a80af210 0x7ff7a8070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.414+0000 7ff7affdf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7a80b7250 0x7ff7a8070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.414+0000 7ff7affdf640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff7a806cdc0 con 0x7ff7a815e7f0 2024-09-12T02:02:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.414+0000 7ff7affdf640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff7a806d0a0 con 0x7ff7a80af210 2024-09-12T02:02:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.414+0000 7ff7affdf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff7a806d380 con 0x7ff7a80b7250 2024-09-12T02:02:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.414+0000 7ff7add7b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff7a815e7f0 0x7ff7a80b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.414+0000 7ff7add7b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff7a815e7f0 0x7ff7a80b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48436/0 (socket says 172.21.15.19:48436) 2024-09-12T02:02:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.414+0000 7ff7add7b640 1 -- 172.21.15.19:0/1154566752 learned_addr learned my addr 172.21.15.19:0/1154566752 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.414+0000 7ff7ae57c640 1 --2- 172.21.15.19:0/1154566752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7a80b7250 0x7ff7a8070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.414+0000 7ff7ad57a640 1 --2- 172.21.15.19:0/1154566752 >> v2:172.21.15.135:3300/0 conn(0x7ff7a80af210 0x7ff7a8070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.414+0000 7ff7add7b640 1 -- 172.21.15.19:0/1154566752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7a80b7250 msgr2=0x7ff7a8070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.414+0000 7ff7add7b640 1 --2- 172.21.15.19:0/1154566752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7a80b7250 0x7ff7a8070fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.414+0000 7ff7add7b640 1 -- 172.21.15.19:0/1154566752 >> v2:172.21.15.135:3300/0 conn(0x7ff7a80af210 msgr2=0x7ff7a8070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.414+0000 7ff7add7b640 1 --2- 172.21.15.19:0/1154566752 >> v2:172.21.15.135:3300/0 conn(0x7ff7a80af210 0x7ff7a8070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.414+0000 7ff7add7b640 1 -- 172.21.15.19:0/1154566752 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a806d660 con 0x7ff7a815e7f0 2024-09-12T02:02:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.414+0000 7ff7ad57a640 1 --2- 172.21.15.19:0/1154566752 >> v2:172.21.15.135:3300/0 conn(0x7ff7a80af210 0x7ff7a8070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.414+0000 7ff7ae57c640 1 --2- 172.21.15.19:0/1154566752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7a80b7250 0x7ff7a8070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.415+0000 7ff7add7b640 1 --2- 172.21.15.19:0/1154566752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7a815e7f0 0x7ff7a80b6d10 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80b5ab0 tx=0x7ff7a402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40043384a7c6fb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.415+0000 7ff7acd79640 1 -- 172.21.15.19:0/1154566752 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4037070 con 0x7ff7a815e7f0 2024-09-12T02:02:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.415+0000 7ff7acd79640 1 -- 172.21.15.19:0/1154566752 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a4032440 con 0x7ff7a815e7f0 2024-09-12T02:02:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.415+0000 7ff7acd79640 1 -- 172.21.15.19:0/1154566752 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4032810 con 0x7ff7a815e7f0 2024-09-12T02:02:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.416+0000 7ff7affdf640 1 -- 172.21.15.19:0/1154566752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7a815e7f0 msgr2=0x7ff7a80b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.416+0000 7ff7affdf640 1 --2- 172.21.15.19:0/1154566752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7a815e7f0 0x7ff7a80b6d10 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80b5ab0 tx=0x7ff7a402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.416+0000 7ff7affdf640 1 -- 172.21.15.19:0/1154566752 shutdown_connections 2024-09-12T02:02:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.416+0000 7ff7affdf640 1 --2- 172.21.15.19:0/1154566752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7a80b7250 0x7ff7a8070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.416+0000 7ff7affdf640 1 --2- 172.21.15.19:0/1154566752 >> v2:172.21.15.135:3300/0 conn(0x7ff7a80af210 0x7ff7a8070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.416+0000 7ff7affdf640 1 --2- 172.21.15.19:0/1154566752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7a815e7f0 0x7ff7a80b6d10 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.416+0000 7ff7affdf640 1 -- 172.21.15.19:0/1154566752 >> 172.21.15.19:0/1154566752 conn(0x7ff7a80b3f30 msgr2=0x7ff7a80b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.416+0000 7ff7affdf640 1 -- 172.21.15.19:0/1154566752 shutdown_connections 2024-09-12T02:02:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.416+0000 7ff7affdf640 1 -- 172.21.15.19:0/1154566752 wait complete. 2024-09-12T02:02:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.417+0000 7ff7affdf640 1 Processor -- start 2024-09-12T02:02:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.417+0000 7ff7affdf640 1 -- start start 2024-09-12T02:02:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.418+0000 7ff7affdf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7a80af210 0x7ff7a8152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.418+0000 7ff7affdf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7a80b7250 0x7ff7a8152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.418+0000 7ff7affdf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7a815e7f0 0x7ff7a815f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.418+0000 7ff7affdf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a809abb0 con 0x7ff7a80af210 2024-09-12T02:02:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.418+0000 7ff7affdf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a809aa30 con 0x7ff7a80b7250 2024-09-12T02:02:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.418+0000 7ff7affdf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff7a809ad30 con 0x7ff7a815e7f0 2024-09-12T02:02:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.418+0000 7ff7add7b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7a80af210 0x7ff7a8152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.418+0000 7ff7add7b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7a80af210 0x7ff7a8152550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48442/0 (socket says 172.21.15.19:48442) 2024-09-12T02:02:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.418+0000 7ff7add7b640 1 -- 172.21.15.19:0/22637689 learned_addr learned my addr 172.21.15.19:0/22637689 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.418+0000 7ff7ad57a640 1 --2- 172.21.15.19:0/22637689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7a80b7250 0x7ff7a8152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.418+0000 7ff7ae57c640 1 --2- 172.21.15.19:0/22637689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7a815e7f0 0x7ff7a815f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.418+0000 7ff7add7b640 1 -- 172.21.15.19:0/22637689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7a815e7f0 msgr2=0x7ff7a815f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.418+0000 7ff7add7b640 1 --2- 172.21.15.19:0/22637689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7a815e7f0 0x7ff7a815f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.418+0000 7ff7add7b640 1 -- 172.21.15.19:0/22637689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7a80b7250 msgr2=0x7ff7a8152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.418+0000 7ff7add7b640 1 --2- 172.21.15.19:0/22637689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7a80b7250 0x7ff7a8152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.418+0000 7ff7add7b640 1 -- 172.21.15.19:0/22637689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a8161730 con 0x7ff7a80af210 2024-09-12T02:02:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.418+0000 7ff7ad57a640 1 --2- 172.21.15.19:0/22637689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7a80b7250 0x7ff7a8152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.418+0000 7ff7ae57c640 1 --2- 172.21.15.19:0/22637689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7a815e7f0 0x7ff7a815f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.419+0000 7ff7add7b640 1 --2- 172.21.15.19:0/22637689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7a80af210 0x7ff7a8152550 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff7a402a220 tx=0x7ff7a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.419+0000 7ff79e7fc640 1 -- 172.21.15.19:0/22637689 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4037040 con 0x7ff7a80af210 2024-09-12T02:02:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.419+0000 7ff79e7fc640 1 -- 172.21.15.19:0/22637689 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a4042070 con 0x7ff7a80af210 2024-09-12T02:02:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.419+0000 7ff7affdf640 1 -- 172.21.15.19:0/22637689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a8161a10 con 0x7ff7a80af210 2024-09-12T02:02:09.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.419+0000 7ff79e7fc640 1 -- 172.21.15.19:0/22637689 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4030bb0 con 0x7ff7a80af210 2024-09-12T02:02:09.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.419+0000 7ff7affdf640 1 -- 172.21.15.19:0/22637689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a815ef50 con 0x7ff7a80af210 2024-09-12T02:02:09.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.420+0000 7ff7affdf640 1 -- 172.21.15.19:0/22637689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7a80ceaa0 con 0x7ff7a80af210 2024-09-12T02:02:09.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.420+0000 7ff79e7fc640 1 -- 172.21.15.19:0/22637689 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff7a4047460 con 0x7ff7a80af210 2024-09-12T02:02:09.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.421+0000 7ff79e7fc640 1 --2- 172.21.15.19:0/22637689 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff78c06be30 0x7ff78c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:09.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.421+0000 7ff79e7fc640 1 -- 172.21.15.19:0/22637689 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5249+0+0 (secure 0 0 0) 0x7ff7a40ab840 con 0x7ff7a80af210 2024-09-12T02:02:09.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.421+0000 7ff7ad57a640 1 --2- 172.21.15.19:0/22637689 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff78c06be30 0x7ff78c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:09.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.422+0000 7ff7ad57a640 1 --2- 172.21.15.19:0/22637689 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff78c06be30 0x7ff78c06e2f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80b07f0 tx=0x7ff798008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:09.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.425+0000 7ff79e7fc640 1 -- 172.21.15.19:0/22637689 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff7a4045360 con 0x7ff7a80af210 2024-09-12T02:02:09.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:09.599+0000 7ff7affdf640 1 -- 172.21.15.19:0/22637689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff7a80b0260 con 0x7ff7a80af210 2024-09-12T02:02:10.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.307+0000 7ff79e7fc640 1 -- 172.21.15.19:0/22637689 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v90) ==== 138+0+0 (secure 0 0 0) 0x7ff7a407a440 con 0x7ff7a80af210 2024-09-12T02:02:10.307 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-09-12T02:02:10.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.312+0000 7ff7affdf640 1 -- 172.21.15.19:0/22637689 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff78c06be30 msgr2=0x7ff78c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:10.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.312+0000 7ff7affdf640 1 --2- 172.21.15.19:0/22637689 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff78c06be30 0x7ff78c06e2f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80b07f0 tx=0x7ff798008040 comp rx=0 tx=0).stop 2024-09-12T02:02:10.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.312+0000 7ff7affdf640 1 -- 172.21.15.19:0/22637689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7a80af210 msgr2=0x7ff7a8152550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:10.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.312+0000 7ff7affdf640 1 --2- 172.21.15.19:0/22637689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7a80af210 0x7ff7a8152550 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff7a402a220 tx=0x7ff7a40046c0 comp rx=0 tx=0).stop 2024-09-12T02:02:10.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.312+0000 7ff7affdf640 1 -- 172.21.15.19:0/22637689 shutdown_connections 2024-09-12T02:02:10.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.312+0000 7ff7affdf640 1 --2- 172.21.15.19:0/22637689 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff78c06be30 0x7ff78c06e2f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:10.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.312+0000 7ff7affdf640 1 --2- 172.21.15.19:0/22637689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7a815e7f0 0x7ff7a815f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:10.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.312+0000 7ff7affdf640 1 --2- 172.21.15.19:0/22637689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7a80b7250 0x7ff7a8152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:10.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.312+0000 7ff7affdf640 1 --2- 172.21.15.19:0/22637689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7a80af210 0x7ff7a8152550 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:10.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.313+0000 7ff7affdf640 1 -- 172.21.15.19:0/22637689 >> 172.21.15.19:0/22637689 conn(0x7ff7a80b3f30 msgr2=0x7ff7a80af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:10.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.313+0000 7ff7affdf640 1 -- 172.21.15.19:0/22637689 shutdown_connections 2024-09-12T02:02:10.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.314+0000 7ff7affdf640 1 -- 172.21.15.19:0/22637689 wait complete. 2024-09-12T02:02:10.328 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:02:10.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.444+0000 7f14d2e37640 1 Processor -- start 2024-09-12T02:02:10.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.444+0000 7f14d2e37640 1 -- start start 2024-09-12T02:02:10.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.445+0000 7f14d2e37640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f14cc0b5f80 0x7f14cc162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:10.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.445+0000 7f14d2e37640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14cc0d4c10 0x7f14cc0b6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:10.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.445+0000 7f14d2e37640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14cc0d2600 con 0x7f14cc0d3320 2024-09-12T02:02:10.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.445+0000 7f14d2e37640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f14cc0d5420 con 0x7f14cc0b5f80 2024-09-12T02:02:10.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.445+0000 7f14d2e37640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f14cc0d2e90 con 0x7f14cc0d4c10 2024-09-12T02:02:10.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.445+0000 7f14d0bd3640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f14cc0b5f80 0x7f14cc162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:10.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.445+0000 7f14cbfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14cc0d4c10 0x7f14cc0b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:10.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.445+0000 7f14d13d4640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f14cc0d3320 0x7f14cc0ceb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:45398/0 (socket says 172.21.15.19:45398) 2024-09-12T02:02:10.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.445+0000 7f14d13d4640 1 -- 172.21.15.19:0/3648895797 learned_addr learned my addr 172.21.15.19:0/3648895797 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:10.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.446+0000 7f14d0bd3640 1 -- 172.21.15.19:0/3648895797 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14cc0d4c10 msgr2=0x7f14cc0b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:10.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.446+0000 7f14d0bd3640 1 --2- 172.21.15.19:0/3648895797 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14cc0d4c10 0x7f14cc0b6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:10.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.446+0000 7f14d0bd3640 1 -- 172.21.15.19:0/3648895797 >> v1:172.21.15.135:6789/0 conn(0x7f14cc0d3320 legacy=0x7f14cc0ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:10.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.446+0000 7f14d0bd3640 1 -- 172.21.15.19:0/3648895797 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14cc0b3c10 con 0x7f14cc0b5f80 2024-09-12T02:02:10.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.446+0000 7f14cbfff640 1 --2- 172.21.15.19:0/3648895797 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14cc0d4c10 0x7f14cc0b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:10.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.446+0000 7f14d0bd3640 1 --2- 172.21.15.19:0/3648895797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc0b5f80 0x7f14cc162980 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f14c00097a0 tx=0x7f14c002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ecb49aced77343f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:10.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.447+0000 7f14cb7fe640 1 -- 172.21.15.19:0/3648895797 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c0037070 con 0x7f14cc0b5f80 2024-09-12T02:02:10.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.447+0000 7f14cb7fe640 1 -- 172.21.15.19:0/3648895797 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14c0032440 con 0x7f14cc0b5f80 2024-09-12T02:02:10.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.447+0000 7f14cb7fe640 1 -- 172.21.15.19:0/3648895797 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c0032810 con 0x7f14cc0b5f80 2024-09-12T02:02:10.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.447+0000 7f14d2e37640 1 -- 172.21.15.19:0/3648895797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc0b5f80 msgr2=0x7f14cc162980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:10.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.447+0000 7f14d2e37640 1 --2- 172.21.15.19:0/3648895797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc0b5f80 0x7f14cc162980 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f14c00097a0 tx=0x7f14c002a180 comp rx=0 tx=0).stop 2024-09-12T02:02:10.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.447+0000 7f14d2e37640 1 -- 172.21.15.19:0/3648895797 shutdown_connections 2024-09-12T02:02:10.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.447+0000 7f14d2e37640 1 --2- 172.21.15.19:0/3648895797 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14cc0d4c10 0x7f14cc0b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:10.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.447+0000 7f14d2e37640 1 --2- 172.21.15.19:0/3648895797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc0b5f80 0x7f14cc162980 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:10.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.447+0000 7f14d2e37640 1 -- 172.21.15.19:0/3648895797 >> 172.21.15.19:0/3648895797 conn(0x7f14cc08bfc0 msgr2=0x7f14cc0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:10.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.447+0000 7f14d2e37640 1 -- 172.21.15.19:0/3648895797 shutdown_connections 2024-09-12T02:02:10.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.447+0000 7f14d2e37640 1 -- 172.21.15.19:0/3648895797 wait complete. 2024-09-12T02:02:10.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.448+0000 7f14d2e37640 1 Processor -- start 2024-09-12T02:02:10.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.448+0000 7f14d2e37640 1 -- start start 2024-09-12T02:02:10.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.449+0000 7f14d2e37640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14cc0b5f80 0x7f14cc159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:10.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.449+0000 7f14d2e37640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc0d3320 0x7f14cc0b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:10.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.449+0000 7f14d2e37640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14cc0d4c10 0x7f14cc0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:10.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.449+0000 7f14d2e37640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc0d5140 con 0x7f14cc0b5f80 2024-09-12T02:02:10.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.449+0000 7f14d2e37640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc0d2880 con 0x7f14cc0d3320 2024-09-12T02:02:10.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.449+0000 7f14d2e37640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f14cc0d2b20 con 0x7f14cc0d4c10 2024-09-12T02:02:10.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.449+0000 7f14d0bd3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14cc0b5f80 0x7f14cc159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:10.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.449+0000 7f14d0bd3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14cc0b5f80 0x7f14cc159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48456/0 (socket says 172.21.15.19:48456) 2024-09-12T02:02:10.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.450+0000 7f14d0bd3640 1 -- 172.21.15.19:0/2226143864 learned_addr learned my addr 172.21.15.19:0/2226143864 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:10.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.450+0000 7f14cbfff640 1 --2- 172.21.15.19:0/2226143864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc0d3320 0x7f14cc0b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:10.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.450+0000 7f14d13d4640 1 --2- 172.21.15.19:0/2226143864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14cc0d4c10 0x7f14cc0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:10.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.450+0000 7f14d0bd3640 1 -- 172.21.15.19:0/2226143864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14cc0d4c10 msgr2=0x7f14cc0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:10.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.450+0000 7f14d0bd3640 1 --2- 172.21.15.19:0/2226143864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14cc0d4c10 0x7f14cc0b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:10.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.450+0000 7f14d0bd3640 1 -- 172.21.15.19:0/2226143864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc0d3320 msgr2=0x7f14cc0b9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:10.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.450+0000 7f14d0bd3640 1 --2- 172.21.15.19:0/2226143864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc0d3320 0x7f14cc0b9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:10.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.450+0000 7f14d0bd3640 1 -- 172.21.15.19:0/2226143864 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14cc0b1c50 con 0x7f14cc0b5f80 2024-09-12T02:02:10.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.450+0000 7f14d0bd3640 1 --2- 172.21.15.19:0/2226143864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14cc0b5f80 0x7f14cc159f40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f14c0000c00 tx=0x7f14c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:10.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.450+0000 7f14c97fa640 1 -- 172.21.15.19:0/2226143864 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c0041070 con 0x7f14cc0b5f80 2024-09-12T02:02:10.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.450+0000 7f14c97fa640 1 -- 172.21.15.19:0/2226143864 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14c003c870 con 0x7f14cc0b5f80 2024-09-12T02:02:10.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.450+0000 7f14d2e37640 1 -- 172.21.15.19:0/2226143864 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14cc0b1f30 con 0x7f14cc0b5f80 2024-09-12T02:02:10.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.450+0000 7f14c97fa640 1 -- 172.21.15.19:0/2226143864 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c0037040 con 0x7f14cc0b5f80 2024-09-12T02:02:10.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.450+0000 7f14d2e37640 1 -- 172.21.15.19:0/2226143864 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14cc0b24f0 con 0x7f14cc0b5f80 2024-09-12T02:02:10.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.451+0000 7f14d2e37640 1 -- 172.21.15.19:0/2226143864 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14cc0b6360 con 0x7f14cc0b5f80 2024-09-12T02:02:10.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.452+0000 7f14c97fa640 1 -- 172.21.15.19:0/2226143864 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f14c0044070 con 0x7f14cc0b5f80 2024-09-12T02:02:10.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.452+0000 7f14c97fa640 1 --2- 172.21.15.19:0/2226143864 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14b006be30 0x7f14b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:10.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.452+0000 7f14c97fa640 1 -- 172.21.15.19:0/2226143864 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5619+0+0 (secure 0 0 0) 0x7f14c00aba60 con 0x7f14cc0b5f80 2024-09-12T02:02:10.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.453+0000 7f14cbfff640 1 --2- 172.21.15.19:0/2226143864 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14b006be30 0x7f14b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:10.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.453+0000 7f14cbfff640 1 --2- 172.21.15.19:0/2226143864 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14b006be30 0x7f14b006e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f14b8009560 tx=0x7f14b8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:10.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.457+0000 7f14c97fa640 1 -- 172.21.15.19:0/2226143864 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f14cc0b3c10 con 0x7f14cc0b5f80 2024-09-12T02:02:10.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:10.633+0000 7f14d2e37640 1 -- 172.21.15.19:0/2226143864 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f14cc1e9da0 con 0x7f14cc0b5f80 2024-09-12T02:02:11.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.313+0000 7f14c97fa640 1 -- 172.21.15.19:0/2226143864 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v91) ==== 170+0+0 (secure 0 0 0) 0x7f14c0079e90 con 0x7f14cc0b5f80 2024-09-12T02:02:11.313 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-09-12T02:02:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.316+0000 7f14d2e37640 1 -- 172.21.15.19:0/2226143864 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14b006be30 msgr2=0x7f14b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.316+0000 7f14d2e37640 1 --2- 172.21.15.19:0/2226143864 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14b006be30 0x7f14b006e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f14b8009560 tx=0x7f14b8009190 comp rx=0 tx=0).stop 2024-09-12T02:02:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.317+0000 7f14d2e37640 1 -- 172.21.15.19:0/2226143864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14cc0b5f80 msgr2=0x7f14cc159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.317+0000 7f14d2e37640 1 --2- 172.21.15.19:0/2226143864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14cc0b5f80 0x7f14cc159f40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f14c0000c00 tx=0x7f14c00046c0 comp rx=0 tx=0).stop 2024-09-12T02:02:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.317+0000 7f14d2e37640 1 -- 172.21.15.19:0/2226143864 shutdown_connections 2024-09-12T02:02:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.317+0000 7f14d2e37640 1 --2- 172.21.15.19:0/2226143864 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14b006be30 0x7f14b006e2f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.317+0000 7f14d2e37640 1 --2- 172.21.15.19:0/2226143864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14cc0d4c10 0x7f14cc0b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.317+0000 7f14d2e37640 1 --2- 172.21.15.19:0/2226143864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc0d3320 0x7f14cc0b9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.317+0000 7f14d2e37640 1 --2- 172.21.15.19:0/2226143864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14cc0b5f80 0x7f14cc159f40 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.317+0000 7f14d2e37640 1 -- 172.21.15.19:0/2226143864 >> 172.21.15.19:0/2226143864 conn(0x7f14cc08bfc0 msgr2=0x7f14cc161f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.318+0000 7f14d2e37640 1 -- 172.21.15.19:0/2226143864 shutdown_connections 2024-09-12T02:02:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.318+0000 7f14d2e37640 1 -- 172.21.15.19:0/2226143864 wait complete. 2024-09-12T02:02:11.345 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:02:11.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.457+0000 7f297f5e4640 1 Processor -- start 2024-09-12T02:02:11.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.457+0000 7f297f5e4640 1 -- start start 2024-09-12T02:02:11.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.458+0000 7f297f5e4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2978159f90 0x7f297806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:11.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.458+0000 7f297f5e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f297806ff10 0x7f297815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:11.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.458+0000 7f297f5e4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29780b3d10 con 0x7f2978160390 2024-09-12T02:02:11.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.458+0000 7f297f5e4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f29780b4db0 con 0x7f2978159f90 2024-09-12T02:02:11.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.458+0000 7f297f5e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f29780b3ff0 con 0x7f297806ff10 2024-09-12T02:02:11.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.458+0000 7f297db81640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2978160390 0x7f297815c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39070/0 (socket says 172.21.15.19:39070) 2024-09-12T02:02:11.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.458+0000 7f297d380640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2978159f90 0x7f297806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:11.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.458+0000 7f297db81640 1 -- 172.21.15.19:0/2795758860 learned_addr learned my addr 172.21.15.19:0/2795758860 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:11.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.458+0000 7f297cb7f640 1 --2- 172.21.15.19:0/2795758860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f297806ff10 0x7f297815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:11.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.458+0000 7f296ffff640 1 -- 172.21.15.19:0/2795758860 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3279336249 0 0) 0x7f29780b3d10 con 0x7f2978160390 2024-09-12T02:02:11.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.458+0000 7f296ffff640 1 -- 172.21.15.19:0/2795758860 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2964003520 con 0x7f2978160390 2024-09-12T02:02:11.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.458+0000 7f297d380640 1 -- 172.21.15.19:0/2795758860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f297806ff10 msgr2=0x7f297815fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:11.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.458+0000 7f297d380640 1 --2- 172.21.15.19:0/2795758860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f297806ff10 0x7f297815fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:11.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.458+0000 7f297d380640 1 -- 172.21.15.19:0/2795758860 >> v1:172.21.15.19:6789/0 conn(0x7f2978160390 legacy=0x7f297815c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:11.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.458+0000 7f297d380640 1 -- 172.21.15.19:0/2795758860 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29780b42d0 con 0x7f2978159f90 2024-09-12T02:02:11.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.458+0000 7f297cb7f640 1 --2- 172.21.15.19:0/2795758860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f297806ff10 0x7f297815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:11.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.459+0000 7f297d380640 1 --2- 172.21.15.19:0/2795758860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2978159f90 0x7f297806f9d0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f29740097a0 tx=0x7f297402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541cb4180075b3d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:11.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.459+0000 7f296ffff640 1 -- 172.21.15.19:0/2795758860 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974037070 con 0x7f2978159f90 2024-09-12T02:02:11.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.459+0000 7f296ffff640 1 -- 172.21.15.19:0/2795758860 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297402ae50 con 0x7f2978159f90 2024-09-12T02:02:11.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.459+0000 7f296ffff640 1 -- 172.21.15.19:0/2795758860 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974032660 con 0x7f2978159f90 2024-09-12T02:02:11.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.460+0000 7f297f5e4640 1 -- 172.21.15.19:0/2795758860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2978159f90 msgr2=0x7f297806f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:11.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.460+0000 7f297f5e4640 1 --2- 172.21.15.19:0/2795758860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2978159f90 0x7f297806f9d0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f29740097a0 tx=0x7f297402a100 comp rx=0 tx=0).stop 2024-09-12T02:02:11.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.460+0000 7f297f5e4640 1 -- 172.21.15.19:0/2795758860 shutdown_connections 2024-09-12T02:02:11.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.460+0000 7f297f5e4640 1 --2- 172.21.15.19:0/2795758860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f297806ff10 0x7f297815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:11.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.460+0000 7f297f5e4640 1 --2- 172.21.15.19:0/2795758860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2978159f90 0x7f297806f9d0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:11.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.460+0000 7f297f5e4640 1 -- 172.21.15.19:0/2795758860 >> 172.21.15.19:0/2795758860 conn(0x7f297806bdf0 msgr2=0x7f297806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:11.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.460+0000 7f297f5e4640 1 -- 172.21.15.19:0/2795758860 shutdown_connections 2024-09-12T02:02:11.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.460+0000 7f297f5e4640 1 -- 172.21.15.19:0/2795758860 wait complete. 2024-09-12T02:02:11.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.461+0000 7f297f5e4640 1 Processor -- start 2024-09-12T02:02:11.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.461+0000 7f297f5e4640 1 -- start start 2024-09-12T02:02:11.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297f5e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f297806ff10 0x7f29781f8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:11.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297f5e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2978159f90 0x7f2978150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:11.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297f5e4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2978160390 0x7f29781562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:11.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297f5e4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f29780b3ab0 con 0x7f2978159f90 2024-09-12T02:02:11.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297f5e4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f29780b3930 con 0x7f2978160390 2024-09-12T02:02:11.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297f5e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f29780cefe0 con 0x7f297806ff10 2024-09-12T02:02:11.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297cb7f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2978159f90 0x7f2978150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:11.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297cb7f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2978159f90 0x7f2978150a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35014/0 (socket says 172.21.15.19:35014) 2024-09-12T02:02:11.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297cb7f640 1 -- 172.21.15.19:0/971427035 learned_addr learned my addr 172.21.15.19:0/971427035 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:11.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297d380640 1 --2- 172.21.15.19:0/971427035 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f297806ff10 0x7f29781f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:11.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297db81640 1 --2- 172.21.15.19:0/971427035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2978160390 0x7f29781562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:11.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297cb7f640 1 -- 172.21.15.19:0/971427035 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f297806ff10 msgr2=0x7f29781f8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:11.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297cb7f640 1 --2- 172.21.15.19:0/971427035 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f297806ff10 0x7f29781f8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:11.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297cb7f640 1 -- 172.21.15.19:0/971427035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2978160390 msgr2=0x7f29781562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:11.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297cb7f640 1 --2- 172.21.15.19:0/971427035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2978160390 0x7f29781562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:11.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297cb7f640 1 -- 172.21.15.19:0/971427035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2978156e30 con 0x7f2978159f90 2024-09-12T02:02:11.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297d380640 1 --2- 172.21.15.19:0/971427035 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f297806ff10 0x7f29781f8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:11.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297db81640 1 --2- 172.21.15.19:0/971427035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2978160390 0x7f29781562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:11.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.462+0000 7f297cb7f640 1 --2- 172.21.15.19:0/971427035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2978159f90 0x7f2978150a50 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f296800d7d0 tx=0x7f296800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:11.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.463+0000 7f296dffb640 1 -- 172.21.15.19:0/971427035 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2968004030 con 0x7f2978159f90 2024-09-12T02:02:11.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.463+0000 7f296dffb640 1 -- 172.21.15.19:0/971427035 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29680041d0 con 0x7f2978159f90 2024-09-12T02:02:11.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.463+0000 7f297f5e4640 1 -- 172.21.15.19:0/971427035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2978157110 con 0x7f2978159f90 2024-09-12T02:02:11.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.463+0000 7f296dffb640 1 -- 172.21.15.19:0/971427035 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29680096a0 con 0x7f2978159f90 2024-09-12T02:02:11.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.463+0000 7f297f5e4640 1 -- 172.21.15.19:0/971427035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29781f7890 con 0x7f2978159f90 2024-09-12T02:02:11.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.464+0000 7f297f5e4640 1 -- 172.21.15.19:0/971427035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f297815fe50 con 0x7f2978159f90 2024-09-12T02:02:11.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.464+0000 7f296dffb640 1 -- 172.21.15.19:0/971427035 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2968009840 con 0x7f2978159f90 2024-09-12T02:02:11.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.465+0000 7f296dffb640 1 --2- 172.21.15.19:0/971427035 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f295c06be30 0x7f295c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:11.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.465+0000 7f296dffb640 1 -- 172.21.15.19:0/971427035 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6001+0+0 (secure 0 0 0) 0x7f296808b2a0 con 0x7f2978159f90 2024-09-12T02:02:11.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.465+0000 7f297d380640 1 --2- 172.21.15.19:0/971427035 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f295c06be30 0x7f295c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:11.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.466+0000 7f297d380640 1 --2- 172.21.15.19:0/971427035 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f295c06be30 0x7f295c06e2f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2974034000 tx=0x7f297402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:11.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.470+0000 7f296dffb640 1 -- 172.21.15.19:0/971427035 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2968059b20 con 0x7f2978159f90 2024-09-12T02:02:11.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:11.685+0000 7f297f5e4640 1 -- 172.21.15.19:0/971427035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f29780ad680 con 0x7f2978159f90 2024-09-12T02:02:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.329+0000 7f296dffb640 1 -- 172.21.15.19:0/971427035 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v74) ==== 174+0+0 (secure 0 0 0) 0x7f2968059420 con 0x7f2978159f90 2024-09-12T02:02:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 13 and data pool 14 2024-09-12T02:02:12.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.338+0000 7f297f5e4640 1 -- 172.21.15.19:0/971427035 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f295c06be30 msgr2=0x7f295c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:12.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.338+0000 7f297f5e4640 1 --2- 172.21.15.19:0/971427035 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f295c06be30 0x7f295c06e2f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2974034000 tx=0x7f297402e000 comp rx=0 tx=0).stop 2024-09-12T02:02:12.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.338+0000 7f297f5e4640 1 -- 172.21.15.19:0/971427035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2978159f90 msgr2=0x7f2978150a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:12.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.338+0000 7f297f5e4640 1 --2- 172.21.15.19:0/971427035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2978159f90 0x7f2978150a50 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f296800d7d0 tx=0x7f296800dc90 comp rx=0 tx=0).stop 2024-09-12T02:02:12.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.338+0000 7f297f5e4640 1 -- 172.21.15.19:0/971427035 shutdown_connections 2024-09-12T02:02:12.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.338+0000 7f297f5e4640 1 --2- 172.21.15.19:0/971427035 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f295c06be30 0x7f295c06e2f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.338+0000 7f297f5e4640 1 --2- 172.21.15.19:0/971427035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2978160390 0x7f29781562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.338+0000 7f297f5e4640 1 --2- 172.21.15.19:0/971427035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2978159f90 0x7f2978150a50 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.338+0000 7f297f5e4640 1 --2- 172.21.15.19:0/971427035 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f297806ff10 0x7f29781f8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.338+0000 7f297f5e4640 1 -- 172.21.15.19:0/971427035 >> 172.21.15.19:0/971427035 conn(0x7f297806bdf0 msgr2=0x7f297806f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:12.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.338+0000 7f297f5e4640 1 -- 172.21.15.19:0/971427035 shutdown_connections 2024-09-12T02:02:12.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.338+0000 7f297f5e4640 1 -- 172.21.15.19:0/971427035 wait complete. 2024-09-12T02:02:12.359 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:02:12.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.465+0000 7f087d62e640 1 Processor -- start 2024-09-12T02:02:12.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.465+0000 7f087d62e640 1 -- start start 2024-09-12T02:02:12.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.466+0000 7f087d62e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0878145bc0 0x7f087815ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:12.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.466+0000 7f087d62e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f08780ae140 0x7f087806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:12.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.466+0000 7f087d62e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08780b3570 con 0x7f087809aa30 2024-09-12T02:02:12.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.466+0000 7f087d62e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f08780b3850 con 0x7f08780ae140 2024-09-12T02:02:12.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.466+0000 7f087d62e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f08780b3b30 con 0x7f0878145bc0 2024-09-12T02:02:12.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.467+0000 7f0876ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0878145bc0 0x7f087815ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:12.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.467+0000 7f08767fc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f08780ae140 0x7f087806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:12.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.467+0000 7f0876ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0878145bc0 0x7f087815ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:39782/0 (socket says 172.21.15.19:39782) 2024-09-12T02:02:12.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.467+0000 7f08767fc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f08780ae140 0x7f087806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:38378/0 (socket says 172.21.15.19:38378) 2024-09-12T02:02:12.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.467+0000 7f0876ffd640 1 -- 172.21.15.19:0/2953732818 learned_addr learned my addr 172.21.15.19:0/2953732818 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:12.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.467+0000 7f08777fe640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f087809aa30 0x7f08780b1e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:35112/0 (socket says 172.21.15.19:35112) 2024-09-12T02:02:12.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.467+0000 7f0876ffd640 1 -- 172.21.15.19:0/2953732818 >> v2:172.21.15.135:3300/0 conn(0x7f08780ae140 msgr2=0x7f087806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:12.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.467+0000 7f0876ffd640 1 --2- 172.21.15.19:0/2953732818 >> v2:172.21.15.135:3300/0 conn(0x7f08780ae140 0x7f087806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.467+0000 7f0876ffd640 1 -- 172.21.15.19:0/2953732818 >> v1:172.21.15.135:6789/0 conn(0x7f087809aa30 legacy=0x7f08780b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:12.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.467+0000 7f0876ffd640 1 -- 172.21.15.19:0/2953732818 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08780b1610 con 0x7f0878145bc0 2024-09-12T02:02:12.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.467+0000 7f08767fc640 1 --2- 172.21.15.19:0/2953732818 >> v2:172.21.15.135:3300/0 conn(0x7f08780ae140 0x7f087806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:12.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.468+0000 7f0876ffd640 1 --2- 172.21.15.19:0/2953732818 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0878145bc0 0x7f087815ca70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0870009870 tx=0x7f087002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc8989a081324c30 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:12.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.468+0000 7f0875ffb640 1 -- 172.21.15.19:0/2953732818 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0870037070 con 0x7f0878145bc0 2024-09-12T02:02:12.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.468+0000 7f0875ffb640 1 -- 172.21.15.19:0/2953732818 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087002ae50 con 0x7f0878145bc0 2024-09-12T02:02:12.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.468+0000 7f0875ffb640 1 -- 172.21.15.19:0/2953732818 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0870032860 con 0x7f0878145bc0 2024-09-12T02:02:12.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.468+0000 7f087d62e640 1 -- 172.21.15.19:0/2953732818 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0878145bc0 msgr2=0x7f087815ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:12.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.468+0000 7f087d62e640 1 --2- 172.21.15.19:0/2953732818 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0878145bc0 0x7f087815ca70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0870009870 tx=0x7f087002a300 comp rx=0 tx=0).stop 2024-09-12T02:02:12.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.468+0000 7f087d62e640 1 -- 172.21.15.19:0/2953732818 shutdown_connections 2024-09-12T02:02:12.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.468+0000 7f087d62e640 1 --2- 172.21.15.19:0/2953732818 >> v2:172.21.15.135:3300/0 conn(0x7f08780ae140 0x7f087806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.468+0000 7f087d62e640 1 --2- 172.21.15.19:0/2953732818 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0878145bc0 0x7f087815ca70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.468+0000 7f087d62e640 1 -- 172.21.15.19:0/2953732818 >> 172.21.15.19:0/2953732818 conn(0x7f0878073490 msgr2=0x7f08780b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:12.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.469+0000 7f087d62e640 1 -- 172.21.15.19:0/2953732818 shutdown_connections 2024-09-12T02:02:12.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.469+0000 7f087d62e640 1 -- 172.21.15.19:0/2953732818 wait complete. 2024-09-12T02:02:12.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.470+0000 7f087d62e640 1 Processor -- start 2024-09-12T02:02:12.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.470+0000 7f087d62e640 1 -- start start 2024-09-12T02:02:12.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.471+0000 7f087d62e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f087809aa30 0x7f08781f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:12.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.471+0000 7f087d62e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08780ae140 0x7f08780b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:12.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.471+0000 7f087d62e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0878145bc0 0x7f08780cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:12.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.471+0000 7f087d62e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0878145fa0 con 0x7f0878145bc0 2024-09-12T02:02:12.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.471+0000 7f087d62e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f087806c150 con 0x7f08780ae140 2024-09-12T02:02:12.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.471+0000 7f087d62e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f08780cc7a0 con 0x7f087809aa30 2024-09-12T02:02:12.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.471+0000 7f08777fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0878145bc0 0x7f08780cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:12.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.471+0000 7f08777fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0878145bc0 0x7f08780cbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35024/0 (socket says 172.21.15.19:35024) 2024-09-12T02:02:12.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.471+0000 7f08777fe640 1 -- 172.21.15.19:0/2912240099 learned_addr learned my addr 172.21.15.19:0/2912240099 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:12.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.471+0000 7f0876ffd640 1 --2- 172.21.15.19:0/2912240099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f087809aa30 0x7f08781f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:12.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.471+0000 7f08767fc640 1 --2- 172.21.15.19:0/2912240099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08780ae140 0x7f08780b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:12.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.471+0000 7f08777fe640 1 -- 172.21.15.19:0/2912240099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f087809aa30 msgr2=0x7f08781f35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:12.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.471+0000 7f08777fe640 1 --2- 172.21.15.19:0/2912240099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f087809aa30 0x7f08781f35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.471+0000 7f08777fe640 1 -- 172.21.15.19:0/2912240099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08780ae140 msgr2=0x7f08780b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:12.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.471+0000 7f08777fe640 1 --2- 172.21.15.19:0/2912240099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08780ae140 0x7f08780b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.471+0000 7f08777fe640 1 -- 172.21.15.19:0/2912240099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08780cca80 con 0x7f0878145bc0 2024-09-12T02:02:12.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.471+0000 7f08777fe640 1 --2- 172.21.15.19:0/2912240099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0878145bc0 0x7f08780cbce0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f086800c780 tx=0x7f086800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:12.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.472+0000 7f085f7fe640 1 -- 172.21.15.19:0/2912240099 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0868017070 con 0x7f0878145bc0 2024-09-12T02:02:12.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.472+0000 7f085f7fe640 1 -- 172.21.15.19:0/2912240099 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f086800a640 con 0x7f0878145bc0 2024-09-12T02:02:12.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.472+0000 7f087d62e640 1 -- 172.21.15.19:0/2912240099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08780b4470 con 0x7f0878145bc0 2024-09-12T02:02:12.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.472+0000 7f085f7fe640 1 -- 172.21.15.19:0/2912240099 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086800aa30 con 0x7f0878145bc0 2024-09-12T02:02:12.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.472+0000 7f087d62e640 1 -- 172.21.15.19:0/2912240099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08781f3b10 con 0x7f0878145bc0 2024-09-12T02:02:12.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.473+0000 7f087d62e640 1 -- 172.21.15.19:0/2912240099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0878072750 con 0x7f0878145bc0 2024-09-12T02:02:12.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.473+0000 7f085f7fe640 1 -- 172.21.15.19:0/2912240099 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f086801a070 con 0x7f0878145bc0 2024-09-12T02:02:12.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.473+0000 7f085f7fe640 1 --2- 172.21.15.19:0/2912240099 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f086406be30 0x7f086406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:12.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.474+0000 7f085f7fe640 1 -- 172.21.15.19:0/2912240099 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6101+0+0 (secure 0 0 0) 0x7f086808a5c0 con 0x7f0878145bc0 2024-09-12T02:02:12.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.474+0000 7f0876ffd640 1 --2- 172.21.15.19:0/2912240099 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f086406be30 0x7f086406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:12.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.474+0000 7f0876ffd640 1 --2- 172.21.15.19:0/2912240099 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f086406be30 0x7f086406e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0870034000 tx=0x7f087002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:12.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.478+0000 7f085f7fe640 1 -- 172.21.15.19:0/2912240099 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0878072750 con 0x7f0878145bc0 2024-09-12T02:02:12.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.656+0000 7f087d62e640 1 -- 172.21.15.19:0/2912240099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f087806c530 con 0x7f0878145bc0 2024-09-12T02:02:12.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.657+0000 7f085f7fe640 1 -- 172.21.15.19:0/2912240099 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+16946 (secure 0 0 0) 0x7f0868058710 con 0x7f0878145bc0 2024-09-12T02:02:12.657 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:12.657 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":92,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:02:11.686112+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:02:09.629825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-12T02:02:10.664335+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:02:12.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.660+0000 7f087d62e640 1 -- 172.21.15.19:0/2912240099 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f086406be30 msgr2=0x7f086406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:12.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.660+0000 7f087d62e640 1 --2- 172.21.15.19:0/2912240099 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f086406be30 0x7f086406e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0870034000 tx=0x7f087002e000 comp rx=0 tx=0).stop 2024-09-12T02:02:12.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.660+0000 7f087d62e640 1 -- 172.21.15.19:0/2912240099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0878145bc0 msgr2=0x7f08780cbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:12.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.660+0000 7f087d62e640 1 --2- 172.21.15.19:0/2912240099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0878145bc0 0x7f08780cbce0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f086800c780 tx=0x7f086800cc40 comp rx=0 tx=0).stop 2024-09-12T02:02:12.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.660+0000 7f087d62e640 1 -- 172.21.15.19:0/2912240099 shutdown_connections 2024-09-12T02:02:12.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.660+0000 7f087d62e640 1 --2- 172.21.15.19:0/2912240099 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f086406be30 0x7f086406e2f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.660+0000 7f087d62e640 1 --2- 172.21.15.19:0/2912240099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0878145bc0 0x7f08780cbce0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.660+0000 7f087d62e640 1 --2- 172.21.15.19:0/2912240099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08780ae140 0x7f08780b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.660+0000 7f087d62e640 1 --2- 172.21.15.19:0/2912240099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f087809aa30 0x7f08781f35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.660+0000 7f087d62e640 1 -- 172.21.15.19:0/2912240099 >> 172.21.15.19:0/2912240099 conn(0x7f0878073490 msgr2=0x7f08780b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:12.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.660+0000 7f087d62e640 1 -- 172.21.15.19:0/2912240099 shutdown_connections 2024-09-12T02:02:12.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.660+0000 7f087d62e640 1 -- 172.21.15.19:0/2912240099 wait complete. 2024-09-12T02:02:12.671 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:02:12.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.773+0000 7f628b5cf640 1 Processor -- start 2024-09-12T02:02:12.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.774+0000 7f628b5cf640 1 -- start start 2024-09-12T02:02:12.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.774+0000 7f628b5cf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f628415b300 0x7f62840cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:12.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.775+0000 7f628b5cf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f62840cd3f0 0x7f628406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:12.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.775+0000 7f628b5cf640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6284072d30 0x7f628406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:12.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.775+0000 7f628b5cf640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f62840728a0 con 0x7f62840cd3f0 2024-09-12T02:02:12.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.775+0000 7f628b5cf640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f62840cdbe0 con 0x7f6284072d30 2024-09-12T02:02:12.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.775+0000 7f628b5cf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f62840cd900 con 0x7f628415b300 2024-09-12T02:02:12.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.775+0000 7f6288b6a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f62840cd3f0 0x7f628406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:12.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.775+0000 7f6288b6a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f62840cd3f0 0x7f628406f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35038/0 (socket says 172.21.15.19:35038) 2024-09-12T02:02:12.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.775+0000 7f6288b6a640 1 -- 172.21.15.19:0/230092452 learned_addr learned my addr 172.21.15.19:0/230092452 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:12.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.775+0000 7f6289b6c640 1 --2- 172.21.15.19:0/230092452 >> v2:172.21.15.135:3300/0 conn(0x7f6284072d30 0x7f628406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:12.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.775+0000 7f628936b640 1 --2- 172.21.15.19:0/230092452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f628415b300 0x7f62840cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:12.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.775+0000 7f6288b6a640 1 -- 172.21.15.19:0/230092452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f628415b300 msgr2=0x7f62840cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:12.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.775+0000 7f6288b6a640 1 --2- 172.21.15.19:0/230092452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f628415b300 0x7f62840cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.775+0000 7f6288b6a640 1 -- 172.21.15.19:0/230092452 >> v2:172.21.15.135:3300/0 conn(0x7f6284072d30 msgr2=0x7f628406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:12.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.775+0000 7f6288b6a640 1 --2- 172.21.15.19:0/230092452 >> v2:172.21.15.135:3300/0 conn(0x7f6284072d30 0x7f628406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.775+0000 7f6288b6a640 1 -- 172.21.15.19:0/230092452 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6284072250 con 0x7f62840cd3f0 2024-09-12T02:02:12.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.775+0000 7f6289b6c640 1 --2- 172.21.15.19:0/230092452 >> v2:172.21.15.135:3300/0 conn(0x7f6284072d30 0x7f628406f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:12.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.776+0000 7f6288b6a640 1 --2- 172.21.15.19:0/230092452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62840cd3f0 0x7f628406f1c0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f6284072040 tx=0x7f627402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa383c571b260a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:12.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.776+0000 7f627bfff640 1 -- 172.21.15.19:0/230092452 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6274037070 con 0x7f62840cd3f0 2024-09-12T02:02:12.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.776+0000 7f627bfff640 1 -- 172.21.15.19:0/230092452 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6274032440 con 0x7f62840cd3f0 2024-09-12T02:02:12.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.776+0000 7f627bfff640 1 -- 172.21.15.19:0/230092452 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6274032810 con 0x7f62840cd3f0 2024-09-12T02:02:12.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.777+0000 7f628b5cf640 1 -- 172.21.15.19:0/230092452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62840cd3f0 msgr2=0x7f628406f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:12.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.777+0000 7f628b5cf640 1 --2- 172.21.15.19:0/230092452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62840cd3f0 0x7f628406f1c0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f6284072040 tx=0x7f627402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.777+0000 7f628b5cf640 1 -- 172.21.15.19:0/230092452 shutdown_connections 2024-09-12T02:02:12.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.777+0000 7f628b5cf640 1 --2- 172.21.15.19:0/230092452 >> v2:172.21.15.135:3300/0 conn(0x7f6284072d30 0x7f628406f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.777+0000 7f628b5cf640 1 --2- 172.21.15.19:0/230092452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62840cd3f0 0x7f628406f1c0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.777+0000 7f628b5cf640 1 --2- 172.21.15.19:0/230092452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f628415b300 0x7f62840cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.777+0000 7f628b5cf640 1 -- 172.21.15.19:0/230092452 >> 172.21.15.19:0/230092452 conn(0x7f6284067d70 msgr2=0x7f628406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:12.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.777+0000 7f628b5cf640 1 -- 172.21.15.19:0/230092452 shutdown_connections 2024-09-12T02:02:12.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.777+0000 7f628b5cf640 1 -- 172.21.15.19:0/230092452 wait complete. 2024-09-12T02:02:12.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.778+0000 7f628b5cf640 1 Processor -- start 2024-09-12T02:02:12.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.778+0000 7f628b5cf640 1 -- start start 2024-09-12T02:02:12.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.779+0000 7f628b5cf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6284072d30 0x7f6284148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:12.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.779+0000 7f628b5cf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62840cd3f0 0x7f62841489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:12.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.779+0000 7f628b5cf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f628415b300 0x7f6284165de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:12.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.779+0000 7f628b5cf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f62840d0160 con 0x7f62840cd3f0 2024-09-12T02:02:12.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.779+0000 7f628b5cf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f62840cffe0 con 0x7f6284072d30 2024-09-12T02:02:12.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.779+0000 7f628b5cf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f62840b3c40 con 0x7f628415b300 2024-09-12T02:02:12.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.779+0000 7f6288b6a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62840cd3f0 0x7f62841489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:12.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.779+0000 7f6288b6a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62840cd3f0 0x7f62841489d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35046/0 (socket says 172.21.15.19:35046) 2024-09-12T02:02:12.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.779+0000 7f6288b6a640 1 -- 172.21.15.19:0/1181284827 learned_addr learned my addr 172.21.15.19:0/1181284827 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:12.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.779+0000 7f6289b6c640 1 --2- 172.21.15.19:0/1181284827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f628415b300 0x7f6284165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:12.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.779+0000 7f628936b640 1 --2- 172.21.15.19:0/1181284827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6284072d30 0x7f6284148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:12.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.779+0000 7f6288b6a640 1 -- 172.21.15.19:0/1181284827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f628415b300 msgr2=0x7f6284165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:12.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.779+0000 7f6288b6a640 1 --2- 172.21.15.19:0/1181284827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f628415b300 0x7f6284165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.779+0000 7f6288b6a640 1 -- 172.21.15.19:0/1181284827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6284072d30 msgr2=0x7f6284148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.779+0000 7f6288b6a640 1 --2- 172.21.15.19:0/1181284827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6284072d30 0x7f6284148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.779+0000 7f6288b6a640 1 -- 172.21.15.19:0/1181284827 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62840caf60 con 0x7f62840cd3f0 2024-09-12T02:02:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.779+0000 7f6288b6a640 1 --2- 172.21.15.19:0/1181284827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62840cd3f0 0x7f62841489d0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f627402a220 tx=0x7f62740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.780+0000 7f6279ffb640 1 -- 172.21.15.19:0/1181284827 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6274041030 con 0x7f62840cd3f0 2024-09-12T02:02:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.780+0000 7f6279ffb640 1 -- 172.21.15.19:0/1181284827 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6274030440 con 0x7f62840cd3f0 2024-09-12T02:02:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.780+0000 7f628b5cf640 1 -- 172.21.15.19:0/1181284827 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62840cb240 con 0x7f62840cd3f0 2024-09-12T02:02:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.780+0000 7f6279ffb640 1 -- 172.21.15.19:0/1181284827 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6274037040 con 0x7f62840cd3f0 2024-09-12T02:02:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.780+0000 7f628b5cf640 1 -- 172.21.15.19:0/1181284827 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f628414ee80 con 0x7f62840cd3f0 2024-09-12T02:02:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.781+0000 7f628b5cf640 1 -- 172.21.15.19:0/1181284827 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62840ce990 con 0x7f62840cd3f0 2024-09-12T02:02:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.781+0000 7f6279ffb640 1 -- 172.21.15.19:0/1181284827 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6274044070 con 0x7f62840cd3f0 2024-09-12T02:02:12.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.782+0000 7f6279ffb640 1 --2- 172.21.15.19:0/1181284827 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f626806be30 0x7f626806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:12.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.782+0000 7f6279ffb640 1 -- 172.21.15.19:0/1181284827 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6101+0+0 (secure 0 0 0) 0x7f62740ab770 con 0x7f62840cd3f0 2024-09-12T02:02:12.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.782+0000 7f628936b640 1 --2- 172.21.15.19:0/1181284827 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f626806be30 0x7f626806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:12.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.782+0000 7f628936b640 1 --2- 172.21.15.19:0/1181284827 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f626806be30 0x7f626806e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6280009a30 tx=0x7f6280008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:12.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.786+0000 7f6279ffb640 1 -- 172.21.15.19:0/1181284827 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f62840ce990 con 0x7f62840cd3f0 2024-09-12T02:02:12.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.963+0000 7f628b5cf640 1 -- 172.21.15.19:0/1181284827 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f628406f9e0 con 0x7f62840cd3f0 2024-09-12T02:02:12.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.964+0000 7f6279ffb640 1 -- 172.21.15.19:0/1181284827 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+16946 (secure 0 0 0) 0x7f6274079e70 con 0x7f62840cd3f0 2024-09-12T02:02:12.964 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:12.964 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":92,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:02:11.686112+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:02:09.629825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-12T02:02:10.664335+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:02:12.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.966+0000 7f628b5cf640 1 -- 172.21.15.19:0/1181284827 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f626806be30 msgr2=0x7f626806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:12.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.966+0000 7f628b5cf640 1 --2- 172.21.15.19:0/1181284827 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f626806be30 0x7f626806e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6280009a30 tx=0x7f6280008040 comp rx=0 tx=0).stop 2024-09-12T02:02:12.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.966+0000 7f628b5cf640 1 -- 172.21.15.19:0/1181284827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62840cd3f0 msgr2=0x7f62841489d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:12.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.966+0000 7f628b5cf640 1 --2- 172.21.15.19:0/1181284827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62840cd3f0 0x7f62841489d0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f627402a220 tx=0x7f62740046c0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.966+0000 7f628b5cf640 1 -- 172.21.15.19:0/1181284827 shutdown_connections 2024-09-12T02:02:12.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.966+0000 7f628b5cf640 1 --2- 172.21.15.19:0/1181284827 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f626806be30 0x7f626806e2f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.966+0000 7f628b5cf640 1 --2- 172.21.15.19:0/1181284827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f628415b300 0x7f6284165de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.966+0000 7f628b5cf640 1 --2- 172.21.15.19:0/1181284827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62840cd3f0 0x7f62841489d0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.966+0000 7f628b5cf640 1 --2- 172.21.15.19:0/1181284827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6284072d30 0x7f6284148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.966+0000 7f628b5cf640 1 -- 172.21.15.19:0/1181284827 >> 172.21.15.19:0/1181284827 conn(0x7f6284067d70 msgr2=0x7f628415d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:12.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.966+0000 7f628b5cf640 1 -- 172.21.15.19:0/1181284827 shutdown_connections 2024-09-12T02:02:12.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:12.966+0000 7f628b5cf640 1 -- 172.21.15.19:0/1181284827 wait complete. 2024-09-12T02:02:12.976 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:02:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.082+0000 7f1cace0a640 1 Processor -- start 2024-09-12T02:02:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.082+0000 7f1cace0a640 1 -- start start 2024-09-12T02:02:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.083+0000 7f1cace0a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca8162340 0x7f1ca806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.083+0000 7f1cace0a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ca815ff70 con 0x7f1ca8162e30 2024-09-12T02:02:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.083+0000 7f1cace0a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ca80d4d10 con 0x7f1ca80cf280 2024-09-12T02:02:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.083+0000 7f1cace0a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca806de90 con 0x7f1ca8162340 2024-09-12T02:02:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca6d9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1ca8162e30 0x7f1ca80d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39076/0 (socket says 172.21.15.19:39076) 2024-09-12T02:02:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca6d9d640 1 -- 172.21.15.19:0/515658696 learned_addr learned my addr 172.21.15.19:0/515658696 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca659c640 1 --2- 172.21.15.19:0/515658696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca8162340 0x7f1ca806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca559a640 1 -- 172.21.15.19:0/515658696 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3583253158 0 0) 0x7f1ca815ff70 con 0x7f1ca8162e30 2024-09-12T02:02:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca559a640 1 -- 172.21.15.19:0/515658696 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c90003520 con 0x7f1ca8162e30 2024-09-12T02:02:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca559a640 1 -- 172.21.15.19:0/515658696 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1288299244 0 0) 0x7f1c90003520 con 0x7f1ca8162e30 2024-09-12T02:02:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca559a640 1 -- 172.21.15.19:0/515658696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca8162340 msgr2=0x7f1ca806d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca559a640 1 --2- 172.21.15.19:0/515658696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca8162340 0x7f1ca806d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca559a640 1 -- 172.21.15.19:0/515658696 >> v1:172.21.15.135:6789/0 conn(0x7f1ca80cf280 legacy=0x7f1ca8162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca559a640 1 -- 172.21.15.19:0/515658696 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca80d4ff0 con 0x7f1ca8162e30 2024-09-12T02:02:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca559a640 1 -- 172.21.15.19:0/515658696 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f1ca00019f0 con 0x7f1ca8162e30 2024-09-12T02:02:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca559a640 1 -- 172.21.15.19:0/515658696 >> v1:172.21.15.19:6789/0 conn(0x7f1ca8162e30 legacy=0x7f1ca80d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca559a640 1 --2- 172.21.15.19:0/515658696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca8162340 0x7f1c900039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca559a640 1 --2- 172.21.15.19:0/515658696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c90003f20 0x7f1c90004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca559a640 1 --2- 172.21.15.19:0/515658696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c90004d40 0x7f1c900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca559a640 1 -- 172.21.15.19:0/515658696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca806de90 con 0x7f1c90004d40 2024-09-12T02:02:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca559a640 1 -- 172.21.15.19:0/515658696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9000bad0 con 0x7f1c90003f20 2024-09-12T02:02:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca559a640 1 -- 172.21.15.19:0/515658696 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1c9000bcd0 con 0x7f1ca8162340 2024-09-12T02:02:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca6d9d640 1 --2- 172.21.15.19:0/515658696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c90004d40 0x7f1c900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca659c640 1 --2- 172.21.15.19:0/515658696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca8162340 0x7f1c900039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.084+0000 7f1ca5d9b640 1 --2- 172.21.15.19:0/515658696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c90003f20 0x7f1c90004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.085+0000 7f1ca6d9d640 1 -- 172.21.15.19:0/515658696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca8162340 msgr2=0x7f1c900039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.085+0000 7f1ca6d9d640 1 --2- 172.21.15.19:0/515658696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca8162340 0x7f1c900039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.085+0000 7f1ca6d9d640 1 -- 172.21.15.19:0/515658696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c90003f20 msgr2=0x7f1c90004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.085+0000 7f1ca6d9d640 1 --2- 172.21.15.19:0/515658696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c90003f20 0x7f1c90004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.085+0000 7f1ca6d9d640 1 -- 172.21.15.19:0/515658696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c90003520 con 0x7f1c90004d40 2024-09-12T02:02:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.085+0000 7f1ca6d9d640 1 --2- 172.21.15.19:0/515658696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c90004d40 0x7f1c900051c0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f1ca000a810 tx=0x7f1c90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7faf9a83c50802e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.085+0000 7f1ca559a640 1 -- 172.21.15.19:0/515658696 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca000a430 con 0x7f1c90004d40 2024-09-12T02:02:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.086+0000 7f1ca559a640 1 -- 172.21.15.19:0/515658696 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca002f070 con 0x7f1c90004d40 2024-09-12T02:02:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.086+0000 7f1ca559a640 1 -- 172.21.15.19:0/515658696 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca002bc90 con 0x7f1c90004d40 2024-09-12T02:02:13.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.086+0000 7f1cace0a640 1 -- 172.21.15.19:0/515658696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c90004d40 msgr2=0x7f1c900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.086+0000 7f1cace0a640 1 --2- 172.21.15.19:0/515658696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c90004d40 0x7f1c900051c0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f1ca000a810 tx=0x7f1c90005830 comp rx=0 tx=0).stop 2024-09-12T02:02:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.086+0000 7f1ca6d9d640 1 -- 172.21.15.19:0/515658696 reap_dead start 2024-09-12T02:02:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.086+0000 7f1cace0a640 1 -- 172.21.15.19:0/515658696 shutdown_connections 2024-09-12T02:02:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.086+0000 7f1cace0a640 1 -- 172.21.15.19:0/515658696 >> 172.21.15.19:0/515658696 conn(0x7f1ca808bfc0 msgr2=0x7f1ca80d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.086+0000 7f1cace0a640 1 -- 172.21.15.19:0/515658696 shutdown_connections 2024-09-12T02:02:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.086+0000 7f1cace0a640 1 -- 172.21.15.19:0/515658696 wait complete. 2024-09-12T02:02:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.088+0000 7f1cace0a640 1 Processor -- start 2024-09-12T02:02:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.088+0000 7f1cace0a640 1 -- start start 2024-09-12T02:02:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.088+0000 7f1cace0a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c90004d40 0x7f1ca8154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.088+0000 7f1cace0a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca80b4760 0x7f1ca81f77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.088+0000 7f1cace0a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca81f7d20 0x7f1ca81599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.088+0000 7f1cace0a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca80cf6c0 con 0x7f1ca80b4760 2024-09-12T02:02:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.088+0000 7f1cace0a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca80d52d0 con 0x7f1c90004d40 2024-09-12T02:02:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.088+0000 7f1cace0a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca806d740 con 0x7f1ca81f7d20 2024-09-12T02:02:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.088+0000 7f1ca5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca80b4760 0x7f1ca81f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.088+0000 7f1ca5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca80b4760 0x7f1ca81f77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35062/0 (socket says 172.21.15.19:35062) 2024-09-12T02:02:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.088+0000 7f1ca5d9b640 1 -- 172.21.15.19:0/1765429446 learned_addr learned my addr 172.21.15.19:0/1765429446 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.089+0000 7f1ca659c640 1 --2- 172.21.15.19:0/1765429446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c90004d40 0x7f1ca8154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.089+0000 7f1ca6d9d640 1 --2- 172.21.15.19:0/1765429446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca81f7d20 0x7f1ca81599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.089+0000 7f1ca5d9b640 1 -- 172.21.15.19:0/1765429446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca81f7d20 msgr2=0x7f1ca81599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.089+0000 7f1ca5d9b640 1 --2- 172.21.15.19:0/1765429446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca81f7d20 0x7f1ca81599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.089+0000 7f1ca5d9b640 1 -- 172.21.15.19:0/1765429446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c90004d40 msgr2=0x7f1ca8154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.089+0000 7f1ca5d9b640 1 --2- 172.21.15.19:0/1765429446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c90004d40 0x7f1ca8154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.089+0000 7f1ca5d9b640 1 -- 172.21.15.19:0/1765429446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca81f8280 con 0x7f1ca80b4760 2024-09-12T02:02:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.089+0000 7f1ca659c640 1 --2- 172.21.15.19:0/1765429446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c90004d40 0x7f1ca8154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.089+0000 7f1ca5d9b640 1 --2- 172.21.15.19:0/1765429446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca80b4760 0x7f1ca81f77e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00e7d0 tx=0x7f1c9c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:13.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.089+0000 7f1c96ffd640 1 -- 172.21.15.19:0/1765429446 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c00ee80 con 0x7f1ca80b4760 2024-09-12T02:02:13.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.089+0000 7f1c96ffd640 1 -- 172.21.15.19:0/1765429446 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c9c0052e0 con 0x7f1ca80b4760 2024-09-12T02:02:13.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.089+0000 7f1cace0a640 1 -- 172.21.15.19:0/1765429446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca81f8560 con 0x7f1ca80b4760 2024-09-12T02:02:13.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.089+0000 7f1c96ffd640 1 -- 172.21.15.19:0/1765429446 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c0054b0 con 0x7f1ca80b4760 2024-09-12T02:02:13.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.089+0000 7f1cace0a640 1 -- 172.21.15.19:0/1765429446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca80cc8d0 con 0x7f1ca80b4760 2024-09-12T02:02:13.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.090+0000 7f1cace0a640 1 -- 172.21.15.19:0/1765429446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca806db70 con 0x7f1ca80b4760 2024-09-12T02:02:13.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.090+0000 7f1c96ffd640 1 -- 172.21.15.19:0/1765429446 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1c9c01a020 con 0x7f1ca80b4760 2024-09-12T02:02:13.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.091+0000 7f1c96ffd640 1 --2- 172.21.15.19:0/1765429446 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1c8806c000 0x7f1c8806e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:13.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.091+0000 7f1c96ffd640 1 -- 172.21.15.19:0/1765429446 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6101+0+0 (secure 0 0 0) 0x7f1c9c08a5c0 con 0x7f1ca80b4760 2024-09-12T02:02:13.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.091+0000 7f1ca659c640 1 --2- 172.21.15.19:0/1765429446 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1c8806c000 0x7f1c8806e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:13.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.092+0000 7f1ca659c640 1 --2- 172.21.15.19:0/1765429446 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1c8806c000 0x7f1c8806e4c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1c98009bc0 tx=0x7f1c98008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:13.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.095+0000 7f1c96ffd640 1 -- 172.21.15.19:0/1765429446 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1c9c021020 con 0x7f1ca80b4760 2024-09-12T02:02:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.307+0000 7f1cace0a640 1 -- 172.21.15.19:0/1765429446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1ca80ba450 con 0x7f1ca80b4760 2024-09-12T02:02:13.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.330+0000 7f1c96ffd640 1 -- 172.21.15.19:0/1765429446 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v75) ==== 118+0+0 (secure 0 0 0) 0x7f1c9c058de0 con 0x7f1ca80b4760 2024-09-12T02:02:13.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.332+0000 7f1cace0a640 1 -- 172.21.15.19:0/1765429446 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1c8806c000 msgr2=0x7f1c8806e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:13.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.332+0000 7f1cace0a640 1 --2- 172.21.15.19:0/1765429446 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1c8806c000 0x7f1c8806e4c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1c98009bc0 tx=0x7f1c98008040 comp rx=0 tx=0).stop 2024-09-12T02:02:13.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.332+0000 7f1cace0a640 1 -- 172.21.15.19:0/1765429446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca80b4760 msgr2=0x7f1ca81f77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:13.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.332+0000 7f1cace0a640 1 --2- 172.21.15.19:0/1765429446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca80b4760 0x7f1ca81f77e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00e7d0 tx=0x7f1c9c00ec90 comp rx=0 tx=0).stop 2024-09-12T02:02:13.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.332+0000 7f1cace0a640 1 -- 172.21.15.19:0/1765429446 shutdown_connections 2024-09-12T02:02:13.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.332+0000 7f1cace0a640 1 --2- 172.21.15.19:0/1765429446 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1c8806c000 0x7f1c8806e4c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:13.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.332+0000 7f1cace0a640 1 --2- 172.21.15.19:0/1765429446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca81f7d20 0x7f1ca81599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:13.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.332+0000 7f1cace0a640 1 --2- 172.21.15.19:0/1765429446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca80b4760 0x7f1ca81f77e0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:13.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.332+0000 7f1cace0a640 1 --2- 172.21.15.19:0/1765429446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c90004d40 0x7f1ca8154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:13.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.332+0000 7f1cace0a640 1 -- 172.21.15.19:0/1765429446 >> 172.21.15.19:0/1765429446 conn(0x7f1ca808bfc0 msgr2=0x7f1ca8162720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:13.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.332+0000 7f1cace0a640 1 -- 172.21.15.19:0/1765429446 shutdown_connections 2024-09-12T02:02:13.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.332+0000 7f1cace0a640 1 -- 172.21.15.19:0/1765429446 wait complete. 2024-09-12T02:02:13.343 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:02:13.343 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:02:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.450+0000 7f26f3682640 1 Processor -- start 2024-09-12T02:02:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.450+0000 7f26f3682640 1 -- start start 2024-09-12T02:02:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.451+0000 7f26f3682640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26ec162340 0x7f26ec06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.451+0000 7f26f3682640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f26ec0cf280 0x7f26ec162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.451+0000 7f26f3682640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f26ec162c60 0x7f26ec0d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.451+0000 7f26f3682640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f26ec06de90 con 0x7f26ec162c60 2024-09-12T02:02:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.451+0000 7f26f3682640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f26ec15ff70 con 0x7f26ec0cf280 2024-09-12T02:02:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.451+0000 7f26f3682640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f26ec0d4d10 con 0x7f26ec162340 2024-09-12T02:02:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.451+0000 7f26f1c1f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f26ec162c60 0x7f26ec0d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.451+0000 7f26f1c1f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f26ec162c60 0x7f26ec0d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35070/0 (socket says 172.21.15.19:35070) 2024-09-12T02:02:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.451+0000 7f26f1c1f640 1 -- 172.21.15.19:0/3452133641 learned_addr learned my addr 172.21.15.19:0/3452133641 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:13.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.451+0000 7f26f141e640 1 --2- 172.21.15.19:0/3452133641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26ec162340 0x7f26ec06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:13.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.451+0000 7f26f0c1d640 1 --2- 172.21.15.19:0/3452133641 >> v2:172.21.15.135:3300/0 conn(0x7f26ec0cf280 0x7f26ec162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:13.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.452+0000 7f26f1c1f640 1 -- 172.21.15.19:0/3452133641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26ec162340 msgr2=0x7f26ec06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:13.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.452+0000 7f26f1c1f640 1 --2- 172.21.15.19:0/3452133641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26ec162340 0x7f26ec06d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:13.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.452+0000 7f26f1c1f640 1 -- 172.21.15.19:0/3452133641 >> v2:172.21.15.135:3300/0 conn(0x7f26ec0cf280 msgr2=0x7f26ec162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:13.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.452+0000 7f26f1c1f640 1 --2- 172.21.15.19:0/3452133641 >> v2:172.21.15.135:3300/0 conn(0x7f26ec0cf280 0x7f26ec162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:13.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.452+0000 7f26f1c1f640 1 -- 172.21.15.19:0/3452133641 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ec0d4ff0 con 0x7f26ec162c60 2024-09-12T02:02:13.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.452+0000 7f26f0c1d640 1 --2- 172.21.15.19:0/3452133641 >> v2:172.21.15.135:3300/0 conn(0x7f26ec0cf280 0x7f26ec162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.452+0000 7f26f1c1f640 1 --2- 172.21.15.19:0/3452133641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26ec162c60 0x7f26ec0d2990 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f26ec08d200 tx=0x7f26e402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4bde8c8ed06ebb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.452+0000 7f26e3fff640 1 -- 172.21.15.19:0/3452133641 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4036070 con 0x7f26ec162c60 2024-09-12T02:02:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.452+0000 7f26e3fff640 1 -- 172.21.15.19:0/3452133641 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e4031600 con 0x7f26ec162c60 2024-09-12T02:02:13.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.452+0000 7f26e3fff640 1 -- 172.21.15.19:0/3452133641 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e40319d0 con 0x7f26ec162c60 2024-09-12T02:02:13.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.453+0000 7f26f3682640 1 -- 172.21.15.19:0/3452133641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26ec162c60 msgr2=0x7f26ec0d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:13.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.453+0000 7f26f3682640 1 --2- 172.21.15.19:0/3452133641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26ec162c60 0x7f26ec0d2990 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f26ec08d200 tx=0x7f26e402a610 comp rx=0 tx=0).stop 2024-09-12T02:02:13.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.453+0000 7f26f3682640 1 -- 172.21.15.19:0/3452133641 shutdown_connections 2024-09-12T02:02:13.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.453+0000 7f26f3682640 1 --2- 172.21.15.19:0/3452133641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26ec162c60 0x7f26ec0d2990 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:13.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.453+0000 7f26f3682640 1 --2- 172.21.15.19:0/3452133641 >> v2:172.21.15.135:3300/0 conn(0x7f26ec0cf280 0x7f26ec162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:13.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.453+0000 7f26f3682640 1 --2- 172.21.15.19:0/3452133641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26ec162340 0x7f26ec06d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:13.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.453+0000 7f26f3682640 1 -- 172.21.15.19:0/3452133641 >> 172.21.15.19:0/3452133641 conn(0x7f26ec08bfc0 msgr2=0x7f26ec0d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:13.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.453+0000 7f26f3682640 1 -- 172.21.15.19:0/3452133641 shutdown_connections 2024-09-12T02:02:13.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.453+0000 7f26f3682640 1 -- 172.21.15.19:0/3452133641 wait complete. 2024-09-12T02:02:13.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.454+0000 7f26f3682640 1 Processor -- start 2024-09-12T02:02:13.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.454+0000 7f26f3682640 1 -- start start 2024-09-12T02:02:13.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.455+0000 7f26f3682640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26ec0cf280 0x7f26ec153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:13.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.455+0000 7f26f3682640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26ec162340 0x7f26ec15bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:13.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.455+0000 7f26f3682640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec162c60 0x7f26ec15bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:13.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.455+0000 7f26f3682640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec0cf6c0 con 0x7f26ec0cf280 2024-09-12T02:02:13.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.455+0000 7f26f3682640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec0d52d0 con 0x7f26ec162c60 2024-09-12T02:02:13.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.455+0000 7f26f3682640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f26ec163110 con 0x7f26ec162340 2024-09-12T02:02:13.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.455+0000 7f26f141e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26ec0cf280 0x7f26ec153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:13.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.455+0000 7f26f141e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26ec0cf280 0x7f26ec153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35080/0 (socket says 172.21.15.19:35080) 2024-09-12T02:02:13.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.455+0000 7f26f141e640 1 -- 172.21.15.19:0/2149318257 learned_addr learned my addr 172.21.15.19:0/2149318257 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:13.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.455+0000 7f26f0c1d640 1 --2- 172.21.15.19:0/2149318257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26ec162340 0x7f26ec15bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:13.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.455+0000 7f26f1c1f640 1 --2- 172.21.15.19:0/2149318257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec162c60 0x7f26ec15bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:13.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.455+0000 7f26f141e640 1 -- 172.21.15.19:0/2149318257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26ec162340 msgr2=0x7f26ec15bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:13.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.455+0000 7f26f141e640 1 --2- 172.21.15.19:0/2149318257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26ec162340 0x7f26ec15bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:13.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.455+0000 7f26f141e640 1 -- 172.21.15.19:0/2149318257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec162c60 msgr2=0x7f26ec15bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:13.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.455+0000 7f26f141e640 1 --2- 172.21.15.19:0/2149318257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec162c60 0x7f26ec15bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:13.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.455+0000 7f26f141e640 1 -- 172.21.15.19:0/2149318257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ec0cbb60 con 0x7f26ec0cf280 2024-09-12T02:02:13.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.456+0000 7f26f141e640 1 --2- 172.21.15.19:0/2149318257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26ec0cf280 0x7f26ec153b80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f26e800d5f0 tx=0x7f26e800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:13.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.456+0000 7f26e1ffb640 1 -- 172.21.15.19:0/2149318257 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e80125f0 con 0x7f26ec0cf280 2024-09-12T02:02:13.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.456+0000 7f26e1ffb640 1 -- 172.21.15.19:0/2149318257 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e8019070 con 0x7f26ec0cf280 2024-09-12T02:02:13.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.456+0000 7f26f3682640 1 -- 172.21.15.19:0/2149318257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26ec0cbe40 con 0x7f26ec0cf280 2024-09-12T02:02:13.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.456+0000 7f26e1ffb640 1 -- 172.21.15.19:0/2149318257 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e80129d0 con 0x7f26ec0cf280 2024-09-12T02:02:13.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.456+0000 7f26f3682640 1 -- 172.21.15.19:0/2149318257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26ec0cc400 con 0x7f26ec0cf280 2024-09-12T02:02:13.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.457+0000 7f26f3682640 1 -- 172.21.15.19:0/2149318257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26ec162720 con 0x7f26ec0cf280 2024-09-12T02:02:13.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.457+0000 7f26e1ffb640 1 -- 172.21.15.19:0/2149318257 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f26e8012b70 con 0x7f26ec0cf280 2024-09-12T02:02:13.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.458+0000 7f26e1ffb640 1 --2- 172.21.15.19:0/2149318257 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26d006be30 0x7f26d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:13.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.458+0000 7f26e1ffb640 1 -- 172.21.15.19:0/2149318257 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6101+0+0 (secure 0 0 0) 0x7f26e808b2c0 con 0x7f26ec0cf280 2024-09-12T02:02:13.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.458+0000 7f26f0c1d640 1 --2- 172.21.15.19:0/2149318257 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26d006be30 0x7f26d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:13.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.459+0000 7f26f0c1d640 1 --2- 172.21.15.19:0/2149318257 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26d006be30 0x7f26d006e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f26ec0c7b50 tx=0x7f26dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:13.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.462+0000 7f26e1ffb640 1 -- 172.21.15.19:0/2149318257 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26e80594a0 con 0x7f26ec0cf280 2024-09-12T02:02:13.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:13.678+0000 7f26f3682640 1 -- 172.21.15.19:0/2149318257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f26ec08e640 con 0x7f26ec0cf280 2024-09-12T02:02:14.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.340+0000 7f26e1ffb640 1 -- 172.21.15.19:0/2149318257 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v76) ==== 122+0+0 (secure 0 0 0) 0x7f26e805d7a0 con 0x7f26ec0cf280 2024-09-12T02:02:14.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.343+0000 7f26f3682640 1 -- 172.21.15.19:0/2149318257 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26d006be30 msgr2=0x7f26d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:14.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.343+0000 7f26f3682640 1 --2- 172.21.15.19:0/2149318257 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26d006be30 0x7f26d006e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f26ec0c7b50 tx=0x7f26dc008040 comp rx=0 tx=0).stop 2024-09-12T02:02:14.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.343+0000 7f26f3682640 1 -- 172.21.15.19:0/2149318257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26ec0cf280 msgr2=0x7f26ec153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:14.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.343+0000 7f26f3682640 1 --2- 172.21.15.19:0/2149318257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26ec0cf280 0x7f26ec153b80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f26e800d5f0 tx=0x7f26e800dab0 comp rx=0 tx=0).stop 2024-09-12T02:02:14.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.343+0000 7f26f3682640 1 -- 172.21.15.19:0/2149318257 shutdown_connections 2024-09-12T02:02:14.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.343+0000 7f26f3682640 1 --2- 172.21.15.19:0/2149318257 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26d006be30 0x7f26d006e2f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:14.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.343+0000 7f26f3682640 1 --2- 172.21.15.19:0/2149318257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec162c60 0x7f26ec15bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:14.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.343+0000 7f26f3682640 1 --2- 172.21.15.19:0/2149318257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26ec162340 0x7f26ec15bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:14.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.343+0000 7f26f3682640 1 --2- 172.21.15.19:0/2149318257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26ec0cf280 0x7f26ec153b80 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:14.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.343+0000 7f26f3682640 1 -- 172.21.15.19:0/2149318257 >> 172.21.15.19:0/2149318257 conn(0x7f26ec08bfc0 msgr2=0x7f26ec0cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:14.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.343+0000 7f26f3682640 1 -- 172.21.15.19:0/2149318257 shutdown_connections 2024-09-12T02:02:14.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.343+0000 7f26f3682640 1 -- 172.21.15.19:0/2149318257 wait complete. 2024-09-12T02:02:14.359 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:02:14.360 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:14.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.469+0000 7f3e483b7640 1 Processor -- start 2024-09-12T02:02:14.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.469+0000 7f3e483b7640 1 -- start start 2024-09-12T02:02:14.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.470+0000 7f3e483b7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3e4015e5f0 0x7f3e400d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:14.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.470+0000 7f3e483b7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e400d3690 con 0x7f3e400b6690 2024-09-12T02:02:14.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.470+0000 7f3e483b7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e400d3970 con 0x7f3e400d30f0 2024-09-12T02:02:14.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.470+0000 7f3e483b7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f3e4006d530 con 0x7f3e4015e5f0 2024-09-12T02:02:14.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.470+0000 7f3e46153640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3e4015e5f0 0x7f3e400d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:14.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.470+0000 7f3e46954640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3e400b6690 0x7f3e4006d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39090/0 (socket says 172.21.15.19:39090) 2024-09-12T02:02:14.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.470+0000 7f3e46954640 1 -- 172.21.15.19:0/1552350682 learned_addr learned my addr 172.21.15.19:0/1552350682 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:14.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.470+0000 7f3e46153640 1 -- 172.21.15.19:0/1552350682 >> v1:172.21.15.135:6789/0 conn(0x7f3e400d30f0 legacy=0x7f3e400b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:14.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.470+0000 7f3e46153640 1 -- 172.21.15.19:0/1552350682 >> v1:172.21.15.19:6789/0 conn(0x7f3e400b6690 legacy=0x7f3e4006d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:14.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.471+0000 7f3e46153640 1 -- 172.21.15.19:0/1552350682 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4006cee0 con 0x7f3e4015e5f0 2024-09-12T02:02:14.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.471+0000 7f3e46153640 1 --2- 172.21.15.19:0/1552350682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4015e5f0 0x7f3e400d4dd0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0097d0 tx=0x7f3e3c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c414f88f6956d6b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:14.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.471+0000 7f3e45151640 1 -- 172.21.15.19:0/1552350682 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c037070 con 0x7f3e4015e5f0 2024-09-12T02:02:14.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.471+0000 7f3e45151640 1 -- 172.21.15.19:0/1552350682 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e3c02ad90 con 0x7f3e4015e5f0 2024-09-12T02:02:14.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.471+0000 7f3e45151640 1 -- 172.21.15.19:0/1552350682 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c032660 con 0x7f3e4015e5f0 2024-09-12T02:02:14.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.472+0000 7f3e483b7640 1 -- 172.21.15.19:0/1552350682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4015e5f0 msgr2=0x7f3e400d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:14.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.472+0000 7f3e483b7640 1 --2- 172.21.15.19:0/1552350682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4015e5f0 0x7f3e400d4dd0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0097d0 tx=0x7f3e3c02a100 comp rx=0 tx=0).stop 2024-09-12T02:02:14.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.472+0000 7f3e483b7640 1 -- 172.21.15.19:0/1552350682 shutdown_connections 2024-09-12T02:02:14.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.472+0000 7f3e483b7640 1 --2- 172.21.15.19:0/1552350682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4015e5f0 0x7f3e400d4dd0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:14.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.472+0000 7f3e483b7640 1 -- 172.21.15.19:0/1552350682 >> 172.21.15.19:0/1552350682 conn(0x7f3e4008bfc0 msgr2=0x7f3e400d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:14.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.472+0000 7f3e483b7640 1 -- 172.21.15.19:0/1552350682 shutdown_connections 2024-09-12T02:02:14.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.472+0000 7f3e483b7640 1 -- 172.21.15.19:0/1552350682 wait complete. 2024-09-12T02:02:14.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.473+0000 7f3e483b7640 1 Processor -- start 2024-09-12T02:02:14.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.473+0000 7f3e483b7640 1 -- start start 2024-09-12T02:02:14.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.474+0000 7f3e483b7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e400b6690 0x7f3e401f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:14.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.474+0000 7f3e483b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e400d30f0 0x7f3e401f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:14.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.474+0000 7f3e483b7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e4015e5f0 0x7f3e401f4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:14.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.474+0000 7f3e483b7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e400d5310 con 0x7f3e400d30f0 2024-09-12T02:02:14.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.474+0000 7f3e483b7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4015e9d0 con 0x7f3e400b6690 2024-09-12T02:02:14.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.474+0000 7f3e483b7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4006e0d0 con 0x7f3e4015e5f0 2024-09-12T02:02:14.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.474+0000 7f3e45952640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e400d30f0 0x7f3e401f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:14.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.474+0000 7f3e45952640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e400d30f0 0x7f3e401f45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35106/0 (socket says 172.21.15.19:35106) 2024-09-12T02:02:14.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.474+0000 7f3e45952640 1 -- 172.21.15.19:0/4076374374 learned_addr learned my addr 172.21.15.19:0/4076374374 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:14.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.474+0000 7f3e46153640 1 --2- 172.21.15.19:0/4076374374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e400b6690 0x7f3e401f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:14.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.474+0000 7f3e46954640 1 --2- 172.21.15.19:0/4076374374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e4015e5f0 0x7f3e401f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:14.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.475+0000 7f3e45952640 1 -- 172.21.15.19:0/4076374374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e4015e5f0 msgr2=0x7f3e401f4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:14.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.475+0000 7f3e45952640 1 --2- 172.21.15.19:0/4076374374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e4015e5f0 0x7f3e401f4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:14.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.475+0000 7f3e45952640 1 -- 172.21.15.19:0/4076374374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e400b6690 msgr2=0x7f3e401f72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:14.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.475+0000 7f3e45952640 1 --2- 172.21.15.19:0/4076374374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e400b6690 0x7f3e401f72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:14.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.475+0000 7f3e45952640 1 -- 172.21.15.19:0/4076374374 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4015d0f0 con 0x7f3e400d30f0 2024-09-12T02:02:14.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.475+0000 7f3e45952640 1 --2- 172.21.15.19:0/4076374374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e400d30f0 0x7f3e401f45d0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000c460 tx=0x7f3e3000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:14.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.475+0000 7f3e36ffd640 1 -- 172.21.15.19:0/4076374374 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e30016020 con 0x7f3e400d30f0 2024-09-12T02:02:14.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.475+0000 7f3e36ffd640 1 -- 172.21.15.19:0/4076374374 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e30012870 con 0x7f3e400d30f0 2024-09-12T02:02:14.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.475+0000 7f3e483b7640 1 -- 172.21.15.19:0/4076374374 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e4015d3d0 con 0x7f3e400d30f0 2024-09-12T02:02:14.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.475+0000 7f3e36ffd640 1 -- 172.21.15.19:0/4076374374 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e30012c60 con 0x7f3e400d30f0 2024-09-12T02:02:14.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.475+0000 7f3e483b7640 1 -- 172.21.15.19:0/4076374374 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e401e7330 con 0x7f3e400d30f0 2024-09-12T02:02:14.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.476+0000 7f3e483b7640 1 -- 172.21.15.19:0/4076374374 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e401e7530 con 0x7f3e400d30f0 2024-09-12T02:02:14.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.476+0000 7f3e36ffd640 1 -- 172.21.15.19:0/4076374374 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e30019020 con 0x7f3e400d30f0 2024-09-12T02:02:14.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.477+0000 7f3e36ffd640 1 --2- 172.21.15.19:0/4076374374 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3e2406be30 0x7f3e2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:14.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.477+0000 7f3e36ffd640 1 -- 172.21.15.19:0/4076374374 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6101+0+0 (secure 0 0 0) 0x7f3e3008ab70 con 0x7f3e400d30f0 2024-09-12T02:02:14.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.477+0000 7f3e46153640 1 --2- 172.21.15.19:0/4076374374 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3e2406be30 0x7f3e2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:14.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.478+0000 7f3e46153640 1 --2- 172.21.15.19:0/4076374374 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3e2406be30 0x7f3e2406e2f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c034000 tx=0x7f3e3c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:14.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.481+0000 7f3e36ffd640 1 -- 172.21.15.19:0/4076374374 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e401e7530 con 0x7f3e400d30f0 2024-09-12T02:02:14.636 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:02:14.636+0000 7fccea454640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:02:14.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.694+0000 7f3e483b7640 1 -- 172.21.15.19:0/4076374374 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e4006dd40 con 0x7f3e400d30f0 2024-09-12T02:02:14.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.695+0000 7f3e36ffd640 1 -- 172.21.15.19:0/4076374374 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5225 (secure 0 0 0) 0x7f3e30020030 con 0x7f3e400d30f0 2024-09-12T02:02:14.694 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:14.695 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":76,"btime":"2024-09-12T02:02:14:334033+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/613869354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":613869354},{"type":"v1","addr":"172.21.15.19:6834","nonce":613869354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:02:13.679357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6451":{"gid":6451,"name":"d","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6837/3774685060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3774685060},{"type":"v1","addr":"172.21.15.135:6837","nonce":3774685060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6451,"qdb_cluster":[6451]},"id":6}]} 2024-09-12T02:02:14.695 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 76 2024-09-12T02:02:14.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.697+0000 7f3e483b7640 1 -- 172.21.15.19:0/4076374374 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3e2406be30 msgr2=0x7f3e2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:14.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.697+0000 7f3e483b7640 1 --2- 172.21.15.19:0/4076374374 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3e2406be30 0x7f3e2406e2f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c034000 tx=0x7f3e3c02e000 comp rx=0 tx=0).stop 2024-09-12T02:02:14.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.697+0000 7f3e483b7640 1 -- 172.21.15.19:0/4076374374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e400d30f0 msgr2=0x7f3e401f45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:14.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.697+0000 7f3e483b7640 1 --2- 172.21.15.19:0/4076374374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e400d30f0 0x7f3e401f45d0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000c460 tx=0x7f3e3000c920 comp rx=0 tx=0).stop 2024-09-12T02:02:14.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.697+0000 7f3e483b7640 1 -- 172.21.15.19:0/4076374374 shutdown_connections 2024-09-12T02:02:14.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.697+0000 7f3e483b7640 1 --2- 172.21.15.19:0/4076374374 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3e2406be30 0x7f3e2406e2f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:14.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.697+0000 7f3e483b7640 1 --2- 172.21.15.19:0/4076374374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e4015e5f0 0x7f3e401f4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:14.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.697+0000 7f3e483b7640 1 --2- 172.21.15.19:0/4076374374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e400d30f0 0x7f3e401f45d0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:14.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.697+0000 7f3e483b7640 1 --2- 172.21.15.19:0/4076374374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e400b6690 0x7f3e401f72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:14.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.697+0000 7f3e483b7640 1 -- 172.21.15.19:0/4076374374 >> 172.21.15.19:0/4076374374 conn(0x7f3e4008bfc0 msgr2=0x7f3e400b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:14.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.697+0000 7f3e483b7640 1 -- 172.21.15.19:0/4076374374 shutdown_connections 2024-09-12T02:02:14.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.697+0000 7f3e483b7640 1 -- 172.21.15.19:0/4076374374 wait complete. 2024-09-12T02:02:14.707 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:02:14.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.810+0000 7f7e9e7d6640 1 Processor -- start 2024-09-12T02:02:14.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.810+0000 7f7e9e7d6640 1 -- start start 2024-09-12T02:02:14.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.811+0000 7f7e9e7d6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7e980d1540 0x7f7e9806dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:14.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.811+0000 7f7e9e7d6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e980d1970 con 0x7f7e9815e740 2024-09-12T02:02:14.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.811+0000 7f7e9e7d6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e980d0780 con 0x7f7e9809b690 2024-09-12T02:02:14.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.811+0000 7f7e9e7d6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f7e9815eb20 con 0x7f7e980d1540 2024-09-12T02:02:14.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.811+0000 7f7e97fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7e9815e740 0x7f7e9806d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39096/0 (socket says 172.21.15.19:39096) 2024-09-12T02:02:14.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.811+0000 7f7e97fff640 1 -- 172.21.15.19:0/2982593209 learned_addr learned my addr 172.21.15.19:0/2982593209 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:14.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.811+0000 7f7e977fe640 1 --2- 172.21.15.19:0/2982593209 >> v2:172.21.15.135:3300/0 conn(0x7f7e980d1540 0x7f7e9806dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:14.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.811+0000 7f7e96ffd640 1 -- 172.21.15.19:0/2982593209 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2188186260 0 0) 0x7f7e980d1970 con 0x7f7e9815e740 2024-09-12T02:02:14.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.811+0000 7f7e96ffd640 1 -- 172.21.15.19:0/2982593209 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e80003520 con 0x7f7e9815e740 2024-09-12T02:02:14.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.811+0000 7f7e96ffd640 1 -- 172.21.15.19:0/2982593209 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3665242416 0 0) 0x7f7e80003520 con 0x7f7e9815e740 2024-09-12T02:02:14.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.811+0000 7f7e96ffd640 1 -- 172.21.15.19:0/2982593209 >> v2:172.21.15.135:3300/0 conn(0x7f7e980d1540 msgr2=0x7f7e9806dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:14.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e96ffd640 1 --2- 172.21.15.19:0/2982593209 >> v2:172.21.15.135:3300/0 conn(0x7f7e980d1540 0x7f7e9806dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:14.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e96ffd640 1 -- 172.21.15.19:0/2982593209 >> v1:172.21.15.135:6789/0 conn(0x7f7e9809b690 legacy=0x7f7e98070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:14.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e96ffd640 1 -- 172.21.15.19:0/2982593209 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e980d0a60 con 0x7f7e9815e740 2024-09-12T02:02:14.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e96ffd640 1 -- 172.21.15.19:0/2982593209 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f7e88001670 con 0x7f7e9815e740 2024-09-12T02:02:14.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e96ffd640 1 -- 172.21.15.19:0/2982593209 >> v1:172.21.15.19:6789/0 conn(0x7f7e9815e740 legacy=0x7f7e9806d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:14.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e96ffd640 1 --2- 172.21.15.19:0/2982593209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e800039b0 0x7f7e80003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:14.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e96ffd640 1 --2- 172.21.15.19:0/2982593209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e80004800 0x7f7e80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:14.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e96ffd640 1 --2- 172.21.15.19:0/2982593209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e800051c0 0x7f7e8000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:14.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e96ffd640 1 -- 172.21.15.19:0/2982593209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9815eb20 con 0x7f7e800051c0 2024-09-12T02:02:14.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e96ffd640 1 -- 172.21.15.19:0/2982593209 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8000bf80 con 0x7f7e800039b0 2024-09-12T02:02:14.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e96ffd640 1 -- 172.21.15.19:0/2982593209 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8000c180 con 0x7f7e80004800 2024-09-12T02:02:14.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e9cd73640 1 --2- 172.21.15.19:0/2982593209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e800051c0 0x7f7e8000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:14.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e97fff640 1 --2- 172.21.15.19:0/2982593209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e800039b0 0x7f7e80003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:14.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e977fe640 1 --2- 172.21.15.19:0/2982593209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e80004800 0x7f7e80004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:14.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e9cd73640 1 -- 172.21.15.19:0/2982593209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e80004800 msgr2=0x7f7e80004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:14.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e9cd73640 1 --2- 172.21.15.19:0/2982593209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e80004800 0x7f7e80004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:14.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e9cd73640 1 -- 172.21.15.19:0/2982593209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e800039b0 msgr2=0x7f7e80003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:14.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e9cd73640 1 --2- 172.21.15.19:0/2982593209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e800039b0 0x7f7e80003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:14.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.812+0000 7f7e9cd73640 1 -- 172.21.15.19:0/2982593209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e80003520 con 0x7f7e800051c0 2024-09-12T02:02:14.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.813+0000 7f7e9cd73640 1 -- 172.21.15.19:0/2982593209 reap_dead start 2024-09-12T02:02:14.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.813+0000 7f7e9cd73640 1 --2- 172.21.15.19:0/2982593209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e800051c0 0x7f7e8000b9c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f7e90001f60 tx=0x7f7e80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655307d8c705be42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:14.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.813+0000 7f7e96ffd640 1 -- 172.21.15.19:0/2982593209 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e90001b30 con 0x7f7e800051c0 2024-09-12T02:02:14.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.813+0000 7f7e96ffd640 1 -- 172.21.15.19:0/2982593209 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e90003b90 con 0x7f7e800051c0 2024-09-12T02:02:14.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.813+0000 7f7e96ffd640 1 -- 172.21.15.19:0/2982593209 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e90005110 con 0x7f7e800051c0 2024-09-12T02:02:14.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.813+0000 7f7e9e7d6640 1 -- 172.21.15.19:0/2982593209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e800051c0 msgr2=0x7f7e8000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:14.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.813+0000 7f7e9e7d6640 1 --2- 172.21.15.19:0/2982593209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e800051c0 0x7f7e8000b9c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f7e90001f60 tx=0x7f7e80005830 comp rx=0 tx=0).stop 2024-09-12T02:02:14.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.814+0000 7f7e9e7d6640 1 -- 172.21.15.19:0/2982593209 shutdown_connections 2024-09-12T02:02:14.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.814+0000 7f7e9e7d6640 1 --2- 172.21.15.19:0/2982593209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e800051c0 0x7f7e8000b9c0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:14.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.814+0000 7f7e9e7d6640 1 -- 172.21.15.19:0/2982593209 >> 172.21.15.19:0/2982593209 conn(0x7f7e980d23a0 msgr2=0x7f7e980d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:14.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.814+0000 7f7e9e7d6640 1 -- 172.21.15.19:0/2982593209 shutdown_connections 2024-09-12T02:02:14.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.814+0000 7f7e9e7d6640 1 -- 172.21.15.19:0/2982593209 wait complete. 2024-09-12T02:02:14.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.815+0000 7f7e9e7d6640 1 Processor -- start 2024-09-12T02:02:14.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.815+0000 7f7e9e7d6640 1 -- start start 2024-09-12T02:02:14.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e9e7d6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e800051c0 0x7f7e981f4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:14.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e9e7d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e9815a6d0 0x7f7e980ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:14.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e9e7d6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e980c65c0 0x7f7e980c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:14.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e9e7d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9809baa0 con 0x7f7e9815a6d0 2024-09-12T02:02:14.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e9e7d6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7e980d1020 con 0x7f7e980c65c0 2024-09-12T02:02:14.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e9e7d6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7e9806cd20 con 0x7f7e800051c0 2024-09-12T02:02:14.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e9815a6d0 0x7f7e980ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:14.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e9815a6d0 0x7f7e980ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35130/0 (socket says 172.21.15.19:35130) 2024-09-12T02:02:14.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e977fe640 1 -- 172.21.15.19:0/1327833164 learned_addr learned my addr 172.21.15.19:0/1327833164 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:14.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e9cd73640 1 --2- 172.21.15.19:0/1327833164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e980c65c0 0x7f7e980c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:14.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e97fff640 1 --2- 172.21.15.19:0/1327833164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e800051c0 0x7f7e981f4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:14.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e977fe640 1 -- 172.21.15.19:0/1327833164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e800051c0 msgr2=0x7f7e981f4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:14.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e977fe640 1 --2- 172.21.15.19:0/1327833164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e800051c0 0x7f7e981f4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:14.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e977fe640 1 -- 172.21.15.19:0/1327833164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e980c65c0 msgr2=0x7f7e980c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:14.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e977fe640 1 --2- 172.21.15.19:0/1327833164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e980c65c0 0x7f7e980c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:14.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e977fe640 1 -- 172.21.15.19:0/1327833164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e9815adb0 con 0x7f7e9815a6d0 2024-09-12T02:02:14.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e9cd73640 1 --2- 172.21.15.19:0/1327833164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e980c65c0 0x7f7e980c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:14.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e977fe640 1 --2- 172.21.15.19:0/1327833164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e9815a6d0 0x7f7e980ce420 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0118e0 tx=0x7f7e8c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:14.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.816+0000 7f7e94ff9640 1 -- 172.21.15.19:0/1327833164 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00fa90 con 0x7f7e9815a6d0 2024-09-12T02:02:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.817+0000 7f7e94ff9640 1 -- 172.21.15.19:0/1327833164 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e8c00fc30 con 0x7f7e9815a6d0 2024-09-12T02:02:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.817+0000 7f7e9e7d6640 1 -- 172.21.15.19:0/1327833164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e9815b090 con 0x7f7e9815a6d0 2024-09-12T02:02:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.817+0000 7f7e94ff9640 1 -- 172.21.15.19:0/1327833164 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c014440 con 0x7f7e9815a6d0 2024-09-12T02:02:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.817+0000 7f7e9e7d6640 1 -- 172.21.15.19:0/1327833164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e9815b650 con 0x7f7e9815a6d0 2024-09-12T02:02:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.817+0000 7f7e9e7d6640 1 -- 172.21.15.19:0/1327833164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e980d0780 con 0x7f7e9815a6d0 2024-09-12T02:02:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.818+0000 7f7e94ff9640 1 -- 172.21.15.19:0/1327833164 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e8c012040 con 0x7f7e9815a6d0 2024-09-12T02:02:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.818+0000 7f7e94ff9640 1 --2- 172.21.15.19:0/1327833164 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7e8406be30 0x7f7e8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:14.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.819+0000 7f7e94ff9640 1 -- 172.21.15.19:0/1327833164 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6101+0+0 (secure 0 0 0) 0x7f7e8c08b6e0 con 0x7f7e9815a6d0 2024-09-12T02:02:14.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.819+0000 7f7e97fff640 1 --2- 172.21.15.19:0/1327833164 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7e8406be30 0x7f7e8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:14.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.819+0000 7f7e97fff640 1 --2- 172.21.15.19:0/1327833164 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7e8406be30 0x7f7e8406e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7e88001050 tx=0x7f7e88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:14.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:14.823+0000 7f7e94ff9640 1 -- 172.21.15.19:0/1327833164 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e8c019030 con 0x7f7e9815a6d0 2024-09-12T02:02:15.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.001+0000 7f7e9e7d6640 1 -- 172.21.15.19:0/1327833164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e980b8320 con 0x7f7e9815a6d0 2024-09-12T02:02:15.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.002+0000 7f7e94ff9640 1 -- 172.21.15.19:0/1327833164 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+16933 (secure 0 0 0) 0x7f7e8c0598b0 con 0x7f7e9815a6d0 2024-09-12T02:02:15.002 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:15.002 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":93,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:02:13.315871+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:02:09.629825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-12T02:02:10.664335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:02:15.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.004+0000 7f7e9e7d6640 1 -- 172.21.15.19:0/1327833164 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7e8406be30 msgr2=0x7f7e8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.004+0000 7f7e9e7d6640 1 --2- 172.21.15.19:0/1327833164 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7e8406be30 0x7f7e8406e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7e88001050 tx=0x7f7e88009040 comp rx=0 tx=0).stop 2024-09-12T02:02:15.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.004+0000 7f7e9e7d6640 1 -- 172.21.15.19:0/1327833164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e9815a6d0 msgr2=0x7f7e980ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.004+0000 7f7e9e7d6640 1 --2- 172.21.15.19:0/1327833164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e9815a6d0 0x7f7e980ce420 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0118e0 tx=0x7f7e8c011da0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.004+0000 7f7e9e7d6640 1 -- 172.21.15.19:0/1327833164 shutdown_connections 2024-09-12T02:02:15.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.004+0000 7f7e9e7d6640 1 --2- 172.21.15.19:0/1327833164 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7e8406be30 0x7f7e8406e2f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.004+0000 7f7e9e7d6640 1 --2- 172.21.15.19:0/1327833164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e980c65c0 0x7f7e980c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.004+0000 7f7e9e7d6640 1 --2- 172.21.15.19:0/1327833164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e9815a6d0 0x7f7e980ce420 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.004+0000 7f7e9e7d6640 1 --2- 172.21.15.19:0/1327833164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e800051c0 0x7f7e981f4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.004+0000 7f7e9e7d6640 1 -- 172.21.15.19:0/1327833164 >> 172.21.15.19:0/1327833164 conn(0x7f7e980d23a0 msgr2=0x7f7e980b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:15.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.004+0000 7f7e9e7d6640 1 -- 172.21.15.19:0/1327833164 shutdown_connections 2024-09-12T02:02:15.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.004+0000 7f7e9e7d6640 1 -- 172.21.15.19:0/1327833164 wait complete. 2024-09-12T02:02:15.016 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:02:15.016 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:02:15.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.119+0000 7fd5d3047640 1 Processor -- start 2024-09-12T02:02:15.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.119+0000 7fd5d3047640 1 -- start start 2024-09-12T02:02:15.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.120+0000 7fd5d3047640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc0b6680 0x7fd5cc169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.120+0000 7fd5d3047640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5cc06d9f0 con 0x7fd5cc162060 2024-09-12T02:02:15.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.120+0000 7fd5d3047640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5cc06dcd0 con 0x7fd5cc161c80 2024-09-12T02:02:15.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.120+0000 7fd5d3047640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd5cc06dfb0 con 0x7fd5cc0b6680 2024-09-12T02:02:15.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.120+0000 7fd5cbfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd5cc162060 0x7fd5cc0b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39098/0 (socket says 172.21.15.19:39098) 2024-09-12T02:02:15.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.120+0000 7fd5cbfff640 1 -- 172.21.15.19:0/285656596 learned_addr learned my addr 172.21.15.19:0/285656596 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:15.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.120+0000 7fd5cb7fe640 1 -- 172.21.15.19:0/285656596 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 742507855 0 0) 0x7fd5cc06d9f0 con 0x7fd5cc162060 2024-09-12T02:02:15.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.120+0000 7fd5cb7fe640 1 -- 172.21.15.19:0/285656596 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5bc003520 con 0x7fd5cc162060 2024-09-12T02:02:15.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.120+0000 7fd5d15e4640 1 --2- 172.21.15.19:0/285656596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc0b6680 0x7fd5cc169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.120+0000 7fd5cb7fe640 1 -- 172.21.15.19:0/285656596 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3701731090 0 0) 0x7fd5bc003520 con 0x7fd5cc162060 2024-09-12T02:02:15.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.120+0000 7fd5cb7fe640 1 -- 172.21.15.19:0/285656596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc0b6680 msgr2=0x7fd5cc169830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:15.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.120+0000 7fd5cb7fe640 1 --2- 172.21.15.19:0/285656596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc0b6680 0x7fd5cc169830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.120+0000 7fd5cb7fe640 1 -- 172.21.15.19:0/285656596 >> v1:172.21.15.135:6789/0 conn(0x7fd5cc161c80 legacy=0x7fd5cc06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.120+0000 7fd5cb7fe640 1 -- 172.21.15.19:0/285656596 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5cc0d01f0 con 0x7fd5cc162060 2024-09-12T02:02:15.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.121+0000 7fd5cb7fe640 1 -- 172.21.15.19:0/285656596 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fd5b8001670 con 0x7fd5cc162060 2024-09-12T02:02:15.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.121+0000 7fd5cb7fe640 1 -- 172.21.15.19:0/285656596 >> v1:172.21.15.19:6789/0 conn(0x7fd5cc162060 legacy=0x7fd5cc0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.121+0000 7fd5cb7fe640 1 --2- 172.21.15.19:0/285656596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5bc0039e0 0x7fd5bc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.121+0000 7fd5cb7fe640 1 --2- 172.21.15.19:0/285656596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5bc004800 0x7fd5bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.121+0000 7fd5cb7fe640 1 --2- 172.21.15.19:0/285656596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc0b6680 0x7fd5bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.121+0000 7fd5cb7fe640 1 -- 172.21.15.19:0/285656596 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd5cc06dfb0 con 0x7fd5bc004800 2024-09-12T02:02:15.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.121+0000 7fd5cb7fe640 1 -- 172.21.15.19:0/285656596 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc00baa0 con 0x7fd5bc0039e0 2024-09-12T02:02:15.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.121+0000 7fd5cb7fe640 1 -- 172.21.15.19:0/285656596 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd5bc00bca0 con 0x7fd5cc0b6680 2024-09-12T02:02:15.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.121+0000 7fd5cbfff640 1 --2- 172.21.15.19:0/285656596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5bc004800 0x7fd5bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.121+0000 7fd5d0de3640 1 --2- 172.21.15.19:0/285656596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5bc0039e0 0x7fd5bc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.121+0000 7fd5d15e4640 1 --2- 172.21.15.19:0/285656596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc0b6680 0x7fd5bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.121+0000 7fd5cbfff640 1 -- 172.21.15.19:0/285656596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc0b6680 msgr2=0x7fd5bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:15.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.121+0000 7fd5cbfff640 1 --2- 172.21.15.19:0/285656596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc0b6680 0x7fd5bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.121+0000 7fd5cbfff640 1 -- 172.21.15.19:0/285656596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5bc0039e0 msgr2=0x7fd5bc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:15.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.121+0000 7fd5cbfff640 1 --2- 172.21.15.19:0/285656596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5bc0039e0 0x7fd5bc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.121+0000 7fd5cbfff640 1 -- 172.21.15.19:0/285656596 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5bc003520 con 0x7fd5bc004800 2024-09-12T02:02:15.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.122+0000 7fd5cbfff640 1 --2- 172.21.15.19:0/285656596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5bc004800 0x7fd5bc004c80 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8001eb0 tx=0x7fd5bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1828ba6bd35e89c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:15.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.122+0000 7fd5cb7fe640 1 -- 172.21.15.19:0/285656596 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8007d30 con 0x7fd5bc004800 2024-09-12T02:02:15.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.122+0000 7fd5cb7fe640 1 -- 172.21.15.19:0/285656596 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b8005af0 con 0x7fd5bc004800 2024-09-12T02:02:15.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.122+0000 7fd5cb7fe640 1 -- 172.21.15.19:0/285656596 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8007070 con 0x7fd5bc004800 2024-09-12T02:02:15.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.122+0000 7fd5d3047640 1 -- 172.21.15.19:0/285656596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5bc004800 msgr2=0x7fd5bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.122+0000 7fd5d3047640 1 --2- 172.21.15.19:0/285656596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5bc004800 0x7fd5bc004c80 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8001eb0 tx=0x7fd5bc005830 comp rx=0 tx=0).stop 2024-09-12T02:02:15.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.123+0000 7fd5d15e4640 1 -- 172.21.15.19:0/285656596 reap_dead start 2024-09-12T02:02:15.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.123+0000 7fd5d3047640 1 -- 172.21.15.19:0/285656596 shutdown_connections 2024-09-12T02:02:15.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.123+0000 7fd5d3047640 1 -- 172.21.15.19:0/285656596 >> 172.21.15.19:0/285656596 conn(0x7fd5cc0d44f0 msgr2=0x7fd5cc0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:15.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.123+0000 7fd5d3047640 1 -- 172.21.15.19:0/285656596 shutdown_connections 2024-09-12T02:02:15.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.123+0000 7fd5d3047640 1 -- 172.21.15.19:0/285656596 wait complete. 2024-09-12T02:02:15.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.124+0000 7fd5d3047640 1 Processor -- start 2024-09-12T02:02:15.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.124+0000 7fd5d3047640 1 -- start start 2024-09-12T02:02:15.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.125+0000 7fd5d3047640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5bc004800 0x7fd5cc0b86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.125+0000 7fd5d3047640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc0c9db0 0x7fd5cc0ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.125+0000 7fd5d3047640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5cc1591b0 0x7fd5cc159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.125+0000 7fd5d3047640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd5cc0b6cb0 con 0x7fd5cc1591b0 2024-09-12T02:02:15.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.125+0000 7fd5d3047640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd5cc0b6b30 con 0x7fd5bc004800 2024-09-12T02:02:15.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.125+0000 7fd5d3047640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd5cc167820 con 0x7fd5cc0c9db0 2024-09-12T02:02:15.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.125+0000 7fd5d15e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5cc1591b0 0x7fd5cc159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.125+0000 7fd5d15e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5cc1591b0 0x7fd5cc159660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35140/0 (socket says 172.21.15.19:35140) 2024-09-12T02:02:15.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.125+0000 7fd5d15e4640 1 -- 172.21.15.19:0/2516446551 learned_addr learned my addr 172.21.15.19:0/2516446551 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:15.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.125+0000 7fd5cbfff640 1 --2- 172.21.15.19:0/2516446551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc0c9db0 0x7fd5cc0ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.125+0000 7fd5d0de3640 1 --2- 172.21.15.19:0/2516446551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5bc004800 0x7fd5cc0b86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.125+0000 7fd5d15e4640 1 -- 172.21.15.19:0/2516446551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc0c9db0 msgr2=0x7fd5cc0ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.125+0000 7fd5d15e4640 1 --2- 172.21.15.19:0/2516446551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc0c9db0 0x7fd5cc0ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.125+0000 7fd5d15e4640 1 -- 172.21.15.19:0/2516446551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5bc004800 msgr2=0x7fd5cc0b86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.125+0000 7fd5d15e4640 1 --2- 172.21.15.19:0/2516446551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5bc004800 0x7fd5cc0b86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.125+0000 7fd5d15e4640 1 -- 172.21.15.19:0/2516446551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5cc0b8c30 con 0x7fd5cc1591b0 2024-09-12T02:02:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.125+0000 7fd5d15e4640 1 --2- 172.21.15.19:0/2516446551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5cc1591b0 0x7fd5cc159660 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc074250 tx=0x7fd5c400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.126+0000 7fd5c97fa640 1 -- 172.21.15.19:0/2516446551 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4015430 con 0x7fd5cc1591b0 2024-09-12T02:02:15.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.126+0000 7fd5c97fa640 1 -- 172.21.15.19:0/2516446551 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c401d070 con 0x7fd5cc1591b0 2024-09-12T02:02:15.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.126+0000 7fd5d3047640 1 -- 172.21.15.19:0/2516446551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5cc0b9d50 con 0x7fd5cc1591b0 2024-09-12T02:02:15.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.126+0000 7fd5c97fa640 1 -- 172.21.15.19:0/2516446551 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4015830 con 0x7fd5cc1591b0 2024-09-12T02:02:15.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.126+0000 7fd5d3047640 1 -- 172.21.15.19:0/2516446551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5cc0b7ef0 con 0x7fd5cc1591b0 2024-09-12T02:02:15.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.127+0000 7fd5d3047640 1 -- 172.21.15.19:0/2516446551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5cc0b5f70 con 0x7fd5cc1591b0 2024-09-12T02:02:15.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.127+0000 7fd5c97fa640 1 -- 172.21.15.19:0/2516446551 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd5c40159d0 con 0x7fd5cc1591b0 2024-09-12T02:02:15.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.128+0000 7fd5c97fa640 1 --2- 172.21.15.19:0/2516446551 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd5b006be60 0x7fd5b006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.128+0000 7fd5c97fa640 1 -- 172.21.15.19:0/2516446551 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6101+0+0 (secure 0 0 0) 0x7fd5c408b7f0 con 0x7fd5cc1591b0 2024-09-12T02:02:15.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.128+0000 7fd5d0de3640 1 --2- 172.21.15.19:0/2516446551 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd5b006be60 0x7fd5b006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.128+0000 7fd5d0de3640 1 --2- 172.21.15.19:0/2516446551 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd5b006be60 0x7fd5b006e320 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0d2710 tx=0x7fd5c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:15.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.132+0000 7fd5c97fa640 1 -- 172.21.15.19:0/2516446551 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5c4010040 con 0x7fd5cc1591b0 2024-09-12T02:02:15.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.306+0000 7fd5d3047640 1 -- 172.21.15.19:0/2516446551 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd5cc0d39f0 con 0x7fd5b006be60 2024-09-12T02:02:15.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.313+0000 7fd5c97fa640 1 -- 172.21.15.19:0/2516446551 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251047 (secure 0 0 0) 0x7fd5cc0d39f0 con 0x7fd5b006be60 2024-09-12T02:02:15.317 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:15.318 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T02:02:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.316+0000 7fd5d3047640 1 -- 172.21.15.19:0/2516446551 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd5b006be60 msgr2=0x7fd5b006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.316+0000 7fd5d3047640 1 --2- 172.21.15.19:0/2516446551 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd5b006be60 0x7fd5b006e320 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0d2710 tx=0x7fd5c0009040 comp rx=0 tx=0).stop 2024-09-12T02:02:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.316+0000 7fd5d3047640 1 -- 172.21.15.19:0/2516446551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5cc1591b0 msgr2=0x7fd5cc159660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.316+0000 7fd5d3047640 1 --2- 172.21.15.19:0/2516446551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5cc1591b0 0x7fd5cc159660 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc074250 tx=0x7fd5c400f580 comp rx=0 tx=0).stop 2024-09-12T02:02:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.316+0000 7fd5d3047640 1 -- 172.21.15.19:0/2516446551 shutdown_connections 2024-09-12T02:02:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.316+0000 7fd5d3047640 1 --2- 172.21.15.19:0/2516446551 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd5b006be60 0x7fd5b006e320 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.316+0000 7fd5d3047640 1 --2- 172.21.15.19:0/2516446551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5cc1591b0 0x7fd5cc159660 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.316+0000 7fd5d3047640 1 --2- 172.21.15.19:0/2516446551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc0c9db0 0x7fd5cc0ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.316+0000 7fd5d3047640 1 --2- 172.21.15.19:0/2516446551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5bc004800 0x7fd5cc0b86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.316+0000 7fd5d3047640 1 -- 172.21.15.19:0/2516446551 >> 172.21.15.19:0/2516446551 conn(0x7fd5cc0d44f0 msgr2=0x7fd5cc0b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:15.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.316+0000 7fd5d3047640 1 -- 172.21.15.19:0/2516446551 shutdown_connections 2024-09-12T02:02:15.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.316+0000 7fd5d3047640 1 -- 172.21.15.19:0/2516446551 wait complete. 2024-09-12T02:02:15.326 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2024-09-12T02:02:14.177257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592618,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":198,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251244,"kb_used_data":10040,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754723476,"statfs":{"total":773094113280,"available":772836839424,"internally_reserved":0,"allocated":10280960,"data_stored":5376849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000943"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.339480+0000","last_change":"2024-09-12T02:02:12.332361+0000","last_active":"2024-09-12T02:02:12.339480+0000","last_peered":"2024-09-12T02:02:12.339480+0000","last_clean":"2024-09-12T02:02:12.339480+0000","last_became_active":"2024-09-12T02:02:12.332101+0000","last_became_peered":"2024-09-12T02:02:12.332101+0000","last_unstale":"2024-09-12T02:02:12.339480+0000","last_undegraded":"2024-09-12T02:02:12.339480+0000","last_fullsized":"2024-09-12T02:02:12.339480+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:32.854191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340632+0000","last_change":"2024-09-12T02:02:12.338898+0000","last_active":"2024-09-12T02:02:13.340632+0000","last_peered":"2024-09-12T02:02:13.340632+0000","last_clean":"2024-09-12T02:02:13.340632+0000","last_became_active":"2024-09-12T02:02:12.338509+0000","last_became_peered":"2024-09-12T02:02:12.338509+0000","last_unstale":"2024-09-12T02:02:13.340632+0000","last_undegraded":"2024-09-12T02:02:13.340632+0000","last_fullsized":"2024-09-12T02:02:13.340632+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:55.080145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.351384+0000","last_change":"2024-09-12T02:02:12.348813+0000","last_active":"2024-09-12T02:02:12.351384+0000","last_peered":"2024-09-12T02:02:12.351384+0000","last_clean":"2024-09-12T02:02:12.351384+0000","last_became_active":"2024-09-12T02:02:12.348446+0000","last_became_peered":"2024-09-12T02:02:12.348446+0000","last_unstale":"2024-09-12T02:02:12.351384+0000","last_undegraded":"2024-09-12T02:02:12.351384+0000","last_fullsized":"2024-09-12T02:02:12.351384+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:13.655779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.337680+0000","last_change":"2024-09-12T02:02:12.336248+0000","last_active":"2024-09-12T02:02:12.337680+0000","last_peered":"2024-09-12T02:02:12.337680+0000","last_clean":"2024-09-12T02:02:12.337680+0000","last_became_active":"2024-09-12T02:02:12.335952+0000","last_became_peered":"2024-09-12T02:02:12.335952+0000","last_unstale":"2024-09-12T02:02:12.337680+0000","last_undegraded":"2024-09-12T02:02:12.337680+0000","last_fullsized":"2024-09-12T02:02:12.337680+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:28.825819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.322680+0000","last_change":"2024-09-12T02:02:11.322680+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.322680+0000","last_undegraded":"2024-09-12T02:02:11.322680+0000","last_fullsized":"2024-09-12T02:02:11.322680+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.342680+0000","last_change":"2024-09-12T02:02:12.338436+0000","last_active":"2024-09-12T02:02:12.342680+0000","last_peered":"2024-09-12T02:02:12.342680+0000","last_clean":"2024-09-12T02:02:12.342680+0000","last_became_active":"2024-09-12T02:02:12.338088+0000","last_became_peered":"2024-09-12T02:02:12.338088+0000","last_unstale":"2024-09-12T02:02:12.342680+0000","last_undegraded":"2024-09-12T02:02:12.342680+0000","last_fullsized":"2024-09-12T02:02:12.342680+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:03.708954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412540+0000","last_change":"2024-09-12T02:02:12.340218+0000","last_active":"2024-09-12T02:02:13.412540+0000","last_peered":"2024-09-12T02:02:13.412540+0000","last_clean":"2024-09-12T02:02:13.412540+0000","last_became_active":"2024-09-12T02:02:12.339861+0000","last_became_peered":"2024-09-12T02:02:12.339861+0000","last_unstale":"2024-09-12T02:02:13.412540+0000","last_undegraded":"2024-09-12T02:02:13.412540+0000","last_fullsized":"2024-09-12T02:02:13.412540+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:51.659882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336910+0000","last_change":"2024-09-12T02:02:12.333340+0000","last_active":"2024-09-12T02:02:12.336910+0000","last_peered":"2024-09-12T02:02:12.336910+0000","last_clean":"2024-09-12T02:02:12.336910+0000","last_became_active":"2024-09-12T02:02:12.333067+0000","last_became_peered":"2024-09-12T02:02:12.333067+0000","last_unstale":"2024-09-12T02:02:12.336910+0000","last_undegraded":"2024-09-12T02:02:12.336910+0000","last_fullsized":"2024-09-12T02:02:12.336910+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:42.119881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.324473+0000","last_change":"2024-09-12T02:02:11.324473+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.324473+0000","last_undegraded":"2024-09-12T02:02:11.324473+0000","last_fullsized":"2024-09-12T02:02:11.324473+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.329564+0000","last_change":"2024-09-12T02:02:12.328431+0000","last_active":"2024-09-12T02:02:12.329564+0000","last_peered":"2024-09-12T02:02:12.329564+0000","last_clean":"2024-09-12T02:02:12.329564+0000","last_became_active":"2024-09-12T02:02:12.328148+0000","last_became_peered":"2024-09-12T02:02:12.328148+0000","last_unstale":"2024-09-12T02:02:12.329564+0000","last_undegraded":"2024-09-12T02:02:12.329564+0000","last_fullsized":"2024-09-12T02:02:12.329564+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:05.794542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.322247+0000","last_change":"2024-09-12T02:02:11.322247+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.322247+0000","last_undegraded":"2024-09-12T02:02:11.322247+0000","last_fullsized":"2024-09-12T02:02:11.322247+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.328850+0000","last_change":"2024-09-12T02:02:12.327134+0000","last_active":"2024-09-12T02:02:12.328850+0000","last_peered":"2024-09-12T02:02:12.328850+0000","last_clean":"2024-09-12T02:02:12.328850+0000","last_became_active":"2024-09-12T02:02:12.326826+0000","last_became_peered":"2024-09-12T02:02:12.326826+0000","last_unstale":"2024-09-12T02:02:12.328850+0000","last_undegraded":"2024-09-12T02:02:12.328850+0000","last_fullsized":"2024-09-12T02:02:12.328850+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:21.234445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336836+0000","last_change":"2024-09-12T02:02:12.331964+0000","last_active":"2024-09-12T02:02:12.336836+0000","last_peered":"2024-09-12T02:02:12.336836+0000","last_clean":"2024-09-12T02:02:12.336836+0000","last_became_active":"2024-09-12T02:02:12.331686+0000","last_became_peered":"2024-09-12T02:02:12.331686+0000","last_unstale":"2024-09-12T02:02:12.336836+0000","last_undegraded":"2024-09-12T02:02:12.336836+0000","last_fullsized":"2024-09-12T02:02:12.336836+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:31.132531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323252+0000","last_change":"2024-09-12T02:02:11.323252+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323252+0000","last_undegraded":"2024-09-12T02:02:11.323252+0000","last_fullsized":"2024-09-12T02:02:11.323252+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.340755+0000","last_change":"2024-09-12T02:02:12.337578+0000","last_active":"2024-09-12T02:02:12.340755+0000","last_peered":"2024-09-12T02:02:12.340755+0000","last_clean":"2024-09-12T02:02:12.340755+0000","last_became_active":"2024-09-12T02:02:12.337335+0000","last_became_peered":"2024-09-12T02:02:12.337335+0000","last_unstale":"2024-09-12T02:02:12.340755+0000","last_undegraded":"2024-09-12T02:02:12.340755+0000","last_fullsized":"2024-09-12T02:02:12.340755+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:59.464045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335356+0000","last_change":"2024-09-12T02:02:12.330650+0000","last_active":"2024-09-12T02:02:12.335356+0000","last_peered":"2024-09-12T02:02:12.335356+0000","last_clean":"2024-09-12T02:02:12.335356+0000","last_became_active":"2024-09-12T02:02:12.330347+0000","last_became_peered":"2024-09-12T02:02:12.330347+0000","last_unstale":"2024-09-12T02:02:12.335356+0000","last_undegraded":"2024-09-12T02:02:12.335356+0000","last_fullsized":"2024-09-12T02:02:12.335356+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.801762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335304+0000","last_change":"2024-09-12T02:02:12.329326+0000","last_active":"2024-09-12T02:02:12.335304+0000","last_peered":"2024-09-12T02:02:12.335304+0000","last_clean":"2024-09-12T02:02:12.335304+0000","last_became_active":"2024-09-12T02:02:12.329063+0000","last_became_peered":"2024-09-12T02:02:12.329063+0000","last_unstale":"2024-09-12T02:02:12.335304+0000","last_undegraded":"2024-09-12T02:02:12.335304+0000","last_fullsized":"2024-09-12T02:02:12.335304+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:10.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.340436+0000","last_change":"2024-09-12T02:02:12.333053+0000","last_active":"2024-09-12T02:02:12.340436+0000","last_peered":"2024-09-12T02:02:12.340436+0000","last_clean":"2024-09-12T02:02:12.340436+0000","last_became_active":"2024-09-12T02:02:12.332788+0000","last_became_peered":"2024-09-12T02:02:12.332788+0000","last_unstale":"2024-09-12T02:02:12.340436+0000","last_undegraded":"2024-09-12T02:02:12.340436+0000","last_fullsized":"2024-09-12T02:02:12.340436+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:42.844428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.321134+0000","last_change":"2024-09-12T02:02:11.321134+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.321134+0000","last_undegraded":"2024-09-12T02:02:11.321134+0000","last_fullsized":"2024-09-12T02:02:11.321134+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336130+0000","last_change":"2024-09-12T02:02:12.326448+0000","last_active":"2024-09-12T02:02:12.336130+0000","last_peered":"2024-09-12T02:02:12.336130+0000","last_clean":"2024-09-12T02:02:12.336130+0000","last_became_active":"2024-09-12T02:02:12.326137+0000","last_became_peered":"2024-09-12T02:02:12.326137+0000","last_unstale":"2024-09-12T02:02:12.336130+0000","last_undegraded":"2024-09-12T02:02:12.336130+0000","last_fullsized":"2024-09-12T02:02:12.336130+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:06.139652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323540+0000","last_change":"2024-09-12T02:02:11.323540+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323540+0000","last_undegraded":"2024-09-12T02:02:11.323540+0000","last_fullsized":"2024-09-12T02:02:11.323540+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.322810+0000","last_change":"2024-09-12T02:02:11.322810+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.322810+0000","last_undegraded":"2024-09-12T02:02:11.322810+0000","last_fullsized":"2024-09-12T02:02:11.322810+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323252+0000","last_change":"2024-09-12T02:02:12.339608+0000","last_active":"2024-09-12T02:02:13.323252+0000","last_peered":"2024-09-12T02:02:13.323252+0000","last_clean":"2024-09-12T02:02:13.323252+0000","last_became_active":"2024-09-12T02:02:12.339051+0000","last_became_peered":"2024-09-12T02:02:12.339051+0000","last_unstale":"2024-09-12T02:02:13.323252+0000","last_undegraded":"2024-09-12T02:02:13.323252+0000","last_fullsized":"2024-09-12T02:02:13.323252+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:51.986401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.347328+0000","last_change":"2024-09-12T02:02:12.344797+0000","last_active":"2024-09-12T02:02:12.347328+0000","last_peered":"2024-09-12T02:02:12.347328+0000","last_clean":"2024-09-12T02:02:12.347328+0000","last_became_active":"2024-09-12T02:02:12.344507+0000","last_became_peered":"2024-09-12T02:02:12.344507+0000","last_unstale":"2024-09-12T02:02:12.347328+0000","last_undegraded":"2024-09-12T02:02:12.347328+0000","last_fullsized":"2024-09-12T02:02:12.347328+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:48.125756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340618+0000","last_change":"2024-09-12T02:02:12.337746+0000","last_active":"2024-09-12T02:02:13.340618+0000","last_peered":"2024-09-12T02:02:13.340618+0000","last_clean":"2024-09-12T02:02:13.340618+0000","last_became_active":"2024-09-12T02:02:12.337473+0000","last_became_peered":"2024-09-12T02:02:12.337473+0000","last_unstale":"2024-09-12T02:02:13.340618+0000","last_undegraded":"2024-09-12T02:02:13.340618+0000","last_fullsized":"2024-09-12T02:02:13.340618+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:25.348127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323897+0000","last_change":"2024-09-12T02:02:11.323897+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323897+0000","last_undegraded":"2024-09-12T02:02:11.323897+0000","last_fullsized":"2024-09-12T02:02:11.323897+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336967+0000","last_change":"2024-09-12T02:02:12.331869+0000","last_active":"2024-09-12T02:02:12.336967+0000","last_peered":"2024-09-12T02:02:12.336967+0000","last_clean":"2024-09-12T02:02:12.336967+0000","last_became_active":"2024-09-12T02:02:12.331585+0000","last_became_peered":"2024-09-12T02:02:12.331585+0000","last_unstale":"2024-09-12T02:02:12.336967+0000","last_undegraded":"2024-09-12T02:02:12.336967+0000","last_fullsized":"2024-09-12T02:02:12.336967+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:26.480661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.353526+0000","last_change":"2024-09-12T02:02:12.349310+0000","last_active":"2024-09-12T02:02:12.353526+0000","last_peered":"2024-09-12T02:02:12.353526+0000","last_clean":"2024-09-12T02:02:12.353526+0000","last_became_active":"2024-09-12T02:02:12.349030+0000","last_became_peered":"2024-09-12T02:02:12.349030+0000","last_unstale":"2024-09-12T02:02:12.353526+0000","last_undegraded":"2024-09-12T02:02:12.353526+0000","last_fullsized":"2024-09-12T02:02:12.353526+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:23.429351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412462+0000","last_change":"2024-09-12T02:02:12.340402+0000","last_active":"2024-09-12T02:02:13.412462+0000","last_peered":"2024-09-12T02:02:13.412462+0000","last_clean":"2024-09-12T02:02:13.412462+0000","last_became_active":"2024-09-12T02:02:12.340024+0000","last_became_peered":"2024-09-12T02:02:12.340024+0000","last_unstale":"2024-09-12T02:02:13.412462+0000","last_undegraded":"2024-09-12T02:02:13.412462+0000","last_fullsized":"2024-09-12T02:02:13.412462+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:24.518549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.322132+0000","last_change":"2024-09-12T02:02:11.322132+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.322132+0000","last_undegraded":"2024-09-12T02:02:11.322132+0000","last_fullsized":"2024-09-12T02:02:11.322132+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340407+0000","last_change":"2024-09-12T02:02:12.343209+0000","last_active":"2024-09-12T02:02:13.340407+0000","last_peered":"2024-09-12T02:02:13.340407+0000","last_clean":"2024-09-12T02:02:13.340407+0000","last_became_active":"2024-09-12T02:02:12.342918+0000","last_became_peered":"2024-09-12T02:02:12.342918+0000","last_unstale":"2024-09-12T02:02:13.340407+0000","last_undegraded":"2024-09-12T02:02:13.340407+0000","last_fullsized":"2024-09-12T02:02:13.340407+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:20.594709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335337+0000","last_change":"2024-09-12T02:02:12.327747+0000","last_active":"2024-09-12T02:02:12.335337+0000","last_peered":"2024-09-12T02:02:12.335337+0000","last_clean":"2024-09-12T02:02:12.335337+0000","last_became_active":"2024-09-12T02:02:12.327465+0000","last_became_peered":"2024-09-12T02:02:12.327465+0000","last_unstale":"2024-09-12T02:02:12.335337+0000","last_undegraded":"2024-09-12T02:02:12.335337+0000","last_fullsized":"2024-09-12T02:02:12.335337+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:51.659882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.353469+0000","last_change":"2024-09-12T02:02:12.351000+0000","last_active":"2024-09-12T02:02:12.353469+0000","last_peered":"2024-09-12T02:02:12.353469+0000","last_clean":"2024-09-12T02:02:12.353469+0000","last_became_active":"2024-09-12T02:02:12.350573+0000","last_became_peered":"2024-09-12T02:02:12.350573+0000","last_unstale":"2024-09-12T02:02:12.353469+0000","last_undegraded":"2024-09-12T02:02:12.353469+0000","last_fullsized":"2024-09-12T02:02:12.353469+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:52.339672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"92'4","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.324080+0000","last_change":"2024-09-12T02:02:11.333328+0000","last_active":"2024-09-12T02:02:13.324080+0000","last_peered":"2024-09-12T02:02:13.324080+0000","last_clean":"2024-09-12T02:02:13.324080+0000","last_became_active":"2024-09-12T02:02:11.333075+0000","last_became_peered":"2024-09-12T02:02:11.333075+0000","last_unstale":"2024-09-12T02:02:13.324080+0000","last_undegraded":"2024-09-12T02:02:13.324080+0000","last_fullsized":"2024-09-12T02:02:13.324080+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:36.748542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335906+0000","last_change":"2024-09-12T02:02:12.330259+0000","last_active":"2024-09-12T02:02:12.335906+0000","last_peered":"2024-09-12T02:02:12.335906+0000","last_clean":"2024-09-12T02:02:12.335906+0000","last_became_active":"2024-09-12T02:02:12.329970+0000","last_became_peered":"2024-09-12T02:02:12.329970+0000","last_unstale":"2024-09-12T02:02:12.335906+0000","last_undegraded":"2024-09-12T02:02:12.335906+0000","last_fullsized":"2024-09-12T02:02:12.335906+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:52.606535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.333999+0000","last_change":"2024-09-12T02:02:11.329594+0000","last_active":"2024-09-12T02:02:11.333999+0000","last_peered":"2024-09-12T02:02:11.333999+0000","last_clean":"2024-09-12T02:02:11.333999+0000","last_became_active":"2024-09-12T02:02:11.329256+0000","last_became_peered":"2024-09-12T02:02:11.329256+0000","last_unstale":"2024-09-12T02:02:11.333999+0000","last_undegraded":"2024-09-12T02:02:11.333999+0000","last_fullsized":"2024-09-12T02:02:11.333999+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:54.686751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412555+0000","last_change":"2024-09-12T02:02:12.337973+0000","last_active":"2024-09-12T02:02:13.412555+0000","last_peered":"2024-09-12T02:02:13.412555+0000","last_clean":"2024-09-12T02:02:13.412555+0000","last_became_active":"2024-09-12T02:02:12.337659+0000","last_became_peered":"2024-09-12T02:02:12.337659+0000","last_unstale":"2024-09-12T02:02:13.412555+0000","last_undegraded":"2024-09-12T02:02:13.412555+0000","last_fullsized":"2024-09-12T02:02:13.412555+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:10.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412473+0000","last_change":"2024-09-12T02:02:11.333138+0000","last_active":"2024-09-12T02:02:13.412473+0000","last_peered":"2024-09-12T02:02:13.412473+0000","last_clean":"2024-09-12T02:02:13.412473+0000","last_became_active":"2024-09-12T02:02:11.332790+0000","last_became_peered":"2024-09-12T02:02:11.332790+0000","last_unstale":"2024-09-12T02:02:13.412473+0000","last_undegraded":"2024-09-12T02:02:13.412473+0000","last_fullsized":"2024-09-12T02:02:13.412473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:57.281562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336328+0000","last_change":"2024-09-12T02:02:12.333076+0000","last_active":"2024-09-12T02:02:12.336328+0000","last_peered":"2024-09-12T02:02:12.336328+0000","last_clean":"2024-09-12T02:02:12.336328+0000","last_became_active":"2024-09-12T02:02:12.332851+0000","last_became_peered":"2024-09-12T02:02:12.332851+0000","last_unstale":"2024-09-12T02:02:12.336328+0000","last_undegraded":"2024-09-12T02:02:12.336328+0000","last_fullsized":"2024-09-12T02:02:12.336328+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:38.281610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323549+0000","last_change":"2024-09-12T02:02:11.332340+0000","last_active":"2024-09-12T02:02:13.323549+0000","last_peered":"2024-09-12T02:02:13.323549+0000","last_clean":"2024-09-12T02:02:13.323549+0000","last_became_active":"2024-09-12T02:02:11.332101+0000","last_became_peered":"2024-09-12T02:02:11.332101+0000","last_unstale":"2024-09-12T02:02:13.323549+0000","last_undegraded":"2024-09-12T02:02:13.323549+0000","last_fullsized":"2024-09-12T02:02:13.323549+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.886557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.332571+0000","last_change":"2024-09-12T02:02:12.325486+0000","last_active":"2024-09-12T02:02:12.332571+0000","last_peered":"2024-09-12T02:02:12.332571+0000","last_clean":"2024-09-12T02:02:12.332571+0000","last_became_active":"2024-09-12T02:02:12.325177+0000","last_became_peered":"2024-09-12T02:02:12.325177+0000","last_unstale":"2024-09-12T02:02:12.332571+0000","last_undegraded":"2024-09-12T02:02:12.332571+0000","last_fullsized":"2024-09-12T02:02:12.332571+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:28.518234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.337143+0000","last_change":"2024-09-12T02:02:11.333899+0000","last_active":"2024-09-12T02:02:11.337143+0000","last_peered":"2024-09-12T02:02:11.337143+0000","last_clean":"2024-09-12T02:02:11.337143+0000","last_became_active":"2024-09-12T02:02:11.333612+0000","last_became_peered":"2024-09-12T02:02:11.333612+0000","last_unstale":"2024-09-12T02:02:11.337143+0000","last_undegraded":"2024-09-12T02:02:11.337143+0000","last_fullsized":"2024-09-12T02:02:11.337143+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:16.109597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.322959+0000","last_change":"2024-09-12T02:02:12.339670+0000","last_active":"2024-09-12T02:02:13.322959+0000","last_peered":"2024-09-12T02:02:13.322959+0000","last_clean":"2024-09-12T02:02:13.322959+0000","last_became_active":"2024-09-12T02:02:12.339401+0000","last_became_peered":"2024-09-12T02:02:12.339401+0000","last_unstale":"2024-09-12T02:02:13.322959+0000","last_undegraded":"2024-09-12T02:02:13.322959+0000","last_fullsized":"2024-09-12T02:02:13.322959+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:39.396515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"92'1","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.353388+0000","last_change":"2024-09-12T02:02:11.336467+0000","last_active":"2024-09-12T02:02:12.353388+0000","last_peered":"2024-09-12T02:02:12.353388+0000","last_clean":"2024-09-12T02:02:12.353388+0000","last_became_active":"2024-09-12T02:02:11.336029+0000","last_became_peered":"2024-09-12T02:02:11.336029+0000","last_unstale":"2024-09-12T02:02:12.353388+0000","last_undegraded":"2024-09-12T02:02:12.353388+0000","last_fullsized":"2024-09-12T02:02:12.353388+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:33.725746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.342775+0000","last_change":"2024-09-12T02:02:12.338526+0000","last_active":"2024-09-12T02:02:12.342775+0000","last_peered":"2024-09-12T02:02:12.342775+0000","last_clean":"2024-09-12T02:02:12.342775+0000","last_became_active":"2024-09-12T02:02:12.338174+0000","last_became_peered":"2024-09-12T02:02:12.338174+0000","last_unstale":"2024-09-12T02:02:12.342775+0000","last_undegraded":"2024-09-12T02:02:12.342775+0000","last_fullsized":"2024-09-12T02:02:12.342775+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.054924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.317838+0000","last_change":"2024-09-12T02:02:11.326331+0000","last_active":"2024-09-12T02:02:12.317838+0000","last_peered":"2024-09-12T02:02:12.317838+0000","last_clean":"2024-09-12T02:02:12.317838+0000","last_became_active":"2024-09-12T02:02:11.326051+0000","last_became_peered":"2024-09-12T02:02:11.326051+0000","last_unstale":"2024-09-12T02:02:12.317838+0000","last_undegraded":"2024-09-12T02:02:12.317838+0000","last_fullsized":"2024-09-12T02:02:12.317838+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:14.638980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.337500+0000","last_change":"2024-09-12T02:02:12.335645+0000","last_active":"2024-09-12T02:02:12.337500+0000","last_peered":"2024-09-12T02:02:12.337500+0000","last_clean":"2024-09-12T02:02:12.337500+0000","last_became_active":"2024-09-12T02:02:12.335371+0000","last_became_peered":"2024-09-12T02:02:12.335371+0000","last_unstale":"2024-09-12T02:02:12.337500+0000","last_undegraded":"2024-09-12T02:02:12.337500+0000","last_fullsized":"2024-09-12T02:02:12.337500+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:03.083808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412357+0000","last_change":"2024-09-12T02:02:11.334790+0000","last_active":"2024-09-12T02:02:13.412357+0000","last_peered":"2024-09-12T02:02:13.412357+0000","last_clean":"2024-09-12T02:02:13.412357+0000","last_became_active":"2024-09-12T02:02:11.334505+0000","last_became_peered":"2024-09-12T02:02:11.334505+0000","last_unstale":"2024-09-12T02:02:13.412357+0000","last_undegraded":"2024-09-12T02:02:13.412357+0000","last_fullsized":"2024-09-12T02:02:13.412357+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:24.342640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323644+0000","last_change":"2024-09-12T02:02:11.323644+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323644+0000","last_undegraded":"2024-09-12T02:02:11.323644+0000","last_fullsized":"2024-09-12T02:02:11.323644+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340682+0000","last_change":"2024-09-12T02:02:11.333595+0000","last_active":"2024-09-12T02:02:13.340682+0000","last_peered":"2024-09-12T02:02:13.340682+0000","last_clean":"2024-09-12T02:02:13.340682+0000","last_became_active":"2024-09-12T02:02:11.333243+0000","last_became_peered":"2024-09-12T02:02:11.333243+0000","last_unstale":"2024-09-12T02:02:13.340682+0000","last_undegraded":"2024-09-12T02:02:13.340682+0000","last_fullsized":"2024-09-12T02:02:13.340682+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:12.239695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412571+0000","last_change":"2024-09-12T02:02:12.350425+0000","last_active":"2024-09-12T02:02:13.412571+0000","last_peered":"2024-09-12T02:02:13.412571+0000","last_clean":"2024-09-12T02:02:13.412571+0000","last_became_active":"2024-09-12T02:02:12.350139+0000","last_became_peered":"2024-09-12T02:02:12.350139+0000","last_unstale":"2024-09-12T02:02:13.412571+0000","last_undegraded":"2024-09-12T02:02:13.412571+0000","last_fullsized":"2024-09-12T02:02:13.412571+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:52.606535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.318431+0000","last_change":"2024-09-12T02:02:11.333135+0000","last_active":"2024-09-12T02:02:12.318431+0000","last_peered":"2024-09-12T02:02:12.318431+0000","last_clean":"2024-09-12T02:02:12.318431+0000","last_became_active":"2024-09-12T02:02:11.332827+0000","last_became_peered":"2024-09-12T02:02:11.332827+0000","last_unstale":"2024-09-12T02:02:12.318431+0000","last_undegraded":"2024-09-12T02:02:12.318431+0000","last_fullsized":"2024-09-12T02:02:12.318431+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:47.007799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.340461+0000","last_change":"2024-09-12T02:02:12.334298+0000","last_active":"2024-09-12T02:02:12.340461+0000","last_peered":"2024-09-12T02:02:12.340461+0000","last_clean":"2024-09-12T02:02:12.340461+0000","last_became_active":"2024-09-12T02:02:12.334014+0000","last_became_peered":"2024-09-12T02:02:12.334014+0000","last_unstale":"2024-09-12T02:02:12.340461+0000","last_undegraded":"2024-09-12T02:02:12.340461+0000","last_fullsized":"2024-09-12T02:02:12.340461+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:17.156403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.337891+0000","last_change":"2024-09-12T02:02:11.335601+0000","last_active":"2024-09-12T02:02:11.337891+0000","last_peered":"2024-09-12T02:02:11.337891+0000","last_clean":"2024-09-12T02:02:11.337891+0000","last_became_active":"2024-09-12T02:02:11.335331+0000","last_became_peered":"2024-09-12T02:02:11.335331+0000","last_unstale":"2024-09-12T02:02:11.337891+0000","last_undegraded":"2024-09-12T02:02:11.337891+0000","last_fullsized":"2024-09-12T02:02:11.337891+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:08.075197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.340936+0000","last_change":"2024-09-12T02:02:12.339385+0000","last_active":"2024-09-12T02:02:12.340936+0000","last_peered":"2024-09-12T02:02:12.340936+0000","last_clean":"2024-09-12T02:02:12.340936+0000","last_became_active":"2024-09-12T02:02:12.339076+0000","last_became_peered":"2024-09-12T02:02:12.339076+0000","last_unstale":"2024-09-12T02:02:12.340936+0000","last_undegraded":"2024-09-12T02:02:12.340936+0000","last_fullsized":"2024-09-12T02:02:12.340936+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.305827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"92'6","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.356286+0000","last_change":"2024-09-12T02:02:11.332578+0000","last_active":"2024-09-12T02:02:12.356286+0000","last_peered":"2024-09-12T02:02:12.356286+0000","last_clean":"2024-09-12T02:02:12.356286+0000","last_became_active":"2024-09-12T02:02:11.332190+0000","last_became_peered":"2024-09-12T02:02:11.332190+0000","last_unstale":"2024-09-12T02:02:12.356286+0000","last_undegraded":"2024-09-12T02:02:12.356286+0000","last_fullsized":"2024-09-12T02:02:12.356286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:48.070182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336884+0000","last_change":"2024-09-12T02:02:12.332687+0000","last_active":"2024-09-12T02:02:12.336884+0000","last_peered":"2024-09-12T02:02:12.336884+0000","last_clean":"2024-09-12T02:02:12.336884+0000","last_became_active":"2024-09-12T02:02:12.332386+0000","last_became_peered":"2024-09-12T02:02:12.332386+0000","last_unstale":"2024-09-12T02:02:12.336884+0000","last_undegraded":"2024-09-12T02:02:12.336884+0000","last_fullsized":"2024-09-12T02:02:12.336884+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:26.580075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412589+0000","last_change":"2024-09-12T02:02:11.335419+0000","last_active":"2024-09-12T02:02:13.412589+0000","last_peered":"2024-09-12T02:02:13.412589+0000","last_clean":"2024-09-12T02:02:13.412589+0000","last_became_active":"2024-09-12T02:02:11.335199+0000","last_became_peered":"2024-09-12T02:02:11.335199+0000","last_unstale":"2024-09-12T02:02:13.412589+0000","last_undegraded":"2024-09-12T02:02:13.412589+0000","last_fullsized":"2024-09-12T02:02:13.412589+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:19.589222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.321258+0000","last_change":"2024-09-12T02:02:11.321258+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.321258+0000","last_undegraded":"2024-09-12T02:02:11.321258+0000","last_fullsized":"2024-09-12T02:02:11.321258+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.322792+0000","last_change":"2024-09-12T02:02:11.334793+0000","last_active":"2024-09-12T02:02:12.322792+0000","last_peered":"2024-09-12T02:02:12.322792+0000","last_clean":"2024-09-12T02:02:12.322792+0000","last_became_active":"2024-09-12T02:02:11.334335+0000","last_became_peered":"2024-09-12T02:02:11.334335+0000","last_unstale":"2024-09-12T02:02:12.322792+0000","last_undegraded":"2024-09-12T02:02:12.322792+0000","last_fullsized":"2024-09-12T02:02:12.322792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:34.830322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335855+0000","last_change":"2024-09-12T02:02:12.329549+0000","last_active":"2024-09-12T02:02:12.335855+0000","last_peered":"2024-09-12T02:02:12.335855+0000","last_clean":"2024-09-12T02:02:12.335855+0000","last_became_active":"2024-09-12T02:02:12.329279+0000","last_became_peered":"2024-09-12T02:02:12.329279+0000","last_unstale":"2024-09-12T02:02:12.335855+0000","last_undegraded":"2024-09-12T02:02:12.335855+0000","last_fullsized":"2024-09-12T02:02:12.335855+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:27.109469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.323203+0000","last_change":"2024-09-12T02:02:11.338109+0000","last_active":"2024-09-12T02:02:12.323203+0000","last_peered":"2024-09-12T02:02:12.323203+0000","last_clean":"2024-09-12T02:02:12.323203+0000","last_became_active":"2024-09-12T02:02:11.337827+0000","last_became_peered":"2024-09-12T02:02:11.337827+0000","last_unstale":"2024-09-12T02:02:12.323203+0000","last_undegraded":"2024-09-12T02:02:12.323203+0000","last_fullsized":"2024-09-12T02:02:12.323203+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:25.822689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.346766+0000","last_change":"2024-09-12T02:02:12.345192+0000","last_active":"2024-09-12T02:02:12.346766+0000","last_peered":"2024-09-12T02:02:12.346766+0000","last_clean":"2024-09-12T02:02:12.346766+0000","last_became_active":"2024-09-12T02:02:12.344763+0000","last_became_peered":"2024-09-12T02:02:12.344763+0000","last_unstale":"2024-09-12T02:02:12.346766+0000","last_undegraded":"2024-09-12T02:02:12.346766+0000","last_fullsized":"2024-09-12T02:02:12.346766+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:29.370257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"92'8","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.356907+0000","last_change":"2024-09-12T02:02:11.336360+0000","last_active":"2024-09-12T02:02:12.356907+0000","last_peered":"2024-09-12T02:02:12.356907+0000","last_clean":"2024-09-12T02:02:12.356907+0000","last_became_active":"2024-09-12T02:02:11.336065+0000","last_became_peered":"2024-09-12T02:02:11.336065+0000","last_unstale":"2024-09-12T02:02:12.356907+0000","last_undegraded":"2024-09-12T02:02:12.356907+0000","last_fullsized":"2024-09-12T02:02:12.356907+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:11.233739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.351195+0000","last_change":"2024-09-12T02:02:12.350095+0000","last_active":"2024-09-12T02:02:12.351195+0000","last_peered":"2024-09-12T02:02:12.351195+0000","last_clean":"2024-09-12T02:02:12.351195+0000","last_became_active":"2024-09-12T02:02:12.349756+0000","last_became_peered":"2024-09-12T02:02:12.349756+0000","last_unstale":"2024-09-12T02:02:12.351195+0000","last_undegraded":"2024-09-12T02:02:12.351195+0000","last_fullsized":"2024-09-12T02:02:12.351195+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:05.645626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.324132+0000","last_change":"2024-09-12T02:02:11.327980+0000","last_active":"2024-09-12T02:02:13.324132+0000","last_peered":"2024-09-12T02:02:13.324132+0000","last_clean":"2024-09-12T02:02:13.324132+0000","last_became_active":"2024-09-12T02:02:11.327687+0000","last_became_peered":"2024-09-12T02:02:11.327687+0000","last_unstale":"2024-09-12T02:02:13.324132+0000","last_undegraded":"2024-09-12T02:02:13.324132+0000","last_fullsized":"2024-09-12T02:02:13.324132+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:15.056421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323117+0000","last_change":"2024-09-12T02:02:12.333663+0000","last_active":"2024-09-12T02:02:13.323117+0000","last_peered":"2024-09-12T02:02:13.323117+0000","last_clean":"2024-09-12T02:02:13.323117+0000","last_became_active":"2024-09-12T02:02:12.333334+0000","last_became_peered":"2024-09-12T02:02:12.333334+0000","last_unstale":"2024-09-12T02:02:13.323117+0000","last_undegraded":"2024-09-12T02:02:13.323117+0000","last_fullsized":"2024-09-12T02:02:13.323117+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:08.450410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412473+0000","last_change":"2024-09-12T02:02:11.331682+0000","last_active":"2024-09-12T02:02:13.412473+0000","last_peered":"2024-09-12T02:02:13.412473+0000","last_clean":"2024-09-12T02:02:13.412473+0000","last_became_active":"2024-09-12T02:02:11.331384+0000","last_became_peered":"2024-09-12T02:02:11.331384+0000","last_unstale":"2024-09-12T02:02:13.412473+0000","last_undegraded":"2024-09-12T02:02:13.412473+0000","last_fullsized":"2024-09-12T02:02:13.412473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:30.836043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323444+0000","last_change":"2024-09-12T02:02:11.323444+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323444+0000","last_undegraded":"2024-09-12T02:02:11.323444+0000","last_fullsized":"2024-09-12T02:02:11.323444+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.334831+0000","last_change":"2024-09-12T02:02:11.333247+0000","last_active":"2024-09-12T02:02:11.334831+0000","last_peered":"2024-09-12T02:02:11.334831+0000","last_clean":"2024-09-12T02:02:11.334831+0000","last_became_active":"2024-09-12T02:02:11.332967+0000","last_became_peered":"2024-09-12T02:02:11.332967+0000","last_unstale":"2024-09-12T02:02:11.334831+0000","last_undegraded":"2024-09-12T02:02:11.334831+0000","last_fullsized":"2024-09-12T02:02:11.334831+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:36.986789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.342109+0000","last_change":"2024-09-12T02:02:12.338322+0000","last_active":"2024-09-12T02:02:12.342109+0000","last_peered":"2024-09-12T02:02:12.342109+0000","last_clean":"2024-09-12T02:02:12.342109+0000","last_became_active":"2024-09-12T02:02:12.338015+0000","last_became_peered":"2024-09-12T02:02:12.338015+0000","last_unstale":"2024-09-12T02:02:12.342109+0000","last_undegraded":"2024-09-12T02:02:12.342109+0000","last_fullsized":"2024-09-12T02:02:12.342109+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:47.736613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340361+0000","last_change":"2024-09-12T02:02:11.332292+0000","last_active":"2024-09-12T02:02:13.340361+0000","last_peered":"2024-09-12T02:02:13.340361+0000","last_clean":"2024-09-12T02:02:13.340361+0000","last_became_active":"2024-09-12T02:02:11.332012+0000","last_became_peered":"2024-09-12T02:02:11.332012+0000","last_unstale":"2024-09-12T02:02:13.340361+0000","last_undegraded":"2024-09-12T02:02:13.340361+0000","last_fullsized":"2024-09-12T02:02:13.340361+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:31.076337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340404+0000","last_change":"2024-09-12T02:02:12.349435+0000","last_active":"2024-09-12T02:02:13.340404+0000","last_peered":"2024-09-12T02:02:13.340404+0000","last_clean":"2024-09-12T02:02:13.340404+0000","last_became_active":"2024-09-12T02:02:12.347614+0000","last_became_peered":"2024-09-12T02:02:12.347614+0000","last_unstale":"2024-09-12T02:02:13.340404+0000","last_undegraded":"2024-09-12T02:02:13.340404+0000","last_fullsized":"2024-09-12T02:02:13.340404+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:29.496591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.321807+0000","last_change":"2024-09-12T02:02:11.330103+0000","last_active":"2024-09-12T02:02:12.321807+0000","last_peered":"2024-09-12T02:02:12.321807+0000","last_clean":"2024-09-12T02:02:12.321807+0000","last_became_active":"2024-09-12T02:02:11.329822+0000","last_became_peered":"2024-09-12T02:02:11.329822+0000","last_unstale":"2024-09-12T02:02:12.321807+0000","last_undegraded":"2024-09-12T02:02:12.321807+0000","last_fullsized":"2024-09-12T02:02:12.321807+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:00.660882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340435+0000","last_change":"2024-09-12T02:02:12.343786+0000","last_active":"2024-09-12T02:02:13.340435+0000","last_peered":"2024-09-12T02:02:13.340435+0000","last_clean":"2024-09-12T02:02:13.340435+0000","last_became_active":"2024-09-12T02:02:12.343506+0000","last_became_peered":"2024-09-12T02:02:12.343506+0000","last_unstale":"2024-09-12T02:02:13.340435+0000","last_undegraded":"2024-09-12T02:02:13.340435+0000","last_fullsized":"2024-09-12T02:02:13.340435+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:58.287049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340526+0000","last_change":"2024-09-12T02:02:11.337862+0000","last_active":"2024-09-12T02:02:13.340526+0000","last_peered":"2024-09-12T02:02:13.340526+0000","last_clean":"2024-09-12T02:02:13.340526+0000","last_became_active":"2024-09-12T02:02:11.337384+0000","last_became_peered":"2024-09-12T02:02:11.337384+0000","last_unstale":"2024-09-12T02:02:13.340526+0000","last_undegraded":"2024-09-12T02:02:13.340526+0000","last_fullsized":"2024-09-12T02:02:13.340526+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:03.587791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336675+0000","last_change":"2024-09-12T02:02:12.332334+0000","last_active":"2024-09-12T02:02:12.336675+0000","last_peered":"2024-09-12T02:02:12.336675+0000","last_clean":"2024-09-12T02:02:12.336675+0000","last_became_active":"2024-09-12T02:02:12.331814+0000","last_became_peered":"2024-09-12T02:02:12.331814+0000","last_unstale":"2024-09-12T02:02:12.336675+0000","last_undegraded":"2024-09-12T02:02:12.336675+0000","last_fullsized":"2024-09-12T02:02:12.336675+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:53.448271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.322071+0000","last_change":"2024-09-12T02:02:11.329706+0000","last_active":"2024-09-12T02:02:12.322071+0000","last_peered":"2024-09-12T02:02:12.322071+0000","last_clean":"2024-09-12T02:02:12.322071+0000","last_became_active":"2024-09-12T02:02:11.329422+0000","last_became_peered":"2024-09-12T02:02:11.329422+0000","last_unstale":"2024-09-12T02:02:12.322071+0000","last_undegraded":"2024-09-12T02:02:12.322071+0000","last_fullsized":"2024-09-12T02:02:12.322071+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:17.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323458+0000","last_change":"2024-09-12T02:02:12.334098+0000","last_active":"2024-09-12T02:02:13.323458+0000","last_peered":"2024-09-12T02:02:13.323458+0000","last_clean":"2024-09-12T02:02:13.323458+0000","last_became_active":"2024-09-12T02:02:12.332786+0000","last_became_peered":"2024-09-12T02:02:12.332786+0000","last_unstale":"2024-09-12T02:02:13.323458+0000","last_undegraded":"2024-09-12T02:02:13.323458+0000","last_fullsized":"2024-09-12T02:02:13.323458+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:15.955019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412678+0000","last_change":"2024-09-12T02:02:11.334960+0000","last_active":"2024-09-12T02:02:13.412678+0000","last_peered":"2024-09-12T02:02:13.412678+0000","last_clean":"2024-09-12T02:02:13.412678+0000","last_became_active":"2024-09-12T02:02:11.334693+0000","last_became_peered":"2024-09-12T02:02:11.334693+0000","last_unstale":"2024-09-12T02:02:13.412678+0000","last_undegraded":"2024-09-12T02:02:13.412678+0000","last_fullsized":"2024-09-12T02:02:13.412678+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:28.491104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.345995+0000","last_change":"2024-09-12T02:02:12.342917+0000","last_active":"2024-09-12T02:02:12.345995+0000","last_peered":"2024-09-12T02:02:12.345995+0000","last_clean":"2024-09-12T02:02:12.345995+0000","last_became_active":"2024-09-12T02:02:12.342611+0000","last_became_peered":"2024-09-12T02:02:12.342611+0000","last_unstale":"2024-09-12T02:02:12.345995+0000","last_undegraded":"2024-09-12T02:02:12.345995+0000","last_fullsized":"2024-09-12T02:02:12.345995+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:13.465096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.334509+0000","last_change":"2024-09-12T02:02:11.331807+0000","last_active":"2024-09-12T02:02:11.334509+0000","last_peered":"2024-09-12T02:02:11.334509+0000","last_clean":"2024-09-12T02:02:11.334509+0000","last_became_active":"2024-09-12T02:02:11.331545+0000","last_became_peered":"2024-09-12T02:02:11.331545+0000","last_unstale":"2024-09-12T02:02:11.334509+0000","last_undegraded":"2024-09-12T02:02:11.334509+0000","last_fullsized":"2024-09-12T02:02:11.334509+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:07.526436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336659+0000","last_change":"2024-09-12T02:02:12.331122+0000","last_active":"2024-09-12T02:02:12.336659+0000","last_peered":"2024-09-12T02:02:12.336659+0000","last_clean":"2024-09-12T02:02:12.336659+0000","last_became_active":"2024-09-12T02:02:12.330378+0000","last_became_peered":"2024-09-12T02:02:12.330378+0000","last_unstale":"2024-09-12T02:02:12.336659+0000","last_undegraded":"2024-09-12T02:02:12.336659+0000","last_fullsized":"2024-09-12T02:02:12.336659+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:51.393021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.337903+0000","last_change":"2024-09-12T02:02:11.335862+0000","last_active":"2024-09-12T02:02:11.337903+0000","last_peered":"2024-09-12T02:02:11.337903+0000","last_clean":"2024-09-12T02:02:11.337903+0000","last_became_active":"2024-09-12T02:02:11.335603+0000","last_became_peered":"2024-09-12T02:02:11.335603+0000","last_unstale":"2024-09-12T02:02:11.337903+0000","last_undegraded":"2024-09-12T02:02:11.337903+0000","last_fullsized":"2024-09-12T02:02:11.337903+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:01.073635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340679+0000","last_change":"2024-09-12T02:02:12.349940+0000","last_active":"2024-09-12T02:02:13.340679+0000","last_peered":"2024-09-12T02:02:13.340679+0000","last_clean":"2024-09-12T02:02:13.340679+0000","last_became_active":"2024-09-12T02:02:12.349675+0000","last_became_peered":"2024-09-12T02:02:12.349675+0000","last_unstale":"2024-09-12T02:02:13.340679+0000","last_undegraded":"2024-09-12T02:02:13.340679+0000","last_fullsized":"2024-09-12T02:02:13.340679+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:19.218621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323638+0000","last_change":"2024-09-12T02:02:11.331813+0000","last_active":"2024-09-12T02:02:13.323638+0000","last_peered":"2024-09-12T02:02:13.323638+0000","last_clean":"2024-09-12T02:02:13.323638+0000","last_became_active":"2024-09-12T02:02:11.331505+0000","last_became_peered":"2024-09-12T02:02:11.331505+0000","last_unstale":"2024-09-12T02:02:13.323638+0000","last_undegraded":"2024-09-12T02:02:13.323638+0000","last_fullsized":"2024-09-12T02:02:13.323638+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:31.234575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336540+0000","last_change":"2024-09-12T02:02:12.333131+0000","last_active":"2024-09-12T02:02:12.336540+0000","last_peered":"2024-09-12T02:02:12.336540+0000","last_clean":"2024-09-12T02:02:12.336540+0000","last_became_active":"2024-09-12T02:02:12.332829+0000","last_became_peered":"2024-09-12T02:02:12.332829+0000","last_unstale":"2024-09-12T02:02:12.336540+0000","last_undegraded":"2024-09-12T02:02:12.336540+0000","last_fullsized":"2024-09-12T02:02:12.336540+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:20.234006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.326472+0000","last_change":"2024-09-12T02:02:11.338517+0000","last_active":"2024-09-12T02:02:12.326472+0000","last_peered":"2024-09-12T02:02:12.326472+0000","last_clean":"2024-09-12T02:02:12.326472+0000","last_became_active":"2024-09-12T02:02:11.338195+0000","last_became_peered":"2024-09-12T02:02:11.338195+0000","last_unstale":"2024-09-12T02:02:12.326472+0000","last_undegraded":"2024-09-12T02:02:12.326472+0000","last_fullsized":"2024-09-12T02:02:12.326472+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:23.513062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335125+0000","last_change":"2024-09-12T02:02:12.327683+0000","last_active":"2024-09-12T02:02:12.335125+0000","last_peered":"2024-09-12T02:02:12.335125+0000","last_clean":"2024-09-12T02:02:12.335125+0000","last_became_active":"2024-09-12T02:02:12.327416+0000","last_became_peered":"2024-09-12T02:02:12.327416+0000","last_unstale":"2024-09-12T02:02:12.335125+0000","last_undegraded":"2024-09-12T02:02:12.335125+0000","last_fullsized":"2024-09-12T02:02:12.335125+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:57.332382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340551+0000","last_change":"2024-09-12T02:02:11.328426+0000","last_active":"2024-09-12T02:02:13.340551+0000","last_peered":"2024-09-12T02:02:13.340551+0000","last_clean":"2024-09-12T02:02:13.340551+0000","last_became_active":"2024-09-12T02:02:11.328217+0000","last_became_peered":"2024-09-12T02:02:11.328217+0000","last_unstale":"2024-09-12T02:02:13.340551+0000","last_undegraded":"2024-09-12T02:02:13.340551+0000","last_fullsized":"2024-09-12T02:02:13.340551+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:36.031506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323434+0000","last_change":"2024-09-12T02:02:12.340317+0000","last_active":"2024-09-12T02:02:13.323434+0000","last_peered":"2024-09-12T02:02:13.323434+0000","last_clean":"2024-09-12T02:02:13.323434+0000","last_became_active":"2024-09-12T02:02:12.340058+0000","last_became_peered":"2024-09-12T02:02:12.340058+0000","last_unstale":"2024-09-12T02:02:13.323434+0000","last_undegraded":"2024-09-12T02:02:13.323434+0000","last_fullsized":"2024-09-12T02:02:13.323434+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:07.388059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323058+0000","last_change":"2024-09-12T02:02:11.327599+0000","last_active":"2024-09-12T02:02:13.323058+0000","last_peered":"2024-09-12T02:02:13.323058+0000","last_clean":"2024-09-12T02:02:13.323058+0000","last_became_active":"2024-09-12T02:02:11.327287+0000","last_became_peered":"2024-09-12T02:02:11.327287+0000","last_unstale":"2024-09-12T02:02:13.323058+0000","last_undegraded":"2024-09-12T02:02:13.323058+0000","last_fullsized":"2024-09-12T02:02:13.323058+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:30.857360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336647+0000","last_change":"2024-09-12T02:02:12.332093+0000","last_active":"2024-09-12T02:02:12.336647+0000","last_peered":"2024-09-12T02:02:12.336647+0000","last_clean":"2024-09-12T02:02:12.336647+0000","last_became_active":"2024-09-12T02:02:12.331500+0000","last_became_peered":"2024-09-12T02:02:12.331500+0000","last_unstale":"2024-09-12T02:02:12.336647+0000","last_undegraded":"2024-09-12T02:02:12.336647+0000","last_fullsized":"2024-09-12T02:02:12.336647+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:48.686084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412398+0000","last_change":"2024-09-12T02:02:11.329064+0000","last_active":"2024-09-12T02:02:13.412398+0000","last_peered":"2024-09-12T02:02:13.412398+0000","last_clean":"2024-09-12T02:02:13.412398+0000","last_became_active":"2024-09-12T02:02:11.328800+0000","last_became_peered":"2024-09-12T02:02:11.328800+0000","last_unstale":"2024-09-12T02:02:13.412398+0000","last_undegraded":"2024-09-12T02:02:13.412398+0000","last_fullsized":"2024-09-12T02:02:13.412398+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:12.833485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412626+0000","last_change":"2024-09-12T02:02:12.341167+0000","last_active":"2024-09-12T02:02:13.412626+0000","last_peered":"2024-09-12T02:02:13.412626+0000","last_clean":"2024-09-12T02:02:13.412626+0000","last_became_active":"2024-09-12T02:02:12.340921+0000","last_became_peered":"2024-09-12T02:02:12.340921+0000","last_unstale":"2024-09-12T02:02:13.412626+0000","last_undegraded":"2024-09-12T02:02:13.412626+0000","last_fullsized":"2024-09-12T02:02:13.412626+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.801762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.324675+0000","last_change":"2024-09-12T02:02:11.329351+0000","last_active":"2024-09-12T02:02:12.324675+0000","last_peered":"2024-09-12T02:02:12.324675+0000","last_clean":"2024-09-12T02:02:12.324675+0000","last_became_active":"2024-09-12T02:02:11.329049+0000","last_became_peered":"2024-09-12T02:02:11.329049+0000","last_unstale":"2024-09-12T02:02:12.324675+0000","last_undegraded":"2024-09-12T02:02:12.324675+0000","last_fullsized":"2024-09-12T02:02:12.324675+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:09.295690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":304,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412422+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T02:02:13.412422+0000","last_peered":"2024-09-12T02:02:13.412422+0000","last_clean":"2024-09-12T02:02:13.412422+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T02:02:13.412422+0000","last_undegraded":"2024-09-12T02:02:13.412422+0000","last_fullsized":"2024-09-12T02:02:13.412422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509522,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32888,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338952,"statfs":{"total":96636764160,"available":96603086848,"internally_reserved":0,"allocated":1740800,"data_stored":1119434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509521,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1159168,"data_stored":531226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509522,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1138688,"data_stored":529010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542226,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1126400,"data_stored":522318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542226,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1126400,"data_stored":522318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542226,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1130496,"data_stored":522388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542226,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32900,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338940,"statfs":{"total":96636764160,"available":96603074560,"internally_reserved":0,"allocated":1744896,"data_stored":1115004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1114112,"data_stored":515151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:02:15.331 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:02:15.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.470+0000 7fabc905e640 1 Processor -- start 2024-09-12T02:02:15.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.470+0000 7fabc905e640 1 -- start start 2024-09-12T02:02:15.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.471+0000 7fabc905e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fabc415e5d0 0x7fabc40d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.471+0000 7fabc905e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc409b140 0x7fabc4168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.471+0000 7fabc905e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabc406cec0 con 0x7fabc406df60 2024-09-12T02:02:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.471+0000 7fabc905e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fabc406dad0 con 0x7fabc415e5d0 2024-09-12T02:02:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.471+0000 7fabc905e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fabc406d1a0 con 0x7fabc409b140 2024-09-12T02:02:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.471+0000 7fabc359e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc409b140 0x7fabc4168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.471+0000 7fabc2d9d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fabc415e5d0 0x7fabc40d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.471+0000 7fabc359e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc409b140 0x7fabc4168560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:39874/0 (socket says 172.21.15.19:39874) 2024-09-12T02:02:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.471+0000 7fabc359e640 1 -- 172.21.15.19:0/661998818 learned_addr learned my addr 172.21.15.19:0/661998818 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.471+0000 7fabc359e640 1 -- 172.21.15.19:0/661998818 >> v2:172.21.15.135:3300/0 conn(0x7fabc415e5d0 msgr2=0x7fabc40d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.471+0000 7fabc359e640 1 --2- 172.21.15.19:0/661998818 >> v2:172.21.15.135:3300/0 conn(0x7fabc415e5d0 0x7fabc40d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.471+0000 7fabc359e640 1 -- 172.21.15.19:0/661998818 >> v1:172.21.15.135:6789/0 conn(0x7fabc406df60 legacy=0x7fabc409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.471+0000 7fabc359e640 1 -- 172.21.15.19:0/661998818 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc406d480 con 0x7fabc409b140 2024-09-12T02:02:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.471+0000 7fabc2d9d640 1 --2- 172.21.15.19:0/661998818 >> v2:172.21.15.135:3300/0 conn(0x7fabc415e5d0 0x7fabc40d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.472+0000 7fabc359e640 1 --2- 172.21.15.19:0/661998818 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc409b140 0x7fabc4168560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009e50 tx=0x7fabbc02a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f66d602ab3d79c57 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.473+0000 7fabc1d9b640 1 -- 172.21.15.19:0/661998818 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc036070 con 0x7fabc409b140 2024-09-12T02:02:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.473+0000 7fabc1d9b640 1 -- 172.21.15.19:0/661998818 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabbc031600 con 0x7fabc409b140 2024-09-12T02:02:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.473+0000 7fabc1d9b640 1 -- 172.21.15.19:0/661998818 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc0319d0 con 0x7fabc409b140 2024-09-12T02:02:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.473+0000 7fabc905e640 1 -- 172.21.15.19:0/661998818 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc409b140 msgr2=0x7fabc4168560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.473+0000 7fabc905e640 1 --2- 172.21.15.19:0/661998818 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc409b140 0x7fabc4168560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009e50 tx=0x7fabbc02a7a0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.473+0000 7fabc905e640 1 -- 172.21.15.19:0/661998818 shutdown_connections 2024-09-12T02:02:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.473+0000 7fabc905e640 1 --2- 172.21.15.19:0/661998818 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc409b140 0x7fabc4168560 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.473+0000 7fabc905e640 1 --2- 172.21.15.19:0/661998818 >> v2:172.21.15.135:3300/0 conn(0x7fabc415e5d0 0x7fabc40d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.473+0000 7fabc905e640 1 -- 172.21.15.19:0/661998818 >> 172.21.15.19:0/661998818 conn(0x7fabc40d23a0 msgr2=0x7fabc40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.473+0000 7fabc905e640 1 -- 172.21.15.19:0/661998818 shutdown_connections 2024-09-12T02:02:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.473+0000 7fabc905e640 1 -- 172.21.15.19:0/661998818 wait complete. 2024-09-12T02:02:15.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.475+0000 7fabc905e640 1 Processor -- start 2024-09-12T02:02:15.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.475+0000 7fabc905e640 1 -- start start 2024-09-12T02:02:15.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.475+0000 7fabc905e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc406df60 0x7fabc4153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.475+0000 7fabc905e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc409b140 0x7fabc40c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.475+0000 7fabc905e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabc415e5d0 0x7fabc40b7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.475+0000 7fabc905e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fabc415eb30 con 0x7fabc415e5d0 2024-09-12T02:02:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.475+0000 7fabc905e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fabc415e9b0 con 0x7fabc406df60 2024-09-12T02:02:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.475+0000 7fabc905e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fabc40d1630 con 0x7fabc409b140 2024-09-12T02:02:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.475+0000 7fabc359e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabc415e5d0 0x7fabc40b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.475+0000 7fabc359e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabc415e5d0 0x7fabc40b7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35156/0 (socket says 172.21.15.19:35156) 2024-09-12T02:02:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.475+0000 7fabc359e640 1 -- 172.21.15.19:0/1838165733 learned_addr learned my addr 172.21.15.19:0/1838165733 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.476+0000 7fabc259c640 1 --2- 172.21.15.19:0/1838165733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc409b140 0x7fabc40c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.476+0000 7fabc2d9d640 1 --2- 172.21.15.19:0/1838165733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc406df60 0x7fabc4153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.476+0000 7fabc359e640 1 -- 172.21.15.19:0/1838165733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc409b140 msgr2=0x7fabc40c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.476+0000 7fabc359e640 1 --2- 172.21.15.19:0/1838165733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc409b140 0x7fabc40c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.476+0000 7fabc359e640 1 -- 172.21.15.19:0/1838165733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc406df60 msgr2=0x7fabc4153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.476+0000 7fabc359e640 1 --2- 172.21.15.19:0/1838165733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc406df60 0x7fabc4153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.476+0000 7fabc359e640 1 -- 172.21.15.19:0/1838165733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc40c6df0 con 0x7fabc415e5d0 2024-09-12T02:02:15.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.476+0000 7fabc259c640 1 --2- 172.21.15.19:0/1838165733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc409b140 0x7fabc40c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:15.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.476+0000 7fabc359e640 1 --2- 172.21.15.19:0/1838165733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabc415e5d0 0x7fabc40b7510 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009e50 tx=0x7fabbc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:15.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.476+0000 7fabab7fe640 1 -- 172.21.15.19:0/1838165733 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc036050 con 0x7fabc415e5d0 2024-09-12T02:02:15.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.476+0000 7fabab7fe640 1 -- 172.21.15.19:0/1838165733 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabbc042070 con 0x7fabc415e5d0 2024-09-12T02:02:15.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.476+0000 7fabc905e640 1 -- 172.21.15.19:0/1838165733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc40c70d0 con 0x7fabc415e5d0 2024-09-12T02:02:15.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.476+0000 7fabab7fe640 1 -- 172.21.15.19:0/1838165733 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc009510 con 0x7fabc415e5d0 2024-09-12T02:02:15.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.476+0000 7fabc905e640 1 -- 172.21.15.19:0/1838165733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc40c7690 con 0x7fabc415e5d0 2024-09-12T02:02:15.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.477+0000 7fabc905e640 1 -- 172.21.15.19:0/1838165733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabc40d10f0 con 0x7fabc415e5d0 2024-09-12T02:02:15.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.478+0000 7fabab7fe640 1 -- 172.21.15.19:0/1838165733 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fabbc007b70 con 0x7fabc415e5d0 2024-09-12T02:02:15.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.478+0000 7fabab7fe640 1 --2- 172.21.15.19:0/1838165733 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabb006be30 0x7fabb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.478+0000 7fabab7fe640 1 -- 172.21.15.19:0/1838165733 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6101+0+0 (secure 0 0 0) 0x7fabbc0abea0 con 0x7fabc415e5d0 2024-09-12T02:02:15.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.479+0000 7fabc2d9d640 1 --2- 172.21.15.19:0/1838165733 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabb006be30 0x7fabb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.479+0000 7fabc2d9d640 1 --2- 172.21.15.19:0/1838165733 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabb006be30 0x7fabb006e2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009560 tx=0x7fabb4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:15.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.483+0000 7fabab7fe640 1 -- 172.21.15.19:0/1838165733 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fabbc079ec0 con 0x7fabc415e5d0 2024-09-12T02:02:15.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.655+0000 7fabc905e640 1 -- 172.21.15.19:0/1838165733 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fabc40b8320 con 0x7fabb006be30 2024-09-12T02:02:15.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.662+0000 7fabab7fe640 1 -- 172.21.15.19:0/1838165733 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251047 (secure 0 0 0) 0x7fabc40b8320 con 0x7fabb006be30 2024-09-12T02:02:15.665 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:15.666 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T02:02:15.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.665+0000 7fabc905e640 1 -- 172.21.15.19:0/1838165733 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabb006be30 msgr2=0x7fabb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.665+0000 7fabc905e640 1 --2- 172.21.15.19:0/1838165733 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabb006be30 0x7fabb006e2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009560 tx=0x7fabb4009190 comp rx=0 tx=0).stop 2024-09-12T02:02:15.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.665+0000 7fabc905e640 1 -- 172.21.15.19:0/1838165733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabc415e5d0 msgr2=0x7fabc40b7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.665+0000 7fabc905e640 1 --2- 172.21.15.19:0/1838165733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabc415e5d0 0x7fabc40b7510 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009e50 tx=0x7fabbc004a40 comp rx=0 tx=0).stop 2024-09-12T02:02:15.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.665+0000 7fabc905e640 1 -- 172.21.15.19:0/1838165733 shutdown_connections 2024-09-12T02:02:15.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.665+0000 7fabc905e640 1 --2- 172.21.15.19:0/1838165733 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabb006be30 0x7fabb006e2f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.665+0000 7fabc905e640 1 --2- 172.21.15.19:0/1838165733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabc415e5d0 0x7fabc40b7510 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.665+0000 7fabc905e640 1 --2- 172.21.15.19:0/1838165733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc409b140 0x7fabc40c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.665+0000 7fabc905e640 1 --2- 172.21.15.19:0/1838165733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc406df60 0x7fabc4153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.665+0000 7fabc905e640 1 -- 172.21.15.19:0/1838165733 >> 172.21.15.19:0/1838165733 conn(0x7fabc40d23a0 msgr2=0x7fabc4071920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:15.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.665+0000 7fabc905e640 1 -- 172.21.15.19:0/1838165733 shutdown_connections 2024-09-12T02:02:15.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.665+0000 7fabc905e640 1 -- 172.21.15.19:0/1838165733 wait complete. 2024-09-12T02:02:15.676 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2024-09-12T02:02:14.177257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592618,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":198,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251244,"kb_used_data":10040,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754723476,"statfs":{"total":773094113280,"available":772836839424,"internally_reserved":0,"allocated":10280960,"data_stored":5376849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000943"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.339480+0000","last_change":"2024-09-12T02:02:12.332361+0000","last_active":"2024-09-12T02:02:12.339480+0000","last_peered":"2024-09-12T02:02:12.339480+0000","last_clean":"2024-09-12T02:02:12.339480+0000","last_became_active":"2024-09-12T02:02:12.332101+0000","last_became_peered":"2024-09-12T02:02:12.332101+0000","last_unstale":"2024-09-12T02:02:12.339480+0000","last_undegraded":"2024-09-12T02:02:12.339480+0000","last_fullsized":"2024-09-12T02:02:12.339480+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:32.854191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340632+0000","last_change":"2024-09-12T02:02:12.338898+0000","last_active":"2024-09-12T02:02:13.340632+0000","last_peered":"2024-09-12T02:02:13.340632+0000","last_clean":"2024-09-12T02:02:13.340632+0000","last_became_active":"2024-09-12T02:02:12.338509+0000","last_became_peered":"2024-09-12T02:02:12.338509+0000","last_unstale":"2024-09-12T02:02:13.340632+0000","last_undegraded":"2024-09-12T02:02:13.340632+0000","last_fullsized":"2024-09-12T02:02:13.340632+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:55.080145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.351384+0000","last_change":"2024-09-12T02:02:12.348813+0000","last_active":"2024-09-12T02:02:12.351384+0000","last_peered":"2024-09-12T02:02:12.351384+0000","last_clean":"2024-09-12T02:02:12.351384+0000","last_became_active":"2024-09-12T02:02:12.348446+0000","last_became_peered":"2024-09-12T02:02:12.348446+0000","last_unstale":"2024-09-12T02:02:12.351384+0000","last_undegraded":"2024-09-12T02:02:12.351384+0000","last_fullsized":"2024-09-12T02:02:12.351384+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:13.655779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.337680+0000","last_change":"2024-09-12T02:02:12.336248+0000","last_active":"2024-09-12T02:02:12.337680+0000","last_peered":"2024-09-12T02:02:12.337680+0000","last_clean":"2024-09-12T02:02:12.337680+0000","last_became_active":"2024-09-12T02:02:12.335952+0000","last_became_peered":"2024-09-12T02:02:12.335952+0000","last_unstale":"2024-09-12T02:02:12.337680+0000","last_undegraded":"2024-09-12T02:02:12.337680+0000","last_fullsized":"2024-09-12T02:02:12.337680+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:28.825819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.322680+0000","last_change":"2024-09-12T02:02:11.322680+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.322680+0000","last_undegraded":"2024-09-12T02:02:11.322680+0000","last_fullsized":"2024-09-12T02:02:11.322680+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.342680+0000","last_change":"2024-09-12T02:02:12.338436+0000","last_active":"2024-09-12T02:02:12.342680+0000","last_peered":"2024-09-12T02:02:12.342680+0000","last_clean":"2024-09-12T02:02:12.342680+0000","last_became_active":"2024-09-12T02:02:12.338088+0000","last_became_peered":"2024-09-12T02:02:12.338088+0000","last_unstale":"2024-09-12T02:02:12.342680+0000","last_undegraded":"2024-09-12T02:02:12.342680+0000","last_fullsized":"2024-09-12T02:02:12.342680+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:03.708954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412540+0000","last_change":"2024-09-12T02:02:12.340218+0000","last_active":"2024-09-12T02:02:13.412540+0000","last_peered":"2024-09-12T02:02:13.412540+0000","last_clean":"2024-09-12T02:02:13.412540+0000","last_became_active":"2024-09-12T02:02:12.339861+0000","last_became_peered":"2024-09-12T02:02:12.339861+0000","last_unstale":"2024-09-12T02:02:13.412540+0000","last_undegraded":"2024-09-12T02:02:13.412540+0000","last_fullsized":"2024-09-12T02:02:13.412540+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:51.659882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336910+0000","last_change":"2024-09-12T02:02:12.333340+0000","last_active":"2024-09-12T02:02:12.336910+0000","last_peered":"2024-09-12T02:02:12.336910+0000","last_clean":"2024-09-12T02:02:12.336910+0000","last_became_active":"2024-09-12T02:02:12.333067+0000","last_became_peered":"2024-09-12T02:02:12.333067+0000","last_unstale":"2024-09-12T02:02:12.336910+0000","last_undegraded":"2024-09-12T02:02:12.336910+0000","last_fullsized":"2024-09-12T02:02:12.336910+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:42.119881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.324473+0000","last_change":"2024-09-12T02:02:11.324473+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.324473+0000","last_undegraded":"2024-09-12T02:02:11.324473+0000","last_fullsized":"2024-09-12T02:02:11.324473+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.329564+0000","last_change":"2024-09-12T02:02:12.328431+0000","last_active":"2024-09-12T02:02:12.329564+0000","last_peered":"2024-09-12T02:02:12.329564+0000","last_clean":"2024-09-12T02:02:12.329564+0000","last_became_active":"2024-09-12T02:02:12.328148+0000","last_became_peered":"2024-09-12T02:02:12.328148+0000","last_unstale":"2024-09-12T02:02:12.329564+0000","last_undegraded":"2024-09-12T02:02:12.329564+0000","last_fullsized":"2024-09-12T02:02:12.329564+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:05.794542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.322247+0000","last_change":"2024-09-12T02:02:11.322247+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.322247+0000","last_undegraded":"2024-09-12T02:02:11.322247+0000","last_fullsized":"2024-09-12T02:02:11.322247+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.328850+0000","last_change":"2024-09-12T02:02:12.327134+0000","last_active":"2024-09-12T02:02:12.328850+0000","last_peered":"2024-09-12T02:02:12.328850+0000","last_clean":"2024-09-12T02:02:12.328850+0000","last_became_active":"2024-09-12T02:02:12.326826+0000","last_became_peered":"2024-09-12T02:02:12.326826+0000","last_unstale":"2024-09-12T02:02:12.328850+0000","last_undegraded":"2024-09-12T02:02:12.328850+0000","last_fullsized":"2024-09-12T02:02:12.328850+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:21.234445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336836+0000","last_change":"2024-09-12T02:02:12.331964+0000","last_active":"2024-09-12T02:02:12.336836+0000","last_peered":"2024-09-12T02:02:12.336836+0000","last_clean":"2024-09-12T02:02:12.336836+0000","last_became_active":"2024-09-12T02:02:12.331686+0000","last_became_peered":"2024-09-12T02:02:12.331686+0000","last_unstale":"2024-09-12T02:02:12.336836+0000","last_undegraded":"2024-09-12T02:02:12.336836+0000","last_fullsized":"2024-09-12T02:02:12.336836+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:31.132531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323252+0000","last_change":"2024-09-12T02:02:11.323252+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323252+0000","last_undegraded":"2024-09-12T02:02:11.323252+0000","last_fullsized":"2024-09-12T02:02:11.323252+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.340755+0000","last_change":"2024-09-12T02:02:12.337578+0000","last_active":"2024-09-12T02:02:12.340755+0000","last_peered":"2024-09-12T02:02:12.340755+0000","last_clean":"2024-09-12T02:02:12.340755+0000","last_became_active":"2024-09-12T02:02:12.337335+0000","last_became_peered":"2024-09-12T02:02:12.337335+0000","last_unstale":"2024-09-12T02:02:12.340755+0000","last_undegraded":"2024-09-12T02:02:12.340755+0000","last_fullsized":"2024-09-12T02:02:12.340755+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:59.464045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335356+0000","last_change":"2024-09-12T02:02:12.330650+0000","last_active":"2024-09-12T02:02:12.335356+0000","last_peered":"2024-09-12T02:02:12.335356+0000","last_clean":"2024-09-12T02:02:12.335356+0000","last_became_active":"2024-09-12T02:02:12.330347+0000","last_became_peered":"2024-09-12T02:02:12.330347+0000","last_unstale":"2024-09-12T02:02:12.335356+0000","last_undegraded":"2024-09-12T02:02:12.335356+0000","last_fullsized":"2024-09-12T02:02:12.335356+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.801762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335304+0000","last_change":"2024-09-12T02:02:12.329326+0000","last_active":"2024-09-12T02:02:12.335304+0000","last_peered":"2024-09-12T02:02:12.335304+0000","last_clean":"2024-09-12T02:02:12.335304+0000","last_became_active":"2024-09-12T02:02:12.329063+0000","last_became_peered":"2024-09-12T02:02:12.329063+0000","last_unstale":"2024-09-12T02:02:12.335304+0000","last_undegraded":"2024-09-12T02:02:12.335304+0000","last_fullsized":"2024-09-12T02:02:12.335304+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:10.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.340436+0000","last_change":"2024-09-12T02:02:12.333053+0000","last_active":"2024-09-12T02:02:12.340436+0000","last_peered":"2024-09-12T02:02:12.340436+0000","last_clean":"2024-09-12T02:02:12.340436+0000","last_became_active":"2024-09-12T02:02:12.332788+0000","last_became_peered":"2024-09-12T02:02:12.332788+0000","last_unstale":"2024-09-12T02:02:12.340436+0000","last_undegraded":"2024-09-12T02:02:12.340436+0000","last_fullsized":"2024-09-12T02:02:12.340436+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:42.844428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.321134+0000","last_change":"2024-09-12T02:02:11.321134+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.321134+0000","last_undegraded":"2024-09-12T02:02:11.321134+0000","last_fullsized":"2024-09-12T02:02:11.321134+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336130+0000","last_change":"2024-09-12T02:02:12.326448+0000","last_active":"2024-09-12T02:02:12.336130+0000","last_peered":"2024-09-12T02:02:12.336130+0000","last_clean":"2024-09-12T02:02:12.336130+0000","last_became_active":"2024-09-12T02:02:12.326137+0000","last_became_peered":"2024-09-12T02:02:12.326137+0000","last_unstale":"2024-09-12T02:02:12.336130+0000","last_undegraded":"2024-09-12T02:02:12.336130+0000","last_fullsized":"2024-09-12T02:02:12.336130+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:06.139652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323540+0000","last_change":"2024-09-12T02:02:11.323540+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323540+0000","last_undegraded":"2024-09-12T02:02:11.323540+0000","last_fullsized":"2024-09-12T02:02:11.323540+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.322810+0000","last_change":"2024-09-12T02:02:11.322810+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.322810+0000","last_undegraded":"2024-09-12T02:02:11.322810+0000","last_fullsized":"2024-09-12T02:02:11.322810+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323252+0000","last_change":"2024-09-12T02:02:12.339608+0000","last_active":"2024-09-12T02:02:13.323252+0000","last_peered":"2024-09-12T02:02:13.323252+0000","last_clean":"2024-09-12T02:02:13.323252+0000","last_became_active":"2024-09-12T02:02:12.339051+0000","last_became_peered":"2024-09-12T02:02:12.339051+0000","last_unstale":"2024-09-12T02:02:13.323252+0000","last_undegraded":"2024-09-12T02:02:13.323252+0000","last_fullsized":"2024-09-12T02:02:13.323252+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:51.986401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.347328+0000","last_change":"2024-09-12T02:02:12.344797+0000","last_active":"2024-09-12T02:02:12.347328+0000","last_peered":"2024-09-12T02:02:12.347328+0000","last_clean":"2024-09-12T02:02:12.347328+0000","last_became_active":"2024-09-12T02:02:12.344507+0000","last_became_peered":"2024-09-12T02:02:12.344507+0000","last_unstale":"2024-09-12T02:02:12.347328+0000","last_undegraded":"2024-09-12T02:02:12.347328+0000","last_fullsized":"2024-09-12T02:02:12.347328+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:48.125756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340618+0000","last_change":"2024-09-12T02:02:12.337746+0000","last_active":"2024-09-12T02:02:13.340618+0000","last_peered":"2024-09-12T02:02:13.340618+0000","last_clean":"2024-09-12T02:02:13.340618+0000","last_became_active":"2024-09-12T02:02:12.337473+0000","last_became_peered":"2024-09-12T02:02:12.337473+0000","last_unstale":"2024-09-12T02:02:13.340618+0000","last_undegraded":"2024-09-12T02:02:13.340618+0000","last_fullsized":"2024-09-12T02:02:13.340618+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:25.348127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323897+0000","last_change":"2024-09-12T02:02:11.323897+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323897+0000","last_undegraded":"2024-09-12T02:02:11.323897+0000","last_fullsized":"2024-09-12T02:02:11.323897+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336967+0000","last_change":"2024-09-12T02:02:12.331869+0000","last_active":"2024-09-12T02:02:12.336967+0000","last_peered":"2024-09-12T02:02:12.336967+0000","last_clean":"2024-09-12T02:02:12.336967+0000","last_became_active":"2024-09-12T02:02:12.331585+0000","last_became_peered":"2024-09-12T02:02:12.331585+0000","last_unstale":"2024-09-12T02:02:12.336967+0000","last_undegraded":"2024-09-12T02:02:12.336967+0000","last_fullsized":"2024-09-12T02:02:12.336967+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:26.480661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.353526+0000","last_change":"2024-09-12T02:02:12.349310+0000","last_active":"2024-09-12T02:02:12.353526+0000","last_peered":"2024-09-12T02:02:12.353526+0000","last_clean":"2024-09-12T02:02:12.353526+0000","last_became_active":"2024-09-12T02:02:12.349030+0000","last_became_peered":"2024-09-12T02:02:12.349030+0000","last_unstale":"2024-09-12T02:02:12.353526+0000","last_undegraded":"2024-09-12T02:02:12.353526+0000","last_fullsized":"2024-09-12T02:02:12.353526+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:23.429351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412462+0000","last_change":"2024-09-12T02:02:12.340402+0000","last_active":"2024-09-12T02:02:13.412462+0000","last_peered":"2024-09-12T02:02:13.412462+0000","last_clean":"2024-09-12T02:02:13.412462+0000","last_became_active":"2024-09-12T02:02:12.340024+0000","last_became_peered":"2024-09-12T02:02:12.340024+0000","last_unstale":"2024-09-12T02:02:13.412462+0000","last_undegraded":"2024-09-12T02:02:13.412462+0000","last_fullsized":"2024-09-12T02:02:13.412462+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:24.518549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.322132+0000","last_change":"2024-09-12T02:02:11.322132+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.322132+0000","last_undegraded":"2024-09-12T02:02:11.322132+0000","last_fullsized":"2024-09-12T02:02:11.322132+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340407+0000","last_change":"2024-09-12T02:02:12.343209+0000","last_active":"2024-09-12T02:02:13.340407+0000","last_peered":"2024-09-12T02:02:13.340407+0000","last_clean":"2024-09-12T02:02:13.340407+0000","last_became_active":"2024-09-12T02:02:12.342918+0000","last_became_peered":"2024-09-12T02:02:12.342918+0000","last_unstale":"2024-09-12T02:02:13.340407+0000","last_undegraded":"2024-09-12T02:02:13.340407+0000","last_fullsized":"2024-09-12T02:02:13.340407+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:20.594709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335337+0000","last_change":"2024-09-12T02:02:12.327747+0000","last_active":"2024-09-12T02:02:12.335337+0000","last_peered":"2024-09-12T02:02:12.335337+0000","last_clean":"2024-09-12T02:02:12.335337+0000","last_became_active":"2024-09-12T02:02:12.327465+0000","last_became_peered":"2024-09-12T02:02:12.327465+0000","last_unstale":"2024-09-12T02:02:12.335337+0000","last_undegraded":"2024-09-12T02:02:12.335337+0000","last_fullsized":"2024-09-12T02:02:12.335337+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:51.659882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.353469+0000","last_change":"2024-09-12T02:02:12.351000+0000","last_active":"2024-09-12T02:02:12.353469+0000","last_peered":"2024-09-12T02:02:12.353469+0000","last_clean":"2024-09-12T02:02:12.353469+0000","last_became_active":"2024-09-12T02:02:12.350573+0000","last_became_peered":"2024-09-12T02:02:12.350573+0000","last_unstale":"2024-09-12T02:02:12.353469+0000","last_undegraded":"2024-09-12T02:02:12.353469+0000","last_fullsized":"2024-09-12T02:02:12.353469+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:52.339672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"92'4","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.324080+0000","last_change":"2024-09-12T02:02:11.333328+0000","last_active":"2024-09-12T02:02:13.324080+0000","last_peered":"2024-09-12T02:02:13.324080+0000","last_clean":"2024-09-12T02:02:13.324080+0000","last_became_active":"2024-09-12T02:02:11.333075+0000","last_became_peered":"2024-09-12T02:02:11.333075+0000","last_unstale":"2024-09-12T02:02:13.324080+0000","last_undegraded":"2024-09-12T02:02:13.324080+0000","last_fullsized":"2024-09-12T02:02:13.324080+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:36.748542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335906+0000","last_change":"2024-09-12T02:02:12.330259+0000","last_active":"2024-09-12T02:02:12.335906+0000","last_peered":"2024-09-12T02:02:12.335906+0000","last_clean":"2024-09-12T02:02:12.335906+0000","last_became_active":"2024-09-12T02:02:12.329970+0000","last_became_peered":"2024-09-12T02:02:12.329970+0000","last_unstale":"2024-09-12T02:02:12.335906+0000","last_undegraded":"2024-09-12T02:02:12.335906+0000","last_fullsized":"2024-09-12T02:02:12.335906+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:52.606535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.333999+0000","last_change":"2024-09-12T02:02:11.329594+0000","last_active":"2024-09-12T02:02:11.333999+0000","last_peered":"2024-09-12T02:02:11.333999+0000","last_clean":"2024-09-12T02:02:11.333999+0000","last_became_active":"2024-09-12T02:02:11.329256+0000","last_became_peered":"2024-09-12T02:02:11.329256+0000","last_unstale":"2024-09-12T02:02:11.333999+0000","last_undegraded":"2024-09-12T02:02:11.333999+0000","last_fullsized":"2024-09-12T02:02:11.333999+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:54.686751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412555+0000","last_change":"2024-09-12T02:02:12.337973+0000","last_active":"2024-09-12T02:02:13.412555+0000","last_peered":"2024-09-12T02:02:13.412555+0000","last_clean":"2024-09-12T02:02:13.412555+0000","last_became_active":"2024-09-12T02:02:12.337659+0000","last_became_peered":"2024-09-12T02:02:12.337659+0000","last_unstale":"2024-09-12T02:02:13.412555+0000","last_undegraded":"2024-09-12T02:02:13.412555+0000","last_fullsized":"2024-09-12T02:02:13.412555+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:10.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412473+0000","last_change":"2024-09-12T02:02:11.333138+0000","last_active":"2024-09-12T02:02:13.412473+0000","last_peered":"2024-09-12T02:02:13.412473+0000","last_clean":"2024-09-12T02:02:13.412473+0000","last_became_active":"2024-09-12T02:02:11.332790+0000","last_became_peered":"2024-09-12T02:02:11.332790+0000","last_unstale":"2024-09-12T02:02:13.412473+0000","last_undegraded":"2024-09-12T02:02:13.412473+0000","last_fullsized":"2024-09-12T02:02:13.412473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:57.281562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336328+0000","last_change":"2024-09-12T02:02:12.333076+0000","last_active":"2024-09-12T02:02:12.336328+0000","last_peered":"2024-09-12T02:02:12.336328+0000","last_clean":"2024-09-12T02:02:12.336328+0000","last_became_active":"2024-09-12T02:02:12.332851+0000","last_became_peered":"2024-09-12T02:02:12.332851+0000","last_unstale":"2024-09-12T02:02:12.336328+0000","last_undegraded":"2024-09-12T02:02:12.336328+0000","last_fullsized":"2024-09-12T02:02:12.336328+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:38.281610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323549+0000","last_change":"2024-09-12T02:02:11.332340+0000","last_active":"2024-09-12T02:02:13.323549+0000","last_peered":"2024-09-12T02:02:13.323549+0000","last_clean":"2024-09-12T02:02:13.323549+0000","last_became_active":"2024-09-12T02:02:11.332101+0000","last_became_peered":"2024-09-12T02:02:11.332101+0000","last_unstale":"2024-09-12T02:02:13.323549+0000","last_undegraded":"2024-09-12T02:02:13.323549+0000","last_fullsized":"2024-09-12T02:02:13.323549+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.886557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.332571+0000","last_change":"2024-09-12T02:02:12.325486+0000","last_active":"2024-09-12T02:02:12.332571+0000","last_peered":"2024-09-12T02:02:12.332571+0000","last_clean":"2024-09-12T02:02:12.332571+0000","last_became_active":"2024-09-12T02:02:12.325177+0000","last_became_peered":"2024-09-12T02:02:12.325177+0000","last_unstale":"2024-09-12T02:02:12.332571+0000","last_undegraded":"2024-09-12T02:02:12.332571+0000","last_fullsized":"2024-09-12T02:02:12.332571+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:28.518234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.337143+0000","last_change":"2024-09-12T02:02:11.333899+0000","last_active":"2024-09-12T02:02:11.337143+0000","last_peered":"2024-09-12T02:02:11.337143+0000","last_clean":"2024-09-12T02:02:11.337143+0000","last_became_active":"2024-09-12T02:02:11.333612+0000","last_became_peered":"2024-09-12T02:02:11.333612+0000","last_unstale":"2024-09-12T02:02:11.337143+0000","last_undegraded":"2024-09-12T02:02:11.337143+0000","last_fullsized":"2024-09-12T02:02:11.337143+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:16.109597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.322959+0000","last_change":"2024-09-12T02:02:12.339670+0000","last_active":"2024-09-12T02:02:13.322959+0000","last_peered":"2024-09-12T02:02:13.322959+0000","last_clean":"2024-09-12T02:02:13.322959+0000","last_became_active":"2024-09-12T02:02:12.339401+0000","last_became_peered":"2024-09-12T02:02:12.339401+0000","last_unstale":"2024-09-12T02:02:13.322959+0000","last_undegraded":"2024-09-12T02:02:13.322959+0000","last_fullsized":"2024-09-12T02:02:13.322959+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:39.396515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"92'1","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.353388+0000","last_change":"2024-09-12T02:02:11.336467+0000","last_active":"2024-09-12T02:02:12.353388+0000","last_peered":"2024-09-12T02:02:12.353388+0000","last_clean":"2024-09-12T02:02:12.353388+0000","last_became_active":"2024-09-12T02:02:11.336029+0000","last_became_peered":"2024-09-12T02:02:11.336029+0000","last_unstale":"2024-09-12T02:02:12.353388+0000","last_undegraded":"2024-09-12T02:02:12.353388+0000","last_fullsized":"2024-09-12T02:02:12.353388+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:33.725746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.342775+0000","last_change":"2024-09-12T02:02:12.338526+0000","last_active":"2024-09-12T02:02:12.342775+0000","last_peered":"2024-09-12T02:02:12.342775+0000","last_clean":"2024-09-12T02:02:12.342775+0000","last_became_active":"2024-09-12T02:02:12.338174+0000","last_became_peered":"2024-09-12T02:02:12.338174+0000","last_unstale":"2024-09-12T02:02:12.342775+0000","last_undegraded":"2024-09-12T02:02:12.342775+0000","last_fullsized":"2024-09-12T02:02:12.342775+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.054924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.317838+0000","last_change":"2024-09-12T02:02:11.326331+0000","last_active":"2024-09-12T02:02:12.317838+0000","last_peered":"2024-09-12T02:02:12.317838+0000","last_clean":"2024-09-12T02:02:12.317838+0000","last_became_active":"2024-09-12T02:02:11.326051+0000","last_became_peered":"2024-09-12T02:02:11.326051+0000","last_unstale":"2024-09-12T02:02:12.317838+0000","last_undegraded":"2024-09-12T02:02:12.317838+0000","last_fullsized":"2024-09-12T02:02:12.317838+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:14.638980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.337500+0000","last_change":"2024-09-12T02:02:12.335645+0000","last_active":"2024-09-12T02:02:12.337500+0000","last_peered":"2024-09-12T02:02:12.337500+0000","last_clean":"2024-09-12T02:02:12.337500+0000","last_became_active":"2024-09-12T02:02:12.335371+0000","last_became_peered":"2024-09-12T02:02:12.335371+0000","last_unstale":"2024-09-12T02:02:12.337500+0000","last_undegraded":"2024-09-12T02:02:12.337500+0000","last_fullsized":"2024-09-12T02:02:12.337500+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:03.083808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412357+0000","last_change":"2024-09-12T02:02:11.334790+0000","last_active":"2024-09-12T02:02:13.412357+0000","last_peered":"2024-09-12T02:02:13.412357+0000","last_clean":"2024-09-12T02:02:13.412357+0000","last_became_active":"2024-09-12T02:02:11.334505+0000","last_became_peered":"2024-09-12T02:02:11.334505+0000","last_unstale":"2024-09-12T02:02:13.412357+0000","last_undegraded":"2024-09-12T02:02:13.412357+0000","last_fullsized":"2024-09-12T02:02:13.412357+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:24.342640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323644+0000","last_change":"2024-09-12T02:02:11.323644+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323644+0000","last_undegraded":"2024-09-12T02:02:11.323644+0000","last_fullsized":"2024-09-12T02:02:11.323644+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340682+0000","last_change":"2024-09-12T02:02:11.333595+0000","last_active":"2024-09-12T02:02:13.340682+0000","last_peered":"2024-09-12T02:02:13.340682+0000","last_clean":"2024-09-12T02:02:13.340682+0000","last_became_active":"2024-09-12T02:02:11.333243+0000","last_became_peered":"2024-09-12T02:02:11.333243+0000","last_unstale":"2024-09-12T02:02:13.340682+0000","last_undegraded":"2024-09-12T02:02:13.340682+0000","last_fullsized":"2024-09-12T02:02:13.340682+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:12.239695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412571+0000","last_change":"2024-09-12T02:02:12.350425+0000","last_active":"2024-09-12T02:02:13.412571+0000","last_peered":"2024-09-12T02:02:13.412571+0000","last_clean":"2024-09-12T02:02:13.412571+0000","last_became_active":"2024-09-12T02:02:12.350139+0000","last_became_peered":"2024-09-12T02:02:12.350139+0000","last_unstale":"2024-09-12T02:02:13.412571+0000","last_undegraded":"2024-09-12T02:02:13.412571+0000","last_fullsized":"2024-09-12T02:02:13.412571+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:52.606535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.318431+0000","last_change":"2024-09-12T02:02:11.333135+0000","last_active":"2024-09-12T02:02:12.318431+0000","last_peered":"2024-09-12T02:02:12.318431+0000","last_clean":"2024-09-12T02:02:12.318431+0000","last_became_active":"2024-09-12T02:02:11.332827+0000","last_became_peered":"2024-09-12T02:02:11.332827+0000","last_unstale":"2024-09-12T02:02:12.318431+0000","last_undegraded":"2024-09-12T02:02:12.318431+0000","last_fullsized":"2024-09-12T02:02:12.318431+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:47.007799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.340461+0000","last_change":"2024-09-12T02:02:12.334298+0000","last_active":"2024-09-12T02:02:12.340461+0000","last_peered":"2024-09-12T02:02:12.340461+0000","last_clean":"2024-09-12T02:02:12.340461+0000","last_became_active":"2024-09-12T02:02:12.334014+0000","last_became_peered":"2024-09-12T02:02:12.334014+0000","last_unstale":"2024-09-12T02:02:12.340461+0000","last_undegraded":"2024-09-12T02:02:12.340461+0000","last_fullsized":"2024-09-12T02:02:12.340461+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:17.156403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.337891+0000","last_change":"2024-09-12T02:02:11.335601+0000","last_active":"2024-09-12T02:02:11.337891+0000","last_peered":"2024-09-12T02:02:11.337891+0000","last_clean":"2024-09-12T02:02:11.337891+0000","last_became_active":"2024-09-12T02:02:11.335331+0000","last_became_peered":"2024-09-12T02:02:11.335331+0000","last_unstale":"2024-09-12T02:02:11.337891+0000","last_undegraded":"2024-09-12T02:02:11.337891+0000","last_fullsized":"2024-09-12T02:02:11.337891+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:08.075197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.340936+0000","last_change":"2024-09-12T02:02:12.339385+0000","last_active":"2024-09-12T02:02:12.340936+0000","last_peered":"2024-09-12T02:02:12.340936+0000","last_clean":"2024-09-12T02:02:12.340936+0000","last_became_active":"2024-09-12T02:02:12.339076+0000","last_became_peered":"2024-09-12T02:02:12.339076+0000","last_unstale":"2024-09-12T02:02:12.340936+0000","last_undegraded":"2024-09-12T02:02:12.340936+0000","last_fullsized":"2024-09-12T02:02:12.340936+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.305827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"92'6","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.356286+0000","last_change":"2024-09-12T02:02:11.332578+0000","last_active":"2024-09-12T02:02:12.356286+0000","last_peered":"2024-09-12T02:02:12.356286+0000","last_clean":"2024-09-12T02:02:12.356286+0000","last_became_active":"2024-09-12T02:02:11.332190+0000","last_became_peered":"2024-09-12T02:02:11.332190+0000","last_unstale":"2024-09-12T02:02:12.356286+0000","last_undegraded":"2024-09-12T02:02:12.356286+0000","last_fullsized":"2024-09-12T02:02:12.356286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:48.070182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336884+0000","last_change":"2024-09-12T02:02:12.332687+0000","last_active":"2024-09-12T02:02:12.336884+0000","last_peered":"2024-09-12T02:02:12.336884+0000","last_clean":"2024-09-12T02:02:12.336884+0000","last_became_active":"2024-09-12T02:02:12.332386+0000","last_became_peered":"2024-09-12T02:02:12.332386+0000","last_unstale":"2024-09-12T02:02:12.336884+0000","last_undegraded":"2024-09-12T02:02:12.336884+0000","last_fullsized":"2024-09-12T02:02:12.336884+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:26.580075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412589+0000","last_change":"2024-09-12T02:02:11.335419+0000","last_active":"2024-09-12T02:02:13.412589+0000","last_peered":"2024-09-12T02:02:13.412589+0000","last_clean":"2024-09-12T02:02:13.412589+0000","last_became_active":"2024-09-12T02:02:11.335199+0000","last_became_peered":"2024-09-12T02:02:11.335199+0000","last_unstale":"2024-09-12T02:02:13.412589+0000","last_undegraded":"2024-09-12T02:02:13.412589+0000","last_fullsized":"2024-09-12T02:02:13.412589+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:19.589222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.321258+0000","last_change":"2024-09-12T02:02:11.321258+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.321258+0000","last_undegraded":"2024-09-12T02:02:11.321258+0000","last_fullsized":"2024-09-12T02:02:11.321258+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.322792+0000","last_change":"2024-09-12T02:02:11.334793+0000","last_active":"2024-09-12T02:02:12.322792+0000","last_peered":"2024-09-12T02:02:12.322792+0000","last_clean":"2024-09-12T02:02:12.322792+0000","last_became_active":"2024-09-12T02:02:11.334335+0000","last_became_peered":"2024-09-12T02:02:11.334335+0000","last_unstale":"2024-09-12T02:02:12.322792+0000","last_undegraded":"2024-09-12T02:02:12.322792+0000","last_fullsized":"2024-09-12T02:02:12.322792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:34.830322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335855+0000","last_change":"2024-09-12T02:02:12.329549+0000","last_active":"2024-09-12T02:02:12.335855+0000","last_peered":"2024-09-12T02:02:12.335855+0000","last_clean":"2024-09-12T02:02:12.335855+0000","last_became_active":"2024-09-12T02:02:12.329279+0000","last_became_peered":"2024-09-12T02:02:12.329279+0000","last_unstale":"2024-09-12T02:02:12.335855+0000","last_undegraded":"2024-09-12T02:02:12.335855+0000","last_fullsized":"2024-09-12T02:02:12.335855+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:27.109469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.323203+0000","last_change":"2024-09-12T02:02:11.338109+0000","last_active":"2024-09-12T02:02:12.323203+0000","last_peered":"2024-09-12T02:02:12.323203+0000","last_clean":"2024-09-12T02:02:12.323203+0000","last_became_active":"2024-09-12T02:02:11.337827+0000","last_became_peered":"2024-09-12T02:02:11.337827+0000","last_unstale":"2024-09-12T02:02:12.323203+0000","last_undegraded":"2024-09-12T02:02:12.323203+0000","last_fullsized":"2024-09-12T02:02:12.323203+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:25.822689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.346766+0000","last_change":"2024-09-12T02:02:12.345192+0000","last_active":"2024-09-12T02:02:12.346766+0000","last_peered":"2024-09-12T02:02:12.346766+0000","last_clean":"2024-09-12T02:02:12.346766+0000","last_became_active":"2024-09-12T02:02:12.344763+0000","last_became_peered":"2024-09-12T02:02:12.344763+0000","last_unstale":"2024-09-12T02:02:12.346766+0000","last_undegraded":"2024-09-12T02:02:12.346766+0000","last_fullsized":"2024-09-12T02:02:12.346766+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:29.370257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"92'8","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.356907+0000","last_change":"2024-09-12T02:02:11.336360+0000","last_active":"2024-09-12T02:02:12.356907+0000","last_peered":"2024-09-12T02:02:12.356907+0000","last_clean":"2024-09-12T02:02:12.356907+0000","last_became_active":"2024-09-12T02:02:11.336065+0000","last_became_peered":"2024-09-12T02:02:11.336065+0000","last_unstale":"2024-09-12T02:02:12.356907+0000","last_undegraded":"2024-09-12T02:02:12.356907+0000","last_fullsized":"2024-09-12T02:02:12.356907+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:11.233739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.351195+0000","last_change":"2024-09-12T02:02:12.350095+0000","last_active":"2024-09-12T02:02:12.351195+0000","last_peered":"2024-09-12T02:02:12.351195+0000","last_clean":"2024-09-12T02:02:12.351195+0000","last_became_active":"2024-09-12T02:02:12.349756+0000","last_became_peered":"2024-09-12T02:02:12.349756+0000","last_unstale":"2024-09-12T02:02:12.351195+0000","last_undegraded":"2024-09-12T02:02:12.351195+0000","last_fullsized":"2024-09-12T02:02:12.351195+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:05.645626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.324132+0000","last_change":"2024-09-12T02:02:11.327980+0000","last_active":"2024-09-12T02:02:13.324132+0000","last_peered":"2024-09-12T02:02:13.324132+0000","last_clean":"2024-09-12T02:02:13.324132+0000","last_became_active":"2024-09-12T02:02:11.327687+0000","last_became_peered":"2024-09-12T02:02:11.327687+0000","last_unstale":"2024-09-12T02:02:13.324132+0000","last_undegraded":"2024-09-12T02:02:13.324132+0000","last_fullsized":"2024-09-12T02:02:13.324132+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:15.056421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323117+0000","last_change":"2024-09-12T02:02:12.333663+0000","last_active":"2024-09-12T02:02:13.323117+0000","last_peered":"2024-09-12T02:02:13.323117+0000","last_clean":"2024-09-12T02:02:13.323117+0000","last_became_active":"2024-09-12T02:02:12.333334+0000","last_became_peered":"2024-09-12T02:02:12.333334+0000","last_unstale":"2024-09-12T02:02:13.323117+0000","last_undegraded":"2024-09-12T02:02:13.323117+0000","last_fullsized":"2024-09-12T02:02:13.323117+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:08.450410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412473+0000","last_change":"2024-09-12T02:02:11.331682+0000","last_active":"2024-09-12T02:02:13.412473+0000","last_peered":"2024-09-12T02:02:13.412473+0000","last_clean":"2024-09-12T02:02:13.412473+0000","last_became_active":"2024-09-12T02:02:11.331384+0000","last_became_peered":"2024-09-12T02:02:11.331384+0000","last_unstale":"2024-09-12T02:02:13.412473+0000","last_undegraded":"2024-09-12T02:02:13.412473+0000","last_fullsized":"2024-09-12T02:02:13.412473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:30.836043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323444+0000","last_change":"2024-09-12T02:02:11.323444+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323444+0000","last_undegraded":"2024-09-12T02:02:11.323444+0000","last_fullsized":"2024-09-12T02:02:11.323444+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.334831+0000","last_change":"2024-09-12T02:02:11.333247+0000","last_active":"2024-09-12T02:02:11.334831+0000","last_peered":"2024-09-12T02:02:11.334831+0000","last_clean":"2024-09-12T02:02:11.334831+0000","last_became_active":"2024-09-12T02:02:11.332967+0000","last_became_peered":"2024-09-12T02:02:11.332967+0000","last_unstale":"2024-09-12T02:02:11.334831+0000","last_undegraded":"2024-09-12T02:02:11.334831+0000","last_fullsized":"2024-09-12T02:02:11.334831+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:36.986789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.342109+0000","last_change":"2024-09-12T02:02:12.338322+0000","last_active":"2024-09-12T02:02:12.342109+0000","last_peered":"2024-09-12T02:02:12.342109+0000","last_clean":"2024-09-12T02:02:12.342109+0000","last_became_active":"2024-09-12T02:02:12.338015+0000","last_became_peered":"2024-09-12T02:02:12.338015+0000","last_unstale":"2024-09-12T02:02:12.342109+0000","last_undegraded":"2024-09-12T02:02:12.342109+0000","last_fullsized":"2024-09-12T02:02:12.342109+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:47.736613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340361+0000","last_change":"2024-09-12T02:02:11.332292+0000","last_active":"2024-09-12T02:02:13.340361+0000","last_peered":"2024-09-12T02:02:13.340361+0000","last_clean":"2024-09-12T02:02:13.340361+0000","last_became_active":"2024-09-12T02:02:11.332012+0000","last_became_peered":"2024-09-12T02:02:11.332012+0000","last_unstale":"2024-09-12T02:02:13.340361+0000","last_undegraded":"2024-09-12T02:02:13.340361+0000","last_fullsized":"2024-09-12T02:02:13.340361+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:31.076337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340404+0000","last_change":"2024-09-12T02:02:12.349435+0000","last_active":"2024-09-12T02:02:13.340404+0000","last_peered":"2024-09-12T02:02:13.340404+0000","last_clean":"2024-09-12T02:02:13.340404+0000","last_became_active":"2024-09-12T02:02:12.347614+0000","last_became_peered":"2024-09-12T02:02:12.347614+0000","last_unstale":"2024-09-12T02:02:13.340404+0000","last_undegraded":"2024-09-12T02:02:13.340404+0000","last_fullsized":"2024-09-12T02:02:13.340404+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:29.496591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.321807+0000","last_change":"2024-09-12T02:02:11.330103+0000","last_active":"2024-09-12T02:02:12.321807+0000","last_peered":"2024-09-12T02:02:12.321807+0000","last_clean":"2024-09-12T02:02:12.321807+0000","last_became_active":"2024-09-12T02:02:11.329822+0000","last_became_peered":"2024-09-12T02:02:11.329822+0000","last_unstale":"2024-09-12T02:02:12.321807+0000","last_undegraded":"2024-09-12T02:02:12.321807+0000","last_fullsized":"2024-09-12T02:02:12.321807+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:00.660882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340435+0000","last_change":"2024-09-12T02:02:12.343786+0000","last_active":"2024-09-12T02:02:13.340435+0000","last_peered":"2024-09-12T02:02:13.340435+0000","last_clean":"2024-09-12T02:02:13.340435+0000","last_became_active":"2024-09-12T02:02:12.343506+0000","last_became_peered":"2024-09-12T02:02:12.343506+0000","last_unstale":"2024-09-12T02:02:13.340435+0000","last_undegraded":"2024-09-12T02:02:13.340435+0000","last_fullsized":"2024-09-12T02:02:13.340435+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:58.287049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340526+0000","last_change":"2024-09-12T02:02:11.337862+0000","last_active":"2024-09-12T02:02:13.340526+0000","last_peered":"2024-09-12T02:02:13.340526+0000","last_clean":"2024-09-12T02:02:13.340526+0000","last_became_active":"2024-09-12T02:02:11.337384+0000","last_became_peered":"2024-09-12T02:02:11.337384+0000","last_unstale":"2024-09-12T02:02:13.340526+0000","last_undegraded":"2024-09-12T02:02:13.340526+0000","last_fullsized":"2024-09-12T02:02:13.340526+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:03.587791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336675+0000","last_change":"2024-09-12T02:02:12.332334+0000","last_active":"2024-09-12T02:02:12.336675+0000","last_peered":"2024-09-12T02:02:12.336675+0000","last_clean":"2024-09-12T02:02:12.336675+0000","last_became_active":"2024-09-12T02:02:12.331814+0000","last_became_peered":"2024-09-12T02:02:12.331814+0000","last_unstale":"2024-09-12T02:02:12.336675+0000","last_undegraded":"2024-09-12T02:02:12.336675+0000","last_fullsized":"2024-09-12T02:02:12.336675+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:53.448271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.322071+0000","last_change":"2024-09-12T02:02:11.329706+0000","last_active":"2024-09-12T02:02:12.322071+0000","last_peered":"2024-09-12T02:02:12.322071+0000","last_clean":"2024-09-12T02:02:12.322071+0000","last_became_active":"2024-09-12T02:02:11.329422+0000","last_became_peered":"2024-09-12T02:02:11.329422+0000","last_unstale":"2024-09-12T02:02:12.322071+0000","last_undegraded":"2024-09-12T02:02:12.322071+0000","last_fullsized":"2024-09-12T02:02:12.322071+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:17.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323458+0000","last_change":"2024-09-12T02:02:12.334098+0000","last_active":"2024-09-12T02:02:13.323458+0000","last_peered":"2024-09-12T02:02:13.323458+0000","last_clean":"2024-09-12T02:02:13.323458+0000","last_became_active":"2024-09-12T02:02:12.332786+0000","last_became_peered":"2024-09-12T02:02:12.332786+0000","last_unstale":"2024-09-12T02:02:13.323458+0000","last_undegraded":"2024-09-12T02:02:13.323458+0000","last_fullsized":"2024-09-12T02:02:13.323458+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:15.955019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412678+0000","last_change":"2024-09-12T02:02:11.334960+0000","last_active":"2024-09-12T02:02:13.412678+0000","last_peered":"2024-09-12T02:02:13.412678+0000","last_clean":"2024-09-12T02:02:13.412678+0000","last_became_active":"2024-09-12T02:02:11.334693+0000","last_became_peered":"2024-09-12T02:02:11.334693+0000","last_unstale":"2024-09-12T02:02:13.412678+0000","last_undegraded":"2024-09-12T02:02:13.412678+0000","last_fullsized":"2024-09-12T02:02:13.412678+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:28.491104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.345995+0000","last_change":"2024-09-12T02:02:12.342917+0000","last_active":"2024-09-12T02:02:12.345995+0000","last_peered":"2024-09-12T02:02:12.345995+0000","last_clean":"2024-09-12T02:02:12.345995+0000","last_became_active":"2024-09-12T02:02:12.342611+0000","last_became_peered":"2024-09-12T02:02:12.342611+0000","last_unstale":"2024-09-12T02:02:12.345995+0000","last_undegraded":"2024-09-12T02:02:12.345995+0000","last_fullsized":"2024-09-12T02:02:12.345995+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:13.465096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.334509+0000","last_change":"2024-09-12T02:02:11.331807+0000","last_active":"2024-09-12T02:02:11.334509+0000","last_peered":"2024-09-12T02:02:11.334509+0000","last_clean":"2024-09-12T02:02:11.334509+0000","last_became_active":"2024-09-12T02:02:11.331545+0000","last_became_peered":"2024-09-12T02:02:11.331545+0000","last_unstale":"2024-09-12T02:02:11.334509+0000","last_undegraded":"2024-09-12T02:02:11.334509+0000","last_fullsized":"2024-09-12T02:02:11.334509+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:07.526436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336659+0000","last_change":"2024-09-12T02:02:12.331122+0000","last_active":"2024-09-12T02:02:12.336659+0000","last_peered":"2024-09-12T02:02:12.336659+0000","last_clean":"2024-09-12T02:02:12.336659+0000","last_became_active":"2024-09-12T02:02:12.330378+0000","last_became_peered":"2024-09-12T02:02:12.330378+0000","last_unstale":"2024-09-12T02:02:12.336659+0000","last_undegraded":"2024-09-12T02:02:12.336659+0000","last_fullsized":"2024-09-12T02:02:12.336659+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:51.393021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.337903+0000","last_change":"2024-09-12T02:02:11.335862+0000","last_active":"2024-09-12T02:02:11.337903+0000","last_peered":"2024-09-12T02:02:11.337903+0000","last_clean":"2024-09-12T02:02:11.337903+0000","last_became_active":"2024-09-12T02:02:11.335603+0000","last_became_peered":"2024-09-12T02:02:11.335603+0000","last_unstale":"2024-09-12T02:02:11.337903+0000","last_undegraded":"2024-09-12T02:02:11.337903+0000","last_fullsized":"2024-09-12T02:02:11.337903+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:01.073635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340679+0000","last_change":"2024-09-12T02:02:12.349940+0000","last_active":"2024-09-12T02:02:13.340679+0000","last_peered":"2024-09-12T02:02:13.340679+0000","last_clean":"2024-09-12T02:02:13.340679+0000","last_became_active":"2024-09-12T02:02:12.349675+0000","last_became_peered":"2024-09-12T02:02:12.349675+0000","last_unstale":"2024-09-12T02:02:13.340679+0000","last_undegraded":"2024-09-12T02:02:13.340679+0000","last_fullsized":"2024-09-12T02:02:13.340679+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:19.218621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323638+0000","last_change":"2024-09-12T02:02:11.331813+0000","last_active":"2024-09-12T02:02:13.323638+0000","last_peered":"2024-09-12T02:02:13.323638+0000","last_clean":"2024-09-12T02:02:13.323638+0000","last_became_active":"2024-09-12T02:02:11.331505+0000","last_became_peered":"2024-09-12T02:02:11.331505+0000","last_unstale":"2024-09-12T02:02:13.323638+0000","last_undegraded":"2024-09-12T02:02:13.323638+0000","last_fullsized":"2024-09-12T02:02:13.323638+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:31.234575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336540+0000","last_change":"2024-09-12T02:02:12.333131+0000","last_active":"2024-09-12T02:02:12.336540+0000","last_peered":"2024-09-12T02:02:12.336540+0000","last_clean":"2024-09-12T02:02:12.336540+0000","last_became_active":"2024-09-12T02:02:12.332829+0000","last_became_peered":"2024-09-12T02:02:12.332829+0000","last_unstale":"2024-09-12T02:02:12.336540+0000","last_undegraded":"2024-09-12T02:02:12.336540+0000","last_fullsized":"2024-09-12T02:02:12.336540+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:20.234006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.326472+0000","last_change":"2024-09-12T02:02:11.338517+0000","last_active":"2024-09-12T02:02:12.326472+0000","last_peered":"2024-09-12T02:02:12.326472+0000","last_clean":"2024-09-12T02:02:12.326472+0000","last_became_active":"2024-09-12T02:02:11.338195+0000","last_became_peered":"2024-09-12T02:02:11.338195+0000","last_unstale":"2024-09-12T02:02:12.326472+0000","last_undegraded":"2024-09-12T02:02:12.326472+0000","last_fullsized":"2024-09-12T02:02:12.326472+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:23.513062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335125+0000","last_change":"2024-09-12T02:02:12.327683+0000","last_active":"2024-09-12T02:02:12.335125+0000","last_peered":"2024-09-12T02:02:12.335125+0000","last_clean":"2024-09-12T02:02:12.335125+0000","last_became_active":"2024-09-12T02:02:12.327416+0000","last_became_peered":"2024-09-12T02:02:12.327416+0000","last_unstale":"2024-09-12T02:02:12.335125+0000","last_undegraded":"2024-09-12T02:02:12.335125+0000","last_fullsized":"2024-09-12T02:02:12.335125+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:57.332382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340551+0000","last_change":"2024-09-12T02:02:11.328426+0000","last_active":"2024-09-12T02:02:13.340551+0000","last_peered":"2024-09-12T02:02:13.340551+0000","last_clean":"2024-09-12T02:02:13.340551+0000","last_became_active":"2024-09-12T02:02:11.328217+0000","last_became_peered":"2024-09-12T02:02:11.328217+0000","last_unstale":"2024-09-12T02:02:13.340551+0000","last_undegraded":"2024-09-12T02:02:13.340551+0000","last_fullsized":"2024-09-12T02:02:13.340551+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:36.031506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323434+0000","last_change":"2024-09-12T02:02:12.340317+0000","last_active":"2024-09-12T02:02:13.323434+0000","last_peered":"2024-09-12T02:02:13.323434+0000","last_clean":"2024-09-12T02:02:13.323434+0000","last_became_active":"2024-09-12T02:02:12.340058+0000","last_became_peered":"2024-09-12T02:02:12.340058+0000","last_unstale":"2024-09-12T02:02:13.323434+0000","last_undegraded":"2024-09-12T02:02:13.323434+0000","last_fullsized":"2024-09-12T02:02:13.323434+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:07.388059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323058+0000","last_change":"2024-09-12T02:02:11.327599+0000","last_active":"2024-09-12T02:02:13.323058+0000","last_peered":"2024-09-12T02:02:13.323058+0000","last_clean":"2024-09-12T02:02:13.323058+0000","last_became_active":"2024-09-12T02:02:11.327287+0000","last_became_peered":"2024-09-12T02:02:11.327287+0000","last_unstale":"2024-09-12T02:02:13.323058+0000","last_undegraded":"2024-09-12T02:02:13.323058+0000","last_fullsized":"2024-09-12T02:02:13.323058+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:30.857360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336647+0000","last_change":"2024-09-12T02:02:12.332093+0000","last_active":"2024-09-12T02:02:12.336647+0000","last_peered":"2024-09-12T02:02:12.336647+0000","last_clean":"2024-09-12T02:02:12.336647+0000","last_became_active":"2024-09-12T02:02:12.331500+0000","last_became_peered":"2024-09-12T02:02:12.331500+0000","last_unstale":"2024-09-12T02:02:12.336647+0000","last_undegraded":"2024-09-12T02:02:12.336647+0000","last_fullsized":"2024-09-12T02:02:12.336647+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:48.686084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412398+0000","last_change":"2024-09-12T02:02:11.329064+0000","last_active":"2024-09-12T02:02:13.412398+0000","last_peered":"2024-09-12T02:02:13.412398+0000","last_clean":"2024-09-12T02:02:13.412398+0000","last_became_active":"2024-09-12T02:02:11.328800+0000","last_became_peered":"2024-09-12T02:02:11.328800+0000","last_unstale":"2024-09-12T02:02:13.412398+0000","last_undegraded":"2024-09-12T02:02:13.412398+0000","last_fullsized":"2024-09-12T02:02:13.412398+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:12.833485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412626+0000","last_change":"2024-09-12T02:02:12.341167+0000","last_active":"2024-09-12T02:02:13.412626+0000","last_peered":"2024-09-12T02:02:13.412626+0000","last_clean":"2024-09-12T02:02:13.412626+0000","last_became_active":"2024-09-12T02:02:12.340921+0000","last_became_peered":"2024-09-12T02:02:12.340921+0000","last_unstale":"2024-09-12T02:02:13.412626+0000","last_undegraded":"2024-09-12T02:02:13.412626+0000","last_fullsized":"2024-09-12T02:02:13.412626+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.801762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.324675+0000","last_change":"2024-09-12T02:02:11.329351+0000","last_active":"2024-09-12T02:02:12.324675+0000","last_peered":"2024-09-12T02:02:12.324675+0000","last_clean":"2024-09-12T02:02:12.324675+0000","last_became_active":"2024-09-12T02:02:11.329049+0000","last_became_peered":"2024-09-12T02:02:11.329049+0000","last_unstale":"2024-09-12T02:02:12.324675+0000","last_undegraded":"2024-09-12T02:02:12.324675+0000","last_fullsized":"2024-09-12T02:02:12.324675+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:09.295690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":304,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412422+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T02:02:13.412422+0000","last_peered":"2024-09-12T02:02:13.412422+0000","last_clean":"2024-09-12T02:02:13.412422+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T02:02:13.412422+0000","last_undegraded":"2024-09-12T02:02:13.412422+0000","last_fullsized":"2024-09-12T02:02:13.412422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509522,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32888,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338952,"statfs":{"total":96636764160,"available":96603086848,"internally_reserved":0,"allocated":1740800,"data_stored":1119434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509521,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1159168,"data_stored":531226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509522,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1138688,"data_stored":529010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542226,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1126400,"data_stored":522318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542226,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1126400,"data_stored":522318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542226,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1130496,"data_stored":522388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542226,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32900,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338940,"statfs":{"total":96636764160,"available":96603074560,"internally_reserved":0,"allocated":1744896,"data_stored":1115004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1114112,"data_stored":515151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:02:15.680 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:02:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.819+0000 7f7a58cf1640 1 Processor -- start 2024-09-12T02:02:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.819+0000 7f7a58cf1640 1 -- start start 2024-09-12T02:02:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.820+0000 7f7a58cf1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a540b0180 0x7f7a54162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.820+0000 7f7a58cf1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7a540af280 0x7f7a54154d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.820+0000 7f7a58cf1640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a5415eb60 con 0x7f7a540b69d0 2024-09-12T02:02:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.820+0000 7f7a58cf1640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f7a540b6db0 con 0x7f7a540af280 2024-09-12T02:02:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.820+0000 7f7a58cf1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7a5415ee40 con 0x7f7a540b0180 2024-09-12T02:02:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.820+0000 7f7a5259c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7a540b69d0 0x7f7a540afa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39100/0 (socket says 172.21.15.19:39100) 2024-09-12T02:02:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.820+0000 7f7a5259c640 1 -- 172.21.15.19:0/658513080 learned_addr learned my addr 172.21.15.19:0/658513080 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.820+0000 7f7a52d9d640 1 --2- 172.21.15.19:0/658513080 >> v2:172.21.15.19:3300/0 conn(0x7f7a540af280 0x7f7a54154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.820+0000 7f7a5159a640 1 -- 172.21.15.19:0/658513080 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2572357622 0 0) 0x7f7a5415eb60 con 0x7f7a540b69d0 2024-09-12T02:02:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.820+0000 7f7a5159a640 1 -- 172.21.15.19:0/658513080 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a3c003520 con 0x7f7a540b69d0 2024-09-12T02:02:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.820+0000 7f7a51d9b640 1 --2- 172.21.15.19:0/658513080 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a540b0180 0x7f7a54162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.820+0000 7f7a52d9d640 1 -- 172.21.15.19:0/658513080 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a540b0180 msgr2=0x7f7a54162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.820+0000 7f7a52d9d640 1 --2- 172.21.15.19:0/658513080 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a540b0180 0x7f7a54162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.820+0000 7f7a52d9d640 1 -- 172.21.15.19:0/658513080 >> v1:172.21.15.19:6789/0 conn(0x7f7a540b69d0 legacy=0x7f7a540afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.820+0000 7f7a52d9d640 1 -- 172.21.15.19:0/658513080 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5415f120 con 0x7f7a540af280 2024-09-12T02:02:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.821+0000 7f7a52d9d640 1 --2- 172.21.15.19:0/658513080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a540af280 0x7f7a54154d00 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009d90 tx=0x7f7a4c02a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aefe9b6adf3a830 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.821+0000 7f7a5159a640 1 -- 172.21.15.19:0/658513080 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c007740 con 0x7f7a540af280 2024-09-12T02:02:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.821+0000 7f7a5159a640 1 -- 172.21.15.19:0/658513080 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4c0078e0 con 0x7f7a540af280 2024-09-12T02:02:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.821+0000 7f7a5159a640 1 -- 172.21.15.19:0/658513080 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c007cb0 con 0x7f7a540af280 2024-09-12T02:02:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.822+0000 7f7a58cf1640 1 -- 172.21.15.19:0/658513080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a540af280 msgr2=0x7f7a54154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.822+0000 7f7a58cf1640 1 --2- 172.21.15.19:0/658513080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a540af280 0x7f7a54154d00 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009d90 tx=0x7f7a4c02a530 comp rx=0 tx=0).stop 2024-09-12T02:02:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.822+0000 7f7a58cf1640 1 -- 172.21.15.19:0/658513080 shutdown_connections 2024-09-12T02:02:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.822+0000 7f7a58cf1640 1 --2- 172.21.15.19:0/658513080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a540af280 0x7f7a54154d00 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.822+0000 7f7a58cf1640 1 --2- 172.21.15.19:0/658513080 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a540b0180 0x7f7a54162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.822+0000 7f7a58cf1640 1 -- 172.21.15.19:0/658513080 >> 172.21.15.19:0/658513080 conn(0x7f7a5406bc10 msgr2=0x7f7a5406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.822+0000 7f7a58cf1640 1 -- 172.21.15.19:0/658513080 shutdown_connections 2024-09-12T02:02:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.822+0000 7f7a58cf1640 1 -- 172.21.15.19:0/658513080 wait complete. 2024-09-12T02:02:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.823+0000 7f7a58cf1640 1 Processor -- start 2024-09-12T02:02:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.823+0000 7f7a58cf1640 1 -- start start 2024-09-12T02:02:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.824+0000 7f7a58cf1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a540af280 0x7f7a540d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.824+0000 7f7a58cf1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a540b0180 0x7f7a5414ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.824+0000 7f7a58cf1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a540b69d0 0x7f7a540cd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.824+0000 7f7a58cf1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7a54155240 con 0x7f7a540af280 2024-09-12T02:02:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.824+0000 7f7a58cf1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7a540af6f0 con 0x7f7a540b69d0 2024-09-12T02:02:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.824+0000 7f7a58cf1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7a541553c0 con 0x7f7a540b0180 2024-09-12T02:02:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.824+0000 7f7a5259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a540af280 0x7f7a540d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.824+0000 7f7a5259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a540af280 0x7f7a540d00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35168/0 (socket says 172.21.15.19:35168) 2024-09-12T02:02:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.824+0000 7f7a5259c640 1 -- 172.21.15.19:0/868805708 learned_addr learned my addr 172.21.15.19:0/868805708 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.824+0000 7f7a51d9b640 1 --2- 172.21.15.19:0/868805708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a540b0180 0x7f7a5414ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.824+0000 7f7a5259c640 1 -- 172.21.15.19:0/868805708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a540b0180 msgr2=0x7f7a5414ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.824+0000 7f7a5259c640 1 --2- 172.21.15.19:0/868805708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a540b0180 0x7f7a5414ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.824+0000 7f7a52d9d640 1 --2- 172.21.15.19:0/868805708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a540b69d0 0x7f7a540cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.824+0000 7f7a5259c640 1 -- 172.21.15.19:0/868805708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a540b69d0 msgr2=0x7f7a540cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.825+0000 7f7a5259c640 1 --2- 172.21.15.19:0/868805708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a540b69d0 0x7f7a540cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.825+0000 7f7a5259c640 1 -- 172.21.15.19:0/868805708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a54151710 con 0x7f7a540af280 2024-09-12T02:02:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.825+0000 7f7a5259c640 1 --2- 172.21.15.19:0/868805708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a540af280 0x7f7a540d00c0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400c390 tx=0x7f7a4400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.825+0000 7f7a42ffd640 1 -- 172.21.15.19:0/868805708 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a44017070 con 0x7f7a540af280 2024-09-12T02:02:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.825+0000 7f7a42ffd640 1 -- 172.21.15.19:0/868805708 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a44005ce0 con 0x7f7a540af280 2024-09-12T02:02:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.825+0000 7f7a58cf1640 1 -- 172.21.15.19:0/868805708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a541519f0 con 0x7f7a540af280 2024-09-12T02:02:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.825+0000 7f7a42ffd640 1 -- 172.21.15.19:0/868805708 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a440072f0 con 0x7f7a540af280 2024-09-12T02:02:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.825+0000 7f7a58cf1640 1 -- 172.21.15.19:0/868805708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a54151fb0 con 0x7f7a540af280 2024-09-12T02:02:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.826+0000 7f7a58cf1640 1 -- 172.21.15.19:0/868805708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a54155780 con 0x7f7a540af280 2024-09-12T02:02:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.826+0000 7f7a42ffd640 1 -- 172.21.15.19:0/868805708 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a4401a070 con 0x7f7a540af280 2024-09-12T02:02:15.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.827+0000 7f7a42ffd640 1 --2- 172.21.15.19:0/868805708 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7a3406be30 0x7f7a3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:15.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.827+0000 7f7a42ffd640 1 -- 172.21.15.19:0/868805708 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6101+0+0 (secure 0 0 0) 0x7f7a4408a430 con 0x7f7a540af280 2024-09-12T02:02:15.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.827+0000 7f7a51d9b640 1 --2- 172.21.15.19:0/868805708 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7a3406be30 0x7f7a3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:15.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.828+0000 7f7a51d9b640 1 --2- 172.21.15.19:0/868805708 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7a3406be30 0x7f7a3406e2f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7a541619c0 tx=0x7f7a48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:15.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:15.831+0000 7f7a42ffd640 1 -- 172.21.15.19:0/868805708 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7a44058c50 con 0x7f7a540af280 2024-09-12T02:02:16.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.001+0000 7f7a58cf1640 1 -- 172.21.15.19:0/868805708 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a5414cf80 con 0x7f7a3406be30 2024-09-12T02:02:16.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.007+0000 7f7a42ffd640 1 -- 172.21.15.19:0/868805708 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251047 (secure 0 0 0) 0x7f7a48009d60 con 0x7f7a3406be30 2024-09-12T02:02:16.010 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:16.011 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T02:02:16.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.011+0000 7f7a58cf1640 1 -- 172.21.15.19:0/868805708 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7a3406be30 msgr2=0x7f7a3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:16.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.011+0000 7f7a58cf1640 1 --2- 172.21.15.19:0/868805708 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7a3406be30 0x7f7a3406e2f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7a541619c0 tx=0x7f7a48008040 comp rx=0 tx=0).stop 2024-09-12T02:02:16.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.011+0000 7f7a58cf1640 1 -- 172.21.15.19:0/868805708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a540af280 msgr2=0x7f7a540d00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:16.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.011+0000 7f7a58cf1640 1 --2- 172.21.15.19:0/868805708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a540af280 0x7f7a540d00c0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400c390 tx=0x7f7a4400c850 comp rx=0 tx=0).stop 2024-09-12T02:02:16.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.011+0000 7f7a58cf1640 1 -- 172.21.15.19:0/868805708 shutdown_connections 2024-09-12T02:02:16.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.011+0000 7f7a58cf1640 1 --2- 172.21.15.19:0/868805708 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7a3406be30 0x7f7a3406e2f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.011+0000 7f7a58cf1640 1 --2- 172.21.15.19:0/868805708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a540b69d0 0x7f7a540cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.011+0000 7f7a58cf1640 1 --2- 172.21.15.19:0/868805708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a540b0180 0x7f7a5414ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.011+0000 7f7a58cf1640 1 --2- 172.21.15.19:0/868805708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a540af280 0x7f7a540d00c0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.011+0000 7f7a58cf1640 1 -- 172.21.15.19:0/868805708 >> 172.21.15.19:0/868805708 conn(0x7f7a5406bc10 msgr2=0x7f7a5406f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:16.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.011+0000 7f7a58cf1640 1 -- 172.21.15.19:0/868805708 shutdown_connections 2024-09-12T02:02:16.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.011+0000 7f7a58cf1640 1 -- 172.21.15.19:0/868805708 wait complete. 2024-09-12T02:02:16.022 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2024-09-12T02:02:14.177257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592618,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":198,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251244,"kb_used_data":10040,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754723476,"statfs":{"total":773094113280,"available":772836839424,"internally_reserved":0,"allocated":10280960,"data_stored":5376849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000943"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.339480+0000","last_change":"2024-09-12T02:02:12.332361+0000","last_active":"2024-09-12T02:02:12.339480+0000","last_peered":"2024-09-12T02:02:12.339480+0000","last_clean":"2024-09-12T02:02:12.339480+0000","last_became_active":"2024-09-12T02:02:12.332101+0000","last_became_peered":"2024-09-12T02:02:12.332101+0000","last_unstale":"2024-09-12T02:02:12.339480+0000","last_undegraded":"2024-09-12T02:02:12.339480+0000","last_fullsized":"2024-09-12T02:02:12.339480+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:32.854191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340632+0000","last_change":"2024-09-12T02:02:12.338898+0000","last_active":"2024-09-12T02:02:13.340632+0000","last_peered":"2024-09-12T02:02:13.340632+0000","last_clean":"2024-09-12T02:02:13.340632+0000","last_became_active":"2024-09-12T02:02:12.338509+0000","last_became_peered":"2024-09-12T02:02:12.338509+0000","last_unstale":"2024-09-12T02:02:13.340632+0000","last_undegraded":"2024-09-12T02:02:13.340632+0000","last_fullsized":"2024-09-12T02:02:13.340632+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:55.080145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.351384+0000","last_change":"2024-09-12T02:02:12.348813+0000","last_active":"2024-09-12T02:02:12.351384+0000","last_peered":"2024-09-12T02:02:12.351384+0000","last_clean":"2024-09-12T02:02:12.351384+0000","last_became_active":"2024-09-12T02:02:12.348446+0000","last_became_peered":"2024-09-12T02:02:12.348446+0000","last_unstale":"2024-09-12T02:02:12.351384+0000","last_undegraded":"2024-09-12T02:02:12.351384+0000","last_fullsized":"2024-09-12T02:02:12.351384+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:13.655779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.337680+0000","last_change":"2024-09-12T02:02:12.336248+0000","last_active":"2024-09-12T02:02:12.337680+0000","last_peered":"2024-09-12T02:02:12.337680+0000","last_clean":"2024-09-12T02:02:12.337680+0000","last_became_active":"2024-09-12T02:02:12.335952+0000","last_became_peered":"2024-09-12T02:02:12.335952+0000","last_unstale":"2024-09-12T02:02:12.337680+0000","last_undegraded":"2024-09-12T02:02:12.337680+0000","last_fullsized":"2024-09-12T02:02:12.337680+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:28.825819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.322680+0000","last_change":"2024-09-12T02:02:11.322680+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.322680+0000","last_undegraded":"2024-09-12T02:02:11.322680+0000","last_fullsized":"2024-09-12T02:02:11.322680+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.342680+0000","last_change":"2024-09-12T02:02:12.338436+0000","last_active":"2024-09-12T02:02:12.342680+0000","last_peered":"2024-09-12T02:02:12.342680+0000","last_clean":"2024-09-12T02:02:12.342680+0000","last_became_active":"2024-09-12T02:02:12.338088+0000","last_became_peered":"2024-09-12T02:02:12.338088+0000","last_unstale":"2024-09-12T02:02:12.342680+0000","last_undegraded":"2024-09-12T02:02:12.342680+0000","last_fullsized":"2024-09-12T02:02:12.342680+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:03.708954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412540+0000","last_change":"2024-09-12T02:02:12.340218+0000","last_active":"2024-09-12T02:02:13.412540+0000","last_peered":"2024-09-12T02:02:13.412540+0000","last_clean":"2024-09-12T02:02:13.412540+0000","last_became_active":"2024-09-12T02:02:12.339861+0000","last_became_peered":"2024-09-12T02:02:12.339861+0000","last_unstale":"2024-09-12T02:02:13.412540+0000","last_undegraded":"2024-09-12T02:02:13.412540+0000","last_fullsized":"2024-09-12T02:02:13.412540+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:51.659882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336910+0000","last_change":"2024-09-12T02:02:12.333340+0000","last_active":"2024-09-12T02:02:12.336910+0000","last_peered":"2024-09-12T02:02:12.336910+0000","last_clean":"2024-09-12T02:02:12.336910+0000","last_became_active":"2024-09-12T02:02:12.333067+0000","last_became_peered":"2024-09-12T02:02:12.333067+0000","last_unstale":"2024-09-12T02:02:12.336910+0000","last_undegraded":"2024-09-12T02:02:12.336910+0000","last_fullsized":"2024-09-12T02:02:12.336910+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:42.119881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.324473+0000","last_change":"2024-09-12T02:02:11.324473+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.324473+0000","last_undegraded":"2024-09-12T02:02:11.324473+0000","last_fullsized":"2024-09-12T02:02:11.324473+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.329564+0000","last_change":"2024-09-12T02:02:12.328431+0000","last_active":"2024-09-12T02:02:12.329564+0000","last_peered":"2024-09-12T02:02:12.329564+0000","last_clean":"2024-09-12T02:02:12.329564+0000","last_became_active":"2024-09-12T02:02:12.328148+0000","last_became_peered":"2024-09-12T02:02:12.328148+0000","last_unstale":"2024-09-12T02:02:12.329564+0000","last_undegraded":"2024-09-12T02:02:12.329564+0000","last_fullsized":"2024-09-12T02:02:12.329564+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:05.794542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.322247+0000","last_change":"2024-09-12T02:02:11.322247+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.322247+0000","last_undegraded":"2024-09-12T02:02:11.322247+0000","last_fullsized":"2024-09-12T02:02:11.322247+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.328850+0000","last_change":"2024-09-12T02:02:12.327134+0000","last_active":"2024-09-12T02:02:12.328850+0000","last_peered":"2024-09-12T02:02:12.328850+0000","last_clean":"2024-09-12T02:02:12.328850+0000","last_became_active":"2024-09-12T02:02:12.326826+0000","last_became_peered":"2024-09-12T02:02:12.326826+0000","last_unstale":"2024-09-12T02:02:12.328850+0000","last_undegraded":"2024-09-12T02:02:12.328850+0000","last_fullsized":"2024-09-12T02:02:12.328850+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:21.234445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336836+0000","last_change":"2024-09-12T02:02:12.331964+0000","last_active":"2024-09-12T02:02:12.336836+0000","last_peered":"2024-09-12T02:02:12.336836+0000","last_clean":"2024-09-12T02:02:12.336836+0000","last_became_active":"2024-09-12T02:02:12.331686+0000","last_became_peered":"2024-09-12T02:02:12.331686+0000","last_unstale":"2024-09-12T02:02:12.336836+0000","last_undegraded":"2024-09-12T02:02:12.336836+0000","last_fullsized":"2024-09-12T02:02:12.336836+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:31.132531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323252+0000","last_change":"2024-09-12T02:02:11.323252+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323252+0000","last_undegraded":"2024-09-12T02:02:11.323252+0000","last_fullsized":"2024-09-12T02:02:11.323252+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.340755+0000","last_change":"2024-09-12T02:02:12.337578+0000","last_active":"2024-09-12T02:02:12.340755+0000","last_peered":"2024-09-12T02:02:12.340755+0000","last_clean":"2024-09-12T02:02:12.340755+0000","last_became_active":"2024-09-12T02:02:12.337335+0000","last_became_peered":"2024-09-12T02:02:12.337335+0000","last_unstale":"2024-09-12T02:02:12.340755+0000","last_undegraded":"2024-09-12T02:02:12.340755+0000","last_fullsized":"2024-09-12T02:02:12.340755+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:59.464045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335356+0000","last_change":"2024-09-12T02:02:12.330650+0000","last_active":"2024-09-12T02:02:12.335356+0000","last_peered":"2024-09-12T02:02:12.335356+0000","last_clean":"2024-09-12T02:02:12.335356+0000","last_became_active":"2024-09-12T02:02:12.330347+0000","last_became_peered":"2024-09-12T02:02:12.330347+0000","last_unstale":"2024-09-12T02:02:12.335356+0000","last_undegraded":"2024-09-12T02:02:12.335356+0000","last_fullsized":"2024-09-12T02:02:12.335356+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.801762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335304+0000","last_change":"2024-09-12T02:02:12.329326+0000","last_active":"2024-09-12T02:02:12.335304+0000","last_peered":"2024-09-12T02:02:12.335304+0000","last_clean":"2024-09-12T02:02:12.335304+0000","last_became_active":"2024-09-12T02:02:12.329063+0000","last_became_peered":"2024-09-12T02:02:12.329063+0000","last_unstale":"2024-09-12T02:02:12.335304+0000","last_undegraded":"2024-09-12T02:02:12.335304+0000","last_fullsized":"2024-09-12T02:02:12.335304+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:10.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.340436+0000","last_change":"2024-09-12T02:02:12.333053+0000","last_active":"2024-09-12T02:02:12.340436+0000","last_peered":"2024-09-12T02:02:12.340436+0000","last_clean":"2024-09-12T02:02:12.340436+0000","last_became_active":"2024-09-12T02:02:12.332788+0000","last_became_peered":"2024-09-12T02:02:12.332788+0000","last_unstale":"2024-09-12T02:02:12.340436+0000","last_undegraded":"2024-09-12T02:02:12.340436+0000","last_fullsized":"2024-09-12T02:02:12.340436+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:42.844428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.321134+0000","last_change":"2024-09-12T02:02:11.321134+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.321134+0000","last_undegraded":"2024-09-12T02:02:11.321134+0000","last_fullsized":"2024-09-12T02:02:11.321134+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336130+0000","last_change":"2024-09-12T02:02:12.326448+0000","last_active":"2024-09-12T02:02:12.336130+0000","last_peered":"2024-09-12T02:02:12.336130+0000","last_clean":"2024-09-12T02:02:12.336130+0000","last_became_active":"2024-09-12T02:02:12.326137+0000","last_became_peered":"2024-09-12T02:02:12.326137+0000","last_unstale":"2024-09-12T02:02:12.336130+0000","last_undegraded":"2024-09-12T02:02:12.336130+0000","last_fullsized":"2024-09-12T02:02:12.336130+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:06.139652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323540+0000","last_change":"2024-09-12T02:02:11.323540+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323540+0000","last_undegraded":"2024-09-12T02:02:11.323540+0000","last_fullsized":"2024-09-12T02:02:11.323540+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.322810+0000","last_change":"2024-09-12T02:02:11.322810+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.322810+0000","last_undegraded":"2024-09-12T02:02:11.322810+0000","last_fullsized":"2024-09-12T02:02:11.322810+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323252+0000","last_change":"2024-09-12T02:02:12.339608+0000","last_active":"2024-09-12T02:02:13.323252+0000","last_peered":"2024-09-12T02:02:13.323252+0000","last_clean":"2024-09-12T02:02:13.323252+0000","last_became_active":"2024-09-12T02:02:12.339051+0000","last_became_peered":"2024-09-12T02:02:12.339051+0000","last_unstale":"2024-09-12T02:02:13.323252+0000","last_undegraded":"2024-09-12T02:02:13.323252+0000","last_fullsized":"2024-09-12T02:02:13.323252+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:51.986401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.347328+0000","last_change":"2024-09-12T02:02:12.344797+0000","last_active":"2024-09-12T02:02:12.347328+0000","last_peered":"2024-09-12T02:02:12.347328+0000","last_clean":"2024-09-12T02:02:12.347328+0000","last_became_active":"2024-09-12T02:02:12.344507+0000","last_became_peered":"2024-09-12T02:02:12.344507+0000","last_unstale":"2024-09-12T02:02:12.347328+0000","last_undegraded":"2024-09-12T02:02:12.347328+0000","last_fullsized":"2024-09-12T02:02:12.347328+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:48.125756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340618+0000","last_change":"2024-09-12T02:02:12.337746+0000","last_active":"2024-09-12T02:02:13.340618+0000","last_peered":"2024-09-12T02:02:13.340618+0000","last_clean":"2024-09-12T02:02:13.340618+0000","last_became_active":"2024-09-12T02:02:12.337473+0000","last_became_peered":"2024-09-12T02:02:12.337473+0000","last_unstale":"2024-09-12T02:02:13.340618+0000","last_undegraded":"2024-09-12T02:02:13.340618+0000","last_fullsized":"2024-09-12T02:02:13.340618+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:25.348127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323897+0000","last_change":"2024-09-12T02:02:11.323897+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323897+0000","last_undegraded":"2024-09-12T02:02:11.323897+0000","last_fullsized":"2024-09-12T02:02:11.323897+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336967+0000","last_change":"2024-09-12T02:02:12.331869+0000","last_active":"2024-09-12T02:02:12.336967+0000","last_peered":"2024-09-12T02:02:12.336967+0000","last_clean":"2024-09-12T02:02:12.336967+0000","last_became_active":"2024-09-12T02:02:12.331585+0000","last_became_peered":"2024-09-12T02:02:12.331585+0000","last_unstale":"2024-09-12T02:02:12.336967+0000","last_undegraded":"2024-09-12T02:02:12.336967+0000","last_fullsized":"2024-09-12T02:02:12.336967+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:26.480661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.353526+0000","last_change":"2024-09-12T02:02:12.349310+0000","last_active":"2024-09-12T02:02:12.353526+0000","last_peered":"2024-09-12T02:02:12.353526+0000","last_clean":"2024-09-12T02:02:12.353526+0000","last_became_active":"2024-09-12T02:02:12.349030+0000","last_became_peered":"2024-09-12T02:02:12.349030+0000","last_unstale":"2024-09-12T02:02:12.353526+0000","last_undegraded":"2024-09-12T02:02:12.353526+0000","last_fullsized":"2024-09-12T02:02:12.353526+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:23.429351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412462+0000","last_change":"2024-09-12T02:02:12.340402+0000","last_active":"2024-09-12T02:02:13.412462+0000","last_peered":"2024-09-12T02:02:13.412462+0000","last_clean":"2024-09-12T02:02:13.412462+0000","last_became_active":"2024-09-12T02:02:12.340024+0000","last_became_peered":"2024-09-12T02:02:12.340024+0000","last_unstale":"2024-09-12T02:02:13.412462+0000","last_undegraded":"2024-09-12T02:02:13.412462+0000","last_fullsized":"2024-09-12T02:02:13.412462+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:24.518549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.322132+0000","last_change":"2024-09-12T02:02:11.322132+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.322132+0000","last_undegraded":"2024-09-12T02:02:11.322132+0000","last_fullsized":"2024-09-12T02:02:11.322132+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340407+0000","last_change":"2024-09-12T02:02:12.343209+0000","last_active":"2024-09-12T02:02:13.340407+0000","last_peered":"2024-09-12T02:02:13.340407+0000","last_clean":"2024-09-12T02:02:13.340407+0000","last_became_active":"2024-09-12T02:02:12.342918+0000","last_became_peered":"2024-09-12T02:02:12.342918+0000","last_unstale":"2024-09-12T02:02:13.340407+0000","last_undegraded":"2024-09-12T02:02:13.340407+0000","last_fullsized":"2024-09-12T02:02:13.340407+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:20.594709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335337+0000","last_change":"2024-09-12T02:02:12.327747+0000","last_active":"2024-09-12T02:02:12.335337+0000","last_peered":"2024-09-12T02:02:12.335337+0000","last_clean":"2024-09-12T02:02:12.335337+0000","last_became_active":"2024-09-12T02:02:12.327465+0000","last_became_peered":"2024-09-12T02:02:12.327465+0000","last_unstale":"2024-09-12T02:02:12.335337+0000","last_undegraded":"2024-09-12T02:02:12.335337+0000","last_fullsized":"2024-09-12T02:02:12.335337+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:51.659882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.353469+0000","last_change":"2024-09-12T02:02:12.351000+0000","last_active":"2024-09-12T02:02:12.353469+0000","last_peered":"2024-09-12T02:02:12.353469+0000","last_clean":"2024-09-12T02:02:12.353469+0000","last_became_active":"2024-09-12T02:02:12.350573+0000","last_became_peered":"2024-09-12T02:02:12.350573+0000","last_unstale":"2024-09-12T02:02:12.353469+0000","last_undegraded":"2024-09-12T02:02:12.353469+0000","last_fullsized":"2024-09-12T02:02:12.353469+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:52.339672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"92'4","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.324080+0000","last_change":"2024-09-12T02:02:11.333328+0000","last_active":"2024-09-12T02:02:13.324080+0000","last_peered":"2024-09-12T02:02:13.324080+0000","last_clean":"2024-09-12T02:02:13.324080+0000","last_became_active":"2024-09-12T02:02:11.333075+0000","last_became_peered":"2024-09-12T02:02:11.333075+0000","last_unstale":"2024-09-12T02:02:13.324080+0000","last_undegraded":"2024-09-12T02:02:13.324080+0000","last_fullsized":"2024-09-12T02:02:13.324080+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:36.748542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335906+0000","last_change":"2024-09-12T02:02:12.330259+0000","last_active":"2024-09-12T02:02:12.335906+0000","last_peered":"2024-09-12T02:02:12.335906+0000","last_clean":"2024-09-12T02:02:12.335906+0000","last_became_active":"2024-09-12T02:02:12.329970+0000","last_became_peered":"2024-09-12T02:02:12.329970+0000","last_unstale":"2024-09-12T02:02:12.335906+0000","last_undegraded":"2024-09-12T02:02:12.335906+0000","last_fullsized":"2024-09-12T02:02:12.335906+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:52.606535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.333999+0000","last_change":"2024-09-12T02:02:11.329594+0000","last_active":"2024-09-12T02:02:11.333999+0000","last_peered":"2024-09-12T02:02:11.333999+0000","last_clean":"2024-09-12T02:02:11.333999+0000","last_became_active":"2024-09-12T02:02:11.329256+0000","last_became_peered":"2024-09-12T02:02:11.329256+0000","last_unstale":"2024-09-12T02:02:11.333999+0000","last_undegraded":"2024-09-12T02:02:11.333999+0000","last_fullsized":"2024-09-12T02:02:11.333999+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:54.686751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412555+0000","last_change":"2024-09-12T02:02:12.337973+0000","last_active":"2024-09-12T02:02:13.412555+0000","last_peered":"2024-09-12T02:02:13.412555+0000","last_clean":"2024-09-12T02:02:13.412555+0000","last_became_active":"2024-09-12T02:02:12.337659+0000","last_became_peered":"2024-09-12T02:02:12.337659+0000","last_unstale":"2024-09-12T02:02:13.412555+0000","last_undegraded":"2024-09-12T02:02:13.412555+0000","last_fullsized":"2024-09-12T02:02:13.412555+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:10.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412473+0000","last_change":"2024-09-12T02:02:11.333138+0000","last_active":"2024-09-12T02:02:13.412473+0000","last_peered":"2024-09-12T02:02:13.412473+0000","last_clean":"2024-09-12T02:02:13.412473+0000","last_became_active":"2024-09-12T02:02:11.332790+0000","last_became_peered":"2024-09-12T02:02:11.332790+0000","last_unstale":"2024-09-12T02:02:13.412473+0000","last_undegraded":"2024-09-12T02:02:13.412473+0000","last_fullsized":"2024-09-12T02:02:13.412473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:57.281562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336328+0000","last_change":"2024-09-12T02:02:12.333076+0000","last_active":"2024-09-12T02:02:12.336328+0000","last_peered":"2024-09-12T02:02:12.336328+0000","last_clean":"2024-09-12T02:02:12.336328+0000","last_became_active":"2024-09-12T02:02:12.332851+0000","last_became_peered":"2024-09-12T02:02:12.332851+0000","last_unstale":"2024-09-12T02:02:12.336328+0000","last_undegraded":"2024-09-12T02:02:12.336328+0000","last_fullsized":"2024-09-12T02:02:12.336328+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:38.281610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323549+0000","last_change":"2024-09-12T02:02:11.332340+0000","last_active":"2024-09-12T02:02:13.323549+0000","last_peered":"2024-09-12T02:02:13.323549+0000","last_clean":"2024-09-12T02:02:13.323549+0000","last_became_active":"2024-09-12T02:02:11.332101+0000","last_became_peered":"2024-09-12T02:02:11.332101+0000","last_unstale":"2024-09-12T02:02:13.323549+0000","last_undegraded":"2024-09-12T02:02:13.323549+0000","last_fullsized":"2024-09-12T02:02:13.323549+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.886557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.332571+0000","last_change":"2024-09-12T02:02:12.325486+0000","last_active":"2024-09-12T02:02:12.332571+0000","last_peered":"2024-09-12T02:02:12.332571+0000","last_clean":"2024-09-12T02:02:12.332571+0000","last_became_active":"2024-09-12T02:02:12.325177+0000","last_became_peered":"2024-09-12T02:02:12.325177+0000","last_unstale":"2024-09-12T02:02:12.332571+0000","last_undegraded":"2024-09-12T02:02:12.332571+0000","last_fullsized":"2024-09-12T02:02:12.332571+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:28.518234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.337143+0000","last_change":"2024-09-12T02:02:11.333899+0000","last_active":"2024-09-12T02:02:11.337143+0000","last_peered":"2024-09-12T02:02:11.337143+0000","last_clean":"2024-09-12T02:02:11.337143+0000","last_became_active":"2024-09-12T02:02:11.333612+0000","last_became_peered":"2024-09-12T02:02:11.333612+0000","last_unstale":"2024-09-12T02:02:11.337143+0000","last_undegraded":"2024-09-12T02:02:11.337143+0000","last_fullsized":"2024-09-12T02:02:11.337143+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:16.109597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.322959+0000","last_change":"2024-09-12T02:02:12.339670+0000","last_active":"2024-09-12T02:02:13.322959+0000","last_peered":"2024-09-12T02:02:13.322959+0000","last_clean":"2024-09-12T02:02:13.322959+0000","last_became_active":"2024-09-12T02:02:12.339401+0000","last_became_peered":"2024-09-12T02:02:12.339401+0000","last_unstale":"2024-09-12T02:02:13.322959+0000","last_undegraded":"2024-09-12T02:02:13.322959+0000","last_fullsized":"2024-09-12T02:02:13.322959+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:39.396515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"92'1","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.353388+0000","last_change":"2024-09-12T02:02:11.336467+0000","last_active":"2024-09-12T02:02:12.353388+0000","last_peered":"2024-09-12T02:02:12.353388+0000","last_clean":"2024-09-12T02:02:12.353388+0000","last_became_active":"2024-09-12T02:02:11.336029+0000","last_became_peered":"2024-09-12T02:02:11.336029+0000","last_unstale":"2024-09-12T02:02:12.353388+0000","last_undegraded":"2024-09-12T02:02:12.353388+0000","last_fullsized":"2024-09-12T02:02:12.353388+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:33.725746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.342775+0000","last_change":"2024-09-12T02:02:12.338526+0000","last_active":"2024-09-12T02:02:12.342775+0000","last_peered":"2024-09-12T02:02:12.342775+0000","last_clean":"2024-09-12T02:02:12.342775+0000","last_became_active":"2024-09-12T02:02:12.338174+0000","last_became_peered":"2024-09-12T02:02:12.338174+0000","last_unstale":"2024-09-12T02:02:12.342775+0000","last_undegraded":"2024-09-12T02:02:12.342775+0000","last_fullsized":"2024-09-12T02:02:12.342775+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.054924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.317838+0000","last_change":"2024-09-12T02:02:11.326331+0000","last_active":"2024-09-12T02:02:12.317838+0000","last_peered":"2024-09-12T02:02:12.317838+0000","last_clean":"2024-09-12T02:02:12.317838+0000","last_became_active":"2024-09-12T02:02:11.326051+0000","last_became_peered":"2024-09-12T02:02:11.326051+0000","last_unstale":"2024-09-12T02:02:12.317838+0000","last_undegraded":"2024-09-12T02:02:12.317838+0000","last_fullsized":"2024-09-12T02:02:12.317838+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:14.638980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.337500+0000","last_change":"2024-09-12T02:02:12.335645+0000","last_active":"2024-09-12T02:02:12.337500+0000","last_peered":"2024-09-12T02:02:12.337500+0000","last_clean":"2024-09-12T02:02:12.337500+0000","last_became_active":"2024-09-12T02:02:12.335371+0000","last_became_peered":"2024-09-12T02:02:12.335371+0000","last_unstale":"2024-09-12T02:02:12.337500+0000","last_undegraded":"2024-09-12T02:02:12.337500+0000","last_fullsized":"2024-09-12T02:02:12.337500+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:03.083808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412357+0000","last_change":"2024-09-12T02:02:11.334790+0000","last_active":"2024-09-12T02:02:13.412357+0000","last_peered":"2024-09-12T02:02:13.412357+0000","last_clean":"2024-09-12T02:02:13.412357+0000","last_became_active":"2024-09-12T02:02:11.334505+0000","last_became_peered":"2024-09-12T02:02:11.334505+0000","last_unstale":"2024-09-12T02:02:13.412357+0000","last_undegraded":"2024-09-12T02:02:13.412357+0000","last_fullsized":"2024-09-12T02:02:13.412357+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:24.342640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323644+0000","last_change":"2024-09-12T02:02:11.323644+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323644+0000","last_undegraded":"2024-09-12T02:02:11.323644+0000","last_fullsized":"2024-09-12T02:02:11.323644+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340682+0000","last_change":"2024-09-12T02:02:11.333595+0000","last_active":"2024-09-12T02:02:13.340682+0000","last_peered":"2024-09-12T02:02:13.340682+0000","last_clean":"2024-09-12T02:02:13.340682+0000","last_became_active":"2024-09-12T02:02:11.333243+0000","last_became_peered":"2024-09-12T02:02:11.333243+0000","last_unstale":"2024-09-12T02:02:13.340682+0000","last_undegraded":"2024-09-12T02:02:13.340682+0000","last_fullsized":"2024-09-12T02:02:13.340682+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:12.239695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412571+0000","last_change":"2024-09-12T02:02:12.350425+0000","last_active":"2024-09-12T02:02:13.412571+0000","last_peered":"2024-09-12T02:02:13.412571+0000","last_clean":"2024-09-12T02:02:13.412571+0000","last_became_active":"2024-09-12T02:02:12.350139+0000","last_became_peered":"2024-09-12T02:02:12.350139+0000","last_unstale":"2024-09-12T02:02:13.412571+0000","last_undegraded":"2024-09-12T02:02:13.412571+0000","last_fullsized":"2024-09-12T02:02:13.412571+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:52.606535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.318431+0000","last_change":"2024-09-12T02:02:11.333135+0000","last_active":"2024-09-12T02:02:12.318431+0000","last_peered":"2024-09-12T02:02:12.318431+0000","last_clean":"2024-09-12T02:02:12.318431+0000","last_became_active":"2024-09-12T02:02:11.332827+0000","last_became_peered":"2024-09-12T02:02:11.332827+0000","last_unstale":"2024-09-12T02:02:12.318431+0000","last_undegraded":"2024-09-12T02:02:12.318431+0000","last_fullsized":"2024-09-12T02:02:12.318431+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:47.007799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.340461+0000","last_change":"2024-09-12T02:02:12.334298+0000","last_active":"2024-09-12T02:02:12.340461+0000","last_peered":"2024-09-12T02:02:12.340461+0000","last_clean":"2024-09-12T02:02:12.340461+0000","last_became_active":"2024-09-12T02:02:12.334014+0000","last_became_peered":"2024-09-12T02:02:12.334014+0000","last_unstale":"2024-09-12T02:02:12.340461+0000","last_undegraded":"2024-09-12T02:02:12.340461+0000","last_fullsized":"2024-09-12T02:02:12.340461+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:17.156403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.337891+0000","last_change":"2024-09-12T02:02:11.335601+0000","last_active":"2024-09-12T02:02:11.337891+0000","last_peered":"2024-09-12T02:02:11.337891+0000","last_clean":"2024-09-12T02:02:11.337891+0000","last_became_active":"2024-09-12T02:02:11.335331+0000","last_became_peered":"2024-09-12T02:02:11.335331+0000","last_unstale":"2024-09-12T02:02:11.337891+0000","last_undegraded":"2024-09-12T02:02:11.337891+0000","last_fullsized":"2024-09-12T02:02:11.337891+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:08.075197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.340936+0000","last_change":"2024-09-12T02:02:12.339385+0000","last_active":"2024-09-12T02:02:12.340936+0000","last_peered":"2024-09-12T02:02:12.340936+0000","last_clean":"2024-09-12T02:02:12.340936+0000","last_became_active":"2024-09-12T02:02:12.339076+0000","last_became_peered":"2024-09-12T02:02:12.339076+0000","last_unstale":"2024-09-12T02:02:12.340936+0000","last_undegraded":"2024-09-12T02:02:12.340936+0000","last_fullsized":"2024-09-12T02:02:12.340936+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.305827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"92'6","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.356286+0000","last_change":"2024-09-12T02:02:11.332578+0000","last_active":"2024-09-12T02:02:12.356286+0000","last_peered":"2024-09-12T02:02:12.356286+0000","last_clean":"2024-09-12T02:02:12.356286+0000","last_became_active":"2024-09-12T02:02:11.332190+0000","last_became_peered":"2024-09-12T02:02:11.332190+0000","last_unstale":"2024-09-12T02:02:12.356286+0000","last_undegraded":"2024-09-12T02:02:12.356286+0000","last_fullsized":"2024-09-12T02:02:12.356286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:48.070182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336884+0000","last_change":"2024-09-12T02:02:12.332687+0000","last_active":"2024-09-12T02:02:12.336884+0000","last_peered":"2024-09-12T02:02:12.336884+0000","last_clean":"2024-09-12T02:02:12.336884+0000","last_became_active":"2024-09-12T02:02:12.332386+0000","last_became_peered":"2024-09-12T02:02:12.332386+0000","last_unstale":"2024-09-12T02:02:12.336884+0000","last_undegraded":"2024-09-12T02:02:12.336884+0000","last_fullsized":"2024-09-12T02:02:12.336884+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:26.580075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412589+0000","last_change":"2024-09-12T02:02:11.335419+0000","last_active":"2024-09-12T02:02:13.412589+0000","last_peered":"2024-09-12T02:02:13.412589+0000","last_clean":"2024-09-12T02:02:13.412589+0000","last_became_active":"2024-09-12T02:02:11.335199+0000","last_became_peered":"2024-09-12T02:02:11.335199+0000","last_unstale":"2024-09-12T02:02:13.412589+0000","last_undegraded":"2024-09-12T02:02:13.412589+0000","last_fullsized":"2024-09-12T02:02:13.412589+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:19.589222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.321258+0000","last_change":"2024-09-12T02:02:11.321258+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.321258+0000","last_undegraded":"2024-09-12T02:02:11.321258+0000","last_fullsized":"2024-09-12T02:02:11.321258+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.322792+0000","last_change":"2024-09-12T02:02:11.334793+0000","last_active":"2024-09-12T02:02:12.322792+0000","last_peered":"2024-09-12T02:02:12.322792+0000","last_clean":"2024-09-12T02:02:12.322792+0000","last_became_active":"2024-09-12T02:02:11.334335+0000","last_became_peered":"2024-09-12T02:02:11.334335+0000","last_unstale":"2024-09-12T02:02:12.322792+0000","last_undegraded":"2024-09-12T02:02:12.322792+0000","last_fullsized":"2024-09-12T02:02:12.322792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:34.830322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335855+0000","last_change":"2024-09-12T02:02:12.329549+0000","last_active":"2024-09-12T02:02:12.335855+0000","last_peered":"2024-09-12T02:02:12.335855+0000","last_clean":"2024-09-12T02:02:12.335855+0000","last_became_active":"2024-09-12T02:02:12.329279+0000","last_became_peered":"2024-09-12T02:02:12.329279+0000","last_unstale":"2024-09-12T02:02:12.335855+0000","last_undegraded":"2024-09-12T02:02:12.335855+0000","last_fullsized":"2024-09-12T02:02:12.335855+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:27.109469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.323203+0000","last_change":"2024-09-12T02:02:11.338109+0000","last_active":"2024-09-12T02:02:12.323203+0000","last_peered":"2024-09-12T02:02:12.323203+0000","last_clean":"2024-09-12T02:02:12.323203+0000","last_became_active":"2024-09-12T02:02:11.337827+0000","last_became_peered":"2024-09-12T02:02:11.337827+0000","last_unstale":"2024-09-12T02:02:12.323203+0000","last_undegraded":"2024-09-12T02:02:12.323203+0000","last_fullsized":"2024-09-12T02:02:12.323203+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:25.822689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.346766+0000","last_change":"2024-09-12T02:02:12.345192+0000","last_active":"2024-09-12T02:02:12.346766+0000","last_peered":"2024-09-12T02:02:12.346766+0000","last_clean":"2024-09-12T02:02:12.346766+0000","last_became_active":"2024-09-12T02:02:12.344763+0000","last_became_peered":"2024-09-12T02:02:12.344763+0000","last_unstale":"2024-09-12T02:02:12.346766+0000","last_undegraded":"2024-09-12T02:02:12.346766+0000","last_fullsized":"2024-09-12T02:02:12.346766+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:29.370257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"92'8","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.356907+0000","last_change":"2024-09-12T02:02:11.336360+0000","last_active":"2024-09-12T02:02:12.356907+0000","last_peered":"2024-09-12T02:02:12.356907+0000","last_clean":"2024-09-12T02:02:12.356907+0000","last_became_active":"2024-09-12T02:02:11.336065+0000","last_became_peered":"2024-09-12T02:02:11.336065+0000","last_unstale":"2024-09-12T02:02:12.356907+0000","last_undegraded":"2024-09-12T02:02:12.356907+0000","last_fullsized":"2024-09-12T02:02:12.356907+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:11.233739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.351195+0000","last_change":"2024-09-12T02:02:12.350095+0000","last_active":"2024-09-12T02:02:12.351195+0000","last_peered":"2024-09-12T02:02:12.351195+0000","last_clean":"2024-09-12T02:02:12.351195+0000","last_became_active":"2024-09-12T02:02:12.349756+0000","last_became_peered":"2024-09-12T02:02:12.349756+0000","last_unstale":"2024-09-12T02:02:12.351195+0000","last_undegraded":"2024-09-12T02:02:12.351195+0000","last_fullsized":"2024-09-12T02:02:12.351195+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:05.645626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.324132+0000","last_change":"2024-09-12T02:02:11.327980+0000","last_active":"2024-09-12T02:02:13.324132+0000","last_peered":"2024-09-12T02:02:13.324132+0000","last_clean":"2024-09-12T02:02:13.324132+0000","last_became_active":"2024-09-12T02:02:11.327687+0000","last_became_peered":"2024-09-12T02:02:11.327687+0000","last_unstale":"2024-09-12T02:02:13.324132+0000","last_undegraded":"2024-09-12T02:02:13.324132+0000","last_fullsized":"2024-09-12T02:02:13.324132+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:15.056421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323117+0000","last_change":"2024-09-12T02:02:12.333663+0000","last_active":"2024-09-12T02:02:13.323117+0000","last_peered":"2024-09-12T02:02:13.323117+0000","last_clean":"2024-09-12T02:02:13.323117+0000","last_became_active":"2024-09-12T02:02:12.333334+0000","last_became_peered":"2024-09-12T02:02:12.333334+0000","last_unstale":"2024-09-12T02:02:13.323117+0000","last_undegraded":"2024-09-12T02:02:13.323117+0000","last_fullsized":"2024-09-12T02:02:13.323117+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:08.450410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412473+0000","last_change":"2024-09-12T02:02:11.331682+0000","last_active":"2024-09-12T02:02:13.412473+0000","last_peered":"2024-09-12T02:02:13.412473+0000","last_clean":"2024-09-12T02:02:13.412473+0000","last_became_active":"2024-09-12T02:02:11.331384+0000","last_became_peered":"2024-09-12T02:02:11.331384+0000","last_unstale":"2024-09-12T02:02:13.412473+0000","last_undegraded":"2024-09-12T02:02:13.412473+0000","last_fullsized":"2024-09-12T02:02:13.412473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:30.836043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323444+0000","last_change":"2024-09-12T02:02:11.323444+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323444+0000","last_undegraded":"2024-09-12T02:02:11.323444+0000","last_fullsized":"2024-09-12T02:02:11.323444+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.334831+0000","last_change":"2024-09-12T02:02:11.333247+0000","last_active":"2024-09-12T02:02:11.334831+0000","last_peered":"2024-09-12T02:02:11.334831+0000","last_clean":"2024-09-12T02:02:11.334831+0000","last_became_active":"2024-09-12T02:02:11.332967+0000","last_became_peered":"2024-09-12T02:02:11.332967+0000","last_unstale":"2024-09-12T02:02:11.334831+0000","last_undegraded":"2024-09-12T02:02:11.334831+0000","last_fullsized":"2024-09-12T02:02:11.334831+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:36.986789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.342109+0000","last_change":"2024-09-12T02:02:12.338322+0000","last_active":"2024-09-12T02:02:12.342109+0000","last_peered":"2024-09-12T02:02:12.342109+0000","last_clean":"2024-09-12T02:02:12.342109+0000","last_became_active":"2024-09-12T02:02:12.338015+0000","last_became_peered":"2024-09-12T02:02:12.338015+0000","last_unstale":"2024-09-12T02:02:12.342109+0000","last_undegraded":"2024-09-12T02:02:12.342109+0000","last_fullsized":"2024-09-12T02:02:12.342109+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:47.736613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340361+0000","last_change":"2024-09-12T02:02:11.332292+0000","last_active":"2024-09-12T02:02:13.340361+0000","last_peered":"2024-09-12T02:02:13.340361+0000","last_clean":"2024-09-12T02:02:13.340361+0000","last_became_active":"2024-09-12T02:02:11.332012+0000","last_became_peered":"2024-09-12T02:02:11.332012+0000","last_unstale":"2024-09-12T02:02:13.340361+0000","last_undegraded":"2024-09-12T02:02:13.340361+0000","last_fullsized":"2024-09-12T02:02:13.340361+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:31.076337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340404+0000","last_change":"2024-09-12T02:02:12.349435+0000","last_active":"2024-09-12T02:02:13.340404+0000","last_peered":"2024-09-12T02:02:13.340404+0000","last_clean":"2024-09-12T02:02:13.340404+0000","last_became_active":"2024-09-12T02:02:12.347614+0000","last_became_peered":"2024-09-12T02:02:12.347614+0000","last_unstale":"2024-09-12T02:02:13.340404+0000","last_undegraded":"2024-09-12T02:02:13.340404+0000","last_fullsized":"2024-09-12T02:02:13.340404+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:29.496591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.321807+0000","last_change":"2024-09-12T02:02:11.330103+0000","last_active":"2024-09-12T02:02:12.321807+0000","last_peered":"2024-09-12T02:02:12.321807+0000","last_clean":"2024-09-12T02:02:12.321807+0000","last_became_active":"2024-09-12T02:02:11.329822+0000","last_became_peered":"2024-09-12T02:02:11.329822+0000","last_unstale":"2024-09-12T02:02:12.321807+0000","last_undegraded":"2024-09-12T02:02:12.321807+0000","last_fullsized":"2024-09-12T02:02:12.321807+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:00.660882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340435+0000","last_change":"2024-09-12T02:02:12.343786+0000","last_active":"2024-09-12T02:02:13.340435+0000","last_peered":"2024-09-12T02:02:13.340435+0000","last_clean":"2024-09-12T02:02:13.340435+0000","last_became_active":"2024-09-12T02:02:12.343506+0000","last_became_peered":"2024-09-12T02:02:12.343506+0000","last_unstale":"2024-09-12T02:02:13.340435+0000","last_undegraded":"2024-09-12T02:02:13.340435+0000","last_fullsized":"2024-09-12T02:02:13.340435+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:58.287049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340526+0000","last_change":"2024-09-12T02:02:11.337862+0000","last_active":"2024-09-12T02:02:13.340526+0000","last_peered":"2024-09-12T02:02:13.340526+0000","last_clean":"2024-09-12T02:02:13.340526+0000","last_became_active":"2024-09-12T02:02:11.337384+0000","last_became_peered":"2024-09-12T02:02:11.337384+0000","last_unstale":"2024-09-12T02:02:13.340526+0000","last_undegraded":"2024-09-12T02:02:13.340526+0000","last_fullsized":"2024-09-12T02:02:13.340526+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:03.587791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336675+0000","last_change":"2024-09-12T02:02:12.332334+0000","last_active":"2024-09-12T02:02:12.336675+0000","last_peered":"2024-09-12T02:02:12.336675+0000","last_clean":"2024-09-12T02:02:12.336675+0000","last_became_active":"2024-09-12T02:02:12.331814+0000","last_became_peered":"2024-09-12T02:02:12.331814+0000","last_unstale":"2024-09-12T02:02:12.336675+0000","last_undegraded":"2024-09-12T02:02:12.336675+0000","last_fullsized":"2024-09-12T02:02:12.336675+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:53.448271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.322071+0000","last_change":"2024-09-12T02:02:11.329706+0000","last_active":"2024-09-12T02:02:12.322071+0000","last_peered":"2024-09-12T02:02:12.322071+0000","last_clean":"2024-09-12T02:02:12.322071+0000","last_became_active":"2024-09-12T02:02:11.329422+0000","last_became_peered":"2024-09-12T02:02:11.329422+0000","last_unstale":"2024-09-12T02:02:12.322071+0000","last_undegraded":"2024-09-12T02:02:12.322071+0000","last_fullsized":"2024-09-12T02:02:12.322071+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:17.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323458+0000","last_change":"2024-09-12T02:02:12.334098+0000","last_active":"2024-09-12T02:02:13.323458+0000","last_peered":"2024-09-12T02:02:13.323458+0000","last_clean":"2024-09-12T02:02:13.323458+0000","last_became_active":"2024-09-12T02:02:12.332786+0000","last_became_peered":"2024-09-12T02:02:12.332786+0000","last_unstale":"2024-09-12T02:02:13.323458+0000","last_undegraded":"2024-09-12T02:02:13.323458+0000","last_fullsized":"2024-09-12T02:02:13.323458+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:15.955019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412678+0000","last_change":"2024-09-12T02:02:11.334960+0000","last_active":"2024-09-12T02:02:13.412678+0000","last_peered":"2024-09-12T02:02:13.412678+0000","last_clean":"2024-09-12T02:02:13.412678+0000","last_became_active":"2024-09-12T02:02:11.334693+0000","last_became_peered":"2024-09-12T02:02:11.334693+0000","last_unstale":"2024-09-12T02:02:13.412678+0000","last_undegraded":"2024-09-12T02:02:13.412678+0000","last_fullsized":"2024-09-12T02:02:13.412678+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:28.491104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.345995+0000","last_change":"2024-09-12T02:02:12.342917+0000","last_active":"2024-09-12T02:02:12.345995+0000","last_peered":"2024-09-12T02:02:12.345995+0000","last_clean":"2024-09-12T02:02:12.345995+0000","last_became_active":"2024-09-12T02:02:12.342611+0000","last_became_peered":"2024-09-12T02:02:12.342611+0000","last_unstale":"2024-09-12T02:02:12.345995+0000","last_undegraded":"2024-09-12T02:02:12.345995+0000","last_fullsized":"2024-09-12T02:02:12.345995+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:13.465096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.334509+0000","last_change":"2024-09-12T02:02:11.331807+0000","last_active":"2024-09-12T02:02:11.334509+0000","last_peered":"2024-09-12T02:02:11.334509+0000","last_clean":"2024-09-12T02:02:11.334509+0000","last_became_active":"2024-09-12T02:02:11.331545+0000","last_became_peered":"2024-09-12T02:02:11.331545+0000","last_unstale":"2024-09-12T02:02:11.334509+0000","last_undegraded":"2024-09-12T02:02:11.334509+0000","last_fullsized":"2024-09-12T02:02:11.334509+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:07.526436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336659+0000","last_change":"2024-09-12T02:02:12.331122+0000","last_active":"2024-09-12T02:02:12.336659+0000","last_peered":"2024-09-12T02:02:12.336659+0000","last_clean":"2024-09-12T02:02:12.336659+0000","last_became_active":"2024-09-12T02:02:12.330378+0000","last_became_peered":"2024-09-12T02:02:12.330378+0000","last_unstale":"2024-09-12T02:02:12.336659+0000","last_undegraded":"2024-09-12T02:02:12.336659+0000","last_fullsized":"2024-09-12T02:02:12.336659+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:51.393021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.337903+0000","last_change":"2024-09-12T02:02:11.335862+0000","last_active":"2024-09-12T02:02:11.337903+0000","last_peered":"2024-09-12T02:02:11.337903+0000","last_clean":"2024-09-12T02:02:11.337903+0000","last_became_active":"2024-09-12T02:02:11.335603+0000","last_became_peered":"2024-09-12T02:02:11.335603+0000","last_unstale":"2024-09-12T02:02:11.337903+0000","last_undegraded":"2024-09-12T02:02:11.337903+0000","last_fullsized":"2024-09-12T02:02:11.337903+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:01.073635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340679+0000","last_change":"2024-09-12T02:02:12.349940+0000","last_active":"2024-09-12T02:02:13.340679+0000","last_peered":"2024-09-12T02:02:13.340679+0000","last_clean":"2024-09-12T02:02:13.340679+0000","last_became_active":"2024-09-12T02:02:12.349675+0000","last_became_peered":"2024-09-12T02:02:12.349675+0000","last_unstale":"2024-09-12T02:02:13.340679+0000","last_undegraded":"2024-09-12T02:02:13.340679+0000","last_fullsized":"2024-09-12T02:02:13.340679+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:19.218621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323638+0000","last_change":"2024-09-12T02:02:11.331813+0000","last_active":"2024-09-12T02:02:13.323638+0000","last_peered":"2024-09-12T02:02:13.323638+0000","last_clean":"2024-09-12T02:02:13.323638+0000","last_became_active":"2024-09-12T02:02:11.331505+0000","last_became_peered":"2024-09-12T02:02:11.331505+0000","last_unstale":"2024-09-12T02:02:13.323638+0000","last_undegraded":"2024-09-12T02:02:13.323638+0000","last_fullsized":"2024-09-12T02:02:13.323638+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:31.234575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336540+0000","last_change":"2024-09-12T02:02:12.333131+0000","last_active":"2024-09-12T02:02:12.336540+0000","last_peered":"2024-09-12T02:02:12.336540+0000","last_clean":"2024-09-12T02:02:12.336540+0000","last_became_active":"2024-09-12T02:02:12.332829+0000","last_became_peered":"2024-09-12T02:02:12.332829+0000","last_unstale":"2024-09-12T02:02:12.336540+0000","last_undegraded":"2024-09-12T02:02:12.336540+0000","last_fullsized":"2024-09-12T02:02:12.336540+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:20.234006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.326472+0000","last_change":"2024-09-12T02:02:11.338517+0000","last_active":"2024-09-12T02:02:12.326472+0000","last_peered":"2024-09-12T02:02:12.326472+0000","last_clean":"2024-09-12T02:02:12.326472+0000","last_became_active":"2024-09-12T02:02:11.338195+0000","last_became_peered":"2024-09-12T02:02:11.338195+0000","last_unstale":"2024-09-12T02:02:12.326472+0000","last_undegraded":"2024-09-12T02:02:12.326472+0000","last_fullsized":"2024-09-12T02:02:12.326472+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:23.513062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335125+0000","last_change":"2024-09-12T02:02:12.327683+0000","last_active":"2024-09-12T02:02:12.335125+0000","last_peered":"2024-09-12T02:02:12.335125+0000","last_clean":"2024-09-12T02:02:12.335125+0000","last_became_active":"2024-09-12T02:02:12.327416+0000","last_became_peered":"2024-09-12T02:02:12.327416+0000","last_unstale":"2024-09-12T02:02:12.335125+0000","last_undegraded":"2024-09-12T02:02:12.335125+0000","last_fullsized":"2024-09-12T02:02:12.335125+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:57.332382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340551+0000","last_change":"2024-09-12T02:02:11.328426+0000","last_active":"2024-09-12T02:02:13.340551+0000","last_peered":"2024-09-12T02:02:13.340551+0000","last_clean":"2024-09-12T02:02:13.340551+0000","last_became_active":"2024-09-12T02:02:11.328217+0000","last_became_peered":"2024-09-12T02:02:11.328217+0000","last_unstale":"2024-09-12T02:02:13.340551+0000","last_undegraded":"2024-09-12T02:02:13.340551+0000","last_fullsized":"2024-09-12T02:02:13.340551+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:36.031506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323434+0000","last_change":"2024-09-12T02:02:12.340317+0000","last_active":"2024-09-12T02:02:13.323434+0000","last_peered":"2024-09-12T02:02:13.323434+0000","last_clean":"2024-09-12T02:02:13.323434+0000","last_became_active":"2024-09-12T02:02:12.340058+0000","last_became_peered":"2024-09-12T02:02:12.340058+0000","last_unstale":"2024-09-12T02:02:13.323434+0000","last_undegraded":"2024-09-12T02:02:13.323434+0000","last_fullsized":"2024-09-12T02:02:13.323434+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:07.388059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323058+0000","last_change":"2024-09-12T02:02:11.327599+0000","last_active":"2024-09-12T02:02:13.323058+0000","last_peered":"2024-09-12T02:02:13.323058+0000","last_clean":"2024-09-12T02:02:13.323058+0000","last_became_active":"2024-09-12T02:02:11.327287+0000","last_became_peered":"2024-09-12T02:02:11.327287+0000","last_unstale":"2024-09-12T02:02:13.323058+0000","last_undegraded":"2024-09-12T02:02:13.323058+0000","last_fullsized":"2024-09-12T02:02:13.323058+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:30.857360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336647+0000","last_change":"2024-09-12T02:02:12.332093+0000","last_active":"2024-09-12T02:02:12.336647+0000","last_peered":"2024-09-12T02:02:12.336647+0000","last_clean":"2024-09-12T02:02:12.336647+0000","last_became_active":"2024-09-12T02:02:12.331500+0000","last_became_peered":"2024-09-12T02:02:12.331500+0000","last_unstale":"2024-09-12T02:02:12.336647+0000","last_undegraded":"2024-09-12T02:02:12.336647+0000","last_fullsized":"2024-09-12T02:02:12.336647+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:48.686084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412398+0000","last_change":"2024-09-12T02:02:11.329064+0000","last_active":"2024-09-12T02:02:13.412398+0000","last_peered":"2024-09-12T02:02:13.412398+0000","last_clean":"2024-09-12T02:02:13.412398+0000","last_became_active":"2024-09-12T02:02:11.328800+0000","last_became_peered":"2024-09-12T02:02:11.328800+0000","last_unstale":"2024-09-12T02:02:13.412398+0000","last_undegraded":"2024-09-12T02:02:13.412398+0000","last_fullsized":"2024-09-12T02:02:13.412398+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:12.833485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412626+0000","last_change":"2024-09-12T02:02:12.341167+0000","last_active":"2024-09-12T02:02:13.412626+0000","last_peered":"2024-09-12T02:02:13.412626+0000","last_clean":"2024-09-12T02:02:13.412626+0000","last_became_active":"2024-09-12T02:02:12.340921+0000","last_became_peered":"2024-09-12T02:02:12.340921+0000","last_unstale":"2024-09-12T02:02:13.412626+0000","last_undegraded":"2024-09-12T02:02:13.412626+0000","last_fullsized":"2024-09-12T02:02:13.412626+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.801762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.324675+0000","last_change":"2024-09-12T02:02:11.329351+0000","last_active":"2024-09-12T02:02:12.324675+0000","last_peered":"2024-09-12T02:02:12.324675+0000","last_clean":"2024-09-12T02:02:12.324675+0000","last_became_active":"2024-09-12T02:02:11.329049+0000","last_became_peered":"2024-09-12T02:02:11.329049+0000","last_unstale":"2024-09-12T02:02:12.324675+0000","last_undegraded":"2024-09-12T02:02:12.324675+0000","last_fullsized":"2024-09-12T02:02:12.324675+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:09.295690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":304,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412422+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T02:02:13.412422+0000","last_peered":"2024-09-12T02:02:13.412422+0000","last_clean":"2024-09-12T02:02:13.412422+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T02:02:13.412422+0000","last_undegraded":"2024-09-12T02:02:13.412422+0000","last_fullsized":"2024-09-12T02:02:13.412422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509522,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32888,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338952,"statfs":{"total":96636764160,"available":96603086848,"internally_reserved":0,"allocated":1740800,"data_stored":1119434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509521,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1159168,"data_stored":531226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509522,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1138688,"data_stored":529010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542226,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1126400,"data_stored":522318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542226,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1126400,"data_stored":522318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542226,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1130496,"data_stored":522388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542226,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32900,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338940,"statfs":{"total":96636764160,"available":96603074560,"internally_reserved":0,"allocated":1744896,"data_stored":1115004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1114112,"data_stored":515151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:02:16.030 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3b is not active+clean 2024-09-12T02:02:16.030 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:02:11.322680+0000', 'last_change': '2024-09-12T02:02:11.322680+0000', 'last_active': '2024-09-12T02:02:11.308510+0000', 'last_peered': '2024-09-12T02:02:11.308510+0000', 'last_clean': '2024-09-12T02:02:11.308510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:02:11.322680+0000', 'last_undegraded': '2024-09-12T02:02:11.322680+0000', 'last_fullsized': '2024-09-12T02:02:11.322680+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_clean_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T02:02:16.030 INFO:tasks.ceph.ceph_manager.ceph:PG 14.37 is not active+clean 2024-09-12T02:02:16.030 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:02:11.324473+0000', 'last_change': '2024-09-12T02:02:11.324473+0000', 'last_active': '2024-09-12T02:02:11.308510+0000', 'last_peered': '2024-09-12T02:02:11.308510+0000', 'last_clean': '2024-09-12T02:02:11.308510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:02:11.324473+0000', 'last_undegraded': '2024-09-12T02:02:11.324473+0000', 'last_fullsized': '2024-09-12T02:02:11.324473+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_clean_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T02:02:16.030 INFO:tasks.ceph.ceph_manager.ceph:PG 14.35 is not active+clean 2024-09-12T02:02:16.030 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:02:11.322247+0000', 'last_change': '2024-09-12T02:02:11.322247+0000', 'last_active': '2024-09-12T02:02:11.308510+0000', 'last_peered': '2024-09-12T02:02:11.308510+0000', 'last_clean': '2024-09-12T02:02:11.308510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:02:11.322247+0000', 'last_undegraded': '2024-09-12T02:02:11.322247+0000', 'last_fullsized': '2024-09-12T02:02:11.322247+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_clean_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T02:02:16.031 INFO:tasks.ceph.ceph_manager.ceph:PG 14.32 is not active+clean 2024-09-12T02:02:16.031 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:02:11.323252+0000', 'last_change': '2024-09-12T02:02:11.323252+0000', 'last_active': '2024-09-12T02:02:11.308510+0000', 'last_peered': '2024-09-12T02:02:11.308510+0000', 'last_clean': '2024-09-12T02:02:11.308510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:02:11.323252+0000', 'last_undegraded': '2024-09-12T02:02:11.323252+0000', 'last_fullsized': '2024-09-12T02:02:11.323252+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_clean_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T02:02:16.031 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2d is not active+clean 2024-09-12T02:02:16.031 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:02:11.321134+0000', 'last_change': '2024-09-12T02:02:11.321134+0000', 'last_active': '2024-09-12T02:02:11.308510+0000', 'last_peered': '2024-09-12T02:02:11.308510+0000', 'last_clean': '2024-09-12T02:02:11.308510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:02:11.321134+0000', 'last_undegraded': '2024-09-12T02:02:11.321134+0000', 'last_fullsized': '2024-09-12T02:02:11.321134+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_clean_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T02:02:16.031 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2b is not active+clean 2024-09-12T02:02:16.031 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:02:11.323540+0000', 'last_change': '2024-09-12T02:02:11.323540+0000', 'last_active': '2024-09-12T02:02:11.308510+0000', 'last_peered': '2024-09-12T02:02:11.308510+0000', 'last_clean': '2024-09-12T02:02:11.308510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:02:11.323540+0000', 'last_undegraded': '2024-09-12T02:02:11.323540+0000', 'last_fullsized': '2024-09-12T02:02:11.323540+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_clean_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T02:02:16.031 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2a is not active+clean 2024-09-12T02:02:16.031 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:02:11.322810+0000', 'last_change': '2024-09-12T02:02:11.322810+0000', 'last_active': '2024-09-12T02:02:11.308510+0000', 'last_peered': '2024-09-12T02:02:11.308510+0000', 'last_clean': '2024-09-12T02:02:11.308510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:02:11.322810+0000', 'last_undegraded': '2024-09-12T02:02:11.322810+0000', 'last_fullsized': '2024-09-12T02:02:11.322810+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_clean_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T02:02:16.031 INFO:tasks.ceph.ceph_manager.ceph:PG 14.26 is not active+clean 2024-09-12T02:02:16.031 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:02:11.323897+0000', 'last_change': '2024-09-12T02:02:11.323897+0000', 'last_active': '2024-09-12T02:02:11.308510+0000', 'last_peered': '2024-09-12T02:02:11.308510+0000', 'last_clean': '2024-09-12T02:02:11.308510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:02:11.323897+0000', 'last_undegraded': '2024-09-12T02:02:11.323897+0000', 'last_fullsized': '2024-09-12T02:02:11.323897+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_clean_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T02:02:16.032 INFO:tasks.ceph.ceph_manager.ceph:PG 14.22 is not active+clean 2024-09-12T02:02:16.032 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:02:11.322132+0000', 'last_change': '2024-09-12T02:02:11.322132+0000', 'last_active': '2024-09-12T02:02:11.308510+0000', 'last_peered': '2024-09-12T02:02:11.308510+0000', 'last_clean': '2024-09-12T02:02:11.308510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:02:11.322132+0000', 'last_undegraded': '2024-09-12T02:02:11.322132+0000', 'last_fullsized': '2024-09-12T02:02:11.322132+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_clean_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T02:02:16.032 INFO:tasks.ceph.ceph_manager.ceph:PG 14.14 is not active+clean 2024-09-12T02:02:16.032 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:02:11.323644+0000', 'last_change': '2024-09-12T02:02:11.323644+0000', 'last_active': '2024-09-12T02:02:11.308510+0000', 'last_peered': '2024-09-12T02:02:11.308510+0000', 'last_clean': '2024-09-12T02:02:11.308510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:02:11.323644+0000', 'last_undegraded': '2024-09-12T02:02:11.323644+0000', 'last_fullsized': '2024-09-12T02:02:11.323644+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_clean_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T02:02:16.032 INFO:tasks.ceph.ceph_manager.ceph:PG 14.11 is not active+clean 2024-09-12T02:02:16.032 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:02:11.321258+0000', 'last_change': '2024-09-12T02:02:11.321258+0000', 'last_active': '2024-09-12T02:02:11.308510+0000', 'last_peered': '2024-09-12T02:02:11.308510+0000', 'last_clean': '2024-09-12T02:02:11.308510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:02:11.321258+0000', 'last_undegraded': '2024-09-12T02:02:11.321258+0000', 'last_fullsized': '2024-09-12T02:02:11.321258+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_clean_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T02:02:16.032 INFO:tasks.ceph.ceph_manager.ceph:PG 14.e is not active+clean 2024-09-12T02:02:16.032 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:02:11.323444+0000', 'last_change': '2024-09-12T02:02:11.323444+0000', 'last_active': '2024-09-12T02:02:11.308510+0000', 'last_peered': '2024-09-12T02:02:11.308510+0000', 'last_clean': '2024-09-12T02:02:11.308510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:02:11.323444+0000', 'last_undegraded': '2024-09-12T02:02:11.323444+0000', 'last_fullsized': '2024-09-12T02:02:11.323444+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'last_clean_scrub_stamp': '2024-09-12T02:02:11.308510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T02:02:16.033 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T02:02:16.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.169+0000 7f372aae6640 1 Processor -- start 2024-09-12T02:02:16.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.169+0000 7f372aae6640 1 -- start start 2024-09-12T02:02:16.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.170+0000 7f372aae6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3724162060 0x7f37240b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:16.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.170+0000 7f372aae6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37240b64b0 0x7f37240b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:16.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.170+0000 7f372aae6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f372406d9f0 con 0x7f3724161c80 2024-09-12T02:02:16.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.170+0000 7f372aae6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f372406dcd0 con 0x7f37240b64b0 2024-09-12T02:02:16.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.170+0000 7f372aae6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f372406dfb0 con 0x7f3724162060 2024-09-12T02:02:16.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.170+0000 7f3729083640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37240b64b0 0x7f37240b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:16.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.170+0000 7f3729083640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37240b64b0 0x7f37240b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35174/0 (socket says 172.21.15.19:35174) 2024-09-12T02:02:16.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.170+0000 7f3729083640 1 -- 172.21.15.19:0/3082573551 learned_addr learned my addr 172.21.15.19:0/3082573551 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:16.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.170+0000 7f3723fff640 1 --2- 172.21.15.19:0/3082573551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3724162060 0x7f37240b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:16.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.170+0000 7f3729083640 1 -- 172.21.15.19:0/3082573551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3724162060 msgr2=0x7f37240b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:16.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.170+0000 7f3729083640 1 --2- 172.21.15.19:0/3082573551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3724162060 0x7f37240b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.170+0000 7f3729083640 1 -- 172.21.15.19:0/3082573551 >> v1:172.21.15.135:6789/0 conn(0x7f3724161c80 legacy=0x7f372406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:16.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.170+0000 7f3729083640 1 -- 172.21.15.19:0/3082573551 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37240d01f0 con 0x7f37240b64b0 2024-09-12T02:02:16.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.170+0000 7f3723fff640 1 --2- 172.21.15.19:0/3082573551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3724162060 0x7f37240b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:16.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.171+0000 7f3729083640 1 --2- 172.21.15.19:0/3082573551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37240b64b0 0x7f37240b6960 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f371c009e50 tx=0x7f371c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc87d88ac3172be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:16.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.171+0000 7f37237fe640 1 -- 172.21.15.19:0/3082573551 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c036070 con 0x7f37240b64b0 2024-09-12T02:02:16.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.171+0000 7f37237fe640 1 -- 172.21.15.19:0/3082573551 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f371c031600 con 0x7f37240b64b0 2024-09-12T02:02:16.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.171+0000 7f37237fe640 1 -- 172.21.15.19:0/3082573551 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c0319d0 con 0x7f37240b64b0 2024-09-12T02:02:16.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.171+0000 7f372aae6640 1 -- 172.21.15.19:0/3082573551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37240b64b0 msgr2=0x7f37240b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:16.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.171+0000 7f372aae6640 1 --2- 172.21.15.19:0/3082573551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37240b64b0 0x7f37240b6960 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f371c009e50 tx=0x7f371c02a710 comp rx=0 tx=0).stop 2024-09-12T02:02:16.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.172+0000 7f372aae6640 1 -- 172.21.15.19:0/3082573551 shutdown_connections 2024-09-12T02:02:16.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.172+0000 7f372aae6640 1 --2- 172.21.15.19:0/3082573551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37240b64b0 0x7f37240b6960 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.172+0000 7f372aae6640 1 --2- 172.21.15.19:0/3082573551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3724162060 0x7f37240b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.172+0000 7f372aae6640 1 -- 172.21.15.19:0/3082573551 >> 172.21.15.19:0/3082573551 conn(0x7f37240d44f0 msgr2=0x7f37240d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:16.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.172+0000 7f372aae6640 1 -- 172.21.15.19:0/3082573551 shutdown_connections 2024-09-12T02:02:16.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.172+0000 7f372aae6640 1 -- 172.21.15.19:0/3082573551 wait complete. 2024-09-12T02:02:16.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.173+0000 7f372aae6640 1 Processor -- start 2024-09-12T02:02:16.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.173+0000 7f372aae6640 1 -- start start 2024-09-12T02:02:16.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.174+0000 7f372aae6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37240b64b0 0x7f372414fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:16.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.174+0000 7f372aae6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3724161c80 0x7f372415ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:16.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.174+0000 7f372aae6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3724162060 0x7f372415f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:16.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.174+0000 7f372aae6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f37240cf1e0 con 0x7f37240b64b0 2024-09-12T02:02:16.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.174+0000 7f372aae6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f37240d2aa0 con 0x7f3724162060 2024-09-12T02:02:16.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.174+0000 7f372aae6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f37240cf360 con 0x7f3724161c80 2024-09-12T02:02:16.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.174+0000 7f3728882640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37240b64b0 0x7f372414fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:16.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.174+0000 7f3728882640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37240b64b0 0x7f372414fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35188/0 (socket says 172.21.15.19:35188) 2024-09-12T02:02:16.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.174+0000 7f3728882640 1 -- 172.21.15.19:0/4040671199 learned_addr learned my addr 172.21.15.19:0/4040671199 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:16.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.174+0000 7f3723fff640 1 --2- 172.21.15.19:0/4040671199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3724161c80 0x7f372415ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:16.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.174+0000 7f3729083640 1 --2- 172.21.15.19:0/4040671199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3724162060 0x7f372415f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:16.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.174+0000 7f3728882640 1 -- 172.21.15.19:0/4040671199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3724161c80 msgr2=0x7f372415ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:16.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.174+0000 7f3728882640 1 --2- 172.21.15.19:0/4040671199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3724161c80 0x7f372415ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.174+0000 7f3728882640 1 -- 172.21.15.19:0/4040671199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3724162060 msgr2=0x7f372415f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:16.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.174+0000 7f3728882640 1 --2- 172.21.15.19:0/4040671199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3724162060 0x7f372415f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.174+0000 7f3728882640 1 -- 172.21.15.19:0/4040671199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37240cc3a0 con 0x7f37240b64b0 2024-09-12T02:02:16.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.174+0000 7f3728882640 1 --2- 172.21.15.19:0/4040671199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37240b64b0 0x7f372414fa40 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f371800c400 tx=0x7f371800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:16.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.175+0000 7f37217fa640 1 -- 172.21.15.19:0/4040671199 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37180052d0 con 0x7f37240b64b0 2024-09-12T02:02:16.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.175+0000 7f37217fa640 1 -- 172.21.15.19:0/4040671199 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3718005490 con 0x7f37240b64b0 2024-09-12T02:02:16.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.175+0000 7f372aae6640 1 -- 172.21.15.19:0/4040671199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37240cc680 con 0x7f37240b64b0 2024-09-12T02:02:16.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.175+0000 7f37217fa640 1 -- 172.21.15.19:0/4040671199 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3718007260 con 0x7f37240b64b0 2024-09-12T02:02:16.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.175+0000 7f372aae6640 1 -- 172.21.15.19:0/4040671199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37240ccc40 con 0x7f37240b64b0 2024-09-12T02:02:16.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.176+0000 7f372aae6640 1 -- 172.21.15.19:0/4040671199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37240b5f70 con 0x7f37240b64b0 2024-09-12T02:02:16.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.176+0000 7f37217fa640 1 -- 172.21.15.19:0/4040671199 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3718007400 con 0x7f37240b64b0 2024-09-12T02:02:16.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.177+0000 7f37217fa640 1 --2- 172.21.15.19:0/4040671199 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f370806be30 0x7f370806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:16.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.177+0000 7f37217fa640 1 -- 172.21.15.19:0/4040671199 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6101+0+0 (secure 0 0 0) 0x7f371808a480 con 0x7f37240b64b0 2024-09-12T02:02:16.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.177+0000 7f3723fff640 1 --2- 172.21.15.19:0/4040671199 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f370806be30 0x7f370806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:16.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.177+0000 7f3723fff640 1 --2- 172.21.15.19:0/4040671199 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f370806be30 0x7f370806e2f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f37240b4300 tx=0x7f3710008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:16.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.181+0000 7f37217fa640 1 -- 172.21.15.19:0/4040671199 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3718058650 con 0x7f37240b64b0 2024-09-12T02:02:16.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.428+0000 7f372aae6640 1 -- 172.21.15.19:0/4040671199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f37240d2cf0 con 0x7f37240b64b0 2024-09-12T02:02:16.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.429+0000 7f37217fa640 1 -- 172.21.15.19:0/4040671199 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1561 (secure 0 0 0) 0x7f371805c950 con 0x7f37240b64b0 2024-09-12T02:02:16.428 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:16.428 INFO:teuthology.orchestra.run.smithi019.stdout:{"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":404,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":93,"num_osds":8,"num_up_osds":8,"osd_up_since":1726106143,"num_in_osds":8,"osd_in_since":1726106133,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":85},{"state_name":"creating+peering","count":12}],"num_pgs":97,"num_pools":3,"num_objects":20,"data_bytes":592618,"bytes_used":257273856,"bytes_avail":772836839424,"bytes_total":773094113280,"inactive_pgs_ratio":0.12371134012937546,"write_bytes_sec":2093,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":76,"btime":"2024-09-12T02:02:14:334033+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"d","status":"up:active","gid":6451}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2024-09-12T02:02:02.174726+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T02:02:16.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.431+0000 7f372aae6640 1 -- 172.21.15.19:0/4040671199 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f370806be30 msgr2=0x7f370806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:16.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.431+0000 7f372aae6640 1 --2- 172.21.15.19:0/4040671199 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f370806be30 0x7f370806e2f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f37240b4300 tx=0x7f3710008040 comp rx=0 tx=0).stop 2024-09-12T02:02:16.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.431+0000 7f372aae6640 1 -- 172.21.15.19:0/4040671199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37240b64b0 msgr2=0x7f372414fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:16.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.431+0000 7f372aae6640 1 --2- 172.21.15.19:0/4040671199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37240b64b0 0x7f372414fa40 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f371800c400 tx=0x7f371800c8c0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.431+0000 7f372aae6640 1 -- 172.21.15.19:0/4040671199 shutdown_connections 2024-09-12T02:02:16.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.431+0000 7f372aae6640 1 --2- 172.21.15.19:0/4040671199 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f370806be30 0x7f370806e2f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.431+0000 7f372aae6640 1 --2- 172.21.15.19:0/4040671199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3724162060 0x7f372415f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.431+0000 7f372aae6640 1 --2- 172.21.15.19:0/4040671199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3724161c80 0x7f372415ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.431+0000 7f372aae6640 1 --2- 172.21.15.19:0/4040671199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37240b64b0 0x7f372414fa40 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.431+0000 7f372aae6640 1 -- 172.21.15.19:0/4040671199 >> 172.21.15.19:0/4040671199 conn(0x7f37240d44f0 msgr2=0x7f37240b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:16.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.431+0000 7f372aae6640 1 -- 172.21.15.19:0/4040671199 shutdown_connections 2024-09-12T02:02:16.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.431+0000 7f372aae6640 1 -- 172.21.15.19:0/4040671199 wait complete. 2024-09-12T02:02:16.441 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T02:02:16.442 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:02:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.544+0000 7f8422568640 1 Processor -- start 2024-09-12T02:02:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.544+0000 7f8422568640 1 -- start start 2024-09-12T02:02:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.545+0000 7f8422568640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f841c09b140 0x7f841c169570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.545+0000 7f8422568640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f841c06cec0 con 0x7f841c15e5d0 2024-09-12T02:02:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.545+0000 7f8422568640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f841c06d1a0 con 0x7f841c06df60 2024-09-12T02:02:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.545+0000 7f8422568640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f841c06dad0 con 0x7f841c09b140 2024-09-12T02:02:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.545+0000 7f841bfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f841c15e5d0 0x7f841c0d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39114/0 (socket says 172.21.15.19:39114) 2024-09-12T02:02:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.545+0000 7f841bfff640 1 -- 172.21.15.19:0/840917972 learned_addr learned my addr 172.21.15.19:0/840917972 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.545+0000 7f8420b05640 1 --2- 172.21.15.19:0/840917972 >> v2:172.21.15.19:3300/0 conn(0x7f841c09b140 0x7f841c169570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.546+0000 7f841affd640 1 -- 172.21.15.19:0/840917972 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2699346411 0 0) 0x7f841c06cec0 con 0x7f841c15e5d0 2024-09-12T02:02:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.546+0000 7f841affd640 1 -- 172.21.15.19:0/840917972 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8404003520 con 0x7f841c15e5d0 2024-09-12T02:02:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.546+0000 7f8420b05640 1 -- 172.21.15.19:0/840917972 >> v1:172.21.15.135:6789/0 conn(0x7f841c06df60 legacy=0x7f841c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.546+0000 7f8420b05640 1 -- 172.21.15.19:0/840917972 >> v1:172.21.15.19:6789/0 conn(0x7f841c15e5d0 legacy=0x7f841c0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.546+0000 7f8420b05640 1 -- 172.21.15.19:0/840917972 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c06d480 con 0x7f841c09b140 2024-09-12T02:02:16.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.547+0000 7f8420b05640 1 --2- 172.21.15.19:0/840917972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f841c09b140 0x7f841c169570 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f8414009dc0 tx=0x7f841402a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387147dfc88723f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:16.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.547+0000 7f841affd640 1 -- 172.21.15.19:0/840917972 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414007740 con 0x7f841c09b140 2024-09-12T02:02:16.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.547+0000 7f841affd640 1 -- 172.21.15.19:0/840917972 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84140078e0 con 0x7f841c09b140 2024-09-12T02:02:16.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.547+0000 7f841affd640 1 -- 172.21.15.19:0/840917972 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414007cb0 con 0x7f841c09b140 2024-09-12T02:02:16.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.547+0000 7f8422568640 1 -- 172.21.15.19:0/840917972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f841c09b140 msgr2=0x7f841c169570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:16.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.547+0000 7f8422568640 1 --2- 172.21.15.19:0/840917972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f841c09b140 0x7f841c169570 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f8414009dc0 tx=0x7f841402a760 comp rx=0 tx=0).stop 2024-09-12T02:02:16.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.547+0000 7f8422568640 1 -- 172.21.15.19:0/840917972 shutdown_connections 2024-09-12T02:02:16.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.547+0000 7f8422568640 1 --2- 172.21.15.19:0/840917972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f841c09b140 0x7f841c169570 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.547+0000 7f8422568640 1 -- 172.21.15.19:0/840917972 >> 172.21.15.19:0/840917972 conn(0x7f841c0d23a0 msgr2=0x7f841c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:16.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.547+0000 7f8422568640 1 -- 172.21.15.19:0/840917972 shutdown_connections 2024-09-12T02:02:16.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.547+0000 7f8422568640 1 -- 172.21.15.19:0/840917972 wait complete. 2024-09-12T02:02:16.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.548+0000 7f8422568640 1 Processor -- start 2024-09-12T02:02:16.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.549+0000 7f8422568640 1 -- start start 2024-09-12T02:02:16.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.549+0000 7f8422568640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f841c06df60 0x7f841c0c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:16.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.549+0000 7f8422568640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f841c09b140 0x7f841c159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:16.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.549+0000 7f8422568640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f841c15e5d0 0x7f841c15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:16.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.549+0000 7f8422568640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f841c0d1980 con 0x7f841c15e5d0 2024-09-12T02:02:16.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.549+0000 7f8422568640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f841c0d1800 con 0x7f841c09b140 2024-09-12T02:02:16.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.549+0000 7f8422568640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f841c15e9b0 con 0x7f841c06df60 2024-09-12T02:02:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.549+0000 7f8420b05640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f841c15e5d0 0x7f841c15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.550+0000 7f8420b05640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f841c15e5d0 0x7f841c15a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35200/0 (socket says 172.21.15.19:35200) 2024-09-12T02:02:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.550+0000 7f8420b05640 1 -- 172.21.15.19:0/2228612871 learned_addr learned my addr 172.21.15.19:0/2228612871 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.550+0000 7f8420b05640 1 -- 172.21.15.19:0/2228612871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f841c06df60 msgr2=0x7f841c0c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.550+0000 7f8420b05640 1 --2- 172.21.15.19:0/2228612871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f841c06df60 0x7f841c0c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.550+0000 7f8420b05640 1 -- 172.21.15.19:0/2228612871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f841c09b140 msgr2=0x7f841c159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.550+0000 7f8420b05640 1 --2- 172.21.15.19:0/2228612871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f841c09b140 0x7f841c159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.550+0000 7f8420b05640 1 -- 172.21.15.19:0/2228612871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c15abb0 con 0x7f841c15e5d0 2024-09-12T02:02:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.550+0000 7f8420b05640 1 --2- 172.21.15.19:0/2228612871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f841c15e5d0 0x7f841c15a320 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f8414009ee0 tx=0x7f8414004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.550+0000 7f8418ff9640 1 -- 172.21.15.19:0/2228612871 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414040070 con 0x7f841c15e5d0 2024-09-12T02:02:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.550+0000 7f8418ff9640 1 -- 172.21.15.19:0/2228612871 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8414031bc0 con 0x7f841c15e5d0 2024-09-12T02:02:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.550+0000 7f8422568640 1 -- 172.21.15.19:0/2228612871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841c0c6010 con 0x7f841c15e5d0 2024-09-12T02:02:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.550+0000 7f8418ff9640 1 -- 172.21.15.19:0/2228612871 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414009450 con 0x7f841c15e5d0 2024-09-12T02:02:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.550+0000 7f8422568640 1 -- 172.21.15.19:0/2228612871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f841c0c8d60 con 0x7f841c15e5d0 2024-09-12T02:02:16.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.551+0000 7f8422568640 1 -- 172.21.15.19:0/2228612871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f841c09aa30 con 0x7f841c15e5d0 2024-09-12T02:02:16.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.552+0000 7f8418ff9640 1 -- 172.21.15.19:0/2228612871 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8414039040 con 0x7f841c15e5d0 2024-09-12T02:02:16.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.552+0000 7f8418ff9640 1 --2- 172.21.15.19:0/2228612871 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f840806be30 0x7f840806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:16.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.552+0000 7f8418ff9640 1 -- 172.21.15.19:0/2228612871 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6101+0+0 (secure 0 0 0) 0x7f84140ac370 con 0x7f841c15e5d0 2024-09-12T02:02:16.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.552+0000 7f841bfff640 1 --2- 172.21.15.19:0/2228612871 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f840806be30 0x7f840806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:16.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.553+0000 7f841bfff640 1 --2- 172.21.15.19:0/2228612871 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f840806be30 0x7f840806e2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f840c000f60 tx=0x7f840c0078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:16.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.556+0000 7f8418ff9640 1 -- 172.21.15.19:0/2228612871 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f841407acb0 con 0x7f841c15e5d0 2024-09-12T02:02:16.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.728+0000 7f8422568640 1 -- 172.21.15.19:0/2228612871 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f841c0b8320 con 0x7f840806be30 2024-09-12T02:02:16.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.735+0000 7f8418ff9640 1 -- 172.21.15.19:0/2228612871 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251047 (secure 0 0 0) 0x7f841c0b8320 con 0x7f840806be30 2024-09-12T02:02:16.737 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:16.738 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T02:02:16.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.738+0000 7f8422568640 1 -- 172.21.15.19:0/2228612871 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f840806be30 msgr2=0x7f840806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:16.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.738+0000 7f8422568640 1 --2- 172.21.15.19:0/2228612871 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f840806be30 0x7f840806e2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f840c000f60 tx=0x7f840c0078f0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.738+0000 7f8422568640 1 -- 172.21.15.19:0/2228612871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f841c15e5d0 msgr2=0x7f841c15a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:16.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.738+0000 7f8422568640 1 --2- 172.21.15.19:0/2228612871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f841c15e5d0 0x7f841c15a320 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f8414009ee0 tx=0x7f8414004a40 comp rx=0 tx=0).stop 2024-09-12T02:02:16.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.738+0000 7f8422568640 1 -- 172.21.15.19:0/2228612871 shutdown_connections 2024-09-12T02:02:16.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.738+0000 7f8422568640 1 --2- 172.21.15.19:0/2228612871 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f840806be30 0x7f840806e2f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.738+0000 7f8422568640 1 --2- 172.21.15.19:0/2228612871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f841c15e5d0 0x7f841c15a320 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.738+0000 7f8422568640 1 --2- 172.21.15.19:0/2228612871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f841c09b140 0x7f841c159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.738+0000 7f8422568640 1 --2- 172.21.15.19:0/2228612871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f841c06df60 0x7f841c0c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:16.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.738+0000 7f8422568640 1 -- 172.21.15.19:0/2228612871 >> 172.21.15.19:0/2228612871 conn(0x7f841c0d23a0 msgr2=0x7f841c1573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:16.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.738+0000 7f8422568640 1 -- 172.21.15.19:0/2228612871 shutdown_connections 2024-09-12T02:02:16.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:16.738+0000 7f8422568640 1 -- 172.21.15.19:0/2228612871 wait complete. 2024-09-12T02:02:16.749 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-12T02:02:16.177648+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592618,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":198,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251244,"kb_used_data":10040,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754723476,"statfs":{"total":773094113280,"available":772836839424,"internally_reserved":0,"allocated":10280960,"data_stored":5376849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.868895"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.339480+0000","last_change":"2024-09-12T02:02:12.332361+0000","last_active":"2024-09-12T02:02:12.339480+0000","last_peered":"2024-09-12T02:02:12.339480+0000","last_clean":"2024-09-12T02:02:12.339480+0000","last_became_active":"2024-09-12T02:02:12.332101+0000","last_became_peered":"2024-09-12T02:02:12.332101+0000","last_unstale":"2024-09-12T02:02:12.339480+0000","last_undegraded":"2024-09-12T02:02:12.339480+0000","last_fullsized":"2024-09-12T02:02:12.339480+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:32.854191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340632+0000","last_change":"2024-09-12T02:02:12.338898+0000","last_active":"2024-09-12T02:02:13.340632+0000","last_peered":"2024-09-12T02:02:13.340632+0000","last_clean":"2024-09-12T02:02:13.340632+0000","last_became_active":"2024-09-12T02:02:12.338509+0000","last_became_peered":"2024-09-12T02:02:12.338509+0000","last_unstale":"2024-09-12T02:02:13.340632+0000","last_undegraded":"2024-09-12T02:02:13.340632+0000","last_fullsized":"2024-09-12T02:02:13.340632+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:55.080145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.351384+0000","last_change":"2024-09-12T02:02:12.348813+0000","last_active":"2024-09-12T02:02:12.351384+0000","last_peered":"2024-09-12T02:02:12.351384+0000","last_clean":"2024-09-12T02:02:12.351384+0000","last_became_active":"2024-09-12T02:02:12.348446+0000","last_became_peered":"2024-09-12T02:02:12.348446+0000","last_unstale":"2024-09-12T02:02:12.351384+0000","last_undegraded":"2024-09-12T02:02:12.351384+0000","last_fullsized":"2024-09-12T02:02:12.351384+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:13.655779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.337680+0000","last_change":"2024-09-12T02:02:12.336248+0000","last_active":"2024-09-12T02:02:12.337680+0000","last_peered":"2024-09-12T02:02:12.337680+0000","last_clean":"2024-09-12T02:02:12.337680+0000","last_became_active":"2024-09-12T02:02:12.335952+0000","last_became_peered":"2024-09-12T02:02:12.335952+0000","last_unstale":"2024-09-12T02:02:12.337680+0000","last_undegraded":"2024-09-12T02:02:12.337680+0000","last_fullsized":"2024-09-12T02:02:12.337680+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:28.825819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.322680+0000","last_change":"2024-09-12T02:02:11.322680+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.322680+0000","last_undegraded":"2024-09-12T02:02:11.322680+0000","last_fullsized":"2024-09-12T02:02:11.322680+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.342680+0000","last_change":"2024-09-12T02:02:12.338436+0000","last_active":"2024-09-12T02:02:12.342680+0000","last_peered":"2024-09-12T02:02:12.342680+0000","last_clean":"2024-09-12T02:02:12.342680+0000","last_became_active":"2024-09-12T02:02:12.338088+0000","last_became_peered":"2024-09-12T02:02:12.338088+0000","last_unstale":"2024-09-12T02:02:12.342680+0000","last_undegraded":"2024-09-12T02:02:12.342680+0000","last_fullsized":"2024-09-12T02:02:12.342680+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:03.708954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412540+0000","last_change":"2024-09-12T02:02:12.340218+0000","last_active":"2024-09-12T02:02:13.412540+0000","last_peered":"2024-09-12T02:02:13.412540+0000","last_clean":"2024-09-12T02:02:13.412540+0000","last_became_active":"2024-09-12T02:02:12.339861+0000","last_became_peered":"2024-09-12T02:02:12.339861+0000","last_unstale":"2024-09-12T02:02:13.412540+0000","last_undegraded":"2024-09-12T02:02:13.412540+0000","last_fullsized":"2024-09-12T02:02:13.412540+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:51.659882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336910+0000","last_change":"2024-09-12T02:02:12.333340+0000","last_active":"2024-09-12T02:02:12.336910+0000","last_peered":"2024-09-12T02:02:12.336910+0000","last_clean":"2024-09-12T02:02:12.336910+0000","last_became_active":"2024-09-12T02:02:12.333067+0000","last_became_peered":"2024-09-12T02:02:12.333067+0000","last_unstale":"2024-09-12T02:02:12.336910+0000","last_undegraded":"2024-09-12T02:02:12.336910+0000","last_fullsized":"2024-09-12T02:02:12.336910+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:42.119881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.324473+0000","last_change":"2024-09-12T02:02:11.324473+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.324473+0000","last_undegraded":"2024-09-12T02:02:11.324473+0000","last_fullsized":"2024-09-12T02:02:11.324473+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.329564+0000","last_change":"2024-09-12T02:02:12.328431+0000","last_active":"2024-09-12T02:02:12.329564+0000","last_peered":"2024-09-12T02:02:12.329564+0000","last_clean":"2024-09-12T02:02:12.329564+0000","last_became_active":"2024-09-12T02:02:12.328148+0000","last_became_peered":"2024-09-12T02:02:12.328148+0000","last_unstale":"2024-09-12T02:02:12.329564+0000","last_undegraded":"2024-09-12T02:02:12.329564+0000","last_fullsized":"2024-09-12T02:02:12.329564+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:05.794542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.322247+0000","last_change":"2024-09-12T02:02:11.322247+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.322247+0000","last_undegraded":"2024-09-12T02:02:11.322247+0000","last_fullsized":"2024-09-12T02:02:11.322247+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.328850+0000","last_change":"2024-09-12T02:02:12.327134+0000","last_active":"2024-09-12T02:02:12.328850+0000","last_peered":"2024-09-12T02:02:12.328850+0000","last_clean":"2024-09-12T02:02:12.328850+0000","last_became_active":"2024-09-12T02:02:12.326826+0000","last_became_peered":"2024-09-12T02:02:12.326826+0000","last_unstale":"2024-09-12T02:02:12.328850+0000","last_undegraded":"2024-09-12T02:02:12.328850+0000","last_fullsized":"2024-09-12T02:02:12.328850+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:21.234445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336836+0000","last_change":"2024-09-12T02:02:12.331964+0000","last_active":"2024-09-12T02:02:12.336836+0000","last_peered":"2024-09-12T02:02:12.336836+0000","last_clean":"2024-09-12T02:02:12.336836+0000","last_became_active":"2024-09-12T02:02:12.331686+0000","last_became_peered":"2024-09-12T02:02:12.331686+0000","last_unstale":"2024-09-12T02:02:12.336836+0000","last_undegraded":"2024-09-12T02:02:12.336836+0000","last_fullsized":"2024-09-12T02:02:12.336836+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:31.132531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323252+0000","last_change":"2024-09-12T02:02:11.323252+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323252+0000","last_undegraded":"2024-09-12T02:02:11.323252+0000","last_fullsized":"2024-09-12T02:02:11.323252+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.340755+0000","last_change":"2024-09-12T02:02:12.337578+0000","last_active":"2024-09-12T02:02:12.340755+0000","last_peered":"2024-09-12T02:02:12.340755+0000","last_clean":"2024-09-12T02:02:12.340755+0000","last_became_active":"2024-09-12T02:02:12.337335+0000","last_became_peered":"2024-09-12T02:02:12.337335+0000","last_unstale":"2024-09-12T02:02:12.340755+0000","last_undegraded":"2024-09-12T02:02:12.340755+0000","last_fullsized":"2024-09-12T02:02:12.340755+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:59.464045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335356+0000","last_change":"2024-09-12T02:02:12.330650+0000","last_active":"2024-09-12T02:02:12.335356+0000","last_peered":"2024-09-12T02:02:12.335356+0000","last_clean":"2024-09-12T02:02:12.335356+0000","last_became_active":"2024-09-12T02:02:12.330347+0000","last_became_peered":"2024-09-12T02:02:12.330347+0000","last_unstale":"2024-09-12T02:02:12.335356+0000","last_undegraded":"2024-09-12T02:02:12.335356+0000","last_fullsized":"2024-09-12T02:02:12.335356+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.801762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335304+0000","last_change":"2024-09-12T02:02:12.329326+0000","last_active":"2024-09-12T02:02:12.335304+0000","last_peered":"2024-09-12T02:02:12.335304+0000","last_clean":"2024-09-12T02:02:12.335304+0000","last_became_active":"2024-09-12T02:02:12.329063+0000","last_became_peered":"2024-09-12T02:02:12.329063+0000","last_unstale":"2024-09-12T02:02:12.335304+0000","last_undegraded":"2024-09-12T02:02:12.335304+0000","last_fullsized":"2024-09-12T02:02:12.335304+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:10.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.340436+0000","last_change":"2024-09-12T02:02:12.333053+0000","last_active":"2024-09-12T02:02:12.340436+0000","last_peered":"2024-09-12T02:02:12.340436+0000","last_clean":"2024-09-12T02:02:12.340436+0000","last_became_active":"2024-09-12T02:02:12.332788+0000","last_became_peered":"2024-09-12T02:02:12.332788+0000","last_unstale":"2024-09-12T02:02:12.340436+0000","last_undegraded":"2024-09-12T02:02:12.340436+0000","last_fullsized":"2024-09-12T02:02:12.340436+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:42.844428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.321134+0000","last_change":"2024-09-12T02:02:11.321134+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.321134+0000","last_undegraded":"2024-09-12T02:02:11.321134+0000","last_fullsized":"2024-09-12T02:02:11.321134+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336130+0000","last_change":"2024-09-12T02:02:12.326448+0000","last_active":"2024-09-12T02:02:12.336130+0000","last_peered":"2024-09-12T02:02:12.336130+0000","last_clean":"2024-09-12T02:02:12.336130+0000","last_became_active":"2024-09-12T02:02:12.326137+0000","last_became_peered":"2024-09-12T02:02:12.326137+0000","last_unstale":"2024-09-12T02:02:12.336130+0000","last_undegraded":"2024-09-12T02:02:12.336130+0000","last_fullsized":"2024-09-12T02:02:12.336130+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:06.139652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323540+0000","last_change":"2024-09-12T02:02:11.323540+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323540+0000","last_undegraded":"2024-09-12T02:02:11.323540+0000","last_fullsized":"2024-09-12T02:02:11.323540+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.322810+0000","last_change":"2024-09-12T02:02:11.322810+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.322810+0000","last_undegraded":"2024-09-12T02:02:11.322810+0000","last_fullsized":"2024-09-12T02:02:11.322810+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323252+0000","last_change":"2024-09-12T02:02:12.339608+0000","last_active":"2024-09-12T02:02:13.323252+0000","last_peered":"2024-09-12T02:02:13.323252+0000","last_clean":"2024-09-12T02:02:13.323252+0000","last_became_active":"2024-09-12T02:02:12.339051+0000","last_became_peered":"2024-09-12T02:02:12.339051+0000","last_unstale":"2024-09-12T02:02:13.323252+0000","last_undegraded":"2024-09-12T02:02:13.323252+0000","last_fullsized":"2024-09-12T02:02:13.323252+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:51.986401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.347328+0000","last_change":"2024-09-12T02:02:12.344797+0000","last_active":"2024-09-12T02:02:12.347328+0000","last_peered":"2024-09-12T02:02:12.347328+0000","last_clean":"2024-09-12T02:02:12.347328+0000","last_became_active":"2024-09-12T02:02:12.344507+0000","last_became_peered":"2024-09-12T02:02:12.344507+0000","last_unstale":"2024-09-12T02:02:12.347328+0000","last_undegraded":"2024-09-12T02:02:12.347328+0000","last_fullsized":"2024-09-12T02:02:12.347328+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:48.125756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340618+0000","last_change":"2024-09-12T02:02:12.337746+0000","last_active":"2024-09-12T02:02:13.340618+0000","last_peered":"2024-09-12T02:02:13.340618+0000","last_clean":"2024-09-12T02:02:13.340618+0000","last_became_active":"2024-09-12T02:02:12.337473+0000","last_became_peered":"2024-09-12T02:02:12.337473+0000","last_unstale":"2024-09-12T02:02:13.340618+0000","last_undegraded":"2024-09-12T02:02:13.340618+0000","last_fullsized":"2024-09-12T02:02:13.340618+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:25.348127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323897+0000","last_change":"2024-09-12T02:02:11.323897+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323897+0000","last_undegraded":"2024-09-12T02:02:11.323897+0000","last_fullsized":"2024-09-12T02:02:11.323897+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336967+0000","last_change":"2024-09-12T02:02:12.331869+0000","last_active":"2024-09-12T02:02:12.336967+0000","last_peered":"2024-09-12T02:02:12.336967+0000","last_clean":"2024-09-12T02:02:12.336967+0000","last_became_active":"2024-09-12T02:02:12.331585+0000","last_became_peered":"2024-09-12T02:02:12.331585+0000","last_unstale":"2024-09-12T02:02:12.336967+0000","last_undegraded":"2024-09-12T02:02:12.336967+0000","last_fullsized":"2024-09-12T02:02:12.336967+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:26.480661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.353526+0000","last_change":"2024-09-12T02:02:12.349310+0000","last_active":"2024-09-12T02:02:12.353526+0000","last_peered":"2024-09-12T02:02:12.353526+0000","last_clean":"2024-09-12T02:02:12.353526+0000","last_became_active":"2024-09-12T02:02:12.349030+0000","last_became_peered":"2024-09-12T02:02:12.349030+0000","last_unstale":"2024-09-12T02:02:12.353526+0000","last_undegraded":"2024-09-12T02:02:12.353526+0000","last_fullsized":"2024-09-12T02:02:12.353526+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:23.429351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412462+0000","last_change":"2024-09-12T02:02:12.340402+0000","last_active":"2024-09-12T02:02:13.412462+0000","last_peered":"2024-09-12T02:02:13.412462+0000","last_clean":"2024-09-12T02:02:13.412462+0000","last_became_active":"2024-09-12T02:02:12.340024+0000","last_became_peered":"2024-09-12T02:02:12.340024+0000","last_unstale":"2024-09-12T02:02:13.412462+0000","last_undegraded":"2024-09-12T02:02:13.412462+0000","last_fullsized":"2024-09-12T02:02:13.412462+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:24.518549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.322132+0000","last_change":"2024-09-12T02:02:11.322132+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.322132+0000","last_undegraded":"2024-09-12T02:02:11.322132+0000","last_fullsized":"2024-09-12T02:02:11.322132+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340407+0000","last_change":"2024-09-12T02:02:12.343209+0000","last_active":"2024-09-12T02:02:13.340407+0000","last_peered":"2024-09-12T02:02:13.340407+0000","last_clean":"2024-09-12T02:02:13.340407+0000","last_became_active":"2024-09-12T02:02:12.342918+0000","last_became_peered":"2024-09-12T02:02:12.342918+0000","last_unstale":"2024-09-12T02:02:13.340407+0000","last_undegraded":"2024-09-12T02:02:13.340407+0000","last_fullsized":"2024-09-12T02:02:13.340407+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:20.594709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335337+0000","last_change":"2024-09-12T02:02:12.327747+0000","last_active":"2024-09-12T02:02:12.335337+0000","last_peered":"2024-09-12T02:02:12.335337+0000","last_clean":"2024-09-12T02:02:12.335337+0000","last_became_active":"2024-09-12T02:02:12.327465+0000","last_became_peered":"2024-09-12T02:02:12.327465+0000","last_unstale":"2024-09-12T02:02:12.335337+0000","last_undegraded":"2024-09-12T02:02:12.335337+0000","last_fullsized":"2024-09-12T02:02:12.335337+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:51.659882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.353469+0000","last_change":"2024-09-12T02:02:12.351000+0000","last_active":"2024-09-12T02:02:12.353469+0000","last_peered":"2024-09-12T02:02:12.353469+0000","last_clean":"2024-09-12T02:02:12.353469+0000","last_became_active":"2024-09-12T02:02:12.350573+0000","last_became_peered":"2024-09-12T02:02:12.350573+0000","last_unstale":"2024-09-12T02:02:12.353469+0000","last_undegraded":"2024-09-12T02:02:12.353469+0000","last_fullsized":"2024-09-12T02:02:12.353469+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:52.339672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"92'4","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.324080+0000","last_change":"2024-09-12T02:02:11.333328+0000","last_active":"2024-09-12T02:02:13.324080+0000","last_peered":"2024-09-12T02:02:13.324080+0000","last_clean":"2024-09-12T02:02:13.324080+0000","last_became_active":"2024-09-12T02:02:11.333075+0000","last_became_peered":"2024-09-12T02:02:11.333075+0000","last_unstale":"2024-09-12T02:02:13.324080+0000","last_undegraded":"2024-09-12T02:02:13.324080+0000","last_fullsized":"2024-09-12T02:02:13.324080+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:36.748542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335906+0000","last_change":"2024-09-12T02:02:12.330259+0000","last_active":"2024-09-12T02:02:12.335906+0000","last_peered":"2024-09-12T02:02:12.335906+0000","last_clean":"2024-09-12T02:02:12.335906+0000","last_became_active":"2024-09-12T02:02:12.329970+0000","last_became_peered":"2024-09-12T02:02:12.329970+0000","last_unstale":"2024-09-12T02:02:12.335906+0000","last_undegraded":"2024-09-12T02:02:12.335906+0000","last_fullsized":"2024-09-12T02:02:12.335906+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:52.606535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.333999+0000","last_change":"2024-09-12T02:02:11.329594+0000","last_active":"2024-09-12T02:02:11.333999+0000","last_peered":"2024-09-12T02:02:11.333999+0000","last_clean":"2024-09-12T02:02:11.333999+0000","last_became_active":"2024-09-12T02:02:11.329256+0000","last_became_peered":"2024-09-12T02:02:11.329256+0000","last_unstale":"2024-09-12T02:02:11.333999+0000","last_undegraded":"2024-09-12T02:02:11.333999+0000","last_fullsized":"2024-09-12T02:02:11.333999+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:54.686751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412555+0000","last_change":"2024-09-12T02:02:12.337973+0000","last_active":"2024-09-12T02:02:13.412555+0000","last_peered":"2024-09-12T02:02:13.412555+0000","last_clean":"2024-09-12T02:02:13.412555+0000","last_became_active":"2024-09-12T02:02:12.337659+0000","last_became_peered":"2024-09-12T02:02:12.337659+0000","last_unstale":"2024-09-12T02:02:13.412555+0000","last_undegraded":"2024-09-12T02:02:13.412555+0000","last_fullsized":"2024-09-12T02:02:13.412555+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:10.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412473+0000","last_change":"2024-09-12T02:02:11.333138+0000","last_active":"2024-09-12T02:02:13.412473+0000","last_peered":"2024-09-12T02:02:13.412473+0000","last_clean":"2024-09-12T02:02:13.412473+0000","last_became_active":"2024-09-12T02:02:11.332790+0000","last_became_peered":"2024-09-12T02:02:11.332790+0000","last_unstale":"2024-09-12T02:02:13.412473+0000","last_undegraded":"2024-09-12T02:02:13.412473+0000","last_fullsized":"2024-09-12T02:02:13.412473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:57.281562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336328+0000","last_change":"2024-09-12T02:02:12.333076+0000","last_active":"2024-09-12T02:02:12.336328+0000","last_peered":"2024-09-12T02:02:12.336328+0000","last_clean":"2024-09-12T02:02:12.336328+0000","last_became_active":"2024-09-12T02:02:12.332851+0000","last_became_peered":"2024-09-12T02:02:12.332851+0000","last_unstale":"2024-09-12T02:02:12.336328+0000","last_undegraded":"2024-09-12T02:02:12.336328+0000","last_fullsized":"2024-09-12T02:02:12.336328+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:38.281610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323549+0000","last_change":"2024-09-12T02:02:11.332340+0000","last_active":"2024-09-12T02:02:13.323549+0000","last_peered":"2024-09-12T02:02:13.323549+0000","last_clean":"2024-09-12T02:02:13.323549+0000","last_became_active":"2024-09-12T02:02:11.332101+0000","last_became_peered":"2024-09-12T02:02:11.332101+0000","last_unstale":"2024-09-12T02:02:13.323549+0000","last_undegraded":"2024-09-12T02:02:13.323549+0000","last_fullsized":"2024-09-12T02:02:13.323549+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.886557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.332571+0000","last_change":"2024-09-12T02:02:12.325486+0000","last_active":"2024-09-12T02:02:12.332571+0000","last_peered":"2024-09-12T02:02:12.332571+0000","last_clean":"2024-09-12T02:02:12.332571+0000","last_became_active":"2024-09-12T02:02:12.325177+0000","last_became_peered":"2024-09-12T02:02:12.325177+0000","last_unstale":"2024-09-12T02:02:12.332571+0000","last_undegraded":"2024-09-12T02:02:12.332571+0000","last_fullsized":"2024-09-12T02:02:12.332571+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:28.518234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.337143+0000","last_change":"2024-09-12T02:02:11.333899+0000","last_active":"2024-09-12T02:02:11.337143+0000","last_peered":"2024-09-12T02:02:11.337143+0000","last_clean":"2024-09-12T02:02:11.337143+0000","last_became_active":"2024-09-12T02:02:11.333612+0000","last_became_peered":"2024-09-12T02:02:11.333612+0000","last_unstale":"2024-09-12T02:02:11.337143+0000","last_undegraded":"2024-09-12T02:02:11.337143+0000","last_fullsized":"2024-09-12T02:02:11.337143+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:16.109597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.322959+0000","last_change":"2024-09-12T02:02:12.339670+0000","last_active":"2024-09-12T02:02:13.322959+0000","last_peered":"2024-09-12T02:02:13.322959+0000","last_clean":"2024-09-12T02:02:13.322959+0000","last_became_active":"2024-09-12T02:02:12.339401+0000","last_became_peered":"2024-09-12T02:02:12.339401+0000","last_unstale":"2024-09-12T02:02:13.322959+0000","last_undegraded":"2024-09-12T02:02:13.322959+0000","last_fullsized":"2024-09-12T02:02:13.322959+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:39.396515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"92'1","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.353388+0000","last_change":"2024-09-12T02:02:11.336467+0000","last_active":"2024-09-12T02:02:12.353388+0000","last_peered":"2024-09-12T02:02:12.353388+0000","last_clean":"2024-09-12T02:02:12.353388+0000","last_became_active":"2024-09-12T02:02:11.336029+0000","last_became_peered":"2024-09-12T02:02:11.336029+0000","last_unstale":"2024-09-12T02:02:12.353388+0000","last_undegraded":"2024-09-12T02:02:12.353388+0000","last_fullsized":"2024-09-12T02:02:12.353388+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:33.725746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.342775+0000","last_change":"2024-09-12T02:02:12.338526+0000","last_active":"2024-09-12T02:02:12.342775+0000","last_peered":"2024-09-12T02:02:12.342775+0000","last_clean":"2024-09-12T02:02:12.342775+0000","last_became_active":"2024-09-12T02:02:12.338174+0000","last_became_peered":"2024-09-12T02:02:12.338174+0000","last_unstale":"2024-09-12T02:02:12.342775+0000","last_undegraded":"2024-09-12T02:02:12.342775+0000","last_fullsized":"2024-09-12T02:02:12.342775+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.054924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.317838+0000","last_change":"2024-09-12T02:02:11.326331+0000","last_active":"2024-09-12T02:02:12.317838+0000","last_peered":"2024-09-12T02:02:12.317838+0000","last_clean":"2024-09-12T02:02:12.317838+0000","last_became_active":"2024-09-12T02:02:11.326051+0000","last_became_peered":"2024-09-12T02:02:11.326051+0000","last_unstale":"2024-09-12T02:02:12.317838+0000","last_undegraded":"2024-09-12T02:02:12.317838+0000","last_fullsized":"2024-09-12T02:02:12.317838+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:14.638980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.337500+0000","last_change":"2024-09-12T02:02:12.335645+0000","last_active":"2024-09-12T02:02:12.337500+0000","last_peered":"2024-09-12T02:02:12.337500+0000","last_clean":"2024-09-12T02:02:12.337500+0000","last_became_active":"2024-09-12T02:02:12.335371+0000","last_became_peered":"2024-09-12T02:02:12.335371+0000","last_unstale":"2024-09-12T02:02:12.337500+0000","last_undegraded":"2024-09-12T02:02:12.337500+0000","last_fullsized":"2024-09-12T02:02:12.337500+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:03.083808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412357+0000","last_change":"2024-09-12T02:02:11.334790+0000","last_active":"2024-09-12T02:02:13.412357+0000","last_peered":"2024-09-12T02:02:13.412357+0000","last_clean":"2024-09-12T02:02:13.412357+0000","last_became_active":"2024-09-12T02:02:11.334505+0000","last_became_peered":"2024-09-12T02:02:11.334505+0000","last_unstale":"2024-09-12T02:02:13.412357+0000","last_undegraded":"2024-09-12T02:02:13.412357+0000","last_fullsized":"2024-09-12T02:02:13.412357+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:24.342640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323644+0000","last_change":"2024-09-12T02:02:11.323644+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323644+0000","last_undegraded":"2024-09-12T02:02:11.323644+0000","last_fullsized":"2024-09-12T02:02:11.323644+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340682+0000","last_change":"2024-09-12T02:02:11.333595+0000","last_active":"2024-09-12T02:02:13.340682+0000","last_peered":"2024-09-12T02:02:13.340682+0000","last_clean":"2024-09-12T02:02:13.340682+0000","last_became_active":"2024-09-12T02:02:11.333243+0000","last_became_peered":"2024-09-12T02:02:11.333243+0000","last_unstale":"2024-09-12T02:02:13.340682+0000","last_undegraded":"2024-09-12T02:02:13.340682+0000","last_fullsized":"2024-09-12T02:02:13.340682+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:12.239695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412571+0000","last_change":"2024-09-12T02:02:12.350425+0000","last_active":"2024-09-12T02:02:13.412571+0000","last_peered":"2024-09-12T02:02:13.412571+0000","last_clean":"2024-09-12T02:02:13.412571+0000","last_became_active":"2024-09-12T02:02:12.350139+0000","last_became_peered":"2024-09-12T02:02:12.350139+0000","last_unstale":"2024-09-12T02:02:13.412571+0000","last_undegraded":"2024-09-12T02:02:13.412571+0000","last_fullsized":"2024-09-12T02:02:13.412571+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:52.606535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.318431+0000","last_change":"2024-09-12T02:02:11.333135+0000","last_active":"2024-09-12T02:02:12.318431+0000","last_peered":"2024-09-12T02:02:12.318431+0000","last_clean":"2024-09-12T02:02:12.318431+0000","last_became_active":"2024-09-12T02:02:11.332827+0000","last_became_peered":"2024-09-12T02:02:11.332827+0000","last_unstale":"2024-09-12T02:02:12.318431+0000","last_undegraded":"2024-09-12T02:02:12.318431+0000","last_fullsized":"2024-09-12T02:02:12.318431+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:47.007799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.340461+0000","last_change":"2024-09-12T02:02:12.334298+0000","last_active":"2024-09-12T02:02:12.340461+0000","last_peered":"2024-09-12T02:02:12.340461+0000","last_clean":"2024-09-12T02:02:12.340461+0000","last_became_active":"2024-09-12T02:02:12.334014+0000","last_became_peered":"2024-09-12T02:02:12.334014+0000","last_unstale":"2024-09-12T02:02:12.340461+0000","last_undegraded":"2024-09-12T02:02:12.340461+0000","last_fullsized":"2024-09-12T02:02:12.340461+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:17.156403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.337891+0000","last_change":"2024-09-12T02:02:11.335601+0000","last_active":"2024-09-12T02:02:11.337891+0000","last_peered":"2024-09-12T02:02:11.337891+0000","last_clean":"2024-09-12T02:02:11.337891+0000","last_became_active":"2024-09-12T02:02:11.335331+0000","last_became_peered":"2024-09-12T02:02:11.335331+0000","last_unstale":"2024-09-12T02:02:11.337891+0000","last_undegraded":"2024-09-12T02:02:11.337891+0000","last_fullsized":"2024-09-12T02:02:11.337891+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:08.075197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.340936+0000","last_change":"2024-09-12T02:02:12.339385+0000","last_active":"2024-09-12T02:02:12.340936+0000","last_peered":"2024-09-12T02:02:12.340936+0000","last_clean":"2024-09-12T02:02:12.340936+0000","last_became_active":"2024-09-12T02:02:12.339076+0000","last_became_peered":"2024-09-12T02:02:12.339076+0000","last_unstale":"2024-09-12T02:02:12.340936+0000","last_undegraded":"2024-09-12T02:02:12.340936+0000","last_fullsized":"2024-09-12T02:02:12.340936+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.305827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"92'6","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.356286+0000","last_change":"2024-09-12T02:02:11.332578+0000","last_active":"2024-09-12T02:02:12.356286+0000","last_peered":"2024-09-12T02:02:12.356286+0000","last_clean":"2024-09-12T02:02:12.356286+0000","last_became_active":"2024-09-12T02:02:11.332190+0000","last_became_peered":"2024-09-12T02:02:11.332190+0000","last_unstale":"2024-09-12T02:02:12.356286+0000","last_undegraded":"2024-09-12T02:02:12.356286+0000","last_fullsized":"2024-09-12T02:02:12.356286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:48.070182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336884+0000","last_change":"2024-09-12T02:02:12.332687+0000","last_active":"2024-09-12T02:02:12.336884+0000","last_peered":"2024-09-12T02:02:12.336884+0000","last_clean":"2024-09-12T02:02:12.336884+0000","last_became_active":"2024-09-12T02:02:12.332386+0000","last_became_peered":"2024-09-12T02:02:12.332386+0000","last_unstale":"2024-09-12T02:02:12.336884+0000","last_undegraded":"2024-09-12T02:02:12.336884+0000","last_fullsized":"2024-09-12T02:02:12.336884+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:26.580075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412589+0000","last_change":"2024-09-12T02:02:11.335419+0000","last_active":"2024-09-12T02:02:13.412589+0000","last_peered":"2024-09-12T02:02:13.412589+0000","last_clean":"2024-09-12T02:02:13.412589+0000","last_became_active":"2024-09-12T02:02:11.335199+0000","last_became_peered":"2024-09-12T02:02:11.335199+0000","last_unstale":"2024-09-12T02:02:13.412589+0000","last_undegraded":"2024-09-12T02:02:13.412589+0000","last_fullsized":"2024-09-12T02:02:13.412589+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:19.589222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.321258+0000","last_change":"2024-09-12T02:02:11.321258+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.321258+0000","last_undegraded":"2024-09-12T02:02:11.321258+0000","last_fullsized":"2024-09-12T02:02:11.321258+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.322792+0000","last_change":"2024-09-12T02:02:11.334793+0000","last_active":"2024-09-12T02:02:12.322792+0000","last_peered":"2024-09-12T02:02:12.322792+0000","last_clean":"2024-09-12T02:02:12.322792+0000","last_became_active":"2024-09-12T02:02:11.334335+0000","last_became_peered":"2024-09-12T02:02:11.334335+0000","last_unstale":"2024-09-12T02:02:12.322792+0000","last_undegraded":"2024-09-12T02:02:12.322792+0000","last_fullsized":"2024-09-12T02:02:12.322792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:34.830322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335855+0000","last_change":"2024-09-12T02:02:12.329549+0000","last_active":"2024-09-12T02:02:12.335855+0000","last_peered":"2024-09-12T02:02:12.335855+0000","last_clean":"2024-09-12T02:02:12.335855+0000","last_became_active":"2024-09-12T02:02:12.329279+0000","last_became_peered":"2024-09-12T02:02:12.329279+0000","last_unstale":"2024-09-12T02:02:12.335855+0000","last_undegraded":"2024-09-12T02:02:12.335855+0000","last_fullsized":"2024-09-12T02:02:12.335855+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:27.109469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.323203+0000","last_change":"2024-09-12T02:02:11.338109+0000","last_active":"2024-09-12T02:02:12.323203+0000","last_peered":"2024-09-12T02:02:12.323203+0000","last_clean":"2024-09-12T02:02:12.323203+0000","last_became_active":"2024-09-12T02:02:11.337827+0000","last_became_peered":"2024-09-12T02:02:11.337827+0000","last_unstale":"2024-09-12T02:02:12.323203+0000","last_undegraded":"2024-09-12T02:02:12.323203+0000","last_fullsized":"2024-09-12T02:02:12.323203+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:25.822689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.346766+0000","last_change":"2024-09-12T02:02:12.345192+0000","last_active":"2024-09-12T02:02:12.346766+0000","last_peered":"2024-09-12T02:02:12.346766+0000","last_clean":"2024-09-12T02:02:12.346766+0000","last_became_active":"2024-09-12T02:02:12.344763+0000","last_became_peered":"2024-09-12T02:02:12.344763+0000","last_unstale":"2024-09-12T02:02:12.346766+0000","last_undegraded":"2024-09-12T02:02:12.346766+0000","last_fullsized":"2024-09-12T02:02:12.346766+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:29.370257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"92'8","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.356907+0000","last_change":"2024-09-12T02:02:11.336360+0000","last_active":"2024-09-12T02:02:12.356907+0000","last_peered":"2024-09-12T02:02:12.356907+0000","last_clean":"2024-09-12T02:02:12.356907+0000","last_became_active":"2024-09-12T02:02:11.336065+0000","last_became_peered":"2024-09-12T02:02:11.336065+0000","last_unstale":"2024-09-12T02:02:12.356907+0000","last_undegraded":"2024-09-12T02:02:12.356907+0000","last_fullsized":"2024-09-12T02:02:12.356907+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:11.233739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.351195+0000","last_change":"2024-09-12T02:02:12.350095+0000","last_active":"2024-09-12T02:02:12.351195+0000","last_peered":"2024-09-12T02:02:12.351195+0000","last_clean":"2024-09-12T02:02:12.351195+0000","last_became_active":"2024-09-12T02:02:12.349756+0000","last_became_peered":"2024-09-12T02:02:12.349756+0000","last_unstale":"2024-09-12T02:02:12.351195+0000","last_undegraded":"2024-09-12T02:02:12.351195+0000","last_fullsized":"2024-09-12T02:02:12.351195+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:05.645626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.324132+0000","last_change":"2024-09-12T02:02:11.327980+0000","last_active":"2024-09-12T02:02:13.324132+0000","last_peered":"2024-09-12T02:02:13.324132+0000","last_clean":"2024-09-12T02:02:13.324132+0000","last_became_active":"2024-09-12T02:02:11.327687+0000","last_became_peered":"2024-09-12T02:02:11.327687+0000","last_unstale":"2024-09-12T02:02:13.324132+0000","last_undegraded":"2024-09-12T02:02:13.324132+0000","last_fullsized":"2024-09-12T02:02:13.324132+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:15.056421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323117+0000","last_change":"2024-09-12T02:02:12.333663+0000","last_active":"2024-09-12T02:02:13.323117+0000","last_peered":"2024-09-12T02:02:13.323117+0000","last_clean":"2024-09-12T02:02:13.323117+0000","last_became_active":"2024-09-12T02:02:12.333334+0000","last_became_peered":"2024-09-12T02:02:12.333334+0000","last_unstale":"2024-09-12T02:02:13.323117+0000","last_undegraded":"2024-09-12T02:02:13.323117+0000","last_fullsized":"2024-09-12T02:02:13.323117+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:08.450410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412473+0000","last_change":"2024-09-12T02:02:11.331682+0000","last_active":"2024-09-12T02:02:13.412473+0000","last_peered":"2024-09-12T02:02:13.412473+0000","last_clean":"2024-09-12T02:02:13.412473+0000","last_became_active":"2024-09-12T02:02:11.331384+0000","last_became_peered":"2024-09-12T02:02:11.331384+0000","last_unstale":"2024-09-12T02:02:13.412473+0000","last_undegraded":"2024-09-12T02:02:13.412473+0000","last_fullsized":"2024-09-12T02:02:13.412473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:30.836043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-12T02:02:11.323444+0000","last_change":"2024-09-12T02:02:11.323444+0000","last_active":"2024-09-12T02:02:11.308510+0000","last_peered":"2024-09-12T02:02:11.308510+0000","last_clean":"2024-09-12T02:02:11.308510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:02:11.323444+0000","last_undegraded":"2024-09-12T02:02:11.323444+0000","last_fullsized":"2024-09-12T02:02:11.323444+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.334831+0000","last_change":"2024-09-12T02:02:11.333247+0000","last_active":"2024-09-12T02:02:11.334831+0000","last_peered":"2024-09-12T02:02:11.334831+0000","last_clean":"2024-09-12T02:02:11.334831+0000","last_became_active":"2024-09-12T02:02:11.332967+0000","last_became_peered":"2024-09-12T02:02:11.332967+0000","last_unstale":"2024-09-12T02:02:11.334831+0000","last_undegraded":"2024-09-12T02:02:11.334831+0000","last_fullsized":"2024-09-12T02:02:11.334831+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:36.986789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.342109+0000","last_change":"2024-09-12T02:02:12.338322+0000","last_active":"2024-09-12T02:02:12.342109+0000","last_peered":"2024-09-12T02:02:12.342109+0000","last_clean":"2024-09-12T02:02:12.342109+0000","last_became_active":"2024-09-12T02:02:12.338015+0000","last_became_peered":"2024-09-12T02:02:12.338015+0000","last_unstale":"2024-09-12T02:02:12.342109+0000","last_undegraded":"2024-09-12T02:02:12.342109+0000","last_fullsized":"2024-09-12T02:02:12.342109+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:47.736613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340361+0000","last_change":"2024-09-12T02:02:11.332292+0000","last_active":"2024-09-12T02:02:13.340361+0000","last_peered":"2024-09-12T02:02:13.340361+0000","last_clean":"2024-09-12T02:02:13.340361+0000","last_became_active":"2024-09-12T02:02:11.332012+0000","last_became_peered":"2024-09-12T02:02:11.332012+0000","last_unstale":"2024-09-12T02:02:13.340361+0000","last_undegraded":"2024-09-12T02:02:13.340361+0000","last_fullsized":"2024-09-12T02:02:13.340361+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:31.076337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340404+0000","last_change":"2024-09-12T02:02:12.349435+0000","last_active":"2024-09-12T02:02:13.340404+0000","last_peered":"2024-09-12T02:02:13.340404+0000","last_clean":"2024-09-12T02:02:13.340404+0000","last_became_active":"2024-09-12T02:02:12.347614+0000","last_became_peered":"2024-09-12T02:02:12.347614+0000","last_unstale":"2024-09-12T02:02:13.340404+0000","last_undegraded":"2024-09-12T02:02:13.340404+0000","last_fullsized":"2024-09-12T02:02:13.340404+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:29.496591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.321807+0000","last_change":"2024-09-12T02:02:11.330103+0000","last_active":"2024-09-12T02:02:12.321807+0000","last_peered":"2024-09-12T02:02:12.321807+0000","last_clean":"2024-09-12T02:02:12.321807+0000","last_became_active":"2024-09-12T02:02:11.329822+0000","last_became_peered":"2024-09-12T02:02:11.329822+0000","last_unstale":"2024-09-12T02:02:12.321807+0000","last_undegraded":"2024-09-12T02:02:12.321807+0000","last_fullsized":"2024-09-12T02:02:12.321807+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:00.660882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340435+0000","last_change":"2024-09-12T02:02:12.343786+0000","last_active":"2024-09-12T02:02:13.340435+0000","last_peered":"2024-09-12T02:02:13.340435+0000","last_clean":"2024-09-12T02:02:13.340435+0000","last_became_active":"2024-09-12T02:02:12.343506+0000","last_became_peered":"2024-09-12T02:02:12.343506+0000","last_unstale":"2024-09-12T02:02:13.340435+0000","last_undegraded":"2024-09-12T02:02:13.340435+0000","last_fullsized":"2024-09-12T02:02:13.340435+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:58.287049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340526+0000","last_change":"2024-09-12T02:02:11.337862+0000","last_active":"2024-09-12T02:02:13.340526+0000","last_peered":"2024-09-12T02:02:13.340526+0000","last_clean":"2024-09-12T02:02:13.340526+0000","last_became_active":"2024-09-12T02:02:11.337384+0000","last_became_peered":"2024-09-12T02:02:11.337384+0000","last_unstale":"2024-09-12T02:02:13.340526+0000","last_undegraded":"2024-09-12T02:02:13.340526+0000","last_fullsized":"2024-09-12T02:02:13.340526+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:03.587791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336675+0000","last_change":"2024-09-12T02:02:12.332334+0000","last_active":"2024-09-12T02:02:12.336675+0000","last_peered":"2024-09-12T02:02:12.336675+0000","last_clean":"2024-09-12T02:02:12.336675+0000","last_became_active":"2024-09-12T02:02:12.331814+0000","last_became_peered":"2024-09-12T02:02:12.331814+0000","last_unstale":"2024-09-12T02:02:12.336675+0000","last_undegraded":"2024-09-12T02:02:12.336675+0000","last_fullsized":"2024-09-12T02:02:12.336675+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:53.448271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.322071+0000","last_change":"2024-09-12T02:02:11.329706+0000","last_active":"2024-09-12T02:02:12.322071+0000","last_peered":"2024-09-12T02:02:12.322071+0000","last_clean":"2024-09-12T02:02:12.322071+0000","last_became_active":"2024-09-12T02:02:11.329422+0000","last_became_peered":"2024-09-12T02:02:11.329422+0000","last_unstale":"2024-09-12T02:02:12.322071+0000","last_undegraded":"2024-09-12T02:02:12.322071+0000","last_fullsized":"2024-09-12T02:02:12.322071+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:17.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323458+0000","last_change":"2024-09-12T02:02:12.334098+0000","last_active":"2024-09-12T02:02:13.323458+0000","last_peered":"2024-09-12T02:02:13.323458+0000","last_clean":"2024-09-12T02:02:13.323458+0000","last_became_active":"2024-09-12T02:02:12.332786+0000","last_became_peered":"2024-09-12T02:02:12.332786+0000","last_unstale":"2024-09-12T02:02:13.323458+0000","last_undegraded":"2024-09-12T02:02:13.323458+0000","last_fullsized":"2024-09-12T02:02:13.323458+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:15.955019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412678+0000","last_change":"2024-09-12T02:02:11.334960+0000","last_active":"2024-09-12T02:02:13.412678+0000","last_peered":"2024-09-12T02:02:13.412678+0000","last_clean":"2024-09-12T02:02:13.412678+0000","last_became_active":"2024-09-12T02:02:11.334693+0000","last_became_peered":"2024-09-12T02:02:11.334693+0000","last_unstale":"2024-09-12T02:02:13.412678+0000","last_undegraded":"2024-09-12T02:02:13.412678+0000","last_fullsized":"2024-09-12T02:02:13.412678+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:28.491104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.345995+0000","last_change":"2024-09-12T02:02:12.342917+0000","last_active":"2024-09-12T02:02:12.345995+0000","last_peered":"2024-09-12T02:02:12.345995+0000","last_clean":"2024-09-12T02:02:12.345995+0000","last_became_active":"2024-09-12T02:02:12.342611+0000","last_became_peered":"2024-09-12T02:02:12.342611+0000","last_unstale":"2024-09-12T02:02:12.345995+0000","last_undegraded":"2024-09-12T02:02:12.345995+0000","last_fullsized":"2024-09-12T02:02:12.345995+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:13.465096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.334509+0000","last_change":"2024-09-12T02:02:11.331807+0000","last_active":"2024-09-12T02:02:11.334509+0000","last_peered":"2024-09-12T02:02:11.334509+0000","last_clean":"2024-09-12T02:02:11.334509+0000","last_became_active":"2024-09-12T02:02:11.331545+0000","last_became_peered":"2024-09-12T02:02:11.331545+0000","last_unstale":"2024-09-12T02:02:11.334509+0000","last_undegraded":"2024-09-12T02:02:11.334509+0000","last_fullsized":"2024-09-12T02:02:11.334509+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:07.526436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336659+0000","last_change":"2024-09-12T02:02:12.331122+0000","last_active":"2024-09-12T02:02:12.336659+0000","last_peered":"2024-09-12T02:02:12.336659+0000","last_clean":"2024-09-12T02:02:12.336659+0000","last_became_active":"2024-09-12T02:02:12.330378+0000","last_became_peered":"2024-09-12T02:02:12.330378+0000","last_unstale":"2024-09-12T02:02:12.336659+0000","last_undegraded":"2024-09-12T02:02:12.336659+0000","last_fullsized":"2024-09-12T02:02:12.336659+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:51.393021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T02:02:11.337903+0000","last_change":"2024-09-12T02:02:11.335862+0000","last_active":"2024-09-12T02:02:11.337903+0000","last_peered":"2024-09-12T02:02:11.337903+0000","last_clean":"2024-09-12T02:02:11.337903+0000","last_became_active":"2024-09-12T02:02:11.335603+0000","last_became_peered":"2024-09-12T02:02:11.335603+0000","last_unstale":"2024-09-12T02:02:11.337903+0000","last_undegraded":"2024-09-12T02:02:11.337903+0000","last_fullsized":"2024-09-12T02:02:11.337903+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:01.073635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340679+0000","last_change":"2024-09-12T02:02:12.349940+0000","last_active":"2024-09-12T02:02:13.340679+0000","last_peered":"2024-09-12T02:02:13.340679+0000","last_clean":"2024-09-12T02:02:13.340679+0000","last_became_active":"2024-09-12T02:02:12.349675+0000","last_became_peered":"2024-09-12T02:02:12.349675+0000","last_unstale":"2024-09-12T02:02:13.340679+0000","last_undegraded":"2024-09-12T02:02:13.340679+0000","last_fullsized":"2024-09-12T02:02:13.340679+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:19.218621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323638+0000","last_change":"2024-09-12T02:02:11.331813+0000","last_active":"2024-09-12T02:02:13.323638+0000","last_peered":"2024-09-12T02:02:13.323638+0000","last_clean":"2024-09-12T02:02:13.323638+0000","last_became_active":"2024-09-12T02:02:11.331505+0000","last_became_peered":"2024-09-12T02:02:11.331505+0000","last_unstale":"2024-09-12T02:02:13.323638+0000","last_undegraded":"2024-09-12T02:02:13.323638+0000","last_fullsized":"2024-09-12T02:02:13.323638+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:31.234575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336540+0000","last_change":"2024-09-12T02:02:12.333131+0000","last_active":"2024-09-12T02:02:12.336540+0000","last_peered":"2024-09-12T02:02:12.336540+0000","last_clean":"2024-09-12T02:02:12.336540+0000","last_became_active":"2024-09-12T02:02:12.332829+0000","last_became_peered":"2024-09-12T02:02:12.332829+0000","last_unstale":"2024-09-12T02:02:12.336540+0000","last_undegraded":"2024-09-12T02:02:12.336540+0000","last_fullsized":"2024-09-12T02:02:12.336540+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:20.234006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.326472+0000","last_change":"2024-09-12T02:02:11.338517+0000","last_active":"2024-09-12T02:02:12.326472+0000","last_peered":"2024-09-12T02:02:12.326472+0000","last_clean":"2024-09-12T02:02:12.326472+0000","last_became_active":"2024-09-12T02:02:11.338195+0000","last_became_peered":"2024-09-12T02:02:11.338195+0000","last_unstale":"2024-09-12T02:02:12.326472+0000","last_undegraded":"2024-09-12T02:02:12.326472+0000","last_fullsized":"2024-09-12T02:02:12.326472+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:23.513062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.335125+0000","last_change":"2024-09-12T02:02:12.327683+0000","last_active":"2024-09-12T02:02:12.335125+0000","last_peered":"2024-09-12T02:02:12.335125+0000","last_clean":"2024-09-12T02:02:12.335125+0000","last_became_active":"2024-09-12T02:02:12.327416+0000","last_became_peered":"2024-09-12T02:02:12.327416+0000","last_unstale":"2024-09-12T02:02:12.335125+0000","last_undegraded":"2024-09-12T02:02:12.335125+0000","last_fullsized":"2024-09-12T02:02:12.335125+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:57.332382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340551+0000","last_change":"2024-09-12T02:02:11.328426+0000","last_active":"2024-09-12T02:02:13.340551+0000","last_peered":"2024-09-12T02:02:13.340551+0000","last_clean":"2024-09-12T02:02:13.340551+0000","last_became_active":"2024-09-12T02:02:11.328217+0000","last_became_peered":"2024-09-12T02:02:11.328217+0000","last_unstale":"2024-09-12T02:02:13.340551+0000","last_undegraded":"2024-09-12T02:02:13.340551+0000","last_fullsized":"2024-09-12T02:02:13.340551+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:36.031506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323434+0000","last_change":"2024-09-12T02:02:12.340317+0000","last_active":"2024-09-12T02:02:13.323434+0000","last_peered":"2024-09-12T02:02:13.323434+0000","last_clean":"2024-09-12T02:02:13.323434+0000","last_became_active":"2024-09-12T02:02:12.340058+0000","last_became_peered":"2024-09-12T02:02:12.340058+0000","last_unstale":"2024-09-12T02:02:13.323434+0000","last_undegraded":"2024-09-12T02:02:13.323434+0000","last_fullsized":"2024-09-12T02:02:13.323434+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:07.388059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323058+0000","last_change":"2024-09-12T02:02:11.327599+0000","last_active":"2024-09-12T02:02:13.323058+0000","last_peered":"2024-09-12T02:02:13.323058+0000","last_clean":"2024-09-12T02:02:13.323058+0000","last_became_active":"2024-09-12T02:02:11.327287+0000","last_became_peered":"2024-09-12T02:02:11.327287+0000","last_unstale":"2024-09-12T02:02:13.323058+0000","last_undegraded":"2024-09-12T02:02:13.323058+0000","last_fullsized":"2024-09-12T02:02:13.323058+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:30.857360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.336647+0000","last_change":"2024-09-12T02:02:12.332093+0000","last_active":"2024-09-12T02:02:12.336647+0000","last_peered":"2024-09-12T02:02:12.336647+0000","last_clean":"2024-09-12T02:02:12.336647+0000","last_became_active":"2024-09-12T02:02:12.331500+0000","last_became_peered":"2024-09-12T02:02:12.331500+0000","last_unstale":"2024-09-12T02:02:12.336647+0000","last_undegraded":"2024-09-12T02:02:12.336647+0000","last_fullsized":"2024-09-12T02:02:12.336647+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:48.686084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412398+0000","last_change":"2024-09-12T02:02:11.329064+0000","last_active":"2024-09-12T02:02:13.412398+0000","last_peered":"2024-09-12T02:02:13.412398+0000","last_clean":"2024-09-12T02:02:13.412398+0000","last_became_active":"2024-09-12T02:02:11.328800+0000","last_became_peered":"2024-09-12T02:02:11.328800+0000","last_unstale":"2024-09-12T02:02:13.412398+0000","last_undegraded":"2024-09-12T02:02:13.412398+0000","last_fullsized":"2024-09-12T02:02:13.412398+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:12.833485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412626+0000","last_change":"2024-09-12T02:02:12.341167+0000","last_active":"2024-09-12T02:02:13.412626+0000","last_peered":"2024-09-12T02:02:13.412626+0000","last_clean":"2024-09-12T02:02:13.412626+0000","last_became_active":"2024-09-12T02:02:12.340921+0000","last_became_peered":"2024-09-12T02:02:12.340921+0000","last_unstale":"2024-09-12T02:02:13.412626+0000","last_undegraded":"2024-09-12T02:02:13.412626+0000","last_fullsized":"2024-09-12T02:02:13.412626+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.801762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T02:02:12.324675+0000","last_change":"2024-09-12T02:02:11.329351+0000","last_active":"2024-09-12T02:02:12.324675+0000","last_peered":"2024-09-12T02:02:12.324675+0000","last_clean":"2024-09-12T02:02:12.324675+0000","last_became_active":"2024-09-12T02:02:11.329049+0000","last_became_peered":"2024-09-12T02:02:11.329049+0000","last_unstale":"2024-09-12T02:02:12.324675+0000","last_undegraded":"2024-09-12T02:02:12.324675+0000","last_fullsized":"2024-09-12T02:02:12.324675+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:09.295690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":304,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412422+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T02:02:13.412422+0000","last_peered":"2024-09-12T02:02:13.412422+0000","last_clean":"2024-09-12T02:02:13.412422+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T02:02:13.412422+0000","last_undegraded":"2024-09-12T02:02:13.412422+0000","last_fullsized":"2024-09-12T02:02:13.412422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509522,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32888,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338952,"statfs":{"total":96636764160,"available":96603086848,"internally_reserved":0,"allocated":1740800,"data_stored":1119434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509521,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1159168,"data_stored":531226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509522,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1138688,"data_stored":529010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542226,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1126400,"data_stored":522318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542226,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1126400,"data_stored":522318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542226,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1130496,"data_stored":522388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542226,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32900,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338940,"statfs":{"total":96636764160,"available":96603074560,"internally_reserved":0,"allocated":1744896,"data_stored":1115004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1114112,"data_stored":515151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:02:19.754 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:02:19.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.869+0000 7f09d7677640 1 Processor -- start 2024-09-12T02:02:19.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.870+0000 7f09d7677640 1 -- start start 2024-09-12T02:02:19.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.870+0000 7f09d7677640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f09d0161c80 0x7f09d006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.870+0000 7f09d7677640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09d006e870 con 0x7f09d00b6680 2024-09-12T02:02:19.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.871+0000 7f09d7677640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09d006d9f0 con 0x7f09d0162060 2024-09-12T02:02:19.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.871+0000 7f09d7677640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f09d006dcd0 con 0x7f09d0161c80 2024-09-12T02:02:19.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.871+0000 7f09d5413640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f09d0161c80 0x7f09d006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.871+0000 7f09d5c14640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f09d00b6680 0x7f09d00cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39124/0 (socket says 172.21.15.19:39124) 2024-09-12T02:02:19.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.871+0000 7f09d5c14640 1 -- 172.21.15.19:0/520946126 learned_addr learned my addr 172.21.15.19:0/520946126 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:19.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.871+0000 7f09d5413640 1 -- 172.21.15.19:0/520946126 >> v1:172.21.15.135:6789/0 conn(0x7f09d0162060 legacy=0x7f09d00b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:19.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.871+0000 7f09d5413640 1 -- 172.21.15.19:0/520946126 >> v1:172.21.15.19:6789/0 conn(0x7f09d00b6680 legacy=0x7f09d00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:19.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.871+0000 7f09d5413640 1 -- 172.21.15.19:0/520946126 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d006dfb0 con 0x7f09d0161c80 2024-09-12T02:02:19.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.871+0000 7f09c7fff640 1 -- 172.21.15.19:0/520946126 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3729978702 0 0) 0x7f09c8001490 con 0x7f09d00b6680 2024-09-12T02:02:19.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.872+0000 7f09d5413640 1 --2- 172.21.15.19:0/520946126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09d0161c80 0x7f09d006e330 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0097a0 tx=0x7f09cc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537b4d663a412f5c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:19.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.872+0000 7f09c7fff640 1 -- 172.21.15.19:0/520946126 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc037070 con 0x7f09d0161c80 2024-09-12T02:02:19.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.872+0000 7f09c7fff640 1 -- 172.21.15.19:0/520946126 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09cc032440 con 0x7f09d0161c80 2024-09-12T02:02:19.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.872+0000 7f09c7fff640 1 -- 172.21.15.19:0/520946126 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc032810 con 0x7f09d0161c80 2024-09-12T02:02:19.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.872+0000 7f09d7677640 1 -- 172.21.15.19:0/520946126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09d0161c80 msgr2=0x7f09d006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:19.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.873+0000 7f09d7677640 1 --2- 172.21.15.19:0/520946126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09d0161c80 0x7f09d006e330 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0097a0 tx=0x7f09cc02a230 comp rx=0 tx=0).stop 2024-09-12T02:02:19.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.873+0000 7f09d7677640 1 -- 172.21.15.19:0/520946126 shutdown_connections 2024-09-12T02:02:19.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.873+0000 7f09d7677640 1 --2- 172.21.15.19:0/520946126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09d0161c80 0x7f09d006e330 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.873+0000 7f09d7677640 1 -- 172.21.15.19:0/520946126 >> 172.21.15.19:0/520946126 conn(0x7f09d00d44f0 msgr2=0x7f09d00d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:19.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.873+0000 7f09d7677640 1 -- 172.21.15.19:0/520946126 shutdown_connections 2024-09-12T02:02:19.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.873+0000 7f09d7677640 1 -- 172.21.15.19:0/520946126 wait complete. 2024-09-12T02:02:19.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.874+0000 7f09d7677640 1 Processor -- start 2024-09-12T02:02:19.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.874+0000 7f09d7677640 1 -- start start 2024-09-12T02:02:19.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09d7677640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09d00b6680 0x7f09d009e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09d7677640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09d0161c80 0x7f09d0151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09d7677640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09d0162060 0x7f09d0151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09d7677640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f09d00b6b30 con 0x7f09d00b6680 2024-09-12T02:02:19.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09d7677640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f09d00d2aa0 con 0x7f09d0162060 2024-09-12T02:02:19.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09d7677640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f09d00b6cb0 con 0x7f09d0161c80 2024-09-12T02:02:19.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09d5413640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09d00b6680 0x7f09d009e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09d5413640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09d00b6680 0x7f09d009e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35216/0 (socket says 172.21.15.19:35216) 2024-09-12T02:02:19.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09d5413640 1 -- 172.21.15.19:0/1298063176 learned_addr learned my addr 172.21.15.19:0/1298063176 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:19.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09d5413640 1 -- 172.21.15.19:0/1298063176 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09d0161c80 msgr2=0x7f09d0151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:19.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09d5413640 1 --2- 172.21.15.19:0/1298063176 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09d0161c80 0x7f09d0151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09d5413640 1 -- 172.21.15.19:0/1298063176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09d0162060 msgr2=0x7f09d0151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:19.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09d5413640 1 --2- 172.21.15.19:0/1298063176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09d0162060 0x7f09d0151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09d5413640 1 -- 172.21.15.19:0/1298063176 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d00b8cc0 con 0x7f09d00b6680 2024-09-12T02:02:19.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09d5413640 1 --2- 172.21.15.19:0/1298063176 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09d00b6680 0x7f09d009e450 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f09cc000c00 tx=0x7f09cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:19.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09c5ffb640 1 -- 172.21.15.19:0/1298063176 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc037040 con 0x7f09d00b6680 2024-09-12T02:02:19.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09c5ffb640 1 -- 172.21.15.19:0/1298063176 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09cc042070 con 0x7f09d00b6680 2024-09-12T02:02:19.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09d7677640 1 -- 172.21.15.19:0/1298063176 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09d00b8fa0 con 0x7f09d00b6680 2024-09-12T02:02:19.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.875+0000 7f09c5ffb640 1 -- 172.21.15.19:0/1298063176 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc030a70 con 0x7f09d00b6680 2024-09-12T02:02:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.876+0000 7f09d7677640 1 -- 172.21.15.19:0/1298063176 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09d00b9560 con 0x7f09d00b6680 2024-09-12T02:02:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.877+0000 7f09d7677640 1 -- 172.21.15.19:0/1298063176 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09d006e330 con 0x7f09d00b6680 2024-09-12T02:02:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.877+0000 7f09c5ffb640 1 -- 172.21.15.19:0/1298063176 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f09cc030c10 con 0x7f09d00b6680 2024-09-12T02:02:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.878+0000 7f09c5ffb640 1 --2- 172.21.15.19:0/1298063176 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f09b406be30 0x7f09b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.878+0000 7f09c5ffb640 1 -- 172.21.15.19:0/1298063176 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6101+0+0 (secure 0 0 0) 0x7f09cc0aba00 con 0x7f09d00b6680 2024-09-12T02:02:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.878+0000 7f09d4c12640 1 --2- 172.21.15.19:0/1298063176 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f09b406be30 0x7f09b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.878+0000 7f09d4c12640 1 --2- 172.21.15.19:0/1298063176 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f09b406be30 0x7f09b406e2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f09c0000f60 tx=0x7f09c00079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:19.882+0000 7f09c5ffb640 1 -- 172.21.15.19:0/1298063176 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f09cc045360 con 0x7f09d00b6680 2024-09-12T02:02:20.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.055+0000 7f09d7677640 1 -- 172.21.15.19:0/1298063176 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09d00b9730 con 0x7f09b406be30 2024-09-12T02:02:20.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.062+0000 7f09c5ffb640 1 -- 172.21.15.19:0/1298063176 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252027 (secure 0 0 0) 0x7f09d00b9730 con 0x7f09b406be30 2024-09-12T02:02:20.065 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:20.066 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T02:02:20.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.065+0000 7f09d7677640 1 -- 172.21.15.19:0/1298063176 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f09b406be30 msgr2=0x7f09b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:20.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.065+0000 7f09d7677640 1 --2- 172.21.15.19:0/1298063176 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f09b406be30 0x7f09b406e2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f09c0000f60 tx=0x7f09c00079b0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.065+0000 7f09d7677640 1 -- 172.21.15.19:0/1298063176 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09d00b6680 msgr2=0x7f09d009e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:20.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.065+0000 7f09d7677640 1 --2- 172.21.15.19:0/1298063176 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09d00b6680 0x7f09d009e450 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f09cc000c00 tx=0x7f09cc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.065+0000 7f09d7677640 1 -- 172.21.15.19:0/1298063176 shutdown_connections 2024-09-12T02:02:20.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.065+0000 7f09d7677640 1 --2- 172.21.15.19:0/1298063176 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f09b406be30 0x7f09b406e2f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.065+0000 7f09d7677640 1 --2- 172.21.15.19:0/1298063176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09d0162060 0x7f09d0151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.065+0000 7f09d7677640 1 --2- 172.21.15.19:0/1298063176 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09d0161c80 0x7f09d0151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.065+0000 7f09d7677640 1 --2- 172.21.15.19:0/1298063176 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09d00b6680 0x7f09d009e450 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.065+0000 7f09d7677640 1 -- 172.21.15.19:0/1298063176 >> 172.21.15.19:0/1298063176 conn(0x7f09d00d44f0 msgr2=0x7f09d006ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:20.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.065+0000 7f09d7677640 1 -- 172.21.15.19:0/1298063176 shutdown_connections 2024-09-12T02:02:20.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.065+0000 7f09d7677640 1 -- 172.21.15.19:0/1298063176 wait complete. 2024-09-12T02:02:20.076 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-12T02:02:18.178070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251316,"kb_used_data":10120,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754723404,"statfs":{"total":773094113280,"available":772836765696,"internally_reserved":0,"allocated":10362880,"data_stored":5417636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.862277"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.413448+0000","last_change":"2024-09-12T02:02:12.332361+0000","last_active":"2024-09-12T02:02:13.413448+0000","last_peered":"2024-09-12T02:02:13.413448+0000","last_clean":"2024-09-12T02:02:13.413448+0000","last_became_active":"2024-09-12T02:02:12.332101+0000","last_became_peered":"2024-09-12T02:02:12.332101+0000","last_unstale":"2024-09-12T02:02:13.413448+0000","last_undegraded":"2024-09-12T02:02:13.413448+0000","last_fullsized":"2024-09-12T02:02:13.413448+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:50.952236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340632+0000","last_change":"2024-09-12T02:02:12.338898+0000","last_active":"2024-09-12T02:02:13.340632+0000","last_peered":"2024-09-12T02:02:13.340632+0000","last_clean":"2024-09-12T02:02:13.340632+0000","last_became_active":"2024-09-12T02:02:12.338509+0000","last_became_peered":"2024-09-12T02:02:12.338509+0000","last_unstale":"2024-09-12T02:02:13.340632+0000","last_undegraded":"2024-09-12T02:02:13.340632+0000","last_fullsized":"2024-09-12T02:02:13.340632+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:55.080145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412541+0000","last_change":"2024-09-12T02:02:12.348813+0000","last_active":"2024-09-12T02:02:13.412541+0000","last_peered":"2024-09-12T02:02:13.412541+0000","last_clean":"2024-09-12T02:02:13.412541+0000","last_became_active":"2024-09-12T02:02:12.348446+0000","last_became_peered":"2024-09-12T02:02:12.348446+0000","last_unstale":"2024-09-12T02:02:13.412541+0000","last_undegraded":"2024-09-12T02:02:13.412541+0000","last_fullsized":"2024-09-12T02:02:13.412541+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:08.931681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.413579+0000","last_change":"2024-09-12T02:02:12.336248+0000","last_active":"2024-09-12T02:02:13.413579+0000","last_peered":"2024-09-12T02:02:13.413579+0000","last_clean":"2024-09-12T02:02:13.413579+0000","last_became_active":"2024-09-12T02:02:12.335952+0000","last_became_peered":"2024-09-12T02:02:12.335952+0000","last_unstale":"2024-09-12T02:02:13.413579+0000","last_undegraded":"2024-09-12T02:02:13.413579+0000","last_fullsized":"2024-09-12T02:02:13.413579+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:07.908032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323615+0000","last_change":"2024-09-12T02:02:12.336993+0000","last_active":"2024-09-12T02:02:13.323615+0000","last_peered":"2024-09-12T02:02:13.323615+0000","last_clean":"2024-09-12T02:02:13.323615+0000","last_became_active":"2024-09-12T02:02:12.336684+0000","last_became_peered":"2024-09-12T02:02:12.336684+0000","last_unstale":"2024-09-12T02:02:13.323615+0000","last_undegraded":"2024-09-12T02:02:13.323615+0000","last_fullsized":"2024-09-12T02:02:13.323615+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:02.903578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.319497+0000","last_change":"2024-09-12T02:02:12.338436+0000","last_active":"2024-09-12T02:02:13.319497+0000","last_peered":"2024-09-12T02:02:13.319497+0000","last_clean":"2024-09-12T02:02:13.319497+0000","last_became_active":"2024-09-12T02:02:12.338088+0000","last_became_peered":"2024-09-12T02:02:12.338088+0000","last_unstale":"2024-09-12T02:02:13.319497+0000","last_undegraded":"2024-09-12T02:02:13.319497+0000","last_fullsized":"2024-09-12T02:02:13.319497+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:59.464862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412540+0000","last_change":"2024-09-12T02:02:12.340218+0000","last_active":"2024-09-12T02:02:13.412540+0000","last_peered":"2024-09-12T02:02:13.412540+0000","last_clean":"2024-09-12T02:02:13.412540+0000","last_became_active":"2024-09-12T02:02:12.339861+0000","last_became_peered":"2024-09-12T02:02:12.339861+0000","last_unstale":"2024-09-12T02:02:13.412540+0000","last_undegraded":"2024-09-12T02:02:13.412540+0000","last_fullsized":"2024-09-12T02:02:13.412540+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:51.659882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412491+0000","last_change":"2024-09-12T02:02:12.333340+0000","last_active":"2024-09-12T02:02:13.412491+0000","last_peered":"2024-09-12T02:02:13.412491+0000","last_clean":"2024-09-12T02:02:13.412491+0000","last_became_active":"2024-09-12T02:02:12.333067+0000","last_became_peered":"2024-09-12T02:02:12.333067+0000","last_unstale":"2024-09-12T02:02:13.412491+0000","last_undegraded":"2024-09-12T02:02:13.412491+0000","last_fullsized":"2024-09-12T02:02:13.412491+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:00.449432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323139+0000","last_change":"2024-09-12T02:02:12.341026+0000","last_active":"2024-09-12T02:02:13.323139+0000","last_peered":"2024-09-12T02:02:13.323139+0000","last_clean":"2024-09-12T02:02:13.323139+0000","last_became_active":"2024-09-12T02:02:12.340735+0000","last_became_peered":"2024-09-12T02:02:12.340735+0000","last_unstale":"2024-09-12T02:02:13.323139+0000","last_undegraded":"2024-09-12T02:02:13.323139+0000","last_fullsized":"2024-09-12T02:02:13.323139+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:17.462635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.413033+0000","last_change":"2024-09-12T02:02:12.328431+0000","last_active":"2024-09-12T02:02:13.413033+0000","last_peered":"2024-09-12T02:02:13.413033+0000","last_clean":"2024-09-12T02:02:13.413033+0000","last_became_active":"2024-09-12T02:02:12.328148+0000","last_became_peered":"2024-09-12T02:02:12.328148+0000","last_unstale":"2024-09-12T02:02:13.413033+0000","last_undegraded":"2024-09-12T02:02:13.413033+0000","last_fullsized":"2024-09-12T02:02:13.413033+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:00.780451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323753+0000","last_change":"2024-09-12T02:02:12.347392+0000","last_active":"2024-09-12T02:02:13.323753+0000","last_peered":"2024-09-12T02:02:13.323753+0000","last_clean":"2024-09-12T02:02:13.323753+0000","last_became_active":"2024-09-12T02:02:12.346383+0000","last_became_peered":"2024-09-12T02:02:12.346383+0000","last_unstale":"2024-09-12T02:02:13.323753+0000","last_undegraded":"2024-09-12T02:02:13.323753+0000","last_fullsized":"2024-09-12T02:02:13.323753+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:34.917013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.413807+0000","last_change":"2024-09-12T02:02:12.327134+0000","last_active":"2024-09-12T02:02:13.413807+0000","last_peered":"2024-09-12T02:02:13.413807+0000","last_clean":"2024-09-12T02:02:13.413807+0000","last_became_active":"2024-09-12T02:02:12.326826+0000","last_became_peered":"2024-09-12T02:02:12.326826+0000","last_unstale":"2024-09-12T02:02:13.413807+0000","last_undegraded":"2024-09-12T02:02:13.413807+0000","last_fullsized":"2024-09-12T02:02:13.413807+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:39.300034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412531+0000","last_change":"2024-09-12T02:02:12.331964+0000","last_active":"2024-09-12T02:02:13.412531+0000","last_peered":"2024-09-12T02:02:13.412531+0000","last_clean":"2024-09-12T02:02:13.412531+0000","last_became_active":"2024-09-12T02:02:12.331686+0000","last_became_peered":"2024-09-12T02:02:12.331686+0000","last_unstale":"2024-09-12T02:02:13.412531+0000","last_undegraded":"2024-09-12T02:02:13.412531+0000","last_fullsized":"2024-09-12T02:02:13.412531+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:06.203523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.322843+0000","last_change":"2024-09-12T02:02:12.347047+0000","last_active":"2024-09-12T02:02:13.322843+0000","last_peered":"2024-09-12T02:02:13.322843+0000","last_clean":"2024-09-12T02:02:13.322843+0000","last_became_active":"2024-09-12T02:02:12.346318+0000","last_became_peered":"2024-09-12T02:02:12.346318+0000","last_unstale":"2024-09-12T02:02:13.322843+0000","last_undegraded":"2024-09-12T02:02:13.322843+0000","last_fullsized":"2024-09-12T02:02:13.322843+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:28.792946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412651+0000","last_change":"2024-09-12T02:02:12.337578+0000","last_active":"2024-09-12T02:02:13.412651+0000","last_peered":"2024-09-12T02:02:13.412651+0000","last_clean":"2024-09-12T02:02:13.412651+0000","last_became_active":"2024-09-12T02:02:12.337335+0000","last_became_peered":"2024-09-12T02:02:12.337335+0000","last_unstale":"2024-09-12T02:02:13.412651+0000","last_undegraded":"2024-09-12T02:02:13.412651+0000","last_fullsized":"2024-09-12T02:02:13.412651+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:13.302515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.319448+0000","last_change":"2024-09-12T02:02:12.330650+0000","last_active":"2024-09-12T02:02:13.319448+0000","last_peered":"2024-09-12T02:02:13.319448+0000","last_clean":"2024-09-12T02:02:13.319448+0000","last_became_active":"2024-09-12T02:02:12.330347+0000","last_became_peered":"2024-09-12T02:02:12.330347+0000","last_unstale":"2024-09-12T02:02:13.319448+0000","last_undegraded":"2024-09-12T02:02:13.319448+0000","last_fullsized":"2024-09-12T02:02:13.319448+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:58.518576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.320034+0000","last_change":"2024-09-12T02:02:12.329326+0000","last_active":"2024-09-12T02:02:13.320034+0000","last_peered":"2024-09-12T02:02:13.320034+0000","last_clean":"2024-09-12T02:02:13.320034+0000","last_became_active":"2024-09-12T02:02:12.329063+0000","last_became_peered":"2024-09-12T02:02:12.329063+0000","last_unstale":"2024-09-12T02:02:13.320034+0000","last_undegraded":"2024-09-12T02:02:13.320034+0000","last_fullsized":"2024-09-12T02:02:13.320034+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:33.164519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412911+0000","last_change":"2024-09-12T02:02:12.333053+0000","last_active":"2024-09-12T02:02:13.412911+0000","last_peered":"2024-09-12T02:02:13.412911+0000","last_clean":"2024-09-12T02:02:13.412911+0000","last_became_active":"2024-09-12T02:02:12.332788+0000","last_became_peered":"2024-09-12T02:02:12.332788+0000","last_unstale":"2024-09-12T02:02:13.412911+0000","last_undegraded":"2024-09-12T02:02:13.412911+0000","last_fullsized":"2024-09-12T02:02:13.412911+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:05.643045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323921+0000","last_change":"2024-09-12T02:02:12.345957+0000","last_active":"2024-09-12T02:02:13.323921+0000","last_peered":"2024-09-12T02:02:13.323921+0000","last_clean":"2024-09-12T02:02:13.323921+0000","last_became_active":"2024-09-12T02:02:12.345560+0000","last_became_peered":"2024-09-12T02:02:12.345560+0000","last_unstale":"2024-09-12T02:02:13.323921+0000","last_undegraded":"2024-09-12T02:02:13.323921+0000","last_fullsized":"2024-09-12T02:02:13.323921+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:00.124800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.413593+0000","last_change":"2024-09-12T02:02:12.326448+0000","last_active":"2024-09-12T02:02:13.413593+0000","last_peered":"2024-09-12T02:02:13.413593+0000","last_clean":"2024-09-12T02:02:13.413593+0000","last_became_active":"2024-09-12T02:02:12.326137+0000","last_became_peered":"2024-09-12T02:02:12.326137+0000","last_unstale":"2024-09-12T02:02:13.413593+0000","last_undegraded":"2024-09-12T02:02:13.413593+0000","last_fullsized":"2024-09-12T02:02:13.413593+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:17.462635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323522+0000","last_change":"2024-09-12T02:02:12.341413+0000","last_active":"2024-09-12T02:02:13.323522+0000","last_peered":"2024-09-12T02:02:13.323522+0000","last_clean":"2024-09-12T02:02:13.323522+0000","last_became_active":"2024-09-12T02:02:12.341089+0000","last_became_peered":"2024-09-12T02:02:12.341089+0000","last_unstale":"2024-09-12T02:02:13.323522+0000","last_undegraded":"2024-09-12T02:02:13.323522+0000","last_fullsized":"2024-09-12T02:02:13.323522+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:18.861349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323005+0000","last_change":"2024-09-12T02:02:12.346833+0000","last_active":"2024-09-12T02:02:13.323005+0000","last_peered":"2024-09-12T02:02:13.323005+0000","last_clean":"2024-09-12T02:02:13.323005+0000","last_became_active":"2024-09-12T02:02:12.345987+0000","last_became_peered":"2024-09-12T02:02:12.345987+0000","last_unstale":"2024-09-12T02:02:13.323005+0000","last_undegraded":"2024-09-12T02:02:13.323005+0000","last_fullsized":"2024-09-12T02:02:13.323005+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:28.671046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323252+0000","last_change":"2024-09-12T02:02:12.339608+0000","last_active":"2024-09-12T02:02:13.323252+0000","last_peered":"2024-09-12T02:02:13.323252+0000","last_clean":"2024-09-12T02:02:13.323252+0000","last_became_active":"2024-09-12T02:02:12.339051+0000","last_became_peered":"2024-09-12T02:02:12.339051+0000","last_unstale":"2024-09-12T02:02:13.323252+0000","last_undegraded":"2024-09-12T02:02:13.323252+0000","last_fullsized":"2024-09-12T02:02:13.323252+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:51.986401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.413249+0000","last_change":"2024-09-12T02:02:12.344797+0000","last_active":"2024-09-12T02:02:13.413249+0000","last_peered":"2024-09-12T02:02:13.413249+0000","last_clean":"2024-09-12T02:02:13.413249+0000","last_became_active":"2024-09-12T02:02:12.344507+0000","last_became_peered":"2024-09-12T02:02:12.344507+0000","last_unstale":"2024-09-12T02:02:13.413249+0000","last_undegraded":"2024-09-12T02:02:13.413249+0000","last_fullsized":"2024-09-12T02:02:13.413249+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:00.928998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340618+0000","last_change":"2024-09-12T02:02:12.337746+0000","last_active":"2024-09-12T02:02:13.340618+0000","last_peered":"2024-09-12T02:02:13.340618+0000","last_clean":"2024-09-12T02:02:13.340618+0000","last_became_active":"2024-09-12T02:02:12.337473+0000","last_became_peered":"2024-09-12T02:02:12.337473+0000","last_unstale":"2024-09-12T02:02:13.340618+0000","last_undegraded":"2024-09-12T02:02:13.340618+0000","last_fullsized":"2024-09-12T02:02:13.340618+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:25.348127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323386+0000","last_change":"2024-09-12T02:02:12.347014+0000","last_active":"2024-09-12T02:02:13.323386+0000","last_peered":"2024-09-12T02:02:13.323386+0000","last_clean":"2024-09-12T02:02:13.323386+0000","last_became_active":"2024-09-12T02:02:12.346223+0000","last_became_peered":"2024-09-12T02:02:12.346223+0000","last_unstale":"2024-09-12T02:02:13.323386+0000","last_undegraded":"2024-09-12T02:02:13.323386+0000","last_fullsized":"2024-09-12T02:02:13.323386+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:44.146381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.413328+0000","last_change":"2024-09-12T02:02:12.331869+0000","last_active":"2024-09-12T02:02:13.413328+0000","last_peered":"2024-09-12T02:02:13.413328+0000","last_clean":"2024-09-12T02:02:13.413328+0000","last_became_active":"2024-09-12T02:02:12.331585+0000","last_became_peered":"2024-09-12T02:02:12.331585+0000","last_unstale":"2024-09-12T02:02:13.413328+0000","last_undegraded":"2024-09-12T02:02:13.413328+0000","last_fullsized":"2024-09-12T02:02:13.413328+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:52.626338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.413744+0000","last_change":"2024-09-12T02:02:12.349310+0000","last_active":"2024-09-12T02:02:13.413744+0000","last_peered":"2024-09-12T02:02:13.413744+0000","last_clean":"2024-09-12T02:02:13.413744+0000","last_became_active":"2024-09-12T02:02:12.349030+0000","last_became_peered":"2024-09-12T02:02:12.349030+0000","last_unstale":"2024-09-12T02:02:13.413744+0000","last_undegraded":"2024-09-12T02:02:13.413744+0000","last_fullsized":"2024-09-12T02:02:13.413744+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:13.054774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412462+0000","last_change":"2024-09-12T02:02:12.340402+0000","last_active":"2024-09-12T02:02:13.412462+0000","last_peered":"2024-09-12T02:02:13.412462+0000","last_clean":"2024-09-12T02:02:13.412462+0000","last_became_active":"2024-09-12T02:02:12.340024+0000","last_became_peered":"2024-09-12T02:02:12.340024+0000","last_unstale":"2024-09-12T02:02:13.412462+0000","last_undegraded":"2024-09-12T02:02:13.412462+0000","last_fullsized":"2024-09-12T02:02:13.412462+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:24.518549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323213+0000","last_change":"2024-09-12T02:02:12.347261+0000","last_active":"2024-09-12T02:02:13.323213+0000","last_peered":"2024-09-12T02:02:13.323213+0000","last_clean":"2024-09-12T02:02:13.323213+0000","last_became_active":"2024-09-12T02:02:12.346558+0000","last_became_peered":"2024-09-12T02:02:12.346558+0000","last_unstale":"2024-09-12T02:02:13.323213+0000","last_undegraded":"2024-09-12T02:02:13.323213+0000","last_fullsized":"2024-09-12T02:02:13.323213+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:13.054774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340407+0000","last_change":"2024-09-12T02:02:12.343209+0000","last_active":"2024-09-12T02:02:13.340407+0000","last_peered":"2024-09-12T02:02:13.340407+0000","last_clean":"2024-09-12T02:02:13.340407+0000","last_became_active":"2024-09-12T02:02:12.342918+0000","last_became_peered":"2024-09-12T02:02:12.342918+0000","last_unstale":"2024-09-12T02:02:13.340407+0000","last_undegraded":"2024-09-12T02:02:13.340407+0000","last_fullsized":"2024-09-12T02:02:13.340407+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:20.594709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.319443+0000","last_change":"2024-09-12T02:02:12.327747+0000","last_active":"2024-09-12T02:02:13.319443+0000","last_peered":"2024-09-12T02:02:13.319443+0000","last_clean":"2024-09-12T02:02:13.319443+0000","last_became_active":"2024-09-12T02:02:12.327465+0000","last_became_peered":"2024-09-12T02:02:12.327465+0000","last_unstale":"2024-09-12T02:02:13.319443+0000","last_undegraded":"2024-09-12T02:02:13.319443+0000","last_fullsized":"2024-09-12T02:02:13.319443+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:45.767151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.319594+0000","last_change":"2024-09-12T02:02:12.351000+0000","last_active":"2024-09-12T02:02:13.319594+0000","last_peered":"2024-09-12T02:02:13.319594+0000","last_clean":"2024-09-12T02:02:13.319594+0000","last_became_active":"2024-09-12T02:02:12.350573+0000","last_became_peered":"2024-09-12T02:02:12.350573+0000","last_unstale":"2024-09-12T02:02:13.319594+0000","last_undegraded":"2024-09-12T02:02:13.319594+0000","last_fullsized":"2024-09-12T02:02:13.319594+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:30.212511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"92'4","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.324080+0000","last_change":"2024-09-12T02:02:11.333328+0000","last_active":"2024-09-12T02:02:13.324080+0000","last_peered":"2024-09-12T02:02:13.324080+0000","last_clean":"2024-09-12T02:02:13.324080+0000","last_became_active":"2024-09-12T02:02:11.333075+0000","last_became_peered":"2024-09-12T02:02:11.333075+0000","last_unstale":"2024-09-12T02:02:13.324080+0000","last_undegraded":"2024-09-12T02:02:13.324080+0000","last_fullsized":"2024-09-12T02:02:13.324080+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:36.748542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.319938+0000","last_change":"2024-09-12T02:02:12.330259+0000","last_active":"2024-09-12T02:02:13.319938+0000","last_peered":"2024-09-12T02:02:13.319938+0000","last_clean":"2024-09-12T02:02:13.319938+0000","last_became_active":"2024-09-12T02:02:12.329970+0000","last_became_peered":"2024-09-12T02:02:12.329970+0000","last_unstale":"2024-09-12T02:02:13.319938+0000","last_undegraded":"2024-09-12T02:02:13.319938+0000","last_fullsized":"2024-09-12T02:02:13.319938+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:37.724090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323426+0000","last_change":"2024-09-12T02:02:11.329594+0000","last_active":"2024-09-12T02:02:13.323426+0000","last_peered":"2024-09-12T02:02:13.323426+0000","last_clean":"2024-09-12T02:02:13.323426+0000","last_became_active":"2024-09-12T02:02:11.329256+0000","last_became_peered":"2024-09-12T02:02:11.329256+0000","last_unstale":"2024-09-12T02:02:13.323426+0000","last_undegraded":"2024-09-12T02:02:13.323426+0000","last_fullsized":"2024-09-12T02:02:13.323426+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:33.725746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412555+0000","last_change":"2024-09-12T02:02:12.337973+0000","last_active":"2024-09-12T02:02:13.412555+0000","last_peered":"2024-09-12T02:02:13.412555+0000","last_clean":"2024-09-12T02:02:13.412555+0000","last_became_active":"2024-09-12T02:02:12.337659+0000","last_became_peered":"2024-09-12T02:02:12.337659+0000","last_unstale":"2024-09-12T02:02:13.412555+0000","last_undegraded":"2024-09-12T02:02:13.412555+0000","last_fullsized":"2024-09-12T02:02:13.412555+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:10.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412473+0000","last_change":"2024-09-12T02:02:11.333138+0000","last_active":"2024-09-12T02:02:13.412473+0000","last_peered":"2024-09-12T02:02:13.412473+0000","last_clean":"2024-09-12T02:02:13.412473+0000","last_became_active":"2024-09-12T02:02:11.332790+0000","last_became_peered":"2024-09-12T02:02:11.332790+0000","last_unstale":"2024-09-12T02:02:13.412473+0000","last_undegraded":"2024-09-12T02:02:13.412473+0000","last_fullsized":"2024-09-12T02:02:13.412473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:57.281562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.320073+0000","last_change":"2024-09-12T02:02:12.333076+0000","last_active":"2024-09-12T02:02:13.320073+0000","last_peered":"2024-09-12T02:02:13.320073+0000","last_clean":"2024-09-12T02:02:13.320073+0000","last_became_active":"2024-09-12T02:02:12.332851+0000","last_became_peered":"2024-09-12T02:02:12.332851+0000","last_unstale":"2024-09-12T02:02:13.320073+0000","last_undegraded":"2024-09-12T02:02:13.320073+0000","last_fullsized":"2024-09-12T02:02:13.320073+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:07.758473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323549+0000","last_change":"2024-09-12T02:02:11.332340+0000","last_active":"2024-09-12T02:02:13.323549+0000","last_peered":"2024-09-12T02:02:13.323549+0000","last_clean":"2024-09-12T02:02:13.323549+0000","last_became_active":"2024-09-12T02:02:11.332101+0000","last_became_peered":"2024-09-12T02:02:11.332101+0000","last_unstale":"2024-09-12T02:02:13.323549+0000","last_undegraded":"2024-09-12T02:02:13.323549+0000","last_fullsized":"2024-09-12T02:02:13.323549+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.886557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412636+0000","last_change":"2024-09-12T02:02:12.325486+0000","last_active":"2024-09-12T02:02:13.412636+0000","last_peered":"2024-09-12T02:02:13.412636+0000","last_clean":"2024-09-12T02:02:13.412636+0000","last_became_active":"2024-09-12T02:02:12.325177+0000","last_became_peered":"2024-09-12T02:02:12.325177+0000","last_unstale":"2024-09-12T02:02:13.412636+0000","last_undegraded":"2024-09-12T02:02:13.412636+0000","last_fullsized":"2024-09-12T02:02:13.412636+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:06.449399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323636+0000","last_change":"2024-09-12T02:02:11.333899+0000","last_active":"2024-09-12T02:02:13.323636+0000","last_peered":"2024-09-12T02:02:13.323636+0000","last_clean":"2024-09-12T02:02:13.323636+0000","last_became_active":"2024-09-12T02:02:11.333612+0000","last_became_peered":"2024-09-12T02:02:11.333612+0000","last_unstale":"2024-09-12T02:02:13.323636+0000","last_undegraded":"2024-09-12T02:02:13.323636+0000","last_fullsized":"2024-09-12T02:02:13.323636+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:25.822689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.322959+0000","last_change":"2024-09-12T02:02:12.339670+0000","last_active":"2024-09-12T02:02:13.322959+0000","last_peered":"2024-09-12T02:02:13.322959+0000","last_clean":"2024-09-12T02:02:13.322959+0000","last_became_active":"2024-09-12T02:02:12.339401+0000","last_became_peered":"2024-09-12T02:02:12.339401+0000","last_unstale":"2024-09-12T02:02:13.322959+0000","last_undegraded":"2024-09-12T02:02:13.322959+0000","last_fullsized":"2024-09-12T02:02:13.322959+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:39.396515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.413255+0000","last_change":"2024-09-12T02:02:11.336467+0000","last_active":"2024-09-12T02:02:13.413255+0000","last_peered":"2024-09-12T02:02:13.413255+0000","last_clean":"2024-09-12T02:02:13.413255+0000","last_became_active":"2024-09-12T02:02:11.336029+0000","last_became_peered":"2024-09-12T02:02:11.336029+0000","last_unstale":"2024-09-12T02:02:13.413255+0000","last_undegraded":"2024-09-12T02:02:13.413255+0000","last_fullsized":"2024-09-12T02:02:13.413255+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:33.725746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.319622+0000","last_change":"2024-09-12T02:02:12.338526+0000","last_active":"2024-09-12T02:02:13.319622+0000","last_peered":"2024-09-12T02:02:13.319622+0000","last_clean":"2024-09-12T02:02:13.319622+0000","last_became_active":"2024-09-12T02:02:12.338174+0000","last_became_peered":"2024-09-12T02:02:12.338174+0000","last_unstale":"2024-09-12T02:02:13.319622+0000","last_undegraded":"2024-09-12T02:02:13.319622+0000","last_fullsized":"2024-09-12T02:02:13.319622+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:50.745551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.413375+0000","last_change":"2024-09-12T02:02:11.326331+0000","last_active":"2024-09-12T02:02:13.413375+0000","last_peered":"2024-09-12T02:02:13.413375+0000","last_clean":"2024-09-12T02:02:13.413375+0000","last_became_active":"2024-09-12T02:02:11.326051+0000","last_became_peered":"2024-09-12T02:02:11.326051+0000","last_unstale":"2024-09-12T02:02:13.413375+0000","last_undegraded":"2024-09-12T02:02:13.413375+0000","last_fullsized":"2024-09-12T02:02:13.413375+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:14.638980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.413267+0000","last_change":"2024-09-12T02:02:12.335645+0000","last_active":"2024-09-12T02:02:13.413267+0000","last_peered":"2024-09-12T02:02:13.413267+0000","last_clean":"2024-09-12T02:02:13.413267+0000","last_became_active":"2024-09-12T02:02:12.335371+0000","last_became_peered":"2024-09-12T02:02:12.335371+0000","last_unstale":"2024-09-12T02:02:13.413267+0000","last_undegraded":"2024-09-12T02:02:13.413267+0000","last_fullsized":"2024-09-12T02:02:13.413267+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:28.671046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412357+0000","last_change":"2024-09-12T02:02:11.334790+0000","last_active":"2024-09-12T02:02:13.412357+0000","last_peered":"2024-09-12T02:02:13.412357+0000","last_clean":"2024-09-12T02:02:13.412357+0000","last_became_active":"2024-09-12T02:02:11.334505+0000","last_became_peered":"2024-09-12T02:02:11.334505+0000","last_unstale":"2024-09-12T02:02:13.412357+0000","last_undegraded":"2024-09-12T02:02:13.412357+0000","last_fullsized":"2024-09-12T02:02:13.412357+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:24.342640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323132+0000","last_change":"2024-09-12T02:02:12.343008+0000","last_active":"2024-09-12T02:02:13.323132+0000","last_peered":"2024-09-12T02:02:13.323132+0000","last_clean":"2024-09-12T02:02:13.323132+0000","last_became_active":"2024-09-12T02:02:12.342697+0000","last_became_peered":"2024-09-12T02:02:12.342697+0000","last_unstale":"2024-09-12T02:02:13.323132+0000","last_undegraded":"2024-09-12T02:02:13.323132+0000","last_fullsized":"2024-09-12T02:02:13.323132+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:07.908032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340682+0000","last_change":"2024-09-12T02:02:11.333595+0000","last_active":"2024-09-12T02:02:13.340682+0000","last_peered":"2024-09-12T02:02:13.340682+0000","last_clean":"2024-09-12T02:02:13.340682+0000","last_became_active":"2024-09-12T02:02:11.333243+0000","last_became_peered":"2024-09-12T02:02:11.333243+0000","last_unstale":"2024-09-12T02:02:13.340682+0000","last_undegraded":"2024-09-12T02:02:13.340682+0000","last_fullsized":"2024-09-12T02:02:13.340682+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:12.239695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412571+0000","last_change":"2024-09-12T02:02:12.350425+0000","last_active":"2024-09-12T02:02:13.412571+0000","last_peered":"2024-09-12T02:02:13.412571+0000","last_clean":"2024-09-12T02:02:13.412571+0000","last_became_active":"2024-09-12T02:02:12.350139+0000","last_became_peered":"2024-09-12T02:02:12.350139+0000","last_unstale":"2024-09-12T02:02:13.412571+0000","last_undegraded":"2024-09-12T02:02:13.412571+0000","last_fullsized":"2024-09-12T02:02:13.412571+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:52.606535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.413149+0000","last_change":"2024-09-12T02:02:11.333135+0000","last_active":"2024-09-12T02:02:13.413149+0000","last_peered":"2024-09-12T02:02:13.413149+0000","last_clean":"2024-09-12T02:02:13.413149+0000","last_became_active":"2024-09-12T02:02:11.332827+0000","last_became_peered":"2024-09-12T02:02:11.332827+0000","last_unstale":"2024-09-12T02:02:13.413149+0000","last_undegraded":"2024-09-12T02:02:13.413149+0000","last_fullsized":"2024-09-12T02:02:13.413149+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:47.007799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.413066+0000","last_change":"2024-09-12T02:02:12.334298+0000","last_active":"2024-09-12T02:02:13.413066+0000","last_peered":"2024-09-12T02:02:13.413066+0000","last_clean":"2024-09-12T02:02:13.413066+0000","last_became_active":"2024-09-12T02:02:12.334014+0000","last_became_peered":"2024-09-12T02:02:12.334014+0000","last_unstale":"2024-09-12T02:02:13.413066+0000","last_undegraded":"2024-09-12T02:02:13.413066+0000","last_fullsized":"2024-09-12T02:02:13.413066+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:01.811314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"92'3","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.324019+0000","last_change":"2024-09-12T02:02:11.335601+0000","last_active":"2024-09-12T02:02:13.324019+0000","last_peered":"2024-09-12T02:02:13.324019+0000","last_clean":"2024-09-12T02:02:13.324019+0000","last_became_active":"2024-09-12T02:02:11.335331+0000","last_became_peered":"2024-09-12T02:02:11.335331+0000","last_unstale":"2024-09-12T02:02:13.324019+0000","last_undegraded":"2024-09-12T02:02:13.324019+0000","last_fullsized":"2024-09-12T02:02:13.324019+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:11.233739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.413102+0000","last_change":"2024-09-12T02:02:12.339385+0000","last_active":"2024-09-12T02:02:13.413102+0000","last_peered":"2024-09-12T02:02:13.413102+0000","last_clean":"2024-09-12T02:02:13.413102+0000","last_became_active":"2024-09-12T02:02:12.339076+0000","last_became_peered":"2024-09-12T02:02:12.339076+0000","last_unstale":"2024-09-12T02:02:13.413102+0000","last_undegraded":"2024-09-12T02:02:13.413102+0000","last_fullsized":"2024-09-12T02:02:13.413102+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:28.792946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"92'6","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.319801+0000","last_change":"2024-09-12T02:02:11.332578+0000","last_active":"2024-09-12T02:02:13.319801+0000","last_peered":"2024-09-12T02:02:13.319801+0000","last_clean":"2024-09-12T02:02:13.319801+0000","last_became_active":"2024-09-12T02:02:11.332190+0000","last_became_peered":"2024-09-12T02:02:11.332190+0000","last_unstale":"2024-09-12T02:02:13.319801+0000","last_undegraded":"2024-09-12T02:02:13.319801+0000","last_fullsized":"2024-09-12T02:02:13.319801+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:48.070182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412773+0000","last_change":"2024-09-12T02:02:12.332687+0000","last_active":"2024-09-12T02:02:13.412773+0000","last_peered":"2024-09-12T02:02:13.412773+0000","last_clean":"2024-09-12T02:02:13.412773+0000","last_became_active":"2024-09-12T02:02:12.332386+0000","last_became_peered":"2024-09-12T02:02:12.332386+0000","last_unstale":"2024-09-12T02:02:13.412773+0000","last_undegraded":"2024-09-12T02:02:13.412773+0000","last_fullsized":"2024-09-12T02:02:13.412773+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:28.374060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412589+0000","last_change":"2024-09-12T02:02:11.335419+0000","last_active":"2024-09-12T02:02:13.412589+0000","last_peered":"2024-09-12T02:02:13.412589+0000","last_clean":"2024-09-12T02:02:13.412589+0000","last_became_active":"2024-09-12T02:02:11.335199+0000","last_became_peered":"2024-09-12T02:02:11.335199+0000","last_unstale":"2024-09-12T02:02:13.412589+0000","last_undegraded":"2024-09-12T02:02:13.412589+0000","last_fullsized":"2024-09-12T02:02:13.412589+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:19.589222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.322793+0000","last_change":"2024-09-12T02:02:12.340797+0000","last_active":"2024-09-12T02:02:13.322793+0000","last_peered":"2024-09-12T02:02:13.322793+0000","last_clean":"2024-09-12T02:02:13.322793+0000","last_became_active":"2024-09-12T02:02:12.340456+0000","last_became_peered":"2024-09-12T02:02:12.340456+0000","last_unstale":"2024-09-12T02:02:13.322793+0000","last_undegraded":"2024-09-12T02:02:13.322793+0000","last_fullsized":"2024-09-12T02:02:13.322793+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:28.374060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.319612+0000","last_change":"2024-09-12T02:02:11.334793+0000","last_active":"2024-09-12T02:02:13.319612+0000","last_peered":"2024-09-12T02:02:13.319612+0000","last_clean":"2024-09-12T02:02:13.319612+0000","last_became_active":"2024-09-12T02:02:11.334335+0000","last_became_peered":"2024-09-12T02:02:11.334335+0000","last_unstale":"2024-09-12T02:02:13.319612+0000","last_undegraded":"2024-09-12T02:02:13.319612+0000","last_fullsized":"2024-09-12T02:02:13.319612+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:34.830322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412697+0000","last_change":"2024-09-12T02:02:12.329549+0000","last_active":"2024-09-12T02:02:13.412697+0000","last_peered":"2024-09-12T02:02:13.412697+0000","last_clean":"2024-09-12T02:02:13.412697+0000","last_became_active":"2024-09-12T02:02:12.329279+0000","last_became_peered":"2024-09-12T02:02:12.329279+0000","last_unstale":"2024-09-12T02:02:13.412697+0000","last_undegraded":"2024-09-12T02:02:13.412697+0000","last_fullsized":"2024-09-12T02:02:13.412697+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:46.376919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412808+0000","last_change":"2024-09-12T02:02:11.338109+0000","last_active":"2024-09-12T02:02:13.412808+0000","last_peered":"2024-09-12T02:02:13.412808+0000","last_clean":"2024-09-12T02:02:13.412808+0000","last_became_active":"2024-09-12T02:02:11.337827+0000","last_became_peered":"2024-09-12T02:02:11.337827+0000","last_unstale":"2024-09-12T02:02:13.412808+0000","last_undegraded":"2024-09-12T02:02:13.412808+0000","last_fullsized":"2024-09-12T02:02:13.412808+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:25.822689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.413532+0000","last_change":"2024-09-12T02:02:12.345192+0000","last_active":"2024-09-12T02:02:13.413532+0000","last_peered":"2024-09-12T02:02:13.413532+0000","last_clean":"2024-09-12T02:02:13.413532+0000","last_became_active":"2024-09-12T02:02:12.344763+0000","last_became_peered":"2024-09-12T02:02:12.344763+0000","last_unstale":"2024-09-12T02:02:13.413532+0000","last_undegraded":"2024-09-12T02:02:13.413532+0000","last_fullsized":"2024-09-12T02:02:13.413532+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:30.346920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"92'8","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412918+0000","last_change":"2024-09-12T02:02:11.336360+0000","last_active":"2024-09-12T02:02:13.412918+0000","last_peered":"2024-09-12T02:02:13.412918+0000","last_clean":"2024-09-12T02:02:13.412918+0000","last_became_active":"2024-09-12T02:02:11.336065+0000","last_became_peered":"2024-09-12T02:02:11.336065+0000","last_unstale":"2024-09-12T02:02:13.412918+0000","last_undegraded":"2024-09-12T02:02:13.412918+0000","last_fullsized":"2024-09-12T02:02:13.412918+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:11.233739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.319747+0000","last_change":"2024-09-12T02:02:12.350095+0000","last_active":"2024-09-12T02:02:13.319747+0000","last_peered":"2024-09-12T02:02:13.319747+0000","last_clean":"2024-09-12T02:02:13.319747+0000","last_became_active":"2024-09-12T02:02:12.349756+0000","last_became_peered":"2024-09-12T02:02:12.349756+0000","last_unstale":"2024-09-12T02:02:13.319747+0000","last_undegraded":"2024-09-12T02:02:13.319747+0000","last_fullsized":"2024-09-12T02:02:13.319747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:19.124921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.324132+0000","last_change":"2024-09-12T02:02:11.327980+0000","last_active":"2024-09-12T02:02:13.324132+0000","last_peered":"2024-09-12T02:02:13.324132+0000","last_clean":"2024-09-12T02:02:13.324132+0000","last_became_active":"2024-09-12T02:02:11.327687+0000","last_became_peered":"2024-09-12T02:02:11.327687+0000","last_unstale":"2024-09-12T02:02:13.324132+0000","last_undegraded":"2024-09-12T02:02:13.324132+0000","last_fullsized":"2024-09-12T02:02:13.324132+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:15.056421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323117+0000","last_change":"2024-09-12T02:02:12.333663+0000","last_active":"2024-09-12T02:02:13.323117+0000","last_peered":"2024-09-12T02:02:13.323117+0000","last_clean":"2024-09-12T02:02:13.323117+0000","last_became_active":"2024-09-12T02:02:12.333334+0000","last_became_peered":"2024-09-12T02:02:12.333334+0000","last_unstale":"2024-09-12T02:02:13.323117+0000","last_undegraded":"2024-09-12T02:02:13.323117+0000","last_fullsized":"2024-09-12T02:02:13.323117+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:08.450410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412473+0000","last_change":"2024-09-12T02:02:11.331682+0000","last_active":"2024-09-12T02:02:13.412473+0000","last_peered":"2024-09-12T02:02:13.412473+0000","last_clean":"2024-09-12T02:02:13.412473+0000","last_became_active":"2024-09-12T02:02:11.331384+0000","last_became_peered":"2024-09-12T02:02:11.331384+0000","last_unstale":"2024-09-12T02:02:13.412473+0000","last_undegraded":"2024-09-12T02:02:13.412473+0000","last_fullsized":"2024-09-12T02:02:13.412473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:30.836043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323319+0000","last_change":"2024-09-12T02:02:12.343913+0000","last_active":"2024-09-12T02:02:13.323319+0000","last_peered":"2024-09-12T02:02:13.323319+0000","last_clean":"2024-09-12T02:02:13.323319+0000","last_became_active":"2024-09-12T02:02:12.343659+0000","last_became_peered":"2024-09-12T02:02:12.343659+0000","last_unstale":"2024-09-12T02:02:13.323319+0000","last_undegraded":"2024-09-12T02:02:13.323319+0000","last_fullsized":"2024-09-12T02:02:13.323319+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:05.131424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.324068+0000","last_change":"2024-09-12T02:02:11.333247+0000","last_active":"2024-09-12T02:02:13.324068+0000","last_peered":"2024-09-12T02:02:13.324068+0000","last_clean":"2024-09-12T02:02:13.324068+0000","last_became_active":"2024-09-12T02:02:11.332967+0000","last_became_peered":"2024-09-12T02:02:11.332967+0000","last_unstale":"2024-09-12T02:02:13.324068+0000","last_undegraded":"2024-09-12T02:02:13.324068+0000","last_fullsized":"2024-09-12T02:02:13.324068+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:09.295690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.319616+0000","last_change":"2024-09-12T02:02:12.338322+0000","last_active":"2024-09-12T02:02:13.319616+0000","last_peered":"2024-09-12T02:02:13.319616+0000","last_clean":"2024-09-12T02:02:13.319616+0000","last_became_active":"2024-09-12T02:02:12.338015+0000","last_became_peered":"2024-09-12T02:02:12.338015+0000","last_unstale":"2024-09-12T02:02:13.319616+0000","last_undegraded":"2024-09-12T02:02:13.319616+0000","last_fullsized":"2024-09-12T02:02:13.319616+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:01.995325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340361+0000","last_change":"2024-09-12T02:02:11.332292+0000","last_active":"2024-09-12T02:02:13.340361+0000","last_peered":"2024-09-12T02:02:13.340361+0000","last_clean":"2024-09-12T02:02:13.340361+0000","last_became_active":"2024-09-12T02:02:11.332012+0000","last_became_peered":"2024-09-12T02:02:11.332012+0000","last_unstale":"2024-09-12T02:02:13.340361+0000","last_undegraded":"2024-09-12T02:02:13.340361+0000","last_fullsized":"2024-09-12T02:02:13.340361+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:31.076337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340404+0000","last_change":"2024-09-12T02:02:12.349435+0000","last_active":"2024-09-12T02:02:13.340404+0000","last_peered":"2024-09-12T02:02:13.340404+0000","last_clean":"2024-09-12T02:02:13.340404+0000","last_became_active":"2024-09-12T02:02:12.347614+0000","last_became_peered":"2024-09-12T02:02:12.347614+0000","last_unstale":"2024-09-12T02:02:13.340404+0000","last_undegraded":"2024-09-12T02:02:13.340404+0000","last_fullsized":"2024-09-12T02:02:13.340404+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:29.496591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412784+0000","last_change":"2024-09-12T02:02:11.330103+0000","last_active":"2024-09-12T02:02:13.412784+0000","last_peered":"2024-09-12T02:02:13.412784+0000","last_clean":"2024-09-12T02:02:13.412784+0000","last_became_active":"2024-09-12T02:02:11.329822+0000","last_became_peered":"2024-09-12T02:02:11.329822+0000","last_unstale":"2024-09-12T02:02:13.412784+0000","last_undegraded":"2024-09-12T02:02:13.412784+0000","last_fullsized":"2024-09-12T02:02:13.412784+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:00.660882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340435+0000","last_change":"2024-09-12T02:02:12.343786+0000","last_active":"2024-09-12T02:02:13.340435+0000","last_peered":"2024-09-12T02:02:13.340435+0000","last_clean":"2024-09-12T02:02:13.340435+0000","last_became_active":"2024-09-12T02:02:12.343506+0000","last_became_peered":"2024-09-12T02:02:12.343506+0000","last_unstale":"2024-09-12T02:02:13.340435+0000","last_undegraded":"2024-09-12T02:02:13.340435+0000","last_fullsized":"2024-09-12T02:02:13.340435+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:58.287049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340526+0000","last_change":"2024-09-12T02:02:11.337862+0000","last_active":"2024-09-12T02:02:13.340526+0000","last_peered":"2024-09-12T02:02:13.340526+0000","last_clean":"2024-09-12T02:02:13.340526+0000","last_became_active":"2024-09-12T02:02:11.337384+0000","last_became_peered":"2024-09-12T02:02:11.337384+0000","last_unstale":"2024-09-12T02:02:13.340526+0000","last_undegraded":"2024-09-12T02:02:13.340526+0000","last_fullsized":"2024-09-12T02:02:13.340526+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:03.587791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.319597+0000","last_change":"2024-09-12T02:02:12.332334+0000","last_active":"2024-09-12T02:02:13.319597+0000","last_peered":"2024-09-12T02:02:13.319597+0000","last_clean":"2024-09-12T02:02:13.319597+0000","last_became_active":"2024-09-12T02:02:12.331814+0000","last_became_peered":"2024-09-12T02:02:12.331814+0000","last_unstale":"2024-09-12T02:02:13.319597+0000","last_undegraded":"2024-09-12T02:02:13.319597+0000","last_fullsized":"2024-09-12T02:02:13.319597+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:09.838722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.413047+0000","last_change":"2024-09-12T02:02:11.329706+0000","last_active":"2024-09-12T02:02:13.413047+0000","last_peered":"2024-09-12T02:02:13.413047+0000","last_clean":"2024-09-12T02:02:13.413047+0000","last_became_active":"2024-09-12T02:02:11.329422+0000","last_became_peered":"2024-09-12T02:02:11.329422+0000","last_unstale":"2024-09-12T02:02:13.413047+0000","last_undegraded":"2024-09-12T02:02:13.413047+0000","last_fullsized":"2024-09-12T02:02:13.413047+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:17.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323458+0000","last_change":"2024-09-12T02:02:12.334098+0000","last_active":"2024-09-12T02:02:13.323458+0000","last_peered":"2024-09-12T02:02:13.323458+0000","last_clean":"2024-09-12T02:02:13.323458+0000","last_became_active":"2024-09-12T02:02:12.332786+0000","last_became_peered":"2024-09-12T02:02:12.332786+0000","last_unstale":"2024-09-12T02:02:13.323458+0000","last_undegraded":"2024-09-12T02:02:13.323458+0000","last_fullsized":"2024-09-12T02:02:13.323458+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:15.955019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412678+0000","last_change":"2024-09-12T02:02:11.334960+0000","last_active":"2024-09-12T02:02:13.412678+0000","last_peered":"2024-09-12T02:02:13.412678+0000","last_clean":"2024-09-12T02:02:13.412678+0000","last_became_active":"2024-09-12T02:02:11.334693+0000","last_became_peered":"2024-09-12T02:02:11.334693+0000","last_unstale":"2024-09-12T02:02:13.412678+0000","last_undegraded":"2024-09-12T02:02:13.412678+0000","last_fullsized":"2024-09-12T02:02:13.412678+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:28.491104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.319938+0000","last_change":"2024-09-12T02:02:12.342917+0000","last_active":"2024-09-12T02:02:13.319938+0000","last_peered":"2024-09-12T02:02:13.319938+0000","last_clean":"2024-09-12T02:02:13.319938+0000","last_became_active":"2024-09-12T02:02:12.342611+0000","last_became_peered":"2024-09-12T02:02:12.342611+0000","last_unstale":"2024-09-12T02:02:13.319938+0000","last_undegraded":"2024-09-12T02:02:13.319938+0000","last_fullsized":"2024-09-12T02:02:13.319938+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:45.634181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"93'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323533+0000","last_change":"2024-09-12T02:02:11.331807+0000","last_active":"2024-09-12T02:02:13.323533+0000","last_peered":"2024-09-12T02:02:13.323533+0000","last_clean":"2024-09-12T02:02:13.323533+0000","last_became_active":"2024-09-12T02:02:11.331545+0000","last_became_peered":"2024-09-12T02:02:11.331545+0000","last_unstale":"2024-09-12T02:02:13.323533+0000","last_undegraded":"2024-09-12T02:02:13.323533+0000","last_fullsized":"2024-09-12T02:02:13.323533+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:05.134165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.320066+0000","last_change":"2024-09-12T02:02:12.331122+0000","last_active":"2024-09-12T02:02:13.320066+0000","last_peered":"2024-09-12T02:02:13.320066+0000","last_clean":"2024-09-12T02:02:13.320066+0000","last_became_active":"2024-09-12T02:02:12.330378+0000","last_became_peered":"2024-09-12T02:02:12.330378+0000","last_unstale":"2024-09-12T02:02:13.320066+0000","last_undegraded":"2024-09-12T02:02:13.320066+0000","last_fullsized":"2024-09-12T02:02:13.320066+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:03.955000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.324082+0000","last_change":"2024-09-12T02:02:11.335862+0000","last_active":"2024-09-12T02:02:13.324082+0000","last_peered":"2024-09-12T02:02:13.324082+0000","last_clean":"2024-09-12T02:02:13.324082+0000","last_became_active":"2024-09-12T02:02:11.335603+0000","last_became_peered":"2024-09-12T02:02:11.335603+0000","last_unstale":"2024-09-12T02:02:13.324082+0000","last_undegraded":"2024-09-12T02:02:13.324082+0000","last_fullsized":"2024-09-12T02:02:13.324082+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:27.512747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340679+0000","last_change":"2024-09-12T02:02:12.349940+0000","last_active":"2024-09-12T02:02:13.340679+0000","last_peered":"2024-09-12T02:02:13.340679+0000","last_clean":"2024-09-12T02:02:13.340679+0000","last_became_active":"2024-09-12T02:02:12.349675+0000","last_became_peered":"2024-09-12T02:02:12.349675+0000","last_unstale":"2024-09-12T02:02:13.340679+0000","last_undegraded":"2024-09-12T02:02:13.340679+0000","last_fullsized":"2024-09-12T02:02:13.340679+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:19.218621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323638+0000","last_change":"2024-09-12T02:02:11.331813+0000","last_active":"2024-09-12T02:02:13.323638+0000","last_peered":"2024-09-12T02:02:13.323638+0000","last_clean":"2024-09-12T02:02:13.323638+0000","last_became_active":"2024-09-12T02:02:11.331505+0000","last_became_peered":"2024-09-12T02:02:11.331505+0000","last_unstale":"2024-09-12T02:02:13.323638+0000","last_undegraded":"2024-09-12T02:02:13.323638+0000","last_fullsized":"2024-09-12T02:02:13.323638+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:31.234575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412956+0000","last_change":"2024-09-12T02:02:12.333131+0000","last_active":"2024-09-12T02:02:13.412956+0000","last_peered":"2024-09-12T02:02:13.412956+0000","last_clean":"2024-09-12T02:02:13.412956+0000","last_became_active":"2024-09-12T02:02:12.332829+0000","last_became_peered":"2024-09-12T02:02:12.332829+0000","last_unstale":"2024-09-12T02:02:13.412956+0000","last_undegraded":"2024-09-12T02:02:13.412956+0000","last_fullsized":"2024-09-12T02:02:13.412956+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:03.090943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.319816+0000","last_change":"2024-09-12T02:02:11.338517+0000","last_active":"2024-09-12T02:02:13.319816+0000","last_peered":"2024-09-12T02:02:13.319816+0000","last_clean":"2024-09-12T02:02:13.319816+0000","last_became_active":"2024-09-12T02:02:11.338195+0000","last_became_peered":"2024-09-12T02:02:11.338195+0000","last_unstale":"2024-09-12T02:02:13.319816+0000","last_undegraded":"2024-09-12T02:02:13.319816+0000","last_fullsized":"2024-09-12T02:02:13.319816+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:23.513062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.413247+0000","last_change":"2024-09-12T02:02:12.327683+0000","last_active":"2024-09-12T02:02:13.413247+0000","last_peered":"2024-09-12T02:02:13.413247+0000","last_clean":"2024-09-12T02:02:13.413247+0000","last_became_active":"2024-09-12T02:02:12.327416+0000","last_became_peered":"2024-09-12T02:02:12.327416+0000","last_unstale":"2024-09-12T02:02:13.413247+0000","last_undegraded":"2024-09-12T02:02:13.413247+0000","last_fullsized":"2024-09-12T02:02:13.413247+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:17.763866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.340551+0000","last_change":"2024-09-12T02:02:11.328426+0000","last_active":"2024-09-12T02:02:13.340551+0000","last_peered":"2024-09-12T02:02:13.340551+0000","last_clean":"2024-09-12T02:02:13.340551+0000","last_became_active":"2024-09-12T02:02:11.328217+0000","last_became_peered":"2024-09-12T02:02:11.328217+0000","last_unstale":"2024-09-12T02:02:13.340551+0000","last_undegraded":"2024-09-12T02:02:13.340551+0000","last_fullsized":"2024-09-12T02:02:13.340551+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:36.031506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323434+0000","last_change":"2024-09-12T02:02:12.340317+0000","last_active":"2024-09-12T02:02:13.323434+0000","last_peered":"2024-09-12T02:02:13.323434+0000","last_clean":"2024-09-12T02:02:13.323434+0000","last_became_active":"2024-09-12T02:02:12.340058+0000","last_became_peered":"2024-09-12T02:02:12.340058+0000","last_unstale":"2024-09-12T02:02:13.323434+0000","last_undegraded":"2024-09-12T02:02:13.323434+0000","last_fullsized":"2024-09-12T02:02:13.323434+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:07.388059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.323058+0000","last_change":"2024-09-12T02:02:11.327599+0000","last_active":"2024-09-12T02:02:13.323058+0000","last_peered":"2024-09-12T02:02:13.323058+0000","last_clean":"2024-09-12T02:02:13.323058+0000","last_became_active":"2024-09-12T02:02:11.327287+0000","last_became_peered":"2024-09-12T02:02:11.327287+0000","last_unstale":"2024-09-12T02:02:13.323058+0000","last_undegraded":"2024-09-12T02:02:13.323058+0000","last_fullsized":"2024-09-12T02:02:13.323058+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:30.857360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.319756+0000","last_change":"2024-09-12T02:02:12.332093+0000","last_active":"2024-09-12T02:02:13.319756+0000","last_peered":"2024-09-12T02:02:13.319756+0000","last_clean":"2024-09-12T02:02:13.319756+0000","last_became_active":"2024-09-12T02:02:12.331500+0000","last_became_peered":"2024-09-12T02:02:12.331500+0000","last_unstale":"2024-09-12T02:02:13.319756+0000","last_undegraded":"2024-09-12T02:02:13.319756+0000","last_fullsized":"2024-09-12T02:02:13.319756+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:20.183385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412398+0000","last_change":"2024-09-12T02:02:11.329064+0000","last_active":"2024-09-12T02:02:13.412398+0000","last_peered":"2024-09-12T02:02:13.412398+0000","last_clean":"2024-09-12T02:02:13.412398+0000","last_became_active":"2024-09-12T02:02:11.328800+0000","last_became_peered":"2024-09-12T02:02:11.328800+0000","last_unstale":"2024-09-12T02:02:13.412398+0000","last_undegraded":"2024-09-12T02:02:13.412398+0000","last_fullsized":"2024-09-12T02:02:13.412398+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:12.833485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412626+0000","last_change":"2024-09-12T02:02:12.341167+0000","last_active":"2024-09-12T02:02:13.412626+0000","last_peered":"2024-09-12T02:02:13.412626+0000","last_clean":"2024-09-12T02:02:13.412626+0000","last_became_active":"2024-09-12T02:02:12.340921+0000","last_became_peered":"2024-09-12T02:02:12.340921+0000","last_unstale":"2024-09-12T02:02:13.412626+0000","last_undegraded":"2024-09-12T02:02:13.412626+0000","last_fullsized":"2024-09-12T02:02:13.412626+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:11.308510+0000","last_clean_scrub_stamp":"2024-09-12T02:02:11.308510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.801762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.413750+0000","last_change":"2024-09-12T02:02:11.329351+0000","last_active":"2024-09-12T02:02:13.413750+0000","last_peered":"2024-09-12T02:02:13.413750+0000","last_clean":"2024-09-12T02:02:13.413750+0000","last_became_active":"2024-09-12T02:02:11.329049+0000","last_became_peered":"2024-09-12T02:02:11.329049+0000","last_unstale":"2024-09-12T02:02:13.413750+0000","last_undegraded":"2024-09-12T02:02:13.413750+0000","last_fullsized":"2024-09-12T02:02:13.413750+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:02:10.303023+0000","last_clean_scrub_stamp":"2024-09-12T02:02:10.303023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:09.295690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":304,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.412422+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T02:02:13.412422+0000","last_peered":"2024-09-12T02:02:13.412422+0000","last_clean":"2024-09-12T02:02:13.412422+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T02:02:13.412422+0000","last_undegraded":"2024-09-12T02:02:13.412422+0000","last_fullsized":"2024-09-12T02:02:13.412422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509522,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32888,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338952,"statfs":{"total":96636764160,"available":96603086848,"internally_reserved":0,"allocated":1740800,"data_stored":1119434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509521,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1159168,"data_stored":531226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509522,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1138688,"data_stored":529010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542227,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1138688,"data_stored":529010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542227,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1138688,"data_stored":529010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542227,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28148,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343692,"statfs":{"total":96636764160,"available":96607940608,"internally_reserved":0,"allocated":1142784,"data_stored":529080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542227,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1757184,"data_stored":1121696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1146880,"data_stored":529170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:02:20.080 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:02:20.080 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:02:20.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.227+0000 7f78b6d9f640 1 Processor -- start 2024-09-12T02:02:20.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.227+0000 7f78b6d9f640 1 -- start start 2024-09-12T02:02:20.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.228+0000 7f78b6d9f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78b0162990 0x7f78b00ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:20.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.228+0000 7f78b6d9f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b00d2b50 con 0x7f78b006e6b0 2024-09-12T02:02:20.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.228+0000 7f78b6d9f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b00d2e30 con 0x7f78b00d4360 2024-09-12T02:02:20.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.228+0000 7f78b6d9f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f78b00b3af0 con 0x7f78b0162990 2024-09-12T02:02:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.228+0000 7f78b559c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f78b006e6b0 0x7f78b006dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39130/0 (socket says 172.21.15.19:39130) 2024-09-12T02:02:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.228+0000 7f78b559c640 1 -- 172.21.15.19:0/3175893068 learned_addr learned my addr 172.21.15.19:0/3175893068 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.228+0000 7f78b659e640 1 --2- 172.21.15.19:0/3175893068 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78b0162990 0x7f78b00ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.228+0000 7f78b4d9b640 1 -- 172.21.15.19:0/3175893068 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 753067899 0 0) 0x7f78b00d2b50 con 0x7f78b006e6b0 2024-09-12T02:02:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.228+0000 7f78b4d9b640 1 -- 172.21.15.19:0/3175893068 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f789c003520 con 0x7f78b006e6b0 2024-09-12T02:02:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b4d9b640 1 -- 172.21.15.19:0/3175893068 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3897707956 0 0) 0x7f78b00d2e30 con 0x7f78b00d4360 2024-09-12T02:02:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b4d9b640 1 -- 172.21.15.19:0/3175893068 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78b00d2b50 con 0x7f78b00d4360 2024-09-12T02:02:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b4d9b640 1 -- 172.21.15.19:0/3175893068 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2673883411 0 0) 0x7f789c003520 con 0x7f78b006e6b0 2024-09-12T02:02:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b4d9b640 1 -- 172.21.15.19:0/3175893068 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78b0162990 msgr2=0x7f78b00ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b4d9b640 1 --2- 172.21.15.19:0/3175893068 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78b0162990 0x7f78b00ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b4d9b640 1 -- 172.21.15.19:0/3175893068 >> v1:172.21.15.135:6789/0 conn(0x7f78b00d4360 legacy=0x7f78b00d4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b4d9b640 1 -- 172.21.15.19:0/3175893068 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b006d1a0 con 0x7f78b006e6b0 2024-09-12T02:02:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b4d9b640 1 -- 172.21.15.19:0/3175893068 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f78a0001670 con 0x7f78b006e6b0 2024-09-12T02:02:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b659e640 1 --2- 172.21.15.19:0/3175893068 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78b0162990 0x7f78b00ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b4d9b640 1 -- 172.21.15.19:0/3175893068 >> v1:172.21.15.19:6789/0 conn(0x7f78b006e6b0 legacy=0x7f78b006dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b4d9b640 1 --2- 172.21.15.19:0/3175893068 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78b0162990 0x7f789c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b4d9b640 1 --2- 172.21.15.19:0/3175893068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f789c004100 0x7f789c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b4d9b640 1 --2- 172.21.15.19:0/3175893068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f789c004d40 0x7f789c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b4d9b640 1 -- 172.21.15.19:0/3175893068 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f78b00b3af0 con 0x7f789c004100 2024-09-12T02:02:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b4d9b640 1 -- 172.21.15.19:0/3175893068 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f789c00bad0 con 0x7f789c004d40 2024-09-12T02:02:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b4d9b640 1 -- 172.21.15.19:0/3175893068 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f789c00bcd0 con 0x7f78b0162990 2024-09-12T02:02:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b559c640 1 --2- 172.21.15.19:0/3175893068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f789c004100 0x7f789c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b5d9d640 1 --2- 172.21.15.19:0/3175893068 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78b0162990 0x7f789c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b659e640 1 --2- 172.21.15.19:0/3175893068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f789c004d40 0x7f789c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b559c640 1 -- 172.21.15.19:0/3175893068 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78b0162990 msgr2=0x7f789c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b559c640 1 --2- 172.21.15.19:0/3175893068 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78b0162990 0x7f789c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b559c640 1 -- 172.21.15.19:0/3175893068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f789c004d40 msgr2=0x7f789c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:20.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b559c640 1 --2- 172.21.15.19:0/3175893068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f789c004d40 0x7f789c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.229+0000 7f78b559c640 1 -- 172.21.15.19:0/3175893068 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f789c003520 con 0x7f789c004100 2024-09-12T02:02:20.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.230+0000 7f78b559c640 1 --2- 172.21.15.19:0/3175893068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f789c004100 0x7f789c004800 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f78a0001eb0 tx=0x7f789c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f8b6750b43f98d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:20.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.230+0000 7f78b4d9b640 1 -- 172.21.15.19:0/3175893068 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0007c00 con 0x7f789c004100 2024-09-12T02:02:20.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.230+0000 7f78b4d9b640 1 -- 172.21.15.19:0/3175893068 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a0005af0 con 0x7f789c004100 2024-09-12T02:02:20.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.230+0000 7f78b4d9b640 1 -- 172.21.15.19:0/3175893068 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0007070 con 0x7f789c004100 2024-09-12T02:02:20.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.231+0000 7f78b6d9f640 1 -- 172.21.15.19:0/3175893068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f789c004100 msgr2=0x7f789c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:20.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.231+0000 7f78b6d9f640 1 --2- 172.21.15.19:0/3175893068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f789c004100 0x7f789c004800 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f78a0001eb0 tx=0x7f789c005830 comp rx=0 tx=0).stop 2024-09-12T02:02:20.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.231+0000 7f78b659e640 1 -- 172.21.15.19:0/3175893068 reap_dead start 2024-09-12T02:02:20.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.231+0000 7f78b6d9f640 1 -- 172.21.15.19:0/3175893068 shutdown_connections 2024-09-12T02:02:20.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.231+0000 7f78b6d9f640 1 -- 172.21.15.19:0/3175893068 >> 172.21.15.19:0/3175893068 conn(0x7f78b009d740 msgr2=0x7f78b008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:20.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.231+0000 7f78b6d9f640 1 -- 172.21.15.19:0/3175893068 shutdown_connections 2024-09-12T02:02:20.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.231+0000 7f78b6d9f640 1 -- 172.21.15.19:0/3175893068 wait complete. 2024-09-12T02:02:20.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.232+0000 7f78b6d9f640 1 Processor -- start 2024-09-12T02:02:20.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.232+0000 7f78b6d9f640 1 -- start start 2024-09-12T02:02:20.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b6d9f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f789c004100 0x7f78b00b81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:20.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b6d9f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78b00cdef0 0x7f78b0152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:20.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b6d9f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b0160ab0 0x7f78b0160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:20.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b6d9f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f78b0162e20 con 0x7f78b00cdef0 2024-09-12T02:02:20.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b6d9f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f78b006d760 con 0x7f78b0160ab0 2024-09-12T02:02:20.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b6d9f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f78b006e390 con 0x7f789c004100 2024-09-12T02:02:20.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b559c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78b00cdef0 0x7f78b0152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:20.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b559c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78b00cdef0 0x7f78b0152930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35238/0 (socket says 172.21.15.19:35238) 2024-09-12T02:02:20.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b559c640 1 -- 172.21.15.19:0/3342594322 learned_addr learned my addr 172.21.15.19:0/3342594322 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:20.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b5d9d640 1 --2- 172.21.15.19:0/3342594322 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f789c004100 0x7f78b00b81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:20.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b659e640 1 --2- 172.21.15.19:0/3342594322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b0160ab0 0x7f78b0160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:20.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b559c640 1 -- 172.21.15.19:0/3342594322 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f789c004100 msgr2=0x7f78b00b81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:20.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b559c640 1 --2- 172.21.15.19:0/3342594322 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f789c004100 0x7f78b00b81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b559c640 1 -- 172.21.15.19:0/3342594322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b0160ab0 msgr2=0x7f78b0160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:20.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b559c640 1 --2- 172.21.15.19:0/3342594322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b0160ab0 0x7f78b0160ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b559c640 1 -- 172.21.15.19:0/3342594322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b00b7400 con 0x7f78b00cdef0 2024-09-12T02:02:20.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b659e640 1 --2- 172.21.15.19:0/3342594322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b0160ab0 0x7f78b0160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:20.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b5d9d640 1 --2- 172.21.15.19:0/3342594322 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f789c004100 0x7f78b00b81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:20.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78b559c640 1 --2- 172.21.15.19:0/3342594322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78b00cdef0 0x7f78b0152930 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f78a002aca0 tx=0x7f78a0001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:20.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78a67fc640 1 -- 172.21.15.19:0/3342594322 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0043070 con 0x7f78b00cdef0 2024-09-12T02:02:20.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.233+0000 7f78a67fc640 1 -- 172.21.15.19:0/3342594322 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a0038040 con 0x7f78b00cdef0 2024-09-12T02:02:20.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.234+0000 7f78b6d9f640 1 -- 172.21.15.19:0/3342594322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b00b76e0 con 0x7f78b00cdef0 2024-09-12T02:02:20.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.234+0000 7f78a67fc640 1 -- 172.21.15.19:0/3342594322 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0001670 con 0x7f78b00cdef0 2024-09-12T02:02:20.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.234+0000 7f78b6d9f640 1 -- 172.21.15.19:0/3342594322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b0152e70 con 0x7f78b00cdef0 2024-09-12T02:02:20.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.234+0000 7f78b6d9f640 1 -- 172.21.15.19:0/3342594322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b0161430 con 0x7f78b00cdef0 2024-09-12T02:02:20.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.235+0000 7f78a67fc640 1 -- 172.21.15.19:0/3342594322 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78a0007270 con 0x7f78b00cdef0 2024-09-12T02:02:20.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.235+0000 7f78a67fc640 1 --2- 172.21.15.19:0/3342594322 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f789406be30 0x7f789406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:20.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.236+0000 7f78a67fc640 1 -- 172.21.15.19:0/3342594322 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6101+0+0 (secure 0 0 0) 0x7f78a00aad70 con 0x7f78b00cdef0 2024-09-12T02:02:20.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.236+0000 7f78b5d9d640 1 --2- 172.21.15.19:0/3342594322 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f789406be30 0x7f789406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:20.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.236+0000 7f78b5d9d640 1 --2- 172.21.15.19:0/3342594322 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f789406be30 0x7f789406e2f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f78ac000c00 tx=0x7f78ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:20.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.240+0000 7f78a67fc640 1 -- 172.21.15.19:0/3342594322 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f78a0005ac0 con 0x7f78b00cdef0 2024-09-12T02:02:20.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.488+0000 7f78b6d9f640 1 -- 172.21.15.19:0/3342594322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f78b015f850 con 0x7f78b00cdef0 2024-09-12T02:02:20.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.490+0000 7f78a67fc640 1 -- 172.21.15.19:0/3342594322 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f78a0078e30 con 0x7f78b00cdef0 2024-09-12T02:02:20.491 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-09-12T02:02:20.491 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDwSeJmfHbXIRAALAvdYAlaB6WxWtubFnlxRw== 2024-09-12T02:02:20.491 INFO:teuthology.orchestra.run.smithi019.stdout: caps mds = "allow" 2024-09-12T02:02:20.491 INFO:teuthology.orchestra.run.smithi019.stdout: caps mon = "allow r" 2024-09-12T02:02:20.491 INFO:teuthology.orchestra.run.smithi019.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:02:20.491 INFO:teuthology.orchestra.run.smithi019.stderr:updated caps for client.0 2024-09-12T02:02:20.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.492+0000 7f78b6d9f640 1 -- 172.21.15.19:0/3342594322 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f789406be30 msgr2=0x7f789406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:20.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.492+0000 7f78b6d9f640 1 --2- 172.21.15.19:0/3342594322 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f789406be30 0x7f789406e2f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f78ac000c00 tx=0x7f78ac009040 comp rx=0 tx=0).stop 2024-09-12T02:02:20.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.492+0000 7f78b6d9f640 1 -- 172.21.15.19:0/3342594322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78b00cdef0 msgr2=0x7f78b0152930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:20.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.492+0000 7f78b6d9f640 1 --2- 172.21.15.19:0/3342594322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78b00cdef0 0x7f78b0152930 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f78a002aca0 tx=0x7f78a0001970 comp rx=0 tx=0).stop 2024-09-12T02:02:20.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.492+0000 7f78b6d9f640 1 -- 172.21.15.19:0/3342594322 shutdown_connections 2024-09-12T02:02:20.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.492+0000 7f78b6d9f640 1 --2- 172.21.15.19:0/3342594322 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f789406be30 0x7f789406e2f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.492+0000 7f78b6d9f640 1 --2- 172.21.15.19:0/3342594322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b0160ab0 0x7f78b0160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.492+0000 7f78b6d9f640 1 --2- 172.21.15.19:0/3342594322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78b00cdef0 0x7f78b0152930 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.492+0000 7f78b6d9f640 1 --2- 172.21.15.19:0/3342594322 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f789c004100 0x7f78b00b81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.493+0000 7f78b6d9f640 1 -- 172.21.15.19:0/3342594322 >> 172.21.15.19:0/3342594322 conn(0x7f78b009d740 msgr2=0x7f78b00b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:20.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.493+0000 7f78b6d9f640 1 -- 172.21.15.19:0/3342594322 shutdown_connections 2024-09-12T02:02:20.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.493+0000 7f78b6d9f640 1 -- 172.21.15.19:0/3342594322 wait complete. 2024-09-12T02:02:20.504 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:20.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.606+0000 7fc1d248b640 1 Processor -- start 2024-09-12T02:02:20.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.606+0000 7fc1d248b640 1 -- start start 2024-09-12T02:02:20.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.607+0000 7fc1d248b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc1cc147360 0x7fc1cc070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:20.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.607+0000 7fc1d248b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc070dd0 0x7fc1cc0d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:20.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.607+0000 7fc1d248b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1cc06cb30 con 0x7fc1cc0d09e0 2024-09-12T02:02:20.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.607+0000 7fc1d248b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fc1cc06bfb0 con 0x7fc1cc147360 2024-09-12T02:02:20.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.607+0000 7fc1d248b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc1cc06c290 con 0x7fc1cc070dd0 2024-09-12T02:02:20.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.607+0000 7fc1cbfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc1cc147360 0x7fc1cc070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:20.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.607+0000 7fc1cbfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc1cc147360 0x7fc1cc070890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35242/0 (socket says 172.21.15.19:35242) 2024-09-12T02:02:20.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.607+0000 7fc1cbfff640 1 -- 172.21.15.19:0/3910663130 learned_addr learned my addr 172.21.15.19:0/3910663130 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:20.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.607+0000 7fc1cbfff640 1 -- 172.21.15.19:0/3910663130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc070dd0 msgr2=0x7fc1cc0d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:20.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.607+0000 7fc1cbfff640 1 --2- 172.21.15.19:0/3910663130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc070dd0 0x7fc1cc0d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.607+0000 7fc1cbfff640 1 -- 172.21.15.19:0/3910663130 >> v1:172.21.15.135:6789/0 conn(0x7fc1cc0d09e0 legacy=0x7fc1cc06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:20.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.607+0000 7fc1cbfff640 1 -- 172.21.15.19:0/3910663130 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1cc06c570 con 0x7fc1cc147360 2024-09-12T02:02:20.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.608+0000 7fc1cbfff640 1 --2- 172.21.15.19:0/3910663130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1cc147360 0x7fc1cc070890 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009870 tx=0x7fc1bc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84c5612961fc734 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:20.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.608+0000 7fc1caffd640 1 -- 172.21.15.19:0/3910663130 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc037070 con 0x7fc1cc147360 2024-09-12T02:02:20.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.608+0000 7fc1caffd640 1 -- 172.21.15.19:0/3910663130 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1bc032440 con 0x7fc1cc147360 2024-09-12T02:02:20.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.608+0000 7fc1caffd640 1 -- 172.21.15.19:0/3910663130 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc032810 con 0x7fc1cc147360 2024-09-12T02:02:20.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.609+0000 7fc1d248b640 1 -- 172.21.15.19:0/3910663130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1cc147360 msgr2=0x7fc1cc070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:20.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.609+0000 7fc1d248b640 1 --2- 172.21.15.19:0/3910663130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1cc147360 0x7fc1cc070890 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009870 tx=0x7fc1bc02a180 comp rx=0 tx=0).stop 2024-09-12T02:02:20.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.609+0000 7fc1d248b640 1 -- 172.21.15.19:0/3910663130 shutdown_connections 2024-09-12T02:02:20.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.609+0000 7fc1d248b640 1 --2- 172.21.15.19:0/3910663130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc070dd0 0x7fc1cc0d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.609+0000 7fc1d248b640 1 --2- 172.21.15.19:0/3910663130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1cc147360 0x7fc1cc070890 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.609+0000 7fc1d248b640 1 -- 172.21.15.19:0/3910663130 >> 172.21.15.19:0/3910663130 conn(0x7fc1cc0b2f40 msgr2=0x7fc1cc0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:20.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.609+0000 7fc1d248b640 1 -- 172.21.15.19:0/3910663130 shutdown_connections 2024-09-12T02:02:20.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.609+0000 7fc1d248b640 1 -- 172.21.15.19:0/3910663130 wait complete. 2024-09-12T02:02:20.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.610+0000 7fc1d248b640 1 Processor -- start 2024-09-12T02:02:20.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.610+0000 7fc1d248b640 1 -- start start 2024-09-12T02:02:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.611+0000 7fc1d248b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc070dd0 0x7fc1cc13d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.611+0000 7fc1d248b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1cc0d09e0 0x7fc1cc0b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.611+0000 7fc1d248b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1cc147360 0x7fc1cc13f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.611+0000 7fc1d248b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc06bc10 con 0x7fc1cc147360 2024-09-12T02:02:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.611+0000 7fc1d248b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc0d0e10 con 0x7fc1cc0d09e0 2024-09-12T02:02:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.611+0000 7fc1d248b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc1cc06bd90 con 0x7fc1cc070dd0 2024-09-12T02:02:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.611+0000 7fc1d0a28640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1cc147360 0x7fc1cc13f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.611+0000 7fc1d0a28640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1cc147360 0x7fc1cc13f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35250/0 (socket says 172.21.15.19:35250) 2024-09-12T02:02:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.611+0000 7fc1d0a28640 1 -- 172.21.15.19:0/1731419812 learned_addr learned my addr 172.21.15.19:0/1731419812 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.611+0000 7fc1cbfff640 1 --2- 172.21.15.19:0/1731419812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc070dd0 0x7fc1cc13d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.611+0000 7fc1cb7fe640 1 --2- 172.21.15.19:0/1731419812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1cc0d09e0 0x7fc1cc0b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.611+0000 7fc1d0a28640 1 -- 172.21.15.19:0/1731419812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc070dd0 msgr2=0x7fc1cc13d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.611+0000 7fc1d0a28640 1 --2- 172.21.15.19:0/1731419812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc070dd0 0x7fc1cc13d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.611+0000 7fc1d0a28640 1 -- 172.21.15.19:0/1731419812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1cc0d09e0 msgr2=0x7fc1cc0b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.611+0000 7fc1d0a28640 1 --2- 172.21.15.19:0/1731419812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1cc0d09e0 0x7fc1cc0b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.611+0000 7fc1d0a28640 1 -- 172.21.15.19:0/1731419812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1cc0b6260 con 0x7fc1cc147360 2024-09-12T02:02:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.612+0000 7fc1d0a28640 1 --2- 172.21.15.19:0/1731419812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1cc147360 0x7fc1cc13f270 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400c7b0 tx=0x7fc1c400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.612+0000 7fc1c8ff9640 1 -- 172.21.15.19:0/1731419812 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4017070 con 0x7fc1cc147360 2024-09-12T02:02:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.612+0000 7fc1c8ff9640 1 -- 172.21.15.19:0/1731419812 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c4003da0 con 0x7fc1cc147360 2024-09-12T02:02:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.612+0000 7fc1c8ff9640 1 -- 172.21.15.19:0/1731419812 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c40052b0 con 0x7fc1cc147360 2024-09-12T02:02:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.612+0000 7fc1d248b640 1 -- 172.21.15.19:0/1731419812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1cc0b59c0 con 0x7fc1cc147360 2024-09-12T02:02:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.612+0000 7fc1d248b640 1 -- 172.21.15.19:0/1731419812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1cc0b5f80 con 0x7fc1cc147360 2024-09-12T02:02:20.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.613+0000 7fc1d248b640 1 -- 172.21.15.19:0/1731419812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1cc0d04a0 con 0x7fc1cc147360 2024-09-12T02:02:20.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.613+0000 7fc1c8ff9640 1 -- 172.21.15.19:0/1731419812 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc1c4005450 con 0x7fc1cc147360 2024-09-12T02:02:20.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.614+0000 7fc1c8ff9640 1 --2- 172.21.15.19:0/1731419812 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc1b806be60 0x7fc1b806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:20.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.614+0000 7fc1c8ff9640 1 -- 172.21.15.19:0/1731419812 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6101+0+0 (secure 0 0 0) 0x7fc1c408a4a0 con 0x7fc1cc147360 2024-09-12T02:02:20.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.614+0000 7fc1cbfff640 1 --2- 172.21.15.19:0/1731419812 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc1b806be60 0x7fc1b806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:20.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.615+0000 7fc1cbfff640 1 --2- 172.21.15.19:0/1731419812 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc1b806be60 0x7fc1b806e320 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc034000 tx=0x7fc1bc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:20.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.618+0000 7fc1c8ff9640 1 -- 172.21.15.19:0/1731419812 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc1c4058cb0 con 0x7fc1cc147360 2024-09-12T02:02:20.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.829+0000 7fc1d248b640 1 -- 172.21.15.19:0/1731419812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1cc1423f0 con 0x7fc1cc147360 2024-09-12T02:02:20.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.829+0000 7fc1c8ff9640 1 -- 172.21.15.19:0/1731419812 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5225 (secure 0 0 0) 0x7fc1c40585b0 con 0x7fc1cc147360 2024-09-12T02:02:20.830 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:20.830 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":76,"btime":"2024-09-12T02:02:14:334033+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/613869354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":613869354},{"type":"v1","addr":"172.21.15.19:6834","nonce":613869354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:02:13.679357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6451":{"gid":6451,"name":"d","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6837/3774685060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3774685060},{"type":"v1","addr":"172.21.15.135:6837","nonce":3774685060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6451,"qdb_cluster":[6451]},"id":6}]} 2024-09-12T02:02:20.830 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 76 2024-09-12T02:02:20.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.831+0000 7fc1d248b640 1 -- 172.21.15.19:0/1731419812 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc1b806be60 msgr2=0x7fc1b806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:20.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.831+0000 7fc1d248b640 1 --2- 172.21.15.19:0/1731419812 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc1b806be60 0x7fc1b806e320 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc034000 tx=0x7fc1bc02e000 comp rx=0 tx=0).stop 2024-09-12T02:02:20.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.831+0000 7fc1d248b640 1 -- 172.21.15.19:0/1731419812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1cc147360 msgr2=0x7fc1cc13f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:20.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.831+0000 7fc1d248b640 1 --2- 172.21.15.19:0/1731419812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1cc147360 0x7fc1cc13f270 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400c7b0 tx=0x7fc1c400cc70 comp rx=0 tx=0).stop 2024-09-12T02:02:20.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.831+0000 7fc1d248b640 1 -- 172.21.15.19:0/1731419812 shutdown_connections 2024-09-12T02:02:20.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.831+0000 7fc1d248b640 1 --2- 172.21.15.19:0/1731419812 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc1b806be60 0x7fc1b806e320 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.831+0000 7fc1d248b640 1 --2- 172.21.15.19:0/1731419812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1cc147360 0x7fc1cc13f270 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.831+0000 7fc1d248b640 1 --2- 172.21.15.19:0/1731419812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1cc0d09e0 0x7fc1cc0b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.831+0000 7fc1d248b640 1 --2- 172.21.15.19:0/1731419812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc070dd0 0x7fc1cc13d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:20.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.831+0000 7fc1d248b640 1 -- 172.21.15.19:0/1731419812 >> 172.21.15.19:0/1731419812 conn(0x7fc1cc0b2f40 msgr2=0x7fc1cc161290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:20.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.831+0000 7fc1d248b640 1 -- 172.21.15.19:0/1731419812 shutdown_connections 2024-09-12T02:02:20.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:20.832+0000 7fc1d248b640 1 -- 172.21.15.19:0/1731419812 wait complete. 2024-09-12T02:02:21.246 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:02:13.679357+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6451}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6451': {'gid': 6451, 'name': 'd', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6837/3774685060', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 3774685060}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 3774685060}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6451, 'qdb_cluster': [6451]} 2024-09-12T02:02:21.246 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:02:21.246 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T02:02:21.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.353+0000 7f2701998640 1 Processor -- start 2024-09-12T02:02:21.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.353+0000 7f2701998640 1 -- start start 2024-09-12T02:02:21.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.354+0000 7f2701998640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f26fc145bc0 0x7f26fc15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.354+0000 7f2701998640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26fc06c320 0x7f26fc0af950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.354+0000 7f2701998640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26fc0b3570 con 0x7f26fc0ae140 2024-09-12T02:02:21.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.354+0000 7f2701998640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f26fc0b3850 con 0x7f26fc145bc0 2024-09-12T02:02:21.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.354+0000 7f2701998640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f26fc0b3b30 con 0x7f26fc06c320 2024-09-12T02:02:21.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.354+0000 7f26f3fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f26fc0ae140 0x7f26fc06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33338/0 (socket says 172.21.15.19:33338) 2024-09-12T02:02:21.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.354+0000 7f26f3fff640 1 -- 172.21.15.19:0/697971689 learned_addr learned my addr 172.21.15.19:0/697971689 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:21.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.354+0000 7f26faffd640 1 --2- 172.21.15.19:0/697971689 >> v2:172.21.15.135:3300/0 conn(0x7f26fc145bc0 0x7f26fc15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.354+0000 7f26fb7fe640 1 --2- 172.21.15.19:0/697971689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26fc06c320 0x7f26fc0af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.354+0000 7f26fa7fc640 1 -- 172.21.15.19:0/697971689 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3622022778 0 0) 0x7f26fc0b3570 con 0x7f26fc0ae140 2024-09-12T02:02:21.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.354+0000 7f26fa7fc640 1 -- 172.21.15.19:0/697971689 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26e8003520 con 0x7f26fc0ae140 2024-09-12T02:02:21.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.354+0000 7f26fb7fe640 1 -- 172.21.15.19:0/697971689 >> v2:172.21.15.135:3300/0 conn(0x7f26fc145bc0 msgr2=0x7f26fc15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:21.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.354+0000 7f26fb7fe640 1 --2- 172.21.15.19:0/697971689 >> v2:172.21.15.135:3300/0 conn(0x7f26fc145bc0 0x7f26fc15ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.354+0000 7f26fb7fe640 1 -- 172.21.15.19:0/697971689 >> v1:172.21.15.19:6789/0 conn(0x7f26fc0ae140 legacy=0x7f26fc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:21.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.354+0000 7f26fb7fe640 1 -- 172.21.15.19:0/697971689 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26fc0b1610 con 0x7f26fc06c320 2024-09-12T02:02:21.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.354+0000 7f26faffd640 1 --2- 172.21.15.19:0/697971689 >> v2:172.21.15.135:3300/0 conn(0x7f26fc145bc0 0x7f26fc15ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:21.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.355+0000 7f26fb7fe640 1 --2- 172.21.15.19:0/697971689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26fc06c320 0x7f26fc0af950 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009dc0 tx=0x7f26f402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83a06ca423f9a5f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:21.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.355+0000 7f26fa7fc640 1 -- 172.21.15.19:0/697971689 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f4007740 con 0x7f26fc06c320 2024-09-12T02:02:21.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.355+0000 7f26fa7fc640 1 -- 172.21.15.19:0/697971689 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f40078e0 con 0x7f26fc06c320 2024-09-12T02:02:21.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.355+0000 7f26fa7fc640 1 -- 172.21.15.19:0/697971689 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f4007c90 con 0x7f26fc06c320 2024-09-12T02:02:21.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.356+0000 7f2701998640 1 -- 172.21.15.19:0/697971689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26fc06c320 msgr2=0x7f26fc0af950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:21.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.356+0000 7f2701998640 1 --2- 172.21.15.19:0/697971689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26fc06c320 0x7f26fc0af950 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009dc0 tx=0x7f26f402a710 comp rx=0 tx=0).stop 2024-09-12T02:02:21.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.356+0000 7f2701998640 1 -- 172.21.15.19:0/697971689 shutdown_connections 2024-09-12T02:02:21.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.356+0000 7f2701998640 1 --2- 172.21.15.19:0/697971689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26fc06c320 0x7f26fc0af950 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.356+0000 7f2701998640 1 --2- 172.21.15.19:0/697971689 >> v2:172.21.15.135:3300/0 conn(0x7f26fc145bc0 0x7f26fc15ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.356+0000 7f2701998640 1 -- 172.21.15.19:0/697971689 >> 172.21.15.19:0/697971689 conn(0x7f26fc073490 msgr2=0x7f26fc0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:21.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.356+0000 7f2701998640 1 -- 172.21.15.19:0/697971689 shutdown_connections 2024-09-12T02:02:21.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.356+0000 7f2701998640 1 -- 172.21.15.19:0/697971689 wait complete. 2024-09-12T02:02:21.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.357+0000 7f2701998640 1 Processor -- start 2024-09-12T02:02:21.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.357+0000 7f2701998640 1 -- start start 2024-09-12T02:02:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.358+0000 7f2701998640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26fc06c320 0x7f26fc09b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.358+0000 7f2701998640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26fc0ae140 0x7f26fc13ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.358+0000 7f2701998640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26fc145bc0 0x7f26fc1f59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.358+0000 7f2701998640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f26fc145fa0 con 0x7f26fc0ae140 2024-09-12T02:02:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.358+0000 7f2701998640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f26fc09aa30 con 0x7f26fc06c320 2024-09-12T02:02:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.358+0000 7f2701998640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f26fc1e60a0 con 0x7f26fc145bc0 2024-09-12T02:02:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.358+0000 7f26f3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26fc0ae140 0x7f26fc13ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.358+0000 7f26f3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26fc0ae140 0x7f26fc13ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50588/0 (socket says 172.21.15.19:50588) 2024-09-12T02:02:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.358+0000 7f26f3fff640 1 -- 172.21.15.19:0/2163951645 learned_addr learned my addr 172.21.15.19:0/2163951645 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.358+0000 7f26fb7fe640 1 --2- 172.21.15.19:0/2163951645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26fc145bc0 0x7f26fc1f59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.358+0000 7f26faffd640 1 --2- 172.21.15.19:0/2163951645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26fc06c320 0x7f26fc09b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.358+0000 7f26f3fff640 1 -- 172.21.15.19:0/2163951645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26fc145bc0 msgr2=0x7f26fc1f59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.358+0000 7f26f3fff640 1 --2- 172.21.15.19:0/2163951645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26fc145bc0 0x7f26fc1f59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.358+0000 7f26f3fff640 1 -- 172.21.15.19:0/2163951645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26fc06c320 msgr2=0x7f26fc09b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.358+0000 7f26f3fff640 1 --2- 172.21.15.19:0/2163951645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26fc06c320 0x7f26fc09b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.358+0000 7f26f3fff640 1 -- 172.21.15.19:0/2163951645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26fc1e6380 con 0x7f26fc0ae140 2024-09-12T02:02:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.359+0000 7f26f3fff640 1 --2- 172.21.15.19:0/2163951645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26fc0ae140 0x7f26fc13ebe0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f26e400c430 tx=0x7f26e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.359+0000 7f26f8ff9640 1 -- 172.21.15.19:0/2163951645 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4017070 con 0x7f26fc0ae140 2024-09-12T02:02:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.359+0000 7f26f8ff9640 1 -- 172.21.15.19:0/2163951645 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e4005ce0 con 0x7f26fc0ae140 2024-09-12T02:02:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.359+0000 7f26f8ff9640 1 -- 172.21.15.19:0/2163951645 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e40072f0 con 0x7f26fc0ae140 2024-09-12T02:02:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.359+0000 7f2701998640 1 -- 172.21.15.19:0/2163951645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26fc1e6660 con 0x7f26fc0ae140 2024-09-12T02:02:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.359+0000 7f2701998640 1 -- 172.21.15.19:0/2163951645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26fc09b800 con 0x7f26fc0ae140 2024-09-12T02:02:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.360+0000 7f26f8ff9640 1 -- 172.21.15.19:0/2163951645 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f26e401a070 con 0x7f26fc0ae140 2024-09-12T02:02:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.361+0000 7f26f8ff9640 1 --2- 172.21.15.19:0/2163951645 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26dc06be30 0x7f26dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.361+0000 7f26f8ff9640 1 -- 172.21.15.19:0/2163951645 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6101+0+0 (secure 0 0 0) 0x7f26e408a4c0 con 0x7f26fc0ae140 2024-09-12T02:02:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.361+0000 7f26faffd640 1 --2- 172.21.15.19:0/2163951645 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26dc06be30 0x7f26dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.361+0000 7f26faffd640 1 --2- 172.21.15.19:0/2163951645 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26dc06be30 0x7f26dc06e2f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f26ec009a30 tx=0x7f26ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:21.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.362+0000 7f270480f740 1 Processor -- start 2024-09-12T02:02:21.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.362+0000 7f270480f740 1 -- start start 2024-09-12T02:02:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f270480f740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5627338f72c0 0x56273393ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f270480f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f4a80 0x5627338f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f270480f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f8a50 0x5627338f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f270480f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562733859520 con 0x5627338f4a80 2024-09-12T02:02:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f270480f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5627338013e0 con 0x5627338f8a50 2024-09-12T02:02:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f270480f740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5627338554e0 con 0x5627338f72c0 2024-09-12T02:02:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f26f3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f4a80 0x5627338f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f26f3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f4a80 0x5627338f76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50594/0 (socket says 172.21.15.19:50594) 2024-09-12T02:02:21.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f26f3fff640 1 -- 172.21.15.19:0/3935495184 learned_addr learned my addr 172.21.15.19:0/3935495184 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:21.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f26faffd640 1 --2- 172.21.15.19:0/3935495184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5627338f72c0 0x56273393ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f26fb7fe640 1 --2- 172.21.15.19:0/3935495184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f8a50 0x5627338f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f26f3fff640 1 -- 172.21.15.19:0/3935495184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5627338f72c0 msgr2=0x56273393ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:21.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f26f3fff640 1 --2- 172.21.15.19:0/3935495184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5627338f72c0 0x56273393ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f26f3fff640 1 -- 172.21.15.19:0/3935495184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f8a50 msgr2=0x5627338f18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:21.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f26f3fff640 1 --2- 172.21.15.19:0/3935495184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f8a50 0x5627338f18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f26f3fff640 1 -- 172.21.15.19:0/3935495184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56273381c2f0 con 0x5627338f4a80 2024-09-12T02:02:21.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f26f3fff640 1 --2- 172.21.15.19:0/3935495184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f4a80 0x5627338f76a0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f26e4000f30 tx=0x7f26e4058250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5522e46876f8dda2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:21.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f26f17fa640 1 -- 172.21.15.19:0/3935495184 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e40568e0 con 0x5627338f4a80 2024-09-12T02:02:21.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f26f17fa640 1 -- 172.21.15.19:0/3935495184 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e4054c50 con 0x5627338f4a80 2024-09-12T02:02:21.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.363+0000 7f26f17fa640 1 -- 172.21.15.19:0/3935495184 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e408a2c0 con 0x5627338f4a80 2024-09-12T02:02:21.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.364+0000 7f270480f740 1 -- 172.21.15.19:0/3935495184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f4a80 msgr2=0x5627338f76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:21.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.364+0000 7f270480f740 1 --2- 172.21.15.19:0/3935495184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f4a80 0x5627338f76a0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f26e4000f30 tx=0x7f26e4058250 comp rx=0 tx=0).stop 2024-09-12T02:02:21.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.364+0000 7f270480f740 1 -- 172.21.15.19:0/3935495184 shutdown_connections 2024-09-12T02:02:21.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.364+0000 7f270480f740 1 --2- 172.21.15.19:0/3935495184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f8a50 0x5627338f18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.364+0000 7f270480f740 1 --2- 172.21.15.19:0/3935495184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f4a80 0x5627338f76a0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.364+0000 7f270480f740 1 --2- 172.21.15.19:0/3935495184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5627338f72c0 0x56273393ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.364+0000 7f270480f740 1 -- 172.21.15.19:0/3935495184 >> 172.21.15.19:0/3935495184 conn(0x5627338f3a80 msgr2=0x56273393bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:21.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.364+0000 7f270480f740 1 -- 172.21.15.19:0/3935495184 shutdown_connections 2024-09-12T02:02:21.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.364+0000 7f270480f740 1 -- 172.21.15.19:0/3935495184 wait complete. 2024-09-12T02:02:21.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.365+0000 7f270480f740 1 -- start start 2024-09-12T02:02:21.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.365+0000 7f270480f740 1 Processor -- start 2024-09-12T02:02:21.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f270480f740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5627338f72c0 0x562733939640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f270480f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f8a50 0x56273391fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f270480f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562733920210 0x5627339199f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f270480f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5627338f2f20 con 0x562733920210 2024-09-12T02:02:21.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f270480f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5627337e2450 con 0x5627338f8a50 2024-09-12T02:02:21.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f270480f740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56273393d290 con 0x5627338f72c0 2024-09-12T02:02:21.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f270480f740 10 client.0 _ll_register_callbacks cb 0x56273356bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:02:21.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f26fb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562733920210 0x5627339199f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f26fb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562733920210 0x5627339199f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50604/0 (socket says 172.21.15.19:50604) 2024-09-12T02:02:21.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f26fb7fe640 1 -- 172.21.15.19:0/936426803 learned_addr learned my addr 172.21.15.19:0/936426803 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:21.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f26faffd640 1 --2- 172.21.15.19:0/936426803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5627338f72c0 0x562733939640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f26f3fff640 1 --2- 172.21.15.19:0/936426803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f8a50 0x56273391fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f26fb7fe640 1 -- 172.21.15.19:0/936426803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5627338f72c0 msgr2=0x562733939640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:21.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f26fb7fe640 1 --2- 172.21.15.19:0/936426803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5627338f72c0 0x562733939640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f26fb7fe640 1 -- 172.21.15.19:0/936426803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f8a50 msgr2=0x56273391fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:21.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f26fb7fe640 1 --2- 172.21.15.19:0/936426803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f8a50 0x56273391fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f26fb7fe640 1 -- 172.21.15.19:0/936426803 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56273356c2d0 con 0x562733920210 2024-09-12T02:02:21.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f26fb7fe640 1 --2- 172.21.15.19:0/936426803 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562733920210 0x5627339199f0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009ee0 tx=0x7f26f4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68578c7c763404c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:21.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f26da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:02:21.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f26da7fc640 1 -- 172.21.15.19:0/936426803 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f4009450 con 0x562733920210 2024-09-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f26da7fc640 1 -- 172.21.15.19:0/936426803 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 6101+0+0 (secure 0 0 0) 0x7f26f403d430 con 0x562733920210 2024-09-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.366+0000 7f270480f740 1 -- 172.21.15.19:0/936426803 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26e4054c50 con 0x562733920210 2024-09-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.367+0000 7f26da7fc640 1 -- 172.21.15.19:0/936426803 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f26f4050050 con 0x562733920210 2024-09-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.367+0000 7f270480f740 10 client.7074 fetch_fsmap learned FSMap version 76 2024-09-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.367+0000 7f270480f740 1 -- 172.21.15.19:0/936426803 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x5627336366b0 con 0x562733920210 2024-09-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.367+0000 7f26da7fc640 1 -- 172.21.15.19:0/936426803 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e4054c50 con 0x562733920210 2024-09-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.367+0000 7f26da7fc640 1 -- 172.21.15.19:0/936426803 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 76) ==== 3502+0+0 (secure 0 0 0) 0x7f26f4053020 con 0x562733920210 2024-09-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.367+0000 7f270480f740 10 client.7074 fetch_fsmap finished waiting for FSMap version 76 2024-09-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.367+0000 7f270480f740 10 client.7074 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.367+0000 7f270480f740 20 client.7074 populate_metadata read hostname 'smithi019' 2024-09-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.367+0000 7f270480f740 1 --2- 172.21.15.19:0/936426803 >> [v2:172.21.15.135:6834/3774685060,v1:172.21.15.135:6837/3774685060] conn(0x562733920a20 0x56273394c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.367+0000 7f270480f740 4 client.7074 mds_command: new command op to 6451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.367+0000 7f270480f740 1 -- 172.21.15.19:0/936426803 --> [v2:172.21.15.135:6834/3774685060,v1:172.21.15.135:6837/3774685060] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562733866c50 con 0x562733920a20 2024-09-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.367+0000 7f26faffd640 1 --2- 172.21.15.19:0/936426803 >> [v2:172.21.15.135:6834/3774685060,v1:172.21.15.135:6837/3774685060] conn(0x562733920a20 0x56273394c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.367+0000 7f26da7fc640 10 client.7074 ms_handle_connect on v2:172.21.15.135:6834/3774685060 2024-09-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.367+0000 7f26faffd640 1 --2- 172.21.15.19:0/936426803 >> [v2:172.21.15.135:6834/3774685060,v1:172.21.15.135:6837/3774685060] conn(0x562733920a20 0x56273394c2a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67afd4ef72cbce55 server_cookie=60c2d0dda9336406 in_seq=0 out_seq=0 2024-09-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.368+0000 7f26da7fc640 1 -- 172.21.15.19:0/936426803 <== mds.0 v2:172.21.15.135:6834/3774685060 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562733866c50 con 0x562733920a20 2024-09-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.368+0000 7f26da7fc640 10 client.7074 handle_command_reply: tid=0 2024-09-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.368+0000 7f270480f740 1 client.7074 shutdown 2024-09-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.368+0000 7f270480f740 1 -- 172.21.15.19:0/936426803 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562733920210 msgr2=0x5627339199f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.368+0000 7f270480f740 1 --2- 172.21.15.19:0/936426803 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562733920210 0x5627339199f0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009ee0 tx=0x7f26f4004ab0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.368+0000 7f270480f740 1 -- 172.21.15.19:0/936426803 shutdown_connections 2024-09-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.368+0000 7f270480f740 1 --2- 172.21.15.19:0/936426803 >> [v2:172.21.15.135:6834/3774685060,v1:172.21.15.135:6837/3774685060] conn(0x562733920a20 0x56273394c2a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.368+0000 7f270480f740 1 --2- 172.21.15.19:0/936426803 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562733920210 0x5627339199f0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.368+0000 7f270480f740 1 --2- 172.21.15.19:0/936426803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f8a50 0x56273391fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.368+0000 7f26da7fc640 0 client.7074 ms_handle_reset on v2:172.21.15.135:6834/3774685060 2024-09-12T02:02:21.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.368+0000 7f270480f740 1 --2- 172.21.15.19:0/936426803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5627338f72c0 0x562733939640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.368+0000 7f270480f740 1 -- 172.21.15.19:0/936426803 >> 172.21.15.19:0/936426803 conn(0x5627338f4a80 msgr2=0x56273393f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:21.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.369+0000 7f270480f740 1 -- 172.21.15.19:0/936426803 shutdown_connections 2024-09-12T02:02:21.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.369+0000 7f270480f740 1 -- 172.21.15.19:0/936426803 wait complete. 2024-09-12T02:02:21.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.369+0000 7f270480f740 20 client.7074 trim_cache size 0 max 16384 2024-09-12T02:02:21.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.386+0000 7f270480f740 1 Processor -- start 2024-09-12T02:02:21.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.387+0000 7f270480f740 1 -- start start 2024-09-12T02:02:21.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.387+0000 7f270480f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f72c0 0x562733916590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.387+0000 7f270480f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f8a50 0x562733939ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.387+0000 7f270480f740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562733920210 0x56273393a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.387+0000 7f270480f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f26fc1fee40 con 0x5627338f72c0 2024-09-12T02:02:21.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.387+0000 7f270480f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f26fc1fdea0 con 0x5627338f8a50 2024-09-12T02:02:21.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.387+0000 7f270480f740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f26fc1e7e20 con 0x562733920210 2024-09-12T02:02:21.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.387+0000 7f26faffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f72c0 0x562733916590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.387+0000 7f26faffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f72c0 0x562733916590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50618/0 (socket says 172.21.15.19:50618) 2024-09-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.387+0000 7f26faffd640 1 -- 172.21.15.19:0/1415724249 learned_addr learned my addr 172.21.15.19:0/1415724249 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.388+0000 7f26f3fff640 1 --2- 172.21.15.19:0/1415724249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f8a50 0x562733939ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.388+0000 7f26fb7fe640 1 --2- 172.21.15.19:0/1415724249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562733920210 0x56273393a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.388+0000 7f26faffd640 1 -- 172.21.15.19:0/1415724249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562733920210 msgr2=0x56273393a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.388+0000 7f26faffd640 1 --2- 172.21.15.19:0/1415724249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562733920210 0x56273393a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.388+0000 7f26faffd640 1 -- 172.21.15.19:0/1415724249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f8a50 msgr2=0x562733939ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.388+0000 7f26faffd640 1 --2- 172.21.15.19:0/1415724249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f8a50 0x562733939ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.388+0000 7f26faffd640 1 -- 172.21.15.19:0/1415724249 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56273394f8d0 con 0x5627338f72c0 2024-09-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.388+0000 7f26faffd640 1 --2- 172.21.15.19:0/1415724249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f72c0 0x562733916590 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x562733920e30 tx=0x7f26ec014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8914751817d77917 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.388+0000 7f26f0ff9640 1 -- 172.21.15.19:0/1415724249 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec02b280 con 0x5627338f72c0 2024-09-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.388+0000 7f26f0ff9640 1 -- 172.21.15.19:0/1415724249 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26ec01a040 con 0x5627338f72c0 2024-09-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.388+0000 7f26f0ff9640 1 -- 172.21.15.19:0/1415724249 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec02b420 con 0x5627338f72c0 2024-09-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.389+0000 7f270480f740 1 -- 172.21.15.19:0/1415724249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f72c0 msgr2=0x562733916590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:21.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.389+0000 7f270480f740 1 --2- 172.21.15.19:0/1415724249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f72c0 0x562733916590 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x562733920e30 tx=0x7f26ec014000 comp rx=0 tx=0).stop 2024-09-12T02:02:21.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.389+0000 7f270480f740 1 -- 172.21.15.19:0/1415724249 shutdown_connections 2024-09-12T02:02:21.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.389+0000 7f270480f740 1 --2- 172.21.15.19:0/1415724249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562733920210 0x56273393a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.389+0000 7f270480f740 1 --2- 172.21.15.19:0/1415724249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f8a50 0x562733939ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.389+0000 7f270480f740 1 --2- 172.21.15.19:0/1415724249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f72c0 0x562733916590 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.389+0000 7f270480f740 1 -- 172.21.15.19:0/1415724249 >> 172.21.15.19:0/1415724249 conn(0x5627338f4a80 msgr2=0x562733917a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:21.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.389+0000 7f270480f740 1 -- 172.21.15.19:0/1415724249 shutdown_connections 2024-09-12T02:02:21.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.389+0000 7f270480f740 1 -- 172.21.15.19:0/1415724249 wait complete. 2024-09-12T02:02:21.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.389+0000 7f270480f740 1 -- start start 2024-09-12T02:02:21.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.389+0000 7f270480f740 1 Processor -- start 2024-09-12T02:02:21.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.390+0000 7f270480f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f72c0 0x562733954de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.390+0000 7f270480f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f8a50 0x5627339b86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.390+0000 7f270480f740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562733920210 0x5627339b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.390+0000 7f270480f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5627339208a0 con 0x5627338f8a50 2024-09-12T02:02:21.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.390+0000 7f270480f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562733950580 con 0x5627338f72c0 2024-09-12T02:02:21.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.390+0000 7f270480f740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562733920ef0 con 0x562733920210 2024-09-12T02:02:21.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.390+0000 7f270480f740 10 client.0 _ll_register_callbacks cb 0x7f26ec009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:02:21.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.390+0000 7f26f3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f8a50 0x5627339b86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.390+0000 7f26f3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f8a50 0x5627339b86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50634/0 (socket says 172.21.15.19:50634) 2024-09-12T02:02:21.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.390+0000 7f26f3fff640 1 -- 172.21.15.19:0/3035063952 learned_addr learned my addr 172.21.15.19:0/3035063952 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:21.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.390+0000 7f26faffd640 1 --2- 172.21.15.19:0/3035063952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f72c0 0x562733954de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.390+0000 7f26fb7fe640 1 --2- 172.21.15.19:0/3035063952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562733920210 0x5627339b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.390+0000 7f26f3fff640 1 -- 172.21.15.19:0/3035063952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562733920210 msgr2=0x5627339b8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:21.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.390+0000 7f26f3fff640 1 --2- 172.21.15.19:0/3035063952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562733920210 0x5627339b8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.390+0000 7f26f3fff640 1 -- 172.21.15.19:0/3035063952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f72c0 msgr2=0x562733954de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:21.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.390+0000 7f26f3fff640 1 --2- 172.21.15.19:0/3035063952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f72c0 0x562733954de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.390+0000 7f26f3fff640 1 -- 172.21.15.19:0/3035063952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562733916830 con 0x5627338f8a50 2024-09-12T02:02:21.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.391+0000 7f26f3fff640 1 --2- 172.21.15.19:0/3035063952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f8a50 0x5627339b86a0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f26e4000f30 tx=0x7f26e401e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe068410c3b1da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:21.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.391+0000 7f26da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:02:21.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.391+0000 7f26da7fc640 1 -- 172.21.15.19:0/3035063952 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e408a2c0 con 0x5627338f8a50 2024-09-12T02:02:21.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.391+0000 7f26da7fc640 1 -- 172.21.15.19:0/3035063952 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 6101+0+0 (secure 0 0 0) 0x7f26e4007490 con 0x5627338f8a50 2024-09-12T02:02:21.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.391+0000 7f270480f740 1 -- 172.21.15.19:0/3035063952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26ec01a040 con 0x5627338f8a50 2024-09-12T02:02:21.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.391+0000 7f26da7fc640 1 -- 172.21.15.19:0/3035063952 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f26e4007690 con 0x5627338f8a50 2024-09-12T02:02:21.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.391+0000 7f270480f740 10 client.7080 fetch_fsmap learned FSMap version 76 2024-09-12T02:02:21.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.391+0000 7f270480f740 1 -- 172.21.15.19:0/3035063952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x5627339bee70 con 0x5627338f8a50 2024-09-12T02:02:21.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.391+0000 7f26da7fc640 1 -- 172.21.15.19:0/3035063952 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26ec01a040 con 0x5627338f8a50 2024-09-12T02:02:21.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.391+0000 7f26da7fc640 1 -- 172.21.15.19:0/3035063952 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 76) ==== 3502+0+0 (secure 0 0 0) 0x7f26e4057a30 con 0x5627338f8a50 2024-09-12T02:02:21.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.391+0000 7f270480f740 10 client.7080 fetch_fsmap finished waiting for FSMap version 76 2024-09-12T02:02:21.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.391+0000 7f270480f740 10 client.7080 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:02:21.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.391+0000 7f270480f740 20 client.7080 populate_metadata read hostname 'smithi019' 2024-09-12T02:02:21.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.391+0000 7f270480f740 1 --2- 172.21.15.19:0/3035063952 >> [v2:172.21.15.135:6834/3774685060,v1:172.21.15.135:6837/3774685060] conn(0x56273394a9c0 0x56273394ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.391+0000 7f270480f740 4 client.7080 mds_command: new command op to 6451 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:02:21.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.391+0000 7f270480f740 1 -- 172.21.15.19:0/3035063952 --> [v2:172.21.15.135:6834/3774685060,v1:172.21.15.135:6837/3774685060] -- command(tid 0: {"prefix": "status"}) -- 0x562733860fa0 con 0x56273394a9c0 2024-09-12T02:02:21.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.391+0000 7f26faffd640 1 --2- 172.21.15.19:0/3035063952 >> [v2:172.21.15.135:6834/3774685060,v1:172.21.15.135:6837/3774685060] conn(0x56273394a9c0 0x56273394ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.392+0000 7f26faffd640 1 --2- 172.21.15.19:0/3035063952 >> [v2:172.21.15.135:6834/3774685060,v1:172.21.15.135:6837/3774685060] conn(0x56273394a9c0 0x56273394ada0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b3a52f237507c5e server_cookie=82b683b4ae29c14c in_seq=0 out_seq=0 2024-09-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.392+0000 7f26da7fc640 10 client.7080 ms_handle_connect on v2:172.21.15.135:6834/3774685060 2024-09-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.392+0000 7f26da7fc640 1 -- 172.21.15.19:0/3035063952 <== mds.0 v2:172.21.15.135:6834/3774685060 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x562733860fa0 con 0x56273394a9c0 2024-09-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.392+0000 7f26da7fc640 10 client.7080 handle_command_reply: tid=0 2024-09-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.392+0000 7f270480f740 1 client.7080 shutdown 2024-09-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.392+0000 7f270480f740 1 -- 172.21.15.19:0/3035063952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f8a50 msgr2=0x5627339b86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.392+0000 7f270480f740 1 --2- 172.21.15.19:0/3035063952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f8a50 0x5627339b86a0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f26e4000f30 tx=0x7f26e401e040 comp rx=0 tx=0).stop 2024-09-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.392+0000 7f270480f740 1 -- 172.21.15.19:0/3035063952 shutdown_connections 2024-09-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.392+0000 7f270480f740 1 --2- 172.21.15.19:0/3035063952 >> [v2:172.21.15.135:6834/3774685060,v1:172.21.15.135:6837/3774685060] conn(0x56273394a9c0 0x56273394ada0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.392+0000 7f270480f740 1 --2- 172.21.15.19:0/3035063952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562733920210 0x5627339b8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.392+0000 7f26da7fc640 0 client.7080 ms_handle_reset on v2:172.21.15.135:6834/3774685060 2024-09-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.392+0000 7f270480f740 1 --2- 172.21.15.19:0/3035063952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5627338f8a50 0x5627339b86a0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.392+0000 7f270480f740 1 --2- 172.21.15.19:0/3035063952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627338f72c0 0x562733954de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.392+0000 7f270480f740 1 -- 172.21.15.19:0/3035063952 >> 172.21.15.19:0/3035063952 conn(0x5627338f4a80 msgr2=0x562733917a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.392+0000 7f270480f740 1 -- 172.21.15.19:0/3035063952 shutdown_connections 2024-09-12T02:02:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.392+0000 7f270480f740 1 -- 172.21.15.19:0/3035063952 wait complete. 2024-09-12T02:02:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.392+0000 7f270480f740 20 client.7080 trim_cache size 0 max 16384 2024-09-12T02:02:21.399 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:02:21.399 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T02:02:21.399 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T02:02:21.399 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 6451, 2024-09-12T02:02:21.399 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T02:02:21.399 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T02:02:21.399 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T02:02:21.399 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 9.0627351300000001, 2024-09-12T02:02:21.400 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 76, 2024-09-12T02:02:21.400 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 93, 2024-09-12T02:02:21.400 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 93, 2024-09-12T02:02:21.400 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 13.089538322999999 2024-09-12T02:02:21.400 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:02:21.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.393+0000 7f2701998640 1 -- 172.21.15.19:0/2163951645 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26dc06be30 msgr2=0x7f26dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:21.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.393+0000 7f2701998640 1 --2- 172.21.15.19:0/2163951645 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26dc06be30 0x7f26dc06e2f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f26ec009a30 tx=0x7f26ec008040 comp rx=0 tx=0).stop 2024-09-12T02:02:21.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.393+0000 7f2701998640 1 -- 172.21.15.19:0/2163951645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26fc0ae140 msgr2=0x7f26fc13ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:21.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.393+0000 7f2701998640 1 --2- 172.21.15.19:0/2163951645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26fc0ae140 0x7f26fc13ebe0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f26e400c430 tx=0x7f26e400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.393+0000 7f2701998640 1 -- 172.21.15.19:0/2163951645 shutdown_connections 2024-09-12T02:02:21.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.393+0000 7f2701998640 1 --2- 172.21.15.19:0/2163951645 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26dc06be30 0x7f26dc06e2f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.393+0000 7f2701998640 1 --2- 172.21.15.19:0/2163951645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26fc145bc0 0x7f26fc1f59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.393+0000 7f2701998640 1 --2- 172.21.15.19:0/2163951645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26fc0ae140 0x7f26fc13ebe0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.393+0000 7f2701998640 1 --2- 172.21.15.19:0/2163951645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26fc06c320 0x7f26fc09b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.393+0000 7f2701998640 1 -- 172.21.15.19:0/2163951645 >> 172.21.15.19:0/2163951645 conn(0x7f26fc073490 msgr2=0x7f26fc0b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:21.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.393+0000 7f2701998640 1 -- 172.21.15.19:0/2163951645 shutdown_connections 2024-09-12T02:02:21.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.393+0000 7f2701998640 1 -- 172.21.15.19:0/2163951645 wait complete. 2024-09-12T02:02:21.404 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:02:21.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.505+0000 7ff69c318640 1 Processor -- start 2024-09-12T02:02:21.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.505+0000 7ff69c318640 1 -- start start 2024-09-12T02:02:21.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.506+0000 7ff69c318640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff694161c80 0x7ff69406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.506+0000 7ff69c318640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69406e870 con 0x7ff694162060 2024-09-12T02:02:21.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.506+0000 7ff69c318640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69406d9f0 con 0x7ff6940b6680 2024-09-12T02:02:21.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.506+0000 7ff69c318640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff69406dcd0 con 0x7ff694161c80 2024-09-12T02:02:21.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.506+0000 7ff6998b3640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff694162060 0x7ff6940b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33350/0 (socket says 172.21.15.19:33350) 2024-09-12T02:02:21.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.506+0000 7ff6998b3640 1 -- 172.21.15.19:0/920885617 learned_addr learned my addr 172.21.15.19:0/920885617 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:21.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff69a0b4640 1 --2- 172.21.15.19:0/920885617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff694161c80 0x7ff69406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff6990b2640 1 -- 172.21.15.19:0/920885617 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1106708938 0 0) 0x7ff688001110 con 0x7ff694162060 2024-09-12T02:02:21.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff6990b2640 1 -- 172.21.15.19:0/920885617 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff67c003520 con 0x7ff694162060 2024-09-12T02:02:21.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff6990b2640 1 -- 172.21.15.19:0/920885617 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2066736145 0 0) 0x7ff67c003520 con 0x7ff694162060 2024-09-12T02:02:21.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff6990b2640 1 -- 172.21.15.19:0/920885617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff694161c80 msgr2=0x7ff69406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:21.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff6990b2640 1 --2- 172.21.15.19:0/920885617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff694161c80 0x7ff69406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff6990b2640 1 -- 172.21.15.19:0/920885617 >> v1:172.21.15.135:6789/0 conn(0x7ff6940b6680 legacy=0x7ff6940cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff6990b2640 1 -- 172.21.15.19:0/920885617 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69406dfb0 con 0x7ff694162060 2024-09-12T02:02:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff6990b2640 1 -- 172.21.15.19:0/920885617 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7ff688001840 con 0x7ff694162060 2024-09-12T02:02:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff69a0b4640 1 --2- 172.21.15.19:0/920885617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff694161c80 0x7ff69406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff6990b2640 1 -- 172.21.15.19:0/920885617 >> v1:172.21.15.19:6789/0 conn(0x7ff694162060 legacy=0x7ff6940b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff6990b2640 1 --2- 172.21.15.19:0/920885617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67c0039e0 0x7ff67c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff6990b2640 1 --2- 172.21.15.19:0/920885617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff67c004390 0x7ff67c004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff6990b2640 1 --2- 172.21.15.19:0/920885617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff694161c80 0x7ff67c005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff6990b2640 1 -- 172.21.15.19:0/920885617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff69406dcd0 con 0x7ff67c0039e0 2024-09-12T02:02:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff6990b2640 1 -- 172.21.15.19:0/920885617 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c00b9c0 con 0x7ff67c004390 2024-09-12T02:02:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff6990b2640 1 -- 172.21.15.19:0/920885617 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff67c00bb70 con 0x7ff694161c80 2024-09-12T02:02:21.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff69a0b4640 1 --2- 172.21.15.19:0/920885617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67c0039e0 0x7ff67c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff69a8b5640 1 --2- 172.21.15.19:0/920885617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff694161c80 0x7ff67c005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.507+0000 7ff6998b3640 1 --2- 172.21.15.19:0/920885617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff67c004390 0x7ff67c004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.508+0000 7ff69a0b4640 1 -- 172.21.15.19:0/920885617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff694161c80 msgr2=0x7ff67c005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:21.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.508+0000 7ff69a0b4640 1 --2- 172.21.15.19:0/920885617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff694161c80 0x7ff67c005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.508+0000 7ff69a0b4640 1 -- 172.21.15.19:0/920885617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff67c004390 msgr2=0x7ff67c004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:21.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.508+0000 7ff69a0b4640 1 --2- 172.21.15.19:0/920885617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff67c004390 0x7ff67c004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.508+0000 7ff69a0b4640 1 -- 172.21.15.19:0/920885617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c003520 con 0x7ff67c0039e0 2024-09-12T02:02:21.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.508+0000 7ff6998b3640 1 --2- 172.21.15.19:0/920885617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff67c004390 0x7ff67c004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:21.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.508+0000 7ff69a0b4640 1 --2- 172.21.15.19:0/920885617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67c0039e0 0x7ff67c003dc0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7ff68400e350 tx=0x7ff67c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59e6f7112d5d126 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:21.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.508+0000 7ff6990b2640 1 -- 172.21.15.19:0/920885617 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684033070 con 0x7ff67c0039e0 2024-09-12T02:02:21.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.508+0000 7ff6990b2640 1 -- 172.21.15.19:0/920885617 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68402f660 con 0x7ff67c0039e0 2024-09-12T02:02:21.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.508+0000 7ff6990b2640 1 -- 172.21.15.19:0/920885617 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684009de0 con 0x7ff67c0039e0 2024-09-12T02:02:21.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.509+0000 7ff69c318640 1 -- 172.21.15.19:0/920885617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67c0039e0 msgr2=0x7ff67c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:21.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.509+0000 7ff69c318640 1 --2- 172.21.15.19:0/920885617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67c0039e0 0x7ff67c003dc0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7ff68400e350 tx=0x7ff67c005830 comp rx=0 tx=0).stop 2024-09-12T02:02:21.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.509+0000 7ff69a8b5640 1 -- 172.21.15.19:0/920885617 reap_dead start 2024-09-12T02:02:21.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.509+0000 7ff69c318640 1 -- 172.21.15.19:0/920885617 shutdown_connections 2024-09-12T02:02:21.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.509+0000 7ff69c318640 1 -- 172.21.15.19:0/920885617 >> 172.21.15.19:0/920885617 conn(0x7ff6940d44f0 msgr2=0x7ff6940d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:21.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.509+0000 7ff69c318640 1 -- 172.21.15.19:0/920885617 shutdown_connections 2024-09-12T02:02:21.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.509+0000 7ff69c318640 1 -- 172.21.15.19:0/920885617 wait complete. 2024-09-12T02:02:21.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.510+0000 7ff69c318640 1 Processor -- start 2024-09-12T02:02:21.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.510+0000 7ff69c318640 1 -- start start 2024-09-12T02:02:21.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.511+0000 7ff69c318640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff67c0039e0 0x7ff694155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.511+0000 7ff69c318640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff694156580 0x7ff69415eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.511+0000 7ff69c318640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff694156ab0 0x7ff69415f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.511+0000 7ff69c318640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff6940b6b30 con 0x7ff694156ab0 2024-09-12T02:02:21.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.511+0000 7ff69c318640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff6940d2aa0 con 0x7ff694156580 2024-09-12T02:02:21.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.511+0000 7ff69c318640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff6940b6cb0 con 0x7ff67c0039e0 2024-09-12T02:02:21.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.511+0000 7ff69a8b5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff694156ab0 0x7ff69415f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.511+0000 7ff69a8b5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff694156ab0 0x7ff69415f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50654/0 (socket says 172.21.15.19:50654) 2024-09-12T02:02:21.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.511+0000 7ff69a8b5640 1 -- 172.21.15.19:0/3301990341 learned_addr learned my addr 172.21.15.19:0/3301990341 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:21.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.511+0000 7ff6998b3640 1 --2- 172.21.15.19:0/3301990341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff694156580 0x7ff69415eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.511+0000 7ff69a0b4640 1 --2- 172.21.15.19:0/3301990341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff67c0039e0 0x7ff694155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.512+0000 7ff69a8b5640 1 -- 172.21.15.19:0/3301990341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff67c0039e0 msgr2=0x7ff694155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:21.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.512+0000 7ff69a8b5640 1 --2- 172.21.15.19:0/3301990341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff67c0039e0 0x7ff694155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.512+0000 7ff69a8b5640 1 -- 172.21.15.19:0/3301990341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff694156580 msgr2=0x7ff69415eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:21.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.512+0000 7ff69a8b5640 1 --2- 172.21.15.19:0/3301990341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff694156580 0x7ff69415eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.512+0000 7ff69a8b5640 1 -- 172.21.15.19:0/3301990341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6940cd440 con 0x7ff694156ab0 2024-09-12T02:02:21.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.512+0000 7ff69a8b5640 1 --2- 172.21.15.19:0/3301990341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff694156ab0 0x7ff69415f070 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00f770 tx=0x7ff68c00fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:21.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.512+0000 7ff692ffd640 1 -- 172.21.15.19:0/3301990341 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c019070 con 0x7ff694156ab0 2024-09-12T02:02:21.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.512+0000 7ff692ffd640 1 -- 172.21.15.19:0/3301990341 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68c005030 con 0x7ff694156ab0 2024-09-12T02:02:21.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.512+0000 7ff69c318640 1 -- 172.21.15.19:0/3301990341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6940cd720 con 0x7ff694156ab0 2024-09-12T02:02:21.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.512+0000 7ff692ffd640 1 -- 172.21.15.19:0/3301990341 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c005440 con 0x7ff694156ab0 2024-09-12T02:02:21.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.512+0000 7ff69c318640 1 -- 172.21.15.19:0/3301990341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6941f89d0 con 0x7ff694156ab0 2024-09-12T02:02:21.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.513+0000 7ff69c318640 1 -- 172.21.15.19:0/3301990341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69406e330 con 0x7ff694156ab0 2024-09-12T02:02:21.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.514+0000 7ff692ffd640 1 -- 172.21.15.19:0/3301990341 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff68c01c070 con 0x7ff694156ab0 2024-09-12T02:02:21.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.514+0000 7ff692ffd640 1 --2- 172.21.15.19:0/3301990341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff68006be30 0x7ff68006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:21.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.514+0000 7ff692ffd640 1 -- 172.21.15.19:0/3301990341 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6101+0+0 (secure 0 0 0) 0x7ff68c08a160 con 0x7ff694156ab0 2024-09-12T02:02:21.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.514+0000 7ff69a0b4640 1 --2- 172.21.15.19:0/3301990341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff68006be30 0x7ff68006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:21.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.515+0000 7ff69a0b4640 1 --2- 172.21.15.19:0/3301990341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff68006be30 0x7ff68006e2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff684035000 tx=0x7ff68402f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:21.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.518+0000 7ff692ffd640 1 -- 172.21.15.19:0/3301990341 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff68c058330 con 0x7ff694156ab0 2024-09-12T02:02:21.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.732+0000 7ff69c318640 1 -- 172.21.15.19:0/3301990341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff6940b3070 con 0x7ff694156ab0 2024-09-12T02:02:21.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.732+0000 7ff692ffd640 1 -- 172.21.15.19:0/3301990341 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) ==== 53+0+73 (secure 0 0 0) 0x7ff68c05c630 con 0x7ff694156ab0 2024-09-12T02:02:21.733 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:02:21.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.735+0000 7ff69c318640 1 -- 172.21.15.19:0/3301990341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff68006be30 msgr2=0x7ff68006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:21.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.735+0000 7ff69c318640 1 --2- 172.21.15.19:0/3301990341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff68006be30 0x7ff68006e2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff684035000 tx=0x7ff68402f000 comp rx=0 tx=0).stop 2024-09-12T02:02:21.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.735+0000 7ff69c318640 1 -- 172.21.15.19:0/3301990341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff694156ab0 msgr2=0x7ff69415f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:21.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.735+0000 7ff69c318640 1 --2- 172.21.15.19:0/3301990341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff694156ab0 0x7ff69415f070 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00f770 tx=0x7ff68c00fc30 comp rx=0 tx=0).stop 2024-09-12T02:02:21.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.735+0000 7ff69c318640 1 -- 172.21.15.19:0/3301990341 shutdown_connections 2024-09-12T02:02:21.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.735+0000 7ff69c318640 1 --2- 172.21.15.19:0/3301990341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff68006be30 0x7ff68006e2f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.735+0000 7ff69c318640 1 --2- 172.21.15.19:0/3301990341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff694156ab0 0x7ff69415f070 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.735+0000 7ff69c318640 1 --2- 172.21.15.19:0/3301990341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff694156580 0x7ff69415eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.735+0000 7ff69c318640 1 --2- 172.21.15.19:0/3301990341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff67c0039e0 0x7ff694155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:21.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.735+0000 7ff69c318640 1 -- 172.21.15.19:0/3301990341 >> 172.21.15.19:0/3301990341 conn(0x7ff6940d44f0 msgr2=0x7ff694160870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:21.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.735+0000 7ff69c318640 1 -- 172.21.15.19:0/3301990341 shutdown_connections 2024-09-12T02:02:21.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21.735+0000 7ff69c318640 1 -- 172.21.15.19:0/3301990341 wait complete. 2024-09-12T02:02:21.746 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:02:21.746 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:02:21.746 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T02:02:21.746 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:02:21.746 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:02:21.746 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:02:21.746 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:02:21.746 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:02:21.746 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:02:21.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:21.747 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T02:02:21.763 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:02:21.763 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:02:21.763 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:02:21.763 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:02:21.763 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T02:02:21.763 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:02:21.763 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:02:21.763 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:02:21.764 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T02:02:21.764 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:02:21.764 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:02:21.764 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T02:02:21.764 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:02:21.764 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:02:21.764 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T02:02:21.764 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:02:21.764 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42419sec preferred_lft 42419sec 2024-09-12T02:02:21.764 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T02:02:21.764 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:02:21.764 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:02:21.764 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:02:21.764 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T02:02:21.765 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:02:21.765 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T02:02:21.765 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:02:21.765 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:02:21.765 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T02:02:21.765 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:02:21.765 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:02:21.765 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:02:21.765 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T02:02:21.765 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:02:21.765 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:02:21.765 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:02:21.765 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T02:02:21.766 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:02:21.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:21.766 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:02:21.827 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T02:02:21.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:21.829 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T02:02:21.885 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T02:02:21.886 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:02:21.886 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:02:21.886 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:02:21.886 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:02:21.886 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:02:21.886 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T02:02:21.886 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:02:21.886 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:02:21.886 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:02:21.887 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T02:02:21.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:02:22.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:02:22.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:22.015 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T02:02:22.031 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:02:22.031 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:02:22.031 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:02:22.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:22.031 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T02:02:22.097 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:02:22.097 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:02:22.153 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:02:22.153 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:02:22.153 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:02:22.209 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:02:22.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:22.209 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:02:22.293 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:02:22.294 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:02:22.294 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:02:22.302 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:02:22.303 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:02:22.303 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:02:22.303 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:02:22.303 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:02:22.322 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:02:22.322 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:02:22.322 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:02:22.322 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:02:22.322 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:02:22.323 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T02:02:22.323 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T02:02:22.323 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T02:02:22.323 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:02:22.323 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:02:22.323 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:02:22.323 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:02:22.324 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:02:22.325 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:02:22.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:22.325 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:02:22.351 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:02:22.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:02:22.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:02:22.455 INFO:teuthology.orchestra.run.smithi019.stdout:client6571 2024-09-12T02:02:22.455 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:02:22.455 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:02:22.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:22.472 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-12T02:02:22.534 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:02:22.534 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:02:22.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:22.592 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-09-12T02:02:22.688 INFO:teuthology.orchestra.run.smithi019.stderr:6+0 records in 2024-09-12T02:02:22.688 INFO:teuthology.orchestra.run.smithi019.stderr:6+0 records out 2024-09-12T02:02:22.688 INFO:teuthology.orchestra.run.smithi019.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0382045 s, 165 MB/s 2024-09-12T02:02:22.689 DEBUG:teuthology.orchestra.run.smithi019:> stdin-killer -- python3 -c ' 2024-09-12T02:02:22.689 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-09-12T02:02:22.689 DEBUG:teuthology.orchestra.run.smithi019:> import stat 2024-09-12T02:02:22.689 DEBUG:teuthology.orchestra.run.smithi019:> import json 2024-09-12T02:02:22.689 DEBUG:teuthology.orchestra.run.smithi019:> import sys 2024-09-12T02:02:22.689 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T02:02:22.689 DEBUG:teuthology.orchestra.run.smithi019:> try: 2024-09-12T02:02:22.689 DEBUG:teuthology.orchestra.run.smithi019:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-12T02:02:22.689 DEBUG:teuthology.orchestra.run.smithi019:> except OSError as e: 2024-09-12T02:02:22.689 DEBUG:teuthology.orchestra.run.smithi019:> sys.exit(e.errno) 2024-09-12T02:02:22.689 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T02:02:22.689 DEBUG:teuthology.orchestra.run.smithi019:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-12T02:02:22.689 DEBUG:teuthology.orchestra.run.smithi019:> print(json.dumps( 2024-09-12T02:02:22.690 DEBUG:teuthology.orchestra.run.smithi019:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-12T02:02:22.690 DEBUG:teuthology.orchestra.run.smithi019:> indent=2)) 2024-09-12T02:02:22.690 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-09-12T02:02:22.762 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:02:22.762 INFO:teuthology.orchestra.run.smithi019.stdout: "st_mode": 33188, 2024-09-12T02:02:22.762 INFO:teuthology.orchestra.run.smithi019.stdout: "st_ino": 1099511627777, 2024-09-12T02:02:22.762 INFO:teuthology.orchestra.run.smithi019.stdout: "st_dev": 41, 2024-09-12T02:02:22.762 INFO:teuthology.orchestra.run.smithi019.stdout: "st_nlink": 1, 2024-09-12T02:02:22.762 INFO:teuthology.orchestra.run.smithi019.stdout: "st_uid": 1000, 2024-09-12T02:02:22.762 INFO:teuthology.orchestra.run.smithi019.stdout: "st_gid": 1333, 2024-09-12T02:02:22.762 INFO:teuthology.orchestra.run.smithi019.stdout: "st_size": 6291456, 2024-09-12T02:02:22.762 INFO:teuthology.orchestra.run.smithi019.stdout: "st_atime": 1726106542.648942, 2024-09-12T02:02:22.763 INFO:teuthology.orchestra.run.smithi019.stdout: "st_mtime": 1726106542.6679418, 2024-09-12T02:02:22.763 INFO:teuthology.orchestra.run.smithi019.stdout: "st_ctime": 1726106542.6679418 2024-09-12T02:02:22.763 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:02:22.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:02:22.768 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:02:22.768 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:02:22.825 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:02:22.825 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:02:22.881 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:02:23.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.024+0000 7fc965542640 1 Processor -- start 2024-09-12T02:02:23.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.024+0000 7fc965542640 1 -- start start 2024-09-12T02:02:23.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.025+0000 7fc965542640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc96015c870 0x7fc96015cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:23.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.025+0000 7fc965542640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9600ccf90 0x7fc9600cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:23.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.025+0000 7fc965542640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9600d01c0 con 0x7fc96015c490 2024-09-12T02:02:23.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.025+0000 7fc965542640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc9600cff70 con 0x7fc96015c870 2024-09-12T02:02:23.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.025+0000 7fc965542640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc9600d0dd0 con 0x7fc9600ccf90 2024-09-12T02:02:23.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.025+0000 7fc95f7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9600ccf90 0x7fc9600cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:23.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.025+0000 7fc957fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc96015c870 0x7fc96015cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:23.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.025+0000 7fc95effd640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fc96015c490 0x7fc96009b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:40920/0 (socket says 172.21.15.19:40920) 2024-09-12T02:02:23.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.025+0000 7fc95effd640 1 -- 172.21.15.19:0/3950406389 learned_addr learned my addr 172.21.15.19:0/3950406389 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:23.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.026+0000 7fc957fff640 1 -- 172.21.15.19:0/3950406389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9600ccf90 msgr2=0x7fc9600cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:23.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.026+0000 7fc957fff640 1 --2- 172.21.15.19:0/3950406389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9600ccf90 0x7fc9600cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.026+0000 7fc957fff640 1 -- 172.21.15.19:0/3950406389 >> v1:172.21.15.135:6789/0 conn(0x7fc96015c490 legacy=0x7fc96009b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:23.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.026+0000 7fc957fff640 1 -- 172.21.15.19:0/3950406389 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9600d04a0 con 0x7fc96015c870 2024-09-12T02:02:23.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.026+0000 7fc95f7fe640 1 --2- 172.21.15.19:0/3950406389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9600ccf90 0x7fc9600cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:23.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.026+0000 7fc957fff640 1 --2- 172.21.15.19:0/3950406389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc96015c870 0x7fc96015cce0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc9480097a0 tx=0x7fc94802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a87124c316872356 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:23.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.027+0000 7fc95e7fc640 1 -- 172.21.15.19:0/3950406389 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc948037070 con 0x7fc96015c870 2024-09-12T02:02:23.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.027+0000 7fc95e7fc640 1 -- 172.21.15.19:0/3950406389 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc948032440 con 0x7fc96015c870 2024-09-12T02:02:23.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.027+0000 7fc95e7fc640 1 -- 172.21.15.19:0/3950406389 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc948032810 con 0x7fc96015c870 2024-09-12T02:02:23.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.027+0000 7fc965542640 1 -- 172.21.15.19:0/3950406389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc96015c870 msgr2=0x7fc96015cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:23.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.027+0000 7fc965542640 1 --2- 172.21.15.19:0/3950406389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc96015c870 0x7fc96015cce0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc9480097a0 tx=0x7fc94802a210 comp rx=0 tx=0).stop 2024-09-12T02:02:23.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.027+0000 7fc965542640 1 -- 172.21.15.19:0/3950406389 shutdown_connections 2024-09-12T02:02:23.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.027+0000 7fc965542640 1 --2- 172.21.15.19:0/3950406389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9600ccf90 0x7fc9600cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.027+0000 7fc965542640 1 --2- 172.21.15.19:0/3950406389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc96015c870 0x7fc96015cce0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.027+0000 7fc965542640 1 -- 172.21.15.19:0/3950406389 >> 172.21.15.19:0/3950406389 conn(0x7fc9600d23a0 msgr2=0x7fc9600d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:23.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.027+0000 7fc965542640 1 -- 172.21.15.19:0/3950406389 shutdown_connections 2024-09-12T02:02:23.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.027+0000 7fc965542640 1 -- 172.21.15.19:0/3950406389 wait complete. 2024-09-12T02:02:23.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.028+0000 7fc965542640 1 Processor -- start 2024-09-12T02:02:23.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.029+0000 7fc965542640 1 -- start start 2024-09-12T02:02:23.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.029+0000 7fc965542640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9600ccf90 0x7fc9600b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:23.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.029+0000 7fc965542640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc96015c490 0x7fc9601f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:23.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.029+0000 7fc965542640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc96015c870 0x7fc9600b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:23.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.029+0000 7fc965542640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc9600d1260 con 0x7fc9600ccf90 2024-09-12T02:02:23.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.029+0000 7fc965542640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc9600d0a60 con 0x7fc96015c490 2024-09-12T02:02:23.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.029+0000 7fc965542640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc9601f6b00 con 0x7fc96015c870 2024-09-12T02:02:23.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.029+0000 7fc95effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9600ccf90 0x7fc9600b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:23.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.029+0000 7fc95effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9600ccf90 0x7fc9600b6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50658/0 (socket says 172.21.15.19:50658) 2024-09-12T02:02:23.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.029+0000 7fc95effd640 1 -- 172.21.15.19:0/1985587870 learned_addr learned my addr 172.21.15.19:0/1985587870 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:23.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.030+0000 7fc957fff640 1 --2- 172.21.15.19:0/1985587870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc96015c490 0x7fc9601f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:23.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.030+0000 7fc95f7fe640 1 --2- 172.21.15.19:0/1985587870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc96015c870 0x7fc9600b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:23.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.030+0000 7fc95effd640 1 -- 172.21.15.19:0/1985587870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc96015c870 msgr2=0x7fc9600b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:23.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.030+0000 7fc95effd640 1 --2- 172.21.15.19:0/1985587870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc96015c870 0x7fc9600b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.030+0000 7fc95effd640 1 -- 172.21.15.19:0/1985587870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc96015c490 msgr2=0x7fc9601f65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:23.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.030+0000 7fc95effd640 1 --2- 172.21.15.19:0/1985587870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc96015c490 0x7fc9601f65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.030+0000 7fc95effd640 1 -- 172.21.15.19:0/1985587870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9600cbd40 con 0x7fc9600ccf90 2024-09-12T02:02:23.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.030+0000 7fc95effd640 1 --2- 172.21.15.19:0/1985587870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9600ccf90 0x7fc9600b6350 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fc95000c400 tx=0x7fc95000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:23.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.030+0000 7fc9577fe640 1 -- 172.21.15.19:0/1985587870 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950017070 con 0x7fc9600ccf90 2024-09-12T02:02:23.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.030+0000 7fc9577fe640 1 -- 172.21.15.19:0/1985587870 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc950005ce0 con 0x7fc9600ccf90 2024-09-12T02:02:23.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.030+0000 7fc965542640 1 -- 172.21.15.19:0/1985587870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9600cc020 con 0x7fc9600ccf90 2024-09-12T02:02:23.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.030+0000 7fc9577fe640 1 -- 172.21.15.19:0/1985587870 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9500072f0 con 0x7fc9600ccf90 2024-09-12T02:02:23.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.030+0000 7fc965542640 1 -- 172.21.15.19:0/1985587870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9601565c0 con 0x7fc9600ccf90 2024-09-12T02:02:23.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.031+0000 7fc965542640 1 -- 172.21.15.19:0/1985587870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc96015cce0 con 0x7fc9600ccf90 2024-09-12T02:02:23.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.032+0000 7fc9577fe640 1 -- 172.21.15.19:0/1985587870 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc95001a070 con 0x7fc9600ccf90 2024-09-12T02:02:23.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.032+0000 7fc9577fe640 1 --2- 172.21.15.19:0/1985587870 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc94006be60 0x7fc94006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:23.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.032+0000 7fc9577fe640 1 -- 172.21.15.19:0/1985587870 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6101+0+0 (secure 0 0 0) 0x7fc95008a1a0 con 0x7fc9600ccf90 2024-09-12T02:02:23.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.032+0000 7fc957fff640 1 --2- 172.21.15.19:0/1985587870 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc94006be60 0x7fc94006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:23.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.033+0000 7fc957fff640 1 --2- 172.21.15.19:0/1985587870 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc94006be60 0x7fc94006e320 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc948034000 tx=0x7fc94802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:23.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.037+0000 7fc9577fe640 1 -- 172.21.15.19:0/1985587870 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc950058400 con 0x7fc9600ccf90 2024-09-12T02:02:23.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.225+0000 7fc965542640 1 -- 172.21.15.19:0/1985587870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc9600d3190 con 0x7fc9600ccf90 2024-09-12T02:02:23.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.226+0000 7fc9577fe640 1 -- 172.21.15.19:0/1985587870 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v93) ==== 80+0+0 (secure 0 0 0) 0x7fc95005c700 con 0x7fc9600ccf90 2024-09-12T02:02:23.226 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-09-12T02:02:23.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.228+0000 7fc965542640 1 -- 172.21.15.19:0/1985587870 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc94006be60 msgr2=0x7fc94006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:23.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.228+0000 7fc965542640 1 --2- 172.21.15.19:0/1985587870 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc94006be60 0x7fc94006e320 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc948034000 tx=0x7fc94802e000 comp rx=0 tx=0).stop 2024-09-12T02:02:23.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.228+0000 7fc965542640 1 -- 172.21.15.19:0/1985587870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9600ccf90 msgr2=0x7fc9600b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:23.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.228+0000 7fc965542640 1 --2- 172.21.15.19:0/1985587870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9600ccf90 0x7fc9600b6350 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fc95000c400 tx=0x7fc95000c800 comp rx=0 tx=0).stop 2024-09-12T02:02:23.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.228+0000 7fc965542640 1 -- 172.21.15.19:0/1985587870 shutdown_connections 2024-09-12T02:02:23.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.228+0000 7fc965542640 1 --2- 172.21.15.19:0/1985587870 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc94006be60 0x7fc94006e320 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.228+0000 7fc965542640 1 --2- 172.21.15.19:0/1985587870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc96015c870 0x7fc9600b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.228+0000 7fc965542640 1 --2- 172.21.15.19:0/1985587870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc96015c490 0x7fc9601f65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.228+0000 7fc965542640 1 --2- 172.21.15.19:0/1985587870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9600ccf90 0x7fc9600b6350 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.228+0000 7fc965542640 1 -- 172.21.15.19:0/1985587870 >> 172.21.15.19:0/1985587870 conn(0x7fc9600d23a0 msgr2=0x7fc9600b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:23.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.228+0000 7fc965542640 1 -- 172.21.15.19:0/1985587870 shutdown_connections 2024-09-12T02:02:23.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.228+0000 7fc965542640 1 -- 172.21.15.19:0/1985587870 wait complete. 2024-09-12T02:02:23.240 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:02:23.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:23.240 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:02:23.284 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:02:23.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:23.285 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:02:23.318 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:23.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.461+0000 7fcebbbfd640 1 Processor -- start 2024-09-12T02:02:23.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.461+0000 7fcebbbfd640 1 -- start start 2024-09-12T02:02:23.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.461+0000 7fcebbbfd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fceb415e5f0 0x7fceb40d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:23.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.462+0000 7fcebbbfd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fceb40d30f0 0x7fceb40b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:23.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.462+0000 7fcebbbfd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceb40d3690 con 0x7fceb40b64c0 2024-09-12T02:02:23.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.462+0000 7fcebbbfd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fceb406d530 con 0x7fceb40d30f0 2024-09-12T02:02:23.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.462+0000 7fcebbbfd640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fceb40d3970 con 0x7fceb415e5f0 2024-09-12T02:02:23.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.462+0000 7fceb9198640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fceb40d30f0 0x7fceb40b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:23.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.462+0000 7fceba19a640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fceb40b64c0 0x7fceb40cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33356/0 (socket says 172.21.15.19:33356) 2024-09-12T02:02:23.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.462+0000 7fceba19a640 1 -- 172.21.15.19:0/2331205108 learned_addr learned my addr 172.21.15.19:0/2331205108 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:23.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.462+0000 7fceb9999640 1 --2- 172.21.15.19:0/2331205108 >> v2:172.21.15.135:3300/0 conn(0x7fceb415e5f0 0x7fceb40d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:23.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.462+0000 7fceb9198640 1 -- 172.21.15.19:0/2331205108 >> v2:172.21.15.135:3300/0 conn(0x7fceb415e5f0 msgr2=0x7fceb40d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:23.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.462+0000 7fceb9198640 1 --2- 172.21.15.19:0/2331205108 >> v2:172.21.15.135:3300/0 conn(0x7fceb415e5f0 0x7fceb40d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.462+0000 7fceb9198640 1 -- 172.21.15.19:0/2331205108 >> v1:172.21.15.19:6789/0 conn(0x7fceb40b64c0 legacy=0x7fceb40cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:23.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.462+0000 7fceb8997640 1 -- 172.21.15.19:0/2331205108 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1712074306 0 0) 0x7fceb40d3690 con 0x7fceb40b64c0 2024-09-12T02:02:23.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.462+0000 7fceb9198640 1 -- 172.21.15.19:0/2331205108 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb406cee0 con 0x7fceb40d30f0 2024-09-12T02:02:23.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.463+0000 7fceb9198640 1 --2- 172.21.15.19:0/2331205108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceb40d30f0 0x7fceb40b5f80 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fceb40d1f90 tx=0x7fcea402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57943da52c66e2c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:23.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.463+0000 7fceb8997640 1 -- 172.21.15.19:0/2331205108 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea4037070 con 0x7fceb40d30f0 2024-09-12T02:02:23.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.463+0000 7fceb8997640 1 -- 172.21.15.19:0/2331205108 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea4032440 con 0x7fceb40d30f0 2024-09-12T02:02:23.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.463+0000 7fceb8997640 1 -- 172.21.15.19:0/2331205108 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea4032810 con 0x7fceb40d30f0 2024-09-12T02:02:23.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.463+0000 7fcebbbfd640 1 -- 172.21.15.19:0/2331205108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceb40d30f0 msgr2=0x7fceb40b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:23.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.463+0000 7fcebbbfd640 1 --2- 172.21.15.19:0/2331205108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceb40d30f0 0x7fceb40b5f80 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fceb40d1f90 tx=0x7fcea402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.464+0000 7fcebbbfd640 1 -- 172.21.15.19:0/2331205108 shutdown_connections 2024-09-12T02:02:23.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.464+0000 7fcebbbfd640 1 --2- 172.21.15.19:0/2331205108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceb40d30f0 0x7fceb40b5f80 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.464+0000 7fcebbbfd640 1 --2- 172.21.15.19:0/2331205108 >> v2:172.21.15.135:3300/0 conn(0x7fceb415e5f0 0x7fceb40d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.464+0000 7fcebbbfd640 1 -- 172.21.15.19:0/2331205108 >> 172.21.15.19:0/2331205108 conn(0x7fceb408bfc0 msgr2=0x7fceb40d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:23.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.464+0000 7fcebbbfd640 1 -- 172.21.15.19:0/2331205108 shutdown_connections 2024-09-12T02:02:23.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.464+0000 7fcebbbfd640 1 -- 172.21.15.19:0/2331205108 wait complete. 2024-09-12T02:02:23.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.465+0000 7fcebbbfd640 1 Processor -- start 2024-09-12T02:02:23.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.465+0000 7fcebbbfd640 1 -- start start 2024-09-12T02:02:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fcebbbfd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceb40b64c0 0x7fceb41508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fcebbbfd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fceb40d30f0 0x7fceb40c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fcebbbfd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceb415e5f0 0x7fceb4160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fcebbbfd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fceb40d5310 con 0x7fceb40b64c0 2024-09-12T02:02:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fcebbbfd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fceb415e9d0 con 0x7fceb415e5f0 2024-09-12T02:02:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fcebbbfd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fceb406e9d0 con 0x7fceb40d30f0 2024-09-12T02:02:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fceb9999640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceb40b64c0 0x7fceb41508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fceb9999640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceb40b64c0 0x7fceb41508f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50674/0 (socket says 172.21.15.19:50674) 2024-09-12T02:02:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fceb9999640 1 -- 172.21.15.19:0/2575724746 learned_addr learned my addr 172.21.15.19:0/2575724746 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fceba19a640 1 --2- 172.21.15.19:0/2575724746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceb415e5f0 0x7fceb4160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fceb9198640 1 --2- 172.21.15.19:0/2575724746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fceb40d30f0 0x7fceb40c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fceb9999640 1 -- 172.21.15.19:0/2575724746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fceb40d30f0 msgr2=0x7fceb40c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fceb9999640 1 --2- 172.21.15.19:0/2575724746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fceb40d30f0 0x7fceb40c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fceb9999640 1 -- 172.21.15.19:0/2575724746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceb415e5f0 msgr2=0x7fceb4160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:23.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fceb9999640 1 --2- 172.21.15.19:0/2575724746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceb415e5f0 0x7fceb4160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fceb9999640 1 -- 172.21.15.19:0/2575724746 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb4150e30 con 0x7fceb40b64c0 2024-09-12T02:02:23.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fceb9198640 1 --2- 172.21.15.19:0/2575724746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fceb40d30f0 0x7fceb40c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:23.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fceba19a640 1 --2- 172.21.15.19:0/2575724746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceb415e5f0 0x7fceb4160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:23.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fceb9999640 1 --2- 172.21.15.19:0/2575724746 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceb40b64c0 0x7fceb41508f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fceb000d5f0 tx=0x7fceb000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:23.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fceaa7fc640 1 -- 172.21.15.19:0/2575724746 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb00125f0 con 0x7fceb40b64c0 2024-09-12T02:02:23.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fceaa7fc640 1 -- 172.21.15.19:0/2575724746 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb0019070 con 0x7fceb40b64c0 2024-09-12T02:02:23.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fceaa7fc640 1 -- 172.21.15.19:0/2575724746 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb00129d0 con 0x7fceb40b64c0 2024-09-12T02:02:23.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fcebbbfd640 1 -- 172.21.15.19:0/2575724746 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceb40ca400 con 0x7fceb40b64c0 2024-09-12T02:02:23.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.466+0000 7fcebbbfd640 1 -- 172.21.15.19:0/2575724746 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceb40caca0 con 0x7fceb40b64c0 2024-09-12T02:02:23.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.467+0000 7fcebbbfd640 1 -- 172.21.15.19:0/2575724746 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceb40b5f80 con 0x7fceb40b64c0 2024-09-12T02:02:23.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.468+0000 7fceaa7fc640 1 -- 172.21.15.19:0/2575724746 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fceb0012b70 con 0x7fceb40b64c0 2024-09-12T02:02:23.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.468+0000 7fceaa7fc640 1 --2- 172.21.15.19:0/2575724746 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce9806be30 0x7fce9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:23.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.468+0000 7fceaa7fc640 1 -- 172.21.15.19:0/2575724746 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6101+0+0 (secure 0 0 0) 0x7fceb008b400 con 0x7fceb40b64c0 2024-09-12T02:02:23.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.468+0000 7fceb9198640 1 --2- 172.21.15.19:0/2575724746 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce9806be30 0x7fce9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:23.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.469+0000 7fceb9198640 1 --2- 172.21.15.19:0/2575724746 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce9806be30 0x7fce9806e2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcea4034000 tx=0x7fcea402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:23.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.472+0000 7fceaa7fc640 1 -- 172.21.15.19:0/2575724746 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fceb0059c20 con 0x7fceb40b64c0 2024-09-12T02:02:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.684+0000 7fcebbbfd640 1 -- 172.21.15.19:0/2575724746 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fceb40d4ea0 con 0x7fceb40b64c0 2024-09-12T02:02:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.685+0000 7fceaa7fc640 1 -- 172.21.15.19:0/2575724746 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5225 (secure 0 0 0) 0x7fceb0059520 con 0x7fceb40b64c0 2024-09-12T02:02:23.686 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:23.686 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":76,"btime":"2024-09-12T02:02:14:334033+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/613869354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":613869354},{"type":"v1","addr":"172.21.15.19:6834","nonce":613869354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:02:13.679357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6451":{"gid":6451,"name":"d","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6837/3774685060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3774685060},{"type":"v1","addr":"172.21.15.135:6837","nonce":3774685060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6451,"qdb_cluster":[6451]},"id":6}]} 2024-09-12T02:02:23.686 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 76 2024-09-12T02:02:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.687+0000 7fcebbbfd640 1 -- 172.21.15.19:0/2575724746 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce9806be30 msgr2=0x7fce9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.687+0000 7fcebbbfd640 1 --2- 172.21.15.19:0/2575724746 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce9806be30 0x7fce9806e2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcea4034000 tx=0x7fcea402e000 comp rx=0 tx=0).stop 2024-09-12T02:02:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.687+0000 7fcebbbfd640 1 -- 172.21.15.19:0/2575724746 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceb40b64c0 msgr2=0x7fceb41508f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.687+0000 7fcebbbfd640 1 --2- 172.21.15.19:0/2575724746 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceb40b64c0 0x7fceb41508f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fceb000d5f0 tx=0x7fceb000dab0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.687+0000 7fcebbbfd640 1 -- 172.21.15.19:0/2575724746 shutdown_connections 2024-09-12T02:02:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.687+0000 7fcebbbfd640 1 --2- 172.21.15.19:0/2575724746 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce9806be30 0x7fce9806e2f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.687+0000 7fcebbbfd640 1 --2- 172.21.15.19:0/2575724746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceb415e5f0 0x7fceb4160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.687+0000 7fcebbbfd640 1 --2- 172.21.15.19:0/2575724746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fceb40d30f0 0x7fceb40c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.687+0000 7fcebbbfd640 1 --2- 172.21.15.19:0/2575724746 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceb40b64c0 0x7fceb41508f0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.687+0000 7fcebbbfd640 1 -- 172.21.15.19:0/2575724746 >> 172.21.15.19:0/2575724746 conn(0x7fceb408bfc0 msgr2=0x7fceb40b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.687+0000 7fcebbbfd640 1 -- 172.21.15.19:0/2575724746 shutdown_connections 2024-09-12T02:02:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.687+0000 7fcebbbfd640 1 -- 172.21.15.19:0/2575724746 wait complete. 2024-09-12T02:02:23.699 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-09-12T02:02:23.837 INFO:teuthology.orchestra.run.smithi135.stdout:{"message":"","return_code":0} 2024-09-12T02:02:23.837 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-12T02:02:23.837 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:02:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.941+0000 7f954cb6d640 1 Processor -- start 2024-09-12T02:02:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.941+0000 7f954cb6d640 1 -- start start 2024-09-12T02:02:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.942+0000 7f954cb6d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95480d30f0 0x7f95480b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.942+0000 7f954cb6d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f95480b64c0 0x7f954806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.942+0000 7f954cb6d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95480d3690 con 0x7f954815e5f0 2024-09-12T02:02:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.942+0000 7f954cb6d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f954806d530 con 0x7f95480b64c0 2024-09-12T02:02:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.942+0000 7f954cb6d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f95480d3970 con 0x7f95480d30f0 2024-09-12T02:02:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.942+0000 7f9546d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f95480b64c0 0x7f954806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.942+0000 7f954659c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f954815e5f0 0x7f95480d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33362/0 (socket says 172.21.15.19:33362) 2024-09-12T02:02:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.942+0000 7f954659c640 1 -- 172.21.15.19:0/3267393906 learned_addr learned my addr 172.21.15.19:0/3267393906 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.943+0000 7f9545d9b640 1 --2- 172.21.15.19:0/3267393906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95480d30f0 0x7f95480b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.943+0000 7f9546d9d640 1 -- 172.21.15.19:0/3267393906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95480d30f0 msgr2=0x7f95480b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.943+0000 7f9546d9d640 1 --2- 172.21.15.19:0/3267393906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95480d30f0 0x7f95480b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.943+0000 7f9546d9d640 1 -- 172.21.15.19:0/3267393906 >> v1:172.21.15.19:6789/0 conn(0x7f954815e5f0 legacy=0x7f95480d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.943+0000 7f954559a640 1 -- 172.21.15.19:0/3267393906 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2962776734 0 0) 0x7f95480d3690 con 0x7f954815e5f0 2024-09-12T02:02:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.943+0000 7f9546d9d640 1 -- 172.21.15.19:0/3267393906 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954806cee0 con 0x7f95480b64c0 2024-09-12T02:02:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.943+0000 7f9546d9d640 1 --2- 172.21.15.19:0/3267393906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95480b64c0 0x7f954806d9c0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f9538009d90 tx=0x7f953802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ec984efe57ce52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.944+0000 7f954559a640 1 -- 172.21.15.19:0/3267393906 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9538007740 con 0x7f95480b64c0 2024-09-12T02:02:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.944+0000 7f954559a640 1 -- 172.21.15.19:0/3267393906 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95380078e0 con 0x7f95480b64c0 2024-09-12T02:02:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.944+0000 7f954559a640 1 -- 172.21.15.19:0/3267393906 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9538007cb0 con 0x7f95480b64c0 2024-09-12T02:02:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.944+0000 7f954cb6d640 1 -- 172.21.15.19:0/3267393906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95480b64c0 msgr2=0x7f954806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.944+0000 7f954cb6d640 1 --2- 172.21.15.19:0/3267393906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95480b64c0 0x7f954806d9c0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f9538009d90 tx=0x7f953802a660 comp rx=0 tx=0).stop 2024-09-12T02:02:23.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.944+0000 7f954cb6d640 1 -- 172.21.15.19:0/3267393906 shutdown_connections 2024-09-12T02:02:23.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.944+0000 7f954cb6d640 1 --2- 172.21.15.19:0/3267393906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95480b64c0 0x7f954806d9c0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.944+0000 7f954cb6d640 1 --2- 172.21.15.19:0/3267393906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95480d30f0 0x7f95480b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.944+0000 7f954cb6d640 1 -- 172.21.15.19:0/3267393906 >> 172.21.15.19:0/3267393906 conn(0x7f954808bfc0 msgr2=0x7f95480d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:23.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.944+0000 7f954cb6d640 1 -- 172.21.15.19:0/3267393906 shutdown_connections 2024-09-12T02:02:23.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.944+0000 7f954cb6d640 1 -- 172.21.15.19:0/3267393906 wait complete. 2024-09-12T02:02:23.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.946+0000 7f954cb6d640 1 Processor -- start 2024-09-12T02:02:23.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.946+0000 7f954cb6d640 1 -- start start 2024-09-12T02:02:23.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.946+0000 7f954cb6d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95480b64c0 0x7f954815d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:23.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.946+0000 7f954cb6d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95480d30f0 0x7f95480b97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:23.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.946+0000 7f954cb6d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f954815e5f0 0x7f95480b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:23.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.946+0000 7f954cb6d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f954806df00 con 0x7f95480d30f0 2024-09-12T02:02:23.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.946+0000 7f954cb6d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f954815e9d0 con 0x7f954815e5f0 2024-09-12T02:02:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.946+0000 7f954cb6d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f954806e080 con 0x7f95480b64c0 2024-09-12T02:02:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.946+0000 7f9545d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95480d30f0 0x7f95480b97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.947+0000 7f9545d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95480d30f0 0x7f95480b97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50702/0 (socket says 172.21.15.19:50702) 2024-09-12T02:02:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.947+0000 7f9545d9b640 1 -- 172.21.15.19:0/2378566341 learned_addr learned my addr 172.21.15.19:0/2378566341 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.947+0000 7f9546d9d640 1 --2- 172.21.15.19:0/2378566341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f954815e5f0 0x7f95480b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.947+0000 7f954659c640 1 --2- 172.21.15.19:0/2378566341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95480b64c0 0x7f954815d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.947+0000 7f9545d9b640 1 -- 172.21.15.19:0/2378566341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95480b64c0 msgr2=0x7f954815d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.947+0000 7f9545d9b640 1 --2- 172.21.15.19:0/2378566341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95480b64c0 0x7f954815d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.947+0000 7f9545d9b640 1 -- 172.21.15.19:0/2378566341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f954815e5f0 msgr2=0x7f95480b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.947+0000 7f9545d9b640 1 --2- 172.21.15.19:0/2378566341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f954815e5f0 0x7f95480b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.947+0000 7f9545d9b640 1 -- 172.21.15.19:0/2378566341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954815d740 con 0x7f95480d30f0 2024-09-12T02:02:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.947+0000 7f9546d9d640 1 --2- 172.21.15.19:0/2378566341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f954815e5f0 0x7f95480b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.947+0000 7f9545d9b640 1 --2- 172.21.15.19:0/2378566341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95480d30f0 0x7f95480b97d0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f953000d7d0 tx=0x7f953000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.947+0000 7f953effd640 1 -- 172.21.15.19:0/2378566341 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9530004020 con 0x7f95480d30f0 2024-09-12T02:02:23.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.947+0000 7f953effd640 1 -- 172.21.15.19:0/2378566341 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95300041e0 con 0x7f95480d30f0 2024-09-12T02:02:23.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.947+0000 7f954cb6d640 1 -- 172.21.15.19:0/2378566341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954815f8b0 con 0x7f95480d30f0 2024-09-12T02:02:23.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.947+0000 7f953effd640 1 -- 172.21.15.19:0/2378566341 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95300043d0 con 0x7f95480d30f0 2024-09-12T02:02:23.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.947+0000 7f954cb6d640 1 -- 172.21.15.19:0/2378566341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f954815fe70 con 0x7f95480d30f0 2024-09-12T02:02:23.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.948+0000 7f954cb6d640 1 -- 172.21.15.19:0/2378566341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9548075790 con 0x7f95480d30f0 2024-09-12T02:02:23.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.949+0000 7f953effd640 1 -- 172.21.15.19:0/2378566341 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f953001b020 con 0x7f95480d30f0 2024-09-12T02:02:23.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.949+0000 7f953effd640 1 --2- 172.21.15.19:0/2378566341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f952806be30 0x7f952806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:23.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.949+0000 7f953effd640 1 -- 172.21.15.19:0/2378566341 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6101+0+0 (secure 0 0 0) 0x7f953008ae40 con 0x7f95480d30f0 2024-09-12T02:02:23.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.950+0000 7f954659c640 1 --2- 172.21.15.19:0/2378566341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f952806be30 0x7f952806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:23.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.950+0000 7f954659c640 1 --2- 172.21.15.19:0/2378566341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f952806be30 0x7f952806e2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9540000f60 tx=0x7f9540009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:23.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:23.954+0000 7f953effd640 1 -- 172.21.15.19:0/2378566341 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9548075790 con 0x7f95480d30f0 2024-09-12T02:02:24.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.171+0000 7f954cb6d640 1 -- 172.21.15.19:0/2378566341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f95480cc880 con 0x7f95480d30f0 2024-09-12T02:02:24.172 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:02:24.171+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:02:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.172+0000 7f953effd640 1 -- 172.21.15.19:0/2378566341 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) ==== 161+0+0 (secure 0 0 0) 0x7f954815d740 con 0x7f95480d30f0 2024-09-12T02:02:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:02:24.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.175+0000 7f954cb6d640 1 -- 172.21.15.19:0/2378566341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f952806be30 msgr2=0x7f952806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.175+0000 7f954cb6d640 1 --2- 172.21.15.19:0/2378566341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f952806be30 0x7f952806e2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9540000f60 tx=0x7f9540009040 comp rx=0 tx=0).stop 2024-09-12T02:02:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.175+0000 7f954cb6d640 1 -- 172.21.15.19:0/2378566341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95480d30f0 msgr2=0x7f95480b97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.175+0000 7f954cb6d640 1 --2- 172.21.15.19:0/2378566341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95480d30f0 0x7f95480b97d0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f953000d7d0 tx=0x7f953000dc90 comp rx=0 tx=0).stop 2024-09-12T02:02:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.175+0000 7f954cb6d640 1 -- 172.21.15.19:0/2378566341 shutdown_connections 2024-09-12T02:02:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.175+0000 7f954cb6d640 1 --2- 172.21.15.19:0/2378566341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f952806be30 0x7f952806e2f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.175+0000 7f954cb6d640 1 --2- 172.21.15.19:0/2378566341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f954815e5f0 0x7f95480b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.175+0000 7f954cb6d640 1 --2- 172.21.15.19:0/2378566341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95480d30f0 0x7f95480b97d0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.175+0000 7f954cb6d640 1 --2- 172.21.15.19:0/2378566341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95480b64c0 0x7f954815d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.175+0000 7f954cb6d640 1 -- 172.21.15.19:0/2378566341 >> 172.21.15.19:0/2378566341 conn(0x7f954808bfc0 msgr2=0x7f95480b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.175+0000 7f954cb6d640 1 -- 172.21.15.19:0/2378566341 shutdown_connections 2024-09-12T02:02:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.175+0000 7f954cb6d640 1 -- 172.21.15.19:0/2378566341 wait complete. 2024-09-12T02:02:24.179 INFO:tasks.ceph.mds.d.smithi135.stderr: -4402> 2024-09-12T02:02:14.636+0000 7fccea454640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:02:24.187 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata export - 2024-09-12T02:02:24.209 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T02:02:24.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.231+0000 7fcd8bb41f40 1 Processor -- start 2024-09-12T02:02:24.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.231+0000 7fcd8bb41f40 1 -- start start 2024-09-12T02:02:24.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.231+0000 7fcd8bb41f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd780030f0 0x5588b69205b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.231+0000 7fcd8bb41f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5588b68dbc40 0x5588b69095e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.231+0000 7fcd8bb41f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5588b6a43130 0x5588b6a435e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.231+0000 7fcd8bb41f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5588b682b510 con 0x5588b68dbc40 2024-09-12T02:02:24.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.231+0000 7fcd8bb41f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5588b6884c50 con 0x7fcd780030f0 2024-09-12T02:02:24.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.231+0000 7fcd8bb41f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5588b68d8dc0 con 0x5588b6a43130 2024-09-12T02:02:24.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.231+0000 7fcd88e36640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5588b68dbc40 0x5588b69095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.231+0000 7fcd88e36640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5588b68dbc40 0x5588b69095e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50728/0 (socket says 172.21.15.19:50728) 2024-09-12T02:02:24.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.231+0000 7fcd88e36640 1 -- 172.21.15.19:0/610600842 learned_addr learned my addr 172.21.15.19:0/610600842 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:24.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.232+0000 7fcd89637640 1 --2- 172.21.15.19:0/610600842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd780030f0 0x5588b69205b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.232+0000 7fcd88e36640 1 -- 172.21.15.19:0/610600842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5588b6a43130 msgr2=0x5588b6a435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:24.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.232+0000 7fcd89e38640 1 --2- 172.21.15.19:0/610600842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5588b6a43130 0x5588b6a435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.232+0000 7fcd88e36640 1 --2- 172.21.15.19:0/610600842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5588b6a43130 0x5588b6a435e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.232+0000 7fcd88e36640 1 -- 172.21.15.19:0/610600842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd780030f0 msgr2=0x5588b69205b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:24.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.232+0000 7fcd88e36640 1 --2- 172.21.15.19:0/610600842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd780030f0 0x5588b69205b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.232+0000 7fcd88e36640 1 -- 172.21.15.19:0/610600842 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588b6908c20 con 0x5588b68dbc40 2024-09-12T02:02:24.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.232+0000 7fcd89637640 1 --2- 172.21.15.19:0/610600842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd780030f0 0x5588b69205b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:24.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.232+0000 7fcd88e36640 1 --2- 172.21.15.19:0/610600842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5588b68dbc40 0x5588b69095e0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fcd74025880 tx=0x7fcd7404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8076cd09ed45708f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.232+0000 7fcd837fe640 1 -- 172.21.15.19:0/610600842 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd740543f0 con 0x5588b68dbc40 2024-09-12T02:02:24.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.232+0000 7fcd837fe640 1 -- 172.21.15.19:0/610600842 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd740547a0 con 0x5588b68dbc40 2024-09-12T02:02:24.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.232+0000 7fcd837fe640 1 -- 172.21.15.19:0/610600842 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd74054b90 con 0x5588b68dbc40 2024-09-12T02:02:24.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.232+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/610600842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5588b68dbc40 msgr2=0x5588b69095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.232+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/610600842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5588b68dbc40 0x5588b69095e0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fcd74025880 tx=0x7fcd7404e000 comp rx=0 tx=0).stop 2024-09-12T02:02:24.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.233+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/610600842 shutdown_connections 2024-09-12T02:02:24.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.233+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/610600842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5588b6a43130 0x5588b6a435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.233+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/610600842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5588b68dbc40 0x5588b69095e0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.233+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/610600842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd780030f0 0x5588b69205b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.233+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/610600842 >> 172.21.15.19:0/610600842 conn(0x5588b68d99e0 msgr2=0x5588b68d8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:24.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.233+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/610600842 shutdown_connections 2024-09-12T02:02:24.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.233+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/610600842 wait complete. 2024-09-12T02:02:24.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.233+0000 7fcd8bb41f40 1 Processor -- start 2024-09-12T02:02:24.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.233+0000 7fcd8bb41f40 1 -- start start 2024-09-12T02:02:24.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.234+0000 7fcd8bb41f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5588b68dbc40 0x5588b698e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.234+0000 7fcd8bb41f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588b6a43130 0x5588b6a3fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.234+0000 7fcd8bb41f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd780030f0 0x5588b69b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.234+0000 7fcd8bb41f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5588b6999880 con 0x5588b68dbc40 2024-09-12T02:02:24.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.234+0000 7fcd8bb41f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5588b6999e40 con 0x5588b6a43130 2024-09-12T02:02:24.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.234+0000 7fcd8bb41f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5588b6999b60 con 0x7fcd780030f0 2024-09-12T02:02:24.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.234+0000 7fcd89637640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5588b68dbc40 0x5588b698e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.234+0000 7fcd89637640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5588b68dbc40 0x5588b698e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50734/0 (socket says 172.21.15.19:50734) 2024-09-12T02:02:24.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.234+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 learned_addr learned my addr 172.21.15.19:0/373537529 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:24.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.234+0000 7fcd89e38640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd780030f0 0x5588b69b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.234+0000 7fcd88e36640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588b6a43130 0x5588b6a3fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.234+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd780030f0 msgr2=0x5588b69b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.234+0000 7fcd89637640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd780030f0 0x5588b69b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.234+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588b6a43130 msgr2=0x5588b6a3fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.234+0000 7fcd89637640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588b6a43130 0x5588b6a3fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.234+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588b69040e0 con 0x5588b68dbc40 2024-09-12T02:02:24.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.234+0000 7fcd89637640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5588b68dbc40 0x5588b698e220 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c006e30 tx=0x7fcd7c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.235+0000 7fcd827fc640 1 -- 172.21.15.19:0/373537529 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c012570 con 0x5588b68dbc40 2024-09-12T02:02:24.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.235+0000 7fcd827fc640 1 -- 172.21.15.19:0/373537529 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd7c018070 con 0x5588b68dbc40 2024-09-12T02:02:24.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.235+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588b69b1e50 con 0x5588b68dbc40 2024-09-12T02:02:24.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.235+0000 7fcd827fc640 1 -- 172.21.15.19:0/373537529 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c012910 con 0x5588b68dbc40 2024-09-12T02:02:24.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.235+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588b69afa80 con 0x5588b68dbc40 2024-09-12T02:02:24.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.236+0000 7fcd827fc640 1 -- 172.21.15.19:0/373537529 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd7c012070 con 0x5588b68dbc40 2024-09-12T02:02:24.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.236+0000 7fcd827fc640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd6c06a810 0x7fcd6c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.237+0000 7fcd827fc640 1 -- 172.21.15.19:0/373537529 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7fcd7c0899f0 con 0x5588b68dbc40 2024-09-12T02:02:24.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.237+0000 7fcd88e36640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd6c06a810 0x7fcd6c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.241 INFO:teuthology.orchestra.run.smithi019.stdout:���� 2024-09-12T02:02:24.241 INFO:teuthology.orchestra.run.smithi019.stdout: �� 2024-09-12T02:02:24.241 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:24.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.237+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5588b69aea50 0x5588b69b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.237+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:1 13.0 13:00000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x5588b69aea50 2024-09-12T02:02:24.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.237+0000 7fcd89e38640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5588b69aea50 0x5588b69b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.237+0000 7fcd88e36640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd6c06a810 0x7fcd6c06ccd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcd74003040 tx=0x7fcd74065040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.237+0000 7fcd89e38640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5588b69aea50 0x5588b69b0560 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.239+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(1 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.239+0000 7fcd89e38640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7fcd78003ab0 0x7fcd84007900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.239+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:08000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x7fcd78003ab0 2024-09-12T02:02:24.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.240+0000 7fcd89637640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7fcd78003ab0 0x7fcd84007900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.240+0000 7fcd89637640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7fcd78003ab0 0x7fcd84007900 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.242+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(2 [pgnls start_epoch 94 out=177b] v93'10 uv10 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x7fcd7c054270 con 0x7fcd78003ab0 2024-09-12T02:02:24.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.242+0000 7fcd89637640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7fcd7c0602a0 0x7fcd7c056ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.242+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] -- osd_op(unknown.0.0:3 13.8 13:10000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x7fcd7c0602a0 2024-09-12T02:02:24.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.242+0000 7fcd88e36640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7fcd7c0602a0 0x7fcd7c056ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.242+0000 7fcd88e36640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7fcd7c0602a0 0x7fcd7c056ac0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.244+0000 7fcd88e36640 1 -- 172.21.15.19:0/373537529 <== osd.2 v2:172.21.15.19:6816/1297238899 1 ==== osd_op_reply(3 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd74054ab0 con 0x7fcd7c0602a0 2024-09-12T02:02:24.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.244+0000 7fcd88e36640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:4 13.18 13:18000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x5588b69aea50 2024-09-12T02:02:24.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.244+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(4 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.245+0000 7fcd89e38640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5588b68dc350 0x7fcd84019920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.245+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:5 13.4 13:20000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x5588b68dc350 2024-09-12T02:02:24.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.245+0000 7fcd89e38640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5588b68dc350 0x7fcd84019920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.245+0000 7fcd89e38640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5588b68dc350 0x7fcd84019920 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.245+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(5 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.245+0000 7fcd89e38640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5588b690a050 0x7fcd84006380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.245+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:6 13.14 13:28000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x5588b690a050 2024-09-12T02:02:24.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.246+0000 7fcd89637640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5588b690a050 0x7fcd84006380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.246+0000 7fcd89637640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5588b690a050 0x7fcd84006380 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.246+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(6 [pgnls start_epoch 94 out=149b] v93'20 uv20 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x7fcd7c054270 con 0x5588b690a050 2024-09-12T02:02:24.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.246+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.c 13:30000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x7fcd78003ab0 2024-09-12T02:02:24.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.246+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(7 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd7c054270 con 0x7fcd78003ab0 2024-09-12T02:02:24.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.246+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:8 13.1c 13:38000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x5588b68dc350 2024-09-12T02:02:24.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.247+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(8 [pgnls start_epoch 94 out=73b] v92'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.247+0000 7fcd89e38640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7fcd8402a060 0x7fcd840293b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.247+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:9 13.2 13:40000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x7fcd8402a060 2024-09-12T02:02:24.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.247+0000 7fcd88e36640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7fcd8402a060 0x7fcd840293b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.247+0000 7fcd88e36640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7fcd8402a060 0x7fcd840293b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.249+0000 7fcd88e36640 1 -- 172.21.15.19:0/373537529 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(9 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd74054ab0 con 0x7fcd8402a060 2024-09-12T02:02:24.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.249+0000 7fcd88e36640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:10 13.12 13:48000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x5588b690a050 2024-09-12T02:02:24.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.250+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(10 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd7c054270 con 0x5588b690a050 2024-09-12T02:02:24.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.250+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] -- osd_op(unknown.0.0:11 13.a 13:50000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x7fcd7c0602a0 2024-09-12T02:02:24.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.250+0000 7fcd88e36640 1 -- 172.21.15.19:0/373537529 <== osd.2 v2:172.21.15.19:6816/1297238899 2 ==== osd_op_reply(11 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd74054ab0 con 0x7fcd7c0602a0 2024-09-12T02:02:24.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.250+0000 7fcd88e36640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.1a 13:58000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x7fcd78003ab0 2024-09-12T02:02:24.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.250+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(12 [pgnls start_epoch 94 out=49b] v92'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.250+0000 7fcd89637640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7fcd7c05e100 0x7fcd7c0891d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.250+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:13 13.6 13:60000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x7fcd7c05e100 2024-09-12T02:02:24.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.250+0000 7fcd89e38640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7fcd7c05e100 0x7fcd7c0891d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.251+0000 7fcd89e38640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7fcd7c05e100 0x7fcd7c0891d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.251+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(13 [pgnls start_epoch 94 out=77b] v93'2 uv2 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.251+0000 7fcd89e38640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x5588b6994080 0x7fcd8402c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.251+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] -- osd_op(unknown.0.0:14 13.16 13:68000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x5588b6994080 2024-09-12T02:02:24.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.251+0000 7fcd89637640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x5588b6994080 0x7fcd8402c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.252+0000 7fcd89637640 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x5588b6994080 0x7fcd8402c960 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.253+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.3 v2:172.21.15.19:6800/2581301650 1 ==== osd_op_reply(14 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b6994080 2024-09-12T02:02:24.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.253+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:15 13.e 13:70000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x5588b69aea50 2024-09-12T02:02:24.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.254+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(15 [pgnls start_epoch 94 out=73b] v92'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.254+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:16 13.1e 13:78000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x7fcd7c05e100 2024-09-12T02:02:24.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.254+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(16 [pgnls start_epoch 94 out=49b] v92'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.254+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:17 13.1 13:80000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x5588b68dc350 2024-09-12T02:02:24.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.254+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(17 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.254+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.11 13:88000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x7fcd78003ab0 2024-09-12T02:02:24.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.255+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(18 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.255+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:19 13.9 13:90000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x7fcd8402a060 2024-09-12T02:02:24.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.255+0000 7fcd88e36640 1 -- 172.21.15.19:0/373537529 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(19 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd74054ab0 con 0x7fcd8402a060 2024-09-12T02:02:24.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.255+0000 7fcd88e36640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] -- osd_op(unknown.0.0:20 13.19 13:98000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x5588b6994080 2024-09-12T02:02:24.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.255+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.3 v2:172.21.15.19:6800/2581301650 2 ==== osd_op_reply(20 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b6994080 2024-09-12T02:02:24.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.255+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:21 13.5 13:a0000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x7fcd7c05e100 2024-09-12T02:02:24.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.255+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(21 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.255+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:22 13.15 13:a8000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x7fcd7c05e100 2024-09-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.256+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(22 [pgnls start_epoch 94 out=97b] v92'3 uv3 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.256+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:23 13.d 13:b0000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x7fcd7c05e100 2024-09-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.256+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(23 [pgnls start_epoch 94 out=74b] v92'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.256+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:24 13.1d 13:b8000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x5588b69aea50 2024-09-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.256+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(24 [pgnls start_epoch 94 out=73b] v92'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.256+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:25 13.3 13:c0000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x5588b690a050 2024-09-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.256+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(25 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b690a050 2024-09-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.257+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:26 13.13 13:c8000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x5588b69aea50 2024-09-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.257+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(26 [pgnls start_epoch 94 out=98b] v93'3 uv3 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.257+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:27 13.b 13:d0000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x7fcd8402a060 2024-09-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.257+0000 7fcd88e36640 1 -- 172.21.15.19:0/373537529 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(27 [pgnls start_epoch 94 out=76b] v93'3 uv3 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x7fcd74054ab0 con 0x7fcd8402a060 2024-09-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.257+0000 7fcd88e36640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:28 13.1b 13:d8000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x7fcd7c05e100 2024-09-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.257+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(28 [pgnls start_epoch 94 out=49b] v92'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.257+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:29 13.7 13:e0000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x5588b69aea50 2024-09-12T02:02:24.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.258+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(29 [pgnls start_epoch 94 out=73b] v92'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.258+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:30 13.17 13:e8000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x7fcd8402a060 2024-09-12T02:02:24.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.258+0000 7fcd88e36640 1 -- 172.21.15.19:0/373537529 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(30 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd74054ab0 con 0x7fcd8402a060 2024-09-12T02:02:24.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.258+0000 7fcd88e36640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:31 13.f 13:f0000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x5588b68dc350 2024-09-12T02:02:24.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.259+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(31 [pgnls start_epoch 94 out=73b] v92'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.259+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:32 13.1f 13:f8000000:%01:::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0aa0 con 0x5588b68dc350 2024-09-12T02:02:24.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.259+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(32 [pgnls start_epoch 94 out=101b] v93'6 uv6 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.259+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:33 13.10 13:09401a81:::601.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6991d00 con 0x7fcd78003ab0 2024-09-12T02:02:24.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.259+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(33 601.00000000 [read 0~0] v0'0 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.259+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:34 13.10 13:09401a81:::601.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b69aca10 con 0x7fcd78003ab0 2024-09-12T02:02:24.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.259+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(34 601.00000000 [getxattrs out=124b] v0'0 uv6 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.259+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:35 13.10 13:09401a81:::601.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b69acdb0 con 0x7fcd78003ab0 2024-09-12T02:02:24.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.260+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(35 601.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.260+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:36 13.10 13:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b69ad150 con 0x7fcd78003ab0 2024-09-12T02:02:24.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.260+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(36 601.00000000 [omap-get-vals out=5b] v0'0 uv6 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.260+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:37 13.10 13:0bd6d154:::602.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b69b0ea0 con 0x7fcd78003ab0 2024-09-12T02:02:24.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.260+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(37 602.00000000 [read 0~0] v0'0 uv7 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.260+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:38 13.10 13:0bd6d154:::602.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a54b50 con 0x7fcd78003ab0 2024-09-12T02:02:24.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.260+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(38 602.00000000 [getxattrs out=124b] v0'0 uv7 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.261+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:39 13.10 13:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a54ef0 con 0x7fcd78003ab0 2024-09-12T02:02:24.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.261+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(39 602.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.261+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:40 13.10 13:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a562a0 con 0x7fcd78003ab0 2024-09-12T02:02:24.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.261+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(40 602.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.261+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:41 13.10 13:0cf6ad0f:::10000000000.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x7fcd78003ab0 2024-09-12T02:02:24.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.261+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(41 10000000000.00000000 [read 0~0] v0'0 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.261+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:42 13.10 13:0cf6ad0f:::10000000000.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x7fcd78003ab0 2024-09-12T02:02:24.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.262+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(42 10000000000.00000000 [getxattrs out=124b] v0'0 uv10 ondisk = 0) ==== 164+0+124 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.262+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:43 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x7fcd78003ab0 2024-09-12T02:02:24.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.262+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(43 10000000000.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.262+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:44 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a562a0 con 0x7fcd78003ab0 2024-09-12T02:02:24.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.262+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(44 10000000000.00000000 [omap-get-vals out=586b] v0'0 uv10 ondisk = 0) ==== 164+0+586 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.267 INFO:teuthology.orchestra.run.smithi019.stdout: ��*$- 601.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray1 ���� �� ((88���� �� ��*$- 602.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray2 ���� �� ((88���� �� ��2,510000000000.00000000�������������������!�������������������������� ���~_layout��������_parent>8subdir ���� ��  (�K�f�&(�K�f�&8`�K�f���'8`�K�f���'���� ��OI sixmegs_head1i"��K�f���'���5@@`���������K�f���'�K�f�&(8`�K�f���'8`�K�f���' 2024-09-12T02:02:24.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.262+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:45 13.10 13:0d82a743:::600.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x7fcd78003ab0 2024-09-12T02:02:24.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.262+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(45 600.00000000 [read 0~0] v0'0 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.262+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:46 13.10 13:0d82a743:::600.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x7fcd78003ab0 2024-09-12T02:02:24.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.262+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(46 600.00000000 [getxattrs out=124b] v0'0 uv5 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.263+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:47 13.10 13:0d82a743:::600.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x7fcd78003ab0 2024-09-12T02:02:24.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.263+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(47 600.00000000 [omap-get-header out=274b] v0'0 uv5 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.263+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:48 13.10 13:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a562a0 con 0x7fcd78003ab0 2024-09-12T02:02:24.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.263+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(48 600.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.263+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:49 13.10 13:0d89b25e:::603.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x7fcd78003ab0 2024-09-12T02:02:24.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.263+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(49 603.00000000 [read 0~0] v0'0 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.263+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:50 13.10 13:0d89b25e:::603.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x7fcd78003ab0 2024-09-12T02:02:24.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.263+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(50 603.00000000 [getxattrs out=124b] v0'0 uv8 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.263+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:51 13.10 13:0d89b25e:::603.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x7fcd78003ab0 2024-09-12T02:02:24.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.264+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(51 603.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.264+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:52 13.10 13:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a562a0 con 0x7fcd78003ab0 2024-09-12T02:02:24.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.264+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(52 603.00000000 [omap-get-vals out=5b] v0'0 uv8 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7fcd7c075040 con 0x7fcd78003ab0 2024-09-12T02:02:24.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.264+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:53 13.14 13:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x5588b690a050 2024-09-12T02:02:24.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.264+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(53 1.00000000.inode [read 0~582 out=582b] v0'0 uv16 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b690a050 2024-09-12T02:02:24.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.264+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:54 13.14 13:287034c4:::1.00000000.inode:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x5588b690a050 2024-09-12T02:02:24.273 INFO:teuthology.orchestra.run.smithi019.stdout:���������K�f�&����security.selinux%unconfined_u:object_r:unlabeled_t:s0������������ �� ��*$- 600.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray0 ���� �� ((88���� �� ��*$- 603.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray3 ���� �� ((88���� �� ��.(11.00000000.inode�������������������!�������������������������� ��`ZFFceph fs volume v011)��K�f+K��C@@���������K�f+K�(�K�f+K�8�K�f+K�8�K�flL��K�flL�����NH�K�flL������������� �� 2024-09-12T02:02:24.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.264+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(54 1.00000000.inode [getxattrs out=4b] v0'0 uv16 ondisk = 0) ==== 160+0+4 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b690a050 2024-09-12T02:02:24.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.264+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:55 13.14 13:287034c4:::1.00000000.inode:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x5588b690a050 2024-09-12T02:02:24.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.265+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(55 1.00000000.inode [omap-get-header] v0'0 uv16 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b690a050 2024-09-12T02:02:24.274 INFO:teuthology.orchestra.run.smithi019.stdout:���� �� 2024-09-12T02:02:24.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.265+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:56 13.14 13:287034c4:::1.00000000.inode:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a562a0 con 0x5588b690a050 2024-09-12T02:02:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.265+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(56 1.00000000.inode [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) ==== 160+0+5 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b690a050 2024-09-12T02:02:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.265+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:57 13.14 13:292cf221:::200.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x5588b690a050 2024-09-12T02:02:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.265+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(57 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b690a050 2024-09-12T02:02:24.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.265+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:58 13.14 13:292cf221:::200.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x5588b690a050 2024-09-12T02:02:24.276 INFO:teuthology.orchestra.run.smithi019.stdout:���� �� ��*$- 200.00000000�������������������!�������������������������� ��tnZZTceph fs volume v011@d<@d<@RD@@@ ���� �� 2024-09-12T02:02:24.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.265+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(58 200.00000000 [getxattrs out=4b] v0'0 uv20 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b690a050 2024-09-12T02:02:24.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.265+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:59 13.14 13:292cf221:::200.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x5588b690a050 2024-09-12T02:02:24.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.266+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(59 200.00000000 [omap-get-header] v0'0 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b690a050 2024-09-12T02:02:24.277 INFO:teuthology.orchestra.run.smithi019.stdout:���� �� 2024-09-12T02:02:24.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.266+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:60 13.14 13:292cf221:::200.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a562a0 con 0x5588b690a050 2024-09-12T02:02:24.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.266+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(60 200.00000000 [omap-get-vals out=5b] v0'0 uv20 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b690a050 2024-09-12T02:02:24.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.266+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:61 13.14 13:2e2fa760:::200.00000001:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x5588b690a050 2024-09-12T02:02:24.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.266+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(61 200.00000001 [read 0~17490 out=17490b] v0'0 uv17 ondisk = 0) ==== 156+0+17490 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b690a050 2024-09-12T02:02:24.279 INFO:teuthology.orchestra.run.smithi019.stdout:���� �� ��*$- 200.00000001�������������������!�������������������������� ��lDfDRDRD��XS&YA1e@��XS&YA1h^T�K�fJ�2 ((88 2 ( 2024-09-12T02:02:24.279 INFO:teuthology.orchestra.run.smithi019.stdout:( 2024-09-12T02:02:24.279 INFO:teuthology.orchestra.run.smithi019.stdout:8 2024-09-12T02:02:24.279 INFO:teuthology.orchestra.run.smithi019.stdout:�K�f��8 2024-09-12T02:02:24.279 INFO:teuthology.orchestra.run.smithi019.stdout:�K�f�� ��������@0@��XS&YA1�� 2024-09-12T02:02:24.279 INFO:teuthology.orchestra.run.smithi019.stdout:��K�f�%�~S���� entity_id0hostname smithi019kernel_version5.14.0-505.el9.x86_64root/�� ����@��XS&YA1����K�f���n���������@��XS&YA1�K�f<3�setattr� C����������K�f����C@@���������K�flL�(8�K�f���8�K�flL��K�flL�����NH�K�flL������������������X@��XS&YA1���K�f��mkdir�p (�K�f+K�(�K�f+K�8�K�f+K�8�K�f+K�J 8subdir����������K�f+K��A�5�����������������K�f+K��K�f+K�(88���������K�f+K�����security.selinux%unconfined_u:object_r:unlabeled_t:s0��������2 ((88  C����������K�f+K��C@@���������K�f+K�(�K�f+K�8�K�f+K�8�K�flL��K�flL�����NH�K�flL���������������������@��XS&YA1��K�f�0�&openc�p (�K�f+K�(�K�f+K�8�K�f�&8�K�f+K�J 8subdir����������K�f�&�A�5�����������������K�f�&�K�f+K�(�K�f�&8�K�f�&8�K�f�&���������K�f+K�����security.selinux%unconfined_u:object_r:unlabeled_t:s0��������� (�K�f�&(�K�f�&8�K�f�&8�K�f�&m [sixmegs����������K�f�&���5@@���������K�f�&�K�f�&�@(88���������K�f�&����security.selinux%unconfined_u:object_r:unlabeled_t:s0����������!!���������@��XS&YA1 2024-09-12T02:02:24.279 INFO:teuthology.orchestra.run.smithi019.stdout:�K�f��I' 2024-09-12T02:02:24.279 INFO:teuthology.orchestra.run.smithi019.stdout:cap update�p (�K�f+K�(�K�f+K�8 �K�f�e7'8�K�f+K�J 8subdir����������K�f�&�A�5�����������������K�f�&�K�f+K�(�K�f�&8 �K�f�e7'8 �K�f�e7'���������K�f+K�����security.selinux%unconfined_u:object_r:unlabeled_t:s0��������� (�K�f�&(�K�f�&8 �K�f�e7'8 �K�f�e7'm [sixmegs����������K�f�e7'���5@@ ���������K�f�e7'�K�f�&��(8 �K�f�e7'8 �K�f�e7'���������K�f�&����security.selinux%unconfined_u:object_r:unlabeled_t:s0������������������@��XS&YA1 2024-09-12T02:02:24.279 INFO:teuthology.orchestra.run.smithi019.stdout:�K�f���' 2024-09-12T02:02:24.279 INFO:teuthology.orchestra.run.smithi019.stdout:cap update�p  (�K�f+K�(�K�f+K�8P�K�f�w�'8�K�f+K�J 8subdir����������K�f�&�A�5�����������������K�f�&�K�f+K�(�K�f�&8P�K�f�w�'8P�K�f�w�'���������K�f+K�����security.selinux%unconfined_u:object_r:unlabeled_t:s0��������� (�K�f�&(�K�f�&8P�K�f�w�'8P�K�f�w�'m [sixmegs����������K�f�w�'���5@@P���������K�f�w�'�K�f�&��(8P�K�f�w�'8P�K�f�w�'���������K�f�&����security.selinux%unconfined_u:object_r:unlabeled_t:s0������������������ @��XS&YA1 2024-09-12T02:02:24.280 INFO:teuthology.orchestra.run.smithi019.stdout:�K�f�i� 2024-09-12T02:02:24.280 INFO:teuthology.orchestra.run.smithi019.stdout:cap update�p  (�K�f+K�(�K�f+K�8`�K�f���'8�K�f+K�J 8subdir�������� 2024-09-12T02:02:24.280 INFO:teuthology.orchestra.run.smithi019.stdout:��K�f�&�A�5�����������������K�f�&�K�f+K�(�K�f�&8`�K�f���'8`�K�f���' 2024-09-12T02:02:24.280 INFO:teuthology.orchestra.run.smithi019.stdout:���������K�f+K�����security.selinux%unconfined_u:object_r:unlabeled_t:s0���������  (�K�f�&(�K�f�&8`�K�f���'8`�K�f���'m [sixmegs����������K�f���'���5@@`���������K�f���'�K�f�&�(8`�K�f���'8`�K�f���'���������K�f�&����security.selinux%unconfined_u:object_r:unlabeled_t:s0�����������������)@��XS&YA1�� 2024-09-12T02:02:24.280 INFO:teuthology.orchestra.run.smithi019.stdout:��K�f���~S������=1@��XS&YA1 2024-09-12T02:02:24.280 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:24.280 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:24.280 INFO:teuthology.orchestra.run.smithi019.stdout:�K�f�]�check_inode_max_size� p  (�K�f+K�(�K�f+K�8`�K�f���'8�K�f+K�J 8subdir�������� ��K�f�&�A�5�����������������K�f�&�K�f+K�(�K�f�&8`�K�f���'8`�K�f���' ���������K�f+K�����security.selinux%unconfined_u:object_r:unlabeled_t:s0���������  (�K�f�&(�K�f�&8`�K�f���'8`�K�f���'� 5sixmegs�������� 2024-09-12T02:02:24.280 INFO:teuthology.orchestra.run.smithi019.stdout:��K�f���'���5@@`���������K�f���'�K�f�&(8`�K�f���'8`�K�f���' 2024-09-12T02:02:24.280 INFO:teuthology.orchestra.run.smithi019.stdout:���������K�f�&����security.selinux%unconfined_u:object_r:unlabeled_t:s0�������� 5sixmegs�������� 2024-09-12T02:02:24.280 INFO:teuthology.orchestra.run.smithi019.stdout:��K�f���'���5@@`���������K�f���'�K�f�&(8`�K�f���'8`�K�f���' 2024-09-12T02:02:24.281 INFO:teuthology.orchestra.run.smithi019.stdout:���������K�f�&����security.selinux%unconfined_u:object_r:unlabeled_t:s0�����������������1@��XS&YA18.$�<@��XS&YA1h^T�K�f��02  (�K�f+K�(�K�f+K�8`�K�f���'8�K�f+K� 2 ( 2024-09-12T02:02:24.281 INFO:teuthology.orchestra.run.smithi019.stdout:( 2024-09-12T02:02:24.281 INFO:teuthology.orchestra.run.smithi019.stdout:8 2024-09-12T02:02:24.281 INFO:teuthology.orchestra.run.smithi019.stdout:�K�f��8 2024-09-12T02:02:24.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.266+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:62 13.14 13:2e2fa760:::200.00000001:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x5588b690a050 2024-09-12T02:02:24.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.267+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(62 200.00000001 [getxattrs out=4b] v0'0 uv17 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b690a050 2024-09-12T02:02:24.282 INFO:teuthology.orchestra.run.smithi019.stdout:�K�f�� ��������@d<@��XS&YA1^TJ�K�f�֬0scatter_writebehind2 (�K�f+K�(�K�f+K�8`�K�f���'8`�K�f���'  C����������K�f+K��C@@���������K�f+K�(�K�f+K�8`�K�f���'8�K�flL��K�flL�����NH�K�flL������������������?@���� �� 2024-09-12T02:02:24.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.267+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:63 13.14 13:2e2fa760:::200.00000001:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x5588b690a050 2024-09-12T02:02:24.282 INFO:teuthology.orchestra.run.smithi019.stdout:���� �� 2024-09-12T02:02:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.267+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(63 200.00000001 [omap-get-header] v0'0 uv17 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b690a050 2024-09-12T02:02:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.267+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:64 13.14 13:2e2fa760:::200.00000001:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a562a0 con 0x5588b690a050 2024-09-12T02:02:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.267+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(64 200.00000001 [omap-get-vals out=5b] v0'0 uv17 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b690a050 2024-09-12T02:02:24.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.267+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:65 13.14 13:2f55791f:::606.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x5588b690a050 2024-09-12T02:02:24.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.267+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(65 606.00000000 [read 0~0] v0'0 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b690a050 2024-09-12T02:02:24.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.267+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:66 13.14 13:2f55791f:::606.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x5588b690a050 2024-09-12T02:02:24.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.268+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(66 606.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b690a050 2024-09-12T02:02:24.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.268+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:67 13.14 13:2f55791f:::606.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x5588b690a050 2024-09-12T02:02:24.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.268+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(67 606.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b690a050 2024-09-12T02:02:24.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.268+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:68 13.14 13:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a562a0 con 0x5588b690a050 2024-09-12T02:02:24.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.268+0000 7fcd89637640 1 -- 172.21.15.19:0/373537529 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(68 606.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7fcd7c075040 con 0x5588b690a050 2024-09-12T02:02:24.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.268+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:69 13.1c 13:3ed09add:::607.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55290 con 0x5588b68dc350 2024-09-12T02:02:24.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.269+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(69 607.00000000 [read 0~0] v0'0 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.269+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:70 13.1c 13:3ed09add:::607.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55630 con 0x5588b68dc350 2024-09-12T02:02:24.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.269+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(70 607.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.269+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:71 13.1c 13:3ed09add:::607.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a559d0 con 0x5588b68dc350 2024-09-12T02:02:24.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.270+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(71 607.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.270+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:72 13.1c 13:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56d80 con 0x5588b68dc350 2024-09-12T02:02:24.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.270+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(72 607.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.270+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.6 13:654134d2:::mds0_openfiles.0:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a55d70 con 0x7fcd7c05e100 2024-09-12T02:02:24.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.270+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(73 mds0_openfiles.0 [read 0~0] v0'0 uv2 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.270+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.6 13:654134d2:::mds0_openfiles.0:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56160 con 0x7fcd7c05e100 2024-09-12T02:02:24.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.270+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(74 mds0_openfiles.0 [getxattrs out=4b] v0'0 uv2 ondisk = 0) ==== 160+0+4 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.289 INFO:teuthology.orchestra.run.smithi019.stdout:���� �� ��*$- 606.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray6 ���� �� ((88���� �� ��*$- 607.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray7 ���� �� ((88���� �� ��.(1mds0_openfiles.0�������������������!�������������������������� �� 2024-09-12T02:02:24.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.270+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.6 13:654134d2:::mds0_openfiles.0:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56550 con 0x7fcd7c05e100 2024-09-12T02:02:24.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.271+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(75 mds0_openfiles.0 [omap-get-header out=42b] v0'0 uv2 ondisk = 0) ==== 160+0+42 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.271+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.6 13:654134d2:::mds0_openfiles.0:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56550 con 0x7fcd7c05e100 2024-09-12T02:02:24.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.271+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(76 mds0_openfiles.0 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) ==== 160+0+5 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.271+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:77 13.e 13:717a0223:::608.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x5588b69aea50 2024-09-12T02:02:24.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.271+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(77 608.00000000 [read 0~0] v0'0 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.271+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:78 13.e 13:717a0223:::608.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x5588b69aea50 2024-09-12T02:02:24.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.272+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(78 608.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.272+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:79 13.e 13:717a0223:::608.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x5588b69aea50 2024-09-12T02:02:24.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.272+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(79 608.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.272+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:80 13.e 13:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x5588b69aea50 2024-09-12T02:02:24.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.272+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(80 608.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.272+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.15 13:a93a17c2:::604.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x7fcd7c05e100 2024-09-12T02:02:24.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.272+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(81 604.00000000 [read 0~0] v0'0 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.272+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.15 13:a93a17c2:::604.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x7fcd7c05e100 2024-09-12T02:02:24.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.273+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(82 604.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.273+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.15 13:a93a17c2:::604.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x7fcd7c05e100 2024-09-12T02:02:24.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.273+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(83 604.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.273+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.15 13:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x7fcd7c05e100 2024-09-12T02:02:24.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.273+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(84 604.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.273+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:85 13.15 13:aa448500:::500.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x7fcd7c05e100 2024-09-12T02:02:24.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.274+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(85 500.00000000 [read 0~90 out=90b] v0'0 uv3 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.274+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:86 13.15 13:aa448500:::500.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x7fcd7c05e100 2024-09-12T02:02:24.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.274+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(86 500.00000000 [getxattrs out=4b] v0'0 uv3 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.296 INFO:teuthology.orchestra.run.smithi019.stdout:���� ��4.*ceph fs volume v011 ���� �� ��*$- 608.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray8 ���� �� ((88���� �� ��*$- 604.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray4 ���� �� ((88���� �� ��*$- 500.00000000�������������������!�������������������������� ��tnZZTceph fs volume v011@@@@@@ ���� �� 2024-09-12T02:02:24.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.274+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:87 13.15 13:aa448500:::500.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x7fcd7c05e100 2024-09-12T02:02:24.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.274+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(87 500.00000000 [omap-get-header] v0'0 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.297 INFO:teuthology.orchestra.run.smithi019.stdout:���� �� 2024-09-12T02:02:24.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.274+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:88 13.15 13:aa448500:::500.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x7fcd7c05e100 2024-09-12T02:02:24.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.274+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(88 500.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.274+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:89 13.d 13:b50e409b:::mds_snaptable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x7fcd7c05e100 2024-09-12T02:02:24.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.275+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(89 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.275+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:90 13.d 13:b50e409b:::mds_snaptable:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x7fcd7c05e100 2024-09-12T02:02:24.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.275+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(90 mds_snaptable [getxattrs out=4b] v0'0 uv1 ondisk = 0) ==== 157+0+4 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.299 INFO:teuthology.orchestra.run.smithi019.stdout:���� �� ��+%. mds_snaptable�������������������!�������������������������� ��`ZFF4���� �� 2024-09-12T02:02:24.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.275+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:91 13.d 13:b50e409b:::mds_snaptable:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x7fcd7c05e100 2024-09-12T02:02:24.299 INFO:teuthology.orchestra.run.smithi019.stdout:���� �� 2024-09-12T02:02:24.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.275+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 21 ==== osd_op_reply(91 mds_snaptable [omap-get-header] v0'0 uv1 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.275+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:92 13.d 13:b50e409b:::mds_snaptable:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x7fcd7c05e100 2024-09-12T02:02:24.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.276+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.4 v2:172.21.15.135:6800/1904467046 22 ==== osd_op_reply(92 mds_snaptable [omap-get-vals out=5b] v0'0 uv1 ondisk = 0) ==== 157+0+5 (crc 0 0 0) 0x7fcd840095f0 con 0x7fcd7c05e100 2024-09-12T02:02:24.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.276+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.1d 13:b871830b:::605.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x5588b69aea50 2024-09-12T02:02:24.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.276+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(93 605.00000000 [read 0~0] v0'0 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.276+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.1d 13:b871830b:::605.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x5588b69aea50 2024-09-12T02:02:24.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.276+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(94 605.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.276+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.1d 13:b871830b:::605.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x5588b69aea50 2024-09-12T02:02:24.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.276+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(95 605.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.276+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.1d 13:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x5588b69aea50 2024-09-12T02:02:24.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.277+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(96 605.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.277+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x5588b69aea50 2024-09-12T02:02:24.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.277+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(97 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.277+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:c91d4a1d:::mds0_inotable:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x5588b69aea50 2024-09-12T02:02:24.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.277+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(98 mds0_inotable [getxattrs out=4b] v0'0 uv3 ondisk = 0) ==== 157+0+4 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.304 INFO:teuthology.orchestra.run.smithi019.stdout:���� �� ��*$- 605.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray5 ���� �� ((88���� �� ��+%. mds0_inotable�������������������!�������������������������� ��<6""��������� �� 2024-09-12T02:02:24.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.277+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:c91d4a1d:::mds0_inotable:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x5588b69aea50 2024-09-12T02:02:24.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.277+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(99 mds0_inotable [omap-get-header] v0'0 uv3 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.304 INFO:teuthology.orchestra.run.smithi019.stdout:���� �� 2024-09-12T02:02:24.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.277+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:c91d4a1d:::mds0_inotable:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x5588b69aea50 2024-09-12T02:02:24.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.277+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(100 mds0_inotable [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 157+0+5 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.278+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:101 13.13 13:cd5a64a3:::100.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x5588b69aea50 2024-09-12T02:02:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.278+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(101 100.00000000 [read 0~0] v0'0 uv1 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.278+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:102 13.13 13:cd5a64a3:::100.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x5588b69aea50 2024-09-12T02:02:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.278+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(102 100.00000000 [getxattrs out=4b] v0'0 uv1 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.306 INFO:teuthology.orchestra.run.smithi019.stdout:���� �� ��*$- 100.00000000�������������������!�������������������������� �� 2024-09-12T02:02:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.278+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:103 13.13 13:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x5588b69aea50 2024-09-12T02:02:24.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.278+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(103 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.307 INFO:teuthology.orchestra.run.smithi019.stdout:���� �� ( 2024-09-12T02:02:24.307 INFO:teuthology.orchestra.run.smithi019.stdout:( 2024-09-12T02:02:24.307 INFO:teuthology.orchestra.run.smithi019.stdout:8 2024-09-12T02:02:24.307 INFO:teuthology.orchestra.run.smithi019.stdout:�K�f��8 2024-09-12T02:02:24.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.278+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:104 13.13 13:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x5588b69aea50 2024-09-12T02:02:24.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.279+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(104 100.00000000 [omap-get-vals out=5195b] v0'0 uv1 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.308 INFO:teuthology.orchestra.run.smithi019.stdout:�K�f������ ��PJ 2024-09-12T02:02:24.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.279+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:105 13.b 13:d0630e4c:::mds0_sessionmap:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a56500 con 0x7fcd8402a060 2024-09-12T02:02:24.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.279+0000 7fcd88e36640 1 -- 172.21.15.19:0/373537529 <== osd.5 v2:172.21.15.135:6808/3846812594 5 ==== osd_op_reply(105 mds0_sessionmap [read 0~0] v0'0 uv3 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fcd74054ab0 con 0x7fcd8402a060 2024-09-12T02:02:24.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.279+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:106 13.b 13:d0630e4c:::mds0_sessionmap:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a568a0 con 0x7fcd8402a060 2024-09-12T02:02:24.309 INFO:teuthology.orchestra.run.smithi019.stdout: stray0_head�i����K�fW�@A�����������������K�fW�(8�K�fW�8�K�fW��K�fW������������� stray1_head�i����K�f 2�@A�����������������K�f 2�(8�K�f 2�8�K�f 2��K�f 2������������� stray2_head�i����K�fA��@A�����������������K�fA��(8�K�fA��8�K�fA���K�fA�������������� stray3_head�i����K�f ��@A�����������������K�f ��(8�K�f ��8�K�f ���K�f �������������� stray4_head�i����K�fq�@A�����������������K�fq�(8�K�fq�8�K�fq��K�fq������������� stray5_head�i����K�ft<�@A�����������������K�ft<�(8�K�ft<�8�K�ft<��K�ft<������������� stray6_head�i����K�f6��@A�����������������K�f6��(8�K�f6��8�K�f6���K�f6�������������� stray7_head�i����K�f$�@A�����������������K�f$�(8�K�f$�8�K�f$��K�f$������������� stray8_head�i����K�f^@A�����������������K�f^(8�K�f^8�K�f^�K�f^������������ stray9_head�i��� �K�f��@A�����������������K�f��(8�K�f��8�K�f���K�f������������������ �� ��-'0mds0_sessionmap�������������������!�������������������������� �� 2024-09-12T02:02:24.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.279+0000 7fcd88e36640 1 -- 172.21.15.19:0/373537529 <== osd.5 v2:172.21.15.135:6808/3846812594 6 ==== osd_op_reply(106 mds0_sessionmap [getxattrs out=4b] v0'0 uv3 ondisk = 0) ==== 159+0+4 (crc 0 0 0) 0x7fcd74054ab0 con 0x7fcd8402a060 2024-09-12T02:02:24.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.279+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:107 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a57120 con 0x7fcd8402a060 2024-09-12T02:02:24.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.280+0000 7fcd88e36640 1 -- 172.21.15.19:0/373537529 <== osd.5 v2:172.21.15.135:6808/3846812594 7 ==== osd_op_reply(107 mds0_sessionmap [omap-get-header out=14b] v0'0 uv3 ondisk = 0) ==== 159+0+14 (crc 0 0 0) 0x7fcd74054ab0 con 0x7fcd8402a060 2024-09-12T02:02:24.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.280+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:108 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a584d0 con 0x7fcd8402a060 2024-09-12T02:02:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.280+0000 7fcd88e36640 1 -- 172.21.15.19:0/373537529 <== osd.5 v2:172.21.15.135:6808/3846812594 8 ==== osd_op_reply(108 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 159+0+5 (crc 0 0 0) 0x7fcd74054ab0 con 0x7fcd8402a060 2024-09-12T02:02:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.280+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a574c0 con 0x5588b69aea50 2024-09-12T02:02:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.281+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(109 609.00000000 [read 0~0] v0'0 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.281+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a574c0 con 0x5588b69aea50 2024-09-12T02:02:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.281+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(110 609.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.281+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:111 13.7 13:e0b41d06:::609.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a574c0 con 0x5588b69aea50 2024-09-12T02:02:24.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.282+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(111 609.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.282+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:112 13.7 13:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a58870 con 0x5588b69aea50 2024-09-12T02:02:24.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.282+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(112 609.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b69aea50 2024-09-12T02:02:24.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.282+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a574c0 con 0x5588b68dc350 2024-09-12T02:02:24.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.283+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(113 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.283+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a574c0 con 0x5588b68dc350 2024-09-12T02:02:24.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.283+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(114 400.00000000 [getxattrs out=4b] v0'0 uv1 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.314 INFO:teuthology.orchestra.run.smithi019.stdout:���� ������ �� ��*$- 609.00000000�������������������!�������������������������� ���~_layout��������_parent>8 stray9 ���� �� ((88���� �� ��*$- 400.00000000�������������������!�������������������������� ��0*���� �� 2024-09-12T02:02:24.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.283+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a574c0 con 0x5588b68dc350 2024-09-12T02:02:24.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.283+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(115 400.00000000 [omap-get-header] v0'0 uv1 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.315 INFO:teuthology.orchestra.run.smithi019.stdout:���� �� 2024-09-12T02:02:24.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.283+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.f 13:f1f69726:::400.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a574c0 con 0x5588b68dc350 2024-09-12T02:02:24.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.284+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(116 400.00000000 [omap-get-vals out=5b] v0'0 uv1 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.284+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a574c0 con 0x5588b68dc350 2024-09-12T02:02:24.316 INFO:teuthology.orchestra.run.smithi019.stdout:���� �� ��0*3100.00000000.inode�������������������!�������������������������� ��`ZFFceph fs volume v011)��K�f��@A�����������������K�f��( 2024-09-12T02:02:24.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.284+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(117 100.00000000.inode [read 0~582 out=582b] v0'0 uv3 ondisk = 0) ==== 162+0+582 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.284+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a574c0 con 0x5588b68dc350 2024-09-12T02:02:24.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.284+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(118 100.00000000.inode [getxattrs out=4b] v0'0 uv3 ondisk = 0) ==== 162+0+4 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.317 INFO:teuthology.orchestra.run.smithi019.stdout:8 �K�f��8 �K�f���K�f������NH������������ �� 2024-09-12T02:02:24.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.284+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a574c0 con 0x5588b68dc350 2024-09-12T02:02:24.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.285+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(119 100.00000000.inode [omap-get-header] v0'0 uv3 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.317 INFO:teuthology.orchestra.run.smithi019.stdout:���� �� 2024-09-12T02:02:24.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.285+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a574c0 con 0x5588b68dc350 2024-09-12T02:02:24.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.285+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(120 100.00000000.inode [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 162+0+5 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.318 INFO:teuthology.orchestra.run.smithi019.stdout:���� �� ��("+ 2024-09-12T02:02:24.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.285+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a574c0 con 0x5588b68dc350 2024-09-12T02:02:24.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.285+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(121 1.00000000 [read 0~0] v0'0 uv6 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.285+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a574c0 con 0x5588b68dc350 2024-09-12T02:02:24.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.285+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(122 1.00000000 [getxattrs out=92b] v0'0 uv6 ondisk = 0) ==== 154+0+92 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.285+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a574c0 con 0x5588b68dc350 2024-09-12T02:02:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.285+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(123 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.285+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5588b6a574c0 con 0x5588b68dc350 2024-09-12T02:02:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(124 1.00000000 [omap-get-vals out=585b] v0'0 uv6 ondisk = 0) ==== 154+0+585 (crc 0 0 0) 0x7fcd840095f0 con 0x5588b68dc350 2024-09-12T02:02:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5588b690a050 msgr2=0x7fcd84006380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5588b690a050 0x7fcd84006380 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7fcd78003ab0 msgr2=0x7fcd84007900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7fcd78003ab0 0x7fcd84007900 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7fcd7c0602a0 msgr2=0x7fcd7c056ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7fcd7c0602a0 0x7fcd7c056ac0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x5588b6994080 msgr2=0x7fcd8402c960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x5588b6994080 0x7fcd8402c960 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7fcd7c05e100 msgr2=0x7fcd7c0891d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7fcd7c05e100 0x7fcd7c0891d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 reap_dead start 2024-09-12T02:02:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7fcd8402a060 msgr2=0x7fcd840293b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7fcd8402a060 0x7fcd840293b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5588b68dc350 msgr2=0x7fcd84019920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd89e38640 1 -- 172.21.15.19:0/373537529 reap_dead start 2024-09-12T02:02:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5588b68dc350 0x7fcd84019920 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5588b69aea50 msgr2=0x5588b69b0560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5588b69aea50 0x5588b69b0560 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd6c06a810 msgr2=0x7fcd6c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd6c06a810 0x7fcd6c06ccd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcd74003040 tx=0x7fcd74065040 comp rx=0 tx=0).stop 2024-09-12T02:02:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5588b68dbc40 msgr2=0x5588b698e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5588b68dbc40 0x5588b698e220 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c006e30 tx=0x7fcd7c003820 comp rx=0 tx=0).stop 2024-09-12T02:02:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 shutdown_connections 2024-09-12T02:02:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5588b69aea50 0x5588b69b0560 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5588b68dc350 0x7fcd84019920 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcd6c06a810 0x7fcd6c06ccd0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 --2- 172.21.15.19:0/373537529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5588b68dbc40 0x5588b698e220 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 >> 172.21.15.19:0/373537529 conn(0x5588b68d99e0 msgr2=0x5588b68d7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 shutdown_connections 2024-09-12T02:02:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.286+0000 7fcd8bb41f40 1 -- 172.21.15.19:0/373537529 wait complete. 2024-09-12T02:02:24.324 INFO:teuthology.orchestra.run.smithi019.stdout:1.00000000�������������������!�������������������������� ��d^_layout@@_parent ���� ��  (�K�f+K�(�K�f+K�8`�K�f���'8�K�f+K����� ��NH subdir_head1i"��K�f�&�A�5�����������������K�f�&�K�f+K�(�K�f�&8`�K�f���'8`�K�f���' ���������K�f+K�����security.selinux%unconfined_u:object_r:unlabeled_t:s0������������ �� �� 2024-09-12T02:02:24.325 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata ls 2024-09-12T02:02:24.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.406+0000 7f70435dff40 1 Processor -- start 2024-09-12T02:02:24.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.406+0000 7f70435dff40 1 -- start start 2024-09-12T02:02:24.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.407+0000 7f70435dff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ef823af60 0x561ef827fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.407+0000 7f70435dff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ef823b340 0x561ef827ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.407+0000 7f70435dff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ef830a1c0 0x561ef82ffb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.407+0000 7f70435dff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561ef82630f0 con 0x561ef823af60 2024-09-12T02:02:24.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.407+0000 7f70435dff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561ef830ab70 con 0x561ef823b340 2024-09-12T02:02:24.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.407+0000 7f70435dff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x561ef8266710 con 0x561ef830a1c0 2024-09-12T02:02:24.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.407+0000 7f70410d5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ef823af60 0x561ef827fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.407+0000 7f70410d5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ef823af60 0x561ef827fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50752/0 (socket says 172.21.15.19:50752) 2024-09-12T02:02:24.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.407+0000 7f70410d5640 1 -- 172.21.15.19:0/3060964185 learned_addr learned my addr 172.21.15.19:0/3060964185 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:24.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.407+0000 7f70408d4640 1 --2- 172.21.15.19:0/3060964185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ef823b340 0x561ef827ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.407+0000 7f70418d6640 1 --2- 172.21.15.19:0/3060964185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ef830a1c0 0x561ef82ffb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.407+0000 7f70410d5640 1 -- 172.21.15.19:0/3060964185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ef830a1c0 msgr2=0x561ef82ffb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:24.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.407+0000 7f70410d5640 1 --2- 172.21.15.19:0/3060964185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ef830a1c0 0x561ef82ffb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.407+0000 7f70410d5640 1 -- 172.21.15.19:0/3060964185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ef823b340 msgr2=0x561ef827ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:24.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.407+0000 7f70410d5640 1 --2- 172.21.15.19:0/3060964185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ef823b340 0x561ef827ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.407+0000 7f70410d5640 1 -- 172.21.15.19:0/3060964185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ef8163cb0 con 0x561ef823af60 2024-09-12T02:02:24.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.407+0000 7f70410d5640 1 --2- 172.21.15.19:0/3060964185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ef823af60 0x561ef827fd50 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f7034009760 tx=0x7f7034009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf0ea623196a2dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.407+0000 7f703b7fe640 1 -- 172.21.15.19:0/3060964185 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7034017070 con 0x561ef823af60 2024-09-12T02:02:24.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.408+0000 7f703b7fe640 1 -- 172.21.15.19:0/3060964185 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70340090d0 con 0x561ef823af60 2024-09-12T02:02:24.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.408+0000 7f703b7fe640 1 -- 172.21.15.19:0/3060964185 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7034006b60 con 0x561ef823af60 2024-09-12T02:02:24.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.408+0000 7f70435dff40 1 -- 172.21.15.19:0/3060964185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ef823af60 msgr2=0x561ef827fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.408+0000 7f70435dff40 1 --2- 172.21.15.19:0/3060964185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ef823af60 0x561ef827fd50 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f7034009760 tx=0x7f7034009c20 comp rx=0 tx=0).stop 2024-09-12T02:02:24.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.408+0000 7f70435dff40 1 -- 172.21.15.19:0/3060964185 shutdown_connections 2024-09-12T02:02:24.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.408+0000 7f70435dff40 1 --2- 172.21.15.19:0/3060964185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ef830a1c0 0x561ef82ffb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.408+0000 7f70435dff40 1 --2- 172.21.15.19:0/3060964185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ef823b340 0x561ef827ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.408+0000 7f70435dff40 1 --2- 172.21.15.19:0/3060964185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ef823af60 0x561ef827fd50 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.408+0000 7f70435dff40 1 -- 172.21.15.19:0/3060964185 >> 172.21.15.19:0/3060964185 conn(0x561ef823a1c0 msgr2=0x561ef8269130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:24.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.408+0000 7f70435dff40 1 -- 172.21.15.19:0/3060964185 shutdown_connections 2024-09-12T02:02:24.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.408+0000 7f70435dff40 1 -- 172.21.15.19:0/3060964185 wait complete. 2024-09-12T02:02:24.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.409+0000 7f70435dff40 1 Processor -- start 2024-09-12T02:02:24.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.409+0000 7f70435dff40 1 -- start start 2024-09-12T02:02:24.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.409+0000 7f70435dff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ef823af60 0x561ef82fea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.409+0000 7f70435dff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ef823b340 0x561ef830f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.409+0000 7f70435dff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ef830a1c0 0x561ef830f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.409+0000 7f70435dff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561ef8268c50 con 0x561ef823af60 2024-09-12T02:02:24.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.409+0000 7f70435dff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561ef83119c0 con 0x561ef830a1c0 2024-09-12T02:02:24.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.409+0000 7f70435dff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x561ef8264df0 con 0x561ef823b340 2024-09-12T02:02:24.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.409+0000 7f70410d5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ef823af60 0x561ef82fea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.409+0000 7f70410d5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ef823af60 0x561ef82fea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50754/0 (socket says 172.21.15.19:50754) 2024-09-12T02:02:24.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.409+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 learned_addr learned my addr 172.21.15.19:0/2077832866 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:24.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.410+0000 7f70408d4640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ef823b340 0x561ef830f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.410+0000 7f70418d6640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ef830a1c0 0x561ef830f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.410+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ef823b340 msgr2=0x561ef830f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.410+0000 7f70410d5640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ef823b340 0x561ef830f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.410+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ef830a1c0 msgr2=0x561ef830f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.410+0000 7f70410d5640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ef830a1c0 0x561ef830f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.410+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ef83988a0 con 0x561ef823af60 2024-09-12T02:02:24.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.410+0000 7f70418d6640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ef830a1c0 0x561ef830f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:24.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.410+0000 7f70408d4640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ef823b340 0x561ef830f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:24.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.410+0000 7f70410d5640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ef823af60 0x561ef82fea90 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f7034000c00 tx=0x7f7034003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.410+0000 7f703a7fc640 1 -- 172.21.15.19:0/2077832866 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7034017070 con 0x561ef823af60 2024-09-12T02:02:24.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.410+0000 7f703a7fc640 1 -- 172.21.15.19:0/2077832866 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7034021070 con 0x561ef823af60 2024-09-12T02:02:24.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.410+0000 7f703a7fc640 1 -- 172.21.15.19:0/2077832866 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703401c880 con 0x561ef823af60 2024-09-12T02:02:24.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.410+0000 7f70435dff40 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561ef8307460 con 0x561ef823af60 2024-09-12T02:02:24.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.410+0000 7f70435dff40 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ef82ff420 con 0x561ef823af60 2024-09-12T02:02:24.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.411+0000 7f703a7fc640 1 -- 172.21.15.19:0/2077832866 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f703401ca20 con 0x561ef823af60 2024-09-12T02:02:24.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.412+0000 7f703a7fc640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f702406a810 0x7f702406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.412+0000 7f703a7fc640 1 -- 172.21.15.19:0/2077832866 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f703408ac20 con 0x561ef823af60 2024-09-12T02:02:24.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.412+0000 7f70435dff40 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561ef82fefd0 0x561ef830d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.412+0000 7f70435dff40 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:1 13.0 13:00000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x561ef82fefd0 2024-09-12T02:02:24.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.412+0000 7f70408d4640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f702406a810 0x7f702406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.412+0000 7f70418d6640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561ef82fefd0 0x561ef830d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.413+0000 7f70408d4640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f702406a810 0x7f702406ccd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x561ef8269b40 tx=0x7f702c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.413+0000 7f70418d6640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561ef82fefd0 0x561ef830d790 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.413+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(1 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f703c04e960 con 0x561ef82fefd0 2024-09-12T02:02:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.413+0000 7f70418d6640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7f703c061040 0x7f703c056400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.413+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:08000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f703c061040 2024-09-12T02:02:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.413+0000 7f70410d5640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7f703c061040 0x7f703c056400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.414+0000 7f70410d5640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7f703c061040 0x7f703c056400 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.414+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(2 [pgnls start_epoch 94 out=177b] v93'10 uv10 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x7f703401a070 con 0x7f703c061040 2024-09-12T02:02:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.414+0000 7f70410d5640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7f7034058fe0 0x7f7034057c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.414+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] -- osd_op(unknown.0.0:3 13.8 13:10000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f7034058fe0 2024-09-12T02:02:24.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.414+0000 7f70408d4640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7f7034058fe0 0x7f7034057c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.414+0000 7f70408d4640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7f7034058fe0 0x7f7034057c40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.415+0000 7f70408d4640 1 -- 172.21.15.19:0/2077832866 <== osd.2 v2:172.21.15.19:6816/1297238899 1 ==== osd_op_reply(3 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702c006a80 con 0x7f7034058fe0 2024-09-12T02:02:24.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.415+0000 7f70408d4640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:4 13.18 13:18000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x561ef82fefd0 2024-09-12T02:02:24.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.415+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(4 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f703c04e960 con 0x561ef82fefd0 2024-09-12T02:02:24.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.415+0000 7f70418d6640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x7f703c0553a0 0x7f703c055800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.415+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:5 13.4 13:20000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f703c0553a0 2024-09-12T02:02:24.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.415+0000 7f70418d6640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x7f703c0553a0 0x7f703c055800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.416+0000 7f70418d6640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x7f703c0553a0 0x7f703c055800 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.416+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(5 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f703c06f040 con 0x7f703c0553a0 2024-09-12T02:02:24.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.416+0000 7f70418d6640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x7f703c072040 0x7f703c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.416+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:6 13.14 13:28000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f703c072040 2024-09-12T02:02:24.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.416+0000 7f70410d5640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x7f703c072040 0x7f703c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.416+0000 7f70410d5640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x7f703c072040 0x7f703c0718c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.416+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(6 [pgnls start_epoch 94 out=149b] v93'20 uv20 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x7f703401a070 con 0x7f703c072040 2024-09-12T02:02:24.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.416+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.c 13:30000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f703c061040 2024-09-12T02:02:24.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.417+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(7 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f703401a070 con 0x7f703c061040 2024-09-12T02:02:24.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.417+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:8 13.1c 13:38000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f703c0553a0 2024-09-12T02:02:24.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.417+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(8 [pgnls start_epoch 94 out=73b] v92'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f703c06f040 con 0x7f703c0553a0 2024-09-12T02:02:24.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.417+0000 7f70418d6640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7f703c074940 0x7f703c0603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.417+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:9 13.2 13:40000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f703c074940 2024-09-12T02:02:24.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.417+0000 7f70408d4640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7f703c074940 0x7f703c0603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.418+0000 7f70408d4640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7f703c074940 0x7f703c0603b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.418+0000 7f70408d4640 1 -- 172.21.15.19:0/2077832866 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(9 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702c006a80 con 0x7f703c074940 2024-09-12T02:02:24.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.418+0000 7f70408d4640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:10 13.12 13:48000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f703c072040 2024-09-12T02:02:24.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.418+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(10 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7034076040 con 0x7f703c072040 2024-09-12T02:02:24.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.418+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] -- osd_op(unknown.0.0:11 13.a 13:50000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f7034058fe0 2024-09-12T02:02:24.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.418+0000 7f70408d4640 1 -- 172.21.15.19:0/2077832866 <== osd.2 v2:172.21.15.19:6816/1297238899 2 ==== osd_op_reply(11 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702c006a80 con 0x7f7034058fe0 2024-09-12T02:02:24.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.418+0000 7f70408d4640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.1a 13:58000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f703c061040 2024-09-12T02:02:24.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.419+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(12 [pgnls start_epoch 94 out=49b] v92'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7034076040 con 0x7f703c061040 2024-09-12T02:02:24.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.419+0000 7f70410d5640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7f70340614d0 0x7f7034082960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.419+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:13 13.6 13:60000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f70340614d0 2024-09-12T02:02:24.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.419+0000 7f70418d6640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7f70340614d0 0x7f7034082960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.419+0000 7f70418d6640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7f70340614d0 0x7f7034082960 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.420+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(13 [pgnls start_epoch 94 out=77b] v93'2 uv2 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x7f703c080040 con 0x7f70340614d0 2024-09-12T02:02:24.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.420+0000 7f70418d6640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x7f703c05f850 0x7f703c070340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.420+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] -- osd_op(unknown.0.0:14 13.16 13:68000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f703c05f850 2024-09-12T02:02:24.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.420+0000 7f70410d5640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x7f703c05f850 0x7f703c070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.420+0000 7f70410d5640 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x7f703c05f850 0x7f703c070340 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.420+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 <== osd.3 v2:172.21.15.19:6800/2581301650 1 ==== osd_op_reply(14 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7034076040 con 0x7f703c05f850 2024-09-12T02:02:24.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.420+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:15 13.e 13:70000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x561ef82fefd0 2024-09-12T02:02:24.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.421+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(15 [pgnls start_epoch 94 out=73b] v92'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f703c080040 con 0x561ef82fefd0 2024-09-12T02:02:24.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.421+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:16 13.1e 13:78000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f70340614d0 2024-09-12T02:02:24.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.421+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(16 [pgnls start_epoch 94 out=49b] v92'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f703c080040 con 0x7f70340614d0 2024-09-12T02:02:24.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.421+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:17 13.1 13:80000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f703c0553a0 2024-09-12T02:02:24.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.421+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(17 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f703c080040 con 0x7f703c0553a0 2024-09-12T02:02:24.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.421+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.11 13:88000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f703c061040 2024-09-12T02:02:24.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.422+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(18 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7034076040 con 0x7f703c061040 2024-09-12T02:02:24.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.422+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:19 13.9 13:90000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f703c074940 2024-09-12T02:02:24.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.422+0000 7f70408d4640 1 -- 172.21.15.19:0/2077832866 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(19 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702c006a80 con 0x7f703c074940 2024-09-12T02:02:24.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.422+0000 7f70408d4640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] -- osd_op(unknown.0.0:20 13.19 13:98000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f703c05f850 2024-09-12T02:02:24.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.422+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 <== osd.3 v2:172.21.15.19:6800/2581301650 2 ==== osd_op_reply(20 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7034076040 con 0x7f703c05f850 2024-09-12T02:02:24.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.422+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:21 13.5 13:a0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f70340614d0 2024-09-12T02:02:24.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.422+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(21 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f703c080040 con 0x7f70340614d0 2024-09-12T02:02:24.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.422+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:22 13.15 13:a8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x561ef8310200 con 0x7f70340614d0 2024-09-12T02:02:24.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.423+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(22 [pgnls start_epoch 94 out=97b] v92'3 uv3 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7f703c080040 con 0x7f70340614d0 2024-09-12T02:02:24.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.423+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:23 13.d 13:b0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x7f703c08e070 con 0x7f70340614d0 2024-09-12T02:02:24.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.423+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(23 [pgnls start_epoch 94 out=74b] v92'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f703c080040 con 0x7f70340614d0 2024-09-12T02:02:24.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.423+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:24 13.1d 13:b8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x7f703c08e070 con 0x561ef82fefd0 2024-09-12T02:02:24.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.423+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(24 [pgnls start_epoch 94 out=73b] v92'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f703c080040 con 0x561ef82fefd0 2024-09-12T02:02:24.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.423+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:25 13.3 13:c0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x7f703c08e070 con 0x7f703c072040 2024-09-12T02:02:24.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.423+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(25 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7034076040 con 0x7f703c072040 2024-09-12T02:02:24.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.423+0000 7f70410d5640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:26 13.13 13:c8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x7f703c08e070 con 0x561ef82fefd0 2024-09-12T02:02:24.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.424+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(26 [pgnls start_epoch 94 out=98b] v93'3 uv3 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x7f703c080040 con 0x561ef82fefd0 2024-09-12T02:02:24.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.424+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:27 13.b 13:d0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x7f703c08e070 con 0x7f703c074940 2024-09-12T02:02:24.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.424+0000 7f70408d4640 1 -- 172.21.15.19:0/2077832866 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(27 [pgnls start_epoch 94 out=76b] v93'3 uv3 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x7f702c006a80 con 0x7f703c074940 2024-09-12T02:02:24.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.424+0000 7f70408d4640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:28 13.1b 13:d8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x7f703c08e070 con 0x7f70340614d0 2024-09-12T02:02:24.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.424+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(28 [pgnls start_epoch 94 out=49b] v92'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f703c080040 con 0x7f70340614d0 2024-09-12T02:02:24.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.424+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:29 13.7 13:e0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x7f703c08e070 con 0x561ef82fefd0 2024-09-12T02:02:24.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.425+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(29 [pgnls start_epoch 94 out=73b] v92'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f703c080040 con 0x561ef82fefd0 2024-09-12T02:02:24.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.425+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:30 13.17 13:e8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x7f703c08e070 con 0x7f703c074940 2024-09-12T02:02:24.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.425+0000 7f70408d4640 1 -- 172.21.15.19:0/2077832866 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(30 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702c006a80 con 0x7f703c074940 2024-09-12T02:02:24.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.425+0000 7f70408d4640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:31 13.f 13:f0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x7f703c08e070 con 0x7f703c0553a0 2024-09-12T02:02:24.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.425+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(31 [pgnls start_epoch 94 out=73b] v92'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f703c080040 con 0x7f703c0553a0 2024-09-12T02:02:24.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.425+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:32 13.1f 13:f8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x7f703c08e070 con 0x7f703c0553a0 2024-09-12T02:02:24.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(32 [pgnls start_epoch 94 out=101b] v93'6 uv6 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x7f703c080040 con 0x7f703c0553a0 2024-09-12T02:02:24.435 INFO:teuthology.orchestra.run.smithi019.stdout:601.00000000 2024-09-12T02:02:24.435 INFO:teuthology.orchestra.run.smithi019.stdout:602.00000000 2024-09-12T02:02:24.435 INFO:teuthology.orchestra.run.smithi019.stdout:10000000000.00000000 2024-09-12T02:02:24.435 INFO:teuthology.orchestra.run.smithi019.stdout:600.00000000 2024-09-12T02:02:24.435 INFO:teuthology.orchestra.run.smithi019.stdout:603.00000000 2024-09-12T02:02:24.435 INFO:teuthology.orchestra.run.smithi019.stdout:1.00000000.inode 2024-09-12T02:02:24.435 INFO:teuthology.orchestra.run.smithi019.stdout:200.00000000 2024-09-12T02:02:24.435 INFO:teuthology.orchestra.run.smithi019.stdout:200.00000001 2024-09-12T02:02:24.435 INFO:teuthology.orchestra.run.smithi019.stdout:606.00000000 2024-09-12T02:02:24.435 INFO:teuthology.orchestra.run.smithi019.stdout:607.00000000 2024-09-12T02:02:24.435 INFO:teuthology.orchestra.run.smithi019.stdout:mds0_openfiles.0 2024-09-12T02:02:24.436 INFO:teuthology.orchestra.run.smithi019.stdout:608.00000000 2024-09-12T02:02:24.436 INFO:teuthology.orchestra.run.smithi019.stdout:604.00000000 2024-09-12T02:02:24.436 INFO:teuthology.orchestra.run.smithi019.stdout:500.00000000 2024-09-12T02:02:24.436 INFO:teuthology.orchestra.run.smithi019.stdout:mds_snaptable 2024-09-12T02:02:24.436 INFO:teuthology.orchestra.run.smithi019.stdout:605.00000000 2024-09-12T02:02:24.436 INFO:teuthology.orchestra.run.smithi019.stdout:mds0_inotable 2024-09-12T02:02:24.436 INFO:teuthology.orchestra.run.smithi019.stdout:100.00000000 2024-09-12T02:02:24.436 INFO:teuthology.orchestra.run.smithi019.stdout:mds0_sessionmap 2024-09-12T02:02:24.436 INFO:teuthology.orchestra.run.smithi019.stdout:609.00000000 2024-09-12T02:02:24.436 INFO:teuthology.orchestra.run.smithi019.stdout:400.00000000 2024-09-12T02:02:24.437 INFO:teuthology.orchestra.run.smithi019.stdout:100.00000000.inode 2024-09-12T02:02:24.437 INFO:teuthology.orchestra.run.smithi019.stdout:1.00000000 2024-09-12T02:02:24.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 -- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x7f703c072040 msgr2=0x7f703c0718c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x7f703c072040 0x7f703c0718c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 -- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7f703c061040 msgr2=0x7f703c056400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7f703c061040 0x7f703c056400 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 -- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7f7034058fe0 msgr2=0x7f7034057c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7f7034058fe0 0x7f7034057c40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 -- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x7f703c05f850 msgr2=0x7f703c070340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x7f703c05f850 0x7f703c070340 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 -- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7f70340614d0 msgr2=0x7f7034082960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7f70340614d0 0x7f7034082960 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 reap_dead start 2024-09-12T02:02:24.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 -- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7f703c074940 msgr2=0x7f703c0603b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7f703c074940 0x7f703c0603b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70418d6640 1 -- 172.21.15.19:0/2077832866 reap_dead start 2024-09-12T02:02:24.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 -- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x7f703c0553a0 msgr2=0x7f703c055800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x7f703c0553a0 0x7f703c055800 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 -- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561ef82fefd0 msgr2=0x561ef830d790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561ef82fefd0 0x561ef830d790 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 -- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f702406a810 msgr2=0x7f702406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f702406a810 0x7f702406ccd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x561ef8269b40 tx=0x7f702c00b040 comp rx=0 tx=0).stop 2024-09-12T02:02:24.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 -- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ef823af60 msgr2=0x561ef82fea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ef823af60 0x561ef82fea90 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f7034000c00 tx=0x7f7034003020 comp rx=0 tx=0).stop 2024-09-12T02:02:24.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 -- 172.21.15.19:0/2077832866 shutdown_connections 2024-09-12T02:02:24.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561ef82fefd0 0x561ef830d790 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x7f703c0553a0 0x7f703c055800 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f702406a810 0x7f702406ccd0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 --2- 172.21.15.19:0/2077832866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ef823af60 0x561ef82fea90 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 -- 172.21.15.19:0/2077832866 >> 172.21.15.19:0/2077832866 conn(0x561ef823a1c0 msgr2=0x561ef8308cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:24.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 -- 172.21.15.19:0/2077832866 shutdown_connections 2024-09-12T02:02:24.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.426+0000 7f70435dff40 1 -- 172.21.15.19:0/2077832866 wait complete. 2024-09-12T02:02:24.444 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 10000000000.00000000 2024-09-12T02:02:24.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.522+0000 7fe697b8ff40 1 Processor -- start 2024-09-12T02:02:24.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.523+0000 7fe697b8ff40 1 -- start start 2024-09-12T02:02:24.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.523+0000 7fe697b8ff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55890c1ee350 0x55890c2c3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.523+0000 7fe697b8ff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55890c21c050 0x55890c1ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.523+0000 7fe697b8ff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55890c2a6080 0x55890c232030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.523+0000 7fe697b8ff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55890c1eaae0 con 0x55890c1ee350 2024-09-12T02:02:24.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.523+0000 7fe697b8ff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55890c13d510 con 0x55890c2a6080 2024-09-12T02:02:24.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.523+0000 7fe697b8ff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55890c1eadc0 con 0x55890c21c050 2024-09-12T02:02:24.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.523+0000 7fe695685640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55890c1ee350 0x55890c2c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.523+0000 7fe695685640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55890c1ee350 0x55890c2c3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50764/0 (socket says 172.21.15.19:50764) 2024-09-12T02:02:24.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.523+0000 7fe695685640 1 -- 172.21.15.19:0/3327965230 learned_addr learned my addr 172.21.15.19:0/3327965230 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:24.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.523+0000 7fe68ffff640 1 --2- 172.21.15.19:0/3327965230 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55890c21c050 0x55890c1ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.523+0000 7fe695e86640 1 --2- 172.21.15.19:0/3327965230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55890c2a6080 0x55890c232030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.524+0000 7fe695685640 1 -- 172.21.15.19:0/3327965230 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55890c21c050 msgr2=0x55890c1ed6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:24.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.524+0000 7fe695685640 1 --2- 172.21.15.19:0/3327965230 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55890c21c050 0x55890c1ed6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.524+0000 7fe695685640 1 -- 172.21.15.19:0/3327965230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55890c2a6080 msgr2=0x55890c232030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.524+0000 7fe695685640 1 --2- 172.21.15.19:0/3327965230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55890c2a6080 0x55890c232030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.524+0000 7fe695685640 1 -- 172.21.15.19:0/3327965230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55890c2c29d0 con 0x55890c1ee350 2024-09-12T02:02:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.524+0000 7fe695685640 1 --2- 172.21.15.19:0/3327965230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55890c1ee350 0x55890c2c3730 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fe68800a7a0 tx=0x7fe68800a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55aa1594cc73e2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.524+0000 7fe68f7fe640 1 -- 172.21.15.19:0/3327965230 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe688018070 con 0x55890c1ee350 2024-09-12T02:02:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.524+0000 7fe68f7fe640 1 -- 172.21.15.19:0/3327965230 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe688007600 con 0x55890c1ee350 2024-09-12T02:02:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.524+0000 7fe68f7fe640 1 -- 172.21.15.19:0/3327965230 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6880079b0 con 0x55890c1ee350 2024-09-12T02:02:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.524+0000 7fe697b8ff40 1 -- 172.21.15.19:0/3327965230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55890c1ee350 msgr2=0x55890c2c3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.524+0000 7fe697b8ff40 1 --2- 172.21.15.19:0/3327965230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55890c1ee350 0x55890c2c3730 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fe68800a7a0 tx=0x7fe68800a890 comp rx=0 tx=0).stop 2024-09-12T02:02:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.524+0000 7fe697b8ff40 1 -- 172.21.15.19:0/3327965230 shutdown_connections 2024-09-12T02:02:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.524+0000 7fe697b8ff40 1 --2- 172.21.15.19:0/3327965230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55890c2a6080 0x55890c232030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.524+0000 7fe697b8ff40 1 --2- 172.21.15.19:0/3327965230 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55890c21c050 0x55890c1ed6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.524+0000 7fe697b8ff40 1 --2- 172.21.15.19:0/3327965230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55890c1ee350 0x55890c2c3730 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.524+0000 7fe697b8ff40 1 -- 172.21.15.19:0/3327965230 >> 172.21.15.19:0/3327965230 conn(0x55890c1eb9e0 msgr2=0x55890c1ebdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.524+0000 7fe697b8ff40 1 -- 172.21.15.19:0/3327965230 shutdown_connections 2024-09-12T02:02:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.524+0000 7fe697b8ff40 1 -- 172.21.15.19:0/3327965230 wait complete. 2024-09-12T02:02:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.525+0000 7fe697b8ff40 1 Processor -- start 2024-09-12T02:02:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.525+0000 7fe697b8ff40 1 -- start start 2024-09-12T02:02:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.526+0000 7fe697b8ff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55890c1ee350 0x55890c354540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.526+0000 7fe697b8ff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55890c21c050 0x55890c1ed8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.526+0000 7fe697b8ff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55890c2a6080 0x55890c2a7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.526+0000 7fe697b8ff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55890c2c44b0 con 0x55890c2a6080 2024-09-12T02:02:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.526+0000 7fe697b8ff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55890c2c2c90 con 0x55890c1ee350 2024-09-12T02:02:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.526+0000 7fe697b8ff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55890c2c3140 con 0x55890c21c050 2024-09-12T02:02:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.526+0000 7fe695e86640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55890c2a6080 0x55890c2a7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.526+0000 7fe695e86640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55890c2a6080 0x55890c2a7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50776/0 (socket says 172.21.15.19:50776) 2024-09-12T02:02:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.526+0000 7fe695e86640 1 -- 172.21.15.19:0/3915239110 learned_addr learned my addr 172.21.15.19:0/3915239110 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.526+0000 7fe68ffff640 1 --2- 172.21.15.19:0/3915239110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55890c21c050 0x55890c1ed8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.526+0000 7fe695685640 1 --2- 172.21.15.19:0/3915239110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55890c1ee350 0x55890c354540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.526+0000 7fe695e86640 1 -- 172.21.15.19:0/3915239110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55890c21c050 msgr2=0x55890c1ed8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.526+0000 7fe695e86640 1 --2- 172.21.15.19:0/3915239110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55890c21c050 0x55890c1ed8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.526+0000 7fe695e86640 1 -- 172.21.15.19:0/3915239110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55890c1ee350 msgr2=0x55890c354540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.526+0000 7fe695e86640 1 --2- 172.21.15.19:0/3915239110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55890c1ee350 0x55890c354540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.526+0000 7fe695e86640 1 -- 172.21.15.19:0/3915239110 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55890c2aa410 con 0x55890c2a6080 2024-09-12T02:02:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.526+0000 7fe695685640 1 --2- 172.21.15.19:0/3915239110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55890c1ee350 0x55890c354540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.526+0000 7fe695e86640 1 --2- 172.21.15.19:0/3915239110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55890c2a6080 0x55890c2a7be0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fe6900259e0 tx=0x7fe690003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.527+0000 7fe68e7fc640 1 -- 172.21.15.19:0/3915239110 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690069070 con 0x55890c2a6080 2024-09-12T02:02:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.527+0000 7fe68e7fc640 1 -- 172.21.15.19:0/3915239110 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6900643f0 con 0x55890c2a6080 2024-09-12T02:02:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.527+0000 7fe697b8ff40 1 -- 172.21.15.19:0/3915239110 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55890c2ac750 con 0x55890c2a6080 2024-09-12T02:02:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.527+0000 7fe68e7fc640 1 -- 172.21.15.19:0/3915239110 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690058600 con 0x55890c2a6080 2024-09-12T02:02:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.527+0000 7fe697b8ff40 1 -- 172.21.15.19:0/3915239110 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55890c236160 con 0x55890c2a6080 2024-09-12T02:02:24.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.528+0000 7fe68e7fc640 1 -- 172.21.15.19:0/3915239110 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe69006c070 con 0x55890c2a6080 2024-09-12T02:02:24.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.528+0000 7fe68e7fc640 1 --2- 172.21.15.19:0/3915239110 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe67806a840 0x7fe67806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.528+0000 7fe68e7fc640 1 -- 172.21.15.19:0/3915239110 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7fe6900cd770 con 0x55890c2a6080 2024-09-12T02:02:24.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.529+0000 7fe695685640 1 --2- 172.21.15.19:0/3915239110 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe67806a840 0x7fe67806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.529+0000 7fe697b8ff40 1 --2- 172.21.15.19:0/3915239110 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55890c1ede00 0x55890c35d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.529+0000 7fe697b8ff40 1 -- 172.21.15.19:0/3915239110 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55890c2ab6d0 con 0x55890c1ede00 2024-09-12T02:02:24.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.529+0000 7fe68ffff640 1 --2- 172.21.15.19:0/3915239110 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55890c1ede00 0x55890c35d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.529+0000 7fe695685640 1 --2- 172.21.15.19:0/3915239110 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe67806a840 0x7fe67806cd00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe688016040 tx=0x7fe68800c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.529+0000 7fe68ffff640 1 --2- 172.21.15.19:0/3915239110 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55890c1ede00 0x55890c35d090 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.529+0000 7fe68ffff640 1 -- 172.21.15.19:0/3915239110 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x7fe680011810 con 0x55890c1ede00 2024-09-12T02:02:24.534 INFO:teuthology.orchestra.run.smithi019.stdout:header (274 bytes) : 2024-09-12T02:02:24.534 INFO:teuthology.orchestra.run.smithi019.stdout:00000000 04 03 0c 01 00 00 0b 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:24.534 INFO:teuthology.orchestra.run.smithi019.stdout:00000010 00 00 00 00 00 00 03 02 28 00 00 00 00 00 00 00 |........(.......| 2024-09-12T02:02:24.534 INFO:teuthology.orchestra.run.smithi019.stdout:00000020 00 00 00 00 ae 4b e2 66 01 12 ae 26 01 00 00 00 |.....K.f...&....| 2024-09-12T02:02:24.534 INFO:teuthology.orchestra.run.smithi019.stdout:00000030 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00 |................| 2024-09-12T02:02:24.534 INFO:teuthology.orchestra.run.smithi019.stdout:00000040 00 00 00 00 03 02 28 00 00 00 00 00 00 00 00 00 |......(.........| 2024-09-12T02:02:24.534 INFO:teuthology.orchestra.run.smithi019.stdout:00000050 00 00 ae 4b e2 66 01 12 ae 26 01 00 00 00 00 00 |...K.f...&......| 2024-09-12T02:02:24.534 INFO:teuthology.orchestra.run.smithi019.stdout:00000060 00 00 00 00 00 00 00 00 00 00 01 00 00 00 00 00 |................| 2024-09-12T02:02:24.534 INFO:teuthology.orchestra.run.smithi019.stdout:00000070 00 00 03 02 38 00 00 00 00 00 00 00 00 00 00 00 |....8...........| 2024-09-12T02:02:24.534 INFO:teuthology.orchestra.run.smithi019.stdout:00000080 00 00 60 00 00 00 00 00 01 00 00 00 00 00 00 00 |..`.............| 2024-09-12T02:02:24.534 INFO:teuthology.orchestra.run.smithi019.stdout:00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:24.535 INFO:teuthology.orchestra.run.smithi019.stdout:000000a0 00 00 00 00 00 00 00 00 ae 4b e2 66 f9 fb cf 27 |.........K.f...'| 2024-09-12T02:02:24.535 INFO:teuthology.orchestra.run.smithi019.stdout:000000b0 03 02 38 00 00 00 00 00 00 00 00 00 00 00 00 00 |..8.............| 2024-09-12T02:02:24.535 INFO:teuthology.orchestra.run.smithi019.stdout:000000c0 60 00 00 00 00 00 01 00 00 00 00 00 00 00 00 00 |`...............| 2024-09-12T02:02:24.535 INFO:teuthology.orchestra.run.smithi019.stdout:000000d0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:24.535 INFO:teuthology.orchestra.run.smithi019.stdout:000000e0 00 00 00 00 00 00 ae 4b e2 66 f9 fb cf 27 00 00 |.......K.f...'..| 2024-09-12T02:02:24.535 INFO:teuthology.orchestra.run.smithi019.stdout:000000f0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:24.535 INFO:teuthology.orchestra.run.smithi019.stdout:* 2024-09-12T02:02:24.535 INFO:teuthology.orchestra.run.smithi019.stdout:00000110 00 00 |..| 2024-09-12T02:02:24.535 INFO:teuthology.orchestra.run.smithi019.stdout:00000112 2024-09-12T02:02:24.535 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.529+0000 7fe697b8ff40 1 -- 172.21.15.19:0/3915239110 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55890c1ede00 msgr2=0x55890c35d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.529+0000 7fe697b8ff40 1 --2- 172.21.15.19:0/3915239110 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55890c1ede00 0x55890c35d090 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.530+0000 7fe697b8ff40 1 -- 172.21.15.19:0/3915239110 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe67806a840 msgr2=0x7fe67806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.530+0000 7fe697b8ff40 1 --2- 172.21.15.19:0/3915239110 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe67806a840 0x7fe67806cd00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe688016040 tx=0x7fe68800c000 comp rx=0 tx=0).stop 2024-09-12T02:02:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.530+0000 7fe697b8ff40 1 -- 172.21.15.19:0/3915239110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55890c2a6080 msgr2=0x55890c2a7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.530+0000 7fe697b8ff40 1 --2- 172.21.15.19:0/3915239110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55890c2a6080 0x55890c2a7be0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fe6900259e0 tx=0x7fe690003330 comp rx=0 tx=0).stop 2024-09-12T02:02:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.530+0000 7fe695e86640 1 -- 172.21.15.19:0/3915239110 reap_dead start 2024-09-12T02:02:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.530+0000 7fe697b8ff40 1 -- 172.21.15.19:0/3915239110 shutdown_connections 2024-09-12T02:02:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.530+0000 7fe697b8ff40 1 -- 172.21.15.19:0/3915239110 >> 172.21.15.19:0/3915239110 conn(0x55890c1eb9e0 msgr2=0x55890c2c3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.530+0000 7fe697b8ff40 1 -- 172.21.15.19:0/3915239110 shutdown_connections 2024-09-12T02:02:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.530+0000 7fe697b8ff40 1 -- 172.21.15.19:0/3915239110 wait complete. 2024-09-12T02:02:24.538 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 600.00000000 2024-09-12T02:02:24.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.582+0000 7f61a0522f40 1 Processor -- start 2024-09-12T02:02:24.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.582+0000 7f61a0522f40 1 -- start start 2024-09-12T02:02:24.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.583+0000 7f61a0522f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f618c0022a0 0x5605c8cba9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.583+0000 7f61a0522f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c8d93360 0x5605c8ce6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.583+0000 7f61a0522f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c8ce8010 0x5605c8d91800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.583+0000 7f61a0522f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5605c8c0c510 con 0x5605c8ce8010 2024-09-12T02:02:24.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.583+0000 7f61a0522f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5605c8c65c50 con 0x5605c8d93360 2024-09-12T02:02:24.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.583+0000 7f61a0522f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5605c8d046b0 con 0x7f618c0022a0 2024-09-12T02:02:24.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.583+0000 7f619e81b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c8ce8010 0x5605c8d91800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.583+0000 7f619e81b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c8ce8010 0x5605c8d91800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50798/0 (socket says 172.21.15.19:50798) 2024-09-12T02:02:24.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.583+0000 7f619e81b640 1 -- 172.21.15.19:0/1724551389 learned_addr learned my addr 172.21.15.19:0/1724551389 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:24.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.583+0000 7f6197fff640 1 --2- 172.21.15.19:0/1724551389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c8d93360 0x5605c8ce6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.583+0000 7f619e01a640 1 --2- 172.21.15.19:0/1724551389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f618c0022a0 0x5605c8cba9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.583+0000 7f619e81b640 1 -- 172.21.15.19:0/1724551389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f618c0022a0 msgr2=0x5605c8cba9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:24.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.583+0000 7f619e81b640 1 --2- 172.21.15.19:0/1724551389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f618c0022a0 0x5605c8cba9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.583+0000 7f619e81b640 1 -- 172.21.15.19:0/1724551389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c8d93360 msgr2=0x5605c8ce6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:24.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.583+0000 7f619e81b640 1 --2- 172.21.15.19:0/1724551389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c8d93360 0x5605c8ce6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.583+0000 7f619e81b640 1 -- 172.21.15.19:0/1724551389 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c8d8f880 con 0x5605c8ce8010 2024-09-12T02:02:24.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.583+0000 7f619e81b640 1 --2- 172.21.15.19:0/1724551389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c8ce8010 0x5605c8d91800 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f6198002230 tx=0x7f6198006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd4faad31da5f9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.584+0000 7f619d018640 1 -- 172.21.15.19:0/1724551389 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6198018070 con 0x5605c8ce8010 2024-09-12T02:02:24.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.584+0000 7f619d018640 1 -- 172.21.15.19:0/1724551389 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61980104c0 con 0x5605c8ce8010 2024-09-12T02:02:24.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.584+0000 7f619d018640 1 -- 172.21.15.19:0/1724551389 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61980108b0 con 0x5605c8ce8010 2024-09-12T02:02:24.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.584+0000 7f61a0522f40 1 -- 172.21.15.19:0/1724551389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c8ce8010 msgr2=0x5605c8d91800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.584+0000 7f61a0522f40 1 --2- 172.21.15.19:0/1724551389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c8ce8010 0x5605c8d91800 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f6198002230 tx=0x7f6198006430 comp rx=0 tx=0).stop 2024-09-12T02:02:24.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.584+0000 7f61a0522f40 1 -- 172.21.15.19:0/1724551389 shutdown_connections 2024-09-12T02:02:24.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.584+0000 7f61a0522f40 1 --2- 172.21.15.19:0/1724551389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c8ce8010 0x5605c8d91800 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.584+0000 7f61a0522f40 1 --2- 172.21.15.19:0/1724551389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c8d93360 0x5605c8ce6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.584+0000 7f61a0522f40 1 --2- 172.21.15.19:0/1724551389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f618c0022a0 0x5605c8cba9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.584+0000 7f61a0522f40 1 -- 172.21.15.19:0/1724551389 >> 172.21.15.19:0/1724551389 conn(0x5605c8ce8490 msgr2=0x5605c8ce8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:24.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.584+0000 7f61a0522f40 1 -- 172.21.15.19:0/1724551389 shutdown_connections 2024-09-12T02:02:24.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.584+0000 7f61a0522f40 1 -- 172.21.15.19:0/1724551389 wait complete. 2024-09-12T02:02:24.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.585+0000 7f61a0522f40 1 Processor -- start 2024-09-12T02:02:24.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.585+0000 7f61a0522f40 1 -- start start 2024-09-12T02:02:24.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.585+0000 7f61a0522f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605c8ce8010 0x5605c8d843b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.585+0000 7f61a0522f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c8d93360 0x5605c8d91800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.585+0000 7f61a0522f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f618c0022a0 0x5605c8d89640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.585+0000 7f61a0522f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5605c8d8b930 con 0x7f618c0022a0 2024-09-12T02:02:24.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.585+0000 7f61a0522f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5605c8d88220 con 0x5605c8d93360 2024-09-12T02:02:24.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.585+0000 7f61a0522f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5605c8d88470 con 0x5605c8ce8010 2024-09-12T02:02:24.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.586+0000 7f619e81b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f618c0022a0 0x5605c8d89640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.586+0000 7f619e01a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605c8ce8010 0x5605c8d843b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.586+0000 7f6197fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c8d93360 0x5605c8d91800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.586+0000 7f619e81b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f618c0022a0 0x5605c8d89640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50802/0 (socket says 172.21.15.19:50802) 2024-09-12T02:02:24.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.586+0000 7f619e81b640 1 -- 172.21.15.19:0/893409979 learned_addr learned my addr 172.21.15.19:0/893409979 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:24.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.586+0000 7f619e81b640 1 -- 172.21.15.19:0/893409979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605c8ce8010 msgr2=0x5605c8d843b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.586+0000 7f619e81b640 1 --2- 172.21.15.19:0/893409979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605c8ce8010 0x5605c8d843b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.586+0000 7f619e81b640 1 -- 172.21.15.19:0/893409979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c8d93360 msgr2=0x5605c8d91800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.586+0000 7f619e81b640 1 --2- 172.21.15.19:0/893409979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c8d93360 0x5605c8d91800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.586+0000 7f619e81b640 1 -- 172.21.15.19:0/893409979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c8d8c010 con 0x7f618c0022a0 2024-09-12T02:02:24.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.586+0000 7f619e81b640 1 --2- 172.21.15.19:0/893409979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f618c0022a0 0x5605c8d89640 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x5605c8cbe630 tx=0x7f6198001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.586+0000 7f61977fe640 1 -- 172.21.15.19:0/893409979 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6198018040 con 0x7f618c0022a0 2024-09-12T02:02:24.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.586+0000 7f61977fe640 1 -- 172.21.15.19:0/893409979 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6198003450 con 0x7f618c0022a0 2024-09-12T02:02:24.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.586+0000 7f61a0522f40 1 -- 172.21.15.19:0/893409979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605c8d8c2f0 con 0x7f618c0022a0 2024-09-12T02:02:24.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.586+0000 7f61977fe640 1 -- 172.21.15.19:0/893409979 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6198003820 con 0x7f618c0022a0 2024-09-12T02:02:24.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.586+0000 7f61a0522f40 1 -- 172.21.15.19:0/893409979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605c8d8dfc0 con 0x7f618c0022a0 2024-09-12T02:02:24.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.588+0000 7f61977fe640 1 -- 172.21.15.19:0/893409979 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6198025020 con 0x7f618c0022a0 2024-09-12T02:02:24.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.588+0000 7f61977fe640 1 --2- 172.21.15.19:0/893409979 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f618006a840 0x7f618006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.588+0000 7f61977fe640 1 -- 172.21.15.19:0/893409979 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f619808a860 con 0x7f618c0022a0 2024-09-12T02:02:24.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.588+0000 7f619e01a640 1 --2- 172.21.15.19:0/893409979 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f618006a840 0x7f618006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.588+0000 7f61a0522f40 1 --2- 172.21.15.19:0/893409979 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5605c8d89b80 0x5605c8d86e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.588+0000 7f61a0522f40 1 -- 172.21.15.19:0/893409979 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:0d82a743:::600.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5605c8d87350 con 0x5605c8d89b80 2024-09-12T02:02:24.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.589+0000 7f6197fff640 1 --2- 172.21.15.19:0/893409979 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5605c8d89b80 0x5605c8d86e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.589+0000 7f619e01a640 1 --2- 172.21.15.19:0/893409979 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f618006a840 0x7f618006cd00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6190054000 tx=0x7f6190050000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.589+0000 7f6197fff640 1 --2- 172.21.15.19:0/893409979 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5605c8d89b80 0x5605c8d86e10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.589+0000 7f6197fff640 1 -- 172.21.15.19:0/893409979 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 600.00000000 [omap-get-header out=274b] v0'0 uv5 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7f6188009a00 con 0x5605c8d89b80 2024-09-12T02:02:24.598 INFO:teuthology.orchestra.run.smithi019.stdout:header (274 bytes) : 2024-09-12T02:02:24.598 INFO:teuthology.orchestra.run.smithi019.stdout:00000000 04 03 0c 01 00 00 01 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:24.598 INFO:teuthology.orchestra.run.smithi019.stdout:00000010 00 00 00 00 00 00 03 02 28 00 00 00 00 00 00 00 |........(.......| 2024-09-12T02:02:24.598 INFO:teuthology.orchestra.run.smithi019.stdout:00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:24.598 INFO:teuthology.orchestra.run.smithi019.stdout:* 2024-09-12T02:02:24.598 INFO:teuthology.orchestra.run.smithi019.stdout:00000040 00 00 00 00 03 02 28 00 00 00 00 00 00 00 00 00 |......(.........| 2024-09-12T02:02:24.598 INFO:teuthology.orchestra.run.smithi019.stdout:00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:24.598 INFO:teuthology.orchestra.run.smithi019.stdout:* 2024-09-12T02:02:24.598 INFO:teuthology.orchestra.run.smithi019.stdout:00000070 00 00 03 02 38 00 00 00 00 00 00 00 00 00 00 00 |....8...........| 2024-09-12T02:02:24.599 INFO:teuthology.orchestra.run.smithi019.stdout:00000080 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:24.599 INFO:teuthology.orchestra.run.smithi019.stdout:* 2024-09-12T02:02:24.599 INFO:teuthology.orchestra.run.smithi019.stdout:000000b0 03 02 38 00 00 00 00 00 00 00 00 00 00 00 00 00 |..8.............| 2024-09-12T02:02:24.599 INFO:teuthology.orchestra.run.smithi019.stdout:000000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:24.599 INFO:teuthology.orchestra.run.smithi019.stdout:* 2024-09-12T02:02:24.599 INFO:teuthology.orchestra.run.smithi019.stdout:00000110 00 00 |..| 2024-09-12T02:02:24.599 INFO:teuthology.orchestra.run.smithi019.stdout:00000112 2024-09-12T02:02:24.599 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:24.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.589+0000 7f61a0522f40 1 -- 172.21.15.19:0/893409979 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5605c8d89b80 msgr2=0x5605c8d86e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.589+0000 7f61a0522f40 1 --2- 172.21.15.19:0/893409979 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5605c8d89b80 0x5605c8d86e10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.589+0000 7f61a0522f40 1 -- 172.21.15.19:0/893409979 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f618006a840 msgr2=0x7f618006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.589+0000 7f61a0522f40 1 --2- 172.21.15.19:0/893409979 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f618006a840 0x7f618006cd00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6190054000 tx=0x7f6190050000 comp rx=0 tx=0).stop 2024-09-12T02:02:24.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.589+0000 7f61a0522f40 1 -- 172.21.15.19:0/893409979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f618c0022a0 msgr2=0x5605c8d89640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.589+0000 7f61a0522f40 1 --2- 172.21.15.19:0/893409979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f618c0022a0 0x5605c8d89640 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x5605c8cbe630 tx=0x7f6198001dc0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.589+0000 7f619e81b640 1 -- 172.21.15.19:0/893409979 reap_dead start 2024-09-12T02:02:24.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.589+0000 7f61a0522f40 1 -- 172.21.15.19:0/893409979 shutdown_connections 2024-09-12T02:02:24.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.589+0000 7f61a0522f40 1 -- 172.21.15.19:0/893409979 >> 172.21.15.19:0/893409979 conn(0x5605c8ce8490 msgr2=0x5605c8d02f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:24.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.589+0000 7f61a0522f40 1 -- 172.21.15.19:0/893409979 shutdown_connections 2024-09-12T02:02:24.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.589+0000 7f61a0522f40 1 -- 172.21.15.19:0/893409979 wait complete. 2024-09-12T02:02:24.602 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 1.00000000.inode 2024-09-12T02:02:24.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.686+0000 7fa404468f40 1 Processor -- start 2024-09-12T02:02:24.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.686+0000 7fa404468f40 1 -- start start 2024-09-12T02:02:24.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa404468f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec0022a0 0x55b567a9b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa404468f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b567a9bd50 0x55b567a11d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa404468f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b567a122b0 0x55b567a9e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa404468f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b5679e1ae0 con 0x55b567a9bd50 2024-09-12T02:02:24.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa404468f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b567934510 con 0x7fa3ec0022a0 2024-09-12T02:02:24.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa404468f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55b5679e1dc0 con 0x55b567a122b0 2024-09-12T02:02:24.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa40175f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b567a9bd50 0x55b567a11d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa40175f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b567a9bd50 0x55b567a11d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50824/0 (socket says 172.21.15.19:50824) 2024-09-12T02:02:24.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa40175f640 1 -- 172.21.15.19:0/4139855214 learned_addr learned my addr 172.21.15.19:0/4139855214 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:24.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa401f60640 1 --2- 172.21.15.19:0/4139855214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec0022a0 0x55b567a9b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa402761640 1 --2- 172.21.15.19:0/4139855214 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b567a122b0 0x55b567a9e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa40175f640 1 -- 172.21.15.19:0/4139855214 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b567a122b0 msgr2=0x55b567a9e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:24.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa40175f640 1 --2- 172.21.15.19:0/4139855214 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b567a122b0 0x55b567a9e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa40175f640 1 -- 172.21.15.19:0/4139855214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec0022a0 msgr2=0x55b567a9b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:24.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa40175f640 1 --2- 172.21.15.19:0/4139855214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec0022a0 0x55b567a9b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa40175f640 1 -- 172.21.15.19:0/4139855214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b567a0ef30 con 0x55b567a9bd50 2024-09-12T02:02:24.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa40175f640 1 --2- 172.21.15.19:0/4139855214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b567a9bd50 0x55b567a11d70 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80098e0 tx=0x7fa3f8005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbb40982032287d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa3f3fff640 1 -- 172.21.15.19:0/4139855214 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8019030 con 0x55b567a9bd50 2024-09-12T02:02:24.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa3f3fff640 1 -- 172.21.15.19:0/4139855214 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3f8015680 con 0x55b567a9bd50 2024-09-12T02:02:24.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.687+0000 7fa3f3fff640 1 -- 172.21.15.19:0/4139855214 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8015a50 con 0x55b567a9bd50 2024-09-12T02:02:24.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.688+0000 7fa404468f40 1 -- 172.21.15.19:0/4139855214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b567a9bd50 msgr2=0x55b567a11d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.688+0000 7fa404468f40 1 --2- 172.21.15.19:0/4139855214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b567a9bd50 0x55b567a11d70 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80098e0 tx=0x7fa3f8005a00 comp rx=0 tx=0).stop 2024-09-12T02:02:24.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.688+0000 7fa404468f40 1 -- 172.21.15.19:0/4139855214 shutdown_connections 2024-09-12T02:02:24.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.688+0000 7fa404468f40 1 --2- 172.21.15.19:0/4139855214 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b567a122b0 0x55b567a9e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.688+0000 7fa404468f40 1 --2- 172.21.15.19:0/4139855214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b567a9bd50 0x55b567a11d70 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.688+0000 7fa404468f40 1 --2- 172.21.15.19:0/4139855214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec0022a0 0x55b567a9b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.688+0000 7fa404468f40 1 -- 172.21.15.19:0/4139855214 >> 172.21.15.19:0/4139855214 conn(0x55b5679e29e0 msgr2=0x55b567a29250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:24.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.688+0000 7fa404468f40 1 -- 172.21.15.19:0/4139855214 shutdown_connections 2024-09-12T02:02:24.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.688+0000 7fa404468f40 1 -- 172.21.15.19:0/4139855214 wait complete. 2024-09-12T02:02:24.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.688+0000 7fa404468f40 1 Processor -- start 2024-09-12T02:02:24.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.688+0000 7fa404468f40 1 -- start start 2024-09-12T02:02:24.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.689+0000 7fa404468f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b567a122b0 0x55b567a95ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.689+0000 7fa404468f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b567a9bd50 0x55b567ab60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.689+0000 7fa404468f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec0022a0 0x55b567a8f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.689+0000 7fa404468f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b567a9b930 con 0x55b567a122b0 2024-09-12T02:02:24.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.689+0000 7fa404468f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b567a0f210 con 0x7fa3ec0022a0 2024-09-12T02:02:24.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.689+0000 7fa404468f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55b567a2c880 con 0x55b567a9bd50 2024-09-12T02:02:24.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.689+0000 7fa401f60640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b567a122b0 0x55b567a95ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.689+0000 7fa401f60640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b567a122b0 0x55b567a95ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50826/0 (socket says 172.21.15.19:50826) 2024-09-12T02:02:24.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.689+0000 7fa401f60640 1 -- 172.21.15.19:0/1654455023 learned_addr learned my addr 172.21.15.19:0/1654455023 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:24.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.689+0000 7fa402761640 1 --2- 172.21.15.19:0/1654455023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec0022a0 0x55b567a8f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.689+0000 7fa40175f640 1 --2- 172.21.15.19:0/1654455023 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b567a9bd50 0x55b567ab60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.690+0000 7fa401f60640 1 -- 172.21.15.19:0/1654455023 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b567a9bd50 msgr2=0x55b567ab60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.690+0000 7fa401f60640 1 --2- 172.21.15.19:0/1654455023 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b567a9bd50 0x55b567ab60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.690+0000 7fa401f60640 1 -- 172.21.15.19:0/1654455023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec0022a0 msgr2=0x55b567a8f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.690+0000 7fa401f60640 1 --2- 172.21.15.19:0/1654455023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec0022a0 0x55b567a8f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.690+0000 7fa401f60640 1 -- 172.21.15.19:0/1654455023 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b567a27cf0 con 0x55b567a122b0 2024-09-12T02:02:24.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.690+0000 7fa401f60640 1 --2- 172.21.15.19:0/1654455023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b567a122b0 0x55b567a95ab0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4059040 tx=0x7fa3f40033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.690+0000 7fa3f2ffd640 1 -- 172.21.15.19:0/1654455023 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4065070 con 0x55b567a122b0 2024-09-12T02:02:24.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.690+0000 7fa404468f40 1 -- 172.21.15.19:0/1654455023 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b567aa3240 con 0x55b567a122b0 2024-09-12T02:02:24.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.690+0000 7fa404468f40 1 -- 172.21.15.19:0/1654455023 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b567ab65f0 con 0x55b567a122b0 2024-09-12T02:02:24.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.690+0000 7fa3f2ffd640 1 -- 172.21.15.19:0/1654455023 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3f404d910 con 0x55b567a122b0 2024-09-12T02:02:24.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.690+0000 7fa3f2ffd640 1 -- 172.21.15.19:0/1654455023 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f406f060 con 0x55b567a122b0 2024-09-12T02:02:24.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.692+0000 7fa3f2ffd640 1 -- 172.21.15.19:0/1654455023 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa3f4068070 con 0x55b567a122b0 2024-09-12T02:02:24.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.692+0000 7fa3f2ffd640 1 --2- 172.21.15.19:0/1654455023 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa3e406a810 0x7fa3e406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.692+0000 7fa3f2ffd640 1 -- 172.21.15.19:0/1654455023 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7fa3f40cdd40 con 0x55b567a122b0 2024-09-12T02:02:24.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.692+0000 7fa40175f640 1 --2- 172.21.15.19:0/1654455023 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa3e406a810 0x7fa3e406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.692+0000 7fa404468f40 1 --2- 172.21.15.19:0/1654455023 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55b567abd3b0 0x55b567a92d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.692+0000 7fa404468f40 1 -- 172.21.15.19:0/1654455023 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:1 13.14 13:287034c4:::1.00000000.inode:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55b567a93290 con 0x55b567abd3b0 2024-09-12T02:02:24.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.692+0000 7fa402761640 1 --2- 172.21.15.19:0/1654455023 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55b567abd3b0 0x55b567a92d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.693+0000 7fa40175f640 1 --2- 172.21.15.19:0/1654455023 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa3e406a810 0x7fa3e406ccd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80098e0 tx=0x7fa3f8014000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.693+0000 7fa402761640 1 --2- 172.21.15.19:0/1654455023 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55b567abd3b0 0x55b567a92d50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.693+0000 7fa402761640 1 -- 172.21.15.19:0/1654455023 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(1 1.00000000.inode [omap-get-header] v0'0 uv16 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fa3fc009730 con 0x55b567abd3b0 2024-09-12T02:02:24.698 INFO:teuthology.orchestra.run.smithi019.stdout:header (0 bytes) : 2024-09-12T02:02:24.698 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:24.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.693+0000 7fa404468f40 1 -- 172.21.15.19:0/1654455023 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55b567abd3b0 msgr2=0x55b567a92d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.693+0000 7fa404468f40 1 --2- 172.21.15.19:0/1654455023 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55b567abd3b0 0x55b567a92d50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.693+0000 7fa404468f40 1 -- 172.21.15.19:0/1654455023 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa3e406a810 msgr2=0x7fa3e406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.693+0000 7fa404468f40 1 --2- 172.21.15.19:0/1654455023 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa3e406a810 0x7fa3e406ccd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80098e0 tx=0x7fa3f8014000 comp rx=0 tx=0).stop 2024-09-12T02:02:24.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.693+0000 7fa404468f40 1 -- 172.21.15.19:0/1654455023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b567a122b0 msgr2=0x55b567a95ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.693+0000 7fa404468f40 1 --2- 172.21.15.19:0/1654455023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b567a122b0 0x55b567a95ab0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4059040 tx=0x7fa3f40033a0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.693+0000 7fa402761640 1 -- 172.21.15.19:0/1654455023 reap_dead start 2024-09-12T02:02:24.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.693+0000 7fa404468f40 1 -- 172.21.15.19:0/1654455023 shutdown_connections 2024-09-12T02:02:24.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.693+0000 7fa404468f40 1 -- 172.21.15.19:0/1654455023 >> 172.21.15.19:0/1654455023 conn(0x55b5679e29e0 msgr2=0x55b567a26ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:24.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.693+0000 7fa404468f40 1 -- 172.21.15.19:0/1654455023 shutdown_connections 2024-09-12T02:02:24.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.693+0000 7fa404468f40 1 -- 172.21.15.19:0/1654455023 wait complete. 2024-09-12T02:02:24.700 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 200.00000000 2024-09-12T02:02:24.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.743+0000 7f474905bf40 1 Processor -- start 2024-09-12T02:02:24.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.743+0000 7f474905bf40 1 -- start start 2024-09-12T02:02:24.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.744+0000 7f474905bf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ed7745180 0x556ed7819c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.744+0000 7f474905bf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556ed7773050 0x556ed77f8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.744+0000 7f474905bf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ed77fd080 0x556ed7740e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.744+0000 7f474905bf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556ed7741ae0 con 0x556ed7745180 2024-09-12T02:02:24.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.744+0000 7f474905bf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556ed7694510 con 0x556ed77fd080 2024-09-12T02:02:24.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.744+0000 7f474905bf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556ed7741dc0 con 0x556ed7773050 2024-09-12T02:02:24.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.744+0000 7f4746b51640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ed7745180 0x556ed7819c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.744+0000 7f4746b51640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ed7745180 0x556ed7819c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50828/0 (socket says 172.21.15.19:50828) 2024-09-12T02:02:24.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.744+0000 7f4746b51640 1 -- 172.21.15.19:0/537521554 learned_addr learned my addr 172.21.15.19:0/537521554 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:24.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.744+0000 7f4746350640 1 --2- 172.21.15.19:0/537521554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556ed7773050 0x556ed77f8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.744+0000 7f4747352640 1 --2- 172.21.15.19:0/537521554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ed77fd080 0x556ed7740e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.744+0000 7f4746b51640 1 -- 172.21.15.19:0/537521554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556ed7773050 msgr2=0x556ed77f8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:24.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.744+0000 7f4746b51640 1 --2- 172.21.15.19:0/537521554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556ed7773050 0x556ed77f8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.744+0000 7f4746b51640 1 -- 172.21.15.19:0/537521554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ed77fd080 msgr2=0x556ed7740e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:24.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.744+0000 7f4746b51640 1 --2- 172.21.15.19:0/537521554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ed77fd080 0x556ed7740e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.744+0000 7f4746b51640 1 -- 172.21.15.19:0/537521554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ed781ced0 con 0x556ed7745180 2024-09-12T02:02:24.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.744+0000 7f4747352640 1 --2- 172.21.15.19:0/537521554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ed77fd080 0x556ed7740e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:24.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.745+0000 7f4746b51640 1 --2- 172.21.15.19:0/537521554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ed7745180 0x556ed7819c00 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f47380259b0 tx=0x7f4738051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1155983a4fa443d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.745+0000 7f474534e640 1 -- 172.21.15.19:0/537521554 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738067070 con 0x556ed7745180 2024-09-12T02:02:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.745+0000 7f474534e640 1 -- 172.21.15.19:0/537521554 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4738058b50 con 0x556ed7745180 2024-09-12T02:02:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.745+0000 7f474534e640 1 -- 172.21.15.19:0/537521554 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47380623f0 con 0x556ed7745180 2024-09-12T02:02:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.745+0000 7f474905bf40 1 -- 172.21.15.19:0/537521554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ed7745180 msgr2=0x556ed7819c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.745+0000 7f474905bf40 1 --2- 172.21.15.19:0/537521554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ed7745180 0x556ed7819c00 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f47380259b0 tx=0x7f4738051000 comp rx=0 tx=0).stop 2024-09-12T02:02:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.745+0000 7f474905bf40 1 -- 172.21.15.19:0/537521554 shutdown_connections 2024-09-12T02:02:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.745+0000 7f474905bf40 1 --2- 172.21.15.19:0/537521554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ed77fd080 0x556ed7740e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.745+0000 7f474905bf40 1 --2- 172.21.15.19:0/537521554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556ed7773050 0x556ed77f8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.745+0000 7f474905bf40 1 --2- 172.21.15.19:0/537521554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ed7745180 0x556ed7819c00 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.745+0000 7f474905bf40 1 -- 172.21.15.19:0/537521554 >> 172.21.15.19:0/537521554 conn(0x556ed77429e0 msgr2=0x556ed77890e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.745+0000 7f474905bf40 1 -- 172.21.15.19:0/537521554 shutdown_connections 2024-09-12T02:02:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.745+0000 7f474905bf40 1 -- 172.21.15.19:0/537521554 wait complete. 2024-09-12T02:02:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.746+0000 7f474905bf40 1 Processor -- start 2024-09-12T02:02:24.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.746+0000 7f474905bf40 1 -- start start 2024-09-12T02:02:24.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f474905bf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ed7745180 0x556ed77f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f474905bf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556ed7773050 0x556ed77f9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f474905bf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ed77fd080 0x556ed77ff680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f474905bf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556ed77fc7f0 con 0x556ed7745180 2024-09-12T02:02:24.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f474905bf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556ed781b8a0 con 0x556ed77fd080 2024-09-12T02:02:24.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f474905bf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556ed781bb80 con 0x556ed7773050 2024-09-12T02:02:24.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f4746b51640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ed7745180 0x556ed77f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f4746b51640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ed7745180 0x556ed77f80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50842/0 (socket says 172.21.15.19:50842) 2024-09-12T02:02:24.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f4746b51640 1 -- 172.21.15.19:0/946807790 learned_addr learned my addr 172.21.15.19:0/946807790 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:24.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f4746350640 1 --2- 172.21.15.19:0/946807790 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556ed7773050 0x556ed77f9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f4747352640 1 --2- 172.21.15.19:0/946807790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ed77fd080 0x556ed77ff680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f4746b51640 1 -- 172.21.15.19:0/946807790 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556ed7773050 msgr2=0x556ed77f9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f4746b51640 1 --2- 172.21.15.19:0/946807790 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556ed7773050 0x556ed77f9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f4746b51640 1 -- 172.21.15.19:0/946807790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ed77fd080 msgr2=0x556ed77ff680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f4746b51640 1 --2- 172.21.15.19:0/946807790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ed77fd080 0x556ed77ff680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f4746b51640 1 -- 172.21.15.19:0/946807790 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ed7818f80 con 0x556ed7745180 2024-09-12T02:02:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f4746b51640 1 --2- 172.21.15.19:0/946807790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ed7745180 0x556ed77f80a0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f47380259b0 tx=0x7f4738003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f472ffff640 1 -- 172.21.15.19:0/946807790 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738070070 con 0x556ed7745180 2024-09-12T02:02:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f472ffff640 1 -- 172.21.15.19:0/946807790 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4738050dc0 con 0x556ed7745180 2024-09-12T02:02:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f472ffff640 1 -- 172.21.15.19:0/946807790 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738067040 con 0x556ed7745180 2024-09-12T02:02:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f474905bf40 1 -- 172.21.15.19:0/946807790 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ed77fd500 con 0x556ed7745180 2024-09-12T02:02:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.747+0000 7f474905bf40 1 -- 172.21.15.19:0/946807790 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ed77fdac0 con 0x556ed7745180 2024-09-12T02:02:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.749+0000 7f472ffff640 1 -- 172.21.15.19:0/946807790 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4738073070 con 0x556ed7745180 2024-09-12T02:02:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.749+0000 7f472ffff640 1 --2- 172.21.15.19:0/946807790 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f473406a810 0x7f473406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.749+0000 7f472ffff640 1 -- 172.21.15.19:0/946807790 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f47380ce9f0 con 0x556ed7745180 2024-09-12T02:02:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.749+0000 7f4746350640 1 --2- 172.21.15.19:0/946807790 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f473406a810 0x7f473406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.749+0000 7f474905bf40 1 --2- 172.21.15.19:0/946807790 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556ed77fa3c0 0x556ed77fe2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.749+0000 7f474905bf40 1 -- 172.21.15.19:0/946807790 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:1 13.14 13:292cf221:::200.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x556ed78191e0 con 0x556ed77fa3c0 2024-09-12T02:02:24.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.750+0000 7f4747352640 1 --2- 172.21.15.19:0/946807790 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556ed77fa3c0 0x556ed77fe2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.750+0000 7f4746350640 1 --2- 172.21.15.19:0/946807790 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f473406a810 0x7f473406ccd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x556ed7819950 tx=0x7f473c005a00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.750+0000 7f4747352640 1 --2- 172.21.15.19:0/946807790 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556ed77fa3c0 0x556ed77fe2c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.750+0000 7f4747352640 1 -- 172.21.15.19:0/946807790 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(1 200.00000000 [omap-get-header] v0'0 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f474000f690 con 0x556ed77fa3c0 2024-09-12T02:02:24.756 INFO:teuthology.orchestra.run.smithi019.stdout:header (0 bytes) : 2024-09-12T02:02:24.756 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.750+0000 7f474905bf40 1 -- 172.21.15.19:0/946807790 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556ed77fa3c0 msgr2=0x556ed77fe2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.750+0000 7f474905bf40 1 --2- 172.21.15.19:0/946807790 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556ed77fa3c0 0x556ed77fe2c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.750+0000 7f474905bf40 1 -- 172.21.15.19:0/946807790 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f473406a810 msgr2=0x7f473406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.750+0000 7f474905bf40 1 --2- 172.21.15.19:0/946807790 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f473406a810 0x7f473406ccd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x556ed7819950 tx=0x7f473c005a00 comp rx=0 tx=0).stop 2024-09-12T02:02:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.750+0000 7f474905bf40 1 -- 172.21.15.19:0/946807790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ed7745180 msgr2=0x556ed77f80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.750+0000 7f474905bf40 1 --2- 172.21.15.19:0/946807790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ed7745180 0x556ed77f80a0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f47380259b0 tx=0x7f4738003330 comp rx=0 tx=0).stop 2024-09-12T02:02:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.750+0000 7f4747352640 1 -- 172.21.15.19:0/946807790 reap_dead start 2024-09-12T02:02:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.750+0000 7f474905bf40 1 -- 172.21.15.19:0/946807790 shutdown_connections 2024-09-12T02:02:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.750+0000 7f474905bf40 1 -- 172.21.15.19:0/946807790 >> 172.21.15.19:0/946807790 conn(0x556ed77429e0 msgr2=0x556ed778c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:24.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.750+0000 7f474905bf40 1 -- 172.21.15.19:0/946807790 shutdown_connections 2024-09-12T02:02:24.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.750+0000 7f474905bf40 1 -- 172.21.15.19:0/946807790 wait complete. 2024-09-12T02:02:24.759 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 200.00000001 2024-09-12T02:02:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.841+0000 7fcea5929f40 1 Processor -- start 2024-09-12T02:02:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.841+0000 7fcea5929f40 1 -- start start 2024-09-12T02:02:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.842+0000 7fcea5929f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562205aa8f40 0x562205b4ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.842+0000 7fcea5929f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562205b57240 0x562205b49920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.842+0000 7fcea5929f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562205b46d70 0x562205a80c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.842+0000 7fcea5929f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5622059d0510 con 0x562205b57240 2024-09-12T02:02:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.842+0000 7fcea5929f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562205a29c50 con 0x562205aa8f40 2024-09-12T02:02:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.842+0000 7fcea5929f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562205ac64a0 con 0x562205b46d70 2024-09-12T02:02:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.842+0000 7fcea2c20640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562205b57240 0x562205b49920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.842+0000 7fcea2c20640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562205b57240 0x562205b49920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50854/0 (socket says 172.21.15.19:50854) 2024-09-12T02:02:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.842+0000 7fcea2c20640 1 -- 172.21.15.19:0/1933997612 learned_addr learned my addr 172.21.15.19:0/1933997612 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.842+0000 7fcea3421640 1 --2- 172.21.15.19:0/1933997612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562205aa8f40 0x562205b4ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.842+0000 7fcea3c22640 1 --2- 172.21.15.19:0/1933997612 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562205b46d70 0x562205a80c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.842+0000 7fcea2c20640 1 -- 172.21.15.19:0/1933997612 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562205b46d70 msgr2=0x562205a80c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:24.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.842+0000 7fcea2c20640 1 --2- 172.21.15.19:0/1933997612 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562205b46d70 0x562205a80c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.842+0000 7fcea2c20640 1 -- 172.21.15.19:0/1933997612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562205aa8f40 msgr2=0x562205b4ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:24.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.842+0000 7fcea2c20640 1 --2- 172.21.15.19:0/1933997612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562205aa8f40 0x562205b4ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.842+0000 7fcea2c20640 1 -- 172.21.15.19:0/1933997612 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562205b56290 con 0x562205b57240 2024-09-12T02:02:24.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.843+0000 7fcea2c20640 1 --2- 172.21.15.19:0/1933997612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562205b57240 0x562205b49920 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fce9800a500 tx=0x7fce9800a9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ea32433b6d308e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.843+0000 7fcea1c1e640 1 -- 172.21.15.19:0/1933997612 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce98008990 con 0x562205b57240 2024-09-12T02:02:24.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.843+0000 7fcea1c1e640 1 -- 172.21.15.19:0/1933997612 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce98008b30 con 0x562205b57240 2024-09-12T02:02:24.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.843+0000 7fcea1c1e640 1 -- 172.21.15.19:0/1933997612 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce98013440 con 0x562205b57240 2024-09-12T02:02:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.843+0000 7fcea5929f40 1 -- 172.21.15.19:0/1933997612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562205b57240 msgr2=0x562205b49920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.843+0000 7fcea5929f40 1 --2- 172.21.15.19:0/1933997612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562205b57240 0x562205b49920 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fce9800a500 tx=0x7fce9800a9c0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.843+0000 7fcea5929f40 1 -- 172.21.15.19:0/1933997612 shutdown_connections 2024-09-12T02:02:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.843+0000 7fcea5929f40 1 --2- 172.21.15.19:0/1933997612 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562205b46d70 0x562205a80c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.843+0000 7fcea5929f40 1 --2- 172.21.15.19:0/1933997612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562205b57240 0x562205b49920 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.843+0000 7fcea5929f40 1 --2- 172.21.15.19:0/1933997612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562205aa8f40 0x562205b4ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.843+0000 7fcea5929f40 1 -- 172.21.15.19:0/1933997612 >> 172.21.15.19:0/1933997612 conn(0x562205a7e9e0 msgr2=0x562205ac8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.843+0000 7fcea5929f40 1 -- 172.21.15.19:0/1933997612 shutdown_connections 2024-09-12T02:02:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.843+0000 7fcea5929f40 1 -- 172.21.15.19:0/1933997612 wait complete. 2024-09-12T02:02:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.844+0000 7fcea5929f40 1 Processor -- start 2024-09-12T02:02:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.844+0000 7fcea5929f40 1 -- start start 2024-09-12T02:02:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea5929f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562205aa8f40 0x562205b4dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea5929f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562205b46d70 0x562205b45c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea5929f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562205b57240 0x562205a7dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea5929f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562205b56550 con 0x562205b46d70 2024-09-12T02:02:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea5929f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562205b476e0 con 0x562205aa8f40 2024-09-12T02:02:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea5929f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562205b56830 con 0x562205b57240 2024-09-12T02:02:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea2c20640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562205b46d70 0x562205b45c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea2c20640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562205b46d70 0x562205b45c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50866/0 (socket says 172.21.15.19:50866) 2024-09-12T02:02:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea2c20640 1 -- 172.21.15.19:0/2493680237 learned_addr learned my addr 172.21.15.19:0/2493680237 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea3421640 1 --2- 172.21.15.19:0/2493680237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562205aa8f40 0x562205b4dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea3c22640 1 --2- 172.21.15.19:0/2493680237 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562205b57240 0x562205a7dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea2c20640 1 -- 172.21.15.19:0/2493680237 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562205b57240 msgr2=0x562205a7dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea2c20640 1 --2- 172.21.15.19:0/2493680237 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562205b57240 0x562205a7dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea2c20640 1 -- 172.21.15.19:0/2493680237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562205aa8f40 msgr2=0x562205b4dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea2c20640 1 --2- 172.21.15.19:0/2493680237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562205aa8f40 0x562205b4dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea2c20640 1 -- 172.21.15.19:0/2493680237 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562205ac3060 con 0x562205b46d70 2024-09-12T02:02:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea3c22640 1 --2- 172.21.15.19:0/2493680237 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562205b57240 0x562205a7dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea3421640 1 --2- 172.21.15.19:0/2493680237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562205aa8f40 0x562205b4dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea2c20640 1 --2- 172.21.15.19:0/2493680237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562205b46d70 0x562205b45c70 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fce9800aa00 tx=0x7fce98002fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea0c1c640 1 -- 172.21.15.19:0/2493680237 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce98020070 con 0x562205b46d70 2024-09-12T02:02:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea0c1c640 1 -- 172.21.15.19:0/2493680237 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce98013810 con 0x562205b46d70 2024-09-12T02:02:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea0c1c640 1 -- 172.21.15.19:0/2493680237 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce98013c00 con 0x562205b46d70 2024-09-12T02:02:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea5929f40 1 -- 172.21.15.19:0/2493680237 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562205ac3340 con 0x562205b46d70 2024-09-12T02:02:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.845+0000 7fcea5929f40 1 -- 172.21.15.19:0/2493680237 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562205b54120 con 0x562205b46d70 2024-09-12T02:02:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.847+0000 7fcea0c1c640 1 -- 172.21.15.19:0/2493680237 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce98023070 con 0x562205b46d70 2024-09-12T02:02:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.847+0000 7fcea0c1c640 1 --2- 172.21.15.19:0/2493680237 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce9006a810 0x7fce9006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.847+0000 7fcea0c1c640 1 -- 172.21.15.19:0/2493680237 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7fce9808b1f0 con 0x562205b46d70 2024-09-12T02:02:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.847+0000 7fcea3421640 1 --2- 172.21.15.19:0/2493680237 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce9006a810 0x7fce9006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.848+0000 7fcea5929f40 1 --2- 172.21.15.19:0/2493680237 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562205b46480 0x562205b54d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.848+0000 7fcea5929f40 1 -- 172.21.15.19:0/2493680237 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:1 13.14 13:2e2fa760:::200.00000001:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x562205b552a0 con 0x562205b46480 2024-09-12T02:02:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.848+0000 7fcea3c22640 1 --2- 172.21.15.19:0/2493680237 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562205b46480 0x562205b54d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.848+0000 7fcea3421640 1 --2- 172.21.15.19:0/2493680237 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce9006a810 0x7fce9006ccd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fce94057000 tx=0x7fce94052000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.848+0000 7fcea3c22640 1 --2- 172.21.15.19:0/2493680237 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562205b46480 0x562205b54d60 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.848+0000 7fcea3c22640 1 -- 172.21.15.19:0/2493680237 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(1 200.00000001 [omap-get-header] v0'0 uv17 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fce9c001630 con 0x562205b46480 2024-09-12T02:02:24.857 INFO:teuthology.orchestra.run.smithi019.stdout:header (0 bytes) : 2024-09-12T02:02:24.857 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.848+0000 7fcea5929f40 1 -- 172.21.15.19:0/2493680237 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562205b46480 msgr2=0x562205b54d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.848+0000 7fcea5929f40 1 --2- 172.21.15.19:0/2493680237 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562205b46480 0x562205b54d60 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.848+0000 7fcea5929f40 1 -- 172.21.15.19:0/2493680237 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce9006a810 msgr2=0x7fce9006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.848+0000 7fcea5929f40 1 --2- 172.21.15.19:0/2493680237 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce9006a810 0x7fce9006ccd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fce94057000 tx=0x7fce94052000 comp rx=0 tx=0).stop 2024-09-12T02:02:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.848+0000 7fcea5929f40 1 -- 172.21.15.19:0/2493680237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562205b46d70 msgr2=0x562205b45c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.848+0000 7fcea5929f40 1 --2- 172.21.15.19:0/2493680237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562205b46d70 0x562205b45c70 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fce9800aa00 tx=0x7fce98002fd0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.848+0000 7fcea3c22640 1 -- 172.21.15.19:0/2493680237 reap_dead start 2024-09-12T02:02:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.849+0000 7fcea5929f40 1 -- 172.21.15.19:0/2493680237 shutdown_connections 2024-09-12T02:02:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.849+0000 7fcea5929f40 1 -- 172.21.15.19:0/2493680237 >> 172.21.15.19:0/2493680237 conn(0x562205a7e9e0 msgr2=0x562205a80c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.849+0000 7fcea5929f40 1 -- 172.21.15.19:0/2493680237 shutdown_connections 2024-09-12T02:02:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.849+0000 7fcea5929f40 1 -- 172.21.15.19:0/2493680237 wait complete. 2024-09-12T02:02:24.860 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader mds0_openfiles.0 2024-09-12T02:02:24.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.942+0000 7eff42ddcf40 1 Processor -- start 2024-09-12T02:02:24.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.942+0000 7eff42ddcf40 1 -- start start 2024-09-12T02:02:24.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.943+0000 7eff42ddcf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563dd52baa10 0x563dd5342ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.943+0000 7eff42ddcf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563dd534a130 0x563dd534a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.943+0000 7eff42ddcf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563dd5270e10 0x563dd529e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.943+0000 7eff42ddcf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563dd52753b0 con 0x563dd534a130 2024-09-12T02:02:24.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.943+0000 7eff42ddcf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563dd51c4510 con 0x563dd52baa10 2024-09-12T02:02:24.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.943+0000 7eff42ddcf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x563dd52a0750 con 0x563dd5270e10 2024-09-12T02:02:24.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.943+0000 7eff3bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563dd534a130 0x563dd534a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.943+0000 7eff3bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563dd534a130 0x563dd534a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50888/0 (socket says 172.21.15.19:50888) 2024-09-12T02:02:24.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.943+0000 7eff3bfff640 1 -- 172.21.15.19:0/1746487294 learned_addr learned my addr 172.21.15.19:0/1746487294 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:24.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.943+0000 7eff410d3640 1 --2- 172.21.15.19:0/1746487294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563dd5270e10 0x563dd529e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.943+0000 7eff408d2640 1 --2- 172.21.15.19:0/1746487294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563dd52baa10 0x563dd5342ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.943+0000 7eff3bfff640 1 -- 172.21.15.19:0/1746487294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563dd5270e10 msgr2=0x563dd529e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:24.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.943+0000 7eff3bfff640 1 --2- 172.21.15.19:0/1746487294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563dd5270e10 0x563dd529e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.943+0000 7eff3bfff640 1 -- 172.21.15.19:0/1746487294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563dd52baa10 msgr2=0x563dd5342ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:24.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.943+0000 7eff3bfff640 1 --2- 172.21.15.19:0/1746487294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563dd52baa10 0x563dd5342ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.943+0000 7eff3bfff640 1 -- 172.21.15.19:0/1746487294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dd5343660 con 0x563dd534a130 2024-09-12T02:02:24.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.943+0000 7eff3bfff640 1 --2- 172.21.15.19:0/1746487294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563dd534a130 0x563dd534a6c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7eff2c045b60 tx=0x7eff2c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6bb8dbc2bc6059 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.944+0000 7eff3affd640 1 -- 172.21.15.19:0/1746487294 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c055070 con 0x563dd534a130 2024-09-12T02:02:24.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.944+0000 7eff3affd640 1 -- 172.21.15.19:0/1746487294 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff2c051730 con 0x563dd534a130 2024-09-12T02:02:24.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.944+0000 7eff3affd640 1 -- 172.21.15.19:0/1746487294 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c051ae0 con 0x563dd534a130 2024-09-12T02:02:24.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.944+0000 7eff42ddcf40 1 -- 172.21.15.19:0/1746487294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563dd534a130 msgr2=0x563dd534a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.944+0000 7eff42ddcf40 1 --2- 172.21.15.19:0/1746487294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563dd534a130 0x563dd534a6c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7eff2c045b60 tx=0x7eff2c051000 comp rx=0 tx=0).stop 2024-09-12T02:02:24.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.944+0000 7eff42ddcf40 1 -- 172.21.15.19:0/1746487294 shutdown_connections 2024-09-12T02:02:24.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.944+0000 7eff42ddcf40 1 --2- 172.21.15.19:0/1746487294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563dd5270e10 0x563dd529e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.944+0000 7eff42ddcf40 1 --2- 172.21.15.19:0/1746487294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563dd534a130 0x563dd534a6c0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.944+0000 7eff42ddcf40 1 --2- 172.21.15.19:0/1746487294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563dd52baa10 0x563dd5342ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.944+0000 7eff42ddcf40 1 -- 172.21.15.19:0/1746487294 >> 172.21.15.19:0/1746487294 conn(0x563dd52729e0 msgr2=0x563dd529da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:24.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.944+0000 7eff42ddcf40 1 -- 172.21.15.19:0/1746487294 shutdown_connections 2024-09-12T02:02:24.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.944+0000 7eff42ddcf40 1 -- 172.21.15.19:0/1746487294 wait complete. 2024-09-12T02:02:24.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.945+0000 7eff42ddcf40 1 Processor -- start 2024-09-12T02:02:24.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.945+0000 7eff42ddcf40 1 -- start start 2024-09-12T02:02:24.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.945+0000 7eff42ddcf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563dd52baa10 0x563dd533cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.945+0000 7eff42ddcf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563dd534a130 0x563dd533bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.945+0000 7eff42ddcf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563dd533faa0 0x563dd529e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.945+0000 7eff42ddcf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563dd52a3280 con 0x563dd52baa10 2024-09-12T02:02:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.945+0000 7eff42ddcf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563dd5343400 con 0x563dd534a130 2024-09-12T02:02:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.945+0000 7eff42ddcf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x563dd52a3560 con 0x563dd533faa0 2024-09-12T02:02:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.945+0000 7eff408d2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563dd52baa10 0x563dd533cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.946+0000 7eff408d2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563dd52baa10 0x563dd533cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50890/0 (socket says 172.21.15.19:50890) 2024-09-12T02:02:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.946+0000 7eff408d2640 1 -- 172.21.15.19:0/1437810172 learned_addr learned my addr 172.21.15.19:0/1437810172 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.946+0000 7eff410d3640 1 --2- 172.21.15.19:0/1437810172 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563dd533faa0 0x563dd529e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.946+0000 7eff3bfff640 1 --2- 172.21.15.19:0/1437810172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563dd534a130 0x563dd533bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.946+0000 7eff408d2640 1 -- 172.21.15.19:0/1437810172 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563dd533faa0 msgr2=0x563dd529e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.946+0000 7eff408d2640 1 --2- 172.21.15.19:0/1437810172 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563dd533faa0 0x563dd529e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.946+0000 7eff408d2640 1 -- 172.21.15.19:0/1437810172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563dd534a130 msgr2=0x563dd533bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.946+0000 7eff408d2640 1 --2- 172.21.15.19:0/1437810172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563dd534a130 0x563dd533bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.946+0000 7eff408d2640 1 -- 172.21.15.19:0/1437810172 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dd533c990 con 0x563dd52baa10 2024-09-12T02:02:24.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.946+0000 7eff408d2640 1 --2- 172.21.15.19:0/1437810172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563dd52baa10 0x563dd533cc70 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7eff340086b0 tx=0x7eff340087a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.946+0000 7eff39ffb640 1 -- 172.21.15.19:0/1437810172 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff34019020 con 0x563dd52baa10 2024-09-12T02:02:24.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.946+0000 7eff39ffb640 1 -- 172.21.15.19:0/1437810172 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff34015880 con 0x563dd52baa10 2024-09-12T02:02:24.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.946+0000 7eff42ddcf40 1 -- 172.21.15.19:0/1437810172 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563dd5347ae0 con 0x563dd52baa10 2024-09-12T02:02:24.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.946+0000 7eff39ffb640 1 -- 172.21.15.19:0/1437810172 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff34015c50 con 0x563dd52baa10 2024-09-12T02:02:24.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.946+0000 7eff42ddcf40 1 -- 172.21.15.19:0/1437810172 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dd52bd300 con 0x563dd52baa10 2024-09-12T02:02:24.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.948+0000 7eff39ffb640 1 -- 172.21.15.19:0/1437810172 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff3401c020 con 0x563dd52baa10 2024-09-12T02:02:24.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.948+0000 7eff39ffb640 1 --2- 172.21.15.19:0/1437810172 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7eff2406a810 0x7eff2406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.948+0000 7eff39ffb640 1 -- 172.21.15.19:0/1437810172 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7eff3408a4c0 con 0x563dd52baa10 2024-09-12T02:02:24.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.948+0000 7eff3bfff640 1 --2- 172.21.15.19:0/1437810172 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7eff2406a810 0x7eff2406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.948+0000 7eff42ddcf40 1 --2- 172.21.15.19:0/1437810172 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x563dd5341650 0x563dd5341a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:24.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.948+0000 7eff42ddcf40 1 -- 172.21.15.19:0/1437810172 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:1 13.6 13:654134d2:::mds0_openfiles.0:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x563dd533c500 con 0x563dd5341650 2024-09-12T02:02:24.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.949+0000 7eff410d3640 1 --2- 172.21.15.19:0/1437810172 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x563dd5341650 0x563dd5341a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:24.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.949+0000 7eff3bfff640 1 --2- 172.21.15.19:0/1437810172 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7eff2406a810 0x7eff2406ccd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7eff2c063000 tx=0x7eff2c053000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.949+0000 7eff410d3640 1 --2- 172.21.15.19:0/1437810172 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x563dd5341650 0x563dd5341a30 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:24.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.949+0000 7eff410d3640 1 -- 172.21.15.19:0/1437810172 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(1 mds0_openfiles.0 [omap-get-header out=42b] v0'0 uv2 ondisk = 0) ==== 160+0+42 (crc 0 0 0) 0x7eff3c006140 con 0x563dd5341650 2024-09-12T02:02:24.958 INFO:teuthology.orchestra.run.smithi019.stdout:header (42 bytes) : 2024-09-12T02:02:24.958 INFO:teuthology.orchestra.run.smithi019.stdout:00000000 13 00 00 00 63 65 70 68 20 66 73 20 76 6f 6c 75 |....ceph fs volu| 2024-09-12T02:02:24.958 INFO:teuthology.orchestra.run.smithi019.stdout:00000010 6d 65 20 76 30 31 31 01 01 0d 00 00 00 02 00 00 |me v011.........| 2024-09-12T02:02:24.958 INFO:teuthology.orchestra.run.smithi019.stdout:00000020 00 00 00 00 00 01 00 00 00 00 |..........| 2024-09-12T02:02:24.958 INFO:teuthology.orchestra.run.smithi019.stdout:0000002a 2024-09-12T02:02:24.958 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:24.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.949+0000 7eff42ddcf40 1 -- 172.21.15.19:0/1437810172 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x563dd5341650 msgr2=0x563dd5341a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.949+0000 7eff42ddcf40 1 --2- 172.21.15.19:0/1437810172 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x563dd5341650 0x563dd5341a30 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.949+0000 7eff42ddcf40 1 -- 172.21.15.19:0/1437810172 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7eff2406a810 msgr2=0x7eff2406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.949+0000 7eff42ddcf40 1 --2- 172.21.15.19:0/1437810172 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7eff2406a810 0x7eff2406ccd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7eff2c063000 tx=0x7eff2c053000 comp rx=0 tx=0).stop 2024-09-12T02:02:24.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.949+0000 7eff42ddcf40 1 -- 172.21.15.19:0/1437810172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563dd52baa10 msgr2=0x563dd533cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:24.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.949+0000 7eff42ddcf40 1 --2- 172.21.15.19:0/1437810172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563dd52baa10 0x563dd533cc70 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7eff340086b0 tx=0x7eff340087a0 comp rx=0 tx=0).stop 2024-09-12T02:02:24.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.949+0000 7eff410d3640 1 -- 172.21.15.19:0/1437810172 reap_dead start 2024-09-12T02:02:24.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.949+0000 7eff42ddcf40 1 -- 172.21.15.19:0/1437810172 shutdown_connections 2024-09-12T02:02:24.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.949+0000 7eff42ddcf40 1 -- 172.21.15.19:0/1437810172 >> 172.21.15.19:0/1437810172 conn(0x563dd52729e0 msgr2=0x563dd52b9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:24.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.950+0000 7eff42ddcf40 1 -- 172.21.15.19:0/1437810172 shutdown_connections 2024-09-12T02:02:24.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:24.950+0000 7eff42ddcf40 1 -- 172.21.15.19:0/1437810172 wait complete. 2024-09-12T02:02:24.961 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 500.00000000 2024-09-12T02:02:25.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.044+0000 7f84bbf96f40 1 Processor -- start 2024-09-12T02:02:25.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.044+0000 7f84bbf96f40 1 -- start start 2024-09-12T02:02:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.045+0000 7f84bbf96f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e35ccdff40 0x55e35cd7e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.045+0000 7f84bbf96f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e35ccfca80 0x55e35cd87fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.045+0000 7f84bbf96f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e35cd8e240 0x55e35cce1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.045+0000 7f84bbf96f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e35cc07510 con 0x55e35cd8e240 2024-09-12T02:02:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.045+0000 7f84bbf96f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e35cc60c50 con 0x55e35ccdff40 2024-09-12T02:02:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.045+0000 7f84bbf96f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55e35ccfd1c0 con 0x55e35ccfca80 2024-09-12T02:02:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.045+0000 7f84ba28d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e35cd8e240 0x55e35cce1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.045+0000 7f84ba28d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e35cd8e240 0x55e35cce1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50904/0 (socket says 172.21.15.19:50904) 2024-09-12T02:02:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.045+0000 7f84ba28d640 1 -- 172.21.15.19:0/2073164139 learned_addr learned my addr 172.21.15.19:0/2073164139 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.045+0000 7f84b9a8c640 1 --2- 172.21.15.19:0/2073164139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e35ccdff40 0x55e35cd7e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.045+0000 7f84b928b640 1 --2- 172.21.15.19:0/2073164139 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e35ccfca80 0x55e35cd87fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.046+0000 7f84ba28d640 1 -- 172.21.15.19:0/2073164139 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e35ccfca80 msgr2=0x55e35cd87fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.046+0000 7f84ba28d640 1 --2- 172.21.15.19:0/2073164139 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e35ccfca80 0x55e35cd87fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.046+0000 7f84ba28d640 1 -- 172.21.15.19:0/2073164139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e35ccdff40 msgr2=0x55e35cd7e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.046+0000 7f84ba28d640 1 --2- 172.21.15.19:0/2073164139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e35ccdff40 0x55e35cd7e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.046+0000 7f84ba28d640 1 -- 172.21.15.19:0/2073164139 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e35cd7e940 con 0x55e35cd8e240 2024-09-12T02:02:25.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.046+0000 7f84b9a8c640 1 --2- 172.21.15.19:0/2073164139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e35ccdff40 0x55e35cd7e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:25.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.046+0000 7f84ba28d640 1 --2- 172.21.15.19:0/2073164139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e35cd8e240 0x55e35cce1930 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f84b400a470 tx=0x7f84b4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09ac9d02206780e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.046+0000 7f84abfff640 1 -- 172.21.15.19:0/2073164139 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b4054620 con 0x55e35cd8e240 2024-09-12T02:02:25.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.046+0000 7f84abfff640 1 -- 172.21.15.19:0/2073164139 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b4054970 con 0x55e35cd8e240 2024-09-12T02:02:25.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.046+0000 7f84abfff640 1 -- 172.21.15.19:0/2073164139 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b4054d20 con 0x55e35cd8e240 2024-09-12T02:02:25.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.046+0000 7f84bbf96f40 1 -- 172.21.15.19:0/2073164139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e35cd8e240 msgr2=0x55e35cce1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.046+0000 7f84bbf96f40 1 --2- 172.21.15.19:0/2073164139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e35cd8e240 0x55e35cce1930 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f84b400a470 tx=0x7f84b4051000 comp rx=0 tx=0).stop 2024-09-12T02:02:25.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.046+0000 7f84bbf96f40 1 -- 172.21.15.19:0/2073164139 shutdown_connections 2024-09-12T02:02:25.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.046+0000 7f84bbf96f40 1 --2- 172.21.15.19:0/2073164139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e35cd8e240 0x55e35cce1930 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.046+0000 7f84bbf96f40 1 --2- 172.21.15.19:0/2073164139 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e35ccfca80 0x55e35cd87fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.046+0000 7f84bbf96f40 1 --2- 172.21.15.19:0/2073164139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e35ccdff40 0x55e35cd7e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.046+0000 7f84bbf96f40 1 -- 172.21.15.19:0/2073164139 >> 172.21.15.19:0/2073164139 conn(0x55e35ccb59e0 msgr2=0x55e35cd8d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.047+0000 7f84bbf96f40 1 -- 172.21.15.19:0/2073164139 shutdown_connections 2024-09-12T02:02:25.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.047+0000 7f84bbf96f40 1 -- 172.21.15.19:0/2073164139 wait complete. 2024-09-12T02:02:25.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.047+0000 7f84bbf96f40 1 Processor -- start 2024-09-12T02:02:25.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.047+0000 7f84bbf96f40 1 -- start start 2024-09-12T02:02:25.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.048+0000 7f84bbf96f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e35ccdff40 0x55e35cd7d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.048+0000 7f84bbf96f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e35ccfca80 0x55e35cd8cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.048+0000 7f84bbf96f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e35cd8e240 0x55e35cd8d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.048+0000 7f84bbf96f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e35ccb53b0 con 0x55e35cd8e240 2024-09-12T02:02:25.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.048+0000 7f84bbf96f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e35ccb6140 con 0x55e35ccfca80 2024-09-12T02:02:25.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.048+0000 7f84bbf96f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55e35cce0ed0 con 0x55e35ccdff40 2024-09-12T02:02:25.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.048+0000 7f84ba28d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e35cd8e240 0x55e35cd8d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.048+0000 7f84ba28d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e35cd8e240 0x55e35cd8d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50912/0 (socket says 172.21.15.19:50912) 2024-09-12T02:02:25.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.048+0000 7f84ba28d640 1 -- 172.21.15.19:0/1457393472 learned_addr learned my addr 172.21.15.19:0/1457393472 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.048+0000 7f84b9a8c640 1 --2- 172.21.15.19:0/1457393472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e35ccdff40 0x55e35cd7d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.048+0000 7f84b928b640 1 --2- 172.21.15.19:0/1457393472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e35ccfca80 0x55e35cd8cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.048+0000 7f84ba28d640 1 -- 172.21.15.19:0/1457393472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e35ccdff40 msgr2=0x55e35cd7d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.048+0000 7f84ba28d640 1 --2- 172.21.15.19:0/1457393472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e35ccdff40 0x55e35cd7d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.048+0000 7f84ba28d640 1 -- 172.21.15.19:0/1457393472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e35ccfca80 msgr2=0x55e35cd8cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.048+0000 7f84ba28d640 1 --2- 172.21.15.19:0/1457393472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e35ccfca80 0x55e35cd8cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.048+0000 7f84ba28d640 1 -- 172.21.15.19:0/1457393472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e35cd828e0 con 0x55e35cd8e240 2024-09-12T02:02:25.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.048+0000 7f84ba28d640 1 --2- 172.21.15.19:0/1457393472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e35cd8e240 0x55e35cd8d310 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f84b4061040 tx=0x7f84b4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.049+0000 7f84aaffd640 1 -- 172.21.15.19:0/1457393472 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b4054d20 con 0x55e35cd8e240 2024-09-12T02:02:25.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.049+0000 7f84aaffd640 1 -- 172.21.15.19:0/1457393472 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b40545e0 con 0x55e35cd8e240 2024-09-12T02:02:25.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.049+0000 7f84bbf96f40 1 -- 172.21.15.19:0/1457393472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e35cd82bc0 con 0x55e35cd8e240 2024-09-12T02:02:25.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.049+0000 7f84aaffd640 1 -- 172.21.15.19:0/1457393472 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b4074690 con 0x55e35cd8e240 2024-09-12T02:02:25.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.049+0000 7f84bbf96f40 1 -- 172.21.15.19:0/1457393472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e35cd852e0 con 0x55e35cd8e240 2024-09-12T02:02:25.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.050+0000 7f84aaffd640 1 -- 172.21.15.19:0/1457393472 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f84b4066020 con 0x55e35cd8e240 2024-09-12T02:02:25.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.050+0000 7f84aaffd640 1 --2- 172.21.15.19:0/1457393472 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f849c06a810 0x7f849c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.051+0000 7f84aaffd640 1 -- 172.21.15.19:0/1457393472 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f84b40cf270 con 0x55e35cd8e240 2024-09-12T02:02:25.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.051+0000 7f84b9a8c640 1 --2- 172.21.15.19:0/1457393472 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f849c06a810 0x7f849c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.051+0000 7f84bbf96f40 1 --2- 172.21.15.19:0/1457393472 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55e35ccb8100 0x55e35cd7eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.051+0000 7f84bbf96f40 1 -- 172.21.15.19:0/1457393472 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:1 13.15 13:aa448500:::500.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55e35cd7f070 con 0x55e35ccb8100 2024-09-12T02:02:25.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.051+0000 7f84b928b640 1 --2- 172.21.15.19:0/1457393472 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55e35ccb8100 0x55e35cd7eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.051+0000 7f84b9a8c640 1 --2- 172.21.15.19:0/1457393472 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f849c06a810 0x7f849c06ccd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f84ac000f80 tx=0x7f84ac0069e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.051+0000 7f84b928b640 1 --2- 172.21.15.19:0/1457393472 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55e35ccb8100 0x55e35cd7eb30 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.052+0000 7f84b928b640 1 -- 172.21.15.19:0/1457393472 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(1 500.00000000 [omap-get-header] v0'0 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f84b00116d0 con 0x55e35ccb8100 2024-09-12T02:02:25.058 INFO:teuthology.orchestra.run.smithi019.stdout:header (0 bytes) : 2024-09-12T02:02:25.058 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:25.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.052+0000 7f84bbf96f40 1 -- 172.21.15.19:0/1457393472 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55e35ccb8100 msgr2=0x55e35cd7eb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.052+0000 7f84bbf96f40 1 --2- 172.21.15.19:0/1457393472 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55e35ccb8100 0x55e35cd7eb30 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.052+0000 7f84bbf96f40 1 -- 172.21.15.19:0/1457393472 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f849c06a810 msgr2=0x7f849c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.052+0000 7f84bbf96f40 1 --2- 172.21.15.19:0/1457393472 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f849c06a810 0x7f849c06ccd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f84ac000f80 tx=0x7f84ac0069e0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.052+0000 7f84bbf96f40 1 -- 172.21.15.19:0/1457393472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e35cd8e240 msgr2=0x55e35cd8d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.052+0000 7f84bbf96f40 1 --2- 172.21.15.19:0/1457393472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e35cd8e240 0x55e35cd8d310 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f84b4061040 tx=0x7f84b4002fb0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.052+0000 7f84ba28d640 1 -- 172.21.15.19:0/1457393472 reap_dead start 2024-09-12T02:02:25.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.052+0000 7f84bbf96f40 1 -- 172.21.15.19:0/1457393472 shutdown_connections 2024-09-12T02:02:25.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.052+0000 7f84bbf96f40 1 -- 172.21.15.19:0/1457393472 >> 172.21.15.19:0/1457393472 conn(0x55e35ccb59e0 msgr2=0x55e35cd8afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.052+0000 7f84bbf96f40 1 -- 172.21.15.19:0/1457393472 shutdown_connections 2024-09-12T02:02:25.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.052+0000 7f84bbf96f40 1 -- 172.21.15.19:0/1457393472 wait complete. 2024-09-12T02:02:25.061 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader mds_snaptable 2024-09-12T02:02:25.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.143+0000 7f947dd65f40 1 Processor -- start 2024-09-12T02:02:25.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.143+0000 7f947dd65f40 1 -- start start 2024-09-12T02:02:25.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.144+0000 7f947dd65f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b98fa87a10 0x55b98fa6bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.144+0000 7f947dd65f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b98fb17130 0x55b98fb03180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.144+0000 7f947dd65f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b98fb0d110 0x55b98fb135e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.144+0000 7f947dd65f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b98fa6e660 con 0x55b98fa87a10 2024-09-12T02:02:25.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.144+0000 7f947dd65f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b98f991510 con 0x55b98fb17130 2024-09-12T02:02:25.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.144+0000 7f947dd65f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55b98fa420d0 con 0x55b98fb0d110 2024-09-12T02:02:25.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.144+0000 7f947b85b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b98fa87a10 0x55b98fa6bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.144+0000 7f947b85b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b98fa87a10 0x55b98fa6bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50930/0 (socket says 172.21.15.19:50930) 2024-09-12T02:02:25.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.144+0000 7f947b85b640 1 -- 172.21.15.19:0/1027706393 learned_addr learned my addr 172.21.15.19:0/1027706393 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.144+0000 7f947b85b640 1 -- 172.21.15.19:0/1027706393 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b98fb0d110 msgr2=0x55b98fb135e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.144+0000 7f947b85b640 1 --2- 172.21.15.19:0/1027706393 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b98fb0d110 0x55b98fb135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.144+0000 7f947b05a640 1 --2- 172.21.15.19:0/1027706393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b98fb17130 0x55b98fb03180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.144+0000 7f947b85b640 1 -- 172.21.15.19:0/1027706393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b98fb17130 msgr2=0x55b98fb03180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.144+0000 7f947b85b640 1 --2- 172.21.15.19:0/1027706393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b98fb17130 0x55b98fb03180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.144+0000 7f947b85b640 1 -- 172.21.15.19:0/1027706393 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b98fa3f1e0 con 0x55b98fa87a10 2024-09-12T02:02:25.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.145+0000 7f947b85b640 1 --2- 172.21.15.19:0/1027706393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b98fa87a10 0x55b98fa6bd00 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f947400a600 tx=0x7f9474053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d4597caf2e32bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.145+0000 7f947a058640 1 -- 172.21.15.19:0/1027706393 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474056070 con 0x55b98fa87a10 2024-09-12T02:02:25.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.145+0000 7f947a058640 1 -- 172.21.15.19:0/1027706393 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9474008590 con 0x55b98fa87a10 2024-09-12T02:02:25.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.145+0000 7f947a058640 1 -- 172.21.15.19:0/1027706393 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474008940 con 0x55b98fa87a10 2024-09-12T02:02:25.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.145+0000 7f947dd65f40 1 -- 172.21.15.19:0/1027706393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b98fa87a10 msgr2=0x55b98fa6bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.145+0000 7f947dd65f40 1 --2- 172.21.15.19:0/1027706393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b98fa87a10 0x55b98fa6bd00 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f947400a600 tx=0x7f9474053000 comp rx=0 tx=0).stop 2024-09-12T02:02:25.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.145+0000 7f947dd65f40 1 -- 172.21.15.19:0/1027706393 shutdown_connections 2024-09-12T02:02:25.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.145+0000 7f947dd65f40 1 --2- 172.21.15.19:0/1027706393 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b98fb0d110 0x55b98fb135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.145+0000 7f947dd65f40 1 --2- 172.21.15.19:0/1027706393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b98fb17130 0x55b98fb03180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.145+0000 7f947dd65f40 1 --2- 172.21.15.19:0/1027706393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b98fa87a10 0x55b98fa6bd00 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.145+0000 7f947dd65f40 1 -- 172.21.15.19:0/1027706393 >> 172.21.15.19:0/1027706393 conn(0x55b98fa3f9e0 msgr2=0x55b98fa6f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.145+0000 7f947dd65f40 1 -- 172.21.15.19:0/1027706393 shutdown_connections 2024-09-12T02:02:25.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.145+0000 7f947dd65f40 1 -- 172.21.15.19:0/1027706393 wait complete. 2024-09-12T02:02:25.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.146+0000 7f947dd65f40 1 Processor -- start 2024-09-12T02:02:25.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.146+0000 7f947dd65f40 1 -- start start 2024-09-12T02:02:25.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947dd65f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b98fa87a10 0x55b98fb16090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947dd65f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b98fb0d110 0x55b98fa6f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947dd65f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b98fb17130 0x55b98faf9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947dd65f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b98fa6ee40 con 0x55b98fa87a10 2024-09-12T02:02:25.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947dd65f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b98fb13130 con 0x55b98fb17130 2024-09-12T02:02:25.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947dd65f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55b98fb036c0 con 0x55b98fb0d110 2024-09-12T02:02:25.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947b85b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b98fa87a10 0x55b98fb16090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947b85b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b98fa87a10 0x55b98fb16090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50940/0 (socket says 172.21.15.19:50940) 2024-09-12T02:02:25.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947b85b640 1 -- 172.21.15.19:0/3592378648 learned_addr learned my addr 172.21.15.19:0/3592378648 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947c05c640 1 --2- 172.21.15.19:0/3592378648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b98fb17130 0x55b98faf9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947b05a640 1 --2- 172.21.15.19:0/3592378648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b98fb0d110 0x55b98fa6f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947b85b640 1 -- 172.21.15.19:0/3592378648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b98fb0d110 msgr2=0x55b98fa6f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947b85b640 1 --2- 172.21.15.19:0/3592378648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b98fb0d110 0x55b98fa6f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947b85b640 1 -- 172.21.15.19:0/3592378648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b98fb17130 msgr2=0x55b98faf9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947b85b640 1 --2- 172.21.15.19:0/3592378648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b98fb17130 0x55b98faf9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947b85b640 1 -- 172.21.15.19:0/3592378648 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b98fb0cdd0 con 0x55b98fa87a10 2024-09-12T02:02:25.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947c05c640 1 --2- 172.21.15.19:0/3592378648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b98fb17130 0x55b98faf9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:25.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947b85b640 1 --2- 172.21.15.19:0/3592378648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b98fa87a10 0x55b98fb16090 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f947400a600 tx=0x7f9474002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f9479056640 1 -- 172.21.15.19:0/3592378648 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474056040 con 0x55b98fa87a10 2024-09-12T02:02:25.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f9479056640 1 -- 172.21.15.19:0/3592378648 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f947405b450 con 0x55b98fa87a10 2024-09-12T02:02:25.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947dd65f40 1 -- 172.21.15.19:0/3592378648 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b98fb16720 con 0x55b98fa87a10 2024-09-12T02:02:25.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f9479056640 1 -- 172.21.15.19:0/3592378648 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947405b820 con 0x55b98fa87a10 2024-09-12T02:02:25.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.147+0000 7f947dd65f40 1 -- 172.21.15.19:0/3592378648 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b98fb0eb50 con 0x55b98fa87a10 2024-09-12T02:02:25.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.149+0000 7f9479056640 1 -- 172.21.15.19:0/3592378648 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9474059070 con 0x55b98fa87a10 2024-09-12T02:02:25.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.149+0000 7f9479056640 1 --2- 172.21.15.19:0/3592378648 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f945c06a840 0x7f945c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.149+0000 7f9479056640 1 -- 172.21.15.19:0/3592378648 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f94740d07e0 con 0x55b98fa87a10 2024-09-12T02:02:25.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.149+0000 7f947b05a640 1 --2- 172.21.15.19:0/3592378648 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f945c06a840 0x7f945c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.149+0000 7f947dd65f40 1 --2- 172.21.15.19:0/3592378648 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b98fa6fc70 0x55b98fbac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.149+0000 7f947dd65f40 1 -- 172.21.15.19:0/3592378648 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:1 13.d 13:b50e409b:::mds_snaptable:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55b98fbaced0 con 0x55b98fa6fc70 2024-09-12T02:02:25.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.150+0000 7f947c05c640 1 --2- 172.21.15.19:0/3592378648 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b98fa6fc70 0x55b98fbac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.150+0000 7f947b05a640 1 --2- 172.21.15.19:0/3592378648 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f945c06a840 0x7f945c06cd00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x55b98fb142e0 tx=0x7f9464001530 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.150+0000 7f947c05c640 1 --2- 172.21.15.19:0/3592378648 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b98fa6fc70 0x55b98fbac990 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.150+0000 7f947c05c640 1 -- 172.21.15.19:0/3592378648 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(1 mds_snaptable [omap-get-header] v0'0 uv1 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f946c00c720 con 0x55b98fa6fc70 2024-09-12T02:02:25.153 INFO:teuthology.orchestra.run.smithi019.stdout:header (0 bytes) : 2024-09-12T02:02:25.154 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:25.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.150+0000 7f947dd65f40 1 -- 172.21.15.19:0/3592378648 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b98fa6fc70 msgr2=0x55b98fbac990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.150+0000 7f947dd65f40 1 --2- 172.21.15.19:0/3592378648 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b98fa6fc70 0x55b98fbac990 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.150+0000 7f947dd65f40 1 -- 172.21.15.19:0/3592378648 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f945c06a840 msgr2=0x7f945c06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.150+0000 7f947dd65f40 1 --2- 172.21.15.19:0/3592378648 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f945c06a840 0x7f945c06cd00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x55b98fb142e0 tx=0x7f9464001530 comp rx=0 tx=0).stop 2024-09-12T02:02:25.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.150+0000 7f947dd65f40 1 -- 172.21.15.19:0/3592378648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b98fa87a10 msgr2=0x55b98fb16090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.150+0000 7f947dd65f40 1 --2- 172.21.15.19:0/3592378648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b98fa87a10 0x55b98fb16090 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f947400a600 tx=0x7f9474002fb0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.150+0000 7f947c05c640 1 -- 172.21.15.19:0/3592378648 reap_dead start 2024-09-12T02:02:25.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.150+0000 7f947dd65f40 1 -- 172.21.15.19:0/3592378648 shutdown_connections 2024-09-12T02:02:25.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.150+0000 7f947dd65f40 1 -- 172.21.15.19:0/3592378648 >> 172.21.15.19:0/3592378648 conn(0x55b98fa3f9e0 msgr2=0x55b98fa86fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.151+0000 7f947dd65f40 1 -- 172.21.15.19:0/3592378648 shutdown_connections 2024-09-12T02:02:25.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.151+0000 7f947dd65f40 1 -- 172.21.15.19:0/3592378648 wait complete. 2024-09-12T02:02:25.156 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader mds0_inotable 2024-09-12T02:02:25.175 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:02:25.198 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:02:25.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.239+0000 7f6fc3e21f40 1 Processor -- start 2024-09-12T02:02:25.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.239+0000 7f6fc3e21f40 1 -- start start 2024-09-12T02:02:25.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.240+0000 7f6fc3e21f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d110ce8180 0x55d110dbfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.240+0000 7f6fc3e21f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d110d16050 0x55d110dbef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.240+0000 7f6fc3e21f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d110da0080 0x55d110dbf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.240+0000 7f6fc3e21f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d110ce4ae0 con 0x55d110d16050 2024-09-12T02:02:25.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.240+0000 7f6fc3e21f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d110c37510 con 0x55d110ce8180 2024-09-12T02:02:25.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.240+0000 7f6fc3e21f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55d110ce4dc0 con 0x55d110da0080 2024-09-12T02:02:25.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.240+0000 7f6fc1116640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d110d16050 0x55d110dbef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.240+0000 7f6fc1116640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d110d16050 0x55d110dbef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50956/0 (socket says 172.21.15.19:50956) 2024-09-12T02:02:25.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.240+0000 7f6fc1116640 1 -- 172.21.15.19:0/3319952278 learned_addr learned my addr 172.21.15.19:0/3319952278 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.240+0000 7f6fc1917640 1 --2- 172.21.15.19:0/3319952278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d110ce8180 0x55d110dbfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.240+0000 7f6fc2118640 1 --2- 172.21.15.19:0/3319952278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d110da0080 0x55d110dbf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.240+0000 7f6fc1116640 1 -- 172.21.15.19:0/3319952278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d110da0080 msgr2=0x55d110dbf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.240+0000 7f6fc1116640 1 --2- 172.21.15.19:0/3319952278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d110da0080 0x55d110dbf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.240+0000 7f6fc1116640 1 -- 172.21.15.19:0/3319952278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d110ce8180 msgr2=0x55d110dbfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.240+0000 7f6fc1116640 1 --2- 172.21.15.19:0/3319952278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d110ce8180 0x55d110dbfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.240+0000 7f6fc1116640 1 -- 172.21.15.19:0/3319952278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d110d15d00 con 0x55d110d16050 2024-09-12T02:02:25.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.240+0000 7f6fc1917640 1 --2- 172.21.15.19:0/3319952278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d110ce8180 0x55d110dbfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:25.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.240+0000 7f6fc1116640 1 --2- 172.21.15.19:0/3319952278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d110d16050 0x55d110dbef10 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8025bc0 tx=0x7f6fb8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24939e041cc0496 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.241+0000 7f6fb3fff640 1 -- 172.21.15.19:0/3319952278 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8063070 con 0x55d110d16050 2024-09-12T02:02:25.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.241+0000 7f6fb3fff640 1 -- 172.21.15.19:0/3319952278 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb80559c0 con 0x55d110d16050 2024-09-12T02:02:25.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.241+0000 7f6fb3fff640 1 -- 172.21.15.19:0/3319952278 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8055d90 con 0x55d110d16050 2024-09-12T02:02:25.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.241+0000 7f6fc3e21f40 1 -- 172.21.15.19:0/3319952278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d110d16050 msgr2=0x55d110dbef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.241+0000 7f6fc3e21f40 1 --2- 172.21.15.19:0/3319952278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d110d16050 0x55d110dbef10 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8025bc0 tx=0x7f6fb8051000 comp rx=0 tx=0).stop 2024-09-12T02:02:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.241+0000 7f6fc3e21f40 1 -- 172.21.15.19:0/3319952278 shutdown_connections 2024-09-12T02:02:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.241+0000 7f6fc3e21f40 1 --2- 172.21.15.19:0/3319952278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d110da0080 0x55d110dbf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.241+0000 7f6fc3e21f40 1 --2- 172.21.15.19:0/3319952278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d110d16050 0x55d110dbef10 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.241+0000 7f6fc3e21f40 1 --2- 172.21.15.19:0/3319952278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d110ce8180 0x55d110dbfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.241+0000 7f6fc3e21f40 1 -- 172.21.15.19:0/3319952278 >> 172.21.15.19:0/3319952278 conn(0x55d110ce59e0 msgr2=0x55d110ce7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.241+0000 7f6fc3e21f40 1 -- 172.21.15.19:0/3319952278 shutdown_connections 2024-09-12T02:02:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.241+0000 7f6fc3e21f40 1 -- 172.21.15.19:0/3319952278 wait complete. 2024-09-12T02:02:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.242+0000 7f6fc3e21f40 1 Processor -- start 2024-09-12T02:02:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.242+0000 7f6fc3e21f40 1 -- start start 2024-09-12T02:02:25.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.242+0000 7f6fc3e21f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d110ce8180 0x55d110e4dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.242+0000 7f6fc3e21f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d110d16050 0x55d110e4c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.242+0000 7f6fc3e21f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d110da0080 0x55d110ce3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.242+0000 7f6fc3e21f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d110da5920 con 0x55d110da0080 2024-09-12T02:02:25.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.242+0000 7f6fc3e21f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d110da5640 con 0x55d110ce8180 2024-09-12T02:02:25.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.242+0000 7f6fc3e21f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55d110da4e10 con 0x55d110d16050 2024-09-12T02:02:25.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.243+0000 7f6fc2118640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d110da0080 0x55d110ce3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.243+0000 7f6fc2118640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d110da0080 0x55d110ce3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50958/0 (socket says 172.21.15.19:50958) 2024-09-12T02:02:25.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.243+0000 7f6fc2118640 1 -- 172.21.15.19:0/813179008 learned_addr learned my addr 172.21.15.19:0/813179008 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.243+0000 7f6fc1917640 1 --2- 172.21.15.19:0/813179008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d110ce8180 0x55d110e4dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.243+0000 7f6fc1116640 1 --2- 172.21.15.19:0/813179008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d110d16050 0x55d110e4c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.243+0000 7f6fc2118640 1 -- 172.21.15.19:0/813179008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d110d16050 msgr2=0x55d110e4c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.243+0000 7f6fc2118640 1 --2- 172.21.15.19:0/813179008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d110d16050 0x55d110e4c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.243+0000 7f6fc2118640 1 -- 172.21.15.19:0/813179008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d110ce8180 msgr2=0x55d110e4dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.243+0000 7f6fc2118640 1 --2- 172.21.15.19:0/813179008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d110ce8180 0x55d110e4dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.243+0000 7f6fc2118640 1 -- 172.21.15.19:0/813179008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d110d9e3f0 con 0x55d110da0080 2024-09-12T02:02:25.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.243+0000 7f6fc1116640 1 --2- 172.21.15.19:0/813179008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d110d16050 0x55d110e4c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:25.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.243+0000 7f6fc2118640 1 --2- 172.21.15.19:0/813179008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d110da0080 0x55d110ce3e10 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0086c0 tx=0x7f6fbc0087b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.243+0000 7f6fb2ffd640 1 -- 172.21.15.19:0/813179008 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc019030 con 0x55d110da0080 2024-09-12T02:02:25.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.243+0000 7f6fb2ffd640 1 -- 172.21.15.19:0/813179008 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fbc015680 con 0x55d110da0080 2024-09-12T02:02:25.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.243+0000 7f6fc3e21f40 1 -- 172.21.15.19:0/813179008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d110e4e3e0 con 0x55d110da0080 2024-09-12T02:02:25.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.243+0000 7f6fb2ffd640 1 -- 172.21.15.19:0/813179008 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc015a70 con 0x55d110da0080 2024-09-12T02:02:25.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.243+0000 7f6fc3e21f40 1 -- 172.21.15.19:0/813179008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d110e4bc10 con 0x55d110da0080 2024-09-12T02:02:25.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.245+0000 7f6fb2ffd640 1 -- 172.21.15.19:0/813179008 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6fbc01c070 con 0x55d110da0080 2024-09-12T02:02:25.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.245+0000 7f6fb2ffd640 1 --2- 172.21.15.19:0/813179008 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6fa406a810 0x7f6fa406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.245+0000 7f6fb2ffd640 1 -- 172.21.15.19:0/813179008 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f6fbc08a320 con 0x55d110da0080 2024-09-12T02:02:25.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.245+0000 7f6fc1917640 1 --2- 172.21.15.19:0/813179008 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6fa406a810 0x7f6fa406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.245+0000 7f6fc3e21f40 1 --2- 172.21.15.19:0/813179008 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d110d9c750 0x55d110dbaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.245+0000 7f6fc3e21f40 1 -- 172.21.15.19:0/813179008 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:1 13.13 13:c91d4a1d:::mds0_inotable:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55d110d9cb30 con 0x55d110d9c750 2024-09-12T02:02:25.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.246+0000 7f6fc1116640 1 --2- 172.21.15.19:0/813179008 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d110d9c750 0x55d110dbaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.246+0000 7f6fc1917640 1 --2- 172.21.15.19:0/813179008 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6fa406a810 0x7f6fa406ccd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x55d110da5070 tx=0x7f6fb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.246+0000 7f6fc1116640 1 --2- 172.21.15.19:0/813179008 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d110d9c750 0x55d110dbaa40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.246+0000 7f6fc1116640 1 -- 172.21.15.19:0/813179008 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(1 mds0_inotable [omap-get-header] v0'0 uv3 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6fb8071040 con 0x55d110d9c750 2024-09-12T02:02:25.251 INFO:teuthology.orchestra.run.smithi019.stdout:header (0 bytes) : 2024-09-12T02:02:25.252 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:25.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.246+0000 7f6fc3e21f40 1 -- 172.21.15.19:0/813179008 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d110d9c750 msgr2=0x55d110dbaa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.246+0000 7f6fc3e21f40 1 --2- 172.21.15.19:0/813179008 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d110d9c750 0x55d110dbaa40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.246+0000 7f6fc3e21f40 1 -- 172.21.15.19:0/813179008 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6fa406a810 msgr2=0x7f6fa406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.246+0000 7f6fc3e21f40 1 --2- 172.21.15.19:0/813179008 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6fa406a810 0x7f6fa406ccd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x55d110da5070 tx=0x7f6fb4008040 comp rx=0 tx=0).stop 2024-09-12T02:02:25.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.246+0000 7f6fc3e21f40 1 -- 172.21.15.19:0/813179008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d110da0080 msgr2=0x55d110ce3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.246+0000 7f6fc3e21f40 1 --2- 172.21.15.19:0/813179008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d110da0080 0x55d110ce3e10 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0086c0 tx=0x7f6fbc0087b0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.246+0000 7f6fc2118640 1 -- 172.21.15.19:0/813179008 reap_dead start 2024-09-12T02:02:25.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.246+0000 7f6fc3e21f40 1 -- 172.21.15.19:0/813179008 shutdown_connections 2024-09-12T02:02:25.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.246+0000 7f6fc3e21f40 1 -- 172.21.15.19:0/813179008 >> 172.21.15.19:0/813179008 conn(0x55d110ce59e0 msgr2=0x55d110ce7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.247+0000 7f6fc3e21f40 1 -- 172.21.15.19:0/813179008 shutdown_connections 2024-09-12T02:02:25.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.247+0000 7f6fc3e21f40 1 -- 172.21.15.19:0/813179008 wait complete. 2024-09-12T02:02:25.255 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 100.00000000 2024-09-12T02:02:25.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.338+0000 7fce7ee0cf40 1 Processor -- start 2024-09-12T02:02:25.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.338+0000 7fce7ee0cf40 1 -- start start 2024-09-12T02:02:25.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.339+0000 7fce7ee0cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557f798e2180 0x557f79997fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.339+0000 7fce7ee0cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f79910050 0x557f799ba1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.339+0000 7fce7ee0cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557f7999a080 0x557f799b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.339+0000 7fce7ee0cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557f798deae0 con 0x557f798e2180 2024-09-12T02:02:25.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.339+0000 7fce7ee0cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557f79831510 con 0x557f79910050 2024-09-12T02:02:25.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.339+0000 7fce7ee0cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x557f798dedc0 con 0x557f7999a080 2024-09-12T02:02:25.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.339+0000 7fce7bcb5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557f798e2180 0x557f79997fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.339+0000 7fce7bcb5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557f798e2180 0x557f79997fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50968/0 (socket says 172.21.15.19:50968) 2024-09-12T02:02:25.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.339+0000 7fce7bcb5640 1 -- 172.21.15.19:0/4271203375 learned_addr learned my addr 172.21.15.19:0/4271203375 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.340+0000 7fce7bcb5640 1 -- 172.21.15.19:0/4271203375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557f7999a080 msgr2=0x557f799b5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.340+0000 7fce7bcb5640 1 --2- 172.21.15.19:0/4271203375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557f7999a080 0x557f799b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.340+0000 7fce7bcb5640 1 -- 172.21.15.19:0/4271203375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f79910050 msgr2=0x557f799ba1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.340+0000 7fce7b4b4640 1 --2- 172.21.15.19:0/4271203375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f79910050 0x557f799ba1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.340+0000 7fce7bcb5640 1 --2- 172.21.15.19:0/4271203375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f79910050 0x557f799ba1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.340+0000 7fce7bcb5640 1 -- 172.21.15.19:0/4271203375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f7990bfe0 con 0x557f798e2180 2024-09-12T02:02:25.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.340+0000 7fce7bcb5640 1 --2- 172.21.15.19:0/4271203375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557f798e2180 0x557f79997fd0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fce6c006530 tx=0x7fce6c0069f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d3caa2c3eb5cce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.340+0000 7fce7a4b2640 1 -- 172.21.15.19:0/4271203375 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c0062e0 con 0x557f798e2180 2024-09-12T02:02:25.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.340+0000 7fce7a4b2640 1 -- 172.21.15.19:0/4271203375 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6c003670 con 0x557f798e2180 2024-09-12T02:02:25.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.340+0000 7fce7a4b2640 1 -- 172.21.15.19:0/4271203375 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c003aa0 con 0x557f798e2180 2024-09-12T02:02:25.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.340+0000 7fce7ee0cf40 1 -- 172.21.15.19:0/4271203375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557f798e2180 msgr2=0x557f79997fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.340+0000 7fce7ee0cf40 1 --2- 172.21.15.19:0/4271203375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557f798e2180 0x557f79997fd0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fce6c006530 tx=0x7fce6c0069f0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.340+0000 7fce7ee0cf40 1 -- 172.21.15.19:0/4271203375 shutdown_connections 2024-09-12T02:02:25.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.340+0000 7fce7ee0cf40 1 --2- 172.21.15.19:0/4271203375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557f7999a080 0x557f799b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.340+0000 7fce7ee0cf40 1 --2- 172.21.15.19:0/4271203375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f79910050 0x557f799ba1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.340+0000 7fce7ee0cf40 1 --2- 172.21.15.19:0/4271203375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557f798e2180 0x557f79997fd0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.340+0000 7fce7ee0cf40 1 -- 172.21.15.19:0/4271203375 >> 172.21.15.19:0/4271203375 conn(0x557f798df9e0 msgr2=0x557f798dfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.340+0000 7fce7ee0cf40 1 -- 172.21.15.19:0/4271203375 shutdown_connections 2024-09-12T02:02:25.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.341+0000 7fce7ee0cf40 1 -- 172.21.15.19:0/4271203375 wait complete. 2024-09-12T02:02:25.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.341+0000 7fce7ee0cf40 1 Processor -- start 2024-09-12T02:02:25.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.341+0000 7fce7ee0cf40 1 -- start start 2024-09-12T02:02:25.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.342+0000 7fce7ee0cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557f798e2180 0x557f799b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.342+0000 7fce7ee0cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557f79910050 0x557f799288a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.342+0000 7fce7ee0cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f7999a080 0x557f79928de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.342+0000 7fce7ee0cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557f798e1a00 con 0x557f798e2180 2024-09-12T02:02:25.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.342+0000 7fce7ee0cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557f799ba6e0 con 0x557f7999a080 2024-09-12T02:02:25.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.342+0000 7fce7ee0cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x557f798e1c50 con 0x557f79910050 2024-09-12T02:02:25.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.342+0000 7fce7bcb5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557f798e2180 0x557f799b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.342+0000 7fce7bcb5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557f798e2180 0x557f799b0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50974/0 (socket says 172.21.15.19:50974) 2024-09-12T02:02:25.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.342+0000 7fce7bcb5640 1 -- 172.21.15.19:0/2229412454 learned_addr learned my addr 172.21.15.19:0/2229412454 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.342+0000 7fce7bcb5640 1 -- 172.21.15.19:0/2229412454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557f79910050 msgr2=0x557f799288a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.342+0000 7fce7bcb5640 1 --2- 172.21.15.19:0/2229412454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557f79910050 0x557f799288a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.342+0000 7fce7bcb5640 1 -- 172.21.15.19:0/2229412454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f7999a080 msgr2=0x557f79928de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.342+0000 7fce7bcb5640 1 --2- 172.21.15.19:0/2229412454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f7999a080 0x557f79928de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.342+0000 7fce7bcb5640 1 -- 172.21.15.19:0/2229412454 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f799b7170 con 0x557f798e2180 2024-09-12T02:02:25.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.342+0000 7fce7bcb5640 1 --2- 172.21.15.19:0/2229412454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557f798e2180 0x557f799b0790 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fce6c006a30 tx=0x7fce6c001290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.342+0000 7fce794b0640 1 -- 172.21.15.19:0/2229412454 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c024070 con 0x557f798e2180 2024-09-12T02:02:25.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.343+0000 7fce794b0640 1 -- 172.21.15.19:0/2229412454 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6c019040 con 0x557f798e2180 2024-09-12T02:02:25.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.343+0000 7fce7ee0cf40 1 -- 172.21.15.19:0/2229412454 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f799b1bf0 con 0x557f798e2180 2024-09-12T02:02:25.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.343+0000 7fce794b0640 1 -- 172.21.15.19:0/2229412454 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c01f8c0 con 0x557f798e2180 2024-09-12T02:02:25.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.343+0000 7fce7ee0cf40 1 -- 172.21.15.19:0/2229412454 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f799b6e90 con 0x557f798e2180 2024-09-12T02:02:25.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.344+0000 7fce794b0640 1 -- 172.21.15.19:0/2229412454 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce6c027070 con 0x557f798e2180 2024-09-12T02:02:25.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.344+0000 7fce794b0640 1 --2- 172.21.15.19:0/2229412454 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce5c06a810 0x7fce5c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.344+0000 7fce794b0640 1 -- 172.21.15.19:0/2229412454 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7fce6c08b280 con 0x557f798e2180 2024-09-12T02:02:25.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.345+0000 7fce7ee0cf40 1 --2- 172.21.15.19:0/2229412454 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x557f799b0cd0 0x557f79a51510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.345+0000 7fce7ee0cf40 1 -- 172.21.15.19:0/2229412454 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:1 13.13 13:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x557f7999fa90 con 0x557f799b0cd0 2024-09-12T02:02:25.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.345+0000 7fce7b4b4640 1 --2- 172.21.15.19:0/2229412454 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce5c06a810 0x7fce5c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.345+0000 7fce7c4b6640 1 --2- 172.21.15.19:0/2229412454 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x557f799b0cd0 0x557f79a51510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.345+0000 7fce7c4b6640 1 --2- 172.21.15.19:0/2229412454 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x557f799b0cd0 0x557f79a51510 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.345+0000 7fce7b4b4640 1 --2- 172.21.15.19:0/2229412454 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce5c06a810 0x7fce5c06ccd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fce64056000 tx=0x7fce6404e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.345+0000 7fce7c4b6640 1 -- 172.21.15.19:0/2229412454 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(1 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7fce74009970 con 0x557f799b0cd0 2024-09-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi019.stdout:header (274 bytes) : 2024-09-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi019.stdout:00000000 04 03 0c 01 00 00 01 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi019.stdout:00000010 00 00 00 00 00 00 03 02 28 00 00 00 00 00 00 00 |........(.......| 2024-09-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi019.stdout:00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi019.stdout:00000030 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi019.stdout:00000040 00 00 00 00 03 02 28 00 00 00 00 00 00 00 00 00 |......(.........| 2024-09-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi019.stdout:00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi019.stdout:00000060 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi019.stdout:00000070 00 00 03 02 38 00 00 00 00 00 00 00 00 00 00 00 |....8...........| 2024-09-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi019.stdout:00000080 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi019.stdout:00000090 0a 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi019.stdout:000000a0 00 00 00 00 00 00 00 00 a4 4b e2 66 99 9b 14 14 |.........K.f....| 2024-09-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi019.stdout:000000b0 03 02 38 00 00 00 00 00 00 00 00 00 00 00 00 00 |..8.............| 2024-09-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi019.stdout:000000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 0a 00 |................| 2024-09-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi019.stdout:000000d0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi019.stdout:000000e0 00 00 00 00 00 00 a4 4b e2 66 99 9b 14 14 00 00 |.......K.f......| 2024-09-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi019.stdout:000000f0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi019.stdout:* 2024-09-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi019.stdout:00000110 00 00 |..| 2024-09-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi019.stdout:00000112 2024-09-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:25.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.346+0000 7fce7ee0cf40 1 -- 172.21.15.19:0/2229412454 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x557f799b0cd0 msgr2=0x557f79a51510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.346+0000 7fce7ee0cf40 1 --2- 172.21.15.19:0/2229412454 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x557f799b0cd0 0x557f79a51510 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.346+0000 7fce7ee0cf40 1 -- 172.21.15.19:0/2229412454 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce5c06a810 msgr2=0x7fce5c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.346+0000 7fce7ee0cf40 1 --2- 172.21.15.19:0/2229412454 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce5c06a810 0x7fce5c06ccd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fce64056000 tx=0x7fce6404e000 comp rx=0 tx=0).stop 2024-09-12T02:02:25.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.346+0000 7fce7ee0cf40 1 -- 172.21.15.19:0/2229412454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557f798e2180 msgr2=0x557f799b0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.346+0000 7fce7ee0cf40 1 --2- 172.21.15.19:0/2229412454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557f798e2180 0x557f799b0790 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fce6c006a30 tx=0x7fce6c001290 comp rx=0 tx=0).stop 2024-09-12T02:02:25.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.346+0000 7fce7c4b6640 1 -- 172.21.15.19:0/2229412454 reap_dead start 2024-09-12T02:02:25.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.346+0000 7fce7ee0cf40 1 -- 172.21.15.19:0/2229412454 shutdown_connections 2024-09-12T02:02:25.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.346+0000 7fce7ee0cf40 1 -- 172.21.15.19:0/2229412454 >> 172.21.15.19:0/2229412454 conn(0x557f798df9e0 msgr2=0x557f798dfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.346+0000 7fce7ee0cf40 1 -- 172.21.15.19:0/2229412454 shutdown_connections 2024-09-12T02:02:25.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.346+0000 7fce7ee0cf40 1 -- 172.21.15.19:0/2229412454 wait complete. 2024-09-12T02:02:25.353 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader mds0_sessionmap 2024-09-12T02:02:25.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.397+0000 7f344feb0f40 1 Processor -- start 2024-09-12T02:02:25.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.397+0000 7f344feb0f40 1 -- start start 2024-09-12T02:02:25.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.398+0000 7f344feb0f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d80107f9e0 0x55d8011461a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.398+0000 7f344feb0f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8010c8ff0 0x55d801151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.398+0000 7f344feb0f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d801156fb0 0x55d8011523f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.398+0000 7f344feb0f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d800fd1510 con 0x55d8010c8ff0 2024-09-12T02:02:25.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.398+0000 7f344feb0f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d80102ac50 con 0x55d80107f9e0 2024-09-12T02:02:25.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.398+0000 7f344feb0f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55d8010801c0 con 0x55d801156fb0 2024-09-12T02:02:25.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.398+0000 7f344d1a5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8010c8ff0 0x55d801151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.398+0000 7f344d1a5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8010c8ff0 0x55d801151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50996/0 (socket says 172.21.15.19:50996) 2024-09-12T02:02:25.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.398+0000 7f344d1a5640 1 -- 172.21.15.19:0/2902510181 learned_addr learned my addr 172.21.15.19:0/2902510181 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.398+0000 7f344d1a5640 1 -- 172.21.15.19:0/2902510181 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d801156fb0 msgr2=0x55d8011523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.398+0000 7f344d1a5640 1 --2- 172.21.15.19:0/2902510181 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d801156fb0 0x55d8011523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.398+0000 7f344d1a5640 1 -- 172.21.15.19:0/2902510181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d80107f9e0 msgr2=0x55d8011461a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.398+0000 7f344d1a5640 1 --2- 172.21.15.19:0/2902510181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d80107f9e0 0x55d8011461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.398+0000 7f344d1a5640 1 -- 172.21.15.19:0/2902510181 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d801155fb0 con 0x55d8010c8ff0 2024-09-12T02:02:25.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.398+0000 7f344d1a5640 1 --2- 172.21.15.19:0/2902510181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8010c8ff0 0x55d801151eb0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f3444001ce0 tx=0x7f344400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15cb98abfbfa7dba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.398+0000 7f343ffff640 1 -- 172.21.15.19:0/2902510181 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344400bd80 con 0x55d8010c8ff0 2024-09-12T02:02:25.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.399+0000 7f343ffff640 1 -- 172.21.15.19:0/2902510181 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f344400f400 con 0x55d8010c8ff0 2024-09-12T02:02:25.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.399+0000 7f343ffff640 1 -- 172.21.15.19:0/2902510181 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344400f830 con 0x55d8010c8ff0 2024-09-12T02:02:25.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.399+0000 7f344feb0f40 1 -- 172.21.15.19:0/2902510181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8010c8ff0 msgr2=0x55d801151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.399+0000 7f344feb0f40 1 --2- 172.21.15.19:0/2902510181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8010c8ff0 0x55d801151eb0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f3444001ce0 tx=0x7f344400b5b0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.399+0000 7f344feb0f40 1 -- 172.21.15.19:0/2902510181 shutdown_connections 2024-09-12T02:02:25.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.399+0000 7f344feb0f40 1 --2- 172.21.15.19:0/2902510181 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d801156fb0 0x55d8011523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.399+0000 7f344feb0f40 1 --2- 172.21.15.19:0/2902510181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8010c8ff0 0x55d801151eb0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.399+0000 7f344feb0f40 1 --2- 172.21.15.19:0/2902510181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d80107f9e0 0x55d8011461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.399+0000 7f344feb0f40 1 -- 172.21.15.19:0/2902510181 >> 172.21.15.19:0/2902510181 conn(0x55d8010ad490 msgr2=0x55d8010c6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.399+0000 7f344feb0f40 1 -- 172.21.15.19:0/2902510181 shutdown_connections 2024-09-12T02:02:25.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.399+0000 7f344feb0f40 1 -- 172.21.15.19:0/2902510181 wait complete. 2024-09-12T02:02:25.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.400+0000 7f344feb0f40 1 Processor -- start 2024-09-12T02:02:25.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.400+0000 7f344feb0f40 1 -- start start 2024-09-12T02:02:25.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.400+0000 7f344feb0f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d80107f9e0 0x55d8011f1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.400+0000 7f344feb0f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8010c8ff0 0x55d8011f1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.400+0000 7f344feb0f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d801156fb0 0x55d8011e6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.400+0000 7f344feb0f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d801081ff0 con 0x55d801156fb0 2024-09-12T02:02:25.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.400+0000 7f344feb0f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d801155d60 con 0x55d8010c8ff0 2024-09-12T02:02:25.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.400+0000 7f344feb0f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55d801156290 con 0x55d80107f9e0 2024-09-12T02:02:25.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.400+0000 7f344e1a7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d801156fb0 0x55d8011e6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.400+0000 7f344e1a7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d801156fb0 0x55d8011e6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51004/0 (socket says 172.21.15.19:51004) 2024-09-12T02:02:25.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.400+0000 7f344e1a7640 1 -- 172.21.15.19:0/2528040656 learned_addr learned my addr 172.21.15.19:0/2528040656 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.400+0000 7f344d1a5640 1 --2- 172.21.15.19:0/2528040656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8010c8ff0 0x55d8011f1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.401+0000 7f344d9a6640 1 --2- 172.21.15.19:0/2528040656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d80107f9e0 0x55d8011f1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.401+0000 7f344e1a7640 1 -- 172.21.15.19:0/2528040656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d80107f9e0 msgr2=0x55d8011f1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.401+0000 7f344e1a7640 1 --2- 172.21.15.19:0/2528040656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d80107f9e0 0x55d8011f1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.401+0000 7f344e1a7640 1 -- 172.21.15.19:0/2528040656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8010c8ff0 msgr2=0x55d8011f1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.401+0000 7f344e1a7640 1 --2- 172.21.15.19:0/2528040656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8010c8ff0 0x55d8011f1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.401+0000 7f344e1a7640 1 -- 172.21.15.19:0/2528040656 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8011e5a80 con 0x55d801156fb0 2024-09-12T02:02:25.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.401+0000 7f344e1a7640 1 --2- 172.21.15.19:0/2528040656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d801156fb0 0x55d8011e6720 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f3448025b00 tx=0x7f3448056510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.401+0000 7f343effd640 1 -- 172.21.15.19:0/2528040656 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3448066020 con 0x55d801156fb0 2024-09-12T02:02:25.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.401+0000 7f343effd640 1 -- 172.21.15.19:0/2528040656 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3448056b90 con 0x55d801156fb0 2024-09-12T02:02:25.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.401+0000 7f343effd640 1 -- 172.21.15.19:0/2528040656 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3448062470 con 0x55d801156fb0 2024-09-12T02:02:25.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.401+0000 7f344feb0f40 1 -- 172.21.15.19:0/2528040656 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d801159e60 con 0x55d801156fb0 2024-09-12T02:02:25.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.401+0000 7f344feb0f40 1 -- 172.21.15.19:0/2528040656 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d80115a420 con 0x55d801156fb0 2024-09-12T02:02:25.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.403+0000 7f343effd640 1 -- 172.21.15.19:0/2528040656 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3448069020 con 0x55d801156fb0 2024-09-12T02:02:25.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.403+0000 7f343effd640 1 --2- 172.21.15.19:0/2528040656 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f343006a810 0x7f343006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.403+0000 7f343effd640 1 -- 172.21.15.19:0/2528040656 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f34480cdd00 con 0x55d801156fb0 2024-09-12T02:02:25.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.403+0000 7f344d9a6640 1 --2- 172.21.15.19:0/2528040656 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f343006a810 0x7f343006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.403+0000 7f344feb0f40 1 --2- 172.21.15.19:0/2528040656 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d8011596d0 0x55d801157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.403+0000 7f344feb0f40 1 -- 172.21.15.19:0/2528040656 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:1 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55d8011f1ed0 con 0x55d8011596d0 2024-09-12T02:02:25.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.403+0000 7f344d1a5640 1 --2- 172.21.15.19:0/2528040656 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d8011596d0 0x55d801157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.404+0000 7f344d9a6640 1 --2- 172.21.15.19:0/2528040656 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f343006a810 0x7f343006ccd0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f34400013e0 tx=0x7f3440001350 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.404+0000 7f344d1a5640 1 --2- 172.21.15.19:0/2528040656 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d8011596d0 0x55d801157390 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.404+0000 7f344d1a5640 1 -- 172.21.15.19:0/2528040656 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv3 ondisk = 0) ==== 159+0+14 (crc 0 0 0) 0x7f344400f6b0 con 0x55d8011596d0 2024-09-12T02:02:25.408 INFO:teuthology.orchestra.run.smithi019.stdout:header (14 bytes) : 2024-09-12T02:02:25.408 INFO:teuthology.orchestra.run.smithi019.stdout:00000000 01 01 08 00 00 00 04 00 00 00 00 00 00 00 |..............| 2024-09-12T02:02:25.408 INFO:teuthology.orchestra.run.smithi019.stdout:0000000e 2024-09-12T02:02:25.408 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:25.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.404+0000 7f344feb0f40 1 -- 172.21.15.19:0/2528040656 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d8011596d0 msgr2=0x55d801157390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.404+0000 7f344feb0f40 1 --2- 172.21.15.19:0/2528040656 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d8011596d0 0x55d801157390 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.404+0000 7f344feb0f40 1 -- 172.21.15.19:0/2528040656 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f343006a810 msgr2=0x7f343006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.404+0000 7f344feb0f40 1 --2- 172.21.15.19:0/2528040656 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f343006a810 0x7f343006ccd0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f34400013e0 tx=0x7f3440001350 comp rx=0 tx=0).stop 2024-09-12T02:02:25.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.404+0000 7f344feb0f40 1 -- 172.21.15.19:0/2528040656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d801156fb0 msgr2=0x55d8011e6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.404+0000 7f344feb0f40 1 --2- 172.21.15.19:0/2528040656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d801156fb0 0x55d8011e6720 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f3448025b00 tx=0x7f3448056510 comp rx=0 tx=0).stop 2024-09-12T02:02:25.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.404+0000 7f344e1a7640 1 -- 172.21.15.19:0/2528040656 reap_dead start 2024-09-12T02:02:25.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.404+0000 7f344feb0f40 1 -- 172.21.15.19:0/2528040656 shutdown_connections 2024-09-12T02:02:25.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.404+0000 7f344feb0f40 1 -- 172.21.15.19:0/2528040656 >> 172.21.15.19:0/2528040656 conn(0x55d8010ad490 msgr2=0x55d801154590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.404+0000 7f344feb0f40 1 -- 172.21.15.19:0/2528040656 shutdown_connections 2024-09-12T02:02:25.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.404+0000 7f344feb0f40 1 -- 172.21.15.19:0/2528040656 wait complete. 2024-09-12T02:02:25.411 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 400.00000000 2024-09-12T02:02:25.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.454+0000 7fcab2b70f40 1 Processor -- start 2024-09-12T02:02:25.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.454+0000 7fcab2b70f40 1 -- start start 2024-09-12T02:02:25.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcab2b70f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5614e0a9d8e0 0x5614e0a8b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcab2b70f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e0b5c730 0x5614e0b5a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcab2b70f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5614e0b73960 0x5614e0a9cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcab2b70f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5614e0acc4e0 con 0x5614e0b73960 2024-09-12T02:02:25.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcab2b70f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5614e09ef510 con 0x5614e0b5c730 2024-09-12T02:02:25.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcab2b70f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5614e0acb970 con 0x5614e0a9d8e0 2024-09-12T02:02:25.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcab0e67640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5614e0b73960 0x5614e0a9cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcab0e67640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5614e0b73960 0x5614e0a9cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51026/0 (socket says 172.21.15.19:51026) 2024-09-12T02:02:25.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcab0e67640 1 -- 172.21.15.19:0/1082181226 learned_addr learned my addr 172.21.15.19:0/1082181226 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcaafe65640 1 --2- 172.21.15.19:0/1082181226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e0b5c730 0x5614e0b5a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcab0666640 1 --2- 172.21.15.19:0/1082181226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5614e0a9d8e0 0x5614e0a8b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcab0e67640 1 -- 172.21.15.19:0/1082181226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5614e0a9d8e0 msgr2=0x5614e0a8b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcab0e67640 1 --2- 172.21.15.19:0/1082181226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5614e0a9d8e0 0x5614e0a8b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcab0e67640 1 -- 172.21.15.19:0/1082181226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e0b5c730 msgr2=0x5614e0b5a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcab0e67640 1 --2- 172.21.15.19:0/1082181226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e0b5c730 0x5614e0b5a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcab0e67640 1 -- 172.21.15.19:0/1082181226 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614e0b5a9e0 con 0x5614e0b73960 2024-09-12T02:02:25.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcaafe65640 1 --2- 172.21.15.19:0/1082181226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e0b5c730 0x5614e0b5a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:25.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcab0e67640 1 --2- 172.21.15.19:0/1082181226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5614e0b73960 0x5614e0a9cbe0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8046100 tx=0x7fcaa8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69930c8ac42c430 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcaaee63640 1 -- 172.21.15.19:0/1082181226 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8067070 con 0x5614e0b73960 2024-09-12T02:02:25.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcaaee63640 1 -- 172.21.15.19:0/1082181226 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa8050960 con 0x5614e0b73960 2024-09-12T02:02:25.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.455+0000 7fcaaee63640 1 -- 172.21.15.19:0/1082181226 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8050d10 con 0x5614e0b73960 2024-09-12T02:02:25.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.456+0000 7fcab2b70f40 1 -- 172.21.15.19:0/1082181226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5614e0b73960 msgr2=0x5614e0a9cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.456+0000 7fcab2b70f40 1 --2- 172.21.15.19:0/1082181226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5614e0b73960 0x5614e0a9cbe0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8046100 tx=0x7fcaa8051000 comp rx=0 tx=0).stop 2024-09-12T02:02:25.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.456+0000 7fcab2b70f40 1 -- 172.21.15.19:0/1082181226 shutdown_connections 2024-09-12T02:02:25.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.456+0000 7fcab2b70f40 1 --2- 172.21.15.19:0/1082181226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5614e0b73960 0x5614e0a9cbe0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.456+0000 7fcab2b70f40 1 --2- 172.21.15.19:0/1082181226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e0b5c730 0x5614e0b5a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.456+0000 7fcab2b70f40 1 --2- 172.21.15.19:0/1082181226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5614e0a9d8e0 0x5614e0a8b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.456+0000 7fcab2b70f40 1 -- 172.21.15.19:0/1082181226 >> 172.21.15.19:0/1082181226 conn(0x5614e0a9ead0 msgr2=0x5614e0b752d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.456+0000 7fcab2b70f40 1 -- 172.21.15.19:0/1082181226 shutdown_connections 2024-09-12T02:02:25.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.456+0000 7fcab2b70f40 1 -- 172.21.15.19:0/1082181226 wait complete. 2024-09-12T02:02:25.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.456+0000 7fcab2b70f40 1 Processor -- start 2024-09-12T02:02:25.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.457+0000 7fcab2b70f40 1 -- start start 2024-09-12T02:02:25.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.457+0000 7fcab2b70f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5614e0a9d8e0 0x5614e0b55720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.457+0000 7fcab2b70f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e0b5c730 0x5614e0ae4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.457+0000 7fcab2b70f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5614e0b73960 0x5614e0a9cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.457+0000 7fcab2b70f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5614e0b76500 con 0x5614e0b73960 2024-09-12T02:02:25.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.457+0000 7fcab2b70f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5614e0a8beb0 con 0x5614e0b5c730 2024-09-12T02:02:25.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.457+0000 7fcab2b70f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5614e0b5af50 con 0x5614e0a9d8e0 2024-09-12T02:02:25.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.457+0000 7fcab0e67640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5614e0b73960 0x5614e0a9cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.457+0000 7fcab0e67640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5614e0b73960 0x5614e0a9cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51036/0 (socket says 172.21.15.19:51036) 2024-09-12T02:02:25.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.457+0000 7fcab0e67640 1 -- 172.21.15.19:0/2058859004 learned_addr learned my addr 172.21.15.19:0/2058859004 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.457+0000 7fcaafe65640 1 --2- 172.21.15.19:0/2058859004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e0b5c730 0x5614e0ae4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.457+0000 7fcab0666640 1 --2- 172.21.15.19:0/2058859004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5614e0a9d8e0 0x5614e0b55720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.458+0000 7fcab0e67640 1 -- 172.21.15.19:0/2058859004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5614e0a9d8e0 msgr2=0x5614e0b55720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.458+0000 7fcab0e67640 1 --2- 172.21.15.19:0/2058859004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5614e0a9d8e0 0x5614e0b55720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.458+0000 7fcab0e67640 1 -- 172.21.15.19:0/2058859004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e0b5c730 msgr2=0x5614e0ae4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.458+0000 7fcab0e67640 1 --2- 172.21.15.19:0/2058859004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e0b5c730 0x5614e0ae4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.458+0000 7fcab0e67640 1 -- 172.21.15.19:0/2058859004 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614e0ae6400 con 0x5614e0b73960 2024-09-12T02:02:25.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.458+0000 7fcab0666640 1 --2- 172.21.15.19:0/2058859004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5614e0a9d8e0 0x5614e0b55720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:25.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.458+0000 7fcab0e67640 1 --2- 172.21.15.19:0/2058859004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5614e0b73960 0x5614e0a9cdd0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fcaa805a040 tx=0x7fcaa8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.458+0000 7fcaade61640 1 -- 172.21.15.19:0/2058859004 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8067040 con 0x5614e0b73960 2024-09-12T02:02:25.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.458+0000 7fcaade61640 1 -- 172.21.15.19:0/2058859004 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa8058780 con 0x5614e0b73960 2024-09-12T02:02:25.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.458+0000 7fcab2b70f40 1 -- 172.21.15.19:0/2058859004 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614e0ae66e0 con 0x5614e0b73960 2024-09-12T02:02:25.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.458+0000 7fcaade61640 1 -- 172.21.15.19:0/2058859004 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8058b70 con 0x5614e0b73960 2024-09-12T02:02:25.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.458+0000 7fcab2b70f40 1 -- 172.21.15.19:0/2058859004 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614e0ae6060 con 0x5614e0b73960 2024-09-12T02:02:25.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.459+0000 7fcaade61640 1 -- 172.21.15.19:0/2058859004 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcaa8058d10 con 0x5614e0b73960 2024-09-12T02:02:25.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.460+0000 7fcaade61640 1 --2- 172.21.15.19:0/2058859004 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca9c06a840 0x7fca9c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.460+0000 7fcaade61640 1 -- 172.21.15.19:0/2058859004 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7fcaa80cf9a0 con 0x5614e0b73960 2024-09-12T02:02:25.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.460+0000 7fcab0666640 1 --2- 172.21.15.19:0/2058859004 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca9c06a840 0x7fca9c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.460+0000 7fcab2b70f40 1 --2- 172.21.15.19:0/2058859004 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5614e0a9d310 0x5614e0ae25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.460+0000 7fcab2b70f40 1 -- 172.21.15.19:0/2058859004 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 13.f 13:f1f69726:::400.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5614e0c0ec40 con 0x5614e0a9d310 2024-09-12T02:02:25.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.460+0000 7fcaafe65640 1 --2- 172.21.15.19:0/2058859004 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5614e0a9d310 0x5614e0ae25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.460+0000 7fcab0666640 1 --2- 172.21.15.19:0/2058859004 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca9c06a840 0x7fca9c06cd00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x5614e0ac7560 tx=0x7fcaa0001750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.461+0000 7fcaafe65640 1 --2- 172.21.15.19:0/2058859004 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5614e0a9d310 0x5614e0ae25b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.461+0000 7fcaafe65640 1 -- 172.21.15.19:0/2058859004 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 400.00000000 [omap-get-header] v0'0 uv1 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcaa40099d0 con 0x5614e0a9d310 2024-09-12T02:02:25.465 INFO:teuthology.orchestra.run.smithi019.stdout:header (0 bytes) : 2024-09-12T02:02:25.465 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:25.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.461+0000 7fcab2b70f40 1 -- 172.21.15.19:0/2058859004 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5614e0a9d310 msgr2=0x5614e0ae25b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.461+0000 7fcab2b70f40 1 --2- 172.21.15.19:0/2058859004 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5614e0a9d310 0x5614e0ae25b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.461+0000 7fcab2b70f40 1 -- 172.21.15.19:0/2058859004 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca9c06a840 msgr2=0x7fca9c06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.461+0000 7fcab2b70f40 1 --2- 172.21.15.19:0/2058859004 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca9c06a840 0x7fca9c06cd00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x5614e0ac7560 tx=0x7fcaa0001750 comp rx=0 tx=0).stop 2024-09-12T02:02:25.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.461+0000 7fcab2b70f40 1 -- 172.21.15.19:0/2058859004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5614e0b73960 msgr2=0x5614e0a9cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.461+0000 7fcab2b70f40 1 --2- 172.21.15.19:0/2058859004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5614e0b73960 0x5614e0a9cdd0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fcaa805a040 tx=0x7fcaa8003330 comp rx=0 tx=0).stop 2024-09-12T02:02:25.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.461+0000 7fcab0e67640 1 -- 172.21.15.19:0/2058859004 reap_dead start 2024-09-12T02:02:25.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.461+0000 7fcab2b70f40 1 -- 172.21.15.19:0/2058859004 shutdown_connections 2024-09-12T02:02:25.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.461+0000 7fcab2b70f40 1 -- 172.21.15.19:0/2058859004 >> 172.21.15.19:0/2058859004 conn(0x5614e0a9ead0 msgr2=0x5614e0ae3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.461+0000 7fcab2b70f40 1 -- 172.21.15.19:0/2058859004 shutdown_connections 2024-09-12T02:02:25.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.461+0000 7fcab2b70f40 1 -- 172.21.15.19:0/2058859004 wait complete. 2024-09-12T02:02:25.467 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 100.00000000.inode 2024-09-12T02:02:25.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.550+0000 7f5f1d01cf40 1 Processor -- start 2024-09-12T02:02:25.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.550+0000 7f5f1d01cf40 1 -- start start 2024-09-12T02:02:25.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.550+0000 7f5f1d01cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e67ae80b0 0x563e67bbcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.550+0000 7f5f1d01cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e67aebcf0 0x563e67bbbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.550+0000 7f5f1d01cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563e67ba5160 0x563e67b152b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.550+0000 7f5f1d01cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563e67bbf860 con 0x563e67ae80b0 2024-09-12T02:02:25.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.550+0000 7f5f1d01cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563e67ba5540 con 0x563e67aebcf0 2024-09-12T02:02:25.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.550+0000 7f5f1d01cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x563e67bbfb40 con 0x563e67ba5160 2024-09-12T02:02:25.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.550+0000 7f5f1ab12640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e67ae80b0 0x563e67bbcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.550+0000 7f5f1ab12640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e67ae80b0 0x563e67bbcb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51066/0 (socket says 172.21.15.19:51066) 2024-09-12T02:02:25.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.550+0000 7f5f1ab12640 1 -- 172.21.15.19:0/2135073377 learned_addr learned my addr 172.21.15.19:0/2135073377 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.550+0000 7f5f13fff640 1 --2- 172.21.15.19:0/2135073377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e67aebcf0 0x563e67bbbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f1b313640 1 --2- 172.21.15.19:0/2135073377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563e67ba5160 0x563e67b152b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f1ab12640 1 -- 172.21.15.19:0/2135073377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563e67ba5160 msgr2=0x563e67b152b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f1ab12640 1 --2- 172.21.15.19:0/2135073377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563e67ba5160 0x563e67b152b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f1ab12640 1 -- 172.21.15.19:0/2135073377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e67aebcf0 msgr2=0x563e67bbbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f1ab12640 1 --2- 172.21.15.19:0/2135073377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e67aebcf0 0x563e67bbbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f1ab12640 1 -- 172.21.15.19:0/2135073377 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e67a14cb0 con 0x563e67ae80b0 2024-09-12T02:02:25.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f13fff640 1 --2- 172.21.15.19:0/2135073377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e67aebcf0 0x563e67bbbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:25.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f1b313640 1 --2- 172.21.15.19:0/2135073377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563e67ba5160 0x563e67b152b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:25.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f1ab12640 1 --2- 172.21.15.19:0/2135073377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e67ae80b0 0x563e67bbcb80 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009750 tx=0x7f5f0c005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0bf2b10ca7cbf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f19b10640 1 -- 172.21.15.19:0/2135073377 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c019070 con 0x563e67ae80b0 2024-09-12T02:02:25.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f19b10640 1 -- 172.21.15.19:0/2135073377 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f0c008890 con 0x563e67ae80b0 2024-09-12T02:02:25.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f19b10640 1 -- 172.21.15.19:0/2135073377 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c008c60 con 0x563e67ae80b0 2024-09-12T02:02:25.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f1d01cf40 1 -- 172.21.15.19:0/2135073377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e67ae80b0 msgr2=0x563e67bbcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f1d01cf40 1 --2- 172.21.15.19:0/2135073377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e67ae80b0 0x563e67bbcb80 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009750 tx=0x7f5f0c005a00 comp rx=0 tx=0).stop 2024-09-12T02:02:25.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f1d01cf40 1 -- 172.21.15.19:0/2135073377 shutdown_connections 2024-09-12T02:02:25.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f1d01cf40 1 --2- 172.21.15.19:0/2135073377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563e67ba5160 0x563e67b152b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f1d01cf40 1 --2- 172.21.15.19:0/2135073377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e67aebcf0 0x563e67bbbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f1d01cf40 1 --2- 172.21.15.19:0/2135073377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e67ae80b0 0x563e67bbcb80 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.551+0000 7f5f1d01cf40 1 -- 172.21.15.19:0/2135073377 >> 172.21.15.19:0/2135073377 conn(0x563e67aeb1d0 msgr2=0x563e67ba3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.552+0000 7f5f1d01cf40 1 -- 172.21.15.19:0/2135073377 shutdown_connections 2024-09-12T02:02:25.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.552+0000 7f5f1d01cf40 1 -- 172.21.15.19:0/2135073377 wait complete. 2024-09-12T02:02:25.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.552+0000 7f5f1d01cf40 1 Processor -- start 2024-09-12T02:02:25.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.552+0000 7f5f1d01cf40 1 -- start start 2024-09-12T02:02:25.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.553+0000 7f5f1d01cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563e67ae80b0 0x563e67ba07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.553+0000 7f5f1d01cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e67aebcf0 0x563e67bbcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.553+0000 7f5f1d01cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e67ba5160 0x563e67b9dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.553+0000 7f5f1d01cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563e67bc1da0 con 0x563e67ba5160 2024-09-12T02:02:25.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.553+0000 7f5f1d01cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563e67bc1b80 con 0x563e67aebcf0 2024-09-12T02:02:25.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.553+0000 7f5f1d01cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x563e67ba4760 con 0x563e67ae80b0 2024-09-12T02:02:25.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.553+0000 7f5f1b313640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e67ba5160 0x563e67b9dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.553+0000 7f5f1b313640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e67ba5160 0x563e67b9dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51068/0 (socket says 172.21.15.19:51068) 2024-09-12T02:02:25.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.553+0000 7f5f1b313640 1 -- 172.21.15.19:0/1441620121 learned_addr learned my addr 172.21.15.19:0/1441620121 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.553+0000 7f5f13fff640 1 --2- 172.21.15.19:0/1441620121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e67aebcf0 0x563e67bbcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.553+0000 7f5f1ab12640 1 --2- 172.21.15.19:0/1441620121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563e67ae80b0 0x563e67ba07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.553+0000 7f5f1b313640 1 -- 172.21.15.19:0/1441620121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563e67ae80b0 msgr2=0x563e67ba07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.553+0000 7f5f1b313640 1 --2- 172.21.15.19:0/1441620121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563e67ae80b0 0x563e67ba07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.553+0000 7f5f1b313640 1 -- 172.21.15.19:0/1441620121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e67aebcf0 msgr2=0x563e67bbcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.553+0000 7f5f1b313640 1 --2- 172.21.15.19:0/1441620121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e67aebcf0 0x563e67bbcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.553+0000 7f5f1b313640 1 -- 172.21.15.19:0/1441620121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e67b9f720 con 0x563e67ba5160 2024-09-12T02:02:25.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.553+0000 7f5f1b313640 1 --2- 172.21.15.19:0/1441620121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e67ba5160 0x563e67b9dd70 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f5f14046120 tx=0x7f5f14003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.554+0000 7f5f18b0e640 1 -- 172.21.15.19:0/1441620121 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f14054040 con 0x563e67ba5160 2024-09-12T02:02:25.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.554+0000 7f5f18b0e640 1 -- 172.21.15.19:0/1441620121 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f14059450 con 0x563e67ba5160 2024-09-12T02:02:25.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.554+0000 7f5f1d01cf40 1 -- 172.21.15.19:0/1441620121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e67b9fa00 con 0x563e67ba5160 2024-09-12T02:02:25.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.554+0000 7f5f18b0e640 1 -- 172.21.15.19:0/1441620121 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f14005b40 con 0x563e67ba5160 2024-09-12T02:02:25.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.554+0000 7f5f1d01cf40 1 -- 172.21.15.19:0/1441620121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e67b9ffc0 con 0x563e67ba5160 2024-09-12T02:02:25.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.555+0000 7f5f18b0e640 1 -- 172.21.15.19:0/1441620121 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5f14057070 con 0x563e67ba5160 2024-09-12T02:02:25.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.555+0000 7f5f18b0e640 1 --2- 172.21.15.19:0/1441620121 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5efc06a840 0x7f5efc06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.556+0000 7f5f18b0e640 1 -- 172.21.15.19:0/1441620121 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f5f140cdb60 con 0x563e67ba5160 2024-09-12T02:02:25.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.556+0000 7f5f1d01cf40 1 --2- 172.21.15.19:0/1441620121 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x563e67bbd280 0x563e67c55a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.556+0000 7f5f1d01cf40 1 -- 172.21.15.19:0/1441620121 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x563e67c55f50 con 0x563e67bbd280 2024-09-12T02:02:25.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.556+0000 7f5f1ab12640 1 --2- 172.21.15.19:0/1441620121 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5efc06a840 0x7f5efc06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.556+0000 7f5f13fff640 1 --2- 172.21.15.19:0/1441620121 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x563e67bbd280 0x563e67c55a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.556+0000 7f5f1ab12640 1 --2- 172.21.15.19:0/1441620121 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5efc06a840 0x7f5efc06cd00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c000c00 tx=0x7f5f0c008000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.556+0000 7f5f13fff640 1 --2- 172.21.15.19:0/1441620121 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x563e67bbd280 0x563e67c55a10 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.557+0000 7f5f13fff640 1 -- 172.21.15.19:0/1441620121 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 100.00000000.inode [omap-get-header] v0'0 uv3 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f5f040099b0 con 0x563e67bbd280 2024-09-12T02:02:25.560 INFO:teuthology.orchestra.run.smithi019.stdout:header (0 bytes) : 2024-09-12T02:02:25.560 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:25.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.557+0000 7f5f1d01cf40 1 -- 172.21.15.19:0/1441620121 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x563e67bbd280 msgr2=0x563e67c55a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.557+0000 7f5f1d01cf40 1 --2- 172.21.15.19:0/1441620121 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x563e67bbd280 0x563e67c55a10 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.557+0000 7f5f1d01cf40 1 -- 172.21.15.19:0/1441620121 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5efc06a840 msgr2=0x7f5efc06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.557+0000 7f5f1d01cf40 1 --2- 172.21.15.19:0/1441620121 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5efc06a840 0x7f5efc06cd00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c000c00 tx=0x7f5f0c008000 comp rx=0 tx=0).stop 2024-09-12T02:02:25.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.557+0000 7f5f1d01cf40 1 -- 172.21.15.19:0/1441620121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e67ba5160 msgr2=0x563e67b9dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.557+0000 7f5f1d01cf40 1 --2- 172.21.15.19:0/1441620121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e67ba5160 0x563e67b9dd70 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f5f14046120 tx=0x7f5f14003330 comp rx=0 tx=0).stop 2024-09-12T02:02:25.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.557+0000 7f5f1b313640 1 -- 172.21.15.19:0/1441620121 reap_dead start 2024-09-12T02:02:25.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.557+0000 7f5f1d01cf40 1 -- 172.21.15.19:0/1441620121 shutdown_connections 2024-09-12T02:02:25.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.557+0000 7f5f1d01cf40 1 -- 172.21.15.19:0/1441620121 >> 172.21.15.19:0/1441620121 conn(0x563e67aeb1d0 msgr2=0x563e67bbc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.557+0000 7f5f1d01cf40 1 -- 172.21.15.19:0/1441620121 shutdown_connections 2024-09-12T02:02:25.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.557+0000 7f5f1d01cf40 1 -- 172.21.15.19:0/1441620121 wait complete. 2024-09-12T02:02:25.563 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 1.00000000 2024-09-12T02:02:25.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.606+0000 7f8ae6ffff40 1 Processor -- start 2024-09-12T02:02:25.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.606+0000 7f8ae6ffff40 1 -- start start 2024-09-12T02:02:25.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.606+0000 7f8ae6ffff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e3dede20 0x5648e3ea8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.606+0000 7f8ae6ffff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e3e1b450 0x5648e3e30b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.606+0000 7f8ae6ffff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5648e3eac730 0x5648e3e310b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.606+0000 7f8ae6ffff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5648e3dee260 con 0x5648e3dede20 2024-09-12T02:02:25.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.606+0000 7f8ae6ffff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5648e3e1c4e0 con 0x5648e3e1b450 2024-09-12T02:02:25.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.606+0000 7f8ae6ffff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5648e3e1b970 con 0x5648e3eac730 2024-09-12T02:02:25.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.606+0000 7f8ae4af7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e3dede20 0x5648e3ea8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.607+0000 7f8ae4af7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e3dede20 0x5648e3ea8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51078/0 (socket says 172.21.15.19:51078) 2024-09-12T02:02:25.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.607+0000 7f8ae4af7640 1 -- 172.21.15.19:0/3310278826 learned_addr learned my addr 172.21.15.19:0/3310278826 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.607+0000 7f8ae52f8640 1 --2- 172.21.15.19:0/3310278826 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5648e3eac730 0x5648e3e310b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.607+0000 7f8ae42f6640 1 --2- 172.21.15.19:0/3310278826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e3e1b450 0x5648e3e30b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.607+0000 7f8ae4af7640 1 -- 172.21.15.19:0/3310278826 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5648e3eac730 msgr2=0x5648e3e310b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.607+0000 7f8ae4af7640 1 --2- 172.21.15.19:0/3310278826 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5648e3eac730 0x5648e3e310b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.607+0000 7f8ae4af7640 1 -- 172.21.15.19:0/3310278826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e3e1b450 msgr2=0x5648e3e30b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.607+0000 7f8ae4af7640 1 --2- 172.21.15.19:0/3310278826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e3e1b450 0x5648e3e30b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.607+0000 7f8ae4af7640 1 -- 172.21.15.19:0/3310278826 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648e3d18cb0 con 0x5648e3dede20 2024-09-12T02:02:25.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.607+0000 7f8ae52f8640 1 --2- 172.21.15.19:0/3310278826 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5648e3eac730 0x5648e3e310b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:25.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.607+0000 7f8ae42f6640 1 --2- 172.21.15.19:0/3310278826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e3e1b450 0x5648e3e30b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:25.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.607+0000 7f8ae4af7640 1 --2- 172.21.15.19:0/3310278826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e3dede20 0x5648e3ea8830 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009750 tx=0x7f8ad4005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14de9c87f2ae6b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.607+0000 7f8ae32f4640 1 -- 172.21.15.19:0/3310278826 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4019070 con 0x5648e3dede20 2024-09-12T02:02:25.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.607+0000 7f8ae32f4640 1 -- 172.21.15.19:0/3310278826 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad4008890 con 0x5648e3dede20 2024-09-12T02:02:25.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.607+0000 7f8ae32f4640 1 -- 172.21.15.19:0/3310278826 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4008c60 con 0x5648e3dede20 2024-09-12T02:02:25.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.608+0000 7f8ae6ffff40 1 -- 172.21.15.19:0/3310278826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e3dede20 msgr2=0x5648e3ea8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.608+0000 7f8ae6ffff40 1 --2- 172.21.15.19:0/3310278826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e3dede20 0x5648e3ea8830 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009750 tx=0x7f8ad4005a00 comp rx=0 tx=0).stop 2024-09-12T02:02:25.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.608+0000 7f8ae6ffff40 1 -- 172.21.15.19:0/3310278826 shutdown_connections 2024-09-12T02:02:25.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.608+0000 7f8ae6ffff40 1 --2- 172.21.15.19:0/3310278826 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5648e3eac730 0x5648e3e310b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.608+0000 7f8ae6ffff40 1 --2- 172.21.15.19:0/3310278826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e3e1b450 0x5648e3e30b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.608+0000 7f8ae6ffff40 1 --2- 172.21.15.19:0/3310278826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e3dede20 0x5648e3ea8830 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.608+0000 7f8ae6ffff40 1 -- 172.21.15.19:0/3310278826 >> 172.21.15.19:0/3310278826 conn(0x5648e3deead0 msgr2=0x5648e3e33980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.608+0000 7f8ae6ffff40 1 -- 172.21.15.19:0/3310278826 shutdown_connections 2024-09-12T02:02:25.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.608+0000 7f8ae6ffff40 1 -- 172.21.15.19:0/3310278826 wait complete. 2024-09-12T02:02:25.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.608+0000 7f8ae6ffff40 1 Processor -- start 2024-09-12T02:02:25.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.608+0000 7f8ae6ffff40 1 -- start start 2024-09-12T02:02:25.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.609+0000 7f8ae6ffff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e3dede20 0x5648e3f56be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.609+0000 7f8ae6ffff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e3e1b450 0x5648e3e2f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.609+0000 7f8ae6ffff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5648e3eac730 0x5648e3e2fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.609+0000 7f8ae6ffff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5648e3ea6d30 con 0x5648e3e1b450 2024-09-12T02:02:25.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.609+0000 7f8ae6ffff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5648e3e315f0 con 0x5648e3dede20 2024-09-12T02:02:25.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.609+0000 7f8ae6ffff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5648e3ded400 con 0x5648e3eac730 2024-09-12T02:02:25.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.609+0000 7f8ae42f6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e3e1b450 0x5648e3e2f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.609+0000 7f8ae42f6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e3e1b450 0x5648e3e2f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51084/0 (socket says 172.21.15.19:51084) 2024-09-12T02:02:25.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.609+0000 7f8ae42f6640 1 -- 172.21.15.19:0/1258187227 learned_addr learned my addr 172.21.15.19:0/1258187227 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.609+0000 7f8ae4af7640 1 --2- 172.21.15.19:0/1258187227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e3dede20 0x5648e3f56be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.609+0000 7f8ae52f8640 1 --2- 172.21.15.19:0/1258187227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5648e3eac730 0x5648e3e2fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.609+0000 7f8ae42f6640 1 -- 172.21.15.19:0/1258187227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5648e3eac730 msgr2=0x5648e3e2fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.609+0000 7f8ae42f6640 1 --2- 172.21.15.19:0/1258187227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5648e3eac730 0x5648e3e2fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.609+0000 7f8ae42f6640 1 -- 172.21.15.19:0/1258187227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e3dede20 msgr2=0x5648e3f56be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.609+0000 7f8ae42f6640 1 --2- 172.21.15.19:0/1258187227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e3dede20 0x5648e3f56be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.609+0000 7f8ae42f6640 1 -- 172.21.15.19:0/1258187227 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648e3f5a3c0 con 0x5648e3e1b450 2024-09-12T02:02:25.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.609+0000 7f8ae42f6640 1 --2- 172.21.15.19:0/1258187227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e3e1b450 0x5648e3e2f8d0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8005fd0 tx=0x7f8ad8009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.610+0000 7f8ae22f2640 1 -- 172.21.15.19:0/1258187227 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8008dd0 con 0x5648e3e1b450 2024-09-12T02:02:25.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.610+0000 7f8ae22f2640 1 -- 172.21.15.19:0/1258187227 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad8015460 con 0x5648e3e1b450 2024-09-12T02:02:25.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.610+0000 7f8ae22f2640 1 -- 172.21.15.19:0/1258187227 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8015810 con 0x5648e3e1b450 2024-09-12T02:02:25.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.610+0000 7f8ae6ffff40 1 -- 172.21.15.19:0/1258187227 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5648e3f5aa00 con 0x5648e3e1b450 2024-09-12T02:02:25.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.610+0000 7f8ae6ffff40 1 -- 172.21.15.19:0/1258187227 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648e3f5a6a0 con 0x5648e3e1b450 2024-09-12T02:02:25.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.611+0000 7f8ae22f2640 1 -- 172.21.15.19:0/1258187227 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ad801c020 con 0x5648e3e1b450 2024-09-12T02:02:25.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.612+0000 7f8ae22f2640 1 --2- 172.21.15.19:0/1258187227 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8ad006a810 0x7f8ad006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.612+0000 7f8ae22f2640 1 -- 172.21.15.19:0/1258187227 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f8ad80899f0 con 0x5648e3e1b450 2024-09-12T02:02:25.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.612+0000 7f8ae4af7640 1 --2- 172.21.15.19:0/1258187227 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8ad006a810 0x7f8ad006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.612+0000 7f8ae6ffff40 1 --2- 172.21.15.19:0/1258187227 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5648e3f5d2a0 0x5648e3f5d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.612+0000 7f8ae6ffff40 1 -- 172.21.15.19:0/1258187227 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5648e3f5b200 con 0x5648e3f5d2a0 2024-09-12T02:02:25.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.612+0000 7f8ae52f8640 1 --2- 172.21.15.19:0/1258187227 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5648e3f5d2a0 0x5648e3f5d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.612+0000 7f8ae4af7640 1 --2- 172.21.15.19:0/1258187227 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8ad006a810 0x7f8ad006ccd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4017040 tx=0x7f8ad4008000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.612+0000 7f8ae52f8640 1 --2- 172.21.15.19:0/1258187227 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5648e3f5d2a0 0x5648e3f5d680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.613+0000 7f8ae52f8640 1 -- 172.21.15.19:0/1258187227 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x7f8adc056030 con 0x5648e3f5d2a0 2024-09-12T02:02:25.616 INFO:teuthology.orchestra.run.smithi019.stdout:header (274 bytes) : 2024-09-12T02:02:25.616 INFO:teuthology.orchestra.run.smithi019.stdout:00000000 04 03 0c 01 00 00 0d 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:25.616 INFO:teuthology.orchestra.run.smithi019.stdout:00000010 00 00 00 00 00 00 03 02 28 00 00 00 00 00 00 00 |........(.......| 2024-09-12T02:02:25.617 INFO:teuthology.orchestra.run.smithi019.stdout:00000020 00 00 00 00 ae 4b e2 66 2b 4b 96 1f 00 00 00 00 |.....K.f+K......| 2024-09-12T02:02:25.617 INFO:teuthology.orchestra.run.smithi019.stdout:00000030 00 00 00 00 01 00 00 00 00 00 00 00 01 00 00 00 |................| 2024-09-12T02:02:25.617 INFO:teuthology.orchestra.run.smithi019.stdout:00000040 00 00 00 00 03 02 28 00 00 00 00 00 00 00 00 00 |......(.........| 2024-09-12T02:02:25.617 INFO:teuthology.orchestra.run.smithi019.stdout:00000050 00 00 ae 4b e2 66 2b 4b 96 1f 00 00 00 00 00 00 |...K.f+K........| 2024-09-12T02:02:25.617 INFO:teuthology.orchestra.run.smithi019.stdout:00000060 00 00 01 00 00 00 00 00 00 00 01 00 00 00 00 00 |................| 2024-09-12T02:02:25.617 INFO:teuthology.orchestra.run.smithi019.stdout:00000070 00 00 03 02 38 00 00 00 00 00 00 00 00 00 00 00 |....8...........| 2024-09-12T02:02:25.617 INFO:teuthology.orchestra.run.smithi019.stdout:00000080 00 00 60 00 00 00 00 00 01 00 00 00 00 00 00 00 |..`.............| 2024-09-12T02:02:25.617 INFO:teuthology.orchestra.run.smithi019.stdout:00000090 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:25.617 INFO:teuthology.orchestra.run.smithi019.stdout:000000a0 00 00 00 00 00 00 00 00 ae 4b e2 66 f9 fb cf 27 |.........K.f...'| 2024-09-12T02:02:25.617 INFO:teuthology.orchestra.run.smithi019.stdout:000000b0 03 02 38 00 00 00 00 00 00 00 00 00 00 00 00 00 |..8.............| 2024-09-12T02:02:25.617 INFO:teuthology.orchestra.run.smithi019.stdout:000000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 00 |................| 2024-09-12T02:02:25.617 INFO:teuthology.orchestra.run.smithi019.stdout:000000d0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:25.617 INFO:teuthology.orchestra.run.smithi019.stdout:000000e0 00 00 00 00 00 00 ae 4b e2 66 2b 4b 96 1f 00 00 |.......K.f+K....| 2024-09-12T02:02:25.617 INFO:teuthology.orchestra.run.smithi019.stdout:000000f0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-09-12T02:02:25.618 INFO:teuthology.orchestra.run.smithi019.stdout:* 2024-09-12T02:02:25.618 INFO:teuthology.orchestra.run.smithi019.stdout:00000110 00 00 |..| 2024-09-12T02:02:25.618 INFO:teuthology.orchestra.run.smithi019.stdout:00000112 2024-09-12T02:02:25.618 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:25.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.613+0000 7f8ae6ffff40 1 -- 172.21.15.19:0/1258187227 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5648e3f5d2a0 msgr2=0x5648e3f5d680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.613+0000 7f8ae6ffff40 1 --2- 172.21.15.19:0/1258187227 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5648e3f5d2a0 0x5648e3f5d680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.613+0000 7f8ae6ffff40 1 -- 172.21.15.19:0/1258187227 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8ad006a810 msgr2=0x7f8ad006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.613+0000 7f8ae6ffff40 1 --2- 172.21.15.19:0/1258187227 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8ad006a810 0x7f8ad006ccd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4017040 tx=0x7f8ad4008000 comp rx=0 tx=0).stop 2024-09-12T02:02:25.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.613+0000 7f8ae6ffff40 1 -- 172.21.15.19:0/1258187227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e3e1b450 msgr2=0x5648e3e2f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.613+0000 7f8ae6ffff40 1 --2- 172.21.15.19:0/1258187227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e3e1b450 0x5648e3e2f8d0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8005fd0 tx=0x7f8ad8009f80 comp rx=0 tx=0).stop 2024-09-12T02:02:25.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.613+0000 7f8ae52f8640 1 -- 172.21.15.19:0/1258187227 reap_dead start 2024-09-12T02:02:25.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.613+0000 7f8ae6ffff40 1 -- 172.21.15.19:0/1258187227 shutdown_connections 2024-09-12T02:02:25.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.613+0000 7f8ae6ffff40 1 -- 172.21.15.19:0/1258187227 >> 172.21.15.19:0/1258187227 conn(0x5648e3deead0 msgr2=0x5648e3e33980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.613+0000 7f8ae6ffff40 1 -- 172.21.15.19:0/1258187227 shutdown_connections 2024-09-12T02:02:25.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.613+0000 7f8ae6ffff40 1 -- 172.21.15.19:0/1258187227 wait complete. 2024-09-12T02:02:25.620 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000 2024-09-12T02:02:25.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.664+0000 7fbd5f972f40 1 Processor -- start 2024-09-12T02:02:25.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.664+0000 7fbd5f972f40 1 -- start start 2024-09-12T02:02:25.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.665+0000 7fbd5f972f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56073cab7180 0x56073cafa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.665+0000 7fbd5f972f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56073cae5050 0x56073cb6ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.665+0000 7fbd5f972f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56073cb6f080 0x56073cafe0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.665+0000 7fbd5f972f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56073cab3ae0 con 0x56073cb6f080 2024-09-12T02:02:25.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.665+0000 7fbd5f972f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56073ca06510 con 0x56073cab7180 2024-09-12T02:02:25.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.665+0000 7fbd5f972f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56073cab3dc0 con 0x56073cae5050 2024-09-12T02:02:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.665+0000 7fbd5dc69640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56073cb6f080 0x56073cafe0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.665+0000 7fbd5dc69640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56073cb6f080 0x56073cafe0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51096/0 (socket says 172.21.15.19:51096) 2024-09-12T02:02:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.665+0000 7fbd5dc69640 1 -- 172.21.15.19:0/2097076993 learned_addr learned my addr 172.21.15.19:0/2097076993 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.665+0000 7fbd57fff640 1 --2- 172.21.15.19:0/2097076993 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56073cae5050 0x56073cb6ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.665+0000 7fbd5d468640 1 --2- 172.21.15.19:0/2097076993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56073cab7180 0x56073cafa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.665+0000 7fbd5dc69640 1 -- 172.21.15.19:0/2097076993 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56073cae5050 msgr2=0x56073cb6ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.665+0000 7fbd5dc69640 1 --2- 172.21.15.19:0/2097076993 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56073cae5050 0x56073cb6ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.666+0000 7fbd5dc69640 1 -- 172.21.15.19:0/2097076993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56073cab7180 msgr2=0x56073cafa2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.666+0000 7fbd5dc69640 1 --2- 172.21.15.19:0/2097076993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56073cab7180 0x56073cafa2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.666+0000 7fbd5dc69640 1 -- 172.21.15.19:0/2097076993 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56073caff260 con 0x56073cb6f080 2024-09-12T02:02:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.666+0000 7fbd5dc69640 1 --2- 172.21.15.19:0/2097076993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56073cb6f080 0x56073cafe0c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fbd580259b0 tx=0x7fbd58051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f75ce7ce0c9fc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.666+0000 7fbd577fe640 1 -- 172.21.15.19:0/2097076993 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58067070 con 0x56073cb6f080 2024-09-12T02:02:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.666+0000 7fbd577fe640 1 -- 172.21.15.19:0/2097076993 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd58058950 con 0x56073cb6f080 2024-09-12T02:02:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.666+0000 7fbd577fe640 1 -- 172.21.15.19:0/2097076993 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58058d00 con 0x56073cb6f080 2024-09-12T02:02:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.666+0000 7fbd5f972f40 1 -- 172.21.15.19:0/2097076993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56073cb6f080 msgr2=0x56073cafe0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.666+0000 7fbd5f972f40 1 --2- 172.21.15.19:0/2097076993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56073cb6f080 0x56073cafe0c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fbd580259b0 tx=0x7fbd58051000 comp rx=0 tx=0).stop 2024-09-12T02:02:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.666+0000 7fbd5f972f40 1 -- 172.21.15.19:0/2097076993 shutdown_connections 2024-09-12T02:02:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.666+0000 7fbd5f972f40 1 --2- 172.21.15.19:0/2097076993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56073cb6f080 0x56073cafe0c0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.666+0000 7fbd5f972f40 1 --2- 172.21.15.19:0/2097076993 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56073cae5050 0x56073cb6ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.666+0000 7fbd5f972f40 1 --2- 172.21.15.19:0/2097076993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56073cab7180 0x56073cafa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.666+0000 7fbd5f972f40 1 -- 172.21.15.19:0/2097076993 >> 172.21.15.19:0/2097076993 conn(0x56073cab49e0 msgr2=0x56073cafb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.666+0000 7fbd5f972f40 1 -- 172.21.15.19:0/2097076993 shutdown_connections 2024-09-12T02:02:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.666+0000 7fbd5f972f40 1 -- 172.21.15.19:0/2097076993 wait complete. 2024-09-12T02:02:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.667+0000 7fbd5f972f40 1 Processor -- start 2024-09-12T02:02:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.667+0000 7fbd5f972f40 1 -- start start 2024-09-12T02:02:25.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.668+0000 7fbd5f972f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56073cab7180 0x56073cb8cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.668+0000 7fbd5f972f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56073cae5050 0x56073cb849f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.668+0000 7fbd5f972f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56073cb6f080 0x56073cafda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.668+0000 7fbd5f972f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56073cb74540 con 0x56073cae5050 2024-09-12T02:02:25.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.668+0000 7fbd5f972f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56073cb8e630 con 0x56073cb6f080 2024-09-12T02:02:25.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.668+0000 7fbd5f972f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56073cb73d50 con 0x56073cab7180 2024-09-12T02:02:25.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.668+0000 7fbd57fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56073cae5050 0x56073cb849f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.668+0000 7fbd57fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56073cae5050 0x56073cb849f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51112/0 (socket says 172.21.15.19:51112) 2024-09-12T02:02:25.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.668+0000 7fbd5d468640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56073cab7180 0x56073cb8cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.668+0000 7fbd57fff640 1 -- 172.21.15.19:0/3022590150 learned_addr learned my addr 172.21.15.19:0/3022590150 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.668+0000 7fbd5dc69640 1 --2- 172.21.15.19:0/3022590150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56073cb6f080 0x56073cafda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.668+0000 7fbd57fff640 1 -- 172.21.15.19:0/3022590150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56073cab7180 msgr2=0x56073cb8cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.668+0000 7fbd57fff640 1 --2- 172.21.15.19:0/3022590150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56073cab7180 0x56073cb8cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.668+0000 7fbd57fff640 1 -- 172.21.15.19:0/3022590150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56073cb6f080 msgr2=0x56073cafda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.668+0000 7fbd57fff640 1 --2- 172.21.15.19:0/3022590150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56073cb6f080 0x56073cafda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.668+0000 7fbd57fff640 1 -- 172.21.15.19:0/3022590150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56073cb8d1b0 con 0x56073cae5050 2024-09-12T02:02:25.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.668+0000 7fbd5d468640 1 --2- 172.21.15.19:0/3022590150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56073cab7180 0x56073cb8cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:25.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.668+0000 7fbd57fff640 1 --2- 172.21.15.19:0/3022590150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56073cae5050 0x56073cb849f0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fbd48008690 tx=0x7fbd48008780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.669+0000 7fbd567fc640 1 -- 172.21.15.19:0/3022590150 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd480148a0 con 0x56073cae5050 2024-09-12T02:02:25.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.669+0000 7fbd567fc640 1 -- 172.21.15.19:0/3022590150 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd4801a070 con 0x56073cae5050 2024-09-12T02:02:25.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.669+0000 7fbd5f972f40 1 -- 172.21.15.19:0/3022590150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56073cb8f020 con 0x56073cae5050 2024-09-12T02:02:25.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.669+0000 7fbd567fc640 1 -- 172.21.15.19:0/3022590150 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48014c40 con 0x56073cae5050 2024-09-12T02:02:25.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.669+0000 7fbd5f972f40 1 -- 172.21.15.19:0/3022590150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56073cafe670 con 0x56073cae5050 2024-09-12T02:02:25.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.670+0000 7fbd567fc640 1 -- 172.21.15.19:0/3022590150 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd48015470 con 0x56073cae5050 2024-09-12T02:02:25.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.671+0000 7fbd567fc640 1 --2- 172.21.15.19:0/3022590150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbd4006a840 0x7fbd4006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.671+0000 7fbd567fc640 1 -- 172.21.15.19:0/3022590150 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7fbd4808a500 con 0x56073cae5050 2024-09-12T02:02:25.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.671+0000 7fbd5d468640 1 --2- 172.21.15.19:0/3022590150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbd4006a840 0x7fbd4006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.671+0000 7fbd5f972f40 1 --2- 172.21.15.19:0/3022590150 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56073cb88690 0x56073cc25cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.671+0000 7fbd5f972f40 1 -- 172.21.15.19:0/3022590150 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x56073cb866a0 con 0x56073cb88690 2024-09-12T02:02:25.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.671+0000 7fbd5dc69640 1 --2- 172.21.15.19:0/3022590150 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56073cb88690 0x56073cc25cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.671+0000 7fbd5d468640 1 --2- 172.21.15.19:0/3022590150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbd4006a840 0x7fbd4006cd00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbd50000c00 tx=0x7fbd50001720 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.671+0000 7fbd5dc69640 1 --2- 172.21.15.19:0/3022590150 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56073cb88690 0x56073cc25cc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.672+0000 7fbd5dc69640 1 -- 172.21.15.19:0/3022590150 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-keys out=21b] v0'0 uv10 ondisk = 0) ==== 164+0+21 (crc 0 0 0) 0x7fbd5806a040 con 0x56073cb88690 2024-09-12T02:02:25.675 INFO:teuthology.orchestra.run.smithi019.stdout:sixmegs_head 2024-09-12T02:02:25.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.672+0000 7fbd5f972f40 1 -- 172.21.15.19:0/3022590150 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56073cb88690 msgr2=0x56073cc25cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.672+0000 7fbd5f972f40 1 --2- 172.21.15.19:0/3022590150 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56073cb88690 0x56073cc25cc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.672+0000 7fbd5f972f40 1 -- 172.21.15.19:0/3022590150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbd4006a840 msgr2=0x7fbd4006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.672+0000 7fbd5f972f40 1 --2- 172.21.15.19:0/3022590150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbd4006a840 0x7fbd4006cd00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbd50000c00 tx=0x7fbd50001720 comp rx=0 tx=0).stop 2024-09-12T02:02:25.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.672+0000 7fbd5f972f40 1 -- 172.21.15.19:0/3022590150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56073cae5050 msgr2=0x56073cb849f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.672+0000 7fbd5f972f40 1 --2- 172.21.15.19:0/3022590150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56073cae5050 0x56073cb849f0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fbd48008690 tx=0x7fbd48008780 comp rx=0 tx=0).stop 2024-09-12T02:02:25.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.672+0000 7fbd5dc69640 1 -- 172.21.15.19:0/3022590150 reap_dead start 2024-09-12T02:02:25.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.672+0000 7fbd5f972f40 1 -- 172.21.15.19:0/3022590150 shutdown_connections 2024-09-12T02:02:25.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.672+0000 7fbd5f972f40 1 -- 172.21.15.19:0/3022590150 >> 172.21.15.19:0/3022590150 conn(0x56073cab49e0 msgr2=0x56073cb6ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.672+0000 7fbd5f972f40 1 -- 172.21.15.19:0/3022590150 shutdown_connections 2024-09-12T02:02:25.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.672+0000 7fbd5f972f40 1 -- 172.21.15.19:0/3022590150 wait complete. 2024-09-12T02:02:25.678 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 600.00000000 2024-09-12T02:02:25.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.720+0000 7f129031ff40 1 Processor -- start 2024-09-12T02:02:25.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.720+0000 7f129031ff40 1 -- start start 2024-09-12T02:02:25.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.721+0000 7f129031ff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609494c48e0 0x56094959f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.721+0000 7f129031ff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5609495857c0 0x56094950a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.721+0000 7f129031ff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560949585ba0 0x5609495839d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.721+0000 7f129031ff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560949416510 con 0x560949585ba0 2024-09-12T02:02:25.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.721+0000 7f129031ff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56094946fc50 con 0x5609494c48e0 2024-09-12T02:02:25.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.721+0000 7f129031ff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5609494c5250 con 0x5609495857c0 2024-09-12T02:02:25.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.721+0000 7f128db91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560949585ba0 0x5609495839d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.721+0000 7f128db91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560949585ba0 0x5609495839d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51128/0 (socket says 172.21.15.19:51128) 2024-09-12T02:02:25.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.721+0000 7f128db91640 1 -- 172.21.15.19:0/1948933358 learned_addr learned my addr 172.21.15.19:0/1948933358 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.721+0000 7f128cb8f640 1 --2- 172.21.15.19:0/1948933358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5609495857c0 0x56094950a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.721+0000 7f128d390640 1 --2- 172.21.15.19:0/1948933358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609494c48e0 0x56094959f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f128db91640 1 -- 172.21.15.19:0/1948933358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5609495857c0 msgr2=0x56094950a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f128db91640 1 --2- 172.21.15.19:0/1948933358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5609495857c0 0x56094950a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f128db91640 1 -- 172.21.15.19:0/1948933358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609494c48e0 msgr2=0x56094959f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f128db91640 1 --2- 172.21.15.19:0/1948933358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609494c48e0 0x56094959f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f128db91640 1 -- 172.21.15.19:0/1948933358 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609494c6310 con 0x560949585ba0 2024-09-12T02:02:25.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f128d390640 1 --2- 172.21.15.19:0/1948933358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609494c48e0 0x56094959f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:25.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f128db91640 1 --2- 172.21.15.19:0/1948933358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560949585ba0 0x5609495839d0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f1288025b90 tx=0x7f128804f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c2c32ee830d5fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f127f7fe640 1 -- 172.21.15.19:0/1948933358 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128805a050 con 0x560949585ba0 2024-09-12T02:02:25.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f127f7fe640 1 -- 172.21.15.19:0/1948933358 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1288066070 con 0x560949585ba0 2024-09-12T02:02:25.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f127f7fe640 1 -- 172.21.15.19:0/1948933358 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1288055c50 con 0x560949585ba0 2024-09-12T02:02:25.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f129031ff40 1 -- 172.21.15.19:0/1948933358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560949585ba0 msgr2=0x5609495839d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f129031ff40 1 --2- 172.21.15.19:0/1948933358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560949585ba0 0x5609495839d0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f1288025b90 tx=0x7f128804f000 comp rx=0 tx=0).stop 2024-09-12T02:02:25.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f129031ff40 1 -- 172.21.15.19:0/1948933358 shutdown_connections 2024-09-12T02:02:25.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f129031ff40 1 --2- 172.21.15.19:0/1948933358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560949585ba0 0x5609495839d0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f129031ff40 1 --2- 172.21.15.19:0/1948933358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5609495857c0 0x56094950a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f129031ff40 1 --2- 172.21.15.19:0/1948933358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609494c48e0 0x56094959f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f129031ff40 1 -- 172.21.15.19:0/1948933358 >> 172.21.15.19:0/1948933358 conn(0x5609494c5ad0 msgr2=0x5609494efda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f129031ff40 1 -- 172.21.15.19:0/1948933358 shutdown_connections 2024-09-12T02:02:25.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.722+0000 7f129031ff40 1 -- 172.21.15.19:0/1948933358 wait complete. 2024-09-12T02:02:25.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.723+0000 7f129031ff40 1 Processor -- start 2024-09-12T02:02:25.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.723+0000 7f129031ff40 1 -- start start 2024-09-12T02:02:25.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.724+0000 7f129031ff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5609494c48e0 0x560949625290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.724+0000 7f129031ff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609495857c0 0x5609495811c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.724+0000 7f129031ff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560949585ba0 0x560949581700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.724+0000 7f129031ff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5609494f0660 con 0x5609495857c0 2024-09-12T02:02:25.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.724+0000 7f129031ff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5609494f4150 con 0x560949585ba0 2024-09-12T02:02:25.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.724+0000 7f129031ff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5609494f08b0 con 0x5609494c48e0 2024-09-12T02:02:25.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.724+0000 7f128cb8f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609495857c0 0x5609495811c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.724+0000 7f128cb8f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609495857c0 0x5609495811c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51132/0 (socket says 172.21.15.19:51132) 2024-09-12T02:02:25.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.724+0000 7f128cb8f640 1 -- 172.21.15.19:0/2855645433 learned_addr learned my addr 172.21.15.19:0/2855645433 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.724+0000 7f128d390640 1 --2- 172.21.15.19:0/2855645433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5609494c48e0 0x560949625290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.724+0000 7f128db91640 1 --2- 172.21.15.19:0/2855645433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560949585ba0 0x560949581700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.724+0000 7f128cb8f640 1 -- 172.21.15.19:0/2855645433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5609494c48e0 msgr2=0x560949625290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.724+0000 7f128cb8f640 1 --2- 172.21.15.19:0/2855645433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5609494c48e0 0x560949625290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.724+0000 7f128cb8f640 1 -- 172.21.15.19:0/2855645433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560949585ba0 msgr2=0x560949581700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.724+0000 7f128cb8f640 1 --2- 172.21.15.19:0/2855645433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560949585ba0 0x560949581700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.724+0000 7f128cb8f640 1 -- 172.21.15.19:0/2855645433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56094950add0 con 0x5609495857c0 2024-09-12T02:02:25.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.724+0000 7f128cb8f640 1 --2- 172.21.15.19:0/2855645433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609495857c0 0x5609495811c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f128400efb0 tx=0x7f128400c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.725+0000 7f127e7fc640 1 -- 172.21.15.19:0/2855645433 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1284008070 con 0x5609495857c0 2024-09-12T02:02:25.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.725+0000 7f127e7fc640 1 -- 172.21.15.19:0/2855645433 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1284011680 con 0x5609495857c0 2024-09-12T02:02:25.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.725+0000 7f127e7fc640 1 -- 172.21.15.19:0/2855645433 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1284011a30 con 0x5609495857c0 2024-09-12T02:02:25.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.725+0000 7f129031ff40 1 -- 172.21.15.19:0/2855645433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609495989f0 con 0x5609495857c0 2024-09-12T02:02:25.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.725+0000 7f129031ff40 1 -- 172.21.15.19:0/2855645433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56094950aaf0 con 0x5609495857c0 2024-09-12T02:02:25.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.726+0000 7f127e7fc640 1 -- 172.21.15.19:0/2855645433 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1284011bd0 con 0x5609495857c0 2024-09-12T02:02:25.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.726+0000 7f127e7fc640 1 --2- 172.21.15.19:0/2855645433 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f127006a840 0x7f127006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.727+0000 7f127e7fc640 1 -- 172.21.15.19:0/2855645433 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f128408a290 con 0x5609495857c0 2024-09-12T02:02:25.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.727+0000 7f129031ff40 1 --2- 172.21.15.19:0/2855645433 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560949624890 0x560949583720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.727+0000 7f129031ff40 1 -- 172.21.15.19:0/2855645433 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:0d82a743:::600.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x560949584500 con 0x560949624890 2024-09-12T02:02:25.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.727+0000 7f128d390640 1 --2- 172.21.15.19:0/2855645433 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f127006a840 0x7f127006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.727+0000 7f128db91640 1 --2- 172.21.15.19:0/2855645433 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560949624890 0x560949583720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.727+0000 7f128db91640 1 --2- 172.21.15.19:0/2855645433 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560949624890 0x560949583720 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.727+0000 7f128d390640 1 --2- 172.21.15.19:0/2855645433 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f127006a840 0x7f127006cd00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1280000c00 tx=0x7f12800038b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.728+0000 7f128db91640 1 -- 172.21.15.19:0/2855645433 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 600.00000000 [omap-get-keys out=5b] v0'0 uv5 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f128805d070 con 0x560949624890 2024-09-12T02:02:25.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.728+0000 7f129031ff40 1 -- 172.21.15.19:0/2855645433 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560949624890 msgr2=0x560949583720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.728+0000 7f129031ff40 1 --2- 172.21.15.19:0/2855645433 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560949624890 0x560949583720 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.728+0000 7f129031ff40 1 -- 172.21.15.19:0/2855645433 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f127006a840 msgr2=0x7f127006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.728+0000 7f129031ff40 1 --2- 172.21.15.19:0/2855645433 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f127006a840 0x7f127006cd00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1280000c00 tx=0x7f12800038b0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.728+0000 7f129031ff40 1 -- 172.21.15.19:0/2855645433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609495857c0 msgr2=0x5609495811c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.728+0000 7f129031ff40 1 --2- 172.21.15.19:0/2855645433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609495857c0 0x5609495811c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f128400efb0 tx=0x7f128400c710 comp rx=0 tx=0).stop 2024-09-12T02:02:25.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.728+0000 7f128db91640 1 -- 172.21.15.19:0/2855645433 reap_dead start 2024-09-12T02:02:25.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.728+0000 7f129031ff40 1 -- 172.21.15.19:0/2855645433 shutdown_connections 2024-09-12T02:02:25.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.728+0000 7f129031ff40 1 -- 172.21.15.19:0/2855645433 >> 172.21.15.19:0/2855645433 conn(0x5609494c5ad0 msgr2=0x56094959d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.728+0000 7f129031ff40 1 -- 172.21.15.19:0/2855645433 shutdown_connections 2024-09-12T02:02:25.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.728+0000 7f129031ff40 1 -- 172.21.15.19:0/2855645433 wait complete. 2024-09-12T02:02:25.732 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000.inode 2024-09-12T02:02:25.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.817+0000 7f5e8711bf40 1 Processor -- start 2024-09-12T02:02:25.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.817+0000 7f5e8711bf40 1 -- start start 2024-09-12T02:02:25.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.818+0000 7f5e8711bf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e6c0030f0 0x557aa9648750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.818+0000 7f5e8711bf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557aa9632430 0x557aa96c3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.818+0000 7f5e8711bf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557aa9648c90 0x557aa96c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.818+0000 7f5e8711bf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557aa9556510 con 0x557aa9632430 2024-09-12T02:02:25.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.818+0000 7f5e8711bf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557aa95afc50 con 0x557aa9648c90 2024-09-12T02:02:25.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.818+0000 7f5e8711bf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x557aa9632f10 con 0x7f5e6c0030f0 2024-09-12T02:02:25.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.818+0000 7f5e83936640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557aa9632430 0x557aa96c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.818+0000 7f5e83936640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557aa9632430 0x557aa96c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51144/0 (socket says 172.21.15.19:51144) 2024-09-12T02:02:25.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.818+0000 7f5e83936640 1 -- 172.21.15.19:0/1218835286 learned_addr learned my addr 172.21.15.19:0/1218835286 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.818+0000 7f5e83936640 1 -- 172.21.15.19:0/1218835286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e6c0030f0 msgr2=0x557aa9648750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.818+0000 7f5e83936640 1 --2- 172.21.15.19:0/1218835286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e6c0030f0 0x557aa9648750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.818+0000 7f5e83936640 1 -- 172.21.15.19:0/1218835286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557aa9648c90 msgr2=0x557aa96c3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.818+0000 7f5e83936640 1 --2- 172.21.15.19:0/1218835286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557aa9648c90 0x557aa96c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.818+0000 7f5e83936640 1 -- 172.21.15.19:0/1218835286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aa962e100 con 0x557aa9632430 2024-09-12T02:02:25.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.818+0000 7f5e83936640 1 --2- 172.21.15.19:0/1218835286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557aa9632430 0x557aa96c3990 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f5e78025880 tx=0x7f5e7804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1189a7d902aee35e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.818+0000 7f5e82934640 1 -- 172.21.15.19:0/1218835286 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e780543f0 con 0x557aa9632430 2024-09-12T02:02:25.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.818+0000 7f5e82934640 1 -- 172.21.15.19:0/1218835286 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e780547a0 con 0x557aa9632430 2024-09-12T02:02:25.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.818+0000 7f5e82934640 1 -- 172.21.15.19:0/1218835286 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e78054b90 con 0x557aa9632430 2024-09-12T02:02:25.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.819+0000 7f5e8711bf40 1 -- 172.21.15.19:0/1218835286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557aa9632430 msgr2=0x557aa96c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.819+0000 7f5e8711bf40 1 --2- 172.21.15.19:0/1218835286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557aa9632430 0x557aa96c3990 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f5e78025880 tx=0x7f5e7804e000 comp rx=0 tx=0).stop 2024-09-12T02:02:25.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.819+0000 7f5e8711bf40 1 -- 172.21.15.19:0/1218835286 shutdown_connections 2024-09-12T02:02:25.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.819+0000 7f5e8711bf40 1 --2- 172.21.15.19:0/1218835286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557aa9648c90 0x557aa96c3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.819+0000 7f5e8711bf40 1 --2- 172.21.15.19:0/1218835286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557aa9632430 0x557aa96c3990 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.819+0000 7f5e8711bf40 1 --2- 172.21.15.19:0/1218835286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e6c0030f0 0x557aa9648750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.819+0000 7f5e8711bf40 1 -- 172.21.15.19:0/1218835286 >> 172.21.15.19:0/1218835286 conn(0x557aa9605ad0 msgr2=0x557aa9630310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.819+0000 7f5e8711bf40 1 -- 172.21.15.19:0/1218835286 shutdown_connections 2024-09-12T02:02:25.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.819+0000 7f5e8711bf40 1 -- 172.21.15.19:0/1218835286 wait complete. 2024-09-12T02:02:25.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.820+0000 7f5e8711bf40 1 Processor -- start 2024-09-12T02:02:25.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.820+0000 7f5e8711bf40 1 -- start start 2024-09-12T02:02:25.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.820+0000 7f5e8711bf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557aa9632430 0x557aa96c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.820+0000 7f5e8711bf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557aa9648c90 0x557aa96de820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.820+0000 7f5e8711bf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e6c0030f0 0x557aa9766500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.820+0000 7f5e8711bf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557aa964a2e0 con 0x557aa9632430 2024-09-12T02:02:25.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.820+0000 7f5e8711bf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557aa962dc70 con 0x557aa9648c90 2024-09-12T02:02:25.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.820+0000 7f5e8711bf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x557aa96df2a0 con 0x7f5e6c0030f0 2024-09-12T02:02:25.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.820+0000 7f5e84137640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557aa9632430 0x557aa96c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.820+0000 7f5e84137640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557aa9632430 0x557aa96c4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51160/0 (socket says 172.21.15.19:51160) 2024-09-12T02:02:25.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.820+0000 7f5e84137640 1 -- 172.21.15.19:0/3584250989 learned_addr learned my addr 172.21.15.19:0/3584250989 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.821+0000 7f5e84938640 1 --2- 172.21.15.19:0/3584250989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e6c0030f0 0x557aa9766500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.821+0000 7f5e84137640 1 -- 172.21.15.19:0/3584250989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e6c0030f0 msgr2=0x557aa9766500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.821+0000 7f5e83936640 1 --2- 172.21.15.19:0/3584250989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557aa9648c90 0x557aa96de820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.821+0000 7f5e84137640 1 --2- 172.21.15.19:0/3584250989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e6c0030f0 0x557aa9766500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.821+0000 7f5e84137640 1 -- 172.21.15.19:0/3584250989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557aa9648c90 msgr2=0x557aa96de820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.821+0000 7f5e84137640 1 --2- 172.21.15.19:0/3584250989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557aa9648c90 0x557aa96de820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.821+0000 7f5e84137640 1 -- 172.21.15.19:0/3584250989 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aa96bfaa0 con 0x557aa9632430 2024-09-12T02:02:25.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.821+0000 7f5e84137640 1 --2- 172.21.15.19:0/3584250989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557aa9632430 0x557aa96c4680 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f5e74001690 tx=0x7f5e7400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.821+0000 7f5e81932640 1 -- 172.21.15.19:0/3584250989 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74013070 con 0x557aa9632430 2024-09-12T02:02:25.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.821+0000 7f5e81932640 1 -- 172.21.15.19:0/3584250989 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e7400f860 con 0x557aa9632430 2024-09-12T02:02:25.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.821+0000 7f5e8711bf40 1 -- 172.21.15.19:0/3584250989 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557aa9764a30 con 0x557aa9632430 2024-09-12T02:02:25.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.821+0000 7f5e81932640 1 -- 172.21.15.19:0/3584250989 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7400fc30 con 0x557aa9632430 2024-09-12T02:02:25.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.821+0000 7f5e8711bf40 1 -- 172.21.15.19:0/3584250989 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557aa9764ff0 con 0x557aa9632430 2024-09-12T02:02:25.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.823+0000 7f5e81932640 1 -- 172.21.15.19:0/3584250989 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5e74016070 con 0x557aa9632430 2024-09-12T02:02:25.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.823+0000 7f5e81932640 1 --2- 172.21.15.19:0/3584250989 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5e7006a810 0x7f5e7006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.823+0000 7f5e81932640 1 -- 172.21.15.19:0/3584250989 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f5e7408a1e0 con 0x557aa9632430 2024-09-12T02:02:25.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.823+0000 7f5e83936640 1 --2- 172.21.15.19:0/3584250989 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5e7006a810 0x7f5e7006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.823+0000 7f5e8711bf40 1 --2- 172.21.15.19:0/3584250989 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x557aa96df530 0x557aa96be940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.823+0000 7f5e8711bf40 1 -- 172.21.15.19:0/3584250989 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:1 13.14 13:287034c4:::1.00000000.inode:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x557aa96ded60 con 0x557aa96df530 2024-09-12T02:02:25.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.823+0000 7f5e84938640 1 --2- 172.21.15.19:0/3584250989 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x557aa96df530 0x557aa96be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.824+0000 7f5e83936640 1 --2- 172.21.15.19:0/3584250989 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5e7006a810 0x7f5e7006ccd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5e78063000 tx=0x7f5e78051000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.824+0000 7f5e84938640 1 --2- 172.21.15.19:0/3584250989 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x557aa96df530 0x557aa96be940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.824+0000 7f5e84938640 1 -- 172.21.15.19:0/3584250989 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(1 1.00000000.inode [omap-get-keys out=5b] v0'0 uv16 ondisk = 0) ==== 160+0+5 (crc 0 0 0) 0x7f5e7c011040 con 0x557aa96df530 2024-09-12T02:02:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.824+0000 7f5e8711bf40 1 -- 172.21.15.19:0/3584250989 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x557aa96df530 msgr2=0x557aa96be940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.824+0000 7f5e8711bf40 1 --2- 172.21.15.19:0/3584250989 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x557aa96df530 0x557aa96be940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.824+0000 7f5e8711bf40 1 -- 172.21.15.19:0/3584250989 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5e7006a810 msgr2=0x7f5e7006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.824+0000 7f5e8711bf40 1 --2- 172.21.15.19:0/3584250989 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5e7006a810 0x7f5e7006ccd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5e78063000 tx=0x7f5e78051000 comp rx=0 tx=0).stop 2024-09-12T02:02:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.824+0000 7f5e8711bf40 1 -- 172.21.15.19:0/3584250989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557aa9632430 msgr2=0x557aa96c4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.824+0000 7f5e8711bf40 1 --2- 172.21.15.19:0/3584250989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557aa9632430 0x557aa96c4680 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f5e74001690 tx=0x7f5e7400b6c0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.824+0000 7f5e84938640 1 -- 172.21.15.19:0/3584250989 reap_dead start 2024-09-12T02:02:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.824+0000 7f5e8711bf40 1 -- 172.21.15.19:0/3584250989 shutdown_connections 2024-09-12T02:02:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.824+0000 7f5e8711bf40 1 -- 172.21.15.19:0/3584250989 >> 172.21.15.19:0/3584250989 conn(0x557aa9605ad0 msgr2=0x557aa9603be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.824+0000 7f5e8711bf40 1 -- 172.21.15.19:0/3584250989 shutdown_connections 2024-09-12T02:02:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.824+0000 7f5e8711bf40 1 -- 172.21.15.19:0/3584250989 wait complete. 2024-09-12T02:02:25.831 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 200.00000000 2024-09-12T02:02:25.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.874+0000 7f6d72eccf40 1 Processor -- start 2024-09-12T02:02:25.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.874+0000 7f6d72eccf40 1 -- start start 2024-09-12T02:02:25.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.874+0000 7f6d72eccf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c04d41640 0x556c04dced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.874+0000 7f6d72eccf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c04dcdd20 0x556c04dc4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.874+0000 7f6d72eccf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556c04dce100 0x556c04dcbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.874+0000 7f6d72eccf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556c04d426b0 con 0x556c04dcdd20 2024-09-12T02:02:25.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.874+0000 7f6d72eccf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556c04c4a510 con 0x556c04d41640 2024-09-12T02:02:25.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.874+0000 7f6d72eccf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556c04cfd2d0 con 0x556c04dce100 2024-09-12T02:02:25.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.874+0000 7f6d701c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c04dcdd20 0x556c04dc4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.875+0000 7f6d701c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c04dcdd20 0x556c04dc4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51172/0 (socket says 172.21.15.19:51172) 2024-09-12T02:02:25.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.875+0000 7f6d701c1640 1 -- 172.21.15.19:0/2760678112 learned_addr learned my addr 172.21.15.19:0/2760678112 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.875+0000 7f6d709c2640 1 --2- 172.21.15.19:0/2760678112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c04d41640 0x556c04dced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.875+0000 7f6d711c3640 1 --2- 172.21.15.19:0/2760678112 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556c04dce100 0x556c04dcbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.875+0000 7f6d701c1640 1 -- 172.21.15.19:0/2760678112 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556c04dce100 msgr2=0x556c04dcbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.875+0000 7f6d701c1640 1 --2- 172.21.15.19:0/2760678112 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556c04dce100 0x556c04dcbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.875+0000 7f6d701c1640 1 -- 172.21.15.19:0/2760678112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c04d41640 msgr2=0x556c04dced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.875+0000 7f6d701c1640 1 --2- 172.21.15.19:0/2760678112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c04d41640 0x556c04dced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.875+0000 7f6d701c1640 1 -- 172.21.15.19:0/2760678112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c04d43e70 con 0x556c04dcdd20 2024-09-12T02:02:25.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.875+0000 7f6d701c1640 1 --2- 172.21.15.19:0/2760678112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c04dcdd20 0x556c04dc4620 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800b2c0 tx=0x7f6d5800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1668418153a88c92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.875+0000 7f6d6f1bf640 1 -- 172.21.15.19:0/2760678112 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d58008070 con 0x556c04dcdd20 2024-09-12T02:02:25.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.875+0000 7f6d6f1bf640 1 -- 172.21.15.19:0/2760678112 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d5800d500 con 0x556c04dcdd20 2024-09-12T02:02:25.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.875+0000 7f6d6f1bf640 1 -- 172.21.15.19:0/2760678112 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5800d930 con 0x556c04dcdd20 2024-09-12T02:02:25.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.876+0000 7f6d72eccf40 1 -- 172.21.15.19:0/2760678112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c04dcdd20 msgr2=0x556c04dc4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.876+0000 7f6d72eccf40 1 --2- 172.21.15.19:0/2760678112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c04dcdd20 0x556c04dc4620 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800b2c0 tx=0x7f6d5800b780 comp rx=0 tx=0).stop 2024-09-12T02:02:25.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.876+0000 7f6d72eccf40 1 -- 172.21.15.19:0/2760678112 shutdown_connections 2024-09-12T02:02:25.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.876+0000 7f6d72eccf40 1 --2- 172.21.15.19:0/2760678112 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556c04dce100 0x556c04dcbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.876+0000 7f6d72eccf40 1 --2- 172.21.15.19:0/2760678112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c04dcdd20 0x556c04dc4620 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.876+0000 7f6d72eccf40 1 --2- 172.21.15.19:0/2760678112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c04d41640 0x556c04dced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.876+0000 7f6d72eccf40 1 -- 172.21.15.19:0/2760678112 >> 172.21.15.19:0/2760678112 conn(0x556c04d26490 msgr2=0x556c04d26870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.876+0000 7f6d72eccf40 1 -- 172.21.15.19:0/2760678112 shutdown_connections 2024-09-12T02:02:25.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.876+0000 7f6d72eccf40 1 -- 172.21.15.19:0/2760678112 wait complete. 2024-09-12T02:02:25.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.876+0000 7f6d72eccf40 1 Processor -- start 2024-09-12T02:02:25.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.876+0000 7f6d72eccf40 1 -- start start 2024-09-12T02:02:25.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.877+0000 7f6d72eccf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c04d41640 0x556c04daed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.877+0000 7f6d72eccf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c04dcdd20 0x556c04d41a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.877+0000 7f6d72eccf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556c04dce100 0x556c04d243e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.877+0000 7f6d72eccf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556c04dcd0b0 con 0x556c04dcdd20 2024-09-12T02:02:25.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.877+0000 7f6d72eccf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556c04dc83e0 con 0x556c04d41640 2024-09-12T02:02:25.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.877+0000 7f6d72eccf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556c04d429f0 con 0x556c04dce100 2024-09-12T02:02:25.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.877+0000 7f6d701c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c04dcdd20 0x556c04d41a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.877+0000 7f6d701c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c04dcdd20 0x556c04d41a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51188/0 (socket says 172.21.15.19:51188) 2024-09-12T02:02:25.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.877+0000 7f6d701c1640 1 -- 172.21.15.19:0/2207012030 learned_addr learned my addr 172.21.15.19:0/2207012030 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.877+0000 7f6d709c2640 1 --2- 172.21.15.19:0/2207012030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c04d41640 0x556c04daed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.877+0000 7f6d711c3640 1 --2- 172.21.15.19:0/2207012030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556c04dce100 0x556c04d243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.877+0000 7f6d701c1640 1 -- 172.21.15.19:0/2207012030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556c04dce100 msgr2=0x556c04d243e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.877+0000 7f6d701c1640 1 --2- 172.21.15.19:0/2207012030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556c04dce100 0x556c04d243e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.877+0000 7f6d701c1640 1 -- 172.21.15.19:0/2207012030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c04d41640 msgr2=0x556c04daed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.877+0000 7f6d701c1640 1 --2- 172.21.15.19:0/2207012030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c04d41640 0x556c04daed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.877+0000 7f6d701c1640 1 -- 172.21.15.19:0/2207012030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c04dc1120 con 0x556c04dcdd20 2024-09-12T02:02:25.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.878+0000 7f6d701c1640 1 --2- 172.21.15.19:0/2207012030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c04dcdd20 0x556c04d41a20 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800b2c0 tx=0x7f6d58000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.878+0000 7f6d6e1bd640 1 -- 172.21.15.19:0/2207012030 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5801c650 con 0x556c04dcdd20 2024-09-12T02:02:25.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.878+0000 7f6d6e1bd640 1 -- 172.21.15.19:0/2207012030 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d58020070 con 0x556c04dcdd20 2024-09-12T02:02:25.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.878+0000 7f6d72eccf40 1 -- 172.21.15.19:0/2207012030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c04dc1400 con 0x556c04dcdd20 2024-09-12T02:02:25.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.878+0000 7f6d6e1bd640 1 -- 172.21.15.19:0/2207012030 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5801ca30 con 0x556c04dcdd20 2024-09-12T02:02:25.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.878+0000 7f6d72eccf40 1 -- 172.21.15.19:0/2207012030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c04daf290 con 0x556c04dcdd20 2024-09-12T02:02:25.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.879+0000 7f6d6e1bd640 1 -- 172.21.15.19:0/2207012030 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6d58017040 con 0x556c04dcdd20 2024-09-12T02:02:25.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.880+0000 7f6d6e1bd640 1 --2- 172.21.15.19:0/2207012030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6d5006a810 0x7f6d5006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.880+0000 7f6d6e1bd640 1 -- 172.21.15.19:0/2207012030 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f6d5808bce0 con 0x556c04dcdd20 2024-09-12T02:02:25.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.880+0000 7f6d709c2640 1 --2- 172.21.15.19:0/2207012030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6d5006a810 0x7f6d5006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.880+0000 7f6d72eccf40 1 --2- 172.21.15.19:0/2207012030 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556c04dc85d0 0x556c04dc5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.880+0000 7f6d72eccf40 1 -- 172.21.15.19:0/2207012030 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:1 13.14 13:292cf221:::200.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x556c04dc6510 con 0x556c04dc85d0 2024-09-12T02:02:25.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.880+0000 7f6d711c3640 1 --2- 172.21.15.19:0/2207012030 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556c04dc85d0 0x556c04dc5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.880+0000 7f6d709c2640 1 --2- 172.21.15.19:0/2207012030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6d5006a810 0x7f6d5006ccd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6d60005fd0 tx=0x7f6d60007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.880+0000 7f6d711c3640 1 --2- 172.21.15.19:0/2207012030 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556c04dc85d0 0x556c04dc5fd0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.881+0000 7f6d711c3640 1 -- 172.21.15.19:0/2207012030 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(1 200.00000000 [omap-get-keys out=5b] v0'0 uv20 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f6d68052890 con 0x556c04dc85d0 2024-09-12T02:02:25.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.881+0000 7f6d72eccf40 1 -- 172.21.15.19:0/2207012030 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556c04dc85d0 msgr2=0x556c04dc5fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.881+0000 7f6d72eccf40 1 --2- 172.21.15.19:0/2207012030 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556c04dc85d0 0x556c04dc5fd0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.881+0000 7f6d72eccf40 1 -- 172.21.15.19:0/2207012030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6d5006a810 msgr2=0x7f6d5006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.881+0000 7f6d72eccf40 1 --2- 172.21.15.19:0/2207012030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6d5006a810 0x7f6d5006ccd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6d60005fd0 tx=0x7f6d60007040 comp rx=0 tx=0).stop 2024-09-12T02:02:25.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.881+0000 7f6d72eccf40 1 -- 172.21.15.19:0/2207012030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c04dcdd20 msgr2=0x556c04d41a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.881+0000 7f6d72eccf40 1 --2- 172.21.15.19:0/2207012030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c04dcdd20 0x556c04d41a20 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800b2c0 tx=0x7f6d58000ed0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.881+0000 7f6d711c3640 1 -- 172.21.15.19:0/2207012030 reap_dead start 2024-09-12T02:02:25.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.881+0000 7f6d72eccf40 1 -- 172.21.15.19:0/2207012030 shutdown_connections 2024-09-12T02:02:25.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.881+0000 7f6d72eccf40 1 -- 172.21.15.19:0/2207012030 >> 172.21.15.19:0/2207012030 conn(0x556c04d26490 msgr2=0x556c04d26870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.881+0000 7f6d72eccf40 1 -- 172.21.15.19:0/2207012030 shutdown_connections 2024-09-12T02:02:25.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.881+0000 7f6d72eccf40 1 -- 172.21.15.19:0/2207012030 wait complete. 2024-09-12T02:02:25.887 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 200.00000001 2024-09-12T02:02:25.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.929+0000 7ff1823b4f40 1 Processor -- start 2024-09-12T02:02:25.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.929+0000 7ff1823b4f40 1 -- start start 2024-09-12T02:02:25.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.930+0000 7ff1823b4f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564012be180 0x556401392a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.930+0000 7ff1823b4f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5564012ec050 0x556401395fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.930+0000 7ff1823b4f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556401376080 0x5564013720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.930+0000 7ff1823b4f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5564012be5c0 con 0x5564012be180 2024-09-12T02:02:25.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.930+0000 7ff1823b4f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55640120d510 con 0x556401376080 2024-09-12T02:02:25.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.930+0000 7ff1823b4f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5564012baae0 con 0x5564012ec050 2024-09-12T02:02:25.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.930+0000 7ff17feaa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564012be180 0x556401392a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.930+0000 7ff17feaa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564012be180 0x556401392a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51206/0 (socket says 172.21.15.19:51206) 2024-09-12T02:02:25.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.930+0000 7ff17feaa640 1 -- 172.21.15.19:0/4260749849 learned_addr learned my addr 172.21.15.19:0/4260749849 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.930+0000 7ff17f6a9640 1 --2- 172.21.15.19:0/4260749849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5564012ec050 0x556401395fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.930+0000 7ff1806ab640 1 --2- 172.21.15.19:0/4260749849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556401376080 0x5564013720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.930+0000 7ff17feaa640 1 -- 172.21.15.19:0/4260749849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5564012ec050 msgr2=0x556401395fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.930+0000 7ff17feaa640 1 --2- 172.21.15.19:0/4260749849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5564012ec050 0x556401395fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.930+0000 7ff17feaa640 1 -- 172.21.15.19:0/4260749849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556401376080 msgr2=0x5564013720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:25.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.930+0000 7ff17feaa640 1 --2- 172.21.15.19:0/4260749849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556401376080 0x5564013720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.930+0000 7ff17feaa640 1 -- 172.21.15.19:0/4260749849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55640137bb90 con 0x5564012be180 2024-09-12T02:02:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.931+0000 7ff17feaa640 1 --2- 172.21.15.19:0/4260749849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564012be180 0x556401392a00 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7ff170005fd0 tx=0x7ff170050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad84471958a1590c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.931+0000 7ff17e6a7640 1 -- 172.21.15.19:0/4260749849 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17004fb90 con 0x5564012be180 2024-09-12T02:02:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.931+0000 7ff17e6a7640 1 -- 172.21.15.19:0/4260749849 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff17004fd50 con 0x5564012be180 2024-09-12T02:02:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.931+0000 7ff17e6a7640 1 -- 172.21.15.19:0/4260749849 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff170057640 con 0x5564012be180 2024-09-12T02:02:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.931+0000 7ff1823b4f40 1 -- 172.21.15.19:0/4260749849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564012be180 msgr2=0x556401392a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.931+0000 7ff1823b4f40 1 --2- 172.21.15.19:0/4260749849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564012be180 0x556401392a00 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7ff170005fd0 tx=0x7ff170050000 comp rx=0 tx=0).stop 2024-09-12T02:02:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.931+0000 7ff1823b4f40 1 -- 172.21.15.19:0/4260749849 shutdown_connections 2024-09-12T02:02:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.931+0000 7ff1823b4f40 1 --2- 172.21.15.19:0/4260749849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556401376080 0x5564013720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.931+0000 7ff1823b4f40 1 --2- 172.21.15.19:0/4260749849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5564012ec050 0x556401395fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.931+0000 7ff1823b4f40 1 --2- 172.21.15.19:0/4260749849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564012be180 0x556401392a00 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.931+0000 7ff1823b4f40 1 -- 172.21.15.19:0/4260749849 >> 172.21.15.19:0/4260749849 conn(0x5564012bb9e0 msgr2=0x556401302370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.931+0000 7ff1823b4f40 1 -- 172.21.15.19:0/4260749849 shutdown_connections 2024-09-12T02:02:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.931+0000 7ff1823b4f40 1 -- 172.21.15.19:0/4260749849 wait complete. 2024-09-12T02:02:25.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.932+0000 7ff1823b4f40 1 Processor -- start 2024-09-12T02:02:25.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.932+0000 7ff1823b4f40 1 -- start start 2024-09-12T02:02:25.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff1823b4f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564012be180 0x5564012ea1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff1823b4f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564012ec050 0x556401376c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff1823b4f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556401376080 0x556401372650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff1823b4f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5564012eaeb0 con 0x5564012ec050 2024-09-12T02:02:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff1823b4f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556401375660 con 0x5564012be180 2024-09-12T02:02:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff1823b4f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5564012e7f30 con 0x556401376080 2024-09-12T02:02:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff17f6a9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564012ec050 0x556401376c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff17f6a9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564012ec050 0x556401376c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51218/0 (socket says 172.21.15.19:51218) 2024-09-12T02:02:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff17feaa640 1 --2- 172.21.15.19:0/336826193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564012be180 0x5564012ea1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff17f6a9640 1 -- 172.21.15.19:0/336826193 learned_addr learned my addr 172.21.15.19:0/336826193 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff1806ab640 1 --2- 172.21.15.19:0/336826193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556401376080 0x556401372650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff17f6a9640 1 -- 172.21.15.19:0/336826193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556401376080 msgr2=0x556401372650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff17f6a9640 1 --2- 172.21.15.19:0/336826193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556401376080 0x556401372650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff17f6a9640 1 -- 172.21.15.19:0/336826193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564012be180 msgr2=0x5564012ea1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff17f6a9640 1 --2- 172.21.15.19:0/336826193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564012be180 0x5564012ea1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff17f6a9640 1 -- 172.21.15.19:0/336826193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55640137b8b0 con 0x5564012ec050 2024-09-12T02:02:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff17f6a9640 1 --2- 172.21.15.19:0/336826193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564012ec050 0x556401376c00 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x5564012bc1c0 tx=0x7ff1740086a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff17d6a5640 1 -- 172.21.15.19:0/336826193 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff174019020 con 0x5564012ec050 2024-09-12T02:02:25.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff17d6a5640 1 -- 172.21.15.19:0/336826193 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff174015880 con 0x5564012ec050 2024-09-12T02:02:25.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.933+0000 7ff1823b4f40 1 -- 172.21.15.19:0/336826193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556401302520 con 0x5564012ec050 2024-09-12T02:02:25.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.934+0000 7ff17d6a5640 1 -- 172.21.15.19:0/336826193 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff174015c30 con 0x5564012ec050 2024-09-12T02:02:25.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.934+0000 7ff1823b4f40 1 -- 172.21.15.19:0/336826193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556401302800 con 0x5564012ec050 2024-09-12T02:02:25.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.935+0000 7ff17d6a5640 1 -- 172.21.15.19:0/336826193 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff17401c020 con 0x5564012ec050 2024-09-12T02:02:25.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.935+0000 7ff17d6a5640 1 --2- 172.21.15.19:0/336826193 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff16c06a810 0x7ff16c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.935+0000 7ff17d6a5640 1 -- 172.21.15.19:0/336826193 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7ff17408a250 con 0x5564012ec050 2024-09-12T02:02:25.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.935+0000 7ff17feaa640 1 --2- 172.21.15.19:0/336826193 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff16c06a810 0x7ff16c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.936+0000 7ff1823b4f40 1 --2- 172.21.15.19:0/336826193 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5564012ea6f0 0x556401372b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:25.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.936+0000 7ff1823b4f40 1 -- 172.21.15.19:0/336826193 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:1 13.14 13:2e2fa760:::200.00000001:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x556401374ed0 con 0x5564012ea6f0 2024-09-12T02:02:25.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.936+0000 7ff1806ab640 1 --2- 172.21.15.19:0/336826193 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5564012ea6f0 0x556401372b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:25.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.936+0000 7ff17feaa640 1 --2- 172.21.15.19:0/336826193 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff16c06a810 0x7ff16c06ccd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff170059000 tx=0x7ff170051000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.936+0000 7ff1806ab640 1 --2- 172.21.15.19:0/336826193 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5564012ea6f0 0x556401372b90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:25.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.936+0000 7ff1806ab640 1 -- 172.21.15.19:0/336826193 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(1 200.00000001 [omap-get-keys out=5b] v0'0 uv17 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7ff1780019d0 con 0x5564012ea6f0 2024-09-12T02:02:25.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.936+0000 7ff1823b4f40 1 -- 172.21.15.19:0/336826193 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5564012ea6f0 msgr2=0x556401372b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.936+0000 7ff1823b4f40 1 --2- 172.21.15.19:0/336826193 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5564012ea6f0 0x556401372b90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.936+0000 7ff1823b4f40 1 -- 172.21.15.19:0/336826193 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff16c06a810 msgr2=0x7ff16c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.936+0000 7ff1823b4f40 1 --2- 172.21.15.19:0/336826193 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff16c06a810 0x7ff16c06ccd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff170059000 tx=0x7ff170051000 comp rx=0 tx=0).stop 2024-09-12T02:02:25.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.936+0000 7ff1823b4f40 1 -- 172.21.15.19:0/336826193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564012ec050 msgr2=0x556401376c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:25.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.936+0000 7ff1823b4f40 1 --2- 172.21.15.19:0/336826193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564012ec050 0x556401376c00 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x5564012bc1c0 tx=0x7ff1740086a0 comp rx=0 tx=0).stop 2024-09-12T02:02:25.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.936+0000 7ff1806ab640 1 -- 172.21.15.19:0/336826193 reap_dead start 2024-09-12T02:02:25.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.936+0000 7ff1823b4f40 1 -- 172.21.15.19:0/336826193 shutdown_connections 2024-09-12T02:02:25.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.937+0000 7ff1823b4f40 1 -- 172.21.15.19:0/336826193 >> 172.21.15.19:0/336826193 conn(0x5564012bb9e0 msgr2=0x556401395720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:25.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.937+0000 7ff1823b4f40 1 -- 172.21.15.19:0/336826193 shutdown_connections 2024-09-12T02:02:25.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:25.937+0000 7ff1823b4f40 1 -- 172.21.15.19:0/336826193 wait complete. 2024-09-12T02:02:25.942 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys mds0_openfiles.0 2024-09-12T02:02:26.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.026+0000 7fb7c9748f40 1 Processor -- start 2024-09-12T02:02:26.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.026+0000 7fb7c9748f40 1 -- start start 2024-09-12T02:02:26.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.027+0000 7fb7c9748f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b0a4a1f350 0x55b0a4a63430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.027+0000 7fb7c9748f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0a4a4d050 0x55b0a4af6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.027+0000 7fb7c9748f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0a4ad7080 0x55b0a4a1e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.027+0000 7fb7c9748f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b0a4a1bae0 con 0x55b0a4ad7080 2024-09-12T02:02:26.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.027+0000 7fb7c9748f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b0a496e510 con 0x55b0a4a4d050 2024-09-12T02:02:26.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.027+0000 7fb7c9748f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55b0a4a1bdc0 con 0x55b0a4a1f350 2024-09-12T02:02:26.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.027+0000 7fb7c7a3f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0a4ad7080 0x55b0a4a1e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.027+0000 7fb7c7a3f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0a4ad7080 0x55b0a4a1e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51224/0 (socket says 172.21.15.19:51224) 2024-09-12T02:02:26.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.027+0000 7fb7c7a3f640 1 -- 172.21.15.19:0/2285656588 learned_addr learned my addr 172.21.15.19:0/2285656588 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.027+0000 7fb7c723e640 1 --2- 172.21.15.19:0/2285656588 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b0a4a1f350 0x55b0a4a63430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.027+0000 7fb7c6a3d640 1 --2- 172.21.15.19:0/2285656588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0a4a4d050 0x55b0a4af6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.028+0000 7fb7c7a3f640 1 -- 172.21.15.19:0/2285656588 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b0a4a1f350 msgr2=0x55b0a4a63430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.028+0000 7fb7c7a3f640 1 --2- 172.21.15.19:0/2285656588 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b0a4a1f350 0x55b0a4a63430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.028+0000 7fb7c7a3f640 1 -- 172.21.15.19:0/2285656588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0a4a4d050 msgr2=0x55b0a4af6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.028+0000 7fb7c7a3f640 1 --2- 172.21.15.19:0/2285656588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0a4a4d050 0x55b0a4af6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.028+0000 7fb7c7a3f640 1 -- 172.21.15.19:0/2285656588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0a4af67c0 con 0x55b0a4ad7080 2024-09-12T02:02:26.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.028+0000 7fb7c7a3f640 1 --2- 172.21.15.19:0/2285656588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0a4ad7080 0x55b0a4a1e6d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000a4b0 tx=0x7fb7c0050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b35aac613f37cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.028+0000 7fb7c5a3b640 1 -- 172.21.15.19:0/2285656588 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c004eb60 con 0x55b0a4ad7080 2024-09-12T02:02:26.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.028+0000 7fb7c5a3b640 1 -- 172.21.15.19:0/2285656588 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c0066070 con 0x55b0a4ad7080 2024-09-12T02:02:26.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.028+0000 7fb7c5a3b640 1 -- 172.21.15.19:0/2285656588 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0061420 con 0x55b0a4ad7080 2024-09-12T02:02:26.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.028+0000 7fb7c9748f40 1 -- 172.21.15.19:0/2285656588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0a4ad7080 msgr2=0x55b0a4a1e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.028+0000 7fb7c9748f40 1 --2- 172.21.15.19:0/2285656588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0a4ad7080 0x55b0a4a1e6d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000a4b0 tx=0x7fb7c0050000 comp rx=0 tx=0).stop 2024-09-12T02:02:26.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.028+0000 7fb7c9748f40 1 -- 172.21.15.19:0/2285656588 shutdown_connections 2024-09-12T02:02:26.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.028+0000 7fb7c9748f40 1 --2- 172.21.15.19:0/2285656588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0a4ad7080 0x55b0a4a1e6d0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.028+0000 7fb7c9748f40 1 --2- 172.21.15.19:0/2285656588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0a4a4d050 0x55b0a4af6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.028+0000 7fb7c9748f40 1 --2- 172.21.15.19:0/2285656588 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b0a4a1f350 0x55b0a4a63430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.028+0000 7fb7c9748f40 1 -- 172.21.15.19:0/2285656588 >> 172.21.15.19:0/2285656588 conn(0x55b0a4a1c9e0 msgr2=0x55b0a4a1cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.029+0000 7fb7c9748f40 1 -- 172.21.15.19:0/2285656588 shutdown_connections 2024-09-12T02:02:26.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.029+0000 7fb7c9748f40 1 -- 172.21.15.19:0/2285656588 wait complete. 2024-09-12T02:02:26.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.029+0000 7fb7c9748f40 1 Processor -- start 2024-09-12T02:02:26.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.029+0000 7fb7c9748f40 1 -- start start 2024-09-12T02:02:26.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.030+0000 7fb7c9748f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0a4a1f350 0x55b0a4aea720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.030+0000 7fb7c9748f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b0a4a4d050 0x55b0a4adb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.030+0000 7fb7c9748f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0a4ad7080 0x55b0a4ad48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.030+0000 7fb7c9748f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b0a4af47a0 con 0x55b0a4ad7080 2024-09-12T02:02:26.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.030+0000 7fb7c9748f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b0a4a66c20 con 0x55b0a4a1f350 2024-09-12T02:02:26.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.030+0000 7fb7c9748f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55b0a4af4a80 con 0x55b0a4a4d050 2024-09-12T02:02:26.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.030+0000 7fb7c7a3f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0a4ad7080 0x55b0a4ad48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.030+0000 7fb7c7a3f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0a4ad7080 0x55b0a4ad48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51228/0 (socket says 172.21.15.19:51228) 2024-09-12T02:02:26.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.030+0000 7fb7c7a3f640 1 -- 172.21.15.19:0/148838621 learned_addr learned my addr 172.21.15.19:0/148838621 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.030+0000 7fb7c723e640 1 --2- 172.21.15.19:0/148838621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0a4a1f350 0x55b0a4aea720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.030+0000 7fb7c6a3d640 1 --2- 172.21.15.19:0/148838621 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b0a4a4d050 0x55b0a4adb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.030+0000 7fb7c7a3f640 1 -- 172.21.15.19:0/148838621 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b0a4a4d050 msgr2=0x55b0a4adb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.030+0000 7fb7c7a3f640 1 --2- 172.21.15.19:0/148838621 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b0a4a4d050 0x55b0a4adb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.030+0000 7fb7c7a3f640 1 -- 172.21.15.19:0/148838621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0a4a1f350 msgr2=0x55b0a4aea720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.030+0000 7fb7c7a3f640 1 --2- 172.21.15.19:0/148838621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0a4a1f350 0x55b0a4aea720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.030+0000 7fb7c7a3f640 1 -- 172.21.15.19:0/148838621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0a4adbf00 con 0x55b0a4ad7080 2024-09-12T02:02:26.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.030+0000 7fb7c723e640 1 --2- 172.21.15.19:0/148838621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0a4a1f350 0x55b0a4aea720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:26.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.030+0000 7fb7c7a3f640 1 --2- 172.21.15.19:0/148838621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0a4ad7080 0x55b0a4ad48f0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0063040 tx=0x7fb7c0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.031+0000 7fb7c4a39640 1 -- 172.21.15.19:0/148838621 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0073070 con 0x55b0a4ad7080 2024-09-12T02:02:26.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.031+0000 7fb7c4a39640 1 -- 172.21.15.19:0/148838621 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c005c040 con 0x55b0a4ad7080 2024-09-12T02:02:26.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.031+0000 7fb7c9748f40 1 -- 172.21.15.19:0/148838621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0a4ad8f60 con 0x55b0a4ad7080 2024-09-12T02:02:26.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.031+0000 7fb7c4a39640 1 -- 172.21.15.19:0/148838621 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c006a420 con 0x55b0a4ad7080 2024-09-12T02:02:26.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.031+0000 7fb7c9748f40 1 -- 172.21.15.19:0/148838621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0a4ad9520 con 0x55b0a4ad7080 2024-09-12T02:02:26.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.032+0000 7fb7c4a39640 1 -- 172.21.15.19:0/148838621 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7c0076070 con 0x55b0a4ad7080 2024-09-12T02:02:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.032+0000 7fb7c4a39640 1 --2- 172.21.15.19:0/148838621 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb7b406a840 0x7fb7b406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.033+0000 7fb7c4a39640 1 -- 172.21.15.19:0/148838621 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7fb7c00cefb0 con 0x55b0a4ad7080 2024-09-12T02:02:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.033+0000 7fb7c9748f40 1 --2- 172.21.15.19:0/148838621 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b0a4ad9d20 0x55b0a4ada130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.033+0000 7fb7c9748f40 1 -- 172.21.15.19:0/148838621 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:1 13.6 13:654134d2:::mds0_openfiles.0:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55b0a4ada670 con 0x55b0a4ad9d20 2024-09-12T02:02:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.033+0000 7fb7c723e640 1 --2- 172.21.15.19:0/148838621 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb7b406a840 0x7fb7b406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.033+0000 7fb7c6a3d640 1 --2- 172.21.15.19:0/148838621 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b0a4ad9d20 0x55b0a4ada130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.033+0000 7fb7c723e640 1 --2- 172.21.15.19:0/148838621 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb7b406a840 0x7fb7b406cd00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8005fd0 tx=0x7fb7b8005a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.033+0000 7fb7c6a3d640 1 --2- 172.21.15.19:0/148838621 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b0a4ad9d20 0x55b0a4ada130 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.034+0000 7fb7c6a3d640 1 -- 172.21.15.19:0/148838621 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(1 mds0_openfiles.0 [omap-get-keys out=5b] v0'0 uv2 ondisk = 0) ==== 160+0+5 (crc 0 0 0) 0x7fb7bc00e040 con 0x55b0a4ad9d20 2024-09-12T02:02:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.034+0000 7fb7c9748f40 1 -- 172.21.15.19:0/148838621 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b0a4ad9d20 msgr2=0x55b0a4ada130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.034+0000 7fb7c9748f40 1 --2- 172.21.15.19:0/148838621 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b0a4ad9d20 0x55b0a4ada130 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.034+0000 7fb7c9748f40 1 -- 172.21.15.19:0/148838621 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb7b406a840 msgr2=0x7fb7b406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.034+0000 7fb7c9748f40 1 --2- 172.21.15.19:0/148838621 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb7b406a840 0x7fb7b406cd00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8005fd0 tx=0x7fb7b8005a50 comp rx=0 tx=0).stop 2024-09-12T02:02:26.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.034+0000 7fb7c9748f40 1 -- 172.21.15.19:0/148838621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0a4ad7080 msgr2=0x55b0a4ad48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.034+0000 7fb7c9748f40 1 --2- 172.21.15.19:0/148838621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0a4ad7080 0x55b0a4ad48f0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0063040 tx=0x7fb7c0003330 comp rx=0 tx=0).stop 2024-09-12T02:02:26.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.034+0000 7fb7c7a3f640 1 -- 172.21.15.19:0/148838621 reap_dead start 2024-09-12T02:02:26.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.034+0000 7fb7c9748f40 1 -- 172.21.15.19:0/148838621 shutdown_connections 2024-09-12T02:02:26.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.034+0000 7fb7c9748f40 1 -- 172.21.15.19:0/148838621 >> 172.21.15.19:0/148838621 conn(0x55b0a4a1c9e0 msgr2=0x55b0a4a1cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.034+0000 7fb7c9748f40 1 -- 172.21.15.19:0/148838621 shutdown_connections 2024-09-12T02:02:26.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.034+0000 7fb7c9748f40 1 -- 172.21.15.19:0/148838621 wait complete. 2024-09-12T02:02:26.039 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 500.00000000 2024-09-12T02:02:26.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.124+0000 7f5f78bdcf40 1 Processor -- start 2024-09-12T02:02:26.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.124+0000 7f5f78bdcf40 1 -- start start 2024-09-12T02:02:26.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.124+0000 7f5f78bdcf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625b82ea350 0x5625b83beb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.124+0000 7f5f78bdcf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5625b8318050 0x5625b832ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.124+0000 7f5f78bdcf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625b83a2080 0x5625b839dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.124+0000 7f5f78bdcf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5625b82e6ae0 con 0x5625b82ea350 2024-09-12T02:02:26.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.124+0000 7f5f78bdcf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5625b8239510 con 0x5625b83a2080 2024-09-12T02:02:26.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.124+0000 7f5f78bdcf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5625b82e6dc0 con 0x5625b8318050 2024-09-12T02:02:26.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.124+0000 7f5f766d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625b82ea350 0x5625b83beb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.124+0000 7f5f766d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625b82ea350 0x5625b83beb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51240/0 (socket says 172.21.15.19:51240) 2024-09-12T02:02:26.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.124+0000 7f5f766d4640 1 -- 172.21.15.19:0/3756070294 learned_addr learned my addr 172.21.15.19:0/3756070294 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.125+0000 7f5f76ed5640 1 --2- 172.21.15.19:0/3756070294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625b83a2080 0x5625b839dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.125+0000 7f5f75ed3640 1 --2- 172.21.15.19:0/3756070294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5625b8318050 0x5625b832ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.125+0000 7f5f766d4640 1 -- 172.21.15.19:0/3756070294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5625b8318050 msgr2=0x5625b832ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.125+0000 7f5f766d4640 1 --2- 172.21.15.19:0/3756070294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5625b8318050 0x5625b832ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.125+0000 7f5f766d4640 1 -- 172.21.15.19:0/3756070294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625b83a2080 msgr2=0x5625b839dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.125+0000 7f5f766d4640 1 --2- 172.21.15.19:0/3756070294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625b83a2080 0x5625b839dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.125+0000 7f5f766d4640 1 -- 172.21.15.19:0/3756070294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625b83c22f0 con 0x5625b82ea350 2024-09-12T02:02:26.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.125+0000 7f5f75ed3640 1 --2- 172.21.15.19:0/3756070294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5625b8318050 0x5625b832ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:26.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.125+0000 7f5f766d4640 1 --2- 172.21.15.19:0/3756070294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625b82ea350 0x5625b83beb10 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f5f6800a4a0 tx=0x7f5f68051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86cf01b465b83180 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.125+0000 7f5f74ed1640 1 -- 172.21.15.19:0/3756070294 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f68067070 con 0x5625b82ea350 2024-09-12T02:02:26.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.125+0000 7f5f74ed1640 1 -- 172.21.15.19:0/3756070294 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f68058b50 con 0x5625b82ea350 2024-09-12T02:02:26.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.125+0000 7f5f74ed1640 1 -- 172.21.15.19:0/3756070294 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f68062430 con 0x5625b82ea350 2024-09-12T02:02:26.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.126+0000 7f5f78bdcf40 1 -- 172.21.15.19:0/3756070294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625b82ea350 msgr2=0x5625b83beb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.126+0000 7f5f78bdcf40 1 --2- 172.21.15.19:0/3756070294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625b82ea350 0x5625b83beb10 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f5f6800a4a0 tx=0x7f5f68051000 comp rx=0 tx=0).stop 2024-09-12T02:02:26.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.126+0000 7f5f78bdcf40 1 -- 172.21.15.19:0/3756070294 shutdown_connections 2024-09-12T02:02:26.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.126+0000 7f5f78bdcf40 1 --2- 172.21.15.19:0/3756070294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625b83a2080 0x5625b839dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.126+0000 7f5f78bdcf40 1 --2- 172.21.15.19:0/3756070294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5625b8318050 0x5625b832ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.126+0000 7f5f78bdcf40 1 --2- 172.21.15.19:0/3756070294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625b82ea350 0x5625b83beb10 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.126+0000 7f5f78bdcf40 1 -- 172.21.15.19:0/3756070294 >> 172.21.15.19:0/3756070294 conn(0x5625b82e79e0 msgr2=0x5625b832e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.126+0000 7f5f78bdcf40 1 -- 172.21.15.19:0/3756070294 shutdown_connections 2024-09-12T02:02:26.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.126+0000 7f5f78bdcf40 1 -- 172.21.15.19:0/3756070294 wait complete. 2024-09-12T02:02:26.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.126+0000 7f5f78bdcf40 1 Processor -- start 2024-09-12T02:02:26.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.126+0000 7f5f78bdcf40 1 -- start start 2024-09-12T02:02:26.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.127+0000 7f5f78bdcf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625b82ea350 0x5625b839de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.127+0000 7f5f78bdcf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5625b8318050 0x5625b83a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.127+0000 7f5f78bdcf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625b83a2080 0x5625b839ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.127+0000 7f5f78bdcf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5625b82ea170 con 0x5625b83a2080 2024-09-12T02:02:26.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.127+0000 7f5f78bdcf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5625b83a7ac0 con 0x5625b82ea350 2024-09-12T02:02:26.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.127+0000 7f5f78bdcf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5625b8313fa0 con 0x5625b8318050 2024-09-12T02:02:26.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.127+0000 7f5f76ed5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625b83a2080 0x5625b839ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.127+0000 7f5f766d4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625b82ea350 0x5625b839de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.127+0000 7f5f766d4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625b82ea350 0x5625b839de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:50646/0 (socket says 172.21.15.19:50646) 2024-09-12T02:02:26.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.127+0000 7f5f75ed3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5625b8318050 0x5625b83a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.127+0000 7f5f766d4640 1 -- 172.21.15.19:0/2295199786 learned_addr learned my addr 172.21.15.19:0/2295199786 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.127+0000 7f5f76ed5640 1 -- 172.21.15.19:0/2295199786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5625b8318050 msgr2=0x5625b83a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.127+0000 7f5f76ed5640 1 --2- 172.21.15.19:0/2295199786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5625b8318050 0x5625b83a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.127+0000 7f5f76ed5640 1 -- 172.21.15.19:0/2295199786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625b82ea350 msgr2=0x5625b839de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.127+0000 7f5f76ed5640 1 --2- 172.21.15.19:0/2295199786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625b82ea350 0x5625b839de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.127+0000 7f5f76ed5640 1 -- 172.21.15.19:0/2295199786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625b83a0c30 con 0x5625b83a2080 2024-09-12T02:02:26.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.127+0000 7f5f766d4640 1 --2- 172.21.15.19:0/2295199786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625b82ea350 0x5625b839de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:26.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.128+0000 7f5f76ed5640 1 --2- 172.21.15.19:0/2295199786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625b83a2080 0x5625b839ca50 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f5f70005fd0 tx=0x7f5f70009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.128+0000 7f5f6f7fe640 1 -- 172.21.15.19:0/2295199786 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70015460 con 0x5625b83a2080 2024-09-12T02:02:26.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.128+0000 7f5f6f7fe640 1 -- 172.21.15.19:0/2295199786 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f7001a070 con 0x5625b83a2080 2024-09-12T02:02:26.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.128+0000 7f5f78bdcf40 1 -- 172.21.15.19:0/2295199786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625b839e510 con 0x5625b83a2080 2024-09-12T02:02:26.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.128+0000 7f5f6f7fe640 1 -- 172.21.15.19:0/2295199786 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70015840 con 0x5625b83a2080 2024-09-12T02:02:26.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.128+0000 7f5f78bdcf40 1 -- 172.21.15.19:0/2295199786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625b839ead0 con 0x5625b83a2080 2024-09-12T02:02:26.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.129+0000 7f5f6f7fe640 1 -- 172.21.15.19:0/2295199786 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5f70013030 con 0x5625b83a2080 2024-09-12T02:02:26.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.130+0000 7f5f6f7fe640 1 --2- 172.21.15.19:0/2295199786 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5f5806a810 0x7f5f5806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.130+0000 7f5f6f7fe640 1 -- 172.21.15.19:0/2295199786 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f5f70089bf0 con 0x5625b83a2080 2024-09-12T02:02:26.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.130+0000 7f5f766d4640 1 --2- 172.21.15.19:0/2295199786 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5f5806a810 0x7f5f5806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.130+0000 7f5f78bdcf40 1 --2- 172.21.15.19:0/2295199786 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5625b83c13a0 0x5625b8460c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.130+0000 7f5f78bdcf40 1 -- 172.21.15.19:0/2295199786 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:1 13.15 13:aa448500:::500.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5625b8461190 con 0x5625b83c13a0 2024-09-12T02:02:26.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.130+0000 7f5f75ed3640 1 --2- 172.21.15.19:0/2295199786 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5625b83c13a0 0x5625b8460c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.130+0000 7f5f766d4640 1 --2- 172.21.15.19:0/2295199786 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5f5806a810 0x7f5f5806ccd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5f6800a4a0 tx=0x7f5f68052000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.130+0000 7f5f75ed3640 1 --2- 172.21.15.19:0/2295199786 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5625b83c13a0 0x5625b8460c50 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.131+0000 7f5f75ed3640 1 -- 172.21.15.19:0/2295199786 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(1 500.00000000 [omap-get-keys out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f5f6000f720 con 0x5625b83c13a0 2024-09-12T02:02:26.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.131+0000 7f5f78bdcf40 1 -- 172.21.15.19:0/2295199786 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5625b83c13a0 msgr2=0x5625b8460c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.131+0000 7f5f78bdcf40 1 --2- 172.21.15.19:0/2295199786 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5625b83c13a0 0x5625b8460c50 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.131+0000 7f5f78bdcf40 1 -- 172.21.15.19:0/2295199786 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5f5806a810 msgr2=0x7f5f5806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.131+0000 7f5f78bdcf40 1 --2- 172.21.15.19:0/2295199786 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5f5806a810 0x7f5f5806ccd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5f6800a4a0 tx=0x7f5f68052000 comp rx=0 tx=0).stop 2024-09-12T02:02:26.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.131+0000 7f5f78bdcf40 1 -- 172.21.15.19:0/2295199786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625b83a2080 msgr2=0x5625b839ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.131+0000 7f5f78bdcf40 1 --2- 172.21.15.19:0/2295199786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625b83a2080 0x5625b839ca50 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f5f70005fd0 tx=0x7f5f70009f70 comp rx=0 tx=0).stop 2024-09-12T02:02:26.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.131+0000 7f5f76ed5640 1 -- 172.21.15.19:0/2295199786 reap_dead start 2024-09-12T02:02:26.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.131+0000 7f5f78bdcf40 1 -- 172.21.15.19:0/2295199786 shutdown_connections 2024-09-12T02:02:26.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.131+0000 7f5f78bdcf40 1 -- 172.21.15.19:0/2295199786 >> 172.21.15.19:0/2295199786 conn(0x5625b82e79e0 msgr2=0x5625b83a7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.131+0000 7f5f78bdcf40 1 -- 172.21.15.19:0/2295199786 shutdown_connections 2024-09-12T02:02:26.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.131+0000 7f5f78bdcf40 1 -- 172.21.15.19:0/2295199786 wait complete. 2024-09-12T02:02:26.136 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys mds_snaptable 2024-09-12T02:02:26.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.180+0000 7f776e80bf40 1 Processor -- start 2024-09-12T02:02:26.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.180+0000 7f776e80bf40 1 -- start start 2024-09-12T02:02:26.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.180+0000 7f776e80bf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55565bbbaf40 0x55565bc5cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.180+0000 7f776e80bf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55565bc69240 0x55565bc681f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.180+0000 7f776e80bf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55565bc60e30 0x55565bc67340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.180+0000 7f776e80bf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55565bae2510 con 0x55565bc69240 2024-09-12T02:02:26.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.180+0000 7f776e80bf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55565bb3bc50 con 0x55565bc60e30 2024-09-12T02:02:26.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.180+0000 7f776e80bf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55565bbd84a0 con 0x55565bbbaf40 2024-09-12T02:02:26.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.180+0000 7f776ae92640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55565bc69240 0x55565bc681f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.181+0000 7f776ae92640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55565bc69240 0x55565bc681f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51258/0 (socket says 172.21.15.19:51258) 2024-09-12T02:02:26.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.181+0000 7f776ae92640 1 -- 172.21.15.19:0/2854672352 learned_addr learned my addr 172.21.15.19:0/2854672352 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.181+0000 7f776b693640 1 --2- 172.21.15.19:0/2854672352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55565bbbaf40 0x55565bc5cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.181+0000 7f776be94640 1 --2- 172.21.15.19:0/2854672352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55565bc60e30 0x55565bc67340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.181+0000 7f776ae92640 1 -- 172.21.15.19:0/2854672352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55565bbbaf40 msgr2=0x55565bc5cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.181+0000 7f776ae92640 1 --2- 172.21.15.19:0/2854672352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55565bbbaf40 0x55565bc5cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.181+0000 7f776ae92640 1 -- 172.21.15.19:0/2854672352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55565bc60e30 msgr2=0x55565bc67340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.181+0000 7f776ae92640 1 --2- 172.21.15.19:0/2854672352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55565bc60e30 0x55565bc67340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.181+0000 7f776ae92640 1 -- 172.21.15.19:0/2854672352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55565bc58b70 con 0x55565bc69240 2024-09-12T02:02:26.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.181+0000 7f776b693640 1 --2- 172.21.15.19:0/2854672352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55565bbbaf40 0x55565bc5cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:26.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.181+0000 7f776be94640 1 --2- 172.21.15.19:0/2854672352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55565bc60e30 0x55565bc67340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:26.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.181+0000 7f776ae92640 1 --2- 172.21.15.19:0/2854672352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55565bc69240 0x55565bc681f0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7760001d80 tx=0x7f7760001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca129ffbf1796cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.181+0000 7f7769e90640 1 -- 172.21.15.19:0/2854672352 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776000bd70 con 0x55565bc69240 2024-09-12T02:02:26.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.181+0000 7f7769e90640 1 -- 172.21.15.19:0/2854672352 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f776000f400 con 0x55565bc69240 2024-09-12T02:02:26.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.181+0000 7f7769e90640 1 -- 172.21.15.19:0/2854672352 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776000f7f0 con 0x55565bc69240 2024-09-12T02:02:26.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.182+0000 7f776e80bf40 1 -- 172.21.15.19:0/2854672352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55565bc69240 msgr2=0x55565bc681f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.182+0000 7f776e80bf40 1 --2- 172.21.15.19:0/2854672352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55565bc69240 0x55565bc681f0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7760001d80 tx=0x7f7760001e70 comp rx=0 tx=0).stop 2024-09-12T02:02:26.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.182+0000 7f776e80bf40 1 -- 172.21.15.19:0/2854672352 shutdown_connections 2024-09-12T02:02:26.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.182+0000 7f776e80bf40 1 --2- 172.21.15.19:0/2854672352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55565bc60e30 0x55565bc67340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.182+0000 7f776e80bf40 1 --2- 172.21.15.19:0/2854672352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55565bc69240 0x55565bc681f0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.182+0000 7f776e80bf40 1 --2- 172.21.15.19:0/2854672352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55565bbbaf40 0x55565bc5cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.182+0000 7f776e80bf40 1 -- 172.21.15.19:0/2854672352 >> 172.21.15.19:0/2854672352 conn(0x55565bb909e0 msgr2=0x55565bc66700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.182+0000 7f776e80bf40 1 -- 172.21.15.19:0/2854672352 shutdown_connections 2024-09-12T02:02:26.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.182+0000 7f776e80bf40 1 -- 172.21.15.19:0/2854672352 wait complete. 2024-09-12T02:02:26.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.182+0000 7f776e80bf40 1 Processor -- start 2024-09-12T02:02:26.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.182+0000 7f776e80bf40 1 -- start start 2024-09-12T02:02:26.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.183+0000 7f776e80bf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55565bbbaf40 0x55565bc54180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.183+0000 7f776e80bf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55565bc69240 0x55565bc678e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.183+0000 7f776e80bf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55565bc57f80 0x55565bbbf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.183+0000 7f776e80bf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55565bc5d430 con 0x55565bc57f80 2024-09-12T02:02:26.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.183+0000 7f776e80bf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55565bc58de0 con 0x55565bc69240 2024-09-12T02:02:26.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.183+0000 7f776e80bf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55565bc5d6b0 con 0x55565bbbaf40 2024-09-12T02:02:26.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.183+0000 7f776be94640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55565bc57f80 0x55565bbbf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.183+0000 7f776be94640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55565bc57f80 0x55565bbbf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51266/0 (socket says 172.21.15.19:51266) 2024-09-12T02:02:26.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.183+0000 7f776be94640 1 -- 172.21.15.19:0/2061870937 learned_addr learned my addr 172.21.15.19:0/2061870937 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.183+0000 7f776b693640 1 --2- 172.21.15.19:0/2061870937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55565bbbaf40 0x55565bc54180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.183+0000 7f776ae92640 1 --2- 172.21.15.19:0/2061870937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55565bc69240 0x55565bc678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.183+0000 7f776be94640 1 -- 172.21.15.19:0/2061870937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55565bbbaf40 msgr2=0x55565bc54180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.183+0000 7f776be94640 1 --2- 172.21.15.19:0/2061870937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55565bbbaf40 0x55565bc54180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.183+0000 7f776be94640 1 -- 172.21.15.19:0/2061870937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55565bc69240 msgr2=0x55565bc678e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.183+0000 7f776be94640 1 --2- 172.21.15.19:0/2061870937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55565bc69240 0x55565bc678e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.183+0000 7f776be94640 1 -- 172.21.15.19:0/2061870937 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55565bc546c0 con 0x55565bc57f80 2024-09-12T02:02:26.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.184+0000 7f776be94640 1 --2- 172.21.15.19:0/2061870937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55565bc57f80 0x55565bbbf0e0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f7764002250 tx=0x7f776400c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.184+0000 7f7768e8e640 1 -- 172.21.15.19:0/2061870937 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7764017070 con 0x55565bc57f80 2024-09-12T02:02:26.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.184+0000 7f7768e8e640 1 -- 172.21.15.19:0/2061870937 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f776400ce10 con 0x55565bc57f80 2024-09-12T02:02:26.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.184+0000 7f776e80bf40 1 -- 172.21.15.19:0/2061870937 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55565bbbebe0 con 0x55565bc57f80 2024-09-12T02:02:26.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.184+0000 7f7768e8e640 1 -- 172.21.15.19:0/2061870937 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7764004700 con 0x55565bc57f80 2024-09-12T02:02:26.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.184+0000 7f776e80bf40 1 -- 172.21.15.19:0/2061870937 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55565bc65b80 con 0x55565bc57f80 2024-09-12T02:02:26.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.185+0000 7f7768e8e640 1 -- 172.21.15.19:0/2061870937 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f776401a070 con 0x55565bc57f80 2024-09-12T02:02:26.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.186+0000 7f7768e8e640 1 --2- 172.21.15.19:0/2061870937 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f775806a840 0x7f775806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.186+0000 7f7768e8e640 1 -- 172.21.15.19:0/2061870937 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f7764089490 con 0x55565bc57f80 2024-09-12T02:02:26.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.186+0000 7f776b693640 1 --2- 172.21.15.19:0/2061870937 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f775806a840 0x7f775806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.186+0000 7f776e80bf40 1 --2- 172.21.15.19:0/2061870937 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55565bbbf620 0x55565bc554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.186+0000 7f776e80bf40 1 -- 172.21.15.19:0/2061870937 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:1 13.d 13:b50e409b:::mds_snaptable:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55565bc55a00 con 0x55565bbbf620 2024-09-12T02:02:26.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.186+0000 7f776ae92640 1 --2- 172.21.15.19:0/2061870937 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55565bbbf620 0x55565bc554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.186+0000 7f776b693640 1 --2- 172.21.15.19:0/2061870937 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f775806a840 0x7f775806cd00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f775c057000 tx=0x7f775c052000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.186+0000 7f776ae92640 1 --2- 172.21.15.19:0/2061870937 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55565bbbf620 0x55565bc554c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.187+0000 7f776ae92640 1 -- 172.21.15.19:0/2061870937 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(1 mds_snaptable [omap-get-keys out=5b] v0'0 uv1 ondisk = 0) ==== 157+0+5 (crc 0 0 0) 0x7f776000f5b0 con 0x55565bbbf620 2024-09-12T02:02:26.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.187+0000 7f776e80bf40 1 -- 172.21.15.19:0/2061870937 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55565bbbf620 msgr2=0x55565bc554c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.187+0000 7f776e80bf40 1 --2- 172.21.15.19:0/2061870937 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55565bbbf620 0x55565bc554c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.187+0000 7f776e80bf40 1 -- 172.21.15.19:0/2061870937 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f775806a840 msgr2=0x7f775806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.187+0000 7f776e80bf40 1 --2- 172.21.15.19:0/2061870937 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f775806a840 0x7f775806cd00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f775c057000 tx=0x7f775c052000 comp rx=0 tx=0).stop 2024-09-12T02:02:26.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.187+0000 7f776e80bf40 1 -- 172.21.15.19:0/2061870937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55565bc57f80 msgr2=0x55565bbbf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.187+0000 7f776e80bf40 1 --2- 172.21.15.19:0/2061870937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55565bc57f80 0x55565bbbf0e0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f7764002250 tx=0x7f776400c5e0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.187+0000 7f776be94640 1 -- 172.21.15.19:0/2061870937 reap_dead start 2024-09-12T02:02:26.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.187+0000 7f776e80bf40 1 -- 172.21.15.19:0/2061870937 shutdown_connections 2024-09-12T02:02:26.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.187+0000 7f776e80bf40 1 -- 172.21.15.19:0/2061870937 >> 172.21.15.19:0/2061870937 conn(0x55565bb909e0 msgr2=0x55565bb8fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.187+0000 7f776e80bf40 1 -- 172.21.15.19:0/2061870937 shutdown_connections 2024-09-12T02:02:26.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.187+0000 7f776e80bf40 1 -- 172.21.15.19:0/2061870937 wait complete. 2024-09-12T02:02:26.206 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys mds0_inotable 2024-09-12T02:02:26.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.275+0000 7ff1f5f70f40 1 Processor -- start 2024-09-12T02:02:26.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.275+0000 7ff1f5f70f40 1 -- start start 2024-09-12T02:02:26.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.275+0000 7ff1f5f70f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bbe94c180 0x559bbea09740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.275+0000 7ff1f5f70f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559bbe97a050 0x559bbea1d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.275+0000 7ff1f5f70f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bbea04080 0x559bbe993100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.276+0000 7ff1f5f70f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559bbe89b510 con 0x559bbe94c180 2024-09-12T02:02:26.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.276+0000 7ff1f5f70f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559bbe8f4c50 con 0x559bbea04080 2024-09-12T02:02:26.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.276+0000 7ff1f5f70f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x559bbe94c5c0 con 0x559bbe97a050 2024-09-12T02:02:26.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.276+0000 7ff1f3a66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bbe94c180 0x559bbea09740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.276+0000 7ff1f3a66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bbe94c180 0x559bbea09740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51278/0 (socket says 172.21.15.19:51278) 2024-09-12T02:02:26.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.276+0000 7ff1f3a66640 1 -- 172.21.15.19:0/10427465 learned_addr learned my addr 172.21.15.19:0/10427465 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.276+0000 7ff1f4267640 1 --2- 172.21.15.19:0/10427465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bbea04080 0x559bbe993100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.276+0000 7ff1f3265640 1 --2- 172.21.15.19:0/10427465 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559bbe97a050 0x559bbea1d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.276+0000 7ff1f3a66640 1 -- 172.21.15.19:0/10427465 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559bbe97a050 msgr2=0x559bbea1d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.276+0000 7ff1f3a66640 1 --2- 172.21.15.19:0/10427465 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559bbe97a050 0x559bbea1d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.276+0000 7ff1f3a66640 1 -- 172.21.15.19:0/10427465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bbea04080 msgr2=0x559bbe993100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.276+0000 7ff1f3a66640 1 --2- 172.21.15.19:0/10427465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bbea04080 0x559bbe993100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.276+0000 7ff1f3a66640 1 -- 172.21.15.19:0/10427465 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bbe94bb00 con 0x559bbe94c180 2024-09-12T02:02:26.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.276+0000 7ff1f3a66640 1 --2- 172.21.15.19:0/10427465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bbe94c180 0x559bbea09740 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400a460 tx=0x7ff1e400a920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8541a04419fd73e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.276+0000 7ff1f2263640 1 -- 172.21.15.19:0/10427465 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e400f7b0 con 0x559bbe94c180 2024-09-12T02:02:26.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.276+0000 7ff1f2263640 1 -- 172.21.15.19:0/10427465 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e4015070 con 0x559bbe94c180 2024-09-12T02:02:26.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.276+0000 7ff1f2263640 1 -- 172.21.15.19:0/10427465 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e400fbb0 con 0x559bbe94c180 2024-09-12T02:02:26.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.277+0000 7ff1f5f70f40 1 -- 172.21.15.19:0/10427465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bbe94c180 msgr2=0x559bbea09740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.277+0000 7ff1f5f70f40 1 --2- 172.21.15.19:0/10427465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bbe94c180 0x559bbea09740 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400a460 tx=0x7ff1e400a920 comp rx=0 tx=0).stop 2024-09-12T02:02:26.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.277+0000 7ff1f5f70f40 1 -- 172.21.15.19:0/10427465 shutdown_connections 2024-09-12T02:02:26.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.277+0000 7ff1f5f70f40 1 --2- 172.21.15.19:0/10427465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bbea04080 0x559bbe993100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.277+0000 7ff1f5f70f40 1 --2- 172.21.15.19:0/10427465 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559bbe97a050 0x559bbea1d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.277+0000 7ff1f5f70f40 1 --2- 172.21.15.19:0/10427465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bbe94c180 0x559bbea09740 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.277+0000 7ff1f5f70f40 1 -- 172.21.15.19:0/10427465 >> 172.21.15.19:0/10427465 conn(0x559bbe9499e0 msgr2=0x559bbea23f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.277+0000 7ff1f5f70f40 1 -- 172.21.15.19:0/10427465 shutdown_connections 2024-09-12T02:02:26.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.277+0000 7ff1f5f70f40 1 -- 172.21.15.19:0/10427465 wait complete. 2024-09-12T02:02:26.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.277+0000 7ff1f5f70f40 1 Processor -- start 2024-09-12T02:02:26.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.277+0000 7ff1f5f70f40 1 -- start start 2024-09-12T02:02:26.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.278+0000 7ff1f5f70f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bbe94c180 0x559bbe98f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.278+0000 7ff1f5f70f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559bbe97a050 0x559bbea1ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.278+0000 7ff1f5f70f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bbea04080 0x559bbea1f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.278+0000 7ff1f5f70f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559bbe94a1d0 con 0x559bbe94c180 2024-09-12T02:02:26.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.278+0000 7ff1f5f70f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559bbe9761c0 con 0x559bbea04080 2024-09-12T02:02:26.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.278+0000 7ff1f5f70f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x559bbea09c80 con 0x559bbe97a050 2024-09-12T02:02:26.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.278+0000 7ff1f3a66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bbe94c180 0x559bbe98f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.278+0000 7ff1f3a66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bbe94c180 0x559bbe98f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51282/0 (socket says 172.21.15.19:51282) 2024-09-12T02:02:26.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.278+0000 7ff1f3a66640 1 -- 172.21.15.19:0/538061766 learned_addr learned my addr 172.21.15.19:0/538061766 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.278+0000 7ff1f3265640 1 --2- 172.21.15.19:0/538061766 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559bbe97a050 0x559bbea1ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.278+0000 7ff1f4267640 1 --2- 172.21.15.19:0/538061766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bbea04080 0x559bbea1f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.279+0000 7ff1f3a66640 1 -- 172.21.15.19:0/538061766 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559bbe97a050 msgr2=0x559bbea1ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.279+0000 7ff1f3a66640 1 --2- 172.21.15.19:0/538061766 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559bbe97a050 0x559bbea1ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.279+0000 7ff1f3a66640 1 -- 172.21.15.19:0/538061766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bbea04080 msgr2=0x559bbea1f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.279+0000 7ff1f3a66640 1 --2- 172.21.15.19:0/538061766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bbea04080 0x559bbea1f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.279+0000 7ff1f3a66640 1 -- 172.21.15.19:0/538061766 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bbea085b0 con 0x559bbe94c180 2024-09-12T02:02:26.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.279+0000 7ff1f3a66640 1 --2- 172.21.15.19:0/538061766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bbe94c180 0x559bbe98f120 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x559bbe94a450 tx=0x7ff1e40032f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.279+0000 7ff1f1261640 1 -- 172.21.15.19:0/538061766 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4025650 con 0x559bbe94c180 2024-09-12T02:02:26.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.279+0000 7ff1f1261640 1 -- 172.21.15.19:0/538061766 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e4025810 con 0x559bbe94c180 2024-09-12T02:02:26.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.279+0000 7ff1f1261640 1 -- 172.21.15.19:0/538061766 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4025c00 con 0x559bbe94c180 2024-09-12T02:02:26.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.279+0000 7ff1f5f70f40 1 -- 172.21.15.19:0/538061766 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559bbe98f660 con 0x559bbe94c180 2024-09-12T02:02:26.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.279+0000 7ff1f5f70f40 1 -- 172.21.15.19:0/538061766 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bbea08b30 con 0x559bbe94c180 2024-09-12T02:02:26.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.281+0000 7ff1f1261640 1 -- 172.21.15.19:0/538061766 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1e4010440 con 0x559bbe94c180 2024-09-12T02:02:26.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.281+0000 7ff1f1261640 1 --2- 172.21.15.19:0/538061766 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff1e006a810 0x7ff1e006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.281+0000 7ff1f1261640 1 -- 172.21.15.19:0/538061766 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7ff1e408b7d0 con 0x559bbe94c180 2024-09-12T02:02:26.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.281+0000 7ff1f3265640 1 --2- 172.21.15.19:0/538061766 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff1e006a810 0x7ff1e006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.281+0000 7ff1f5f70f40 1 --2- 172.21.15.19:0/538061766 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559bbeab71e0 0x559bbeac2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.281+0000 7ff1f5f70f40 1 -- 172.21.15.19:0/538061766 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:1 13.13 13:c91d4a1d:::mds0_inotable:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x559bbea202a0 con 0x559bbeab71e0 2024-09-12T02:02:26.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.282+0000 7ff1f4267640 1 --2- 172.21.15.19:0/538061766 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559bbeab71e0 0x559bbeac2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.282+0000 7ff1f3265640 1 --2- 172.21.15.19:0/538061766 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff1e006a810 0x7ff1e006ccd0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8057000 tx=0x7ff1e8052000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.282+0000 7ff1f4267640 1 --2- 172.21.15.19:0/538061766 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559bbeab71e0 0x559bbeac2bc0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.282+0000 7ff1f4267640 1 -- 172.21.15.19:0/538061766 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(1 mds0_inotable [omap-get-keys out=5b] v0'0 uv3 ondisk = 0) ==== 157+0+5 (crc 0 0 0) 0x7ff1ec010630 con 0x559bbeab71e0 2024-09-12T02:02:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.282+0000 7ff1f5f70f40 1 -- 172.21.15.19:0/538061766 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559bbeab71e0 msgr2=0x559bbeac2bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.282+0000 7ff1f5f70f40 1 --2- 172.21.15.19:0/538061766 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559bbeab71e0 0x559bbeac2bc0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.282+0000 7ff1f5f70f40 1 -- 172.21.15.19:0/538061766 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff1e006a810 msgr2=0x7ff1e006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.282+0000 7ff1f5f70f40 1 --2- 172.21.15.19:0/538061766 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff1e006a810 0x7ff1e006ccd0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8057000 tx=0x7ff1e8052000 comp rx=0 tx=0).stop 2024-09-12T02:02:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.282+0000 7ff1f5f70f40 1 -- 172.21.15.19:0/538061766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bbe94c180 msgr2=0x559bbe98f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.282+0000 7ff1f5f70f40 1 --2- 172.21.15.19:0/538061766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bbe94c180 0x559bbe98f120 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x559bbe94a450 tx=0x7ff1e40032f0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.282+0000 7ff1f4267640 1 -- 172.21.15.19:0/538061766 reap_dead start 2024-09-12T02:02:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.282+0000 7ff1f5f70f40 1 -- 172.21.15.19:0/538061766 shutdown_connections 2024-09-12T02:02:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.282+0000 7ff1f5f70f40 1 -- 172.21.15.19:0/538061766 >> 172.21.15.19:0/538061766 conn(0x559bbe9499e0 msgr2=0x559bbe990620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.283+0000 7ff1f5f70f40 1 -- 172.21.15.19:0/538061766 shutdown_connections 2024-09-12T02:02:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.283+0000 7ff1f5f70f40 1 -- 172.21.15.19:0/538061766 wait complete. 2024-09-12T02:02:26.288 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 100.00000000 2024-09-12T02:02:26.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.370+0000 7f0bf41f8f40 1 Processor -- start 2024-09-12T02:02:26.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.371+0000 7f0bf41f8f40 1 -- start start 2024-09-12T02:02:26.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.371+0000 7f0bf41f8f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b7667f4e20 0x55b76695ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.371+0000 7f0bf41f8f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b766822450 0x55b76681fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.371+0000 7f0bf41f8f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b7668b3730 0x55b76683b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.371+0000 7f0bf41f8f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b7668234e0 con 0x55b766822450 2024-09-12T02:02:26.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.371+0000 7f0bf41f8f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b766746510 con 0x55b7668b3730 2024-09-12T02:02:26.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.371+0000 7f0bf41f8f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55b7667f5260 con 0x55b7667f4e20 2024-09-12T02:02:26.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.371+0000 7f0bf14ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b766822450 0x55b76681fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.371+0000 7f0bf14ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b766822450 0x55b76681fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51306/0 (socket says 172.21.15.19:51306) 2024-09-12T02:02:26.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.371+0000 7f0bf14ed640 1 -- 172.21.15.19:0/3810650206 learned_addr learned my addr 172.21.15.19:0/3810650206 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.372+0000 7f0bf24ef640 1 --2- 172.21.15.19:0/3810650206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b7668b3730 0x55b76683b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.372+0000 7f0bf1cee640 1 --2- 172.21.15.19:0/3810650206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b7667f4e20 0x55b76695ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.372+0000 7f0bf14ed640 1 -- 172.21.15.19:0/3810650206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b7667f4e20 msgr2=0x55b76695ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.372+0000 7f0bf14ed640 1 --2- 172.21.15.19:0/3810650206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b7667f4e20 0x55b76695ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.372+0000 7f0bf14ed640 1 -- 172.21.15.19:0/3810650206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b7668b3730 msgr2=0x55b76683b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.372+0000 7f0bf14ed640 1 --2- 172.21.15.19:0/3810650206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b7668b3730 0x55b76683b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.372+0000 7f0bf14ed640 1 -- 172.21.15.19:0/3810650206 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76683d1b0 con 0x55b766822450 2024-09-12T02:02:26.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.372+0000 7f0bf24ef640 1 --2- 172.21.15.19:0/3810650206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b7668b3730 0x55b76683b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:26.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.372+0000 7f0bf14ed640 1 --2- 172.21.15.19:0/3810650206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b766822450 0x55b76681fe10 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f0be8045b00 tx=0x7f0be8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c75a5afb5cb01a87 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.372+0000 7f0be3fff640 1 -- 172.21.15.19:0/3810650206 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8056050 con 0x55b766822450 2024-09-12T02:02:26.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.372+0000 7f0be3fff640 1 -- 172.21.15.19:0/3810650206 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be8052af0 con 0x55b766822450 2024-09-12T02:02:26.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.372+0000 7f0be3fff640 1 -- 172.21.15.19:0/3810650206 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8065440 con 0x55b766822450 2024-09-12T02:02:26.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.372+0000 7f0bf41f8f40 1 -- 172.21.15.19:0/3810650206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b766822450 msgr2=0x55b76681fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.372+0000 7f0bf41f8f40 1 --2- 172.21.15.19:0/3810650206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b766822450 0x55b76681fe10 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f0be8045b00 tx=0x7f0be8051000 comp rx=0 tx=0).stop 2024-09-12T02:02:26.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.372+0000 7f0bf41f8f40 1 -- 172.21.15.19:0/3810650206 shutdown_connections 2024-09-12T02:02:26.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.372+0000 7f0bf41f8f40 1 --2- 172.21.15.19:0/3810650206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b7668b3730 0x55b76683b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.372+0000 7f0bf41f8f40 1 --2- 172.21.15.19:0/3810650206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b766822450 0x55b76681fe10 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.372+0000 7f0bf41f8f40 1 --2- 172.21.15.19:0/3810650206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b7667f4e20 0x55b76695ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.373+0000 7f0bf41f8f40 1 -- 172.21.15.19:0/3810650206 >> 172.21.15.19:0/3810650206 conn(0x55b7667f5ad0 msgr2=0x55b7667f4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.373+0000 7f0bf41f8f40 1 -- 172.21.15.19:0/3810650206 shutdown_connections 2024-09-12T02:02:26.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.373+0000 7f0bf41f8f40 1 -- 172.21.15.19:0/3810650206 wait complete. 2024-09-12T02:02:26.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.373+0000 7f0bf41f8f40 1 Processor -- start 2024-09-12T02:02:26.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.373+0000 7f0bf41f8f40 1 -- start start 2024-09-12T02:02:26.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0bf41f8f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7667f4e20 0x55b76683c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0bf41f8f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b766822450 0x55b7668c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0bf41f8f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b7668b3730 0x55b7668aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0bf41f8f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b7668b2540 con 0x55b7667f4e20 2024-09-12T02:02:26.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0bf41f8f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b7668c9d70 con 0x55b7668b3730 2024-09-12T02:02:26.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0bf41f8f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55b766834f10 con 0x55b766822450 2024-09-12T02:02:26.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0bf1cee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7667f4e20 0x55b76683c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0bf1cee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7667f4e20 0x55b76683c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51310/0 (socket says 172.21.15.19:51310) 2024-09-12T02:02:26.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0bf1cee640 1 -- 172.21.15.19:0/260160167 learned_addr learned my addr 172.21.15.19:0/260160167 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0bf24ef640 1 --2- 172.21.15.19:0/260160167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b7668b3730 0x55b7668aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0bf14ed640 1 --2- 172.21.15.19:0/260160167 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b766822450 0x55b7668c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0bf1cee640 1 -- 172.21.15.19:0/260160167 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b766822450 msgr2=0x55b7668c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0bf1cee640 1 --2- 172.21.15.19:0/260160167 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b766822450 0x55b7668c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0bf1cee640 1 -- 172.21.15.19:0/260160167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b7668b3730 msgr2=0x55b7668aaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0bf1cee640 1 --2- 172.21.15.19:0/260160167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b7668b3730 0x55b7668aaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0bf1cee640 1 -- 172.21.15.19:0/260160167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7668c9ba0 con 0x55b7667f4e20 2024-09-12T02:02:26.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0bf24ef640 1 --2- 172.21.15.19:0/260160167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b7668b3730 0x55b7668aaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:26.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0bf1cee640 1 --2- 172.21.15.19:0/260160167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7667f4e20 0x55b76683c180 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f0be400bd70 tx=0x7f0be400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.374+0000 7f0be2ffd640 1 -- 172.21.15.19:0/260160167 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4007a30 con 0x55b7667f4e20 2024-09-12T02:02:26.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.375+0000 7f0be2ffd640 1 -- 172.21.15.19:0/260160167 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be4007bd0 con 0x55b7667f4e20 2024-09-12T02:02:26.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.375+0000 7f0bf41f8f40 1 -- 172.21.15.19:0/260160167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7668ac690 con 0x55b7667f4e20 2024-09-12T02:02:26.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.375+0000 7f0be2ffd640 1 -- 172.21.15.19:0/260160167 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4015470 con 0x55b7667f4e20 2024-09-12T02:02:26.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.375+0000 7f0bf41f8f40 1 -- 172.21.15.19:0/260160167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7668acc50 con 0x55b7667f4e20 2024-09-12T02:02:26.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.376+0000 7f0be2ffd640 1 -- 172.21.15.19:0/260160167 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0be4015610 con 0x55b7667f4e20 2024-09-12T02:02:26.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.376+0000 7f0be2ffd640 1 --2- 172.21.15.19:0/260160167 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0bd406a810 0x7f0bd406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.376+0000 7f0be2ffd640 1 -- 172.21.15.19:0/260160167 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f0be4089120 con 0x55b7667f4e20 2024-09-12T02:02:26.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.377+0000 7f0bf14ed640 1 --2- 172.21.15.19:0/260160167 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0bd406a810 0x7f0bd406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.377+0000 7f0bf41f8f40 1 --2- 172.21.15.19:0/260160167 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55b7668ad420 0x55b7668ad800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.377+0000 7f0bf41f8f40 1 -- 172.21.15.19:0/260160167 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:1 13.13 13:cd5a64a3:::100.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55b7668add40 con 0x55b7668ad420 2024-09-12T02:02:26.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.377+0000 7f0bf24ef640 1 --2- 172.21.15.19:0/260160167 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55b7668ad420 0x55b7668ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.377+0000 7f0bf14ed640 1 --2- 172.21.15.19:0/260160167 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0bd406a810 0x7f0bd406ccd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0be8045b00 tx=0x7f0be8053000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.377+0000 7f0bf24ef640 1 --2- 172.21.15.19:0/260160167 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55b7668ad420 0x55b7668ad800 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.378+0000 7f0bf24ef640 1 -- 172.21.15.19:0/260160167 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(1 100.00000000 [omap-get-keys out=155b] v0'0 uv1 ondisk = 0) ==== 156+0+155 (crc 0 0 0) 0x7f0bec003040 con 0x55b7668ad420 2024-09-12T02:02:26.382 INFO:teuthology.orchestra.run.smithi019.stdout:stray0_head 2024-09-12T02:02:26.382 INFO:teuthology.orchestra.run.smithi019.stdout:stray1_head 2024-09-12T02:02:26.382 INFO:teuthology.orchestra.run.smithi019.stdout:stray2_head 2024-09-12T02:02:26.382 INFO:teuthology.orchestra.run.smithi019.stdout:stray3_head 2024-09-12T02:02:26.382 INFO:teuthology.orchestra.run.smithi019.stdout:stray4_head 2024-09-12T02:02:26.382 INFO:teuthology.orchestra.run.smithi019.stdout:stray5_head 2024-09-12T02:02:26.382 INFO:teuthology.orchestra.run.smithi019.stdout:stray6_head 2024-09-12T02:02:26.382 INFO:teuthology.orchestra.run.smithi019.stdout:stray7_head 2024-09-12T02:02:26.383 INFO:teuthology.orchestra.run.smithi019.stdout:stray8_head 2024-09-12T02:02:26.383 INFO:teuthology.orchestra.run.smithi019.stdout:stray9_head 2024-09-12T02:02:26.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.378+0000 7f0bf41f8f40 1 -- 172.21.15.19:0/260160167 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55b7668ad420 msgr2=0x55b7668ad800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.378+0000 7f0bf41f8f40 1 --2- 172.21.15.19:0/260160167 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55b7668ad420 0x55b7668ad800 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.378+0000 7f0bf41f8f40 1 -- 172.21.15.19:0/260160167 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0bd406a810 msgr2=0x7f0bd406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.378+0000 7f0bf41f8f40 1 --2- 172.21.15.19:0/260160167 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0bd406a810 0x7f0bd406ccd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0be8045b00 tx=0x7f0be8053000 comp rx=0 tx=0).stop 2024-09-12T02:02:26.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.378+0000 7f0bf41f8f40 1 -- 172.21.15.19:0/260160167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7667f4e20 msgr2=0x55b76683c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.378+0000 7f0bf41f8f40 1 --2- 172.21.15.19:0/260160167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7667f4e20 0x55b76683c180 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f0be400bd70 tx=0x7f0be400be60 comp rx=0 tx=0).stop 2024-09-12T02:02:26.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.378+0000 7f0bf24ef640 1 -- 172.21.15.19:0/260160167 reap_dead start 2024-09-12T02:02:26.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.378+0000 7f0bf41f8f40 1 -- 172.21.15.19:0/260160167 shutdown_connections 2024-09-12T02:02:26.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.378+0000 7f0bf41f8f40 1 -- 172.21.15.19:0/260160167 >> 172.21.15.19:0/260160167 conn(0x55b7667f5ad0 msgr2=0x55b7668b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.378+0000 7f0bf41f8f40 1 -- 172.21.15.19:0/260160167 shutdown_connections 2024-09-12T02:02:26.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.378+0000 7f0bf41f8f40 1 -- 172.21.15.19:0/260160167 wait complete. 2024-09-12T02:02:26.385 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys mds0_sessionmap 2024-09-12T02:02:26.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.428+0000 7f8431120f40 1 Processor -- start 2024-09-12T02:02:26.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.428+0000 7f8431120f40 1 -- start start 2024-09-12T02:02:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.429+0000 7f8431120f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573043d6180 0x557304539ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.429+0000 7f8431120f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557304404050 0x5573044add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.429+0000 7f8431120f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55730448e080 0x55730448bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.429+0000 7f8431120f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5573043d2ae0 con 0x55730448e080 2024-09-12T02:02:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.429+0000 7f8431120f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557304325510 con 0x5573043d6180 2024-09-12T02:02:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.429+0000 7f8431120f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5573043d2dc0 con 0x557304404050 2024-09-12T02:02:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.429+0000 7f842e9b0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55730448e080 0x55730448bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.429+0000 7f842e9b0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55730448e080 0x55730448bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51320/0 (socket says 172.21.15.19:51320) 2024-09-12T02:02:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.429+0000 7f842e9b0640 1 -- 172.21.15.19:0/1495796657 learned_addr learned my addr 172.21.15.19:0/1495796657 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.429+0000 7f8427fff640 1 --2- 172.21.15.19:0/1495796657 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557304404050 0x5573044add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.429+0000 7f842e1af640 1 --2- 172.21.15.19:0/1495796657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573043d6180 0x557304539ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.429+0000 7f842e9b0640 1 -- 172.21.15.19:0/1495796657 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557304404050 msgr2=0x5573044add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.429+0000 7f842e9b0640 1 --2- 172.21.15.19:0/1495796657 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557304404050 0x5573044add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.429+0000 7f842e9b0640 1 -- 172.21.15.19:0/1495796657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573043d6180 msgr2=0x557304539ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.429+0000 7f842e9b0640 1 --2- 172.21.15.19:0/1495796657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573043d6180 0x557304539ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.429+0000 7f842e9b0640 1 -- 172.21.15.19:0/1495796657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557304403860 con 0x55730448e080 2024-09-12T02:02:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.430+0000 7f842e9b0640 1 --2- 172.21.15.19:0/1495796657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55730448e080 0x55730448bab0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f84280461e0 tx=0x7f8428051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642eeb4d77fa5be9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.430+0000 7f842d1ad640 1 -- 172.21.15.19:0/1495796657 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8428067070 con 0x55730448e080 2024-09-12T02:02:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.430+0000 7f842d1ad640 1 -- 172.21.15.19:0/1495796657 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842804fbc0 con 0x55730448e080 2024-09-12T02:02:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.430+0000 7f842d1ad640 1 -- 172.21.15.19:0/1495796657 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8428058400 con 0x55730448e080 2024-09-12T02:02:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.430+0000 7f8431120f40 1 -- 172.21.15.19:0/1495796657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55730448e080 msgr2=0x55730448bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.430+0000 7f8431120f40 1 --2- 172.21.15.19:0/1495796657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55730448e080 0x55730448bab0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f84280461e0 tx=0x7f8428051000 comp rx=0 tx=0).stop 2024-09-12T02:02:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.430+0000 7f8431120f40 1 -- 172.21.15.19:0/1495796657 shutdown_connections 2024-09-12T02:02:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.430+0000 7f8431120f40 1 --2- 172.21.15.19:0/1495796657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55730448e080 0x55730448bab0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.430+0000 7f8431120f40 1 --2- 172.21.15.19:0/1495796657 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557304404050 0x5573044add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.430+0000 7f8431120f40 1 --2- 172.21.15.19:0/1495796657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573043d6180 0x557304539ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.430+0000 7f8431120f40 1 -- 172.21.15.19:0/1495796657 >> 172.21.15.19:0/1495796657 conn(0x5573043d39e0 msgr2=0x557304419a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.430+0000 7f8431120f40 1 -- 172.21.15.19:0/1495796657 shutdown_connections 2024-09-12T02:02:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.430+0000 7f8431120f40 1 -- 172.21.15.19:0/1495796657 wait complete. 2024-09-12T02:02:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.431+0000 7f8431120f40 1 Processor -- start 2024-09-12T02:02:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.431+0000 7f8431120f40 1 -- start start 2024-09-12T02:02:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.432+0000 7f8431120f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573043d6180 0x557304402f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.432+0000 7f8431120f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557304404050 0x5573044a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.432+0000 7f8431120f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730448e080 0x55730448b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.432+0000 7f8431120f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5573044035c0 con 0x5573043d6180 2024-09-12T02:02:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.432+0000 7f8431120f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557304539ff0 con 0x55730448e080 2024-09-12T02:02:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.432+0000 7f8431120f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5573044aabb0 con 0x557304404050 2024-09-12T02:02:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.432+0000 7f842e1af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573043d6180 0x557304402f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.432+0000 7f842e1af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573043d6180 0x557304402f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51330/0 (socket says 172.21.15.19:51330) 2024-09-12T02:02:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.432+0000 7f842e1af640 1 -- 172.21.15.19:0/322746833 learned_addr learned my addr 172.21.15.19:0/322746833 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.432+0000 7f842e9b0640 1 --2- 172.21.15.19:0/322746833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730448e080 0x55730448b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.432+0000 7f8427fff640 1 --2- 172.21.15.19:0/322746833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557304404050 0x5573044a57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.432+0000 7f842e1af640 1 -- 172.21.15.19:0/322746833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557304404050 msgr2=0x5573044a57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.432+0000 7f842e1af640 1 --2- 172.21.15.19:0/322746833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557304404050 0x5573044a57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.432+0000 7f842e1af640 1 -- 172.21.15.19:0/322746833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730448e080 msgr2=0x55730448b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.432+0000 7f842e1af640 1 --2- 172.21.15.19:0/322746833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730448e080 0x55730448b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.432+0000 7f842e1af640 1 -- 172.21.15.19:0/322746833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573044a5d20 con 0x5573043d6180 2024-09-12T02:02:26.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.432+0000 7f842e1af640 1 --2- 172.21.15.19:0/322746833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573043d6180 0x557304402f90 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f842000ded0 tx=0x7f842000b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.432+0000 7f84277fe640 1 -- 172.21.15.19:0/322746833 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8420014020 con 0x5573043d6180 2024-09-12T02:02:26.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.433+0000 7f84277fe640 1 -- 172.21.15.19:0/322746833 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842000be10 con 0x5573043d6180 2024-09-12T02:02:26.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.433+0000 7f8431120f40 1 -- 172.21.15.19:0/322746833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55730453ca40 con 0x5573043d6180 2024-09-12T02:02:26.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.433+0000 7f84277fe640 1 -- 172.21.15.19:0/322746833 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8420008030 con 0x5573043d6180 2024-09-12T02:02:26.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.433+0000 7f8431120f40 1 -- 172.21.15.19:0/322746833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55730453a4f0 con 0x5573043d6180 2024-09-12T02:02:26.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.434+0000 7f84277fe640 1 -- 172.21.15.19:0/322746833 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8420017020 con 0x5573043d6180 2024-09-12T02:02:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.434+0000 7f84277fe640 1 --2- 172.21.15.19:0/322746833 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f841006a810 0x7f841006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.434+0000 7f84277fe640 1 -- 172.21.15.19:0/322746833 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f8420089bd0 con 0x5573043d6180 2024-09-12T02:02:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.435+0000 7f8427fff640 1 --2- 172.21.15.19:0/322746833 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f841006a810 0x7f841006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.435+0000 7f8431120f40 1 --2- 172.21.15.19:0/322746833 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55730453bd00 0x5573044a99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.435+0000 7f8431120f40 1 -- 172.21.15.19:0/322746833 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:1 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5573044a9f10 con 0x55730453bd00 2024-09-12T02:02:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.435+0000 7f842e9b0640 1 --2- 172.21.15.19:0/322746833 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55730453bd00 0x5573044a99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.435+0000 7f8427fff640 1 --2- 172.21.15.19:0/322746833 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f841006a810 0x7f841006ccd0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x557304539fc0 tx=0x7f8418005b00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.435+0000 7f842e9b0640 1 --2- 172.21.15.19:0/322746833 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55730453bd00 0x5573044a99d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.436+0000 7f842e9b0640 1 -- 172.21.15.19:0/322746833 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-keys out=5b] v0'0 uv3 ondisk = 0) ==== 159+0+5 (crc 0 0 0) 0x7f8428058400 con 0x55730453bd00 2024-09-12T02:02:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.436+0000 7f8431120f40 1 -- 172.21.15.19:0/322746833 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55730453bd00 msgr2=0x5573044a99d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.436+0000 7f8431120f40 1 --2- 172.21.15.19:0/322746833 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55730453bd00 0x5573044a99d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.436+0000 7f8431120f40 1 -- 172.21.15.19:0/322746833 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f841006a810 msgr2=0x7f841006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.436+0000 7f8431120f40 1 --2- 172.21.15.19:0/322746833 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f841006a810 0x7f841006ccd0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x557304539fc0 tx=0x7f8418005b00 comp rx=0 tx=0).stop 2024-09-12T02:02:26.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.436+0000 7f8431120f40 1 -- 172.21.15.19:0/322746833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573043d6180 msgr2=0x557304402f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.436+0000 7f8431120f40 1 --2- 172.21.15.19:0/322746833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573043d6180 0x557304402f90 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f842000ded0 tx=0x7f842000b5e0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.436+0000 7f842e9b0640 1 -- 172.21.15.19:0/322746833 reap_dead start 2024-09-12T02:02:26.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.436+0000 7f8431120f40 1 -- 172.21.15.19:0/322746833 shutdown_connections 2024-09-12T02:02:26.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.436+0000 7f8431120f40 1 -- 172.21.15.19:0/322746833 >> 172.21.15.19:0/322746833 conn(0x5573043d39e0 msgr2=0x557304419a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.436+0000 7f8431120f40 1 -- 172.21.15.19:0/322746833 shutdown_connections 2024-09-12T02:02:26.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.436+0000 7f8431120f40 1 -- 172.21.15.19:0/322746833 wait complete. 2024-09-12T02:02:26.441 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 400.00000000 2024-09-12T02:02:26.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.524+0000 7f26b9d20f40 1 Processor -- start 2024-09-12T02:02:26.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.524+0000 7f26b9d20f40 1 -- start start 2024-09-12T02:02:26.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b9d20f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5639f59b6a10 0x5639f5999500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b9d20f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639f5a46130 0x5639f5ad2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b9d20f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639f59b8a00 0x5639f59b8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b9d20f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5639f59713b0 con 0x5639f59b8a00 2024-09-12T02:02:26.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b9d20f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5639f58c0510 con 0x5639f5a46130 2024-09-12T02:02:26.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b9d20f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5639f599c750 con 0x5639f59b6a10 2024-09-12T02:02:26.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b75b0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639f59b8a00 0x5639f59b8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b75b0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639f59b8a00 0x5639f59b8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51348/0 (socket says 172.21.15.19:51348) 2024-09-12T02:02:26.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b75b0640 1 -- 172.21.15.19:0/1792466143 learned_addr learned my addr 172.21.15.19:0/1792466143 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b6daf640 1 --2- 172.21.15.19:0/1792466143 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5639f59b6a10 0x5639f5999500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b65ae640 1 --2- 172.21.15.19:0/1792466143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639f5a46130 0x5639f5ad2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b75b0640 1 -- 172.21.15.19:0/1792466143 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5639f59b6a10 msgr2=0x5639f5999500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b75b0640 1 --2- 172.21.15.19:0/1792466143 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5639f59b6a10 0x5639f5999500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b75b0640 1 -- 172.21.15.19:0/1792466143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639f5a46130 msgr2=0x5639f5ad2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b75b0640 1 --2- 172.21.15.19:0/1792466143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639f5a46130 0x5639f5ad2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b75b0640 1 -- 172.21.15.19:0/1792466143 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f596d900 con 0x5639f59b8a00 2024-09-12T02:02:26.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b6daf640 1 --2- 172.21.15.19:0/1792466143 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5639f59b6a10 0x5639f5999500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:26.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b65ae640 1 --2- 172.21.15.19:0/1792466143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639f5a46130 0x5639f5ad2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:26.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b75b0640 1 --2- 172.21.15.19:0/1792466143 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639f59b8a00 0x5639f59b8eb0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f26b0002d60 tx=0x7f26b000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396d39497de3e9f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b55ac640 1 -- 172.21.15.19:0/1792466143 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b0013020 con 0x5639f59b8a00 2024-09-12T02:02:26.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b55ac640 1 -- 172.21.15.19:0/1792466143 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b000f400 con 0x5639f59b8a00 2024-09-12T02:02:26.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.525+0000 7f26b55ac640 1 -- 172.21.15.19:0/1792466143 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b000f7f0 con 0x5639f59b8a00 2024-09-12T02:02:26.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.526+0000 7f26b9d20f40 1 -- 172.21.15.19:0/1792466143 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639f59b8a00 msgr2=0x5639f59b8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.526+0000 7f26b9d20f40 1 --2- 172.21.15.19:0/1792466143 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639f59b8a00 0x5639f59b8eb0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f26b0002d60 tx=0x7f26b000b5b0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.526+0000 7f26b9d20f40 1 -- 172.21.15.19:0/1792466143 shutdown_connections 2024-09-12T02:02:26.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.526+0000 7f26b9d20f40 1 --2- 172.21.15.19:0/1792466143 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639f59b8a00 0x5639f59b8eb0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.526+0000 7f26b9d20f40 1 --2- 172.21.15.19:0/1792466143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639f5a46130 0x5639f5ad2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.526+0000 7f26b9d20f40 1 --2- 172.21.15.19:0/1792466143 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5639f59b6a10 0x5639f5999500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.526+0000 7f26b9d20f40 1 -- 172.21.15.19:0/1792466143 >> 172.21.15.19:0/1792466143 conn(0x5639f596e9e0 msgr2=0x5639f5999a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.526+0000 7f26b9d20f40 1 -- 172.21.15.19:0/1792466143 shutdown_connections 2024-09-12T02:02:26.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.526+0000 7f26b9d20f40 1 -- 172.21.15.19:0/1792466143 wait complete. 2024-09-12T02:02:26.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.527+0000 7f26b9d20f40 1 Processor -- start 2024-09-12T02:02:26.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.527+0000 7f26b9d20f40 1 -- start start 2024-09-12T02:02:26.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.527+0000 7f26b9d20f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639f59b6a10 0x5639f599a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.527+0000 7f26b9d20f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5639f59b8a00 0x5639f5ade1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.527+0000 7f26b9d20f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639f5a46130 0x5639f5ade720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.527+0000 7f26b9d20f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5639f596de10 con 0x5639f59b6a10 2024-09-12T02:02:26.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.527+0000 7f26b9d20f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5639f596dc90 con 0x5639f5a46130 2024-09-12T02:02:26.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.527+0000 7f26b9d20f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5639f596df90 con 0x5639f59b8a00 2024-09-12T02:02:26.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.527+0000 7f26b6daf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639f59b6a10 0x5639f599a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.527+0000 7f26b6daf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639f59b6a10 0x5639f599a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51354/0 (socket says 172.21.15.19:51354) 2024-09-12T02:02:26.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.527+0000 7f26b6daf640 1 -- 172.21.15.19:0/204916745 learned_addr learned my addr 172.21.15.19:0/204916745 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.528+0000 7f26b65ae640 1 --2- 172.21.15.19:0/204916745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5639f59b8a00 0x5639f5ade1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.528+0000 7f26b75b0640 1 --2- 172.21.15.19:0/204916745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639f5a46130 0x5639f5ade720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.528+0000 7f26b6daf640 1 -- 172.21.15.19:0/204916745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5639f59b8a00 msgr2=0x5639f5ade1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.528+0000 7f26b6daf640 1 --2- 172.21.15.19:0/204916745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5639f59b8a00 0x5639f5ade1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.528+0000 7f26b6daf640 1 -- 172.21.15.19:0/204916745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639f5a46130 msgr2=0x5639f5ade720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.528+0000 7f26b6daf640 1 --2- 172.21.15.19:0/204916745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639f5a46130 0x5639f5ade720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.528+0000 7f26b6daf640 1 -- 172.21.15.19:0/204916745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f5999da0 con 0x5639f59b6a10 2024-09-12T02:02:26.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.528+0000 7f26b75b0640 1 --2- 172.21.15.19:0/204916745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639f5a46130 0x5639f5ade720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:26.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.528+0000 7f26b6daf640 1 --2- 172.21.15.19:0/204916745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639f59b6a10 0x5639f599a710 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f26a800a4d0 tx=0x7f26a800a990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.528+0000 7f26affff640 1 -- 172.21.15.19:0/204916745 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a8015030 con 0x5639f59b6a10 2024-09-12T02:02:26.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.528+0000 7f26affff640 1 -- 172.21.15.19:0/204916745 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a8011690 con 0x5639f59b6a10 2024-09-12T02:02:26.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.528+0000 7f26b9d20f40 1 -- 172.21.15.19:0/204916745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639f5a3c1a0 con 0x5639f59b6a10 2024-09-12T02:02:26.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.528+0000 7f26affff640 1 -- 172.21.15.19:0/204916745 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a8011a60 con 0x5639f59b6a10 2024-09-12T02:02:26.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.528+0000 7f26b9d20f40 1 -- 172.21.15.19:0/204916745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639f59b3f40 con 0x5639f59b6a10 2024-09-12T02:02:26.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.530+0000 7f26affff640 1 -- 172.21.15.19:0/204916745 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f26a8018070 con 0x5639f59b6a10 2024-09-12T02:02:26.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.530+0000 7f26affff640 1 --2- 172.21.15.19:0/204916745 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f269806a810 0x7f269806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.530+0000 7f26affff640 1 -- 172.21.15.19:0/204916745 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f26a8089fe0 con 0x5639f59b6a10 2024-09-12T02:02:26.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.530+0000 7f26b65ae640 1 --2- 172.21.15.19:0/204916745 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f269806a810 0x7f269806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.530+0000 7f26b9d20f40 1 --2- 172.21.15.19:0/204916745 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5639f599ac50 0x5639f5adec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.530+0000 7f26b9d20f40 1 -- 172.21.15.19:0/204916745 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 13.f 13:f1f69726:::400.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5639f59b4740 con 0x5639f599ac50 2024-09-12T02:02:26.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.530+0000 7f26b75b0640 1 --2- 172.21.15.19:0/204916745 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5639f599ac50 0x5639f5adec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.531+0000 7f26b65ae640 1 --2- 172.21.15.19:0/204916745 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f269806a810 0x7f269806ccd0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f26a0057000 tx=0x7f26a0052000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.531+0000 7f26b75b0640 1 --2- 172.21.15.19:0/204916745 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5639f599ac50 0x5639f5adec60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.531+0000 7f26b75b0640 1 -- 172.21.15.19:0/204916745 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 400.00000000 [omap-get-keys out=5b] v0'0 uv1 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f26b000f630 con 0x5639f599ac50 2024-09-12T02:02:26.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.531+0000 7f26b9d20f40 1 -- 172.21.15.19:0/204916745 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5639f599ac50 msgr2=0x5639f5adec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.531+0000 7f26b9d20f40 1 --2- 172.21.15.19:0/204916745 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5639f599ac50 0x5639f5adec60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.531+0000 7f26b9d20f40 1 -- 172.21.15.19:0/204916745 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f269806a810 msgr2=0x7f269806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.531+0000 7f26b9d20f40 1 --2- 172.21.15.19:0/204916745 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f269806a810 0x7f269806ccd0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f26a0057000 tx=0x7f26a0052000 comp rx=0 tx=0).stop 2024-09-12T02:02:26.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.531+0000 7f26b9d20f40 1 -- 172.21.15.19:0/204916745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639f59b6a10 msgr2=0x5639f599a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.531+0000 7f26b9d20f40 1 --2- 172.21.15.19:0/204916745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639f59b6a10 0x5639f599a710 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f26a800a4d0 tx=0x7f26a800a990 comp rx=0 tx=0).stop 2024-09-12T02:02:26.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.531+0000 7f26b75b0640 1 -- 172.21.15.19:0/204916745 reap_dead start 2024-09-12T02:02:26.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.531+0000 7f26b9d20f40 1 -- 172.21.15.19:0/204916745 shutdown_connections 2024-09-12T02:02:26.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.531+0000 7f26b9d20f40 1 -- 172.21.15.19:0/204916745 >> 172.21.15.19:0/204916745 conn(0x5639f596e9e0 msgr2=0x5639f59b8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.531+0000 7f26b9d20f40 1 -- 172.21.15.19:0/204916745 shutdown_connections 2024-09-12T02:02:26.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.531+0000 7f26b9d20f40 1 -- 172.21.15.19:0/204916745 wait complete. 2024-09-12T02:02:26.541 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 100.00000000.inode 2024-09-12T02:02:26.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.634+0000 7fa38d370f40 1 Processor -- start 2024-09-12T02:02:26.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.635+0000 7fa38d370f40 1 -- start start 2024-09-12T02:02:26.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.635+0000 7fa38d370f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ae6dc350 0x5602ae708240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.635+0000 7fa38d370f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5602ae70a050 0x5602ae708bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.635+0000 7fa38d370f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ae794080 0x5602ae7b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.635+0000 7fa38d370f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5602ae6d8ae0 con 0x5602ae6dc350 2024-09-12T02:02:26.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.635+0000 7fa38d370f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5602ae62b510 con 0x5602ae794080 2024-09-12T02:02:26.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.635+0000 7fa38d370f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5602ae6d8dc0 con 0x5602ae70a050 2024-09-12T02:02:26.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.635+0000 7fa38ae66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ae6dc350 0x5602ae708240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.635+0000 7fa38ae66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ae6dc350 0x5602ae708240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51370/0 (socket says 172.21.15.19:51370) 2024-09-12T02:02:26.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.635+0000 7fa38ae66640 1 -- 172.21.15.19:0/3170265499 learned_addr learned my addr 172.21.15.19:0/3170265499 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.635+0000 7fa38b667640 1 --2- 172.21.15.19:0/3170265499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ae794080 0x5602ae7b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.635+0000 7fa38a665640 1 --2- 172.21.15.19:0/3170265499 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5602ae70a050 0x5602ae708bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa38ae66640 1 -- 172.21.15.19:0/3170265499 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5602ae70a050 msgr2=0x5602ae708bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa38ae66640 1 --2- 172.21.15.19:0/3170265499 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5602ae70a050 0x5602ae708bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa38ae66640 1 -- 172.21.15.19:0/3170265499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ae794080 msgr2=0x5602ae7b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa38ae66640 1 --2- 172.21.15.19:0/3170265499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ae794080 0x5602ae7b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa38ae66640 1 -- 172.21.15.19:0/3170265499 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602ae7b3a00 con 0x5602ae6dc350 2024-09-12T02:02:26.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa38b667640 1 --2- 172.21.15.19:0/3170265499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ae794080 0x5602ae7b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:26.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa38ae66640 1 --2- 172.21.15.19:0/3170265499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ae6dc350 0x5602ae708240 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fa37c000c00 tx=0x7fa37c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9b7320f0d9db98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa389663640 1 -- 172.21.15.19:0/3170265499 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c055070 con 0x5602ae6dc350 2024-09-12T02:02:26.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa389663640 1 -- 172.21.15.19:0/3170265499 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa37c0518b0 con 0x5602ae6dc350 2024-09-12T02:02:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa389663640 1 -- 172.21.15.19:0/3170265499 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c051ca0 con 0x5602ae6dc350 2024-09-12T02:02:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa38d370f40 1 -- 172.21.15.19:0/3170265499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ae6dc350 msgr2=0x5602ae708240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa38d370f40 1 --2- 172.21.15.19:0/3170265499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ae6dc350 0x5602ae708240 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fa37c000c00 tx=0x7fa37c051000 comp rx=0 tx=0).stop 2024-09-12T02:02:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa38d370f40 1 -- 172.21.15.19:0/3170265499 shutdown_connections 2024-09-12T02:02:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa38d370f40 1 --2- 172.21.15.19:0/3170265499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ae794080 0x5602ae7b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa38d370f40 1 --2- 172.21.15.19:0/3170265499 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5602ae70a050 0x5602ae708bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa38d370f40 1 --2- 172.21.15.19:0/3170265499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ae6dc350 0x5602ae708240 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa38d370f40 1 -- 172.21.15.19:0/3170265499 >> 172.21.15.19:0/3170265499 conn(0x5602ae6d99e0 msgr2=0x5602ae720350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa38d370f40 1 -- 172.21.15.19:0/3170265499 shutdown_connections 2024-09-12T02:02:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.636+0000 7fa38d370f40 1 -- 172.21.15.19:0/3170265499 wait complete. 2024-09-12T02:02:26.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.637+0000 7fa38d370f40 1 Processor -- start 2024-09-12T02:02:26.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.637+0000 7fa38d370f40 1 -- start start 2024-09-12T02:02:26.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa38d370f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5602ae6dc350 0x5602ae7aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa38d370f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ae70a050 0x5602ae7b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa38d370f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ae794080 0x5602ae797de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa38d370f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5602ae7b4100 con 0x5602ae70a050 2024-09-12T02:02:26.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa38d370f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5602ae799ba0 con 0x5602ae794080 2024-09-12T02:02:26.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa38d370f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5602ae7b43e0 con 0x5602ae6dc350 2024-09-12T02:02:26.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa38a665640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ae70a050 0x5602ae7b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa38a665640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ae70a050 0x5602ae7b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51374/0 (socket says 172.21.15.19:51374) 2024-09-12T02:02:26.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa38a665640 1 -- 172.21.15.19:0/3278038304 learned_addr learned my addr 172.21.15.19:0/3278038304 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa38ae66640 1 --2- 172.21.15.19:0/3278038304 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5602ae6dc350 0x5602ae7aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa38b667640 1 --2- 172.21.15.19:0/3278038304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ae794080 0x5602ae797de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa38a665640 1 -- 172.21.15.19:0/3278038304 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5602ae6dc350 msgr2=0x5602ae7aee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa38a665640 1 --2- 172.21.15.19:0/3278038304 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5602ae6dc350 0x5602ae7aee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa38a665640 1 -- 172.21.15.19:0/3278038304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ae794080 msgr2=0x5602ae797de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa38a665640 1 --2- 172.21.15.19:0/3278038304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ae794080 0x5602ae797de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa38a665640 1 -- 172.21.15.19:0/3278038304 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602ae7af3b0 con 0x5602ae70a050 2024-09-12T02:02:26.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa38a665640 1 --2- 172.21.15.19:0/3278038304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ae70a050 0x5602ae7b0670 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fa380003c90 tx=0x7fa38000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa373fff640 1 -- 172.21.15.19:0/3278038304 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380015070 con 0x5602ae70a050 2024-09-12T02:02:26.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa373fff640 1 -- 172.21.15.19:0/3278038304 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa380011640 con 0x5602ae70a050 2024-09-12T02:02:26.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa38d370f40 1 -- 172.21.15.19:0/3278038304 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602ae7af660 con 0x5602ae70a050 2024-09-12T02:02:26.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.638+0000 7fa373fff640 1 -- 172.21.15.19:0/3278038304 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380011a30 con 0x5602ae70a050 2024-09-12T02:02:26.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.639+0000 7fa38d370f40 1 -- 172.21.15.19:0/3278038304 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602ae792810 con 0x5602ae70a050 2024-09-12T02:02:26.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.640+0000 7fa373fff640 1 -- 172.21.15.19:0/3278038304 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa380018070 con 0x5602ae70a050 2024-09-12T02:02:26.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.640+0000 7fa373fff640 1 --2- 172.21.15.19:0/3278038304 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa37806a840 0x7fa37806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.640+0000 7fa373fff640 1 -- 172.21.15.19:0/3278038304 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7fa380089970 con 0x5602ae70a050 2024-09-12T02:02:26.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.641+0000 7fa38d370f40 1 --2- 172.21.15.19:0/3278038304 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5602ae7afa80 0x5602ae791c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.641+0000 7fa38d370f40 1 -- 172.21.15.19:0/3278038304 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5602ae7b0bb0 con 0x5602ae7afa80 2024-09-12T02:02:26.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.641+0000 7fa38ae66640 1 --2- 172.21.15.19:0/3278038304 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa37806a840 0x7fa37806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.641+0000 7fa38b667640 1 --2- 172.21.15.19:0/3278038304 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5602ae7afa80 0x5602ae791c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.641+0000 7fa38ae66640 1 --2- 172.21.15.19:0/3278038304 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa37806a840 0x7fa37806cd00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00a4f0 tx=0x7fa37c053000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.641+0000 7fa38b667640 1 --2- 172.21.15.19:0/3278038304 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5602ae7afa80 0x5602ae791c20 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.642+0000 7fa38b667640 1 -- 172.21.15.19:0/3278038304 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 100.00000000.inode [omap-get-keys out=5b] v0'0 uv3 ondisk = 0) ==== 162+0+5 (crc 0 0 0) 0x7fa38400d980 con 0x5602ae7afa80 2024-09-12T02:02:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.642+0000 7fa38d370f40 1 -- 172.21.15.19:0/3278038304 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5602ae7afa80 msgr2=0x5602ae791c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.642+0000 7fa38d370f40 1 --2- 172.21.15.19:0/3278038304 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5602ae7afa80 0x5602ae791c20 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.642+0000 7fa38d370f40 1 -- 172.21.15.19:0/3278038304 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa37806a840 msgr2=0x7fa37806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.642+0000 7fa38d370f40 1 --2- 172.21.15.19:0/3278038304 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa37806a840 0x7fa37806cd00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00a4f0 tx=0x7fa37c053000 comp rx=0 tx=0).stop 2024-09-12T02:02:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.642+0000 7fa38d370f40 1 -- 172.21.15.19:0/3278038304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ae70a050 msgr2=0x5602ae7b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.642+0000 7fa38d370f40 1 --2- 172.21.15.19:0/3278038304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ae70a050 0x5602ae7b0670 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fa380003c90 tx=0x7fa38000b5b0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.642+0000 7fa38b667640 1 -- 172.21.15.19:0/3278038304 reap_dead start 2024-09-12T02:02:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.642+0000 7fa38d370f40 1 -- 172.21.15.19:0/3278038304 shutdown_connections 2024-09-12T02:02:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.642+0000 7fa38d370f40 1 -- 172.21.15.19:0/3278038304 >> 172.21.15.19:0/3278038304 conn(0x5602ae6d99e0 msgr2=0x5602ae793110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.642+0000 7fa38d370f40 1 -- 172.21.15.19:0/3278038304 shutdown_connections 2024-09-12T02:02:26.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.642+0000 7fa38d370f40 1 -- 172.21.15.19:0/3278038304 wait complete. 2024-09-12T02:02:26.647 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-09-12T02:02:26.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.731+0000 7f6511948f40 1 Processor -- start 2024-09-12T02:02:26.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.731+0000 7f6511948f40 1 -- start start 2024-09-12T02:02:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.732+0000 7f6511948f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4058cd5d0 0x55c4057fd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.732+0000 7f6511948f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c4057fd960 0x55c4058cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.732+0000 7f6511948f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4058cdef0 0x55c4058ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.732+0000 7f6511948f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c40574f510 con 0x55c4058cdef0 2024-09-12T02:02:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.732+0000 7f6511948f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c4057a8c50 con 0x55c4058cd5d0 2024-09-12T02:02:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.732+0000 7f6511948f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55c4058d2350 con 0x55c4057fd960 2024-09-12T02:02:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.732+0000 7f650fc3f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4058cdef0 0x55c4058ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.732+0000 7f650fc3f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4058cdef0 0x55c4058ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51398/0 (socket says 172.21.15.19:51398) 2024-09-12T02:02:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.732+0000 7f650fc3f640 1 -- 172.21.15.19:0/3680157564 learned_addr learned my addr 172.21.15.19:0/3680157564 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.732+0000 7f650f43e640 1 --2- 172.21.15.19:0/3680157564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4058cd5d0 0x55c4057fd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.732+0000 7f650ec3d640 1 --2- 172.21.15.19:0/3680157564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c4057fd960 0x55c4058cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.732+0000 7f650fc3f640 1 -- 172.21.15.19:0/3680157564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c4057fd960 msgr2=0x55c4058cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.732+0000 7f650fc3f640 1 --2- 172.21.15.19:0/3680157564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c4057fd960 0x55c4058cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.732+0000 7f650fc3f640 1 -- 172.21.15.19:0/3680157564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4058cd5d0 msgr2=0x55c4057fd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.732+0000 7f650fc3f640 1 --2- 172.21.15.19:0/3680157564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4058cd5d0 0x55c4057fd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.732+0000 7f650fc3f640 1 -- 172.21.15.19:0/3680157564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c405828400 con 0x55c4058cdef0 2024-09-12T02:02:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.733+0000 7f650fc3f640 1 --2- 172.21.15.19:0/3680157564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4058cdef0 0x55c4058ce370 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f6508005830 tx=0x7f6508051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b48a36bcec800e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.733+0000 7f650dc3b640 1 -- 172.21.15.19:0/3680157564 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508058400 con 0x55c4058cdef0 2024-09-12T02:02:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.733+0000 7f650dc3b640 1 -- 172.21.15.19:0/3680157564 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65080587b0 con 0x55c4058cdef0 2024-09-12T02:02:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.733+0000 7f650dc3b640 1 -- 172.21.15.19:0/3680157564 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508058ba0 con 0x55c4058cdef0 2024-09-12T02:02:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.733+0000 7f6511948f40 1 -- 172.21.15.19:0/3680157564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4058cdef0 msgr2=0x55c4058ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.733+0000 7f6511948f40 1 --2- 172.21.15.19:0/3680157564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4058cdef0 0x55c4058ce370 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f6508005830 tx=0x7f6508051000 comp rx=0 tx=0).stop 2024-09-12T02:02:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.733+0000 7f6511948f40 1 -- 172.21.15.19:0/3680157564 shutdown_connections 2024-09-12T02:02:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.733+0000 7f6511948f40 1 --2- 172.21.15.19:0/3680157564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4058cdef0 0x55c4058ce370 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.733+0000 7f6511948f40 1 --2- 172.21.15.19:0/3680157564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c4057fd960 0x55c4058cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.733+0000 7f6511948f40 1 --2- 172.21.15.19:0/3680157564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4058cd5d0 0x55c4057fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.733+0000 7f6511948f40 1 -- 172.21.15.19:0/3680157564 >> 172.21.15.19:0/3680157564 conn(0x55c4057ff1d0 msgr2=0x55c4057fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.733+0000 7f6511948f40 1 -- 172.21.15.19:0/3680157564 shutdown_connections 2024-09-12T02:02:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.733+0000 7f6511948f40 1 -- 172.21.15.19:0/3680157564 wait complete. 2024-09-12T02:02:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.734+0000 7f6511948f40 1 Processor -- start 2024-09-12T02:02:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.734+0000 7f6511948f40 1 -- start start 2024-09-12T02:02:26.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.734+0000 7f6511948f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4057fd960 0x55c4058caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f6511948f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4058cd5d0 0x55c405820f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f6511948f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c4058cdef0 0x55c4058cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f6511948f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c4057fcef0 con 0x55c4057fd960 2024-09-12T02:02:26.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f6511948f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c405828730 con 0x55c4058cd5d0 2024-09-12T02:02:26.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f6511948f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55c4057fc350 con 0x55c4058cdef0 2024-09-12T02:02:26.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f650f43e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4057fd960 0x55c4058caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f650f43e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4057fd960 0x55c4058caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51410/0 (socket says 172.21.15.19:51410) 2024-09-12T02:02:26.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f650f43e640 1 -- 172.21.15.19:0/3929607393 learned_addr learned my addr 172.21.15.19:0/3929607393 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f650fc3f640 1 --2- 172.21.15.19:0/3929607393 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c4058cdef0 0x55c4058cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f650ec3d640 1 --2- 172.21.15.19:0/3929607393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4058cd5d0 0x55c405820f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f650f43e640 1 -- 172.21.15.19:0/3929607393 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c4058cdef0 msgr2=0x55c4058cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f650f43e640 1 --2- 172.21.15.19:0/3929607393 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c4058cdef0 0x55c4058cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f650f43e640 1 -- 172.21.15.19:0/3929607393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4058cd5d0 msgr2=0x55c405820f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f650f43e640 1 --2- 172.21.15.19:0/3929607393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4058cd5d0 0x55c405820f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f650f43e640 1 -- 172.21.15.19:0/3929607393 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c40581fe90 con 0x55c4057fd960 2024-09-12T02:02:26.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f650fc3f640 1 --2- 172.21.15.19:0/3929607393 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c4058cdef0 0x55c4058cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:26.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f650f43e640 1 --2- 172.21.15.19:0/3929607393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4057fd960 0x55c4058caec0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f650000f4c0 tx=0x7f650000f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f650cc39640 1 -- 172.21.15.19:0/3929607393 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6500017020 con 0x55c4057fd960 2024-09-12T02:02:26.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f650cc39640 1 -- 172.21.15.19:0/3929607393 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6500013810 con 0x55c4057fd960 2024-09-12T02:02:26.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f6511948f40 1 -- 172.21.15.19:0/3929607393 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c405820170 con 0x55c4057fd960 2024-09-12T02:02:26.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f650cc39640 1 -- 172.21.15.19:0/3929607393 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6500013bc0 con 0x55c4057fd960 2024-09-12T02:02:26.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.735+0000 7f6511948f40 1 -- 172.21.15.19:0/3929607393 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c405820730 con 0x55c4057fd960 2024-09-12T02:02:26.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.737+0000 7f650cc39640 1 -- 172.21.15.19:0/3929607393 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f650001a020 con 0x55c4057fd960 2024-09-12T02:02:26.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.737+0000 7f650cc39640 1 --2- 172.21.15.19:0/3929607393 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f64f006a810 0x7f64f006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.737+0000 7f650cc39640 1 -- 172.21.15.19:0/3929607393 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f650008a040 con 0x55c4057fd960 2024-09-12T02:02:26.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.737+0000 7f650ec3d640 1 --2- 172.21.15.19:0/3929607393 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f64f006a810 0x7f64f006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.737+0000 7f6511948f40 1 --2- 172.21.15.19:0/3929607393 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c40596c2e0 0x55c40596c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.737+0000 7f6511948f40 1 -- 172.21.15.19:0/3929607393 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55c4057fd540 con 0x55c40596c2e0 2024-09-12T02:02:26.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.738+0000 7f650fc3f640 1 --2- 172.21.15.19:0/3929607393 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c40596c2e0 0x55c40596c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.738+0000 7f650ec3d640 1 --2- 172.21.15.19:0/3929607393 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f64f006a810 0x7f64f006ccd0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x55c4058e11f0 tx=0x7f64f8001730 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.738+0000 7f650fc3f640 1 --2- 172.21.15.19:0/3929607393 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c40596c2e0 0x55c40596c6e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.742 INFO:teuthology.orchestra.run.smithi019.stdout:subdir_head 2024-09-12T02:02:26.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.738+0000 7f650fc3f640 1 -- 172.21.15.19:0/3929607393 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=20b] v0'0 uv6 ondisk = 0) ==== 154+0+20 (crc 0 0 0) 0x7f650804e040 con 0x55c40596c2e0 2024-09-12T02:02:26.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.738+0000 7f6511948f40 1 -- 172.21.15.19:0/3929607393 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c40596c2e0 msgr2=0x55c40596c6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.738+0000 7f6511948f40 1 --2- 172.21.15.19:0/3929607393 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c40596c2e0 0x55c40596c6e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.738+0000 7f6511948f40 1 -- 172.21.15.19:0/3929607393 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f64f006a810 msgr2=0x7f64f006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.738+0000 7f6511948f40 1 --2- 172.21.15.19:0/3929607393 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f64f006a810 0x7f64f006ccd0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x55c4058e11f0 tx=0x7f64f8001730 comp rx=0 tx=0).stop 2024-09-12T02:02:26.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.738+0000 7f6511948f40 1 -- 172.21.15.19:0/3929607393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4057fd960 msgr2=0x55c4058caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.738+0000 7f6511948f40 1 --2- 172.21.15.19:0/3929607393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4057fd960 0x55c4058caec0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f650000f4c0 tx=0x7f650000f980 comp rx=0 tx=0).stop 2024-09-12T02:02:26.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.738+0000 7f650fc3f640 1 -- 172.21.15.19:0/3929607393 reap_dead start 2024-09-12T02:02:26.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.738+0000 7f6511948f40 1 -- 172.21.15.19:0/3929607393 shutdown_connections 2024-09-12T02:02:26.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.738+0000 7f6511948f40 1 -- 172.21.15.19:0/3929607393 >> 172.21.15.19:0/3929607393 conn(0x55c4057ff1d0 msgr2=0x55c4058cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.739+0000 7f6511948f40 1 -- 172.21.15.19:0/3929607393 shutdown_connections 2024-09-12T02:02:26.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.739+0000 7f6511948f40 1 -- 172.21.15.19:0/3929607393 wait complete. 2024-09-12T02:02:26.744 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 10000000000.00000000 2024-09-12T02:02:26.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.827+0000 7fb833466f40 1 Processor -- start 2024-09-12T02:02:26.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.828+0000 7fb833466f40 1 -- start start 2024-09-12T02:02:26.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.828+0000 7fb833466f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623363aa900 0x562336435970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.828+0000 7fb833466f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56233641eb20 0x56233641d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.828+0000 7fb833466f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56233641ef00 0x56233641de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.828+0000 7fb833466f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56233638e350 con 0x56233641eb20 2024-09-12T02:02:26.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.828+0000 7fb833466f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5623362b2510 con 0x5623363aa900 2024-09-12T02:02:26.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.828+0000 7fb833466f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56233638e630 con 0x56233641ef00 2024-09-12T02:02:26.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.828+0000 7fb83075b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56233641eb20 0x56233641d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.828+0000 7fb83075b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56233641eb20 0x56233641d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51432/0 (socket says 172.21.15.19:51432) 2024-09-12T02:02:26.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.828+0000 7fb83075b640 1 -- 172.21.15.19:0/2400214296 learned_addr learned my addr 172.21.15.19:0/2400214296 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.828+0000 7fb83175d640 1 --2- 172.21.15.19:0/2400214296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56233641ef00 0x56233641de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.828+0000 7fb830f5c640 1 --2- 172.21.15.19:0/2400214296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623363aa900 0x562336435970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.829+0000 7fb83075b640 1 -- 172.21.15.19:0/2400214296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56233641ef00 msgr2=0x56233641de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.829+0000 7fb83075b640 1 --2- 172.21.15.19:0/2400214296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56233641ef00 0x56233641de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.829+0000 7fb83075b640 1 -- 172.21.15.19:0/2400214296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623363aa900 msgr2=0x562336435970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.829+0000 7fb83075b640 1 --2- 172.21.15.19:0/2400214296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623363aa900 0x562336435970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.829+0000 7fb83075b640 1 -- 172.21.15.19:0/2400214296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562336360f70 con 0x56233641eb20 2024-09-12T02:02:26.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.829+0000 7fb83175d640 1 --2- 172.21.15.19:0/2400214296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56233641ef00 0x56233641de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:26.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.829+0000 7fb83075b640 1 --2- 172.21.15.19:0/2400214296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56233641eb20 0x56233641d930 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fb818001ce0 tx=0x7fb81800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3afa824b3f8ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.829+0000 7fb82f759640 1 -- 172.21.15.19:0/2400214296 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81800bc60 con 0x56233641eb20 2024-09-12T02:02:26.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.829+0000 7fb82f759640 1 -- 172.21.15.19:0/2400214296 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb81800be20 con 0x56233641eb20 2024-09-12T02:02:26.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.829+0000 7fb82f759640 1 -- 172.21.15.19:0/2400214296 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81800f640 con 0x56233641eb20 2024-09-12T02:02:26.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.829+0000 7fb833466f40 1 -- 172.21.15.19:0/2400214296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56233641eb20 msgr2=0x56233641d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.829+0000 7fb833466f40 1 --2- 172.21.15.19:0/2400214296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56233641eb20 0x56233641d930 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fb818001ce0 tx=0x7fb81800b5b0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.829+0000 7fb833466f40 1 -- 172.21.15.19:0/2400214296 shutdown_connections 2024-09-12T02:02:26.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.829+0000 7fb833466f40 1 --2- 172.21.15.19:0/2400214296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56233641ef00 0x56233641de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.829+0000 7fb833466f40 1 --2- 172.21.15.19:0/2400214296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56233641eb20 0x56233641d930 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.829+0000 7fb833466f40 1 --2- 172.21.15.19:0/2400214296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623363aa900 0x562336435970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.829+0000 7fb833466f40 1 -- 172.21.15.19:0/2400214296 >> 172.21.15.19:0/2400214296 conn(0x562336361ad0 msgr2=0x562336361eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.829+0000 7fb833466f40 1 -- 172.21.15.19:0/2400214296 shutdown_connections 2024-09-12T02:02:26.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.830+0000 7fb833466f40 1 -- 172.21.15.19:0/2400214296 wait complete. 2024-09-12T02:02:26.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.830+0000 7fb833466f40 1 Processor -- start 2024-09-12T02:02:26.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.830+0000 7fb833466f40 1 -- start start 2024-09-12T02:02:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb833466f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623363aa900 0x562336434e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb833466f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56233641eb20 0x562336419e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb833466f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56233641ef00 0x56233641a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb833466f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5623364372a0 con 0x5623363aa900 2024-09-12T02:02:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb833466f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5623363a9e50 con 0x56233641eb20 2024-09-12T02:02:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb833466f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56233638c6f0 con 0x56233641ef00 2024-09-12T02:02:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb830f5c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623363aa900 0x562336434e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb830f5c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623363aa900 0x562336434e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51440/0 (socket says 172.21.15.19:51440) 2024-09-12T02:02:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb830f5c640 1 -- 172.21.15.19:0/2002685107 learned_addr learned my addr 172.21.15.19:0/2002685107 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb83075b640 1 --2- 172.21.15.19:0/2002685107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56233641eb20 0x562336419e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb83175d640 1 --2- 172.21.15.19:0/2002685107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56233641ef00 0x56233641a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb830f5c640 1 -- 172.21.15.19:0/2002685107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56233641ef00 msgr2=0x56233641a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb830f5c640 1 --2- 172.21.15.19:0/2002685107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56233641ef00 0x56233641a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb830f5c640 1 -- 172.21.15.19:0/2002685107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56233641eb20 msgr2=0x562336419e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb830f5c640 1 --2- 172.21.15.19:0/2002685107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56233641eb20 0x562336419e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb830f5c640 1 -- 172.21.15.19:0/2002685107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623364353d0 con 0x5623363aa900 2024-09-12T02:02:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb83175d640 1 --2- 172.21.15.19:0/2002685107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56233641ef00 0x56233641a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb830f5c640 1 --2- 172.21.15.19:0/2002685107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623363aa900 0x562336434e90 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fb82000e2e0 tx=0x7fb82000e7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.831+0000 7fb82e757640 1 -- 172.21.15.19:0/2002685107 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb820013870 con 0x5623363aa900 2024-09-12T02:02:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.832+0000 7fb82e757640 1 -- 172.21.15.19:0/2002685107 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb820013a10 con 0x5623363aa900 2024-09-12T02:02:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.832+0000 7fb833466f40 1 -- 172.21.15.19:0/2002685107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623363a5600 con 0x5623363aa900 2024-09-12T02:02:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.832+0000 7fb82e757640 1 -- 172.21.15.19:0/2002685107 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb820013dc0 con 0x5623363aa900 2024-09-12T02:02:26.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.832+0000 7fb833466f40 1 -- 172.21.15.19:0/2002685107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623363a5bc0 con 0x5623363aa900 2024-09-12T02:02:26.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.833+0000 7fb82e757640 1 -- 172.21.15.19:0/2002685107 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb820011070 con 0x5623363aa900 2024-09-12T02:02:26.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.833+0000 7fb82e757640 1 --2- 172.21.15.19:0/2002685107 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb81006a810 0x7fb81006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.833+0000 7fb82e757640 1 -- 172.21.15.19:0/2002685107 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7fb82008a770 con 0x5623363aa900 2024-09-12T02:02:26.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.834+0000 7fb83075b640 1 --2- 172.21.15.19:0/2002685107 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb81006a810 0x7fb81006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.834+0000 7fb833466f40 1 --2- 172.21.15.19:0/2002685107 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562336418780 0x562336418b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.834+0000 7fb833466f40 1 -- 172.21.15.19:0/2002685107 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:0cf6ad0f:::10000000000.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5623364190c0 con 0x562336418780 2024-09-12T02:02:26.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.834+0000 7fb83175d640 1 --2- 172.21.15.19:0/2002685107 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562336418780 0x562336418b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.834+0000 7fb83075b640 1 --2- 172.21.15.19:0/2002685107 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb81006a810 0x7fb81006ccd0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x56233641b490 tx=0x7fb818009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.834+0000 7fb83175d640 1 --2- 172.21.15.19:0/2002685107 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562336418780 0x562336418b80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.834+0000 7fb83175d640 1 -- 172.21.15.19:0/2002685107 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 10000000000.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x7fb828057030 con 0x562336418780 2024-09-12T02:02:26.839 INFO:teuthology.orchestra.run.smithi019.stdout:cephfs_metadata/10000000000.00000000 mtime 2024-09-12T02:02:23.000000+0000, size 0 2024-09-12T02:02:26.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.834+0000 7fb833466f40 1 -- 172.21.15.19:0/2002685107 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562336418780 msgr2=0x562336418b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.834+0000 7fb833466f40 1 --2- 172.21.15.19:0/2002685107 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562336418780 0x562336418b80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.835+0000 7fb833466f40 1 -- 172.21.15.19:0/2002685107 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb81006a810 msgr2=0x7fb81006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.835+0000 7fb833466f40 1 --2- 172.21.15.19:0/2002685107 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb81006a810 0x7fb81006ccd0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x56233641b490 tx=0x7fb818009000 comp rx=0 tx=0).stop 2024-09-12T02:02:26.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.835+0000 7fb833466f40 1 -- 172.21.15.19:0/2002685107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623363aa900 msgr2=0x562336434e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.835+0000 7fb833466f40 1 --2- 172.21.15.19:0/2002685107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623363aa900 0x562336434e90 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fb82000e2e0 tx=0x7fb82000e7a0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.835+0000 7fb83175d640 1 -- 172.21.15.19:0/2002685107 reap_dead start 2024-09-12T02:02:26.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.835+0000 7fb833466f40 1 -- 172.21.15.19:0/2002685107 shutdown_connections 2024-09-12T02:02:26.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.835+0000 7fb833466f40 1 -- 172.21.15.19:0/2002685107 >> 172.21.15.19:0/2002685107 conn(0x562336361ad0 msgr2=0x562336361eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.835+0000 7fb833466f40 1 -- 172.21.15.19:0/2002685107 shutdown_connections 2024-09-12T02:02:26.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.835+0000 7fb833466f40 1 -- 172.21.15.19:0/2002685107 wait complete. 2024-09-12T02:02:26.841 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 600.00000000 2024-09-12T02:02:26.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.884+0000 7feb1872ef40 1 Processor -- start 2024-09-12T02:02:26.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.884+0000 7feb1872ef40 1 -- start start 2024-09-12T02:02:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb1872ef40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5590d4c1ef40 0x5590d4bf3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb1872ef40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590d4ccd240 0x5590d4ccb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb1872ef40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590d4ccbc50 0x5590d4cbe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb1872ef40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5590d4c3c4a0 con 0x5590d4ccbc50 2024-09-12T02:02:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb1872ef40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5590d4c3bf20 con 0x5590d4ccd240 2024-09-12T02:02:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb1872ef40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5590d4c3c780 con 0x5590d4c1ef40 2024-09-12T02:02:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb15fbe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590d4ccbc50 0x5590d4cbe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb15fbe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590d4ccbc50 0x5590d4cbe0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51450/0 (socket says 172.21.15.19:51450) 2024-09-12T02:02:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb15fbe640 1 -- 172.21.15.19:0/541216247 learned_addr learned my addr 172.21.15.19:0/541216247 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb157bd640 1 --2- 172.21.15.19:0/541216247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5590d4c1ef40 0x5590d4bf3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb14fbc640 1 --2- 172.21.15.19:0/541216247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590d4ccd240 0x5590d4ccb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb15fbe640 1 -- 172.21.15.19:0/541216247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5590d4c1ef40 msgr2=0x5590d4bf3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb15fbe640 1 --2- 172.21.15.19:0/541216247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5590d4c1ef40 0x5590d4bf3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb15fbe640 1 -- 172.21.15.19:0/541216247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590d4ccd240 msgr2=0x5590d4ccb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb15fbe640 1 --2- 172.21.15.19:0/541216247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590d4ccd240 0x5590d4ccb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb15fbe640 1 -- 172.21.15.19:0/541216247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590d4b1fcb0 con 0x5590d4ccbc50 2024-09-12T02:02:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb157bd640 1 --2- 172.21.15.19:0/541216247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5590d4c1ef40 0x5590d4bf3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb14fbc640 1 --2- 172.21.15.19:0/541216247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590d4ccd240 0x5590d4ccb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb15fbe640 1 --2- 172.21.15.19:0/541216247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590d4ccbc50 0x5590d4cbe0b0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7feb0800c480 tx=0x7feb0800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44743e6fc58e678b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb0f7fe640 1 -- 172.21.15.19:0/541216247 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb080116b0 con 0x5590d4ccbc50 2024-09-12T02:02:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb0f7fe640 1 -- 172.21.15.19:0/541216247 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb08017070 con 0x5590d4ccbc50 2024-09-12T02:02:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.885+0000 7feb0f7fe640 1 -- 172.21.15.19:0/541216247 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb08011a90 con 0x5590d4ccbc50 2024-09-12T02:02:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.886+0000 7feb1872ef40 1 -- 172.21.15.19:0/541216247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590d4ccbc50 msgr2=0x5590d4cbe0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.886+0000 7feb1872ef40 1 --2- 172.21.15.19:0/541216247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590d4ccbc50 0x5590d4cbe0b0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7feb0800c480 tx=0x7feb0800c940 comp rx=0 tx=0).stop 2024-09-12T02:02:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.886+0000 7feb1872ef40 1 -- 172.21.15.19:0/541216247 shutdown_connections 2024-09-12T02:02:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.886+0000 7feb1872ef40 1 --2- 172.21.15.19:0/541216247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590d4ccbc50 0x5590d4cbe0b0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.886+0000 7feb1872ef40 1 --2- 172.21.15.19:0/541216247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590d4ccd240 0x5590d4ccb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.886+0000 7feb1872ef40 1 --2- 172.21.15.19:0/541216247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5590d4c1ef40 0x5590d4bf3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.886+0000 7feb1872ef40 1 -- 172.21.15.19:0/541216247 >> 172.21.15.19:0/541216247 conn(0x5590d4bf49e0 msgr2=0x5590d4c3e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.886+0000 7feb1872ef40 1 -- 172.21.15.19:0/541216247 shutdown_connections 2024-09-12T02:02:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.886+0000 7feb1872ef40 1 -- 172.21.15.19:0/541216247 wait complete. 2024-09-12T02:02:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.887+0000 7feb1872ef40 1 Processor -- start 2024-09-12T02:02:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.887+0000 7feb1872ef40 1 -- start start 2024-09-12T02:02:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.887+0000 7feb1872ef40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590d4c1ef40 0x5590d4cbcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.887+0000 7feb1872ef40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5590d4ccbc50 0x5590d4d64b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.887+0000 7feb1872ef40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590d4ccd240 0x5590d4cbf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.887+0000 7feb1872ef40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5590d4ccc890 con 0x5590d4c1ef40 2024-09-12T02:02:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.887+0000 7feb1872ef40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5590d4bf5350 con 0x5590d4ccd240 2024-09-12T02:02:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.887+0000 7feb1872ef40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5590d4cbd9d0 con 0x5590d4ccbc50 2024-09-12T02:02:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.887+0000 7feb157bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590d4c1ef40 0x5590d4cbcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.887+0000 7feb157bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590d4c1ef40 0x5590d4cbcaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51454/0 (socket says 172.21.15.19:51454) 2024-09-12T02:02:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.887+0000 7feb157bd640 1 -- 172.21.15.19:0/2486764064 learned_addr learned my addr 172.21.15.19:0/2486764064 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.888+0000 7feb15fbe640 1 --2- 172.21.15.19:0/2486764064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590d4ccd240 0x5590d4cbf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.888+0000 7feb14fbc640 1 --2- 172.21.15.19:0/2486764064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5590d4ccbc50 0x5590d4d64b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.888+0000 7feb157bd640 1 -- 172.21.15.19:0/2486764064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5590d4ccbc50 msgr2=0x5590d4d64b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.888+0000 7feb157bd640 1 --2- 172.21.15.19:0/2486764064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5590d4ccbc50 0x5590d4d64b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.888+0000 7feb157bd640 1 -- 172.21.15.19:0/2486764064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590d4ccd240 msgr2=0x5590d4cbf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.888+0000 7feb157bd640 1 --2- 172.21.15.19:0/2486764064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590d4ccd240 0x5590d4cbf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.888+0000 7feb157bd640 1 -- 172.21.15.19:0/2486764064 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590d4cc41b0 con 0x5590d4c1ef40 2024-09-12T02:02:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.888+0000 7feb14fbc640 1 --2- 172.21.15.19:0/2486764064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5590d4ccbc50 0x5590d4d64b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.888+0000 7feb15fbe640 1 --2- 172.21.15.19:0/2486764064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590d4ccd240 0x5590d4cbf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.888+0000 7feb157bd640 1 --2- 172.21.15.19:0/2486764064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590d4c1ef40 0x5590d4cbcaf0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7feb10025c20 tx=0x7feb10002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.888+0000 7feb0e7fc640 1 -- 172.21.15.19:0/2486764064 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10053880 con 0x5590d4c1ef40 2024-09-12T02:02:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.888+0000 7feb0e7fc640 1 -- 172.21.15.19:0/2486764064 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb10053a20 con 0x5590d4c1ef40 2024-09-12T02:02:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.888+0000 7feb1872ef40 1 -- 172.21.15.19:0/2486764064 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590d4d65400 con 0x5590d4c1ef40 2024-09-12T02:02:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.888+0000 7feb0e7fc640 1 -- 172.21.15.19:0/2486764064 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10053df0 con 0x5590d4c1ef40 2024-09-12T02:02:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.888+0000 7feb1872ef40 1 -- 172.21.15.19:0/2486764064 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590d4d659c0 con 0x5590d4c1ef40 2024-09-12T02:02:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.890+0000 7feb0e7fc640 1 -- 172.21.15.19:0/2486764064 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb10068440 con 0x5590d4c1ef40 2024-09-12T02:02:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.890+0000 7feb0e7fc640 1 --2- 172.21.15.19:0/2486764064 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7feaf806a840 0x7feaf806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.890+0000 7feb0e7fc640 1 -- 172.21.15.19:0/2486764064 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7feb100ce400 con 0x5590d4c1ef40 2024-09-12T02:02:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.890+0000 7feb1872ef40 1 --2- 172.21.15.19:0/2486764064 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5590d4cc1620 0x5590d4cc1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.890+0000 7feb1872ef40 1 -- 172.21.15.19:0/2486764064 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:0d82a743:::600.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5590d4cc1f80 con 0x5590d4cc1620 2024-09-12T02:02:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.890+0000 7feb14fbc640 1 --2- 172.21.15.19:0/2486764064 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7feaf806a840 0x7feaf806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.890+0000 7feb15fbe640 1 --2- 172.21.15.19:0/2486764064 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5590d4cc1620 0x5590d4cc1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.891+0000 7feb15fbe640 1 --2- 172.21.15.19:0/2486764064 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5590d4cc1620 0x5590d4cc1a40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.891+0000 7feb14fbc640 1 --2- 172.21.15.19:0/2486764064 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7feaf806a840 0x7feaf806cd00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x5590d4cc4ed0 tx=0x7feb00005980 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.891+0000 7feb15fbe640 1 -- 172.21.15.19:0/2486764064 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 600.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x7feb08011910 con 0x5590d4cc1620 2024-09-12T02:02:26.895 INFO:teuthology.orchestra.run.smithi019.stdout:cephfs_metadata/600.00000000 mtime 2024-09-12T02:02:12.000000+0000, size 0 2024-09-12T02:02:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.891+0000 7feb1872ef40 1 -- 172.21.15.19:0/2486764064 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5590d4cc1620 msgr2=0x5590d4cc1a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.891+0000 7feb1872ef40 1 --2- 172.21.15.19:0/2486764064 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5590d4cc1620 0x5590d4cc1a40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.891+0000 7feb1872ef40 1 -- 172.21.15.19:0/2486764064 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7feaf806a840 msgr2=0x7feaf806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.891+0000 7feb1872ef40 1 --2- 172.21.15.19:0/2486764064 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7feaf806a840 0x7feaf806cd00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x5590d4cc4ed0 tx=0x7feb00005980 comp rx=0 tx=0).stop 2024-09-12T02:02:26.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.891+0000 7feb1872ef40 1 -- 172.21.15.19:0/2486764064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590d4c1ef40 msgr2=0x5590d4cbcaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.891+0000 7feb1872ef40 1 --2- 172.21.15.19:0/2486764064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590d4c1ef40 0x5590d4cbcaf0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7feb10025c20 tx=0x7feb10002fb0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.891+0000 7feb15fbe640 1 -- 172.21.15.19:0/2486764064 reap_dead start 2024-09-12T02:02:26.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.891+0000 7feb1872ef40 1 -- 172.21.15.19:0/2486764064 shutdown_connections 2024-09-12T02:02:26.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.891+0000 7feb1872ef40 1 -- 172.21.15.19:0/2486764064 >> 172.21.15.19:0/2486764064 conn(0x5590d4bf49e0 msgr2=0x5590d4bf6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.891+0000 7feb1872ef40 1 -- 172.21.15.19:0/2486764064 shutdown_connections 2024-09-12T02:02:26.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.891+0000 7feb1872ef40 1 -- 172.21.15.19:0/2486764064 wait complete. 2024-09-12T02:02:26.897 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 1.00000000.inode 2024-09-12T02:02:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.979+0000 7f9c62f4af40 1 Processor -- start 2024-09-12T02:02:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.979+0000 7f9c62f4af40 1 -- start start 2024-09-12T02:02:26.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.979+0000 7f9c62f4af40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfa7d3b9e0 0x55cfa7e13610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.979+0000 7f9c62f4af40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55cfa7d848e0 0x55cfa7e153f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.979+0000 7f9c62f4af40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfa7e12fb0 0x55cfa7e15930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.979+0000 7f9c62f4af40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cfa7c8d510 con 0x55cfa7e12fb0 2024-09-12T02:02:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.979+0000 7f9c62f4af40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cfa7d3bf20 con 0x55cfa7d3b9e0 2024-09-12T02:02:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.979+0000 7f9c62f4af40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55cfa7d83b40 con 0x55cfa7d848e0 2024-09-12T02:02:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.979+0000 7f9c61241640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfa7e12fb0 0x55cfa7e15930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.980+0000 7f9c61241640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfa7e12fb0 0x55cfa7e15930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51464/0 (socket says 172.21.15.19:51464) 2024-09-12T02:02:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.980+0000 7f9c61241640 1 -- 172.21.15.19:0/2671761283 learned_addr learned my addr 172.21.15.19:0/2671761283 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.980+0000 7f9c60a40640 1 --2- 172.21.15.19:0/2671761283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfa7d3b9e0 0x55cfa7e13610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.980+0000 7f9c6023f640 1 --2- 172.21.15.19:0/2671761283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55cfa7d848e0 0x55cfa7e153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.980+0000 7f9c61241640 1 -- 172.21.15.19:0/2671761283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55cfa7d848e0 msgr2=0x55cfa7e153f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.980+0000 7f9c61241640 1 --2- 172.21.15.19:0/2671761283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55cfa7d848e0 0x55cfa7e153f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.980+0000 7f9c61241640 1 -- 172.21.15.19:0/2671761283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfa7d3b9e0 msgr2=0x55cfa7e13610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.980+0000 7f9c61241640 1 --2- 172.21.15.19:0/2671761283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfa7d3b9e0 0x55cfa7e13610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.980+0000 7f9c61241640 1 -- 172.21.15.19:0/2671761283 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfa7e02730 con 0x55cfa7e12fb0 2024-09-12T02:02:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.980+0000 7f9c61241640 1 --2- 172.21.15.19:0/2671761283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfa7e12fb0 0x55cfa7e15930 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800b620 tx=0x7f9c5800bae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c1cc6c69a2f3a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.980+0000 7f9c5f23d640 1 -- 172.21.15.19:0/2671761283 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c58014020 con 0x55cfa7e12fb0 2024-09-12T02:02:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.980+0000 7f9c5f23d640 1 -- 172.21.15.19:0/2671761283 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c58009870 con 0x55cfa7e12fb0 2024-09-12T02:02:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.980+0000 7f9c5f23d640 1 -- 172.21.15.19:0/2671761283 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c58009c40 con 0x55cfa7e12fb0 2024-09-12T02:02:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.981+0000 7f9c62f4af40 1 -- 172.21.15.19:0/2671761283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfa7e12fb0 msgr2=0x55cfa7e15930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.981+0000 7f9c62f4af40 1 --2- 172.21.15.19:0/2671761283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfa7e12fb0 0x55cfa7e15930 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800b620 tx=0x7f9c5800bae0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.981+0000 7f9c62f4af40 1 -- 172.21.15.19:0/2671761283 shutdown_connections 2024-09-12T02:02:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.981+0000 7f9c62f4af40 1 --2- 172.21.15.19:0/2671761283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfa7e12fb0 0x55cfa7e15930 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.981+0000 7f9c62f4af40 1 --2- 172.21.15.19:0/2671761283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55cfa7d848e0 0x55cfa7e153f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.981+0000 7f9c62f4af40 1 --2- 172.21.15.19:0/2671761283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfa7d3b9e0 0x55cfa7e13610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.981+0000 7f9c62f4af40 1 -- 172.21.15.19:0/2671761283 >> 172.21.15.19:0/2671761283 conn(0x55cfa7d69490 msgr2=0x55cfa7d69870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.981+0000 7f9c62f4af40 1 -- 172.21.15.19:0/2671761283 shutdown_connections 2024-09-12T02:02:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.981+0000 7f9c62f4af40 1 -- 172.21.15.19:0/2671761283 wait complete. 2024-09-12T02:02:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.981+0000 7f9c62f4af40 1 Processor -- start 2024-09-12T02:02:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.981+0000 7f9c62f4af40 1 -- start start 2024-09-12T02:02:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.982+0000 7f9c62f4af40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfa7d3b9e0 0x55cfa7df2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.982+0000 7f9c62f4af40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfa7d848e0 0x55cfa7e12340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.982+0000 7f9c62f4af40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55cfa7e12fb0 0x55cfa7e0d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.982+0000 7f9c62f4af40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cfa7e02450 con 0x55cfa7d848e0 2024-09-12T02:02:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.982+0000 7f9c62f4af40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cfa7e02170 con 0x55cfa7d3b9e0 2024-09-12T02:02:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.982+0000 7f9c62f4af40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55cfa7d83580 con 0x55cfa7e12fb0 2024-09-12T02:02:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.982+0000 7f9c6023f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfa7d848e0 0x55cfa7e12340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.982+0000 7f9c6023f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfa7d848e0 0x55cfa7e12340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51472/0 (socket says 172.21.15.19:51472) 2024-09-12T02:02:26.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.982+0000 7f9c6023f640 1 -- 172.21.15.19:0/1723601280 learned_addr learned my addr 172.21.15.19:0/1723601280 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:26.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.982+0000 7f9c60a40640 1 --2- 172.21.15.19:0/1723601280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfa7d3b9e0 0x55cfa7df2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.982+0000 7f9c61241640 1 --2- 172.21.15.19:0/1723601280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55cfa7e12fb0 0x55cfa7e0d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.982+0000 7f9c6023f640 1 -- 172.21.15.19:0/1723601280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55cfa7e12fb0 msgr2=0x55cfa7e0d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.982+0000 7f9c6023f640 1 --2- 172.21.15.19:0/1723601280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55cfa7e12fb0 0x55cfa7e0d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.982+0000 7f9c6023f640 1 -- 172.21.15.19:0/1723601280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfa7d3b9e0 msgr2=0x55cfa7df2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.982+0000 7f9c6023f640 1 --2- 172.21.15.19:0/1723601280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfa7d3b9e0 0x55cfa7df2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.982+0000 7f9c6023f640 1 -- 172.21.15.19:0/1723601280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfa7e0d780 con 0x55cfa7d848e0 2024-09-12T02:02:26.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.983+0000 7f9c6023f640 1 --2- 172.21.15.19:0/1723601280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfa7d848e0 0x55cfa7e12340 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400a5d0 tx=0x7f9c54002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.983+0000 7f9c5e23b640 1 -- 172.21.15.19:0/1723601280 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54055040 con 0x55cfa7d848e0 2024-09-12T02:02:26.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.983+0000 7f9c5e23b640 1 -- 172.21.15.19:0/1723601280 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c54051970 con 0x55cfa7d848e0 2024-09-12T02:02:26.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.983+0000 7f9c62f4af40 1 -- 172.21.15.19:0/1723601280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfa7e0da60 con 0x55cfa7d848e0 2024-09-12T02:02:26.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.983+0000 7f9c5e23b640 1 -- 172.21.15.19:0/1723601280 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54051d40 con 0x55cfa7d848e0 2024-09-12T02:02:26.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.983+0000 7f9c62f4af40 1 -- 172.21.15.19:0/1723601280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfa7e0e020 con 0x55cfa7d848e0 2024-09-12T02:02:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.984+0000 7f9c5e23b640 1 -- 172.21.15.19:0/1723601280 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c54058070 con 0x55cfa7d848e0 2024-09-12T02:02:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.985+0000 7f9c5e23b640 1 --2- 172.21.15.19:0/1723601280 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9c4c06a840 0x7f9c4c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.985+0000 7f9c5e23b640 1 -- 172.21.15.19:0/1723601280 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f9c540cd8f0 con 0x55cfa7d848e0 2024-09-12T02:02:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.985+0000 7f9c60a40640 1 --2- 172.21.15.19:0/1723601280 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9c4c06a840 0x7f9c4c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.985+0000 7f9c62f4af40 1 --2- 172.21.15.19:0/1723601280 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55cfa7e0e820 0x55cfa7e0ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.985+0000 7f9c62f4af40 1 -- 172.21.15.19:0/1723601280 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:1 13.14 13:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55cfa7e0f190 con 0x55cfa7e0e820 2024-09-12T02:02:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.985+0000 7f9c61241640 1 --2- 172.21.15.19:0/1723601280 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55cfa7e0e820 0x55cfa7e0ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.986+0000 7f9c61241640 1 --2- 172.21.15.19:0/1723601280 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55cfa7e0e820 0x55cfa7e0ec50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.986+0000 7f9c60a40640 1 --2- 172.21.15.19:0/1723601280 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9c4c06a840 0x7f9c4c06cd00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9c50003f10 tx=0x7f9c50003870 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:26.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.986+0000 7f9c61241640 1 -- 172.21.15.19:0/1723601280 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv16 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x7f9c58009a20 con 0x55cfa7e0e820 2024-09-12T02:02:26.990 INFO:teuthology.orchestra.run.smithi019.stdout:cephfs_metadata/1.00000000.inode mtime 2024-09-12T02:02:23.000000+0000, size 582 2024-09-12T02:02:26.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.986+0000 7f9c62f4af40 1 -- 172.21.15.19:0/1723601280 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55cfa7e0e820 msgr2=0x55cfa7e0ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.986+0000 7f9c62f4af40 1 --2- 172.21.15.19:0/1723601280 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55cfa7e0e820 0x55cfa7e0ec50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.986+0000 7f9c62f4af40 1 -- 172.21.15.19:0/1723601280 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9c4c06a840 msgr2=0x7f9c4c06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.986+0000 7f9c62f4af40 1 --2- 172.21.15.19:0/1723601280 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9c4c06a840 0x7f9c4c06cd00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9c50003f10 tx=0x7f9c50003870 comp rx=0 tx=0).stop 2024-09-12T02:02:26.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.986+0000 7f9c62f4af40 1 -- 172.21.15.19:0/1723601280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfa7d848e0 msgr2=0x55cfa7e12340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:26.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.986+0000 7f9c62f4af40 1 --2- 172.21.15.19:0/1723601280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfa7d848e0 0x55cfa7e12340 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400a5d0 tx=0x7f9c54002fb0 comp rx=0 tx=0).stop 2024-09-12T02:02:26.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.986+0000 7f9c61241640 1 -- 172.21.15.19:0/1723601280 reap_dead start 2024-09-12T02:02:26.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.986+0000 7f9c62f4af40 1 -- 172.21.15.19:0/1723601280 shutdown_connections 2024-09-12T02:02:26.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.986+0000 7f9c62f4af40 1 -- 172.21.15.19:0/1723601280 >> 172.21.15.19:0/1723601280 conn(0x55cfa7d69490 msgr2=0x55cfa7d6b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:26.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.986+0000 7f9c62f4af40 1 -- 172.21.15.19:0/1723601280 shutdown_connections 2024-09-12T02:02:26.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:26.986+0000 7f9c62f4af40 1 -- 172.21.15.19:0/1723601280 wait complete. 2024-09-12T02:02:26.992 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 200.00000000 2024-09-12T02:02:27.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.076+0000 7f528bd79f40 1 Processor -- start 2024-09-12T02:02:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.076+0000 7f528bd79f40 1 -- start start 2024-09-12T02:02:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.077+0000 7f528bd79f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f444c29640 0x55f444c9c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.077+0000 7f528bd79f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f444cb5d20 0x55f444cb8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.077+0000 7f528bd79f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f444cb6100 0x55f444cb8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.077+0000 7f528bd79f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f444c2a6b0 con 0x55f444cb6100 2024-09-12T02:02:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.077+0000 7f528bd79f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f444b32510 con 0x55f444c29640 2024-09-12T02:02:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.077+0000 7f528bd79f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55f444be52d0 con 0x55f444cb5d20 2024-09-12T02:02:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.077+0000 7f528a072640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f444cb6100 0x55f444cb8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.077+0000 7f528a072640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f444cb6100 0x55f444cb8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51480/0 (socket says 172.21.15.19:51480) 2024-09-12T02:02:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.077+0000 7f528a072640 1 -- 172.21.15.19:0/3901768952 learned_addr learned my addr 172.21.15.19:0/3901768952 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.077+0000 7f5289871640 1 --2- 172.21.15.19:0/3901768952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f444c29640 0x55f444c9c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.077+0000 7f5289070640 1 --2- 172.21.15.19:0/3901768952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f444cb5d20 0x55f444cb8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.077+0000 7f528a072640 1 -- 172.21.15.19:0/3901768952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f444cb5d20 msgr2=0x55f444cb8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.077+0000 7f528a072640 1 --2- 172.21.15.19:0/3901768952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f444cb5d20 0x55f444cb8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.077+0000 7f528a072640 1 -- 172.21.15.19:0/3901768952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f444c29640 msgr2=0x55f444c9c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.077+0000 7f528a072640 1 --2- 172.21.15.19:0/3901768952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f444c29640 0x55f444c9c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.077+0000 7f528a072640 1 -- 172.21.15.19:0/3901768952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f444cb8d70 con 0x55f444cb6100 2024-09-12T02:02:27.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.078+0000 7f528a072640 1 --2- 172.21.15.19:0/3901768952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f444cb6100 0x55f444cb8670 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f528400a830 tx=0x7f528400acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54feb5bae8a096d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.078+0000 7f527bfff640 1 -- 172.21.15.19:0/3901768952 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528400d9c0 con 0x55f444cb6100 2024-09-12T02:02:27.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.078+0000 7f527bfff640 1 -- 172.21.15.19:0/3901768952 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528400db80 con 0x55f444cb6100 2024-09-12T02:02:27.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.078+0000 7f527bfff640 1 -- 172.21.15.19:0/3901768952 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284012470 con 0x55f444cb6100 2024-09-12T02:02:27.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.078+0000 7f528bd79f40 1 -- 172.21.15.19:0/3901768952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f444cb6100 msgr2=0x55f444cb8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.078+0000 7f528bd79f40 1 --2- 172.21.15.19:0/3901768952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f444cb6100 0x55f444cb8670 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f528400a830 tx=0x7f528400acf0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.078+0000 7f528bd79f40 1 -- 172.21.15.19:0/3901768952 shutdown_connections 2024-09-12T02:02:27.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.078+0000 7f528bd79f40 1 --2- 172.21.15.19:0/3901768952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f444cb6100 0x55f444cb8670 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.078+0000 7f528bd79f40 1 --2- 172.21.15.19:0/3901768952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f444cb5d20 0x55f444cb8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.078+0000 7f528bd79f40 1 --2- 172.21.15.19:0/3901768952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f444c29640 0x55f444c9c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.078+0000 7f528bd79f40 1 -- 172.21.15.19:0/3901768952 >> 172.21.15.19:0/3901768952 conn(0x55f444c0e490 msgr2=0x55f444c0e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.078+0000 7f528bd79f40 1 -- 172.21.15.19:0/3901768952 shutdown_connections 2024-09-12T02:02:27.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.078+0000 7f528bd79f40 1 -- 172.21.15.19:0/3901768952 wait complete. 2024-09-12T02:02:27.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.079+0000 7f528bd79f40 1 Processor -- start 2024-09-12T02:02:27.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.079+0000 7f528bd79f40 1 -- start start 2024-09-12T02:02:27.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f528bd79f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f444c29640 0x55f444c9a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f528bd79f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f444cb5d20 0x55f444cb1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f528bd79f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f444cb6100 0x55f444caf770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f528bd79f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f444cb6910 con 0x55f444cb6100 2024-09-12T02:02:27.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f528bd79f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f444cb6630 con 0x55f444cb5d20 2024-09-12T02:02:27.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f528bd79f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55f444c25b10 con 0x55f444c29640 2024-09-12T02:02:27.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f528a072640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f444cb6100 0x55f444caf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f528a072640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f444cb6100 0x55f444caf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51482/0 (socket says 172.21.15.19:51482) 2024-09-12T02:02:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f528a072640 1 -- 172.21.15.19:0/1706988788 learned_addr learned my addr 172.21.15.19:0/1706988788 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f5289070640 1 --2- 172.21.15.19:0/1706988788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f444cb5d20 0x55f444cb1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f5289871640 1 --2- 172.21.15.19:0/1706988788 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f444c29640 0x55f444c9a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f528a072640 1 -- 172.21.15.19:0/1706988788 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f444c29640 msgr2=0x55f444c9a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f528a072640 1 --2- 172.21.15.19:0/1706988788 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f444c29640 0x55f444c9a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f528a072640 1 -- 172.21.15.19:0/1706988788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f444cb5d20 msgr2=0x55f444cb1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f528a072640 1 --2- 172.21.15.19:0/1706988788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f444cb5d20 0x55f444cb1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f528a072640 1 -- 172.21.15.19:0/1706988788 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f444c9a860 con 0x55f444cb6100 2024-09-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f528a072640 1 --2- 172.21.15.19:0/1706988788 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f444cb6100 0x55f444caf770 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x55f444cb5930 tx=0x7f52840033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f527affd640 1 -- 172.21.15.19:0/1706988788 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528401c640 con 0x55f444cb6100 2024-09-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f527affd640 1 -- 172.21.15.19:0/1706988788 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528401c800 con 0x55f444cb6100 2024-09-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.080+0000 7f528bd79f40 1 -- 172.21.15.19:0/1706988788 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f444c9acd0 con 0x55f444cb6100 2024-09-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.081+0000 7f527affd640 1 -- 172.21.15.19:0/1706988788 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528401cbf0 con 0x55f444cb6100 2024-09-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.081+0000 7f528bd79f40 1 -- 172.21.15.19:0/1706988788 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f444caef70 con 0x55f444cb6100 2024-09-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.082+0000 7f527affd640 1 -- 172.21.15.19:0/1706988788 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f528402d3f0 con 0x55f444cb6100 2024-09-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.082+0000 7f527affd640 1 --2- 172.21.15.19:0/1706988788 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f526c06a810 0x7f526c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.082+0000 7f527affd640 1 -- 172.21.15.19:0/1706988788 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f528408c100 con 0x55f444cb6100 2024-09-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.082+0000 7f528bd79f40 1 --2- 172.21.15.19:0/1706988788 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55f444cb0160 0x55f444cad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.083+0000 7f528bd79f40 1 -- 172.21.15.19:0/1706988788 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:1 13.14 13:292cf221:::200.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55f444cb8540 con 0x55f444cb0160 2024-09-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.083+0000 7f5289871640 1 --2- 172.21.15.19:0/1706988788 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f526c06a810 0x7f526c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.083+0000 7f5289070640 1 --2- 172.21.15.19:0/1706988788 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55f444cb0160 0x55f444cad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.083+0000 7f5289070640 1 --2- 172.21.15.19:0/1706988788 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55f444cb0160 0x55f444cad880 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.083+0000 7f5289871640 1 --2- 172.21.15.19:0/1706988788 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f526c06a810 0x7f526c06ccd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f527c057000 tx=0x7f527c052000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.083+0000 7f5289070640 1 -- 172.21.15.19:0/1706988788 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(1 200.00000000 [stat out=16b] v0'0 uv20 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x7f52800117c0 con 0x55f444cb0160 2024-09-12T02:02:27.088 INFO:teuthology.orchestra.run.smithi019.stdout:cephfs_metadata/200.00000000 mtime 2024-09-12T02:02:23.000000+0000, size 90 2024-09-12T02:02:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.083+0000 7f528bd79f40 1 -- 172.21.15.19:0/1706988788 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55f444cb0160 msgr2=0x55f444cad880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.083+0000 7f528bd79f40 1 --2- 172.21.15.19:0/1706988788 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55f444cb0160 0x55f444cad880 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.083+0000 7f528bd79f40 1 -- 172.21.15.19:0/1706988788 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f526c06a810 msgr2=0x7f526c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.083+0000 7f528bd79f40 1 --2- 172.21.15.19:0/1706988788 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f526c06a810 0x7f526c06ccd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f527c057000 tx=0x7f527c052000 comp rx=0 tx=0).stop 2024-09-12T02:02:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.083+0000 7f528bd79f40 1 -- 172.21.15.19:0/1706988788 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f444cb6100 msgr2=0x55f444caf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.083+0000 7f528bd79f40 1 --2- 172.21.15.19:0/1706988788 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f444cb6100 0x55f444caf770 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x55f444cb5930 tx=0x7f52840033a0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.083+0000 7f528a072640 1 -- 172.21.15.19:0/1706988788 reap_dead start 2024-09-12T02:02:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.083+0000 7f528bd79f40 1 -- 172.21.15.19:0/1706988788 shutdown_connections 2024-09-12T02:02:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.083+0000 7f528bd79f40 1 -- 172.21.15.19:0/1706988788 >> 172.21.15.19:0/1706988788 conn(0x55f444c0e490 msgr2=0x55f444cb8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.083+0000 7f528bd79f40 1 -- 172.21.15.19:0/1706988788 shutdown_connections 2024-09-12T02:02:27.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.084+0000 7f528bd79f40 1 -- 172.21.15.19:0/1706988788 wait complete. 2024-09-12T02:02:27.091 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 200.00000001 2024-09-12T02:02:27.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.173+0000 7faeab579f40 1 Processor -- start 2024-09-12T02:02:27.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.173+0000 7faeab579f40 1 -- start start 2024-09-12T02:02:27.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.174+0000 7faeab579f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e82b7e0640 0x55e82b86de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.174+0000 7faeab579f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e82b86cd20 0x55e82b7c7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.174+0000 7faeab579f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e82b86d100 0x55e82b7c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.174+0000 7faeab579f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e82b6e9510 con 0x55e82b86cd20 2024-09-12T02:02:27.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.174+0000 7faeab579f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e82b742c50 con 0x55e82b7e0640 2024-09-12T02:02:27.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.174+0000 7faeab579f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55e82b7e16b0 con 0x55e82b86d100 2024-09-12T02:02:27.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.174+0000 7faea8870640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e82b86cd20 0x55e82b7c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.174+0000 7faea8870640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e82b86cd20 0x55e82b7c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51492/0 (socket says 172.21.15.19:51492) 2024-09-12T02:02:27.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.174+0000 7faea8870640 1 -- 172.21.15.19:0/2352107958 learned_addr learned my addr 172.21.15.19:0/2352107958 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.174+0000 7faea9071640 1 --2- 172.21.15.19:0/2352107958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e82b7e0640 0x55e82b86de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.174+0000 7faea8870640 1 -- 172.21.15.19:0/2352107958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e82b86d100 msgr2=0x55e82b7c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.174+0000 7faea8870640 1 --2- 172.21.15.19:0/2352107958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e82b86d100 0x55e82b7c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.174+0000 7faea8870640 1 -- 172.21.15.19:0/2352107958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e82b7e0640 msgr2=0x55e82b86de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.174+0000 7faea8870640 1 --2- 172.21.15.19:0/2352107958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e82b7e0640 0x55e82b86de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.174+0000 7faea8870640 1 -- 172.21.15.19:0/2352107958 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e82b86fde0 con 0x55e82b86cd20 2024-09-12T02:02:27.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.174+0000 7faea9071640 1 --2- 172.21.15.19:0/2352107958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e82b7e0640 0x55e82b86de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:27.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.175+0000 7faea8870640 1 --2- 172.21.15.19:0/2352107958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e82b86cd20 0x55e82b7c7920 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7faea000b240 tx=0x7faea000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e34db85c7cf68e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.175+0000 7fae9b7fe640 1 -- 172.21.15.19:0/2352107958 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea0008070 con 0x55e82b86cd20 2024-09-12T02:02:27.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.175+0000 7fae9b7fe640 1 -- 172.21.15.19:0/2352107958 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faea000d500 con 0x55e82b86cd20 2024-09-12T02:02:27.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.175+0000 7fae9b7fe640 1 -- 172.21.15.19:0/2352107958 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea000d8f0 con 0x55e82b86cd20 2024-09-12T02:02:27.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.175+0000 7faeab579f40 1 -- 172.21.15.19:0/2352107958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e82b86cd20 msgr2=0x55e82b7c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.175+0000 7faeab579f40 1 --2- 172.21.15.19:0/2352107958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e82b86cd20 0x55e82b7c7920 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7faea000b240 tx=0x7faea000b700 comp rx=0 tx=0).stop 2024-09-12T02:02:27.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.175+0000 7faeab579f40 1 -- 172.21.15.19:0/2352107958 shutdown_connections 2024-09-12T02:02:27.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.175+0000 7faeab579f40 1 --2- 172.21.15.19:0/2352107958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e82b86d100 0x55e82b7c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.175+0000 7faeab579f40 1 --2- 172.21.15.19:0/2352107958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e82b86cd20 0x55e82b7c7920 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.175+0000 7faeab579f40 1 --2- 172.21.15.19:0/2352107958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e82b7e0640 0x55e82b86de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.175+0000 7faeab579f40 1 -- 172.21.15.19:0/2352107958 >> 172.21.15.19:0/2352107958 conn(0x55e82b7c5490 msgr2=0x55e82b7c4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.175+0000 7faeab579f40 1 -- 172.21.15.19:0/2352107958 shutdown_connections 2024-09-12T02:02:27.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.175+0000 7faeab579f40 1 -- 172.21.15.19:0/2352107958 wait complete. 2024-09-12T02:02:27.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.176+0000 7faeab579f40 1 Processor -- start 2024-09-12T02:02:27.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.176+0000 7faeab579f40 1 -- start start 2024-09-12T02:02:27.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.177+0000 7faeab579f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e82b7e0640 0x55e82b86a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.177+0000 7faeab579f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e82b86cd20 0x55e82b86de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.177+0000 7faeab579f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e82b86d100 0x55e82b86e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.177+0000 7faeab579f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e82b86d710 con 0x55e82b86cd20 2024-09-12T02:02:27.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.177+0000 7faeab579f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e82b863c30 con 0x55e82b7e0640 2024-09-12T02:02:27.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.177+0000 7faeab579f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55e82b7e0c60 con 0x55e82b86d100 2024-09-12T02:02:27.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.177+0000 7faea8870640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e82b86cd20 0x55e82b86de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.177+0000 7faea8870640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e82b86cd20 0x55e82b86de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51498/0 (socket says 172.21.15.19:51498) 2024-09-12T02:02:27.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.177+0000 7faea8870640 1 -- 172.21.15.19:0/2186995081 learned_addr learned my addr 172.21.15.19:0/2186995081 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.177+0000 7faea9071640 1 --2- 172.21.15.19:0/2186995081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e82b7e0640 0x55e82b86a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.177+0000 7faea9872640 1 --2- 172.21.15.19:0/2186995081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e82b86d100 0x55e82b86e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.177+0000 7faea8870640 1 -- 172.21.15.19:0/2186995081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e82b86d100 msgr2=0x55e82b86e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.177+0000 7faea8870640 1 --2- 172.21.15.19:0/2186995081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e82b86d100 0x55e82b86e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.177+0000 7faea8870640 1 -- 172.21.15.19:0/2186995081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e82b7e0640 msgr2=0x55e82b86a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.177+0000 7faea8870640 1 --2- 172.21.15.19:0/2186995081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e82b7e0640 0x55e82b86a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.177+0000 7faea8870640 1 -- 172.21.15.19:0/2186995081 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e82b8671b0 con 0x55e82b86cd20 2024-09-12T02:02:27.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.177+0000 7faea9071640 1 --2- 172.21.15.19:0/2186995081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e82b7e0640 0x55e82b86a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:27.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.177+0000 7faea8870640 1 --2- 172.21.15.19:0/2186995081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e82b86cd20 0x55e82b86de00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7faea0000c00 tx=0x7faea0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.178+0000 7fae9a7fc640 1 -- 172.21.15.19:0/2186995081 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea001c650 con 0x55e82b86cd20 2024-09-12T02:02:27.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.178+0000 7fae9a7fc640 1 -- 172.21.15.19:0/2186995081 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faea0021020 con 0x55e82b86cd20 2024-09-12T02:02:27.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.178+0000 7faeab579f40 1 -- 172.21.15.19:0/2186995081 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e82b863640 con 0x55e82b86cd20 2024-09-12T02:02:27.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.178+0000 7fae9a7fc640 1 -- 172.21.15.19:0/2186995081 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea001c8d0 con 0x55e82b86cd20 2024-09-12T02:02:27.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.178+0000 7faeab579f40 1 -- 172.21.15.19:0/2186995081 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e82b866ed0 con 0x55e82b86cd20 2024-09-12T02:02:27.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.179+0000 7fae9a7fc640 1 -- 172.21.15.19:0/2186995081 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faea0017070 con 0x55e82b86cd20 2024-09-12T02:02:27.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.179+0000 7fae9a7fc640 1 --2- 172.21.15.19:0/2186995081 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae8c06a810 0x7fae8c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.180+0000 7fae9a7fc640 1 -- 172.21.15.19:0/2186995081 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7faea008b870 con 0x55e82b86cd20 2024-09-12T02:02:27.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.180+0000 7faeab579f40 1 --2- 172.21.15.19:0/2186995081 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55e82b7c78a0 0x55e82b7c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.180+0000 7faea9071640 1 --2- 172.21.15.19:0/2186995081 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae8c06a810 0x7fae8c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.180+0000 7faeab579f40 1 -- 172.21.15.19:0/2186995081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:1 13.14 13:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55e82b7c50c0 con 0x55e82b7c78a0 2024-09-12T02:02:27.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.180+0000 7faea9872640 1 --2- 172.21.15.19:0/2186995081 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55e82b7c78a0 0x55e82b7c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.180+0000 7faea9872640 1 --2- 172.21.15.19:0/2186995081 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55e82b7c78a0 0x55e82b7c7c80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.180+0000 7faea9071640 1 --2- 172.21.15.19:0/2186995081 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae8c06a810 0x7fae8c06ccd0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fae9c057000 tx=0x7fae9c052000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.180+0000 7faea9872640 1 -- 172.21.15.19:0/2186995081 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(1 200.00000001 [stat out=16b] v0'0 uv17 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x7faea4006020 con 0x55e82b7c78a0 2024-09-12T02:02:27.184 INFO:teuthology.orchestra.run.smithi019.stdout:cephfs_metadata/200.00000001 mtime 2024-09-12T02:02:23.000000+0000, size 17490 2024-09-12T02:02:27.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.181+0000 7faeab579f40 1 -- 172.21.15.19:0/2186995081 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55e82b7c78a0 msgr2=0x55e82b7c7c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.181+0000 7faeab579f40 1 --2- 172.21.15.19:0/2186995081 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55e82b7c78a0 0x55e82b7c7c80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.181+0000 7faeab579f40 1 -- 172.21.15.19:0/2186995081 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae8c06a810 msgr2=0x7fae8c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.181+0000 7faeab579f40 1 --2- 172.21.15.19:0/2186995081 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae8c06a810 0x7fae8c06ccd0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fae9c057000 tx=0x7fae9c052000 comp rx=0 tx=0).stop 2024-09-12T02:02:27.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.181+0000 7faeab579f40 1 -- 172.21.15.19:0/2186995081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e82b86cd20 msgr2=0x55e82b86de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.181+0000 7faeab579f40 1 --2- 172.21.15.19:0/2186995081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e82b86cd20 0x55e82b86de00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7faea0000c00 tx=0x7faea0000ed0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.181+0000 7faea9872640 1 -- 172.21.15.19:0/2186995081 reap_dead start 2024-09-12T02:02:27.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.181+0000 7faeab579f40 1 -- 172.21.15.19:0/2186995081 shutdown_connections 2024-09-12T02:02:27.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.181+0000 7faeab579f40 1 -- 172.21.15.19:0/2186995081 >> 172.21.15.19:0/2186995081 conn(0x55e82b7c5490 msgr2=0x55e82b795e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.181+0000 7faeab579f40 1 -- 172.21.15.19:0/2186995081 shutdown_connections 2024-09-12T02:02:27.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.181+0000 7faeab579f40 1 -- 172.21.15.19:0/2186995081 wait complete. 2024-09-12T02:02:27.187 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat mds0_openfiles.0 2024-09-12T02:02:27.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.269+0000 7f7bd0ed2f40 1 Processor -- start 2024-09-12T02:02:27.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.269+0000 7f7bd0ed2f40 1 -- start start 2024-09-12T02:02:27.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.270+0000 7f7bd0ed2f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559189653f40 0x5591897012d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.270+0000 7f7bd0ed2f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559189670a80 0x5591896559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.270+0000 7f7bd0ed2f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559189702240 0x559189627e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.270+0000 7f7bd0ed2f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559189670f20 con 0x559189702240 2024-09-12T02:02:27.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.270+0000 7f7bd0ed2f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55918957b510 con 0x559189653f40 2024-09-12T02:02:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.270+0000 7f7bd0ed2f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5591896711c0 con 0x559189670a80 2024-09-12T02:02:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.270+0000 7f7bcf1cb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559189702240 0x559189627e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.270+0000 7f7bcf1cb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559189702240 0x559189627e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51508/0 (socket says 172.21.15.19:51508) 2024-09-12T02:02:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.270+0000 7f7bcf1cb640 1 -- 172.21.15.19:0/3278401508 learned_addr learned my addr 172.21.15.19:0/3278401508 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.270+0000 7f7bce9ca640 1 --2- 172.21.15.19:0/3278401508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559189653f40 0x5591897012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.270+0000 7f7bce1c9640 1 --2- 172.21.15.19:0/3278401508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559189670a80 0x5591896559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.270+0000 7f7bcf1cb640 1 -- 172.21.15.19:0/3278401508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559189670a80 msgr2=0x5591896559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.270+0000 7f7bcf1cb640 1 --2- 172.21.15.19:0/3278401508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559189670a80 0x5591896559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.270+0000 7f7bcf1cb640 1 -- 172.21.15.19:0/3278401508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559189653f40 msgr2=0x5591897012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.270+0000 7f7bcf1cb640 1 --2- 172.21.15.19:0/3278401508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559189653f40 0x5591897012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.270+0000 7f7bcf1cb640 1 -- 172.21.15.19:0/3278401508 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591896f9a90 con 0x559189702240 2024-09-12T02:02:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.271+0000 7f7bcf1cb640 1 --2- 172.21.15.19:0/3278401508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559189702240 0x559189627e10 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009540 tx=0x7f7bc8009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc06c2adcfca6eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.271+0000 7f7bcd1c7640 1 -- 172.21.15.19:0/3278401508 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8006600 con 0x559189702240 2024-09-12T02:02:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.271+0000 7f7bcd1c7640 1 -- 172.21.15.19:0/3278401508 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc80067c0 con 0x559189702240 2024-09-12T02:02:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.271+0000 7f7bcd1c7640 1 -- 172.21.15.19:0/3278401508 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8006bb0 con 0x559189702240 2024-09-12T02:02:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.271+0000 7f7bd0ed2f40 1 -- 172.21.15.19:0/3278401508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559189702240 msgr2=0x559189627e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.271+0000 7f7bd0ed2f40 1 --2- 172.21.15.19:0/3278401508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559189702240 0x559189627e10 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009540 tx=0x7f7bc8009a00 comp rx=0 tx=0).stop 2024-09-12T02:02:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.271+0000 7f7bd0ed2f40 1 -- 172.21.15.19:0/3278401508 shutdown_connections 2024-09-12T02:02:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.271+0000 7f7bd0ed2f40 1 --2- 172.21.15.19:0/3278401508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559189702240 0x559189627e10 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.271+0000 7f7bd0ed2f40 1 --2- 172.21.15.19:0/3278401508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559189670a80 0x5591896559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.271+0000 7f7bd0ed2f40 1 --2- 172.21.15.19:0/3278401508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559189653f40 0x5591897012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.271+0000 7f7bd0ed2f40 1 -- 172.21.15.19:0/3278401508 >> 172.21.15.19:0/3278401508 conn(0x5591896299e0 msgr2=0x55918962bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.271+0000 7f7bd0ed2f40 1 -- 172.21.15.19:0/3278401508 shutdown_connections 2024-09-12T02:02:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.271+0000 7f7bd0ed2f40 1 -- 172.21.15.19:0/3278401508 wait complete. 2024-09-12T02:02:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.272+0000 7f7bd0ed2f40 1 Processor -- start 2024-09-12T02:02:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.272+0000 7f7bd0ed2f40 1 -- start start 2024-09-12T02:02:27.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.273+0000 7f7bd0ed2f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559189653f40 0x5591896fd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.273+0000 7f7bd0ed2f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559189670a80 0x55918966f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.273+0000 7f7bd0ed2f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559189702240 0x5591896f1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.273+0000 7f7bd0ed2f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5591896ff130 con 0x559189670a80 2024-09-12T02:02:27.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.273+0000 7f7bd0ed2f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5591896f2860 con 0x559189653f40 2024-09-12T02:02:27.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.273+0000 7f7bd0ed2f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5591896f2580 con 0x559189702240 2024-09-12T02:02:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.273+0000 7f7bce1c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559189670a80 0x55918966f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.273+0000 7f7bce1c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559189670a80 0x55918966f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51514/0 (socket says 172.21.15.19:51514) 2024-09-12T02:02:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.273+0000 7f7bce1c9640 1 -- 172.21.15.19:0/388629217 learned_addr learned my addr 172.21.15.19:0/388629217 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.273+0000 7f7bce9ca640 1 --2- 172.21.15.19:0/388629217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559189653f40 0x5591896fd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.273+0000 7f7bcf1cb640 1 --2- 172.21.15.19:0/388629217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559189702240 0x5591896f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.273+0000 7f7bce1c9640 1 -- 172.21.15.19:0/388629217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559189702240 msgr2=0x5591896f1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.273+0000 7f7bce1c9640 1 --2- 172.21.15.19:0/388629217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559189702240 0x5591896f1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.273+0000 7f7bce1c9640 1 -- 172.21.15.19:0/388629217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559189653f40 msgr2=0x5591896fd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.273+0000 7f7bce1c9640 1 --2- 172.21.15.19:0/388629217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559189653f40 0x5591896fd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.273+0000 7f7bce1c9640 1 -- 172.21.15.19:0/388629217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591896f1570 con 0x559189670a80 2024-09-12T02:02:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.273+0000 7f7bce1c9640 1 --2- 172.21.15.19:0/388629217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559189670a80 0x55918966f400 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8055040 tx=0x7f7bb8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.273+0000 7f7bc7fff640 1 -- 172.21.15.19:0/388629217 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8053bb0 con 0x559189670a80 2024-09-12T02:02:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.274+0000 7f7bc7fff640 1 -- 172.21.15.19:0/388629217 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bb8053d50 con 0x559189670a80 2024-09-12T02:02:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.274+0000 7f7bd0ed2f40 1 -- 172.21.15.19:0/388629217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591896f2a10 con 0x559189670a80 2024-09-12T02:02:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.274+0000 7f7bc7fff640 1 -- 172.21.15.19:0/388629217 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8068680 con 0x559189670a80 2024-09-12T02:02:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.274+0000 7f7bd0ed2f40 1 -- 172.21.15.19:0/388629217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591896f2fd0 con 0x559189670a80 2024-09-12T02:02:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.275+0000 7f7bc7fff640 1 -- 172.21.15.19:0/388629217 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7bb8071440 con 0x559189670a80 2024-09-12T02:02:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.275+0000 7f7bc7fff640 1 --2- 172.21.15.19:0/388629217 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7bb006a810 0x7f7bb006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.275+0000 7f7bc7fff640 1 -- 172.21.15.19:0/388629217 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f7bb80ce4b0 con 0x559189670a80 2024-09-12T02:02:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.276+0000 7f7bce9ca640 1 --2- 172.21.15.19:0/388629217 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7bb006a810 0x7f7bb006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.276+0000 7f7bd0ed2f40 1 --2- 172.21.15.19:0/388629217 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5591896fc8c0 0x5591896f49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.276+0000 7f7bd0ed2f40 1 -- 172.21.15.19:0/388629217 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:1 13.6 13:654134d2:::mds0_openfiles.0:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5591896f9d10 con 0x5591896fc8c0 2024-09-12T02:02:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.276+0000 7f7bcf1cb640 1 --2- 172.21.15.19:0/388629217 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5591896fc8c0 0x5591896f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.276+0000 7f7bce9ca640 1 --2- 172.21.15.19:0/388629217 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7bb006a810 0x7f7bb006ccd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0000f80 tx=0x7f7bc0006330 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.276+0000 7f7bcf1cb640 1 --2- 172.21.15.19:0/388629217 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5591896fc8c0 0x5591896f49a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.277+0000 7f7bcf1cb640 1 -- 172.21.15.19:0/388629217 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(1 mds0_openfiles.0 [stat out=16b] v0'0 uv2 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x7f7bc8006970 con 0x5591896fc8c0 2024-09-12T02:02:27.280 INFO:teuthology.orchestra.run.smithi019.stdout:cephfs_metadata/mds0_openfiles.0 mtime 2024-09-12T02:02:23.000000+0000, size 0 2024-09-12T02:02:27.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.277+0000 7f7bd0ed2f40 1 -- 172.21.15.19:0/388629217 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5591896fc8c0 msgr2=0x5591896f49a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.277+0000 7f7bd0ed2f40 1 --2- 172.21.15.19:0/388629217 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5591896fc8c0 0x5591896f49a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.277+0000 7f7bd0ed2f40 1 -- 172.21.15.19:0/388629217 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7bb006a810 msgr2=0x7f7bb006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.277+0000 7f7bd0ed2f40 1 --2- 172.21.15.19:0/388629217 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7bb006a810 0x7f7bb006ccd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0000f80 tx=0x7f7bc0006330 comp rx=0 tx=0).stop 2024-09-12T02:02:27.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.277+0000 7f7bd0ed2f40 1 -- 172.21.15.19:0/388629217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559189670a80 msgr2=0x55918966f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.277+0000 7f7bd0ed2f40 1 --2- 172.21.15.19:0/388629217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559189670a80 0x55918966f400 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8055040 tx=0x7f7bb8002fb0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.277+0000 7f7bcf1cb640 1 -- 172.21.15.19:0/388629217 reap_dead start 2024-09-12T02:02:27.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.277+0000 7f7bd0ed2f40 1 -- 172.21.15.19:0/388629217 shutdown_connections 2024-09-12T02:02:27.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.277+0000 7f7bd0ed2f40 1 -- 172.21.15.19:0/388629217 >> 172.21.15.19:0/388629217 conn(0x5591896299e0 msgr2=0x5591896f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.277+0000 7f7bd0ed2f40 1 -- 172.21.15.19:0/388629217 shutdown_connections 2024-09-12T02:02:27.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.277+0000 7f7bd0ed2f40 1 -- 172.21.15.19:0/388629217 wait complete. 2024-09-12T02:02:27.282 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 500.00000000 2024-09-12T02:02:27.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.365+0000 7ff9c8b1ff40 1 Processor -- start 2024-09-12T02:02:27.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.365+0000 7ff9c8b1ff40 1 -- start start 2024-09-12T02:02:27.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.366+0000 7ff9c8b1ff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56507246cf30 0x5650724f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.366+0000 7ff9c8b1ff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650724f9d20 0x5650724fcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.366+0000 7ff9c8b1ff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5650724fa100 0x56507246d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.366+0000 7ff9c8b1ff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56507246e6b0 con 0x56507246cf30 2024-09-12T02:02:27.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.366+0000 7ff9c8b1ff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x565072376510 con 0x5650724f9d20 2024-09-12T02:02:27.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.366+0000 7ff9c8b1ff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5650724292d0 con 0x5650724fa100 2024-09-12T02:02:27.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.366+0000 7ff9c5bcf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56507246cf30 0x5650724f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.366+0000 7ff9c5bcf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56507246cf30 0x5650724f0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51520/0 (socket says 172.21.15.19:51520) 2024-09-12T02:02:27.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.366+0000 7ff9c5bcf640 1 -- 172.21.15.19:0/3031282351 learned_addr learned my addr 172.21.15.19:0/3031282351 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.366+0000 7ff9c53ce640 1 --2- 172.21.15.19:0/3031282351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650724f9d20 0x5650724fcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.366+0000 7ff9c63d0640 1 --2- 172.21.15.19:0/3031282351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5650724fa100 0x56507246d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.366+0000 7ff9c5bcf640 1 -- 172.21.15.19:0/3031282351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5650724fa100 msgr2=0x56507246d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.367+0000 7ff9c5bcf640 1 --2- 172.21.15.19:0/3031282351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5650724fa100 0x56507246d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.367+0000 7ff9c5bcf640 1 -- 172.21.15.19:0/3031282351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650724f9d20 msgr2=0x5650724fcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.367+0000 7ff9c5bcf640 1 --2- 172.21.15.19:0/3031282351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650724f9d20 0x5650724fcb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.367+0000 7ff9c5bcf640 1 -- 172.21.15.19:0/3031282351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650724fd500 con 0x56507246cf30 2024-09-12T02:02:27.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.367+0000 7ff9c5bcf640 1 --2- 172.21.15.19:0/3031282351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56507246cf30 0x5650724f0b70 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8025d20 tx=0x7ff9b8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c32339536efe61 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.367+0000 7ff9b7fff640 1 -- 172.21.15.19:0/3031282351 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8055070 con 0x56507246cf30 2024-09-12T02:02:27.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.367+0000 7ff9b7fff640 1 -- 172.21.15.19:0/3031282351 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b80517e0 con 0x56507246cf30 2024-09-12T02:02:27.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.367+0000 7ff9b7fff640 1 -- 172.21.15.19:0/3031282351 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8051b90 con 0x56507246cf30 2024-09-12T02:02:27.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.367+0000 7ff9c8b1ff40 1 -- 172.21.15.19:0/3031282351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56507246cf30 msgr2=0x5650724f0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.367+0000 7ff9c8b1ff40 1 --2- 172.21.15.19:0/3031282351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56507246cf30 0x5650724f0b70 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8025d20 tx=0x7ff9b8051000 comp rx=0 tx=0).stop 2024-09-12T02:02:27.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.367+0000 7ff9c8b1ff40 1 -- 172.21.15.19:0/3031282351 shutdown_connections 2024-09-12T02:02:27.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.367+0000 7ff9c8b1ff40 1 --2- 172.21.15.19:0/3031282351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5650724fa100 0x56507246d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.367+0000 7ff9c8b1ff40 1 --2- 172.21.15.19:0/3031282351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650724f9d20 0x5650724fcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.367+0000 7ff9c8b1ff40 1 --2- 172.21.15.19:0/3031282351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56507246cf30 0x5650724f0b70 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.367+0000 7ff9c8b1ff40 1 -- 172.21.15.19:0/3031282351 >> 172.21.15.19:0/3031282351 conn(0x565072452490 msgr2=0x5650724fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.367+0000 7ff9c8b1ff40 1 -- 172.21.15.19:0/3031282351 shutdown_connections 2024-09-12T02:02:27.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.368+0000 7ff9c8b1ff40 1 -- 172.21.15.19:0/3031282351 wait complete. 2024-09-12T02:02:27.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.368+0000 7ff9c8b1ff40 1 Processor -- start 2024-09-12T02:02:27.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.368+0000 7ff9c8b1ff40 1 -- start start 2024-09-12T02:02:27.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.369+0000 7ff9c8b1ff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56507246cf30 0x5650724255a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.369+0000 7ff9c8b1ff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5650724f9d20 0x56507259a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.369+0000 7ff9c8b1ff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5650724fa100 0x56507259a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.369+0000 7ff9c8b1ff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5650724fb130 con 0x5650724f9d20 2024-09-12T02:02:27.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.369+0000 7ff9c8b1ff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5650724f10b0 con 0x56507246cf30 2024-09-12T02:02:27.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.369+0000 7ff9c8b1ff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5650724fb410 con 0x5650724fa100 2024-09-12T02:02:27.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.369+0000 7ff9c53ce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5650724f9d20 0x56507259a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.369+0000 7ff9c53ce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5650724f9d20 0x56507259a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51522/0 (socket says 172.21.15.19:51522) 2024-09-12T02:02:27.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.369+0000 7ff9c53ce640 1 -- 172.21.15.19:0/482446889 learned_addr learned my addr 172.21.15.19:0/482446889 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.369+0000 7ff9c5bcf640 1 --2- 172.21.15.19:0/482446889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56507246cf30 0x5650724255a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.369+0000 7ff9c63d0640 1 --2- 172.21.15.19:0/482446889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5650724fa100 0x56507259a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.369+0000 7ff9c53ce640 1 -- 172.21.15.19:0/482446889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5650724fa100 msgr2=0x56507259a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.369+0000 7ff9c53ce640 1 --2- 172.21.15.19:0/482446889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5650724fa100 0x56507259a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.369+0000 7ff9c53ce640 1 -- 172.21.15.19:0/482446889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56507246cf30 msgr2=0x5650724255a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.369+0000 7ff9c53ce640 1 --2- 172.21.15.19:0/482446889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56507246cf30 0x5650724255a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.369+0000 7ff9c53ce640 1 -- 172.21.15.19:0/482446889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650724ed690 con 0x5650724f9d20 2024-09-12T02:02:27.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.369+0000 7ff9c5bcf640 1 --2- 172.21.15.19:0/482446889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56507246cf30 0x5650724255a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:27.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.369+0000 7ff9c53ce640 1 --2- 172.21.15.19:0/482446889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5650724f9d20 0x56507259a350 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009e20 tx=0x7ff9bc009e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.370+0000 7ff9b6ffd640 1 -- 172.21.15.19:0/482446889 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc0143f0 con 0x5650724f9d20 2024-09-12T02:02:27.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.370+0000 7ff9b6ffd640 1 -- 172.21.15.19:0/482446889 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc019070 con 0x5650724f9d20 2024-09-12T02:02:27.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.370+0000 7ff9c8b1ff40 1 -- 172.21.15.19:0/482446889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650724ed1e0 con 0x5650724f9d20 2024-09-12T02:02:27.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.370+0000 7ff9b6ffd640 1 -- 172.21.15.19:0/482446889 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc0147f0 con 0x5650724f9d20 2024-09-12T02:02:27.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.370+0000 7ff9c8b1ff40 1 -- 172.21.15.19:0/482446889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650725901f0 con 0x5650724f9d20 2024-09-12T02:02:27.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.371+0000 7ff9b6ffd640 1 -- 172.21.15.19:0/482446889 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9bc014990 con 0x5650724f9d20 2024-09-12T02:02:27.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.371+0000 7ff9b6ffd640 1 --2- 172.21.15.19:0/482446889 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9a806a810 0x7ff9a806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.371+0000 7ff9b6ffd640 1 -- 172.21.15.19:0/482446889 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7ff9bc0899f0 con 0x5650724f9d20 2024-09-12T02:02:27.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.372+0000 7ff9c5bcf640 1 --2- 172.21.15.19:0/482446889 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9a806a810 0x7ff9a806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.372+0000 7ff9c8b1ff40 1 --2- 172.21.15.19:0/482446889 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x565072425ae0 0x56507258edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.372+0000 7ff9c8b1ff40 1 -- 172.21.15.19:0/482446889 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:1 13.15 13:aa448500:::500.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5650724fa7e0 con 0x565072425ae0 2024-09-12T02:02:27.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.372+0000 7ff9c63d0640 1 --2- 172.21.15.19:0/482446889 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x565072425ae0 0x56507258edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.372+0000 7ff9c5bcf640 1 --2- 172.21.15.19:0/482446889 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9a806a810 0x7ff9a806ccd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8064000 tx=0x7ff9b8053000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.372+0000 7ff9c63d0640 1 --2- 172.21.15.19:0/482446889 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x565072425ae0 0x56507258edd0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.373+0000 7ff9c63d0640 1 -- 172.21.15.19:0/482446889 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(1 500.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x7ff9c0001580 con 0x565072425ae0 2024-09-12T02:02:27.376 INFO:teuthology.orchestra.run.smithi019.stdout:cephfs_metadata/500.00000000 mtime 2024-09-12T02:02:12.000000+0000, size 90 2024-09-12T02:02:27.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.373+0000 7ff9c8b1ff40 1 -- 172.21.15.19:0/482446889 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x565072425ae0 msgr2=0x56507258edd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.373+0000 7ff9c8b1ff40 1 --2- 172.21.15.19:0/482446889 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x565072425ae0 0x56507258edd0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.373+0000 7ff9c8b1ff40 1 -- 172.21.15.19:0/482446889 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9a806a810 msgr2=0x7ff9a806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.373+0000 7ff9c8b1ff40 1 --2- 172.21.15.19:0/482446889 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9a806a810 0x7ff9a806ccd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8064000 tx=0x7ff9b8053000 comp rx=0 tx=0).stop 2024-09-12T02:02:27.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.373+0000 7ff9c8b1ff40 1 -- 172.21.15.19:0/482446889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5650724f9d20 msgr2=0x56507259a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.373+0000 7ff9c8b1ff40 1 --2- 172.21.15.19:0/482446889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5650724f9d20 0x56507259a350 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009e20 tx=0x7ff9bc009e50 comp rx=0 tx=0).stop 2024-09-12T02:02:27.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.373+0000 7ff9c63d0640 1 -- 172.21.15.19:0/482446889 reap_dead start 2024-09-12T02:02:27.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.373+0000 7ff9c8b1ff40 1 -- 172.21.15.19:0/482446889 shutdown_connections 2024-09-12T02:02:27.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.373+0000 7ff9c8b1ff40 1 -- 172.21.15.19:0/482446889 >> 172.21.15.19:0/482446889 conn(0x565072452490 msgr2=0x5650724fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.373+0000 7ff9c8b1ff40 1 -- 172.21.15.19:0/482446889 shutdown_connections 2024-09-12T02:02:27.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.373+0000 7ff9c8b1ff40 1 -- 172.21.15.19:0/482446889 wait complete. 2024-09-12T02:02:27.379 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat mds_snaptable 2024-09-12T02:02:27.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.422+0000 7f960c307f40 1 Processor -- start 2024-09-12T02:02:27.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.422+0000 7f960c307f40 1 -- start start 2024-09-12T02:02:27.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.422+0000 7f960c307f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562ce6f6350 0x5562ce7ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.422+0000 7f960c307f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562ce724050 0x5562ce739cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.422+0000 7f960c307f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562ce7ae080 0x5562ce7aba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.422+0000 7f960c307f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5562ce645510 con 0x5562ce6f6350 2024-09-12T02:02:27.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.422+0000 7f960c307f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5562ce69ec50 con 0x5562ce7ae080 2024-09-12T02:02:27.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.422+0000 7f960c307f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5562ce6f2dc0 con 0x5562ce724050 2024-09-12T02:02:27.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.423+0000 7f9609dfd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562ce6f6350 0x5562ce7ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.423+0000 7f9609dfd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562ce6f6350 0x5562ce7ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51536/0 (socket says 172.21.15.19:51536) 2024-09-12T02:02:27.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.423+0000 7f9609dfd640 1 -- 172.21.15.19:0/1923092936 learned_addr learned my addr 172.21.15.19:0/1923092936 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.423+0000 7f960a5fe640 1 --2- 172.21.15.19:0/1923092936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562ce7ae080 0x5562ce7aba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.423+0000 7f9603fff640 1 --2- 172.21.15.19:0/1923092936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562ce724050 0x5562ce739cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.423+0000 7f9609dfd640 1 -- 172.21.15.19:0/1923092936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562ce724050 msgr2=0x5562ce739cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.423+0000 7f9609dfd640 1 --2- 172.21.15.19:0/1923092936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562ce724050 0x5562ce739cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.423+0000 7f9609dfd640 1 -- 172.21.15.19:0/1923092936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562ce7ae080 msgr2=0x5562ce7aba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.423+0000 7f9609dfd640 1 --2- 172.21.15.19:0/1923092936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562ce7ae080 0x5562ce7aba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.423+0000 7f9609dfd640 1 -- 172.21.15.19:0/1923092936 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562ce73b8c0 con 0x5562ce6f6350 2024-09-12T02:02:27.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.423+0000 7f960a5fe640 1 --2- 172.21.15.19:0/1923092936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562ce7ae080 0x5562ce7aba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:27.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.423+0000 7f9603fff640 1 --2- 172.21.15.19:0/1923092936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562ce724050 0x5562ce739cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:27.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.423+0000 7f9609dfd640 1 --2- 172.21.15.19:0/1923092936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562ce6f6350 0x5562ce7ccb10 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f95fc001ed0 tx=0x7f95fc00b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e1e05c151badb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.423+0000 7f9608dfb640 1 -- 172.21.15.19:0/1923092936 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc012020 con 0x5562ce6f6350 2024-09-12T02:02:27.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.423+0000 7f9608dfb640 1 -- 172.21.15.19:0/1923092936 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc00d690 con 0x5562ce6f6350 2024-09-12T02:02:27.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.423+0000 7f9608dfb640 1 -- 172.21.15.19:0/1923092936 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc00da80 con 0x5562ce6f6350 2024-09-12T02:02:27.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.424+0000 7f960c307f40 1 -- 172.21.15.19:0/1923092936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562ce6f6350 msgr2=0x5562ce7ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.424+0000 7f960c307f40 1 --2- 172.21.15.19:0/1923092936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562ce6f6350 0x5562ce7ccb10 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f95fc001ed0 tx=0x7f95fc00b800 comp rx=0 tx=0).stop 2024-09-12T02:02:27.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.424+0000 7f960c307f40 1 -- 172.21.15.19:0/1923092936 shutdown_connections 2024-09-12T02:02:27.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.424+0000 7f960c307f40 1 --2- 172.21.15.19:0/1923092936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562ce7ae080 0x5562ce7aba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.424+0000 7f960c307f40 1 --2- 172.21.15.19:0/1923092936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562ce724050 0x5562ce739cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.424+0000 7f960c307f40 1 --2- 172.21.15.19:0/1923092936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562ce6f6350 0x5562ce7ccb10 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.424+0000 7f960c307f40 1 -- 172.21.15.19:0/1923092936 >> 172.21.15.19:0/1923092936 conn(0x5562ce6f39e0 msgr2=0x5562ce7237d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.424+0000 7f960c307f40 1 -- 172.21.15.19:0/1923092936 shutdown_connections 2024-09-12T02:02:27.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.424+0000 7f960c307f40 1 -- 172.21.15.19:0/1923092936 wait complete. 2024-09-12T02:02:27.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.424+0000 7f960c307f40 1 Processor -- start 2024-09-12T02:02:27.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.424+0000 7f960c307f40 1 -- start start 2024-09-12T02:02:27.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.425+0000 7f960c307f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562ce6f6350 0x5562ce7cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.425+0000 7f960c307f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562ce724050 0x5562ce7b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.425+0000 7f960c307f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562ce7ae080 0x5562ce7ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.425+0000 7f960c307f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5562ce7b39b0 con 0x5562ce6f6350 2024-09-12T02:02:27.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.425+0000 7f960c307f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5562ce7b3020 con 0x5562ce724050 2024-09-12T02:02:27.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.425+0000 7f960c307f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5562ce7cc230 con 0x5562ce7ae080 2024-09-12T02:02:27.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.425+0000 7f9609dfd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562ce6f6350 0x5562ce7cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.425+0000 7f9609dfd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562ce6f6350 0x5562ce7cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51548/0 (socket says 172.21.15.19:51548) 2024-09-12T02:02:27.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.425+0000 7f9609dfd640 1 -- 172.21.15.19:0/537851137 learned_addr learned my addr 172.21.15.19:0/537851137 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.425+0000 7f960a5fe640 1 --2- 172.21.15.19:0/537851137 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562ce7ae080 0x5562ce7ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.425+0000 7f9603fff640 1 --2- 172.21.15.19:0/537851137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562ce724050 0x5562ce7b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.425+0000 7f9609dfd640 1 -- 172.21.15.19:0/537851137 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562ce7ae080 msgr2=0x5562ce7ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.425+0000 7f9609dfd640 1 --2- 172.21.15.19:0/537851137 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562ce7ae080 0x5562ce7ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.426+0000 7f9609dfd640 1 -- 172.21.15.19:0/537851137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562ce724050 msgr2=0x5562ce7b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.426+0000 7f9609dfd640 1 --2- 172.21.15.19:0/537851137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562ce724050 0x5562ce7b0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.426+0000 7f9609dfd640 1 -- 172.21.15.19:0/537851137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562ce8637e0 con 0x5562ce6f6350 2024-09-12T02:02:27.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.426+0000 7f9609dfd640 1 --2- 172.21.15.19:0/537851137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562ce6f6350 0x5562ce7cc470 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00b840 tx=0x7f95fc001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.426+0000 7f9602ffd640 1 -- 172.21.15.19:0/537851137 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc027070 con 0x5562ce6f6350 2024-09-12T02:02:27.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.426+0000 7f9602ffd640 1 -- 172.21.15.19:0/537851137 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc00d490 con 0x5562ce6f6350 2024-09-12T02:02:27.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.426+0000 7f960c307f40 1 -- 172.21.15.19:0/537851137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562ce863ac0 con 0x5562ce6f6350 2024-09-12T02:02:27.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.426+0000 7f9602ffd640 1 -- 172.21.15.19:0/537851137 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc00ec30 con 0x5562ce6f6350 2024-09-12T02:02:27.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.426+0000 7f960c307f40 1 -- 172.21.15.19:0/537851137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562ce864080 con 0x5562ce6f6350 2024-09-12T02:02:27.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.427+0000 7f9602ffd640 1 -- 172.21.15.19:0/537851137 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f95fc02a070 con 0x5562ce6f6350 2024-09-12T02:02:27.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.428+0000 7f9602ffd640 1 --2- 172.21.15.19:0/537851137 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f95ec06a810 0x7f95ec06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.428+0000 7f9602ffd640 1 -- 172.21.15.19:0/537851137 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f95fc08b5a0 con 0x5562ce6f6350 2024-09-12T02:02:27.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.428+0000 7f960c307f40 1 --2- 172.21.15.19:0/537851137 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5562ce861740 0x5562ce861b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.428+0000 7f960c307f40 1 -- 172.21.15.19:0/537851137 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:1 13.d 13:b50e409b:::mds_snaptable:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x5562ce864880 con 0x5562ce861740 2024-09-12T02:02:27.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.428+0000 7f9603fff640 1 --2- 172.21.15.19:0/537851137 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f95ec06a810 0x7f95ec06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.428+0000 7f960a5fe640 1 --2- 172.21.15.19:0/537851137 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5562ce861740 0x5562ce861b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.429+0000 7f9603fff640 1 --2- 172.21.15.19:0/537851137 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f95ec06a810 0x7f95ec06ccd0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x5562ce7b2de0 tx=0x7f95f40018a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.429+0000 7f960a5fe640 1 --2- 172.21.15.19:0/537851137 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5562ce861740 0x5562ce861b20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.429+0000 7f960a5fe640 1 -- 172.21.15.19:0/537851137 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(1 mds_snaptable [stat out=16b] v0'0 uv1 ondisk = 0) ==== 157+0+16 (crc 0 0 0) 0x7f9604052870 con 0x5562ce861740 2024-09-12T02:02:27.432 INFO:teuthology.orchestra.run.smithi019.stdout:cephfs_metadata/mds_snaptable mtime 2024-09-12T02:02:12.000000+0000, size 70 2024-09-12T02:02:27.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.429+0000 7f960c307f40 1 -- 172.21.15.19:0/537851137 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5562ce861740 msgr2=0x5562ce861b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.429+0000 7f960c307f40 1 --2- 172.21.15.19:0/537851137 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5562ce861740 0x5562ce861b20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.429+0000 7f960c307f40 1 -- 172.21.15.19:0/537851137 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f95ec06a810 msgr2=0x7f95ec06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.429+0000 7f960c307f40 1 --2- 172.21.15.19:0/537851137 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f95ec06a810 0x7f95ec06ccd0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x5562ce7b2de0 tx=0x7f95f40018a0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.429+0000 7f960c307f40 1 -- 172.21.15.19:0/537851137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562ce6f6350 msgr2=0x5562ce7cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.429+0000 7f960c307f40 1 --2- 172.21.15.19:0/537851137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562ce6f6350 0x5562ce7cc470 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00b840 tx=0x7f95fc001150 comp rx=0 tx=0).stop 2024-09-12T02:02:27.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.429+0000 7f960a5fe640 1 -- 172.21.15.19:0/537851137 reap_dead start 2024-09-12T02:02:27.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.429+0000 7f960c307f40 1 -- 172.21.15.19:0/537851137 shutdown_connections 2024-09-12T02:02:27.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.429+0000 7f960c307f40 1 -- 172.21.15.19:0/537851137 >> 172.21.15.19:0/537851137 conn(0x5562ce6f39e0 msgr2=0x5562ce7cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.429+0000 7f960c307f40 1 -- 172.21.15.19:0/537851137 shutdown_connections 2024-09-12T02:02:27.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.429+0000 7f960c307f40 1 -- 172.21.15.19:0/537851137 wait complete. 2024-09-12T02:02:27.434 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat mds0_inotable 2024-09-12T02:02:27.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.478+0000 7f3b66165f40 1 Processor -- start 2024-09-12T02:02:27.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.478+0000 7f3b66165f40 1 -- start start 2024-09-12T02:02:27.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.478+0000 7f3b66165f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e186f0460 0x561e18773d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.478+0000 7f3b66165f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561e18767e00 0x561e1877ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.478+0000 7f3b66165f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e1877cfa0 0x561e1876ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.478+0000 7f3b66165f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561e1877b4d0 con 0x561e1877cfa0 2024-09-12T02:02:27.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.478+0000 7f3b66165f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561e185f4510 con 0x561e186f0460 2024-09-12T02:02:27.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.478+0000 7f3b66165f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x561e186a2d50 con 0x561e18767e00 2024-09-12T02:02:27.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.479+0000 7f3b6445c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e1877cfa0 0x561e1876ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.479+0000 7f3b6445c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e1877cfa0 0x561e1876ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51566/0 (socket says 172.21.15.19:51566) 2024-09-12T02:02:27.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.479+0000 7f3b6445c640 1 -- 172.21.15.19:0/4239165634 learned_addr learned my addr 172.21.15.19:0/4239165634 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.479+0000 7f3b6445c640 1 -- 172.21.15.19:0/4239165634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561e18767e00 msgr2=0x561e1877ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.479+0000 7f3b6445c640 1 --2- 172.21.15.19:0/4239165634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561e18767e00 0x561e1877ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.479+0000 7f3b6445c640 1 -- 172.21.15.19:0/4239165634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e186f0460 msgr2=0x561e18773d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.479+0000 7f3b6445c640 1 --2- 172.21.15.19:0/4239165634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e186f0460 0x561e18773d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.479+0000 7f3b6445c640 1 -- 172.21.15.19:0/4239165634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e186efc10 con 0x561e1877cfa0 2024-09-12T02:02:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.479+0000 7f3b6445c640 1 --2- 172.21.15.19:0/4239165634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e1877cfa0 0x561e1876ef00 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c057040 tx=0x7f3b5c04f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e237f78387d990b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.479+0000 7f3b62458640 1 -- 172.21.15.19:0/4239165634 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c001430 con 0x561e1877cfa0 2024-09-12T02:02:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.479+0000 7f3b62458640 1 -- 172.21.15.19:0/4239165634 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b5c0015d0 con 0x561e1877cfa0 2024-09-12T02:02:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.479+0000 7f3b62458640 1 -- 172.21.15.19:0/4239165634 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c065420 con 0x561e1877cfa0 2024-09-12T02:02:27.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.480+0000 7f3b66165f40 1 -- 172.21.15.19:0/4239165634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e1877cfa0 msgr2=0x561e1876ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.480+0000 7f3b66165f40 1 --2- 172.21.15.19:0/4239165634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e1877cfa0 0x561e1876ef00 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c057040 tx=0x7f3b5c04f000 comp rx=0 tx=0).stop 2024-09-12T02:02:27.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.480+0000 7f3b66165f40 1 -- 172.21.15.19:0/4239165634 shutdown_connections 2024-09-12T02:02:27.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.480+0000 7f3b66165f40 1 --2- 172.21.15.19:0/4239165634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e1877cfa0 0x561e1876ef00 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.480+0000 7f3b66165f40 1 --2- 172.21.15.19:0/4239165634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561e18767e00 0x561e1877ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.480+0000 7f3b66165f40 1 --2- 172.21.15.19:0/4239165634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e186f0460 0x561e18773d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.480+0000 7f3b66165f40 1 -- 172.21.15.19:0/4239165634 >> 172.21.15.19:0/4239165634 conn(0x561e186a18d0 msgr2=0x561e186d1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.480+0000 7f3b66165f40 1 -- 172.21.15.19:0/4239165634 shutdown_connections 2024-09-12T02:02:27.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.480+0000 7f3b66165f40 1 -- 172.21.15.19:0/4239165634 wait complete. 2024-09-12T02:02:27.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.480+0000 7f3b66165f40 1 Processor -- start 2024-09-12T02:02:27.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.480+0000 7f3b66165f40 1 -- start start 2024-09-12T02:02:27.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.481+0000 7f3b66165f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e186f0460 0x561e188152e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.481+0000 7f3b66165f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561e18767e00 0x561e18815820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.481+0000 7f3b66165f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e1876e9f0 0x561e18814060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.481+0000 7f3b66165f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561e1877c250 con 0x561e1876e9f0 2024-09-12T02:02:27.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.481+0000 7f3b66165f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561e1877d630 con 0x561e186f0460 2024-09-12T02:02:27.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.481+0000 7f3b66165f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x561e186efed0 con 0x561e18767e00 2024-09-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.481+0000 7f3b6445c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e1876e9f0 0x561e18814060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.481+0000 7f3b6445c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e1876e9f0 0x561e18814060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51576/0 (socket says 172.21.15.19:51576) 2024-09-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.481+0000 7f3b6445c640 1 -- 172.21.15.19:0/785077091 learned_addr learned my addr 172.21.15.19:0/785077091 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.481+0000 7f3b6345a640 1 --2- 172.21.15.19:0/785077091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561e18767e00 0x561e18815820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.481+0000 7f3b63c5b640 1 --2- 172.21.15.19:0/785077091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e186f0460 0x561e188152e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.481+0000 7f3b6445c640 1 -- 172.21.15.19:0/785077091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561e18767e00 msgr2=0x561e18815820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.481+0000 7f3b6445c640 1 --2- 172.21.15.19:0/785077091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561e18767e00 0x561e18815820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.481+0000 7f3b6445c640 1 -- 172.21.15.19:0/785077091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e186f0460 msgr2=0x561e188152e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.481+0000 7f3b6445c640 1 --2- 172.21.15.19:0/785077091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e186f0460 0x561e188152e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.481+0000 7f3b6445c640 1 -- 172.21.15.19:0/785077091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e1876f460 con 0x561e1876e9f0 2024-09-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.481+0000 7f3b6345a640 1 --2- 172.21.15.19:0/785077091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561e18767e00 0x561e18815820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.482+0000 7f3b6445c640 1 --2- 172.21.15.19:0/785077091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e1876e9f0 0x561e18814060 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c046b40 tx=0x7f3b5c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.482+0000 7f3b61456640 1 -- 172.21.15.19:0/785077091 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c001430 con 0x561e1876e9f0 2024-09-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.482+0000 7f3b61456640 1 -- 172.21.15.19:0/785077091 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b5c06f070 con 0x561e1876e9f0 2024-09-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.482+0000 7f3b61456640 1 -- 172.21.15.19:0/785077091 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c065c40 con 0x561e1876e9f0 2024-09-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.482+0000 7f3b66165f40 1 -- 172.21.15.19:0/785077091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e1876f740 con 0x561e1876e9f0 2024-09-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.482+0000 7f3b66165f40 1 -- 172.21.15.19:0/785077091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e18779eb0 con 0x561e1876e9f0 2024-09-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.483+0000 7f3b61456640 1 -- 172.21.15.19:0/785077091 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b5c05c040 con 0x561e1876e9f0 2024-09-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.484+0000 7f3b61456640 1 --2- 172.21.15.19:0/785077091 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3b5006a810 0x7f3b5006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.484+0000 7f3b61456640 1 -- 172.21.15.19:0/785077091 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f3b5c0cf220 con 0x561e1876e9f0 2024-09-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.484+0000 7f3b63c5b640 1 --2- 172.21.15.19:0/785077091 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3b5006a810 0x7f3b5006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.484+0000 7f3b66165f40 1 --2- 172.21.15.19:0/785077091 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561e188145a0 0x561e188149b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.484+0000 7f3b66165f40 1 -- 172.21.15.19:0/785077091 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:1 13.13 13:c91d4a1d:::mds0_inotable:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x561e18815d60 con 0x561e188145a0 2024-09-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.484+0000 7f3b6345a640 1 --2- 172.21.15.19:0/785077091 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561e188145a0 0x561e188149b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.484+0000 7f3b63c5b640 1 --2- 172.21.15.19:0/785077091 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3b5006a810 0x7f3b5006ccd0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3b54003370 tx=0x7f3b54005d80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.484+0000 7f3b6345a640 1 --2- 172.21.15.19:0/785077091 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561e188145a0 0x561e188149b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.485+0000 7f3b6345a640 1 -- 172.21.15.19:0/785077091 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(1 mds0_inotable [stat out=16b] v0'0 uv3 ondisk = 0) ==== 157+0+16 (crc 0 0 0) 0x7f3b58009870 con 0x561e188145a0 2024-09-12T02:02:27.489 INFO:teuthology.orchestra.run.smithi019.stdout:cephfs_metadata/mds0_inotable mtime 2024-09-12T02:02:23.000000+0000, size 34 2024-09-12T02:02:27.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.485+0000 7f3b66165f40 1 -- 172.21.15.19:0/785077091 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561e188145a0 msgr2=0x561e188149b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.485+0000 7f3b66165f40 1 --2- 172.21.15.19:0/785077091 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561e188145a0 0x561e188149b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.485+0000 7f3b66165f40 1 -- 172.21.15.19:0/785077091 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3b5006a810 msgr2=0x7f3b5006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.485+0000 7f3b66165f40 1 --2- 172.21.15.19:0/785077091 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3b5006a810 0x7f3b5006ccd0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3b54003370 tx=0x7f3b54005d80 comp rx=0 tx=0).stop 2024-09-12T02:02:27.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.485+0000 7f3b66165f40 1 -- 172.21.15.19:0/785077091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e1876e9f0 msgr2=0x561e18814060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.485+0000 7f3b66165f40 1 --2- 172.21.15.19:0/785077091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e1876e9f0 0x561e18814060 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c046b40 tx=0x7f3b5c000fe0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.485+0000 7f3b6445c640 1 -- 172.21.15.19:0/785077091 reap_dead start 2024-09-12T02:02:27.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.485+0000 7f3b66165f40 1 -- 172.21.15.19:0/785077091 shutdown_connections 2024-09-12T02:02:27.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.485+0000 7f3b66165f40 1 -- 172.21.15.19:0/785077091 >> 172.21.15.19:0/785077091 conn(0x561e186a18d0 msgr2=0x561e18773b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.485+0000 7f3b66165f40 1 -- 172.21.15.19:0/785077091 shutdown_connections 2024-09-12T02:02:27.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.485+0000 7f3b66165f40 1 -- 172.21.15.19:0/785077091 wait complete. 2024-09-12T02:02:27.491 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 100.00000000 2024-09-12T02:02:27.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.534+0000 7fca20b22f40 1 Processor -- start 2024-09-12T02:02:27.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.534+0000 7fca20b22f40 1 -- start start 2024-09-12T02:02:27.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.534+0000 7fca20b22f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db71b21f40 0x55db71b41000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.534+0000 7fca20b22f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db71bd0240 0x55db71b23d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.534+0000 7fca20b22f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55db71af6dc0 0x55db71b22e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.534+0000 7fca20b22f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55db71b3f4a0 con 0x55db71b21f40 2024-09-12T02:02:27.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.534+0000 7fca20b22f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55db71b3ef20 con 0x55db71bd0240 2024-09-12T02:02:27.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.534+0000 7fca20b22f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55db71b3f780 con 0x55db71af6dc0 2024-09-12T02:02:27.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.535+0000 7fca1e618640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db71b21f40 0x55db71b41000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.535+0000 7fca1e618640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db71b21f40 0x55db71b41000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51596/0 (socket says 172.21.15.19:51596) 2024-09-12T02:02:27.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.535+0000 7fca1e618640 1 -- 172.21.15.19:0/2551759423 learned_addr learned my addr 172.21.15.19:0/2551759423 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.535+0000 7fca1ee19640 1 --2- 172.21.15.19:0/2551759423 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55db71af6dc0 0x55db71b22e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.535+0000 7fca1de17640 1 --2- 172.21.15.19:0/2551759423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db71bd0240 0x55db71b23d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.535+0000 7fca1e618640 1 -- 172.21.15.19:0/2551759423 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55db71af6dc0 msgr2=0x55db71b22e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.535+0000 7fca1e618640 1 --2- 172.21.15.19:0/2551759423 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55db71af6dc0 0x55db71b22e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.535+0000 7fca1e618640 1 -- 172.21.15.19:0/2551759423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db71bd0240 msgr2=0x55db71b23d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.535+0000 7fca1e618640 1 --2- 172.21.15.19:0/2551759423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db71bd0240 0x55db71b23d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.535+0000 7fca1e618640 1 -- 172.21.15.19:0/2551759423 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db71a22cb0 con 0x55db71b21f40 2024-09-12T02:02:27.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.535+0000 7fca1e618640 1 --2- 172.21.15.19:0/2551759423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db71b21f40 0x55db71b41000 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fca10009540 tx=0x7fca10009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adb58d5c1ddef88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.535+0000 7fca1ce15640 1 -- 172.21.15.19:0/2551759423 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10017070 con 0x55db71b21f40 2024-09-12T02:02:27.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.535+0000 7fca1ce15640 1 -- 172.21.15.19:0/2551759423 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca10006540 con 0x55db71b21f40 2024-09-12T02:02:27.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.535+0000 7fca1ce15640 1 -- 172.21.15.19:0/2551759423 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10006910 con 0x55db71b21f40 2024-09-12T02:02:27.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.536+0000 7fca20b22f40 1 -- 172.21.15.19:0/2551759423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db71b21f40 msgr2=0x55db71b41000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.536+0000 7fca20b22f40 1 --2- 172.21.15.19:0/2551759423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db71b21f40 0x55db71b41000 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fca10009540 tx=0x7fca10009a00 comp rx=0 tx=0).stop 2024-09-12T02:02:27.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.536+0000 7fca20b22f40 1 -- 172.21.15.19:0/2551759423 shutdown_connections 2024-09-12T02:02:27.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.536+0000 7fca20b22f40 1 --2- 172.21.15.19:0/2551759423 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55db71af6dc0 0x55db71b22e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.536+0000 7fca20b22f40 1 --2- 172.21.15.19:0/2551759423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db71bd0240 0x55db71b23d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.536+0000 7fca20b22f40 1 --2- 172.21.15.19:0/2551759423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db71b21f40 0x55db71b41000 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.536+0000 7fca20b22f40 1 -- 172.21.15.19:0/2551759423 >> 172.21.15.19:0/2551759423 conn(0x55db71af79e0 msgr2=0x55db71b3cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.536+0000 7fca20b22f40 1 -- 172.21.15.19:0/2551759423 shutdown_connections 2024-09-12T02:02:27.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.536+0000 7fca20b22f40 1 -- 172.21.15.19:0/2551759423 wait complete. 2024-09-12T02:02:27.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.536+0000 7fca20b22f40 1 Processor -- start 2024-09-12T02:02:27.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.536+0000 7fca20b22f40 1 -- start start 2024-09-12T02:02:27.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.537+0000 7fca20b22f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db71af6dc0 0x55db71bc3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.537+0000 7fca20b22f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db71b21f40 0x55db71af72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.537+0000 7fca20b22f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55db71bd0240 0x55db71b23130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.537+0000 7fca20b22f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55db71bcb620 con 0x55db71b21f40 2024-09-12T02:02:27.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.537+0000 7fca20b22f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55db71bcb390 con 0x55db71af6dc0 2024-09-12T02:02:27.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.537+0000 7fca20b22f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55db71af81d0 con 0x55db71bd0240 2024-09-12T02:02:27.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.537+0000 7fca1de17640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db71b21f40 0x55db71af72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.537+0000 7fca1de17640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db71b21f40 0x55db71af72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51604/0 (socket says 172.21.15.19:51604) 2024-09-12T02:02:27.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.537+0000 7fca1de17640 1 -- 172.21.15.19:0/3058175340 learned_addr learned my addr 172.21.15.19:0/3058175340 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.537+0000 7fca1ee19640 1 --2- 172.21.15.19:0/3058175340 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55db71bd0240 0x55db71b23130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.537+0000 7fca1e618640 1 --2- 172.21.15.19:0/3058175340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db71af6dc0 0x55db71bc3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.537+0000 7fca1de17640 1 -- 172.21.15.19:0/3058175340 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55db71bd0240 msgr2=0x55db71b23130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.537+0000 7fca1de17640 1 --2- 172.21.15.19:0/3058175340 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55db71bd0240 0x55db71b23130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.537+0000 7fca1de17640 1 -- 172.21.15.19:0/3058175340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db71af6dc0 msgr2=0x55db71bc3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.537+0000 7fca1de17640 1 --2- 172.21.15.19:0/3058175340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db71af6dc0 0x55db71bc3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.537+0000 7fca1de17640 1 -- 172.21.15.19:0/3058175340 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db71bcd1d0 con 0x55db71b21f40 2024-09-12T02:02:27.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.538+0000 7fca1de17640 1 --2- 172.21.15.19:0/3058175340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db71b21f40 0x55db71af72a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fca14007dd0 tx=0x7fca14006750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.538+0000 7fca0f7fe640 1 -- 172.21.15.19:0/3058175340 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14018070 con 0x55db71b21f40 2024-09-12T02:02:27.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.538+0000 7fca0f7fe640 1 -- 172.21.15.19:0/3058175340 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca140135f0 con 0x55db71b21f40 2024-09-12T02:02:27.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.538+0000 7fca20b22f40 1 -- 172.21.15.19:0/3058175340 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db71bccef0 con 0x55db71b21f40 2024-09-12T02:02:27.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.538+0000 7fca0f7fe640 1 -- 172.21.15.19:0/3058175340 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca140139c0 con 0x55db71b21f40 2024-09-12T02:02:27.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.538+0000 7fca20b22f40 1 -- 172.21.15.19:0/3058175340 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db71b3c840 con 0x55db71b21f40 2024-09-12T02:02:27.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.539+0000 7fca0f7fe640 1 -- 172.21.15.19:0/3058175340 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca1401b070 con 0x55db71b21f40 2024-09-12T02:02:27.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.540+0000 7fca0f7fe640 1 --2- 172.21.15.19:0/3058175340 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca0006a810 0x7fca0006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.540+0000 7fca0f7fe640 1 -- 172.21.15.19:0/3058175340 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7fca14088f00 con 0x55db71b21f40 2024-09-12T02:02:27.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.540+0000 7fca20b22f40 1 --2- 172.21.15.19:0/3058175340 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55db71af6320 0x55db71c56380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.540+0000 7fca20b22f40 1 -- 172.21.15.19:0/3058175340 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:1 13.13 13:cd5a64a3:::100.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55db71bbed40 con 0x55db71af6320 2024-09-12T02:02:27.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.540+0000 7fca1e618640 1 --2- 172.21.15.19:0/3058175340 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca0006a810 0x7fca0006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.540+0000 7fca1ee19640 1 --2- 172.21.15.19:0/3058175340 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55db71af6320 0x55db71c56380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.541+0000 7fca1e618640 1 --2- 172.21.15.19:0/3058175340 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca0006a810 0x7fca0006ccd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fca10009a40 tx=0x7fca1000f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.541+0000 7fca1ee19640 1 --2- 172.21.15.19:0/3058175340 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55db71af6320 0x55db71c56380 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.541+0000 7fca1ee19640 1 -- 172.21.15.19:0/3058175340 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(1 100.00000000 [stat out=16b] v0'0 uv1 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x7fca1804f960 con 0x55db71af6320 2024-09-12T02:02:27.544 INFO:teuthology.orchestra.run.smithi019.stdout:cephfs_metadata/100.00000000 mtime 2024-09-12T02:02:12.000000+0000, size 0 2024-09-12T02:02:27.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.541+0000 7fca20b22f40 1 -- 172.21.15.19:0/3058175340 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55db71af6320 msgr2=0x55db71c56380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.541+0000 7fca20b22f40 1 --2- 172.21.15.19:0/3058175340 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55db71af6320 0x55db71c56380 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.541+0000 7fca20b22f40 1 -- 172.21.15.19:0/3058175340 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca0006a810 msgr2=0x7fca0006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.541+0000 7fca20b22f40 1 --2- 172.21.15.19:0/3058175340 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca0006a810 0x7fca0006ccd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fca10009a40 tx=0x7fca1000f000 comp rx=0 tx=0).stop 2024-09-12T02:02:27.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.541+0000 7fca20b22f40 1 -- 172.21.15.19:0/3058175340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db71b21f40 msgr2=0x55db71af72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.541+0000 7fca20b22f40 1 --2- 172.21.15.19:0/3058175340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db71b21f40 0x55db71af72a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fca14007dd0 tx=0x7fca14006750 comp rx=0 tx=0).stop 2024-09-12T02:02:27.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.541+0000 7fca1ee19640 1 -- 172.21.15.19:0/3058175340 reap_dead start 2024-09-12T02:02:27.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.541+0000 7fca20b22f40 1 -- 172.21.15.19:0/3058175340 shutdown_connections 2024-09-12T02:02:27.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.541+0000 7fca20b22f40 1 -- 172.21.15.19:0/3058175340 >> 172.21.15.19:0/3058175340 conn(0x55db71af79e0 msgr2=0x55db71c57e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.541+0000 7fca20b22f40 1 -- 172.21.15.19:0/3058175340 shutdown_connections 2024-09-12T02:02:27.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.541+0000 7fca20b22f40 1 -- 172.21.15.19:0/3058175340 wait complete. 2024-09-12T02:02:27.547 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat mds0_sessionmap 2024-09-12T02:02:27.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.630+0000 7f459caf8f40 1 Processor -- start 2024-09-12T02:02:27.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.630+0000 7f459caf8f40 1 -- start start 2024-09-12T02:02:27.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.630+0000 7f459caf8f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d75471640 0x560d7542a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.630+0000 7f459caf8f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d754fdd20 0x560d75500ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.630+0000 7f459caf8f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d754fe100 0x560d7546e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.630+0000 7f459caf8f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560d754726b0 con 0x560d754fe100 2024-09-12T02:02:27.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.630+0000 7f459caf8f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560d7537a510 con 0x560d754fdd20 2024-09-12T02:02:27.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.630+0000 7f459caf8f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560d7542d2d0 con 0x560d75471640 2024-09-12T02:02:27.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.630+0000 7f459adef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d754fe100 0x560d7546e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.631+0000 7f459adef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d754fe100 0x560d7546e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51620/0 (socket says 172.21.15.19:51620) 2024-09-12T02:02:27.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.631+0000 7f459adef640 1 -- 172.21.15.19:0/3719047419 learned_addr learned my addr 172.21.15.19:0/3719047419 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.631+0000 7f459a5ee640 1 --2- 172.21.15.19:0/3719047419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d75471640 0x560d7542a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.631+0000 7f4599ded640 1 --2- 172.21.15.19:0/3719047419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d754fdd20 0x560d75500ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.631+0000 7f459adef640 1 -- 172.21.15.19:0/3719047419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d75471640 msgr2=0x560d7542a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.631+0000 7f459adef640 1 --2- 172.21.15.19:0/3719047419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d75471640 0x560d7542a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.631+0000 7f459adef640 1 -- 172.21.15.19:0/3719047419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d754fdd20 msgr2=0x560d75500ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.631+0000 7f459adef640 1 --2- 172.21.15.19:0/3719047419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d754fdd20 0x560d75500ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.631+0000 7f459adef640 1 -- 172.21.15.19:0/3719047419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d7546fce0 con 0x560d754fe100 2024-09-12T02:02:27.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.631+0000 7f459adef640 1 --2- 172.21.15.19:0/3719047419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d754fe100 0x560d7546e7e0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f45940460e0 tx=0x7f4594051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b617422a89986cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.631+0000 7f4598deb640 1 -- 172.21.15.19:0/3719047419 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4594067070 con 0x560d754fe100 2024-09-12T02:02:27.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.631+0000 7f4598deb640 1 -- 172.21.15.19:0/3719047419 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4594058b50 con 0x560d754fe100 2024-09-12T02:02:27.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.631+0000 7f4598deb640 1 -- 172.21.15.19:0/3719047419 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4594062430 con 0x560d754fe100 2024-09-12T02:02:27.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.632+0000 7f459caf8f40 1 -- 172.21.15.19:0/3719047419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d754fe100 msgr2=0x560d7546e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.632+0000 7f459caf8f40 1 --2- 172.21.15.19:0/3719047419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d754fe100 0x560d7546e7e0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f45940460e0 tx=0x7f4594051000 comp rx=0 tx=0).stop 2024-09-12T02:02:27.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.632+0000 7f459caf8f40 1 -- 172.21.15.19:0/3719047419 shutdown_connections 2024-09-12T02:02:27.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.632+0000 7f459caf8f40 1 --2- 172.21.15.19:0/3719047419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d754fe100 0x560d7546e7e0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.632+0000 7f459caf8f40 1 --2- 172.21.15.19:0/3719047419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d754fdd20 0x560d75500ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.632+0000 7f459caf8f40 1 --2- 172.21.15.19:0/3719047419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d75471640 0x560d7542a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.632+0000 7f459caf8f40 1 -- 172.21.15.19:0/3719047419 >> 172.21.15.19:0/3719047419 conn(0x560d75456490 msgr2=0x560d75470f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.632+0000 7f459caf8f40 1 -- 172.21.15.19:0/3719047419 shutdown_connections 2024-09-12T02:02:27.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.632+0000 7f459caf8f40 1 -- 172.21.15.19:0/3719047419 wait complete. 2024-09-12T02:02:27.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.632+0000 7f459caf8f40 1 Processor -- start 2024-09-12T02:02:27.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.632+0000 7f459caf8f40 1 -- start start 2024-09-12T02:02:27.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.633+0000 7f459caf8f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d75471640 0x560d754f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.633+0000 7f459caf8f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d754fdd20 0x560d7544c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.633+0000 7f459caf8f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d754fe100 0x560d75501e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.633+0000 7f459caf8f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560d754fb5d0 con 0x560d754fe100 2024-09-12T02:02:27.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.633+0000 7f459caf8f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560d7546ffc0 con 0x560d75471640 2024-09-12T02:02:27.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.633+0000 7f459caf8f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560d754fb2f0 con 0x560d754fdd20 2024-09-12T02:02:27.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.633+0000 7f459adef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d754fe100 0x560d75501e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.633+0000 7f459adef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d754fe100 0x560d75501e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51624/0 (socket says 172.21.15.19:51624) 2024-09-12T02:02:27.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.633+0000 7f459adef640 1 -- 172.21.15.19:0/3679986455 learned_addr learned my addr 172.21.15.19:0/3679986455 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.633+0000 7f4599ded640 1 --2- 172.21.15.19:0/3679986455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d754fdd20 0x560d7544c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.633+0000 7f459a5ee640 1 --2- 172.21.15.19:0/3679986455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d75471640 0x560d754f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.634+0000 7f459adef640 1 -- 172.21.15.19:0/3679986455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d754fdd20 msgr2=0x560d7544c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.634+0000 7f459adef640 1 --2- 172.21.15.19:0/3679986455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d754fdd20 0x560d7544c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.634+0000 7f459adef640 1 -- 172.21.15.19:0/3679986455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d75471640 msgr2=0x560d754f76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.634+0000 7f459adef640 1 --2- 172.21.15.19:0/3679986455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d75471640 0x560d754f76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.634+0000 7f459adef640 1 -- 172.21.15.19:0/3679986455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d754fd0a0 con 0x560d754fe100 2024-09-12T02:02:27.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.634+0000 7f4599ded640 1 --2- 172.21.15.19:0/3679986455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d754fdd20 0x560d7544c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:27.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.634+0000 7f459a5ee640 1 --2- 172.21.15.19:0/3679986455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d75471640 0x560d754f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.634+0000 7f459adef640 1 --2- 172.21.15.19:0/3679986455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d754fe100 0x560d75501e90 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f4594005fd0 tx=0x7f4594003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.634+0000 7f458b7fe640 1 -- 172.21.15.19:0/3679986455 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4594067070 con 0x560d754fe100 2024-09-12T02:02:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.634+0000 7f458b7fe640 1 -- 172.21.15.19:0/3679986455 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4594068040 con 0x560d754fe100 2024-09-12T02:02:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.634+0000 7f459caf8f40 1 -- 172.21.15.19:0/3679986455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560d754fd380 con 0x560d754fe100 2024-09-12T02:02:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.634+0000 7f458b7fe640 1 -- 172.21.15.19:0/3679986455 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4594062b60 con 0x560d754fe100 2024-09-12T02:02:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.634+0000 7f459caf8f40 1 -- 172.21.15.19:0/3679986455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d754f9000 con 0x560d754fe100 2024-09-12T02:02:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.635+0000 7f458b7fe640 1 -- 172.21.15.19:0/3679986455 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4594062d00 con 0x560d754fe100 2024-09-12T02:02:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.636+0000 7f458b7fe640 1 --2- 172.21.15.19:0/3679986455 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f457c06a810 0x7f457c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.636+0000 7f458b7fe640 1 -- 172.21.15.19:0/3679986455 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f45940cf110 con 0x560d754fe100 2024-09-12T02:02:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.636+0000 7f459caf8f40 1 --2- 172.21.15.19:0/3679986455 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560d754f9d10 0x560d754fa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.636+0000 7f459caf8f40 1 -- 172.21.15.19:0/3679986455 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:1 13.b 13:d0630e4c:::mds0_sessionmap:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x560d754fa630 con 0x560d754f9d10 2024-09-12T02:02:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.636+0000 7f459a5ee640 1 --2- 172.21.15.19:0/3679986455 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f457c06a810 0x7f457c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.636+0000 7f4599ded640 1 --2- 172.21.15.19:0/3679986455 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560d754f9d10 0x560d754fa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.637+0000 7f459a5ee640 1 --2- 172.21.15.19:0/3679986455 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f457c06a810 0x7f457c06ccd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x560d7544dc90 tx=0x7f458c001750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.637+0000 7f4599ded640 1 --2- 172.21.15.19:0/3679986455 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560d754f9d10 0x560d754fa0f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.637+0000 7f4599ded640 1 -- 172.21.15.19:0/3679986455 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(1 mds0_sessionmap [stat out=16b] v0'0 uv3 ondisk = 0) ==== 159+0+16 (crc 0 0 0) 0x7f4590009890 con 0x560d754f9d10 2024-09-12T02:02:27.641 INFO:teuthology.orchestra.run.smithi019.stdout:cephfs_metadata/mds0_sessionmap mtime 2024-09-12T02:02:23.000000+0000, size 0 2024-09-12T02:02:27.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.637+0000 7f459caf8f40 1 -- 172.21.15.19:0/3679986455 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560d754f9d10 msgr2=0x560d754fa0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.637+0000 7f459caf8f40 1 --2- 172.21.15.19:0/3679986455 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560d754f9d10 0x560d754fa0f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.637+0000 7f459caf8f40 1 -- 172.21.15.19:0/3679986455 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f457c06a810 msgr2=0x7f457c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.637+0000 7f459caf8f40 1 --2- 172.21.15.19:0/3679986455 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f457c06a810 0x7f457c06ccd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x560d7544dc90 tx=0x7f458c001750 comp rx=0 tx=0).stop 2024-09-12T02:02:27.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.637+0000 7f459caf8f40 1 -- 172.21.15.19:0/3679986455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d754fe100 msgr2=0x560d75501e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.637+0000 7f459caf8f40 1 --2- 172.21.15.19:0/3679986455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d754fe100 0x560d75501e90 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f4594005fd0 tx=0x7f4594003330 comp rx=0 tx=0).stop 2024-09-12T02:02:27.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.637+0000 7f459adef640 1 -- 172.21.15.19:0/3679986455 reap_dead start 2024-09-12T02:02:27.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.637+0000 7f459caf8f40 1 -- 172.21.15.19:0/3679986455 shutdown_connections 2024-09-12T02:02:27.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.637+0000 7f459caf8f40 1 -- 172.21.15.19:0/3679986455 >> 172.21.15.19:0/3679986455 conn(0x560d75456490 msgr2=0x560d7546e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.637+0000 7f459caf8f40 1 -- 172.21.15.19:0/3679986455 shutdown_connections 2024-09-12T02:02:27.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.637+0000 7f459caf8f40 1 -- 172.21.15.19:0/3679986455 wait complete. 2024-09-12T02:02:27.643 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 400.00000000 2024-09-12T02:02:27.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.686+0000 7fbad6f63f40 1 Processor -- start 2024-09-12T02:02:27.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.686+0000 7fbad6f63f40 1 -- start start 2024-09-12T02:02:27.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.687+0000 7fbad6f63f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff347dbf70 0x55ff348a0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.687+0000 7fbad6f63f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ff347dc350 0x55ff34809b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.687+0000 7fbad6f63f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff348ab8e0 0x55ff3480a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.687+0000 7fbad6f63f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ff34804100 con 0x55ff347dbf70 2024-09-12T02:02:27.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.687+0000 7fbad6f63f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ff3472b510 con 0x55ff348ab8e0 2024-09-12T02:02:27.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.687+0000 7fbad6f63f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55ff34807720 con 0x55ff347dc350 2024-09-12T02:02:27.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.687+0000 7fbad4a59640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff347dbf70 0x55ff348a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.687+0000 7fbad4a59640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff347dbf70 0x55ff348a0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51646/0 (socket says 172.21.15.19:51646) 2024-09-12T02:02:27.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.687+0000 7fbad4a59640 1 -- 172.21.15.19:0/4015932845 learned_addr learned my addr 172.21.15.19:0/4015932845 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.687+0000 7fbad4a59640 1 -- 172.21.15.19:0/4015932845 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ff347dc350 msgr2=0x55ff34809b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.687+0000 7fbad4a59640 1 --2- 172.21.15.19:0/4015932845 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ff347dc350 0x55ff34809b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.687+0000 7fbad4a59640 1 -- 172.21.15.19:0/4015932845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff348ab8e0 msgr2=0x55ff3480a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.687+0000 7fbad4a59640 1 --2- 172.21.15.19:0/4015932845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff348ab8e0 0x55ff3480a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.687+0000 7fbad4a59640 1 -- 172.21.15.19:0/4015932845 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff348a08c0 con 0x55ff347dbf70 2024-09-12T02:02:27.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.687+0000 7fbad4a59640 1 --2- 172.21.15.19:0/4015932845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff347dbf70 0x55ff348a0210 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fbac4025ae0 tx=0x7fbac4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc60de9ea62990f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.687+0000 7fbad3256640 1 -- 172.21.15.19:0/4015932845 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4067070 con 0x55ff347dbf70 2024-09-12T02:02:27.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.687+0000 7fbad3256640 1 -- 172.21.15.19:0/4015932845 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac404fbc0 con 0x55ff347dbf70 2024-09-12T02:02:27.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.688+0000 7fbad3256640 1 -- 172.21.15.19:0/4015932845 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac404f630 con 0x55ff347dbf70 2024-09-12T02:02:27.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.688+0000 7fbad6f63f40 1 -- 172.21.15.19:0/4015932845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff347dbf70 msgr2=0x55ff348a0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.688+0000 7fbad6f63f40 1 --2- 172.21.15.19:0/4015932845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff347dbf70 0x55ff348a0210 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fbac4025ae0 tx=0x7fbac4051000 comp rx=0 tx=0).stop 2024-09-12T02:02:27.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.688+0000 7fbad6f63f40 1 -- 172.21.15.19:0/4015932845 shutdown_connections 2024-09-12T02:02:27.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.688+0000 7fbad6f63f40 1 --2- 172.21.15.19:0/4015932845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff348ab8e0 0x55ff3480a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.688+0000 7fbad6f63f40 1 --2- 172.21.15.19:0/4015932845 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ff347dc350 0x55ff34809b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.688+0000 7fbad6f63f40 1 --2- 172.21.15.19:0/4015932845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff347dbf70 0x55ff348a0210 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.688+0000 7fbad6f63f40 1 -- 172.21.15.19:0/4015932845 >> 172.21.15.19:0/4015932845 conn(0x55ff347db1d0 msgr2=0x55ff34822740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.688+0000 7fbad6f63f40 1 -- 172.21.15.19:0/4015932845 shutdown_connections 2024-09-12T02:02:27.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.688+0000 7fbad6f63f40 1 -- 172.21.15.19:0/4015932845 wait complete. 2024-09-12T02:02:27.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.689+0000 7fbad6f63f40 1 Processor -- start 2024-09-12T02:02:27.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.689+0000 7fbad6f63f40 1 -- start start 2024-09-12T02:02:27.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.689+0000 7fbad6f63f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff347dbf70 0x55ff348a8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.689+0000 7fbad6f63f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff347dc350 0x55ff34808bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.689+0000 7fbad6f63f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ff348ab8e0 0x55ff34809100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.689+0000 7fbad6f63f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ff34823060 con 0x55ff347dbf70 2024-09-12T02:02:27.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.689+0000 7fbad6f63f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ff348b3bc0 con 0x55ff347dc350 2024-09-12T02:02:27.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.689+0000 7fbad6f63f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55ff348a0d70 con 0x55ff348ab8e0 2024-09-12T02:02:27.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.689+0000 7fbad4a59640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff347dbf70 0x55ff348a8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.689+0000 7fbad4a59640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff347dbf70 0x55ff348a8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51650/0 (socket says 172.21.15.19:51650) 2024-09-12T02:02:27.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.689+0000 7fbad4a59640 1 -- 172.21.15.19:0/2512891485 learned_addr learned my addr 172.21.15.19:0/2512891485 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.690+0000 7fbad4258640 1 --2- 172.21.15.19:0/2512891485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff347dc350 0x55ff34808bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.690+0000 7fbad525a640 1 --2- 172.21.15.19:0/2512891485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ff348ab8e0 0x55ff34809100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.690+0000 7fbad4a59640 1 -- 172.21.15.19:0/2512891485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ff348ab8e0 msgr2=0x55ff34809100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.690+0000 7fbad4a59640 1 --2- 172.21.15.19:0/2512891485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ff348ab8e0 0x55ff34809100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.690+0000 7fbad4a59640 1 -- 172.21.15.19:0/2512891485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff347dc350 msgr2=0x55ff34808bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.690+0000 7fbad4a59640 1 --2- 172.21.15.19:0/2512891485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff347dc350 0x55ff34808bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.690+0000 7fbad4a59640 1 -- 172.21.15.19:0/2512891485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff34805e80 con 0x55ff347dbf70 2024-09-12T02:02:27.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.690+0000 7fbad4258640 1 --2- 172.21.15.19:0/2512891485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff347dc350 0x55ff34808bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:27.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.690+0000 7fbad4a59640 1 --2- 172.21.15.19:0/2512891485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff347dbf70 0x55ff348a8ba0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fbac4000f80 tx=0x7fbac4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.690+0000 7fbad2254640 1 -- 172.21.15.19:0/2512891485 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4067040 con 0x55ff347dbf70 2024-09-12T02:02:27.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.690+0000 7fbad2254640 1 -- 172.21.15.19:0/2512891485 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac4072070 con 0x55ff347dbf70 2024-09-12T02:02:27.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.690+0000 7fbad2254640 1 -- 172.21.15.19:0/2512891485 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4058cc0 con 0x55ff347dbf70 2024-09-12T02:02:27.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.690+0000 7fbad6f63f40 1 -- 172.21.15.19:0/2512891485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff3481dc10 con 0x55ff347dbf70 2024-09-12T02:02:27.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.690+0000 7fbad6f63f40 1 -- 172.21.15.19:0/2512891485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff348a0210 con 0x55ff347dbf70 2024-09-12T02:02:27.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.692+0000 7fbad2254640 1 -- 172.21.15.19:0/2512891485 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbac4077460 con 0x55ff347dbf70 2024-09-12T02:02:27.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.692+0000 7fbad2254640 1 --2- 172.21.15.19:0/2512891485 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbab406a840 0x7fbab406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.692+0000 7fbad2254640 1 -- 172.21.15.19:0/2512891485 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7fbac40cfb40 con 0x55ff347dbf70 2024-09-12T02:02:27.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.692+0000 7fbad6f63f40 1 --2- 172.21.15.19:0/2512891485 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ff348a90e0 0x55ff3489c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.692+0000 7fbad6f63f40 1 -- 172.21.15.19:0/2512891485 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 13.f 13:f1f69726:::400.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55ff3489d260 con 0x55ff348a90e0 2024-09-12T02:02:27.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.692+0000 7fbad4258640 1 --2- 172.21.15.19:0/2512891485 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbab406a840 0x7fbab406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.693+0000 7fbad525a640 1 --2- 172.21.15.19:0/2512891485 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ff348a90e0 0x55ff3489c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.693+0000 7fbad4258640 1 --2- 172.21.15.19:0/2512891485 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbab406a840 0x7fbab406cd00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbabc000f60 tx=0x7fbabc001680 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.693+0000 7fbad525a640 1 --2- 172.21.15.19:0/2512891485 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ff348a90e0 0x55ff3489c080 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.693+0000 7fbad525a640 1 -- 172.21.15.19:0/2512891485 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 400.00000000 [stat out=16b] v0'0 uv1 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x7fbacc007550 con 0x55ff348a90e0 2024-09-12T02:02:27.697 INFO:teuthology.orchestra.run.smithi019.stdout:cephfs_metadata/400.00000000 mtime 2024-09-12T02:02:12.000000+0000, size 22 2024-09-12T02:02:27.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.693+0000 7fbad6f63f40 1 -- 172.21.15.19:0/2512891485 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ff348a90e0 msgr2=0x55ff3489c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.693+0000 7fbad6f63f40 1 --2- 172.21.15.19:0/2512891485 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ff348a90e0 0x55ff3489c080 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.693+0000 7fbad6f63f40 1 -- 172.21.15.19:0/2512891485 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbab406a840 msgr2=0x7fbab406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.693+0000 7fbad6f63f40 1 --2- 172.21.15.19:0/2512891485 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbab406a840 0x7fbab406cd00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbabc000f60 tx=0x7fbabc001680 comp rx=0 tx=0).stop 2024-09-12T02:02:27.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.693+0000 7fbad6f63f40 1 -- 172.21.15.19:0/2512891485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff347dbf70 msgr2=0x55ff348a8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.693+0000 7fbad6f63f40 1 --2- 172.21.15.19:0/2512891485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff347dbf70 0x55ff348a8ba0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fbac4000f80 tx=0x7fbac4003330 comp rx=0 tx=0).stop 2024-09-12T02:02:27.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.693+0000 7fbad525a640 1 -- 172.21.15.19:0/2512891485 reap_dead start 2024-09-12T02:02:27.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.693+0000 7fbad6f63f40 1 -- 172.21.15.19:0/2512891485 shutdown_connections 2024-09-12T02:02:27.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.693+0000 7fbad6f63f40 1 -- 172.21.15.19:0/2512891485 >> 172.21.15.19:0/2512891485 conn(0x55ff347db1d0 msgr2=0x55ff3489f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.693+0000 7fbad6f63f40 1 -- 172.21.15.19:0/2512891485 shutdown_connections 2024-09-12T02:02:27.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.693+0000 7fbad6f63f40 1 -- 172.21.15.19:0/2512891485 wait complete. 2024-09-12T02:02:27.699 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 100.00000000.inode 2024-09-12T02:02:27.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.781+0000 7f2b35c31f40 1 Processor -- start 2024-09-12T02:02:27.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.781+0000 7f2b35c31f40 1 -- start start 2024-09-12T02:02:27.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.782+0000 7f2b35c31f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b200022d0 0x55fa015ffc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.782+0000 7f2b35c31f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fa0156d5e0 0x55fa015dfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.782+0000 7f2b35c31f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fa01572990 0x55fa015e0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.782+0000 7f2b35c31f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fa0147a510 con 0x55fa0156d5e0 2024-09-12T02:02:27.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.782+0000 7f2b35c31f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fa014d3c50 con 0x7f2b200022d0 2024-09-12T02:02:27.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.782+0000 7f2b35c31f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55fa01527dc0 con 0x55fa01572990 2024-09-12T02:02:27.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.782+0000 7f2b32f26640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fa0156d5e0 0x55fa015dfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.782+0000 7f2b32f26640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fa0156d5e0 0x55fa015dfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51672/0 (socket says 172.21.15.19:51672) 2024-09-12T02:02:27.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.782+0000 7f2b32f26640 1 -- 172.21.15.19:0/3953892315 learned_addr learned my addr 172.21.15.19:0/3953892315 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.782+0000 7f2b33f28640 1 --2- 172.21.15.19:0/3953892315 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fa01572990 0x55fa015e0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.782+0000 7f2b33727640 1 --2- 172.21.15.19:0/3953892315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b200022d0 0x55fa015ffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.782+0000 7f2b32f26640 1 -- 172.21.15.19:0/3953892315 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fa01572990 msgr2=0x55fa015e0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.782+0000 7f2b32f26640 1 --2- 172.21.15.19:0/3953892315 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fa01572990 0x55fa015e0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.782+0000 7f2b32f26640 1 -- 172.21.15.19:0/3953892315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b200022d0 msgr2=0x55fa015ffc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.782+0000 7f2b32f26640 1 --2- 172.21.15.19:0/3953892315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b200022d0 0x55fa015ffc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.782+0000 7f2b32f26640 1 -- 172.21.15.19:0/3953892315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa0156dfa0 con 0x55fa0156d5e0 2024-09-12T02:02:27.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.782+0000 7f2b33727640 1 --2- 172.21.15.19:0/3953892315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b200022d0 0x55fa015ffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:27.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.783+0000 7f2b32f26640 1 --2- 172.21.15.19:0/3953892315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fa0156d5e0 0x55fa015dfbf0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c009790 tx=0x7f2b1c009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fe6bfdc4cf3a11 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.783+0000 7f2b31f24640 1 -- 172.21.15.19:0/3953892315 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c007800 con 0x55fa0156d5e0 2024-09-12T02:02:27.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.783+0000 7f2b31f24640 1 -- 172.21.15.19:0/3953892315 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b1c019070 con 0x55fa0156d5e0 2024-09-12T02:02:27.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.783+0000 7f2b31f24640 1 -- 172.21.15.19:0/3953892315 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c007ba0 con 0x55fa0156d5e0 2024-09-12T02:02:27.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.783+0000 7f2b35c31f40 1 -- 172.21.15.19:0/3953892315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fa0156d5e0 msgr2=0x55fa015dfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.783+0000 7f2b35c31f40 1 --2- 172.21.15.19:0/3953892315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fa0156d5e0 0x55fa015dfbf0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c009790 tx=0x7f2b1c009880 comp rx=0 tx=0).stop 2024-09-12T02:02:27.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.783+0000 7f2b35c31f40 1 -- 172.21.15.19:0/3953892315 shutdown_connections 2024-09-12T02:02:27.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.783+0000 7f2b35c31f40 1 --2- 172.21.15.19:0/3953892315 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fa01572990 0x55fa015e0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.783+0000 7f2b35c31f40 1 --2- 172.21.15.19:0/3953892315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fa0156d5e0 0x55fa015dfbf0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.783+0000 7f2b35c31f40 1 --2- 172.21.15.19:0/3953892315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b200022d0 0x55fa015ffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.783+0000 7f2b35c31f40 1 -- 172.21.15.19:0/3953892315 >> 172.21.15.19:0/3953892315 conn(0x55fa015289e0 msgr2=0x55fa016028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.783+0000 7f2b35c31f40 1 -- 172.21.15.19:0/3953892315 shutdown_connections 2024-09-12T02:02:27.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.783+0000 7f2b35c31f40 1 -- 172.21.15.19:0/3953892315 wait complete. 2024-09-12T02:02:27.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.784+0000 7f2b35c31f40 1 Processor -- start 2024-09-12T02:02:27.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.784+0000 7f2b35c31f40 1 -- start start 2024-09-12T02:02:27.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b35c31f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0156d5e0 0x55fa015fee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b35c31f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fa01572990 0x55fa01527000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b35c31f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b200022d0 0x55fa0169a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b35c31f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fa0156e280 con 0x7f2b200022d0 2024-09-12T02:02:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b35c31f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fa0156ebb0 con 0x55fa0156d5e0 2024-09-12T02:02:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b35c31f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55fa0156e560 con 0x55fa01572990 2024-09-12T02:02:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b33f28640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b200022d0 0x55fa0169a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b33f28640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b200022d0 0x55fa0169a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51678/0 (socket says 172.21.15.19:51678) 2024-09-12T02:02:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b33f28640 1 -- 172.21.15.19:0/2718630494 learned_addr learned my addr 172.21.15.19:0/2718630494 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b33727640 1 --2- 172.21.15.19:0/2718630494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0156d5e0 0x55fa015fee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b32f26640 1 --2- 172.21.15.19:0/2718630494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fa01572990 0x55fa01527000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b33f28640 1 -- 172.21.15.19:0/2718630494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fa01572990 msgr2=0x55fa01527000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b33f28640 1 --2- 172.21.15.19:0/2718630494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fa01572990 0x55fa01527000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b33f28640 1 -- 172.21.15.19:0/2718630494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0156d5e0 msgr2=0x55fa015fee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b33f28640 1 --2- 172.21.15.19:0/2718630494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0156d5e0 0x55fa015fee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b33f28640 1 -- 172.21.15.19:0/2718630494 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa015e3590 con 0x7f2b200022d0 2024-09-12T02:02:27.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b32f26640 1 --2- 172.21.15.19:0/2718630494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fa01572990 0x55fa01527000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:27.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b33f28640 1 --2- 172.21.15.19:0/2718630494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b200022d0 0x55fa0169a430 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x55fa0152b890 tx=0x7f2b2c00d740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b30f22640 1 -- 172.21.15.19:0/2718630494 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c018640 con 0x7f2b200022d0 2024-09-12T02:02:27.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b30f22640 1 -- 172.21.15.19:0/2718630494 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b2c0187e0 con 0x7f2b200022d0 2024-09-12T02:02:27.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b30f22640 1 -- 172.21.15.19:0/2718630494 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c018bd0 con 0x7f2b200022d0 2024-09-12T02:02:27.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b35c31f40 1 -- 172.21.15.19:0/2718630494 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa015e3870 con 0x7f2b200022d0 2024-09-12T02:02:27.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.785+0000 7f2b35c31f40 1 -- 172.21.15.19:0/2718630494 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa015e3e30 con 0x7f2b200022d0 2024-09-12T02:02:27.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.787+0000 7f2b30f22640 1 -- 172.21.15.19:0/2718630494 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b2c009070 con 0x7f2b200022d0 2024-09-12T02:02:27.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.787+0000 7f2b30f22640 1 --2- 172.21.15.19:0/2718630494 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2b1406a840 0x7f2b1406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.787+0000 7f2b30f22640 1 -- 172.21.15.19:0/2718630494 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f2b2c08a300 con 0x7f2b200022d0 2024-09-12T02:02:27.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.787+0000 7f2b35c31f40 1 --2- 172.21.15.19:0/2718630494 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55fa01527540 0x55fa015fd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.788+0000 7f2b33727640 1 --2- 172.21.15.19:0/2718630494 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2b1406a840 0x7f2b1406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.788+0000 7f2b35c31f40 1 -- 172.21.15.19:0/2718630494 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 13.1f 13:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55fa015e4630 con 0x55fa01527540 2024-09-12T02:02:27.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.788+0000 7f2b32f26640 1 --2- 172.21.15.19:0/2718630494 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55fa01527540 0x55fa015fd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.788+0000 7f2b33727640 1 --2- 172.21.15.19:0/2718630494 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2b1406a840 0x7f2b1406cd00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2b24055000 tx=0x7f2b24008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.788+0000 7f2b32f26640 1 --2- 172.21.15.19:0/2718630494 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55fa01527540 0x55fa015fd170 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.789+0000 7f2b32f26640 1 -- 172.21.15.19:0/2718630494 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) ==== 162+0+16 (crc 0 0 0) 0x7f2b1c007a10 con 0x55fa01527540 2024-09-12T02:02:27.792 INFO:teuthology.orchestra.run.smithi019.stdout:cephfs_metadata/100.00000000.inode mtime 2024-09-12T02:02:12.000000+0000, size 582 2024-09-12T02:02:27.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.789+0000 7f2b35c31f40 1 -- 172.21.15.19:0/2718630494 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55fa01527540 msgr2=0x55fa015fd170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.789+0000 7f2b35c31f40 1 --2- 172.21.15.19:0/2718630494 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55fa01527540 0x55fa015fd170 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.789+0000 7f2b35c31f40 1 -- 172.21.15.19:0/2718630494 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2b1406a840 msgr2=0x7f2b1406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.789+0000 7f2b35c31f40 1 --2- 172.21.15.19:0/2718630494 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2b1406a840 0x7f2b1406cd00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2b24055000 tx=0x7f2b24008030 comp rx=0 tx=0).stop 2024-09-12T02:02:27.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.789+0000 7f2b35c31f40 1 -- 172.21.15.19:0/2718630494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b200022d0 msgr2=0x55fa0169a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.789+0000 7f2b35c31f40 1 --2- 172.21.15.19:0/2718630494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b200022d0 0x55fa0169a430 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x55fa0152b890 tx=0x7f2b2c00d740 comp rx=0 tx=0).stop 2024-09-12T02:02:27.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.789+0000 7f2b33f28640 1 -- 172.21.15.19:0/2718630494 reap_dead start 2024-09-12T02:02:27.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.789+0000 7f2b35c31f40 1 -- 172.21.15.19:0/2718630494 shutdown_connections 2024-09-12T02:02:27.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.789+0000 7f2b35c31f40 1 -- 172.21.15.19:0/2718630494 >> 172.21.15.19:0/2718630494 conn(0x55fa015289e0 msgr2=0x55fa015dfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.789+0000 7f2b35c31f40 1 -- 172.21.15.19:0/2718630494 shutdown_connections 2024-09-12T02:02:27.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.789+0000 7f2b35c31f40 1 -- 172.21.15.19:0/2718630494 wait complete. 2024-09-12T02:02:27.795 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 1.00000000 2024-09-12T02:02:27.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.878+0000 7f276df43f40 1 Processor -- start 2024-09-12T02:02:27.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.878+0000 7f276df43f40 1 -- start start 2024-09-12T02:02:27.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276df43f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27540030f0 0x557e5603f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276df43f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557e560d2ff0 0x557e560d1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276df43f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e56028030 0x557e56162270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276df43f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557e55f4c510 con 0x557e560d2ff0 2024-09-12T02:02:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276df43f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557e55fa5c50 con 0x557e56028030 2024-09-12T02:02:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276df43f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x557e560446b0 con 0x7f27540030f0 2024-09-12T02:02:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276b238640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557e560d2ff0 0x557e560d1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276b238640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557e560d2ff0 0x557e560d1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51696/0 (socket says 172.21.15.19:51696) 2024-09-12T02:02:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276b238640 1 -- 172.21.15.19:0/1443471827 learned_addr learned my addr 172.21.15.19:0/1443471827 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276ba39640 1 --2- 172.21.15.19:0/1443471827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27540030f0 0x557e5603f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276c23a640 1 --2- 172.21.15.19:0/1443471827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e56028030 0x557e56162270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276b238640 1 -- 172.21.15.19:0/1443471827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27540030f0 msgr2=0x557e5603f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276b238640 1 --2- 172.21.15.19:0/1443471827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27540030f0 0x557e5603f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276b238640 1 -- 172.21.15.19:0/1443471827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e56028030 msgr2=0x557e56162270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276b238640 1 --2- 172.21.15.19:0/1443471827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e56028030 0x557e56162270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276b238640 1 -- 172.21.15.19:0/1443471827 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e560cf2d0 con 0x557e560d2ff0 2024-09-12T02:02:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276b238640 1 --2- 172.21.15.19:0/1443471827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557e560d2ff0 0x557e560d1770 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f2760056040 tx=0x7f2760052000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b5880f371aafdb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276a236640 1 -- 172.21.15.19:0/1443471827 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2760064070 con 0x557e560d2ff0 2024-09-12T02:02:27.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276a236640 1 -- 172.21.15.19:0/1443471827 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2760053460 con 0x557e560d2ff0 2024-09-12T02:02:27.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.879+0000 7f276a236640 1 -- 172.21.15.19:0/1443471827 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2760058040 con 0x557e560d2ff0 2024-09-12T02:02:27.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.880+0000 7f276df43f40 1 -- 172.21.15.19:0/1443471827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557e560d2ff0 msgr2=0x557e560d1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.880+0000 7f276df43f40 1 --2- 172.21.15.19:0/1443471827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557e560d2ff0 0x557e560d1770 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f2760056040 tx=0x7f2760052000 comp rx=0 tx=0).stop 2024-09-12T02:02:27.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.880+0000 7f276df43f40 1 -- 172.21.15.19:0/1443471827 shutdown_connections 2024-09-12T02:02:27.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.880+0000 7f276df43f40 1 --2- 172.21.15.19:0/1443471827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e56028030 0x557e56162270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.880+0000 7f276df43f40 1 --2- 172.21.15.19:0/1443471827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557e560d2ff0 0x557e560d1770 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.880+0000 7f276df43f40 1 --2- 172.21.15.19:0/1443471827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27540030f0 0x557e5603f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.880+0000 7f276df43f40 1 -- 172.21.15.19:0/1443471827 >> 172.21.15.19:0/1443471827 conn(0x557e56028490 msgr2=0x557e55ff91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.880+0000 7f276df43f40 1 -- 172.21.15.19:0/1443471827 shutdown_connections 2024-09-12T02:02:27.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.880+0000 7f276df43f40 1 -- 172.21.15.19:0/1443471827 wait complete. 2024-09-12T02:02:27.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.881+0000 7f276df43f40 1 Processor -- start 2024-09-12T02:02:27.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.881+0000 7f276df43f40 1 -- start start 2024-09-12T02:02:27.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.881+0000 7f276df43f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557e56028030 0x557e560d2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.881+0000 7f276df43f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e560d2ff0 0x557e560d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.881+0000 7f276df43f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27540030f0 0x557e560ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.881+0000 7f276df43f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557e560410e0 con 0x7f27540030f0 2024-09-12T02:02:27.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.881+0000 7f276df43f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557e5603b700 con 0x557e560d2ff0 2024-09-12T02:02:27.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.881+0000 7f276df43f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x557e560413c0 con 0x557e56028030 2024-09-12T02:02:27.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.881+0000 7f276c23a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27540030f0 0x557e560ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.881+0000 7f276c23a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27540030f0 0x557e560ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51702/0 (socket says 172.21.15.19:51702) 2024-09-12T02:02:27.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.881+0000 7f276c23a640 1 -- 172.21.15.19:0/732965703 learned_addr learned my addr 172.21.15.19:0/732965703 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:27.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.882+0000 7f276ba39640 1 --2- 172.21.15.19:0/732965703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557e56028030 0x557e560d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.882+0000 7f276b238640 1 --2- 172.21.15.19:0/732965703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e560d2ff0 0x557e560d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.882+0000 7f276c23a640 1 -- 172.21.15.19:0/732965703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557e56028030 msgr2=0x557e560d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.882+0000 7f276c23a640 1 --2- 172.21.15.19:0/732965703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557e56028030 0x557e560d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.882+0000 7f276c23a640 1 -- 172.21.15.19:0/732965703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e560d2ff0 msgr2=0x557e560d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.882+0000 7f276c23a640 1 --2- 172.21.15.19:0/732965703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e560d2ff0 0x557e560d06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.882+0000 7f276c23a640 1 -- 172.21.15.19:0/732965703 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e560cea30 con 0x7f27540030f0 2024-09-12T02:02:27.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.882+0000 7f276b238640 1 --2- 172.21.15.19:0/732965703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e560d2ff0 0x557e560d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:27.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.882+0000 7f276c23a640 1 --2- 172.21.15.19:0/732965703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27540030f0 0x557e560ca440 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x557e56042290 tx=0x7f2764003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.882+0000 7f2769234640 1 -- 172.21.15.19:0/732965703 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276401a070 con 0x7f27540030f0 2024-09-12T02:02:27.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.882+0000 7f2769234640 1 -- 172.21.15.19:0/732965703 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27640135b0 con 0x7f27540030f0 2024-09-12T02:02:27.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.882+0000 7f2769234640 1 -- 172.21.15.19:0/732965703 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2764013980 con 0x7f27540030f0 2024-09-12T02:02:27.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.882+0000 7f276df43f40 1 -- 172.21.15.19:0/732965703 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e560ced10 con 0x7f27540030f0 2024-09-12T02:02:27.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.882+0000 7f276df43f40 1 -- 172.21.15.19:0/732965703 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e5602a960 con 0x7f27540030f0 2024-09-12T02:02:27.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.883+0000 7f2769234640 1 -- 172.21.15.19:0/732965703 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f276401d070 con 0x7f27540030f0 2024-09-12T02:02:27.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.884+0000 7f2769234640 1 --2- 172.21.15.19:0/732965703 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f275806a810 0x7f275806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.884+0000 7f2769234640 1 -- 172.21.15.19:0/732965703 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f2764089810 con 0x7f27540030f0 2024-09-12T02:02:27.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.884+0000 7f276ba39640 1 --2- 172.21.15.19:0/732965703 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f275806a810 0x7f275806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.884+0000 7f276df43f40 1 --2- 172.21.15.19:0/732965703 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x557e560cb190 0x557e5615e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:27.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.884+0000 7f276df43f40 1 -- 172.21.15.19:0/732965703 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 13.1f 13:ff5b34d6:::1.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x557e560d0c10 con 0x557e560cb190 2024-09-12T02:02:27.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.884+0000 7f276b238640 1 --2- 172.21.15.19:0/732965703 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x557e560cb190 0x557e5615e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:27.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.885+0000 7f276ba39640 1 --2- 172.21.15.19:0/732965703 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f275806a810 0x7f275806ccd0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f275c005770 tx=0x7f275c00c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.885+0000 7f276b238640 1 --2- 172.21.15.19:0/732965703 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x557e560cb190 0x557e5615e3f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:27.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.885+0000 7f276b238640 1 -- 172.21.15.19:0/732965703 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 1.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) ==== 154+0+16 (crc 0 0 0) 0x7f2760053830 con 0x557e560cb190 2024-09-12T02:02:27.888 INFO:teuthology.orchestra.run.smithi019.stdout:cephfs_metadata/1.00000000 mtime 2024-09-12T02:02:23.000000+0000, size 0 2024-09-12T02:02:27.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.885+0000 7f276df43f40 1 -- 172.21.15.19:0/732965703 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x557e560cb190 msgr2=0x557e5615e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.885+0000 7f276df43f40 1 --2- 172.21.15.19:0/732965703 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x557e560cb190 0x557e5615e3f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:27.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.885+0000 7f276df43f40 1 -- 172.21.15.19:0/732965703 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f275806a810 msgr2=0x7f275806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.885+0000 7f276df43f40 1 --2- 172.21.15.19:0/732965703 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f275806a810 0x7f275806ccd0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f275c005770 tx=0x7f275c00c040 comp rx=0 tx=0).stop 2024-09-12T02:02:27.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.885+0000 7f276df43f40 1 -- 172.21.15.19:0/732965703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27540030f0 msgr2=0x557e560ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:27.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.885+0000 7f276df43f40 1 --2- 172.21.15.19:0/732965703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27540030f0 0x557e560ca440 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x557e56042290 tx=0x7f2764003820 comp rx=0 tx=0).stop 2024-09-12T02:02:27.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.885+0000 7f276c23a640 1 -- 172.21.15.19:0/732965703 reap_dead start 2024-09-12T02:02:27.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.885+0000 7f276df43f40 1 -- 172.21.15.19:0/732965703 shutdown_connections 2024-09-12T02:02:27.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.885+0000 7f276df43f40 1 -- 172.21.15.19:0/732965703 >> 172.21.15.19:0/732965703 conn(0x557e56028490 msgr2=0x557e55ff9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:27.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.885+0000 7f276df43f40 1 -- 172.21.15.19:0/732965703 shutdown_connections 2024-09-12T02:02:27.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:27.885+0000 7f276df43f40 1 -- 172.21.15.19:0/732965703 wait complete. 2024-09-12T02:02:27.890 INFO:tasks.cephfs.test_damage:Expectation on rm '10000000000.00000000' will be 'no damage' 2024-09-12T02:02:27.890 INFO:tasks.cephfs.test_damage:Expectation on rm '600.00000000' will be 'damaged_on_start' 2024-09-12T02:02:27.891 INFO:tasks.cephfs.test_damage:Expectation on rm '1.00000000.inode' will be 'damaged_on_start' 2024-09-12T02:02:27.891 INFO:tasks.cephfs.test_damage:Expectation on rm '200.00000000' will be 'damaged_on_start' 2024-09-12T02:02:27.891 INFO:tasks.cephfs.test_damage:Expectation on rm '200.00000001' will be 'damaged_on_start' 2024-09-12T02:02:27.891 INFO:tasks.cephfs.test_damage:Expectation on rm 'mds0_openfiles.0' will be 'no damage' 2024-09-12T02:02:27.891 INFO:tasks.cephfs.test_damage:Expectation on rm '500.00000000' will be 'no damage' 2024-09-12T02:02:27.891 INFO:tasks.cephfs.test_damage:Expectation on rm 'mds_snaptable' will be 'damaged_on_start' 2024-09-12T02:02:27.891 INFO:tasks.cephfs.test_damage:Expectation on rm 'mds0_inotable' will be 'damaged_on_start' 2024-09-12T02:02:27.891 INFO:tasks.cephfs.test_damage:Expectation on rm '100.00000000' will be 'damaged_on_start' 2024-09-12T02:02:27.891 INFO:tasks.cephfs.test_damage:Expectation on rm 'mds0_sessionmap' will be 'damaged_on_start' 2024-09-12T02:02:27.891 INFO:tasks.cephfs.test_damage:Expectation on rm '400.00000000' will be 'no damage' 2024-09-12T02:02:27.891 INFO:tasks.cephfs.test_damage:Expectation on rm '100.00000000.inode' will be 'damaged_on_start' 2024-09-12T02:02:27.891 INFO:tasks.cephfs.test_damage:Expectation on rm '1.00000000' will be 'damaged_on_start' 2024-09-12T02:02:27.891 INFO:tasks.cephfs.test_damage:Expectation on corrupt header '10000000000.00000000' will be 'no damage' 2024-09-12T02:02:27.891 INFO:tasks.cephfs.test_damage:Expectation on corrupt header '600.00000000' will be 'damaged_on_start' 2024-09-12T02:02:27.892 INFO:tasks.cephfs.test_damage:Expectation on corrupt header 'mds0_openfiles.0' will be 'no damage' 2024-09-12T02:02:27.892 INFO:tasks.cephfs.test_damage:Expectation on corrupt header '100.00000000' will be 'damaged_on_start' 2024-09-12T02:02:27.892 INFO:tasks.cephfs.test_damage:Expectation on corrupt header 'mds0_sessionmap' will be 'damaged_on_start' 2024-09-12T02:02:27.892 INFO:tasks.cephfs.test_damage:Expectation on corrupt header '1.00000000' will be 'damaged_on_start' 2024-09-12T02:02:27.892 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 10000000000.00000000' 2024-09-12T02:02:27.892 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:02:27.892 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:02:27.908 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:02:27.908 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:02:27.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:27.909 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:02:27.963 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:02:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:02:27.964 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:02:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.106+0000 7f297e9e4640 1 Processor -- start 2024-09-12T02:02:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.107+0000 7f297e9e4640 1 -- start start 2024-09-12T02:02:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.107+0000 7f297e9e4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2978162060 0x7f29780b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.107+0000 7f297e9e4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f29780b64b0 0x7f29780b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.107+0000 7f297e9e4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f297806d9f0 con 0x7f2978161c80 2024-09-12T02:02:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.107+0000 7f297e9e4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f297806dcd0 con 0x7f2978162060 2024-09-12T02:02:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.107+0000 7f297e9e4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f297806dfb0 con 0x7f29780b64b0 2024-09-12T02:02:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.107+0000 7f29777fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2978162060 0x7f29780b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.107+0000 7f2977fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2978161c80 0x7f297806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33614/0 (socket says 172.21.15.19:33614) 2024-09-12T02:02:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.108+0000 7f2977fff640 1 -- 172.21.15.19:0/1236595691 learned_addr learned my addr 172.21.15.19:0/1236595691 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.108+0000 7f297cf81640 1 --2- 172.21.15.19:0/1236595691 >> v2:172.21.15.135:3300/0 conn(0x7f29780b64b0 0x7f29780b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.108+0000 7f29777fe640 1 -- 172.21.15.19:0/1236595691 >> v2:172.21.15.135:3300/0 conn(0x7f29780b64b0 msgr2=0x7f29780b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.108+0000 7f29777fe640 1 --2- 172.21.15.19:0/1236595691 >> v2:172.21.15.135:3300/0 conn(0x7f29780b64b0 0x7f29780b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.108+0000 7f29777fe640 1 -- 172.21.15.19:0/1236595691 >> v1:172.21.15.19:6789/0 conn(0x7f2978161c80 legacy=0x7f297806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.108+0000 7f29777fe640 1 -- 172.21.15.19:0/1236595691 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29780d01f0 con 0x7f2978162060 2024-09-12T02:02:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.108+0000 7f2976ffd640 1 -- 172.21.15.19:0/1236595691 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2771637871 0 0) 0x7f297806d9f0 con 0x7f2978161c80 2024-09-12T02:02:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.109+0000 7f29777fe640 1 --2- 172.21.15.19:0/1236595691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2978162060 0x7f29780b5f70 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f297808d750 tx=0x7f296c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d708c6e9a656aab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.109+0000 7f2976ffd640 1 -- 172.21.15.19:0/1236595691 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296c037070 con 0x7f2978162060 2024-09-12T02:02:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.109+0000 7f2976ffd640 1 -- 172.21.15.19:0/1236595691 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f296c032440 con 0x7f2978162060 2024-09-12T02:02:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.109+0000 7f2976ffd640 1 -- 172.21.15.19:0/1236595691 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296c032810 con 0x7f2978162060 2024-09-12T02:02:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.109+0000 7f297e9e4640 1 -- 172.21.15.19:0/1236595691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2978162060 msgr2=0x7f29780b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.109+0000 7f297e9e4640 1 --2- 172.21.15.19:0/1236595691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2978162060 0x7f29780b5f70 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f297808d750 tx=0x7f296c02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:02:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.109+0000 7f297e9e4640 1 -- 172.21.15.19:0/1236595691 shutdown_connections 2024-09-12T02:02:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.109+0000 7f297e9e4640 1 --2- 172.21.15.19:0/1236595691 >> v2:172.21.15.135:3300/0 conn(0x7f29780b64b0 0x7f29780b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.109+0000 7f297e9e4640 1 --2- 172.21.15.19:0/1236595691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2978162060 0x7f29780b5f70 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.109+0000 7f297e9e4640 1 -- 172.21.15.19:0/1236595691 >> 172.21.15.19:0/1236595691 conn(0x7f29780d44f0 msgr2=0x7f29780d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.109+0000 7f297e9e4640 1 -- 172.21.15.19:0/1236595691 shutdown_connections 2024-09-12T02:02:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.109+0000 7f297e9e4640 1 -- 172.21.15.19:0/1236595691 wait complete. 2024-09-12T02:02:28.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.111+0000 7f297e9e4640 1 Processor -- start 2024-09-12T02:02:28.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.111+0000 7f297e9e4640 1 -- start start 2024-09-12T02:02:28.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.111+0000 7f297e9e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29780b64b0 0x7f29781f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.111+0000 7f297e9e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2978161c80 0x7f29780b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.111+0000 7f297e9e4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2978162060 0x7f2978160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.111+0000 7f297e9e4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f29780cf1e0 con 0x7f29780b64b0 2024-09-12T02:02:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.111+0000 7f297e9e4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f29780d2aa0 con 0x7f2978162060 2024-09-12T02:02:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.111+0000 7f297e9e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f29780cf360 con 0x7f2978161c80 2024-09-12T02:02:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.112+0000 7f2977fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29780b64b0 0x7f29781f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.112+0000 7f2977fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29780b64b0 0x7f29781f3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51718/0 (socket says 172.21.15.19:51718) 2024-09-12T02:02:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.112+0000 7f2977fff640 1 -- 172.21.15.19:0/1196352859 learned_addr learned my addr 172.21.15.19:0/1196352859 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.112+0000 7f29777fe640 1 --2- 172.21.15.19:0/1196352859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2978161c80 0x7f29780b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.112+0000 7f297cf81640 1 --2- 172.21.15.19:0/1196352859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2978162060 0x7f2978160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.112+0000 7f2977fff640 1 -- 172.21.15.19:0/1196352859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2978161c80 msgr2=0x7f29780b8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.112+0000 7f2977fff640 1 --2- 172.21.15.19:0/1196352859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2978161c80 0x7f29780b8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.112+0000 7f2977fff640 1 -- 172.21.15.19:0/1196352859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2978162060 msgr2=0x7f2978160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.112+0000 7f2977fff640 1 --2- 172.21.15.19:0/1196352859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2978162060 0x7f2978160070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.112+0000 7f2977fff640 1 -- 172.21.15.19:0/1196352859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29780c8e40 con 0x7f29780b64b0 2024-09-12T02:02:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.112+0000 7f29777fe640 1 --2- 172.21.15.19:0/1196352859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2978161c80 0x7f29780b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.112+0000 7f2977fff640 1 --2- 172.21.15.19:0/1196352859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29780b64b0 0x7f29781f3d10 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f296800c4d0 tx=0x7f296800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.112+0000 7f2974ff9640 1 -- 172.21.15.19:0/1196352859 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2968018070 con 0x7f29780b64b0 2024-09-12T02:02:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.112+0000 7f2974ff9640 1 -- 172.21.15.19:0/1196352859 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2968007500 con 0x7f29780b64b0 2024-09-12T02:02:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.112+0000 7f297e9e4640 1 -- 172.21.15.19:0/1196352859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29780c9120 con 0x7f29780b64b0 2024-09-12T02:02:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.112+0000 7f2974ff9640 1 -- 172.21.15.19:0/1196352859 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2968004a20 con 0x7f29780b64b0 2024-09-12T02:02:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.112+0000 7f297e9e4640 1 -- 172.21.15.19:0/1196352859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29780c96e0 con 0x7f29780b64b0 2024-09-12T02:02:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.113+0000 7f297e9e4640 1 -- 172.21.15.19:0/1196352859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29780c9ac0 con 0x7f29780b64b0 2024-09-12T02:02:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.114+0000 7f2974ff9640 1 -- 172.21.15.19:0/1196352859 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f296801b070 con 0x7f29780b64b0 2024-09-12T02:02:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.115+0000 7f2974ff9640 1 --2- 172.21.15.19:0/1196352859 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f296406be30 0x7f296406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.115+0000 7f2974ff9640 1 -- 172.21.15.19:0/1196352859 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f296808a460 con 0x7f29780b64b0 2024-09-12T02:02:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.115+0000 7f29777fe640 1 --2- 172.21.15.19:0/1196352859 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f296406be30 0x7f296406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.115+0000 7f29777fe640 1 --2- 172.21.15.19:0/1196352859 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f296406be30 0x7f296406e2f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f296c034000 tx=0x7f296c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:28.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.119+0000 7f2974ff9640 1 -- 172.21.15.19:0/1196352859 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29780c9ac0 con 0x7f29780b64b0 2024-09-12T02:02:28.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.333+0000 7f297e9e4640 1 -- 172.21.15.19:0/1196352859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f29780b5f70 con 0x7f29780b64b0 2024-09-12T02:02:28.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.367+0000 7f2974ff9640 1 -- 172.21.15.19:0/1196352859 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v79) ==== 161+0+0 (secure 0 0 0) 0x7f2968058b90 con 0x7f29780b64b0 2024-09-12T02:02:28.367 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:02:28.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.369+0000 7f297e9e4640 1 -- 172.21.15.19:0/1196352859 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f296406be30 msgr2=0x7f296406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:28.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.369+0000 7f297e9e4640 1 --2- 172.21.15.19:0/1196352859 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f296406be30 0x7f296406e2f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f296c034000 tx=0x7f296c02e000 comp rx=0 tx=0).stop 2024-09-12T02:02:28.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.369+0000 7f297e9e4640 1 -- 172.21.15.19:0/1196352859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29780b64b0 msgr2=0x7f29781f3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:28.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.369+0000 7f297e9e4640 1 --2- 172.21.15.19:0/1196352859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29780b64b0 0x7f29781f3d10 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f296800c4d0 tx=0x7f296800c990 comp rx=0 tx=0).stop 2024-09-12T02:02:28.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.369+0000 7f297e9e4640 1 -- 172.21.15.19:0/1196352859 shutdown_connections 2024-09-12T02:02:28.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.369+0000 7f297e9e4640 1 --2- 172.21.15.19:0/1196352859 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f296406be30 0x7f296406e2f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:28.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.369+0000 7f297e9e4640 1 --2- 172.21.15.19:0/1196352859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2978162060 0x7f2978160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:28.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.369+0000 7f297e9e4640 1 --2- 172.21.15.19:0/1196352859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2978161c80 0x7f29780b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:28.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.369+0000 7f297e9e4640 1 --2- 172.21.15.19:0/1196352859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29780b64b0 0x7f29781f3d10 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:28.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.369+0000 7f297e9e4640 1 -- 172.21.15.19:0/1196352859 >> 172.21.15.19:0/1196352859 conn(0x7f29780d44f0 msgr2=0x7f29780b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:28.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.369+0000 7f297e9e4640 1 -- 172.21.15.19:0/1196352859 shutdown_connections 2024-09-12T02:02:28.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.369+0000 7f297e9e4640 1 -- 172.21.15.19:0/1196352859 wait complete. 2024-09-12T02:02:28.380 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:02:28.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.483+0000 7f5565178640 1 Processor -- start 2024-09-12T02:02:28.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.483+0000 7f5565178640 1 -- start start 2024-09-12T02:02:28.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.484+0000 7f5565178640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55600b0180 0x7f5560162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:28.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.484+0000 7f5565178640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f556015eb60 con 0x7f55600af280 2024-09-12T02:02:28.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.484+0000 7f5565178640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f556015ee40 con 0x7f55600b69d0 2024-09-12T02:02:28.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.484+0000 7f5565178640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f55600b6db0 con 0x7f55600b0180 2024-09-12T02:02:28.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.484+0000 7f555f59e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f55600af280 0x7f5560154d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33618/0 (socket says 172.21.15.19:33618) 2024-09-12T02:02:28.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.484+0000 7f555f59e640 1 -- 172.21.15.19:0/800692086 learned_addr learned my addr 172.21.15.19:0/800692086 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:28.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.484+0000 7f555e59c640 1 --2- 172.21.15.19:0/800692086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55600b0180 0x7f5560162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:28.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.484+0000 7f555dd9b640 1 -- 172.21.15.19:0/800692086 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3620356734 0 0) 0x7f556015eb60 con 0x7f55600af280 2024-09-12T02:02:28.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.484+0000 7f555dd9b640 1 -- 172.21.15.19:0/800692086 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f554c003520 con 0x7f55600af280 2024-09-12T02:02:28.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555dd9b640 1 -- 172.21.15.19:0/800692086 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3316286580 0 0) 0x7f554c003520 con 0x7f55600af280 2024-09-12T02:02:28.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555dd9b640 1 -- 172.21.15.19:0/800692086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55600b0180 msgr2=0x7f5560162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:28.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555dd9b640 1 --2- 172.21.15.19:0/800692086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55600b0180 0x7f5560162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:28.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555dd9b640 1 -- 172.21.15.19:0/800692086 >> v1:172.21.15.135:6789/0 conn(0x7f55600b69d0 legacy=0x7f55600afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:28.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555dd9b640 1 -- 172.21.15.19:0/800692086 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556015f120 con 0x7f55600af280 2024-09-12T02:02:28.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555dd9b640 1 -- 172.21.15.19:0/800692086 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f5558001670 con 0x7f55600af280 2024-09-12T02:02:28.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555dd9b640 1 -- 172.21.15.19:0/800692086 >> v1:172.21.15.19:6789/0 conn(0x7f55600af280 legacy=0x7f5560154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:28.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555dd9b640 1 --2- 172.21.15.19:0/800692086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55600b0180 0x7f554c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:28.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555dd9b640 1 --2- 172.21.15.19:0/800692086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f554c003f40 0x7f554c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:28.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555dd9b640 1 --2- 172.21.15.19:0/800692086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f554c004d40 0x7f554c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:28.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555dd9b640 1 -- 172.21.15.19:0/800692086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f55600b6db0 con 0x7f554c003f40 2024-09-12T02:02:28.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555dd9b640 1 -- 172.21.15.19:0/800692086 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f554c00bb80 con 0x7f554c004d40 2024-09-12T02:02:28.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555dd9b640 1 -- 172.21.15.19:0/800692086 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f554c00bd80 con 0x7f55600b0180 2024-09-12T02:02:28.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555e59c640 1 --2- 172.21.15.19:0/800692086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f554c003f40 0x7f554c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:28.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555ed9d640 1 --2- 172.21.15.19:0/800692086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55600b0180 0x7f554c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:28.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555f59e640 1 --2- 172.21.15.19:0/800692086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f554c004d40 0x7f554c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:28.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555e59c640 1 -- 172.21.15.19:0/800692086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55600b0180 msgr2=0x7f554c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:28.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555e59c640 1 --2- 172.21.15.19:0/800692086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55600b0180 0x7f554c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:28.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555e59c640 1 -- 172.21.15.19:0/800692086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f554c004d40 msgr2=0x7f554c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:28.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555e59c640 1 --2- 172.21.15.19:0/800692086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f554c004d40 0x7f554c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:28.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.485+0000 7f555e59c640 1 -- 172.21.15.19:0/800692086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554c003520 con 0x7f554c003f40 2024-09-12T02:02:28.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.486+0000 7f555e59c640 1 --2- 172.21.15.19:0/800692086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f554c003f40 0x7f554c004800 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f5548009ac0 tx=0x7f554c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490a325754b663aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:28.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.486+0000 7f555dd9b640 1 -- 172.21.15.19:0/800692086 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5548036070 con 0x7f554c003f40 2024-09-12T02:02:28.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.486+0000 7f555dd9b640 1 -- 172.21.15.19:0/800692086 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5548031400 con 0x7f554c003f40 2024-09-12T02:02:28.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.486+0000 7f555dd9b640 1 -- 172.21.15.19:0/800692086 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5548009690 con 0x7f554c003f40 2024-09-12T02:02:28.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.486+0000 7f5565178640 1 -- 172.21.15.19:0/800692086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f554c003f40 msgr2=0x7f554c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:28.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.486+0000 7f5565178640 1 --2- 172.21.15.19:0/800692086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f554c003f40 0x7f554c004800 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f5548009ac0 tx=0x7f554c005830 comp rx=0 tx=0).stop 2024-09-12T02:02:28.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.486+0000 7f555f59e640 1 -- 172.21.15.19:0/800692086 reap_dead start 2024-09-12T02:02:28.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.486+0000 7f5565178640 1 -- 172.21.15.19:0/800692086 shutdown_connections 2024-09-12T02:02:28.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.486+0000 7f5565178640 1 -- 172.21.15.19:0/800692086 >> 172.21.15.19:0/800692086 conn(0x7f556006bc10 msgr2=0x7f556006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:28.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.487+0000 7f5565178640 1 -- 172.21.15.19:0/800692086 shutdown_connections 2024-09-12T02:02:28.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.487+0000 7f5565178640 1 -- 172.21.15.19:0/800692086 wait complete. 2024-09-12T02:02:28.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.488+0000 7f5565178640 1 Processor -- start 2024-09-12T02:02:28.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.488+0000 7f5565178640 1 -- start start 2024-09-12T02:02:28.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.489+0000 7f5565178640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f554c003f40 0x7f55601f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:28.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.489+0000 7f5565178640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5560160d00 0x7f55601e8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:28.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.489+0000 7f5565178640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55601e8870 0x7f55601586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:28.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.489+0000 7f5565178640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f556006f870 con 0x7f554c003f40 2024-09-12T02:02:28.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.489+0000 7f5565178640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55600af6f0 con 0x7f55601e8870 2024-09-12T02:02:28.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.489+0000 7f5565178640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f556006f9f0 con 0x7f5560160d00 2024-09-12T02:02:28.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.489+0000 7f555ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f554c003f40 0x7f55601f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:28.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.489+0000 7f555ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f554c003f40 0x7f55601f7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51740/0 (socket says 172.21.15.19:51740) 2024-09-12T02:02:28.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.489+0000 7f555ed9d640 1 -- 172.21.15.19:0/616249254 learned_addr learned my addr 172.21.15.19:0/616249254 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:28.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.489+0000 7f555e59c640 1 --2- 172.21.15.19:0/616249254 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5560160d00 0x7f55601e8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:28.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.489+0000 7f555f59e640 1 --2- 172.21.15.19:0/616249254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55601e8870 0x7f55601586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:28.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.489+0000 7f555ed9d640 1 -- 172.21.15.19:0/616249254 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5560160d00 msgr2=0x7f55601e8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:28.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.489+0000 7f555ed9d640 1 --2- 172.21.15.19:0/616249254 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5560160d00 0x7f55601e8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:28.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.489+0000 7f555ed9d640 1 -- 172.21.15.19:0/616249254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55601e8870 msgr2=0x7f55601586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:28.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.489+0000 7f555ed9d640 1 --2- 172.21.15.19:0/616249254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55601e8870 0x7f55601586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:28.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.489+0000 7f555ed9d640 1 -- 172.21.15.19:0/616249254 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55601e9c10 con 0x7f554c003f40 2024-09-12T02:02:28.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.489+0000 7f555ed9d640 1 --2- 172.21.15.19:0/616249254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f554c003f40 0x7f55601f7cc0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f555000fb90 tx=0x7f555000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:28.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.490+0000 7f55577fe640 1 -- 172.21.15.19:0/616249254 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550003b80 con 0x7f554c003f40 2024-09-12T02:02:28.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.490+0000 7f55577fe640 1 -- 172.21.15.19:0/616249254 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5550018070 con 0x7f554c003f40 2024-09-12T02:02:28.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.490+0000 7f55577fe640 1 -- 172.21.15.19:0/616249254 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555000d910 con 0x7f554c003f40 2024-09-12T02:02:28.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.490+0000 7f5565178640 1 -- 172.21.15.19:0/616249254 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55601e9ef0 con 0x7f554c003f40 2024-09-12T02:02:28.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.490+0000 7f5565178640 1 -- 172.21.15.19:0/616249254 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55601ea4b0 con 0x7f554c003f40 2024-09-12T02:02:28.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.491+0000 7f5565178640 1 -- 172.21.15.19:0/616249254 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55601ea6b0 con 0x7f554c003f40 2024-09-12T02:02:28.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.491+0000 7f55577fe640 1 -- 172.21.15.19:0/616249254 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f555000dab0 con 0x7f554c003f40 2024-09-12T02:02:28.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.492+0000 7f55577fe640 1 --2- 172.21.15.19:0/616249254 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f554006be60 0x7f554006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:28.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.492+0000 7f55577fe640 1 -- 172.21.15.19:0/616249254 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f555008b100 con 0x7f554c003f40 2024-09-12T02:02:28.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.492+0000 7f555e59c640 1 --2- 172.21.15.19:0/616249254 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f554006be60 0x7f554006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:28.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.493+0000 7f555e59c640 1 --2- 172.21.15.19:0/616249254 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f554006be60 0x7f554006e320 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f5548033000 tx=0x7f5548008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:28.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.496+0000 7f55577fe640 1 -- 172.21.15.19:0/616249254 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f55601ea6b0 con 0x7f554c003f40 2024-09-12T02:02:28.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:28.743+0000 7f5565178640 1 -- 172.21.15.19:0/616249254 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f5560162a50 con 0x7f554c003f40 2024-09-12T02:02:29.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.372+0000 7f55577fe640 1 -- 172.21.15.19:0/616249254 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v80) ==== 107+0+0 (secure 0 0 0) 0x7f5550059960 con 0x7f554c003f40 2024-09-12T02:02:29.373 INFO:teuthology.orchestra.run.smithi019.stderr:nothing to do: rank is not damaged 2024-09-12T02:02:29.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.375+0000 7f5565178640 1 -- 172.21.15.19:0/616249254 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f554006be60 msgr2=0x7f554006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.375+0000 7f5565178640 1 --2- 172.21.15.19:0/616249254 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f554006be60 0x7f554006e320 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f5548033000 tx=0x7f5548008030 comp rx=0 tx=0).stop 2024-09-12T02:02:29.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.375+0000 7f5565178640 1 -- 172.21.15.19:0/616249254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f554c003f40 msgr2=0x7f55601f7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.375+0000 7f5565178640 1 --2- 172.21.15.19:0/616249254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f554c003f40 0x7f55601f7cc0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f555000fb90 tx=0x7f555000ff90 comp rx=0 tx=0).stop 2024-09-12T02:02:29.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.375+0000 7f5565178640 1 -- 172.21.15.19:0/616249254 shutdown_connections 2024-09-12T02:02:29.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.375+0000 7f5565178640 1 --2- 172.21.15.19:0/616249254 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f554006be60 0x7f554006e320 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.375+0000 7f5565178640 1 --2- 172.21.15.19:0/616249254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55601e8870 0x7f55601586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.375+0000 7f5565178640 1 --2- 172.21.15.19:0/616249254 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5560160d00 0x7f55601e8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.375+0000 7f5565178640 1 --2- 172.21.15.19:0/616249254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f554c003f40 0x7f55601f7cc0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.375+0000 7f5565178640 1 -- 172.21.15.19:0/616249254 >> 172.21.15.19:0/616249254 conn(0x7f556006bc10 msgr2=0x7f55600b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:29.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.375+0000 7f5565178640 1 -- 172.21.15.19:0/616249254 shutdown_connections 2024-09-12T02:02:29.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.375+0000 7f5565178640 1 -- 172.21.15.19:0/616249254 wait complete. 2024-09-12T02:02:29.389 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:02:29.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.435+0000 7fcaea0f6f40 1 Processor -- start 2024-09-12T02:02:29.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.435+0000 7fcaea0f6f40 1 -- start start 2024-09-12T02:02:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.436+0000 7fcaea0f6f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e858a0350 0x564e858e4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.436+0000 7fcaea0f6f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x564e858ce050 0x564e85955d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.436+0000 7fcaea0f6f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e85958080 0x564e85977d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.436+0000 7fcaea0f6f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564e857ef510 con 0x564e85958080 2024-09-12T02:02:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.436+0000 7fcaea0f6f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564e85848c50 con 0x564e858a0350 2024-09-12T02:02:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.436+0000 7fcaea0f6f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x564e8589cdc0 con 0x564e858ce050 2024-09-12T02:02:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.436+0000 7fcae83ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e85958080 0x564e85977d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.436+0000 7fcae83ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e85958080 0x564e85977d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51754/0 (socket says 172.21.15.19:51754) 2024-09-12T02:02:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.436+0000 7fcae83ed640 1 -- 172.21.15.19:0/2854933117 learned_addr learned my addr 172.21.15.19:0/2854933117 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.436+0000 7fcae83ed640 1 -- 172.21.15.19:0/2854933117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x564e858ce050 msgr2=0x564e85955d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.436+0000 7fcae83ed640 1 --2- 172.21.15.19:0/2854933117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x564e858ce050 0x564e85955d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.436+0000 7fcae83ed640 1 -- 172.21.15.19:0/2854933117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e858a0350 msgr2=0x564e858e4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.436+0000 7fcae83ed640 1 --2- 172.21.15.19:0/2854933117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e858a0350 0x564e858e4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.436+0000 7fcae83ed640 1 -- 172.21.15.19:0/2854933117 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e858e49a0 con 0x564e85958080 2024-09-12T02:02:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.437+0000 7fcae83ed640 1 --2- 172.21.15.19:0/2854933117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e85958080 0x564e85977d70 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fcae0025d40 tx=0x7fcae0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7c1099825bb8c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.437+0000 7fcae63e9640 1 -- 172.21.15.19:0/2854933117 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae006a070 con 0x564e85958080 2024-09-12T02:02:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.437+0000 7fcae63e9640 1 -- 172.21.15.19:0/2854933117 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae00517d0 con 0x564e85958080 2024-09-12T02:02:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.437+0000 7fcae63e9640 1 -- 172.21.15.19:0/2854933117 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0055040 con 0x564e85958080 2024-09-12T02:02:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.437+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/2854933117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e85958080 msgr2=0x564e85977d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.437+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/2854933117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e85958080 0x564e85977d70 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fcae0025d40 tx=0x7fcae0051000 comp rx=0 tx=0).stop 2024-09-12T02:02:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.437+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/2854933117 shutdown_connections 2024-09-12T02:02:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.437+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/2854933117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e85958080 0x564e85977d70 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.437+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/2854933117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x564e858ce050 0x564e85955d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.437+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/2854933117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e858a0350 0x564e858e4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.437+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/2854933117 >> 172.21.15.19:0/2854933117 conn(0x564e8589d9e0 msgr2=0x564e85976110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:29.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.437+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/2854933117 shutdown_connections 2024-09-12T02:02:29.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.437+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/2854933117 wait complete. 2024-09-12T02:02:29.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.438+0000 7fcaea0f6f40 1 Processor -- start 2024-09-12T02:02:29.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.438+0000 7fcaea0f6f40 1 -- start start 2024-09-12T02:02:29.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.439+0000 7fcaea0f6f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e858a0350 0x564e85954da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.439+0000 7fcaea0f6f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x564e858ce050 0x564e8595a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.439+0000 7fcaea0f6f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e85958080 0x564e85a0f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.439+0000 7fcaea0f6f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564e859740a0 con 0x564e858a0350 2024-09-12T02:02:29.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.439+0000 7fcaea0f6f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564e859757a0 con 0x564e85958080 2024-09-12T02:02:29.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.439+0000 7fcaea0f6f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x564e85974380 con 0x564e858ce050 2024-09-12T02:02:29.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.439+0000 7fcae7bec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e858a0350 0x564e85954da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.439+0000 7fcae7bec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e858a0350 0x564e85954da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51768/0 (socket says 172.21.15.19:51768) 2024-09-12T02:02:29.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.439+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 learned_addr learned my addr 172.21.15.19:0/1393269410 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:29.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.439+0000 7fcae83ed640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e85958080 0x564e85a0f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.439+0000 7fcae73eb640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x564e858ce050 0x564e8595a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.439+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x564e858ce050 msgr2=0x564e8595a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.439+0000 7fcae7bec640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x564e858ce050 0x564e8595a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.439+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e85958080 msgr2=0x564e85a0f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.439+0000 7fcae7bec640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e85958080 0x564e85a0f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.439+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e858e2e00 con 0x564e858a0350 2024-09-12T02:02:29.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.439+0000 7fcae7bec640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e858a0350 0x564e85954da0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fcad8006fc0 tx=0x7fcad800b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:29.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.439+0000 7fcae53e7640 1 -- 172.21.15.19:0/1393269410 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad80062d0 con 0x564e858a0350 2024-09-12T02:02:29.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.440+0000 7fcae53e7640 1 -- 172.21.15.19:0/1393269410 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad8003450 con 0x564e858a0350 2024-09-12T02:02:29.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.440+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e858e30e0 con 0x564e858a0350 2024-09-12T02:02:29.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.440+0000 7fcae53e7640 1 -- 172.21.15.19:0/1393269410 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad80038c0 con 0x564e858a0350 2024-09-12T02:02:29.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.440+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e85a0eca0 con 0x564e858a0350 2024-09-12T02:02:29.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.441+0000 7fcae53e7640 1 -- 172.21.15.19:0/1393269410 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcad8010070 con 0x564e858a0350 2024-09-12T02:02:29.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.441+0000 7fcae53e7640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcad406a9b0 0x7fcad406ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.442+0000 7fcae53e7640 1 -- 172.21.15.19:0/1393269410 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7fcad8089710 con 0x564e858a0350 2024-09-12T02:02:29.444 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:02:29.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.442+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x564e8589ddc0 0x564e85958460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.442+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85973410 con 0x564e8589ddc0 2024-09-12T02:02:29.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.442+0000 7fcae73eb640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcad406a9b0 0x7fcad406ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.442+0000 7fcae83ed640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x564e8589ddc0 0x564e85958460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.442+0000 7fcae83ed640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x564e8589ddc0 0x564e85958460 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:29.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.442+0000 7fcae73eb640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcad406a9b0 0x7fcad406ce70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x564e85973f60 tx=0x7fcadc001710 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:29.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.443+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v94'11 uv6 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.443+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e858e4460 con 0x564e8589ddc0 2024-09-12T02:02:29.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.445+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v94'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.445+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e859589a0 con 0x564e8589ddc0 2024-09-12T02:02:29.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.447+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v94'13 uv13 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.447 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:02:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.447+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a18e00 con 0x564e8589ddc0 2024-09-12T02:02:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.448+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v94'14 uv14 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.448+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a191a0 con 0x564e8589ddc0 2024-09-12T02:02:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.451+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v94'15 uv15 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.451+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a17df0 con 0x564e8589ddc0 2024-09-12T02:02:29.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.453+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v94'16 uv16 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.453+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a181b0 con 0x564e8589ddc0 2024-09-12T02:02:29.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.456+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v94'17 uv7 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.456+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a181b0 con 0x564e8589ddc0 2024-09-12T02:02:29.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.458+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v94'18 uv18 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.458+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a181b0 con 0x564e8589ddc0 2024-09-12T02:02:29.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.461+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v94'19 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.461 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:02:29.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.461+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a181b0 con 0x564e8589ddc0 2024-09-12T02:02:29.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.464+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v94'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.464+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a181b0 con 0x564e8589ddc0 2024-09-12T02:02:29.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.467+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v94'21 uv21 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.467+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a181b0 con 0x564e8589ddc0 2024-09-12T02:02:29.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.469+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v94'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.469+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a181b0 con 0x564e8589ddc0 2024-09-12T02:02:29.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.470+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v94'23 uv10 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.470+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a181b0 con 0x564e8589ddc0 2024-09-12T02:02:29.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.473+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v94'24 uv24 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.473+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a181b0 con 0x564e8589ddc0 2024-09-12T02:02:29.476 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:02:29.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.476+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v94'25 uv25 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.476+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a181b0 con 0x564e8589ddc0 2024-09-12T02:02:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.479+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v94'26 uv26 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.479+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a181b0 con 0x564e8589ddc0 2024-09-12T02:02:29.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.481+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v94'27 uv27 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.481+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a181b0 con 0x564e8589ddc0 2024-09-12T02:02:29.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.484+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v94'28 uv28 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.484+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a18570 con 0x564e8589ddc0 2024-09-12T02:02:29.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.487+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v94'29 uv29 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.487+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a18570 con 0x564e8589ddc0 2024-09-12T02:02:29.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.489+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v94'30 uv5 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.490+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e8595a7f0 con 0x564e8589ddc0 2024-09-12T02:02:29.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.491+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v94'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.491+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e8595a7f0 con 0x564e8589ddc0 2024-09-12T02:02:29.492 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:02:29.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.492+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v94'32 uv32 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.492+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e8595a7f0 con 0x564e8589ddc0 2024-09-12T02:02:29.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.493+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v94'33 uv33 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.493+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e8595a7f0 con 0x564e8589ddc0 2024-09-12T02:02:29.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.494+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v94'34 uv34 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.494+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e8595a7f0 con 0x564e8589ddc0 2024-09-12T02:02:29.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.495+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v94'35 uv35 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.495+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e8595a7f0 con 0x564e8589ddc0 2024-09-12T02:02:29.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.496+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v94'36 uv8 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.496+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e8595a7f0 con 0x564e8589ddc0 2024-09-12T02:02:29.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.497+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v94'37 uv37 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.497+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a18460 con 0x564e8589ddc0 2024-09-12T02:02:29.498 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:02:29.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.498+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v94'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.498+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a18460 con 0x564e8589ddc0 2024-09-12T02:02:29.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.499+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v94'39 uv39 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.499+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a18460 con 0x564e8589ddc0 2024-09-12T02:02:29.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.500+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v94'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.500+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a18460 con 0x564e8589ddc0 2024-09-12T02:02:29.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.501+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v94'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e8589ddc0 2024-09-12T02:02:29.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.501+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x564e85a18460 0x564e85a1b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.501+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1ba90 con 0x564e85a18460 2024-09-12T02:02:29.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.501+0000 7fcae7bec640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x564e85a18460 0x564e85a1b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.502+0000 7fcae7bec640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x564e85a18460 0x564e85a1b550 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:29.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.503+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v94'21 uv16 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.503+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1be30 con 0x564e85a18460 2024-09-12T02:02:29.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.504+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v94'22 uv22 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.504+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1c290 con 0x564e85a18460 2024-09-12T02:02:29.507 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:02:29.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.507+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v94'23 uv23 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.507+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1cb50 con 0x564e85a18460 2024-09-12T02:02:29.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.510+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v94'24 uv24 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.510+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1cef0 con 0x564e85a18460 2024-09-12T02:02:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.512+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v94'25 uv25 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.512+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1d290 con 0x564e85a18460 2024-09-12T02:02:29.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.515+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v94'26 uv20 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.515+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1d680 con 0x564e85a18460 2024-09-12T02:02:29.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.516+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v94'27 uv27 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.516+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1d680 con 0x564e85a18460 2024-09-12T02:02:29.517 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:02:29.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.517+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v94'28 uv28 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.517+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1d680 con 0x564e85a18460 2024-09-12T02:02:29.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.519+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v94'29 uv29 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.519+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1d680 con 0x564e85a18460 2024-09-12T02:02:29.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.520+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v94'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.520+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1d680 con 0x564e85a18460 2024-09-12T02:02:29.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.521+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v94'31 uv17 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.521+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1d680 con 0x564e85a18460 2024-09-12T02:02:29.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.522+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v94'32 uv32 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.522+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1d680 con 0x564e85a18460 2024-09-12T02:02:29.523 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:02:29.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.523+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v94'33 uv33 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.523+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1d680 con 0x564e85a18460 2024-09-12T02:02:29.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.524+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v94'34 uv34 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.524+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1d680 con 0x564e85a18460 2024-09-12T02:02:29.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.526+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v94'35 uv35 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.526+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1d680 con 0x564e85a18460 2024-09-12T02:02:29.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.527+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v94'36 uv2 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.527+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1d680 con 0x564e85a18460 2024-09-12T02:02:29.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.528+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v94'37 uv37 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.528+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1d680 con 0x564e85a18460 2024-09-12T02:02:29.529 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:02:29.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.529+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v94'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.529+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1e690 con 0x564e85a18460 2024-09-12T02:02:29.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.530+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v94'39 uv39 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.530+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1e690 con 0x564e85a18460 2024-09-12T02:02:29.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.531+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v94'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.531+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a1d680 con 0x564e85a18460 2024-09-12T02:02:29.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.532+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v94'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a18460 2024-09-12T02:02:29.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.533+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x564e85a1df50 0x564e85a20340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.533+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a20880 con 0x564e85a1df50 2024-09-12T02:02:29.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.533+0000 7fcae73eb640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x564e85a1df50 0x564e85a20340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.533+0000 7fcae73eb640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x564e85a1df50 0x564e85a20340 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:29.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.534+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v94'3 uv2 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.534+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a20c80 con 0x564e85a1df50 2024-09-12T02:02:29.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.535+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v94'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.535+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a21160 con 0x564e85a1df50 2024-09-12T02:02:29.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.538+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v94'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.539 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:02:29.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.538+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a22a10 con 0x564e85a1df50 2024-09-12T02:02:29.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.541+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v94'6 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.541+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a22db0 con 0x564e85a1df50 2024-09-12T02:02:29.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.544+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v94'7 uv7 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.544+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a21a00 con 0x564e85a1df50 2024-09-12T02:02:29.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.547+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v94'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.547+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x564e85a22300 0x564e85a25160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.547+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a256a0 con 0x564e85a22300 2024-09-12T02:02:29.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.547+0000 7fcae83ed640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x564e85a22300 0x564e85a25160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.548+0000 7fcae83ed640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x564e85a22300 0x564e85a25160 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.549+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v94'3 uv2 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.549+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a256a0 con 0x564e85a22300 2024-09-12T02:02:29.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.550+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v94'4 uv4 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.550+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a256a0 con 0x564e85a22300 2024-09-12T02:02:29.552 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:02:29.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.551+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v94'5 uv5 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.552+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a25a90 con 0x564e85a22300 2024-09-12T02:02:29.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.553+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v94'6 uv6 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.553+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x564e85a25fa0 0x564e85a28390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.553+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28910 con 0x564e85a25fa0 2024-09-12T02:02:29.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.553+0000 7fcae7bec640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x564e85a25fa0 0x564e85a28390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.553+0000 7fcae7bec640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x564e85a25fa0 0x564e85a28390 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:29.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.555+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v94'3 uv2 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.555+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a25fa0 2024-09-12T02:02:29.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.556+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v94'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.556+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a25fa0 2024-09-12T02:02:29.557 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:02:29.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.557+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v94'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.557+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a29cf0 con 0x564e85a25fa0 2024-09-12T02:02:29.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.558+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v94'6 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.558+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a29cf0 con 0x564e85a25fa0 2024-09-12T02:02:29.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.560+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v94'7 uv7 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.560+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a25fa0 2024-09-12T02:02:29.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.561+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v94'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.561+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a22300 2024-09-12T02:02:29.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.562+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v94'4 uv2 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.562+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a22300 2024-09-12T02:02:29.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.563+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v94'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.563+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a22300 2024-09-12T02:02:29.564 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:02:29.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.564+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v94'6 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.564+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a22300 2024-09-12T02:02:29.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.565+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v94'7 uv7 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.565+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a22300 2024-09-12T02:02:29.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.566+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v94'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.566+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a22300 2024-09-12T02:02:29.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.567+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v94'9 uv9 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.567+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a22300 2024-09-12T02:02:29.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.570+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v94'10 uv3 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.570+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a22300 2024-09-12T02:02:29.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.571+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v94'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.571+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a22300 2024-09-12T02:02:29.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.572+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v94'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.572 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:02:29.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.572+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a22300 2024-09-12T02:02:29.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.578+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v94'13 uv13 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.578+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a22300 2024-09-12T02:02:29.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.580+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v94'14 uv14 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.580+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a22300 2024-09-12T02:02:29.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.582+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v94'2 uv1 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.582+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a22300 2024-09-12T02:02:29.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.584+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v94'3 uv3 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.584+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a22300 2024-09-12T02:02:29.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.587+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v94'4 uv4 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.588 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:02:29.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.587+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a22300 2024-09-12T02:02:29.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.590+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v94'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.590+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a22300 2024-09-12T02:02:29.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.592+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v94'6 uv6 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcae006d040 con 0x564e85a22300 2024-09-12T02:02:29.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.592+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a25fa0 2024-09-12T02:02:29.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.594+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v94'3 uv2 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.594+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a25fa0 2024-09-12T02:02:29.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.595+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v94'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.595+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a25fa0 2024-09-12T02:02:29.596 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:02:29.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.596+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v94'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.596+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a25fa0 2024-09-12T02:02:29.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.597+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v94'6 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.597+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a25fa0 2024-09-12T02:02:29.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.598+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v94'7 uv7 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.598+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a25fa0 2024-09-12T02:02:29.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.599+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v94'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.599+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a25fa0 2024-09-12T02:02:29.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.600+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v94'4 uv3 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.600+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a25fa0 2024-09-12T02:02:29.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.601+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v94'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.601+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a28ce0 con 0x564e85a25fa0 2024-09-12T02:02:29.602 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:02:29.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.602+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v94'6 uv6 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.602+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a290f0 con 0x564e85a25fa0 2024-09-12T02:02:29.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.603+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v94'7 uv7 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.603+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a290f0 con 0x564e85a25fa0 2024-09-12T02:02:29.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.604+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v94'8 uv8 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.604+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a290f0 con 0x564e85a25fa0 2024-09-12T02:02:29.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.605+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v94'9 uv1 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.605+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a290f0 con 0x564e85a25fa0 2024-09-12T02:02:29.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.606+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v94'10 uv10 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.606+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a290f0 con 0x564e85a25fa0 2024-09-12T02:02:29.607 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:02:29.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.607+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v94'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.607+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a290f0 con 0x564e85a25fa0 2024-09-12T02:02:29.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.609+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v94'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.609+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a294e0 con 0x564e85a25fa0 2024-09-12T02:02:29.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.612+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v94'13 uv13 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.612+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x564e85a29ba0 0x564e85a2bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.612+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c4d0 con 0x564e85a29ba0 2024-09-12T02:02:29.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.612+0000 7fcae73eb640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x564e85a29ba0 0x564e85a2bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.612+0000 7fcae73eb640 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x564e85a29ba0 0x564e85a2bf90 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:29.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.613+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v94'4 uv3 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a29ba0 2024-09-12T02:02:29.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.613+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a29ba0 2024-09-12T02:02:29.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.614+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v94'5 uv5 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a29ba0 2024-09-12T02:02:29.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.614+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a29ba0 2024-09-12T02:02:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.617+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v94'6 uv6 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a29ba0 2024-09-12T02:02:29.617 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:02:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.617+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a29ba0 2024-09-12T02:02:29.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.618+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v94'7 uv7 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a29ba0 2024-09-12T02:02:29.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.618+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a25fa0 2024-09-12T02:02:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.619+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v94'3 uv2 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.619+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a25fa0 2024-09-12T02:02:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.620+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v94'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.621+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a25fa0 2024-09-12T02:02:29.623 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:02:29.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.624+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v94'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.624+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2d880 con 0x564e85a25fa0 2024-09-12T02:02:29.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.626+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v94'6 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.626+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2d880 con 0x564e85a25fa0 2024-09-12T02:02:29.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.631+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v94'7 uv7 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.631+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a25fa0 2024-09-12T02:02:29.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.632+0000 7fcae7bec640 1 -- 172.21.15.19:0/1393269410 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v94'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad8019020 con 0x564e85a25fa0 2024-09-12T02:02:29.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.632+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a1df50 2024-09-12T02:02:29.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.635+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v94'2 uv1 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.635+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a1df50 2024-09-12T02:02:29.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.638+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v94'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.638+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a1df50 2024-09-12T02:02:29.641 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:02:29.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.640+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v94'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.640+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a1df50 2024-09-12T02:02:29.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.643+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v94'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.643+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a1df50 2024-09-12T02:02:29.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.646+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v94'6 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.646+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a1df50 2024-09-12T02:02:29.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.647+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v94'7 uv3 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.647+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a1df50 2024-09-12T02:02:29.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.648+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v94'8 uv8 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.648+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a1df50 2024-09-12T02:02:29.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.649+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v94'9 uv9 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.649 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:02:29.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.649+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a1df50 2024-09-12T02:02:29.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.650+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v94'10 uv10 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.650+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a1df50 2024-09-12T02:02:29.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.651+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v94'11 uv11 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.651+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a1df50 2024-09-12T02:02:29.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.651+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v94'12 uv6 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.651+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a1df50 2024-09-12T02:02:29.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.652+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v94'13 uv13 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.653+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a1df50 2024-09-12T02:02:29.653 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:02:29.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.653+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v94'14 uv14 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.653+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a1df50 2024-09-12T02:02:29.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.654+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v94'15 uv15 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.654+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a1df50 2024-09-12T02:02:29.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.655+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v94'16 uv16 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.655+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2c870 con 0x564e85a1df50 2024-09-12T02:02:29.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.656+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v94'17 uv17 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.656+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564e85a2cc60 con 0x564e85a1df50 2024-09-12T02:02:29.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcae73eb640 1 -- 172.21.15.19:0/1393269410 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v94'18 uv18 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcadc002050 con 0x564e85a1df50 2024-09-12T02:02:29.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x564e85a18460 msgr2=0x564e85a1b550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x564e85a18460 0x564e85a1b550 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x564e8589ddc0 msgr2=0x564e85958460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x564e8589ddc0 0x564e85958460 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x564e85a22300 msgr2=0x564e85a25160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x564e85a22300 0x564e85a25160 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x564e85a29ba0 msgr2=0x564e85a2bf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x564e85a29ba0 0x564e85a2bf90 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x564e85a1df50 msgr2=0x564e85a20340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x564e85a1df50 0x564e85a20340 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x564e85a25fa0 msgr2=0x564e85a28390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x564e85a25fa0 0x564e85a28390 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 reap_dead start 2024-09-12T02:02:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcae83ed640 1 -- 172.21.15.19:0/1393269410 reap_dead start 2024-09-12T02:02:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcad406a9b0 msgr2=0x7fcad406ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcad406a9b0 0x7fcad406ce70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x564e85973f60 tx=0x7fcadc001710 comp rx=0 tx=0).stop 2024-09-12T02:02:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e858a0350 msgr2=0x564e85954da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.657+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e858a0350 0x564e85954da0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fcad8006fc0 tx=0x7fcad800b570 comp rx=0 tx=0).stop 2024-09-12T02:02:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.658+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 shutdown_connections 2024-09-12T02:02:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.658+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcad406a9b0 0x7fcad406ce70 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.658+0000 7fcaea0f6f40 1 --2- 172.21.15.19:0/1393269410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e858a0350 0x564e85954da0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.658+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 >> 172.21.15.19:0/1393269410 conn(0x564e8589d9e0 msgr2=0x564e859745c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.658+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 shutdown_connections 2024-09-12T02:02:29.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.658+0000 7fcaea0f6f40 1 -- 172.21.15.19:0/1393269410 wait complete. 2024-09-12T02:02:29.662 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 10000000000.00000000 2024-09-12T02:02:29.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.745+0000 7faf39e3cf40 1 Processor -- start 2024-09-12T02:02:29.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.745+0000 7faf39e3cf40 1 -- start start 2024-09-12T02:02:29.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.746+0000 7faf39e3cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5570ab28f640 0x5570ab289710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.746+0000 7faf39e3cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5570ab31bd20 0x5570ab319e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.746+0000 7faf39e3cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570ab31c100 0x5570ab31cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.746+0000 7faf39e3cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5570ab198510 con 0x5570ab31bd20 2024-09-12T02:02:29.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.746+0000 7faf39e3cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5570ab1f1c50 con 0x5570ab31c100 2024-09-12T02:02:29.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.746+0000 7faf39e3cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5570ab2906b0 con 0x5570ab28f640 2024-09-12T02:02:29.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.746+0000 7faf37133640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5570ab31bd20 0x5570ab319e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.746+0000 7faf37133640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5570ab31bd20 0x5570ab319e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51784/0 (socket says 172.21.15.19:51784) 2024-09-12T02:02:29.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.746+0000 7faf37133640 1 -- 172.21.15.19:0/3454206679 learned_addr learned my addr 172.21.15.19:0/3454206679 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:29.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.746+0000 7faf37934640 1 --2- 172.21.15.19:0/3454206679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5570ab28f640 0x5570ab289710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.746+0000 7faf37133640 1 -- 172.21.15.19:0/3454206679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5570ab28f640 msgr2=0x5570ab289710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:29.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.746+0000 7faf38135640 1 --2- 172.21.15.19:0/3454206679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570ab31c100 0x5570ab31cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.746+0000 7faf37133640 1 --2- 172.21.15.19:0/3454206679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5570ab28f640 0x5570ab289710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.746+0000 7faf37133640 1 -- 172.21.15.19:0/3454206679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570ab31c100 msgr2=0x5570ab31cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:29.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.746+0000 7faf37133640 1 --2- 172.21.15.19:0/3454206679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570ab31c100 0x5570ab31cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.746+0000 7faf37133640 1 -- 172.21.15.19:0/3454206679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570ab289c50 con 0x5570ab31bd20 2024-09-12T02:02:29.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.746+0000 7faf38135640 1 --2- 172.21.15.19:0/3454206679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570ab31c100 0x5570ab31cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:29.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.747+0000 7faf37133640 1 --2- 172.21.15.19:0/3454206679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5570ab31bd20 0x5570ab319e00 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00b240 tx=0x7faf2c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482352246d3fbca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:29.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.747+0000 7faf36131640 1 -- 172.21.15.19:0/3454206679 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c008070 con 0x5570ab31bd20 2024-09-12T02:02:29.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.747+0000 7faf36131640 1 -- 172.21.15.19:0/3454206679 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf2c00d500 con 0x5570ab31bd20 2024-09-12T02:02:29.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.747+0000 7faf36131640 1 -- 172.21.15.19:0/3454206679 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00d8d0 con 0x5570ab31bd20 2024-09-12T02:02:29.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.747+0000 7faf39e3cf40 1 -- 172.21.15.19:0/3454206679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5570ab31bd20 msgr2=0x5570ab319e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.747+0000 7faf39e3cf40 1 --2- 172.21.15.19:0/3454206679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5570ab31bd20 0x5570ab319e00 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00b240 tx=0x7faf2c00b700 comp rx=0 tx=0).stop 2024-09-12T02:02:29.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.747+0000 7faf39e3cf40 1 -- 172.21.15.19:0/3454206679 shutdown_connections 2024-09-12T02:02:29.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.747+0000 7faf39e3cf40 1 --2- 172.21.15.19:0/3454206679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570ab31c100 0x5570ab31cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.747+0000 7faf39e3cf40 1 --2- 172.21.15.19:0/3454206679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5570ab31bd20 0x5570ab319e00 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.747+0000 7faf39e3cf40 1 --2- 172.21.15.19:0/3454206679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5570ab28f640 0x5570ab289710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.747+0000 7faf39e3cf40 1 -- 172.21.15.19:0/3454206679 >> 172.21.15.19:0/3454206679 conn(0x5570ab274490 msgr2=0x5570ab249e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:29.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.747+0000 7faf39e3cf40 1 -- 172.21.15.19:0/3454206679 shutdown_connections 2024-09-12T02:02:29.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.747+0000 7faf39e3cf40 1 -- 172.21.15.19:0/3454206679 wait complete. 2024-09-12T02:02:29.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.748+0000 7faf39e3cf40 1 Processor -- start 2024-09-12T02:02:29.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.748+0000 7faf39e3cf40 1 -- start start 2024-09-12T02:02:29.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf39e3cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5570ab28f640 0x5570ab3192f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf39e3cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5570ab31bd20 0x5570ab30ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf39e3cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570ab31c100 0x5570ab31cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf39e3cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5570ab28dd80 con 0x5570ab28f640 2024-09-12T02:02:29.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf39e3cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5570ab274e10 con 0x5570ab31c100 2024-09-12T02:02:29.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf39e3cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5570ab274b30 con 0x5570ab31bd20 2024-09-12T02:02:29.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf37934640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5570ab28f640 0x5570ab3192f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf37934640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5570ab28f640 0x5570ab3192f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51794/0 (socket says 172.21.15.19:51794) 2024-09-12T02:02:29.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf37934640 1 -- 172.21.15.19:0/3369805877 learned_addr learned my addr 172.21.15.19:0/3369805877 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:29.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf38135640 1 --2- 172.21.15.19:0/3369805877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570ab31c100 0x5570ab31cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf37133640 1 --2- 172.21.15.19:0/3369805877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5570ab31bd20 0x5570ab30ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf37934640 1 -- 172.21.15.19:0/3369805877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5570ab31bd20 msgr2=0x5570ab30ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf37934640 1 --2- 172.21.15.19:0/3369805877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5570ab31bd20 0x5570ab30ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf37934640 1 -- 172.21.15.19:0/3369805877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570ab31c100 msgr2=0x5570ab31cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf37934640 1 --2- 172.21.15.19:0/3369805877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570ab31c100 0x5570ab31cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf37934640 1 -- 172.21.15.19:0/3369805877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570ab28b010 con 0x5570ab28f640 2024-09-12T02:02:29.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf37934640 1 --2- 172.21.15.19:0/3369805877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5570ab28f640 0x5570ab3192f0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7faf28025cc0 tx=0x7faf28002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:29.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf3512f640 1 -- 172.21.15.19:0/3369805877 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28052bb0 con 0x5570ab28f640 2024-09-12T02:02:29.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.749+0000 7faf3512f640 1 -- 172.21.15.19:0/3369805877 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf28052d50 con 0x5570ab28f640 2024-09-12T02:02:29.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.750+0000 7faf39e3cf40 1 -- 172.21.15.19:0/3369805877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570ab245160 con 0x5570ab28f640 2024-09-12T02:02:29.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.750+0000 7faf3512f640 1 -- 172.21.15.19:0/3369805877 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28067660 con 0x5570ab28f640 2024-09-12T02:02:29.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.750+0000 7faf39e3cf40 1 -- 172.21.15.19:0/3369805877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570ab244e10 con 0x5570ab28f640 2024-09-12T02:02:29.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.751+0000 7faf3512f640 1 -- 172.21.15.19:0/3369805877 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf28059020 con 0x5570ab28f640 2024-09-12T02:02:29.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.751+0000 7faf3512f640 1 --2- 172.21.15.19:0/3369805877 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faf2406a810 0x7faf2406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.751+0000 7faf3512f640 1 -- 172.21.15.19:0/3369805877 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7faf280ce0b0 con 0x5570ab28f640 2024-09-12T02:02:29.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.752+0000 7faf37133640 1 --2- 172.21.15.19:0/3369805877 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faf2406a810 0x7faf2406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.752+0000 7faf39e3cf40 1 --2- 172.21.15.19:0/3369805877 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5570ab30f330 0x5570ab3b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.752+0000 7faf39e3cf40 1 -- 172.21.15.19:0/3369805877 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x5570ab3b61b0 con 0x5570ab30f330 2024-09-12T02:02:29.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.752+0000 7faf38135640 1 --2- 172.21.15.19:0/3369805877 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5570ab30f330 0x5570ab3b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.752+0000 7faf38135640 1 --2- 172.21.15.19:0/3369805877 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5570ab30f330 0x5570ab3b5c70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:29.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.752+0000 7faf37133640 1 --2- 172.21.15.19:0/3369805877 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faf2406a810 0x7faf2406ccd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x5570ab28fcf0 tx=0x7faf2c009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:29.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.753+0000 7faf38135640 1 -- 172.21.15.19:0/3369805877 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 10000000000.00000000 [delete] v94'42 uv42 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7faf3000c840 con 0x5570ab30f330 2024-09-12T02:02:29.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.753+0000 7faf39e3cf40 1 -- 172.21.15.19:0/3369805877 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5570ab30f330 msgr2=0x5570ab3b5c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.753+0000 7faf39e3cf40 1 --2- 172.21.15.19:0/3369805877 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5570ab30f330 0x5570ab3b5c70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.753+0000 7faf39e3cf40 1 -- 172.21.15.19:0/3369805877 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faf2406a810 msgr2=0x7faf2406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.753+0000 7faf39e3cf40 1 --2- 172.21.15.19:0/3369805877 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faf2406a810 0x7faf2406ccd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x5570ab28fcf0 tx=0x7faf2c009000 comp rx=0 tx=0).stop 2024-09-12T02:02:29.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.753+0000 7faf39e3cf40 1 -- 172.21.15.19:0/3369805877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5570ab28f640 msgr2=0x5570ab3192f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.753+0000 7faf39e3cf40 1 --2- 172.21.15.19:0/3369805877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5570ab28f640 0x5570ab3192f0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7faf28025cc0 tx=0x7faf28002fb0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.753+0000 7faf38135640 1 -- 172.21.15.19:0/3369805877 reap_dead start 2024-09-12T02:02:29.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.753+0000 7faf39e3cf40 1 -- 172.21.15.19:0/3369805877 shutdown_connections 2024-09-12T02:02:29.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.753+0000 7faf39e3cf40 1 -- 172.21.15.19:0/3369805877 >> 172.21.15.19:0/3369805877 conn(0x5570ab274490 msgr2=0x5570ab31dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:29.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.753+0000 7faf39e3cf40 1 -- 172.21.15.19:0/3369805877 shutdown_connections 2024-09-12T02:02:29.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.753+0000 7faf39e3cf40 1 -- 172.21.15.19:0/3369805877 wait complete. 2024-09-12T02:02:29.759 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:02:29.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.905+0000 7f2dd149b640 1 Processor -- start 2024-09-12T02:02:29.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.905+0000 7f2dd149b640 1 -- start start 2024-09-12T02:02:29.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.906+0000 7f2dd149b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2dcc161e60 0x7f2dcc0cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.906+0000 7f2dd149b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dcc06cac0 0x7f2dcc06cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.906+0000 7f2dd149b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dcc0ce010 con 0x7f2dcc0b3220 2024-09-12T02:02:29.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.906+0000 7f2dd149b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2dcc0ce2f0 con 0x7f2dcc161e60 2024-09-12T02:02:29.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.906+0000 7f2dd149b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2dcc0d0640 con 0x7f2dcc06cac0 2024-09-12T02:02:29.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.906+0000 7f2dcaffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2dcc161e60 0x7f2dcc0cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.906+0000 7f2dcaffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2dcc161e60 0x7f2dcc0cda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51810/0 (socket says 172.21.15.19:51810) 2024-09-12T02:02:29.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.906+0000 7f2dcaffd640 1 -- 172.21.15.19:0/3995794187 learned_addr learned my addr 172.21.15.19:0/3995794187 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:29.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.906+0000 7f2dcb7fe640 1 --2- 172.21.15.19:0/3995794187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dcc06cac0 0x7f2dcc06cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.907+0000 7f2dcaffd640 1 -- 172.21.15.19:0/3995794187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dcc06cac0 msgr2=0x7f2dcc06cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:29.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.907+0000 7f2dcaffd640 1 --2- 172.21.15.19:0/3995794187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dcc06cac0 0x7f2dcc06cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.907+0000 7f2dcaffd640 1 -- 172.21.15.19:0/3995794187 >> v1:172.21.15.135:6789/0 conn(0x7f2dcc0b3220 legacy=0x7f2dcc0d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.907+0000 7f2dcaffd640 1 -- 172.21.15.19:0/3995794187 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dcc0cfff0 con 0x7f2dcc161e60 2024-09-12T02:02:29.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.907+0000 7f2dcaffd640 1 --2- 172.21.15.19:0/3995794187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dcc161e60 0x7f2dcc0cda30 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40098a0 tx=0x7f2dc402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db77b2f1b12f0190 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:29.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.908+0000 7f2dc9ffb640 1 -- 172.21.15.19:0/3995794187 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4037070 con 0x7f2dcc161e60 2024-09-12T02:02:29.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.908+0000 7f2dc9ffb640 1 -- 172.21.15.19:0/3995794187 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc4032440 con 0x7f2dcc161e60 2024-09-12T02:02:29.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.908+0000 7f2dc9ffb640 1 -- 172.21.15.19:0/3995794187 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4032810 con 0x7f2dcc161e60 2024-09-12T02:02:29.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.908+0000 7f2dd149b640 1 -- 172.21.15.19:0/3995794187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dcc161e60 msgr2=0x7f2dcc0cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.908+0000 7f2dd149b640 1 --2- 172.21.15.19:0/3995794187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dcc161e60 0x7f2dcc0cda30 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40098a0 tx=0x7f2dc402a200 comp rx=0 tx=0).stop 2024-09-12T02:02:29.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.908+0000 7f2dd149b640 1 -- 172.21.15.19:0/3995794187 shutdown_connections 2024-09-12T02:02:29.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.908+0000 7f2dd149b640 1 --2- 172.21.15.19:0/3995794187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dcc06cac0 0x7f2dcc06cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.908+0000 7f2dd149b640 1 --2- 172.21.15.19:0/3995794187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dcc161e60 0x7f2dcc0cda30 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.908+0000 7f2dd149b640 1 -- 172.21.15.19:0/3995794187 >> 172.21.15.19:0/3995794187 conn(0x7f2dcc0b3de0 msgr2=0x7f2dcc0b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:29.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.908+0000 7f2dd149b640 1 -- 172.21.15.19:0/3995794187 shutdown_connections 2024-09-12T02:02:29.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.908+0000 7f2dd149b640 1 -- 172.21.15.19:0/3995794187 wait complete. 2024-09-12T02:02:29.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.909+0000 7f2dd149b640 1 Processor -- start 2024-09-12T02:02:29.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.910+0000 7f2dd149b640 1 -- start start 2024-09-12T02:02:29.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.910+0000 7f2dd149b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dcc06cac0 0x7f2dcc0b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.910+0000 7f2dd149b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dcc0b3220 0x7f2dcc0c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.910+0000 7f2dd149b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dcc161e60 0x7f2dcc09f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.910+0000 7f2dd149b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2dcc0d1360 con 0x7f2dcc0b3220 2024-09-12T02:02:29.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.910+0000 7f2dd149b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2dcc0d11e0 con 0x7f2dcc161e60 2024-09-12T02:02:29.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.910+0000 7f2dd149b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2dcc09b940 con 0x7f2dcc06cac0 2024-09-12T02:02:29.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.910+0000 7f2dca7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dcc0b3220 0x7f2dcc0c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.910+0000 7f2dca7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dcc0b3220 0x7f2dcc0c93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51814/0 (socket says 172.21.15.19:51814) 2024-09-12T02:02:29.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.910+0000 7f2dca7fc640 1 -- 172.21.15.19:0/2203129218 learned_addr learned my addr 172.21.15.19:0/2203129218 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:29.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.910+0000 7f2dcaffd640 1 --2- 172.21.15.19:0/2203129218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dcc06cac0 0x7f2dcc0b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.910+0000 7f2dcb7fe640 1 --2- 172.21.15.19:0/2203129218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dcc161e60 0x7f2dcc09f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.911+0000 7f2dca7fc640 1 -- 172.21.15.19:0/2203129218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dcc06cac0 msgr2=0x7f2dcc0b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.911+0000 7f2dca7fc640 1 --2- 172.21.15.19:0/2203129218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dcc06cac0 0x7f2dcc0b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.911+0000 7f2dca7fc640 1 -- 172.21.15.19:0/2203129218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dcc161e60 msgr2=0x7f2dcc09f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:29.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.911+0000 7f2dca7fc640 1 --2- 172.21.15.19:0/2203129218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dcc161e60 0x7f2dcc09f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:29.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.911+0000 7f2dca7fc640 1 -- 172.21.15.19:0/2203129218 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dcc15cc30 con 0x7f2dcc0b3220 2024-09-12T02:02:29.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.911+0000 7f2dca7fc640 1 --2- 172.21.15.19:0/2203129218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dcc0b3220 0x7f2dcc0c93c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c3c0 tx=0x7f2db400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:29.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.911+0000 7f2dc37fe640 1 -- 172.21.15.19:0/2203129218 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db40052d0 con 0x7f2dcc0b3220 2024-09-12T02:02:29.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.911+0000 7f2dc37fe640 1 -- 172.21.15.19:0/2203129218 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db4005490 con 0x7f2dcc0b3220 2024-09-12T02:02:29.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.911+0000 7f2dd149b640 1 -- 172.21.15.19:0/2203129218 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dcc09d420 con 0x7f2dcc0b3220 2024-09-12T02:02:29.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.911+0000 7f2dc37fe640 1 -- 172.21.15.19:0/2203129218 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4007260 con 0x7f2dcc0b3220 2024-09-12T02:02:29.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.911+0000 7f2dd149b640 1 -- 172.21.15.19:0/2203129218 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dcc09d9e0 con 0x7f2dcc0b3220 2024-09-12T02:02:29.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.912+0000 7f2dd149b640 1 -- 172.21.15.19:0/2203129218 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dcc0cda30 con 0x7f2dcc0b3220 2024-09-12T02:02:29.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.913+0000 7f2dc37fe640 1 -- 172.21.15.19:0/2203129218 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2db4007400 con 0x7f2dcc0b3220 2024-09-12T02:02:29.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.913+0000 7f2dc37fe640 1 --2- 172.21.15.19:0/2203129218 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dac06be30 0x7f2dac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:29.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.913+0000 7f2dc37fe640 1 -- 172.21.15.19:0/2203129218 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f2db408a3e0 con 0x7f2dcc0b3220 2024-09-12T02:02:29.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.913+0000 7f2dcaffd640 1 --2- 172.21.15.19:0/2203129218 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dac06be30 0x7f2dac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:29.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.914+0000 7f2dcaffd640 1 --2- 172.21.15.19:0/2203129218 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dac06be30 0x7f2dac06e2f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4034000 tx=0x7f2dc402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:29.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:29.918+0000 7f2dc37fe640 1 -- 172.21.15.19:0/2203129218 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2db40585f0 con 0x7f2dcc0b3220 2024-09-12T02:02:30.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.132+0000 7f2dd149b640 1 -- 172.21.15.19:0/2203129218 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f2dcc0cb210 con 0x7f2dcc0b3220 2024-09-12T02:02:30.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.378+0000 7f2dc37fe640 1 -- 172.21.15.19:0/2203129218 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v81) ==== 162+0+0 (secure 0 0 0) 0x7f2db405c8f0 con 0x7f2dcc0b3220 2024-09-12T02:02:30.379 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:02:30.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.380+0000 7f2dd149b640 1 -- 172.21.15.19:0/2203129218 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dac06be30 msgr2=0x7f2dac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:30.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.380+0000 7f2dd149b640 1 --2- 172.21.15.19:0/2203129218 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dac06be30 0x7f2dac06e2f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4034000 tx=0x7f2dc402e000 comp rx=0 tx=0).stop 2024-09-12T02:02:30.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.380+0000 7f2dd149b640 1 -- 172.21.15.19:0/2203129218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dcc0b3220 msgr2=0x7f2dcc0c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:30.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.380+0000 7f2dd149b640 1 --2- 172.21.15.19:0/2203129218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dcc0b3220 0x7f2dcc0c93c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c3c0 tx=0x7f2db400c880 comp rx=0 tx=0).stop 2024-09-12T02:02:30.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.380+0000 7f2dd149b640 1 -- 172.21.15.19:0/2203129218 shutdown_connections 2024-09-12T02:02:30.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.380+0000 7f2dd149b640 1 --2- 172.21.15.19:0/2203129218 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dac06be30 0x7f2dac06e2f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:30.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.380+0000 7f2dd149b640 1 --2- 172.21.15.19:0/2203129218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dcc161e60 0x7f2dcc09f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:30.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.380+0000 7f2dd149b640 1 --2- 172.21.15.19:0/2203129218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dcc0b3220 0x7f2dcc0c93c0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:30.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.380+0000 7f2dd149b640 1 --2- 172.21.15.19:0/2203129218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dcc06cac0 0x7f2dcc0b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:30.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.380+0000 7f2dd149b640 1 -- 172.21.15.19:0/2203129218 >> 172.21.15.19:0/2203129218 conn(0x7f2dcc0b3de0 msgr2=0x7f2dcc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:30.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.380+0000 7f2dd149b640 1 -- 172.21.15.19:0/2203129218 shutdown_connections 2024-09-12T02:02:30.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.380+0000 7f2dd149b640 1 -- 172.21.15.19:0/2203129218 wait complete. 2024-09-12T02:02:30.796 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:30.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.901+0000 7f09c6847640 1 Processor -- start 2024-09-12T02:02:30.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.901+0000 7f09c6847640 1 -- start start 2024-09-12T02:02:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.902+0000 7f09c6847640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f09c015e760 0x7f09c006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.902+0000 7f09c6847640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f09c00cfcc0 0x7f09c00d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.902+0000 7f09c6847640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09c00d2700 con 0x7f09c00d4fd0 2024-09-12T02:02:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.902+0000 7f09c6847640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f09c00cedb0 con 0x7f09c00cfcc0 2024-09-12T02:02:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.902+0000 7f09c6847640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f09c00cf090 con 0x7f09c015e760 2024-09-12T02:02:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.902+0000 7f09c4de4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f09c00cfcc0 0x7f09c00d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.902+0000 7f09c4de4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f09c00cfcc0 0x7f09c00d2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51822/0 (socket says 172.21.15.19:51822) 2024-09-12T02:02:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.902+0000 7f09c4de4640 1 -- 172.21.15.19:0/875163474 learned_addr learned my addr 172.21.15.19:0/875163474 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.902+0000 7f09bffff640 1 --2- 172.21.15.19:0/875163474 >> v2:172.21.15.135:3300/0 conn(0x7f09c015e760 0x7f09c006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.903+0000 7f09c4de4640 1 -- 172.21.15.19:0/875163474 >> v2:172.21.15.135:3300/0 conn(0x7f09c015e760 msgr2=0x7f09c006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.903+0000 7f09c4de4640 1 --2- 172.21.15.19:0/875163474 >> v2:172.21.15.135:3300/0 conn(0x7f09c015e760 0x7f09c006cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.903+0000 7f09c4de4640 1 -- 172.21.15.19:0/875163474 >> v1:172.21.15.19:6789/0 conn(0x7f09c00d4fd0 legacy=0x7f09c00cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.903+0000 7f09c4de4640 1 -- 172.21.15.19:0/875163474 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c00b3c80 con 0x7f09c00cfcc0 2024-09-12T02:02:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.903+0000 7f09beffd640 1 -- 172.21.15.19:0/875163474 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 952664938 0 0) 0x7f09b4001180 con 0x7f09c00d4fd0 2024-09-12T02:02:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.903+0000 7f09c4de4640 1 --2- 172.21.15.19:0/875163474 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09c00cfcc0 0x7f09c00d2ea0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f09c008ca50 tx=0x7f09b802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22883c95326268ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.904+0000 7f09beffd640 1 -- 172.21.15.19:0/875163474 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b8036070 con 0x7f09c00cfcc0 2024-09-12T02:02:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.904+0000 7f09beffd640 1 -- 172.21.15.19:0/875163474 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b8031600 con 0x7f09c00cfcc0 2024-09-12T02:02:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.904+0000 7f09beffd640 1 -- 172.21.15.19:0/875163474 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b80319d0 con 0x7f09c00cfcc0 2024-09-12T02:02:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.904+0000 7f09c6847640 1 -- 172.21.15.19:0/875163474 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09c00cfcc0 msgr2=0x7f09c00d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.904+0000 7f09c6847640 1 --2- 172.21.15.19:0/875163474 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09c00cfcc0 0x7f09c00d2ea0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f09c008ca50 tx=0x7f09b802a730 comp rx=0 tx=0).stop 2024-09-12T02:02:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.904+0000 7f09c6847640 1 -- 172.21.15.19:0/875163474 shutdown_connections 2024-09-12T02:02:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.904+0000 7f09c6847640 1 --2- 172.21.15.19:0/875163474 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09c00cfcc0 0x7f09c00d2ea0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.904+0000 7f09c6847640 1 --2- 172.21.15.19:0/875163474 >> v2:172.21.15.135:3300/0 conn(0x7f09c015e760 0x7f09c006cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.904+0000 7f09c6847640 1 -- 172.21.15.19:0/875163474 >> 172.21.15.19:0/875163474 conn(0x7f09c008bfc0 msgr2=0x7f09c00d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.904+0000 7f09c6847640 1 -- 172.21.15.19:0/875163474 shutdown_connections 2024-09-12T02:02:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.904+0000 7f09c6847640 1 -- 172.21.15.19:0/875163474 wait complete. 2024-09-12T02:02:30.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.905+0000 7f09c6847640 1 Processor -- start 2024-09-12T02:02:30.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.906+0000 7f09c6847640 1 -- start start 2024-09-12T02:02:30.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.906+0000 7f09c6847640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09c00cfcc0 0x7f09c0156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:30.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.906+0000 7f09c6847640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09c00d4fd0 0x7f09c00b8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:30.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.906+0000 7f09c6847640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09c015e760 0x7f09c01544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:30.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.906+0000 7f09c6847640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f09c00d33e0 con 0x7f09c00d4fd0 2024-09-12T02:02:30.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.906+0000 7f09c6847640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f09c00b38e0 con 0x7f09c00cfcc0 2024-09-12T02:02:30.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.906+0000 7f09c6847640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f09c00d3560 con 0x7f09c015e760 2024-09-12T02:02:30.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.906+0000 7f09bf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09c00d4fd0 0x7f09c00b8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:30.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.906+0000 7f09bf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09c00d4fd0 0x7f09c00b8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51828/0 (socket says 172.21.15.19:51828) 2024-09-12T02:02:30.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.906+0000 7f09bf7fe640 1 -- 172.21.15.19:0/2601596247 learned_addr learned my addr 172.21.15.19:0/2601596247 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:30.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.907+0000 7f09bffff640 1 --2- 172.21.15.19:0/2601596247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09c00cfcc0 0x7f09c0156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:30.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.907+0000 7f09c4de4640 1 --2- 172.21.15.19:0/2601596247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09c015e760 0x7f09c01544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:30.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.907+0000 7f09bf7fe640 1 -- 172.21.15.19:0/2601596247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09c015e760 msgr2=0x7f09c01544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:30.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.907+0000 7f09bf7fe640 1 --2- 172.21.15.19:0/2601596247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09c015e760 0x7f09c01544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:30.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.907+0000 7f09bf7fe640 1 -- 172.21.15.19:0/2601596247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09c00cfcc0 msgr2=0x7f09c0156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:30.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.907+0000 7f09bf7fe640 1 --2- 172.21.15.19:0/2601596247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09c00cfcc0 0x7f09c0156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:30.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.907+0000 7f09bf7fe640 1 -- 172.21.15.19:0/2601596247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c00b7380 con 0x7f09c00d4fd0 2024-09-12T02:02:30.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.907+0000 7f09bf7fe640 1 --2- 172.21.15.19:0/2601596247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09c00d4fd0 0x7f09c00b8700 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f09b400c480 tx=0x7f09b400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:30.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.907+0000 7f09bcff9640 1 -- 172.21.15.19:0/2601596247 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b4017070 con 0x7f09c00d4fd0 2024-09-12T02:02:30.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.907+0000 7f09bcff9640 1 -- 172.21.15.19:0/2601596247 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b40035f0 con 0x7f09c00d4fd0 2024-09-12T02:02:30.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.907+0000 7f09c6847640 1 -- 172.21.15.19:0/2601596247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c00b7660 con 0x7f09c00d4fd0 2024-09-12T02:02:30.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.907+0000 7f09bcff9640 1 -- 172.21.15.19:0/2601596247 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b40039e0 con 0x7f09c00d4fd0 2024-09-12T02:02:30.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.907+0000 7f09c6847640 1 -- 172.21.15.19:0/2601596247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c00b7c20 con 0x7f09c00d4fd0 2024-09-12T02:02:30.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.908+0000 7f09c6847640 1 -- 172.21.15.19:0/2601596247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09c00d3890 con 0x7f09c00d4fd0 2024-09-12T02:02:30.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.908+0000 7f09bcff9640 1 -- 172.21.15.19:0/2601596247 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f09b401a070 con 0x7f09c00d4fd0 2024-09-12T02:02:30.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.909+0000 7f09bcff9640 1 --2- 172.21.15.19:0/2601596247 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f09ac06be30 0x7f09ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:30.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.909+0000 7f09bcff9640 1 -- 172.21.15.19:0/2601596247 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f09b408a3c0 con 0x7f09c00d4fd0 2024-09-12T02:02:30.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.909+0000 7f09bffff640 1 --2- 172.21.15.19:0/2601596247 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f09ac06be30 0x7f09ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:30.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.910+0000 7f09bffff640 1 --2- 172.21.15.19:0/2601596247 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f09ac06be30 0x7f09ac06e2f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f09b0006fd0 tx=0x7f09b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:30.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:30.913+0000 7f09bcff9640 1 -- 172.21.15.19:0/2601596247 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f09c00d2700 con 0x7f09c00d4fd0 2024-09-12T02:02:31.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:31.123+0000 7f09c6847640 1 -- 172.21.15.19:0/2601596247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09c00b6d20 con 0x7f09c00d4fd0 2024-09-12T02:02:31.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:31.124+0000 7f09bcff9640 1 -- 172.21.15.19:0/2601596247 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5219 (secure 0 0 0) 0x7f09b4058c20 con 0x7f09c00d4fd0 2024-09-12T02:02:31.125 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:31.125 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":82,"btime":"2024-09-12T02:02:30:384164+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1101861733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1101861733},{"type":"v1","addr":"172.21.15.135:6837","nonce":1101861733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:02:30.384147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6436":{"gid":6436,"name":"c","rank":0,"incarnation":82,"state":"up:replay","state_seq":1,"addr":"172.21.15.19:6834/613869354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":613869354},{"type":"v1","addr":"172.21.15.19:6834","nonce":613869354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:02:31.125 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 82 2024-09-12T02:02:31.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:31.126+0000 7f09c6847640 1 -- 172.21.15.19:0/2601596247 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f09ac06be30 msgr2=0x7f09ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:31.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:31.126+0000 7f09c6847640 1 --2- 172.21.15.19:0/2601596247 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f09ac06be30 0x7f09ac06e2f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f09b0006fd0 tx=0x7f09b0008040 comp rx=0 tx=0).stop 2024-09-12T02:02:31.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:31.126+0000 7f09c6847640 1 -- 172.21.15.19:0/2601596247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09c00d4fd0 msgr2=0x7f09c00b8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:31.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:31.126+0000 7f09c6847640 1 --2- 172.21.15.19:0/2601596247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09c00d4fd0 0x7f09c00b8700 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f09b400c480 tx=0x7f09b400c940 comp rx=0 tx=0).stop 2024-09-12T02:02:31.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:31.126+0000 7f09c6847640 1 -- 172.21.15.19:0/2601596247 shutdown_connections 2024-09-12T02:02:31.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:31.126+0000 7f09c6847640 1 --2- 172.21.15.19:0/2601596247 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f09ac06be30 0x7f09ac06e2f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:31.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:31.126+0000 7f09c6847640 1 --2- 172.21.15.19:0/2601596247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09c015e760 0x7f09c01544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:31.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:31.126+0000 7f09c6847640 1 --2- 172.21.15.19:0/2601596247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09c00d4fd0 0x7f09c00b8700 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:31.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:31.126+0000 7f09c6847640 1 --2- 172.21.15.19:0/2601596247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09c00cfcc0 0x7f09c0156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:31.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:31.126+0000 7f09c6847640 1 -- 172.21.15.19:0/2601596247 >> 172.21.15.19:0/2601596247 conn(0x7f09c008bfc0 msgr2=0x7f09c00b2300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:31.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:31.126+0000 7f09c6847640 1 -- 172.21.15.19:0/2601596247 shutdown_connections 2024-09-12T02:02:31.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:31.126+0000 7f09c6847640 1 -- 172.21.15.19:0/2601596247 wait complete. 2024-09-12T02:02:31.138 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 82, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:02:30.384147+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 94, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6436}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6436': {'gid': 6436, 'name': 'c', 'rank': 0, 'incarnation': 82, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.19:6834/613869354', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 613869354}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 613869354}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:02:31.138 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6436:up:replay 2024-09-12T02:02:31.138 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-12T02:02:33.618 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:02:33.617+0000 7f0662bd7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:02:36.541 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:36.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.656+0000 7f2b25a77640 1 Processor -- start 2024-09-12T02:02:36.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.656+0000 7f2b25a77640 1 -- start start 2024-09-12T02:02:36.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.657+0000 7f2b25a77640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2b20161c80 0x7f2b2006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:36.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.657+0000 7f2b25a77640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b20162060 0x7f2b200b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:36.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.657+0000 7f2b25a77640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b2006e870 con 0x7f2b200b64b0 2024-09-12T02:02:36.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.657+0000 7f2b25a77640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2b2006d9f0 con 0x7f2b20162060 2024-09-12T02:02:36.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.657+0000 7f2b25a77640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f2b2006dcd0 con 0x7f2b20161c80 2024-09-12T02:02:36.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.657+0000 7f2b16ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b20162060 0x7f2b200b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:36.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.657+0000 7f2b1ffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2b200b64b0 0x7f2b20162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34030/0 (socket says 172.21.15.19:34030) 2024-09-12T02:02:36.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.657+0000 7f2b1ffff640 1 -- 172.21.15.19:0/3852983150 learned_addr learned my addr 172.21.15.19:0/3852983150 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:36.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.657+0000 7f2b1f7fe640 1 --2- 172.21.15.19:0/3852983150 >> v2:172.21.15.135:3300/0 conn(0x7f2b20161c80 0x7f2b2006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:36.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.658+0000 7f2b16ffd640 1 -- 172.21.15.19:0/3852983150 >> v2:172.21.15.135:3300/0 conn(0x7f2b20161c80 msgr2=0x7f2b2006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:36.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.658+0000 7f2b16ffd640 1 --2- 172.21.15.19:0/3852983150 >> v2:172.21.15.135:3300/0 conn(0x7f2b20161c80 0x7f2b2006e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:36.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.658+0000 7f2b16ffd640 1 -- 172.21.15.19:0/3852983150 >> v1:172.21.15.19:6789/0 conn(0x7f2b200b64b0 legacy=0x7f2b20162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:36.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.658+0000 7f2b1effd640 1 -- 172.21.15.19:0/3852983150 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 156443371 0 0) 0x7f2b18001490 con 0x7f2b200b64b0 2024-09-12T02:02:36.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.658+0000 7f2b16ffd640 1 -- 172.21.15.19:0/3852983150 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2006dfb0 con 0x7f2b20162060 2024-09-12T02:02:36.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.658+0000 7f2b16ffd640 1 --2- 172.21.15.19:0/3852983150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b20162060 0x7f2b200b5f70 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f2b2008d7a0 tx=0x7f2b0802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c58f25855be63f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:36.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.658+0000 7f2b1effd640 1 -- 172.21.15.19:0/3852983150 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b08037070 con 0x7f2b20162060 2024-09-12T02:02:36.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.659+0000 7f2b1effd640 1 -- 172.21.15.19:0/3852983150 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b08032440 con 0x7f2b20162060 2024-09-12T02:02:36.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.659+0000 7f2b1effd640 1 -- 172.21.15.19:0/3852983150 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b08032810 con 0x7f2b20162060 2024-09-12T02:02:36.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.659+0000 7f2b25a77640 1 -- 172.21.15.19:0/3852983150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b20162060 msgr2=0x7f2b200b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:36.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.659+0000 7f2b25a77640 1 --2- 172.21.15.19:0/3852983150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b20162060 0x7f2b200b5f70 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f2b2008d7a0 tx=0x7f2b0802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:02:36.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.659+0000 7f2b25a77640 1 -- 172.21.15.19:0/3852983150 shutdown_connections 2024-09-12T02:02:36.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.659+0000 7f2b25a77640 1 --2- 172.21.15.19:0/3852983150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b20162060 0x7f2b200b5f70 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:36.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.659+0000 7f2b25a77640 1 --2- 172.21.15.19:0/3852983150 >> v2:172.21.15.135:3300/0 conn(0x7f2b20161c80 0x7f2b2006e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:36.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.659+0000 7f2b25a77640 1 -- 172.21.15.19:0/3852983150 >> 172.21.15.19:0/3852983150 conn(0x7f2b200d44f0 msgr2=0x7f2b200d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:36.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.659+0000 7f2b25a77640 1 -- 172.21.15.19:0/3852983150 shutdown_connections 2024-09-12T02:02:36.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.659+0000 7f2b25a77640 1 -- 172.21.15.19:0/3852983150 wait complete. 2024-09-12T02:02:36.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.660+0000 7f2b25a77640 1 Processor -- start 2024-09-12T02:02:36.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.661+0000 7f2b25a77640 1 -- start start 2024-09-12T02:02:36.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.661+0000 7f2b25a77640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b200b64b0 0x7f2b20156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:36.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.661+0000 7f2b25a77640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b20161c80 0x7f2b200cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:36.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.661+0000 7f2b25a77640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b20162060 0x7f2b200b8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:36.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.661+0000 7f2b25a77640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2b200d2a10 con 0x7f2b20161c80 2024-09-12T02:02:36.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.661+0000 7f2b25a77640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2b200d2890 con 0x7f2b200b64b0 2024-09-12T02:02:36.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.661+0000 7f2b25a77640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2b200b6960 con 0x7f2b20162060 2024-09-12T02:02:36.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.661+0000 7f2b16ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b20161c80 0x7f2b200cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:36.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.661+0000 7f2b16ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b20161c80 0x7f2b200cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41084/0 (socket says 172.21.15.19:41084) 2024-09-12T02:02:36.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.661+0000 7f2b16ffd640 1 -- 172.21.15.19:0/2530909953 learned_addr learned my addr 172.21.15.19:0/2530909953 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:36.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.662+0000 7f2b1f7fe640 1 --2- 172.21.15.19:0/2530909953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b200b64b0 0x7f2b20156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:36.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.662+0000 7f2b16ffd640 1 -- 172.21.15.19:0/2530909953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b20162060 msgr2=0x7f2b200b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:36.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.662+0000 7f2b1ffff640 1 --2- 172.21.15.19:0/2530909953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b20162060 0x7f2b200b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:36.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.662+0000 7f2b16ffd640 1 --2- 172.21.15.19:0/2530909953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b20162060 0x7f2b200b8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:36.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.662+0000 7f2b16ffd640 1 -- 172.21.15.19:0/2530909953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b200b64b0 msgr2=0x7f2b20156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:36.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.662+0000 7f2b16ffd640 1 --2- 172.21.15.19:0/2530909953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b200b64b0 0x7f2b20156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:36.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.662+0000 7f2b16ffd640 1 -- 172.21.15.19:0/2530909953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b200c8060 con 0x7f2b20161c80 2024-09-12T02:02:36.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.662+0000 7f2b1ffff640 1 --2- 172.21.15.19:0/2530909953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b20162060 0x7f2b200b8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:36.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.662+0000 7f2b16ffd640 1 --2- 172.21.15.19:0/2530909953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b20161c80 0x7f2b200cb5c0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f2b08000c00 tx=0x7f2b080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:36.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.662+0000 7f2b1cff9640 1 -- 172.21.15.19:0/2530909953 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b08037040 con 0x7f2b20161c80 2024-09-12T02:02:36.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.662+0000 7f2b1cff9640 1 -- 172.21.15.19:0/2530909953 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b08042070 con 0x7f2b20161c80 2024-09-12T02:02:36.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.662+0000 7f2b25a77640 1 -- 172.21.15.19:0/2530909953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b200c8340 con 0x7f2b20161c80 2024-09-12T02:02:36.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.662+0000 7f2b1cff9640 1 -- 172.21.15.19:0/2530909953 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b08030bd0 con 0x7f2b20161c80 2024-09-12T02:02:36.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.662+0000 7f2b25a77640 1 -- 172.21.15.19:0/2530909953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b200c8900 con 0x7f2b20161c80 2024-09-12T02:02:36.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.663+0000 7f2b25a77640 1 -- 172.21.15.19:0/2530909953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b200ba470 con 0x7f2b20161c80 2024-09-12T02:02:36.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.664+0000 7f2b1cff9640 1 -- 172.21.15.19:0/2530909953 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b08047460 con 0x7f2b20161c80 2024-09-12T02:02:36.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.664+0000 7f2b1cff9640 1 --2- 172.21.15.19:0/2530909953 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2b0006be30 0x7f2b0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:36.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.664+0000 7f2b1cff9640 1 -- 172.21.15.19:0/2530909953 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f2b080abc00 con 0x7f2b20161c80 2024-09-12T02:02:36.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.664+0000 7f2b1f7fe640 1 --2- 172.21.15.19:0/2530909953 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2b0006be30 0x7f2b0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:36.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.665+0000 7f2b1f7fe640 1 --2- 172.21.15.19:0/2530909953 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2b0006be30 0x7f2b0006e2f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2b10006fd0 tx=0x7f2b10008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:36.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.669+0000 7f2b1cff9640 1 -- 172.21.15.19:0/2530909953 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b080b2080 con 0x7f2b20161c80 2024-09-12T02:02:36.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.885+0000 7f2b25a77640 1 -- 172.21.15.19:0/2530909953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b20160570 con 0x7f2b20161c80 2024-09-12T02:02:36.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.886+0000 7f2b1cff9640 1 -- 172.21.15.19:0/2530909953 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5226 (secure 0 0 0) 0x7f2b08032e20 con 0x7f2b20161c80 2024-09-12T02:02:36.888 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:36.888 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":85,"btime":"2024-09-12T02:02:33:391674+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1101861733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1101861733},{"type":"v1","addr":"172.21.15.135:6837","nonce":1101861733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:02:33.391666+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6436":{"gid":6436,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":9,"addr":"172.21.15.19:6834/613869354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":613869354},{"type":"v1","addr":"172.21.15.19:6834","nonce":613869354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6436,"qdb_cluster":[6436]},"id":6}]} 2024-09-12T02:02:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 85 2024-09-12T02:02:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.888+0000 7f2b25a77640 1 -- 172.21.15.19:0/2530909953 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2b0006be30 msgr2=0x7f2b0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.888+0000 7f2b25a77640 1 --2- 172.21.15.19:0/2530909953 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2b0006be30 0x7f2b0006e2f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2b10006fd0 tx=0x7f2b10008040 comp rx=0 tx=0).stop 2024-09-12T02:02:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.888+0000 7f2b25a77640 1 -- 172.21.15.19:0/2530909953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b20161c80 msgr2=0x7f2b200cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.888+0000 7f2b25a77640 1 --2- 172.21.15.19:0/2530909953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b20161c80 0x7f2b200cb5c0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f2b08000c00 tx=0x7f2b080046c0 comp rx=0 tx=0).stop 2024-09-12T02:02:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.888+0000 7f2b25a77640 1 -- 172.21.15.19:0/2530909953 shutdown_connections 2024-09-12T02:02:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.888+0000 7f2b25a77640 1 --2- 172.21.15.19:0/2530909953 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2b0006be30 0x7f2b0006e2f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.888+0000 7f2b25a77640 1 --2- 172.21.15.19:0/2530909953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b20162060 0x7f2b200b8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.888+0000 7f2b25a77640 1 --2- 172.21.15.19:0/2530909953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b20161c80 0x7f2b200cb5c0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.888+0000 7f2b25a77640 1 --2- 172.21.15.19:0/2530909953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b200b64b0 0x7f2b20156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.888+0000 7f2b25a77640 1 -- 172.21.15.19:0/2530909953 >> 172.21.15.19:0/2530909953 conn(0x7f2b200d44f0 msgr2=0x7f2b200b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.888+0000 7f2b25a77640 1 -- 172.21.15.19:0/2530909953 shutdown_connections 2024-09-12T02:02:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:36.888+0000 7f2b25a77640 1 -- 172.21.15.19:0/2530909953 wait complete. 2024-09-12T02:02:36.900 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 85, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:02:33.391666+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 94, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6436}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6436': {'gid': 6436, 'name': 'c', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.19:6834/613869354', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 613869354}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 613869354}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6436, 'qdb_cluster': [6436]} 2024-09-12T02:02:36.900 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:02:36.900 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T02:02:37.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.006+0000 7f03432af640 1 Processor -- start 2024-09-12T02:02:37.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.006+0000 7f03432af640 1 -- start start 2024-09-12T02:02:37.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.007+0000 7f03432af640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f033c072320 0x7f033c0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.007+0000 7f03432af640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f033c072de0 0x7f033c06e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.007+0000 7f03432af640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033c146140 con 0x7f033c072700 2024-09-12T02:02:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.007+0000 7f03432af640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f033c0cd740 con 0x7f033c072320 2024-09-12T02:02:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.007+0000 7f03432af640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f033c0cda20 con 0x7f033c072de0 2024-09-12T02:02:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.007+0000 7f034104b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f033c072320 0x7f033c0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.007+0000 7f034104b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f033c072320 0x7f033c0cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41086/0 (socket says 172.21.15.19:41086) 2024-09-12T02:02:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.007+0000 7f034104b640 1 -- 172.21.15.19:0/3106281468 learned_addr learned my addr 172.21.15.19:0/3106281468 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.007+0000 7f034084a640 1 --2- 172.21.15.19:0/3106281468 >> v2:172.21.15.135:3300/0 conn(0x7f033c072de0 0x7f033c06e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.007+0000 7f034104b640 1 -- 172.21.15.19:0/3106281468 >> v2:172.21.15.135:3300/0 conn(0x7f033c072de0 msgr2=0x7f033c06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.007+0000 7f034104b640 1 --2- 172.21.15.19:0/3106281468 >> v2:172.21.15.135:3300/0 conn(0x7f033c072de0 0x7f033c06e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.007+0000 7f034104b640 1 -- 172.21.15.19:0/3106281468 >> v1:172.21.15.135:6789/0 conn(0x7f033c072700 legacy=0x7f033c06e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.007+0000 7f034104b640 1 -- 172.21.15.19:0/3106281468 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033c0cdd00 con 0x7f033c072320 2024-09-12T02:02:37.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.008+0000 7f034104b640 1 --2- 172.21.15.19:0/3106281468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f033c072320 0x7f033c0cce60 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f033c06f8c0 tx=0x7f033802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee4ee1d14085b8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:37.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.008+0000 7f0333fff640 1 -- 172.21.15.19:0/3106281468 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338037070 con 0x7f033c072320 2024-09-12T02:02:37.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.008+0000 7f0333fff640 1 -- 172.21.15.19:0/3106281468 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0338032440 con 0x7f033c072320 2024-09-12T02:02:37.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.008+0000 7f0333fff640 1 -- 172.21.15.19:0/3106281468 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338032810 con 0x7f033c072320 2024-09-12T02:02:37.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.009+0000 7f03432af640 1 -- 172.21.15.19:0/3106281468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f033c072320 msgr2=0x7f033c0cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.009+0000 7f03432af640 1 --2- 172.21.15.19:0/3106281468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f033c072320 0x7f033c0cce60 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f033c06f8c0 tx=0x7f033802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.009+0000 7f03432af640 1 -- 172.21.15.19:0/3106281468 shutdown_connections 2024-09-12T02:02:37.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.009+0000 7f03432af640 1 --2- 172.21.15.19:0/3106281468 >> v2:172.21.15.135:3300/0 conn(0x7f033c072de0 0x7f033c06e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.009+0000 7f03432af640 1 --2- 172.21.15.19:0/3106281468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f033c072320 0x7f033c0cce60 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.009+0000 7f03432af640 1 -- 172.21.15.19:0/3106281468 >> 172.21.15.19:0/3106281468 conn(0x7f033c067d70 msgr2=0x7f033c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:37.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.009+0000 7f03432af640 1 -- 172.21.15.19:0/3106281468 shutdown_connections 2024-09-12T02:02:37.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.009+0000 7f03432af640 1 -- 172.21.15.19:0/3106281468 wait complete. 2024-09-12T02:02:37.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.010+0000 7f03432af640 1 Processor -- start 2024-09-12T02:02:37.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.010+0000 7f03432af640 1 -- start start 2024-09-12T02:02:37.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.011+0000 7f03432af640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f033c072320 0x7f033c15bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.011+0000 7f03432af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f033c072700 0x7f033c1e76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.011+0000 7f03432af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f033c072de0 0x7f033c0b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.011+0000 7f03432af640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f033c0cd520 con 0x7f033c072700 2024-09-12T02:02:37.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.011+0000 7f03432af640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f033c0cd3a0 con 0x7f033c072320 2024-09-12T02:02:37.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.011+0000 7f03432af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f033c06ed00 con 0x7f033c072de0 2024-09-12T02:02:37.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.011+0000 7f034084a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f033c072700 0x7f033c1e76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.011+0000 7f034084a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f033c072700 0x7f033c1e76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41092/0 (socket says 172.21.15.19:41092) 2024-09-12T02:02:37.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.011+0000 7f034084a640 1 -- 172.21.15.19:0/1010472489 learned_addr learned my addr 172.21.15.19:0/1010472489 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:37.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.011+0000 7f034104b640 1 --2- 172.21.15.19:0/1010472489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f033c072320 0x7f033c15bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.011+0000 7f034084a640 1 -- 172.21.15.19:0/1010472489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f033c072de0 msgr2=0x7f033c0b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.011+0000 7f034084a640 1 --2- 172.21.15.19:0/1010472489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f033c072de0 0x7f033c0b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.011+0000 7f034084a640 1 -- 172.21.15.19:0/1010472489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f033c072320 msgr2=0x7f033c15bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.011+0000 7f034084a640 1 --2- 172.21.15.19:0/1010472489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f033c072320 0x7f033c15bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.011+0000 7f034084a640 1 -- 172.21.15.19:0/1010472489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033c1f4490 con 0x7f033c072700 2024-09-12T02:02:37.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.011+0000 7f034084a640 1 --2- 172.21.15.19:0/1010472489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f033c072700 0x7f033c1e76b0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f032c00c820 tx=0x7f032c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:37.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.011+0000 7f0331ffb640 1 -- 172.21.15.19:0/1010472489 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c015070 con 0x7f033c072700 2024-09-12T02:02:37.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.012+0000 7f0331ffb640 1 -- 172.21.15.19:0/1010472489 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032c004020 con 0x7f033c072700 2024-09-12T02:02:37.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.012+0000 7f03432af640 1 -- 172.21.15.19:0/1010472489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033c1e81b0 con 0x7f033c072700 2024-09-12T02:02:37.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.012+0000 7f0331ffb640 1 -- 172.21.15.19:0/1010472489 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c0043f0 con 0x7f033c072700 2024-09-12T02:02:37.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.012+0000 7f03432af640 1 -- 172.21.15.19:0/1010472489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f033c0c9590 con 0x7f033c072700 2024-09-12T02:02:37.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.013+0000 7f0331ffb640 1 -- 172.21.15.19:0/1010472489 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f032c007830 con 0x7f033c072700 2024-09-12T02:02:37.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.014+0000 7f0331ffb640 1 --2- 172.21.15.19:0/1010472489 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f032006be30 0x7f032006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.014+0000 7f0331ffb640 1 -- 172.21.15.19:0/1010472489 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f032c08aea0 con 0x7f033c072700 2024-09-12T02:02:37.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.014+0000 7f034104b640 1 --2- 172.21.15.19:0/1010472489 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f032006be30 0x7f032006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.015+0000 7f034104b640 1 --2- 172.21.15.19:0/1010472489 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f032006be30 0x7f032006e2f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0338034000 tx=0x7f033802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:37.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.015+0000 7f0346040740 1 Processor -- start 2024-09-12T02:02:37.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.015+0000 7f0346040740 1 -- start start 2024-09-12T02:02:37.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f0346040740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b468322c0 0x556b46877a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f0346040740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4682fa80 0x556b468326a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f0346040740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b46833a50 0x556b4682c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f0346040740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556b46794520 con 0x556b4682fa80 2024-09-12T02:02:37.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f0346040740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556b4673c3e0 con 0x556b46833a50 2024-09-12T02:02:37.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f0346040740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556b467904e0 con 0x556b468322c0 2024-09-12T02:02:37.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f034084a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4682fa80 0x556b468326a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f034084a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4682fa80 0x556b468326a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41106/0 (socket says 172.21.15.19:41106) 2024-09-12T02:02:37.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f034084a640 1 -- 172.21.15.19:0/4070201661 learned_addr learned my addr 172.21.15.19:0/4070201661 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:37.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f034104b640 1 --2- 172.21.15.19:0/4070201661 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b468322c0 0x556b46877a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f034184c640 1 --2- 172.21.15.19:0/4070201661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b46833a50 0x556b4682c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f034084a640 1 -- 172.21.15.19:0/4070201661 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b468322c0 msgr2=0x556b46877a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:37.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f034084a640 1 --2- 172.21.15.19:0/4070201661 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b468322c0 0x556b46877a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f034084a640 1 -- 172.21.15.19:0/4070201661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b46833a50 msgr2=0x556b4682c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:37.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f034084a640 1 --2- 172.21.15.19:0/4070201661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b46833a50 0x556b4682c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f034084a640 1 -- 172.21.15.19:0/4070201661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b467572f0 con 0x556b4682fa80 2024-09-12T02:02:37.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f034084a640 1 --2- 172.21.15.19:0/4070201661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4682fa80 0x556b468326a0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f032c0890c0 tx=0x7f032c059690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae55e88b5ad75ad7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:37.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f0326ffd640 1 -- 172.21.15.19:0/4070201661 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c087070 con 0x556b4682fa80 2024-09-12T02:02:37.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f0326ffd640 1 -- 172.21.15.19:0/4070201661 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032c061ab0 con 0x556b4682fa80 2024-09-12T02:02:37.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.016+0000 7f0326ffd640 1 -- 172.21.15.19:0/4070201661 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c01e040 con 0x556b4682fa80 2024-09-12T02:02:37.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.017+0000 7f0346040740 1 -- 172.21.15.19:0/4070201661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4682fa80 msgr2=0x556b468326a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.017+0000 7f0346040740 1 --2- 172.21.15.19:0/4070201661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4682fa80 0x556b468326a0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f032c0890c0 tx=0x7f032c059690 comp rx=0 tx=0).stop 2024-09-12T02:02:37.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.017+0000 7f0346040740 1 -- 172.21.15.19:0/4070201661 shutdown_connections 2024-09-12T02:02:37.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.017+0000 7f0346040740 1 --2- 172.21.15.19:0/4070201661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b46833a50 0x556b4682c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.017+0000 7f0346040740 1 --2- 172.21.15.19:0/4070201661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4682fa80 0x556b468326a0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.017+0000 7f0346040740 1 --2- 172.21.15.19:0/4070201661 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b468322c0 0x556b46877a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.017+0000 7f0346040740 1 -- 172.21.15.19:0/4070201661 >> 172.21.15.19:0/4070201661 conn(0x556b4682ea80 msgr2=0x556b46876f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:37.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.017+0000 7f0346040740 1 -- 172.21.15.19:0/4070201661 shutdown_connections 2024-09-12T02:02:37.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.017+0000 7f0346040740 1 -- 172.21.15.19:0/4070201661 wait complete. 2024-09-12T02:02:37.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.018+0000 7f0346040740 1 -- start start 2024-09-12T02:02:37.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.018+0000 7f0346040740 1 Processor -- start 2024-09-12T02:02:37.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f0346040740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b468322c0 0x556b4682bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f0346040740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b46833a50 0x556b4685d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f0346040740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4685da10 0x556b46874010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f0346040740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556b4682df20 con 0x556b4685da10 2024-09-12T02:02:37.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f0346040740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556b4671d450 con 0x556b468322c0 2024-09-12T02:02:37.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f0346040740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556b46878290 con 0x556b46833a50 2024-09-12T02:02:37.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f0346040740 10 client.0 _ll_register_callbacks cb 0x556b464a6ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:02:37.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f034184c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4685da10 0x556b46874010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f034184c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4685da10 0x556b46874010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41110/0 (socket says 172.21.15.19:41110) 2024-09-12T02:02:37.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f034184c640 1 -- 172.21.15.19:0/1677083570 learned_addr learned my addr 172.21.15.19:0/1677083570 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:37.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f034104b640 1 --2- 172.21.15.19:0/1677083570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b468322c0 0x556b4682bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f034084a640 1 --2- 172.21.15.19:0/1677083570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b46833a50 0x556b4685d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f034184c640 1 -- 172.21.15.19:0/1677083570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b46833a50 msgr2=0x556b4685d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:37.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f034184c640 1 --2- 172.21.15.19:0/1677083570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b46833a50 0x556b4685d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f034184c640 1 -- 172.21.15.19:0/1677083570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b468322c0 msgr2=0x556b4682bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:37.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f034184c640 1 --2- 172.21.15.19:0/1677083570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b468322c0 0x556b4682bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f034184c640 1 -- 172.21.15.19:0/1677083570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b464a72d0 con 0x556b4685da10 2024-09-12T02:02:37.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f034184c640 1 --2- 172.21.15.19:0/1677083570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4685da10 0x556b46874010 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f033400f540 tx=0x7f033400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2489aaf3041717 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:37.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f031bfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:02:37.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f031bfff640 1 -- 172.21.15.19:0/1677083570 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0334018020 con 0x556b4685da10 2024-09-12T02:02:37.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f031bfff640 1 -- 172.21.15.19:0/1677083570 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f0334014680 con 0x556b4685da10 2024-09-12T02:02:37.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.019+0000 7f0346040740 1 -- 172.21.15.19:0/1677083570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f032c061ab0 con 0x556b4685da10 2024-09-12T02:02:37.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.020+0000 7f031bfff640 1 -- 172.21.15.19:0/1677083570 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f0334022050 con 0x556b4685da10 2024-09-12T02:02:37.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.020+0000 7f0346040740 10 client.7620 fetch_fsmap learned FSMap version 85 2024-09-12T02:02:37.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.020+0000 7f0346040740 1 -- 172.21.15.19:0/1677083570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x556b465716b0 con 0x556b4685da10 2024-09-12T02:02:37.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.020+0000 7f031bfff640 1 -- 172.21.15.19:0/1677083570 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032c061ab0 con 0x556b4685da10 2024-09-12T02:02:37.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.020+0000 7f031bfff640 1 -- 172.21.15.19:0/1677083570 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7f0334025020 con 0x556b4685da10 2024-09-12T02:02:37.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.020+0000 7f0346040740 10 client.7620 fetch_fsmap finished waiting for FSMap version 85 2024-09-12T02:02:37.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.020+0000 7f0346040740 10 client.7620 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:02:37.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.020+0000 7f0346040740 20 client.7620 populate_metadata read hostname 'smithi019' 2024-09-12T02:02:37.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.020+0000 7f0346040740 1 --2- 172.21.15.19:0/1677083570 >> [v2:172.21.15.19:6832/613869354,v1:172.21.15.19:6834/613869354] conn(0x556b46888150 0x556b46888530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.020+0000 7f0346040740 4 client.7620 mds_command: new command op to 6436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:02:37.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.020+0000 7f0346040740 1 -- 172.21.15.19:0/1677083570 --> [v2:172.21.15.19:6832/613869354,v1:172.21.15.19:6834/613869354] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b467a1c50 con 0x556b46888150 2024-09-12T02:02:37.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.020+0000 7f034104b640 1 --2- 172.21.15.19:0/1677083570 >> [v2:172.21.15.19:6832/613869354,v1:172.21.15.19:6834/613869354] conn(0x556b46888150 0x556b46888530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.020+0000 7f031bfff640 10 client.7620 ms_handle_connect on v2:172.21.15.19:6832/613869354 2024-09-12T02:02:37.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.020+0000 7f034104b640 1 --2- 172.21.15.19:0/1677083570 >> [v2:172.21.15.19:6832/613869354,v1:172.21.15.19:6834/613869354] conn(0x556b46888150 0x556b46888530 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a16ab84045372c0 server_cookie=52317c0d94ca1f4f in_seq=0 out_seq=0 2024-09-12T02:02:37.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.021+0000 7f031bfff640 1 -- 172.21.15.19:0/1677083570 <== mds.0 v2:172.21.15.19:6832/613869354 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b467a1c50 con 0x556b46888150 2024-09-12T02:02:37.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.021+0000 7f031bfff640 10 client.7620 handle_command_reply: tid=0 2024-09-12T02:02:37.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.021+0000 7f0346040740 1 client.7620 shutdown 2024-09-12T02:02:37.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.021+0000 7f0346040740 1 -- 172.21.15.19:0/1677083570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4685da10 msgr2=0x556b46874010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.021+0000 7f0346040740 1 --2- 172.21.15.19:0/1677083570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4685da10 0x556b46874010 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f033400f540 tx=0x7f033400fa00 comp rx=0 tx=0).stop 2024-09-12T02:02:37.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.021+0000 7f0346040740 1 -- 172.21.15.19:0/1677083570 shutdown_connections 2024-09-12T02:02:37.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.021+0000 7f0346040740 1 --2- 172.21.15.19:0/1677083570 >> [v2:172.21.15.19:6832/613869354,v1:172.21.15.19:6834/613869354] conn(0x556b46888150 0x556b46888530 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.021+0000 7f0346040740 1 --2- 172.21.15.19:0/1677083570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4685da10 0x556b46874010 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.021+0000 7f0346040740 1 --2- 172.21.15.19:0/1677083570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b46833a50 0x556b4685d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.021+0000 7f0346040740 1 --2- 172.21.15.19:0/1677083570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b468322c0 0x556b4682bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.021+0000 7f0346040740 1 -- 172.21.15.19:0/1677083570 >> 172.21.15.19:0/1677083570 conn(0x556b4682fa80 msgr2=0x556b46875dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:37.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.021+0000 7f031bfff640 0 client.7620 ms_handle_reset on v2:172.21.15.19:6832/613869354 2024-09-12T02:02:37.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.021+0000 7f0346040740 1 -- 172.21.15.19:0/1677083570 shutdown_connections 2024-09-12T02:02:37.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.021+0000 7f0346040740 1 -- 172.21.15.19:0/1677083570 wait complete. 2024-09-12T02:02:37.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.022+0000 7f0346040740 20 client.7620 trim_cache size 0 max 16384 2024-09-12T02:02:37.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.040+0000 7f0346040740 1 Processor -- start 2024-09-12T02:02:37.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.040+0000 7f0346040740 1 -- start start 2024-09-12T02:02:37.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.040+0000 7f0346040740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b468322c0 0x556b46888530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.040+0000 7f0346040740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b46833a50 0x556b46888a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.040+0000 7f0346040740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b4685da10 0x556b46899990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.040+0000 7f0346040740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f033c200400 con 0x556b46833a50 2024-09-12T02:02:37.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.040+0000 7f0346040740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f033c1ff760 con 0x556b4685da10 2024-09-12T02:02:37.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.040+0000 7f0346040740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f033c1ffdb0 con 0x556b468322c0 2024-09-12T02:02:37.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.040+0000 7f034084a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b46833a50 0x556b46888a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.040+0000 7f034084a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b46833a50 0x556b46888a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41118/0 (socket says 172.21.15.19:41118) 2024-09-12T02:02:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.040+0000 7f034084a640 1 -- 172.21.15.19:0/1555239085 learned_addr learned my addr 172.21.15.19:0/1555239085 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.041+0000 7f034084a640 1 -- 172.21.15.19:0/1555239085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b468322c0 msgr2=0x556b46888530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.041+0000 7f034104b640 1 --2- 172.21.15.19:0/1555239085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b468322c0 0x556b46888530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.041+0000 7f034084a640 1 --2- 172.21.15.19:0/1555239085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b468322c0 0x556b46888530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.041+0000 7f034084a640 1 -- 172.21.15.19:0/1555239085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b4685da10 msgr2=0x556b46899990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.041+0000 7f034184c640 1 --2- 172.21.15.19:0/1555239085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b4685da10 0x556b46899990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.041+0000 7f034084a640 1 --2- 172.21.15.19:0/1555239085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b4685da10 0x556b46899990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.041+0000 7f034084a640 1 -- 172.21.15.19:0/1555239085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b46832a10 con 0x556b46833a50 2024-09-12T02:02:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.041+0000 7f034184c640 1 --2- 172.21.15.19:0/1555239085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b4685da10 0x556b46899990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.041+0000 7f034084a640 1 --2- 172.21.15.19:0/1555239085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b46833a50 0x556b46888a70 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f032c05d440 tx=0x7f032c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d1a5bf6e6e4f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.041+0000 7f03267fc640 1 -- 172.21.15.19:0/1555239085 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c087040 con 0x556b46833a50 2024-09-12T02:02:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.041+0000 7f03267fc640 1 -- 172.21.15.19:0/1555239085 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032c056f70 con 0x556b46833a50 2024-09-12T02:02:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.041+0000 7f03267fc640 1 -- 172.21.15.19:0/1555239085 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c01e040 con 0x556b46833a50 2024-09-12T02:02:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.042+0000 7f0346040740 1 -- 172.21.15.19:0/1555239085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b46833a50 msgr2=0x556b46888a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.042+0000 7f0346040740 1 --2- 172.21.15.19:0/1555239085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b46833a50 0x556b46888a70 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f032c05d440 tx=0x7f032c01b000 comp rx=0 tx=0).stop 2024-09-12T02:02:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.042+0000 7f0346040740 1 -- 172.21.15.19:0/1555239085 shutdown_connections 2024-09-12T02:02:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.042+0000 7f0346040740 1 --2- 172.21.15.19:0/1555239085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b4685da10 0x556b46899990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.042+0000 7f0346040740 1 --2- 172.21.15.19:0/1555239085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b46833a50 0x556b46888a70 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.042+0000 7f0346040740 1 --2- 172.21.15.19:0/1555239085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b468322c0 0x556b46888530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.042+0000 7f0346040740 1 -- 172.21.15.19:0/1555239085 >> 172.21.15.19:0/1555239085 conn(0x556b4682fa80 msgr2=0x556b46873de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.042+0000 7f0346040740 1 -- 172.21.15.19:0/1555239085 shutdown_connections 2024-09-12T02:02:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.042+0000 7f0346040740 1 -- 172.21.15.19:0/1555239085 wait complete. 2024-09-12T02:02:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.042+0000 7f0346040740 1 -- start start 2024-09-12T02:02:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.042+0000 7f0346040740 1 Processor -- start 2024-09-12T02:02:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.043+0000 7f0346040740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b468322c0 0x556b46858c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.043+0000 7f0346040740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b46833a50 0x556b46888720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.043+0000 7f0346040740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4685da10 0x556b468dd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.043+0000 7f0346040740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556b4682c2b0 con 0x556b4685da10 2024-09-12T02:02:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.043+0000 7f0346040740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556b468891d0 con 0x556b468322c0 2024-09-12T02:02:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.043+0000 7f0346040740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556b4688a8b0 con 0x556b46833a50 2024-09-12T02:02:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.043+0000 7f0346040740 10 client.0 _ll_register_callbacks cb 0x7f0334005060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:02:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.043+0000 7f034184c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4685da10 0x556b468dd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.043+0000 7f034184c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4685da10 0x556b468dd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41124/0 (socket says 172.21.15.19:41124) 2024-09-12T02:02:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.043+0000 7f034184c640 1 -- 172.21.15.19:0/1240502174 learned_addr learned my addr 172.21.15.19:0/1240502174 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.043+0000 7f034084a640 1 --2- 172.21.15.19:0/1240502174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b46833a50 0x556b46888720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.043+0000 7f034104b640 1 --2- 172.21.15.19:0/1240502174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b468322c0 0x556b46858c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f034184c640 1 -- 172.21.15.19:0/1240502174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b46833a50 msgr2=0x556b46888720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f034184c640 1 --2- 172.21.15.19:0/1240502174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b46833a50 0x556b46888720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f034184c640 1 -- 172.21.15.19:0/1240502174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b468322c0 msgr2=0x556b46858c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f034184c640 1 --2- 172.21.15.19:0/1240502174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b468322c0 0x556b46858c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f034184c640 1 -- 172.21.15.19:0/1240502174 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b4689a3e0 con 0x556b4685da10 2024-09-12T02:02:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f034184c640 1 --2- 172.21.15.19:0/1240502174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4685da10 0x556b468dd590 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f0334006e00 tx=0x7f0334003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a10244d2b45a11 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f031bfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:02:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f031bfff640 1 -- 172.21.15.19:0/1240502174 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0334018030 con 0x556b4685da10 2024-09-12T02:02:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f031bfff640 1 -- 172.21.15.19:0/1240502174 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f033401d600 con 0x556b4685da10 2024-09-12T02:02:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f0346040740 1 -- 172.21.15.19:0/1240502174 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f032c056f70 con 0x556b4685da10 2024-09-12T02:02:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f031bfff640 1 -- 172.21.15.19:0/1240502174 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f0334033050 con 0x556b4685da10 2024-09-12T02:02:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f0346040740 10 client.7626 fetch_fsmap learned FSMap version 85 2024-09-12T02:02:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f0346040740 1 -- 172.21.15.19:0/1240502174 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x556b46830600 con 0x556b4685da10 2024-09-12T02:02:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f031bfff640 1 -- 172.21.15.19:0/1240502174 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032c056f70 con 0x556b4685da10 2024-09-12T02:02:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f031bfff640 1 -- 172.21.15.19:0/1240502174 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7f0334036020 con 0x556b4685da10 2024-09-12T02:02:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f0346040740 10 client.7626 fetch_fsmap finished waiting for FSMap version 85 2024-09-12T02:02:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f0346040740 10 client.7626 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:02:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f0346040740 20 client.7626 populate_metadata read hostname 'smithi019' 2024-09-12T02:02:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f0346040740 1 --2- 172.21.15.19:0/1240502174 >> [v2:172.21.15.19:6832/613869354,v1:172.21.15.19:6834/613869354] conn(0x556b4687a820 0x556b4687ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f0346040740 4 client.7626 mds_command: new command op to 6436 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:02:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f0346040740 1 -- 172.21.15.19:0/1240502174 --> [v2:172.21.15.19:6832/613869354,v1:172.21.15.19:6834/613869354] -- command(tid 0: {"prefix": "status"}) -- 0x556b4685f2c0 con 0x556b4687a820 2024-09-12T02:02:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.044+0000 7f034104b640 1 --2- 172.21.15.19:0/1240502174 >> [v2:172.21.15.19:6832/613869354,v1:172.21.15.19:6834/613869354] conn(0x556b4687a820 0x556b4687ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.045+0000 7f031bfff640 10 client.7626 ms_handle_connect on v2:172.21.15.19:6832/613869354 2024-09-12T02:02:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.045+0000 7f034104b640 1 --2- 172.21.15.19:0/1240502174 >> [v2:172.21.15.19:6832/613869354,v1:172.21.15.19:6834/613869354] conn(0x556b4687a820 0x556b4687ac00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed2309e07a3281c6 server_cookie=687c21e9b93dfd6a in_seq=0 out_seq=0 2024-09-12T02:02:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.045+0000 7f031bfff640 1 -- 172.21.15.19:0/1240502174 <== mds.0 v2:172.21.15.19:6832/613869354 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x556b4685f2c0 con 0x556b4687a820 2024-09-12T02:02:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.045+0000 7f031bfff640 10 client.7626 handle_command_reply: tid=0 2024-09-12T02:02:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.045+0000 7f0346040740 1 client.7626 shutdown 2024-09-12T02:02:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.045+0000 7f0346040740 1 -- 172.21.15.19:0/1240502174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4685da10 msgr2=0x556b468dd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.045+0000 7f0346040740 1 --2- 172.21.15.19:0/1240502174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4685da10 0x556b468dd590 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f0334006e00 tx=0x7f0334003ae0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.045+0000 7f0346040740 1 -- 172.21.15.19:0/1240502174 shutdown_connections 2024-09-12T02:02:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.045+0000 7f0346040740 1 --2- 172.21.15.19:0/1240502174 >> [v2:172.21.15.19:6832/613869354,v1:172.21.15.19:6834/613869354] conn(0x556b4687a820 0x556b4687ac00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.045+0000 7f0346040740 1 --2- 172.21.15.19:0/1240502174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b4685da10 0x556b468dd590 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.045+0000 7f0346040740 1 --2- 172.21.15.19:0/1240502174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556b46833a50 0x556b46888720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.045+0000 7f031bfff640 0 client.7626 ms_handle_reset on v2:172.21.15.19:6832/613869354 2024-09-12T02:02:37.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.045+0000 7f0346040740 1 --2- 172.21.15.19:0/1240502174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b468322c0 0x556b46858c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.045+0000 7f0346040740 1 -- 172.21.15.19:0/1240502174 >> 172.21.15.19:0/1240502174 conn(0x556b4682fa80 msgr2=0x556b468771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:37.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.045+0000 7f0346040740 1 -- 172.21.15.19:0/1240502174 shutdown_connections 2024-09-12T02:02:37.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.045+0000 7f0346040740 1 -- 172.21.15.19:0/1240502174 wait complete. 2024-09-12T02:02:37.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.045+0000 7f0346040740 20 client.7626 trim_cache size 0 max 16384 2024-09-12T02:02:37.055 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:02:37.055 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T02:02:37.055 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T02:02:37.055 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 6436, 2024-09-12T02:02:37.055 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T02:02:37.055 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T02:02:37.055 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T02:02:37.055 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 6.6608260760000002, 2024-09-12T02:02:37.055 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 85, 2024-09-12T02:02:37.056 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 94, 2024-09-12T02:02:37.056 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 94, 2024-09-12T02:02:37.056 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 28.752139596999999 2024-09-12T02:02:37.056 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:02:37.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.046+0000 7f03432af640 1 -- 172.21.15.19:0/1010472489 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f032006be30 msgr2=0x7f032006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.046+0000 7f03432af640 1 --2- 172.21.15.19:0/1010472489 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f032006be30 0x7f032006e2f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0338034000 tx=0x7f033802e000 comp rx=0 tx=0).stop 2024-09-12T02:02:37.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.046+0000 7f03432af640 1 -- 172.21.15.19:0/1010472489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f033c072700 msgr2=0x7f033c1e76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.046+0000 7f03432af640 1 --2- 172.21.15.19:0/1010472489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f033c072700 0x7f033c1e76b0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f032c00c820 tx=0x7f032c00cce0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.046+0000 7f03432af640 1 -- 172.21.15.19:0/1010472489 shutdown_connections 2024-09-12T02:02:37.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.046+0000 7f03432af640 1 --2- 172.21.15.19:0/1010472489 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f032006be30 0x7f032006e2f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.046+0000 7f03432af640 1 --2- 172.21.15.19:0/1010472489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f033c072de0 0x7f033c0b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.046+0000 7f03432af640 1 --2- 172.21.15.19:0/1010472489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f033c072700 0x7f033c1e76b0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.046+0000 7f03432af640 1 --2- 172.21.15.19:0/1010472489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f033c072320 0x7f033c15bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.046+0000 7f03432af640 1 -- 172.21.15.19:0/1010472489 >> 172.21.15.19:0/1010472489 conn(0x7f033c067d70 msgr2=0x7f033c0ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.046+0000 7f03432af640 1 -- 172.21.15.19:0/1010472489 shutdown_connections 2024-09-12T02:02:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.046+0000 7f03432af640 1 -- 172.21.15.19:0/1010472489 wait complete. 2024-09-12T02:02:37.058 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:02:37.058 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Delete 10000000000.00000000', proceeding to ls 2024-09-12T02:02:37.058 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:02:37.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.160+0000 7f785e52c640 1 Processor -- start 2024-09-12T02:02:37.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.160+0000 7f785e52c640 1 -- start start 2024-09-12T02:02:37.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.161+0000 7f785e52c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f785809b140 0x7f7858169570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.161+0000 7f785e52c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f785806cec0 con 0x7f785815e5d0 2024-09-12T02:02:37.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.161+0000 7f785e52c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f785806d1a0 con 0x7f785806df60 2024-09-12T02:02:37.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.161+0000 7f785e52c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f785806dad0 con 0x7f785809b140 2024-09-12T02:02:37.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.161+0000 7f7857fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f785815e5d0 0x7f78580d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34042/0 (socket says 172.21.15.19:34042) 2024-09-12T02:02:37.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.161+0000 7f7857fff640 1 -- 172.21.15.19:0/3220976012 learned_addr learned my addr 172.21.15.19:0/3220976012 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:37.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f785cac9640 1 --2- 172.21.15.19:0/3220976012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f785809b140 0x7f7858169570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f7856ffd640 1 -- 172.21.15.19:0/3220976012 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2902522627 0 0) 0x7f785806cec0 con 0x7f785815e5d0 2024-09-12T02:02:37.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f7856ffd640 1 -- 172.21.15.19:0/3220976012 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7840003520 con 0x7f785815e5d0 2024-09-12T02:02:37.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f7856ffd640 1 -- 172.21.15.19:0/3220976012 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 660990965 0 0) 0x7f785806d1a0 con 0x7f785806df60 2024-09-12T02:02:37.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f7856ffd640 1 -- 172.21.15.19:0/3220976012 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f785806cec0 con 0x7f785806df60 2024-09-12T02:02:37.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f7856ffd640 1 -- 172.21.15.19:0/3220976012 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 694283084 0 0) 0x7f7840003520 con 0x7f785815e5d0 2024-09-12T02:02:37.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f7856ffd640 1 -- 172.21.15.19:0/3220976012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f785809b140 msgr2=0x7f7858169570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:37.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f7856ffd640 1 --2- 172.21.15.19:0/3220976012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f785809b140 0x7f7858169570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f7856ffd640 1 -- 172.21.15.19:0/3220976012 >> v1:172.21.15.135:6789/0 conn(0x7f785806df60 legacy=0x7f785809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f7856ffd640 1 -- 172.21.15.19:0/3220976012 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785806d480 con 0x7f785815e5d0 2024-09-12T02:02:37.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f7856ffd640 1 -- 172.21.15.19:0/3220976012 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f7848001670 con 0x7f785815e5d0 2024-09-12T02:02:37.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f785cac9640 1 --2- 172.21.15.19:0/3220976012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f785809b140 0x7f7858169570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:37.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f7856ffd640 1 -- 172.21.15.19:0/3220976012 >> v1:172.21.15.19:6789/0 conn(0x7f785815e5d0 legacy=0x7f78580d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f7856ffd640 1 --2- 172.21.15.19:0/3220976012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7840003b70 0x7f7840003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f7856ffd640 1 --2- 172.21.15.19:0/3220976012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f785809b140 0x7f7840004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f7856ffd640 1 --2- 172.21.15.19:0/3220976012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7840004d40 0x7f78400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f7856ffd640 1 -- 172.21.15.19:0/3220976012 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f785806dad0 con 0x7f7840004d40 2024-09-12T02:02:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f7856ffd640 1 -- 172.21.15.19:0/3220976012 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f784000ba70 con 0x7f7840003b70 2024-09-12T02:02:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f7856ffd640 1 -- 172.21.15.19:0/3220976012 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f784000bc20 con 0x7f785809b140 2024-09-12T02:02:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f785cac9640 1 --2- 172.21.15.19:0/3220976012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7840004d40 0x7f78400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f7857fff640 1 --2- 172.21.15.19:0/3220976012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7840003b70 0x7f7840003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f78577fe640 1 --2- 172.21.15.19:0/3220976012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f785809b140 0x7f7840004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f785cac9640 1 -- 172.21.15.19:0/3220976012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f785809b140 msgr2=0x7f7840004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f785cac9640 1 --2- 172.21.15.19:0/3220976012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f785809b140 0x7f7840004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f785cac9640 1 -- 172.21.15.19:0/3220976012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7840003b70 msgr2=0x7f7840003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f785cac9640 1 --2- 172.21.15.19:0/3220976012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7840003b70 0x7f7840003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f785cac9640 1 -- 172.21.15.19:0/3220976012 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7840003520 con 0x7f7840004d40 2024-09-12T02:02:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.162+0000 7f78577fe640 1 --2- 172.21.15.19:0/3220976012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f785809b140 0x7f7840004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.163+0000 7f785cac9640 1 --2- 172.21.15.19:0/3220976012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7840004d40 0x7f78400051c0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f785000e350 tx=0x7f7840005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f606844273941138 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.163+0000 7f7856ffd640 1 -- 172.21.15.19:0/3220976012 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7850033070 con 0x7f7840004d40 2024-09-12T02:02:37.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.163+0000 7f7856ffd640 1 -- 172.21.15.19:0/3220976012 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f785002f660 con 0x7f7840004d40 2024-09-12T02:02:37.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.163+0000 7f7856ffd640 1 -- 172.21.15.19:0/3220976012 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7850009de0 con 0x7f7840004d40 2024-09-12T02:02:37.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.164+0000 7f785e52c640 1 -- 172.21.15.19:0/3220976012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7840004d40 msgr2=0x7f78400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.164+0000 7f785e52c640 1 --2- 172.21.15.19:0/3220976012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7840004d40 0x7f78400051c0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f785000e350 tx=0x7f7840005830 comp rx=0 tx=0).stop 2024-09-12T02:02:37.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.164+0000 7f785cac9640 1 -- 172.21.15.19:0/3220976012 reap_dead start 2024-09-12T02:02:37.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.164+0000 7f785e52c640 1 -- 172.21.15.19:0/3220976012 shutdown_connections 2024-09-12T02:02:37.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.164+0000 7f785e52c640 1 -- 172.21.15.19:0/3220976012 >> 172.21.15.19:0/3220976012 conn(0x7f78580d23a0 msgr2=0x7f78580d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:37.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.164+0000 7f785e52c640 1 -- 172.21.15.19:0/3220976012 shutdown_connections 2024-09-12T02:02:37.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.164+0000 7f785e52c640 1 -- 172.21.15.19:0/3220976012 wait complete. 2024-09-12T02:02:37.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.165+0000 7f785e52c640 1 Processor -- start 2024-09-12T02:02:37.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.165+0000 7f785e52c640 1 -- start start 2024-09-12T02:02:37.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.166+0000 7f785e52c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7840004d40 0x7f78581521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.166+0000 7f785e52c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78580c6cf0 0x7f78580b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.166+0000 7f785e52c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78581527c0 0x7f785815bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.166+0000 7f785e52c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f78580d1980 con 0x7f78580c6cf0 2024-09-12T02:02:37.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.166+0000 7f785e52c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f78580d1800 con 0x7f7840004d40 2024-09-12T02:02:37.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.166+0000 7f785e52c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f785815e9b0 con 0x7f78581527c0 2024-09-12T02:02:37.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.166+0000 7f78577fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78580c6cf0 0x7f78580b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.166+0000 7f78577fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78580c6cf0 0x7f78580b6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41152/0 (socket says 172.21.15.19:41152) 2024-09-12T02:02:37.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.166+0000 7f78577fe640 1 -- 172.21.15.19:0/3634825364 learned_addr learned my addr 172.21.15.19:0/3634825364 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:37.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.167+0000 7f7857fff640 1 --2- 172.21.15.19:0/3634825364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7840004d40 0x7f78581521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.167+0000 7f785cac9640 1 --2- 172.21.15.19:0/3634825364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78581527c0 0x7f785815bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.167+0000 7f78577fe640 1 -- 172.21.15.19:0/3634825364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78581527c0 msgr2=0x7f785815bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.167+0000 7f78577fe640 1 --2- 172.21.15.19:0/3634825364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78581527c0 0x7f785815bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.167+0000 7f78577fe640 1 -- 172.21.15.19:0/3634825364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7840004d40 msgr2=0x7f78581521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.167+0000 7f78577fe640 1 --2- 172.21.15.19:0/3634825364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7840004d40 0x7f78581521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.167+0000 7f78577fe640 1 -- 172.21.15.19:0/3634825364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785815a1a0 con 0x7f78580c6cf0 2024-09-12T02:02:37.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.167+0000 7f7857fff640 1 --2- 172.21.15.19:0/3634825364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7840004d40 0x7f78581521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:37.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.167+0000 7f785cac9640 1 --2- 172.21.15.19:0/3634825364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78581527c0 0x7f785815bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:37.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.167+0000 7f78577fe640 1 --2- 172.21.15.19:0/3634825364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78580c6cf0 0x7f78580b6f70 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f784c00e7b0 tx=0x7f784c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:37.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.167+0000 7f7854ff9640 1 -- 172.21.15.19:0/3634825364 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c00ee60 con 0x7f78580c6cf0 2024-09-12T02:02:37.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.167+0000 7f7854ff9640 1 -- 172.21.15.19:0/3634825364 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f784c0052e0 con 0x7f78580c6cf0 2024-09-12T02:02:37.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.167+0000 7f785e52c640 1 -- 172.21.15.19:0/3634825364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78580c5f70 con 0x7f78580c6cf0 2024-09-12T02:02:37.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.167+0000 7f7854ff9640 1 -- 172.21.15.19:0/3634825364 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c007020 con 0x7f78580c6cf0 2024-09-12T02:02:37.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.167+0000 7f785e52c640 1 -- 172.21.15.19:0/3634825364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78580c64f0 con 0x7f78580c6cf0 2024-09-12T02:02:37.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.168+0000 7f785e52c640 1 -- 172.21.15.19:0/3634825364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f785806d1a0 con 0x7f78580c6cf0 2024-09-12T02:02:37.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.169+0000 7f7854ff9640 1 -- 172.21.15.19:0/3634825364 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f784c01a020 con 0x7f78580c6cf0 2024-09-12T02:02:37.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.169+0000 7f7854ff9640 1 --2- 172.21.15.19:0/3634825364 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f784406be60 0x7f784406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.169+0000 7f7854ff9640 1 -- 172.21.15.19:0/3634825364 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6187+0+0 (secure 0 0 0) 0x7f784c08a7b0 con 0x7f78580c6cf0 2024-09-12T02:02:37.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.169+0000 7f7857fff640 1 --2- 172.21.15.19:0/3634825364 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f784406be60 0x7f784406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.170+0000 7f7857fff640 1 --2- 172.21.15.19:0/3634825364 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f784406be60 0x7f784406e320 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7848007c40 tx=0x7f7848009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:37.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.173+0000 7f7854ff9640 1 -- 172.21.15.19:0/3634825364 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f784c059010 con 0x7f78580c6cf0 2024-09-12T02:02:37.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.386+0000 7f785e52c640 1 -- 172.21.15.19:0/3634825364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7858070bc0 con 0x7f78580c6cf0 2024-09-12T02:02:37.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.386+0000 7f7854ff9640 1 -- 172.21.15.19:0/3634825364 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v85) ==== 53+0+73 (secure 0 0 0) 0x7f784c058910 con 0x7f78580c6cf0 2024-09-12T02:02:37.387 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:02:37.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.388+0000 7f785e52c640 1 -- 172.21.15.19:0/3634825364 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f784406be60 msgr2=0x7f784406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.388+0000 7f785e52c640 1 --2- 172.21.15.19:0/3634825364 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f784406be60 0x7f784406e320 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7848007c40 tx=0x7f7848009040 comp rx=0 tx=0).stop 2024-09-12T02:02:37.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.388+0000 7f785e52c640 1 -- 172.21.15.19:0/3634825364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78580c6cf0 msgr2=0x7f78580b6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.388+0000 7f785e52c640 1 --2- 172.21.15.19:0/3634825364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78580c6cf0 0x7f78580b6f70 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f784c00e7b0 tx=0x7f784c00ec70 comp rx=0 tx=0).stop 2024-09-12T02:02:37.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.388+0000 7f785e52c640 1 -- 172.21.15.19:0/3634825364 shutdown_connections 2024-09-12T02:02:37.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.388+0000 7f785e52c640 1 --2- 172.21.15.19:0/3634825364 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f784406be60 0x7f784406e320 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.388+0000 7f785e52c640 1 --2- 172.21.15.19:0/3634825364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78581527c0 0x7f785815bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.388+0000 7f785e52c640 1 --2- 172.21.15.19:0/3634825364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78580c6cf0 0x7f78580b6f70 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.388+0000 7f785e52c640 1 --2- 172.21.15.19:0/3634825364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7840004d40 0x7f78581521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.389+0000 7f785e52c640 1 -- 172.21.15.19:0/3634825364 >> 172.21.15.19:0/3634825364 conn(0x7f78580d23a0 msgr2=0x7f78580b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:37.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.389+0000 7f785e52c640 1 -- 172.21.15.19:0/3634825364 shutdown_connections 2024-09-12T02:02:37.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37.389+0000 7f785e52c640 1 -- 172.21.15.19:0/3634825364 wait complete. 2024-09-12T02:02:37.400 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:02:37.400 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:02:37.400 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T02:02:37.400 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:02:37.400 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:02:37.400 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:02:37.400 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:02:37.400 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:02:37.400 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:02:37.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:37.402 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T02:02:37.418 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:02:37.418 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:02:37.418 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:02:37.418 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:02:37.418 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T02:02:37.418 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:02:37.418 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:02:37.418 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:02:37.418 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T02:02:37.419 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:02:37.419 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:02:37.419 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T02:02:37.419 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:02:37.419 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:02:37.419 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T02:02:37.419 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:02:37.419 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42403sec preferred_lft 42403sec 2024-09-12T02:02:37.419 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T02:02:37.419 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:02:37.419 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:02:37.419 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:02:37.419 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T02:02:37.419 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:02:37.419 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T02:02:37.420 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:02:37.420 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:02:37.420 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T02:02:37.420 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:02:37.420 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:02:37.420 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:02:37.420 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T02:02:37.420 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:02:37.420 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:02:37.420 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:02:37.420 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T02:02:37.420 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:02:37.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:37.421 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:02:37.482 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T02:02:37.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:37.484 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T02:02:37.541 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T02:02:37.541 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:02:37.541 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:02:37.541 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:02:37.541 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:02:37.541 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:02:37.541 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T02:02:37.541 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:02:37.542 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:02:37.542 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:02:37.542 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T02:02:37.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:02:37.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:02:37.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:37.670 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T02:02:37.685 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:02:37.685 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:02:37.686 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:02:37.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:37.686 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T02:02:37.752 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:02:37.752 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:02:37.808 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:02:37.808 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:02:37.808 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:02:37.864 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:02:37.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:37.864 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:02:37.949 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:02:37.949 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:02:37.949 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:02:37.957 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:02:37.957 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:02:37.957 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:02:37.958 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:02:37.958 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:02:37.963 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:02:37.963 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:02:37.963 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:02:37.963 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:02:37.963 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:02:37.963 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T02:02:37.963 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T02:02:37.963 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T02:02:37.964 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:02:37.964 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:02:37.964 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:02:37.964 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:02:37.964 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:02:37.965 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:02:37.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:37.965 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:02:37.996 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:02:38.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:02:38.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:02:38.093 INFO:teuthology.orchestra.run.smithi019.stdout:client7635 2024-09-12T02:02:38.093 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:02:38.094 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:02:38.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:38.109 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2024-09-12T02:02:38.153 INFO:teuthology.orchestra.run:waiting for 20 2024-09-12T02:02:38.167 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:02:38.167+0000 7f065ebcf640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/subdir) 2024-09-12T02:02:38.168 INFO:teuthology.orchestra.run.smithi019.stdout:.: 2024-09-12T02:02:38.168 INFO:teuthology.orchestra.run.smithi019.stdout:subdir 2024-09-12T02:02:38.168 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:38.168 INFO:teuthology.orchestra.run.smithi019.stdout:./subdir: 2024-09-12T02:02:38.168 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 10000000000.00000000' did not caused DAMAGED state 2024-09-12T02:02:38.168 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 600.00000000' 2024-09-12T02:02:38.168 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:02:38.168 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:02:38.224 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:02:38.224 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:02:38.280 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:02:38.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.427+0000 7f00329a6640 1 Processor -- start 2024-09-12T02:02:38.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.427+0000 7f00329a6640 1 -- start start 2024-09-12T02:02:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.427+0000 7f00329a6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f002c162060 0x7f002c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.427+0000 7f00329a6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f002c06d9f0 con 0x7f002c161c80 2024-09-12T02:02:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.427+0000 7f00329a6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f002c06dcd0 con 0x7f002c0b64b0 2024-09-12T02:02:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.427+0000 7f00329a6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f002c06dfb0 con 0x7f002c162060 2024-09-12T02:02:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002bfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f002c161c80 0x7f002c06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34044/0 (socket says 172.21.15.19:34044) 2024-09-12T02:02:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002bfff640 1 -- 172.21.15.19:0/2439564397 learned_addr learned my addr 172.21.15.19:0/2439564397 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002affd640 1 -- 172.21.15.19:0/2439564397 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4000146877 0 0) 0x7f002c06d9f0 con 0x7f002c161c80 2024-09-12T02:02:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002affd640 1 -- 172.21.15.19:0/2439564397 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0014003520 con 0x7f002c161c80 2024-09-12T02:02:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002b7fe640 1 --2- 172.21.15.19:0/2439564397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f002c162060 0x7f002c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:38.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002affd640 1 -- 172.21.15.19:0/2439564397 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1636508451 0 0) 0x7f0014003520 con 0x7f002c161c80 2024-09-12T02:02:38.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002affd640 1 -- 172.21.15.19:0/2439564397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f002c162060 msgr2=0x7f002c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:38.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002affd640 1 --2- 172.21.15.19:0/2439564397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f002c162060 0x7f002c0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:38.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002affd640 1 -- 172.21.15.19:0/2439564397 >> v1:172.21.15.135:6789/0 conn(0x7f002c0b64b0 legacy=0x7f002c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:38.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002affd640 1 -- 172.21.15.19:0/2439564397 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002c0d2890 con 0x7f002c161c80 2024-09-12T02:02:38.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002affd640 1 -- 172.21.15.19:0/2439564397 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f001c001670 con 0x7f002c161c80 2024-09-12T02:02:38.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002affd640 1 -- 172.21.15.19:0/2439564397 >> v1:172.21.15.19:6789/0 conn(0x7f002c161c80 legacy=0x7f002c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:38.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002affd640 1 --2- 172.21.15.19:0/2439564397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00140039e0 0x7f0014003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:38.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002affd640 1 --2- 172.21.15.19:0/2439564397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0014004800 0x7f0014004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:38.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002affd640 1 --2- 172.21.15.19:0/2439564397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f002c162060 0x7f0014005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:38.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002affd640 1 -- 172.21.15.19:0/2439564397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f002c06dfb0 con 0x7f00140039e0 2024-09-12T02:02:38.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002affd640 1 -- 172.21.15.19:0/2439564397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f001400baf0 con 0x7f0014004800 2024-09-12T02:02:38.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002affd640 1 -- 172.21.15.19:0/2439564397 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f001400bcf0 con 0x7f002c162060 2024-09-12T02:02:38.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002bfff640 1 --2- 172.21.15.19:0/2439564397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00140039e0 0x7f0014003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:38.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f002b7fe640 1 --2- 172.21.15.19:0/2439564397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0014004800 0x7f0014004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:38.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.428+0000 7f0030f43640 1 --2- 172.21.15.19:0/2439564397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f002c162060 0x7f0014005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:38.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.429+0000 7f002bfff640 1 -- 172.21.15.19:0/2439564397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f002c162060 msgr2=0x7f0014005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:38.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.429+0000 7f002bfff640 1 --2- 172.21.15.19:0/2439564397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f002c162060 0x7f0014005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:38.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.429+0000 7f002bfff640 1 -- 172.21.15.19:0/2439564397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0014004800 msgr2=0x7f0014004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:38.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.429+0000 7f002bfff640 1 --2- 172.21.15.19:0/2439564397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0014004800 0x7f0014004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:38.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.429+0000 7f002bfff640 1 -- 172.21.15.19:0/2439564397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0014003520 con 0x7f00140039e0 2024-09-12T02:02:38.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.429+0000 7f0030f43640 1 --2- 172.21.15.19:0/2439564397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f002c162060 0x7f0014005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:38.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.429+0000 7f002bfff640 1 --2- 172.21.15.19:0/2439564397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00140039e0 0x7f0014003e00 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f001c00c210 tx=0x7f0014005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62f45553a274139 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:38.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.429+0000 7f002affd640 1 -- 172.21.15.19:0/2439564397 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c007d30 con 0x7f00140039e0 2024-09-12T02:02:38.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.429+0000 7f002affd640 1 -- 172.21.15.19:0/2439564397 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f001c005ad0 con 0x7f00140039e0 2024-09-12T02:02:38.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.429+0000 7f002affd640 1 -- 172.21.15.19:0/2439564397 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c007070 con 0x7f00140039e0 2024-09-12T02:02:38.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.430+0000 7f00329a6640 1 -- 172.21.15.19:0/2439564397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00140039e0 msgr2=0x7f0014003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:38.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.430+0000 7f00329a6640 1 --2- 172.21.15.19:0/2439564397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00140039e0 0x7f0014003e00 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f001c00c210 tx=0x7f0014005830 comp rx=0 tx=0).stop 2024-09-12T02:02:38.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.430+0000 7f0030f43640 1 -- 172.21.15.19:0/2439564397 reap_dead start 2024-09-12T02:02:38.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.430+0000 7f00329a6640 1 -- 172.21.15.19:0/2439564397 shutdown_connections 2024-09-12T02:02:38.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.430+0000 7f00329a6640 1 -- 172.21.15.19:0/2439564397 >> 172.21.15.19:0/2439564397 conn(0x7f002c0d44f0 msgr2=0x7f002c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:38.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.430+0000 7f00329a6640 1 -- 172.21.15.19:0/2439564397 shutdown_connections 2024-09-12T02:02:38.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.430+0000 7f00329a6640 1 -- 172.21.15.19:0/2439564397 wait complete. 2024-09-12T02:02:38.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.431+0000 7f00329a6640 1 Processor -- start 2024-09-12T02:02:38.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.431+0000 7f00329a6640 1 -- start start 2024-09-12T02:02:38.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.432+0000 7f00329a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00140039e0 0x7f002c159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:38.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.432+0000 7f00329a6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f002c0b2650 0x7f002c0b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:38.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.432+0000 7f00329a6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f002c0cc640 0x7f002c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:38.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.432+0000 7f00329a6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f002c0b6300 con 0x7f00140039e0 2024-09-12T02:02:38.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.432+0000 7f00329a6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f002c0b6180 con 0x7f002c0b2650 2024-09-12T02:02:38.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.432+0000 7f00329a6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f002c0b2ff0 con 0x7f002c0cc640 2024-09-12T02:02:38.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.432+0000 7f002bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00140039e0 0x7f002c159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:38.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.432+0000 7f002bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00140039e0 0x7f002c159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41162/0 (socket says 172.21.15.19:41162) 2024-09-12T02:02:38.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.432+0000 7f002bfff640 1 -- 172.21.15.19:0/3649662018 learned_addr learned my addr 172.21.15.19:0/3649662018 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:38.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.432+0000 7f002b7fe640 1 --2- 172.21.15.19:0/3649662018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f002c0b2650 0x7f002c0b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:38.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.433+0000 7f0030f43640 1 --2- 172.21.15.19:0/3649662018 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f002c0cc640 0x7f002c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:38.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.433+0000 7f002bfff640 1 -- 172.21.15.19:0/3649662018 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f002c0cc640 msgr2=0x7f002c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:38.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.433+0000 7f002bfff640 1 --2- 172.21.15.19:0/3649662018 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f002c0cc640 0x7f002c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:38.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.433+0000 7f002bfff640 1 -- 172.21.15.19:0/3649662018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f002c0b2650 msgr2=0x7f002c0b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:38.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.433+0000 7f002bfff640 1 --2- 172.21.15.19:0/3649662018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f002c0b2650 0x7f002c0b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:38.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.433+0000 7f002bfff640 1 -- 172.21.15.19:0/3649662018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002c159f70 con 0x7f00140039e0 2024-09-12T02:02:38.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.433+0000 7f002bfff640 1 --2- 172.21.15.19:0/3649662018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00140039e0 0x7f002c159a30 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f001c00c330 tx=0x7f001c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:38.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.433+0000 7f0028ff9640 1 -- 172.21.15.19:0/3649662018 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c042020 con 0x7f00140039e0 2024-09-12T02:02:38.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.433+0000 7f0028ff9640 1 -- 172.21.15.19:0/3649662018 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f001c004bf0 con 0x7f00140039e0 2024-09-12T02:02:38.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.433+0000 7f00329a6640 1 -- 172.21.15.19:0/3649662018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f002c1f7ca0 con 0x7f00140039e0 2024-09-12T02:02:38.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.433+0000 7f0028ff9640 1 -- 172.21.15.19:0/3649662018 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c007d10 con 0x7f00140039e0 2024-09-12T02:02:38.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.433+0000 7f00329a6640 1 -- 172.21.15.19:0/3649662018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f002c1f8260 con 0x7f00140039e0 2024-09-12T02:02:38.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.434+0000 7f00329a6640 1 -- 172.21.15.19:0/3649662018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f002c068ea0 con 0x7f00140039e0 2024-09-12T02:02:38.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.435+0000 7f0028ff9640 1 -- 172.21.15.19:0/3649662018 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f001c045020 con 0x7f00140039e0 2024-09-12T02:02:38.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.435+0000 7f0028ff9640 1 --2- 172.21.15.19:0/3649662018 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f001806be30 0x7f001806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:38.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.435+0000 7f0028ff9640 1 -- 172.21.15.19:0/3649662018 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6303+0+0 (secure 0 0 0) 0x7f001c0ab1b0 con 0x7f00140039e0 2024-09-12T02:02:38.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.435+0000 7f002b7fe640 1 --2- 172.21.15.19:0/3649662018 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f001806be30 0x7f001806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:38.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.436+0000 7f002b7fe640 1 --2- 172.21.15.19:0/3649662018 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f001806be30 0x7f001806e2f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f002c0d2680 tx=0x7f0020008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:38.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.439+0000 7f0028ff9640 1 -- 172.21.15.19:0/3649662018 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f002c068ea0 con 0x7f00140039e0 2024-09-12T02:02:38.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.627+0000 7f00329a6640 1 -- 172.21.15.19:0/3649662018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f002c0d2a60 con 0x7f00140039e0 2024-09-12T02:02:38.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.627+0000 7f0028ff9640 1 -- 172.21.15.19:0/3649662018 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v95) ==== 80+0+124 (secure 0 0 0) 0x7f001c04c020 con 0x7f00140039e0 2024-09-12T02:02:38.627 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:02:38.628 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:02:38.628 INFO:teuthology.orchestra.run.smithi019.stderr:listed 2 entries 2024-09-12T02:02:38.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.629+0000 7f00329a6640 1 -- 172.21.15.19:0/3649662018 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f001806be30 msgr2=0x7f001806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.629+0000 7f00329a6640 1 --2- 172.21.15.19:0/3649662018 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f001806be30 0x7f001806e2f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f002c0d2680 tx=0x7f0020008040 comp rx=0 tx=0).stop 2024-09-12T02:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.629+0000 7f00329a6640 1 -- 172.21.15.19:0/3649662018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00140039e0 msgr2=0x7f002c159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.629+0000 7f00329a6640 1 --2- 172.21.15.19:0/3649662018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00140039e0 0x7f002c159a30 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f001c00c330 tx=0x7f001c001a40 comp rx=0 tx=0).stop 2024-09-12T02:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.629+0000 7f00329a6640 1 -- 172.21.15.19:0/3649662018 shutdown_connections 2024-09-12T02:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.629+0000 7f00329a6640 1 --2- 172.21.15.19:0/3649662018 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f001806be30 0x7f001806e2f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.629+0000 7f00329a6640 1 --2- 172.21.15.19:0/3649662018 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f002c0cc640 0x7f002c0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.629+0000 7f00329a6640 1 --2- 172.21.15.19:0/3649662018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f002c0b2650 0x7f002c0b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.629+0000 7f00329a6640 1 --2- 172.21.15.19:0/3649662018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00140039e0 0x7f002c159a30 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.629+0000 7f00329a6640 1 -- 172.21.15.19:0/3649662018 >> 172.21.15.19:0/3649662018 conn(0x7f002c0d44f0 msgr2=0x7f002c06cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.629+0000 7f00329a6640 1 -- 172.21.15.19:0/3649662018 shutdown_connections 2024-09-12T02:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.629+0000 7f00329a6640 1 -- 172.21.15.19:0/3649662018 wait complete. 2024-09-12T02:02:38.640 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:02:38.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:38.641 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-12T02:02:38.674 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:02:38.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:38.674 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:02:38.732 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:02:38.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.875+0000 7feae23a2640 1 Processor -- start 2024-09-12T02:02:38.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.875+0000 7feae23a2640 1 -- start start 2024-09-12T02:02:38.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.876+0000 7feae23a2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7feadc0d0dd0 0x7feadc0d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:38.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.876+0000 7feae23a2640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feadc0cf000 con 0x7feadc15e660 2024-09-12T02:02:38.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.876+0000 7feae23a2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feadc0d16f0 con 0x7feadc0d1f90 2024-09-12T02:02:38.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.876+0000 7feae23a2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7feadc06d3e0 con 0x7feadc0d0dd0 2024-09-12T02:02:38.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.876+0000 7feae0b9f640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7feadc15e660 0x7feadc06ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34060/0 (socket says 172.21.15.19:34060) 2024-09-12T02:02:38.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.876+0000 7feae0b9f640 1 -- 172.21.15.19:0/1772931970 learned_addr learned my addr 172.21.15.19:0/1772931970 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:38.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.876+0000 7fead3fff640 1 -- 172.21.15.19:0/1772931970 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1466042503 0 0) 0x7feadc0cf000 con 0x7feadc15e660 2024-09-12T02:02:38.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.876+0000 7feae13a0640 1 --2- 172.21.15.19:0/1772931970 >> v2:172.21.15.135:3300/0 conn(0x7feadc0d0dd0 0x7feadc0d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:38.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.876+0000 7fead3fff640 1 -- 172.21.15.19:0/1772931970 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feac8003520 con 0x7feadc15e660 2024-09-12T02:02:38.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7fead3fff640 1 -- 172.21.15.19:0/1772931970 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2419067114 0 0) 0x7feac8003520 con 0x7feadc15e660 2024-09-12T02:02:38.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7fead3fff640 1 -- 172.21.15.19:0/1772931970 >> v2:172.21.15.135:3300/0 conn(0x7feadc0d0dd0 msgr2=0x7feadc0d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:38.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7fead3fff640 1 --2- 172.21.15.19:0/1772931970 >> v2:172.21.15.135:3300/0 conn(0x7feadc0d0dd0 0x7feadc0d11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:38.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7fead3fff640 1 -- 172.21.15.19:0/1772931970 >> v1:172.21.15.135:6789/0 conn(0x7feadc0d1f90 legacy=0x7feadc0cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:38.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7fead3fff640 1 -- 172.21.15.19:0/1772931970 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feadc0d29a0 con 0x7feadc15e660 2024-09-12T02:02:38.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7fead3fff640 1 -- 172.21.15.19:0/1772931970 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7feacc001670 con 0x7feadc15e660 2024-09-12T02:02:38.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7feae13a0640 1 --2- 172.21.15.19:0/1772931970 >> v2:172.21.15.135:3300/0 conn(0x7feadc0d0dd0 0x7feadc0d11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:38.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7fead3fff640 1 -- 172.21.15.19:0/1772931970 >> v1:172.21.15.19:6789/0 conn(0x7feadc15e660 legacy=0x7feadc06ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:38.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7fead3fff640 1 --2- 172.21.15.19:0/1772931970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feac80039b0 0x7feac8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:38.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7fead3fff640 1 --2- 172.21.15.19:0/1772931970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac8004800 0x7feac8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:38.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7fead3fff640 1 --2- 172.21.15.19:0/1772931970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac80051c0 0x7feac800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:38.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7fead3fff640 1 -- 172.21.15.19:0/1772931970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feadc06d3e0 con 0x7feac80039b0 2024-09-12T02:02:38.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7fead3fff640 1 -- 172.21.15.19:0/1772931970 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feac800c110 con 0x7feac80051c0 2024-09-12T02:02:38.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7fead3fff640 1 -- 172.21.15.19:0/1772931970 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7feac800c310 con 0x7feac8004800 2024-09-12T02:02:38.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7feae13a0640 1 --2- 172.21.15.19:0/1772931970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feac80039b0 0x7feac8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:38.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7feae0b9f640 1 --2- 172.21.15.19:0/1772931970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac8004800 0x7feac8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:38.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7feae1ba1640 1 --2- 172.21.15.19:0/1772931970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac80051c0 0x7feac800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:38.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7feae13a0640 1 -- 172.21.15.19:0/1772931970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac8004800 msgr2=0x7feac8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:38.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7feae13a0640 1 --2- 172.21.15.19:0/1772931970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac8004800 0x7feac8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:38.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7feae13a0640 1 -- 172.21.15.19:0/1772931970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac80051c0 msgr2=0x7feac800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:38.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7feae13a0640 1 --2- 172.21.15.19:0/1772931970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac80051c0 0x7feac800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:38.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7feae13a0640 1 -- 172.21.15.19:0/1772931970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac8003520 con 0x7feac80039b0 2024-09-12T02:02:38.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.877+0000 7feae1ba1640 1 -- 172.21.15.19:0/1772931970 reap_dead start 2024-09-12T02:02:38.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.878+0000 7feae13a0640 1 --2- 172.21.15.19:0/1772931970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feac80039b0 0x7feac8003dd0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fead80098a0 tx=0x7feac8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ef42d1245ae04a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:38.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.878+0000 7fead3fff640 1 -- 172.21.15.19:0/1772931970 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead800f040 con 0x7feac80039b0 2024-09-12T02:02:38.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.878+0000 7fead3fff640 1 -- 172.21.15.19:0/1772931970 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead802ace0 con 0x7feac80039b0 2024-09-12T02:02:38.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.878+0000 7fead3fff640 1 -- 172.21.15.19:0/1772931970 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead8004250 con 0x7feac80039b0 2024-09-12T02:02:38.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.878+0000 7feae23a2640 1 -- 172.21.15.19:0/1772931970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feac80039b0 msgr2=0x7feac8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:38.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.878+0000 7feae23a2640 1 --2- 172.21.15.19:0/1772931970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feac80039b0 0x7feac8003dd0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fead80098a0 tx=0x7feac8005830 comp rx=0 tx=0).stop 2024-09-12T02:02:38.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.878+0000 7feae23a2640 1 -- 172.21.15.19:0/1772931970 shutdown_connections 2024-09-12T02:02:38.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.878+0000 7feae23a2640 1 --2- 172.21.15.19:0/1772931970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feac80039b0 0x7feac8003dd0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:38.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.878+0000 7feae23a2640 1 -- 172.21.15.19:0/1772931970 >> 172.21.15.19:0/1772931970 conn(0x7feadc08bfc0 msgr2=0x7feadc0d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:38.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.879+0000 7feae23a2640 1 -- 172.21.15.19:0/1772931970 shutdown_connections 2024-09-12T02:02:38.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.879+0000 7feae23a2640 1 -- 172.21.15.19:0/1772931970 wait complete. 2024-09-12T02:02:38.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.880+0000 7feae23a2640 1 Processor -- start 2024-09-12T02:02:38.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.880+0000 7feae23a2640 1 -- start start 2024-09-12T02:02:38.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.880+0000 7feae23a2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac80039b0 0x7feadc15b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:38.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.880+0000 7feae23a2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feadc0ca9a0 0x7feadc0b97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:38.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7feae23a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feadc0cae20 0x7feadc0b9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:38.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7feae23a2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feadc0cf330 con 0x7feadc0cae20 2024-09-12T02:02:38.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7feae23a2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feadc0d2f40 con 0x7feadc0ca9a0 2024-09-12T02:02:38.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7feae23a2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7feadc0d3220 con 0x7feac80039b0 2024-09-12T02:02:38.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7feae1ba1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feadc0cae20 0x7feadc0b9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:38.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7feae1ba1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feadc0cae20 0x7feadc0b9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41174/0 (socket says 172.21.15.19:41174) 2024-09-12T02:02:38.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7feae1ba1640 1 -- 172.21.15.19:0/3393048769 learned_addr learned my addr 172.21.15.19:0/3393048769 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:38.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7feae13a0640 1 --2- 172.21.15.19:0/3393048769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac80039b0 0x7feadc15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:38.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7feae0b9f640 1 --2- 172.21.15.19:0/3393048769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feadc0ca9a0 0x7feadc0b97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:38.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7feae1ba1640 1 -- 172.21.15.19:0/3393048769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac80039b0 msgr2=0x7feadc15b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:38.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7feae1ba1640 1 --2- 172.21.15.19:0/3393048769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac80039b0 0x7feadc15b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:38.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7feae1ba1640 1 -- 172.21.15.19:0/3393048769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feadc0ca9a0 msgr2=0x7feadc0b97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:38.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7feae1ba1640 1 --2- 172.21.15.19:0/3393048769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feadc0ca9a0 0x7feadc0b97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:38.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7feae1ba1640 1 -- 172.21.15.19:0/3393048769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feadc0c99a0 con 0x7feadc0cae20 2024-09-12T02:02:38.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7feae1ba1640 1 --2- 172.21.15.19:0/3393048769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feadc0cae20 0x7feadc0b9ce0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fead4007fd0 tx=0x7fead400e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:38.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7fead1ffb640 1 -- 172.21.15.19:0/3393048769 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead4019070 con 0x7feadc0cae20 2024-09-12T02:02:38.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7fead1ffb640 1 -- 172.21.15.19:0/3393048769 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead4006e20 con 0x7feadc0cae20 2024-09-12T02:02:38.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7feae23a2640 1 -- 172.21.15.19:0/3393048769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feadc0c9c80 con 0x7feadc0cae20 2024-09-12T02:02:38.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.881+0000 7fead1ffb640 1 -- 172.21.15.19:0/3393048769 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead4003bb0 con 0x7feadc0cae20 2024-09-12T02:02:38.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.882+0000 7feae23a2640 1 -- 172.21.15.19:0/3393048769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feadc0cb490 con 0x7feadc0cae20 2024-09-12T02:02:38.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.882+0000 7feae23a2640 1 -- 172.21.15.19:0/3393048769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feadc0d2420 con 0x7feadc0cae20 2024-09-12T02:02:38.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.883+0000 7fead1ffb640 1 -- 172.21.15.19:0/3393048769 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fead401c070 con 0x7feadc0cae20 2024-09-12T02:02:38.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.883+0000 7fead1ffb640 1 --2- 172.21.15.19:0/3393048769 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7feac006be60 0x7feac006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:38.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.883+0000 7fead1ffb640 1 -- 172.21.15.19:0/3393048769 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6303+0+0 (secure 0 0 0) 0x7fead408a3b0 con 0x7feadc0cae20 2024-09-12T02:02:38.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.884+0000 7feae13a0640 1 --2- 172.21.15.19:0/3393048769 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7feac006be60 0x7feac006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:38.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.884+0000 7feae13a0640 1 --2- 172.21.15.19:0/3393048769 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7feac006be60 0x7feac006e320 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fead8033000 tx=0x7fead802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:38.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:38.888+0000 7fead1ffb640 1 -- 172.21.15.19:0/3393048769 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fead4058550 con 0x7feadc0cae20 2024-09-12T02:02:39.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.103+0000 7feae23a2640 1 -- 172.21.15.19:0/3393048769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7feadc0d1b20 con 0x7feadc0cae20 2024-09-12T02:02:39.104 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:02:39.103+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:02:39.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.104+0000 7fead1ffb640 1 -- 172.21.15.19:0/3393048769 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v86) ==== 161+0+0 (secure 0 0 0) 0x7fead405c850 con 0x7feadc0cae20 2024-09-12T02:02:39.105 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:02:39.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.107+0000 7feae23a2640 1 -- 172.21.15.19:0/3393048769 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7feac006be60 msgr2=0x7feac006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:39.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.107+0000 7feae23a2640 1 --2- 172.21.15.19:0/3393048769 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7feac006be60 0x7feac006e320 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fead8033000 tx=0x7fead802e000 comp rx=0 tx=0).stop 2024-09-12T02:02:39.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.107+0000 7feae23a2640 1 -- 172.21.15.19:0/3393048769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feadc0cae20 msgr2=0x7feadc0b9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:39.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.107+0000 7feae23a2640 1 --2- 172.21.15.19:0/3393048769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feadc0cae20 0x7feadc0b9ce0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fead4007fd0 tx=0x7fead400e940 comp rx=0 tx=0).stop 2024-09-12T02:02:39.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.108+0000 7feae23a2640 1 -- 172.21.15.19:0/3393048769 shutdown_connections 2024-09-12T02:02:39.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.108+0000 7feae23a2640 1 --2- 172.21.15.19:0/3393048769 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7feac006be60 0x7feac006e320 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:39.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.108+0000 7feae23a2640 1 --2- 172.21.15.19:0/3393048769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feadc0cae20 0x7feadc0b9ce0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:39.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.108+0000 7feae23a2640 1 --2- 172.21.15.19:0/3393048769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feadc0ca9a0 0x7feadc0b97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:39.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.108+0000 7feae23a2640 1 --2- 172.21.15.19:0/3393048769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac80039b0 0x7feadc15b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:39.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.108+0000 7feae23a2640 1 -- 172.21.15.19:0/3393048769 >> 172.21.15.19:0/3393048769 conn(0x7feadc08bfc0 msgr2=0x7feadc06ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:39.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.108+0000 7feae23a2640 1 -- 172.21.15.19:0/3393048769 shutdown_connections 2024-09-12T02:02:39.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.108+0000 7feae23a2640 1 -- 172.21.15.19:0/3393048769 wait complete. 2024-09-12T02:02:39.110 INFO:tasks.ceph.mds.c.smithi019.stderr: -654> 2024-09-12T02:02:33.617+0000 7f0662bd7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:02:39.111 INFO:tasks.ceph.mds.c.smithi019.stderr: -160> 2024-09-12T02:02:38.167+0000 7f065ebcf640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/subdir) 2024-09-12T02:02:39.122 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:02:39.137 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:02:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.226+0000 7f4ffc0d0640 1 Processor -- start 2024-09-12T02:02:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.226+0000 7f4ffc0d0640 1 -- start start 2024-09-12T02:02:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.227+0000 7f4ffc0d0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ff406dbd0 0x7f4ff409b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.227+0000 7f4ffc0d0640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ff40d1970 con 0x7f4ff415e740 2024-09-12T02:02:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.227+0000 7f4ffc0d0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ff406e000 con 0x7f4ff40d1540 2024-09-12T02:02:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.227+0000 7f4ffc0d0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff415eb20 con 0x7f4ff406dbd0 2024-09-12T02:02:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.227+0000 7f4ff9e6c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4ff415e740 0x7f4ff406d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34064/0 (socket says 172.21.15.19:34064) 2024-09-12T02:02:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.227+0000 7f4ff9e6c640 1 -- 172.21.15.19:0/743133098 learned_addr learned my addr 172.21.15.19:0/743133098 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.227+0000 7f4ffa66d640 1 --2- 172.21.15.19:0/743133098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ff406dbd0 0x7f4ff409b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.227+0000 7f4ff8e6a640 1 -- 172.21.15.19:0/743133098 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3893906717 0 0) 0x7f4ff40d1970 con 0x7f4ff415e740 2024-09-12T02:02:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.227+0000 7f4ff8e6a640 1 -- 172.21.15.19:0/743133098 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fe0003520 con 0x7f4ff415e740 2024-09-12T02:02:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.227+0000 7f4ff8e6a640 1 -- 172.21.15.19:0/743133098 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3830405051 0 0) 0x7f4ff406e000 con 0x7f4ff40d1540 2024-09-12T02:02:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.227+0000 7f4ff8e6a640 1 -- 172.21.15.19:0/743133098 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ff40d1970 con 0x7f4ff40d1540 2024-09-12T02:02:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.227+0000 7f4ff8e6a640 1 -- 172.21.15.19:0/743133098 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2528891137 0 0) 0x7f4fe0003520 con 0x7f4ff415e740 2024-09-12T02:02:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.227+0000 7f4ff8e6a640 1 -- 172.21.15.19:0/743133098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ff406dbd0 msgr2=0x7f4ff409b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.227+0000 7f4ff8e6a640 1 --2- 172.21.15.19:0/743133098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ff406dbd0 0x7f4ff409b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.227+0000 7f4ff8e6a640 1 -- 172.21.15.19:0/743133098 >> v1:172.21.15.135:6789/0 conn(0x7f4ff40d1540 legacy=0x7f4ff4070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.228+0000 7f4ff8e6a640 1 -- 172.21.15.19:0/743133098 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff40d0780 con 0x7f4ff415e740 2024-09-12T02:02:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.228+0000 7f4ff8e6a640 1 -- 172.21.15.19:0/743133098 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f4ff0001670 con 0x7f4ff415e740 2024-09-12T02:02:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.228+0000 7f4ff8e6a640 1 -- 172.21.15.19:0/743133098 >> v1:172.21.15.19:6789/0 conn(0x7f4ff415e740 legacy=0x7f4ff406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.228+0000 7f4ff8e6a640 1 --2- 172.21.15.19:0/743133098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ff406dbd0 0x7f4fe0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.228+0000 7f4ff8e6a640 1 --2- 172.21.15.19:0/743133098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fe00040d0 0x7f4fe0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.228+0000 7f4ff8e6a640 1 --2- 172.21.15.19:0/743133098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fe0004d40 0x7f4fe00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.228+0000 7f4ff8e6a640 1 -- 172.21.15.19:0/743133098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff415eb20 con 0x7f4fe00040d0 2024-09-12T02:02:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.228+0000 7f4ff8e6a640 1 -- 172.21.15.19:0/743133098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe000baa0 con 0x7f4fe0004d40 2024-09-12T02:02:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.228+0000 7f4ff8e6a640 1 -- 172.21.15.19:0/743133098 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe000bca0 con 0x7f4ff406dbd0 2024-09-12T02:02:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.228+0000 7f4ff966b640 1 --2- 172.21.15.19:0/743133098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fe00040d0 0x7f4fe0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.228+0000 7f4ff9e6c640 1 --2- 172.21.15.19:0/743133098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ff406dbd0 0x7f4fe0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.228+0000 7f4ffa66d640 1 --2- 172.21.15.19:0/743133098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fe0004d40 0x7f4fe00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.228+0000 7f4ff966b640 1 -- 172.21.15.19:0/743133098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ff406dbd0 msgr2=0x7f4fe0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.228+0000 7f4ff966b640 1 --2- 172.21.15.19:0/743133098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ff406dbd0 0x7f4fe0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.228+0000 7f4ff966b640 1 -- 172.21.15.19:0/743133098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fe0004d40 msgr2=0x7f4fe00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.228+0000 7f4ff966b640 1 --2- 172.21.15.19:0/743133098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fe0004d40 0x7f4fe00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.228+0000 7f4ff966b640 1 -- 172.21.15.19:0/743133098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe0003520 con 0x7f4fe00040d0 2024-09-12T02:02:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.228+0000 7f4ff9e6c640 1 --2- 172.21.15.19:0/743133098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ff406dbd0 0x7f4fe0003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.229+0000 7f4ff966b640 1 --2- 172.21.15.19:0/743133098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fe00040d0 0x7f4fe0004800 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40018d0 tx=0x7f4fe0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2832e767ab2186f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.229+0000 7f4ff8e6a640 1 -- 172.21.15.19:0/743133098 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe40014f0 con 0x7f4fe00040d0 2024-09-12T02:02:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.229+0000 7f4ff8e6a640 1 -- 172.21.15.19:0/743133098 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe40052d0 con 0x7f4fe00040d0 2024-09-12T02:02:39.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.229+0000 7f4ff8e6a640 1 -- 172.21.15.19:0/743133098 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe402aca0 con 0x7f4fe00040d0 2024-09-12T02:02:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.229+0000 7f4ffc0d0640 1 -- 172.21.15.19:0/743133098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fe00040d0 msgr2=0x7f4fe0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.229+0000 7f4ffc0d0640 1 --2- 172.21.15.19:0/743133098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fe00040d0 0x7f4fe0004800 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40018d0 tx=0x7f4fe0005830 comp rx=0 tx=0).stop 2024-09-12T02:02:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.229+0000 7f4ffa66d640 1 -- 172.21.15.19:0/743133098 reap_dead start 2024-09-12T02:02:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.230+0000 7f4ffc0d0640 1 -- 172.21.15.19:0/743133098 shutdown_connections 2024-09-12T02:02:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.230+0000 7f4ffc0d0640 1 -- 172.21.15.19:0/743133098 >> 172.21.15.19:0/743133098 conn(0x7f4ff40d23a0 msgr2=0x7f4ff40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.230+0000 7f4ffc0d0640 1 -- 172.21.15.19:0/743133098 shutdown_connections 2024-09-12T02:02:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.230+0000 7f4ffc0d0640 1 -- 172.21.15.19:0/743133098 wait complete. 2024-09-12T02:02:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.231+0000 7f4ffc0d0640 1 Processor -- start 2024-09-12T02:02:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.231+0000 7f4ffc0d0640 1 -- start start 2024-09-12T02:02:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ffc0d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fe00040d0 0x7f4ff415cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ffc0d0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ff40c8660 0x7f4ff40b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ffc0d0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff40c8ae0 0x7f4ff40b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ffc0d0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff40d1020 con 0x7f4fe00040d0 2024-09-12T02:02:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ffc0d0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff40d0d40 con 0x7f4ff40c8ae0 2024-09-12T02:02:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ffc0d0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff409b690 con 0x7f4ff40c8660 2024-09-12T02:02:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ff9e6c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fe00040d0 0x7f4ff415cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ff9e6c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fe00040d0 0x7f4ff415cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41194/0 (socket says 172.21.15.19:41194) 2024-09-12T02:02:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ff9e6c640 1 -- 172.21.15.19:0/793728630 learned_addr learned my addr 172.21.15.19:0/793728630 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ffa66d640 1 --2- 172.21.15.19:0/793728630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff40c8ae0 0x7f4ff40b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ff966b640 1 --2- 172.21.15.19:0/793728630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ff40c8660 0x7f4ff40b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ff9e6c640 1 -- 172.21.15.19:0/793728630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ff40c8660 msgr2=0x7f4ff40b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ff9e6c640 1 --2- 172.21.15.19:0/793728630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ff40c8660 0x7f4ff40b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ff9e6c640 1 -- 172.21.15.19:0/793728630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff40c8ae0 msgr2=0x7f4ff40b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ff9e6c640 1 --2- 172.21.15.19:0/793728630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff40c8ae0 0x7f4ff40b5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ff9e6c640 1 -- 172.21.15.19:0/793728630 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff40b7250 con 0x7f4fe00040d0 2024-09-12T02:02:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ff9e6c640 1 --2- 172.21.15.19:0/793728630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fe00040d0 0x7f4ff415cc90 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0007310 tx=0x7f4ff00077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4fea7fc640 1 -- 172.21.15.19:0/793728630 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff000fa80 con 0x7f4fe00040d0 2024-09-12T02:02:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4fea7fc640 1 -- 172.21.15.19:0/793728630 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff0018070 con 0x7f4fe00040d0 2024-09-12T02:02:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ffc0d0640 1 -- 172.21.15.19:0/793728630 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff40b74f0 con 0x7f4fe00040d0 2024-09-12T02:02:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4fea7fc640 1 -- 172.21.15.19:0/793728630 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff000fe20 con 0x7f4fe00040d0 2024-09-12T02:02:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.232+0000 7f4ffc0d0640 1 -- 172.21.15.19:0/793728630 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff40b7ab0 con 0x7f4fe00040d0 2024-09-12T02:02:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.234+0000 7f4ffc0d0640 1 -- 172.21.15.19:0/793728630 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff409ba00 con 0x7f4fe00040d0 2024-09-12T02:02:39.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.234+0000 7f4fea7fc640 1 -- 172.21.15.19:0/793728630 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ff001d460 con 0x7f4fe00040d0 2024-09-12T02:02:39.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.235+0000 7f4fea7fc640 1 --2- 172.21.15.19:0/793728630 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4fd806be30 0x7f4fd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:39.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.235+0000 7f4fea7fc640 1 -- 172.21.15.19:0/793728630 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6389+0+0 (secure 0 0 0) 0x7f4ff008b250 con 0x7f4fe00040d0 2024-09-12T02:02:39.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.235+0000 7f4ff966b640 1 --2- 172.21.15.19:0/793728630 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4fd806be30 0x7f4fd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:39.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.235+0000 7f4ff966b640 1 --2- 172.21.15.19:0/793728630 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4fd806be30 0x7f4fd806e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4032000 tx=0x7f4fe4009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:39.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.239+0000 7f4fea7fc640 1 -- 172.21.15.19:0/793728630 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ff00599e0 con 0x7f4fe00040d0 2024-09-12T02:02:39.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:39.485+0000 7f4ffc0d0640 1 -- 172.21.15.19:0/793728630 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f4ff40cc490 con 0x7f4fe00040d0 2024-09-12T02:02:40.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.106+0000 7f4fea7fc640 1 -- 172.21.15.19:0/793728630 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v87) ==== 107+0+0 (secure 0 0 0) 0x7f4ff00592e0 con 0x7f4fe00040d0 2024-09-12T02:02:40.106 INFO:teuthology.orchestra.run.smithi019.stderr:nothing to do: rank is not damaged 2024-09-12T02:02:40.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.108+0000 7f4ffc0d0640 1 -- 172.21.15.19:0/793728630 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4fd806be30 msgr2=0x7f4fd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.108+0000 7f4ffc0d0640 1 --2- 172.21.15.19:0/793728630 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4fd806be30 0x7f4fd806e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4032000 tx=0x7f4fe4009030 comp rx=0 tx=0).stop 2024-09-12T02:02:40.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.108+0000 7f4ffc0d0640 1 -- 172.21.15.19:0/793728630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fe00040d0 msgr2=0x7f4ff415cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.108+0000 7f4ffc0d0640 1 --2- 172.21.15.19:0/793728630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fe00040d0 0x7f4ff415cc90 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0007310 tx=0x7f4ff00077d0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.108+0000 7f4ffc0d0640 1 -- 172.21.15.19:0/793728630 shutdown_connections 2024-09-12T02:02:40.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.108+0000 7f4ffc0d0640 1 --2- 172.21.15.19:0/793728630 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4fd806be30 0x7f4fd806e2f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.108+0000 7f4ffc0d0640 1 --2- 172.21.15.19:0/793728630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff40c8ae0 0x7f4ff40b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.108+0000 7f4ffc0d0640 1 --2- 172.21.15.19:0/793728630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ff40c8660 0x7f4ff40b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.108+0000 7f4ffc0d0640 1 --2- 172.21.15.19:0/793728630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fe00040d0 0x7f4ff415cc90 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.108+0000 7f4ffc0d0640 1 -- 172.21.15.19:0/793728630 >> 172.21.15.19:0/793728630 conn(0x7f4ff40d23a0 msgr2=0x7f4ff415d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:40.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.108+0000 7f4ffc0d0640 1 -- 172.21.15.19:0/793728630 shutdown_connections 2024-09-12T02:02:40.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.108+0000 7f4ffc0d0640 1 -- 172.21.15.19:0/793728630 wait complete. 2024-09-12T02:02:40.122 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:02:40.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.210+0000 7ff22923cf40 1 Processor -- start 2024-09-12T02:02:40.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.210+0000 7ff22923cf40 1 -- start start 2024-09-12T02:02:40.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.210+0000 7ff22923cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2100030f0 0x55d236e42310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.210+0000 7ff22923cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d236e44400 0x55d236e44880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.210+0000 7ff22923cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d236e44dc0 0x55d236f644a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.210+0000 7ff22923cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d236d4c510 con 0x55d236e44400 2024-09-12T02:02:40.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.210+0000 7ff22923cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d236dfaf20 con 0x7ff2100030f0 2024-09-12T02:02:40.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.210+0000 7ff22923cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55d236e45270 con 0x55d236e44dc0 2024-09-12T02:02:40.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.210+0000 7ff226531640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d236e44400 0x55d236e44880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.211+0000 7ff226531640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d236e44400 0x55d236e44880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41210/0 (socket says 172.21.15.19:41210) 2024-09-12T02:02:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.211+0000 7ff226531640 1 -- 172.21.15.19:0/464961044 learned_addr learned my addr 172.21.15.19:0/464961044 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.211+0000 7ff226d32640 1 --2- 172.21.15.19:0/464961044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2100030f0 0x55d236e42310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.211+0000 7ff227533640 1 --2- 172.21.15.19:0/464961044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d236e44dc0 0x55d236f644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.211+0000 7ff226531640 1 -- 172.21.15.19:0/464961044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d236e44dc0 msgr2=0x55d236f644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.211+0000 7ff226531640 1 --2- 172.21.15.19:0/464961044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d236e44dc0 0x55d236f644a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.211+0000 7ff226531640 1 -- 172.21.15.19:0/464961044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2100030f0 msgr2=0x55d236e42310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.211+0000 7ff226531640 1 --2- 172.21.15.19:0/464961044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2100030f0 0x55d236e42310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.211+0000 7ff226531640 1 -- 172.21.15.19:0/464961044 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d236dfe850 con 0x55d236e44400 2024-09-12T02:02:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.211+0000 7ff226d32640 1 --2- 172.21.15.19:0/464961044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2100030f0 0x55d236e42310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.211+0000 7ff226531640 1 --2- 172.21.15.19:0/464961044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d236e44400 0x55d236e44880 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7ff21c026380 tx=0x7ff21c04f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6303dff59af7905 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.211+0000 7ff22552f640 1 -- 172.21.15.19:0/464961044 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c061450 con 0x55d236e44400 2024-09-12T02:02:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.211+0000 7ff22552f640 1 -- 172.21.15.19:0/464961044 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff21c066070 con 0x55d236e44400 2024-09-12T02:02:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.211+0000 7ff22552f640 1 -- 172.21.15.19:0/464961044 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c061850 con 0x55d236e44400 2024-09-12T02:02:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.212+0000 7ff22923cf40 1 -- 172.21.15.19:0/464961044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d236e44400 msgr2=0x55d236e44880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.212+0000 7ff22923cf40 1 --2- 172.21.15.19:0/464961044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d236e44400 0x55d236e44880 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7ff21c026380 tx=0x7ff21c04f000 comp rx=0 tx=0).stop 2024-09-12T02:02:40.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.212+0000 7ff22923cf40 1 -- 172.21.15.19:0/464961044 shutdown_connections 2024-09-12T02:02:40.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.212+0000 7ff22923cf40 1 --2- 172.21.15.19:0/464961044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d236e44dc0 0x55d236f644a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.212+0000 7ff22923cf40 1 --2- 172.21.15.19:0/464961044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d236e44400 0x55d236e44880 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.212+0000 7ff22923cf40 1 --2- 172.21.15.19:0/464961044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2100030f0 0x55d236e42310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.212+0000 7ff22923cf40 1 -- 172.21.15.19:0/464961044 >> 172.21.15.19:0/464961044 conn(0x55d236e28490 msgr2=0x55d236e41220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:40.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.212+0000 7ff22923cf40 1 -- 172.21.15.19:0/464961044 shutdown_connections 2024-09-12T02:02:40.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.212+0000 7ff22923cf40 1 -- 172.21.15.19:0/464961044 wait complete. 2024-09-12T02:02:40.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.212+0000 7ff22923cf40 1 Processor -- start 2024-09-12T02:02:40.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.212+0000 7ff22923cf40 1 -- start start 2024-09-12T02:02:40.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.213+0000 7ff22923cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d236e44400 0x55d236e44840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.213+0000 7ff22923cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d236e44dc0 0x55d236ebaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.213+0000 7ff22923cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2100030f0 0x55d236e3fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.213+0000 7ff22923cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d236e40bc0 con 0x55d236e44400 2024-09-12T02:02:40.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.213+0000 7ff22923cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d236e457b0 con 0x55d236e44dc0 2024-09-12T02:02:40.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.213+0000 7ff22923cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55d236ecde30 con 0x7ff2100030f0 2024-09-12T02:02:40.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.213+0000 7ff226d32640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d236e44400 0x55d236e44840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.213+0000 7ff226d32640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d236e44400 0x55d236e44840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41222/0 (socket says 172.21.15.19:41222) 2024-09-12T02:02:40.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.213+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 learned_addr learned my addr 172.21.15.19:0/3515194154 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:40.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.213+0000 7ff227533640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2100030f0 0x55d236e3fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.214+0000 7ff226531640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d236e44dc0 0x55d236ebaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.214+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2100030f0 msgr2=0x55d236e3fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.214+0000 7ff226d32640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2100030f0 0x55d236e3fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.214+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d236e44dc0 msgr2=0x55d236ebaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.214+0000 7ff226d32640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d236e44dc0 0x55d236ebaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.214+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d236f603f0 con 0x55d236e44400 2024-09-12T02:02:40.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.214+0000 7ff226d32640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d236e44400 0x55d236e44840 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7ff218009e30 tx=0x7ff218009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:40.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.214+0000 7ff20ffff640 1 -- 172.21.15.19:0/3515194154 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21801a020 con 0x55d236e44400 2024-09-12T02:02:40.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.214+0000 7ff20ffff640 1 -- 172.21.15.19:0/3515194154 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff218016640 con 0x55d236e44400 2024-09-12T02:02:40.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.214+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d236ecd470 con 0x55d236e44400 2024-09-12T02:02:40.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.214+0000 7ff20ffff640 1 -- 172.21.15.19:0/3515194154 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218016a10 con 0x55d236e44400 2024-09-12T02:02:40.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.214+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d236f5c780 con 0x55d236e44400 2024-09-12T02:02:40.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.215+0000 7ff20ffff640 1 -- 172.21.15.19:0/3515194154 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff21801d020 con 0x55d236e44400 2024-09-12T02:02:40.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.216+0000 7ff20ffff640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff21406a810 0x7ff21406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.216+0000 7ff20ffff640 1 -- 172.21.15.19:0/3515194154 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6389+0+0 (secure 0 0 0) 0x7ff21808a240 con 0x55d236e44400 2024-09-12T02:02:40.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.216+0000 7ff226531640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff21406a810 0x7ff21406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.220 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:02:40.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.216+0000 7ff22923cf40 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55d236f5cca0 0x55d236f5d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.216+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f5d5c0 con 0x55d236f5cca0 2024-09-12T02:02:40.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.216+0000 7ff227533640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55d236f5cca0 0x55d236f5d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.217+0000 7ff226531640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff21406a810 0x7ff21406ccd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff21c065000 tx=0x7ff21c051000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:40.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.217+0000 7ff227533640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55d236f5cca0 0x55d236f5d080 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:40.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.218+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v96'43 uv16 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.218+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f5d960 con 0x55d236f5cca0 2024-09-12T02:02:40.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.219+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v96'44 uv44 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.219+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f5ddc0 con 0x55d236f5cca0 2024-09-12T02:02:40.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.222+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v96'45 uv45 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.222 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:02:40.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.222+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f76790 con 0x55d236f5cca0 2024-09-12T02:02:40.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.223+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v96'46 uv46 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.223+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f76b30 con 0x55d236f5cca0 2024-09-12T02:02:40.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.226+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v96'47 uv47 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.226+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f75780 con 0x55d236f5cca0 2024-09-12T02:02:40.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.229+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v96'48 uv48 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.229+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f75b70 con 0x55d236f5cca0 2024-09-12T02:02:40.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.230+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v96'49 uv22 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.230+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f75f10 con 0x55d236f5cca0 2024-09-12T02:02:40.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.232+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v96'50 uv50 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.233+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f762b0 con 0x55d236f5cca0 2024-09-12T02:02:40.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.235+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v96'51 uv51 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.236 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:02:40.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.235+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f762b0 con 0x55d236f5cca0 2024-09-12T02:02:40.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.236+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v96'52 uv52 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.236+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f762b0 con 0x55d236f5cca0 2024-09-12T02:02:40.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.239+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v96'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.239+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f762b0 con 0x55d236f5cca0 2024-09-12T02:02:40.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.240+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v96'54 uv54 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.240+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f762b0 con 0x55d236f5cca0 2024-09-12T02:02:40.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.241+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v96'55 uv55 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.242 INFO:teuthology.orchestra.run.smithi019.stdout:Write #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:02:40.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.242+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f762b0 con 0x55d236f5cca0 2024-09-12T02:02:40.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.244+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [setxattr (30)] v96'56 uv56 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.244+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f762b0 con 0x55d236f5cca0 2024-09-12T02:02:40.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.245+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [setxattr (62)] v96'57 uv57 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.246+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f762b0 con 0x55d236f5cca0 2024-09-12T02:02:40.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.246+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [omap-set-header] v96'58 uv58 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.247+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f77380 con 0x55d236f5cca0 2024-09-12T02:02:40.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.249+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [omap-set-vals] v96'59 uv59 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.249+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f77380 con 0x55d236f5cca0 2024-09-12T02:02:40.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.252+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 600.00000000 [create] v96'60 uv35 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.252+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f77380 con 0x55d236f5cca0 2024-09-12T02:02:40.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.255+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 600.00000000 [delete] v96'61 uv61 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.255+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f77380 con 0x55d236f5cca0 2024-09-12T02:02:40.258 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:02:40.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.258+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v96'62 uv62 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.258+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f78390 con 0x55d236f5cca0 2024-09-12T02:02:40.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.259+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [setxattr (30)] v96'63 uv63 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.259+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f78390 con 0x55d236f5cca0 2024-09-12T02:02:40.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.262+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [setxattr (62)] v96'64 uv64 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.262+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f77380 con 0x55d236f5cca0 2024-09-12T02:02:40.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.265+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [omap-set-header] v96'65 uv65 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.265+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f77380 con 0x55d236f5cca0 2024-09-12T02:02:40.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.267+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 603.00000000 [create] v96'66 uv41 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.267+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f77380 con 0x55d236f5cca0 2024-09-12T02:02:40.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.270+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 603.00000000 [delete] v96'67 uv67 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.270+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f77380 con 0x55d236f5cca0 2024-09-12T02:02:40.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.273+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v96'68 uv68 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.273 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:02:40.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.273+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f78390 con 0x55d236f5cca0 2024-09-12T02:02:40.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.276+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [setxattr (30)] v96'69 uv69 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.276+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f78390 con 0x55d236f5cca0 2024-09-12T02:02:40.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.278+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [setxattr (62)] v96'70 uv70 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.278+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f77380 con 0x55d236f5cca0 2024-09-12T02:02:40.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.281+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [omap-set-header] v96'71 uv71 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f5cca0 2024-09-12T02:02:40.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.281+0000 7ff22923cf40 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55d236f77890 0x55d236f79c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.281+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:30 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7a1c0 con 0x55d236f77890 2024-09-12T02:02:40.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.281+0000 7ff226d32640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55d236f77890 0x55d236f79c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.281+0000 7ff226d32640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55d236f77890 0x55d236f79c80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:40.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.283+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(30 1.00000000.inode [create] v96'46 uv25 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.283+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:31 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7a560 con 0x55d236f77890 2024-09-12T02:02:40.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.284+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(31 1.00000000.inode [delete] v96'47 uv47 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.284+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7a900 con 0x55d236f77890 2024-09-12T02:02:40.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.285+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(32 1.00000000.inode [create] v96'48 uv48 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.286 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:02:40.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.285+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7b150 con 0x55d236f77890 2024-09-12T02:02:40.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.287+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(33 1.00000000.inode [write 0~582] v96'49 uv49 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.287+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7b4f0 con 0x55d236f77890 2024-09-12T02:02:40.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.289+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(34 1.00000000.inode [omap-set-header] v96'50 uv50 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.289+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7b890 con 0x55d236f77890 2024-09-12T02:02:40.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.291+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(35 200.00000000 [create] v96'51 uv44 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.291+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7bc30 con 0x55d236f77890 2024-09-12T02:02:40.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.292+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(36 200.00000000 [delete] v96'52 uv52 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.292+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7bfd0 con 0x55d236f77890 2024-09-12T02:02:40.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.293+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(37 200.00000000 [create] v96'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.293 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:02:40.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.293+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7bfd0 con 0x55d236f77890 2024-09-12T02:02:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.294+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(38 200.00000000 [write 0~90] v96'54 uv54 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.294+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7bfd0 con 0x55d236f77890 2024-09-12T02:02:40.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.295+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(39 200.00000000 [omap-set-header] v96'55 uv55 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.295+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7bfd0 con 0x55d236f77890 2024-09-12T02:02:40.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.298+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(40 200.00000001 [create] v96'56 uv45 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.298+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7bfd0 con 0x55d236f77890 2024-09-12T02:02:40.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.299+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(41 200.00000001 [delete] v96'57 uv57 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.299+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7bfd0 con 0x55d236f77890 2024-09-12T02:02:40.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.300+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(42 200.00000001 [create] v96'58 uv58 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.301 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:02:40.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.300+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f80450 con 0x55d236f77890 2024-09-12T02:02:40.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.302+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(43 200.00000001 [write 0~17490] v96'59 uv59 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.302+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f80450 con 0x55d236f77890 2024-09-12T02:02:40.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.303+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(44 200.00000001 [omap-set-header] v96'60 uv60 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.303+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7bfd0 con 0x55d236f77890 2024-09-12T02:02:40.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.304+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(45 606.00000000 [create] v96'61 uv41 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.304+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7bfd0 con 0x55d236f77890 2024-09-12T02:02:40.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.305+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(46 606.00000000 [delete] v96'62 uv62 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.305+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7bfd0 con 0x55d236f77890 2024-09-12T02:02:40.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.306+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(47 606.00000000 [create] v96'63 uv63 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.306 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:02:40.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.306+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7cfe0 con 0x55d236f77890 2024-09-12T02:02:40.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.307+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(48 606.00000000 [setxattr (30)] v96'64 uv64 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.307+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7cfe0 con 0x55d236f77890 2024-09-12T02:02:40.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.308+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(49 606.00000000 [setxattr (62)] v96'65 uv65 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.308+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7bfd0 con 0x55d236f77890 2024-09-12T02:02:40.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.309+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(50 606.00000000 [omap-set-header] v96'66 uv66 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f77890 2024-09-12T02:02:40.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.309+0000 7ff22923cf40 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d236f7c4e0 0x55d236f7e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.309+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:51 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7ee10 con 0x55d236f7c4e0 2024-09-12T02:02:40.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.309+0000 7ff226531640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d236f7c4e0 0x55d236f7e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.309+0000 7ff226531640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d236f7c4e0 0x55d236f7e8d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:40.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.311+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(51 607.00000000 [create] v96'9 uv8 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.311+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:52 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7f1b0 con 0x55d236f7c4e0 2024-09-12T02:02:40.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.313+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(52 607.00000000 [delete] v96'10 uv10 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.313+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7f550 con 0x55d236f7c4e0 2024-09-12T02:02:40.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.316+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(53 607.00000000 [create] v96'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.316 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:02:40.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.316+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f80db0 con 0x55d236f7c4e0 2024-09-12T02:02:40.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.319+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(54 607.00000000 [setxattr (30)] v96'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.319+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f81150 con 0x55d236f7c4e0 2024-09-12T02:02:40.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.320+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(55 607.00000000 [setxattr (62)] v96'13 uv13 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.320+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f7fda0 con 0x55d236f7c4e0 2024-09-12T02:02:40.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.322+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(56 607.00000000 [omap-set-header] v96'14 uv14 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.322+0000 7ff22923cf40 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55d236f806a0 0x55d236f83500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.322+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:57 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f83a40 con 0x55d236f806a0 2024-09-12T02:02:40.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.323+0000 7ff227533640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55d236f806a0 0x55d236f83500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.323+0000 7ff227533640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55d236f806a0 0x55d236f83500 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:40.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.324+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(57 mds0_openfiles.0 [create] v96'9 uv8 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.324+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:58 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f83a40 con 0x55d236f806a0 2024-09-12T02:02:40.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.325+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(58 mds0_openfiles.0 [delete] v96'10 uv10 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.325+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f83a40 con 0x55d236f806a0 2024-09-12T02:02:40.328 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:02:40.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.328+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(59 mds0_openfiles.0 [create] v96'11 uv11 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.328+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f83e30 con 0x55d236f806a0 2024-09-12T02:02:40.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.331+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(60 mds0_openfiles.0 [omap-set-header] v96'12 uv12 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.331+0000 7ff22923cf40 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d236f84340 0x55d236f86730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.331+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:61 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f86cb0 con 0x55d236f84340 2024-09-12T02:02:40.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.331+0000 7ff226d32640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d236f84340 0x55d236f86730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.331+0000 7ff226d32640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d236f84340 0x55d236f86730 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:40.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.333+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(61 608.00000000 [create] v96'9 uv8 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.333+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:62 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f84340 2024-09-12T02:02:40.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.336+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(62 608.00000000 [delete] v96'10 uv10 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.336+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f84340 2024-09-12T02:02:40.339 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:02:40.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.339+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(63 608.00000000 [create] v96'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.339+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f88090 con 0x55d236f84340 2024-09-12T02:02:40.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.342+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(64 608.00000000 [setxattr (30)] v96'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.342+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f88090 con 0x55d236f84340 2024-09-12T02:02:40.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.344+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(65 608.00000000 [setxattr (62)] v96'13 uv13 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.344+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f84340 2024-09-12T02:02:40.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.346+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(66 608.00000000 [omap-set-header] v96'14 uv14 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.346+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:67 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f806a0 2024-09-12T02:02:40.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.347+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(67 604.00000000 [create] v96'15 uv9 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.347+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:68 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f806a0 2024-09-12T02:02:40.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.348+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(68 604.00000000 [delete] v96'16 uv16 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.348+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f806a0 2024-09-12T02:02:40.349 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:02:40.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.349+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(69 604.00000000 [create] v96'17 uv17 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.349+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f88090 con 0x55d236f806a0 2024-09-12T02:02:40.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.350+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(70 604.00000000 [setxattr (30)] v96'18 uv18 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.350+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f88090 con 0x55d236f806a0 2024-09-12T02:02:40.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.351+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(71 604.00000000 [setxattr (62)] v96'19 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.351+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f806a0 2024-09-12T02:02:40.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.352+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(72 604.00000000 [omap-set-header] v96'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.352+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f806a0 2024-09-12T02:02:40.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.353+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(73 500.00000000 [create] v96'21 uv14 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.353+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f806a0 2024-09-12T02:02:40.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.354+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(74 500.00000000 [delete] v96'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.354+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f806a0 2024-09-12T02:02:40.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.355+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(75 500.00000000 [create] v96'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.355 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:02:40.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.355+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f806a0 2024-09-12T02:02:40.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.356+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(76 500.00000000 [write 0~90] v96'24 uv24 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.356+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f806a0 2024-09-12T02:02:40.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.357+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(77 500.00000000 [omap-set-header] v96'25 uv25 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.357+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f806a0 2024-09-12T02:02:40.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.358+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(78 mds_snaptable [create] v96'7 uv6 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.358+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f806a0 2024-09-12T02:02:40.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.359+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(79 mds_snaptable [delete] v96'8 uv8 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.359+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f806a0 2024-09-12T02:02:40.360 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:02:40.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.360+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(80 mds_snaptable [create] v96'9 uv9 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.360+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f806a0 2024-09-12T02:02:40.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.361+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(81 mds_snaptable [write 0~70] v96'10 uv10 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.361+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f806a0 2024-09-12T02:02:40.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.362+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(82 mds_snaptable [omap-set-header] v96'11 uv11 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ff220011040 con 0x55d236f806a0 2024-09-12T02:02:40.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.362+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:83 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f84340 2024-09-12T02:02:40.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.363+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(83 605.00000000 [create] v96'9 uv8 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.363+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:84 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f84340 2024-09-12T02:02:40.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.364+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(84 605.00000000 [delete] v96'10 uv10 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.364+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87080 con 0x55d236f84340 2024-09-12T02:02:40.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.367+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(85 605.00000000 [create] v96'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.367 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:02:40.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.367+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f884a0 con 0x55d236f84340 2024-09-12T02:02:40.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.369+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(86 605.00000000 [setxattr (30)] v96'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.369+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f884a0 con 0x55d236f84340 2024-09-12T02:02:40.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.372+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(87 605.00000000 [setxattr (62)] v96'13 uv13 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.372+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87490 con 0x55d236f84340 2024-09-12T02:02:40.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.374+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(88 605.00000000 [omap-set-header] v96'14 uv14 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.374+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87490 con 0x55d236f84340 2024-09-12T02:02:40.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.377+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(89 mds0_inotable [create] v96'14 uv8 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.377+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87490 con 0x55d236f84340 2024-09-12T02:02:40.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.379+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(90 mds0_inotable [delete] v96'15 uv15 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.379+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87490 con 0x55d236f84340 2024-09-12T02:02:40.382 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:02:40.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.382+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(91 mds0_inotable [create] v96'16 uv16 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.382+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87490 con 0x55d236f84340 2024-09-12T02:02:40.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.383+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(92 mds0_inotable [write 0~34] v96'17 uv17 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.383+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87490 con 0x55d236f84340 2024-09-12T02:02:40.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.384+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v96'18 uv18 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.384+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87490 con 0x55d236f84340 2024-09-12T02:02:40.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.385+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(94 100.00000000 [create] v96'19 uv13 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.385+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87490 con 0x55d236f84340 2024-09-12T02:02:40.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.386+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(95 100.00000000 [delete] v96'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.386+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87490 con 0x55d236f84340 2024-09-12T02:02:40.387 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:02:40.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.387+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(96 100.00000000 [create] v96'21 uv21 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.387+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f87490 con 0x55d236f84340 2024-09-12T02:02:40.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.388+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(97 100.00000000 [omap-set-header] v96'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.388+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8a2a0 con 0x55d236f84340 2024-09-12T02:02:40.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.389+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v96'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.389+0000 7ff22923cf40 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d236f87e50 0x55d236f8a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.389+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:99 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8a240 con 0x55d236f87e50 2024-09-12T02:02:40.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.389+0000 7ff226531640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d236f87e50 0x55d236f8a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.390+0000 7ff226531640 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d236f87e50 0x55d236f8a6e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:40.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.391+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(99 mds0_sessionmap [create] v96'9 uv7 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f87e50 2024-09-12T02:02:40.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.391+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:100 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac20 con 0x55d236f87e50 2024-09-12T02:02:40.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.392+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(100 mds0_sessionmap [delete] v96'10 uv10 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f87e50 2024-09-12T02:02:40.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.392+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac20 con 0x55d236f87e50 2024-09-12T02:02:40.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.393+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(101 mds0_sessionmap [create] v96'11 uv11 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f87e50 2024-09-12T02:02:40.394 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:02:40.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.393+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac20 con 0x55d236f87e50 2024-09-12T02:02:40.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.394+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v96'12 uv12 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f87e50 2024-09-12T02:02:40.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.394+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:103 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac20 con 0x55d236f84340 2024-09-12T02:02:40.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.395+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(103 609.00000000 [create] v96'9 uv8 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.395+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:104 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac20 con 0x55d236f84340 2024-09-12T02:02:40.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.397+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(104 609.00000000 [delete] v96'10 uv10 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.397+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac20 con 0x55d236f84340 2024-09-12T02:02:40.398 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:02:40.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.398+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(105 609.00000000 [create] v96'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.398+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8bc30 con 0x55d236f84340 2024-09-12T02:02:40.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.399+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v96'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.399+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8bc30 con 0x55d236f84340 2024-09-12T02:02:40.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.400+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v96'13 uv13 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.400+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac20 con 0x55d236f84340 2024-09-12T02:02:40.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.401+0000 7ff226d32640 1 -- 172.21.15.19:0/3515194154 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(108 609.00000000 [omap-set-header] v96'14 uv14 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff218054940 con 0x55d236f84340 2024-09-12T02:02:40.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.401+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:109 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac20 con 0x55d236f7c4e0 2024-09-12T02:02:40.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.402+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(109 400.00000000 [create] v96'7 uv6 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.403+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:110 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac20 con 0x55d236f7c4e0 2024-09-12T02:02:40.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.404+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(110 400.00000000 [delete] v96'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.404+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac20 con 0x55d236f7c4e0 2024-09-12T02:02:40.405 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:02:40.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.405+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(111 400.00000000 [create] v96'9 uv9 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.405+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac20 con 0x55d236f7c4e0 2024-09-12T02:02:40.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.406+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(112 400.00000000 [write 0~22] v96'10 uv10 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.406+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac20 con 0x55d236f7c4e0 2024-09-12T02:02:40.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.407+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(113 400.00000000 [omap-set-header] v96'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.407+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac20 con 0x55d236f7c4e0 2024-09-12T02:02:40.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.408+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(114 100.00000000.inode [create] v96'20 uv11 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.408+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac80 con 0x55d236f7c4e0 2024-09-12T02:02:40.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.409+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(115 100.00000000.inode [delete] v96'21 uv21 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.409+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac80 con 0x55d236f7c4e0 2024-09-12T02:02:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.412+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(116 100.00000000.inode [create] v96'22 uv22 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.412 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:02:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.412+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac80 con 0x55d236f7c4e0 2024-09-12T02:02:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.413+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v96'23 uv23 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.413+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac20 con 0x55d236f7c4e0 2024-09-12T02:02:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.414+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v96'24 uv24 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.414+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac20 con 0x55d236f7c4e0 2024-09-12T02:02:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.414+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(119 1.00000000 [create] v96'25 uv18 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.415+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac20 con 0x55d236f7c4e0 2024-09-12T02:02:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.415+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(120 1.00000000 [delete] v96'26 uv26 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.415+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8ac20 con 0x55d236f7c4e0 2024-09-12T02:02:40.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.416+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(121 1.00000000 [create] v96'27 uv27 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.417 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:02:40.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.416+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8c020 con 0x55d236f7c4e0 2024-09-12T02:02:40.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.417+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v96'28 uv28 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.417+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8c020 con 0x55d236f7c4e0 2024-09-12T02:02:40.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.418+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v96'29 uv29 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.418+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8acf0 con 0x55d236f7c4e0 2024-09-12T02:02:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.419+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(124 1.00000000 [omap-set-header] v96'30 uv30 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.419+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x55d236f8b150 con 0x55d236f7c4e0 2024-09-12T02:02:40.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff226531640 1 -- 172.21.15.19:0/3515194154 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v96'31 uv31 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7ff21c0617e0 con 0x55d236f7c4e0 2024-09-12T02:02:40.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55d236f77890 msgr2=0x55d236f79c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55d236f77890 0x55d236f79c80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55d236f5cca0 msgr2=0x55d236f5d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55d236f5cca0 0x55d236f5d080 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55d236f806a0 msgr2=0x55d236f83500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55d236f806a0 0x55d236f83500 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d236f87e50 msgr2=0x55d236f8a6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d236f87e50 0x55d236f8a6e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d236f7c4e0 msgr2=0x55d236f7e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d236f7c4e0 0x55d236f7e8d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d236f84340 msgr2=0x55d236f86730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d236f84340 0x55d236f86730 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 reap_dead start 2024-09-12T02:02:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff227533640 1 -- 172.21.15.19:0/3515194154 reap_dead start 2024-09-12T02:02:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff21406a810 msgr2=0x7ff21406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff21406a810 0x7ff21406ccd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff21c065000 tx=0x7ff21c051000 comp rx=0 tx=0).stop 2024-09-12T02:02:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d236e44400 msgr2=0x55d236e44840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d236e44400 0x55d236e44840 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7ff218009e30 tx=0x7ff218009f20 comp rx=0 tx=0).stop 2024-09-12T02:02:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 shutdown_connections 2024-09-12T02:02:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff21406a810 0x7ff21406ccd0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 --2- 172.21.15.19:0/3515194154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d236e44400 0x55d236e44840 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.420+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 >> 172.21.15.19:0/3515194154 conn(0x55d236e28490 msgr2=0x55d236ed48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.421+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 shutdown_connections 2024-09-12T02:02:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.421+0000 7ff22923cf40 1 -- 172.21.15.19:0/3515194154 wait complete. 2024-09-12T02:02:40.424 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 600.00000000 2024-09-12T02:02:40.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.508+0000 7f0be87f8f40 1 Processor -- start 2024-09-12T02:02:40.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.508+0000 7f0be87f8f40 1 -- start start 2024-09-12T02:02:40.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be87f8f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd4002430 0x55ce2a5c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be87f8f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce2a5294c0 0x55ce2a5233d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be87f8f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce2a5c6bc0 0x55ce2a524a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be87f8f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ce2a44a510 con 0x55ce2a5c6bc0 2024-09-12T02:02:40.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be87f8f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ce2a4a3c50 con 0x7f0bd4002430 2024-09-12T02:02:40.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be87f8f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55ce2a526720 con 0x55ce2a5294c0 2024-09-12T02:02:40.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be6aef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce2a5c6bc0 0x55ce2a524a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be6aef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce2a5c6bc0 0x55ce2a524a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41240/0 (socket says 172.21.15.19:41240) 2024-09-12T02:02:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be6aef640 1 -- 172.21.15.19:0/3278416062 learned_addr learned my addr 172.21.15.19:0/3278416062 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be5aed640 1 --2- 172.21.15.19:0/3278416062 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce2a5294c0 0x55ce2a5233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be62ee640 1 --2- 172.21.15.19:0/3278416062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd4002430 0x55ce2a5c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be6aef640 1 -- 172.21.15.19:0/3278416062 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce2a5294c0 msgr2=0x55ce2a5233d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be6aef640 1 --2- 172.21.15.19:0/3278416062 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce2a5294c0 0x55ce2a5233d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be6aef640 1 -- 172.21.15.19:0/3278416062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd4002430 msgr2=0x55ce2a5c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be6aef640 1 --2- 172.21.15.19:0/3278416062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd4002430 0x55ce2a5c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be6aef640 1 -- 172.21.15.19:0/3278416062 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce2a543120 con 0x55ce2a5c6bc0 2024-09-12T02:02:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be6aef640 1 --2- 172.21.15.19:0/3278416062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce2a5c6bc0 0x55ce2a524a10 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x55ce2a525330 tx=0x7f0be0005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795990a3e8e98020 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be4aeb640 1 -- 172.21.15.19:0/3278416062 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be0008480 con 0x55ce2a5c6bc0 2024-09-12T02:02:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be4aeb640 1 -- 172.21.15.19:0/3278416062 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be0008620 con 0x55ce2a5c6bc0 2024-09-12T02:02:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.509+0000 7f0be4aeb640 1 -- 172.21.15.19:0/3278416062 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be0008a10 con 0x55ce2a5c6bc0 2024-09-12T02:02:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.510+0000 7f0be87f8f40 1 -- 172.21.15.19:0/3278416062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce2a5c6bc0 msgr2=0x55ce2a524a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.510+0000 7f0be87f8f40 1 --2- 172.21.15.19:0/3278416062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce2a5c6bc0 0x55ce2a524a10 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x55ce2a525330 tx=0x7f0be0005a00 comp rx=0 tx=0).stop 2024-09-12T02:02:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.510+0000 7f0be87f8f40 1 -- 172.21.15.19:0/3278416062 shutdown_connections 2024-09-12T02:02:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.510+0000 7f0be87f8f40 1 --2- 172.21.15.19:0/3278416062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce2a5c6bc0 0x55ce2a524a10 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.510+0000 7f0be87f8f40 1 --2- 172.21.15.19:0/3278416062 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce2a5294c0 0x55ce2a5233d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.510+0000 7f0be87f8f40 1 --2- 172.21.15.19:0/3278416062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd4002430 0x55ce2a5c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.510+0000 7f0be87f8f40 1 -- 172.21.15.19:0/3278416062 >> 172.21.15.19:0/3278416062 conn(0x55ce2a4fa1d0 msgr2=0x55ce2a4f7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.510+0000 7f0be87f8f40 1 -- 172.21.15.19:0/3278416062 shutdown_connections 2024-09-12T02:02:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.510+0000 7f0be87f8f40 1 -- 172.21.15.19:0/3278416062 wait complete. 2024-09-12T02:02:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.511+0000 7f0be87f8f40 1 Processor -- start 2024-09-12T02:02:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.511+0000 7f0be87f8f40 1 -- start start 2024-09-12T02:02:40.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.511+0000 7f0be87f8f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce2a5c6bc0 0x55ce2a5bbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.511+0000 7f0be87f8f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd4002430 0x55ce2a5bc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.511+0000 7f0be87f8f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce2a5cffb0 0x55ce2a541770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.511+0000 7f0be87f8f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ce2a5c8e00 con 0x55ce2a5c6bc0 2024-09-12T02:02:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.511+0000 7f0be87f8f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ce2a543390 con 0x7f0bd4002430 2024-09-12T02:02:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.511+0000 7f0be87f8f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55ce2a523910 con 0x55ce2a5cffb0 2024-09-12T02:02:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.512+0000 7f0be62ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce2a5c6bc0 0x55ce2a5bbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.512+0000 7f0be62ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce2a5c6bc0 0x55ce2a5bbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41252/0 (socket says 172.21.15.19:41252) 2024-09-12T02:02:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.512+0000 7f0be62ee640 1 -- 172.21.15.19:0/1084959172 learned_addr learned my addr 172.21.15.19:0/1084959172 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.512+0000 7f0be5aed640 1 --2- 172.21.15.19:0/1084959172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd4002430 0x55ce2a5bc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.512+0000 7f0be6aef640 1 --2- 172.21.15.19:0/1084959172 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce2a5cffb0 0x55ce2a541770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.512+0000 7f0be62ee640 1 -- 172.21.15.19:0/1084959172 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce2a5cffb0 msgr2=0x55ce2a541770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.512+0000 7f0be62ee640 1 --2- 172.21.15.19:0/1084959172 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce2a5cffb0 0x55ce2a541770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.512+0000 7f0be62ee640 1 -- 172.21.15.19:0/1084959172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd4002430 msgr2=0x55ce2a5bc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.512+0000 7f0be62ee640 1 --2- 172.21.15.19:0/1084959172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd4002430 0x55ce2a5bc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.512+0000 7f0be62ee640 1 -- 172.21.15.19:0/1084959172 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce2a5bd0a0 con 0x55ce2a5c6bc0 2024-09-12T02:02:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.512+0000 7f0be62ee640 1 --2- 172.21.15.19:0/1084959172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce2a5c6bc0 0x55ce2a5bbaa0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8026090 tx=0x7f0bd8001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.512+0000 7f0bdf7fe640 1 -- 172.21.15.19:0/1084959172 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8001f90 con 0x55ce2a5c6bc0 2024-09-12T02:02:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.512+0000 7f0bdf7fe640 1 -- 172.21.15.19:0/1084959172 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd804d8f0 con 0x55ce2a5c6bc0 2024-09-12T02:02:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.512+0000 7f0be87f8f40 1 -- 172.21.15.19:0/1084959172 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce2a5c9260 con 0x55ce2a5c6bc0 2024-09-12T02:02:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.512+0000 7f0bdf7fe640 1 -- 172.21.15.19:0/1084959172 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd80019f0 con 0x55ce2a5c6bc0 2024-09-12T02:02:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.512+0000 7f0be87f8f40 1 -- 172.21.15.19:0/1084959172 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce2a5c96a0 con 0x55ce2a5c6bc0 2024-09-12T02:02:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.514+0000 7f0bdf7fe640 1 -- 172.21.15.19:0/1084959172 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0bd8069020 con 0x55ce2a5c6bc0 2024-09-12T02:02:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.514+0000 7f0bdf7fe640 1 --2- 172.21.15.19:0/1084959172 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0bc806a810 0x7f0bc806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.514+0000 7f0bdf7fe640 1 -- 172.21.15.19:0/1084959172 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6389+0+0 (secure 0 0 0) 0x7f0bd80ccf40 con 0x55ce2a5c6bc0 2024-09-12T02:02:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.514+0000 7f0be5aed640 1 --2- 172.21.15.19:0/1084959172 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0bc806a810 0x7f0bc806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.514+0000 7f0be87f8f40 1 --2- 172.21.15.19:0/1084959172 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55ce2a5be2d0 0x55ce2a5be6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.514+0000 7f0be87f8f40 1 -- 172.21.15.19:0/1084959172 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x55ce2a53ca00 con 0x55ce2a5be2d0 2024-09-12T02:02:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.514+0000 7f0be6aef640 1 --2- 172.21.15.19:0/1084959172 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55ce2a5be2d0 0x55ce2a5be6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.515+0000 7f0be5aed640 1 --2- 172.21.15.19:0/1084959172 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0bc806a810 0x7f0bc806ccd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x55ce2a5c8790 tx=0x7f0bd000b380 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.515+0000 7f0be6aef640 1 --2- 172.21.15.19:0/1084959172 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55ce2a5be2d0 0x55ce2a5be6b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.516+0000 7f0be6aef640 1 -- 172.21.15.19:0/1084959172 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 600.00000000 [delete] v96'72 uv72 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0be0008950 con 0x55ce2a5be2d0 2024-09-12T02:02:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.516+0000 7f0be87f8f40 1 -- 172.21.15.19:0/1084959172 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55ce2a5be2d0 msgr2=0x55ce2a5be6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.516+0000 7f0be87f8f40 1 --2- 172.21.15.19:0/1084959172 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55ce2a5be2d0 0x55ce2a5be6b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.516+0000 7f0be87f8f40 1 -- 172.21.15.19:0/1084959172 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0bc806a810 msgr2=0x7f0bc806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.516+0000 7f0be87f8f40 1 --2- 172.21.15.19:0/1084959172 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0bc806a810 0x7f0bc806ccd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x55ce2a5c8790 tx=0x7f0bd000b380 comp rx=0 tx=0).stop 2024-09-12T02:02:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.516+0000 7f0be87f8f40 1 -- 172.21.15.19:0/1084959172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce2a5c6bc0 msgr2=0x55ce2a5bbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.516+0000 7f0be87f8f40 1 --2- 172.21.15.19:0/1084959172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce2a5c6bc0 0x55ce2a5bbaa0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8026090 tx=0x7f0bd8001d40 comp rx=0 tx=0).stop 2024-09-12T02:02:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.516+0000 7f0be6aef640 1 -- 172.21.15.19:0/1084959172 reap_dead start 2024-09-12T02:02:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.516+0000 7f0be87f8f40 1 -- 172.21.15.19:0/1084959172 shutdown_connections 2024-09-12T02:02:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.516+0000 7f0be87f8f40 1 -- 172.21.15.19:0/1084959172 >> 172.21.15.19:0/1084959172 conn(0x55ce2a4fa1d0 msgr2=0x55ce2a65f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.516+0000 7f0be87f8f40 1 -- 172.21.15.19:0/1084959172 shutdown_connections 2024-09-12T02:02:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.516+0000 7f0be87f8f40 1 -- 172.21.15.19:0/1084959172 wait complete. 2024-09-12T02:02:40.520 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:02:40.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.625+0000 7f32ac680640 1 Processor -- start 2024-09-12T02:02:40.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.625+0000 7f32ac680640 1 -- start start 2024-09-12T02:02:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.626+0000 7f32ac680640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32a40d15f0 0x7f32a40cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.626+0000 7f32ac680640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f32a40cf160 0x7f32a406d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.626+0000 7f32ac680640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a40cf980 con 0x7f32a4161a20 2024-09-12T02:02:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.626+0000 7f32ac680640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f32a4161e00 con 0x7f32a40cf160 2024-09-12T02:02:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.626+0000 7f32ac680640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f32a406d050 con 0x7f32a40d15f0 2024-09-12T02:02:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.626+0000 7f32aac1d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f32a40cf160 0x7f32a406d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.626+0000 7f32aa41c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f32a4161a20 0x7f32a40d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34088/0 (socket says 172.21.15.19:34088) 2024-09-12T02:02:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.626+0000 7f32aac1d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f32a40cf160 0x7f32a406d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41262/0 (socket says 172.21.15.19:41262) 2024-09-12T02:02:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.626+0000 7f32aa41c640 1 -- 172.21.15.19:0/3323016271 learned_addr learned my addr 172.21.15.19:0/3323016271 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.626+0000 7f32a9c1b640 1 --2- 172.21.15.19:0/3323016271 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32a40d15f0 0x7f32a40cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.626+0000 7f32aac1d640 1 -- 172.21.15.19:0/3323016271 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32a40d15f0 msgr2=0x7f32a40cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.626+0000 7f32aac1d640 1 --2- 172.21.15.19:0/3323016271 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32a40d15f0 0x7f32a40cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.626+0000 7f32aac1d640 1 -- 172.21.15.19:0/3323016271 >> v1:172.21.15.19:6789/0 conn(0x7f32a4161a20 legacy=0x7f32a40d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.626+0000 7f32a941a640 1 -- 172.21.15.19:0/3323016271 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3789388649 0 0) 0x7f32a40cf980 con 0x7f32a4161a20 2024-09-12T02:02:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.626+0000 7f32aac1d640 1 -- 172.21.15.19:0/3323016271 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a40cfc20 con 0x7f32a40cf160 2024-09-12T02:02:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.626+0000 7f32a9c1b640 1 --2- 172.21.15.19:0/3323016271 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32a40d15f0 0x7f32a40cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:40.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.627+0000 7f32aac1d640 1 --2- 172.21.15.19:0/3323016271 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32a40cf160 0x7f32a406d810 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f329c0097a0 tx=0x7f329c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e66b2a4b7419f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:40.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.627+0000 7f32a941a640 1 -- 172.21.15.19:0/3323016271 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c037070 con 0x7f32a40cf160 2024-09-12T02:02:40.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.627+0000 7f32a941a640 1 -- 172.21.15.19:0/3323016271 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329c032440 con 0x7f32a40cf160 2024-09-12T02:02:40.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.627+0000 7f32a941a640 1 -- 172.21.15.19:0/3323016271 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c032810 con 0x7f32a40cf160 2024-09-12T02:02:40.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.627+0000 7f32ac680640 1 -- 172.21.15.19:0/3323016271 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32a40cf160 msgr2=0x7f32a406d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.627+0000 7f32ac680640 1 --2- 172.21.15.19:0/3323016271 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32a40cf160 0x7f32a406d810 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f329c0097a0 tx=0x7f329c02a180 comp rx=0 tx=0).stop 2024-09-12T02:02:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.628+0000 7f32ac680640 1 -- 172.21.15.19:0/3323016271 shutdown_connections 2024-09-12T02:02:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.628+0000 7f32ac680640 1 --2- 172.21.15.19:0/3323016271 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32a40cf160 0x7f32a406d810 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.628+0000 7f32ac680640 1 --2- 172.21.15.19:0/3323016271 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32a40d15f0 0x7f32a40cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.628+0000 7f32ac680640 1 -- 172.21.15.19:0/3323016271 >> 172.21.15.19:0/3323016271 conn(0x7f32a409d850 msgr2=0x7f32a408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.628+0000 7f32ac680640 1 -- 172.21.15.19:0/3323016271 shutdown_connections 2024-09-12T02:02:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.628+0000 7f32ac680640 1 -- 172.21.15.19:0/3323016271 wait complete. 2024-09-12T02:02:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.629+0000 7f32ac680640 1 Processor -- start 2024-09-12T02:02:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.629+0000 7f32ac680640 1 -- start start 2024-09-12T02:02:40.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32ac680640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a40cf160 0x7f32a40ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32ac680640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32a40d15f0 0x7f32a40b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32ac680640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32a4161a20 0x7f32a40ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32ac680640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f32a40b1040 con 0x7f32a40d15f0 2024-09-12T02:02:40.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32ac680640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f32a406d2f0 con 0x7f32a40cf160 2024-09-12T02:02:40.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32ac680640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f32a40cf5f0 con 0x7f32a4161a20 2024-09-12T02:02:40.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32a9c1b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32a40d15f0 0x7f32a40b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32a9c1b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32a40d15f0 0x7f32a40b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41268/0 (socket says 172.21.15.19:41268) 2024-09-12T02:02:40.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32a9c1b640 1 -- 172.21.15.19:0/1710759154 learned_addr learned my addr 172.21.15.19:0/1710759154 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:40.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32aa41c640 1 --2- 172.21.15.19:0/1710759154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a40cf160 0x7f32a40ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32aac1d640 1 --2- 172.21.15.19:0/1710759154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32a4161a20 0x7f32a40ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32a9c1b640 1 -- 172.21.15.19:0/1710759154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32a4161a20 msgr2=0x7f32a40ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32a9c1b640 1 --2- 172.21.15.19:0/1710759154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32a4161a20 0x7f32a40ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32a9c1b640 1 -- 172.21.15.19:0/1710759154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a40cf160 msgr2=0x7f32a40ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:40.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32a9c1b640 1 --2- 172.21.15.19:0/1710759154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a40cf160 0x7f32a40ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:40.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32a9c1b640 1 -- 172.21.15.19:0/1710759154 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a40b4640 con 0x7f32a40d15f0 2024-09-12T02:02:40.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32a9c1b640 1 --2- 172.21.15.19:0/1710759154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32a40d15f0 0x7f32a40b3df0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f329800e730 tx=0x7f329800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:40.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32a2ffd640 1 -- 172.21.15.19:0/1710759154 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329800f040 con 0x7f32a40d15f0 2024-09-12T02:02:40.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32a2ffd640 1 -- 172.21.15.19:0/1710759154 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3298004230 con 0x7f32a40d15f0 2024-09-12T02:02:40.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32ac680640 1 -- 172.21.15.19:0/1710759154 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a40b4920 con 0x7f32a40d15f0 2024-09-12T02:02:40.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32a2ffd640 1 -- 172.21.15.19:0/1710759154 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329800ee40 con 0x7f32a40d15f0 2024-09-12T02:02:40.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.630+0000 7f32ac680640 1 -- 172.21.15.19:0/1710759154 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a40b4330 con 0x7f32a40d15f0 2024-09-12T02:02:40.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.632+0000 7f32ac680640 1 -- 172.21.15.19:0/1710759154 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a40cec20 con 0x7f32a40d15f0 2024-09-12T02:02:40.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.632+0000 7f32a2ffd640 1 -- 172.21.15.19:0/1710759154 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f329800c6d0 con 0x7f32a40d15f0 2024-09-12T02:02:40.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.632+0000 7f32a2ffd640 1 --2- 172.21.15.19:0/1710759154 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f329006be30 0x7f329006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:40.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.633+0000 7f32a2ffd640 1 -- 172.21.15.19:0/1710759154 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6389+0+0 (secure 0 0 0) 0x7f329808ade0 con 0x7f32a40d15f0 2024-09-12T02:02:40.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.633+0000 7f32aa41c640 1 --2- 172.21.15.19:0/1710759154 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f329006be30 0x7f329006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:40.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.633+0000 7f32aa41c640 1 --2- 172.21.15.19:0/1710759154 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f329006be30 0x7f329006e2f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3294007ed0 tx=0x7f3294007e60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:40.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.637+0000 7f32a2ffd640 1 -- 172.21.15.19:0/1710759154 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3298017020 con 0x7f32a40d15f0 2024-09-12T02:02:40.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:40.850+0000 7f32ac680640 1 -- 172.21.15.19:0/1710759154 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f32a415fc40 con 0x7f32a40d15f0 2024-09-12T02:02:41.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.413+0000 7f32a2ffd640 1 -- 172.21.15.19:0/1710759154 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v88) ==== 162+0+0 (secure 0 0 0) 0x7f3298059570 con 0x7f32a40d15f0 2024-09-12T02:02:41.414 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:02:41.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.416+0000 7f32ac680640 1 -- 172.21.15.19:0/1710759154 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f329006be30 msgr2=0x7f329006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:41.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.416+0000 7f32ac680640 1 --2- 172.21.15.19:0/1710759154 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f329006be30 0x7f329006e2f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3294007ed0 tx=0x7f3294007e60 comp rx=0 tx=0).stop 2024-09-12T02:02:41.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.416+0000 7f32ac680640 1 -- 172.21.15.19:0/1710759154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32a40d15f0 msgr2=0x7f32a40b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:41.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.416+0000 7f32ac680640 1 --2- 172.21.15.19:0/1710759154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32a40d15f0 0x7f32a40b3df0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f329800e730 tx=0x7f329800ebf0 comp rx=0 tx=0).stop 2024-09-12T02:02:41.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.416+0000 7f32ac680640 1 -- 172.21.15.19:0/1710759154 shutdown_connections 2024-09-12T02:02:41.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.416+0000 7f32ac680640 1 --2- 172.21.15.19:0/1710759154 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f329006be30 0x7f329006e2f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:41.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.416+0000 7f32ac680640 1 --2- 172.21.15.19:0/1710759154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32a4161a20 0x7f32a40ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:41.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.416+0000 7f32ac680640 1 --2- 172.21.15.19:0/1710759154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32a40d15f0 0x7f32a40b3df0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:41.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.416+0000 7f32ac680640 1 --2- 172.21.15.19:0/1710759154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a40cf160 0x7f32a40ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:41.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.416+0000 7f32ac680640 1 -- 172.21.15.19:0/1710759154 >> 172.21.15.19:0/1710759154 conn(0x7f32a409d850 msgr2=0x7f32a406d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:41.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.416+0000 7f32ac680640 1 -- 172.21.15.19:0/1710759154 shutdown_connections 2024-09-12T02:02:41.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.416+0000 7f32ac680640 1 -- 172.21.15.19:0/1710759154 wait complete. 2024-09-12T02:02:41.432 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:41.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.539+0000 7f855fa8c640 1 Processor -- start 2024-09-12T02:02:41.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.539+0000 7f855fa8c640 1 -- start start 2024-09-12T02:02:41.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.540+0000 7f855fa8c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855815c870 0x7f855815ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:41.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.540+0000 7f855fa8c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f85580ccf90 0x7f85580cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:41.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.540+0000 7f855fa8c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85580d01c0 con 0x7f855815c490 2024-09-12T02:02:41.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.540+0000 7f855fa8c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f85580cff70 con 0x7f85580ccf90 2024-09-12T02:02:41.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.540+0000 7f855fa8c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f85580d0dd0 con 0x7f855815c870 2024-09-12T02:02:41.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.540+0000 7f855d027640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855815c870 0x7f855815ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:41.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.540+0000 7f855e029640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f85580ccf90 0x7f85580cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:41.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.540+0000 7f855d027640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855815c870 0x7f855815ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:54560/0 (socket says 172.21.15.19:54560) 2024-09-12T02:02:41.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.540+0000 7f855e029640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f85580ccf90 0x7f85580cd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:49180/0 (socket says 172.21.15.19:49180) 2024-09-12T02:02:41.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.540+0000 7f855d027640 1 -- 172.21.15.19:0/3736422686 learned_addr learned my addr 172.21.15.19:0/3736422686 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:41.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.540+0000 7f855d828640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f855815c490 0x7f855809b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:43802/0 (socket says 172.21.15.19:43802) 2024-09-12T02:02:41.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.540+0000 7f855e029640 1 -- 172.21.15.19:0/3736422686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855815c870 msgr2=0x7f855815ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:41.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.541+0000 7f855e029640 1 --2- 172.21.15.19:0/3736422686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855815c870 0x7f855815ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:41.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.541+0000 7f855e029640 1 -- 172.21.15.19:0/3736422686 >> v1:172.21.15.135:6789/0 conn(0x7f855815c490 legacy=0x7f855809b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:41.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.541+0000 7f855e029640 1 -- 172.21.15.19:0/3736422686 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85580d04a0 con 0x7f85580ccf90 2024-09-12T02:02:41.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.541+0000 7f855d027640 1 --2- 172.21.15.19:0/3736422686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855815c870 0x7f855815ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:41.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.541+0000 7f855e029640 1 --2- 172.21.15.19:0/3736422686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85580ccf90 0x7f85580cd440 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f854800dbc0 tx=0x7f854802e510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f009a0d850275f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:41.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.541+0000 7f855c826640 1 -- 172.21.15.19:0/3736422686 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854803a070 con 0x7f85580ccf90 2024-09-12T02:02:41.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.542+0000 7f855c826640 1 -- 172.21.15.19:0/3736422686 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854800b650 con 0x7f85580ccf90 2024-09-12T02:02:41.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.542+0000 7f855c826640 1 -- 172.21.15.19:0/3736422686 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854800ba20 con 0x7f85580ccf90 2024-09-12T02:02:41.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.542+0000 7f855fa8c640 1 -- 172.21.15.19:0/3736422686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85580ccf90 msgr2=0x7f85580cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:41.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.542+0000 7f855fa8c640 1 --2- 172.21.15.19:0/3736422686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85580ccf90 0x7f85580cd440 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f854800dbc0 tx=0x7f854802e510 comp rx=0 tx=0).stop 2024-09-12T02:02:41.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.542+0000 7f855fa8c640 1 -- 172.21.15.19:0/3736422686 shutdown_connections 2024-09-12T02:02:41.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.542+0000 7f855fa8c640 1 --2- 172.21.15.19:0/3736422686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855815c870 0x7f855815ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:41.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.542+0000 7f855fa8c640 1 --2- 172.21.15.19:0/3736422686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85580ccf90 0x7f85580cd440 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:41.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.542+0000 7f855fa8c640 1 -- 172.21.15.19:0/3736422686 >> 172.21.15.19:0/3736422686 conn(0x7f85580d23a0 msgr2=0x7f85580d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:41.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.542+0000 7f855fa8c640 1 -- 172.21.15.19:0/3736422686 shutdown_connections 2024-09-12T02:02:41.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.542+0000 7f855fa8c640 1 -- 172.21.15.19:0/3736422686 wait complete. 2024-09-12T02:02:41.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.543+0000 7f855fa8c640 1 Processor -- start 2024-09-12T02:02:41.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.543+0000 7f855fa8c640 1 -- start start 2024-09-12T02:02:41.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.544+0000 7f855fa8c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85580ccf90 0x7f855814e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:41.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.544+0000 7f855fa8c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855815c490 0x7f855815a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.544+0000 7f855fa8c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f855815c870 0x7f855815a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.544+0000 7f855fa8c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f85580d1260 con 0x7f85580ccf90 2024-09-12T02:02:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.544+0000 7f855fa8c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f85580d0a60 con 0x7f855815c870 2024-09-12T02:02:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.544+0000 7f855fa8c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8558156e40 con 0x7f855815c490 2024-09-12T02:02:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.544+0000 7f855d828640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85580ccf90 0x7f855814e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.544+0000 7f855d828640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85580ccf90 0x7f855814e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48200/0 (socket says 172.21.15.19:48200) 2024-09-12T02:02:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.544+0000 7f855d828640 1 -- 172.21.15.19:0/2625565502 learned_addr learned my addr 172.21.15.19:0/2625565502 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.544+0000 7f855e029640 1 --2- 172.21.15.19:0/2625565502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f855815c870 0x7f855815a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.544+0000 7f855d027640 1 --2- 172.21.15.19:0/2625565502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855815c490 0x7f855815a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.545+0000 7f855d828640 1 -- 172.21.15.19:0/2625565502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855815c490 msgr2=0x7f855815a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.545+0000 7f855d828640 1 --2- 172.21.15.19:0/2625565502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855815c490 0x7f855815a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.545+0000 7f855d828640 1 -- 172.21.15.19:0/2625565502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f855815c870 msgr2=0x7f855815a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:41.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.545+0000 7f855d828640 1 --2- 172.21.15.19:0/2625565502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f855815c870 0x7f855815a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:41.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.545+0000 7f855d828640 1 -- 172.21.15.19:0/2625565502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85580ca450 con 0x7f85580ccf90 2024-09-12T02:02:41.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.545+0000 7f855d828640 1 --2- 172.21.15.19:0/2625565502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85580ccf90 0x7f855814e770 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f855000c400 tx=0x7f855000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:41.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.545+0000 7f85567fc640 1 -- 172.21.15.19:0/2625565502 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85500074e0 con 0x7f85580ccf90 2024-09-12T02:02:41.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.545+0000 7f85567fc640 1 -- 172.21.15.19:0/2625565502 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8550007680 con 0x7f85580ccf90 2024-09-12T02:02:41.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.545+0000 7f855fa8c640 1 -- 172.21.15.19:0/2625565502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85580b8060 con 0x7f85580ccf90 2024-09-12T02:02:41.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.545+0000 7f85567fc640 1 -- 172.21.15.19:0/2625565502 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8550004a00 con 0x7f85580ccf90 2024-09-12T02:02:41.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.545+0000 7f855fa8c640 1 -- 172.21.15.19:0/2625565502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85580ca9d0 con 0x7f85580ccf90 2024-09-12T02:02:41.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.546+0000 7f855fa8c640 1 -- 172.21.15.19:0/2625565502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85580caba0 con 0x7f85580ccf90 2024-09-12T02:02:41.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.547+0000 7f85567fc640 1 -- 172.21.15.19:0/2625565502 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f855001a020 con 0x7f85580ccf90 2024-09-12T02:02:41.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.547+0000 7f85567fc640 1 --2- 172.21.15.19:0/2625565502 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f854406be60 0x7f854406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:41.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.547+0000 7f85567fc640 1 -- 172.21.15.19:0/2625565502 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6389+0+0 (secure 0 0 0) 0x7f855008a860 con 0x7f85580ccf90 2024-09-12T02:02:41.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.548+0000 7f855d027640 1 --2- 172.21.15.19:0/2625565502 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f854406be60 0x7f854406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:41.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.548+0000 7f855d027640 1 --2- 172.21.15.19:0/2625565502 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f854406be60 0x7f854406e320 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f85580cf0c0 tx=0x7f854c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:41.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.552+0000 7f85567fc640 1 -- 172.21.15.19:0/2625565502 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8550058880 con 0x7f85580ccf90 2024-09-12T02:02:41.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.766+0000 7f855fa8c640 1 -- 172.21.15.19:0/2625565502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f855815ccb0 con 0x7f85580ccf90 2024-09-12T02:02:41.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.766+0000 7f85567fc640 1 -- 172.21.15.19:0/2625565502 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5222 (secure 0 0 0) 0x7f855005cb80 con 0x7f85580ccf90 2024-09-12T02:02:41.767 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:41.767 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":89,"btime":"2024-09-12T02:02:41:416567+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1101861733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1101861733},{"type":"v1","addr":"172.21.15.135:6837","nonce":1101861733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:02:41.416547+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7653":{"gid":7653,"name":"c","rank":0,"incarnation":89,"state":"up:replay","state_seq":1,"addr":"172.21.15.19:6834/2072535494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2072535494},{"type":"v1","addr":"172.21.15.19:6834","nonce":2072535494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:02:41.767 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 89 2024-09-12T02:02:41.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.768+0000 7f855fa8c640 1 -- 172.21.15.19:0/2625565502 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f854406be60 msgr2=0x7f854406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:41.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.768+0000 7f855fa8c640 1 --2- 172.21.15.19:0/2625565502 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f854406be60 0x7f854406e320 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f85580cf0c0 tx=0x7f854c00b040 comp rx=0 tx=0).stop 2024-09-12T02:02:41.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.768+0000 7f855fa8c640 1 -- 172.21.15.19:0/2625565502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85580ccf90 msgr2=0x7f855814e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:41.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.768+0000 7f855fa8c640 1 --2- 172.21.15.19:0/2625565502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85580ccf90 0x7f855814e770 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f855000c400 tx=0x7f855000c8c0 comp rx=0 tx=0).stop 2024-09-12T02:02:41.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.768+0000 7f855fa8c640 1 -- 172.21.15.19:0/2625565502 shutdown_connections 2024-09-12T02:02:41.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.768+0000 7f855fa8c640 1 --2- 172.21.15.19:0/2625565502 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f854406be60 0x7f854406e320 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:41.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.768+0000 7f855fa8c640 1 --2- 172.21.15.19:0/2625565502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f855815c870 0x7f855815a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:41.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.768+0000 7f855fa8c640 1 --2- 172.21.15.19:0/2625565502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855815c490 0x7f855815a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:41.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.768+0000 7f855fa8c640 1 --2- 172.21.15.19:0/2625565502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85580ccf90 0x7f855814e770 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:41.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.768+0000 7f855fa8c640 1 -- 172.21.15.19:0/2625565502 >> 172.21.15.19:0/2625565502 conn(0x7f85580d23a0 msgr2=0x7f85580cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:41.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.768+0000 7f855fa8c640 1 -- 172.21.15.19:0/2625565502 shutdown_connections 2024-09-12T02:02:41.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:41.769+0000 7f855fa8c640 1 -- 172.21.15.19:0/2625565502 wait complete. 2024-09-12T02:02:41.780 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-12T02:02:44.440 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:02:44.439+0000 7f3dd56a3640 -1 log_channel(cluster) log [ERR] : dir 0x600 object missing on disk; some files may be lost (~mds0/stray0) 2024-09-12T02:02:44.441 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:02:44.439+0000 7f3dd56a3640 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x600 is fatal because it is a system directory for this rank 2024-09-12T02:02:44.441 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:02:44.440+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:02:44.441 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:02:44.440+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:02:45.113 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:02:45.112+0000 7f3dd96ab640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:02:46.781 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:46.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.896+0000 7fec6f933640 1 Processor -- start 2024-09-12T02:02:46.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.896+0000 7fec6f933640 1 -- start start 2024-09-12T02:02:46.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.897+0000 7fec6f933640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec6815e740 0x7fec680d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:46.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.897+0000 7fec6f933640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec680d0780 con 0x7fec6809b690 2024-09-12T02:02:46.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.897+0000 7fec6f933640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec680d0a60 con 0x7fec6806dbd0 2024-09-12T02:02:46.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.897+0000 7fec6f933640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fec6815eb20 con 0x7fec6815e740 2024-09-12T02:02:46.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.897+0000 7fec6d6cf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec6815e740 0x7fec680d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:46.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.897+0000 7fec6cece640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fec6809b690 0x7fec6806d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:51758/0 (socket says 172.21.15.19:51758) 2024-09-12T02:02:46.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.897+0000 7fec6cece640 1 -- 172.21.15.19:0/2096184619 learned_addr learned my addr 172.21.15.19:0/2096184619 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:46.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.897+0000 7fec6d6cf640 1 -- 172.21.15.19:0/2096184619 >> v1:172.21.15.135:6789/0 conn(0x7fec6806dbd0 legacy=0x7fec68070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:46.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.898+0000 7fec6d6cf640 1 -- 172.21.15.19:0/2096184619 >> v1:172.21.15.19:6789/0 conn(0x7fec6809b690 legacy=0x7fec6806d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:46.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.898+0000 7fec5ffff640 1 -- 172.21.15.19:0/2096184619 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 539263141 0 0) 0x7fec680d0780 con 0x7fec6809b690 2024-09-12T02:02:46.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.898+0000 7fec6d6cf640 1 -- 172.21.15.19:0/2096184619 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec680d0d40 con 0x7fec6815e740 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.898+0000 7fec6d6cf640 1 --2- 172.21.15.19:0/2096184619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec6815e740 0x7fec680d1540 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fec640097a0 tx=0x7fec6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ec7b1ae35d2fa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.898+0000 7fec5ffff640 1 -- 172.21.15.19:0/2096184619 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec64037070 con 0x7fec6815e740 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.899+0000 7fec5ffff640 1 -- 172.21.15.19:0/2096184619 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec64032440 con 0x7fec6815e740 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.899+0000 7fec5ffff640 1 -- 172.21.15.19:0/2096184619 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec64032810 con 0x7fec6815e740 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.899+0000 7fec6f933640 1 -- 172.21.15.19:0/2096184619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec6815e740 msgr2=0x7fec680d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.899+0000 7fec6f933640 1 --2- 172.21.15.19:0/2096184619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec6815e740 0x7fec680d1540 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fec640097a0 tx=0x7fec6402a270 comp rx=0 tx=0).stop 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.899+0000 7fec6f933640 1 -- 172.21.15.19:0/2096184619 shutdown_connections 2024-09-12T02:02:46.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.899+0000 7fec6f933640 1 --2- 172.21.15.19:0/2096184619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec6815e740 0x7fec680d1540 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.899+0000 7fec6f933640 1 -- 172.21.15.19:0/2096184619 >> 172.21.15.19:0/2096184619 conn(0x7fec680d23a0 msgr2=0x7fec680d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:46.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.899+0000 7fec6f933640 1 -- 172.21.15.19:0/2096184619 shutdown_connections 2024-09-12T02:02:46.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.899+0000 7fec6f933640 1 -- 172.21.15.19:0/2096184619 wait complete. 2024-09-12T02:02:46.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.900+0000 7fec6f933640 1 Processor -- start 2024-09-12T02:02:46.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.900+0000 7fec6f933640 1 -- start start 2024-09-12T02:02:46.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.901+0000 7fec6f933640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec6806dbd0 0x7fec681f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.901+0000 7fec6f933640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec6809b690 0x7fec6815c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.901+0000 7fec6f933640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec6815e740 0x7fec6815cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.901+0000 7fec6f933640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fec6806dfe0 con 0x7fec6809b690 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.901+0000 7fec6f933640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fec6809bac0 con 0x7fec6806dbd0 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.901+0000 7fec6f933640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fec6806cd20 con 0x7fec6815e740 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.901+0000 7fec6cece640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec6809b690 0x7fec6815c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.901+0000 7fec6cece640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec6809b690 0x7fec6815c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48216/0 (socket says 172.21.15.19:48216) 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.901+0000 7fec6cece640 1 -- 172.21.15.19:0/184013877 learned_addr learned my addr 172.21.15.19:0/184013877 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.902+0000 7fec6d6cf640 1 --2- 172.21.15.19:0/184013877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec6806dbd0 0x7fec681f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.902+0000 7fec6cece640 1 -- 172.21.15.19:0/184013877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec6815e740 msgr2=0x7fec6815cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.902+0000 7fec6ded0640 1 --2- 172.21.15.19:0/184013877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec6815e740 0x7fec6815cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.902+0000 7fec6cece640 1 --2- 172.21.15.19:0/184013877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec6815e740 0x7fec6815cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.902+0000 7fec6cece640 1 -- 172.21.15.19:0/184013877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec6806dbd0 msgr2=0x7fec681f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.902+0000 7fec6cece640 1 --2- 172.21.15.19:0/184013877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec6806dbd0 0x7fec681f3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.902+0000 7fec6cece640 1 -- 172.21.15.19:0/184013877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec680ca4f0 con 0x7fec6809b690 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.902+0000 7fec6ded0640 1 --2- 172.21.15.19:0/184013877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec6815e740 0x7fec6815cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.902+0000 7fec6d6cf640 1 --2- 172.21.15.19:0/184013877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec6806dbd0 0x7fec681f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.902+0000 7fec6cece640 1 --2- 172.21.15.19:0/184013877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec6809b690 0x7fec6815c960 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fec5800c4a0 tx=0x7fec5800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.902+0000 7fec5dffb640 1 -- 172.21.15.19:0/184013877 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec58018070 con 0x7fec6809b690 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.902+0000 7fec5dffb640 1 -- 172.21.15.19:0/184013877 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec580074e0 con 0x7fec6809b690 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.902+0000 7fec5dffb640 1 -- 172.21.15.19:0/184013877 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec58004a20 con 0x7fec6809b690 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.902+0000 7fec6f933640 1 -- 172.21.15.19:0/184013877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec680c9970 con 0x7fec6809b690 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.902+0000 7fec6f933640 1 -- 172.21.15.19:0/184013877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec680c9f30 con 0x7fec6809b690 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.903+0000 7fec6f933640 1 -- 172.21.15.19:0/184013877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec680d0780 con 0x7fec6809b690 2024-09-12T02:02:46.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.904+0000 7fec5dffb640 1 -- 172.21.15.19:0/184013877 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec5801b070 con 0x7fec6809b690 2024-09-12T02:02:46.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.904+0000 7fec5dffb640 1 --2- 172.21.15.19:0/184013877 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fec4c06be30 0x7fec4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:46.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.904+0000 7fec5dffb640 1 -- 172.21.15.19:0/184013877 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6475+0+0 (secure 0 0 0) 0x7fec5808a520 con 0x7fec6809b690 2024-09-12T02:02:46.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.905+0000 7fec6d6cf640 1 --2- 172.21.15.19:0/184013877 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fec4c06be30 0x7fec4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:46.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.905+0000 7fec6d6cf640 1 --2- 172.21.15.19:0/184013877 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fec4c06be30 0x7fec4c06e2f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fec64034000 tx=0x7fec6402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:46.909+0000 7fec5dffb640 1 -- 172.21.15.19:0/184013877 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec58058b40 con 0x7fec6809b690 2024-09-12T02:02:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.120+0000 7fec6f933640 1 -- 172.21.15.19:0/184013877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec680d1cb0 con 0x7fec6809b690 2024-09-12T02:02:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.120+0000 7fec5dffb640 1 -- 172.21.15.19:0/184013877 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+4388 (secure 0 0 0) 0x7fec58058440 con 0x7fec6809b690 2024-09-12T02:02:47.121 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:47.121 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":93,"btime":"2024-09-12T02:02:44:441139+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1101861733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1101861733},{"type":"v1","addr":"172.21.15.135:6837","nonce":1101861733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:02:44.441134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:02:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 93 2024-09-12T02:02:47.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.122+0000 7fec6f933640 1 -- 172.21.15.19:0/184013877 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fec4c06be30 msgr2=0x7fec4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:47.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.122+0000 7fec6f933640 1 --2- 172.21.15.19:0/184013877 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fec4c06be30 0x7fec4c06e2f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fec64034000 tx=0x7fec6402e000 comp rx=0 tx=0).stop 2024-09-12T02:02:47.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.122+0000 7fec6f933640 1 -- 172.21.15.19:0/184013877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec6809b690 msgr2=0x7fec6815c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:47.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.122+0000 7fec6f933640 1 --2- 172.21.15.19:0/184013877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec6809b690 0x7fec6815c960 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fec5800c4a0 tx=0x7fec5800c960 comp rx=0 tx=0).stop 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.122+0000 7fec6f933640 1 -- 172.21.15.19:0/184013877 shutdown_connections 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.122+0000 7fec6f933640 1 --2- 172.21.15.19:0/184013877 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fec4c06be30 0x7fec4c06e2f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.122+0000 7fec6f933640 1 --2- 172.21.15.19:0/184013877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec6815e740 0x7fec6815cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.122+0000 7fec6f933640 1 --2- 172.21.15.19:0/184013877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec6809b690 0x7fec6815c960 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.122+0000 7fec6f933640 1 --2- 172.21.15.19:0/184013877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec6806dbd0 0x7fec681f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.122+0000 7fec6f933640 1 -- 172.21.15.19:0/184013877 >> 172.21.15.19:0/184013877 conn(0x7fec680d23a0 msgr2=0x7fec680b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.123+0000 7fec6f933640 1 -- 172.21.15.19:0/184013877 shutdown_connections 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.123+0000 7fec6f933640 1 -- 172.21.15.19:0/184013877 wait complete. 2024-09-12T02:02:47.134 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:02:47.134 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:47.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.236+0000 7f854d19f640 1 Processor -- start 2024-09-12T02:02:47.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.236+0000 7f854d19f640 1 -- start start 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.237+0000 7f854d19f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f85480ce8b0 0x7f854815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.237+0000 7f854d19f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f854809b510 0x7f854809b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.237+0000 7f854d19f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85480d00a0 con 0x7f85480d06e0 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.237+0000 7f854d19f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f854815d920 con 0x7f85480ce8b0 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.237+0000 7f854d19f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f854809b080 con 0x7f854809b510 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.237+0000 7f854659c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f85480ce8b0 0x7f854815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.237+0000 7f854659c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f85480ce8b0 0x7f854815d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48220/0 (socket says 172.21.15.19:48220) 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.237+0000 7f854659c640 1 -- 172.21.15.19:0/2934029990 learned_addr learned my addr 172.21.15.19:0/2934029990 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.237+0000 7f854759e640 1 --2- 172.21.15.19:0/2934029990 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f854809b510 0x7f854809b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.237+0000 7f854659c640 1 -- 172.21.15.19:0/2934029990 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f854809b510 msgr2=0x7f854809b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.237+0000 7f854659c640 1 --2- 172.21.15.19:0/2934029990 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f854809b510 0x7f854809b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.237+0000 7f854659c640 1 -- 172.21.15.19:0/2934029990 >> v1:172.21.15.135:6789/0 conn(0x7f85480d06e0 legacy=0x7f85480d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:47.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.237+0000 7f854659c640 1 -- 172.21.15.19:0/2934029990 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85480d0380 con 0x7f85480ce8b0 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.238+0000 7f854659c640 1 --2- 172.21.15.19:0/2934029990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85480ce8b0 0x7f854815d3e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f853c009870 tx=0x7f853c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95e8b76d6b5b544 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.238+0000 7f8545d9b640 1 -- 172.21.15.19:0/2934029990 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c037070 con 0x7f85480ce8b0 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.238+0000 7f8545d9b640 1 -- 172.21.15.19:0/2934029990 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f853c032440 con 0x7f85480ce8b0 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.238+0000 7f8545d9b640 1 -- 172.21.15.19:0/2934029990 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c032810 con 0x7f85480ce8b0 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.238+0000 7f854d19f640 1 -- 172.21.15.19:0/2934029990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85480ce8b0 msgr2=0x7f854815d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.238+0000 7f854d19f640 1 --2- 172.21.15.19:0/2934029990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85480ce8b0 0x7f854815d3e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f853c009870 tx=0x7f853c02a270 comp rx=0 tx=0).stop 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.239+0000 7f854d19f640 1 -- 172.21.15.19:0/2934029990 shutdown_connections 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.239+0000 7f854d19f640 1 --2- 172.21.15.19:0/2934029990 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f854809b510 0x7f854809b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.239+0000 7f854d19f640 1 --2- 172.21.15.19:0/2934029990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85480ce8b0 0x7f854815d3e0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.239+0000 7f854d19f640 1 -- 172.21.15.19:0/2934029990 >> 172.21.15.19:0/2934029990 conn(0x7f85480d23a0 msgr2=0x7f85480d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.239+0000 7f854d19f640 1 -- 172.21.15.19:0/2934029990 shutdown_connections 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.239+0000 7f854d19f640 1 -- 172.21.15.19:0/2934029990 wait complete. 2024-09-12T02:02:47.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.240+0000 7f854d19f640 1 Processor -- start 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.240+0000 7f854d19f640 1 -- start start 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.241+0000 7f854d19f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f854809b510 0x7f85480c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.241+0000 7f854d19f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85480ce8b0 0x7f85480b6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.241+0000 7f854d19f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85480d06e0 0x7f85480b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.241+0000 7f854d19f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f854815c740 con 0x7f85480ce8b0 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.241+0000 7f854d19f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f854809ad10 con 0x7f85480d06e0 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.241+0000 7f854d19f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f85480ccf90 con 0x7f854809b510 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.241+0000 7f854659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85480ce8b0 0x7f85480b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.241+0000 7f854659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85480ce8b0 0x7f85480b6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48226/0 (socket says 172.21.15.19:48226) 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.241+0000 7f854659c640 1 -- 172.21.15.19:0/1266500569 learned_addr learned my addr 172.21.15.19:0/1266500569 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.241+0000 7f854759e640 1 --2- 172.21.15.19:0/1266500569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85480d06e0 0x7f85480b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.241+0000 7f8546d9d640 1 --2- 172.21.15.19:0/1266500569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f854809b510 0x7f85480c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.241+0000 7f854659c640 1 -- 172.21.15.19:0/1266500569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f854809b510 msgr2=0x7f85480c73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.241+0000 7f854659c640 1 --2- 172.21.15.19:0/1266500569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f854809b510 0x7f85480c73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.241+0000 7f854659c640 1 -- 172.21.15.19:0/1266500569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85480d06e0 msgr2=0x7f85480b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.241+0000 7f854659c640 1 --2- 172.21.15.19:0/1266500569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85480d06e0 0x7f85480b6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.241+0000 7f854659c640 1 -- 172.21.15.19:0/1266500569 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85480c6340 con 0x7f85480ce8b0 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.241+0000 7f8546d9d640 1 --2- 172.21.15.19:0/1266500569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f854809b510 0x7f85480c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.241+0000 7f854659c640 1 --2- 172.21.15.19:0/1266500569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85480ce8b0 0x7f85480b6860 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f853c000c00 tx=0x7f853c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.242+0000 7f852f7fe640 1 -- 172.21.15.19:0/1266500569 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c041020 con 0x7f85480ce8b0 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.242+0000 7f852f7fe640 1 -- 172.21.15.19:0/1266500569 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f853c0306c0 con 0x7f85480ce8b0 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.242+0000 7f854d19f640 1 -- 172.21.15.19:0/1266500569 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85480c6620 con 0x7f85480ce8b0 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.242+0000 7f852f7fe640 1 -- 172.21.15.19:0/1266500569 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c037040 con 0x7f85480ce8b0 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.242+0000 7f854d19f640 1 -- 172.21.15.19:0/1266500569 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85480c6be0 con 0x7f85480ce8b0 2024-09-12T02:02:47.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.243+0000 7f854d19f640 1 -- 172.21.15.19:0/1266500569 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f854809b9a0 con 0x7f85480ce8b0 2024-09-12T02:02:47.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.243+0000 7f852f7fe640 1 -- 172.21.15.19:0/1266500569 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f853c044020 con 0x7f85480ce8b0 2024-09-12T02:02:47.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.243+0000 7f852f7fe640 1 --2- 172.21.15.19:0/1266500569 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f853406be30 0x7f853406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:47.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.244+0000 7f852f7fe640 1 -- 172.21.15.19:0/1266500569 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6475+0+0 (secure 0 0 0) 0x7f853c0ab900 con 0x7f85480ce8b0 2024-09-12T02:02:47.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.244+0000 7f8546d9d640 1 --2- 172.21.15.19:0/1266500569 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f853406be30 0x7f853406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:47.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.244+0000 7f8546d9d640 1 --2- 172.21.15.19:0/1266500569 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f853406be30 0x7f853406e2f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8538001660 tx=0x7f8538009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:47.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.248+0000 7f852f7fe640 1 -- 172.21.15.19:0/1266500569 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f853c04b030 con 0x7f85480ce8b0 2024-09-12T02:02:47.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.462+0000 7f854d19f640 1 -- 172.21.15.19:0/1266500569 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85480d16b0 con 0x7f85480ce8b0 2024-09-12T02:02:47.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.462+0000 7f852f7fe640 1 -- 172.21.15.19:0/1266500569 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+4388 (secure 0 0 0) 0x7f853c079fb0 con 0x7f85480ce8b0 2024-09-12T02:02:47.463 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:47.463 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":93,"btime":"2024-09-12T02:02:44:441139+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1101861733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1101861733},{"type":"v1","addr":"172.21.15.135:6837","nonce":1101861733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:02:44.441134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:02:47.463 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 93 2024-09-12T02:02:47.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.465+0000 7f854d19f640 1 -- 172.21.15.19:0/1266500569 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f853406be30 msgr2=0x7f853406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:47.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.465+0000 7f854d19f640 1 --2- 172.21.15.19:0/1266500569 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f853406be30 0x7f853406e2f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8538001660 tx=0x7f8538009040 comp rx=0 tx=0).stop 2024-09-12T02:02:47.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.465+0000 7f854d19f640 1 -- 172.21.15.19:0/1266500569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85480ce8b0 msgr2=0x7f85480b6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.465+0000 7f854d19f640 1 --2- 172.21.15.19:0/1266500569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85480ce8b0 0x7f85480b6860 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f853c000c00 tx=0x7f853c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.465+0000 7f854d19f640 1 -- 172.21.15.19:0/1266500569 shutdown_connections 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.465+0000 7f854d19f640 1 --2- 172.21.15.19:0/1266500569 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f853406be30 0x7f853406e2f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.465+0000 7f854d19f640 1 --2- 172.21.15.19:0/1266500569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85480d06e0 0x7f85480b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.465+0000 7f854d19f640 1 --2- 172.21.15.19:0/1266500569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85480ce8b0 0x7f85480b6860 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.465+0000 7f854d19f640 1 --2- 172.21.15.19:0/1266500569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f854809b510 0x7f85480c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.465+0000 7f854d19f640 1 -- 172.21.15.19:0/1266500569 >> 172.21.15.19:0/1266500569 conn(0x7f85480d23a0 msgr2=0x7f85480b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.465+0000 7f854d19f640 1 -- 172.21.15.19:0/1266500569 shutdown_connections 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.465+0000 7f854d19f640 1 -- 172.21.15.19:0/1266500569 wait complete. 2024-09-12T02:02:47.476 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:02:47.477 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:47.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.578+0000 7f938ca0a640 1 Processor -- start 2024-09-12T02:02:47.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.579+0000 7f938ca0a640 1 -- start start 2024-09-12T02:02:47.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.579+0000 7f938ca0a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f938815b300 0x7f93880cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:47.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.579+0000 7f938ca0a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f938806f8d0 0x7f938815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:47.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.579+0000 7f938ca0a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93880cdbe0 con 0x7f93880cd3f0 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.579+0000 7f938ca0a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f93880728a0 con 0x7f938806f8d0 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.579+0000 7f938ca0a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f93880cd900 con 0x7f938815b300 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.580+0000 7f9386d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f938806f8d0 0x7f938815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.580+0000 7f9385d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f93880cd3f0 0x7f938806f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:51762/0 (socket says 172.21.15.19:51762) 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.580+0000 7f9385d9b640 1 -- 172.21.15.19:0/2778893663 learned_addr learned my addr 172.21.15.19:0/2778893663 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.580+0000 7f938659c640 1 --2- 172.21.15.19:0/2778893663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f938815b300 0x7f93880cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.580+0000 7f9386d9d640 1 -- 172.21.15.19:0/2778893663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f938815b300 msgr2=0x7f93880cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.580+0000 7f9386d9d640 1 --2- 172.21.15.19:0/2778893663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f938815b300 0x7f93880cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.580+0000 7f9386d9d640 1 -- 172.21.15.19:0/2778893663 >> v1:172.21.15.19:6789/0 conn(0x7f93880cd3f0 legacy=0x7f938806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.580+0000 7f9386d9d640 1 -- 172.21.15.19:0/2778893663 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9388072250 con 0x7f938806f8d0 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.580+0000 7f938559a640 1 -- 172.21.15.19:0/2778893663 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3214949242 0 0) 0x7f93880cdbe0 con 0x7f93880cd3f0 2024-09-12T02:02:47.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.581+0000 7f9386d9d640 1 --2- 172.21.15.19:0/2778893663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f938806f8d0 0x7f938815b6e0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f9380009d90 tx=0x7f938002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43da484d50199974 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.581+0000 7f938559a640 1 -- 172.21.15.19:0/2778893663 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9380007740 con 0x7f938806f8d0 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.581+0000 7f938559a640 1 -- 172.21.15.19:0/2778893663 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93800078e0 con 0x7f938806f8d0 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.581+0000 7f938559a640 1 -- 172.21.15.19:0/2778893663 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9380007cb0 con 0x7f938806f8d0 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.581+0000 7f938ca0a640 1 -- 172.21.15.19:0/2778893663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f938806f8d0 msgr2=0x7f938815b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.581+0000 7f938ca0a640 1 --2- 172.21.15.19:0/2778893663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f938806f8d0 0x7f938815b6e0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f9380009d90 tx=0x7f938002a660 comp rx=0 tx=0).stop 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.581+0000 7f938ca0a640 1 -- 172.21.15.19:0/2778893663 shutdown_connections 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.581+0000 7f938ca0a640 1 --2- 172.21.15.19:0/2778893663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f938806f8d0 0x7f938815b6e0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.581+0000 7f938ca0a640 1 --2- 172.21.15.19:0/2778893663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f938815b300 0x7f93880cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.581+0000 7f938ca0a640 1 -- 172.21.15.19:0/2778893663 >> 172.21.15.19:0/2778893663 conn(0x7f9388067d70 msgr2=0x7f938806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.582+0000 7f938ca0a640 1 -- 172.21.15.19:0/2778893663 shutdown_connections 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.582+0000 7f938ca0a640 1 -- 172.21.15.19:0/2778893663 wait complete. 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.583+0000 7f938ca0a640 1 Processor -- start 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.583+0000 7f938ca0a640 1 -- start start 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f938ca0a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f938806f8d0 0x7f938814c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f938ca0a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93880cd3f0 0x7f938806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f938ca0a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938815b300 0x7f938806e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f938ca0a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f93880d0160 con 0x7f938806f8d0 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f938ca0a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93880cffe0 con 0x7f938815b300 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f938ca0a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9388072d30 con 0x7f93880cd3f0 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f938659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f938806f8d0 0x7f938814c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f938659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f938806f8d0 0x7f938814c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48240/0 (socket says 172.21.15.19:48240) 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f938659c640 1 -- 172.21.15.19:0/92812435 learned_addr learned my addr 172.21.15.19:0/92812435 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f9386d9d640 1 --2- 172.21.15.19:0/92812435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938815b300 0x7f938806e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f9385d9b640 1 --2- 172.21.15.19:0/92812435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93880cd3f0 0x7f938806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f938659c640 1 -- 172.21.15.19:0/92812435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93880cd3f0 msgr2=0x7f938806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f938659c640 1 --2- 172.21.15.19:0/92812435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93880cd3f0 0x7f938806e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f938659c640 1 -- 172.21.15.19:0/92812435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938815b300 msgr2=0x7f938806e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f938659c640 1 --2- 172.21.15.19:0/92812435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938815b300 0x7f938806e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f938659c640 1 -- 172.21.15.19:0/92812435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9388151390 con 0x7f938806f8d0 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f9386d9d640 1 --2- 172.21.15.19:0/92812435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938815b300 0x7f938806e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f9385d9b640 1 --2- 172.21.15.19:0/92812435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93880cd3f0 0x7f938806e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f938659c640 1 --2- 172.21.15.19:0/92812435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f938806f8d0 0x7f938814c030 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f937800e870 tx=0x7f937800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f9376ffd640 1 -- 172.21.15.19:0/92812435 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9378017070 con 0x7f938806f8d0 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f9376ffd640 1 -- 172.21.15.19:0/92812435 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f937800c940 con 0x7f938806f8d0 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f938ca0a640 1 -- 172.21.15.19:0/92812435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9388150dd0 con 0x7f938806f8d0 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f9376ffd640 1 -- 172.21.15.19:0/92812435 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937800cd30 con 0x7f938806f8d0 2024-09-12T02:02:47.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.584+0000 7f938ca0a640 1 -- 172.21.15.19:0/92812435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93881f99c0 con 0x7f938806f8d0 2024-09-12T02:02:47.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.585+0000 7f938ca0a640 1 -- 172.21.15.19:0/92812435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f938815bd40 con 0x7f938806f8d0 2024-09-12T02:02:47.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.586+0000 7f9376ffd640 1 -- 172.21.15.19:0/92812435 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f937801a070 con 0x7f938806f8d0 2024-09-12T02:02:47.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.587+0000 7f9376ffd640 1 --2- 172.21.15.19:0/92812435 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f936806be30 0x7f936806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:47.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.587+0000 7f9376ffd640 1 -- 172.21.15.19:0/92812435 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6475+0+0 (secure 0 0 0) 0x7f937808b330 con 0x7f938806f8d0 2024-09-12T02:02:47.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.587+0000 7f9385d9b640 1 --2- 172.21.15.19:0/92812435 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f936806be30 0x7f936806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:47.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.588+0000 7f9385d9b640 1 --2- 172.21.15.19:0/92812435 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f936806be30 0x7f936806e2f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f937c000f60 tx=0x7f937c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:47.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.591+0000 7f9376ffd640 1 -- 172.21.15.19:0/92812435 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9378059a70 con 0x7f938806f8d0 2024-09-12T02:02:47.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.800+0000 7f938ca0a640 1 -- 172.21.15.19:0/92812435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f938815b780 con 0x7f938806f8d0 2024-09-12T02:02:47.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.800+0000 7f9376ffd640 1 -- 172.21.15.19:0/92812435 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+4388 (secure 0 0 0) 0x7f9378059370 con 0x7f938806f8d0 2024-09-12T02:02:47.801 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:47.801 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":93,"btime":"2024-09-12T02:02:44:441139+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1101861733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1101861733},{"type":"v1","addr":"172.21.15.135:6837","nonce":1101861733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:02:44.441134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:02:47.801 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 93 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.802+0000 7f938ca0a640 1 -- 172.21.15.19:0/92812435 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f936806be30 msgr2=0x7f936806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.802+0000 7f938ca0a640 1 --2- 172.21.15.19:0/92812435 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f936806be30 0x7f936806e2f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f937c000f60 tx=0x7f937c009040 comp rx=0 tx=0).stop 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.802+0000 7f938ca0a640 1 -- 172.21.15.19:0/92812435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f938806f8d0 msgr2=0x7f938814c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.802+0000 7f938ca0a640 1 --2- 172.21.15.19:0/92812435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f938806f8d0 0x7f938814c030 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f937800e870 tx=0x7f937800ed30 comp rx=0 tx=0).stop 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.802+0000 7f938ca0a640 1 -- 172.21.15.19:0/92812435 shutdown_connections 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.802+0000 7f938ca0a640 1 --2- 172.21.15.19:0/92812435 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f936806be30 0x7f936806e2f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.802+0000 7f938ca0a640 1 --2- 172.21.15.19:0/92812435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938815b300 0x7f938806e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.802+0000 7f938ca0a640 1 --2- 172.21.15.19:0/92812435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93880cd3f0 0x7f938806e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.802+0000 7f938ca0a640 1 --2- 172.21.15.19:0/92812435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f938806f8d0 0x7f938814c030 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:47.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.802+0000 7f938ca0a640 1 -- 172.21.15.19:0/92812435 >> 172.21.15.19:0/92812435 conn(0x7f9388067d70 msgr2=0x7f938806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:47.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.802+0000 7f938ca0a640 1 -- 172.21.15.19:0/92812435 shutdown_connections 2024-09-12T02:02:47.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:47.802+0000 7f938ca0a640 1 -- 172.21.15.19:0/92812435 wait complete. 2024-09-12T02:02:47.814 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 600.00000000' led to DAMAGED state 2024-09-12T02:02:47.814 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 1.00000000.inode' 2024-09-12T02:02:47.814 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:02:47.814 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:02:47.830 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:02:47.831 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:02:47.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:47.831 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:02:47.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:02:47.887 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:02:47.887 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:02:48.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.030+0000 7f184395f640 1 Processor -- start 2024-09-12T02:02:48.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.030+0000 7f184395f640 1 -- start start 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.031+0000 7f184395f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f183c15e760 0x7f183c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.031+0000 7f184395f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f183c0d4fd0 0x7f183c0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.031+0000 7f184395f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f183c0d2700 con 0x7f183c0b3650 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.031+0000 7f184395f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f183c0cedb0 con 0x7f183c0d4fd0 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.031+0000 7f184395f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f183c0cf090 con 0x7f183c15e760 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.032+0000 7f18416fb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f183c15e760 0x7f183c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.032+0000 7f1840efa640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f183c0d4fd0 0x7f183c0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.032+0000 7f18416fb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f183c15e760 0x7f183c06cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:54616/0 (socket says 172.21.15.19:54616) 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.032+0000 7f1841efc640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f183c0b3650 0x7f183c0d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:43834/0 (socket says 172.21.15.19:43834) 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.032+0000 7f18416fb640 1 -- 172.21.15.19:0/2354243593 learned_addr learned my addr 172.21.15.19:0/2354243593 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.032+0000 7f18416fb640 1 -- 172.21.15.19:0/2354243593 >> v2:172.21.15.135:3300/0 conn(0x7f183c0d4fd0 msgr2=0x7f183c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.032+0000 7f1833fff640 1 -- 172.21.15.19:0/2354243593 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 8557417 0 0) 0x7f1834001490 con 0x7f183c0b3650 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.032+0000 7f18416fb640 1 --2- 172.21.15.19:0/2354243593 >> v2:172.21.15.135:3300/0 conn(0x7f183c0d4fd0 0x7f183c0cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.032+0000 7f18416fb640 1 -- 172.21.15.19:0/2354243593 >> v1:172.21.15.135:6789/0 conn(0x7f183c0b3650 legacy=0x7f183c0d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.032+0000 7f18416fb640 1 -- 172.21.15.19:0/2354243593 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c0b3c80 con 0x7f183c15e760 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.033+0000 7f18416fb640 1 --2- 172.21.15.19:0/2354243593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f183c15e760 0x7f183c06cdd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1838009870 tx=0x7f183802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=729bbdeed337f1e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.033+0000 7f1833fff640 1 -- 172.21.15.19:0/2354243593 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1838037070 con 0x7f183c15e760 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.033+0000 7f1833fff640 1 -- 172.21.15.19:0/2354243593 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1838032440 con 0x7f183c15e760 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.033+0000 7f1833fff640 1 -- 172.21.15.19:0/2354243593 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1838032810 con 0x7f183c15e760 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.033+0000 7f184395f640 1 -- 172.21.15.19:0/2354243593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f183c15e760 msgr2=0x7f183c06cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:48.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.033+0000 7f184395f640 1 --2- 172.21.15.19:0/2354243593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f183c15e760 0x7f183c06cdd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1838009870 tx=0x7f183802a1c0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.033+0000 7f184395f640 1 -- 172.21.15.19:0/2354243593 shutdown_connections 2024-09-12T02:02:48.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.033+0000 7f184395f640 1 --2- 172.21.15.19:0/2354243593 >> v2:172.21.15.135:3300/0 conn(0x7f183c0d4fd0 0x7f183c0cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.033+0000 7f184395f640 1 --2- 172.21.15.19:0/2354243593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f183c15e760 0x7f183c06cdd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.033+0000 7f184395f640 1 -- 172.21.15.19:0/2354243593 >> 172.21.15.19:0/2354243593 conn(0x7f183c08bfc0 msgr2=0x7f183c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:48.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.034+0000 7f184395f640 1 -- 172.21.15.19:0/2354243593 shutdown_connections 2024-09-12T02:02:48.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.034+0000 7f184395f640 1 -- 172.21.15.19:0/2354243593 wait complete. 2024-09-12T02:02:48.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.035+0000 7f184395f640 1 Processor -- start 2024-09-12T02:02:48.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.035+0000 7f184395f640 1 -- start start 2024-09-12T02:02:48.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.035+0000 7f184395f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f183c0b3650 0x7f183c15d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:48.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.035+0000 7f184395f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f183c0d4fd0 0x7f183c0cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:48.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.035+0000 7f184395f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f183c15e760 0x7f183c0cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:48.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.035+0000 7f184395f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f183c0cfe80 con 0x7f183c0d4fd0 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.035+0000 7f184395f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f183c0cfd00 con 0x7f183c15e760 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.035+0000 7f184395f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f183c0d35b0 con 0x7f183c0b3650 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.036+0000 7f1840efa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f183c0d4fd0 0x7f183c0cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.036+0000 7f1840efa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f183c0d4fd0 0x7f183c0cdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48250/0 (socket says 172.21.15.19:48250) 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.036+0000 7f1840efa640 1 -- 172.21.15.19:0/601892076 learned_addr learned my addr 172.21.15.19:0/601892076 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.036+0000 7f1841efc640 1 --2- 172.21.15.19:0/601892076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f183c15e760 0x7f183c0cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.036+0000 7f18416fb640 1 --2- 172.21.15.19:0/601892076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f183c0b3650 0x7f183c15d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.036+0000 7f1840efa640 1 -- 172.21.15.19:0/601892076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f183c0b3650 msgr2=0x7f183c15d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.036+0000 7f1840efa640 1 --2- 172.21.15.19:0/601892076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f183c0b3650 0x7f183c15d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.036+0000 7f1840efa640 1 -- 172.21.15.19:0/601892076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f183c15e760 msgr2=0x7f183c0cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.036+0000 7f1840efa640 1 --2- 172.21.15.19:0/601892076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f183c15e760 0x7f183c0cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.036+0000 7f1840efa640 1 -- 172.21.15.19:0/601892076 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c15e080 con 0x7f183c0d4fd0 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.036+0000 7f1840efa640 1 --2- 172.21.15.19:0/601892076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f183c0d4fd0 0x7f183c0cdaa0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f182c00e8d0 tx=0x7f182c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:48.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.036+0000 7f1831ffb640 1 -- 172.21.15.19:0/601892076 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c017070 con 0x7f183c0d4fd0 2024-09-12T02:02:48.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.036+0000 7f184395f640 1 -- 172.21.15.19:0/601892076 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f183c0b7f60 con 0x7f183c0d4fd0 2024-09-12T02:02:48.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.036+0000 7f1831ffb640 1 -- 172.21.15.19:0/601892076 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f182c00c940 con 0x7f183c0d4fd0 2024-09-12T02:02:48.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.036+0000 7f1831ffb640 1 -- 172.21.15.19:0/601892076 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c00cd10 con 0x7f183c0d4fd0 2024-09-12T02:02:48.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.037+0000 7f184395f640 1 -- 172.21.15.19:0/601892076 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f183c0cb750 con 0x7f183c0d4fd0 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.038+0000 7f184395f640 1 -- 172.21.15.19:0/601892076 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f183c0d3930 con 0x7f183c0d4fd0 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.038+0000 7f1831ffb640 1 -- 172.21.15.19:0/601892076 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f182c01a070 con 0x7f183c0d4fd0 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.039+0000 7f1831ffb640 1 --2- 172.21.15.19:0/601892076 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f182006be30 0x7f182006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.039+0000 7f1831ffb640 1 -- 172.21.15.19:0/601892076 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6475+0+0 (secure 0 0 0) 0x7f182c08b4e0 con 0x7f183c0d4fd0 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.039+0000 7f18416fb640 1 --2- 172.21.15.19:0/601892076 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f182006be30 0x7f182006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.039+0000 7f18416fb640 1 --2- 172.21.15.19:0/601892076 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f182006be30 0x7f182006e2f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1838034000 tx=0x7f183802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:48.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.043+0000 7f1831ffb640 1 -- 172.21.15.19:0/601892076 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f183c15e080 con 0x7f183c0d4fd0 2024-09-12T02:02:48.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.256+0000 7f184395f640 1 -- 172.21.15.19:0/601892076 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f183c06e7b0 con 0x7f183c0d4fd0 2024-09-12T02:02:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.441+0000 7f1831ffb640 1 -- 172.21.15.19:0/601892076 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v94) ==== 161+0+0 (secure 0 0 0) 0x7f182c0594b0 con 0x7f183c0d4fd0 2024-09-12T02:02:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:02:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.443+0000 7f184395f640 1 -- 172.21.15.19:0/601892076 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f182006be30 msgr2=0x7f182006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.443+0000 7f184395f640 1 --2- 172.21.15.19:0/601892076 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f182006be30 0x7f182006e2f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1838034000 tx=0x7f183802e000 comp rx=0 tx=0).stop 2024-09-12T02:02:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.443+0000 7f184395f640 1 -- 172.21.15.19:0/601892076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f183c0d4fd0 msgr2=0x7f183c0cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.443+0000 7f184395f640 1 --2- 172.21.15.19:0/601892076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f183c0d4fd0 0x7f183c0cdaa0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f182c00e8d0 tx=0x7f182c00ed90 comp rx=0 tx=0).stop 2024-09-12T02:02:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.443+0000 7f184395f640 1 -- 172.21.15.19:0/601892076 shutdown_connections 2024-09-12T02:02:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.443+0000 7f184395f640 1 --2- 172.21.15.19:0/601892076 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f182006be30 0x7f182006e2f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.443+0000 7f184395f640 1 --2- 172.21.15.19:0/601892076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f183c15e760 0x7f183c0cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.443+0000 7f184395f640 1 --2- 172.21.15.19:0/601892076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f183c0d4fd0 0x7f183c0cdaa0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.443+0000 7f184395f640 1 --2- 172.21.15.19:0/601892076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f183c0b3650 0x7f183c15d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.443+0000 7f184395f640 1 -- 172.21.15.19:0/601892076 >> 172.21.15.19:0/601892076 conn(0x7f183c08bfc0 msgr2=0x7f183c0b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.443+0000 7f184395f640 1 -- 172.21.15.19:0/601892076 shutdown_connections 2024-09-12T02:02:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.443+0000 7f184395f640 1 -- 172.21.15.19:0/601892076 wait complete. 2024-09-12T02:02:48.455 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:02:48.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.557+0000 7fa22332a640 1 Processor -- start 2024-09-12T02:02:48.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.557+0000 7fa22332a640 1 -- start start 2024-09-12T02:02:48.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.558+0000 7fa22332a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c06df60 0x7fa21c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:48.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.558+0000 7fa22332a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa21c09af70 0x7fa21c168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:48.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.558+0000 7fa22332a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa21c06cec0 con 0x7fa21c15e5d0 2024-09-12T02:02:48.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.558+0000 7fa22332a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa21c06dad0 con 0x7fa21c09af70 2024-09-12T02:02:48.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.558+0000 7fa22332a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa21c06d1a0 con 0x7fa21c06df60 2024-09-12T02:02:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.558+0000 7fa2210c6640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa21c15e5d0 0x7fa21c0d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:51768/0 (socket says 172.21.15.19:51768) 2024-09-12T02:02:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.558+0000 7fa2210c6640 1 -- 172.21.15.19:0/4259303870 learned_addr learned my addr 172.21.15.19:0/4259303870 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.558+0000 7fa2208c5640 1 --2- 172.21.15.19:0/4259303870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c06df60 0x7fa21c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.558+0000 7fa2218c7640 1 --2- 172.21.15.19:0/4259303870 >> v2:172.21.15.135:3300/0 conn(0x7fa21c09af70 0x7fa21c168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.558+0000 7fa21bfff640 1 -- 172.21.15.19:0/4259303870 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2999682997 0 0) 0x7fa21c06cec0 con 0x7fa21c15e5d0 2024-09-12T02:02:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa21bfff640 1 -- 172.21.15.19:0/4259303870 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa204003520 con 0x7fa21c15e5d0 2024-09-12T02:02:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa21bfff640 1 -- 172.21.15.19:0/4259303870 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1756003925 0 0) 0x7fa204003520 con 0x7fa21c15e5d0 2024-09-12T02:02:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa21bfff640 1 -- 172.21.15.19:0/4259303870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c06df60 msgr2=0x7fa21c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa21bfff640 1 --2- 172.21.15.19:0/4259303870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c06df60 0x7fa21c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa21bfff640 1 -- 172.21.15.19:0/4259303870 >> v2:172.21.15.135:3300/0 conn(0x7fa21c09af70 msgr2=0x7fa21c168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa21bfff640 1 --2- 172.21.15.19:0/4259303870 >> v2:172.21.15.135:3300/0 conn(0x7fa21c09af70 0x7fa21c168560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa21bfff640 1 -- 172.21.15.19:0/4259303870 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21c06d480 con 0x7fa21c15e5d0 2024-09-12T02:02:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa21bfff640 1 -- 172.21.15.19:0/4259303870 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fa214001670 con 0x7fa21c15e5d0 2024-09-12T02:02:48.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa21bfff640 1 -- 172.21.15.19:0/4259303870 >> v1:172.21.15.19:6789/0 conn(0x7fa21c15e5d0 legacy=0x7fa21c0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:48.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa21bfff640 1 --2- 172.21.15.19:0/4259303870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2040039b0 0x7fa204003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:48.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa21bfff640 1 --2- 172.21.15.19:0/4259303870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa204004800 0x7fa204004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:48.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa21bfff640 1 --2- 172.21.15.19:0/4259303870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c06df60 0x7fa2040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:48.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa21bfff640 1 -- 172.21.15.19:0/4259303870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c06dad0 con 0x7fa2040039b0 2024-09-12T02:02:48.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa21bfff640 1 -- 172.21.15.19:0/4259303870 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c06d1a0 con 0x7fa204004800 2024-09-12T02:02:48.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa21bfff640 1 -- 172.21.15.19:0/4259303870 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa20400b9c0 con 0x7fa21c06df60 2024-09-12T02:02:48.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa2210c6640 1 --2- 172.21.15.19:0/4259303870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2040039b0 0x7fa204003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:48.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa2208c5640 1 --2- 172.21.15.19:0/4259303870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa204004800 0x7fa204004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:48.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa2218c7640 1 --2- 172.21.15.19:0/4259303870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c06df60 0x7fa2040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:48.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa2210c6640 1 -- 172.21.15.19:0/4259303870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c06df60 msgr2=0x7fa2040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:48.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa2210c6640 1 --2- 172.21.15.19:0/4259303870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c06df60 0x7fa2040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa2210c6640 1 -- 172.21.15.19:0/4259303870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa204004800 msgr2=0x7fa204004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:48.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa2210c6640 1 --2- 172.21.15.19:0/4259303870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa204004800 0x7fa204004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa2210c6640 1 -- 172.21.15.19:0/4259303870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa204003520 con 0x7fa2040039b0 2024-09-12T02:02:48.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.559+0000 7fa2218c7640 1 --2- 172.21.15.19:0/4259303870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c06df60 0x7fa2040051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:48.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.560+0000 7fa2210c6640 1 --2- 172.21.15.19:0/4259303870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2040039b0 0x7fa204003dd0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fa214001050 tx=0x7fa204005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93baf3055eb2d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:48.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.560+0000 7fa21bfff640 1 -- 172.21.15.19:0/4259303870 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21402e070 con 0x7fa2040039b0 2024-09-12T02:02:48.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.560+0000 7fa21bfff640 1 -- 172.21.15.19:0/4259303870 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa214005af0 con 0x7fa2040039b0 2024-09-12T02:02:48.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.560+0000 7fa21bfff640 1 -- 172.21.15.19:0/4259303870 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa214007d70 con 0x7fa2040039b0 2024-09-12T02:02:48.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.561+0000 7fa22332a640 1 -- 172.21.15.19:0/4259303870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2040039b0 msgr2=0x7fa204003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:48.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.561+0000 7fa22332a640 1 --2- 172.21.15.19:0/4259303870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2040039b0 0x7fa204003dd0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fa214001050 tx=0x7fa204005830 comp rx=0 tx=0).stop 2024-09-12T02:02:48.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.561+0000 7fa2218c7640 1 -- 172.21.15.19:0/4259303870 reap_dead start 2024-09-12T02:02:48.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.561+0000 7fa22332a640 1 -- 172.21.15.19:0/4259303870 shutdown_connections 2024-09-12T02:02:48.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.561+0000 7fa22332a640 1 -- 172.21.15.19:0/4259303870 >> 172.21.15.19:0/4259303870 conn(0x7fa21c0d23a0 msgr2=0x7fa21c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:48.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.561+0000 7fa22332a640 1 -- 172.21.15.19:0/4259303870 shutdown_connections 2024-09-12T02:02:48.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.561+0000 7fa22332a640 1 -- 172.21.15.19:0/4259303870 wait complete. 2024-09-12T02:02:48.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.562+0000 7fa22332a640 1 Processor -- start 2024-09-12T02:02:48.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.562+0000 7fa22332a640 1 -- start start 2024-09-12T02:02:48.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.563+0000 7fa22332a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2040039b0 0x7fa21c155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:48.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.563+0000 7fa22332a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c0b7750 0x7fa21c0b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:48.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.563+0000 7fa22332a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa21c15d300 0x7fa21c15d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:48.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.563+0000 7fa22332a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c0d1980 con 0x7fa2040039b0 2024-09-12T02:02:48.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.563+0000 7fa22332a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c0d1800 con 0x7fa21c15d300 2024-09-12T02:02:48.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.563+0000 7fa22332a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa21c15e9b0 con 0x7fa21c0b7750 2024-09-12T02:02:48.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.563+0000 7fa2210c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2040039b0 0x7fa21c155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:48.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.563+0000 7fa2210c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2040039b0 0x7fa21c155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48262/0 (socket says 172.21.15.19:48262) 2024-09-12T02:02:48.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.563+0000 7fa2210c6640 1 -- 172.21.15.19:0/3760428455 learned_addr learned my addr 172.21.15.19:0/3760428455 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:48.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.563+0000 7fa2218c7640 1 --2- 172.21.15.19:0/3760428455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa21c15d300 0x7fa21c15d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:48.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.563+0000 7fa2208c5640 1 --2- 172.21.15.19:0/3760428455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c0b7750 0x7fa21c0b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:48.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.563+0000 7fa2210c6640 1 -- 172.21.15.19:0/3760428455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c0b7750 msgr2=0x7fa21c0b7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:48.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.563+0000 7fa2210c6640 1 --2- 172.21.15.19:0/3760428455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c0b7750 0x7fa21c0b7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.563+0000 7fa2210c6640 1 -- 172.21.15.19:0/3760428455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa21c15d300 msgr2=0x7fa21c15d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:48.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.563+0000 7fa2210c6640 1 --2- 172.21.15.19:0/3760428455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa21c15d300 0x7fa21c15d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.563+0000 7fa2210c6640 1 -- 172.21.15.19:0/3760428455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21c1f5460 con 0x7fa2040039b0 2024-09-12T02:02:48.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.563+0000 7fa2210c6640 1 --2- 172.21.15.19:0/3760428455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2040039b0 0x7fa21c155b00 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fa21400c2d0 tx=0x7fa214000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:48.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.564+0000 7fa219ffb640 1 -- 172.21.15.19:0/3760428455 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa214042070 con 0x7fa2040039b0 2024-09-12T02:02:48.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.564+0000 7fa219ffb640 1 -- 172.21.15.19:0/3760428455 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa214007480 con 0x7fa2040039b0 2024-09-12T02:02:48.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.564+0000 7fa22332a640 1 -- 172.21.15.19:0/3760428455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa21c1f46a0 con 0x7fa2040039b0 2024-09-12T02:02:48.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.564+0000 7fa219ffb640 1 -- 172.21.15.19:0/3760428455 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa214001cc0 con 0x7fa2040039b0 2024-09-12T02:02:48.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.564+0000 7fa22332a640 1 -- 172.21.15.19:0/3760428455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa21c1f4c60 con 0x7fa2040039b0 2024-09-12T02:02:48.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.565+0000 7fa22332a640 1 -- 172.21.15.19:0/3760428455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa21c09aa30 con 0x7fa2040039b0 2024-09-12T02:02:48.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.565+0000 7fa219ffb640 1 -- 172.21.15.19:0/3760428455 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa214045070 con 0x7fa2040039b0 2024-09-12T02:02:48.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.566+0000 7fa219ffb640 1 --2- 172.21.15.19:0/3760428455 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa20806be60 0x7fa20806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:48.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.566+0000 7fa219ffb640 1 -- 172.21.15.19:0/3760428455 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6475+0+0 (secure 0 0 0) 0x7fa2140ab9b0 con 0x7fa2040039b0 2024-09-12T02:02:48.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.566+0000 7fa2208c5640 1 --2- 172.21.15.19:0/3760428455 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa20806be60 0x7fa20806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:48.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.567+0000 7fa2208c5640 1 --2- 172.21.15.19:0/3760428455 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa20806be60 0x7fa20806e320 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa21c071900 tx=0x7fa210009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:48.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.570+0000 7fa219ffb640 1 -- 172.21.15.19:0/3760428455 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa214005ac0 con 0x7fa2040039b0 2024-09-12T02:02:48.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:48.815+0000 7fa22332a640 1 -- 172.21.15.19:0/3760428455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7fa21c0b8320 con 0x7fa2040039b0 2024-09-12T02:02:49.191 INFO:tasks.ceph.mds.c.smithi019.stderr: -48> 2024-09-12T02:02:44.439+0000 7f3dd56a3640 -1 log_channel(cluster) log [ERR] : dir 0x600 object missing on disk; some files may be lost (~mds0/stray0) 2024-09-12T02:02:49.192 INFO:tasks.ceph.mds.c.smithi019.stderr: -46> 2024-09-12T02:02:44.439+0000 7f3dd56a3640 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x600 is fatal because it is a system directory for this rank 2024-09-12T02:02:49.192 INFO:tasks.ceph.mds.c.smithi019.stderr: -34> 2024-09-12T02:02:45.112+0000 7f3dd96ab640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:02:49.217 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:02:49.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.446+0000 7fa219ffb640 1 -- 172.21.15.19:0/3760428455 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v95) ==== 101+0+0 (secure 0 0 0) 0x7fa214079b30 con 0x7fa2040039b0 2024-09-12T02:02:49.447 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:02:49.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.449+0000 7fa22332a640 1 -- 172.21.15.19:0/3760428455 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa20806be60 msgr2=0x7fa20806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.449+0000 7fa22332a640 1 --2- 172.21.15.19:0/3760428455 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa20806be60 0x7fa20806e320 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa21c071900 tx=0x7fa210009190 comp rx=0 tx=0).stop 2024-09-12T02:02:49.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.449+0000 7fa22332a640 1 -- 172.21.15.19:0/3760428455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2040039b0 msgr2=0x7fa21c155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.449+0000 7fa22332a640 1 --2- 172.21.15.19:0/3760428455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2040039b0 0x7fa21c155b00 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fa21400c2d0 tx=0x7fa214000fe0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.449+0000 7fa22332a640 1 -- 172.21.15.19:0/3760428455 shutdown_connections 2024-09-12T02:02:49.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.449+0000 7fa22332a640 1 --2- 172.21.15.19:0/3760428455 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa20806be60 0x7fa20806e320 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.449+0000 7fa22332a640 1 --2- 172.21.15.19:0/3760428455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa21c15d300 0x7fa21c15d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.449+0000 7fa22332a640 1 --2- 172.21.15.19:0/3760428455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c0b7750 0x7fa21c0b7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.449+0000 7fa22332a640 1 --2- 172.21.15.19:0/3760428455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2040039b0 0x7fa21c155b00 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.449+0000 7fa22332a640 1 -- 172.21.15.19:0/3760428455 >> 172.21.15.19:0/3760428455 conn(0x7fa21c0d23a0 msgr2=0x7fa21c071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:49.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.449+0000 7fa22332a640 1 -- 172.21.15.19:0/3760428455 shutdown_connections 2024-09-12T02:02:49.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.449+0000 7fa22332a640 1 -- 172.21.15.19:0/3760428455 wait complete. 2024-09-12T02:02:49.463 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:02:49.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.509+0000 7fe37b33df40 1 Processor -- start 2024-09-12T02:02:49.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.509+0000 7fe37b33df40 1 -- start start 2024-09-12T02:02:49.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe37b33df40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3640030f0 0x55f8f5c34fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe37b33df40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8f5c38280 0x55f8f5c55a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe37b33df40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8f5c57bc0 0x55f8f5c58e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe37b33df40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f8f5b7dae0 con 0x55f8f5c57bc0 2024-09-12T02:02:49.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe37b33df40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f8f5ad0510 con 0x55f8f5c38280 2024-09-12T02:02:49.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe37b33df40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55f8f5b7ddc0 con 0x7fe3640030f0 2024-09-12T02:02:49.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe379634640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8f5c57bc0 0x55f8f5c58e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe379634640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8f5c57bc0 0x55f8f5c58e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48302/0 (socket says 172.21.15.19:48302) 2024-09-12T02:02:49.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe379634640 1 -- 172.21.15.19:0/4005459132 learned_addr learned my addr 172.21.15.19:0/4005459132 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:49.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe370632640 1 --2- 172.21.15.19:0/4005459132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8f5c38280 0x55f8f5c55a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe378e33640 1 --2- 172.21.15.19:0/4005459132 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3640030f0 0x55f8f5c34fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe379634640 1 -- 172.21.15.19:0/4005459132 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3640030f0 msgr2=0x55f8f5c34fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:49.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe379634640 1 --2- 172.21.15.19:0/4005459132 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3640030f0 0x55f8f5c34fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe379634640 1 -- 172.21.15.19:0/4005459132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8f5c38280 msgr2=0x55f8f5c55a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:49.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe379634640 1 --2- 172.21.15.19:0/4005459132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8f5c38280 0x55f8f5c55a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe379634640 1 -- 172.21.15.19:0/4005459132 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8f5c3eec0 con 0x55f8f5c57bc0 2024-09-12T02:02:49.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe370632640 1 --2- 172.21.15.19:0/4005459132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8f5c38280 0x55f8f5c55a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:49.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe378e33640 1 --2- 172.21.15.19:0/4005459132 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3640030f0 0x55f8f5c34fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:49.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.510+0000 7fe379634640 1 --2- 172.21.15.19:0/4005459132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8f5c57bc0 0x55f8f5c58e10 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x55f8f5c3ff60 tx=0x7fe374005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf5e2d0122762da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:49.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.511+0000 7fe3737fe640 1 -- 172.21.15.19:0/4005459132 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374017030 con 0x55f8f5c57bc0 2024-09-12T02:02:49.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.511+0000 7fe3737fe640 1 -- 172.21.15.19:0/4005459132 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe374012670 con 0x55f8f5c57bc0 2024-09-12T02:02:49.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.511+0000 7fe3737fe640 1 -- 172.21.15.19:0/4005459132 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374012860 con 0x55f8f5c57bc0 2024-09-12T02:02:49.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.511+0000 7fe37b33df40 1 -- 172.21.15.19:0/4005459132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8f5c57bc0 msgr2=0x55f8f5c58e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.511+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4005459132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8f5c57bc0 0x55f8f5c58e10 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x55f8f5c3ff60 tx=0x7fe374005d80 comp rx=0 tx=0).stop 2024-09-12T02:02:49.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.511+0000 7fe37b33df40 1 -- 172.21.15.19:0/4005459132 shutdown_connections 2024-09-12T02:02:49.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.511+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4005459132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8f5c57bc0 0x55f8f5c58e10 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.511+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4005459132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8f5c38280 0x55f8f5c55a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.511+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4005459132 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3640030f0 0x55f8f5c34fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.511+0000 7fe37b33df40 1 -- 172.21.15.19:0/4005459132 >> 172.21.15.19:0/4005459132 conn(0x55f8f5b7e9e0 msgr2=0x55f8f5bc5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:49.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.511+0000 7fe37b33df40 1 -- 172.21.15.19:0/4005459132 shutdown_connections 2024-09-12T02:02:49.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.511+0000 7fe37b33df40 1 -- 172.21.15.19:0/4005459132 wait complete. 2024-09-12T02:02:49.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.512+0000 7fe37b33df40 1 Processor -- start 2024-09-12T02:02:49.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.512+0000 7fe37b33df40 1 -- start start 2024-09-12T02:02:49.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.512+0000 7fe37b33df40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f8f5c38280 0x55f8f5c34510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.512+0000 7fe37b33df40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8f5c57bc0 0x55f8f5b7d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe37b33df40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3640030f0 0x55f8f5c25910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe37b33df40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f8f5c57950 con 0x55f8f5c57bc0 2024-09-12T02:02:49.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe37b33df40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f8f5c35520 con 0x7fe3640030f0 2024-09-12T02:02:49.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe37b33df40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55f8f5c3e910 con 0x55f8f5c38280 2024-09-12T02:02:49.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe370632640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8f5c57bc0 0x55f8f5b7d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe370632640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8f5c57bc0 0x55f8f5b7d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48308/0 (socket says 172.21.15.19:48308) 2024-09-12T02:02:49.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 learned_addr learned my addr 172.21.15.19:0/4046316544 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:49.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe379634640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3640030f0 0x55f8f5c25910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe378e33640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f8f5c38280 0x55f8f5c34510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f8f5c38280 msgr2=0x55f8f5c34510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe370632640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f8f5c38280 0x55f8f5c34510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3640030f0 msgr2=0x55f8f5c25910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe370632640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3640030f0 0x55f8f5c25910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8f5c356a0 con 0x55f8f5c57bc0 2024-09-12T02:02:49.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe370632640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8f5c57bc0 0x55f8f5b7d000 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fe360025e00 tx=0x7fe360003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:49.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe3727fc640 1 -- 172.21.15.19:0/4046316544 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe360069070 con 0x55f8f5c57bc0 2024-09-12T02:02:49.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe3727fc640 1 -- 172.21.15.19:0/4046316544 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe36004f860 con 0x55f8f5c57bc0 2024-09-12T02:02:49.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8f5c35980 con 0x55f8f5c57bc0 2024-09-12T02:02:49.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe3727fc640 1 -- 172.21.15.19:0/4046316544 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe360009410 con 0x55f8f5c57bc0 2024-09-12T02:02:49.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.513+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8f5c35f40 con 0x55f8f5c57bc0 2024-09-12T02:02:49.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.515+0000 7fe3727fc640 1 -- 172.21.15.19:0/4046316544 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe360058400 con 0x55f8f5c57bc0 2024-09-12T02:02:49.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.515+0000 7fe3727fc640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe35806a810 0x7fe35806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.515+0000 7fe3727fc640 1 -- 172.21.15.19:0/4046316544 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6475+0+0 (secure 0 0 0) 0x7fe3600cd350 con 0x55f8f5c57bc0 2024-09-12T02:02:49.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.515+0000 7fe378e33640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe35806a810 0x7fe35806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.519 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:02:49.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.516+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55f8f5b7d540 0x55f8f5bad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.516+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5c593f0 con 0x55f8f5b7d540 2024-09-12T02:02:49.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.516+0000 7fe379634640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55f8f5b7d540 0x55f8f5bad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.516+0000 7fe378e33640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe35806a810 0x7fe35806ccd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe368000fb0 tx=0x7fe368001e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:49.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.516+0000 7fe379634640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55f8f5b7d540 0x55f8f5bad4d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:49.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.517+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v97'73 uv48 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.517+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5bada10 con 0x55f8f5b7d540 2024-09-12T02:02:49.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.518+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v97'74 uv74 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.518+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9400 con 0x55f8f5b7d540 2024-09-12T02:02:49.521 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:02:49.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.521+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v97'75 uv75 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.521+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cfa7b0 con 0x55f8f5b7d540 2024-09-12T02:02:49.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.524+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v97'76 uv76 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.524+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cfab50 con 0x55f8f5b7d540 2024-09-12T02:02:49.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.527+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v97'77 uv77 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.527+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf97a0 con 0x55f8f5b7d540 2024-09-12T02:02:49.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.529+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v97'78 uv78 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.529+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9b40 con 0x55f8f5b7d540 2024-09-12T02:02:49.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.532+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v97'79 uv54 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.532+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9f30 con 0x55f8f5b7d540 2024-09-12T02:02:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.535+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v97'80 uv80 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.535+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9f30 con 0x55f8f5b7d540 2024-09-12T02:02:49.537 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:02:49.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.537+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v97'81 uv81 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.537+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.540+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v97'82 uv82 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.540+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.543+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v97'83 uv83 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.543+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.545+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v97'84 uv84 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.545+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.548+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v97'85 uv59 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.548+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.549+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v97'86 uv86 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.549+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.550 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:02:49.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.550+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v97'87 uv87 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.550+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.551+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v97'88 uv88 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.551+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.552+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v97'89 uv89 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.552+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.555+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v97'90 uv90 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.555+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.558+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v97'91 uv91 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.558+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.561 INFO:teuthology.orchestra.run.smithi019.stdout:Write #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:02:49.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.561+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v97'92 uv92 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.561+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.564+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [setxattr (30)] v97'93 uv93 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.564+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.566+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [setxattr (62)] v97'94 uv94 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.566+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.569+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [omap-set-header] v97'95 uv95 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.569+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.572+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 603.00000000 [create] v97'96 uv71 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.572+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.573+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 603.00000000 [delete] v97'97 uv97 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.573+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.575 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:02:49.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.575+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v97'98 uv98 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.575+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.576+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [setxattr (30)] v97'99 uv99 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.576+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.577+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [setxattr (62)] v97'100 uv100 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.577+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5b7d540 2024-09-12T02:02:49.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.579+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [omap-set-header] v97'101 uv101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5b7d540 2024-09-12T02:02:49.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.579+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55f8f5cfa310 0x55f8f5cfd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.579+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:30 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cf9ee0 con 0x55f8f5cfa310 2024-09-12T02:02:49.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.580+0000 7fe378e33640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55f8f5cfa310 0x55f8f5cfd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.580+0000 7fe378e33640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55f8f5cfa310 0x55f8f5cfd410 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:49.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.581+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(30 1.00000000.inode [create] v97'68 uv50 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.581+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:31 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cfd950 con 0x55f8f5cfa310 2024-09-12T02:02:49.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.583+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(31 1.00000000.inode [delete] v97'69 uv69 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.583+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cfdcf0 con 0x55f8f5cfa310 2024-09-12T02:02:49.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.584+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(32 1.00000000.inode [create] v97'70 uv70 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.584 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:02:49.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.584+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cfe540 con 0x55f8f5cfa310 2024-09-12T02:02:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.585+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(33 1.00000000.inode [write 0~582] v97'71 uv71 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.585+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cfe8e0 con 0x55f8f5cfa310 2024-09-12T02:02:49.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.586+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(34 1.00000000.inode [omap-set-header] v97'72 uv72 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.586+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cfec80 con 0x55f8f5cfa310 2024-09-12T02:02:49.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.587+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(35 200.00000000 [create] v97'73 uv55 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.587+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cff020 con 0x55f8f5cfa310 2024-09-12T02:02:49.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.588+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(36 200.00000000 [delete] v97'74 uv74 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.588+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cff3c0 con 0x55f8f5cfa310 2024-09-12T02:02:49.589 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:02:49.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.589+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(37 200.00000000 [create] v97'75 uv75 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.589+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cff3c0 con 0x55f8f5cfa310 2024-09-12T02:02:49.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.591+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(38 200.00000000 [write 0~90] v97'76 uv76 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.591+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cff3c0 con 0x55f8f5cfa310 2024-09-12T02:02:49.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.592+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(39 200.00000000 [omap-set-header] v97'77 uv77 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.592+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cff3c0 con 0x55f8f5cfa310 2024-09-12T02:02:49.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.593+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(40 200.00000001 [create] v97'78 uv60 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.593+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cff3c0 con 0x55f8f5cfa310 2024-09-12T02:02:49.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.594+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(41 200.00000001 [delete] v97'79 uv79 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.594+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cff3c0 con 0x55f8f5cfa310 2024-09-12T02:02:49.595 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:02:49.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.595+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(42 200.00000001 [create] v97'80 uv80 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.595+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d03840 con 0x55f8f5cfa310 2024-09-12T02:02:49.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.597+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(43 200.00000001 [write 0~17490] v97'81 uv81 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.597+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d03840 con 0x55f8f5cfa310 2024-09-12T02:02:49.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.598+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(44 200.00000001 [omap-set-header] v97'82 uv82 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.598+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cff3c0 con 0x55f8f5cfa310 2024-09-12T02:02:49.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.599+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(45 606.00000000 [create] v97'83 uv66 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.599+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cff3c0 con 0x55f8f5cfa310 2024-09-12T02:02:49.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.600+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(46 606.00000000 [delete] v97'84 uv84 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.600+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cff3c0 con 0x55f8f5cfa310 2024-09-12T02:02:49.601 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:02:49.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.601+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(47 606.00000000 [create] v97'85 uv85 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.601+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d003d0 con 0x55f8f5cfa310 2024-09-12T02:02:49.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.602+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(48 606.00000000 [setxattr (30)] v97'86 uv86 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.602+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d003d0 con 0x55f8f5cfa310 2024-09-12T02:02:49.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.603+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(49 606.00000000 [setxattr (62)] v97'87 uv87 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.603+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5cff3c0 con 0x55f8f5cfa310 2024-09-12T02:02:49.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.604+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(50 606.00000000 [omap-set-header] v97'88 uv88 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5cfa310 2024-09-12T02:02:49.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.604+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55f8f5cffcc0 0x55f8f5d00100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.604+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:51 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d027a0 con 0x55f8f5cffcc0 2024-09-12T02:02:49.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.605+0000 7fe370632640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55f8f5cffcc0 0x55f8f5d00100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.605+0000 7fe370632640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55f8f5cffcc0 0x55f8f5d00100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:49.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.606+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(51 607.00000000 [create] v97'15 uv14 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.606+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:52 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d02b40 con 0x55f8f5cffcc0 2024-09-12T02:02:49.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.607+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(52 607.00000000 [delete] v97'16 uv16 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.607+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d02ee0 con 0x55f8f5cffcc0 2024-09-12T02:02:49.609 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:02:49.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.609+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(53 607.00000000 [create] v97'17 uv17 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.609+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d04790 con 0x55f8f5cffcc0 2024-09-12T02:02:49.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.610+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(54 607.00000000 [setxattr (30)] v97'18 uv18 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.610+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d04b30 con 0x55f8f5cffcc0 2024-09-12T02:02:49.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.611+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(55 607.00000000 [setxattr (62)] v97'19 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.611+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d03780 con 0x55f8f5cffcc0 2024-09-12T02:02:49.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.612+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(56 607.00000000 [omap-set-header] v97'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.612+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55f8f5d04080 0x55f8f5d06ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.612+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:57 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d07420 con 0x55f8f5d04080 2024-09-12T02:02:49.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.612+0000 7fe379634640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55f8f5d04080 0x55f8f5d06ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.612+0000 7fe379634640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55f8f5d04080 0x55f8f5d06ee0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:49.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.614+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(57 mds0_openfiles.0 [create] v97'13 uv12 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.614+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:58 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d07420 con 0x55f8f5d04080 2024-09-12T02:02:49.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.615+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(58 mds0_openfiles.0 [delete] v97'14 uv14 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.615+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d07810 con 0x55f8f5d04080 2024-09-12T02:02:49.616 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:02:49.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.616+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(59 mds0_openfiles.0 [create] v97'15 uv15 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.616+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d07810 con 0x55f8f5d04080 2024-09-12T02:02:49.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.617+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(60 mds0_openfiles.0 [omap-set-header] v97'16 uv16 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.617+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55f8f5d07e90 0x55f8f5d0a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.617+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:61 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0a860 con 0x55f8f5d07e90 2024-09-12T02:02:49.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.617+0000 7fe378e33640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55f8f5d07e90 0x55f8f5d0a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.618+0000 7fe378e33640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55f8f5d07e90 0x55f8f5d0a280 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:49.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.619+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(61 608.00000000 [create] v97'15 uv14 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.619+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:62 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0a920 con 0x55f8f5d07e90 2024-09-12T02:02:49.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.623+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(62 608.00000000 [delete] v97'16 uv16 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.623+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d07e90 2024-09-12T02:02:49.624 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:02:49.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.624+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(63 608.00000000 [create] v97'17 uv17 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.624+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0bd20 con 0x55f8f5d07e90 2024-09-12T02:02:49.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.627+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(64 608.00000000 [setxattr (30)] v97'18 uv18 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.627+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0bd20 con 0x55f8f5d07e90 2024-09-12T02:02:49.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.629+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(65 608.00000000 [setxattr (62)] v97'19 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.629+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d07e90 2024-09-12T02:02:49.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.634+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(66 608.00000000 [omap-set-header] v97'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.634+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:67 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d04080 2024-09-12T02:02:49.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.634+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(67 604.00000000 [create] v97'26 uv20 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.635+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:68 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d04080 2024-09-12T02:02:49.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.636+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(68 604.00000000 [delete] v97'27 uv27 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.636+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d04080 2024-09-12T02:02:49.637 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:02:49.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.637+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(69 604.00000000 [create] v97'28 uv28 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.637+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0bd20 con 0x55f8f5d04080 2024-09-12T02:02:49.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.638+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(70 604.00000000 [setxattr (30)] v97'29 uv29 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.638+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0bd20 con 0x55f8f5d04080 2024-09-12T02:02:49.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.639+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(71 604.00000000 [setxattr (62)] v97'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.639+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d04080 2024-09-12T02:02:49.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.640+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(72 604.00000000 [omap-set-header] v97'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.640+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d04080 2024-09-12T02:02:49.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.641+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(73 500.00000000 [create] v97'32 uv25 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.641+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d04080 2024-09-12T02:02:49.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.642+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(74 500.00000000 [delete] v97'33 uv33 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.642+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d04080 2024-09-12T02:02:49.643 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:02:49.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.642+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(75 500.00000000 [create] v97'34 uv34 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.642+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d04080 2024-09-12T02:02:49.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.644+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(76 500.00000000 [write 0~90] v97'35 uv35 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.644+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d04080 2024-09-12T02:02:49.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.645+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(77 500.00000000 [omap-set-header] v97'36 uv36 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.645+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d04080 2024-09-12T02:02:49.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.646+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(78 mds_snaptable [create] v97'12 uv11 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.646+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d04080 2024-09-12T02:02:49.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.647+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(79 mds_snaptable [delete] v97'13 uv13 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.647+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d04080 2024-09-12T02:02:49.648 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:02:49.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.648+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(80 mds_snaptable [create] v97'14 uv14 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.648+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d04080 2024-09-12T02:02:49.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.649+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(81 mds_snaptable [write 0~70] v97'15 uv15 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.649+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d04080 2024-09-12T02:02:49.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.650+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(82 mds_snaptable [omap-set-header] v97'16 uv16 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe374012c40 con 0x55f8f5d04080 2024-09-12T02:02:49.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.650+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:83 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d07e90 2024-09-12T02:02:49.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.651+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(83 605.00000000 [create] v97'15 uv14 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.651+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:84 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d07e90 2024-09-12T02:02:49.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.652+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(84 605.00000000 [delete] v97'16 uv16 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.652+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d07e90 2024-09-12T02:02:49.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.653+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(85 605.00000000 [create] v97'17 uv17 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.653 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:02:49.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.653+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0bd20 con 0x55f8f5d07e90 2024-09-12T02:02:49.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.654+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(86 605.00000000 [setxattr (30)] v97'18 uv18 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.654+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0bd20 con 0x55f8f5d07e90 2024-09-12T02:02:49.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.655+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(87 605.00000000 [setxattr (62)] v97'19 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.655+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d07e90 2024-09-12T02:02:49.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.656+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(88 605.00000000 [omap-set-header] v97'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.656+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d07e90 2024-09-12T02:02:49.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.657+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(89 mds0_inotable [create] v97'24 uv18 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.657+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d07e90 2024-09-12T02:02:49.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.658+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(90 mds0_inotable [delete] v97'25 uv25 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.658+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d07e90 2024-09-12T02:02:49.659 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:02:49.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.659+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(91 mds0_inotable [create] v97'26 uv26 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.659+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d07e90 2024-09-12T02:02:49.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.660+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(92 mds0_inotable [write 0~34] v97'27 uv27 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.660+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d07e90 2024-09-12T02:02:49.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.661+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v97'28 uv28 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.661+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d07e90 2024-09-12T02:02:49.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.662+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(94 100.00000000 [create] v97'29 uv23 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.662+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d07e90 2024-09-12T02:02:49.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.663+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(95 100.00000000 [delete] v97'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.663+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ad10 con 0x55f8f5d07e90 2024-09-12T02:02:49.664 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:02:49.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.664+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(96 100.00000000 [create] v97'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.664+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d03310 con 0x55f8f5d07e90 2024-09-12T02:02:49.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.665+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(97 100.00000000 [omap-set-header] v97'32 uv32 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.665+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0db20 con 0x55f8f5d07e90 2024-09-12T02:02:49.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.666+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v97'33 uv33 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.666+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55f8f5d0b840 0x55f8f5d0dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.666+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:99 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e1e0 con 0x55f8f5d0b840 2024-09-12T02:02:49.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.667+0000 7fe370632640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55f8f5d0b840 0x55f8f5d0dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.667+0000 7fe370632640 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55f8f5d0b840 0x55f8f5d0dc30 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:49.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.668+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(99 mds0_sessionmap [create] v97'14 uv12 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5d0b840 2024-09-12T02:02:49.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.668+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:100 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e580 con 0x55f8f5d0b840 2024-09-12T02:02:49.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.669+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(100 mds0_sessionmap [delete] v97'15 uv15 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5d0b840 2024-09-12T02:02:49.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.669+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e580 con 0x55f8f5d0b840 2024-09-12T02:02:49.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.670+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(101 mds0_sessionmap [create] v97'16 uv16 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5d0b840 2024-09-12T02:02:49.670 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:02:49.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.670+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e970 con 0x55f8f5d0b840 2024-09-12T02:02:49.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.671+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v97'17 uv17 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5d0b840 2024-09-12T02:02:49.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.671+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:103 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e970 con 0x55f8f5d07e90 2024-09-12T02:02:49.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.672+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(103 609.00000000 [create] v97'15 uv14 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.672+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:104 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e970 con 0x55f8f5d07e90 2024-09-12T02:02:49.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.673+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(104 609.00000000 [delete] v97'16 uv16 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.673+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e970 con 0x55f8f5d07e90 2024-09-12T02:02:49.676 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:02:49.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.676+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(105 609.00000000 [create] v97'17 uv17 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.676+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0f980 con 0x55f8f5d07e90 2024-09-12T02:02:49.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.677+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v97'18 uv18 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.677+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0f980 con 0x55f8f5d07e90 2024-09-12T02:02:49.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.678+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v97'19 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.678+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e970 con 0x55f8f5d07e90 2024-09-12T02:02:49.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.682+0000 7fe378e33640 1 -- 172.21.15.19:0/4046316544 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(108 609.00000000 [omap-set-header] v97'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe368011ba0 con 0x55f8f5d07e90 2024-09-12T02:02:49.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.682+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:109 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e970 con 0x55f8f5cffcc0 2024-09-12T02:02:49.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.683+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(109 400.00000000 [create] v97'12 uv11 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.683+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:110 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e600 con 0x55f8f5cffcc0 2024-09-12T02:02:49.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.684+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(110 400.00000000 [delete] v97'13 uv13 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.684+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e580 con 0x55f8f5cffcc0 2024-09-12T02:02:49.685 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:02:49.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.685+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(111 400.00000000 [create] v97'14 uv14 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.685+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e580 con 0x55f8f5cffcc0 2024-09-12T02:02:49.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.687+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(112 400.00000000 [write 0~22] v97'15 uv15 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.687+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e580 con 0x55f8f5cffcc0 2024-09-12T02:02:49.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.688+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(113 400.00000000 [omap-set-header] v97'16 uv16 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.688+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e580 con 0x55f8f5cffcc0 2024-09-12T02:02:49.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.689+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(114 100.00000000.inode [create] v97'33 uv24 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.689+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e580 con 0x55f8f5cffcc0 2024-09-12T02:02:49.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.690+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(115 100.00000000.inode [delete] v97'34 uv34 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.690+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e580 con 0x55f8f5cffcc0 2024-09-12T02:02:49.691 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:02:49.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.691+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(116 100.00000000.inode [create] v97'35 uv35 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.691+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e5a0 con 0x55f8f5cffcc0 2024-09-12T02:02:49.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.692+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v97'36 uv36 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.692+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ead0 con 0x55f8f5cffcc0 2024-09-12T02:02:49.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.693+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v97'37 uv37 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.693+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ead0 con 0x55f8f5cffcc0 2024-09-12T02:02:49.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.694+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(119 1.00000000 [create] v97'38 uv31 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.694+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e9e0 con 0x55f8f5cffcc0 2024-09-12T02:02:49.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.694+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(120 1.00000000 [delete] v97'39 uv39 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.694+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e990 con 0x55f8f5cffcc0 2024-09-12T02:02:49.695 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:02:49.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.695+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(121 1.00000000 [create] v97'40 uv40 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.695+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e990 con 0x55f8f5cffcc0 2024-09-12T02:02:49.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.696+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v97'41 uv41 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.696+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e970 con 0x55f8f5cffcc0 2024-09-12T02:02:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.697+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v97'42 uv42 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.697+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0e970 con 0x55f8f5cffcc0 2024-09-12T02:02:49.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.698+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(124 1.00000000 [omap-set-header] v97'43 uv43 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.698+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55f8f5d0ed50 con 0x55f8f5cffcc0 2024-09-12T02:02:49.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe370632640 1 -- 172.21.15.19:0/4046316544 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v97'44 uv44 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fe360097a10 con 0x55f8f5cffcc0 2024-09-12T02:02:49.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55f8f5cfa310 msgr2=0x55f8f5cfd410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55f8f5cfa310 0x55f8f5cfd410 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55f8f5b7d540 msgr2=0x55f8f5bad4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55f8f5b7d540 0x55f8f5bad4d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55f8f5d04080 msgr2=0x55f8f5d06ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55f8f5d04080 0x55f8f5d06ee0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55f8f5d0b840 msgr2=0x55f8f5d0dc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55f8f5d0b840 0x55f8f5d0dc30 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55f8f5cffcc0 msgr2=0x55f8f5d00100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55f8f5cffcc0 0x55f8f5d00100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55f8f5d07e90 msgr2=0x55f8f5d0a280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55f8f5d07e90 0x55f8f5d0a280 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 reap_dead start 2024-09-12T02:02:49.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe379634640 1 -- 172.21.15.19:0/4046316544 reap_dead start 2024-09-12T02:02:49.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe35806a810 msgr2=0x7fe35806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe35806a810 0x7fe35806ccd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe368000fb0 tx=0x7fe368001e30 comp rx=0 tx=0).stop 2024-09-12T02:02:49.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8f5c57bc0 msgr2=0x55f8f5b7d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8f5c57bc0 0x55f8f5b7d000 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fe360025e00 tx=0x7fe360003020 comp rx=0 tx=0).stop 2024-09-12T02:02:49.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 shutdown_connections 2024-09-12T02:02:49.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe35806a810 0x7fe35806ccd0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 --2- 172.21.15.19:0/4046316544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8f5c57bc0 0x55f8f5b7d000 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 >> 172.21.15.19:0/4046316544 conn(0x55f8f5b7e9e0 msgr2=0x55f8f5c55a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:49.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 shutdown_connections 2024-09-12T02:02:49.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.699+0000 7fe37b33df40 1 -- 172.21.15.19:0/4046316544 wait complete. 2024-09-12T02:02:49.703 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 1.00000000.inode 2024-09-12T02:02:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.786+0000 7fa81a92af40 1 Processor -- start 2024-09-12T02:02:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.786+0000 7fa81a92af40 1 -- start start 2024-09-12T02:02:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.787+0000 7fa81a92af40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55997b459cf0 0x55997b52f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.787+0000 7fa81a92af40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55997b513160 0x55997b50ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.787+0000 7fa81a92af40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55997b52e6a0 0x55997b50bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.787+0000 7fa81a92af40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55997b513540 con 0x55997b52e6a0 2024-09-12T02:02:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.787+0000 7fa81a92af40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55997b3a9510 con 0x55997b459cf0 2024-09-12T02:02:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.787+0000 7fa81a92af40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55997b488620 con 0x55997b513160 2024-09-12T02:02:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.787+0000 7fa8181bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55997b52e6a0 0x55997b50bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.787+0000 7fa8181bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55997b52e6a0 0x55997b50bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48328/0 (socket says 172.21.15.19:48328) 2024-09-12T02:02:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.787+0000 7fa8181bb640 1 -- 172.21.15.19:0/1916429786 learned_addr learned my addr 172.21.15.19:0/1916429786 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.787+0000 7fa8179ba640 1 --2- 172.21.15.19:0/1916429786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55997b459cf0 0x55997b52f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.787+0000 7fa8171b9640 1 --2- 172.21.15.19:0/1916429786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55997b513160 0x55997b50ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.787+0000 7fa8181bb640 1 -- 172.21.15.19:0/1916429786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55997b513160 msgr2=0x55997b50ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.787+0000 7fa8181bb640 1 --2- 172.21.15.19:0/1916429786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55997b513160 0x55997b50ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.787+0000 7fa8181bb640 1 -- 172.21.15.19:0/1916429786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55997b459cf0 msgr2=0x55997b52f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.787+0000 7fa8181bb640 1 --2- 172.21.15.19:0/1916429786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55997b459cf0 0x55997b52f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.787+0000 7fa8181bb640 1 -- 172.21.15.19:0/1916429786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55997b5272e0 con 0x55997b52e6a0 2024-09-12T02:02:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.788+0000 7fa8181bb640 1 --2- 172.21.15.19:0/1916429786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55997b52e6a0 0x55997b50bfd0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fa810046180 tx=0x7fa810051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e4f8d38d847a9e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.788+0000 7fa8161b7640 1 -- 172.21.15.19:0/1916429786 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa810067070 con 0x55997b52e6a0 2024-09-12T02:02:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.788+0000 7fa8161b7640 1 -- 172.21.15.19:0/1916429786 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa81004fb60 con 0x55997b52e6a0 2024-09-12T02:02:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.788+0000 7fa8161b7640 1 -- 172.21.15.19:0/1916429786 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa810058400 con 0x55997b52e6a0 2024-09-12T02:02:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.788+0000 7fa81a92af40 1 -- 172.21.15.19:0/1916429786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55997b52e6a0 msgr2=0x55997b50bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.788+0000 7fa81a92af40 1 --2- 172.21.15.19:0/1916429786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55997b52e6a0 0x55997b50bfd0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fa810046180 tx=0x7fa810051000 comp rx=0 tx=0).stop 2024-09-12T02:02:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.788+0000 7fa81a92af40 1 -- 172.21.15.19:0/1916429786 shutdown_connections 2024-09-12T02:02:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.788+0000 7fa81a92af40 1 --2- 172.21.15.19:0/1916429786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55997b52e6a0 0x55997b50bfd0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.788+0000 7fa81a92af40 1 --2- 172.21.15.19:0/1916429786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55997b513160 0x55997b50ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.788+0000 7fa81a92af40 1 --2- 172.21.15.19:0/1916429786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55997b459cf0 0x55997b52f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.788+0000 7fa81a92af40 1 -- 172.21.15.19:0/1916429786 >> 172.21.15.19:0/1916429786 conn(0x55997b4591d0 msgr2=0x55997b4837b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.788+0000 7fa81a92af40 1 -- 172.21.15.19:0/1916429786 shutdown_connections 2024-09-12T02:02:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.788+0000 7fa81a92af40 1 -- 172.21.15.19:0/1916429786 wait complete. 2024-09-12T02:02:49.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.789+0000 7fa81a92af40 1 Processor -- start 2024-09-12T02:02:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.789+0000 7fa81a92af40 1 -- start start 2024-09-12T02:02:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa81a92af40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55997b459cf0 0x55997b5bbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa81a92af40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55997b513160 0x55997b511550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa81a92af40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55997b52e6a0 0x55997b513db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa81a92af40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55997b510e90 con 0x55997b459cf0 2024-09-12T02:02:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa81a92af40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55997b510720 con 0x55997b513160 2024-09-12T02:02:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa81a92af40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55997b4a1200 con 0x55997b52e6a0 2024-09-12T02:02:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa8179ba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55997b459cf0 0x55997b5bbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa8179ba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55997b459cf0 0x55997b5bbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48338/0 (socket says 172.21.15.19:48338) 2024-09-12T02:02:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa8179ba640 1 -- 172.21.15.19:0/693365201 learned_addr learned my addr 172.21.15.19:0/693365201 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa8171b9640 1 --2- 172.21.15.19:0/693365201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55997b513160 0x55997b511550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa8181bb640 1 --2- 172.21.15.19:0/693365201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55997b52e6a0 0x55997b513db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa8179ba640 1 -- 172.21.15.19:0/693365201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55997b52e6a0 msgr2=0x55997b513db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa8179ba640 1 --2- 172.21.15.19:0/693365201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55997b52e6a0 0x55997b513db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa8179ba640 1 -- 172.21.15.19:0/693365201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55997b513160 msgr2=0x55997b511550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa8179ba640 1 --2- 172.21.15.19:0/693365201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55997b513160 0x55997b511550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa8179ba640 1 -- 172.21.15.19:0/693365201 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55997b516800 con 0x55997b459cf0 2024-09-12T02:02:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa8179ba640 1 --2- 172.21.15.19:0/693365201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55997b459cf0 0x55997b5bbbc0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fa80800c610 tx=0x7fa80800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa8151b5640 1 -- 172.21.15.19:0/693365201 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80800f650 con 0x55997b459cf0 2024-09-12T02:02:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa8151b5640 1 -- 172.21.15.19:0/693365201 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa80800f7f0 con 0x55997b459cf0 2024-09-12T02:02:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa8151b5640 1 -- 172.21.15.19:0/693365201 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80800fbc0 con 0x55997b459cf0 2024-09-12T02:02:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.790+0000 7fa81a92af40 1 -- 172.21.15.19:0/693365201 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55997b506970 con 0x55997b459cf0 2024-09-12T02:02:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.791+0000 7fa81a92af40 1 -- 172.21.15.19:0/693365201 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55997b5bc100 con 0x55997b459cf0 2024-09-12T02:02:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.792+0000 7fa8151b5640 1 -- 172.21.15.19:0/693365201 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa808009390 con 0x55997b459cf0 2024-09-12T02:02:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.792+0000 7fa8151b5640 1 --2- 172.21.15.19:0/693365201 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa80406a810 0x7fa80406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.792+0000 7fa8151b5640 1 -- 172.21.15.19:0/693365201 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6475+0+0 (secure 0 0 0) 0x7fa80808a7c0 con 0x55997b459cf0 2024-09-12T02:02:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.792+0000 7fa8171b9640 1 --2- 172.21.15.19:0/693365201 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa80406a810 0x7fa80406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.792+0000 7fa81a92af40 1 --2- 172.21.15.19:0/693365201 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55997b511a90 0x55997b5c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.793+0000 7fa81a92af40 1 -- 172.21.15.19:0/693365201 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:1 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55997b526190 con 0x55997b511a90 2024-09-12T02:02:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.793+0000 7fa8181bb640 1 --2- 172.21.15.19:0/693365201 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55997b511a90 0x55997b5c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.793+0000 7fa8171b9640 1 --2- 172.21.15.19:0/693365201 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa80406a810 0x7fa80406ccd0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x55997b50fd20 tx=0x7fa80c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.793+0000 7fa8181bb640 1 --2- 172.21.15.19:0/693365201 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55997b511a90 0x55997b5c78c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:49.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.794+0000 7fa8181bb640 1 -- 172.21.15.19:0/693365201 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(1 1.00000000.inode [delete] v97'89 uv89 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fa810058400 con 0x55997b511a90 2024-09-12T02:02:49.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.794+0000 7fa81a92af40 1 -- 172.21.15.19:0/693365201 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55997b511a90 msgr2=0x55997b5c78c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.794+0000 7fa81a92af40 1 --2- 172.21.15.19:0/693365201 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55997b511a90 0x55997b5c78c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.794+0000 7fa81a92af40 1 -- 172.21.15.19:0/693365201 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa80406a810 msgr2=0x7fa80406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.794+0000 7fa81a92af40 1 --2- 172.21.15.19:0/693365201 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa80406a810 0x7fa80406ccd0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x55997b50fd20 tx=0x7fa80c00b040 comp rx=0 tx=0).stop 2024-09-12T02:02:49.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.794+0000 7fa81a92af40 1 -- 172.21.15.19:0/693365201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55997b459cf0 msgr2=0x55997b5bbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.794+0000 7fa81a92af40 1 --2- 172.21.15.19:0/693365201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55997b459cf0 0x55997b5bbbc0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fa80800c610 tx=0x7fa80800cad0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.794+0000 7fa8181bb640 1 -- 172.21.15.19:0/693365201 reap_dead start 2024-09-12T02:02:49.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.794+0000 7fa81a92af40 1 -- 172.21.15.19:0/693365201 shutdown_connections 2024-09-12T02:02:49.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.794+0000 7fa81a92af40 1 -- 172.21.15.19:0/693365201 >> 172.21.15.19:0/693365201 conn(0x55997b4591d0 msgr2=0x55997b52f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:49.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.794+0000 7fa81a92af40 1 -- 172.21.15.19:0/693365201 shutdown_connections 2024-09-12T02:02:49.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.794+0000 7fa81a92af40 1 -- 172.21.15.19:0/693365201 wait complete. 2024-09-12T02:02:49.799 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:02:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.944+0000 7f066ba50640 1 Processor -- start 2024-09-12T02:02:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.944+0000 7f066ba50640 1 -- start start 2024-09-12T02:02:49.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.945+0000 7f066ba50640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f066415e7f0 0x7f06640b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.945+0000 7f066ba50640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0664071180 0x7f066406de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.945+0000 7f066ba50640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f066406cdc0 con 0x7f06640af210 2024-09-12T02:02:49.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.945+0000 7f066ba50640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f066406d0a0 con 0x7f0664071180 2024-09-12T02:02:49.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.945+0000 7f066ba50640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f066406d380 con 0x7f066415e7f0 2024-09-12T02:02:49.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.945+0000 7f0668feb640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f06640af210 0x7f0664070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:51794/0 (socket says 172.21.15.19:51794) 2024-09-12T02:02:49.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.945+0000 7f0668feb640 1 -- 172.21.15.19:0/3605035596 learned_addr learned my addr 172.21.15.19:0/3605035596 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:49.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.945+0000 7f0669fed640 1 --2- 172.21.15.19:0/3605035596 >> v2:172.21.15.135:3300/0 conn(0x7f0664071180 0x7f066406de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.945+0000 7f06697ec640 1 --2- 172.21.15.19:0/3605035596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f066415e7f0 0x7f06640b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.945+0000 7f065bfff640 1 -- 172.21.15.19:0/3605035596 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1838733120 0 0) 0x7f066406cdc0 con 0x7f06640af210 2024-09-12T02:02:49.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.945+0000 7f065bfff640 1 -- 172.21.15.19:0/3605035596 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0650003520 con 0x7f06640af210 2024-09-12T02:02:49.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.946+0000 7f0669fed640 1 -- 172.21.15.19:0/3605035596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f066415e7f0 msgr2=0x7f06640b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:49.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.946+0000 7f0669fed640 1 --2- 172.21.15.19:0/3605035596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f066415e7f0 0x7f06640b6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.946+0000 7f0669fed640 1 -- 172.21.15.19:0/3605035596 >> v1:172.21.15.19:6789/0 conn(0x7f06640af210 legacy=0x7f0664070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.946+0000 7f0669fed640 1 -- 172.21.15.19:0/3605035596 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f066406d660 con 0x7f0664071180 2024-09-12T02:02:49.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.946+0000 7f06697ec640 1 --2- 172.21.15.19:0/3605035596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f066415e7f0 0x7f06640b6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:49.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.946+0000 7f0669fed640 1 --2- 172.21.15.19:0/3605035596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0664071180 0x7f066406de60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f065c009d90 tx=0x7f065c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe8551444b236283 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:49.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.946+0000 7f065bfff640 1 -- 172.21.15.19:0/3605035596 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c007740 con 0x7f0664071180 2024-09-12T02:02:49.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.946+0000 7f065bfff640 1 -- 172.21.15.19:0/3605035596 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f065c0078e0 con 0x7f0664071180 2024-09-12T02:02:49.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.946+0000 7f065bfff640 1 -- 172.21.15.19:0/3605035596 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c007c90 con 0x7f0664071180 2024-09-12T02:02:49.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.947+0000 7f066ba50640 1 -- 172.21.15.19:0/3605035596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0664071180 msgr2=0x7f066406de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.947+0000 7f066ba50640 1 --2- 172.21.15.19:0/3605035596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0664071180 0x7f066406de60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f065c009d90 tx=0x7f065c02a660 comp rx=0 tx=0).stop 2024-09-12T02:02:49.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.947+0000 7f066ba50640 1 -- 172.21.15.19:0/3605035596 shutdown_connections 2024-09-12T02:02:49.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.947+0000 7f066ba50640 1 --2- 172.21.15.19:0/3605035596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0664071180 0x7f066406de60 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.947+0000 7f066ba50640 1 --2- 172.21.15.19:0/3605035596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f066415e7f0 0x7f06640b6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.947+0000 7f066ba50640 1 -- 172.21.15.19:0/3605035596 >> 172.21.15.19:0/3605035596 conn(0x7f06640b3f30 msgr2=0x7f06640b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:49.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.947+0000 7f066ba50640 1 -- 172.21.15.19:0/3605035596 shutdown_connections 2024-09-12T02:02:49.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.947+0000 7f066ba50640 1 -- 172.21.15.19:0/3605035596 wait complete. 2024-09-12T02:02:49.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.948+0000 7f066ba50640 1 Processor -- start 2024-09-12T02:02:49.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.948+0000 7f066ba50640 1 -- start start 2024-09-12T02:02:49.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.949+0000 7f066ba50640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0664071180 0x7f06641446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.949+0000 7f066ba50640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06640af210 0x7f0664147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.949+0000 7f066ba50640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f066415e7f0 0x7f066415fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.949+0000 7f066ba50640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f06640b7250 con 0x7f06640af210 2024-09-12T02:02:49.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.949+0000 7f066ba50640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06640b6150 con 0x7f066415e7f0 2024-09-12T02:02:49.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.949+0000 7f066ba50640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f06640b73d0 con 0x7f0664071180 2024-09-12T02:02:49.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.949+0000 7f0668feb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06640af210 0x7f0664147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.949+0000 7f0668feb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06640af210 0x7f0664147050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48340/0 (socket says 172.21.15.19:48340) 2024-09-12T02:02:49.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.949+0000 7f0668feb640 1 -- 172.21.15.19:0/3713379696 learned_addr learned my addr 172.21.15.19:0/3713379696 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:49.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.949+0000 7f06697ec640 1 --2- 172.21.15.19:0/3713379696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0664071180 0x7f06641446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.950+0000 7f0669fed640 1 --2- 172.21.15.19:0/3713379696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f066415e7f0 0x7f066415fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.950+0000 7f0668feb640 1 -- 172.21.15.19:0/3713379696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0664071180 msgr2=0x7f06641446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.950+0000 7f0668feb640 1 --2- 172.21.15.19:0/3713379696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0664071180 0x7f06641446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.950+0000 7f0668feb640 1 -- 172.21.15.19:0/3713379696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f066415e7f0 msgr2=0x7f066415fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:49.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.950+0000 7f0668feb640 1 --2- 172.21.15.19:0/3713379696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f066415e7f0 0x7f066415fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:49.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.950+0000 7f0668feb640 1 -- 172.21.15.19:0/3713379696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0664147980 con 0x7f06640af210 2024-09-12T02:02:49.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.950+0000 7f0668feb640 1 --2- 172.21.15.19:0/3713379696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06640af210 0x7f0664147050 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f065400c3f0 tx=0x7f0654001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:49.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.950+0000 7f0659ffb640 1 -- 172.21.15.19:0/3713379696 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0654017070 con 0x7f06640af210 2024-09-12T02:02:49.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.950+0000 7f0659ffb640 1 -- 172.21.15.19:0/3713379696 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0654005ce0 con 0x7f06640af210 2024-09-12T02:02:49.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.950+0000 7f0659ffb640 1 -- 172.21.15.19:0/3713379696 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06540072f0 con 0x7f06640af210 2024-09-12T02:02:49.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.950+0000 7f066ba50640 1 -- 172.21.15.19:0/3713379696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0664147c60 con 0x7f06640af210 2024-09-12T02:02:49.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.950+0000 7f066ba50640 1 -- 172.21.15.19:0/3713379696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f066415a410 con 0x7f06640af210 2024-09-12T02:02:49.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.951+0000 7f066ba50640 1 -- 172.21.15.19:0/3713379696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06640b6d10 con 0x7f06640af210 2024-09-12T02:02:49.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.952+0000 7f0659ffb640 1 -- 172.21.15.19:0/3713379696 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f065401a070 con 0x7f06640af210 2024-09-12T02:02:49.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.952+0000 7f0659ffb640 1 --2- 172.21.15.19:0/3713379696 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f064806be30 0x7f064806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:49.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.953+0000 7f0659ffb640 1 -- 172.21.15.19:0/3713379696 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6475+0+0 (secure 0 0 0) 0x7f065408a4e0 con 0x7f06640af210 2024-09-12T02:02:49.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.953+0000 7f06697ec640 1 --2- 172.21.15.19:0/3713379696 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f064806be30 0x7f064806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:49.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.953+0000 7f06697ec640 1 --2- 172.21.15.19:0/3713379696 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f064806be30 0x7f064806e2f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0660009a30 tx=0x7f0660008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:49.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:49.957+0000 7f0659ffb640 1 -- 172.21.15.19:0/3713379696 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0654058af0 con 0x7f06640af210 2024-09-12T02:02:50.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.169+0000 7f066ba50640 1 -- 172.21.15.19:0/3713379696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f06640afc20 con 0x7f06640af210 2024-09-12T02:02:50.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.457+0000 7f0659ffb640 1 -- 172.21.15.19:0/3713379696 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v96) ==== 162+0+0 (secure 0 0 0) 0x7f0654007e20 con 0x7f06640af210 2024-09-12T02:02:50.458 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:02:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.459+0000 7f066ba50640 1 -- 172.21.15.19:0/3713379696 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f064806be30 msgr2=0x7f064806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.459+0000 7f066ba50640 1 --2- 172.21.15.19:0/3713379696 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f064806be30 0x7f064806e2f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0660009a30 tx=0x7f0660008040 comp rx=0 tx=0).stop 2024-09-12T02:02:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.460+0000 7f066ba50640 1 -- 172.21.15.19:0/3713379696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06640af210 msgr2=0x7f0664147050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.460+0000 7f066ba50640 1 --2- 172.21.15.19:0/3713379696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06640af210 0x7f0664147050 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f065400c3f0 tx=0x7f0654001e70 comp rx=0 tx=0).stop 2024-09-12T02:02:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.460+0000 7f066ba50640 1 -- 172.21.15.19:0/3713379696 shutdown_connections 2024-09-12T02:02:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.460+0000 7f066ba50640 1 --2- 172.21.15.19:0/3713379696 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f064806be30 0x7f064806e2f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.460+0000 7f066ba50640 1 --2- 172.21.15.19:0/3713379696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f066415e7f0 0x7f066415fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.460+0000 7f066ba50640 1 --2- 172.21.15.19:0/3713379696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06640af210 0x7f0664147050 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.460+0000 7f066ba50640 1 --2- 172.21.15.19:0/3713379696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0664071180 0x7f06641446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.460+0000 7f066ba50640 1 -- 172.21.15.19:0/3713379696 >> 172.21.15.19:0/3713379696 conn(0x7f06640b3f30 msgr2=0x7f06640b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.460+0000 7f066ba50640 1 -- 172.21.15.19:0/3713379696 shutdown_connections 2024-09-12T02:02:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.460+0000 7f066ba50640 1 -- 172.21.15.19:0/3713379696 wait complete. 2024-09-12T02:02:50.469 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:02:50.469+0000 7f27d2771640 -1 mds.0.cache.ino(0x1) No data while reading inode 0x1 2024-09-12T02:02:50.469 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:02:50.469+0000 7f27d2771640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2024-09-12T02:02:50.470 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:02:50.469+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:02:50.470 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:02:50.469+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:02:50.473 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:50.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.575+0000 7f622b247640 1 Processor -- start 2024-09-12T02:02:50.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.575+0000 7f622b247640 1 -- start start 2024-09-12T02:02:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.575+0000 7f622b247640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6224161c80 0x7f622406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.576+0000 7f622b247640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62240b6680 0x7f62240cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.576+0000 7f622b247640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f622406e870 con 0x7f6224162060 2024-09-12T02:02:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.576+0000 7f622b247640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f622406d9f0 con 0x7f6224161c80 2024-09-12T02:02:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.576+0000 7f622b247640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f622406dcd0 con 0x7f62240b6680 2024-09-12T02:02:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.576+0000 7f62297e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62240b6680 0x7f62240cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.576+0000 7f62297e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62240b6680 0x7f62240cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:54720/0 (socket says 172.21.15.19:54720) 2024-09-12T02:02:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.576+0000 7f62297e4640 1 -- 172.21.15.19:0/2041201711 learned_addr learned my addr 172.21.15.19:0/2041201711 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.576+0000 7f6223fff640 1 --1- 172.21.15.19:0/2041201711 >> v1:172.21.15.135:6789/0 conn(0x7f6224162060 0x7f62240b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:43848/0 (socket says 172.21.15.19:43848) 2024-09-12T02:02:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.576+0000 7f6228fe3640 1 --2- 172.21.15.19:0/2041201711 >> v2:172.21.15.135:3300/0 conn(0x7f6224161c80 0x7f622406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.576+0000 7f62237fe640 1 -- 172.21.15.19:0/2041201711 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508845613 0 0) 0x7f620c001490 con 0x7f6224162060 2024-09-12T02:02:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.576+0000 7f62237fe640 1 -- 172.21.15.19:0/2041201711 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6210003520 con 0x7f6224162060 2024-09-12T02:02:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.576+0000 7f6228fe3640 1 -- 172.21.15.19:0/2041201711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62240b6680 msgr2=0x7f62240cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.576+0000 7f6228fe3640 1 --2- 172.21.15.19:0/2041201711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62240b6680 0x7f62240cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.576+0000 7f6228fe3640 1 -- 172.21.15.19:0/2041201711 >> v1:172.21.15.135:6789/0 conn(0x7f6224162060 legacy=0x7f62240b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.576+0000 7f6228fe3640 1 -- 172.21.15.19:0/2041201711 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622406dfb0 con 0x7f6224161c80 2024-09-12T02:02:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.576+0000 7f62297e4640 1 --2- 172.21.15.19:0/2041201711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62240b6680 0x7f62240cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.577+0000 7f6228fe3640 1 --2- 172.21.15.19:0/2041201711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6224161c80 0x7f622406e330 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f62140097a0 tx=0x7f621402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b2df05bdd46ec20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.577+0000 7f62237fe640 1 -- 172.21.15.19:0/2041201711 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6214037070 con 0x7f6224161c80 2024-09-12T02:02:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.577+0000 7f62237fe640 1 -- 172.21.15.19:0/2041201711 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6214032440 con 0x7f6224161c80 2024-09-12T02:02:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.577+0000 7f62237fe640 1 -- 172.21.15.19:0/2041201711 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6214032810 con 0x7f6224161c80 2024-09-12T02:02:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.578+0000 7f622b247640 1 -- 172.21.15.19:0/2041201711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6224161c80 msgr2=0x7f622406e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.578+0000 7f622b247640 1 --2- 172.21.15.19:0/2041201711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6224161c80 0x7f622406e330 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f62140097a0 tx=0x7f621402a180 comp rx=0 tx=0).stop 2024-09-12T02:02:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.578+0000 7f622b247640 1 -- 172.21.15.19:0/2041201711 shutdown_connections 2024-09-12T02:02:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.578+0000 7f622b247640 1 --2- 172.21.15.19:0/2041201711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62240b6680 0x7f62240cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.578+0000 7f622b247640 1 --2- 172.21.15.19:0/2041201711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6224161c80 0x7f622406e330 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.578+0000 7f622b247640 1 -- 172.21.15.19:0/2041201711 >> 172.21.15.19:0/2041201711 conn(0x7f62240d44f0 msgr2=0x7f62240d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.578+0000 7f622b247640 1 -- 172.21.15.19:0/2041201711 shutdown_connections 2024-09-12T02:02:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.578+0000 7f622b247640 1 -- 172.21.15.19:0/2041201711 wait complete. 2024-09-12T02:02:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.579+0000 7f622b247640 1 Processor -- start 2024-09-12T02:02:50.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.579+0000 7f622b247640 1 -- start start 2024-09-12T02:02:50.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.580+0000 7f622b247640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62240b6680 0x7f62241f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:50.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.580+0000 7f622b247640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6224161c80 0x7f62240b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:50.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.580+0000 7f622b247640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6224162060 0x7f6224158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:50.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.580+0000 7f622b247640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f62240b6cb0 con 0x7f62240b6680 2024-09-12T02:02:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.580+0000 7f622b247640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f62240b6b30 con 0x7f6224162060 2024-09-12T02:02:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.580+0000 7f622b247640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f62240cf720 con 0x7f6224161c80 2024-09-12T02:02:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.580+0000 7f6228fe3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62240b6680 0x7f62241f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.580+0000 7f6228fe3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62240b6680 0x7f62241f86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48356/0 (socket says 172.21.15.19:48356) 2024-09-12T02:02:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.580+0000 7f6228fe3640 1 -- 172.21.15.19:0/367495155 learned_addr learned my addr 172.21.15.19:0/367495155 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.580+0000 7f6223fff640 1 --2- 172.21.15.19:0/367495155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6224161c80 0x7f62240b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.580+0000 7f62297e4640 1 --2- 172.21.15.19:0/367495155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6224162060 0x7f6224158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.581+0000 7f6228fe3640 1 -- 172.21.15.19:0/367495155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6224161c80 msgr2=0x7f62240b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.581+0000 7f6228fe3640 1 --2- 172.21.15.19:0/367495155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6224161c80 0x7f62240b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.581+0000 7f6228fe3640 1 -- 172.21.15.19:0/367495155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6224162060 msgr2=0x7f6224158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.581+0000 7f6228fe3640 1 --2- 172.21.15.19:0/367495155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6224162060 0x7f6224158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.581+0000 7f6228fe3640 1 -- 172.21.15.19:0/367495155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62241f8c00 con 0x7f62240b6680 2024-09-12T02:02:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.581+0000 7f6228fe3640 1 --2- 172.21.15.19:0/367495155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62240b6680 0x7f62241f86c0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f6214035040 tx=0x7f62140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.581+0000 7f62217fa640 1 -- 172.21.15.19:0/367495155 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6214041030 con 0x7f62240b6680 2024-09-12T02:02:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.581+0000 7f62217fa640 1 -- 172.21.15.19:0/367495155 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f621403d4e0 con 0x7f62240b6680 2024-09-12T02:02:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.581+0000 7f62217fa640 1 -- 172.21.15.19:0/367495155 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6214037040 con 0x7f62240b6680 2024-09-12T02:02:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.581+0000 7f622b247640 1 -- 172.21.15.19:0/367495155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62241f4bb0 con 0x7f62240b6680 2024-09-12T02:02:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.581+0000 7f622b247640 1 -- 172.21.15.19:0/367495155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62241f5170 con 0x7f62240b6680 2024-09-12T02:02:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.582+0000 7f622b247640 1 -- 172.21.15.19:0/367495155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62240cf1e0 con 0x7f62240b6680 2024-09-12T02:02:50.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.583+0000 7f62217fa640 1 -- 172.21.15.19:0/367495155 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6214044070 con 0x7f62240b6680 2024-09-12T02:02:50.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.583+0000 7f62217fa640 1 --2- 172.21.15.19:0/367495155 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f620406be30 0x7f620406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:50.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.583+0000 7f62217fa640 1 -- 172.21.15.19:0/367495155 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6561+0+0 (secure 0 0 0) 0x7f62140ab640 con 0x7f62240b6680 2024-09-12T02:02:50.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.583+0000 7f6223fff640 1 --2- 172.21.15.19:0/367495155 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f620406be30 0x7f620406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:50.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.584+0000 7f6223fff640 1 --2- 172.21.15.19:0/367495155 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f620406be30 0x7f620406e2f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6224159cd0 tx=0x7f620c007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.587+0000 7f62217fa640 1 -- 172.21.15.19:0/367495155 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6214079650 con 0x7f62240b6680 2024-09-12T02:02:50.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.800+0000 7f622b247640 1 -- 172.21.15.19:0/367495155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62240d2c40 con 0x7f62240b6680 2024-09-12T02:02:50.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.801+0000 7f62217fa640 1 -- 172.21.15.19:0/367495155 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+4388 (secure 0 0 0) 0x7f621407d950 con 0x7f62240b6680 2024-09-12T02:02:50.801 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:50.801 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":98,"btime":"2024-09-12T02:02:50:471036+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1101861733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1101861733},{"type":"v1","addr":"172.21.15.135:6837","nonce":1101861733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:02:50.470978+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:02:50.802 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 98 2024-09-12T02:02:50.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.803+0000 7f622b247640 1 -- 172.21.15.19:0/367495155 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f620406be30 msgr2=0x7f620406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:50.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.803+0000 7f622b247640 1 --2- 172.21.15.19:0/367495155 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f620406be30 0x7f620406e2f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6224159cd0 tx=0x7f620c007eb0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.803+0000 7f622b247640 1 -- 172.21.15.19:0/367495155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62240b6680 msgr2=0x7f62241f86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.803+0000 7f622b247640 1 --2- 172.21.15.19:0/367495155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62240b6680 0x7f62241f86c0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f6214035040 tx=0x7f62140046c0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.803+0000 7f622b247640 1 -- 172.21.15.19:0/367495155 shutdown_connections 2024-09-12T02:02:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.803+0000 7f622b247640 1 --2- 172.21.15.19:0/367495155 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f620406be30 0x7f620406e2f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.803+0000 7f622b247640 1 --2- 172.21.15.19:0/367495155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6224162060 0x7f6224158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.803+0000 7f622b247640 1 --2- 172.21.15.19:0/367495155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6224161c80 0x7f62240b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.803+0000 7f622b247640 1 --2- 172.21.15.19:0/367495155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62240b6680 0x7f62241f86c0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.803+0000 7f622b247640 1 -- 172.21.15.19:0/367495155 >> 172.21.15.19:0/367495155 conn(0x7f62240d44f0 msgr2=0x7f62240b5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.803+0000 7f622b247640 1 -- 172.21.15.19:0/367495155 shutdown_connections 2024-09-12T02:02:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.803+0000 7f622b247640 1 -- 172.21.15.19:0/367495155 wait complete. 2024-09-12T02:02:50.814 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:02:50.815 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:50.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.917+0000 7f93d6931640 1 Processor -- start 2024-09-12T02:02:50.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.917+0000 7f93d6931640 1 -- start start 2024-09-12T02:02:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.918+0000 7f93d6931640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f93d015e740 0x7f93d00d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.918+0000 7f93d6931640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d009b690 0x7f93d006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.918+0000 7f93d6931640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93d006e000 con 0x7f93d006d4c0 2024-09-12T02:02:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.918+0000 7f93d6931640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f93d015eb20 con 0x7f93d015e740 2024-09-12T02:02:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.918+0000 7f93d6931640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f93d006d260 con 0x7f93d009b690 2024-09-12T02:02:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.918+0000 7f93cffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f93d015e740 0x7f93d00d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.918+0000 7f93cffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f93d015e740 0x7f93d00d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48366/0 (socket says 172.21.15.19:48366) 2024-09-12T02:02:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.918+0000 7f93cffff640 1 -- 172.21.15.19:0/350677389 learned_addr learned my addr 172.21.15.19:0/350677389 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.918+0000 7f93cf7fe640 1 --2- 172.21.15.19:0/350677389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d009b690 0x7f93d006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.918+0000 7f93cffff640 1 -- 172.21.15.19:0/350677389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d009b690 msgr2=0x7f93d006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.918+0000 7f93cffff640 1 --2- 172.21.15.19:0/350677389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d009b690 0x7f93d006cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.918+0000 7f93cffff640 1 -- 172.21.15.19:0/350677389 >> v1:172.21.15.135:6789/0 conn(0x7f93d006d4c0 legacy=0x7f93d006d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.918+0000 7f93cffff640 1 -- 172.21.15.19:0/350677389 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d00d0780 con 0x7f93d015e740 2024-09-12T02:02:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.919+0000 7f93cffff640 1 --2- 172.21.15.19:0/350677389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d015e740 0x7f93d00d1540 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009870 tx=0x7f93c002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed4889dcb590b02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.919+0000 7f93ceffd640 1 -- 172.21.15.19:0/350677389 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0037070 con 0x7f93d015e740 2024-09-12T02:02:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.919+0000 7f93ceffd640 1 -- 172.21.15.19:0/350677389 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93c0032440 con 0x7f93d015e740 2024-09-12T02:02:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.919+0000 7f93ceffd640 1 -- 172.21.15.19:0/350677389 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0032810 con 0x7f93d015e740 2024-09-12T02:02:50.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.919+0000 7f93d6931640 1 -- 172.21.15.19:0/350677389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d015e740 msgr2=0x7f93d00d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:50.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.919+0000 7f93d6931640 1 --2- 172.21.15.19:0/350677389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d015e740 0x7f93d00d1540 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009870 tx=0x7f93c002a2a0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.919+0000 7f93d6931640 1 -- 172.21.15.19:0/350677389 shutdown_connections 2024-09-12T02:02:50.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.919+0000 7f93d6931640 1 --2- 172.21.15.19:0/350677389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d009b690 0x7f93d006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.919+0000 7f93d6931640 1 --2- 172.21.15.19:0/350677389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d015e740 0x7f93d00d1540 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.919+0000 7f93d6931640 1 -- 172.21.15.19:0/350677389 >> 172.21.15.19:0/350677389 conn(0x7f93d00d23a0 msgr2=0x7f93d00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:50.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.920+0000 7f93d6931640 1 -- 172.21.15.19:0/350677389 shutdown_connections 2024-09-12T02:02:50.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.920+0000 7f93d6931640 1 -- 172.21.15.19:0/350677389 wait complete. 2024-09-12T02:02:50.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.921+0000 7f93d6931640 1 Processor -- start 2024-09-12T02:02:50.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.921+0000 7f93d6931640 1 -- start start 2024-09-12T02:02:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93d6931640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d006d4c0 0x7f93d00cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93d6931640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d009b690 0x7f93d009fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93d6931640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d015e740 0x7f93d009d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93d6931640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f93d00d1020 con 0x7f93d006d4c0 2024-09-12T02:02:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93d6931640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93d00d0d40 con 0x7f93d015e740 2024-09-12T02:02:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93d6931640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f93d009ba90 con 0x7f93d009b690 2024-09-12T02:02:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93cffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d006d4c0 0x7f93d00cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93cffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d006d4c0 0x7f93d00cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48372/0 (socket says 172.21.15.19:48372) 2024-09-12T02:02:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93cffff640 1 -- 172.21.15.19:0/3653750376 learned_addr learned my addr 172.21.15.19:0/3653750376 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93cf7fe640 1 --2- 172.21.15.19:0/3653750376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d009b690 0x7f93d009fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93d4ece640 1 --2- 172.21.15.19:0/3653750376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d015e740 0x7f93d009d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93cffff640 1 -- 172.21.15.19:0/3653750376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d009b690 msgr2=0x7f93d009fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93cffff640 1 --2- 172.21.15.19:0/3653750376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d009b690 0x7f93d009fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93cffff640 1 -- 172.21.15.19:0/3653750376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d015e740 msgr2=0x7f93d009d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93cffff640 1 --2- 172.21.15.19:0/3653750376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d015e740 0x7f93d009d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93cffff640 1 -- 172.21.15.19:0/3653750376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d009c460 con 0x7f93d006d4c0 2024-09-12T02:02:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93cffff640 1 --2- 172.21.15.19:0/3653750376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d006d4c0 0x7f93d00cabc0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009870 tx=0x7f93c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93ccff9640 1 -- 172.21.15.19:0/3653750376 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0041020 con 0x7f93d006d4c0 2024-09-12T02:02:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93ccff9640 1 -- 172.21.15.19:0/3653750376 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93c0030970 con 0x7f93d006d4c0 2024-09-12T02:02:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93d6931640 1 -- 172.21.15.19:0/3653750376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d009c740 con 0x7f93d006d4c0 2024-09-12T02:02:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93ccff9640 1 -- 172.21.15.19:0/3653750376 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0037040 con 0x7f93d006d4c0 2024-09-12T02:02:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.922+0000 7f93d6931640 1 -- 172.21.15.19:0/3653750376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d009cd00 con 0x7f93d006d4c0 2024-09-12T02:02:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.923+0000 7f93d6931640 1 -- 172.21.15.19:0/3653750376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93d006cd20 con 0x7f93d006d4c0 2024-09-12T02:02:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.924+0000 7f93ccff9640 1 -- 172.21.15.19:0/3653750376 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f93c0044020 con 0x7f93d006d4c0 2024-09-12T02:02:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.924+0000 7f93ccff9640 1 --2- 172.21.15.19:0/3653750376 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93bc06be30 0x7f93bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.924+0000 7f93ccff9640 1 -- 172.21.15.19:0/3653750376 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6561+0+0 (secure 0 0 0) 0x7f93c00abbc0 con 0x7f93d006d4c0 2024-09-12T02:02:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.924+0000 7f93cf7fe640 1 --2- 172.21.15.19:0/3653750376 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93bc06be30 0x7f93bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:50.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.925+0000 7f93cf7fe640 1 --2- 172.21.15.19:0/3653750376 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93bc06be30 0x7f93bc06e2f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f93d00a03d0 tx=0x7f93c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:50.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:50.928+0000 7f93ccff9640 1 -- 172.21.15.19:0/3653750376 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f93c004b030 con 0x7f93d006d4c0 2024-09-12T02:02:51.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.139+0000 7f93d6931640 1 -- 172.21.15.19:0/3653750376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93d00d1cb0 con 0x7f93d006d4c0 2024-09-12T02:02:51.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.139+0000 7f93ccff9640 1 -- 172.21.15.19:0/3653750376 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+4388 (secure 0 0 0) 0x7f93c00ab070 con 0x7f93d006d4c0 2024-09-12T02:02:51.140 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:51.140 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":98,"btime":"2024-09-12T02:02:50:471036+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1101861733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1101861733},{"type":"v1","addr":"172.21.15.135:6837","nonce":1101861733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:02:50.470978+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:02:51.140 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 98 2024-09-12T02:02:51.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.141+0000 7f93d6931640 1 -- 172.21.15.19:0/3653750376 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93bc06be30 msgr2=0x7f93bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:51.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.141+0000 7f93d6931640 1 --2- 172.21.15.19:0/3653750376 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93bc06be30 0x7f93bc06e2f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f93d00a03d0 tx=0x7f93c4008040 comp rx=0 tx=0).stop 2024-09-12T02:02:51.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.141+0000 7f93d6931640 1 -- 172.21.15.19:0/3653750376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d006d4c0 msgr2=0x7f93d00cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:51.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.141+0000 7f93d6931640 1 --2- 172.21.15.19:0/3653750376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d006d4c0 0x7f93d00cabc0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009870 tx=0x7f93c00046c0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.141+0000 7f93d6931640 1 -- 172.21.15.19:0/3653750376 shutdown_connections 2024-09-12T02:02:51.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.141+0000 7f93d6931640 1 --2- 172.21.15.19:0/3653750376 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93bc06be30 0x7f93bc06e2f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.141+0000 7f93d6931640 1 --2- 172.21.15.19:0/3653750376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d015e740 0x7f93d009d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.141+0000 7f93d6931640 1 --2- 172.21.15.19:0/3653750376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93d009b690 0x7f93d009fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.141+0000 7f93d6931640 1 --2- 172.21.15.19:0/3653750376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d006d4c0 0x7f93d00cabc0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.141+0000 7f93d6931640 1 -- 172.21.15.19:0/3653750376 >> 172.21.15.19:0/3653750376 conn(0x7f93d00d23a0 msgr2=0x7f93d00d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:51.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.142+0000 7f93d6931640 1 -- 172.21.15.19:0/3653750376 shutdown_connections 2024-09-12T02:02:51.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.142+0000 7f93d6931640 1 -- 172.21.15.19:0/3653750376 wait complete. 2024-09-12T02:02:51.153 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:02:51.153 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:51.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.255+0000 7f7d56a5e640 1 Processor -- start 2024-09-12T02:02:51.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.255+0000 7f7d56a5e640 1 -- start start 2024-09-12T02:02:51.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.256+0000 7f7d56a5e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d5015c490 0x7f7d5009b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:51.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.256+0000 7f7d56a5e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d500d01c0 con 0x7f7d5015cf80 2024-09-12T02:02:51.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.256+0000 7f7d56a5e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d500d04a0 con 0x7f7d5009b980 2024-09-12T02:02:51.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.256+0000 7f7d56a5e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7d500cff70 con 0x7f7d5015c490 2024-09-12T02:02:51.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.256+0000 7f7d54ffb640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7d5015cf80 0x7f7d500ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40532/0 (socket says 172.21.15.19:40532) 2024-09-12T02:02:51.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.256+0000 7f7d54ffb640 1 -- 172.21.15.19:0/3155135223 learned_addr learned my addr 172.21.15.19:0/3155135223 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:51.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.256+0000 7f7d4ffff640 1 --2- 172.21.15.19:0/3155135223 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d5015c490 0x7f7d5009b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:51.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.256+0000 7f7d4effd640 1 -- 172.21.15.19:0/3155135223 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1352139474 0 0) 0x7f7d500d01c0 con 0x7f7d5015cf80 2024-09-12T02:02:51.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.256+0000 7f7d4effd640 1 -- 172.21.15.19:0/3155135223 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d3c003520 con 0x7f7d5015cf80 2024-09-12T02:02:51.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.256+0000 7f7d4effd640 1 -- 172.21.15.19:0/3155135223 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2159028377 0 0) 0x7f7d500d04a0 con 0x7f7d5009b980 2024-09-12T02:02:51.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.256+0000 7f7d4effd640 1 -- 172.21.15.19:0/3155135223 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d500d01c0 con 0x7f7d5009b980 2024-09-12T02:02:51.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.256+0000 7f7d4effd640 1 -- 172.21.15.19:0/3155135223 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 76614748 0 0) 0x7f7d3c003520 con 0x7f7d5015cf80 2024-09-12T02:02:51.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.256+0000 7f7d4effd640 1 -- 172.21.15.19:0/3155135223 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d5015c490 msgr2=0x7f7d5009b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:51.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.256+0000 7f7d4effd640 1 --2- 172.21.15.19:0/3155135223 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d5015c490 0x7f7d5009b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.256+0000 7f7d4effd640 1 -- 172.21.15.19:0/3155135223 >> v1:172.21.15.135:6789/0 conn(0x7f7d5009b980 legacy=0x7f7d5015c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:51.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.256+0000 7f7d4effd640 1 -- 172.21.15.19:0/3155135223 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d500d0780 con 0x7f7d5015cf80 2024-09-12T02:02:51.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.256+0000 7f7d4effd640 1 -- 172.21.15.19:0/3155135223 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f7d480019f0 con 0x7f7d5015cf80 2024-09-12T02:02:51.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.257+0000 7f7d4ffff640 1 --2- 172.21.15.19:0/3155135223 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d5015c490 0x7f7d5009b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:51.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.257+0000 7f7d4effd640 1 -- 172.21.15.19:0/3155135223 >> v1:172.21.15.19:6789/0 conn(0x7f7d5015cf80 legacy=0x7f7d500ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:51.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.257+0000 7f7d4effd640 1 --2- 172.21.15.19:0/3155135223 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d5015c490 0x7f7d3c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:51.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.257+0000 7f7d4effd640 1 --2- 172.21.15.19:0/3155135223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d3c0040b0 0x7f7d3c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:51.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.257+0000 7f7d4effd640 1 --2- 172.21.15.19:0/3155135223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d3c004d40 0x7f7d3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:51.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.257+0000 7f7d4effd640 1 -- 172.21.15.19:0/3155135223 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7d500cff70 con 0x7f7d3c004d40 2024-09-12T02:02:51.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.257+0000 7f7d4effd640 1 -- 172.21.15.19:0/3155135223 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c00ba70 con 0x7f7d3c0040b0 2024-09-12T02:02:51.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.257+0000 7f7d4effd640 1 -- 172.21.15.19:0/3155135223 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7d3c00bc70 con 0x7f7d5015c490 2024-09-12T02:02:51.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.257+0000 7f7d54ffb640 1 --2- 172.21.15.19:0/3155135223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d3c004d40 0x7f7d3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:51.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.257+0000 7f7d4ffff640 1 --2- 172.21.15.19:0/3155135223 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d5015c490 0x7f7d3c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:51.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.257+0000 7f7d4f7fe640 1 --2- 172.21.15.19:0/3155135223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d3c0040b0 0x7f7d3c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:51.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.257+0000 7f7d54ffb640 1 -- 172.21.15.19:0/3155135223 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d5015c490 msgr2=0x7f7d3c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:51.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.257+0000 7f7d54ffb640 1 --2- 172.21.15.19:0/3155135223 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d5015c490 0x7f7d3c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.257+0000 7f7d54ffb640 1 -- 172.21.15.19:0/3155135223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d3c0040b0 msgr2=0x7f7d3c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:51.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.257+0000 7f7d54ffb640 1 --2- 172.21.15.19:0/3155135223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d3c0040b0 0x7f7d3c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.257+0000 7f7d54ffb640 1 -- 172.21.15.19:0/3155135223 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3c003520 con 0x7f7d3c004d40 2024-09-12T02:02:51.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.258+0000 7f7d54ffb640 1 --2- 172.21.15.19:0/3155135223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d3c004d40 0x7f7d3c0051c0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800a800 tx=0x7f7d3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11d68afdf1567ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:51.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.258+0000 7f7d4effd640 1 -- 172.21.15.19:0/3155135223 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4800a430 con 0x7f7d3c004d40 2024-09-12T02:02:51.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.258+0000 7f7d4effd640 1 -- 172.21.15.19:0/3155135223 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4802f070 con 0x7f7d3c004d40 2024-09-12T02:02:51.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.258+0000 7f7d4effd640 1 -- 172.21.15.19:0/3155135223 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4802bc30 con 0x7f7d3c004d40 2024-09-12T02:02:51.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.258+0000 7f7d56a5e640 1 -- 172.21.15.19:0/3155135223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d3c004d40 msgr2=0x7f7d3c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:51.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.258+0000 7f7d56a5e640 1 --2- 172.21.15.19:0/3155135223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d3c004d40 0x7f7d3c0051c0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800a800 tx=0x7f7d3c005830 comp rx=0 tx=0).stop 2024-09-12T02:02:51.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.258+0000 7f7d54ffb640 1 -- 172.21.15.19:0/3155135223 reap_dead start 2024-09-12T02:02:51.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.259+0000 7f7d56a5e640 1 -- 172.21.15.19:0/3155135223 shutdown_connections 2024-09-12T02:02:51.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.259+0000 7f7d56a5e640 1 -- 172.21.15.19:0/3155135223 >> 172.21.15.19:0/3155135223 conn(0x7f7d500d23a0 msgr2=0x7f7d500d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:51.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.259+0000 7f7d56a5e640 1 -- 172.21.15.19:0/3155135223 shutdown_connections 2024-09-12T02:02:51.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.259+0000 7f7d56a5e640 1 -- 172.21.15.19:0/3155135223 wait complete. 2024-09-12T02:02:51.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.260+0000 7f7d56a5e640 1 Processor -- start 2024-09-12T02:02:51.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.260+0000 7f7d56a5e640 1 -- start start 2024-09-12T02:02:51.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d56a5e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d3c004d40 0x7f7d500b7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:51.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d56a5e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d500b5bb0 0x7f7d5014e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:51.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d56a5e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d50070bd0 0x7f7d50071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:51.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d56a5e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7d500d1260 con 0x7f7d3c004d40 2024-09-12T02:02:51.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d56a5e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7d500d0dd0 con 0x7f7d50070bd0 2024-09-12T02:02:51.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d56a5e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7d500c9c10 con 0x7f7d500b5bb0 2024-09-12T02:02:51.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d4ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d3c004d40 0x7f7d500b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:51.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d4ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d3c004d40 0x7f7d500b7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38016/0 (socket says 172.21.15.19:38016) 2024-09-12T02:02:51.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d4ffff640 1 -- 172.21.15.19:0/2598844088 learned_addr learned my addr 172.21.15.19:0/2598844088 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:51.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d4f7fe640 1 --2- 172.21.15.19:0/2598844088 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d500b5bb0 0x7f7d5014e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:51.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d54ffb640 1 --2- 172.21.15.19:0/2598844088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d50070bd0 0x7f7d50071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:51.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d4ffff640 1 -- 172.21.15.19:0/2598844088 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d500b5bb0 msgr2=0x7f7d5014e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:51.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d4ffff640 1 --2- 172.21.15.19:0/2598844088 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d500b5bb0 0x7f7d5014e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d4ffff640 1 -- 172.21.15.19:0/2598844088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d50070bd0 msgr2=0x7f7d50071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:51.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d4ffff640 1 --2- 172.21.15.19:0/2598844088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d50070bd0 0x7f7d50071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d4ffff640 1 -- 172.21.15.19:0/2598844088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d500c9eb0 con 0x7f7d3c004d40 2024-09-12T02:02:51.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d54ffb640 1 --2- 172.21.15.19:0/2598844088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d50070bd0 0x7f7d50071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:51.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d4ffff640 1 --2- 172.21.15.19:0/2598844088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d3c004d40 0x7f7d500b7170 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f7d400119d0 tx=0x7f7d40011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:51.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.261+0000 7f7d4cff9640 1 -- 172.21.15.19:0/2598844088 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4000fa30 con 0x7f7d3c004d40 2024-09-12T02:02:51.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.262+0000 7f7d4cff9640 1 -- 172.21.15.19:0/2598844088 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4000fbd0 con 0x7f7d3c004d40 2024-09-12T02:02:51.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.262+0000 7f7d56a5e640 1 -- 172.21.15.19:0/2598844088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d500ca190 con 0x7f7d3c004d40 2024-09-12T02:02:51.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.262+0000 7f7d4cff9640 1 -- 172.21.15.19:0/2598844088 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d40014440 con 0x7f7d3c004d40 2024-09-12T02:02:51.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.262+0000 7f7d56a5e640 1 -- 172.21.15.19:0/2598844088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d500ca750 con 0x7f7d3c004d40 2024-09-12T02:02:51.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.262+0000 7f7d56a5e640 1 -- 172.21.15.19:0/2598844088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d50069140 con 0x7f7d3c004d40 2024-09-12T02:02:51.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.263+0000 7f7d4cff9640 1 -- 172.21.15.19:0/2598844088 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d40012040 con 0x7f7d3c004d40 2024-09-12T02:02:51.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.263+0000 7f7d4cff9640 1 --2- 172.21.15.19:0/2598844088 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7d3006be30 0x7f7d3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:51.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.264+0000 7f7d4cff9640 1 -- 172.21.15.19:0/2598844088 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6561+0+0 (secure 0 0 0) 0x7f7d4008b800 con 0x7f7d3c004d40 2024-09-12T02:02:51.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.264+0000 7f7d4f7fe640 1 --2- 172.21.15.19:0/2598844088 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7d3006be30 0x7f7d3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:51.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.264+0000 7f7d4f7fe640 1 --2- 172.21.15.19:0/2598844088 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7d3006be30 0x7f7d3006e2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7d50074070 tx=0x7f7d38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:51.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.268+0000 7f7d4cff9640 1 -- 172.21.15.19:0/2598844088 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d40019030 con 0x7f7d3c004d40 2024-09-12T02:02:51.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.481+0000 7f7d56a5e640 1 -- 172.21.15.19:0/2598844088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d500d04a0 con 0x7f7d3c004d40 2024-09-12T02:02:51.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.481+0000 7f7d4cff9640 1 -- 172.21.15.19:0/2598844088 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+4388 (secure 0 0 0) 0x7f7d40059800 con 0x7f7d3c004d40 2024-09-12T02:02:51.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:51.482 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":98,"btime":"2024-09-12T02:02:50:471036+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1101861733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1101861733},{"type":"v1","addr":"172.21.15.135:6837","nonce":1101861733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:02:50.470978+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:02:51.482 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 98 2024-09-12T02:02:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.483+0000 7f7d56a5e640 1 -- 172.21.15.19:0/2598844088 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7d3006be30 msgr2=0x7f7d3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.483+0000 7f7d56a5e640 1 --2- 172.21.15.19:0/2598844088 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7d3006be30 0x7f7d3006e2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7d50074070 tx=0x7f7d38009040 comp rx=0 tx=0).stop 2024-09-12T02:02:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.483+0000 7f7d56a5e640 1 -- 172.21.15.19:0/2598844088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d3c004d40 msgr2=0x7f7d500b7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.483+0000 7f7d56a5e640 1 --2- 172.21.15.19:0/2598844088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d3c004d40 0x7f7d500b7170 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f7d400119d0 tx=0x7f7d40011dd0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.483+0000 7f7d56a5e640 1 -- 172.21.15.19:0/2598844088 shutdown_connections 2024-09-12T02:02:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.483+0000 7f7d56a5e640 1 --2- 172.21.15.19:0/2598844088 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7d3006be30 0x7f7d3006e2f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.483+0000 7f7d56a5e640 1 --2- 172.21.15.19:0/2598844088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d50070bd0 0x7f7d50071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.483+0000 7f7d56a5e640 1 --2- 172.21.15.19:0/2598844088 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d500b5bb0 0x7f7d5014e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.483+0000 7f7d56a5e640 1 --2- 172.21.15.19:0/2598844088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d3c004d40 0x7f7d500b7170 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.483+0000 7f7d56a5e640 1 -- 172.21.15.19:0/2598844088 >> 172.21.15.19:0/2598844088 conn(0x7f7d500d23a0 msgr2=0x7f7d500cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:51.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.483+0000 7f7d56a5e640 1 -- 172.21.15.19:0/2598844088 shutdown_connections 2024-09-12T02:02:51.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.483+0000 7f7d56a5e640 1 -- 172.21.15.19:0/2598844088 wait complete. 2024-09-12T02:02:51.494 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 1.00000000.inode' led to DAMAGED state 2024-09-12T02:02:51.495 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 200.00000000' 2024-09-12T02:02:51.495 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:02:51.495 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:02:51.511 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:02:51.511 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:02:51.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:51.511 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:02:51.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:02:51.567 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:02:51.567 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:02:51.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.709+0000 7f862b386640 1 Processor -- start 2024-09-12T02:02:51.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.709+0000 7f862b386640 1 -- start start 2024-09-12T02:02:51.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.710+0000 7f862b386640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f862415e990 0x7f86240b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:51.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.710+0000 7f862b386640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86240ae140 0x7f86240ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:51.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.710+0000 7f862b386640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86240b6520 con 0x7f862415e5b0 2024-09-12T02:02:51.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.710+0000 7f862b386640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f86240b2c30 con 0x7f86240ae140 2024-09-12T02:02:51.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.710+0000 7f862b386640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f86240aeb30 con 0x7f862415e990 2024-09-12T02:02:51.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.710+0000 7f8629923640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86240ae140 0x7f86240ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:51.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.710+0000 7f8629122640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f862415e5b0 0x7f86240b2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40548/0 (socket says 172.21.15.19:40548) 2024-09-12T02:02:51.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.711+0000 7f8629122640 1 -- 172.21.15.19:0/2065567446 learned_addr learned my addr 172.21.15.19:0/2065567446 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:51.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.711+0000 7f8628921640 1 --2- 172.21.15.19:0/2065567446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f862415e990 0x7f86240b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:51.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.711+0000 7f8629923640 1 -- 172.21.15.19:0/2065567446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f862415e990 msgr2=0x7f86240b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:51.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.711+0000 7f8629923640 1 --2- 172.21.15.19:0/2065567446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f862415e990 0x7f86240b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.711+0000 7f8629923640 1 -- 172.21.15.19:0/2065567446 >> v1:172.21.15.19:6789/0 conn(0x7f862415e5b0 legacy=0x7f86240b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:51.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.711+0000 7f8623fff640 1 -- 172.21.15.19:0/2065567446 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2571335895 0 0) 0x7f86240b6520 con 0x7f862415e5b0 2024-09-12T02:02:51.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.711+0000 7f8629923640 1 -- 172.21.15.19:0/2065567446 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86240b1a40 con 0x7f86240ae140 2024-09-12T02:02:51.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.712+0000 7f8629923640 1 --2- 172.21.15.19:0/2065567446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86240ae140 0x7f86240ae5f0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f8614009d90 tx=0x7f861402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163df6fe234db7e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:51.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.712+0000 7f8623fff640 1 -- 172.21.15.19:0/2065567446 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614007740 con 0x7f86240ae140 2024-09-12T02:02:51.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.712+0000 7f8623fff640 1 -- 172.21.15.19:0/2065567446 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86140078e0 con 0x7f86240ae140 2024-09-12T02:02:51.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.712+0000 7f8623fff640 1 -- 172.21.15.19:0/2065567446 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614007cb0 con 0x7f86240ae140 2024-09-12T02:02:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.712+0000 7f862b386640 1 -- 172.21.15.19:0/2065567446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86240ae140 msgr2=0x7f86240ae5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.712+0000 7f862b386640 1 --2- 172.21.15.19:0/2065567446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86240ae140 0x7f86240ae5f0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f8614009d90 tx=0x7f861402a660 comp rx=0 tx=0).stop 2024-09-12T02:02:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.712+0000 7f862b386640 1 -- 172.21.15.19:0/2065567446 shutdown_connections 2024-09-12T02:02:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.712+0000 7f862b386640 1 --2- 172.21.15.19:0/2065567446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86240ae140 0x7f86240ae5f0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.712+0000 7f862b386640 1 --2- 172.21.15.19:0/2065567446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f862415e990 0x7f86240b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.712+0000 7f862b386640 1 -- 172.21.15.19:0/2065567446 >> 172.21.15.19:0/2065567446 conn(0x7f8624073490 msgr2=0x7f86240b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.712+0000 7f862b386640 1 -- 172.21.15.19:0/2065567446 shutdown_connections 2024-09-12T02:02:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.712+0000 7f862b386640 1 -- 172.21.15.19:0/2065567446 wait complete. 2024-09-12T02:02:51.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.714+0000 7f862b386640 1 Processor -- start 2024-09-12T02:02:51.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.714+0000 7f862b386640 1 -- start start 2024-09-12T02:02:51.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.714+0000 7f862b386640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86240ae140 0x7f862406f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:51.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.714+0000 7f862b386640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f862415e5b0 0x7f862406fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:51.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.714+0000 7f862b386640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f862415e990 0x7f86240cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:51.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.714+0000 7f862b386640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f86240b0490 con 0x7f862415e990 2024-09-12T02:02:51.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.714+0000 7f862b386640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f86240b2000 con 0x7f862415e5b0 2024-09-12T02:02:51.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.714+0000 7f862b386640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f86240b07e0 con 0x7f86240ae140 2024-09-12T02:02:51.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.715+0000 7f8629923640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f862415e990 0x7f86240cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:51.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.715+0000 7f8629923640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f862415e990 0x7f86240cd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38028/0 (socket says 172.21.15.19:38028) 2024-09-12T02:02:51.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.715+0000 7f8629923640 1 -- 172.21.15.19:0/4234681831 learned_addr learned my addr 172.21.15.19:0/4234681831 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:51.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.715+0000 7f8629122640 1 --2- 172.21.15.19:0/4234681831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86240ae140 0x7f862406f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:51.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.715+0000 7f8628921640 1 --2- 172.21.15.19:0/4234681831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f862415e5b0 0x7f862406fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:51.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.715+0000 7f8629923640 1 -- 172.21.15.19:0/4234681831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86240ae140 msgr2=0x7f862406f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:51.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.715+0000 7f8629923640 1 --2- 172.21.15.19:0/4234681831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86240ae140 0x7f862406f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.715+0000 7f8629923640 1 -- 172.21.15.19:0/4234681831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f862415e5b0 msgr2=0x7f862406fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:51.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.715+0000 7f8629923640 1 --2- 172.21.15.19:0/4234681831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f862415e5b0 0x7f862406fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:51.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.715+0000 7f8629923640 1 -- 172.21.15.19:0/4234681831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86241f7b00 con 0x7f862415e990 2024-09-12T02:02:51.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.715+0000 7f8629923640 1 --2- 172.21.15.19:0/4234681831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f862415e990 0x7f86240cd9f0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f8614009eb0 tx=0x7f8614004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:51.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.715+0000 7f8621ffb640 1 -- 172.21.15.19:0/4234681831 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614040070 con 0x7f862415e990 2024-09-12T02:02:51.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.715+0000 7f8621ffb640 1 -- 172.21.15.19:0/4234681831 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8614031bc0 con 0x7f862415e990 2024-09-12T02:02:51.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.715+0000 7f862b386640 1 -- 172.21.15.19:0/4234681831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86241f8880 con 0x7f862415e990 2024-09-12T02:02:51.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.715+0000 7f8621ffb640 1 -- 172.21.15.19:0/4234681831 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614009450 con 0x7f862415e990 2024-09-12T02:02:51.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.716+0000 7f862b386640 1 -- 172.21.15.19:0/4234681831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86241f8080 con 0x7f862415e990 2024-09-12T02:02:51.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.717+0000 7f862b386640 1 -- 172.21.15.19:0/4234681831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86240ae5f0 con 0x7f862415e990 2024-09-12T02:02:51.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.717+0000 7f8621ffb640 1 -- 172.21.15.19:0/4234681831 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8614039040 con 0x7f862415e990 2024-09-12T02:02:51.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.718+0000 7f8621ffb640 1 --2- 172.21.15.19:0/4234681831 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f861006be30 0x7f861006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:51.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.718+0000 7f8621ffb640 1 -- 172.21.15.19:0/4234681831 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6561+0+0 (secure 0 0 0) 0x7f86140acaf0 con 0x7f862415e990 2024-09-12T02:02:51.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.718+0000 7f8629122640 1 --2- 172.21.15.19:0/4234681831 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f861006be30 0x7f861006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:51.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.718+0000 7f8629122640 1 --2- 172.21.15.19:0/4234681831 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f861006be30 0x7f861006e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f861c000f60 tx=0x7f861c007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:51.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.722+0000 7f8621ffb640 1 -- 172.21.15.19:0/4234681831 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f861407b0a0 con 0x7f862415e990 2024-09-12T02:02:51.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:51.933+0000 7f862b386640 1 -- 172.21.15.19:0/4234681831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f86240afd40 con 0x7f862415e990 2024-09-12T02:02:52.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.466+0000 7f8621ffb640 1 -- 172.21.15.19:0/4234681831 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v99) ==== 161+0+0 (secure 0 0 0) 0x7f861407a9a0 con 0x7f862415e990 2024-09-12T02:02:52.466 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:02:52.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.468+0000 7f862b386640 1 -- 172.21.15.19:0/4234681831 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f861006be30 msgr2=0x7f861006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:52.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.468+0000 7f862b386640 1 --2- 172.21.15.19:0/4234681831 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f861006be30 0x7f861006e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f861c000f60 tx=0x7f861c007b50 comp rx=0 tx=0).stop 2024-09-12T02:02:52.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.468+0000 7f862b386640 1 -- 172.21.15.19:0/4234681831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f862415e990 msgr2=0x7f86240cd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:52.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.468+0000 7f862b386640 1 --2- 172.21.15.19:0/4234681831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f862415e990 0x7f86240cd9f0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f8614009eb0 tx=0x7f8614004a40 comp rx=0 tx=0).stop 2024-09-12T02:02:52.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.468+0000 7f862b386640 1 -- 172.21.15.19:0/4234681831 shutdown_connections 2024-09-12T02:02:52.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.468+0000 7f862b386640 1 --2- 172.21.15.19:0/4234681831 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f861006be30 0x7f861006e2f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:52.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.468+0000 7f862b386640 1 --2- 172.21.15.19:0/4234681831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f862415e990 0x7f86240cd9f0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:52.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.468+0000 7f862b386640 1 --2- 172.21.15.19:0/4234681831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f862415e5b0 0x7f862406fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:52.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.468+0000 7f862b386640 1 --2- 172.21.15.19:0/4234681831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86240ae140 0x7f862406f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:52.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.468+0000 7f862b386640 1 -- 172.21.15.19:0/4234681831 >> 172.21.15.19:0/4234681831 conn(0x7f8624073490 msgr2=0x7f86240aece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:52.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.468+0000 7f862b386640 1 -- 172.21.15.19:0/4234681831 shutdown_connections 2024-09-12T02:02:52.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.468+0000 7f862b386640 1 -- 172.21.15.19:0/4234681831 wait complete. 2024-09-12T02:02:52.481 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:02:52.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.588+0000 7f561db0a640 1 Processor -- start 2024-09-12T02:02:52.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.588+0000 7f561db0a640 1 -- start start 2024-09-12T02:02:52.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.588+0000 7f561db0a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5618161c80 0x7f561806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:52.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.588+0000 7f561db0a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5618162060 0x7f56180b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:52.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.588+0000 7f561db0a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f561806e870 con 0x7f56180b64b0 2024-09-12T02:02:52.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.588+0000 7f561db0a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f561806d9f0 con 0x7f5618162060 2024-09-12T02:02:52.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.588+0000 7f561db0a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f561806dcd0 con 0x7f5618161c80 2024-09-12T02:02:52.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f5617fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f56180b64b0 0x7f5618162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40560/0 (socket says 172.21.15.19:40560) 2024-09-12T02:02:52.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f5617fff640 1 -- 172.21.15.19:0/431423440 learned_addr learned my addr 172.21.15.19:0/431423440 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:52.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f56177fe640 1 --2- 172.21.15.19:0/431423440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5618161c80 0x7f561806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:52.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f5616ffd640 1 --2- 172.21.15.19:0/431423440 >> v2:172.21.15.135:3300/0 conn(0x7f5618162060 0x7f56180b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:52.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f56167fc640 1 -- 172.21.15.19:0/431423440 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1918801449 0 0) 0x7f5610001490 con 0x7f56180b64b0 2024-09-12T02:02:52.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f56167fc640 1 -- 172.21.15.19:0/431423440 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5600003520 con 0x7f56180b64b0 2024-09-12T02:02:52.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f56167fc640 1 -- 172.21.15.19:0/431423440 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3857257020 0 0) 0x7f5600003520 con 0x7f56180b64b0 2024-09-12T02:02:52.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f56167fc640 1 -- 172.21.15.19:0/431423440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5618161c80 msgr2=0x7f561806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:52.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f56167fc640 1 --2- 172.21.15.19:0/431423440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5618161c80 0x7f561806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:52.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f56167fc640 1 -- 172.21.15.19:0/431423440 >> v2:172.21.15.135:3300/0 conn(0x7f5618162060 msgr2=0x7f56180b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:52.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f56167fc640 1 --2- 172.21.15.19:0/431423440 >> v2:172.21.15.135:3300/0 conn(0x7f5618162060 0x7f56180b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:52.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f56167fc640 1 -- 172.21.15.19:0/431423440 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561806dfb0 con 0x7f56180b64b0 2024-09-12T02:02:52.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f56167fc640 1 -- 172.21.15.19:0/431423440 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f5610001bc0 con 0x7f56180b64b0 2024-09-12T02:02:52.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f56167fc640 1 -- 172.21.15.19:0/431423440 >> v1:172.21.15.19:6789/0 conn(0x7f56180b64b0 legacy=0x7f5618162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:52.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f56167fc640 1 --2- 172.21.15.19:0/431423440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5618161c80 0x7f56000039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:52.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f56167fc640 1 --2- 172.21.15.19:0/431423440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5600003f30 0x7f5600004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:52.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f56167fc640 1 --2- 172.21.15.19:0/431423440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5600004d40 0x7f56000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:52.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f56167fc640 1 -- 172.21.15.19:0/431423440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f561806d9f0 con 0x7f5600003f30 2024-09-12T02:02:52.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f56167fc640 1 -- 172.21.15.19:0/431423440 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f561806dcd0 con 0x7f5600004d40 2024-09-12T02:02:52.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f56167fc640 1 -- 172.21.15.19:0/431423440 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f560000b9c0 con 0x7f5618161c80 2024-09-12T02:02:52.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f5616ffd640 1 --2- 172.21.15.19:0/431423440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5600003f30 0x7f5600004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:52.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f5617fff640 1 --2- 172.21.15.19:0/431423440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5600004d40 0x7f56000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:52.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.589+0000 7f56177fe640 1 --2- 172.21.15.19:0/431423440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5618161c80 0x7f56000039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:52.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.590+0000 7f5616ffd640 1 -- 172.21.15.19:0/431423440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5618161c80 msgr2=0x7f56000039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:52.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.590+0000 7f5616ffd640 1 --2- 172.21.15.19:0/431423440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5618161c80 0x7f56000039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:52.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.590+0000 7f5616ffd640 1 -- 172.21.15.19:0/431423440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5600004d40 msgr2=0x7f56000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:52.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.590+0000 7f5616ffd640 1 --2- 172.21.15.19:0/431423440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5600004d40 0x7f56000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:52.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.590+0000 7f5616ffd640 1 -- 172.21.15.19:0/431423440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5600003520 con 0x7f5600003f30 2024-09-12T02:02:52.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.590+0000 7f5616ffd640 1 --2- 172.21.15.19:0/431423440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5600003f30 0x7f5600004800 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f561808e830 tx=0x7f5600005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c523de125726184 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:52.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.591+0000 7f56167fc640 1 -- 172.21.15.19:0/431423440 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c036070 con 0x7f5600003f30 2024-09-12T02:02:52.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.591+0000 7f56167fc640 1 -- 172.21.15.19:0/431423440 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f560c031400 con 0x7f5600003f30 2024-09-12T02:02:52.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.591+0000 7f56167fc640 1 -- 172.21.15.19:0/431423440 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c009690 con 0x7f5600003f30 2024-09-12T02:02:52.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.591+0000 7f561db0a640 1 -- 172.21.15.19:0/431423440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5600003f30 msgr2=0x7f5600004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:52.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.591+0000 7f561db0a640 1 --2- 172.21.15.19:0/431423440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5600003f30 0x7f5600004800 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f561808e830 tx=0x7f5600005830 comp rx=0 tx=0).stop 2024-09-12T02:02:52.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.591+0000 7f5617fff640 1 -- 172.21.15.19:0/431423440 reap_dead start 2024-09-12T02:02:52.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.591+0000 7f561db0a640 1 -- 172.21.15.19:0/431423440 shutdown_connections 2024-09-12T02:02:52.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.591+0000 7f561db0a640 1 -- 172.21.15.19:0/431423440 >> 172.21.15.19:0/431423440 conn(0x7f56180d44f0 msgr2=0x7f56180d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:52.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.591+0000 7f561db0a640 1 -- 172.21.15.19:0/431423440 shutdown_connections 2024-09-12T02:02:52.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.591+0000 7f561db0a640 1 -- 172.21.15.19:0/431423440 wait complete. 2024-09-12T02:02:52.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.592+0000 7f561db0a640 1 Processor -- start 2024-09-12T02:02:52.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.593+0000 7f561db0a640 1 -- start start 2024-09-12T02:02:52.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.593+0000 7f561db0a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5600003f30 0x7f5618156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:52.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.593+0000 7f561db0a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5618156ad0 0x7f56180b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:52.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.593+0000 7f561db0a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56180b94c0 0x7f56180b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:52.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.593+0000 7f561db0a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f56180d2a10 con 0x7f5618156ad0 2024-09-12T02:02:52.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.593+0000 7f561db0a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f56180d2890 con 0x7f56180b94c0 2024-09-12T02:02:52.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.593+0000 7f561db0a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f561806e330 con 0x7f5600003f30 2024-09-12T02:02:52.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.593+0000 7f5616ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5618156ad0 0x7f56180b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:52.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.593+0000 7f5616ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5618156ad0 0x7f56180b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38060/0 (socket says 172.21.15.19:38060) 2024-09-12T02:02:52.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.593+0000 7f5616ffd640 1 -- 172.21.15.19:0/1825484923 learned_addr learned my addr 172.21.15.19:0/1825484923 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:52.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.594+0000 7f5617fff640 1 --2- 172.21.15.19:0/1825484923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56180b94c0 0x7f56180b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:52.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.594+0000 7f56177fe640 1 --2- 172.21.15.19:0/1825484923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5600003f30 0x7f5618156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:52.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.594+0000 7f5616ffd640 1 -- 172.21.15.19:0/1825484923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5600003f30 msgr2=0x7f5618156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:52.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.594+0000 7f5616ffd640 1 --2- 172.21.15.19:0/1825484923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5600003f30 0x7f5618156560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:52.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.594+0000 7f5616ffd640 1 -- 172.21.15.19:0/1825484923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56180b94c0 msgr2=0x7f56180b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:52.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.594+0000 7f5616ffd640 1 --2- 172.21.15.19:0/1825484923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56180b94c0 0x7f56180b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:52.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.594+0000 7f5616ffd640 1 -- 172.21.15.19:0/1825484923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56181f5040 con 0x7f5618156ad0 2024-09-12T02:02:52.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.594+0000 7f5617fff640 1 --2- 172.21.15.19:0/1825484923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56180b94c0 0x7f56180b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:52.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.594+0000 7f5616ffd640 1 --2- 172.21.15.19:0/1825484923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5618156ad0 0x7f56180b2530 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f560c034040 tx=0x7f560c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:52.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.594+0000 7f55fffff640 1 -- 172.21.15.19:0/1825484923 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c040020 con 0x7f5618156ad0 2024-09-12T02:02:52.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.594+0000 7f55fffff640 1 -- 172.21.15.19:0/1825484923 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f560c03b6a0 con 0x7f5618156ad0 2024-09-12T02:02:52.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.594+0000 7f561db0a640 1 -- 172.21.15.19:0/1825484923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56181f5320 con 0x7f5618156ad0 2024-09-12T02:02:52.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.594+0000 7f55fffff640 1 -- 172.21.15.19:0/1825484923 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c036040 con 0x7f5618156ad0 2024-09-12T02:02:52.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.594+0000 7f561db0a640 1 -- 172.21.15.19:0/1825484923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56181f58e0 con 0x7f5618156ad0 2024-09-12T02:02:52.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.595+0000 7f561db0a640 1 -- 172.21.15.19:0/1825484923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56180b50d0 con 0x7f5618156ad0 2024-09-12T02:02:52.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.596+0000 7f55fffff640 1 -- 172.21.15.19:0/1825484923 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f560c043020 con 0x7f5618156ad0 2024-09-12T02:02:52.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.596+0000 7f55fffff640 1 --2- 172.21.15.19:0/1825484923 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f560406be60 0x7f560406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:52.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.596+0000 7f55fffff640 1 -- 172.21.15.19:0/1825484923 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6561+0+0 (secure 0 0 0) 0x7f560c0ab870 con 0x7f5618156ad0 2024-09-12T02:02:52.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.596+0000 7f56177fe640 1 --2- 172.21.15.19:0/1825484923 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f560406be60 0x7f560406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:52.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.597+0000 7f56177fe640 1 --2- 172.21.15.19:0/1825484923 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f560406be60 0x7f560406e320 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5608009900 tx=0x7f5608008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:52.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.600+0000 7f55fffff640 1 -- 172.21.15.19:0/1825484923 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f56180b50d0 con 0x7f5618156ad0 2024-09-12T02:02:52.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:52.846+0000 7f561db0a640 1 -- 172.21.15.19:0/1825484923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f56180ba470 con 0x7f5618156ad0 2024-09-12T02:02:53.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.468+0000 7f55fffff640 1 -- 172.21.15.19:0/1825484923 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v100) ==== 101+0+0 (secure 0 0 0) 0x7f560c04a030 con 0x7f5618156ad0 2024-09-12T02:02:53.468 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:02:53.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.470+0000 7f561db0a640 1 -- 172.21.15.19:0/1825484923 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f560406be60 msgr2=0x7f560406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.470+0000 7f561db0a640 1 --2- 172.21.15.19:0/1825484923 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f560406be60 0x7f560406e320 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5608009900 tx=0x7f5608008040 comp rx=0 tx=0).stop 2024-09-12T02:02:53.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.470+0000 7f561db0a640 1 -- 172.21.15.19:0/1825484923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5618156ad0 msgr2=0x7f56180b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.470+0000 7f561db0a640 1 --2- 172.21.15.19:0/1825484923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5618156ad0 0x7f56180b2530 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f560c034040 tx=0x7f560c004730 comp rx=0 tx=0).stop 2024-09-12T02:02:53.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.470+0000 7f561db0a640 1 -- 172.21.15.19:0/1825484923 shutdown_connections 2024-09-12T02:02:53.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.470+0000 7f561db0a640 1 --2- 172.21.15.19:0/1825484923 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f560406be60 0x7f560406e320 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.470+0000 7f561db0a640 1 --2- 172.21.15.19:0/1825484923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56180b94c0 0x7f56180b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.470+0000 7f561db0a640 1 --2- 172.21.15.19:0/1825484923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5618156ad0 0x7f56180b2530 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.470+0000 7f561db0a640 1 --2- 172.21.15.19:0/1825484923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5600003f30 0x7f5618156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.470+0000 7f561db0a640 1 -- 172.21.15.19:0/1825484923 >> 172.21.15.19:0/1825484923 conn(0x7f56180d44f0 msgr2=0x7f5618162490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:53.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.471+0000 7f561db0a640 1 -- 172.21.15.19:0/1825484923 shutdown_connections 2024-09-12T02:02:53.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.471+0000 7f561db0a640 1 -- 172.21.15.19:0/1825484923 wait complete. 2024-09-12T02:02:53.485 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:02:53.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.532+0000 7f7470721f40 1 Processor -- start 2024-09-12T02:02:53.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.532+0000 7f7470721f40 1 -- start start 2024-09-12T02:02:53.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.533+0000 7f7470721f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559348de9180 0x559348e2aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.533+0000 7f7470721f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559348e17050 0x559348f4fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.533+0000 7f7470721f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559348ea1080 0x559348f4d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.533+0000 7f7470721f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559348de95c0 con 0x559348e17050 2024-09-12T02:02:53.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.533+0000 7f7470721f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559348d38510 con 0x559348de9180 2024-09-12T02:02:53.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.533+0000 7f7470721f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x559348de5ae0 con 0x559348ea1080 2024-09-12T02:02:53.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.533+0000 7f746cfce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559348e17050 0x559348f4fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.533+0000 7f746cfce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559348e17050 0x559348f4fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38078/0 (socket says 172.21.15.19:38078) 2024-09-12T02:02:53.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.533+0000 7f746cfce640 1 -- 172.21.15.19:0/1342658857 learned_addr learned my addr 172.21.15.19:0/1342658857 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:53.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.533+0000 7f746d7cf640 1 --2- 172.21.15.19:0/1342658857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559348de9180 0x559348e2aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.533+0000 7f746dfd0640 1 --2- 172.21.15.19:0/1342658857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559348ea1080 0x559348f4d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.534+0000 7f746cfce640 1 -- 172.21.15.19:0/1342658857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559348ea1080 msgr2=0x559348f4d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:53.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.534+0000 7f746cfce640 1 --2- 172.21.15.19:0/1342658857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559348ea1080 0x559348f4d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.534+0000 7f746cfce640 1 -- 172.21.15.19:0/1342658857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559348de9180 msgr2=0x559348e2aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:53.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.534+0000 7f746cfce640 1 --2- 172.21.15.19:0/1342658857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559348de9180 0x559348e2aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.534+0000 7f746cfce640 1 -- 172.21.15.19:0/1342658857 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559348ebe440 con 0x559348e17050 2024-09-12T02:02:53.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.534+0000 7f746cfce640 1 --2- 172.21.15.19:0/1342658857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559348e17050 0x559348f4fae0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f7464025d40 tx=0x7f7464051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ababa3dc749fa2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:53.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.534+0000 7f745f7fe640 1 -- 172.21.15.19:0/1342658857 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7464055070 con 0x559348e17050 2024-09-12T02:02:53.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.534+0000 7f745f7fe640 1 -- 172.21.15.19:0/1342658857 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7464051850 con 0x559348e17050 2024-09-12T02:02:53.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.534+0000 7f745f7fe640 1 -- 172.21.15.19:0/1342658857 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7464051c00 con 0x559348e17050 2024-09-12T02:02:53.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.534+0000 7f7470721f40 1 -- 172.21.15.19:0/1342658857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559348e17050 msgr2=0x559348f4fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.534+0000 7f7470721f40 1 --2- 172.21.15.19:0/1342658857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559348e17050 0x559348f4fae0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f7464025d40 tx=0x7f7464051000 comp rx=0 tx=0).stop 2024-09-12T02:02:53.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.534+0000 7f7470721f40 1 -- 172.21.15.19:0/1342658857 shutdown_connections 2024-09-12T02:02:53.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.534+0000 7f7470721f40 1 --2- 172.21.15.19:0/1342658857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559348ea1080 0x559348f4d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.534+0000 7f7470721f40 1 --2- 172.21.15.19:0/1342658857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559348e17050 0x559348f4fae0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.534+0000 7f7470721f40 1 --2- 172.21.15.19:0/1342658857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559348de9180 0x559348e2aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.534+0000 7f7470721f40 1 -- 172.21.15.19:0/1342658857 >> 172.21.15.19:0/1342658857 conn(0x559348de69e0 msgr2=0x559348de6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:53.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.535+0000 7f7470721f40 1 -- 172.21.15.19:0/1342658857 shutdown_connections 2024-09-12T02:02:53.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.535+0000 7f7470721f40 1 -- 172.21.15.19:0/1342658857 wait complete. 2024-09-12T02:02:53.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.535+0000 7f7470721f40 1 Processor -- start 2024-09-12T02:02:53.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.535+0000 7f7470721f40 1 -- start start 2024-09-12T02:02:53.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.536+0000 7f7470721f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559348de9180 0x559348e9fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.536+0000 7f7470721f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559348e17050 0x559348ea4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.536+0000 7f7470721f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559348ea1080 0x559348f4d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.536+0000 7f7470721f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559348ec1570 con 0x559348ea1080 2024-09-12T02:02:53.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.536+0000 7f7470721f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559348ea70a0 con 0x559348de9180 2024-09-12T02:02:53.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.536+0000 7f7470721f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x559348ebe160 con 0x559348e17050 2024-09-12T02:02:53.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.536+0000 7f746dfd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559348ea1080 0x559348f4d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.536+0000 7f746dfd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559348ea1080 0x559348f4d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38086/0 (socket says 172.21.15.19:38086) 2024-09-12T02:02:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.536+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 learned_addr learned my addr 172.21.15.19:0/1568284557 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.536+0000 7f746d7cf640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559348de9180 0x559348e9fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.536+0000 7f746cfce640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559348e17050 0x559348ea4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.536+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559348e17050 msgr2=0x559348ea4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.536+0000 7f746dfd0640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559348e17050 0x559348ea4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.536+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559348de9180 msgr2=0x559348e9fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.536+0000 7f746dfd0640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559348de9180 0x559348e9fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.536+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559348ea0410 con 0x559348ea1080 2024-09-12T02:02:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.537+0000 7f746dfd0640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559348ea1080 0x559348f4d580 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f746800f540 tx=0x7f746800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.537+0000 7f745e7fc640 1 -- 172.21.15.19:0/1568284557 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468017070 con 0x559348ea1080 2024-09-12T02:02:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.537+0000 7f745e7fc640 1 -- 172.21.15.19:0/1568284557 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f746800c650 con 0x559348ea1080 2024-09-12T02:02:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.537+0000 7f745e7fc640 1 -- 172.21.15.19:0/1568284557 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746800ca00 con 0x559348ea1080 2024-09-12T02:02:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.537+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559348ea3e80 con 0x559348ea1080 2024-09-12T02:02:53.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.537+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559348ea4440 con 0x559348ea1080 2024-09-12T02:02:53.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.539+0000 7f745e7fc640 1 -- 172.21.15.19:0/1568284557 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f746801a070 con 0x559348ea1080 2024-09-12T02:02:53.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.539+0000 7f745e7fc640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f745006a810 0x7f745006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.539+0000 7f745e7fc640 1 -- 172.21.15.19:0/1568284557 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6561+0+0 (secure 0 0 0) 0x7f746808a1a0 con 0x559348ea1080 2024-09-12T02:02:53.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.539+0000 7f746d7cf640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f745006a810 0x7f745006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.542 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:02:53.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.539+0000 7f7470721f40 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x559348f4dac0 0x559348f47b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.539+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348e2d220 con 0x559348f4dac0 2024-09-12T02:02:53.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.539+0000 7f746cfce640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x559348f4dac0 0x559348f47b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.540+0000 7f746d7cf640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f745006a810 0x7f745006ccd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7460011480 tx=0x7f74600016f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:53.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.540+0000 7f746cfce640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x559348f4dac0 0x559348f47b00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:53.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.541+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v98'102 uv78 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.541+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348ebff20 con 0x559348f4dac0 2024-09-12T02:02:53.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.542+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v98'103 uv103 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.542+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f58390 con 0x559348f4dac0 2024-09-12T02:02:53.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.545+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v98'104 uv104 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.545 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:02:53.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.545+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f58730 con 0x559348f4dac0 2024-09-12T02:02:53.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.548+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v98'105 uv105 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.548+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f58b30 con 0x559348f4dac0 2024-09-12T02:02:53.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.551+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v98'106 uv106 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.551+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f58f30 con 0x559348f4dac0 2024-09-12T02:02:53.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.554+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v98'107 uv107 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.554+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f61660 con 0x559348f4dac0 2024-09-12T02:02:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.557+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v98'108 uv84 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.557+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f61660 con 0x559348f4dac0 2024-09-12T02:02:53.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.560+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v98'109 uv109 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.560+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f61660 con 0x559348f4dac0 2024-09-12T02:02:53.563 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:02:53.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.563+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v98'110 uv110 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.563+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f62670 con 0x559348f4dac0 2024-09-12T02:02:53.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.566+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v98'111 uv111 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.566+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f62670 con 0x559348f4dac0 2024-09-12T02:02:53.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.569+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v98'112 uv112 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.569+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f61660 con 0x559348f4dac0 2024-09-12T02:02:53.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.570+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v98'113 uv113 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.570+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f61660 con 0x559348f4dac0 2024-09-12T02:02:53.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.573+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v98'114 uv91 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.573+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f61660 con 0x559348f4dac0 2024-09-12T02:02:53.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.576+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v98'115 uv115 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.576+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f61660 con 0x559348f4dac0 2024-09-12T02:02:53.578 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:02:53.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.578+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v98'116 uv116 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.578+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f62670 con 0x559348f4dac0 2024-09-12T02:02:53.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.581+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v98'117 uv117 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.581+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f62670 con 0x559348f4dac0 2024-09-12T02:02:53.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.584+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v98'118 uv118 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.584+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f61660 con 0x559348f4dac0 2024-09-12T02:02:53.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.587+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v98'119 uv119 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.587+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f61dc0 con 0x559348f4dac0 2024-09-12T02:02:53.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.589+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v98'120 uv120 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.589+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f61dc0 con 0x559348f4dac0 2024-09-12T02:02:53.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.591+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v98'121 uv95 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.591+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f61dc0 con 0x559348f4dac0 2024-09-12T02:02:53.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.593+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v98'122 uv122 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.593+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f61dc0 con 0x559348f4dac0 2024-09-12T02:02:53.594 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:02:53.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.594+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v98'123 uv123 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.594+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f62dd0 con 0x559348f4dac0 2024-09-12T02:02:53.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.595+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v98'124 uv124 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.595+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f62dd0 con 0x559348f4dac0 2024-09-12T02:02:53.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.596+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v98'125 uv125 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.596+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f61dc0 con 0x559348f4dac0 2024-09-12T02:02:53.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.597+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v98'126 uv126 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.597+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f61dc0 con 0x559348f4dac0 2024-09-12T02:02:53.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.598+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v98'127 uv101 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.598+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f61dc0 con 0x559348f4dac0 2024-09-12T02:02:53.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.599+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v98'128 uv128 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.599+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f61dc0 con 0x559348f4dac0 2024-09-12T02:02:53.600 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:02:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.600+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v98'129 uv129 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.600+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f62dd0 con 0x559348f4dac0 2024-09-12T02:02:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.601+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v98'130 uv130 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.601+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f62dd0 con 0x559348f4dac0 2024-09-12T02:02:53.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.602+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v98'131 uv131 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.602+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f61dc0 con 0x559348f4dac0 2024-09-12T02:02:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.603+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v98'132 uv132 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f4dac0 2024-09-12T02:02:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.603+0000 7f7470721f40 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559348f622d0 0x559348f646c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.603+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f64c00 con 0x559348f622d0 2024-09-12T02:02:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.603+0000 7f746d7cf640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559348f622d0 0x559348f646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.603+0000 7f746d7cf640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559348f622d0 0x559348f646c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:53.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.605+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v98'90 uv90 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.605 INFO:teuthology.orchestra.run.smithi019.stdout:Write #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:02:53.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.605+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f65450 con 0x559348f622d0 2024-09-12T02:02:53.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.606+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [write 0~582] v98'91 uv91 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.606+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f65020 con 0x559348f622d0 2024-09-12T02:02:53.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.607+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [omap-set-header] v98'92 uv92 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.607+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f65870 con 0x559348f622d0 2024-09-12T02:02:53.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.608+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 200.00000000 [create] v98'93 uv77 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.608+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f661a0 con 0x559348f622d0 2024-09-12T02:02:53.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.610+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 200.00000000 [delete] v98'94 uv94 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.610+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f66540 con 0x559348f622d0 2024-09-12T02:02:53.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.611+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v98'95 uv95 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.611 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:02:53.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.611+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f66930 con 0x559348f622d0 2024-09-12T02:02:53.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.612+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [write 0~90] v98'96 uv96 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.612+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f66d50 con 0x559348f622d0 2024-09-12T02:02:53.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.613+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [omap-set-header] v98'97 uv97 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.613+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f66d50 con 0x559348f622d0 2024-09-12T02:02:53.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.614+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000001 [create] v98'98 uv82 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.614+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f66d50 con 0x559348f622d0 2024-09-12T02:02:53.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.615+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000001 [delete] v98'99 uv99 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.615+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f66d50 con 0x559348f622d0 2024-09-12T02:02:53.616 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:02:53.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.616+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v98'100 uv100 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.616+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f66d50 con 0x559348f622d0 2024-09-12T02:02:53.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.617+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [write 0~17490] v98'101 uv101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.617+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f66d50 con 0x559348f622d0 2024-09-12T02:02:53.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.618+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [omap-set-header] v98'102 uv102 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.618+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f66d90 con 0x559348f622d0 2024-09-12T02:02:53.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.619+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 606.00000000 [create] v98'103 uv88 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.619+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f671b0 con 0x559348f622d0 2024-09-12T02:02:53.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.620+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 606.00000000 [delete] v98'104 uv104 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.620+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f671b0 con 0x559348f622d0 2024-09-12T02:02:53.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.621+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v98'105 uv105 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.621 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:02:53.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.621+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f68600 con 0x559348f622d0 2024-09-12T02:02:53.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.622+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [setxattr (30)] v98'106 uv106 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.622+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f68600 con 0x559348f622d0 2024-09-12T02:02:53.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.623+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [setxattr (62)] v98'107 uv107 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.623+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f672c0 con 0x559348f622d0 2024-09-12T02:02:53.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.624+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [omap-set-header] v98'108 uv108 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f622d0 2024-09-12T02:02:53.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.624+0000 7f7470721f40 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x559348f67940 0x559348f69d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.624+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:51 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f6a370 con 0x559348f67940 2024-09-12T02:02:53.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.625+0000 7f746cfce640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x559348f67940 0x559348f69d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.625+0000 7f746cfce640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x559348f67940 0x559348f69d30 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:53.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.627+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(51 607.00000000 [create] v98'21 uv20 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.627+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:52 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f6a740 con 0x559348f67940 2024-09-12T02:02:53.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.628+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(52 607.00000000 [delete] v98'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.628+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f6a740 con 0x559348f67940 2024-09-12T02:02:53.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.629+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(53 607.00000000 [create] v98'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.630 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:02:53.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.630+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f6b750 con 0x559348f67940 2024-09-12T02:02:53.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.631+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(54 607.00000000 [setxattr (30)] v98'24 uv24 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.631+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f6b750 con 0x559348f67940 2024-09-12T02:02:53.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.632+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(55 607.00000000 [setxattr (62)] v98'25 uv25 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.632+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f6a740 con 0x559348f67940 2024-09-12T02:02:53.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.634+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(56 607.00000000 [omap-set-header] v98'26 uv26 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.634+0000 7f7470721f40 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x559348f6adc0 0x559348f6d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.634+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:57 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f6d8c0 con 0x559348f6adc0 2024-09-12T02:02:53.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.634+0000 7f746dfd0640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x559348f6adc0 0x559348f6d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.634+0000 7f746dfd0640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x559348f6adc0 0x559348f6d1f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:53.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.635+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(57 mds0_openfiles.0 [create] v98'17 uv16 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.635+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:58 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f6ddd0 con 0x559348f6adc0 2024-09-12T02:02:53.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.637+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(58 mds0_openfiles.0 [delete] v98'18 uv18 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.637+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f6e290 con 0x559348f6adc0 2024-09-12T02:02:53.639 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:02:53.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.640+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(59 mds0_openfiles.0 [create] v98'19 uv19 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.640+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f6eb80 con 0x559348f6adc0 2024-09-12T02:02:53.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.642+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(60 mds0_openfiles.0 [omap-set-header] v98'20 uv20 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.642+0000 7f7470721f40 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559348f6f430 0x559348f71820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.642+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:61 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f71d60 con 0x559348f6f430 2024-09-12T02:02:53.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.643+0000 7f746d7cf640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559348f6f430 0x559348f71820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.643+0000 7f746d7cf640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559348f6f430 0x559348f71820 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:53.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.644+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(61 608.00000000 [create] v98'21 uv20 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.644+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:62 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f71e20 con 0x559348f6f430 2024-09-12T02:02:53.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.647+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(62 608.00000000 [delete] v98'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.647+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72240 con 0x559348f6f430 2024-09-12T02:02:53.649 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:02:53.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.649+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(63 608.00000000 [create] v98'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.649+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f73250 con 0x559348f6f430 2024-09-12T02:02:53.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.652+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(64 608.00000000 [setxattr (30)] v98'24 uv24 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.652+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f73250 con 0x559348f6f430 2024-09-12T02:02:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.655+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(65 608.00000000 [setxattr (62)] v98'25 uv25 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.655+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72240 con 0x559348f6f430 2024-09-12T02:02:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.657+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(66 608.00000000 [omap-set-header] v98'26 uv26 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.657+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:67 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72240 con 0x559348f6adc0 2024-09-12T02:02:53.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.658+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(67 604.00000000 [create] v98'37 uv31 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.658+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:68 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f725e0 con 0x559348f6adc0 2024-09-12T02:02:53.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.659+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(68 604.00000000 [delete] v98'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.659+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72980 con 0x559348f6adc0 2024-09-12T02:02:53.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.660+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(69 604.00000000 [create] v98'39 uv39 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.660 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:02:53.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.660+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f73d30 con 0x559348f6adc0 2024-09-12T02:02:53.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.661+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(70 604.00000000 [setxattr (30)] v98'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.661+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f73d30 con 0x559348f6adc0 2024-09-12T02:02:53.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.662+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(71 604.00000000 [setxattr (62)] v98'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.662+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6adc0 2024-09-12T02:02:53.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.663+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(72 604.00000000 [omap-set-header] v98'42 uv42 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.663+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6adc0 2024-09-12T02:02:53.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.664+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(73 500.00000000 [create] v98'43 uv36 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.664+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6adc0 2024-09-12T02:02:53.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.665+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(74 500.00000000 [delete] v98'44 uv44 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.665+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6adc0 2024-09-12T02:02:53.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.666+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(75 500.00000000 [create] v98'45 uv45 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.666 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:02:53.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.666+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6adc0 2024-09-12T02:02:53.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.667+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(76 500.00000000 [write 0~90] v98'46 uv46 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.667+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6adc0 2024-09-12T02:02:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.668+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(77 500.00000000 [omap-set-header] v98'47 uv47 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.668+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6adc0 2024-09-12T02:02:53.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.669+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(78 mds_snaptable [create] v98'17 uv16 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.669+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6adc0 2024-09-12T02:02:53.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.670+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(79 mds_snaptable [delete] v98'18 uv18 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.670+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6adc0 2024-09-12T02:02:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.672+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(80 mds_snaptable [create] v98'19 uv19 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.672 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:02:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.672+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6adc0 2024-09-12T02:02:53.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.673+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(81 mds_snaptable [write 0~70] v98'20 uv20 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.673+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6adc0 2024-09-12T02:02:53.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.674+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(82 mds_snaptable [omap-set-header] v98'21 uv21 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7468023070 con 0x559348f6adc0 2024-09-12T02:02:53.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.674+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:83 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6f430 2024-09-12T02:02:53.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.675+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(83 605.00000000 [create] v98'21 uv20 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.675+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:84 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6f430 2024-09-12T02:02:53.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.676+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(84 605.00000000 [delete] v98'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.676+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6f430 2024-09-12T02:02:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.677+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(85 605.00000000 [create] v98'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.677 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:02:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.677+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6f430 2024-09-12T02:02:53.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.678+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(86 605.00000000 [setxattr (30)] v98'24 uv24 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.678+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6f430 2024-09-12T02:02:53.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.679+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(87 605.00000000 [setxattr (62)] v98'25 uv25 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.679+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6f430 2024-09-12T02:02:53.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.680+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(88 605.00000000 [omap-set-header] v98'26 uv26 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.680+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6f430 2024-09-12T02:02:53.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.680+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(89 mds0_inotable [create] v98'34 uv28 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.680+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6f430 2024-09-12T02:02:53.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.681+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(90 mds0_inotable [delete] v98'35 uv35 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.681+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f72d20 con 0x559348f6f430 2024-09-12T02:02:53.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.682+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(91 mds0_inotable [create] v98'36 uv36 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.682 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:02:53.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.682+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f73180 con 0x559348f6f430 2024-09-12T02:02:53.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.685+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(92 mds0_inotable [write 0~34] v98'37 uv37 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.685+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f73130 con 0x559348f6f430 2024-09-12T02:02:53.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.687+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v98'38 uv38 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.687+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f73130 con 0x559348f6f430 2024-09-12T02:02:53.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.690+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(94 100.00000000 [create] v98'39 uv33 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.690+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f73130 con 0x559348f6f430 2024-09-12T02:02:53.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.693+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(95 100.00000000 [delete] v98'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.693+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f73130 con 0x559348f6f430 2024-09-12T02:02:53.695 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:02:53.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.695+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(96 100.00000000 [create] v98'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.695+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f73130 con 0x559348f6f430 2024-09-12T02:02:53.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.698+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(97 100.00000000 [omap-set-header] v98'42 uv42 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.698+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75f40 con 0x559348f6f430 2024-09-12T02:02:53.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.700+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v98'43 uv43 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.701+0000 7f7470721f40 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x559348f73af0 0x559348f76330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.701+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:99 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f73af0 2024-09-12T02:02:53.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.701+0000 7f746cfce640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x559348f73af0 0x559348f76330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.701+0000 7f746cfce640 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x559348f73af0 0x559348f76330 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:53.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.702+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(99 mds0_sessionmap [create] v98'18 uv17 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f73af0 2024-09-12T02:02:53.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.702+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:100 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f73af0 2024-09-12T02:02:53.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.704+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(100 mds0_sessionmap [delete] v98'19 uv19 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f73af0 2024-09-12T02:02:53.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.704+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f73af0 2024-09-12T02:02:53.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.705+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(101 mds0_sessionmap [create] v98'20 uv20 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f73af0 2024-09-12T02:02:53.705 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:02:53.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.705+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f73af0 2024-09-12T02:02:53.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.706+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v98'21 uv21 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f73af0 2024-09-12T02:02:53.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.706+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:103 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f6f430 2024-09-12T02:02:53.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.707+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(103 609.00000000 [create] v98'21 uv20 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.707+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:104 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f6f430 2024-09-12T02:02:53.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.708+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(104 609.00000000 [delete] v98'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.708+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f6f430 2024-09-12T02:02:53.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.709+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(105 609.00000000 [create] v98'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.710 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:02:53.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.710+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f6f430 2024-09-12T02:02:53.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.711+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v98'24 uv24 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.711+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f6f430 2024-09-12T02:02:53.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.712+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v98'25 uv25 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.712+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f6f430 2024-09-12T02:02:53.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.712+0000 7f746d7cf640 1 -- 172.21.15.19:0/1568284557 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(108 609.00000000 [omap-set-header] v98'26 uv26 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7460012930 con 0x559348f6f430 2024-09-12T02:02:53.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.713+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:109 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f67940 2024-09-12T02:02:53.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.714+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(109 400.00000000 [create] v98'17 uv16 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.714+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:110 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f67940 2024-09-12T02:02:53.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.715+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(110 400.00000000 [delete] v98'18 uv18 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.715+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f67940 2024-09-12T02:02:53.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.717+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(111 400.00000000 [create] v98'19 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.716 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:02:53.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.717+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f67940 2024-09-12T02:02:53.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.717+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(112 400.00000000 [write 0~22] v98'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.717+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f67940 2024-09-12T02:02:53.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.719+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(113 400.00000000 [omap-set-header] v98'21 uv21 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.719+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f67940 2024-09-12T02:02:53.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.720+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(114 100.00000000.inode [create] v98'45 uv37 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.720+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f67940 2024-09-12T02:02:53.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.721+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(115 100.00000000.inode [delete] v98'46 uv46 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.721+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f67940 2024-09-12T02:02:53.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.722+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(116 100.00000000.inode [create] v98'47 uv47 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.722 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:02:53.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.722+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f67940 2024-09-12T02:02:53.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.723+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v98'48 uv48 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.723+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f67940 2024-09-12T02:02:53.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.724+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v98'49 uv49 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.724+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f67940 2024-09-12T02:02:53.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.725+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(119 1.00000000 [create] v98'50 uv44 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.725+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f67940 2024-09-12T02:02:53.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.726+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(120 1.00000000 [delete] v98'51 uv51 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.726+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f67940 2024-09-12T02:02:53.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.727+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(121 1.00000000 [create] v98'52 uv52 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.727 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:02:53.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.727+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f67940 2024-09-12T02:02:53.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.728+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v98'53 uv53 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.728+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f67940 2024-09-12T02:02:53.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.728+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v98'54 uv54 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.728+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f75ee0 con 0x559348f67940 2024-09-12T02:02:53.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.729+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(124 1.00000000 [omap-set-header] v98'55 uv55 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.729+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x559348f76890 con 0x559348f67940 2024-09-12T02:02:53.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.730+0000 7f746cfce640 1 -- 172.21.15.19:0/1568284557 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v98'56 uv56 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7464057030 con 0x559348f67940 2024-09-12T02:02:53.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.730+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559348f622d0 msgr2=0x559348f646c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.730+0000 7f7470721f40 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559348f622d0 0x559348f646c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.730+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x559348f4dac0 msgr2=0x559348f47b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.730+0000 7f7470721f40 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x559348f4dac0 0x559348f47b00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.730+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x559348f6adc0 msgr2=0x559348f6d1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.730+0000 7f7470721f40 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x559348f6adc0 0x559348f6d1f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.730+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x559348f73af0 msgr2=0x559348f76330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.730+0000 7f7470721f40 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x559348f73af0 0x559348f76330 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.730+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x559348f67940 msgr2=0x559348f69d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.730+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 reap_dead start 2024-09-12T02:02:53.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.730+0000 7f7470721f40 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x559348f67940 0x559348f69d30 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.731+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559348f6f430 msgr2=0x559348f71820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.731+0000 7f7470721f40 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559348f6f430 0x559348f71820 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.731+0000 7f746dfd0640 1 -- 172.21.15.19:0/1568284557 reap_dead start 2024-09-12T02:02:53.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.731+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f745006a810 msgr2=0x7f745006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.731+0000 7f7470721f40 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f745006a810 0x7f745006ccd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7460011480 tx=0x7f74600016f0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.731+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559348ea1080 msgr2=0x559348f4d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.731+0000 7f7470721f40 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559348ea1080 0x559348f4d580 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f746800f540 tx=0x7f746800fa00 comp rx=0 tx=0).stop 2024-09-12T02:02:53.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.731+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 shutdown_connections 2024-09-12T02:02:53.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.731+0000 7f7470721f40 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f745006a810 0x7f745006ccd0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.731+0000 7f7470721f40 1 --2- 172.21.15.19:0/1568284557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559348ea1080 0x559348f4d580 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.731+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 >> 172.21.15.19:0/1568284557 conn(0x559348de69e0 msgr2=0x559348e2aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:53.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.731+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 shutdown_connections 2024-09-12T02:02:53.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.731+0000 7f7470721f40 1 -- 172.21.15.19:0/1568284557 wait complete. 2024-09-12T02:02:53.734 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 200.00000000 2024-09-12T02:02:53.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.777+0000 7f2c7000ef40 1 Processor -- start 2024-09-12T02:02:53.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.777+0000 7f2c7000ef40 1 -- start start 2024-09-12T02:02:53.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.778+0000 7f2c7000ef40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718a4b640 0x55e718acdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.778+0000 7f2c7000ef40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e718ad7d20 0x55e718ad9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.778+0000 7f2c7000ef40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e718ad8100 0x55e718ada450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.778+0000 7f2c7000ef40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e718954510 con 0x55e718ad7d20 2024-09-12T02:02:53.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.778+0000 7f2c7000ef40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e7189adc50 con 0x55e718a4b640 2024-09-12T02:02:53.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.778+0000 7f2c7000ef40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55e718a4c6b0 con 0x55e718ad8100 2024-09-12T02:02:53.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.778+0000 7f2c6c596640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e718ad7d20 0x55e718ad9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.778+0000 7f2c6c596640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e718ad7d20 0x55e718ad9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38108/0 (socket says 172.21.15.19:38108) 2024-09-12T02:02:53.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.778+0000 7f2c6c596640 1 -- 172.21.15.19:0/3013587483 learned_addr learned my addr 172.21.15.19:0/3013587483 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:53.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.778+0000 7f2c6c596640 1 -- 172.21.15.19:0/3013587483 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e718ad8100 msgr2=0x55e718ada450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:53.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.778+0000 7f2c6d598640 1 --2- 172.21.15.19:0/3013587483 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e718ad8100 0x55e718ada450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.778+0000 7f2c6c596640 1 --2- 172.21.15.19:0/3013587483 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e718ad8100 0x55e718ada450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.778+0000 7f2c6c596640 1 -- 172.21.15.19:0/3013587483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718a4b640 msgr2=0x55e718acdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:53.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.778+0000 7f2c6c596640 1 --2- 172.21.15.19:0/3013587483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718a4b640 0x55e718acdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.778+0000 7f2c6c596640 1 -- 172.21.15.19:0/3013587483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e718a30ba0 con 0x55e718ad7d20 2024-09-12T02:02:53.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.778+0000 7f2c6c596640 1 --2- 172.21.15.19:0/3013587483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e718ad7d20 0x55e718ad9f10 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f2c54005cf0 tx=0x7f2c54051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634ac036f3f962fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:53.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.779+0000 7f2c6b594640 1 -- 172.21.15.19:0/3013587483 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c54069070 con 0x55e718ad7d20 2024-09-12T02:02:53.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.779+0000 7f2c6b594640 1 -- 172.21.15.19:0/3013587483 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c54052bb0 con 0x55e718ad7d20 2024-09-12T02:02:53.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.779+0000 7f2c6b594640 1 -- 172.21.15.19:0/3013587483 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5405b420 con 0x55e718ad7d20 2024-09-12T02:02:53.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.779+0000 7f2c7000ef40 1 -- 172.21.15.19:0/3013587483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e718ad7d20 msgr2=0x55e718ad9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.779+0000 7f2c7000ef40 1 --2- 172.21.15.19:0/3013587483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e718ad7d20 0x55e718ad9f10 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f2c54005cf0 tx=0x7f2c54051000 comp rx=0 tx=0).stop 2024-09-12T02:02:53.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.779+0000 7f2c7000ef40 1 -- 172.21.15.19:0/3013587483 shutdown_connections 2024-09-12T02:02:53.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.779+0000 7f2c7000ef40 1 --2- 172.21.15.19:0/3013587483 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e718ad8100 0x55e718ada450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.779+0000 7f2c7000ef40 1 --2- 172.21.15.19:0/3013587483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e718ad7d20 0x55e718ad9f10 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.779+0000 7f2c7000ef40 1 --2- 172.21.15.19:0/3013587483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718a4b640 0x55e718acdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.779+0000 7f2c7000ef40 1 -- 172.21.15.19:0/3013587483 >> 172.21.15.19:0/3013587483 conn(0x55e718a30490 msgr2=0x55e718a05e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:53.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.779+0000 7f2c7000ef40 1 -- 172.21.15.19:0/3013587483 shutdown_connections 2024-09-12T02:02:53.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.779+0000 7f2c7000ef40 1 -- 172.21.15.19:0/3013587483 wait complete. 2024-09-12T02:02:53.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.780+0000 7f2c7000ef40 1 Processor -- start 2024-09-12T02:02:53.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.780+0000 7f2c7000ef40 1 -- start start 2024-09-12T02:02:53.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.780+0000 7f2c7000ef40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e718a4b640 0x55e718b70b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.780+0000 7f2c7000ef40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e718ad7d20 0x55e718accaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.780+0000 7f2c7000ef40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718ad8100 0x55e718acd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.780+0000 7f2c7000ef40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e718ad8660 con 0x55e718a4b640 2024-09-12T02:02:53.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.780+0000 7f2c7000ef40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e718a4ba80 con 0x55e718ad8100 2024-09-12T02:02:53.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.780+0000 7f2c7000ef40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55e718ad58d0 con 0x55e718ad7d20 2024-09-12T02:02:53.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.781+0000 7f2c6cd97640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e718a4b640 0x55e718b70b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.781+0000 7f2c6cd97640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e718a4b640 0x55e718b70b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38112/0 (socket says 172.21.15.19:38112) 2024-09-12T02:02:53.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.781+0000 7f2c6cd97640 1 -- 172.21.15.19:0/1692900564 learned_addr learned my addr 172.21.15.19:0/1692900564 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:53.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.781+0000 7f2c6d598640 1 --2- 172.21.15.19:0/1692900564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718ad8100 0x55e718acd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.781+0000 7f2c6cd97640 1 -- 172.21.15.19:0/1692900564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e718ad7d20 msgr2=0x55e718accaf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:02:53.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.781+0000 7f2c6cd97640 1 --2- 172.21.15.19:0/1692900564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e718ad7d20 0x55e718accaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.781+0000 7f2c6cd97640 1 -- 172.21.15.19:0/1692900564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718ad8100 msgr2=0x55e718acd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.781+0000 7f2c6cd97640 1 --2- 172.21.15.19:0/1692900564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718ad8100 0x55e718acd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.781+0000 7f2c6cd97640 1 -- 172.21.15.19:0/1692900564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e718ad9800 con 0x55e718a4b640 2024-09-12T02:02:53.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.781+0000 7f2c6cd97640 1 --2- 172.21.15.19:0/1692900564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e718a4b640 0x55e718b70b50 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0021f0 tx=0x7f2c5c00b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:53.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.781+0000 7f2c6a592640 1 -- 172.21.15.19:0/1692900564 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c0062d0 con 0x55e718a4b640 2024-09-12T02:02:53.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.781+0000 7f2c6a592640 1 -- 172.21.15.19:0/1692900564 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c5c003450 con 0x55e718a4b640 2024-09-12T02:02:53.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.781+0000 7f2c7000ef40 1 -- 172.21.15.19:0/1692900564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e718adae50 con 0x55e718a4b640 2024-09-12T02:02:53.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.781+0000 7f2c6a592640 1 -- 172.21.15.19:0/1692900564 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c003880 con 0x55e718a4b640 2024-09-12T02:02:53.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.781+0000 7f2c7000ef40 1 -- 172.21.15.19:0/1692900564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e718acc5d0 con 0x55e718a4b640 2024-09-12T02:02:53.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.783+0000 7f2c6a592640 1 -- 172.21.15.19:0/1692900564 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c5c010070 con 0x55e718a4b640 2024-09-12T02:02:53.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.783+0000 7f2c6a592640 1 --2- 172.21.15.19:0/1692900564 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2c4c06a9b0 0x7f2c4c06ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.783+0000 7f2c6a592640 1 -- 172.21.15.19:0/1692900564 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6561+0+0 (secure 0 0 0) 0x7f2c5c089890 con 0x55e718a4b640 2024-09-12T02:02:53.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.783+0000 7f2c6c596640 1 --2- 172.21.15.19:0/1692900564 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2c4c06a9b0 0x7f2c4c06ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.783+0000 7f2c7000ef40 1 --2- 172.21.15.19:0/1692900564 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55e718aca800 0x55e718acabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.783+0000 7f2c7000ef40 1 -- 172.21.15.19:0/1692900564 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:1 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x55e718a029e0 con 0x55e718aca800 2024-09-12T02:02:53.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.783+0000 7f2c6d598640 1 --2- 172.21.15.19:0/1692900564 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55e718aca800 0x55e718acabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.784+0000 7f2c6c596640 1 --2- 172.21.15.19:0/1692900564 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2c4c06a9b0 0x7f2c4c06ce70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55e718a49d30 tx=0x7f2c54053000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:53.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.784+0000 7f2c6d598640 1 --2- 172.21.15.19:0/1692900564 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55e718aca800 0x55e718acabe0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:53.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.785+0000 7f2c6d598640 1 -- 172.21.15.19:0/1692900564 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(1 200.00000000 [delete] v98'109 uv109 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2c6400b790 con 0x55e718aca800 2024-09-12T02:02:53.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.785+0000 7f2c7000ef40 1 -- 172.21.15.19:0/1692900564 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55e718aca800 msgr2=0x55e718acabe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.785+0000 7f2c7000ef40 1 --2- 172.21.15.19:0/1692900564 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55e718aca800 0x55e718acabe0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.785+0000 7f2c7000ef40 1 -- 172.21.15.19:0/1692900564 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2c4c06a9b0 msgr2=0x7f2c4c06ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.785+0000 7f2c7000ef40 1 --2- 172.21.15.19:0/1692900564 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2c4c06a9b0 0x7f2c4c06ce70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55e718a49d30 tx=0x7f2c54053000 comp rx=0 tx=0).stop 2024-09-12T02:02:53.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.785+0000 7f2c7000ef40 1 -- 172.21.15.19:0/1692900564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e718a4b640 msgr2=0x55e718b70b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.785+0000 7f2c7000ef40 1 --2- 172.21.15.19:0/1692900564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e718a4b640 0x55e718b70b50 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0021f0 tx=0x7f2c5c00b570 comp rx=0 tx=0).stop 2024-09-12T02:02:53.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.785+0000 7f2c6d598640 1 -- 172.21.15.19:0/1692900564 reap_dead start 2024-09-12T02:02:53.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.785+0000 7f2c7000ef40 1 -- 172.21.15.19:0/1692900564 shutdown_connections 2024-09-12T02:02:53.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.785+0000 7f2c7000ef40 1 -- 172.21.15.19:0/1692900564 >> 172.21.15.19:0/1692900564 conn(0x55e718a30490 msgr2=0x55e718acddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:53.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.785+0000 7f2c7000ef40 1 -- 172.21.15.19:0/1692900564 shutdown_connections 2024-09-12T02:02:53.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.785+0000 7f2c7000ef40 1 -- 172.21.15.19:0/1692900564 wait complete. 2024-09-12T02:02:53.789 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:02:53.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.933+0000 7fce40f86640 1 Processor -- start 2024-09-12T02:02:53.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.933+0000 7fce40f86640 1 -- start start 2024-09-12T02:02:53.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.934+0000 7fce40f86640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c162340 0x7fce3c06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.934+0000 7fce40f86640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce3c0cf280 0x7fce3c162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.934+0000 7fce40f86640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce3c162c60 0x7fce3c0d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.934+0000 7fce40f86640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fce3c06de90 con 0x7fce3c162c60 2024-09-12T02:02:53.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.934+0000 7fce40f86640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fce3c15ff70 con 0x7fce3c0cf280 2024-09-12T02:02:53.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.934+0000 7fce40f86640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fce3c0d4d10 con 0x7fce3c162340 2024-09-12T02:02:53.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.934+0000 7fce3ad9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce3c162c60 0x7fce3c0d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.934+0000 7fce3ad9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce3c162c60 0x7fce3c0d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38116/0 (socket says 172.21.15.19:38116) 2024-09-12T02:02:53.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.934+0000 7fce3ad9d640 1 -- 172.21.15.19:0/2446370856 learned_addr learned my addr 172.21.15.19:0/2446370856 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:53.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.935+0000 7fce39d9b640 1 --2- 172.21.15.19:0/2446370856 >> v2:172.21.15.135:3300/0 conn(0x7fce3c0cf280 0x7fce3c162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.935+0000 7fce3a59c640 1 --2- 172.21.15.19:0/2446370856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c162340 0x7fce3c06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.935+0000 7fce3ad9d640 1 -- 172.21.15.19:0/2446370856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c162340 msgr2=0x7fce3c06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:53.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.935+0000 7fce3ad9d640 1 --2- 172.21.15.19:0/2446370856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c162340 0x7fce3c06d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.935+0000 7fce3ad9d640 1 -- 172.21.15.19:0/2446370856 >> v2:172.21.15.135:3300/0 conn(0x7fce3c0cf280 msgr2=0x7fce3c162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:53.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.935+0000 7fce3ad9d640 1 --2- 172.21.15.19:0/2446370856 >> v2:172.21.15.135:3300/0 conn(0x7fce3c0cf280 0x7fce3c162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.935+0000 7fce3ad9d640 1 -- 172.21.15.19:0/2446370856 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c0d4ff0 con 0x7fce3c162c60 2024-09-12T02:02:53.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.935+0000 7fce3ad9d640 1 --2- 172.21.15.19:0/2446370856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3c162c60 0x7fce3c0d2990 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fce3c08d200 tx=0x7fce2c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7624fc0d154f02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:53.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.936+0000 7fce3959a640 1 -- 172.21.15.19:0/2446370856 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c036070 con 0x7fce3c162c60 2024-09-12T02:02:53.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.936+0000 7fce3959a640 1 -- 172.21.15.19:0/2446370856 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce2c031600 con 0x7fce3c162c60 2024-09-12T02:02:53.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.936+0000 7fce3959a640 1 -- 172.21.15.19:0/2446370856 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0319d0 con 0x7fce3c162c60 2024-09-12T02:02:53.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.936+0000 7fce40f86640 1 -- 172.21.15.19:0/2446370856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3c162c60 msgr2=0x7fce3c0d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.936+0000 7fce40f86640 1 --2- 172.21.15.19:0/2446370856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3c162c60 0x7fce3c0d2990 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fce3c08d200 tx=0x7fce2c02a610 comp rx=0 tx=0).stop 2024-09-12T02:02:53.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.936+0000 7fce40f86640 1 -- 172.21.15.19:0/2446370856 shutdown_connections 2024-09-12T02:02:53.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.936+0000 7fce40f86640 1 --2- 172.21.15.19:0/2446370856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3c162c60 0x7fce3c0d2990 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.936+0000 7fce40f86640 1 --2- 172.21.15.19:0/2446370856 >> v2:172.21.15.135:3300/0 conn(0x7fce3c0cf280 0x7fce3c162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.936+0000 7fce40f86640 1 --2- 172.21.15.19:0/2446370856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c162340 0x7fce3c06d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.936+0000 7fce40f86640 1 -- 172.21.15.19:0/2446370856 >> 172.21.15.19:0/2446370856 conn(0x7fce3c08bfc0 msgr2=0x7fce3c0d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:53.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.936+0000 7fce40f86640 1 -- 172.21.15.19:0/2446370856 shutdown_connections 2024-09-12T02:02:53.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.936+0000 7fce40f86640 1 -- 172.21.15.19:0/2446370856 wait complete. 2024-09-12T02:02:53.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.938+0000 7fce40f86640 1 Processor -- start 2024-09-12T02:02:53.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.938+0000 7fce40f86640 1 -- start start 2024-09-12T02:02:53.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.938+0000 7fce40f86640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c0cf280 0x7fce3c153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.938+0000 7fce40f86640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce3c162340 0x7fce3c15bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.938+0000 7fce40f86640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3c162c60 0x7fce3c15bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.938+0000 7fce40f86640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c0cf6c0 con 0x7fce3c162c60 2024-09-12T02:02:53.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.938+0000 7fce40f86640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c0d52d0 con 0x7fce3c162340 2024-09-12T02:02:53.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.938+0000 7fce40f86640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fce3c163110 con 0x7fce3c0cf280 2024-09-12T02:02:53.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.939+0000 7fce3ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3c162c60 0x7fce3c15bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.939+0000 7fce3ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3c162c60 0x7fce3c15bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38126/0 (socket says 172.21.15.19:38126) 2024-09-12T02:02:53.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.939+0000 7fce3ad9d640 1 -- 172.21.15.19:0/3317348336 learned_addr learned my addr 172.21.15.19:0/3317348336 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:53.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.939+0000 7fce3a59c640 1 --2- 172.21.15.19:0/3317348336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c0cf280 0x7fce3c153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.939+0000 7fce39d9b640 1 --2- 172.21.15.19:0/3317348336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce3c162340 0x7fce3c15bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.939+0000 7fce3ad9d640 1 -- 172.21.15.19:0/3317348336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c0cf280 msgr2=0x7fce3c153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.939+0000 7fce3ad9d640 1 --2- 172.21.15.19:0/3317348336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c0cf280 0x7fce3c153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.939+0000 7fce3ad9d640 1 -- 172.21.15.19:0/3317348336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce3c162340 msgr2=0x7fce3c15bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:53.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.939+0000 7fce3ad9d640 1 --2- 172.21.15.19:0/3317348336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce3c162340 0x7fce3c15bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:53.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.939+0000 7fce3ad9d640 1 -- 172.21.15.19:0/3317348336 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c0cbb60 con 0x7fce3c162c60 2024-09-12T02:02:53.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.939+0000 7fce3ad9d640 1 --2- 172.21.15.19:0/3317348336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3c162c60 0x7fce3c15bff0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fce2c034040 tx=0x7fce2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:53.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.939+0000 7fce32ffd640 1 -- 172.21.15.19:0/3317348336 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c041070 con 0x7fce3c162c60 2024-09-12T02:02:53.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.939+0000 7fce32ffd640 1 -- 172.21.15.19:0/3317348336 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce2c03c650 con 0x7fce3c162c60 2024-09-12T02:02:53.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.939+0000 7fce32ffd640 1 -- 172.21.15.19:0/3317348336 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c036040 con 0x7fce3c162c60 2024-09-12T02:02:53.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.939+0000 7fce40f86640 1 -- 172.21.15.19:0/3317348336 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3c0cbe40 con 0x7fce3c162c60 2024-09-12T02:02:53.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.939+0000 7fce40f86640 1 -- 172.21.15.19:0/3317348336 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3c0cc400 con 0x7fce3c162c60 2024-09-12T02:02:53.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.941+0000 7fce40f86640 1 -- 172.21.15.19:0/3317348336 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce3c162720 con 0x7fce3c162c60 2024-09-12T02:02:53.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.941+0000 7fce32ffd640 1 -- 172.21.15.19:0/3317348336 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce2c044070 con 0x7fce3c162c60 2024-09-12T02:02:53.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.941+0000 7fce32ffd640 1 --2- 172.21.15.19:0/3317348336 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce1c06be30 0x7fce1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:53.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.942+0000 7fce32ffd640 1 -- 172.21.15.19:0/3317348336 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6561+0+0 (secure 0 0 0) 0x7fce2c0aba10 con 0x7fce3c162c60 2024-09-12T02:02:53.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.942+0000 7fce3a59c640 1 --2- 172.21.15.19:0/3317348336 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce1c06be30 0x7fce1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:53.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.942+0000 7fce3a59c640 1 --2- 172.21.15.19:0/3317348336 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce1c06be30 0x7fce1c06e2f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fce34009aa0 tx=0x7fce34009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:53.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:53.946+0000 7fce32ffd640 1 -- 172.21.15.19:0/3317348336 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce2c079bc0 con 0x7fce3c162c60 2024-09-12T02:02:54.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.156+0000 7fce40f86640 1 -- 172.21.15.19:0/3317348336 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fce3c0ba450 con 0x7fce3c162c60 2024-09-12T02:02:54.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.477+0000 7fce32ffd640 1 -- 172.21.15.19:0/3317348336 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v101) ==== 162+0+0 (secure 0 0 0) 0x7fce2c07dec0 con 0x7fce3c162c60 2024-09-12T02:02:54.478 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:02:54.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.479+0000 7fce40f86640 1 -- 172.21.15.19:0/3317348336 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce1c06be30 msgr2=0x7fce1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:54.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.479+0000 7fce40f86640 1 --2- 172.21.15.19:0/3317348336 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce1c06be30 0x7fce1c06e2f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fce34009aa0 tx=0x7fce34009190 comp rx=0 tx=0).stop 2024-09-12T02:02:54.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.479+0000 7fce40f86640 1 -- 172.21.15.19:0/3317348336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3c162c60 msgr2=0x7fce3c15bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:54.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.479+0000 7fce40f86640 1 --2- 172.21.15.19:0/3317348336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3c162c60 0x7fce3c15bff0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fce2c034040 tx=0x7fce2c004a40 comp rx=0 tx=0).stop 2024-09-12T02:02:54.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.479+0000 7fce40f86640 1 -- 172.21.15.19:0/3317348336 shutdown_connections 2024-09-12T02:02:54.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.479+0000 7fce40f86640 1 --2- 172.21.15.19:0/3317348336 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce1c06be30 0x7fce1c06e2f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:54.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.479+0000 7fce40f86640 1 --2- 172.21.15.19:0/3317348336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3c162c60 0x7fce3c15bff0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:54.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.479+0000 7fce40f86640 1 --2- 172.21.15.19:0/3317348336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce3c162340 0x7fce3c15bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:54.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.479+0000 7fce40f86640 1 --2- 172.21.15.19:0/3317348336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c0cf280 0x7fce3c153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:54.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.479+0000 7fce40f86640 1 -- 172.21.15.19:0/3317348336 >> 172.21.15.19:0/3317348336 conn(0x7fce3c08bfc0 msgr2=0x7fce3c0cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:54.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.479+0000 7fce40f86640 1 -- 172.21.15.19:0/3317348336 shutdown_connections 2024-09-12T02:02:54.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.479+0000 7fce40f86640 1 -- 172.21.15.19:0/3317348336 wait complete. 2024-09-12T02:02:54.486 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:02:54.486+0000 7fa8daaa7640 -1 log_channel(cluster) log [ERR] : Error recovering journal 0x200: (2) No such file or directory 2024-09-12T02:02:54.487 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:02:54.487+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:02:54.487 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:02:54.487+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:02:54.493 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:54.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.595+0000 7f0d13a2e640 1 Processor -- start 2024-09-12T02:02:54.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.596+0000 7f0d13a2e640 1 -- start start 2024-09-12T02:02:54.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.596+0000 7f0d13a2e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d0c162060 0x7f0d0c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:54.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.596+0000 7f0d13a2e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0d0c0b64b0 0x7f0d0c0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:54.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.596+0000 7f0d13a2e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d0c06d9f0 con 0x7f0d0c161c80 2024-09-12T02:02:54.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.596+0000 7f0d13a2e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f0d0c06dcd0 con 0x7f0d0c0b64b0 2024-09-12T02:02:54.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.596+0000 7f0d13a2e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0c06dfb0 con 0x7f0d0c162060 2024-09-12T02:02:54.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.597+0000 7f0d11fcb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0d0c0b64b0 0x7f0d0c0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:54.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.597+0000 7f0d11fcb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0d0c0b64b0 0x7f0d0c0b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38128/0 (socket says 172.21.15.19:38128) 2024-09-12T02:02:54.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.597+0000 7f0d11fcb640 1 -- 172.21.15.19:0/1271071006 learned_addr learned my addr 172.21.15.19:0/1271071006 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:54.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.597+0000 7f0d10fc9640 1 --2- 172.21.15.19:0/1271071006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d0c162060 0x7f0d0c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:54.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.597+0000 7f0d11fcb640 1 -- 172.21.15.19:0/1271071006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d0c162060 msgr2=0x7f0d0c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:54.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.597+0000 7f0d11fcb640 1 --2- 172.21.15.19:0/1271071006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d0c162060 0x7f0d0c0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:54.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.597+0000 7f0d11fcb640 1 -- 172.21.15.19:0/1271071006 >> v1:172.21.15.135:6789/0 conn(0x7f0d0c161c80 legacy=0x7f0d0c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:54.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.597+0000 7f0d11fcb640 1 -- 172.21.15.19:0/1271071006 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0c0d01f0 con 0x7f0d0c0b64b0 2024-09-12T02:02:54.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.598+0000 7f0d11fcb640 1 --2- 172.21.15.19:0/1271071006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d0c0b64b0 0x7f0d0c0b6960 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f0d04009870 tx=0x7f0d0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5579b2b37ba0e0a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:54.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.598+0000 7f0d0bfff640 1 -- 172.21.15.19:0/1271071006 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d04037070 con 0x7f0d0c0b64b0 2024-09-12T02:02:54.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.598+0000 7f0d0bfff640 1 -- 172.21.15.19:0/1271071006 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d04032440 con 0x7f0d0c0b64b0 2024-09-12T02:02:54.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.598+0000 7f0d0bfff640 1 -- 172.21.15.19:0/1271071006 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d04032810 con 0x7f0d0c0b64b0 2024-09-12T02:02:54.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.598+0000 7f0d13a2e640 1 -- 172.21.15.19:0/1271071006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d0c0b64b0 msgr2=0x7f0d0c0b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:54.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.598+0000 7f0d13a2e640 1 --2- 172.21.15.19:0/1271071006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d0c0b64b0 0x7f0d0c0b6960 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f0d04009870 tx=0x7f0d0402a270 comp rx=0 tx=0).stop 2024-09-12T02:02:54.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.598+0000 7f0d13a2e640 1 -- 172.21.15.19:0/1271071006 shutdown_connections 2024-09-12T02:02:54.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.598+0000 7f0d13a2e640 1 --2- 172.21.15.19:0/1271071006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d0c0b64b0 0x7f0d0c0b6960 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:54.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.598+0000 7f0d13a2e640 1 --2- 172.21.15.19:0/1271071006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d0c162060 0x7f0d0c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:54.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.598+0000 7f0d13a2e640 1 -- 172.21.15.19:0/1271071006 >> 172.21.15.19:0/1271071006 conn(0x7f0d0c0d44f0 msgr2=0x7f0d0c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:54.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.598+0000 7f0d13a2e640 1 -- 172.21.15.19:0/1271071006 shutdown_connections 2024-09-12T02:02:54.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.599+0000 7f0d13a2e640 1 -- 172.21.15.19:0/1271071006 wait complete. 2024-09-12T02:02:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.600+0000 7f0d13a2e640 1 Processor -- start 2024-09-12T02:02:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.600+0000 7f0d13a2e640 1 -- start start 2024-09-12T02:02:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.600+0000 7f0d13a2e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d0c0b64b0 0x7f0d0c1598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.600+0000 7f0d13a2e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d0c161c80 0x7f0d0c0c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.600+0000 7f0d13a2e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d0c162060 0x7f0d0c0c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.600+0000 7f0d13a2e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c0cf1e0 con 0x7f0d0c161c80 2024-09-12T02:02:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.600+0000 7f0d13a2e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c0d2aa0 con 0x7f0d0c162060 2024-09-12T02:02:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.600+0000 7f0d13a2e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0c0cf360 con 0x7f0d0c0b64b0 2024-09-12T02:02:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.601+0000 7f0d10fc9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d0c161c80 0x7f0d0c0c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.601+0000 7f0d10fc9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d0c161c80 0x7f0d0c0c9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38130/0 (socket says 172.21.15.19:38130) 2024-09-12T02:02:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.601+0000 7f0d10fc9640 1 -- 172.21.15.19:0/3623481767 learned_addr learned my addr 172.21.15.19:0/3623481767 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.601+0000 7f0d11fcb640 1 --2- 172.21.15.19:0/3623481767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d0c162060 0x7f0d0c0c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.601+0000 7f0d117ca640 1 --2- 172.21.15.19:0/3623481767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d0c0b64b0 0x7f0d0c1598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.601+0000 7f0d10fc9640 1 -- 172.21.15.19:0/3623481767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d0c0b64b0 msgr2=0x7f0d0c1598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.601+0000 7f0d10fc9640 1 --2- 172.21.15.19:0/3623481767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d0c0b64b0 0x7f0d0c1598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.601+0000 7f0d10fc9640 1 -- 172.21.15.19:0/3623481767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d0c162060 msgr2=0x7f0d0c0c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.601+0000 7f0d10fc9640 1 --2- 172.21.15.19:0/3623481767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d0c162060 0x7f0d0c0c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.601+0000 7f0d10fc9640 1 -- 172.21.15.19:0/3623481767 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0c0c8a30 con 0x7f0d0c161c80 2024-09-12T02:02:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.601+0000 7f0d117ca640 1 --2- 172.21.15.19:0/3623481767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d0c0b64b0 0x7f0d0c1598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.601+0000 7f0d10fc9640 1 --2- 172.21.15.19:0/3623481767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d0c161c80 0x7f0d0c0c9ad0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000d5a0 tx=0x7f0d0000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.601+0000 7f0d09ffb640 1 -- 172.21.15.19:0/3623481767 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d000125f0 con 0x7f0d0c161c80 2024-09-12T02:02:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.601+0000 7f0d09ffb640 1 -- 172.21.15.19:0/3623481767 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d00019070 con 0x7f0d0c161c80 2024-09-12T02:02:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.601+0000 7f0d13a2e640 1 -- 172.21.15.19:0/3623481767 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0c0c8d10 con 0x7f0d0c161c80 2024-09-12T02:02:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.601+0000 7f0d09ffb640 1 -- 172.21.15.19:0/3623481767 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d000129d0 con 0x7f0d0c161c80 2024-09-12T02:02:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.602+0000 7f0d13a2e640 1 -- 172.21.15.19:0/3623481767 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d0c0c92d0 con 0x7f0d0c161c80 2024-09-12T02:02:54.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.602+0000 7f0d13a2e640 1 -- 172.21.15.19:0/3623481767 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d0c0b5f70 con 0x7f0d0c161c80 2024-09-12T02:02:54.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.603+0000 7f0d09ffb640 1 -- 172.21.15.19:0/3623481767 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d00012b70 con 0x7f0d0c161c80 2024-09-12T02:02:54.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.603+0000 7f0d09ffb640 1 --2- 172.21.15.19:0/3623481767 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0cf806be30 0x7f0cf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:54.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.603+0000 7f0d09ffb640 1 -- 172.21.15.19:0/3623481767 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6647+0+0 (secure 0 0 0) 0x7f0d0008b340 con 0x7f0d0c161c80 2024-09-12T02:02:54.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.603+0000 7f0d117ca640 1 --2- 172.21.15.19:0/3623481767 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0cf806be30 0x7f0cf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:54.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.604+0000 7f0d117ca640 1 --2- 172.21.15.19:0/3623481767 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0cf806be30 0x7f0cf806e2f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc001e00 tx=0x7f0cfc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.607+0000 7f0d09ffb640 1 -- 172.21.15.19:0/3623481767 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d00023020 con 0x7f0d0c161c80 2024-09-12T02:02:54.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.817+0000 7f0d13a2e640 1 -- 172.21.15.19:0/3623481767 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d0c0ba470 con 0x7f0d0c161c80 2024-09-12T02:02:54.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.817+0000 7f0d09ffb640 1 -- 172.21.15.19:0/3623481767 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+3562 (secure 0 0 0) 0x7f0d000598c0 con 0x7f0d0c161c80 2024-09-12T02:02:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:54.818 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":103,"btime":"2024-09-12T02:02:54:488300+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:02:54.488225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:02:54.818 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 103 2024-09-12T02:02:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.819+0000 7f0d13a2e640 1 -- 172.21.15.19:0/3623481767 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0cf806be30 msgr2=0x7f0cf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.819+0000 7f0d13a2e640 1 --2- 172.21.15.19:0/3623481767 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0cf806be30 0x7f0cf806e2f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc001e00 tx=0x7f0cfc009040 comp rx=0 tx=0).stop 2024-09-12T02:02:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.819+0000 7f0d13a2e640 1 -- 172.21.15.19:0/3623481767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d0c161c80 msgr2=0x7f0d0c0c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.819+0000 7f0d13a2e640 1 --2- 172.21.15.19:0/3623481767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d0c161c80 0x7f0d0c0c9ad0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000d5a0 tx=0x7f0d0000da60 comp rx=0 tx=0).stop 2024-09-12T02:02:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.819+0000 7f0d13a2e640 1 -- 172.21.15.19:0/3623481767 shutdown_connections 2024-09-12T02:02:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.819+0000 7f0d13a2e640 1 --2- 172.21.15.19:0/3623481767 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0cf806be30 0x7f0cf806e2f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.819+0000 7f0d13a2e640 1 --2- 172.21.15.19:0/3623481767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d0c162060 0x7f0d0c0c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.819+0000 7f0d13a2e640 1 --2- 172.21.15.19:0/3623481767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d0c161c80 0x7f0d0c0c9ad0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.819+0000 7f0d13a2e640 1 --2- 172.21.15.19:0/3623481767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d0c0b64b0 0x7f0d0c1598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:54.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.819+0000 7f0d13a2e640 1 -- 172.21.15.19:0/3623481767 >> 172.21.15.19:0/3623481767 conn(0x7f0d0c0d44f0 msgr2=0x7f0d0c0b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:54.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.819+0000 7f0d13a2e640 1 -- 172.21.15.19:0/3623481767 shutdown_connections 2024-09-12T02:02:54.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.819+0000 7f0d13a2e640 1 -- 172.21.15.19:0/3623481767 wait complete. 2024-09-12T02:02:54.831 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:02:54.831 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.933+0000 7ff02d07b640 1 Processor -- start 2024-09-12T02:02:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.933+0000 7ff02d07b640 1 -- start start 2024-09-12T02:02:54.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff02d07b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0280d30f0 0x7ff0280b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:54.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff02d07b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0280d3690 con 0x7ff0280b64c0 2024-09-12T02:02:54.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff02d07b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0280d3970 con 0x7ff02815e5f0 2024-09-12T02:02:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff02d07b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff02806d530 con 0x7ff0280d30f0 2024-09-12T02:02:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff02759e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff0280b64c0 0x7ff02806d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40582/0 (socket says 172.21.15.19:40582) 2024-09-12T02:02:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff02759e640 1 -- 172.21.15.19:0/1067293479 learned_addr learned my addr 172.21.15.19:0/1067293479 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff02659c640 1 --2- 172.21.15.19:0/1067293479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0280d30f0 0x7ff0280b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff025d9b640 1 -- 172.21.15.19:0/1067293479 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3567811106 0 0) 0x7ff0280d3690 con 0x7ff0280b64c0 2024-09-12T02:02:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff025d9b640 1 -- 172.21.15.19:0/1067293479 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff010003520 con 0x7ff0280b64c0 2024-09-12T02:02:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff025d9b640 1 -- 172.21.15.19:0/1067293479 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1624774212 0 0) 0x7ff0280d3970 con 0x7ff02815e5f0 2024-09-12T02:02:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff025d9b640 1 -- 172.21.15.19:0/1067293479 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0280d3690 con 0x7ff02815e5f0 2024-09-12T02:02:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff025d9b640 1 -- 172.21.15.19:0/1067293479 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 881296420 0 0) 0x7ff010003520 con 0x7ff0280b64c0 2024-09-12T02:02:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff025d9b640 1 -- 172.21.15.19:0/1067293479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0280d30f0 msgr2=0x7ff0280b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:54.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff025d9b640 1 --2- 172.21.15.19:0/1067293479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0280d30f0 0x7ff0280b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:54.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff025d9b640 1 -- 172.21.15.19:0/1067293479 >> v1:172.21.15.135:6789/0 conn(0x7ff02815e5f0 legacy=0x7ff0280d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:54.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff025d9b640 1 -- 172.21.15.19:0/1067293479 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff02806cee0 con 0x7ff0280b64c0 2024-09-12T02:02:54.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff025d9b640 1 -- 172.21.15.19:0/1067293479 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7ff0200019f0 con 0x7ff0280b64c0 2024-09-12T02:02:54.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff025d9b640 1 -- 172.21.15.19:0/1067293479 >> v1:172.21.15.19:6789/0 conn(0x7ff0280b64c0 legacy=0x7ff02806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:54.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff025d9b640 1 --2- 172.21.15.19:0/1067293479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff010003b70 0x7ff010003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:54.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff025d9b640 1 --2- 172.21.15.19:0/1067293479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff010004800 0x7ff010004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:54.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff025d9b640 1 --2- 172.21.15.19:0/1067293479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0280d30f0 0x7ff0100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:54.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff025d9b640 1 -- 172.21.15.19:0/1067293479 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff02806d530 con 0x7ff010003b70 2024-09-12T02:02:54.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff025d9b640 1 -- 172.21.15.19:0/1067293479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff01000ba70 con 0x7ff010004800 2024-09-12T02:02:54.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.934+0000 7ff025d9b640 1 -- 172.21.15.19:0/1067293479 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff01000bc40 con 0x7ff0280d30f0 2024-09-12T02:02:54.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.935+0000 7ff026d9d640 1 --2- 172.21.15.19:0/1067293479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff010003b70 0x7ff010003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:54.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.935+0000 7ff02659c640 1 --2- 172.21.15.19:0/1067293479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff010004800 0x7ff010004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:54.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.935+0000 7ff02759e640 1 --2- 172.21.15.19:0/1067293479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0280d30f0 0x7ff0100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:54.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.935+0000 7ff026d9d640 1 -- 172.21.15.19:0/1067293479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0280d30f0 msgr2=0x7ff0100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:54.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.935+0000 7ff026d9d640 1 --2- 172.21.15.19:0/1067293479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0280d30f0 0x7ff0100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:54.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.935+0000 7ff026d9d640 1 -- 172.21.15.19:0/1067293479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff010004800 msgr2=0x7ff010004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:54.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.935+0000 7ff026d9d640 1 --2- 172.21.15.19:0/1067293479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff010004800 0x7ff010004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:54.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.935+0000 7ff026d9d640 1 -- 172.21.15.19:0/1067293479 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff010003520 con 0x7ff010003b70 2024-09-12T02:02:54.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.936+0000 7ff026d9d640 1 --2- 172.21.15.19:0/1067293479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff010003b70 0x7ff010003f70 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7ff0180018d0 tx=0x7ff010005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a66ba475320d00 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:54.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.936+0000 7ff025d9b640 1 -- 172.21.15.19:0/1067293479 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0180014f0 con 0x7ff010003b70 2024-09-12T02:02:54.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.936+0000 7ff025d9b640 1 -- 172.21.15.19:0/1067293479 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0180052d0 con 0x7ff010003b70 2024-09-12T02:02:54.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.936+0000 7ff025d9b640 1 -- 172.21.15.19:0/1067293479 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01802ac30 con 0x7ff010003b70 2024-09-12T02:02:54.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.936+0000 7ff02d07b640 1 -- 172.21.15.19:0/1067293479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff010003b70 msgr2=0x7ff010003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:54.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.936+0000 7ff02d07b640 1 --2- 172.21.15.19:0/1067293479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff010003b70 0x7ff010003f70 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7ff0180018d0 tx=0x7ff010005830 comp rx=0 tx=0).stop 2024-09-12T02:02:54.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.936+0000 7ff02759e640 1 -- 172.21.15.19:0/1067293479 reap_dead start 2024-09-12T02:02:54.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.936+0000 7ff02d07b640 1 -- 172.21.15.19:0/1067293479 shutdown_connections 2024-09-12T02:02:54.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.936+0000 7ff02d07b640 1 -- 172.21.15.19:0/1067293479 >> 172.21.15.19:0/1067293479 conn(0x7ff02808bfc0 msgr2=0x7ff0280d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:54.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.936+0000 7ff02d07b640 1 -- 172.21.15.19:0/1067293479 shutdown_connections 2024-09-12T02:02:54.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.936+0000 7ff02d07b640 1 -- 172.21.15.19:0/1067293479 wait complete. 2024-09-12T02:02:54.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.938+0000 7ff02d07b640 1 Processor -- start 2024-09-12T02:02:54.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.938+0000 7ff02d07b640 1 -- start start 2024-09-12T02:02:54.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.938+0000 7ff02d07b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff010003b70 0x7ff028158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:54.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.938+0000 7ff02d07b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0281f4ac0 0x7ff0281f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:54.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff02d07b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff02815cd40 0x7ff02815d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:54.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff02d07b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff0280b5f80 con 0x7ff0281f4ac0 2024-09-12T02:02:54.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff02d07b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff02815e9d0 con 0x7ff02815cd40 2024-09-12T02:02:54.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff02d07b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff0280b6100 con 0x7ff010003b70 2024-09-12T02:02:54.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff02659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0281f4ac0 0x7ff0281f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:54.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff02659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0281f4ac0 0x7ff0281f51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38152/0 (socket says 172.21.15.19:38152) 2024-09-12T02:02:54.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff02659c640 1 -- 172.21.15.19:0/2788349293 learned_addr learned my addr 172.21.15.19:0/2788349293 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:54.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff026d9d640 1 --2- 172.21.15.19:0/2788349293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff010003b70 0x7ff028158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:54.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff02759e640 1 --2- 172.21.15.19:0/2788349293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff02815cd40 0x7ff02815d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:54.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff02659c640 1 -- 172.21.15.19:0/2788349293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff010003b70 msgr2=0x7ff028158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:54.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff02659c640 1 --2- 172.21.15.19:0/2788349293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff010003b70 0x7ff028158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff02659c640 1 -- 172.21.15.19:0/2788349293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff02815cd40 msgr2=0x7ff02815d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff02659c640 1 --2- 172.21.15.19:0/2788349293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff02815cd40 0x7ff02815d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff02659c640 1 -- 172.21.15.19:0/2788349293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0280c8410 con 0x7ff0281f4ac0 2024-09-12T02:02:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff02659c640 1 --2- 172.21.15.19:0/2788349293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0281f4ac0 0x7ff0281f51c0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7ff01c011910 tx=0x7ff01c011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff00f7fe640 1 -- 172.21.15.19:0/2788349293 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c00f9d0 con 0x7ff0281f4ac0 2024-09-12T02:02:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff00f7fe640 1 -- 172.21.15.19:0/2788349293 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff01c00fb70 con 0x7ff0281f4ac0 2024-09-12T02:02:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff02d07b640 1 -- 172.21.15.19:0/2788349293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0280c86f0 con 0x7ff0281f4ac0 2024-09-12T02:02:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff00f7fe640 1 -- 172.21.15.19:0/2788349293 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c014440 con 0x7ff0281f4ac0 2024-09-12T02:02:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.939+0000 7ff02d07b640 1 -- 172.21.15.19:0/2788349293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0280c8cb0 con 0x7ff0281f4ac0 2024-09-12T02:02:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.940+0000 7ff02d07b640 1 -- 172.21.15.19:0/2788349293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0280d4dd0 con 0x7ff0281f4ac0 2024-09-12T02:02:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.941+0000 7ff00f7fe640 1 -- 172.21.15.19:0/2788349293 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff01c012040 con 0x7ff0281f4ac0 2024-09-12T02:02:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.941+0000 7ff00f7fe640 1 --2- 172.21.15.19:0/2788349293 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff01406be30 0x7ff01406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.942+0000 7ff00f7fe640 1 -- 172.21.15.19:0/2788349293 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6647+0+0 (secure 0 0 0) 0x7ff01c08b6e0 con 0x7ff0281f4ac0 2024-09-12T02:02:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.942+0000 7ff026d9d640 1 --2- 172.21.15.19:0/2788349293 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff01406be30 0x7ff01406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.942+0000 7ff026d9d640 1 --2- 172.21.15.19:0/2788349293 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff01406be30 0x7ff01406e2f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff018032000 tx=0x7ff018009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:54.946+0000 7ff00f7fe640 1 -- 172.21.15.19:0/2788349293 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff01c019030 con 0x7ff0281f4ac0 2024-09-12T02:02:55.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.161+0000 7ff02d07b640 1 -- 172.21.15.19:0/2788349293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff02806e770 con 0x7ff0281f4ac0 2024-09-12T02:02:55.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.161+0000 7ff00f7fe640 1 -- 172.21.15.19:0/2788349293 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+3562 (secure 0 0 0) 0x7ff01c01fe50 con 0x7ff0281f4ac0 2024-09-12T02:02:55.162 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:55.162 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":103,"btime":"2024-09-12T02:02:54:488300+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:02:54.488225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:02:55.162 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 103 2024-09-12T02:02:55.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.164+0000 7ff02d07b640 1 -- 172.21.15.19:0/2788349293 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff01406be30 msgr2=0x7ff01406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.164+0000 7ff02d07b640 1 --2- 172.21.15.19:0/2788349293 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff01406be30 0x7ff01406e2f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff018032000 tx=0x7ff018009030 comp rx=0 tx=0).stop 2024-09-12T02:02:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.164+0000 7ff02d07b640 1 -- 172.21.15.19:0/2788349293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0281f4ac0 msgr2=0x7ff0281f51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.164+0000 7ff02d07b640 1 --2- 172.21.15.19:0/2788349293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0281f4ac0 0x7ff0281f51c0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7ff01c011910 tx=0x7ff01c011dd0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.164+0000 7ff02d07b640 1 -- 172.21.15.19:0/2788349293 shutdown_connections 2024-09-12T02:02:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.164+0000 7ff02d07b640 1 --2- 172.21.15.19:0/2788349293 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff01406be30 0x7ff01406e2f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.164+0000 7ff02d07b640 1 --2- 172.21.15.19:0/2788349293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff02815cd40 0x7ff02815d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.164+0000 7ff02d07b640 1 --2- 172.21.15.19:0/2788349293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0281f4ac0 0x7ff0281f51c0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.164+0000 7ff02d07b640 1 --2- 172.21.15.19:0/2788349293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff010003b70 0x7ff028158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.164+0000 7ff02d07b640 1 -- 172.21.15.19:0/2788349293 >> 172.21.15.19:0/2788349293 conn(0x7ff02808bfc0 msgr2=0x7ff0280b56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.164+0000 7ff02d07b640 1 -- 172.21.15.19:0/2788349293 shutdown_connections 2024-09-12T02:02:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.164+0000 7ff02d07b640 1 -- 172.21.15.19:0/2788349293 wait complete. 2024-09-12T02:02:55.176 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:02:55.176 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:55.221 INFO:tasks.ceph.mds.c.smithi019.stderr: -35> 2024-09-12T02:02:50.469+0000 7f27d2771640 -1 mds.0.cache.ino(0x1) No data while reading inode 0x1 2024-09-12T02:02:55.221 INFO:tasks.ceph.mds.c.smithi019.stderr: -33> 2024-09-12T02:02:50.469+0000 7f27d2771640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2024-09-12T02:02:55.245 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:02:55.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.279+0000 7fd61a786640 1 Processor -- start 2024-09-12T02:02:55.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.279+0000 7fd61a786640 1 -- start start 2024-09-12T02:02:55.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.280+0000 7fd61a786640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6140b61e0 0x7fd6140b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:55.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.280+0000 7fd61a786640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd6140b6b00 0x7fd6140cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:55.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.280+0000 7fd61a786640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd6140d3ad0 0x7fd6140cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:55.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.280+0000 7fd61a786640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd6140c7e50 con 0x7fd6140b6b00 2024-09-12T02:02:55.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.280+0000 7fd61a786640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd6140d3640 con 0x7fd6140d3ad0 2024-09-12T02:02:55.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.280+0000 7fd61a786640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd6140d5010 con 0x7fd6140b61e0 2024-09-12T02:02:55.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.280+0000 7fd60bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd6140b6b00 0x7fd6140cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:55.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.280+0000 7fd60bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd6140b6b00 0x7fd6140cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38192/0 (socket says 172.21.15.19:38192) 2024-09-12T02:02:55.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.280+0000 7fd60bfff640 1 -- 172.21.15.19:0/3327093991 learned_addr learned my addr 172.21.15.19:0/3327093991 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:55.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.281+0000 7fd618d23640 1 --2- 172.21.15.19:0/3327093991 >> v2:172.21.15.135:3300/0 conn(0x7fd6140d3ad0 0x7fd6140cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:55.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.281+0000 7fd613fff640 1 --2- 172.21.15.19:0/3327093991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6140b61e0 0x7fd6140b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:55.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.281+0000 7fd60bfff640 1 -- 172.21.15.19:0/3327093991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6140b61e0 msgr2=0x7fd6140b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:55.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.281+0000 7fd60bfff640 1 --2- 172.21.15.19:0/3327093991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6140b61e0 0x7fd6140b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.281+0000 7fd60bfff640 1 -- 172.21.15.19:0/3327093991 >> v2:172.21.15.135:3300/0 conn(0x7fd6140d3ad0 msgr2=0x7fd6140cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:55.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.281+0000 7fd60bfff640 1 --2- 172.21.15.19:0/3327093991 >> v2:172.21.15.135:3300/0 conn(0x7fd6140d3ad0 0x7fd6140cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.281+0000 7fd60bfff640 1 -- 172.21.15.19:0/3327093991 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61406e7e0 con 0x7fd6140b6b00 2024-09-12T02:02:55.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.281+0000 7fd60bfff640 1 --2- 172.21.15.19:0/3327093991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6140b6b00 0x7fd6140cede0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fd61408d6a0 tx=0x7fd5fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111b49e568b4200a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:55.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.282+0000 7fd6137fe640 1 -- 172.21.15.19:0/3327093991 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc037070 con 0x7fd6140b6b00 2024-09-12T02:02:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.282+0000 7fd6137fe640 1 -- 172.21.15.19:0/3327093991 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5fc032440 con 0x7fd6140b6b00 2024-09-12T02:02:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.282+0000 7fd6137fe640 1 -- 172.21.15.19:0/3327093991 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc032810 con 0x7fd6140b6b00 2024-09-12T02:02:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.282+0000 7fd61a786640 1 -- 172.21.15.19:0/3327093991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6140b6b00 msgr2=0x7fd6140cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.282+0000 7fd61a786640 1 --2- 172.21.15.19:0/3327093991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6140b6b00 0x7fd6140cede0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fd61408d6a0 tx=0x7fd5fc02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.282+0000 7fd61a786640 1 -- 172.21.15.19:0/3327093991 shutdown_connections 2024-09-12T02:02:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.282+0000 7fd61a786640 1 --2- 172.21.15.19:0/3327093991 >> v2:172.21.15.135:3300/0 conn(0x7fd6140d3ad0 0x7fd6140cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.282+0000 7fd61a786640 1 --2- 172.21.15.19:0/3327093991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6140b6b00 0x7fd6140cede0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.282+0000 7fd61a786640 1 --2- 172.21.15.19:0/3327093991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6140b61e0 0x7fd6140b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.282+0000 7fd61a786640 1 -- 172.21.15.19:0/3327093991 >> 172.21.15.19:0/3327093991 conn(0x7fd6140d44f0 msgr2=0x7fd6140d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.282+0000 7fd61a786640 1 -- 172.21.15.19:0/3327093991 shutdown_connections 2024-09-12T02:02:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.282+0000 7fd61a786640 1 -- 172.21.15.19:0/3327093991 wait complete. 2024-09-12T02:02:55.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.284+0000 7fd61a786640 1 Processor -- start 2024-09-12T02:02:55.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.284+0000 7fd61a786640 1 -- start start 2024-09-12T02:02:55.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.284+0000 7fd61a786640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6140b61e0 0x7fd6140cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:55.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.284+0000 7fd61a786640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6140b6b00 0x7fd6140cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:55.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.284+0000 7fd61a786640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6140d3ad0 0x7fd6140c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:55.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.284+0000 7fd61a786640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd6140c76b0 con 0x7fd6140b61e0 2024-09-12T02:02:55.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.284+0000 7fd61a786640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd6140d52f0 con 0x7fd6140b6b00 2024-09-12T02:02:55.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.284+0000 7fd61a786640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd6140c7830 con 0x7fd6140d3ad0 2024-09-12T02:02:55.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.284+0000 7fd613fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6140b61e0 0x7fd6140cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:55.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.284+0000 7fd613fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6140b61e0 0x7fd6140cbf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38202/0 (socket says 172.21.15.19:38202) 2024-09-12T02:02:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.284+0000 7fd613fff640 1 -- 172.21.15.19:0/719963215 learned_addr learned my addr 172.21.15.19:0/719963215 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.285+0000 7fd60bfff640 1 --2- 172.21.15.19:0/719963215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6140b6b00 0x7fd6140cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.285+0000 7fd618d23640 1 --2- 172.21.15.19:0/719963215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6140d3ad0 0x7fd6140c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.285+0000 7fd613fff640 1 -- 172.21.15.19:0/719963215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6140d3ad0 msgr2=0x7fd6140c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.285+0000 7fd613fff640 1 --2- 172.21.15.19:0/719963215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6140d3ad0 0x7fd6140c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.285+0000 7fd613fff640 1 -- 172.21.15.19:0/719963215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6140b6b00 msgr2=0x7fd6140cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:55.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.285+0000 7fd613fff640 1 --2- 172.21.15.19:0/719963215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6140b6b00 0x7fd6140cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.285+0000 7fd613fff640 1 -- 172.21.15.19:0/719963215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6140ca410 con 0x7fd6140b61e0 2024-09-12T02:02:55.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.285+0000 7fd60bfff640 1 --2- 172.21.15.19:0/719963215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6140b6b00 0x7fd6140cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:55.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.285+0000 7fd613fff640 1 --2- 172.21.15.19:0/719963215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6140b61e0 0x7fd6140cbf90 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fd60400d830 tx=0x7fd60400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:55.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.285+0000 7fd6117fa640 1 -- 172.21.15.19:0/719963215 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604018020 con 0x7fd6140b61e0 2024-09-12T02:02:55.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.285+0000 7fd6117fa640 1 -- 172.21.15.19:0/719963215 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6040096a0 con 0x7fd6140b61e0 2024-09-12T02:02:55.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.285+0000 7fd61a786640 1 -- 172.21.15.19:0/719963215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6140ca6f0 con 0x7fd6140b61e0 2024-09-12T02:02:55.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.285+0000 7fd6117fa640 1 -- 172.21.15.19:0/719963215 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604009a70 con 0x7fd6140b61e0 2024-09-12T02:02:55.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.285+0000 7fd61a786640 1 -- 172.21.15.19:0/719963215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd61406ef10 con 0x7fd6140b61e0 2024-09-12T02:02:55.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.286+0000 7fd61a786640 1 -- 172.21.15.19:0/719963215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6140b65c0 con 0x7fd6140b61e0 2024-09-12T02:02:55.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.287+0000 7fd6117fa640 1 -- 172.21.15.19:0/719963215 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd60401b020 con 0x7fd6140b61e0 2024-09-12T02:02:55.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.287+0000 7fd6117fa640 1 --2- 172.21.15.19:0/719963215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd5f406be30 0x7fd5f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:55.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.288+0000 7fd6117fa640 1 -- 172.21.15.19:0/719963215 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6647+0+0 (secure 0 0 0) 0x7fd60408b600 con 0x7fd6140b61e0 2024-09-12T02:02:55.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.288+0000 7fd60bfff640 1 --2- 172.21.15.19:0/719963215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd5f406be30 0x7fd5f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:55.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.288+0000 7fd60bfff640 1 --2- 172.21.15.19:0/719963215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd5f406be30 0x7fd5f406e2f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc034000 tx=0x7fd5fc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:55.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.292+0000 7fd6117fa640 1 -- 172.21.15.19:0/719963215 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd604022030 con 0x7fd6140b61e0 2024-09-12T02:02:55.388 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:02:55.391 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:02:55.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.505+0000 7fd61a786640 1 -- 172.21.15.19:0/719963215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6140ba470 con 0x7fd6140b61e0 2024-09-12T02:02:55.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.505+0000 7fd6117fa640 1 -- 172.21.15.19:0/719963215 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+4388 (secure 0 0 0) 0x7fd6040102e0 con 0x7fd6140b61e0 2024-09-12T02:02:55.506 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:55.506 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":104,"btime":"2024-09-12T02:02:55:489562+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7836,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3136344951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3136344951},{"type":"v1","addr":"172.21.15.19:6834","nonce":3136344951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:02:54.488225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:02:55.506 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 104 2024-09-12T02:02:55.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.507+0000 7fd61a786640 1 -- 172.21.15.19:0/719963215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd5f406be30 msgr2=0x7fd5f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:55.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.507+0000 7fd61a786640 1 --2- 172.21.15.19:0/719963215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd5f406be30 0x7fd5f406e2f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc034000 tx=0x7fd5fc02e000 comp rx=0 tx=0).stop 2024-09-12T02:02:55.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.507+0000 7fd61a786640 1 -- 172.21.15.19:0/719963215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6140b61e0 msgr2=0x7fd6140cbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:55.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.507+0000 7fd61a786640 1 --2- 172.21.15.19:0/719963215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6140b61e0 0x7fd6140cbf90 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fd60400d830 tx=0x7fd60400dcf0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.507+0000 7fd61a786640 1 -- 172.21.15.19:0/719963215 shutdown_connections 2024-09-12T02:02:55.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.507+0000 7fd61a786640 1 --2- 172.21.15.19:0/719963215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd5f406be30 0x7fd5f406e2f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.507+0000 7fd61a786640 1 --2- 172.21.15.19:0/719963215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6140d3ad0 0x7fd6140c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.507+0000 7fd61a786640 1 --2- 172.21.15.19:0/719963215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6140b6b00 0x7fd6140cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.507+0000 7fd61a786640 1 --2- 172.21.15.19:0/719963215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6140b61e0 0x7fd6140cbf90 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.507+0000 7fd61a786640 1 -- 172.21.15.19:0/719963215 >> 172.21.15.19:0/719963215 conn(0x7fd6140d44f0 msgr2=0x7fd6140b1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:55.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.507+0000 7fd61a786640 1 -- 172.21.15.19:0/719963215 shutdown_connections 2024-09-12T02:02:55.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.507+0000 7fd61a786640 1 -- 172.21.15.19:0/719963215 wait complete. 2024-09-12T02:02:55.519 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 200.00000000' led to DAMAGED state 2024-09-12T02:02:55.519 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 200.00000001' 2024-09-12T02:02:55.519 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:02:55.519 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:02:55.535 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:02:55.535 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:02:55.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:55.535 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:02:55.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:02:55.591 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:02:55.591 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:02:55.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.733+0000 7fa547d2c640 1 Processor -- start 2024-09-12T02:02:55.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.733+0000 7fa547d2c640 1 -- start start 2024-09-12T02:02:55.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.734+0000 7fa547d2c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa54015e740 0x7fa5400d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:55.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.734+0000 7fa547d2c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5400d0780 con 0x7fa54006dbd0 2024-09-12T02:02:55.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.734+0000 7fa547d2c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5400d0a60 con 0x7fa54009b690 2024-09-12T02:02:55.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.734+0000 7fa547d2c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa54015eb20 con 0x7fa54015e740 2024-09-12T02:02:55.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.734+0000 7fa545ac8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa54015e740 0x7fa5400d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:55.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.734+0000 7fa5462c9640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa54006dbd0 0x7fa540070160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40594/0 (socket says 172.21.15.19:40594) 2024-09-12T02:02:55.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.734+0000 7fa5462c9640 1 -- 172.21.15.19:0/3680798015 learned_addr learned my addr 172.21.15.19:0/3680798015 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:55.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.735+0000 7fa545ac8640 1 -- 172.21.15.19:0/3680798015 >> v1:172.21.15.135:6789/0 conn(0x7fa54009b690 legacy=0x7fa54006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:55.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.735+0000 7fa545ac8640 1 -- 172.21.15.19:0/3680798015 >> v1:172.21.15.19:6789/0 conn(0x7fa54006dbd0 legacy=0x7fa540070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:55.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.735+0000 7fa545ac8640 1 -- 172.21.15.19:0/3680798015 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5400d0d40 con 0x7fa54015e740 2024-09-12T02:02:55.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.735+0000 7fa544ac6640 1 -- 172.21.15.19:0/3680798015 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2874962911 0 0) 0x7fa5400d0780 con 0x7fa54006dbd0 2024-09-12T02:02:55.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.735+0000 7fa545ac8640 1 --2- 172.21.15.19:0/3680798015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54015e740 0x7fa5400d1540 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0097a0 tx=0x7fa53c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56bc44dee9ab6507 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:55.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.735+0000 7fa544ac6640 1 -- 172.21.15.19:0/3680798015 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c037070 con 0x7fa54015e740 2024-09-12T02:02:55.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.736+0000 7fa544ac6640 1 -- 172.21.15.19:0/3680798015 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa53c032440 con 0x7fa54015e740 2024-09-12T02:02:55.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.736+0000 7fa544ac6640 1 -- 172.21.15.19:0/3680798015 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c032810 con 0x7fa54015e740 2024-09-12T02:02:55.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.736+0000 7fa547d2c640 1 -- 172.21.15.19:0/3680798015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54015e740 msgr2=0x7fa5400d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:55.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.736+0000 7fa547d2c640 1 --2- 172.21.15.19:0/3680798015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54015e740 0x7fa5400d1540 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0097a0 tx=0x7fa53c02a270 comp rx=0 tx=0).stop 2024-09-12T02:02:55.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.736+0000 7fa547d2c640 1 -- 172.21.15.19:0/3680798015 shutdown_connections 2024-09-12T02:02:55.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.736+0000 7fa547d2c640 1 --2- 172.21.15.19:0/3680798015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54015e740 0x7fa5400d1540 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.736+0000 7fa547d2c640 1 -- 172.21.15.19:0/3680798015 >> 172.21.15.19:0/3680798015 conn(0x7fa5400d23a0 msgr2=0x7fa5400d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:55.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.736+0000 7fa547d2c640 1 -- 172.21.15.19:0/3680798015 shutdown_connections 2024-09-12T02:02:55.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.736+0000 7fa547d2c640 1 -- 172.21.15.19:0/3680798015 wait complete. 2024-09-12T02:02:55.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.737+0000 7fa547d2c640 1 Processor -- start 2024-09-12T02:02:55.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.737+0000 7fa547d2c640 1 -- start start 2024-09-12T02:02:55.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.738+0000 7fa547d2c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa54006dbd0 0x7fa5400c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:55.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.738+0000 7fa547d2c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54009b690 0x7fa5400cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:55.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.738+0000 7fa547d2c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa54015e740 0x7fa5400cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:55.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.738+0000 7fa547d2c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa54006dfe0 con 0x7fa54009b690 2024-09-12T02:02:55.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.738+0000 7fa547d2c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa54009bac0 con 0x7fa54006dbd0 2024-09-12T02:02:55.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.738+0000 7fa547d2c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa54006cd20 con 0x7fa54015e740 2024-09-12T02:02:55.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.738+0000 7fa5452c7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54009b690 0x7fa5400cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:55.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.738+0000 7fa5452c7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54009b690 0x7fa5400cafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38220/0 (socket says 172.21.15.19:38220) 2024-09-12T02:02:55.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.738+0000 7fa5452c7640 1 -- 172.21.15.19:0/1293559147 learned_addr learned my addr 172.21.15.19:0/1293559147 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:55.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.738+0000 7fa545ac8640 1 --2- 172.21.15.19:0/1293559147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa54006dbd0 0x7fa5400c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:55.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.738+0000 7fa5462c9640 1 --2- 172.21.15.19:0/1293559147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa54015e740 0x7fa5400cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:55.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.739+0000 7fa5452c7640 1 -- 172.21.15.19:0/1293559147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa54015e740 msgr2=0x7fa5400cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:55.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.739+0000 7fa5452c7640 1 --2- 172.21.15.19:0/1293559147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa54015e740 0x7fa5400cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.739+0000 7fa5452c7640 1 -- 172.21.15.19:0/1293559147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa54006dbd0 msgr2=0x7fa5400c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:55.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.739+0000 7fa5452c7640 1 --2- 172.21.15.19:0/1293559147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa54006dbd0 0x7fa5400c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:55.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.739+0000 7fa5452c7640 1 -- 172.21.15.19:0/1293559147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5400c88d0 con 0x7fa54009b690 2024-09-12T02:02:55.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.739+0000 7fa5452c7640 1 --2- 172.21.15.19:0/1293559147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54009b690 0x7fa5400cafd0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fa53000c430 tx=0x7fa53000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:55.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.739+0000 7fa5367fc640 1 -- 172.21.15.19:0/1293559147 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530011790 con 0x7fa54009b690 2024-09-12T02:02:55.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.739+0000 7fa5367fc640 1 -- 172.21.15.19:0/1293559147 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa530017070 con 0x7fa54009b690 2024-09-12T02:02:55.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.739+0000 7fa547d2c640 1 -- 172.21.15.19:0/1293559147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa54014fe50 con 0x7fa54009b690 2024-09-12T02:02:55.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.739+0000 7fa5367fc640 1 -- 172.21.15.19:0/1293559147 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530011bb0 con 0x7fa54009b690 2024-09-12T02:02:55.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.739+0000 7fa547d2c640 1 -- 172.21.15.19:0/1293559147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5400c8310 con 0x7fa54009b690 2024-09-12T02:02:55.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.740+0000 7fa547d2c640 1 -- 172.21.15.19:0/1293559147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5400d0780 con 0x7fa54009b690 2024-09-12T02:02:55.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.740+0000 7fa5367fc640 1 -- 172.21.15.19:0/1293559147 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa53001c460 con 0x7fa54009b690 2024-09-12T02:02:55.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.741+0000 7fa5367fc640 1 --2- 172.21.15.19:0/1293559147 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa52406be30 0x7fa52406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:55.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.741+0000 7fa5367fc640 1 -- 172.21.15.19:0/1293559147 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6647+0+0 (secure 0 0 0) 0x7fa53008b080 con 0x7fa54009b690 2024-09-12T02:02:55.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.741+0000 7fa545ac8640 1 --2- 172.21.15.19:0/1293559147 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa52406be30 0x7fa52406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:55.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.742+0000 7fa545ac8640 1 --2- 172.21.15.19:0/1293559147 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa52406be30 0x7fa52406e2f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa53c034000 tx=0x7fa53c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:55.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.745+0000 7fa5367fc640 1 -- 172.21.15.19:0/1293559147 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa5400c88d0 con 0x7fa54009b690 2024-09-12T02:02:55.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:55.958+0000 7fa547d2c640 1 -- 172.21.15.19:0/1293559147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa5400d1cb0 con 0x7fa54009b690 2024-09-12T02:02:56.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.495+0000 7fa5367fc640 1 -- 172.21.15.19:0/1293559147 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v105) ==== 161+0+0 (secure 0 0 0) 0x7fa530059710 con 0x7fa54009b690 2024-09-12T02:02:56.496 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:02:56.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.498+0000 7fa547d2c640 1 -- 172.21.15.19:0/1293559147 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa52406be30 msgr2=0x7fa52406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:56.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.498+0000 7fa547d2c640 1 --2- 172.21.15.19:0/1293559147 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa52406be30 0x7fa52406e2f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa53c034000 tx=0x7fa53c02e000 comp rx=0 tx=0).stop 2024-09-12T02:02:56.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.498+0000 7fa547d2c640 1 -- 172.21.15.19:0/1293559147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54009b690 msgr2=0x7fa5400cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:56.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.498+0000 7fa547d2c640 1 --2- 172.21.15.19:0/1293559147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54009b690 0x7fa5400cafd0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fa53000c430 tx=0x7fa53000c8f0 comp rx=0 tx=0).stop 2024-09-12T02:02:56.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.498+0000 7fa547d2c640 1 -- 172.21.15.19:0/1293559147 shutdown_connections 2024-09-12T02:02:56.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.498+0000 7fa547d2c640 1 --2- 172.21.15.19:0/1293559147 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa52406be30 0x7fa52406e2f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:56.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.498+0000 7fa547d2c640 1 --2- 172.21.15.19:0/1293559147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa54015e740 0x7fa5400cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:56.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.498+0000 7fa547d2c640 1 --2- 172.21.15.19:0/1293559147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54009b690 0x7fa5400cafd0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:56.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.498+0000 7fa547d2c640 1 --2- 172.21.15.19:0/1293559147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa54006dbd0 0x7fa5400c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:56.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.498+0000 7fa547d2c640 1 -- 172.21.15.19:0/1293559147 >> 172.21.15.19:0/1293559147 conn(0x7fa5400d23a0 msgr2=0x7fa5400b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:56.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.498+0000 7fa547d2c640 1 -- 172.21.15.19:0/1293559147 shutdown_connections 2024-09-12T02:02:56.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.498+0000 7fa547d2c640 1 -- 172.21.15.19:0/1293559147 wait complete. 2024-09-12T02:02:56.510 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:02:56.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.618+0000 7f65bebd6640 1 Processor -- start 2024-09-12T02:02:56.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.618+0000 7f65bebd6640 1 -- start start 2024-09-12T02:02:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.619+0000 7f65bebd6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65b80b6690 0x7f65b81691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.619+0000 7f65bebd6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b80d3690 con 0x7f65b815e5f0 2024-09-12T02:02:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.619+0000 7f65bebd6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b80d3970 con 0x7f65b80d30f0 2024-09-12T02:02:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.619+0000 7f65bebd6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f65b806d530 con 0x7f65b80b6690 2024-09-12T02:02:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.619+0000 7f65bc972640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f65b815e5f0 0x7f65b80d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40600/0 (socket says 172.21.15.19:40600) 2024-09-12T02:02:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.619+0000 7f65bc972640 1 -- 172.21.15.19:0/1489794119 learned_addr learned my addr 172.21.15.19:0/1489794119 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:56.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.619+0000 7f65bd173640 1 --2- 172.21.15.19:0/1489794119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65b80b6690 0x7f65b81691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.619+0000 7f65b77fe640 1 -- 172.21.15.19:0/1489794119 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 585645760 0 0) 0x7f65b80d3690 con 0x7f65b815e5f0 2024-09-12T02:02:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.619+0000 7f65b77fe640 1 -- 172.21.15.19:0/1489794119 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65a0003520 con 0x7f65b815e5f0 2024-09-12T02:02:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.620+0000 7f65b77fe640 1 -- 172.21.15.19:0/1489794119 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2020435581 0 0) 0x7f65b80d3970 con 0x7f65b80d30f0 2024-09-12T02:02:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.620+0000 7f65b77fe640 1 -- 172.21.15.19:0/1489794119 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65b80d3690 con 0x7f65b80d30f0 2024-09-12T02:02:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.620+0000 7f65bd173640 1 -- 172.21.15.19:0/1489794119 >> v1:172.21.15.135:6789/0 conn(0x7f65b80d30f0 legacy=0x7f65b80b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.620+0000 7f65bd173640 1 -- 172.21.15.19:0/1489794119 >> v1:172.21.15.19:6789/0 conn(0x7f65b815e5f0 legacy=0x7f65b80d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.620+0000 7f65b77fe640 1 -- 172.21.15.19:0/1489794119 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4016920215 0 0) 0x7f65a0003520 con 0x7f65b815e5f0 2024-09-12T02:02:56.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.620+0000 7f65bd173640 1 -- 172.21.15.19:0/1489794119 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b806cee0 con 0x7f65b80b6690 2024-09-12T02:02:56.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.620+0000 7f65bd173640 1 --2- 172.21.15.19:0/1489794119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65b80b6690 0x7f65b81691a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f65b0009dc0 tx=0x7f65b002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=231843200f5d6e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:56.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.621+0000 7f65b77fe640 1 -- 172.21.15.19:0/1489794119 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8001690 con 0x7f65b80b6690 2024-09-12T02:02:56.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.621+0000 7f65b77fe640 1 -- 172.21.15.19:0/1489794119 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65b0007540 con 0x7f65b80b6690 2024-09-12T02:02:56.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.621+0000 7f65b77fe640 1 -- 172.21.15.19:0/1489794119 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b0007910 con 0x7f65b80b6690 2024-09-12T02:02:56.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.621+0000 7f65bebd6640 1 -- 172.21.15.19:0/1489794119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65b80b6690 msgr2=0x7f65b81691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:56.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.621+0000 7f65bebd6640 1 --2- 172.21.15.19:0/1489794119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65b80b6690 0x7f65b81691a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f65b0009dc0 tx=0x7f65b002a660 comp rx=0 tx=0).stop 2024-09-12T02:02:56.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.621+0000 7f65bebd6640 1 -- 172.21.15.19:0/1489794119 shutdown_connections 2024-09-12T02:02:56.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.621+0000 7f65bebd6640 1 --2- 172.21.15.19:0/1489794119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65b80b6690 0x7f65b81691a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:56.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.621+0000 7f65bebd6640 1 -- 172.21.15.19:0/1489794119 >> 172.21.15.19:0/1489794119 conn(0x7f65b808bfc0 msgr2=0x7f65b80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:56.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.621+0000 7f65bebd6640 1 -- 172.21.15.19:0/1489794119 shutdown_connections 2024-09-12T02:02:56.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.621+0000 7f65bebd6640 1 -- 172.21.15.19:0/1489794119 wait complete. 2024-09-12T02:02:56.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.622+0000 7f65bebd6640 1 Processor -- start 2024-09-12T02:02:56.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.623+0000 7f65bebd6640 1 -- start start 2024-09-12T02:02:56.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.623+0000 7f65bebd6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65b80b6690 0x7f65b80cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:56.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.623+0000 7f65bebd6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65b80d30f0 0x7f65b8160c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:56.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.623+0000 7f65bebd6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b815e5f0 0x7f65b8155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:56.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.623+0000 7f65bebd6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f65b806e9d0 con 0x7f65b815e5f0 2024-09-12T02:02:56.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.623+0000 7f65bebd6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f65b815e9d0 con 0x7f65b80d30f0 2024-09-12T02:02:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.623+0000 7f65bebd6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f65b806eb50 con 0x7f65b80b6690 2024-09-12T02:02:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.624+0000 7f65bd173640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b815e5f0 0x7f65b8155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.624+0000 7f65bd173640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b815e5f0 0x7f65b8155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38222/0 (socket says 172.21.15.19:38222) 2024-09-12T02:02:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.624+0000 7f65bd173640 1 -- 172.21.15.19:0/216934346 learned_addr learned my addr 172.21.15.19:0/216934346 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.624+0000 7f65bc972640 1 --2- 172.21.15.19:0/216934346 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65b80b6690 0x7f65b80cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.624+0000 7f65b7fff640 1 --2- 172.21.15.19:0/216934346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65b80d30f0 0x7f65b8160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.624+0000 7f65bd173640 1 -- 172.21.15.19:0/216934346 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65b80b6690 msgr2=0x7f65b80cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.624+0000 7f65bd173640 1 --2- 172.21.15.19:0/216934346 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65b80b6690 0x7f65b80cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.624+0000 7f65bd173640 1 -- 172.21.15.19:0/216934346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65b80d30f0 msgr2=0x7f65b8160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.624+0000 7f65bd173640 1 --2- 172.21.15.19:0/216934346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65b80d30f0 0x7f65b8160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.624+0000 7f65bd173640 1 -- 172.21.15.19:0/216934346 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b80cbc60 con 0x7f65b815e5f0 2024-09-12T02:02:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.624+0000 7f65bd173640 1 --2- 172.21.15.19:0/216934346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b815e5f0 0x7f65b8155a40 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f65b0009ee0 tx=0x7f65b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:56.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.624+0000 7f65b57fa640 1 -- 172.21.15.19:0/216934346 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b0040070 con 0x7f65b815e5f0 2024-09-12T02:02:56.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.624+0000 7f65b57fa640 1 -- 172.21.15.19:0/216934346 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65b0031bc0 con 0x7f65b815e5f0 2024-09-12T02:02:56.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.624+0000 7f65bebd6640 1 -- 172.21.15.19:0/216934346 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b80cbf40 con 0x7f65b815e5f0 2024-09-12T02:02:56.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.624+0000 7f65b57fa640 1 -- 172.21.15.19:0/216934346 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b0009450 con 0x7f65b815e5f0 2024-09-12T02:02:56.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.624+0000 7f65bebd6640 1 -- 172.21.15.19:0/216934346 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b80cc500 con 0x7f65b815e5f0 2024-09-12T02:02:56.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.625+0000 7f65bebd6640 1 -- 172.21.15.19:0/216934346 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65b80b4a50 con 0x7f65b815e5f0 2024-09-12T02:02:56.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.626+0000 7f65b57fa640 1 -- 172.21.15.19:0/216934346 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65b0039040 con 0x7f65b815e5f0 2024-09-12T02:02:56.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.626+0000 7f65b57fa640 1 --2- 172.21.15.19:0/216934346 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f65a406be30 0x7f65a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:56.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.626+0000 7f65b57fa640 1 -- 172.21.15.19:0/216934346 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6647+0+0 (secure 0 0 0) 0x7f65b00ac8d0 con 0x7f65b815e5f0 2024-09-12T02:02:56.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.626+0000 7f65bc972640 1 --2- 172.21.15.19:0/216934346 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f65a406be30 0x7f65a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:56.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.627+0000 7f65bc972640 1 --2- 172.21.15.19:0/216934346 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f65a406be30 0x7f65a406e2f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f65a8001800 tx=0x7f65a80016d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:56.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.631+0000 7f65b57fa640 1 -- 172.21.15.19:0/216934346 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f65b007a800 con 0x7f65b815e5f0 2024-09-12T02:02:56.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:56.880+0000 7f65bebd6640 1 -- 172.21.15.19:0/216934346 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f65b80b4770 con 0x7f65b815e5f0 2024-09-12T02:02:57.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.497+0000 7f65b57fa640 1 -- 172.21.15.19:0/216934346 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v106) ==== 101+0+0 (secure 0 0 0) 0x7f65b007eb00 con 0x7f65b815e5f0 2024-09-12T02:02:57.497 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:02:57.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.499+0000 7f65bebd6640 1 -- 172.21.15.19:0/216934346 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f65a406be30 msgr2=0x7f65a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.499+0000 7f65bebd6640 1 --2- 172.21.15.19:0/216934346 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f65a406be30 0x7f65a406e2f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f65a8001800 tx=0x7f65a80016d0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.499+0000 7f65bebd6640 1 -- 172.21.15.19:0/216934346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b815e5f0 msgr2=0x7f65b8155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.499+0000 7f65bebd6640 1 --2- 172.21.15.19:0/216934346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b815e5f0 0x7f65b8155a40 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f65b0009ee0 tx=0x7f65b0004a40 comp rx=0 tx=0).stop 2024-09-12T02:02:57.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.499+0000 7f65bebd6640 1 -- 172.21.15.19:0/216934346 shutdown_connections 2024-09-12T02:02:57.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.499+0000 7f65bebd6640 1 --2- 172.21.15.19:0/216934346 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f65a406be30 0x7f65a406e2f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.499+0000 7f65bebd6640 1 --2- 172.21.15.19:0/216934346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b815e5f0 0x7f65b8155a40 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.499+0000 7f65bebd6640 1 --2- 172.21.15.19:0/216934346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65b80d30f0 0x7f65b8160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.499+0000 7f65bebd6640 1 --2- 172.21.15.19:0/216934346 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65b80b6690 0x7f65b80cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.499+0000 7f65bebd6640 1 -- 172.21.15.19:0/216934346 >> 172.21.15.19:0/216934346 conn(0x7f65b808bfc0 msgr2=0x7f65b80cf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.500+0000 7f65bebd6640 1 -- 172.21.15.19:0/216934346 shutdown_connections 2024-09-12T02:02:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.500+0000 7f65bebd6640 1 -- 172.21.15.19:0/216934346 wait complete. 2024-09-12T02:02:57.513 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:02:57.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.560+0000 7fec9011ef40 1 Processor -- start 2024-09-12T02:02:57.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.560+0000 7fec9011ef40 1 -- start start 2024-09-12T02:02:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec9011ef40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adeee73640 0x55adeeef6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec9011ef40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adeeeffd20 0x55adeee59900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec9011ef40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adeef00100 0x55adeee59e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec9011ef40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55adeee746b0 con 0x55adeeeffd20 2024-09-12T02:02:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec9011ef40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55adeed7c510 con 0x55adeef00100 2024-09-12T02:02:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec9011ef40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55adeee2f2d0 con 0x55adeee73640 2024-09-12T02:02:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec8d413640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adeeeffd20 0x55adeee59900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec8d413640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adeeeffd20 0x55adeee59900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38244/0 (socket says 172.21.15.19:38244) 2024-09-12T02:02:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec8d413640 1 -- 172.21.15.19:0/1021974354 learned_addr learned my addr 172.21.15.19:0/1021974354 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec8e415640 1 --2- 172.21.15.19:0/1021974354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adeef00100 0x55adeee59e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec8dc14640 1 --2- 172.21.15.19:0/1021974354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adeee73640 0x55adeeef6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec8d413640 1 -- 172.21.15.19:0/1021974354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adeee73640 msgr2=0x55adeeef6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec8d413640 1 --2- 172.21.15.19:0/1021974354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adeee73640 0x55adeeef6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec8d413640 1 -- 172.21.15.19:0/1021974354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adeef00100 msgr2=0x55adeee59e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec8d413640 1 --2- 172.21.15.19:0/1021974354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adeef00100 0x55adeee59e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec8d413640 1 -- 172.21.15.19:0/1021974354 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adeeef7120 con 0x55adeeeffd20 2024-09-12T02:02:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec8d413640 1 --2- 172.21.15.19:0/1021974354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adeeeffd20 0x55adeee59900 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fec84001cb0 tx=0x7fec8400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab1768b06f5c236 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec7ffff640 1 -- 172.21.15.19:0/1021974354 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8400bcc0 con 0x55adeeeffd20 2024-09-12T02:02:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec7ffff640 1 -- 172.21.15.19:0/1021974354 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8400f400 con 0x55adeeeffd20 2024-09-12T02:02:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.561+0000 7fec7ffff640 1 -- 172.21.15.19:0/1021974354 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8400f7f0 con 0x55adeeeffd20 2024-09-12T02:02:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.562+0000 7fec9011ef40 1 -- 172.21.15.19:0/1021974354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adeeeffd20 msgr2=0x55adeee59900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.562+0000 7fec9011ef40 1 --2- 172.21.15.19:0/1021974354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adeeeffd20 0x55adeee59900 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fec84001cb0 tx=0x7fec8400b5b0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.562+0000 7fec9011ef40 1 -- 172.21.15.19:0/1021974354 shutdown_connections 2024-09-12T02:02:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.562+0000 7fec9011ef40 1 --2- 172.21.15.19:0/1021974354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adeef00100 0x55adeee59e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.562+0000 7fec9011ef40 1 --2- 172.21.15.19:0/1021974354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adeeeffd20 0x55adeee59900 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.562+0000 7fec9011ef40 1 --2- 172.21.15.19:0/1021974354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adeee73640 0x55adeeef6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.562+0000 7fec9011ef40 1 -- 172.21.15.19:0/1021974354 >> 172.21.15.19:0/1021974354 conn(0x55adeee58490 msgr2=0x55adeee58870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.562+0000 7fec9011ef40 1 -- 172.21.15.19:0/1021974354 shutdown_connections 2024-09-12T02:02:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.562+0000 7fec9011ef40 1 -- 172.21.15.19:0/1021974354 wait complete. 2024-09-12T02:02:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.563+0000 7fec9011ef40 1 Processor -- start 2024-09-12T02:02:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.563+0000 7fec9011ef40 1 -- start start 2024-09-12T02:02:57.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.563+0000 7fec9011ef40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adeee73640 0x55adeeef2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.563+0000 7fec9011ef40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adeeeffd20 0x55adeee6e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.563+0000 7fec9011ef40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adeef00100 0x55adeef00f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.563+0000 7fec9011ef40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55adeee5a9f0 con 0x55adeef00100 2024-09-12T02:02:57.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.564+0000 7fec9011ef40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55adeef00580 con 0x55adeeeffd20 2024-09-12T02:02:57.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.564+0000 7fec9011ef40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55adeef00860 con 0x55adeee73640 2024-09-12T02:02:57.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.564+0000 7fec8e415640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adeef00100 0x55adeef00f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.564+0000 7fec8e415640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adeef00100 0x55adeef00f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38258/0 (socket says 172.21.15.19:38258) 2024-09-12T02:02:57.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.564+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 learned_addr learned my addr 172.21.15.19:0/2590642149 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:57.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.564+0000 7fec8dc14640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adeee73640 0x55adeeef2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.564+0000 7fec8d413640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adeeeffd20 0x55adeee6e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.564+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adeee73640 msgr2=0x55adeeef2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.564+0000 7fec8e415640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adeee73640 0x55adeeef2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.564+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adeeeffd20 msgr2=0x55adeee6e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.564+0000 7fec8e415640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adeeeffd20 0x55adeee6e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.564+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adeee6f340 con 0x55adeef00100 2024-09-12T02:02:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.564+0000 7fec8e415640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adeef00100 0x55adeef00f20 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fec88025ab0 tx=0x7fec88003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.564+0000 7fec7effd640 1 -- 172.21.15.19:0/2590642149 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8804f640 con 0x55adeef00100 2024-09-12T02:02:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.564+0000 7fec7effd640 1 -- 172.21.15.19:0/2590642149 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec88062400 con 0x55adeef00100 2024-09-12T02:02:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.564+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55adeee70d10 con 0x55adeef00100 2024-09-12T02:02:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.564+0000 7fec7effd640 1 -- 172.21.15.19:0/2590642149 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec880627b0 con 0x55adeef00100 2024-09-12T02:02:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.565+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adeee712d0 con 0x55adeef00100 2024-09-12T02:02:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.566+0000 7fec7effd640 1 -- 172.21.15.19:0/2590642149 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec88062950 con 0x55adeef00100 2024-09-12T02:02:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.566+0000 7fec7effd640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fec7006a810 0x7fec7006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.566+0000 7fec7effd640 1 -- 172.21.15.19:0/2590642149 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6647+0+0 (secure 0 0 0) 0x7fec880cdc80 con 0x55adeef00100 2024-09-12T02:02:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.567+0000 7fec8dc14640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fec7006a810 0x7fec7006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.570 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:02:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.567+0000 7fec9011ef40 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55adeee58010 0x55adeefa2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.567+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa2640 con 0x55adeee58010 2024-09-12T02:02:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.567+0000 7fec8d413640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55adeee58010 0x55adeefa2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.567+0000 7fec8dc14640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fec7006a810 0x7fec7006ccd0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fec800098e0 tx=0x7fec8000c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.567+0000 7fec8d413640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55adeee58010 0x55adeefa2100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.568+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v99'133 uv107 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.568+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa29e0 con 0x55adeee58010 2024-09-12T02:02:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.570+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v99'134 uv134 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.570+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa2d80 con 0x55adeee58010 2024-09-12T02:02:57.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.572+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v99'135 uv135 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.573 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:02:57.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.572+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa4130 con 0x55adeee58010 2024-09-12T02:02:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.575+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v99'136 uv136 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.576+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa44d0 con 0x55adeee58010 2024-09-12T02:02:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.577+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v99'137 uv137 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.577+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa3120 con 0x55adeee58010 2024-09-12T02:02:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.579+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v99'138 uv138 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.579+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa3530 con 0x55adeee58010 2024-09-12T02:02:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.582+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v99'139 uv113 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.582+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.585+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v99'140 uv140 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.585+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.588+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v99'141 uv141 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.588 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:02:57.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.588+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.591+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v99'142 uv142 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.591+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.592+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v99'143 uv143 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.592+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.594+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v99'144 uv144 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.594+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.597+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v99'145 uv120 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.597+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.600+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v99'146 uv146 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.600+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.603+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v99'147 uv147 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.603 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:02:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.603+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.606+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v99'148 uv148 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.606+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.609+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v99'149 uv149 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.609+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.610+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v99'150 uv150 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.610+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.615+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v99'151 uv151 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.615+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.616+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v99'152 uv126 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.616+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.617+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v99'153 uv153 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.617+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.618+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v99'154 uv154 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.618 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:02:57.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.618+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.619+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v99'155 uv155 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.619+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.620+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v99'156 uv156 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.620+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.621+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v99'157 uv157 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.621+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.624+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v99'158 uv132 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.624+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.627+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v99'159 uv159 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.627+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.630+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v99'160 uv160 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.630 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:02:57.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.630+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.631+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v99'161 uv161 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.631+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.634+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v99'162 uv162 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.634+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeee58010 2024-09-12T02:02:57.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.637+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v99'163 uv163 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeee58010 2024-09-12T02:02:57.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.637+0000 7fec9011ef40 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55adeefa3cb0 0x55adeefa6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.637+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa38d0 con 0x55adeefa3cb0 2024-09-12T02:02:57.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.637+0000 7fec8dc14640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55adeefa3cb0 0x55adeefa6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.637+0000 7fec8dc14640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55adeefa3cb0 0x55adeefa6d90 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:57.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.639+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v99'110 uv92 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fec80007a90 con 0x55adeefa3cb0 2024-09-12T02:02:57.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.639+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa72d0 con 0x55adeefa3cb0 2024-09-12T02:02:57.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.640+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v99'111 uv111 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefa3cb0 2024-09-12T02:02:57.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.640+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa7670 con 0x55adeefa3cb0 2024-09-12T02:02:57.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.641+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v99'112 uv112 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefa3cb0 2024-09-12T02:02:57.642 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:02:57.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.641+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa7ec0 con 0x55adeefa3cb0 2024-09-12T02:02:57.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.642+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v99'113 uv113 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefa3cb0 2024-09-12T02:02:57.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.642+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa8260 con 0x55adeefa3cb0 2024-09-12T02:02:57.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.643+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v99'114 uv114 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefa3cb0 2024-09-12T02:02:57.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.644+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa8600 con 0x55adeefa3cb0 2024-09-12T02:02:57.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.644+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v99'115 uv115 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefa3cb0 2024-09-12T02:02:57.645 INFO:teuthology.orchestra.run.smithi019.stdout:Write #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:02:57.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.644+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa89a0 con 0x55adeefa3cb0 2024-09-12T02:02:57.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.645+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [write 0~90] v99'116 uv116 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefa3cb0 2024-09-12T02:02:57.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.645+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa8d40 con 0x55adeefa3cb0 2024-09-12T02:02:57.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.646+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [omap-set-header] v99'117 uv117 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefa3cb0 2024-09-12T02:02:57.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.647+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa8d40 con 0x55adeefa3cb0 2024-09-12T02:02:57.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.648+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000001 [create] v99'118 uv102 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefa3cb0 2024-09-12T02:02:57.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.648+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa8d40 con 0x55adeefa3cb0 2024-09-12T02:02:57.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.649+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000001 [delete] v99'119 uv119 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefa3cb0 2024-09-12T02:02:57.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.649+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa8d40 con 0x55adeefa3cb0 2024-09-12T02:02:57.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.650+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v99'120 uv120 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefa3cb0 2024-09-12T02:02:57.650 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:02:57.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.650+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa8d40 con 0x55adeefa3cb0 2024-09-12T02:02:57.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.651+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [write 0~17490] v99'121 uv121 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefa3cb0 2024-09-12T02:02:57.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.651+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa8d40 con 0x55adeefa3cb0 2024-09-12T02:02:57.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.652+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [omap-set-header] v99'122 uv122 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefa3cb0 2024-09-12T02:02:57.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.652+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa8d40 con 0x55adeefa3cb0 2024-09-12T02:02:57.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.653+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 606.00000000 [create] v99'123 uv108 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefa3cb0 2024-09-12T02:02:57.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.653+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa8d40 con 0x55adeefa3cb0 2024-09-12T02:02:57.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.654+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 606.00000000 [delete] v99'124 uv124 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefa3cb0 2024-09-12T02:02:57.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.654+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa8d40 con 0x55adeefa3cb0 2024-09-12T02:02:57.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.655+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v99'125 uv125 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefa3cb0 2024-09-12T02:02:57.655 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:02:57.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.655+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa8d40 con 0x55adeefa3cb0 2024-09-12T02:02:57.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.656+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [setxattr (30)] v99'126 uv126 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefa3cb0 2024-09-12T02:02:57.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.656+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa9d50 con 0x55adeefa3cb0 2024-09-12T02:02:57.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.657+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [setxattr (62)] v99'127 uv127 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefa3cb0 2024-09-12T02:02:57.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.657+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa8d40 con 0x55adeefa3cb0 2024-09-12T02:02:57.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.658+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [omap-set-header] v99'128 uv128 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefa3cb0 2024-09-12T02:02:57.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.658+0000 7fec9011ef40 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55adeefa93c0 0x55adeefa97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.658+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:51 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefac150 con 0x55adeefa93c0 2024-09-12T02:02:57.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.658+0000 7fec8d413640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55adeefa93c0 0x55adeefa97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.658+0000 7fec8d413640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55adeefa93c0 0x55adeefa97c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:57.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.660+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(51 607.00000000 [create] v99'27 uv26 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.660+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:52 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefac150 con 0x55adeefa93c0 2024-09-12T02:02:57.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.661+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(52 607.00000000 [delete] v99'28 uv28 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.661+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefac150 con 0x55adeefa93c0 2024-09-12T02:02:57.662 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:02:57.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.662+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(53 607.00000000 [create] v99'29 uv29 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.662+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa7af0 con 0x55adeefa93c0 2024-09-12T02:02:57.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.663+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(54 607.00000000 [setxattr (30)] v99'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.663+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa7ab0 con 0x55adeefa93c0 2024-09-12T02:02:57.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.664+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(55 607.00000000 [setxattr (62)] v99'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.664+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefa7ab0 con 0x55adeefa93c0 2024-09-12T02:02:57.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.665+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(56 607.00000000 [omap-set-header] v99'32 uv32 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.665+0000 7fec9011ef40 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55adeefacb10 0x55adeefacf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.665+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:57 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefaf660 con 0x55adeefacb10 2024-09-12T02:02:57.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.665+0000 7fec8e415640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55adeefacb10 0x55adeefacf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.666+0000 7fec8e415640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55adeefacb10 0x55adeefacf70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:57.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.667+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(57 mds0_openfiles.0 [create] v99'21 uv20 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.667+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:58 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefafa00 con 0x55adeefacb10 2024-09-12T02:02:57.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.668+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(58 mds0_openfiles.0 [delete] v99'22 uv22 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.668+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefafe60 con 0x55adeefacb10 2024-09-12T02:02:57.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.669+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(59 mds0_openfiles.0 [create] v99'23 uv23 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.670 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:02:57.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.669+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb0720 con 0x55adeefacb10 2024-09-12T02:02:57.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.670+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(60 mds0_openfiles.0 [omap-set-header] v99'24 uv24 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.670+0000 7fec9011ef40 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55adeefb0fd0 0x55adeefb33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.670+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:61 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb3900 con 0x55adeefb0fd0 2024-09-12T02:02:57.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.671+0000 7fec8dc14640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55adeefb0fd0 0x55adeefb33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.671+0000 7fec8dc14640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55adeefb0fd0 0x55adeefb33c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:57.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.672+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(61 608.00000000 [create] v99'27 uv26 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.672+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:62 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb39c0 con 0x55adeefb0fd0 2024-09-12T02:02:57.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.676+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(62 608.00000000 [delete] v99'28 uv28 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.676+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb3de0 con 0x55adeefb0fd0 2024-09-12T02:02:57.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.677+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(63 608.00000000 [create] v99'29 uv29 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.677 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:02:57.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.677+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb4df0 con 0x55adeefb0fd0 2024-09-12T02:02:57.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.679+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(64 608.00000000 [setxattr (30)] v99'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.679+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb4df0 con 0x55adeefb0fd0 2024-09-12T02:02:57.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.683+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(65 608.00000000 [setxattr (62)] v99'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.683+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb3de0 con 0x55adeefb0fd0 2024-09-12T02:02:57.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.688+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(66 608.00000000 [omap-set-header] v99'32 uv32 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.688+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:67 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb3de0 con 0x55adeefacb10 2024-09-12T02:02:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.689+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(67 604.00000000 [create] v99'48 uv42 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.689+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:68 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb4180 con 0x55adeefacb10 2024-09-12T02:02:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.690+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(68 604.00000000 [delete] v99'49 uv49 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.690+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb4520 con 0x55adeefacb10 2024-09-12T02:02:57.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.691+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(69 604.00000000 [create] v99'50 uv50 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.691 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:02:57.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.691+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb58d0 con 0x55adeefacb10 2024-09-12T02:02:57.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.692+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(70 604.00000000 [setxattr (30)] v99'51 uv51 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.692+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb58d0 con 0x55adeefacb10 2024-09-12T02:02:57.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.693+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(71 604.00000000 [setxattr (62)] v99'52 uv52 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.693+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb48c0 con 0x55adeefacb10 2024-09-12T02:02:57.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.694+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(72 604.00000000 [omap-set-header] v99'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.694+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb48c0 con 0x55adeefacb10 2024-09-12T02:02:57.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.695+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(73 500.00000000 [create] v99'54 uv47 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.695+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb48c0 con 0x55adeefacb10 2024-09-12T02:02:57.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.697+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(74 500.00000000 [delete] v99'55 uv55 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.697+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb48c0 con 0x55adeefacb10 2024-09-12T02:02:57.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.698+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(75 500.00000000 [create] v99'56 uv56 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.698 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:02:57.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.698+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb48c0 con 0x55adeefacb10 2024-09-12T02:02:57.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.699+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(76 500.00000000 [write 0~90] v99'57 uv57 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.699+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb48c0 con 0x55adeefacb10 2024-09-12T02:02:57.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.700+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(77 500.00000000 [omap-set-header] v99'58 uv58 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.700+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb48c0 con 0x55adeefacb10 2024-09-12T02:02:57.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.701+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(78 mds_snaptable [create] v99'22 uv21 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.701+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb48c0 con 0x55adeefacb10 2024-09-12T02:02:57.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.702+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(79 mds_snaptable [delete] v99'23 uv23 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.702+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb48c0 con 0x55adeefacb10 2024-09-12T02:02:57.703 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:02:57.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.703+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(80 mds_snaptable [create] v99'24 uv24 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.703+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb48c0 con 0x55adeefacb10 2024-09-12T02:02:57.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.705+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(81 mds_snaptable [write 0~70] v99'25 uv25 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.705+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb48c0 con 0x55adeefacb10 2024-09-12T02:02:57.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.706+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(82 mds_snaptable [omap-set-header] v99'26 uv26 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fec88060070 con 0x55adeefacb10 2024-09-12T02:02:57.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.706+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:83 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb48c0 con 0x55adeefb0fd0 2024-09-12T02:02:57.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.707+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(83 605.00000000 [create] v99'27 uv26 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.707+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:84 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb48c0 con 0x55adeefb0fd0 2024-09-12T02:02:57.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.708+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(84 605.00000000 [delete] v99'28 uv28 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.708+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb48c0 con 0x55adeefb0fd0 2024-09-12T02:02:57.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.710+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(85 605.00000000 [create] v99'29 uv29 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.711 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:02:57.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.710+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb5cc0 con 0x55adeefb0fd0 2024-09-12T02:02:57.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.712+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(86 605.00000000 [setxattr (30)] v99'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.712+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb5cc0 con 0x55adeefb0fd0 2024-09-12T02:02:57.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.713+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(87 605.00000000 [setxattr (62)] v99'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.713+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb4cb0 con 0x55adeefb0fd0 2024-09-12T02:02:57.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.714+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(88 605.00000000 [omap-set-header] v99'32 uv32 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.714+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb4cb0 con 0x55adeefb0fd0 2024-09-12T02:02:57.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.715+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(89 mds0_inotable [create] v99'44 uv38 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.715+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb4cb0 con 0x55adeefb0fd0 2024-09-12T02:02:57.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.716+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(90 mds0_inotable [delete] v99'45 uv45 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.716+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb4cb0 con 0x55adeefb0fd0 2024-09-12T02:02:57.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.717+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(91 mds0_inotable [create] v99'46 uv46 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.717 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:02:57.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.717+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb4cb0 con 0x55adeefb0fd0 2024-09-12T02:02:57.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.718+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(92 mds0_inotable [write 0~34] v99'47 uv47 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.718+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb4cb0 con 0x55adeefb0fd0 2024-09-12T02:02:57.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.719+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v99'48 uv48 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.719+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb4cb0 con 0x55adeefb0fd0 2024-09-12T02:02:57.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.720+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(94 100.00000000 [create] v99'49 uv43 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.720+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb4cb0 con 0x55adeefb0fd0 2024-09-12T02:02:57.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.721+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(95 100.00000000 [delete] v99'50 uv50 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.721+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb4cb0 con 0x55adeefb0fd0 2024-09-12T02:02:57.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.722+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(96 100.00000000 [create] v99'51 uv51 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.723 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:02:57.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.722+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb4cb0 con 0x55adeefb0fd0 2024-09-12T02:02:57.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.725+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(97 100.00000000 [omap-set-header] v99'52 uv52 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.725+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7ac0 con 0x55adeefb0fd0 2024-09-12T02:02:57.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.727+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v99'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.727+0000 7fec9011ef40 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55adeefb5670 0x55adeefb7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.727+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:99 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefb5670 2024-09-12T02:02:57.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.727+0000 7fec8d413640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55adeefb5670 0x55adeefb7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.727+0000 7fec8d413640 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55adeefb5670 0x55adeefb7fa0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:57.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.729+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(99 mds0_sessionmap [create] v99'22 uv21 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefb5670 2024-09-12T02:02:57.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.729+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:100 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefb5670 2024-09-12T02:02:57.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.730+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(100 mds0_sessionmap [delete] v99'23 uv23 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefb5670 2024-09-12T02:02:57.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.730+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefb5670 2024-09-12T02:02:57.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.733+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(101 mds0_sessionmap [create] v99'24 uv24 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefb5670 2024-09-12T02:02:57.733 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:02:57.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.733+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefb5670 2024-09-12T02:02:57.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.736+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v99'25 uv25 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefb5670 2024-09-12T02:02:57.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.736+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:103 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefb0fd0 2024-09-12T02:02:57.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.737+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(103 609.00000000 [create] v99'27 uv26 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.737+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:104 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefb0fd0 2024-09-12T02:02:57.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.738+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(104 609.00000000 [delete] v99'28 uv28 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.738+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefb0fd0 2024-09-12T02:02:57.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.739+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(105 609.00000000 [create] v99'29 uv29 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.740 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:02:57.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.740+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefb0fd0 2024-09-12T02:02:57.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.741+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v99'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.741+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefb0fd0 2024-09-12T02:02:57.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.742+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v99'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.742+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefb0fd0 2024-09-12T02:02:57.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.743+0000 7fec8dc14640 1 -- 172.21.15.19:0/2590642149 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(108 609.00000000 [omap-set-header] v99'32 uv32 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec80021040 con 0x55adeefb0fd0 2024-09-12T02:02:57.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.743+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:109 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefa93c0 2024-09-12T02:02:57.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.744+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(109 400.00000000 [create] v99'22 uv21 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.744+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:110 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefa93c0 2024-09-12T02:02:57.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.746+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(110 400.00000000 [delete] v99'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.746+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefa93c0 2024-09-12T02:02:57.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.747+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(111 400.00000000 [create] v99'24 uv24 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.747 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:02:57.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.747+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefa93c0 2024-09-12T02:02:57.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.748+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(112 400.00000000 [write 0~22] v99'25 uv25 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.748+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefa93c0 2024-09-12T02:02:57.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.749+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(113 400.00000000 [omap-set-header] v99'26 uv26 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.750+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefa93c0 2024-09-12T02:02:57.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.751+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(114 100.00000000.inode [create] v99'57 uv49 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.751+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb84e0 con 0x55adeefa93c0 2024-09-12T02:02:57.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.752+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(115 100.00000000.inode [delete] v99'58 uv58 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.752+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb84e0 con 0x55adeefa93c0 2024-09-12T02:02:57.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.753+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(116 100.00000000.inode [create] v99'59 uv59 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.753 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:02:57.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.753+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb84e0 con 0x55adeefa93c0 2024-09-12T02:02:57.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.754+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v99'60 uv60 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.754+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefa93c0 2024-09-12T02:02:57.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.755+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v99'61 uv61 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.755+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefa93c0 2024-09-12T02:02:57.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.756+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(119 1.00000000 [create] v99'62 uv56 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.756+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefa93c0 2024-09-12T02:02:57.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.757+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(120 1.00000000 [delete] v99'63 uv63 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.757+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefa93c0 2024-09-12T02:02:57.758 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:02:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.758+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(121 1.00000000 [create] v99'64 uv64 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.758+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefa93c0 2024-09-12T02:02:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.759+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v99'65 uv65 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.759+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefa93c0 2024-09-12T02:02:57.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.760+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v99'66 uv66 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.760+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb7a60 con 0x55adeefa93c0 2024-09-12T02:02:57.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.761+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(124 1.00000000 [omap-set-header] v99'67 uv67 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.761+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55adeefb84e0 con 0x55adeefa93c0 2024-09-12T02:02:57.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec8d413640 1 -- 172.21.15.19:0/2590642149 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v99'68 uv68 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fec8400f5b0 con 0x55adeefa93c0 2024-09-12T02:02:57.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55adeefa3cb0 msgr2=0x55adeefa6d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55adeefa3cb0 0x55adeefa6d90 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55adeee58010 msgr2=0x55adeefa2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55adeee58010 0x55adeefa2100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55adeefacb10 msgr2=0x55adeefacf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55adeefacb10 0x55adeefacf70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55adeefb5670 msgr2=0x55adeefb7fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55adeefb5670 0x55adeefb7fa0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55adeefa93c0 msgr2=0x55adeefa97c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 reap_dead start 2024-09-12T02:02:57.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55adeefa93c0 0x55adeefa97c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec8e415640 1 -- 172.21.15.19:0/2590642149 reap_dead start 2024-09-12T02:02:57.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55adeefb0fd0 msgr2=0x55adeefb33c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55adeefb0fd0 0x55adeefb33c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fec7006a810 msgr2=0x7fec7006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fec7006a810 0x7fec7006ccd0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fec800098e0 tx=0x7fec8000c040 comp rx=0 tx=0).stop 2024-09-12T02:02:57.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adeef00100 msgr2=0x55adeef00f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adeef00100 0x55adeef00f20 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fec88025ab0 tx=0x7fec88003330 comp rx=0 tx=0).stop 2024-09-12T02:02:57.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 shutdown_connections 2024-09-12T02:02:57.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55adeefb0fd0 0x55adeefb33c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55adeefa93c0 0x55adeefa97c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fec7006a810 0x7fec7006ccd0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 --2- 172.21.15.19:0/2590642149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adeef00100 0x55adeef00f20 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 >> 172.21.15.19:0/2590642149 conn(0x55adeee58490 msgr2=0x55adeee58870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:57.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 shutdown_connections 2024-09-12T02:02:57.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.762+0000 7fec9011ef40 1 -- 172.21.15.19:0/2590642149 wait complete. 2024-09-12T02:02:57.767 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 200.00000001 2024-09-12T02:02:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.850+0000 7fc5643eaf40 1 Processor -- start 2024-09-12T02:02:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.850+0000 7fc5643eaf40 1 -- start start 2024-09-12T02:02:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc5643eaf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9e4c2640 0x559e9e545370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc5643eaf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559e9e54ed20 0x559e9e5508d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc5643eaf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e9e54f100 0x559e9e4ba890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc5643eaf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559e9e4c36b0 con 0x559e9e54ed20 2024-09-12T02:02:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc5643eaf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559e9e3cb510 con 0x559e9e4c2640 2024-09-12T02:02:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc5643eaf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x559e9e47e2d0 con 0x559e9e54f100 2024-09-12T02:02:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc5616df640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559e9e54ed20 0x559e9e5508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc5616df640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559e9e54ed20 0x559e9e5508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38270/0 (socket says 172.21.15.19:38270) 2024-09-12T02:02:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc5616df640 1 -- 172.21.15.19:0/2504600482 learned_addr learned my addr 172.21.15.19:0/2504600482 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc561ee0640 1 --2- 172.21.15.19:0/2504600482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9e4c2640 0x559e9e545370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc5626e1640 1 --2- 172.21.15.19:0/2504600482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e9e54f100 0x559e9e4ba890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc5616df640 1 -- 172.21.15.19:0/2504600482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e9e54f100 msgr2=0x559e9e4ba890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc5616df640 1 --2- 172.21.15.19:0/2504600482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e9e54f100 0x559e9e4ba890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc5616df640 1 -- 172.21.15.19:0/2504600482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9e4c2640 msgr2=0x559e9e545370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc5616df640 1 --2- 172.21.15.19:0/2504600482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9e4c2640 0x559e9e545370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc5616df640 1 -- 172.21.15.19:0/2504600482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e9e545b30 con 0x559e9e54ed20 2024-09-12T02:02:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc5616df640 1 --2- 172.21.15.19:0/2504600482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559e9e54ed20 0x559e9e5508d0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fc558001e90 tx=0x7fc55800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2089dce273e22400 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc553fff640 1 -- 172.21.15.19:0/2504600482 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558012020 con 0x559e9e54ed20 2024-09-12T02:02:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc553fff640 1 -- 172.21.15.19:0/2504600482 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc55800e690 con 0x559e9e54ed20 2024-09-12T02:02:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.851+0000 7fc553fff640 1 -- 172.21.15.19:0/2504600482 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55800ea80 con 0x559e9e54ed20 2024-09-12T02:02:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.852+0000 7fc5643eaf40 1 -- 172.21.15.19:0/2504600482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559e9e54ed20 msgr2=0x559e9e5508d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.852+0000 7fc5643eaf40 1 --2- 172.21.15.19:0/2504600482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559e9e54ed20 0x559e9e5508d0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fc558001e90 tx=0x7fc55800b780 comp rx=0 tx=0).stop 2024-09-12T02:02:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.852+0000 7fc5643eaf40 1 -- 172.21.15.19:0/2504600482 shutdown_connections 2024-09-12T02:02:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.852+0000 7fc5643eaf40 1 --2- 172.21.15.19:0/2504600482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e9e54f100 0x559e9e4ba890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.852+0000 7fc5643eaf40 1 --2- 172.21.15.19:0/2504600482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559e9e54ed20 0x559e9e5508d0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.852+0000 7fc5643eaf40 1 --2- 172.21.15.19:0/2504600482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9e4c2640 0x559e9e545370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.852+0000 7fc5643eaf40 1 -- 172.21.15.19:0/2504600482 >> 172.21.15.19:0/2504600482 conn(0x559e9e4a7490 msgr2=0x559e9e4a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.852+0000 7fc5643eaf40 1 -- 172.21.15.19:0/2504600482 shutdown_connections 2024-09-12T02:02:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.852+0000 7fc5643eaf40 1 -- 172.21.15.19:0/2504600482 wait complete. 2024-09-12T02:02:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.853+0000 7fc5643eaf40 1 Processor -- start 2024-09-12T02:02:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.853+0000 7fc5643eaf40 1 -- start start 2024-09-12T02:02:57.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.853+0000 7fc5643eaf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9e4c2640 0x559e9e53f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.853+0000 7fc5643eaf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559e9e54ed20 0x559e9e5e5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.853+0000 7fc5643eaf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e9e54f100 0x559e9e541df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.853+0000 7fc5643eaf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559e9e4a6e30 con 0x559e9e54ed20 2024-09-12T02:02:57.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.853+0000 7fc5643eaf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559e9e4a9e90 con 0x559e9e4c2640 2024-09-12T02:02:57.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.853+0000 7fc5643eaf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x559e9e4aa0e0 con 0x559e9e54f100 2024-09-12T02:02:57.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.853+0000 7fc5616df640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559e9e54ed20 0x559e9e5e5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.853+0000 7fc5616df640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559e9e54ed20 0x559e9e5e5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38272/0 (socket says 172.21.15.19:38272) 2024-09-12T02:02:57.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.853+0000 7fc5616df640 1 -- 172.21.15.19:0/1321544896 learned_addr learned my addr 172.21.15.19:0/1321544896 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:57.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.854+0000 7fc5626e1640 1 --2- 172.21.15.19:0/1321544896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e9e54f100 0x559e9e541df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.854+0000 7fc561ee0640 1 --2- 172.21.15.19:0/1321544896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9e4c2640 0x559e9e53f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.854+0000 7fc5616df640 1 -- 172.21.15.19:0/1321544896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e9e54f100 msgr2=0x559e9e541df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.854+0000 7fc5616df640 1 --2- 172.21.15.19:0/1321544896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e9e54f100 0x559e9e541df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.854+0000 7fc5616df640 1 -- 172.21.15.19:0/1321544896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9e4c2640 msgr2=0x559e9e53f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.854+0000 7fc5616df640 1 --2- 172.21.15.19:0/1321544896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9e4c2640 0x559e9e53f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.854+0000 7fc5616df640 1 -- 172.21.15.19:0/1321544896 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e9e5510f0 con 0x559e9e54ed20 2024-09-12T02:02:57.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.854+0000 7fc561ee0640 1 --2- 172.21.15.19:0/1321544896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9e4c2640 0x559e9e53f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:57.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.854+0000 7fc5626e1640 1 --2- 172.21.15.19:0/1321544896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e9e54f100 0x559e9e541df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:57.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.854+0000 7fc5616df640 1 --2- 172.21.15.19:0/1321544896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559e9e54ed20 0x559e9e5e5d70 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fc55800b7c0 tx=0x7fc558000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:57.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.854+0000 7fc552ffd640 1 -- 172.21.15.19:0/1321544896 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558027070 con 0x559e9e54ed20 2024-09-12T02:02:57.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.854+0000 7fc552ffd640 1 -- 172.21.15.19:0/1321544896 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc558017420 con 0x559e9e54ed20 2024-09-12T02:02:57.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.854+0000 7fc552ffd640 1 -- 172.21.15.19:0/1321544896 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5580177d0 con 0x559e9e54ed20 2024-09-12T02:02:57.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.854+0000 7fc5643eaf40 1 -- 172.21.15.19:0/1321544896 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e9e5513d0 con 0x559e9e54ed20 2024-09-12T02:02:57.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.854+0000 7fc5643eaf40 1 -- 172.21.15.19:0/1321544896 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e9e551e20 con 0x559e9e54ed20 2024-09-12T02:02:57.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.856+0000 7fc552ffd640 1 -- 172.21.15.19:0/1321544896 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc55802a070 con 0x559e9e54ed20 2024-09-12T02:02:57.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.856+0000 7fc552ffd640 1 --2- 172.21.15.19:0/1321544896 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc54406a810 0x7fc54406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.856+0000 7fc552ffd640 1 -- 172.21.15.19:0/1321544896 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6647+0+0 (secure 0 0 0) 0x7fc55808b3e0 con 0x559e9e54ed20 2024-09-12T02:02:57.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.856+0000 7fc561ee0640 1 --2- 172.21.15.19:0/1321544896 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc54406a810 0x7fc54406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.856+0000 7fc5643eaf40 1 --2- 172.21.15.19:0/1321544896 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559e9e542f20 0x559e9e543330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:57.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.856+0000 7fc5643eaf40 1 -- 172.21.15.19:0/1321544896 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:1 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x559e9e543870 con 0x559e9e542f20 2024-09-12T02:02:57.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.856+0000 7fc5626e1640 1 --2- 172.21.15.19:0/1321544896 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559e9e542f20 0x559e9e543330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:57.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.857+0000 7fc561ee0640 1 --2- 172.21.15.19:0/1321544896 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc54406a810 0x7fc54406ccd0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc554005400 tx=0x7fc55400c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:57.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.857+0000 7fc5626e1640 1 --2- 172.21.15.19:0/1321544896 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559e9e542f20 0x559e9e543330 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:57.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.858+0000 7fc5626e1640 1 -- 172.21.15.19:0/1321544896 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(1 200.00000001 [delete] v99'129 uv129 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc55c04e040 con 0x559e9e542f20 2024-09-12T02:02:57.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.858+0000 7fc5643eaf40 1 -- 172.21.15.19:0/1321544896 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559e9e542f20 msgr2=0x559e9e543330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.858+0000 7fc5643eaf40 1 --2- 172.21.15.19:0/1321544896 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559e9e542f20 0x559e9e543330 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.858+0000 7fc5643eaf40 1 -- 172.21.15.19:0/1321544896 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc54406a810 msgr2=0x7fc54406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.858+0000 7fc5643eaf40 1 --2- 172.21.15.19:0/1321544896 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc54406a810 0x7fc54406ccd0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc554005400 tx=0x7fc55400c040 comp rx=0 tx=0).stop 2024-09-12T02:02:57.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.858+0000 7fc5643eaf40 1 -- 172.21.15.19:0/1321544896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559e9e54ed20 msgr2=0x559e9e5e5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:57.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.858+0000 7fc5643eaf40 1 --2- 172.21.15.19:0/1321544896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559e9e54ed20 0x559e9e5e5d70 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fc55800b7c0 tx=0x7fc558000ed0 comp rx=0 tx=0).stop 2024-09-12T02:02:57.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.858+0000 7fc5626e1640 1 -- 172.21.15.19:0/1321544896 reap_dead start 2024-09-12T02:02:57.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.858+0000 7fc5643eaf40 1 -- 172.21.15.19:0/1321544896 shutdown_connections 2024-09-12T02:02:57.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.858+0000 7fc5643eaf40 1 -- 172.21.15.19:0/1321544896 >> 172.21.15.19:0/1321544896 conn(0x559e9e4a7490 msgr2=0x559e9e47cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:57.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.858+0000 7fc5643eaf40 1 -- 172.21.15.19:0/1321544896 shutdown_connections 2024-09-12T02:02:57.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:57.858+0000 7fc5643eaf40 1 -- 172.21.15.19:0/1321544896 wait complete. 2024-09-12T02:02:57.862 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:02:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.007+0000 7fb97b166640 1 Processor -- start 2024-09-12T02:02:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.007+0000 7fb97b166640 1 -- start start 2024-09-12T02:02:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.008+0000 7fb97b166640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb9740d5090 0x7fb9740cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.008+0000 7fb97b166640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9740cfae0 0x7fb9740b1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.008+0000 7fb97b166640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9740d34f0 con 0x7fb97415e6c0 2024-09-12T02:02:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.008+0000 7fb97b166640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb9740cf400 con 0x7fb9740d5090 2024-09-12T02:02:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.008+0000 7fb97b166640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb9740cff30 con 0x7fb9740cfae0 2024-09-12T02:02:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.008+0000 7fb973fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb9740d5090 0x7fb9740cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.008+0000 7fb973fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb9740d5090 0x7fb9740cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38284/0 (socket says 172.21.15.19:38284) 2024-09-12T02:02:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.008+0000 7fb973fff640 1 -- 172.21.15.19:0/1480130125 learned_addr learned my addr 172.21.15.19:0/1480130125 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.009+0000 7fb979703640 1 --2- 172.21.15.19:0/1480130125 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9740cfae0 0x7fb9740b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.009+0000 7fb973fff640 1 -- 172.21.15.19:0/1480130125 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9740cfae0 msgr2=0x7fb9740b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.009+0000 7fb973fff640 1 --2- 172.21.15.19:0/1480130125 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9740cfae0 0x7fb9740b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.009+0000 7fb973fff640 1 -- 172.21.15.19:0/1480130125 >> v1:172.21.15.135:6789/0 conn(0x7fb97415e6c0 legacy=0x7fb9740cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.009+0000 7fb973fff640 1 -- 172.21.15.19:0/1480130125 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9740d3790 con 0x7fb9740d5090 2024-09-12T02:02:58.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.010+0000 7fb973fff640 1 --2- 172.21.15.19:0/1480130125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9740d5090 0x7fb9740cf5a0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009870 tx=0x7fb95c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ab1553ef5fd6d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:58.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.010+0000 7fb9737fe640 1 -- 172.21.15.19:0/1480130125 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c037070 con 0x7fb9740d5090 2024-09-12T02:02:58.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.010+0000 7fb9737fe640 1 -- 172.21.15.19:0/1480130125 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb95c032440 con 0x7fb9740d5090 2024-09-12T02:02:58.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.010+0000 7fb9737fe640 1 -- 172.21.15.19:0/1480130125 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c032810 con 0x7fb9740d5090 2024-09-12T02:02:58.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.010+0000 7fb97b166640 1 -- 172.21.15.19:0/1480130125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9740d5090 msgr2=0x7fb9740cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:58.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.010+0000 7fb97b166640 1 --2- 172.21.15.19:0/1480130125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9740d5090 0x7fb9740cf5a0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009870 tx=0x7fb95c02a1c0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.010+0000 7fb97b166640 1 -- 172.21.15.19:0/1480130125 shutdown_connections 2024-09-12T02:02:58.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.010+0000 7fb97b166640 1 --2- 172.21.15.19:0/1480130125 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9740cfae0 0x7fb9740b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.010+0000 7fb97b166640 1 --2- 172.21.15.19:0/1480130125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9740d5090 0x7fb9740cf5a0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.010+0000 7fb97b166640 1 -- 172.21.15.19:0/1480130125 >> 172.21.15.19:0/1480130125 conn(0x7fb97408bfc0 msgr2=0x7fb9740d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:58.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.010+0000 7fb97b166640 1 -- 172.21.15.19:0/1480130125 shutdown_connections 2024-09-12T02:02:58.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.010+0000 7fb97b166640 1 -- 172.21.15.19:0/1480130125 wait complete. 2024-09-12T02:02:58.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.011+0000 7fb97b166640 1 Processor -- start 2024-09-12T02:02:58.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.012+0000 7fb97b166640 1 -- start start 2024-09-12T02:02:58.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.012+0000 7fb97b166640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9740cfae0 0x7fb9740b7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:58.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.012+0000 7fb97b166640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9740d5090 0x7fb97415ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:58.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.012+0000 7fb97b166640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb97415e6c0 0x7fb974159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:58.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.012+0000 7fb97b166640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb97415eaa0 con 0x7fb9740d5090 2024-09-12T02:02:58.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.012+0000 7fb97b166640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb9740b10d0 con 0x7fb97415e6c0 2024-09-12T02:02:58.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.012+0000 7fb97b166640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb97415ec20 con 0x7fb9740cfae0 2024-09-12T02:02:58.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.013+0000 7fb973fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9740d5090 0x7fb97415ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:58.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.013+0000 7fb973fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9740d5090 0x7fb97415ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38294/0 (socket says 172.21.15.19:38294) 2024-09-12T02:02:58.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.013+0000 7fb973fff640 1 -- 172.21.15.19:0/2521170432 learned_addr learned my addr 172.21.15.19:0/2521170432 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:58.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.013+0000 7fb979703640 1 --2- 172.21.15.19:0/2521170432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb97415e6c0 0x7fb974159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:58.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.013+0000 7fb978f02640 1 --2- 172.21.15.19:0/2521170432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9740cfae0 0x7fb9740b7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:58.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.013+0000 7fb973fff640 1 -- 172.21.15.19:0/2521170432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9740cfae0 msgr2=0x7fb9740b7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:58.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.013+0000 7fb973fff640 1 --2- 172.21.15.19:0/2521170432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9740cfae0 0x7fb9740b7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.013+0000 7fb973fff640 1 -- 172.21.15.19:0/2521170432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb97415e6c0 msgr2=0x7fb974159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:58.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.013+0000 7fb973fff640 1 --2- 172.21.15.19:0/2521170432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb97415e6c0 0x7fb974159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.013+0000 7fb973fff640 1 -- 172.21.15.19:0/2521170432 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9741f57e0 con 0x7fb9740d5090 2024-09-12T02:02:58.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.013+0000 7fb979703640 1 --2- 172.21.15.19:0/2521170432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb97415e6c0 0x7fb974159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:58.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.013+0000 7fb973fff640 1 --2- 172.21.15.19:0/2521170432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9740d5090 0x7fb97415ae20 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fb95c000c00 tx=0x7fb95c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:58.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.013+0000 7fb9717fa640 1 -- 172.21.15.19:0/2521170432 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c037040 con 0x7fb9740d5090 2024-09-12T02:02:58.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.013+0000 7fb9717fa640 1 -- 172.21.15.19:0/2521170432 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb95c042070 con 0x7fb9740d5090 2024-09-12T02:02:58.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.013+0000 7fb97b166640 1 -- 172.21.15.19:0/2521170432 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9740b8e20 con 0x7fb9740d5090 2024-09-12T02:02:58.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.013+0000 7fb9717fa640 1 -- 172.21.15.19:0/2521170432 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c030880 con 0x7fb9740d5090 2024-09-12T02:02:58.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.013+0000 7fb97b166640 1 -- 172.21.15.19:0/2521170432 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb97415b360 con 0x7fb9740d5090 2024-09-12T02:02:58.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.014+0000 7fb97b166640 1 -- 172.21.15.19:0/2521170432 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9740cf5a0 con 0x7fb9740d5090 2024-09-12T02:02:58.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.015+0000 7fb9717fa640 1 -- 172.21.15.19:0/2521170432 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb95c02ad10 con 0x7fb9740d5090 2024-09-12T02:02:58.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.015+0000 7fb9717fa640 1 --2- 172.21.15.19:0/2521170432 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb95406be30 0x7fb95406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:58.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.015+0000 7fb9717fa640 1 -- 172.21.15.19:0/2521170432 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6647+0+0 (secure 0 0 0) 0x7fb95c0ab590 con 0x7fb9740d5090 2024-09-12T02:02:58.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.015+0000 7fb978f02640 1 --2- 172.21.15.19:0/2521170432 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb95406be30 0x7fb95406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:58.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.016+0000 7fb978f02640 1 --2- 172.21.15.19:0/2521170432 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb95406be30 0x7fb95406e2f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb9640012e0 tx=0x7fb964009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:58.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.020+0000 7fb9717fa640 1 -- 172.21.15.19:0/2521170432 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb95c0795d0 con 0x7fb9740d5090 2024-09-12T02:02:58.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.231+0000 7fb97b166640 1 -- 172.21.15.19:0/2521170432 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fb9740b6d30 con 0x7fb9740d5090 2024-09-12T02:02:58.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.509+0000 7fb9717fa640 1 -- 172.21.15.19:0/2521170432 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v107) ==== 162+0+0 (secure 0 0 0) 0x7fb95c07d8d0 con 0x7fb9740d5090 2024-09-12T02:02:58.510 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:02:58.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.512+0000 7fb97b166640 1 -- 172.21.15.19:0/2521170432 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb95406be30 msgr2=0x7fb95406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:58.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.512+0000 7fb97b166640 1 --2- 172.21.15.19:0/2521170432 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb95406be30 0x7fb95406e2f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb9640012e0 tx=0x7fb964009040 comp rx=0 tx=0).stop 2024-09-12T02:02:58.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.512+0000 7fb97b166640 1 -- 172.21.15.19:0/2521170432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9740d5090 msgr2=0x7fb97415ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:58.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.512+0000 7fb97b166640 1 --2- 172.21.15.19:0/2521170432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9740d5090 0x7fb97415ae20 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fb95c000c00 tx=0x7fb95c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.512+0000 7fb97b166640 1 -- 172.21.15.19:0/2521170432 shutdown_connections 2024-09-12T02:02:58.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.512+0000 7fb97b166640 1 --2- 172.21.15.19:0/2521170432 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb95406be30 0x7fb95406e2f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.512+0000 7fb97b166640 1 --2- 172.21.15.19:0/2521170432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb97415e6c0 0x7fb974159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.512+0000 7fb97b166640 1 --2- 172.21.15.19:0/2521170432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9740d5090 0x7fb97415ae20 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.512+0000 7fb97b166640 1 --2- 172.21.15.19:0/2521170432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9740cfae0 0x7fb9740b7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.512+0000 7fb97b166640 1 -- 172.21.15.19:0/2521170432 >> 172.21.15.19:0/2521170432 conn(0x7fb97408bfc0 msgr2=0x7fb9740b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:58.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.512+0000 7fb97b166640 1 -- 172.21.15.19:0/2521170432 shutdown_connections 2024-09-12T02:02:58.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.512+0000 7fb97b166640 1 -- 172.21.15.19:0/2521170432 wait complete. 2024-09-12T02:02:58.519 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:02:58.519+0000 7faa90fbd640 -1 log_channel(cluster) log [ERR] : missing journal object 2024-09-12T02:02:58.520 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:02:58.520+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:02:58.520 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:02:58.520+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:02:58.526 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:58.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.628+0000 7fb68ff18640 1 Processor -- start 2024-09-12T02:02:58.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.628+0000 7fb68ff18640 1 -- start start 2024-09-12T02:02:58.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.629+0000 7fb68ff18640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb688072d30 0x7fb68806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:58.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.629+0000 7fb68ff18640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb68806f700 0x7fb68815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:58.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.629+0000 7fb68ff18640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6880cdbe0 con 0x7fb68815b300 2024-09-12T02:02:58.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.629+0000 7fb68ff18640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb68806fb50 con 0x7fb68806f700 2024-09-12T02:02:58.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.629+0000 7fb68ff18640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb6880728a0 con 0x7fb688072d30 2024-09-12T02:02:58.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.629+0000 7fb68e4b5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb68806f700 0x7fb68815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:58.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.629+0000 7fb68dcb4640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb68815b300 0x7fb6880cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40620/0 (socket says 172.21.15.19:40620) 2024-09-12T02:02:58.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.629+0000 7fb68e4b5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb68806f700 0x7fb68815b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38304/0 (socket says 172.21.15.19:38304) 2024-09-12T02:02:58.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.629+0000 7fb68dcb4640 1 -- 172.21.15.19:0/2808218004 learned_addr learned my addr 172.21.15.19:0/2808218004 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:58.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.629+0000 7fb68d4b3640 1 --2- 172.21.15.19:0/2808218004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb688072d30 0x7fb68806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:58.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.629+0000 7fb68e4b5640 1 -- 172.21.15.19:0/2808218004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb688072d30 msgr2=0x7fb68806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:58.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.629+0000 7fb68e4b5640 1 --2- 172.21.15.19:0/2808218004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb688072d30 0x7fb68806f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.629+0000 7fb68e4b5640 1 -- 172.21.15.19:0/2808218004 >> v1:172.21.15.19:6789/0 conn(0x7fb68815b300 legacy=0x7fb6880cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:58.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.630+0000 7fb68e4b5640 1 -- 172.21.15.19:0/2808218004 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6880cd900 con 0x7fb68806f700 2024-09-12T02:02:58.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.629+0000 7fb68ccb2640 1 -- 172.21.15.19:0/2808218004 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3760690421 0 0) 0x7fb6880cdbe0 con 0x7fb68815b300 2024-09-12T02:02:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.630+0000 7fb68e4b5640 1 --2- 172.21.15.19:0/2808218004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb68806f700 0x7fb68815b6e0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fb67800bfa0 tx=0x7fb67802c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25f8167aed6c6b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.630+0000 7fb68ccb2640 1 -- 172.21.15.19:0/2808218004 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678039070 con 0x7fb68806f700 2024-09-12T02:02:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.630+0000 7fb68ccb2640 1 -- 172.21.15.19:0/2808218004 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb678009540 con 0x7fb68806f700 2024-09-12T02:02:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.630+0000 7fb68ccb2640 1 -- 172.21.15.19:0/2808218004 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678009910 con 0x7fb68806f700 2024-09-12T02:02:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.631+0000 7fb68ff18640 1 -- 172.21.15.19:0/2808218004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb68806f700 msgr2=0x7fb68815b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.631+0000 7fb68ff18640 1 --2- 172.21.15.19:0/2808218004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb68806f700 0x7fb68815b6e0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fb67800bfa0 tx=0x7fb67802c860 comp rx=0 tx=0).stop 2024-09-12T02:02:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.631+0000 7fb68ff18640 1 -- 172.21.15.19:0/2808218004 shutdown_connections 2024-09-12T02:02:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.631+0000 7fb68ff18640 1 --2- 172.21.15.19:0/2808218004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb68806f700 0x7fb68815b6e0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.631+0000 7fb68ff18640 1 --2- 172.21.15.19:0/2808218004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb688072d30 0x7fb68806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.631+0000 7fb68ff18640 1 -- 172.21.15.19:0/2808218004 >> 172.21.15.19:0/2808218004 conn(0x7fb688067d70 msgr2=0x7fb68806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:58.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.631+0000 7fb68ff18640 1 -- 172.21.15.19:0/2808218004 shutdown_connections 2024-09-12T02:02:58.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.631+0000 7fb68ff18640 1 -- 172.21.15.19:0/2808218004 wait complete. 2024-09-12T02:02:58.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.632+0000 7fb68ff18640 1 Processor -- start 2024-09-12T02:02:58.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.632+0000 7fb68ff18640 1 -- start start 2024-09-12T02:02:58.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.633+0000 7fb68ff18640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb68806f700 0x7fb68814e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:58.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.633+0000 7fb68ff18640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb688072d30 0x7fb68815ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:58.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.633+0000 7fb68ff18640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb68815b300 0x7fb68815bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:58.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.633+0000 7fb68ff18640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb6880cd5c0 con 0x7fb688072d30 2024-09-12T02:02:58.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.633+0000 7fb68ff18640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb688072530 con 0x7fb68815b300 2024-09-12T02:02:58.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.633+0000 7fb68ff18640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb6880cffe0 con 0x7fb68806f700 2024-09-12T02:02:58.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.633+0000 7fb68d4b3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb688072d30 0x7fb68815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:58.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.633+0000 7fb68d4b3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb688072d30 0x7fb68815ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38320/0 (socket says 172.21.15.19:38320) 2024-09-12T02:02:58.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.633+0000 7fb68d4b3640 1 -- 172.21.15.19:0/943812931 learned_addr learned my addr 172.21.15.19:0/943812931 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:58.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.633+0000 7fb68dcb4640 1 --2- 172.21.15.19:0/943812931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb68806f700 0x7fb68814e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:58.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.633+0000 7fb68e4b5640 1 --2- 172.21.15.19:0/943812931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb68815b300 0x7fb68815bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:58.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.633+0000 7fb68d4b3640 1 -- 172.21.15.19:0/943812931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb68806f700 msgr2=0x7fb68814e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:58.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.633+0000 7fb68d4b3640 1 --2- 172.21.15.19:0/943812931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb68806f700 0x7fb68814e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.633+0000 7fb68d4b3640 1 -- 172.21.15.19:0/943812931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb68815b300 msgr2=0x7fb68815bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:58.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.633+0000 7fb68d4b3640 1 --2- 172.21.15.19:0/943812931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb68815b300 0x7fb68815bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.633+0000 7fb68d4b3640 1 -- 172.21.15.19:0/943812931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6880ae790 con 0x7fb688072d30 2024-09-12T02:02:58.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.634+0000 7fb68d4b3640 1 --2- 172.21.15.19:0/943812931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb688072d30 0x7fb68815ded0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00d830 tx=0x7fb67c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:58.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.634+0000 7fb6867fc640 1 -- 172.21.15.19:0/943812931 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c00b6c0 con 0x7fb688072d30 2024-09-12T02:02:58.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.634+0000 7fb6867fc640 1 -- 172.21.15.19:0/943812931 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb67c019070 con 0x7fb688072d30 2024-09-12T02:02:58.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.634+0000 7fb68ff18640 1 -- 172.21.15.19:0/943812931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6880aea70 con 0x7fb688072d30 2024-09-12T02:02:58.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.634+0000 7fb6867fc640 1 -- 172.21.15.19:0/943812931 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c00ba80 con 0x7fb688072d30 2024-09-12T02:02:58.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.634+0000 7fb68ff18640 1 -- 172.21.15.19:0/943812931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6880af030 con 0x7fb688072d30 2024-09-12T02:02:58.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.635+0000 7fb68ff18640 1 -- 172.21.15.19:0/943812931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6880ce350 con 0x7fb688072d30 2024-09-12T02:02:58.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.635+0000 7fb6867fc640 1 -- 172.21.15.19:0/943812931 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb67c01e460 con 0x7fb688072d30 2024-09-12T02:02:58.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.636+0000 7fb6867fc640 1 --2- 172.21.15.19:0/943812931 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb67406be60 0x7fb67406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:58.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.636+0000 7fb6867fc640 1 -- 172.21.15.19:0/943812931 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6733+0+0 (secure 0 0 0) 0x7fb67c08b700 con 0x7fb688072d30 2024-09-12T02:02:58.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.636+0000 7fb68dcb4640 1 --2- 172.21.15.19:0/943812931 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb67406be60 0x7fb67406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:58.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.636+0000 7fb68dcb4640 1 --2- 172.21.15.19:0/943812931 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb67406be60 0x7fb67406e320 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb680007fd0 tx=0x7fb680007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:58.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.640+0000 7fb6867fc640 1 -- 172.21.15.19:0/943812931 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb67c0596f0 con 0x7fb688072d30 2024-09-12T02:02:58.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.853+0000 7fb68ff18640 1 -- 172.21.15.19:0/943812931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6880b1060 con 0x7fb688072d30 2024-09-12T02:02:58.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.853+0000 7fb6867fc640 1 -- 172.21.15.19:0/943812931 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+3563 (secure 0 0 0) 0x7fb67c05d9f0 con 0x7fb688072d30 2024-09-12T02:02:58.854 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:58.854 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":109,"btime":"2024-09-12T02:02:58:521571+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:02:58.521497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:02:58.854 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 109 2024-09-12T02:02:58.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.855+0000 7fb68ff18640 1 -- 172.21.15.19:0/943812931 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb67406be60 msgr2=0x7fb67406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:58.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.855+0000 7fb68ff18640 1 --2- 172.21.15.19:0/943812931 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb67406be60 0x7fb67406e320 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb680007fd0 tx=0x7fb680007de0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.855+0000 7fb68ff18640 1 -- 172.21.15.19:0/943812931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb688072d30 msgr2=0x7fb68815ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:58.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.855+0000 7fb68ff18640 1 --2- 172.21.15.19:0/943812931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb688072d30 0x7fb68815ded0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00d830 tx=0x7fb67c00dcf0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.855+0000 7fb68ff18640 1 -- 172.21.15.19:0/943812931 shutdown_connections 2024-09-12T02:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.855+0000 7fb68ff18640 1 --2- 172.21.15.19:0/943812931 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb67406be60 0x7fb67406e320 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.855+0000 7fb68ff18640 1 --2- 172.21.15.19:0/943812931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb68815b300 0x7fb68815bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.855+0000 7fb68ff18640 1 --2- 172.21.15.19:0/943812931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb688072d30 0x7fb68815ded0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.855+0000 7fb68ff18640 1 --2- 172.21.15.19:0/943812931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb68806f700 0x7fb68814e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.855+0000 7fb68ff18640 1 -- 172.21.15.19:0/943812931 >> 172.21.15.19:0/943812931 conn(0x7fb688067d70 msgr2=0x7fb6880b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.855+0000 7fb68ff18640 1 -- 172.21.15.19:0/943812931 shutdown_connections 2024-09-12T02:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.855+0000 7fb68ff18640 1 -- 172.21.15.19:0/943812931 wait complete. 2024-09-12T02:02:58.867 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:02:58.867 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:58.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.969+0000 7f675f36d640 1 Processor -- start 2024-09-12T02:02:58.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.969+0000 7f675f36d640 1 -- start start 2024-09-12T02:02:58.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.970+0000 7f675f36d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f675815e760 0x7f675806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:58.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.970+0000 7f675f36d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67580d4fd0 0x7f67580cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:58.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.970+0000 7f675f36d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67580d2700 con 0x7f67580b3650 2024-09-12T02:02:58.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.970+0000 7f675f36d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f67580cedb0 con 0x7f675815e760 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.970+0000 7f675f36d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f67580cf090 con 0x7f67580d4fd0 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.970+0000 7f675d109640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f675815e760 0x7f675806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.970+0000 7f675d109640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f675815e760 0x7f675806cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38332/0 (socket says 172.21.15.19:38332) 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.970+0000 7f675d109640 1 -- 172.21.15.19:0/3924094868 learned_addr learned my addr 172.21.15.19:0/3924094868 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.970+0000 7f675c908640 1 --2- 172.21.15.19:0/3924094868 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67580d4fd0 0x7f67580cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.970+0000 7f675d109640 1 -- 172.21.15.19:0/3924094868 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67580d4fd0 msgr2=0x7f67580cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.970+0000 7f675d109640 1 --2- 172.21.15.19:0/3924094868 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67580d4fd0 0x7f67580cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.970+0000 7f675d109640 1 -- 172.21.15.19:0/3924094868 >> v1:172.21.15.135:6789/0 conn(0x7f67580b3650 legacy=0x7f67580d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.970+0000 7f675d109640 1 -- 172.21.15.19:0/3924094868 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67580b3c80 con 0x7f675815e760 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.971+0000 7f675d109640 1 --2- 172.21.15.19:0/3924094868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f675815e760 0x7f675806cdd0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f6754009870 tx=0x7f675402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f4b2febe55a4c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.971+0000 7f674ffff640 1 -- 172.21.15.19:0/3924094868 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6754037070 con 0x7f675815e760 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.971+0000 7f674ffff640 1 -- 172.21.15.19:0/3924094868 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6754032440 con 0x7f675815e760 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.971+0000 7f674ffff640 1 -- 172.21.15.19:0/3924094868 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6754032810 con 0x7f675815e760 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.972+0000 7f675f36d640 1 -- 172.21.15.19:0/3924094868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f675815e760 msgr2=0x7f675806cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.972+0000 7f675f36d640 1 --2- 172.21.15.19:0/3924094868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f675815e760 0x7f675806cdd0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f6754009870 tx=0x7f675402a1c0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.972+0000 7f675f36d640 1 -- 172.21.15.19:0/3924094868 shutdown_connections 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.972+0000 7f675f36d640 1 --2- 172.21.15.19:0/3924094868 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67580d4fd0 0x7f67580cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.972+0000 7f675f36d640 1 --2- 172.21.15.19:0/3924094868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f675815e760 0x7f675806cdd0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.972+0000 7f675f36d640 1 -- 172.21.15.19:0/3924094868 >> 172.21.15.19:0/3924094868 conn(0x7f675808bfc0 msgr2=0x7f67580d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.972+0000 7f675f36d640 1 -- 172.21.15.19:0/3924094868 shutdown_connections 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.972+0000 7f675f36d640 1 -- 172.21.15.19:0/3924094868 wait complete. 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.973+0000 7f675f36d640 1 Processor -- start 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.973+0000 7f675f36d640 1 -- start start 2024-09-12T02:02:58.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f675f36d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67580b3650 0x7f6758155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f675f36d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67580d4fd0 0x7f6758161040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f675f36d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f675815e760 0x7f6758161580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f675f36d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f67580cfe80 con 0x7f67580d4fd0 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f675f36d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f67580cfd00 con 0x7f67580b3650 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f675f36d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f67580d35b0 con 0x7f675815e760 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f675c908640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67580d4fd0 0x7f6758161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f675c908640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67580d4fd0 0x7f6758161040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38348/0 (socket says 172.21.15.19:38348) 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f675c908640 1 -- 172.21.15.19:0/3848721099 learned_addr learned my addr 172.21.15.19:0/3848721099 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f675d109640 1 --2- 172.21.15.19:0/3848721099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67580b3650 0x7f6758155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f675d90a640 1 --2- 172.21.15.19:0/3848721099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f675815e760 0x7f6758161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f675c908640 1 -- 172.21.15.19:0/3848721099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f675815e760 msgr2=0x7f6758161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f675c908640 1 --2- 172.21.15.19:0/3848721099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f675815e760 0x7f6758161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f675c908640 1 -- 172.21.15.19:0/3848721099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67580b3650 msgr2=0x7f6758155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f675c908640 1 --2- 172.21.15.19:0/3848721099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67580b3650 0x7f6758155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f675c908640 1 -- 172.21.15.19:0/3848721099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f675815f660 con 0x7f67580d4fd0 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f675c908640 1 --2- 172.21.15.19:0/3848721099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67580d4fd0 0x7f6758161040 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f674800d800 tx=0x7f674800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f674dffb640 1 -- 172.21.15.19:0/3848721099 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6748004020 con 0x7f67580d4fd0 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f674dffb640 1 -- 172.21.15.19:0/3848721099 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67480041c0 con 0x7f67580d4fd0 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f675f36d640 1 -- 172.21.15.19:0/3848721099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f675815f940 con 0x7f67580d4fd0 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.974+0000 7f674dffb640 1 -- 172.21.15.19:0/3848721099 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67480043b0 con 0x7f67580d4fd0 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.975+0000 7f675f36d640 1 -- 172.21.15.19:0/3848721099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67581561f0 con 0x7f67580d4fd0 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.976+0000 7f675f36d640 1 -- 172.21.15.19:0/3848721099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6758161ee0 con 0x7f67580d4fd0 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.976+0000 7f674dffb640 1 -- 172.21.15.19:0/3848721099 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f674801b020 con 0x7f67580d4fd0 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.976+0000 7f674dffb640 1 --2- 172.21.15.19:0/3848721099 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f673c06be30 0x7f673c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.976+0000 7f674dffb640 1 -- 172.21.15.19:0/3848721099 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6733+0+0 (secure 0 0 0) 0x7f674808ad10 con 0x7f67580d4fd0 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.977+0000 7f675d109640 1 --2- 172.21.15.19:0/3848721099 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f673c06be30 0x7f673c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:58.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.977+0000 7f675d109640 1 --2- 172.21.15.19:0/3848721099 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f673c06be30 0x7f673c06e2f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6754034000 tx=0x7f675402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:58.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:58.981+0000 7f674dffb640 1 -- 172.21.15.19:0/3848721099 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6758161ee0 con 0x7f67580d4fd0 2024-09-12T02:02:59.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.189+0000 7f675f36d640 1 -- 172.21.15.19:0/3848721099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67580d3980 con 0x7f67580d4fd0 2024-09-12T02:02:59.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.189+0000 7f674dffb640 1 -- 172.21.15.19:0/3848721099 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+3563 (secure 0 0 0) 0x7f6748090020 con 0x7f67580d4fd0 2024-09-12T02:02:59.190 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:59.190 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":109,"btime":"2024-09-12T02:02:58:521571+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:02:58.521497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:02:59.190 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 109 2024-09-12T02:02:59.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.192+0000 7f675f36d640 1 -- 172.21.15.19:0/3848721099 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f673c06be30 msgr2=0x7f673c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:59.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.192+0000 7f675f36d640 1 --2- 172.21.15.19:0/3848721099 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f673c06be30 0x7f673c06e2f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6754034000 tx=0x7f675402e000 comp rx=0 tx=0).stop 2024-09-12T02:02:59.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.192+0000 7f675f36d640 1 -- 172.21.15.19:0/3848721099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67580d4fd0 msgr2=0x7f6758161040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:59.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.192+0000 7f675f36d640 1 --2- 172.21.15.19:0/3848721099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67580d4fd0 0x7f6758161040 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f674800d800 tx=0x7f674800dcc0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.192+0000 7f675f36d640 1 -- 172.21.15.19:0/3848721099 shutdown_connections 2024-09-12T02:02:59.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.192+0000 7f675f36d640 1 --2- 172.21.15.19:0/3848721099 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f673c06be30 0x7f673c06e2f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.192+0000 7f675f36d640 1 --2- 172.21.15.19:0/3848721099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f675815e760 0x7f6758161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.192+0000 7f675f36d640 1 --2- 172.21.15.19:0/3848721099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67580d4fd0 0x7f6758161040 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.192+0000 7f675f36d640 1 --2- 172.21.15.19:0/3848721099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67580b3650 0x7f6758155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.192+0000 7f675f36d640 1 -- 172.21.15.19:0/3848721099 >> 172.21.15.19:0/3848721099 conn(0x7f675808bfc0 msgr2=0x7f67580b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:59.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.192+0000 7f675f36d640 1 -- 172.21.15.19:0/3848721099 shutdown_connections 2024-09-12T02:02:59.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.192+0000 7f675f36d640 1 -- 172.21.15.19:0/3848721099 wait complete. 2024-09-12T02:02:59.203 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:02:59.204 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:02:59.237 INFO:tasks.ceph.mds.d.smithi135.stderr: -36> 2024-09-12T02:02:54.486+0000 7fa8daaa7640 -1 log_channel(cluster) log [ERR] : Error recovering journal 0x200: (2) No such file or directory 2024-09-12T02:02:59.264 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T02:02:59.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.306+0000 7f02b8b3b640 1 Processor -- start 2024-09-12T02:02:59.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.306+0000 7f02b8b3b640 1 -- start start 2024-09-12T02:02:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.307+0000 7f02b8b3b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b415e5f0 0x7f02b40d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.307+0000 7f02b8b3b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f02b40b6690 0x7f02b406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.307+0000 7f02b8b3b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b40d3690 con 0x7f02b40d30f0 2024-09-12T02:02:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.307+0000 7f02b8b3b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f02b406d530 con 0x7f02b40b6690 2024-09-12T02:02:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.307+0000 7f02b8b3b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f02b40d3970 con 0x7f02b415e5f0 2024-09-12T02:02:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.307+0000 7f02a9d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f02b40d30f0 0x7f02b40b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40626/0 (socket says 172.21.15.19:40626) 2024-09-12T02:02:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.307+0000 7f02a9d9b640 1 -- 172.21.15.19:0/2560769071 learned_addr learned my addr 172.21.15.19:0/2560769071 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:02:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.307+0000 7f02b2d9d640 1 --2- 172.21.15.19:0/2560769071 >> v2:172.21.15.135:3300/0 conn(0x7f02b40b6690 0x7f02b406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.307+0000 7f02b259c640 1 --2- 172.21.15.19:0/2560769071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b415e5f0 0x7f02b40d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.307+0000 7f02b1d9b640 1 -- 172.21.15.19:0/2560769071 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3579199726 0 0) 0x7f02b40d3690 con 0x7f02b40d30f0 2024-09-12T02:02:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.307+0000 7f02b1d9b640 1 -- 172.21.15.19:0/2560769071 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02a0003520 con 0x7f02b40d30f0 2024-09-12T02:02:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.307+0000 7f02b1d9b640 1 -- 172.21.15.19:0/2560769071 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1380684562 0 0) 0x7f02a0003520 con 0x7f02b40d30f0 2024-09-12T02:02:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.307+0000 7f02b1d9b640 1 -- 172.21.15.19:0/2560769071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b415e5f0 msgr2=0x7f02b40d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.307+0000 7f02b1d9b640 1 --2- 172.21.15.19:0/2560769071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b415e5f0 0x7f02b40d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.307+0000 7f02b1d9b640 1 -- 172.21.15.19:0/2560769071 >> v2:172.21.15.135:3300/0 conn(0x7f02b40b6690 msgr2=0x7f02b406d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.307+0000 7f02b1d9b640 1 --2- 172.21.15.19:0/2560769071 >> v2:172.21.15.135:3300/0 conn(0x7f02b40b6690 0x7f02b406d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.307+0000 7f02b1d9b640 1 -- 172.21.15.19:0/2560769071 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b406cee0 con 0x7f02b40d30f0 2024-09-12T02:02:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.307+0000 7f02b1d9b640 1 -- 172.21.15.19:0/2560769071 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f029c001670 con 0x7f02b40d30f0 2024-09-12T02:02:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.308+0000 7f02b1d9b640 1 -- 172.21.15.19:0/2560769071 >> v1:172.21.15.19:6789/0 conn(0x7f02b40d30f0 legacy=0x7f02b40b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.308+0000 7f02b1d9b640 1 --2- 172.21.15.19:0/2560769071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02a00039b0 0x7f02a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.308+0000 7f02b1d9b640 1 --2- 172.21.15.19:0/2560769071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b415e5f0 0x7f02a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.308+0000 7f02b1d9b640 1 --2- 172.21.15.19:0/2560769071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a0004d40 0x7f02a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.308+0000 7f02b1d9b640 1 -- 172.21.15.19:0/2560769071 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f02b406d530 con 0x7f02a0004d40 2024-09-12T02:02:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.308+0000 7f02b1d9b640 1 -- 172.21.15.19:0/2560769071 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f02b40d3970 con 0x7f02a00039b0 2024-09-12T02:02:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.308+0000 7f02b1d9b640 1 -- 172.21.15.19:0/2560769071 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f02a000b9c0 con 0x7f02b415e5f0 2024-09-12T02:02:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.308+0000 7f02b2d9d640 1 --2- 172.21.15.19:0/2560769071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a0004d40 0x7f02a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.308+0000 7f02b259c640 1 --2- 172.21.15.19:0/2560769071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02a00039b0 0x7f02a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.308+0000 7f02a9d9b640 1 --2- 172.21.15.19:0/2560769071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b415e5f0 0x7f02a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.308+0000 7f02b2d9d640 1 -- 172.21.15.19:0/2560769071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b415e5f0 msgr2=0x7f02a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.308+0000 7f02b2d9d640 1 --2- 172.21.15.19:0/2560769071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b415e5f0 0x7f02a0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.308+0000 7f02b2d9d640 1 -- 172.21.15.19:0/2560769071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02a00039b0 msgr2=0x7f02a0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.308+0000 7f02b2d9d640 1 --2- 172.21.15.19:0/2560769071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02a00039b0 0x7f02a0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.308+0000 7f02b2d9d640 1 -- 172.21.15.19:0/2560769071 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a0003520 con 0x7f02a0004d40 2024-09-12T02:02:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.309+0000 7f02b2d9d640 1 --2- 172.21.15.19:0/2560769071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a0004d40 0x7f02a00051c0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009fc0 tx=0x7f02a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a284a5f8db6b75d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.309+0000 7f02b1d9b640 1 -- 172.21.15.19:0/2560769071 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac009c10 con 0x7f02a0004d40 2024-09-12T02:02:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.309+0000 7f02b1d9b640 1 -- 172.21.15.19:0/2560769071 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ac036070 con 0x7f02a0004d40 2024-09-12T02:02:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.309+0000 7f02b1d9b640 1 -- 172.21.15.19:0/2560769071 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac02d070 con 0x7f02a0004d40 2024-09-12T02:02:59.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.309+0000 7f02b8b3b640 1 -- 172.21.15.19:0/2560769071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a0004d40 msgr2=0x7f02a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:59.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.309+0000 7f02b8b3b640 1 --2- 172.21.15.19:0/2560769071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a0004d40 0x7f02a00051c0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009fc0 tx=0x7f02a0005830 comp rx=0 tx=0).stop 2024-09-12T02:02:59.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.309+0000 7f02b2d9d640 1 -- 172.21.15.19:0/2560769071 reap_dead start 2024-09-12T02:02:59.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.309+0000 7f02b8b3b640 1 -- 172.21.15.19:0/2560769071 shutdown_connections 2024-09-12T02:02:59.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.309+0000 7f02b8b3b640 1 -- 172.21.15.19:0/2560769071 >> 172.21.15.19:0/2560769071 conn(0x7f02b408bfc0 msgr2=0x7f02b40d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:59.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.309+0000 7f02b8b3b640 1 -- 172.21.15.19:0/2560769071 shutdown_connections 2024-09-12T02:02:59.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.309+0000 7f02b8b3b640 1 -- 172.21.15.19:0/2560769071 wait complete. 2024-09-12T02:02:59.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.311+0000 7f02b8b3b640 1 Processor -- start 2024-09-12T02:02:59.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.311+0000 7f02b8b3b640 1 -- start start 2024-09-12T02:02:59.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.312+0000 7f02b8b3b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02b40cab70 0x7f02b415a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:59.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.312+0000 7f02b8b3b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02b40caf50 0x7f02b415adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:59.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.312+0000 7f02b8b3b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b415fe20 0x7f02b41602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:59.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.312+0000 7f02b8b3b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f02b40d4dd0 con 0x7f02b40caf50 2024-09-12T02:02:59.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.312+0000 7f02b8b3b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f02b415e9d0 con 0x7f02b40cab70 2024-09-12T02:02:59.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.312+0000 7f02b8b3b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f02b40d4f50 con 0x7f02b415fe20 2024-09-12T02:02:59.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.312+0000 7f02a9d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02b40caf50 0x7f02b415adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:59.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.312+0000 7f02a9d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02b40caf50 0x7f02b415adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38368/0 (socket says 172.21.15.19:38368) 2024-09-12T02:02:59.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.312+0000 7f02a9d9b640 1 -- 172.21.15.19:0/318806184 learned_addr learned my addr 172.21.15.19:0/318806184 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:59.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.312+0000 7f02b259c640 1 --2- 172.21.15.19:0/318806184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02b40cab70 0x7f02b415a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:59.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.312+0000 7f02b2d9d640 1 --2- 172.21.15.19:0/318806184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b415fe20 0x7f02b41602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:59.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.312+0000 7f02a9d9b640 1 -- 172.21.15.19:0/318806184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b415fe20 msgr2=0x7f02b41602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:59.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.312+0000 7f02a9d9b640 1 --2- 172.21.15.19:0/318806184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b415fe20 0x7f02b41602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.312+0000 7f02a9d9b640 1 -- 172.21.15.19:0/318806184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02b40cab70 msgr2=0x7f02b415a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:59.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.312+0000 7f02a9d9b640 1 --2- 172.21.15.19:0/318806184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02b40cab70 0x7f02b415a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.312+0000 7f02a9d9b640 1 -- 172.21.15.19:0/318806184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b40b8230 con 0x7f02b40caf50 2024-09-12T02:02:59.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.312+0000 7f02a9d9b640 1 --2- 172.21.15.19:0/318806184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02b40caf50 0x7f02b415adc0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f029c0072c0 tx=0x7f029c0076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:59.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.313+0000 7f02ab7fe640 1 -- 172.21.15.19:0/318806184 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029c00f9c0 con 0x7f02b40caf50 2024-09-12T02:02:59.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.313+0000 7f02ab7fe640 1 -- 172.21.15.19:0/318806184 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f029c018070 con 0x7f02b40caf50 2024-09-12T02:02:59.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.313+0000 7f02ab7fe640 1 -- 172.21.15.19:0/318806184 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029c00fdc0 con 0x7f02b40caf50 2024-09-12T02:02:59.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.313+0000 7f02b8b3b640 1 -- 172.21.15.19:0/318806184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02b415b3b0 con 0x7f02b40caf50 2024-09-12T02:02:59.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.313+0000 7f02b8b3b640 1 -- 172.21.15.19:0/318806184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02b40b87d0 con 0x7f02b40caf50 2024-09-12T02:02:59.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.314+0000 7f02b8b3b640 1 -- 172.21.15.19:0/318806184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02b40d5310 con 0x7f02b40caf50 2024-09-12T02:02:59.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.314+0000 7f02ab7fe640 1 -- 172.21.15.19:0/318806184 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f029c01d460 con 0x7f02b40caf50 2024-09-12T02:02:59.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.315+0000 7f02ab7fe640 1 --2- 172.21.15.19:0/318806184 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f029406be30 0x7f029406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:59.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.315+0000 7f02ab7fe640 1 -- 172.21.15.19:0/318806184 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6733+0+0 (secure 0 0 0) 0x7f029c08b350 con 0x7f02b40caf50 2024-09-12T02:02:59.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.315+0000 7f02b259c640 1 --2- 172.21.15.19:0/318806184 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f029406be30 0x7f029406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:59.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.316+0000 7f02b259c640 1 --2- 172.21.15.19:0/318806184 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f029406be30 0x7f029406e2f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009b40 tx=0x7f02a4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:59.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.319+0000 7f02ab7fe640 1 -- 172.21.15.19:0/318806184 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f029c059900 con 0x7f02b40caf50 2024-09-12T02:02:59.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.531+0000 7f02b8b3b640 1 -- 172.21.15.19:0/318806184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02b40b89a0 con 0x7f02b40caf50 2024-09-12T02:02:59.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.532+0000 7f02ab7fe640 1 -- 172.21.15.19:0/318806184 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+4392 (secure 0 0 0) 0x7f029c059200 con 0x7f02b40caf50 2024-09-12T02:02:59.532 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:02:59.533 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":110,"btime":"2024-09-12T02:02:59:523011+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7162,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4287312235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4287312235},{"type":"v1","addr":"172.21.15.135:6837","nonce":4287312235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:02:58.521497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:02:59.533 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 110 2024-09-12T02:02:59.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.534+0000 7f02b8b3b640 1 -- 172.21.15.19:0/318806184 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f029406be30 msgr2=0x7f029406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:59.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.534+0000 7f02b8b3b640 1 --2- 172.21.15.19:0/318806184 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f029406be30 0x7f029406e2f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009b40 tx=0x7f02a4009190 comp rx=0 tx=0).stop 2024-09-12T02:02:59.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.534+0000 7f02b8b3b640 1 -- 172.21.15.19:0/318806184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02b40caf50 msgr2=0x7f02b415adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:59.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.534+0000 7f02b8b3b640 1 --2- 172.21.15.19:0/318806184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02b40caf50 0x7f02b415adc0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f029c0072c0 tx=0x7f029c0076c0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.534+0000 7f02b8b3b640 1 -- 172.21.15.19:0/318806184 shutdown_connections 2024-09-12T02:02:59.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.534+0000 7f02b8b3b640 1 --2- 172.21.15.19:0/318806184 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f029406be30 0x7f029406e2f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.534+0000 7f02b8b3b640 1 --2- 172.21.15.19:0/318806184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b415fe20 0x7f02b41602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.534+0000 7f02b8b3b640 1 --2- 172.21.15.19:0/318806184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02b40caf50 0x7f02b415adc0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.534+0000 7f02b8b3b640 1 --2- 172.21.15.19:0/318806184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02b40cab70 0x7f02b415a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.534+0000 7f02b8b3b640 1 -- 172.21.15.19:0/318806184 >> 172.21.15.19:0/318806184 conn(0x7f02b408bfc0 msgr2=0x7f02b40b5430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:59.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.534+0000 7f02b8b3b640 1 -- 172.21.15.19:0/318806184 shutdown_connections 2024-09-12T02:02:59.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.534+0000 7f02b8b3b640 1 -- 172.21.15.19:0/318806184 wait complete. 2024-09-12T02:02:59.545 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 200.00000001' led to DAMAGED state 2024-09-12T02:02:59.545 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete mds0_openfiles.0' 2024-09-12T02:02:59.545 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:02:59.545 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:02:59.561 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:02:59.562 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:02:59.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:02:59.562 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:02:59.618 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:02:59.618 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:02:59.618 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:02:59.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.762+0000 7fac6739f640 1 Processor -- start 2024-09-12T02:02:59.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.762+0000 7fac6739f640 1 -- start start 2024-09-12T02:02:59.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.763+0000 7fac6739f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac600d1f90 0x7fac600cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:59.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.763+0000 7fac6739f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac600cf000 con 0x7fac6015e660 2024-09-12T02:02:59.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.763+0000 7fac6739f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac600d29a0 con 0x7fac600d0dd0 2024-09-12T02:02:59.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.763+0000 7fac6739f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fac6006d3e0 con 0x7fac600d1f90 2024-09-12T02:02:59.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.763+0000 7fac66b9e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac600d1f90 0x7fac600cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:59.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.763+0000 7fac66b9e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac600d1f90 0x7fac600cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38372/0 (socket says 172.21.15.19:38372) 2024-09-12T02:02:59.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.763+0000 7fac66b9e640 1 -- 172.21.15.19:0/3529916208 learned_addr learned my addr 172.21.15.19:0/3529916208 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:59.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.763+0000 7fac66b9e640 1 -- 172.21.15.19:0/3529916208 >> v1:172.21.15.135:6789/0 conn(0x7fac600d0dd0 legacy=0x7fac600d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:59.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.763+0000 7fac66b9e640 1 -- 172.21.15.19:0/3529916208 >> v1:172.21.15.19:6789/0 conn(0x7fac6015e660 legacy=0x7fac6006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:59.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.763+0000 7fac66b9e640 1 -- 172.21.15.19:0/3529916208 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac600d2c60 con 0x7fac600d1f90 2024-09-12T02:02:59.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.764+0000 7fac66b9e640 1 --2- 172.21.15.19:0/3529916208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac600d1f90 0x7fac600cf7c0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fac58009e50 tx=0x7fac5802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c024838139dc5bde server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:59.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.764+0000 7fac6539b640 1 -- 172.21.15.19:0/3529916208 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58036070 con 0x7fac600d1f90 2024-09-12T02:02:59.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.764+0000 7fac6539b640 1 -- 172.21.15.19:0/3529916208 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac58031600 con 0x7fac600d1f90 2024-09-12T02:02:59.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.764+0000 7fac6539b640 1 -- 172.21.15.19:0/3529916208 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac580319d0 con 0x7fac600d1f90 2024-09-12T02:02:59.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.765+0000 7fac6739f640 1 -- 172.21.15.19:0/3529916208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac600d1f90 msgr2=0x7fac600cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:59.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.765+0000 7fac6739f640 1 --2- 172.21.15.19:0/3529916208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac600d1f90 0x7fac600cf7c0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fac58009e50 tx=0x7fac5802a760 comp rx=0 tx=0).stop 2024-09-12T02:02:59.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.765+0000 7fac6739f640 1 -- 172.21.15.19:0/3529916208 shutdown_connections 2024-09-12T02:02:59.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.765+0000 7fac6739f640 1 --2- 172.21.15.19:0/3529916208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac600d1f90 0x7fac600cf7c0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.765+0000 7fac6739f640 1 -- 172.21.15.19:0/3529916208 >> 172.21.15.19:0/3529916208 conn(0x7fac6008bfc0 msgr2=0x7fac600d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:59.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.765+0000 7fac6739f640 1 -- 172.21.15.19:0/3529916208 shutdown_connections 2024-09-12T02:02:59.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.765+0000 7fac6739f640 1 -- 172.21.15.19:0/3529916208 wait complete. 2024-09-12T02:02:59.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.766+0000 7fac6739f640 1 Processor -- start 2024-09-12T02:02:59.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.766+0000 7fac6739f640 1 -- start start 2024-09-12T02:02:59.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.767+0000 7fac6739f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac600d0dd0 0x7fac600cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:59.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.767+0000 7fac6739f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac600d1f90 0x7fac60160680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:59.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.767+0000 7fac6739f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac6015e660 0x7fac60160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:59.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.767+0000 7fac6739f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fac600cf330 con 0x7fac600d0dd0 2024-09-12T02:02:59.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.767+0000 7fac6739f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fac600d3220 con 0x7fac600d1f90 2024-09-12T02:02:59.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.767+0000 7fac6739f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fac600d33a0 con 0x7fac6015e660 2024-09-12T02:02:59.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.767+0000 7fac6639d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac600d0dd0 0x7fac600cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:59.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.767+0000 7fac6639d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac600d0dd0 0x7fac600cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38386/0 (socket says 172.21.15.19:38386) 2024-09-12T02:02:59.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.767+0000 7fac6639d640 1 -- 172.21.15.19:0/2434554956 learned_addr learned my addr 172.21.15.19:0/2434554956 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:02:59.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.767+0000 7fac65b9c640 1 --2- 172.21.15.19:0/2434554956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac600d1f90 0x7fac60160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:59.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.767+0000 7fac66b9e640 1 --2- 172.21.15.19:0/2434554956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac6015e660 0x7fac60160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:59.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.767+0000 7fac6639d640 1 -- 172.21.15.19:0/2434554956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac6015e660 msgr2=0x7fac60160bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:59.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.767+0000 7fac6639d640 1 --2- 172.21.15.19:0/2434554956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac6015e660 0x7fac60160bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.767+0000 7fac6639d640 1 -- 172.21.15.19:0/2434554956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac600d1f90 msgr2=0x7fac60160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:59.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.767+0000 7fac6639d640 1 --2- 172.21.15.19:0/2434554956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac600d1f90 0x7fac60160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:59.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.767+0000 7fac6639d640 1 -- 172.21.15.19:0/2434554956 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac601611f0 con 0x7fac600d0dd0 2024-09-12T02:02:59.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.767+0000 7fac65b9c640 1 --2- 172.21.15.19:0/2434554956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac600d1f90 0x7fac60160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:59.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.767+0000 7fac6639d640 1 --2- 172.21.15.19:0/2434554956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac600d0dd0 0x7fac600cc890 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fac5c00c430 tx=0x7fac5c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:59.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.768+0000 7fac56ffd640 1 -- 172.21.15.19:0/2434554956 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5c011790 con 0x7fac600d0dd0 2024-09-12T02:02:59.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.768+0000 7fac56ffd640 1 -- 172.21.15.19:0/2434554956 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac5c017070 con 0x7fac600d0dd0 2024-09-12T02:02:59.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.768+0000 7fac6739f640 1 -- 172.21.15.19:0/2434554956 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac601614d0 con 0x7fac600d0dd0 2024-09-12T02:02:59.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.768+0000 7fac56ffd640 1 -- 172.21.15.19:0/2434554956 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5c011bb0 con 0x7fac600d0dd0 2024-09-12T02:02:59.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.768+0000 7fac6739f640 1 -- 172.21.15.19:0/2434554956 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac60161a90 con 0x7fac600d0dd0 2024-09-12T02:02:59.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.769+0000 7fac6739f640 1 -- 172.21.15.19:0/2434554956 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac600d24d0 con 0x7fac600d0dd0 2024-09-12T02:02:59.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.769+0000 7fac56ffd640 1 -- 172.21.15.19:0/2434554956 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac5c01c460 con 0x7fac600d0dd0 2024-09-12T02:02:59.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.770+0000 7fac56ffd640 1 --2- 172.21.15.19:0/2434554956 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac4406be30 0x7fac4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:59.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.770+0000 7fac56ffd640 1 -- 172.21.15.19:0/2434554956 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6733+0+0 (secure 0 0 0) 0x7fac5c08aff0 con 0x7fac600d0dd0 2024-09-12T02:02:59.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.770+0000 7fac65b9c640 1 --2- 172.21.15.19:0/2434554956 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac4406be30 0x7fac4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:59.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.770+0000 7fac65b9c640 1 --2- 172.21.15.19:0/2434554956 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac4406be30 0x7fac4406e2f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fac6015c000 tx=0x7fac50009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:59.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.774+0000 7fac56ffd640 1 -- 172.21.15.19:0/2434554956 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac5c059630 con 0x7fac600d0dd0 2024-09-12T02:02:59.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:02:59.984+0000 7fac6739f640 1 -- 172.21.15.19:0/2434554956 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fac600d1b20 con 0x7fac600d0dd0 2024-09-12T02:03:00.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.529+0000 7fac56ffd640 1 -- 172.21.15.19:0/2434554956 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v111) ==== 161+0+0 (secure 0 0 0) 0x7fac5c058f30 con 0x7fac600d0dd0 2024-09-12T02:03:00.530 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:03:00.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.532+0000 7fac6739f640 1 -- 172.21.15.19:0/2434554956 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac4406be30 msgr2=0x7fac4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:00.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.532+0000 7fac6739f640 1 --2- 172.21.15.19:0/2434554956 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac4406be30 0x7fac4406e2f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fac6015c000 tx=0x7fac50009040 comp rx=0 tx=0).stop 2024-09-12T02:03:00.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.532+0000 7fac6739f640 1 -- 172.21.15.19:0/2434554956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac600d0dd0 msgr2=0x7fac600cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:00.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.532+0000 7fac6739f640 1 --2- 172.21.15.19:0/2434554956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac600d0dd0 0x7fac600cc890 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fac5c00c430 tx=0x7fac5c00c8f0 comp rx=0 tx=0).stop 2024-09-12T02:03:00.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.532+0000 7fac6739f640 1 -- 172.21.15.19:0/2434554956 shutdown_connections 2024-09-12T02:03:00.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.532+0000 7fac6739f640 1 --2- 172.21.15.19:0/2434554956 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac4406be30 0x7fac4406e2f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:00.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.532+0000 7fac6739f640 1 --2- 172.21.15.19:0/2434554956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac6015e660 0x7fac60160bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:00.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.532+0000 7fac6739f640 1 --2- 172.21.15.19:0/2434554956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac600d1f90 0x7fac60160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:00.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.532+0000 7fac6739f640 1 --2- 172.21.15.19:0/2434554956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac600d0dd0 0x7fac600cc890 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:00.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.532+0000 7fac6739f640 1 -- 172.21.15.19:0/2434554956 >> 172.21.15.19:0/2434554956 conn(0x7fac6008bfc0 msgr2=0x7fac600b3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:00.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.532+0000 7fac6739f640 1 -- 172.21.15.19:0/2434554956 shutdown_connections 2024-09-12T02:03:00.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.532+0000 7fac6739f640 1 -- 172.21.15.19:0/2434554956 wait complete. 2024-09-12T02:03:00.545 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:03:00.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.651+0000 7f6eef2e6640 1 Processor -- start 2024-09-12T02:03:00.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.651+0000 7f6eef2e6640 1 -- start start 2024-09-12T02:03:00.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.652+0000 7f6eef2e6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6ee80d30f0 0x7f6ee80b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:00.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.652+0000 7f6eef2e6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6ee80b64c0 0x7f6ee806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:00.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.652+0000 7f6eef2e6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ee80d3690 con 0x7f6ee815e5f0 2024-09-12T02:03:00.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.652+0000 7f6eef2e6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f6ee806d530 con 0x7f6ee80b64c0 2024-09-12T02:03:00.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.652+0000 7f6eef2e6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6ee80d3970 con 0x7f6ee80d30f0 2024-09-12T02:03:00.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.652+0000 7f6eed883640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6ee80b64c0 0x7f6ee806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:00.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.652+0000 7f6eed883640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6ee80b64c0 0x7f6ee806d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38394/0 (socket says 172.21.15.19:38394) 2024-09-12T02:03:00.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.652+0000 7f6eed883640 1 -- 172.21.15.19:0/856827292 learned_addr learned my addr 172.21.15.19:0/856827292 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:00.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.652+0000 7f6eec881640 1 --2- 172.21.15.19:0/856827292 >> v2:172.21.15.135:3300/0 conn(0x7f6ee80d30f0 0x7f6ee80b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:00.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.652+0000 7f6eed883640 1 -- 172.21.15.19:0/856827292 >> v2:172.21.15.135:3300/0 conn(0x7f6ee80d30f0 msgr2=0x7f6ee80b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:00.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.652+0000 7f6eed883640 1 --2- 172.21.15.19:0/856827292 >> v2:172.21.15.135:3300/0 conn(0x7f6ee80d30f0 0x7f6ee80b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:00.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.652+0000 7f6eed883640 1 -- 172.21.15.19:0/856827292 >> v1:172.21.15.135:6789/0 conn(0x7f6ee815e5f0 legacy=0x7f6ee80d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:00.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.652+0000 7f6eed883640 1 -- 172.21.15.19:0/856827292 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee806cee0 con 0x7f6ee80b64c0 2024-09-12T02:03:00.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.653+0000 7f6eed883640 1 --2- 172.21.15.19:0/856827292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ee80b64c0 0x7f6ee806d9c0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f6ee808e520 tx=0x7f6ee002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344496c534fb5e81 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.653+0000 7f6edffff640 1 -- 172.21.15.19:0/856827292 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0036070 con 0x7f6ee80b64c0 2024-09-12T02:03:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.653+0000 7f6edffff640 1 -- 172.21.15.19:0/856827292 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee0031600 con 0x7f6ee80b64c0 2024-09-12T02:03:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.653+0000 7f6edffff640 1 -- 172.21.15.19:0/856827292 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee00319d0 con 0x7f6ee80b64c0 2024-09-12T02:03:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.653+0000 7f6eef2e6640 1 -- 172.21.15.19:0/856827292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ee80b64c0 msgr2=0x7f6ee806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.653+0000 7f6eef2e6640 1 --2- 172.21.15.19:0/856827292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ee80b64c0 0x7f6ee806d9c0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f6ee808e520 tx=0x7f6ee002a730 comp rx=0 tx=0).stop 2024-09-12T02:03:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.654+0000 7f6eef2e6640 1 -- 172.21.15.19:0/856827292 shutdown_connections 2024-09-12T02:03:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.654+0000 7f6eef2e6640 1 --2- 172.21.15.19:0/856827292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ee80b64c0 0x7f6ee806d9c0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.654+0000 7f6eef2e6640 1 --2- 172.21.15.19:0/856827292 >> v2:172.21.15.135:3300/0 conn(0x7f6ee80d30f0 0x7f6ee80b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.654+0000 7f6eef2e6640 1 -- 172.21.15.19:0/856827292 >> 172.21.15.19:0/856827292 conn(0x7f6ee808bfc0 msgr2=0x7f6ee80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.654+0000 7f6eef2e6640 1 -- 172.21.15.19:0/856827292 shutdown_connections 2024-09-12T02:03:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.654+0000 7f6eef2e6640 1 -- 172.21.15.19:0/856827292 wait complete. 2024-09-12T02:03:00.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.655+0000 7f6eef2e6640 1 Processor -- start 2024-09-12T02:03:00.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.655+0000 7f6eef2e6640 1 -- start start 2024-09-12T02:03:00.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.656+0000 7f6eef2e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ee80b64c0 0x7f6ee815b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.656+0000 7f6eef2e6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ee80d30f0 0x7f6ee80d1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.656+0000 7f6eef2e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ee815e5f0 0x7f6ee80c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.656+0000 7f6eef2e6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee806df00 con 0x7f6ee815e5f0 2024-09-12T02:03:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.656+0000 7f6eef2e6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee815e9d0 con 0x7f6ee80b64c0 2024-09-12T02:03:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.656+0000 7f6eef2e6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6ee806e080 con 0x7f6ee80d30f0 2024-09-12T02:03:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.656+0000 7f6eed883640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ee815e5f0 0x7f6ee80c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.656+0000 7f6eed883640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ee815e5f0 0x7f6ee80c9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38398/0 (socket says 172.21.15.19:38398) 2024-09-12T02:03:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.656+0000 7f6eed883640 1 -- 172.21.15.19:0/1557997824 learned_addr learned my addr 172.21.15.19:0/1557997824 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.656+0000 7f6eed082640 1 --2- 172.21.15.19:0/1557997824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ee80b64c0 0x7f6ee815b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.656+0000 7f6eec881640 1 --2- 172.21.15.19:0/1557997824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ee80d30f0 0x7f6ee80d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.656+0000 7f6eed883640 1 -- 172.21.15.19:0/1557997824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ee80d30f0 msgr2=0x7f6ee80d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.656+0000 7f6eed883640 1 --2- 172.21.15.19:0/1557997824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ee80d30f0 0x7f6ee80d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.656+0000 7f6eed883640 1 -- 172.21.15.19:0/1557997824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ee80b64c0 msgr2=0x7f6ee815b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:00.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.656+0000 7f6eed883640 1 --2- 172.21.15.19:0/1557997824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ee80b64c0 0x7f6ee815b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:00.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.656+0000 7f6eed883640 1 -- 172.21.15.19:0/1557997824 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee815ef10 con 0x7f6ee815e5f0 2024-09-12T02:03:00.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.656+0000 7f6eed883640 1 --2- 172.21.15.19:0/1557997824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ee815e5f0 0x7f6ee80c9ea0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009f40 tx=0x7f6ee0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:00.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.656+0000 7f6eddffb640 1 -- 172.21.15.19:0/1557997824 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee003f020 con 0x7f6ee815e5f0 2024-09-12T02:03:00.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.657+0000 7f6eddffb640 1 -- 172.21.15.19:0/1557997824 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee0037040 con 0x7f6ee815e5f0 2024-09-12T02:03:00.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.657+0000 7f6eef2e6640 1 -- 172.21.15.19:0/1557997824 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee815f1f0 con 0x7f6ee815e5f0 2024-09-12T02:03:00.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.657+0000 7f6eddffb640 1 -- 172.21.15.19:0/1557997824 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0036070 con 0x7f6ee815e5f0 2024-09-12T02:03:00.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.657+0000 7f6eef2e6640 1 -- 172.21.15.19:0/1557997824 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee815f7b0 con 0x7f6ee815e5f0 2024-09-12T02:03:00.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.658+0000 7f6eef2e6640 1 -- 172.21.15.19:0/1557997824 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee806d9c0 con 0x7f6ee815e5f0 2024-09-12T02:03:00.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.658+0000 7f6eddffb640 1 -- 172.21.15.19:0/1557997824 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ee0042020 con 0x7f6ee815e5f0 2024-09-12T02:03:00.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.659+0000 7f6eddffb640 1 --2- 172.21.15.19:0/1557997824 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6ecc06be30 0x7f6ecc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:00.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.659+0000 7f6eddffb640 1 -- 172.21.15.19:0/1557997824 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6733+0+0 (secure 0 0 0) 0x7f6ee00ab540 con 0x7f6ee815e5f0 2024-09-12T02:03:00.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.659+0000 7f6eed082640 1 --2- 172.21.15.19:0/1557997824 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6ecc06be30 0x7f6ecc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:00.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.659+0000 7f6eed082640 1 --2- 172.21.15.19:0/1557997824 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6ecc06be30 0x7f6ecc06e2f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6ee40016e0 tx=0x7f6ee4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.663+0000 7f6eddffb640 1 -- 172.21.15.19:0/1557997824 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ee0049030 con 0x7f6ee815e5f0 2024-09-12T02:03:00.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:00.911+0000 7f6eef2e6640 1 -- 172.21.15.19:0/1557997824 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f6ee806bda0 con 0x7f6ee815e5f0 2024-09-12T02:03:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.531+0000 7f6eddffb640 1 -- 172.21.15.19:0/1557997824 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v112) ==== 101+0+0 (secure 0 0 0) 0x7f6ee0079400 con 0x7f6ee815e5f0 2024-09-12T02:03:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:03:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.534+0000 7f6eef2e6640 1 -- 172.21.15.19:0/1557997824 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6ecc06be30 msgr2=0x7f6ecc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.534+0000 7f6eef2e6640 1 --2- 172.21.15.19:0/1557997824 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6ecc06be30 0x7f6ecc06e2f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6ee40016e0 tx=0x7f6ee4009040 comp rx=0 tx=0).stop 2024-09-12T02:03:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.534+0000 7f6eef2e6640 1 -- 172.21.15.19:0/1557997824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ee815e5f0 msgr2=0x7f6ee80c9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.534+0000 7f6eef2e6640 1 --2- 172.21.15.19:0/1557997824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ee815e5f0 0x7f6ee80c9ea0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009f40 tx=0x7f6ee0004a40 comp rx=0 tx=0).stop 2024-09-12T02:03:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.534+0000 7f6eef2e6640 1 -- 172.21.15.19:0/1557997824 shutdown_connections 2024-09-12T02:03:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.534+0000 7f6eef2e6640 1 --2- 172.21.15.19:0/1557997824 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6ecc06be30 0x7f6ecc06e2f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.534+0000 7f6eef2e6640 1 --2- 172.21.15.19:0/1557997824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ee815e5f0 0x7f6ee80c9ea0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.534+0000 7f6eef2e6640 1 --2- 172.21.15.19:0/1557997824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ee80d30f0 0x7f6ee80d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.534+0000 7f6eef2e6640 1 --2- 172.21.15.19:0/1557997824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ee80b64c0 0x7f6ee815b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.534+0000 7f6eef2e6640 1 -- 172.21.15.19:0/1557997824 >> 172.21.15.19:0/1557997824 conn(0x7f6ee808bfc0 msgr2=0x7f6ee80b4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.534+0000 7f6eef2e6640 1 -- 172.21.15.19:0/1557997824 shutdown_connections 2024-09-12T02:03:01.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.534+0000 7f6eef2e6640 1 -- 172.21.15.19:0/1557997824 wait complete. 2024-09-12T02:03:01.549 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:03:01.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.596+0000 7fd7a65dff40 1 Processor -- start 2024-09-12T02:03:01.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.596+0000 7fd7a65dff40 1 -- start start 2024-09-12T02:03:01.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.597+0000 7fd7a65dff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c6fd58e0 0x5622c6ffed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.597+0000 7fd7a65dff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5622c7093800 0x5622c7091df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.597+0000 7fd7a65dff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622c70acf60 0x5622c6fff750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.597+0000 7fd7a65dff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5622c6f27510 con 0x5622c70acf60 2024-09-12T02:03:01.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.597+0000 7fd7a65dff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5622c6f80c50 con 0x5622c6fd58e0 2024-09-12T02:03:01.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.597+0000 7fd7a65dff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5622c70ab1f0 con 0x5622c7093800 2024-09-12T02:03:01.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.597+0000 7fd7a48d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622c70acf60 0x5622c6fff750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.597+0000 7fd7a48d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622c70acf60 0x5622c6fff750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40038/0 (socket says 172.21.15.19:40038) 2024-09-12T02:03:01.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.597+0000 7fd7a48d6640 1 -- 172.21.15.19:0/2004132801 learned_addr learned my addr 172.21.15.19:0/2004132801 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:01.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.597+0000 7fd7a40d5640 1 --2- 172.21.15.19:0/2004132801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c6fd58e0 0x5622c6ffed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.597+0000 7fd7a38d4640 1 --2- 172.21.15.19:0/2004132801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5622c7093800 0x5622c7091df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.597+0000 7fd7a48d6640 1 -- 172.21.15.19:0/2004132801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5622c7093800 msgr2=0x5622c7091df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:01.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.597+0000 7fd7a48d6640 1 --2- 172.21.15.19:0/2004132801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5622c7093800 0x5622c7091df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.597+0000 7fd7a48d6640 1 -- 172.21.15.19:0/2004132801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c6fd58e0 msgr2=0x5622c6ffed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:01.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.597+0000 7fd7a48d6640 1 --2- 172.21.15.19:0/2004132801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c6fd58e0 0x5622c6ffed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.597+0000 7fd7a48d6640 1 -- 172.21.15.19:0/2004132801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622c708f940 con 0x5622c70acf60 2024-09-12T02:03:01.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.598+0000 7fd7a48d6640 1 --2- 172.21.15.19:0/2004132801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622c70acf60 0x5622c6fff750 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fd79c025940 tx=0x7fd79c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74616ade7dda7f70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:01.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.598+0000 7fd7a28d2640 1 -- 172.21.15.19:0/2004132801 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c055040 con 0x5622c70acf60 2024-09-12T02:03:01.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.598+0000 7fd7a28d2640 1 -- 172.21.15.19:0/2004132801 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd79c0518c0 con 0x5622c70acf60 2024-09-12T02:03:01.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.598+0000 7fd7a28d2640 1 -- 172.21.15.19:0/2004132801 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c051c70 con 0x5622c70acf60 2024-09-12T02:03:01.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.598+0000 7fd7a65dff40 1 -- 172.21.15.19:0/2004132801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622c70acf60 msgr2=0x5622c6fff750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.598+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/2004132801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622c70acf60 0x5622c6fff750 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fd79c025940 tx=0x7fd79c051000 comp rx=0 tx=0).stop 2024-09-12T02:03:01.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.598+0000 7fd7a65dff40 1 -- 172.21.15.19:0/2004132801 shutdown_connections 2024-09-12T02:03:01.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.598+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/2004132801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622c70acf60 0x5622c6fff750 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.598+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/2004132801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5622c7093800 0x5622c7091df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.598+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/2004132801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c6fd58e0 0x5622c6ffed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.598+0000 7fd7a65dff40 1 -- 172.21.15.19:0/2004132801 >> 172.21.15.19:0/2004132801 conn(0x5622c6fd6ad0 msgr2=0x5622c70045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:01.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.598+0000 7fd7a65dff40 1 -- 172.21.15.19:0/2004132801 shutdown_connections 2024-09-12T02:03:01.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.598+0000 7fd7a65dff40 1 -- 172.21.15.19:0/2004132801 wait complete. 2024-09-12T02:03:01.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.599+0000 7fd7a65dff40 1 Processor -- start 2024-09-12T02:03:01.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.599+0000 7fd7a65dff40 1 -- start start 2024-09-12T02:03:01.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.600+0000 7fd7a65dff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5622c6fd58e0 0x5622c708b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.600+0000 7fd7a65dff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c7093800 0x5622c713e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.600+0000 7fd7a65dff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622c70acf60 0x5622c713e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.600+0000 7fd7a65dff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5622c7001220 con 0x5622c70acf60 2024-09-12T02:03:01.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.600+0000 7fd7a65dff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5622c708ef90 con 0x5622c7093800 2024-09-12T02:03:01.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.600+0000 7fd7a65dff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5622c6fd5410 con 0x5622c6fd58e0 2024-09-12T02:03:01.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.600+0000 7fd7a48d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622c70acf60 0x5622c713e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.600+0000 7fd7a38d4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c7093800 0x5622c713e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.600+0000 7fd7a48d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622c70acf60 0x5622c713e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40044/0 (socket says 172.21.15.19:40044) 2024-09-12T02:03:01.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.600+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 learned_addr learned my addr 172.21.15.19:0/1046167228 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:01.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.600+0000 7fd7a40d5640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5622c6fd58e0 0x5622c708b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.600+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5622c6fd58e0 msgr2=0x5622c708b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.600+0000 7fd7a48d6640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5622c6fd58e0 0x5622c708b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.600+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c7093800 msgr2=0x5622c713e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.600+0000 7fd7a48d6640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c7093800 0x5622c713e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.600+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622c70a9960 con 0x5622c70acf60 2024-09-12T02:03:01.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.601+0000 7fd7a48d6640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622c70acf60 0x5622c713e860 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x5622c713bb40 tx=0x7fd79c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:01.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.601+0000 7fd7a18d0640 1 -- 172.21.15.19:0/1046167228 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c070020 con 0x5622c70acf60 2024-09-12T02:03:01.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.601+0000 7fd7a18d0640 1 -- 172.21.15.19:0/1046167228 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd79c05a450 con 0x5622c70acf60 2024-09-12T02:03:01.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.601+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622c70a9390 con 0x5622c70acf60 2024-09-12T02:03:01.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.601+0000 7fd7a18d0640 1 -- 172.21.15.19:0/1046167228 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c055040 con 0x5622c70acf60 2024-09-12T02:03:01.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.601+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622c713bb70 con 0x5622c70acf60 2024-09-12T02:03:01.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.602+0000 7fd7a18d0640 1 -- 172.21.15.19:0/1046167228 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd79c073020 con 0x5622c70acf60 2024-09-12T02:03:01.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.603+0000 7fd7a18d0640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd79006a810 0x7fd79006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.603+0000 7fd7a18d0640 1 -- 172.21.15.19:0/1046167228 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6733+0+0 (secure 0 0 0) 0x7fd79c0cf0a0 con 0x5622c70acf60 2024-09-12T02:03:01.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.603+0000 7fd7a40d5640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd79006a810 0x7fd79006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.606 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:03:01.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.603+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5622c71470c0 0x5622c71474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.603+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7003080 con 0x5622c71470c0 2024-09-12T02:03:01.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.603+0000 7fd7a38d4640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5622c71470c0 0x5622c71474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.603+0000 7fd7a40d5640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd79006a810 0x7fd79006ccd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x5622c701f1a0 tx=0x7fd7940038d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:01.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.604+0000 7fd7a38d4640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5622c71470c0 0x5622c71474a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:01.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.605+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v100'164 uv138 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd79800e4e0 con 0x5622c71470c0 2024-09-12T02:03:01.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.605+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c708e380 con 0x5622c71470c0 2024-09-12T02:03:01.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.606+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v100'165 uv165 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.606+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71479e0 con 0x5622c71470c0 2024-09-12T02:03:01.608 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:03:01.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.607+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v100'166 uv166 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.607+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7151330 con 0x5622c71470c0 2024-09-12T02:03:01.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.608+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v100'167 uv167 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.608+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71516d0 con 0x5622c71470c0 2024-09-12T02:03:01.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.609+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v100'168 uv168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.609+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7150320 con 0x5622c71470c0 2024-09-12T02:03:01.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.610+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v100'169 uv169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.610+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.611+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v100'170 uv144 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.611+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.612+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v100'171 uv171 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.612+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.613+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v100'172 uv172 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.613 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:03:01.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.613+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.614+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v100'173 uv173 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.614+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.615+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v100'174 uv174 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.615+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.616+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v100'175 uv175 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.616+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.617+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v100'176 uv151 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.617+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.618+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v100'177 uv177 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.618+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.619 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:03:01.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.619+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v100'178 uv178 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.619+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.620+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v100'179 uv179 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.620+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.621+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v100'180 uv180 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.621+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.622+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v100'181 uv181 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.622+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.623+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v100'182 uv182 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.623+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.624+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v100'183 uv157 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.624+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.625+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v100'184 uv184 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.625+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.628 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:03:01.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.628+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v100'185 uv185 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.628+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.631+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v100'186 uv186 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.631+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.634+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v100'187 uv187 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.634+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.636+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v100'188 uv188 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.636+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.637+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v100'189 uv163 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.637+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.640+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v100'190 uv190 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.640+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.643 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:03:01.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.643+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v100'191 uv191 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.643+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.646+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v100'192 uv192 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.646+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.649+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v100'193 uv193 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.649+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c71470c0 2024-09-12T02:03:01.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.652+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v100'194 uv194 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c71470c0 2024-09-12T02:03:01.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.652+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5622c7151a70 0x5622c7153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.652+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71506c0 con 0x5622c7151a70 2024-09-12T02:03:01.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.652+0000 7fd7a40d5640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5622c7151a70 0x5622c7153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.652+0000 7fd7a40d5640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5622c7151a70 0x5622c7153e60 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:01.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.654+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v100'130 uv114 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.654+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c71543a0 con 0x5622c7151a70 2024-09-12T02:03:01.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.655+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v100'131 uv131 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.655+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7154740 con 0x5622c7151a70 2024-09-12T02:03:01.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.656+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v100'132 uv132 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.656 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:03:01.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.656+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7154f90 con 0x5622c7151a70 2024-09-12T02:03:01.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.657+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v100'133 uv133 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.657+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7155330 con 0x5622c7151a70 2024-09-12T02:03:01.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.658+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v100'134 uv134 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.658+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71556d0 con 0x5622c7151a70 2024-09-12T02:03:01.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.659+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v100'135 uv117 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.659+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c7155a70 con 0x5622c7151a70 2024-09-12T02:03:01.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.661+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v100'136 uv136 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.661+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7155e10 con 0x5622c7151a70 2024-09-12T02:03:01.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.662+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v100'137 uv137 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.662 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:03:01.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.662+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7155e10 con 0x5622c7151a70 2024-09-12T02:03:01.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.663+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v100'138 uv138 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.663+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7155e10 con 0x5622c7151a70 2024-09-12T02:03:01.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.664+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v100'139 uv139 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.664+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7155e10 con 0x5622c7151a70 2024-09-12T02:03:01.665 INFO:teuthology.orchestra.run.smithi019.stdout:Write #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:03:01.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.665+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v100'140 uv140 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.665+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c715a290 con 0x5622c7151a70 2024-09-12T02:03:01.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.666+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [write 0~17490] v100'141 uv141 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.666+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c715a290 con 0x5622c7151a70 2024-09-12T02:03:01.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.667+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [omap-set-header] v100'142 uv142 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.667+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7155e10 con 0x5622c7151a70 2024-09-12T02:03:01.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.668+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 606.00000000 [create] v100'143 uv128 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.668+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c7155e10 con 0x5622c7151a70 2024-09-12T02:03:01.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.669+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 606.00000000 [delete] v100'144 uv144 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.669+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7155e10 con 0x5622c7151a70 2024-09-12T02:03:01.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.670+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v100'145 uv145 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.671 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:03:01.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.670+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7156e20 con 0x5622c7151a70 2024-09-12T02:03:01.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.671+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [setxattr (30)] v100'146 uv146 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.671+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7156e20 con 0x5622c7151a70 2024-09-12T02:03:01.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.672+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [setxattr (62)] v100'147 uv147 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.672+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7155e10 con 0x5622c7151a70 2024-09-12T02:03:01.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.673+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [omap-set-header] v100'148 uv148 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c7151a70 2024-09-12T02:03:01.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.673+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5622c7156490 0x5622c7158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.673+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:51 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7158e00 con 0x5622c7156490 2024-09-12T02:03:01.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.674+0000 7fd7a38d4640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5622c7156490 0x5622c7158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.674+0000 7fd7a38d4640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5622c7156490 0x5622c7158880 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:01.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.675+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(51 607.00000000 [create] v100'33 uv32 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.675+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:52 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c7158ec0 con 0x5622c7156490 2024-09-12T02:03:01.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.676+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(52 607.00000000 [delete] v100'34 uv34 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.676+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71592b0 con 0x5622c7156490 2024-09-12T02:03:01.679 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:03:01.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.679+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(53 607.00000000 [create] v100'35 uv35 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.679+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c715a2c0 con 0x5622c7156490 2024-09-12T02:03:01.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.682+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(54 607.00000000 [setxattr (30)] v100'36 uv36 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.682+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c715a2c0 con 0x5622c7156490 2024-09-12T02:03:01.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.688+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(55 607.00000000 [setxattr (62)] v100'37 uv37 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.688+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71592b0 con 0x5622c7156490 2024-09-12T02:03:01.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.689+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(56 607.00000000 [omap-set-header] v100'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.689+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5622c7159930 0x5622c715bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.689+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:57 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c715c2c0 con 0x5622c7159930 2024-09-12T02:03:01.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.689+0000 7fd7a48d6640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5622c7159930 0x5622c715bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.690+0000 7fd7a48d6640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5622c7159930 0x5622c715bd20 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:01.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.691+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(57 mds0_openfiles.0 [create] v100'25 uv24 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.691+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:58 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c715c7d0 con 0x5622c7159930 2024-09-12T02:03:01.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.692+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(58 mds0_openfiles.0 [delete] v100'26 uv26 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.692+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c715ccd0 con 0x5622c7159930 2024-09-12T02:03:01.693 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:03:01.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.693+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(59 mds0_openfiles.0 [create] v100'27 uv27 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.693+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7154bc0 con 0x5622c7159930 2024-09-12T02:03:01.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.695+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(60 mds0_openfiles.0 [omap-set-header] v100'28 uv28 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.695+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5622c715dc80 0x5622c7160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.695+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:61 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71606d0 con 0x5622c715dc80 2024-09-12T02:03:01.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.695+0000 7fd7a40d5640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5622c715dc80 0x5622c7160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.696+0000 7fd7a40d5640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5622c715dc80 0x5622c7160070 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:01.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.697+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(61 608.00000000 [create] v100'33 uv32 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.697+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:62 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c71607b0 con 0x5622c715dc80 2024-09-12T02:03:01.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.698+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(62 608.00000000 [delete] v100'34 uv34 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.698+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7160bd0 con 0x5622c715dc80 2024-09-12T02:03:01.699 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:03:01.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.699+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(63 608.00000000 [create] v100'35 uv35 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.699+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7161be0 con 0x5622c715dc80 2024-09-12T02:03:01.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.702+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(64 608.00000000 [setxattr (30)] v100'36 uv36 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.702+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7161be0 con 0x5622c715dc80 2024-09-12T02:03:01.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.703+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(65 608.00000000 [setxattr (62)] v100'37 uv37 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.703+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7160bd0 con 0x5622c715dc80 2024-09-12T02:03:01.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.705+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(66 608.00000000 [omap-set-header] v100'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.705+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:67 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7160bd0 con 0x5622c7159930 2024-09-12T02:03:01.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.706+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(67 604.00000000 [create] v100'59 uv53 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.706+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:68 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c7160f70 con 0x5622c7159930 2024-09-12T02:03:01.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.707+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(68 604.00000000 [delete] v100'60 uv60 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.707+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7161310 con 0x5622c7159930 2024-09-12T02:03:01.708 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:03:01.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.708+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(69 604.00000000 [create] v100'61 uv61 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.708+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71626c0 con 0x5622c7159930 2024-09-12T02:03:01.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.709+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(70 604.00000000 [setxattr (30)] v100'62 uv62 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.709+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71626c0 con 0x5622c7159930 2024-09-12T02:03:01.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.710+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(71 604.00000000 [setxattr (62)] v100'63 uv63 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.710+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c7159930 2024-09-12T02:03:01.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.711+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(72 604.00000000 [omap-set-header] v100'64 uv64 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.711+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c7159930 2024-09-12T02:03:01.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.712+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(73 500.00000000 [create] v100'65 uv58 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.712+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c7159930 2024-09-12T02:03:01.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.713+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(74 500.00000000 [delete] v100'66 uv66 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.713+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c7159930 2024-09-12T02:03:01.714 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:03:01.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.714+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(75 500.00000000 [create] v100'67 uv67 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.714+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c7159930 2024-09-12T02:03:01.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.715+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(76 500.00000000 [write 0~90] v100'68 uv68 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.715+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c7159930 2024-09-12T02:03:01.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.716+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(77 500.00000000 [omap-set-header] v100'69 uv69 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.716+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c7159930 2024-09-12T02:03:01.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.717+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(78 mds_snaptable [create] v100'27 uv26 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.717+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c7159930 2024-09-12T02:03:01.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.720+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(79 mds_snaptable [delete] v100'28 uv28 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.720+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c7159930 2024-09-12T02:03:01.723 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:03:01.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.723+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(80 mds_snaptable [create] v100'29 uv29 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.723+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c7159930 2024-09-12T02:03:01.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.725+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(81 mds_snaptable [write 0~70] v100'30 uv30 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.725+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c7159930 2024-09-12T02:03:01.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.728+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(82 mds_snaptable [omap-set-header] v100'31 uv31 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fd79c057030 con 0x5622c7159930 2024-09-12T02:03:01.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.728+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:83 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c715dc80 2024-09-12T02:03:01.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.729+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(83 605.00000000 [create] v100'33 uv32 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.729+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:84 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c715dc80 2024-09-12T02:03:01.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.730+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(84 605.00000000 [delete] v100'34 uv34 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.730+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c715dc80 2024-09-12T02:03:01.731 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:03:01.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.731+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(85 605.00000000 [create] v100'35 uv35 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.731+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c715dc80 2024-09-12T02:03:01.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.732+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(86 605.00000000 [setxattr (30)] v100'36 uv36 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.732+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c715dc80 2024-09-12T02:03:01.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.733+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(87 605.00000000 [setxattr (62)] v100'37 uv37 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.733+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c715dc80 2024-09-12T02:03:01.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.734+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(88 605.00000000 [omap-set-header] v100'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.734+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c715dc80 2024-09-12T02:03:01.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.735+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(89 mds0_inotable [create] v100'54 uv48 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.735+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c715dc80 2024-09-12T02:03:01.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.736+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(90 mds0_inotable [delete] v100'55 uv55 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.736+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71616b0 con 0x5622c715dc80 2024-09-12T02:03:01.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.737+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(91 mds0_inotable [create] v100'56 uv56 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.737 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:03:01.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.737+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7161b20 con 0x5622c715dc80 2024-09-12T02:03:01.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.738+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(92 mds0_inotable [write 0~34] v100'57 uv57 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.738+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7161b20 con 0x5622c715dc80 2024-09-12T02:03:01.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.739+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v100'58 uv58 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.739+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7161b20 con 0x5622c715dc80 2024-09-12T02:03:01.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.740+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(94 100.00000000 [create] v100'59 uv53 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.740+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c7161b20 con 0x5622c715dc80 2024-09-12T02:03:01.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.741+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(95 100.00000000 [delete] v100'60 uv60 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.741+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7161b20 con 0x5622c715dc80 2024-09-12T02:03:01.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.742+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(96 100.00000000 [create] v100'61 uv61 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.743 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:03:01.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.742+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7161b20 con 0x5622c715dc80 2024-09-12T02:03:01.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.743+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(97 100.00000000 [omap-set-header] v100'62 uv62 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.743+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7161fd0 con 0x5622c715dc80 2024-09-12T02:03:01.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.744+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v100'63 uv63 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.744+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5622c7162690 0x5622c7164ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.744+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:99 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c7162690 2024-09-12T02:03:01.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.744+0000 7fd7a38d4640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5622c7162690 0x5622c7164ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.745+0000 7fd7a38d4640 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5622c7162690 0x5622c7164ae0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:01.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.746+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(99 mds0_sessionmap [create] v100'26 uv25 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7162690 2024-09-12T02:03:01.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.746+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:100 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c7162690 2024-09-12T02:03:01.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.747+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(100 mds0_sessionmap [delete] v100'27 uv27 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7162690 2024-09-12T02:03:01.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.747+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c7162690 2024-09-12T02:03:01.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.750+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(101 mds0_sessionmap [create] v100'28 uv28 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7162690 2024-09-12T02:03:01.750 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:03:01.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.750+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c7162690 2024-09-12T02:03:01.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.752+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v100'29 uv29 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7162690 2024-09-12T02:03:01.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.752+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:103 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c715dc80 2024-09-12T02:03:01.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.753+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(103 609.00000000 [create] v100'33 uv32 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.754+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:104 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c715dc80 2024-09-12T02:03:01.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.755+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(104 609.00000000 [delete] v100'34 uv34 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.755+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c715dc80 2024-09-12T02:03:01.756 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:03:01.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.756+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(105 609.00000000 [create] v100'35 uv35 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.756+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7166030 con 0x5622c715dc80 2024-09-12T02:03:01.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.756+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v100'36 uv36 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.757+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7166030 con 0x5622c715dc80 2024-09-12T02:03:01.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.758+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v100'37 uv37 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.758+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c715dc80 2024-09-12T02:03:01.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.759+0000 7fd7a40d5640 1 -- 172.21.15.19:0/1046167228 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(108 609.00000000 [omap-set-header] v100'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd79401b040 con 0x5622c715dc80 2024-09-12T02:03:01.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.759+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:109 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c7156490 2024-09-12T02:03:01.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.760+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(109 400.00000000 [create] v100'27 uv26 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.760+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:110 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c7156490 2024-09-12T02:03:01.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.761+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(110 400.00000000 [delete] v100'28 uv28 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.761+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c7156490 2024-09-12T02:03:01.762 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:03:01.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.762+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(111 400.00000000 [create] v100'29 uv29 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.762+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c7156490 2024-09-12T02:03:01.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.763+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(112 400.00000000 [write 0~22] v100'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.763+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c7156490 2024-09-12T02:03:01.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.764+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(113 400.00000000 [omap-set-header] v100'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.764+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c7156490 2024-09-12T02:03:01.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.765+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(114 100.00000000.inode [create] v100'69 uv61 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.765+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c7156490 2024-09-12T02:03:01.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.766+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(115 100.00000000.inode [delete] v100'70 uv70 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.766+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c7156490 2024-09-12T02:03:01.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.767+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(116 100.00000000.inode [create] v100'71 uv71 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.767 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:03:01.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.767+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c7156490 2024-09-12T02:03:01.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.768+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v100'72 uv72 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.768+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c7156490 2024-09-12T02:03:01.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.769+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v100'73 uv73 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.769+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c7156490 2024-09-12T02:03:01.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.770+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(119 1.00000000 [create] v100'74 uv68 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.770+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c7156490 2024-09-12T02:03:01.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.771+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(120 1.00000000 [delete] v100'75 uv75 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.771+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c7156490 2024-09-12T02:03:01.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.773+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(121 1.00000000 [create] v100'76 uv76 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.773 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:03:01.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.773+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7166030 con 0x5622c7156490 2024-09-12T02:03:01.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.774+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v100'77 uv77 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.774+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7166030 con 0x5622c7156490 2024-09-12T02:03:01.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.774+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v100'78 uv78 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.775+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c7165020 con 0x5622c7156490 2024-09-12T02:03:01.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.775+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(124 1.00000000 [omap-set-header] v100'79 uv79 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.775+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5622c71654d0 con 0x5622c7156490 2024-09-12T02:03:01.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.776+0000 7fd7a38d4640 1 -- 172.21.15.19:0/1046167228 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v100'80 uv80 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fd798009040 con 0x5622c7156490 2024-09-12T02:03:01.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.776+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5622c7151a70 msgr2=0x5622c7153e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.776+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5622c7151a70 0x5622c7153e60 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.776+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5622c71470c0 msgr2=0x5622c71474a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.776+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5622c71470c0 0x5622c71474a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.776+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5622c7159930 msgr2=0x5622c715bd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.776+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5622c7159930 0x5622c715bd20 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.776+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5622c7162690 msgr2=0x5622c7164ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.776+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5622c7162690 0x5622c7164ae0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.776+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5622c7156490 msgr2=0x5622c7158880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.776+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 reap_dead start 2024-09-12T02:03:01.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.776+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5622c7156490 0x5622c7158880 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.776+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5622c715dc80 msgr2=0x5622c7160070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.776+0000 7fd7a48d6640 1 -- 172.21.15.19:0/1046167228 reap_dead start 2024-09-12T02:03:01.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.776+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5622c715dc80 0x5622c7160070 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.777+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd79006a810 msgr2=0x7fd79006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.777+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd79006a810 0x7fd79006ccd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x5622c701f1a0 tx=0x7fd7940038d0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.777+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622c70acf60 msgr2=0x5622c713e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.777+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622c70acf60 0x5622c713e860 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x5622c713bb40 tx=0x7fd79c003330 comp rx=0 tx=0).stop 2024-09-12T02:03:01.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.777+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 shutdown_connections 2024-09-12T02:03:01.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.777+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5622c715dc80 0x5622c7160070 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.777+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd79006a810 0x7fd79006ccd0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.777+0000 7fd7a65dff40 1 --2- 172.21.15.19:0/1046167228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622c70acf60 0x5622c713e860 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.777+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 >> 172.21.15.19:0/1046167228 conn(0x5622c6fd6ad0 msgr2=0x5622c7003ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:01.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.777+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 shutdown_connections 2024-09-12T02:03:01.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.777+0000 7fd7a65dff40 1 -- 172.21.15.19:0/1046167228 wait complete. 2024-09-12T02:03:01.780 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds0_openfiles.0 2024-09-12T02:03:01.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.863+0000 7fcf9bb2af40 1 Processor -- start 2024-09-12T02:03:01.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.863+0000 7fcf9bb2af40 1 -- start start 2024-09-12T02:03:01.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.864+0000 7fcf9bb2af40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c572df180 0x557c57323560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.864+0000 7fcf9bb2af40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c5730d050 0x557c57394fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.864+0000 7fcf9bb2af40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557c57397080 0x557c57442c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.864+0000 7fcf9bb2af40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557c5722e510 con 0x557c5730d050 2024-09-12T02:03:01.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.864+0000 7fcf9bb2af40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557c57287c50 con 0x557c572df180 2024-09-12T02:03:01.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.864+0000 7fcf9bb2af40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x557c572df5c0 con 0x557c57397080 2024-09-12T02:03:01.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.864+0000 7fcf983b9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c5730d050 0x557c57394fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.864+0000 7fcf983b9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c5730d050 0x557c57394fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40048/0 (socket says 172.21.15.19:40048) 2024-09-12T02:03:01.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.864+0000 7fcf983b9640 1 -- 172.21.15.19:0/1461502414 learned_addr learned my addr 172.21.15.19:0/1461502414 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:01.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.864+0000 7fcf98bba640 1 --2- 172.21.15.19:0/1461502414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c572df180 0x557c57323560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.864+0000 7fcf993bb640 1 --2- 172.21.15.19:0/1461502414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557c57397080 0x557c57442c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.865+0000 7fcf983b9640 1 -- 172.21.15.19:0/1461502414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557c57397080 msgr2=0x557c57442c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:01.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.865+0000 7fcf983b9640 1 --2- 172.21.15.19:0/1461502414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557c57397080 0x557c57442c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.865+0000 7fcf983b9640 1 -- 172.21.15.19:0/1461502414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c572df180 msgr2=0x557c57323560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:01.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.865+0000 7fcf983b9640 1 --2- 172.21.15.19:0/1461502414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c572df180 0x557c57323560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.865+0000 7fcf983b9640 1 -- 172.21.15.19:0/1461502414 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c573b44b0 con 0x557c5730d050 2024-09-12T02:03:01.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.865+0000 7fcf983b9640 1 --2- 172.21.15.19:0/1461502414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c5730d050 0x557c57394fd0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fcf80025930 tx=0x7fcf8004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d1a97a2c581ac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:01.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.865+0000 7fcf973b7640 1 -- 172.21.15.19:0/1461502414 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf80059040 con 0x557c5730d050 2024-09-12T02:03:01.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.865+0000 7fcf973b7640 1 -- 172.21.15.19:0/1461502414 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf800547f0 con 0x557c5730d050 2024-09-12T02:03:01.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.865+0000 7fcf973b7640 1 -- 172.21.15.19:0/1461502414 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf80054ba0 con 0x557c5730d050 2024-09-12T02:03:01.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.865+0000 7fcf9bb2af40 1 -- 172.21.15.19:0/1461502414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c5730d050 msgr2=0x557c57394fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.865+0000 7fcf9bb2af40 1 --2- 172.21.15.19:0/1461502414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c5730d050 0x557c57394fd0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fcf80025930 tx=0x7fcf8004e000 comp rx=0 tx=0).stop 2024-09-12T02:03:01.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.866+0000 7fcf9bb2af40 1 -- 172.21.15.19:0/1461502414 shutdown_connections 2024-09-12T02:03:01.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.866+0000 7fcf9bb2af40 1 --2- 172.21.15.19:0/1461502414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557c57397080 0x557c57442c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.866+0000 7fcf9bb2af40 1 --2- 172.21.15.19:0/1461502414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c5730d050 0x557c57394fd0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.866+0000 7fcf9bb2af40 1 --2- 172.21.15.19:0/1461502414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c572df180 0x557c57323560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.866+0000 7fcf9bb2af40 1 -- 172.21.15.19:0/1461502414 >> 172.21.15.19:0/1461502414 conn(0x557c572dc9e0 msgr2=0x557c573b50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:01.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.866+0000 7fcf9bb2af40 1 -- 172.21.15.19:0/1461502414 shutdown_connections 2024-09-12T02:03:01.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.866+0000 7fcf9bb2af40 1 -- 172.21.15.19:0/1461502414 wait complete. 2024-09-12T02:03:01.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.866+0000 7fcf9bb2af40 1 Processor -- start 2024-09-12T02:03:01.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.866+0000 7fcf9bb2af40 1 -- start start 2024-09-12T02:03:01.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.867+0000 7fcf9bb2af40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c572df180 0x557c57442140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.867+0000 7fcf9bb2af40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c5730d050 0x557c5739c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.867+0000 7fcf9bb2af40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557c57397080 0x557c57397460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.867+0000 7fcf9bb2af40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557c572dece0 con 0x557c572df180 2024-09-12T02:03:01.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.867+0000 7fcf9bb2af40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557c572dea00 con 0x557c5730d050 2024-09-12T02:03:01.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.867+0000 7fcf9bb2af40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x557c5739cde0 con 0x557c57397080 2024-09-12T02:03:01.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.867+0000 7fcf98bba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c572df180 0x557c57442140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.867+0000 7fcf98bba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c572df180 0x557c57442140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40054/0 (socket says 172.21.15.19:40054) 2024-09-12T02:03:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.867+0000 7fcf98bba640 1 -- 172.21.15.19:0/1280801451 learned_addr learned my addr 172.21.15.19:0/1280801451 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.867+0000 7fcf983b9640 1 --2- 172.21.15.19:0/1280801451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c5730d050 0x557c5739c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.867+0000 7fcf993bb640 1 --2- 172.21.15.19:0/1280801451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557c57397080 0x557c57397460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.867+0000 7fcf98bba640 1 -- 172.21.15.19:0/1280801451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557c57397080 msgr2=0x557c57397460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.867+0000 7fcf98bba640 1 --2- 172.21.15.19:0/1280801451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557c57397080 0x557c57397460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.867+0000 7fcf98bba640 1 -- 172.21.15.19:0/1280801451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c5730d050 msgr2=0x557c5739c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.867+0000 7fcf98bba640 1 --2- 172.21.15.19:0/1280801451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c5730d050 0x557c5739c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.867+0000 7fcf98bba640 1 -- 172.21.15.19:0/1280801451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c57442d60 con 0x557c572df180 2024-09-12T02:03:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.868+0000 7fcf98bba640 1 --2- 172.21.15.19:0/1280801451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c572df180 0x557c57442140 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800e4d0 tx=0x7fcf8800e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.868+0000 7fcf963b5640 1 -- 172.21.15.19:0/1280801451 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf88019070 con 0x557c572df180 2024-09-12T02:03:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.868+0000 7fcf963b5640 1 -- 172.21.15.19:0/1280801451 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf880104c0 con 0x557c572df180 2024-09-12T02:03:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.868+0000 7fcf9bb2af40 1 -- 172.21.15.19:0/1280801451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c57443040 con 0x557c572df180 2024-09-12T02:03:01.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.868+0000 7fcf963b5640 1 -- 172.21.15.19:0/1280801451 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf880108b0 con 0x557c572df180 2024-09-12T02:03:01.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.868+0000 7fcf9bb2af40 1 -- 172.21.15.19:0/1280801451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c57393780 con 0x557c572df180 2024-09-12T02:03:01.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.869+0000 7fcf963b5640 1 -- 172.21.15.19:0/1280801451 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf8801c070 con 0x557c572df180 2024-09-12T02:03:01.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.870+0000 7fcf963b5640 1 --2- 172.21.15.19:0/1280801451 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcf7806a810 0x7fcf7806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.870+0000 7fcf963b5640 1 -- 172.21.15.19:0/1280801451 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6733+0+0 (secure 0 0 0) 0x7fcf88089660 con 0x557c572df180 2024-09-12T02:03:01.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.870+0000 7fcf983b9640 1 --2- 172.21.15.19:0/1280801451 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcf7806a810 0x7fcf7806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.870+0000 7fcf9bb2af40 1 --2- 172.21.15.19:0/1280801451 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x557c57321f90 0x557c57393ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:01.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.870+0000 7fcf9bb2af40 1 -- 172.21.15.19:0/1280801451 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:1 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x557c573941e0 con 0x557c57321f90 2024-09-12T02:03:01.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.870+0000 7fcf993bb640 1 --2- 172.21.15.19:0/1280801451 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x557c57321f90 0x557c57393ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:01.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.870+0000 7fcf983b9640 1 --2- 172.21.15.19:0/1280801451 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcf7806a810 0x7fcf7806ccd0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcf80025930 tx=0x7fcf80051000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:01.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.870+0000 7fcf993bb640 1 --2- 172.21.15.19:0/1280801451 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x557c57321f90 0x557c57393ca0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:01.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.871+0000 7fcf993bb640 1 -- 172.21.15.19:0/1280801451 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(1 mds0_openfiles.0 [delete] v100'29 uv29 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcf90011840 con 0x557c57321f90 2024-09-12T02:03:01.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.872+0000 7fcf9bb2af40 1 -- 172.21.15.19:0/1280801451 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x557c57321f90 msgr2=0x557c57393ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.872+0000 7fcf9bb2af40 1 --2- 172.21.15.19:0/1280801451 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x557c57321f90 0x557c57393ca0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:01.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.872+0000 7fcf9bb2af40 1 -- 172.21.15.19:0/1280801451 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcf7806a810 msgr2=0x7fcf7806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.872+0000 7fcf9bb2af40 1 --2- 172.21.15.19:0/1280801451 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcf7806a810 0x7fcf7806ccd0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcf80025930 tx=0x7fcf80051000 comp rx=0 tx=0).stop 2024-09-12T02:03:01.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.872+0000 7fcf9bb2af40 1 -- 172.21.15.19:0/1280801451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c572df180 msgr2=0x557c57442140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:01.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.872+0000 7fcf9bb2af40 1 --2- 172.21.15.19:0/1280801451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c572df180 0x557c57442140 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800e4d0 tx=0x7fcf8800e990 comp rx=0 tx=0).stop 2024-09-12T02:03:01.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.872+0000 7fcf993bb640 1 -- 172.21.15.19:0/1280801451 reap_dead start 2024-09-12T02:03:01.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.872+0000 7fcf9bb2af40 1 -- 172.21.15.19:0/1280801451 shutdown_connections 2024-09-12T02:03:01.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.872+0000 7fcf9bb2af40 1 -- 172.21.15.19:0/1280801451 >> 172.21.15.19:0/1280801451 conn(0x557c572dc9e0 msgr2=0x557c573b6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:01.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.872+0000 7fcf9bb2af40 1 -- 172.21.15.19:0/1280801451 shutdown_connections 2024-09-12T02:03:01.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:01.872+0000 7fcf9bb2af40 1 -- 172.21.15.19:0/1280801451 wait complete. 2024-09-12T02:03:01.876 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:03:02.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.021+0000 7f4212ed2640 1 Processor -- start 2024-09-12T02:03:02.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.021+0000 7f4212ed2640 1 -- start start 2024-09-12T02:03:02.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.021+0000 7f4212ed2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c0b5f80 0x7f420c162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:02.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.022+0000 7f4212ed2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f420c0d3320 0x7f420c0d37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:02.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.022+0000 7f4212ed2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f420c0d2600 con 0x7f420c0d4c10 2024-09-12T02:03:02.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.022+0000 7f4212ed2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f420c0d5420 con 0x7f420c0d3320 2024-09-12T02:03:02.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.022+0000 7f4212ed2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f420c0d2e90 con 0x7f420c0b5f80 2024-09-12T02:03:02.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.022+0000 7f421146f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f420c0d3320 0x7f420c0d37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:02.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.022+0000 7f421146f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f420c0d3320 0x7f420c0d37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:46838/0 (socket says 172.21.15.19:46838) 2024-09-12T02:03:02.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.022+0000 7f4210c6e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c0b5f80 0x7f420c162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:02.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.022+0000 7f421146f640 1 -- 172.21.15.19:0/2741536967 learned_addr learned my addr 172.21.15.19:0/2741536967 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:02.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.022+0000 7f420bfff640 1 --1- 172.21.15.19:0/2741536967 >> v1:172.21.15.135:6789/0 conn(0x7f420c0d4c10 0x7f420c0b6360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:47142/0 (socket says 172.21.15.19:47142) 2024-09-12T02:03:02.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.022+0000 7f421146f640 1 -- 172.21.15.19:0/2741536967 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c0b5f80 msgr2=0x7f420c162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:02.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.022+0000 7f421146f640 1 --2- 172.21.15.19:0/2741536967 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c0b5f80 0x7f420c162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:02.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.022+0000 7f421146f640 1 -- 172.21.15.19:0/2741536967 >> v1:172.21.15.135:6789/0 conn(0x7f420c0d4c10 legacy=0x7f420c0b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:02.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.022+0000 7f421146f640 1 -- 172.21.15.19:0/2741536967 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420c0b3c10 con 0x7f420c0d3320 2024-09-12T02:03:02.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.023+0000 7f421146f640 1 --2- 172.21.15.19:0/2741536967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f420c0d3320 0x7f420c0d37b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4204009e50 tx=0x7f420402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=670f2bda8dd6b89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:02.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.023+0000 7f420b7fe640 1 -- 172.21.15.19:0/2741536967 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4204036070 con 0x7f420c0d3320 2024-09-12T02:03:02.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.023+0000 7f420b7fe640 1 -- 172.21.15.19:0/2741536967 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4204031600 con 0x7f420c0d3320 2024-09-12T02:03:02.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.023+0000 7f420b7fe640 1 -- 172.21.15.19:0/2741536967 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42040319d0 con 0x7f420c0d3320 2024-09-12T02:03:02.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.024+0000 7f4212ed2640 1 -- 172.21.15.19:0/2741536967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f420c0d3320 msgr2=0x7f420c0d37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:02.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.024+0000 7f4212ed2640 1 --2- 172.21.15.19:0/2741536967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f420c0d3320 0x7f420c0d37b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4204009e50 tx=0x7f420402a710 comp rx=0 tx=0).stop 2024-09-12T02:03:02.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.024+0000 7f4212ed2640 1 -- 172.21.15.19:0/2741536967 shutdown_connections 2024-09-12T02:03:02.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.024+0000 7f4212ed2640 1 --2- 172.21.15.19:0/2741536967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f420c0d3320 0x7f420c0d37b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:02.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.024+0000 7f4212ed2640 1 --2- 172.21.15.19:0/2741536967 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c0b5f80 0x7f420c162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:02.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.024+0000 7f4212ed2640 1 -- 172.21.15.19:0/2741536967 >> 172.21.15.19:0/2741536967 conn(0x7f420c08bfc0 msgr2=0x7f420c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:02.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.024+0000 7f4212ed2640 1 -- 172.21.15.19:0/2741536967 shutdown_connections 2024-09-12T02:03:02.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.024+0000 7f4212ed2640 1 -- 172.21.15.19:0/2741536967 wait complete. 2024-09-12T02:03:02.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.025+0000 7f4212ed2640 1 Processor -- start 2024-09-12T02:03:02.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.025+0000 7f4212ed2640 1 -- start start 2024-09-12T02:03:02.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.026+0000 7f4212ed2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c0b5f80 0x7f420c0c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:02.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.026+0000 7f4212ed2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f420c0d3320 0x7f420c0b9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:02.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.026+0000 7f4212ed2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f420c0d4c10 0x7f420c153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:02.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.026+0000 7f4212ed2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f420c0d2b20 con 0x7f420c0d3320 2024-09-12T02:03:02.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.026+0000 7f4212ed2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f420c0d2880 con 0x7f420c0d4c10 2024-09-12T02:03:02.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.026+0000 7f4212ed2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f420c15f690 con 0x7f420c0b5f80 2024-09-12T02:03:02.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.026+0000 7f420bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f420c0d3320 0x7f420c0b9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:02.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.026+0000 7f4210c6e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c0b5f80 0x7f420c0c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.026+0000 7f420bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f420c0d3320 0x7f420c0b9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40068/0 (socket says 172.21.15.19:40068) 2024-09-12T02:03:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.026+0000 7f420bfff640 1 -- 172.21.15.19:0/1987602093 learned_addr learned my addr 172.21.15.19:0/1987602093 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.026+0000 7f421146f640 1 --2- 172.21.15.19:0/1987602093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f420c0d4c10 0x7f420c153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.027+0000 7f4210c6e640 1 -- 172.21.15.19:0/1987602093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f420c0d4c10 msgr2=0x7f420c153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.027+0000 7f4210c6e640 1 --2- 172.21.15.19:0/1987602093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f420c0d4c10 0x7f420c153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.027+0000 7f4210c6e640 1 -- 172.21.15.19:0/1987602093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f420c0d3320 msgr2=0x7f420c0b9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.027+0000 7f4210c6e640 1 --2- 172.21.15.19:0/1987602093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f420c0d3320 0x7f420c0b9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.027+0000 7f4210c6e640 1 -- 172.21.15.19:0/1987602093 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420c0ba320 con 0x7f420c0b5f80 2024-09-12T02:03:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.027+0000 7f420bfff640 1 --2- 172.21.15.19:0/1987602093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f420c0d3320 0x7f420c0b9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:03:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.027+0000 7f4210c6e640 1 --2- 172.21.15.19:0/1987602093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c0b5f80 0x7f420c0c9c80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f420000e850 tx=0x7f420000ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.027+0000 7f42097fa640 1 -- 172.21.15.19:0/1987602093 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200017070 con 0x7f420c0b5f80 2024-09-12T02:03:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.027+0000 7f42097fa640 1 -- 172.21.15.19:0/1987602093 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f420000c940 con 0x7f420c0b5f80 2024-09-12T02:03:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.027+0000 7f4212ed2640 1 -- 172.21.15.19:0/1987602093 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f420c153a80 con 0x7f420c0b5f80 2024-09-12T02:03:02.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.027+0000 7f42097fa640 1 -- 172.21.15.19:0/1987602093 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420000cd10 con 0x7f420c0b5f80 2024-09-12T02:03:02.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.027+0000 7f4212ed2640 1 -- 172.21.15.19:0/1987602093 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f420c0c8c50 con 0x7f420c0b5f80 2024-09-12T02:03:02.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.028+0000 7f4212ed2640 1 -- 172.21.15.19:0/1987602093 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f420c0d3f70 con 0x7f420c0b5f80 2024-09-12T02:03:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.029+0000 7f42097fa640 1 -- 172.21.15.19:0/1987602093 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f420001a070 con 0x7f420c0b5f80 2024-09-12T02:03:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.029+0000 7f42097fa640 1 --2- 172.21.15.19:0/1987602093 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f41f006be30 0x7f41f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.029+0000 7f42097fa640 1 -- 172.21.15.19:0/1987602093 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(100..100 src has 1..100) ==== 6733+0+0 (secure 0 0 0) 0x7f420008b0d0 con 0x7f420c0b5f80 2024-09-12T02:03:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.029+0000 7f420bfff640 1 --2- 172.21.15.19:0/1987602093 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f41f006be30 0x7f41f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.030+0000 7f420bfff640 1 --2- 172.21.15.19:0/1987602093 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f41f006be30 0x7f41f006e2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f420c0c9a00 tx=0x7f41f8007f10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:02.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.034+0000 7f42097fa640 1 -- 172.21.15.19:0/1987602093 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42000590a0 con 0x7f420c0b5f80 2024-09-12T02:03:02.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.244+0000 7f4212ed2640 1 -- 172.21.15.19:0/1987602093 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f420c0b4100 con 0x7f420c0b5f80 2024-09-12T02:03:02.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.550+0000 7f42097fa640 1 -- 172.21.15.19:0/1987602093 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v113) ==== 162+0+0 (secure 0 0 0) 0x7f420005d3a0 con 0x7f420c0b5f80 2024-09-12T02:03:02.551 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:03:02.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.552+0000 7f4212ed2640 1 -- 172.21.15.19:0/1987602093 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f41f006be30 msgr2=0x7f41f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:02.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.552+0000 7f4212ed2640 1 --2- 172.21.15.19:0/1987602093 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f41f006be30 0x7f41f006e2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f420c0c9a00 tx=0x7f41f8007f10 comp rx=0 tx=0).stop 2024-09-12T02:03:02.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.552+0000 7f4212ed2640 1 -- 172.21.15.19:0/1987602093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c0b5f80 msgr2=0x7f420c0c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:02.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.552+0000 7f4212ed2640 1 --2- 172.21.15.19:0/1987602093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c0b5f80 0x7f420c0c9c80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f420000e850 tx=0x7f420000ed10 comp rx=0 tx=0).stop 2024-09-12T02:03:02.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.553+0000 7f4212ed2640 1 -- 172.21.15.19:0/1987602093 shutdown_connections 2024-09-12T02:03:02.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.553+0000 7f4212ed2640 1 --2- 172.21.15.19:0/1987602093 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f41f006be30 0x7f41f006e2f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:02.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.553+0000 7f4212ed2640 1 --2- 172.21.15.19:0/1987602093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f420c0d4c10 0x7f420c153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:02.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.553+0000 7f4212ed2640 1 --2- 172.21.15.19:0/1987602093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f420c0d3320 0x7f420c0b9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:02.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.553+0000 7f4212ed2640 1 --2- 172.21.15.19:0/1987602093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c0b5f80 0x7f420c0c9c80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:02.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.553+0000 7f4212ed2640 1 -- 172.21.15.19:0/1987602093 >> 172.21.15.19:0/1987602093 conn(0x7f420c08bfc0 msgr2=0x7f420c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:02.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.553+0000 7f4212ed2640 1 -- 172.21.15.19:0/1987602093 shutdown_connections 2024-09-12T02:03:02.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:02.553+0000 7f4212ed2640 1 -- 172.21.15.19:0/1987602093 wait complete. 2024-09-12T02:03:02.557 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:03:02.558+0000 7f08fe932640 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2024-09-12T02:03:02.969 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:03.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.083+0000 7f3fe9a47640 1 Processor -- start 2024-09-12T02:03:03.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.083+0000 7f3fe9a47640 1 -- start start 2024-09-12T02:03:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.084+0000 7f3fe9a47640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3fe4072700 0x7f3fe415d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.084+0000 7f3fe9a47640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe4146140 con 0x7f3fe4072de0 2024-09-12T02:03:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.084+0000 7f3fe9a47640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe40cd740 con 0x7f3fe4072320 2024-09-12T02:03:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.084+0000 7f3fe9a47640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f3fe40cda20 con 0x7f3fe4072700 2024-09-12T02:03:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.084+0000 7f3fda7fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3fe4072de0 0x7f3fe415d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55486/0 (socket says 172.21.15.19:55486) 2024-09-12T02:03:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.084+0000 7f3fda7fc640 1 -- 172.21.15.19:0/1944447291 learned_addr learned my addr 172.21.15.19:0/1944447291 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:03.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.084+0000 7f3fe37fe640 1 --2- 172.21.15.19:0/1944447291 >> v2:172.21.15.135:3300/0 conn(0x7f3fe4072700 0x7f3fe415d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:03.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.084+0000 7f3fe27fc640 1 -- 172.21.15.19:0/1944447291 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3687918039 0 0) 0x7f3fe4146140 con 0x7f3fe4072de0 2024-09-12T02:03:03.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.084+0000 7f3fe27fc640 1 -- 172.21.15.19:0/1944447291 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fd0003520 con 0x7f3fe4072de0 2024-09-12T02:03:03.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.084+0000 7f3fe37fe640 1 -- 172.21.15.19:0/1944447291 >> v1:172.21.15.135:6789/0 conn(0x7f3fe4072320 legacy=0x7f3fe40cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:03.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.084+0000 7f3fe37fe640 1 -- 172.21.15.19:0/1944447291 >> v1:172.21.15.19:6789/0 conn(0x7f3fe4072de0 legacy=0x7f3fe415d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:03.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.084+0000 7f3fe37fe640 1 -- 172.21.15.19:0/1944447291 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe40cdd00 con 0x7f3fe4072700 2024-09-12T02:03:03.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.085+0000 7f3fe37fe640 1 --2- 172.21.15.19:0/1944447291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fe4072700 0x7f3fe415d8f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009d90 tx=0x7f3fdc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9d51398a0a27592 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:03.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.086+0000 7f3fe27fc640 1 -- 172.21.15.19:0/1944447291 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc007740 con 0x7f3fe4072700 2024-09-12T02:03:03.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.086+0000 7f3fe27fc640 1 -- 172.21.15.19:0/1944447291 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fdc0078e0 con 0x7f3fe4072700 2024-09-12T02:03:03.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.086+0000 7f3fe27fc640 1 -- 172.21.15.19:0/1944447291 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc007c90 con 0x7f3fe4072700 2024-09-12T02:03:03.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.086+0000 7f3fe9a47640 1 -- 172.21.15.19:0/1944447291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fe4072700 msgr2=0x7f3fe415d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:03.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.086+0000 7f3fe9a47640 1 --2- 172.21.15.19:0/1944447291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fe4072700 0x7f3fe415d8f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009d90 tx=0x7f3fdc02a660 comp rx=0 tx=0).stop 2024-09-12T02:03:03.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.086+0000 7f3fe9a47640 1 -- 172.21.15.19:0/1944447291 shutdown_connections 2024-09-12T02:03:03.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.086+0000 7f3fe9a47640 1 --2- 172.21.15.19:0/1944447291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fe4072700 0x7f3fe415d8f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:03.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.086+0000 7f3fe9a47640 1 -- 172.21.15.19:0/1944447291 >> 172.21.15.19:0/1944447291 conn(0x7f3fe4067d70 msgr2=0x7f3fe406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:03.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.086+0000 7f3fe9a47640 1 -- 172.21.15.19:0/1944447291 shutdown_connections 2024-09-12T02:03:03.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.086+0000 7f3fe9a47640 1 -- 172.21.15.19:0/1944447291 wait complete. 2024-09-12T02:03:03.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.087+0000 7f3fe9a47640 1 Processor -- start 2024-09-12T02:03:03.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.088+0000 7f3fe9a47640 1 -- start start 2024-09-12T02:03:03.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.088+0000 7f3fe9a47640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fe4072320 0x7f3fe4141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:03.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.088+0000 7f3fe9a47640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fe4072700 0x7f3fe415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:03.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.088+0000 7f3fe9a47640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fe4072de0 0x7f3fe40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:03.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.088+0000 7f3fe9a47640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe415dfb0 con 0x7f3fe4072700 2024-09-12T02:03:03.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.088+0000 7f3fe9a47640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe415de30 con 0x7f3fe4072320 2024-09-12T02:03:03.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.088+0000 7f3fe9a47640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe415e130 con 0x7f3fe4072de0 2024-09-12T02:03:03.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.088+0000 7f3fda7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fe4072700 0x7f3fe415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:03.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.089+0000 7f3fda7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fe4072700 0x7f3fe415bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40070/0 (socket says 172.21.15.19:40070) 2024-09-12T02:03:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.089+0000 7f3fda7fc640 1 -- 172.21.15.19:0/2832894162 learned_addr learned my addr 172.21.15.19:0/2832894162 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.089+0000 7f3fe37fe640 1 --2- 172.21.15.19:0/2832894162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fe4072de0 0x7f3fe40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.089+0000 7f3fe2ffd640 1 --2- 172.21.15.19:0/2832894162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fe4072320 0x7f3fe4141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.089+0000 7f3fda7fc640 1 -- 172.21.15.19:0/2832894162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fe4072de0 msgr2=0x7f3fe40b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.089+0000 7f3fda7fc640 1 --2- 172.21.15.19:0/2832894162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fe4072de0 0x7f3fe40b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.089+0000 7f3fda7fc640 1 -- 172.21.15.19:0/2832894162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fe4072320 msgr2=0x7f3fe4141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.089+0000 7f3fda7fc640 1 --2- 172.21.15.19:0/2832894162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fe4072320 0x7f3fe4141220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.089+0000 7f3fda7fc640 1 -- 172.21.15.19:0/2832894162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe40b3d30 con 0x7f3fe4072700 2024-09-12T02:03:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.089+0000 7f3fda7fc640 1 --2- 172.21.15.19:0/2832894162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fe4072700 0x7f3fe415bae0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00c410 tx=0x7f3fcc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.089+0000 7f3fe0ff9640 1 -- 172.21.15.19:0/2832894162 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc017070 con 0x7f3fe4072700 2024-09-12T02:03:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.089+0000 7f3fe0ff9640 1 -- 172.21.15.19:0/2832894162 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fcc005ce0 con 0x7f3fe4072700 2024-09-12T02:03:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.089+0000 7f3fe9a47640 1 -- 172.21.15.19:0/2832894162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe40b4010 con 0x7f3fe4072700 2024-09-12T02:03:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.089+0000 7f3fe0ff9640 1 -- 172.21.15.19:0/2832894162 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc0072f0 con 0x7f3fe4072700 2024-09-12T02:03:03.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.089+0000 7f3fe9a47640 1 -- 172.21.15.19:0/2832894162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe40b45d0 con 0x7f3fe4072700 2024-09-12T02:03:03.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.090+0000 7f3fe9a47640 1 -- 172.21.15.19:0/2832894162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe4072c00 con 0x7f3fe4072700 2024-09-12T02:03:03.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.091+0000 7f3fe0ff9640 1 -- 172.21.15.19:0/2832894162 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3fcc01a070 con 0x7f3fe4072700 2024-09-12T02:03:03.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.091+0000 7f3fe0ff9640 1 --2- 172.21.15.19:0/2832894162 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3fc406be60 0x7f3fc406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:03.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.091+0000 7f3fe0ff9640 1 -- 172.21.15.19:0/2832894162 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6733+0+0 (secure 0 0 0) 0x7f3fcc08a740 con 0x7f3fe4072700 2024-09-12T02:03:03.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.092+0000 7f3fe2ffd640 1 --2- 172.21.15.19:0/2832894162 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3fc406be60 0x7f3fc406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:03.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.092+0000 7f3fe2ffd640 1 --2- 172.21.15.19:0/2832894162 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3fc406be60 0x7f3fc406e320 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4001640 tx=0x7f3fd4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:03.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.096+0000 7f3fe0ff9640 1 -- 172.21.15.19:0/2832894162 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3fe4072c00 con 0x7f3fe4072700 2024-09-12T02:03:03.271 INFO:tasks.ceph.mds.c.smithi019.stderr: -38> 2024-09-12T02:02:58.519+0000 7faa90fbd640 -1 log_channel(cluster) log [ERR] : missing journal object 2024-09-12T02:03:03.295 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:03:03.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.309+0000 7f3fe9a47640 1 -- 172.21.15.19:0/2832894162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fe40cea50 con 0x7f3fe4072700 2024-09-12T02:03:03.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.309+0000 7f3fe0ff9640 1 -- 172.21.15.19:0/2832894162 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+4401 (secure 0 0 0) 0x7f3fcc058d10 con 0x7f3fe4072700 2024-09-12T02:03:03.310 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:03.310 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":114,"btime":"2024-09-12T02:03:02:550575+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:02.550565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7162},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7162":{"gid":7162,"name":"d","rank":0,"incarnation":114,"state":"up:replay","state_seq":1,"addr":"172.21.15.135:6837/4287312235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4287312235},{"type":"v1","addr":"172.21.15.135:6837","nonce":4287312235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:03.310 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 114 2024-09-12T02:03:03.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.311+0000 7f3fe9a47640 1 -- 172.21.15.19:0/2832894162 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3fc406be60 msgr2=0x7f3fc406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:03.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.311+0000 7f3fe9a47640 1 --2- 172.21.15.19:0/2832894162 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3fc406be60 0x7f3fc406e320 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4001640 tx=0x7f3fd4009040 comp rx=0 tx=0).stop 2024-09-12T02:03:03.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.311+0000 7f3fe9a47640 1 -- 172.21.15.19:0/2832894162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fe4072700 msgr2=0x7f3fe415bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:03.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.311+0000 7f3fe9a47640 1 --2- 172.21.15.19:0/2832894162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fe4072700 0x7f3fe415bae0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00c410 tx=0x7f3fcc00c8d0 comp rx=0 tx=0).stop 2024-09-12T02:03:03.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.311+0000 7f3fe9a47640 1 -- 172.21.15.19:0/2832894162 shutdown_connections 2024-09-12T02:03:03.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.311+0000 7f3fe9a47640 1 --2- 172.21.15.19:0/2832894162 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3fc406be60 0x7f3fc406e320 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:03.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.311+0000 7f3fe9a47640 1 --2- 172.21.15.19:0/2832894162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fe4072de0 0x7f3fe40b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:03.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.311+0000 7f3fe9a47640 1 --2- 172.21.15.19:0/2832894162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fe4072700 0x7f3fe415bae0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:03.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.311+0000 7f3fe9a47640 1 --2- 172.21.15.19:0/2832894162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fe4072320 0x7f3fe4141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:03.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.311+0000 7f3fe9a47640 1 -- 172.21.15.19:0/2832894162 >> 172.21.15.19:0/2832894162 conn(0x7f3fe4067d70 msgr2=0x7f3fe4144210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:03.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.311+0000 7f3fe9a47640 1 -- 172.21.15.19:0/2832894162 shutdown_connections 2024-09-12T02:03:03.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:03.311+0000 7f3fe9a47640 1 -- 172.21.15.19:0/2832894162 wait complete. 2024-09-12T02:03:03.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 114, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:03:02.550565+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 100, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7162}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7162': {'gid': 7162, 'name': 'd', 'rank': 0, 'incarnation': 114, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.135:6837/4287312235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 4287312235}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 4287312235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:03:03.323 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7162:up:replay 2024-09-12T02:03:03.323 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-12T02:03:08.727 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.842+0000 7fdba074b640 1 Processor -- start 2024-09-12T02:03:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.842+0000 7fdba074b640 1 -- start start 2024-09-12T02:03:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.843+0000 7fdba074b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb98161c80 0x7fdb9806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.843+0000 7fdba074b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdb98162060 0x7fdb980b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.843+0000 7fdba074b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb9806e870 con 0x7fdb980b64b0 2024-09-12T02:03:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.843+0000 7fdba074b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fdb9806d9f0 con 0x7fdb98162060 2024-09-12T02:03:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.843+0000 7fdba074b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdb9806dcd0 con 0x7fdb98161c80 2024-09-12T02:03:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.844+0000 7fdb9dce6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdb98162060 0x7fdb980b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.844+0000 7fdb9dce6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdb98162060 0x7fdb980b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40102/0 (socket says 172.21.15.19:40102) 2024-09-12T02:03:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.844+0000 7fdb9dce6640 1 -- 172.21.15.19:0/1303274655 learned_addr learned my addr 172.21.15.19:0/1303274655 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.844+0000 7fdb9e4e7640 1 --2- 172.21.15.19:0/1303274655 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb98161c80 0x7fdb9806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.844+0000 7fdb9dce6640 1 -- 172.21.15.19:0/1303274655 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb98161c80 msgr2=0x7fdb9806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.844+0000 7fdb9dce6640 1 --2- 172.21.15.19:0/1303274655 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb98161c80 0x7fdb9806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.844+0000 7fdb9dce6640 1 -- 172.21.15.19:0/1303274655 >> v1:172.21.15.135:6789/0 conn(0x7fdb980b64b0 legacy=0x7fdb98162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.844+0000 7fdb9dce6640 1 -- 172.21.15.19:0/1303274655 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb9806dfb0 con 0x7fdb98162060 2024-09-12T02:03:08.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.845+0000 7fdb9dce6640 1 --2- 172.21.15.19:0/1303274655 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb98162060 0x7fdb980b5f70 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fdb88009870 tx=0x7fdb8802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5edef92b05f6b0fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:08.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.845+0000 7fdb9d4e5640 1 -- 172.21.15.19:0/1303274655 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb88037070 con 0x7fdb98162060 2024-09-12T02:03:08.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.845+0000 7fdb9d4e5640 1 -- 172.21.15.19:0/1303274655 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb88032440 con 0x7fdb98162060 2024-09-12T02:03:08.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.845+0000 7fdb9d4e5640 1 -- 172.21.15.19:0/1303274655 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb88032810 con 0x7fdb98162060 2024-09-12T02:03:08.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.845+0000 7fdba074b640 1 -- 172.21.15.19:0/1303274655 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb98162060 msgr2=0x7fdb980b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:08.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.845+0000 7fdba074b640 1 --2- 172.21.15.19:0/1303274655 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb98162060 0x7fdb980b5f70 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fdb88009870 tx=0x7fdb8802a210 comp rx=0 tx=0).stop 2024-09-12T02:03:08.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.845+0000 7fdba074b640 1 -- 172.21.15.19:0/1303274655 shutdown_connections 2024-09-12T02:03:08.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.845+0000 7fdba074b640 1 --2- 172.21.15.19:0/1303274655 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb98162060 0x7fdb980b5f70 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:08.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.845+0000 7fdba074b640 1 --2- 172.21.15.19:0/1303274655 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb98161c80 0x7fdb9806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:08.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.845+0000 7fdba074b640 1 -- 172.21.15.19:0/1303274655 >> 172.21.15.19:0/1303274655 conn(0x7fdb980d44f0 msgr2=0x7fdb980d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:08.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.846+0000 7fdba074b640 1 -- 172.21.15.19:0/1303274655 shutdown_connections 2024-09-12T02:03:08.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.846+0000 7fdba074b640 1 -- 172.21.15.19:0/1303274655 wait complete. 2024-09-12T02:03:08.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.847+0000 7fdba074b640 1 Processor -- start 2024-09-12T02:03:08.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.847+0000 7fdba074b640 1 -- start start 2024-09-12T02:03:08.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.847+0000 7fdba074b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb980b64b0 0x7fdb98156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:08.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.847+0000 7fdba074b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb98161c80 0x7fdb980b8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:08.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.847+0000 7fdba074b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb98162060 0x7fdb980b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:08.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.847+0000 7fdba074b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdb980d2a10 con 0x7fdb980b64b0 2024-09-12T02:03:08.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.847+0000 7fdba074b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdb980d2890 con 0x7fdb98161c80 2024-09-12T02:03:08.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.847+0000 7fdba074b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdb980b6960 con 0x7fdb98162060 2024-09-12T02:03:08.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.848+0000 7fdb9e4e7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb980b64b0 0x7fdb98156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:08.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.848+0000 7fdb9e4e7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb980b64b0 0x7fdb98156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40104/0 (socket says 172.21.15.19:40104) 2024-09-12T02:03:08.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.848+0000 7fdb9e4e7640 1 -- 172.21.15.19:0/142300523 learned_addr learned my addr 172.21.15.19:0/142300523 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:08.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.848+0000 7fdb9ece8640 1 --2- 172.21.15.19:0/142300523 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb98162060 0x7fdb980b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:08.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.848+0000 7fdb9dce6640 1 --2- 172.21.15.19:0/142300523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb98161c80 0x7fdb980b8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:08.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.848+0000 7fdb9e4e7640 1 -- 172.21.15.19:0/142300523 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb98162060 msgr2=0x7fdb980b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:08.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.848+0000 7fdb9e4e7640 1 --2- 172.21.15.19:0/142300523 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb98162060 0x7fdb980b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:08.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.848+0000 7fdb9e4e7640 1 -- 172.21.15.19:0/142300523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb98161c80 msgr2=0x7fdb980b8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:08.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.848+0000 7fdb9e4e7640 1 --2- 172.21.15.19:0/142300523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb98161c80 0x7fdb980b8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:08.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.848+0000 7fdb9e4e7640 1 -- 172.21.15.19:0/142300523 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb980c8180 con 0x7fdb980b64b0 2024-09-12T02:03:08.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.848+0000 7fdb9e4e7640 1 --2- 172.21.15.19:0/142300523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb980b64b0 0x7fdb98156680 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fdb94007ef0 tx=0x7fdb9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:08.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.848+0000 7fdb8effd640 1 -- 172.21.15.19:0/142300523 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb94014620 con 0x7fdb980b64b0 2024-09-12T02:03:08.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.848+0000 7fdb8effd640 1 -- 172.21.15.19:0/142300523 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb94019070 con 0x7fdb980b64b0 2024-09-12T02:03:08.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.848+0000 7fdba074b640 1 -- 172.21.15.19:0/142300523 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb980c8460 con 0x7fdb980b64b0 2024-09-12T02:03:08.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.848+0000 7fdb8effd640 1 -- 172.21.15.19:0/142300523 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb94014a00 con 0x7fdb980b64b0 2024-09-12T02:03:08.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.848+0000 7fdba074b640 1 -- 172.21.15.19:0/142300523 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb980c8a20 con 0x7fdb980b64b0 2024-09-12T02:03:08.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.850+0000 7fdba074b640 1 -- 172.21.15.19:0/142300523 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb980d0aa0 con 0x7fdb980b64b0 2024-09-12T02:03:08.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.850+0000 7fdb8effd640 1 -- 172.21.15.19:0/142300523 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb94014ba0 con 0x7fdb980b64b0 2024-09-12T02:03:08.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.850+0000 7fdb8effd640 1 --2- 172.21.15.19:0/142300523 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdb7c06be30 0x7fdb7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:08.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.851+0000 7fdb8effd640 1 -- 172.21.15.19:0/142300523 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6733+0+0 (secure 0 0 0) 0x7fdb9408ba50 con 0x7fdb980b64b0 2024-09-12T02:03:08.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.851+0000 7fdb9dce6640 1 --2- 172.21.15.19:0/142300523 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdb7c06be30 0x7fdb7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:08.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.851+0000 7fdb9dce6640 1 --2- 172.21.15.19:0/142300523 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdb7c06be30 0x7fdb7c06e2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fdb88034000 tx=0x7fdb8802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:08.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:08.855+0000 7fdb8effd640 1 -- 172.21.15.19:0/142300523 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdb980d0aa0 con 0x7fdb980b64b0 2024-09-12T02:03:09.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.069+0000 7fdba074b640 1 -- 172.21.15.19:0/142300523 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb98161430 con 0x7fdb980b64b0 2024-09-12T02:03:09.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.069+0000 7fdb8effd640 1 -- 172.21.15.19:0/142300523 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5234 (secure 0 0 0) 0x7fdb940599b0 con 0x7fdb980b64b0 2024-09-12T02:03:09.070 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:09.070 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":117,"btime":"2024-09-12T02:03:05:558332+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7962,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3995150987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3995150987},{"type":"v1","addr":"172.21.15.19:6834","nonce":3995150987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:05.558327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7162},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7162":{"gid":7162,"name":"d","rank":0,"incarnation":114,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6837/4287312235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4287312235},{"type":"v1","addr":"172.21.15.135:6837","nonce":4287312235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7162,"qdb_cluster":[7162]},"id":6}]} 2024-09-12T02:03:09.070 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 117 2024-09-12T02:03:09.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.071+0000 7fdba074b640 1 -- 172.21.15.19:0/142300523 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdb7c06be30 msgr2=0x7fdb7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:09.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.071+0000 7fdba074b640 1 --2- 172.21.15.19:0/142300523 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdb7c06be30 0x7fdb7c06e2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fdb88034000 tx=0x7fdb8802e000 comp rx=0 tx=0).stop 2024-09-12T02:03:09.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.071+0000 7fdba074b640 1 -- 172.21.15.19:0/142300523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb980b64b0 msgr2=0x7fdb98156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:09.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.071+0000 7fdba074b640 1 --2- 172.21.15.19:0/142300523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb980b64b0 0x7fdb98156680 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fdb94007ef0 tx=0x7fdb9400e4b0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.071+0000 7fdba074b640 1 -- 172.21.15.19:0/142300523 shutdown_connections 2024-09-12T02:03:09.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.071+0000 7fdba074b640 1 --2- 172.21.15.19:0/142300523 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdb7c06be30 0x7fdb7c06e2f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.071+0000 7fdba074b640 1 --2- 172.21.15.19:0/142300523 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb98162060 0x7fdb980b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.071+0000 7fdba074b640 1 --2- 172.21.15.19:0/142300523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb98161c80 0x7fdb980b8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.071+0000 7fdba074b640 1 --2- 172.21.15.19:0/142300523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb980b64b0 0x7fdb98156680 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.071+0000 7fdba074b640 1 -- 172.21.15.19:0/142300523 >> 172.21.15.19:0/142300523 conn(0x7fdb980d44f0 msgr2=0x7fdb98162520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:09.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.071+0000 7fdba074b640 1 -- 172.21.15.19:0/142300523 shutdown_connections 2024-09-12T02:03:09.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.071+0000 7fdba074b640 1 -- 172.21.15.19:0/142300523 wait complete. 2024-09-12T02:03:09.083 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 117, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:03:05.558327+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 100, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7162}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7162': {'gid': 7162, 'name': 'd', 'rank': 0, 'incarnation': 114, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.135:6837/4287312235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 4287312235}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 4287312235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7162, 'qdb_cluster': [7162]} 2024-09-12T02:03:09.083 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:03:09.084 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T02:03:09.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.186+0000 7fb3ee142640 1 Processor -- start 2024-09-12T02:03:09.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.186+0000 7fb3ee142640 1 -- start start 2024-09-12T02:03:09.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.187+0000 7fb3ee142640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb3e8072320 0x7fb3e80cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.187+0000 7fb3ee142640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb3e815e1f0 0x7fb3e806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.187+0000 7fb3ee142640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3e8146140 con 0x7fb3e8072de0 2024-09-12T02:03:09.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.187+0000 7fb3ee142640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb3e80cd740 con 0x7fb3e8072320 2024-09-12T02:03:09.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.187+0000 7fb3ee142640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb3e80cda20 con 0x7fb3e815e1f0 2024-09-12T02:03:09.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.187+0000 7fb3e77fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb3e8072320 0x7fb3e80cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.187+0000 7fb3e77fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb3e8072320 0x7fb3e80cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40118/0 (socket says 172.21.15.19:40118) 2024-09-12T02:03:09.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.187+0000 7fb3e6ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb3e8072de0 0x7fb3e806e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55500/0 (socket says 172.21.15.19:55500) 2024-09-12T02:03:09.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.187+0000 7fb3e77fe640 1 -- 172.21.15.19:0/523169916 learned_addr learned my addr 172.21.15.19:0/523169916 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:09.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.187+0000 7fb3e7fff640 1 --2- 172.21.15.19:0/523169916 >> v2:172.21.15.135:3300/0 conn(0x7fb3e815e1f0 0x7fb3e806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.187+0000 7fb3e77fe640 1 -- 172.21.15.19:0/523169916 >> v2:172.21.15.135:3300/0 conn(0x7fb3e815e1f0 msgr2=0x7fb3e806e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:09.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.187+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/523169916 >> v2:172.21.15.135:3300/0 conn(0x7fb3e815e1f0 0x7fb3e806e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.187+0000 7fb3e77fe640 1 -- 172.21.15.19:0/523169916 >> v1:172.21.15.19:6789/0 conn(0x7fb3e8072de0 legacy=0x7fb3e806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:09.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.187+0000 7fb3e77fe640 1 -- 172.21.15.19:0/523169916 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e80cdd00 con 0x7fb3e8072320 2024-09-12T02:03:09.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.188+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/523169916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e8072320 0x7fb3e80cce60 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80cfce0 tx=0x7fb3d802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328d4b49ea5f588b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:09.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.188+0000 7fb3e67fc640 1 -- 172.21.15.19:0/523169916 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8037070 con 0x7fb3e8072320 2024-09-12T02:03:09.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.188+0000 7fb3e67fc640 1 -- 172.21.15.19:0/523169916 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d8032440 con 0x7fb3e8072320 2024-09-12T02:03:09.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.188+0000 7fb3e67fc640 1 -- 172.21.15.19:0/523169916 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8032810 con 0x7fb3e8072320 2024-09-12T02:03:09.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.189+0000 7fb3ee142640 1 -- 172.21.15.19:0/523169916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e8072320 msgr2=0x7fb3e80cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:09.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.189+0000 7fb3ee142640 1 --2- 172.21.15.19:0/523169916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e8072320 0x7fb3e80cce60 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80cfce0 tx=0x7fb3d802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.189+0000 7fb3ee142640 1 -- 172.21.15.19:0/523169916 shutdown_connections 2024-09-12T02:03:09.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.189+0000 7fb3ee142640 1 --2- 172.21.15.19:0/523169916 >> v2:172.21.15.135:3300/0 conn(0x7fb3e815e1f0 0x7fb3e806e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.189+0000 7fb3ee142640 1 --2- 172.21.15.19:0/523169916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e8072320 0x7fb3e80cce60 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.189+0000 7fb3ee142640 1 -- 172.21.15.19:0/523169916 >> 172.21.15.19:0/523169916 conn(0x7fb3e8067d70 msgr2=0x7fb3e806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.189+0000 7fb3ee142640 1 -- 172.21.15.19:0/523169916 shutdown_connections 2024-09-12T02:03:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.189+0000 7fb3ee142640 1 -- 172.21.15.19:0/523169916 wait complete. 2024-09-12T02:03:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.190+0000 7fb3ee142640 1 Processor -- start 2024-09-12T02:03:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.190+0000 7fb3ee142640 1 -- start start 2024-09-12T02:03:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.191+0000 7fb3ee142640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e8072320 0x7fb3e8141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.191+0000 7fb3ee142640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3e8072de0 0x7fb3e80b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.191+0000 7fb3ee142640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3e815e1f0 0x7fb3e81f4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.191+0000 7fb3ee142640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e80cd520 con 0x7fb3e8072320 2024-09-12T02:03:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.191+0000 7fb3ee142640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e80cd3a0 con 0x7fb3e815e1f0 2024-09-12T02:03:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.191+0000 7fb3ee142640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb3e806ed00 con 0x7fb3e8072de0 2024-09-12T02:03:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.191+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e8072320 0x7fb3e8141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.191+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e8072320 0x7fb3e8141fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40128/0 (socket says 172.21.15.19:40128) 2024-09-12T02:03:09.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.191+0000 7fb3e77fe640 1 -- 172.21.15.19:0/351976566 learned_addr learned my addr 172.21.15.19:0/351976566 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:09.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.191+0000 7fb3e77fe640 1 -- 172.21.15.19:0/351976566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3e8072de0 msgr2=0x7fb3e80b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:09.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.191+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/351976566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3e8072de0 0x7fb3e80b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.191+0000 7fb3e77fe640 1 -- 172.21.15.19:0/351976566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3e815e1f0 msgr2=0x7fb3e81f4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:09.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.191+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/351976566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3e815e1f0 0x7fb3e81f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.191+0000 7fb3e77fe640 1 -- 172.21.15.19:0/351976566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e8142510 con 0x7fb3e8072320 2024-09-12T02:03:09.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.191+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/351976566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e8072320 0x7fb3e8141fd0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fb3d802a220 tx=0x7fb3d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:09.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.192+0000 7fb3cffff640 1 -- 172.21.15.19:0/351976566 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8041020 con 0x7fb3e8072320 2024-09-12T02:03:09.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.192+0000 7fb3cffff640 1 -- 172.21.15.19:0/351976566 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d80306c0 con 0x7fb3e8072320 2024-09-12T02:03:09.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.192+0000 7fb3cffff640 1 -- 172.21.15.19:0/351976566 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8037040 con 0x7fb3e8072320 2024-09-12T02:03:09.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.192+0000 7fb3ee142640 1 -- 172.21.15.19:0/351976566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e80b3d00 con 0x7fb3e8072320 2024-09-12T02:03:09.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.192+0000 7fb3ee142640 1 -- 172.21.15.19:0/351976566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e80b45a0 con 0x7fb3e8072320 2024-09-12T02:03:09.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.193+0000 7fb3cffff640 1 -- 172.21.15.19:0/351976566 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3d8044020 con 0x7fb3e8072320 2024-09-12T02:03:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.194+0000 7fb3cffff640 1 --2- 172.21.15.19:0/351976566 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb3d406be30 0x7fb3d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.194+0000 7fb3cffff640 1 -- 172.21.15.19:0/351976566 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6733+0+0 (secure 0 0 0) 0x7fb3d80abaa0 con 0x7fb3e8072320 2024-09-12T02:03:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.194+0000 7fb3e6ffd640 1 --2- 172.21.15.19:0/351976566 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb3d406be30 0x7fb3d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.195+0000 7fb3e6ffd640 1 --2- 172.21.15.19:0/351976566 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb3d406be30 0x7fb3d406e2f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc000f60 tx=0x7fb3dc007a00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.195+0000 7fb3f0edc740 1 Processor -- start 2024-09-12T02:03:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.195+0000 7fb3f0edc740 1 -- start start 2024-09-12T02:03:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3f0edc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d5825462c0 0x55d58258ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3f0edc740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d582543a80 0x55d5825466a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3f0edc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d582547a50 0x55d5825408b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3f0edc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d5824a8520 con 0x55d5825462c0 2024-09-12T02:03:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3f0edc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d5824503e0 con 0x55d582547a50 2024-09-12T02:03:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3f0edc740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55d5824a44e0 con 0x55d582543a80 2024-09-12T02:03:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d5825462c0 0x55d58258ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d5825462c0 0x55d58258ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40136/0 (socket says 172.21.15.19:40136) 2024-09-12T02:03:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3e77fe640 1 -- 172.21.15.19:0/3631325938 learned_addr learned my addr 172.21.15.19:0/3631325938 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3e7fff640 1 --2- 172.21.15.19:0/3631325938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d582547a50 0x55d5825408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3e6ffd640 1 --2- 172.21.15.19:0/3631325938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d582543a80 0x55d5825466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3e77fe640 1 -- 172.21.15.19:0/3631325938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d582543a80 msgr2=0x55d5825466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/3631325938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d582543a80 0x55d5825466a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3e77fe640 1 -- 172.21.15.19:0/3631325938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d582547a50 msgr2=0x55d5825408b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/3631325938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d582547a50 0x55d5825408b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3e77fe640 1 -- 172.21.15.19:0/3631325938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d58246b2f0 con 0x55d5825462c0 2024-09-12T02:03:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3e7fff640 1 --2- 172.21.15.19:0/3631325938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d582547a50 0x55d5825408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/3631325938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d5825462c0 0x55d58258ba60 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80a9b10 tx=0x7fb3d8079370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7855731b829c1c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3cd7fa640 1 -- 172.21.15.19:0/3631325938 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8079950 con 0x55d5825462c0 2024-09-12T02:03:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3cd7fa640 1 -- 172.21.15.19:0/3631325938 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d807dd00 con 0x55d5825462c0 2024-09-12T02:03:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.196+0000 7fb3cd7fa640 1 -- 172.21.15.19:0/3631325938 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8082530 con 0x55d5825462c0 2024-09-12T02:03:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.197+0000 7fb3f0edc740 1 -- 172.21.15.19:0/3631325938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d5825462c0 msgr2=0x55d58258ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.197+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/3631325938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d5825462c0 0x55d58258ba60 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80a9b10 tx=0x7fb3d8079370 comp rx=0 tx=0).stop 2024-09-12T02:03:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.197+0000 7fb3f0edc740 1 -- 172.21.15.19:0/3631325938 shutdown_connections 2024-09-12T02:03:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.197+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/3631325938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d582547a50 0x55d5825408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.197+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/3631325938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d582543a80 0x55d5825466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.197+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/3631325938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d5825462c0 0x55d58258ba60 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.197+0000 7fb3f0edc740 1 -- 172.21.15.19:0/3631325938 >> 172.21.15.19:0/3631325938 conn(0x55d582542a80 msgr2=0x55d58258af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.197+0000 7fb3f0edc740 1 -- 172.21.15.19:0/3631325938 shutdown_connections 2024-09-12T02:03:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.197+0000 7fb3f0edc740 1 -- 172.21.15.19:0/3631325938 wait complete. 2024-09-12T02:03:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.198+0000 7fb3f0edc740 1 -- start start 2024-09-12T02:03:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.198+0000 7fb3f0edc740 1 Processor -- start 2024-09-12T02:03:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3f0edc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d5825462c0 0x55d582570ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3f0edc740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d582547a50 0x55d582562790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3f0edc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d582567810 0x55d582566390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3f0edc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d5824a8520 con 0x55d5825462c0 2024-09-12T02:03:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3f0edc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d582431450 con 0x55d582567810 2024-09-12T02:03:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3f0edc740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55d582541f20 con 0x55d582547a50 2024-09-12T02:03:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3f0edc740 10 client.0 _ll_register_callbacks cb 0x55d5821baac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:03:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d5825462c0 0x55d582570ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d5825462c0 0x55d582570ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40152/0 (socket says 172.21.15.19:40152) 2024-09-12T02:03:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3e77fe640 1 -- 172.21.15.19:0/4008193650 learned_addr learned my addr 172.21.15.19:0/4008193650 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3e6ffd640 1 --2- 172.21.15.19:0/4008193650 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d582547a50 0x55d582562790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3e7fff640 1 --2- 172.21.15.19:0/4008193650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d582567810 0x55d582566390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3e77fe640 1 -- 172.21.15.19:0/4008193650 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d582547a50 msgr2=0x55d582562790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/4008193650 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d582547a50 0x55d582562790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3e77fe640 1 -- 172.21.15.19:0/4008193650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d582567810 msgr2=0x55d582566390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/4008193650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d582567810 0x55d582566390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3e77fe640 1 -- 172.21.15.19:0/4008193650 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5821bb2d0 con 0x55d5825462c0 2024-09-12T02:03:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3e7fff640 1 --2- 172.21.15.19:0/4008193650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d582567810 0x55d582566390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/4008193650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d5825462c0 0x55d582570ae0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80a9c20 tx=0x7fb3d803e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd69e46df0b8783 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:03:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3c67fc640 1 -- 172.21.15.19:0/4008193650 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8098060 con 0x55d5825462c0 2024-09-12T02:03:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3c67fc640 1 -- 172.21.15.19:0/4008193650 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 6733+0+0 (secure 0 0 0) 0x7fb3d80820a0 con 0x55d5825462c0 2024-09-12T02:03:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.199+0000 7fb3f0edc740 1 -- 172.21.15.19:0/4008193650 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3d807dd00 con 0x55d5825462c0 2024-09-12T02:03:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.200+0000 7fb3c67fc640 1 -- 172.21.15.19:0/4008193650 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7fb3d809f050 con 0x55d5825462c0 2024-09-12T02:03:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.200+0000 7fb3f0edc740 10 client.7983 fetch_fsmap learned FSMap version 117 2024-09-12T02:03:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.200+0000 7fb3f0edc740 1 -- 172.21.15.19:0/4008193650 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55d5822856b0 con 0x55d5825462c0 2024-09-12T02:03:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.200+0000 7fb3c67fc640 1 -- 172.21.15.19:0/4008193650 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d807dd00 con 0x55d5825462c0 2024-09-12T02:03:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.200+0000 7fb3c67fc640 1 -- 172.21.15.19:0/4008193650 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 117) ==== 3502+0+0 (secure 0 0 0) 0x7fb3d803a030 con 0x55d5825462c0 2024-09-12T02:03:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.200+0000 7fb3f0edc740 10 client.7983 fetch_fsmap finished waiting for FSMap version 117 2024-09-12T02:03:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.200+0000 7fb3f0edc740 10 client.7983 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:03:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.200+0000 7fb3f0edc740 20 client.7983 populate_metadata read hostname 'smithi019' 2024-09-12T02:03:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.200+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/4008193650 >> [v2:172.21.15.135:6834/4287312235,v1:172.21.15.135:6837/4287312235] conn(0x55d5825416a0 0x55d58256ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.200+0000 7fb3f0edc740 4 client.7983 mds_command: new command op to 7162 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:03:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.200+0000 7fb3f0edc740 1 -- 172.21.15.19:0/4008193650 --> [v2:172.21.15.135:6834/4287312235,v1:172.21.15.135:6837/4287312235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5824b5c50 con 0x55d5825416a0 2024-09-12T02:03:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.200+0000 7fb3e6ffd640 1 --2- 172.21.15.19:0/4008193650 >> [v2:172.21.15.135:6834/4287312235,v1:172.21.15.135:6837/4287312235] conn(0x55d5825416a0 0x55d58256ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.201+0000 7fb3c67fc640 10 client.7983 ms_handle_connect on v2:172.21.15.135:6834/4287312235 2024-09-12T02:03:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.201+0000 7fb3e6ffd640 1 --2- 172.21.15.19:0/4008193650 >> [v2:172.21.15.135:6834/4287312235,v1:172.21.15.135:6837/4287312235] conn(0x55d5825416a0 0x55d58256ddc0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19d958c4b140d41d server_cookie=3a1a799b57e27859 in_seq=0 out_seq=0 2024-09-12T02:03:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.201+0000 7fb3c67fc640 1 -- 172.21.15.19:0/4008193650 <== mds.0 v2:172.21.15.135:6834/4287312235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d5824b5c50 con 0x55d5825416a0 2024-09-12T02:03:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.201+0000 7fb3c67fc640 10 client.7983 handle_command_reply: tid=0 2024-09-12T02:03:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.201+0000 7fb3f0edc740 1 client.7983 shutdown 2024-09-12T02:03:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.202+0000 7fb3f0edc740 1 -- 172.21.15.19:0/4008193650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d5825462c0 msgr2=0x55d582570ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.202+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/4008193650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d5825462c0 0x55d582570ae0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80a9c20 tx=0x7fb3d803e000 comp rx=0 tx=0).stop 2024-09-12T02:03:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.202+0000 7fb3f0edc740 1 -- 172.21.15.19:0/4008193650 shutdown_connections 2024-09-12T02:03:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.202+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/4008193650 >> [v2:172.21.15.135:6834/4287312235,v1:172.21.15.135:6837/4287312235] conn(0x55d5825416a0 0x55d58256ddc0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.202+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/4008193650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d582567810 0x55d582566390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.202+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/4008193650 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d582547a50 0x55d582562790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.202+0000 7fb3c67fc640 0 client.7983 ms_handle_reset on v2:172.21.15.135:6834/4287312235 2024-09-12T02:03:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.202+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/4008193650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d5825462c0 0x55d582570ae0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.202+0000 7fb3f0edc740 1 -- 172.21.15.19:0/4008193650 >> 172.21.15.19:0/4008193650 conn(0x55d582543a80 msgr2=0x55d58258a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.202+0000 7fb3f0edc740 1 -- 172.21.15.19:0/4008193650 shutdown_connections 2024-09-12T02:03:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.202+0000 7fb3f0edc740 1 -- 172.21.15.19:0/4008193650 wait complete. 2024-09-12T02:03:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.202+0000 7fb3f0edc740 20 client.7983 trim_cache size 0 max 16384 2024-09-12T02:03:09.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.220+0000 7fb3f0edc740 1 Processor -- start 2024-09-12T02:03:09.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.220+0000 7fb3f0edc740 1 -- start start 2024-09-12T02:03:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3f0edc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5825462c0 0x55d582568890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3f0edc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d582547a50 0x55d582562400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3f0edc740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d582567810 0x55d5825ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3f0edc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e82007f0 con 0x55d582547a50 2024-09-12T02:03:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3f0edc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e81ffb10 con 0x55d5825462c0 2024-09-12T02:03:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3f0edc740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb3e8200160 con 0x55d582567810 2024-09-12T02:03:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3e6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d582547a50 0x55d582562400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3e6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d582547a50 0x55d582562400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40166/0 (socket says 172.21.15.19:40166) 2024-09-12T02:03:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3e6ffd640 1 -- 172.21.15.19:0/512499309 learned_addr learned my addr 172.21.15.19:0/512499309 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3e7fff640 1 --2- 172.21.15.19:0/512499309 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d582567810 0x55d5825ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/512499309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5825462c0 0x55d582568890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3e6ffd640 1 -- 172.21.15.19:0/512499309 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d582567810 msgr2=0x55d5825ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3e6ffd640 1 --2- 172.21.15.19:0/512499309 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d582567810 0x55d5825ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3e6ffd640 1 -- 172.21.15.19:0/512499309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5825462c0 msgr2=0x55d582568890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3e6ffd640 1 --2- 172.21.15.19:0/512499309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5825462c0 0x55d582568890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3e6ffd640 1 -- 172.21.15.19:0/512499309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d58253c6c0 con 0x55d582547a50 2024-09-12T02:03:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/512499309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5825462c0 0x55d582568890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3e6ffd640 1 --2- 172.21.15.19:0/512499309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d582547a50 0x55d582562400 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc007460 tx=0x7fb3dc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3baf77148aa8a9f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.221+0000 7fb3ccff9640 1 -- 172.21.15.19:0/512499309 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc012610 con 0x55d582547a50 2024-09-12T02:03:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.222+0000 7fb3ccff9640 1 -- 172.21.15.19:0/512499309 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3dc0127b0 con 0x55d582547a50 2024-09-12T02:03:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.222+0000 7fb3ccff9640 1 -- 172.21.15.19:0/512499309 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc012b80 con 0x55d582547a50 2024-09-12T02:03:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.222+0000 7fb3f0edc740 1 -- 172.21.15.19:0/512499309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d582547a50 msgr2=0x55d582562400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.222+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/512499309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d582547a50 0x55d582562400 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc007460 tx=0x7fb3dc010000 comp rx=0 tx=0).stop 2024-09-12T02:03:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.222+0000 7fb3f0edc740 1 -- 172.21.15.19:0/512499309 shutdown_connections 2024-09-12T02:03:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.222+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/512499309 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d582567810 0x55d5825ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.222+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/512499309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d582547a50 0x55d582562400 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.222+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/512499309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5825462c0 0x55d582568890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.222+0000 7fb3f0edc740 1 -- 172.21.15.19:0/512499309 >> 172.21.15.19:0/512499309 conn(0x55d582543a80 msgr2=0x55d58259a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.222+0000 7fb3f0edc740 1 -- 172.21.15.19:0/512499309 shutdown_connections 2024-09-12T02:03:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.222+0000 7fb3f0edc740 1 -- 172.21.15.19:0/512499309 wait complete. 2024-09-12T02:03:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.223+0000 7fb3f0edc740 1 -- start start 2024-09-12T02:03:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.223+0000 7fb3f0edc740 1 Processor -- start 2024-09-12T02:03:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3f0edc740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d5825462c0 0x55d582608450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3f0edc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d582547a50 0x55d5825ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3f0edc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d582567810 0x55d582587980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3f0edc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d5824a8520 con 0x55d582567810 2024-09-12T02:03:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3f0edc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d582541f20 con 0x55d582547a50 2024-09-12T02:03:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3f0edc740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55d5825410a0 con 0x55d5825462c0 2024-09-12T02:03:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3f0edc740 10 client.0 _ll_register_callbacks cb 0x7fb3d8091070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:03:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d582567810 0x55d582587980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d582567810 0x55d582587980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40178/0 (socket says 172.21.15.19:40178) 2024-09-12T02:03:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3e7fff640 1 -- 172.21.15.19:0/1602176503 learned_addr learned my addr 172.21.15.19:0/1602176503 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/1602176503 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d5825462c0 0x55d582608450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3e6ffd640 1 --2- 172.21.15.19:0/1602176503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d582547a50 0x55d5825ad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3e7fff640 1 -- 172.21.15.19:0/1602176503 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d5825462c0 msgr2=0x55d582608450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3e7fff640 1 --2- 172.21.15.19:0/1602176503 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d5825462c0 0x55d582608450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3e7fff640 1 -- 172.21.15.19:0/1602176503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d582547a50 msgr2=0x55d5825ad9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3e7fff640 1 --2- 172.21.15.19:0/1602176503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d582547a50 0x55d5825ad9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3e7fff640 1 -- 172.21.15.19:0/1602176503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d58259a160 con 0x55d582567810 2024-09-12T02:03:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3e7fff640 1 --2- 172.21.15.19:0/1602176503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d582567810 0x55d582587980 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00040f0 tx=0x7fb3e00045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38af1067f85d89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:03:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3c67fc640 1 -- 172.21.15.19:0/1602176503 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e001b020 con 0x55d582567810 2024-09-12T02:03:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3c67fc640 1 -- 172.21.15.19:0/1602176503 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 6733+0+0 (secure 0 0 0) 0x7fb3e0004800 con 0x55d582567810 2024-09-12T02:03:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.224+0000 7fb3f0edc740 1 -- 172.21.15.19:0/1602176503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3dc0127b0 con 0x55d582567810 2024-09-12T02:03:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.225+0000 7fb3c67fc640 1 -- 172.21.15.19:0/1602176503 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7fb3e0025050 con 0x55d582567810 2024-09-12T02:03:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.225+0000 7fb3f0edc740 10 client.7989 fetch_fsmap learned FSMap version 117 2024-09-12T02:03:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.225+0000 7fb3f0edc740 1 -- 172.21.15.19:0/1602176503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55d5826089f0 con 0x55d582567810 2024-09-12T02:03:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.225+0000 7fb3c67fc640 1 -- 172.21.15.19:0/1602176503 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3dc0127b0 con 0x55d582567810 2024-09-12T02:03:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.225+0000 7fb3c67fc640 1 -- 172.21.15.19:0/1602176503 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 117) ==== 3502+0+0 (secure 0 0 0) 0x7fb3e0028020 con 0x55d582567810 2024-09-12T02:03:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.225+0000 7fb3f0edc740 10 client.7989 fetch_fsmap finished waiting for FSMap version 117 2024-09-12T02:03:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.225+0000 7fb3f0edc740 10 client.7989 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:03:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.225+0000 7fb3f0edc740 20 client.7989 populate_metadata read hostname 'smithi019' 2024-09-12T02:03:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.225+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/1602176503 >> [v2:172.21.15.135:6834/4287312235,v1:172.21.15.135:6837/4287312235] conn(0x55d582592ec0 0x55d582564e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.225+0000 7fb3f0edc740 4 client.7989 mds_command: new command op to 7162 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:03:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.225+0000 7fb3f0edc740 1 -- 172.21.15.19:0/1602176503 --> [v2:172.21.15.135:6834/4287312235,v1:172.21.15.135:6837/4287312235] -- command(tid 0: {"prefix": "status"}) -- 0x55d5824affa0 con 0x55d582592ec0 2024-09-12T02:03:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.225+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/1602176503 >> [v2:172.21.15.135:6834/4287312235,v1:172.21.15.135:6837/4287312235] conn(0x55d582592ec0 0x55d582564e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.225+0000 7fb3c67fc640 10 client.7989 ms_handle_connect on v2:172.21.15.135:6834/4287312235 2024-09-12T02:03:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.225+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/1602176503 >> [v2:172.21.15.135:6834/4287312235,v1:172.21.15.135:6837/4287312235] conn(0x55d582592ec0 0x55d582564e00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1bb4cdd987d4a35 server_cookie=d4ecf7274efc12d1 in_seq=0 out_seq=0 2024-09-12T02:03:09.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.226+0000 7fb3c67fc640 1 -- 172.21.15.19:0/1602176503 <== mds.0 v2:172.21.15.135:6834/4287312235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x55d5824affa0 con 0x55d582592ec0 2024-09-12T02:03:09.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.226+0000 7fb3c67fc640 10 client.7989 handle_command_reply: tid=0 2024-09-12T02:03:09.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.226+0000 7fb3f0edc740 1 client.7989 shutdown 2024-09-12T02:03:09.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.226+0000 7fb3f0edc740 1 -- 172.21.15.19:0/1602176503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d582567810 msgr2=0x55d582587980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:09.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.226+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/1602176503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d582567810 0x55d582587980 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00040f0 tx=0x7fb3e00045b0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.226+0000 7fb3f0edc740 1 -- 172.21.15.19:0/1602176503 shutdown_connections 2024-09-12T02:03:09.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.226+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/1602176503 >> [v2:172.21.15.135:6834/4287312235,v1:172.21.15.135:6837/4287312235] conn(0x55d582592ec0 0x55d582564e00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.226+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/1602176503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d582567810 0x55d582587980 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.226+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/1602176503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d582547a50 0x55d5825ad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.226+0000 7fb3f0edc740 1 --2- 172.21.15.19:0/1602176503 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d5825462c0 0x55d582608450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.226+0000 7fb3c67fc640 0 client.7989 ms_handle_reset on v2:172.21.15.135:6834/4287312235 2024-09-12T02:03:09.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.226+0000 7fb3f0edc740 1 -- 172.21.15.19:0/1602176503 >> 172.21.15.19:0/1602176503 conn(0x55d582543a80 msgr2=0x55d58256ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:09.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.226+0000 7fb3f0edc740 1 -- 172.21.15.19:0/1602176503 shutdown_connections 2024-09-12T02:03:09.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.226+0000 7fb3f0edc740 1 -- 172.21.15.19:0/1602176503 wait complete. 2024-09-12T02:03:09.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.226+0000 7fb3f0edc740 20 client.7989 trim_cache size 0 max 16384 2024-09-12T02:03:09.233 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:03:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T02:03:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T02:03:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 7162, 2024-09-12T02:03:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T02:03:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T02:03:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T02:03:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 6.6709399749999996, 2024-09-12T02:03:09.234 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 117, 2024-09-12T02:03:09.234 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 100, 2024-09-12T02:03:09.234 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 100, 2024-09-12T02:03:09.234 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 9.9606327439999998 2024-09-12T02:03:09.234 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:03:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.227+0000 7fb3ee142640 1 -- 172.21.15.19:0/351976566 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb3d406be30 msgr2=0x7fb3d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.227+0000 7fb3ee142640 1 --2- 172.21.15.19:0/351976566 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb3d406be30 0x7fb3d406e2f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc000f60 tx=0x7fb3dc007a00 comp rx=0 tx=0).stop 2024-09-12T02:03:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.227+0000 7fb3ee142640 1 -- 172.21.15.19:0/351976566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e8072320 msgr2=0x7fb3e8141fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.227+0000 7fb3ee142640 1 --2- 172.21.15.19:0/351976566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e8072320 0x7fb3e8141fd0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fb3d802a220 tx=0x7fb3d80046c0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.227+0000 7fb3ee142640 1 -- 172.21.15.19:0/351976566 shutdown_connections 2024-09-12T02:03:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.227+0000 7fb3ee142640 1 --2- 172.21.15.19:0/351976566 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb3d406be30 0x7fb3d406e2f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.227+0000 7fb3ee142640 1 --2- 172.21.15.19:0/351976566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3e815e1f0 0x7fb3e81f4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.227+0000 7fb3ee142640 1 --2- 172.21.15.19:0/351976566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3e8072de0 0x7fb3e80b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.227+0000 7fb3ee142640 1 --2- 172.21.15.19:0/351976566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e8072320 0x7fb3e8141fd0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.227+0000 7fb3ee142640 1 -- 172.21.15.19:0/351976566 >> 172.21.15.19:0/351976566 conn(0x7fb3e8067d70 msgr2=0x7fb3e81e64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.227+0000 7fb3ee142640 1 -- 172.21.15.19:0/351976566 shutdown_connections 2024-09-12T02:03:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.227+0000 7fb3ee142640 1 -- 172.21.15.19:0/351976566 wait complete. 2024-09-12T02:03:09.238 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:03:09.238 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Delete mds0_openfiles.0', proceeding to ls 2024-09-12T02:03:09.238 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:03:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.340+0000 7f51b2b0a640 1 Processor -- start 2024-09-12T02:03:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.340+0000 7f51b2b0a640 1 -- start start 2024-09-12T02:03:09.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.341+0000 7f51b2b0a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f51ac0d06e0 0x7f51ac0ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.341+0000 7f51b2b0a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51ac09b510 0x7f51ac09b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.341+0000 7f51b2b0a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51ac0d00a0 con 0x7f51ac15d3e0 2024-09-12T02:03:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.341+0000 7f51b2b0a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f51ac09b080 con 0x7f51ac0d06e0 2024-09-12T02:03:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.341+0000 7f51b2b0a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f51ac0d0380 con 0x7f51ac09b510 2024-09-12T02:03:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.342+0000 7f51b10a7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51ac09b510 0x7f51ac09b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.342+0000 7f51b08a6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f51ac0d06e0 0x7f51ac0ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.342+0000 7f51b10a7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51ac09b510 0x7f51ac09b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:55904/0 (socket says 172.21.15.19:55904) 2024-09-12T02:03:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.342+0000 7f51b08a6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f51ac0d06e0 0x7f51ac0ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:46948/0 (socket says 172.21.15.19:46948) 2024-09-12T02:03:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.342+0000 7f51b10a7640 1 -- 172.21.15.19:0/3096472493 learned_addr learned my addr 172.21.15.19:0/3096472493 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.342+0000 7f51b10a7640 1 -- 172.21.15.19:0/3096472493 >> v2:172.21.15.135:3300/0 conn(0x7f51ac0d06e0 msgr2=0x7f51ac0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.342+0000 7f51b10a7640 1 --2- 172.21.15.19:0/3096472493 >> v2:172.21.15.135:3300/0 conn(0x7f51ac0d06e0 0x7f51ac0ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.342+0000 7f51b10a7640 1 -- 172.21.15.19:0/3096472493 >> v1:172.21.15.135:6789/0 conn(0x7f51ac15d3e0 legacy=0x7f51ac0d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:09.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.342+0000 7f51b10a7640 1 -- 172.21.15.19:0/3096472493 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ac09aa30 con 0x7f51ac09b510 2024-09-12T02:03:09.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.343+0000 7f51b10a7640 1 --2- 172.21.15.19:0/3096472493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51ac09b510 0x7f51ac09b9c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009e50 tx=0x7f51a402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd0104fa27da6ef9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.343+0000 7f51ab7fe640 1 -- 172.21.15.19:0/3096472493 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a4036070 con 0x7f51ac09b510 2024-09-12T02:03:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.343+0000 7f51ab7fe640 1 -- 172.21.15.19:0/3096472493 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a4031600 con 0x7f51ac09b510 2024-09-12T02:03:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.343+0000 7f51ab7fe640 1 -- 172.21.15.19:0/3096472493 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a40319d0 con 0x7f51ac09b510 2024-09-12T02:03:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.343+0000 7f51b2b0a640 1 -- 172.21.15.19:0/3096472493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51ac09b510 msgr2=0x7f51ac09b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.343+0000 7f51b2b0a640 1 --2- 172.21.15.19:0/3096472493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51ac09b510 0x7f51ac09b9c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009e50 tx=0x7f51a402a710 comp rx=0 tx=0).stop 2024-09-12T02:03:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.344+0000 7f51b2b0a640 1 -- 172.21.15.19:0/3096472493 shutdown_connections 2024-09-12T02:03:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.344+0000 7f51b2b0a640 1 --2- 172.21.15.19:0/3096472493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51ac09b510 0x7f51ac09b9c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.344+0000 7f51b2b0a640 1 --2- 172.21.15.19:0/3096472493 >> v2:172.21.15.135:3300/0 conn(0x7f51ac0d06e0 0x7f51ac0ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.344+0000 7f51b2b0a640 1 -- 172.21.15.19:0/3096472493 >> 172.21.15.19:0/3096472493 conn(0x7f51ac0d23a0 msgr2=0x7f51ac0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.344+0000 7f51b2b0a640 1 -- 172.21.15.19:0/3096472493 shutdown_connections 2024-09-12T02:03:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.344+0000 7f51b2b0a640 1 -- 172.21.15.19:0/3096472493 wait complete. 2024-09-12T02:03:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.345+0000 7f51b2b0a640 1 Processor -- start 2024-09-12T02:03:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.345+0000 7f51b2b0a640 1 -- start start 2024-09-12T02:03:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.346+0000 7f51b2b0a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51ac09b510 0x7f51ac06e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.346+0000 7f51b2b0a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51ac0d06e0 0x7f51ac1589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.346+0000 7f51b2b0a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51ac15d3e0 0x7f51ac0b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.346+0000 7f51b2b0a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac15c740 con 0x7f51ac09b510 2024-09-12T02:03:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.346+0000 7f51b2b0a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac15d800 con 0x7f51ac0d06e0 2024-09-12T02:03:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.346+0000 7f51b2b0a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f51ac0ccf90 con 0x7f51ac15d3e0 2024-09-12T02:03:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.346+0000 7f51b08a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51ac09b510 0x7f51ac06e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.346+0000 7f51b08a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51ac09b510 0x7f51ac06e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40182/0 (socket says 172.21.15.19:40182) 2024-09-12T02:03:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.346+0000 7f51b08a6640 1 -- 172.21.15.19:0/4204650335 learned_addr learned my addr 172.21.15.19:0/4204650335 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.346+0000 7f51abfff640 1 --2- 172.21.15.19:0/4204650335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51ac0d06e0 0x7f51ac1589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.346+0000 7f51b10a7640 1 --2- 172.21.15.19:0/4204650335 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51ac15d3e0 0x7f51ac0b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.346+0000 7f51b08a6640 1 -- 172.21.15.19:0/4204650335 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51ac15d3e0 msgr2=0x7f51ac0b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:09.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.346+0000 7f51b08a6640 1 --2- 172.21.15.19:0/4204650335 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51ac15d3e0 0x7f51ac0b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.346+0000 7f51b08a6640 1 -- 172.21.15.19:0/4204650335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51ac0d06e0 msgr2=0x7f51ac1589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:09.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.346+0000 7f51b08a6640 1 --2- 172.21.15.19:0/4204650335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51ac0d06e0 0x7f51ac1589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.346+0000 7f51b08a6640 1 -- 172.21.15.19:0/4204650335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ac158f10 con 0x7f51ac09b510 2024-09-12T02:03:09.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.346+0000 7f51b08a6640 1 --2- 172.21.15.19:0/4204650335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51ac09b510 0x7f51ac06e8d0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f519c00e9b0 tx=0x7f519c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:09.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.346+0000 7f51a97fa640 1 -- 172.21.15.19:0/4204650335 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c017070 con 0x7f51ac09b510 2024-09-12T02:03:09.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.347+0000 7f51a97fa640 1 -- 172.21.15.19:0/4204650335 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f519c00c9a0 con 0x7f51ac09b510 2024-09-12T02:03:09.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.347+0000 7f51b2b0a640 1 -- 172.21.15.19:0/4204650335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51ac06cf70 con 0x7f51ac09b510 2024-09-12T02:03:09.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.347+0000 7f51a97fa640 1 -- 172.21.15.19:0/4204650335 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c00cd90 con 0x7f51ac09b510 2024-09-12T02:03:09.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.347+0000 7f51b2b0a640 1 -- 172.21.15.19:0/4204650335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51ac06d530 con 0x7f51ac09b510 2024-09-12T02:03:09.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.348+0000 7f51b2b0a640 1 -- 172.21.15.19:0/4204650335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51ac09b9c0 con 0x7f51ac09b510 2024-09-12T02:03:09.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.348+0000 7f51a97fa640 1 -- 172.21.15.19:0/4204650335 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f519c01a070 con 0x7f51ac09b510 2024-09-12T02:03:09.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.349+0000 7f51a97fa640 1 --2- 172.21.15.19:0/4204650335 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f519806be30 0x7f519806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:09.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.349+0000 7f51a97fa640 1 -- 172.21.15.19:0/4204650335 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6733+0+0 (secure 0 0 0) 0x7f519c08b1d0 con 0x7f51ac09b510 2024-09-12T02:03:09.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.349+0000 7f51abfff640 1 --2- 172.21.15.19:0/4204650335 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f519806be30 0x7f519806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:09.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.349+0000 7f51abfff640 1 --2- 172.21.15.19:0/4204650335 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f519806be30 0x7f519806e2f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0b3bf0 tx=0x7f51a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:09.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.353+0000 7f51a97fa640 1 -- 172.21.15.19:0/4204650335 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f519c0590b0 con 0x7f51ac09b510 2024-09-12T02:03:09.529 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:03:09.529+0000 7f090293a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:03:09.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.565+0000 7f51b2b0a640 1 -- 172.21.15.19:0/4204650335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f51ac0d31d0 con 0x7f51ac09b510 2024-09-12T02:03:09.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.565+0000 7f51a97fa640 1 -- 172.21.15.19:0/4204650335 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v117) ==== 53+0+73 (secure 0 0 0) 0x7f519c05d3b0 con 0x7f51ac09b510 2024-09-12T02:03:09.566 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:03:09.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.567+0000 7f51b2b0a640 1 -- 172.21.15.19:0/4204650335 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f519806be30 msgr2=0x7f519806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:09.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.567+0000 7f51b2b0a640 1 --2- 172.21.15.19:0/4204650335 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f519806be30 0x7f519806e2f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0b3bf0 tx=0x7f51a0009040 comp rx=0 tx=0).stop 2024-09-12T02:03:09.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.567+0000 7f51b2b0a640 1 -- 172.21.15.19:0/4204650335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51ac09b510 msgr2=0x7f51ac06e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:09.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.567+0000 7f51b2b0a640 1 --2- 172.21.15.19:0/4204650335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51ac09b510 0x7f51ac06e8d0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f519c00e9b0 tx=0x7f519c00ee70 comp rx=0 tx=0).stop 2024-09-12T02:03:09.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.567+0000 7f51b2b0a640 1 -- 172.21.15.19:0/4204650335 shutdown_connections 2024-09-12T02:03:09.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.567+0000 7f51b2b0a640 1 --2- 172.21.15.19:0/4204650335 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f519806be30 0x7f519806e2f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.567+0000 7f51b2b0a640 1 --2- 172.21.15.19:0/4204650335 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51ac15d3e0 0x7f51ac0b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.567+0000 7f51b2b0a640 1 --2- 172.21.15.19:0/4204650335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51ac0d06e0 0x7f51ac1589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.567+0000 7f51b2b0a640 1 --2- 172.21.15.19:0/4204650335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51ac09b510 0x7f51ac06e8d0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:09.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.567+0000 7f51b2b0a640 1 -- 172.21.15.19:0/4204650335 >> 172.21.15.19:0/4204650335 conn(0x7f51ac0d23a0 msgr2=0x7f51ac0b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:09.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.567+0000 7f51b2b0a640 1 -- 172.21.15.19:0/4204650335 shutdown_connections 2024-09-12T02:03:09.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09.567+0000 7f51b2b0a640 1 -- 172.21.15.19:0/4204650335 wait complete. 2024-09-12T02:03:09.579 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:03:09.579 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:03:09.579 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T02:03:09.579 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:03:09.580 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:03:09.580 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:03:09.580 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:03:09.580 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:03:09.580 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:03:09.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:09.580 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T02:03:09.596 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:03:09.596 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:03:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:03:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T02:03:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:09.597 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:03:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:03:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T02:03:09.597 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:03:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:03:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T02:03:09.597 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:03:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:03:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T02:03:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:03:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42371sec preferred_lft 42371sec 2024-09-12T02:03:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T02:03:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:09.598 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:03:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:03:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T02:03:09.598 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:03:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T02:03:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:03:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T02:03:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:09.598 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:03:09.599 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:03:09.599 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T02:03:09.599 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:09.599 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:03:09.599 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:03:09.599 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T02:03:09.599 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:09.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:09.599 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:03:09.661 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T02:03:09.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:09.663 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T02:03:09.719 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T02:03:09.720 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:03:09.720 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:03:09.720 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:03:09.720 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:03:09.720 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:03:09.720 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T02:03:09.720 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:03:09.721 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:03:09.721 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:03:09.721 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T02:03:09.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:03:09.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:03:09.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:09.850 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T02:03:09.865 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:03:09.865 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:03:09.866 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:03:09.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:09.866 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T02:03:09.932 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:03:09.932 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:03:09.988 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:03:09.988 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:03:09.988 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:03:10.043 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:03:10.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:10.044 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:03:10.127 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:03:10.127 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:03:10.128 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:03:10.136 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:03:10.136 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:03:10.137 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:03:10.137 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:03:10.137 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:03:10.142 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:03:10.143 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:03:10.143 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:03:10.143 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:03:10.143 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:03:10.143 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T02:03:10.143 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T02:03:10.143 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T02:03:10.143 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:03:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:03:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:03:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:03:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:03:10.145 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:03:10.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:10.145 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:03:10.170 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:03:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:03:10.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:03:10.268 INFO:teuthology.orchestra.run.smithi019.stdout:client6605 2024-09-12T02:03:10.268 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:03:10.268 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:03:10.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:10.284 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2024-09-12T02:03:10.327 INFO:teuthology.orchestra.run:waiting for 20 2024-09-12T02:03:10.343 INFO:teuthology.orchestra.run.smithi019.stdout:.: 2024-09-12T02:03:10.343 INFO:teuthology.orchestra.run.smithi019.stdout:subdir 2024-09-12T02:03:10.343 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:10.343 INFO:teuthology.orchestra.run.smithi019.stdout:./subdir: 2024-09-12T02:03:10.343 INFO:teuthology.orchestra.run.smithi019.stdout:sixmegs 2024-09-12T02:03:10.343 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete mds0_openfiles.0' did not caused DAMAGED state 2024-09-12T02:03:10.343 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 500.00000000' 2024-09-12T02:03:10.344 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:03:10.344 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:03:10.399 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:03:10.399 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:03:10.455 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:03:10.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.598+0000 7fb4e26ba640 1 Processor -- start 2024-09-12T02:03:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.598+0000 7fb4e26ba640 1 -- start start 2024-09-12T02:03:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.599+0000 7fb4e26ba640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb4dc15e760 0x7fb4dc06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.599+0000 7fb4e26ba640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb4dc0cfcc0 0x7fb4dc0d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.599+0000 7fb4e26ba640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4dc0d2700 con 0x7fb4dc0d4fd0 2024-09-12T02:03:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.599+0000 7fb4e26ba640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb4dc0cedb0 con 0x7fb4dc0cfcc0 2024-09-12T02:03:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.599+0000 7fb4e26ba640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb4dc0cf090 con 0x7fb4dc15e760 2024-09-12T02:03:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.599+0000 7fb4e0c57640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb4dc0cfcc0 0x7fb4dc0d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.599+0000 7fb4e0c57640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb4dc0cfcc0 0x7fb4dc0d2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40198/0 (socket says 172.21.15.19:40198) 2024-09-12T02:03:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.599+0000 7fb4e0c57640 1 -- 172.21.15.19:0/1188923638 learned_addr learned my addr 172.21.15.19:0/1188923638 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.599+0000 7fb4e0c57640 1 -- 172.21.15.19:0/1188923638 >> v2:172.21.15.135:3300/0 conn(0x7fb4dc15e760 msgr2=0x7fb4dc06cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.599+0000 7fb4e0c57640 1 --2- 172.21.15.19:0/1188923638 >> v2:172.21.15.135:3300/0 conn(0x7fb4dc15e760 0x7fb4dc06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.599+0000 7fb4e0c57640 1 -- 172.21.15.19:0/1188923638 >> v1:172.21.15.135:6789/0 conn(0x7fb4dc0d4fd0 legacy=0x7fb4dc0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.599+0000 7fb4e0c57640 1 -- 172.21.15.19:0/1188923638 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4dc0b3c80 con 0x7fb4dc0cfcc0 2024-09-12T02:03:10.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.600+0000 7fb4e0c57640 1 --2- 172.21.15.19:0/1188923638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4dc0cfcc0 0x7fb4dc0d2ea0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc08ca50 tx=0x7fb4d402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f57fd6c561fd37 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:10.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.600+0000 7fb4daffd640 1 -- 172.21.15.19:0/1188923638 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4036070 con 0x7fb4dc0cfcc0 2024-09-12T02:03:10.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.600+0000 7fb4daffd640 1 -- 172.21.15.19:0/1188923638 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d4031600 con 0x7fb4dc0cfcc0 2024-09-12T02:03:10.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.600+0000 7fb4daffd640 1 -- 172.21.15.19:0/1188923638 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d40319d0 con 0x7fb4dc0cfcc0 2024-09-12T02:03:10.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.601+0000 7fb4e26ba640 1 -- 172.21.15.19:0/1188923638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4dc0cfcc0 msgr2=0x7fb4dc0d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:10.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.601+0000 7fb4e26ba640 1 --2- 172.21.15.19:0/1188923638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4dc0cfcc0 0x7fb4dc0d2ea0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc08ca50 tx=0x7fb4d402a6f0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.601+0000 7fb4e26ba640 1 -- 172.21.15.19:0/1188923638 shutdown_connections 2024-09-12T02:03:10.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.601+0000 7fb4e26ba640 1 --2- 172.21.15.19:0/1188923638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4dc0cfcc0 0x7fb4dc0d2ea0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.601+0000 7fb4e26ba640 1 --2- 172.21.15.19:0/1188923638 >> v2:172.21.15.135:3300/0 conn(0x7fb4dc15e760 0x7fb4dc06cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.601+0000 7fb4e26ba640 1 -- 172.21.15.19:0/1188923638 >> 172.21.15.19:0/1188923638 conn(0x7fb4dc08bfc0 msgr2=0x7fb4dc0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:10.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.601+0000 7fb4e26ba640 1 -- 172.21.15.19:0/1188923638 shutdown_connections 2024-09-12T02:03:10.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.601+0000 7fb4e26ba640 1 -- 172.21.15.19:0/1188923638 wait complete. 2024-09-12T02:03:10.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.602+0000 7fb4e26ba640 1 Processor -- start 2024-09-12T02:03:10.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.602+0000 7fb4e26ba640 1 -- start start 2024-09-12T02:03:10.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.603+0000 7fb4e26ba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4dc0cfcc0 0x7fb4dc14b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:10.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.603+0000 7fb4e26ba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4dc0d4fd0 0x7fb4dc14bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:10.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.603+0000 7fb4e26ba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4dc15e760 0x7fb4dc0c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:10.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.603+0000 7fb4e26ba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb4dc0d33e0 con 0x7fb4dc15e760 2024-09-12T02:03:10.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.603+0000 7fb4e26ba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb4dc0b38e0 con 0x7fb4dc0d4fd0 2024-09-12T02:03:10.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.603+0000 7fb4e26ba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb4dc0d3560 con 0x7fb4dc0cfcc0 2024-09-12T02:03:10.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.603+0000 7fb4e0c57640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4dc15e760 0x7fb4dc0c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:10.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.603+0000 7fb4e0c57640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4dc15e760 0x7fb4dc0c7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40206/0 (socket says 172.21.15.19:40206) 2024-09-12T02:03:10.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.603+0000 7fb4e0c57640 1 -- 172.21.15.19:0/4247307215 learned_addr learned my addr 172.21.15.19:0/4247307215 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:10.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.603+0000 7fb4db7fe640 1 --2- 172.21.15.19:0/4247307215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4dc0d4fd0 0x7fb4dc14bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:10.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.603+0000 7fb4dbfff640 1 --2- 172.21.15.19:0/4247307215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4dc0cfcc0 0x7fb4dc14b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:10.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.603+0000 7fb4e0c57640 1 -- 172.21.15.19:0/4247307215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4dc0cfcc0 msgr2=0x7fb4dc14b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:10.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.603+0000 7fb4e0c57640 1 --2- 172.21.15.19:0/4247307215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4dc0cfcc0 0x7fb4dc14b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.603+0000 7fb4e0c57640 1 -- 172.21.15.19:0/4247307215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4dc0d4fd0 msgr2=0x7fb4dc14bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:10.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.603+0000 7fb4e0c57640 1 --2- 172.21.15.19:0/4247307215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4dc0d4fd0 0x7fb4dc14bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.603+0000 7fb4e0c57640 1 -- 172.21.15.19:0/4247307215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4dc0b83d0 con 0x7fb4dc15e760 2024-09-12T02:03:10.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.603+0000 7fb4db7fe640 1 --2- 172.21.15.19:0/4247307215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4dc0d4fd0 0x7fb4dc14bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:10.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.603+0000 7fb4dbfff640 1 --2- 172.21.15.19:0/4247307215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4dc0cfcc0 0x7fb4dc14b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:10.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.604+0000 7fb4e0c57640 1 --2- 172.21.15.19:0/4247307215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4dc15e760 0x7fb4dc0c7d30 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009f40 tx=0x7fb4d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:10.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.604+0000 7fb4d8ff9640 1 -- 172.21.15.19:0/4247307215 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4041020 con 0x7fb4dc15e760 2024-09-12T02:03:10.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.604+0000 7fb4d8ff9640 1 -- 172.21.15.19:0/4247307215 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d4007720 con 0x7fb4dc15e760 2024-09-12T02:03:10.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.604+0000 7fb4e26ba640 1 -- 172.21.15.19:0/4247307215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4dc0cad90 con 0x7fb4dc15e760 2024-09-12T02:03:10.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.604+0000 7fb4d8ff9640 1 -- 172.21.15.19:0/4247307215 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4036040 con 0x7fb4dc15e760 2024-09-12T02:03:10.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.604+0000 7fb4e26ba640 1 -- 172.21.15.19:0/4247307215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4dc0b8970 con 0x7fb4dc15e760 2024-09-12T02:03:10.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.605+0000 7fb4e26ba640 1 -- 172.21.15.19:0/4247307215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4dc0d38b0 con 0x7fb4dc15e760 2024-09-12T02:03:10.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.605+0000 7fb4d8ff9640 1 -- 172.21.15.19:0/4247307215 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb4d4044020 con 0x7fb4dc15e760 2024-09-12T02:03:10.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.606+0000 7fb4d8ff9640 1 --2- 172.21.15.19:0/4247307215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb4c806be30 0x7fb4c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:10.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.606+0000 7fb4d8ff9640 1 -- 172.21.15.19:0/4247307215 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6733+0+0 (secure 0 0 0) 0x7fb4d40abfa0 con 0x7fb4dc15e760 2024-09-12T02:03:10.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.606+0000 7fb4dbfff640 1 --2- 172.21.15.19:0/4247307215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb4c806be30 0x7fb4c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:10.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.607+0000 7fb4dbfff640 1 --2- 172.21.15.19:0/4247307215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb4c806be30 0x7fb4c806e2f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00a870 tx=0x7fb4cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:10.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.610+0000 7fb4d8ff9640 1 -- 172.21.15.19:0/4247307215 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4d404b030 con 0x7fb4dc15e760 2024-09-12T02:03:10.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.797+0000 7fb4e26ba640 1 -- 172.21.15.19:0/4247307215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb4dc0b6d20 con 0x7fb4dc15e760 2024-09-12T02:03:10.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.798+0000 7fb4d8ff9640 1 -- 172.21.15.19:0/4247307215 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 12 entries v100) ==== 81+0+732 (secure 0 0 0) 0x7fb4dc0d2700 con 0x7fb4dc15e760 2024-09-12T02:03:10.798 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3136344951 2024-09-13T02:02:58.521234+0000 2024-09-12T02:03:10.799 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/1101861733 2024-09-13T02:02:54.487980+0000 2024-09-12T02:03:10.799 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/650556594 2024-09-13T02:02:50.470816+0000 2024-09-12T02:03:10.799 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/650556594 2024-09-13T02:02:50.470816+0000 2024-09-12T02:03:10.799 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/613869354 2024-09-13T02:02:39.104650+0000 2024-09-12T02:03:10.799 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3136344951 2024-09-13T02:02:58.521234+0000 2024-09-12T02:03:10.799 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/613869354 2024-09-13T02:02:39.104650+0000 2024-09-12T02:03:10.799 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/2072535494 2024-09-13T02:02:44.440900+0000 2024-09-12T02:03:10.799 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/2072535494 2024-09-13T02:02:44.440900+0000 2024-09-12T02:03:10.799 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:03:10.799 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/1101861733 2024-09-13T02:02:54.487980+0000 2024-09-12T02:03:10.799 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:03:10.799 INFO:teuthology.orchestra.run.smithi019.stderr:listed 12 entries 2024-09-12T02:03:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.800+0000 7fb4e26ba640 1 -- 172.21.15.19:0/4247307215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb4c806be30 msgr2=0x7fb4c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.800+0000 7fb4e26ba640 1 --2- 172.21.15.19:0/4247307215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb4c806be30 0x7fb4c806e2f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00a870 tx=0x7fb4cc008040 comp rx=0 tx=0).stop 2024-09-12T02:03:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.800+0000 7fb4e26ba640 1 -- 172.21.15.19:0/4247307215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4dc15e760 msgr2=0x7fb4dc0c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.800+0000 7fb4e26ba640 1 --2- 172.21.15.19:0/4247307215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4dc15e760 0x7fb4dc0c7d30 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009f40 tx=0x7fb4d4004a40 comp rx=0 tx=0).stop 2024-09-12T02:03:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.800+0000 7fb4e26ba640 1 -- 172.21.15.19:0/4247307215 shutdown_connections 2024-09-12T02:03:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.800+0000 7fb4e26ba640 1 --2- 172.21.15.19:0/4247307215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb4c806be30 0x7fb4c806e2f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.800+0000 7fb4e26ba640 1 --2- 172.21.15.19:0/4247307215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4dc15e760 0x7fb4dc0c7d30 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.800+0000 7fb4e26ba640 1 --2- 172.21.15.19:0/4247307215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4dc0d4fd0 0x7fb4dc14bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.800+0000 7fb4e26ba640 1 --2- 172.21.15.19:0/4247307215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4dc0cfcc0 0x7fb4dc14b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.800+0000 7fb4e26ba640 1 -- 172.21.15.19:0/4247307215 >> 172.21.15.19:0/4247307215 conn(0x7fb4dc08bfc0 msgr2=0x7fb4dc0b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.800+0000 7fb4e26ba640 1 -- 172.21.15.19:0/4247307215 shutdown_connections 2024-09-12T02:03:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:10.800+0000 7fb4e26ba640 1 -- 172.21.15.19:0/4247307215 wait complete. 2024-09-12T02:03:10.811 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:03:10.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:10.812 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-12T02:03:10.854 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:03:10.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:10.854 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:03:10.910 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:03:11.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.053+0000 7f1d1588d640 1 Processor -- start 2024-09-12T02:03:11.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.053+0000 7f1d1588d640 1 -- start start 2024-09-12T02:03:11.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.054+0000 7f1d1588d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d10072dc0 0x7f1d100b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:11.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.054+0000 7f1d1588d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d100b44c0 con 0x7f1d100b3c90 2024-09-12T02:03:11.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.054+0000 7f1d1588d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d1015ead0 con 0x7f1d100afd60 2024-09-12T02:03:11.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.054+0000 7f1d1588d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1d100b0140 con 0x7f1d10072dc0 2024-09-12T02:03:11.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.054+0000 7f1d0f7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1d100b3c90 0x7f1d1006f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45244/0 (socket says 172.21.15.19:45244) 2024-09-12T02:03:11.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.054+0000 7f1d0f7fe640 1 -- 172.21.15.19:0/678853711 learned_addr learned my addr 172.21.15.19:0/678853711 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:11.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.054+0000 7f1d0e7fc640 1 --2- 172.21.15.19:0/678853711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d10072dc0 0x7f1d100b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:11.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.054+0000 7f1d0dffb640 1 -- 172.21.15.19:0/678853711 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 123617405 0 0) 0x7f1d100b44c0 con 0x7f1d100b3c90 2024-09-12T02:03:11.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.054+0000 7f1d0dffb640 1 -- 172.21.15.19:0/678853711 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cfc003520 con 0x7f1d100b3c90 2024-09-12T02:03:11.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.054+0000 7f1d0dffb640 1 -- 172.21.15.19:0/678853711 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 802284835 0 0) 0x7f1d1015ead0 con 0x7f1d100afd60 2024-09-12T02:03:11.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.054+0000 7f1d0dffb640 1 -- 172.21.15.19:0/678853711 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d100b44c0 con 0x7f1d100afd60 2024-09-12T02:03:11.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.055+0000 7f1d0e7fc640 1 -- 172.21.15.19:0/678853711 >> v1:172.21.15.135:6789/0 conn(0x7f1d100afd60 legacy=0x7f1d100726b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:11.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.055+0000 7f1d0dffb640 1 -- 172.21.15.19:0/678853711 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2593172494 0 0) 0x7f1cfc003520 con 0x7f1d100b3c90 2024-09-12T02:03:11.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.055+0000 7f1d0e7fc640 1 -- 172.21.15.19:0/678853711 >> v1:172.21.15.19:6789/0 conn(0x7f1d100b3c90 legacy=0x7f1d1006f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:11.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.055+0000 7f1d0e7fc640 1 -- 172.21.15.19:0/678853711 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1015edb0 con 0x7f1d10072dc0 2024-09-12T02:03:11.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.055+0000 7f1d0e7fc640 1 --2- 172.21.15.19:0/678853711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d10072dc0 0x7f1d100b3750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80097d0 tx=0x7f1cf802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b432456dd01b5d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:11.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.056+0000 7f1d0dffb640 1 -- 172.21.15.19:0/678853711 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8037070 con 0x7f1d10072dc0 2024-09-12T02:03:11.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.056+0000 7f1d0dffb640 1 -- 172.21.15.19:0/678853711 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf802ac30 con 0x7f1d10072dc0 2024-09-12T02:03:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.056+0000 7f1d0dffb640 1 -- 172.21.15.19:0/678853711 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00001670 con 0x7f1d10072dc0 2024-09-12T02:03:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.056+0000 7f1d1588d640 1 -- 172.21.15.19:0/678853711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d10072dc0 msgr2=0x7f1d100b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.056+0000 7f1d1588d640 1 --2- 172.21.15.19:0/678853711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d10072dc0 0x7f1d100b3750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80097d0 tx=0x7f1cf802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:03:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.056+0000 7f1d1588d640 1 -- 172.21.15.19:0/678853711 shutdown_connections 2024-09-12T02:03:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.056+0000 7f1d1588d640 1 --2- 172.21.15.19:0/678853711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d10072dc0 0x7f1d100b3750 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.056+0000 7f1d1588d640 1 -- 172.21.15.19:0/678853711 >> 172.21.15.19:0/678853711 conn(0x7f1d1006c030 msgr2=0x7f1d1006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.056+0000 7f1d1588d640 1 -- 172.21.15.19:0/678853711 shutdown_connections 2024-09-12T02:03:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.056+0000 7f1d1588d640 1 -- 172.21.15.19:0/678853711 wait complete. 2024-09-12T02:03:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.057+0000 7f1d1588d640 1 Processor -- start 2024-09-12T02:03:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.058+0000 7f1d1588d640 1 -- start start 2024-09-12T02:03:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.058+0000 7f1d1588d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d10072dc0 0x7f1d101f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.058+0000 7f1d1588d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d100afd60 0x7f1d101f3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.058+0000 7f1d1588d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d100b3c90 0x7f1d1015b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.058+0000 7f1d1588d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1015f890 con 0x7f1d100afd60 2024-09-12T02:03:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.058+0000 7f1d1588d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1015f370 con 0x7f1d100b3c90 2024-09-12T02:03:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.058+0000 7f1d1588d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1d100b4140 con 0x7f1d10072dc0 2024-09-12T02:03:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.058+0000 7f1d0e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d100afd60 0x7f1d101f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.058+0000 7f1d0e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d100afd60 0x7f1d101f3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40476/0 (socket says 172.21.15.19:40476) 2024-09-12T02:03:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.058+0000 7f1d0e7fc640 1 -- 172.21.15.19:0/3103059037 learned_addr learned my addr 172.21.15.19:0/3103059037 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.059+0000 7f1d0f7fe640 1 --2- 172.21.15.19:0/3103059037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d100b3c90 0x7f1d1015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.059+0000 7f1d0effd640 1 --2- 172.21.15.19:0/3103059037 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d10072dc0 0x7f1d101f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.059+0000 7f1d0e7fc640 1 -- 172.21.15.19:0/3103059037 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d10072dc0 msgr2=0x7f1d101f32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.059+0000 7f1d0e7fc640 1 --2- 172.21.15.19:0/3103059037 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d10072dc0 0x7f1d101f32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.059+0000 7f1d0e7fc640 1 -- 172.21.15.19:0/3103059037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d100b3c90 msgr2=0x7f1d1015b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.059+0000 7f1d0e7fc640 1 --2- 172.21.15.19:0/3103059037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d100b3c90 0x7f1d1015b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.059+0000 7f1d0e7fc640 1 -- 172.21.15.19:0/3103059037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d10159120 con 0x7f1d100afd60 2024-09-12T02:03:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.059+0000 7f1d0effd640 1 --2- 172.21.15.19:0/3103059037 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d10072dc0 0x7f1d101f32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.059+0000 7f1d0f7fe640 1 --2- 172.21.15.19:0/3103059037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d100b3c90 0x7f1d1015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.059+0000 7f1d0e7fc640 1 --2- 172.21.15.19:0/3103059037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d100afd60 0x7f1d101f3810 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8035040 tx=0x7f1cf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.059+0000 7f1d07fff640 1 -- 172.21.15.19:0/3103059037 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8041020 con 0x7f1d100afd60 2024-09-12T02:03:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.059+0000 7f1d07fff640 1 -- 172.21.15.19:0/3103059037 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf803d640 con 0x7f1d100afd60 2024-09-12T02:03:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.059+0000 7f1d1588d640 1 -- 172.21.15.19:0/3103059037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1015d190 con 0x7f1d100afd60 2024-09-12T02:03:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.059+0000 7f1d07fff640 1 -- 172.21.15.19:0/3103059037 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8037040 con 0x7f1d100afd60 2024-09-12T02:03:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.059+0000 7f1d1588d640 1 -- 172.21.15.19:0/3103059037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d10158d40 con 0x7f1d100afd60 2024-09-12T02:03:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.060+0000 7f1d1588d640 1 -- 172.21.15.19:0/3103059037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d100b3750 con 0x7f1d100afd60 2024-09-12T02:03:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.061+0000 7f1d07fff640 1 -- 172.21.15.19:0/3103059037 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1cf8044020 con 0x7f1d100afd60 2024-09-12T02:03:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.061+0000 7f1d07fff640 1 --2- 172.21.15.19:0/3103059037 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cf006be30 0x7f1cf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.061+0000 7f1d07fff640 1 -- 172.21.15.19:0/3103059037 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6733+0+0 (secure 0 0 0) 0x7f1cf80ab7f0 con 0x7f1d100afd60 2024-09-12T02:03:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.061+0000 7f1d0effd640 1 --2- 172.21.15.19:0/3103059037 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cf006be30 0x7f1cf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.062+0000 7f1d0effd640 1 --2- 172.21.15.19:0/3103059037 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cf006be30 0x7f1cf006e2f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1d08007fd0 tx=0x7f1d08009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:11.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.065+0000 7f1d07fff640 1 -- 172.21.15.19:0/3103059037 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1cf804b030 con 0x7f1d100afd60 2024-09-12T02:03:11.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.275+0000 7f1d1588d640 1 -- 172.21.15.19:0/3103059037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1d10070920 con 0x7f1d100afd60 2024-09-12T02:03:11.276 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:03:11.276+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:03:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.277+0000 7f1d07fff640 1 -- 172.21.15.19:0/3103059037 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v118) ==== 161+0+0 (secure 0 0 0) 0x7f1cf8079da0 con 0x7f1d100afd60 2024-09-12T02:03:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:03:11.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.279+0000 7f1d1588d640 1 -- 172.21.15.19:0/3103059037 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cf006be30 msgr2=0x7f1cf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:11.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.279+0000 7f1d1588d640 1 --2- 172.21.15.19:0/3103059037 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cf006be30 0x7f1cf006e2f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1d08007fd0 tx=0x7f1d08009040 comp rx=0 tx=0).stop 2024-09-12T02:03:11.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.279+0000 7f1d1588d640 1 -- 172.21.15.19:0/3103059037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d100afd60 msgr2=0x7f1d101f3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:11.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.279+0000 7f1d1588d640 1 --2- 172.21.15.19:0/3103059037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d100afd60 0x7f1d101f3810 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8035040 tx=0x7f1cf80046c0 comp rx=0 tx=0).stop 2024-09-12T02:03:11.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.280+0000 7f1d1588d640 1 -- 172.21.15.19:0/3103059037 shutdown_connections 2024-09-12T02:03:11.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.280+0000 7f1d1588d640 1 --2- 172.21.15.19:0/3103059037 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cf006be30 0x7f1cf006e2f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:11.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.280+0000 7f1d1588d640 1 --2- 172.21.15.19:0/3103059037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d100b3c90 0x7f1d1015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.280+0000 7f1d1588d640 1 --2- 172.21.15.19:0/3103059037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d100afd60 0x7f1d101f3810 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.280+0000 7f1d1588d640 1 --2- 172.21.15.19:0/3103059037 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d10072dc0 0x7f1d101f32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.280+0000 7f1d1588d640 1 -- 172.21.15.19:0/3103059037 >> 172.21.15.19:0/3103059037 conn(0x7f1d1006c030 msgr2=0x7f1d1015fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.280+0000 7f1d1588d640 1 -- 172.21.15.19:0/3103059037 shutdown_connections 2024-09-12T02:03:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.280+0000 7f1d1588d640 1 -- 172.21.15.19:0/3103059037 wait complete. 2024-09-12T02:03:11.283 INFO:tasks.ceph.mds.d.smithi135.stderr: -1776> 2024-09-12T02:03:02.558+0000 7f08fe932640 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2024-09-12T02:03:11.285 INFO:tasks.ceph.mds.d.smithi135.stderr: -528> 2024-09-12T02:03:09.529+0000 7f090293a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:03:11.291 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:03:11.312 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T02:03:11.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.394+0000 7f07d0e74640 1 Processor -- start 2024-09-12T02:03:11.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.394+0000 7f07d0e74640 1 -- start start 2024-09-12T02:03:11.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.395+0000 7f07d0e74640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07cc15e5d0 0x7f07cc0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:11.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.395+0000 7f07d0e74640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f07cc06df60 0x7f07cc09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:11.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.395+0000 7f07d0e74640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07cc06cec0 con 0x7f07cc0d1630 2024-09-12T02:03:11.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.395+0000 7f07d0e74640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f07cc06dad0 con 0x7f07cc06df60 2024-09-12T02:03:11.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.395+0000 7f07d0e74640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f07cc06d1a0 con 0x7f07cc15e5d0 2024-09-12T02:03:11.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.395+0000 7f07c1d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f07cc06df60 0x7f07cc09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:11.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.395+0000 7f07c1d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f07cc06df60 0x7f07cc09aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40490/0 (socket says 172.21.15.19:40490) 2024-09-12T02:03:11.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.395+0000 7f07c1d9b640 1 -- 172.21.15.19:0/1765592491 learned_addr learned my addr 172.21.15.19:0/1765592491 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:11.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.395+0000 7f07ca59c640 1 --2- 172.21.15.19:0/1765592491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07cc15e5d0 0x7f07cc0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:11.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.395+0000 7f07c1d9b640 1 -- 172.21.15.19:0/1765592491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07cc15e5d0 msgr2=0x7f07cc0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:11.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.395+0000 7f07c1d9b640 1 --2- 172.21.15.19:0/1765592491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07cc15e5d0 0x7f07cc0d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:11.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.395+0000 7f07c1d9b640 1 -- 172.21.15.19:0/1765592491 >> v1:172.21.15.135:6789/0 conn(0x7f07cc0d1630 legacy=0x7f07cc162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:11.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.395+0000 7f07c1d9b640 1 -- 172.21.15.19:0/1765592491 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07cc06d480 con 0x7f07cc06df60 2024-09-12T02:03:11.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.395+0000 7f07ca59c640 1 --2- 172.21.15.19:0/1765592491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07cc15e5d0 0x7f07cc0d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:11.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.396+0000 7f07c1d9b640 1 --2- 172.21.15.19:0/1765592491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07cc06df60 0x7f07cc09aa30 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009870 tx=0x7f07b402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f3db890fd6e06b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:11.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.396+0000 7f07c9d9b640 1 -- 172.21.15.19:0/1765592491 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b4037070 con 0x7f07cc06df60 2024-09-12T02:03:11.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.396+0000 7f07c9d9b640 1 -- 172.21.15.19:0/1765592491 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b4032440 con 0x7f07cc06df60 2024-09-12T02:03:11.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.396+0000 7f07c9d9b640 1 -- 172.21.15.19:0/1765592491 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b4032810 con 0x7f07cc06df60 2024-09-12T02:03:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.397+0000 7f07d0e74640 1 -- 172.21.15.19:0/1765592491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07cc06df60 msgr2=0x7f07cc09aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.397+0000 7f07d0e74640 1 --2- 172.21.15.19:0/1765592491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07cc06df60 0x7f07cc09aa30 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009870 tx=0x7f07b402a2a0 comp rx=0 tx=0).stop 2024-09-12T02:03:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.397+0000 7f07d0e74640 1 -- 172.21.15.19:0/1765592491 shutdown_connections 2024-09-12T02:03:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.397+0000 7f07d0e74640 1 --2- 172.21.15.19:0/1765592491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07cc06df60 0x7f07cc09aa30 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.397+0000 7f07d0e74640 1 --2- 172.21.15.19:0/1765592491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07cc15e5d0 0x7f07cc0d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.397+0000 7f07d0e74640 1 -- 172.21.15.19:0/1765592491 >> 172.21.15.19:0/1765592491 conn(0x7f07cc0d23a0 msgr2=0x7f07cc0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.397+0000 7f07d0e74640 1 -- 172.21.15.19:0/1765592491 shutdown_connections 2024-09-12T02:03:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.397+0000 7f07d0e74640 1 -- 172.21.15.19:0/1765592491 wait complete. 2024-09-12T02:03:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.398+0000 7f07d0e74640 1 Processor -- start 2024-09-12T02:03:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.398+0000 7f07d0e74640 1 -- start start 2024-09-12T02:03:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.399+0000 7f07d0e74640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07cc06df60 0x7f07cc0c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.399+0000 7f07d0e74640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07cc0d1630 0x7f07cc1f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.399+0000 7f07d0e74640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07cc15e5d0 0x7f07cc1f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.399+0000 7f07d0e74640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f07cc15eb30 con 0x7f07cc15e5d0 2024-09-12T02:03:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.399+0000 7f07d0e74640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f07cc15e9b0 con 0x7f07cc0d1630 2024-09-12T02:03:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.399+0000 7f07d0e74640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f07cc09af70 con 0x7f07cc06df60 2024-09-12T02:03:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.399+0000 7f07cad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07cc15e5d0 0x7f07cc1f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.399+0000 7f07cad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07cc15e5d0 0x7f07cc1f8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40496/0 (socket says 172.21.15.19:40496) 2024-09-12T02:03:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.399+0000 7f07cad9d640 1 -- 172.21.15.19:0/3684067815 learned_addr learned my addr 172.21.15.19:0/3684067815 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.399+0000 7f07c1d9b640 1 --2- 172.21.15.19:0/3684067815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07cc0d1630 0x7f07cc1f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.399+0000 7f07ca59c640 1 --2- 172.21.15.19:0/3684067815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07cc06df60 0x7f07cc0c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.399+0000 7f07cad9d640 1 -- 172.21.15.19:0/3684067815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07cc06df60 msgr2=0x7f07cc0c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.399+0000 7f07cad9d640 1 --2- 172.21.15.19:0/3684067815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07cc06df60 0x7f07cc0c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.399+0000 7f07cad9d640 1 -- 172.21.15.19:0/3684067815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07cc0d1630 msgr2=0x7f07cc1f4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.399+0000 7f07cad9d640 1 --2- 172.21.15.19:0/3684067815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07cc0d1630 0x7f07cc1f4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.399+0000 7f07cad9d640 1 -- 172.21.15.19:0/3684067815 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07cc0c8ef0 con 0x7f07cc15e5d0 2024-09-12T02:03:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.400+0000 7f07cad9d640 1 --2- 172.21.15.19:0/3684067815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07cc15e5d0 0x7f07cc1f8480 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f07c400c7e0 tx=0x7f07c400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.400+0000 7f07c37fe640 1 -- 172.21.15.19:0/3684067815 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c4004b60 con 0x7f07cc15e5d0 2024-09-12T02:03:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.400+0000 7f07c37fe640 1 -- 172.21.15.19:0/3684067815 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07c4004d00 con 0x7f07cc15e5d0 2024-09-12T02:03:11.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.400+0000 7f07d0e74640 1 -- 172.21.15.19:0/3684067815 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07cc0c8710 con 0x7f07cc15e5d0 2024-09-12T02:03:11.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.400+0000 7f07c37fe640 1 -- 172.21.15.19:0/3684067815 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c400aa90 con 0x7f07cc15e5d0 2024-09-12T02:03:11.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.400+0000 7f07d0e74640 1 -- 172.21.15.19:0/3684067815 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07cc0c72d0 con 0x7f07cc15e5d0 2024-09-12T02:03:11.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.401+0000 7f07d0e74640 1 -- 172.21.15.19:0/3684067815 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07cc09aa30 con 0x7f07cc15e5d0 2024-09-12T02:03:11.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.401+0000 7f07c37fe640 1 -- 172.21.15.19:0/3684067815 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f07c400ac30 con 0x7f07cc15e5d0 2024-09-12T02:03:11.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.402+0000 7f07c37fe640 1 --2- 172.21.15.19:0/3684067815 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f07ac06be30 0x7f07ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:11.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.402+0000 7f07c37fe640 1 -- 172.21.15.19:0/3684067815 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6819+0+0 (secure 0 0 0) 0x7f07c408b3a0 con 0x7f07cc15e5d0 2024-09-12T02:03:11.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.402+0000 7f07ca59c640 1 --2- 172.21.15.19:0/3684067815 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f07ac06be30 0x7f07ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:11.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.403+0000 7f07ca59c640 1 --2- 172.21.15.19:0/3684067815 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f07ac06be30 0x7f07ac06e2f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00aac0 tx=0x7f07bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:11.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.407+0000 7f07c37fe640 1 -- 172.21.15.19:0/3684067815 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f07c4020070 con 0x7f07cc15e5d0 2024-09-12T02:03:11.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:11.653+0000 7f07d0e74640 1 -- 172.21.15.19:0/3684067815 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f07cc0b8320 con 0x7f07cc15e5d0 2024-09-12T02:03:12.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.279+0000 7f07c37fe640 1 -- 172.21.15.19:0/3684067815 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v119) ==== 107+0+0 (secure 0 0 0) 0x7f07c40592a0 con 0x7f07cc15e5d0 2024-09-12T02:03:12.279 INFO:teuthology.orchestra.run.smithi019.stderr:nothing to do: rank is not damaged 2024-09-12T02:03:12.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.282+0000 7f07d0e74640 1 -- 172.21.15.19:0/3684067815 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f07ac06be30 msgr2=0x7f07ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.282+0000 7f07d0e74640 1 --2- 172.21.15.19:0/3684067815 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f07ac06be30 0x7f07ac06e2f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00aac0 tx=0x7f07bc008040 comp rx=0 tx=0).stop 2024-09-12T02:03:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.282+0000 7f07d0e74640 1 -- 172.21.15.19:0/3684067815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07cc15e5d0 msgr2=0x7f07cc1f8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.282+0000 7f07d0e74640 1 --2- 172.21.15.19:0/3684067815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07cc15e5d0 0x7f07cc1f8480 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f07c400c7e0 tx=0x7f07c400cca0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.282+0000 7f07d0e74640 1 -- 172.21.15.19:0/3684067815 shutdown_connections 2024-09-12T02:03:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.282+0000 7f07d0e74640 1 --2- 172.21.15.19:0/3684067815 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f07ac06be30 0x7f07ac06e2f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.282+0000 7f07d0e74640 1 --2- 172.21.15.19:0/3684067815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07cc15e5d0 0x7f07cc1f8480 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.282+0000 7f07d0e74640 1 --2- 172.21.15.19:0/3684067815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07cc0d1630 0x7f07cc1f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.282+0000 7f07d0e74640 1 --2- 172.21.15.19:0/3684067815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07cc06df60 0x7f07cc0c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.282+0000 7f07d0e74640 1 -- 172.21.15.19:0/3684067815 >> 172.21.15.19:0/3684067815 conn(0x7f07cc0d23a0 msgr2=0x7f07cc15cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.282+0000 7f07d0e74640 1 -- 172.21.15.19:0/3684067815 shutdown_connections 2024-09-12T02:03:12.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.282+0000 7f07d0e74640 1 -- 172.21.15.19:0/3684067815 wait complete. 2024-09-12T02:03:12.296 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:03:12.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.346+0000 7f21ec1daf40 1 Processor -- start 2024-09-12T02:03:12.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.346+0000 7f21ec1daf40 1 -- start start 2024-09-12T02:03:12.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.347+0000 7f21ec1daf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1abed9e0 0x561b1ac37dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.347+0000 7f21ec1daf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561b1abef460 0x561b1ac36c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.347+0000 7f21ec1daf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1acc4fb0 0x561b1acc54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.347+0000 7f21ec1daf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561b1abee1c0 con 0x561b1abed9e0 2024-09-12T02:03:12.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.347+0000 7f21ec1daf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561b1abedf20 con 0x561b1acc4fb0 2024-09-12T02:03:12.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.347+0000 7f21ec1daf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x561b1abee720 con 0x561b1abef460 2024-09-12T02:03:12.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.347+0000 7f21e9cd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1abed9e0 0x561b1ac37dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.347+0000 7f21e9cd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1abed9e0 0x561b1ac37dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40514/0 (socket says 172.21.15.19:40514) 2024-09-12T02:03:12.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.347+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3654310541 learned_addr learned my addr 172.21.15.19:0/3654310541 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:12.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.347+0000 7f21e94cf640 1 --2- 172.21.15.19:0/3654310541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561b1abef460 0x561b1ac36c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.347+0000 7f21ea4d1640 1 --2- 172.21.15.19:0/3654310541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1acc4fb0 0x561b1acc54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.347+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3654310541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561b1abef460 msgr2=0x561b1ac36c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:12.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.347+0000 7f21e9cd0640 1 --2- 172.21.15.19:0/3654310541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561b1abef460 0x561b1ac36c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.347+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3654310541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1acc4fb0 msgr2=0x561b1acc54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:12.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.347+0000 7f21e9cd0640 1 --2- 172.21.15.19:0/3654310541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1acc4fb0 0x561b1acc54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.347+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3654310541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b1ab18cb0 con 0x561b1abed9e0 2024-09-12T02:03:12.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.347+0000 7f21e9cd0640 1 --2- 172.21.15.19:0/3654310541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1abed9e0 0x561b1ac37dc0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009780 tx=0x7f21dc005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54cb304c7c747930 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:12.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.348+0000 7f21e3fff640 1 -- 172.21.15.19:0/3654310541 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc008870 con 0x561b1abed9e0 2024-09-12T02:03:12.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.348+0000 7f21e3fff640 1 -- 172.21.15.19:0/3654310541 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21dc018070 con 0x561b1abed9e0 2024-09-12T02:03:12.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.348+0000 7f21e3fff640 1 -- 172.21.15.19:0/3654310541 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc008c30 con 0x561b1abed9e0 2024-09-12T02:03:12.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.348+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3654310541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1abed9e0 msgr2=0x561b1ac37dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.348+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3654310541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1abed9e0 0x561b1ac37dc0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009780 tx=0x7f21dc005a00 comp rx=0 tx=0).stop 2024-09-12T02:03:12.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.348+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3654310541 shutdown_connections 2024-09-12T02:03:12.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.348+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3654310541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1acc4fb0 0x561b1acc54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.348+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3654310541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561b1abef460 0x561b1ac36c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.348+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3654310541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1abed9e0 0x561b1ac37dc0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.348+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3654310541 >> 172.21.15.19:0/3654310541 conn(0x561b1ac1b490 msgr2=0x561b1ac38ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:12.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.348+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3654310541 shutdown_connections 2024-09-12T02:03:12.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.348+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3654310541 wait complete. 2024-09-12T02:03:12.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.349+0000 7f21ec1daf40 1 Processor -- start 2024-09-12T02:03:12.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.349+0000 7f21ec1daf40 1 -- start start 2024-09-12T02:03:12.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21ec1daf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1abed9e0 0x561b1acb6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21ec1daf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561b1abef460 0x561b1ac37dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21ec1daf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1acc4fb0 0x561b1ac38300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21ec1daf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561b1acc80e0 con 0x561b1abed9e0 2024-09-12T02:03:12.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21ec1daf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561b1ac1bba0 con 0x561b1acc4fb0 2024-09-12T02:03:12.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21ec1daf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x561b1ac39370 con 0x561b1abef460 2024-09-12T02:03:12.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21e9cd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1abed9e0 0x561b1acb6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21e9cd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1abed9e0 0x561b1acb6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40520/0 (socket says 172.21.15.19:40520) 2024-09-12T02:03:12.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 learned_addr learned my addr 172.21.15.19:0/3529015772 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:12.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21ea4d1640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1acc4fb0 0x561b1ac38300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21e94cf640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561b1abef460 0x561b1ac37dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561b1abef460 msgr2=0x561b1ac37dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21e9cd0640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561b1abef460 0x561b1ac37dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1acc4fb0 msgr2=0x561b1ac38300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21e9cd0640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1acc4fb0 0x561b1ac38300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b1acc1850 con 0x561b1abed9e0 2024-09-12T02:03:12.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21e9cd0640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1abed9e0 0x561b1acb6ef0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f21dc000c00 tx=0x7f21dc003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:12.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21e2ffd640 1 -- 172.21.15.19:0/3529015772 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc026670 con 0x561b1abed9e0 2024-09-12T02:03:12.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.350+0000 7f21e2ffd640 1 -- 172.21.15.19:0/3529015772 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21dc021070 con 0x561b1abed9e0 2024-09-12T02:03:12.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.351+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b1acc1b30 con 0x561b1abed9e0 2024-09-12T02:03:12.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.351+0000 7f21e2ffd640 1 -- 172.21.15.19:0/3529015772 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc026a70 con 0x561b1abed9e0 2024-09-12T02:03:12.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.351+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b1acc20f0 con 0x561b1abed9e0 2024-09-12T02:03:12.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.352+0000 7f21e2ffd640 1 -- 172.21.15.19:0/3529015772 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21dc013420 con 0x561b1abed9e0 2024-09-12T02:03:12.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.353+0000 7f21e2ffd640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f21cc06a810 0x7f21cc06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.353+0000 7f21e2ffd640 1 -- 172.21.15.19:0/3529015772 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6819+0+0 (secure 0 0 0) 0x7f21dc08bcc0 con 0x561b1abed9e0 2024-09-12T02:03:12.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.353+0000 7f21e94cf640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f21cc06a810 0x7f21cc06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.356 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:03:12.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.353+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x561b1ac33cb0 0x561b1acc0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.353+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1acc0ab0 con 0x561b1ac33cb0 2024-09-12T02:03:12.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.353+0000 7f21ea4d1640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x561b1ac33cb0 0x561b1acc0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.353+0000 7f21e94cf640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f21cc06a810 0x7f21cc06ccd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f21d4057000 tx=0x7f21d4052000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:12.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.354+0000 7f21ea4d1640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x561b1ac33cb0 0x561b1acc0570 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:12.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.355+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v101'195 uv169 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.355+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1acc0ee0 con 0x561b1ac33cb0 2024-09-12T02:03:12.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.356+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v101'196 uv196 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.356+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1acc1340 con 0x561b1ac33cb0 2024-09-12T02:03:12.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.359+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v101'197 uv197 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.360 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:03:12.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.359+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad68d80 con 0x561b1ac33cb0 2024-09-12T02:03:12.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.360+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v101'198 uv198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.360+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad69120 con 0x561b1ac33cb0 2024-09-12T02:03:12.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.362+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v101'199 uv199 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.362+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad67d70 con 0x561b1ac33cb0 2024-09-12T02:03:12.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.365+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v101'200 uv200 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.365+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad68110 con 0x561b1ac33cb0 2024-09-12T02:03:12.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.368+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v101'201 uv175 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.368+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad68500 con 0x561b1ac33cb0 2024-09-12T02:03:12.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.369+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v101'202 uv202 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.369+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad68500 con 0x561b1ac33cb0 2024-09-12T02:03:12.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.372+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v101'203 uv203 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.372 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:03:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.372+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad684b0 con 0x561b1ac33cb0 2024-09-12T02:03:12.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.374+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v101'204 uv204 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.374+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad684b0 con 0x561b1ac33cb0 2024-09-12T02:03:12.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.377+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v101'205 uv205 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.377+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad684b0 con 0x561b1ac33cb0 2024-09-12T02:03:12.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.378+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v101'206 uv206 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.378+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad684b0 con 0x561b1ac33cb0 2024-09-12T02:03:12.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.381+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v101'207 uv182 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.381+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad684b0 con 0x561b1ac33cb0 2024-09-12T02:03:12.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.382+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v101'208 uv208 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.382+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad684b0 con 0x561b1ac33cb0 2024-09-12T02:03:12.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.383+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v101'209 uv209 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.384 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:03:12.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.383+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad684b0 con 0x561b1ac33cb0 2024-09-12T02:03:12.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.387+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v101'210 uv210 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.387+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad684b0 con 0x561b1ac33cb0 2024-09-12T02:03:12.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.389+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v101'211 uv211 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.389+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad684b0 con 0x561b1ac33cb0 2024-09-12T02:03:12.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.390+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v101'212 uv212 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.390+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad694c0 con 0x561b1ac33cb0 2024-09-12T02:03:12.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.393+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v101'213 uv213 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.393+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad694c0 con 0x561b1ac33cb0 2024-09-12T02:03:12.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.396+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v101'214 uv188 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.396+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad694c0 con 0x561b1ac33cb0 2024-09-12T02:03:12.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.397+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v101'215 uv215 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.397+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad694c0 con 0x561b1ac33cb0 2024-09-12T02:03:12.400 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:03:12.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.400+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v101'216 uv216 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.400+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6a4d0 con 0x561b1ac33cb0 2024-09-12T02:03:12.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.402+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v101'217 uv217 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.403+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6a4d0 con 0x561b1ac33cb0 2024-09-12T02:03:12.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.405+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v101'218 uv218 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.405+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad694c0 con 0x561b1ac33cb0 2024-09-12T02:03:12.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.408+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v101'219 uv219 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.408+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad694c0 con 0x561b1ac33cb0 2024-09-12T02:03:12.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.410+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v101'220 uv194 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.410+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad694c0 con 0x561b1ac33cb0 2024-09-12T02:03:12.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.411+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v101'221 uv221 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.411+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad694c0 con 0x561b1ac33cb0 2024-09-12T02:03:12.412 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:03:12.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.412+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v101'222 uv222 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.412+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6a4d0 con 0x561b1ac33cb0 2024-09-12T02:03:12.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.413+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v101'223 uv223 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.413+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6a4d0 con 0x561b1ac33cb0 2024-09-12T02:03:12.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.414+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v101'224 uv224 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.414+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad694c0 con 0x561b1ac33cb0 2024-09-12T02:03:12.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.415+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v101'225 uv225 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ac33cb0 2024-09-12T02:03:12.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.415+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x561b1ad699d0 0x561b1ad6bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.415+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6c300 con 0x561b1ad699d0 2024-09-12T02:03:12.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.415+0000 7f21e9cd0640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x561b1ad699d0 0x561b1ad6bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.415+0000 7f21e9cd0640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x561b1ad699d0 0x561b1ad6bdc0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:12.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.417+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v101'153 uv134 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.417+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6c6a0 con 0x561b1ad699d0 2024-09-12T02:03:12.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.419+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v101'154 uv154 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.419+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6ca40 con 0x561b1ad699d0 2024-09-12T02:03:12.420 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:03:12.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.420+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v101'155 uv155 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.420+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6d290 con 0x561b1ad699d0 2024-09-12T02:03:12.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.421+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v101'156 uv156 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.421+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6d630 con 0x561b1ad699d0 2024-09-12T02:03:12.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.423+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v101'157 uv157 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.423+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6d9d0 con 0x561b1ad699d0 2024-09-12T02:03:12.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.424+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v101'158 uv151 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.424+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6dd70 con 0x561b1ad699d0 2024-09-12T02:03:12.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.425+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v101'159 uv159 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.425+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6dd70 con 0x561b1ad699d0 2024-09-12T02:03:12.426 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:03:12.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.426+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v101'160 uv160 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.426+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6dd70 con 0x561b1ad699d0 2024-09-12T02:03:12.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.427+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v101'161 uv161 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.427+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6dd70 con 0x561b1ad699d0 2024-09-12T02:03:12.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.428+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v101'162 uv162 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.429+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6dd70 con 0x561b1ad699d0 2024-09-12T02:03:12.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.429+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v101'163 uv152 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.430+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6dd70 con 0x561b1ad699d0 2024-09-12T02:03:12.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.431+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v101'164 uv164 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.431+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6dd70 con 0x561b1ad699d0 2024-09-12T02:03:12.432 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:03:12.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.432+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v101'165 uv165 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.432+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad721f0 con 0x561b1ad699d0 2024-09-12T02:03:12.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.433+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v101'166 uv166 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.433+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad721f0 con 0x561b1ad699d0 2024-09-12T02:03:12.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.434+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v101'167 uv167 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.434+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6dd70 con 0x561b1ad699d0 2024-09-12T02:03:12.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.435+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v101'168 uv148 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.435+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6dd70 con 0x561b1ad699d0 2024-09-12T02:03:12.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.437+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v101'169 uv169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.437+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6dd70 con 0x561b1ad699d0 2024-09-12T02:03:12.438 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:03:12.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.438+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v101'170 uv170 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.438+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6ed80 con 0x561b1ad699d0 2024-09-12T02:03:12.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.439+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v101'171 uv171 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.439+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6ed80 con 0x561b1ad699d0 2024-09-12T02:03:12.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.440+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v101'172 uv172 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.440+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6dd70 con 0x561b1ad699d0 2024-09-12T02:03:12.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.441+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v101'173 uv173 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad699d0 2024-09-12T02:03:12.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.441+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x561b1ad6e3f0 0x561b1ad707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.441+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad70db0 con 0x561b1ad6e3f0 2024-09-12T02:03:12.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.441+0000 7f21e94cf640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x561b1ad6e3f0 0x561b1ad707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.442+0000 7f21e94cf640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x561b1ad6e3f0 0x561b1ad707e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:12.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.443+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v101'39 uv38 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.443+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad71250 con 0x561b1ad6e3f0 2024-09-12T02:03:12.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.444+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v101'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.444+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad71730 con 0x561b1ad6e3f0 2024-09-12T02:03:12.445 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:03:12.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.445+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v101'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.445+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad6cec0 con 0x561b1ad6e3f0 2024-09-12T02:03:12.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.446+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v101'42 uv42 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.446+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad730a0 con 0x561b1ad6e3f0 2024-09-12T02:03:12.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.447+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v101'43 uv43 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.447+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad71fd0 con 0x561b1ad6e3f0 2024-09-12T02:03:12.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.449+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v101'44 uv44 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.449+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x561b1ad72a90 0x561b1ad754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.449+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad75a00 con 0x561b1ad72a90 2024-09-12T02:03:12.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.449+0000 7f21ea4d1640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x561b1ad72a90 0x561b1ad754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.449+0000 7f21ea4d1640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x561b1ad72a90 0x561b1ad754a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:12.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.452+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v101'32 uv31 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.452+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad75df0 con 0x561b1ad72a90 2024-09-12T02:03:12.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.454+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v101'33 uv33 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.454+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad75df0 con 0x561b1ad72a90 2024-09-12T02:03:12.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.456+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v101'34 uv34 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.457 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:03:12.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.456+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad75df0 con 0x561b1ad72a90 2024-09-12T02:03:12.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.457+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v101'35 uv35 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.457+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561b1ad76720 0x561b1ad78b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.457+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79050 con 0x561b1ad76720 2024-09-12T02:03:12.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.458+0000 7f21e9cd0640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561b1ad76720 0x561b1ad78b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.458+0000 7f21e9cd0640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561b1ad76720 0x561b1ad78b10 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:12.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.459+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v101'39 uv38 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.459+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79050 con 0x561b1ad76720 2024-09-12T02:03:12.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.461+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v101'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.461+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad76720 2024-09-12T02:03:12.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.462+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v101'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.462 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:03:12.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.462+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7a450 con 0x561b1ad76720 2024-09-12T02:03:12.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.464+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v101'42 uv42 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.464+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7a450 con 0x561b1ad76720 2024-09-12T02:03:12.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.464+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v101'43 uv43 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.464+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad76720 2024-09-12T02:03:12.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.465+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v101'44 uv44 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.465+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad72a90 2024-09-12T02:03:12.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.467+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v101'70 uv64 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.467+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad72a90 2024-09-12T02:03:12.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.468+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v101'71 uv71 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.468+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad72a90 2024-09-12T02:03:12.469 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:03:12.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.469+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v101'72 uv72 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.469+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7a450 con 0x561b1ad72a90 2024-09-12T02:03:12.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.471+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v101'73 uv73 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.471+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7a450 con 0x561b1ad72a90 2024-09-12T02:03:12.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.472+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v101'74 uv74 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.472+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad72a90 2024-09-12T02:03:12.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.474+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v101'75 uv75 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.474+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad72a90 2024-09-12T02:03:12.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.475+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v101'76 uv69 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.475+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad72a90 2024-09-12T02:03:12.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.476+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v101'77 uv77 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.476+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad72a90 2024-09-12T02:03:12.477 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:03:12.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.477+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v101'78 uv78 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.477+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad72a90 2024-09-12T02:03:12.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.478+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v101'79 uv79 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.478+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad72a90 2024-09-12T02:03:12.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.480+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v101'80 uv80 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.480+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad72a90 2024-09-12T02:03:12.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.481+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v101'32 uv31 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.481+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad72a90 2024-09-12T02:03:12.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.482+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v101'33 uv33 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.482+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad72a90 2024-09-12T02:03:12.488 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:03:12.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.488+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v101'34 uv34 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.488+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad72a90 2024-09-12T02:03:12.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.489+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v101'35 uv35 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.489+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad72a90 2024-09-12T02:03:12.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.492+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v101'36 uv36 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f21e4002940 con 0x561b1ad72a90 2024-09-12T02:03:12.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.492+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad76720 2024-09-12T02:03:12.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.493+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v101'39 uv38 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.493+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad76720 2024-09-12T02:03:12.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.494+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v101'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.494+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad76720 2024-09-12T02:03:12.495 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:03:12.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.495+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v101'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.495+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7a450 con 0x561b1ad76720 2024-09-12T02:03:12.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.496+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v101'42 uv42 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.496+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7a450 con 0x561b1ad76720 2024-09-12T02:03:12.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.497+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v101'43 uv43 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.497+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad76720 2024-09-12T02:03:12.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.498+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v101'44 uv44 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.498+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad76720 2024-09-12T02:03:12.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.499+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v101'64 uv58 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.499+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad76720 2024-09-12T02:03:12.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.500+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v101'65 uv65 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.500+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79440 con 0x561b1ad76720 2024-09-12T02:03:12.504 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:03:12.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.501+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v101'66 uv66 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.501+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79800 con 0x561b1ad76720 2024-09-12T02:03:12.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.502+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v101'67 uv67 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.502+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79500 con 0x561b1ad76720 2024-09-12T02:03:12.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.503+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v101'68 uv68 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.503+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79500 con 0x561b1ad76720 2024-09-12T02:03:12.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.504+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v101'69 uv63 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.504+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad79500 con 0x561b1ad76720 2024-09-12T02:03:12.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.505+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v101'70 uv70 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.505+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad794e0 con 0x561b1ad76720 2024-09-12T02:03:12.506 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:03:12.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.506+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v101'71 uv71 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.506+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad794e0 con 0x561b1ad76720 2024-09-12T02:03:12.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.507+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v101'72 uv72 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.507+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7c2f0 con 0x561b1ad76720 2024-09-12T02:03:12.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.508+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v101'73 uv73 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.508+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x561b1ad7a010 0x561b1ad7c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.508+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7c400 con 0x561b1ad7a010 2024-09-12T02:03:12.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.508+0000 7f21e94cf640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x561b1ad7a010 0x561b1ad7c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.509+0000 7f21e94cf640 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x561b1ad7a010 0x561b1ad7c950 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:12.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.510+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v101'31 uv29 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad7a010 2024-09-12T02:03:12.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.510+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7c400 con 0x561b1ad7a010 2024-09-12T02:03:12.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.511+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v101'32 uv32 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad7a010 2024-09-12T02:03:12.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.511+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7c400 con 0x561b1ad7a010 2024-09-12T02:03:12.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.514+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v101'33 uv33 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad7a010 2024-09-12T02:03:12.514 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:03:12.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.514+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7c400 con 0x561b1ad7a010 2024-09-12T02:03:12.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.517+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v101'34 uv34 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad7a010 2024-09-12T02:03:12.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.517+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7c400 con 0x561b1ad76720 2024-09-12T02:03:12.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.518+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v101'39 uv38 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.518+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7c400 con 0x561b1ad76720 2024-09-12T02:03:12.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.519+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v101'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.519+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7c400 con 0x561b1ad76720 2024-09-12T02:03:12.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.521+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v101'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.521 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:03:12.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.521+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7c400 con 0x561b1ad76720 2024-09-12T02:03:12.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.522+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v101'42 uv42 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.522+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7c400 con 0x561b1ad76720 2024-09-12T02:03:12.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.523+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v101'43 uv43 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.523+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7c400 con 0x561b1ad76720 2024-09-12T02:03:12.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.524+0000 7f21e9cd0640 1 -- 172.21.15.19:0/3529015772 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v101'44 uv44 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21dc0563e0 con 0x561b1ad76720 2024-09-12T02:03:12.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.524+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7c400 con 0x561b1ad6e3f0 2024-09-12T02:03:12.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.525+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v101'32 uv31 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.525+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7c400 con 0x561b1ad6e3f0 2024-09-12T02:03:12.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.526+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v101'33 uv33 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.526+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7c400 con 0x561b1ad6e3f0 2024-09-12T02:03:12.527 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:03:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.527+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v101'34 uv34 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.527+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7cee0 con 0x561b1ad6e3f0 2024-09-12T02:03:12.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.529+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v101'35 uv35 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.529+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7cee0 con 0x561b1ad6e3f0 2024-09-12T02:03:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.530+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v101'36 uv36 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.530+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7ce90 con 0x561b1ad6e3f0 2024-09-12T02:03:12.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.531+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v101'82 uv73 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.531+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7ce90 con 0x561b1ad6e3f0 2024-09-12T02:03:12.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.532+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v101'83 uv83 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.532+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7ce90 con 0x561b1ad6e3f0 2024-09-12T02:03:12.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.533+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v101'84 uv84 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.534 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:03:12.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.533+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7ce90 con 0x561b1ad6e3f0 2024-09-12T02:03:12.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.534+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v101'85 uv85 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.535+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7ce90 con 0x561b1ad6e3f0 2024-09-12T02:03:12.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.535+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v101'86 uv86 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.536+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7ce90 con 0x561b1ad6e3f0 2024-09-12T02:03:12.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.536+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v101'87 uv80 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.536+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7ce90 con 0x561b1ad6e3f0 2024-09-12T02:03:12.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.537+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v101'88 uv88 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.537+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7ce90 con 0x561b1ad6e3f0 2024-09-12T02:03:12.538 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:03:12.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.538+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v101'89 uv89 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.538+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7df40 con 0x561b1ad6e3f0 2024-09-12T02:03:12.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.539+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v101'90 uv90 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.539+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7df40 con 0x561b1ad6e3f0 2024-09-12T02:03:12.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.540+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v101'91 uv91 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.540+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7ce90 con 0x561b1ad6e3f0 2024-09-12T02:03:12.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.541+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v101'92 uv92 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.541+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x561b1ad7c400 con 0x561b1ad6e3f0 2024-09-12T02:03:12.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21e94cf640 1 -- 172.21.15.19:0/3529015772 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v101'93 uv93 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f21d4050050 con 0x561b1ad6e3f0 2024-09-12T02:03:12.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x561b1ad699d0 msgr2=0x561b1ad6bdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x561b1ad699d0 0x561b1ad6bdc0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x561b1ac33cb0 msgr2=0x561b1acc0570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x561b1ac33cb0 0x561b1acc0570 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x561b1ad72a90 msgr2=0x561b1ad754a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x561b1ad72a90 0x561b1ad754a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x561b1ad7a010 msgr2=0x561b1ad7c950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x561b1ad7a010 0x561b1ad7c950 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x561b1ad6e3f0 msgr2=0x561b1ad707e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x561b1ad6e3f0 0x561b1ad707e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561b1ad76720 msgr2=0x561b1ad78b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561b1ad76720 0x561b1ad78b10 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 reap_dead start 2024-09-12T02:03:12.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ea4d1640 1 -- 172.21.15.19:0/3529015772 reap_dead start 2024-09-12T02:03:12.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f21cc06a810 msgr2=0x7f21cc06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f21cc06a810 0x7f21cc06ccd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f21d4057000 tx=0x7f21d4052000 comp rx=0 tx=0).stop 2024-09-12T02:03:12.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1abed9e0 msgr2=0x561b1acb6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1abed9e0 0x561b1acb6ef0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f21dc000c00 tx=0x7f21dc003020 comp rx=0 tx=0).stop 2024-09-12T02:03:12.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 shutdown_connections 2024-09-12T02:03:12.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f21cc06a810 0x7f21cc06ccd0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 --2- 172.21.15.19:0/3529015772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1abed9e0 0x561b1acb6ef0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 >> 172.21.15.19:0/3529015772 conn(0x561b1ac1b490 msgr2=0x561b1ac36bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:12.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 shutdown_connections 2024-09-12T02:03:12.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.542+0000 7f21ec1daf40 1 -- 172.21.15.19:0/3529015772 wait complete. 2024-09-12T02:03:12.545 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 500.00000000 2024-09-12T02:03:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.628+0000 7fd8e27eef40 1 Processor -- start 2024-09-12T02:03:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.628+0000 7fd8e27eef40 1 -- start start 2024-09-12T02:03:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.629+0000 7fd8e27eef40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555b76547f40 0x555b7651c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.629+0000 7fd8e27eef40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555b76564a80 0x555b765f1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.629+0000 7fd8e27eef40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b765f6240 0x555b76549af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.629+0000 7fd8e27eef40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x555b76564f20 con 0x555b76564a80 2024-09-12T02:03:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.629+0000 7fd8e27eef40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555b7646f510 con 0x555b765f6240 2024-09-12T02:03:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.629+0000 7fd8e27eef40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x555b765651c0 con 0x555b76547f40 2024-09-12T02:03:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.629+0000 7fd8dfae5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555b76564a80 0x555b765f1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.629+0000 7fd8e0ae7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b765f6240 0x555b76549af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.629+0000 7fd8dfae5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555b76564a80 0x555b765f1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40536/0 (socket says 172.21.15.19:40536) 2024-09-12T02:03:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.629+0000 7fd8dfae5640 1 -- 172.21.15.19:0/3882695235 learned_addr learned my addr 172.21.15.19:0/3882695235 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.629+0000 7fd8e02e6640 1 --2- 172.21.15.19:0/3882695235 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555b76547f40 0x555b7651c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.629+0000 7fd8e0ae7640 1 -- 172.21.15.19:0/3882695235 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555b76547f40 msgr2=0x555b7651c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.629+0000 7fd8e0ae7640 1 --2- 172.21.15.19:0/3882695235 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555b76547f40 0x555b7651c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.629+0000 7fd8e0ae7640 1 -- 172.21.15.19:0/3882695235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555b76564a80 msgr2=0x555b765f1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.629+0000 7fd8e0ae7640 1 --2- 172.21.15.19:0/3882695235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555b76564a80 0x555b765f1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.629+0000 7fd8e0ae7640 1 -- 172.21.15.19:0/3882695235 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b76563620 con 0x555b765f6240 2024-09-12T02:03:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.630+0000 7fd8e0ae7640 1 --2- 172.21.15.19:0/3882695235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b765f6240 0x555b76549af0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009750 tx=0x7fd8d8005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7946f34fdd0609c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.630+0000 7fd8deae3640 1 -- 172.21.15.19:0/3882695235 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8019070 con 0x555b765f6240 2024-09-12T02:03:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.630+0000 7fd8deae3640 1 -- 172.21.15.19:0/3882695235 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d8008890 con 0x555b765f6240 2024-09-12T02:03:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.630+0000 7fd8deae3640 1 -- 172.21.15.19:0/3882695235 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8008c60 con 0x555b765f6240 2024-09-12T02:03:12.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.630+0000 7fd8e27eef40 1 -- 172.21.15.19:0/3882695235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b765f6240 msgr2=0x555b76549af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.630+0000 7fd8e27eef40 1 --2- 172.21.15.19:0/3882695235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b765f6240 0x555b76549af0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009750 tx=0x7fd8d8005a00 comp rx=0 tx=0).stop 2024-09-12T02:03:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.630+0000 7fd8e27eef40 1 -- 172.21.15.19:0/3882695235 shutdown_connections 2024-09-12T02:03:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.630+0000 7fd8e27eef40 1 --2- 172.21.15.19:0/3882695235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b765f6240 0x555b76549af0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.630+0000 7fd8e27eef40 1 --2- 172.21.15.19:0/3882695235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555b76564a80 0x555b765f1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.630+0000 7fd8e27eef40 1 --2- 172.21.15.19:0/3882695235 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555b76547f40 0x555b7651c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.630+0000 7fd8e27eef40 1 -- 172.21.15.19:0/3882695235 >> 172.21.15.19:0/3882695235 conn(0x555b7651d9e0 msgr2=0x555b765f5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.630+0000 7fd8e27eef40 1 -- 172.21.15.19:0/3882695235 shutdown_connections 2024-09-12T02:03:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.630+0000 7fd8e27eef40 1 -- 172.21.15.19:0/3882695235 wait complete. 2024-09-12T02:03:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.631+0000 7fd8e27eef40 1 Processor -- start 2024-09-12T02:03:12.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.631+0000 7fd8e27eef40 1 -- start start 2024-09-12T02:03:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e27eef40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b76547f40 0x555b765f4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e27eef40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555b76564a80 0x555b765e4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e27eef40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555b765f6240 0x555b765e5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e27eef40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x555b76562f60 con 0x555b765f6240 2024-09-12T02:03:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e27eef40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555b765f2cb0 con 0x555b76547f40 2024-09-12T02:03:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e27eef40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x555b765f12b0 con 0x555b76564a80 2024-09-12T02:03:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e0ae7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555b765f6240 0x555b765e5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e0ae7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555b765f6240 0x555b765e5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40552/0 (socket says 172.21.15.19:40552) 2024-09-12T02:03:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e0ae7640 1 -- 172.21.15.19:0/3780600480 learned_addr learned my addr 172.21.15.19:0/3780600480 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e02e6640 1 --2- 172.21.15.19:0/3780600480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b76547f40 0x555b765f4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8dfae5640 1 --2- 172.21.15.19:0/3780600480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555b76564a80 0x555b765e4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e0ae7640 1 -- 172.21.15.19:0/3780600480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555b76564a80 msgr2=0x555b765e4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e0ae7640 1 --2- 172.21.15.19:0/3780600480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555b76564a80 0x555b765e4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e0ae7640 1 -- 172.21.15.19:0/3780600480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b76547f40 msgr2=0x555b765f4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e0ae7640 1 --2- 172.21.15.19:0/3780600480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b76547f40 0x555b765f4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e0ae7640 1 -- 172.21.15.19:0/3780600480 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b765ec920 con 0x555b765f6240 2024-09-12T02:03:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e02e6640 1 --2- 172.21.15.19:0/3780600480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b76547f40 0x555b765f4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e0ae7640 1 --2- 172.21.15.19:0/3780600480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555b765f6240 0x555b765e5130 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8017040 tx=0x7fd8d8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8ddae1640 1 -- 172.21.15.19:0/3780600480 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8019070 con 0x555b765f6240 2024-09-12T02:03:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8ddae1640 1 -- 172.21.15.19:0/3780600480 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d801a040 con 0x555b765f6240 2024-09-12T02:03:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8ddae1640 1 -- 172.21.15.19:0/3780600480 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8020890 con 0x555b765f6240 2024-09-12T02:03:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e27eef40 1 -- 172.21.15.19:0/3780600480 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b76548be0 con 0x555b765f6240 2024-09-12T02:03:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.632+0000 7fd8e27eef40 1 -- 172.21.15.19:0/3780600480 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b765496c0 con 0x555b765f6240 2024-09-12T02:03:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.634+0000 7fd8ddae1640 1 -- 172.21.15.19:0/3780600480 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8d8020a30 con 0x555b765f6240 2024-09-12T02:03:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.634+0000 7fd8ddae1640 1 --2- 172.21.15.19:0/3780600480 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd8c006a810 0x7fd8c006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.634+0000 7fd8ddae1640 1 -- 172.21.15.19:0/3780600480 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6819+0+0 (secure 0 0 0) 0x7fd8d808c3e0 con 0x555b765f6240 2024-09-12T02:03:12.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.634+0000 7fd8e02e6640 1 --2- 172.21.15.19:0/3780600480 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd8c006a810 0x7fd8c006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.634+0000 7fd8e27eef40 1 --2- 172.21.15.19:0/3780600480 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x555b765f4f60 0x555b7654c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.634+0000 7fd8e27eef40 1 -- 172.21.15.19:0/3780600480 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:1 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x555b7654cd20 con 0x555b765f4f60 2024-09-12T02:03:12.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.635+0000 7fd8dfae5640 1 --2- 172.21.15.19:0/3780600480 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x555b765f4f60 0x555b7654c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.635+0000 7fd8e02e6640 1 --2- 172.21.15.19:0/3780600480 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd8c006a810 0x7fd8c006ccd0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00012e0 tx=0x7fd8d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:12.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.635+0000 7fd8dfae5640 1 --2- 172.21.15.19:0/3780600480 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x555b765f4f60 0x555b7654c7e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:12.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.636+0000 7fd8dfae5640 1 -- 172.21.15.19:0/3780600480 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(1 500.00000000 [delete] v101'81 uv81 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd8c8050050 con 0x555b765f4f60 2024-09-12T02:03:12.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.636+0000 7fd8e27eef40 1 -- 172.21.15.19:0/3780600480 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x555b765f4f60 msgr2=0x555b7654c7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.636+0000 7fd8e27eef40 1 --2- 172.21.15.19:0/3780600480 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x555b765f4f60 0x555b7654c7e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.637+0000 7fd8e27eef40 1 -- 172.21.15.19:0/3780600480 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd8c006a810 msgr2=0x7fd8c006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.637+0000 7fd8e27eef40 1 --2- 172.21.15.19:0/3780600480 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd8c006a810 0x7fd8c006ccd0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00012e0 tx=0x7fd8d0008040 comp rx=0 tx=0).stop 2024-09-12T02:03:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.637+0000 7fd8e27eef40 1 -- 172.21.15.19:0/3780600480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555b765f6240 msgr2=0x555b765e5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.637+0000 7fd8e27eef40 1 --2- 172.21.15.19:0/3780600480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555b765f6240 0x555b765e5130 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8017040 tx=0x7fd8d8002fb0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.637+0000 7fd8e0ae7640 1 -- 172.21.15.19:0/3780600480 reap_dead start 2024-09-12T02:03:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.637+0000 7fd8e27eef40 1 -- 172.21.15.19:0/3780600480 shutdown_connections 2024-09-12T02:03:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.637+0000 7fd8e27eef40 1 -- 172.21.15.19:0/3780600480 >> 172.21.15.19:0/3780600480 conn(0x555b7651d9e0 msgr2=0x555b765f2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.637+0000 7fd8e27eef40 1 -- 172.21.15.19:0/3780600480 shutdown_connections 2024-09-12T02:03:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.637+0000 7fd8e27eef40 1 -- 172.21.15.19:0/3780600480 wait complete. 2024-09-12T02:03:12.641 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:03:12.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.785+0000 7f611e752640 1 Processor -- start 2024-09-12T02:03:12.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.785+0000 7f611e752640 1 -- start start 2024-09-12T02:03:12.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.786+0000 7f611e752640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f611815e6c0 0x7f61180cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.786+0000 7f611e752640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61180d5090 0x7f61180cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.786+0000 7f611e752640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61180cfef0 con 0x7f61180cfae0 2024-09-12T02:03:12.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.786+0000 7f611e752640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f61180cf400 con 0x7f611815e6c0 2024-09-12T02:03:12.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.786+0000 7f611e752640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f61180b10d0 con 0x7f61180d5090 2024-09-12T02:03:12.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.786+0000 7f61177fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61180d5090 0x7f61180cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.786+0000 7f6117fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f611815e6c0 0x7f61180cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.786+0000 7f61177fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61180d5090 0x7f61180cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:49880/0 (socket says 172.21.15.19:49880) 2024-09-12T02:03:12.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.786+0000 7f611ccef640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f61180cfae0 0x7f61181622d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:50962/0 (socket says 172.21.15.19:50962) 2024-09-12T02:03:12.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.786+0000 7f6117fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f611815e6c0 0x7f61180cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54760/0 (socket says 172.21.15.19:54760) 2024-09-12T02:03:12.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.786+0000 7f61177fe640 1 -- 172.21.15.19:0/3211681337 learned_addr learned my addr 172.21.15.19:0/3211681337 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:12.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.786+0000 7f61177fe640 1 -- 172.21.15.19:0/3211681337 >> v2:172.21.15.135:3300/0 conn(0x7f611815e6c0 msgr2=0x7f61180cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:12.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.786+0000 7f61177fe640 1 --2- 172.21.15.19:0/3211681337 >> v2:172.21.15.135:3300/0 conn(0x7f611815e6c0 0x7f61180cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.786+0000 7f61177fe640 1 -- 172.21.15.19:0/3211681337 >> v1:172.21.15.135:6789/0 conn(0x7f61180cfae0 legacy=0x7f61181622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.786+0000 7f6116ffd640 1 -- 172.21.15.19:0/3211681337 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3535475603 0 0) 0x7f6110001490 con 0x7f61180cfae0 2024-09-12T02:03:12.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.786+0000 7f61177fe640 1 -- 172.21.15.19:0/3211681337 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61180d34f0 con 0x7f61180d5090 2024-09-12T02:03:12.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.786+0000 7f6117fff640 1 --2- 172.21.15.19:0/3211681337 >> v2:172.21.15.135:3300/0 conn(0x7f611815e6c0 0x7f61180cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:03:12.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.787+0000 7f61177fe640 1 --2- 172.21.15.19:0/3211681337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61180d5090 0x7f61180cf5a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f61180b1250 tx=0x7f610c02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8065f3eb498334a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:12.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.787+0000 7f6116ffd640 1 -- 172.21.15.19:0/3211681337 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c037070 con 0x7f61180d5090 2024-09-12T02:03:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.787+0000 7f6116ffd640 1 -- 172.21.15.19:0/3211681337 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610c032440 con 0x7f61180d5090 2024-09-12T02:03:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.787+0000 7f6116ffd640 1 -- 172.21.15.19:0/3211681337 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c032810 con 0x7f61180d5090 2024-09-12T02:03:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.788+0000 7f611e752640 1 -- 172.21.15.19:0/3211681337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61180d5090 msgr2=0x7f61180cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.788+0000 7f611e752640 1 --2- 172.21.15.19:0/3211681337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61180d5090 0x7f61180cf5a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f61180b1250 tx=0x7f610c02a130 comp rx=0 tx=0).stop 2024-09-12T02:03:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.788+0000 7f611e752640 1 -- 172.21.15.19:0/3211681337 shutdown_connections 2024-09-12T02:03:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.788+0000 7f611e752640 1 --2- 172.21.15.19:0/3211681337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61180d5090 0x7f61180cf5a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.788+0000 7f611e752640 1 --2- 172.21.15.19:0/3211681337 >> v2:172.21.15.135:3300/0 conn(0x7f611815e6c0 0x7f61180cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.788+0000 7f611e752640 1 -- 172.21.15.19:0/3211681337 >> 172.21.15.19:0/3211681337 conn(0x7f611808bfc0 msgr2=0x7f61180d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.788+0000 7f611e752640 1 -- 172.21.15.19:0/3211681337 shutdown_connections 2024-09-12T02:03:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.788+0000 7f611e752640 1 -- 172.21.15.19:0/3211681337 wait complete. 2024-09-12T02:03:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.789+0000 7f611e752640 1 Processor -- start 2024-09-12T02:03:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.789+0000 7f611e752640 1 -- start start 2024-09-12T02:03:12.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.790+0000 7f611e752640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61180cfae0 0x7f61181f4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.790+0000 7f611e752640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61180d5090 0x7f61180ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.790+0000 7f611e752640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f611815e6c0 0x7f61180cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.790+0000 7f611e752640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f61180cf0f0 con 0x7f61180cfae0 2024-09-12T02:03:12.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.790+0000 7f611e752640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f61180d3a70 con 0x7f611815e6c0 2024-09-12T02:03:12.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.790+0000 7f611e752640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f611815eaa0 con 0x7f61180d5090 2024-09-12T02:03:12.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.790+0000 7f6117fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61180cfae0 0x7f61181f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.790+0000 7f6117fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61180cfae0 0x7f61181f4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40560/0 (socket says 172.21.15.19:40560) 2024-09-12T02:03:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.790+0000 7f6117fff640 1 -- 172.21.15.19:0/2930018592 learned_addr learned my addr 172.21.15.19:0/2930018592 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.790+0000 7f61177fe640 1 --2- 172.21.15.19:0/2930018592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61180d5090 0x7f61180ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.790+0000 7f611ccef640 1 --2- 172.21.15.19:0/2930018592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f611815e6c0 0x7f61180cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.790+0000 7f6117fff640 1 -- 172.21.15.19:0/2930018592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61180d5090 msgr2=0x7f61180ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.790+0000 7f6117fff640 1 --2- 172.21.15.19:0/2930018592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61180d5090 0x7f61180ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.790+0000 7f6117fff640 1 -- 172.21.15.19:0/2930018592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f611815e6c0 msgr2=0x7f61180cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.790+0000 7f6117fff640 1 --2- 172.21.15.19:0/2930018592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f611815e6c0 0x7f61180cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.790+0000 7f6117fff640 1 -- 172.21.15.19:0/2930018592 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61180c9fe0 con 0x7f61180cfae0 2024-09-12T02:03:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.791+0000 7f61177fe640 1 --2- 172.21.15.19:0/2930018592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61180d5090 0x7f61180ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:03:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.791+0000 7f6117fff640 1 --2- 172.21.15.19:0/2930018592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61180cfae0 0x7f61181f4490 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f610800ebe0 tx=0x7f610800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.791+0000 7f6114ff9640 1 -- 172.21.15.19:0/2930018592 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108017070 con 0x7f61180cfae0 2024-09-12T02:03:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.791+0000 7f6114ff9640 1 -- 172.21.15.19:0/2930018592 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610800cc30 con 0x7f61180cfae0 2024-09-12T02:03:12.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.791+0000 7f6114ff9640 1 -- 172.21.15.19:0/2930018592 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108013470 con 0x7f61180cfae0 2024-09-12T02:03:12.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.791+0000 7f611e752640 1 -- 172.21.15.19:0/2930018592 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61180ca2c0 con 0x7f61180cfae0 2024-09-12T02:03:12.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.791+0000 7f611e752640 1 -- 172.21.15.19:0/2930018592 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61180ca880 con 0x7f61180cfae0 2024-09-12T02:03:12.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.792+0000 7f611e752640 1 -- 172.21.15.19:0/2930018592 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61180cf5a0 con 0x7f61180cfae0 2024-09-12T02:03:12.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.793+0000 7f6114ff9640 1 -- 172.21.15.19:0/2930018592 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f610801a070 con 0x7f61180cfae0 2024-09-12T02:03:12.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.793+0000 7f6114ff9640 1 --2- 172.21.15.19:0/2930018592 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f610406be30 0x7f610406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.793+0000 7f6114ff9640 1 -- 172.21.15.19:0/2930018592 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6819+0+0 (secure 0 0 0) 0x7f610808b460 con 0x7f61180cfae0 2024-09-12T02:03:12.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.793+0000 7f61177fe640 1 --2- 172.21.15.19:0/2930018592 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f610406be30 0x7f610406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.794+0000 7f61177fe640 1 --2- 172.21.15.19:0/2930018592 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f610406be30 0x7f610406e2f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f610c034000 tx=0x7f610c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:12.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:12.797+0000 7f6114ff9640 1 -- 172.21.15.19:0/2930018592 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61080593f0 con 0x7f61180cfae0 2024-09-12T02:03:13.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:13.008+0000 7f611e752640 1 -- 172.21.15.19:0/2930018592 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f61181e80b0 con 0x7f61180cfae0 2024-09-12T02:03:13.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:13.582+0000 7f6114ff9640 1 -- 172.21.15.19:0/2930018592 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v120) ==== 162+0+0 (secure 0 0 0) 0x7f610805d6f0 con 0x7f61180cfae0 2024-09-12T02:03:13.583 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:03:13.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:13.586+0000 7f611e752640 1 -- 172.21.15.19:0/2930018592 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f610406be30 msgr2=0x7f610406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:13.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:13.586+0000 7f611e752640 1 --2- 172.21.15.19:0/2930018592 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f610406be30 0x7f610406e2f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f610c034000 tx=0x7f610c02e000 comp rx=0 tx=0).stop 2024-09-12T02:03:13.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:13.586+0000 7f611e752640 1 -- 172.21.15.19:0/2930018592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61180cfae0 msgr2=0x7f61181f4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:13.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:13.586+0000 7f611e752640 1 --2- 172.21.15.19:0/2930018592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61180cfae0 0x7f61181f4490 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f610800ebe0 tx=0x7f610800c520 comp rx=0 tx=0).stop 2024-09-12T02:03:13.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:13.586+0000 7f611e752640 1 -- 172.21.15.19:0/2930018592 shutdown_connections 2024-09-12T02:03:13.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:13.586+0000 7f611e752640 1 --2- 172.21.15.19:0/2930018592 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f610406be30 0x7f610406e2f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:13.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:13.586+0000 7f611e752640 1 --2- 172.21.15.19:0/2930018592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f611815e6c0 0x7f61180cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:13.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:13.586+0000 7f611e752640 1 --2- 172.21.15.19:0/2930018592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61180d5090 0x7f61180ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:13.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:13.586+0000 7f611e752640 1 --2- 172.21.15.19:0/2930018592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61180cfae0 0x7f61181f4490 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:13.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:13.586+0000 7f611e752640 1 -- 172.21.15.19:0/2930018592 >> 172.21.15.19:0/2930018592 conn(0x7f611808bfc0 msgr2=0x7f61180b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:13.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:13.586+0000 7f611e752640 1 -- 172.21.15.19:0/2930018592 shutdown_connections 2024-09-12T02:03:13.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:13.586+0000 7f611e752640 1 -- 172.21.15.19:0/2930018592 wait complete. 2024-09-12T02:03:14.005 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:14.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.121+0000 7fc6934d0640 1 Processor -- start 2024-09-12T02:03:14.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.121+0000 7fc6934d0640 1 -- start start 2024-09-12T02:03:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.122+0000 7fc6934d0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc68c0b6690 0x7fc68c1691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.122+0000 7fc6934d0640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc68c0d3690 con 0x7fc68c15e5f0 2024-09-12T02:03:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.122+0000 7fc6934d0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc68c0d3970 con 0x7fc68c0d30f0 2024-09-12T02:03:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.122+0000 7fc6934d0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc68c06d530 con 0x7fc68c0b6690 2024-09-12T02:03:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.122+0000 7fc69126c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc68c15e5f0 0x7fc68c0d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45258/0 (socket says 172.21.15.19:45258) 2024-09-12T02:03:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.122+0000 7fc69126c640 1 -- 172.21.15.19:0/795619114 learned_addr learned my addr 172.21.15.19:0/795619114 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.122+0000 7fc691a6d640 1 --2- 172.21.15.19:0/795619114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc68c0b6690 0x7fc68c1691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.122+0000 7fc67ffff640 1 -- 172.21.15.19:0/795619114 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3109018529 0 0) 0x7fc68c0d3690 con 0x7fc68c15e5f0 2024-09-12T02:03:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.122+0000 7fc67ffff640 1 -- 172.21.15.19:0/795619114 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc678003520 con 0x7fc68c15e5f0 2024-09-12T02:03:14.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.122+0000 7fc67ffff640 1 -- 172.21.15.19:0/795619114 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1181979395 0 0) 0x7fc68c0d3970 con 0x7fc68c0d30f0 2024-09-12T02:03:14.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.122+0000 7fc67ffff640 1 -- 172.21.15.19:0/795619114 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc68c0d3690 con 0x7fc68c0d30f0 2024-09-12T02:03:14.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.122+0000 7fc67ffff640 1 -- 172.21.15.19:0/795619114 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2845116922 0 0) 0x7fc678003520 con 0x7fc68c15e5f0 2024-09-12T02:03:14.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.122+0000 7fc691a6d640 1 -- 172.21.15.19:0/795619114 >> v1:172.21.15.135:6789/0 conn(0x7fc68c0d30f0 legacy=0x7fc68c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:14.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.122+0000 7fc691a6d640 1 -- 172.21.15.19:0/795619114 >> v1:172.21.15.19:6789/0 conn(0x7fc68c15e5f0 legacy=0x7fc68c0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:14.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.122+0000 7fc691a6d640 1 -- 172.21.15.19:0/795619114 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68c06cee0 con 0x7fc68c0b6690 2024-09-12T02:03:14.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.123+0000 7fc691a6d640 1 --2- 172.21.15.19:0/795619114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc68c0b6690 0x7fc68c1691a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc684009dc0 tx=0x7fc68402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33cb8d06a201cfce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:14.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.123+0000 7fc67ffff640 1 -- 172.21.15.19:0/795619114 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688001690 con 0x7fc68c0b6690 2024-09-12T02:03:14.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.124+0000 7fc67ffff640 1 -- 172.21.15.19:0/795619114 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc684007540 con 0x7fc68c0b6690 2024-09-12T02:03:14.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.124+0000 7fc67ffff640 1 -- 172.21.15.19:0/795619114 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6840078f0 con 0x7fc68c0b6690 2024-09-12T02:03:14.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.124+0000 7fc6934d0640 1 -- 172.21.15.19:0/795619114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc68c0b6690 msgr2=0x7fc68c1691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:14.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.124+0000 7fc6934d0640 1 --2- 172.21.15.19:0/795619114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc68c0b6690 0x7fc68c1691a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc684009dc0 tx=0x7fc68402a660 comp rx=0 tx=0).stop 2024-09-12T02:03:14.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.124+0000 7fc6934d0640 1 -- 172.21.15.19:0/795619114 shutdown_connections 2024-09-12T02:03:14.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.124+0000 7fc6934d0640 1 --2- 172.21.15.19:0/795619114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc68c0b6690 0x7fc68c1691a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:14.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.124+0000 7fc6934d0640 1 -- 172.21.15.19:0/795619114 >> 172.21.15.19:0/795619114 conn(0x7fc68c08bfc0 msgr2=0x7fc68c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:14.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.124+0000 7fc6934d0640 1 -- 172.21.15.19:0/795619114 shutdown_connections 2024-09-12T02:03:14.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.124+0000 7fc6934d0640 1 -- 172.21.15.19:0/795619114 wait complete. 2024-09-12T02:03:14.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.125+0000 7fc6934d0640 1 Processor -- start 2024-09-12T02:03:14.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.126+0000 7fc6934d0640 1 -- start start 2024-09-12T02:03:14.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.126+0000 7fc6934d0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc68c0b6690 0x7fc68c0b7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:14.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.126+0000 7fc6934d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc68c0d30f0 0x7fc68c158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:14.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.126+0000 7fc6934d0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc68c15e5f0 0x7fc68c0b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:14.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.126+0000 7fc6934d0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c06e9d0 con 0x7fc68c0d30f0 2024-09-12T02:03:14.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.126+0000 7fc6934d0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c15e9d0 con 0x7fc68c15e5f0 2024-09-12T02:03:14.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.126+0000 7fc6934d0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc68c06eb50 con 0x7fc68c0b6690 2024-09-12T02:03:14.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.126+0000 7fc690a6b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc68c0d30f0 0x7fc68c158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:14.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.126+0000 7fc690a6b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc68c0d30f0 0x7fc68c158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40562/0 (socket says 172.21.15.19:40562) 2024-09-12T02:03:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.126+0000 7fc690a6b640 1 -- 172.21.15.19:0/2580189383 learned_addr learned my addr 172.21.15.19:0/2580189383 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.127+0000 7fc69126c640 1 --2- 172.21.15.19:0/2580189383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc68c0b6690 0x7fc68c0b7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.127+0000 7fc691a6d640 1 --2- 172.21.15.19:0/2580189383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc68c15e5f0 0x7fc68c0b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.127+0000 7fc690a6b640 1 -- 172.21.15.19:0/2580189383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc68c0b6690 msgr2=0x7fc68c0b7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.127+0000 7fc690a6b640 1 --2- 172.21.15.19:0/2580189383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc68c0b6690 0x7fc68c0b7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.127+0000 7fc690a6b640 1 -- 172.21.15.19:0/2580189383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc68c15e5f0 msgr2=0x7fc68c0b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.127+0000 7fc690a6b640 1 --2- 172.21.15.19:0/2580189383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc68c15e5f0 0x7fc68c0b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.127+0000 7fc690a6b640 1 -- 172.21.15.19:0/2580189383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68c15ff20 con 0x7fc68c0d30f0 2024-09-12T02:03:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.127+0000 7fc690a6b640 1 --2- 172.21.15.19:0/2580189383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc68c0d30f0 0x7fc68c158140 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fc68000c4c0 tx=0x7fc68000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.127+0000 7fc67dffb640 1 -- 172.21.15.19:0/2580189383 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6800052d0 con 0x7fc68c0d30f0 2024-09-12T02:03:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.127+0000 7fc67dffb640 1 -- 172.21.15.19:0/2580189383 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc680005470 con 0x7fc68c0d30f0 2024-09-12T02:03:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.127+0000 7fc6934d0640 1 -- 172.21.15.19:0/2580189383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc68c160200 con 0x7fc68c0d30f0 2024-09-12T02:03:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.127+0000 7fc67dffb640 1 -- 172.21.15.19:0/2580189383 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc680012870 con 0x7fc68c0d30f0 2024-09-12T02:03:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.127+0000 7fc6934d0640 1 -- 172.21.15.19:0/2580189383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc68c0c98e0 con 0x7fc68c0d30f0 2024-09-12T02:03:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.128+0000 7fc6934d0640 1 -- 172.21.15.19:0/2580189383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc68c0b5690 con 0x7fc68c0d30f0 2024-09-12T02:03:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.129+0000 7fc67dffb640 1 -- 172.21.15.19:0/2580189383 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc680012a10 con 0x7fc68c0d30f0 2024-09-12T02:03:14.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.129+0000 7fc67dffb640 1 --2- 172.21.15.19:0/2580189383 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc67006be30 0x7fc67006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:14.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.129+0000 7fc67dffb640 1 -- 172.21.15.19:0/2580189383 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6819+0+0 (secure 0 0 0) 0x7fc68008b060 con 0x7fc68c0d30f0 2024-09-12T02:03:14.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.130+0000 7fc69126c640 1 --2- 172.21.15.19:0/2580189383 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc67006be30 0x7fc67006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:14.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.130+0000 7fc69126c640 1 --2- 172.21.15.19:0/2580189383 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc67006be30 0x7fc67006e2f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc688000fb0 tx=0x7fc6880014f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.134+0000 7fc67dffb640 1 -- 172.21.15.19:0/2580189383 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc68c0b5690 con 0x7fc68c0d30f0 2024-09-12T02:03:14.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.344+0000 7fc6934d0640 1 -- 172.21.15.19:0/2580189383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc68c0b5f80 con 0x7fc68c0d30f0 2024-09-12T02:03:14.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.344+0000 7fc67dffb640 1 -- 172.21.15.19:0/2580189383 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) ==== 95+0+5221 (secure 0 0 0) 0x7fc680059510 con 0x7fc68c0d30f0 2024-09-12T02:03:14.345 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:14.346 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":121,"btime":"2024-09-12T02:03:13:587255+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7255,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/46689513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":46689513},{"type":"v1","addr":"172.21.15.135:6837","nonce":46689513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:13.587226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7962":{"gid":7962,"name":"c","rank":0,"incarnation":121,"state":"up:replay","state_seq":1,"addr":"172.21.15.19:6834/3995150987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3995150987},{"type":"v1","addr":"172.21.15.19:6834","nonce":3995150987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:14.346 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 121 2024-09-12T02:03:14.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.346+0000 7fc6934d0640 1 -- 172.21.15.19:0/2580189383 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc67006be30 msgr2=0x7fc67006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:14.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.346+0000 7fc6934d0640 1 --2- 172.21.15.19:0/2580189383 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc67006be30 0x7fc67006e2f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc688000fb0 tx=0x7fc6880014f0 comp rx=0 tx=0).stop 2024-09-12T02:03:14.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.346+0000 7fc6934d0640 1 -- 172.21.15.19:0/2580189383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc68c0d30f0 msgr2=0x7fc68c158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:14.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.346+0000 7fc6934d0640 1 --2- 172.21.15.19:0/2580189383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc68c0d30f0 0x7fc68c158140 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fc68000c4c0 tx=0x7fc68000c980 comp rx=0 tx=0).stop 2024-09-12T02:03:14.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.346+0000 7fc6934d0640 1 -- 172.21.15.19:0/2580189383 shutdown_connections 2024-09-12T02:03:14.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.346+0000 7fc6934d0640 1 --2- 172.21.15.19:0/2580189383 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc67006be30 0x7fc67006e2f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:14.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.346+0000 7fc6934d0640 1 --2- 172.21.15.19:0/2580189383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc68c15e5f0 0x7fc68c0b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:14.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.346+0000 7fc6934d0640 1 --2- 172.21.15.19:0/2580189383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc68c0d30f0 0x7fc68c158140 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:14.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.346+0000 7fc6934d0640 1 --2- 172.21.15.19:0/2580189383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc68c0b6690 0x7fc68c0b7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:14.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.346+0000 7fc6934d0640 1 -- 172.21.15.19:0/2580189383 >> 172.21.15.19:0/2580189383 conn(0x7fc68c08bfc0 msgr2=0x7fc68c06d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:14.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.346+0000 7fc6934d0640 1 -- 172.21.15.19:0/2580189383 shutdown_connections 2024-09-12T02:03:14.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:14.347+0000 7fc6934d0640 1 -- 172.21.15.19:0/2580189383 wait complete. 2024-09-12T02:03:14.358 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 121, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:03:13.587226+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7962}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7962': {'gid': 7962, 'name': 'c', 'rank': 0, 'incarnation': 121, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.19:6834/3995150987', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 3995150987}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 3995150987}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:03:14.359 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7962:up:replay 2024-09-12T02:03:14.359 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-12T02:03:19.561 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:03:19.562+0000 7f60b0fa8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:03:19.763 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.878+0000 7f7cdd5fd640 1 Processor -- start 2024-09-12T02:03:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.878+0000 7f7cdd5fd640 1 -- start start 2024-09-12T02:03:19.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.879+0000 7f7cdd5fd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7cd8161c80 0x7f7cd806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:19.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.879+0000 7f7cdd5fd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7cd8162060 0x7f7cd80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:19.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.879+0000 7f7cdd5fd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7cd80b64b0 0x7f7cd80b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:19.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.879+0000 7f7cdd5fd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f7cd806e870 con 0x7f7cd8161c80 2024-09-12T02:03:19.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.879+0000 7f7cdd5fd640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f7cd806d9f0 con 0x7f7cd80b64b0 2024-09-12T02:03:19.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.879+0000 7f7cdd5fd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd806dcd0 con 0x7f7cd8162060 2024-09-12T02:03:19.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.879+0000 7f7cd6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7cd8161c80 0x7f7cd806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:19.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.879+0000 7f7cd6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7cd8161c80 0x7f7cd806e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40570/0 (socket says 172.21.15.19:40570) 2024-09-12T02:03:19.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.879+0000 7f7cd6ffd640 1 -- 172.21.15.19:0/4291715288 learned_addr learned my addr 172.21.15.19:0/4291715288 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:19.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.880+0000 7f7cd67fc640 1 --2- 172.21.15.19:0/4291715288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7cd8162060 0x7f7cd80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.880+0000 7f7cd77fe640 1 --2- 172.21.15.19:0/4291715288 >> v2:172.21.15.135:3300/0 conn(0x7f7cd80b64b0 0x7f7cd80b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.880+0000 7f7cd6ffd640 1 -- 172.21.15.19:0/4291715288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7cd8162060 msgr2=0x7f7cd80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.880+0000 7f7cd6ffd640 1 --2- 172.21.15.19:0/4291715288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7cd8162060 0x7f7cd80b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.880+0000 7f7cd6ffd640 1 -- 172.21.15.19:0/4291715288 >> v2:172.21.15.135:3300/0 conn(0x7f7cd80b64b0 msgr2=0x7f7cd80b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.880+0000 7f7cd6ffd640 1 --2- 172.21.15.19:0/4291715288 >> v2:172.21.15.135:3300/0 conn(0x7f7cd80b64b0 0x7f7cd80b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.880+0000 7f7cd6ffd640 1 -- 172.21.15.19:0/4291715288 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd806dfb0 con 0x7f7cd8161c80 2024-09-12T02:03:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.880+0000 7f7cd77fe640 1 --2- 172.21.15.19:0/4291715288 >> v2:172.21.15.135:3300/0 conn(0x7f7cd80b64b0 0x7f7cd80b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.880+0000 7f7cd6ffd640 1 --2- 172.21.15.19:0/4291715288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cd8161c80 0x7f7cd806e330 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f7cd80687b0 tx=0x7f7cc802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e937d504fe83c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.881+0000 7f7cd5ffb640 1 -- 172.21.15.19:0/4291715288 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8036070 con 0x7f7cd8161c80 2024-09-12T02:03:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.881+0000 7f7cd5ffb640 1 -- 172.21.15.19:0/4291715288 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc8031600 con 0x7f7cd8161c80 2024-09-12T02:03:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.881+0000 7f7cd5ffb640 1 -- 172.21.15.19:0/4291715288 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc80319d0 con 0x7f7cd8161c80 2024-09-12T02:03:19.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.881+0000 7f7cdd5fd640 1 -- 172.21.15.19:0/4291715288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cd8161c80 msgr2=0x7f7cd806e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:19.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.881+0000 7f7cdd5fd640 1 --2- 172.21.15.19:0/4291715288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cd8161c80 0x7f7cd806e330 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f7cd80687b0 tx=0x7f7cc802a6a0 comp rx=0 tx=0).stop 2024-09-12T02:03:19.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.881+0000 7f7cdd5fd640 1 -- 172.21.15.19:0/4291715288 shutdown_connections 2024-09-12T02:03:19.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.881+0000 7f7cdd5fd640 1 --2- 172.21.15.19:0/4291715288 >> v2:172.21.15.135:3300/0 conn(0x7f7cd80b64b0 0x7f7cd80b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:19.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.881+0000 7f7cdd5fd640 1 --2- 172.21.15.19:0/4291715288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7cd8162060 0x7f7cd80b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:19.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.881+0000 7f7cdd5fd640 1 --2- 172.21.15.19:0/4291715288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cd8161c80 0x7f7cd806e330 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:19.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.881+0000 7f7cdd5fd640 1 -- 172.21.15.19:0/4291715288 >> 172.21.15.19:0/4291715288 conn(0x7f7cd80d44f0 msgr2=0x7f7cd80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:19.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.881+0000 7f7cdd5fd640 1 -- 172.21.15.19:0/4291715288 shutdown_connections 2024-09-12T02:03:19.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.881+0000 7f7cdd5fd640 1 -- 172.21.15.19:0/4291715288 wait complete. 2024-09-12T02:03:19.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.883+0000 7f7cdd5fd640 1 Processor -- start 2024-09-12T02:03:19.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.883+0000 7f7cdd5fd640 1 -- start start 2024-09-12T02:03:19.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.883+0000 7f7cdd5fd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cd80b64b0 0x7f7cd80cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:19.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.883+0000 7f7cdd5fd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7cd8161c80 0x7f7cd80b7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:19.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.883+0000 7f7cdd5fd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cd8162060 0x7f7cd814fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:19.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.883+0000 7f7cdd5fd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd8162500 con 0x7f7cd80b64b0 2024-09-12T02:03:19.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.883+0000 7f7cdd5fd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd80d2aa0 con 0x7f7cd8162060 2024-09-12T02:03:19.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.883+0000 7f7cdd5fd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd8162680 con 0x7f7cd8161c80 2024-09-12T02:03:19.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.884+0000 7f7cd6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cd80b64b0 0x7f7cd80cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:19.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.884+0000 7f7cd6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cd80b64b0 0x7f7cd80cc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40584/0 (socket says 172.21.15.19:40584) 2024-09-12T02:03:19.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.884+0000 7f7cd6ffd640 1 -- 172.21.15.19:0/1914107918 learned_addr learned my addr 172.21.15.19:0/1914107918 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:19.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.884+0000 7f7cd77fe640 1 --2- 172.21.15.19:0/1914107918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cd8162060 0x7f7cd814fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:19.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.884+0000 7f7cd6ffd640 1 -- 172.21.15.19:0/1914107918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7cd8161c80 msgr2=0x7f7cd80b7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:19.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.884+0000 7f7cd67fc640 1 --2- 172.21.15.19:0/1914107918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7cd8161c80 0x7f7cd80b7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:19.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.884+0000 7f7cd6ffd640 1 --2- 172.21.15.19:0/1914107918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7cd8161c80 0x7f7cd80b7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:19.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.884+0000 7f7cd6ffd640 1 -- 172.21.15.19:0/1914107918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cd8162060 msgr2=0x7f7cd814fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:19.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.884+0000 7f7cd6ffd640 1 --2- 172.21.15.19:0/1914107918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cd8162060 0x7f7cd814fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:19.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.884+0000 7f7cd6ffd640 1 -- 172.21.15.19:0/1914107918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd80b83b0 con 0x7f7cd80b64b0 2024-09-12T02:03:19.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.884+0000 7f7cd77fe640 1 --2- 172.21.15.19:0/1914107918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cd8162060 0x7f7cd814fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:19.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.884+0000 7f7cd6ffd640 1 --2- 172.21.15.19:0/1914107918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cd80b64b0 0x7f7cd80cc2e0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8000f80 tx=0x7f7cc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:19.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.884+0000 7f7ccf7fe640 1 -- 172.21.15.19:0/1914107918 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8036050 con 0x7f7cd80b64b0 2024-09-12T02:03:19.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.884+0000 7f7ccf7fe640 1 -- 172.21.15.19:0/1914107918 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc8042070 con 0x7f7cd80b64b0 2024-09-12T02:03:19.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.884+0000 7f7ccf7fe640 1 -- 172.21.15.19:0/1914107918 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8009510 con 0x7f7cd80b64b0 2024-09-12T02:03:19.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.884+0000 7f7cdd5fd640 1 -- 172.21.15.19:0/1914107918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd80cc970 con 0x7f7cd80b64b0 2024-09-12T02:03:19.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.885+0000 7f7cdd5fd640 1 -- 172.21.15.19:0/1914107918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd80b8a00 con 0x7f7cd80b64b0 2024-09-12T02:03:19.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.886+0000 7f7cdd5fd640 1 -- 172.21.15.19:0/1914107918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd806e330 con 0x7f7cd80b64b0 2024-09-12T02:03:19.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.886+0000 7f7ccf7fe640 1 -- 172.21.15.19:0/1914107918 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7cc8007c70 con 0x7f7cd80b64b0 2024-09-12T02:03:19.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.886+0000 7f7ccf7fe640 1 --2- 172.21.15.19:0/1914107918 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7cb806be30 0x7f7cb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:19.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.886+0000 7f7ccf7fe640 1 -- 172.21.15.19:0/1914107918 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6819+0+0 (secure 0 0 0) 0x7f7cc80ac1a0 con 0x7f7cd80b64b0 2024-09-12T02:03:19.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.887+0000 7f7cd67fc640 1 --2- 172.21.15.19:0/1914107918 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7cb806be30 0x7f7cb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:19.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.887+0000 7f7cd67fc640 1 --2- 172.21.15.19:0/1914107918 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7cb806be30 0x7f7cb806e2f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0006fd0 tx=0x7f7cc0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:19.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:19.891+0000 7f7ccf7fe640 1 -- 172.21.15.19:0/1914107918 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7cc807a6f0 con 0x7f7cd80b64b0 2024-09-12T02:03:20.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.105+0000 7f7cdd5fd640 1 -- 172.21.15.19:0/1914107918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cd80b4440 con 0x7f7cd80b64b0 2024-09-12T02:03:20.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.105+0000 7f7ccf7fe640 1 -- 172.21.15.19:0/1914107918 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) ==== 95+0+5228 (secure 0 0 0) 0x7f7cc8079ff0 con 0x7f7cd80b64b0 2024-09-12T02:03:20.106 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:20.106 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":124,"btime":"2024-09-12T02:03:16:600437+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7255,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/46689513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":46689513},{"type":"v1","addr":"172.21.15.135:6837","nonce":46689513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:16.600426+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7962":{"gid":7962,"name":"c","rank":0,"incarnation":121,"state":"up:active","state_seq":6,"addr":"172.21.15.19:6834/3995150987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3995150987},{"type":"v1","addr":"172.21.15.19:6834","nonce":3995150987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7962,"qdb_cluster":[7962]},"id":6}]} 2024-09-12T02:03:20.106 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 124 2024-09-12T02:03:20.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.107+0000 7f7cdd5fd640 1 -- 172.21.15.19:0/1914107918 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7cb806be30 msgr2=0x7f7cb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:20.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.107+0000 7f7cdd5fd640 1 --2- 172.21.15.19:0/1914107918 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7cb806be30 0x7f7cb806e2f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0006fd0 tx=0x7f7cc0008040 comp rx=0 tx=0).stop 2024-09-12T02:03:20.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.107+0000 7f7cdd5fd640 1 -- 172.21.15.19:0/1914107918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cd80b64b0 msgr2=0x7f7cd80cc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:20.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.107+0000 7f7cdd5fd640 1 --2- 172.21.15.19:0/1914107918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cd80b64b0 0x7f7cd80cc2e0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8000f80 tx=0x7f7cc8004a40 comp rx=0 tx=0).stop 2024-09-12T02:03:20.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.107+0000 7f7cdd5fd640 1 -- 172.21.15.19:0/1914107918 shutdown_connections 2024-09-12T02:03:20.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.107+0000 7f7cdd5fd640 1 --2- 172.21.15.19:0/1914107918 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7cb806be30 0x7f7cb806e2f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.107+0000 7f7cdd5fd640 1 --2- 172.21.15.19:0/1914107918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cd8162060 0x7f7cd814fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.107+0000 7f7cdd5fd640 1 --2- 172.21.15.19:0/1914107918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7cd8161c80 0x7f7cd80b7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.107+0000 7f7cdd5fd640 1 --2- 172.21.15.19:0/1914107918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cd80b64b0 0x7f7cd80cc2e0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.107+0000 7f7cdd5fd640 1 -- 172.21.15.19:0/1914107918 >> 172.21.15.19:0/1914107918 conn(0x7f7cd80d44f0 msgr2=0x7f7cd80b47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:20.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.108+0000 7f7cdd5fd640 1 -- 172.21.15.19:0/1914107918 shutdown_connections 2024-09-12T02:03:20.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.108+0000 7f7cdd5fd640 1 -- 172.21.15.19:0/1914107918 wait complete. 2024-09-12T02:03:20.120 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 124, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:03:16.600426+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7962}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7962': {'gid': 7962, 'name': 'c', 'rank': 0, 'incarnation': 121, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.19:6834/3995150987', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 3995150987}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 3995150987}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7962, 'qdb_cluster': [7962]} 2024-09-12T02:03:20.120 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:03:20.120 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T02:03:20.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.224+0000 7f97e6f8d640 1 Processor -- start 2024-09-12T02:03:20.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.224+0000 7f97e6f8d640 1 -- start start 2024-09-12T02:03:20.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.224+0000 7f97e6f8d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f97e0162060 0x7f97e00b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.224+0000 7f97e6f8d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97e00b64b0 0x7f97e00b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.224+0000 7f97e6f8d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97e006d9f0 con 0x7f97e0161c80 2024-09-12T02:03:20.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.224+0000 7f97e6f8d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f97e006dcd0 con 0x7f97e0162060 2024-09-12T02:03:20.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.224+0000 7f97e6f8d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f97e006dfb0 con 0x7f97e00b64b0 2024-09-12T02:03:20.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.225+0000 7f97dffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f97e0162060 0x7f97e00b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.225+0000 7f97e4d29640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f97e0161c80 0x7f97e006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45266/0 (socket says 172.21.15.19:45266) 2024-09-12T02:03:20.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.225+0000 7f97e4d29640 1 -- 172.21.15.19:0/684485794 learned_addr learned my addr 172.21.15.19:0/684485794 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:20.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.225+0000 7f97dffff640 1 -- 172.21.15.19:0/684485794 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97e00b64b0 msgr2=0x7f97e00b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:20.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.225+0000 7f97dffff640 1 --2- 172.21.15.19:0/684485794 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97e00b64b0 0x7f97e00b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.225+0000 7f97dffff640 1 -- 172.21.15.19:0/684485794 >> v1:172.21.15.19:6789/0 conn(0x7f97e0161c80 legacy=0x7f97e006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:20.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.225+0000 7f97dffff640 1 -- 172.21.15.19:0/684485794 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e00d01f0 con 0x7f97e0162060 2024-09-12T02:03:20.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.225+0000 7f97df7fe640 1 -- 172.21.15.19:0/684485794 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4273032050 0 0) 0x7f97e006d9f0 con 0x7f97e0161c80 2024-09-12T02:03:20.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.226+0000 7f97dffff640 1 --2- 172.21.15.19:0/684485794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97e0162060 0x7f97e00b5f70 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f97cc0097a0 tx=0x7f97cc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4699cc999c28ffe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:20.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.226+0000 7f97df7fe640 1 -- 172.21.15.19:0/684485794 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc037070 con 0x7f97e0162060 2024-09-12T02:03:20.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.226+0000 7f97df7fe640 1 -- 172.21.15.19:0/684485794 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97cc032440 con 0x7f97e0162060 2024-09-12T02:03:20.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.226+0000 7f97df7fe640 1 -- 172.21.15.19:0/684485794 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc032810 con 0x7f97e0162060 2024-09-12T02:03:20.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.226+0000 7f97e6f8d640 1 -- 172.21.15.19:0/684485794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97e0162060 msgr2=0x7f97e00b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:20.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.226+0000 7f97e6f8d640 1 --2- 172.21.15.19:0/684485794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97e0162060 0x7f97e00b5f70 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f97cc0097a0 tx=0x7f97cc02a180 comp rx=0 tx=0).stop 2024-09-12T02:03:20.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.226+0000 7f97e6f8d640 1 -- 172.21.15.19:0/684485794 shutdown_connections 2024-09-12T02:03:20.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.226+0000 7f97e6f8d640 1 --2- 172.21.15.19:0/684485794 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97e00b64b0 0x7f97e00b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.226+0000 7f97e6f8d640 1 --2- 172.21.15.19:0/684485794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97e0162060 0x7f97e00b5f70 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.226+0000 7f97e6f8d640 1 -- 172.21.15.19:0/684485794 >> 172.21.15.19:0/684485794 conn(0x7f97e00d44f0 msgr2=0x7f97e00d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:20.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.226+0000 7f97e6f8d640 1 -- 172.21.15.19:0/684485794 shutdown_connections 2024-09-12T02:03:20.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.226+0000 7f97e6f8d640 1 -- 172.21.15.19:0/684485794 wait complete. 2024-09-12T02:03:20.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.227+0000 7f97e6f8d640 1 Processor -- start 2024-09-12T02:03:20.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.228+0000 7f97e6f8d640 1 -- start start 2024-09-12T02:03:20.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.228+0000 7f97e6f8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97e00b64b0 0x7f97e00b9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.228+0000 7f97e6f8d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97e0161c80 0x7f97e00b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.228+0000 7f97e6f8d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97e0162060 0x7f97e01560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.228+0000 7f97e6f8d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f97e00cf360 con 0x7f97e00b64b0 2024-09-12T02:03:20.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.228+0000 7f97e6f8d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f97e00cf1e0 con 0x7f97e0161c80 2024-09-12T02:03:20.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.228+0000 7f97e6f8d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f97e00cf4e0 con 0x7f97e0162060 2024-09-12T02:03:20.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.228+0000 7f97e4d29640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97e00b64b0 0x7f97e00b9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.229+0000 7f97e4d29640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97e00b64b0 0x7f97e00b9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40600/0 (socket says 172.21.15.19:40600) 2024-09-12T02:03:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.229+0000 7f97e4d29640 1 -- 172.21.15.19:0/1292000470 learned_addr learned my addr 172.21.15.19:0/1292000470 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.229+0000 7f97e552a640 1 --2- 172.21.15.19:0/1292000470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97e0162060 0x7f97e01560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.229+0000 7f97dffff640 1 --2- 172.21.15.19:0/1292000470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97e0161c80 0x7f97e00b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.229+0000 7f97e4d29640 1 -- 172.21.15.19:0/1292000470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97e0162060 msgr2=0x7f97e01560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.229+0000 7f97e4d29640 1 --2- 172.21.15.19:0/1292000470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97e0162060 0x7f97e01560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.229+0000 7f97e4d29640 1 -- 172.21.15.19:0/1292000470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97e0161c80 msgr2=0x7f97e00b87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.229+0000 7f97e4d29640 1 --2- 172.21.15.19:0/1292000470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97e0161c80 0x7f97e00b87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.229+0000 7f97e4d29640 1 -- 172.21.15.19:0/1292000470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e01f7e60 con 0x7f97e00b64b0 2024-09-12T02:03:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.229+0000 7f97e552a640 1 --2- 172.21.15.19:0/1292000470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97e0162060 0x7f97e01560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:20.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.229+0000 7f97dffff640 1 --2- 172.21.15.19:0/1292000470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97e0161c80 0x7f97e00b87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.229+0000 7f97e4d29640 1 --2- 172.21.15.19:0/1292000470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97e00b64b0 0x7f97e00b9160 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f97d400c4d0 tx=0x7f97d400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.229+0000 7f97dd7fa640 1 -- 172.21.15.19:0/1292000470 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4018070 con 0x7f97e00b64b0 2024-09-12T02:03:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.229+0000 7f97dd7fa640 1 -- 172.21.15.19:0/1292000470 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d4007500 con 0x7f97e00b64b0 2024-09-12T02:03:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.229+0000 7f97e6f8d640 1 -- 172.21.15.19:0/1292000470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97e01f8140 con 0x7f97e00b64b0 2024-09-12T02:03:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.229+0000 7f97dd7fa640 1 -- 172.21.15.19:0/1292000470 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4004a20 con 0x7f97e00b64b0 2024-09-12T02:03:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.229+0000 7f97e6f8d640 1 -- 172.21.15.19:0/1292000470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97e01f8700 con 0x7f97e00b64b0 2024-09-12T02:03:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.231+0000 7f97dd7fa640 1 -- 172.21.15.19:0/1292000470 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f97d401b070 con 0x7f97e00b64b0 2024-09-12T02:03:20.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.231+0000 7f97dd7fa640 1 --2- 172.21.15.19:0/1292000470 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f97c406be30 0x7f97c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.231+0000 7f97dd7fa640 1 -- 172.21.15.19:0/1292000470 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6819+0+0 (secure 0 0 0) 0x7f97d408a640 con 0x7f97e00b64b0 2024-09-12T02:03:20.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.232+0000 7f97dffff640 1 --2- 172.21.15.19:0/1292000470 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f97c406be30 0x7f97c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.232+0000 7f97e9e07740 1 Processor -- start 2024-09-12T02:03:20.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.232+0000 7f97dffff640 1 --2- 172.21.15.19:0/1292000470 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f97c406be30 0x7f97c406e2f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f97cc034000 tx=0x7f97cc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:20.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.232+0000 7f97e9e07740 1 -- start start 2024-09-12T02:03:20.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.233+0000 7f97e9e07740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cda2c0 0x55afc7d1fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.233+0000 7f97e9e07740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cd7a80 0x55afc7cda6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.233+0000 7f97e9e07740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cdba50 0x55afc7cd48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.233+0000 7f97e9e07740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55afc7c3c520 con 0x55afc7cd7a80 2024-09-12T02:03:20.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.233+0000 7f97e9e07740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55afc7be43e0 con 0x55afc7cda2c0 2024-09-12T02:03:20.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.233+0000 7f97e9e07740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55afc7c384e0 con 0x55afc7cdba50 2024-09-12T02:03:20.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.233+0000 7f97dffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cd7a80 0x55afc7cda6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.233+0000 7f97dffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cd7a80 0x55afc7cda6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40612/0 (socket says 172.21.15.19:40612) 2024-09-12T02:03:20.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.233+0000 7f97dffff640 1 -- 172.21.15.19:0/1390330212 learned_addr learned my addr 172.21.15.19:0/1390330212 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:20.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.233+0000 7f97e4d29640 1 --2- 172.21.15.19:0/1390330212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cda2c0 0x55afc7d1fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.233+0000 7f97e552a640 1 --2- 172.21.15.19:0/1390330212 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cdba50 0x55afc7cd48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.233+0000 7f97dffff640 1 -- 172.21.15.19:0/1390330212 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cdba50 msgr2=0x55afc7cd48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:20.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.233+0000 7f97dffff640 1 --2- 172.21.15.19:0/1390330212 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cdba50 0x55afc7cd48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.233+0000 7f97dffff640 1 -- 172.21.15.19:0/1390330212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cda2c0 msgr2=0x55afc7d1fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:20.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.233+0000 7f97dffff640 1 --2- 172.21.15.19:0/1390330212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cda2c0 0x55afc7d1fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.233+0000 7f97dffff640 1 -- 172.21.15.19:0/1390330212 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afc7bff2f0 con 0x55afc7cd7a80 2024-09-12T02:03:20.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.233+0000 7f97dffff640 1 --2- 172.21.15.19:0/1390330212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cd7a80 0x55afc7cda6a0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009890 tx=0x7f97cc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7eb1181b4290be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:20.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.234+0000 7f97ca7fc640 1 -- 172.21.15.19:0/1390330212 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc037040 con 0x55afc7cd7a80 2024-09-12T02:03:20.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.234+0000 7f97ca7fc640 1 -- 172.21.15.19:0/1390330212 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97cc04d070 con 0x55afc7cd7a80 2024-09-12T02:03:20.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.234+0000 7f97ca7fc640 1 -- 172.21.15.19:0/1390330212 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc03d840 con 0x55afc7cd7a80 2024-09-12T02:03:20.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.234+0000 7f97e9e07740 1 -- 172.21.15.19:0/1390330212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cd7a80 msgr2=0x55afc7cda6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:20.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.234+0000 7f97e9e07740 1 --2- 172.21.15.19:0/1390330212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cd7a80 0x55afc7cda6a0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009890 tx=0x7f97cc02c000 comp rx=0 tx=0).stop 2024-09-12T02:03:20.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.234+0000 7f97e9e07740 1 -- 172.21.15.19:0/1390330212 shutdown_connections 2024-09-12T02:03:20.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.234+0000 7f97e9e07740 1 --2- 172.21.15.19:0/1390330212 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cdba50 0x55afc7cd48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.234+0000 7f97e9e07740 1 --2- 172.21.15.19:0/1390330212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cd7a80 0x55afc7cda6a0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.234+0000 7f97e9e07740 1 --2- 172.21.15.19:0/1390330212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cda2c0 0x55afc7d1fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.234+0000 7f97e9e07740 1 -- 172.21.15.19:0/1390330212 >> 172.21.15.19:0/1390330212 conn(0x55afc7cd6a80 msgr2=0x55afc7d1ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:20.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.234+0000 7f97e9e07740 1 -- 172.21.15.19:0/1390330212 shutdown_connections 2024-09-12T02:03:20.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.234+0000 7f97e9e07740 1 -- 172.21.15.19:0/1390330212 wait complete. 2024-09-12T02:03:20.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.235+0000 7f97e9e07740 1 -- start start 2024-09-12T02:03:20.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.235+0000 7f97e9e07740 1 Processor -- start 2024-09-12T02:03:20.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97e9e07740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cda2c0 0x55afc7d18c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97e9e07740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cdba50 0x55afc7cd5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97e9e07740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cfa9e0 0x55afc7cd4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97e9e07740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55afc7cd5f20 con 0x55afc7cda2c0 2024-09-12T02:03:20.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97e9e07740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55afc7bc5450 con 0x55afc7cfa9e0 2024-09-12T02:03:20.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97e9e07740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55afc7d20290 con 0x55afc7cdba50 2024-09-12T02:03:20.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97e9e07740 10 client.0 _ll_register_callbacks cb 0x55afc794eac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:03:20.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97e4d29640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cda2c0 0x55afc7d18c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97e4d29640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cda2c0 0x55afc7d18c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40618/0 (socket says 172.21.15.19:40618) 2024-09-12T02:03:20.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97e4d29640 1 -- 172.21.15.19:0/3283358375 learned_addr learned my addr 172.21.15.19:0/3283358375 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:20.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97dffff640 1 --2- 172.21.15.19:0/3283358375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cdba50 0x55afc7cd5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97e552a640 1 --2- 172.21.15.19:0/3283358375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cfa9e0 0x55afc7cd4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97e4d29640 1 -- 172.21.15.19:0/3283358375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cdba50 msgr2=0x55afc7cd5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:20.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97e4d29640 1 --2- 172.21.15.19:0/3283358375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cdba50 0x55afc7cd5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97e4d29640 1 -- 172.21.15.19:0/3283358375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cfa9e0 msgr2=0x55afc7cd4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:20.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97e4d29640 1 --2- 172.21.15.19:0/3283358375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cfa9e0 0x55afc7cd4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97e4d29640 1 -- 172.21.15.19:0/3283358375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afc794f2d0 con 0x55afc7cda2c0 2024-09-12T02:03:20.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97e4d29640 1 --2- 172.21.15.19:0/3283358375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cda2c0 0x55afc7d18c80 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f97d40548f0 tx=0x7f97d405c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde6ffbab9a5bf1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:20.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.236+0000 7f97bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:03:20.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.237+0000 7f97bf7fe640 1 -- 172.21.15.19:0/3283358375 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4088b30 con 0x55afc7cda2c0 2024-09-12T02:03:20.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.237+0000 7f97bf7fe640 1 -- 172.21.15.19:0/3283358375 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 6819+0+0 (secure 0 0 0) 0x7f97d4088cd0 con 0x55afc7cda2c0 2024-09-12T02:03:20.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.237+0000 7f97e9e07740 1 -- 172.21.15.19:0/3283358375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97cc04d070 con 0x55afc7cda2c0 2024-09-12T02:03:20.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.237+0000 7f97bf7fe640 1 -- 172.21.15.19:0/3283358375 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7f97d40578e0 con 0x55afc7cda2c0 2024-09-12T02:03:20.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.237+0000 7f97e9e07740 10 client.8061 fetch_fsmap learned FSMap version 124 2024-09-12T02:03:20.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.237+0000 7f97e9e07740 1 -- 172.21.15.19:0/3283358375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=124,monmap=2+}) -- 0x55afc7a196b0 con 0x55afc7cda2c0 2024-09-12T02:03:20.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.237+0000 7f97bf7fe640 1 -- 172.21.15.19:0/3283358375 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97cc04d070 con 0x55afc7cda2c0 2024-09-12T02:03:20.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.237+0000 7f97bf7fe640 1 -- 172.21.15.19:0/3283358375 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 124) ==== 3502+0+0 (secure 0 0 0) 0x7f97d4057a80 con 0x55afc7cda2c0 2024-09-12T02:03:20.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.237+0000 7f97e9e07740 10 client.8061 fetch_fsmap finished waiting for FSMap version 124 2024-09-12T02:03:20.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.237+0000 7f97e9e07740 10 client.8061 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:03:20.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.237+0000 7f97e9e07740 20 client.8061 populate_metadata read hostname 'smithi019' 2024-09-12T02:03:20.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.237+0000 7f97e9e07740 1 --2- 172.21.15.19:0/3283358375 >> [v2:172.21.15.19:6832/3995150987,v1:172.21.15.19:6834/3995150987] conn(0x55afc7cd4af0 0x55afc7cfe000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.237+0000 7f97e9e07740 4 client.8061 mds_command: new command op to 7962 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:03:20.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.237+0000 7f97e9e07740 1 -- 172.21.15.19:0/3283358375 --> [v2:172.21.15.19:6832/3995150987,v1:172.21.15.19:6834/3995150987] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afc7c49c50 con 0x55afc7cd4af0 2024-09-12T02:03:20.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.237+0000 7f97dffff640 1 --2- 172.21.15.19:0/3283358375 >> [v2:172.21.15.19:6832/3995150987,v1:172.21.15.19:6834/3995150987] conn(0x55afc7cd4af0 0x55afc7cfe000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.238+0000 7f97bf7fe640 10 client.8061 ms_handle_connect on v2:172.21.15.19:6832/3995150987 2024-09-12T02:03:20.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.238+0000 7f97dffff640 1 --2- 172.21.15.19:0/3283358375 >> [v2:172.21.15.19:6832/3995150987,v1:172.21.15.19:6834/3995150987] conn(0x55afc7cd4af0 0x55afc7cfe000 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db6110b0159c960a server_cookie=1ea2259ad41d90e1 in_seq=0 out_seq=0 2024-09-12T02:03:20.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.238+0000 7f97bf7fe640 1 -- 172.21.15.19:0/3283358375 <== mds.0 v2:172.21.15.19:6832/3995150987 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55afc7c49c50 con 0x55afc7cd4af0 2024-09-12T02:03:20.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.238+0000 7f97bf7fe640 10 client.8061 handle_command_reply: tid=0 2024-09-12T02:03:20.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.238+0000 7f97e9e07740 1 client.8061 shutdown 2024-09-12T02:03:20.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.238+0000 7f97e9e07740 1 -- 172.21.15.19:0/3283358375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cda2c0 msgr2=0x55afc7d18c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:20.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.238+0000 7f97e9e07740 1 --2- 172.21.15.19:0/3283358375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cda2c0 0x55afc7d18c80 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f97d40548f0 tx=0x7f97d405c980 comp rx=0 tx=0).stop 2024-09-12T02:03:20.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.238+0000 7f97e9e07740 1 -- 172.21.15.19:0/3283358375 shutdown_connections 2024-09-12T02:03:20.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.238+0000 7f97e9e07740 1 --2- 172.21.15.19:0/3283358375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cfa9e0 0x55afc7cd4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.238+0000 7f97e9e07740 1 --2- 172.21.15.19:0/3283358375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cdba50 0x55afc7cd5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.238+0000 7f97e9e07740 1 --2- 172.21.15.19:0/3283358375 >> [v2:172.21.15.19:6832/3995150987,v1:172.21.15.19:6834/3995150987] conn(0x55afc7cd4af0 0x55afc7cfe000 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.238+0000 7f97e9e07740 1 --2- 172.21.15.19:0/3283358375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cda2c0 0x55afc7d18c80 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.238+0000 7f97bf7fe640 0 client.8061 ms_handle_reset on v2:172.21.15.19:6832/3995150987 2024-09-12T02:03:20.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.238+0000 7f97e9e07740 1 -- 172.21.15.19:0/3283358375 >> 172.21.15.19:0/3283358375 conn(0x55afc7cd7a80 msgr2=0x55afc7cd8020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:20.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.239+0000 7f97e9e07740 1 -- 172.21.15.19:0/3283358375 shutdown_connections 2024-09-12T02:03:20.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.239+0000 7f97e9e07740 1 -- 172.21.15.19:0/3283358375 wait complete. 2024-09-12T02:03:20.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.239+0000 7f97e9e07740 20 client.8061 trim_cache size 0 max 16384 2024-09-12T02:03:20.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.257+0000 7f97e9e07740 1 Processor -- start 2024-09-12T02:03:20.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.257+0000 7f97e9e07740 1 -- start start 2024-09-12T02:03:20.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.257+0000 7f97e9e07740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cda2c0 0x55afc7d42af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.257+0000 7f97e9e07740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cdba50 0x55afc7d415d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.257+0000 7f97e9e07740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cfa9e0 0x55afc7d41b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.257+0000 7f97e9e07740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f97e00c9370 con 0x55afc7cda2c0 2024-09-12T02:03:20.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.257+0000 7f97e9e07740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f97e00b8120 con 0x55afc7cfa9e0 2024-09-12T02:03:20.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.257+0000 7f97e9e07740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f97e00c8d20 con 0x55afc7cdba50 2024-09-12T02:03:20.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.258+0000 7f97e4d29640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cda2c0 0x55afc7d42af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.258+0000 7f97e4d29640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cda2c0 0x55afc7d42af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40632/0 (socket says 172.21.15.19:40632) 2024-09-12T02:03:20.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.258+0000 7f97e4d29640 1 -- 172.21.15.19:0/2770262073 learned_addr learned my addr 172.21.15.19:0/2770262073 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:20.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.258+0000 7f97dffff640 1 --2- 172.21.15.19:0/2770262073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cdba50 0x55afc7d415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.258+0000 7f97e552a640 1 --2- 172.21.15.19:0/2770262073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cfa9e0 0x55afc7d41b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.258+0000 7f97e4d29640 1 -- 172.21.15.19:0/2770262073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cdba50 msgr2=0x55afc7d415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:20.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.258+0000 7f97e4d29640 1 --2- 172.21.15.19:0/2770262073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cdba50 0x55afc7d415d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.258+0000 7f97e4d29640 1 -- 172.21.15.19:0/2770262073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cfa9e0 msgr2=0x55afc7d41b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:20.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.258+0000 7f97e4d29640 1 --2- 172.21.15.19:0/2770262073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cfa9e0 0x55afc7d41b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.258+0000 7f97e4d29640 1 -- 172.21.15.19:0/2770262073 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afc7ccf470 con 0x55afc7cda2c0 2024-09-12T02:03:20.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.258+0000 7f97e4d29640 1 --2- 172.21.15.19:0/2770262073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cda2c0 0x55afc7d42af0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f97d4058190 tx=0x7f97d408a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd36f4a0514d187 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:20.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.258+0000 7f97c9ffb640 1 -- 172.21.15.19:0/2770262073 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d40703b0 con 0x55afc7cda2c0 2024-09-12T02:03:20.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.258+0000 7f97c9ffb640 1 -- 172.21.15.19:0/2770262073 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d4057a80 con 0x55afc7cda2c0 2024-09-12T02:03:20.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.258+0000 7f97c9ffb640 1 -- 172.21.15.19:0/2770262073 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4088d30 con 0x55afc7cda2c0 2024-09-12T02:03:20.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.259+0000 7f97e9e07740 1 -- 172.21.15.19:0/2770262073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cda2c0 msgr2=0x55afc7d42af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:20.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.259+0000 7f97e9e07740 1 --2- 172.21.15.19:0/2770262073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cda2c0 0x55afc7d42af0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f97d4058190 tx=0x7f97d408a050 comp rx=0 tx=0).stop 2024-09-12T02:03:20.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.259+0000 7f97e9e07740 1 -- 172.21.15.19:0/2770262073 shutdown_connections 2024-09-12T02:03:20.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.259+0000 7f97e9e07740 1 --2- 172.21.15.19:0/2770262073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cfa9e0 0x55afc7d41b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.259+0000 7f97e9e07740 1 --2- 172.21.15.19:0/2770262073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cdba50 0x55afc7d415d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.259+0000 7f97e9e07740 1 --2- 172.21.15.19:0/2770262073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cda2c0 0x55afc7d42af0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.259+0000 7f97e9e07740 1 -- 172.21.15.19:0/2770262073 >> 172.21.15.19:0/2770262073 conn(0x55afc7cd7a80 msgr2=0x55afc7d1d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:20.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.259+0000 7f97e9e07740 1 -- 172.21.15.19:0/2770262073 shutdown_connections 2024-09-12T02:03:20.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.259+0000 7f97e9e07740 1 -- 172.21.15.19:0/2770262073 wait complete. 2024-09-12T02:03:20.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.259+0000 7f97e9e07740 1 -- start start 2024-09-12T02:03:20.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.260+0000 7f97e9e07740 1 Processor -- start 2024-09-12T02:03:20.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.260+0000 7f97e9e07740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cda2c0 0x55afc7cd9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.260+0000 7f97e9e07740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cdba50 0x55afc7d8f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.260+0000 7f97e9e07740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cfa9e0 0x55afc7d2e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.260+0000 7f97e9e07740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55afc7cd4970 con 0x55afc7cdba50 2024-09-12T02:03:20.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.260+0000 7f97e9e07740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55afc7cfaf40 con 0x55afc7cda2c0 2024-09-12T02:03:20.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.260+0000 7f97e9e07740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55afc7d03190 con 0x55afc7cfa9e0 2024-09-12T02:03:20.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.260+0000 7f97e9e07740 10 client.0 _ll_register_callbacks cb 0x7f97d4058490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:03:20.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.260+0000 7f97dffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cdba50 0x55afc7d8f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97dffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cdba50 0x55afc7d8f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40648/0 (socket says 172.21.15.19:40648) 2024-09-12T02:03:20.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97dffff640 1 -- 172.21.15.19:0/2860797209 learned_addr learned my addr 172.21.15.19:0/2860797209 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:20.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97e4d29640 1 --2- 172.21.15.19:0/2860797209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cda2c0 0x55afc7cd9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97e552a640 1 --2- 172.21.15.19:0/2860797209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cfa9e0 0x55afc7d2e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97dffff640 1 -- 172.21.15.19:0/2860797209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cfa9e0 msgr2=0x55afc7d2e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:20.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97dffff640 1 --2- 172.21.15.19:0/2860797209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cfa9e0 0x55afc7d2e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97dffff640 1 -- 172.21.15.19:0/2860797209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cda2c0 msgr2=0x55afc7cd9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:20.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97dffff640 1 --2- 172.21.15.19:0/2860797209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cda2c0 0x55afc7cd9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97dffff640 1 -- 172.21.15.19:0/2860797209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afc7d41700 con 0x55afc7cdba50 2024-09-12T02:03:20.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97dffff640 1 --2- 172.21.15.19:0/2860797209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cdba50 0x55afc7d8f880 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f97cc02a1c0 tx=0x7f97cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c7347ea57399bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:20.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:03:20.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97bf7fe640 1 -- 172.21.15.19:0/2860797209 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc037040 con 0x55afc7cdba50 2024-09-12T02:03:20.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97bf7fe640 1 -- 172.21.15.19:0/2860797209 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 6819+0+0 (secure 0 0 0) 0x7f97cc004420 con 0x55afc7cdba50 2024-09-12T02:03:20.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97e9e07740 1 -- 172.21.15.19:0/2860797209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97d4057a80 con 0x55afc7cdba50 2024-09-12T02:03:20.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97bf7fe640 1 -- 172.21.15.19:0/2860797209 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7f97cc003610 con 0x55afc7cdba50 2024-09-12T02:03:20.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97e9e07740 10 client.8067 fetch_fsmap learned FSMap version 124 2024-09-12T02:03:20.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97e9e07740 1 -- 172.21.15.19:0/2860797209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=124,monmap=2+}) -- 0x55afc7d362d0 con 0x55afc7cdba50 2024-09-12T02:03:20.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97bf7fe640 1 -- 172.21.15.19:0/2860797209 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d4057a80 con 0x55afc7cdba50 2024-09-12T02:03:20.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.261+0000 7f97bf7fe640 1 -- 172.21.15.19:0/2860797209 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 124) ==== 3502+0+0 (secure 0 0 0) 0x7f97cc0037b0 con 0x55afc7cdba50 2024-09-12T02:03:20.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97e9e07740 10 client.8067 fetch_fsmap finished waiting for FSMap version 124 2024-09-12T02:03:20.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97e9e07740 10 client.8067 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:03:20.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97e9e07740 20 client.8067 populate_metadata read hostname 'smithi019' 2024-09-12T02:03:20.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97e9e07740 1 --2- 172.21.15.19:0/2860797209 >> [v2:172.21.15.19:6832/3995150987,v1:172.21.15.19:6834/3995150987] conn(0x55afc7d31280 0x55afc7d31660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97e9e07740 4 client.8067 mds_command: new command op to 7962 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:03:20.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97e9e07740 1 -- 172.21.15.19:0/2860797209 --> [v2:172.21.15.19:6832/3995150987,v1:172.21.15.19:6834/3995150987] -- command(tid 0: {"prefix": "status"}) -- 0x55afc7c43fa0 con 0x55afc7d31280 2024-09-12T02:03:20.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97e4d29640 1 --2- 172.21.15.19:0/2860797209 >> [v2:172.21.15.19:6832/3995150987,v1:172.21.15.19:6834/3995150987] conn(0x55afc7d31280 0x55afc7d31660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97bf7fe640 10 client.8067 ms_handle_connect on v2:172.21.15.19:6832/3995150987 2024-09-12T02:03:20.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97e4d29640 1 --2- 172.21.15.19:0/2860797209 >> [v2:172.21.15.19:6832/3995150987,v1:172.21.15.19:6834/3995150987] conn(0x55afc7d31280 0x55afc7d31660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac58c144bc90a946 server_cookie=84ecb6eb8e0a39d in_seq=0 out_seq=0 2024-09-12T02:03:20.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97bf7fe640 1 -- 172.21.15.19:0/2860797209 <== mds.0 v2:172.21.15.19:6832/3995150987 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x55afc7c43fa0 con 0x55afc7d31280 2024-09-12T02:03:20.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97bf7fe640 10 client.8067 handle_command_reply: tid=0 2024-09-12T02:03:20.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97e9e07740 1 client.8067 shutdown 2024-09-12T02:03:20.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97e9e07740 1 -- 172.21.15.19:0/2860797209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cdba50 msgr2=0x55afc7d8f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:20.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97e9e07740 1 --2- 172.21.15.19:0/2860797209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cdba50 0x55afc7d8f880 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f97cc02a1c0 tx=0x7f97cc004730 comp rx=0 tx=0).stop 2024-09-12T02:03:20.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97e9e07740 1 -- 172.21.15.19:0/2860797209 shutdown_connections 2024-09-12T02:03:20.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97e9e07740 1 --2- 172.21.15.19:0/2860797209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55afc7cfa9e0 0x55afc7d2e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97e9e07740 1 --2- 172.21.15.19:0/2860797209 >> [v2:172.21.15.19:6832/3995150987,v1:172.21.15.19:6834/3995150987] conn(0x55afc7d31280 0x55afc7d31660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97bf7fe640 0 client.8067 ms_handle_reset on v2:172.21.15.19:6832/3995150987 2024-09-12T02:03:20.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97e9e07740 1 --2- 172.21.15.19:0/2860797209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55afc7cdba50 0x55afc7d8f880 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.262+0000 7f97e9e07740 1 --2- 172.21.15.19:0/2860797209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55afc7cda2c0 0x55afc7cd9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.263+0000 7f97e9e07740 1 -- 172.21.15.19:0/2860797209 >> 172.21.15.19:0/2860797209 conn(0x55afc7cd7a80 msgr2=0x55afc7d20b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:20.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.263+0000 7f97e9e07740 1 -- 172.21.15.19:0/2860797209 shutdown_connections 2024-09-12T02:03:20.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.263+0000 7f97e9e07740 1 -- 172.21.15.19:0/2860797209 wait complete. 2024-09-12T02:03:20.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.263+0000 7f97e9e07740 20 client.8067 trim_cache size 0 max 16384 2024-09-12T02:03:20.273 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:03:20.274 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T02:03:20.274 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T02:03:20.274 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 7962, 2024-09-12T02:03:20.274 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T02:03:20.274 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T02:03:20.274 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T02:03:20.274 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 6.6748637610000001, 2024-09-12T02:03:20.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 124, 2024-09-12T02:03:20.274 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 101, 2024-09-12T02:03:20.274 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 101, 2024-09-12T02:03:20.274 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 16.966042636000001 2024-09-12T02:03:20.274 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:03:20.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.263+0000 7f97e6f8d640 1 -- 172.21.15.19:0/1292000470 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f97c406be30 msgr2=0x7f97c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:20.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.263+0000 7f97e6f8d640 1 --2- 172.21.15.19:0/1292000470 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f97c406be30 0x7f97c406e2f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f97cc034000 tx=0x7f97cc02e000 comp rx=0 tx=0).stop 2024-09-12T02:03:20.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.263+0000 7f97e6f8d640 1 -- 172.21.15.19:0/1292000470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97e00b64b0 msgr2=0x7f97e00b9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:20.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.263+0000 7f97e6f8d640 1 --2- 172.21.15.19:0/1292000470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97e00b64b0 0x7f97e00b9160 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f97d400c4d0 tx=0x7f97d400c990 comp rx=0 tx=0).stop 2024-09-12T02:03:20.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.263+0000 7f97e6f8d640 1 -- 172.21.15.19:0/1292000470 shutdown_connections 2024-09-12T02:03:20.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.263+0000 7f97e6f8d640 1 --2- 172.21.15.19:0/1292000470 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f97c406be30 0x7f97c406e2f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.263+0000 7f97e6f8d640 1 --2- 172.21.15.19:0/1292000470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97e0162060 0x7f97e01560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.263+0000 7f97e6f8d640 1 --2- 172.21.15.19:0/1292000470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97e0161c80 0x7f97e00b87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.263+0000 7f97e6f8d640 1 --2- 172.21.15.19:0/1292000470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97e00b64b0 0x7f97e00b9160 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.263+0000 7f97e6f8d640 1 -- 172.21.15.19:0/1292000470 >> 172.21.15.19:0/1292000470 conn(0x7f97e00d44f0 msgr2=0x7f97e00b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:20.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.263+0000 7f97e6f8d640 1 -- 172.21.15.19:0/1292000470 shutdown_connections 2024-09-12T02:03:20.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.263+0000 7f97e6f8d640 1 -- 172.21.15.19:0/1292000470 wait complete. 2024-09-12T02:03:20.277 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:03:20.277 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Delete 500.00000000', proceeding to ls 2024-09-12T02:03:20.277 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:03:20.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.380+0000 7f5354242640 1 Processor -- start 2024-09-12T02:03:20.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.380+0000 7f5354242640 1 -- start start 2024-09-12T02:03:20.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.381+0000 7f5354242640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f534c15b300 0x7f534c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.381+0000 7f5354242640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f534c06f8d0 0x7f534c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.381+0000 7f5354242640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f534c0cdbe0 con 0x7f534c0cd3f0 2024-09-12T02:03:20.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.381+0000 7f5354242640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f534c0728a0 con 0x7f534c15b300 2024-09-12T02:03:20.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.381+0000 7f5354242640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f534c0cd900 con 0x7f534c06f8d0 2024-09-12T02:03:20.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.381+0000 7f5351fde640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f534c15b300 0x7f534c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.381+0000 7f5351fde640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f534c15b300 0x7f534c0cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40660/0 (socket says 172.21.15.19:40660) 2024-09-12T02:03:20.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.381+0000 7f5351fde640 1 -- 172.21.15.19:0/4158570087 learned_addr learned my addr 172.21.15.19:0/4158570087 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:20.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.381+0000 7f53527df640 1 --2- 172.21.15.19:0/4158570087 >> v2:172.21.15.135:3300/0 conn(0x7f534c06f8d0 0x7f534c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.381+0000 7f5351fde640 1 -- 172.21.15.19:0/4158570087 >> v2:172.21.15.135:3300/0 conn(0x7f534c06f8d0 msgr2=0x7f534c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:20.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.381+0000 7f5351fde640 1 --2- 172.21.15.19:0/4158570087 >> v2:172.21.15.135:3300/0 conn(0x7f534c06f8d0 0x7f534c15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.381+0000 7f5351fde640 1 -- 172.21.15.19:0/4158570087 >> v1:172.21.15.135:6789/0 conn(0x7f534c0cd3f0 legacy=0x7f534c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:20.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.381+0000 7f5351fde640 1 -- 172.21.15.19:0/4158570087 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534c072250 con 0x7f534c15b300 2024-09-12T02:03:20.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.382+0000 7f5351fde640 1 --2- 172.21.15.19:0/4158570087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c15b300 0x7f534c0cceb0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f534c0b38f0 tx=0x7f534802c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fd4df52423584 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:20.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.382+0000 7f5350fdc640 1 -- 172.21.15.19:0/4158570087 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5348036020 con 0x7f534c15b300 2024-09-12T02:03:20.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.382+0000 7f5350fdc640 1 -- 172.21.15.19:0/4158570087 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5348032640 con 0x7f534c15b300 2024-09-12T02:03:20.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.382+0000 7f5350fdc640 1 -- 172.21.15.19:0/4158570087 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5348032a10 con 0x7f534c15b300 2024-09-12T02:03:20.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.383+0000 7f5354242640 1 -- 172.21.15.19:0/4158570087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c15b300 msgr2=0x7f534c0cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:20.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.383+0000 7f5354242640 1 --2- 172.21.15.19:0/4158570087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c15b300 0x7f534c0cceb0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f534c0b38f0 tx=0x7f534802c940 comp rx=0 tx=0).stop 2024-09-12T02:03:20.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.383+0000 7f5354242640 1 -- 172.21.15.19:0/4158570087 shutdown_connections 2024-09-12T02:03:20.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.383+0000 7f5354242640 1 --2- 172.21.15.19:0/4158570087 >> v2:172.21.15.135:3300/0 conn(0x7f534c06f8d0 0x7f534c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.383+0000 7f5354242640 1 --2- 172.21.15.19:0/4158570087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c15b300 0x7f534c0cceb0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.383+0000 7f5354242640 1 -- 172.21.15.19:0/4158570087 >> 172.21.15.19:0/4158570087 conn(0x7f534c067d70 msgr2=0x7f534c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:20.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.383+0000 7f5354242640 1 -- 172.21.15.19:0/4158570087 shutdown_connections 2024-09-12T02:03:20.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.383+0000 7f5354242640 1 -- 172.21.15.19:0/4158570087 wait complete. 2024-09-12T02:03:20.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.384+0000 7f5354242640 1 Processor -- start 2024-09-12T02:03:20.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.384+0000 7f5354242640 1 -- start start 2024-09-12T02:03:20.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.385+0000 7f5354242640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c06f8d0 0x7f534c150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.385+0000 7f5354242640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f534c0cd3f0 0x7f534c152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.385+0000 7f5354242640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534c15b300 0x7f534c153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.385+0000 7f5354242640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f534c0d0160 con 0x7f534c06f8d0 2024-09-12T02:03:20.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.385+0000 7f5354242640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f534c0cffe0 con 0x7f534c15b300 2024-09-12T02:03:20.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.385+0000 7f5354242640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f534c072d30 con 0x7f534c0cd3f0 2024-09-12T02:03:20.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.385+0000 7f5351fde640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c06f8d0 0x7f534c150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.385+0000 7f5351fde640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c06f8d0 0x7f534c150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40674/0 (socket says 172.21.15.19:40674) 2024-09-12T02:03:20.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.385+0000 7f5351fde640 1 -- 172.21.15.19:0/2462312944 learned_addr learned my addr 172.21.15.19:0/2462312944 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:20.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.385+0000 7f53527df640 1 --2- 172.21.15.19:0/2462312944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534c15b300 0x7f534c153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.385+0000 7f53517dd640 1 --2- 172.21.15.19:0/2462312944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f534c0cd3f0 0x7f534c152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.385+0000 7f5351fde640 1 -- 172.21.15.19:0/2462312944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f534c0cd3f0 msgr2=0x7f534c152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:20.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.385+0000 7f5351fde640 1 --2- 172.21.15.19:0/2462312944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f534c0cd3f0 0x7f534c152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.385+0000 7f5351fde640 1 -- 172.21.15.19:0/2462312944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534c15b300 msgr2=0x7f534c153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:20.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.385+0000 7f5351fde640 1 --2- 172.21.15.19:0/2462312944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534c15b300 0x7f534c153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.385+0000 7f5351fde640 1 -- 172.21.15.19:0/2462312944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534c151940 con 0x7f534c06f8d0 2024-09-12T02:03:20.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.385+0000 7f53517dd640 1 --2- 172.21.15.19:0/2462312944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f534c0cd3f0 0x7f534c152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:20.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.385+0000 7f5351fde640 1 --2- 172.21.15.19:0/2462312944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c06f8d0 0x7f534c150020 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f534802c980 tx=0x7f53480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:20.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.386+0000 7f53427fc640 1 -- 172.21.15.19:0/2462312944 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5348036040 con 0x7f534c06f8d0 2024-09-12T02:03:20.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.386+0000 7f53427fc640 1 -- 172.21.15.19:0/2462312944 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f534803bcb0 con 0x7f534c06f8d0 2024-09-12T02:03:20.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.386+0000 7f5354242640 1 -- 172.21.15.19:0/2462312944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534c151c20 con 0x7f534c06f8d0 2024-09-12T02:03:20.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.386+0000 7f53427fc640 1 -- 172.21.15.19:0/2462312944 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534803be60 con 0x7f534c06f8d0 2024-09-12T02:03:20.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.386+0000 7f5354242640 1 -- 172.21.15.19:0/2462312944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f534c1521e0 con 0x7f534c06f8d0 2024-09-12T02:03:20.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.387+0000 7f5354242640 1 -- 172.21.15.19:0/2462312944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f534c0b0f60 con 0x7f534c06f8d0 2024-09-12T02:03:20.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.387+0000 7f53427fc640 1 -- 172.21.15.19:0/2462312944 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f534804c060 con 0x7f534c06f8d0 2024-09-12T02:03:20.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.388+0000 7f53427fc640 1 --2- 172.21.15.19:0/2462312944 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f533006be30 0x7f533006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:20.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.388+0000 7f53427fc640 1 -- 172.21.15.19:0/2462312944 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6819+0+0 (secure 0 0 0) 0x7f53480ae240 con 0x7f534c06f8d0 2024-09-12T02:03:20.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.388+0000 7f53517dd640 1 --2- 172.21.15.19:0/2462312944 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f533006be30 0x7f533006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:20.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.389+0000 7f53517dd640 1 --2- 172.21.15.19:0/2462312944 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f533006be30 0x7f533006e2f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f533c007fd0 tx=0x7f533c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:20.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.392+0000 7f53427fc640 1 -- 172.21.15.19:0/2462312944 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5348040070 con 0x7f534c06f8d0 2024-09-12T02:03:20.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.601+0000 7f5354242640 1 -- 172.21.15.19:0/2462312944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f534c0b0c80 con 0x7f534c06f8d0 2024-09-12T02:03:20.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.601+0000 7f53427fc640 1 -- 172.21.15.19:0/2462312944 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v124) ==== 53+0+73 (secure 0 0 0) 0x7f534807c790 con 0x7f534c06f8d0 2024-09-12T02:03:20.602 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:03:20.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.603+0000 7f5354242640 1 -- 172.21.15.19:0/2462312944 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f533006be30 msgr2=0x7f533006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:20.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.603+0000 7f5354242640 1 --2- 172.21.15.19:0/2462312944 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f533006be30 0x7f533006e2f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f533c007fd0 tx=0x7f533c009040 comp rx=0 tx=0).stop 2024-09-12T02:03:20.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.603+0000 7f5354242640 1 -- 172.21.15.19:0/2462312944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c06f8d0 msgr2=0x7f534c150020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:20.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.603+0000 7f5354242640 1 --2- 172.21.15.19:0/2462312944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c06f8d0 0x7f534c150020 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f534802c980 tx=0x7f53480046c0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.603+0000 7f5354242640 1 -- 172.21.15.19:0/2462312944 shutdown_connections 2024-09-12T02:03:20.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.603+0000 7f5354242640 1 --2- 172.21.15.19:0/2462312944 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f533006be30 0x7f533006e2f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.603+0000 7f5354242640 1 --2- 172.21.15.19:0/2462312944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534c15b300 0x7f534c153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.603+0000 7f5354242640 1 --2- 172.21.15.19:0/2462312944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f534c0cd3f0 0x7f534c152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.603+0000 7f5354242640 1 --2- 172.21.15.19:0/2462312944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c06f8d0 0x7f534c150020 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:20.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.603+0000 7f5354242640 1 -- 172.21.15.19:0/2462312944 >> 172.21.15.19:0/2462312944 conn(0x7f534c067d70 msgr2=0x7f534c06ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:20.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.603+0000 7f5354242640 1 -- 172.21.15.19:0/2462312944 shutdown_connections 2024-09-12T02:03:20.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20.603+0000 7f5354242640 1 -- 172.21.15.19:0/2462312944 wait complete. 2024-09-12T02:03:20.615 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:03:20.615 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:03:20.616 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T02:03:20.616 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:03:20.616 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:03:20.616 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:03:20.616 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:03:20.616 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:03:20.616 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:03:20.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:20.616 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T02:03:20.632 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:03:20.632 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:03:20.632 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:03:20.632 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:20.632 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T02:03:20.633 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:20.633 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:03:20.633 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:03:20.633 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T02:03:20.633 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:03:20.633 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:03:20.633 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T02:03:20.633 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:03:20.633 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:03:20.633 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T02:03:20.633 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:03:20.633 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42360sec preferred_lft 42360sec 2024-09-12T02:03:20.633 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T02:03:20.634 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:20.634 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:03:20.634 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:03:20.634 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T02:03:20.634 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:03:20.634 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T02:03:20.634 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:03:20.634 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:20.634 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T02:03:20.634 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:20.634 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:03:20.634 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:03:20.635 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T02:03:20.635 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:20.635 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:03:20.635 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:03:20.635 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T02:03:20.635 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:20.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:20.635 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:03:20.696 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T02:03:20.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:20.698 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T02:03:20.755 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T02:03:20.755 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:03:20.755 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:03:20.755 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:03:20.755 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:03:20.756 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:03:20.756 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T02:03:20.756 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:03:20.756 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:03:20.756 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:03:20.756 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T02:03:20.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:03:20.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:03:20.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:20.883 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T02:03:20.899 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:03:20.899 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:03:20.899 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:03:20.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:20.900 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T02:03:20.965 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:03:20.965 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:03:21.021 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:03:21.021 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:03:21.021 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:03:21.077 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:03:21.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:21.077 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:03:21.162 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:03:21.162 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:03:21.162 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:03:21.171 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:03:21.171 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:03:21.171 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:03:21.171 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:03:21.171 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:03:21.176 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:03:21.176 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:03:21.176 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:03:21.176 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:03:21.176 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:03:21.177 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T02:03:21.177 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T02:03:21.177 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T02:03:21.177 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:03:21.177 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:03:21.177 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:03:21.177 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:03:21.177 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:03:21.179 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:03:21.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:21.179 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:03:21.204 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:03:21.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:03:21.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:03:21.301 INFO:teuthology.orchestra.run.smithi019.stdout:client8076 2024-09-12T02:03:21.301 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:03:21.301 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:03:21.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:21.318 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2024-09-12T02:03:21.361 INFO:teuthology.orchestra.run:waiting for 20 2024-09-12T02:03:21.376 INFO:teuthology.orchestra.run.smithi019.stdout:.: 2024-09-12T02:03:21.376 INFO:teuthology.orchestra.run.smithi019.stdout:subdir 2024-09-12T02:03:21.376 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:21.376 INFO:teuthology.orchestra.run.smithi019.stdout:./subdir: 2024-09-12T02:03:21.376 INFO:teuthology.orchestra.run.smithi019.stdout:sixmegs 2024-09-12T02:03:21.376 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 500.00000000' did not caused DAMAGED state 2024-09-12T02:03:21.377 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete mds_snaptable' 2024-09-12T02:03:21.377 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:03:21.377 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:03:21.432 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:03:21.433 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:03:21.489 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:03:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.634+0000 7fa77da37640 1 Processor -- start 2024-09-12T02:03:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.634+0000 7fa77da37640 1 -- start start 2024-09-12T02:03:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.634+0000 7fa77da37640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa778145e00 0x7fa7780cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.634+0000 7fa77da37640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7780d0be0 0x7fa7780afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.634+0000 7fa77da37640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7780af720 con 0x7fa77815d460 2024-09-12T02:03:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.634+0000 7fa77da37640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa7781461e0 con 0x7fa778145e00 2024-09-12T02:03:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.634+0000 7fa77da37640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa77815d8f0 con 0x7fa7780d0be0 2024-09-12T02:03:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.635+0000 7fa776ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa778145e00 0x7fa7780cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.635+0000 7fa776ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa778145e00 0x7fa7780cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44030/0 (socket says 172.21.15.19:44030) 2024-09-12T02:03:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.635+0000 7fa7767fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa77815d460 0x7fa7780d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44194/0 (socket says 172.21.15.19:44194) 2024-09-12T02:03:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.635+0000 7fa776ffd640 1 -- 172.21.15.19:0/4291646973 learned_addr learned my addr 172.21.15.19:0/4291646973 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.635+0000 7fa7777fe640 1 --2- 172.21.15.19:0/4291646973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7780d0be0 0x7fa7780afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.635+0000 7fa776ffd640 1 -- 172.21.15.19:0/4291646973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7780d0be0 msgr2=0x7fa7780afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.635+0000 7fa776ffd640 1 --2- 172.21.15.19:0/4291646973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7780d0be0 0x7fa7780afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.635+0000 7fa776ffd640 1 -- 172.21.15.19:0/4291646973 >> v1:172.21.15.19:6789/0 conn(0x7fa77815d460 legacy=0x7fa7780d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.635+0000 7fa775ffb640 1 -- 172.21.15.19:0/4291646973 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3320889740 0 0) 0x7fa7780af720 con 0x7fa77815d460 2024-09-12T02:03:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.635+0000 7fa776ffd640 1 -- 172.21.15.19:0/4291646973 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7780cdf90 con 0x7fa778145e00 2024-09-12T02:03:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.636+0000 7fa776ffd640 1 --2- 172.21.15.19:0/4291646973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa778145e00 0x7fa7780cd8a0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fa768009870 tx=0x7fa76802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a078bb082cecb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.636+0000 7fa775ffb640 1 -- 172.21.15.19:0/4291646973 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa768037070 con 0x7fa778145e00 2024-09-12T02:03:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.636+0000 7fa775ffb640 1 -- 172.21.15.19:0/4291646973 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa768032440 con 0x7fa778145e00 2024-09-12T02:03:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.636+0000 7fa775ffb640 1 -- 172.21.15.19:0/4291646973 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa768032810 con 0x7fa778145e00 2024-09-12T02:03:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.636+0000 7fa77da37640 1 -- 172.21.15.19:0/4291646973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa778145e00 msgr2=0x7fa7780cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.636+0000 7fa77da37640 1 --2- 172.21.15.19:0/4291646973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa778145e00 0x7fa7780cd8a0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fa768009870 tx=0x7fa76802a270 comp rx=0 tx=0).stop 2024-09-12T02:03:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.636+0000 7fa77da37640 1 -- 172.21.15.19:0/4291646973 shutdown_connections 2024-09-12T02:03:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.636+0000 7fa77da37640 1 --2- 172.21.15.19:0/4291646973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7780d0be0 0x7fa7780afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.636+0000 7fa77da37640 1 --2- 172.21.15.19:0/4291646973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa778145e00 0x7fa7780cd8a0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.636+0000 7fa77da37640 1 -- 172.21.15.19:0/4291646973 >> 172.21.15.19:0/4291646973 conn(0x7fa7780b2f40 msgr2=0x7fa7780b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:21.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.636+0000 7fa77da37640 1 -- 172.21.15.19:0/4291646973 shutdown_connections 2024-09-12T02:03:21.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.636+0000 7fa77da37640 1 -- 172.21.15.19:0/4291646973 wait complete. 2024-09-12T02:03:21.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.638+0000 7fa77da37640 1 Processor -- start 2024-09-12T02:03:21.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.638+0000 7fa77da37640 1 -- start start 2024-09-12T02:03:21.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.638+0000 7fa77da37640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7780d0be0 0x7fa778158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:21.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.638+0000 7fa77da37640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa778145e00 0x7fa778140850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:21.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.638+0000 7fa77da37640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa77815d460 0x7fa778159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:21.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.638+0000 7fa77da37640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa7780ce830 con 0x7fa778145e00 2024-09-12T02:03:21.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.638+0000 7fa77da37640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa7780ce550 con 0x7fa77815d460 2024-09-12T02:03:21.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.638+0000 7fa77da37640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa7780cede0 con 0x7fa7780d0be0 2024-09-12T02:03:21.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.639+0000 7fa7767fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa778145e00 0x7fa778140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:21.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.639+0000 7fa7767fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa778145e00 0x7fa778140850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44038/0 (socket says 172.21.15.19:44038) 2024-09-12T02:03:21.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.639+0000 7fa7767fc640 1 -- 172.21.15.19:0/959762482 learned_addr learned my addr 172.21.15.19:0/959762482 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:21.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.639+0000 7fa776ffd640 1 --2- 172.21.15.19:0/959762482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7780d0be0 0x7fa778158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:21.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.639+0000 7fa7777fe640 1 --2- 172.21.15.19:0/959762482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa77815d460 0x7fa778159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:21.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.639+0000 7fa7767fc640 1 -- 172.21.15.19:0/959762482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7780d0be0 msgr2=0x7fa778158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:21.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.639+0000 7fa7767fc640 1 --2- 172.21.15.19:0/959762482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7780d0be0 0x7fa778158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.639+0000 7fa7767fc640 1 -- 172.21.15.19:0/959762482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa77815d460 msgr2=0x7fa778159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:21.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.639+0000 7fa7767fc640 1 --2- 172.21.15.19:0/959762482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa77815d460 0x7fa778159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.639+0000 7fa7767fc640 1 -- 172.21.15.19:0/959762482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77813fa90 con 0x7fa778145e00 2024-09-12T02:03:21.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.639+0000 7fa7767fc640 1 --2- 172.21.15.19:0/959762482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa778145e00 0x7fa778140850 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00c4e0 tx=0x7fa76c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:21.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.639+0000 7fa75ffff640 1 -- 172.21.15.19:0/959762482 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c018070 con 0x7fa778145e00 2024-09-12T02:03:21.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.639+0000 7fa75ffff640 1 -- 172.21.15.19:0/959762482 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa76c0074c0 con 0x7fa778145e00 2024-09-12T02:03:21.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.639+0000 7fa77da37640 1 -- 172.21.15.19:0/959762482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa77813fd70 con 0x7fa778145e00 2024-09-12T02:03:21.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.639+0000 7fa75ffff640 1 -- 172.21.15.19:0/959762482 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c004a20 con 0x7fa778145e00 2024-09-12T02:03:21.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.639+0000 7fa77da37640 1 -- 172.21.15.19:0/959762482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa778140330 con 0x7fa778145e00 2024-09-12T02:03:21.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.640+0000 7fa77da37640 1 -- 172.21.15.19:0/959762482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7780cd8a0 con 0x7fa778145e00 2024-09-12T02:03:21.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.641+0000 7fa75ffff640 1 -- 172.21.15.19:0/959762482 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa76c01b070 con 0x7fa778145e00 2024-09-12T02:03:21.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.642+0000 7fa75ffff640 1 --2- 172.21.15.19:0/959762482 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa76406be30 0x7fa76406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:21.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.642+0000 7fa75ffff640 1 -- 172.21.15.19:0/959762482 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6819+0+0 (secure 0 0 0) 0x7fa76c08a570 con 0x7fa778145e00 2024-09-12T02:03:21.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.642+0000 7fa776ffd640 1 --2- 172.21.15.19:0/959762482 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa76406be30 0x7fa76406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:21.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.642+0000 7fa776ffd640 1 --2- 172.21.15.19:0/959762482 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa76406be30 0x7fa76406e2f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa768034000 tx=0x7fa76802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:21.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.646+0000 7fa75ffff640 1 -- 172.21.15.19:0/959762482 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa76c0585c0 con 0x7fa778145e00 2024-09-12T02:03:21.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.832+0000 7fa77da37640 1 -- 172.21.15.19:0/959762482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa7780cf8f0 con 0x7fa778145e00 2024-09-12T02:03:21.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.833+0000 7fa75ffff640 1 -- 172.21.15.19:0/959762482 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 14 entries v101) ==== 81+0+856 (secure 0 0 0) 0x7fa76c05c8c0 con 0x7fa778145e00 2024-09-12T02:03:21.833 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:03:21.833 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/1101861733 2024-09-13T02:02:54.487980+0000 2024-09-12T02:03:21.834 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:03:21.834 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/2072535494 2024-09-13T02:02:44.440900+0000 2024-09-12T02:03:21.834 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/2072535494 2024-09-13T02:02:44.440900+0000 2024-09-12T02:03:21.834 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/613869354 2024-09-13T02:02:39.104650+0000 2024-09-12T02:03:21.834 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3136344951 2024-09-13T02:02:58.521234+0000 2024-09-12T02:03:21.834 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/4287312235 2024-09-13T02:03:11.277301+0000 2024-09-12T02:03:21.834 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/613869354 2024-09-13T02:02:39.104650+0000 2024-09-12T02:03:21.834 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/650556594 2024-09-13T02:02:50.470816+0000 2024-09-12T02:03:21.834 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/4287312235 2024-09-13T02:03:11.277301+0000 2024-09-12T02:03:21.834 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/650556594 2024-09-13T02:02:50.470816+0000 2024-09-12T02:03:21.834 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/1101861733 2024-09-13T02:02:54.487980+0000 2024-09-12T02:03:21.834 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3136344951 2024-09-13T02:02:58.521234+0000 2024-09-12T02:03:21.835 INFO:teuthology.orchestra.run.smithi019.stderr:listed 14 entries 2024-09-12T02:03:21.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.835+0000 7fa77da37640 1 -- 172.21.15.19:0/959762482 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa76406be30 msgr2=0x7fa76406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:21.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.835+0000 7fa77da37640 1 --2- 172.21.15.19:0/959762482 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa76406be30 0x7fa76406e2f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa768034000 tx=0x7fa76802e000 comp rx=0 tx=0).stop 2024-09-12T02:03:21.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.835+0000 7fa77da37640 1 -- 172.21.15.19:0/959762482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa778145e00 msgr2=0x7fa778140850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:21.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.835+0000 7fa77da37640 1 --2- 172.21.15.19:0/959762482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa778145e00 0x7fa778140850 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00c4e0 tx=0x7fa76c00c9a0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.835+0000 7fa77da37640 1 -- 172.21.15.19:0/959762482 shutdown_connections 2024-09-12T02:03:21.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.835+0000 7fa77da37640 1 --2- 172.21.15.19:0/959762482 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa76406be30 0x7fa76406e2f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.835+0000 7fa77da37640 1 --2- 172.21.15.19:0/959762482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa77815d460 0x7fa778159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.835+0000 7fa77da37640 1 --2- 172.21.15.19:0/959762482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa778145e00 0x7fa778140850 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.835+0000 7fa77da37640 1 --2- 172.21.15.19:0/959762482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7780d0be0 0x7fa778158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.835+0000 7fa77da37640 1 -- 172.21.15.19:0/959762482 >> 172.21.15.19:0/959762482 conn(0x7fa7780b2f40 msgr2=0x7fa7780b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:21.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.835+0000 7fa77da37640 1 -- 172.21.15.19:0/959762482 shutdown_connections 2024-09-12T02:03:21.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:21.835+0000 7fa77da37640 1 -- 172.21.15.19:0/959762482 wait complete. 2024-09-12T02:03:21.846 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:03:21.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:21.846 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-12T02:03:21.889 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:03:21.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:21.889 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:03:21.946 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:03:22.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.089+0000 7f95ba042640 1 Processor -- start 2024-09-12T02:03:22.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.089+0000 7f95ba042640 1 -- start start 2024-09-12T02:03:22.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95ba042640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95b40d1540 0x7f95b406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:22.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95ba042640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b40d1940 con 0x7f95b415e740 2024-09-12T02:03:22.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95ba042640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b409bae0 con 0x7f95b409b690 2024-09-12T02:03:22.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95ba042640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f95b415eb20 con 0x7f95b40d1540 2024-09-12T02:03:22.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b37fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f95b415e740 0x7f95b406d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44208/0 (socket says 172.21.15.19:44208) 2024-09-12T02:03:22.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b37fe640 1 -- 172.21.15.19:0/1116857455 learned_addr learned my addr 172.21.15.19:0/1116857455 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:22.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b27fc640 1 -- 172.21.15.19:0/1116857455 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 977205150 0 0) 0x7f95b40d1940 con 0x7f95b415e740 2024-09-12T02:03:22.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b27fc640 1 -- 172.21.15.19:0/1116857455 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f959c003520 con 0x7f95b415e740 2024-09-12T02:03:22.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b2ffd640 1 --2- 172.21.15.19:0/1116857455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95b40d1540 0x7f95b406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:22.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b27fc640 1 -- 172.21.15.19:0/1116857455 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3798639250 0 0) 0x7f959c003520 con 0x7f95b415e740 2024-09-12T02:03:22.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b27fc640 1 -- 172.21.15.19:0/1116857455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95b40d1540 msgr2=0x7f95b406dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:22.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b27fc640 1 --2- 172.21.15.19:0/1116857455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95b40d1540 0x7f95b406dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:22.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b27fc640 1 -- 172.21.15.19:0/1116857455 >> v1:172.21.15.135:6789/0 conn(0x7f95b409b690 legacy=0x7f95b4070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:22.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b27fc640 1 -- 172.21.15.19:0/1116857455 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b40d0780 con 0x7f95b415e740 2024-09-12T02:03:22.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b27fc640 1 -- 172.21.15.19:0/1116857455 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f95a4001670 con 0x7f95b415e740 2024-09-12T02:03:22.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b27fc640 1 -- 172.21.15.19:0/1116857455 >> v1:172.21.15.19:6789/0 conn(0x7f95b415e740 legacy=0x7f95b406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:22.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b27fc640 1 --2- 172.21.15.19:0/1116857455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f959c0039e0 0x7f959c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:22.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b27fc640 1 --2- 172.21.15.19:0/1116857455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f959c004800 0x7f959c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:22.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b27fc640 1 --2- 172.21.15.19:0/1116857455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95b40d1540 0x7f959c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:22.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b27fc640 1 -- 172.21.15.19:0/1116857455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f95b415eb20 con 0x7f959c0039e0 2024-09-12T02:03:22.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b27fc640 1 -- 172.21.15.19:0/1116857455 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f959c00bb30 con 0x7f959c004800 2024-09-12T02:03:22.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b27fc640 1 -- 172.21.15.19:0/1116857455 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f959c00bd30 con 0x7f95b40d1540 2024-09-12T02:03:22.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.090+0000 7f95b37fe640 1 --2- 172.21.15.19:0/1116857455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f959c0039e0 0x7f959c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:22.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.091+0000 7f95b3fff640 1 --2- 172.21.15.19:0/1116857455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95b40d1540 0x7f959c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:22.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.091+0000 7f95b2ffd640 1 --2- 172.21.15.19:0/1116857455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f959c004800 0x7f959c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:22.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.091+0000 7f95b37fe640 1 -- 172.21.15.19:0/1116857455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95b40d1540 msgr2=0x7f959c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:22.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.091+0000 7f95b37fe640 1 --2- 172.21.15.19:0/1116857455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95b40d1540 0x7f959c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:22.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.091+0000 7f95b37fe640 1 -- 172.21.15.19:0/1116857455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f959c004800 msgr2=0x7f959c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:22.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.091+0000 7f95b37fe640 1 --2- 172.21.15.19:0/1116857455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f959c004800 0x7f959c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:22.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.091+0000 7f95b37fe640 1 -- 172.21.15.19:0/1116857455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c003520 con 0x7f959c0039e0 2024-09-12T02:03:22.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.092+0000 7f95b37fe640 1 --2- 172.21.15.19:0/1116857455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f959c0039e0 0x7f959c003e00 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f95a4001eb0 tx=0x7f959c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469956fb5fd6e491 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:22.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.092+0000 7f95b27fc640 1 -- 172.21.15.19:0/1116857455 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4007d30 con 0x7f959c0039e0 2024-09-12T02:03:22.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.092+0000 7f95b27fc640 1 -- 172.21.15.19:0/1116857455 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a4005af0 con 0x7f959c0039e0 2024-09-12T02:03:22.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.092+0000 7f95b27fc640 1 -- 172.21.15.19:0/1116857455 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4007070 con 0x7f959c0039e0 2024-09-12T02:03:22.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.092+0000 7f95ba042640 1 -- 172.21.15.19:0/1116857455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f959c0039e0 msgr2=0x7f959c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:22.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.092+0000 7f95ba042640 1 --2- 172.21.15.19:0/1116857455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f959c0039e0 0x7f959c003e00 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f95a4001eb0 tx=0x7f959c005830 comp rx=0 tx=0).stop 2024-09-12T02:03:22.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.092+0000 7f95b3fff640 1 -- 172.21.15.19:0/1116857455 reap_dead start 2024-09-12T02:03:22.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.092+0000 7f95ba042640 1 -- 172.21.15.19:0/1116857455 shutdown_connections 2024-09-12T02:03:22.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.092+0000 7f95ba042640 1 -- 172.21.15.19:0/1116857455 >> 172.21.15.19:0/1116857455 conn(0x7f95b40d23a0 msgr2=0x7f95b40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:22.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.092+0000 7f95ba042640 1 -- 172.21.15.19:0/1116857455 shutdown_connections 2024-09-12T02:03:22.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.092+0000 7f95ba042640 1 -- 172.21.15.19:0/1116857455 wait complete. 2024-09-12T02:03:22.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.093+0000 7f95ba042640 1 Processor -- start 2024-09-12T02:03:22.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.094+0000 7f95ba042640 1 -- start start 2024-09-12T02:03:22.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.094+0000 7f95ba042640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0039e0 0x7f95b40cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:22.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.094+0000 7f95ba042640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95b41574d0 0x7f95b40b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:22.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.094+0000 7f95ba042640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95b40b11f0 0x7f95b40b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:22.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.094+0000 7f95ba042640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f95b40d1020 con 0x7f95b41574d0 2024-09-12T02:03:22.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.094+0000 7f95ba042640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f95b40d0d40 con 0x7f95b40b11f0 2024-09-12T02:03:22.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.094+0000 7f95ba042640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f95b406dbd0 con 0x7f959c0039e0 2024-09-12T02:03:22.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.095+0000 7f95b2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95b41574d0 0x7f95b40b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:22.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.095+0000 7f95b2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95b41574d0 0x7f95b40b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44064/0 (socket says 172.21.15.19:44064) 2024-09-12T02:03:22.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.095+0000 7f95b2ffd640 1 -- 172.21.15.19:0/2857767997 learned_addr learned my addr 172.21.15.19:0/2857767997 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:22.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.095+0000 7f95b37fe640 1 --2- 172.21.15.19:0/2857767997 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0039e0 0x7f95b40cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:22.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.095+0000 7f95b3fff640 1 --2- 172.21.15.19:0/2857767997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95b40b11f0 0x7f95b40b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:22.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.095+0000 7f95b2ffd640 1 -- 172.21.15.19:0/2857767997 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0039e0 msgr2=0x7f95b40cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:22.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.095+0000 7f95b2ffd640 1 --2- 172.21.15.19:0/2857767997 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0039e0 0x7f95b40cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:22.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.095+0000 7f95b2ffd640 1 -- 172.21.15.19:0/2857767997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95b40b11f0 msgr2=0x7f95b40b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:22.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.095+0000 7f95b2ffd640 1 --2- 172.21.15.19:0/2857767997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95b40b11f0 0x7f95b40b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:22.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.095+0000 7f95b2ffd640 1 -- 172.21.15.19:0/2857767997 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b40b5e40 con 0x7f95b41574d0 2024-09-12T02:03:22.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.095+0000 7f95b2ffd640 1 --2- 172.21.15.19:0/2857767997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95b41574d0 0x7f95b40b0cb0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f95a80119a0 tx=0x7f95a8011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:22.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.095+0000 7f959bfff640 1 -- 172.21.15.19:0/2857767997 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a800faf0 con 0x7f95b41574d0 2024-09-12T02:03:22.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.095+0000 7f959bfff640 1 -- 172.21.15.19:0/2857767997 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a800fc90 con 0x7f95b41574d0 2024-09-12T02:03:22.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.095+0000 7f95ba042640 1 -- 172.21.15.19:0/2857767997 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b40ca8e0 con 0x7f95b41574d0 2024-09-12T02:03:22.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.095+0000 7f959bfff640 1 -- 172.21.15.19:0/2857767997 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a8014440 con 0x7f95b41574d0 2024-09-12T02:03:22.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.095+0000 7f95ba042640 1 -- 172.21.15.19:0/2857767997 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b40caea0 con 0x7f95b41574d0 2024-09-12T02:03:22.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.096+0000 7f95ba042640 1 -- 172.21.15.19:0/2857767997 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b406df50 con 0x7f95b41574d0 2024-09-12T02:03:22.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.097+0000 7f959bfff640 1 -- 172.21.15.19:0/2857767997 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f95a8012040 con 0x7f95b41574d0 2024-09-12T02:03:22.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.097+0000 7f959bfff640 1 --2- 172.21.15.19:0/2857767997 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f95a006be60 0x7f95a006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:22.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.097+0000 7f959bfff640 1 -- 172.21.15.19:0/2857767997 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6819+0+0 (secure 0 0 0) 0x7f95a808b6b0 con 0x7f95b41574d0 2024-09-12T02:03:22.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.098+0000 7f95b37fe640 1 --2- 172.21.15.19:0/2857767997 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f95a006be60 0x7f95a006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:22.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.098+0000 7f95b37fe640 1 --2- 172.21.15.19:0/2857767997 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f95a006be60 0x7f95a006e320 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f95a4032000 tx=0x7f95a4034040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:22.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.102+0000 7f959bfff640 1 -- 172.21.15.19:0/2857767997 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95a8019030 con 0x7f95b41574d0 2024-09-12T02:03:22.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.314+0000 7f95ba042640 1 -- 172.21.15.19:0/2857767997 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f95b40b15d0 con 0x7f95b41574d0 2024-09-12T02:03:22.315 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:03:22.314+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:03:22.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.316+0000 7f959bfff640 1 -- 172.21.15.19:0/2857767997 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v125) ==== 161+0+0 (secure 0 0 0) 0x7f95a8059640 con 0x7f95b41574d0 2024-09-12T02:03:22.316 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:03:22.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.319+0000 7f95ba042640 1 -- 172.21.15.19:0/2857767997 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f95a006be60 msgr2=0x7f95a006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:22.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.319+0000 7f95ba042640 1 --2- 172.21.15.19:0/2857767997 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f95a006be60 0x7f95a006e320 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f95a4032000 tx=0x7f95a4034040 comp rx=0 tx=0).stop 2024-09-12T02:03:22.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.319+0000 7f95ba042640 1 -- 172.21.15.19:0/2857767997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95b41574d0 msgr2=0x7f95b40b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:22.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.319+0000 7f95ba042640 1 --2- 172.21.15.19:0/2857767997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95b41574d0 0x7f95b40b0cb0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f95a80119a0 tx=0x7f95a8011e60 comp rx=0 tx=0).stop 2024-09-12T02:03:22.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.319+0000 7f95ba042640 1 -- 172.21.15.19:0/2857767997 shutdown_connections 2024-09-12T02:03:22.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.319+0000 7f95ba042640 1 --2- 172.21.15.19:0/2857767997 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f95a006be60 0x7f95a006e320 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:22.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.319+0000 7f95ba042640 1 --2- 172.21.15.19:0/2857767997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95b40b11f0 0x7f95b40b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:22.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.319+0000 7f95ba042640 1 --2- 172.21.15.19:0/2857767997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95b41574d0 0x7f95b40b0cb0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:22.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.319+0000 7f95ba042640 1 --2- 172.21.15.19:0/2857767997 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0039e0 0x7f95b40cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:22.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.319+0000 7f95ba042640 1 -- 172.21.15.19:0/2857767997 >> 172.21.15.19:0/2857767997 conn(0x7f95b40d23a0 msgr2=0x7f95b40cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:22.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.319+0000 7f95ba042640 1 -- 172.21.15.19:0/2857767997 shutdown_connections 2024-09-12T02:03:22.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.319+0000 7f95ba042640 1 -- 172.21.15.19:0/2857767997 wait complete. 2024-09-12T02:03:22.322 INFO:tasks.ceph.mds.c.smithi019.stderr: -593> 2024-09-12T02:03:19.562+0000 7f60b0fa8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:03:22.331 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:03:22.346 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:03:22.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.435+0000 7f60a1a5e640 1 Processor -- start 2024-09-12T02:03:22.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.435+0000 7f60a1a5e640 1 -- start start 2024-09-12T02:03:22.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.435+0000 7f60a1a5e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f609c15ba30 0x7f609c06f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:22.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.435+0000 7f60a1a5e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f609c073050 0x7f609c0b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:22.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.435+0000 7f60a1a5e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609c0b3570 con 0x7f609c06fd50 2024-09-12T02:03:22.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.435+0000 7f60a1a5e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f609c0b4180 con 0x7f609c073050 2024-09-12T02:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.435+0000 7f60a1a5e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f609c0b3850 con 0x7f609c15ba30 2024-09-12T02:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.436+0000 7f609b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f609c073050 0x7f609c0b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.436+0000 7f609b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f609c073050 0x7f609c0b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44094/0 (socket says 172.21.15.19:44094) 2024-09-12T02:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.436+0000 7f609b7fe640 1 -- 172.21.15.19:0/880460866 learned_addr learned my addr 172.21.15.19:0/880460866 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.436+0000 7f609affd640 1 --2- 172.21.15.19:0/880460866 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f609c15ba30 0x7f609c06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.436+0000 7f609b7fe640 1 -- 172.21.15.19:0/880460866 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f609c15ba30 msgr2=0x7f609c06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.436+0000 7f609b7fe640 1 --2- 172.21.15.19:0/880460866 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f609c15ba30 0x7f609c06f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.436+0000 7f609b7fe640 1 -- 172.21.15.19:0/880460866 >> v1:172.21.15.135:6789/0 conn(0x7f609c06fd50 legacy=0x7f609c072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.436+0000 7f609b7fe640 1 -- 172.21.15.19:0/880460866 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c0b3b30 con 0x7f609c073050 2024-09-12T02:03:22.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.437+0000 7f609b7fe640 1 --2- 172.21.15.19:0/880460866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609c073050 0x7f609c0b4880 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f6094009870 tx=0x7f609402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7eece975ec20827 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:22.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.437+0000 7f6099ffb640 1 -- 172.21.15.19:0/880460866 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094037070 con 0x7f609c073050 2024-09-12T02:03:22.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.437+0000 7f6099ffb640 1 -- 172.21.15.19:0/880460866 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6094032440 con 0x7f609c073050 2024-09-12T02:03:22.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.437+0000 7f6099ffb640 1 -- 172.21.15.19:0/880460866 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094032810 con 0x7f609c073050 2024-09-12T02:03:22.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.437+0000 7f60a1a5e640 1 -- 172.21.15.19:0/880460866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609c073050 msgr2=0x7f609c0b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:22.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.437+0000 7f60a1a5e640 1 --2- 172.21.15.19:0/880460866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609c073050 0x7f609c0b4880 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f6094009870 tx=0x7f609402a270 comp rx=0 tx=0).stop 2024-09-12T02:03:22.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.437+0000 7f60a1a5e640 1 -- 172.21.15.19:0/880460866 shutdown_connections 2024-09-12T02:03:22.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.437+0000 7f60a1a5e640 1 --2- 172.21.15.19:0/880460866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609c073050 0x7f609c0b4880 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:22.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.437+0000 7f60a1a5e640 1 --2- 172.21.15.19:0/880460866 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f609c15ba30 0x7f609c06f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:22.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.437+0000 7f60a1a5e640 1 -- 172.21.15.19:0/880460866 >> 172.21.15.19:0/880460866 conn(0x7f609c067d70 msgr2=0x7f609c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:22.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.438+0000 7f60a1a5e640 1 -- 172.21.15.19:0/880460866 shutdown_connections 2024-09-12T02:03:22.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.438+0000 7f60a1a5e640 1 -- 172.21.15.19:0/880460866 wait complete. 2024-09-12T02:03:22.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.439+0000 7f60a1a5e640 1 Processor -- start 2024-09-12T02:03:22.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.439+0000 7f60a1a5e640 1 -- start start 2024-09-12T02:03:22.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.440+0000 7f60a1a5e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609c06fd50 0x7f609c15da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.440+0000 7f60a1a5e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f609c073050 0x7f609c153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.440+0000 7f60a1a5e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f609c15ba30 0x7f609c13ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.440+0000 7f60a1a5e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f609c0ccfe0 con 0x7f609c06fd50 2024-09-12T02:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.440+0000 7f60a1a5e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f609c0ce810 con 0x7f609c073050 2024-09-12T02:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.440+0000 7f60a1a5e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f609c0cd160 con 0x7f609c15ba30 2024-09-12T02:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.440+0000 7f609affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609c06fd50 0x7f609c15da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.440+0000 7f609affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609c06fd50 0x7f609c15da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44110/0 (socket says 172.21.15.19:44110) 2024-09-12T02:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.440+0000 7f609affd640 1 -- 172.21.15.19:0/1934182134 learned_addr learned my addr 172.21.15.19:0/1934182134 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.440+0000 7f609a7fc640 1 --2- 172.21.15.19:0/1934182134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f609c073050 0x7f609c153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.440+0000 7f609b7fe640 1 --2- 172.21.15.19:0/1934182134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f609c15ba30 0x7f609c13ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.440+0000 7f609affd640 1 -- 172.21.15.19:0/1934182134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f609c15ba30 msgr2=0x7f609c13ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.440+0000 7f609affd640 1 --2- 172.21.15.19:0/1934182134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f609c15ba30 0x7f609c13ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.440+0000 7f609affd640 1 -- 172.21.15.19:0/1934182134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f609c073050 msgr2=0x7f609c153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:22.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.440+0000 7f609affd640 1 --2- 172.21.15.19:0/1934182134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f609c073050 0x7f609c153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:22.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.440+0000 7f609affd640 1 -- 172.21.15.19:0/1934182134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c0afd00 con 0x7f609c06fd50 2024-09-12T02:03:22.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.440+0000 7f609affd640 1 --2- 172.21.15.19:0/1934182134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609c06fd50 0x7f609c15da00 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f608c00e870 tx=0x7f608c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:22.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.440+0000 7f6083fff640 1 -- 172.21.15.19:0/1934182134 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c017070 con 0x7f609c06fd50 2024-09-12T02:03:22.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.441+0000 7f6083fff640 1 -- 172.21.15.19:0/1934182134 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f608c00c940 con 0x7f609c06fd50 2024-09-12T02:03:22.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.441+0000 7f6083fff640 1 -- 172.21.15.19:0/1934182134 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c00cd30 con 0x7f609c06fd50 2024-09-12T02:03:22.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.441+0000 7f60a1a5e640 1 -- 172.21.15.19:0/1934182134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609c15c560 con 0x7f609c06fd50 2024-09-12T02:03:22.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.441+0000 7f60a1a5e640 1 -- 172.21.15.19:0/1934182134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f609c0affa0 con 0x7f609c06fd50 2024-09-12T02:03:22.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.442+0000 7f60a1a5e640 1 -- 172.21.15.19:0/1934182134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f609c06f810 con 0x7f609c06fd50 2024-09-12T02:03:22.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.442+0000 7f6083fff640 1 -- 172.21.15.19:0/1934182134 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f608c01a070 con 0x7f609c06fd50 2024-09-12T02:03:22.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.442+0000 7f6083fff640 1 --2- 172.21.15.19:0/1934182134 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f608806be30 0x7f608806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:22.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.443+0000 7f6083fff640 1 -- 172.21.15.19:0/1934182134 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6905+0+0 (secure 0 0 0) 0x7f608c08b1a0 con 0x7f609c06fd50 2024-09-12T02:03:22.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.443+0000 7f609a7fc640 1 --2- 172.21.15.19:0/1934182134 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f608806be30 0x7f608806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:22.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.443+0000 7f609a7fc640 1 --2- 172.21.15.19:0/1934182134 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f608806be30 0x7f608806e2f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f609c154660 tx=0x7f6090009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:22.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.447+0000 7f6083fff640 1 -- 172.21.15.19:0/1934182134 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f608c058fc0 con 0x7f609c06fd50 2024-09-12T02:03:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:22.691+0000 7f60a1a5e640 1 -- 172.21.15.19:0/1934182134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f609c06fa80 con 0x7f609c06fd50 2024-09-12T02:03:23.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.317+0000 7f6083fff640 1 -- 172.21.15.19:0/1934182134 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v126) ==== 107+0+0 (secure 0 0 0) 0x7f608c05d2c0 con 0x7f609c06fd50 2024-09-12T02:03:23.318 INFO:teuthology.orchestra.run.smithi019.stderr:nothing to do: rank is not damaged 2024-09-12T02:03:23.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.320+0000 7f60a1a5e640 1 -- 172.21.15.19:0/1934182134 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f608806be30 msgr2=0x7f608806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.320+0000 7f60a1a5e640 1 --2- 172.21.15.19:0/1934182134 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f608806be30 0x7f608806e2f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f609c154660 tx=0x7f6090009040 comp rx=0 tx=0).stop 2024-09-12T02:03:23.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.320+0000 7f60a1a5e640 1 -- 172.21.15.19:0/1934182134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609c06fd50 msgr2=0x7f609c15da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.320+0000 7f60a1a5e640 1 --2- 172.21.15.19:0/1934182134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609c06fd50 0x7f609c15da00 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f608c00e870 tx=0x7f608c00ed30 comp rx=0 tx=0).stop 2024-09-12T02:03:23.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.320+0000 7f60a1a5e640 1 -- 172.21.15.19:0/1934182134 shutdown_connections 2024-09-12T02:03:23.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.320+0000 7f60a1a5e640 1 --2- 172.21.15.19:0/1934182134 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f608806be30 0x7f608806e2f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.320+0000 7f60a1a5e640 1 --2- 172.21.15.19:0/1934182134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f609c15ba30 0x7f609c13ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.320+0000 7f60a1a5e640 1 --2- 172.21.15.19:0/1934182134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f609c073050 0x7f609c153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.320+0000 7f60a1a5e640 1 --2- 172.21.15.19:0/1934182134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609c06fd50 0x7f609c15da00 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.320+0000 7f60a1a5e640 1 -- 172.21.15.19:0/1934182134 >> 172.21.15.19:0/1934182134 conn(0x7f609c067d70 msgr2=0x7f609c159b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:23.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.320+0000 7f60a1a5e640 1 -- 172.21.15.19:0/1934182134 shutdown_connections 2024-09-12T02:03:23.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.320+0000 7f60a1a5e640 1 -- 172.21.15.19:0/1934182134 wait complete. 2024-09-12T02:03:23.335 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:03:23.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.423+0000 7fa4d5691f40 1 Processor -- start 2024-09-12T02:03:23.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.423+0000 7fa4d5691f40 1 -- start start 2024-09-12T02:03:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.424+0000 7fa4d5691f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b8b95ea30 0x562b8b940000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.424+0000 7fa4d5691f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562b8b940540 0x562b8b885e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.424+0000 7fa4d5691f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b8b886350 0x562b8b93e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.424+0000 7fa4d5691f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562b8b886ae0 con 0x562b8b886350 2024-09-12T02:03:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.424+0000 7fa4d5691f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562b8b7d9510 con 0x562b8b95ea30 2024-09-12T02:03:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.424+0000 7fa4d5691f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562b8b886dc0 con 0x562b8b940540 2024-09-12T02:03:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.424+0000 7fa4d3988640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b8b886350 0x562b8b93e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.424+0000 7fa4d3988640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b8b886350 0x562b8b93e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44136/0 (socket says 172.21.15.19:44136) 2024-09-12T02:03:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.424+0000 7fa4d3988640 1 -- 172.21.15.19:0/2733241842 learned_addr learned my addr 172.21.15.19:0/2733241842 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.424+0000 7fa4d3187640 1 --2- 172.21.15.19:0/2733241842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b8b95ea30 0x562b8b940000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.424+0000 7fa4d2986640 1 --2- 172.21.15.19:0/2733241842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562b8b940540 0x562b8b885e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.424+0000 7fa4d3988640 1 -- 172.21.15.19:0/2733241842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562b8b940540 msgr2=0x562b8b885e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.424+0000 7fa4d3988640 1 --2- 172.21.15.19:0/2733241842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562b8b940540 0x562b8b885e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.425+0000 7fa4d3988640 1 -- 172.21.15.19:0/2733241842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b8b95ea30 msgr2=0x562b8b940000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.425+0000 7fa4d3988640 1 --2- 172.21.15.19:0/2733241842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b8b95ea30 0x562b8b940000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.425+0000 7fa4d3988640 1 -- 172.21.15.19:0/2733241842 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b8b8cc7a0 con 0x562b8b886350 2024-09-12T02:03:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.425+0000 7fa4d3988640 1 --2- 172.21.15.19:0/2733241842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b8b886350 0x562b8b93e8a0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc046160 tx=0x7fa4cc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9044c754e5e47d19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.425+0000 7fa4d1984640 1 -- 172.21.15.19:0/2733241842 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc04f860 con 0x562b8b886350 2024-09-12T02:03:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.425+0000 7fa4d1984640 1 -- 172.21.15.19:0/2733241842 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4cc04fa00 con 0x562b8b886350 2024-09-12T02:03:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.425+0000 7fa4d1984640 1 -- 172.21.15.19:0/2733241842 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc04fdf0 con 0x562b8b886350 2024-09-12T02:03:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.425+0000 7fa4d5691f40 1 -- 172.21.15.19:0/2733241842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b8b886350 msgr2=0x562b8b93e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.425+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/2733241842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b8b886350 0x562b8b93e8a0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc046160 tx=0x7fa4cc051000 comp rx=0 tx=0).stop 2024-09-12T02:03:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.425+0000 7fa4d5691f40 1 -- 172.21.15.19:0/2733241842 shutdown_connections 2024-09-12T02:03:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.425+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/2733241842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b8b886350 0x562b8b93e8a0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.425+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/2733241842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562b8b940540 0x562b8b885e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.425+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/2733241842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b8b95ea30 0x562b8b940000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.425+0000 7fa4d5691f40 1 -- 172.21.15.19:0/2733241842 >> 172.21.15.19:0/2733241842 conn(0x562b8b8879e0 msgr2=0x562b8b8b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.426+0000 7fa4d5691f40 1 -- 172.21.15.19:0/2733241842 shutdown_connections 2024-09-12T02:03:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.426+0000 7fa4d5691f40 1 -- 172.21.15.19:0/2733241842 wait complete. 2024-09-12T02:03:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.426+0000 7fa4d5691f40 1 Processor -- start 2024-09-12T02:03:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.426+0000 7fa4d5691f40 1 -- start start 2024-09-12T02:03:23.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.427+0000 7fa4d5691f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b8b886350 0x562b8b941340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.427+0000 7fa4d5691f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b8b940540 0x562b8b942860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.427+0000 7fa4d5691f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562b8b95ea30 0x562b8b95b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.427+0000 7fa4d5691f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562b8b93fbe0 con 0x562b8b886350 2024-09-12T02:03:23.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.427+0000 7fa4d5691f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562b8b962050 con 0x562b8b940540 2024-09-12T02:03:23.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.427+0000 7fa4d5691f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562b8b961a90 con 0x562b8b95ea30 2024-09-12T02:03:23.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.427+0000 7fa4d3187640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b8b886350 0x562b8b941340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.427+0000 7fa4d3187640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b8b886350 0x562b8b941340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44140/0 (socket says 172.21.15.19:44140) 2024-09-12T02:03:23.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.427+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 learned_addr learned my addr 172.21.15.19:0/1314943012 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:23.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.427+0000 7fa4d2986640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b8b940540 0x562b8b942860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.427+0000 7fa4d3988640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562b8b95ea30 0x562b8b95b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.427+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562b8b95ea30 msgr2=0x562b8b95b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.427+0000 7fa4d3187640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562b8b95ea30 0x562b8b95b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.427+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b8b940540 msgr2=0x562b8b942860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.427+0000 7fa4d3187640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b8b940540 0x562b8b942860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.427+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b8b8b7a80 con 0x562b8b886350 2024-09-12T02:03:23.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.428+0000 7fa4d3187640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b8b886350 0x562b8b941340 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40116c0 tx=0x7fa4c4011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.428+0000 7fa4d0982640 1 -- 172.21.15.19:0/1314943012 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4018030 con 0x562b8b886350 2024-09-12T02:03:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.428+0000 7fa4d0982640 1 -- 172.21.15.19:0/1314943012 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c400f790 con 0x562b8b886350 2024-09-12T02:03:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.428+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b8b95c6e0 con 0x562b8b886350 2024-09-12T02:03:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.428+0000 7fa4d0982640 1 -- 172.21.15.19:0/1314943012 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c400f960 con 0x562b8b886350 2024-09-12T02:03:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.428+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b8b95cca0 con 0x562b8b886350 2024-09-12T02:03:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.429+0000 7fa4d0982640 1 -- 172.21.15.19:0/1314943012 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4c401b030 con 0x562b8b886350 2024-09-12T02:03:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.430+0000 7fa4d0982640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa4c006a810 0x7fa4c006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.430+0000 7fa4d0982640 1 -- 172.21.15.19:0/1314943012 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6905+0+0 (secure 0 0 0) 0x7fa4c4089eb0 con 0x562b8b886350 2024-09-12T02:03:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.430+0000 7fa4d2986640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa4c006a810 0x7fa4c006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.433 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:03:23.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.430+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562b8b942da0 0x562b8b95c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.430+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8b95d1a0 con 0x562b8b942da0 2024-09-12T02:03:23.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.430+0000 7fa4d3988640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562b8b942da0 0x562b8b95c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.431+0000 7fa4d2986640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa4c006a810 0x7fa4c006ccd0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8003130 tx=0x7fa4c80014b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:23.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.431+0000 7fa4d3988640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562b8b942da0 0x562b8b95c080 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:23.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.432+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v102'226 uv200 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.432+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8b95d5d0 con 0x562b8b942da0 2024-09-12T02:03:23.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.433+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v102'227 uv227 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.433+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8b95da30 con 0x562b8b942da0 2024-09-12T02:03:23.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.434+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v102'228 uv228 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.436 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:03:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.434+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8b95ddd0 con 0x562b8b942da0 2024-09-12T02:03:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.435+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v102'229 uv229 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.435+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba03c20 con 0x562b8b942da0 2024-09-12T02:03:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.436+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v102'230 uv230 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.436+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba02c10 con 0x562b8b942da0 2024-09-12T02:03:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.438+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v102'231 uv231 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.438+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba02fb0 con 0x562b8b942da0 2024-09-12T02:03:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.439+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v102'232 uv206 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.439+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba03350 con 0x562b8b942da0 2024-09-12T02:03:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.440+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v102'233 uv233 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.440+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba03350 con 0x562b8b942da0 2024-09-12T02:03:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.441+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v102'234 uv234 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.441 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:03:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.441+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba03350 con 0x562b8b942da0 2024-09-12T02:03:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.442+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v102'235 uv235 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.442+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba03350 con 0x562b8b942da0 2024-09-12T02:03:23.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.445+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v102'236 uv236 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.445+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba03350 con 0x562b8b942da0 2024-09-12T02:03:23.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.446+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v102'237 uv237 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.446+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba03350 con 0x562b8b942da0 2024-09-12T02:03:23.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.449+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v102'238 uv213 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.449+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba03350 con 0x562b8b942da0 2024-09-12T02:03:23.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.450+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v102'239 uv239 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.450+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba03350 con 0x562b8b942da0 2024-09-12T02:03:23.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.452+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v102'240 uv240 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.452 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:03:23.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.452+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba03350 con 0x562b8b942da0 2024-09-12T02:03:23.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.455+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v102'241 uv241 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.455+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba03350 con 0x562b8b942da0 2024-09-12T02:03:23.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.456+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v102'242 uv242 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.456+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba03350 con 0x562b8b942da0 2024-09-12T02:03:23.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.459+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v102'243 uv243 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.459+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba03780 con 0x562b8b942da0 2024-09-12T02:03:23.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.462+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v102'244 uv244 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.462+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8b93c8f0 con 0x562b8b942da0 2024-09-12T02:03:23.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.465+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v102'245 uv219 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.465+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8b93c8f0 con 0x562b8b942da0 2024-09-12T02:03:23.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.466+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v102'246 uv246 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.466+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8b93c8f0 con 0x562b8b942da0 2024-09-12T02:03:23.467 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:03:23.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.467+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v102'247 uv247 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.467+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8b93c8f0 con 0x562b8b942da0 2024-09-12T02:03:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.468+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v102'248 uv248 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.468+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8b93c8f0 con 0x562b8b942da0 2024-09-12T02:03:23.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.469+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v102'249 uv249 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.469+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8b93c8f0 con 0x562b8b942da0 2024-09-12T02:03:23.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.470+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v102'250 uv250 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.470+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8b93c8f0 con 0x562b8b942da0 2024-09-12T02:03:23.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.471+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v102'251 uv225 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.471+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8b93c8f0 con 0x562b8b942da0 2024-09-12T02:03:23.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.472+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v102'252 uv252 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.472+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8b93c8f0 con 0x562b8b942da0 2024-09-12T02:03:23.473 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:03:23.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.473+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v102'253 uv253 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.473+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8b93c8f0 con 0x562b8b942da0 2024-09-12T02:03:23.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.474+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v102'254 uv254 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.474+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8b93c8f0 con 0x562b8b942da0 2024-09-12T02:03:23.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.475+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v102'255 uv255 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.475+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8b93c8f0 con 0x562b8b942da0 2024-09-12T02:03:23.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.476+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v102'256 uv256 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8b942da0 2024-09-12T02:03:23.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.476+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562b8ba044d0 0x562b8ba068c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.476+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba06e00 con 0x562b8ba044d0 2024-09-12T02:03:23.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.476+0000 7fa4d3187640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562b8ba044d0 0x562b8ba068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.476+0000 7fa4d3187640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562b8ba044d0 0x562b8ba068c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:23.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.478+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v102'178 uv157 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.478+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba071a0 con 0x562b8ba044d0 2024-09-12T02:03:23.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.479+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v102'179 uv179 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.479+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba07540 con 0x562b8ba044d0 2024-09-12T02:03:23.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.480+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v102'180 uv180 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.480 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:03:23.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.480+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba07d90 con 0x562b8ba044d0 2024-09-12T02:03:23.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.481+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v102'181 uv181 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.481+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba08130 con 0x562b8ba044d0 2024-09-12T02:03:23.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.482+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v102'182 uv182 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.482+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba084d0 con 0x562b8ba044d0 2024-09-12T02:03:23.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.483+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v102'183 uv176 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.483+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba08870 con 0x562b8ba044d0 2024-09-12T02:03:23.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.484+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v102'184 uv184 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.484+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba08c10 con 0x562b8ba044d0 2024-09-12T02:03:23.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.485+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v102'185 uv185 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.486 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:03:23.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.485+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba08c10 con 0x562b8ba044d0 2024-09-12T02:03:23.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.486+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v102'186 uv186 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.486+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba08c10 con 0x562b8ba044d0 2024-09-12T02:03:23.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.487+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v102'187 uv187 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.487+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba08c10 con 0x562b8ba044d0 2024-09-12T02:03:23.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.488+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v102'188 uv177 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.488+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba08c10 con 0x562b8ba044d0 2024-09-12T02:03:23.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.489+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v102'189 uv189 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.490+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba08c10 con 0x562b8ba044d0 2024-09-12T02:03:23.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.490+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v102'190 uv190 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.491 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:03:23.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.491+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba0d090 con 0x562b8ba044d0 2024-09-12T02:03:23.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.492+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v102'191 uv191 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.492+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba0d090 con 0x562b8ba044d0 2024-09-12T02:03:23.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.493+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v102'192 uv192 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.493+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba08c10 con 0x562b8ba044d0 2024-09-12T02:03:23.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.493+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v102'193 uv173 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.493+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba08c10 con 0x562b8ba044d0 2024-09-12T02:03:23.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.495+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v102'194 uv194 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.495+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba08c10 con 0x562b8ba044d0 2024-09-12T02:03:23.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.496+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v102'195 uv195 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.496 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:03:23.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.496+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba09c20 con 0x562b8ba044d0 2024-09-12T02:03:23.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.497+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v102'196 uv196 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.497+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba09c20 con 0x562b8ba044d0 2024-09-12T02:03:23.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.498+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v102'197 uv197 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.498+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba08c10 con 0x562b8ba044d0 2024-09-12T02:03:23.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.499+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v102'198 uv198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba044d0 2024-09-12T02:03:23.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.499+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x562b8ba09120 0x562b8ba0b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.499+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba0baa0 con 0x562b8ba09120 2024-09-12T02:03:23.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.499+0000 7fa4d2986640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x562b8ba09120 0x562b8ba0b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.499+0000 7fa4d2986640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x562b8ba09120 0x562b8ba0b510 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:23.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.500+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v102'45 uv44 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.500+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba0c2f0 con 0x562b8ba09120 2024-09-12T02:03:23.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.502+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v102'46 uv46 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.502+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba0c690 con 0x562b8ba09120 2024-09-12T02:03:23.503 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:03:23.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.503+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v102'47 uv47 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.503+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba0da40 con 0x562b8ba09120 2024-09-12T02:03:23.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.504+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v102'48 uv48 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.504+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba0de80 con 0x562b8ba09120 2024-09-12T02:03:23.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.505+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v102'49 uv49 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.505+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba0ca30 con 0x562b8ba09120 2024-09-12T02:03:23.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.506+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v102'50 uv50 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.506+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x562b8ba0d4f0 0x562b8ba10280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.506+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba10870 con 0x562b8ba0d4f0 2024-09-12T02:03:23.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.506+0000 7fa4d3988640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x562b8ba0d4f0 0x562b8ba10280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.506+0000 7fa4d3988640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x562b8ba0d4f0 0x562b8ba10280 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:23.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.507+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v102'38 uv37 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.508+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba10c60 con 0x562b8ba0d4f0 2024-09-12T02:03:23.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.509+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v102'39 uv39 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.509+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba10c60 con 0x562b8ba0d4f0 2024-09-12T02:03:23.510 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:03:23.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.510+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v102'40 uv40 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.510+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba10c60 con 0x562b8ba0d4f0 2024-09-12T02:03:23.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.511+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v102'41 uv41 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.511+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562b8ba11560 0x562b8ba13950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.511+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba13e90 con 0x562b8ba11560 2024-09-12T02:03:23.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.511+0000 7fa4d3187640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562b8ba11560 0x562b8ba13950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.511+0000 7fa4d3187640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562b8ba11560 0x562b8ba13950 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:23.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.513+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v102'45 uv44 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.513+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba13e90 con 0x562b8ba11560 2024-09-12T02:03:23.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.519+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v102'46 uv46 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.519+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba11560 2024-09-12T02:03:23.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.521+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v102'47 uv47 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.521 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:03:23.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.521+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba15290 con 0x562b8ba11560 2024-09-12T02:03:23.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.525+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v102'48 uv48 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.525+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba15290 con 0x562b8ba11560 2024-09-12T02:03:23.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.528+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v102'49 uv49 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.528+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba11560 2024-09-12T02:03:23.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.530+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v102'50 uv50 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.530+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba0d4f0 2024-09-12T02:03:23.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.531+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v102'83 uv75 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.531+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba0d4f0 2024-09-12T02:03:23.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.532+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v102'84 uv84 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.532+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba0d4f0 2024-09-12T02:03:23.533 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:03:23.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.532+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v102'85 uv85 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.532+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba15290 con 0x562b8ba0d4f0 2024-09-12T02:03:23.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.534+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v102'86 uv86 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.534+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba15290 con 0x562b8ba0d4f0 2024-09-12T02:03:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.535+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v102'87 uv87 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.535+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba0d4f0 2024-09-12T02:03:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.536+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v102'88 uv88 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.536+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba0d4f0 2024-09-12T02:03:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.537+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v102'89 uv82 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.537+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba0d4f0 2024-09-12T02:03:23.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.538+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v102'90 uv90 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.538+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba0d4f0 2024-09-12T02:03:23.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.539+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v102'91 uv91 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.539 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:03:23.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.539+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba0d4f0 2024-09-12T02:03:23.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.540+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v102'92 uv92 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.540+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba0d4f0 2024-09-12T02:03:23.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.541+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v102'93 uv93 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.541+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba0d4f0 2024-09-12T02:03:23.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.542+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v102'37 uv36 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.542+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba0d4f0 2024-09-12T02:03:23.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.543+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v102'38 uv38 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.543+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba0d4f0 2024-09-12T02:03:23.546 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:03:23.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.544+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v102'39 uv39 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.544+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba0d4f0 2024-09-12T02:03:23.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.545+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v102'40 uv40 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.545+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba0d4f0 2024-09-12T02:03:23.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.546+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v102'41 uv41 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa4cc01a320 con 0x562b8ba0d4f0 2024-09-12T02:03:23.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.546+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba11560 2024-09-12T02:03:23.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.547+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v102'45 uv44 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.547+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba11560 2024-09-12T02:03:23.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.548+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v102'46 uv46 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.548+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba11560 2024-09-12T02:03:23.549 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:03:23.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.549+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v102'47 uv47 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.549+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba15290 con 0x562b8ba11560 2024-09-12T02:03:23.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.550+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v102'48 uv48 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.550+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba15290 con 0x562b8ba11560 2024-09-12T02:03:23.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.551+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v102'49 uv49 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.551+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba11560 2024-09-12T02:03:23.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.552+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v102'50 uv50 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.552+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba11560 2024-09-12T02:03:23.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.553+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v102'74 uv68 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.553+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba11560 2024-09-12T02:03:23.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.554+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v102'75 uv75 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.554+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba11560 2024-09-12T02:03:23.555 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:03:23.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.555+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v102'76 uv76 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.555+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba11560 2024-09-12T02:03:23.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.556+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v102'77 uv77 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.556+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba11560 2024-09-12T02:03:23.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.558+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v102'78 uv78 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.558+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba11560 2024-09-12T02:03:23.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.559+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v102'79 uv73 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.559+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba11560 2024-09-12T02:03:23.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.560+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v102'80 uv80 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.560+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba11560 2024-09-12T02:03:23.561 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:03:23.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.561+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v102'81 uv81 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.561+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba14280 con 0x562b8ba11560 2024-09-12T02:03:23.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.562+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v102'82 uv82 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.562+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17090 con 0x562b8ba11560 2024-09-12T02:03:23.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.563+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v102'83 uv83 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.563+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x562b8ba14db0 0x562b8ba176f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.563+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba171a0 con 0x562b8ba14db0 2024-09-12T02:03:23.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.563+0000 7fa4d2986640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x562b8ba14db0 0x562b8ba176f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.564+0000 7fa4d2986640 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x562b8ba14db0 0x562b8ba176f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:23.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.565+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v102'36 uv34 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba14db0 2024-09-12T02:03:23.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.565+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba14db0 2024-09-12T02:03:23.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.566+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v102'37 uv37 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba14db0 2024-09-12T02:03:23.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.566+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba14db0 2024-09-12T02:03:23.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.568+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v102'38 uv38 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba14db0 2024-09-12T02:03:23.569 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:03:23.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.568+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba14db0 2024-09-12T02:03:23.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.571+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v102'39 uv39 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba14db0 2024-09-12T02:03:23.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.572+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba11560 2024-09-12T02:03:23.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.573+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v102'45 uv44 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.573+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba11560 2024-09-12T02:03:23.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.574+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v102'46 uv46 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.574+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba11560 2024-09-12T02:03:23.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.575+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v102'47 uv47 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.575 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:03:23.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.575+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba18c40 con 0x562b8ba11560 2024-09-12T02:03:23.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.576+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v102'48 uv48 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.576+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba18c40 con 0x562b8ba11560 2024-09-12T02:03:23.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.576+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v102'49 uv49 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.577+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba11560 2024-09-12T02:03:23.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.578+0000 7fa4d3187640 1 -- 172.21.15.19:0/1314943012 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v102'50 uv50 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c4054460 con 0x562b8ba11560 2024-09-12T02:03:23.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.578+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba09120 2024-09-12T02:03:23.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.579+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v102'37 uv36 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.579+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba09120 2024-09-12T02:03:23.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.580+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v102'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.580+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba09120 2024-09-12T02:03:23.581 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:03:23.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.581+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v102'39 uv39 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.581+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba09120 2024-09-12T02:03:23.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.582+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v102'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.582+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba09120 2024-09-12T02:03:23.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.582+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v102'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.582+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba09120 2024-09-12T02:03:23.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.583+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v102'95 uv86 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.583+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba09120 2024-09-12T02:03:23.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.584+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v102'96 uv96 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.584+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba09120 2024-09-12T02:03:23.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.585+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v102'97 uv97 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.586 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:03:23.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.585+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba09120 2024-09-12T02:03:23.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.586+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v102'98 uv98 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.586+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba09120 2024-09-12T02:03:23.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.588+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v102'99 uv99 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.588+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba09120 2024-09-12T02:03:23.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.588+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v102'100 uv93 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.589+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba09120 2024-09-12T02:03:23.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.589+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v102'101 uv101 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.589+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba09120 2024-09-12T02:03:23.591 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:03:23.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.591+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v102'102 uv102 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.591+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba18c40 con 0x562b8ba09120 2024-09-12T02:03:23.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.592+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v102'103 uv103 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.592+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba18c40 con 0x562b8ba09120 2024-09-12T02:03:23.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.593+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v102'104 uv104 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.593+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba17c30 con 0x562b8ba09120 2024-09-12T02:03:23.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.594+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v102'105 uv105 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.594+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x562b8ba18020 con 0x562b8ba09120 2024-09-12T02:03:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.597+0000 7fa4d2986640 1 -- 172.21.15.19:0/1314943012 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v102'106 uv106 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fa4c8009040 con 0x562b8ba09120 2024-09-12T02:03:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.597+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562b8ba044d0 msgr2=0x562b8ba068c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.597+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562b8ba044d0 0x562b8ba068c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.597+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562b8b942da0 msgr2=0x562b8b95c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.597+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562b8b942da0 0x562b8b95c080 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.597+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x562b8ba0d4f0 msgr2=0x562b8ba10280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.597+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x562b8ba0d4f0 0x562b8ba10280 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.597+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x562b8ba14db0 msgr2=0x562b8ba176f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.597+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x562b8ba14db0 0x562b8ba176f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.597+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x562b8ba09120 msgr2=0x562b8ba0b510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.597+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x562b8ba09120 0x562b8ba0b510 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.597+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 reap_dead start 2024-09-12T02:03:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.597+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562b8ba11560 msgr2=0x562b8ba13950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.597+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562b8ba11560 0x562b8ba13950 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.597+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 reap_dead start 2024-09-12T02:03:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.598+0000 7fa4d3988640 1 -- 172.21.15.19:0/1314943012 reap_dead start 2024-09-12T02:03:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.598+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa4c006a810 msgr2=0x7fa4c006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.598+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa4c006a810 0x7fa4c006ccd0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8003130 tx=0x7fa4c80014b0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.598+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b8b886350 msgr2=0x562b8b941340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.598+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b8b886350 0x562b8b941340 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40116c0 tx=0x7fa4c4011ac0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.598+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 shutdown_connections 2024-09-12T02:03:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.598+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa4c006a810 0x7fa4c006ccd0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.598+0000 7fa4d5691f40 1 --2- 172.21.15.19:0/1314943012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b8b886350 0x562b8b941340 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.598+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 >> 172.21.15.19:0/1314943012 conn(0x562b8b8879e0 msgr2=0x562b8b93fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.598+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 shutdown_connections 2024-09-12T02:03:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.598+0000 7fa4d5691f40 1 -- 172.21.15.19:0/1314943012 wait complete. 2024-09-12T02:03:23.601 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds_snaptable 2024-09-12T02:03:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.684+0000 7f9924158f40 1 Processor -- start 2024-09-12T02:03:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.684+0000 7f9924158f40 1 -- start start 2024-09-12T02:03:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.685+0000 7f9924158f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5584c659d9e0 0x5584c65e6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.685+0000 7f9924158f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5584c659f460 0x5584c6670c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.685+0000 7f9924158f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584c6674fb0 0x5584c666f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.685+0000 7f9924158f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5584c659df20 con 0x5584c659f460 2024-09-12T02:03:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.685+0000 7f9924158f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5584c64ef510 con 0x5584c6674fb0 2024-09-12T02:03:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.685+0000 7f9924158f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5584c659e1c0 con 0x5584c659d9e0 2024-09-12T02:03:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.685+0000 7f991944d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5584c659f460 0x5584c6670c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.685+0000 7f991944d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5584c659f460 0x5584c6670c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44148/0 (socket says 172.21.15.19:44148) 2024-09-12T02:03:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.685+0000 7f991944d640 1 -- 172.21.15.19:0/2679662939 learned_addr learned my addr 172.21.15.19:0/2679662939 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.685+0000 7f9921c4e640 1 --2- 172.21.15.19:0/2679662939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5584c659d9e0 0x5584c65e6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.685+0000 7f992244f640 1 --2- 172.21.15.19:0/2679662939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584c6674fb0 0x5584c666f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.685+0000 7f991944d640 1 -- 172.21.15.19:0/2679662939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5584c659d9e0 msgr2=0x5584c65e6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.685+0000 7f991944d640 1 --2- 172.21.15.19:0/2679662939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5584c659d9e0 0x5584c65e6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.685+0000 7f991944d640 1 -- 172.21.15.19:0/2679662939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584c6674fb0 msgr2=0x5584c666f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.685+0000 7f991944d640 1 --2- 172.21.15.19:0/2679662939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584c6674fb0 0x5584c666f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.685+0000 7f991944d640 1 -- 172.21.15.19:0/2679662939 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584c6671190 con 0x5584c659f460 2024-09-12T02:03:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.685+0000 7f992244f640 1 --2- 172.21.15.19:0/2679662939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584c6674fb0 0x5584c666f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.686+0000 7f991944d640 1 --2- 172.21.15.19:0/2679662939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5584c659f460 0x5584c6670c50 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f990c025d20 tx=0x7f990c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed44500a8adf42a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.686+0000 7f9920c4c640 1 -- 172.21.15.19:0/2679662939 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990c068070 con 0x5584c659f460 2024-09-12T02:03:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.686+0000 7f9920c4c640 1 -- 172.21.15.19:0/2679662939 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f990c0516f0 con 0x5584c659f460 2024-09-12T02:03:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.686+0000 7f9920c4c640 1 -- 172.21.15.19:0/2679662939 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990c055070 con 0x5584c659f460 2024-09-12T02:03:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.686+0000 7f9924158f40 1 -- 172.21.15.19:0/2679662939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5584c659f460 msgr2=0x5584c6670c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.686+0000 7f9924158f40 1 --2- 172.21.15.19:0/2679662939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5584c659f460 0x5584c6670c50 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f990c025d20 tx=0x7f990c051000 comp rx=0 tx=0).stop 2024-09-12T02:03:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.686+0000 7f9924158f40 1 -- 172.21.15.19:0/2679662939 shutdown_connections 2024-09-12T02:03:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.686+0000 7f9924158f40 1 --2- 172.21.15.19:0/2679662939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584c6674fb0 0x5584c666f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.686+0000 7f9924158f40 1 --2- 172.21.15.19:0/2679662939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5584c659f460 0x5584c6670c50 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.686+0000 7f9924158f40 1 --2- 172.21.15.19:0/2679662939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5584c659d9e0 0x5584c65e6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.686+0000 7f9924158f40 1 -- 172.21.15.19:0/2679662939 >> 172.21.15.19:0/2679662939 conn(0x5584c65cb490 msgr2=0x5584c65a1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:23.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.686+0000 7f9924158f40 1 -- 172.21.15.19:0/2679662939 shutdown_connections 2024-09-12T02:03:23.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.686+0000 7f9924158f40 1 -- 172.21.15.19:0/2679662939 wait complete. 2024-09-12T02:03:23.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.687+0000 7f9924158f40 1 Processor -- start 2024-09-12T02:03:23.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.687+0000 7f9924158f40 1 -- start start 2024-09-12T02:03:23.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f9924158f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584c659d9e0 0x5584c6654ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f9924158f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5584c659f460 0x5584c670e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f9924158f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5584c6674fb0 0x5584c65a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f9924158f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5584c65e6280 con 0x5584c6674fb0 2024-09-12T02:03:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f9924158f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5584c65e8950 con 0x5584c659d9e0 2024-09-12T02:03:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f9924158f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5584c65e5fa0 con 0x5584c659f460 2024-09-12T02:03:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f992244f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5584c6674fb0 0x5584c65a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f992244f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5584c6674fb0 0x5584c65a15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44158/0 (socket says 172.21.15.19:44158) 2024-09-12T02:03:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f992244f640 1 -- 172.21.15.19:0/708499538 learned_addr learned my addr 172.21.15.19:0/708499538 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f991944d640 1 --2- 172.21.15.19:0/708499538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5584c659f460 0x5584c670e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f9921c4e640 1 --2- 172.21.15.19:0/708499538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584c659d9e0 0x5584c6654ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f992244f640 1 -- 172.21.15.19:0/708499538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5584c659f460 msgr2=0x5584c670e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f992244f640 1 --2- 172.21.15.19:0/708499538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5584c659f460 0x5584c670e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f992244f640 1 -- 172.21.15.19:0/708499538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584c659d9e0 msgr2=0x5584c6654ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f992244f640 1 --2- 172.21.15.19:0/708499538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584c659d9e0 0x5584c6654ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f992244f640 1 -- 172.21.15.19:0/708499538 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584c670e720 con 0x5584c6674fb0 2024-09-12T02:03:23.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f992244f640 1 --2- 172.21.15.19:0/708499538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5584c6674fb0 0x5584c65a15b0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f991c004ea0 tx=0x7f991c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:23.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f991b7fe640 1 -- 172.21.15.19:0/708499538 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c018070 con 0x5584c6674fb0 2024-09-12T02:03:23.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f991b7fe640 1 -- 172.21.15.19:0/708499538 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f991c0020b0 con 0x5584c6674fb0 2024-09-12T02:03:23.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f9924158f40 1 -- 172.21.15.19:0/708499538 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584c670eec0 con 0x5584c6674fb0 2024-09-12T02:03:23.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.688+0000 7f991b7fe640 1 -- 172.21.15.19:0/708499538 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c00f650 con 0x5584c6674fb0 2024-09-12T02:03:23.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.689+0000 7f9924158f40 1 -- 172.21.15.19:0/708499538 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584c670f480 con 0x5584c6674fb0 2024-09-12T02:03:23.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.690+0000 7f991b7fe640 1 -- 172.21.15.19:0/708499538 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f991c01b070 con 0x5584c6674fb0 2024-09-12T02:03:23.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.690+0000 7f991b7fe640 1 --2- 172.21.15.19:0/708499538 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f990406a810 0x7f990406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.690+0000 7f991b7fe640 1 -- 172.21.15.19:0/708499538 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6905+0+0 (secure 0 0 0) 0x7f991c0896c0 con 0x5584c6674fb0 2024-09-12T02:03:23.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.691+0000 7f9924158f40 1 --2- 172.21.15.19:0/708499538 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5584c6673c20 0x5584c6665c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.691+0000 7f9924158f40 1 -- 172.21.15.19:0/708499538 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:1 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x5584c6666160 con 0x5584c6673c20 2024-09-12T02:03:23.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.691+0000 7f9921c4e640 1 --2- 172.21.15.19:0/708499538 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f990406a810 0x7f990406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.691+0000 7f991944d640 1 --2- 172.21.15.19:0/708499538 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5584c6673c20 0x5584c6665c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.691+0000 7f991944d640 1 --2- 172.21.15.19:0/708499538 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5584c6673c20 0x5584c6665c20 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.691+0000 7f9921c4e640 1 --2- 172.21.15.19:0/708499538 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f990406a810 0x7f990406ccd0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x5584c6657d00 tx=0x7f991400e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.692+0000 7f991944d640 1 -- 172.21.15.19:0/708499538 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(1 mds_snaptable [delete] v102'42 uv42 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f990c06b040 con 0x5584c6673c20 2024-09-12T02:03:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.692+0000 7f9924158f40 1 -- 172.21.15.19:0/708499538 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5584c6673c20 msgr2=0x5584c6665c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.692+0000 7f9924158f40 1 --2- 172.21.15.19:0/708499538 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5584c6673c20 0x5584c6665c20 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.693+0000 7f9924158f40 1 -- 172.21.15.19:0/708499538 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f990406a810 msgr2=0x7f990406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.693+0000 7f9924158f40 1 --2- 172.21.15.19:0/708499538 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f990406a810 0x7f990406ccd0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x5584c6657d00 tx=0x7f991400e040 comp rx=0 tx=0).stop 2024-09-12T02:03:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.693+0000 7f9924158f40 1 -- 172.21.15.19:0/708499538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5584c6674fb0 msgr2=0x5584c65a15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.693+0000 7f9924158f40 1 --2- 172.21.15.19:0/708499538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5584c6674fb0 0x5584c65a15b0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f991c004ea0 tx=0x7f991c001a00 comp rx=0 tx=0).stop 2024-09-12T02:03:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.693+0000 7f992244f640 1 -- 172.21.15.19:0/708499538 reap_dead start 2024-09-12T02:03:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.693+0000 7f9924158f40 1 -- 172.21.15.19:0/708499538 shutdown_connections 2024-09-12T02:03:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.693+0000 7f9924158f40 1 -- 172.21.15.19:0/708499538 >> 172.21.15.19:0/708499538 conn(0x5584c65cb490 msgr2=0x5584c6669cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:23.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.693+0000 7f9924158f40 1 -- 172.21.15.19:0/708499538 shutdown_connections 2024-09-12T02:03:23.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.693+0000 7f9924158f40 1 -- 172.21.15.19:0/708499538 wait complete. 2024-09-12T02:03:23.698 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:03:23.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.843+0000 7fce82fa2640 1 Processor -- start 2024-09-12T02:03:23.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.843+0000 7fce82fa2640 1 -- start start 2024-09-12T02:03:23.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.844+0000 7fce82fa2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce7c161ac0 0x7fce7c06e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.844+0000 7fce82fa2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0b3640 0x7fce7c0d23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.844+0000 7fce82fa2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce7c0d28f0 0x7fce7c06cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.844+0000 7fce82fa2640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fce7c0ceba0 con 0x7fce7c0d28f0 2024-09-12T02:03:23.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.844+0000 7fce82fa2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fce7c06dfb0 con 0x7fce7c161ac0 2024-09-12T02:03:23.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.844+0000 7fce82fa2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fce7c0d2d40 con 0x7fce7c0b3640 2024-09-12T02:03:23.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.844+0000 7fce827a1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce7c0d28f0 0x7fce7c06cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.844+0000 7fce827a1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce7c0d28f0 0x7fce7c06cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44172/0 (socket says 172.21.15.19:44172) 2024-09-12T02:03:23.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.844+0000 7fce827a1640 1 -- 172.21.15.19:0/2770920314 learned_addr learned my addr 172.21.15.19:0/2770920314 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:23.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.844+0000 7fce8179f640 1 --2- 172.21.15.19:0/2770920314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0b3640 0x7fce7c0d23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.844+0000 7fce81fa0640 1 --2- 172.21.15.19:0/2770920314 >> v2:172.21.15.135:3300/0 conn(0x7fce7c161ac0 0x7fce7c06e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.845+0000 7fce827a1640 1 -- 172.21.15.19:0/2770920314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0b3640 msgr2=0x7fce7c0d23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:23.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.845+0000 7fce827a1640 1 --2- 172.21.15.19:0/2770920314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0b3640 0x7fce7c0d23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.845+0000 7fce827a1640 1 -- 172.21.15.19:0/2770920314 >> v2:172.21.15.135:3300/0 conn(0x7fce7c161ac0 msgr2=0x7fce7c06e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:23.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.845+0000 7fce827a1640 1 --2- 172.21.15.19:0/2770920314 >> v2:172.21.15.135:3300/0 conn(0x7fce7c161ac0 0x7fce7c06e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.845+0000 7fce827a1640 1 -- 172.21.15.19:0/2770920314 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7c0b1170 con 0x7fce7c0d28f0 2024-09-12T02:03:23.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.845+0000 7fce8179f640 1 --2- 172.21.15.19:0/2770920314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0b3640 0x7fce7c0d23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:23.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.845+0000 7fce81fa0640 1 --2- 172.21.15.19:0/2770920314 >> v2:172.21.15.135:3300/0 conn(0x7fce7c161ac0 0x7fce7c06e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:23.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.845+0000 7fce827a1640 1 --2- 172.21.15.19:0/2770920314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7c0d28f0 0x7fce7c06cd10 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fce7c08cf20 tx=0x7fce7402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953fc275c4f2fcbf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:23.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.846+0000 7fce80f9e640 1 -- 172.21.15.19:0/2770920314 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74036070 con 0x7fce7c0d28f0 2024-09-12T02:03:23.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.846+0000 7fce80f9e640 1 -- 172.21.15.19:0/2770920314 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce74031600 con 0x7fce7c0d28f0 2024-09-12T02:03:23.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.846+0000 7fce80f9e640 1 -- 172.21.15.19:0/2770920314 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce740319d0 con 0x7fce7c0d28f0 2024-09-12T02:03:23.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.846+0000 7fce82fa2640 1 -- 172.21.15.19:0/2770920314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7c0d28f0 msgr2=0x7fce7c06cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.846+0000 7fce82fa2640 1 --2- 172.21.15.19:0/2770920314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7c0d28f0 0x7fce7c06cd10 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fce7c08cf20 tx=0x7fce7402a730 comp rx=0 tx=0).stop 2024-09-12T02:03:23.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.846+0000 7fce82fa2640 1 -- 172.21.15.19:0/2770920314 shutdown_connections 2024-09-12T02:03:23.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.846+0000 7fce82fa2640 1 --2- 172.21.15.19:0/2770920314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7c0d28f0 0x7fce7c06cd10 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.846+0000 7fce82fa2640 1 --2- 172.21.15.19:0/2770920314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0b3640 0x7fce7c0d23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.846+0000 7fce82fa2640 1 --2- 172.21.15.19:0/2770920314 >> v2:172.21.15.135:3300/0 conn(0x7fce7c161ac0 0x7fce7c06e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.846+0000 7fce82fa2640 1 -- 172.21.15.19:0/2770920314 >> 172.21.15.19:0/2770920314 conn(0x7fce7c08bfc0 msgr2=0x7fce7c0d4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:23.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.846+0000 7fce82fa2640 1 -- 172.21.15.19:0/2770920314 shutdown_connections 2024-09-12T02:03:23.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.846+0000 7fce82fa2640 1 -- 172.21.15.19:0/2770920314 wait complete. 2024-09-12T02:03:23.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.847+0000 7fce82fa2640 1 Processor -- start 2024-09-12T02:03:23.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.847+0000 7fce82fa2640 1 -- start start 2024-09-12T02:03:23.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.848+0000 7fce82fa2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0b3640 0x7fce7c0b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.848+0000 7fce82fa2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c0d28f0 0x7fce7c1e93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.848+0000 7fce82fa2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7c161ac0 0x7fce7c0ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.848+0000 7fce82fa2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fce7c0b1a10 con 0x7fce7c161ac0 2024-09-12T02:03:23.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.848+0000 7fce82fa2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce7c0b1730 con 0x7fce7c0d28f0 2024-09-12T02:03:23.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.848+0000 7fce82fa2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fce7c161ea0 con 0x7fce7c0b3640 2024-09-12T02:03:23.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.848+0000 7fce827a1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7c161ac0 0x7fce7c0ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.848+0000 7fce827a1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7c161ac0 0x7fce7c0ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44186/0 (socket says 172.21.15.19:44186) 2024-09-12T02:03:23.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.848+0000 7fce827a1640 1 -- 172.21.15.19:0/2845574954 learned_addr learned my addr 172.21.15.19:0/2845574954 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:23.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.849+0000 7fce81fa0640 1 --2- 172.21.15.19:0/2845574954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0b3640 0x7fce7c0b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.849+0000 7fce8179f640 1 --2- 172.21.15.19:0/2845574954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c0d28f0 0x7fce7c1e93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.849+0000 7fce827a1640 1 -- 172.21.15.19:0/2845574954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0b3640 msgr2=0x7fce7c0b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.849+0000 7fce827a1640 1 --2- 172.21.15.19:0/2845574954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0b3640 0x7fce7c0b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.849+0000 7fce827a1640 1 -- 172.21.15.19:0/2845574954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c0d28f0 msgr2=0x7fce7c1e93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.849+0000 7fce827a1640 1 --2- 172.21.15.19:0/2845574954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c0d28f0 0x7fce7c1e93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.849+0000 7fce827a1640 1 -- 172.21.15.19:0/2845574954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7c0b44b0 con 0x7fce7c161ac0 2024-09-12T02:03:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.849+0000 7fce8179f640 1 --2- 172.21.15.19:0/2845574954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c0d28f0 0x7fce7c1e93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.849+0000 7fce827a1640 1 --2- 172.21.15.19:0/2845574954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7c161ac0 0x7fce7c0ca280 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fce74034040 tx=0x7fce74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.849+0000 7fce727fc640 1 -- 172.21.15.19:0/2845574954 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74041020 con 0x7fce7c161ac0 2024-09-12T02:03:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.849+0000 7fce727fc640 1 -- 172.21.15.19:0/2845574954 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce740077a0 con 0x7fce7c161ac0 2024-09-12T02:03:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.849+0000 7fce82fa2640 1 -- 172.21.15.19:0/2845574954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce7c0b5910 con 0x7fce7c161ac0 2024-09-12T02:03:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.849+0000 7fce727fc640 1 -- 172.21.15.19:0/2845574954 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74036040 con 0x7fce7c161ac0 2024-09-12T02:03:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.849+0000 7fce82fa2640 1 -- 172.21.15.19:0/2845574954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce7c0b5e90 con 0x7fce7c161ac0 2024-09-12T02:03:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.850+0000 7fce82fa2640 1 -- 172.21.15.19:0/2845574954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce7c0d23b0 con 0x7fce7c161ac0 2024-09-12T02:03:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.850+0000 7fce727fc640 1 -- 172.21.15.19:0/2845574954 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce74044020 con 0x7fce7c161ac0 2024-09-12T02:03:23.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.851+0000 7fce727fc640 1 --2- 172.21.15.19:0/2845574954 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce6006be60 0x7fce6006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.851+0000 7fce727fc640 1 -- 172.21.15.19:0/2845574954 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6905+0+0 (secure 0 0 0) 0x7fce740abf70 con 0x7fce7c161ac0 2024-09-12T02:03:23.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.851+0000 7fce81fa0640 1 --2- 172.21.15.19:0/2845574954 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce6006be60 0x7fce6006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.852+0000 7fce81fa0640 1 --2- 172.21.15.19:0/2845574954 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce6006be60 0x7fce6006e320 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fce78006fd0 tx=0x7fce78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:23.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:23.855+0000 7fce727fc640 1 -- 172.21.15.19:0/2845574954 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce7404b030 con 0x7fce7c161ac0 2024-09-12T02:03:24.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.067+0000 7fce82fa2640 1 -- 172.21.15.19:0/2845574954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fce7c0b2870 con 0x7fce7c161ac0 2024-09-12T02:03:24.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.625+0000 7fce727fc640 1 -- 172.21.15.19:0/2845574954 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v127) ==== 162+0+0 (secure 0 0 0) 0x7fce7c0b44b0 con 0x7fce7c161ac0 2024-09-12T02:03:24.625 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:03:24.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.628+0000 7fce82fa2640 1 -- 172.21.15.19:0/2845574954 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce6006be60 msgr2=0x7fce6006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:24.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.628+0000 7fce82fa2640 1 --2- 172.21.15.19:0/2845574954 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce6006be60 0x7fce6006e320 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fce78006fd0 tx=0x7fce78008040 comp rx=0 tx=0).stop 2024-09-12T02:03:24.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.628+0000 7fce82fa2640 1 -- 172.21.15.19:0/2845574954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7c161ac0 msgr2=0x7fce7c0ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:24.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.628+0000 7fce82fa2640 1 --2- 172.21.15.19:0/2845574954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7c161ac0 0x7fce7c0ca280 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fce74034040 tx=0x7fce74004a40 comp rx=0 tx=0).stop 2024-09-12T02:03:24.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.628+0000 7fce82fa2640 1 -- 172.21.15.19:0/2845574954 shutdown_connections 2024-09-12T02:03:24.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.628+0000 7fce82fa2640 1 --2- 172.21.15.19:0/2845574954 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce6006be60 0x7fce6006e320 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:24.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.628+0000 7fce82fa2640 1 --2- 172.21.15.19:0/2845574954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7c161ac0 0x7fce7c0ca280 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:24.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.628+0000 7fce82fa2640 1 --2- 172.21.15.19:0/2845574954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c0d28f0 0x7fce7c1e93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:24.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.628+0000 7fce82fa2640 1 --2- 172.21.15.19:0/2845574954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0b3640 0x7fce7c0b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:24.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.628+0000 7fce82fa2640 1 -- 172.21.15.19:0/2845574954 >> 172.21.15.19:0/2845574954 conn(0x7fce7c08bfc0 msgr2=0x7fce7c0cf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:24.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.628+0000 7fce82fa2640 1 -- 172.21.15.19:0/2845574954 shutdown_connections 2024-09-12T02:03:24.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.628+0000 7fce82fa2640 1 -- 172.21.15.19:0/2845574954 wait complete. 2024-09-12T02:03:24.635 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:03:24.635+0000 7fd9f37d4640 -1 mds.0.snaptable: load_2 could not read table: -2 2024-09-12T02:03:24.636 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:03:24.635+0000 7fd9f37d4640 -1 log_channel(cluster) log [ERR] : error reading table object 'mds_snaptable' -2 ((2) No such file or directory) 2024-09-12T02:03:24.636 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:03:24.636+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:03:24.636 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:03:24.636+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:03:24.644 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:24.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.751+0000 7f8cb48e4640 1 Processor -- start 2024-09-12T02:03:24.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.751+0000 7f8cb48e4640 1 -- start start 2024-09-12T02:03:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.752+0000 7f8cb48e4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8cb00b6690 0x7f8cb01691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.752+0000 7f8cb48e4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb00d3690 con 0x7f8cb015e5f0 2024-09-12T02:03:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.752+0000 7f8cb48e4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb00d3970 con 0x7f8cb00d30f0 2024-09-12T02:03:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.752+0000 7f8cb48e4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8cb006d530 con 0x7f8cb00b6690 2024-09-12T02:03:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.752+0000 7f8caed9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8cb00b6690 0x7f8cb01691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.752+0000 7f8cae59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8cb015e5f0 0x7f8cb00d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44242/0 (socket says 172.21.15.19:44242) 2024-09-12T02:03:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.752+0000 7f8cae59c640 1 -- 172.21.15.19:0/2975485367 learned_addr learned my addr 172.21.15.19:0/2975485367 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.752+0000 7f8caed9d640 1 -- 172.21.15.19:0/2975485367 >> v1:172.21.15.135:6789/0 conn(0x7f8cb00d30f0 legacy=0x7f8cb00b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.752+0000 7f8caed9d640 1 -- 172.21.15.19:0/2975485367 >> v1:172.21.15.19:6789/0 conn(0x7f8cb015e5f0 legacy=0x7f8cb00d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.752+0000 7f8caed9d640 1 -- 172.21.15.19:0/2975485367 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb006cee0 con 0x7f8cb00b6690 2024-09-12T02:03:24.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.753+0000 7f8caed9d640 1 --2- 172.21.15.19:0/2975485367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00b6690 0x7f8cb01691a0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009dc0 tx=0x7f8ca802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca25464781c83a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:24.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.753+0000 7f8cad59a640 1 -- 172.21.15.19:0/2975485367 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8007740 con 0x7f8cb00b6690 2024-09-12T02:03:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.753+0000 7f8cad59a640 1 -- 172.21.15.19:0/2975485367 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca80078e0 con 0x7f8cb00b6690 2024-09-12T02:03:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.753+0000 7f8cad59a640 1 -- 172.21.15.19:0/2975485367 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8007cb0 con 0x7f8cb00b6690 2024-09-12T02:03:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.754+0000 7f8cb48e4640 1 -- 172.21.15.19:0/2975485367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00b6690 msgr2=0x7f8cb01691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.754+0000 7f8cb48e4640 1 --2- 172.21.15.19:0/2975485367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00b6690 0x7f8cb01691a0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009dc0 tx=0x7f8ca802a730 comp rx=0 tx=0).stop 2024-09-12T02:03:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.754+0000 7f8cb48e4640 1 -- 172.21.15.19:0/2975485367 shutdown_connections 2024-09-12T02:03:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.754+0000 7f8cb48e4640 1 --2- 172.21.15.19:0/2975485367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00b6690 0x7f8cb01691a0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.754+0000 7f8cb48e4640 1 -- 172.21.15.19:0/2975485367 >> 172.21.15.19:0/2975485367 conn(0x7f8cb008bfc0 msgr2=0x7f8cb00d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.754+0000 7f8cb48e4640 1 -- 172.21.15.19:0/2975485367 shutdown_connections 2024-09-12T02:03:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.754+0000 7f8cb48e4640 1 -- 172.21.15.19:0/2975485367 wait complete. 2024-09-12T02:03:24.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.755+0000 7f8cb48e4640 1 Processor -- start 2024-09-12T02:03:24.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.755+0000 7f8cb48e4640 1 -- start start 2024-09-12T02:03:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.756+0000 7f8cb48e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00b6690 0x7f8cb0154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.756+0000 7f8cb48e4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb00d30f0 0x7f8cb00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.756+0000 7f8cb48e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cb015e5f0 0x7f8cb00cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.756+0000 7f8cb48e4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb006e9d0 con 0x7f8cb00b6690 2024-09-12T02:03:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.756+0000 7f8cb48e4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb015e9d0 con 0x7f8cb00d30f0 2024-09-12T02:03:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.756+0000 7f8cb48e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb006eb50 con 0x7f8cb015e5f0 2024-09-12T02:03:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.756+0000 7f8cae59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00b6690 0x7f8cb0154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.756+0000 7f8cae59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00b6690 0x7f8cb0154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44204/0 (socket says 172.21.15.19:44204) 2024-09-12T02:03:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.756+0000 7f8cae59c640 1 -- 172.21.15.19:0/706428789 learned_addr learned my addr 172.21.15.19:0/706428789 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:24.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.757+0000 7f8cadd9b640 1 --2- 172.21.15.19:0/706428789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb00d30f0 0x7f8cb00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:24.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.757+0000 7f8caed9d640 1 --2- 172.21.15.19:0/706428789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cb015e5f0 0x7f8cb00cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:24.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.757+0000 7f8cae59c640 1 -- 172.21.15.19:0/706428789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cb015e5f0 msgr2=0x7f8cb00cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:24.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.757+0000 7f8cae59c640 1 --2- 172.21.15.19:0/706428789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cb015e5f0 0x7f8cb00cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:24.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.757+0000 7f8cae59c640 1 -- 172.21.15.19:0/706428789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb00d30f0 msgr2=0x7f8cb00b7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:24.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.757+0000 7f8cae59c640 1 --2- 172.21.15.19:0/706428789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb00d30f0 0x7f8cb00b7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:24.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.757+0000 7f8cae59c640 1 -- 172.21.15.19:0/706428789 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb00b8210 con 0x7f8cb00b6690 2024-09-12T02:03:24.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.757+0000 7f8cadd9b640 1 --2- 172.21.15.19:0/706428789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb00d30f0 0x7f8cb00b7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:24.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.757+0000 7f8caed9d640 1 --2- 172.21.15.19:0/706428789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cb015e5f0 0x7f8cb00cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:24.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.757+0000 7f8cae59c640 1 --2- 172.21.15.19:0/706428789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00b6690 0x7f8cb0154910 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000c4d0 tx=0x7f8ca000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:24.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.757+0000 7f8c9effd640 1 -- 172.21.15.19:0/706428789 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0017070 con 0x7f8cb00b6690 2024-09-12T02:03:24.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.757+0000 7f8c9effd640 1 -- 172.21.15.19:0/706428789 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca0005ce0 con 0x7f8cb00b6690 2024-09-12T02:03:24.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.757+0000 7f8c9effd640 1 -- 172.21.15.19:0/706428789 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0007270 con 0x7f8cb00b6690 2024-09-12T02:03:24.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.757+0000 7f8cb48e4640 1 -- 172.21.15.19:0/706428789 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb00b84f0 con 0x7f8cb00b6690 2024-09-12T02:03:24.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.757+0000 7f8cb48e4640 1 -- 172.21.15.19:0/706428789 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb00b8ab0 con 0x7f8cb00b6690 2024-09-12T02:03:24.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.758+0000 7f8cb48e4640 1 -- 172.21.15.19:0/706428789 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb00b5f80 con 0x7f8cb00b6690 2024-09-12T02:03:24.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.759+0000 7f8c9effd640 1 -- 172.21.15.19:0/706428789 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ca001a070 con 0x7f8cb00b6690 2024-09-12T02:03:24.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.759+0000 7f8c9effd640 1 --2- 172.21.15.19:0/706428789 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c9006be30 0x7f8c9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:24.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.759+0000 7f8c9effd640 1 -- 172.21.15.19:0/706428789 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6991+0+0 (secure 0 0 0) 0x7f8ca008a670 con 0x7f8cb00b6690 2024-09-12T02:03:24.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.759+0000 7f8cadd9b640 1 --2- 172.21.15.19:0/706428789 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c9006be30 0x7f8c9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:24.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.760+0000 7f8cadd9b640 1 --2- 172.21.15.19:0/706428789 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c9006be30 0x7f8c9006e2f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00cd790 tx=0x7f8ca4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:24.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.763+0000 7f8c9effd640 1 -- 172.21.15.19:0/706428789 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ca0058440 con 0x7f8cb00b6690 2024-09-12T02:03:24.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.973+0000 7f8cb48e4640 1 -- 172.21.15.19:0/706428789 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8cb00b1b10 con 0x7f8cb00b6690 2024-09-12T02:03:24.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.974+0000 7f8c9effd640 1 -- 172.21.15.19:0/706428789 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) ==== 95+0+4386 (secure 0 0 0) 0x7f8ca005c740 con 0x7f8cb00b6690 2024-09-12T02:03:24.976 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:24.976 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":129,"btime":"2024-09-12T02:03:24:637346+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7255,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/46689513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":46689513},{"type":"v1","addr":"172.21.15.135:6837","nonce":46689513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:24.637264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:24.977 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 129 2024-09-12T02:03:24.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.976+0000 7f8cb48e4640 1 -- 172.21.15.19:0/706428789 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c9006be30 msgr2=0x7f8c9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:24.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.976+0000 7f8cb48e4640 1 --2- 172.21.15.19:0/706428789 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c9006be30 0x7f8c9006e2f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00cd790 tx=0x7f8ca4009040 comp rx=0 tx=0).stop 2024-09-12T02:03:24.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.976+0000 7f8cb48e4640 1 -- 172.21.15.19:0/706428789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00b6690 msgr2=0x7f8cb0154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:24.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.976+0000 7f8cb48e4640 1 --2- 172.21.15.19:0/706428789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00b6690 0x7f8cb0154910 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000c4d0 tx=0x7f8ca000c990 comp rx=0 tx=0).stop 2024-09-12T02:03:24.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.976+0000 7f8cb48e4640 1 -- 172.21.15.19:0/706428789 shutdown_connections 2024-09-12T02:03:24.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.976+0000 7f8cb48e4640 1 --2- 172.21.15.19:0/706428789 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c9006be30 0x7f8c9006e2f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:24.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.976+0000 7f8cb48e4640 1 --2- 172.21.15.19:0/706428789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cb015e5f0 0x7f8cb00cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:24.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.976+0000 7f8cb48e4640 1 --2- 172.21.15.19:0/706428789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb00d30f0 0x7f8cb00b7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:24.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.976+0000 7f8cb48e4640 1 --2- 172.21.15.19:0/706428789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00b6690 0x7f8cb0154910 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:24.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.976+0000 7f8cb48e4640 1 -- 172.21.15.19:0/706428789 >> 172.21.15.19:0/706428789 conn(0x7f8cb008bfc0 msgr2=0x7f8cb00b5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:24.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.976+0000 7f8cb48e4640 1 -- 172.21.15.19:0/706428789 shutdown_connections 2024-09-12T02:03:24.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:24.976+0000 7f8cb48e4640 1 -- 172.21.15.19:0/706428789 wait complete. 2024-09-12T02:03:24.987 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:03:24.987 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:25.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.091+0000 7fcc7560e640 1 Processor -- start 2024-09-12T02:03:25.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.091+0000 7fcc7560e640 1 -- start start 2024-09-12T02:03:25.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.092+0000 7fcc7560e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcc7015e5d0 0x7fcc700d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:25.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.092+0000 7fcc7560e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcc7009b140 0x7fcc70168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:25.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.092+0000 7fcc7560e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc7006cec0 con 0x7fcc7006df60 2024-09-12T02:03:25.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.092+0000 7fcc7560e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fcc7006dad0 con 0x7fcc7015e5d0 2024-09-12T02:03:25.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.092+0000 7fcc7560e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fcc7006d1a0 con 0x7fcc7009b140 2024-09-12T02:03:25.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.092+0000 7fcc6effd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcc7015e5d0 0x7fcc700d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:25.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.092+0000 7fcc6effd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcc7015e5d0 0x7fcc700d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44210/0 (socket says 172.21.15.19:44210) 2024-09-12T02:03:25.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.092+0000 7fcc6effd640 1 -- 172.21.15.19:0/3474104983 learned_addr learned my addr 172.21.15.19:0/3474104983 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:25.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.092+0000 7fcc6effd640 1 -- 172.21.15.19:0/3474104983 >> v2:172.21.15.135:3300/0 conn(0x7fcc7009b140 msgr2=0x7fcc70168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:25.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.092+0000 7fcc6effd640 1 --2- 172.21.15.19:0/3474104983 >> v2:172.21.15.135:3300/0 conn(0x7fcc7009b140 0x7fcc70168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.092+0000 7fcc6effd640 1 -- 172.21.15.19:0/3474104983 >> v1:172.21.15.135:6789/0 conn(0x7fcc7006df60 legacy=0x7fcc7009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:25.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.092+0000 7fcc6effd640 1 -- 172.21.15.19:0/3474104983 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7006d480 con 0x7fcc7015e5d0 2024-09-12T02:03:25.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.093+0000 7fcc6effd640 1 --2- 172.21.15.19:0/3474104983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc7015e5d0 0x7fcc700d10f0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009870 tx=0x7fcc6002a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43eca965bd19341c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:25.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.093+0000 7fcc6e7fc640 1 -- 172.21.15.19:0/3474104983 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc60037070 con 0x7fcc7015e5d0 2024-09-12T02:03:25.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.093+0000 7fcc6e7fc640 1 -- 172.21.15.19:0/3474104983 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc60032640 con 0x7fcc7015e5d0 2024-09-12T02:03:25.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.093+0000 7fcc6e7fc640 1 -- 172.21.15.19:0/3474104983 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc60032a10 con 0x7fcc7015e5d0 2024-09-12T02:03:25.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.094+0000 7fcc7560e640 1 -- 172.21.15.19:0/3474104983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc7015e5d0 msgr2=0x7fcc700d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:25.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.094+0000 7fcc7560e640 1 --2- 172.21.15.19:0/3474104983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc7015e5d0 0x7fcc700d10f0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009870 tx=0x7fcc6002a320 comp rx=0 tx=0).stop 2024-09-12T02:03:25.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.094+0000 7fcc7560e640 1 -- 172.21.15.19:0/3474104983 shutdown_connections 2024-09-12T02:03:25.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.094+0000 7fcc7560e640 1 --2- 172.21.15.19:0/3474104983 >> v2:172.21.15.135:3300/0 conn(0x7fcc7009b140 0x7fcc70168560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.094+0000 7fcc7560e640 1 --2- 172.21.15.19:0/3474104983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc7015e5d0 0x7fcc700d10f0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.094+0000 7fcc7560e640 1 -- 172.21.15.19:0/3474104983 >> 172.21.15.19:0/3474104983 conn(0x7fcc700d23a0 msgr2=0x7fcc700d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:25.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.094+0000 7fcc7560e640 1 -- 172.21.15.19:0/3474104983 shutdown_connections 2024-09-12T02:03:25.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.094+0000 7fcc7560e640 1 -- 172.21.15.19:0/3474104983 wait complete. 2024-09-12T02:03:25.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.095+0000 7fcc7560e640 1 Processor -- start 2024-09-12T02:03:25.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.095+0000 7fcc7560e640 1 -- start start 2024-09-12T02:03:25.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.096+0000 7fcc7560e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc7006df60 0x7fcc700b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:25.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.096+0000 7fcc7560e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc7009b140 0x7fcc701ea4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:25.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.096+0000 7fcc7560e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc7015e5d0 0x7fcc701ea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:25.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.096+0000 7fcc7560e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7015eb30 con 0x7fcc7006df60 2024-09-12T02:03:25.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.096+0000 7fcc7560e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7015e9b0 con 0x7fcc7015e5d0 2024-09-12T02:03:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.096+0000 7fcc7560e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcc700d1630 con 0x7fcc7009b140 2024-09-12T02:03:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.096+0000 7fcc6effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc7006df60 0x7fcc700b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.096+0000 7fcc6effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc7006df60 0x7fcc700b77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44216/0 (socket says 172.21.15.19:44216) 2024-09-12T02:03:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.096+0000 7fcc6effd640 1 -- 172.21.15.19:0/1567337030 learned_addr learned my addr 172.21.15.19:0/1567337030 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.096+0000 7fcc6f7fe640 1 --2- 172.21.15.19:0/1567337030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc7015e5d0 0x7fcc701ea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.096+0000 7fcc67fff640 1 --2- 172.21.15.19:0/1567337030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc7009b140 0x7fcc701ea4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.096+0000 7fcc6effd640 1 -- 172.21.15.19:0/1567337030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc7009b140 msgr2=0x7fcc701ea4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.096+0000 7fcc6effd640 1 --2- 172.21.15.19:0/1567337030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc7009b140 0x7fcc701ea4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.096+0000 7fcc6effd640 1 -- 172.21.15.19:0/1567337030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc7015e5d0 msgr2=0x7fcc701ea9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.096+0000 7fcc6effd640 1 --2- 172.21.15.19:0/1567337030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc7015e5d0 0x7fcc701ea9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.096+0000 7fcc6effd640 1 -- 172.21.15.19:0/1567337030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc700b7f10 con 0x7fcc7006df60 2024-09-12T02:03:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.096+0000 7fcc6effd640 1 --2- 172.21.15.19:0/1567337030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc7006df60 0x7fcc700b77e0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fcc60000c00 tx=0x7fcc600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.097+0000 7fcc677fe640 1 -- 172.21.15.19:0/1567337030 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc60037040 con 0x7fcc7006df60 2024-09-12T02:03:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.097+0000 7fcc677fe640 1 -- 172.21.15.19:0/1567337030 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc60004250 con 0x7fcc7006df60 2024-09-12T02:03:25.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.097+0000 7fcc7560e640 1 -- 172.21.15.19:0/1567337030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc700af640 con 0x7fcc7006df60 2024-09-12T02:03:25.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.097+0000 7fcc677fe640 1 -- 172.21.15.19:0/1567337030 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6003c730 con 0x7fcc7006df60 2024-09-12T02:03:25.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.097+0000 7fcc7560e640 1 -- 172.21.15.19:0/1567337030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc700b5670 con 0x7fcc7006df60 2024-09-12T02:03:25.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.098+0000 7fcc7560e640 1 -- 172.21.15.19:0/1567337030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc700d10f0 con 0x7fcc7006df60 2024-09-12T02:03:25.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.098+0000 7fcc677fe640 1 -- 172.21.15.19:0/1567337030 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc6003a070 con 0x7fcc7006df60 2024-09-12T02:03:25.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.099+0000 7fcc677fe640 1 --2- 172.21.15.19:0/1567337030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcc5006be30 0x7fcc5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:25.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.099+0000 7fcc677fe640 1 -- 172.21.15.19:0/1567337030 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6991+0+0 (secure 0 0 0) 0x7fcc600abbd0 con 0x7fcc7006df60 2024-09-12T02:03:25.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.099+0000 7fcc67fff640 1 --2- 172.21.15.19:0/1567337030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcc5006be30 0x7fcc5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:25.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.100+0000 7fcc67fff640 1 --2- 172.21.15.19:0/1567337030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcc5006be30 0x7fcc5006e2f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcc58007fd0 tx=0x7fcc58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:25.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.103+0000 7fcc677fe640 1 -- 172.21.15.19:0/1567337030 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcc60041020 con 0x7fcc7006df60 2024-09-12T02:03:25.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.315+0000 7fcc7560e640 1 -- 172.21.15.19:0/1567337030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc700b29e0 con 0x7fcc7006df60 2024-09-12T02:03:25.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.316+0000 7fcc677fe640 1 -- 172.21.15.19:0/1567337030 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) ==== 95+0+4386 (secure 0 0 0) 0x7fcc6007a110 con 0x7fcc7006df60 2024-09-12T02:03:25.316 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:25.316 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":129,"btime":"2024-09-12T02:03:24:637346+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7255,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/46689513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":46689513},{"type":"v1","addr":"172.21.15.135:6837","nonce":46689513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:24.637264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:25.316 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 129 2024-09-12T02:03:25.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.318+0000 7fcc7560e640 1 -- 172.21.15.19:0/1567337030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcc5006be30 msgr2=0x7fcc5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:25.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.318+0000 7fcc7560e640 1 --2- 172.21.15.19:0/1567337030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcc5006be30 0x7fcc5006e2f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcc58007fd0 tx=0x7fcc58009040 comp rx=0 tx=0).stop 2024-09-12T02:03:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.318+0000 7fcc7560e640 1 -- 172.21.15.19:0/1567337030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc7006df60 msgr2=0x7fcc700b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.318+0000 7fcc7560e640 1 --2- 172.21.15.19:0/1567337030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc7006df60 0x7fcc700b77e0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fcc60000c00 tx=0x7fcc600046c0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.318+0000 7fcc7560e640 1 -- 172.21.15.19:0/1567337030 shutdown_connections 2024-09-12T02:03:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.318+0000 7fcc7560e640 1 --2- 172.21.15.19:0/1567337030 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcc5006be30 0x7fcc5006e2f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.318+0000 7fcc7560e640 1 --2- 172.21.15.19:0/1567337030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc7015e5d0 0x7fcc701ea9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.318+0000 7fcc7560e640 1 --2- 172.21.15.19:0/1567337030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc7009b140 0x7fcc701ea4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.318+0000 7fcc7560e640 1 --2- 172.21.15.19:0/1567337030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc7006df60 0x7fcc700b77e0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.318+0000 7fcc7560e640 1 -- 172.21.15.19:0/1567337030 >> 172.21.15.19:0/1567337030 conn(0x7fcc700d23a0 msgr2=0x7fcc700b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.318+0000 7fcc7560e640 1 -- 172.21.15.19:0/1567337030 shutdown_connections 2024-09-12T02:03:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.318+0000 7fcc7560e640 1 -- 172.21.15.19:0/1567337030 wait complete. 2024-09-12T02:03:25.329 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:03:25.330 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:25.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.431+0000 7fcede4e6640 1 Processor -- start 2024-09-12T02:03:25.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.431+0000 7fcede4e6640 1 -- start start 2024-09-12T02:03:25.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.432+0000 7fcede4e6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced8072d30 0x7fced806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:25.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.432+0000 7fcede4e6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fced806f700 0x7fced815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:25.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.432+0000 7fcede4e6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fced80cdbe0 con 0x7fced815b300 2024-09-12T02:03:25.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.432+0000 7fcede4e6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fced806fb50 con 0x7fced806f700 2024-09-12T02:03:25.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.432+0000 7fcede4e6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fced80728a0 con 0x7fced8072d30 2024-09-12T02:03:25.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.432+0000 7fcedca83640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fced806f700 0x7fced815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:25.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.432+0000 7fcedca83640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fced806f700 0x7fced815b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44230/0 (socket says 172.21.15.19:44230) 2024-09-12T02:03:25.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.432+0000 7fcedca83640 1 -- 172.21.15.19:0/2789950110 learned_addr learned my addr 172.21.15.19:0/2789950110 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:25.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.432+0000 7fced77fe640 1 --2- 172.21.15.19:0/2789950110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced8072d30 0x7fced806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:25.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.432+0000 7fcedca83640 1 -- 172.21.15.19:0/2789950110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced8072d30 msgr2=0x7fced806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:25.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.432+0000 7fcedca83640 1 --2- 172.21.15.19:0/2789950110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced8072d30 0x7fced806f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.432+0000 7fcedca83640 1 -- 172.21.15.19:0/2789950110 >> v1:172.21.15.135:6789/0 conn(0x7fced815b300 legacy=0x7fced80cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:25.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.433+0000 7fcedca83640 1 -- 172.21.15.19:0/2789950110 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced80cd900 con 0x7fced806f700 2024-09-12T02:03:25.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.433+0000 7fcedca83640 1 --2- 172.21.15.19:0/2789950110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced806f700 0x7fced815b6e0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fced0009e50 tx=0x7fced002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecb61edd9ea7d68 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:25.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.433+0000 7fced6ffd640 1 -- 172.21.15.19:0/2789950110 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced0036070 con 0x7fced806f700 2024-09-12T02:03:25.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.433+0000 7fced6ffd640 1 -- 172.21.15.19:0/2789950110 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fced0031600 con 0x7fced806f700 2024-09-12T02:03:25.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.433+0000 7fced6ffd640 1 -- 172.21.15.19:0/2789950110 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced00319d0 con 0x7fced806f700 2024-09-12T02:03:25.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.434+0000 7fcede4e6640 1 -- 172.21.15.19:0/2789950110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced806f700 msgr2=0x7fced815b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:25.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.434+0000 7fcede4e6640 1 --2- 172.21.15.19:0/2789950110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced806f700 0x7fced815b6e0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fced0009e50 tx=0x7fced002a6c0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.434+0000 7fcede4e6640 1 -- 172.21.15.19:0/2789950110 shutdown_connections 2024-09-12T02:03:25.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.434+0000 7fcede4e6640 1 --2- 172.21.15.19:0/2789950110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced806f700 0x7fced815b6e0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.434+0000 7fcede4e6640 1 --2- 172.21.15.19:0/2789950110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced8072d30 0x7fced806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.434+0000 7fcede4e6640 1 -- 172.21.15.19:0/2789950110 >> 172.21.15.19:0/2789950110 conn(0x7fced8067d70 msgr2=0x7fced806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:25.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.434+0000 7fcede4e6640 1 -- 172.21.15.19:0/2789950110 shutdown_connections 2024-09-12T02:03:25.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.434+0000 7fcede4e6640 1 -- 172.21.15.19:0/2789950110 wait complete. 2024-09-12T02:03:25.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.435+0000 7fcede4e6640 1 Processor -- start 2024-09-12T02:03:25.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.435+0000 7fcede4e6640 1 -- start start 2024-09-12T02:03:25.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.436+0000 7fcede4e6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced806f700 0x7fced8145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:25.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.436+0000 7fcede4e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced8072d30 0x7fced81f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:25.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.436+0000 7fcede4e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced815b300 0x7fced80b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:25.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.436+0000 7fcede4e6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fced80cd5c0 con 0x7fced8072d30 2024-09-12T02:03:25.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.436+0000 7fcede4e6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fced8072530 con 0x7fced815b300 2024-09-12T02:03:25.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.436+0000 7fcede4e6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fced80cffe0 con 0x7fced806f700 2024-09-12T02:03:25.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.436+0000 7fced77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced8072d30 0x7fced81f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:25.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.436+0000 7fced77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced8072d30 0x7fced81f56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44246/0 (socket says 172.21.15.19:44246) 2024-09-12T02:03:25.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.436+0000 7fced77fe640 1 -- 172.21.15.19:0/421215783 learned_addr learned my addr 172.21.15.19:0/421215783 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:25.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.436+0000 7fcedca83640 1 --2- 172.21.15.19:0/421215783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced815b300 0x7fced80b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:25.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.436+0000 7fced7fff640 1 --2- 172.21.15.19:0/421215783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced806f700 0x7fced8145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:25.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.437+0000 7fced77fe640 1 -- 172.21.15.19:0/421215783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced806f700 msgr2=0x7fced8145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:25.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.437+0000 7fced77fe640 1 --2- 172.21.15.19:0/421215783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced806f700 0x7fced8145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.437+0000 7fced77fe640 1 -- 172.21.15.19:0/421215783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced815b300 msgr2=0x7fced80b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:25.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.437+0000 7fced77fe640 1 --2- 172.21.15.19:0/421215783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced815b300 0x7fced80b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.437+0000 7fced77fe640 1 -- 172.21.15.19:0/421215783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced81f5fc0 con 0x7fced8072d30 2024-09-12T02:03:25.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.437+0000 7fced77fe640 1 --2- 172.21.15.19:0/421215783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced8072d30 0x7fced81f56e0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00d800 tx=0x7fcecc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:25.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.437+0000 7fced4ff9640 1 -- 172.21.15.19:0/421215783 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00b6c0 con 0x7fced8072d30 2024-09-12T02:03:25.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.437+0000 7fced4ff9640 1 -- 172.21.15.19:0/421215783 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcecc019070 con 0x7fced8072d30 2024-09-12T02:03:25.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.437+0000 7fcede4e6640 1 -- 172.21.15.19:0/421215783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced81f62a0 con 0x7fced8072d30 2024-09-12T02:03:25.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.437+0000 7fced4ff9640 1 -- 172.21.15.19:0/421215783 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00ba80 con 0x7fced8072d30 2024-09-12T02:03:25.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.437+0000 7fcede4e6640 1 -- 172.21.15.19:0/421215783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced81f6580 con 0x7fced8072d30 2024-09-12T02:03:25.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.438+0000 7fcede4e6640 1 -- 172.21.15.19:0/421215783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced806f1c0 con 0x7fced8072d30 2024-09-12T02:03:25.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.438+0000 7fced4ff9640 1 -- 172.21.15.19:0/421215783 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcecc00bc20 con 0x7fced8072d30 2024-09-12T02:03:25.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.439+0000 7fced4ff9640 1 --2- 172.21.15.19:0/421215783 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcec406be30 0x7fcec406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:25.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.439+0000 7fced4ff9640 1 -- 172.21.15.19:0/421215783 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6991+0+0 (secure 0 0 0) 0x7fcecc08b640 con 0x7fced8072d30 2024-09-12T02:03:25.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.439+0000 7fced7fff640 1 --2- 172.21.15.19:0/421215783 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcec406be30 0x7fcec406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:25.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.440+0000 7fced7fff640 1 --2- 172.21.15.19:0/421215783 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcec406be30 0x7fcec406e2f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcec8006fd0 tx=0x7fcec8009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:25.443 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:03:25.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.443+0000 7fced4ff9640 1 -- 172.21.15.19:0/421215783 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcecc059530 con 0x7fced8072d30 2024-09-12T02:03:25.446 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:03:25.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.656+0000 7fcede4e6640 1 -- 172.21.15.19:0/421215783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fced815e5b0 con 0x7fced8072d30 2024-09-12T02:03:25.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.656+0000 7fced4ff9640 1 -- 172.21.15.19:0/421215783 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) ==== 95+0+4386 (secure 0 0 0) 0x7fcecc05d830 con 0x7fced8072d30 2024-09-12T02:03:25.657 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:25.657 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":129,"btime":"2024-09-12T02:03:24:637346+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7255,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/46689513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":46689513},{"type":"v1","addr":"172.21.15.135:6837","nonce":46689513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:24.637264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:25.658 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 129 2024-09-12T02:03:25.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.658+0000 7fcede4e6640 1 -- 172.21.15.19:0/421215783 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcec406be30 msgr2=0x7fcec406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:25.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.658+0000 7fcede4e6640 1 --2- 172.21.15.19:0/421215783 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcec406be30 0x7fcec406e2f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcec8006fd0 tx=0x7fcec8009060 comp rx=0 tx=0).stop 2024-09-12T02:03:25.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.658+0000 7fcede4e6640 1 -- 172.21.15.19:0/421215783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced8072d30 msgr2=0x7fced81f56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:25.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.658+0000 7fcede4e6640 1 --2- 172.21.15.19:0/421215783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced8072d30 0x7fced81f56e0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00d800 tx=0x7fcecc00dcc0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.658+0000 7fcede4e6640 1 -- 172.21.15.19:0/421215783 shutdown_connections 2024-09-12T02:03:25.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.658+0000 7fcede4e6640 1 --2- 172.21.15.19:0/421215783 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcec406be30 0x7fcec406e2f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.658+0000 7fcede4e6640 1 --2- 172.21.15.19:0/421215783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced815b300 0x7fced80b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.658+0000 7fcede4e6640 1 --2- 172.21.15.19:0/421215783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced8072d30 0x7fced81f56e0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.658+0000 7fcede4e6640 1 --2- 172.21.15.19:0/421215783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced806f700 0x7fced8145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.658+0000 7fcede4e6640 1 -- 172.21.15.19:0/421215783 >> 172.21.15.19:0/421215783 conn(0x7fced8067d70 msgr2=0x7fced80b0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:25.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.659+0000 7fcede4e6640 1 -- 172.21.15.19:0/421215783 shutdown_connections 2024-09-12T02:03:25.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.659+0000 7fcede4e6640 1 -- 172.21.15.19:0/421215783 wait complete. 2024-09-12T02:03:25.670 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete mds_snaptable' led to DAMAGED state 2024-09-12T02:03:25.670 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete mds0_inotable' 2024-09-12T02:03:25.670 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:03:25.670 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:03:25.687 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:03:25.687 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:03:25.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:25.687 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:03:25.742 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:03:25.743 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:03:25.743 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:03:25.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.886+0000 7fa6d5c77640 1 Processor -- start 2024-09-12T02:03:25.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.886+0000 7fa6d5c77640 1 -- start start 2024-09-12T02:03:25.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.887+0000 7fa6d5c77640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa6d00d04a0 0x7fa6d00d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:25.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.887+0000 7fa6d5c77640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6d00ae550 0x7fa6d00ae980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:25.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.887+0000 7fa6d5c77640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d006cb30 con 0x7fa6d0147360 2024-09-12T02:03:25.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.887+0000 7fa6d5c77640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa6d00d0e50 con 0x7fa6d00d04a0 2024-09-12T02:03:25.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.887+0000 7fa6d5c77640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d006bfb0 con 0x7fa6d00ae550 2024-09-12T02:03:25.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.887+0000 7fa6ceffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa6d00d04a0 0x7fa6d00d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:25.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.887+0000 7fa6ceffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa6d00d04a0 0x7fa6d00d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44248/0 (socket says 172.21.15.19:44248) 2024-09-12T02:03:25.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.887+0000 7fa6ceffd640 1 -- 172.21.15.19:0/2938229119 learned_addr learned my addr 172.21.15.19:0/2938229119 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:25.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.887+0000 7fa6ceffd640 1 -- 172.21.15.19:0/2938229119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6d00ae550 msgr2=0x7fa6d00ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:25.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.887+0000 7fa6cffff640 1 --2- 172.21.15.19:0/2938229119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6d00ae550 0x7fa6d00ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:25.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.887+0000 7fa6ceffd640 1 --2- 172.21.15.19:0/2938229119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6d00ae550 0x7fa6d00ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.887+0000 7fa6ceffd640 1 -- 172.21.15.19:0/2938229119 >> v1:172.21.15.135:6789/0 conn(0x7fa6d0147360 legacy=0x7fa6d0070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:25.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.887+0000 7fa6ceffd640 1 -- 172.21.15.19:0/2938229119 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d006c290 con 0x7fa6d00d04a0 2024-09-12T02:03:25.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.887+0000 7fa6cffff640 1 --2- 172.21.15.19:0/2938229119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6d00ae550 0x7fa6d00ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:25.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.888+0000 7fa6ceffd640 1 --2- 172.21.15.19:0/2938229119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6d00d04a0 0x7fa6d00d0910 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009870 tx=0x7fa6c402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfb0a382ccf6061 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:25.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.888+0000 7fa6ce7fc640 1 -- 172.21.15.19:0/2938229119 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4037070 con 0x7fa6d00d04a0 2024-09-12T02:03:25.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.888+0000 7fa6ce7fc640 1 -- 172.21.15.19:0/2938229119 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c4032440 con 0x7fa6d00d04a0 2024-09-12T02:03:25.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.888+0000 7fa6ce7fc640 1 -- 172.21.15.19:0/2938229119 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4032810 con 0x7fa6d00d04a0 2024-09-12T02:03:25.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.889+0000 7fa6d5c77640 1 -- 172.21.15.19:0/2938229119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6d00d04a0 msgr2=0x7fa6d00d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:25.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.889+0000 7fa6d5c77640 1 --2- 172.21.15.19:0/2938229119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6d00d04a0 0x7fa6d00d0910 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009870 tx=0x7fa6c402a180 comp rx=0 tx=0).stop 2024-09-12T02:03:25.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.889+0000 7fa6d5c77640 1 -- 172.21.15.19:0/2938229119 shutdown_connections 2024-09-12T02:03:25.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.889+0000 7fa6d5c77640 1 --2- 172.21.15.19:0/2938229119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6d00ae550 0x7fa6d00ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.889+0000 7fa6d5c77640 1 --2- 172.21.15.19:0/2938229119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6d00d04a0 0x7fa6d00d0910 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.889+0000 7fa6d5c77640 1 -- 172.21.15.19:0/2938229119 >> 172.21.15.19:0/2938229119 conn(0x7fa6d00b2f40 msgr2=0x7fa6d00b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:25.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.889+0000 7fa6d5c77640 1 -- 172.21.15.19:0/2938229119 shutdown_connections 2024-09-12T02:03:25.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.889+0000 7fa6d5c77640 1 -- 172.21.15.19:0/2938229119 wait complete. 2024-09-12T02:03:25.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.890+0000 7fa6d5c77640 1 Processor -- start 2024-09-12T02:03:25.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.890+0000 7fa6d5c77640 1 -- start start 2024-09-12T02:03:25.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.891+0000 7fa6d5c77640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6d00ae550 0x7fa6d00b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:25.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.891+0000 7fa6d5c77640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6d00d04a0 0x7fa6d0144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:25.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.891+0000 7fa6d5c77640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d0147360 0x7fa6d015ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:25.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.891+0000 7fa6d5c77640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d0070fa0 con 0x7fa6d00ae550 2024-09-12T02:03:25.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.891+0000 7fa6d5c77640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d006c850 con 0x7fa6d0147360 2024-09-12T02:03:25.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.891+0000 7fa6d5c77640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d006bc10 con 0x7fa6d00d04a0 2024-09-12T02:03:25.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.891+0000 7fa6cf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6d00ae550 0x7fa6d00b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:25.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.891+0000 7fa6cf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6d00ae550 0x7fa6d00b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44260/0 (socket says 172.21.15.19:44260) 2024-09-12T02:03:25.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.891+0000 7fa6cf7fe640 1 -- 172.21.15.19:0/1216225464 learned_addr learned my addr 172.21.15.19:0/1216225464 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:25.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.891+0000 7fa6ceffd640 1 --2- 172.21.15.19:0/1216225464 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6d00d04a0 0x7fa6d0144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:25.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.891+0000 7fa6cffff640 1 --2- 172.21.15.19:0/1216225464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d0147360 0x7fa6d015ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:25.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.891+0000 7fa6cf7fe640 1 -- 172.21.15.19:0/1216225464 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6d00d04a0 msgr2=0x7fa6d0144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:25.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.891+0000 7fa6cf7fe640 1 --2- 172.21.15.19:0/1216225464 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6d00d04a0 0x7fa6d0144ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.891+0000 7fa6cf7fe640 1 -- 172.21.15.19:0/1216225464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d0147360 msgr2=0x7fa6d015ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:25.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.891+0000 7fa6cf7fe640 1 --2- 172.21.15.19:0/1216225464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d0147360 0x7fa6d015ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:25.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.891+0000 7fa6cf7fe640 1 -- 172.21.15.19:0/1216225464 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d0144ff0 con 0x7fa6d00ae550 2024-09-12T02:03:25.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.892+0000 7fa6cf7fe640 1 --2- 172.21.15.19:0/1216225464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6d00ae550 0x7fa6d00b5c50 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000b420 tx=0x7fa6c000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:25.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.892+0000 7fa6b7fff640 1 -- 172.21.15.19:0/1216225464 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0011830 con 0x7fa6d00ae550 2024-09-12T02:03:25.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.892+0000 7fa6b7fff640 1 -- 172.21.15.19:0/1216225464 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c0016070 con 0x7fa6d00ae550 2024-09-12T02:03:25.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.892+0000 7fa6d5c77640 1 -- 172.21.15.19:0/1216225464 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d00b6260 con 0x7fa6d00ae550 2024-09-12T02:03:25.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.892+0000 7fa6b7fff640 1 -- 172.21.15.19:0/1216225464 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0011c10 con 0x7fa6d00ae550 2024-09-12T02:03:25.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.892+0000 7fa6d5c77640 1 -- 172.21.15.19:0/1216225464 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d00b6820 con 0x7fa6d00ae550 2024-09-12T02:03:25.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.893+0000 7fa6d5c77640 1 -- 172.21.15.19:0/1216225464 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d00d0910 con 0x7fa6d00ae550 2024-09-12T02:03:25.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.893+0000 7fa6b7fff640 1 -- 172.21.15.19:0/1216225464 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa6c001b460 con 0x7fa6d00ae550 2024-09-12T02:03:25.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.894+0000 7fa6b7fff640 1 --2- 172.21.15.19:0/1216225464 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6bc06be30 0x7fa6bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:25.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.894+0000 7fa6b7fff640 1 -- 172.21.15.19:0/1216225464 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6991+0+0 (secure 0 0 0) 0x7fa6c008ac80 con 0x7fa6d00ae550 2024-09-12T02:03:25.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.894+0000 7fa6ceffd640 1 --2- 172.21.15.19:0/1216225464 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6bc06be30 0x7fa6bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:25.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.894+0000 7fa6ceffd640 1 --2- 172.21.15.19:0/1216225464 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6bc06be30 0x7fa6bc06e2f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4034000 tx=0x7fa6c402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:25.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:25.898+0000 7fa6b7fff640 1 -- 172.21.15.19:0/1216225464 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6c0020020 con 0x7fa6d00ae550 2024-09-12T02:03:26.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.109+0000 7fa6d5c77640 1 -- 172.21.15.19:0/1216225464 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa6d0070310 con 0x7fa6d00ae550 2024-09-12T02:03:26.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.636+0000 7fa6b7fff640 1 -- 172.21.15.19:0/1216225464 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v130) ==== 161+0+0 (secure 0 0 0) 0x7fa6c0058b70 con 0x7fa6d00ae550 2024-09-12T02:03:26.636 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:03:26.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.638+0000 7fa6d5c77640 1 -- 172.21.15.19:0/1216225464 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6bc06be30 msgr2=0x7fa6bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:26.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.638+0000 7fa6d5c77640 1 --2- 172.21.15.19:0/1216225464 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6bc06be30 0x7fa6bc06e2f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4034000 tx=0x7fa6c402e000 comp rx=0 tx=0).stop 2024-09-12T02:03:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.638+0000 7fa6d5c77640 1 -- 172.21.15.19:0/1216225464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6d00ae550 msgr2=0x7fa6d00b5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.638+0000 7fa6d5c77640 1 --2- 172.21.15.19:0/1216225464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6d00ae550 0x7fa6d00b5c50 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000b420 tx=0x7fa6c000b8e0 comp rx=0 tx=0).stop 2024-09-12T02:03:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.638+0000 7fa6d5c77640 1 -- 172.21.15.19:0/1216225464 shutdown_connections 2024-09-12T02:03:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.638+0000 7fa6d5c77640 1 --2- 172.21.15.19:0/1216225464 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6bc06be30 0x7fa6bc06e2f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.638+0000 7fa6d5c77640 1 --2- 172.21.15.19:0/1216225464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d0147360 0x7fa6d015ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.638+0000 7fa6d5c77640 1 --2- 172.21.15.19:0/1216225464 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6d00d04a0 0x7fa6d0144ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.638+0000 7fa6d5c77640 1 --2- 172.21.15.19:0/1216225464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6d00ae550 0x7fa6d00b5c50 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.638+0000 7fa6d5c77640 1 -- 172.21.15.19:0/1216225464 >> 172.21.15.19:0/1216225464 conn(0x7fa6d00b2f40 msgr2=0x7fa6d00b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.638+0000 7fa6d5c77640 1 -- 172.21.15.19:0/1216225464 shutdown_connections 2024-09-12T02:03:26.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.638+0000 7fa6d5c77640 1 -- 172.21.15.19:0/1216225464 wait complete. 2024-09-12T02:03:26.652 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:03:26.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.760+0000 7f8d2eee4640 1 Processor -- start 2024-09-12T02:03:26.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.760+0000 7f8d2eee4640 1 -- start start 2024-09-12T02:03:26.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.761+0000 7f8d2eee4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d28161c80 0x7f8d2806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:26.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.761+0000 7f8d2eee4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d28162060 0x7f8d280b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:26.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.761+0000 7f8d2eee4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8d280b64b0 0x7f8d280b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:26.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.761+0000 7f8d2eee4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8d2806e870 con 0x7f8d28162060 2024-09-12T02:03:26.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.761+0000 7f8d2eee4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f8d2806d9f0 con 0x7f8d280b64b0 2024-09-12T02:03:26.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.761+0000 7f8d2eee4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8d2806dcd0 con 0x7f8d28161c80 2024-09-12T02:03:26.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.761+0000 7f8d27fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d28162060 0x7f8d280b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:26.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.761+0000 7f8d27fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d28162060 0x7f8d280b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44262/0 (socket says 172.21.15.19:44262) 2024-09-12T02:03:26.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.761+0000 7f8d27fff640 1 -- 172.21.15.19:0/2479370638 learned_addr learned my addr 172.21.15.19:0/2479370638 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:26.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.762+0000 7f8d2cc80640 1 --2- 172.21.15.19:0/2479370638 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d28161c80 0x7f8d2806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:26.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.762+0000 7f8d2d481640 1 --2- 172.21.15.19:0/2479370638 >> v2:172.21.15.135:3300/0 conn(0x7f8d280b64b0 0x7f8d280b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:26.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.762+0000 7f8d27fff640 1 -- 172.21.15.19:0/2479370638 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d28161c80 msgr2=0x7f8d2806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:26.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.762+0000 7f8d27fff640 1 --2- 172.21.15.19:0/2479370638 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d28161c80 0x7f8d2806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:26.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.762+0000 7f8d27fff640 1 -- 172.21.15.19:0/2479370638 >> v2:172.21.15.135:3300/0 conn(0x7f8d280b64b0 msgr2=0x7f8d280b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:26.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.762+0000 7f8d27fff640 1 --2- 172.21.15.19:0/2479370638 >> v2:172.21.15.135:3300/0 conn(0x7f8d280b64b0 0x7f8d280b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:26.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.762+0000 7f8d27fff640 1 -- 172.21.15.19:0/2479370638 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2806dfb0 con 0x7f8d28162060 2024-09-12T02:03:26.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.763+0000 7f8d27fff640 1 --2- 172.21.15.19:0/2479370638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d28162060 0x7f8d280b5f70 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f8d280687b0 tx=0x7f8d1c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0bffbdd3578dfd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:26.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.763+0000 7f8d277fe640 1 -- 172.21.15.19:0/2479370638 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c037070 con 0x7f8d28162060 2024-09-12T02:03:26.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.763+0000 7f8d277fe640 1 -- 172.21.15.19:0/2479370638 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1c032440 con 0x7f8d28162060 2024-09-12T02:03:26.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.763+0000 7f8d277fe640 1 -- 172.21.15.19:0/2479370638 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c032810 con 0x7f8d28162060 2024-09-12T02:03:26.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.763+0000 7f8d2eee4640 1 -- 172.21.15.19:0/2479370638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d28162060 msgr2=0x7f8d280b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:26.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.763+0000 7f8d2eee4640 1 --2- 172.21.15.19:0/2479370638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d28162060 0x7f8d280b5f70 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f8d280687b0 tx=0x7f8d1c02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:03:26.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.763+0000 7f8d2eee4640 1 -- 172.21.15.19:0/2479370638 shutdown_connections 2024-09-12T02:03:26.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.763+0000 7f8d2eee4640 1 --2- 172.21.15.19:0/2479370638 >> v2:172.21.15.135:3300/0 conn(0x7f8d280b64b0 0x7f8d280b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:26.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.763+0000 7f8d2eee4640 1 --2- 172.21.15.19:0/2479370638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d28162060 0x7f8d280b5f70 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:26.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.763+0000 7f8d2eee4640 1 --2- 172.21.15.19:0/2479370638 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d28161c80 0x7f8d2806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:26.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.763+0000 7f8d2eee4640 1 -- 172.21.15.19:0/2479370638 >> 172.21.15.19:0/2479370638 conn(0x7f8d280d44f0 msgr2=0x7f8d280d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:26.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.763+0000 7f8d2eee4640 1 -- 172.21.15.19:0/2479370638 shutdown_connections 2024-09-12T02:03:26.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.763+0000 7f8d2eee4640 1 -- 172.21.15.19:0/2479370638 wait complete. 2024-09-12T02:03:26.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.765+0000 7f8d2eee4640 1 Processor -- start 2024-09-12T02:03:26.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.765+0000 7f8d2eee4640 1 -- start start 2024-09-12T02:03:26.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.765+0000 7f8d2eee4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d280b64b0 0x7f8d281570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:26.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.765+0000 7f8d2eee4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d28161c80 0x7f8d280b9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:26.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.765+0000 7f8d2eee4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d28162060 0x7f8d280ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:26.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.765+0000 7f8d2eee4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8d28162500 con 0x7f8d280b64b0 2024-09-12T02:03:26.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.765+0000 7f8d2eee4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8d280d2aa0 con 0x7f8d28161c80 2024-09-12T02:03:26.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.765+0000 7f8d2eee4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8d28162680 con 0x7f8d28162060 2024-09-12T02:03:26.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.766+0000 7f8d2cc80640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d280b64b0 0x7f8d281570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:26.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.766+0000 7f8d2cc80640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d280b64b0 0x7f8d281570d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44278/0 (socket says 172.21.15.19:44278) 2024-09-12T02:03:26.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.766+0000 7f8d2cc80640 1 -- 172.21.15.19:0/3173246054 learned_addr learned my addr 172.21.15.19:0/3173246054 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:26.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.766+0000 7f8d2d481640 1 --2- 172.21.15.19:0/3173246054 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d28162060 0x7f8d280ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:26.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.766+0000 7f8d27fff640 1 --2- 172.21.15.19:0/3173246054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d28161c80 0x7f8d280b9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:26.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.766+0000 7f8d2cc80640 1 -- 172.21.15.19:0/3173246054 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d28162060 msgr2=0x7f8d280ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:26.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.766+0000 7f8d2cc80640 1 --2- 172.21.15.19:0/3173246054 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d28162060 0x7f8d280ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:26.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.766+0000 7f8d2cc80640 1 -- 172.21.15.19:0/3173246054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d28161c80 msgr2=0x7f8d280b9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:26.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.766+0000 7f8d2cc80640 1 --2- 172.21.15.19:0/3173246054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d28161c80 0x7f8d280b9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:26.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.766+0000 7f8d2cc80640 1 -- 172.21.15.19:0/3173246054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d28157610 con 0x7f8d280b64b0 2024-09-12T02:03:26.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.766+0000 7f8d2cc80640 1 --2- 172.21.15.19:0/3173246054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d280b64b0 0x7f8d281570d0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800e9b0 tx=0x7f8d1800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:26.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.766+0000 7f8d257fa640 1 -- 172.21.15.19:0/3173246054 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18017070 con 0x7f8d280b64b0 2024-09-12T02:03:26.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.766+0000 7f8d257fa640 1 -- 172.21.15.19:0/3173246054 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1800c9a0 con 0x7f8d280b64b0 2024-09-12T02:03:26.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.766+0000 7f8d2eee4640 1 -- 172.21.15.19:0/3173246054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d280ba1d0 con 0x7f8d280b64b0 2024-09-12T02:03:26.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.766+0000 7f8d257fa640 1 -- 172.21.15.19:0/3173246054 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1800cd90 con 0x7f8d280b64b0 2024-09-12T02:03:26.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.766+0000 7f8d2eee4640 1 -- 172.21.15.19:0/3173246054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d280b83a0 con 0x7f8d280b64b0 2024-09-12T02:03:26.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.767+0000 7f8d2eee4640 1 -- 172.21.15.19:0/3173246054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d2806e330 con 0x7f8d280b64b0 2024-09-12T02:03:26.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.768+0000 7f8d257fa640 1 -- 172.21.15.19:0/3173246054 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d1801a070 con 0x7f8d280b64b0 2024-09-12T02:03:26.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.768+0000 7f8d257fa640 1 --2- 172.21.15.19:0/3173246054 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d1406be30 0x7f8d1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:26.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.768+0000 7f8d257fa640 1 -- 172.21.15.19:0/3173246054 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6991+0+0 (secure 0 0 0) 0x7f8d1808b230 con 0x7f8d280b64b0 2024-09-12T02:03:26.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.769+0000 7f8d27fff640 1 --2- 172.21.15.19:0/3173246054 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d1406be30 0x7f8d1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:26.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.769+0000 7f8d27fff640 1 --2- 172.21.15.19:0/3173246054 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d1406be30 0x7f8d1406e2f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c034000 tx=0x7f8d1c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:26.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:26.773+0000 7f8d257fa640 1 -- 172.21.15.19:0/3173246054 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d18059100 con 0x7f8d280b64b0 2024-09-12T02:03:27.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.019+0000 7f8d2eee4640 1 -- 172.21.15.19:0/3173246054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f8d280ba470 con 0x7f8d280b64b0 2024-09-12T02:03:27.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.637+0000 7f8d257fa640 1 -- 172.21.15.19:0/3173246054 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v131) ==== 101+0+0 (secure 0 0 0) 0x7f8d1805d400 con 0x7f8d280b64b0 2024-09-12T02:03:27.637 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:03:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.639+0000 7f8d2eee4640 1 -- 172.21.15.19:0/3173246054 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d1406be30 msgr2=0x7f8d1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.639+0000 7f8d2eee4640 1 --2- 172.21.15.19:0/3173246054 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d1406be30 0x7f8d1406e2f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c034000 tx=0x7f8d1c02e000 comp rx=0 tx=0).stop 2024-09-12T02:03:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.639+0000 7f8d2eee4640 1 -- 172.21.15.19:0/3173246054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d280b64b0 msgr2=0x7f8d281570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.639+0000 7f8d2eee4640 1 --2- 172.21.15.19:0/3173246054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d280b64b0 0x7f8d281570d0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800e9b0 tx=0x7f8d1800ee70 comp rx=0 tx=0).stop 2024-09-12T02:03:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.640+0000 7f8d2eee4640 1 -- 172.21.15.19:0/3173246054 shutdown_connections 2024-09-12T02:03:27.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.640+0000 7f8d2eee4640 1 --2- 172.21.15.19:0/3173246054 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d1406be30 0x7f8d1406e2f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.640+0000 7f8d2eee4640 1 --2- 172.21.15.19:0/3173246054 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d28162060 0x7f8d280ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.640+0000 7f8d2eee4640 1 --2- 172.21.15.19:0/3173246054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d28161c80 0x7f8d280b9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.640+0000 7f8d2eee4640 1 --2- 172.21.15.19:0/3173246054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d280b64b0 0x7f8d281570d0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.640+0000 7f8d2eee4640 1 -- 172.21.15.19:0/3173246054 >> 172.21.15.19:0/3173246054 conn(0x7f8d280d44f0 msgr2=0x7f8d280b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:27.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.640+0000 7f8d2eee4640 1 -- 172.21.15.19:0/3173246054 shutdown_connections 2024-09-12T02:03:27.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.640+0000 7f8d2eee4640 1 -- 172.21.15.19:0/3173246054 wait complete. 2024-09-12T02:03:27.655 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:03:27.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.701+0000 7f0b269dcf40 1 Processor -- start 2024-09-12T02:03:27.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.701+0000 7f0b269dcf40 1 -- start start 2024-09-12T02:03:27.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.702+0000 7f0b269dcf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5555b6baa180 0x5555b6c7e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.702+0000 7f0b269dcf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5555b6bd8050 0x5555b6c5ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.702+0000 7f0b269dcf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5555b6c62080 0x5555b6c80b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.702+0000 7f0b269dcf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5555b6af9510 con 0x5555b6c62080 2024-09-12T02:03:27.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.702+0000 7f0b269dcf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5555b6b52c50 con 0x5555b6baa180 2024-09-12T02:03:27.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.702+0000 7f0b269dcf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5555b6ba6dc0 con 0x5555b6bd8050 2024-09-12T02:03:27.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.702+0000 7f0b24cd5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5555b6c62080 0x5555b6c80b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.702+0000 7f0b24cd5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5555b6c62080 0x5555b6c80b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44290/0 (socket says 172.21.15.19:44290) 2024-09-12T02:03:27.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.702+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1285802222 learned_addr learned my addr 172.21.15.19:0/1285802222 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:27.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.702+0000 7f0b244d4640 1 --2- 172.21.15.19:0/1285802222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5555b6baa180 0x5555b6c7e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.702+0000 7f0b23cd3640 1 --2- 172.21.15.19:0/1285802222 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5555b6bd8050 0x5555b6c5ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.702+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1285802222 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5555b6bd8050 msgr2=0x5555b6c5ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:27.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.702+0000 7f0b24cd5640 1 --2- 172.21.15.19:0/1285802222 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5555b6bd8050 0x5555b6c5ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.702+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1285802222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5555b6baa180 msgr2=0x5555b6c7e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:27.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.702+0000 7f0b24cd5640 1 --2- 172.21.15.19:0/1285802222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5555b6baa180 0x5555b6c7e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.702+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1285802222 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555b6c81080 con 0x5555b6c62080 2024-09-12T02:03:27.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.702+0000 7f0b244d4640 1 --2- 172.21.15.19:0/1285802222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5555b6baa180 0x5555b6c7e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:27.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.703+0000 7f0b24cd5640 1 --2- 172.21.15.19:0/1285802222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5555b6c62080 0x5555b6c80b40 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c001700 tx=0x7f0b1c001bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfee7826c26e2676 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:27.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.703+0000 7f0b22cd1640 1 -- 172.21.15.19:0/1285802222 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c016070 con 0x5555b6c62080 2024-09-12T02:03:27.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.703+0000 7f0b22cd1640 1 -- 172.21.15.19:0/1285802222 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b1c004520 con 0x5555b6c62080 2024-09-12T02:03:27.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.703+0000 7f0b22cd1640 1 -- 172.21.15.19:0/1285802222 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c004910 con 0x5555b6c62080 2024-09-12T02:03:27.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.703+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1285802222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5555b6c62080 msgr2=0x5555b6c80b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.703+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1285802222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5555b6c62080 0x5555b6c80b40 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c001700 tx=0x7f0b1c001bc0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.703+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1285802222 shutdown_connections 2024-09-12T02:03:27.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.703+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1285802222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5555b6c62080 0x5555b6c80b40 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.703+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1285802222 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5555b6bd8050 0x5555b6c5ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.703+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1285802222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5555b6baa180 0x5555b6c7e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.703+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1285802222 >> 172.21.15.19:0/1285802222 conn(0x5555b6ba79e0 msgr2=0x5555b6ba7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:27.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.703+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1285802222 shutdown_connections 2024-09-12T02:03:27.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.703+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1285802222 wait complete. 2024-09-12T02:03:27.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.704+0000 7f0b269dcf40 1 Processor -- start 2024-09-12T02:03:27.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.704+0000 7f0b269dcf40 1 -- start start 2024-09-12T02:03:27.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.705+0000 7f0b269dcf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5555b6baa180 0x5555b6c64800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.705+0000 7f0b269dcf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5555b6bd8050 0x5555b6bedc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.705+0000 7f0b269dcf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5555b6c62080 0x5555b6c7d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.705+0000 7f0b269dcf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5555b6c66df0 con 0x5555b6baa180 2024-09-12T02:03:27.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.705+0000 7f0b269dcf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5555b6c67640 con 0x5555b6c62080 2024-09-12T02:03:27.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.705+0000 7f0b269dcf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5555b6c7f320 con 0x5555b6bd8050 2024-09-12T02:03:27.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.705+0000 7f0b244d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5555b6baa180 0x5555b6c64800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.705+0000 7f0b23cd3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5555b6bd8050 0x5555b6bedc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.705+0000 7f0b244d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5555b6baa180 0x5555b6c64800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44294/0 (socket says 172.21.15.19:44294) 2024-09-12T02:03:27.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.705+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 learned_addr learned my addr 172.21.15.19:0/1931274588 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:27.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.705+0000 7f0b24cd5640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5555b6c62080 0x5555b6c7d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.705+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5555b6bd8050 msgr2=0x5555b6bedc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.705+0000 7f0b244d4640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5555b6bd8050 0x5555b6bedc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.705+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5555b6c62080 msgr2=0x5555b6c7d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.705+0000 7f0b244d4640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5555b6c62080 0x5555b6c7d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.705+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555b6c820a0 con 0x5555b6baa180 2024-09-12T02:03:27.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.705+0000 7f0b23cd3640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5555b6bd8050 0x5555b6bedc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:03:27.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.705+0000 7f0b244d4640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5555b6baa180 0x5555b6c64800 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400df70 tx=0x7f0b1400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:27.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.706+0000 7f0b21ccf640 1 -- 172.21.15.19:0/1931274588 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1400be60 con 0x5555b6baa180 2024-09-12T02:03:27.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.706+0000 7f0b21ccf640 1 -- 172.21.15.19:0/1931274588 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b14016070 con 0x5555b6baa180 2024-09-12T02:03:27.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.706+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555b6bf1a60 con 0x5555b6baa180 2024-09-12T02:03:27.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.706+0000 7f0b21ccf640 1 -- 172.21.15.19:0/1931274588 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b140116a0 con 0x5555b6baa180 2024-09-12T02:03:27.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.706+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555b6ba7ec0 con 0x5555b6baa180 2024-09-12T02:03:27.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.707+0000 7f0b21ccf640 1 -- 172.21.15.19:0/1931274588 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b14011840 con 0x5555b6baa180 2024-09-12T02:03:27.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.708+0000 7f0b21ccf640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0b1006a810 0x7f0b1006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.708+0000 7f0b21ccf640 1 -- 172.21.15.19:0/1931274588 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6991+0+0 (secure 0 0 0) 0x7f0b14089e00 con 0x5555b6baa180 2024-09-12T02:03:27.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.708+0000 7f0b23cd3640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0b1006a810 0x7f0b1006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.711 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:03:27.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.708+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5555b6d078a0 0x5555b6d21ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.708+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6c822c0 con 0x5555b6d078a0 2024-09-12T02:03:27.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.708+0000 7f0b24cd5640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5555b6d078a0 0x5555b6d21ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.708+0000 7f0b23cd3640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0b1006a810 0x7f0b1006ccd0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0b18057000 tx=0x7f0b18052000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:27.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.709+0000 7f0b24cd5640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5555b6d078a0 0x5555b6d21ec0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:27.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.710+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v103'257 uv231 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.710+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6bee170 con 0x5555b6d078a0 2024-09-12T02:03:27.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.711+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v103'258 uv258 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.711+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6c5e7e0 con 0x5555b6d078a0 2024-09-12T02:03:27.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.712+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v103'259 uv259 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.713 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:03:27.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.712+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d23410 con 0x5555b6d078a0 2024-09-12T02:03:27.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.713+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v103'260 uv260 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.713+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d237b0 con 0x5555b6d078a0 2024-09-12T02:03:27.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.714+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v103'261 uv261 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.714+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22400 con 0x5555b6d078a0 2024-09-12T02:03:27.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.715+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v103'262 uv262 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.716+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d227a0 con 0x5555b6d078a0 2024-09-12T02:03:27.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.717+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v103'263 uv237 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.717+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.718+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v103'264 uv264 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.718+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.719 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:03:27.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.719+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v103'265 uv265 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.719+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.720+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v103'266 uv266 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.720+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.721+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v103'267 uv267 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.721+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.722+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v103'268 uv268 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.722+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.723+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v103'269 uv244 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.723+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.724+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v103'270 uv270 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.724+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.725 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:03:27.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.725+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v103'271 uv271 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.725+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.726+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v103'272 uv272 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.726+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.727+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v103'273 uv273 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.727+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.728+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v103'274 uv274 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.728+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.728+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v103'275 uv275 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.729+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.729+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v103'276 uv250 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.730+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.730+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v103'277 uv277 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.730+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.731 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:03:27.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.731+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v103'278 uv278 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.731+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.732+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v103'279 uv279 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.732+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.733+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v103'280 uv280 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.733+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.734+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v103'281 uv281 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.734+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.735+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v103'282 uv256 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.735+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.736+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v103'283 uv283 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.736+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.738 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:03:27.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.738+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v103'284 uv284 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.738+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.739+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v103'285 uv285 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.739+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.740+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v103'286 uv286 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.740+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d078a0 2024-09-12T02:03:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.741+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v103'287 uv287 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d078a0 2024-09-12T02:03:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.741+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5555b6d23b50 0x5555b6d25f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.741+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d22b40 con 0x5555b6d23b50 2024-09-12T02:03:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.741+0000 7f0b244d4640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5555b6d23b50 0x5555b6d25f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.741+0000 7f0b244d4640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5555b6d23b50 0x5555b6d25f40 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:27.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.743+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v103'199 uv182 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.743+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d26480 con 0x5555b6d23b50 2024-09-12T02:03:27.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.744+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v103'200 uv200 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.744+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d26820 con 0x5555b6d23b50 2024-09-12T02:03:27.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.745+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v103'201 uv201 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.746 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:03:27.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.745+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d27070 con 0x5555b6d23b50 2024-09-12T02:03:27.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.746+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v103'202 uv202 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.746+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d27410 con 0x5555b6d23b50 2024-09-12T02:03:27.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.747+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v103'203 uv203 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.748+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d277b0 con 0x5555b6d23b50 2024-09-12T02:03:27.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.748+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v103'204 uv187 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.749+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d27b50 con 0x5555b6d23b50 2024-09-12T02:03:27.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.750+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v103'205 uv205 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.750+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d27ef0 con 0x5555b6d23b50 2024-09-12T02:03:27.751 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:03:27.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.751+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v103'206 uv206 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.751+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d27ef0 con 0x5555b6d23b50 2024-09-12T02:03:27.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.752+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v103'207 uv207 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.752+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d27ef0 con 0x5555b6d23b50 2024-09-12T02:03:27.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.753+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v103'208 uv208 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.753+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d27ef0 con 0x5555b6d23b50 2024-09-12T02:03:27.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.755+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v103'209 uv192 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.755+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d27ef0 con 0x5555b6d23b50 2024-09-12T02:03:27.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.756+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v103'210 uv210 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.756+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d27ef0 con 0x5555b6d23b50 2024-09-12T02:03:27.757 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:03:27.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.757+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v103'211 uv211 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.757+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d2c370 con 0x5555b6d23b50 2024-09-12T02:03:27.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.758+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v103'212 uv212 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.758+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d2c370 con 0x5555b6d23b50 2024-09-12T02:03:27.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.760+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v103'213 uv213 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.760+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d27ef0 con 0x5555b6d23b50 2024-09-12T02:03:27.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.761+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v103'214 uv198 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.761+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d27ef0 con 0x5555b6d23b50 2024-09-12T02:03:27.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.762+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v103'215 uv215 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.762+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d27ef0 con 0x5555b6d23b50 2024-09-12T02:03:27.763 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:03:27.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.763+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v103'216 uv216 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.763+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d28f00 con 0x5555b6d23b50 2024-09-12T02:03:27.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.764+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v103'217 uv217 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.764+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d28f00 con 0x5555b6d23b50 2024-09-12T02:03:27.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.765+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v103'218 uv218 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.765+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d27ef0 con 0x5555b6d23b50 2024-09-12T02:03:27.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.766+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v103'219 uv219 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d23b50 2024-09-12T02:03:27.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.766+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5555b6d28400 0x5555b6d2a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.766+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d2adc0 con 0x5555b6d28400 2024-09-12T02:03:27.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.766+0000 7f0b23cd3640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5555b6d28400 0x5555b6d2a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.766+0000 7f0b23cd3640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5555b6d28400 0x5555b6d2a7f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:27.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.767+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v103'51 uv50 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.767+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d2b290 con 0x5555b6d28400 2024-09-12T02:03:27.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.768+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v103'52 uv52 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.768+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d2b770 con 0x5555b6d28400 2024-09-12T02:03:27.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.769+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v103'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.770 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:03:27.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.769+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d2d020 con 0x5555b6d28400 2024-09-12T02:03:27.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.770+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v103'54 uv54 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.770+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d2d3c0 con 0x5555b6d28400 2024-09-12T02:03:27.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.771+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v103'55 uv55 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.771+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d2c010 con 0x5555b6d28400 2024-09-12T02:03:27.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.772+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v103'56 uv56 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.772+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5555b6d2c910 0x5555b6d2f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.772+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d2fcb0 con 0x5555b6d2c910 2024-09-12T02:03:27.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.772+0000 7f0b24cd5640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5555b6d2c910 0x5555b6d2f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.773+0000 7f0b24cd5640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5555b6d2c910 0x5555b6d2f770 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:27.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.774+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v103'42 uv41 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d2c910 2024-09-12T02:03:27.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.774+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d2fcb0 con 0x5555b6d2c910 2024-09-12T02:03:27.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.775+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v103'43 uv43 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d2c910 2024-09-12T02:03:27.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.775+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d2fd30 con 0x5555b6d2c910 2024-09-12T02:03:27.778 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:03:27.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.778+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v103'44 uv44 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d2c910 2024-09-12T02:03:27.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.778+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d30120 con 0x5555b6d2c910 2024-09-12T02:03:27.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.781+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v103'45 uv45 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d2c910 2024-09-12T02:03:27.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.781+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5555b6d30630 0x5555b6d32a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.781+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d32fb0 con 0x5555b6d30630 2024-09-12T02:03:27.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.781+0000 7f0b244d4640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5555b6d30630 0x5555b6d32a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.781+0000 7f0b244d4640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5555b6d30630 0x5555b6d32a20 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:27.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.783+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v103'51 uv50 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.783+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33070 con 0x5555b6d30630 2024-09-12T02:03:27.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.786+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v103'52 uv52 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.786+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d30630 2024-09-12T02:03:27.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.789+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v103'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.788 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:03:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.789+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d34470 con 0x5555b6d30630 2024-09-12T02:03:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.790+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v103'54 uv54 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.790+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d34470 con 0x5555b6d30630 2024-09-12T02:03:27.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.790+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v103'55 uv55 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.790+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d30630 2024-09-12T02:03:27.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.791+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v103'56 uv56 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.791+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d2c910 2024-09-12T02:03:27.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.793+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v103'94 uv88 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d2c910 2024-09-12T02:03:27.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.793+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d2c910 2024-09-12T02:03:27.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.794+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v103'95 uv95 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d2c910 2024-09-12T02:03:27.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.794+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d2c910 2024-09-12T02:03:27.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.795+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v103'96 uv96 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d2c910 2024-09-12T02:03:27.795 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:03:27.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.795+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d34470 con 0x5555b6d2c910 2024-09-12T02:03:27.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.796+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v103'97 uv97 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d2c910 2024-09-12T02:03:27.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.796+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d34470 con 0x5555b6d2c910 2024-09-12T02:03:27.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.797+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v103'98 uv98 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d2c910 2024-09-12T02:03:27.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.797+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d2c910 2024-09-12T02:03:27.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.799+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v103'99 uv99 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d2c910 2024-09-12T02:03:27.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.799+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d2c910 2024-09-12T02:03:27.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.800+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v103'100 uv93 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d2c910 2024-09-12T02:03:27.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.800+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d2c910 2024-09-12T02:03:27.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.801+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v103'101 uv101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d2c910 2024-09-12T02:03:27.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.801+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d2c910 2024-09-12T02:03:27.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.802+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v103'102 uv102 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d2c910 2024-09-12T02:03:27.802 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:03:27.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.802+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d2c910 2024-09-12T02:03:27.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.803+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v103'103 uv103 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d2c910 2024-09-12T02:03:27.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.803+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d2c910 2024-09-12T02:03:27.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.804+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v103'104 uv104 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d2c910 2024-09-12T02:03:27.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.804+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d2c910 2024-09-12T02:03:27.805 INFO:teuthology.orchestra.run.smithi019.stdout:Write #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:03:27.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.805+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v103'43 uv43 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d2c910 2024-09-12T02:03:27.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.805+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d2c910 2024-09-12T02:03:27.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.806+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [write 0~70] v103'44 uv44 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d2c910 2024-09-12T02:03:27.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.806+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d2c910 2024-09-12T02:03:27.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.807+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [omap-set-header] v103'45 uv45 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0b1c00f070 con 0x5555b6d2c910 2024-09-12T02:03:27.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.807+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:83 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d30630 2024-09-12T02:03:27.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.808+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(83 605.00000000 [create] v103'51 uv50 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.808+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:84 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d30630 2024-09-12T02:03:27.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.809+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(84 605.00000000 [delete] v103'52 uv52 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.809+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d30630 2024-09-12T02:03:27.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.810+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(85 605.00000000 [create] v103'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.811 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:03:27.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.810+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d34470 con 0x5555b6d30630 2024-09-12T02:03:27.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.811+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(86 605.00000000 [setxattr (30)] v103'54 uv54 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.811+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d34470 con 0x5555b6d30630 2024-09-12T02:03:27.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.812+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(87 605.00000000 [setxattr (62)] v103'55 uv55 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.812+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d30630 2024-09-12T02:03:27.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.813+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(88 605.00000000 [omap-set-header] v103'56 uv56 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.813+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d30630 2024-09-12T02:03:27.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.814+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(89 mds0_inotable [create] v103'84 uv78 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.814+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d30630 2024-09-12T02:03:27.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.815+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(90 mds0_inotable [delete] v103'85 uv85 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.816+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33460 con 0x5555b6d30630 2024-09-12T02:03:27.817 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:03:27.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.817+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(91 mds0_inotable [create] v103'86 uv86 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.817+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33820 con 0x5555b6d30630 2024-09-12T02:03:27.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.818+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(92 mds0_inotable [write 0~34] v103'87 uv87 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.818+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33820 con 0x5555b6d30630 2024-09-12T02:03:27.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.819+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v103'88 uv88 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.819+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33820 con 0x5555b6d30630 2024-09-12T02:03:27.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.820+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(94 100.00000000 [create] v103'89 uv83 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.820+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33820 con 0x5555b6d30630 2024-09-12T02:03:27.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.821+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(95 100.00000000 [delete] v103'90 uv90 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.821+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33820 con 0x5555b6d30630 2024-09-12T02:03:27.822 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:03:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.822+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(96 100.00000000 [create] v103'91 uv91 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.822+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d33820 con 0x5555b6d30630 2024-09-12T02:03:27.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.823+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(97 100.00000000 [omap-set-header] v103'92 uv92 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.823+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36630 con 0x5555b6d30630 2024-09-12T02:03:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.825+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v103'93 uv93 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.825+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5555b6d341e0 0x5555b6d36a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.825+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:99 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d365d0 con 0x5555b6d341e0 2024-09-12T02:03:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.825+0000 7f0b23cd3640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5555b6d341e0 0x5555b6d36a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.825+0000 7f0b23cd3640 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5555b6d341e0 0x5555b6d36a20 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:27.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.827+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(99 mds0_sessionmap [create] v103'40 uv39 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d341e0 2024-09-12T02:03:27.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.827+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:100 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d365d0 con 0x5555b6d341e0 2024-09-12T02:03:27.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.828+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(100 mds0_sessionmap [delete] v103'41 uv41 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d341e0 2024-09-12T02:03:27.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.828+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d365d0 con 0x5555b6d341e0 2024-09-12T02:03:27.829 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:03:27.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.829+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(101 mds0_sessionmap [create] v103'42 uv42 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d341e0 2024-09-12T02:03:27.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.829+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d341e0 2024-09-12T02:03:27.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.830+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v103'43 uv43 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d341e0 2024-09-12T02:03:27.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.830+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:103 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d30630 2024-09-12T02:03:27.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.831+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(103 609.00000000 [create] v103'51 uv50 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.831+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:104 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d30630 2024-09-12T02:03:27.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.832+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(104 609.00000000 [delete] v103'52 uv52 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.832+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d30630 2024-09-12T02:03:27.833 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:03:27.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.833+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(105 609.00000000 [create] v103'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.833+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d37f70 con 0x5555b6d30630 2024-09-12T02:03:27.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.835+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v103'54 uv54 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.835+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d37f70 con 0x5555b6d30630 2024-09-12T02:03:27.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.835+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v103'55 uv55 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.835+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d30630 2024-09-12T02:03:27.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.836+0000 7f0b244d4640 1 -- 172.21.15.19:0/1931274588 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(108 609.00000000 [omap-set-header] v103'56 uv56 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b1400e040 con 0x5555b6d30630 2024-09-12T02:03:27.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.836+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:109 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d28400 2024-09-12T02:03:27.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.837+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(109 400.00000000 [create] v103'42 uv41 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.837+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:110 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d28400 2024-09-12T02:03:27.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.839+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(110 400.00000000 [delete] v103'43 uv43 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.839+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d28400 2024-09-12T02:03:27.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.841+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(111 400.00000000 [create] v103'44 uv44 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.840 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:03:27.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.841+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d28400 2024-09-12T02:03:27.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.841+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(112 400.00000000 [write 0~22] v103'45 uv45 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.841+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d28400 2024-09-12T02:03:27.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.842+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(113 400.00000000 [omap-set-header] v103'46 uv46 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.842+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d28400 2024-09-12T02:03:27.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.843+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(114 100.00000000.inode [create] v103'107 uv99 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.843+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d28400 2024-09-12T02:03:27.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.844+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(115 100.00000000.inode [delete] v103'108 uv108 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.844+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d28400 2024-09-12T02:03:27.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.845+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(116 100.00000000.inode [create] v103'109 uv109 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.845 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:03:27.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.845+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d28400 2024-09-12T02:03:27.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.846+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v103'110 uv110 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.846+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d28400 2024-09-12T02:03:27.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.846+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v103'111 uv111 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.847+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d28400 2024-09-12T02:03:27.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.848+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(119 1.00000000 [create] v103'112 uv106 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.848+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d28400 2024-09-12T02:03:27.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.849+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(120 1.00000000 [delete] v103'113 uv113 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.849+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d28400 2024-09-12T02:03:27.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.850+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(121 1.00000000 [create] v103'114 uv114 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.850 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:03:27.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.850+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d37f70 con 0x5555b6d28400 2024-09-12T02:03:27.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.851+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v103'115 uv115 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.851+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d37f70 con 0x5555b6d28400 2024-09-12T02:03:27.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.852+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v103'116 uv116 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.852+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d36f60 con 0x5555b6d28400 2024-09-12T02:03:27.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.853+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(124 1.00000000 [omap-set-header] v103'117 uv117 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.853+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5555b6d37410 con 0x5555b6d28400 2024-09-12T02:03:27.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b23cd3640 1 -- 172.21.15.19:0/1931274588 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v103'118 uv118 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0b180539c0 con 0x5555b6d28400 2024-09-12T02:03:27.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5555b6d23b50 msgr2=0x5555b6d25f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5555b6d23b50 0x5555b6d25f40 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5555b6d078a0 msgr2=0x5555b6d21ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5555b6d078a0 0x5555b6d21ec0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5555b6d2c910 msgr2=0x5555b6d2f770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5555b6d2c910 0x5555b6d2f770 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5555b6d341e0 msgr2=0x5555b6d36a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5555b6d341e0 0x5555b6d36a20 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5555b6d28400 msgr2=0x5555b6d2a7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5555b6d28400 0x5555b6d2a7f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5555b6d30630 msgr2=0x5555b6d32a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5555b6d30630 0x5555b6d32a20 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 reap_dead start 2024-09-12T02:03:27.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b24cd5640 1 -- 172.21.15.19:0/1931274588 reap_dead start 2024-09-12T02:03:27.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0b1006a810 msgr2=0x7f0b1006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0b1006a810 0x7f0b1006ccd0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0b18057000 tx=0x7f0b18052000 comp rx=0 tx=0).stop 2024-09-12T02:03:27.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5555b6baa180 msgr2=0x5555b6c64800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5555b6baa180 0x5555b6c64800 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400df70 tx=0x7f0b1400b5b0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 shutdown_connections 2024-09-12T02:03:27.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0b1006a810 0x7f0b1006ccd0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 --2- 172.21.15.19:0/1931274588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5555b6baa180 0x5555b6c64800 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 >> 172.21.15.19:0/1931274588 conn(0x5555b6ba79e0 msgr2=0x5555b6c81250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:27.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 shutdown_connections 2024-09-12T02:03:27.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.854+0000 7f0b269dcf40 1 -- 172.21.15.19:0/1931274588 wait complete. 2024-09-12T02:03:27.858 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds0_inotable 2024-09-12T02:03:27.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.900+0000 7f529a242f40 1 Processor -- start 2024-09-12T02:03:27.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.900+0000 7f529a242f40 1 -- start start 2024-09-12T02:03:27.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.901+0000 7f529a242f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562b6b12f180 0x562b6b203fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.901+0000 7f529a242f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b6b15d050 0x562b6b176380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.901+0000 7f529a242f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b6b1e7080 0x562b6b2961f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.901+0000 7f529a242f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562b6b12bae0 con 0x562b6b15d050 2024-09-12T02:03:27.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.901+0000 7f529a242f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562b6b07e510 con 0x562b6b1e7080 2024-09-12T02:03:27.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.901+0000 7f529a242f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562b6b12bdc0 con 0x562b6b12f180 2024-09-12T02:03:27.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.901+0000 7f5297537640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b6b15d050 0x562b6b176380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.901+0000 7f5297537640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b6b15d050 0x562b6b176380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44308/0 (socket says 172.21.15.19:44308) 2024-09-12T02:03:27.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.901+0000 7f5297537640 1 -- 172.21.15.19:0/297528898 learned_addr learned my addr 172.21.15.19:0/297528898 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:27.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.901+0000 7f5297d38640 1 --2- 172.21.15.19:0/297528898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562b6b12f180 0x562b6b203fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.901+0000 7f5298539640 1 --2- 172.21.15.19:0/297528898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b6b1e7080 0x562b6b2961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.901+0000 7f5297537640 1 -- 172.21.15.19:0/297528898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562b6b12f180 msgr2=0x562b6b203fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:27.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.901+0000 7f5297537640 1 --2- 172.21.15.19:0/297528898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562b6b12f180 0x562b6b203fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.901+0000 7f5297537640 1 -- 172.21.15.19:0/297528898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b6b1e7080 msgr2=0x562b6b2961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:27.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.901+0000 7f5297537640 1 --2- 172.21.15.19:0/297528898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b6b1e7080 0x562b6b2961f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.901+0000 7f5297537640 1 -- 172.21.15.19:0/297528898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b6b203b90 con 0x562b6b15d050 2024-09-12T02:03:27.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.902+0000 7f5297537640 1 --2- 172.21.15.19:0/297528898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b6b15d050 0x562b6b176380 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f528c025d20 tx=0x7f528c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b0a016fcfcc1c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:27.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.902+0000 7f5296535640 1 -- 172.21.15.19:0/297528898 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c055070 con 0x562b6b15d050 2024-09-12T02:03:27.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.902+0000 7f5296535640 1 -- 172.21.15.19:0/297528898 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528c051730 con 0x562b6b15d050 2024-09-12T02:03:27.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.902+0000 7f5296535640 1 -- 172.21.15.19:0/297528898 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c051ae0 con 0x562b6b15d050 2024-09-12T02:03:27.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.902+0000 7f529a242f40 1 -- 172.21.15.19:0/297528898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b6b15d050 msgr2=0x562b6b176380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.902+0000 7f529a242f40 1 --2- 172.21.15.19:0/297528898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b6b15d050 0x562b6b176380 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f528c025d20 tx=0x7f528c051000 comp rx=0 tx=0).stop 2024-09-12T02:03:27.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.902+0000 7f529a242f40 1 -- 172.21.15.19:0/297528898 shutdown_connections 2024-09-12T02:03:27.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.902+0000 7f529a242f40 1 --2- 172.21.15.19:0/297528898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b6b1e7080 0x562b6b2961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.902+0000 7f529a242f40 1 --2- 172.21.15.19:0/297528898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b6b15d050 0x562b6b176380 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.902+0000 7f529a242f40 1 --2- 172.21.15.19:0/297528898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562b6b12f180 0x562b6b203fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.902+0000 7f529a242f40 1 -- 172.21.15.19:0/297528898 >> 172.21.15.19:0/297528898 conn(0x562b6b12c9e0 msgr2=0x562b6b12ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:27.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.902+0000 7f529a242f40 1 -- 172.21.15.19:0/297528898 shutdown_connections 2024-09-12T02:03:27.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.902+0000 7f529a242f40 1 -- 172.21.15.19:0/297528898 wait complete. 2024-09-12T02:03:27.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.903+0000 7f529a242f40 1 Processor -- start 2024-09-12T02:03:27.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.903+0000 7f529a242f40 1 -- start start 2024-09-12T02:03:27.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f529a242f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b6b12f180 0x562b6b2000d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f529a242f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b6b15d050 0x562b6b202880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f529a242f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562b6b1e7080 0x562b6b15bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f529a242f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562b6b12d2d0 con 0x562b6b12f180 2024-09-12T02:03:27.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f529a242f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562b6b2044f0 con 0x562b6b15d050 2024-09-12T02:03:27.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f529a242f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562b6b12cff0 con 0x562b6b1e7080 2024-09-12T02:03:27.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f5297d38640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b6b12f180 0x562b6b2000d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f5297d38640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b6b12f180 0x562b6b2000d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44314/0 (socket says 172.21.15.19:44314) 2024-09-12T02:03:27.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f5297d38640 1 -- 172.21.15.19:0/3224539792 learned_addr learned my addr 172.21.15.19:0/3224539792 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f5297537640 1 --2- 172.21.15.19:0/3224539792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b6b15d050 0x562b6b202880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f5298539640 1 --2- 172.21.15.19:0/3224539792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562b6b1e7080 0x562b6b15bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f5297d38640 1 -- 172.21.15.19:0/3224539792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562b6b1e7080 msgr2=0x562b6b15bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f5297d38640 1 --2- 172.21.15.19:0/3224539792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562b6b1e7080 0x562b6b15bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f5297d38640 1 -- 172.21.15.19:0/3224539792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b6b15d050 msgr2=0x562b6b202880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f5297d38640 1 --2- 172.21.15.19:0/3224539792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b6b15d050 0x562b6b202880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f5297d38640 1 -- 172.21.15.19:0/3224539792 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b6b1e51b0 con 0x562b6b12f180 2024-09-12T02:03:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f5297d38640 1 --2- 172.21.15.19:0/3224539792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b6b12f180 0x562b6b2000d0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f52880105f0 tx=0x7f5288010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f5295533640 1 -- 172.21.15.19:0/3224539792 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5288018070 con 0x562b6b12f180 2024-09-12T02:03:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f5295533640 1 -- 172.21.15.19:0/3224539792 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528800b750 con 0x562b6b12f180 2024-09-12T02:03:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f529a242f40 1 -- 172.21.15.19:0/3224539792 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b6b201da0 con 0x562b6b12f180 2024-09-12T02:03:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f5295533640 1 -- 172.21.15.19:0/3224539792 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528800bb00 con 0x562b6b12f180 2024-09-12T02:03:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.904+0000 7f529a242f40 1 -- 172.21.15.19:0/3224539792 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b6b200610 con 0x562b6b12f180 2024-09-12T02:03:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.906+0000 7f5295533640 1 -- 172.21.15.19:0/3224539792 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f528801b070 con 0x562b6b12f180 2024-09-12T02:03:27.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.906+0000 7f5295533640 1 --2- 172.21.15.19:0/3224539792 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f528406a810 0x7f528406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.906+0000 7f5295533640 1 -- 172.21.15.19:0/3224539792 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6991+0+0 (secure 0 0 0) 0x7f528808a4a0 con 0x562b6b12f180 2024-09-12T02:03:27.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.906+0000 7f5297537640 1 --2- 172.21.15.19:0/3224539792 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f528406a810 0x7f528406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.907+0000 7f529a242f40 1 --2- 172.21.15.19:0/3224539792 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562b6b158330 0x562b6b1ff190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.907+0000 7f529a242f40 1 -- 172.21.15.19:0/3224539792 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:1 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x562b6b1ff6d0 con 0x562b6b158330 2024-09-12T02:03:27.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.907+0000 7f5298539640 1 --2- 172.21.15.19:0/3224539792 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562b6b158330 0x562b6b1ff190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.907+0000 7f5297537640 1 --2- 172.21.15.19:0/3224539792 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f528406a810 0x7f528406ccd0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f528c064000 tx=0x7f528c053000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:27.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.907+0000 7f5298539640 1 --2- 172.21.15.19:0/3224539792 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562b6b158330 0x562b6b1ff190 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:27.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.908+0000 7f5298539640 1 -- 172.21.15.19:0/3224539792 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(1 mds0_inotable [delete] v103'94 uv94 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5290011610 con 0x562b6b158330 2024-09-12T02:03:27.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.908+0000 7f529a242f40 1 -- 172.21.15.19:0/3224539792 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562b6b158330 msgr2=0x562b6b1ff190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.908+0000 7f529a242f40 1 --2- 172.21.15.19:0/3224539792 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562b6b158330 0x562b6b1ff190 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.908+0000 7f529a242f40 1 -- 172.21.15.19:0/3224539792 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f528406a810 msgr2=0x7f528406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.908+0000 7f529a242f40 1 --2- 172.21.15.19:0/3224539792 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f528406a810 0x7f528406ccd0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f528c064000 tx=0x7f528c053000 comp rx=0 tx=0).stop 2024-09-12T02:03:27.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.909+0000 7f529a242f40 1 -- 172.21.15.19:0/3224539792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b6b12f180 msgr2=0x562b6b2000d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.909+0000 7f529a242f40 1 --2- 172.21.15.19:0/3224539792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b6b12f180 0x562b6b2000d0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f52880105f0 tx=0x7f5288010ab0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.909+0000 7f5298539640 1 -- 172.21.15.19:0/3224539792 reap_dead start 2024-09-12T02:03:27.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.909+0000 7f529a242f40 1 -- 172.21.15.19:0/3224539792 shutdown_connections 2024-09-12T02:03:27.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.909+0000 7f529a242f40 1 -- 172.21.15.19:0/3224539792 >> 172.21.15.19:0/3224539792 conn(0x562b6b12c9e0 msgr2=0x562b6b12ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:27.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.909+0000 7f529a242f40 1 -- 172.21.15.19:0/3224539792 shutdown_connections 2024-09-12T02:03:27.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:27.909+0000 7f529a242f40 1 -- 172.21.15.19:0/3224539792 wait complete. 2024-09-12T02:03:27.913 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:03:28.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.057+0000 7f602607b640 1 Processor -- start 2024-09-12T02:03:28.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.057+0000 7f602607b640 1 -- start start 2024-09-12T02:03:28.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.058+0000 7f602607b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6020162e30 0x7f602006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:28.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.058+0000 7f602607b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f60200cf280 0x7f60200d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.058+0000 7f602607b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f602015ff70 con 0x7f6020162340 2024-09-12T02:03:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.058+0000 7f602607b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f602006de90 con 0x7f60200cf280 2024-09-12T02:03:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.058+0000 7f602607b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6020163270 con 0x7f6020162e30 2024-09-12T02:03:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.058+0000 7f601ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f60200cf280 0x7f60200d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.058+0000 7f601ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f60200cf280 0x7f60200d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44322/0 (socket says 172.21.15.19:44322) 2024-09-12T02:03:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.058+0000 7f601ffff640 1 -- 172.21.15.19:0/1968257838 learned_addr learned my addr 172.21.15.19:0/1968257838 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.058+0000 7f601effd640 1 --2- 172.21.15.19:0/1968257838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6020162e30 0x7f602006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.058+0000 7f601ffff640 1 -- 172.21.15.19:0/1968257838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6020162e30 msgr2=0x7f602006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.058+0000 7f601ffff640 1 --2- 172.21.15.19:0/1968257838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6020162e30 0x7f602006d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.058+0000 7f601ffff640 1 -- 172.21.15.19:0/1968257838 >> v1:172.21.15.135:6789/0 conn(0x7f6020162340 legacy=0x7f6020162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.058+0000 7f601ffff640 1 -- 172.21.15.19:0/1968257838 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60200d4d10 con 0x7f60200cf280 2024-09-12T02:03:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.059+0000 7f601ffff640 1 --2- 172.21.15.19:0/1968257838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60200cf280 0x7f60200d2990 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f6018009e50 tx=0x7f601802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c91b744d2e8ae7f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.059+0000 7f601e7fc640 1 -- 172.21.15.19:0/1968257838 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018036070 con 0x7f60200cf280 2024-09-12T02:03:28.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.059+0000 7f601e7fc640 1 -- 172.21.15.19:0/1968257838 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6018031600 con 0x7f60200cf280 2024-09-12T02:03:28.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.059+0000 7f601e7fc640 1 -- 172.21.15.19:0/1968257838 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60180319d0 con 0x7f60200cf280 2024-09-12T02:03:28.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.060+0000 7f602607b640 1 -- 172.21.15.19:0/1968257838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60200cf280 msgr2=0x7f60200d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:28.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.060+0000 7f602607b640 1 --2- 172.21.15.19:0/1968257838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60200cf280 0x7f60200d2990 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f6018009e50 tx=0x7f601802a680 comp rx=0 tx=0).stop 2024-09-12T02:03:28.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.060+0000 7f602607b640 1 -- 172.21.15.19:0/1968257838 shutdown_connections 2024-09-12T02:03:28.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.060+0000 7f602607b640 1 --2- 172.21.15.19:0/1968257838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60200cf280 0x7f60200d2990 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.060+0000 7f602607b640 1 --2- 172.21.15.19:0/1968257838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6020162e30 0x7f602006d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.060+0000 7f602607b640 1 -- 172.21.15.19:0/1968257838 >> 172.21.15.19:0/1968257838 conn(0x7f602008bfc0 msgr2=0x7f60200d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:28.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.060+0000 7f602607b640 1 -- 172.21.15.19:0/1968257838 shutdown_connections 2024-09-12T02:03:28.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.060+0000 7f602607b640 1 -- 172.21.15.19:0/1968257838 wait complete. 2024-09-12T02:03:28.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.061+0000 7f602607b640 1 Processor -- start 2024-09-12T02:03:28.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.061+0000 7f602607b640 1 -- start start 2024-09-12T02:03:28.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.062+0000 7f602607b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60200cf280 0x7f60200ce040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:28.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.062+0000 7f602607b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6020162340 0x7f60200cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:28.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.062+0000 7f602607b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6020162e30 0x7f602014b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:28.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.062+0000 7f602607b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f60200cf710 con 0x7f6020162e30 2024-09-12T02:03:28.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.062+0000 7f602607b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f60200d2470 con 0x7f6020162340 2024-09-12T02:03:28.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.062+0000 7f602607b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f60200d52d0 con 0x7f60200cf280 2024-09-12T02:03:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.062+0000 7f601ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6020162e30 0x7f602014b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.062+0000 7f601ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6020162e30 0x7f602014b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44326/0 (socket says 172.21.15.19:44326) 2024-09-12T02:03:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.062+0000 7f601ffff640 1 -- 172.21.15.19:0/3340737797 learned_addr learned my addr 172.21.15.19:0/3340737797 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.062+0000 7f601effd640 1 --2- 172.21.15.19:0/3340737797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6020162340 0x7f60200cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.062+0000 7f601f7fe640 1 --2- 172.21.15.19:0/3340737797 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60200cf280 0x7f60200ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.062+0000 7f601ffff640 1 -- 172.21.15.19:0/3340737797 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60200cf280 msgr2=0x7f60200ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.062+0000 7f601ffff640 1 --2- 172.21.15.19:0/3340737797 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60200cf280 0x7f60200ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.062+0000 7f601ffff640 1 -- 172.21.15.19:0/3340737797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6020162340 msgr2=0x7f60200cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.062+0000 7f601ffff640 1 --2- 172.21.15.19:0/3340737797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6020162340 0x7f60200cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.062+0000 7f601ffff640 1 -- 172.21.15.19:0/3340737797 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60200b7830 con 0x7f6020162e30 2024-09-12T02:03:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.063+0000 7f601ffff640 1 --2- 172.21.15.19:0/3340737797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6020162e30 0x7f602014b920 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f6018034040 tx=0x7f6018004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.063+0000 7f6007fff640 1 -- 172.21.15.19:0/3340737797 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018041020 con 0x7f6020162e30 2024-09-12T02:03:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.063+0000 7f6007fff640 1 -- 172.21.15.19:0/3340737797 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60180077a0 con 0x7f6020162e30 2024-09-12T02:03:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.063+0000 7f602607b640 1 -- 172.21.15.19:0/3340737797 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60200b7b10 con 0x7f6020162e30 2024-09-12T02:03:28.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.063+0000 7f6007fff640 1 -- 172.21.15.19:0/3340737797 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018036040 con 0x7f6020162e30 2024-09-12T02:03:28.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.063+0000 7f602607b640 1 -- 172.21.15.19:0/3340737797 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60200b80d0 con 0x7f6020162e30 2024-09-12T02:03:28.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.064+0000 7f602607b640 1 -- 172.21.15.19:0/3340737797 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f602006d740 con 0x7f6020162e30 2024-09-12T02:03:28.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.064+0000 7f6007fff640 1 -- 172.21.15.19:0/3340737797 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6018044020 con 0x7f6020162e30 2024-09-12T02:03:28.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.065+0000 7f6007fff640 1 --2- 172.21.15.19:0/3340737797 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f600c06be30 0x7f600c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:28.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.065+0000 7f6007fff640 1 -- 172.21.15.19:0/3340737797 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6991+0+0 (secure 0 0 0) 0x7f60180abf70 con 0x7f6020162e30 2024-09-12T02:03:28.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.065+0000 7f601f7fe640 1 --2- 172.21.15.19:0/3340737797 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f600c06be30 0x7f600c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:28.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.065+0000 7f601f7fe640 1 --2- 172.21.15.19:0/3340737797 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f600c06be30 0x7f600c06e2f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6010000f60 tx=0x7f6010009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:28.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.069+0000 7f6007fff640 1 -- 172.21.15.19:0/3340737797 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f601804b030 con 0x7f6020162e30 2024-09-12T02:03:28.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.280+0000 7f602607b640 1 -- 172.21.15.19:0/3340737797 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f60200ba450 con 0x7f6020162e30 2024-09-12T02:03:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.645+0000 7f6007fff640 1 -- 172.21.15.19:0/3340737797 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v132) ==== 162+0+0 (secure 0 0 0) 0x7f6018079ca0 con 0x7f6020162e30 2024-09-12T02:03:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:03:28.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.647+0000 7f602607b640 1 -- 172.21.15.19:0/3340737797 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f600c06be30 msgr2=0x7f600c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:28.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.647+0000 7f602607b640 1 --2- 172.21.15.19:0/3340737797 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f600c06be30 0x7f600c06e2f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6010000f60 tx=0x7f6010009040 comp rx=0 tx=0).stop 2024-09-12T02:03:28.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.647+0000 7f602607b640 1 -- 172.21.15.19:0/3340737797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6020162e30 msgr2=0x7f602014b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:28.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.647+0000 7f602607b640 1 --2- 172.21.15.19:0/3340737797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6020162e30 0x7f602014b920 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f6018034040 tx=0x7f6018004a40 comp rx=0 tx=0).stop 2024-09-12T02:03:28.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.647+0000 7f602607b640 1 -- 172.21.15.19:0/3340737797 shutdown_connections 2024-09-12T02:03:28.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.647+0000 7f602607b640 1 --2- 172.21.15.19:0/3340737797 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f600c06be30 0x7f600c06e2f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.647+0000 7f602607b640 1 --2- 172.21.15.19:0/3340737797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6020162e30 0x7f602014b920 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.647+0000 7f602607b640 1 --2- 172.21.15.19:0/3340737797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6020162340 0x7f60200cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.647+0000 7f602607b640 1 --2- 172.21.15.19:0/3340737797 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60200cf280 0x7f60200ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.647+0000 7f602607b640 1 -- 172.21.15.19:0/3340737797 >> 172.21.15.19:0/3340737797 conn(0x7f602008bfc0 msgr2=0x7f6020160b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:28.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.647+0000 7f602607b640 1 -- 172.21.15.19:0/3340737797 shutdown_connections 2024-09-12T02:03:28.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.647+0000 7f602607b640 1 -- 172.21.15.19:0/3340737797 wait complete. 2024-09-12T02:03:28.652 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:03:28.653+0000 7f10a0adb640 -1 mds.0.inotable: load_2 could not read table: -2 2024-09-12T02:03:28.652 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:03:28.653+0000 7f10a0adb640 -1 log_channel(cluster) log [ERR] : error reading table object 'mds0_inotable' -2 ((2) No such file or directory) 2024-09-12T02:03:28.653 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:03:28.653+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:03:28.653 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:03:28.653+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:03:28.661 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:28.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.764+0000 7f69aa6f8640 1 Processor -- start 2024-09-12T02:03:28.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.764+0000 7f69aa6f8640 1 -- start start 2024-09-12T02:03:28.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69aa6f8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f69a40d30f0 0x7f69a40b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:28.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69aa6f8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69a40d3690 con 0x7f69a415e5f0 2024-09-12T02:03:28.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69aa6f8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69a40d3970 con 0x7f69a40b64c0 2024-09-12T02:03:28.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69aa6f8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f69a406d530 con 0x7f69a40d30f0 2024-09-12T02:03:28.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a3fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f69a415e5f0 0x7f69a40d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44266/0 (socket says 172.21.15.19:44266) 2024-09-12T02:03:28.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a3fff640 1 -- 172.21.15.19:0/3057653595 learned_addr learned my addr 172.21.15.19:0/3057653595 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:28.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a2ffd640 1 -- 172.21.15.19:0/3057653595 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746339188 0 0) 0x7f69a40d3690 con 0x7f69a415e5f0 2024-09-12T02:03:28.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a2ffd640 1 -- 172.21.15.19:0/3057653595 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f698c003520 con 0x7f69a415e5f0 2024-09-12T02:03:28.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a37fe640 1 --2- 172.21.15.19:0/3057653595 >> v2:172.21.15.135:3300/0 conn(0x7f69a40d30f0 0x7f69a40b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:28.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a2ffd640 1 -- 172.21.15.19:0/3057653595 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3862045563 0 0) 0x7f698c003520 con 0x7f69a415e5f0 2024-09-12T02:03:28.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a2ffd640 1 -- 172.21.15.19:0/3057653595 >> v2:172.21.15.135:3300/0 conn(0x7f69a40d30f0 msgr2=0x7f69a40b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:28.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a2ffd640 1 --2- 172.21.15.19:0/3057653595 >> v2:172.21.15.135:3300/0 conn(0x7f69a40d30f0 0x7f69a40b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a2ffd640 1 -- 172.21.15.19:0/3057653595 >> v1:172.21.15.135:6789/0 conn(0x7f69a40b64c0 legacy=0x7f69a406d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:28.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a2ffd640 1 -- 172.21.15.19:0/3057653595 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a406cee0 con 0x7f69a415e5f0 2024-09-12T02:03:28.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a2ffd640 1 -- 172.21.15.19:0/3057653595 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f6994001670 con 0x7f69a415e5f0 2024-09-12T02:03:28.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a2ffd640 1 -- 172.21.15.19:0/3057653595 >> v1:172.21.15.19:6789/0 conn(0x7f69a415e5f0 legacy=0x7f69a40d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:28.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a2ffd640 1 --2- 172.21.15.19:0/3057653595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f698c0039b0 0x7f698c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:28.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a2ffd640 1 --2- 172.21.15.19:0/3057653595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f698c004800 0x7f698c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:28.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a2ffd640 1 --2- 172.21.15.19:0/3057653595 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f698c0051c0 0x7f698c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:28.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a2ffd640 1 -- 172.21.15.19:0/3057653595 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f69a406d530 con 0x7f698c004800 2024-09-12T02:03:28.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a2ffd640 1 -- 172.21.15.19:0/3057653595 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f698c00c0f0 con 0x7f698c0039b0 2024-09-12T02:03:28.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a2ffd640 1 -- 172.21.15.19:0/3057653595 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f698c00c2f0 con 0x7f698c0051c0 2024-09-12T02:03:28.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a37fe640 1 --2- 172.21.15.19:0/3057653595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f698c004800 0x7f698c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:28.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a3fff640 1 --2- 172.21.15.19:0/3057653595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f698c0039b0 0x7f698c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:28.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a8c95640 1 --2- 172.21.15.19:0/3057653595 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f698c0051c0 0x7f698c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:28.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a37fe640 1 -- 172.21.15.19:0/3057653595 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f698c0051c0 msgr2=0x7f698c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:28.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a37fe640 1 --2- 172.21.15.19:0/3057653595 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f698c0051c0 0x7f698c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a37fe640 1 -- 172.21.15.19:0/3057653595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f698c0039b0 msgr2=0x7f698c003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:28.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a37fe640 1 --2- 172.21.15.19:0/3057653595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f698c0039b0 0x7f698c003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a8c95640 1 -- 172.21.15.19:0/3057653595 reap_dead start 2024-09-12T02:03:28.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.766+0000 7f69a37fe640 1 -- 172.21.15.19:0/3057653595 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698c003520 con 0x7f698c004800 2024-09-12T02:03:28.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.767+0000 7f69a37fe640 1 --2- 172.21.15.19:0/3057653595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f698c004800 0x7f698c004c80 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f699800ba00 tx=0x7f698c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b493d12bd6c6c123 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:28.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.767+0000 7f69a2ffd640 1 -- 172.21.15.19:0/3057653595 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6998030070 con 0x7f698c004800 2024-09-12T02:03:28.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.767+0000 7f69a2ffd640 1 -- 172.21.15.19:0/3057653595 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f699802ad80 con 0x7f698c004800 2024-09-12T02:03:28.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.767+0000 7f69a2ffd640 1 -- 172.21.15.19:0/3057653595 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699800b600 con 0x7f698c004800 2024-09-12T02:03:28.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.768+0000 7f69aa6f8640 1 -- 172.21.15.19:0/3057653595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f698c004800 msgr2=0x7f698c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:28.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.768+0000 7f69aa6f8640 1 --2- 172.21.15.19:0/3057653595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f698c004800 0x7f698c004c80 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f699800ba00 tx=0x7f698c005830 comp rx=0 tx=0).stop 2024-09-12T02:03:28.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.768+0000 7f69aa6f8640 1 -- 172.21.15.19:0/3057653595 shutdown_connections 2024-09-12T02:03:28.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.768+0000 7f69aa6f8640 1 --2- 172.21.15.19:0/3057653595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f698c004800 0x7f698c004c80 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.768+0000 7f69aa6f8640 1 -- 172.21.15.19:0/3057653595 >> 172.21.15.19:0/3057653595 conn(0x7f69a408bfc0 msgr2=0x7f69a40d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:28.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.768+0000 7f69aa6f8640 1 -- 172.21.15.19:0/3057653595 shutdown_connections 2024-09-12T02:03:28.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.768+0000 7f69aa6f8640 1 -- 172.21.15.19:0/3057653595 wait complete. 2024-09-12T02:03:28.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.769+0000 7f69aa6f8640 1 Processor -- start 2024-09-12T02:03:28.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.769+0000 7f69aa6f8640 1 -- start start 2024-09-12T02:03:28.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.770+0000 7f69aa6f8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f698c004800 0x7f69a414c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:28.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.770+0000 7f69aa6f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69a4160dd0 0x7f69a409f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:28.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.770+0000 7f69aa6f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69a4161250 0x7f69a409f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:28.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.770+0000 7f69aa6f8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f69a40b5f80 con 0x7f69a4160dd0 2024-09-12T02:03:28.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.770+0000 7f69aa6f8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f69a415e9d0 con 0x7f698c004800 2024-09-12T02:03:28.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.770+0000 7f69aa6f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f69a40b6100 con 0x7f69a4161250 2024-09-12T02:03:28.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.770+0000 7f69a37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69a4160dd0 0x7f69a409f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:28.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.770+0000 7f69a37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69a4160dd0 0x7f69a409f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44336/0 (socket says 172.21.15.19:44336) 2024-09-12T02:03:28.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.770+0000 7f69a37fe640 1 -- 172.21.15.19:0/2694498026 learned_addr learned my addr 172.21.15.19:0/2694498026 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:28.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.770+0000 7f69a3fff640 1 --2- 172.21.15.19:0/2694498026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f698c004800 0x7f69a414c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:28.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.770+0000 7f69a8c95640 1 --2- 172.21.15.19:0/2694498026 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69a4161250 0x7f69a409f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:28.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.770+0000 7f69a37fe640 1 -- 172.21.15.19:0/2694498026 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69a4161250 msgr2=0x7f69a409f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:28.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.770+0000 7f69a37fe640 1 --2- 172.21.15.19:0/2694498026 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69a4161250 0x7f69a409f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.770+0000 7f69a37fe640 1 -- 172.21.15.19:0/2694498026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f698c004800 msgr2=0x7f69a414c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:28.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.770+0000 7f69a37fe640 1 --2- 172.21.15.19:0/2694498026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f698c004800 0x7f69a414c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.770+0000 7f69a37fe640 1 -- 172.21.15.19:0/2694498026 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a40c8e00 con 0x7f69a4160dd0 2024-09-12T02:03:28.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.771+0000 7f69a37fe640 1 --2- 172.21.15.19:0/2694498026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69a4160dd0 0x7f69a409f390 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f699802a870 tx=0x7f6998004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:28.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.771+0000 7f69a0ff9640 1 -- 172.21.15.19:0/2694498026 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6998043030 con 0x7f69a4160dd0 2024-09-12T02:03:28.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.771+0000 7f69a0ff9640 1 -- 172.21.15.19:0/2694498026 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f699802ab80 con 0x7f69a4160dd0 2024-09-12T02:03:28.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.771+0000 7f69a0ff9640 1 -- 172.21.15.19:0/2694498026 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699800b600 con 0x7f69a4160dd0 2024-09-12T02:03:28.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.771+0000 7f69aa6f8640 1 -- 172.21.15.19:0/2694498026 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a40c90e0 con 0x7f69a4160dd0 2024-09-12T02:03:28.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.771+0000 7f69aa6f8640 1 -- 172.21.15.19:0/2694498026 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a40c96a0 con 0x7f69a4160dd0 2024-09-12T02:03:28.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.772+0000 7f69aa6f8640 1 -- 172.21.15.19:0/2694498026 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69a40d4dd0 con 0x7f69a4160dd0 2024-09-12T02:03:28.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.773+0000 7f69a0ff9640 1 -- 172.21.15.19:0/2694498026 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6998046070 con 0x7f69a4160dd0 2024-09-12T02:03:28.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.773+0000 7f69a0ff9640 1 --2- 172.21.15.19:0/2694498026 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f699006be60 0x7f699006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:28.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.773+0000 7f69a0ff9640 1 -- 172.21.15.19:0/2694498026 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7077+0+0 (secure 0 0 0) 0x7f69980abd10 con 0x7f69a4160dd0 2024-09-12T02:03:28.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.773+0000 7f69a3fff640 1 --2- 172.21.15.19:0/2694498026 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f699006be60 0x7f699006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:28.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.774+0000 7f69a3fff640 1 --2- 172.21.15.19:0/2694498026 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f699006be60 0x7f699006e320 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6994001050 tx=0x7f6994000f80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:28.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.777+0000 7f69a0ff9640 1 -- 172.21.15.19:0/2694498026 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6998079ba0 con 0x7f69a4160dd0 2024-09-12T02:03:28.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.990+0000 7f69aa6f8640 1 -- 172.21.15.19:0/2694498026 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69a40b3670 con 0x7f69a4160dd0 2024-09-12T02:03:28.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.991+0000 7f69a0ff9640 1 -- 172.21.15.19:0/2694498026 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 134 v134) ==== 95+0+3563 (secure 0 0 0) 0x7f699807dea0 con 0x7f69a4160dd0 2024-09-12T02:03:28.991 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:28.991 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":134,"btime":"2024-09-12T02:03:28:654631+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:28.654582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 134 2024-09-12T02:03:28.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.993+0000 7f69aa6f8640 1 -- 172.21.15.19:0/2694498026 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f699006be60 msgr2=0x7f699006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:28.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.993+0000 7f69aa6f8640 1 --2- 172.21.15.19:0/2694498026 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f699006be60 0x7f699006e320 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6994001050 tx=0x7f6994000f80 comp rx=0 tx=0).stop 2024-09-12T02:03:28.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.993+0000 7f69aa6f8640 1 -- 172.21.15.19:0/2694498026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69a4160dd0 msgr2=0x7f69a409f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:28.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.993+0000 7f69aa6f8640 1 --2- 172.21.15.19:0/2694498026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69a4160dd0 0x7f69a409f390 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f699802a870 tx=0x7f6998004730 comp rx=0 tx=0).stop 2024-09-12T02:03:28.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.993+0000 7f69aa6f8640 1 -- 172.21.15.19:0/2694498026 shutdown_connections 2024-09-12T02:03:28.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.993+0000 7f69aa6f8640 1 --2- 172.21.15.19:0/2694498026 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f699006be60 0x7f699006e320 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.993+0000 7f69aa6f8640 1 --2- 172.21.15.19:0/2694498026 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69a4161250 0x7f69a409f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.993+0000 7f69aa6f8640 1 --2- 172.21.15.19:0/2694498026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69a4160dd0 0x7f69a409f390 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.993+0000 7f69aa6f8640 1 --2- 172.21.15.19:0/2694498026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f698c004800 0x7f69a414c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:28.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.993+0000 7f69aa6f8640 1 -- 172.21.15.19:0/2694498026 >> 172.21.15.19:0/2694498026 conn(0x7f69a408bfc0 msgr2=0x7f69a406e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:28.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.993+0000 7f69aa6f8640 1 -- 172.21.15.19:0/2694498026 shutdown_connections 2024-09-12T02:03:28.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:28.993+0000 7f69aa6f8640 1 -- 172.21.15.19:0/2694498026 wait complete. 2024-09-12T02:03:29.004 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:03:29.005 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:29.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.107+0000 7fe277131640 1 Processor -- start 2024-09-12T02:03:29.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.107+0000 7fe277131640 1 -- start start 2024-09-12T02:03:29.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.107+0000 7fe277131640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe270162060 0x7fe2700b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:29.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.107+0000 7fe277131640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2700b64b0 0x7fe2700b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:29.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.107+0000 7fe277131640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe27006d9f0 con 0x7fe270161c80 2024-09-12T02:03:29.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.107+0000 7fe277131640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fe27006dcd0 con 0x7fe270162060 2024-09-12T02:03:29.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.107+0000 7fe277131640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe27006dfb0 con 0x7fe2700b64b0 2024-09-12T02:03:29.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.108+0000 7fe26ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe270162060 0x7fe2700b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:29.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.108+0000 7fe26ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe270162060 0x7fe2700b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44338/0 (socket says 172.21.15.19:44338) 2024-09-12T02:03:29.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.108+0000 7fe274ecd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe270161c80 0x7fe27006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44268/0 (socket says 172.21.15.19:44268) 2024-09-12T02:03:29.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.108+0000 7fe26ffff640 1 -- 172.21.15.19:0/4008881655 learned_addr learned my addr 172.21.15.19:0/4008881655 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:29.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.108+0000 7fe2756ce640 1 --2- 172.21.15.19:0/4008881655 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2700b64b0 0x7fe2700b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:29.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.108+0000 7fe26ffff640 1 -- 172.21.15.19:0/4008881655 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2700b64b0 msgr2=0x7fe2700b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:29.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.108+0000 7fe26ffff640 1 --2- 172.21.15.19:0/4008881655 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2700b64b0 0x7fe2700b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.108+0000 7fe26ffff640 1 -- 172.21.15.19:0/4008881655 >> v1:172.21.15.19:6789/0 conn(0x7fe270161c80 legacy=0x7fe27006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:29.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.108+0000 7fe26f7fe640 1 -- 172.21.15.19:0/4008881655 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 87071898 0 0) 0x7fe27006d9f0 con 0x7fe270161c80 2024-09-12T02:03:29.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.108+0000 7fe26ffff640 1 -- 172.21.15.19:0/4008881655 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2700d01f0 con 0x7fe270162060 2024-09-12T02:03:29.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.110+0000 7fe26ffff640 1 --2- 172.21.15.19:0/4008881655 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe270162060 0x7fe2700b5f70 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fe258009e50 tx=0x7fe25802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de57de89bc4a6673 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:29.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.110+0000 7fe26f7fe640 1 -- 172.21.15.19:0/4008881655 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe258036070 con 0x7fe270162060 2024-09-12T02:03:29.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.110+0000 7fe26f7fe640 1 -- 172.21.15.19:0/4008881655 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe258031600 con 0x7fe270162060 2024-09-12T02:03:29.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.110+0000 7fe26f7fe640 1 -- 172.21.15.19:0/4008881655 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2580319d0 con 0x7fe270162060 2024-09-12T02:03:29.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.110+0000 7fe277131640 1 -- 172.21.15.19:0/4008881655 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe270162060 msgr2=0x7fe2700b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:29.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.110+0000 7fe277131640 1 --2- 172.21.15.19:0/4008881655 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe270162060 0x7fe2700b5f70 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fe258009e50 tx=0x7fe25802a710 comp rx=0 tx=0).stop 2024-09-12T02:03:29.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.110+0000 7fe277131640 1 -- 172.21.15.19:0/4008881655 shutdown_connections 2024-09-12T02:03:29.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.110+0000 7fe277131640 1 --2- 172.21.15.19:0/4008881655 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2700b64b0 0x7fe2700b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.110+0000 7fe277131640 1 --2- 172.21.15.19:0/4008881655 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe270162060 0x7fe2700b5f70 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.110+0000 7fe277131640 1 -- 172.21.15.19:0/4008881655 >> 172.21.15.19:0/4008881655 conn(0x7fe2700d44f0 msgr2=0x7fe2700d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:29.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.110+0000 7fe277131640 1 -- 172.21.15.19:0/4008881655 shutdown_connections 2024-09-12T02:03:29.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.110+0000 7fe277131640 1 -- 172.21.15.19:0/4008881655 wait complete. 2024-09-12T02:03:29.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.111+0000 7fe277131640 1 Processor -- start 2024-09-12T02:03:29.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.111+0000 7fe277131640 1 -- start start 2024-09-12T02:03:29.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe277131640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2700b64b0 0x7fe270159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:29.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe277131640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe270161c80 0x7fe2700b8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:29.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe277131640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe270162060 0x7fe2700c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:29.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe277131640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe2700cf360 con 0x7fe270162060 2024-09-12T02:03:29.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe277131640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe2700cf1e0 con 0x7fe2700b64b0 2024-09-12T02:03:29.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe277131640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe2700cf4e0 con 0x7fe270161c80 2024-09-12T02:03:29.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe2756ce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe270162060 0x7fe2700c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:29.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe2756ce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe270162060 0x7fe2700c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44352/0 (socket says 172.21.15.19:44352) 2024-09-12T02:03:29.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe2756ce640 1 -- 172.21.15.19:0/1027244264 learned_addr learned my addr 172.21.15.19:0/1027244264 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:29.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe26ffff640 1 --2- 172.21.15.19:0/1027244264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe270161c80 0x7fe2700b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:29.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe274ecd640 1 --2- 172.21.15.19:0/1027244264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2700b64b0 0x7fe270159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:29.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe2756ce640 1 -- 172.21.15.19:0/1027244264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe270161c80 msgr2=0x7fe2700b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:29.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe2756ce640 1 --2- 172.21.15.19:0/1027244264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe270161c80 0x7fe2700b8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe2756ce640 1 -- 172.21.15.19:0/1027244264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2700b64b0 msgr2=0x7fe270159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:29.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe2756ce640 1 --2- 172.21.15.19:0/1027244264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2700b64b0 0x7fe270159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe2756ce640 1 -- 172.21.15.19:0/1027244264 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe270159e90 con 0x7fe270162060 2024-09-12T02:03:29.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe2756ce640 1 --2- 172.21.15.19:0/1027244264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe270162060 0x7fe2700c7f30 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fe26800d830 tx=0x7fe26800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:29.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe26d7fa640 1 -- 172.21.15.19:0/1027244264 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26800b6c0 con 0x7fe270162060 2024-09-12T02:03:29.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe26d7fa640 1 -- 172.21.15.19:0/1027244264 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe268019070 con 0x7fe270162060 2024-09-12T02:03:29.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe277131640 1 -- 172.21.15.19:0/1027244264 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2700c89f0 con 0x7fe270162060 2024-09-12T02:03:29.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe26d7fa640 1 -- 172.21.15.19:0/1027244264 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26800bac0 con 0x7fe270162060 2024-09-12T02:03:29.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.112+0000 7fe277131640 1 -- 172.21.15.19:0/1027244264 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2700b7c60 con 0x7fe270162060 2024-09-12T02:03:29.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.113+0000 7fe277131640 1 -- 172.21.15.19:0/1027244264 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2700b5f70 con 0x7fe270162060 2024-09-12T02:03:29.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.114+0000 7fe26d7fa640 1 -- 172.21.15.19:0/1027244264 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe26801e460 con 0x7fe270162060 2024-09-12T02:03:29.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.114+0000 7fe26d7fa640 1 --2- 172.21.15.19:0/1027244264 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe25006be30 0x7fe25006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:29.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.114+0000 7fe26d7fa640 1 -- 172.21.15.19:0/1027244264 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7077+0+0 (secure 0 0 0) 0x7fe26808b9a0 con 0x7fe270162060 2024-09-12T02:03:29.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.114+0000 7fe274ecd640 1 --2- 172.21.15.19:0/1027244264 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe25006be30 0x7fe25006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:29.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.115+0000 7fe274ecd640 1 --2- 172.21.15.19:0/1027244264 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe25006be30 0x7fe25006e2f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe260000f60 tx=0x7fe260007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:29.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.119+0000 7fe26d7fa640 1 -- 172.21.15.19:0/1027244264 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe268059df0 con 0x7fe270162060 2024-09-12T02:03:29.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.329+0000 7fe277131640 1 -- 172.21.15.19:0/1027244264 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2700d3200 con 0x7fe270162060 2024-09-12T02:03:29.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.329+0000 7fe26d7fa640 1 -- 172.21.15.19:0/1027244264 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 134 v134) ==== 95+0+3563 (secure 0 0 0) 0x7fe2680596f0 con 0x7fe270162060 2024-09-12T02:03:29.330 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:29.330 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":134,"btime":"2024-09-12T02:03:28:654631+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:28.654582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 134 2024-09-12T02:03:29.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.331+0000 7fe277131640 1 -- 172.21.15.19:0/1027244264 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe25006be30 msgr2=0x7fe25006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:29.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.331+0000 7fe277131640 1 --2- 172.21.15.19:0/1027244264 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe25006be30 0x7fe25006e2f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe260000f60 tx=0x7fe260007b50 comp rx=0 tx=0).stop 2024-09-12T02:03:29.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.331+0000 7fe277131640 1 -- 172.21.15.19:0/1027244264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe270162060 msgr2=0x7fe2700c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:29.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.331+0000 7fe277131640 1 --2- 172.21.15.19:0/1027244264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe270162060 0x7fe2700c7f30 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fe26800d830 tx=0x7fe26800dcf0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.331+0000 7fe277131640 1 -- 172.21.15.19:0/1027244264 shutdown_connections 2024-09-12T02:03:29.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.331+0000 7fe277131640 1 --2- 172.21.15.19:0/1027244264 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe25006be30 0x7fe25006e2f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.331+0000 7fe277131640 1 --2- 172.21.15.19:0/1027244264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe270162060 0x7fe2700c7f30 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.331+0000 7fe277131640 1 --2- 172.21.15.19:0/1027244264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe270161c80 0x7fe2700b8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.331+0000 7fe277131640 1 --2- 172.21.15.19:0/1027244264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2700b64b0 0x7fe270159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.331+0000 7fe277131640 1 -- 172.21.15.19:0/1027244264 >> 172.21.15.19:0/1027244264 conn(0x7fe2700d44f0 msgr2=0x7fe2700d3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:29.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.331+0000 7fe277131640 1 -- 172.21.15.19:0/1027244264 shutdown_connections 2024-09-12T02:03:29.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.331+0000 7fe277131640 1 -- 172.21.15.19:0/1027244264 wait complete. 2024-09-12T02:03:29.342 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:03:29.343 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:29.386 INFO:tasks.ceph.mds.c.smithi019.stderr: -48> 2024-09-12T02:03:24.635+0000 7fd9f37d4640 -1 mds.0.snaptable: load_2 could not read table: -2 2024-09-12T02:03:29.387 INFO:tasks.ceph.mds.c.smithi019.stderr: -47> 2024-09-12T02:03:24.635+0000 7fd9f37d4640 -1 log_channel(cluster) log [ERR] : error reading table object 'mds_snaptable' -2 ((2) No such file or directory) 2024-09-12T02:03:29.412 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:03:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.449+0000 7f3b41191640 1 Processor -- start 2024-09-12T02:03:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.449+0000 7f3b41191640 1 -- start start 2024-09-12T02:03:29.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.449+0000 7f3b41191640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3b3c0b43f0 0x7f3b3c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:29.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.449+0000 7f3b41191640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3c0b3830 con 0x7f3b3c0b5050 2024-09-12T02:03:29.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.449+0000 7f3b41191640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3c0b5610 con 0x7f3b3c15b340 2024-09-12T02:03:29.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.449+0000 7f3b41191640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f3b3c0b5bd0 con 0x7f3b3c0b43f0 2024-09-12T02:03:29.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.449+0000 7f3b3a59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3b3c0b43f0 0x7f3b3c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:29.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.449+0000 7f3b3b59e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3b3c0b5050 0x7f3b3c15b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44290/0 (socket says 172.21.15.19:44290) 2024-09-12T02:03:29.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.449+0000 7f3b3b59e640 1 -- 172.21.15.19:0/3509116812 learned_addr learned my addr 172.21.15.19:0/3509116812 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:29.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.449+0000 7f3b3a59c640 1 -- 172.21.15.19:0/3509116812 >> v1:172.21.15.135:6789/0 conn(0x7f3b3c15b340 legacy=0x7f3b3c0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:29.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.449+0000 7f3b3a59c640 1 -- 172.21.15.19:0/3509116812 >> v1:172.21.15.19:6789/0 conn(0x7f3b3c0b5050 legacy=0x7f3b3c15b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:29.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.449+0000 7f3b39d9b640 1 -- 172.21.15.19:0/3509116812 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1375458218 0 0) 0x7f3b3c0b3830 con 0x7f3b3c0b5050 2024-09-12T02:03:29.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.449+0000 7f3b3a59c640 1 -- 172.21.15.19:0/3509116812 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3c0b58f0 con 0x7f3b3c0b43f0 2024-09-12T02:03:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.450+0000 7f3b3a59c640 1 --2- 172.21.15.19:0/3509116812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b3c0b43f0 0x7f3b3c09aa30 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f3b300097a0 tx=0x7f3b3002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18da2a63d2c1c80d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.450+0000 7f3b39d9b640 1 -- 172.21.15.19:0/3509116812 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30037070 con 0x7f3b3c0b43f0 2024-09-12T02:03:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.450+0000 7f3b39d9b640 1 -- 172.21.15.19:0/3509116812 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b30032440 con 0x7f3b3c0b43f0 2024-09-12T02:03:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.450+0000 7f3b39d9b640 1 -- 172.21.15.19:0/3509116812 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30032810 con 0x7f3b3c0b43f0 2024-09-12T02:03:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.450+0000 7f3b41191640 1 -- 172.21.15.19:0/3509116812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b3c0b43f0 msgr2=0x7f3b3c09aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.450+0000 7f3b41191640 1 --2- 172.21.15.19:0/3509116812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b3c0b43f0 0x7f3b3c09aa30 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f3b300097a0 tx=0x7f3b3002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.450+0000 7f3b41191640 1 -- 172.21.15.19:0/3509116812 shutdown_connections 2024-09-12T02:03:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.451+0000 7f3b41191640 1 --2- 172.21.15.19:0/3509116812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b3c0b43f0 0x7f3b3c09aa30 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.451+0000 7f3b41191640 1 -- 172.21.15.19:0/3509116812 >> 172.21.15.19:0/3509116812 conn(0x7f3b3c073490 msgr2=0x7f3b3c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:29.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.451+0000 7f3b41191640 1 -- 172.21.15.19:0/3509116812 shutdown_connections 2024-09-12T02:03:29.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.451+0000 7f3b41191640 1 -- 172.21.15.19:0/3509116812 wait complete. 2024-09-12T02:03:29.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.452+0000 7f3b41191640 1 Processor -- start 2024-09-12T02:03:29.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.452+0000 7f3b41191640 1 -- start start 2024-09-12T02:03:29.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.453+0000 7f3b41191640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b3c0b43f0 0x7f3b3c149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.453+0000 7f3b41191640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b3c0b5050 0x7f3b3c1563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.453+0000 7f3b41191640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b3c15b340 0x7f3b3c156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.453+0000 7f3b41191640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c0cdb30 con 0x7f3b3c15b340 2024-09-12T02:03:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.453+0000 7f3b41191640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c15d8f0 con 0x7f3b3c0b43f0 2024-09-12T02:03:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.453+0000 7f3b41191640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3b3c0cdcb0 con 0x7f3b3c0b5050 2024-09-12T02:03:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.453+0000 7f3b3b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b3c15b340 0x7f3b3c156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.453+0000 7f3b3b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b3c15b340 0x7f3b3c156900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44384/0 (socket says 172.21.15.19:44384) 2024-09-12T02:03:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.453+0000 7f3b3b59e640 1 -- 172.21.15.19:0/2053998798 learned_addr learned my addr 172.21.15.19:0/2053998798 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.453+0000 7f3b3ad9d640 1 --2- 172.21.15.19:0/2053998798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b3c0b43f0 0x7f3b3c149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.453+0000 7f3b3a59c640 1 --2- 172.21.15.19:0/2053998798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b3c0b5050 0x7f3b3c1563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.453+0000 7f3b3b59e640 1 -- 172.21.15.19:0/2053998798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b3c0b5050 msgr2=0x7f3b3c1563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.453+0000 7f3b3b59e640 1 --2- 172.21.15.19:0/2053998798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b3c0b5050 0x7f3b3c1563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.453+0000 7f3b3b59e640 1 -- 172.21.15.19:0/2053998798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b3c0b43f0 msgr2=0x7f3b3c149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:29.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.453+0000 7f3b3b59e640 1 --2- 172.21.15.19:0/2053998798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b3c0b43f0 0x7f3b3c149610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.453+0000 7f3b3b59e640 1 -- 172.21.15.19:0/2053998798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3c149f70 con 0x7f3b3c15b340 2024-09-12T02:03:29.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.454+0000 7f3b3b59e640 1 --2- 172.21.15.19:0/2053998798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b3c15b340 0x7f3b3c156900 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f3b3400c7a0 tx=0x7f3b3400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:29.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.454+0000 7f3b237fe640 1 -- 172.21.15.19:0/2053998798 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b34018070 con 0x7f3b3c15b340 2024-09-12T02:03:29.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.454+0000 7f3b237fe640 1 -- 172.21.15.19:0/2053998798 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3400a640 con 0x7f3b3c15b340 2024-09-12T02:03:29.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.454+0000 7f3b41191640 1 -- 172.21.15.19:0/2053998798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b3c156f30 con 0x7f3b3c15b340 2024-09-12T02:03:29.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.454+0000 7f3b237fe640 1 -- 172.21.15.19:0/2053998798 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3400aa70 con 0x7f3b3c15b340 2024-09-12T02:03:29.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.454+0000 7f3b41191640 1 -- 172.21.15.19:0/2053998798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b3c1543d0 con 0x7f3b3c15b340 2024-09-12T02:03:29.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.455+0000 7f3b41191640 1 -- 172.21.15.19:0/2053998798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b3c09aa30 con 0x7f3b3c15b340 2024-09-12T02:03:29.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.455+0000 7f3b237fe640 1 -- 172.21.15.19:0/2053998798 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b3401b070 con 0x7f3b3c15b340 2024-09-12T02:03:29.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.456+0000 7f3b237fe640 1 --2- 172.21.15.19:0/2053998798 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3b2806be30 0x7f3b2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:29.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.456+0000 7f3b237fe640 1 -- 172.21.15.19:0/2053998798 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7077+0+0 (secure 0 0 0) 0x7f3b3408a970 con 0x7f3b3c15b340 2024-09-12T02:03:29.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.456+0000 7f3b3ad9d640 1 --2- 172.21.15.19:0/2053998798 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3b2806be30 0x7f3b2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:29.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.457+0000 7f3b3ad9d640 1 --2- 172.21.15.19:0/2053998798 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3b2806be30 0x7f3b2806e2f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c1f7c30 tx=0x7f3b2c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:29.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.460+0000 7f3b237fe640 1 -- 172.21.15.19:0/2053998798 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b34058770 con 0x7f3b3c15b340 2024-09-12T02:03:29.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.674+0000 7f3b41191640 1 -- 172.21.15.19:0/2053998798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b3c152b00 con 0x7f3b3c15b340 2024-09-12T02:03:29.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.674+0000 7f3b237fe640 1 -- 172.21.15.19:0/2053998798 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 135 v135) ==== 95+0+4389 (secure 0 0 0) 0x7f3b3405ca70 con 0x7f3b3c15b340 2024-09-12T02:03:29.675 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:29.675 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":135,"btime":"2024-09-12T02:03:29:655916+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/4124612835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":4124612835},{"type":"v1","addr":"172.21.15.19:6834","nonce":4124612835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":135}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:28.654582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:29.676 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 135 2024-09-12T02:03:29.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.676+0000 7f3b41191640 1 -- 172.21.15.19:0/2053998798 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3b2806be30 msgr2=0x7f3b2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:29.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.676+0000 7f3b41191640 1 --2- 172.21.15.19:0/2053998798 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3b2806be30 0x7f3b2806e2f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c1f7c30 tx=0x7f3b2c009040 comp rx=0 tx=0).stop 2024-09-12T02:03:29.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.676+0000 7f3b41191640 1 -- 172.21.15.19:0/2053998798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b3c15b340 msgr2=0x7f3b3c156900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:29.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.676+0000 7f3b41191640 1 --2- 172.21.15.19:0/2053998798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b3c15b340 0x7f3b3c156900 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f3b3400c7a0 tx=0x7f3b3400cc60 comp rx=0 tx=0).stop 2024-09-12T02:03:29.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.676+0000 7f3b41191640 1 -- 172.21.15.19:0/2053998798 shutdown_connections 2024-09-12T02:03:29.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.676+0000 7f3b41191640 1 --2- 172.21.15.19:0/2053998798 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3b2806be30 0x7f3b2806e2f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.676+0000 7f3b41191640 1 --2- 172.21.15.19:0/2053998798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b3c15b340 0x7f3b3c156900 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.676+0000 7f3b41191640 1 --2- 172.21.15.19:0/2053998798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b3c0b5050 0x7f3b3c1563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.676+0000 7f3b41191640 1 --2- 172.21.15.19:0/2053998798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b3c0b43f0 0x7f3b3c149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.676+0000 7f3b41191640 1 -- 172.21.15.19:0/2053998798 >> 172.21.15.19:0/2053998798 conn(0x7f3b3c073490 msgr2=0x7f3b3c15a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:29.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.676+0000 7f3b41191640 1 -- 172.21.15.19:0/2053998798 shutdown_connections 2024-09-12T02:03:29.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.676+0000 7f3b41191640 1 -- 172.21.15.19:0/2053998798 wait complete. 2024-09-12T02:03:29.688 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete mds0_inotable' led to DAMAGED state 2024-09-12T02:03:29.688 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 100.00000000' 2024-09-12T02:03:29.688 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:03:29.688 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:03:29.744 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:03:29.745 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:03:29.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:29.745 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:03:29.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:03:29.801 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:03:29.801 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:03:29.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.945+0000 7fa220aac640 1 Processor -- start 2024-09-12T02:03:29.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.945+0000 7fa220aac640 1 -- start start 2024-09-12T02:03:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.946+0000 7fa220aac640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa21c15e760 0x7fa21c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.946+0000 7fa220aac640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c0d4fd0 0x7fa21c0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.946+0000 7fa220aac640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa21c0d2700 con 0x7fa21c0b3650 2024-09-12T02:03:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.946+0000 7fa220aac640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa21c0cedb0 con 0x7fa21c15e760 2024-09-12T02:03:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.946+0000 7fa220aac640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa21c0cf090 con 0x7fa21c0d4fd0 2024-09-12T02:03:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.946+0000 7fa21a59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa21c15e760 0x7fa21c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.946+0000 7fa21ad9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa21c0b3650 0x7fa21c0d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44304/0 (socket says 172.21.15.19:44304) 2024-09-12T02:03:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.946+0000 7fa21ad9d640 1 -- 172.21.15.19:0/3425209806 learned_addr learned my addr 172.21.15.19:0/3425209806 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.946+0000 7fa219d9b640 1 --2- 172.21.15.19:0/3425209806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c0d4fd0 0x7fa21c0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:29.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.946+0000 7fa21a59c640 1 -- 172.21.15.19:0/3425209806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c0d4fd0 msgr2=0x7fa21c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:29.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.946+0000 7fa21a59c640 1 --2- 172.21.15.19:0/3425209806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c0d4fd0 0x7fa21c0cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.946+0000 7fa21a59c640 1 -- 172.21.15.19:0/3425209806 >> v1:172.21.15.19:6789/0 conn(0x7fa21c0b3650 legacy=0x7fa21c0d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:29.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.946+0000 7fa21959a640 1 -- 172.21.15.19:0/3425209806 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 991206318 0 0) 0x7fa214001490 con 0x7fa21c0b3650 2024-09-12T02:03:29.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.946+0000 7fa21a59c640 1 -- 172.21.15.19:0/3425209806 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21c0b3c80 con 0x7fa21c15e760 2024-09-12T02:03:29.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.947+0000 7fa21a59c640 1 --2- 172.21.15.19:0/3425209806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa21c15e760 0x7fa21c06cdd0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0097a0 tx=0x7fa20c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76288244e260b864 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:29.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.947+0000 7fa21959a640 1 -- 172.21.15.19:0/3425209806 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c037070 con 0x7fa21c15e760 2024-09-12T02:03:29.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.947+0000 7fa21959a640 1 -- 172.21.15.19:0/3425209806 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa20c02ae50 con 0x7fa21c15e760 2024-09-12T02:03:29.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.947+0000 7fa21959a640 1 -- 172.21.15.19:0/3425209806 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c032660 con 0x7fa21c15e760 2024-09-12T02:03:29.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.948+0000 7fa220aac640 1 -- 172.21.15.19:0/3425209806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa21c15e760 msgr2=0x7fa21c06cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.948+0000 7fa220aac640 1 --2- 172.21.15.19:0/3425209806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa21c15e760 0x7fa21c06cdd0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0097a0 tx=0x7fa20c02a100 comp rx=0 tx=0).stop 2024-09-12T02:03:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.948+0000 7fa220aac640 1 -- 172.21.15.19:0/3425209806 shutdown_connections 2024-09-12T02:03:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.948+0000 7fa220aac640 1 --2- 172.21.15.19:0/3425209806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c0d4fd0 0x7fa21c0cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.948+0000 7fa220aac640 1 --2- 172.21.15.19:0/3425209806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa21c15e760 0x7fa21c06cdd0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.948+0000 7fa220aac640 1 -- 172.21.15.19:0/3425209806 >> 172.21.15.19:0/3425209806 conn(0x7fa21c08bfc0 msgr2=0x7fa21c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.948+0000 7fa220aac640 1 -- 172.21.15.19:0/3425209806 shutdown_connections 2024-09-12T02:03:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.948+0000 7fa220aac640 1 -- 172.21.15.19:0/3425209806 wait complete. 2024-09-12T02:03:29.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.949+0000 7fa220aac640 1 Processor -- start 2024-09-12T02:03:29.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.949+0000 7fa220aac640 1 -- start start 2024-09-12T02:03:29.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.950+0000 7fa220aac640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c0b3650 0x7fa21c156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:29.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.950+0000 7fa220aac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa21c0d4fd0 0x7fa21c160df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:29.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.950+0000 7fa220aac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa21c15e760 0x7fa21c0b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:29.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.950+0000 7fa220aac640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c0cfe80 con 0x7fa21c0d4fd0 2024-09-12T02:03:29.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.950+0000 7fa220aac640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c0cfd00 con 0x7fa21c15e760 2024-09-12T02:03:29.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.950+0000 7fa220aac640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa21c0d35b0 con 0x7fa21c0b3650 2024-09-12T02:03:29.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.950+0000 7fa219d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa21c0d4fd0 0x7fa21c160df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:29.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.950+0000 7fa219d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa21c0d4fd0 0x7fa21c160df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44412/0 (socket says 172.21.15.19:44412) 2024-09-12T02:03:29.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.950+0000 7fa219d9b640 1 -- 172.21.15.19:0/1629897145 learned_addr learned my addr 172.21.15.19:0/1629897145 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:29.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.950+0000 7fa21a59c640 1 --2- 172.21.15.19:0/1629897145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c0b3650 0x7fa21c156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:29.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.950+0000 7fa21ad9d640 1 --2- 172.21.15.19:0/1629897145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa21c15e760 0x7fa21c0b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:29.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.951+0000 7fa219d9b640 1 -- 172.21.15.19:0/1629897145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c0b3650 msgr2=0x7fa21c156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:29.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.951+0000 7fa219d9b640 1 --2- 172.21.15.19:0/1629897145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c0b3650 0x7fa21c156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.951+0000 7fa219d9b640 1 -- 172.21.15.19:0/1629897145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa21c15e760 msgr2=0x7fa21c0b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:29.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.951+0000 7fa219d9b640 1 --2- 172.21.15.19:0/1629897145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa21c15e760 0x7fa21c0b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:29.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.951+0000 7fa219d9b640 1 -- 172.21.15.19:0/1629897145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21c1f4b70 con 0x7fa21c0d4fd0 2024-09-12T02:03:29.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.951+0000 7fa219d9b640 1 --2- 172.21.15.19:0/1629897145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa21c0d4fd0 0x7fa21c160df0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fa21000d800 tx=0x7fa21000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:29.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.951+0000 7fa20affd640 1 -- 172.21.15.19:0/1629897145 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210004020 con 0x7fa21c0d4fd0 2024-09-12T02:03:29.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.951+0000 7fa20affd640 1 -- 172.21.15.19:0/1629897145 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2100041c0 con 0x7fa21c0d4fd0 2024-09-12T02:03:29.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.951+0000 7fa220aac640 1 -- 172.21.15.19:0/1629897145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa21c1f4e50 con 0x7fa21c0d4fd0 2024-09-12T02:03:29.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.951+0000 7fa20affd640 1 -- 172.21.15.19:0/1629897145 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2100043b0 con 0x7fa21c0d4fd0 2024-09-12T02:03:29.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.951+0000 7fa220aac640 1 -- 172.21.15.19:0/1629897145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa21c1f5410 con 0x7fa21c0d4fd0 2024-09-12T02:03:29.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.952+0000 7fa220aac640 1 -- 172.21.15.19:0/1629897145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa21c0d3980 con 0x7fa21c0d4fd0 2024-09-12T02:03:29.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.953+0000 7fa20affd640 1 -- 172.21.15.19:0/1629897145 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa21001b020 con 0x7fa21c0d4fd0 2024-09-12T02:03:29.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.953+0000 7fa20affd640 1 --2- 172.21.15.19:0/1629897145 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa1fc06be30 0x7fa1fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:29.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.953+0000 7fa20affd640 1 -- 172.21.15.19:0/1629897145 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7077+0+0 (secure 0 0 0) 0x7fa21008b080 con 0x7fa21c0d4fd0 2024-09-12T02:03:29.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.953+0000 7fa21a59c640 1 --2- 172.21.15.19:0/1629897145 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa1fc06be30 0x7fa1fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:29.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.954+0000 7fa21a59c640 1 --2- 172.21.15.19:0/1629897145 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa1fc06be30 0x7fa1fc06e2f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa20c034000 tx=0x7fa20c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:29.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:29.958+0000 7fa20affd640 1 -- 172.21.15.19:0/1629897145 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa210058e80 con 0x7fa21c0d4fd0 2024-09-12T02:03:30.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.169+0000 7fa220aac640 1 -- 172.21.15.19:0/1629897145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa21c15e080 con 0x7fa21c0d4fd0 2024-09-12T02:03:30.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.661+0000 7fa20affd640 1 -- 172.21.15.19:0/1629897145 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v136) ==== 161+0+0 (secure 0 0 0) 0x7fa21005d180 con 0x7fa21c0d4fd0 2024-09-12T02:03:30.661 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:03:30.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.664+0000 7fa220aac640 1 -- 172.21.15.19:0/1629897145 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa1fc06be30 msgr2=0x7fa1fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:30.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.664+0000 7fa220aac640 1 --2- 172.21.15.19:0/1629897145 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa1fc06be30 0x7fa1fc06e2f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa20c034000 tx=0x7fa20c02e000 comp rx=0 tx=0).stop 2024-09-12T02:03:30.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.664+0000 7fa220aac640 1 -- 172.21.15.19:0/1629897145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa21c0d4fd0 msgr2=0x7fa21c160df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:30.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.664+0000 7fa220aac640 1 --2- 172.21.15.19:0/1629897145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa21c0d4fd0 0x7fa21c160df0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fa21000d800 tx=0x7fa21000dcc0 comp rx=0 tx=0).stop 2024-09-12T02:03:30.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.664+0000 7fa220aac640 1 -- 172.21.15.19:0/1629897145 shutdown_connections 2024-09-12T02:03:30.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.664+0000 7fa220aac640 1 --2- 172.21.15.19:0/1629897145 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa1fc06be30 0x7fa1fc06e2f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:30.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.664+0000 7fa220aac640 1 --2- 172.21.15.19:0/1629897145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa21c15e760 0x7fa21c0b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:30.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.664+0000 7fa220aac640 1 --2- 172.21.15.19:0/1629897145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa21c0d4fd0 0x7fa21c160df0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:30.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.664+0000 7fa220aac640 1 --2- 172.21.15.19:0/1629897145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa21c0b3650 0x7fa21c156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:30.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.664+0000 7fa220aac640 1 -- 172.21.15.19:0/1629897145 >> 172.21.15.19:0/1629897145 conn(0x7fa21c08bfc0 msgr2=0x7fa21c0b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:30.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.664+0000 7fa220aac640 1 -- 172.21.15.19:0/1629897145 shutdown_connections 2024-09-12T02:03:30.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.664+0000 7fa220aac640 1 -- 172.21.15.19:0/1629897145 wait complete. 2024-09-12T02:03:30.676 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:03:30.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.785+0000 7f87e6c2e640 1 Processor -- start 2024-09-12T02:03:30.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.785+0000 7f87e6c2e640 1 -- start start 2024-09-12T02:03:30.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.786+0000 7f87e6c2e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f87e015e760 0x7f87e006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:30.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.786+0000 7f87e6c2e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87e00d4fd0 0x7f87e00cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:30.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.786+0000 7f87e6c2e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e00d2700 con 0x7f87e00b3650 2024-09-12T02:03:30.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.786+0000 7f87e6c2e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f87e00cedb0 con 0x7f87e015e760 2024-09-12T02:03:30.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.786+0000 7f87e6c2e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f87e00cf090 con 0x7f87e00d4fd0 2024-09-12T02:03:30.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.787+0000 7f87e49ca640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f87e015e760 0x7f87e006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:30.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.787+0000 7f87e51cb640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f87e00b3650 0x7f87e00d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:37642/0 (socket says 172.21.15.19:37642) 2024-09-12T02:03:30.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.787+0000 7f87e51cb640 1 -- 172.21.15.19:0/1728220292 learned_addr learned my addr 172.21.15.19:0/1728220292 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:30.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.787+0000 7f87e49ca640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f87e015e760 0x7f87e006cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:46422/0 (socket says 172.21.15.19:46422) 2024-09-12T02:03:30.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.787+0000 7f87dffff640 1 --2- 172.21.15.19:0/1728220292 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87e00d4fd0 0x7f87e00cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:30.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.787+0000 7f87e49ca640 1 -- 172.21.15.19:0/1728220292 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87e00d4fd0 msgr2=0x7f87e00cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:30.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.787+0000 7f87e49ca640 1 --2- 172.21.15.19:0/1728220292 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87e00d4fd0 0x7f87e00cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:30.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.787+0000 7f87e49ca640 1 -- 172.21.15.19:0/1728220292 >> v1:172.21.15.135:6789/0 conn(0x7f87e00b3650 legacy=0x7f87e00d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:30.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.787+0000 7f87e49ca640 1 -- 172.21.15.19:0/1728220292 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e00b3c80 con 0x7f87e015e760 2024-09-12T02:03:30.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.787+0000 7f87df7fe640 1 -- 172.21.15.19:0/1728220292 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3826022324 0 0) 0x7f87d8001490 con 0x7f87e00b3650 2024-09-12T02:03:30.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.788+0000 7f87e49ca640 1 --2- 172.21.15.19:0/1728220292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87e015e760 0x7f87e006cdd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f87d00097a0 tx=0x7f87d002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5bfdde49804c8c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:30.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.788+0000 7f87df7fe640 1 -- 172.21.15.19:0/1728220292 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d0037070 con 0x7f87e015e760 2024-09-12T02:03:30.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.788+0000 7f87df7fe640 1 -- 172.21.15.19:0/1728220292 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d002ae50 con 0x7f87e015e760 2024-09-12T02:03:30.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.788+0000 7f87df7fe640 1 -- 172.21.15.19:0/1728220292 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d0032660 con 0x7f87e015e760 2024-09-12T02:03:30.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.788+0000 7f87e6c2e640 1 -- 172.21.15.19:0/1728220292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87e015e760 msgr2=0x7f87e006cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:30.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.788+0000 7f87e6c2e640 1 --2- 172.21.15.19:0/1728220292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87e015e760 0x7f87e006cdd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f87d00097a0 tx=0x7f87d002a100 comp rx=0 tx=0).stop 2024-09-12T02:03:30.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.788+0000 7f87e6c2e640 1 -- 172.21.15.19:0/1728220292 shutdown_connections 2024-09-12T02:03:30.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.788+0000 7f87e6c2e640 1 --2- 172.21.15.19:0/1728220292 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87e00d4fd0 0x7f87e00cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:30.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.788+0000 7f87e6c2e640 1 --2- 172.21.15.19:0/1728220292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87e015e760 0x7f87e006cdd0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:30.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.788+0000 7f87e6c2e640 1 -- 172.21.15.19:0/1728220292 >> 172.21.15.19:0/1728220292 conn(0x7f87e008bfc0 msgr2=0x7f87e00d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:30.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.788+0000 7f87e6c2e640 1 -- 172.21.15.19:0/1728220292 shutdown_connections 2024-09-12T02:03:30.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.788+0000 7f87e6c2e640 1 -- 172.21.15.19:0/1728220292 wait complete. 2024-09-12T02:03:30.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.790+0000 7f87e6c2e640 1 Processor -- start 2024-09-12T02:03:30.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.790+0000 7f87e6c2e640 1 -- start start 2024-09-12T02:03:30.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.791+0000 7f87e6c2e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87e00b3650 0x7f87e0156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:30.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.791+0000 7f87e6c2e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87e00d4fd0 0x7f87e0160df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:30.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.791+0000 7f87e6c2e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87e015e760 0x7f87e00b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:30.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.791+0000 7f87e6c2e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f87e00cfe80 con 0x7f87e00d4fd0 2024-09-12T02:03:30.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.791+0000 7f87e6c2e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f87e00cfd00 con 0x7f87e015e760 2024-09-12T02:03:30.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.791+0000 7f87e6c2e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f87e00d35b0 con 0x7f87e00b3650 2024-09-12T02:03:30.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.791+0000 7f87dffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87e00d4fd0 0x7f87e0160df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:30.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.791+0000 7f87dffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87e00d4fd0 0x7f87e0160df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44426/0 (socket says 172.21.15.19:44426) 2024-09-12T02:03:30.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.791+0000 7f87dffff640 1 -- 172.21.15.19:0/2205513965 learned_addr learned my addr 172.21.15.19:0/2205513965 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:30.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.791+0000 7f87e49ca640 1 --2- 172.21.15.19:0/2205513965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87e00b3650 0x7f87e0156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:30.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.791+0000 7f87e51cb640 1 --2- 172.21.15.19:0/2205513965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87e015e760 0x7f87e00b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:30.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.791+0000 7f87dffff640 1 -- 172.21.15.19:0/2205513965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87e00b3650 msgr2=0x7f87e0156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:30.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.791+0000 7f87dffff640 1 --2- 172.21.15.19:0/2205513965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87e00b3650 0x7f87e0156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:30.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.791+0000 7f87dffff640 1 -- 172.21.15.19:0/2205513965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87e015e760 msgr2=0x7f87e00b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:30.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.791+0000 7f87dffff640 1 --2- 172.21.15.19:0/2205513965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87e015e760 0x7f87e00b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:30.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.791+0000 7f87dffff640 1 -- 172.21.15.19:0/2205513965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e01f4b70 con 0x7f87e00d4fd0 2024-09-12T02:03:30.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.791+0000 7f87dffff640 1 --2- 172.21.15.19:0/2205513965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87e00d4fd0 0x7f87e0160df0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f87d400e900 tx=0x7f87d400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:30.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.792+0000 7f87dd7fa640 1 -- 172.21.15.19:0/2205513965 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d4017070 con 0x7f87e00d4fd0 2024-09-12T02:03:30.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.792+0000 7f87e6c2e640 1 -- 172.21.15.19:0/2205513965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e01f4e50 con 0x7f87e00d4fd0 2024-09-12T02:03:30.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.792+0000 7f87dd7fa640 1 -- 172.21.15.19:0/2205513965 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d400ca00 con 0x7f87e00d4fd0 2024-09-12T02:03:30.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.792+0000 7f87dd7fa640 1 -- 172.21.15.19:0/2205513965 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d400cdd0 con 0x7f87e00d4fd0 2024-09-12T02:03:30.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.792+0000 7f87e6c2e640 1 -- 172.21.15.19:0/2205513965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e01f5410 con 0x7f87e00d4fd0 2024-09-12T02:03:30.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.792+0000 7f87e6c2e640 1 -- 172.21.15.19:0/2205513965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87e00d3980 con 0x7f87e00d4fd0 2024-09-12T02:03:30.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.793+0000 7f87dd7fa640 1 -- 172.21.15.19:0/2205513965 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f87d401a070 con 0x7f87e00d4fd0 2024-09-12T02:03:30.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.793+0000 7f87dd7fa640 1 --2- 172.21.15.19:0/2205513965 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f87cc06be30 0x7f87cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:30.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.794+0000 7f87dd7fa640 1 -- 172.21.15.19:0/2205513965 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7077+0+0 (secure 0 0 0) 0x7f87d408b790 con 0x7f87e00d4fd0 2024-09-12T02:03:30.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.794+0000 7f87e49ca640 1 --2- 172.21.15.19:0/2205513965 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f87cc06be30 0x7f87cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:30.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.794+0000 7f87e49ca640 1 --2- 172.21.15.19:0/2205513965 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f87cc06be30 0x7f87cc06e2f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f87d0034000 tx=0x7f87d002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:30.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:30.798+0000 7f87dd7fa640 1 -- 172.21.15.19:0/2205513965 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f87d4059510 con 0x7f87e00d4fd0 2024-09-12T02:03:31.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.042+0000 7f87e6c2e640 1 -- 172.21.15.19:0/2205513965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f87e01f5610 con 0x7f87e00d4fd0 2024-09-12T02:03:31.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.663+0000 7f87dd7fa640 1 -- 172.21.15.19:0/2205513965 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v137) ==== 101+0+0 (secure 0 0 0) 0x7f87d405d810 con 0x7f87e00d4fd0 2024-09-12T02:03:31.662 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:03:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.666+0000 7f87e6c2e640 1 -- 172.21.15.19:0/2205513965 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f87cc06be30 msgr2=0x7f87cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.666+0000 7f87e6c2e640 1 --2- 172.21.15.19:0/2205513965 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f87cc06be30 0x7f87cc06e2f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f87d0034000 tx=0x7f87d002e000 comp rx=0 tx=0).stop 2024-09-12T02:03:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.666+0000 7f87e6c2e640 1 -- 172.21.15.19:0/2205513965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87e00d4fd0 msgr2=0x7f87e0160df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.666+0000 7f87e6c2e640 1 --2- 172.21.15.19:0/2205513965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87e00d4fd0 0x7f87e0160df0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f87d400e900 tx=0x7f87d400edc0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.666+0000 7f87e6c2e640 1 -- 172.21.15.19:0/2205513965 shutdown_connections 2024-09-12T02:03:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.666+0000 7f87e6c2e640 1 --2- 172.21.15.19:0/2205513965 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f87cc06be30 0x7f87cc06e2f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.666+0000 7f87e6c2e640 1 --2- 172.21.15.19:0/2205513965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87e015e760 0x7f87e00b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.666+0000 7f87e6c2e640 1 --2- 172.21.15.19:0/2205513965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87e00d4fd0 0x7f87e0160df0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.666+0000 7f87e6c2e640 1 --2- 172.21.15.19:0/2205513965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87e00b3650 0x7f87e0156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.666+0000 7f87e6c2e640 1 -- 172.21.15.19:0/2205513965 >> 172.21.15.19:0/2205513965 conn(0x7f87e008bfc0 msgr2=0x7f87e00b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.666+0000 7f87e6c2e640 1 -- 172.21.15.19:0/2205513965 shutdown_connections 2024-09-12T02:03:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.666+0000 7f87e6c2e640 1 -- 172.21.15.19:0/2205513965 wait complete. 2024-09-12T02:03:31.680 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:03:31.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.727+0000 7fcadb91cf40 1 Processor -- start 2024-09-12T02:03:31.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.727+0000 7fcadb91cf40 1 -- start start 2024-09-12T02:03:31.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.728+0000 7fcadb91cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605d9345f40 0x5605d93e8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.728+0000 7fcadb91cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605d9362a80 0x5605d9347bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.728+0000 7fcadb91cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605d93f4240 0x5605d9346320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.728+0000 7fcadb91cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5605d926d510 con 0x5605d9345f40 2024-09-12T02:03:31.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.728+0000 7fcadb91cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5605d92c6c50 con 0x5605d93f4240 2024-09-12T02:03:31.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.728+0000 7fcadb91cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5605d93631c0 con 0x5605d9362a80 2024-09-12T02:03:31.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.728+0000 7fcad8afa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605d9345f40 0x5605d93e8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.728+0000 7fcad8afa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605d9345f40 0x5605d93e8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56756/0 (socket says 172.21.15.19:56756) 2024-09-12T02:03:31.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.728+0000 7fcad8afa640 1 -- 172.21.15.19:0/1082428493 learned_addr learned my addr 172.21.15.19:0/1082428493 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:31.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.728+0000 7fcad8afa640 1 -- 172.21.15.19:0/1082428493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605d9362a80 msgr2=0x5605d9347bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:31.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.728+0000 7fcad8afa640 1 --2- 172.21.15.19:0/1082428493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605d9362a80 0x5605d9347bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.728+0000 7fcad8afa640 1 -- 172.21.15.19:0/1082428493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605d93f4240 msgr2=0x5605d9346320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:31.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.728+0000 7fcad8afa640 1 --2- 172.21.15.19:0/1082428493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605d93f4240 0x5605d9346320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.728+0000 7fcad8afa640 1 -- 172.21.15.19:0/1082428493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605d93e85a0 con 0x5605d9345f40 2024-09-12T02:03:31.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.728+0000 7fcad8afa640 1 --2- 172.21.15.19:0/1082428493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605d9345f40 0x5605d93e8060 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fcac800a490 tx=0x7fcac800a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd1b9f770cbd578 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:31.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.729+0000 7fcad72f7640 1 -- 172.21.15.19:0/1082428493 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac800f7b0 con 0x5605d9345f40 2024-09-12T02:03:31.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.729+0000 7fcad72f7640 1 -- 172.21.15.19:0/1082428493 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcac8015070 con 0x5605d9345f40 2024-09-12T02:03:31.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.729+0000 7fcad72f7640 1 -- 172.21.15.19:0/1082428493 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac800fbb0 con 0x5605d9345f40 2024-09-12T02:03:31.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.729+0000 7fcadb91cf40 1 -- 172.21.15.19:0/1082428493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605d9345f40 msgr2=0x5605d93e8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.729+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/1082428493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605d9345f40 0x5605d93e8060 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fcac800a490 tx=0x7fcac800a950 comp rx=0 tx=0).stop 2024-09-12T02:03:31.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.729+0000 7fcadb91cf40 1 -- 172.21.15.19:0/1082428493 shutdown_connections 2024-09-12T02:03:31.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.729+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/1082428493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605d93f4240 0x5605d9346320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.729+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/1082428493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605d9362a80 0x5605d9347bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.729+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/1082428493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605d9345f40 0x5605d93e8060 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.729+0000 7fcadb91cf40 1 -- 172.21.15.19:0/1082428493 >> 172.21.15.19:0/1082428493 conn(0x5605d931b9e0 msgr2=0x5605d931dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:31.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.729+0000 7fcadb91cf40 1 -- 172.21.15.19:0/1082428493 shutdown_connections 2024-09-12T02:03:31.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.729+0000 7fcadb91cf40 1 -- 172.21.15.19:0/1082428493 wait complete. 2024-09-12T02:03:31.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.730+0000 7fcadb91cf40 1 Processor -- start 2024-09-12T02:03:31.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.730+0000 7fcadb91cf40 1 -- start start 2024-09-12T02:03:31.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcadb91cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605d9345f40 0x5605d93e9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcadb91cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605d9362a80 0x5605d93f0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcadb91cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605d93f4240 0x5605d93dee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcadb91cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5605d93ef350 con 0x5605d9345f40 2024-09-12T02:03:31.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcadb91cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5605d93eb350 con 0x5605d93f4240 2024-09-12T02:03:31.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcadb91cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5605d93ef630 con 0x5605d9362a80 2024-09-12T02:03:31.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcad8afa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605d9345f40 0x5605d93e9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcad8afa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605d9345f40 0x5605d93e9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56766/0 (socket says 172.21.15.19:56766) 2024-09-12T02:03:31.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 learned_addr learned my addr 172.21.15.19:0/4116966704 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:31.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcad92fb640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605d93f4240 0x5605d93dee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcad82f9640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605d9362a80 0x5605d93f0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605d9362a80 msgr2=0x5605d93f0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcad8afa640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605d9362a80 0x5605d93f0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605d93f4240 msgr2=0x5605d93dee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcad8afa640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605d93f4240 0x5605d93dee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605d931b3c0 con 0x5605d9345f40 2024-09-12T02:03:31.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcad8afa640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605d9345f40 0x5605d93e9830 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fcac800ae50 tx=0x7fcac80032f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:31.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcad62f5640 1 -- 172.21.15.19:0/4116966704 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac8025650 con 0x5605d9345f40 2024-09-12T02:03:31.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcad62f5640 1 -- 172.21.15.19:0/4116966704 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcac8025810 con 0x5605d9345f40 2024-09-12T02:03:31.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.731+0000 7fcad62f5640 1 -- 172.21.15.19:0/4116966704 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac8025c00 con 0x5605d9345f40 2024-09-12T02:03:31.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.732+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605d93ea4e0 con 0x5605d9345f40 2024-09-12T02:03:31.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.732+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605d93eaaa0 con 0x5605d9345f40 2024-09-12T02:03:31.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.733+0000 7fcad62f5640 1 -- 172.21.15.19:0/4116966704 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcac8010440 con 0x5605d9345f40 2024-09-12T02:03:31.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.733+0000 7fcad62f5640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcac406a810 0x7fcac406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.734+0000 7fcad62f5640 1 -- 172.21.15.19:0/4116966704 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7077+0+0 (secure 0 0 0) 0x7fcac808bb60 con 0x5605d9345f40 2024-09-12T02:03:31.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.734+0000 7fcad82f9640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcac406a810 0x7fcac406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.736 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:03:31.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.734+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5605d93ed050 0x5605d93ed450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.734+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d93ed990 con 0x5605d93ed050 2024-09-12T02:03:31.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.734+0000 7fcad92fb640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5605d93ed050 0x5605d93ed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.734+0000 7fcad82f9640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcac406a810 0x7fcac406ccd0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x5605d93efc70 tx=0x7fcacc001930 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:31.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.734+0000 7fcad92fb640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5605d93ed050 0x5605d93ed450 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:31.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.736+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v104'288 uv262 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.736+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d93edda0 con 0x5605d93ed050 2024-09-12T02:03:31.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.737+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v104'289 uv289 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.737+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d9496160 con 0x5605d93ed050 2024-09-12T02:03:31.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.738+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v104'290 uv290 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.738 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:03:31.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.738+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d9497510 con 0x5605d93ed050 2024-09-12T02:03:31.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.739+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v104'291 uv291 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.739+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94978b0 con 0x5605d93ed050 2024-09-12T02:03:31.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.740+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v104'292 uv292 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.740+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d9496500 con 0x5605d93ed050 2024-09-12T02:03:31.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.742+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v104'293 uv293 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.742+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.743+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v104'294 uv268 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.743+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.744+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v104'295 uv295 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.744+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.745+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v104'296 uv296 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.744 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:03:31.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.745+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.746+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v104'297 uv297 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.746+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.747+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v104'298 uv298 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.747+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.748+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v104'299 uv299 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.748+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.749+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v104'300 uv275 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.749+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.750+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v104'301 uv301 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.750+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.751+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v104'302 uv302 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.750 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:03:31.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.751+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.752+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v104'303 uv303 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.752+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.753+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v104'304 uv304 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.753+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.754+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v104'305 uv305 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.754+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.754+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v104'306 uv306 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.755+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.755+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v104'307 uv281 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.756+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.757+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v104'308 uv308 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.757+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.757+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v104'309 uv309 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.757 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:03:31.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.758+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.758+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v104'310 uv310 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.758+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.759+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v104'311 uv311 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.759+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.760+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v104'312 uv312 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.760+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.762+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v104'313 uv287 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.762+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.763+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v104'314 uv314 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.763+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.763 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:03:31.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.764+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v104'315 uv315 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.764+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.765+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v104'316 uv316 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.765+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.766+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v104'317 uv317 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.766+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94968a0 con 0x5605d93ed050 2024-09-12T02:03:31.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.767+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v104'318 uv318 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d93ed050 2024-09-12T02:03:31.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.767+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5605d9497c50 0x5605d949a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.767+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d949a580 con 0x5605d9497c50 2024-09-12T02:03:31.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.767+0000 7fcad8afa640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5605d9497c50 0x5605d949a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.767+0000 7fcad8afa640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5605d9497c50 0x5605d949a040 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:31.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.769+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v104'220 uv203 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.769+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d949a920 con 0x5605d9497c50 2024-09-12T02:03:31.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.771+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v104'221 uv221 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.771+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d949acc0 con 0x5605d9497c50 2024-09-12T02:03:31.771 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:03:31.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.772+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v104'222 uv222 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.772+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d949b060 con 0x5605d9497c50 2024-09-12T02:03:31.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.773+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v104'223 uv223 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.773+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d949b400 con 0x5605d9497c50 2024-09-12T02:03:31.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.774+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v104'224 uv224 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.774+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d949b7a0 con 0x5605d9497c50 2024-09-12T02:03:31.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.776+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v104'225 uv208 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.776+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d949bb40 con 0x5605d9497c50 2024-09-12T02:03:31.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.777+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v104'226 uv226 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.777+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d949bee0 con 0x5605d9497c50 2024-09-12T02:03:31.777 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:03:31.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.778+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v104'227 uv227 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.778+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d949bee0 con 0x5605d9497c50 2024-09-12T02:03:31.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.780+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v104'228 uv228 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.780+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d949bee0 con 0x5605d9497c50 2024-09-12T02:03:31.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.781+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v104'229 uv229 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.781+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d949bee0 con 0x5605d9497c50 2024-09-12T02:03:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.782+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v104'230 uv213 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.782+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d949bee0 con 0x5605d9497c50 2024-09-12T02:03:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.783+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v104'231 uv231 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.783+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d949bee0 con 0x5605d9497c50 2024-09-12T02:03:31.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.784+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v104'232 uv232 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.783 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:03:31.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.784+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a0360 con 0x5605d9497c50 2024-09-12T02:03:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.785+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v104'233 uv233 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.785+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a0360 con 0x5605d9497c50 2024-09-12T02:03:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.786+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v104'234 uv234 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.786+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d949bee0 con 0x5605d9497c50 2024-09-12T02:03:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.787+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v104'235 uv219 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.787+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d949bee0 con 0x5605d9497c50 2024-09-12T02:03:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.788+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v104'236 uv236 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.788+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d949bee0 con 0x5605d9497c50 2024-09-12T02:03:31.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.789+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v104'237 uv237 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.789 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:03:31.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.789+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d949cef0 con 0x5605d9497c50 2024-09-12T02:03:31.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.790+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v104'238 uv238 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.791+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d949cef0 con 0x5605d9497c50 2024-09-12T02:03:31.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.791+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v104'239 uv239 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.791+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d949bee0 con 0x5605d9497c50 2024-09-12T02:03:31.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.792+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v104'240 uv240 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d9497c50 2024-09-12T02:03:31.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.792+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5605d949c3f0 0x5605d949e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.793+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d949ed70 con 0x5605d949c3f0 2024-09-12T02:03:31.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.793+0000 7fcad82f9640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5605d949c3f0 0x5605d949e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.793+0000 7fcad82f9640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5605d949c3f0 0x5605d949e7e0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:31.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.794+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v104'57 uv56 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.794+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d949f260 con 0x5605d949c3f0 2024-09-12T02:03:31.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.795+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v104'58 uv58 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.795+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d949f740 con 0x5605d949c3f0 2024-09-12T02:03:31.795 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:03:31.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.796+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v104'59 uv59 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.796+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a0ff0 con 0x5605d949c3f0 2024-09-12T02:03:31.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.798+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v104'60 uv60 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.798+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a1390 con 0x5605d949c3f0 2024-09-12T02:03:31.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.799+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v104'61 uv61 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.799+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d949ffe0 con 0x5605d949c3f0 2024-09-12T02:03:31.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.800+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v104'62 uv62 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.800+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5605d94a08e0 0x5605d94a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.800+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a3c80 con 0x5605d94a08e0 2024-09-12T02:03:31.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.800+0000 7fcad92fb640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5605d94a08e0 0x5605d94a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.800+0000 7fcad92fb640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5605d94a08e0 0x5605d94a3740 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:31.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.802+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v104'46 uv45 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.802+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a3c80 con 0x5605d94a08e0 2024-09-12T02:03:31.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.803+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v104'47 uv47 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.803+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a3d00 con 0x5605d94a08e0 2024-09-12T02:03:31.803 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:03:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.804+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v104'48 uv48 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.804+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a4120 con 0x5605d94a08e0 2024-09-12T02:03:31.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.805+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v104'49 uv49 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.805+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5605d94a4630 0x5605d94a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.805+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a6ff0 con 0x5605d94a4630 2024-09-12T02:03:31.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.805+0000 7fcad8afa640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5605d94a4630 0x5605d94a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.806+0000 7fcad8afa640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5605d94a4630 0x5605d94a6a20 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.807+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v104'57 uv56 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.807+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a70b0 con 0x5605d94a4630 2024-09-12T02:03:31.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.808+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v104'58 uv58 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.808+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a4630 2024-09-12T02:03:31.810 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:03:31.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.811+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v104'59 uv59 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.811+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a84b0 con 0x5605d94a4630 2024-09-12T02:03:31.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.814+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v104'60 uv60 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.814+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a84b0 con 0x5605d94a4630 2024-09-12T02:03:31.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.816+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v104'61 uv61 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.816+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a4630 2024-09-12T02:03:31.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.819+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v104'62 uv62 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.819+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a08e0 2024-09-12T02:03:31.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.821+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v104'105 uv99 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.821+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a08e0 2024-09-12T02:03:31.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.822+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v104'106 uv106 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.822+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a08e0 2024-09-12T02:03:31.822 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:03:31.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.823+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v104'107 uv107 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.823+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a84b0 con 0x5605d94a08e0 2024-09-12T02:03:31.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.824+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v104'108 uv108 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.824+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a84b0 con 0x5605d94a08e0 2024-09-12T02:03:31.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.825+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v104'109 uv109 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.825+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a08e0 2024-09-12T02:03:31.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.826+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v104'110 uv110 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.826+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a08e0 2024-09-12T02:03:31.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.827+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v104'111 uv104 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.827+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a08e0 2024-09-12T02:03:31.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.828+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v104'112 uv112 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.828+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a08e0 2024-09-12T02:03:31.829 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:03:31.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.829+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v104'113 uv113 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.829+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a08e0 2024-09-12T02:03:31.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.830+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v104'114 uv114 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.830+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a08e0 2024-09-12T02:03:31.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.831+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v104'115 uv115 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.831+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a08e0 2024-09-12T02:03:31.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.832+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v104'46 uv45 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.832+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a08e0 2024-09-12T02:03:31.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.833+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v104'47 uv47 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.833+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a08e0 2024-09-12T02:03:31.834 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:03:31.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.834+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v104'48 uv48 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.834+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a08e0 2024-09-12T02:03:31.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.835+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v104'49 uv49 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.835+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a08e0 2024-09-12T02:03:31.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.836+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v104'50 uv50 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcad0057030 con 0x5605d94a08e0 2024-09-12T02:03:31.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.837+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a4630 2024-09-12T02:03:31.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.838+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v104'57 uv56 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.838+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a4630 2024-09-12T02:03:31.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.839+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v104'58 uv58 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.839+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a4630 2024-09-12T02:03:31.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.840+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v104'59 uv59 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.840 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:03:31.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.840+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a84b0 con 0x5605d94a4630 2024-09-12T02:03:31.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.840+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v104'60 uv60 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.840+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a84b0 con 0x5605d94a4630 2024-09-12T02:03:31.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.841+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v104'61 uv61 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.841+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a4630 2024-09-12T02:03:31.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.843+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v104'62 uv62 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.843+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a4630 2024-09-12T02:03:31.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.844+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v104'95 uv95 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.844 INFO:teuthology.orchestra.run.smithi019.stdout:Write #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:03:31.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.844+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a4630 2024-09-12T02:03:31.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.845+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [write 0~34] v104'96 uv96 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.845+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a4630 2024-09-12T02:03:31.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.846+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v104'97 uv97 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.846+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a4630 2024-09-12T02:03:31.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.847+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 100.00000000 [create] v104'98 uv93 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.847+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a74a0 con 0x5605d94a4630 2024-09-12T02:03:31.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.847+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 100.00000000 [delete] v104'99 uv99 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.848+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a7890 con 0x5605d94a4630 2024-09-12T02:03:31.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.848+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v104'100 uv100 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.848 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:03:31.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.848+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94a7890 con 0x5605d94a4630 2024-09-12T02:03:31.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.850+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [omap-set-header] v104'101 uv101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.850+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aa390 con 0x5605d94a4630 2024-09-12T02:03:31.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.851+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v104'102 uv102 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.851+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5605d94a80b0 0x5605d94aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.851+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:99 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aa4a0 con 0x5605d94a80b0 2024-09-12T02:03:31.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.851+0000 7fcad82f9640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5605d94a80b0 0x5605d94aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.851+0000 7fcad82f9640 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5605d94a80b0 0x5605d94aa9f0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:31.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.852+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(99 mds0_sessionmap [create] v104'44 uv43 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d94a80b0 2024-09-12T02:03:31.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.852+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:100 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d94a80b0 2024-09-12T02:03:31.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.855+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(100 mds0_sessionmap [delete] v104'45 uv45 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d94a80b0 2024-09-12T02:03:31.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.855+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d94a80b0 2024-09-12T02:03:31.857 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:03:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.858+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(101 mds0_sessionmap [create] v104'46 uv46 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d94a80b0 2024-09-12T02:03:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.858+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d94a80b0 2024-09-12T02:03:31.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.861+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v104'47 uv47 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d94a80b0 2024-09-12T02:03:31.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.861+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:103 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d94a4630 2024-09-12T02:03:31.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.862+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(103 609.00000000 [create] v104'57 uv56 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.862+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:104 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d94a4630 2024-09-12T02:03:31.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.864+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(104 609.00000000 [delete] v104'58 uv58 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.864+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d94a4630 2024-09-12T02:03:31.865 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:03:31.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.866+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v104'59 uv59 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.866+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94abf40 con 0x5605d94a4630 2024-09-12T02:03:31.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.867+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v104'60 uv60 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.867+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94abf40 con 0x5605d94a4630 2024-09-12T02:03:31.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.868+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v104'61 uv61 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.868+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d94a4630 2024-09-12T02:03:31.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.869+0000 7fcad8afa640 1 -- 172.21.15.19:0/4116966704 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [omap-set-header] v104'62 uv62 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcac8022070 con 0x5605d94a4630 2024-09-12T02:03:31.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.869+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:109 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d949c3f0 2024-09-12T02:03:31.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.870+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(109 400.00000000 [create] v104'47 uv46 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.870+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:110 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d949c3f0 2024-09-12T02:03:31.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.871+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(110 400.00000000 [delete] v104'48 uv48 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.871+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d949c3f0 2024-09-12T02:03:31.871 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:03:31.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.872+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(111 400.00000000 [create] v104'49 uv49 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.872+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d949c3f0 2024-09-12T02:03:31.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.873+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(112 400.00000000 [write 0~22] v104'50 uv50 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.873+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d949c3f0 2024-09-12T02:03:31.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.874+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(113 400.00000000 [omap-set-header] v104'51 uv51 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.875+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d949c3f0 2024-09-12T02:03:31.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.876+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(114 100.00000000.inode [create] v104'119 uv111 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.876+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d949c3f0 2024-09-12T02:03:31.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.877+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(115 100.00000000.inode [delete] v104'120 uv120 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.877+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d949c3f0 2024-09-12T02:03:31.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.878+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(116 100.00000000.inode [create] v104'121 uv121 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.877 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:03:31.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.878+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d949c3f0 2024-09-12T02:03:31.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.879+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v104'122 uv122 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.879+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d949c3f0 2024-09-12T02:03:31.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.880+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v104'123 uv123 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.880+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d949c3f0 2024-09-12T02:03:31.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.881+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(119 1.00000000 [create] v104'124 uv118 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.881+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d949c3f0 2024-09-12T02:03:31.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.882+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(120 1.00000000 [delete] v104'125 uv125 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.882+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf30 con 0x5605d949c3f0 2024-09-12T02:03:31.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.883+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(121 1.00000000 [create] v104'126 uv126 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.882 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:03:31.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.883+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94aaf70 con 0x5605d949c3f0 2024-09-12T02:03:31.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.884+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v104'127 uv127 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.884+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94ac410 con 0x5605d949c3f0 2024-09-12T02:03:31.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.885+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v104'128 uv128 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.885+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94ab320 con 0x5605d949c3f0 2024-09-12T02:03:31.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.886+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(124 1.00000000 [omap-set-header] v104'129 uv129 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.886+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x5605d94ab7d0 con 0x5605d949c3f0 2024-09-12T02:03:31.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcad82f9640 1 -- 172.21.15.19:0/4116966704 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v104'130 uv130 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcacc019040 con 0x5605d949c3f0 2024-09-12T02:03:31.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5605d9497c50 msgr2=0x5605d949a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5605d9497c50 0x5605d949a040 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5605d93ed050 msgr2=0x5605d93ed450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5605d93ed050 0x5605d93ed450 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5605d94a08e0 msgr2=0x5605d94a3740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5605d94a08e0 0x5605d94a3740 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5605d94a80b0 msgr2=0x5605d94aa9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5605d94a80b0 0x5605d94aa9f0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5605d949c3f0 msgr2=0x5605d949e7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5605d949c3f0 0x5605d949e7e0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5605d94a4630 msgr2=0x5605d94a6a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5605d94a4630 0x5605d94a6a20 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 reap_dead start 2024-09-12T02:03:31.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcad92fb640 1 -- 172.21.15.19:0/4116966704 reap_dead start 2024-09-12T02:03:31.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcac406a810 msgr2=0x7fcac406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcac406a810 0x7fcac406ccd0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x5605d93efc70 tx=0x7fcacc001930 comp rx=0 tx=0).stop 2024-09-12T02:03:31.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605d9345f40 msgr2=0x5605d93e9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605d9345f40 0x5605d93e9830 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fcac800ae50 tx=0x7fcac80032f0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 shutdown_connections 2024-09-12T02:03:31.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcac406a810 0x7fcac406ccd0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 --2- 172.21.15.19:0/4116966704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605d9345f40 0x5605d93e9830 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 >> 172.21.15.19:0/4116966704 conn(0x5605d931b9e0 msgr2=0x5605d9347bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:31.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 shutdown_connections 2024-09-12T02:03:31.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.887+0000 7fcadb91cf40 1 -- 172.21.15.19:0/4116966704 wait complete. 2024-09-12T02:03:31.890 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 100.00000000 2024-09-12T02:03:31.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.975+0000 7f5a30e42f40 1 Processor -- start 2024-09-12T02:03:31.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.975+0000 7f5a30e42f40 1 -- start start 2024-09-12T02:03:31.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.976+0000 7f5a30e42f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fb5d372b40 0x55fb5d3b9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.976+0000 7f5a30e42f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb5d3bb050 0x55fb5d3b9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.976+0000 7f5a30e42f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb5d372f20 0x55fb5d3b9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.976+0000 7f5a30e42f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fb5d2c1510 con 0x55fb5d372f20 2024-09-12T02:03:31.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.976+0000 7f5a30e42f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fb5d36ff20 con 0x55fb5d3bb050 2024-09-12T02:03:31.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.976+0000 7f5a30e42f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55fb5d3b7800 con 0x55fb5d372b40 2024-09-12T02:03:31.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.976+0000 7f5a2f139640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb5d372f20 0x55fb5d3b9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.976+0000 7f5a2f139640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb5d372f20 0x55fb5d3b9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56776/0 (socket says 172.21.15.19:56776) 2024-09-12T02:03:31.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.976+0000 7f5a2f139640 1 -- 172.21.15.19:0/127806128 learned_addr learned my addr 172.21.15.19:0/127806128 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:31.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.976+0000 7f5a2e938640 1 --2- 172.21.15.19:0/127806128 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fb5d372b40 0x55fb5d3b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.976+0000 7f5a2e137640 1 --2- 172.21.15.19:0/127806128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb5d3bb050 0x55fb5d3b9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.976+0000 7f5a2f139640 1 -- 172.21.15.19:0/127806128 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fb5d372b40 msgr2=0x55fb5d3b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:31.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.976+0000 7f5a2f139640 1 --2- 172.21.15.19:0/127806128 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fb5d372b40 0x55fb5d3b9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.976+0000 7f5a2f139640 1 -- 172.21.15.19:0/127806128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb5d3bb050 msgr2=0x55fb5d3b9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:31.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.976+0000 7f5a2f139640 1 --2- 172.21.15.19:0/127806128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb5d3bb050 0x55fb5d3b9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.976+0000 7f5a2f139640 1 -- 172.21.15.19:0/127806128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb5d446510 con 0x55fb5d372f20 2024-09-12T02:03:31.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.976+0000 7f5a2f139640 1 --2- 172.21.15.19:0/127806128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb5d372f20 0x55fb5d3b9e80 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f5a28025a40 tx=0x7f5a28050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb1544ac96686d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:31.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.977+0000 7f5a2d135640 1 -- 172.21.15.19:0/127806128 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a28065070 con 0x55fb5d372f20 2024-09-12T02:03:31.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.977+0000 7f5a2d135640 1 -- 172.21.15.19:0/127806128 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a28051880 con 0x55fb5d372f20 2024-09-12T02:03:31.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.977+0000 7f5a2d135640 1 -- 172.21.15.19:0/127806128 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a28055040 con 0x55fb5d372f20 2024-09-12T02:03:31.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.977+0000 7f5a30e42f40 1 -- 172.21.15.19:0/127806128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb5d372f20 msgr2=0x55fb5d3b9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.977+0000 7f5a30e42f40 1 --2- 172.21.15.19:0/127806128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb5d372f20 0x55fb5d3b9e80 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f5a28025a40 tx=0x7f5a28050000 comp rx=0 tx=0).stop 2024-09-12T02:03:31.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.977+0000 7f5a30e42f40 1 -- 172.21.15.19:0/127806128 shutdown_connections 2024-09-12T02:03:31.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.977+0000 7f5a30e42f40 1 --2- 172.21.15.19:0/127806128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb5d372f20 0x55fb5d3b9e80 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.977+0000 7f5a30e42f40 1 --2- 172.21.15.19:0/127806128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb5d3bb050 0x55fb5d3b9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.977+0000 7f5a30e42f40 1 --2- 172.21.15.19:0/127806128 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fb5d372b40 0x55fb5d3b9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.977+0000 7f5a30e42f40 1 -- 172.21.15.19:0/127806128 >> 172.21.15.19:0/127806128 conn(0x55fb5d39d490 msgr2=0x55fb5d3b6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:31.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.977+0000 7f5a30e42f40 1 -- 172.21.15.19:0/127806128 shutdown_connections 2024-09-12T02:03:31.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.977+0000 7f5a30e42f40 1 -- 172.21.15.19:0/127806128 wait complete. 2024-09-12T02:03:31.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.978+0000 7f5a30e42f40 1 Processor -- start 2024-09-12T02:03:31.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.978+0000 7f5a30e42f40 1 -- start start 2024-09-12T02:03:31.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.978+0000 7f5a30e42f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb5d372b40 0x55fb5d4dec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.978+0000 7f5a30e42f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fb5d372f20 0x55fb5d435d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.978+0000 7f5a30e42f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb5d3bb050 0x55fb5d4df390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.978+0000 7f5a30e42f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fb5d39dab0 con 0x55fb5d3bb050 2024-09-12T02:03:31.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.978+0000 7f5a30e42f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fb5d43d5a0 con 0x55fb5d372b40 2024-09-12T02:03:31.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.978+0000 7f5a30e42f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55fb5d39dc30 con 0x55fb5d372f20 2024-09-12T02:03:31.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.979+0000 7f5a2f139640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb5d3bb050 0x55fb5d4df390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.979+0000 7f5a2f139640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb5d3bb050 0x55fb5d4df390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56792/0 (socket says 172.21.15.19:56792) 2024-09-12T02:03:31.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.979+0000 7f5a2e938640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb5d372b40 0x55fb5d4dec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.979+0000 7f5a2f139640 1 -- 172.21.15.19:0/1509832349 learned_addr learned my addr 172.21.15.19:0/1509832349 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:31.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.979+0000 7f5a2e137640 1 --2- 172.21.15.19:0/1509832349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fb5d372f20 0x55fb5d435d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.979+0000 7f5a2f139640 1 -- 172.21.15.19:0/1509832349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fb5d372f20 msgr2=0x55fb5d435d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.979+0000 7f5a2f139640 1 --2- 172.21.15.19:0/1509832349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fb5d372f20 0x55fb5d435d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.979+0000 7f5a2f139640 1 -- 172.21.15.19:0/1509832349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb5d372b40 msgr2=0x55fb5d4dec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.979+0000 7f5a2f139640 1 --2- 172.21.15.19:0/1509832349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb5d372b40 0x55fb5d4dec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.979+0000 7f5a2f139640 1 -- 172.21.15.19:0/1509832349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb5d4df190 con 0x55fb5d3bb050 2024-09-12T02:03:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.979+0000 7f5a2f139640 1 --2- 172.21.15.19:0/1509832349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb5d3bb050 0x55fb5d4df390 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f5a28005fd0 tx=0x7f5a280033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.979+0000 7f5a17fff640 1 -- 172.21.15.19:0/1509832349 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2806e070 con 0x55fb5d3bb050 2024-09-12T02:03:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.979+0000 7f5a17fff640 1 -- 172.21.15.19:0/1509832349 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a2805c440 con 0x55fb5d3bb050 2024-09-12T02:03:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.979+0000 7f5a30e42f40 1 -- 172.21.15.19:0/1509832349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb5d449f30 con 0x55fb5d3bb050 2024-09-12T02:03:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.979+0000 7f5a17fff640 1 -- 172.21.15.19:0/1509832349 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a28065040 con 0x55fb5d3bb050 2024-09-12T02:03:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.979+0000 7f5a30e42f40 1 -- 172.21.15.19:0/1509832349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb5d447740 con 0x55fb5d3bb050 2024-09-12T02:03:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.981+0000 7f5a17fff640 1 -- 172.21.15.19:0/1509832349 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a28071070 con 0x55fb5d3bb050 2024-09-12T02:03:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.981+0000 7f5a17fff640 1 --2- 172.21.15.19:0/1509832349 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a1c06a810 0x7f5a1c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.981+0000 7f5a17fff640 1 -- 172.21.15.19:0/1509832349 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7077+0+0 (secure 0 0 0) 0x7f5a280cddb0 con 0x55fb5d3bb050 2024-09-12T02:03:31.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.982+0000 7f5a30e42f40 1 --2- 172.21.15.19:0/1509832349 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55fb5d4df8d0 0x55fb5d438500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:31.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.982+0000 7f5a30e42f40 1 -- 172.21.15.19:0/1509832349 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:1 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x55fb5d436290 con 0x55fb5d4df8d0 2024-09-12T02:03:31.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.982+0000 7f5a2e938640 1 --2- 172.21.15.19:0/1509832349 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a1c06a810 0x7f5a1c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.982+0000 7f5a2e137640 1 --2- 172.21.15.19:0/1509832349 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55fb5d4df8d0 0x55fb5d438500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:31.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.982+0000 7f5a2e938640 1 --2- 172.21.15.19:0/1509832349 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a1c06a810 0x7f5a1c06ccd0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5a20003130 tx=0x7f5a20011040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:31.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.982+0000 7f5a2e137640 1 --2- 172.21.15.19:0/1509832349 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55fb5d4df8d0 0x55fb5d438500 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:31.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.983+0000 7f5a2e137640 1 -- 172.21.15.19:0/1509832349 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(1 100.00000000 [delete] v104'103 uv103 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5a24009910 con 0x55fb5d4df8d0 2024-09-12T02:03:31.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.984+0000 7f5a30e42f40 1 -- 172.21.15.19:0/1509832349 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55fb5d4df8d0 msgr2=0x55fb5d438500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.984+0000 7f5a30e42f40 1 --2- 172.21.15.19:0/1509832349 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55fb5d4df8d0 0x55fb5d438500 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.984+0000 7f5a30e42f40 1 -- 172.21.15.19:0/1509832349 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a1c06a810 msgr2=0x7f5a1c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.984+0000 7f5a30e42f40 1 --2- 172.21.15.19:0/1509832349 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a1c06a810 0x7f5a1c06ccd0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5a20003130 tx=0x7f5a20011040 comp rx=0 tx=0).stop 2024-09-12T02:03:31.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.984+0000 7f5a30e42f40 1 -- 172.21.15.19:0/1509832349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb5d3bb050 msgr2=0x55fb5d4df390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:31.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.984+0000 7f5a30e42f40 1 --2- 172.21.15.19:0/1509832349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb5d3bb050 0x55fb5d4df390 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f5a28005fd0 tx=0x7f5a280033a0 comp rx=0 tx=0).stop 2024-09-12T02:03:31.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.984+0000 7f5a2f139640 1 -- 172.21.15.19:0/1509832349 reap_dead start 2024-09-12T02:03:31.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.984+0000 7f5a30e42f40 1 -- 172.21.15.19:0/1509832349 shutdown_connections 2024-09-12T02:03:31.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.984+0000 7f5a30e42f40 1 -- 172.21.15.19:0/1509832349 >> 172.21.15.19:0/1509832349 conn(0x55fb5d39d490 msgr2=0x55fb5d4459d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:31.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.984+0000 7f5a30e42f40 1 -- 172.21.15.19:0/1509832349 shutdown_connections 2024-09-12T02:03:31.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:31.984+0000 7f5a30e42f40 1 -- 172.21.15.19:0/1509832349 wait complete. 2024-09-12T02:03:31.987 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:03:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.093+0000 7f5c1d85e640 1 Processor -- start 2024-09-12T02:03:32.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.093+0000 7f5c1d85e640 1 -- start start 2024-09-12T02:03:32.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.094+0000 7f5c1d85e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c180d4c10 0x7f5c18162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:32.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.094+0000 7f5c1d85e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5c180d3320 0x7f5c180d37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:32.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.094+0000 7f5c1d85e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c180d2600 con 0x7f5c180b5f80 2024-09-12T02:03:32.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.094+0000 7f5c1d85e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f5c180d5420 con 0x7f5c180d3320 2024-09-12T02:03:32.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.094+0000 7f5c1d85e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5c180d2e90 con 0x7f5c180d4c10 2024-09-12T02:03:32.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.094+0000 7f5c177fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5c180d3320 0x7f5c180d37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:32.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.094+0000 7f5c16ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5c180b5f80 0x7f5c180b6360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35708/0 (socket says 172.21.15.19:35708) 2024-09-12T02:03:32.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.094+0000 7f5c16ffd640 1 -- 172.21.15.19:0/4172359253 learned_addr learned my addr 172.21.15.19:0/4172359253 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:32.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.094+0000 7f5c177fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5c180d3320 0x7f5c180d37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56806/0 (socket says 172.21.15.19:56806) 2024-09-12T02:03:32.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.094+0000 7f5c0e7fc640 1 --2- 172.21.15.19:0/4172359253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c180d4c10 0x7f5c18162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:32.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.094+0000 7f5c177fe640 1 -- 172.21.15.19:0/4172359253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c180d4c10 msgr2=0x7f5c18162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:32.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.094+0000 7f5c177fe640 1 --2- 172.21.15.19:0/4172359253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c180d4c10 0x7f5c18162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:32.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.094+0000 7f5c177fe640 1 -- 172.21.15.19:0/4172359253 >> v1:172.21.15.19:6789/0 conn(0x7f5c180b5f80 legacy=0x7f5c180b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:32.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.094+0000 7f5c177fe640 1 -- 172.21.15.19:0/4172359253 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c180b3c10 con 0x7f5c180d3320 2024-09-12T02:03:32.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.094+0000 7f5c167fc640 1 -- 172.21.15.19:0/4172359253 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 604169907 0 0) 0x7f5c08001110 con 0x7f5c180b5f80 2024-09-12T02:03:32.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.095+0000 7f5c177fe640 1 --2- 172.21.15.19:0/4172359253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c180d3320 0x7f5c180d37b0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009d90 tx=0x7f5c1002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2355c7231d453a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:32.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.095+0000 7f5c167fc640 1 -- 172.21.15.19:0/4172359253 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10007740 con 0x7f5c180d3320 2024-09-12T02:03:32.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.095+0000 7f5c167fc640 1 -- 172.21.15.19:0/4172359253 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c100078e0 con 0x7f5c180d3320 2024-09-12T02:03:32.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.095+0000 7f5c167fc640 1 -- 172.21.15.19:0/4172359253 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10007cb0 con 0x7f5c180d3320 2024-09-12T02:03:32.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.096+0000 7f5c1d85e640 1 -- 172.21.15.19:0/4172359253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c180d3320 msgr2=0x7f5c180d37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:32.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.096+0000 7f5c1d85e640 1 --2- 172.21.15.19:0/4172359253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c180d3320 0x7f5c180d37b0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009d90 tx=0x7f5c1002a660 comp rx=0 tx=0).stop 2024-09-12T02:03:32.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.096+0000 7f5c1d85e640 1 -- 172.21.15.19:0/4172359253 shutdown_connections 2024-09-12T02:03:32.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.096+0000 7f5c1d85e640 1 --2- 172.21.15.19:0/4172359253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c180d3320 0x7f5c180d37b0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:32.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.096+0000 7f5c1d85e640 1 --2- 172.21.15.19:0/4172359253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c180d4c10 0x7f5c18162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:32.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.096+0000 7f5c1d85e640 1 -- 172.21.15.19:0/4172359253 >> 172.21.15.19:0/4172359253 conn(0x7f5c1808bfc0 msgr2=0x7f5c180d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:32.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.096+0000 7f5c1d85e640 1 -- 172.21.15.19:0/4172359253 shutdown_connections 2024-09-12T02:03:32.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.096+0000 7f5c1d85e640 1 -- 172.21.15.19:0/4172359253 wait complete. 2024-09-12T02:03:32.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.097+0000 7f5c1d85e640 1 Processor -- start 2024-09-12T02:03:32.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.097+0000 7f5c1d85e640 1 -- start start 2024-09-12T02:03:32.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.098+0000 7f5c1d85e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c180b5f80 0x7f5c18154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:32.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.098+0000 7f5c1d85e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c180d3320 0x7f5c18155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:32.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.098+0000 7f5c1d85e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c180d4c10 0x7f5c18155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:32.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.098+0000 7f5c1d85e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5c180d2b20 con 0x7f5c180d4c10 2024-09-12T02:03:32.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.098+0000 7f5c1d85e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5c180d2880 con 0x7f5c180d3320 2024-09-12T02:03:32.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.098+0000 7f5c1d85e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1815f690 con 0x7f5c180b5f80 2024-09-12T02:03:32.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.098+0000 7f5c177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c180d4c10 0x7f5c18155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:32.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.098+0000 7f5c177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c180d4c10 0x7f5c18155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56810/0 (socket says 172.21.15.19:56810) 2024-09-12T02:03:32.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.098+0000 7f5c177fe640 1 -- 172.21.15.19:0/2979109375 learned_addr learned my addr 172.21.15.19:0/2979109375 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:32.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.098+0000 7f5c16ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c180b5f80 0x7f5c18154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:32.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.098+0000 7f5c0e7fc640 1 --2- 172.21.15.19:0/2979109375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c180d3320 0x7f5c18155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:32.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.098+0000 7f5c177fe640 1 -- 172.21.15.19:0/2979109375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c180b5f80 msgr2=0x7f5c18154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:32.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.098+0000 7f5c177fe640 1 --2- 172.21.15.19:0/2979109375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c180b5f80 0x7f5c18154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:32.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.098+0000 7f5c177fe640 1 -- 172.21.15.19:0/2979109375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c180d3320 msgr2=0x7f5c18155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:32.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.098+0000 7f5c177fe640 1 --2- 172.21.15.19:0/2979109375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c180d3320 0x7f5c18155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:32.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.098+0000 7f5c177fe640 1 -- 172.21.15.19:0/2979109375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c180b1450 con 0x7f5c180d4c10 2024-09-12T02:03:32.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.098+0000 7f5c16ffd640 1 --2- 172.21.15.19:0/2979109375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c180b5f80 0x7f5c18154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:03:32.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.099+0000 7f5c177fe640 1 --2- 172.21.15.19:0/2979109375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c180d4c10 0x7f5c18155940 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009eb0 tx=0x7f5c10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:32.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.099+0000 7f5c14ff9640 1 -- 172.21.15.19:0/2979109375 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10040070 con 0x7f5c180d4c10 2024-09-12T02:03:32.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.099+0000 7f5c14ff9640 1 -- 172.21.15.19:0/2979109375 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c10031bc0 con 0x7f5c180d4c10 2024-09-12T02:03:32.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.099+0000 7f5c1d85e640 1 -- 172.21.15.19:0/2979109375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c18156470 con 0x7f5c180d4c10 2024-09-12T02:03:32.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.099+0000 7f5c14ff9640 1 -- 172.21.15.19:0/2979109375 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10009450 con 0x7f5c180d4c10 2024-09-12T02:03:32.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.099+0000 7f5c1d85e640 1 -- 172.21.15.19:0/2979109375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c18156a30 con 0x7f5c180d4c10 2024-09-12T02:03:32.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.100+0000 7f5c1d85e640 1 -- 172.21.15.19:0/2979109375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c180d3f70 con 0x7f5c180d4c10 2024-09-12T02:03:32.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.101+0000 7f5c14ff9640 1 -- 172.21.15.19:0/2979109375 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c10039040 con 0x7f5c180d4c10 2024-09-12T02:03:32.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.101+0000 7f5c14ff9640 1 --2- 172.21.15.19:0/2979109375 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5bf806be30 0x7f5bf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:32.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.101+0000 7f5c14ff9640 1 -- 172.21.15.19:0/2979109375 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7077+0+0 (secure 0 0 0) 0x7f5c100acb70 con 0x7f5c180d4c10 2024-09-12T02:03:32.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.101+0000 7f5c16ffd640 1 --2- 172.21.15.19:0/2979109375 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5bf806be30 0x7f5bf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:32.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.102+0000 7f5c16ffd640 1 --2- 172.21.15.19:0/2979109375 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5bf806be30 0x7f5bf806e2f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5c08007fd0 tx=0x7f5c08007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:32.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.106+0000 7f5c14ff9640 1 -- 172.21.15.19:0/2979109375 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c180b1450 con 0x7f5c180d4c10 2024-09-12T02:03:32.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.318+0000 7f5c1d85e640 1 -- 172.21.15.19:0/2979109375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f5c1806d1e0 con 0x7f5c180d4c10 2024-09-12T02:03:32.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.674+0000 7f5c14ff9640 1 -- 172.21.15.19:0/2979109375 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v138) ==== 162+0+0 (secure 0 0 0) 0x7f5c180b3c10 con 0x7f5c180d4c10 2024-09-12T02:03:32.674 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:03:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.677+0000 7f5c1d85e640 1 -- 172.21.15.19:0/2979109375 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5bf806be30 msgr2=0x7f5bf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.677+0000 7f5c1d85e640 1 --2- 172.21.15.19:0/2979109375 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5bf806be30 0x7f5bf806e2f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5c08007fd0 tx=0x7f5c08007de0 comp rx=0 tx=0).stop 2024-09-12T02:03:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.677+0000 7f5c1d85e640 1 -- 172.21.15.19:0/2979109375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c180d4c10 msgr2=0x7f5c18155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.677+0000 7f5c1d85e640 1 --2- 172.21.15.19:0/2979109375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c180d4c10 0x7f5c18155940 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009eb0 tx=0x7f5c10004a40 comp rx=0 tx=0).stop 2024-09-12T02:03:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.677+0000 7f5c1d85e640 1 -- 172.21.15.19:0/2979109375 shutdown_connections 2024-09-12T02:03:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.677+0000 7f5c1d85e640 1 --2- 172.21.15.19:0/2979109375 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5bf806be30 0x7f5bf806e2f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.677+0000 7f5c1d85e640 1 --2- 172.21.15.19:0/2979109375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c180d4c10 0x7f5c18155940 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.677+0000 7f5c1d85e640 1 --2- 172.21.15.19:0/2979109375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c180d3320 0x7f5c18155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.677+0000 7f5c1d85e640 1 --2- 172.21.15.19:0/2979109375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c180b5f80 0x7f5c18154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.677+0000 7f5c1d85e640 1 -- 172.21.15.19:0/2979109375 >> 172.21.15.19:0/2979109375 conn(0x7f5c1808bfc0 msgr2=0x7f5c18160260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.677+0000 7f5c1d85e640 1 -- 172.21.15.19:0/2979109375 shutdown_connections 2024-09-12T02:03:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.677+0000 7f5c1d85e640 1 -- 172.21.15.19:0/2979109375 wait complete. 2024-09-12T02:03:32.689 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:32.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.791+0000 7f0220742640 1 Processor -- start 2024-09-12T02:03:32.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.791+0000 7f0220742640 1 -- start start 2024-09-12T02:03:32.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.792+0000 7f0220742640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0218071750 0x7f02180d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:32.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.792+0000 7f0220742640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f02180d0b20 0x7f02181680c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:32.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.792+0000 7f0220742640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02180d12c0 con 0x7f021809aca0 2024-09-12T02:03:32.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.792+0000 7f0220742640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f021806d040 con 0x7f02180d0b20 2024-09-12T02:03:32.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.792+0000 7f0220742640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f02180d15a0 con 0x7f0218071750 2024-09-12T02:03:32.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.792+0000 7f021ecdf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f02180d0b20 0x7f02181680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:32.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.792+0000 7f021e4de640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f021809aca0 0x7f021809b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35714/0 (socket says 172.21.15.19:35714) 2024-09-12T02:03:32.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.792+0000 7f021ecdf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f02180d0b20 0x7f02181680c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56814/0 (socket says 172.21.15.19:56814) 2024-09-12T02:03:32.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.792+0000 7f021e4de640 1 -- 172.21.15.19:0/2298459831 learned_addr learned my addr 172.21.15.19:0/2298459831 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:32.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.793+0000 7f021dcdd640 1 --2- 172.21.15.19:0/2298459831 >> v2:172.21.15.135:3300/0 conn(0x7f0218071750 0x7f02180d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:32.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.793+0000 7f021ecdf640 1 -- 172.21.15.19:0/2298459831 >> v2:172.21.15.135:3300/0 conn(0x7f0218071750 msgr2=0x7f02180d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:32.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.793+0000 7f021ecdf640 1 --2- 172.21.15.19:0/2298459831 >> v2:172.21.15.135:3300/0 conn(0x7f0218071750 0x7f02180d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:32.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.793+0000 7f021ecdf640 1 -- 172.21.15.19:0/2298459831 >> v1:172.21.15.19:6789/0 conn(0x7f021809aca0 legacy=0x7f021809b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:32.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.793+0000 7f021d4dc640 1 -- 172.21.15.19:0/2298459831 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2017419987 0 0) 0x7f02180d12c0 con 0x7f021809aca0 2024-09-12T02:03:32.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.793+0000 7f021ecdf640 1 -- 172.21.15.19:0/2298459831 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02180d1880 con 0x7f02180d0b20 2024-09-12T02:03:32.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.794+0000 7f021ecdf640 1 --2- 172.21.15.19:0/2298459831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02180d0b20 0x7f02181680c0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f02180b1e10 tx=0x7f021002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323e54a8eb57aab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:32.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.794+0000 7f021d4dc640 1 -- 172.21.15.19:0/2298459831 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210037070 con 0x7f02180d0b20 2024-09-12T02:03:32.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.794+0000 7f021d4dc640 1 -- 172.21.15.19:0/2298459831 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0210032440 con 0x7f02180d0b20 2024-09-12T02:03:32.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.794+0000 7f021d4dc640 1 -- 172.21.15.19:0/2298459831 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210032810 con 0x7f02180d0b20 2024-09-12T02:03:32.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.794+0000 7f0220742640 1 -- 172.21.15.19:0/2298459831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02180d0b20 msgr2=0x7f02181680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:32.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.794+0000 7f0220742640 1 --2- 172.21.15.19:0/2298459831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02180d0b20 0x7f02181680c0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f02180b1e10 tx=0x7f021002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:03:32.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.794+0000 7f0220742640 1 -- 172.21.15.19:0/2298459831 shutdown_connections 2024-09-12T02:03:32.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.794+0000 7f0220742640 1 --2- 172.21.15.19:0/2298459831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02180d0b20 0x7f02181680c0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:32.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.794+0000 7f0220742640 1 --2- 172.21.15.19:0/2298459831 >> v2:172.21.15.135:3300/0 conn(0x7f0218071750 0x7f02180d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:32.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.794+0000 7f0220742640 1 -- 172.21.15.19:0/2298459831 >> 172.21.15.19:0/2298459831 conn(0x7f02180d23a0 msgr2=0x7f02180d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:32.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.794+0000 7f0220742640 1 -- 172.21.15.19:0/2298459831 shutdown_connections 2024-09-12T02:03:32.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.794+0000 7f0220742640 1 -- 172.21.15.19:0/2298459831 wait complete. 2024-09-12T02:03:32.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.796+0000 7f0220742640 1 Processor -- start 2024-09-12T02:03:32.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.796+0000 7f0220742640 1 -- start start 2024-09-12T02:03:32.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.796+0000 7f0220742640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0218071750 0x7f02180c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:32.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.796+0000 7f0220742640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f021809aca0 0x7f021814d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:32.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.796+0000 7f0220742640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02180d0b20 0x7f021806d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:32.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.796+0000 7f0220742640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f021809b790 con 0x7f02180d0b20 2024-09-12T02:03:32.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.796+0000 7f0220742640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0218070220 con 0x7f021809aca0 2024-09-12T02:03:32.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.796+0000 7f0220742640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f02180d0f70 con 0x7f0218071750 2024-09-12T02:03:32.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.797+0000 7f021ecdf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02180d0b20 0x7f021806d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:32.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.797+0000 7f021ecdf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02180d0b20 0x7f021806d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56830/0 (socket says 172.21.15.19:56830) 2024-09-12T02:03:32.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.797+0000 7f021ecdf640 1 -- 172.21.15.19:0/1811269490 learned_addr learned my addr 172.21.15.19:0/1811269490 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:32.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.797+0000 7f021dcdd640 1 --2- 172.21.15.19:0/1811269490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f021809aca0 0x7f021814d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:32.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.797+0000 7f021e4de640 1 --2- 172.21.15.19:0/1811269490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0218071750 0x7f02180c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:32.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.797+0000 7f021ecdf640 1 -- 172.21.15.19:0/1811269490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0218071750 msgr2=0x7f02180c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.797+0000 7f021ecdf640 1 --2- 172.21.15.19:0/1811269490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0218071750 0x7f02180c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.797+0000 7f021ecdf640 1 -- 172.21.15.19:0/1811269490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f021809aca0 msgr2=0x7f021814d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.797+0000 7f021ecdf640 1 --2- 172.21.15.19:0/1811269490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f021809aca0 0x7f021814d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.797+0000 7f021ecdf640 1 -- 172.21.15.19:0/1811269490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02180b3920 con 0x7f02180d0b20 2024-09-12T02:03:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.797+0000 7f021ecdf640 1 --2- 172.21.15.19:0/1811269490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02180d0b20 0x7f021806d7a0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f0210035040 tx=0x7f02100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.797+0000 7f0216ffd640 1 -- 172.21.15.19:0/1811269490 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210037040 con 0x7f02180d0b20 2024-09-12T02:03:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.797+0000 7f0216ffd640 1 -- 172.21.15.19:0/1811269490 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0210042070 con 0x7f02180d0b20 2024-09-12T02:03:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.797+0000 7f0216ffd640 1 -- 172.21.15.19:0/1811269490 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210030b30 con 0x7f02180d0b20 2024-09-12T02:03:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.797+0000 7f0220742640 1 -- 172.21.15.19:0/1811269490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02180b3360 con 0x7f02180d0b20 2024-09-12T02:03:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.797+0000 7f0220742640 1 -- 172.21.15.19:0/1811269490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0218157be0 con 0x7f02180d0b20 2024-09-12T02:03:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.798+0000 7f0220742640 1 -- 172.21.15.19:0/1811269490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02180d05e0 con 0x7f02180d0b20 2024-09-12T02:03:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.799+0000 7f0216ffd640 1 -- 172.21.15.19:0/1811269490 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0210030cd0 con 0x7f02180d0b20 2024-09-12T02:03:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.799+0000 7f0216ffd640 1 --2- 172.21.15.19:0/1811269490 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f020406be60 0x7f020406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:32.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.800+0000 7f0216ffd640 1 -- 172.21.15.19:0/1811269490 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7077+0+0 (secure 0 0 0) 0x7f02100abe80 con 0x7f02180d0b20 2024-09-12T02:03:32.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.800+0000 7f021e4de640 1 --2- 172.21.15.19:0/1811269490 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f020406be60 0x7f020406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:32.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.800+0000 7f021e4de640 1 --2- 172.21.15.19:0/1811269490 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f020406be60 0x7f020406e320 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f02080012e0 tx=0x7f0208001700 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:32.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:32.804+0000 7f0216ffd640 1 -- 172.21.15.19:0/1811269490 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0210032e20 con 0x7f02180d0b20 2024-09-12T02:03:33.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:33.016+0000 7f0220742640 1 -- 172.21.15.19:0/1811269490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f021815dfa0 con 0x7f02180d0b20 2024-09-12T02:03:33.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:33.016+0000 7f0216ffd640 1 -- 172.21.15.19:0/1811269490 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 139 v139) ==== 95+0+4398 (secure 0 0 0) 0x7f0210079b50 con 0x7f02180d0b20 2024-09-12T02:03:33.016 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:33.016 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":139,"btime":"2024-09-12T02:03:32:677468+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":139,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:32.677438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8208":{"gid":8208,"name":"c","rank":0,"incarnation":139,"state":"up:replay","state_seq":1,"addr":"172.21.15.19:6834/4124612835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":4124612835},{"type":"v1","addr":"172.21.15.19:6834","nonce":4124612835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:33.016 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 139 2024-09-12T02:03:33.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:33.018+0000 7f0220742640 1 -- 172.21.15.19:0/1811269490 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f020406be60 msgr2=0x7f020406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:33.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:33.018+0000 7f0220742640 1 --2- 172.21.15.19:0/1811269490 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f020406be60 0x7f020406e320 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f02080012e0 tx=0x7f0208001700 comp rx=0 tx=0).stop 2024-09-12T02:03:33.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:33.018+0000 7f0220742640 1 -- 172.21.15.19:0/1811269490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02180d0b20 msgr2=0x7f021806d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:33.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:33.018+0000 7f0220742640 1 --2- 172.21.15.19:0/1811269490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02180d0b20 0x7f021806d7a0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f0210035040 tx=0x7f02100046c0 comp rx=0 tx=0).stop 2024-09-12T02:03:33.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:33.018+0000 7f0220742640 1 -- 172.21.15.19:0/1811269490 shutdown_connections 2024-09-12T02:03:33.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:33.018+0000 7f0220742640 1 --2- 172.21.15.19:0/1811269490 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f020406be60 0x7f020406e320 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:33.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:33.018+0000 7f0220742640 1 --2- 172.21.15.19:0/1811269490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02180d0b20 0x7f021806d7a0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:33.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:33.018+0000 7f0220742640 1 --2- 172.21.15.19:0/1811269490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f021809aca0 0x7f021814d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:33.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:33.018+0000 7f0220742640 1 --2- 172.21.15.19:0/1811269490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0218071750 0x7f02180c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:33.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:33.019+0000 7f0220742640 1 -- 172.21.15.19:0/1811269490 >> 172.21.15.19:0/1811269490 conn(0x7f02180d23a0 msgr2=0x7f02180cee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:33.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:33.019+0000 7f0220742640 1 -- 172.21.15.19:0/1811269490 shutdown_connections 2024-09-12T02:03:33.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:33.019+0000 7f0220742640 1 -- 172.21.15.19:0/1811269490 wait complete. 2024-09-12T02:03:33.029 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-12T02:03:33.405 INFO:tasks.ceph.mds.d.smithi135.stderr: -48> 2024-09-12T02:03:28.653+0000 7f10a0adb640 -1 mds.0.inotable: load_2 could not read table: -2 2024-09-12T02:03:33.405 INFO:tasks.ceph.mds.d.smithi135.stderr: -47> 2024-09-12T02:03:28.653+0000 7f10a0adb640 -1 log_channel(cluster) log [ERR] : error reading table object 'mds0_inotable' -2 ((2) No such file or directory) 2024-09-12T02:03:33.431 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T02:03:35.695 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:03:35.696+0000 7fda4b16d640 -1 log_channel(cluster) log [ERR] : dir 0x100 object missing on disk; some files may be lost (~mds0) 2024-09-12T02:03:35.696 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:03:35.697+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:03:35.696 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:03:35.697+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:03:38.030 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:38.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.147+0000 7fefbbb3b640 1 Processor -- start 2024-09-12T02:03:38.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.147+0000 7fefbbb3b640 1 -- start start 2024-09-12T02:03:38.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.148+0000 7fefbbb3b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fefb4161c80 0x7fefb406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:38.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.148+0000 7fefbbb3b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fefb40b6680 0x7fefb40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:38.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.148+0000 7fefbbb3b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefb406e870 con 0x7fefb4162060 2024-09-12T02:03:38.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.148+0000 7fefbbb3b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fefb406d9f0 con 0x7fefb4161c80 2024-09-12T02:03:38.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.148+0000 7fefbbb3b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fefb406dcd0 con 0x7fefb40b6680 2024-09-12T02:03:38.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.148+0000 7fefb98d7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fefb4161c80 0x7fefb406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:38.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.148+0000 7fefb90d6640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fefb4162060 0x7fefb40b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35716/0 (socket says 172.21.15.19:35716) 2024-09-12T02:03:38.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.148+0000 7fefb90d6640 1 -- 172.21.15.19:0/568874036 learned_addr learned my addr 172.21.15.19:0/568874036 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:38.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.148+0000 7fefba0d8640 1 --2- 172.21.15.19:0/568874036 >> v2:172.21.15.135:3300/0 conn(0x7fefb40b6680 0x7fefb40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:38.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.148+0000 7fefb98d7640 1 -- 172.21.15.19:0/568874036 >> v2:172.21.15.135:3300/0 conn(0x7fefb40b6680 msgr2=0x7fefb40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:38.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.148+0000 7fefb98d7640 1 --2- 172.21.15.19:0/568874036 >> v2:172.21.15.135:3300/0 conn(0x7fefb40b6680 0x7fefb40cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.148+0000 7fefb98d7640 1 -- 172.21.15.19:0/568874036 >> v1:172.21.15.19:6789/0 conn(0x7fefb4162060 legacy=0x7fefb40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:38.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.148+0000 7fefb98d7640 1 -- 172.21.15.19:0/568874036 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb406dfb0 con 0x7fefb4161c80 2024-09-12T02:03:38.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.148+0000 7fefb88d5640 1 -- 172.21.15.19:0/568874036 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3006333064 0 0) 0x7fefa4001110 con 0x7fefb4162060 2024-09-12T02:03:38.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.149+0000 7fefb98d7640 1 --2- 172.21.15.19:0/568874036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefb4161c80 0x7fefb406e330 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fefb408d750 tx=0x7fefb002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cbc4ab7c8c4dc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:38.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.149+0000 7fefb88d5640 1 -- 172.21.15.19:0/568874036 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0037070 con 0x7fefb4161c80 2024-09-12T02:03:38.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.149+0000 7fefb88d5640 1 -- 172.21.15.19:0/568874036 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb0032440 con 0x7fefb4161c80 2024-09-12T02:03:38.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.149+0000 7fefb88d5640 1 -- 172.21.15.19:0/568874036 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0032810 con 0x7fefb4161c80 2024-09-12T02:03:38.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.150+0000 7fefbbb3b640 1 -- 172.21.15.19:0/568874036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefb4161c80 msgr2=0x7fefb406e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:38.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.150+0000 7fefbbb3b640 1 --2- 172.21.15.19:0/568874036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefb4161c80 0x7fefb406e330 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fefb408d750 tx=0x7fefb002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.150+0000 7fefbbb3b640 1 -- 172.21.15.19:0/568874036 shutdown_connections 2024-09-12T02:03:38.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.150+0000 7fefbbb3b640 1 --2- 172.21.15.19:0/568874036 >> v2:172.21.15.135:3300/0 conn(0x7fefb40b6680 0x7fefb40cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.150+0000 7fefbbb3b640 1 --2- 172.21.15.19:0/568874036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefb4161c80 0x7fefb406e330 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.150+0000 7fefbbb3b640 1 -- 172.21.15.19:0/568874036 >> 172.21.15.19:0/568874036 conn(0x7fefb40d44f0 msgr2=0x7fefb40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:38.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.150+0000 7fefbbb3b640 1 -- 172.21.15.19:0/568874036 shutdown_connections 2024-09-12T02:03:38.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.150+0000 7fefbbb3b640 1 -- 172.21.15.19:0/568874036 wait complete. 2024-09-12T02:03:38.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.151+0000 7fefbbb3b640 1 Processor -- start 2024-09-12T02:03:38.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.151+0000 7fefbbb3b640 1 -- start start 2024-09-12T02:03:38.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.152+0000 7fefbbb3b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefb40b6680 0x7fefb41f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:38.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.152+0000 7fefbbb3b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb4161c80 0x7fefb4160620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:38.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.152+0000 7fefbbb3b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefb4162060 0x7fefb40b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:38.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.152+0000 7fefbbb3b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fefb40b6b30 con 0x7fefb40b6680 2024-09-12T02:03:38.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.152+0000 7fefbbb3b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fefb40d2aa0 con 0x7fefb4162060 2024-09-12T02:03:38.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.152+0000 7fefbbb3b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fefb40b6cb0 con 0x7fefb4161c80 2024-09-12T02:03:38.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.152+0000 7fefb98d7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefb40b6680 0x7fefb41f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:38.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.152+0000 7fefb98d7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefb40b6680 0x7fefb41f3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56860/0 (socket says 172.21.15.19:56860) 2024-09-12T02:03:38.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.152+0000 7fefb98d7640 1 -- 172.21.15.19:0/1512076981 learned_addr learned my addr 172.21.15.19:0/1512076981 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:38.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.152+0000 7fefba0d8640 1 --2- 172.21.15.19:0/1512076981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefb4162060 0x7fefb40b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:38.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.152+0000 7fefb90d6640 1 --2- 172.21.15.19:0/1512076981 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb4161c80 0x7fefb4160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:38.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.152+0000 7fefb98d7640 1 -- 172.21.15.19:0/1512076981 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb4161c80 msgr2=0x7fefb4160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:38.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.152+0000 7fefb98d7640 1 --2- 172.21.15.19:0/1512076981 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb4161c80 0x7fefb4160620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.152+0000 7fefb98d7640 1 -- 172.21.15.19:0/1512076981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefb4162060 msgr2=0x7fefb40b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:38.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.152+0000 7fefb98d7640 1 --2- 172.21.15.19:0/1512076981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefb4162060 0x7fefb40b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.152+0000 7fefb98d7640 1 -- 172.21.15.19:0/1512076981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb40cd6c0 con 0x7fefb40b6680 2024-09-12T02:03:38.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.152+0000 7fefb90d6640 1 --2- 172.21.15.19:0/1512076981 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb4161c80 0x7fefb4160620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:38.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.153+0000 7fefb98d7640 1 --2- 172.21.15.19:0/1512076981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefb40b6680 0x7fefb41f3d80 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fefb0000c00 tx=0x7fefb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:38.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.153+0000 7fefaa7fc640 1 -- 172.21.15.19:0/1512076981 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0037040 con 0x7fefb40b6680 2024-09-12T02:03:38.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.153+0000 7fefaa7fc640 1 -- 172.21.15.19:0/1512076981 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb0042070 con 0x7fefb40b6680 2024-09-12T02:03:38.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.153+0000 7fefaa7fc640 1 -- 172.21.15.19:0/1512076981 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0030bd0 con 0x7fefb40b6680 2024-09-12T02:03:38.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.153+0000 7fefbbb3b640 1 -- 172.21.15.19:0/1512076981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb40cd9a0 con 0x7fefb40b6680 2024-09-12T02:03:38.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.153+0000 7fefbbb3b640 1 -- 172.21.15.19:0/1512076981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb40cdf60 con 0x7fefb40b6680 2024-09-12T02:03:38.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.154+0000 7fefbbb3b640 1 -- 172.21.15.19:0/1512076981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefb406e330 con 0x7fefb40b6680 2024-09-12T02:03:38.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.154+0000 7fefaa7fc640 1 -- 172.21.15.19:0/1512076981 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fefb0047460 con 0x7fefb40b6680 2024-09-12T02:03:38.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.155+0000 7fefaa7fc640 1 --2- 172.21.15.19:0/1512076981 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef9806be30 0x7fef9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:38.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.155+0000 7fefaa7fc640 1 -- 172.21.15.19:0/1512076981 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 7163+0+0 (secure 0 0 0) 0x7fefb00abf20 con 0x7fefb40b6680 2024-09-12T02:03:38.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.155+0000 7fefb90d6640 1 --2- 172.21.15.19:0/1512076981 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef9806be30 0x7fef9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:38.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.156+0000 7fefb90d6640 1 --2- 172.21.15.19:0/1512076981 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef9806be30 0x7fef9806e2f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fefb40b7b20 tx=0x7fefa4007a10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:38.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.159+0000 7fefaa7fc640 1 -- 172.21.15.19:0/1512076981 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fefb0032e20 con 0x7fefb40b6680 2024-09-12T02:03:38.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.371+0000 7fefbbb3b640 1 -- 172.21.15.19:0/1512076981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefb40b4390 con 0x7fefb40b6680 2024-09-12T02:03:38.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.372+0000 7fefaa7fc640 1 -- 172.21.15.19:0/1512076981 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) ==== 95+0+4392 (secure 0 0 0) 0x7fefb007a3b0 con 0x7fefb40b6680 2024-09-12T02:03:38.371 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:38.372 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":143,"btime":"2024-09-12T02:03:35:697848+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3866905323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3866905323},{"type":"v1","addr":"172.21.15.135:6837","nonce":3866905323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:35.697843+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:38.372 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 143 2024-09-12T02:03:38.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.374+0000 7fefbbb3b640 1 -- 172.21.15.19:0/1512076981 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef9806be30 msgr2=0x7fef9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:38.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.374+0000 7fefbbb3b640 1 --2- 172.21.15.19:0/1512076981 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef9806be30 0x7fef9806e2f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fefb40b7b20 tx=0x7fefa4007a10 comp rx=0 tx=0).stop 2024-09-12T02:03:38.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.374+0000 7fefbbb3b640 1 -- 172.21.15.19:0/1512076981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefb40b6680 msgr2=0x7fefb41f3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:38.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.374+0000 7fefbbb3b640 1 --2- 172.21.15.19:0/1512076981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefb40b6680 0x7fefb41f3d80 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fefb0000c00 tx=0x7fefb00046c0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.374+0000 7fefbbb3b640 1 -- 172.21.15.19:0/1512076981 shutdown_connections 2024-09-12T02:03:38.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.374+0000 7fefbbb3b640 1 --2- 172.21.15.19:0/1512076981 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef9806be30 0x7fef9806e2f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.374+0000 7fefbbb3b640 1 --2- 172.21.15.19:0/1512076981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefb4162060 0x7fefb40b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.374+0000 7fefbbb3b640 1 --2- 172.21.15.19:0/1512076981 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb4161c80 0x7fefb4160620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.374+0000 7fefbbb3b640 1 --2- 172.21.15.19:0/1512076981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefb40b6680 0x7fefb41f3d80 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.374+0000 7fefbbb3b640 1 -- 172.21.15.19:0/1512076981 >> 172.21.15.19:0/1512076981 conn(0x7fefb40d44f0 msgr2=0x7fefb40b5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:38.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.374+0000 7fefbbb3b640 1 -- 172.21.15.19:0/1512076981 shutdown_connections 2024-09-12T02:03:38.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.374+0000 7fefbbb3b640 1 -- 172.21.15.19:0/1512076981 wait complete. 2024-09-12T02:03:38.385 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:03:38.385 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:38.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.487+0000 7f7408cc9640 1 Processor -- start 2024-09-12T02:03:38.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.487+0000 7f7408cc9640 1 -- start start 2024-09-12T02:03:38.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.488+0000 7f7408cc9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7404072320 0x7f74040cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:38.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.488+0000 7f7408cc9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f740415e1f0 0x7f740406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.488+0000 7f7408cc9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7404146140 con 0x7f7404072de0 2024-09-12T02:03:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.488+0000 7f7408cc9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f74040cd740 con 0x7f740415e1f0 2024-09-12T02:03:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.488+0000 7f7408cc9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f74040cda20 con 0x7f7404072320 2024-09-12T02:03:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.489+0000 7f7402d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f740415e1f0 0x7f740406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.489+0000 7f7401d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7404072de0 0x7f740406e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35724/0 (socket says 172.21.15.19:35724) 2024-09-12T02:03:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.489+0000 7f7401d9b640 1 -- 172.21.15.19:0/542102631 learned_addr learned my addr 172.21.15.19:0/542102631 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.489+0000 7f7402d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f740415e1f0 0x7f740406e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56862/0 (socket says 172.21.15.19:56862) 2024-09-12T02:03:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.489+0000 7f740259c640 1 --2- 172.21.15.19:0/542102631 >> v2:172.21.15.135:3300/0 conn(0x7f7404072320 0x7f74040cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.489+0000 7f7402d9d640 1 -- 172.21.15.19:0/542102631 >> v2:172.21.15.135:3300/0 conn(0x7f7404072320 msgr2=0x7f74040cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.489+0000 7f7402d9d640 1 --2- 172.21.15.19:0/542102631 >> v2:172.21.15.135:3300/0 conn(0x7f7404072320 0x7f74040cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.489+0000 7f7402d9d640 1 -- 172.21.15.19:0/542102631 >> v1:172.21.15.19:6789/0 conn(0x7f7404072de0 legacy=0x7f740406e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.489+0000 7f7402d9d640 1 -- 172.21.15.19:0/542102631 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74040cdd00 con 0x7f740415e1f0 2024-09-12T02:03:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.489+0000 7f740259c640 1 --2- 172.21.15.19:0/542102631 >> v2:172.21.15.135:3300/0 conn(0x7f7404072320 0x7f74040cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.489+0000 7f740159a640 1 -- 172.21.15.19:0/542102631 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2756091745 0 0) 0x7f7404146140 con 0x7f7404072de0 2024-09-12T02:03:38.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.490+0000 7f7402d9d640 1 --2- 172.21.15.19:0/542102631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f740415e1f0 0x7f740406e7c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f74040b31e0 tx=0x7f73f402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b720bdf4b21bc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:38.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.490+0000 7f740159a640 1 -- 172.21.15.19:0/542102631 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4037070 con 0x7f740415e1f0 2024-09-12T02:03:38.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.490+0000 7f740159a640 1 -- 172.21.15.19:0/542102631 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f4032440 con 0x7f740415e1f0 2024-09-12T02:03:38.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.490+0000 7f740159a640 1 -- 172.21.15.19:0/542102631 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f402ae60 con 0x7f740415e1f0 2024-09-12T02:03:38.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.490+0000 7f7408cc9640 1 -- 172.21.15.19:0/542102631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f740415e1f0 msgr2=0x7f740406e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:38.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.490+0000 7f7408cc9640 1 --2- 172.21.15.19:0/542102631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f740415e1f0 0x7f740406e7c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f74040b31e0 tx=0x7f73f402a110 comp rx=0 tx=0).stop 2024-09-12T02:03:38.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.490+0000 7f7408cc9640 1 -- 172.21.15.19:0/542102631 shutdown_connections 2024-09-12T02:03:38.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.490+0000 7f7408cc9640 1 --2- 172.21.15.19:0/542102631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f740415e1f0 0x7f740406e7c0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.490+0000 7f7408cc9640 1 --2- 172.21.15.19:0/542102631 >> v2:172.21.15.135:3300/0 conn(0x7f7404072320 0x7f74040cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.490+0000 7f7408cc9640 1 -- 172.21.15.19:0/542102631 >> 172.21.15.19:0/542102631 conn(0x7f7404067d70 msgr2=0x7f740406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:38.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.491+0000 7f7408cc9640 1 -- 172.21.15.19:0/542102631 shutdown_connections 2024-09-12T02:03:38.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.491+0000 7f7408cc9640 1 -- 172.21.15.19:0/542102631 wait complete. 2024-09-12T02:03:38.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.492+0000 7f7408cc9640 1 Processor -- start 2024-09-12T02:03:38.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.492+0000 7f7408cc9640 1 -- start start 2024-09-12T02:03:38.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7408cc9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7404072320 0x7f7404142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:38.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7408cc9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7404072de0 0x7f74040cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:38.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7408cc9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f740415e1f0 0x7f74040cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:38.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7408cc9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f74040cd520 con 0x7f7404072de0 2024-09-12T02:03:38.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7408cc9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f74040cd3a0 con 0x7f7404072320 2024-09-12T02:03:38.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7408cc9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f740406ed00 con 0x7f740415e1f0 2024-09-12T02:03:38.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7401d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7404072de0 0x7f74040cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:38.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7401d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7404072de0 0x7f74040cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56876/0 (socket says 172.21.15.19:56876) 2024-09-12T02:03:38.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7401d9b640 1 -- 172.21.15.19:0/3014905743 learned_addr learned my addr 172.21.15.19:0/3014905743 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:38.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f740259c640 1 --2- 172.21.15.19:0/3014905743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7404072320 0x7f7404142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7402d9d640 1 --2- 172.21.15.19:0/3014905743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f740415e1f0 0x7f74040cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7401d9b640 1 -- 172.21.15.19:0/3014905743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f740415e1f0 msgr2=0x7f74040cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7401d9b640 1 --2- 172.21.15.19:0/3014905743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f740415e1f0 0x7f74040cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7401d9b640 1 -- 172.21.15.19:0/3014905743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7404072320 msgr2=0x7f7404142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7401d9b640 1 --2- 172.21.15.19:0/3014905743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7404072320 0x7f7404142690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7401d9b640 1 -- 172.21.15.19:0/3014905743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74040c80b0 con 0x7f7404072de0 2024-09-12T02:03:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7402d9d640 1 --2- 172.21.15.19:0/3014905743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f740415e1f0 0x7f74040cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7401d9b640 1 --2- 172.21.15.19:0/3014905743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7404072de0 0x7f74040cae50 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00c500 tx=0x7f73ec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f73faffd640 1 -- 172.21.15.19:0/3014905743 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec018070 con 0x7f7404072de0 2024-09-12T02:03:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f73faffd640 1 -- 172.21.15.19:0/3014905743 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ec007580 con 0x7f7404072de0 2024-09-12T02:03:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7408cc9640 1 -- 172.21.15.19:0/3014905743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74040c8820 con 0x7f7404072de0 2024-09-12T02:03:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f73faffd640 1 -- 172.21.15.19:0/3014905743 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec004a20 con 0x7f7404072de0 2024-09-12T02:03:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.493+0000 7f7408cc9640 1 -- 172.21.15.19:0/3014905743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74040c8de0 con 0x7f7404072de0 2024-09-12T02:03:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.494+0000 7f7408cc9640 1 -- 172.21.15.19:0/3014905743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7404072700 con 0x7f7404072de0 2024-09-12T02:03:38.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.495+0000 7f73faffd640 1 -- 172.21.15.19:0/3014905743 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f73ec01b070 con 0x7f7404072de0 2024-09-12T02:03:38.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.495+0000 7f73faffd640 1 --2- 172.21.15.19:0/3014905743 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f73e406be30 0x7f73e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:38.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.495+0000 7f73faffd640 1 -- 172.21.15.19:0/3014905743 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 7163+0+0 (secure 0 0 0) 0x7f73ec08a640 con 0x7f7404072de0 2024-09-12T02:03:38.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.496+0000 7f740259c640 1 --2- 172.21.15.19:0/3014905743 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f73e406be30 0x7f73e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:38.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.496+0000 7f740259c640 1 --2- 172.21.15.19:0/3014905743 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f73e406be30 0x7f73e406e2f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f74040c8630 tx=0x7f73fc009890 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.500+0000 7f73faffd640 1 -- 172.21.15.19:0/3014905743 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f73ec058480 con 0x7f7404072de0 2024-09-12T02:03:38.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.710+0000 7f7408cc9640 1 -- 172.21.15.19:0/3014905743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74040cc390 con 0x7f7404072de0 2024-09-12T02:03:38.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.710+0000 7f73faffd640 1 -- 172.21.15.19:0/3014905743 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) ==== 95+0+4392 (secure 0 0 0) 0x7f73ec05c780 con 0x7f7404072de0 2024-09-12T02:03:38.710 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:38.710 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":143,"btime":"2024-09-12T02:03:35:697848+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3866905323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3866905323},{"type":"v1","addr":"172.21.15.135:6837","nonce":3866905323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:35.697843+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:38.710 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 143 2024-09-12T02:03:38.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.713+0000 7f7408cc9640 1 -- 172.21.15.19:0/3014905743 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f73e406be30 msgr2=0x7f73e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:38.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.713+0000 7f7408cc9640 1 --2- 172.21.15.19:0/3014905743 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f73e406be30 0x7f73e406e2f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f74040c8630 tx=0x7f73fc009890 comp rx=0 tx=0).stop 2024-09-12T02:03:38.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.713+0000 7f7408cc9640 1 -- 172.21.15.19:0/3014905743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7404072de0 msgr2=0x7f74040cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:38.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.713+0000 7f7408cc9640 1 --2- 172.21.15.19:0/3014905743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7404072de0 0x7f74040cae50 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00c500 tx=0x7f73ec00c9c0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.713+0000 7f7408cc9640 1 -- 172.21.15.19:0/3014905743 shutdown_connections 2024-09-12T02:03:38.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.713+0000 7f7408cc9640 1 --2- 172.21.15.19:0/3014905743 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f73e406be30 0x7f73e406e2f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.713+0000 7f7408cc9640 1 --2- 172.21.15.19:0/3014905743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f740415e1f0 0x7f74040cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.713+0000 7f7408cc9640 1 --2- 172.21.15.19:0/3014905743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7404072de0 0x7f74040cae50 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.713+0000 7f7408cc9640 1 --2- 172.21.15.19:0/3014905743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7404072320 0x7f7404142690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.713+0000 7f7408cc9640 1 -- 172.21.15.19:0/3014905743 >> 172.21.15.19:0/3014905743 conn(0x7f7404067d70 msgr2=0x7f74041452c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:38.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.713+0000 7f7408cc9640 1 -- 172.21.15.19:0/3014905743 shutdown_connections 2024-09-12T02:03:38.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.713+0000 7f7408cc9640 1 -- 172.21.15.19:0/3014905743 wait complete. 2024-09-12T02:03:38.723 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:03:38.723 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:38.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.827+0000 7f0f40bbd640 1 Processor -- start 2024-09-12T02:03:38.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.827+0000 7f0f40bbd640 1 -- start start 2024-09-12T02:03:38.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.828+0000 7f0f40bbd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0f3c15e5d0 0x7f0f3c0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:38.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.828+0000 7f0f40bbd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0f3c09b140 0x7f0f3c168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:38.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.828+0000 7f0f40bbd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f3c06cec0 con 0x7f0f3c06df60 2024-09-12T02:03:38.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.828+0000 7f0f40bbd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f0f3c06dad0 con 0x7f0f3c15e5d0 2024-09-12T02:03:38.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.828+0000 7f0f40bbd640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0f3c06d1a0 con 0x7f0f3c09b140 2024-09-12T02:03:38.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.828+0000 7f0f3a59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0f3c15e5d0 0x7f0f3c0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:38.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.828+0000 7f0f3a59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0f3c15e5d0 0x7f0f3c0d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56892/0 (socket says 172.21.15.19:56892) 2024-09-12T02:03:38.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.828+0000 7f0f3a59c640 1 -- 172.21.15.19:0/1778858665 learned_addr learned my addr 172.21.15.19:0/1778858665 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:38.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.828+0000 7f0f3ad9d640 1 --2- 172.21.15.19:0/1778858665 >> v2:172.21.15.135:3300/0 conn(0x7f0f3c09b140 0x7f0f3c168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:38.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.828+0000 7f0f3a59c640 1 -- 172.21.15.19:0/1778858665 >> v2:172.21.15.135:3300/0 conn(0x7f0f3c09b140 msgr2=0x7f0f3c168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:38.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.828+0000 7f0f3a59c640 1 --2- 172.21.15.19:0/1778858665 >> v2:172.21.15.135:3300/0 conn(0x7f0f3c09b140 0x7f0f3c168560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.828+0000 7f0f3a59c640 1 -- 172.21.15.19:0/1778858665 >> v1:172.21.15.135:6789/0 conn(0x7f0f3c06df60 legacy=0x7f0f3c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:38.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.828+0000 7f0f3a59c640 1 -- 172.21.15.19:0/1778858665 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3c06d480 con 0x7f0f3c15e5d0 2024-09-12T02:03:38.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.829+0000 7f0f3a59c640 1 --2- 172.21.15.19:0/1778858665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f3c15e5d0 0x7f0f3c0d10f0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009870 tx=0x7f0f2c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8f7367b5891527 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:38.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.829+0000 7f0f3959a640 1 -- 172.21.15.19:0/1778858665 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c037070 con 0x7f0f3c15e5d0 2024-09-12T02:03:38.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.829+0000 7f0f3959a640 1 -- 172.21.15.19:0/1778858665 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2c032640 con 0x7f0f3c15e5d0 2024-09-12T02:03:38.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.829+0000 7f0f3959a640 1 -- 172.21.15.19:0/1778858665 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c032a10 con 0x7f0f3c15e5d0 2024-09-12T02:03:38.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.830+0000 7f0f40bbd640 1 -- 172.21.15.19:0/1778858665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f3c15e5d0 msgr2=0x7f0f3c0d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:38.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.830+0000 7f0f40bbd640 1 --2- 172.21.15.19:0/1778858665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f3c15e5d0 0x7f0f3c0d10f0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009870 tx=0x7f0f2c02a300 comp rx=0 tx=0).stop 2024-09-12T02:03:38.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.830+0000 7f0f40bbd640 1 -- 172.21.15.19:0/1778858665 shutdown_connections 2024-09-12T02:03:38.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.830+0000 7f0f40bbd640 1 --2- 172.21.15.19:0/1778858665 >> v2:172.21.15.135:3300/0 conn(0x7f0f3c09b140 0x7f0f3c168560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.830+0000 7f0f40bbd640 1 --2- 172.21.15.19:0/1778858665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f3c15e5d0 0x7f0f3c0d10f0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.830+0000 7f0f40bbd640 1 -- 172.21.15.19:0/1778858665 >> 172.21.15.19:0/1778858665 conn(0x7f0f3c0d23a0 msgr2=0x7f0f3c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:38.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.830+0000 7f0f40bbd640 1 -- 172.21.15.19:0/1778858665 shutdown_connections 2024-09-12T02:03:38.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.830+0000 7f0f40bbd640 1 -- 172.21.15.19:0/1778858665 wait complete. 2024-09-12T02:03:38.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.831+0000 7f0f40bbd640 1 Processor -- start 2024-09-12T02:03:38.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.831+0000 7f0f40bbd640 1 -- start start 2024-09-12T02:03:38.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.832+0000 7f0f40bbd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f3c06df60 0x7f0f3c159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:38.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.832+0000 7f0f40bbd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f3c09b140 0x7f0f3c0b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:38.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.832+0000 7f0f40bbd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f3c15e5d0 0x7f0f3c155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:38.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.832+0000 7f0f40bbd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c15eb30 con 0x7f0f3c15e5d0 2024-09-12T02:03:38.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.832+0000 7f0f40bbd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c15e9b0 con 0x7f0f3c09b140 2024-09-12T02:03:38.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.832+0000 7f0f40bbd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3c0d1630 con 0x7f0f3c06df60 2024-09-12T02:03:38.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.832+0000 7f0f3ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f3c15e5d0 0x7f0f3c155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:38.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.832+0000 7f0f3ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f3c15e5d0 0x7f0f3c155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56902/0 (socket says 172.21.15.19:56902) 2024-09-12T02:03:38.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.832+0000 7f0f3ad9d640 1 -- 172.21.15.19:0/848456041 learned_addr learned my addr 172.21.15.19:0/848456041 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:38.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.832+0000 7f0f39d9b640 1 --2- 172.21.15.19:0/848456041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f3c09b140 0x7f0f3c0b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:38.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.832+0000 7f0f3a59c640 1 --2- 172.21.15.19:0/848456041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f3c06df60 0x7f0f3c159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:38.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.832+0000 7f0f3ad9d640 1 -- 172.21.15.19:0/848456041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f3c06df60 msgr2=0x7f0f3c159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:38.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.832+0000 7f0f3ad9d640 1 --2- 172.21.15.19:0/848456041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f3c06df60 0x7f0f3c159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.832+0000 7f0f3ad9d640 1 -- 172.21.15.19:0/848456041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f3c09b140 msgr2=0x7f0f3c0b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:38.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.832+0000 7f0f3ad9d640 1 --2- 172.21.15.19:0/848456041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f3c09b140 0x7f0f3c0b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:38.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.832+0000 7f0f3ad9d640 1 -- 172.21.15.19:0/848456041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3c0b7c70 con 0x7f0f3c15e5d0 2024-09-12T02:03:38.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.832+0000 7f0f39d9b640 1 --2- 172.21.15.19:0/848456041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f3c09b140 0x7f0f3c0b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:03:38.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.833+0000 7f0f3ad9d640 1 --2- 172.21.15.19:0/848456041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f3c15e5d0 0x7f0f3c155f90 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400cd20 tx=0x7f0f3400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:38.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.833+0000 7f0f2affd640 1 -- 172.21.15.19:0/848456041 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f34003b90 con 0x7f0f3c15e5d0 2024-09-12T02:03:38.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.833+0000 7f0f2affd640 1 -- 172.21.15.19:0/848456041 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f34003d30 con 0x7f0f3c15e5d0 2024-09-12T02:03:38.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.833+0000 7f0f40bbd640 1 -- 172.21.15.19:0/848456041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3c0b7f50 con 0x7f0f3c15e5d0 2024-09-12T02:03:38.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.833+0000 7f0f2affd640 1 -- 172.21.15.19:0/848456041 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f34004240 con 0x7f0f3c15e5d0 2024-09-12T02:03:38.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.833+0000 7f0f40bbd640 1 -- 172.21.15.19:0/848456041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f3c0b6890 con 0x7f0f3c15e5d0 2024-09-12T02:03:38.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.834+0000 7f0f40bbd640 1 -- 172.21.15.19:0/848456041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f3c0d10f0 con 0x7f0f3c15e5d0 2024-09-12T02:03:38.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.834+0000 7f0f2affd640 1 -- 172.21.15.19:0/848456041 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f340043e0 con 0x7f0f3c15e5d0 2024-09-12T02:03:38.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.835+0000 7f0f2affd640 1 --2- 172.21.15.19:0/848456041 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0f1c06be60 0x7f0f1c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:38.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.835+0000 7f0f2affd640 1 -- 172.21.15.19:0/848456041 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 7163+0+0 (secure 0 0 0) 0x7f0f3408bcb0 con 0x7f0f3c15e5d0 2024-09-12T02:03:38.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.835+0000 7f0f3a59c640 1 --2- 172.21.15.19:0/848456041 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0f1c06be60 0x7f0f1c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:38.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.836+0000 7f0f3a59c640 1 --2- 172.21.15.19:0/848456041 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0f1c06be60 0x7f0f1c06e320 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c034000 tx=0x7f0f2c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:38.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:38.839+0000 7f0f2affd640 1 -- 172.21.15.19:0/848456041 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f34059af0 con 0x7f0f3c15e5d0 2024-09-12T02:03:39.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.050+0000 7f0f40bbd640 1 -- 172.21.15.19:0/848456041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f3c071600 con 0x7f0f3c15e5d0 2024-09-12T02:03:39.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.051+0000 7f0f2affd640 1 -- 172.21.15.19:0/848456041 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) ==== 95+0+4392 (secure 0 0 0) 0x7f0f3405ddf0 con 0x7f0f3c15e5d0 2024-09-12T02:03:39.051 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:39.051 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":143,"btime":"2024-09-12T02:03:35:697848+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3866905323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3866905323},{"type":"v1","addr":"172.21.15.135:6837","nonce":3866905323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:35.697843+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:39.051 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 143 2024-09-12T02:03:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.053+0000 7f0f40bbd640 1 -- 172.21.15.19:0/848456041 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0f1c06be60 msgr2=0x7f0f1c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.053+0000 7f0f40bbd640 1 --2- 172.21.15.19:0/848456041 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0f1c06be60 0x7f0f1c06e320 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c034000 tx=0x7f0f2c02e000 comp rx=0 tx=0).stop 2024-09-12T02:03:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.053+0000 7f0f40bbd640 1 -- 172.21.15.19:0/848456041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f3c15e5d0 msgr2=0x7f0f3c155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.053+0000 7f0f40bbd640 1 --2- 172.21.15.19:0/848456041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f3c15e5d0 0x7f0f3c155f90 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400cd20 tx=0x7f0f3400a660 comp rx=0 tx=0).stop 2024-09-12T02:03:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.053+0000 7f0f40bbd640 1 -- 172.21.15.19:0/848456041 shutdown_connections 2024-09-12T02:03:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.053+0000 7f0f40bbd640 1 --2- 172.21.15.19:0/848456041 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0f1c06be60 0x7f0f1c06e320 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.053+0000 7f0f40bbd640 1 --2- 172.21.15.19:0/848456041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f3c15e5d0 0x7f0f3c155f90 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.053+0000 7f0f40bbd640 1 --2- 172.21.15.19:0/848456041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f3c09b140 0x7f0f3c0b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.053+0000 7f0f40bbd640 1 --2- 172.21.15.19:0/848456041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f3c06df60 0x7f0f3c159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.053+0000 7f0f40bbd640 1 -- 172.21.15.19:0/848456041 >> 172.21.15.19:0/848456041 conn(0x7f0f3c0d23a0 msgr2=0x7f0f3c0d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.053+0000 7f0f40bbd640 1 -- 172.21.15.19:0/848456041 shutdown_connections 2024-09-12T02:03:39.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.053+0000 7f0f40bbd640 1 -- 172.21.15.19:0/848456041 wait complete. 2024-09-12T02:03:39.064 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 100.00000000' led to DAMAGED state 2024-09-12T02:03:39.064 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete mds0_sessionmap' 2024-09-12T02:03:39.064 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:03:39.064 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:03:39.080 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:03:39.080 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:03:39.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:39.080 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:03:39.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:03:39.136 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:03:39.136 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:03:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.279+0000 7fc9393e8640 1 Processor -- start 2024-09-12T02:03:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.279+0000 7fc9393e8640 1 -- start start 2024-09-12T02:03:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.280+0000 7fc9393e8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9340b43f0 0x7fc93409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.280+0000 7fc9393e8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc9340b5050 0x7fc93415b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.280+0000 7fc9393e8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9340b3830 con 0x7fc93415b340 2024-09-12T02:03:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.280+0000 7fc9393e8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fc9340b5bd0 con 0x7fc9340b5050 2024-09-12T02:03:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.280+0000 7fc9393e8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc9340b5610 con 0x7fc9340b43f0 2024-09-12T02:03:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.280+0000 7fc932ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc93415b340 0x7fc9340b4940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35734/0 (socket says 172.21.15.19:35734) 2024-09-12T02:03:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.280+0000 7fc932ffd640 1 -- 172.21.15.19:0/3717103985 learned_addr learned my addr 172.21.15.19:0/3717103985 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.280+0000 7fc9337fe640 1 --2- 172.21.15.19:0/3717103985 >> v2:172.21.15.19:3300/0 conn(0x7fc9340b5050 0x7fc93415b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.281+0000 7fc9327fc640 1 --2- 172.21.15.19:0/3717103985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9340b43f0 0x7fc93409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.281+0000 7fc931ffb640 1 -- 172.21.15.19:0/3717103985 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3804929320 0 0) 0x7fc9340b3830 con 0x7fc93415b340 2024-09-12T02:03:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.281+0000 7fc931ffb640 1 -- 172.21.15.19:0/3717103985 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc91c003520 con 0x7fc93415b340 2024-09-12T02:03:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.281+0000 7fc9337fe640 1 -- 172.21.15.19:0/3717103985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9340b43f0 msgr2=0x7fc93409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.281+0000 7fc9337fe640 1 --2- 172.21.15.19:0/3717103985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9340b43f0 0x7fc93409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.281+0000 7fc9337fe640 1 -- 172.21.15.19:0/3717103985 >> v1:172.21.15.19:6789/0 conn(0x7fc93415b340 legacy=0x7fc9340b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.281+0000 7fc9337fe640 1 -- 172.21.15.19:0/3717103985 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9340b58f0 con 0x7fc9340b5050 2024-09-12T02:03:39.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.282+0000 7fc9337fe640 1 --2- 172.21.15.19:0/3717103985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9340b5050 0x7fc93415b720 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0097a0 tx=0x7fc92c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fafe1a4394e83740 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:39.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.282+0000 7fc931ffb640 1 -- 172.21.15.19:0/3717103985 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c037070 con 0x7fc9340b5050 2024-09-12T02:03:39.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.282+0000 7fc931ffb640 1 -- 172.21.15.19:0/3717103985 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92c032440 con 0x7fc9340b5050 2024-09-12T02:03:39.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.282+0000 7fc931ffb640 1 -- 172.21.15.19:0/3717103985 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c032810 con 0x7fc9340b5050 2024-09-12T02:03:39.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.282+0000 7fc9393e8640 1 -- 172.21.15.19:0/3717103985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9340b5050 msgr2=0x7fc93415b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:39.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.282+0000 7fc9393e8640 1 --2- 172.21.15.19:0/3717103985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9340b5050 0x7fc93415b720 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0097a0 tx=0x7fc92c02a210 comp rx=0 tx=0).stop 2024-09-12T02:03:39.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.282+0000 7fc9393e8640 1 -- 172.21.15.19:0/3717103985 shutdown_connections 2024-09-12T02:03:39.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.282+0000 7fc9393e8640 1 --2- 172.21.15.19:0/3717103985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9340b5050 0x7fc93415b720 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.282+0000 7fc9393e8640 1 --2- 172.21.15.19:0/3717103985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9340b43f0 0x7fc93409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.282+0000 7fc9393e8640 1 -- 172.21.15.19:0/3717103985 >> 172.21.15.19:0/3717103985 conn(0x7fc934073490 msgr2=0x7fc9340b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:39.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.282+0000 7fc9393e8640 1 -- 172.21.15.19:0/3717103985 shutdown_connections 2024-09-12T02:03:39.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.282+0000 7fc9393e8640 1 -- 172.21.15.19:0/3717103985 wait complete. 2024-09-12T02:03:39.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.284+0000 7fc9393e8640 1 Processor -- start 2024-09-12T02:03:39.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.284+0000 7fc9393e8640 1 -- start start 2024-09-12T02:03:39.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.284+0000 7fc9393e8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9340b43f0 0x7fc934148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:39.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.284+0000 7fc9393e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9340b5050 0x7fc9341f87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:39.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.284+0000 7fc9393e8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc93415b340 0x7fc934155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:39.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.284+0000 7fc9393e8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc9340cdb30 con 0x7fc9340b5050 2024-09-12T02:03:39.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.284+0000 7fc9393e8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc93415d8f0 con 0x7fc9340b43f0 2024-09-12T02:03:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.284+0000 7fc9393e8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc9340cdcb0 con 0x7fc93415b340 2024-09-12T02:03:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.285+0000 7fc9327fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9340b5050 0x7fc9341f87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.285+0000 7fc9327fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9340b5050 0x7fc9341f87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56918/0 (socket says 172.21.15.19:56918) 2024-09-12T02:03:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.285+0000 7fc9327fc640 1 -- 172.21.15.19:0/324491427 learned_addr learned my addr 172.21.15.19:0/324491427 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.285+0000 7fc932ffd640 1 --2- 172.21.15.19:0/324491427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9340b43f0 0x7fc934148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.285+0000 7fc9337fe640 1 --2- 172.21.15.19:0/324491427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc93415b340 0x7fc934155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.285+0000 7fc9327fc640 1 -- 172.21.15.19:0/324491427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc93415b340 msgr2=0x7fc934155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.285+0000 7fc9327fc640 1 --2- 172.21.15.19:0/324491427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc93415b340 0x7fc934155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.285+0000 7fc9327fc640 1 -- 172.21.15.19:0/324491427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9340b43f0 msgr2=0x7fc934148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.285+0000 7fc9327fc640 1 --2- 172.21.15.19:0/324491427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9340b43f0 0x7fc934148830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.285+0000 7fc9327fc640 1 -- 172.21.15.19:0/324491427 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9341f8cf0 con 0x7fc9340b5050 2024-09-12T02:03:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.285+0000 7fc9327fc640 1 --2- 172.21.15.19:0/324491427 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9340b5050 0x7fc9341f87b0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fc92800e9b0 tx=0x7fc92800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.285+0000 7fc91b7fe640 1 -- 172.21.15.19:0/324491427 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc928017070 con 0x7fc9340b5050 2024-09-12T02:03:39.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.285+0000 7fc91b7fe640 1 -- 172.21.15.19:0/324491427 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92800c9a0 con 0x7fc9340b5050 2024-09-12T02:03:39.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.285+0000 7fc9393e8640 1 -- 172.21.15.19:0/324491427 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9340ce960 con 0x7fc9340b5050 2024-09-12T02:03:39.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.285+0000 7fc91b7fe640 1 -- 172.21.15.19:0/324491427 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92800cd70 con 0x7fc9340b5050 2024-09-12T02:03:39.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.285+0000 7fc9393e8640 1 -- 172.21.15.19:0/324491427 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9340cef20 con 0x7fc9340b5050 2024-09-12T02:03:39.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.286+0000 7fc9393e8640 1 -- 172.21.15.19:0/324491427 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc93409aa30 con 0x7fc9340b5050 2024-09-12T02:03:39.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.287+0000 7fc91b7fe640 1 -- 172.21.15.19:0/324491427 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc92801a070 con 0x7fc9340b5050 2024-09-12T02:03:39.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.287+0000 7fc91b7fe640 1 --2- 172.21.15.19:0/324491427 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc92006be30 0x7fc92006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:39.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.287+0000 7fc91b7fe640 1 -- 172.21.15.19:0/324491427 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 7163+0+0 (secure 0 0 0) 0x7fc92808b3b0 con 0x7fc9340b5050 2024-09-12T02:03:39.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.287+0000 7fc932ffd640 1 --2- 172.21.15.19:0/324491427 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc92006be30 0x7fc92006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:39.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.288+0000 7fc932ffd640 1 --2- 172.21.15.19:0/324491427 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc92006be30 0x7fc92006e2f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc924005c00 tx=0x7fc924009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:39.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.291+0000 7fc91b7fe640 1 -- 172.21.15.19:0/324491427 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc9341f8cf0 con 0x7fc9340b5050 2024-09-12T02:03:39.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.503+0000 7fc9393e8640 1 -- 172.21.15.19:0/324491427 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc934149310 con 0x7fc9340b5050 2024-09-12T02:03:39.661 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:03:39.662+0000 7fda4f175640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:03:39.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.737+0000 7fc91b7fe640 1 -- 172.21.15.19:0/324491427 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v144) ==== 161+0+0 (secure 0 0 0) 0x7fc928059840 con 0x7fc9340b5050 2024-09-12T02:03:39.737 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:03:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.739+0000 7fc9393e8640 1 -- 172.21.15.19:0/324491427 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc92006be30 msgr2=0x7fc92006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.739+0000 7fc9393e8640 1 --2- 172.21.15.19:0/324491427 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc92006be30 0x7fc92006e2f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc924005c00 tx=0x7fc924009040 comp rx=0 tx=0).stop 2024-09-12T02:03:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.739+0000 7fc9393e8640 1 -- 172.21.15.19:0/324491427 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9340b5050 msgr2=0x7fc9341f87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.739+0000 7fc9393e8640 1 --2- 172.21.15.19:0/324491427 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9340b5050 0x7fc9341f87b0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fc92800e9b0 tx=0x7fc92800ee70 comp rx=0 tx=0).stop 2024-09-12T02:03:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.739+0000 7fc9393e8640 1 -- 172.21.15.19:0/324491427 shutdown_connections 2024-09-12T02:03:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.739+0000 7fc9393e8640 1 --2- 172.21.15.19:0/324491427 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc92006be30 0x7fc92006e2f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.739+0000 7fc9393e8640 1 --2- 172.21.15.19:0/324491427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc93415b340 0x7fc934155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.739+0000 7fc9393e8640 1 --2- 172.21.15.19:0/324491427 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9340b5050 0x7fc9341f87b0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.739+0000 7fc9393e8640 1 --2- 172.21.15.19:0/324491427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9340b43f0 0x7fc934148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.739+0000 7fc9393e8640 1 -- 172.21.15.19:0/324491427 >> 172.21.15.19:0/324491427 conn(0x7fc934073490 msgr2=0x7fc93415cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.739+0000 7fc9393e8640 1 -- 172.21.15.19:0/324491427 shutdown_connections 2024-09-12T02:03:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.739+0000 7fc9393e8640 1 -- 172.21.15.19:0/324491427 wait complete. 2024-09-12T02:03:39.750 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:03:39.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.854+0000 7f65aa2af640 1 Processor -- start 2024-09-12T02:03:39.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.854+0000 7f65aa2af640 1 -- start start 2024-09-12T02:03:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.855+0000 7f65aa2af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65a4161c80 0x7f65a406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.855+0000 7f65aa2af640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f65a40b6680 0x7f65a40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.855+0000 7f65aa2af640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65a406e870 con 0x7f65a4162060 2024-09-12T02:03:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.855+0000 7f65aa2af640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f65a406d9f0 con 0x7f65a40b6680 2024-09-12T02:03:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.855+0000 7f65aa2af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f65a406dcd0 con 0x7f65a4161c80 2024-09-12T02:03:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.855+0000 7f65a884c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f65a40b6680 0x7f65a40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.855+0000 7f65a884c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f65a40b6680 0x7f65a40cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56920/0 (socket says 172.21.15.19:56920) 2024-09-12T02:03:39.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.855+0000 7f65a884c640 1 -- 172.21.15.19:0/1144432234 learned_addr learned my addr 172.21.15.19:0/1144432234 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:39.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.856+0000 7f65a3fff640 1 --2- 172.21.15.19:0/1144432234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65a4161c80 0x7f65a406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:39.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.856+0000 7f65a884c640 1 -- 172.21.15.19:0/1144432234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65a4161c80 msgr2=0x7f65a406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:39.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.856+0000 7f65a884c640 1 --2- 172.21.15.19:0/1144432234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65a4161c80 0x7f65a406e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.856+0000 7f65a884c640 1 -- 172.21.15.19:0/1144432234 >> v1:172.21.15.135:6789/0 conn(0x7f65a4162060 legacy=0x7f65a40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:39.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.856+0000 7f65a884c640 1 -- 172.21.15.19:0/1144432234 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a406dfb0 con 0x7f65a40b6680 2024-09-12T02:03:39.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.856+0000 7f65a884c640 1 --2- 172.21.15.19:0/1144432234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65a40b6680 0x7f65a40cf1e0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f659c009e50 tx=0x7f659c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e33b3a2efe6891 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:39.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.857+0000 7f65a2ffd640 1 -- 172.21.15.19:0/1144432234 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c036070 con 0x7f65a40b6680 2024-09-12T02:03:39.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.857+0000 7f65a2ffd640 1 -- 172.21.15.19:0/1144432234 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f659c031600 con 0x7f65a40b6680 2024-09-12T02:03:39.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.857+0000 7f65a2ffd640 1 -- 172.21.15.19:0/1144432234 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c0319d0 con 0x7f65a40b6680 2024-09-12T02:03:39.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.857+0000 7f65aa2af640 1 -- 172.21.15.19:0/1144432234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65a40b6680 msgr2=0x7f65a40cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:39.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.857+0000 7f65aa2af640 1 --2- 172.21.15.19:0/1144432234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65a40b6680 0x7f65a40cf1e0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f659c009e50 tx=0x7f659c02a6c0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.857+0000 7f65aa2af640 1 -- 172.21.15.19:0/1144432234 shutdown_connections 2024-09-12T02:03:39.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.857+0000 7f65aa2af640 1 --2- 172.21.15.19:0/1144432234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65a40b6680 0x7f65a40cf1e0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.857+0000 7f65aa2af640 1 --2- 172.21.15.19:0/1144432234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65a4161c80 0x7f65a406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.857+0000 7f65aa2af640 1 -- 172.21.15.19:0/1144432234 >> 172.21.15.19:0/1144432234 conn(0x7f65a40d44f0 msgr2=0x7f65a40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:39.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.857+0000 7f65aa2af640 1 -- 172.21.15.19:0/1144432234 shutdown_connections 2024-09-12T02:03:39.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.857+0000 7f65aa2af640 1 -- 172.21.15.19:0/1144432234 wait complete. 2024-09-12T02:03:39.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.858+0000 7f65aa2af640 1 Processor -- start 2024-09-12T02:03:39.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.859+0000 7f65aa2af640 1 -- start start 2024-09-12T02:03:39.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.859+0000 7f65aa2af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65a40b6680 0x7f65a40cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:39.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.859+0000 7f65aa2af640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65a4161c80 0x7f65a4156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:39.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.859+0000 7f65aa2af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65a4162060 0x7f65a415eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:39.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.859+0000 7f65aa2af640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f65a40b6b30 con 0x7f65a40b6680 2024-09-12T02:03:39.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.859+0000 7f65aa2af640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f65a40d2aa0 con 0x7f65a4161c80 2024-09-12T02:03:39.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.859+0000 7f65aa2af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f65a40b6cb0 con 0x7f65a4162060 2024-09-12T02:03:39.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.859+0000 7f65a3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65a40b6680 0x7f65a40cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:39.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.859+0000 7f65a3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65a40b6680 0x7f65a40cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56928/0 (socket says 172.21.15.19:56928) 2024-09-12T02:03:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.859+0000 7f65a3fff640 1 -- 172.21.15.19:0/2694825430 learned_addr learned my addr 172.21.15.19:0/2694825430 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.860+0000 7f65a884c640 1 --2- 172.21.15.19:0/2694825430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65a4162060 0x7f65a415eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.860+0000 7f65a37fe640 1 --2- 172.21.15.19:0/2694825430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65a4161c80 0x7f65a4156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.860+0000 7f65a3fff640 1 -- 172.21.15.19:0/2694825430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65a4162060 msgr2=0x7f65a415eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.860+0000 7f65a3fff640 1 --2- 172.21.15.19:0/2694825430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65a4162060 0x7f65a415eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.860+0000 7f65a3fff640 1 -- 172.21.15.19:0/2694825430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65a4161c80 msgr2=0x7f65a4156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.860+0000 7f65a3fff640 1 --2- 172.21.15.19:0/2694825430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65a4161c80 0x7f65a4156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.860+0000 7f65a3fff640 1 -- 172.21.15.19:0/2694825430 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a40ba0f0 con 0x7f65a40b6680 2024-09-12T02:03:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.860+0000 7f65a3fff640 1 --2- 172.21.15.19:0/2694825430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65a40b6680 0x7f65a40cb5c0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f659400c7f0 tx=0x7f659400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.860+0000 7f65a0ff9640 1 -- 172.21.15.19:0/2694825430 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6594015070 con 0x7f65a40b6680 2024-09-12T02:03:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.860+0000 7f65a0ff9640 1 -- 172.21.15.19:0/2694825430 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6594004220 con 0x7f65a40b6680 2024-09-12T02:03:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.860+0000 7f65aa2af640 1 -- 172.21.15.19:0/2694825430 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a40c7fc0 con 0x7f65a40b6680 2024-09-12T02:03:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.860+0000 7f65a0ff9640 1 -- 172.21.15.19:0/2694825430 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6594007620 con 0x7f65a40b6680 2024-09-12T02:03:39.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.860+0000 7f65aa2af640 1 -- 172.21.15.19:0/2694825430 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a40c8580 con 0x7f65a40b6680 2024-09-12T02:03:39.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.861+0000 7f65aa2af640 1 -- 172.21.15.19:0/2694825430 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a406e330 con 0x7f65a40b6680 2024-09-12T02:03:39.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.862+0000 7f65a0ff9640 1 -- 172.21.15.19:0/2694825430 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65940079d0 con 0x7f65a40b6680 2024-09-12T02:03:39.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.862+0000 7f65a0ff9640 1 --2- 172.21.15.19:0/2694825430 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f659006be30 0x7f659006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:39.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.862+0000 7f65a0ff9640 1 -- 172.21.15.19:0/2694825430 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 7163+0+0 (secure 0 0 0) 0x7f659408b3d0 con 0x7f65a40b6680 2024-09-12T02:03:39.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.863+0000 7f65a37fe640 1 --2- 172.21.15.19:0/2694825430 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f659006be30 0x7f659006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:39.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.863+0000 7f65a37fe640 1 --2- 172.21.15.19:0/2694825430 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f659006be30 0x7f659006e2f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f65a40cde30 tx=0x7f6598007e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:39.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:39.867+0000 7f65a0ff9640 1 -- 172.21.15.19:0/2694825430 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6594059180 con 0x7f65a40b6680 2024-09-12T02:03:40.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.113+0000 7f65aa2af640 1 -- 172.21.15.19:0/2694825430 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f65a4161430 con 0x7f65a40b6680 2024-09-12T02:03:40.447 INFO:tasks.ceph.mds.c.smithi019.stderr: -52> 2024-09-12T02:03:35.696+0000 7fda4b16d640 -1 log_channel(cluster) log [ERR] : dir 0x100 object missing on disk; some files may be lost (~mds0) 2024-09-12T02:03:40.448 INFO:tasks.ceph.mds.c.smithi019.stderr: -17> 2024-09-12T02:03:39.662+0000 7fda4f175640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:03:40.473 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:03:40.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.742+0000 7f65a0ff9640 1 -- 172.21.15.19:0/2694825430 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v145) ==== 101+0+0 (secure 0 0 0) 0x7f659405d480 con 0x7f65a40b6680 2024-09-12T02:03:40.742 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:03:40.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.745+0000 7f65aa2af640 1 -- 172.21.15.19:0/2694825430 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f659006be30 msgr2=0x7f659006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.745+0000 7f65aa2af640 1 --2- 172.21.15.19:0/2694825430 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f659006be30 0x7f659006e2f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f65a40cde30 tx=0x7f6598007e50 comp rx=0 tx=0).stop 2024-09-12T02:03:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.745+0000 7f65aa2af640 1 -- 172.21.15.19:0/2694825430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65a40b6680 msgr2=0x7f65a40cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.745+0000 7f65aa2af640 1 --2- 172.21.15.19:0/2694825430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65a40b6680 0x7f65a40cb5c0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f659400c7f0 tx=0x7f659400ccb0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.745+0000 7f65aa2af640 1 -- 172.21.15.19:0/2694825430 shutdown_connections 2024-09-12T02:03:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.745+0000 7f65aa2af640 1 --2- 172.21.15.19:0/2694825430 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f659006be30 0x7f659006e2f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.745+0000 7f65aa2af640 1 --2- 172.21.15.19:0/2694825430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65a4162060 0x7f65a415eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.745+0000 7f65aa2af640 1 --2- 172.21.15.19:0/2694825430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65a4161c80 0x7f65a4156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.745+0000 7f65aa2af640 1 --2- 172.21.15.19:0/2694825430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65a40b6680 0x7f65a40cb5c0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.745+0000 7f65aa2af640 1 -- 172.21.15.19:0/2694825430 >> 172.21.15.19:0/2694825430 conn(0x7f65a40d44f0 msgr2=0x7f65a40b4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.745+0000 7f65aa2af640 1 -- 172.21.15.19:0/2694825430 shutdown_connections 2024-09-12T02:03:40.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.745+0000 7f65aa2af640 1 -- 172.21.15.19:0/2694825430 wait complete. 2024-09-12T02:03:40.757 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:03:40.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.803+0000 7f80005f8f40 1 Processor -- start 2024-09-12T02:03:40.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.803+0000 7f80005f8f40 1 -- start start 2024-09-12T02:03:40.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.804+0000 7f80005f8f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56103b02bf70 0x56103b0f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.804+0000 7f80005f8f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56103b02c350 0x56103b06da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.804+0000 7f80005f8f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56103b0fb8e0 0x56103b102510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.804+0000 7f80005f8f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56103b054100 con 0x56103b02bf70 2024-09-12T02:03:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.804+0000 7f80005f8f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56103af7b510 con 0x56103b02c350 2024-09-12T02:03:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.804+0000 7f80005f8f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56103b057720 con 0x56103b0fb8e0 2024-09-12T02:03:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.804+0000 7f7ffe0f0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56103b02bf70 0x56103b0f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.804+0000 7f7ffe0f0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56103b02bf70 0x56103b0f6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56956/0 (socket says 172.21.15.19:56956) 2024-09-12T02:03:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.804+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/96877144 learned_addr learned my addr 172.21.15.19:0/96877144 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.804+0000 7f7ffd8ef640 1 --2- 172.21.15.19:0/96877144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56103b02c350 0x56103b06da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.804+0000 7f7ffe8f1640 1 --2- 172.21.15.19:0/96877144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56103b0fb8e0 0x56103b102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.805+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/96877144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56103b0fb8e0 msgr2=0x56103b102510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.805+0000 7f7ffe0f0640 1 --2- 172.21.15.19:0/96877144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56103b0fb8e0 0x56103b102510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.805+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/96877144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56103b02c350 msgr2=0x56103b06da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:40.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.805+0000 7f7ffe0f0640 1 --2- 172.21.15.19:0/96877144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56103b02c350 0x56103b06da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.805+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/96877144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56103b055670 con 0x56103b02bf70 2024-09-12T02:03:40.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.805+0000 7f7ffe0f0640 1 --2- 172.21.15.19:0/96877144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56103b02bf70 0x56103b0f6ea0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f7ff000a7a0 tx=0x7f7ff000a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6ff2dbf5a5253e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:40.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.805+0000 7f7ffc8ed640 1 -- 172.21.15.19:0/96877144 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0019070 con 0x56103b02bf70 2024-09-12T02:03:40.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.805+0000 7f7ffc8ed640 1 -- 172.21.15.19:0/96877144 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff0007600 con 0x56103b02bf70 2024-09-12T02:03:40.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.805+0000 7f7ffc8ed640 1 -- 172.21.15.19:0/96877144 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00079d0 con 0x56103b02bf70 2024-09-12T02:03:40.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.805+0000 7f80005f8f40 1 -- 172.21.15.19:0/96877144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56103b02bf70 msgr2=0x56103b0f6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:40.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.805+0000 7f80005f8f40 1 --2- 172.21.15.19:0/96877144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56103b02bf70 0x56103b0f6ea0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f7ff000a7a0 tx=0x7f7ff000a890 comp rx=0 tx=0).stop 2024-09-12T02:03:40.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.805+0000 7f80005f8f40 1 -- 172.21.15.19:0/96877144 shutdown_connections 2024-09-12T02:03:40.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.805+0000 7f80005f8f40 1 --2- 172.21.15.19:0/96877144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56103b0fb8e0 0x56103b102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.805+0000 7f80005f8f40 1 --2- 172.21.15.19:0/96877144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56103b02c350 0x56103b06da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.805+0000 7f80005f8f40 1 --2- 172.21.15.19:0/96877144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56103b02bf70 0x56103b0f6ea0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.805+0000 7f80005f8f40 1 -- 172.21.15.19:0/96877144 >> 172.21.15.19:0/96877144 conn(0x56103b02b1d0 msgr2=0x56103b054280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:40.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.805+0000 7f80005f8f40 1 -- 172.21.15.19:0/96877144 shutdown_connections 2024-09-12T02:03:40.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.805+0000 7f80005f8f40 1 -- 172.21.15.19:0/96877144 wait complete. 2024-09-12T02:03:40.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.806+0000 7f80005f8f40 1 Processor -- start 2024-09-12T02:03:40.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.806+0000 7f80005f8f40 1 -- start start 2024-09-12T02:03:40.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.807+0000 7f80005f8f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56103b02bf70 0x56103b0736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:40.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.807+0000 7f80005f8f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56103b02c350 0x56103b0edb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:40.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.807+0000 7f80005f8f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56103b0fb8e0 0x56103b0f9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:40.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.807+0000 7f80005f8f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56103b0fa700 con 0x56103b02bf70 2024-09-12T02:03:40.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.807+0000 7f80005f8f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56103b0fac30 con 0x56103b02c350 2024-09-12T02:03:40.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.807+0000 7f80005f8f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56103b0fa950 con 0x56103b0fb8e0 2024-09-12T02:03:40.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.807+0000 7f7ffe0f0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56103b02bf70 0x56103b0736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:40.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.807+0000 7f7ffe0f0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56103b02bf70 0x56103b0736e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56968/0 (socket says 172.21.15.19:56968) 2024-09-12T02:03:40.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.807+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 learned_addr learned my addr 172.21.15.19:0/154238069 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:40.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.807+0000 7f7ffe8f1640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56103b0fb8e0 0x56103b0f9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:40.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.807+0000 7f7ffd8ef640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56103b02c350 0x56103b0edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:40.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.807+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56103b0fb8e0 msgr2=0x56103b0f9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:40.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.807+0000 7f7ffe0f0640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56103b0fb8e0 0x56103b0f9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.807+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56103b02c350 msgr2=0x56103b0edb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:40.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.807+0000 7f7ffe0f0640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56103b02c350 0x56103b0edb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.807+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56103b072920 con 0x56103b02bf70 2024-09-12T02:03:40.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.807+0000 7f7ffe0f0640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56103b02bf70 0x56103b0736e0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0017040 tx=0x7f7ff0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:40.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.808+0000 7f7fef7fe640 1 -- 172.21.15.19:0/154238069 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0019040 con 0x56103b02bf70 2024-09-12T02:03:40.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.808+0000 7f7fef7fe640 1 -- 172.21.15.19:0/154238069 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff0022070 con 0x56103b02bf70 2024-09-12T02:03:40.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.808+0000 7f7fef7fe640 1 -- 172.21.15.19:0/154238069 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00146d0 con 0x56103b02bf70 2024-09-12T02:03:40.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.808+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56103b072c00 con 0x56103b02bf70 2024-09-12T02:03:40.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.808+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56103b054410 con 0x56103b02bf70 2024-09-12T02:03:40.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.809+0000 7f7fef7fe640 1 -- 172.21.15.19:0/154238069 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ff0014870 con 0x56103b02bf70 2024-09-12T02:03:40.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.809+0000 7f7fef7fe640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7fe006a810 0x7f7fe006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:40.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.810+0000 7f7fef7fe640 1 -- 172.21.15.19:0/154238069 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 7163+0+0 (secure 0 0 0) 0x7f7ff008ab90 con 0x56103b02bf70 2024-09-12T02:03:40.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.810+0000 7f7ffd8ef640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7fe006a810 0x7f7fe006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:40.813 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:03:40.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.810+0000 7f80005f8f40 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56103b0ee0c0 0x56103b0fcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:40.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.810+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b06fc10 con 0x56103b0ee0c0 2024-09-12T02:03:40.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.810+0000 7f7ffe8f1640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56103b0ee0c0 0x56103b0fcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:40.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.810+0000 7f7ffe8f1640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56103b0ee0c0 0x56103b0fcce0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:40.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.810+0000 7f7ffd8ef640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7fe006a810 0x7f7fe006ccd0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x56103b100e90 tx=0x7f7ff4003890 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:40.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.812+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v105'319 uv293 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.812+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b06ed40 con 0x56103b0ee0c0 2024-09-12T02:03:40.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.813+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v105'320 uv320 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.813+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4050 con 0x56103b0ee0c0 2024-09-12T02:03:40.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.814+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v105'321 uv321 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.816 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:03:40.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.814+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a5400 con 0x56103b0ee0c0 2024-09-12T02:03:40.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.815+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v105'322 uv322 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.815+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a57a0 con 0x56103b0ee0c0 2024-09-12T02:03:40.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.816+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v105'323 uv323 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.816+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a43f0 con 0x56103b0ee0c0 2024-09-12T02:03:40.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.817+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v105'324 uv324 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.817+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.818+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v105'325 uv299 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.818+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.819+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v105'326 uv326 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.819+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.819+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v105'327 uv327 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.819 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:03:40.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.820+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.820+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v105'328 uv328 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.820+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.821+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v105'329 uv329 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.821+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.822+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v105'330 uv330 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.822+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.824+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v105'331 uv306 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.824+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.825+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v105'332 uv332 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.825+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.826+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v105'333 uv333 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.826 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:03:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.826+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.827+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v105'334 uv334 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.827+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.828+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v105'335 uv335 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.828+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.829+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v105'336 uv336 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.829+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.830+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v105'337 uv337 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.830+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.831+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v105'338 uv312 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.831+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.833+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v105'339 uv339 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.833+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.833 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:03:40.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.834+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v105'340 uv340 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.834+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.835+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v105'341 uv341 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.835+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.835+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v105'342 uv342 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.835+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.836+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v105'343 uv343 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.836+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.837+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v105'344 uv318 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.837+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.838+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v105'345 uv345 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.838+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.838 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:03:40.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.839+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v105'346 uv346 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.839+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.840+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v105'347 uv347 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.840+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.841+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v105'348 uv348 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.841+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a4790 con 0x56103b0ee0c0 2024-09-12T02:03:40.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.842+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v105'349 uv349 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b0ee0c0 2024-09-12T02:03:40.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.842+0000 7f80005f8f40 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x56103b1a5b40 0x56103b1a7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:40.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.842+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a8470 con 0x56103b1a5b40 2024-09-12T02:03:40.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.843+0000 7f7ffe0f0640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x56103b1a5b40 0x56103b1a7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:40.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.843+0000 7f7ffe0f0640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x56103b1a5b40 0x56103b1a7f30 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:40.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.844+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v105'242 uv224 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.844+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a8810 con 0x56103b1a5b40 2024-09-12T02:03:40.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.845+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v105'243 uv243 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.846+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a8bb0 con 0x56103b1a5b40 2024-09-12T02:03:40.846 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:03:40.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.847+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v105'244 uv244 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.847+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a8f50 con 0x56103b1a5b40 2024-09-12T02:03:40.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.848+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v105'245 uv245 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.848+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a92f0 con 0x56103b1a5b40 2024-09-12T02:03:40.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.849+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v105'246 uv246 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.849+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a9690 con 0x56103b1a5b40 2024-09-12T02:03:40.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.850+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v105'247 uv229 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.850+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a9690 con 0x56103b1a5b40 2024-09-12T02:03:40.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.851+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v105'248 uv248 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.851+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a9690 con 0x56103b1a5b40 2024-09-12T02:03:40.851 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:03:40.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.852+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v105'249 uv249 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.852+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a9690 con 0x56103b1a5b40 2024-09-12T02:03:40.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.854+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v105'250 uv250 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.854+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a9690 con 0x56103b1a5b40 2024-09-12T02:03:40.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.855+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v105'251 uv251 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.855+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a9690 con 0x56103b1a5b40 2024-09-12T02:03:40.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.856+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v105'252 uv234 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.856+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a9690 con 0x56103b1a5b40 2024-09-12T02:03:40.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.857+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v105'253 uv253 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.857+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a9690 con 0x56103b1a5b40 2024-09-12T02:03:40.857 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:03:40.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.858+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v105'254 uv254 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.858+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1adb10 con 0x56103b1a5b40 2024-09-12T02:03:40.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.860+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v105'255 uv255 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.860+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1adb10 con 0x56103b1a5b40 2024-09-12T02:03:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.861+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v105'256 uv256 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.861+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a9690 con 0x56103b1a5b40 2024-09-12T02:03:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.862+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v105'257 uv240 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.862+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a9690 con 0x56103b1a5b40 2024-09-12T02:03:40.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.863+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v105'258 uv258 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.863+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a9690 con 0x56103b1a5b40 2024-09-12T02:03:40.863 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:03:40.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.864+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v105'259 uv259 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.864+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1aa6a0 con 0x56103b1a5b40 2024-09-12T02:03:40.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.865+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v105'260 uv260 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.865+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1aa6a0 con 0x56103b1a5b40 2024-09-12T02:03:40.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.866+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v105'261 uv261 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.866+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1a9690 con 0x56103b1a5b40 2024-09-12T02:03:40.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.867+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v105'262 uv262 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1a5b40 2024-09-12T02:03:40.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.867+0000 7f80005f8f40 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x56103b1a9d10 0x56103b1ac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:40.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.867+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1ac680 con 0x56103b1a9d10 2024-09-12T02:03:40.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.868+0000 7f7ffd8ef640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x56103b1a9d10 0x56103b1ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:40.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.868+0000 7f7ffd8ef640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x56103b1a9d10 0x56103b1ac100 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:40.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.869+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v105'63 uv62 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.870+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1acb40 con 0x56103b1a9d10 2024-09-12T02:03:40.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.871+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v105'64 uv64 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.871+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1ad020 con 0x56103b1a9d10 2024-09-12T02:03:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.872+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v105'65 uv65 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.871 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:03:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.872+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1ae8d0 con 0x56103b1a9d10 2024-09-12T02:03:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.873+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v105'66 uv66 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.873+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1aec70 con 0x56103b1a9d10 2024-09-12T02:03:40.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.874+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v105'67 uv67 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.874+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1ad8c0 con 0x56103b1a9d10 2024-09-12T02:03:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.875+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v105'68 uv68 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.875+0000 7f80005f8f40 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x56103b1ae1e0 0x56103b1b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.875+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b1560 con 0x56103b1ae1e0 2024-09-12T02:03:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.875+0000 7f7ffe8f1640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x56103b1ae1e0 0x56103b1b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.876+0000 7f7ffe8f1640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x56103b1ae1e0 0x56103b1b1020 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:40.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.877+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v105'50 uv49 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.877+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b1560 con 0x56103b1ae1e0 2024-09-12T02:03:40.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.878+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v105'51 uv51 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.878+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b15e0 con 0x56103b1ae1e0 2024-09-12T02:03:40.878 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:03:40.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.879+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v105'52 uv52 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.879+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b19d0 con 0x56103b1ae1e0 2024-09-12T02:03:40.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.881+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v105'53 uv53 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.881+0000 7f80005f8f40 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x56103b1b1ee0 0x56103b1b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:40.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.881+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4850 con 0x56103b1b1ee0 2024-09-12T02:03:40.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.882+0000 7f7ffe0f0640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x56103b1b1ee0 0x56103b1b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:40.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.882+0000 7f7ffe0f0640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x56103b1b1ee0 0x56103b1b42d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:40.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.883+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v105'63 uv62 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.883+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4910 con 0x56103b1b1ee0 2024-09-12T02:03:40.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.884+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v105'64 uv64 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.884+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1b1ee0 2024-09-12T02:03:40.885 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:03:40.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.885+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v105'65 uv65 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.886+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b5d10 con 0x56103b1b1ee0 2024-09-12T02:03:40.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.887+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v105'66 uv66 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.888+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b5d10 con 0x56103b1b1ee0 2024-09-12T02:03:40.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.889+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v105'67 uv67 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.889+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1b1ee0 2024-09-12T02:03:40.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.890+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v105'68 uv68 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.890+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1ae1e0 2024-09-12T02:03:40.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.891+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v105'116 uv110 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.891+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1ae1e0 2024-09-12T02:03:40.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.892+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v105'117 uv117 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.892+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1ae1e0 2024-09-12T02:03:40.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.893+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v105'118 uv118 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.892 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:03:40.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.893+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b5d10 con 0x56103b1ae1e0 2024-09-12T02:03:40.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.894+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v105'119 uv119 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.894+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b5d10 con 0x56103b1ae1e0 2024-09-12T02:03:40.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.895+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v105'120 uv120 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.895+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1ae1e0 2024-09-12T02:03:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.896+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v105'121 uv121 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.896+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1ae1e0 2024-09-12T02:03:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.897+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v105'122 uv115 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.897+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1ae1e0 2024-09-12T02:03:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.898+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v105'123 uv123 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.898+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1ae1e0 2024-09-12T02:03:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.899+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v105'124 uv124 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.899 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:03:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.899+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1ae1e0 2024-09-12T02:03:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.900+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v105'125 uv125 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.900+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1ae1e0 2024-09-12T02:03:40.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.901+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v105'126 uv126 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.901+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1ae1e0 2024-09-12T02:03:40.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.902+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v105'51 uv50 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.902+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1ae1e0 2024-09-12T02:03:40.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.903+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v105'52 uv52 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.903+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1ae1e0 2024-09-12T02:03:40.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.904+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v105'53 uv53 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.903 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:03:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.904+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1ae1e0 2024-09-12T02:03:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.905+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v105'54 uv54 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.905+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1ae1e0 2024-09-12T02:03:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.906+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v105'55 uv55 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7ff8056030 con 0x56103b1ae1e0 2024-09-12T02:03:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.906+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1b1ee0 2024-09-12T02:03:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.907+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v105'63 uv62 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.907+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1b1ee0 2024-09-12T02:03:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.908+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v105'64 uv64 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.908+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1b1ee0 2024-09-12T02:03:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.909+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v105'65 uv65 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.908 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:03:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.909+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b5d10 con 0x56103b1b1ee0 2024-09-12T02:03:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.910+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v105'66 uv66 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.910+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b5d10 con 0x56103b1b1ee0 2024-09-12T02:03:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.911+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v105'67 uv67 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.911+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1b1ee0 2024-09-12T02:03:40.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.912+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v105'68 uv68 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.912+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1b1ee0 2024-09-12T02:03:40.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.913+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v105'104 uv97 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.913+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1b1ee0 2024-09-12T02:03:40.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.914+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v105'105 uv105 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.914+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1b1ee0 2024-09-12T02:03:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.915+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v105'106 uv106 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.914 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:03:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.915+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1b1ee0 2024-09-12T02:03:40.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.916+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v105'107 uv107 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.916+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1b1ee0 2024-09-12T02:03:40.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.917+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v105'108 uv108 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.917+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1b1ee0 2024-09-12T02:03:40.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.918+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v105'109 uv109 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.917 INFO:teuthology.orchestra.run.smithi019.stdout:Write #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:03:40.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.918+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b4d00 con 0x56103b1b1ee0 2024-09-12T02:03:40.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.919+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [omap-set-header] v105'110 uv110 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.919+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b5190 con 0x56103b1b1ee0 2024-09-12T02:03:40.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.921+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v105'111 uv111 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.921+0000 7f80005f8f40 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x56103b1b5850 0x56103b1b7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:40.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.921+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:99 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8180 con 0x56103b1b5850 2024-09-12T02:03:40.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.921+0000 7f7ffd8ef640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x56103b1b5850 0x56103b1b7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:40.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.921+0000 7f7ffd8ef640 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x56103b1b5850 0x56103b1b7c40 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:40.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.923+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(99 mds0_sessionmap [create] v105'49 uv47 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1b5850 2024-09-12T02:03:40.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.923+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:100 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8520 con 0x56103b1b5850 2024-09-12T02:03:40.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.924+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(100 mds0_sessionmap [delete] v105'50 uv50 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1b5850 2024-09-12T02:03:40.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.924+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b85a0 con 0x56103b1b5850 2024-09-12T02:03:40.924 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:03:40.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.925+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(101 mds0_sessionmap [create] v105'51 uv51 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1b5850 2024-09-12T02:03:40.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.925+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8620 con 0x56103b1b5850 2024-09-12T02:03:40.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.927+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v105'52 uv52 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1b5850 2024-09-12T02:03:40.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.927+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:103 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8620 con 0x56103b1b1ee0 2024-09-12T02:03:40.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.928+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(103 609.00000000 [create] v105'63 uv62 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.928+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:104 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8620 con 0x56103b1b1ee0 2024-09-12T02:03:40.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.929+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(104 609.00000000 [delete] v105'64 uv64 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.929+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8620 con 0x56103b1b1ee0 2024-09-12T02:03:40.929 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:03:40.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.930+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v105'65 uv65 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.930+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8620 con 0x56103b1b1ee0 2024-09-12T02:03:40.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.931+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v105'66 uv66 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.931+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8620 con 0x56103b1b1ee0 2024-09-12T02:03:40.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.931+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v105'67 uv67 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.932+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8620 con 0x56103b1b1ee0 2024-09-12T02:03:40.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.933+0000 7f7ffe0f0640 1 -- 172.21.15.19:0/154238069 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [omap-set-header] v105'68 uv68 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff005f0b0 con 0x56103b1b1ee0 2024-09-12T02:03:40.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.933+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:109 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8620 con 0x56103b1a9d10 2024-09-12T02:03:40.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.934+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(109 400.00000000 [create] v105'52 uv51 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.934+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:110 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8620 con 0x56103b1a9d10 2024-09-12T02:03:40.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.935+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(110 400.00000000 [delete] v105'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.935+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8660 con 0x56103b1a9d10 2024-09-12T02:03:40.935 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:03:40.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.936+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(111 400.00000000 [create] v105'54 uv54 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.936+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8660 con 0x56103b1a9d10 2024-09-12T02:03:40.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.937+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(112 400.00000000 [write 0~22] v105'55 uv55 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.937+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8660 con 0x56103b1a9d10 2024-09-12T02:03:40.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.938+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(113 400.00000000 [omap-set-header] v105'56 uv56 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.938+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8660 con 0x56103b1a9d10 2024-09-12T02:03:40.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.939+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(114 100.00000000.inode [create] v105'132 uv123 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.939+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8660 con 0x56103b1a9d10 2024-09-12T02:03:40.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.940+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(115 100.00000000.inode [delete] v105'133 uv133 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.940+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8660 con 0x56103b1a9d10 2024-09-12T02:03:40.940 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:03:40.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.941+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(116 100.00000000.inode [create] v105'134 uv134 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.941+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8660 con 0x56103b1a9d10 2024-09-12T02:03:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.942+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v105'135 uv135 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.942+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8640 con 0x56103b1a9d10 2024-09-12T02:03:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.943+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v105'136 uv136 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.943+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8640 con 0x56103b1a9d10 2024-09-12T02:03:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.944+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(119 1.00000000 [create] v105'137 uv130 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.944+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8640 con 0x56103b1a9d10 2024-09-12T02:03:40.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.945+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(120 1.00000000 [delete] v105'138 uv138 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.945+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8640 con 0x56103b1a9d10 2024-09-12T02:03:40.945 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:03:40.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.946+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(121 1.00000000 [create] v105'139 uv139 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.946+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8640 con 0x56103b1a9d10 2024-09-12T02:03:40.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.947+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v105'140 uv140 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.947+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8640 con 0x56103b1a9d10 2024-09-12T02:03:40.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.948+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v105'141 uv141 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.948+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8640 con 0x56103b1a9d10 2024-09-12T02:03:40.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.949+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(124 1.00000000 [omap-set-header] v105'142 uv142 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.949+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x56103b1b8b70 con 0x56103b1a9d10 2024-09-12T02:03:40.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f7ffd8ef640 1 -- 172.21.15.19:0/154238069 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v105'143 uv143 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7ff400e040 con 0x56103b1a9d10 2024-09-12T02:03:40.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x56103b1a5b40 msgr2=0x56103b1a7f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:40.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x56103b1a5b40 0x56103b1a7f30 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56103b0ee0c0 msgr2=0x56103b0fcce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56103b0ee0c0 0x56103b0fcce0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x56103b1ae1e0 msgr2=0x56103b1b1020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x56103b1ae1e0 0x56103b1b1020 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x56103b1b5850 msgr2=0x56103b1b7c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x56103b1b5850 0x56103b1b7c40 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x56103b1a9d10 msgr2=0x56103b1ac100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x56103b1a9d10 0x56103b1ac100 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x56103b1b1ee0 msgr2=0x56103b1b42d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x56103b1b1ee0 0x56103b1b42d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 reap_dead start 2024-09-12T02:03:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f7ffe8f1640 1 -- 172.21.15.19:0/154238069 reap_dead start 2024-09-12T02:03:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7fe006a810 msgr2=0x7f7fe006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7fe006a810 0x7f7fe006ccd0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x56103b100e90 tx=0x7f7ff4003890 comp rx=0 tx=0).stop 2024-09-12T02:03:40.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56103b02bf70 msgr2=0x56103b0736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:40.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56103b02bf70 0x56103b0736e0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0017040 tx=0x7f7ff0003020 comp rx=0 tx=0).stop 2024-09-12T02:03:40.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 shutdown_connections 2024-09-12T02:03:40.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7fe006a810 0x7f7fe006ccd0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 --2- 172.21.15.19:0/154238069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56103b02bf70 0x56103b0736e0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:40.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 >> 172.21.15.19:0/154238069 conn(0x56103b02b1d0 msgr2=0x56103b0f7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:40.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.950+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 shutdown_connections 2024-09-12T02:03:40.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:40.951+0000 7f80005f8f40 1 -- 172.21.15.19:0/154238069 wait complete. 2024-09-12T02:03:40.953 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds0_sessionmap 2024-09-12T02:03:41.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.037+0000 7f1873b92f40 1 Processor -- start 2024-09-12T02:03:41.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.037+0000 7f1873b92f40 1 -- start start 2024-09-12T02:03:41.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.038+0000 7f1873b92f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561074ae8180 0x561074b9dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.038+0000 7f1873b92f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561074b16050 0x561074bbe120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.038+0000 7f1873b92f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561074ba0080 0x561074bbe660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.038+0000 7f1873b92f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561074ae4dc0 con 0x561074ae8180 2024-09-12T02:03:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.038+0000 7f1873b92f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561074ae4ae0 con 0x561074ba0080 2024-09-12T02:03:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.038+0000 7f1873b92f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x561074ae50a0 con 0x561074b16050 2024-09-12T02:03:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.038+0000 7f1871688640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561074ae8180 0x561074b9dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.038+0000 7f1871688640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561074ae8180 0x561074b9dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56992/0 (socket says 172.21.15.19:56992) 2024-09-12T02:03:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.038+0000 7f1871688640 1 -- 172.21.15.19:0/4273630455 learned_addr learned my addr 172.21.15.19:0/4273630455 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.038+0000 7f186bfff640 1 --2- 172.21.15.19:0/4273630455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561074b16050 0x561074bbe120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.038+0000 7f1871e89640 1 --2- 172.21.15.19:0/4273630455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561074ba0080 0x561074bbe660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.038+0000 7f1871688640 1 -- 172.21.15.19:0/4273630455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561074b16050 msgr2=0x561074bbe120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.038+0000 7f1871688640 1 --2- 172.21.15.19:0/4273630455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561074b16050 0x561074bbe120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.039+0000 7f1871688640 1 -- 172.21.15.19:0/4273630455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561074ba0080 msgr2=0x561074bbe660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.039+0000 7f1871688640 1 --2- 172.21.15.19:0/4273630455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561074ba0080 0x561074bbe660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.039+0000 7f1871688640 1 -- 172.21.15.19:0/4273630455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561074a10cb0 con 0x561074ae8180 2024-09-12T02:03:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.039+0000 7f1871e89640 1 --2- 172.21.15.19:0/4273630455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561074ba0080 0x561074bbe660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.039+0000 7f1871688640 1 --2- 172.21.15.19:0/4273630455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561074ae8180 0x561074b9dda0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f186400a7a0 tx=0x7f186400a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e461fe24a963e073 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.039+0000 7f186b7fe640 1 -- 172.21.15.19:0/4273630455 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1864019070 con 0x561074ae8180 2024-09-12T02:03:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.039+0000 7f186b7fe640 1 -- 172.21.15.19:0/4273630455 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1864007600 con 0x561074ae8180 2024-09-12T02:03:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.039+0000 7f186b7fe640 1 -- 172.21.15.19:0/4273630455 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18640079d0 con 0x561074ae8180 2024-09-12T02:03:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.039+0000 7f1873b92f40 1 -- 172.21.15.19:0/4273630455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561074ae8180 msgr2=0x561074b9dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.039+0000 7f1873b92f40 1 --2- 172.21.15.19:0/4273630455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561074ae8180 0x561074b9dda0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f186400a7a0 tx=0x7f186400a890 comp rx=0 tx=0).stop 2024-09-12T02:03:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.039+0000 7f1873b92f40 1 -- 172.21.15.19:0/4273630455 shutdown_connections 2024-09-12T02:03:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.039+0000 7f1873b92f40 1 --2- 172.21.15.19:0/4273630455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561074ba0080 0x561074bbe660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.039+0000 7f1873b92f40 1 --2- 172.21.15.19:0/4273630455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561074b16050 0x561074bbe120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.039+0000 7f1873b92f40 1 --2- 172.21.15.19:0/4273630455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561074ae8180 0x561074b9dda0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.039+0000 7f1873b92f40 1 -- 172.21.15.19:0/4273630455 >> 172.21.15.19:0/4273630455 conn(0x561074ae59e0 msgr2=0x561074b10530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.039+0000 7f1873b92f40 1 -- 172.21.15.19:0/4273630455 shutdown_connections 2024-09-12T02:03:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.039+0000 7f1873b92f40 1 -- 172.21.15.19:0/4273630455 wait complete. 2024-09-12T02:03:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.040+0000 7f1873b92f40 1 Processor -- start 2024-09-12T02:03:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.040+0000 7f1873b92f40 1 -- start start 2024-09-12T02:03:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f1873b92f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561074ae8180 0x561074bb7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f1873b92f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561074b16050 0x561074ae4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f1873b92f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561074ba0080 0x561074bbe090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f1873b92f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561074b120d0 con 0x561074ae8180 2024-09-12T02:03:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f1873b92f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561074ae7ec0 con 0x561074ba0080 2024-09-12T02:03:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f1873b92f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x561074ae7be0 con 0x561074b16050 2024-09-12T02:03:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f1871688640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561074ae8180 0x561074bb7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f1871688640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561074ae8180 0x561074bb7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56998/0 (socket says 172.21.15.19:56998) 2024-09-12T02:03:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f1871688640 1 -- 172.21.15.19:0/1798850247 learned_addr learned my addr 172.21.15.19:0/1798850247 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f1871e89640 1 --2- 172.21.15.19:0/1798850247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561074ba0080 0x561074bbe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f186bfff640 1 --2- 172.21.15.19:0/1798850247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561074b16050 0x561074ae4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f1871688640 1 -- 172.21.15.19:0/1798850247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561074b16050 msgr2=0x561074ae4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f1871688640 1 --2- 172.21.15.19:0/1798850247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561074b16050 0x561074ae4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f1871688640 1 -- 172.21.15.19:0/1798850247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561074ba0080 msgr2=0x561074bbe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f1871688640 1 --2- 172.21.15.19:0/1798850247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561074ba0080 0x561074bbe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f1871688640 1 -- 172.21.15.19:0/1798850247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561074b2afd0 con 0x561074ae8180 2024-09-12T02:03:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f1871688640 1 --2- 172.21.15.19:0/1798850247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561074ae8180 0x561074bb7d30 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f1864017040 tx=0x7f1864003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f186a7fc640 1 -- 172.21.15.19:0/1798850247 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1864019040 con 0x561074ae8180 2024-09-12T02:03:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f186a7fc640 1 -- 172.21.15.19:0/1798850247 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1864022070 con 0x561074ae8180 2024-09-12T02:03:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.041+0000 7f1873b92f40 1 -- 172.21.15.19:0/1798850247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561074b2b270 con 0x561074ae8180 2024-09-12T02:03:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.042+0000 7f186a7fc640 1 -- 172.21.15.19:0/1798850247 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1864005310 con 0x561074ae8180 2024-09-12T02:03:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.042+0000 7f1873b92f40 1 -- 172.21.15.19:0/1798850247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561074b2b830 con 0x561074ae8180 2024-09-12T02:03:41.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.043+0000 7f186a7fc640 1 -- 172.21.15.19:0/1798850247 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1864014470 con 0x561074ae8180 2024-09-12T02:03:41.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.043+0000 7f186a7fc640 1 --2- 172.21.15.19:0/1798850247 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f185406a9e0 0x7f185406cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.043+0000 7f186a7fc640 1 -- 172.21.15.19:0/1798850247 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 7163+0+0 (secure 0 0 0) 0x7f186408a940 con 0x561074ae8180 2024-09-12T02:03:41.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.044+0000 7f186bfff640 1 --2- 172.21.15.19:0/1798850247 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f185406a9e0 0x7f185406cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.044+0000 7f1873b92f40 1 --2- 172.21.15.19:0/1798850247 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x561074ae4540 0x561074b2c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.044+0000 7f1873b92f40 1 -- 172.21.15.19:0/1798850247 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:1 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x561074bb91e0 con 0x561074ae4540 2024-09-12T02:03:41.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.044+0000 7f1871e89640 1 --2- 172.21.15.19:0/1798850247 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x561074ae4540 0x561074b2c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.044+0000 7f186bfff640 1 --2- 172.21.15.19:0/1798850247 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f185406a9e0 0x7f185406cea0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x561074b2fd20 tx=0x7f185c00e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:41.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.044+0000 7f1871e89640 1 --2- 172.21.15.19:0/1798850247 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x561074ae4540 0x561074b2c540 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:41.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.045+0000 7f1871e89640 1 -- 172.21.15.19:0/1798850247 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(1 mds0_sessionmap [delete] v105'53 uv53 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f186c056030 con 0x561074ae4540 2024-09-12T02:03:41.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.045+0000 7f1873b92f40 1 -- 172.21.15.19:0/1798850247 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x561074ae4540 msgr2=0x561074b2c540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:41.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.045+0000 7f1873b92f40 1 --2- 172.21.15.19:0/1798850247 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x561074ae4540 0x561074b2c540 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.045+0000 7f1873b92f40 1 -- 172.21.15.19:0/1798850247 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f185406a9e0 msgr2=0x7f185406cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:41.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.045+0000 7f1873b92f40 1 --2- 172.21.15.19:0/1798850247 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f185406a9e0 0x7f185406cea0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x561074b2fd20 tx=0x7f185c00e040 comp rx=0 tx=0).stop 2024-09-12T02:03:41.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.045+0000 7f1873b92f40 1 -- 172.21.15.19:0/1798850247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561074ae8180 msgr2=0x561074bb7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:41.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.045+0000 7f1873b92f40 1 --2- 172.21.15.19:0/1798850247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561074ae8180 0x561074bb7d30 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f1864017040 tx=0x7f1864003020 comp rx=0 tx=0).stop 2024-09-12T02:03:41.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.045+0000 7f1871e89640 1 -- 172.21.15.19:0/1798850247 reap_dead start 2024-09-12T02:03:41.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.046+0000 7f1873b92f40 1 -- 172.21.15.19:0/1798850247 shutdown_connections 2024-09-12T02:03:41.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.046+0000 7f1873b92f40 1 -- 172.21.15.19:0/1798850247 >> 172.21.15.19:0/1798850247 conn(0x561074ae59e0 msgr2=0x561074ba5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:41.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.046+0000 7f1873b92f40 1 -- 172.21.15.19:0/1798850247 shutdown_connections 2024-09-12T02:03:41.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.046+0000 7f1873b92f40 1 -- 172.21.15.19:0/1798850247 wait complete. 2024-09-12T02:03:41.049 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:03:41.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.194+0000 7f70e7e0e640 1 Processor -- start 2024-09-12T02:03:41.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.194+0000 7f70e7e0e640 1 -- start start 2024-09-12T02:03:41.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.195+0000 7f70e7e0e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f70e00cd120 0x7f70e0071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.195+0000 7f70e7e0e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70e015b950 0x7f70e015e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.195+0000 7f70e7e0e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e015be00 con 0x7f70e015b570 2024-09-12T02:03:41.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.195+0000 7f70e7e0e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f70e00740e0 con 0x7f70e00cd120 2024-09-12T02:03:41.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.195+0000 7f70e7e0e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f70e0073b20 con 0x7f70e015b950 2024-09-12T02:03:41.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.195+0000 7f70e63ab640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70e015b950 0x7f70e015e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.195+0000 7f70e53a9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f70e00cd120 0x7f70e0071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.195+0000 7f70e63ab640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70e015b950 0x7f70e015e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:40178/0 (socket says 172.21.15.19:40178) 2024-09-12T02:03:41.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.195+0000 7f70e63ab640 1 -- 172.21.15.19:0/23529193 learned_addr learned my addr 172.21.15.19:0/23529193 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:41.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.195+0000 7f70e5baa640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f70e015b570 0x7f70e00cca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:39770/0 (socket says 172.21.15.19:39770) 2024-09-12T02:03:41.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.195+0000 7f70e53a9640 1 --2- 172.21.15.19:0/23529193 >> v2:172.21.15.135:3300/0 conn(0x7f70e00cd120 0x7f70e0071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:44140/0 (socket says 172.21.15.19:44140) 2024-09-12T02:03:41.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.195+0000 7f70e63ab640 1 -- 172.21.15.19:0/23529193 >> v2:172.21.15.135:3300/0 conn(0x7f70e00cd120 msgr2=0x7f70e0071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:41.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.195+0000 7f70e63ab640 1 --2- 172.21.15.19:0/23529193 >> v2:172.21.15.135:3300/0 conn(0x7f70e00cd120 0x7f70e0071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.195+0000 7f70e63ab640 1 -- 172.21.15.19:0/23529193 >> v1:172.21.15.135:6789/0 conn(0x7f70e015b570 legacy=0x7f70e00cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:41.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.195+0000 7f70e63ab640 1 -- 172.21.15.19:0/23529193 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e0073e00 con 0x7f70e015b950 2024-09-12T02:03:41.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.195+0000 7f70e53a9640 1 --2- 172.21.15.19:0/23529193 >> v2:172.21.15.135:3300/0 conn(0x7f70e00cd120 0x7f70e0071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:03:41.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.196+0000 7f70e63ab640 1 --2- 172.21.15.19:0/23529193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70e015b950 0x7f70e015e4e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009e50 tx=0x7f70d802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14162b3d26890ce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:41.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.196+0000 7f70e4ba8640 1 -- 172.21.15.19:0/23529193 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8036070 con 0x7f70e015b950 2024-09-12T02:03:41.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.196+0000 7f70e4ba8640 1 -- 172.21.15.19:0/23529193 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d8031600 con 0x7f70e015b950 2024-09-12T02:03:41.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.196+0000 7f70e4ba8640 1 -- 172.21.15.19:0/23529193 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d80319d0 con 0x7f70e015b950 2024-09-12T02:03:41.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.197+0000 7f70e7e0e640 1 -- 172.21.15.19:0/23529193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70e015b950 msgr2=0x7f70e015e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:41.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.197+0000 7f70e7e0e640 1 --2- 172.21.15.19:0/23529193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70e015b950 0x7f70e015e4e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009e50 tx=0x7f70d802a680 comp rx=0 tx=0).stop 2024-09-12T02:03:41.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.197+0000 7f70e7e0e640 1 -- 172.21.15.19:0/23529193 shutdown_connections 2024-09-12T02:03:41.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.197+0000 7f70e7e0e640 1 --2- 172.21.15.19:0/23529193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70e015b950 0x7f70e015e4e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.197+0000 7f70e7e0e640 1 --2- 172.21.15.19:0/23529193 >> v2:172.21.15.135:3300/0 conn(0x7f70e00cd120 0x7f70e0071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.197+0000 7f70e7e0e640 1 -- 172.21.15.19:0/23529193 >> 172.21.15.19:0/23529193 conn(0x7f70e006bdf0 msgr2=0x7f70e006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:41.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.197+0000 7f70e7e0e640 1 -- 172.21.15.19:0/23529193 shutdown_connections 2024-09-12T02:03:41.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.197+0000 7f70e7e0e640 1 -- 172.21.15.19:0/23529193 wait complete. 2024-09-12T02:03:41.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.198+0000 7f70e7e0e640 1 Processor -- start 2024-09-12T02:03:41.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.198+0000 7f70e7e0e640 1 -- start start 2024-09-12T02:03:41.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.199+0000 7f70e7e0e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70e00cd120 0x7f70e0147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.199+0000 7f70e7e0e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70e015b570 0x7f70e015ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.199+0000 7f70e7e0e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70e015b950 0x7f70e01516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.199+0000 7f70e7e0e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f70e00cf840 con 0x7f70e00cd120 2024-09-12T02:03:41.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.199+0000 7f70e7e0e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70e0072450 con 0x7f70e015b950 2024-09-12T02:03:41.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.199+0000 7f70e7e0e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f70e00cf9c0 con 0x7f70e015b570 2024-09-12T02:03:41.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.199+0000 7f70e5baa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70e00cd120 0x7f70e0147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.199+0000 7f70e53a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70e015b570 0x7f70e015ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.199+0000 7f70e63ab640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70e015b950 0x7f70e01516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.199+0000 7f70e53a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70e015b570 0x7f70e015ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:40188/0 (socket says 172.21.15.19:40188) 2024-09-12T02:03:41.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.199+0000 7f70e53a9640 1 -- 172.21.15.19:0/4132020943 learned_addr learned my addr 172.21.15.19:0/4132020943 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:41.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.199+0000 7f70e5baa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70e00cd120 0x7f70e0147ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35596/0 (socket says 172.21.15.19:35596) 2024-09-12T02:03:41.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.199+0000 7f70e53a9640 1 -- 172.21.15.19:0/4132020943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70e015b950 msgr2=0x7f70e01516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:41.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.199+0000 7f70e53a9640 1 --2- 172.21.15.19:0/4132020943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70e015b950 0x7f70e01516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.199+0000 7f70e53a9640 1 -- 172.21.15.19:0/4132020943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70e00cd120 msgr2=0x7f70e0147ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:41.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.199+0000 7f70e53a9640 1 --2- 172.21.15.19:0/4132020943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70e00cd120 0x7f70e0147ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.199+0000 7f70e53a9640 1 -- 172.21.15.19:0/4132020943 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e0150290 con 0x7f70e015b570 2024-09-12T02:03:41.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.199+0000 7f70e5baa640 1 --2- 172.21.15.19:0/4132020943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70e00cd120 0x7f70e0147ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:03:41.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.200+0000 7f70e53a9640 1 --2- 172.21.15.19:0/4132020943 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70e015b570 0x7f70e015ca30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f70d000ebe0 tx=0x7f70d000c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:41.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.200+0000 7f70d67fc640 1 -- 172.21.15.19:0/4132020943 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d0017070 con 0x7f70e015b570 2024-09-12T02:03:41.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.200+0000 7f70d67fc640 1 -- 172.21.15.19:0/4132020943 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d000cc30 con 0x7f70e015b570 2024-09-12T02:03:41.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.200+0000 7f70e7e0e640 1 -- 172.21.15.19:0/4132020943 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e00ae740 con 0x7f70e015b570 2024-09-12T02:03:41.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.200+0000 7f70d67fc640 1 -- 172.21.15.19:0/4132020943 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d0013470 con 0x7f70e015b570 2024-09-12T02:03:41.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.200+0000 7f70e7e0e640 1 -- 172.21.15.19:0/4132020943 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e015dc80 con 0x7f70e015b570 2024-09-12T02:03:41.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.201+0000 7f70e7e0e640 1 -- 172.21.15.19:0/4132020943 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e014b260 con 0x7f70e015b570 2024-09-12T02:03:41.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.202+0000 7f70d67fc640 1 -- 172.21.15.19:0/4132020943 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f70d001a070 con 0x7f70e015b570 2024-09-12T02:03:41.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.202+0000 7f70d67fc640 1 --2- 172.21.15.19:0/4132020943 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f70c406be30 0x7f70c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.202+0000 7f70d67fc640 1 -- 172.21.15.19:0/4132020943 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(105..105 src has 1..105) ==== 7163+0+0 (secure 0 0 0) 0x7f70d008b6f0 con 0x7f70e015b570 2024-09-12T02:03:41.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.202+0000 7f70e5baa640 1 --2- 172.21.15.19:0/4132020943 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f70c406be30 0x7f70c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.203+0000 7f70e5baa640 1 --2- 172.21.15.19:0/4132020943 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f70c406be30 0x7f70c406e2f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f70dc007fd0 tx=0x7f70dc007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:41.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.207+0000 7f70d67fc640 1 -- 172.21.15.19:0/4132020943 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f70e014b260 con 0x7f70e015b570 2024-09-12T02:03:41.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.419+0000 7f70e7e0e640 1 -- 172.21.15.19:0/4132020943 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f70e0071e40 con 0x7f70e015b570 2024-09-12T02:03:41.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.730+0000 7f70d67fc640 1 -- 172.21.15.19:0/4132020943 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v146) ==== 162+0+0 (secure 0 0 0) 0x7f70d0059400 con 0x7f70e015b570 2024-09-12T02:03:41.729 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:03:41.730 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:03:41.730+0000 7fcf2f590640 -1 mds.0.sessionmap _load_finish got (2) No such file or directory 2024-09-12T02:03:41.730 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:03:41.730+0000 7fcf2f590640 -1 log_channel(cluster) log [ERR] : error reading sessionmap 'mds0_sessionmap' -2 ((2) No such file or directory) 2024-09-12T02:03:41.730 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:03:41.731+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:03:41.730 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:03:41.731+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:03:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.732+0000 7f70e7e0e640 1 -- 172.21.15.19:0/4132020943 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f70c406be30 msgr2=0x7f70c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.732+0000 7f70e7e0e640 1 --2- 172.21.15.19:0/4132020943 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f70c406be30 0x7f70c406e2f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f70dc007fd0 tx=0x7f70dc007e80 comp rx=0 tx=0).stop 2024-09-12T02:03:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.732+0000 7f70e7e0e640 1 -- 172.21.15.19:0/4132020943 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70e015b570 msgr2=0x7f70e015ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.732+0000 7f70e7e0e640 1 --2- 172.21.15.19:0/4132020943 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70e015b570 0x7f70e015ca30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f70d000ebe0 tx=0x7f70d000c520 comp rx=0 tx=0).stop 2024-09-12T02:03:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.732+0000 7f70e7e0e640 1 -- 172.21.15.19:0/4132020943 shutdown_connections 2024-09-12T02:03:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.732+0000 7f70e7e0e640 1 --2- 172.21.15.19:0/4132020943 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f70c406be30 0x7f70c406e2f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.732+0000 7f70e7e0e640 1 --2- 172.21.15.19:0/4132020943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70e015b950 0x7f70e01516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.732+0000 7f70e7e0e640 1 --2- 172.21.15.19:0/4132020943 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70e015b570 0x7f70e015ca30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.732+0000 7f70e7e0e640 1 --2- 172.21.15.19:0/4132020943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70e00cd120 0x7f70e0147ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.732+0000 7f70e7e0e640 1 -- 172.21.15.19:0/4132020943 >> 172.21.15.19:0/4132020943 conn(0x7f70e006bdf0 msgr2=0x7f70e00cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:41.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.732+0000 7f70e7e0e640 1 -- 172.21.15.19:0/4132020943 shutdown_connections 2024-09-12T02:03:41.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.732+0000 7f70e7e0e640 1 -- 172.21.15.19:0/4132020943 wait complete. 2024-09-12T02:03:41.744 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:41.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.847+0000 7fd4cf2f8640 1 Processor -- start 2024-09-12T02:03:41.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.847+0000 7fd4cf2f8640 1 -- start start 2024-09-12T02:03:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.848+0000 7fd4cf2f8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd4c815e740 0x7fd4c80d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.848+0000 7fd4cf2f8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd4c809b690 0x7fd4c806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.848+0000 7fd4cf2f8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4c80d0780 con 0x7fd4c806d4c0 2024-09-12T02:03:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.848+0000 7fd4cf2f8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd4c815eb20 con 0x7fd4c815e740 2024-09-12T02:03:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.848+0000 7fd4cf2f8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd4c806d260 con 0x7fd4c809b690 2024-09-12T02:03:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.848+0000 7fd4cd094640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd4c815e740 0x7fd4c80d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.848+0000 7fd4cd094640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd4c815e740 0x7fd4c80d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35608/0 (socket says 172.21.15.19:35608) 2024-09-12T02:03:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.848+0000 7fd4cd094640 1 -- 172.21.15.19:0/2199953563 learned_addr learned my addr 172.21.15.19:0/2199953563 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.848+0000 7fd4cd895640 1 --1- 172.21.15.19:0/2199953563 >> v1:172.21.15.19:6789/0 conn(0x7fd4c806d4c0 0x7fd4c806d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46860/0 (socket says 172.21.15.19:46860) 2024-09-12T02:03:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.848+0000 7fd4cc893640 1 --2- 172.21.15.19:0/2199953563 >> v2:172.21.15.135:3300/0 conn(0x7fd4c809b690 0x7fd4c806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.849+0000 7fd4cd094640 1 -- 172.21.15.19:0/2199953563 >> v2:172.21.15.135:3300/0 conn(0x7fd4c809b690 msgr2=0x7fd4c806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.849+0000 7fd4cd094640 1 --2- 172.21.15.19:0/2199953563 >> v2:172.21.15.135:3300/0 conn(0x7fd4c809b690 0x7fd4c806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.849+0000 7fd4cd094640 1 -- 172.21.15.19:0/2199953563 >> v1:172.21.15.19:6789/0 conn(0x7fd4c806d4c0 legacy=0x7fd4c806d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.849+0000 7fd4cd094640 1 -- 172.21.15.19:0/2199953563 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c80d0a60 con 0x7fd4c815e740 2024-09-12T02:03:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.849+0000 7fd4bffff640 1 -- 172.21.15.19:0/2199953563 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 503620889 0 0) 0x7fd4c80d0780 con 0x7fd4c806d4c0 2024-09-12T02:03:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.849+0000 7fd4cc893640 1 --2- 172.21.15.19:0/2199953563 >> v2:172.21.15.135:3300/0 conn(0x7fd4c809b690 0x7fd4c806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.849+0000 7fd4cd094640 1 --2- 172.21.15.19:0/2199953563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4c815e740 0x7fd4c80d1540 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80691b0 tx=0x7fd4c402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1756451f644f7332 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:41.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.849+0000 7fd4bffff640 1 -- 172.21.15.19:0/2199953563 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4037070 con 0x7fd4c815e740 2024-09-12T02:03:41.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.850+0000 7fd4bffff640 1 -- 172.21.15.19:0/2199953563 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4c402ae50 con 0x7fd4c815e740 2024-09-12T02:03:41.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.850+0000 7fd4bffff640 1 -- 172.21.15.19:0/2199953563 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4032860 con 0x7fd4c815e740 2024-09-12T02:03:41.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.850+0000 7fd4cf2f8640 1 -- 172.21.15.19:0/2199953563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4c815e740 msgr2=0x7fd4c80d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:41.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.850+0000 7fd4cf2f8640 1 --2- 172.21.15.19:0/2199953563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4c815e740 0x7fd4c80d1540 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80691b0 tx=0x7fd4c402a300 comp rx=0 tx=0).stop 2024-09-12T02:03:41.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.850+0000 7fd4cf2f8640 1 -- 172.21.15.19:0/2199953563 shutdown_connections 2024-09-12T02:03:41.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.850+0000 7fd4cf2f8640 1 --2- 172.21.15.19:0/2199953563 >> v2:172.21.15.135:3300/0 conn(0x7fd4c809b690 0x7fd4c806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.850+0000 7fd4cf2f8640 1 --2- 172.21.15.19:0/2199953563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4c815e740 0x7fd4c80d1540 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.850+0000 7fd4cf2f8640 1 -- 172.21.15.19:0/2199953563 >> 172.21.15.19:0/2199953563 conn(0x7fd4c80d23a0 msgr2=0x7fd4c80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:41.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.850+0000 7fd4cf2f8640 1 -- 172.21.15.19:0/2199953563 shutdown_connections 2024-09-12T02:03:41.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.850+0000 7fd4cf2f8640 1 -- 172.21.15.19:0/2199953563 wait complete. 2024-09-12T02:03:41.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.851+0000 7fd4cf2f8640 1 Processor -- start 2024-09-12T02:03:41.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.851+0000 7fd4cf2f8640 1 -- start start 2024-09-12T02:03:41.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.852+0000 7fd4cf2f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4c806d4c0 0x7fd4c8157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.852+0000 7fd4cf2f8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4c809b690 0x7fd4c80b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.852+0000 7fd4cf2f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4c815e740 0x7fd4c80b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.852+0000 7fd4cf2f8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c809bac0 con 0x7fd4c815e740 2024-09-12T02:03:41.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.852+0000 7fd4cf2f8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c80d1020 con 0x7fd4c809b690 2024-09-12T02:03:41.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.852+0000 7fd4cf2f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd4c806dfe0 con 0x7fd4c806d4c0 2024-09-12T02:03:41.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.852+0000 7fd4cd895640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4c815e740 0x7fd4c80b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.852+0000 7fd4cd895640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4c815e740 0x7fd4c80b0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35612/0 (socket says 172.21.15.19:35612) 2024-09-12T02:03:41.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.852+0000 7fd4cd895640 1 -- 172.21.15.19:0/1580176998 learned_addr learned my addr 172.21.15.19:0/1580176998 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:41.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.852+0000 7fd4cc893640 1 --2- 172.21.15.19:0/1580176998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4c809b690 0x7fd4c80b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.852+0000 7fd4cd094640 1 --2- 172.21.15.19:0/1580176998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4c806d4c0 0x7fd4c8157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.853+0000 7fd4cd895640 1 -- 172.21.15.19:0/1580176998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4c806d4c0 msgr2=0x7fd4c8157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:41.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.853+0000 7fd4cd895640 1 --2- 172.21.15.19:0/1580176998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4c806d4c0 0x7fd4c8157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.853+0000 7fd4cd895640 1 -- 172.21.15.19:0/1580176998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4c809b690 msgr2=0x7fd4c80b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:41.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.853+0000 7fd4cd895640 1 --2- 172.21.15.19:0/1580176998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4c809b690 0x7fd4c80b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:41.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.853+0000 7fd4cd895640 1 -- 172.21.15.19:0/1580176998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c80c9ae0 con 0x7fd4c815e740 2024-09-12T02:03:41.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.853+0000 7fd4cd895640 1 --2- 172.21.15.19:0/1580176998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4c815e740 0x7fd4c80b0af0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fd4c000c730 tx=0x7fd4c000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:41.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.853+0000 7fd4bdffb640 1 -- 172.21.15.19:0/1580176998 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0018070 con 0x7fd4c815e740 2024-09-12T02:03:41.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.853+0000 7fd4bdffb640 1 -- 172.21.15.19:0/1580176998 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4c000ce40 con 0x7fd4c815e740 2024-09-12T02:03:41.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.853+0000 7fd4cf2f8640 1 -- 172.21.15.19:0/1580176998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c80b7280 con 0x7fd4c815e740 2024-09-12T02:03:41.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.853+0000 7fd4bdffb640 1 -- 172.21.15.19:0/1580176998 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c000a860 con 0x7fd4c815e740 2024-09-12T02:03:41.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.853+0000 7fd4cf2f8640 1 -- 172.21.15.19:0/1580176998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c80ca040 con 0x7fd4c815e740 2024-09-12T02:03:41.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.854+0000 7fd4cf2f8640 1 -- 172.21.15.19:0/1580176998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4c80d0780 con 0x7fd4c815e740 2024-09-12T02:03:41.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.854+0000 7fd4bdffb640 1 -- 172.21.15.19:0/1580176998 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd4c001b070 con 0x7fd4c815e740 2024-09-12T02:03:41.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.855+0000 7fd4bdffb640 1 --2- 172.21.15.19:0/1580176998 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd4ac06be30 0x7fd4ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:41.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.855+0000 7fd4bdffb640 1 -- 172.21.15.19:0/1580176998 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7249+0+0 (secure 0 0 0) 0x7fd4c008a8b0 con 0x7fd4c815e740 2024-09-12T02:03:41.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.855+0000 7fd4cd094640 1 --2- 172.21.15.19:0/1580176998 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd4ac06be30 0x7fd4ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:41.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.856+0000 7fd4cd094640 1 --2- 172.21.15.19:0/1580176998 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd4ac06be30 0x7fd4ac06e2f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4034000 tx=0x7fd4c402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:41.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:41.859+0000 7fd4bdffb640 1 -- 172.21.15.19:0/1580176998 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4c80c9ae0 con 0x7fd4c815e740 2024-09-12T02:03:42.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.075+0000 7fd4cf2f8640 1 -- 172.21.15.19:0/1580176998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4c80d1cb0 con 0x7fd4c815e740 2024-09-12T02:03:42.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.076+0000 7fd4bdffb640 1 -- 172.21.15.19:0/1580176998 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 147 v147) ==== 95+0+4392 (secure 0 0 0) 0x7fd4c0058690 con 0x7fd4c815e740 2024-09-12T02:03:42.076 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:42.076 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":147,"btime":"2024-09-12T02:03:41:731458+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3866905323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3866905323},{"type":"v1","addr":"172.21.15.135:6837","nonce":3866905323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":147,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:41.731398+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:42.076 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 147 2024-09-12T02:03:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.078+0000 7fd4cf2f8640 1 -- 172.21.15.19:0/1580176998 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd4ac06be30 msgr2=0x7fd4ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.078+0000 7fd4cf2f8640 1 --2- 172.21.15.19:0/1580176998 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd4ac06be30 0x7fd4ac06e2f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4034000 tx=0x7fd4c402e000 comp rx=0 tx=0).stop 2024-09-12T02:03:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.078+0000 7fd4cf2f8640 1 -- 172.21.15.19:0/1580176998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4c815e740 msgr2=0x7fd4c80b0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.078+0000 7fd4cf2f8640 1 --2- 172.21.15.19:0/1580176998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4c815e740 0x7fd4c80b0af0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fd4c000c730 tx=0x7fd4c000cbf0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.079+0000 7fd4cf2f8640 1 -- 172.21.15.19:0/1580176998 shutdown_connections 2024-09-12T02:03:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.079+0000 7fd4cf2f8640 1 --2- 172.21.15.19:0/1580176998 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd4ac06be30 0x7fd4ac06e2f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.079+0000 7fd4cf2f8640 1 --2- 172.21.15.19:0/1580176998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4c815e740 0x7fd4c80b0af0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.079+0000 7fd4cf2f8640 1 --2- 172.21.15.19:0/1580176998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4c809b690 0x7fd4c80b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.079+0000 7fd4cf2f8640 1 --2- 172.21.15.19:0/1580176998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4c806d4c0 0x7fd4c8157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.079+0000 7fd4cf2f8640 1 -- 172.21.15.19:0/1580176998 >> 172.21.15.19:0/1580176998 conn(0x7fd4c80d23a0 msgr2=0x7fd4c80b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.079+0000 7fd4cf2f8640 1 -- 172.21.15.19:0/1580176998 shutdown_connections 2024-09-12T02:03:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.079+0000 7fd4cf2f8640 1 -- 172.21.15.19:0/1580176998 wait complete. 2024-09-12T02:03:42.089 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:03:42.089 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:42.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.192+0000 7fd2f79cf640 1 Processor -- start 2024-09-12T02:03:42.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.192+0000 7fd2f79cf640 1 -- start start 2024-09-12T02:03:42.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.193+0000 7fd2f79cf640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd2f015ba30 0x7fd2f006f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.193+0000 7fd2f79cf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd2f006fd50 0x7fd2f0072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.193+0000 7fd2f79cf640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f00b3570 con 0x7fd2f0072e80 2024-09-12T02:03:42.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.193+0000 7fd2f79cf640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd2f00732f0 con 0x7fd2f006fd50 2024-09-12T02:03:42.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.193+0000 7fd2f79cf640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd2f00b4180 con 0x7fd2f015ba30 2024-09-12T02:03:42.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.193+0000 7fd2f4f6a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd2f006fd50 0x7fd2f0072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.193+0000 7fd2f4f6a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd2f006fd50 0x7fd2f0072940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35626/0 (socket says 172.21.15.19:35626) 2024-09-12T02:03:42.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.193+0000 7fd2f4f6a640 1 -- 172.21.15.19:0/3565392128 learned_addr learned my addr 172.21.15.19:0/3565392128 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:42.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.193+0000 7fd2f5f6c640 1 --1- 172.21.15.19:0/3565392128 >> v1:172.21.15.19:6789/0 conn(0x7fd2f0072e80 0x7fd2f006e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46862/0 (socket says 172.21.15.19:46862) 2024-09-12T02:03:42.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.193+0000 7fd2f576b640 1 --2- 172.21.15.19:0/3565392128 >> v2:172.21.15.135:3300/0 conn(0x7fd2f015ba30 0x7fd2f006f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.193+0000 7fd2f4f6a640 1 -- 172.21.15.19:0/3565392128 >> v2:172.21.15.135:3300/0 conn(0x7fd2f015ba30 msgr2=0x7fd2f006f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:42.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.193+0000 7fd2f4f6a640 1 --2- 172.21.15.19:0/3565392128 >> v2:172.21.15.135:3300/0 conn(0x7fd2f015ba30 0x7fd2f006f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.193+0000 7fd2f4f6a640 1 -- 172.21.15.19:0/3565392128 >> v1:172.21.15.19:6789/0 conn(0x7fd2f0072e80 legacy=0x7fd2f006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:42.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.193+0000 7fd2f4f6a640 1 -- 172.21.15.19:0/3565392128 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f00b3850 con 0x7fd2f006fd50 2024-09-12T02:03:42.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.193+0000 7fd2f576b640 1 --2- 172.21.15.19:0/3565392128 >> v2:172.21.15.135:3300/0 conn(0x7fd2f015ba30 0x7fd2f006f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:42.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.194+0000 7fd2f4f6a640 1 --2- 172.21.15.19:0/3565392128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f006fd50 0x7fd2f0072940 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fd2f006ca90 tx=0x7fd2e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8149eae732946bef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:42.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.194+0000 7fd2e7fff640 1 -- 172.21.15.19:0/3565392128 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0037070 con 0x7fd2f006fd50 2024-09-12T02:03:42.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.194+0000 7fd2e7fff640 1 -- 172.21.15.19:0/3565392128 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e0032440 con 0x7fd2f006fd50 2024-09-12T02:03:42.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.194+0000 7fd2e7fff640 1 -- 172.21.15.19:0/3565392128 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0032810 con 0x7fd2f006fd50 2024-09-12T02:03:42.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.195+0000 7fd2f79cf640 1 -- 172.21.15.19:0/3565392128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f006fd50 msgr2=0x7fd2f0072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:42.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.195+0000 7fd2f79cf640 1 --2- 172.21.15.19:0/3565392128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f006fd50 0x7fd2f0072940 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fd2f006ca90 tx=0x7fd2e002a270 comp rx=0 tx=0).stop 2024-09-12T02:03:42.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.195+0000 7fd2f79cf640 1 -- 172.21.15.19:0/3565392128 shutdown_connections 2024-09-12T02:03:42.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.195+0000 7fd2f79cf640 1 --2- 172.21.15.19:0/3565392128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f006fd50 0x7fd2f0072940 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.195+0000 7fd2f79cf640 1 --2- 172.21.15.19:0/3565392128 >> v2:172.21.15.135:3300/0 conn(0x7fd2f015ba30 0x7fd2f006f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.195+0000 7fd2f79cf640 1 -- 172.21.15.19:0/3565392128 >> 172.21.15.19:0/3565392128 conn(0x7fd2f0067d70 msgr2=0x7fd2f006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:42.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.195+0000 7fd2f79cf640 1 -- 172.21.15.19:0/3565392128 shutdown_connections 2024-09-12T02:03:42.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.195+0000 7fd2f79cf640 1 -- 172.21.15.19:0/3565392128 wait complete. 2024-09-12T02:03:42.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.196+0000 7fd2f79cf640 1 Processor -- start 2024-09-12T02:03:42.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.196+0000 7fd2f79cf640 1 -- start start 2024-09-12T02:03:42.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.197+0000 7fd2f79cf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f006fd50 0x7fd2f014e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.197+0000 7fd2f79cf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f0072e80 0x7fd2f00b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.197+0000 7fd2f79cf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2f015ba30 0x7fd2f00b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.197+0000 7fd2f79cf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f00ce810 con 0x7fd2f0072e80 2024-09-12T02:03:42.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.197+0000 7fd2f79cf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f00b3e10 con 0x7fd2f006fd50 2024-09-12T02:03:42.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.197+0000 7fd2f79cf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f00b5890 con 0x7fd2f015ba30 2024-09-12T02:03:42.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.197+0000 7fd2f4f6a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f0072e80 0x7fd2f00b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.197+0000 7fd2f4f6a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f0072e80 0x7fd2f00b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35634/0 (socket says 172.21.15.19:35634) 2024-09-12T02:03:42.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.197+0000 7fd2f4f6a640 1 -- 172.21.15.19:0/2877279977 learned_addr learned my addr 172.21.15.19:0/2877279977 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:42.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.197+0000 7fd2f576b640 1 --2- 172.21.15.19:0/2877279977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f006fd50 0x7fd2f014e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.197+0000 7fd2f5f6c640 1 --2- 172.21.15.19:0/2877279977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2f015ba30 0x7fd2f00b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.197+0000 7fd2f4f6a640 1 -- 172.21.15.19:0/2877279977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2f015ba30 msgr2=0x7fd2f00b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:42.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.198+0000 7fd2f4f6a640 1 --2- 172.21.15.19:0/2877279977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2f015ba30 0x7fd2f00b1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.198+0000 7fd2f4f6a640 1 -- 172.21.15.19:0/2877279977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f006fd50 msgr2=0x7fd2f014e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:42.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.198+0000 7fd2f4f6a640 1 --2- 172.21.15.19:0/2877279977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f006fd50 0x7fd2f014e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.198+0000 7fd2f4f6a640 1 -- 172.21.15.19:0/2877279977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f014cac0 con 0x7fd2f0072e80 2024-09-12T02:03:42.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.198+0000 7fd2f576b640 1 --2- 172.21.15.19:0/2877279977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f006fd50 0x7fd2f014e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:42.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.198+0000 7fd2f4f6a640 1 --2- 172.21.15.19:0/2877279977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f0072e80 0x7fd2f00b1510 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fd2e002a2b0 tx=0x7fd2e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:42.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.198+0000 7fd2e5ffb640 1 -- 172.21.15.19:0/2877279977 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0041020 con 0x7fd2f0072e80 2024-09-12T02:03:42.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.198+0000 7fd2e5ffb640 1 -- 172.21.15.19:0/2877279977 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e00306c0 con 0x7fd2f0072e80 2024-09-12T02:03:42.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.198+0000 7fd2f79cf640 1 -- 172.21.15.19:0/2877279977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f0157bb0 con 0x7fd2f0072e80 2024-09-12T02:03:42.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.198+0000 7fd2e5ffb640 1 -- 172.21.15.19:0/2877279977 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0037040 con 0x7fd2f0072e80 2024-09-12T02:03:42.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.198+0000 7fd2f79cf640 1 -- 172.21.15.19:0/2877279977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f0157e20 con 0x7fd2f0072e80 2024-09-12T02:03:42.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.199+0000 7fd2f79cf640 1 -- 172.21.15.19:0/2877279977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f0149500 con 0x7fd2f0072e80 2024-09-12T02:03:42.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.200+0000 7fd2e5ffb640 1 -- 172.21.15.19:0/2877279977 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2e0044020 con 0x7fd2f0072e80 2024-09-12T02:03:42.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.200+0000 7fd2e5ffb640 1 --2- 172.21.15.19:0/2877279977 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd2d406be30 0x7fd2d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.200+0000 7fd2e5ffb640 1 -- 172.21.15.19:0/2877279977 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7249+0+0 (secure 0 0 0) 0x7fd2e00abc10 con 0x7fd2f0072e80 2024-09-12T02:03:42.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.200+0000 7fd2f576b640 1 --2- 172.21.15.19:0/2877279977 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd2d406be30 0x7fd2d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.201+0000 7fd2f576b640 1 --2- 172.21.15.19:0/2877279977 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd2d406be30 0x7fd2d406e2f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec006fd0 tx=0x7fd2ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:42.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.205+0000 7fd2e5ffb640 1 -- 172.21.15.19:0/2877279977 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2e004b030 con 0x7fd2f0072e80 2024-09-12T02:03:42.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.413+0000 7fd2f79cf640 1 -- 172.21.15.19:0/2877279977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2f0152ae0 con 0x7fd2f0072e80 2024-09-12T02:03:42.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.414+0000 7fd2e5ffb640 1 -- 172.21.15.19:0/2877279977 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 147 v147) ==== 95+0+4392 (secure 0 0 0) 0x7fd2e007a040 con 0x7fd2f0072e80 2024-09-12T02:03:42.413 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:42.413 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":147,"btime":"2024-09-12T02:03:41:731458+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3866905323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3866905323},{"type":"v1","addr":"172.21.15.135:6837","nonce":3866905323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":147,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:41.731398+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:42.414 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 147 2024-09-12T02:03:42.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.416+0000 7fd2f79cf640 1 -- 172.21.15.19:0/2877279977 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd2d406be30 msgr2=0x7fd2d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:42.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.416+0000 7fd2f79cf640 1 --2- 172.21.15.19:0/2877279977 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd2d406be30 0x7fd2d406e2f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec006fd0 tx=0x7fd2ec008040 comp rx=0 tx=0).stop 2024-09-12T02:03:42.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.416+0000 7fd2f79cf640 1 -- 172.21.15.19:0/2877279977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f0072e80 msgr2=0x7fd2f00b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:42.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.416+0000 7fd2f79cf640 1 --2- 172.21.15.19:0/2877279977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f0072e80 0x7fd2f00b1510 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fd2e002a2b0 tx=0x7fd2e00046c0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.416+0000 7fd2f79cf640 1 -- 172.21.15.19:0/2877279977 shutdown_connections 2024-09-12T02:03:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.416+0000 7fd2f79cf640 1 --2- 172.21.15.19:0/2877279977 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd2d406be30 0x7fd2d406e2f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.416+0000 7fd2f79cf640 1 --2- 172.21.15.19:0/2877279977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2f015ba30 0x7fd2f00b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.416+0000 7fd2f79cf640 1 --2- 172.21.15.19:0/2877279977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f0072e80 0x7fd2f00b1510 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.416+0000 7fd2f79cf640 1 --2- 172.21.15.19:0/2877279977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f006fd50 0x7fd2f014e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.416+0000 7fd2f79cf640 1 -- 172.21.15.19:0/2877279977 >> 172.21.15.19:0/2877279977 conn(0x7fd2f0067d70 msgr2=0x7fd2f00720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.416+0000 7fd2f79cf640 1 -- 172.21.15.19:0/2877279977 shutdown_connections 2024-09-12T02:03:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.416+0000 7fd2f79cf640 1 -- 172.21.15.19:0/2877279977 wait complete. 2024-09-12T02:03:42.426 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:03:42.426 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:42.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.529+0000 7f660b4d2640 1 Processor -- start 2024-09-12T02:03:42.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.529+0000 7f660b4d2640 1 -- start start 2024-09-12T02:03:42.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.530+0000 7f660b4d2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6604161a20 0x7f66040d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.530+0000 7f660b4d2640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66040d1830 con 0x7f66040cf330 2024-09-12T02:03:42.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.530+0000 7f660b4d2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66040cf980 con 0x7f66040d1420 2024-09-12T02:03:42.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.530+0000 7f660b4d2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f66040cf760 con 0x7f6604161a20 2024-09-12T02:03:42.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.530+0000 7f6609a6f640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f66040cf330 0x7f660406d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46868/0 (socket says 172.21.15.19:46868) 2024-09-12T02:03:42.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.530+0000 7f6609a6f640 1 -- 172.21.15.19:0/476774636 learned_addr learned my addr 172.21.15.19:0/476774636 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:42.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.530+0000 7f660926e640 1 --2- 172.21.15.19:0/476774636 >> v2:172.21.15.135:3300/0 conn(0x7f6604161a20 0x7f66040d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.530+0000 7f65fbfff640 1 -- 172.21.15.19:0/476774636 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1671128008 0 0) 0x7f65fc001490 con 0x7f66040cf330 2024-09-12T02:03:42.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.530+0000 7f65fbfff640 1 -- 172.21.15.19:0/476774636 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65f0003520 con 0x7f66040cf330 2024-09-12T02:03:42.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f65fbfff640 1 -- 172.21.15.19:0/476774636 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1593762561 0 0) 0x7f65f0003520 con 0x7f66040cf330 2024-09-12T02:03:42.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f65fbfff640 1 -- 172.21.15.19:0/476774636 >> v2:172.21.15.135:3300/0 conn(0x7f6604161a20 msgr2=0x7f66040d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:42.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f65fbfff640 1 --2- 172.21.15.19:0/476774636 >> v2:172.21.15.135:3300/0 conn(0x7f6604161a20 0x7f66040d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f65fbfff640 1 -- 172.21.15.19:0/476774636 >> v1:172.21.15.135:6789/0 conn(0x7f66040d1420 legacy=0x7f66040cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:42.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f65fbfff640 1 -- 172.21.15.19:0/476774636 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660406d050 con 0x7f66040cf330 2024-09-12T02:03:42.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f65fbfff640 1 -- 172.21.15.19:0/476774636 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f65fc001bc0 con 0x7f66040cf330 2024-09-12T02:03:42.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f65fbfff640 1 -- 172.21.15.19:0/476774636 >> v1:172.21.15.19:6789/0 conn(0x7f66040cf330 legacy=0x7f660406d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:42.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f65fbfff640 1 --2- 172.21.15.19:0/476774636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65f00039b0 0x7f65f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f65fbfff640 1 --2- 172.21.15.19:0/476774636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65f0004800 0x7f65f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f65fbfff640 1 --2- 172.21.15.19:0/476774636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65f00051c0 0x7f65f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f65fbfff640 1 -- 172.21.15.19:0/476774636 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f66040cf760 con 0x7f65f00039b0 2024-09-12T02:03:42.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f65fbfff640 1 -- 172.21.15.19:0/476774636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f65f000c060 con 0x7f65f00051c0 2024-09-12T02:03:42.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f65fbfff640 1 -- 172.21.15.19:0/476774636 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f65f000c260 con 0x7f65f0004800 2024-09-12T02:03:42.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f660926e640 1 --2- 172.21.15.19:0/476774636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65f00039b0 0x7f65f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f6609a6f640 1 --2- 172.21.15.19:0/476774636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65f00051c0 0x7f65f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f6608a6d640 1 --2- 172.21.15.19:0/476774636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65f0004800 0x7f65f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f660926e640 1 -- 172.21.15.19:0/476774636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65f0004800 msgr2=0x7f65f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:42.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f660926e640 1 --2- 172.21.15.19:0/476774636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65f0004800 0x7f65f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f660926e640 1 -- 172.21.15.19:0/476774636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65f00051c0 msgr2=0x7f65f000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f660926e640 1 --2- 172.21.15.19:0/476774636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65f00051c0 0x7f65f000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f660926e640 1 -- 172.21.15.19:0/476774636 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f0003520 con 0x7f65f00039b0 2024-09-12T02:03:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.531+0000 7f6609a6f640 1 -- 172.21.15.19:0/476774636 reap_dead start 2024-09-12T02:03:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.532+0000 7f660926e640 1 --2- 172.21.15.19:0/476774636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65f00039b0 0x7f65f0003dd0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f6600009ac0 tx=0x7f65f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8a6c11eb5229c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.532+0000 7f65fbfff640 1 -- 172.21.15.19:0/476774636 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600036070 con 0x7f65f00039b0 2024-09-12T02:03:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.532+0000 7f65fbfff640 1 -- 172.21.15.19:0/476774636 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6600031400 con 0x7f65f00039b0 2024-09-12T02:03:42.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.532+0000 7f65fbfff640 1 -- 172.21.15.19:0/476774636 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600009690 con 0x7f65f00039b0 2024-09-12T02:03:42.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.532+0000 7f660b4d2640 1 -- 172.21.15.19:0/476774636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65f00039b0 msgr2=0x7f65f0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:42.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.532+0000 7f660b4d2640 1 --2- 172.21.15.19:0/476774636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65f00039b0 0x7f65f0003dd0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f6600009ac0 tx=0x7f65f0005830 comp rx=0 tx=0).stop 2024-09-12T02:03:42.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.533+0000 7f660b4d2640 1 -- 172.21.15.19:0/476774636 shutdown_connections 2024-09-12T02:03:42.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.533+0000 7f660b4d2640 1 --2- 172.21.15.19:0/476774636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65f00039b0 0x7f65f0003dd0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.533+0000 7f660b4d2640 1 -- 172.21.15.19:0/476774636 >> 172.21.15.19:0/476774636 conn(0x7f660409d850 msgr2=0x7f660408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:42.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.533+0000 7f660b4d2640 1 -- 172.21.15.19:0/476774636 shutdown_connections 2024-09-12T02:03:42.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.533+0000 7f660b4d2640 1 -- 172.21.15.19:0/476774636 wait complete. 2024-09-12T02:03:42.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.534+0000 7f660b4d2640 1 Processor -- start 2024-09-12T02:03:42.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.534+0000 7f660b4d2640 1 -- start start 2024-09-12T02:03:42.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f660b4d2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65f00039b0 0x7f66041582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f660b4d2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66041f4e20 0x7f66040b5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f660b4d2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66041f5260 0x7f66040b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f660b4d2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f66040cff00 con 0x7f65f00039b0 2024-09-12T02:03:42.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f660b4d2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6604161e00 con 0x7f66041f5260 2024-09-12T02:03:42.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f660b4d2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f660406d2f0 con 0x7f66041f4e20 2024-09-12T02:03:42.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f660926e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65f00039b0 0x7f66041582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f660926e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65f00039b0 0x7f66041582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35652/0 (socket says 172.21.15.19:35652) 2024-09-12T02:03:42.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f660926e640 1 -- 172.21.15.19:0/3540667507 learned_addr learned my addr 172.21.15.19:0/3540667507 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:42.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f6608a6d640 1 --2- 172.21.15.19:0/3540667507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66041f4e20 0x7f66040b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f6609a6f640 1 --2- 172.21.15.19:0/3540667507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66041f5260 0x7f66040b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f660926e640 1 -- 172.21.15.19:0/3540667507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66041f4e20 msgr2=0x7f66040b5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:42.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f660926e640 1 --2- 172.21.15.19:0/3540667507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66041f4e20 0x7f66040b5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f660926e640 1 -- 172.21.15.19:0/3540667507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66041f5260 msgr2=0x7f66040b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:42.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f660926e640 1 --2- 172.21.15.19:0/3540667507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66041f5260 0x7f66040b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f660926e640 1 -- 172.21.15.19:0/3540667507 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66040ccec0 con 0x7f65f00039b0 2024-09-12T02:03:42.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f660926e640 1 --2- 172.21.15.19:0/3540667507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65f00039b0 0x7f66041582b0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f6600034040 tx=0x7f6600004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:42.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f65f9ffb640 1 -- 172.21.15.19:0/3540667507 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660003f020 con 0x7f65f00039b0 2024-09-12T02:03:42.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f65f9ffb640 1 -- 172.21.15.19:0/3540667507 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6600037040 con 0x7f65f00039b0 2024-09-12T02:03:42.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f660b4d2640 1 -- 172.21.15.19:0/3540667507 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66040cbe20 con 0x7f65f00039b0 2024-09-12T02:03:42.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.535+0000 7f65f9ffb640 1 -- 172.21.15.19:0/3540667507 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600036070 con 0x7f65f00039b0 2024-09-12T02:03:42.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.536+0000 7f660b4d2640 1 -- 172.21.15.19:0/3540667507 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66040cc3e0 con 0x7f65f00039b0 2024-09-12T02:03:42.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.536+0000 7f660b4d2640 1 -- 172.21.15.19:0/3540667507 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66040b1040 con 0x7f65f00039b0 2024-09-12T02:03:42.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.537+0000 7f65f9ffb640 1 -- 172.21.15.19:0/3540667507 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6600042020 con 0x7f65f00039b0 2024-09-12T02:03:42.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.537+0000 7f65f9ffb640 1 --2- 172.21.15.19:0/3540667507 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f65e806be60 0x7f65e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.537+0000 7f65f9ffb640 1 -- 172.21.15.19:0/3540667507 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7249+0+0 (secure 0 0 0) 0x7f66000ab4f0 con 0x7f65f00039b0 2024-09-12T02:03:42.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.538+0000 7f6608a6d640 1 --2- 172.21.15.19:0/3540667507 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f65e806be60 0x7f65e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.538+0000 7f6608a6d640 1 --2- 172.21.15.19:0/3540667507 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f65e806be60 0x7f65e806e320 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f65f4007fd0 tx=0x7f65f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:42.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.542+0000 7f65f9ffb640 1 -- 172.21.15.19:0/3540667507 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6600049030 con 0x7f65f00039b0 2024-09-12T02:03:42.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.751+0000 7f660b4d2640 1 -- 172.21.15.19:0/3540667507 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f660406e3e0 con 0x7f65f00039b0 2024-09-12T02:03:42.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.752+0000 7f65f9ffb640 1 -- 172.21.15.19:0/3540667507 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 147 v147) ==== 95+0+4392 (secure 0 0 0) 0x7f66000798b0 con 0x7f65f00039b0 2024-09-12T02:03:42.752 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:42.752 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":147,"btime":"2024-09-12T02:03:41:731458+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3866905323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3866905323},{"type":"v1","addr":"172.21.15.135:6837","nonce":3866905323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":147,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:41.731398+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:42.752 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 147 2024-09-12T02:03:42.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.754+0000 7f660b4d2640 1 -- 172.21.15.19:0/3540667507 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f65e806be60 msgr2=0x7f65e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:42.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.754+0000 7f660b4d2640 1 --2- 172.21.15.19:0/3540667507 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f65e806be60 0x7f65e806e320 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f65f4007fd0 tx=0x7f65f4009040 comp rx=0 tx=0).stop 2024-09-12T02:03:42.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.754+0000 7f660b4d2640 1 -- 172.21.15.19:0/3540667507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65f00039b0 msgr2=0x7f66041582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:42.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.754+0000 7f660b4d2640 1 --2- 172.21.15.19:0/3540667507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65f00039b0 0x7f66041582b0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f6600034040 tx=0x7f6600004730 comp rx=0 tx=0).stop 2024-09-12T02:03:42.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.754+0000 7f660b4d2640 1 -- 172.21.15.19:0/3540667507 shutdown_connections 2024-09-12T02:03:42.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.754+0000 7f660b4d2640 1 --2- 172.21.15.19:0/3540667507 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f65e806be60 0x7f65e806e320 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.754+0000 7f660b4d2640 1 --2- 172.21.15.19:0/3540667507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66041f5260 0x7f66040b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.754+0000 7f660b4d2640 1 --2- 172.21.15.19:0/3540667507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66041f4e20 0x7f66040b5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.754+0000 7f660b4d2640 1 --2- 172.21.15.19:0/3540667507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65f00039b0 0x7f66041582b0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.754+0000 7f660b4d2640 1 -- 172.21.15.19:0/3540667507 >> 172.21.15.19:0/3540667507 conn(0x7f660409d850 msgr2=0x7f660406d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:42.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.754+0000 7f660b4d2640 1 -- 172.21.15.19:0/3540667507 shutdown_connections 2024-09-12T02:03:42.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.754+0000 7f660b4d2640 1 -- 172.21.15.19:0/3540667507 wait complete. 2024-09-12T02:03:42.764 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete mds0_sessionmap' led to DAMAGED state 2024-09-12T02:03:42.764 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 400.00000000' 2024-09-12T02:03:42.765 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:03:42.765 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:03:42.781 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:03:42.781 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:03:42.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:42.781 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:03:42.836 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:03:42.837 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:03:42.837 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:03:42.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.981+0000 7f8d93d33640 1 Processor -- start 2024-09-12T02:03:42.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.981+0000 7f8d93d33640 1 -- start start 2024-09-12T02:03:42.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.982+0000 7f8d93d33640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d8c072d30 0x7f8d8c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.982+0000 7f8d93d33640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8d8c06f700 0x7f8d8c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.982+0000 7f8d93d33640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d8c06fae0 con 0x7f8d8c15b300 2024-09-12T02:03:42.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.982+0000 7f8d93d33640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8d8c0728a0 con 0x7f8d8c072d30 2024-09-12T02:03:42.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.982+0000 7f8d93d33640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f8d8c0cdbe0 con 0x7f8d8c06f700 2024-09-12T02:03:42.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.982+0000 7f8d912ce640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d8c072d30 0x7f8d8c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.982+0000 7f8d912ce640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d8c072d30 0x7f8d8c06f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35660/0 (socket says 172.21.15.19:35660) 2024-09-12T02:03:42.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.982+0000 7f8d912ce640 1 -- 172.21.15.19:0/1035161613 learned_addr learned my addr 172.21.15.19:0/1035161613 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:42.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.982+0000 7f8d922d0640 1 --2- 172.21.15.19:0/1035161613 >> v2:172.21.15.135:3300/0 conn(0x7f8d8c06f700 0x7f8d8c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.982+0000 7f8d912ce640 1 -- 172.21.15.19:0/1035161613 >> v2:172.21.15.135:3300/0 conn(0x7f8d8c06f700 msgr2=0x7f8d8c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:42.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.982+0000 7f8d912ce640 1 --2- 172.21.15.19:0/1035161613 >> v2:172.21.15.135:3300/0 conn(0x7f8d8c06f700 0x7f8d8c15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.982+0000 7f8d912ce640 1 -- 172.21.15.19:0/1035161613 >> v1:172.21.15.135:6789/0 conn(0x7f8d8c15b300 legacy=0x7f8d8c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:42.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.982+0000 7f8d912ce640 1 -- 172.21.15.19:0/1035161613 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8c0cd900 con 0x7f8d8c072d30 2024-09-12T02:03:42.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.982+0000 7f8d922d0640 1 --2- 172.21.15.19:0/1035161613 >> v2:172.21.15.135:3300/0 conn(0x7f8d8c06f700 0x7f8d8c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:42.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.983+0000 7f8d912ce640 1 --2- 172.21.15.19:0/1035161613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d8c072d30 0x7f8d8c06f1c0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0b38f0 tx=0x7f8d7c02c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b5bf0cdb4e4153 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:42.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.983+0000 7f8d90acd640 1 -- 172.21.15.19:0/1035161613 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c032710 con 0x7f8d8c072d30 2024-09-12T02:03:42.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.983+0000 7f8d90acd640 1 -- 172.21.15.19:0/1035161613 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d7c0328b0 con 0x7f8d8c072d30 2024-09-12T02:03:42.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.983+0000 7f8d90acd640 1 -- 172.21.15.19:0/1035161613 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c032ca0 con 0x7f8d8c072d30 2024-09-12T02:03:42.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.984+0000 7f8d93d33640 1 -- 172.21.15.19:0/1035161613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d8c072d30 msgr2=0x7f8d8c06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:42.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.984+0000 7f8d93d33640 1 --2- 172.21.15.19:0/1035161613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d8c072d30 0x7f8d8c06f1c0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0b38f0 tx=0x7f8d7c02c850 comp rx=0 tx=0).stop 2024-09-12T02:03:42.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.984+0000 7f8d93d33640 1 -- 172.21.15.19:0/1035161613 shutdown_connections 2024-09-12T02:03:42.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.984+0000 7f8d93d33640 1 --2- 172.21.15.19:0/1035161613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d8c072d30 0x7f8d8c06f1c0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.984+0000 7f8d93d33640 1 --2- 172.21.15.19:0/1035161613 >> v2:172.21.15.135:3300/0 conn(0x7f8d8c06f700 0x7f8d8c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.984+0000 7f8d93d33640 1 -- 172.21.15.19:0/1035161613 >> 172.21.15.19:0/1035161613 conn(0x7f8d8c067d70 msgr2=0x7f8d8c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:42.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.984+0000 7f8d93d33640 1 -- 172.21.15.19:0/1035161613 shutdown_connections 2024-09-12T02:03:42.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.984+0000 7f8d93d33640 1 -- 172.21.15.19:0/1035161613 wait complete. 2024-09-12T02:03:42.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.985+0000 7f8d93d33640 1 Processor -- start 2024-09-12T02:03:42.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.985+0000 7f8d93d33640 1 -- start start 2024-09-12T02:03:42.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d93d33640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d8c06f700 0x7f8d8c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d93d33640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d8c072d30 0x7f8d8c150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d93d33640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d8c15b300 0x7f8d8c154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d93d33640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c0cd5c0 con 0x7f8d8c15b300 2024-09-12T02:03:42.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d93d33640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c072530 con 0x7f8d8c06f700 2024-09-12T02:03:42.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d93d33640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8d8c0cffe0 con 0x7f8d8c072d30 2024-09-12T02:03:42.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d922d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d8c15b300 0x7f8d8c154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d922d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d8c15b300 0x7f8d8c154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35664/0 (socket says 172.21.15.19:35664) 2024-09-12T02:03:42.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d922d0640 1 -- 172.21.15.19:0/3395522475 learned_addr learned my addr 172.21.15.19:0/3395522475 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:42.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d91acf640 1 --2- 172.21.15.19:0/3395522475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d8c06f700 0x7f8d8c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d912ce640 1 --2- 172.21.15.19:0/3395522475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d8c072d30 0x7f8d8c150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d922d0640 1 -- 172.21.15.19:0/3395522475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d8c072d30 msgr2=0x7f8d8c150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:42.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d922d0640 1 --2- 172.21.15.19:0/3395522475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d8c072d30 0x7f8d8c150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d922d0640 1 -- 172.21.15.19:0/3395522475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d8c06f700 msgr2=0x7f8d8c155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:42.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d922d0640 1 --2- 172.21.15.19:0/3395522475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d8c06f700 0x7f8d8c155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:42.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d922d0640 1 -- 172.21.15.19:0/3395522475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8c154f40 con 0x7f8d8c15b300 2024-09-12T02:03:42.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d91acf640 1 --2- 172.21.15.19:0/3395522475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d8c06f700 0x7f8d8c155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:42.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d912ce640 1 --2- 172.21.15.19:0/3395522475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d8c072d30 0x7f8d8c150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:42.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d922d0640 1 --2- 172.21.15.19:0/3395522475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d8c15b300 0x7f8d8c154210 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f8d8400cd50 tx=0x7f8d8400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:42.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d827fc640 1 -- 172.21.15.19:0/3395522475 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8400f680 con 0x7f8d8c15b300 2024-09-12T02:03:42.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.986+0000 7f8d827fc640 1 -- 172.21.15.19:0/3395522475 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d8400f840 con 0x7f8d8c15b300 2024-09-12T02:03:42.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.987+0000 7f8d93d33640 1 -- 172.21.15.19:0/3395522475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d8c155220 con 0x7f8d8c15b300 2024-09-12T02:03:42.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.987+0000 7f8d827fc640 1 -- 172.21.15.19:0/3395522475 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8400fc30 con 0x7f8d8c15b300 2024-09-12T02:03:42.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.987+0000 7f8d93d33640 1 -- 172.21.15.19:0/3395522475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d8c1557e0 con 0x7f8d8c15b300 2024-09-12T02:03:42.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.987+0000 7f8d93d33640 1 -- 172.21.15.19:0/3395522475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d8c075790 con 0x7f8d8c15b300 2024-09-12T02:03:42.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.988+0000 7f8d827fc640 1 -- 172.21.15.19:0/3395522475 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d840213f0 con 0x7f8d8c15b300 2024-09-12T02:03:42.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.988+0000 7f8d827fc640 1 --2- 172.21.15.19:0/3395522475 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d7006be30 0x7f8d7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:42.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.989+0000 7f8d827fc640 1 -- 172.21.15.19:0/3395522475 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7249+0+0 (secure 0 0 0) 0x7f8d8408c200 con 0x7f8d8c15b300 2024-09-12T02:03:42.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.989+0000 7f8d91acf640 1 --2- 172.21.15.19:0/3395522475 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d7006be30 0x7f8d7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:42.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.989+0000 7f8d91acf640 1 --2- 172.21.15.19:0/3395522475 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d7006be30 0x7f8d7006e2f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c159010 tx=0x7f8d88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:42.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:42.993+0000 7f8d827fc640 1 -- 172.21.15.19:0/3395522475 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d84014030 con 0x7f8d8c15b300 2024-09-12T02:03:43.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.205+0000 7f8d93d33640 1 -- 172.21.15.19:0/3395522475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8d8c15c220 con 0x7f8d8c15b300 2024-09-12T02:03:43.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.755+0000 7f8d827fc640 1 -- 172.21.15.19:0/3395522475 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v148) ==== 161+0+0 (secure 0 0 0) 0x7f8d8405a630 con 0x7f8d8c15b300 2024-09-12T02:03:43.755 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:03:43.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.758+0000 7f8d93d33640 1 -- 172.21.15.19:0/3395522475 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d7006be30 msgr2=0x7f8d7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:43.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.758+0000 7f8d93d33640 1 --2- 172.21.15.19:0/3395522475 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d7006be30 0x7f8d7006e2f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c159010 tx=0x7f8d88009040 comp rx=0 tx=0).stop 2024-09-12T02:03:43.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.758+0000 7f8d93d33640 1 -- 172.21.15.19:0/3395522475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d8c15b300 msgr2=0x7f8d8c154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:43.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.758+0000 7f8d93d33640 1 --2- 172.21.15.19:0/3395522475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d8c15b300 0x7f8d8c154210 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f8d8400cd50 tx=0x7f8d8400a650 comp rx=0 tx=0).stop 2024-09-12T02:03:43.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.758+0000 7f8d93d33640 1 -- 172.21.15.19:0/3395522475 shutdown_connections 2024-09-12T02:03:43.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.758+0000 7f8d93d33640 1 --2- 172.21.15.19:0/3395522475 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d7006be30 0x7f8d7006e2f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:43.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.758+0000 7f8d93d33640 1 --2- 172.21.15.19:0/3395522475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d8c15b300 0x7f8d8c154210 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:43.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.758+0000 7f8d93d33640 1 --2- 172.21.15.19:0/3395522475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d8c072d30 0x7f8d8c150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:43.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.758+0000 7f8d93d33640 1 --2- 172.21.15.19:0/3395522475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d8c06f700 0x7f8d8c155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:43.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.758+0000 7f8d93d33640 1 -- 172.21.15.19:0/3395522475 >> 172.21.15.19:0/3395522475 conn(0x7f8d8c067d70 msgr2=0x7f8d8c0cbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:43.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.758+0000 7f8d93d33640 1 -- 172.21.15.19:0/3395522475 shutdown_connections 2024-09-12T02:03:43.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.758+0000 7f8d93d33640 1 -- 172.21.15.19:0/3395522475 wait complete. 2024-09-12T02:03:43.770 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:03:43.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.878+0000 7f211c5fd640 1 Processor -- start 2024-09-12T02:03:43.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.878+0000 7f211c5fd640 1 -- start start 2024-09-12T02:03:43.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.879+0000 7f211c5fd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f211406f8d0 0x7f2114165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:43.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.879+0000 7f211c5fd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21140cdbe0 con 0x7f2114072d30 2024-09-12T02:03:43.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.879+0000 7f211c5fd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21140cd900 con 0x7f211415b300 2024-09-12T02:03:43.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.879+0000 7f211c5fd640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f21140728a0 con 0x7f211406f8d0 2024-09-12T02:03:43.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.879+0000 7f2119b98640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2114072d30 0x7f211406f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46882/0 (socket says 172.21.15.19:46882) 2024-09-12T02:03:43.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.879+0000 7f2119b98640 1 -- 172.21.15.19:0/3048118292 learned_addr learned my addr 172.21.15.19:0/3048118292 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:43.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119397640 1 -- 172.21.15.19:0/3048118292 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2186090107 0 0) 0x7f21140cdbe0 con 0x7f2114072d30 2024-09-12T02:03:43.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f211ab9a640 1 --2- 172.21.15.19:0/3048118292 >> v2:172.21.15.135:3300/0 conn(0x7f211406f8d0 0x7f2114165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:43.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119397640 1 -- 172.21.15.19:0/3048118292 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20fc003520 con 0x7f2114072d30 2024-09-12T02:03:43.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119397640 1 -- 172.21.15.19:0/3048118292 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4248127478 0 0) 0x7f20fc003520 con 0x7f2114072d30 2024-09-12T02:03:43.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119397640 1 -- 172.21.15.19:0/3048118292 >> v2:172.21.15.135:3300/0 conn(0x7f211406f8d0 msgr2=0x7f2114165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:43.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119397640 1 --2- 172.21.15.19:0/3048118292 >> v2:172.21.15.135:3300/0 conn(0x7f211406f8d0 0x7f2114165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:43.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119397640 1 -- 172.21.15.19:0/3048118292 >> v1:172.21.15.135:6789/0 conn(0x7f211415b300 legacy=0x7f21140cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:43.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119397640 1 -- 172.21.15.19:0/3048118292 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2114072250 con 0x7f2114072d30 2024-09-12T02:03:43.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119397640 1 -- 172.21.15.19:0/3048118292 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f2108001670 con 0x7f2114072d30 2024-09-12T02:03:43.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119397640 1 -- 172.21.15.19:0/3048118292 >> v1:172.21.15.19:6789/0 conn(0x7f2114072d30 legacy=0x7f211406f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:43.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119397640 1 --2- 172.21.15.19:0/3048118292 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20fc0039b0 0x7f20fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:43.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119397640 1 --2- 172.21.15.19:0/3048118292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20fc0043b0 0x7f20fc004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:43.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119397640 1 --2- 172.21.15.19:0/3048118292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20fc005120 0x7f20fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:43.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119397640 1 -- 172.21.15.19:0/3048118292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f21140728a0 con 0x7f20fc0043b0 2024-09-12T02:03:43.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119397640 1 -- 172.21.15.19:0/3048118292 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f20fc00c060 con 0x7f20fc005120 2024-09-12T02:03:43.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119397640 1 -- 172.21.15.19:0/3048118292 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f20fc00c260 con 0x7f20fc0039b0 2024-09-12T02:03:43.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119b98640 1 --2- 172.21.15.19:0/3048118292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20fc0043b0 0x7f20fc004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:43.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f211a399640 1 --2- 172.21.15.19:0/3048118292 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20fc0039b0 0x7f20fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:43.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f211ab9a640 1 --2- 172.21.15.19:0/3048118292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20fc005120 0x7f20fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:43.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119b98640 1 -- 172.21.15.19:0/3048118292 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20fc0039b0 msgr2=0x7f20fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:43.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119b98640 1 --2- 172.21.15.19:0/3048118292 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20fc0039b0 0x7f20fc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:43.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119b98640 1 -- 172.21.15.19:0/3048118292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20fc005120 msgr2=0x7f20fc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:43.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119b98640 1 --2- 172.21.15.19:0/3048118292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20fc005120 0x7f20fc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:43.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f2119b98640 1 -- 172.21.15.19:0/3048118292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20fc003520 con 0x7f20fc0043b0 2024-09-12T02:03:43.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.880+0000 7f211ab9a640 1 -- 172.21.15.19:0/3048118292 reap_dead start 2024-09-12T02:03:43.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.881+0000 7f2119b98640 1 --2- 172.21.15.19:0/3048118292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20fc0043b0 0x7f20fc004880 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f210800c290 tx=0x7f20fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a0a4d59ecb3bda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:43.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.881+0000 7f2119397640 1 -- 172.21.15.19:0/3048118292 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108007d50 con 0x7f20fc0043b0 2024-09-12T02:03:43.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.881+0000 7f2119397640 1 -- 172.21.15.19:0/3048118292 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2108005af0 con 0x7f20fc0043b0 2024-09-12T02:03:43.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.881+0000 7f2119397640 1 -- 172.21.15.19:0/3048118292 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108007070 con 0x7f20fc0043b0 2024-09-12T02:03:43.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.882+0000 7f211c5fd640 1 -- 172.21.15.19:0/3048118292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20fc0043b0 msgr2=0x7f20fc004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:43.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.882+0000 7f211c5fd640 1 --2- 172.21.15.19:0/3048118292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20fc0043b0 0x7f20fc004880 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f210800c290 tx=0x7f20fc005830 comp rx=0 tx=0).stop 2024-09-12T02:03:43.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.882+0000 7f211c5fd640 1 -- 172.21.15.19:0/3048118292 shutdown_connections 2024-09-12T02:03:43.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.882+0000 7f211c5fd640 1 --2- 172.21.15.19:0/3048118292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20fc0043b0 0x7f20fc004880 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:43.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.882+0000 7f211c5fd640 1 -- 172.21.15.19:0/3048118292 >> 172.21.15.19:0/3048118292 conn(0x7f2114067d70 msgr2=0x7f211406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:43.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.882+0000 7f211c5fd640 1 -- 172.21.15.19:0/3048118292 shutdown_connections 2024-09-12T02:03:43.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.882+0000 7f211c5fd640 1 -- 172.21.15.19:0/3048118292 wait complete. 2024-09-12T02:03:43.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.883+0000 7f211c5fd640 1 Processor -- start 2024-09-12T02:03:43.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.883+0000 7f211c5fd640 1 -- start start 2024-09-12T02:03:43.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.884+0000 7f211c5fd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20fc0043b0 0x7f2114169e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:43.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.884+0000 7f211c5fd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21141465b0 0x7f2114145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:43.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.884+0000 7f211c5fd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2114168ab0 0x7f2114168f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:43.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.884+0000 7f211c5fd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f21140d0160 con 0x7f2114168ab0 2024-09-12T02:03:43.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.884+0000 7f211c5fd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f21140cffe0 con 0x7f20fc0043b0 2024-09-12T02:03:43.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.884+0000 7f211c5fd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f21140cceb0 con 0x7f21141465b0 2024-09-12T02:03:43.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.884+0000 7f211ab9a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2114168ab0 0x7f2114168f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:43.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.884+0000 7f211ab9a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2114168ab0 0x7f2114168f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35692/0 (socket says 172.21.15.19:35692) 2024-09-12T02:03:43.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.884+0000 7f211ab9a640 1 -- 172.21.15.19:0/1677516607 learned_addr learned my addr 172.21.15.19:0/1677516607 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:43.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.884+0000 7f211a399640 1 --2- 172.21.15.19:0/1677516607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20fc0043b0 0x7f2114169e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:43.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.884+0000 7f2119b98640 1 --2- 172.21.15.19:0/1677516607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21141465b0 0x7f2114145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:43.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.884+0000 7f211ab9a640 1 -- 172.21.15.19:0/1677516607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21141465b0 msgr2=0x7f2114145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:43.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.884+0000 7f211ab9a640 1 --2- 172.21.15.19:0/1677516607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21141465b0 0x7f2114145cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:43.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.884+0000 7f211ab9a640 1 -- 172.21.15.19:0/1677516607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20fc0043b0 msgr2=0x7f2114169e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:43.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.884+0000 7f211ab9a640 1 --2- 172.21.15.19:0/1677516607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20fc0043b0 0x7f2114169e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:43.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.884+0000 7f211ab9a640 1 -- 172.21.15.19:0/1677516607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2114146210 con 0x7f2114168ab0 2024-09-12T02:03:43.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.885+0000 7f211ab9a640 1 --2- 172.21.15.19:0/1677516607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2114168ab0 0x7f2114168f40 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f211406c910 tx=0x7f2104011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:43.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.885+0000 7f2112ffd640 1 -- 172.21.15.19:0/1677516607 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2104019020 con 0x7f2114168ab0 2024-09-12T02:03:43.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.885+0000 7f2112ffd640 1 -- 172.21.15.19:0/1677516607 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2104004030 con 0x7f2114168ab0 2024-09-12T02:03:43.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.885+0000 7f211c5fd640 1 -- 172.21.15.19:0/1677516607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2114158c10 con 0x7f2114168ab0 2024-09-12T02:03:43.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.885+0000 7f2112ffd640 1 -- 172.21.15.19:0/1677516607 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2104004400 con 0x7f2114168ab0 2024-09-12T02:03:43.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.885+0000 7f211c5fd640 1 -- 172.21.15.19:0/1677516607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21141591d0 con 0x7f2114168ab0 2024-09-12T02:03:43.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.886+0000 7f211c5fd640 1 -- 172.21.15.19:0/1677516607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21140cd240 con 0x7f2114168ab0 2024-09-12T02:03:43.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.886+0000 7f2112ffd640 1 -- 172.21.15.19:0/1677516607 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f210401c020 con 0x7f2114168ab0 2024-09-12T02:03:43.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.887+0000 7f2112ffd640 1 --2- 172.21.15.19:0/1677516607 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f210006be30 0x7f210006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:43.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.887+0000 7f2112ffd640 1 -- 172.21.15.19:0/1677516607 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7249+0+0 (secure 0 0 0) 0x7f210408b850 con 0x7f2114168ab0 2024-09-12T02:03:43.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.887+0000 7f211a399640 1 --2- 172.21.15.19:0/1677516607 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f210006be30 0x7f210006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:43.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.888+0000 7f211a399640 1 --2- 172.21.15.19:0/1677516607 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f210006be30 0x7f210006e2f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f210c003fd0 tx=0x7f210c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:43.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:43.891+0000 7f2112ffd640 1 -- 172.21.15.19:0/1677516607 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2104023020 con 0x7f2114168ab0 2024-09-12T02:03:44.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.137+0000 7f211c5fd640 1 -- 172.21.15.19:0/1677516607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f21141507b0 con 0x7f2114168ab0 2024-09-12T02:03:44.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.768+0000 7f2112ffd640 1 -- 172.21.15.19:0/1677516607 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v149) ==== 101+0+0 (secure 0 0 0) 0x7f2104059be0 con 0x7f2114168ab0 2024-09-12T02:03:44.767 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:03:44.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.771+0000 7f211c5fd640 1 -- 172.21.15.19:0/1677516607 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f210006be30 msgr2=0x7f210006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:44.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.771+0000 7f211c5fd640 1 --2- 172.21.15.19:0/1677516607 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f210006be30 0x7f210006e2f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f210c003fd0 tx=0x7f210c009040 comp rx=0 tx=0).stop 2024-09-12T02:03:44.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.771+0000 7f211c5fd640 1 -- 172.21.15.19:0/1677516607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2114168ab0 msgr2=0x7f2114168f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:44.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.771+0000 7f211c5fd640 1 --2- 172.21.15.19:0/1677516607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2114168ab0 0x7f2114168f40 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f211406c910 tx=0x7f2104011cf0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.771+0000 7f211c5fd640 1 -- 172.21.15.19:0/1677516607 shutdown_connections 2024-09-12T02:03:44.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.771+0000 7f211c5fd640 1 --2- 172.21.15.19:0/1677516607 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f210006be30 0x7f210006e2f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.772+0000 7f211c5fd640 1 --2- 172.21.15.19:0/1677516607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2114168ab0 0x7f2114168f40 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.772+0000 7f211c5fd640 1 --2- 172.21.15.19:0/1677516607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21141465b0 0x7f2114145cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.772+0000 7f211c5fd640 1 --2- 172.21.15.19:0/1677516607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20fc0043b0 0x7f2114169e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.772+0000 7f211c5fd640 1 -- 172.21.15.19:0/1677516607 >> 172.21.15.19:0/1677516607 conn(0x7f2114067d70 msgr2=0x7f21140b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:44.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.772+0000 7f211c5fd640 1 -- 172.21.15.19:0/1677516607 shutdown_connections 2024-09-12T02:03:44.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.772+0000 7f211c5fd640 1 -- 172.21.15.19:0/1677516607 wait complete. 2024-09-12T02:03:44.784 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:03:44.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.831+0000 7f1f836ccf40 1 Processor -- start 2024-09-12T02:03:44.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.831+0000 7f1f836ccf40 1 -- start start 2024-09-12T02:03:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.832+0000 7f1f836ccf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560e8e206350 0x560e8e2daa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.832+0000 7f1f836ccf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e8e234050 0x560e8e232fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.832+0000 7f1f836ccf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e8e2be080 0x560e8e233510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.832+0000 7f1f836ccf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560e8e202ae0 con 0x560e8e2be080 2024-09-12T02:03:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.832+0000 7f1f836ccf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560e8e155510 con 0x560e8e234050 2024-09-12T02:03:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.832+0000 7f1f836ccf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560e8e202dc0 con 0x560e8e206350 2024-09-12T02:03:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.832+0000 7f1f819c3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e8e2be080 0x560e8e233510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.832+0000 7f1f819c3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e8e2be080 0x560e8e233510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35700/0 (socket says 172.21.15.19:35700) 2024-09-12T02:03:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.832+0000 7f1f819c3640 1 -- 172.21.15.19:0/1351686528 learned_addr learned my addr 172.21.15.19:0/1351686528 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.832+0000 7f1f811c2640 1 --2- 172.21.15.19:0/1351686528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560e8e206350 0x560e8e2daa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.832+0000 7f1f809c1640 1 --2- 172.21.15.19:0/1351686528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e8e234050 0x560e8e232fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.832+0000 7f1f819c3640 1 -- 172.21.15.19:0/1351686528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560e8e206350 msgr2=0x560e8e2daa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.832+0000 7f1f819c3640 1 --2- 172.21.15.19:0/1351686528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560e8e206350 0x560e8e2daa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.832+0000 7f1f819c3640 1 -- 172.21.15.19:0/1351686528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e8e234050 msgr2=0x560e8e232fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.832+0000 7f1f819c3640 1 --2- 172.21.15.19:0/1351686528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e8e234050 0x560e8e232fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.832+0000 7f1f819c3640 1 -- 172.21.15.19:0/1351686528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e8e2dd900 con 0x560e8e2be080 2024-09-12T02:03:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.832+0000 7f1f819c3640 1 --2- 172.21.15.19:0/1351686528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e8e2be080 0x560e8e233510 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c009910 tx=0x7f1f7c005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d97eaee8b23ff29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.832+0000 7f1f737fe640 1 -- 172.21.15.19:0/1351686528 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c0089b0 con 0x560e8e2be080 2024-09-12T02:03:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.833+0000 7f1f737fe640 1 -- 172.21.15.19:0/1351686528 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f7c008b50 con 0x560e8e2be080 2024-09-12T02:03:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.833+0000 7f1f737fe640 1 -- 172.21.15.19:0/1351686528 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c013420 con 0x560e8e2be080 2024-09-12T02:03:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.833+0000 7f1f836ccf40 1 -- 172.21.15.19:0/1351686528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e8e2be080 msgr2=0x560e8e233510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.833+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/1351686528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e8e2be080 0x560e8e233510 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c009910 tx=0x7f1f7c005a00 comp rx=0 tx=0).stop 2024-09-12T02:03:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.833+0000 7f1f836ccf40 1 -- 172.21.15.19:0/1351686528 shutdown_connections 2024-09-12T02:03:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.833+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/1351686528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e8e2be080 0x560e8e233510 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.833+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/1351686528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e8e234050 0x560e8e232fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.833+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/1351686528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560e8e206350 0x560e8e2daa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.833+0000 7f1f836ccf40 1 -- 172.21.15.19:0/1351686528 >> 172.21.15.19:0/1351686528 conn(0x560e8e2039e0 msgr2=0x560e8e201e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.833+0000 7f1f836ccf40 1 -- 172.21.15.19:0/1351686528 shutdown_connections 2024-09-12T02:03:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.833+0000 7f1f836ccf40 1 -- 172.21.15.19:0/1351686528 wait complete. 2024-09-12T02:03:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.834+0000 7f1f836ccf40 1 Processor -- start 2024-09-12T02:03:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.834+0000 7f1f836ccf40 1 -- start start 2024-09-12T02:03:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.834+0000 7f1f836ccf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e8e206350 0x560e8e2d2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.834+0000 7f1f836ccf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e8e234050 0x560e8e2329d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.834+0000 7f1f836ccf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560e8e2be080 0x560e8e2dcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.834+0000 7f1f836ccf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560e8e205d90 con 0x560e8e234050 2024-09-12T02:03:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.834+0000 7f1f836ccf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560e8e206070 con 0x560e8e206350 2024-09-12T02:03:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.834+0000 7f1f836ccf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560e8e22fd60 con 0x560e8e2be080 2024-09-12T02:03:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.835+0000 7f1f809c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e8e234050 0x560e8e2329d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.835+0000 7f1f809c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e8e234050 0x560e8e2329d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35714/0 (socket says 172.21.15.19:35714) 2024-09-12T02:03:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.835+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 learned_addr learned my addr 172.21.15.19:0/3522809613 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.835+0000 7f1f811c2640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e8e206350 0x560e8e2d2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.835+0000 7f1f819c3640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560e8e2be080 0x560e8e2dcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.835+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560e8e2be080 msgr2=0x560e8e2dcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.835+0000 7f1f809c1640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560e8e2be080 0x560e8e2dcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.835+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e8e206350 msgr2=0x560e8e2d2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.835+0000 7f1f809c1640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e8e206350 0x560e8e2d2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.835+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e8e2b8960 con 0x560e8e234050 2024-09-12T02:03:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.835+0000 7f1f809c1640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e8e234050 0x560e8e2329d0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800dfd0 tx=0x7f1f7800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.835+0000 7f1f727fc640 1 -- 172.21.15.19:0/3522809613 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7800f650 con 0x560e8e234050 2024-09-12T02:03:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.835+0000 7f1f727fc640 1 -- 172.21.15.19:0/3522809613 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f7800f7f0 con 0x560e8e234050 2024-09-12T02:03:44.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.835+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e8e2bd300 con 0x560e8e234050 2024-09-12T02:03:44.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.835+0000 7f1f727fc640 1 -- 172.21.15.19:0/3522809613 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7800fbc0 con 0x560e8e234050 2024-09-12T02:03:44.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.835+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e8e2d1160 con 0x560e8e234050 2024-09-12T02:03:44.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.837+0000 7f1f727fc640 1 -- 172.21.15.19:0/3522809613 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f78017400 con 0x560e8e234050 2024-09-12T02:03:44.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.837+0000 7f1f727fc640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1f6406a810 0x7f1f6406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:44.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.837+0000 7f1f727fc640 1 -- 172.21.15.19:0/3522809613 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7249+0+0 (secure 0 0 0) 0x7f1f7808a820 con 0x560e8e234050 2024-09-12T02:03:44.839 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:03:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.838+0000 7f1f811c2640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1f6406a810 0x7f1f6406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.838+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560e8e2b9360 0x560e8e374e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.838+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e2d3150 con 0x560e8e2b9360 2024-09-12T02:03:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.838+0000 7f1f819c3640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560e8e2b9360 0x560e8e374e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.838+0000 7f1f819c3640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560e8e2b9360 0x560e8e374e80 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.838+0000 7f1f811c2640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1f6406a810 0x7f1f6406ccd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1f74057000 tx=0x7f1f74007030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.839+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v106'350 uv324 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.839+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e232f10 con 0x560e8e2b9360 2024-09-12T02:03:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.841+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v106'351 uv351 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.841+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e3753c0 con 0x560e8e2b9360 2024-09-12T02:03:44.842 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:03:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.841+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v106'352 uv352 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.842+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e375760 con 0x560e8e2b9360 2024-09-12T02:03:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.843+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v106'353 uv353 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.843+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37f160 con 0x560e8e2b9360 2024-09-12T02:03:44.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.844+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v106'354 uv354 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.844+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37e150 con 0x560e8e2b9360 2024-09-12T02:03:44.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.845+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v106'355 uv355 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.845+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37e540 con 0x560e8e2b9360 2024-09-12T02:03:44.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.846+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v106'356 uv330 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.846+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37e8e0 con 0x560e8e2b9360 2024-09-12T02:03:44.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.847+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v106'357 uv357 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.847+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37e8e0 con 0x560e8e2b9360 2024-09-12T02:03:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.848+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v106'358 uv358 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.848 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:03:44.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.848+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37e8e0 con 0x560e8e2b9360 2024-09-12T02:03:44.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.849+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v106'359 uv359 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.849+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37e8e0 con 0x560e8e2b9360 2024-09-12T02:03:44.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.850+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v106'360 uv360 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.850+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37e8e0 con 0x560e8e2b9360 2024-09-12T02:03:44.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.851+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v106'361 uv361 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.851+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37e8e0 con 0x560e8e2b9360 2024-09-12T02:03:44.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.852+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v106'362 uv337 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.852+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37e8e0 con 0x560e8e2b9360 2024-09-12T02:03:44.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.853+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v106'363 uv363 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.853+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37e8e0 con 0x560e8e2b9360 2024-09-12T02:03:44.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.854+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v106'364 uv364 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.856 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:03:44.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.855+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37e8e0 con 0x560e8e2b9360 2024-09-12T02:03:44.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.855+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v106'365 uv365 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.856+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37e8e0 con 0x560e8e2b9360 2024-09-12T02:03:44.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.856+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v106'366 uv366 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.857+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37e8e0 con 0x560e8e2b9360 2024-09-12T02:03:44.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.858+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v106'367 uv367 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.858+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37ed30 con 0x560e8e2b9360 2024-09-12T02:03:44.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.858+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v106'368 uv368 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.859+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37ecc0 con 0x560e8e2b9360 2024-09-12T02:03:44.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.859+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v106'369 uv343 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.860+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37eb90 con 0x560e8e2b9360 2024-09-12T02:03:44.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.861+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v106'370 uv370 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.861+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37eb90 con 0x560e8e2b9360 2024-09-12T02:03:44.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.862+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v106'371 uv371 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.861 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:03:44.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.862+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37eb90 con 0x560e8e2b9360 2024-09-12T02:03:44.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.863+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v106'372 uv372 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.863+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37eb90 con 0x560e8e2b9360 2024-09-12T02:03:44.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.864+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v106'373 uv373 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.864+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37eb90 con 0x560e8e2b9360 2024-09-12T02:03:44.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.865+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v106'374 uv374 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.865+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37eb90 con 0x560e8e2b9360 2024-09-12T02:03:44.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.866+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v106'375 uv349 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.866+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37eb90 con 0x560e8e2b9360 2024-09-12T02:03:44.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.867+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v106'376 uv376 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.867+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37eb90 con 0x560e8e2b9360 2024-09-12T02:03:44.867 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:03:44.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.868+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v106'377 uv377 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.868+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37eb90 con 0x560e8e2b9360 2024-09-12T02:03:44.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.869+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v106'378 uv378 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.869+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37eb90 con 0x560e8e2b9360 2024-09-12T02:03:44.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.870+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v106'379 uv379 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.870+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37eb90 con 0x560e8e2b9360 2024-09-12T02:03:44.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.871+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v106'380 uv380 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e2b9360 2024-09-12T02:03:44.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.871+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560e8e37fa10 0x560e8e381e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:44.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.871+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e37eb90 con 0x560e8e37fa10 2024-09-12T02:03:44.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.871+0000 7f1f811c2640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560e8e37fa10 0x560e8e381e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:44.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.871+0000 7f1f811c2640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560e8e37fa10 0x560e8e381e00 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:44.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.873+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v106'263 uv246 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.873+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e382340 con 0x560e8e37fa10 2024-09-12T02:03:44.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.874+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v106'264 uv264 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.874+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e3826e0 con 0x560e8e37fa10 2024-09-12T02:03:44.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.875+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v106'265 uv265 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.875 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:03:44.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.875+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e382f30 con 0x560e8e37fa10 2024-09-12T02:03:44.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.877+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v106'266 uv266 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.877+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e3832d0 con 0x560e8e37fa10 2024-09-12T02:03:44.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.878+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v106'267 uv267 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.878+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e383670 con 0x560e8e37fa10 2024-09-12T02:03:44.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.879+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v106'268 uv251 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.879+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e383a10 con 0x560e8e37fa10 2024-09-12T02:03:44.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.881+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v106'269 uv269 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.881+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e383a10 con 0x560e8e37fa10 2024-09-12T02:03:44.881 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:03:44.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.882+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v106'270 uv270 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.882+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e383a10 con 0x560e8e37fa10 2024-09-12T02:03:44.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.883+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v106'271 uv271 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.883+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e383a10 con 0x560e8e37fa10 2024-09-12T02:03:44.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.884+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v106'272 uv272 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.885+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e383a10 con 0x560e8e37fa10 2024-09-12T02:03:44.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.886+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v106'273 uv256 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.886+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e383a10 con 0x560e8e37fa10 2024-09-12T02:03:44.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.887+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v106'274 uv274 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.887+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e383a10 con 0x560e8e37fa10 2024-09-12T02:03:44.887 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:03:44.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.888+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v106'275 uv275 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.888+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e387e90 con 0x560e8e37fa10 2024-09-12T02:03:44.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.890+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v106'276 uv276 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.890+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e387e90 con 0x560e8e37fa10 2024-09-12T02:03:44.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.891+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v106'277 uv277 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.891+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e383a10 con 0x560e8e37fa10 2024-09-12T02:03:44.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.892+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v106'278 uv262 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.892+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e383a10 con 0x560e8e37fa10 2024-09-12T02:03:44.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.893+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v106'279 uv279 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.893+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e383a10 con 0x560e8e37fa10 2024-09-12T02:03:44.893 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:03:44.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.894+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v106'280 uv280 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.894+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e384a20 con 0x560e8e37fa10 2024-09-12T02:03:44.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.895+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v106'281 uv281 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.895+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e384a20 con 0x560e8e37fa10 2024-09-12T02:03:44.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.896+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v106'282 uv282 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.896+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e383a10 con 0x560e8e37fa10 2024-09-12T02:03:44.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.897+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v106'283 uv283 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e37fa10 2024-09-12T02:03:44.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.897+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560e8e384090 0x560e8e386480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:44.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.897+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e386a90 con 0x560e8e384090 2024-09-12T02:03:44.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.898+0000 7f1f809c1640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560e8e384090 0x560e8e386480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:44.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.898+0000 7f1f809c1640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560e8e384090 0x560e8e386480 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:44.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.899+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v106'69 uv68 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.899+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e386f80 con 0x560e8e384090 2024-09-12T02:03:44.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.900+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v106'70 uv70 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.900+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e387460 con 0x560e8e384090 2024-09-12T02:03:44.900 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:03:44.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.901+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v106'71 uv71 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.901+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e388d10 con 0x560e8e384090 2024-09-12T02:03:44.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.903+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v106'72 uv72 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.903+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e3890b0 con 0x560e8e384090 2024-09-12T02:03:44.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.904+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v106'73 uv73 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.904+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e387d00 con 0x560e8e384090 2024-09-12T02:03:44.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.905+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v106'74 uv74 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.905+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560e8e388600 0x560e8e38b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:44.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.905+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38b9a0 con 0x560e8e388600 2024-09-12T02:03:44.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.905+0000 7f1f819c3640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560e8e388600 0x560e8e38b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:44.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.905+0000 7f1f819c3640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560e8e388600 0x560e8e38b460 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:44.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.907+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v106'54 uv53 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.907+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38b9a0 con 0x560e8e388600 2024-09-12T02:03:44.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.908+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v106'55 uv55 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.908+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38bd90 con 0x560e8e388600 2024-09-12T02:03:44.908 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:03:44.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.909+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v106'56 uv56 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.909+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38bd90 con 0x560e8e388600 2024-09-12T02:03:44.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.915+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v106'57 uv57 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.915+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560e8e38c410 0x560e8e38e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:44.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.915+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38ed40 con 0x560e8e38c410 2024-09-12T02:03:44.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.915+0000 7f1f811c2640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560e8e38c410 0x560e8e38e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:44.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.916+0000 7f1f811c2640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560e8e38c410 0x560e8e38e800 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:44.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.917+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v106'69 uv68 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.917+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38edc0 con 0x560e8e38c410 2024-09-12T02:03:44.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.918+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v106'70 uv70 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.918+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e38c410 2024-09-12T02:03:44.919 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:03:44.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.920+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v106'71 uv71 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.920+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e3901f0 con 0x560e8e38c410 2024-09-12T02:03:44.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.923+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v106'72 uv72 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.923+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e3901f0 con 0x560e8e38c410 2024-09-12T02:03:44.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.924+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v106'73 uv73 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.924+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e38c410 2024-09-12T02:03:44.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.927+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v106'74 uv74 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.927+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e388600 2024-09-12T02:03:44.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.929+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v106'127 uv121 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.929+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e388600 2024-09-12T02:03:44.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.930+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v106'128 uv128 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.930+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e388600 2024-09-12T02:03:44.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.931+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v106'129 uv129 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.930 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:03:44.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.931+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e3901f0 con 0x560e8e388600 2024-09-12T02:03:44.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.932+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v106'130 uv130 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.932+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e3901f0 con 0x560e8e388600 2024-09-12T02:03:44.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.933+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v106'131 uv131 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.933+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e388600 2024-09-12T02:03:44.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.934+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v106'132 uv132 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.934+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e388600 2024-09-12T02:03:44.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.935+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v106'133 uv126 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.935+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e388600 2024-09-12T02:03:44.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.936+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v106'134 uv134 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.936+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e388600 2024-09-12T02:03:44.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.937+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v106'135 uv135 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.936 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:03:44.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.937+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e388600 2024-09-12T02:03:44.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.938+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v106'136 uv136 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.938+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e388600 2024-09-12T02:03:44.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.939+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v106'137 uv137 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.939+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e388600 2024-09-12T02:03:44.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.940+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v106'56 uv55 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.940+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e388600 2024-09-12T02:03:44.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.941+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v106'57 uv57 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.941+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e388600 2024-09-12T02:03:44.942 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:03:44.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.942+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v106'58 uv58 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.942+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e388600 2024-09-12T02:03:44.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.943+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v106'59 uv59 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.943+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e388600 2024-09-12T02:03:44.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.944+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v106'60 uv60 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f1f7c0087b0 con 0x560e8e388600 2024-09-12T02:03:44.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.944+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e38c410 2024-09-12T02:03:44.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.945+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v106'69 uv68 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.945+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e38c410 2024-09-12T02:03:44.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.946+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v106'70 uv70 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.946+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e38c410 2024-09-12T02:03:44.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.947+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v106'71 uv71 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.947 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:03:44.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.947+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e3901f0 con 0x560e8e38c410 2024-09-12T02:03:44.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.948+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v106'72 uv72 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.948+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e3901f0 con 0x560e8e38c410 2024-09-12T02:03:44.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.949+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v106'73 uv73 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.949+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e38c410 2024-09-12T02:03:44.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.950+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v106'74 uv74 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.950+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e38c410 2024-09-12T02:03:44.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.951+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v106'112 uv108 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.951+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e38c410 2024-09-12T02:03:44.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.952+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v106'113 uv113 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.952+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f1e0 con 0x560e8e38c410 2024-09-12T02:03:44.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.953+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v106'114 uv114 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.953 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:03:44.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.953+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f2a0 con 0x560e8e38c410 2024-09-12T02:03:44.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.954+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v106'115 uv115 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.954+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f2a0 con 0x560e8e38c410 2024-09-12T02:03:44.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.955+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v106'116 uv116 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.955+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f2a0 con 0x560e8e38c410 2024-09-12T02:03:44.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.956+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v106'117 uv111 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.956+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f2a0 con 0x560e8e38c410 2024-09-12T02:03:44.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.957+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v106'118 uv118 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.957+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f280 con 0x560e8e38c410 2024-09-12T02:03:44.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.958+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v106'119 uv119 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.958 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:03:44.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.958+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38f6b0 con 0x560e8e38c410 2024-09-12T02:03:44.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.959+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v106'120 uv120 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.959+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e38fac0 con 0x560e8e38c410 2024-09-12T02:03:44.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.960+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v106'121 uv121 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.960+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560e8e390150 0x560e8e3925e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:44.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.960+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e390150 2024-09-12T02:03:44.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.960+0000 7f1f809c1640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560e8e390150 0x560e8e3925e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:44.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.961+0000 7f1f809c1640 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560e8e390150 0x560e8e3925e0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:44.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.962+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v106'54 uv54 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e390150 2024-09-12T02:03:44.961 INFO:teuthology.orchestra.run.smithi019.stdout:Write #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:03:44.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.962+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e390150 2024-09-12T02:03:44.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.963+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v106'55 uv55 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e390150 2024-09-12T02:03:44.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.963+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:103 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e38c410 2024-09-12T02:03:44.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.964+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(103 609.00000000 [create] v106'69 uv68 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.964+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:104 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e38c410 2024-09-12T02:03:44.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.965+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(104 609.00000000 [delete] v106'70 uv70 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.966+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e38c410 2024-09-12T02:03:44.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.966+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(105 609.00000000 [create] v106'71 uv71 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.966 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:03:44.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.967+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e393b30 con 0x560e8e38c410 2024-09-12T02:03:44.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.968+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v106'72 uv72 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.968+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e393b30 con 0x560e8e38c410 2024-09-12T02:03:44.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.969+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v106'73 uv73 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.969+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e38c410 2024-09-12T02:03:44.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.970+0000 7f1f811c2640 1 -- 172.21.15.19:0/3522809613 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(108 609.00000000 [omap-set-header] v106'74 uv74 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f7404e040 con 0x560e8e38c410 2024-09-12T02:03:44.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.970+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:109 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e384090 2024-09-12T02:03:44.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.971+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(109 400.00000000 [create] v106'57 uv56 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.971+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:110 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e384090 2024-09-12T02:03:44.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.972+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(110 400.00000000 [delete] v106'58 uv58 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.972+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e384090 2024-09-12T02:03:44.972 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:03:44.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.973+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(111 400.00000000 [create] v106'59 uv59 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.973+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e384090 2024-09-12T02:03:44.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.974+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(112 400.00000000 [write 0~22] v106'60 uv60 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.974+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e384090 2024-09-12T02:03:44.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.976+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(113 400.00000000 [omap-set-header] v106'61 uv61 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.976+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e384090 2024-09-12T02:03:44.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.977+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(114 100.00000000.inode [create] v106'144 uv136 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.977+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e384090 2024-09-12T02:03:44.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.978+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(115 100.00000000.inode [delete] v106'145 uv145 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.978+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e384090 2024-09-12T02:03:44.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.979+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(116 100.00000000.inode [create] v106'146 uv146 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.978 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:03:44.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.979+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e384090 2024-09-12T02:03:44.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.980+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v106'147 uv147 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.980+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e384090 2024-09-12T02:03:44.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.981+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v106'148 uv148 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.981+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e384090 2024-09-12T02:03:44.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.982+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(119 1.00000000 [create] v106'149 uv143 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.982+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e384090 2024-09-12T02:03:44.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.983+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(120 1.00000000 [delete] v106'150 uv150 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.983+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e384090 2024-09-12T02:03:44.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.984+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(121 1.00000000 [create] v106'151 uv151 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.984 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:03:44.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.984+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e393b30 con 0x560e8e384090 2024-09-12T02:03:44.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.985+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v106'152 uv152 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.985+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e393b30 con 0x560e8e384090 2024-09-12T02:03:44.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.986+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v106'153 uv153 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.986+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392b20 con 0x560e8e384090 2024-09-12T02:03:44.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.987+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(124 1.00000000 [omap-set-header] v106'154 uv154 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.987+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x560e8e392fd0 con 0x560e8e384090 2024-09-12T02:03:44.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.988+0000 7f1f809c1640 1 -- 172.21.15.19:0/3522809613 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v106'155 uv155 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f1f78054c70 con 0x560e8e384090 2024-09-12T02:03:44.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.988+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560e8e37fa10 msgr2=0x560e8e381e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:44.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.988+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560e8e37fa10 0x560e8e381e00 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.988+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560e8e2b9360 msgr2=0x560e8e374e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:44.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.988+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560e8e2b9360 0x560e8e374e80 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.988+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560e8e388600 msgr2=0x560e8e38b460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:44.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.988+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560e8e388600 0x560e8e38b460 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.988+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560e8e390150 msgr2=0x560e8e3925e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:44.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.988+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560e8e390150 0x560e8e3925e0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.988+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560e8e384090 msgr2=0x560e8e386480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:44.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.988+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560e8e384090 0x560e8e386480 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.988+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560e8e38c410 msgr2=0x560e8e38e800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:44.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.988+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560e8e38c410 0x560e8e38e800 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.988+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 reap_dead start 2024-09-12T02:03:44.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.988+0000 7f1f819c3640 1 -- 172.21.15.19:0/3522809613 reap_dead start 2024-09-12T02:03:44.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.988+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1f6406a810 msgr2=0x7f1f6406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:44.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.988+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1f6406a810 0x7f1f6406ccd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1f74057000 tx=0x7f1f74007030 comp rx=0 tx=0).stop 2024-09-12T02:03:44.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.989+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e8e234050 msgr2=0x560e8e2329d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:44.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.989+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e8e234050 0x560e8e2329d0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800dfd0 tx=0x7f1f7800b6c0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.989+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 shutdown_connections 2024-09-12T02:03:44.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.989+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1f6406a810 0x7f1f6406ccd0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.989+0000 7f1f836ccf40 1 --2- 172.21.15.19:0/3522809613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e8e234050 0x560e8e2329d0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:44.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.989+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 >> 172.21.15.19:0/3522809613 conn(0x560e8e2039e0 msgr2=0x560e8e2dde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:44.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.989+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 shutdown_connections 2024-09-12T02:03:44.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:44.989+0000 7f1f836ccf40 1 -- 172.21.15.19:0/3522809613 wait complete. 2024-09-12T02:03:44.991 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 400.00000000 2024-09-12T02:03:45.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.075+0000 7f59671d1f40 1 Processor -- start 2024-09-12T02:03:45.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.075+0000 7f59671d1f40 1 -- start start 2024-09-12T02:03:45.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.076+0000 7f59671d1f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c2f0009640 0x55c2f008c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:45.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.076+0000 7f59671d1f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2f0095d20 0x55c2f00975b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:45.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.076+0000 7f59671d1f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f0096100 0x55c2f0098130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:45.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.076+0000 7f59671d1f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c2f000a6b0 con 0x55c2f0095d20 2024-09-12T02:03:45.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.076+0000 7f59671d1f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c2eff12510 con 0x55c2f0096100 2024-09-12T02:03:45.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.076+0000 7f59671d1f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55c2effc52d0 con 0x55c2f0009640 2024-09-12T02:03:45.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.076+0000 7f595ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2f0095d20 0x55c2f00975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:45.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.076+0000 7f595ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2f0095d20 0x55c2f00975b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35718/0 (socket says 172.21.15.19:35718) 2024-09-12T02:03:45.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.076+0000 7f595ffff640 1 -- 172.21.15.19:0/677667338 learned_addr learned my addr 172.21.15.19:0/677667338 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:45.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.076+0000 7f5964cc7640 1 --2- 172.21.15.19:0/677667338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c2f0009640 0x55c2f008c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:45.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.076+0000 7f59654c8640 1 --2- 172.21.15.19:0/677667338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f0096100 0x55c2f0098130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:45.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.077+0000 7f595ffff640 1 -- 172.21.15.19:0/677667338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c2f0009640 msgr2=0x55c2f008c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:45.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.077+0000 7f595ffff640 1 --2- 172.21.15.19:0/677667338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c2f0009640 0x55c2f008c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.077+0000 7f595ffff640 1 -- 172.21.15.19:0/677667338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f0096100 msgr2=0x55c2f0098130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:45.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.077+0000 7f595ffff640 1 --2- 172.21.15.19:0/677667338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f0096100 0x55c2f0098130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.077+0000 7f595ffff640 1 -- 172.21.15.19:0/677667338 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2f0099530 con 0x55c2f0095d20 2024-09-12T02:03:45.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.077+0000 7f595ffff640 1 --2- 172.21.15.19:0/677667338 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2f0095d20 0x55c2f00975b0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f5950002de0 tx=0x7f595000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6455fb1d005c1c8c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:45.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.077+0000 7f595effd640 1 -- 172.21.15.19:0/677667338 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595000f400 con 0x55c2f0095d20 2024-09-12T02:03:45.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.077+0000 7f595effd640 1 -- 172.21.15.19:0/677667338 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5950014070 con 0x55c2f0095d20 2024-09-12T02:03:45.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.077+0000 7f595effd640 1 -- 172.21.15.19:0/677667338 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595000f7e0 con 0x55c2f0095d20 2024-09-12T02:03:45.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.077+0000 7f59671d1f40 1 -- 172.21.15.19:0/677667338 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2f0095d20 msgr2=0x55c2f00975b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:45.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.077+0000 7f59671d1f40 1 --2- 172.21.15.19:0/677667338 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2f0095d20 0x55c2f00975b0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f5950002de0 tx=0x7f595000b5b0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.077+0000 7f59671d1f40 1 -- 172.21.15.19:0/677667338 shutdown_connections 2024-09-12T02:03:45.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.077+0000 7f59671d1f40 1 --2- 172.21.15.19:0/677667338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f0096100 0x55c2f0098130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.077+0000 7f59671d1f40 1 --2- 172.21.15.19:0/677667338 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2f0095d20 0x55c2f00975b0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.077+0000 7f59671d1f40 1 --2- 172.21.15.19:0/677667338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c2f0009640 0x55c2f008c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.078+0000 7f59671d1f40 1 -- 172.21.15.19:0/677667338 >> 172.21.15.19:0/677667338 conn(0x55c2effee490 msgr2=0x55c2effee870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:45.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.078+0000 7f59671d1f40 1 -- 172.21.15.19:0/677667338 shutdown_connections 2024-09-12T02:03:45.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.078+0000 7f59671d1f40 1 -- 172.21.15.19:0/677667338 wait complete. 2024-09-12T02:03:45.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.078+0000 7f59671d1f40 1 Processor -- start 2024-09-12T02:03:45.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.078+0000 7f59671d1f40 1 -- start start 2024-09-12T02:03:45.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.079+0000 7f59671d1f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f0009640 0x55c2f0089680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:45.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.079+0000 7f59671d1f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2f0095d20 0x55c2f008a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:45.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.079+0000 7f59671d1f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c2f0096100 0x55c2f0081b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:45.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.079+0000 7f59671d1f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c2effebf30 con 0x55c2f0095d20 2024-09-12T02:03:45.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.079+0000 7f59671d1f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c2f0099250 con 0x55c2f0009640 2024-09-12T02:03:45.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.079+0000 7f59671d1f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55c2f0096630 con 0x55c2f0096100 2024-09-12T02:03:45.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.079+0000 7f595ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2f0095d20 0x55c2f008a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:45.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.079+0000 7f595ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2f0095d20 0x55c2f008a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35724/0 (socket says 172.21.15.19:35724) 2024-09-12T02:03:45.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.079+0000 7f595ffff640 1 -- 172.21.15.19:0/760456830 learned_addr learned my addr 172.21.15.19:0/760456830 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:45.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.079+0000 7f5964cc7640 1 --2- 172.21.15.19:0/760456830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f0009640 0x55c2f0089680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:45.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.079+0000 7f59654c8640 1 --2- 172.21.15.19:0/760456830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c2f0096100 0x55c2f0081b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:45.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.079+0000 7f595ffff640 1 -- 172.21.15.19:0/760456830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c2f0096100 msgr2=0x55c2f0081b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:45.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.079+0000 7f595ffff640 1 --2- 172.21.15.19:0/760456830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c2f0096100 0x55c2f0081b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.079+0000 7f595ffff640 1 -- 172.21.15.19:0/760456830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f0009640 msgr2=0x55c2f0089680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:45.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.079+0000 7f595ffff640 1 --2- 172.21.15.19:0/760456830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f0009640 0x55c2f0089680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.079+0000 7f595ffff640 1 -- 172.21.15.19:0/760456830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2effc2990 con 0x55c2f0095d20 2024-09-12T02:03:45.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.079+0000 7f595ffff640 1 --2- 172.21.15.19:0/760456830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2f0095d20 0x55c2f008a920 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f5950010000 tx=0x7f5950001fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:45.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.080+0000 7f595dffb640 1 -- 172.21.15.19:0/760456830 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950002600 con 0x55c2f0095d20 2024-09-12T02:03:45.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.080+0000 7f595dffb640 1 -- 172.21.15.19:0/760456830 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f595001bd30 con 0x55c2f0095d20 2024-09-12T02:03:45.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.080+0000 7f595dffb640 1 -- 172.21.15.19:0/760456830 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59500196c0 con 0x55c2f0095d20 2024-09-12T02:03:45.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.080+0000 7f59671d1f40 1 -- 172.21.15.19:0/760456830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2effc18f0 con 0x55c2f0095d20 2024-09-12T02:03:45.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.080+0000 7f59671d1f40 1 -- 172.21.15.19:0/760456830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2effc1eb0 con 0x55c2f0095d20 2024-09-12T02:03:45.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.081+0000 7f595dffb640 1 -- 172.21.15.19:0/760456830 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f595000e070 con 0x55c2f0095d20 2024-09-12T02:03:45.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.081+0000 7f595dffb640 1 --2- 172.21.15.19:0/760456830 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f594806a9b0 0x7f594806ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:45.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.082+0000 7f595dffb640 1 -- 172.21.15.19:0/760456830 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7249+0+0 (secure 0 0 0) 0x7f595008ba80 con 0x55c2f0095d20 2024-09-12T02:03:45.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.082+0000 7f5964cc7640 1 --2- 172.21.15.19:0/760456830 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f594806a9b0 0x7f594806ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:45.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.082+0000 7f59671d1f40 1 --2- 172.21.15.19:0/760456830 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c2f008ae60 0x55c2effefdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:45.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.082+0000 7f59671d1f40 1 -- 172.21.15.19:0/760456830 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x55c2effc13f0 con 0x55c2f008ae60 2024-09-12T02:03:45.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.082+0000 7f59654c8640 1 --2- 172.21.15.19:0/760456830 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c2f008ae60 0x55c2effefdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:45.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.082+0000 7f5964cc7640 1 --2- 172.21.15.19:0/760456830 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f594806a9b0 0x7f594806ce70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5958057000 tx=0x7f5958052000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:45.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.082+0000 7f59654c8640 1 --2- 172.21.15.19:0/760456830 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c2f008ae60 0x55c2effefdd0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:45.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.083+0000 7f59654c8640 1 -- 172.21.15.19:0/760456830 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 400.00000000 [delete] v106'62 uv62 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f596000ca30 con 0x55c2f008ae60 2024-09-12T02:03:45.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.083+0000 7f59671d1f40 1 -- 172.21.15.19:0/760456830 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c2f008ae60 msgr2=0x55c2effefdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:45.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.083+0000 7f59671d1f40 1 --2- 172.21.15.19:0/760456830 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c2f008ae60 0x55c2effefdd0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.083+0000 7f59671d1f40 1 -- 172.21.15.19:0/760456830 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f594806a9b0 msgr2=0x7f594806ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:45.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.083+0000 7f59671d1f40 1 --2- 172.21.15.19:0/760456830 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f594806a9b0 0x7f594806ce70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5958057000 tx=0x7f5958052000 comp rx=0 tx=0).stop 2024-09-12T02:03:45.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.083+0000 7f59671d1f40 1 -- 172.21.15.19:0/760456830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2f0095d20 msgr2=0x55c2f008a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:45.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.083+0000 7f59671d1f40 1 --2- 172.21.15.19:0/760456830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2f0095d20 0x55c2f008a920 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f5950010000 tx=0x7f5950001fe0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.083+0000 7f59654c8640 1 -- 172.21.15.19:0/760456830 reap_dead start 2024-09-12T02:03:45.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.084+0000 7f59671d1f40 1 -- 172.21.15.19:0/760456830 shutdown_connections 2024-09-12T02:03:45.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.084+0000 7f59671d1f40 1 -- 172.21.15.19:0/760456830 >> 172.21.15.19:0/760456830 conn(0x55c2effee490 msgr2=0x55c2effee870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:45.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.084+0000 7f59671d1f40 1 -- 172.21.15.19:0/760456830 shutdown_connections 2024-09-12T02:03:45.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.084+0000 7f59671d1f40 1 -- 172.21.15.19:0/760456830 wait complete. 2024-09-12T02:03:45.090 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:03:45.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.235+0000 7f8d3a1cf640 1 Processor -- start 2024-09-12T02:03:45.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.235+0000 7f8d3a1cf640 1 -- start start 2024-09-12T02:03:45.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.236+0000 7f8d3a1cf640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8d34162e30 0x7f8d3406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:45.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.236+0000 7f8d3a1cf640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d3415ff70 con 0x7f8d34162340 2024-09-12T02:03:45.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.236+0000 7f8d3a1cf640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d340d4d10 con 0x7f8d340cf280 2024-09-12T02:03:45.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.236+0000 7f8d3a1cf640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f8d3406de90 con 0x7f8d34162e30 2024-09-12T02:03:45.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.236+0000 7f8d337fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8d34162340 0x7f8d34162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46896/0 (socket says 172.21.15.19:46896) 2024-09-12T02:03:45.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.236+0000 7f8d337fe640 1 -- 172.21.15.19:0/2541600471 learned_addr learned my addr 172.21.15.19:0/2541600471 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:45.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.236+0000 7f8d327fc640 1 -- 172.21.15.19:0/2541600471 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1696426478 0 0) 0x7f8d3415ff70 con 0x7f8d34162340 2024-09-12T02:03:45.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.236+0000 7f8d327fc640 1 -- 172.21.15.19:0/2541600471 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d1c003520 con 0x7f8d34162340 2024-09-12T02:03:45.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.236+0000 7f8d32ffd640 1 --2- 172.21.15.19:0/2541600471 >> v2:172.21.15.135:3300/0 conn(0x7f8d34162e30 0x7f8d3406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:45.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d327fc640 1 -- 172.21.15.19:0/2541600471 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2065001497 0 0) 0x7f8d1c003520 con 0x7f8d34162340 2024-09-12T02:03:45.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d327fc640 1 -- 172.21.15.19:0/2541600471 >> v2:172.21.15.135:3300/0 conn(0x7f8d34162e30 msgr2=0x7f8d3406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:45.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d327fc640 1 --2- 172.21.15.19:0/2541600471 >> v2:172.21.15.135:3300/0 conn(0x7f8d34162e30 0x7f8d3406d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d327fc640 1 -- 172.21.15.19:0/2541600471 >> v1:172.21.15.135:6789/0 conn(0x7f8d340cf280 legacy=0x7f8d340d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:45.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d327fc640 1 -- 172.21.15.19:0/2541600471 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d340d4ff0 con 0x7f8d34162340 2024-09-12T02:03:45.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d327fc640 1 -- 172.21.15.19:0/2541600471 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f8d24001670 con 0x7f8d34162340 2024-09-12T02:03:45.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d327fc640 1 -- 172.21.15.19:0/2541600471 >> v1:172.21.15.19:6789/0 conn(0x7f8d34162340 legacy=0x7f8d34162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:45.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d327fc640 1 --2- 172.21.15.19:0/2541600471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d1c0039b0 0x7f8d1c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:45.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d327fc640 1 --2- 172.21.15.19:0/2541600471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d1c004800 0x7f8d1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:45.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d327fc640 1 --2- 172.21.15.19:0/2541600471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d1c0051c0 0x7f8d1c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:45.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d327fc640 1 -- 172.21.15.19:0/2541600471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3406de90 con 0x7f8d1c0039b0 2024-09-12T02:03:45.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d327fc640 1 -- 172.21.15.19:0/2541600471 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c00c160 con 0x7f8d1c0051c0 2024-09-12T02:03:45.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d327fc640 1 -- 172.21.15.19:0/2541600471 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8d1c00c360 con 0x7f8d1c004800 2024-09-12T02:03:45.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d337fe640 1 --2- 172.21.15.19:0/2541600471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d1c0039b0 0x7f8d1c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:45.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d32ffd640 1 --2- 172.21.15.19:0/2541600471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d1c004800 0x7f8d1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:45.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d33fff640 1 --2- 172.21.15.19:0/2541600471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d1c0051c0 0x7f8d1c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:45.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d337fe640 1 -- 172.21.15.19:0/2541600471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d1c004800 msgr2=0x7f8d1c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:45.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d337fe640 1 --2- 172.21.15.19:0/2541600471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d1c004800 0x7f8d1c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d337fe640 1 -- 172.21.15.19:0/2541600471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d1c0051c0 msgr2=0x7f8d1c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:45.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d337fe640 1 --2- 172.21.15.19:0/2541600471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d1c0051c0 0x7f8d1c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d337fe640 1 -- 172.21.15.19:0/2541600471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d1c003520 con 0x7f8d1c0039b0 2024-09-12T02:03:45.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d33fff640 1 --2- 172.21.15.19:0/2541600471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d1c0051c0 0x7f8d1c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:45.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.237+0000 7f8d33fff640 1 -- 172.21.15.19:0/2541600471 reap_dead start 2024-09-12T02:03:45.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.238+0000 7f8d337fe640 1 --2- 172.21.15.19:0/2541600471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d1c0039b0 0x7f8d1c003dd0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400c210 tx=0x7f8d1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b10a4a7b74ea44 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:45.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.238+0000 7f8d327fc640 1 -- 172.21.15.19:0/2541600471 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d24007d30 con 0x7f8d1c0039b0 2024-09-12T02:03:45.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.238+0000 7f8d327fc640 1 -- 172.21.15.19:0/2541600471 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d24005ad0 con 0x7f8d1c0039b0 2024-09-12T02:03:45.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.238+0000 7f8d327fc640 1 -- 172.21.15.19:0/2541600471 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d24007070 con 0x7f8d1c0039b0 2024-09-12T02:03:45.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.239+0000 7f8d3a1cf640 1 -- 172.21.15.19:0/2541600471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d1c0039b0 msgr2=0x7f8d1c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:45.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.239+0000 7f8d3a1cf640 1 --2- 172.21.15.19:0/2541600471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d1c0039b0 0x7f8d1c003dd0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400c210 tx=0x7f8d1c005830 comp rx=0 tx=0).stop 2024-09-12T02:03:45.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.239+0000 7f8d3a1cf640 1 -- 172.21.15.19:0/2541600471 shutdown_connections 2024-09-12T02:03:45.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.239+0000 7f8d3a1cf640 1 --2- 172.21.15.19:0/2541600471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d1c0039b0 0x7f8d1c003dd0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.239+0000 7f8d3a1cf640 1 -- 172.21.15.19:0/2541600471 >> 172.21.15.19:0/2541600471 conn(0x7f8d3408bfc0 msgr2=0x7f8d340d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:45.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.239+0000 7f8d3a1cf640 1 -- 172.21.15.19:0/2541600471 shutdown_connections 2024-09-12T02:03:45.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.239+0000 7f8d3a1cf640 1 -- 172.21.15.19:0/2541600471 wait complete. 2024-09-12T02:03:45.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.240+0000 7f8d3a1cf640 1 Processor -- start 2024-09-12T02:03:45.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.240+0000 7f8d3a1cf640 1 -- start start 2024-09-12T02:03:45.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.241+0000 7f8d3a1cf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d1c0039b0 0x7f8d34156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:45.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.241+0000 7f8d3a1cf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d34156cb0 0x7f8d340b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:45.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.241+0000 7f8d3a1cf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d340cb5a0 0x7f8d341611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:45.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.241+0000 7f8d3a1cf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8d340cf6f0 con 0x7f8d340cb5a0 2024-09-12T02:03:45.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.241+0000 7f8d3a1cf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8d34163270 con 0x7f8d34156cb0 2024-09-12T02:03:45.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.241+0000 7f8d3a1cf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8d340d52d0 con 0x7f8d1c0039b0 2024-09-12T02:03:45.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.241+0000 7f8d33fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d340cb5a0 0x7f8d341611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:45.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.241+0000 7f8d33fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d340cb5a0 0x7f8d341611b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35744/0 (socket says 172.21.15.19:35744) 2024-09-12T02:03:45.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.241+0000 7f8d33fff640 1 -- 172.21.15.19:0/1007909993 learned_addr learned my addr 172.21.15.19:0/1007909993 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:45.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.241+0000 7f8d32ffd640 1 --2- 172.21.15.19:0/1007909993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d34156cb0 0x7f8d340b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:45.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.241+0000 7f8d337fe640 1 --2- 172.21.15.19:0/1007909993 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d1c0039b0 0x7f8d34156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:45.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.241+0000 7f8d33fff640 1 -- 172.21.15.19:0/1007909993 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d1c0039b0 msgr2=0x7f8d34156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:45.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.241+0000 7f8d33fff640 1 --2- 172.21.15.19:0/1007909993 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d1c0039b0 0x7f8d34156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.241+0000 7f8d33fff640 1 -- 172.21.15.19:0/1007909993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d34156cb0 msgr2=0x7f8d340b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:45.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.241+0000 7f8d33fff640 1 --2- 172.21.15.19:0/1007909993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d34156cb0 0x7f8d340b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.241+0000 7f8d33fff640 1 -- 172.21.15.19:0/1007909993 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d340cbea0 con 0x7f8d340cb5a0 2024-09-12T02:03:45.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.241+0000 7f8d32ffd640 1 --2- 172.21.15.19:0/1007909993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d34156cb0 0x7f8d340b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:03:45.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.241+0000 7f8d33fff640 1 --2- 172.21.15.19:0/1007909993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d340cb5a0 0x7f8d341611b0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f8d3406e060 tx=0x7f8d2c00ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:45.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.242+0000 7f8d1bfff640 1 -- 172.21.15.19:0/1007909993 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c019070 con 0x7f8d340cb5a0 2024-09-12T02:03:45.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.242+0000 7f8d1bfff640 1 -- 172.21.15.19:0/1007909993 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d2c003b80 con 0x7f8d340cb5a0 2024-09-12T02:03:45.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.242+0000 7f8d1bfff640 1 -- 172.21.15.19:0/1007909993 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c0050d0 con 0x7f8d340cb5a0 2024-09-12T02:03:45.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.242+0000 7f8d3a1cf640 1 -- 172.21.15.19:0/1007909993 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d340cc180 con 0x7f8d340cb5a0 2024-09-12T02:03:45.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.242+0000 7f8d3a1cf640 1 -- 172.21.15.19:0/1007909993 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d340cc740 con 0x7f8d340cb5a0 2024-09-12T02:03:45.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.243+0000 7f8d3a1cf640 1 -- 172.21.15.19:0/1007909993 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d3406d740 con 0x7f8d340cb5a0 2024-09-12T02:03:45.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.243+0000 7f8d1bfff640 1 -- 172.21.15.19:0/1007909993 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d2c01c070 con 0x7f8d340cb5a0 2024-09-12T02:03:45.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.244+0000 7f8d1bfff640 1 --2- 172.21.15.19:0/1007909993 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d2006be30 0x7f8d2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:45.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.244+0000 7f8d1bfff640 1 -- 172.21.15.19:0/1007909993 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7249+0+0 (secure 0 0 0) 0x7f8d2c08a960 con 0x7f8d340cb5a0 2024-09-12T02:03:45.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.244+0000 7f8d337fe640 1 --2- 172.21.15.19:0/1007909993 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d2006be30 0x7f8d2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:45.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.244+0000 7f8d337fe640 1 --2- 172.21.15.19:0/1007909993 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d2006be30 0x7f8d2006e2f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8d24033000 tx=0x7f8d2402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:45.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.248+0000 7f8d1bfff640 1 -- 172.21.15.19:0/1007909993 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d2c0586a0 con 0x7f8d340cb5a0 2024-09-12T02:03:45.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.460+0000 7f8d3a1cf640 1 -- 172.21.15.19:0/1007909993 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f8d3408e640 con 0x7f8d340cb5a0 2024-09-12T02:03:45.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.774+0000 7f8d1bfff640 1 -- 172.21.15.19:0/1007909993 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v150) ==== 162+0+0 (secure 0 0 0) 0x7f8d2c05c9a0 con 0x7f8d340cb5a0 2024-09-12T02:03:45.774 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:03:45.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.777+0000 7f8d3a1cf640 1 -- 172.21.15.19:0/1007909993 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d2006be30 msgr2=0x7f8d2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:45.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.777+0000 7f8d3a1cf640 1 --2- 172.21.15.19:0/1007909993 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d2006be30 0x7f8d2006e2f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8d24033000 tx=0x7f8d2402e000 comp rx=0 tx=0).stop 2024-09-12T02:03:45.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.777+0000 7f8d3a1cf640 1 -- 172.21.15.19:0/1007909993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d340cb5a0 msgr2=0x7f8d341611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:45.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.777+0000 7f8d3a1cf640 1 --2- 172.21.15.19:0/1007909993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d340cb5a0 0x7f8d341611b0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f8d3406e060 tx=0x7f8d2c00ead0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.777+0000 7f8d3a1cf640 1 -- 172.21.15.19:0/1007909993 shutdown_connections 2024-09-12T02:03:45.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.777+0000 7f8d3a1cf640 1 --2- 172.21.15.19:0/1007909993 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d2006be30 0x7f8d2006e2f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.777+0000 7f8d3a1cf640 1 --2- 172.21.15.19:0/1007909993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d340cb5a0 0x7f8d341611b0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.777+0000 7f8d3a1cf640 1 --2- 172.21.15.19:0/1007909993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d34156cb0 0x7f8d340b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.777+0000 7f8d3a1cf640 1 --2- 172.21.15.19:0/1007909993 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d1c0039b0 0x7f8d34156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.777+0000 7f8d3a1cf640 1 -- 172.21.15.19:0/1007909993 >> 172.21.15.19:0/1007909993 conn(0x7f8d3408bfc0 msgr2=0x7f8d3406e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:45.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.778+0000 7f8d3a1cf640 1 -- 172.21.15.19:0/1007909993 shutdown_connections 2024-09-12T02:03:45.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:45.778+0000 7f8d3a1cf640 1 -- 172.21.15.19:0/1007909993 wait complete. 2024-09-12T02:03:46.193 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:46.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.308+0000 7fbf8e2dd640 1 Processor -- start 2024-09-12T02:03:46.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.308+0000 7fbf8e2dd640 1 -- start start 2024-09-12T02:03:46.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.309+0000 7fbf8e2dd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf88147360 0x7fbf88070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:46.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.309+0000 7fbf8e2dd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbf88070dd0 0x7fbf880d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:46.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.309+0000 7fbf8e2dd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbf880d09e0 0x7fbf8806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:46.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.309+0000 7fbf8e2dd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fbf8806cb30 con 0x7fbf880d09e0 2024-09-12T02:03:46.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.309+0000 7fbf8e2dd640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fbf880d0e30 con 0x7fbf88070dd0 2024-09-12T02:03:46.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.309+0000 7fbf8e2dd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbf8806bfb0 con 0x7fbf88147360 2024-09-12T02:03:46.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.309+0000 7fbf8c87a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbf880d09e0 0x7fbf8806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:46.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.309+0000 7fbf8c87a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbf880d09e0 0x7fbf8806f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35758/0 (socket says 172.21.15.19:35758) 2024-09-12T02:03:46.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.309+0000 7fbf8c87a640 1 -- 172.21.15.19:0/3081753765 learned_addr learned my addr 172.21.15.19:0/3081753765 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:46.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.309+0000 7fbf877fe640 1 --2- 172.21.15.19:0/3081753765 >> v2:172.21.15.135:3300/0 conn(0x7fbf88070dd0 0x7fbf880d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:46.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.309+0000 7fbf87fff640 1 --2- 172.21.15.19:0/3081753765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf88147360 0x7fbf88070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:46.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.309+0000 7fbf8c87a640 1 -- 172.21.15.19:0/3081753765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf88147360 msgr2=0x7fbf88070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:46.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.309+0000 7fbf8c87a640 1 --2- 172.21.15.19:0/3081753765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf88147360 0x7fbf88070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:46.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.309+0000 7fbf8c87a640 1 -- 172.21.15.19:0/3081753765 >> v2:172.21.15.135:3300/0 conn(0x7fbf88070dd0 msgr2=0x7fbf880d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:46.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.309+0000 7fbf8c87a640 1 --2- 172.21.15.19:0/3081753765 >> v2:172.21.15.135:3300/0 conn(0x7fbf88070dd0 0x7fbf880d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:46.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.309+0000 7fbf8c87a640 1 -- 172.21.15.19:0/3081753765 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf8806c290 con 0x7fbf880d09e0 2024-09-12T02:03:46.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.310+0000 7fbf8c87a640 1 --2- 172.21.15.19:0/3081753765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf880d09e0 0x7fbf8806f060 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fbf880ced90 tx=0x7fbf8002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec4470ad51a9f2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:46.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.310+0000 7fbf86ffd640 1 -- 172.21.15.19:0/3081753765 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80036070 con 0x7fbf880d09e0 2024-09-12T02:03:46.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.310+0000 7fbf86ffd640 1 -- 172.21.15.19:0/3081753765 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf80031600 con 0x7fbf880d09e0 2024-09-12T02:03:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.310+0000 7fbf86ffd640 1 -- 172.21.15.19:0/3081753765 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf800319d0 con 0x7fbf880d09e0 2024-09-12T02:03:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.311+0000 7fbf8e2dd640 1 -- 172.21.15.19:0/3081753765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf880d09e0 msgr2=0x7fbf8806f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.311+0000 7fbf8e2dd640 1 --2- 172.21.15.19:0/3081753765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf880d09e0 0x7fbf8806f060 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fbf880ced90 tx=0x7fbf8002a610 comp rx=0 tx=0).stop 2024-09-12T02:03:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.311+0000 7fbf8e2dd640 1 -- 172.21.15.19:0/3081753765 shutdown_connections 2024-09-12T02:03:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.311+0000 7fbf8e2dd640 1 --2- 172.21.15.19:0/3081753765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf880d09e0 0x7fbf8806f060 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.311+0000 7fbf8e2dd640 1 --2- 172.21.15.19:0/3081753765 >> v2:172.21.15.135:3300/0 conn(0x7fbf88070dd0 0x7fbf880d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.311+0000 7fbf8e2dd640 1 --2- 172.21.15.19:0/3081753765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf88147360 0x7fbf88070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.311+0000 7fbf8e2dd640 1 -- 172.21.15.19:0/3081753765 >> 172.21.15.19:0/3081753765 conn(0x7fbf880b2f40 msgr2=0x7fbf880b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.311+0000 7fbf8e2dd640 1 -- 172.21.15.19:0/3081753765 shutdown_connections 2024-09-12T02:03:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.311+0000 7fbf8e2dd640 1 -- 172.21.15.19:0/3081753765 wait complete. 2024-09-12T02:03:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.312+0000 7fbf8e2dd640 1 Processor -- start 2024-09-12T02:03:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.312+0000 7fbf8e2dd640 1 -- start start 2024-09-12T02:03:46.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.313+0000 7fbf8e2dd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf88070dd0 0x7fbf88158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:46.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.313+0000 7fbf8e2dd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf880d09e0 0x7fbf88141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:46.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.313+0000 7fbf8e2dd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf88147360 0x7fbf881461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:46.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.313+0000 7fbf8e2dd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8806bc10 con 0x7fbf880d09e0 2024-09-12T02:03:46.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.313+0000 7fbf8e2dd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8806c850 con 0x7fbf88070dd0 2024-09-12T02:03:46.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.313+0000 7fbf8e2dd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbf8806bd90 con 0x7fbf88147360 2024-09-12T02:03:46.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.313+0000 7fbf877fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf880d09e0 0x7fbf88141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:46.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.313+0000 7fbf877fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf880d09e0 0x7fbf88141340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35764/0 (socket says 172.21.15.19:35764) 2024-09-12T02:03:46.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.313+0000 7fbf877fe640 1 -- 172.21.15.19:0/562137668 learned_addr learned my addr 172.21.15.19:0/562137668 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:46.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.313+0000 7fbf87fff640 1 --2- 172.21.15.19:0/562137668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf88070dd0 0x7fbf88158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:46.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.313+0000 7fbf8c87a640 1 --2- 172.21.15.19:0/562137668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf88147360 0x7fbf881461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:46.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.313+0000 7fbf877fe640 1 -- 172.21.15.19:0/562137668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf88147360 msgr2=0x7fbf881461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:46.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.313+0000 7fbf877fe640 1 --2- 172.21.15.19:0/562137668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf88147360 0x7fbf881461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:46.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.313+0000 7fbf877fe640 1 -- 172.21.15.19:0/562137668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf88070dd0 msgr2=0x7fbf88158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:46.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.313+0000 7fbf877fe640 1 --2- 172.21.15.19:0/562137668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf88070dd0 0x7fbf88158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:46.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.313+0000 7fbf877fe640 1 -- 172.21.15.19:0/562137668 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf8815bde0 con 0x7fbf880d09e0 2024-09-12T02:03:46.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.314+0000 7fbf877fe640 1 --2- 172.21.15.19:0/562137668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf880d09e0 0x7fbf88141340 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00d620 tx=0x7fbf7c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:46.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.314+0000 7fbf84ff9640 1 -- 172.21.15.19:0/562137668 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c004240 con 0x7fbf880d09e0 2024-09-12T02:03:46.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.314+0000 7fbf84ff9640 1 -- 172.21.15.19:0/562137668 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf7c0043e0 con 0x7fbf880d09e0 2024-09-12T02:03:46.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.314+0000 7fbf84ff9640 1 -- 172.21.15.19:0/562137668 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c003610 con 0x7fbf880d09e0 2024-09-12T02:03:46.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.314+0000 7fbf8e2dd640 1 -- 172.21.15.19:0/562137668 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf8815b540 con 0x7fbf880d09e0 2024-09-12T02:03:46.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.314+0000 7fbf8e2dd640 1 -- 172.21.15.19:0/562137668 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf8815bb00 con 0x7fbf880d09e0 2024-09-12T02:03:46.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.315+0000 7fbf8e2dd640 1 -- 172.21.15.19:0/562137668 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf880d04a0 con 0x7fbf880d09e0 2024-09-12T02:03:46.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.315+0000 7fbf84ff9640 1 -- 172.21.15.19:0/562137668 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf7c01b020 con 0x7fbf880d09e0 2024-09-12T02:03:46.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.316+0000 7fbf84ff9640 1 --2- 172.21.15.19:0/562137668 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf7406be30 0x7fbf7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:46.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.316+0000 7fbf84ff9640 1 -- 172.21.15.19:0/562137668 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7249+0+0 (secure 0 0 0) 0x7fbf7c08b050 con 0x7fbf880d09e0 2024-09-12T02:03:46.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.316+0000 7fbf87fff640 1 --2- 172.21.15.19:0/562137668 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf7406be30 0x7fbf7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:46.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.317+0000 7fbf87fff640 1 --2- 172.21.15.19:0/562137668 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf7406be30 0x7fbf7406e2f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fbf78006fd0 tx=0x7fbf78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:46.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.320+0000 7fbf84ff9640 1 -- 172.21.15.19:0/562137668 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbf7c058da0 con 0x7fbf880d09e0 2024-09-12T02:03:46.481 INFO:tasks.ceph.mds.c.smithi019.stderr: -46> 2024-09-12T02:03:41.730+0000 7fcf2f590640 -1 mds.0.sessionmap _load_finish got (2) No such file or directory 2024-09-12T02:03:46.481 INFO:tasks.ceph.mds.c.smithi019.stderr: -45> 2024-09-12T02:03:41.730+0000 7fcf2f590640 -1 log_channel(cluster) log [ERR] : error reading sessionmap 'mds0_sessionmap' -2 ((2) No such file or directory) 2024-09-12T02:03:46.505 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:03:46.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.533+0000 7fbf8e2dd640 1 -- 172.21.15.19:0/562137668 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf880b2110 con 0x7fbf880d09e0 2024-09-12T02:03:46.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.534+0000 7fbf84ff9640 1 -- 172.21.15.19:0/562137668 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) ==== 95+0+4401 (secure 0 0 0) 0x7fbf7c05d0a0 con 0x7fbf880d09e0 2024-09-12T02:03:46.534 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:46.534 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":151,"btime":"2024-09-12T02:03:45:777280+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":151,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:45.777263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7453":{"gid":7453,"name":"d","rank":0,"incarnation":151,"state":"up:replay","state_seq":1,"addr":"172.21.15.135:6837/3866905323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3866905323},{"type":"v1","addr":"172.21.15.135:6837","nonce":3866905323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:46.534 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 151 2024-09-12T02:03:46.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.536+0000 7fbf8e2dd640 1 -- 172.21.15.19:0/562137668 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf7406be30 msgr2=0x7fbf7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:46.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.536+0000 7fbf8e2dd640 1 --2- 172.21.15.19:0/562137668 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf7406be30 0x7fbf7406e2f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fbf78006fd0 tx=0x7fbf78008040 comp rx=0 tx=0).stop 2024-09-12T02:03:46.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.536+0000 7fbf8e2dd640 1 -- 172.21.15.19:0/562137668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf880d09e0 msgr2=0x7fbf88141340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:46.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.536+0000 7fbf8e2dd640 1 --2- 172.21.15.19:0/562137668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf880d09e0 0x7fbf88141340 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00d620 tx=0x7fbf7c00dae0 comp rx=0 tx=0).stop 2024-09-12T02:03:46.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.536+0000 7fbf8e2dd640 1 -- 172.21.15.19:0/562137668 shutdown_connections 2024-09-12T02:03:46.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.536+0000 7fbf8e2dd640 1 --2- 172.21.15.19:0/562137668 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf7406be30 0x7fbf7406e2f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:46.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.536+0000 7fbf8e2dd640 1 --2- 172.21.15.19:0/562137668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf88147360 0x7fbf881461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:46.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.536+0000 7fbf8e2dd640 1 --2- 172.21.15.19:0/562137668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf880d09e0 0x7fbf88141340 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:46.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.536+0000 7fbf8e2dd640 1 --2- 172.21.15.19:0/562137668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf88070dd0 0x7fbf88158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:46.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.536+0000 7fbf8e2dd640 1 -- 172.21.15.19:0/562137668 >> 172.21.15.19:0/562137668 conn(0x7fbf880b2f40 msgr2=0x7fbf88142d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:46.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.536+0000 7fbf8e2dd640 1 -- 172.21.15.19:0/562137668 shutdown_connections 2024-09-12T02:03:46.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:46.536+0000 7fbf8e2dd640 1 -- 172.21.15.19:0/562137668 wait complete. 2024-09-12T02:03:46.546 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 151, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:03:45.777263+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 106, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7453}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7453': {'gid': 7453, 'name': 'd', 'rank': 0, 'incarnation': 151, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.135:6837/3866905323', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 3866905323}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 3866905323}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:03:46.547 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7453:up:replay 2024-09-12T02:03:46.547 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-12T02:03:51.952 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:52.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.067+0000 7f8c87cc9640 1 Processor -- start 2024-09-12T02:03:52.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.068+0000 7f8c87cc9640 1 -- start start 2024-09-12T02:03:52.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.069+0000 7f8c87cc9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8c80072d30 0x7f8c8006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.069+0000 7f8c87cc9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c8006f700 0x7f8c8015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.069+0000 7f8c87cc9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c8006fae0 con 0x7f8c8015b300 2024-09-12T02:03:52.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.069+0000 7f8c87cc9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8c800728a0 con 0x7f8c8006f700 2024-09-12T02:03:52.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.069+0000 7f8c87cc9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f8c800cdbe0 con 0x7f8c80072d30 2024-09-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.069+0000 7f8c86266640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c8006f700 0x7f8c8015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.069+0000 7f8c86266640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c8006f700 0x7f8c8015b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49808/0 (socket says 172.21.15.19:49808) 2024-09-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.069+0000 7f8c86266640 1 -- 172.21.15.19:0/1785231067 learned_addr learned my addr 172.21.15.19:0/1785231067 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.069+0000 7f8c85a65640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8c8015b300 0x7f8c800cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36344/0 (socket says 172.21.15.19:36344) 2024-09-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.069+0000 7f8c85264640 1 --2- 172.21.15.19:0/1785231067 >> v2:172.21.15.135:3300/0 conn(0x7f8c80072d30 0x7f8c8006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.069+0000 7f8c86266640 1 -- 172.21.15.19:0/1785231067 >> v2:172.21.15.135:3300/0 conn(0x7f8c80072d30 msgr2=0x7f8c8006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.069+0000 7f8c86266640 1 --2- 172.21.15.19:0/1785231067 >> v2:172.21.15.135:3300/0 conn(0x7f8c80072d30 0x7f8c8006f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.069+0000 7f8c86266640 1 -- 172.21.15.19:0/1785231067 >> v1:172.21.15.19:6789/0 conn(0x7f8c8015b300 legacy=0x7f8c800cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.069+0000 7f8c86266640 1 -- 172.21.15.19:0/1785231067 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c800cd900 con 0x7f8c8006f700 2024-09-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.070+0000 7f8c86266640 1 --2- 172.21.15.19:0/1785231067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c8006f700 0x7f8c8015b6e0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f8c800b57c0 tx=0x7f8c7002c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e07c37407980e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.070+0000 7f8c84a63640 1 -- 172.21.15.19:0/1785231067 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7000b2d0 con 0x7f8c8006f700 2024-09-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.070+0000 7f8c84a63640 1 -- 172.21.15.19:0/1785231067 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7000b470 con 0x7f8c8006f700 2024-09-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.070+0000 7f8c84a63640 1 -- 172.21.15.19:0/1785231067 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c70009820 con 0x7f8c8006f700 2024-09-12T02:03:52.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.071+0000 7f8c87cc9640 1 -- 172.21.15.19:0/1785231067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c8006f700 msgr2=0x7f8c8015b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.071+0000 7f8c87cc9640 1 --2- 172.21.15.19:0/1785231067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c8006f700 0x7f8c8015b6e0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f8c800b57c0 tx=0x7f8c7002c8b0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.071+0000 7f8c87cc9640 1 -- 172.21.15.19:0/1785231067 shutdown_connections 2024-09-12T02:03:52.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.071+0000 7f8c87cc9640 1 --2- 172.21.15.19:0/1785231067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c8006f700 0x7f8c8015b6e0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.071+0000 7f8c87cc9640 1 --2- 172.21.15.19:0/1785231067 >> v2:172.21.15.135:3300/0 conn(0x7f8c80072d30 0x7f8c8006f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.071+0000 7f8c87cc9640 1 -- 172.21.15.19:0/1785231067 >> 172.21.15.19:0/1785231067 conn(0x7f8c80067d70 msgr2=0x7f8c8006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:52.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.071+0000 7f8c87cc9640 1 -- 172.21.15.19:0/1785231067 shutdown_connections 2024-09-12T02:03:52.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.071+0000 7f8c87cc9640 1 -- 172.21.15.19:0/1785231067 wait complete. 2024-09-12T02:03:52.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.072+0000 7f8c87cc9640 1 Processor -- start 2024-09-12T02:03:52.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.072+0000 7f8c87cc9640 1 -- start start 2024-09-12T02:03:52.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c87cc9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c8006f700 0x7f8c800c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c87cc9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c80072d30 0x7f8c801530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c87cc9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c8015b300 0x7f8c80156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c87cc9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8c800cd5c0 con 0x7f8c8006f700 2024-09-12T02:03:52.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c87cc9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8c80072530 con 0x7f8c80072d30 2024-09-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c87cc9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8c800cffe0 con 0x7f8c8015b300 2024-09-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c85a65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c8006f700 0x7f8c800c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c85a65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c8006f700 0x7f8c800c6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49816/0 (socket says 172.21.15.19:49816) 2024-09-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c85a65640 1 -- 172.21.15.19:0/2135980535 learned_addr learned my addr 172.21.15.19:0/2135980535 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c85264640 1 --2- 172.21.15.19:0/2135980535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c80072d30 0x7f8c801530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c86266640 1 --2- 172.21.15.19:0/2135980535 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c8015b300 0x7f8c80156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c85a65640 1 -- 172.21.15.19:0/2135980535 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c8015b300 msgr2=0x7f8c80156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c85a65640 1 --2- 172.21.15.19:0/2135980535 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c8015b300 0x7f8c80156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c85a65640 1 -- 172.21.15.19:0/2135980535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c80072d30 msgr2=0x7f8c801530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c85a65640 1 --2- 172.21.15.19:0/2135980535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c80072d30 0x7f8c801530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c85a65640 1 -- 172.21.15.19:0/2135980535 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c80154fb0 con 0x7f8c8006f700 2024-09-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c86266640 1 --2- 172.21.15.19:0/2135980535 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c8015b300 0x7f8c80156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c85a65640 1 --2- 172.21.15.19:0/2135980535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c8006f700 0x7f8c800c6940 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800c400 tx=0x7f8c7800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:52.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.073+0000 7f8c7e7fc640 1 -- 172.21.15.19:0/2135980535 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c780074e0 con 0x7f8c8006f700 2024-09-12T02:03:52.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.074+0000 7f8c7e7fc640 1 -- 172.21.15.19:0/2135980535 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c78007680 con 0x7f8c8006f700 2024-09-12T02:03:52.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.074+0000 7f8c7e7fc640 1 -- 172.21.15.19:0/2135980535 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c78004a00 con 0x7f8c8006f700 2024-09-12T02:03:52.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.074+0000 7f8c87cc9640 1 -- 172.21.15.19:0/2135980535 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c800c5e60 con 0x7f8c8006f700 2024-09-12T02:03:52.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.074+0000 7f8c87cc9640 1 -- 172.21.15.19:0/2135980535 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c800c6420 con 0x7f8c8006f700 2024-09-12T02:03:52.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.075+0000 7f8c87cc9640 1 -- 172.21.15.19:0/2135980535 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c8015c470 con 0x7f8c8006f700 2024-09-12T02:03:52.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.075+0000 7f8c7e7fc640 1 -- 172.21.15.19:0/2135980535 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c7801a020 con 0x7f8c8006f700 2024-09-12T02:03:52.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.076+0000 7f8c7e7fc640 1 --2- 172.21.15.19:0/2135980535 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c6c06be30 0x7f8c6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.076+0000 7f8c7e7fc640 1 -- 172.21.15.19:0/2135980535 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7249+0+0 (secure 0 0 0) 0x7f8c7808ac40 con 0x7f8c8006f700 2024-09-12T02:03:52.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.076+0000 7f8c85264640 1 --2- 172.21.15.19:0/2135980535 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c6c06be30 0x7f8c6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.077+0000 7f8c85264640 1 --2- 172.21.15.19:0/2135980535 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c6c06be30 0x7f8c6c06e2f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8c801ee030 tx=0x7f8c74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:52.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.080+0000 7f8c7e7fc640 1 -- 172.21.15.19:0/2135980535 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8c78059070 con 0x7f8c8006f700 2024-09-12T02:03:52.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.289+0000 7f8c87cc9640 1 -- 172.21.15.19:0/2135980535 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c8015c190 con 0x7f8c8006f700 2024-09-12T02:03:52.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.290+0000 7f8c7e7fc640 1 -- 172.21.15.19:0/2135980535 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 154 v154) ==== 95+0+5234 (secure 0 0 0) 0x7f8c78058970 con 0x7f8c8006f700 2024-09-12T02:03:52.290 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:52.291 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":154,"btime":"2024-09-12T02:03:48:785883+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8412,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/1800650480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1800650480},{"type":"v1","addr":"172.21.15.19:6834","nonce":1800650480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152}],"filesystems":[{"mdsmap":{"epoch":154,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:48.785875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7453":{"gid":7453,"name":"d","rank":0,"incarnation":151,"state":"up:active","state_seq":7,"addr":"172.21.15.135:6837/3866905323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3866905323},{"type":"v1","addr":"172.21.15.135:6837","nonce":3866905323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7453,"qdb_cluster":[7453]},"id":6}]} 2024-09-12T02:03:52.291 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 154 2024-09-12T02:03:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.292+0000 7f8c87cc9640 1 -- 172.21.15.19:0/2135980535 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c6c06be30 msgr2=0x7f8c6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.292+0000 7f8c87cc9640 1 --2- 172.21.15.19:0/2135980535 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c6c06be30 0x7f8c6c06e2f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8c801ee030 tx=0x7f8c74008040 comp rx=0 tx=0).stop 2024-09-12T02:03:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.292+0000 7f8c87cc9640 1 -- 172.21.15.19:0/2135980535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c8006f700 msgr2=0x7f8c800c6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.292+0000 7f8c87cc9640 1 --2- 172.21.15.19:0/2135980535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c8006f700 0x7f8c800c6940 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800c400 tx=0x7f8c7800c8c0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.292+0000 7f8c87cc9640 1 -- 172.21.15.19:0/2135980535 shutdown_connections 2024-09-12T02:03:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.292+0000 7f8c87cc9640 1 --2- 172.21.15.19:0/2135980535 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c6c06be30 0x7f8c6c06e2f0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.292+0000 7f8c87cc9640 1 --2- 172.21.15.19:0/2135980535 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c8015b300 0x7f8c80156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.292+0000 7f8c87cc9640 1 --2- 172.21.15.19:0/2135980535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c80072d30 0x7f8c801530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.292+0000 7f8c87cc9640 1 --2- 172.21.15.19:0/2135980535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c8006f700 0x7f8c800c6940 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.292+0000 7f8c87cc9640 1 -- 172.21.15.19:0/2135980535 >> 172.21.15.19:0/2135980535 conn(0x7f8c80067d70 msgr2=0x7f8c8015dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.292+0000 7f8c87cc9640 1 -- 172.21.15.19:0/2135980535 shutdown_connections 2024-09-12T02:03:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.292+0000 7f8c87cc9640 1 -- 172.21.15.19:0/2135980535 wait complete. 2024-09-12T02:03:52.303 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 154, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:03:48.785875+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 106, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7453}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7453': {'gid': 7453, 'name': 'd', 'rank': 0, 'incarnation': 151, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.135:6837/3866905323', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 3866905323}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 3866905323}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7453, 'qdb_cluster': [7453]} 2024-09-12T02:03:52.303 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:03:52.304 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T02:03:52.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.406+0000 7fbf4e731640 1 Processor -- start 2024-09-12T02:03:52.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.407+0000 7fbf4e731640 1 -- start start 2024-09-12T02:03:52.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.407+0000 7fbf4e731640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbf48161c80 0x7fbf4806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.407+0000 7fbf4e731640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbf48162060 0x7fbf480b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.407+0000 7fbf4e731640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf4806e870 con 0x7fbf480b64b0 2024-09-12T02:03:52.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.407+0000 7fbf4e731640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fbf4806d9f0 con 0x7fbf48161c80 2024-09-12T02:03:52.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.407+0000 7fbf4e731640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fbf4806dcd0 con 0x7fbf48162060 2024-09-12T02:03:52.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.408+0000 7fbf47fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbf48161c80 0x7fbf4806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.408+0000 7fbf4ccce640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbf480b64b0 0x7fbf48162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36358/0 (socket says 172.21.15.19:36358) 2024-09-12T02:03:52.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.408+0000 7fbf47fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbf48161c80 0x7fbf4806e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49830/0 (socket says 172.21.15.19:49830) 2024-09-12T02:03:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.408+0000 7fbf4ccce640 1 -- 172.21.15.19:0/3917273430 learned_addr learned my addr 172.21.15.19:0/3917273430 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.408+0000 7fbf477fe640 1 --2- 172.21.15.19:0/3917273430 >> v2:172.21.15.135:3300/0 conn(0x7fbf48162060 0x7fbf480b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.408+0000 7fbf47fff640 1 -- 172.21.15.19:0/3917273430 >> v2:172.21.15.135:3300/0 conn(0x7fbf48162060 msgr2=0x7fbf480b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.408+0000 7fbf47fff640 1 --2- 172.21.15.19:0/3917273430 >> v2:172.21.15.135:3300/0 conn(0x7fbf48162060 0x7fbf480b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.408+0000 7fbf47fff640 1 -- 172.21.15.19:0/3917273430 >> v1:172.21.15.19:6789/0 conn(0x7fbf480b64b0 legacy=0x7fbf48162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.408+0000 7fbf47fff640 1 -- 172.21.15.19:0/3917273430 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4806dfb0 con 0x7fbf48161c80 2024-09-12T02:03:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.408+0000 7fbf46ffd640 1 -- 172.21.15.19:0/3917273430 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 193761534 0 0) 0x7fbf40001490 con 0x7fbf480b64b0 2024-09-12T02:03:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.409+0000 7fbf47fff640 1 --2- 172.21.15.19:0/3917273430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf48161c80 0x7fbf4806e330 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fbf4808e830 tx=0x7fbf3802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a6053354aaac93 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.409+0000 7fbf46ffd640 1 -- 172.21.15.19:0/3917273430 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38037070 con 0x7fbf48161c80 2024-09-12T02:03:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.409+0000 7fbf46ffd640 1 -- 172.21.15.19:0/3917273430 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf38032440 con 0x7fbf48161c80 2024-09-12T02:03:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.409+0000 7fbf46ffd640 1 -- 172.21.15.19:0/3917273430 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38032810 con 0x7fbf48161c80 2024-09-12T02:03:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.409+0000 7fbf4e731640 1 -- 172.21.15.19:0/3917273430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf48161c80 msgr2=0x7fbf4806e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.409+0000 7fbf4e731640 1 --2- 172.21.15.19:0/3917273430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf48161c80 0x7fbf4806e330 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fbf4808e830 tx=0x7fbf3802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.409+0000 7fbf4e731640 1 -- 172.21.15.19:0/3917273430 shutdown_connections 2024-09-12T02:03:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.409+0000 7fbf4e731640 1 --2- 172.21.15.19:0/3917273430 >> v2:172.21.15.135:3300/0 conn(0x7fbf48162060 0x7fbf480b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.409+0000 7fbf4e731640 1 --2- 172.21.15.19:0/3917273430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf48161c80 0x7fbf4806e330 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.409+0000 7fbf4e731640 1 -- 172.21.15.19:0/3917273430 >> 172.21.15.19:0/3917273430 conn(0x7fbf480d44f0 msgr2=0x7fbf480d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.409+0000 7fbf4e731640 1 -- 172.21.15.19:0/3917273430 shutdown_connections 2024-09-12T02:03:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.409+0000 7fbf4e731640 1 -- 172.21.15.19:0/3917273430 wait complete. 2024-09-12T02:03:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.411+0000 7fbf4e731640 1 Processor -- start 2024-09-12T02:03:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.411+0000 7fbf4e731640 1 -- start start 2024-09-12T02:03:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.411+0000 7fbf4e731640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf480b64b0 0x7fbf480ce800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.411+0000 7fbf4e731640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf48161c80 0x7fbf480b9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.411+0000 7fbf4e731640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf48162060 0x7fbf48155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.411+0000 7fbf4e731640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbf480d2a10 con 0x7fbf48161c80 2024-09-12T02:03:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.411+0000 7fbf4e731640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbf480d2890 con 0x7fbf48162060 2024-09-12T02:03:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.411+0000 7fbf4e731640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbf480b6960 con 0x7fbf480b64b0 2024-09-12T02:03:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.412+0000 7fbf477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf48161c80 0x7fbf480b9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.412+0000 7fbf477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf48161c80 0x7fbf480b9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49840/0 (socket says 172.21.15.19:49840) 2024-09-12T02:03:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.412+0000 7fbf477fe640 1 -- 172.21.15.19:0/3497720093 learned_addr learned my addr 172.21.15.19:0/3497720093 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.412+0000 7fbf4ccce640 1 --2- 172.21.15.19:0/3497720093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf48162060 0x7fbf48155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.412+0000 7fbf47fff640 1 --2- 172.21.15.19:0/3497720093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf480b64b0 0x7fbf480ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.412+0000 7fbf477fe640 1 -- 172.21.15.19:0/3497720093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf480b64b0 msgr2=0x7fbf480ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.412+0000 7fbf477fe640 1 --2- 172.21.15.19:0/3497720093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf480b64b0 0x7fbf480ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.412+0000 7fbf477fe640 1 -- 172.21.15.19:0/3497720093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf48162060 msgr2=0x7fbf48155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.412+0000 7fbf477fe640 1 --2- 172.21.15.19:0/3497720093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf48162060 0x7fbf48155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.412+0000 7fbf477fe640 1 -- 172.21.15.19:0/3497720093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf480b74e0 con 0x7fbf48161c80 2024-09-12T02:03:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.412+0000 7fbf477fe640 1 --2- 172.21.15.19:0/3497720093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf48161c80 0x7fbf480b9ce0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00d5f0 tx=0x7fbf3c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.412+0000 7fbf44ff9640 1 -- 172.21.15.19:0/3497720093 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c0125f0 con 0x7fbf48161c80 2024-09-12T02:03:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.412+0000 7fbf44ff9640 1 -- 172.21.15.19:0/3497720093 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf3c019070 con 0x7fbf48161c80 2024-09-12T02:03:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.412+0000 7fbf44ff9640 1 -- 172.21.15.19:0/3497720093 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c0129d0 con 0x7fbf48161c80 2024-09-12T02:03:52.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.412+0000 7fbf4e731640 1 -- 172.21.15.19:0/3497720093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf480b77c0 con 0x7fbf48161c80 2024-09-12T02:03:52.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.412+0000 7fbf4e731640 1 -- 172.21.15.19:0/3497720093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf480b7d80 con 0x7fbf48161c80 2024-09-12T02:03:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.414+0000 7fbf44ff9640 1 -- 172.21.15.19:0/3497720093 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf3c012b70 con 0x7fbf48161c80 2024-09-12T02:03:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.414+0000 7fbf44ff9640 1 --2- 172.21.15.19:0/3497720093 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf3406be30 0x7fbf3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.414+0000 7fbf44ff9640 1 -- 172.21.15.19:0/3497720093 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7249+0+0 (secure 0 0 0) 0x7fbf3c08b7b0 con 0x7fbf48161c80 2024-09-12T02:03:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.414+0000 7fbf47fff640 1 --2- 172.21.15.19:0/3497720093 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf3406be30 0x7fbf3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.415+0000 7fbf47fff640 1 --2- 172.21.15.19:0/3497720093 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf3406be30 0x7fbf3406e2f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fbf38034000 tx=0x7fbf3802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.415+0000 7fbf514d3740 1 Processor -- start 2024-09-12T02:03:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.415+0000 7fbf514d3740 1 -- start start 2024-09-12T02:03:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.416+0000 7fbf514d3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed72c0 0x556287f1ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.416+0000 7fbf514d3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed4a80 0x556287ed76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.416+0000 7fbf514d3740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed8a50 0x556287ed18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.416+0000 7fbf514d3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556287e39520 con 0x556287ed72c0 2024-09-12T02:03:52.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.416+0000 7fbf514d3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556287de13e0 con 0x556287ed4a80 2024-09-12T02:03:52.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.416+0000 7fbf514d3740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556287e354e0 con 0x556287ed8a50 2024-09-12T02:03:52.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.416+0000 7fbf47fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed72c0 0x556287f1ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.416+0000 7fbf47fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed72c0 0x556287f1ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49854/0 (socket says 172.21.15.19:49854) 2024-09-12T02:03:52.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.416+0000 7fbf47fff640 1 -- 172.21.15.19:0/1934907039 learned_addr learned my addr 172.21.15.19:0/1934907039 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:52.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.416+0000 7fbf4ccce640 1 --2- 172.21.15.19:0/1934907039 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed8a50 0x556287ed18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.416+0000 7fbf477fe640 1 --2- 172.21.15.19:0/1934907039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed4a80 0x556287ed76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.416+0000 7fbf47fff640 1 -- 172.21.15.19:0/1934907039 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed8a50 msgr2=0x556287ed18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:52.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.416+0000 7fbf47fff640 1 --2- 172.21.15.19:0/1934907039 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed8a50 0x556287ed18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.416+0000 7fbf47fff640 1 -- 172.21.15.19:0/1934907039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed4a80 msgr2=0x556287ed76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:52.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.416+0000 7fbf47fff640 1 --2- 172.21.15.19:0/1934907039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed4a80 0x556287ed76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.416+0000 7fbf47fff640 1 -- 172.21.15.19:0/1934907039 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556287dfc2f0 con 0x556287ed72c0 2024-09-12T02:03:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.416+0000 7fbf477fe640 1 --2- 172.21.15.19:0/1934907039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed4a80 0x556287ed76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.416+0000 7fbf47fff640 1 --2- 172.21.15.19:0/1934907039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed72c0 0x556287f1ca60 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fbf38032820 tx=0x7fbf3802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ee64c8a27e7e22 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.417+0000 7fbf2dffb640 1 -- 172.21.15.19:0/1934907039 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3804f070 con 0x556287ed72c0 2024-09-12T02:03:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.417+0000 7fbf2dffb640 1 -- 172.21.15.19:0/1934907039 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf38038040 con 0x556287ed72c0 2024-09-12T02:03:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.417+0000 7fbf2dffb640 1 -- 172.21.15.19:0/1934907039 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38037040 con 0x556287ed72c0 2024-09-12T02:03:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.417+0000 7fbf514d3740 1 -- 172.21.15.19:0/1934907039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed72c0 msgr2=0x556287f1ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.417+0000 7fbf514d3740 1 --2- 172.21.15.19:0/1934907039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed72c0 0x556287f1ca60 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fbf38032820 tx=0x7fbf3802c000 comp rx=0 tx=0).stop 2024-09-12T02:03:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.417+0000 7fbf514d3740 1 -- 172.21.15.19:0/1934907039 shutdown_connections 2024-09-12T02:03:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.417+0000 7fbf514d3740 1 --2- 172.21.15.19:0/1934907039 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed8a50 0x556287ed18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.417+0000 7fbf514d3740 1 --2- 172.21.15.19:0/1934907039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed4a80 0x556287ed76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.417+0000 7fbf514d3740 1 --2- 172.21.15.19:0/1934907039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed72c0 0x556287f1ca60 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.417+0000 7fbf514d3740 1 -- 172.21.15.19:0/1934907039 >> 172.21.15.19:0/1934907039 conn(0x556287ed3a80 msgr2=0x556287f1bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.417+0000 7fbf514d3740 1 -- 172.21.15.19:0/1934907039 shutdown_connections 2024-09-12T02:03:52.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.417+0000 7fbf514d3740 1 -- 172.21.15.19:0/1934907039 wait complete. 2024-09-12T02:03:52.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.418+0000 7fbf514d3740 1 -- start start 2024-09-12T02:03:52.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.418+0000 7fbf514d3740 1 Processor -- start 2024-09-12T02:03:52.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf514d3740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed72c0 0x556287ed26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf514d3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed8a50 0x556287ef54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf514d3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287f01a00 0x556287ed5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf514d3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556287ed2f20 con 0x556287f01a00 2024-09-12T02:03:52.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf514d3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556287dc2450 con 0x556287ed8a50 2024-09-12T02:03:52.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf514d3740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556287f1d290 con 0x556287ed72c0 2024-09-12T02:03:52.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf514d3740 10 client.0 _ll_register_callbacks cb 0x556287b4bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:03:52.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf4ccce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287f01a00 0x556287ed5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf4ccce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287f01a00 0x556287ed5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49868/0 (socket says 172.21.15.19:49868) 2024-09-12T02:03:52.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf4ccce640 1 -- 172.21.15.19:0/2811859639 learned_addr learned my addr 172.21.15.19:0/2811859639 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:52.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf47fff640 1 --2- 172.21.15.19:0/2811859639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed72c0 0x556287ed26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf477fe640 1 --2- 172.21.15.19:0/2811859639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed8a50 0x556287ef54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf4ccce640 1 -- 172.21.15.19:0/2811859639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed72c0 msgr2=0x556287ed26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:52.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf4ccce640 1 --2- 172.21.15.19:0/2811859639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed72c0 0x556287ed26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf4ccce640 1 -- 172.21.15.19:0/2811859639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed8a50 msgr2=0x556287ef54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:52.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf4ccce640 1 --2- 172.21.15.19:0/2811859639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed8a50 0x556287ef54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf4ccce640 1 -- 172.21.15.19:0/2811859639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556287b4c2d0 con 0x556287f01a00 2024-09-12T02:03:52.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf4ccce640 1 --2- 172.21.15.19:0/2811859639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287f01a00 0x556287ed5930 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fbf40007320 tx=0x7fbf400077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e84aa37d5aaab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:52.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.419+0000 7fbf26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:03:52.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.420+0000 7fbf26ffd640 1 -- 172.21.15.19:0/2811859639 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf40012820 con 0x556287f01a00 2024-09-12T02:03:52.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.420+0000 7fbf26ffd640 1 -- 172.21.15.19:0/2811859639 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 7249+0+0 (secure 0 0 0) 0x7fbf400129c0 con 0x556287f01a00 2024-09-12T02:03:52.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.420+0000 7fbf514d3740 1 -- 172.21.15.19:0/2811859639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf38038040 con 0x556287f01a00 2024-09-12T02:03:52.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.420+0000 7fbf26ffd640 1 -- 172.21.15.19:0/2811859639 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=154) ==== 24+0+0 (secure 0 0 0) 0x7fbf40022050 con 0x556287f01a00 2024-09-12T02:03:52.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.420+0000 7fbf514d3740 10 client.8436 fetch_fsmap learned FSMap version 154 2024-09-12T02:03:52.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.420+0000 7fbf514d3740 1 -- 172.21.15.19:0/2811859639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=154,monmap=2+}) -- 0x556287c166b0 con 0x556287f01a00 2024-09-12T02:03:52.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.420+0000 7fbf26ffd640 1 -- 172.21.15.19:0/2811859639 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf38038040 con 0x556287f01a00 2024-09-12T02:03:52.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.420+0000 7fbf26ffd640 1 -- 172.21.15.19:0/2811859639 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 154) ==== 3502+0+0 (secure 0 0 0) 0x7fbf40025020 con 0x556287f01a00 2024-09-12T02:03:52.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.420+0000 7fbf514d3740 10 client.8436 fetch_fsmap finished waiting for FSMap version 154 2024-09-12T02:03:52.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.420+0000 7fbf514d3740 10 client.8436 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:03:52.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.420+0000 7fbf514d3740 20 client.8436 populate_metadata read hostname 'smithi019' 2024-09-12T02:03:52.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.420+0000 7fbf514d3740 1 --2- 172.21.15.19:0/2811859639 >> [v2:172.21.15.135:6834/3866905323,v1:172.21.15.135:6837/3866905323] conn(0x556287ed07d0 0x556287ed0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.420+0000 7fbf514d3740 4 client.8436 mds_command: new command op to 7453 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:03:52.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.420+0000 7fbf514d3740 1 -- 172.21.15.19:0/2811859639 --> [v2:172.21.15.135:6834/3866905323,v1:172.21.15.135:6837/3866905323] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556287e46c50 con 0x556287ed07d0 2024-09-12T02:03:52.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.420+0000 7fbf47fff640 1 --2- 172.21.15.19:0/2811859639 >> [v2:172.21.15.135:6834/3866905323,v1:172.21.15.135:6837/3866905323] conn(0x556287ed07d0 0x556287ed0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.421+0000 7fbf47fff640 1 --2- 172.21.15.19:0/2811859639 >> [v2:172.21.15.135:6834/3866905323,v1:172.21.15.135:6837/3866905323] conn(0x556287ed07d0 0x556287ed0bb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=441e776f47ed9f8e server_cookie=5808fe4e8cbd0f17 in_seq=0 out_seq=0 2024-09-12T02:03:52.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.421+0000 7fbf26ffd640 10 client.8436 ms_handle_connect on v2:172.21.15.135:6834/3866905323 2024-09-12T02:03:52.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.422+0000 7fbf26ffd640 1 -- 172.21.15.19:0/2811859639 <== mds.0 v2:172.21.15.135:6834/3866905323 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556287e46c50 con 0x556287ed07d0 2024-09-12T02:03:52.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.422+0000 7fbf26ffd640 10 client.8436 handle_command_reply: tid=0 2024-09-12T02:03:52.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.422+0000 7fbf514d3740 1 client.8436 shutdown 2024-09-12T02:03:52.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.422+0000 7fbf514d3740 1 -- 172.21.15.19:0/2811859639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287f01a00 msgr2=0x556287ed5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.422+0000 7fbf514d3740 1 --2- 172.21.15.19:0/2811859639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287f01a00 0x556287ed5930 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fbf40007320 tx=0x7fbf400077e0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.422+0000 7fbf514d3740 1 -- 172.21.15.19:0/2811859639 shutdown_connections 2024-09-12T02:03:52.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.422+0000 7fbf514d3740 1 --2- 172.21.15.19:0/2811859639 >> [v2:172.21.15.135:6834/3866905323,v1:172.21.15.135:6837/3866905323] conn(0x556287ed07d0 0x556287ed0bb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.422+0000 7fbf26ffd640 0 client.8436 ms_handle_reset on v2:172.21.15.135:6834/3866905323 2024-09-12T02:03:52.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.422+0000 7fbf514d3740 1 --2- 172.21.15.19:0/2811859639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287f01a00 0x556287ed5930 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.422+0000 7fbf514d3740 1 --2- 172.21.15.19:0/2811859639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed8a50 0x556287ef54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.422+0000 7fbf514d3740 1 --2- 172.21.15.19:0/2811859639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed72c0 0x556287ed26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.422+0000 7fbf514d3740 1 -- 172.21.15.19:0/2811859639 >> 172.21.15.19:0/2811859639 conn(0x556287ed4a80 msgr2=0x556287f1b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:52.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.422+0000 7fbf514d3740 1 -- 172.21.15.19:0/2811859639 shutdown_connections 2024-09-12T02:03:52.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.422+0000 7fbf514d3740 1 -- 172.21.15.19:0/2811859639 wait complete. 2024-09-12T02:03:52.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.422+0000 7fbf514d3740 20 client.8436 trim_cache size 0 max 16384 2024-09-12T02:03:52.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.440+0000 7fbf514d3740 1 Processor -- start 2024-09-12T02:03:52.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.440+0000 7fbf514d3740 1 -- start start 2024-09-12T02:03:52.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf514d3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed07d0 0x556287f1bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf514d3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed72c0 0x556287f1a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf514d3740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed8a50 0x556287f2b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf514d3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbf48200ba0 con 0x556287ed07d0 2024-09-12T02:03:52.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf514d3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbf481fff30 con 0x556287ed72c0 2024-09-12T02:03:52.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf514d3740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbf48200550 con 0x556287ed8a50 2024-09-12T02:03:52.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf47fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed07d0 0x556287f1bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf47fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed07d0 0x556287f1bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49878/0 (socket says 172.21.15.19:49878) 2024-09-12T02:03:52.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf47fff640 1 -- 172.21.15.19:0/3159772069 learned_addr learned my addr 172.21.15.19:0/3159772069 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:52.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf4ccce640 1 --2- 172.21.15.19:0/3159772069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed8a50 0x556287f2b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf477fe640 1 --2- 172.21.15.19:0/3159772069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed72c0 0x556287f1a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf47fff640 1 -- 172.21.15.19:0/3159772069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed8a50 msgr2=0x556287f2b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:52.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf47fff640 1 --2- 172.21.15.19:0/3159772069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed8a50 0x556287f2b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf47fff640 1 -- 172.21.15.19:0/3159772069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed72c0 msgr2=0x556287f1a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:52.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf47fff640 1 --2- 172.21.15.19:0/3159772069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed72c0 0x556287f1a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf47fff640 1 -- 172.21.15.19:0/3159772069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556287effe70 con 0x556287ed07d0 2024-09-12T02:03:52.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf4ccce640 1 --2- 172.21.15.19:0/3159772069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed8a50 0x556287f2b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:52.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf477fe640 1 --2- 172.21.15.19:0/3159772069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed72c0 0x556287f1a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:52.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf47fff640 1 --2- 172.21.15.19:0/3159772069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed07d0 0x556287f1bf10 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fbf38000c00 tx=0x7fbf3803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c0d72c4ddc6ce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:52.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf2d7fa640 1 -- 172.21.15.19:0/3159772069 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3804f040 con 0x556287ed07d0 2024-09-12T02:03:52.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf2d7fa640 1 -- 172.21.15.19:0/3159772069 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf3804a810 con 0x556287ed07d0 2024-09-12T02:03:52.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.441+0000 7fbf2d7fa640 1 -- 172.21.15.19:0/3159772069 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38037040 con 0x556287ed07d0 2024-09-12T02:03:52.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.442+0000 7fbf514d3740 1 -- 172.21.15.19:0/3159772069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed07d0 msgr2=0x556287f1bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.442+0000 7fbf514d3740 1 --2- 172.21.15.19:0/3159772069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed07d0 0x556287f1bf10 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fbf38000c00 tx=0x7fbf3803d000 comp rx=0 tx=0).stop 2024-09-12T02:03:52.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.442+0000 7fbf514d3740 1 -- 172.21.15.19:0/3159772069 shutdown_connections 2024-09-12T02:03:52.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.442+0000 7fbf514d3740 1 --2- 172.21.15.19:0/3159772069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed8a50 0x556287f2b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.442+0000 7fbf514d3740 1 --2- 172.21.15.19:0/3159772069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed72c0 0x556287f1a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.442+0000 7fbf514d3740 1 --2- 172.21.15.19:0/3159772069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed07d0 0x556287f1bf10 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.442+0000 7fbf514d3740 1 -- 172.21.15.19:0/3159772069 >> 172.21.15.19:0/3159772069 conn(0x556287ed4a80 msgr2=0x556287f1b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:52.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.442+0000 7fbf514d3740 1 -- 172.21.15.19:0/3159772069 shutdown_connections 2024-09-12T02:03:52.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.442+0000 7fbf514d3740 1 -- 172.21.15.19:0/3159772069 wait complete. 2024-09-12T02:03:52.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.443+0000 7fbf514d3740 1 -- start start 2024-09-12T02:03:52.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.443+0000 7fbf514d3740 1 Processor -- start 2024-09-12T02:03:52.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf514d3740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed07d0 0x556287f830d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf514d3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed72c0 0x556287f2b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf514d3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed8a50 0x556287f2b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf514d3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556287f00410 con 0x556287ed8a50 2024-09-12T02:03:52.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf514d3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556287ef5a30 con 0x556287ed72c0 2024-09-12T02:03:52.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf514d3740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556287ef8430 con 0x556287ed07d0 2024-09-12T02:03:52.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf514d3740 10 client.0 _ll_register_callbacks cb 0x7fbf40004e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:03:52.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf4ccce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed8a50 0x556287f2b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf4ccce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed8a50 0x556287f2b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49888/0 (socket says 172.21.15.19:49888) 2024-09-12T02:03:52.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf4ccce640 1 -- 172.21.15.19:0/3754662824 learned_addr learned my addr 172.21.15.19:0/3754662824 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:52.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf47fff640 1 --2- 172.21.15.19:0/3754662824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed07d0 0x556287f830d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf477fe640 1 --2- 172.21.15.19:0/3754662824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed72c0 0x556287f2b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf4ccce640 1 -- 172.21.15.19:0/3754662824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed07d0 msgr2=0x556287f830d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:52.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf4ccce640 1 --2- 172.21.15.19:0/3754662824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed07d0 0x556287f830d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf4ccce640 1 -- 172.21.15.19:0/3754662824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed72c0 msgr2=0x556287f2b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:52.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf4ccce640 1 --2- 172.21.15.19:0/3754662824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed72c0 0x556287f2b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf4ccce640 1 -- 172.21.15.19:0/3754662824 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556287ed6af0 con 0x556287ed8a50 2024-09-12T02:03:52.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf4ccce640 1 --2- 172.21.15.19:0/3754662824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed8a50 0x556287f2b700 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fbf40007320 tx=0x7fbf400016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55a6ce931e2c5ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:52.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:03:52.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf26ffd640 1 -- 172.21.15.19:0/3754662824 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf40015850 con 0x556287ed8a50 2024-09-12T02:03:52.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf26ffd640 1 -- 172.21.15.19:0/3754662824 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 7249+0+0 (secure 0 0 0) 0x7fbf40017d30 con 0x556287ed8a50 2024-09-12T02:03:52.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.444+0000 7fbf514d3740 1 -- 172.21.15.19:0/3754662824 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf3804a810 con 0x556287ed8a50 2024-09-12T02:03:52.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.445+0000 7fbf26ffd640 1 -- 172.21.15.19:0/3754662824 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=154) ==== 24+0+0 (secure 0 0 0) 0x7fbf40035050 con 0x556287ed8a50 2024-09-12T02:03:52.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.445+0000 7fbf514d3740 10 client.8442 fetch_fsmap learned FSMap version 154 2024-09-12T02:03:52.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.445+0000 7fbf514d3740 1 -- 172.21.15.19:0/3754662824 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=154,monmap=2+}) -- 0x556287f9e320 con 0x556287ed8a50 2024-09-12T02:03:52.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.445+0000 7fbf26ffd640 1 -- 172.21.15.19:0/3754662824 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf3804a810 con 0x556287ed8a50 2024-09-12T02:03:52.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.445+0000 7fbf26ffd640 1 -- 172.21.15.19:0/3754662824 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 154) ==== 3502+0+0 (secure 0 0 0) 0x7fbf40038020 con 0x556287ed8a50 2024-09-12T02:03:52.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.445+0000 7fbf514d3740 10 client.8442 fetch_fsmap finished waiting for FSMap version 154 2024-09-12T02:03:52.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.445+0000 7fbf514d3740 10 client.8442 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:03:52.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.445+0000 7fbf514d3740 20 client.8442 populate_metadata read hostname 'smithi019' 2024-09-12T02:03:52.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.445+0000 7fbf514d3740 1 --2- 172.21.15.19:0/3754662824 >> [v2:172.21.15.135:6834/3866905323,v1:172.21.15.135:6837/3866905323] conn(0x556287f01a00 0x556287f9dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.445+0000 7fbf514d3740 4 client.8442 mds_command: new command op to 7453 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:03:52.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.445+0000 7fbf514d3740 1 -- 172.21.15.19:0/3754662824 --> [v2:172.21.15.135:6834/3866905323,v1:172.21.15.135:6837/3866905323] -- command(tid 0: {"prefix": "status"}) -- 0x556287e40fa0 con 0x556287f01a00 2024-09-12T02:03:52.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.445+0000 7fbf47fff640 1 --2- 172.21.15.19:0/3754662824 >> [v2:172.21.15.135:6834/3866905323,v1:172.21.15.135:6837/3866905323] conn(0x556287f01a00 0x556287f9dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.445+0000 7fbf26ffd640 10 client.8442 ms_handle_connect on v2:172.21.15.135:6834/3866905323 2024-09-12T02:03:52.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.445+0000 7fbf47fff640 1 --2- 172.21.15.19:0/3754662824 >> [v2:172.21.15.135:6834/3866905323,v1:172.21.15.135:6837/3866905323] conn(0x556287f01a00 0x556287f9dbc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d19ff35b71cc71d server_cookie=688e3ab30128443c in_seq=0 out_seq=0 2024-09-12T02:03:52.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf26ffd640 1 -- 172.21.15.19:0/3754662824 <== mds.0 v2:172.21.15.135:6834/3866905323 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x556287e40fa0 con 0x556287f01a00 2024-09-12T02:03:52.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf26ffd640 10 client.8442 handle_command_reply: tid=0 2024-09-12T02:03:52.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf514d3740 1 client.8442 shutdown 2024-09-12T02:03:52.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf514d3740 1 -- 172.21.15.19:0/3754662824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed8a50 msgr2=0x556287f2b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf514d3740 1 --2- 172.21.15.19:0/3754662824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed8a50 0x556287f2b700 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fbf40007320 tx=0x7fbf400016f0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf514d3740 1 -- 172.21.15.19:0/3754662824 shutdown_connections 2024-09-12T02:03:52.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf514d3740 1 --2- 172.21.15.19:0/3754662824 >> [v2:172.21.15.135:6834/3866905323,v1:172.21.15.135:6837/3866905323] conn(0x556287f01a00 0x556287f9dbc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf514d3740 1 --2- 172.21.15.19:0/3754662824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556287ed8a50 0x556287f2b700 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf514d3740 1 --2- 172.21.15.19:0/3754662824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556287ed72c0 0x556287f2b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf514d3740 1 --2- 172.21.15.19:0/3754662824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556287ed07d0 0x556287f830d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf26ffd640 0 client.8442 ms_handle_reset on v2:172.21.15.135:6834/3866905323 2024-09-12T02:03:52.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf514d3740 1 -- 172.21.15.19:0/3754662824 >> 172.21.15.19:0/3754662824 conn(0x556287ed4a80 msgr2=0x556287f1a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:52.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf514d3740 1 -- 172.21.15.19:0/3754662824 shutdown_connections 2024-09-12T02:03:52.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf514d3740 1 -- 172.21.15.19:0/3754662824 wait complete. 2024-09-12T02:03:52.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf514d3740 20 client.8442 trim_cache size 0 max 16384 2024-09-12T02:03:52.453 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:03:52.453 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T02:03:52.453 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T02:03:52.453 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 7453, 2024-09-12T02:03:52.453 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T02:03:52.453 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T02:03:52.453 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T02:03:52.453 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 6.6672247630000001, 2024-09-12T02:03:52.453 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 154, 2024-09-12T02:03:52.453 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 106, 2024-09-12T02:03:52.453 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 106, 2024-09-12T02:03:52.454 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 19.013591199 2024-09-12T02:03:52.454 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:03:52.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf4e731640 1 -- 172.21.15.19:0/3497720093 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf3406be30 msgr2=0x7fbf3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf4e731640 1 --2- 172.21.15.19:0/3497720093 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf3406be30 0x7fbf3406e2f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fbf38034000 tx=0x7fbf3802e000 comp rx=0 tx=0).stop 2024-09-12T02:03:52.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf4e731640 1 -- 172.21.15.19:0/3497720093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf48161c80 msgr2=0x7fbf480b9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.446+0000 7fbf4e731640 1 --2- 172.21.15.19:0/3497720093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf48161c80 0x7fbf480b9ce0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00d5f0 tx=0x7fbf3c00dab0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.447+0000 7fbf4e731640 1 -- 172.21.15.19:0/3497720093 shutdown_connections 2024-09-12T02:03:52.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.447+0000 7fbf4e731640 1 --2- 172.21.15.19:0/3497720093 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf3406be30 0x7fbf3406e2f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.447+0000 7fbf4e731640 1 --2- 172.21.15.19:0/3497720093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf48162060 0x7fbf48155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.447+0000 7fbf4e731640 1 --2- 172.21.15.19:0/3497720093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf48161c80 0x7fbf480b9ce0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.447+0000 7fbf4e731640 1 --2- 172.21.15.19:0/3497720093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf480b64b0 0x7fbf480ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.447+0000 7fbf4e731640 1 -- 172.21.15.19:0/3497720093 >> 172.21.15.19:0/3497720093 conn(0x7fbf480d44f0 msgr2=0x7fbf480d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:52.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.447+0000 7fbf4e731640 1 -- 172.21.15.19:0/3497720093 shutdown_connections 2024-09-12T02:03:52.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.447+0000 7fbf4e731640 1 -- 172.21.15.19:0/3497720093 wait complete. 2024-09-12T02:03:52.458 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:03:52.458 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Delete 400.00000000', proceeding to ls 2024-09-12T02:03:52.458 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:03:52.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.559+0000 7f793e7fd640 1 Processor -- start 2024-09-12T02:03:52.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.559+0000 7f793e7fd640 1 -- start start 2024-09-12T02:03:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.560+0000 7f793e7fd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7938162060 0x7f79380b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.560+0000 7f793e7fd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f79380b64b0 0x7f79380b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.560+0000 7f793e7fd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793806d9f0 con 0x7f7938161c80 2024-09-12T02:03:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.560+0000 7f793e7fd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f793806dcd0 con 0x7f79380b64b0 2024-09-12T02:03:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.560+0000 7f793e7fd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f793806dfb0 con 0x7f7938162060 2024-09-12T02:03:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.560+0000 7f793cd9a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f79380b64b0 0x7f79380b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.560+0000 7f7937fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7938161c80 0x7f793806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36372/0 (socket says 172.21.15.19:36372) 2024-09-12T02:03:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.560+0000 7f793cd9a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f79380b64b0 0x7f79380b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49894/0 (socket says 172.21.15.19:49894) 2024-09-12T02:03:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.560+0000 7f7937fff640 1 -- 172.21.15.19:0/67281773 learned_addr learned my addr 172.21.15.19:0/67281773 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.561+0000 7f79377fe640 1 --2- 172.21.15.19:0/67281773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7938162060 0x7f79380b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.561+0000 7f793cd9a640 1 -- 172.21.15.19:0/67281773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7938162060 msgr2=0x7f79380b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.561+0000 7f793cd9a640 1 --2- 172.21.15.19:0/67281773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7938162060 0x7f79380b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.561+0000 7f793cd9a640 1 -- 172.21.15.19:0/67281773 >> v1:172.21.15.19:6789/0 conn(0x7f7938161c80 legacy=0x7f793806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.561+0000 7f793cd9a640 1 -- 172.21.15.19:0/67281773 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79380d01f0 con 0x7f79380b64b0 2024-09-12T02:03:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.561+0000 7f7936ffd640 1 -- 172.21.15.19:0/67281773 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1860273842 0 0) 0x7f793806d9f0 con 0x7f7938161c80 2024-09-12T02:03:52.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.562+0000 7f793cd9a640 1 --2- 172.21.15.19:0/67281773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79380b64b0 0x7f79380b6960 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f7930009d90 tx=0x7f793002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad926ef91b203e35 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:52.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.562+0000 7f7936ffd640 1 -- 172.21.15.19:0/67281773 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7930007740 con 0x7f79380b64b0 2024-09-12T02:03:52.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.562+0000 7f7936ffd640 1 -- 172.21.15.19:0/67281773 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79300078e0 con 0x7f79380b64b0 2024-09-12T02:03:52.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.562+0000 7f7936ffd640 1 -- 172.21.15.19:0/67281773 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7930007cb0 con 0x7f79380b64b0 2024-09-12T02:03:52.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.562+0000 7f793e7fd640 1 -- 172.21.15.19:0/67281773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79380b64b0 msgr2=0x7f79380b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.562+0000 7f793e7fd640 1 --2- 172.21.15.19:0/67281773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79380b64b0 0x7f79380b6960 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f7930009d90 tx=0x7f793002a660 comp rx=0 tx=0).stop 2024-09-12T02:03:52.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.562+0000 7f793e7fd640 1 -- 172.21.15.19:0/67281773 shutdown_connections 2024-09-12T02:03:52.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.562+0000 7f793e7fd640 1 --2- 172.21.15.19:0/67281773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79380b64b0 0x7f79380b6960 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.562+0000 7f793e7fd640 1 --2- 172.21.15.19:0/67281773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7938162060 0x7f79380b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.562+0000 7f793e7fd640 1 -- 172.21.15.19:0/67281773 >> 172.21.15.19:0/67281773 conn(0x7f79380d44f0 msgr2=0x7f79380d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:52.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.562+0000 7f793e7fd640 1 -- 172.21.15.19:0/67281773 shutdown_connections 2024-09-12T02:03:52.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.562+0000 7f793e7fd640 1 -- 172.21.15.19:0/67281773 wait complete. 2024-09-12T02:03:52.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.563+0000 7f793e7fd640 1 Processor -- start 2024-09-12T02:03:52.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.564+0000 7f793e7fd640 1 -- start start 2024-09-12T02:03:52.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.564+0000 7f793e7fd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79380b64b0 0x7f79380c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.564+0000 7f793e7fd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7938161c80 0x7f793814be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.564+0000 7f793e7fd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7938162060 0x7f79380c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.564+0000 7f793e7fd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f79380cf1e0 con 0x7f7938162060 2024-09-12T02:03:52.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.564+0000 7f793e7fd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f79380d2aa0 con 0x7f79380b64b0 2024-09-12T02:03:52.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.564+0000 7f793e7fd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f79380cf360 con 0x7f7938161c80 2024-09-12T02:03:52.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.564+0000 7f793cd9a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7938162060 0x7f79380c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.564+0000 7f793cd9a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7938162060 0x7f79380c9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49898/0 (socket says 172.21.15.19:49898) 2024-09-12T02:03:52.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.564+0000 7f793cd9a640 1 -- 172.21.15.19:0/2151199454 learned_addr learned my addr 172.21.15.19:0/2151199454 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.565+0000 7f79377fe640 1 --2- 172.21.15.19:0/2151199454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7938161c80 0x7f793814be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.565+0000 7f7937fff640 1 --2- 172.21.15.19:0/2151199454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79380b64b0 0x7f79380c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.565+0000 7f793cd9a640 1 -- 172.21.15.19:0/2151199454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7938161c80 msgr2=0x7f793814be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.565+0000 7f793cd9a640 1 --2- 172.21.15.19:0/2151199454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7938161c80 0x7f793814be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.565+0000 7f793cd9a640 1 -- 172.21.15.19:0/2151199454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79380b64b0 msgr2=0x7f79380c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.565+0000 7f793cd9a640 1 --2- 172.21.15.19:0/2151199454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79380b64b0 0x7f79380c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.565+0000 7f793cd9a640 1 -- 172.21.15.19:0/2151199454 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79380c85f0 con 0x7f7938162060 2024-09-12T02:03:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.565+0000 7f79377fe640 1 --2- 172.21.15.19:0/2151199454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7938161c80 0x7f793814be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.565+0000 7f7937fff640 1 --2- 172.21.15.19:0/2151199454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79380b64b0 0x7f79380c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.565+0000 7f793cd9a640 1 --2- 172.21.15.19:0/2151199454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7938162060 0x7f79380c9690 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f793002a6a0 tx=0x7f7930004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.565+0000 7f7934ff9640 1 -- 172.21.15.19:0/2151199454 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7930040070 con 0x7f7938162060 2024-09-12T02:03:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.565+0000 7f7934ff9640 1 -- 172.21.15.19:0/2151199454 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7930031bc0 con 0x7f7938162060 2024-09-12T02:03:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.565+0000 7f793e7fd640 1 -- 172.21.15.19:0/2151199454 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79380c88d0 con 0x7f7938162060 2024-09-12T02:03:52.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.565+0000 7f7934ff9640 1 -- 172.21.15.19:0/2151199454 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7930009450 con 0x7f7938162060 2024-09-12T02:03:52.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.565+0000 7f793e7fd640 1 -- 172.21.15.19:0/2151199454 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79380c8e90 con 0x7f7938162060 2024-09-12T02:03:52.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.566+0000 7f793e7fd640 1 -- 172.21.15.19:0/2151199454 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79380b5f70 con 0x7f7938162060 2024-09-12T02:03:52.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.567+0000 7f7934ff9640 1 -- 172.21.15.19:0/2151199454 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7930039040 con 0x7f7938162060 2024-09-12T02:03:52.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.567+0000 7f7934ff9640 1 --2- 172.21.15.19:0/2151199454 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f792406be30 0x7f792406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.567+0000 7f7934ff9640 1 -- 172.21.15.19:0/2151199454 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7249+0+0 (secure 0 0 0) 0x7f79300ac6e0 con 0x7f7938162060 2024-09-12T02:03:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.567+0000 7f7937fff640 1 --2- 172.21.15.19:0/2151199454 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f792406be30 0x7f792406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.568+0000 7f7937fff640 1 --2- 172.21.15.19:0/2151199454 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f792406be30 0x7f792406e2f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7928000f60 tx=0x7f7928009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:52.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.572+0000 7f7934ff9640 1 -- 172.21.15.19:0/2151199454 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f793007ab10 con 0x7f7938162060 2024-09-12T02:03:52.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.781+0000 7f793e7fd640 1 -- 172.21.15.19:0/2151199454 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f79380d3640 con 0x7f7938162060 2024-09-12T02:03:52.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.782+0000 7f7934ff9640 1 -- 172.21.15.19:0/2151199454 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v154) ==== 53+0+73 (secure 0 0 0) 0x7f793007a410 con 0x7f7938162060 2024-09-12T02:03:52.782 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:03:52.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.784+0000 7f793e7fd640 1 -- 172.21.15.19:0/2151199454 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f792406be30 msgr2=0x7f792406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.784+0000 7f793e7fd640 1 --2- 172.21.15.19:0/2151199454 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f792406be30 0x7f792406e2f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7928000f60 tx=0x7f7928009040 comp rx=0 tx=0).stop 2024-09-12T02:03:52.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.784+0000 7f793e7fd640 1 -- 172.21.15.19:0/2151199454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7938162060 msgr2=0x7f79380c9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:52.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.784+0000 7f793e7fd640 1 --2- 172.21.15.19:0/2151199454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7938162060 0x7f79380c9690 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f793002a6a0 tx=0x7f7930004a40 comp rx=0 tx=0).stop 2024-09-12T02:03:52.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.784+0000 7f793e7fd640 1 -- 172.21.15.19:0/2151199454 shutdown_connections 2024-09-12T02:03:52.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.784+0000 7f793e7fd640 1 --2- 172.21.15.19:0/2151199454 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f792406be30 0x7f792406e2f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.784+0000 7f793e7fd640 1 --2- 172.21.15.19:0/2151199454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7938162060 0x7f79380c9690 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.784+0000 7f793e7fd640 1 --2- 172.21.15.19:0/2151199454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7938161c80 0x7f793814be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.784+0000 7f793e7fd640 1 --2- 172.21.15.19:0/2151199454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79380b64b0 0x7f79380c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:52.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.784+0000 7f793e7fd640 1 -- 172.21.15.19:0/2151199454 >> 172.21.15.19:0/2151199454 conn(0x7f79380d44f0 msgr2=0x7f7938074740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:52.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.784+0000 7f793e7fd640 1 -- 172.21.15.19:0/2151199454 shutdown_connections 2024-09-12T02:03:52.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:52.784+0000 7f793e7fd640 1 -- 172.21.15.19:0/2151199454 wait complete. 2024-09-12T02:03:52.795 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:03:52.795 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:03:52.795 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T02:03:52.795 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:03:52.795 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:03:52.795 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:03:52.795 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:03:52.795 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:03:52.795 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:03:52.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:52.796 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T02:03:52.813 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:03:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:03:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:03:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T02:03:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:52.813 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:03:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:03:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T02:03:52.814 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:03:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:03:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T02:03:52.814 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:03:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:03:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T02:03:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:03:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42328sec preferred_lft 42328sec 2024-09-12T02:03:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T02:03:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:52.815 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:03:52.816 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:03:52.816 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T02:03:52.816 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:03:52.816 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T02:03:52.816 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:03:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T02:03:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:52.817 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:03:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:03:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T02:03:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:52.818 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:03:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:03:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T02:03:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:03:52.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:52.819 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:03:52.877 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T02:03:52.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:52.879 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T02:03:52.936 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T02:03:52.936 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:03:52.936 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:03:52.937 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:03:52.937 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:03:52.937 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:03:52.937 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T02:03:52.937 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:03:52.937 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:03:52.937 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:03:52.937 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T02:03:53.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:03:53.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:03:53.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:53.065 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T02:03:53.081 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:03:53.081 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:03:53.081 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:03:53.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:53.082 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T02:03:53.147 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:03:53.147 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:03:53.203 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:03:53.203 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:03:53.203 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:03:53.261 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:03:53.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:53.261 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:03:53.345 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:03:53.345 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:03:53.345 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:03:53.354 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:03:53.354 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:03:53.354 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:03:53.354 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:03:53.354 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:03:53.370 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:03:53.370 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:03:53.370 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:03:53.370 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:03:53.370 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:03:53.370 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T02:03:53.370 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T02:03:53.370 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T02:03:53.371 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:03:53.371 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:03:53.371 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:03:53.371 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:03:53.371 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:03:53.373 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:03:53.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:53.373 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:03:53.439 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:03:53.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:03:53.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:03:53.537 INFO:teuthology.orchestra.run.smithi019.stdout:client6896 2024-09-12T02:03:53.537 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:03:53.537 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:03:53.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:53.554 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2024-09-12T02:03:53.597 INFO:teuthology.orchestra.run:waiting for 20 2024-09-12T02:03:53.612 INFO:teuthology.orchestra.run.smithi019.stdout:.: 2024-09-12T02:03:53.613 INFO:teuthology.orchestra.run.smithi019.stdout:subdir 2024-09-12T02:03:53.613 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:53.613 INFO:teuthology.orchestra.run.smithi019.stdout:./subdir: 2024-09-12T02:03:53.613 INFO:teuthology.orchestra.run.smithi019.stdout:sixmegs 2024-09-12T02:03:53.613 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 400.00000000' did not caused DAMAGED state 2024-09-12T02:03:53.613 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 100.00000000.inode' 2024-09-12T02:03:53.613 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:03:53.613 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:03:53.669 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:03:53.669 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:03:53.689 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:03:53.690+0000 7faaab372640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:03:53.726 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:03:53.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.870+0000 7fce3eeba640 1 Processor -- start 2024-09-12T02:03:53.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.870+0000 7fce3eeba640 1 -- start start 2024-09-12T02:03:53.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.871+0000 7fce3eeba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce380d06e0 0x7fce380ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:53.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.871+0000 7fce3eeba640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce3809b510 0x7fce3809b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:53.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.871+0000 7fce3eeba640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce380d00a0 con 0x7fce3815d3e0 2024-09-12T02:03:53.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.871+0000 7fce3eeba640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fce3809b080 con 0x7fce3809b510 2024-09-12T02:03:53.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.871+0000 7fce3eeba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fce380d0380 con 0x7fce380d06e0 2024-09-12T02:03:53.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.871+0000 7fce3d457640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce3809b510 0x7fce3809b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:53.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.871+0000 7fce3cc56640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce380d06e0 0x7fce380ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:53.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.871+0000 7fce37fff640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fce3815d3e0 0x7fce380d0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:40790/0 (socket says 172.21.15.19:40790) 2024-09-12T02:03:53.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.871+0000 7fce3cc56640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce380d06e0 0x7fce380ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:44014/0 (socket says 172.21.15.19:44014) 2024-09-12T02:03:53.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.871+0000 7fce3d457640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce3809b510 0x7fce3809b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:48558/0 (socket says 172.21.15.19:48558) 2024-09-12T02:03:53.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.871+0000 7fce37fff640 1 -- 172.21.15.19:0/2029962286 learned_addr learned my addr 172.21.15.19:0/2029962286 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:53.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.871+0000 7fce377fe640 1 -- 172.21.15.19:0/2029962286 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 324554749 0 0) 0x7fce380d00a0 con 0x7fce3815d3e0 2024-09-12T02:03:53.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.871+0000 7fce377fe640 1 -- 172.21.15.19:0/2029962286 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce28003520 con 0x7fce3815d3e0 2024-09-12T02:03:53.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.871+0000 7fce3d457640 1 -- 172.21.15.19:0/2029962286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce380d06e0 msgr2=0x7fce380ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:53.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.871+0000 7fce3d457640 1 --2- 172.21.15.19:0/2029962286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce380d06e0 0x7fce380ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:53.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.871+0000 7fce3d457640 1 -- 172.21.15.19:0/2029962286 >> v1:172.21.15.135:6789/0 conn(0x7fce3815d3e0 legacy=0x7fce380d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:53.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.871+0000 7fce3d457640 1 -- 172.21.15.19:0/2029962286 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3809aa30 con 0x7fce3809b510 2024-09-12T02:03:53.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.871+0000 7fce3cc56640 1 --2- 172.21.15.19:0/2029962286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce380d06e0 0x7fce380ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:03:53.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.872+0000 7fce3d457640 1 --2- 172.21.15.19:0/2029962286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce3809b510 0x7fce3809b9c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fce30009d90 tx=0x7fce3002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae0dd4246390bfc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:53.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.872+0000 7fce377fe640 1 -- 172.21.15.19:0/2029962286 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce30007740 con 0x7fce3809b510 2024-09-12T02:03:53.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.872+0000 7fce377fe640 1 -- 172.21.15.19:0/2029962286 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce300078e0 con 0x7fce3809b510 2024-09-12T02:03:53.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.872+0000 7fce377fe640 1 -- 172.21.15.19:0/2029962286 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce30007c90 con 0x7fce3809b510 2024-09-12T02:03:53.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.873+0000 7fce3eeba640 1 -- 172.21.15.19:0/2029962286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce3809b510 msgr2=0x7fce3809b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:53.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.873+0000 7fce3eeba640 1 --2- 172.21.15.19:0/2029962286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce3809b510 0x7fce3809b9c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fce30009d90 tx=0x7fce3002a660 comp rx=0 tx=0).stop 2024-09-12T02:03:53.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.873+0000 7fce3eeba640 1 -- 172.21.15.19:0/2029962286 shutdown_connections 2024-09-12T02:03:53.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.873+0000 7fce3eeba640 1 --2- 172.21.15.19:0/2029962286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce3809b510 0x7fce3809b9c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:53.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.873+0000 7fce3eeba640 1 --2- 172.21.15.19:0/2029962286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce380d06e0 0x7fce380ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:53.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.873+0000 7fce3eeba640 1 -- 172.21.15.19:0/2029962286 >> 172.21.15.19:0/2029962286 conn(0x7fce380d23a0 msgr2=0x7fce380d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:53.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.873+0000 7fce3eeba640 1 -- 172.21.15.19:0/2029962286 shutdown_connections 2024-09-12T02:03:53.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.873+0000 7fce3eeba640 1 -- 172.21.15.19:0/2029962286 wait complete. 2024-09-12T02:03:53.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.874+0000 7fce3eeba640 1 Processor -- start 2024-09-12T02:03:53.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.874+0000 7fce3eeba640 1 -- start start 2024-09-12T02:03:53.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.875+0000 7fce3eeba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3809b510 0x7fce381597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:53.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.875+0000 7fce3eeba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce380d06e0 0x7fce3806e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:53.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.875+0000 7fce3eeba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3815d3e0 0x7fce3815a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:53.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.875+0000 7fce3eeba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fce3815c740 con 0x7fce3809b510 2024-09-12T02:03:53.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.875+0000 7fce3eeba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce3815d800 con 0x7fce380d06e0 2024-09-12T02:03:53.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.875+0000 7fce3eeba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fce380ccf90 con 0x7fce3815d3e0 2024-09-12T02:03:53.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.875+0000 7fce3cc56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3809b510 0x7fce381597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:53.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.875+0000 7fce3cc56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3809b510 0x7fce381597a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49904/0 (socket says 172.21.15.19:49904) 2024-09-12T02:03:53.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.875+0000 7fce3cc56640 1 -- 172.21.15.19:0/3533868047 learned_addr learned my addr 172.21.15.19:0/3533868047 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:53.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.875+0000 7fce37fff640 1 --2- 172.21.15.19:0/3533868047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce380d06e0 0x7fce3806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:53.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.875+0000 7fce3d457640 1 --2- 172.21.15.19:0/3533868047 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3815d3e0 0x7fce3815a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:53.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.876+0000 7fce3cc56640 1 -- 172.21.15.19:0/3533868047 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3815d3e0 msgr2=0x7fce3815a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:53.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.876+0000 7fce3cc56640 1 --2- 172.21.15.19:0/3533868047 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3815d3e0 0x7fce3815a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:53.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.876+0000 7fce3cc56640 1 -- 172.21.15.19:0/3533868047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce380d06e0 msgr2=0x7fce3806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:53.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.876+0000 7fce3cc56640 1 --2- 172.21.15.19:0/3533868047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce380d06e0 0x7fce3806e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:53.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.876+0000 7fce3cc56640 1 -- 172.21.15.19:0/3533868047 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce38159ce0 con 0x7fce3809b510 2024-09-12T02:03:53.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.876+0000 7fce37fff640 1 --2- 172.21.15.19:0/3533868047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce380d06e0 0x7fce3806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:03:53.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.876+0000 7fce3cc56640 1 --2- 172.21.15.19:0/3533868047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3809b510 0x7fce381597a0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00ebe0 tx=0x7fce2c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:53.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.876+0000 7fce357fa640 1 -- 172.21.15.19:0/3533868047 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c017070 con 0x7fce3809b510 2024-09-12T02:03:53.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.876+0000 7fce3eeba640 1 -- 172.21.15.19:0/3533868047 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce381f42e0 con 0x7fce3809b510 2024-09-12T02:03:53.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.876+0000 7fce357fa640 1 -- 172.21.15.19:0/3533868047 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce2c00cc30 con 0x7fce3809b510 2024-09-12T02:03:53.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.876+0000 7fce357fa640 1 -- 172.21.15.19:0/3533868047 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c013470 con 0x7fce3809b510 2024-09-12T02:03:53.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.876+0000 7fce3eeba640 1 -- 172.21.15.19:0/3533868047 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce381f48a0 con 0x7fce3809b510 2024-09-12T02:03:53.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.877+0000 7fce3eeba640 1 -- 172.21.15.19:0/3533868047 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce380d00a0 con 0x7fce3809b510 2024-09-12T02:03:53.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.877+0000 7fce357fa640 1 -- 172.21.15.19:0/3533868047 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce2c01a070 con 0x7fce3809b510 2024-09-12T02:03:53.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.878+0000 7fce357fa640 1 --2- 172.21.15.19:0/3533868047 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce1c06be60 0x7fce1c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:53.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.878+0000 7fce357fa640 1 -- 172.21.15.19:0/3533868047 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7249+0+0 (secure 0 0 0) 0x7fce2c08b300 con 0x7fce3809b510 2024-09-12T02:03:53.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.878+0000 7fce37fff640 1 --2- 172.21.15.19:0/3533868047 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce1c06be60 0x7fce1c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:53.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.879+0000 7fce37fff640 1 --2- 172.21.15.19:0/3533868047 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce1c06be60 0x7fce1c06e320 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fce24005880 tx=0x7fce24009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:53.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:53.882+0000 7fce357fa640 1 -- 172.21.15.19:0/3533868047 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce2c059060 con 0x7fce3809b510 2024-09-12T02:03:54.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.073+0000 7fce3eeba640 1 -- 172.21.15.19:0/3533868047 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fce3806cd50 con 0x7fce3809b510 2024-09-12T02:03:54.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.074+0000 7fce357fa640 1 -- 172.21.15.19:0/3533868047 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 24 entries v106) ==== 81+0+1464 (secure 0 0 0) 0x7fce3806cd50 con 0x7fce3809b510 2024-09-12T02:03:54.074 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/1875416968 2024-09-13T02:03:41.731211+0000 2024-09-12T02:03:54.074 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/4124612835 2024-09-13T02:03:35.697598+0000 2024-09-12T02:03:54.074 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/46689513 2024-09-13T02:03:28.654366+0000 2024-09-12T02:03:54.074 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3598057058 2024-09-13T02:03:24.636971+0000 2024-09-12T02:03:54.075 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3995150987 2024-09-13T02:03:22.315702+0000 2024-09-12T02:03:54.075 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3995150987 2024-09-13T02:03:22.315702+0000 2024-09-12T02:03:54.075 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:03:54.075 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/46689513 2024-09-13T02:03:28.654366+0000 2024-09-12T02:03:54.075 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/1101861733 2024-09-13T02:02:54.487980+0000 2024-09-12T02:03:54.075 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:03:54.075 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/2072535494 2024-09-13T02:02:44.440900+0000 2024-09-12T02:03:54.075 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/4124612835 2024-09-13T02:03:35.697598+0000 2024-09-12T02:03:54.075 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/2072535494 2024-09-13T02:02:44.440900+0000 2024-09-12T02:03:54.075 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/613869354 2024-09-13T02:02:39.104650+0000 2024-09-12T02:03:54.075 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3136344951 2024-09-13T02:02:58.521234+0000 2024-09-12T02:03:54.076 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/1875416968 2024-09-13T02:03:41.731211+0000 2024-09-12T02:03:54.076 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/4287312235 2024-09-13T02:03:11.277301+0000 2024-09-12T02:03:54.076 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/613869354 2024-09-13T02:02:39.104650+0000 2024-09-12T02:03:54.076 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/650556594 2024-09-13T02:02:50.470816+0000 2024-09-12T02:03:54.076 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/4287312235 2024-09-13T02:03:11.277301+0000 2024-09-12T02:03:54.076 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/650556594 2024-09-13T02:02:50.470816+0000 2024-09-12T02:03:54.076 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/1101861733 2024-09-13T02:02:54.487980+0000 2024-09-12T02:03:54.076 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3598057058 2024-09-13T02:03:24.636971+0000 2024-09-12T02:03:54.076 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3136344951 2024-09-13T02:02:58.521234+0000 2024-09-12T02:03:54.078 INFO:teuthology.orchestra.run.smithi019.stderr:listed 24 entries 2024-09-12T02:03:54.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.076+0000 7fce3eeba640 1 -- 172.21.15.19:0/3533868047 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce1c06be60 msgr2=0x7fce1c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:54.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.076+0000 7fce3eeba640 1 --2- 172.21.15.19:0/3533868047 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce1c06be60 0x7fce1c06e320 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fce24005880 tx=0x7fce24009040 comp rx=0 tx=0).stop 2024-09-12T02:03:54.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.076+0000 7fce3eeba640 1 -- 172.21.15.19:0/3533868047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3809b510 msgr2=0x7fce381597a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:54.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.076+0000 7fce3eeba640 1 --2- 172.21.15.19:0/3533868047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3809b510 0x7fce381597a0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00ebe0 tx=0x7fce2c00c520 comp rx=0 tx=0).stop 2024-09-12T02:03:54.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.076+0000 7fce3eeba640 1 -- 172.21.15.19:0/3533868047 shutdown_connections 2024-09-12T02:03:54.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.076+0000 7fce3eeba640 1 --2- 172.21.15.19:0/3533868047 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce1c06be60 0x7fce1c06e320 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.076+0000 7fce3eeba640 1 --2- 172.21.15.19:0/3533868047 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3815d3e0 0x7fce3815a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.076+0000 7fce3eeba640 1 --2- 172.21.15.19:0/3533868047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce380d06e0 0x7fce3806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.076+0000 7fce3eeba640 1 --2- 172.21.15.19:0/3533868047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3809b510 0x7fce381597a0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.076+0000 7fce3eeba640 1 -- 172.21.15.19:0/3533868047 >> 172.21.15.19:0/3533868047 conn(0x7fce380d23a0 msgr2=0x7fce380af370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:54.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.076+0000 7fce3eeba640 1 -- 172.21.15.19:0/3533868047 shutdown_connections 2024-09-12T02:03:54.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.076+0000 7fce3eeba640 1 -- 172.21.15.19:0/3533868047 wait complete. 2024-09-12T02:03:54.087 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:03:54.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:54.088 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-12T02:03:54.131 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:03:54.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:54.131 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:03:54.187 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:03:54.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.330+0000 7fb930f78640 1 Processor -- start 2024-09-12T02:03:54.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.331+0000 7fb930f78640 1 -- start start 2024-09-12T02:03:54.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.331+0000 7fb930f78640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb92c162060 0x7fb92c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:54.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.331+0000 7fb930f78640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb92c0b64b0 0x7fb92c0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:54.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.331+0000 7fb930f78640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb92c06d9f0 con 0x7fb92c161c80 2024-09-12T02:03:54.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.331+0000 7fb930f78640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb92c06dcd0 con 0x7fb92c162060 2024-09-12T02:03:54.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.331+0000 7fb930f78640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb92c06dfb0 con 0x7fb92c0b64b0 2024-09-12T02:03:54.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.332+0000 7fb929d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb92c162060 0x7fb92c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:54.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.332+0000 7fb929d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb92c162060 0x7fb92c0b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49912/0 (socket says 172.21.15.19:49912) 2024-09-12T02:03:54.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.332+0000 7fb929d9b640 1 -- 172.21.15.19:0/3313885977 learned_addr learned my addr 172.21.15.19:0/3313885977 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:54.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.332+0000 7fb92a59c640 1 --1- 172.21.15.19:0/3313885977 >> v1:172.21.15.19:6789/0 conn(0x7fb92c161c80 0x7fb92c06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36386/0 (socket says 172.21.15.19:36386) 2024-09-12T02:03:54.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.332+0000 7fb92ad9d640 1 --2- 172.21.15.19:0/3313885977 >> v2:172.21.15.135:3300/0 conn(0x7fb92c0b64b0 0x7fb92c0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:54.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.332+0000 7fb929d9b640 1 -- 172.21.15.19:0/3313885977 >> v2:172.21.15.135:3300/0 conn(0x7fb92c0b64b0 msgr2=0x7fb92c0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:54.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.332+0000 7fb929d9b640 1 --2- 172.21.15.19:0/3313885977 >> v2:172.21.15.135:3300/0 conn(0x7fb92c0b64b0 0x7fb92c0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.332+0000 7fb929d9b640 1 -- 172.21.15.19:0/3313885977 >> v1:172.21.15.19:6789/0 conn(0x7fb92c161c80 legacy=0x7fb92c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:54.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.332+0000 7fb929d9b640 1 -- 172.21.15.19:0/3313885977 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92c0d01f0 con 0x7fb92c162060 2024-09-12T02:03:54.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.333+0000 7fb929d9b640 1 --2- 172.21.15.19:0/3313885977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb92c162060 0x7fb92c0b5f70 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fb92c08d750 tx=0x7fb92002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aff56ea974ad548 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:54.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.333+0000 7fb92959a640 1 -- 172.21.15.19:0/3313885977 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb920037070 con 0x7fb92c162060 2024-09-12T02:03:54.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.333+0000 7fb92959a640 1 -- 172.21.15.19:0/3313885977 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb920032440 con 0x7fb92c162060 2024-09-12T02:03:54.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.333+0000 7fb92959a640 1 -- 172.21.15.19:0/3313885977 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb920032810 con 0x7fb92c162060 2024-09-12T02:03:54.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.333+0000 7fb930f78640 1 -- 172.21.15.19:0/3313885977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb92c162060 msgr2=0x7fb92c0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:54.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.333+0000 7fb930f78640 1 --2- 172.21.15.19:0/3313885977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb92c162060 0x7fb92c0b5f70 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fb92c08d750 tx=0x7fb92002a270 comp rx=0 tx=0).stop 2024-09-12T02:03:54.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.333+0000 7fb930f78640 1 -- 172.21.15.19:0/3313885977 shutdown_connections 2024-09-12T02:03:54.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.333+0000 7fb930f78640 1 --2- 172.21.15.19:0/3313885977 >> v2:172.21.15.135:3300/0 conn(0x7fb92c0b64b0 0x7fb92c0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.333+0000 7fb930f78640 1 --2- 172.21.15.19:0/3313885977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb92c162060 0x7fb92c0b5f70 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.333+0000 7fb930f78640 1 -- 172.21.15.19:0/3313885977 >> 172.21.15.19:0/3313885977 conn(0x7fb92c0d44f0 msgr2=0x7fb92c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:54.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.333+0000 7fb930f78640 1 -- 172.21.15.19:0/3313885977 shutdown_connections 2024-09-12T02:03:54.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.333+0000 7fb930f78640 1 -- 172.21.15.19:0/3313885977 wait complete. 2024-09-12T02:03:54.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.335+0000 7fb930f78640 1 Processor -- start 2024-09-12T02:03:54.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.335+0000 7fb930f78640 1 -- start start 2024-09-12T02:03:54.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.335+0000 7fb930f78640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb92c0b64b0 0x7fb92c159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:54.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.335+0000 7fb930f78640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb92c161c80 0x7fb92c0b7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:54.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb930f78640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb92c162060 0x7fb92c0b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:54.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb930f78640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c0cf1e0 con 0x7fb92c0b64b0 2024-09-12T02:03:54.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb930f78640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c0d2aa0 con 0x7fb92c161c80 2024-09-12T02:03:54.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb930f78640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb92c0cf360 con 0x7fb92c162060 2024-09-12T02:03:54.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb92a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb92c0b64b0 0x7fb92c159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:54.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb92a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb92c0b64b0 0x7fb92c159ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49918/0 (socket says 172.21.15.19:49918) 2024-09-12T02:03:54.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb92a59c640 1 -- 172.21.15.19:0/170618040 learned_addr learned my addr 172.21.15.19:0/170618040 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:54.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb929d9b640 1 --2- 172.21.15.19:0/170618040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb92c161c80 0x7fb92c0b7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:54.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb92ad9d640 1 --2- 172.21.15.19:0/170618040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb92c162060 0x7fb92c0b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:54.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb92a59c640 1 -- 172.21.15.19:0/170618040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb92c162060 msgr2=0x7fb92c0b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:54.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb92a59c640 1 --2- 172.21.15.19:0/170618040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb92c162060 0x7fb92c0b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb92a59c640 1 -- 172.21.15.19:0/170618040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb92c161c80 msgr2=0x7fb92c0b7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:54.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb92a59c640 1 --2- 172.21.15.19:0/170618040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb92c161c80 0x7fb92c0b7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb92a59c640 1 -- 172.21.15.19:0/170618040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92c0b9600 con 0x7fb92c0b64b0 2024-09-12T02:03:54.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb92ad9d640 1 --2- 172.21.15.19:0/170618040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb92c162060 0x7fb92c0b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:54.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb92a59c640 1 --2- 172.21.15.19:0/170618040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb92c0b64b0 0x7fb92c159ae0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00c400 tx=0x7fb91c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:54.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb91affd640 1 -- 172.21.15.19:0/170618040 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c0074e0 con 0x7fb92c0b64b0 2024-09-12T02:03:54.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb91affd640 1 -- 172.21.15.19:0/170618040 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c007680 con 0x7fb92c0b64b0 2024-09-12T02:03:54.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb930f78640 1 -- 172.21.15.19:0/170618040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92c0b9320 con 0x7fb92c0b64b0 2024-09-12T02:03:54.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb91affd640 1 -- 172.21.15.19:0/170618040 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c004a00 con 0x7fb92c0b64b0 2024-09-12T02:03:54.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.336+0000 7fb930f78640 1 -- 172.21.15.19:0/170618040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb92c0c8340 con 0x7fb92c0b64b0 2024-09-12T02:03:54.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.337+0000 7fb930f78640 1 -- 172.21.15.19:0/170618040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92c0b5f70 con 0x7fb92c0b64b0 2024-09-12T02:03:54.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.338+0000 7fb91affd640 1 -- 172.21.15.19:0/170618040 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb91c01a020 con 0x7fb92c0b64b0 2024-09-12T02:03:54.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.338+0000 7fb91affd640 1 --2- 172.21.15.19:0/170618040 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb90c06be30 0x7fb90c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:54.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.338+0000 7fb91affd640 1 -- 172.21.15.19:0/170618040 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7249+0+0 (secure 0 0 0) 0x7fb91c08ac40 con 0x7fb92c0b64b0 2024-09-12T02:03:54.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.339+0000 7fb929d9b640 1 --2- 172.21.15.19:0/170618040 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb90c06be30 0x7fb90c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:54.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.339+0000 7fb929d9b640 1 --2- 172.21.15.19:0/170618040 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb90c06be30 0x7fb90c06e2f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb920034000 tx=0x7fb92002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:54.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.342+0000 7fb91affd640 1 -- 172.21.15.19:0/170618040 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb91c059070 con 0x7fb92c0b64b0 2024-09-12T02:03:54.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.555+0000 7fb930f78640 1 -- 172.21.15.19:0/170618040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb92c0ba470 con 0x7fb92c0b64b0 2024-09-12T02:03:54.556 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:03:54.556+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:03:54.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.558+0000 7fb91affd640 1 -- 172.21.15.19:0/170618040 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v155) ==== 161+0+0 (secure 0 0 0) 0x7fb91c058970 con 0x7fb92c0b64b0 2024-09-12T02:03:54.558 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:03:54.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.560+0000 7fb930f78640 1 -- 172.21.15.19:0/170618040 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb90c06be30 msgr2=0x7fb90c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:54.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.560+0000 7fb930f78640 1 --2- 172.21.15.19:0/170618040 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb90c06be30 0x7fb90c06e2f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb920034000 tx=0x7fb92002e000 comp rx=0 tx=0).stop 2024-09-12T02:03:54.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.560+0000 7fb930f78640 1 -- 172.21.15.19:0/170618040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb92c0b64b0 msgr2=0x7fb92c159ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:54.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.560+0000 7fb930f78640 1 --2- 172.21.15.19:0/170618040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb92c0b64b0 0x7fb92c159ae0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00c400 tx=0x7fb91c00c8c0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.560+0000 7fb930f78640 1 -- 172.21.15.19:0/170618040 shutdown_connections 2024-09-12T02:03:54.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.560+0000 7fb930f78640 1 --2- 172.21.15.19:0/170618040 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb90c06be30 0x7fb90c06e2f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.560+0000 7fb930f78640 1 --2- 172.21.15.19:0/170618040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb92c162060 0x7fb92c0b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.560+0000 7fb930f78640 1 --2- 172.21.15.19:0/170618040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb92c161c80 0x7fb92c0b7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.560+0000 7fb930f78640 1 --2- 172.21.15.19:0/170618040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb92c0b64b0 0x7fb92c159ae0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.560+0000 7fb930f78640 1 -- 172.21.15.19:0/170618040 >> 172.21.15.19:0/170618040 conn(0x7fb92c0d44f0 msgr2=0x7fb92c0b4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:54.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.560+0000 7fb930f78640 1 -- 172.21.15.19:0/170618040 shutdown_connections 2024-09-12T02:03:54.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.560+0000 7fb930f78640 1 -- 172.21.15.19:0/170618040 wait complete. 2024-09-12T02:03:54.564 INFO:tasks.ceph.mds.d.smithi135.stderr: -83> 2024-09-12T02:03:53.690+0000 7faaab372640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:03:54.573 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:03:54.589 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T02:03:54.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.676+0000 7ff443303640 1 Processor -- start 2024-09-12T02:03:54.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.676+0000 7ff443303640 1 -- start start 2024-09-12T02:03:54.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.677+0000 7ff443303640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff43c15e5f0 0x7ff43c0d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:54.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.677+0000 7ff443303640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff43c0d30f0 0x7ff43c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:54.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.677+0000 7ff443303640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff43c0d3690 con 0x7ff43c0b64c0 2024-09-12T02:03:54.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.677+0000 7ff443303640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff43c06d530 con 0x7ff43c15e5f0 2024-09-12T02:03:54.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.677+0000 7ff443303640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff43c0d3970 con 0x7ff43c0d30f0 2024-09-12T02:03:54.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.677+0000 7ff44109f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff43c15e5f0 0x7ff43c0d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:54.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.677+0000 7ff44109f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff43c15e5f0 0x7ff43c0d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49920/0 (socket says 172.21.15.19:49920) 2024-09-12T02:03:54.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.677+0000 7ff44109f640 1 -- 172.21.15.19:0/166931722 learned_addr learned my addr 172.21.15.19:0/166931722 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:54.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.677+0000 7ff44089e640 1 --2- 172.21.15.19:0/166931722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff43c0d30f0 0x7ff43c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:54.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.677+0000 7ff44109f640 1 -- 172.21.15.19:0/166931722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff43c0d30f0 msgr2=0x7ff43c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:54.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.677+0000 7ff44109f640 1 --2- 172.21.15.19:0/166931722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff43c0d30f0 0x7ff43c0b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.677+0000 7ff44109f640 1 -- 172.21.15.19:0/166931722 >> v1:172.21.15.19:6789/0 conn(0x7ff43c0b64c0 legacy=0x7ff43c0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.677+0000 7ff433fff640 1 -- 172.21.15.19:0/166931722 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 157619533 0 0) 0x7ff43c0d3690 con 0x7ff43c0b64c0 2024-09-12T02:03:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.677+0000 7ff44109f640 1 -- 172.21.15.19:0/166931722 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c06cee0 con 0x7ff43c15e5f0 2024-09-12T02:03:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.678+0000 7ff44109f640 1 --2- 172.21.15.19:0/166931722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c15e5f0 0x7ff43c0d4dd0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7ff438009870 tx=0x7ff43802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa078d09035d1b33 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.678+0000 7ff433fff640 1 -- 172.21.15.19:0/166931722 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438037070 con 0x7ff43c15e5f0 2024-09-12T02:03:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.678+0000 7ff433fff640 1 -- 172.21.15.19:0/166931722 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff438032440 con 0x7ff43c15e5f0 2024-09-12T02:03:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.678+0000 7ff433fff640 1 -- 172.21.15.19:0/166931722 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438032810 con 0x7ff43c15e5f0 2024-09-12T02:03:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.679+0000 7ff443303640 1 -- 172.21.15.19:0/166931722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c15e5f0 msgr2=0x7ff43c0d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.679+0000 7ff443303640 1 --2- 172.21.15.19:0/166931722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c15e5f0 0x7ff43c0d4dd0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7ff438009870 tx=0x7ff43802a270 comp rx=0 tx=0).stop 2024-09-12T02:03:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.679+0000 7ff443303640 1 -- 172.21.15.19:0/166931722 shutdown_connections 2024-09-12T02:03:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.679+0000 7ff443303640 1 --2- 172.21.15.19:0/166931722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff43c0d30f0 0x7ff43c0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.679+0000 7ff443303640 1 --2- 172.21.15.19:0/166931722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c15e5f0 0x7ff43c0d4dd0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.679+0000 7ff443303640 1 -- 172.21.15.19:0/166931722 >> 172.21.15.19:0/166931722 conn(0x7ff43c08bfc0 msgr2=0x7ff43c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:54.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.679+0000 7ff443303640 1 -- 172.21.15.19:0/166931722 shutdown_connections 2024-09-12T02:03:54.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.679+0000 7ff443303640 1 -- 172.21.15.19:0/166931722 wait complete. 2024-09-12T02:03:54.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.680+0000 7ff443303640 1 Processor -- start 2024-09-12T02:03:54.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.680+0000 7ff443303640 1 -- start start 2024-09-12T02:03:54.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.681+0000 7ff443303640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff43c0b64c0 0x7ff43c0cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:54.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.681+0000 7ff443303640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c0d30f0 0x7ff43c15ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:54.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.681+0000 7ff443303640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff43c15e5f0 0x7ff43c0b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:54.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.681+0000 7ff443303640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c0d5310 con 0x7ff43c0d30f0 2024-09-12T02:03:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.681+0000 7ff443303640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c15e9d0 con 0x7ff43c0b64c0 2024-09-12T02:03:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.681+0000 7ff443303640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff43c06e9d0 con 0x7ff43c15e5f0 2024-09-12T02:03:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.681+0000 7ff44089e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c0d30f0 0x7ff43c15ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.681+0000 7ff44089e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c0d30f0 0x7ff43c15ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49924/0 (socket says 172.21.15.19:49924) 2024-09-12T02:03:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.681+0000 7ff44089e640 1 -- 172.21.15.19:0/3787114329 learned_addr learned my addr 172.21.15.19:0/3787114329 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.681+0000 7ff4418a0640 1 --2- 172.21.15.19:0/3787114329 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff43c15e5f0 0x7ff43c0b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.681+0000 7ff44109f640 1 --2- 172.21.15.19:0/3787114329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff43c0b64c0 0x7ff43c0cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.681+0000 7ff44089e640 1 -- 172.21.15.19:0/3787114329 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff43c15e5f0 msgr2=0x7ff43c0b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.681+0000 7ff44089e640 1 --2- 172.21.15.19:0/3787114329 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff43c15e5f0 0x7ff43c0b3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.681+0000 7ff44089e640 1 -- 172.21.15.19:0/3787114329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff43c0b64c0 msgr2=0x7ff43c0cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.681+0000 7ff44089e640 1 --2- 172.21.15.19:0/3787114329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff43c0b64c0 0x7ff43c0cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.681+0000 7ff44089e640 1 -- 172.21.15.19:0/3787114329 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c0cb720 con 0x7ff43c0d30f0 2024-09-12T02:03:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.682+0000 7ff44089e640 1 --2- 172.21.15.19:0/3787114329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c0d30f0 0x7ff43c15ad90 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00d7d0 tx=0x7ff42c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.682+0000 7ff431ffb640 1 -- 172.21.15.19:0/3787114329 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c004020 con 0x7ff43c0d30f0 2024-09-12T02:03:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.682+0000 7ff431ffb640 1 -- 172.21.15.19:0/3787114329 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff42c0041e0 con 0x7ff43c0d30f0 2024-09-12T02:03:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.682+0000 7ff431ffb640 1 -- 172.21.15.19:0/3787114329 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c0043d0 con 0x7ff43c0d30f0 2024-09-12T02:03:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.682+0000 7ff443303640 1 -- 172.21.15.19:0/3787114329 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff43c0ccc90 con 0x7ff43c0d30f0 2024-09-12T02:03:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.682+0000 7ff443303640 1 -- 172.21.15.19:0/3787114329 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff43c0cd4b0 con 0x7ff43c0d30f0 2024-09-12T02:03:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.683+0000 7ff443303640 1 -- 172.21.15.19:0/3787114329 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff43c0b5f80 con 0x7ff43c0d30f0 2024-09-12T02:03:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.683+0000 7ff431ffb640 1 -- 172.21.15.19:0/3787114329 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff42c01b020 con 0x7ff43c0d30f0 2024-09-12T02:03:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.684+0000 7ff431ffb640 1 --2- 172.21.15.19:0/3787114329 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff42006be60 0x7ff42006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.684+0000 7ff431ffb640 1 -- 172.21.15.19:0/3787114329 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 7335+0+0 (secure 0 0 0) 0x7ff42c08b150 con 0x7ff43c0d30f0 2024-09-12T02:03:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.684+0000 7ff44109f640 1 --2- 172.21.15.19:0/3787114329 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff42006be60 0x7ff42006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:54.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.685+0000 7ff44109f640 1 --2- 172.21.15.19:0/3787114329 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff42006be60 0x7ff42006e320 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff438034000 tx=0x7ff43802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:54.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.688+0000 7ff431ffb640 1 -- 172.21.15.19:0/3787114329 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff42c058e50 con 0x7ff43c0d30f0 2024-09-12T02:03:54.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:54.934+0000 7ff443303640 1 -- 172.21.15.19:0/3787114329 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7ff43c161da0 con 0x7ff43c0d30f0 2024-09-12T02:03:55.509 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:03:55.512 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:03:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.559+0000 7ff431ffb640 1 -- 172.21.15.19:0/3787114329 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v156) ==== 107+0+0 (secure 0 0 0) 0x7ff42c05d150 con 0x7ff43c0d30f0 2024-09-12T02:03:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:nothing to do: rank is not damaged 2024-09-12T02:03:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.561+0000 7ff443303640 1 -- 172.21.15.19:0/3787114329 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff42006be60 msgr2=0x7ff42006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.561+0000 7ff443303640 1 --2- 172.21.15.19:0/3787114329 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff42006be60 0x7ff42006e320 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff438034000 tx=0x7ff43802e000 comp rx=0 tx=0).stop 2024-09-12T02:03:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.561+0000 7ff443303640 1 -- 172.21.15.19:0/3787114329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c0d30f0 msgr2=0x7ff43c15ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.561+0000 7ff443303640 1 --2- 172.21.15.19:0/3787114329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c0d30f0 0x7ff43c15ad90 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00d7d0 tx=0x7ff42c00dc90 comp rx=0 tx=0).stop 2024-09-12T02:03:55.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.562+0000 7ff443303640 1 -- 172.21.15.19:0/3787114329 shutdown_connections 2024-09-12T02:03:55.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.562+0000 7ff443303640 1 --2- 172.21.15.19:0/3787114329 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff42006be60 0x7ff42006e320 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.562+0000 7ff443303640 1 --2- 172.21.15.19:0/3787114329 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff43c15e5f0 0x7ff43c0b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.562+0000 7ff443303640 1 --2- 172.21.15.19:0/3787114329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c0d30f0 0x7ff43c15ad90 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.562+0000 7ff443303640 1 --2- 172.21.15.19:0/3787114329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff43c0b64c0 0x7ff43c0cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.562+0000 7ff443303640 1 -- 172.21.15.19:0/3787114329 >> 172.21.15.19:0/3787114329 conn(0x7ff43c08bfc0 msgr2=0x7ff43c0d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:55.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.562+0000 7ff443303640 1 -- 172.21.15.19:0/3787114329 shutdown_connections 2024-09-12T02:03:55.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.562+0000 7ff443303640 1 -- 172.21.15.19:0/3787114329 wait complete. 2024-09-12T02:03:55.573 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:03:55.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.657+0000 7f97a728ff40 1 Processor -- start 2024-09-12T02:03:55.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.657+0000 7f97a728ff40 1 -- start start 2024-09-12T02:03:55.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.658+0000 7f97a728ff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561bbab89640 0x561bbac18050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.658+0000 7f97a728ff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bbac15d20 0x561bbab87300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.658+0000 7f97a728ff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561bbac16100 0x561bbab6d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.658+0000 7f97a728ff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561bbaa92510 con 0x561bbac16100 2024-09-12T02:03:55.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.658+0000 7f97a728ff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561bbaaebc50 con 0x561bbac15d20 2024-09-12T02:03:55.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.658+0000 7f97a728ff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x561bbab8a6b0 con 0x561bbab89640 2024-09-12T02:03:55.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.658+0000 7f97a5586640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561bbac16100 0x561bbab6d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.658+0000 7f97a5586640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561bbac16100 0x561bbab6d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49944/0 (socket says 172.21.15.19:49944) 2024-09-12T02:03:55.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.658+0000 7f97a5586640 1 -- 172.21.15.19:0/3783310008 learned_addr learned my addr 172.21.15.19:0/3783310008 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:55.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.658+0000 7f97a4d85640 1 --2- 172.21.15.19:0/3783310008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561bbab89640 0x561bbac18050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.658+0000 7f97a4584640 1 --2- 172.21.15.19:0/3783310008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bbac15d20 0x561bbab87300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.658+0000 7f97a5586640 1 -- 172.21.15.19:0/3783310008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561bbab89640 msgr2=0x561bbac18050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:55.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.658+0000 7f97a5586640 1 --2- 172.21.15.19:0/3783310008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561bbab89640 0x561bbac18050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.658+0000 7f97a5586640 1 -- 172.21.15.19:0/3783310008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bbac15d20 msgr2=0x561bbab87300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.658+0000 7f97a5586640 1 --2- 172.21.15.19:0/3783310008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bbac15d20 0x561bbab87300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.658+0000 7f97a5586640 1 -- 172.21.15.19:0/3783310008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bbab6e2c0 con 0x561bbac16100 2024-09-12T02:03:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.658+0000 7f97a5586640 1 --2- 172.21.15.19:0/3783310008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561bbac16100 0x561bbab6d3f0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f979c045b00 tx=0x7f979c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913e22034760000a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.659+0000 7f97a3582640 1 -- 172.21.15.19:0/3783310008 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c052ca0 con 0x561bbac16100 2024-09-12T02:03:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.659+0000 7f97a3582640 1 -- 172.21.15.19:0/3783310008 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f979c052e40 con 0x561bbac16100 2024-09-12T02:03:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.659+0000 7f97a3582640 1 -- 172.21.15.19:0/3783310008 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c0656a0 con 0x561bbac16100 2024-09-12T02:03:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.659+0000 7f97a728ff40 1 -- 172.21.15.19:0/3783310008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561bbac16100 msgr2=0x561bbab6d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.659+0000 7f97a728ff40 1 --2- 172.21.15.19:0/3783310008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561bbac16100 0x561bbab6d3f0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f979c045b00 tx=0x7f979c051000 comp rx=0 tx=0).stop 2024-09-12T02:03:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.659+0000 7f97a728ff40 1 -- 172.21.15.19:0/3783310008 shutdown_connections 2024-09-12T02:03:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.659+0000 7f97a728ff40 1 --2- 172.21.15.19:0/3783310008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561bbac16100 0x561bbab6d3f0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.659+0000 7f97a728ff40 1 --2- 172.21.15.19:0/3783310008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bbac15d20 0x561bbab87300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.659+0000 7f97a728ff40 1 --2- 172.21.15.19:0/3783310008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561bbab89640 0x561bbac18050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.659+0000 7f97a728ff40 1 -- 172.21.15.19:0/3783310008 >> 172.21.15.19:0/3783310008 conn(0x561bbab6e490 msgr2=0x561bbac16500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:55.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.659+0000 7f97a728ff40 1 -- 172.21.15.19:0/3783310008 shutdown_connections 2024-09-12T02:03:55.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.659+0000 7f97a728ff40 1 -- 172.21.15.19:0/3783310008 wait complete. 2024-09-12T02:03:55.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.660+0000 7f97a728ff40 1 Processor -- start 2024-09-12T02:03:55.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.660+0000 7f97a728ff40 1 -- start start 2024-09-12T02:03:55.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.660+0000 7f97a728ff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561bbab89640 0x561bbac11eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a728ff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bbac15d20 0x561bbac0c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a728ff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561bbac16100 0x561bbac0e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a728ff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561bbac155c0 con 0x561bbab89640 2024-09-12T02:03:55.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a728ff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561bbac15370 con 0x561bbac15d20 2024-09-12T02:03:55.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a728ff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x561bbab3f370 con 0x561bbac16100 2024-09-12T02:03:55.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a4d85640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561bbab89640 0x561bbac11eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a4d85640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561bbab89640 0x561bbac11eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49958/0 (socket says 172.21.15.19:49958) 2024-09-12T02:03:55.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 learned_addr learned my addr 172.21.15.19:0/2773942801 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:55.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a5586640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561bbac16100 0x561bbac0e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a4584640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bbac15d20 0x561bbac0c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561bbac16100 msgr2=0x561bbac0e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a4d85640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561bbac16100 0x561bbac0e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bbac15d20 msgr2=0x561bbac0c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a4d85640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bbac15d20 0x561bbac0c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bbac0caa0 con 0x561bbab89640 2024-09-12T02:03:55.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a5586640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561bbac16100 0x561bbac0e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:55.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a4584640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bbac15d20 0x561bbac0c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:55.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a4d85640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561bbab89640 0x561bbac11eb0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f979400d490 tx=0x7f979400d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:55.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a2580640 1 -- 172.21.15.19:0/2773942801 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794004120 con 0x561bbab89640 2024-09-12T02:03:55.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a2580640 1 -- 172.21.15.19:0/2773942801 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9794018070 con 0x561bbab89640 2024-09-12T02:03:55.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561bbac14740 con 0x561bbab89640 2024-09-12T02:03:55.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a2580640 1 -- 172.21.15.19:0/2773942801 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794012830 con 0x561bbab89640 2024-09-12T02:03:55.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.661+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bbac0dbc0 con 0x561bbab89640 2024-09-12T02:03:55.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.663+0000 7f97a2580640 1 -- 172.21.15.19:0/2773942801 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f97940129d0 con 0x561bbab89640 2024-09-12T02:03:55.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.663+0000 7f97a2580640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f979006a810 0x7f979006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.663+0000 7f97a2580640 1 -- 172.21.15.19:0/2773942801 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 7335+0+0 (secure 0 0 0) 0x7f979408a2c0 con 0x561bbab89640 2024-09-12T02:03:55.666 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:03:55.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.663+0000 7f97a4584640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f979006a810 0x7f979006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.663+0000 7f97a728ff40 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x561bbab87e50 0x561bbab86b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.663+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbac14e30 con 0x561bbab87e50 2024-09-12T02:03:55.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.664+0000 7f97a5586640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x561bbab87e50 0x561bbab86b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.664+0000 7f97a4584640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f979006a810 0x7f979006ccd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x561bbac19800 tx=0x7f9798001790 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:55.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.664+0000 7f97a5586640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x561bbab87e50 0x561bbab86b20 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:55.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.665+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v107'381 uv355 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.665+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbac0ee10 con 0x561bbab87e50 2024-09-12T02:03:55.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.666+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v107'382 uv382 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.666+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbab87060 con 0x561bbab87e50 2024-09-12T02:03:55.669 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:03:55.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.667+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v107'383 uv383 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.667+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbbb90 con 0x561bbab87e50 2024-09-12T02:03:55.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.668+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v107'384 uv384 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.668+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbbf30 con 0x561bbab87e50 2024-09-12T02:03:55.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.669+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v107'385 uv385 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.669+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbab80 con 0x561bbab87e50 2024-09-12T02:03:55.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.670+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v107'386 uv386 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.670+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbaf20 con 0x561bbab87e50 2024-09-12T02:03:55.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.671+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v107'387 uv361 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.671+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbaf20 con 0x561bbab87e50 2024-09-12T02:03:55.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.672+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v107'388 uv388 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.672+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbaf20 con 0x561bbab87e50 2024-09-12T02:03:55.674 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:03:55.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.674+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v107'389 uv389 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.674+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbaf20 con 0x561bbab87e50 2024-09-12T02:03:55.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.675+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v107'390 uv390 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.675+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbaf20 con 0x561bbab87e50 2024-09-12T02:03:55.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.676+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v107'391 uv391 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.676+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbaf20 con 0x561bbab87e50 2024-09-12T02:03:55.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.677+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v107'392 uv392 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.677+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbaf20 con 0x561bbab87e50 2024-09-12T02:03:55.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.678+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v107'393 uv368 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.678+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbaf20 con 0x561bbab87e50 2024-09-12T02:03:55.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.679+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v107'394 uv394 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.679+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbaf20 con 0x561bbab87e50 2024-09-12T02:03:55.680 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:03:55.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.680+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v107'395 uv395 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.680+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbaf20 con 0x561bbab87e50 2024-09-12T02:03:55.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.681+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v107'396 uv396 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.681+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbaf20 con 0x561bbab87e50 2024-09-12T02:03:55.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.682+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v107'397 uv397 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.682+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbaf20 con 0x561bbab87e50 2024-09-12T02:03:55.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.683+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v107'398 uv398 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.683+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbb7b0 con 0x561bbab87e50 2024-09-12T02:03:55.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.684+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v107'399 uv399 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.684+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbb7b0 con 0x561bbab87e50 2024-09-12T02:03:55.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.685+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v107'400 uv374 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.685+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbb7b0 con 0x561bbab87e50 2024-09-12T02:03:55.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.686+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v107'401 uv401 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.686+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbb680 con 0x561bbab87e50 2024-09-12T02:03:55.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.687+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v107'402 uv402 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.687 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:03:55.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.687+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbb680 con 0x561bbab87e50 2024-09-12T02:03:55.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.688+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v107'403 uv403 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.688+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbb680 con 0x561bbab87e50 2024-09-12T02:03:55.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.689+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v107'404 uv404 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.689+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbb680 con 0x561bbab87e50 2024-09-12T02:03:55.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.689+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v107'405 uv405 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.690+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbb680 con 0x561bbab87e50 2024-09-12T02:03:55.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.691+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v107'406 uv380 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.691+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbb680 con 0x561bbab87e50 2024-09-12T02:03:55.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.691+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v107'407 uv407 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.691+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbb680 con 0x561bbab87e50 2024-09-12T02:03:55.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.692+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v107'408 uv408 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.693 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:03:55.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.692+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbb680 con 0x561bbab87e50 2024-09-12T02:03:55.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.693+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v107'409 uv409 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.693+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbb680 con 0x561bbab87e50 2024-09-12T02:03:55.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.694+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v107'410 uv410 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.694+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbb680 con 0x561bbab87e50 2024-09-12T02:03:55.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.695+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v107'411 uv411 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbab87e50 2024-09-12T02:03:55.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.695+0000 7f97a728ff40 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x561bbacbc7e0 0x561bbacbebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.695+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbb680 con 0x561bbacbc7e0 2024-09-12T02:03:55.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.695+0000 7f97a4d85640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x561bbacbc7e0 0x561bbacbebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.696+0000 7f97a4d85640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x561bbacbc7e0 0x561bbacbebd0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:55.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.697+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v107'288 uv267 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.697+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbf110 con 0x561bbacbc7e0 2024-09-12T02:03:55.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.699+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v107'289 uv289 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.699+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbf4b0 con 0x561bbacbc7e0 2024-09-12T02:03:55.700 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:03:55.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.700+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v107'290 uv290 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.700+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbfd00 con 0x561bbacbc7e0 2024-09-12T02:03:55.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.701+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v107'291 uv291 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.701+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc00a0 con 0x561bbacbc7e0 2024-09-12T02:03:55.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.702+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v107'292 uv292 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.702+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc0440 con 0x561bbacbc7e0 2024-09-12T02:03:55.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.704+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v107'293 uv286 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.704+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc07e0 con 0x561bbacbc7e0 2024-09-12T02:03:55.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.705+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v107'294 uv294 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.705+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc0b80 con 0x561bbacbc7e0 2024-09-12T02:03:55.706 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:03:55.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.706+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v107'295 uv295 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.706+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc0b80 con 0x561bbacbc7e0 2024-09-12T02:03:55.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.707+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v107'296 uv296 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.707+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc0b80 con 0x561bbacbc7e0 2024-09-12T02:03:55.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.708+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v107'297 uv297 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.708+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc0b80 con 0x561bbacbc7e0 2024-09-12T02:03:55.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.710+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v107'298 uv287 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.710+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc0b80 con 0x561bbacbc7e0 2024-09-12T02:03:55.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.711+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v107'299 uv299 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.711+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc0b80 con 0x561bbacbc7e0 2024-09-12T02:03:55.712 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:03:55.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.712+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v107'300 uv300 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.712+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc5000 con 0x561bbacbc7e0 2024-09-12T02:03:55.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.713+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v107'301 uv301 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.713+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc5000 con 0x561bbacbc7e0 2024-09-12T02:03:55.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.714+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v107'302 uv302 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.714+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc0b80 con 0x561bbacbc7e0 2024-09-12T02:03:55.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.716+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v107'303 uv283 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.716+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc0b80 con 0x561bbacbc7e0 2024-09-12T02:03:55.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.717+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v107'304 uv304 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.717+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc0b80 con 0x561bbacbc7e0 2024-09-12T02:03:55.718 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:03:55.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.718+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v107'305 uv305 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.718+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc1b90 con 0x561bbacbc7e0 2024-09-12T02:03:55.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.719+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v107'306 uv306 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.719+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc1b90 con 0x561bbacbc7e0 2024-09-12T02:03:55.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.720+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v107'307 uv307 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.720+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc0b80 con 0x561bbacbc7e0 2024-09-12T02:03:55.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.721+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v107'308 uv308 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacbc7e0 2024-09-12T02:03:55.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.721+0000 7f97a728ff40 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x561bbacc1090 0x561bbacc3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.721+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc39c0 con 0x561bbacc1090 2024-09-12T02:03:55.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.721+0000 7f97a4584640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x561bbacc1090 0x561bbacc3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.722+0000 7f97a4584640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x561bbacc1090 0x561bbacc3480 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:55.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.723+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v107'75 uv74 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.723+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc3d60 con 0x561bbacc1090 2024-09-12T02:03:55.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.724+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v107'76 uv76 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.724+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc4210 con 0x561bbacc1090 2024-09-12T02:03:55.726 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:03:55.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.725+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v107'77 uv77 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.725+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacbf950 con 0x561bbacc1090 2024-09-12T02:03:55.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.726+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v107'78 uv78 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.726+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc5ba0 con 0x561bbacc1090 2024-09-12T02:03:55.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.727+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v107'79 uv79 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.727+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc4ab0 con 0x561bbacc1090 2024-09-12T02:03:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.728+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v107'80 uv80 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.728+0000 7f97a728ff40 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x561bbacc5570 0x561bbacc7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.728+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc8570 con 0x561bbacc5570 2024-09-12T02:03:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.728+0000 7f97a5586640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x561bbacc5570 0x561bbacc7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.729+0000 7f97a5586640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x561bbacc5570 0x561bbacc7fd0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:55.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.730+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v107'60 uv59 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.730+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc8960 con 0x561bbacc5570 2024-09-12T02:03:55.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.732+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v107'61 uv61 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.732+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc8960 con 0x561bbacc5570 2024-09-12T02:03:55.733 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:03:55.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.733+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v107'62 uv62 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.733+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacc8960 con 0x561bbacc5570 2024-09-12T02:03:55.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.735+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v107'63 uv63 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.735+0000 7f97a728ff40 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561bbacc9290 0x561bbaccb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.735+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccbbc0 con 0x561bbacc9290 2024-09-12T02:03:55.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.736+0000 7f97a4d85640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561bbacc9290 0x561bbaccb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.736+0000 7f97a4d85640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561bbacc9290 0x561bbaccb680 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:55.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.737+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v107'75 uv74 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.737+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccbbc0 con 0x561bbacc9290 2024-09-12T02:03:55.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.738+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v107'76 uv76 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.739+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccbc40 con 0x561bbacc9290 2024-09-12T02:03:55.740 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:03:55.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.740+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v107'77 uv77 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.740+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccd040 con 0x561bbacc9290 2024-09-12T02:03:55.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.741+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v107'78 uv78 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.741+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccd040 con 0x561bbacc9290 2024-09-12T02:03:55.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.742+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v107'79 uv79 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.742+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc9290 2024-09-12T02:03:55.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.745+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v107'80 uv80 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.745+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc5570 2024-09-12T02:03:55.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.747+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v107'138 uv132 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.747+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc5570 2024-09-12T02:03:55.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.748+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v107'139 uv139 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.748+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc5570 2024-09-12T02:03:55.749 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:03:55.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.749+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v107'140 uv140 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.749+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccd040 con 0x561bbacc5570 2024-09-12T02:03:55.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.750+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v107'141 uv141 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.750+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccd040 con 0x561bbacc5570 2024-09-12T02:03:55.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.751+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v107'142 uv142 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.751+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc5570 2024-09-12T02:03:55.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.752+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v107'143 uv143 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.752+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc5570 2024-09-12T02:03:55.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.753+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v107'144 uv137 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.753+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc5570 2024-09-12T02:03:55.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.754+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v107'145 uv145 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.754+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc5570 2024-09-12T02:03:55.755 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:03:55.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.755+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v107'146 uv146 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.755+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc5570 2024-09-12T02:03:55.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.756+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v107'147 uv147 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.756+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc5570 2024-09-12T02:03:55.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.758+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v107'148 uv148 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.758+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc5570 2024-09-12T02:03:55.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.759+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v107'61 uv60 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.759+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc5570 2024-09-12T02:03:55.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.760+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v107'62 uv62 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.760+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc5570 2024-09-12T02:03:55.761 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:03:55.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.761+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v107'63 uv63 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.761+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc5570 2024-09-12T02:03:55.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.762+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v107'64 uv64 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.762+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc5570 2024-09-12T02:03:55.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.763+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v107'65 uv65 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f979c065480 con 0x561bbacc5570 2024-09-12T02:03:55.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.763+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc9290 2024-09-12T02:03:55.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.764+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v107'75 uv74 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.764+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc9290 2024-09-12T02:03:55.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.765+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v107'76 uv76 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.765+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc9290 2024-09-12T02:03:55.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.766+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v107'77 uv77 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.766 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:03:55.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.766+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccd040 con 0x561bbacc9290 2024-09-12T02:03:55.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.767+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v107'78 uv78 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.767+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccd040 con 0x561bbacc9290 2024-09-12T02:03:55.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.768+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v107'79 uv79 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.768+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc9290 2024-09-12T02:03:55.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.769+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v107'80 uv80 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.769+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc9290 2024-09-12T02:03:55.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.770+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v107'122 uv116 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.770+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc9290 2024-09-12T02:03:55.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.771+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v107'123 uv123 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.771+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc9290 2024-09-12T02:03:55.772 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:03:55.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.772+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v107'124 uv124 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.772+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc9290 2024-09-12T02:03:55.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.773+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v107'125 uv125 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.773+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc9290 2024-09-12T02:03:55.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.774+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v107'126 uv126 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.774+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc9290 2024-09-12T02:03:55.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.775+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v107'127 uv121 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.775+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc9290 2024-09-12T02:03:55.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.776+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v107'128 uv128 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.776+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc9290 2024-09-12T02:03:55.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.776+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v107'129 uv129 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.777 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:03:55.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.777+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccc030 con 0x561bbacc9290 2024-09-12T02:03:55.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.777+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v107'130 uv130 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.777+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccee40 con 0x561bbacc9290 2024-09-12T02:03:55.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.778+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v107'131 uv131 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.779+0000 7f97a728ff40 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x561bbacccb60 0x561bbaccf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.779+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccef50 con 0x561bbacccb60 2024-09-12T02:03:55.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.779+0000 7f97a4584640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x561bbacccb60 0x561bbaccf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.779+0000 7f97a4584640 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x561bbacccb60 0x561bbaccf440 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:55.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.780+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v107'57 uv55 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacccb60 2024-09-12T02:03:55.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.780+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccf980 con 0x561bbacccb60 2024-09-12T02:03:55.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.781+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v107'58 uv58 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacccb60 2024-09-12T02:03:55.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.781+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfd20 con 0x561bbacccb60 2024-09-12T02:03:55.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.782+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v107'59 uv59 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacccb60 2024-09-12T02:03:55.783 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:03:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.782+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfd20 con 0x561bbacccb60 2024-09-12T02:03:55.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.783+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v107'60 uv60 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacccb60 2024-09-12T02:03:55.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.783+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfd20 con 0x561bbacc9290 2024-09-12T02:03:55.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.784+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v107'75 uv74 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.785+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfd20 con 0x561bbacc9290 2024-09-12T02:03:55.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.786+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v107'76 uv76 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.786+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfd20 con 0x561bbacc9290 2024-09-12T02:03:55.787 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:03:55.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.787+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v107'77 uv77 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.787+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacd0d30 con 0x561bbacc9290 2024-09-12T02:03:55.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.788+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v107'78 uv78 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.788+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacd0d30 con 0x561bbacc9290 2024-09-12T02:03:55.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.789+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v107'79 uv79 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.789+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfd20 con 0x561bbacc9290 2024-09-12T02:03:55.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.790+0000 7f97a4d85640 1 -- 172.21.15.19:0/2773942801 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v107'80 uv80 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9794006c60 con 0x561bbacc9290 2024-09-12T02:03:55.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.790+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfd20 con 0x561bbacc1090 2024-09-12T02:03:55.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.791+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v107'64 uv63 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.791+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfd20 con 0x561bbacc1090 2024-09-12T02:03:55.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.792+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v107'65 uv65 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.792+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfd20 con 0x561bbacc1090 2024-09-12T02:03:55.793 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:03:55.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.793+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v107'66 uv66 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.794+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfd20 con 0x561bbacc1090 2024-09-12T02:03:55.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.795+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v107'67 uv67 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.795+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfd20 con 0x561bbacc1090 2024-09-12T02:03:55.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.796+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v107'68 uv68 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.796+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfd20 con 0x561bbacc1090 2024-09-12T02:03:55.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.797+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v107'157 uv148 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.797+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfd20 con 0x561bbacc1090 2024-09-12T02:03:55.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.798+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v107'158 uv158 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.799+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfd20 con 0x561bbacc1090 2024-09-12T02:03:55.800 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:03:55.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.799+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v107'159 uv159 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.800+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacd0110 con 0x561bbacc1090 2024-09-12T02:03:55.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.801+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v107'160 uv160 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.801+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacd0110 con 0x561bbacc1090 2024-09-12T02:03:55.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.802+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v107'161 uv161 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.802+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfdd0 con 0x561bbacc1090 2024-09-12T02:03:55.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.803+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v107'162 uv155 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.803+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfd60 con 0x561bbacc1090 2024-09-12T02:03:55.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.804+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v107'163 uv163 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.804+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfd20 con 0x561bbacc1090 2024-09-12T02:03:55.805 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:03:55.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.805+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v107'164 uv164 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.805+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfd60 con 0x561bbacc1090 2024-09-12T02:03:55.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.806+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v107'165 uv165 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.806+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacd0d30 con 0x561bbacc1090 2024-09-12T02:03:55.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.807+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v107'166 uv166 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.807+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbaccfd20 con 0x561bbacc1090 2024-09-12T02:03:55.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.808+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v107'167 uv167 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.808+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x561bbacd01d0 con 0x561bbacc1090 2024-09-12T02:03:55.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a4584640 1 -- 172.21.15.19:0/2773942801 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v107'168 uv168 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f979801a040 con 0x561bbacc1090 2024-09-12T02:03:55.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x561bbacbc7e0 msgr2=0x561bbacbebd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x561bbacbc7e0 0x561bbacbebd0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x561bbab87e50 msgr2=0x561bbab86b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x561bbab87e50 0x561bbab86b20 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x561bbacc5570 msgr2=0x561bbacc7fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x561bbacc5570 0x561bbacc7fd0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x561bbacccb60 msgr2=0x561bbaccf440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x561bbacccb60 0x561bbaccf440 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x561bbacc1090 msgr2=0x561bbacc3480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x561bbacc1090 0x561bbacc3480 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561bbacc9290 msgr2=0x561bbaccb680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x561bbacc9290 0x561bbaccb680 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 reap_dead start 2024-09-12T02:03:55.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a5586640 1 -- 172.21.15.19:0/2773942801 reap_dead start 2024-09-12T02:03:55.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f979006a810 msgr2=0x7f979006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f979006a810 0x7f979006ccd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x561bbac19800 tx=0x7f9798001790 comp rx=0 tx=0).stop 2024-09-12T02:03:55.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561bbab89640 msgr2=0x561bbac11eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561bbab89640 0x561bbac11eb0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f979400d490 tx=0x7f979400d950 comp rx=0 tx=0).stop 2024-09-12T02:03:55.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 shutdown_connections 2024-09-12T02:03:55.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f979006a810 0x7f979006ccd0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 --2- 172.21.15.19:0/2773942801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561bbab89640 0x561bbac11eb0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 >> 172.21.15.19:0/2773942801 conn(0x561bbab6e490 msgr2=0x561bbac17090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:55.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 shutdown_connections 2024-09-12T02:03:55.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.809+0000 7f97a728ff40 1 -- 172.21.15.19:0/2773942801 wait complete. 2024-09-12T02:03:55.813 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 100.00000000.inode 2024-09-12T02:03:55.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.897+0000 7f0dcc745f40 1 Processor -- start 2024-09-12T02:03:55.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.897+0000 7f0dcc745f40 1 -- start start 2024-09-12T02:03:55.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.898+0000 7f0dcc745f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db4003630 0x5573cedbfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.898+0000 7f0dcc745f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573cee95490 0x5573cee949e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.898+0000 7f0dcc745f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573cedbbe10 0x5573cedbc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.898+0000 7f0dcc745f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5573ced0f510 con 0x5573cedbbe10 2024-09-12T02:03:55.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.898+0000 7f0dcc745f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5573ced68c50 con 0x7f0db4003630 2024-09-12T02:03:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.898+0000 7f0dcc745f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5573cedbcdc0 con 0x5573cee95490 2024-09-12T02:03:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.898+0000 7f0dcaa3c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573cedbbe10 0x5573cedbc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.898+0000 7f0dcaa3c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573cedbbe10 0x5573cedbc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49972/0 (socket says 172.21.15.19:49972) 2024-09-12T02:03:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.898+0000 7f0dcaa3c640 1 -- 172.21.15.19:0/3696498966 learned_addr learned my addr 172.21.15.19:0/3696498966 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.898+0000 7f0dc9a3a640 1 --2- 172.21.15.19:0/3696498966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573cee95490 0x5573cee949e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.898+0000 7f0dca23b640 1 --2- 172.21.15.19:0/3696498966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db4003630 0x5573cedbfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.898+0000 7f0dcaa3c640 1 -- 172.21.15.19:0/3696498966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573cee95490 msgr2=0x5573cee949e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.898+0000 7f0dcaa3c640 1 --2- 172.21.15.19:0/3696498966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573cee95490 0x5573cee949e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.898+0000 7f0dcaa3c640 1 -- 172.21.15.19:0/3696498966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db4003630 msgr2=0x5573cedbfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.898+0000 7f0dcaa3c640 1 --2- 172.21.15.19:0/3696498966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db4003630 0x5573cedbfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.898+0000 7f0dcaa3c640 1 -- 172.21.15.19:0/3696498966 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573cede97a0 con 0x5573cedbbe10 2024-09-12T02:03:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.899+0000 7f0dcaa3c640 1 --2- 172.21.15.19:0/3696498966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573cedbbe10 0x5573cedbc290 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4046500 tx=0x7f0dc404f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa526a476872c49 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.899+0000 7f0dc8a38640 1 -- 172.21.15.19:0/3696498966 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc401a3e0 con 0x5573cedbbe10 2024-09-12T02:03:55.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.899+0000 7f0dc8a38640 1 -- 172.21.15.19:0/3696498966 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dc4065070 con 0x5573cedbbe10 2024-09-12T02:03:55.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.899+0000 7f0dc8a38640 1 -- 172.21.15.19:0/3696498966 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4005430 con 0x5573cedbbe10 2024-09-12T02:03:55.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.899+0000 7f0dcc745f40 1 -- 172.21.15.19:0/3696498966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573cedbbe10 msgr2=0x5573cedbc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.899+0000 7f0dcc745f40 1 --2- 172.21.15.19:0/3696498966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573cedbbe10 0x5573cedbc290 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4046500 tx=0x7f0dc404f000 comp rx=0 tx=0).stop 2024-09-12T02:03:55.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.899+0000 7f0dcc745f40 1 -- 172.21.15.19:0/3696498966 shutdown_connections 2024-09-12T02:03:55.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.899+0000 7f0dcc745f40 1 --2- 172.21.15.19:0/3696498966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573cedbbe10 0x5573cedbc290 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.899+0000 7f0dcc745f40 1 --2- 172.21.15.19:0/3696498966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573cee95490 0x5573cee949e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.899+0000 7f0dcc745f40 1 --2- 172.21.15.19:0/3696498966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db4003630 0x5573cedbfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.899+0000 7f0dcc745f40 1 -- 172.21.15.19:0/3696498966 >> 172.21.15.19:0/3696498966 conn(0x5573cedbd9e0 msgr2=0x5573cede9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:55.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.899+0000 7f0dcc745f40 1 -- 172.21.15.19:0/3696498966 shutdown_connections 2024-09-12T02:03:55.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.899+0000 7f0dcc745f40 1 -- 172.21.15.19:0/3696498966 wait complete. 2024-09-12T02:03:55.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.900+0000 7f0dcc745f40 1 Processor -- start 2024-09-12T02:03:55.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.900+0000 7f0dcc745f40 1 -- start start 2024-09-12T02:03:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dcc745f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573cedbbe10 0x5573cee78bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dcc745f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cee95490 0x5573cee93cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dcc745f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0db4003630 0x5573cee7cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dcc745f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5573ceded430 con 0x5573cedbbe10 2024-09-12T02:03:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dcc745f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5573ceded150 con 0x5573cee95490 2024-09-12T02:03:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dcc745f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5573ceded9f0 con 0x7f0db4003630 2024-09-12T02:03:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dca23b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573cedbbe10 0x5573cee78bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dca23b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573cedbbe10 0x5573cee78bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49974/0 (socket says 172.21.15.19:49974) 2024-09-12T02:03:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dca23b640 1 -- 172.21.15.19:0/4002817917 learned_addr learned my addr 172.21.15.19:0/4002817917 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dc9a3a640 1 --2- 172.21.15.19:0/4002817917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cee95490 0x5573cee93cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dcaa3c640 1 --2- 172.21.15.19:0/4002817917 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0db4003630 0x5573cee7cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dca23b640 1 -- 172.21.15.19:0/4002817917 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0db4003630 msgr2=0x5573cee7cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dca23b640 1 --2- 172.21.15.19:0/4002817917 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0db4003630 0x5573cee7cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dca23b640 1 -- 172.21.15.19:0/4002817917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cee95490 msgr2=0x5573cee93cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dca23b640 1 --2- 172.21.15.19:0/4002817917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cee95490 0x5573cee93cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dca23b640 1 -- 172.21.15.19:0/4002817917 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573cef2bc40 con 0x5573cedbbe10 2024-09-12T02:03:55.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dca23b640 1 --2- 172.21.15.19:0/4002817917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573cedbbe10 0x5573cee78bc0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0116b0 tx=0x7f0dbc011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:55.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dbb7fe640 1 -- 172.21.15.19:0/4002817917 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00f850 con 0x5573cedbbe10 2024-09-12T02:03:55.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.901+0000 7f0dbb7fe640 1 -- 172.21.15.19:0/4002817917 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dbc016030 con 0x5573cedbbe10 2024-09-12T02:03:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.902+0000 7f0dcc745f40 1 -- 172.21.15.19:0/4002817917 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573cee7c470 con 0x5573cedbbe10 2024-09-12T02:03:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.902+0000 7f0dbb7fe640 1 -- 172.21.15.19:0/4002817917 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00fbf0 con 0x5573cedbbe10 2024-09-12T02:03:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.902+0000 7f0dcc745f40 1 -- 172.21.15.19:0/4002817917 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573cee7ca30 con 0x5573cedbbe10 2024-09-12T02:03:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.903+0000 7f0dbb7fe640 1 -- 172.21.15.19:0/4002817917 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0dbc00e050 con 0x5573cedbbe10 2024-09-12T02:03:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.903+0000 7f0dbb7fe640 1 --2- 172.21.15.19:0/4002817917 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0dac06a810 0x7f0dac06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.903+0000 7f0dbb7fe640 1 -- 172.21.15.19:0/4002817917 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 7335+0+0 (secure 0 0 0) 0x7f0dbc08a9c0 con 0x5573cedbbe10 2024-09-12T02:03:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.904+0000 7f0dc9a3a640 1 --2- 172.21.15.19:0/4002817917 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0dac06a810 0x7f0dac06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.904+0000 7f0dcc745f40 1 --2- 172.21.15.19:0/4002817917 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5573cee7a7b0 0x5573cee7ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.904+0000 7f0dcc745f40 1 -- 172.21.15.19:0/4002817917 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x5573cee7b160 con 0x5573cee7a7b0 2024-09-12T02:03:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.904+0000 7f0dcaa3c640 1 --2- 172.21.15.19:0/4002817917 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5573cee7a7b0 0x5573cee7ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.904+0000 7f0dc9a3a640 1 --2- 172.21.15.19:0/4002817917 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0dac06a810 0x7f0dac06ccd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x5573cee7db60 tx=0x7f0dc0011040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.904+0000 7f0dcaa3c640 1 --2- 172.21.15.19:0/4002817917 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5573cee7a7b0 0x5573cee7ac20 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.906+0000 7f0dcaa3c640 1 -- 172.21.15.19:0/4002817917 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 100.00000000.inode [delete] v107'169 uv169 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f0dc4005040 con 0x5573cee7a7b0 2024-09-12T02:03:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.906+0000 7f0dcc745f40 1 -- 172.21.15.19:0/4002817917 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5573cee7a7b0 msgr2=0x5573cee7ac20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.906+0000 7f0dcc745f40 1 --2- 172.21.15.19:0/4002817917 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5573cee7a7b0 0x5573cee7ac20 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.906+0000 7f0dcc745f40 1 -- 172.21.15.19:0/4002817917 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0dac06a810 msgr2=0x7f0dac06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.906+0000 7f0dcc745f40 1 --2- 172.21.15.19:0/4002817917 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0dac06a810 0x7f0dac06ccd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x5573cee7db60 tx=0x7f0dc0011040 comp rx=0 tx=0).stop 2024-09-12T02:03:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.906+0000 7f0dcc745f40 1 -- 172.21.15.19:0/4002817917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573cedbbe10 msgr2=0x5573cee78bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.906+0000 7f0dcc745f40 1 --2- 172.21.15.19:0/4002817917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573cedbbe10 0x5573cee78bc0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0116b0 tx=0x7f0dbc011ab0 comp rx=0 tx=0).stop 2024-09-12T02:03:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.906+0000 7f0dcaa3c640 1 -- 172.21.15.19:0/4002817917 reap_dead start 2024-09-12T02:03:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.906+0000 7f0dcc745f40 1 -- 172.21.15.19:0/4002817917 shutdown_connections 2024-09-12T02:03:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.906+0000 7f0dcc745f40 1 -- 172.21.15.19:0/4002817917 >> 172.21.15.19:0/4002817917 conn(0x5573cedbd9e0 msgr2=0x5573cedbc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.906+0000 7f0dcc745f40 1 -- 172.21.15.19:0/4002817917 shutdown_connections 2024-09-12T02:03:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:55.906+0000 7f0dcc745f40 1 -- 172.21.15.19:0/4002817917 wait complete. 2024-09-12T02:03:55.912 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:03:56.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.017+0000 7f7c05277640 1 Processor -- start 2024-09-12T02:03:56.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.017+0000 7f7c05277640 1 -- start start 2024-09-12T02:03:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.018+0000 7f7c05277640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7c00161a20 0x7f7c000d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.018+0000 7f7c05277640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c000cf330 0x7f7c0006d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.018+0000 7f7c05277640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c000d1830 con 0x7f7c000d1420 2024-09-12T02:03:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.018+0000 7f7c05277640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f7c000cf760 con 0x7f7c00161a20 2024-09-12T02:03:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.018+0000 7f7c05277640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7c00161e00 con 0x7f7c000cf330 2024-09-12T02:03:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.018+0000 7f7bfeffd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7c00161a20 0x7f7c000d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.018+0000 7f7bff7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c000cf330 0x7f7c0006d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.018+0000 7f7bfeffd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7c00161a20 0x7f7c000d0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:48644/0 (socket says 172.21.15.19:48644) 2024-09-12T02:03:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.018+0000 7f7bfe7fc640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f7c000d1420 0x7f7c000cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:40814/0 (socket says 172.21.15.19:40814) 2024-09-12T02:03:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.018+0000 7f7bfeffd640 1 -- 172.21.15.19:0/1863164795 learned_addr learned my addr 172.21.15.19:0/1863164795 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:56.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.019+0000 7f7bfeffd640 1 -- 172.21.15.19:0/1863164795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c000cf330 msgr2=0x7f7c0006d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:56.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.019+0000 7f7bfeffd640 1 --2- 172.21.15.19:0/1863164795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c000cf330 0x7f7c0006d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:56.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.019+0000 7f7bfeffd640 1 -- 172.21.15.19:0/1863164795 >> v1:172.21.15.135:6789/0 conn(0x7f7c000d1420 legacy=0x7f7c000cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:56.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.019+0000 7f7bfeffd640 1 -- 172.21.15.19:0/1863164795 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c000cf980 con 0x7f7c00161a20 2024-09-12T02:03:56.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.019+0000 7f7bfdffb640 1 -- 172.21.15.19:0/1863164795 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632226114 0 0) 0x7f7be8001110 con 0x7f7c000d1420 2024-09-12T02:03:56.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.020+0000 7f7bfeffd640 1 --2- 172.21.15.19:0/1863164795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c00161a20 0x7f7c000d0ee0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0009e80 tx=0x7f7bf002a750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f0f13ecb18e6b05 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:56.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.020+0000 7f7bfdffb640 1 -- 172.21.15.19:0/1863164795 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0036070 con 0x7f7c00161a20 2024-09-12T02:03:56.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.020+0000 7f7bfdffb640 1 -- 172.21.15.19:0/1863164795 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf0031600 con 0x7f7c00161a20 2024-09-12T02:03:56.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.020+0000 7f7bfdffb640 1 -- 172.21.15.19:0/1863164795 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf00319d0 con 0x7f7c00161a20 2024-09-12T02:03:56.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.020+0000 7f7c05277640 1 -- 172.21.15.19:0/1863164795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c00161a20 msgr2=0x7f7c000d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:56.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.020+0000 7f7c05277640 1 --2- 172.21.15.19:0/1863164795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c00161a20 0x7f7c000d0ee0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0009e80 tx=0x7f7bf002a750 comp rx=0 tx=0).stop 2024-09-12T02:03:56.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.020+0000 7f7c05277640 1 -- 172.21.15.19:0/1863164795 shutdown_connections 2024-09-12T02:03:56.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.020+0000 7f7c05277640 1 --2- 172.21.15.19:0/1863164795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c000cf330 0x7f7c0006d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:56.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.020+0000 7f7c05277640 1 --2- 172.21.15.19:0/1863164795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c00161a20 0x7f7c000d0ee0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:56.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.020+0000 7f7c05277640 1 -- 172.21.15.19:0/1863164795 >> 172.21.15.19:0/1863164795 conn(0x7f7c0009d850 msgr2=0x7f7c0008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:56.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.020+0000 7f7c05277640 1 -- 172.21.15.19:0/1863164795 shutdown_connections 2024-09-12T02:03:56.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.020+0000 7f7c05277640 1 -- 172.21.15.19:0/1863164795 wait complete. 2024-09-12T02:03:56.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.022+0000 7f7c05277640 1 Processor -- start 2024-09-12T02:03:56.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.022+0000 7f7c05277640 1 -- start start 2024-09-12T02:03:56.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.022+0000 7f7c05277640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c000cf330 0x7f7c00151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:56.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.022+0000 7f7c05277640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c000d1420 0x7f7c0014f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:56.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.022+0000 7f7c05277640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c00161a20 0x7f7c00156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:56.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.022+0000 7f7c05277640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7c000cff00 con 0x7f7c00161a20 2024-09-12T02:03:56.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.022+0000 7f7c05277640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0006d050 con 0x7f7c000d1420 2024-09-12T02:03:56.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.022+0000 7f7c05277640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7c0006d2f0 con 0x7f7c000cf330 2024-09-12T02:03:56.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.023+0000 7f7bff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c00161a20 0x7f7c00156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:56.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.023+0000 7f7bff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c00161a20 0x7f7c00156540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49986/0 (socket says 172.21.15.19:49986) 2024-09-12T02:03:56.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.023+0000 7f7bff7fe640 1 -- 172.21.15.19:0/3639525445 learned_addr learned my addr 172.21.15.19:0/3639525445 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:56.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.023+0000 7f7bfe7fc640 1 --2- 172.21.15.19:0/3639525445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c000d1420 0x7f7c0014f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:56.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.023+0000 7f7bfeffd640 1 --2- 172.21.15.19:0/3639525445 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c000cf330 0x7f7c00151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:56.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.023+0000 7f7bff7fe640 1 -- 172.21.15.19:0/3639525445 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c000cf330 msgr2=0x7f7c00151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:56.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.023+0000 7f7bff7fe640 1 --2- 172.21.15.19:0/3639525445 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c000cf330 0x7f7c00151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:56.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.023+0000 7f7bff7fe640 1 -- 172.21.15.19:0/3639525445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c000d1420 msgr2=0x7f7c0014f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:56.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.023+0000 7f7bff7fe640 1 --2- 172.21.15.19:0/3639525445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c000d1420 0x7f7c0014f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:56.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.023+0000 7f7bff7fe640 1 -- 172.21.15.19:0/3639525445 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c00151710 con 0x7f7c00161a20 2024-09-12T02:03:56.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.023+0000 7f7bfeffd640 1 --2- 172.21.15.19:0/3639525445 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c000cf330 0x7f7c00151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:56.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.023+0000 7f7bff7fe640 1 --2- 172.21.15.19:0/3639525445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c00161a20 0x7f7c00156540 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800e960 tx=0x7f7bf800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:56.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.023+0000 7f7bf77fe640 1 -- 172.21.15.19:0/3639525445 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8017070 con 0x7f7c00161a20 2024-09-12T02:03:56.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.023+0000 7f7bf77fe640 1 -- 172.21.15.19:0/3639525445 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf800c980 con 0x7f7c00161a20 2024-09-12T02:03:56.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.023+0000 7f7bf77fe640 1 -- 172.21.15.19:0/3639525445 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf800cd70 con 0x7f7c00161a20 2024-09-12T02:03:56.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.023+0000 7f7c05277640 1 -- 172.21.15.19:0/3639525445 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c00160b80 con 0x7f7c00161a20 2024-09-12T02:03:56.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.023+0000 7f7c05277640 1 -- 172.21.15.19:0/3639525445 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c00160e20 con 0x7f7c00161a20 2024-09-12T02:03:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.024+0000 7f7c05277640 1 -- 172.21.15.19:0/3639525445 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c001518e0 con 0x7f7c00161a20 2024-09-12T02:03:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.025+0000 7f7bf77fe640 1 -- 172.21.15.19:0/3639525445 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7bf801a070 con 0x7f7c00161a20 2024-09-12T02:03:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.025+0000 7f7bf77fe640 1 --2- 172.21.15.19:0/3639525445 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7be006be30 0x7f7be006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.025+0000 7f7bf77fe640 1 -- 172.21.15.19:0/3639525445 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 7335+0+0 (secure 0 0 0) 0x7f7bf808b440 con 0x7f7c00161a20 2024-09-12T02:03:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.026+0000 7f7bfeffd640 1 --2- 172.21.15.19:0/3639525445 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7be006be30 0x7f7be006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.026+0000 7f7bfeffd640 1 --2- 172.21.15.19:0/3639525445 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7be006be30 0x7f7be006e2f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0033000 tx=0x7f7bf0009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:56.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.030+0000 7f7bf77fe640 1 -- 172.21.15.19:0/3639525445 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7bf8059820 con 0x7f7c00161a20 2024-09-12T02:03:56.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.244+0000 7f7c05277640 1 -- 172.21.15.19:0/3639525445 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f7c000b1040 con 0x7f7c00161a20 2024-09-12T02:03:56.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.729+0000 7f7bf77fe640 1 -- 172.21.15.19:0/3639525445 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v157) ==== 162+0+0 (secure 0 0 0) 0x7f7bf8059120 con 0x7f7c00161a20 2024-09-12T02:03:56.729 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:03:56.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.731+0000 7f7c05277640 1 -- 172.21.15.19:0/3639525445 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7be006be30 msgr2=0x7f7be006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:56.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.731+0000 7f7c05277640 1 --2- 172.21.15.19:0/3639525445 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7be006be30 0x7f7be006e2f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0033000 tx=0x7f7bf0009000 comp rx=0 tx=0).stop 2024-09-12T02:03:56.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.731+0000 7f7c05277640 1 -- 172.21.15.19:0/3639525445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c00161a20 msgr2=0x7f7c00156540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:56.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.731+0000 7f7c05277640 1 --2- 172.21.15.19:0/3639525445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c00161a20 0x7f7c00156540 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800e960 tx=0x7f7bf800ee20 comp rx=0 tx=0).stop 2024-09-12T02:03:56.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.731+0000 7f7c05277640 1 -- 172.21.15.19:0/3639525445 shutdown_connections 2024-09-12T02:03:56.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.731+0000 7f7c05277640 1 --2- 172.21.15.19:0/3639525445 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7be006be30 0x7f7be006e2f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:56.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.731+0000 7f7c05277640 1 --2- 172.21.15.19:0/3639525445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c00161a20 0x7f7c00156540 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:56.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.731+0000 7f7c05277640 1 --2- 172.21.15.19:0/3639525445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c000d1420 0x7f7c0014f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:56.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.731+0000 7f7c05277640 1 --2- 172.21.15.19:0/3639525445 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c000cf330 0x7f7c00151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:56.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.731+0000 7f7c05277640 1 -- 172.21.15.19:0/3639525445 >> 172.21.15.19:0/3639525445 conn(0x7f7c0009d850 msgr2=0x7f7c000b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:56.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.731+0000 7f7c05277640 1 -- 172.21.15.19:0/3639525445 shutdown_connections 2024-09-12T02:03:56.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.731+0000 7f7c05277640 1 -- 172.21.15.19:0/3639525445 wait complete. 2024-09-12T02:03:56.735 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:03:56.735+0000 7f4f11ccc640 -1 mds.0.cache.ino(0x100) No data while reading inode 0x100 2024-09-12T02:03:56.735 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:03:56.735+0000 7f4f11ccc640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2024-09-12T02:03:56.736 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:03:56.736+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:03:56.736 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:03:56.736+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:03:56.745 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:56.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.853+0000 7f05ce33b640 1 Processor -- start 2024-09-12T02:03:56.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.853+0000 7f05ce33b640 1 -- start start 2024-09-12T02:03:56.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.854+0000 7f05ce33b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05c80afd70 0x7f05c8160820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:56.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.854+0000 7f05ce33b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f05c80b5f80 0x7f05c80b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:56.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.854+0000 7f05ce33b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c80b68e0 con 0x7f05c806e7d0 2024-09-12T02:03:56.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.854+0000 7f05ce33b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f05c8160d60 con 0x7f05c80b5f80 2024-09-12T02:03:56.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.854+0000 7f05ce33b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f05c806fdb0 con 0x7f05c80afd70 2024-09-12T02:03:56.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.854+0000 7f05c77fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f05c80b5f80 0x7f05c80b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:56.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.854+0000 7f05c77fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f05c80b5f80 0x7f05c80b63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49998/0 (socket says 172.21.15.19:49998) 2024-09-12T02:03:56.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.854+0000 7f05c77fe640 1 -- 172.21.15.19:0/2005751935 learned_addr learned my addr 172.21.15.19:0/2005751935 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:56.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.854+0000 7f05c77fe640 1 -- 172.21.15.19:0/2005751935 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05c80afd70 msgr2=0x7f05c8160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:56.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.854+0000 7f05c7fff640 1 --2- 172.21.15.19:0/2005751935 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05c80afd70 0x7f05c8160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:56.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.854+0000 7f05c77fe640 1 --2- 172.21.15.19:0/2005751935 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05c80afd70 0x7f05c8160820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:56.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.854+0000 7f05c77fe640 1 -- 172.21.15.19:0/2005751935 >> v1:172.21.15.135:6789/0 conn(0x7f05c806e7d0 legacy=0x7f05c806ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:56.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.854+0000 7f05c77fe640 1 -- 172.21.15.19:0/2005751935 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c8070090 con 0x7f05c80b5f80 2024-09-12T02:03:56.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.854+0000 7f05c7fff640 1 --2- 172.21.15.19:0/2005751935 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05c80afd70 0x7f05c8160820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:56.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.855+0000 7f05c77fe640 1 --2- 172.21.15.19:0/2005751935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c80b5f80 0x7f05c80b63a0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f05bc009870 tx=0x7f05bc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6848e6d1736c182 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:56.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.855+0000 7f05c6ffd640 1 -- 172.21.15.19:0/2005751935 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05bc037070 con 0x7f05c80b5f80 2024-09-12T02:03:56.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.855+0000 7f05c6ffd640 1 -- 172.21.15.19:0/2005751935 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05bc032440 con 0x7f05c80b5f80 2024-09-12T02:03:56.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.855+0000 7f05c6ffd640 1 -- 172.21.15.19:0/2005751935 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05bc032810 con 0x7f05c80b5f80 2024-09-12T02:03:56.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.856+0000 7f05ce33b640 1 -- 172.21.15.19:0/2005751935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c80b5f80 msgr2=0x7f05c80b63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:56.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.856+0000 7f05ce33b640 1 --2- 172.21.15.19:0/2005751935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c80b5f80 0x7f05c80b63a0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f05bc009870 tx=0x7f05bc02a210 comp rx=0 tx=0).stop 2024-09-12T02:03:56.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.856+0000 7f05ce33b640 1 -- 172.21.15.19:0/2005751935 shutdown_connections 2024-09-12T02:03:56.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.856+0000 7f05ce33b640 1 --2- 172.21.15.19:0/2005751935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c80b5f80 0x7f05c80b63a0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:56.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.856+0000 7f05ce33b640 1 --2- 172.21.15.19:0/2005751935 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05c80afd70 0x7f05c8160820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:56.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.856+0000 7f05ce33b640 1 -- 172.21.15.19:0/2005751935 >> 172.21.15.19:0/2005751935 conn(0x7f05c806bc10 msgr2=0x7f05c806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:56.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.856+0000 7f05ce33b640 1 -- 172.21.15.19:0/2005751935 shutdown_connections 2024-09-12T02:03:56.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.856+0000 7f05ce33b640 1 -- 172.21.15.19:0/2005751935 wait complete. 2024-09-12T02:03:56.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.857+0000 7f05ce33b640 1 Processor -- start 2024-09-12T02:03:56.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.857+0000 7f05ce33b640 1 -- start start 2024-09-12T02:03:56.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.858+0000 7f05ce33b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05c806e7d0 0x7f05c8152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:56.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.858+0000 7f05ce33b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c80afd70 0x7f05c8138b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:56.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.858+0000 7f05ce33b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c80b5f80 0x7f05c814fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:56.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.858+0000 7f05ce33b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f05c806fa80 con 0x7f05c80b5f80 2024-09-12T02:03:56.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.858+0000 7f05ce33b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f05c8070650 con 0x7f05c80afd70 2024-09-12T02:03:56.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.858+0000 7f05ce33b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f05c80b0150 con 0x7f05c806e7d0 2024-09-12T02:03:56.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.858+0000 7f05cc8d8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c80b5f80 0x7f05c814fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:56.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.858+0000 7f05cc8d8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c80b5f80 0x7f05c814fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50002/0 (socket says 172.21.15.19:50002) 2024-09-12T02:03:56.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.858+0000 7f05cc8d8640 1 -- 172.21.15.19:0/3243799469 learned_addr learned my addr 172.21.15.19:0/3243799469 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:56.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.858+0000 7f05c77fe640 1 --2- 172.21.15.19:0/3243799469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c80afd70 0x7f05c8138b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:56.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.858+0000 7f05c7fff640 1 --2- 172.21.15.19:0/3243799469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05c806e7d0 0x7f05c8152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:56.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.858+0000 7f05cc8d8640 1 -- 172.21.15.19:0/3243799469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05c806e7d0 msgr2=0x7f05c8152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:56.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.858+0000 7f05cc8d8640 1 --2- 172.21.15.19:0/3243799469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05c806e7d0 0x7f05c8152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:56.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.858+0000 7f05cc8d8640 1 -- 172.21.15.19:0/3243799469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c80afd70 msgr2=0x7f05c8138b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:56.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.858+0000 7f05cc8d8640 1 --2- 172.21.15.19:0/3243799469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c80afd70 0x7f05c8138b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:56.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.858+0000 7f05cc8d8640 1 -- 172.21.15.19:0/3243799469 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c8139080 con 0x7f05c80b5f80 2024-09-12T02:03:56.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.858+0000 7f05cc8d8640 1 --2- 172.21.15.19:0/3243799469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c80b5f80 0x7f05c814fd90 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f05c000b970 tx=0x7f05c000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:56.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.859+0000 7f05c4ff9640 1 -- 172.21.15.19:0/3243799469 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c0019070 con 0x7f05c80b5f80 2024-09-12T02:03:56.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.859+0000 7f05c4ff9640 1 -- 172.21.15.19:0/3243799469 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c000cb40 con 0x7f05c80b5f80 2024-09-12T02:03:56.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.859+0000 7f05ce33b640 1 -- 172.21.15.19:0/3243799469 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c8151fb0 con 0x7f05c80b5f80 2024-09-12T02:03:56.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.859+0000 7f05c4ff9640 1 -- 172.21.15.19:0/3243799469 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c0014440 con 0x7f05c80b5f80 2024-09-12T02:03:56.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.859+0000 7f05ce33b640 1 -- 172.21.15.19:0/3243799469 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c8152570 con 0x7f05c80b5f80 2024-09-12T02:03:56.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.860+0000 7f05ce33b640 1 -- 172.21.15.19:0/3243799469 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05c8160060 con 0x7f05c80b5f80 2024-09-12T02:03:56.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.860+0000 7f05c4ff9640 1 -- 172.21.15.19:0/3243799469 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05c001c070 con 0x7f05c80b5f80 2024-09-12T02:03:56.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.861+0000 7f05c4ff9640 1 --2- 172.21.15.19:0/3243799469 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f05b406be30 0x7f05b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:56.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.861+0000 7f05c4ff9640 1 -- 172.21.15.19:0/3243799469 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 7421+0+0 (secure 0 0 0) 0x7f05c008b210 con 0x7f05c80b5f80 2024-09-12T02:03:56.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.861+0000 7f05c7fff640 1 --2- 172.21.15.19:0/3243799469 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f05b406be30 0x7f05b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:56.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.861+0000 7f05c7fff640 1 --2- 172.21.15.19:0/3243799469 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f05b406be30 0x7f05b406e2f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f05b800ab60 tx=0x7f05b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:56.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:56.865+0000 7f05c4ff9640 1 -- 172.21.15.19:0/3243799469 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05c0058e20 con 0x7f05c80b5f80 2024-09-12T02:03:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.076+0000 7f05ce33b640 1 -- 172.21.15.19:0/3243799469 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05c81563e0 con 0x7f05c80b5f80 2024-09-12T02:03:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.077+0000 7f05c4ff9640 1 -- 172.21.15.19:0/3243799469 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 158 v158) ==== 95+0+4392 (secure 0 0 0) 0x7f05c005d120 con 0x7f05c80b5f80 2024-09-12T02:03:57.078 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:57.078 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":158,"btime":"2024-09-12T02:03:56:737599+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7612,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4107165769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4107165769},{"type":"v1","addr":"172.21.15.135:6837","nonce":4107165769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":156}],"filesystems":[{"mdsmap":{"epoch":158,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:56.737542+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 158 2024-09-12T02:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.079+0000 7f05ce33b640 1 -- 172.21.15.19:0/3243799469 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f05b406be30 msgr2=0x7f05b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.079+0000 7f05ce33b640 1 --2- 172.21.15.19:0/3243799469 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f05b406be30 0x7f05b406e2f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f05b800ab60 tx=0x7f05b8008040 comp rx=0 tx=0).stop 2024-09-12T02:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.079+0000 7f05ce33b640 1 -- 172.21.15.19:0/3243799469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c80b5f80 msgr2=0x7f05c814fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.079+0000 7f05ce33b640 1 --2- 172.21.15.19:0/3243799469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c80b5f80 0x7f05c814fd90 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f05c000b970 tx=0x7f05c000be30 comp rx=0 tx=0).stop 2024-09-12T02:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.079+0000 7f05ce33b640 1 -- 172.21.15.19:0/3243799469 shutdown_connections 2024-09-12T02:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.079+0000 7f05ce33b640 1 --2- 172.21.15.19:0/3243799469 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f05b406be30 0x7f05b406e2f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.079+0000 7f05ce33b640 1 --2- 172.21.15.19:0/3243799469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c80b5f80 0x7f05c814fd90 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.079+0000 7f05ce33b640 1 --2- 172.21.15.19:0/3243799469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c80afd70 0x7f05c8138b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.079+0000 7f05ce33b640 1 --2- 172.21.15.19:0/3243799469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05c806e7d0 0x7f05c8152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.079+0000 7f05ce33b640 1 -- 172.21.15.19:0/3243799469 >> 172.21.15.19:0/3243799469 conn(0x7f05c806bc10 msgr2=0x7f05c806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.079+0000 7f05ce33b640 1 -- 172.21.15.19:0/3243799469 shutdown_connections 2024-09-12T02:03:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.079+0000 7f05ce33b640 1 -- 172.21.15.19:0/3243799469 wait complete. 2024-09-12T02:03:57.091 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:03:57.091 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:57.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.193+0000 7f54dea42640 1 Processor -- start 2024-09-12T02:03:57.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.193+0000 7f54dea42640 1 -- start start 2024-09-12T02:03:57.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.194+0000 7f54dea42640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f54d809b140 0x7f54d8169570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.194+0000 7f54dea42640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54d806cec0 con 0x7f54d815e5d0 2024-09-12T02:03:57.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.194+0000 7f54dea42640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54d806d1a0 con 0x7f54d806df60 2024-09-12T02:03:57.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.194+0000 7f54dea42640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f54d806dad0 con 0x7f54d809b140 2024-09-12T02:03:57.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.194+0000 7f54d7fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f54d815e5d0 0x7f54d80d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36428/0 (socket says 172.21.15.19:36428) 2024-09-12T02:03:57.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.194+0000 7f54d7fff640 1 -- 172.21.15.19:0/4133522202 learned_addr learned my addr 172.21.15.19:0/4133522202 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:57.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.194+0000 7f54dcfdf640 1 --2- 172.21.15.19:0/4133522202 >> v2:172.21.15.135:3300/0 conn(0x7f54d809b140 0x7f54d8169570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.194+0000 7f54d6ffd640 1 -- 172.21.15.19:0/4133522202 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4152651360 0 0) 0x7f54d806cec0 con 0x7f54d815e5d0 2024-09-12T02:03:57.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.194+0000 7f54d6ffd640 1 -- 172.21.15.19:0/4133522202 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54c0003520 con 0x7f54d815e5d0 2024-09-12T02:03:57.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.195+0000 7f54d6ffd640 1 -- 172.21.15.19:0/4133522202 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 174221349 0 0) 0x7f54c0003520 con 0x7f54d815e5d0 2024-09-12T02:03:57.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.195+0000 7f54dcfdf640 1 -- 172.21.15.19:0/4133522202 >> v1:172.21.15.135:6789/0 conn(0x7f54d806df60 legacy=0x7f54d809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.195+0000 7f54dcfdf640 1 -- 172.21.15.19:0/4133522202 >> v1:172.21.15.19:6789/0 conn(0x7f54d815e5d0 legacy=0x7f54d80d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.195+0000 7f54dcfdf640 1 -- 172.21.15.19:0/4133522202 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d806d480 con 0x7f54d809b140 2024-09-12T02:03:57.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.195+0000 7f54dcfdf640 1 --2- 172.21.15.19:0/4133522202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d809b140 0x7f54d8169570 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009dc0 tx=0x7f54d002a750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2966e6499f96db83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:57.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.196+0000 7f54d6ffd640 1 -- 172.21.15.19:0/4133522202 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c8001670 con 0x7f54d809b140 2024-09-12T02:03:57.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.196+0000 7f54d6ffd640 1 -- 172.21.15.19:0/4133522202 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d0007540 con 0x7f54d809b140 2024-09-12T02:03:57.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.196+0000 7f54d6ffd640 1 -- 172.21.15.19:0/4133522202 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d0007910 con 0x7f54d809b140 2024-09-12T02:03:57.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.196+0000 7f54dea42640 1 -- 172.21.15.19:0/4133522202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d809b140 msgr2=0x7f54d8169570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.196+0000 7f54dea42640 1 --2- 172.21.15.19:0/4133522202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d809b140 0x7f54d8169570 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009dc0 tx=0x7f54d002a750 comp rx=0 tx=0).stop 2024-09-12T02:03:57.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.196+0000 7f54dea42640 1 -- 172.21.15.19:0/4133522202 shutdown_connections 2024-09-12T02:03:57.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.196+0000 7f54dea42640 1 --2- 172.21.15.19:0/4133522202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d809b140 0x7f54d8169570 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.196+0000 7f54dea42640 1 -- 172.21.15.19:0/4133522202 >> 172.21.15.19:0/4133522202 conn(0x7f54d80d23a0 msgr2=0x7f54d80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:57.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.196+0000 7f54dea42640 1 -- 172.21.15.19:0/4133522202 shutdown_connections 2024-09-12T02:03:57.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.196+0000 7f54dea42640 1 -- 172.21.15.19:0/4133522202 wait complete. 2024-09-12T02:03:57.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.197+0000 7f54dea42640 1 Processor -- start 2024-09-12T02:03:57.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.198+0000 7f54dea42640 1 -- start start 2024-09-12T02:03:57.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.198+0000 7f54dea42640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d806df60 0x7f54d80c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.198+0000 7f54dea42640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f54d809b140 0x7f54d80b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.198+0000 7f54dea42640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54d815e5d0 0x7f54d81526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.198+0000 7f54dea42640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f54d80d1980 con 0x7f54d815e5d0 2024-09-12T02:03:57.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.198+0000 7f54dea42640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f54d80d1800 con 0x7f54d806df60 2024-09-12T02:03:57.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.198+0000 7f54dea42640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f54d815e9b0 con 0x7f54d809b140 2024-09-12T02:03:57.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.198+0000 7f54dcfdf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54d815e5d0 0x7f54d81526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.198+0000 7f54dcfdf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54d815e5d0 0x7f54d81526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50014/0 (socket says 172.21.15.19:50014) 2024-09-12T02:03:57.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.198+0000 7f54dcfdf640 1 -- 172.21.15.19:0/3902258477 learned_addr learned my addr 172.21.15.19:0/3902258477 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:57.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.199+0000 7f54d7fff640 1 --2- 172.21.15.19:0/3902258477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d806df60 0x7f54d80c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.199+0000 7f54d77fe640 1 --2- 172.21.15.19:0/3902258477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f54d809b140 0x7f54d80b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.199+0000 7f54dcfdf640 1 -- 172.21.15.19:0/3902258477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f54d809b140 msgr2=0x7f54d80b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.199+0000 7f54dcfdf640 1 --2- 172.21.15.19:0/3902258477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f54d809b140 0x7f54d80b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.199+0000 7f54dcfdf640 1 -- 172.21.15.19:0/3902258477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d806df60 msgr2=0x7f54d80c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.199+0000 7f54dcfdf640 1 --2- 172.21.15.19:0/3902258477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d806df60 0x7f54d80c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.199+0000 7f54dcfdf640 1 -- 172.21.15.19:0/3902258477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d80b5710 con 0x7f54d815e5d0 2024-09-12T02:03:57.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.199+0000 7f54d7fff640 1 --2- 172.21.15.19:0/3902258477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d806df60 0x7f54d80c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:57.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.199+0000 7f54d77fe640 1 --2- 172.21.15.19:0/3902258477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f54d809b140 0x7f54d80b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:57.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.199+0000 7f54dcfdf640 1 --2- 172.21.15.19:0/3902258477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54d815e5d0 0x7f54d81526f0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009ee0 tx=0x7f54d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:57.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.199+0000 7f54d4ff9640 1 -- 172.21.15.19:0/3902258477 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d0040070 con 0x7f54d815e5d0 2024-09-12T02:03:57.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.199+0000 7f54d4ff9640 1 -- 172.21.15.19:0/3902258477 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d0031bc0 con 0x7f54d815e5d0 2024-09-12T02:03:57.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.199+0000 7f54d4ff9640 1 -- 172.21.15.19:0/3902258477 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d0009450 con 0x7f54d815e5d0 2024-09-12T02:03:57.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.199+0000 7f54dea42640 1 -- 172.21.15.19:0/3902258477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d80b59e0 con 0x7f54d815e5d0 2024-09-12T02:03:57.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.199+0000 7f54dea42640 1 -- 172.21.15.19:0/3902258477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d80b5fa0 con 0x7f54d815e5d0 2024-09-12T02:03:57.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.200+0000 7f54dea42640 1 -- 172.21.15.19:0/3902258477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d80d28d0 con 0x7f54d815e5d0 2024-09-12T02:03:57.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.201+0000 7f54d4ff9640 1 -- 172.21.15.19:0/3902258477 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f54d0039040 con 0x7f54d815e5d0 2024-09-12T02:03:57.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.201+0000 7f54d4ff9640 1 --2- 172.21.15.19:0/3902258477 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f54c406be60 0x7f54c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.201+0000 7f54d4ff9640 1 -- 172.21.15.19:0/3902258477 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 7421+0+0 (secure 0 0 0) 0x7f54d00aca00 con 0x7f54d815e5d0 2024-09-12T02:03:57.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.201+0000 7f54d7fff640 1 --2- 172.21.15.19:0/3902258477 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f54c406be60 0x7f54c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.202+0000 7f54d7fff640 1 --2- 172.21.15.19:0/3902258477 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f54c406be60 0x7f54c406e320 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f54c8005880 tx=0x7f54c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:57.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.205+0000 7f54d4ff9640 1 -- 172.21.15.19:0/3902258477 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f54d80d28d0 con 0x7f54d815e5d0 2024-09-12T02:03:57.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.414+0000 7f54dea42640 1 -- 172.21.15.19:0/3902258477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54d80b6560 con 0x7f54d815e5d0 2024-09-12T02:03:57.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.415+0000 7f54d4ff9640 1 -- 172.21.15.19:0/3902258477 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 158 v158) ==== 95+0+4392 (secure 0 0 0) 0x7f54d004c030 con 0x7f54d815e5d0 2024-09-12T02:03:57.415 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:57.416 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":158,"btime":"2024-09-12T02:03:56:737599+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7612,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4107165769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4107165769},{"type":"v1","addr":"172.21.15.135:6837","nonce":4107165769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":156}],"filesystems":[{"mdsmap":{"epoch":158,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:56.737542+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:57.416 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 158 2024-09-12T02:03:57.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.417+0000 7f54dea42640 1 -- 172.21.15.19:0/3902258477 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f54c406be60 msgr2=0x7f54c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.417+0000 7f54dea42640 1 --2- 172.21.15.19:0/3902258477 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f54c406be60 0x7f54c406e320 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f54c8005880 tx=0x7f54c8009040 comp rx=0 tx=0).stop 2024-09-12T02:03:57.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.417+0000 7f54dea42640 1 -- 172.21.15.19:0/3902258477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54d815e5d0 msgr2=0x7f54d81526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.417+0000 7f54dea42640 1 --2- 172.21.15.19:0/3902258477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54d815e5d0 0x7f54d81526f0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009ee0 tx=0x7f54d0004a40 comp rx=0 tx=0).stop 2024-09-12T02:03:57.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.417+0000 7f54dea42640 1 -- 172.21.15.19:0/3902258477 shutdown_connections 2024-09-12T02:03:57.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.417+0000 7f54dea42640 1 --2- 172.21.15.19:0/3902258477 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f54c406be60 0x7f54c406e320 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.417+0000 7f54dea42640 1 --2- 172.21.15.19:0/3902258477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54d815e5d0 0x7f54d81526f0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.417+0000 7f54dea42640 1 --2- 172.21.15.19:0/3902258477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f54d809b140 0x7f54d80b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.417+0000 7f54dea42640 1 --2- 172.21.15.19:0/3902258477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d806df60 0x7f54d80c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.417+0000 7f54dea42640 1 -- 172.21.15.19:0/3902258477 >> 172.21.15.19:0/3902258477 conn(0x7f54d80d23a0 msgr2=0x7f54d80d2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:57.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.417+0000 7f54dea42640 1 -- 172.21.15.19:0/3902258477 shutdown_connections 2024-09-12T02:03:57.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.417+0000 7f54dea42640 1 -- 172.21.15.19:0/3902258477 wait complete. 2024-09-12T02:03:57.428 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:03:57.428 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:03:57.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.530+0000 7fb1929a6640 1 Processor -- start 2024-09-12T02:03:57.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.530+0000 7fb1929a6640 1 -- start start 2024-09-12T02:03:57.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.531+0000 7fb1929a6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb18c15e760 0x7fb18c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.531+0000 7fb1929a6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb18c0d4fd0 0x7fb18c0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.531+0000 7fb1929a6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb18c0b3650 0x7fb18c0cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.531+0000 7fb1929a6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb18c0d2700 con 0x7fb18c0d4fd0 2024-09-12T02:03:57.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.531+0000 7fb1929a6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb18c0cedb0 con 0x7fb18c0b3650 2024-09-12T02:03:57.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.531+0000 7fb1929a6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb18c0cf090 con 0x7fb18c15e760 2024-09-12T02:03:57.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.531+0000 7fb18b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb18c0d4fd0 0x7fb18c0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.531+0000 7fb18b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb18c0d4fd0 0x7fb18c0cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50028/0 (socket says 172.21.15.19:50028) 2024-09-12T02:03:57.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.531+0000 7fb18b7fe640 1 -- 172.21.15.19:0/4280344737 learned_addr learned my addr 172.21.15.19:0/4280344737 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:57.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.531+0000 7fb18bfff640 1 --2- 172.21.15.19:0/4280344737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb18c15e760 0x7fb18c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.531+0000 7fb190f43640 1 --2- 172.21.15.19:0/4280344737 >> v2:172.21.15.135:3300/0 conn(0x7fb18c0b3650 0x7fb18c0cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.531+0000 7fb18b7fe640 1 -- 172.21.15.19:0/4280344737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb18c15e760 msgr2=0x7fb18c06cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:57.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.531+0000 7fb18b7fe640 1 --2- 172.21.15.19:0/4280344737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb18c15e760 0x7fb18c06cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.531+0000 7fb18b7fe640 1 -- 172.21.15.19:0/4280344737 >> v2:172.21.15.135:3300/0 conn(0x7fb18c0b3650 msgr2=0x7fb18c0cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:57.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.531+0000 7fb18b7fe640 1 --2- 172.21.15.19:0/4280344737 >> v2:172.21.15.135:3300/0 conn(0x7fb18c0b3650 0x7fb18c0cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.531+0000 7fb18b7fe640 1 -- 172.21.15.19:0/4280344737 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb18c0b3c80 con 0x7fb18c0d4fd0 2024-09-12T02:03:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.532+0000 7fb18b7fe640 1 --2- 172.21.15.19:0/4280344737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb18c0d4fd0 0x7fb18c0cf5b0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fb18c08c8c0 tx=0x7fb18002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ed0b434f4a8b2b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:57.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.532+0000 7fb18affd640 1 -- 172.21.15.19:0/4280344737 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb180004030 con 0x7fb18c0d4fd0 2024-09-12T02:03:57.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.532+0000 7fb18affd640 1 -- 172.21.15.19:0/4280344737 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1800041d0 con 0x7fb18c0d4fd0 2024-09-12T02:03:57.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.532+0000 7fb18affd640 1 -- 172.21.15.19:0/4280344737 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb180003610 con 0x7fb18c0d4fd0 2024-09-12T02:03:57.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.533+0000 7fb1929a6640 1 -- 172.21.15.19:0/4280344737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb18c0d4fd0 msgr2=0x7fb18c0cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.533+0000 7fb1929a6640 1 --2- 172.21.15.19:0/4280344737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb18c0d4fd0 0x7fb18c0cf5b0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fb18c08c8c0 tx=0x7fb18002a130 comp rx=0 tx=0).stop 2024-09-12T02:03:57.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.533+0000 7fb1929a6640 1 -- 172.21.15.19:0/4280344737 shutdown_connections 2024-09-12T02:03:57.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.533+0000 7fb1929a6640 1 --2- 172.21.15.19:0/4280344737 >> v2:172.21.15.135:3300/0 conn(0x7fb18c0b3650 0x7fb18c0cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.533+0000 7fb1929a6640 1 --2- 172.21.15.19:0/4280344737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb18c0d4fd0 0x7fb18c0cf5b0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.533+0000 7fb1929a6640 1 --2- 172.21.15.19:0/4280344737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb18c15e760 0x7fb18c06cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.533+0000 7fb1929a6640 1 -- 172.21.15.19:0/4280344737 >> 172.21.15.19:0/4280344737 conn(0x7fb18c08bfc0 msgr2=0x7fb18c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:57.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.533+0000 7fb1929a6640 1 -- 172.21.15.19:0/4280344737 shutdown_connections 2024-09-12T02:03:57.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.533+0000 7fb1929a6640 1 -- 172.21.15.19:0/4280344737 wait complete. 2024-09-12T02:03:57.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.534+0000 7fb1929a6640 1 Processor -- start 2024-09-12T02:03:57.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.534+0000 7fb1929a6640 1 -- start start 2024-09-12T02:03:57.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb1929a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb18c0b3650 0x7fb18c0c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb1929a6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb18c0d4fd0 0x7fb18c1520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb1929a6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb18c15e760 0x7fb18c0b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb1929a6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb18c0d3230 con 0x7fb18c0b3650 2024-09-12T02:03:57.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb1929a6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb18c0d30b0 con 0x7fb18c15e760 2024-09-12T02:03:57.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb1929a6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb18c0d33b0 con 0x7fb18c0d4fd0 2024-09-12T02:03:57.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb18bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb18c0b3650 0x7fb18c0c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb18bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb18c0b3650 0x7fb18c0c8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50042/0 (socket says 172.21.15.19:50042) 2024-09-12T02:03:57.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb18bfff640 1 -- 172.21.15.19:0/2184022248 learned_addr learned my addr 172.21.15.19:0/2184022248 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:57.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb18b7fe640 1 --2- 172.21.15.19:0/2184022248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb18c0d4fd0 0x7fb18c1520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb190f43640 1 --2- 172.21.15.19:0/2184022248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb18c15e760 0x7fb18c0b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb18bfff640 1 -- 172.21.15.19:0/2184022248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb18c0d4fd0 msgr2=0x7fb18c1520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb18bfff640 1 --2- 172.21.15.19:0/2184022248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb18c0d4fd0 0x7fb18c1520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb18bfff640 1 -- 172.21.15.19:0/2184022248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb18c15e760 msgr2=0x7fb18c0b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb18bfff640 1 --2- 172.21.15.19:0/2184022248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb18c15e760 0x7fb18c0b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb18bfff640 1 -- 172.21.15.19:0/2184022248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb18c0c8fb0 con 0x7fb18c0b3650 2024-09-12T02:03:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb190f43640 1 --2- 172.21.15.19:0/2184022248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb18c15e760 0x7fb18c0b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb18b7fe640 1 --2- 172.21.15.19:0/2184022248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb18c0d4fd0 0x7fb18c1520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.535+0000 7fb18bfff640 1 --2- 172.21.15.19:0/2184022248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb18c0b3650 0x7fb18c0c8a70 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fb17c00d620 tx=0x7fb17c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.536+0000 7fb188ff9640 1 -- 172.21.15.19:0/2184022248 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c00b620 con 0x7fb18c0b3650 2024-09-12T02:03:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.536+0000 7fb188ff9640 1 -- 172.21.15.19:0/2184022248 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17c019070 con 0x7fb18c0b3650 2024-09-12T02:03:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.536+0000 7fb1929a6640 1 -- 172.21.15.19:0/2184022248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb18c152620 con 0x7fb18c0b3650 2024-09-12T02:03:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.536+0000 7fb188ff9640 1 -- 172.21.15.19:0/2184022248 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c00ba00 con 0x7fb18c0b3650 2024-09-12T02:03:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.536+0000 7fb1929a6640 1 -- 172.21.15.19:0/2184022248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb18c0c9250 con 0x7fb18c0b3650 2024-09-12T02:03:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.537+0000 7fb1929a6640 1 -- 172.21.15.19:0/2184022248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb18c0d36a0 con 0x7fb18c0b3650 2024-09-12T02:03:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.537+0000 7fb188ff9640 1 -- 172.21.15.19:0/2184022248 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb17c00bba0 con 0x7fb18c0b3650 2024-09-12T02:03:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.538+0000 7fb188ff9640 1 --2- 172.21.15.19:0/2184022248 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb17806be60 0x7fb17806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.538+0000 7fb188ff9640 1 -- 172.21.15.19:0/2184022248 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 7421+0+0 (secure 0 0 0) 0x7fb17c08b8f0 con 0x7fb18c0b3650 2024-09-12T02:03:57.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.538+0000 7fb18b7fe640 1 --2- 172.21.15.19:0/2184022248 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb17806be60 0x7fb17806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.539+0000 7fb18b7fe640 1 --2- 172.21.15.19:0/2184022248 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb17806be60 0x7fb17806e320 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb180033000 tx=0x7fb18002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:57.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.542+0000 7fb188ff9640 1 -- 172.21.15.19:0/2184022248 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb17c059bf0 con 0x7fb18c0b3650 2024-09-12T02:03:57.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.753+0000 7fb1929a6640 1 -- 172.21.15.19:0/2184022248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb18c0b6d20 con 0x7fb18c0b3650 2024-09-12T02:03:57.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.753+0000 7fb188ff9640 1 -- 172.21.15.19:0/2184022248 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 158 v158) ==== 95+0+4392 (secure 0 0 0) 0x7fb17c0594f0 con 0x7fb18c0b3650 2024-09-12T02:03:57.754 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:03:57.754 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":158,"btime":"2024-09-12T02:03:56:737599+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7612,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4107165769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4107165769},{"type":"v1","addr":"172.21.15.135:6837","nonce":4107165769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":156}],"filesystems":[{"mdsmap":{"epoch":158,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:03:56.737542+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:03:57.754 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 158 2024-09-12T02:03:57.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.755+0000 7fb1929a6640 1 -- 172.21.15.19:0/2184022248 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb17806be60 msgr2=0x7fb17806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.755+0000 7fb1929a6640 1 --2- 172.21.15.19:0/2184022248 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb17806be60 0x7fb17806e320 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb180033000 tx=0x7fb18002e000 comp rx=0 tx=0).stop 2024-09-12T02:03:57.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.755+0000 7fb1929a6640 1 -- 172.21.15.19:0/2184022248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb18c0b3650 msgr2=0x7fb18c0c8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.755+0000 7fb1929a6640 1 --2- 172.21.15.19:0/2184022248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb18c0b3650 0x7fb18c0c8a70 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fb17c00d620 tx=0x7fb17c00dae0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.756+0000 7fb1929a6640 1 -- 172.21.15.19:0/2184022248 shutdown_connections 2024-09-12T02:03:57.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.756+0000 7fb1929a6640 1 --2- 172.21.15.19:0/2184022248 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb17806be60 0x7fb17806e320 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.756+0000 7fb1929a6640 1 --2- 172.21.15.19:0/2184022248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb18c15e760 0x7fb18c0b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.756+0000 7fb1929a6640 1 --2- 172.21.15.19:0/2184022248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb18c0d4fd0 0x7fb18c1520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.756+0000 7fb1929a6640 1 --2- 172.21.15.19:0/2184022248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb18c0b3650 0x7fb18c0c8a70 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.756+0000 7fb1929a6640 1 -- 172.21.15.19:0/2184022248 >> 172.21.15.19:0/2184022248 conn(0x7fb18c08bfc0 msgr2=0x7fb18c153380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:57.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.756+0000 7fb1929a6640 1 -- 172.21.15.19:0/2184022248 shutdown_connections 2024-09-12T02:03:57.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.756+0000 7fb1929a6640 1 -- 172.21.15.19:0/2184022248 wait complete. 2024-09-12T02:03:57.767 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 100.00000000.inode' led to DAMAGED state 2024-09-12T02:03:57.767 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 1.00000000' 2024-09-12T02:03:57.767 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:03:57.767 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:03:57.783 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:03:57.783 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:03:57.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:57.783 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:03:57.838 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:03:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:03:57.839 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:03:57.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.981+0000 7f04e9a8c640 1 Processor -- start 2024-09-12T02:03:57.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.981+0000 7f04e9a8c640 1 -- start start 2024-09-12T02:03:57.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.982+0000 7f04e9a8c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f04e40cfcc0 0x7f04e406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.982+0000 7f04e9a8c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04e40d2700 con 0x7f04e40d4fd0 2024-09-12T02:03:57.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.982+0000 7f04e9a8c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04e40cedb0 con 0x7f04e415e760 2024-09-12T02:03:57.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.982+0000 7f04e9a8c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f04e40cf090 con 0x7f04e40cfcc0 2024-09-12T02:03:57.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.982+0000 7f04e3fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f04e40d4fd0 0x7f04e40d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36430/0 (socket says 172.21.15.19:36430) 2024-09-12T02:03:57.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.982+0000 7f04e3fff640 1 -- 172.21.15.19:0/3381244653 learned_addr learned my addr 172.21.15.19:0/3381244653 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:03:57.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.982+0000 7f04e2ffd640 1 --2- 172.21.15.19:0/3381244653 >> v2:172.21.15.135:3300/0 conn(0x7f04e40cfcc0 0x7f04e406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.982+0000 7f04e27fc640 1 -- 172.21.15.19:0/3381244653 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3936276045 0 0) 0x7f04dc001490 con 0x7f04e40d4fd0 2024-09-12T02:03:57.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e27fc640 1 -- 172.21.15.19:0/3381244653 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04cc003520 con 0x7f04e40d4fd0 2024-09-12T02:03:57.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e27fc640 1 -- 172.21.15.19:0/3381244653 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3437511798 0 0) 0x7f04cc003520 con 0x7f04e40d4fd0 2024-09-12T02:03:57.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e27fc640 1 -- 172.21.15.19:0/3381244653 >> v2:172.21.15.135:3300/0 conn(0x7f04e40cfcc0 msgr2=0x7f04e406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:57.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e27fc640 1 --2- 172.21.15.19:0/3381244653 >> v2:172.21.15.135:3300/0 conn(0x7f04e40cfcc0 0x7f04e406cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e27fc640 1 -- 172.21.15.19:0/3381244653 >> v1:172.21.15.135:6789/0 conn(0x7f04e415e760 legacy=0x7f04e40cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e27fc640 1 -- 172.21.15.19:0/3381244653 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e40b3c80 con 0x7f04e40d4fd0 2024-09-12T02:03:57.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e27fc640 1 -- 172.21.15.19:0/3381244653 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f04dc001bc0 con 0x7f04e40d4fd0 2024-09-12T02:03:57.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e2ffd640 1 --2- 172.21.15.19:0/3381244653 >> v2:172.21.15.135:3300/0 conn(0x7f04e40cfcc0 0x7f04e406cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:03:57.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e27fc640 1 -- 172.21.15.19:0/3381244653 >> v1:172.21.15.19:6789/0 conn(0x7f04e40d4fd0 legacy=0x7f04e40d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e27fc640 1 --2- 172.21.15.19:0/3381244653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04cc0039b0 0x7f04cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e27fc640 1 --2- 172.21.15.19:0/3381244653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04cc004800 0x7f04cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e27fc640 1 --2- 172.21.15.19:0/3381244653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04cc0051c0 0x7f04cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e27fc640 1 -- 172.21.15.19:0/3381244653 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f04e40cf090 con 0x7f04cc0039b0 2024-09-12T02:03:57.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e27fc640 1 -- 172.21.15.19:0/3381244653 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc00c060 con 0x7f04cc004800 2024-09-12T02:03:57.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e27fc640 1 -- 172.21.15.19:0/3381244653 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f04cc00c260 con 0x7f04cc0051c0 2024-09-12T02:03:57.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e37fe640 1 --2- 172.21.15.19:0/3381244653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04cc0039b0 0x7f04cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e2ffd640 1 --2- 172.21.15.19:0/3381244653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04cc004800 0x7f04cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e3fff640 1 --2- 172.21.15.19:0/3381244653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04cc0051c0 0x7f04cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e37fe640 1 -- 172.21.15.19:0/3381244653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04cc0051c0 msgr2=0x7f04cc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:57.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e37fe640 1 --2- 172.21.15.19:0/3381244653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04cc0051c0 0x7f04cc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e37fe640 1 -- 172.21.15.19:0/3381244653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04cc004800 msgr2=0x7f04cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:57.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e37fe640 1 --2- 172.21.15.19:0/3381244653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04cc004800 0x7f04cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e3fff640 1 -- 172.21.15.19:0/3381244653 reap_dead start 2024-09-12T02:03:57.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.983+0000 7f04e37fe640 1 -- 172.21.15.19:0/3381244653 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04cc003520 con 0x7f04cc0039b0 2024-09-12T02:03:57.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.984+0000 7f04e37fe640 1 --2- 172.21.15.19:0/3381244653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04cc0039b0 0x7f04cc003dd0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f04d4001750 tx=0x7f04cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4754460ebe36fb74 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:57.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.984+0000 7f04e27fc640 1 -- 172.21.15.19:0/3381244653 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d4001370 con 0x7f04cc0039b0 2024-09-12T02:03:57.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.984+0000 7f04e27fc640 1 -- 172.21.15.19:0/3381244653 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d40052d0 con 0x7f04cc0039b0 2024-09-12T02:03:57.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.984+0000 7f04e27fc640 1 -- 172.21.15.19:0/3381244653 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d402abe0 con 0x7f04cc0039b0 2024-09-12T02:03:57.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.985+0000 7f04e9a8c640 1 -- 172.21.15.19:0/3381244653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04cc0039b0 msgr2=0x7f04cc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.985+0000 7f04e9a8c640 1 --2- 172.21.15.19:0/3381244653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04cc0039b0 0x7f04cc003dd0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f04d4001750 tx=0x7f04cc005830 comp rx=0 tx=0).stop 2024-09-12T02:03:57.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.985+0000 7f04e9a8c640 1 -- 172.21.15.19:0/3381244653 shutdown_connections 2024-09-12T02:03:57.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.985+0000 7f04e9a8c640 1 --2- 172.21.15.19:0/3381244653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04cc0039b0 0x7f04cc003dd0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.985+0000 7f04e9a8c640 1 -- 172.21.15.19:0/3381244653 >> 172.21.15.19:0/3381244653 conn(0x7f04e408bfc0 msgr2=0x7f04e40d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:57.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.985+0000 7f04e9a8c640 1 -- 172.21.15.19:0/3381244653 shutdown_connections 2024-09-12T02:03:57.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.985+0000 7f04e9a8c640 1 -- 172.21.15.19:0/3381244653 wait complete. 2024-09-12T02:03:57.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.986+0000 7f04e9a8c640 1 Processor -- start 2024-09-12T02:03:57.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.986+0000 7f04e9a8c640 1 -- start start 2024-09-12T02:03:57.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.987+0000 7f04e9a8c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04cc0039b0 0x7f04e40b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.987+0000 7f04e9a8c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04e40b87a0 0x7f04e40b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.987+0000 7f04e9a8c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04e40cb620 0x7f04e40cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.987+0000 7f04e9a8c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f04e406cdd0 con 0x7f04e40b87a0 2024-09-12T02:03:57.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.987+0000 7f04e9a8c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f04e40b3860 con 0x7f04e40cb620 2024-09-12T02:03:57.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.987+0000 7f04e9a8c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f04e406cf50 con 0x7f04cc0039b0 2024-09-12T02:03:57.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.987+0000 7f04e2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04e40b87a0 0x7f04e40b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.987+0000 7f04e2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04e40b87a0 0x7f04e40b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50072/0 (socket says 172.21.15.19:50072) 2024-09-12T02:03:57.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.987+0000 7f04e2ffd640 1 -- 172.21.15.19:0/1968526091 learned_addr learned my addr 172.21.15.19:0/1968526091 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:57.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.987+0000 7f04e37fe640 1 --2- 172.21.15.19:0/1968526091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04cc0039b0 0x7f04e40b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.987+0000 7f04e3fff640 1 --2- 172.21.15.19:0/1968526091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04e40cb620 0x7f04e40cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.987+0000 7f04e2ffd640 1 -- 172.21.15.19:0/1968526091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04cc0039b0 msgr2=0x7f04e40b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.987+0000 7f04e2ffd640 1 --2- 172.21.15.19:0/1968526091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04cc0039b0 0x7f04e40b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.987+0000 7f04e2ffd640 1 -- 172.21.15.19:0/1968526091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04e40cb620 msgr2=0x7f04e40cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:57.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.987+0000 7f04e2ffd640 1 --2- 172.21.15.19:0/1968526091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04e40cb620 0x7f04e40cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:57.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.987+0000 7f04e2ffd640 1 -- 172.21.15.19:0/1968526091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e40cc970 con 0x7f04e40b87a0 2024-09-12T02:03:57.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.988+0000 7f04e2ffd640 1 --2- 172.21.15.19:0/1968526091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04e40b87a0 0x7f04e40b50f0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f04d8011d00 tx=0x7f04d800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:57.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.988+0000 7f04cbfff640 1 -- 172.21.15.19:0/1968526091 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d800fd20 con 0x7f04e40b87a0 2024-09-12T02:03:57.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.988+0000 7f04cbfff640 1 -- 172.21.15.19:0/1968526091 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d8004020 con 0x7f04e40b87a0 2024-09-12T02:03:57.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.988+0000 7f04e9a8c640 1 -- 172.21.15.19:0/1968526091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04e4153260 con 0x7f04e40b87a0 2024-09-12T02:03:57.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.988+0000 7f04cbfff640 1 -- 172.21.15.19:0/1968526091 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d80043f0 con 0x7f04e40b87a0 2024-09-12T02:03:57.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.988+0000 7f04e9a8c640 1 -- 172.21.15.19:0/1968526091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04e41537e0 con 0x7f04e40b87a0 2024-09-12T02:03:57.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.989+0000 7f04e9a8c640 1 -- 172.21.15.19:0/1968526091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04e40b6d20 con 0x7f04e40b87a0 2024-09-12T02:03:57.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.989+0000 7f04cbfff640 1 -- 172.21.15.19:0/1968526091 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f04d8012040 con 0x7f04e40b87a0 2024-09-12T02:03:57.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.990+0000 7f04cbfff640 1 --2- 172.21.15.19:0/1968526091 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f04d006be60 0x7f04d006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:57.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.990+0000 7f04cbfff640 1 -- 172.21.15.19:0/1968526091 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 7421+0+0 (secure 0 0 0) 0x7f04d808b8c0 con 0x7f04e40b87a0 2024-09-12T02:03:57.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.990+0000 7f04e37fe640 1 --2- 172.21.15.19:0/1968526091 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f04d006be60 0x7f04d006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:57.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.991+0000 7f04e37fe640 1 --2- 172.21.15.19:0/1968526091 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f04d006be60 0x7f04d006e320 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f04d4032000 tx=0x7f04d402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:57.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:57.994+0000 7f04cbfff640 1 -- 172.21.15.19:0/1968526091 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f04d8019030 con 0x7f04e40b87a0 2024-09-12T02:03:58.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.205+0000 7f04e9a8c640 1 -- 172.21.15.19:0/1968526091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f04e406eb60 con 0x7f04e40b87a0 2024-09-12T02:03:58.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.834+0000 7f04cbfff640 1 -- 172.21.15.19:0/1968526091 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v159) ==== 161+0+0 (secure 0 0 0) 0x7f04d8059630 con 0x7f04e40b87a0 2024-09-12T02:03:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:03:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.837+0000 7f04e9a8c640 1 -- 172.21.15.19:0/1968526091 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f04d006be60 msgr2=0x7f04d006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.837+0000 7f04e9a8c640 1 --2- 172.21.15.19:0/1968526091 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f04d006be60 0x7f04d006e320 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f04d4032000 tx=0x7f04d402e000 comp rx=0 tx=0).stop 2024-09-12T02:03:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.837+0000 7f04e9a8c640 1 -- 172.21.15.19:0/1968526091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04e40b87a0 msgr2=0x7f04e40b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.837+0000 7f04e9a8c640 1 --2- 172.21.15.19:0/1968526091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04e40b87a0 0x7f04e40b50f0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f04d8011d00 tx=0x7f04d800f610 comp rx=0 tx=0).stop 2024-09-12T02:03:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.837+0000 7f04e9a8c640 1 -- 172.21.15.19:0/1968526091 shutdown_connections 2024-09-12T02:03:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.837+0000 7f04e9a8c640 1 --2- 172.21.15.19:0/1968526091 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f04d006be60 0x7f04d006e320 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.837+0000 7f04e9a8c640 1 --2- 172.21.15.19:0/1968526091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04e40cb620 0x7f04e40cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:58.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.837+0000 7f04e9a8c640 1 --2- 172.21.15.19:0/1968526091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04e40b87a0 0x7f04e40b50f0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:58.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.837+0000 7f04e9a8c640 1 --2- 172.21.15.19:0/1968526091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04cc0039b0 0x7f04e40b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:58.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.837+0000 7f04e9a8c640 1 -- 172.21.15.19:0/1968526091 >> 172.21.15.19:0/1968526091 conn(0x7f04e408bfc0 msgr2=0x7f04e40d3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:58.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.837+0000 7f04e9a8c640 1 -- 172.21.15.19:0/1968526091 shutdown_connections 2024-09-12T02:03:58.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.837+0000 7f04e9a8c640 1 -- 172.21.15.19:0/1968526091 wait complete. 2024-09-12T02:03:58.850 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:03:58.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.958+0000 7f9e53b26640 1 Processor -- start 2024-09-12T02:03:58.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.959+0000 7f9e53b26640 1 -- start start 2024-09-12T02:03:58.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.959+0000 7f9e53b26640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9e4c072940 0x7f9e4c072da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:58.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.959+0000 7f9e53b26640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9e4c0b4880 0x7f9e4c0b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:58.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.959+0000 7f9e53b26640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e4c0b3570 con 0x7f9e4c15ba30 2024-09-12T02:03:58.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.959+0000 7f9e53b26640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f9e4c0732e0 con 0x7f9e4c0b4880 2024-09-12T02:03:58.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.960+0000 7f9e53b26640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f9e4c0b4180 con 0x7f9e4c072940 2024-09-12T02:03:58.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.960+0000 7f9e520c3640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9e4c0b4880 0x7f9e4c0b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:58.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.960+0000 7f9e520c3640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9e4c0b4880 0x7f9e4c0b4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50080/0 (socket says 172.21.15.19:50080) 2024-09-12T02:03:58.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.960+0000 7f9e520c3640 1 -- 172.21.15.19:0/1453442452 learned_addr learned my addr 172.21.15.19:0/1453442452 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:58.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.960+0000 7f9e520c3640 1 -- 172.21.15.19:0/1453442452 >> v2:172.21.15.135:3300/0 conn(0x7f9e4c072940 msgr2=0x7f9e4c072da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:58.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.960+0000 7f9e520c3640 1 --2- 172.21.15.19:0/1453442452 >> v2:172.21.15.135:3300/0 conn(0x7f9e4c072940 0x7f9e4c072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:58.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.960+0000 7f9e520c3640 1 -- 172.21.15.19:0/1453442452 >> v1:172.21.15.135:6789/0 conn(0x7f9e4c15ba30 legacy=0x7f9e4c06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:58.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.960+0000 7f9e520c3640 1 -- 172.21.15.19:0/1453442452 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4c0b3850 con 0x7f9e4c0b4880 2024-09-12T02:03:58.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.961+0000 7f9e520c3640 1 --2- 172.21.15.19:0/1453442452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e4c0b4880 0x7f9e4c0b4d10 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c0cfff0 tx=0x7f9e4402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864e4f7d65524670 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:58.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.961+0000 7f9e508c0640 1 -- 172.21.15.19:0/1453442452 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44037070 con 0x7f9e4c0b4880 2024-09-12T02:03:58.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.961+0000 7f9e508c0640 1 -- 172.21.15.19:0/1453442452 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e44032440 con 0x7f9e4c0b4880 2024-09-12T02:03:58.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.961+0000 7f9e508c0640 1 -- 172.21.15.19:0/1453442452 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44032810 con 0x7f9e4c0b4880 2024-09-12T02:03:58.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.961+0000 7f9e53b26640 1 -- 172.21.15.19:0/1453442452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e4c0b4880 msgr2=0x7f9e4c0b4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:58.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.961+0000 7f9e53b26640 1 --2- 172.21.15.19:0/1453442452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e4c0b4880 0x7f9e4c0b4d10 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c0cfff0 tx=0x7f9e4402a230 comp rx=0 tx=0).stop 2024-09-12T02:03:58.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.961+0000 7f9e53b26640 1 -- 172.21.15.19:0/1453442452 shutdown_connections 2024-09-12T02:03:58.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.961+0000 7f9e53b26640 1 --2- 172.21.15.19:0/1453442452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e4c0b4880 0x7f9e4c0b4d10 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:58.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.961+0000 7f9e53b26640 1 --2- 172.21.15.19:0/1453442452 >> v2:172.21.15.135:3300/0 conn(0x7f9e4c072940 0x7f9e4c072da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:58.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.961+0000 7f9e53b26640 1 -- 172.21.15.19:0/1453442452 >> 172.21.15.19:0/1453442452 conn(0x7f9e4c067d70 msgr2=0x7f9e4c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:58.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.961+0000 7f9e53b26640 1 -- 172.21.15.19:0/1453442452 shutdown_connections 2024-09-12T02:03:58.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.961+0000 7f9e53b26640 1 -- 172.21.15.19:0/1453442452 wait complete. 2024-09-12T02:03:58.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.963+0000 7f9e53b26640 1 Processor -- start 2024-09-12T02:03:58.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.963+0000 7f9e53b26640 1 -- start start 2024-09-12T02:03:58.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.963+0000 7f9e53b26640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e4c072940 0x7f9e4c148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:58.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.963+0000 7f9e53b26640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e4c0b4880 0x7f9e4c14ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:58.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.963+0000 7f9e53b26640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e4c15ba30 0x7f9e4c14d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:58.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.963+0000 7f9e53b26640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4c06ff20 con 0x7f9e4c0b4880 2024-09-12T02:03:58.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.963+0000 7f9e53b26640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4c0b3e10 con 0x7f9e4c15ba30 2024-09-12T02:03:58.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.963+0000 7f9e53b26640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9e4c0ce810 con 0x7f9e4c072940 2024-09-12T02:03:58.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.964+0000 7f9e510c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e4c0b4880 0x7f9e4c14ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:58.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.964+0000 7f9e510c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e4c0b4880 0x7f9e4c14ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50096/0 (socket says 172.21.15.19:50096) 2024-09-12T02:03:58.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.964+0000 7f9e510c1640 1 -- 172.21.15.19:0/2031867133 learned_addr learned my addr 172.21.15.19:0/2031867133 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:58.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.964+0000 7f9e518c2640 1 --2- 172.21.15.19:0/2031867133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e4c072940 0x7f9e4c148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:58.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.964+0000 7f9e520c3640 1 --2- 172.21.15.19:0/2031867133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e4c15ba30 0x7f9e4c14d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:58.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.964+0000 7f9e510c1640 1 -- 172.21.15.19:0/2031867133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e4c072940 msgr2=0x7f9e4c148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:58.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.964+0000 7f9e510c1640 1 --2- 172.21.15.19:0/2031867133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e4c072940 0x7f9e4c148a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:58.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.964+0000 7f9e510c1640 1 -- 172.21.15.19:0/2031867133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e4c15ba30 msgr2=0x7f9e4c14d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:58.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.964+0000 7f9e510c1640 1 --2- 172.21.15.19:0/2031867133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e4c15ba30 0x7f9e4c14d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:58.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.964+0000 7f9e510c1640 1 -- 172.21.15.19:0/2031867133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4c131cc0 con 0x7f9e4c0b4880 2024-09-12T02:03:58.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.964+0000 7f9e510c1640 1 --2- 172.21.15.19:0/2031867133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e4c0b4880 0x7f9e4c14ce10 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000b4d0 tx=0x7f9e4000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:58.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.964+0000 7f9e4a7fc640 1 -- 172.21.15.19:0/2031867133 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e40014070 con 0x7f9e4c0b4880 2024-09-12T02:03:58.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.964+0000 7f9e4a7fc640 1 -- 172.21.15.19:0/2031867133 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e40010870 con 0x7f9e4c0b4880 2024-09-12T02:03:58.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.964+0000 7f9e53b26640 1 -- 172.21.15.19:0/2031867133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e4c131f80 con 0x7f9e4c0b4880 2024-09-12T02:03:58.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.964+0000 7f9e4a7fc640 1 -- 172.21.15.19:0/2031867133 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e40010c60 con 0x7f9e4c0b4880 2024-09-12T02:03:58.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.964+0000 7f9e53b26640 1 -- 172.21.15.19:0/2031867133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e4c148f40 con 0x7f9e4c0b4880 2024-09-12T02:03:58.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.965+0000 7f9e53b26640 1 -- 172.21.15.19:0/2031867133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e4c0ccfe0 con 0x7f9e4c0b4880 2024-09-12T02:03:58.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.966+0000 7f9e4a7fc640 1 -- 172.21.15.19:0/2031867133 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e40017070 con 0x7f9e4c0b4880 2024-09-12T02:03:58.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.966+0000 7f9e4a7fc640 1 --2- 172.21.15.19:0/2031867133 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e3806be60 0x7f9e3806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:58.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.967+0000 7f9e4a7fc640 1 -- 172.21.15.19:0/2031867133 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 7421+0+0 (secure 0 0 0) 0x7f9e4008b2b0 con 0x7f9e4c0b4880 2024-09-12T02:03:58.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.967+0000 7f9e518c2640 1 --2- 172.21.15.19:0/2031867133 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e3806be60 0x7f9e3806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:58.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.967+0000 7f9e518c2640 1 --2- 172.21.15.19:0/2031867133 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e3806be60 0x7f9e3806e320 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c009fd0 tx=0x7f9e3c00d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:58.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:58.971+0000 7f9e4a7fc640 1 -- 172.21.15.19:0/2031867133 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e40058ec0 con 0x7f9e4c0b4880 2024-09-12T02:03:59.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.217+0000 7f9e53b26640 1 -- 172.21.15.19:0/2031867133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f9e4c0cf0c0 con 0x7f9e4c0b4880 2024-09-12T02:03:59.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.835+0000 7f9e4a7fc640 1 -- 172.21.15.19:0/2031867133 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v160) ==== 101+0+0 (secure 0 0 0) 0x7f9e4005d1c0 con 0x7f9e4c0b4880 2024-09-12T02:03:59.836 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:03:59.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.838+0000 7f9e53b26640 1 -- 172.21.15.19:0/2031867133 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e3806be60 msgr2=0x7f9e3806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:59.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.838+0000 7f9e53b26640 1 --2- 172.21.15.19:0/2031867133 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e3806be60 0x7f9e3806e320 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c009fd0 tx=0x7f9e3c00d040 comp rx=0 tx=0).stop 2024-09-12T02:03:59.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.838+0000 7f9e53b26640 1 -- 172.21.15.19:0/2031867133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e4c0b4880 msgr2=0x7f9e4c14ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:59.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.838+0000 7f9e53b26640 1 --2- 172.21.15.19:0/2031867133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e4c0b4880 0x7f9e4c14ce10 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000b4d0 tx=0x7f9e4000b990 comp rx=0 tx=0).stop 2024-09-12T02:03:59.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.838+0000 7f9e53b26640 1 -- 172.21.15.19:0/2031867133 shutdown_connections 2024-09-12T02:03:59.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.838+0000 7f9e53b26640 1 --2- 172.21.15.19:0/2031867133 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e3806be60 0x7f9e3806e320 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:59.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.838+0000 7f9e53b26640 1 --2- 172.21.15.19:0/2031867133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e4c15ba30 0x7f9e4c14d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:59.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.838+0000 7f9e53b26640 1 --2- 172.21.15.19:0/2031867133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e4c0b4880 0x7f9e4c14ce10 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:59.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.838+0000 7f9e53b26640 1 --2- 172.21.15.19:0/2031867133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e4c072940 0x7f9e4c148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:59.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.838+0000 7f9e53b26640 1 -- 172.21.15.19:0/2031867133 >> 172.21.15.19:0/2031867133 conn(0x7f9e4c067d70 msgr2=0x7f9e4c1597a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:59.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.838+0000 7f9e53b26640 1 -- 172.21.15.19:0/2031867133 shutdown_connections 2024-09-12T02:03:59.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.838+0000 7f9e53b26640 1 -- 172.21.15.19:0/2031867133 wait complete. 2024-09-12T02:03:59.851 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:03:59.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.898+0000 7f03daae5f40 1 Processor -- start 2024-09-12T02:03:59.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.898+0000 7f03daae5f40 1 -- start start 2024-09-12T02:03:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03daae5f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564cb5901180 0x564cb59d83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03daae5f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x564cb592f050 0x564cb5948340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03daae5f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb59b9080 0x564cb59b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03daae5f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564cb5850510 con 0x564cb5901180 2024-09-12T02:03:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03daae5f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564cb58a9c50 con 0x564cb59b9080 2024-09-12T02:03:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03daae5f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x564cb59015c0 con 0x564cb592f050 2024-09-12T02:03:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03d85db640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564cb5901180 0x564cb59d83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03d85db640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564cb5901180 0x564cb59d83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50098/0 (socket says 172.21.15.19:50098) 2024-09-12T02:03:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03d85db640 1 -- 172.21.15.19:0/1482695585 learned_addr learned my addr 172.21.15.19:0/1482695585 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03d8ddc640 1 --2- 172.21.15.19:0/1482695585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb59b9080 0x564cb59b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03d7dda640 1 --2- 172.21.15.19:0/1482695585 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x564cb592f050 0x564cb5948340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03d85db640 1 -- 172.21.15.19:0/1482695585 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x564cb592f050 msgr2=0x564cb5948340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03d85db640 1 --2- 172.21.15.19:0/1482695585 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x564cb592f050 0x564cb5948340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03d85db640 1 -- 172.21.15.19:0/1482695585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb59b9080 msgr2=0x564cb59b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:03:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03d85db640 1 --2- 172.21.15.19:0/1482695585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb59b9080 0x564cb59b6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03d85db640 1 -- 172.21.15.19:0/1482695585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cb58ff290 con 0x564cb5901180 2024-09-12T02:03:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03d7dda640 1 --2- 172.21.15.19:0/1482695585 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x564cb592f050 0x564cb5948340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03d85db640 1 --2- 172.21.15.19:0/1482695585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564cb5901180 0x564cb59d83e0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f03c80011e0 tx=0x7f03c800b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e9546463a3fa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03d6dd8640 1 -- 172.21.15.19:0/1482695585 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c8012020 con 0x564cb5901180 2024-09-12T02:03:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03d6dd8640 1 -- 172.21.15.19:0/1482695585 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c800e690 con 0x564cb5901180 2024-09-12T02:03:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.899+0000 7f03d6dd8640 1 -- 172.21.15.19:0/1482695585 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c800eac0 con 0x564cb5901180 2024-09-12T02:03:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.900+0000 7f03daae5f40 1 -- 172.21.15.19:0/1482695585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564cb5901180 msgr2=0x564cb59d83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.900+0000 7f03daae5f40 1 --2- 172.21.15.19:0/1482695585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564cb5901180 0x564cb59d83e0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f03c80011e0 tx=0x7f03c800b800 comp rx=0 tx=0).stop 2024-09-12T02:03:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.900+0000 7f03daae5f40 1 -- 172.21.15.19:0/1482695585 shutdown_connections 2024-09-12T02:03:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.900+0000 7f03daae5f40 1 --2- 172.21.15.19:0/1482695585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb59b9080 0x564cb59b6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.900+0000 7f03daae5f40 1 --2- 172.21.15.19:0/1482695585 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x564cb592f050 0x564cb5948340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.900+0000 7f03daae5f40 1 --2- 172.21.15.19:0/1482695585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564cb5901180 0x564cb59d83e0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.900+0000 7f03daae5f40 1 -- 172.21.15.19:0/1482695585 >> 172.21.15.19:0/1482695585 conn(0x564cb58fe9e0 msgr2=0x564cb59d8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.900+0000 7f03daae5f40 1 -- 172.21.15.19:0/1482695585 shutdown_connections 2024-09-12T02:03:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.900+0000 7f03daae5f40 1 -- 172.21.15.19:0/1482695585 wait complete. 2024-09-12T02:03:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.901+0000 7f03daae5f40 1 Processor -- start 2024-09-12T02:03:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.901+0000 7f03daae5f40 1 -- start start 2024-09-12T02:03:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.901+0000 7f03daae5f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x564cb5901180 0x564cb59d4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.901+0000 7f03daae5f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb592f050 0x564cb5a74240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.901+0000 7f03daae5f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564cb59b9080 0x564cb5a74780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:59.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.901+0000 7f03daae5f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564cb59beca0 con 0x564cb59b9080 2024-09-12T02:03:59.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.901+0000 7f03daae5f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564cb5900d80 con 0x564cb592f050 2024-09-12T02:03:59.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.901+0000 7f03daae5f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x564cb59d7ec0 con 0x564cb5901180 2024-09-12T02:03:59.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.901+0000 7f03d8ddc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564cb59b9080 0x564cb5a74780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:59.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.902+0000 7f03d8ddc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564cb59b9080 0x564cb5a74780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50110/0 (socket says 172.21.15.19:50110) 2024-09-12T02:03:59.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.902+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 learned_addr learned my addr 172.21.15.19:0/3527464736 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:03:59.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.902+0000 7f03d7dda640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb592f050 0x564cb5a74240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:59.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.902+0000 7f03d85db640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x564cb5901180 0x564cb59d4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:59.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.902+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x564cb5901180 msgr2=0x564cb59d4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:59.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.902+0000 7f03d8ddc640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x564cb5901180 0x564cb59d4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:59.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.902+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb592f050 msgr2=0x564cb5a74240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:59.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.902+0000 7f03d8ddc640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb592f050 0x564cb5a74240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.902+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cb59be770 con 0x564cb59b9080 2024-09-12T02:03:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.902+0000 7f03d8ddc640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564cb59b9080 0x564cb5a74780 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f03d0004250 tx=0x7f03d000d5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.902+0000 7f03d5dd6640 1 -- 172.21.15.19:0/3527464736 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d0018070 con 0x564cb59b9080 2024-09-12T02:03:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.902+0000 7f03d5dd6640 1 -- 172.21.15.19:0/3527464736 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03d000de20 con 0x564cb59b9080 2024-09-12T02:03:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.902+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cb592a530 con 0x564cb59b9080 2024-09-12T02:03:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.902+0000 7f03d5dd6640 1 -- 172.21.15.19:0/3527464736 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d0001540 con 0x564cb59b9080 2024-09-12T02:03:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.902+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cb59b68f0 con 0x564cb59b9080 2024-09-12T02:03:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.904+0000 7f03d5dd6640 1 -- 172.21.15.19:0/3527464736 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f03d001b070 con 0x564cb59b9080 2024-09-12T02:03:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.904+0000 7f03d5dd6640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f03c406a840 0x7f03c406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:59.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.904+0000 7f03d5dd6640 1 -- 172.21.15.19:0/3527464736 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 7421+0+0 (secure 0 0 0) 0x7f03d0089790 con 0x564cb59b9080 2024-09-12T02:03:59.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.904+0000 7f03d85db640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f03c406a840 0x7f03c406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:59.910 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:03:59.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.905+0000 7f03daae5f40 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x564cb59d4990 0x564cb59ba380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:59.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.905+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb59d7720 con 0x564cb59d4990 2024-09-12T02:03:59.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.905+0000 7f03d7dda640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x564cb59d4990 0x564cb59ba380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:59.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.905+0000 7f03d85db640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f03c406a840 0x7f03c406cd00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f03c80011e0 tx=0x7f03c801b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:59.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.905+0000 7f03d7dda640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x564cb59d4990 0x564cb59ba380 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:59.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.907+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v108'412 uv386 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.907+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb59d9040 con 0x564cb59d4990 2024-09-12T02:03:59.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.908+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v108'413 uv413 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.908+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb59ba8c0 con 0x564cb59d4990 2024-09-12T02:03:59.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.909+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v108'414 uv414 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.913 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:03:59.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.909+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb59bac60 con 0x564cb59d4990 2024-09-12T02:03:59.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.910+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v108'415 uv415 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.910+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7e520 con 0x564cb59d4990 2024-09-12T02:03:59.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.911+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v108'416 uv416 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.911+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7d510 con 0x564cb59d4990 2024-09-12T02:03:59.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.912+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v108'417 uv417 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.912+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7d900 con 0x564cb59d4990 2024-09-12T02:03:59.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.913+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v108'418 uv392 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.913+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7dcf0 con 0x564cb59d4990 2024-09-12T02:03:59.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.914+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v108'419 uv419 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.914+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7dcf0 con 0x564cb59d4990 2024-09-12T02:03:59.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.915+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v108'420 uv420 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.917 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:03:59.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.915+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7dca0 con 0x564cb59d4990 2024-09-12T02:03:59.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.916+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v108'421 uv421 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.916+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7dca0 con 0x564cb59d4990 2024-09-12T02:03:59.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.917+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v108'422 uv422 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.917+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7e0a0 con 0x564cb59d4990 2024-09-12T02:03:59.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.918+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v108'423 uv423 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.918+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7e0a0 con 0x564cb59d4990 2024-09-12T02:03:59.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.919+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v108'424 uv399 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.919+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7e0a0 con 0x564cb59d4990 2024-09-12T02:03:59.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.920+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v108'425 uv425 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.920+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7e0a0 con 0x564cb59d4990 2024-09-12T02:03:59.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.921+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v108'426 uv426 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.921 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:03:59.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.921+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7e0a0 con 0x564cb59d4990 2024-09-12T02:03:59.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.922+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v108'427 uv427 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.922+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7e0a0 con 0x564cb59d4990 2024-09-12T02:03:59.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.923+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v108'428 uv428 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.923+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7e0a0 con 0x564cb59d4990 2024-09-12T02:03:59.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.924+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v108'429 uv429 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.924+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7ed70 con 0x564cb59d4990 2024-09-12T02:03:59.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.926+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v108'430 uv430 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.926+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7ed70 con 0x564cb59d4990 2024-09-12T02:03:59.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.927+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v108'431 uv405 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.927+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7ed70 con 0x564cb59d4990 2024-09-12T02:03:59.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.928+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v108'432 uv432 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.928+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7ed70 con 0x564cb59d4990 2024-09-12T02:03:59.929 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:03:59.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.929+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v108'433 uv433 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.929+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7fd80 con 0x564cb59d4990 2024-09-12T02:03:59.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.930+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v108'434 uv434 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.930+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7fd80 con 0x564cb59d4990 2024-09-12T02:03:59.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.930+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v108'435 uv435 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.930+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7ed70 con 0x564cb59d4990 2024-09-12T02:03:59.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.931+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v108'436 uv436 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.931+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7ed70 con 0x564cb59d4990 2024-09-12T02:03:59.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.932+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v108'437 uv411 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.932+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7ed70 con 0x564cb59d4990 2024-09-12T02:03:59.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.933+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v108'438 uv438 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.933+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7ed70 con 0x564cb59d4990 2024-09-12T02:03:59.936 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:03:59.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.936+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v108'439 uv439 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.936+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7fd80 con 0x564cb59d4990 2024-09-12T02:03:59.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.937+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v108'440 uv440 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.937+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7fd80 con 0x564cb59d4990 2024-09-12T02:03:59.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.938+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v108'441 uv441 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.938+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a7ed70 con 0x564cb59d4990 2024-09-12T02:03:59.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.939+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v108'442 uv442 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb59d4990 2024-09-12T02:03:59.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.939+0000 7f03daae5f40 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x564cb5a7f280 0x564cb5a81670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:59.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.939+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a81bb0 con 0x564cb5a7f280 2024-09-12T02:03:59.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.939+0000 7f03d85db640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x564cb5a7f280 0x564cb5a81670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:59.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.940+0000 7f03d85db640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x564cb5a7f280 0x564cb5a81670 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:59.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.941+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v108'309 uv292 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.941+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a81f50 con 0x564cb5a7f280 2024-09-12T02:03:59.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.942+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v108'310 uv310 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.942+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a822f0 con 0x564cb5a7f280 2024-09-12T02:03:59.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.944+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v108'311 uv311 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.944 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:03:59.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.944+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a82690 con 0x564cb5a7f280 2024-09-12T02:03:59.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.945+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v108'312 uv312 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.945+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a82a30 con 0x564cb5a7f280 2024-09-12T02:03:59.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.946+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v108'313 uv313 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.946+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a82dd0 con 0x564cb5a7f280 2024-09-12T02:03:59.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.947+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v108'314 uv297 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.947+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a83170 con 0x564cb5a7f280 2024-09-12T02:03:59.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.948+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v108'315 uv315 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.948+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a83170 con 0x564cb5a7f280 2024-09-12T02:03:59.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.949+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v108'316 uv316 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.951 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:03:59.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.949+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a83170 con 0x564cb5a7f280 2024-09-12T02:03:59.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.950+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v108'317 uv317 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.950+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a83170 con 0x564cb5a7f280 2024-09-12T02:03:59.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.951+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v108'318 uv318 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.951+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a83170 con 0x564cb5a7f280 2024-09-12T02:03:59.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.952+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v108'319 uv302 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.952+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a83170 con 0x564cb5a7f280 2024-09-12T02:03:59.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.953+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v108'320 uv320 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.954+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a83170 con 0x564cb5a7f280 2024-09-12T02:03:59.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.955+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v108'321 uv321 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.956 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:03:59.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.955+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a875f0 con 0x564cb5a7f280 2024-09-12T02:03:59.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.956+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v108'322 uv322 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.956+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a875f0 con 0x564cb5a7f280 2024-09-12T02:03:59.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.957+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v108'323 uv323 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.957+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a83170 con 0x564cb5a7f280 2024-09-12T02:03:59.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.958+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v108'324 uv308 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.958+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a83170 con 0x564cb5a7f280 2024-09-12T02:03:59.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.960+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v108'325 uv325 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.960+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a83170 con 0x564cb5a7f280 2024-09-12T02:03:59.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.961+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v108'326 uv326 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.961 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:03:59.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.961+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a84180 con 0x564cb5a7f280 2024-09-12T02:03:59.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.962+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v108'327 uv327 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.962+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a84180 con 0x564cb5a7f280 2024-09-12T02:03:59.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.963+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v108'328 uv328 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.963+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a83170 con 0x564cb5a7f280 2024-09-12T02:03:59.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.964+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v108'329 uv329 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a7f280 2024-09-12T02:03:59.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.964+0000 7f03daae5f40 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x564cb5a83680 0x564cb5a85a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:59.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.964+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a85fb0 con 0x564cb5a83680 2024-09-12T02:03:59.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.964+0000 7f03d7dda640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x564cb5a83680 0x564cb5a85a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:59.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.964+0000 7f03d7dda640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x564cb5a83680 0x564cb5a85a70 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:59.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.966+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v108'81 uv80 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:03:59.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.966+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a85fb0 con 0x564cb5a83680 2024-09-12T02:03:59.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.967+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v108'82 uv82 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:03:59.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.967+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a86030 con 0x564cb5a83680 2024-09-12T02:03:59.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.968+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v108'83 uv83 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:03:59.969 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:03:59.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.968+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a87430 con 0x564cb5a83680 2024-09-12T02:03:59.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.969+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v108'84 uv84 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:03:59.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.969+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a87430 con 0x564cb5a83680 2024-09-12T02:03:59.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.970+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v108'85 uv85 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:03:59.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.970+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a86420 con 0x564cb5a83680 2024-09-12T02:03:59.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.971+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v108'86 uv86 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:03:59.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.971+0000 7f03daae5f40 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x564cb5a86930 0x564cb5a88d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:59.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.971+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a89330 con 0x564cb5a86930 2024-09-12T02:03:59.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.971+0000 7f03d8ddc640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x564cb5a86930 0x564cb5a88d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:59.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.971+0000 7f03d8ddc640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x564cb5a86930 0x564cb5a88d20 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:59.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.973+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v108'64 uv63 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.973+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a89820 con 0x564cb5a86930 2024-09-12T02:03:59.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.974+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v108'65 uv65 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.974+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a89d20 con 0x564cb5a86930 2024-09-12T02:03:59.975 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:03:59.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.974+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v108'66 uv66 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.975+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8a5e0 con 0x564cb5a86930 2024-09-12T02:03:59.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.976+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v108'67 uv67 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.976+0000 7f03daae5f40 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x564cb5a8ae90 0x564cb5a8d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:59.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.976+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8d7c0 con 0x564cb5a8ae90 2024-09-12T02:03:59.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.976+0000 7f03d85db640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x564cb5a8ae90 0x564cb5a8d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:59.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.976+0000 7f03d85db640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x564cb5a8ae90 0x564cb5a8d280 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:59.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.977+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v108'81 uv80 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:03:59.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.978+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8d880 con 0x564cb5a8ae90 2024-09-12T02:03:59.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.979+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v108'82 uv82 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:03:59.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.979+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8dca0 con 0x564cb5a8ae90 2024-09-12T02:03:59.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.980+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v108'83 uv83 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:03:59.980 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:03:59.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.980+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8ecb0 con 0x564cb5a8ae90 2024-09-12T02:03:59.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.981+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v108'84 uv84 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:03:59.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.981+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8ecb0 con 0x564cb5a8ae90 2024-09-12T02:03:59.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.982+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v108'85 uv85 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:03:59.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.983+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8dca0 con 0x564cb5a8ae90 2024-09-12T02:03:59.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.984+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v108'86 uv86 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:03:59.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.984+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8dca0 con 0x564cb5a86930 2024-09-12T02:03:59.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.985+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v108'149 uv143 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.985+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e040 con 0x564cb5a86930 2024-09-12T02:03:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.986+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v108'150 uv150 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.986+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e3e0 con 0x564cb5a86930 2024-09-12T02:03:59.987 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:03:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.987+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v108'151 uv151 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.987+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8f790 con 0x564cb5a86930 2024-09-12T02:03:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.988+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v108'152 uv152 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.988+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8f790 con 0x564cb5a86930 2024-09-12T02:03:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.989+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v108'153 uv153 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.989+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e780 con 0x564cb5a86930 2024-09-12T02:03:59.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.990+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v108'154 uv154 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.990+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e780 con 0x564cb5a86930 2024-09-12T02:03:59.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.991+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v108'155 uv148 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.991+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e780 con 0x564cb5a86930 2024-09-12T02:03:59.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.992+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v108'156 uv156 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.992+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e780 con 0x564cb5a86930 2024-09-12T02:03:59.993 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:03:59.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.993+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v108'157 uv157 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.993+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e780 con 0x564cb5a86930 2024-09-12T02:03:59.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.994+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v108'158 uv158 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.994+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e780 con 0x564cb5a86930 2024-09-12T02:03:59.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.995+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v108'159 uv159 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.995+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e780 con 0x564cb5a86930 2024-09-12T02:03:59.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.996+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v108'66 uv65 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.996+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e780 con 0x564cb5a86930 2024-09-12T02:03:59.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.997+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v108'67 uv67 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.997+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e780 con 0x564cb5a86930 2024-09-12T02:03:59.998 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:03:59.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.998+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v108'68 uv68 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.998+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e780 con 0x564cb5a86930 2024-09-12T02:03:59.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.999+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v108'69 uv69 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:03:59.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:03:59.999+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e780 con 0x564cb5a86930 2024-09-12T02:04:00.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.000+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v108'70 uv70 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f03d001a030 con 0x564cb5a86930 2024-09-12T02:04:00.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.000+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e780 con 0x564cb5a8ae90 2024-09-12T02:04:00.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.001+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v108'81 uv80 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.001+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e780 con 0x564cb5a8ae90 2024-09-12T02:04:00.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.002+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v108'82 uv82 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.002+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e780 con 0x564cb5a8ae90 2024-09-12T02:04:00.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.003+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v108'83 uv83 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.004 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:04:00.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.003+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8fbb0 con 0x564cb5a8ae90 2024-09-12T02:04:00.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.004+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v108'84 uv84 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.004+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8fbb0 con 0x564cb5a8ae90 2024-09-12T02:04:00.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.005+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v108'85 uv85 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.005+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e8d0 con 0x564cb5a8ae90 2024-09-12T02:04:00.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.006+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v108'86 uv86 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.006+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e8d0 con 0x564cb5a8ae90 2024-09-12T02:04:00.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.007+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v108'132 uv126 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.007+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e850 con 0x564cb5a8ae90 2024-09-12T02:04:00.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.008+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v108'133 uv133 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.008+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e850 con 0x564cb5a8ae90 2024-09-12T02:04:00.010 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:04:00.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.010+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v108'134 uv134 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.010+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8ec40 con 0x564cb5a8ae90 2024-09-12T02:04:00.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.011+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v108'135 uv135 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.011+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e960 con 0x564cb5a8ae90 2024-09-12T02:04:00.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.012+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v108'136 uv136 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.012+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e960 con 0x564cb5a8ae90 2024-09-12T02:04:00.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.013+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v108'137 uv131 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.013+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e910 con 0x564cb5a8ae90 2024-09-12T02:04:00.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.014+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v108'138 uv138 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.014+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8e8f0 con 0x564cb5a8ae90 2024-09-12T02:04:00.016 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:04:00.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.015+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v108'139 uv139 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.015+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8ece0 con 0x564cb5a8ae90 2024-09-12T02:04:00.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.016+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v108'140 uv140 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.016+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a8a230 con 0x564cb5a8ae90 2024-09-12T02:04:00.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.017+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v108'141 uv141 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.017+0000 7f03daae5f40 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x564cb5a8f7c0 0x564cb5a91e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.017+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a8f7c0 2024-09-12T02:04:00.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.017+0000 7f03d7dda640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x564cb5a8f7c0 0x564cb5a91e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.018+0000 7f03d7dda640 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x564cb5a8f7c0 0x564cb5a91e10 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:00.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.019+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v108'61 uv60 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a8f7c0 2024-09-12T02:04:00.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.019+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a8f7c0 2024-09-12T02:04:00.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.020+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v108'62 uv62 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a8f7c0 2024-09-12T02:04:00.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.020+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a8f7c0 2024-09-12T02:04:00.023 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:04:00.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.023+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v108'63 uv63 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a8f7c0 2024-09-12T02:04:00.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.023+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a8f7c0 2024-09-12T02:04:00.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.025+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v108'64 uv64 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a8f7c0 2024-09-12T02:04:00.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.025+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a8ae90 2024-09-12T02:04:00.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.027+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v108'81 uv80 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.027+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a8ae90 2024-09-12T02:04:00.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.028+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v108'82 uv82 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.028+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a8ae90 2024-09-12T02:04:00.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.029+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v108'83 uv83 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.029 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:04:00.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.029+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a93360 con 0x564cb5a8ae90 2024-09-12T02:04:00.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.030+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v108'84 uv84 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.030+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a93360 con 0x564cb5a8ae90 2024-09-12T02:04:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.031+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v108'85 uv85 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.031+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a8ae90 2024-09-12T02:04:00.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.033+0000 7f03d85db640 1 -- 172.21.15.19:0/3527464736 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v108'86 uv86 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03c800ea90 con 0x564cb5a8ae90 2024-09-12T02:04:00.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.033+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a83680 2024-09-12T02:04:00.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.034+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v108'69 uv68 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:04:00.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.034+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a83680 2024-09-12T02:04:00.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.035+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v108'70 uv70 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:04:00.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.035+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a83680 2024-09-12T02:04:00.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.036+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v108'71 uv71 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:04:00.037 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:04:00.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.036+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a83680 2024-09-12T02:04:00.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.037+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v108'72 uv72 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:04:00.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.037+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a83680 2024-09-12T02:04:00.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.039+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v108'73 uv73 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:04:00.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.039+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a83680 2024-09-12T02:04:00.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.040+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v108'170 uv170 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:04:00.040 INFO:teuthology.orchestra.run.smithi019.stdout:Write #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:04:00.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.040+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a83680 2024-09-12T02:04:00.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.041+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v108'171 uv171 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:04:00.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.041+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a83680 2024-09-12T02:04:00.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.044+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v108'172 uv172 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:04:00.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.044+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a83680 2024-09-12T02:04:00.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.045+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 1.00000000 [create] v108'173 uv168 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:04:00.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.045+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a83680 2024-09-12T02:04:00.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.046+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 1.00000000 [delete] v108'174 uv174 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:04:00.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.046+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a83680 2024-09-12T02:04:00.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.047+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v108'175 uv175 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:04:00.047 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:04:00.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.047+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a93360 con 0x564cb5a83680 2024-09-12T02:04:00.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.048+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v108'176 uv176 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:04:00.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.048+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a93360 con 0x564cb5a83680 2024-09-12T02:04:00.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.049+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v108'177 uv177 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:04:00.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.049+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92350 con 0x564cb5a83680 2024-09-12T02:04:00.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.050+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [omap-set-header] v108'178 uv178 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:04:00.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.050+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x564cb5a92800 con 0x564cb5a83680 2024-09-12T02:04:00.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03d7dda640 1 -- 172.21.15.19:0/3527464736 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v108'179 uv179 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f03cc05c040 con 0x564cb5a83680 2024-09-12T02:04:00.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x564cb5a7f280 msgr2=0x564cb5a81670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x564cb5a7f280 0x564cb5a81670 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x564cb59d4990 msgr2=0x564cb59ba380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x564cb59d4990 0x564cb59ba380 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x564cb5a86930 msgr2=0x564cb5a88d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x564cb5a86930 0x564cb5a88d20 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x564cb5a8f7c0 msgr2=0x564cb5a91e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x564cb5a8f7c0 0x564cb5a91e10 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 reap_dead start 2024-09-12T02:04:00.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x564cb5a83680 msgr2=0x564cb5a85a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x564cb5a83680 0x564cb5a85a70 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x564cb5a8ae90 msgr2=0x564cb5a8d280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03d8ddc640 1 -- 172.21.15.19:0/3527464736 reap_dead start 2024-09-12T02:04:00.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x564cb5a8ae90 0x564cb5a8d280 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f03c406a840 msgr2=0x7f03c406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f03c406a840 0x7f03c406cd00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f03c80011e0 tx=0x7f03c801b040 comp rx=0 tx=0).stop 2024-09-12T02:04:00.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564cb59b9080 msgr2=0x564cb5a74780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564cb59b9080 0x564cb5a74780 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f03d0004250 tx=0x7f03d000d5f0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 shutdown_connections 2024-09-12T02:04:00.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x564cb5a8ae90 0x564cb5a8d280 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f03c406a840 0x7f03c406cd00 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 --2- 172.21.15.19:0/3527464736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564cb59b9080 0x564cb5a74780 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 >> 172.21.15.19:0/3527464736 conn(0x564cb58fe9e0 msgr2=0x564cb59d8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:00.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.051+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 shutdown_connections 2024-09-12T02:04:00.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.052+0000 7f03daae5f40 1 -- 172.21.15.19:0/3527464736 wait complete. 2024-09-12T02:04:00.056 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 1.00000000 2024-09-12T02:04:00.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.139+0000 7f252f25bf40 1 Processor -- start 2024-09-12T02:04:00.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.139+0000 7f252f25bf40 1 -- start start 2024-09-12T02:04:00.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.140+0000 7f252f25bf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfdb464f40 0x55cfdb5070a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.140+0000 7f252f25bf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55cfdb513240 0x55cfdb466a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.140+0000 7f252f25bf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfdb50cd40 0x55cfdb59c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.140+0000 7f252f25bf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cfdb481f20 con 0x55cfdb464f40 2024-09-12T02:04:00.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.140+0000 7f252f25bf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cfdb38c510 con 0x55cfdb50cd40 2024-09-12T02:04:00.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.140+0000 7f252f25bf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55cfdb4824a0 con 0x55cfdb513240 2024-09-12T02:04:00.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.140+0000 7f252cd51640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfdb464f40 0x55cfdb5070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.140+0000 7f252cd51640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfdb464f40 0x55cfdb5070a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50118/0 (socket says 172.21.15.19:50118) 2024-09-12T02:04:00.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.140+0000 7f252cd51640 1 -- 172.21.15.19:0/3857239253 learned_addr learned my addr 172.21.15.19:0/3857239253 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:00.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.140+0000 7f252c550640 1 --2- 172.21.15.19:0/3857239253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55cfdb513240 0x55cfdb466a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.140+0000 7f252d552640 1 --2- 172.21.15.19:0/3857239253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfdb50cd40 0x55cfdb59c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.140+0000 7f252cd51640 1 -- 172.21.15.19:0/3857239253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55cfdb513240 msgr2=0x55cfdb466a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:00.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.140+0000 7f252cd51640 1 --2- 172.21.15.19:0/3857239253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55cfdb513240 0x55cfdb466a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.140+0000 7f252cd51640 1 -- 172.21.15.19:0/3857239253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfdb50cd40 msgr2=0x55cfdb59c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:00.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.140+0000 7f252cd51640 1 --2- 172.21.15.19:0/3857239253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfdb50cd40 0x55cfdb59c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.140+0000 7f252cd51640 1 -- 172.21.15.19:0/3857239253 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfdb510380 con 0x55cfdb464f40 2024-09-12T02:04:00.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.141+0000 7f252cd51640 1 --2- 172.21.15.19:0/3857239253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfdb464f40 0x55cfdb5070a0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f251c009950 tx=0x7f251c005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ab25a3ffbe3693 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:00.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.141+0000 7f252b54e640 1 -- 172.21.15.19:0/3857239253 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251c0089b0 con 0x55cfdb464f40 2024-09-12T02:04:00.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.141+0000 7f252b54e640 1 -- 172.21.15.19:0/3857239253 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f251c018070 con 0x55cfdb464f40 2024-09-12T02:04:00.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.141+0000 7f252b54e640 1 -- 172.21.15.19:0/3857239253 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251c008d50 con 0x55cfdb464f40 2024-09-12T02:04:00.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.141+0000 7f252f25bf40 1 -- 172.21.15.19:0/3857239253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfdb464f40 msgr2=0x55cfdb5070a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.141+0000 7f252f25bf40 1 --2- 172.21.15.19:0/3857239253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfdb464f40 0x55cfdb5070a0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f251c009950 tx=0x7f251c005a00 comp rx=0 tx=0).stop 2024-09-12T02:04:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.141+0000 7f252f25bf40 1 -- 172.21.15.19:0/3857239253 shutdown_connections 2024-09-12T02:04:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.141+0000 7f252f25bf40 1 --2- 172.21.15.19:0/3857239253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfdb50cd40 0x55cfdb59c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.141+0000 7f252f25bf40 1 --2- 172.21.15.19:0/3857239253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55cfdb513240 0x55cfdb466a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.141+0000 7f252f25bf40 1 --2- 172.21.15.19:0/3857239253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfdb464f40 0x55cfdb5070a0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.141+0000 7f252f25bf40 1 -- 172.21.15.19:0/3857239253 >> 172.21.15.19:0/3857239253 conn(0x55cfdb43a9e0 msgr2=0x55cfdb43adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.141+0000 7f252f25bf40 1 -- 172.21.15.19:0/3857239253 shutdown_connections 2024-09-12T02:04:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.141+0000 7f252f25bf40 1 -- 172.21.15.19:0/3857239253 wait complete. 2024-09-12T02:04:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.142+0000 7f252f25bf40 1 Processor -- start 2024-09-12T02:04:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.142+0000 7f252f25bf40 1 -- start start 2024-09-12T02:04:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.143+0000 7f252f25bf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfdb464f40 0x55cfdb5a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.143+0000 7f252f25bf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfdb513240 0x55cfdb43a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.143+0000 7f252f25bf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55cfdb504ef0 0x55cfdb5046c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.143+0000 7f252f25bf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cfdb50d8e0 con 0x55cfdb513240 2024-09-12T02:04:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.143+0000 7f252f25bf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cfdb510130 con 0x55cfdb464f40 2024-09-12T02:04:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.143+0000 7f252f25bf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55cfdb5075e0 con 0x55cfdb504ef0 2024-09-12T02:04:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.143+0000 7f252c550640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfdb513240 0x55cfdb43a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.143+0000 7f252c550640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfdb513240 0x55cfdb43a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50122/0 (socket says 172.21.15.19:50122) 2024-09-12T02:04:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.143+0000 7f252c550640 1 -- 172.21.15.19:0/2603425465 learned_addr learned my addr 172.21.15.19:0/2603425465 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.143+0000 7f252cd51640 1 --2- 172.21.15.19:0/2603425465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfdb464f40 0x55cfdb5a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.143+0000 7f252d552640 1 --2- 172.21.15.19:0/2603425465 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55cfdb504ef0 0x55cfdb5046c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.143+0000 7f252c550640 1 -- 172.21.15.19:0/2603425465 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55cfdb504ef0 msgr2=0x55cfdb5046c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.143+0000 7f252c550640 1 --2- 172.21.15.19:0/2603425465 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55cfdb504ef0 0x55cfdb5046c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.143+0000 7f252c550640 1 -- 172.21.15.19:0/2603425465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfdb464f40 msgr2=0x55cfdb5a89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.143+0000 7f252c550640 1 --2- 172.21.15.19:0/2603425465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfdb464f40 0x55cfdb5a89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.143+0000 7f252c550640 1 -- 172.21.15.19:0/2603425465 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfdb50a510 con 0x55cfdb513240 2024-09-12T02:04:00.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.143+0000 7f252c550640 1 --2- 172.21.15.19:0/2603425465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfdb513240 0x55cfdb43a150 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x55cfdb43f010 tx=0x7f252000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:00.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.144+0000 7f252a54c640 1 -- 172.21.15.19:0/2603425465 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2520008070 con 0x55cfdb513240 2024-09-12T02:04:00.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.144+0000 7f252a54c640 1 -- 172.21.15.19:0/2603425465 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25200116a0 con 0x55cfdb513240 2024-09-12T02:04:00.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.144+0000 7f252f25bf40 1 -- 172.21.15.19:0/2603425465 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfdb50a7f0 con 0x55cfdb513240 2024-09-12T02:04:00.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.144+0000 7f252a54c640 1 -- 172.21.15.19:0/2603425465 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2520011a90 con 0x55cfdb513240 2024-09-12T02:04:00.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.144+0000 7f252f25bf40 1 -- 172.21.15.19:0/2603425465 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfdb469860 con 0x55cfdb513240 2024-09-12T02:04:00.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.145+0000 7f252a54c640 1 -- 172.21.15.19:0/2603425465 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2520011c30 con 0x55cfdb513240 2024-09-12T02:04:00.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.145+0000 7f252a54c640 1 --2- 172.21.15.19:0/2603425465 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f251806a840 0x7f251806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.146+0000 7f252a54c640 1 -- 172.21.15.19:0/2603425465 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 7421+0+0 (secure 0 0 0) 0x7f252008a6f0 con 0x55cfdb513240 2024-09-12T02:04:00.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.146+0000 7f252cd51640 1 --2- 172.21.15.19:0/2603425465 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f251806a840 0x7f251806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.146+0000 7f252f25bf40 1 --2- 172.21.15.19:0/2603425465 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55cfdb46a060 0x55cfdb46a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.146+0000 7f252f25bf40 1 -- 172.21.15.19:0/2603425465 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55cfdb46a9b0 con 0x55cfdb46a060 2024-09-12T02:04:00.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.146+0000 7f252d552640 1 --2- 172.21.15.19:0/2603425465 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55cfdb46a060 0x55cfdb46a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.146+0000 7f252cd51640 1 --2- 172.21.15.19:0/2603425465 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f251806a840 0x7f251806cd00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f251c015040 tx=0x7f251c012000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:00.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.146+0000 7f252d552640 1 --2- 172.21.15.19:0/2603425465 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55cfdb46a060 0x55cfdb46a470 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:00.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.148+0000 7f252d552640 1 -- 172.21.15.19:0/2603425465 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 1.00000000 [delete] v108'180 uv180 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f2524057030 con 0x55cfdb46a060 2024-09-12T02:04:00.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.148+0000 7f252f25bf40 1 -- 172.21.15.19:0/2603425465 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55cfdb46a060 msgr2=0x55cfdb46a470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.148+0000 7f252f25bf40 1 --2- 172.21.15.19:0/2603425465 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55cfdb46a060 0x55cfdb46a470 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.148+0000 7f252f25bf40 1 -- 172.21.15.19:0/2603425465 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f251806a840 msgr2=0x7f251806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.148+0000 7f252f25bf40 1 --2- 172.21.15.19:0/2603425465 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f251806a840 0x7f251806cd00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f251c015040 tx=0x7f251c012000 comp rx=0 tx=0).stop 2024-09-12T02:04:00.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.148+0000 7f252f25bf40 1 -- 172.21.15.19:0/2603425465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfdb513240 msgr2=0x55cfdb43a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.148+0000 7f252f25bf40 1 --2- 172.21.15.19:0/2603425465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cfdb513240 0x55cfdb43a150 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x55cfdb43f010 tx=0x7f252000c8d0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.148+0000 7f252d552640 1 -- 172.21.15.19:0/2603425465 reap_dead start 2024-09-12T02:04:00.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.148+0000 7f252f25bf40 1 -- 172.21.15.19:0/2603425465 shutdown_connections 2024-09-12T02:04:00.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.148+0000 7f252f25bf40 1 -- 172.21.15.19:0/2603425465 >> 172.21.15.19:0/2603425465 conn(0x55cfdb43a9e0 msgr2=0x55cfdb43adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:00.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.148+0000 7f252f25bf40 1 -- 172.21.15.19:0/2603425465 shutdown_connections 2024-09-12T02:04:00.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.148+0000 7f252f25bf40 1 -- 172.21.15.19:0/2603425465 wait complete. 2024-09-12T02:04:00.154 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:04:00.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.299+0000 7f2d65074640 1 Processor -- start 2024-09-12T02:04:00.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.299+0000 7f2d65074640 1 -- start start 2024-09-12T02:04:00.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.300+0000 7f2d65074640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d600d15f0 0x7f2d600cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.300+0000 7f2d65074640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2d600cf160 0x7f2d6006d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.300+0000 7f2d65074640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d600cf980 con 0x7f2d60161a20 2024-09-12T02:04:00.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.300+0000 7f2d65074640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f2d60161e00 con 0x7f2d600cf160 2024-09-12T02:04:00.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.300+0000 7f2d65074640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6006d050 con 0x7f2d600d15f0 2024-09-12T02:04:00.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.300+0000 7f2d5ed9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2d60161a20 0x7f2d600d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36450/0 (socket says 172.21.15.19:36450) 2024-09-12T02:04:00.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.300+0000 7f2d5ed9d640 1 -- 172.21.15.19:0/2411761793 learned_addr learned my addr 172.21.15.19:0/2411761793 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:00.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.300+0000 7f2d5f59e640 1 --2- 172.21.15.19:0/2411761793 >> v2:172.21.15.135:3300/0 conn(0x7f2d600cf160 0x7f2d6006d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.300+0000 7f2d5e59c640 1 --2- 172.21.15.19:0/2411761793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d600d15f0 0x7f2d600cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.300+0000 7f2d5dd9b640 1 -- 172.21.15.19:0/2411761793 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2835281923 0 0) 0x7f2d600cf980 con 0x7f2d60161a20 2024-09-12T02:04:00.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.301+0000 7f2d5dd9b640 1 -- 172.21.15.19:0/2411761793 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d48003520 con 0x7f2d60161a20 2024-09-12T02:04:00.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.301+0000 7f2d5f59e640 1 -- 172.21.15.19:0/2411761793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d600d15f0 msgr2=0x7f2d600cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:00.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.301+0000 7f2d5f59e640 1 --2- 172.21.15.19:0/2411761793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d600d15f0 0x7f2d600cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.301+0000 7f2d5f59e640 1 -- 172.21.15.19:0/2411761793 >> v1:172.21.15.19:6789/0 conn(0x7f2d60161a20 legacy=0x7f2d600d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.301+0000 7f2d5f59e640 1 -- 172.21.15.19:0/2411761793 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d600cfc20 con 0x7f2d600cf160 2024-09-12T02:04:00.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.301+0000 7f2d5f59e640 1 --2- 172.21.15.19:0/2411761793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d600cf160 0x7f2d6006d810 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009d90 tx=0x7f2d5802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7249ecce5d8ddcab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:00.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.302+0000 7f2d5dd9b640 1 -- 172.21.15.19:0/2411761793 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58007740 con 0x7f2d600cf160 2024-09-12T02:04:00.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.302+0000 7f2d5dd9b640 1 -- 172.21.15.19:0/2411761793 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d580078e0 con 0x7f2d600cf160 2024-09-12T02:04:00.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.302+0000 7f2d5dd9b640 1 -- 172.21.15.19:0/2411761793 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58007c90 con 0x7f2d600cf160 2024-09-12T02:04:00.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.302+0000 7f2d65074640 1 -- 172.21.15.19:0/2411761793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d600cf160 msgr2=0x7f2d6006d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.302+0000 7f2d65074640 1 --2- 172.21.15.19:0/2411761793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d600cf160 0x7f2d6006d810 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009d90 tx=0x7f2d5802a660 comp rx=0 tx=0).stop 2024-09-12T02:04:00.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.302+0000 7f2d65074640 1 -- 172.21.15.19:0/2411761793 shutdown_connections 2024-09-12T02:04:00.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.302+0000 7f2d65074640 1 --2- 172.21.15.19:0/2411761793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d600cf160 0x7f2d6006d810 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.302+0000 7f2d65074640 1 --2- 172.21.15.19:0/2411761793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d600d15f0 0x7f2d600cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.302+0000 7f2d65074640 1 -- 172.21.15.19:0/2411761793 >> 172.21.15.19:0/2411761793 conn(0x7f2d6009d850 msgr2=0x7f2d6008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:00.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.302+0000 7f2d65074640 1 -- 172.21.15.19:0/2411761793 shutdown_connections 2024-09-12T02:04:00.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.302+0000 7f2d65074640 1 -- 172.21.15.19:0/2411761793 wait complete. 2024-09-12T02:04:00.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.304+0000 7f2d65074640 1 Processor -- start 2024-09-12T02:04:00.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.304+0000 7f2d65074640 1 -- start start 2024-09-12T02:04:00.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.304+0000 7f2d65074640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d600cf160 0x7f2d6014fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.304+0000 7f2d65074640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d600d15f0 0x7f2d601f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.304+0000 7f2d65074640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d60161a20 0x7f2d6015a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.304+0000 7f2d65074640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2d600b1040 con 0x7f2d60161a20 2024-09-12T02:04:00.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.304+0000 7f2d65074640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6006d2f0 con 0x7f2d600cf160 2024-09-12T02:04:00.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.304+0000 7f2d65074640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2d600cf5f0 con 0x7f2d600d15f0 2024-09-12T02:04:00.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.305+0000 7f2d5f59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d60161a20 0x7f2d6015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.305+0000 7f2d5f59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d60161a20 0x7f2d6015a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50130/0 (socket says 172.21.15.19:50130) 2024-09-12T02:04:00.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.305+0000 7f2d5f59e640 1 -- 172.21.15.19:0/265867287 learned_addr learned my addr 172.21.15.19:0/265867287 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:00.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.305+0000 7f2d5e59c640 1 --2- 172.21.15.19:0/265867287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d600d15f0 0x7f2d601f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.305+0000 7f2d5ed9d640 1 --2- 172.21.15.19:0/265867287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d600cf160 0x7f2d6014fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.305+0000 7f2d5f59e640 1 -- 172.21.15.19:0/265867287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d600d15f0 msgr2=0x7f2d601f43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.305+0000 7f2d5f59e640 1 --2- 172.21.15.19:0/265867287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d600d15f0 0x7f2d601f43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.305+0000 7f2d5f59e640 1 -- 172.21.15.19:0/265867287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d600cf160 msgr2=0x7f2d6014fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.305+0000 7f2d5f59e640 1 --2- 172.21.15.19:0/265867287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d600cf160 0x7f2d6014fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.305+0000 7f2d5f59e640 1 -- 172.21.15.19:0/265867287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d601f4c80 con 0x7f2d60161a20 2024-09-12T02:04:00.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.305+0000 7f2d5f59e640 1 --2- 172.21.15.19:0/265867287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d60161a20 0x7f2d6015a420 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009eb0 tx=0x7f2d58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:00.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.305+0000 7f2d477fe640 1 -- 172.21.15.19:0/265867287 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58040070 con 0x7f2d60161a20 2024-09-12T02:04:00.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.305+0000 7f2d477fe640 1 -- 172.21.15.19:0/265867287 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d58031c60 con 0x7f2d60161a20 2024-09-12T02:04:00.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.305+0000 7f2d65074640 1 -- 172.21.15.19:0/265867287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d601f4f60 con 0x7f2d60161a20 2024-09-12T02:04:00.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.305+0000 7f2d477fe640 1 -- 172.21.15.19:0/265867287 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58009450 con 0x7f2d60161a20 2024-09-12T02:04:00.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.305+0000 7f2d65074640 1 -- 172.21.15.19:0/265867287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d601f4920 con 0x7f2d60161a20 2024-09-12T02:04:00.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.307+0000 7f2d65074640 1 -- 172.21.15.19:0/265867287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d600cec20 con 0x7f2d60161a20 2024-09-12T02:04:00.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.307+0000 7f2d477fe640 1 -- 172.21.15.19:0/265867287 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d58039040 con 0x7f2d60161a20 2024-09-12T02:04:00.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.307+0000 7f2d477fe640 1 --2- 172.21.15.19:0/265867287 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2d4c06be30 0x7f2d4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.307+0000 7f2d477fe640 1 -- 172.21.15.19:0/265867287 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 7421+0+0 (secure 0 0 0) 0x7f2d580ac870 con 0x7f2d60161a20 2024-09-12T02:04:00.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.307+0000 7f2d5ed9d640 1 --2- 172.21.15.19:0/265867287 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2d4c06be30 0x7f2d4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.308+0000 7f2d5ed9d640 1 --2- 172.21.15.19:0/265867287 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2d4c06be30 0x7f2d4c06e2f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2d50005880 tx=0x7f2d50009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:00.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.311+0000 7f2d477fe640 1 -- 172.21.15.19:0/265867287 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2d5807a520 con 0x7f2d60161a20 2024-09-12T02:04:00.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.527+0000 7f2d65074640 1 -- 172.21.15.19:0/265867287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f2d6006e8c0 con 0x7f2d60161a20 2024-09-12T02:04:00.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.850+0000 7f2d477fe640 1 -- 172.21.15.19:0/265867287 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v161) ==== 162+0+0 (secure 0 0 0) 0x7f2d5807e820 con 0x7f2d60161a20 2024-09-12T02:04:00.851 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:04:00.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.852+0000 7f2d65074640 1 -- 172.21.15.19:0/265867287 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2d4c06be30 msgr2=0x7f2d4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.852+0000 7f2d65074640 1 --2- 172.21.15.19:0/265867287 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2d4c06be30 0x7f2d4c06e2f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2d50005880 tx=0x7f2d50009040 comp rx=0 tx=0).stop 2024-09-12T02:04:00.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.852+0000 7f2d65074640 1 -- 172.21.15.19:0/265867287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d60161a20 msgr2=0x7f2d6015a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.852+0000 7f2d65074640 1 --2- 172.21.15.19:0/265867287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d60161a20 0x7f2d6015a420 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009eb0 tx=0x7f2d58004a40 comp rx=0 tx=0).stop 2024-09-12T02:04:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.853+0000 7f2d65074640 1 -- 172.21.15.19:0/265867287 shutdown_connections 2024-09-12T02:04:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.853+0000 7f2d65074640 1 --2- 172.21.15.19:0/265867287 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2d4c06be30 0x7f2d4c06e2f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.853+0000 7f2d65074640 1 --2- 172.21.15.19:0/265867287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d60161a20 0x7f2d6015a420 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.853+0000 7f2d65074640 1 --2- 172.21.15.19:0/265867287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d600d15f0 0x7f2d601f43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.853+0000 7f2d65074640 1 --2- 172.21.15.19:0/265867287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d600cf160 0x7f2d6014fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.853+0000 7f2d65074640 1 -- 172.21.15.19:0/265867287 >> 172.21.15.19:0/265867287 conn(0x7f2d6009d850 msgr2=0x7f2d6015e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.853+0000 7f2d65074640 1 -- 172.21.15.19:0/265867287 shutdown_connections 2024-09-12T02:04:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.853+0000 7f2d65074640 1 -- 172.21.15.19:0/265867287 wait complete. 2024-09-12T02:04:00.865 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:00.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.967+0000 7fd813528640 1 Processor -- start 2024-09-12T02:04:00.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.967+0000 7fd813528640 1 -- start start 2024-09-12T02:04:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.968+0000 7fd813528640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd80c072de0 0x7fd80c15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.968+0000 7fd813528640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd80c072700 0x7fd80c15d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.968+0000 7fd813528640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd80c146140 con 0x7fd80c072320 2024-09-12T02:04:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.968+0000 7fd813528640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd80c0cd740 con 0x7fd80c072700 2024-09-12T02:04:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.968+0000 7fd813528640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd80c0cda20 con 0x7fd80c072de0 2024-09-12T02:04:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.968+0000 7fd811ac5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd80c072700 0x7fd80c15d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.968+0000 7fd811ac5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd80c072700 0x7fd80c15d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50144/0 (socket says 172.21.15.19:50144) 2024-09-12T02:04:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.968+0000 7fd811ac5640 1 -- 172.21.15.19:0/3108349810 learned_addr learned my addr 172.21.15.19:0/3108349810 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.969+0000 7fd810ac3640 1 --2- 172.21.15.19:0/3108349810 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd80c072de0 0x7fd80c15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.969+0000 7fd811ac5640 1 -- 172.21.15.19:0/3108349810 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd80c072de0 msgr2=0x7fd80c15d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.969+0000 7fd811ac5640 1 --2- 172.21.15.19:0/3108349810 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd80c072de0 0x7fd80c15d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.969+0000 7fd811ac5640 1 -- 172.21.15.19:0/3108349810 >> v1:172.21.15.135:6789/0 conn(0x7fd80c072320 legacy=0x7fd80c0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.969+0000 7fd811ac5640 1 -- 172.21.15.19:0/3108349810 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd80c0cdd00 con 0x7fd80c072700 2024-09-12T02:04:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.969+0000 7fd811ac5640 1 --2- 172.21.15.19:0/3108349810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd80c072700 0x7fd80c15d720 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009e50 tx=0x7fd7fc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1309beb180093c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.970+0000 7fd80bfff640 1 -- 172.21.15.19:0/3108349810 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc036070 con 0x7fd80c072700 2024-09-12T02:04:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.970+0000 7fd80bfff640 1 -- 172.21.15.19:0/3108349810 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7fc031600 con 0x7fd80c072700 2024-09-12T02:04:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.970+0000 7fd80bfff640 1 -- 172.21.15.19:0/3108349810 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0319d0 con 0x7fd80c072700 2024-09-12T02:04:00.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.970+0000 7fd813528640 1 -- 172.21.15.19:0/3108349810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd80c072700 msgr2=0x7fd80c15d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.970+0000 7fd813528640 1 --2- 172.21.15.19:0/3108349810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd80c072700 0x7fd80c15d720 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009e50 tx=0x7fd7fc02a680 comp rx=0 tx=0).stop 2024-09-12T02:04:00.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.970+0000 7fd813528640 1 -- 172.21.15.19:0/3108349810 shutdown_connections 2024-09-12T02:04:00.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.970+0000 7fd813528640 1 --2- 172.21.15.19:0/3108349810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd80c072700 0x7fd80c15d720 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.970+0000 7fd813528640 1 --2- 172.21.15.19:0/3108349810 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd80c072de0 0x7fd80c15d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.970+0000 7fd813528640 1 -- 172.21.15.19:0/3108349810 >> 172.21.15.19:0/3108349810 conn(0x7fd80c067d70 msgr2=0x7fd80c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.970+0000 7fd813528640 1 -- 172.21.15.19:0/3108349810 shutdown_connections 2024-09-12T02:04:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.970+0000 7fd813528640 1 -- 172.21.15.19:0/3108349810 wait complete. 2024-09-12T02:04:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.971+0000 7fd813528640 1 Processor -- start 2024-09-12T02:04:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.972+0000 7fd813528640 1 -- start start 2024-09-12T02:04:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.972+0000 7fd813528640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd80c072320 0x7fd80c15bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.972+0000 7fd813528640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd80c072700 0x7fd80c144c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.972+0000 7fd813528640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80c072de0 0x7fd80c145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.972+0000 7fd813528640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c15dde0 con 0x7fd80c072320 2024-09-12T02:04:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.972+0000 7fd813528640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c15dc60 con 0x7fd80c072de0 2024-09-12T02:04:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.972+0000 7fd813528640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd80c15df60 con 0x7fd80c072700 2024-09-12T02:04:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.972+0000 7fd8112c4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd80c072320 0x7fd80c15bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.972+0000 7fd8112c4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd80c072320 0x7fd80c15bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50146/0 (socket says 172.21.15.19:50146) 2024-09-12T02:04:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.972+0000 7fd8112c4640 1 -- 172.21.15.19:0/3034618495 learned_addr learned my addr 172.21.15.19:0/3034618495 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.973+0000 7fd811ac5640 1 --2- 172.21.15.19:0/3034618495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80c072de0 0x7fd80c145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.973+0000 7fd810ac3640 1 --2- 172.21.15.19:0/3034618495 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd80c072700 0x7fd80c144c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.973+0000 7fd8112c4640 1 -- 172.21.15.19:0/3034618495 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd80c072700 msgr2=0x7fd80c144c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.973+0000 7fd8112c4640 1 --2- 172.21.15.19:0/3034618495 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd80c072700 0x7fd80c144c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.973+0000 7fd8112c4640 1 -- 172.21.15.19:0/3034618495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80c072de0 msgr2=0x7fd80c145140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.973+0000 7fd8112c4640 1 --2- 172.21.15.19:0/3034618495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80c072de0 0x7fd80c145140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.973+0000 7fd8112c4640 1 -- 172.21.15.19:0/3034618495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd80c1e4150 con 0x7fd80c072320 2024-09-12T02:04:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.973+0000 7fd811ac5640 1 --2- 172.21.15.19:0/3034618495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80c072de0 0x7fd80c145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.973+0000 7fd8112c4640 1 --2- 172.21.15.19:0/3034618495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd80c072320 0x7fd80c15bd50 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd80400c400 tx=0x7fd80400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.973+0000 7fd809ffb640 1 -- 172.21.15.19:0/3034618495 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8040052d0 con 0x7fd80c072320 2024-09-12T02:04:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.973+0000 7fd809ffb640 1 -- 172.21.15.19:0/3034618495 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd804005490 con 0x7fd80c072320 2024-09-12T02:04:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.973+0000 7fd813528640 1 -- 172.21.15.19:0/3034618495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd80c1e48e0 con 0x7fd80c072320 2024-09-12T02:04:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.973+0000 7fd809ffb640 1 -- 172.21.15.19:0/3034618495 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd804007260 con 0x7fd80c072320 2024-09-12T02:04:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.973+0000 7fd813528640 1 -- 172.21.15.19:0/3034618495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd80c15c290 con 0x7fd80c072320 2024-09-12T02:04:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.974+0000 7fd813528640 1 -- 172.21.15.19:0/3034618495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd80c0c5f90 con 0x7fd80c072320 2024-09-12T02:04:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.975+0000 7fd809ffb640 1 -- 172.21.15.19:0/3034618495 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd804007400 con 0x7fd80c072320 2024-09-12T02:04:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.975+0000 7fd809ffb640 1 --2- 172.21.15.19:0/3034618495 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd7f806be30 0x7fd7f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.975+0000 7fd809ffb640 1 -- 172.21.15.19:0/3034618495 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 7421+0+0 (secure 0 0 0) 0x7fd80408a9c0 con 0x7fd80c072320 2024-09-12T02:04:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.975+0000 7fd810ac3640 1 --2- 172.21.15.19:0/3034618495 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd7f806be30 0x7fd7f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.976+0000 7fd810ac3640 1 --2- 172.21.15.19:0/3034618495 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd7f806be30 0x7fd7f806e2f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0cb360 tx=0x7fd800008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:00.979+0000 7fd809ffb640 1 -- 172.21.15.19:0/3034618495 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd80c0c5f90 con 0x7fd80c072320 2024-09-12T02:04:01.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:01.191+0000 7fd813528640 1 -- 172.21.15.19:0/3034618495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd80c0c6210 con 0x7fd80c072320 2024-09-12T02:04:01.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:01.192+0000 7fd809ffb640 1 -- 172.21.15.19:0/3034618495 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 162 v162) ==== 95+0+4401 (secure 0 0 0) 0x7fd80408ce20 con 0x7fd80c072320 2024-09-12T02:04:01.192 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:01.192 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":162,"btime":"2024-09-12T02:04:00:853908+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":162,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:00.853894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7612},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7612":{"gid":7612,"name":"d","rank":0,"incarnation":162,"state":"up:replay","state_seq":1,"addr":"172.21.15.135:6837/4107165769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4107165769},{"type":"v1","addr":"172.21.15.135:6837","nonce":4107165769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:01.193 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 162 2024-09-12T02:04:01.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:01.194+0000 7fd813528640 1 -- 172.21.15.19:0/3034618495 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd7f806be30 msgr2=0x7fd7f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:01.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:01.194+0000 7fd813528640 1 --2- 172.21.15.19:0/3034618495 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd7f806be30 0x7fd7f806e2f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0cb360 tx=0x7fd800008040 comp rx=0 tx=0).stop 2024-09-12T02:04:01.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:01.194+0000 7fd813528640 1 -- 172.21.15.19:0/3034618495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd80c072320 msgr2=0x7fd80c15bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:01.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:01.194+0000 7fd813528640 1 --2- 172.21.15.19:0/3034618495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd80c072320 0x7fd80c15bd50 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd80400c400 tx=0x7fd80400c8c0 comp rx=0 tx=0).stop 2024-09-12T02:04:01.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:01.194+0000 7fd813528640 1 -- 172.21.15.19:0/3034618495 shutdown_connections 2024-09-12T02:04:01.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:01.194+0000 7fd813528640 1 --2- 172.21.15.19:0/3034618495 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd7f806be30 0x7fd7f806e2f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:01.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:01.194+0000 7fd813528640 1 --2- 172.21.15.19:0/3034618495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80c072de0 0x7fd80c145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:01.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:01.194+0000 7fd813528640 1 --2- 172.21.15.19:0/3034618495 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd80c072700 0x7fd80c144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:01.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:01.194+0000 7fd813528640 1 --2- 172.21.15.19:0/3034618495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd80c072320 0x7fd80c15bd50 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:01.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:01.194+0000 7fd813528640 1 -- 172.21.15.19:0/3034618495 >> 172.21.15.19:0/3034618495 conn(0x7fd80c067d70 msgr2=0x7fd80c0ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:01.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:01.194+0000 7fd813528640 1 -- 172.21.15.19:0/3034618495 shutdown_connections 2024-09-12T02:04:01.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:01.194+0000 7fd813528640 1 -- 172.21.15.19:0/3034618495 wait complete. 2024-09-12T02:04:01.205 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-12T02:04:01.487 INFO:tasks.ceph.mds.c.smithi019.stderr: -43> 2024-09-12T02:03:56.735+0000 7f4f11ccc640 -1 mds.0.cache.ino(0x100) No data while reading inode 0x100 2024-09-12T02:04:01.487 INFO:tasks.ceph.mds.c.smithi019.stderr: -33> 2024-09-12T02:03:56.735+0000 7f4f11ccc640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2024-09-12T02:04:01.512 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:04:03.867 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:04:03.866+0000 7fdf51243640 -1 log_channel(cluster) log [ERR] : dir 0x1 object missing on disk; some files may be lost () 2024-09-12T02:04:03.867 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:04:03.866+0000 7fdf51243640 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x1 is fatal because it is a system directory for this rank 2024-09-12T02:04:03.868 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:03.868+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:04:03.868 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:03.868+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:04:05.566 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:04:05.565+0000 7fdf5524b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:04:06.207 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:06.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.323+0000 7fef36d11640 1 Processor -- start 2024-09-12T02:04:06.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.323+0000 7fef36d11640 1 -- start start 2024-09-12T02:04:06.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.324+0000 7fef36d11640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fef30162060 0x7fef300b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:06.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.324+0000 7fef36d11640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef300b64b0 0x7fef300b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:06.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.324+0000 7fef36d11640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef3006d9f0 con 0x7fef30161c80 2024-09-12T02:04:06.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.324+0000 7fef36d11640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fef3006dcd0 con 0x7fef300b64b0 2024-09-12T02:04:06.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.324+0000 7fef36d11640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fef3006dfb0 con 0x7fef30162060 2024-09-12T02:04:06.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.324+0000 7fef352ae640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef300b64b0 0x7fef300b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:06.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.324+0000 7fef34aad640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fef30161c80 0x7fef3006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55922/0 (socket says 172.21.15.19:55922) 2024-09-12T02:04:06.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.324+0000 7fef34aad640 1 -- 172.21.15.19:0/3832144298 learned_addr learned my addr 172.21.15.19:0/3832144298 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:06.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.324+0000 7fef2ffff640 1 --2- 172.21.15.19:0/3832144298 >> v2:172.21.15.135:3300/0 conn(0x7fef30162060 0x7fef300b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:06.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.324+0000 7fef352ae640 1 -- 172.21.15.19:0/3832144298 >> v2:172.21.15.135:3300/0 conn(0x7fef30162060 msgr2=0x7fef300b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:06.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.324+0000 7fef352ae640 1 --2- 172.21.15.19:0/3832144298 >> v2:172.21.15.135:3300/0 conn(0x7fef30162060 0x7fef300b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.324+0000 7fef352ae640 1 -- 172.21.15.19:0/3832144298 >> v1:172.21.15.19:6789/0 conn(0x7fef30161c80 legacy=0x7fef3006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:06.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.324+0000 7fef352ae640 1 -- 172.21.15.19:0/3832144298 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef300d01f0 con 0x7fef300b64b0 2024-09-12T02:04:06.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.324+0000 7fef2ffff640 1 --2- 172.21.15.19:0/3832144298 >> v2:172.21.15.135:3300/0 conn(0x7fef30162060 0x7fef300b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:06.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.325+0000 7fef352ae640 1 --2- 172.21.15.19:0/3832144298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef300b64b0 0x7fef300b6960 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fef3008e830 tx=0x7fef2802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38cd70188bbfae25 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:06.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.325+0000 7fef2f7fe640 1 -- 172.21.15.19:0/3832144298 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28007740 con 0x7fef300b64b0 2024-09-12T02:04:06.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.325+0000 7fef2f7fe640 1 -- 172.21.15.19:0/3832144298 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef280078e0 con 0x7fef300b64b0 2024-09-12T02:04:06.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.325+0000 7fef2f7fe640 1 -- 172.21.15.19:0/3832144298 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28007cb0 con 0x7fef300b64b0 2024-09-12T02:04:06.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.326+0000 7fef36d11640 1 -- 172.21.15.19:0/3832144298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef300b64b0 msgr2=0x7fef300b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:06.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.326+0000 7fef36d11640 1 --2- 172.21.15.19:0/3832144298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef300b64b0 0x7fef300b6960 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fef3008e830 tx=0x7fef2802a680 comp rx=0 tx=0).stop 2024-09-12T02:04:06.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.326+0000 7fef36d11640 1 -- 172.21.15.19:0/3832144298 shutdown_connections 2024-09-12T02:04:06.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.326+0000 7fef36d11640 1 --2- 172.21.15.19:0/3832144298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef300b64b0 0x7fef300b6960 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.326+0000 7fef36d11640 1 --2- 172.21.15.19:0/3832144298 >> v2:172.21.15.135:3300/0 conn(0x7fef30162060 0x7fef300b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.326+0000 7fef36d11640 1 -- 172.21.15.19:0/3832144298 >> 172.21.15.19:0/3832144298 conn(0x7fef300d44f0 msgr2=0x7fef300d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:06.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.326+0000 7fef36d11640 1 -- 172.21.15.19:0/3832144298 shutdown_connections 2024-09-12T02:04:06.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.326+0000 7fef36d11640 1 -- 172.21.15.19:0/3832144298 wait complete. 2024-09-12T02:04:06.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.327+0000 7fef36d11640 1 Processor -- start 2024-09-12T02:04:06.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.327+0000 7fef36d11640 1 -- start start 2024-09-12T02:04:06.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.328+0000 7fef36d11640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef300b64b0 0x7fef301fc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:06.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.328+0000 7fef36d11640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef30161c80 0x7fef300b9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:06.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.328+0000 7fef36d11640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef30162060 0x7fef30159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:06.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.328+0000 7fef36d11640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fef300cf1e0 con 0x7fef300b64b0 2024-09-12T02:04:06.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.328+0000 7fef36d11640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fef300d2aa0 con 0x7fef30161c80 2024-09-12T02:04:06.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.328+0000 7fef36d11640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fef300cf360 con 0x7fef30162060 2024-09-12T02:04:06.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.328+0000 7fef34aad640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef300b64b0 0x7fef301fc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:06.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.328+0000 7fef34aad640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef300b64b0 0x7fef301fc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45542/0 (socket says 172.21.15.19:45542) 2024-09-12T02:04:06.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.328+0000 7fef34aad640 1 -- 172.21.15.19:0/1452753110 learned_addr learned my addr 172.21.15.19:0/1452753110 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:06.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.329+0000 7fef352ae640 1 --2- 172.21.15.19:0/1452753110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef30162060 0x7fef30159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:06.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.329+0000 7fef2ffff640 1 --2- 172.21.15.19:0/1452753110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef30161c80 0x7fef300b9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:06.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.329+0000 7fef34aad640 1 -- 172.21.15.19:0/1452753110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef30162060 msgr2=0x7fef30159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:06.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.329+0000 7fef34aad640 1 --2- 172.21.15.19:0/1452753110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef30162060 0x7fef30159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.329+0000 7fef34aad640 1 -- 172.21.15.19:0/1452753110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef30161c80 msgr2=0x7fef300b9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:06.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.329+0000 7fef34aad640 1 --2- 172.21.15.19:0/1452753110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef30161c80 0x7fef300b9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.329+0000 7fef34aad640 1 -- 172.21.15.19:0/1452753110 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef300b73e0 con 0x7fef300b64b0 2024-09-12T02:04:06.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.329+0000 7fef34aad640 1 --2- 172.21.15.19:0/1452753110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef300b64b0 0x7fef301fc8e0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fef2400c430 tx=0x7fef2400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:06.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.329+0000 7fef2d7fa640 1 -- 172.21.15.19:0/1452753110 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef24017070 con 0x7fef300b64b0 2024-09-12T02:04:06.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.329+0000 7fef2d7fa640 1 -- 172.21.15.19:0/1452753110 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef24005ce0 con 0x7fef300b64b0 2024-09-12T02:04:06.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.329+0000 7fef36d11640 1 -- 172.21.15.19:0/1452753110 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef300b7680 con 0x7fef300b64b0 2024-09-12T02:04:06.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.329+0000 7fef2d7fa640 1 -- 172.21.15.19:0/1452753110 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef240072f0 con 0x7fef300b64b0 2024-09-12T02:04:06.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.329+0000 7fef36d11640 1 -- 172.21.15.19:0/1452753110 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef301fc0e0 con 0x7fef300b64b0 2024-09-12T02:04:06.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.330+0000 7fef36d11640 1 -- 172.21.15.19:0/1452753110 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef300b5f70 con 0x7fef300b64b0 2024-09-12T02:04:06.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.331+0000 7fef2d7fa640 1 -- 172.21.15.19:0/1452753110 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef2401a070 con 0x7fef300b64b0 2024-09-12T02:04:06.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.331+0000 7fef2d7fa640 1 --2- 172.21.15.19:0/1452753110 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef1406be60 0x7fef1406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:06.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.331+0000 7fef2d7fa640 1 -- 172.21.15.19:0/1452753110 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 7507+0+0 (secure 0 0 0) 0x7fef2408a970 con 0x7fef300b64b0 2024-09-12T02:04:06.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.332+0000 7fef2ffff640 1 --2- 172.21.15.19:0/1452753110 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef1406be60 0x7fef1406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:06.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.332+0000 7fef2ffff640 1 --2- 172.21.15.19:0/1452753110 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef1406be60 0x7fef1406e320 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fef300d0590 tx=0x7fef1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:06.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.336+0000 7fef2d7fa640 1 -- 172.21.15.19:0/1452753110 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fef24058c10 con 0x7fef300b64b0 2024-09-12T02:04:06.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.544+0000 7fef36d11640 1 -- 172.21.15.19:0/1452753110 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef300ba470 con 0x7fef300b64b0 2024-09-12T02:04:06.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.545+0000 7fef2d7fa640 1 -- 172.21.15.19:0/1452753110 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 166 v166) ==== 95+0+4389 (secure 0 0 0) 0x7fef24058510 con 0x7fef300b64b0 2024-09-12T02:04:06.546 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:06.546 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":166,"btime":"2024-09-12T02:04:03:869446+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8565,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3985859189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3985859189},{"type":"v1","addr":"172.21.15.19:6834","nonce":3985859189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163}],"filesystems":[{"mdsmap":{"epoch":166,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:03.869442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:06.546 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 166 2024-09-12T02:04:06.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.547+0000 7fef36d11640 1 -- 172.21.15.19:0/1452753110 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef1406be60 msgr2=0x7fef1406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:06.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.547+0000 7fef36d11640 1 --2- 172.21.15.19:0/1452753110 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef1406be60 0x7fef1406e320 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fef300d0590 tx=0x7fef1c008040 comp rx=0 tx=0).stop 2024-09-12T02:04:06.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.547+0000 7fef36d11640 1 -- 172.21.15.19:0/1452753110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef300b64b0 msgr2=0x7fef301fc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:06.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.547+0000 7fef36d11640 1 --2- 172.21.15.19:0/1452753110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef300b64b0 0x7fef301fc8e0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fef2400c430 tx=0x7fef2400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.547+0000 7fef36d11640 1 -- 172.21.15.19:0/1452753110 shutdown_connections 2024-09-12T02:04:06.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.547+0000 7fef36d11640 1 --2- 172.21.15.19:0/1452753110 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef1406be60 0x7fef1406e320 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.547+0000 7fef36d11640 1 --2- 172.21.15.19:0/1452753110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef30162060 0x7fef30159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.547+0000 7fef36d11640 1 --2- 172.21.15.19:0/1452753110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef30161c80 0x7fef300b9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.547+0000 7fef36d11640 1 --2- 172.21.15.19:0/1452753110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef300b64b0 0x7fef301fc8e0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.547+0000 7fef36d11640 1 -- 172.21.15.19:0/1452753110 >> 172.21.15.19:0/1452753110 conn(0x7fef300d44f0 msgr2=0x7fef300b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:06.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.547+0000 7fef36d11640 1 -- 172.21.15.19:0/1452753110 shutdown_connections 2024-09-12T02:04:06.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.547+0000 7fef36d11640 1 -- 172.21.15.19:0/1452753110 wait complete. 2024-09-12T02:04:06.559 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:04:06.559 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:06.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.661+0000 7fa1c8453640 1 Processor -- start 2024-09-12T02:04:06.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.661+0000 7fa1c8453640 1 -- start start 2024-09-12T02:04:06.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.662+0000 7fa1c8453640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1c015e5f0 0x7fa1c00d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:06.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.662+0000 7fa1c8453640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa1c00d30f0 0x7fa1c00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:06.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.662+0000 7fa1c8453640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1c00d3690 con 0x7fa1c00b64c0 2024-09-12T02:04:06.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.662+0000 7fa1c8453640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa1c006d530 con 0x7fa1c00d30f0 2024-09-12T02:04:06.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.662+0000 7fa1c8453640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa1c00d3970 con 0x7fa1c015e5f0 2024-09-12T02:04:06.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.662+0000 7fa1c59ee640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa1c00d30f0 0x7fa1c00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:06.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.662+0000 7fa1c61ef640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1c015e5f0 0x7fa1c00d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:06.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.662+0000 7fa1c69f0640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fa1c00b64c0 0x7fa1c00cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:37854/0 (socket says 172.21.15.19:37854) 2024-09-12T02:04:06.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.662+0000 7fa1c69f0640 1 -- 172.21.15.19:0/3005074852 learned_addr learned my addr 172.21.15.19:0/3005074852 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:06.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.662+0000 7fa1c51ed640 1 -- 172.21.15.19:0/3005074852 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 903981589 0 0) 0x7fa1c00d3690 con 0x7fa1c00b64c0 2024-09-12T02:04:06.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.663+0000 7fa1c51ed640 1 -- 172.21.15.19:0/3005074852 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1ac003520 con 0x7fa1c00b64c0 2024-09-12T02:04:06.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.663+0000 7fa1c61ef640 1 -- 172.21.15.19:0/3005074852 >> v2:172.21.15.135:3300/0 conn(0x7fa1c00d30f0 msgr2=0x7fa1c00b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:06.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.663+0000 7fa1c61ef640 1 --2- 172.21.15.19:0/3005074852 >> v2:172.21.15.135:3300/0 conn(0x7fa1c00d30f0 0x7fa1c00b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.663+0000 7fa1c61ef640 1 -- 172.21.15.19:0/3005074852 >> v1:172.21.15.135:6789/0 conn(0x7fa1c00b64c0 legacy=0x7fa1c00cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:06.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.663+0000 7fa1c61ef640 1 -- 172.21.15.19:0/3005074852 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c006cee0 con 0x7fa1c015e5f0 2024-09-12T02:04:06.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.663+0000 7fa1c59ee640 1 --2- 172.21.15.19:0/3005074852 >> v2:172.21.15.135:3300/0 conn(0x7fa1c00d30f0 0x7fa1c00b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:06.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.663+0000 7fa1c61ef640 1 --2- 172.21.15.19:0/3005074852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1c015e5f0 0x7fa1c00d4dd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc0097a0 tx=0x7fa1bc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3e83a63d704d2a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:06.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.664+0000 7fa1c51ed640 1 -- 172.21.15.19:0/3005074852 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc037070 con 0x7fa1c015e5f0 2024-09-12T02:04:06.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.664+0000 7fa1c51ed640 1 -- 172.21.15.19:0/3005074852 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1bc032440 con 0x7fa1c015e5f0 2024-09-12T02:04:06.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.664+0000 7fa1c51ed640 1 -- 172.21.15.19:0/3005074852 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc0327f0 con 0x7fa1c015e5f0 2024-09-12T02:04:06.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.664+0000 7fa1c8453640 1 -- 172.21.15.19:0/3005074852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1c015e5f0 msgr2=0x7fa1c00d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:06.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.664+0000 7fa1c8453640 1 --2- 172.21.15.19:0/3005074852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1c015e5f0 0x7fa1c00d4dd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc0097a0 tx=0x7fa1bc02a180 comp rx=0 tx=0).stop 2024-09-12T02:04:06.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.664+0000 7fa1c8453640 1 -- 172.21.15.19:0/3005074852 shutdown_connections 2024-09-12T02:04:06.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.664+0000 7fa1c8453640 1 --2- 172.21.15.19:0/3005074852 >> v2:172.21.15.135:3300/0 conn(0x7fa1c00d30f0 0x7fa1c00b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.664+0000 7fa1c8453640 1 --2- 172.21.15.19:0/3005074852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1c015e5f0 0x7fa1c00d4dd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.664+0000 7fa1c8453640 1 -- 172.21.15.19:0/3005074852 >> 172.21.15.19:0/3005074852 conn(0x7fa1c008bfc0 msgr2=0x7fa1c00d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:06.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.664+0000 7fa1c8453640 1 -- 172.21.15.19:0/3005074852 shutdown_connections 2024-09-12T02:04:06.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.664+0000 7fa1c8453640 1 -- 172.21.15.19:0/3005074852 wait complete. 2024-09-12T02:04:06.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.665+0000 7fa1c8453640 1 Processor -- start 2024-09-12T02:04:06.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.665+0000 7fa1c8453640 1 -- start start 2024-09-12T02:04:06.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.666+0000 7fa1c8453640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c00b64c0 0x7fa1c0153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:06.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.666+0000 7fa1c8453640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1c00d30f0 0x7fa1c00b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:06.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.666+0000 7fa1c8453640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1c015e5f0 0x7fa1c00b92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:06.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.666+0000 7fa1c8453640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c00d5310 con 0x7fa1c00d30f0 2024-09-12T02:04:06.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.666+0000 7fa1c8453640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c015e9d0 con 0x7fa1c00b64c0 2024-09-12T02:04:06.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.666+0000 7fa1c8453640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa1c006e9d0 con 0x7fa1c015e5f0 2024-09-12T02:04:06.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.666+0000 7fa1c59ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1c00d30f0 0x7fa1c00b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:06.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.666+0000 7fa1c59ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1c00d30f0 0x7fa1c00b8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45554/0 (socket says 172.21.15.19:45554) 2024-09-12T02:04:06.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.666+0000 7fa1c59ee640 1 -- 172.21.15.19:0/3842172324 learned_addr learned my addr 172.21.15.19:0/3842172324 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:06.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.666+0000 7fa1c61ef640 1 --2- 172.21.15.19:0/3842172324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c00b64c0 0x7fa1c0153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:06.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.666+0000 7fa1c69f0640 1 --2- 172.21.15.19:0/3842172324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1c015e5f0 0x7fa1c00b92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:06.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.667+0000 7fa1c59ee640 1 -- 172.21.15.19:0/3842172324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1c015e5f0 msgr2=0x7fa1c00b92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:06.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.667+0000 7fa1c59ee640 1 --2- 172.21.15.19:0/3842172324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1c015e5f0 0x7fa1c00b92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.667+0000 7fa1c59ee640 1 -- 172.21.15.19:0/3842172324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c00b64c0 msgr2=0x7fa1c0153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:06.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.667+0000 7fa1c59ee640 1 --2- 172.21.15.19:0/3842172324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c00b64c0 0x7fa1c0153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.667+0000 7fa1c59ee640 1 -- 172.21.15.19:0/3842172324 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c00b7680 con 0x7fa1c00d30f0 2024-09-12T02:04:06.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.667+0000 7fa1c59ee640 1 --2- 172.21.15.19:0/3842172324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1c00d30f0 0x7fa1c00b8d90 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000ebb0 tx=0x7fa1b000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:06.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.667+0000 7fa1b6ffd640 1 -- 172.21.15.19:0/3842172324 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0017070 con 0x7fa1c00d30f0 2024-09-12T02:04:06.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.667+0000 7fa1b6ffd640 1 -- 172.21.15.19:0/3842172324 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b000cc30 con 0x7fa1c00d30f0 2024-09-12T02:04:06.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.667+0000 7fa1c8453640 1 -- 172.21.15.19:0/3842172324 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c0153dd0 con 0x7fa1c00d30f0 2024-09-12T02:04:06.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.667+0000 7fa1b6ffd640 1 -- 172.21.15.19:0/3842172324 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0013470 con 0x7fa1c00d30f0 2024-09-12T02:04:06.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.667+0000 7fa1c8453640 1 -- 172.21.15.19:0/3842172324 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c015fa10 con 0x7fa1c00d30f0 2024-09-12T02:04:06.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.668+0000 7fa1c8453640 1 -- 172.21.15.19:0/3842172324 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1c00b5f80 con 0x7fa1c00d30f0 2024-09-12T02:04:06.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.668+0000 7fa1b6ffd640 1 -- 172.21.15.19:0/3842172324 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1b001a070 con 0x7fa1c00d30f0 2024-09-12T02:04:06.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.669+0000 7fa1b6ffd640 1 --2- 172.21.15.19:0/3842172324 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa1a406be30 0x7fa1a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:06.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.669+0000 7fa1b6ffd640 1 -- 172.21.15.19:0/3842172324 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 7507+0+0 (secure 0 0 0) 0x7fa1b008b480 con 0x7fa1c00d30f0 2024-09-12T02:04:06.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.669+0000 7fa1c61ef640 1 --2- 172.21.15.19:0/3842172324 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa1a406be30 0x7fa1a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:06.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.670+0000 7fa1c61ef640 1 --2- 172.21.15.19:0/3842172324 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa1a406be30 0x7fa1a406e2f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc034000 tx=0x7fa1bc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:06.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.673+0000 7fa1b6ffd640 1 -- 172.21.15.19:0/3842172324 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1c00b7680 con 0x7fa1c00d30f0 2024-09-12T02:04:06.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.884+0000 7fa1c8453640 1 -- 172.21.15.19:0/3842172324 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1c0160340 con 0x7fa1c00d30f0 2024-09-12T02:04:06.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.885+0000 7fa1b6ffd640 1 -- 172.21.15.19:0/3842172324 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 166 v166) ==== 95+0+4389 (secure 0 0 0) 0x7fa1b0059040 con 0x7fa1c00d30f0 2024-09-12T02:04:06.885 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:06.885 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":166,"btime":"2024-09-12T02:04:03:869446+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8565,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3985859189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3985859189},{"type":"v1","addr":"172.21.15.19:6834","nonce":3985859189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163}],"filesystems":[{"mdsmap":{"epoch":166,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:03.869442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:06.886 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 166 2024-09-12T02:04:06.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.887+0000 7fa1c8453640 1 -- 172.21.15.19:0/3842172324 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa1a406be30 msgr2=0x7fa1a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:06.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.887+0000 7fa1c8453640 1 --2- 172.21.15.19:0/3842172324 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa1a406be30 0x7fa1a406e2f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc034000 tx=0x7fa1bc02e000 comp rx=0 tx=0).stop 2024-09-12T02:04:06.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.887+0000 7fa1c8453640 1 -- 172.21.15.19:0/3842172324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1c00d30f0 msgr2=0x7fa1c00b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:06.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.887+0000 7fa1c8453640 1 --2- 172.21.15.19:0/3842172324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1c00d30f0 0x7fa1c00b8d90 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000ebb0 tx=0x7fa1b000c520 comp rx=0 tx=0).stop 2024-09-12T02:04:06.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.887+0000 7fa1c8453640 1 -- 172.21.15.19:0/3842172324 shutdown_connections 2024-09-12T02:04:06.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.887+0000 7fa1c8453640 1 --2- 172.21.15.19:0/3842172324 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa1a406be30 0x7fa1a406e2f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.887+0000 7fa1c8453640 1 --2- 172.21.15.19:0/3842172324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1c015e5f0 0x7fa1c00b92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.887+0000 7fa1c8453640 1 --2- 172.21.15.19:0/3842172324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1c00d30f0 0x7fa1c00b8d90 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.887+0000 7fa1c8453640 1 --2- 172.21.15.19:0/3842172324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c00b64c0 0x7fa1c0153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.887+0000 7fa1c8453640 1 -- 172.21.15.19:0/3842172324 >> 172.21.15.19:0/3842172324 conn(0x7fa1c008bfc0 msgr2=0x7fa1c00b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:06.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.887+0000 7fa1c8453640 1 -- 172.21.15.19:0/3842172324 shutdown_connections 2024-09-12T02:04:06.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:06.887+0000 7fa1c8453640 1 -- 172.21.15.19:0/3842172324 wait complete. 2024-09-12T02:04:06.898 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:06.898 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:07.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.000+0000 7fa005677640 1 Processor -- start 2024-09-12T02:04:07.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.000+0000 7fa005677640 1 -- start start 2024-09-12T02:04:07.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.001+0000 7fa005677640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa00015b300 0x7fa0000cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:07.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.001+0000 7fa005677640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa0000cd3f0 0x7fa00006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:07.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.001+0000 7fa005677640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa000072d30 0x7fa00006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:07.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.001+0000 7fa005677640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa0000728a0 con 0x7fa00015b300 2024-09-12T02:04:07.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.001+0000 7fa005677640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa0000cdbe0 con 0x7fa0000cd3f0 2024-09-12T02:04:07.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.001+0000 7fa005677640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa0000cd900 con 0x7fa000072d30 2024-09-12T02:04:07.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.001+0000 7f9ffeffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa00015b300 0x7fa0000cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:07.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.001+0000 7f9ffeffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa00015b300 0x7fa0000cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45570/0 (socket says 172.21.15.19:45570) 2024-09-12T02:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.001+0000 7f9ffeffd640 1 -- 172.21.15.19:0/94147554 learned_addr learned my addr 172.21.15.19:0/94147554 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.001+0000 7f9ffe7fc640 1 --2- 172.21.15.19:0/94147554 >> v2:172.21.15.135:3300/0 conn(0x7fa0000cd3f0 0x7fa00006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.001+0000 7f9fff7fe640 1 --2- 172.21.15.19:0/94147554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa000072d30 0x7fa00006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.001+0000 7f9ffeffd640 1 -- 172.21.15.19:0/94147554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa000072d30 msgr2=0x7fa00006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.001+0000 7f9ffeffd640 1 --2- 172.21.15.19:0/94147554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa000072d30 0x7fa00006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.001+0000 7f9ffeffd640 1 -- 172.21.15.19:0/94147554 >> v2:172.21.15.135:3300/0 conn(0x7fa0000cd3f0 msgr2=0x7fa00006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.001+0000 7f9ffeffd640 1 --2- 172.21.15.19:0/94147554 >> v2:172.21.15.135:3300/0 conn(0x7fa0000cd3f0 0x7fa00006f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.001+0000 7f9ffeffd640 1 -- 172.21.15.19:0/94147554 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa000072250 con 0x7fa00015b300 2024-09-12T02:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.001+0000 7f9ffe7fc640 1 --2- 172.21.15.19:0/94147554 >> v2:172.21.15.135:3300/0 conn(0x7fa0000cd3f0 0x7fa00006f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.002+0000 7f9ffeffd640 1 --2- 172.21.15.19:0/94147554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa00015b300 0x7fa0000cceb0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fa0000b57c0 tx=0x7f9ff802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650ac451b7aab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.002+0000 7f9ffdffb640 1 -- 172.21.15.19:0/94147554 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8037070 con 0x7fa00015b300 2024-09-12T02:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.002+0000 7f9ffdffb640 1 -- 172.21.15.19:0/94147554 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff8032440 con 0x7fa00015b300 2024-09-12T02:04:07.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.002+0000 7f9ffdffb640 1 -- 172.21.15.19:0/94147554 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8032810 con 0x7fa00015b300 2024-09-12T02:04:07.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.003+0000 7fa005677640 1 -- 172.21.15.19:0/94147554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa00015b300 msgr2=0x7fa0000cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:07.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.003+0000 7fa005677640 1 --2- 172.21.15.19:0/94147554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa00015b300 0x7fa0000cceb0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fa0000b57c0 tx=0x7f9ff802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.003+0000 7fa005677640 1 -- 172.21.15.19:0/94147554 shutdown_connections 2024-09-12T02:04:07.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.003+0000 7fa005677640 1 --2- 172.21.15.19:0/94147554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa000072d30 0x7fa00006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.003+0000 7fa005677640 1 --2- 172.21.15.19:0/94147554 >> v2:172.21.15.135:3300/0 conn(0x7fa0000cd3f0 0x7fa00006f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.003+0000 7fa005677640 1 --2- 172.21.15.19:0/94147554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa00015b300 0x7fa0000cceb0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.003+0000 7fa005677640 1 -- 172.21.15.19:0/94147554 >> 172.21.15.19:0/94147554 conn(0x7fa000067d70 msgr2=0x7fa00006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:07.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.003+0000 7fa005677640 1 -- 172.21.15.19:0/94147554 shutdown_connections 2024-09-12T02:04:07.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.003+0000 7fa005677640 1 -- 172.21.15.19:0/94147554 wait complete. 2024-09-12T02:04:07.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.004+0000 7fa005677640 1 Processor -- start 2024-09-12T02:04:07.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.004+0000 7fa005677640 1 -- start start 2024-09-12T02:04:07.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.005+0000 7fa005677640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa000072d30 0x7fa0000b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:07.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.005+0000 7fa005677640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0000cd3f0 0x7fa0000af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:07.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.005+0000 7fa005677640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa00015b300 0x7fa000151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:07.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.005+0000 7fa005677640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa0000d0160 con 0x7fa00015b300 2024-09-12T02:04:07.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.005+0000 7fa005677640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa0000cffe0 con 0x7fa0000cd3f0 2024-09-12T02:04:07.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.005+0000 7fa005677640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa0000b3c40 con 0x7fa000072d30 2024-09-12T02:04:07.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.005+0000 7f9fff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa00015b300 0x7fa000151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:07.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.005+0000 7f9fff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa00015b300 0x7fa000151a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45586/0 (socket says 172.21.15.19:45586) 2024-09-12T02:04:07.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.005+0000 7f9fff7fe640 1 -- 172.21.15.19:0/109897698 learned_addr learned my addr 172.21.15.19:0/109897698 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:07.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.005+0000 7f9ffe7fc640 1 --2- 172.21.15.19:0/109897698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0000cd3f0 0x7fa0000af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:07.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.005+0000 7f9ffeffd640 1 --2- 172.21.15.19:0/109897698 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa000072d30 0x7fa0000b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:07.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.005+0000 7f9fff7fe640 1 -- 172.21.15.19:0/109897698 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa000072d30 msgr2=0x7fa0000b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:07.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.005+0000 7f9fff7fe640 1 --2- 172.21.15.19:0/109897698 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa000072d30 0x7fa0000b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.005+0000 7f9fff7fe640 1 -- 172.21.15.19:0/109897698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0000cd3f0 msgr2=0x7fa0000af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:07.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.005+0000 7f9fff7fe640 1 --2- 172.21.15.19:0/109897698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0000cd3f0 0x7fa0000af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.005+0000 7f9fff7fe640 1 -- 172.21.15.19:0/109897698 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0000af6e0 con 0x7fa00015b300 2024-09-12T02:04:07.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.005+0000 7f9ffe7fc640 1 --2- 172.21.15.19:0/109897698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0000cd3f0 0x7fa0000af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.005+0000 7f9ffeffd640 1 --2- 172.21.15.19:0/109897698 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa000072d30 0x7fa0000b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.006+0000 7f9fff7fe640 1 --2- 172.21.15.19:0/109897698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa00015b300 0x7fa000151a40 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0007e60 tx=0x7f9ff000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.006+0000 7f9ff77fe640 1 -- 172.21.15.19:0/109897698 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0014620 con 0x7fa00015b300 2024-09-12T02:04:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.006+0000 7f9ff77fe640 1 -- 172.21.15.19:0/109897698 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff0019070 con 0x7fa00015b300 2024-09-12T02:04:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.006+0000 7fa005677640 1 -- 172.21.15.19:0/109897698 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0000b0720 con 0x7fa00015b300 2024-09-12T02:04:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.006+0000 7f9ff77fe640 1 -- 172.21.15.19:0/109897698 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0014a20 con 0x7fa00015b300 2024-09-12T02:04:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.006+0000 7fa005677640 1 -- 172.21.15.19:0/109897698 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0000b0fc0 con 0x7fa00015b300 2024-09-12T02:04:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.007+0000 7fa005677640 1 -- 172.21.15.19:0/109897698 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0000b41f0 con 0x7fa00015b300 2024-09-12T02:04:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.007+0000 7f9ff77fe640 1 -- 172.21.15.19:0/109897698 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ff0014bc0 con 0x7fa00015b300 2024-09-12T02:04:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.008+0000 7f9ff77fe640 1 --2- 172.21.15.19:0/109897698 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9fe006be30 0x7f9fe006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.008+0000 7f9ff77fe640 1 -- 172.21.15.19:0/109897698 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 7507+0+0 (secure 0 0 0) 0x7f9ff008bde0 con 0x7fa00015b300 2024-09-12T02:04:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.008+0000 7f9ffeffd640 1 --2- 172.21.15.19:0/109897698 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9fe006be30 0x7f9fe006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:07.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.009+0000 7f9ffeffd640 1 --2- 172.21.15.19:0/109897698 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9fe006be30 0x7f9fe006e2f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8034000 tx=0x7f9ff802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:07.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.012+0000 7f9ff77fe640 1 -- 172.21.15.19:0/109897698 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ff005a080 con 0x7fa00015b300 2024-09-12T02:04:07.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.224+0000 7fa005677640 1 -- 172.21.15.19:0/109897698 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0001e8700 con 0x7fa00015b300 2024-09-12T02:04:07.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.225+0000 7f9ff77fe640 1 -- 172.21.15.19:0/109897698 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 166 v166) ==== 95+0+4389 (secure 0 0 0) 0x7f9ff0059980 con 0x7fa00015b300 2024-09-12T02:04:07.226 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:07.226 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":166,"btime":"2024-09-12T02:04:03:869446+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8565,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3985859189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3985859189},{"type":"v1","addr":"172.21.15.19:6834","nonce":3985859189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163}],"filesystems":[{"mdsmap":{"epoch":166,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:03.869442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:07.227 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 166 2024-09-12T02:04:07.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.227+0000 7fa005677640 1 -- 172.21.15.19:0/109897698 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9fe006be30 msgr2=0x7f9fe006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:07.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.227+0000 7fa005677640 1 --2- 172.21.15.19:0/109897698 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9fe006be30 0x7f9fe006e2f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8034000 tx=0x7f9ff802e000 comp rx=0 tx=0).stop 2024-09-12T02:04:07.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.227+0000 7fa005677640 1 -- 172.21.15.19:0/109897698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa00015b300 msgr2=0x7fa000151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:07.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.227+0000 7fa005677640 1 --2- 172.21.15.19:0/109897698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa00015b300 0x7fa000151a40 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0007e60 tx=0x7f9ff000e4b0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.227+0000 7fa005677640 1 -- 172.21.15.19:0/109897698 shutdown_connections 2024-09-12T02:04:07.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.227+0000 7fa005677640 1 --2- 172.21.15.19:0/109897698 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9fe006be30 0x7f9fe006e2f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.227+0000 7fa005677640 1 --2- 172.21.15.19:0/109897698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa00015b300 0x7fa000151a40 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.227+0000 7fa005677640 1 --2- 172.21.15.19:0/109897698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0000cd3f0 0x7fa0000af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.227+0000 7fa005677640 1 --2- 172.21.15.19:0/109897698 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa000072d30 0x7fa0000b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.227+0000 7fa005677640 1 -- 172.21.15.19:0/109897698 >> 172.21.15.19:0/109897698 conn(0x7fa000067d70 msgr2=0x7fa00015ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:07.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.227+0000 7fa005677640 1 -- 172.21.15.19:0/109897698 shutdown_connections 2024-09-12T02:04:07.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.227+0000 7fa005677640 1 -- 172.21.15.19:0/109897698 wait complete. 2024-09-12T02:04:07.238 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 1.00000000' led to DAMAGED state 2024-09-12T02:04:07.239 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt 1.00000000.inode' 2024-09-12T02:04:07.239 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:04:07.239 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:04:07.256 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:04:07.256 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:04:07.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:07.256 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:04:07.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:04:07.312 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:04:07.312 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:04:07.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.455+0000 7f3e2c647640 1 Processor -- start 2024-09-12T02:04:07.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.455+0000 7f3e2c647640 1 -- start start 2024-09-12T02:04:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.456+0000 7f3e2c647640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3e240d30f0 0x7f3e240b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.456+0000 7f3e2c647640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e240d3690 con 0x7f3e240b64c0 2024-09-12T02:04:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.456+0000 7f3e2c647640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e240d3970 con 0x7f3e2415e5f0 2024-09-12T02:04:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.456+0000 7f3e2c647640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f3e2406d530 con 0x7f3e240d30f0 2024-09-12T02:04:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.456+0000 7f3e2abe4640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3e240b64c0 0x7f3e2406d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55926/0 (socket says 172.21.15.19:55926) 2024-09-12T02:04:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.456+0000 7f3e2abe4640 1 -- 172.21.15.19:0/827573333 learned_addr learned my addr 172.21.15.19:0/827573333 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.456+0000 7f3e29be2640 1 --2- 172.21.15.19:0/827573333 >> v2:172.21.15.135:3300/0 conn(0x7f3e240d30f0 0x7f3e240b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.456+0000 7f3e293e1640 1 -- 172.21.15.19:0/827573333 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3199387350 0 0) 0x7f3e240d3690 con 0x7f3e240b64c0 2024-09-12T02:04:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.456+0000 7f3e293e1640 1 -- 172.21.15.19:0/827573333 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e10003520 con 0x7f3e240b64c0 2024-09-12T02:04:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.456+0000 7f3e293e1640 1 -- 172.21.15.19:0/827573333 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3823322392 0 0) 0x7f3e10003520 con 0x7f3e240b64c0 2024-09-12T02:04:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.456+0000 7f3e293e1640 1 -- 172.21.15.19:0/827573333 >> v2:172.21.15.135:3300/0 conn(0x7f3e240d30f0 msgr2=0x7f3e240b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.456+0000 7f3e293e1640 1 --2- 172.21.15.19:0/827573333 >> v2:172.21.15.135:3300/0 conn(0x7f3e240d30f0 0x7f3e240b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.456+0000 7f3e293e1640 1 -- 172.21.15.19:0/827573333 >> v1:172.21.15.135:6789/0 conn(0x7f3e2415e5f0 legacy=0x7f3e240d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.456+0000 7f3e293e1640 1 -- 172.21.15.19:0/827573333 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2406cee0 con 0x7f3e240b64c0 2024-09-12T02:04:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.456+0000 7f3e293e1640 1 -- 172.21.15.19:0/827573333 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f3e1c0019f0 con 0x7f3e240b64c0 2024-09-12T02:04:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.456+0000 7f3e293e1640 1 -- 172.21.15.19:0/827573333 >> v1:172.21.15.19:6789/0 conn(0x7f3e240b64c0 legacy=0x7f3e2406d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.457+0000 7f3e293e1640 1 --2- 172.21.15.19:0/827573333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e100039b0 0x7f3e10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.457+0000 7f3e293e1640 1 --2- 172.21.15.19:0/827573333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e10004800 0x7f3e10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.457+0000 7f3e293e1640 1 --2- 172.21.15.19:0/827573333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e100051c0 0x7f3e1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.457+0000 7f3e293e1640 1 -- 172.21.15.19:0/827573333 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2406d530 con 0x7f3e100039b0 2024-09-12T02:04:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.457+0000 7f3e293e1640 1 -- 172.21.15.19:0/827573333 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1000c060 con 0x7f3e100051c0 2024-09-12T02:04:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.457+0000 7f3e293e1640 1 -- 172.21.15.19:0/827573333 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1000c260 con 0x7f3e10004800 2024-09-12T02:04:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.457+0000 7f3e2a3e3640 1 --2- 172.21.15.19:0/827573333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e100039b0 0x7f3e10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.457+0000 7f3e29be2640 1 --2- 172.21.15.19:0/827573333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e10004800 0x7f3e10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.457+0000 7f3e2abe4640 1 --2- 172.21.15.19:0/827573333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e100051c0 0x7f3e1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.457+0000 7f3e2a3e3640 1 -- 172.21.15.19:0/827573333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e10004800 msgr2=0x7f3e10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.457+0000 7f3e2a3e3640 1 --2- 172.21.15.19:0/827573333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e10004800 0x7f3e10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.457+0000 7f3e2a3e3640 1 -- 172.21.15.19:0/827573333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e100051c0 msgr2=0x7f3e1000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:07.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.457+0000 7f3e2a3e3640 1 --2- 172.21.15.19:0/827573333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e100051c0 0x7f3e1000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.457+0000 7f3e2abe4640 1 -- 172.21.15.19:0/827573333 reap_dead start 2024-09-12T02:04:07.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.457+0000 7f3e2a3e3640 1 -- 172.21.15.19:0/827573333 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e10003520 con 0x7f3e100039b0 2024-09-12T02:04:07.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.457+0000 7f3e29be2640 1 --2- 172.21.15.19:0/827573333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e10004800 0x7f3e10004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:07.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.458+0000 7f3e2a3e3640 1 --2- 172.21.15.19:0/827573333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e100039b0 0x7f3e10003dd0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f3e20001750 tx=0x7f3e10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f0b8f67a3ceb25 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:07.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.458+0000 7f3e293e1640 1 -- 172.21.15.19:0/827573333 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e20001370 con 0x7f3e100039b0 2024-09-12T02:04:07.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.458+0000 7f3e293e1640 1 -- 172.21.15.19:0/827573333 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e200052d0 con 0x7f3e100039b0 2024-09-12T02:04:07.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.458+0000 7f3e293e1640 1 -- 172.21.15.19:0/827573333 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2002abc0 con 0x7f3e100039b0 2024-09-12T02:04:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.458+0000 7f3e2c647640 1 -- 172.21.15.19:0/827573333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e100039b0 msgr2=0x7f3e10003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.458+0000 7f3e2c647640 1 --2- 172.21.15.19:0/827573333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e100039b0 0x7f3e10003dd0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f3e20001750 tx=0x7f3e10005830 comp rx=0 tx=0).stop 2024-09-12T02:04:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.459+0000 7f3e2c647640 1 -- 172.21.15.19:0/827573333 shutdown_connections 2024-09-12T02:04:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.459+0000 7f3e2c647640 1 --2- 172.21.15.19:0/827573333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e100039b0 0x7f3e10003dd0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.459+0000 7f3e2c647640 1 -- 172.21.15.19:0/827573333 >> 172.21.15.19:0/827573333 conn(0x7f3e2408bfc0 msgr2=0x7f3e240d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.459+0000 7f3e2c647640 1 -- 172.21.15.19:0/827573333 shutdown_connections 2024-09-12T02:04:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.459+0000 7f3e2c647640 1 -- 172.21.15.19:0/827573333 wait complete. 2024-09-12T02:04:07.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.460+0000 7f3e2c647640 1 Processor -- start 2024-09-12T02:04:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.460+0000 7f3e2c647640 1 -- start start 2024-09-12T02:04:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.460+0000 7f3e2c647640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e100039b0 0x7f3e241f1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.460+0000 7f3e2c647640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e2415fcd0 0x7f3e241f7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.460+0000 7f3e2c647640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e241f7cb0 0x7f3e241f8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.460+0000 7f3e2c647640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e240b5f80 con 0x7f3e100039b0 2024-09-12T02:04:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.460+0000 7f3e2c647640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2415e9d0 con 0x7f3e2415fcd0 2024-09-12T02:04:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.460+0000 7f3e2c647640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3e240b6100 con 0x7f3e241f7cb0 2024-09-12T02:04:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.461+0000 7f3e2a3e3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e100039b0 0x7f3e241f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.461+0000 7f3e2a3e3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e100039b0 0x7f3e241f1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45604/0 (socket says 172.21.15.19:45604) 2024-09-12T02:04:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.461+0000 7f3e2a3e3640 1 -- 172.21.15.19:0/2884087750 learned_addr learned my addr 172.21.15.19:0/2884087750 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.461+0000 7f3e29be2640 1 --2- 172.21.15.19:0/2884087750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e2415fcd0 0x7f3e241f7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.461+0000 7f3e2abe4640 1 --2- 172.21.15.19:0/2884087750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e241f7cb0 0x7f3e241f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.461+0000 7f3e2a3e3640 1 -- 172.21.15.19:0/2884087750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e241f7cb0 msgr2=0x7f3e241f8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.461+0000 7f3e2a3e3640 1 --2- 172.21.15.19:0/2884087750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e241f7cb0 0x7f3e241f8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.461+0000 7f3e2a3e3640 1 -- 172.21.15.19:0/2884087750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e2415fcd0 msgr2=0x7f3e241f7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.461+0000 7f3e2a3e3640 1 --2- 172.21.15.19:0/2884087750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e2415fcd0 0x7f3e241f7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.461+0000 7f3e2a3e3640 1 -- 172.21.15.19:0/2884087750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e24160520 con 0x7f3e100039b0 2024-09-12T02:04:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.461+0000 7f3e2abe4640 1 --2- 172.21.15.19:0/2884087750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e241f7cb0 0x7f3e241f8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.461+0000 7f3e2a3e3640 1 --2- 172.21.15.19:0/2884087750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e100039b0 0x7f3e241f1670 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f3e20001870 tx=0x7f3e20001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.461+0000 7f3e1affd640 1 -- 172.21.15.19:0/2884087750 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2003f030 con 0x7f3e100039b0 2024-09-12T02:04:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.461+0000 7f3e1affd640 1 -- 172.21.15.19:0/2884087750 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e20005480 con 0x7f3e100039b0 2024-09-12T02:04:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.461+0000 7f3e2c647640 1 -- 172.21.15.19:0/2884087750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e24160800 con 0x7f3e100039b0 2024-09-12T02:04:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.461+0000 7f3e1affd640 1 -- 172.21.15.19:0/2884087750 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e20037040 con 0x7f3e100039b0 2024-09-12T02:04:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.461+0000 7f3e2c647640 1 -- 172.21.15.19:0/2884087750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e24160dc0 con 0x7f3e100039b0 2024-09-12T02:04:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.462+0000 7f3e2c647640 1 -- 172.21.15.19:0/2884087750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e240d4dd0 con 0x7f3e100039b0 2024-09-12T02:04:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.463+0000 7f3e1affd640 1 -- 172.21.15.19:0/2884087750 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e20042070 con 0x7f3e100039b0 2024-09-12T02:04:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.463+0000 7f3e1affd640 1 --2- 172.21.15.19:0/2884087750 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3e0806be30 0x7f3e0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.463+0000 7f3e1affd640 1 -- 172.21.15.19:0/2884087750 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 7507+0+0 (secure 0 0 0) 0x7f3e200aaeb0 con 0x7f3e100039b0 2024-09-12T02:04:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.463+0000 7f3e29be2640 1 --2- 172.21.15.19:0/2884087750 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3e0806be30 0x7f3e0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.464+0000 7f3e29be2640 1 --2- 172.21.15.19:0/2884087750 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3e0806be30 0x7f3e0806e2f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3e240b35b0 tx=0x7f3e14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:07.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.468+0000 7f3e1affd640 1 -- 172.21.15.19:0/2884087750 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e200791e0 con 0x7f3e100039b0 2024-09-12T02:04:07.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.677+0000 7f3e2c647640 1 -- 172.21.15.19:0/2884087750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3e240cf2b0 con 0x7f3e100039b0 2024-09-12T02:04:07.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.885+0000 7f3e1affd640 1 -- 172.21.15.19:0/2884087750 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v167) ==== 161+0+0 (secure 0 0 0) 0x7f3e20078ae0 con 0x7f3e100039b0 2024-09-12T02:04:07.886 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:04:07.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.888+0000 7f3e2c647640 1 -- 172.21.15.19:0/2884087750 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3e0806be30 msgr2=0x7f3e0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:07.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.888+0000 7f3e2c647640 1 --2- 172.21.15.19:0/2884087750 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3e0806be30 0x7f3e0806e2f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3e240b35b0 tx=0x7f3e14008040 comp rx=0 tx=0).stop 2024-09-12T02:04:07.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.888+0000 7f3e2c647640 1 -- 172.21.15.19:0/2884087750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e100039b0 msgr2=0x7f3e241f1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:07.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.888+0000 7f3e2c647640 1 --2- 172.21.15.19:0/2884087750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e100039b0 0x7f3e241f1670 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f3e20001870 tx=0x7f3e20001120 comp rx=0 tx=0).stop 2024-09-12T02:04:07.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.888+0000 7f3e2c647640 1 -- 172.21.15.19:0/2884087750 shutdown_connections 2024-09-12T02:04:07.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.888+0000 7f3e2c647640 1 --2- 172.21.15.19:0/2884087750 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3e0806be30 0x7f3e0806e2f0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.888+0000 7f3e2c647640 1 --2- 172.21.15.19:0/2884087750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e241f7cb0 0x7f3e241f8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.888+0000 7f3e2c647640 1 --2- 172.21.15.19:0/2884087750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e2415fcd0 0x7f3e241f7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.888+0000 7f3e2c647640 1 --2- 172.21.15.19:0/2884087750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e100039b0 0x7f3e241f1670 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:07.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.888+0000 7f3e2c647640 1 -- 172.21.15.19:0/2884087750 >> 172.21.15.19:0/2884087750 conn(0x7f3e2408bfc0 msgr2=0x7f3e240b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:07.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.888+0000 7f3e2c647640 1 -- 172.21.15.19:0/2884087750 shutdown_connections 2024-09-12T02:04:07.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:07.888+0000 7f3e2c647640 1 -- 172.21.15.19:0/2884087750 wait complete. 2024-09-12T02:04:07.900 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:04:08.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.003+0000 7f744c9bd640 1 Processor -- start 2024-09-12T02:04:08.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.003+0000 7f744c9bd640 1 -- start start 2024-09-12T02:04:08.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.004+0000 7f744c9bd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f744815e760 0x7f744806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:08.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.004+0000 7f744c9bd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74480cfcc0 0x7f74480d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:08.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.004+0000 7f744c9bd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74480d2700 con 0x7f74480d4fd0 2024-09-12T02:04:08.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.004+0000 7f744c9bd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f74480cedb0 con 0x7f744815e760 2024-09-12T02:04:08.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.004+0000 7f744c9bd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f74480cf090 con 0x7f74480cfcc0 2024-09-12T02:04:08.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.004+0000 7f744659c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f744815e760 0x7f744806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:08.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.004+0000 7f7445d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f74480d4fd0 0x7f74480cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55938/0 (socket says 172.21.15.19:55938) 2024-09-12T02:04:08.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.004+0000 7f744659c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f744815e760 0x7f744806cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45616/0 (socket says 172.21.15.19:45616) 2024-09-12T02:04:08.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.004+0000 7f7445d9b640 1 -- 172.21.15.19:0/3411249323 learned_addr learned my addr 172.21.15.19:0/3411249323 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:08.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.005+0000 7f7446d9d640 1 --2- 172.21.15.19:0/3411249323 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74480cfcc0 0x7f74480d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.005+0000 7f744659c640 1 -- 172.21.15.19:0/3411249323 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74480cfcc0 msgr2=0x7f74480d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.005+0000 7f744659c640 1 --2- 172.21.15.19:0/3411249323 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74480cfcc0 0x7f74480d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.005+0000 7f744659c640 1 -- 172.21.15.19:0/3411249323 >> v1:172.21.15.19:6789/0 conn(0x7f74480d4fd0 legacy=0x7f74480cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.005+0000 7f744659c640 1 -- 172.21.15.19:0/3411249323 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74480b3c80 con 0x7f744815e760 2024-09-12T02:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.005+0000 7f744659c640 1 --2- 172.21.15.19:0/3411249323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744815e760 0x7f744806cdd0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f74400097a0 tx=0x7f744002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2071746cef5fd170 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.005+0000 7f744559a640 1 -- 172.21.15.19:0/3411249323 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7440037070 con 0x7f744815e760 2024-09-12T02:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.006+0000 7f744559a640 1 -- 172.21.15.19:0/3411249323 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7440032440 con 0x7f744815e760 2024-09-12T02:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.006+0000 7f744559a640 1 -- 172.21.15.19:0/3411249323 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7440032810 con 0x7f744815e760 2024-09-12T02:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.006+0000 7f744c9bd640 1 -- 172.21.15.19:0/3411249323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744815e760 msgr2=0x7f744806cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:08.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.006+0000 7f744c9bd640 1 --2- 172.21.15.19:0/3411249323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744815e760 0x7f744806cdd0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f74400097a0 tx=0x7f744002a180 comp rx=0 tx=0).stop 2024-09-12T02:04:08.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.006+0000 7f744c9bd640 1 -- 172.21.15.19:0/3411249323 shutdown_connections 2024-09-12T02:04:08.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.006+0000 7f744c9bd640 1 --2- 172.21.15.19:0/3411249323 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74480cfcc0 0x7f74480d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:08.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.006+0000 7f744c9bd640 1 --2- 172.21.15.19:0/3411249323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744815e760 0x7f744806cdd0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:08.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.006+0000 7f744c9bd640 1 -- 172.21.15.19:0/3411249323 >> 172.21.15.19:0/3411249323 conn(0x7f744808bfc0 msgr2=0x7f74480d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:08.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.006+0000 7f744c9bd640 1 -- 172.21.15.19:0/3411249323 shutdown_connections 2024-09-12T02:04:08.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.006+0000 7f744c9bd640 1 -- 172.21.15.19:0/3411249323 wait complete. 2024-09-12T02:04:08.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.007+0000 7f744c9bd640 1 Processor -- start 2024-09-12T02:04:08.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.008+0000 7f744c9bd640 1 -- start start 2024-09-12T02:04:08.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.008+0000 7f744c9bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74480cfcc0 0x7f74480b9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:08.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.008+0000 7f744c9bd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74480d4fd0 0x7f74481f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:08.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.008+0000 7f744c9bd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f744815e760 0x7f7448153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:08.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.008+0000 7f744c9bd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f74480d33e0 con 0x7f74480cfcc0 2024-09-12T02:04:08.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.008+0000 7f744c9bd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f74480b38e0 con 0x7f744815e760 2024-09-12T02:04:08.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.008+0000 7f744c9bd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f74480d3560 con 0x7f74480d4fd0 2024-09-12T02:04:08.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.008+0000 7f744659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74480cfcc0 0x7f74480b9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:08.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.008+0000 7f744659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74480cfcc0 0x7f74480b9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45630/0 (socket says 172.21.15.19:45630) 2024-09-12T02:04:08.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.008+0000 7f744659c640 1 -- 172.21.15.19:0/1654813717 learned_addr learned my addr 172.21.15.19:0/1654813717 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:08.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.008+0000 7f7445d9b640 1 --2- 172.21.15.19:0/1654813717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74480d4fd0 0x7f74481f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:08.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.008+0000 7f7446d9d640 1 --2- 172.21.15.19:0/1654813717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f744815e760 0x7f7448153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:08.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.009+0000 7f744659c640 1 -- 172.21.15.19:0/1654813717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74480d4fd0 msgr2=0x7f74481f86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:08.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.009+0000 7f744659c640 1 --2- 172.21.15.19:0/1654813717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74480d4fd0 0x7f74481f86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:08.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.009+0000 7f744659c640 1 -- 172.21.15.19:0/1654813717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f744815e760 msgr2=0x7f7448153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:08.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.009+0000 7f744659c640 1 --2- 172.21.15.19:0/1654813717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f744815e760 0x7f7448153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:08.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.009+0000 7f744659c640 1 -- 172.21.15.19:0/1654813717 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74481538a0 con 0x7f74480cfcc0 2024-09-12T02:04:08.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.009+0000 7f744659c640 1 --2- 172.21.15.19:0/1654813717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74480cfcc0 0x7f74480b9ae0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f7440035040 tx=0x7f74400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:08.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.009+0000 7f743effd640 1 -- 172.21.15.19:0/1654813717 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7440037040 con 0x7f74480cfcc0 2024-09-12T02:04:08.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.009+0000 7f743effd640 1 -- 172.21.15.19:0/1654813717 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7440030770 con 0x7f74480cfcc0 2024-09-12T02:04:08.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.009+0000 7f744c9bd640 1 -- 172.21.15.19:0/1654813717 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f744815fe70 con 0x7f74480cfcc0 2024-09-12T02:04:08.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.009+0000 7f743effd640 1 -- 172.21.15.19:0/1654813717 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7440030b80 con 0x7f74480cfcc0 2024-09-12T02:04:08.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.009+0000 7f744c9bd640 1 -- 172.21.15.19:0/1654813717 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7448160430 con 0x7f74480cfcc0 2024-09-12T02:04:08.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.010+0000 7f744c9bd640 1 -- 172.21.15.19:0/1654813717 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74480d38e0 con 0x7f74480cfcc0 2024-09-12T02:04:08.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.010+0000 7f743effd640 1 -- 172.21.15.19:0/1654813717 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7440044020 con 0x7f74480cfcc0 2024-09-12T02:04:08.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.011+0000 7f743effd640 1 --2- 172.21.15.19:0/1654813717 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f742806be30 0x7f742806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:08.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.011+0000 7f743effd640 1 -- 172.21.15.19:0/1654813717 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 7507+0+0 (secure 0 0 0) 0x7f74400aba40 con 0x7f74480cfcc0 2024-09-12T02:04:08.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.011+0000 7f7445d9b640 1 --2- 172.21.15.19:0/1654813717 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f742806be30 0x7f742806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:08.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.012+0000 7f7445d9b640 1 --2- 172.21.15.19:0/1654813717 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f742806be30 0x7f742806e2f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7430005880 tx=0x7f7430009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:08.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.015+0000 7f743effd640 1 -- 172.21.15.19:0/1654813717 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7440032e20 con 0x7f74480cfcc0 2024-09-12T02:04:08.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.262+0000 7f744c9bd640 1 -- 172.21.15.19:0/1654813717 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f74480b6d20 con 0x7f74480cfcc0 2024-09-12T02:04:08.619 INFO:tasks.ceph.mds.d.smithi135.stderr: -50> 2024-09-12T02:04:03.866+0000 7fdf51243640 -1 log_channel(cluster) log [ERR] : dir 0x1 object missing on disk; some files may be lost () 2024-09-12T02:04:08.619 INFO:tasks.ceph.mds.d.smithi135.stderr: -48> 2024-09-12T02:04:03.866+0000 7fdf51243640 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x1 is fatal because it is a system directory for this rank 2024-09-12T02:04:08.619 INFO:tasks.ceph.mds.d.smithi135.stderr: -30> 2024-09-12T02:04:05.565+0000 7fdf5524b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:04:08.647 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T02:04:08.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.891+0000 7f743effd640 1 -- 172.21.15.19:0/1654813717 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v168) ==== 101+0+0 (secure 0 0 0) 0x7f7440079d70 con 0x7f74480cfcc0 2024-09-12T02:04:08.892 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:04:08.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.895+0000 7f744c9bd640 1 -- 172.21.15.19:0/1654813717 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f742806be30 msgr2=0x7f742806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:08.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.895+0000 7f744c9bd640 1 --2- 172.21.15.19:0/1654813717 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f742806be30 0x7f742806e2f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7430005880 tx=0x7f7430009040 comp rx=0 tx=0).stop 2024-09-12T02:04:08.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.895+0000 7f744c9bd640 1 -- 172.21.15.19:0/1654813717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74480cfcc0 msgr2=0x7f74480b9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:08.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.895+0000 7f744c9bd640 1 --2- 172.21.15.19:0/1654813717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74480cfcc0 0x7f74480b9ae0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f7440035040 tx=0x7f74400046c0 comp rx=0 tx=0).stop 2024-09-12T02:04:08.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.895+0000 7f744c9bd640 1 -- 172.21.15.19:0/1654813717 shutdown_connections 2024-09-12T02:04:08.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.895+0000 7f744c9bd640 1 --2- 172.21.15.19:0/1654813717 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f742806be30 0x7f742806e2f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:08.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.895+0000 7f744c9bd640 1 --2- 172.21.15.19:0/1654813717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f744815e760 0x7f7448153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:08.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.895+0000 7f744c9bd640 1 --2- 172.21.15.19:0/1654813717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74480d4fd0 0x7f74481f86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:08.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.895+0000 7f744c9bd640 1 --2- 172.21.15.19:0/1654813717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74480cfcc0 0x7f74480b9ae0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:08.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.895+0000 7f744c9bd640 1 -- 172.21.15.19:0/1654813717 >> 172.21.15.19:0/1654813717 conn(0x7f744808bfc0 msgr2=0x7f74480b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:08.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.895+0000 7f744c9bd640 1 -- 172.21.15.19:0/1654813717 shutdown_connections 2024-09-12T02:04:08.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.895+0000 7f744c9bd640 1 -- 172.21.15.19:0/1654813717 wait complete. 2024-09-12T02:04:08.909 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:04:08.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.956+0000 7ff9f9cfaf40 1 Processor -- start 2024-09-12T02:04:08.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.956+0000 7ff9f9cfaf40 1 -- start start 2024-09-12T02:04:08.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.956+0000 7ff9f9cfaf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce88fb5f70 0x55ce88ffc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:08.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.956+0000 7ff9f9cfaf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce88fb6350 0x55ce88ff7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:08.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.956+0000 7ff9f9cfaf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce890851d0 0x55ce88fe1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:08.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.956+0000 7ff9f9cfaf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ce88fde100 con 0x55ce88fb6350 2024-09-12T02:04:08.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.956+0000 7ff9f9cfaf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ce88fe1720 con 0x55ce890851d0 2024-09-12T02:04:08.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.956+0000 7ff9f9cfaf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55ce8908bff0 con 0x55ce88fb5f70 2024-09-12T02:04:08.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.957+0000 7ff9f6fef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce88fb6350 0x55ce88ff7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:08.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.957+0000 7ff9f6fef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce88fb6350 0x55ce88ff7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45652/0 (socket says 172.21.15.19:45652) 2024-09-12T02:04:08.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.957+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2657346288 learned_addr learned my addr 172.21.15.19:0/2657346288 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:08.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.957+0000 7ff9f77f0640 1 --2- 172.21.15.19:0/2657346288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce88fb5f70 0x55ce88ffc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:08.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.957+0000 7ff9f7ff1640 1 --2- 172.21.15.19:0/2657346288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce890851d0 0x55ce88fe1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:08.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.957+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2657346288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce88fb5f70 msgr2=0x55ce88ffc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:08.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.957+0000 7ff9f6fef640 1 --2- 172.21.15.19:0/2657346288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce88fb5f70 0x55ce88ffc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:08.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.957+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2657346288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce890851d0 msgr2=0x55ce88fe1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:08.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.957+0000 7ff9f6fef640 1 --2- 172.21.15.19:0/2657346288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce890851d0 0x55ce88fe1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:08.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.957+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2657346288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce88edecb0 con 0x55ce88fb6350 2024-09-12T02:04:08.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.957+0000 7ff9f7ff1640 1 --2- 172.21.15.19:0/2657346288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce890851d0 0x55ce88fe1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:08.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.957+0000 7ff9f6fef640 1 --2- 172.21.15.19:0/2657346288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce88fb6350 0x55ce88ff7be0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009890 tx=0x7ff9ec005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a66f803b2aece6d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:08.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.957+0000 7ff9f5fed640 1 -- 172.21.15.19:0/2657346288 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec008930 con 0x55ce88fb6350 2024-09-12T02:04:08.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.957+0000 7ff9f5fed640 1 -- 172.21.15.19:0/2657346288 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ec018070 con 0x55ce88fb6350 2024-09-12T02:04:08.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.957+0000 7ff9f5fed640 1 -- 172.21.15.19:0/2657346288 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec008d10 con 0x55ce88fb6350 2024-09-12T02:04:08.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.958+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2657346288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce88fb6350 msgr2=0x55ce88ff7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:08.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.958+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2657346288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce88fb6350 0x55ce88ff7be0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009890 tx=0x7ff9ec005a00 comp rx=0 tx=0).stop 2024-09-12T02:04:08.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.958+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2657346288 shutdown_connections 2024-09-12T02:04:08.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.958+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2657346288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce890851d0 0x55ce88fe1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:08.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.958+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2657346288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce88fb6350 0x55ce88ff7be0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:08.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.958+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2657346288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce88fb5f70 0x55ce88ffc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:08.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.958+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2657346288 >> 172.21.15.19:0/2657346288 conn(0x55ce88fb51d0 msgr2=0x55ce88fdfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:08.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.958+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2657346288 shutdown_connections 2024-09-12T02:04:08.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.958+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2657346288 wait complete. 2024-09-12T02:04:08.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.959+0000 7ff9f9cfaf40 1 Processor -- start 2024-09-12T02:04:08.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.959+0000 7ff9f9cfaf40 1 -- start start 2024-09-12T02:04:08.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.959+0000 7ff9f9cfaf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce88fb5f70 0x55ce8907ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:08.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.959+0000 7ff9f9cfaf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce88fb6350 0x55ce88fe1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:08.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.959+0000 7ff9f9cfaf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce890851d0 0x55ce88fe20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:08.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.959+0000 7ff9f9cfaf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ce8907b080 con 0x55ce890851d0 2024-09-12T02:04:08.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.959+0000 7ff9f9cfaf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ce890838d0 con 0x55ce88fb6350 2024-09-12T02:04:08.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.959+0000 7ff9f9cfaf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55ce89079520 con 0x55ce88fb5f70 2024-09-12T02:04:08.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.960+0000 7ff9f7ff1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce890851d0 0x55ce88fe20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:08.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.960+0000 7ff9f7ff1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce890851d0 0x55ce88fe20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45660/0 (socket says 172.21.15.19:45660) 2024-09-12T02:04:08.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.960+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 learned_addr learned my addr 172.21.15.19:0/2229797575 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:08.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.960+0000 7ff9f6fef640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce88fb6350 0x55ce88fe1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:08.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.960+0000 7ff9f77f0640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce88fb5f70 0x55ce8907ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:08.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.960+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce88fb5f70 msgr2=0x55ce8907ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:08.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.960+0000 7ff9f7ff1640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce88fb5f70 0x55ce8907ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:08.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.960+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce88fb6350 msgr2=0x55ce88fe1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:08.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.960+0000 7ff9f7ff1640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce88fb6350 0x55ce88fe1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:08.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.960+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce88ffe210 con 0x55ce890851d0 2024-09-12T02:04:08.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.960+0000 7ff9f77f0640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ce88fb5f70 0x55ce8907ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:08.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.960+0000 7ff9f7ff1640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce890851d0 0x55ce88fe20b0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7ff9f000f540 tx=0x7ff9f000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:08.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.960+0000 7ff9f4feb640 1 -- 172.21.15.19:0/2229797575 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0019020 con 0x55ce890851d0 2024-09-12T02:04:08.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.960+0000 7ff9f4feb640 1 -- 172.21.15.19:0/2229797575 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f0015690 con 0x55ce890851d0 2024-09-12T02:04:08.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.960+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce8907ab90 con 0x55ce890851d0 2024-09-12T02:04:08.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.960+0000 7ff9f4feb640 1 -- 172.21.15.19:0/2229797575 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0015a80 con 0x55ce890851d0 2024-09-12T02:04:08.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.960+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce890791b0 con 0x55ce890851d0 2024-09-12T02:04:08.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.962+0000 7ff9f4feb640 1 -- 172.21.15.19:0/2229797575 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9f001c020 con 0x55ce890851d0 2024-09-12T02:04:08.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.962+0000 7ff9f4feb640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9e406a810 0x7ff9e406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:08.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.962+0000 7ff9f4feb640 1 -- 172.21.15.19:0/2229797575 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 7507+0+0 (secure 0 0 0) 0x7ff9f008a6c0 con 0x55ce890851d0 2024-09-12T02:04:08.965 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:04:08.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.962+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55ce88ffa080 0x55ce89079ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:08.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.963+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912d800 con 0x55ce88ffa080 2024-09-12T02:04:08.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.963+0000 7ff9f77f0640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9e406a810 0x7ff9e406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:08.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.963+0000 7ff9f6fef640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55ce88ffa080 0x55ce89079ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:08.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.963+0000 7ff9f6fef640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55ce88ffa080 0x55ce89079ec0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:08.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.963+0000 7ff9f77f0640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9e406a810 0x7ff9e406ccd0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8057000 tx=0x7ff9e8052000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:08.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.964+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v109'443 uv417 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.965+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912dba0 con 0x55ce88ffa080 2024-09-12T02:04:08.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.966+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v109'444 uv444 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.966+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912df40 con 0x55ce88ffa080 2024-09-12T02:04:08.968 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:04:08.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.967+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v109'445 uv445 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.967+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912f2f0 con 0x55ce88ffa080 2024-09-12T02:04:08.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.968+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v109'446 uv446 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.968+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912f690 con 0x55ce88ffa080 2024-09-12T02:04:08.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.971+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v109'447 uv447 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.971+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912e2e0 con 0x55ce88ffa080 2024-09-12T02:04:08.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.972+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v109'448 uv448 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.972+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912e6f0 con 0x55ce88ffa080 2024-09-12T02:04:08.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.973+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v109'449 uv423 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.973+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.974+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v109'450 uv450 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.974+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.975+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v109'451 uv451 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.975 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:04:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.975+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.976+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v109'452 uv452 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.976+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.977+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v109'453 uv453 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.977+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.978+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v109'454 uv454 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.978+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.979+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v109'455 uv430 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.979+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.980+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v109'456 uv456 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.980+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.981+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v109'457 uv457 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.981 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:04:08.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.981+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.982+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v109'458 uv458 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.982+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.983+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v109'459 uv459 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.983+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.984+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v109'460 uv460 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.984+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.985+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v109'461 uv461 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.985+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.986+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v109'462 uv436 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.986+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.988+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v109'463 uv463 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.988+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.989 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:04:08.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.988+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v109'464 uv464 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.989+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.990+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v109'465 uv465 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.990+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.991+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v109'466 uv466 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.991+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.992+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v109'467 uv467 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.992+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.993+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v109'468 uv442 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.993+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.994+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v109'469 uv469 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.994+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.995 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:04:08.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.995+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v109'470 uv470 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.995+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.996+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v109'471 uv471 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.996+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.998+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v109'472 uv472 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.998+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8912ea90 con 0x55ce88ffa080 2024-09-12T02:04:08.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.999+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v109'473 uv473 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce88ffa080 2024-09-12T02:04:08.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.999+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55ce8912ee50 0x55ce89131f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:08.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.999+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce89132490 con 0x55ce8912ee50 2024-09-12T02:04:08.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.999+0000 7ff9f77f0640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55ce8912ee50 0x55ce89131f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:08.999+0000 7ff9f77f0640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55ce8912ee50 0x55ce89131f50 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:09.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.001+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v109'331 uv313 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.001+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce89132830 con 0x55ce8912ee50 2024-09-12T02:04:09.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.002+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v109'332 uv332 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.002+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce89132bd0 con 0x55ce8912ee50 2024-09-12T02:04:09.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.004+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v109'333 uv333 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.004 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:04:09.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.004+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce89133420 con 0x55ce8912ee50 2024-09-12T02:04:09.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.005+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v109'334 uv334 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.005+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891337c0 con 0x55ce8912ee50 2024-09-12T02:04:09.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.006+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v109'335 uv335 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.006+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce89133b60 con 0x55ce8912ee50 2024-09-12T02:04:09.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.008+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v109'336 uv318 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.008+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce89133f00 con 0x55ce8912ee50 2024-09-12T02:04:09.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.009+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v109'337 uv337 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.009+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891342a0 con 0x55ce8912ee50 2024-09-12T02:04:09.010 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:04:09.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.010+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v109'338 uv338 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.010+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891342a0 con 0x55ce8912ee50 2024-09-12T02:04:09.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.011+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v109'339 uv339 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.011+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891342a0 con 0x55ce8912ee50 2024-09-12T02:04:09.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.013+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v109'340 uv340 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.013+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891342a0 con 0x55ce8912ee50 2024-09-12T02:04:09.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.014+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v109'341 uv323 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.014+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce891342a0 con 0x55ce8912ee50 2024-09-12T02:04:09.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.016+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v109'342 uv342 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.016+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891342a0 con 0x55ce8912ee50 2024-09-12T02:04:09.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.017+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v109'343 uv343 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.017 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:04:09.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.017+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce89138720 con 0x55ce8912ee50 2024-09-12T02:04:09.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.018+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v109'344 uv344 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.018+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce89138720 con 0x55ce8912ee50 2024-09-12T02:04:09.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.019+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v109'345 uv345 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.019+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891342a0 con 0x55ce8912ee50 2024-09-12T02:04:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.021+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v109'346 uv329 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.021+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce891342a0 con 0x55ce8912ee50 2024-09-12T02:04:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.022+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v109'347 uv347 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.022+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891342a0 con 0x55ce8912ee50 2024-09-12T02:04:09.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.023+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v109'348 uv348 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.023 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:04:09.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.023+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891352b0 con 0x55ce8912ee50 2024-09-12T02:04:09.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.024+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v109'349 uv349 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.024+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891352b0 con 0x55ce8912ee50 2024-09-12T02:04:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.025+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v109'350 uv350 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.025+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891342a0 con 0x55ce8912ee50 2024-09-12T02:04:09.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.026+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v109'351 uv351 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8912ee50 2024-09-12T02:04:09.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.026+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ce891347b0 0x55ce89136ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.026+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891370e0 con 0x55ce891347b0 2024-09-12T02:04:09.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.027+0000 7ff9f6fef640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ce891347b0 0x55ce89136ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.027+0000 7ff9f6fef640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ce891347b0 0x55ce89136ba0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:09.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.028+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v109'87 uv86 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.028+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce89137120 con 0x55ce891347b0 2024-09-12T02:04:09.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.029+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v109'88 uv88 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.029+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce89137540 con 0x55ce891347b0 2024-09-12T02:04:09.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.030+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v109'89 uv89 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.031 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:04:09.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.030+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce89138550 con 0x55ce891347b0 2024-09-12T02:04:09.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.032+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v109'90 uv90 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.032+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce89138550 con 0x55ce891347b0 2024-09-12T02:04:09.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.033+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v109'91 uv91 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.033+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce89137540 con 0x55ce891347b0 2024-09-12T02:04:09.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.034+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v109'92 uv92 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.034+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55ce89137bc0 0x55ce89139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.034+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913a630 con 0x55ce89137bc0 2024-09-12T02:04:09.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.034+0000 7ff9f7ff1640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55ce89137bc0 0x55ce89139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.034+0000 7ff9f7ff1640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55ce89137bc0 0x55ce89139fb0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:09.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.036+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v109'68 uv67 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.036+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913ab40 con 0x55ce89137bc0 2024-09-12T02:04:09.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.037+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v109'69 uv69 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.037+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913b040 con 0x55ce89137bc0 2024-09-12T02:04:09.038 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:04:09.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.038+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v109'70 uv70 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.038+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913b900 con 0x55ce89137bc0 2024-09-12T02:04:09.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.039+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v109'71 uv71 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.039+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55ce8913c1b0 0x55ce8913e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.039+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913eae0 con 0x55ce8913c1b0 2024-09-12T02:04:09.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.039+0000 7ff9f77f0640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55ce8913c1b0 0x55ce8913e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.039+0000 7ff9f77f0640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55ce8913c1b0 0x55ce8913e5a0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:09.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.041+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v109'87 uv86 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.041+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913eba0 con 0x55ce8913c1b0 2024-09-12T02:04:09.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.042+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v109'88 uv88 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.042+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913efc0 con 0x55ce8913c1b0 2024-09-12T02:04:09.043 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:04:09.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.043+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v109'89 uv89 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.043+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913ffd0 con 0x55ce8913c1b0 2024-09-12T02:04:09.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.044+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v109'90 uv90 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.044+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913ffd0 con 0x55ce8913c1b0 2024-09-12T02:04:09.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.045+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v109'91 uv91 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.045+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913efc0 con 0x55ce8913c1b0 2024-09-12T02:04:09.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.047+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v109'92 uv92 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.047+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913efc0 con 0x55ce89137bc0 2024-09-12T02:04:09.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.048+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v109'160 uv154 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.048+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913f360 con 0x55ce89137bc0 2024-09-12T02:04:09.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.049+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v109'161 uv161 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.049+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913f700 con 0x55ce89137bc0 2024-09-12T02:04:09.050 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:04:09.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.050+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v109'162 uv162 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.050+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce89140ab0 con 0x55ce89137bc0 2024-09-12T02:04:09.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.051+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v109'163 uv163 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.051+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce89140ab0 con 0x55ce89137bc0 2024-09-12T02:04:09.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.052+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v109'164 uv164 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.052+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce89137bc0 2024-09-12T02:04:09.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.053+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v109'165 uv165 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.053+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce89137bc0 2024-09-12T02:04:09.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.054+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v109'166 uv159 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.054+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce89137bc0 2024-09-12T02:04:09.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.055+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v109'167 uv167 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.055+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce89137bc0 2024-09-12T02:04:09.057 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:04:09.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.056+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v109'168 uv168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.056+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce89137bc0 2024-09-12T02:04:09.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.058+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v109'169 uv169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.058+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce89137bc0 2024-09-12T02:04:09.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.059+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v109'170 uv170 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.059+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce89137bc0 2024-09-12T02:04:09.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.060+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v109'71 uv70 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.060+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce89137bc0 2024-09-12T02:04:09.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.061+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v109'72 uv72 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.061+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce89137bc0 2024-09-12T02:04:09.062 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:04:09.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.062+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v109'73 uv73 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.062+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce89137bc0 2024-09-12T02:04:09.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.063+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v109'74 uv74 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.063+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce89137bc0 2024-09-12T02:04:09.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.064+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v109'75 uv75 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ff9f0054960 con 0x55ce89137bc0 2024-09-12T02:04:09.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.064+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce8913c1b0 2024-09-12T02:04:09.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.065+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v109'87 uv86 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.065+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce8913c1b0 2024-09-12T02:04:09.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.066+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v109'88 uv88 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.066+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce8913c1b0 2024-09-12T02:04:09.067 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:04:09.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.067+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v109'89 uv89 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.067+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce89140ab0 con 0x55ce8913c1b0 2024-09-12T02:04:09.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.068+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v109'90 uv90 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.068+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce89140ab0 con 0x55ce8913c1b0 2024-09-12T02:04:09.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.069+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v109'91 uv91 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.069+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce8913c1b0 2024-09-12T02:04:09.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.070+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v109'92 uv92 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.070+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce8913c1b0 2024-09-12T02:04:09.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.071+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v109'142 uv136 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.071+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce8913c1b0 2024-09-12T02:04:09.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.072+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v109'143 uv143 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.072+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce8913c1b0 2024-09-12T02:04:09.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.073+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v109'144 uv144 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.074 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:04:09.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.073+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913fe90 con 0x55ce8913c1b0 2024-09-12T02:04:09.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.074+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v109'145 uv145 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.074+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913fac0 con 0x55ce8913c1b0 2024-09-12T02:04:09.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.075+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v109'146 uv146 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.075+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce8913c1b0 2024-09-12T02:04:09.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.076+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v109'147 uv141 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.076+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce8913c1b0 2024-09-12T02:04:09.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.077+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v109'148 uv148 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.077+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce8913c1b0 2024-09-12T02:04:09.078 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:04:09.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.078+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v109'149 uv149 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.078+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913faa0 con 0x55ce8913c1b0 2024-09-12T02:04:09.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.079+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v109'150 uv150 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.079+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce8913ff50 con 0x55ce8913c1b0 2024-09-12T02:04:09.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.080+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v109'151 uv151 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.080+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55ce89140610 0x55ce89142e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.080+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891409f0 con 0x55ce89140610 2024-09-12T02:04:09.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.080+0000 7ff9f6fef640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55ce89140610 0x55ce89142e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.081+0000 7ff9f6fef640 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55ce89140610 0x55ce89142e80 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:09.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.082+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v109'66 uv64 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce89140610 2024-09-12T02:04:09.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.082+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce891409f0 con 0x55ce89140610 2024-09-12T02:04:09.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.083+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v109'67 uv67 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce89140610 2024-09-12T02:04:09.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.083+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891409f0 con 0x55ce89140610 2024-09-12T02:04:09.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.085+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v109'68 uv68 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce89140610 2024-09-12T02:04:09.086 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:04:09.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.085+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891433c0 con 0x55ce89140610 2024-09-12T02:04:09.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.086+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v109'69 uv69 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce89140610 2024-09-12T02:04:09.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.086+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891433c0 con 0x55ce8913c1b0 2024-09-12T02:04:09.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.087+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v109'87 uv86 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.087+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce891433c0 con 0x55ce8913c1b0 2024-09-12T02:04:09.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.089+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v109'88 uv88 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.089+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891433c0 con 0x55ce8913c1b0 2024-09-12T02:04:09.090 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:04:09.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.090+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v109'89 uv89 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.090+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891443d0 con 0x55ce8913c1b0 2024-09-12T02:04:09.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.090+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v109'90 uv90 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.091+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891443d0 con 0x55ce8913c1b0 2024-09-12T02:04:09.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.092+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v109'91 uv91 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.092+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891433c0 con 0x55ce8913c1b0 2024-09-12T02:04:09.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.093+0000 7ff9f77f0640 1 -- 172.21.15.19:0/2229797575 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v109'92 uv92 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9e8067070 con 0x55ce8913c1b0 2024-09-12T02:04:09.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.093+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891433c0 con 0x55ce891347b0 2024-09-12T02:04:09.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.094+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v109'74 uv73 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.094+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce891433c0 con 0x55ce891347b0 2024-09-12T02:04:09.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.095+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v109'75 uv75 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.095+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891433c0 con 0x55ce891347b0 2024-09-12T02:04:09.097 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:04:09.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.096+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v109'76 uv76 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.096+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891433c0 con 0x55ce891347b0 2024-09-12T02:04:09.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.098+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v109'77 uv77 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.098+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891433c0 con 0x55ce891347b0 2024-09-12T02:04:09.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.099+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v109'78 uv78 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.099+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891433c0 con 0x55ce891347b0 2024-09-12T02:04:09.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.100+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v109'182 uv172 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.100+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x55ce891433c0 con 0x55ce891347b0 2024-09-12T02:04:09.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.101+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v109'183 uv183 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.101+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891433c0 con 0x55ce891347b0 2024-09-12T02:04:09.102 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:04:09.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.102+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v109'184 uv184 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.102+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891433c0 con 0x55ce891347b0 2024-09-12T02:04:09.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.103+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v109'185 uv185 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.103+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891433c0 con 0x55ce891347b0 2024-09-12T02:04:09.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.104+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v109'186 uv186 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.104+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891433c0 con 0x55ce891347b0 2024-09-12T02:04:09.105 INFO:teuthology.orchestra.run.smithi019.stdout:Write #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:04:09.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.105+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v109'187 uv187 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.105+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891443d0 con 0x55ce891347b0 2024-09-12T02:04:09.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.106+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v109'188 uv188 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.106+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891443d0 con 0x55ce891347b0 2024-09-12T02:04:09.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.107+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v109'189 uv189 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.107+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce891433c0 con 0x55ce891347b0 2024-09-12T02:04:09.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.108+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [omap-set-header] v109'190 uv190 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.108+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ce89143870 con 0x55ce891347b0 2024-09-12T02:04:09.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f6fef640 1 -- 172.21.15.19:0/2229797575 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v109'191 uv191 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7ff9ec008730 con 0x55ce891347b0 2024-09-12T02:04:09.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55ce8912ee50 msgr2=0x55ce89131f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55ce8912ee50 0x55ce89131f50 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55ce88ffa080 msgr2=0x55ce89079ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55ce88ffa080 0x55ce89079ec0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55ce89137bc0 msgr2=0x55ce89139fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55ce89137bc0 0x55ce89139fb0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55ce89140610 msgr2=0x55ce89142e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55ce89140610 0x55ce89142e80 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ce891347b0 msgr2=0x55ce89136ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ce891347b0 0x55ce89136ba0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55ce8913c1b0 msgr2=0x55ce8913e5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55ce8913c1b0 0x55ce8913e5a0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 reap_dead start 2024-09-12T02:04:09.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 reap_dead start 2024-09-12T02:04:09.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f7ff1640 1 -- 172.21.15.19:0/2229797575 reap_dead start 2024-09-12T02:04:09.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9e406a810 msgr2=0x7ff9e406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9e406a810 0x7ff9e406ccd0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8057000 tx=0x7ff9e8052000 comp rx=0 tx=0).stop 2024-09-12T02:04:09.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce890851d0 msgr2=0x55ce88fe20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce890851d0 0x55ce88fe20b0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7ff9f000f540 tx=0x7ff9f000fa00 comp rx=0 tx=0).stop 2024-09-12T02:04:09.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 shutdown_connections 2024-09-12T02:04:09.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9e406a810 0x7ff9e406ccd0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 --2- 172.21.15.19:0/2229797575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce890851d0 0x55ce88fe20b0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.109+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 >> 172.21.15.19:0/2229797575 conn(0x55ce88fb51d0 msgr2=0x55ce89082d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:09.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.110+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 shutdown_connections 2024-09-12T02:04:09.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.110+0000 7ff9f9cfaf40 1 -- 172.21.15.19:0/2229797575 wait complete. 2024-09-12T02:04:09.113 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put 1.00000000.inode - 2024-09-12T02:04:09.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.158+0000 7ff3f8673f40 1 Processor -- start 2024-09-12T02:04:09.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.158+0000 7ff3f8673f40 1 -- start start 2024-09-12T02:04:09.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f8673f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c2066a820 0x559c2066cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f8673f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c20595a00 0x559c20653be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f8673f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559c2066d1e0 0x559c2066d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f8673f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559c204e5510 con 0x559c20595a00 2024-09-12T02:04:09.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f8673f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559c2053ec50 con 0x559c2066a820 2024-09-12T02:04:09.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f8673f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x559c20592dc0 con 0x559c2066d1e0 2024-09-12T02:04:09.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f596a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c20595a00 0x559c20653be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f596a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c20595a00 0x559c20653be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45672/0 (socket says 172.21.15.19:45672) 2024-09-12T02:04:09.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f596a640 1 -- 172.21.15.19:0/406165499 learned_addr learned my addr 172.21.15.19:0/406165499 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:09.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f696c640 1 --2- 172.21.15.19:0/406165499 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559c2066d1e0 0x559c2066d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f616b640 1 --2- 172.21.15.19:0/406165499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c2066a820 0x559c2066cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f596a640 1 -- 172.21.15.19:0/406165499 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559c2066d1e0 msgr2=0x559c2066d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:09.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f596a640 1 --2- 172.21.15.19:0/406165499 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559c2066d1e0 0x559c2066d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f596a640 1 -- 172.21.15.19:0/406165499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c2066a820 msgr2=0x559c2066cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:09.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f596a640 1 --2- 172.21.15.19:0/406165499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c2066a820 0x559c2066cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f596a640 1 -- 172.21.15.19:0/406165499 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c205d8090 con 0x559c20595a00 2024-09-12T02:04:09.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f596a640 1 --2- 172.21.15.19:0/406165499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c20595a00 0x559c20653be0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00e300 tx=0x7ff3ec00e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1c1d2ce10fde2a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:09.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f4968640 1 -- 172.21.15.19:0/406165499 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec001b80 con 0x559c20595a00 2024-09-12T02:04:09.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f4968640 1 -- 172.21.15.19:0/406165499 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ec001d20 con 0x559c20595a00 2024-09-12T02:04:09.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.159+0000 7ff3f4968640 1 -- 172.21.15.19:0/406165499 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec002250 con 0x559c20595a00 2024-09-12T02:04:09.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.160+0000 7ff3f8673f40 1 -- 172.21.15.19:0/406165499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c20595a00 msgr2=0x559c20653be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.160+0000 7ff3f8673f40 1 --2- 172.21.15.19:0/406165499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c20595a00 0x559c20653be0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00e300 tx=0x7ff3ec00e7c0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.160+0000 7ff3f8673f40 1 -- 172.21.15.19:0/406165499 shutdown_connections 2024-09-12T02:04:09.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.160+0000 7ff3f8673f40 1 --2- 172.21.15.19:0/406165499 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559c2066d1e0 0x559c2066d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.160+0000 7ff3f8673f40 1 --2- 172.21.15.19:0/406165499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c20595a00 0x559c20653be0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.160+0000 7ff3f8673f40 1 --2- 172.21.15.19:0/406165499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c2066a820 0x559c2066cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.160+0000 7ff3f8673f40 1 -- 172.21.15.19:0/406165499 >> 172.21.15.19:0/406165499 conn(0x559c205939e0 msgr2=0x559c205da450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:09.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.160+0000 7ff3f8673f40 1 -- 172.21.15.19:0/406165499 shutdown_connections 2024-09-12T02:04:09.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.160+0000 7ff3f8673f40 1 -- 172.21.15.19:0/406165499 wait complete. 2024-09-12T02:04:09.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.160+0000 7ff3f8673f40 1 Processor -- start 2024-09-12T02:04:09.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.160+0000 7ff3f8673f40 1 -- start start 2024-09-12T02:04:09.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.161+0000 7ff3f8673f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c20595a00 0x559c206f9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.161+0000 7ff3f8673f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c2066a820 0x559c206490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.161+0000 7ff3f8673f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559c2066d1e0 0x559c20702360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.161+0000 7ff3f8673f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559c205d7db0 con 0x559c2066a820 2024-09-12T02:04:09.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.161+0000 7ff3f8673f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559c205d7ad0 con 0x559c20595a00 2024-09-12T02:04:09.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.161+0000 7ff3f8673f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x559c2066c6d0 con 0x559c2066d1e0 2024-09-12T02:04:09.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.161+0000 7ff3f596a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c2066a820 0x559c206490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.161+0000 7ff3f596a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c2066a820 0x559c206490a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45676/0 (socket says 172.21.15.19:45676) 2024-09-12T02:04:09.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.161+0000 7ff3f596a640 1 -- 172.21.15.19:0/2486629172 learned_addr learned my addr 172.21.15.19:0/2486629172 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:09.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.161+0000 7ff3f616b640 1 --2- 172.21.15.19:0/2486629172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c20595a00 0x559c206f9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.161+0000 7ff3f696c640 1 --2- 172.21.15.19:0/2486629172 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559c2066d1e0 0x559c20702360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.162+0000 7ff3f596a640 1 -- 172.21.15.19:0/2486629172 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559c2066d1e0 msgr2=0x559c20702360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.162+0000 7ff3f596a640 1 --2- 172.21.15.19:0/2486629172 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559c2066d1e0 0x559c20702360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.162+0000 7ff3f596a640 1 -- 172.21.15.19:0/2486629172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c20595a00 msgr2=0x559c206f9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.162+0000 7ff3f596a640 1 --2- 172.21.15.19:0/2486629172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c20595a00 0x559c206f9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.162+0000 7ff3f596a640 1 -- 172.21.15.19:0/2486629172 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c206fa1f0 con 0x559c2066a820 2024-09-12T02:04:09.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.162+0000 7ff3f596a640 1 --2- 172.21.15.19:0/2486629172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c2066a820 0x559c206490a0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00e2d0 tx=0x7ff3ec001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:09.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.162+0000 7ff3e77fe640 1 -- 172.21.15.19:0/2486629172 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec001b80 con 0x559c2066a820 2024-09-12T02:04:09.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.162+0000 7ff3e77fe640 1 -- 172.21.15.19:0/2486629172 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ec000ed0 con 0x559c2066a820 2024-09-12T02:04:09.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.162+0000 7ff3f8673f40 1 -- 172.21.15.19:0/2486629172 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c205d8f80 con 0x559c2066a820 2024-09-12T02:04:09.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.162+0000 7ff3e77fe640 1 -- 172.21.15.19:0/2486629172 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec011ac0 con 0x559c2066a820 2024-09-12T02:04:09.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.162+0000 7ff3f8673f40 1 -- 172.21.15.19:0/2486629172 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c205d9540 con 0x559c2066a820 2024-09-12T02:04:09.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.163+0000 7ff3e77fe640 1 -- 172.21.15.19:0/2486629172 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3ec011c60 con 0x559c2066a820 2024-09-12T02:04:09.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.164+0000 7ff3e77fe640 1 --2- 172.21.15.19:0/2486629172 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3d806a810 0x7ff3d806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.164+0000 7ff3e77fe640 1 -- 172.21.15.19:0/2486629172 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 7507+0+0 (secure 0 0 0) 0x7ff3ec08bb90 con 0x559c2066a820 2024-09-12T02:04:09.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.164+0000 7ff3f616b640 1 --2- 172.21.15.19:0/2486629172 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3d806a810 0x7ff3d806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.164+0000 7ff3f8673f40 1 --2- 172.21.15.19:0/2486629172 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559c2064c320 0x559c205d9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.164+0000 7ff3f8673f40 1 -- 172.21.15.19:0/2486629172 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:1 13.14 13:287034c4:::1.00000000.inode:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x559c205d9fa0 con 0x559c2064c320 2024-09-12T02:04:09.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.164+0000 7ff3f696c640 1 --2- 172.21.15.19:0/2486629172 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559c2064c320 0x559c205d9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.164+0000 7ff3f616b640 1 --2- 172.21.15.19:0/2486629172 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3d806a810 0x7ff3d806ccd0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8055000 tx=0x7ff3e8006000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:09.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.165+0000 7ff3f696c640 1 --2- 172.21.15.19:0/2486629172 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559c2064c320 0x559c205d9a60 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:09.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.166+0000 7ff3f696c640 1 -- 172.21.15.19:0/2486629172 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(1 1.00000000.inode [writefull 0~80] v109'352 uv352 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ff3f0009770 con 0x559c2064c320 2024-09-12T02:04:09.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.166+0000 7ff3f8673f40 1 -- 172.21.15.19:0/2486629172 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559c2064c320 msgr2=0x559c205d9a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.166+0000 7ff3f8673f40 1 --2- 172.21.15.19:0/2486629172 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559c2064c320 0x559c205d9a60 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.166+0000 7ff3f8673f40 1 -- 172.21.15.19:0/2486629172 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3d806a810 msgr2=0x7ff3d806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.166+0000 7ff3f8673f40 1 --2- 172.21.15.19:0/2486629172 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3d806a810 0x7ff3d806ccd0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8055000 tx=0x7ff3e8006000 comp rx=0 tx=0).stop 2024-09-12T02:04:09.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.166+0000 7ff3f8673f40 1 -- 172.21.15.19:0/2486629172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c2066a820 msgr2=0x559c206490a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.166+0000 7ff3f8673f40 1 --2- 172.21.15.19:0/2486629172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c2066a820 0x559c206490a0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00e2d0 tx=0x7ff3ec001190 comp rx=0 tx=0).stop 2024-09-12T02:04:09.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.166+0000 7ff3f696c640 1 -- 172.21.15.19:0/2486629172 reap_dead start 2024-09-12T02:04:09.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.166+0000 7ff3f8673f40 1 -- 172.21.15.19:0/2486629172 shutdown_connections 2024-09-12T02:04:09.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.166+0000 7ff3f8673f40 1 -- 172.21.15.19:0/2486629172 >> 172.21.15.19:0/2486629172 conn(0x559c205939e0 msgr2=0x559c20667610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:09.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.166+0000 7ff3f8673f40 1 -- 172.21.15.19:0/2486629172 shutdown_connections 2024-09-12T02:04:09.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.166+0000 7ff3f8673f40 1 -- 172.21.15.19:0/2486629172 wait complete. 2024-09-12T02:04:09.172 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:04:09.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.315+0000 7f9029711640 1 Processor -- start 2024-09-12T02:04:09.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.316+0000 7f9029711640 1 -- start start 2024-09-12T02:04:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.316+0000 7f9029711640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9024162340 0x7f902406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.316+0000 7f9029711640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9024162e30 0x7f90240d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.316+0000 7f9029711640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f902415ff70 con 0x7f90240cf280 2024-09-12T02:04:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.316+0000 7f9029711640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f902406de90 con 0x7f9024162340 2024-09-12T02:04:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.316+0000 7f9029711640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f90240d4d10 con 0x7f9024162e30 2024-09-12T02:04:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.316+0000 7f9022ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9024162340 0x7f902406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.317+0000 7f90227fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f90240cf280 0x7f9024162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55960/0 (socket says 172.21.15.19:55960) 2024-09-12T02:04:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.317+0000 7f9022ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9024162340 0x7f902406d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45688/0 (socket says 172.21.15.19:45688) 2024-09-12T02:04:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.317+0000 7f90227fc640 1 -- 172.21.15.19:0/1792415919 learned_addr learned my addr 172.21.15.19:0/1792415919 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.317+0000 7f90237fe640 1 --2- 172.21.15.19:0/1792415919 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9024162e30 0x7f90240d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.317+0000 7f9022ffd640 1 -- 172.21.15.19:0/1792415919 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9024162e30 msgr2=0x7f90240d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.317+0000 7f9022ffd640 1 --2- 172.21.15.19:0/1792415919 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9024162e30 0x7f90240d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.317+0000 7f9022ffd640 1 -- 172.21.15.19:0/1792415919 >> v1:172.21.15.19:6789/0 conn(0x7f90240cf280 legacy=0x7f9024162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.317+0000 7f9022ffd640 1 -- 172.21.15.19:0/1792415919 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90240d4ff0 con 0x7f9024162340 2024-09-12T02:04:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.317+0000 7f9021ffb640 1 -- 172.21.15.19:0/1792415919 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1225133619 0 0) 0x7f902415ff70 con 0x7f90240cf280 2024-09-12T02:04:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.318+0000 7f9022ffd640 1 --2- 172.21.15.19:0/1792415919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9024162340 0x7f902406d740 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f9014009d90 tx=0x7f901402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b21f92eba577f42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.318+0000 7f9021ffb640 1 -- 172.21.15.19:0/1792415919 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014031600 con 0x7f9024162340 2024-09-12T02:04:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.318+0000 7f9021ffb640 1 -- 172.21.15.19:0/1792415919 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90140317a0 con 0x7f9024162340 2024-09-12T02:04:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.318+0000 7f9021ffb640 1 -- 172.21.15.19:0/1792415919 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014031b70 con 0x7f9024162340 2024-09-12T02:04:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.318+0000 7f9029711640 1 -- 172.21.15.19:0/1792415919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9024162340 msgr2=0x7f902406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.318+0000 7f9029711640 1 --2- 172.21.15.19:0/1792415919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9024162340 0x7f902406d740 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f9014009d90 tx=0x7f901402a5d0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.318+0000 7f9029711640 1 -- 172.21.15.19:0/1792415919 shutdown_connections 2024-09-12T02:04:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.318+0000 7f9029711640 1 --2- 172.21.15.19:0/1792415919 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9024162e30 0x7f90240d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.318+0000 7f9029711640 1 --2- 172.21.15.19:0/1792415919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9024162340 0x7f902406d740 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.318+0000 7f9029711640 1 -- 172.21.15.19:0/1792415919 >> 172.21.15.19:0/1792415919 conn(0x7f902408bfc0 msgr2=0x7f90240d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:09.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.318+0000 7f9029711640 1 -- 172.21.15.19:0/1792415919 shutdown_connections 2024-09-12T02:04:09.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.318+0000 7f9029711640 1 -- 172.21.15.19:0/1792415919 wait complete. 2024-09-12T02:04:09.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.320+0000 7f9029711640 1 Processor -- start 2024-09-12T02:04:09.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.320+0000 7f9029711640 1 -- start start 2024-09-12T02:04:09.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.320+0000 7f9029711640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90240cf280 0x7f90240c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.320+0000 7f9029711640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9024162340 0x7f90240b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.320+0000 7f9029711640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9024162e30 0x7f902414b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.320+0000 7f9029711640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f90240cf6c0 con 0x7f9024162e30 2024-09-12T02:04:09.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.320+0000 7f9029711640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f90240d52d0 con 0x7f9024162340 2024-09-12T02:04:09.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.320+0000 7f9029711640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f90240d2ed0 con 0x7f90240cf280 2024-09-12T02:04:09.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.321+0000 7f90237fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9024162e30 0x7f902414b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.321+0000 7f90237fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9024162e30 0x7f902414b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45704/0 (socket says 172.21.15.19:45704) 2024-09-12T02:04:09.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.321+0000 7f90237fe640 1 -- 172.21.15.19:0/1014237061 learned_addr learned my addr 172.21.15.19:0/1014237061 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:09.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.321+0000 7f9022ffd640 1 --2- 172.21.15.19:0/1014237061 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90240cf280 0x7f90240c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.321+0000 7f90227fc640 1 --2- 172.21.15.19:0/1014237061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9024162340 0x7f90240b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.321+0000 7f90237fe640 1 -- 172.21.15.19:0/1014237061 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90240cf280 msgr2=0x7f90240c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.321+0000 7f90237fe640 1 --2- 172.21.15.19:0/1014237061 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90240cf280 0x7f90240c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.321+0000 7f90237fe640 1 -- 172.21.15.19:0/1014237061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9024162340 msgr2=0x7f90240b7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.321+0000 7f90237fe640 1 --2- 172.21.15.19:0/1014237061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9024162340 0x7f90240b7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.321+0000 7f90237fe640 1 -- 172.21.15.19:0/1014237061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90240b8510 con 0x7f9024162e30 2024-09-12T02:04:09.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.321+0000 7f90237fe640 1 --2- 172.21.15.19:0/1014237061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9024162e30 0x7f902414b6d0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f901c00e7f0 tx=0x7f901c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:09.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.321+0000 7f901b7fe640 1 -- 172.21.15.19:0/1014237061 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901c017070 con 0x7f9024162e30 2024-09-12T02:04:09.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.321+0000 7f901b7fe640 1 -- 172.21.15.19:0/1014237061 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f901c00ee40 con 0x7f9024162e30 2024-09-12T02:04:09.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.321+0000 7f901b7fe640 1 -- 172.21.15.19:0/1014237061 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901c00cb80 con 0x7f9024162e30 2024-09-12T02:04:09.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.321+0000 7f9029711640 1 -- 172.21.15.19:0/1014237061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90240b87f0 con 0x7f9024162e30 2024-09-12T02:04:09.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.321+0000 7f9029711640 1 -- 172.21.15.19:0/1014237061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90240b8db0 con 0x7f9024162e30 2024-09-12T02:04:09.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.322+0000 7f9029711640 1 -- 172.21.15.19:0/1014237061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90240d2990 con 0x7f9024162e30 2024-09-12T02:04:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.323+0000 7f901b7fe640 1 -- 172.21.15.19:0/1014237061 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f901c01a070 con 0x7f9024162e30 2024-09-12T02:04:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.323+0000 7f901b7fe640 1 --2- 172.21.15.19:0/1014237061 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f900406be30 0x7f900406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.323+0000 7f901b7fe640 1 -- 172.21.15.19:0/1014237061 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 7507+0+0 (secure 0 0 0) 0x7f901c08b790 con 0x7f9024162e30 2024-09-12T02:04:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.323+0000 7f9022ffd640 1 --2- 172.21.15.19:0/1014237061 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f900406be30 0x7f900406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.324+0000 7f9022ffd640 1 --2- 172.21.15.19:0/1014237061 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f900406be30 0x7f900406e2f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9014034000 tx=0x7f901402f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.328+0000 7f901b7fe640 1 -- 172.21.15.19:0/1014237061 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f901c059360 con 0x7f9024162e30 2024-09-12T02:04:09.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.540+0000 7f9029711640 1 -- 172.21.15.19:0/1014237061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f902408e640 con 0x7f9024162e30 2024-09-12T02:04:09.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.892+0000 7f901b7fe640 1 -- 172.21.15.19:0/1014237061 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v169) ==== 162+0+0 (secure 0 0 0) 0x7f901c05d660 con 0x7f9024162e30 2024-09-12T02:04:09.893 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:04:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.895+0000 7f9029711640 1 -- 172.21.15.19:0/1014237061 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f900406be30 msgr2=0x7f900406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.895+0000 7f9029711640 1 --2- 172.21.15.19:0/1014237061 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f900406be30 0x7f900406e2f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9014034000 tx=0x7f901402f000 comp rx=0 tx=0).stop 2024-09-12T02:04:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.895+0000 7f9029711640 1 -- 172.21.15.19:0/1014237061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9024162e30 msgr2=0x7f902414b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.895+0000 7f9029711640 1 --2- 172.21.15.19:0/1014237061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9024162e30 0x7f902414b6d0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f901c00e7f0 tx=0x7f901c00ebf0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.895+0000 7f9029711640 1 -- 172.21.15.19:0/1014237061 shutdown_connections 2024-09-12T02:04:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.895+0000 7f9029711640 1 --2- 172.21.15.19:0/1014237061 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f900406be30 0x7f900406e2f0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.895+0000 7f9029711640 1 --2- 172.21.15.19:0/1014237061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9024162e30 0x7f902414b6d0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.895+0000 7f9029711640 1 --2- 172.21.15.19:0/1014237061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9024162340 0x7f90240b7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.895+0000 7f9029711640 1 --2- 172.21.15.19:0/1014237061 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90240cf280 0x7f90240c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.895+0000 7f9029711640 1 -- 172.21.15.19:0/1014237061 >> 172.21.15.19:0/1014237061 conn(0x7f902408bfc0 msgr2=0x7f90240d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.895+0000 7f9029711640 1 -- 172.21.15.19:0/1014237061 shutdown_connections 2024-09-12T02:04:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:09.895+0000 7f9029711640 1 -- 172.21.15.19:0/1014237061 wait complete. 2024-09-12T02:04:09.905 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:04:09.905+0000 7fd5a6bb8640 -1 mds.0.cache.ino(0x1) Corrupt inode 0x1: End of buffer [buffer:2] 2024-09-12T02:04:09.905 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:04:09.905+0000 7fd5a6bb8640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2024-09-12T02:04:09.906 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:09.906+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:04:09.906 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:09.906+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:04:09.908 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.012+0000 7f1850a5c640 1 Processor -- start 2024-09-12T02:04:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.012+0000 7f1850a5c640 1 -- start start 2024-09-12T02:04:10.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.013+0000 7f1850a5c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f184c15e5f0 0x7f184c0d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.013+0000 7f1850a5c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f184c0b6690 0x7f184c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.013+0000 7f1850a5c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f184c0d3690 con 0x7f184c0d30f0 2024-09-12T02:04:10.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.013+0000 7f1850a5c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f184c06d530 con 0x7f184c0b6690 2024-09-12T02:04:10.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.013+0000 7f1850a5c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f184c0d3970 con 0x7f184c15e5f0 2024-09-12T02:04:10.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.013+0000 7f184ad9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f184c0b6690 0x7f184c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.013+0000 7f1843fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f184c0d30f0 0x7f184c0b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55964/0 (socket says 172.21.15.19:55964) 2024-09-12T02:04:10.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.013+0000 7f1843fff640 1 -- 172.21.15.19:0/597739446 learned_addr learned my addr 172.21.15.19:0/597739446 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:10.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.013+0000 7f184a59c640 1 --2- 172.21.15.19:0/597739446 >> v2:172.21.15.135:3300/0 conn(0x7f184c15e5f0 0x7f184c0d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.013+0000 7f184ad9d640 1 -- 172.21.15.19:0/597739446 >> v2:172.21.15.135:3300/0 conn(0x7f184c15e5f0 msgr2=0x7f184c0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:10.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.013+0000 7f184ad9d640 1 --2- 172.21.15.19:0/597739446 >> v2:172.21.15.135:3300/0 conn(0x7f184c15e5f0 0x7f184c0d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.013+0000 7f184ad9d640 1 -- 172.21.15.19:0/597739446 >> v1:172.21.15.19:6789/0 conn(0x7f184c0d30f0 legacy=0x7f184c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.013+0000 7f1849d9b640 1 -- 172.21.15.19:0/597739446 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 971269738 0 0) 0x7f184c0d3690 con 0x7f184c0d30f0 2024-09-12T02:04:10.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.013+0000 7f184ad9d640 1 -- 172.21.15.19:0/597739446 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184c06cee0 con 0x7f184c0b6690 2024-09-12T02:04:10.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.014+0000 7f184ad9d640 1 --2- 172.21.15.19:0/597739446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f184c0b6690 0x7f184c06d9c0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f1844009d90 tx=0x7f184402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82b9f7d8f3c1ce1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:10.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.014+0000 7f1849d9b640 1 -- 172.21.15.19:0/597739446 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844007740 con 0x7f184c0b6690 2024-09-12T02:04:10.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.014+0000 7f1849d9b640 1 -- 172.21.15.19:0/597739446 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18440078e0 con 0x7f184c0b6690 2024-09-12T02:04:10.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.014+0000 7f1849d9b640 1 -- 172.21.15.19:0/597739446 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844007cb0 con 0x7f184c0b6690 2024-09-12T02:04:10.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.014+0000 7f1850a5c640 1 -- 172.21.15.19:0/597739446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f184c0b6690 msgr2=0x7f184c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.014+0000 7f1850a5c640 1 --2- 172.21.15.19:0/597739446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f184c0b6690 0x7f184c06d9c0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f1844009d90 tx=0x7f184402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.015+0000 7f1850a5c640 1 -- 172.21.15.19:0/597739446 shutdown_connections 2024-09-12T02:04:10.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.015+0000 7f1850a5c640 1 --2- 172.21.15.19:0/597739446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f184c0b6690 0x7f184c06d9c0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.015+0000 7f1850a5c640 1 --2- 172.21.15.19:0/597739446 >> v2:172.21.15.135:3300/0 conn(0x7f184c15e5f0 0x7f184c0d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.015+0000 7f1850a5c640 1 -- 172.21.15.19:0/597739446 >> 172.21.15.19:0/597739446 conn(0x7f184c08bfc0 msgr2=0x7f184c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:10.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.015+0000 7f1850a5c640 1 -- 172.21.15.19:0/597739446 shutdown_connections 2024-09-12T02:04:10.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.015+0000 7f1850a5c640 1 -- 172.21.15.19:0/597739446 wait complete. 2024-09-12T02:04:10.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.016+0000 7f1850a5c640 1 Processor -- start 2024-09-12T02:04:10.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.016+0000 7f1850a5c640 1 -- start start 2024-09-12T02:04:10.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1850a5c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f184c0b6690 0x7f184c14fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1850a5c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f184c0d30f0 0x7f184c159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1850a5c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f184c15e5f0 0x7f184c0b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1850a5c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f184c0d5310 con 0x7f184c0d30f0 2024-09-12T02:04:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1850a5c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f184c15e9d0 con 0x7f184c15e5f0 2024-09-12T02:04:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1850a5c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f184c06df00 con 0x7f184c0b6690 2024-09-12T02:04:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1843fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f184c0d30f0 0x7f184c159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1843fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f184c0d30f0 0x7f184c159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45716/0 (socket says 172.21.15.19:45716) 2024-09-12T02:04:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1843fff640 1 -- 172.21.15.19:0/3594596263 learned_addr learned my addr 172.21.15.19:0/3594596263 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f184ad9d640 1 --2- 172.21.15.19:0/3594596263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f184c15e5f0 0x7f184c0b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f184a59c640 1 --2- 172.21.15.19:0/3594596263 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f184c0b6690 0x7f184c14fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1843fff640 1 -- 172.21.15.19:0/3594596263 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f184c0b6690 msgr2=0x7f184c14fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1843fff640 1 --2- 172.21.15.19:0/3594596263 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f184c0b6690 0x7f184c14fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1843fff640 1 -- 172.21.15.19:0/3594596263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f184c15e5f0 msgr2=0x7f184c0b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1843fff640 1 --2- 172.21.15.19:0/3594596263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f184c15e5f0 0x7f184c0b45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1843fff640 1 -- 172.21.15.19:0/3594596263 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184c159b90 con 0x7f184c0d30f0 2024-09-12T02:04:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f184ad9d640 1 --2- 172.21.15.19:0/3594596263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f184c15e5f0 0x7f184c0b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f184a59c640 1 --2- 172.21.15.19:0/3594596263 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f184c0b6690 0x7f184c14fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1843fff640 1 --2- 172.21.15.19:0/3594596263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f184c0d30f0 0x7f184c159220 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f183400c4d0 tx=0x7f183400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1842ffd640 1 -- 172.21.15.19:0/3594596263 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834018070 con 0x7f184c0d30f0 2024-09-12T02:04:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1842ffd640 1 -- 172.21.15.19:0/3594596263 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1834007500 con 0x7f184c0d30f0 2024-09-12T02:04:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1850a5c640 1 -- 172.21.15.19:0/3594596263 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f184c159e70 con 0x7f184c0d30f0 2024-09-12T02:04:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1842ffd640 1 -- 172.21.15.19:0/3594596263 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834004a20 con 0x7f184c0d30f0 2024-09-12T02:04:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.017+0000 7f1850a5c640 1 -- 172.21.15.19:0/3594596263 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f184c15a430 con 0x7f184c0d30f0 2024-09-12T02:04:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.018+0000 7f1850a5c640 1 -- 172.21.15.19:0/3594596263 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f184c06d9c0 con 0x7f184c0d30f0 2024-09-12T02:04:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.019+0000 7f1842ffd640 1 -- 172.21.15.19:0/3594596263 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f183401b070 con 0x7f184c0d30f0 2024-09-12T02:04:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.019+0000 7f1842ffd640 1 --2- 172.21.15.19:0/3594596263 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f182c06be60 0x7f182c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.019+0000 7f1842ffd640 1 -- 172.21.15.19:0/3594596263 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 7593+0+0 (secure 0 0 0) 0x7f183408a840 con 0x7f184c0d30f0 2024-09-12T02:04:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.020+0000 7f184a59c640 1 --2- 172.21.15.19:0/3594596263 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f182c06be60 0x7f182c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.020+0000 7f184a59c640 1 --2- 172.21.15.19:0/3594596263 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f182c06be60 0x7f182c06e320 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f183c006fd0 tx=0x7f183c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:10.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.024+0000 7f1842ffd640 1 -- 172.21.15.19:0/3594596263 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1834058b20 con 0x7f184c0d30f0 2024-09-12T02:04:10.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.234+0000 7f1850a5c640 1 -- 172.21.15.19:0/3594596263 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f184c06ebb0 con 0x7f184c0d30f0 2024-09-12T02:04:10.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.235+0000 7f1842ffd640 1 -- 172.21.15.19:0/3594596263 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 171 v171) ==== 95+0+4389 (secure 0 0 0) 0x7f1834058420 con 0x7f184c0d30f0 2024-09-12T02:04:10.235 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:10.235 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":171,"btime":"2024-09-12T02:04:09:907188+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7001,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/926329492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":926329492},{"type":"v1","addr":"172.21.15.135:6837","nonce":926329492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":168}],"filesystems":[{"mdsmap":{"epoch":171,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:09.907131+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:10.236 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 171 2024-09-12T02:04:10.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.236+0000 7f1850a5c640 1 -- 172.21.15.19:0/3594596263 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f182c06be60 msgr2=0x7f182c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.236+0000 7f1850a5c640 1 --2- 172.21.15.19:0/3594596263 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f182c06be60 0x7f182c06e320 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f183c006fd0 tx=0x7f183c008040 comp rx=0 tx=0).stop 2024-09-12T02:04:10.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.236+0000 7f1850a5c640 1 -- 172.21.15.19:0/3594596263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f184c0d30f0 msgr2=0x7f184c159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.236+0000 7f1850a5c640 1 --2- 172.21.15.19:0/3594596263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f184c0d30f0 0x7f184c159220 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f183400c4d0 tx=0x7f183400c990 comp rx=0 tx=0).stop 2024-09-12T02:04:10.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.237+0000 7f1850a5c640 1 -- 172.21.15.19:0/3594596263 shutdown_connections 2024-09-12T02:04:10.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.237+0000 7f1850a5c640 1 --2- 172.21.15.19:0/3594596263 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f182c06be60 0x7f182c06e320 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.237+0000 7f1850a5c640 1 --2- 172.21.15.19:0/3594596263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f184c15e5f0 0x7f184c0b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.237+0000 7f1850a5c640 1 --2- 172.21.15.19:0/3594596263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f184c0d30f0 0x7f184c159220 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.237+0000 7f1850a5c640 1 --2- 172.21.15.19:0/3594596263 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f184c0b6690 0x7f184c14fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.237+0000 7f1850a5c640 1 -- 172.21.15.19:0/3594596263 >> 172.21.15.19:0/3594596263 conn(0x7f184c08bfc0 msgr2=0x7f184c0b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:10.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.237+0000 7f1850a5c640 1 -- 172.21.15.19:0/3594596263 shutdown_connections 2024-09-12T02:04:10.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.237+0000 7f1850a5c640 1 -- 172.21.15.19:0/3594596263 wait complete. 2024-09-12T02:04:10.248 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:10.248 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:10.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.352+0000 7f93bd877640 1 Processor -- start 2024-09-12T02:04:10.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.352+0000 7f93bd877640 1 -- start start 2024-09-12T02:04:10.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.352+0000 7f93bd877640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93b815e5d0 0x7f93b80d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.352+0000 7f93bd877640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f93b806df60 0x7f93b809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.352+0000 7f93bd877640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93b806cec0 con 0x7f93b80d1630 2024-09-12T02:04:10.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.352+0000 7f93bd877640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f93b806dad0 con 0x7f93b806df60 2024-09-12T02:04:10.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.352+0000 7f93bd877640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f93b806d1a0 con 0x7f93b815e5d0 2024-09-12T02:04:10.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.353+0000 7f93b77fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f93b80d1630 0x7f93b8162230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55972/0 (socket says 172.21.15.19:55972) 2024-09-12T02:04:10.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.353+0000 7f93b77fe640 1 -- 172.21.15.19:0/3354600878 learned_addr learned my addr 172.21.15.19:0/3354600878 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:10.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.353+0000 7f93b6ffd640 1 --2- 172.21.15.19:0/3354600878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93b815e5d0 0x7f93b80d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.353+0000 7f93b67fc640 1 --2- 172.21.15.19:0/3354600878 >> v2:172.21.15.135:3300/0 conn(0x7f93b806df60 0x7f93b809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.353+0000 7f93b5ffb640 1 -- 172.21.15.19:0/3354600878 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 918703004 0 0) 0x7f93b806cec0 con 0x7f93b80d1630 2024-09-12T02:04:10.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.353+0000 7f93b5ffb640 1 -- 172.21.15.19:0/3354600878 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93a0003520 con 0x7f93b80d1630 2024-09-12T02:04:10.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.353+0000 7f93b6ffd640 1 -- 172.21.15.19:0/3354600878 >> v2:172.21.15.135:3300/0 conn(0x7f93b806df60 msgr2=0x7f93b809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:10.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.353+0000 7f93b6ffd640 1 --2- 172.21.15.19:0/3354600878 >> v2:172.21.15.135:3300/0 conn(0x7f93b806df60 0x7f93b809aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.353+0000 7f93b6ffd640 1 -- 172.21.15.19:0/3354600878 >> v1:172.21.15.19:6789/0 conn(0x7f93b80d1630 legacy=0x7f93b8162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.353+0000 7f93b5ffb640 1 -- 172.21.15.19:0/3354600878 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1661370326 0 0) 0x7f93a0003520 con 0x7f93b80d1630 2024-09-12T02:04:10.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.353+0000 7f93b6ffd640 1 -- 172.21.15.19:0/3354600878 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b806d480 con 0x7f93b815e5d0 2024-09-12T02:04:10.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.353+0000 7f93b67fc640 1 --2- 172.21.15.19:0/3354600878 >> v2:172.21.15.135:3300/0 conn(0x7f93b806df60 0x7f93b809aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:10.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.354+0000 7f93b6ffd640 1 --2- 172.21.15.19:0/3354600878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93b815e5d0 0x7f93b80d10f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f93a80097a0 tx=0x7f93a802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dbc162fd7ba609f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:10.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.354+0000 7f93b5ffb640 1 -- 172.21.15.19:0/3354600878 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a8037070 con 0x7f93b815e5d0 2024-09-12T02:04:10.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.354+0000 7f93b5ffb640 1 -- 172.21.15.19:0/3354600878 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93a8032440 con 0x7f93b815e5d0 2024-09-12T02:04:10.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.354+0000 7f93b5ffb640 1 -- 172.21.15.19:0/3354600878 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a80327f0 con 0x7f93b815e5d0 2024-09-12T02:04:10.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.355+0000 7f93bd877640 1 -- 172.21.15.19:0/3354600878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93b815e5d0 msgr2=0x7f93b80d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.355+0000 7f93bd877640 1 --2- 172.21.15.19:0/3354600878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93b815e5d0 0x7f93b80d10f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f93a80097a0 tx=0x7f93a802a210 comp rx=0 tx=0).stop 2024-09-12T02:04:10.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.355+0000 7f93bd877640 1 -- 172.21.15.19:0/3354600878 shutdown_connections 2024-09-12T02:04:10.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.355+0000 7f93bd877640 1 --2- 172.21.15.19:0/3354600878 >> v2:172.21.15.135:3300/0 conn(0x7f93b806df60 0x7f93b809aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.355+0000 7f93bd877640 1 --2- 172.21.15.19:0/3354600878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93b815e5d0 0x7f93b80d10f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.355+0000 7f93bd877640 1 -- 172.21.15.19:0/3354600878 >> 172.21.15.19:0/3354600878 conn(0x7f93b80d23a0 msgr2=0x7f93b80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:10.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.355+0000 7f93bd877640 1 -- 172.21.15.19:0/3354600878 shutdown_connections 2024-09-12T02:04:10.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.355+0000 7f93bd877640 1 -- 172.21.15.19:0/3354600878 wait complete. 2024-09-12T02:04:10.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.356+0000 7f93bd877640 1 Processor -- start 2024-09-12T02:04:10.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.356+0000 7f93bd877640 1 -- start start 2024-09-12T02:04:10.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f93bd877640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93b806df60 0x7f93b8150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f93bd877640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b80d1630 0x7f93b80b6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f93bd877640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93b815e5d0 0x7f93b80b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f93bd877640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f93b815eb30 con 0x7f93b815e5d0 2024-09-12T02:04:10.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f93bd877640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93b815e9b0 con 0x7f93b80d1630 2024-09-12T02:04:10.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f93bd877640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f93b809af70 con 0x7f93b806df60 2024-09-12T02:04:10.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f93b77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93b815e5d0 0x7f93b80b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f93b77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93b815e5d0 0x7f93b80b6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45728/0 (socket says 172.21.15.19:45728) 2024-09-12T02:04:10.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f93b77fe640 1 -- 172.21.15.19:0/4273740255 learned_addr learned my addr 172.21.15.19:0/4273740255 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:10.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f93b67fc640 1 --2- 172.21.15.19:0/4273740255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b80d1630 0x7f93b80b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f93b6ffd640 1 --2- 172.21.15.19:0/4273740255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93b806df60 0x7f93b8150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f93b77fe640 1 -- 172.21.15.19:0/4273740255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93b806df60 msgr2=0x7f93b8150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f93b77fe640 1 --2- 172.21.15.19:0/4273740255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93b806df60 0x7f93b8150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f93b77fe640 1 -- 172.21.15.19:0/4273740255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b80d1630 msgr2=0x7f93b80b6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f93b77fe640 1 --2- 172.21.15.19:0/4273740255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b80d1630 0x7f93b80b6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f93b77fe640 1 -- 172.21.15.19:0/4273740255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b80b0c10 con 0x7f93b815e5d0 2024-09-12T02:04:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f93b67fc640 1 --2- 172.21.15.19:0/4273740255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b80d1630 0x7f93b80b6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f93b77fe640 1 --2- 172.21.15.19:0/4273740255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93b815e5d0 0x7f93b80b6cb0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f93b000cb10 tx=0x7f93b000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.357+0000 7f939ffff640 1 -- 172.21.15.19:0/4273740255 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b000ac70 con 0x7f93b815e5d0 2024-09-12T02:04:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.358+0000 7f939ffff640 1 -- 172.21.15.19:0/4273740255 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93b000ae30 con 0x7f93b815e5d0 2024-09-12T02:04:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.358+0000 7f93bd877640 1 -- 172.21.15.19:0/4273740255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b81e8160 con 0x7f93b815e5d0 2024-09-12T02:04:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.358+0000 7f939ffff640 1 -- 172.21.15.19:0/4273740255 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b0012600 con 0x7f93b815e5d0 2024-09-12T02:04:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.358+0000 7f93bd877640 1 -- 172.21.15.19:0/4273740255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b81e8720 con 0x7f93b815e5d0 2024-09-12T02:04:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.359+0000 7f93bd877640 1 -- 172.21.15.19:0/4273740255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b809aa30 con 0x7f93b815e5d0 2024-09-12T02:04:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.359+0000 7f939ffff640 1 -- 172.21.15.19:0/4273740255 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f93b00127a0 con 0x7f93b815e5d0 2024-09-12T02:04:10.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.360+0000 7f939ffff640 1 --2- 172.21.15.19:0/4273740255 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93a406be30 0x7f93a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.360+0000 7f939ffff640 1 -- 172.21.15.19:0/4273740255 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 7593+0+0 (secure 0 0 0) 0x7f93b008bcf0 con 0x7f93b815e5d0 2024-09-12T02:04:10.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.360+0000 7f93b6ffd640 1 --2- 172.21.15.19:0/4273740255 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93a406be30 0x7f93a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.360+0000 7f93b6ffd640 1 --2- 172.21.15.19:0/4273740255 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93a406be30 0x7f93a406e2f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f93a8034000 tx=0x7f93a802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:10.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.364+0000 7f939ffff640 1 -- 172.21.15.19:0/4273740255 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f93b0090070 con 0x7f93b815e5d0 2024-09-12T02:04:10.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.575+0000 7f93bd877640 1 -- 172.21.15.19:0/4273740255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93b80b8320 con 0x7f93b815e5d0 2024-09-12T02:04:10.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.576+0000 7f939ffff640 1 -- 172.21.15.19:0/4273740255 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 171 v171) ==== 95+0+4389 (secure 0 0 0) 0x7f93b0059f40 con 0x7f93b815e5d0 2024-09-12T02:04:10.576 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:10.576 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":171,"btime":"2024-09-12T02:04:09:907188+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7001,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/926329492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":926329492},{"type":"v1","addr":"172.21.15.135:6837","nonce":926329492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":168}],"filesystems":[{"mdsmap":{"epoch":171,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:09.907131+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:10.577 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 171 2024-09-12T02:04:10.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.578+0000 7f93bd877640 1 -- 172.21.15.19:0/4273740255 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93a406be30 msgr2=0x7f93a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.578+0000 7f93bd877640 1 --2- 172.21.15.19:0/4273740255 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93a406be30 0x7f93a406e2f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f93a8034000 tx=0x7f93a802e000 comp rx=0 tx=0).stop 2024-09-12T02:04:10.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.578+0000 7f93bd877640 1 -- 172.21.15.19:0/4273740255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93b815e5d0 msgr2=0x7f93b80b6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.578+0000 7f93bd877640 1 --2- 172.21.15.19:0/4273740255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93b815e5d0 0x7f93b80b6cb0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f93b000cb10 tx=0x7f93b000a060 comp rx=0 tx=0).stop 2024-09-12T02:04:10.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.578+0000 7f93bd877640 1 -- 172.21.15.19:0/4273740255 shutdown_connections 2024-09-12T02:04:10.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.578+0000 7f93bd877640 1 --2- 172.21.15.19:0/4273740255 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93a406be30 0x7f93a406e2f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.578+0000 7f93bd877640 1 --2- 172.21.15.19:0/4273740255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93b815e5d0 0x7f93b80b6cb0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.578+0000 7f93bd877640 1 --2- 172.21.15.19:0/4273740255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b80d1630 0x7f93b80b6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.578+0000 7f93bd877640 1 --2- 172.21.15.19:0/4273740255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93b806df60 0x7f93b8150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.578+0000 7f93bd877640 1 -- 172.21.15.19:0/4273740255 >> 172.21.15.19:0/4273740255 conn(0x7f93b80d23a0 msgr2=0x7f93b80b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:10.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.578+0000 7f93bd877640 1 -- 172.21.15.19:0/4273740255 shutdown_connections 2024-09-12T02:04:10.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.578+0000 7f93bd877640 1 -- 172.21.15.19:0/4273740255 wait complete. 2024-09-12T02:04:10.589 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:10.589 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:10.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.691+0000 7f2396731640 1 Processor -- start 2024-09-12T02:04:10.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.691+0000 7f2396731640 1 -- start start 2024-09-12T02:04:10.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.691+0000 7f2396731640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f239009aa30 0x7f23900b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.691+0000 7f2396731640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23900b3760 0x7f239009ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.691+0000 7f2396731640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f239009b350 con 0x7f239006cd20 2024-09-12T02:04:10.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.691+0000 7f2396731640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f23900d0670 con 0x7f239009aa30 2024-09-12T02:04:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.691+0000 7f2396731640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f23900b2790 con 0x7f23900b3760 2024-09-12T02:04:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.692+0000 7f238ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f239009aa30 0x7f23900b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.692+0000 7f238ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f239009aa30 0x7f23900b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45740/0 (socket says 172.21.15.19:45740) 2024-09-12T02:04:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.692+0000 7f238ffff640 1 -- 172.21.15.19:0/4236415718 learned_addr learned my addr 172.21.15.19:0/4236415718 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.692+0000 7f2387fff640 1 --2- 172.21.15.19:0/4236415718 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23900b3760 0x7f239009ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.692+0000 7f238ffff640 1 -- 172.21.15.19:0/4236415718 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23900b3760 msgr2=0x7f239009ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.692+0000 7f238ffff640 1 --2- 172.21.15.19:0/4236415718 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23900b3760 0x7f239009ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.692+0000 7f238ffff640 1 -- 172.21.15.19:0/4236415718 >> v1:172.21.15.135:6789/0 conn(0x7f239006cd20 legacy=0x7f23900d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.692+0000 7f238ffff640 1 -- 172.21.15.19:0/4236415718 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23900b2a70 con 0x7f239009aa30 2024-09-12T02:04:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.693+0000 7f238ffff640 1 --2- 172.21.15.19:0/4236415718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239009aa30 0x7f23900b3030 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f2380009870 tx=0x7f238002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f4f5ccc099547e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.693+0000 7f238f7fe640 1 -- 172.21.15.19:0/4236415718 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2380037070 con 0x7f239009aa30 2024-09-12T02:04:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.693+0000 7f238f7fe640 1 -- 172.21.15.19:0/4236415718 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2380032440 con 0x7f239009aa30 2024-09-12T02:04:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.693+0000 7f238f7fe640 1 -- 172.21.15.19:0/4236415718 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2380032810 con 0x7f239009aa30 2024-09-12T02:04:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.693+0000 7f2396731640 1 -- 172.21.15.19:0/4236415718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239009aa30 msgr2=0x7f23900b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.693+0000 7f2396731640 1 --2- 172.21.15.19:0/4236415718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239009aa30 0x7f23900b3030 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f2380009870 tx=0x7f238002a180 comp rx=0 tx=0).stop 2024-09-12T02:04:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.694+0000 7f2396731640 1 -- 172.21.15.19:0/4236415718 shutdown_connections 2024-09-12T02:04:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.694+0000 7f2396731640 1 --2- 172.21.15.19:0/4236415718 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23900b3760 0x7f239009ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.694+0000 7f2396731640 1 --2- 172.21.15.19:0/4236415718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239009aa30 0x7f23900b3030 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.694+0000 7f2396731640 1 -- 172.21.15.19:0/4236415718 >> 172.21.15.19:0/4236415718 conn(0x7f23900d23a0 msgr2=0x7f23900d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.694+0000 7f2396731640 1 -- 172.21.15.19:0/4236415718 shutdown_connections 2024-09-12T02:04:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.694+0000 7f2396731640 1 -- 172.21.15.19:0/4236415718 wait complete. 2024-09-12T02:04:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.695+0000 7f2396731640 1 Processor -- start 2024-09-12T02:04:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.695+0000 7f2396731640 1 -- start start 2024-09-12T02:04:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.695+0000 7f2396731640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f239006cd20 0x7f23901f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.695+0000 7f2396731640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f239009aa30 0x7f23900cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.695+0000 7f2396731640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23900b3760 0x7f23900cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.695+0000 7f2396731640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f239015fca0 con 0x7f23900b3760 2024-09-12T02:04:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.695+0000 7f2396731640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f23900d08a0 con 0x7f239009aa30 2024-09-12T02:04:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.695+0000 7f2396731640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f239015fe20 con 0x7f239006cd20 2024-09-12T02:04:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.696+0000 7f2394cce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23900b3760 0x7f23900cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.696+0000 7f2394cce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23900b3760 0x7f23900cb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45750/0 (socket says 172.21.15.19:45750) 2024-09-12T02:04:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.696+0000 7f2394cce640 1 -- 172.21.15.19:0/466891281 learned_addr learned my addr 172.21.15.19:0/466891281 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.696+0000 7f2387fff640 1 --2- 172.21.15.19:0/466891281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f239009aa30 0x7f23900cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.696+0000 7f238ffff640 1 --2- 172.21.15.19:0/466891281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f239006cd20 0x7f23901f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.696+0000 7f2394cce640 1 -- 172.21.15.19:0/466891281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f239006cd20 msgr2=0x7f23901f4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.696+0000 7f2394cce640 1 --2- 172.21.15.19:0/466891281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f239006cd20 0x7f23901f4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.696+0000 7f2394cce640 1 -- 172.21.15.19:0/466891281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f239009aa30 msgr2=0x7f23900cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.696+0000 7f2394cce640 1 --2- 172.21.15.19:0/466891281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f239009aa30 0x7f23900cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.696+0000 7f2394cce640 1 -- 172.21.15.19:0/466891281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2390161ea0 con 0x7f23900b3760 2024-09-12T02:04:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.696+0000 7f238ffff640 1 --2- 172.21.15.19:0/466891281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f239006cd20 0x7f23901f4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.696+0000 7f2394cce640 1 --2- 172.21.15.19:0/466891281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23900b3760 0x7f23900cb9c0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f238800b9e0 tx=0x7f238800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.696+0000 7f238d7fa640 1 -- 172.21.15.19:0/466891281 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388003b70 con 0x7f23900b3760 2024-09-12T02:04:10.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.696+0000 7f238d7fa640 1 -- 172.21.15.19:0/466891281 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2388003d10 con 0x7f23900b3760 2024-09-12T02:04:10.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.696+0000 7f238d7fa640 1 -- 172.21.15.19:0/466891281 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238800cb60 con 0x7f23900b3760 2024-09-12T02:04:10.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.696+0000 7f2396731640 1 -- 172.21.15.19:0/466891281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23900ccb00 con 0x7f23900b3760 2024-09-12T02:04:10.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.696+0000 7f2396731640 1 -- 172.21.15.19:0/466891281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f239015ac70 con 0x7f23900b3760 2024-09-12T02:04:10.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.697+0000 7f2396731640 1 -- 172.21.15.19:0/466891281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23900cc7a0 con 0x7f23900b3760 2024-09-12T02:04:10.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.698+0000 7f238d7fa640 1 -- 172.21.15.19:0/466891281 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f238800cd00 con 0x7f23900b3760 2024-09-12T02:04:10.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.699+0000 7f238d7fa640 1 --2- 172.21.15.19:0/466891281 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f237006be30 0x7f237006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.699+0000 7f238d7fa640 1 -- 172.21.15.19:0/466891281 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 7593+0+0 (secure 0 0 0) 0x7f238808b330 con 0x7f23900b3760 2024-09-12T02:04:10.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.699+0000 7f238ffff640 1 --2- 172.21.15.19:0/466891281 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f237006be30 0x7f237006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.699+0000 7f238ffff640 1 --2- 172.21.15.19:0/466891281 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f237006be30 0x7f237006e2f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2380034000 tx=0x7f238002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:10.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.703+0000 7f238d7fa640 1 -- 172.21.15.19:0/466891281 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23900cc7a0 con 0x7f23900b3760 2024-09-12T02:04:10.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.914+0000 7f2396731640 1 -- 172.21.15.19:0/466891281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23900d1fe0 con 0x7f23900b3760 2024-09-12T02:04:10.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.914+0000 7f238d7fa640 1 -- 172.21.15.19:0/466891281 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 171 v171) ==== 95+0+4389 (secure 0 0 0) 0x7f2388058fc0 con 0x7f23900b3760 2024-09-12T02:04:10.915 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:10.915 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":171,"btime":"2024-09-12T02:04:09:907188+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7001,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/926329492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":926329492},{"type":"v1","addr":"172.21.15.135:6837","nonce":926329492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":168}],"filesystems":[{"mdsmap":{"epoch":171,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:09.907131+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:10.915 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 171 2024-09-12T02:04:10.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.916+0000 7f2396731640 1 -- 172.21.15.19:0/466891281 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f237006be30 msgr2=0x7f237006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.916+0000 7f2396731640 1 --2- 172.21.15.19:0/466891281 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f237006be30 0x7f237006e2f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2380034000 tx=0x7f238002e000 comp rx=0 tx=0).stop 2024-09-12T02:04:10.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.916+0000 7f2396731640 1 -- 172.21.15.19:0/466891281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23900b3760 msgr2=0x7f23900cb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.916+0000 7f2396731640 1 --2- 172.21.15.19:0/466891281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23900b3760 0x7f23900cb9c0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f238800b9e0 tx=0x7f238800bea0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.916+0000 7f2396731640 1 -- 172.21.15.19:0/466891281 shutdown_connections 2024-09-12T02:04:10.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.916+0000 7f2396731640 1 --2- 172.21.15.19:0/466891281 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f237006be30 0x7f237006e2f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.916+0000 7f2396731640 1 --2- 172.21.15.19:0/466891281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23900b3760 0x7f23900cb9c0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.916+0000 7f2396731640 1 --2- 172.21.15.19:0/466891281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f239009aa30 0x7f23900cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.916+0000 7f2396731640 1 --2- 172.21.15.19:0/466891281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f239006cd20 0x7f23901f4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.916+0000 7f2396731640 1 -- 172.21.15.19:0/466891281 >> 172.21.15.19:0/466891281 conn(0x7f23900d23a0 msgr2=0x7f23900af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:10.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.916+0000 7f2396731640 1 -- 172.21.15.19:0/466891281 shutdown_connections 2024-09-12T02:04:10.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:10.916+0000 7f2396731640 1 -- 172.21.15.19:0/466891281 wait complete. 2024-09-12T02:04:10.928 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt 1.00000000.inode' led to DAMAGED state 2024-09-12T02:04:10.928 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt 200.00000000' 2024-09-12T02:04:10.928 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:04:10.928 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:04:10.944 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:04:10.944 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:04:10.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:10.945 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:04:11.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:04:11.001 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:04:11.001 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:04:11.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.144+0000 7f5022df6640 1 Processor -- start 2024-09-12T02:04:11.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.144+0000 7f5022df6640 1 -- start start 2024-09-12T02:04:11.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.145+0000 7f5022df6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f501c161c80 0x7f501c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:11.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.145+0000 7f5022df6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f501c162060 0x7f501c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:11.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.145+0000 7f5022df6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f501c06e870 con 0x7f501c0b64b0 2024-09-12T02:04:11.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.145+0000 7f5022df6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f501c06d9f0 con 0x7f501c161c80 2024-09-12T02:04:11.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.145+0000 7f5022df6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f501c06dcd0 con 0x7f501c162060 2024-09-12T02:04:11.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.145+0000 7f5020b92640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f501c161c80 0x7f501c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:11.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.145+0000 7f5020b92640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f501c161c80 0x7f501c06e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57536/0 (socket says 172.21.15.19:57536) 2024-09-12T02:04:11.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.145+0000 7f5020b92640 1 -- 172.21.15.19:0/678202959 learned_addr learned my addr 172.21.15.19:0/678202959 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:11.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.145+0000 7f5021393640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f501c0b64b0 0x7f501c162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49068/0 (socket says 172.21.15.19:49068) 2024-09-12T02:04:11.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.145+0000 7f501bfff640 1 --2- 172.21.15.19:0/678202959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f501c162060 0x7f501c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:11.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.146+0000 7f5020b92640 1 -- 172.21.15.19:0/678202959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f501c162060 msgr2=0x7f501c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:11.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.146+0000 7f5020b92640 1 --2- 172.21.15.19:0/678202959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f501c162060 0x7f501c0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:11.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.146+0000 7f5020b92640 1 -- 172.21.15.19:0/678202959 >> v1:172.21.15.19:6789/0 conn(0x7f501c0b64b0 legacy=0x7f501c162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:11.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.146+0000 7f5020b92640 1 -- 172.21.15.19:0/678202959 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501c06dfb0 con 0x7f501c161c80 2024-09-12T02:04:11.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.146+0000 7f501b7fe640 1 -- 172.21.15.19:0/678202959 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 379791754 0 0) 0x7f5014001490 con 0x7f501c0b64b0 2024-09-12T02:04:11.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.146+0000 7f5020b92640 1 --2- 172.21.15.19:0/678202959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f501c161c80 0x7f501c06e330 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f5004009870 tx=0x7f500402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7195a2e3e79d7ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:11.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.146+0000 7f501b7fe640 1 -- 172.21.15.19:0/678202959 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5004037070 con 0x7f501c161c80 2024-09-12T02:04:11.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.147+0000 7f501b7fe640 1 -- 172.21.15.19:0/678202959 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5004032440 con 0x7f501c161c80 2024-09-12T02:04:11.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.147+0000 7f501b7fe640 1 -- 172.21.15.19:0/678202959 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5004032810 con 0x7f501c161c80 2024-09-12T02:04:11.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.147+0000 7f5022df6640 1 -- 172.21.15.19:0/678202959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f501c161c80 msgr2=0x7f501c06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:11.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.147+0000 7f5022df6640 1 --2- 172.21.15.19:0/678202959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f501c161c80 0x7f501c06e330 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f5004009870 tx=0x7f500402a270 comp rx=0 tx=0).stop 2024-09-12T02:04:11.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.147+0000 7f5022df6640 1 -- 172.21.15.19:0/678202959 shutdown_connections 2024-09-12T02:04:11.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.147+0000 7f5022df6640 1 --2- 172.21.15.19:0/678202959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f501c162060 0x7f501c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:11.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.147+0000 7f5022df6640 1 --2- 172.21.15.19:0/678202959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f501c161c80 0x7f501c06e330 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:11.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.147+0000 7f5022df6640 1 -- 172.21.15.19:0/678202959 >> 172.21.15.19:0/678202959 conn(0x7f501c0d44f0 msgr2=0x7f501c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:11.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.147+0000 7f5022df6640 1 -- 172.21.15.19:0/678202959 shutdown_connections 2024-09-12T02:04:11.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.147+0000 7f5022df6640 1 -- 172.21.15.19:0/678202959 wait complete. 2024-09-12T02:04:11.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.148+0000 7f5022df6640 1 Processor -- start 2024-09-12T02:04:11.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.148+0000 7f5022df6640 1 -- start start 2024-09-12T02:04:11.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.149+0000 7f5022df6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f501c0b64b0 0x7f501c156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:11.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.149+0000 7f5022df6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f501c161c80 0x7f501c0cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:11.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.149+0000 7f5022df6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f501c162060 0x7f501c0b86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:11.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.149+0000 7f5022df6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f501c0d2a10 con 0x7f501c0b64b0 2024-09-12T02:04:11.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.149+0000 7f5022df6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f501c0d2890 con 0x7f501c162060 2024-09-12T02:04:11.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.149+0000 7f5022df6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f501c0b6960 con 0x7f501c161c80 2024-09-12T02:04:11.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.149+0000 7f5020b92640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f501c0b64b0 0x7f501c156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:11.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.149+0000 7f5020b92640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f501c0b64b0 0x7f501c156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57538/0 (socket says 172.21.15.19:57538) 2024-09-12T02:04:11.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.149+0000 7f5020b92640 1 -- 172.21.15.19:0/1750602859 learned_addr learned my addr 172.21.15.19:0/1750602859 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:11.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.149+0000 7f501bfff640 1 --2- 172.21.15.19:0/1750602859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f501c161c80 0x7f501c0cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:11.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.150+0000 7f5021393640 1 --2- 172.21.15.19:0/1750602859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f501c162060 0x7f501c0b86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:11.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.150+0000 7f5020b92640 1 -- 172.21.15.19:0/1750602859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f501c161c80 msgr2=0x7f501c0cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:11.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.150+0000 7f5020b92640 1 --2- 172.21.15.19:0/1750602859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f501c161c80 0x7f501c0cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:11.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.150+0000 7f5020b92640 1 -- 172.21.15.19:0/1750602859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f501c162060 msgr2=0x7f501c0b86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:11.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.150+0000 7f5020b92640 1 --2- 172.21.15.19:0/1750602859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f501c162060 0x7f501c0b86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:11.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.150+0000 7f5020b92640 1 -- 172.21.15.19:0/1750602859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501c159fa0 con 0x7f501c0b64b0 2024-09-12T02:04:11.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.150+0000 7f5020b92640 1 --2- 172.21.15.19:0/1750602859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f501c0b64b0 0x7f501c156330 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f5004009870 tx=0x7f50040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:11.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.150+0000 7f50197fa640 1 -- 172.21.15.19:0/1750602859 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5004041020 con 0x7f501c0b64b0 2024-09-12T02:04:11.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.150+0000 7f50197fa640 1 -- 172.21.15.19:0/1750602859 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50040306c0 con 0x7f501c0b64b0 2024-09-12T02:04:11.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.150+0000 7f5022df6640 1 -- 172.21.15.19:0/1750602859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f501c0b7340 con 0x7f501c0b64b0 2024-09-12T02:04:11.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.150+0000 7f50197fa640 1 -- 172.21.15.19:0/1750602859 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5004037040 con 0x7f501c0b64b0 2024-09-12T02:04:11.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.150+0000 7f5022df6640 1 -- 172.21.15.19:0/1750602859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f501c0b7900 con 0x7f501c0b64b0 2024-09-12T02:04:11.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.151+0000 7f5022df6640 1 -- 172.21.15.19:0/1750602859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f501c06e330 con 0x7f501c0b64b0 2024-09-12T02:04:11.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.152+0000 7f50197fa640 1 -- 172.21.15.19:0/1750602859 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5004044020 con 0x7f501c0b64b0 2024-09-12T02:04:11.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.152+0000 7f50197fa640 1 --2- 172.21.15.19:0/1750602859 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4ffc06be60 0x7f4ffc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:11.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.152+0000 7f50197fa640 1 -- 172.21.15.19:0/1750602859 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 7593+0+0 (secure 0 0 0) 0x7f50040abc20 con 0x7f501c0b64b0 2024-09-12T02:04:11.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.152+0000 7f501bfff640 1 --2- 172.21.15.19:0/1750602859 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4ffc06be60 0x7f4ffc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:11.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.153+0000 7f501bfff640 1 --2- 172.21.15.19:0/1750602859 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4ffc06be60 0x7f4ffc06e320 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f501c0cb570 tx=0x7f500c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:11.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.156+0000 7f50197fa640 1 -- 172.21.15.19:0/1750602859 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f500404b030 con 0x7f501c0b64b0 2024-09-12T02:04:11.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.368+0000 7f5022df6640 1 -- 172.21.15.19:0/1750602859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f501c0ba470 con 0x7f501c0b64b0 2024-09-12T02:04:11.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.915+0000 7f50197fa640 1 -- 172.21.15.19:0/1750602859 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v172) ==== 161+0+0 (secure 0 0 0) 0x7f50040800d0 con 0x7f501c0b64b0 2024-09-12T02:04:11.916 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:04:11.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.918+0000 7f5022df6640 1 -- 172.21.15.19:0/1750602859 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4ffc06be60 msgr2=0x7f4ffc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:11.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.918+0000 7f5022df6640 1 --2- 172.21.15.19:0/1750602859 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4ffc06be60 0x7f4ffc06e320 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f501c0cb570 tx=0x7f500c008040 comp rx=0 tx=0).stop 2024-09-12T02:04:11.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.918+0000 7f5022df6640 1 -- 172.21.15.19:0/1750602859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f501c0b64b0 msgr2=0x7f501c156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:11.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.918+0000 7f5022df6640 1 --2- 172.21.15.19:0/1750602859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f501c0b64b0 0x7f501c156330 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f5004009870 tx=0x7f50040046c0 comp rx=0 tx=0).stop 2024-09-12T02:04:11.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.918+0000 7f5022df6640 1 -- 172.21.15.19:0/1750602859 shutdown_connections 2024-09-12T02:04:11.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.918+0000 7f5022df6640 1 --2- 172.21.15.19:0/1750602859 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4ffc06be60 0x7f4ffc06e320 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:11.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.918+0000 7f5022df6640 1 --2- 172.21.15.19:0/1750602859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f501c162060 0x7f501c0b86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:11.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.918+0000 7f5022df6640 1 --2- 172.21.15.19:0/1750602859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f501c161c80 0x7f501c0cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:11.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.918+0000 7f5022df6640 1 --2- 172.21.15.19:0/1750602859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f501c0b64b0 0x7f501c156330 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:11.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.918+0000 7f5022df6640 1 -- 172.21.15.19:0/1750602859 >> 172.21.15.19:0/1750602859 conn(0x7f501c0d44f0 msgr2=0x7f501c15fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:11.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.918+0000 7f5022df6640 1 -- 172.21.15.19:0/1750602859 shutdown_connections 2024-09-12T02:04:11.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:11.918+0000 7f5022df6640 1 -- 172.21.15.19:0/1750602859 wait complete. 2024-09-12T02:04:11.930 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:04:12.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.035+0000 7f4164e8b640 1 Processor -- start 2024-09-12T02:04:12.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.035+0000 7f4164e8b640 1 -- start start 2024-09-12T02:04:12.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.036+0000 7f4164e8b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f41600cfcc0 0x7f416006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.036+0000 7f4164e8b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41600d2700 con 0x7f41600d4fd0 2024-09-12T02:04:12.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.036+0000 7f4164e8b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41600cedb0 con 0x7f416015e760 2024-09-12T02:04:12.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.036+0000 7f4164e8b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f41600cf090 con 0x7f41600cfcc0 2024-09-12T02:04:12.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.036+0000 7f415ed9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f41600d4fd0 0x7f41600d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49080/0 (socket says 172.21.15.19:49080) 2024-09-12T02:04:12.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.036+0000 7f415ed9d640 1 -- 172.21.15.19:0/529381199 learned_addr learned my addr 172.21.15.19:0/529381199 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:12.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.036+0000 7f4157fff640 1 --2- 172.21.15.19:0/529381199 >> v2:172.21.15.135:3300/0 conn(0x7f41600cfcc0 0x7f416006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.036+0000 7f415dd9b640 1 -- 172.21.15.19:0/529381199 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3047235620 0 0) 0x7f4158001490 con 0x7f41600d4fd0 2024-09-12T02:04:12.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.036+0000 7f415dd9b640 1 -- 172.21.15.19:0/529381199 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f414c003520 con 0x7f41600d4fd0 2024-09-12T02:04:12.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.036+0000 7f415dd9b640 1 -- 172.21.15.19:0/529381199 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 582076997 0 0) 0x7f414c003520 con 0x7f41600d4fd0 2024-09-12T02:04:12.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.036+0000 7f415dd9b640 1 -- 172.21.15.19:0/529381199 >> v2:172.21.15.135:3300/0 conn(0x7f41600cfcc0 msgr2=0x7f416006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:12.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.036+0000 7f415dd9b640 1 --2- 172.21.15.19:0/529381199 >> v2:172.21.15.135:3300/0 conn(0x7f41600cfcc0 0x7f416006cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.036+0000 7f415dd9b640 1 -- 172.21.15.19:0/529381199 >> v1:172.21.15.135:6789/0 conn(0x7f416015e760 legacy=0x7f41600cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:12.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.036+0000 7f415dd9b640 1 -- 172.21.15.19:0/529381199 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41600b3c80 con 0x7f41600d4fd0 2024-09-12T02:04:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.036+0000 7f415dd9b640 1 -- 172.21.15.19:0/529381199 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f4158001bc0 con 0x7f41600d4fd0 2024-09-12T02:04:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.036+0000 7f415dd9b640 1 -- 172.21.15.19:0/529381199 >> v1:172.21.15.19:6789/0 conn(0x7f41600d4fd0 legacy=0x7f41600d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.036+0000 7f415dd9b640 1 --2- 172.21.15.19:0/529381199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f414c0039b0 0x7f414c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.037+0000 7f415dd9b640 1 --2- 172.21.15.19:0/529381199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f414c004800 0x7f414c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.037+0000 7f415dd9b640 1 --2- 172.21.15.19:0/529381199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f414c0051c0 0x7f414c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.037+0000 7f415dd9b640 1 -- 172.21.15.19:0/529381199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f41600cf090 con 0x7f414c004800 2024-09-12T02:04:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.037+0000 7f415dd9b640 1 -- 172.21.15.19:0/529381199 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f414c00c060 con 0x7f414c0051c0 2024-09-12T02:04:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.037+0000 7f415dd9b640 1 -- 172.21.15.19:0/529381199 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f414c00c260 con 0x7f414c0039b0 2024-09-12T02:04:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.037+0000 7f4157fff640 1 --2- 172.21.15.19:0/529381199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f414c004800 0x7f414c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.037+0000 7f415e59c640 1 --2- 172.21.15.19:0/529381199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f414c0039b0 0x7f414c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.037+0000 7f415ed9d640 1 --2- 172.21.15.19:0/529381199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f414c0051c0 0x7f414c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.037+0000 7f4157fff640 1 -- 172.21.15.19:0/529381199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f414c0039b0 msgr2=0x7f414c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.037+0000 7f4157fff640 1 --2- 172.21.15.19:0/529381199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f414c0039b0 0x7f414c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.037+0000 7f4157fff640 1 -- 172.21.15.19:0/529381199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f414c0051c0 msgr2=0x7f414c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:12.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.037+0000 7f4157fff640 1 --2- 172.21.15.19:0/529381199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f414c0051c0 0x7f414c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.037+0000 7f4157fff640 1 -- 172.21.15.19:0/529381199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414c003520 con 0x7f414c004800 2024-09-12T02:04:12.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.037+0000 7f415ed9d640 1 -- 172.21.15.19:0/529381199 reap_dead start 2024-09-12T02:04:12.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.038+0000 7f4157fff640 1 --2- 172.21.15.19:0/529381199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f414c004800 0x7f414c004c80 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f4148009ab0 tx=0x7f414c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8338b24ff31e8a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:12.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.038+0000 7f415dd9b640 1 -- 172.21.15.19:0/529381199 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4148036070 con 0x7f414c004800 2024-09-12T02:04:12.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.038+0000 7f415dd9b640 1 -- 172.21.15.19:0/529381199 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4148005990 con 0x7f414c004800 2024-09-12T02:04:12.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.038+0000 7f415dd9b640 1 -- 172.21.15.19:0/529381199 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4148009680 con 0x7f414c004800 2024-09-12T02:04:12.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.038+0000 7f4164e8b640 1 -- 172.21.15.19:0/529381199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f414c004800 msgr2=0x7f414c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:12.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.038+0000 7f4164e8b640 1 --2- 172.21.15.19:0/529381199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f414c004800 0x7f414c004c80 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f4148009ab0 tx=0x7f414c005830 comp rx=0 tx=0).stop 2024-09-12T02:04:12.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.038+0000 7f4164e8b640 1 -- 172.21.15.19:0/529381199 shutdown_connections 2024-09-12T02:04:12.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.038+0000 7f4164e8b640 1 --2- 172.21.15.19:0/529381199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f414c004800 0x7f414c004c80 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.038+0000 7f4164e8b640 1 -- 172.21.15.19:0/529381199 >> 172.21.15.19:0/529381199 conn(0x7f416008bfc0 msgr2=0x7f41600d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:12.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.038+0000 7f4164e8b640 1 -- 172.21.15.19:0/529381199 shutdown_connections 2024-09-12T02:04:12.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.039+0000 7f4164e8b640 1 -- 172.21.15.19:0/529381199 wait complete. 2024-09-12T02:04:12.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.040+0000 7f4164e8b640 1 Processor -- start 2024-09-12T02:04:12.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.040+0000 7f4164e8b640 1 -- start start 2024-09-12T02:04:12.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f4164e8b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f414c004800 0x7f41600b9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f4164e8b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41600ba0a0 0x7f41601f8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f4164e8b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41601f8a60 0x7f41600b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f4164e8b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f416006cdd0 con 0x7f41601f8a60 2024-09-12T02:04:12.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f4164e8b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f41600b3860 con 0x7f41600ba0a0 2024-09-12T02:04:12.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f4164e8b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f416006cf50 con 0x7f414c004800 2024-09-12T02:04:12.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f415ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41601f8a60 0x7f41600b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f415ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41601f8a60 0x7f41600b7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57552/0 (socket says 172.21.15.19:57552) 2024-09-12T02:04:12.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f415ed9d640 1 -- 172.21.15.19:0/1838060232 learned_addr learned my addr 172.21.15.19:0/1838060232 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:12.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f415e59c640 1 --2- 172.21.15.19:0/1838060232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f414c004800 0x7f41600b9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f4157fff640 1 --2- 172.21.15.19:0/1838060232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41600ba0a0 0x7f41601f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f415ed9d640 1 -- 172.21.15.19:0/1838060232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f414c004800 msgr2=0x7f41600b9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:12.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f415ed9d640 1 --2- 172.21.15.19:0/1838060232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f414c004800 0x7f41600b9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f415ed9d640 1 -- 172.21.15.19:0/1838060232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41600ba0a0 msgr2=0x7f41601f8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:12.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f415ed9d640 1 --2- 172.21.15.19:0/1838060232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41600ba0a0 0x7f41601f8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f415ed9d640 1 -- 172.21.15.19:0/1838060232 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41600c9e90 con 0x7f41601f8a60 2024-09-12T02:04:12.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f415ed9d640 1 --2- 172.21.15.19:0/1838060232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41601f8a60 0x7f41600b7380 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f4158000f80 tx=0x7f415800af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:12.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f4156ffd640 1 -- 172.21.15.19:0/1838060232 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4158017020 con 0x7f41601f8a60 2024-09-12T02:04:12.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f4156ffd640 1 -- 172.21.15.19:0/1838060232 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4158007740 con 0x7f41601f8a60 2024-09-12T02:04:12.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f4164e8b640 1 -- 172.21.15.19:0/1838060232 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41600ca170 con 0x7f41601f8a60 2024-09-12T02:04:12.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.041+0000 7f4156ffd640 1 -- 172.21.15.19:0/1838060232 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41580133f0 con 0x7f41601f8a60 2024-09-12T02:04:12.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.042+0000 7f4164e8b640 1 -- 172.21.15.19:0/1838060232 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41600ca730 con 0x7f41601f8a60 2024-09-12T02:04:12.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.042+0000 7f4164e8b640 1 -- 172.21.15.19:0/1838060232 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f416015e080 con 0x7f41601f8a60 2024-09-12T02:04:12.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.043+0000 7f4156ffd640 1 -- 172.21.15.19:0/1838060232 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f415801a020 con 0x7f41601f8a60 2024-09-12T02:04:12.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.043+0000 7f4156ffd640 1 --2- 172.21.15.19:0/1838060232 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f414006be60 0x7f414006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.044+0000 7f4156ffd640 1 -- 172.21.15.19:0/1838060232 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 7593+0+0 (secure 0 0 0) 0x7f415808bb40 con 0x7f41601f8a60 2024-09-12T02:04:12.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.044+0000 7f415e59c640 1 --2- 172.21.15.19:0/1838060232 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f414006be60 0x7f414006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.044+0000 7f415e59c640 1 --2- 172.21.15.19:0/1838060232 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f414006be60 0x7f414006e320 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4150000c00 tx=0x7f4150009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:12.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.048+0000 7f4156ffd640 1 -- 172.21.15.19:0/1838060232 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4158021020 con 0x7f41601f8a60 2024-09-12T02:04:12.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.292+0000 7f4164e8b640 1 -- 172.21.15.19:0/1838060232 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f41600b6d20 con 0x7f41601f8a60 2024-09-12T02:04:12.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.921+0000 7f4156ffd640 1 -- 172.21.15.19:0/1838060232 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v173) ==== 101+0+0 (secure 0 0 0) 0x7f41600d2700 con 0x7f41601f8a60 2024-09-12T02:04:12.921 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:04:12.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.924+0000 7f4164e8b640 1 -- 172.21.15.19:0/1838060232 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f414006be60 msgr2=0x7f414006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:12.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.924+0000 7f4164e8b640 1 --2- 172.21.15.19:0/1838060232 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f414006be60 0x7f414006e320 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4150000c00 tx=0x7f4150009040 comp rx=0 tx=0).stop 2024-09-12T02:04:12.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.924+0000 7f4164e8b640 1 -- 172.21.15.19:0/1838060232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41601f8a60 msgr2=0x7f41600b7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:12.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.924+0000 7f4164e8b640 1 --2- 172.21.15.19:0/1838060232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41601f8a60 0x7f41600b7380 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f4158000f80 tx=0x7f415800af60 comp rx=0 tx=0).stop 2024-09-12T02:04:12.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.924+0000 7f4164e8b640 1 -- 172.21.15.19:0/1838060232 shutdown_connections 2024-09-12T02:04:12.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.924+0000 7f4164e8b640 1 --2- 172.21.15.19:0/1838060232 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f414006be60 0x7f414006e320 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.924+0000 7f4164e8b640 1 --2- 172.21.15.19:0/1838060232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41601f8a60 0x7f41600b7380 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.924+0000 7f4164e8b640 1 --2- 172.21.15.19:0/1838060232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41600ba0a0 0x7f41601f8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.924+0000 7f4164e8b640 1 --2- 172.21.15.19:0/1838060232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f414c004800 0x7f41600b9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.924+0000 7f4164e8b640 1 -- 172.21.15.19:0/1838060232 >> 172.21.15.19:0/1838060232 conn(0x7f416008bfc0 msgr2=0x7f416006d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:12.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.924+0000 7f4164e8b640 1 -- 172.21.15.19:0/1838060232 shutdown_connections 2024-09-12T02:04:12.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.924+0000 7f4164e8b640 1 -- 172.21.15.19:0/1838060232 wait complete. 2024-09-12T02:04:12.938 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:04:12.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.982+0000 7f9be9b21f40 1 Processor -- start 2024-09-12T02:04:12.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.982+0000 7f9be9b21f40 1 -- start start 2024-09-12T02:04:12.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.982+0000 7f9be9b21f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3e45dd180 0x55e3e46b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.982+0000 7f9be9b21f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e3e460b050 0x55e3e4692f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.982+0000 7f9be9b21f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3e4695080 0x55e3e47447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.982+0000 7f9be9b21f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e3e45d9dc0 con 0x55e3e4695080 2024-09-12T02:04:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.982+0000 7f9be9b21f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e3e45d9ae0 con 0x55e3e45dd180 2024-09-12T02:04:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.982+0000 7f9be9b21f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55e3e45da0a0 con 0x55e3e460b050 2024-09-12T02:04:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.983+0000 7f9be73d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3e4695080 0x55e3e47447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.983+0000 7f9be73d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3e4695080 0x55e3e47447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57562/0 (socket says 172.21.15.19:57562) 2024-09-12T02:04:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.983+0000 7f9be73d0640 1 -- 172.21.15.19:0/3157240118 learned_addr learned my addr 172.21.15.19:0/3157240118 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.983+0000 7f9be6bcf640 1 --2- 172.21.15.19:0/3157240118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3e45dd180 0x55e3e46b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.983+0000 7f9be63ce640 1 --2- 172.21.15.19:0/3157240118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e3e460b050 0x55e3e4692f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.983+0000 7f9be73d0640 1 -- 172.21.15.19:0/3157240118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e3e460b050 msgr2=0x55e3e4692f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.983+0000 7f9be73d0640 1 --2- 172.21.15.19:0/3157240118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e3e460b050 0x55e3e4692f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.983+0000 7f9be73d0640 1 -- 172.21.15.19:0/3157240118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3e45dd180 msgr2=0x55e3e46b4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:12.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.983+0000 7f9be73d0640 1 --2- 172.21.15.19:0/3157240118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3e45dd180 0x55e3e46b4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.983+0000 7f9be73d0640 1 -- 172.21.15.19:0/3157240118 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3e4505cb0 con 0x55e3e4695080 2024-09-12T02:04:12.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.983+0000 7f9be6bcf640 1 --2- 172.21.15.19:0/3157240118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3e45dd180 0x55e3e46b4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:12.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.983+0000 7f9be73d0640 1 --2- 172.21.15.19:0/3157240118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3e4695080 0x55e3e47447a0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f9be0046220 tx=0x7f9be0050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94d3554129e318b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:12.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.983+0000 7f9be53cc640 1 -- 172.21.15.19:0/3157240118 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be004eb60 con 0x55e3e4695080 2024-09-12T02:04:12.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.983+0000 7f9be53cc640 1 -- 172.21.15.19:0/3157240118 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be0066070 con 0x55e3e4695080 2024-09-12T02:04:12.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.983+0000 7f9be53cc640 1 -- 172.21.15.19:0/3157240118 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be0061420 con 0x55e3e4695080 2024-09-12T02:04:12.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.984+0000 7f9be9b21f40 1 -- 172.21.15.19:0/3157240118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3e4695080 msgr2=0x55e3e47447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:12.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.984+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/3157240118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3e4695080 0x55e3e47447a0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f9be0046220 tx=0x7f9be0050000 comp rx=0 tx=0).stop 2024-09-12T02:04:12.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.984+0000 7f9be9b21f40 1 -- 172.21.15.19:0/3157240118 shutdown_connections 2024-09-12T02:04:12.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.984+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/3157240118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3e4695080 0x55e3e47447a0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.984+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/3157240118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e3e460b050 0x55e3e4692f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.984+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/3157240118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3e45dd180 0x55e3e46b4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.984+0000 7f9be9b21f40 1 -- 172.21.15.19:0/3157240118 >> 172.21.15.19:0/3157240118 conn(0x55e3e45da9e0 msgr2=0x55e3e4605cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:12.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.984+0000 7f9be9b21f40 1 -- 172.21.15.19:0/3157240118 shutdown_connections 2024-09-12T02:04:12.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.984+0000 7f9be9b21f40 1 -- 172.21.15.19:0/3157240118 wait complete. 2024-09-12T02:04:12.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.984+0000 7f9be9b21f40 1 Processor -- start 2024-09-12T02:04:12.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.984+0000 7f9be9b21f40 1 -- start start 2024-09-12T02:04:12.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.985+0000 7f9be9b21f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3e45dd180 0x55e3e4691fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.985+0000 7f9be9b21f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e3e460b050 0x55e3e4621140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.985+0000 7f9be9b21f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3e4695080 0x55e3e4621680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.985+0000 7f9be9b21f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e3e46056e0 con 0x55e3e45dd180 2024-09-12T02:04:12.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.985+0000 7f9be9b21f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e3e469aac0 con 0x55e3e4695080 2024-09-12T02:04:12.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.985+0000 7f9be9b21f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55e3e4693470 con 0x55e3e460b050 2024-09-12T02:04:12.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.985+0000 7f9be6bcf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3e45dd180 0x55e3e4691fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.985+0000 7f9be6bcf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3e45dd180 0x55e3e4691fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57564/0 (socket says 172.21.15.19:57564) 2024-09-12T02:04:12.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.985+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 learned_addr learned my addr 172.21.15.19:0/112574330 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:12.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.985+0000 7f9be63ce640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e3e460b050 0x55e3e4621140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.985+0000 7f9be73d0640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3e4695080 0x55e3e4621680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.986+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e3e460b050 msgr2=0x55e3e4621140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:12.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.986+0000 7f9be6bcf640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e3e460b050 0x55e3e4621140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.986+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3e4695080 msgr2=0x55e3e4621680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:12.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.986+0000 7f9be6bcf640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3e4695080 0x55e3e4621680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.986+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3e460a220 con 0x55e3e45dd180 2024-09-12T02:04:12.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.986+0000 7f9be73d0640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3e4695080 0x55e3e4621680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:12.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.986+0000 7f9be6bcf640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3e45dd180 0x55e3e4691fc0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8007de0 tx=0x7f9bd8006750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:12.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.986+0000 7f9bcffff640 1 -- 172.21.15.19:0/112574330 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8018070 con 0x55e3e45dd180 2024-09-12T02:04:12.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.986+0000 7f9bcffff640 1 -- 172.21.15.19:0/112574330 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd8010660 con 0x55e3e45dd180 2024-09-12T02:04:12.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.986+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e3e4742850 con 0x55e3e45dd180 2024-09-12T02:04:12.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.986+0000 7f9bcffff640 1 -- 172.21.15.19:0/112574330 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8006e60 con 0x55e3e45dd180 2024-09-12T02:04:12.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.986+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3e4742e10 con 0x55e3e45dd180 2024-09-12T02:04:12.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.987+0000 7f9bcffff640 1 -- 172.21.15.19:0/112574330 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9bd801b070 con 0x55e3e45dd180 2024-09-12T02:04:12.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.988+0000 7f9bcffff640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9bd406a810 0x7f9bd406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.988+0000 7f9bcffff640 1 -- 172.21.15.19:0/112574330 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 7593+0+0 (secure 0 0 0) 0x7f9bd80895e0 con 0x55e3e45dd180 2024-09-12T02:04:12.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.988+0000 7f9be63ce640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9bd406a810 0x7f9bd406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.991 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:04:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.988+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55e3e460a5b0 0x55e3e46b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.988+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e45d93b0 con 0x55e3e460a5b0 2024-09-12T02:04:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.988+0000 7f9be73d0640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55e3e460a5b0 0x55e3e46b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.989+0000 7f9be63ce640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9bd406a810 0x7f9bd406ccd0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc005fd0 tx=0x7f9bdc00c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.989+0000 7f9be73d0640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55e3e460a5b0 0x55e3e46b0d50 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.990+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v110'474 uv448 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.990+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e46b1290 con 0x55e3e460a5b0 2024-09-12T02:04:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.991+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v110'475 uv475 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.991+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4754b50 con 0x55e3e460a5b0 2024-09-12T02:04:12.993 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:04:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.992+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v110'476 uv476 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.992+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755f00 con 0x55e3e460a5b0 2024-09-12T02:04:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.993+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v110'477 uv477 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.993+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47562a0 con 0x55e3e460a5b0 2024-09-12T02:04:12.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.995+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v110'478 uv478 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:12.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.995+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4754ef0 con 0x55e3e460a5b0 2024-09-12T02:04:12.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.996+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v110'479 uv479 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:12.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.996+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47552e0 con 0x55e3e460a5b0 2024-09-12T02:04:12.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.997+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v110'480 uv454 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:12.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.997+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755680 con 0x55e3e460a5b0 2024-09-12T02:04:12.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.998+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v110'481 uv481 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:12.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.998+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755680 con 0x55e3e460a5b0 2024-09-12T02:04:12.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.999+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v110'482 uv482 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:12.999 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:04:13.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:12.999+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755680 con 0x55e3e460a5b0 2024-09-12T02:04:13.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.000+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v110'483 uv483 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.000+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755680 con 0x55e3e460a5b0 2024-09-12T02:04:13.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.001+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v110'484 uv484 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.001+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755680 con 0x55e3e460a5b0 2024-09-12T02:04:13.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.002+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v110'485 uv485 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.002+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755680 con 0x55e3e460a5b0 2024-09-12T02:04:13.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.003+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v110'486 uv461 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.003+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755680 con 0x55e3e460a5b0 2024-09-12T02:04:13.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.004+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v110'487 uv487 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.004+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755680 con 0x55e3e460a5b0 2024-09-12T02:04:13.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.005+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v110'488 uv488 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.006 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:04:13.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.005+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755680 con 0x55e3e460a5b0 2024-09-12T02:04:13.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.006+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v110'489 uv489 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.006+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755680 con 0x55e3e460a5b0 2024-09-12T02:04:13.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.007+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v110'490 uv490 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.007+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755680 con 0x55e3e460a5b0 2024-09-12T02:04:13.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.008+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v110'491 uv491 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.008+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755a40 con 0x55e3e460a5b0 2024-09-12T02:04:13.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.009+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v110'492 uv492 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.009+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755a40 con 0x55e3e460a5b0 2024-09-12T02:04:13.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.010+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v110'493 uv467 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.010+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755930 con 0x55e3e460a5b0 2024-09-12T02:04:13.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.011+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v110'494 uv494 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.011+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755930 con 0x55e3e460a5b0 2024-09-12T02:04:13.013 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:04:13.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.012+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v110'495 uv495 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.012+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755930 con 0x55e3e460a5b0 2024-09-12T02:04:13.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.013+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v110'496 uv496 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.013+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755930 con 0x55e3e460a5b0 2024-09-12T02:04:13.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.014+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v110'497 uv497 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.014+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755930 con 0x55e3e460a5b0 2024-09-12T02:04:13.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.015+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v110'498 uv498 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.015+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755930 con 0x55e3e460a5b0 2024-09-12T02:04:13.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.016+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v110'499 uv473 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.016+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755930 con 0x55e3e460a5b0 2024-09-12T02:04:13.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.017+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v110'500 uv500 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.017+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755930 con 0x55e3e460a5b0 2024-09-12T02:04:13.018 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:04:13.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.018+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v110'501 uv501 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.018+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755930 con 0x55e3e460a5b0 2024-09-12T02:04:13.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.019+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v110'502 uv502 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.019+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755930 con 0x55e3e460a5b0 2024-09-12T02:04:13.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.020+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v110'503 uv503 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.020+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755930 con 0x55e3e460a5b0 2024-09-12T02:04:13.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.021+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v110'504 uv504 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e460a5b0 2024-09-12T02:04:13.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.021+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55e3e4756b50 0x55e3e4758f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.021+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4755930 con 0x55e3e4756b50 2024-09-12T02:04:13.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.022+0000 7f9be6bcf640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55e3e4756b50 0x55e3e4758f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.022+0000 7f9be6bcf640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55e3e4756b50 0x55e3e4758f40 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:13.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.023+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v110'353 uv352 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.024+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4759480 con 0x55e3e4756b50 2024-09-12T02:04:13.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.025+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v110'354 uv354 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.025+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4759820 con 0x55e3e4756b50 2024-09-12T02:04:13.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.026+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v110'355 uv355 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.026 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:04:13.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.026+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475a070 con 0x55e3e4756b50 2024-09-12T02:04:13.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.027+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v110'356 uv356 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.027+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475a410 con 0x55e3e4756b50 2024-09-12T02:04:13.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.028+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v110'357 uv357 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.028+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475a7b0 con 0x55e3e4756b50 2024-09-12T02:04:13.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.030+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v110'358 uv340 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.030+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475ab50 con 0x55e3e4756b50 2024-09-12T02:04:13.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.031+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v110'359 uv359 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.031+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475aef0 con 0x55e3e4756b50 2024-09-12T02:04:13.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.032+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v110'360 uv360 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.032 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:04:13.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.032+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475aef0 con 0x55e3e4756b50 2024-09-12T02:04:13.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.033+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v110'361 uv361 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.033+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475aef0 con 0x55e3e4756b50 2024-09-12T02:04:13.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.034+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v110'362 uv362 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.034+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475aef0 con 0x55e3e4756b50 2024-09-12T02:04:13.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.035+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v110'363 uv345 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.035+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475aef0 con 0x55e3e4756b50 2024-09-12T02:04:13.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.036+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v110'364 uv364 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.036+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475aef0 con 0x55e3e4756b50 2024-09-12T02:04:13.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.038+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v110'365 uv365 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.038 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:04:13.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.038+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475f370 con 0x55e3e4756b50 2024-09-12T02:04:13.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.039+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v110'366 uv366 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.039+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475f370 con 0x55e3e4756b50 2024-09-12T02:04:13.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.040+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v110'367 uv367 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.040+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475aef0 con 0x55e3e4756b50 2024-09-12T02:04:13.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.041+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v110'368 uv351 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.041+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475aef0 con 0x55e3e4756b50 2024-09-12T02:04:13.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.042+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v110'369 uv369 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.042+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475aef0 con 0x55e3e4756b50 2024-09-12T02:04:13.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.043+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v110'370 uv370 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.044 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:04:13.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.043+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475bf00 con 0x55e3e4756b50 2024-09-12T02:04:13.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.044+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v110'371 uv371 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.044+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475bf00 con 0x55e3e4756b50 2024-09-12T02:04:13.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.046+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v110'372 uv372 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.046+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475aef0 con 0x55e3e4756b50 2024-09-12T02:04:13.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.047+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v110'373 uv373 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4756b50 2024-09-12T02:04:13.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.047+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55e3e475b450 0x55e3e475d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.047+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475de60 con 0x55e3e475b450 2024-09-12T02:04:13.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.047+0000 7f9be63ce640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55e3e475b450 0x55e3e475d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.047+0000 7f9be63ce640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55e3e475b450 0x55e3e475d840 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:13.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.049+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v110'93 uv92 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.049+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475e6b0 con 0x55e3e475b450 2024-09-12T02:04:13.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.050+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v110'94 uv94 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.050+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475ea50 con 0x55e3e475b450 2024-09-12T02:04:13.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.051+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v110'95 uv95 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.052 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:04:13.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.051+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475fe00 con 0x55e3e475b450 2024-09-12T02:04:13.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.052+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v110'96 uv96 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.052+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4760280 con 0x55e3e475b450 2024-09-12T02:04:13.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.053+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v110'97 uv97 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.053+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e475edf0 con 0x55e3e475b450 2024-09-12T02:04:13.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.054+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v110'98 uv98 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.054+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55e3e475f8b0 0x55e3e47626a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.054+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4762c20 con 0x55e3e475f8b0 2024-09-12T02:04:13.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.054+0000 7f9be73d0640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55e3e475f8b0 0x55e3e47626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.055+0000 7f9be73d0640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55e3e475f8b0 0x55e3e47626a0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:13.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.056+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v110'72 uv71 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.056+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4762ff0 con 0x55e3e475f8b0 2024-09-12T02:04:13.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.057+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v110'73 uv73 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.057+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4762ff0 con 0x55e3e475f8b0 2024-09-12T02:04:13.058 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:04:13.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.058+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v110'74 uv74 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.058+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4762ff0 con 0x55e3e475f8b0 2024-09-12T02:04:13.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.059+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v110'75 uv75 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.059+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55e3e4763920 0x55e3e4765d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.059+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4766250 con 0x55e3e4763920 2024-09-12T02:04:13.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.059+0000 7f9be6bcf640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55e3e4763920 0x55e3e4765d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.060+0000 7f9be6bcf640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55e3e4763920 0x55e3e4765d10 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:13.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.061+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v110'93 uv92 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.061+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4766250 con 0x55e3e4763920 2024-09-12T02:04:13.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.062+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v110'94 uv94 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.062+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47662d0 con 0x55e3e4763920 2024-09-12T02:04:13.063 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:04:13.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.063+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v110'95 uv95 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.063+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4767700 con 0x55e3e4763920 2024-09-12T02:04:13.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.064+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v110'96 uv96 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.064+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4767700 con 0x55e3e4763920 2024-09-12T02:04:13.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.065+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v110'97 uv97 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.065+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e4763920 2024-09-12T02:04:13.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.066+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v110'98 uv98 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.066+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e475f8b0 2024-09-12T02:04:13.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.068+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v110'171 uv165 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.068+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e475f8b0 2024-09-12T02:04:13.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.069+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v110'172 uv172 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.069+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e475f8b0 2024-09-12T02:04:13.070 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:04:13.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.070+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v110'173 uv173 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.070+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4767700 con 0x55e3e475f8b0 2024-09-12T02:04:13.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.071+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v110'174 uv174 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.071+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4767700 con 0x55e3e475f8b0 2024-09-12T02:04:13.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.072+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v110'175 uv175 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.072+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e475f8b0 2024-09-12T02:04:13.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.073+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v110'176 uv176 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.073+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e475f8b0 2024-09-12T02:04:13.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.074+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v110'177 uv170 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.074+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e475f8b0 2024-09-12T02:04:13.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.075+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v110'178 uv178 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.075+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e475f8b0 2024-09-12T02:04:13.077 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:04:13.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.076+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v110'179 uv179 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.077+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e475f8b0 2024-09-12T02:04:13.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.078+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v110'180 uv180 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.078+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e475f8b0 2024-09-12T02:04:13.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.079+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v110'181 uv181 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.079+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e475f8b0 2024-09-12T02:04:13.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.080+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v110'76 uv75 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.080+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e475f8b0 2024-09-12T02:04:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.081+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v110'77 uv77 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.081+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e475f8b0 2024-09-12T02:04:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.082+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v110'78 uv78 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.082 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:04:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.082+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e475f8b0 2024-09-12T02:04:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.083+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v110'79 uv79 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.083+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e475f8b0 2024-09-12T02:04:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.084+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v110'80 uv80 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9be004ebe0 con 0x55e3e475f8b0 2024-09-12T02:04:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.084+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e4763920 2024-09-12T02:04:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.085+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v110'93 uv92 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.085+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e4763920 2024-09-12T02:04:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.086+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v110'94 uv94 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.086+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e4763920 2024-09-12T02:04:13.087 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:04:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.087+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v110'95 uv95 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.087+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4767700 con 0x55e3e4763920 2024-09-12T02:04:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.088+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v110'96 uv96 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.088+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4767700 con 0x55e3e4763920 2024-09-12T02:04:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.089+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v110'97 uv97 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.089+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e4763920 2024-09-12T02:04:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.089+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v110'98 uv98 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.089+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e4763920 2024-09-12T02:04:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.091+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v110'152 uv146 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.091+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e4763920 2024-09-12T02:04:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.091+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v110'153 uv153 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.092+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e4763920 2024-09-12T02:04:13.092 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:04:13.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.092+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v110'154 uv154 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.092+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e4763920 2024-09-12T02:04:13.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.093+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v110'155 uv155 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.093+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e4763920 2024-09-12T02:04:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.095+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v110'156 uv156 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.095+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e4763920 2024-09-12T02:04:13.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.096+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v110'157 uv151 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.096+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e4763920 2024-09-12T02:04:13.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.097+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v110'158 uv158 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.097+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e4763920 2024-09-12T02:04:13.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.098+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v110'159 uv159 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.098 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:04:13.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.098+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e47666f0 con 0x55e3e4763920 2024-09-12T02:04:13.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.099+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v110'160 uv160 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.099+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4769500 con 0x55e3e4763920 2024-09-12T02:04:13.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.100+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v110'161 uv161 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.100+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55e3e4767220 0x55e3e4769b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.100+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4769610 con 0x55e3e4767220 2024-09-12T02:04:13.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.100+0000 7f9be63ce640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55e3e4767220 0x55e3e4769b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.101+0000 7f9be63ce640 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55e3e4767220 0x55e3e4769b40 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:13.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.102+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v110'70 uv69 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e4767220 2024-09-12T02:04:13.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.102+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4769610 con 0x55e3e4767220 2024-09-12T02:04:13.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.103+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v110'71 uv71 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e4767220 2024-09-12T02:04:13.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.103+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4769610 con 0x55e3e4767220 2024-09-12T02:04:13.104 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:04:13.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.104+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v110'72 uv72 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e4767220 2024-09-12T02:04:13.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.104+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4769610 con 0x55e3e4767220 2024-09-12T02:04:13.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.105+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v110'73 uv73 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e4767220 2024-09-12T02:04:13.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.105+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4769610 con 0x55e3e4763920 2024-09-12T02:04:13.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.106+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v110'93 uv92 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.106+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4769610 con 0x55e3e4763920 2024-09-12T02:04:13.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.107+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v110'94 uv94 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.107+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4769610 con 0x55e3e4763920 2024-09-12T02:04:13.108 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:04:13.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.108+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v110'95 uv95 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.108+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4769610 con 0x55e3e4763920 2024-09-12T02:04:13.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.109+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v110'96 uv96 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.109+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4769610 con 0x55e3e4763920 2024-09-12T02:04:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.110+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v110'97 uv97 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.110+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4769610 con 0x55e3e4763920 2024-09-12T02:04:13.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.112+0000 7f9be6bcf640 1 -- 172.21.15.19:0/112574330 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v110'98 uv98 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bd801a030 con 0x55e3e4763920 2024-09-12T02:04:13.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.112+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4769610 con 0x55e3e475b450 2024-09-12T02:04:13.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.113+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v110'79 uv78 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.113+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4769610 con 0x55e3e475b450 2024-09-12T02:04:13.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.114+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v110'80 uv80 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.114+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4769610 con 0x55e3e475b450 2024-09-12T02:04:13.115 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:04:13.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.115+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v110'81 uv81 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.115+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4769610 con 0x55e3e475b450 2024-09-12T02:04:13.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.116+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v110'82 uv82 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.117+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4769610 con 0x55e3e475b450 2024-09-12T02:04:13.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.118+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v110'83 uv83 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.118+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e4769610 con 0x55e3e475b450 2024-09-12T02:04:13.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.119+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v110'192 uv186 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.119+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e476a080 con 0x55e3e475b450 2024-09-12T02:04:13.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.120+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v110'193 uv193 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.120+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e476a080 con 0x55e3e475b450 2024-09-12T02:04:13.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.121+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v110'194 uv194 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.121 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:04:13.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.121+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e476a080 con 0x55e3e475b450 2024-09-12T02:04:13.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.122+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v110'195 uv195 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.122+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e476a080 con 0x55e3e475b450 2024-09-12T02:04:13.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.123+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v110'196 uv196 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.123+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e476a080 con 0x55e3e475b450 2024-09-12T02:04:13.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.124+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v110'197 uv191 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.124+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x55e3e476a080 con 0x55e3e475b450 2024-09-12T02:04:13.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.125+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v110'198 uv198 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.125+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e476a080 con 0x55e3e475b450 2024-09-12T02:04:13.126 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:04:13.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.126+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v110'199 uv199 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.126+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e476b0e0 con 0x55e3e475b450 2024-09-12T02:04:13.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.127+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v110'200 uv200 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.127+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e476b0e0 con 0x55e3e475b450 2024-09-12T02:04:13.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.128+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v110'201 uv201 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.128+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e476a080 con 0x55e3e475b450 2024-09-12T02:04:13.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.129+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v110'202 uv202 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.129+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55e3e476a080 con 0x55e3e475b450 2024-09-12T02:04:13.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be63ce640 1 -- 172.21.15.19:0/112574330 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v110'203 uv203 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f9bdc0088d0 con 0x55e3e475b450 2024-09-12T02:04:13.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55e3e4756b50 msgr2=0x55e3e4758f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55e3e4756b50 0x55e3e4758f40 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55e3e460a5b0 msgr2=0x55e3e46b0d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55e3e460a5b0 0x55e3e46b0d50 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55e3e475f8b0 msgr2=0x55e3e47626a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55e3e475f8b0 0x55e3e47626a0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55e3e4767220 msgr2=0x55e3e4769b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55e3e4767220 0x55e3e4769b40 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55e3e475b450 msgr2=0x55e3e475d840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55e3e475b450 0x55e3e475d840 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 reap_dead start 2024-09-12T02:04:13.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55e3e4763920 msgr2=0x55e3e4765d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55e3e4763920 0x55e3e4765d10 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 reap_dead start 2024-09-12T02:04:13.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be73d0640 1 -- 172.21.15.19:0/112574330 reap_dead start 2024-09-12T02:04:13.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9bd406a810 msgr2=0x7f9bd406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9bd406a810 0x7f9bd406ccd0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc005fd0 tx=0x7f9bdc00c040 comp rx=0 tx=0).stop 2024-09-12T02:04:13.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3e45dd180 msgr2=0x55e3e4691fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3e45dd180 0x55e3e4691fc0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8007de0 tx=0x7f9bd8006750 comp rx=0 tx=0).stop 2024-09-12T02:04:13.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 shutdown_connections 2024-09-12T02:04:13.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9bd406a810 0x7f9bd406ccd0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 --2- 172.21.15.19:0/112574330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3e45dd180 0x55e3e4691fc0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 >> 172.21.15.19:0/112574330 conn(0x55e3e45da9e0 msgr2=0x55e3e4605ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:13.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 shutdown_connections 2024-09-12T02:04:13.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.130+0000 7f9be9b21f40 1 -- 172.21.15.19:0/112574330 wait complete. 2024-09-12T02:04:13.137 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put 200.00000000 - 2024-09-12T02:04:13.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.219+0000 7ffa57091f40 1 Processor -- start 2024-09-12T02:04:13.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.219+0000 7ffa57091f40 1 -- start start 2024-09-12T02:04:13.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.220+0000 7ffa57091f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5602482d4a10 0x56024828c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.220+0000 7ffa57091f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560248364130 0x5602483605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.220+0000 7ffa57091f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560248359d40 0x560248361160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.220+0000 7ffa57091f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5602482bb660 con 0x560248359d40 2024-09-12T02:04:13.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.220+0000 7ffa57091f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5602481de510 con 0x560248364130 2024-09-12T02:04:13.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.220+0000 7ffa57091f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56024828f0d0 con 0x5602482d4a10 2024-09-12T02:04:13.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.220+0000 7ffa55388640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560248359d40 0x560248361160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.220+0000 7ffa55388640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560248359d40 0x560248361160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57570/0 (socket says 172.21.15.19:57570) 2024-09-12T02:04:13.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.220+0000 7ffa55388640 1 -- 172.21.15.19:0/4084712895 learned_addr learned my addr 172.21.15.19:0/4084712895 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:13.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.220+0000 7ffa54b87640 1 --2- 172.21.15.19:0/4084712895 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5602482d4a10 0x56024828c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.220+0000 7ffa4ffff640 1 --2- 172.21.15.19:0/4084712895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560248364130 0x5602483605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.221+0000 7ffa55388640 1 -- 172.21.15.19:0/4084712895 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5602482d4a10 msgr2=0x56024828c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:13.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.221+0000 7ffa55388640 1 --2- 172.21.15.19:0/4084712895 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5602482d4a10 0x56024828c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.221+0000 7ffa55388640 1 -- 172.21.15.19:0/4084712895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560248364130 msgr2=0x5602483605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:13.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.221+0000 7ffa55388640 1 --2- 172.21.15.19:0/4084712895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560248364130 0x5602483605e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.221+0000 7ffa55388640 1 -- 172.21.15.19:0/4084712895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56024835aa20 con 0x560248359d40 2024-09-12T02:04:13.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.221+0000 7ffa4ffff640 1 --2- 172.21.15.19:0/4084712895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560248364130 0x5602483605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:13.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.221+0000 7ffa55388640 1 --2- 172.21.15.19:0/4084712895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560248359d40 0x560248361160 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000c4b0 tx=0x7ffa5000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277246c76140f648 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:13.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.221+0000 7ffa4effd640 1 -- 172.21.15.19:0/4084712895 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa500115f0 con 0x560248359d40 2024-09-12T02:04:13.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.221+0000 7ffa4effd640 1 -- 172.21.15.19:0/4084712895 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa50011790 con 0x560248359d40 2024-09-12T02:04:13.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.221+0000 7ffa4effd640 1 -- 172.21.15.19:0/4084712895 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa50011b80 con 0x560248359d40 2024-09-12T02:04:13.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.221+0000 7ffa57091f40 1 -- 172.21.15.19:0/4084712895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560248359d40 msgr2=0x560248361160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.221+0000 7ffa57091f40 1 --2- 172.21.15.19:0/4084712895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560248359d40 0x560248361160 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000c4b0 tx=0x7ffa5000c970 comp rx=0 tx=0).stop 2024-09-12T02:04:13.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.221+0000 7ffa57091f40 1 -- 172.21.15.19:0/4084712895 shutdown_connections 2024-09-12T02:04:13.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.221+0000 7ffa57091f40 1 --2- 172.21.15.19:0/4084712895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560248359d40 0x560248361160 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.221+0000 7ffa57091f40 1 --2- 172.21.15.19:0/4084712895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560248364130 0x5602483605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.221+0000 7ffa57091f40 1 --2- 172.21.15.19:0/4084712895 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5602482d4a10 0x56024828c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.221+0000 7ffa57091f40 1 -- 172.21.15.19:0/4084712895 >> 172.21.15.19:0/4084712895 conn(0x56024828c9e0 msgr2=0x5602482b74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:13.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.221+0000 7ffa57091f40 1 -- 172.21.15.19:0/4084712895 shutdown_connections 2024-09-12T02:04:13.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.222+0000 7ffa57091f40 1 -- 172.21.15.19:0/4084712895 wait complete. 2024-09-12T02:04:13.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.222+0000 7ffa57091f40 1 Processor -- start 2024-09-12T02:04:13.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.222+0000 7ffa57091f40 1 -- start start 2024-09-12T02:04:13.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa57091f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5602482d4a10 0x5602482d4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa57091f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560248359d40 0x56024834c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa57091f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560248364130 0x5602483f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa57091f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56024835f4b0 con 0x560248359d40 2024-09-12T02:04:13.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa57091f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5602482d3bb0 con 0x560248364130 2024-09-12T02:04:13.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa57091f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56024835f020 con 0x5602482d4a10 2024-09-12T02:04:13.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa4ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560248359d40 0x56024834c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa4ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560248359d40 0x56024834c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57586/0 (socket says 172.21.15.19:57586) 2024-09-12T02:04:13.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa4ffff640 1 -- 172.21.15.19:0/2219248402 learned_addr learned my addr 172.21.15.19:0/2219248402 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:13.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa55388640 1 --2- 172.21.15.19:0/2219248402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560248364130 0x5602483f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa54b87640 1 --2- 172.21.15.19:0/2219248402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5602482d4a10 0x5602482d4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa4ffff640 1 -- 172.21.15.19:0/2219248402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5602482d4a10 msgr2=0x5602482d4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa4ffff640 1 --2- 172.21.15.19:0/2219248402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5602482d4a10 0x5602482d4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa4ffff640 1 -- 172.21.15.19:0/2219248402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560248364130 msgr2=0x5602483f2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa4ffff640 1 --2- 172.21.15.19:0/2219248402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560248364130 0x5602483f2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa4ffff640 1 -- 172.21.15.19:0/2219248402 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560248351c20 con 0x560248359d40 2024-09-12T02:04:13.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa4ffff640 1 --2- 172.21.15.19:0/2219248402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560248359d40 0x56024834c3e0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7ffa400011e0 tx=0x7ffa4000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:13.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa4dffb640 1 -- 172.21.15.19:0/2219248402 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa400032d0 con 0x560248359d40 2024-09-12T02:04:13.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.223+0000 7ffa4dffb640 1 -- 172.21.15.19:0/2219248402 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa40016070 con 0x560248359d40 2024-09-12T02:04:13.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.224+0000 7ffa57091f40 1 -- 172.21.15.19:0/2219248402 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56024834f8b0 con 0x560248359d40 2024-09-12T02:04:13.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.224+0000 7ffa4dffb640 1 -- 172.21.15.19:0/2219248402 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa400016c0 con 0x560248359d40 2024-09-12T02:04:13.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.224+0000 7ffa57091f40 1 -- 172.21.15.19:0/2219248402 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602483521a0 con 0x560248359d40 2024-09-12T02:04:13.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.225+0000 7ffa4dffb640 1 -- 172.21.15.19:0/2219248402 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa40001860 con 0x560248359d40 2024-09-12T02:04:13.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.225+0000 7ffa4dffb640 1 --2- 172.21.15.19:0/2219248402 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffa3806a810 0x7ffa3806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.225+0000 7ffa4dffb640 1 -- 172.21.15.19:0/2219248402 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 7593+0+0 (secure 0 0 0) 0x7ffa4008a1d0 con 0x560248359d40 2024-09-12T02:04:13.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.226+0000 7ffa54b87640 1 --2- 172.21.15.19:0/2219248402 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffa3806a810 0x7ffa3806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.226+0000 7ffa57091f40 1 --2- 172.21.15.19:0/2219248402 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x56024834c920 0x560248352bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.226+0000 7ffa57091f40 1 -- 172.21.15.19:0/2219248402 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:1 13.14 13:292cf221:::200.00000000:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x56024834cea0 con 0x56024834c920 2024-09-12T02:04:13.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.226+0000 7ffa55388640 1 --2- 172.21.15.19:0/2219248402 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x56024834c920 0x560248352bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.226+0000 7ffa54b87640 1 --2- 172.21.15.19:0/2219248402 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffa3806a810 0x7ffa3806ccd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ffa48057000 tx=0x7ffa48052000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:13.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.226+0000 7ffa55388640 1 --2- 172.21.15.19:0/2219248402 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x56024834c920 0x560248352bd0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:13.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.227+0000 7ffa55388640 1 -- 172.21.15.19:0/2219248402 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(1 200.00000000 [writefull 0~80] v110'374 uv374 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa500119c0 con 0x56024834c920 2024-09-12T02:04:13.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.227+0000 7ffa57091f40 1 -- 172.21.15.19:0/2219248402 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x56024834c920 msgr2=0x560248352bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.227+0000 7ffa57091f40 1 --2- 172.21.15.19:0/2219248402 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x56024834c920 0x560248352bd0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.227+0000 7ffa57091f40 1 -- 172.21.15.19:0/2219248402 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffa3806a810 msgr2=0x7ffa3806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.227+0000 7ffa57091f40 1 --2- 172.21.15.19:0/2219248402 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffa3806a810 0x7ffa3806ccd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ffa48057000 tx=0x7ffa48052000 comp rx=0 tx=0).stop 2024-09-12T02:04:13.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.227+0000 7ffa57091f40 1 -- 172.21.15.19:0/2219248402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560248359d40 msgr2=0x56024834c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.227+0000 7ffa57091f40 1 --2- 172.21.15.19:0/2219248402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560248359d40 0x56024834c3e0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7ffa400011e0 tx=0x7ffa4000b5b0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.228+0000 7ffa55388640 1 -- 172.21.15.19:0/2219248402 reap_dead start 2024-09-12T02:04:13.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.228+0000 7ffa57091f40 1 -- 172.21.15.19:0/2219248402 shutdown_connections 2024-09-12T02:04:13.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.228+0000 7ffa57091f40 1 -- 172.21.15.19:0/2219248402 >> 172.21.15.19:0/2219248402 conn(0x56024828c9e0 msgr2=0x560248360100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:13.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.228+0000 7ffa57091f40 1 -- 172.21.15.19:0/2219248402 shutdown_connections 2024-09-12T02:04:13.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.228+0000 7ffa57091f40 1 -- 172.21.15.19:0/2219248402 wait complete. 2024-09-12T02:04:13.233 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:04:13.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.377+0000 7f62db496640 1 Processor -- start 2024-09-12T02:04:13.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.377+0000 7f62db496640 1 -- start start 2024-09-12T02:04:13.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.378+0000 7f62db496640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f62d4161a20 0x7f62d40d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.378+0000 7f62db496640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f62d40cf330 0x7f62d406d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.378+0000 7f62db496640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62d40d1830 con 0x7f62d40d1420 2024-09-12T02:04:13.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.378+0000 7f62db496640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f62d40cf760 con 0x7f62d40cf330 2024-09-12T02:04:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.378+0000 7f62db496640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f62d4161e00 con 0x7f62d4161a20 2024-09-12T02:04:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.378+0000 7f62d9a33640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f62d40cf330 0x7f62d406d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.378+0000 7f62d8a31640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f62d40d1420 0x7f62d40cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49100/0 (socket says 172.21.15.19:49100) 2024-09-12T02:04:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.378+0000 7f62d8a31640 1 -- 172.21.15.19:0/3439591039 learned_addr learned my addr 172.21.15.19:0/3439591039 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.378+0000 7f62d9a33640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f62d40cf330 0x7f62d406d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57590/0 (socket says 172.21.15.19:57590) 2024-09-12T02:04:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.378+0000 7f62d9232640 1 --2- 172.21.15.19:0/3439591039 >> v2:172.21.15.135:3300/0 conn(0x7f62d4161a20 0x7f62d40d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.379+0000 7f62d9a33640 1 -- 172.21.15.19:0/3439591039 >> v2:172.21.15.135:3300/0 conn(0x7f62d4161a20 msgr2=0x7f62d40d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.379+0000 7f62d9a33640 1 --2- 172.21.15.19:0/3439591039 >> v2:172.21.15.135:3300/0 conn(0x7f62d4161a20 0x7f62d40d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.379+0000 7f62d9a33640 1 -- 172.21.15.19:0/3439591039 >> v1:172.21.15.19:6789/0 conn(0x7f62d40d1420 legacy=0x7f62d40cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.379+0000 7f62d9a33640 1 -- 172.21.15.19:0/3439591039 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d40cf980 con 0x7f62d40cf330 2024-09-12T02:04:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.379+0000 7f62cbfff640 1 -- 172.21.15.19:0/3439591039 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3052466910 0 0) 0x7f62c4001110 con 0x7f62d40d1420 2024-09-12T02:04:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.379+0000 7f62d9a33640 1 --2- 172.21.15.19:0/3439591039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d40cf330 0x7f62d406d810 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f62d408c910 tx=0x7f62cc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4fe20089bdd06ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.379+0000 7f62cbfff640 1 -- 172.21.15.19:0/3439591039 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc007740 con 0x7f62d40cf330 2024-09-12T02:04:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.379+0000 7f62cbfff640 1 -- 172.21.15.19:0/3439591039 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62cc0078e0 con 0x7f62d40cf330 2024-09-12T02:04:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.379+0000 7f62cbfff640 1 -- 172.21.15.19:0/3439591039 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc007cb0 con 0x7f62d40cf330 2024-09-12T02:04:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.380+0000 7f62db496640 1 -- 172.21.15.19:0/3439591039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d40cf330 msgr2=0x7f62d406d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.380+0000 7f62db496640 1 --2- 172.21.15.19:0/3439591039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d40cf330 0x7f62d406d810 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f62d408c910 tx=0x7f62cc02a680 comp rx=0 tx=0).stop 2024-09-12T02:04:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.380+0000 7f62db496640 1 -- 172.21.15.19:0/3439591039 shutdown_connections 2024-09-12T02:04:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.380+0000 7f62db496640 1 --2- 172.21.15.19:0/3439591039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d40cf330 0x7f62d406d810 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.380+0000 7f62db496640 1 --2- 172.21.15.19:0/3439591039 >> v2:172.21.15.135:3300/0 conn(0x7f62d4161a20 0x7f62d40d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.380+0000 7f62db496640 1 -- 172.21.15.19:0/3439591039 >> 172.21.15.19:0/3439591039 conn(0x7f62d409d850 msgr2=0x7f62d408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:13.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.380+0000 7f62db496640 1 -- 172.21.15.19:0/3439591039 shutdown_connections 2024-09-12T02:04:13.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.380+0000 7f62db496640 1 -- 172.21.15.19:0/3439591039 wait complete. 2024-09-12T02:04:13.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.381+0000 7f62db496640 1 Processor -- start 2024-09-12T02:04:13.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.381+0000 7f62db496640 1 -- start start 2024-09-12T02:04:13.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.382+0000 7f62db496640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62d40cf330 0x7f62d4152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.382+0000 7f62db496640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d40d1420 0x7f62d40b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.382+0000 7f62db496640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d4161a20 0x7f62d40b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.382+0000 7f62db496640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f62d40cff00 con 0x7f62d40d1420 2024-09-12T02:04:13.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.382+0000 7f62db496640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f62d406d050 con 0x7f62d4161a20 2024-09-12T02:04:13.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.382+0000 7f62db496640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f62d406d2f0 con 0x7f62d40cf330 2024-09-12T02:04:13.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.382+0000 7f62d8a31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d40d1420 0x7f62d40b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.382+0000 7f62d8a31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d40d1420 0x7f62d40b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57594/0 (socket says 172.21.15.19:57594) 2024-09-12T02:04:13.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.382+0000 7f62d8a31640 1 -- 172.21.15.19:0/1999491004 learned_addr learned my addr 172.21.15.19:0/1999491004 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:13.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.383+0000 7f62d9a33640 1 --2- 172.21.15.19:0/1999491004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d4161a20 0x7f62d40b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.383+0000 7f62d9232640 1 --2- 172.21.15.19:0/1999491004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62d40cf330 0x7f62d4152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.383+0000 7f62d8a31640 1 -- 172.21.15.19:0/1999491004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62d40cf330 msgr2=0x7f62d4152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.383+0000 7f62d8a31640 1 --2- 172.21.15.19:0/1999491004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62d40cf330 0x7f62d4152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.383+0000 7f62d8a31640 1 -- 172.21.15.19:0/1999491004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d4161a20 msgr2=0x7f62d40b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.383+0000 7f62d8a31640 1 --2- 172.21.15.19:0/1999491004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d4161a20 0x7f62d40b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.383+0000 7f62d8a31640 1 -- 172.21.15.19:0/1999491004 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d40b4060 con 0x7f62d40d1420 2024-09-12T02:04:13.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.383+0000 7f62d9a33640 1 --2- 172.21.15.19:0/1999491004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d4161a20 0x7f62d40b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:13.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.383+0000 7f62d9232640 1 --2- 172.21.15.19:0/1999491004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62d40cf330 0x7f62d4152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:13.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.383+0000 7f62d8a31640 1 --2- 172.21.15.19:0/1999491004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d40d1420 0x7f62d40b4e20 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f62c400c7b0 tx=0x7f62c400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:13.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.383+0000 7f62c9ffb640 1 -- 172.21.15.19:0/1999491004 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c4018070 con 0x7f62d40d1420 2024-09-12T02:04:13.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.383+0000 7f62c9ffb640 1 -- 172.21.15.19:0/1999491004 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62c40072d0 con 0x7f62d40d1420 2024-09-12T02:04:13.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.383+0000 7f62db496640 1 -- 172.21.15.19:0/1999491004 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d40b4340 con 0x7f62d40d1420 2024-09-12T02:04:13.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.383+0000 7f62c9ffb640 1 -- 172.21.15.19:0/1999491004 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c40047e0 con 0x7f62d40d1420 2024-09-12T02:04:13.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.383+0000 7f62db496640 1 -- 172.21.15.19:0/1999491004 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d4152e90 con 0x7f62d40d1420 2024-09-12T02:04:13.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.384+0000 7f62db496640 1 -- 172.21.15.19:0/1999491004 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62d40b1040 con 0x7f62d40d1420 2024-09-12T02:04:13.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.385+0000 7f62c9ffb640 1 -- 172.21.15.19:0/1999491004 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f62c401b070 con 0x7f62d40d1420 2024-09-12T02:04:13.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.385+0000 7f62c9ffb640 1 --2- 172.21.15.19:0/1999491004 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f62b806be60 0x7f62b806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:13.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.386+0000 7f62c9ffb640 1 -- 172.21.15.19:0/1999491004 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 7593+0+0 (secure 0 0 0) 0x7f62c408a9c0 con 0x7f62d40d1420 2024-09-12T02:04:13.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.386+0000 7f62d9232640 1 --2- 172.21.15.19:0/1999491004 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f62b806be60 0x7f62b806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:13.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.386+0000 7f62d9232640 1 --2- 172.21.15.19:0/1999491004 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f62b806be60 0x7f62b806e320 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009a20 tx=0x7f62d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:13.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.390+0000 7f62c9ffb640 1 -- 172.21.15.19:0/1999491004 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f62d40d1830 con 0x7f62d40d1420 2024-09-12T02:04:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.604+0000 7f62db496640 1 -- 172.21.15.19:0/1999491004 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f62d415e900 con 0x7f62d40d1420 2024-09-12T02:04:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.923+0000 7f62c9ffb640 1 -- 172.21.15.19:0/1999491004 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v174) ==== 162+0+0 (secure 0 0 0) 0x7f62c4058b70 con 0x7f62d40d1420 2024-09-12T02:04:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:04:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.925+0000 7f62db496640 1 -- 172.21.15.19:0/1999491004 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f62b806be60 msgr2=0x7f62b806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.925+0000 7f62db496640 1 --2- 172.21.15.19:0/1999491004 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f62b806be60 0x7f62b806e320 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009a20 tx=0x7f62d0008040 comp rx=0 tx=0).stop 2024-09-12T02:04:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.925+0000 7f62db496640 1 -- 172.21.15.19:0/1999491004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d40d1420 msgr2=0x7f62d40b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.925+0000 7f62db496640 1 --2- 172.21.15.19:0/1999491004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d40d1420 0x7f62d40b4e20 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f62c400c7b0 tx=0x7f62c400cc70 comp rx=0 tx=0).stop 2024-09-12T02:04:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.925+0000 7f62db496640 1 -- 172.21.15.19:0/1999491004 shutdown_connections 2024-09-12T02:04:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.925+0000 7f62db496640 1 --2- 172.21.15.19:0/1999491004 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f62b806be60 0x7f62b806e320 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.925+0000 7f62db496640 1 --2- 172.21.15.19:0/1999491004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d4161a20 0x7f62d40b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.925+0000 7f62db496640 1 --2- 172.21.15.19:0/1999491004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d40d1420 0x7f62d40b4e20 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.925+0000 7f62db496640 1 --2- 172.21.15.19:0/1999491004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62d40cf330 0x7f62d4152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.925+0000 7f62db496640 1 -- 172.21.15.19:0/1999491004 >> 172.21.15.19:0/1999491004 conn(0x7f62d409d850 msgr2=0x7f62d408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.925+0000 7f62db496640 1 -- 172.21.15.19:0/1999491004 shutdown_connections 2024-09-12T02:04:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:13.925+0000 7f62db496640 1 -- 172.21.15.19:0/1999491004 wait complete. 2024-09-12T02:04:13.935 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:04:13.936+0000 7fc5d2a8b640 -1 log_channel(cluster) log [ERR] : Error recovering journal 0x200: (22) Invalid argument 2024-09-12T02:04:13.936 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:13.936+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:04:13.936 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:13.936+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:04:13.938 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:14.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.044+0000 7fb972f66640 1 Processor -- start 2024-09-12T02:04:14.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.044+0000 7fb972f66640 1 -- start start 2024-09-12T02:04:14.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.044+0000 7fb972f66640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb96c161c80 0x7fb96c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.044+0000 7fb972f66640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb96c162060 0x7fb96c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.044+0000 7fb972f66640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb96c06e870 con 0x7fb96c0b64b0 2024-09-12T02:04:14.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.044+0000 7fb972f66640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb96c06d9f0 con 0x7fb96c161c80 2024-09-12T02:04:14.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb972f66640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb96c06dcd0 con 0x7fb96c162060 2024-09-12T02:04:14.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb971503640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb96c0b64b0 0x7fb96c162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49114/0 (socket says 172.21.15.19:49114) 2024-09-12T02:04:14.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb971503640 1 -- 172.21.15.19:0/3820621854 learned_addr learned my addr 172.21.15.19:0/3820621854 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:14.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb96bfff640 1 --2- 172.21.15.19:0/3820621854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb96c162060 0x7fb96c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb970d02640 1 --2- 172.21.15.19:0/3820621854 >> v2:172.21.15.135:3300/0 conn(0x7fb96c161c80 0x7fb96c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb96b7fe640 1 -- 172.21.15.19:0/3820621854 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4043545579 0 0) 0x7fb964001490 con 0x7fb96c0b64b0 2024-09-12T02:04:14.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb96b7fe640 1 -- 172.21.15.19:0/3820621854 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb95c003520 con 0x7fb96c0b64b0 2024-09-12T02:04:14.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb96b7fe640 1 -- 172.21.15.19:0/3820621854 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 773728704 0 0) 0x7fb95c003520 con 0x7fb96c0b64b0 2024-09-12T02:04:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb96b7fe640 1 -- 172.21.15.19:0/3820621854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb96c162060 msgr2=0x7fb96c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb96b7fe640 1 --2- 172.21.15.19:0/3820621854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb96c162060 0x7fb96c0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb96b7fe640 1 -- 172.21.15.19:0/3820621854 >> v2:172.21.15.135:3300/0 conn(0x7fb96c161c80 msgr2=0x7fb96c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb96b7fe640 1 --2- 172.21.15.19:0/3820621854 >> v2:172.21.15.135:3300/0 conn(0x7fb96c161c80 0x7fb96c06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb96b7fe640 1 -- 172.21.15.19:0/3820621854 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96c06dfb0 con 0x7fb96c0b64b0 2024-09-12T02:04:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb96b7fe640 1 -- 172.21.15.19:0/3820621854 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fb964001bc0 con 0x7fb96c0b64b0 2024-09-12T02:04:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb96b7fe640 1 -- 172.21.15.19:0/3820621854 >> v1:172.21.15.19:6789/0 conn(0x7fb96c0b64b0 legacy=0x7fb96c162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb96b7fe640 1 --2- 172.21.15.19:0/3820621854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb95c0039b0 0x7fb95c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb96b7fe640 1 --2- 172.21.15.19:0/3820621854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb96c162060 0x7fb95c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb96b7fe640 1 --2- 172.21.15.19:0/3820621854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb95c004d40 0x7fb95c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb96b7fe640 1 -- 172.21.15.19:0/3820621854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c06d9f0 con 0x7fb95c004d40 2024-09-12T02:04:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb96b7fe640 1 -- 172.21.15.19:0/3820621854 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c06dcd0 con 0x7fb95c0039b0 2024-09-12T02:04:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb96b7fe640 1 -- 172.21.15.19:0/3820621854 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb95c00b9c0 con 0x7fb96c162060 2024-09-12T02:04:14.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb971503640 1 --2- 172.21.15.19:0/3820621854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb95c004d40 0x7fb95c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb970d02640 1 --2- 172.21.15.19:0/3820621854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb95c0039b0 0x7fb95c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.045+0000 7fb96bfff640 1 --2- 172.21.15.19:0/3820621854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb96c162060 0x7fb95c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.046+0000 7fb971503640 1 -- 172.21.15.19:0/3820621854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb96c162060 msgr2=0x7fb95c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:14.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.046+0000 7fb971503640 1 --2- 172.21.15.19:0/3820621854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb96c162060 0x7fb95c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.046+0000 7fb971503640 1 -- 172.21.15.19:0/3820621854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb95c0039b0 msgr2=0x7fb95c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:14.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.046+0000 7fb971503640 1 --2- 172.21.15.19:0/3820621854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb95c0039b0 0x7fb95c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.046+0000 7fb971503640 1 -- 172.21.15.19:0/3820621854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95c003520 con 0x7fb95c004d40 2024-09-12T02:04:14.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.046+0000 7fb971503640 1 --2- 172.21.15.19:0/3820621854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb95c004d40 0x7fb95c0051c0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fb96400aa40 tx=0x7fb95c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50a4e5e9b17c9b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:14.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.047+0000 7fb96b7fe640 1 -- 172.21.15.19:0/3820621854 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96400a690 con 0x7fb95c004d40 2024-09-12T02:04:14.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.047+0000 7fb96b7fe640 1 -- 172.21.15.19:0/3820621854 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb96402f070 con 0x7fb95c004d40 2024-09-12T02:04:14.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.047+0000 7fb96b7fe640 1 -- 172.21.15.19:0/3820621854 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb964034470 con 0x7fb95c004d40 2024-09-12T02:04:14.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.047+0000 7fb972f66640 1 -- 172.21.15.19:0/3820621854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb95c004d40 msgr2=0x7fb95c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.047+0000 7fb972f66640 1 --2- 172.21.15.19:0/3820621854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb95c004d40 0x7fb95c0051c0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fb96400aa40 tx=0x7fb95c005830 comp rx=0 tx=0).stop 2024-09-12T02:04:14.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.047+0000 7fb971503640 1 -- 172.21.15.19:0/3820621854 reap_dead start 2024-09-12T02:04:14.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.047+0000 7fb972f66640 1 -- 172.21.15.19:0/3820621854 shutdown_connections 2024-09-12T02:04:14.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.047+0000 7fb972f66640 1 -- 172.21.15.19:0/3820621854 >> 172.21.15.19:0/3820621854 conn(0x7fb96c0d44f0 msgr2=0x7fb96c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:14.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.047+0000 7fb972f66640 1 -- 172.21.15.19:0/3820621854 shutdown_connections 2024-09-12T02:04:14.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.047+0000 7fb972f66640 1 -- 172.21.15.19:0/3820621854 wait complete. 2024-09-12T02:04:14.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.048+0000 7fb972f66640 1 Processor -- start 2024-09-12T02:04:14.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.048+0000 7fb972f66640 1 -- start start 2024-09-12T02:04:14.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.049+0000 7fb972f66640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb95c004d40 0x7fb96c153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.049+0000 7fb972f66640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb96c0cbfb0 0x7fb96c0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.049+0000 7fb972f66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb96c0b20b0 0x7fb96c0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.049+0000 7fb972f66640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c0d2a10 con 0x7fb96c0b20b0 2024-09-12T02:04:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.049+0000 7fb972f66640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c0d2890 con 0x7fb95c004d40 2024-09-12T02:04:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.049+0000 7fb972f66640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb96c0b5f70 con 0x7fb96c0cbfb0 2024-09-12T02:04:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.049+0000 7fb971503640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb96c0b20b0 0x7fb96c0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.049+0000 7fb971503640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb96c0b20b0 0x7fb96c0b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57612/0 (socket says 172.21.15.19:57612) 2024-09-12T02:04:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.049+0000 7fb971503640 1 -- 172.21.15.19:0/474746751 learned_addr learned my addr 172.21.15.19:0/474746751 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.050+0000 7fb96bfff640 1 --2- 172.21.15.19:0/474746751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb96c0cbfb0 0x7fb96c0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.050+0000 7fb970d02640 1 --2- 172.21.15.19:0/474746751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb95c004d40 0x7fb96c153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.050+0000 7fb971503640 1 -- 172.21.15.19:0/474746751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb96c0cbfb0 msgr2=0x7fb96c0cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.050+0000 7fb971503640 1 --2- 172.21.15.19:0/474746751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb96c0cbfb0 0x7fb96c0cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.050+0000 7fb971503640 1 -- 172.21.15.19:0/474746751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb95c004d40 msgr2=0x7fb96c153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.050+0000 7fb971503640 1 --2- 172.21.15.19:0/474746751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb95c004d40 0x7fb96c153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.050+0000 7fb971503640 1 -- 172.21.15.19:0/474746751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96c0ccff0 con 0x7fb96c0b20b0 2024-09-12T02:04:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.050+0000 7fb971503640 1 --2- 172.21.15.19:0/474746751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb96c0b20b0 0x7fb96c0b2530 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fb964000f80 tx=0x7fb96c06e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:14.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.050+0000 7fb9697fa640 1 -- 172.21.15.19:0/474746751 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb964039070 con 0x7fb96c0b20b0 2024-09-12T02:04:14.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.050+0000 7fb9697fa640 1 -- 172.21.15.19:0/474746751 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb964034470 con 0x7fb96c0b20b0 2024-09-12T02:04:14.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.050+0000 7fb972f66640 1 -- 172.21.15.19:0/474746751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb96c0cca30 con 0x7fb96c0b20b0 2024-09-12T02:04:14.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.050+0000 7fb9697fa640 1 -- 172.21.15.19:0/474746751 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96400a690 con 0x7fb96c0b20b0 2024-09-12T02:04:14.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.050+0000 7fb972f66640 1 -- 172.21.15.19:0/474746751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb96c0b8a50 con 0x7fb96c0b20b0 2024-09-12T02:04:14.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.051+0000 7fb972f66640 1 -- 172.21.15.19:0/474746751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb96c06e330 con 0x7fb96c0b20b0 2024-09-12T02:04:14.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.052+0000 7fb9697fa640 1 -- 172.21.15.19:0/474746751 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb964044060 con 0x7fb96c0b20b0 2024-09-12T02:04:14.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.052+0000 7fb9697fa640 1 --2- 172.21.15.19:0/474746751 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb95006be60 0x7fb95006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.052+0000 7fb9697fa640 1 -- 172.21.15.19:0/474746751 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 7679+0+0 (secure 0 0 0) 0x7fb9640ab090 con 0x7fb96c0b20b0 2024-09-12T02:04:14.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.052+0000 7fb970d02640 1 --2- 172.21.15.19:0/474746751 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb95006be60 0x7fb95006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.053+0000 7fb970d02640 1 --2- 172.21.15.19:0/474746751 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb95006be60 0x7fb95006e320 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb960009bc0 tx=0x7fb960009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:14.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.056+0000 7fb9697fa640 1 -- 172.21.15.19:0/474746751 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb96c06e870 con 0x7fb96c0b20b0 2024-09-12T02:04:14.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.270+0000 7fb972f66640 1 -- 172.21.15.19:0/474746751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb96c0d22e0 con 0x7fb96c0b20b0 2024-09-12T02:04:14.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.271+0000 7fb9697fa640 1 -- 172.21.15.19:0/474746751 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 176 v176) ==== 95+0+3563 (secure 0 0 0) 0x7fb964079350 con 0x7fb96c0b20b0 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":176,"btime":"2024-09-12T02:04:13:937402+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":176,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:13.937352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 176 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.273+0000 7fb972f66640 1 -- 172.21.15.19:0/474746751 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb95006be60 msgr2=0x7fb95006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.273+0000 7fb972f66640 1 --2- 172.21.15.19:0/474746751 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb95006be60 0x7fb95006e320 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb960009bc0 tx=0x7fb960009190 comp rx=0 tx=0).stop 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.273+0000 7fb972f66640 1 -- 172.21.15.19:0/474746751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb96c0b20b0 msgr2=0x7fb96c0b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.273+0000 7fb972f66640 1 --2- 172.21.15.19:0/474746751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb96c0b20b0 0x7fb96c0b2530 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fb964000f80 tx=0x7fb96c06e180 comp rx=0 tx=0).stop 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.273+0000 7fb972f66640 1 -- 172.21.15.19:0/474746751 shutdown_connections 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.273+0000 7fb972f66640 1 --2- 172.21.15.19:0/474746751 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb95006be60 0x7fb95006e320 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.273+0000 7fb972f66640 1 --2- 172.21.15.19:0/474746751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb96c0b20b0 0x7fb96c0b2530 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.273+0000 7fb972f66640 1 --2- 172.21.15.19:0/474746751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb96c0cbfb0 0x7fb96c0cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.273+0000 7fb972f66640 1 --2- 172.21.15.19:0/474746751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb95c004d40 0x7fb96c153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.273+0000 7fb972f66640 1 -- 172.21.15.19:0/474746751 >> 172.21.15.19:0/474746751 conn(0x7fb96c0d44f0 msgr2=0x7fb96c0b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:14.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.273+0000 7fb972f66640 1 -- 172.21.15.19:0/474746751 shutdown_connections 2024-09-12T02:04:14.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.273+0000 7fb972f66640 1 -- 172.21.15.19:0/474746751 wait complete. 2024-09-12T02:04:14.285 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:14.285 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:14.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.387+0000 7fd7d2ae6640 1 Processor -- start 2024-09-12T02:04:14.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.387+0000 7fd7d2ae6640 1 -- start start 2024-09-12T02:04:14.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.387+0000 7fd7d2ae6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd7cc0d1090 0x7fd7cc09b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.387+0000 7fd7d2ae6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7cc0cec00 con 0x7fd7cc15c520 2024-09-12T02:04:14.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.387+0000 7fd7d2ae6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7cc09bd90 con 0x7fd7cc0b1620 2024-09-12T02:04:14.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.387+0000 7fd7d2ae6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd7cc0d0010 con 0x7fd7cc0d1090 2024-09-12T02:04:14.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.388+0000 7fd7cbfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd7cc0d1090 0x7fd7cc09b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.388+0000 7fd7d0882640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd7cc15c520 0x7fd7cc0d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49126/0 (socket says 172.21.15.19:49126) 2024-09-12T02:04:14.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.388+0000 7fd7d0882640 1 -- 172.21.15.19:0/1969847399 learned_addr learned my addr 172.21.15.19:0/1969847399 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:14.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.388+0000 7fd7cbfff640 1 -- 172.21.15.19:0/1969847399 >> v1:172.21.15.135:6789/0 conn(0x7fd7cc0b1620 legacy=0x7fd7cc0cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:14.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.388+0000 7fd7cbfff640 1 -- 172.21.15.19:0/1969847399 >> v1:172.21.15.19:6789/0 conn(0x7fd7cc15c520 legacy=0x7fd7cc0d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.388+0000 7fd7cb7fe640 1 -- 172.21.15.19:0/1969847399 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2115841749 0 0) 0x7fd7cc0cec00 con 0x7fd7cc15c520 2024-09-12T02:04:14.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.388+0000 7fd7cbfff640 1 -- 172.21.15.19:0/1969847399 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc0d02f0 con 0x7fd7cc0d1090 2024-09-12T02:04:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.389+0000 7fd7cbfff640 1 --2- 172.21.15.19:0/1969847399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7cc0d1090 0x7fd7cc09b720 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40097a0 tx=0x7fd7b402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76e258f4311c144 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.389+0000 7fd7cb7fe640 1 -- 172.21.15.19:0/1969847399 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4037070 con 0x7fd7cc0d1090 2024-09-12T02:04:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.389+0000 7fd7cb7fe640 1 -- 172.21.15.19:0/1969847399 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b4032440 con 0x7fd7cc0d1090 2024-09-12T02:04:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.389+0000 7fd7cb7fe640 1 -- 172.21.15.19:0/1969847399 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4032810 con 0x7fd7cc0d1090 2024-09-12T02:04:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.389+0000 7fd7d2ae6640 1 -- 172.21.15.19:0/1969847399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7cc0d1090 msgr2=0x7fd7cc09b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.389+0000 7fd7d2ae6640 1 --2- 172.21.15.19:0/1969847399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7cc0d1090 0x7fd7cc09b720 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40097a0 tx=0x7fd7b402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.389+0000 7fd7d2ae6640 1 -- 172.21.15.19:0/1969847399 shutdown_connections 2024-09-12T02:04:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.389+0000 7fd7d2ae6640 1 --2- 172.21.15.19:0/1969847399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7cc0d1090 0x7fd7cc09b720 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.389+0000 7fd7d2ae6640 1 -- 172.21.15.19:0/1969847399 >> 172.21.15.19:0/1969847399 conn(0x7fd7cc0d23a0 msgr2=0x7fd7cc0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.389+0000 7fd7d2ae6640 1 -- 172.21.15.19:0/1969847399 shutdown_connections 2024-09-12T02:04:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.389+0000 7fd7d2ae6640 1 -- 172.21.15.19:0/1969847399 wait complete. 2024-09-12T02:04:14.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.391+0000 7fd7d2ae6640 1 Processor -- start 2024-09-12T02:04:14.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.391+0000 7fd7d2ae6640 1 -- start start 2024-09-12T02:04:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.391+0000 7fd7d2ae6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7cc0b1620 0x7fd7cc0b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7d2ae6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7cc0d1090 0x7fd7cc153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7d2ae6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7cc15c520 0x7fd7cc0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7d2ae6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc15c900 con 0x7fd7cc0b1620 2024-09-12T02:04:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7d2ae6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc0d05d0 con 0x7fd7cc15c520 2024-09-12T02:04:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7d2ae6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd7cc0b7f50 con 0x7fd7cc0d1090 2024-09-12T02:04:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7d0882640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7cc0b1620 0x7fd7cc0b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7d0882640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7cc0b1620 0x7fd7cc0b7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57642/0 (socket says 172.21.15.19:57642) 2024-09-12T02:04:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7d0882640 1 -- 172.21.15.19:0/2234220410 learned_addr learned my addr 172.21.15.19:0/2234220410 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7d1083640 1 --2- 172.21.15.19:0/2234220410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7cc15c520 0x7fd7cc0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7cbfff640 1 --2- 172.21.15.19:0/2234220410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7cc0d1090 0x7fd7cc153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7d0882640 1 -- 172.21.15.19:0/2234220410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7cc0d1090 msgr2=0x7fd7cc153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7d0882640 1 --2- 172.21.15.19:0/2234220410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7cc0d1090 0x7fd7cc153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7d0882640 1 -- 172.21.15.19:0/2234220410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7cc15c520 msgr2=0x7fd7cc0b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7d0882640 1 --2- 172.21.15.19:0/2234220410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7cc15c520 0x7fd7cc0b6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7d0882640 1 -- 172.21.15.19:0/2234220410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc1536d0 con 0x7fd7cc0b1620 2024-09-12T02:04:14.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7d1083640 1 --2- 172.21.15.19:0/2234220410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7cc15c520 0x7fd7cc0b6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:14.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7d0882640 1 --2- 172.21.15.19:0/2234220410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7cc0b1620 0x7fd7cc0b7a10 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00c7c0 tx=0x7fd7bc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:14.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7c97fa640 1 -- 172.21.15.19:0/2234220410 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc018070 con 0x7fd7cc0b1620 2024-09-12T02:04:14.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7c97fa640 1 -- 172.21.15.19:0/2234220410 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7bc00a640 con 0x7fd7cc0b1620 2024-09-12T02:04:14.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7d2ae6640 1 -- 172.21.15.19:0/2234220410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7cc0b5350 con 0x7fd7cc0b1620 2024-09-12T02:04:14.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7c97fa640 1 -- 172.21.15.19:0/2234220410 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc00aa30 con 0x7fd7cc0b1620 2024-09-12T02:04:14.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.392+0000 7fd7d2ae6640 1 -- 172.21.15.19:0/2234220410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7cc0b5910 con 0x7fd7cc0b1620 2024-09-12T02:04:14.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.393+0000 7fd7d2ae6640 1 -- 172.21.15.19:0/2234220410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7cc09b720 con 0x7fd7cc0b1620 2024-09-12T02:04:14.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.394+0000 7fd7c97fa640 1 -- 172.21.15.19:0/2234220410 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd7bc01b070 con 0x7fd7cc0b1620 2024-09-12T02:04:14.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.394+0000 7fd7c97fa640 1 --2- 172.21.15.19:0/2234220410 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd7ac06be30 0x7fd7ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.394+0000 7fd7c97fa640 1 -- 172.21.15.19:0/2234220410 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 7679+0+0 (secure 0 0 0) 0x7fd7bc08ab70 con 0x7fd7cc0b1620 2024-09-12T02:04:14.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.395+0000 7fd7cbfff640 1 --2- 172.21.15.19:0/2234220410 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd7ac06be30 0x7fd7ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.395+0000 7fd7cbfff640 1 --2- 172.21.15.19:0/2234220410 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd7ac06be30 0x7fd7ac06e2f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4034000 tx=0x7fd7b402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:14.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.399+0000 7fd7c97fa640 1 -- 172.21.15.19:0/2234220410 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd7bc058e00 con 0x7fd7cc0b1620 2024-09-12T02:04:14.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.610+0000 7fd7d2ae6640 1 -- 172.21.15.19:0/2234220410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7cc09aa80 con 0x7fd7cc0b1620 2024-09-12T02:04:14.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.611+0000 7fd7c97fa640 1 -- 172.21.15.19:0/2234220410 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 176 v176) ==== 95+0+3563 (secure 0 0 0) 0x7fd7bc058700 con 0x7fd7cc0b1620 2024-09-12T02:04:14.611 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:14.611 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":176,"btime":"2024-09-12T02:04:13:937402+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":176,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:13.937352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:14.611 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 176 2024-09-12T02:04:14.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.613+0000 7fd7d2ae6640 1 -- 172.21.15.19:0/2234220410 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd7ac06be30 msgr2=0x7fd7ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.613+0000 7fd7d2ae6640 1 --2- 172.21.15.19:0/2234220410 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd7ac06be30 0x7fd7ac06e2f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4034000 tx=0x7fd7b402e000 comp rx=0 tx=0).stop 2024-09-12T02:04:14.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.613+0000 7fd7d2ae6640 1 -- 172.21.15.19:0/2234220410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7cc0b1620 msgr2=0x7fd7cc0b7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.613+0000 7fd7d2ae6640 1 --2- 172.21.15.19:0/2234220410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7cc0b1620 0x7fd7cc0b7a10 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00c7c0 tx=0x7fd7bc00cc80 comp rx=0 tx=0).stop 2024-09-12T02:04:14.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.613+0000 7fd7d2ae6640 1 -- 172.21.15.19:0/2234220410 shutdown_connections 2024-09-12T02:04:14.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.613+0000 7fd7d2ae6640 1 --2- 172.21.15.19:0/2234220410 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd7ac06be30 0x7fd7ac06e2f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.613+0000 7fd7d2ae6640 1 --2- 172.21.15.19:0/2234220410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7cc15c520 0x7fd7cc0b6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.613+0000 7fd7d2ae6640 1 --2- 172.21.15.19:0/2234220410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7cc0d1090 0x7fd7cc153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.613+0000 7fd7d2ae6640 1 --2- 172.21.15.19:0/2234220410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7cc0b1620 0x7fd7cc0b7a10 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.613+0000 7fd7d2ae6640 1 -- 172.21.15.19:0/2234220410 >> 172.21.15.19:0/2234220410 conn(0x7fd7cc0d23a0 msgr2=0x7fd7cc06e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:14.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.613+0000 7fd7d2ae6640 1 -- 172.21.15.19:0/2234220410 shutdown_connections 2024-09-12T02:04:14.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.613+0000 7fd7d2ae6640 1 -- 172.21.15.19:0/2234220410 wait complete. 2024-09-12T02:04:14.624 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:14.625 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:14.657 INFO:tasks.ceph.mds.c.smithi019.stderr: -37> 2024-09-12T02:04:09.905+0000 7fd5a6bb8640 -1 mds.0.cache.ino(0x1) Corrupt inode 0x1: End of buffer [buffer:2] 2024-09-12T02:04:14.657 INFO:tasks.ceph.mds.c.smithi019.stderr: -35> 2024-09-12T02:04:09.905+0000 7fd5a6bb8640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2024-09-12T02:04:14.682 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:04:14.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.729+0000 7f8df764c640 1 Processor -- start 2024-09-12T02:04:14.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.729+0000 7f8df764c640 1 -- start start 2024-09-12T02:04:14.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.730+0000 7f8df764c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8df00d30f0 0x7f8df00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.730+0000 7f8df764c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df00d3690 con 0x7f8df00b64c0 2024-09-12T02:04:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.730+0000 7f8df764c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df00d3970 con 0x7f8df015e5f0 2024-09-12T02:04:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.730+0000 7f8df764c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f8df006d530 con 0x7f8df00d30f0 2024-09-12T02:04:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.730+0000 7f8df5be9640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8df00b64c0 0x7f8df006d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49140/0 (socket says 172.21.15.19:49140) 2024-09-12T02:04:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.730+0000 7f8df5be9640 1 -- 172.21.15.19:0/427476061 learned_addr learned my addr 172.21.15.19:0/427476061 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.730+0000 7f8df4be7640 1 --2- 172.21.15.19:0/427476061 >> v2:172.21.15.135:3300/0 conn(0x7f8df00d30f0 0x7f8df00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.730+0000 7f8de7fff640 1 -- 172.21.15.19:0/427476061 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3477511725 0 0) 0x7f8df00d3690 con 0x7f8df00b64c0 2024-09-12T02:04:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.730+0000 7f8de7fff640 1 -- 172.21.15.19:0/427476061 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ddc003520 con 0x7f8df00b64c0 2024-09-12T02:04:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8de7fff640 1 -- 172.21.15.19:0/427476061 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1731785582 0 0) 0x7f8ddc003520 con 0x7f8df00b64c0 2024-09-12T02:04:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8de7fff640 1 -- 172.21.15.19:0/427476061 >> v2:172.21.15.135:3300/0 conn(0x7f8df00d30f0 msgr2=0x7f8df00b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8de7fff640 1 --2- 172.21.15.19:0/427476061 >> v2:172.21.15.135:3300/0 conn(0x7f8df00d30f0 0x7f8df00b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8de7fff640 1 -- 172.21.15.19:0/427476061 >> v1:172.21.15.135:6789/0 conn(0x7f8df015e5f0 legacy=0x7f8df00d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8de7fff640 1 -- 172.21.15.19:0/427476061 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df006cee0 con 0x7f8df00b64c0 2024-09-12T02:04:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8de7fff640 1 -- 172.21.15.19:0/427476061 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f8de80019f0 con 0x7f8df00b64c0 2024-09-12T02:04:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8de7fff640 1 -- 172.21.15.19:0/427476061 >> v1:172.21.15.19:6789/0 conn(0x7f8df00b64c0 legacy=0x7f8df006d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8de7fff640 1 --2- 172.21.15.19:0/427476061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ddc0039b0 0x7f8ddc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8de7fff640 1 --2- 172.21.15.19:0/427476061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ddc004800 0x7f8ddc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8de7fff640 1 --2- 172.21.15.19:0/427476061 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ddc0051c0 0x7f8ddc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8de7fff640 1 -- 172.21.15.19:0/427476061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8df006d530 con 0x7f8ddc0039b0 2024-09-12T02:04:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8de7fff640 1 -- 172.21.15.19:0/427476061 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc00c060 con 0x7f8ddc004800 2024-09-12T02:04:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8de7fff640 1 -- 172.21.15.19:0/427476061 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8ddc00c260 con 0x7f8ddc0051c0 2024-09-12T02:04:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8df53e8640 1 --2- 172.21.15.19:0/427476061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ddc0039b0 0x7f8ddc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8df4be7640 1 --2- 172.21.15.19:0/427476061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ddc004800 0x7f8ddc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8df5be9640 1 --2- 172.21.15.19:0/427476061 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ddc0051c0 0x7f8ddc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8df53e8640 1 -- 172.21.15.19:0/427476061 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ddc0051c0 msgr2=0x7f8ddc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8df53e8640 1 --2- 172.21.15.19:0/427476061 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ddc0051c0 0x7f8ddc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8df53e8640 1 -- 172.21.15.19:0/427476061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ddc004800 msgr2=0x7f8ddc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8df53e8640 1 --2- 172.21.15.19:0/427476061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ddc004800 0x7f8ddc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8df5be9640 1 -- 172.21.15.19:0/427476061 reap_dead start 2024-09-12T02:04:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.731+0000 7f8df53e8640 1 -- 172.21.15.19:0/427476061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ddc003520 con 0x7f8ddc0039b0 2024-09-12T02:04:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.732+0000 7f8df53e8640 1 --2- 172.21.15.19:0/427476061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ddc0039b0 0x7f8ddc003dd0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f8dec001750 tx=0x7f8ddc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69aabf8d6b627c09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.732+0000 7f8de7fff640 1 -- 172.21.15.19:0/427476061 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec001370 con 0x7f8ddc0039b0 2024-09-12T02:04:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.732+0000 7f8de7fff640 1 -- 172.21.15.19:0/427476061 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dec0052d0 con 0x7f8ddc0039b0 2024-09-12T02:04:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.732+0000 7f8de7fff640 1 -- 172.21.15.19:0/427476061 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec02abe0 con 0x7f8ddc0039b0 2024-09-12T02:04:14.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.733+0000 7f8df764c640 1 -- 172.21.15.19:0/427476061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ddc0039b0 msgr2=0x7f8ddc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.733+0000 7f8df764c640 1 --2- 172.21.15.19:0/427476061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ddc0039b0 0x7f8ddc003dd0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f8dec001750 tx=0x7f8ddc005830 comp rx=0 tx=0).stop 2024-09-12T02:04:14.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.733+0000 7f8df764c640 1 -- 172.21.15.19:0/427476061 shutdown_connections 2024-09-12T02:04:14.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.733+0000 7f8df764c640 1 --2- 172.21.15.19:0/427476061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ddc0039b0 0x7f8ddc003dd0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.733+0000 7f8df764c640 1 -- 172.21.15.19:0/427476061 >> 172.21.15.19:0/427476061 conn(0x7f8df008bfc0 msgr2=0x7f8df00d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:14.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.733+0000 7f8df764c640 1 -- 172.21.15.19:0/427476061 shutdown_connections 2024-09-12T02:04:14.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.733+0000 7f8df764c640 1 -- 172.21.15.19:0/427476061 wait complete. 2024-09-12T02:04:14.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.734+0000 7f8df764c640 1 Processor -- start 2024-09-12T02:04:14.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.734+0000 7f8df764c640 1 -- start start 2024-09-12T02:04:14.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8df764c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ddc0039b0 0x7f8df01e7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8df764c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8df01e7650 0x7f8df00b9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8df764c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8df00b9a40 0x7f8df01f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8df764c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8df00b5f80 con 0x7f8ddc0039b0 2024-09-12T02:04:14.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8df764c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8df015e9d0 con 0x7f8df00b9a40 2024-09-12T02:04:14.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8df764c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8df00b6100 con 0x7f8df01e7650 2024-09-12T02:04:14.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8df53e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ddc0039b0 0x7f8df01e7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8df53e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ddc0039b0 0x7f8df01e7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57684/0 (socket says 172.21.15.19:57684) 2024-09-12T02:04:14.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8df53e8640 1 -- 172.21.15.19:0/3479062256 learned_addr learned my addr 172.21.15.19:0/3479062256 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:14.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8df4be7640 1 --2- 172.21.15.19:0/3479062256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8df01e7650 0x7f8df00b9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8df5be9640 1 --2- 172.21.15.19:0/3479062256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8df00b9a40 0x7f8df01f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8df53e8640 1 -- 172.21.15.19:0/3479062256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8df01e7650 msgr2=0x7f8df00b9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8df53e8640 1 --2- 172.21.15.19:0/3479062256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8df01e7650 0x7f8df00b9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8df53e8640 1 -- 172.21.15.19:0/3479062256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8df00b9a40 msgr2=0x7f8df01f3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8df53e8640 1 --2- 172.21.15.19:0/3479062256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8df00b9a40 0x7f8df01f3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8df53e8640 1 -- 172.21.15.19:0/3479062256 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df00c8f80 con 0x7f8ddc0039b0 2024-09-12T02:04:14.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8df4be7640 1 --2- 172.21.15.19:0/3479062256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8df01e7650 0x7f8df00b9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:14.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8df53e8640 1 --2- 172.21.15.19:0/3479062256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ddc0039b0 0x7f8df01e7110 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f8dec001870 tx=0x7f8dec001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:14.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.735+0000 7f8de5ffb640 1 -- 172.21.15.19:0/3479062256 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec03f030 con 0x7f8ddc0039b0 2024-09-12T02:04:14.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.736+0000 7f8de5ffb640 1 -- 172.21.15.19:0/3479062256 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dec005480 con 0x7f8ddc0039b0 2024-09-12T02:04:14.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.736+0000 7f8de5ffb640 1 -- 172.21.15.19:0/3479062256 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec037040 con 0x7f8ddc0039b0 2024-09-12T02:04:14.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.736+0000 7f8df764c640 1 -- 172.21.15.19:0/3479062256 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8df00c9260 con 0x7f8ddc0039b0 2024-09-12T02:04:14.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.736+0000 7f8df764c640 1 -- 172.21.15.19:0/3479062256 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8df01f3fd0 con 0x7f8ddc0039b0 2024-09-12T02:04:14.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.737+0000 7f8df764c640 1 -- 172.21.15.19:0/3479062256 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8df00d1de0 con 0x7f8ddc0039b0 2024-09-12T02:04:14.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.737+0000 7f8de5ffb640 1 -- 172.21.15.19:0/3479062256 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8dec042070 con 0x7f8ddc0039b0 2024-09-12T02:04:14.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.738+0000 7f8de5ffb640 1 --2- 172.21.15.19:0/3479062256 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8dd406be60 0x7f8dd406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.738+0000 7f8de5ffb640 1 -- 172.21.15.19:0/3479062256 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 7679+0+0 (secure 0 0 0) 0x7f8dec0aac60 con 0x7f8ddc0039b0 2024-09-12T02:04:14.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.738+0000 7f8df4be7640 1 --2- 172.21.15.19:0/3479062256 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8dd406be60 0x7f8dd406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.739+0000 7f8df4be7640 1 --2- 172.21.15.19:0/3479062256 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8dd406be60 0x7f8dd406e320 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8df00c8d10 tx=0x7f8de0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:14.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.742+0000 7f8de5ffb640 1 -- 172.21.15.19:0/3479062256 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8df00d1de0 con 0x7f8ddc0039b0 2024-09-12T02:04:14.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.957+0000 7f8df764c640 1 -- 172.21.15.19:0/3479062256 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8df00d4dd0 con 0x7f8ddc0039b0 2024-09-12T02:04:14.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.957+0000 7f8de5ffb640 1 -- 172.21.15.19:0/3479062256 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 177 v177) ==== 95+0+4386 (secure 0 0 0) 0x7f8dec078d30 con 0x7f8ddc0039b0 2024-09-12T02:04:14.958 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:14.958 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":177,"btime":"2024-09-12T02:04:14:938993+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/961161264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":961161264},{"type":"v1","addr":"172.21.15.19:6834","nonce":961161264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":177}],"filesystems":[{"mdsmap":{"epoch":176,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:13.937352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:14.958 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 177 2024-09-12T02:04:14.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.960+0000 7f8df764c640 1 -- 172.21.15.19:0/3479062256 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8dd406be60 msgr2=0x7f8dd406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.960+0000 7f8df764c640 1 --2- 172.21.15.19:0/3479062256 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8dd406be60 0x7f8dd406e320 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8df00c8d10 tx=0x7f8de0008040 comp rx=0 tx=0).stop 2024-09-12T02:04:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.960+0000 7f8df764c640 1 -- 172.21.15.19:0/3479062256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ddc0039b0 msgr2=0x7f8df01e7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.960+0000 7f8df764c640 1 --2- 172.21.15.19:0/3479062256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ddc0039b0 0x7f8df01e7110 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f8dec001870 tx=0x7f8dec001120 comp rx=0 tx=0).stop 2024-09-12T02:04:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.960+0000 7f8df764c640 1 -- 172.21.15.19:0/3479062256 shutdown_connections 2024-09-12T02:04:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.960+0000 7f8df764c640 1 --2- 172.21.15.19:0/3479062256 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8dd406be60 0x7f8dd406e320 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.960+0000 7f8df764c640 1 --2- 172.21.15.19:0/3479062256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8df00b9a40 0x7f8df01f3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.960+0000 7f8df764c640 1 --2- 172.21.15.19:0/3479062256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8df01e7650 0x7f8df00b9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.960+0000 7f8df764c640 1 --2- 172.21.15.19:0/3479062256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ddc0039b0 0x7f8df01e7110 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.960+0000 7f8df764c640 1 -- 172.21.15.19:0/3479062256 >> 172.21.15.19:0/3479062256 conn(0x7f8df008bfc0 msgr2=0x7f8df006e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.960+0000 7f8df764c640 1 -- 172.21.15.19:0/3479062256 shutdown_connections 2024-09-12T02:04:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:14.960+0000 7f8df764c640 1 -- 172.21.15.19:0/3479062256 wait complete. 2024-09-12T02:04:14.971 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt 200.00000000' led to DAMAGED state 2024-09-12T02:04:14.971 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt 200.00000001' 2024-09-12T02:04:14.971 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:04:14.971 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:04:15.027 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:04:15.028 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:04:15.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:15.028 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:04:15.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:04:15.084 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:04:15.084 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:04:15.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.228+0000 7ffa32b5f640 1 Processor -- start 2024-09-12T02:04:15.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.228+0000 7ffa32b5f640 1 -- start start 2024-09-12T02:04:15.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.229+0000 7ffa32b5f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffa2c0b6680 0x7ffa2c169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:15.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.229+0000 7ffa32b5f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa2c06d9f0 con 0x7ffa2c162060 2024-09-12T02:04:15.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.229+0000 7ffa32b5f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa2c06dcd0 con 0x7ffa2c161c80 2024-09-12T02:04:15.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.229+0000 7ffa32b5f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ffa2c06dfb0 con 0x7ffa2c0b6680 2024-09-12T02:04:15.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.229+0000 7ffa2bfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ffa2c162060 0x7ffa2c0b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49154/0 (socket says 172.21.15.19:49154) 2024-09-12T02:04:15.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.229+0000 7ffa2bfff640 1 -- 172.21.15.19:0/2259525571 learned_addr learned my addr 172.21.15.19:0/2259525571 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:15.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.229+0000 7ffa310fc640 1 --2- 172.21.15.19:0/2259525571 >> v2:172.21.15.135:3300/0 conn(0x7ffa2c0b6680 0x7ffa2c169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:15.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.229+0000 7ffa2b7fe640 1 -- 172.21.15.19:0/2259525571 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 661409568 0 0) 0x7ffa2c06d9f0 con 0x7ffa2c162060 2024-09-12T02:04:15.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.229+0000 7ffa2b7fe640 1 -- 172.21.15.19:0/2259525571 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa1c003520 con 0x7ffa2c162060 2024-09-12T02:04:15.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.229+0000 7ffa2b7fe640 1 -- 172.21.15.19:0/2259525571 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 64982690 0 0) 0x7ffa2c06dcd0 con 0x7ffa2c161c80 2024-09-12T02:04:15.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.229+0000 7ffa2b7fe640 1 -- 172.21.15.19:0/2259525571 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa2c06d9f0 con 0x7ffa2c161c80 2024-09-12T02:04:15.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.229+0000 7ffa310fc640 1 -- 172.21.15.19:0/2259525571 >> v1:172.21.15.135:6789/0 conn(0x7ffa2c161c80 legacy=0x7ffa2c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:15.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.229+0000 7ffa310fc640 1 -- 172.21.15.19:0/2259525571 >> v1:172.21.15.19:6789/0 conn(0x7ffa2c162060 legacy=0x7ffa2c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:15.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.229+0000 7ffa2b7fe640 1 -- 172.21.15.19:0/2259525571 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1285088908 0 0) 0x7ffa1c003520 con 0x7ffa2c162060 2024-09-12T02:04:15.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.229+0000 7ffa310fc640 1 -- 172.21.15.19:0/2259525571 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2c0d01f0 con 0x7ffa2c0b6680 2024-09-12T02:04:15.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.230+0000 7ffa310fc640 1 --2- 172.21.15.19:0/2259525571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa2c0b6680 0x7ffa2c169830 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009d90 tx=0x7ffa2402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e260382cacbccc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:15.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.230+0000 7ffa2b7fe640 1 -- 172.21.15.19:0/2259525571 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18001670 con 0x7ffa2c0b6680 2024-09-12T02:04:15.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.230+0000 7ffa2b7fe640 1 -- 172.21.15.19:0/2259525571 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa24007540 con 0x7ffa2c0b6680 2024-09-12T02:04:15.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.230+0000 7ffa2b7fe640 1 -- 172.21.15.19:0/2259525571 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24007910 con 0x7ffa2c0b6680 2024-09-12T02:04:15.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.231+0000 7ffa32b5f640 1 -- 172.21.15.19:0/2259525571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa2c0b6680 msgr2=0x7ffa2c169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:15.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.231+0000 7ffa32b5f640 1 --2- 172.21.15.19:0/2259525571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa2c0b6680 0x7ffa2c169830 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009d90 tx=0x7ffa2402a680 comp rx=0 tx=0).stop 2024-09-12T02:04:15.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.231+0000 7ffa32b5f640 1 -- 172.21.15.19:0/2259525571 shutdown_connections 2024-09-12T02:04:15.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.231+0000 7ffa32b5f640 1 --2- 172.21.15.19:0/2259525571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa2c0b6680 0x7ffa2c169830 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:15.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.231+0000 7ffa32b5f640 1 -- 172.21.15.19:0/2259525571 >> 172.21.15.19:0/2259525571 conn(0x7ffa2c0d44f0 msgr2=0x7ffa2c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:15.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.231+0000 7ffa32b5f640 1 -- 172.21.15.19:0/2259525571 shutdown_connections 2024-09-12T02:04:15.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.231+0000 7ffa32b5f640 1 -- 172.21.15.19:0/2259525571 wait complete. 2024-09-12T02:04:15.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.232+0000 7ffa32b5f640 1 Processor -- start 2024-09-12T02:04:15.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.232+0000 7ffa32b5f640 1 -- start start 2024-09-12T02:04:15.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.233+0000 7ffa32b5f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa2c0b6680 0x7ffa2c0b9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:15.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.233+0000 7ffa32b5f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa2c161c80 0x7ffa2c0cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:15.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.233+0000 7ffa32b5f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa2c162060 0x7ffa2c0b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:15.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.233+0000 7ffa32b5f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2c0b6cb0 con 0x7ffa2c161c80 2024-09-12T02:04:15.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.233+0000 7ffa32b5f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2c0b6b30 con 0x7ffa2c0b6680 2024-09-12T02:04:15.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.233+0000 7ffa32b5f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ffa2c169d70 con 0x7ffa2c162060 2024-09-12T02:04:15.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.233+0000 7ffa2bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa2c161c80 0x7ffa2c0cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:15.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.233+0000 7ffa2bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa2c161c80 0x7ffa2c0cdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57688/0 (socket says 172.21.15.19:57688) 2024-09-12T02:04:15.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.233+0000 7ffa2bfff640 1 -- 172.21.15.19:0/3852873795 learned_addr learned my addr 172.21.15.19:0/3852873795 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:15.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.233+0000 7ffa308fb640 1 --2- 172.21.15.19:0/3852873795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa2c0b6680 0x7ffa2c0b9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:15.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.233+0000 7ffa310fc640 1 --2- 172.21.15.19:0/3852873795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa2c162060 0x7ffa2c0b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:15.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.233+0000 7ffa2bfff640 1 -- 172.21.15.19:0/3852873795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa2c162060 msgr2=0x7ffa2c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:15.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.233+0000 7ffa2bfff640 1 --2- 172.21.15.19:0/3852873795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa2c162060 0x7ffa2c0b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:15.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.233+0000 7ffa2bfff640 1 -- 172.21.15.19:0/3852873795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa2c0b6680 msgr2=0x7ffa2c0b9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:15.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.233+0000 7ffa2bfff640 1 --2- 172.21.15.19:0/3852873795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa2c0b6680 0x7ffa2c0b9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:15.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.233+0000 7ffa2bfff640 1 -- 172.21.15.19:0/3852873795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2c169b40 con 0x7ffa2c161c80 2024-09-12T02:04:15.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.234+0000 7ffa2bfff640 1 --2- 172.21.15.19:0/3852873795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa2c161c80 0x7ffa2c0cdb80 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7ffa18000fd0 tx=0x7ffa1800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:15.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.234+0000 7ffa297fa640 1 -- 172.21.15.19:0/3852873795 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18017070 con 0x7ffa2c161c80 2024-09-12T02:04:15.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.234+0000 7ffa297fa640 1 -- 172.21.15.19:0/3852873795 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa18005ad0 con 0x7ffa2c161c80 2024-09-12T02:04:15.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.234+0000 7ffa32b5f640 1 -- 172.21.15.19:0/3852873795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa2c0ba030 con 0x7ffa2c161c80 2024-09-12T02:04:15.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.234+0000 7ffa297fa640 1 -- 172.21.15.19:0/3852873795 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18007070 con 0x7ffa2c161c80 2024-09-12T02:04:15.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.234+0000 7ffa32b5f640 1 -- 172.21.15.19:0/3852873795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa2c15e950 con 0x7ffa2c161c80 2024-09-12T02:04:15.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.235+0000 7ffa32b5f640 1 -- 172.21.15.19:0/3852873795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa2c0b5f70 con 0x7ffa2c161c80 2024-09-12T02:04:15.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.235+0000 7ffa297fa640 1 -- 172.21.15.19:0/3852873795 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa1801a070 con 0x7ffa2c161c80 2024-09-12T02:04:15.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.236+0000 7ffa297fa640 1 --2- 172.21.15.19:0/3852873795 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffa1006be30 0x7ffa1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:15.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.236+0000 7ffa297fa640 1 -- 172.21.15.19:0/3852873795 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 7679+0+0 (secure 0 0 0) 0x7ffa1808a980 con 0x7ffa2c161c80 2024-09-12T02:04:15.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.236+0000 7ffa308fb640 1 --2- 172.21.15.19:0/3852873795 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffa1006be30 0x7ffa1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:15.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.237+0000 7ffa308fb640 1 --2- 172.21.15.19:0/3852873795 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffa1006be30 0x7ffa1006e2f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ffa200011e0 tx=0x7ffa20009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:15.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.240+0000 7ffa297fa640 1 -- 172.21.15.19:0/3852873795 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa18058530 con 0x7ffa2c161c80 2024-09-12T02:04:15.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.451+0000 7ffa32b5f640 1 -- 172.21.15.19:0/3852873795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ffa2c15cc00 con 0x7ffa2c161c80 2024-09-12T02:04:15.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.947+0000 7ffa297fa640 1 -- 172.21.15.19:0/3852873795 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v178) ==== 161+0+0 (secure 0 0 0) 0x7ffa1805c830 con 0x7ffa2c161c80 2024-09-12T02:04:15.947 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:04:15.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.949+0000 7ffa32b5f640 1 -- 172.21.15.19:0/3852873795 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffa1006be30 msgr2=0x7ffa1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:15.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.949+0000 7ffa32b5f640 1 --2- 172.21.15.19:0/3852873795 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffa1006be30 0x7ffa1006e2f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ffa200011e0 tx=0x7ffa20009040 comp rx=0 tx=0).stop 2024-09-12T02:04:15.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.949+0000 7ffa32b5f640 1 -- 172.21.15.19:0/3852873795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa2c161c80 msgr2=0x7ffa2c0cdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:15.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.949+0000 7ffa32b5f640 1 --2- 172.21.15.19:0/3852873795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa2c161c80 0x7ffa2c0cdb80 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7ffa18000fd0 tx=0x7ffa1800cbe0 comp rx=0 tx=0).stop 2024-09-12T02:04:15.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.949+0000 7ffa32b5f640 1 -- 172.21.15.19:0/3852873795 shutdown_connections 2024-09-12T02:04:15.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.949+0000 7ffa32b5f640 1 --2- 172.21.15.19:0/3852873795 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffa1006be30 0x7ffa1006e2f0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:15.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.949+0000 7ffa32b5f640 1 --2- 172.21.15.19:0/3852873795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa2c162060 0x7ffa2c0b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:15.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.949+0000 7ffa32b5f640 1 --2- 172.21.15.19:0/3852873795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa2c161c80 0x7ffa2c0cdb80 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:15.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.949+0000 7ffa32b5f640 1 --2- 172.21.15.19:0/3852873795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa2c0b6680 0x7ffa2c0b9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:15.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.949+0000 7ffa32b5f640 1 -- 172.21.15.19:0/3852873795 >> 172.21.15.19:0/3852873795 conn(0x7ffa2c0d44f0 msgr2=0x7ffa2c160ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:15.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.949+0000 7ffa32b5f640 1 -- 172.21.15.19:0/3852873795 shutdown_connections 2024-09-12T02:04:15.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:15.949+0000 7ffa32b5f640 1 -- 172.21.15.19:0/3852873795 wait complete. 2024-09-12T02:04:15.962 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:04:16.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.067+0000 7f6178d8d640 1 Processor -- start 2024-09-12T02:04:16.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.067+0000 7f6178d8d640 1 -- start start 2024-09-12T02:04:16.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.068+0000 7f6178d8d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6174161c80 0x7f617406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:16.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.068+0000 7f6178d8d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f617406e870 con 0x7f6174162060 2024-09-12T02:04:16.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.068+0000 7f6178d8d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f617406d9f0 con 0x7f61740b6680 2024-09-12T02:04:16.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.068+0000 7f6178d8d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f617406dcd0 con 0x7f6174161c80 2024-09-12T02:04:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.069+0000 7f617259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6174161c80 0x7f617406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.069+0000 7f6171d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6174162060 0x7f61740b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49164/0 (socket says 172.21.15.19:49164) 2024-09-12T02:04:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.069+0000 7f617259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6174161c80 0x7f617406e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57696/0 (socket says 172.21.15.19:57696) 2024-09-12T02:04:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.069+0000 7f6171d9b640 1 -- 172.21.15.19:0/1069579177 learned_addr learned my addr 172.21.15.19:0/1069579177 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.069+0000 7f617259c640 1 -- 172.21.15.19:0/1069579177 >> v1:172.21.15.135:6789/0 conn(0x7f61740b6680 legacy=0x7f61740cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.069+0000 7f617159a640 1 -- 172.21.15.19:0/1069579177 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3641714771 0 0) 0x7f615c001110 con 0x7f6174162060 2024-09-12T02:04:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.069+0000 7f617259c640 1 -- 172.21.15.19:0/1069579177 >> v1:172.21.15.19:6789/0 conn(0x7f6174162060 legacy=0x7f61740b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.069+0000 7f617259c640 1 -- 172.21.15.19:0/1069579177 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f617406dfb0 con 0x7f6174161c80 2024-09-12T02:04:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.070+0000 7f617259c640 1 --2- 172.21.15.19:0/1069579177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6174161c80 0x7f617406e330 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f616c009d90 tx=0x7f616c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b910699564c8d0bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.070+0000 7f617159a640 1 -- 172.21.15.19:0/1069579177 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c007740 con 0x7f6174161c80 2024-09-12T02:04:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.070+0000 7f617159a640 1 -- 172.21.15.19:0/1069579177 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f616c0078e0 con 0x7f6174161c80 2024-09-12T02:04:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.070+0000 7f617159a640 1 -- 172.21.15.19:0/1069579177 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c007cb0 con 0x7f6174161c80 2024-09-12T02:04:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.070+0000 7f6178d8d640 1 -- 172.21.15.19:0/1069579177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6174161c80 msgr2=0x7f617406e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.070+0000 7f6178d8d640 1 --2- 172.21.15.19:0/1069579177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6174161c80 0x7f617406e330 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f616c009d90 tx=0x7f616c02a6f0 comp rx=0 tx=0).stop 2024-09-12T02:04:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.070+0000 7f6178d8d640 1 -- 172.21.15.19:0/1069579177 shutdown_connections 2024-09-12T02:04:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.070+0000 7f6178d8d640 1 --2- 172.21.15.19:0/1069579177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6174161c80 0x7f617406e330 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.070+0000 7f6178d8d640 1 -- 172.21.15.19:0/1069579177 >> 172.21.15.19:0/1069579177 conn(0x7f61740d44f0 msgr2=0x7f61740d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.071+0000 7f6178d8d640 1 -- 172.21.15.19:0/1069579177 shutdown_connections 2024-09-12T02:04:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.071+0000 7f6178d8d640 1 -- 172.21.15.19:0/1069579177 wait complete. 2024-09-12T02:04:16.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.072+0000 7f6178d8d640 1 Processor -- start 2024-09-12T02:04:16.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.072+0000 7f6178d8d640 1 -- start start 2024-09-12T02:04:16.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f6178d8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61740b6680 0x7f6174156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:16.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f6178d8d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6174161c80 0x7f61740b8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:16.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f6178d8d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6174162060 0x7f61740b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:16.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f6178d8d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f61740b6b30 con 0x7f61740b6680 2024-09-12T02:04:16.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f6178d8d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f61740d2aa0 con 0x7f6174161c80 2024-09-12T02:04:16.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f6178d8d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f61740b6cb0 con 0x7f6174162060 2024-09-12T02:04:16.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f617259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61740b6680 0x7f6174156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:16.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f617259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61740b6680 0x7f6174156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57698/0 (socket says 172.21.15.19:57698) 2024-09-12T02:04:16.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f617259c640 1 -- 172.21.15.19:0/2861227774 learned_addr learned my addr 172.21.15.19:0/2861227774 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:16.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f6171d9b640 1 --2- 172.21.15.19:0/2861227774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6174161c80 0x7f61740b8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f6172d9d640 1 --2- 172.21.15.19:0/2861227774 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6174162060 0x7f61740b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f617259c640 1 -- 172.21.15.19:0/2861227774 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6174162060 msgr2=0x7f61740b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f617259c640 1 --2- 172.21.15.19:0/2861227774 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6174162060 0x7f61740b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f617259c640 1 -- 172.21.15.19:0/2861227774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6174161c80 msgr2=0x7f61740b8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f617259c640 1 --2- 172.21.15.19:0/2861227774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6174161c80 0x7f61740b8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f617259c640 1 -- 172.21.15.19:0/2861227774 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61740c8de0 con 0x7f61740b6680 2024-09-12T02:04:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f6171d9b640 1 --2- 172.21.15.19:0/2861227774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6174161c80 0x7f61740b8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f6172d9d640 1 --2- 172.21.15.19:0/2861227774 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6174162060 0x7f61740b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.073+0000 7f617259c640 1 --2- 172.21.15.19:0/2861227774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61740b6680 0x7f6174156330 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f616c009d90 tx=0x7f616c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.074+0000 7f616affd640 1 -- 172.21.15.19:0/2861227774 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c03f070 con 0x7f61740b6680 2024-09-12T02:04:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.074+0000 7f6178d8d640 1 -- 172.21.15.19:0/2861227774 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61740c7d40 con 0x7f61740b6680 2024-09-12T02:04:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.074+0000 7f616affd640 1 -- 172.21.15.19:0/2861227774 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f616c031d00 con 0x7f61740b6680 2024-09-12T02:04:16.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.074+0000 7f616affd640 1 -- 172.21.15.19:0/2861227774 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c044660 con 0x7f61740b6680 2024-09-12T02:04:16.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.074+0000 7f6178d8d640 1 -- 172.21.15.19:0/2861227774 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61740c8300 con 0x7f61740b6680 2024-09-12T02:04:16.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.075+0000 7f6178d8d640 1 -- 172.21.15.19:0/2861227774 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f617406e330 con 0x7f61740b6680 2024-09-12T02:04:16.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.075+0000 7f616affd640 1 -- 172.21.15.19:0/2861227774 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f616c03b410 con 0x7f61740b6680 2024-09-12T02:04:16.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.075+0000 7f616affd640 1 --2- 172.21.15.19:0/2861227774 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f615406be60 0x7f615406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:16.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.076+0000 7f616affd640 1 -- 172.21.15.19:0/2861227774 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 7679+0+0 (secure 0 0 0) 0x7f616c0acfd0 con 0x7f61740b6680 2024-09-12T02:04:16.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.076+0000 7f6171d9b640 1 --2- 172.21.15.19:0/2861227774 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f615406be60 0x7f615406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:16.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.076+0000 7f6171d9b640 1 --2- 172.21.15.19:0/2861227774 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f615406be60 0x7f615406e320 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f615c0013b0 tx=0x7f615c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:16.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.080+0000 7f616affd640 1 -- 172.21.15.19:0/2861227774 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f616c07b150 con 0x7f61740b6680 2024-09-12T02:04:16.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.324+0000 7f6178d8d640 1 -- 172.21.15.19:0/2861227774 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f61740d39f0 con 0x7f61740b6680 2024-09-12T02:04:16.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.951+0000 7f616affd640 1 -- 172.21.15.19:0/2861227774 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v179) ==== 101+0+0 (secure 0 0 0) 0x7f616c07aa50 con 0x7f61740b6680 2024-09-12T02:04:16.952 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:04:16.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.954+0000 7f6178d8d640 1 -- 172.21.15.19:0/2861227774 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f615406be60 msgr2=0x7f615406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:16.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.954+0000 7f6178d8d640 1 --2- 172.21.15.19:0/2861227774 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f615406be60 0x7f615406e320 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f615c0013b0 tx=0x7f615c009040 comp rx=0 tx=0).stop 2024-09-12T02:04:16.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.954+0000 7f6178d8d640 1 -- 172.21.15.19:0/2861227774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61740b6680 msgr2=0x7f6174156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:16.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.954+0000 7f6178d8d640 1 --2- 172.21.15.19:0/2861227774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61740b6680 0x7f6174156330 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f616c009d90 tx=0x7f616c004a40 comp rx=0 tx=0).stop 2024-09-12T02:04:16.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.954+0000 7f6178d8d640 1 -- 172.21.15.19:0/2861227774 shutdown_connections 2024-09-12T02:04:16.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.954+0000 7f6178d8d640 1 --2- 172.21.15.19:0/2861227774 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f615406be60 0x7f615406e320 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:16.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.954+0000 7f6178d8d640 1 --2- 172.21.15.19:0/2861227774 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6174162060 0x7f61740b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:16.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.954+0000 7f6178d8d640 1 --2- 172.21.15.19:0/2861227774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6174161c80 0x7f61740b8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:16.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.954+0000 7f6178d8d640 1 --2- 172.21.15.19:0/2861227774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61740b6680 0x7f6174156330 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:16.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.954+0000 7f6178d8d640 1 -- 172.21.15.19:0/2861227774 >> 172.21.15.19:0/2861227774 conn(0x7f61740d44f0 msgr2=0x7f61740cfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:16.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.954+0000 7f6178d8d640 1 -- 172.21.15.19:0/2861227774 shutdown_connections 2024-09-12T02:04:16.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:16.954+0000 7f6178d8d640 1 -- 172.21.15.19:0/2861227774 wait complete. 2024-09-12T02:04:16.968 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:04:17.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.015+0000 7f52a707df40 1 Processor -- start 2024-09-12T02:04:17.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.015+0000 7f52a707df40 1 -- start start 2024-09-12T02:04:17.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.015+0000 7f52a707df40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f528c002460 0x559c70b26d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.015+0000 7f52a707df40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559c70a7c870 0x559c70a974a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.015+0000 7f52a707df40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c709c0f60 0x559c709c1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.015+0000 7f52a707df40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559c70913510 con 0x559c709c0f60 2024-09-12T02:04:17.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.015+0000 7f52a707df40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559c7096cc50 con 0x7f528c002460 2024-09-12T02:04:17.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.015+0000 7f52a707df40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x559c709ef630 con 0x559c70a7c870 2024-09-12T02:04:17.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.016+0000 7f52a5374640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c709c0f60 0x559c709c1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.016+0000 7f52a5374640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c709c0f60 0x559c709c1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57716/0 (socket says 172.21.15.19:57716) 2024-09-12T02:04:17.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.016+0000 7f52a5374640 1 -- 172.21.15.19:0/1899083928 learned_addr learned my addr 172.21.15.19:0/1899083928 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:17.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.016+0000 7f52a4b73640 1 --2- 172.21.15.19:0/1899083928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f528c002460 0x559c70b26d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.016+0000 7f52a4372640 1 --2- 172.21.15.19:0/1899083928 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559c70a7c870 0x559c70a974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.016+0000 7f52a5374640 1 -- 172.21.15.19:0/1899083928 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559c70a7c870 msgr2=0x559c70a974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.016+0000 7f52a5374640 1 --2- 172.21.15.19:0/1899083928 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559c70a7c870 0x559c70a974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.016+0000 7f52a5374640 1 -- 172.21.15.19:0/1899083928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f528c002460 msgr2=0x559c70b26d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.016+0000 7f52a5374640 1 --2- 172.21.15.19:0/1899083928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f528c002460 0x559c70b26d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.016+0000 7f52a5374640 1 -- 172.21.15.19:0/1899083928 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c70a7e760 con 0x559c709c0f60 2024-09-12T02:04:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.016+0000 7f52a5374640 1 --2- 172.21.15.19:0/1899083928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c709c0f60 0x559c709c1c10 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x559c70a08900 tx=0x7f529c006820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32b0758af351da4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.016+0000 7f52a3370640 1 -- 172.21.15.19:0/1899083928 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c018070 con 0x559c709c0f60 2024-09-12T02:04:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.016+0000 7f52a3370640 1 -- 172.21.15.19:0/1899083928 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f529c004100 con 0x559c709c0f60 2024-09-12T02:04:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.016+0000 7f52a3370640 1 -- 172.21.15.19:0/1899083928 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c003110 con 0x559c709c0f60 2024-09-12T02:04:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.017+0000 7f52a707df40 1 -- 172.21.15.19:0/1899083928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c709c0f60 msgr2=0x559c709c1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.017+0000 7f52a707df40 1 --2- 172.21.15.19:0/1899083928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c709c0f60 0x559c709c1c10 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x559c70a08900 tx=0x7f529c006820 comp rx=0 tx=0).stop 2024-09-12T02:04:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.017+0000 7f52a707df40 1 -- 172.21.15.19:0/1899083928 shutdown_connections 2024-09-12T02:04:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.017+0000 7f52a707df40 1 --2- 172.21.15.19:0/1899083928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c709c0f60 0x559c709c1c10 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.017+0000 7f52a707df40 1 --2- 172.21.15.19:0/1899083928 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559c70a7c870 0x559c70a974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.017+0000 7f52a707df40 1 --2- 172.21.15.19:0/1899083928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f528c002460 0x559c70b26d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.017+0000 7f52a707df40 1 -- 172.21.15.19:0/1899083928 >> 172.21.15.19:0/1899083928 conn(0x559c709c2ad0 msgr2=0x559c70a99cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.017+0000 7f52a707df40 1 -- 172.21.15.19:0/1899083928 shutdown_connections 2024-09-12T02:04:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.017+0000 7f52a707df40 1 -- 172.21.15.19:0/1899083928 wait complete. 2024-09-12T02:04:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.017+0000 7f52a707df40 1 Processor -- start 2024-09-12T02:04:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.017+0000 7f52a707df40 1 -- start start 2024-09-12T02:04:17.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.018+0000 7f52a707df40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c709c0f60 0x559c70a7d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.018+0000 7f52a707df40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c70a7c870 0x559c70a03ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.018+0000 7f52a707df40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f528c002460 0x559c70a7cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.018+0000 7f52a707df40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559c70a7e480 con 0x559c70a7c870 2024-09-12T02:04:17.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.018+0000 7f52a707df40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559c709c0790 con 0x559c709c0f60 2024-09-12T02:04:17.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.018+0000 7f52a707df40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x559c70a7bc40 con 0x7f528c002460 2024-09-12T02:04:17.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.018+0000 7f52a4372640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c70a7c870 0x559c70a03ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.018+0000 7f52a4372640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c70a7c870 0x559c70a03ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57726/0 (socket says 172.21.15.19:57726) 2024-09-12T02:04:17.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.018+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 learned_addr learned my addr 172.21.15.19:0/4204277886 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:17.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.018+0000 7f52a4b73640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c709c0f60 0x559c70a7d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.018+0000 7f52a5374640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f528c002460 0x559c70a7cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.018+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f528c002460 msgr2=0x559c70a7cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.018+0000 7f52a4372640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f528c002460 0x559c70a7cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.019+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c709c0f60 msgr2=0x559c70a7d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.019+0000 7f52a4372640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c709c0f60 0x559c70a7d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.019+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c70a07330 con 0x559c70a7c870 2024-09-12T02:04:17.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.019+0000 7f52a5374640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f528c002460 0x559c70a7cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:17.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.019+0000 7f52a4372640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c70a7c870 0x559c70a03ee0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f5298009ec0 tx=0x7f5298005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:17.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.019+0000 7f52a236e640 1 -- 172.21.15.19:0/4204277886 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529801a020 con 0x559c70a7c870 2024-09-12T02:04:17.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.019+0000 7f52a236e640 1 -- 172.21.15.19:0/4204277886 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5298016650 con 0x559c70a7c870 2024-09-12T02:04:17.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.019+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c70a075d0 con 0x559c70a7c870 2024-09-12T02:04:17.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.019+0000 7f52a236e640 1 -- 172.21.15.19:0/4204277886 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5298016a00 con 0x559c70a7c870 2024-09-12T02:04:17.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.019+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c70a07b90 con 0x559c70a7c870 2024-09-12T02:04:17.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.020+0000 7f52a236e640 1 -- 172.21.15.19:0/4204277886 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f529801d020 con 0x559c70a7c870 2024-09-12T02:04:17.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.021+0000 7f52a236e640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f529006a840 0x7f529006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.021+0000 7f52a236e640 1 -- 172.21.15.19:0/4204277886 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 7679+0+0 (secure 0 0 0) 0x7f529808ab10 con 0x559c70a7c870 2024-09-12T02:04:17.024 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:04:17.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.021+0000 7f52a4b73640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f529006a840 0x7f529006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.021+0000 7f52a707df40 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x559c70a961a0 0x559c70a7acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.021+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70a96580 con 0x559c70a961a0 2024-09-12T02:04:17.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.021+0000 7f52a5374640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x559c70a961a0 0x559c70a7acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.022+0000 7f52a5374640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x559c70a961a0 0x559c70a7acc0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:17.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.022+0000 7f52a4b73640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f529006a840 0x7f529006cd00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5294009a90 tx=0x7f5294050000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:17.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.023+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v111'505 uv479 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.023+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70a7b200 con 0x559c70a961a0 2024-09-12T02:04:17.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.024+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v111'506 uv506 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.024+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70a7d300 con 0x559c70a961a0 2024-09-12T02:04:17.026 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:04:17.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.025+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v111'507 uv507 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.025+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3b560 con 0x559c70a961a0 2024-09-12T02:04:17.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.026+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v111'508 uv508 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.026+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3b900 con 0x559c70a961a0 2024-09-12T02:04:17.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.027+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v111'509 uv509 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.027+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3a550 con 0x559c70a961a0 2024-09-12T02:04:17.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.029+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v111'510 uv510 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.029+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3a910 con 0x559c70a961a0 2024-09-12T02:04:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.030+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v111'511 uv485 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.030+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3acb0 con 0x559c70a961a0 2024-09-12T02:04:17.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.031+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v111'512 uv512 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.031+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3acb0 con 0x559c70a961a0 2024-09-12T02:04:17.032 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:04:17.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.032+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v111'513 uv513 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.032+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3acb0 con 0x559c70a961a0 2024-09-12T02:04:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.033+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v111'514 uv514 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.033+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3acb0 con 0x559c70a961a0 2024-09-12T02:04:17.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.034+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v111'515 uv515 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.034+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3acb0 con 0x559c70a961a0 2024-09-12T02:04:17.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.035+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v111'516 uv516 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.035+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3acb0 con 0x559c70a961a0 2024-09-12T02:04:17.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.036+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v111'517 uv492 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.036+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3acb0 con 0x559c70a961a0 2024-09-12T02:04:17.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.037+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v111'518 uv518 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.037+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3acb0 con 0x559c70a961a0 2024-09-12T02:04:17.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.039+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v111'519 uv519 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.041 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:04:17.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.039+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3acb0 con 0x559c70a961a0 2024-09-12T02:04:17.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.040+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v111'520 uv520 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.040+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3acb0 con 0x559c70a961a0 2024-09-12T02:04:17.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.041+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v111'521 uv521 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.041+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3acb0 con 0x559c70a961a0 2024-09-12T02:04:17.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.042+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v111'522 uv522 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.042+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70a7b630 con 0x559c70a961a0 2024-09-12T02:04:17.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.043+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v111'523 uv523 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.043+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70a7b630 con 0x559c70a961a0 2024-09-12T02:04:17.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.044+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v111'524 uv498 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.044+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70a7b630 con 0x559c70a961a0 2024-09-12T02:04:17.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.045+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v111'525 uv525 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.045+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70a7b630 con 0x559c70a961a0 2024-09-12T02:04:17.046 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:04:17.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.046+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v111'526 uv526 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.046+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3af60 con 0x559c70a961a0 2024-09-12T02:04:17.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.047+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v111'527 uv527 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.047+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3af60 con 0x559c70a961a0 2024-09-12T02:04:17.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.048+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v111'528 uv528 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.048+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3af60 con 0x559c70a961a0 2024-09-12T02:04:17.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.049+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v111'529 uv529 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.049+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3af60 con 0x559c70a961a0 2024-09-12T02:04:17.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.051+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v111'530 uv504 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.051+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3af60 con 0x559c70a961a0 2024-09-12T02:04:17.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.052+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v111'531 uv531 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.052+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3af60 con 0x559c70a961a0 2024-09-12T02:04:17.053 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:04:17.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.053+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v111'532 uv532 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.053+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3af60 con 0x559c70a961a0 2024-09-12T02:04:17.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.054+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v111'533 uv533 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.054+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3af60 con 0x559c70a961a0 2024-09-12T02:04:17.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.055+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v111'534 uv534 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.055+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3af60 con 0x559c70a961a0 2024-09-12T02:04:17.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.056+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v111'535 uv535 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70a961a0 2024-09-12T02:04:17.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.056+0000 7f52a707df40 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559c70b3af60 0x559c70b3e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.056+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3e700 con 0x559c70b3af60 2024-09-12T02:04:17.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.056+0000 7f52a4b73640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559c70b3af60 0x559c70b3e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.056+0000 7f52a4b73640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559c70b3af60 0x559c70b3e1c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:17.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.058+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v111'375 uv357 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.058+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3eaa0 con 0x559c70b3af60 2024-09-12T02:04:17.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.060+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v111'376 uv376 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.060+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3eee0 con 0x559c70b3af60 2024-09-12T02:04:17.061 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:04:17.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.061+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v111'377 uv377 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.061+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3f7d0 con 0x559c70b3af60 2024-09-12T02:04:17.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.062+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v111'378 uv378 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.062+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3fb70 con 0x559c70b3af60 2024-09-12T02:04:17.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.064+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v111'379 uv379 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.064+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b3ff10 con 0x559c70b3af60 2024-09-12T02:04:17.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.065+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v111'380 uv374 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.065+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b402b0 con 0x559c70b3af60 2024-09-12T02:04:17.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.066+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v111'381 uv381 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.066+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b40650 con 0x559c70b3af60 2024-09-12T02:04:17.068 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:04:17.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.068+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v111'382 uv382 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.068+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b40690 con 0x559c70b3af60 2024-09-12T02:04:17.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.069+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v111'383 uv383 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.070+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b40650 con 0x559c70b3af60 2024-09-12T02:04:17.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.071+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v111'384 uv384 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.071+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b40650 con 0x559c70b3af60 2024-09-12T02:04:17.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.072+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v111'385 uv367 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.072+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b40650 con 0x559c70b3af60 2024-09-12T02:04:17.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.073+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v111'386 uv386 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.073+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b40650 con 0x559c70b3af60 2024-09-12T02:04:17.075 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:04:17.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.075+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v111'387 uv387 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.075+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b40650 con 0x559c70b3af60 2024-09-12T02:04:17.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.076+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v111'388 uv388 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.076+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b40650 con 0x559c70b3af60 2024-09-12T02:04:17.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.077+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v111'389 uv389 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.077+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b40a10 con 0x559c70b3af60 2024-09-12T02:04:17.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.078+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v111'390 uv373 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.079+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b406e0 con 0x559c70b3af60 2024-09-12T02:04:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.080+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v111'391 uv391 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.080+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b406e0 con 0x559c70b3af60 2024-09-12T02:04:17.081 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:04:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.081+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v111'392 uv392 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.081+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b41700 con 0x559c70b3af60 2024-09-12T02:04:17.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.082+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v111'393 uv393 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.082+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b416c0 con 0x559c70b3af60 2024-09-12T02:04:17.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.084+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v111'394 uv394 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.084+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b416c0 con 0x559c70b3af60 2024-09-12T02:04:17.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.085+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v111'395 uv395 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b3af60 2024-09-12T02:04:17.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.085+0000 7f52a707df40 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x559c70b40b60 0x559c70b40f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.085+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b43ac0 con 0x559c70b40b60 2024-09-12T02:04:17.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.085+0000 7f52a4372640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x559c70b40b60 0x559c70b40f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.085+0000 7f52a4372640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x559c70b40b60 0x559c70b40f40 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:17.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.087+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v111'99 uv98 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.087+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b43e60 con 0x559c70b40b60 2024-09-12T02:04:17.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.088+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v111'100 uv100 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.088+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b44240 con 0x559c70b40b60 2024-09-12T02:04:17.089 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:04:17.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.089+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v111'101 uv101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.089+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b45af0 con 0x559c70b40b60 2024-09-12T02:04:17.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.090+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v111'102 uv102 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.090+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b45e90 con 0x559c70b40b60 2024-09-12T02:04:17.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.091+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v111'103 uv103 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.091+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b44ae0 con 0x559c70b40b60 2024-09-12T02:04:17.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.092+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v111'104 uv104 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.092+0000 7f52a707df40 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x559c70b453e0 0x559c70b48240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.092+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b48780 con 0x559c70b453e0 2024-09-12T02:04:17.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.092+0000 7f52a5374640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x559c70b453e0 0x559c70b48240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.092+0000 7f52a5374640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x559c70b453e0 0x559c70b48240 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:17.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.094+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v111'76 uv75 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.094+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b48780 con 0x559c70b453e0 2024-09-12T02:04:17.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.095+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v111'77 uv77 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.095+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b48800 con 0x559c70b453e0 2024-09-12T02:04:17.096 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:04:17.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.096+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v111'78 uv78 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.096+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b48bf0 con 0x559c70b453e0 2024-09-12T02:04:17.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.097+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v111'79 uv79 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.097+0000 7f52a707df40 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559c70b49100 0x559c70b4b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.097+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4ba70 con 0x559c70b49100 2024-09-12T02:04:17.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.097+0000 7f52a4b73640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559c70b49100 0x559c70b4b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.098+0000 7f52a4b73640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559c70b49100 0x559c70b4b4f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.099+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v111'99 uv98 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.099+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4baf0 con 0x559c70b49100 2024-09-12T02:04:17.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.100+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v111'100 uv100 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.100+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b49100 2024-09-12T02:04:17.101 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:04:17.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.101+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v111'101 uv101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.101+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4cf20 con 0x559c70b49100 2024-09-12T02:04:17.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.102+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v111'102 uv102 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.102+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4cf20 con 0x559c70b49100 2024-09-12T02:04:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.104+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v111'103 uv103 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.104+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b49100 2024-09-12T02:04:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.105+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v111'104 uv104 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.105+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b453e0 2024-09-12T02:04:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.106+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v111'182 uv176 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.106+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b453e0 2024-09-12T02:04:17.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.107+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v111'183 uv183 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.107+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b453e0 2024-09-12T02:04:17.108 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:04:17.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.108+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v111'184 uv184 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.108+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4cf20 con 0x559c70b453e0 2024-09-12T02:04:17.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.109+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v111'185 uv185 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.109+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4cf20 con 0x559c70b453e0 2024-09-12T02:04:17.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.110+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v111'186 uv186 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.110+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b453e0 2024-09-12T02:04:17.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.111+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v111'187 uv187 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.111+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b453e0 2024-09-12T02:04:17.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.112+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v111'188 uv181 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.112+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b453e0 2024-09-12T02:04:17.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.113+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v111'189 uv189 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.113+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b453e0 2024-09-12T02:04:17.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.114+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v111'190 uv190 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.115 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:04:17.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.114+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b453e0 2024-09-12T02:04:17.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.115+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v111'191 uv191 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.115+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b453e0 2024-09-12T02:04:17.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.116+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v111'192 uv192 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.116+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b453e0 2024-09-12T02:04:17.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.117+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v111'81 uv80 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.117+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b453e0 2024-09-12T02:04:17.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.118+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v111'82 uv82 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.118+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b453e0 2024-09-12T02:04:17.119 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:04:17.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.119+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v111'83 uv83 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.119+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b453e0 2024-09-12T02:04:17.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.120+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v111'84 uv84 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.120+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b453e0 2024-09-12T02:04:17.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.121+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v111'85 uv85 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f529c0030f0 con 0x559c70b453e0 2024-09-12T02:04:17.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.121+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b49100 2024-09-12T02:04:17.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.122+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v111'99 uv98 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.122+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b49100 2024-09-12T02:04:17.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.123+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v111'100 uv100 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.123+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b49100 2024-09-12T02:04:17.125 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:04:17.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.124+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v111'101 uv101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.124+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4cf20 con 0x559c70b49100 2024-09-12T02:04:17.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.125+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v111'102 uv102 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.125+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4cf20 con 0x559c70b49100 2024-09-12T02:04:17.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.126+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v111'103 uv103 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.126+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b49100 2024-09-12T02:04:17.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.128+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v111'104 uv104 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.128+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b49100 2024-09-12T02:04:17.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.129+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v111'162 uv156 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.129+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b49100 2024-09-12T02:04:17.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.130+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v111'163 uv163 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.130+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4bf10 con 0x559c70b49100 2024-09-12T02:04:17.131 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:04:17.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.131+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v111'164 uv164 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.131+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4c320 con 0x559c70b49100 2024-09-12T02:04:17.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.132+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v111'165 uv165 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.132+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4c2d0 con 0x559c70b49100 2024-09-12T02:04:17.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.133+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v111'166 uv166 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.133+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4c2d0 con 0x559c70b49100 2024-09-12T02:04:17.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.134+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v111'167 uv161 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.134+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4c2d0 con 0x559c70b49100 2024-09-12T02:04:17.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.135+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v111'168 uv168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.135+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4c2d0 con 0x559c70b49100 2024-09-12T02:04:17.137 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:04:17.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.136+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v111'169 uv169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.136+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4c2d0 con 0x559c70b49100 2024-09-12T02:04:17.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.137+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v111'170 uv170 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.137+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f0e0 con 0x559c70b49100 2024-09-12T02:04:17.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.139+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v111'171 uv171 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.139+0000 7f52a707df40 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x559c70b4cb90 0x559c70b4ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.139+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f4c0 con 0x559c70b4cb90 2024-09-12T02:04:17.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.139+0000 7f52a4372640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x559c70b4cb90 0x559c70b4ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.139+0000 7f52a4372640 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x559c70b4cb90 0x559c70b4ef80 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:17.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.140+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v111'74 uv73 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b4cb90 2024-09-12T02:04:17.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.140+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f860 con 0x559c70b4cb90 2024-09-12T02:04:17.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.142+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v111'75 uv75 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b4cb90 2024-09-12T02:04:17.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.142+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f860 con 0x559c70b4cb90 2024-09-12T02:04:17.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.143+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v111'76 uv76 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b4cb90 2024-09-12T02:04:17.143 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:04:17.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.143+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f920 con 0x559c70b4cb90 2024-09-12T02:04:17.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.144+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v111'77 uv77 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b4cb90 2024-09-12T02:04:17.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.144+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f920 con 0x559c70b49100 2024-09-12T02:04:17.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.145+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v111'99 uv98 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.145+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b49100 2024-09-12T02:04:17.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.146+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v111'100 uv100 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.146+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b49100 2024-09-12T02:04:17.147 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:04:17.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.147+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v111'101 uv101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.147+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b49100 2024-09-12T02:04:17.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.148+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v111'102 uv102 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.148+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b49100 2024-09-12T02:04:17.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.149+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v111'103 uv103 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.149+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b49100 2024-09-12T02:04:17.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.150+0000 7f52a4b73640 1 -- 172.21.15.19:0/4204277886 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v111'104 uv104 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5294062430 con 0x559c70b49100 2024-09-12T02:04:17.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.150+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b40b60 2024-09-12T02:04:17.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.152+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v111'84 uv83 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.152+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b40b60 2024-09-12T02:04:17.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.153+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v111'85 uv85 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.153+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b40b60 2024-09-12T02:04:17.155 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:04:17.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.154+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v111'86 uv86 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.155+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b40b60 2024-09-12T02:04:17.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.156+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v111'87 uv87 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.156+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b40b60 2024-09-12T02:04:17.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.157+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v111'88 uv88 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.157+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b40b60 2024-09-12T02:04:17.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.158+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v111'204 uv196 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.158+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b40b60 2024-09-12T02:04:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.159+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v111'205 uv205 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.159+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b40b60 2024-09-12T02:04:17.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.160+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v111'206 uv206 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.160 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:04:17.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.160+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b40b60 2024-09-12T02:04:17.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.161+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v111'207 uv207 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.161+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b40b60 2024-09-12T02:04:17.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.162+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v111'208 uv208 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.162+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b40b60 2024-09-12T02:04:17.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.163+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v111'209 uv203 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.163+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b40b60 2024-09-12T02:04:17.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.164+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v111'210 uv210 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.164+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b40b60 2024-09-12T02:04:17.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.165+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v111'211 uv211 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.165 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:04:17.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.165+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b40b60 2024-09-12T02:04:17.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.166+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v111'212 uv212 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.166+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b40b60 2024-09-12T02:04:17.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.167+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v111'213 uv213 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.167+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4f8e0 con 0x559c70b40b60 2024-09-12T02:04:17.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.168+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v111'214 uv214 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.168+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x559c70b4fd60 con 0x559c70b40b60 2024-09-12T02:04:17.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a4372640 1 -- 172.21.15.19:0/4204277886 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v111'215 uv215 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5298026070 con 0x559c70b40b60 2024-09-12T02:04:17.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559c70b3af60 msgr2=0x559c70b3e1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559c70b3af60 0x559c70b3e1c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x559c70a961a0 msgr2=0x559c70a7acc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x559c70a961a0 0x559c70a7acc0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x559c70b453e0 msgr2=0x559c70b48240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x559c70b453e0 0x559c70b48240 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x559c70b4cb90 msgr2=0x559c70b4ef80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x559c70b4cb90 0x559c70b4ef80 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x559c70b40b60 msgr2=0x559c70b40f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x559c70b40b60 0x559c70b40f40 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559c70b49100 msgr2=0x559c70b4b4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559c70b49100 0x559c70b4b4f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 reap_dead start 2024-09-12T02:04:17.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 reap_dead start 2024-09-12T02:04:17.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a5374640 1 -- 172.21.15.19:0/4204277886 reap_dead start 2024-09-12T02:04:17.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f529006a840 msgr2=0x7f529006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f529006a840 0x7f529006cd00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5294009a90 tx=0x7f5294050000 comp rx=0 tx=0).stop 2024-09-12T02:04:17.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c70a7c870 msgr2=0x559c70a03ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c70a7c870 0x559c70a03ee0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f5298009ec0 tx=0x7f5298005790 comp rx=0 tx=0).stop 2024-09-12T02:04:17.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 shutdown_connections 2024-09-12T02:04:17.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f529006a840 0x7f529006cd00 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 --2- 172.21.15.19:0/4204277886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c70a7c870 0x559c70a03ee0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 >> 172.21.15.19:0/4204277886 conn(0x559c709c2ad0 msgr2=0x559c709c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:17.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 shutdown_connections 2024-09-12T02:04:17.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.169+0000 7f52a707df40 1 -- 172.21.15.19:0/4204277886 wait complete. 2024-09-12T02:04:17.172 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put 200.00000001 - 2024-09-12T02:04:17.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.216+0000 7f2999a68f40 1 Processor -- start 2024-09-12T02:04:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.216+0000 7f2999a68f40 1 -- start start 2024-09-12T02:04:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.217+0000 7f2999a68f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556584d85350 0x556584e3b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.217+0000 7f2999a68f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556584db3050 0x556584dcc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.217+0000 7f2999a68f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556584e3d080 0x556584e5cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.217+0000 7f2999a68f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556584d81ae0 con 0x556584e3d080 2024-09-12T02:04:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.217+0000 7f2999a68f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556584cd4510 con 0x556584d85350 2024-09-12T02:04:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.217+0000 7f2999a68f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556584d81dc0 con 0x556584db3050 2024-09-12T02:04:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.217+0000 7f2997d61640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556584e3d080 0x556584e5cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.217+0000 7f2997d61640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556584e3d080 0x556584e5cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57750/0 (socket says 172.21.15.19:57750) 2024-09-12T02:04:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.217+0000 7f2997d61640 1 -- 172.21.15.19:0/1981290492 learned_addr learned my addr 172.21.15.19:0/1981290492 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.217+0000 7f2997560640 1 --2- 172.21.15.19:0/1981290492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556584d85350 0x556584e3b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.217+0000 7f2996d5f640 1 --2- 172.21.15.19:0/1981290492 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556584db3050 0x556584dcc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.217+0000 7f2997d61640 1 -- 172.21.15.19:0/1981290492 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556584db3050 msgr2=0x556584dcc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.217+0000 7f2997d61640 1 --2- 172.21.15.19:0/1981290492 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556584db3050 0x556584dcc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.217+0000 7f2997d61640 1 -- 172.21.15.19:0/1981290492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556584d85350 msgr2=0x556584e3b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.217+0000 7f2997d61640 1 --2- 172.21.15.19:0/1981290492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556584d85350 0x556584e3b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.217+0000 7f2997d61640 1 -- 172.21.15.19:0/1981290492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556584dae6a0 con 0x556584e3d080 2024-09-12T02:04:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.217+0000 7f2997560640 1 --2- 172.21.15.19:0/1981290492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556584d85350 0x556584e3b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.217+0000 7f2997d61640 1 --2- 172.21.15.19:0/1981290492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556584e3d080 0x556584e5cf00 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f2990046220 tx=0x7f2990050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560d2420994a71c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.218+0000 7f2995d5d640 1 -- 172.21.15.19:0/1981290492 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299004eb60 con 0x556584e3d080 2024-09-12T02:04:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.218+0000 7f2995d5d640 1 -- 172.21.15.19:0/1981290492 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2990066070 con 0x556584e3d080 2024-09-12T02:04:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.218+0000 7f2995d5d640 1 -- 172.21.15.19:0/1981290492 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2990061420 con 0x556584e3d080 2024-09-12T02:04:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.218+0000 7f2999a68f40 1 -- 172.21.15.19:0/1981290492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556584e3d080 msgr2=0x556584e5cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.218+0000 7f2999a68f40 1 --2- 172.21.15.19:0/1981290492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556584e3d080 0x556584e5cf00 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f2990046220 tx=0x7f2990050000 comp rx=0 tx=0).stop 2024-09-12T02:04:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.218+0000 7f2999a68f40 1 -- 172.21.15.19:0/1981290492 shutdown_connections 2024-09-12T02:04:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.218+0000 7f2999a68f40 1 --2- 172.21.15.19:0/1981290492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556584e3d080 0x556584e5cf00 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.218+0000 7f2999a68f40 1 --2- 172.21.15.19:0/1981290492 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556584db3050 0x556584dcc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.218+0000 7f2999a68f40 1 --2- 172.21.15.19:0/1981290492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556584d85350 0x556584e3b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.218+0000 7f2999a68f40 1 -- 172.21.15.19:0/1981290492 >> 172.21.15.19:0/1981290492 conn(0x556584d829e0 msgr2=0x556584d82dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.218+0000 7f2999a68f40 1 -- 172.21.15.19:0/1981290492 shutdown_connections 2024-09-12T02:04:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.218+0000 7f2999a68f40 1 -- 172.21.15.19:0/1981290492 wait complete. 2024-09-12T02:04:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.219+0000 7f2999a68f40 1 Processor -- start 2024-09-12T02:04:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.219+0000 7f2999a68f40 1 -- start start 2024-09-12T02:04:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2999a68f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556584d85350 0x556584e39850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2999a68f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556584db3050 0x556584dadad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2999a68f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556584e3d080 0x556584e54270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2999a68f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556584daec60 con 0x556584db3050 2024-09-12T02:04:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2999a68f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556584dae980 con 0x556584d85350 2024-09-12T02:04:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2999a68f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556584daef40 con 0x556584e3d080 2024-09-12T02:04:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2996d5f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556584db3050 0x556584dadad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2996d5f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556584db3050 0x556584dadad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57762/0 (socket says 172.21.15.19:57762) 2024-09-12T02:04:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2996d5f640 1 -- 172.21.15.19:0/2272907995 learned_addr learned my addr 172.21.15.19:0/2272907995 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2997560640 1 --2- 172.21.15.19:0/2272907995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556584d85350 0x556584e39850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2997d61640 1 --2- 172.21.15.19:0/2272907995 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556584e3d080 0x556584e54270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2996d5f640 1 -- 172.21.15.19:0/2272907995 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556584e3d080 msgr2=0x556584e54270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2996d5f640 1 --2- 172.21.15.19:0/2272907995 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556584e3d080 0x556584e54270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2996d5f640 1 -- 172.21.15.19:0/2272907995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556584d85350 msgr2=0x556584e39850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2996d5f640 1 --2- 172.21.15.19:0/2272907995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556584d85350 0x556584e39850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2996d5f640 1 -- 172.21.15.19:0/2272907995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556584e55320 con 0x556584db3050 2024-09-12T02:04:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2997d61640 1 --2- 172.21.15.19:0/2272907995 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556584e3d080 0x556584e54270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2997560640 1 --2- 172.21.15.19:0/2272907995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556584d85350 0x556584e39850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2996d5f640 1 --2- 172.21.15.19:0/2272907995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556584db3050 0x556584dadad0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f298c003c80 tx=0x7f298c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2994d5b640 1 -- 172.21.15.19:0/2272907995 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298c015070 con 0x556584db3050 2024-09-12T02:04:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2994d5b640 1 -- 172.21.15.19:0/2272907995 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f298c011660 con 0x556584db3050 2024-09-12T02:04:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2999a68f40 1 -- 172.21.15.19:0/2272907995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556584e55600 con 0x556584db3050 2024-09-12T02:04:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2994d5b640 1 -- 172.21.15.19:0/2272907995 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298c011a50 con 0x556584db3050 2024-09-12T02:04:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.220+0000 7f2999a68f40 1 -- 172.21.15.19:0/2272907995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556584dc6fd0 con 0x556584db3050 2024-09-12T02:04:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.222+0000 7f2994d5b640 1 -- 172.21.15.19:0/2272907995 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f298c018070 con 0x556584db3050 2024-09-12T02:04:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.222+0000 7f2994d5b640 1 --2- 172.21.15.19:0/2272907995 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f298406a810 0x7f298406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.222+0000 7f2994d5b640 1 -- 172.21.15.19:0/2272907995 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 7679+0+0 (secure 0 0 0) 0x7f298c08a2e0 con 0x556584db3050 2024-09-12T02:04:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.222+0000 7f2997560640 1 --2- 172.21.15.19:0/2272907995 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f298406a810 0x7f298406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.222+0000 7f2999a68f40 1 --2- 172.21.15.19:0/2272907995 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556584dae010 0x556584e54cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.222+0000 7f2999a68f40 1 -- 172.21.15.19:0/2272907995 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:1 13.14 13:2e2fa760:::200.00000001:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x556584ef3ef0 con 0x556584dae010 2024-09-12T02:04:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.223+0000 7f2997d61640 1 --2- 172.21.15.19:0/2272907995 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556584dae010 0x556584e54cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.223+0000 7f2997560640 1 --2- 172.21.15.19:0/2272907995 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f298406a810 0x7f298406ccd0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2988007640 tx=0x7f298800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.223+0000 7f2997d61640 1 --2- 172.21.15.19:0/2272907995 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556584dae010 0x556584e54cc0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.224+0000 7f2997d61640 1 -- 172.21.15.19:0/2272907995 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(1 200.00000001 [writefull 0~80] v111'396 uv396 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f299004ea80 con 0x556584dae010 2024-09-12T02:04:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.224+0000 7f2999a68f40 1 -- 172.21.15.19:0/2272907995 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556584dae010 msgr2=0x556584e54cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.224+0000 7f2999a68f40 1 --2- 172.21.15.19:0/2272907995 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556584dae010 0x556584e54cc0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.225+0000 7f2999a68f40 1 -- 172.21.15.19:0/2272907995 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f298406a810 msgr2=0x7f298406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.225+0000 7f2999a68f40 1 --2- 172.21.15.19:0/2272907995 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f298406a810 0x7f298406ccd0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2988007640 tx=0x7f298800b040 comp rx=0 tx=0).stop 2024-09-12T02:04:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.225+0000 7f2999a68f40 1 -- 172.21.15.19:0/2272907995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556584db3050 msgr2=0x556584dadad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.225+0000 7f2999a68f40 1 --2- 172.21.15.19:0/2272907995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556584db3050 0x556584dadad0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f298c003c80 tx=0x7f298c00b5b0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.225+0000 7f2997d61640 1 -- 172.21.15.19:0/2272907995 reap_dead start 2024-09-12T02:04:17.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.225+0000 7f2999a68f40 1 -- 172.21.15.19:0/2272907995 shutdown_connections 2024-09-12T02:04:17.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.225+0000 7f2999a68f40 1 -- 172.21.15.19:0/2272907995 >> 172.21.15.19:0/2272907995 conn(0x556584d829e0 msgr2=0x556584d82dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:17.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.225+0000 7f2999a68f40 1 -- 172.21.15.19:0/2272907995 shutdown_connections 2024-09-12T02:04:17.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.225+0000 7f2999a68f40 1 -- 172.21.15.19:0/2272907995 wait complete. 2024-09-12T02:04:17.230 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:04:17.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.373+0000 7fb0ca74b640 1 Processor -- start 2024-09-12T02:04:17.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.374+0000 7fb0ca74b640 1 -- start start 2024-09-12T02:04:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.374+0000 7fb0ca74b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0c4159ce0 0x7fb0c415d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.374+0000 7fb0ca74b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb0c415dce0 0x7fb0c415e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.374+0000 7fb0ca74b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0c415d730 con 0x7fb0c40b5f10 2024-09-12T02:04:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.374+0000 7fb0ca74b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb0c40700b0 con 0x7fb0c415dce0 2024-09-12T02:04:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.374+0000 7fb0ca74b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c41601b0 con 0x7fb0c4159ce0 2024-09-12T02:04:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.375+0000 7fb0c8ce8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb0c415dce0 0x7fb0c415e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.375+0000 7fb0c8ce8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb0c415dce0 0x7fb0c415e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57770/0 (socket says 172.21.15.19:57770) 2024-09-12T02:04:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.375+0000 7fb0c8ce8640 1 -- 172.21.15.19:0/4042195646 learned_addr learned my addr 172.21.15.19:0/4042195646 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.375+0000 7fb0c3fff640 1 --2- 172.21.15.19:0/4042195646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0c4159ce0 0x7fb0c415d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.375+0000 7fb0c8ce8640 1 -- 172.21.15.19:0/4042195646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0c4159ce0 msgr2=0x7fb0c415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.375+0000 7fb0c8ce8640 1 --2- 172.21.15.19:0/4042195646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0c4159ce0 0x7fb0c415d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.375+0000 7fb0c8ce8640 1 -- 172.21.15.19:0/4042195646 >> v1:172.21.15.135:6789/0 conn(0x7fb0c40b5f10 legacy=0x7fb0c40b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.375+0000 7fb0c8ce8640 1 -- 172.21.15.19:0/4042195646 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c4160490 con 0x7fb0c415dce0 2024-09-12T02:04:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.376+0000 7fb0c8ce8640 1 --2- 172.21.15.19:0/4042195646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0c415dce0 0x7fb0c415e170 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009e50 tx=0x7fb0bc02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d083b891ad8934ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.376+0000 7fb0c2ffd640 1 -- 172.21.15.19:0/4042195646 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc036070 con 0x7fb0c415dce0 2024-09-12T02:04:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.376+0000 7fb0c2ffd640 1 -- 172.21.15.19:0/4042195646 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0bc031600 con 0x7fb0c415dce0 2024-09-12T02:04:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.376+0000 7fb0c2ffd640 1 -- 172.21.15.19:0/4042195646 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0319d0 con 0x7fb0c415dce0 2024-09-12T02:04:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.376+0000 7fb0ca74b640 1 -- 172.21.15.19:0/4042195646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0c415dce0 msgr2=0x7fb0c415e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.376+0000 7fb0ca74b640 1 --2- 172.21.15.19:0/4042195646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0c415dce0 0x7fb0c415e170 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009e50 tx=0x7fb0bc02a5f0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.376+0000 7fb0ca74b640 1 -- 172.21.15.19:0/4042195646 shutdown_connections 2024-09-12T02:04:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.376+0000 7fb0ca74b640 1 --2- 172.21.15.19:0/4042195646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0c415dce0 0x7fb0c415e170 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.376+0000 7fb0ca74b640 1 --2- 172.21.15.19:0/4042195646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0c4159ce0 0x7fb0c415d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.376+0000 7fb0ca74b640 1 -- 172.21.15.19:0/4042195646 >> 172.21.15.19:0/4042195646 conn(0x7fb0c4073590 msgr2=0x7fb0c406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.376+0000 7fb0ca74b640 1 -- 172.21.15.19:0/4042195646 shutdown_connections 2024-09-12T02:04:17.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.376+0000 7fb0ca74b640 1 -- 172.21.15.19:0/4042195646 wait complete. 2024-09-12T02:04:17.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.378+0000 7fb0ca74b640 1 Processor -- start 2024-09-12T02:04:17.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.378+0000 7fb0ca74b640 1 -- start start 2024-09-12T02:04:17.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.378+0000 7fb0ca74b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0c40b5f10 0x7fb0c4147510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.378+0000 7fb0ca74b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0c4159ce0 0x7fb0c41f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.378+0000 7fb0ca74b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0c415dce0 0x7fb0c41f2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.378+0000 7fb0ca74b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c415a0c0 con 0x7fb0c4159ce0 2024-09-12T02:04:17.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.378+0000 7fb0ca74b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c4160a50 con 0x7fb0c40b5f10 2024-09-12T02:04:17.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.378+0000 7fb0ca74b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c41f2c20 con 0x7fb0c415dce0 2024-09-12T02:04:17.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.379+0000 7fb0c37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0c4159ce0 0x7fb0c41f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.379+0000 7fb0c37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0c4159ce0 0x7fb0c41f2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57774/0 (socket says 172.21.15.19:57774) 2024-09-12T02:04:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.379+0000 7fb0c37fe640 1 -- 172.21.15.19:0/2490075859 learned_addr learned my addr 172.21.15.19:0/2490075859 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.379+0000 7fb0c3fff640 1 --2- 172.21.15.19:0/2490075859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0c40b5f10 0x7fb0c4147510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.379+0000 7fb0c8ce8640 1 --2- 172.21.15.19:0/2490075859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0c415dce0 0x7fb0c41f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.379+0000 7fb0c37fe640 1 -- 172.21.15.19:0/2490075859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0c415dce0 msgr2=0x7fb0c41f2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.379+0000 7fb0c37fe640 1 --2- 172.21.15.19:0/2490075859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0c415dce0 0x7fb0c41f2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.379+0000 7fb0c37fe640 1 -- 172.21.15.19:0/2490075859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0c40b5f10 msgr2=0x7fb0c4147510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.379+0000 7fb0c37fe640 1 --2- 172.21.15.19:0/2490075859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0c40b5f10 0x7fb0c4147510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.379+0000 7fb0c37fe640 1 -- 172.21.15.19:0/2490075859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c41f2f00 con 0x7fb0c4159ce0 2024-09-12T02:04:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.379+0000 7fb0c37fe640 1 --2- 172.21.15.19:0/2490075859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0c4159ce0 0x7fb0c41f2100 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800c3c0 tx=0x7fb0b800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.379+0000 7fb0c0ff9640 1 -- 172.21.15.19:0/2490075859 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b80052d0 con 0x7fb0c4159ce0 2024-09-12T02:04:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.379+0000 7fb0c0ff9640 1 -- 172.21.15.19:0/2490075859 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b8005490 con 0x7fb0c4159ce0 2024-09-12T02:04:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.379+0000 7fb0ca74b640 1 -- 172.21.15.19:0/2490075859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c41f31e0 con 0x7fb0c4159ce0 2024-09-12T02:04:17.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.379+0000 7fb0c0ff9640 1 -- 172.21.15.19:0/2490075859 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8007260 con 0x7fb0c4159ce0 2024-09-12T02:04:17.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.379+0000 7fb0ca74b640 1 -- 172.21.15.19:0/2490075859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c41f37a0 con 0x7fb0c4159ce0 2024-09-12T02:04:17.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.380+0000 7fb0ca74b640 1 -- 172.21.15.19:0/2490075859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0c4070b10 con 0x7fb0c4159ce0 2024-09-12T02:04:17.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.381+0000 7fb0c0ff9640 1 -- 172.21.15.19:0/2490075859 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb0b8007400 con 0x7fb0c4159ce0 2024-09-12T02:04:17.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.381+0000 7fb0c0ff9640 1 --2- 172.21.15.19:0/2490075859 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb0b006be30 0x7fb0b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:17.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.381+0000 7fb0c0ff9640 1 -- 172.21.15.19:0/2490075859 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 7679+0+0 (secure 0 0 0) 0x7fb0b808aae0 con 0x7fb0c4159ce0 2024-09-12T02:04:17.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.381+0000 7fb0c3fff640 1 --2- 172.21.15.19:0/2490075859 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb0b006be30 0x7fb0b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:17.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.382+0000 7fb0c3fff640 1 --2- 172.21.15.19:0/2490075859 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb0b006be30 0x7fb0b006e2f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009b40 tx=0x7fb0b4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:17.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.386+0000 7fb0c0ff9640 1 -- 172.21.15.19:0/2490075859 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb0c4070b10 con 0x7fb0c4159ce0 2024-09-12T02:04:17.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.602+0000 7fb0ca74b640 1 -- 172.21.15.19:0/2490075859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fb0c415fda0 con 0x7fb0c4159ce0 2024-09-12T02:04:17.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.961+0000 7fb0c0ff9640 1 -- 172.21.15.19:0/2490075859 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v180) ==== 162+0+0 (secure 0 0 0) 0x7fb0b80585f0 con 0x7fb0c4159ce0 2024-09-12T02:04:17.962 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:04:17.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.963+0000 7fb0ca74b640 1 -- 172.21.15.19:0/2490075859 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb0b006be30 msgr2=0x7fb0b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.963+0000 7fb0ca74b640 1 --2- 172.21.15.19:0/2490075859 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb0b006be30 0x7fb0b006e2f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009b40 tx=0x7fb0b4009190 comp rx=0 tx=0).stop 2024-09-12T02:04:17.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.963+0000 7fb0ca74b640 1 -- 172.21.15.19:0/2490075859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0c4159ce0 msgr2=0x7fb0c41f2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.963+0000 7fb0ca74b640 1 --2- 172.21.15.19:0/2490075859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0c4159ce0 0x7fb0c41f2100 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800c3c0 tx=0x7fb0b800c880 comp rx=0 tx=0).stop 2024-09-12T02:04:17.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.964+0000 7fb0ca74b640 1 -- 172.21.15.19:0/2490075859 shutdown_connections 2024-09-12T02:04:17.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.964+0000 7fb0ca74b640 1 --2- 172.21.15.19:0/2490075859 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb0b006be30 0x7fb0b006e2f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.964+0000 7fb0ca74b640 1 --2- 172.21.15.19:0/2490075859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0c415dce0 0x7fb0c41f2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.964+0000 7fb0ca74b640 1 --2- 172.21.15.19:0/2490075859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0c4159ce0 0x7fb0c41f2100 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.964+0000 7fb0ca74b640 1 --2- 172.21.15.19:0/2490075859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0c40b5f10 0x7fb0c4147510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.964+0000 7fb0ca74b640 1 -- 172.21.15.19:0/2490075859 >> 172.21.15.19:0/2490075859 conn(0x7fb0c4073590 msgr2=0x7fb0c415a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:17.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.964+0000 7fb0ca74b640 1 -- 172.21.15.19:0/2490075859 shutdown_connections 2024-09-12T02:04:17.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:17.964+0000 7fb0ca74b640 1 -- 172.21.15.19:0/2490075859 wait complete. 2024-09-12T02:04:17.971 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:04:17.971+0000 7fbc9b247640 -1 log_channel(cluster) log [ERR] : missing journal object 2024-09-12T02:04:17.972 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:17.972+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:04:17.972 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:17.972+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:04:17.979 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:18.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.083+0000 7f11edb03640 1 Processor -- start 2024-09-12T02:04:18.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.083+0000 7f11edb03640 1 -- start start 2024-09-12T02:04:18.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.084+0000 7f11edb03640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f11e80d30f0 0x7f11e80b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:18.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.084+0000 7f11edb03640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11e80d3690 con 0x7f11e815e5f0 2024-09-12T02:04:18.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.084+0000 7f11edb03640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11e80d3970 con 0x7f11e80b64c0 2024-09-12T02:04:18.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.084+0000 7f11edb03640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f11e806d530 con 0x7f11e80d30f0 2024-09-12T02:04:18.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.084+0000 7f11e6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f11e80d30f0 0x7f11e80b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:18.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.084+0000 7f11e6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f11e80d30f0 0x7f11e80b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57782/0 (socket says 172.21.15.19:57782) 2024-09-12T02:04:18.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.084+0000 7f11e77fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f11e815e5f0 0x7f11e80d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49184/0 (socket says 172.21.15.19:49184) 2024-09-12T02:04:18.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.084+0000 7f11e6ffd640 1 -- 172.21.15.19:0/1963879411 learned_addr learned my addr 172.21.15.19:0/1963879411 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.085+0000 7f11e6ffd640 1 -- 172.21.15.19:0/1963879411 >> v1:172.21.15.135:6789/0 conn(0x7f11e80b64c0 legacy=0x7f11e806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.085+0000 7f11e6ffd640 1 -- 172.21.15.19:0/1963879411 >> v1:172.21.15.19:6789/0 conn(0x7f11e815e5f0 legacy=0x7f11e80d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.085+0000 7f11e6ffd640 1 -- 172.21.15.19:0/1963879411 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e806cee0 con 0x7f11e80d30f0 2024-09-12T02:04:18.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.085+0000 7f11e6ffd640 1 --2- 172.21.15.19:0/1963879411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11e80d30f0 0x7f11e80b5f80 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009870 tx=0x7f11dc02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d885b88b06608a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:18.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.085+0000 7f11e67fc640 1 -- 172.21.15.19:0/1963879411 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc037070 con 0x7f11e80d30f0 2024-09-12T02:04:18.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.085+0000 7f11e67fc640 1 -- 172.21.15.19:0/1963879411 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11dc032440 con 0x7f11e80d30f0 2024-09-12T02:04:18.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.085+0000 7f11e67fc640 1 -- 172.21.15.19:0/1963879411 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc032810 con 0x7f11e80d30f0 2024-09-12T02:04:18.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.086+0000 7f11edb03640 1 -- 172.21.15.19:0/1963879411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11e80d30f0 msgr2=0x7f11e80b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:18.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.086+0000 7f11edb03640 1 --2- 172.21.15.19:0/1963879411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11e80d30f0 0x7f11e80b5f80 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009870 tx=0x7f11dc02a2a0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.086+0000 7f11edb03640 1 -- 172.21.15.19:0/1963879411 shutdown_connections 2024-09-12T02:04:18.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.086+0000 7f11edb03640 1 --2- 172.21.15.19:0/1963879411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11e80d30f0 0x7f11e80b5f80 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.086+0000 7f11edb03640 1 -- 172.21.15.19:0/1963879411 >> 172.21.15.19:0/1963879411 conn(0x7f11e808bfc0 msgr2=0x7f11e80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:18.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.086+0000 7f11edb03640 1 -- 172.21.15.19:0/1963879411 shutdown_connections 2024-09-12T02:04:18.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.086+0000 7f11edb03640 1 -- 172.21.15.19:0/1963879411 wait complete. 2024-09-12T02:04:18.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.087+0000 7f11edb03640 1 Processor -- start 2024-09-12T02:04:18.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.087+0000 7f11edb03640 1 -- start start 2024-09-12T02:04:18.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.088+0000 7f11edb03640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11e80b64c0 0x7f11e815b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:18.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.088+0000 7f11edb03640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11e80d30f0 0x7f11e81615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:18.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.088+0000 7f11edb03640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11e815e5f0 0x7f11e80b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:18.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.088+0000 7f11edb03640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f11e806e0d0 con 0x7f11e80d30f0 2024-09-12T02:04:18.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.088+0000 7f11edb03640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f11e815e9d0 con 0x7f11e80b64c0 2024-09-12T02:04:18.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.088+0000 7f11edb03640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f11e806e250 con 0x7f11e815e5f0 2024-09-12T02:04:18.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.088+0000 7f11e6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11e80d30f0 0x7f11e81615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:18.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.088+0000 7f11e6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11e80d30f0 0x7f11e81615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57790/0 (socket says 172.21.15.19:57790) 2024-09-12T02:04:18.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.088+0000 7f11e6ffd640 1 -- 172.21.15.19:0/3413718267 learned_addr learned my addr 172.21.15.19:0/3413718267 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:18.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.089+0000 7f11e77fe640 1 --2- 172.21.15.19:0/3413718267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11e80b64c0 0x7f11e815b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:18.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.089+0000 7f11e7fff640 1 --2- 172.21.15.19:0/3413718267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11e815e5f0 0x7f11e80b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:18.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.089+0000 7f11e6ffd640 1 -- 172.21.15.19:0/3413718267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11e815e5f0 msgr2=0x7f11e80b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:18.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.089+0000 7f11e6ffd640 1 --2- 172.21.15.19:0/3413718267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11e815e5f0 0x7f11e80b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.089+0000 7f11e6ffd640 1 -- 172.21.15.19:0/3413718267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11e80b64c0 msgr2=0x7f11e815b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:18.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.089+0000 7f11e6ffd640 1 --2- 172.21.15.19:0/3413718267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11e80b64c0 0x7f11e815b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.089+0000 7f11e6ffd640 1 -- 172.21.15.19:0/3413718267 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e8161b20 con 0x7f11e80d30f0 2024-09-12T02:04:18.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.089+0000 7f11e77fe640 1 --2- 172.21.15.19:0/3413718267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11e80b64c0 0x7f11e815b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:18.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.089+0000 7f11e6ffd640 1 --2- 172.21.15.19:0/3413718267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11e80d30f0 0x7f11e81615e0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009870 tx=0x7f11dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:18.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.089+0000 7f11cffff640 1 -- 172.21.15.19:0/3413718267 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc041070 con 0x7f11e80d30f0 2024-09-12T02:04:18.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.089+0000 7f11cffff640 1 -- 172.21.15.19:0/3413718267 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11dc03c870 con 0x7f11e80d30f0 2024-09-12T02:04:18.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.089+0000 7f11edb03640 1 -- 172.21.15.19:0/3413718267 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11e8160540 con 0x7f11e80d30f0 2024-09-12T02:04:18.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.089+0000 7f11cffff640 1 -- 172.21.15.19:0/3413718267 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc037040 con 0x7f11e80d30f0 2024-09-12T02:04:18.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.089+0000 7f11edb03640 1 -- 172.21.15.19:0/3413718267 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11e8160b00 con 0x7f11e80d30f0 2024-09-12T02:04:18.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.090+0000 7f11edb03640 1 -- 172.21.15.19:0/3413718267 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11e80b5f80 con 0x7f11e80d30f0 2024-09-12T02:04:18.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.091+0000 7f11cffff640 1 -- 172.21.15.19:0/3413718267 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11dc044070 con 0x7f11e80d30f0 2024-09-12T02:04:18.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.091+0000 7f11cffff640 1 --2- 172.21.15.19:0/3413718267 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f11d406be30 0x7f11d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:18.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.091+0000 7f11cffff640 1 -- 172.21.15.19:0/3413718267 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7f11dc0ac1d0 con 0x7f11e80d30f0 2024-09-12T02:04:18.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.091+0000 7f11e77fe640 1 --2- 172.21.15.19:0/3413718267 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f11d406be30 0x7f11d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:18.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.092+0000 7f11e77fe640 1 --2- 172.21.15.19:0/3413718267 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f11d406be30 0x7f11d406e2f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f11d8000f60 tx=0x7f11d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:18.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.096+0000 7f11cffff640 1 -- 172.21.15.19:0/3413718267 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f11dc07a400 con 0x7f11e80d30f0 2024-09-12T02:04:18.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.307+0000 7f11edb03640 1 -- 172.21.15.19:0/3413718267 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11e80b4d60 con 0x7f11e80d30f0 2024-09-12T02:04:18.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.307+0000 7f11cffff640 1 -- 172.21.15.19:0/3413718267 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 182 v182) ==== 95+0+3563 (secure 0 0 0) 0x7f11dc079d00 con 0x7f11e80d30f0 2024-09-12T02:04:18.308 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:18.308 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":182,"btime":"2024-09-12T02:04:17:973634+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":182,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:17.973558+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:18.308 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 182 2024-09-12T02:04:18.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.309+0000 7f11edb03640 1 -- 172.21.15.19:0/3413718267 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f11d406be30 msgr2=0x7f11d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:18.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.309+0000 7f11edb03640 1 --2- 172.21.15.19:0/3413718267 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f11d406be30 0x7f11d406e2f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f11d8000f60 tx=0x7f11d8009040 comp rx=0 tx=0).stop 2024-09-12T02:04:18.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.309+0000 7f11edb03640 1 -- 172.21.15.19:0/3413718267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11e80d30f0 msgr2=0x7f11e81615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:18.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.309+0000 7f11edb03640 1 --2- 172.21.15.19:0/3413718267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11e80d30f0 0x7f11e81615e0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009870 tx=0x7f11dc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.309+0000 7f11edb03640 1 -- 172.21.15.19:0/3413718267 shutdown_connections 2024-09-12T02:04:18.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.309+0000 7f11edb03640 1 --2- 172.21.15.19:0/3413718267 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f11d406be30 0x7f11d406e2f0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.309+0000 7f11edb03640 1 --2- 172.21.15.19:0/3413718267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11e815e5f0 0x7f11e80b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.309+0000 7f11edb03640 1 --2- 172.21.15.19:0/3413718267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11e80d30f0 0x7f11e81615e0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.309+0000 7f11edb03640 1 --2- 172.21.15.19:0/3413718267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11e80b64c0 0x7f11e815b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.309+0000 7f11edb03640 1 -- 172.21.15.19:0/3413718267 >> 172.21.15.19:0/3413718267 conn(0x7f11e808bfc0 msgr2=0x7f11e80b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:18.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.309+0000 7f11edb03640 1 -- 172.21.15.19:0/3413718267 shutdown_connections 2024-09-12T02:04:18.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.309+0000 7f11edb03640 1 -- 172.21.15.19:0/3413718267 wait complete. 2024-09-12T02:04:18.320 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:18.320 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:18.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.422+0000 7f994973b640 1 Processor -- start 2024-09-12T02:04:18.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.422+0000 7f994973b640 1 -- start start 2024-09-12T02:04:18.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.423+0000 7f994973b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99440d06e0 0x7f99440ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:18.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.423+0000 7f994973b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f994415d3e0 0x7f99440d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:18.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.423+0000 7f994973b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99440d1000 con 0x7f994409b510 2024-09-12T02:04:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.423+0000 7f994973b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f994409b080 con 0x7f994415d3e0 2024-09-12T02:04:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.423+0000 7f994973b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f99440d00a0 con 0x7f99440d06e0 2024-09-12T02:04:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.423+0000 7f99427fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f994415d3e0 0x7f99440d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.423+0000 7f99437fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f994409b510 0x7f99440ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49186/0 (socket says 172.21.15.19:49186) 2024-09-12T02:04:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.423+0000 7f99437fe640 1 -- 172.21.15.19:0/2110538434 learned_addr learned my addr 172.21.15.19:0/2110538434 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.423+0000 7f9942ffd640 1 --2- 172.21.15.19:0/2110538434 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99440d06e0 0x7f99440ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.424+0000 7f99427fc640 1 -- 172.21.15.19:0/2110538434 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99440d06e0 msgr2=0x7f99440ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.424+0000 7f99427fc640 1 --2- 172.21.15.19:0/2110538434 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99440d06e0 0x7f99440ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.424+0000 7f99427fc640 1 -- 172.21.15.19:0/2110538434 >> v1:172.21.15.19:6789/0 conn(0x7f994409b510 legacy=0x7f99440ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.424+0000 7f99427fc640 1 -- 172.21.15.19:0/2110538434 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99440d0380 con 0x7f994415d3e0 2024-09-12T02:04:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.424+0000 7f9941ffb640 1 -- 172.21.15.19:0/2110538434 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 476549295 0 0) 0x7f99440d1000 con 0x7f994409b510 2024-09-12T02:04:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.424+0000 7f9942ffd640 1 --2- 172.21.15.19:0/2110538434 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99440d06e0 0x7f99440ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.424+0000 7f99427fc640 1 --2- 172.21.15.19:0/2110538434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f994415d3e0 0x7f99440d0ac0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f992c0097a0 tx=0x7f992c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126694a2cfb6b4a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.424+0000 7f9941ffb640 1 -- 172.21.15.19:0/2110538434 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992c037070 con 0x7f994415d3e0 2024-09-12T02:04:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.424+0000 7f9941ffb640 1 -- 172.21.15.19:0/2110538434 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f992c032440 con 0x7f994415d3e0 2024-09-12T02:04:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.424+0000 7f9941ffb640 1 -- 172.21.15.19:0/2110538434 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992c032810 con 0x7f994415d3e0 2024-09-12T02:04:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.425+0000 7f994973b640 1 -- 172.21.15.19:0/2110538434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f994415d3e0 msgr2=0x7f99440d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.425+0000 7f994973b640 1 --2- 172.21.15.19:0/2110538434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f994415d3e0 0x7f99440d0ac0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f992c0097a0 tx=0x7f992c02a180 comp rx=0 tx=0).stop 2024-09-12T02:04:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.425+0000 7f994973b640 1 -- 172.21.15.19:0/2110538434 shutdown_connections 2024-09-12T02:04:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.425+0000 7f994973b640 1 --2- 172.21.15.19:0/2110538434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f994415d3e0 0x7f99440d0ac0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.425+0000 7f994973b640 1 --2- 172.21.15.19:0/2110538434 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99440d06e0 0x7f99440ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.425+0000 7f994973b640 1 -- 172.21.15.19:0/2110538434 >> 172.21.15.19:0/2110538434 conn(0x7f99440d23a0 msgr2=0x7f99440d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:18.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.425+0000 7f994973b640 1 -- 172.21.15.19:0/2110538434 shutdown_connections 2024-09-12T02:04:18.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.425+0000 7f994973b640 1 -- 172.21.15.19:0/2110538434 wait complete. 2024-09-12T02:04:18.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.426+0000 7f994973b640 1 Processor -- start 2024-09-12T02:04:18.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.426+0000 7f994973b640 1 -- start start 2024-09-12T02:04:18.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.427+0000 7f994973b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f994409b510 0x7f994415daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:18.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.427+0000 7f994973b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99440d06e0 0x7f994415e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:18.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.427+0000 7f994973b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f994415d3e0 0x7f994415e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:18.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.427+0000 7f994973b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f994415d800 con 0x7f99440d06e0 2024-09-12T02:04:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.427+0000 7f994973b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f994409ad10 con 0x7f994415d3e0 2024-09-12T02:04:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.427+0000 7f994973b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f994415c740 con 0x7f994409b510 2024-09-12T02:04:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.427+0000 7f99427fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99440d06e0 0x7f994415e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.427+0000 7f99427fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99440d06e0 0x7f994415e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57800/0 (socket says 172.21.15.19:57800) 2024-09-12T02:04:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.427+0000 7f99427fc640 1 -- 172.21.15.19:0/2444552832 learned_addr learned my addr 172.21.15.19:0/2444552832 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.427+0000 7f99437fe640 1 --2- 172.21.15.19:0/2444552832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f994415d3e0 0x7f994415e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.427+0000 7f9942ffd640 1 --2- 172.21.15.19:0/2444552832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f994409b510 0x7f994415daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.428+0000 7f99427fc640 1 -- 172.21.15.19:0/2444552832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f994409b510 msgr2=0x7f994415daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.428+0000 7f99427fc640 1 --2- 172.21.15.19:0/2444552832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f994409b510 0x7f994415daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.428+0000 7f99427fc640 1 -- 172.21.15.19:0/2444552832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f994415d3e0 msgr2=0x7f994415e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.428+0000 7f99427fc640 1 --2- 172.21.15.19:0/2444552832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f994415d3e0 0x7f994415e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.428+0000 7f99427fc640 1 -- 172.21.15.19:0/2444552832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99440c89e0 con 0x7f99440d06e0 2024-09-12T02:04:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.428+0000 7f99437fe640 1 --2- 172.21.15.19:0/2444552832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f994415d3e0 0x7f994415e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:18.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.428+0000 7f9942ffd640 1 --2- 172.21.15.19:0/2444552832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f994409b510 0x7f994415daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:18.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.428+0000 7f99427fc640 1 --2- 172.21.15.19:0/2444552832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99440d06e0 0x7f994415e030 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f992c035040 tx=0x7f992c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:18.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.428+0000 7f993b7fe640 1 -- 172.21.15.19:0/2444552832 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992c037040 con 0x7f99440d06e0 2024-09-12T02:04:18.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.428+0000 7f993b7fe640 1 -- 172.21.15.19:0/2444552832 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f992c030770 con 0x7f99440d06e0 2024-09-12T02:04:18.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.428+0000 7f993b7fe640 1 -- 172.21.15.19:0/2444552832 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992c030b80 con 0x7f99440d06e0 2024-09-12T02:04:18.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.428+0000 7f994973b640 1 -- 172.21.15.19:0/2444552832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99440c8cc0 con 0x7f99440d06e0 2024-09-12T02:04:18.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.428+0000 7f994973b640 1 -- 172.21.15.19:0/2444552832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99440c96c0 con 0x7f99440d06e0 2024-09-12T02:04:18.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.429+0000 7f994973b640 1 -- 172.21.15.19:0/2444552832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99440ce8b0 con 0x7f99440d06e0 2024-09-12T02:04:18.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.429+0000 7f993b7fe640 1 -- 172.21.15.19:0/2444552832 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f992c044020 con 0x7f99440d06e0 2024-09-12T02:04:18.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.430+0000 7f993b7fe640 1 --2- 172.21.15.19:0/2444552832 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f992406be30 0x7f992406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:18.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.430+0000 7f993b7fe640 1 -- 172.21.15.19:0/2444552832 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7f992c0abb20 con 0x7f99440d06e0 2024-09-12T02:04:18.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.430+0000 7f9942ffd640 1 --2- 172.21.15.19:0/2444552832 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f992406be30 0x7f992406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:18.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.431+0000 7f9942ffd640 1 --2- 172.21.15.19:0/2444552832 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f992406be30 0x7f992406e2f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f993c006fd0 tx=0x7f993c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:18.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.434+0000 7f993b7fe640 1 -- 172.21.15.19:0/2444552832 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f992c032e20 con 0x7f99440d06e0 2024-09-12T02:04:18.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.649+0000 7f994973b640 1 -- 172.21.15.19:0/2444552832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99440d31d0 con 0x7f99440d06e0 2024-09-12T02:04:18.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.650+0000 7f993b7fe640 1 -- 172.21.15.19:0/2444552832 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 182 v182) ==== 95+0+3563 (secure 0 0 0) 0x7f992c079d50 con 0x7f99440d06e0 2024-09-12T02:04:18.650 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:18.650 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":182,"btime":"2024-09-12T02:04:17:973634+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":182,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:17.973558+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:18.650 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 182 2024-09-12T02:04:18.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.652+0000 7f994973b640 1 -- 172.21.15.19:0/2444552832 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f992406be30 msgr2=0x7f992406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.652+0000 7f994973b640 1 --2- 172.21.15.19:0/2444552832 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f992406be30 0x7f992406e2f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f993c006fd0 tx=0x7f993c008040 comp rx=0 tx=0).stop 2024-09-12T02:04:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.652+0000 7f994973b640 1 -- 172.21.15.19:0/2444552832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99440d06e0 msgr2=0x7f994415e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.652+0000 7f994973b640 1 --2- 172.21.15.19:0/2444552832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99440d06e0 0x7f994415e030 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f992c035040 tx=0x7f992c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.652+0000 7f994973b640 1 -- 172.21.15.19:0/2444552832 shutdown_connections 2024-09-12T02:04:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.652+0000 7f994973b640 1 --2- 172.21.15.19:0/2444552832 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f992406be30 0x7f992406e2f0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.652+0000 7f994973b640 1 --2- 172.21.15.19:0/2444552832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f994415d3e0 0x7f994415e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.652+0000 7f994973b640 1 --2- 172.21.15.19:0/2444552832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99440d06e0 0x7f994415e030 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.652+0000 7f994973b640 1 --2- 172.21.15.19:0/2444552832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f994409b510 0x7f994415daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.652+0000 7f994973b640 1 -- 172.21.15.19:0/2444552832 >> 172.21.15.19:0/2444552832 conn(0x7f99440d23a0 msgr2=0x7f99440cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.652+0000 7f994973b640 1 -- 172.21.15.19:0/2444552832 shutdown_connections 2024-09-12T02:04:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.652+0000 7f994973b640 1 -- 172.21.15.19:0/2444552832 wait complete. 2024-09-12T02:04:18.663 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:18.664 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:18.687 INFO:tasks.ceph.mds.d.smithi135.stderr: -31> 2024-09-12T02:04:13.936+0000 7fc5d2a8b640 -1 log_channel(cluster) log [ERR] : Error recovering journal 0x200: (22) Invalid argument 2024-09-12T02:04:18.715 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T02:04:18.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.765+0000 7fa09862e640 1 Processor -- start 2024-09-12T02:04:18.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.766+0000 7fa09862e640 1 -- start start 2024-09-12T02:04:18.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.766+0000 7fa09862e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa090162060 0x7fa0900b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:18.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.766+0000 7fa09862e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa0900b64b0 0x7fa0900b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:18.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.766+0000 7fa09862e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa09006d9f0 con 0x7fa090161c80 2024-09-12T02:04:18.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.766+0000 7fa09862e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa09006dcd0 con 0x7fa090162060 2024-09-12T02:04:18.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.766+0000 7fa09862e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa09006dfb0 con 0x7fa0900b64b0 2024-09-12T02:04:18.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.767+0000 7fa095bc9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa090162060 0x7fa0900b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:18.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.767+0000 7fa095bc9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa090162060 0x7fa0900b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57808/0 (socket says 172.21.15.19:57808) 2024-09-12T02:04:18.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.767+0000 7fa095bc9640 1 -- 172.21.15.19:0/2033724995 learned_addr learned my addr 172.21.15.19:0/2033724995 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:18.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.767+0000 7fa096bcb640 1 --2- 172.21.15.19:0/2033724995 >> v2:172.21.15.135:3300/0 conn(0x7fa0900b64b0 0x7fa0900b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:18.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.767+0000 7fa095bc9640 1 -- 172.21.15.19:0/2033724995 >> v2:172.21.15.135:3300/0 conn(0x7fa0900b64b0 msgr2=0x7fa0900b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:18.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.767+0000 7fa095bc9640 1 --2- 172.21.15.19:0/2033724995 >> v2:172.21.15.135:3300/0 conn(0x7fa0900b64b0 0x7fa0900b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.767+0000 7fa095bc9640 1 -- 172.21.15.19:0/2033724995 >> v1:172.21.15.19:6789/0 conn(0x7fa090161c80 legacy=0x7fa09006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:18.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.767+0000 7fa0953c8640 1 -- 172.21.15.19:0/2033724995 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2563203857 0 0) 0x7fa09006d9f0 con 0x7fa090161c80 2024-09-12T02:04:18.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.767+0000 7fa095bc9640 1 -- 172.21.15.19:0/2033724995 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0900d01f0 con 0x7fa090162060 2024-09-12T02:04:18.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.768+0000 7fa095bc9640 1 --2- 172.21.15.19:0/2033724995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa090162060 0x7fa0900b5f70 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fa09008d750 tx=0x7fa08002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ef3732e065764e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:18.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.768+0000 7fa0953c8640 1 -- 172.21.15.19:0/2033724995 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa080037070 con 0x7fa090162060 2024-09-12T02:04:18.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.768+0000 7fa0953c8640 1 -- 172.21.15.19:0/2033724995 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa080032440 con 0x7fa090162060 2024-09-12T02:04:18.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.768+0000 7fa0953c8640 1 -- 172.21.15.19:0/2033724995 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa080032810 con 0x7fa090162060 2024-09-12T02:04:18.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.768+0000 7fa09862e640 1 -- 172.21.15.19:0/2033724995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa090162060 msgr2=0x7fa0900b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:18.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.768+0000 7fa09862e640 1 --2- 172.21.15.19:0/2033724995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa090162060 0x7fa0900b5f70 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fa09008d750 tx=0x7fa08002a270 comp rx=0 tx=0).stop 2024-09-12T02:04:18.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.769+0000 7fa09862e640 1 -- 172.21.15.19:0/2033724995 shutdown_connections 2024-09-12T02:04:18.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.769+0000 7fa09862e640 1 --2- 172.21.15.19:0/2033724995 >> v2:172.21.15.135:3300/0 conn(0x7fa0900b64b0 0x7fa0900b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.769+0000 7fa09862e640 1 --2- 172.21.15.19:0/2033724995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa090162060 0x7fa0900b5f70 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.769+0000 7fa09862e640 1 -- 172.21.15.19:0/2033724995 >> 172.21.15.19:0/2033724995 conn(0x7fa0900d44f0 msgr2=0x7fa0900d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:18.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.769+0000 7fa09862e640 1 -- 172.21.15.19:0/2033724995 shutdown_connections 2024-09-12T02:04:18.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.769+0000 7fa09862e640 1 -- 172.21.15.19:0/2033724995 wait complete. 2024-09-12T02:04:18.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.770+0000 7fa09862e640 1 Processor -- start 2024-09-12T02:04:18.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.770+0000 7fa09862e640 1 -- start start 2024-09-12T02:04:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.770+0000 7fa09862e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0900b64b0 0x7fa0901f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa09862e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa090161c80 0x7fa0900b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa09862e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa090162060 0x7fa090160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa09862e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa0900cf1e0 con 0x7fa0900b64b0 2024-09-12T02:04:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa09862e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa0900d2aa0 con 0x7fa090161c80 2024-09-12T02:04:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa09862e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa0900cf360 con 0x7fa090162060 2024-09-12T02:04:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa0963ca640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0900b64b0 0x7fa0901f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa0963ca640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0900b64b0 0x7fa0901f3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57814/0 (socket says 172.21.15.19:57814) 2024-09-12T02:04:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa0963ca640 1 -- 172.21.15.19:0/97977307 learned_addr learned my addr 172.21.15.19:0/97977307 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa0963ca640 1 -- 172.21.15.19:0/97977307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa090162060 msgr2=0x7fa090160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa0963ca640 1 --2- 172.21.15.19:0/97977307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa090162060 0x7fa090160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa0963ca640 1 -- 172.21.15.19:0/97977307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa090161c80 msgr2=0x7fa0900b8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa0963ca640 1 --2- 172.21.15.19:0/97977307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa090161c80 0x7fa0900b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa0963ca640 1 -- 172.21.15.19:0/97977307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0900c8e40 con 0x7fa0900b64b0 2024-09-12T02:04:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa0963ca640 1 --2- 172.21.15.19:0/97977307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0900b64b0 0x7fa0901f3d10 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00c4b0 tx=0x7fa08c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa086ffd640 1 -- 172.21.15.19:0/97977307 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c017070 con 0x7fa0900b64b0 2024-09-12T02:04:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa086ffd640 1 -- 172.21.15.19:0/97977307 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa08c0035f0 con 0x7fa0900b64b0 2024-09-12T02:04:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa09862e640 1 -- 172.21.15.19:0/97977307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0900c9120 con 0x7fa0900b64b0 2024-09-12T02:04:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa086ffd640 1 -- 172.21.15.19:0/97977307 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c003a20 con 0x7fa0900b64b0 2024-09-12T02:04:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.771+0000 7fa09862e640 1 -- 172.21.15.19:0/97977307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0900c96e0 con 0x7fa0900b64b0 2024-09-12T02:04:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.772+0000 7fa09862e640 1 -- 172.21.15.19:0/97977307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0900c9ac0 con 0x7fa0900b64b0 2024-09-12T02:04:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.773+0000 7fa086ffd640 1 -- 172.21.15.19:0/97977307 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa08c01a070 con 0x7fa0900b64b0 2024-09-12T02:04:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.773+0000 7fa086ffd640 1 --2- 172.21.15.19:0/97977307 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa07406be30 0x7fa07406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.773+0000 7fa086ffd640 1 -- 172.21.15.19:0/97977307 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7fa08c08aae0 con 0x7fa0900b64b0 2024-09-12T02:04:18.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.773+0000 7fa095bc9640 1 --2- 172.21.15.19:0/97977307 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa07406be30 0x7fa07406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:18.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.774+0000 7fa095bc9640 1 --2- 172.21.15.19:0/97977307 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa07406be30 0x7fa07406e2f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa080034000 tx=0x7fa08002c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:18.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.777+0000 7fa086ffd640 1 -- 172.21.15.19:0/97977307 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa0900c9ac0 con 0x7fa0900b64b0 2024-09-12T02:04:18.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.992+0000 7fa09862e640 1 -- 172.21.15.19:0/97977307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0900b5f70 con 0x7fa0900b64b0 2024-09-12T02:04:18.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.993+0000 7fa086ffd640 1 -- 172.21.15.19:0/97977307 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 183 v183) ==== 95+0+4392 (secure 0 0 0) 0x7fa08c058c80 con 0x7fa0900b64b0 2024-09-12T02:04:18.993 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:18.994 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":183,"btime":"2024-09-12T02:04:18:975220+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7103,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2405422603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2405422603},{"type":"v1","addr":"172.21.15.135:6837","nonce":2405422603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":183}],"filesystems":[{"mdsmap":{"epoch":182,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:17.973558+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 183 2024-09-12T02:04:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.995+0000 7fa09862e640 1 -- 172.21.15.19:0/97977307 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa07406be30 msgr2=0x7fa07406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.995+0000 7fa09862e640 1 --2- 172.21.15.19:0/97977307 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa07406be30 0x7fa07406e2f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa080034000 tx=0x7fa08002c000 comp rx=0 tx=0).stop 2024-09-12T02:04:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.995+0000 7fa09862e640 1 -- 172.21.15.19:0/97977307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0900b64b0 msgr2=0x7fa0901f3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.995+0000 7fa09862e640 1 --2- 172.21.15.19:0/97977307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0900b64b0 0x7fa0901f3d10 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00c4b0 tx=0x7fa08c00c970 comp rx=0 tx=0).stop 2024-09-12T02:04:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.995+0000 7fa09862e640 1 -- 172.21.15.19:0/97977307 shutdown_connections 2024-09-12T02:04:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.995+0000 7fa09862e640 1 --2- 172.21.15.19:0/97977307 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa07406be30 0x7fa07406e2f0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.995+0000 7fa09862e640 1 --2- 172.21.15.19:0/97977307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa090162060 0x7fa090160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.995+0000 7fa09862e640 1 --2- 172.21.15.19:0/97977307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa090161c80 0x7fa0900b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.995+0000 7fa09862e640 1 --2- 172.21.15.19:0/97977307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0900b64b0 0x7fa0901f3d10 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.995+0000 7fa09862e640 1 -- 172.21.15.19:0/97977307 >> 172.21.15.19:0/97977307 conn(0x7fa0900d44f0 msgr2=0x7fa0900b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.995+0000 7fa09862e640 1 -- 172.21.15.19:0/97977307 shutdown_connections 2024-09-12T02:04:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:18.995+0000 7fa09862e640 1 -- 172.21.15.19:0/97977307 wait complete. 2024-09-12T02:04:19.006 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt 200.00000001' led to DAMAGED state 2024-09-12T02:04:19.006 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt 500.00000000' 2024-09-12T02:04:19.007 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:04:19.007 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:04:19.023 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:04:19.023 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:04:19.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:19.023 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:04:19.078 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:04:19.078 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:04:19.079 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:04:19.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.222+0000 7f77b1e1e640 1 Processor -- start 2024-09-12T02:04:19.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.222+0000 7f77b1e1e640 1 -- start start 2024-09-12T02:04:19.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.222+0000 7f77b1e1e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f77ac0b6690 0x7f77ac1691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:19.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.222+0000 7f77b1e1e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77ac0d3690 con 0x7f77ac15e5f0 2024-09-12T02:04:19.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.222+0000 7f77b1e1e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77ac0d3970 con 0x7f77ac0d30f0 2024-09-12T02:04:19.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.222+0000 7f77b1e1e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f77ac06d530 con 0x7f77ac0b6690 2024-09-12T02:04:19.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77ab7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f77ac15e5f0 0x7f77ac0d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49196/0 (socket says 172.21.15.19:49196) 2024-09-12T02:04:19.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77ab7fe640 1 -- 172.21.15.19:0/3668349515 learned_addr learned my addr 172.21.15.19:0/3668349515 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:19.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77aa7fc640 1 -- 172.21.15.19:0/3668349515 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 824527679 0 0) 0x7f77ac0d3690 con 0x7f77ac15e5f0 2024-09-12T02:04:19.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77aa7fc640 1 -- 172.21.15.19:0/3668349515 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7794003520 con 0x7f77ac15e5f0 2024-09-12T02:04:19.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77abfff640 1 --2- 172.21.15.19:0/3668349515 >> v2:172.21.15.135:3300/0 conn(0x7f77ac0b6690 0x7f77ac1691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:19.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77aa7fc640 1 -- 172.21.15.19:0/3668349515 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 598102120 0 0) 0x7f7794003520 con 0x7f77ac15e5f0 2024-09-12T02:04:19.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77aa7fc640 1 -- 172.21.15.19:0/3668349515 >> v2:172.21.15.135:3300/0 conn(0x7f77ac0b6690 msgr2=0x7f77ac1691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:19.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77aa7fc640 1 --2- 172.21.15.19:0/3668349515 >> v2:172.21.15.135:3300/0 conn(0x7f77ac0b6690 0x7f77ac1691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77aa7fc640 1 -- 172.21.15.19:0/3668349515 >> v1:172.21.15.135:6789/0 conn(0x7f77ac0d30f0 legacy=0x7f77ac0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:19.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77aa7fc640 1 -- 172.21.15.19:0/3668349515 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ac06cee0 con 0x7f77ac15e5f0 2024-09-12T02:04:19.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77aa7fc640 1 -- 172.21.15.19:0/3668349515 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f779c001670 con 0x7f77ac15e5f0 2024-09-12T02:04:19.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77aa7fc640 1 -- 172.21.15.19:0/3668349515 >> v1:172.21.15.19:6789/0 conn(0x7f77ac15e5f0 legacy=0x7f77ac0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:19.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77aa7fc640 1 --2- 172.21.15.19:0/3668349515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77940039e0 0x7f7794003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:19.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77aa7fc640 1 --2- 172.21.15.19:0/3668349515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7794004800 0x7f7794004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:19.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77aa7fc640 1 --2- 172.21.15.19:0/3668349515 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77940051c0 0x7f779400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:19.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77aa7fc640 1 -- 172.21.15.19:0/3668349515 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f77ac06d530 con 0x7f7794004800 2024-09-12T02:04:19.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77aa7fc640 1 -- 172.21.15.19:0/3668349515 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f779400c090 con 0x7f77940039e0 2024-09-12T02:04:19.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77aa7fc640 1 -- 172.21.15.19:0/3668349515 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f779400c290 con 0x7f77940051c0 2024-09-12T02:04:19.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77aaffd640 1 --2- 172.21.15.19:0/3668349515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7794004800 0x7f7794004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:19.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.223+0000 7f77ab7fe640 1 --2- 172.21.15.19:0/3668349515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77940039e0 0x7f7794003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:19.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.224+0000 7f77abfff640 1 --2- 172.21.15.19:0/3668349515 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77940051c0 0x7f779400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:19.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.224+0000 7f77aaffd640 1 -- 172.21.15.19:0/3668349515 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77940051c0 msgr2=0x7f779400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:19.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.224+0000 7f77aaffd640 1 --2- 172.21.15.19:0/3668349515 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77940051c0 0x7f779400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.224+0000 7f77aaffd640 1 -- 172.21.15.19:0/3668349515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77940039e0 msgr2=0x7f7794003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:19.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.224+0000 7f77aaffd640 1 --2- 172.21.15.19:0/3668349515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77940039e0 0x7f7794003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.224+0000 7f77aaffd640 1 -- 172.21.15.19:0/3668349515 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7794003520 con 0x7f7794004800 2024-09-12T02:04:19.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.224+0000 7f77abfff640 1 --2- 172.21.15.19:0/3668349515 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77940051c0 0x7f779400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:19.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.224+0000 7f77abfff640 1 -- 172.21.15.19:0/3668349515 reap_dead start 2024-09-12T02:04:19.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.224+0000 7f77aaffd640 1 --2- 172.21.15.19:0/3668349515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7794004800 0x7f7794004c80 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f77a0001750 tx=0x7f7794005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c60270e6804998 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:19.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.225+0000 7f77aa7fc640 1 -- 172.21.15.19:0/3668349515 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a0001370 con 0x7f7794004800 2024-09-12T02:04:19.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.225+0000 7f77aa7fc640 1 -- 172.21.15.19:0/3668349515 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a00052d0 con 0x7f7794004800 2024-09-12T02:04:19.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.225+0000 7f77aa7fc640 1 -- 172.21.15.19:0/3668349515 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a002abc0 con 0x7f7794004800 2024-09-12T02:04:19.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.225+0000 7f77b1e1e640 1 -- 172.21.15.19:0/3668349515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7794004800 msgr2=0x7f7794004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:19.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.225+0000 7f77b1e1e640 1 --2- 172.21.15.19:0/3668349515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7794004800 0x7f7794004c80 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f77a0001750 tx=0x7f7794005830 comp rx=0 tx=0).stop 2024-09-12T02:04:19.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.225+0000 7f77b1e1e640 1 -- 172.21.15.19:0/3668349515 shutdown_connections 2024-09-12T02:04:19.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.225+0000 7f77b1e1e640 1 --2- 172.21.15.19:0/3668349515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7794004800 0x7f7794004c80 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.225+0000 7f77b1e1e640 1 -- 172.21.15.19:0/3668349515 >> 172.21.15.19:0/3668349515 conn(0x7f77ac08bfc0 msgr2=0x7f77ac0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:19.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.225+0000 7f77b1e1e640 1 -- 172.21.15.19:0/3668349515 shutdown_connections 2024-09-12T02:04:19.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.225+0000 7f77b1e1e640 1 -- 172.21.15.19:0/3668349515 wait complete. 2024-09-12T02:04:19.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.226+0000 7f77b1e1e640 1 Processor -- start 2024-09-12T02:04:19.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.227+0000 7f77b1e1e640 1 -- start start 2024-09-12T02:04:19.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.227+0000 7f77b1e1e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7794004800 0x7f77ac0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:19.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.227+0000 7f77b1e1e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77ac0cbfe0 0x7f77ac0cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:19.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.227+0000 7f77b1e1e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77ac155ad0 0x7f77ac15a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:19.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.227+0000 7f77b1e1e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f77ac0b5f80 con 0x7f7794004800 2024-09-12T02:04:19.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.227+0000 7f77b1e1e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f77ac15e9d0 con 0x7f77ac0cbfe0 2024-09-12T02:04:19.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.227+0000 7f77b1e1e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f77ac0b6100 con 0x7f77ac155ad0 2024-09-12T02:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.227+0000 7f77ab7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7794004800 0x7f77ac0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.227+0000 7f77ab7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7794004800 0x7f77ac0ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57840/0 (socket says 172.21.15.19:57840) 2024-09-12T02:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.227+0000 7f77ab7fe640 1 -- 172.21.15.19:0/2015956529 learned_addr learned my addr 172.21.15.19:0/2015956529 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.227+0000 7f77abfff640 1 --2- 172.21.15.19:0/2015956529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77ac155ad0 0x7f77ac15a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.227+0000 7f77aaffd640 1 --2- 172.21.15.19:0/2015956529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77ac0cbfe0 0x7f77ac0cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.228+0000 7f77ab7fe640 1 -- 172.21.15.19:0/2015956529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77ac155ad0 msgr2=0x7f77ac15a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.228+0000 7f77ab7fe640 1 --2- 172.21.15.19:0/2015956529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77ac155ad0 0x7f77ac15a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.228+0000 7f77ab7fe640 1 -- 172.21.15.19:0/2015956529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77ac0cbfe0 msgr2=0x7f77ac0cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.228+0000 7f77ab7fe640 1 --2- 172.21.15.19:0/2015956529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77ac0cbfe0 0x7f77ac0cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.228+0000 7f77ab7fe640 1 -- 172.21.15.19:0/2015956529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ac0cc5a0 con 0x7f7794004800 2024-09-12T02:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.228+0000 7f77ab7fe640 1 --2- 172.21.15.19:0/2015956529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7794004800 0x7f77ac0ca6b0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f779c0072f0 tx=0x7f779c0077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.228+0000 7f7793fff640 1 -- 172.21.15.19:0/2015956529 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c001660 con 0x7f7794004800 2024-09-12T02:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.228+0000 7f7793fff640 1 -- 172.21.15.19:0/2015956529 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f779c018070 con 0x7f7794004800 2024-09-12T02:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.228+0000 7f77b1e1e640 1 -- 172.21.15.19:0/2015956529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77ac0c9bd0 con 0x7f7794004800 2024-09-12T02:04:19.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.228+0000 7f7793fff640 1 -- 172.21.15.19:0/2015956529 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c00fb80 con 0x7f7794004800 2024-09-12T02:04:19.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.228+0000 7f77b1e1e640 1 -- 172.21.15.19:0/2015956529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77ac155f50 con 0x7f7794004800 2024-09-12T02:04:19.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.229+0000 7f77b1e1e640 1 -- 172.21.15.19:0/2015956529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77ac0d4dd0 con 0x7f7794004800 2024-09-12T02:04:19.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.230+0000 7f7793fff640 1 -- 172.21.15.19:0/2015956529 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f779c00fd20 con 0x7f7794004800 2024-09-12T02:04:19.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.230+0000 7f7793fff640 1 --2- 172.21.15.19:0/2015956529 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f779806c000 0x7f779806e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:19.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.230+0000 7f7793fff640 1 -- 172.21.15.19:0/2015956529 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7f779c08b530 con 0x7f7794004800 2024-09-12T02:04:19.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.230+0000 7f77aaffd640 1 --2- 172.21.15.19:0/2015956529 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f779806c000 0x7f779806e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:19.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.231+0000 7f77aaffd640 1 --2- 172.21.15.19:0/2015956529 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f779806c000 0x7f779806e4c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f77a0032000 tx=0x7f77a002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:19.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.234+0000 7f7793fff640 1 -- 172.21.15.19:0/2015956529 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f779c059080 con 0x7f7794004800 2024-09-12T02:04:19.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.449+0000 7f77b1e1e640 1 -- 172.21.15.19:0/2015956529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f77ac0ca290 con 0x7f7794004800 2024-09-12T02:04:19.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.983+0000 7f7793fff640 1 -- 172.21.15.19:0/2015956529 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v184) ==== 161+0+0 (secure 0 0 0) 0x7f779c05d380 con 0x7f7794004800 2024-09-12T02:04:19.983 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:04:19.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.985+0000 7f77b1e1e640 1 -- 172.21.15.19:0/2015956529 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f779806c000 msgr2=0x7f779806e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:19.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.985+0000 7f77b1e1e640 1 --2- 172.21.15.19:0/2015956529 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f779806c000 0x7f779806e4c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f77a0032000 tx=0x7f77a002e000 comp rx=0 tx=0).stop 2024-09-12T02:04:19.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.985+0000 7f77b1e1e640 1 -- 172.21.15.19:0/2015956529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7794004800 msgr2=0x7f77ac0ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:19.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.985+0000 7f77b1e1e640 1 --2- 172.21.15.19:0/2015956529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7794004800 0x7f77ac0ca6b0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f779c0072f0 tx=0x7f779c0077b0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.985+0000 7f77b1e1e640 1 -- 172.21.15.19:0/2015956529 shutdown_connections 2024-09-12T02:04:19.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.985+0000 7f77b1e1e640 1 --2- 172.21.15.19:0/2015956529 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f779806c000 0x7f779806e4c0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.985+0000 7f77b1e1e640 1 --2- 172.21.15.19:0/2015956529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77ac155ad0 0x7f77ac15a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.985+0000 7f77b1e1e640 1 --2- 172.21.15.19:0/2015956529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77ac0cbfe0 0x7f77ac0cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.985+0000 7f77b1e1e640 1 --2- 172.21.15.19:0/2015956529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7794004800 0x7f77ac0ca6b0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.985+0000 7f77b1e1e640 1 -- 172.21.15.19:0/2015956529 >> 172.21.15.19:0/2015956529 conn(0x7f77ac08bfc0 msgr2=0x7f77ac0cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:19.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.985+0000 7f77b1e1e640 1 -- 172.21.15.19:0/2015956529 shutdown_connections 2024-09-12T02:04:19.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:19.985+0000 7f77b1e1e640 1 -- 172.21.15.19:0/2015956529 wait complete. 2024-09-12T02:04:19.998 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:04:20.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.105+0000 7f488de96640 1 Processor -- start 2024-09-12T02:04:20.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.105+0000 7f488de96640 1 -- start start 2024-09-12T02:04:20.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.106+0000 7f488de96640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4888161c80 0x7f488806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:20.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.106+0000 7f488de96640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4888162060 0x7f48880b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:20.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.106+0000 7f488de96640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f488806e870 con 0x7f48880b64b0 2024-09-12T02:04:20.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.106+0000 7f488de96640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f488806d9f0 con 0x7f4888162060 2024-09-12T02:04:20.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.106+0000 7f488de96640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f488806dcd0 con 0x7f4888161c80 2024-09-12T02:04:20.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.106+0000 7f4887fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f48880b64b0 0x7f4888162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49208/0 (socket says 172.21.15.19:49208) 2024-09-12T02:04:20.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.106+0000 7f4887fff640 1 -- 172.21.15.19:0/3060833103 learned_addr learned my addr 172.21.15.19:0/3060833103 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:20.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f48877fe640 1 --2- 172.21.15.19:0/3060833103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4888161c80 0x7f488806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:20.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f487effd640 1 --2- 172.21.15.19:0/3060833103 >> v2:172.21.15.135:3300/0 conn(0x7f4888162060 0x7f48880b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:20.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f4886ffd640 1 -- 172.21.15.19:0/3060833103 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3770329763 0 0) 0x7f4880001490 con 0x7f48880b64b0 2024-09-12T02:04:20.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f4886ffd640 1 -- 172.21.15.19:0/3060833103 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4874003520 con 0x7f48880b64b0 2024-09-12T02:04:20.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f4886ffd640 1 -- 172.21.15.19:0/3060833103 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3991162229 0 0) 0x7f4874003520 con 0x7f48880b64b0 2024-09-12T02:04:20.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f4886ffd640 1 -- 172.21.15.19:0/3060833103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4888161c80 msgr2=0x7f488806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:20.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f4886ffd640 1 --2- 172.21.15.19:0/3060833103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4888161c80 0x7f488806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:20.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f4886ffd640 1 -- 172.21.15.19:0/3060833103 >> v2:172.21.15.135:3300/0 conn(0x7f4888162060 msgr2=0x7f48880b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:20.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f4886ffd640 1 --2- 172.21.15.19:0/3060833103 >> v2:172.21.15.135:3300/0 conn(0x7f4888162060 0x7f48880b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:20.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f4886ffd640 1 -- 172.21.15.19:0/3060833103 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488806dfb0 con 0x7f48880b64b0 2024-09-12T02:04:20.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f487effd640 1 --2- 172.21.15.19:0/3060833103 >> v2:172.21.15.135:3300/0 conn(0x7f4888162060 0x7f48880b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f4886ffd640 1 -- 172.21.15.19:0/3060833103 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f4880001bc0 con 0x7f48880b64b0 2024-09-12T02:04:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f4886ffd640 1 -- 172.21.15.19:0/3060833103 >> v1:172.21.15.19:6789/0 conn(0x7f48880b64b0 legacy=0x7f4888162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f4886ffd640 1 --2- 172.21.15.19:0/3060833103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48740039b0 0x7f4874003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f4886ffd640 1 --2- 172.21.15.19:0/3060833103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4888161c80 0x7f4874004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f4886ffd640 1 --2- 172.21.15.19:0/3060833103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4874004d40 0x7f48740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f4886ffd640 1 -- 172.21.15.19:0/3060833103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f488806d9f0 con 0x7f48740039b0 2024-09-12T02:04:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f4886ffd640 1 -- 172.21.15.19:0/3060833103 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f488806dcd0 con 0x7f4874004d40 2024-09-12T02:04:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f4886ffd640 1 -- 172.21.15.19:0/3060833103 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f487400b9c0 con 0x7f4888161c80 2024-09-12T02:04:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f48877fe640 1 --2- 172.21.15.19:0/3060833103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48740039b0 0x7f4874003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f4887fff640 1 --2- 172.21.15.19:0/3060833103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4874004d40 0x7f48740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f487effd640 1 --2- 172.21.15.19:0/3060833103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4888161c80 0x7f4874004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f48877fe640 1 -- 172.21.15.19:0/3060833103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4888161c80 msgr2=0x7f4874004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f48877fe640 1 --2- 172.21.15.19:0/3060833103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4888161c80 0x7f4874004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f48877fe640 1 -- 172.21.15.19:0/3060833103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4874004d40 msgr2=0x7f48740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f48877fe640 1 --2- 172.21.15.19:0/3060833103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4874004d40 0x7f48740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f48877fe640 1 -- 172.21.15.19:0/3060833103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4874003520 con 0x7f48740039b0 2024-09-12T02:04:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.107+0000 7f487effd640 1 --2- 172.21.15.19:0/3060833103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4888161c80 0x7f4874004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.108+0000 7f48877fe640 1 --2- 172.21.15.19:0/3060833103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48740039b0 0x7f4874003dd0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f4878009ac0 tx=0x7f4874005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f38da64fe493c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.108+0000 7f4886ffd640 1 -- 172.21.15.19:0/3060833103 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4878036070 con 0x7f48740039b0 2024-09-12T02:04:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.108+0000 7f4886ffd640 1 -- 172.21.15.19:0/3060833103 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4878031400 con 0x7f48740039b0 2024-09-12T02:04:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.108+0000 7f4886ffd640 1 -- 172.21.15.19:0/3060833103 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4878009690 con 0x7f48740039b0 2024-09-12T02:04:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.109+0000 7f488de96640 1 -- 172.21.15.19:0/3060833103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48740039b0 msgr2=0x7f4874003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.109+0000 7f488de96640 1 --2- 172.21.15.19:0/3060833103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48740039b0 0x7f4874003dd0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f4878009ac0 tx=0x7f4874005830 comp rx=0 tx=0).stop 2024-09-12T02:04:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.109+0000 7f4887fff640 1 -- 172.21.15.19:0/3060833103 reap_dead start 2024-09-12T02:04:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.109+0000 7f488de96640 1 -- 172.21.15.19:0/3060833103 shutdown_connections 2024-09-12T02:04:20.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.109+0000 7f488de96640 1 -- 172.21.15.19:0/3060833103 >> 172.21.15.19:0/3060833103 conn(0x7f48880d44f0 msgr2=0x7f48880d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:20.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.109+0000 7f488de96640 1 -- 172.21.15.19:0/3060833103 shutdown_connections 2024-09-12T02:04:20.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.109+0000 7f488de96640 1 -- 172.21.15.19:0/3060833103 wait complete. 2024-09-12T02:04:20.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.110+0000 7f488de96640 1 Processor -- start 2024-09-12T02:04:20.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.110+0000 7f488de96640 1 -- start start 2024-09-12T02:04:20.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.111+0000 7f488de96640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48740039b0 0x7f4888159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:20.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.111+0000 7f488de96640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48880b2220 0x7f48880b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:20.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.111+0000 7f488de96640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48880cc2e0 0x7f48880cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:20.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.111+0000 7f488de96640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f48880d2a10 con 0x7f48740039b0 2024-09-12T02:04:20.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.111+0000 7f488de96640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f48880d2890 con 0x7f48880b2220 2024-09-12T02:04:20.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.111+0000 7f488de96640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f488806e330 con 0x7f48880cc2e0 2024-09-12T02:04:20.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.111+0000 7f48877fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48740039b0 0x7f4888159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:20.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.111+0000 7f48877fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48740039b0 0x7f4888159a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57870/0 (socket says 172.21.15.19:57870) 2024-09-12T02:04:20.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.111+0000 7f48877fe640 1 -- 172.21.15.19:0/4008763332 learned_addr learned my addr 172.21.15.19:0/4008763332 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:20.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.111+0000 7f487effd640 1 --2- 172.21.15.19:0/4008763332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48880b2220 0x7f48880b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:20.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.111+0000 7f4887fff640 1 --2- 172.21.15.19:0/4008763332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48880cc2e0 0x7f48880cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:20.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.112+0000 7f48877fe640 1 -- 172.21.15.19:0/4008763332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48880cc2e0 msgr2=0x7f48880cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:20.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.112+0000 7f48877fe640 1 --2- 172.21.15.19:0/4008763332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48880cc2e0 0x7f48880cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:20.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.112+0000 7f48877fe640 1 -- 172.21.15.19:0/4008763332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48880b2220 msgr2=0x7f48880b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:20.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.112+0000 7f48877fe640 1 --2- 172.21.15.19:0/4008763332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48880b2220 0x7f48880b26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:20.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.112+0000 7f48877fe640 1 -- 172.21.15.19:0/4008763332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48880b9270 con 0x7f48740039b0 2024-09-12T02:04:20.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.112+0000 7f48877fe640 1 --2- 172.21.15.19:0/4008763332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48740039b0 0x7f4888159a50 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f4878009ac0 tx=0x7f4878004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:20.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.112+0000 7f4884ff9640 1 -- 172.21.15.19:0/4008763332 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4878040020 con 0x7f48740039b0 2024-09-12T02:04:20.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.112+0000 7f4884ff9640 1 -- 172.21.15.19:0/4008763332 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4878003bc0 con 0x7f48740039b0 2024-09-12T02:04:20.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.112+0000 7f488de96640 1 -- 172.21.15.19:0/4008763332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48880b9550 con 0x7f48740039b0 2024-09-12T02:04:20.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.112+0000 7f4884ff9640 1 -- 172.21.15.19:0/4008763332 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4878036040 con 0x7f48740039b0 2024-09-12T02:04:20.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.112+0000 7f488de96640 1 -- 172.21.15.19:0/4008763332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48880b9b10 con 0x7f48740039b0 2024-09-12T02:04:20.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.113+0000 7f488de96640 1 -- 172.21.15.19:0/4008763332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4888162ca0 con 0x7f48740039b0 2024-09-12T02:04:20.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.114+0000 7f4884ff9640 1 -- 172.21.15.19:0/4008763332 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4878043020 con 0x7f48740039b0 2024-09-12T02:04:20.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.114+0000 7f4884ff9640 1 --2- 172.21.15.19:0/4008763332 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f486806be60 0x7f486806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:20.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.114+0000 7f4884ff9640 1 -- 172.21.15.19:0/4008763332 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7f48780ab6a0 con 0x7f48740039b0 2024-09-12T02:04:20.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.114+0000 7f487effd640 1 --2- 172.21.15.19:0/4008763332 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f486806be60 0x7f486806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:20.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.115+0000 7f487effd640 1 --2- 172.21.15.19:0/4008763332 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f486806be60 0x7f486806e320 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f48880b2f20 tx=0x7f4870008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:20.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.118+0000 7f4884ff9640 1 -- 172.21.15.19:0/4008763332 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f487804a070 con 0x7f48740039b0 2024-09-12T02:04:20.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.367+0000 7f488de96640 1 -- 172.21.15.19:0/4008763332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f48881629c0 con 0x7f48740039b0 2024-09-12T02:04:20.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.987+0000 7f4884ff9640 1 -- 172.21.15.19:0/4008763332 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v185) ==== 101+0+0 (secure 0 0 0) 0x7f48780044e0 con 0x7f48740039b0 2024-09-12T02:04:20.988 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:04:20.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.989+0000 7f488de96640 1 -- 172.21.15.19:0/4008763332 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f486806be60 msgr2=0x7f486806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:20.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.989+0000 7f488de96640 1 --2- 172.21.15.19:0/4008763332 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f486806be60 0x7f486806e320 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f48880b2f20 tx=0x7f4870008040 comp rx=0 tx=0).stop 2024-09-12T02:04:20.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.989+0000 7f488de96640 1 -- 172.21.15.19:0/4008763332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48740039b0 msgr2=0x7f4888159a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:20.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.989+0000 7f488de96640 1 --2- 172.21.15.19:0/4008763332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48740039b0 0x7f4888159a50 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f4878009ac0 tx=0x7f4878004730 comp rx=0 tx=0).stop 2024-09-12T02:04:20.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.989+0000 7f488de96640 1 -- 172.21.15.19:0/4008763332 shutdown_connections 2024-09-12T02:04:20.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.989+0000 7f488de96640 1 --2- 172.21.15.19:0/4008763332 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f486806be60 0x7f486806e320 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:20.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.989+0000 7f488de96640 1 --2- 172.21.15.19:0/4008763332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48880cc2e0 0x7f48880cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:20.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.989+0000 7f488de96640 1 --2- 172.21.15.19:0/4008763332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48880b2220 0x7f48880b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:20.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.989+0000 7f488de96640 1 --2- 172.21.15.19:0/4008763332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48740039b0 0x7f4888159a50 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:20.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.990+0000 7f488de96640 1 -- 172.21.15.19:0/4008763332 >> 172.21.15.19:0/4008763332 conn(0x7f48880d44f0 msgr2=0x7f48880d3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:20.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.990+0000 7f488de96640 1 -- 172.21.15.19:0/4008763332 shutdown_connections 2024-09-12T02:04:20.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:20.990+0000 7f488de96640 1 -- 172.21.15.19:0/4008763332 wait complete. 2024-09-12T02:04:21.003 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:04:21.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.048+0000 7f13c3987f40 1 Processor -- start 2024-09-12T02:04:21.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.048+0000 7f13c3987f40 1 -- start start 2024-09-12T02:04:21.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.048+0000 7f13c3987f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d7b7329e0 0x559d7b778ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.048+0000 7f13c3987f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d7b77bff0 0x559d7b7625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.048+0000 7f13c3987f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d7b809fb0 0x559d7b807590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.048+0000 7f13c3987f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559d7b684510 con 0x559d7b77bff0 2024-09-12T02:04:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.048+0000 7f13c3987f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559d7b6ddc50 con 0x559d7b7329e0 2024-09-12T02:04:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.048+0000 7f13c3987f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x559d7b7331c0 con 0x559d7b809fb0 2024-09-12T02:04:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.048+0000 7f13c0c7c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d7b77bff0 0x559d7b7625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.048+0000 7f13c0c7c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d7b77bff0 0x559d7b7625d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58352/0 (socket says 172.21.15.19:58352) 2024-09-12T02:04:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.048+0000 7f13c0c7c640 1 -- 172.21.15.19:0/10151868 learned_addr learned my addr 172.21.15.19:0/10151868 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.049+0000 7f13c147d640 1 --2- 172.21.15.19:0/10151868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d7b7329e0 0x559d7b778ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.049+0000 7f13c1c7e640 1 --2- 172.21.15.19:0/10151868 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d7b809fb0 0x559d7b807590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.049+0000 7f13c0c7c640 1 -- 172.21.15.19:0/10151868 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d7b809fb0 msgr2=0x559d7b807590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.049+0000 7f13c0c7c640 1 --2- 172.21.15.19:0/10151868 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d7b809fb0 0x559d7b807590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.049+0000 7f13c0c7c640 1 -- 172.21.15.19:0/10151868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d7b7329e0 msgr2=0x559d7b778ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.049+0000 7f13c0c7c640 1 --2- 172.21.15.19:0/10151868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d7b7329e0 0x559d7b778ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.049+0000 7f13c0c7c640 1 -- 172.21.15.19:0/10151868 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d7b77d880 con 0x559d7b77bff0 2024-09-12T02:04:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.049+0000 7f13c0c7c640 1 --2- 172.21.15.19:0/10151868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d7b77bff0 0x559d7b7625d0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f13b800b240 tx=0x7f13b800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e93e29f43b8eab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.049+0000 7f13b37fe640 1 -- 172.21.15.19:0/10151868 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8008070 con 0x559d7b77bff0 2024-09-12T02:04:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.049+0000 7f13b37fe640 1 -- 172.21.15.19:0/10151868 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b800d500 con 0x559d7b77bff0 2024-09-12T02:04:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.049+0000 7f13b37fe640 1 -- 172.21.15.19:0/10151868 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b800d8f0 con 0x559d7b77bff0 2024-09-12T02:04:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.050+0000 7f13c3987f40 1 -- 172.21.15.19:0/10151868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d7b77bff0 msgr2=0x559d7b7625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.050+0000 7f13c3987f40 1 --2- 172.21.15.19:0/10151868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d7b77bff0 0x559d7b7625d0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f13b800b240 tx=0x7f13b800b700 comp rx=0 tx=0).stop 2024-09-12T02:04:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.050+0000 7f13c3987f40 1 -- 172.21.15.19:0/10151868 shutdown_connections 2024-09-12T02:04:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.050+0000 7f13c3987f40 1 --2- 172.21.15.19:0/10151868 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d7b809fb0 0x559d7b807590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.050+0000 7f13c3987f40 1 --2- 172.21.15.19:0/10151868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d7b77bff0 0x559d7b7625d0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.050+0000 7f13c3987f40 1 --2- 172.21.15.19:0/10151868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d7b7329e0 0x559d7b778ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.050+0000 7f13c3987f40 1 -- 172.21.15.19:0/10151868 >> 172.21.15.19:0/10151868 conn(0x559d7b760490 msgr2=0x559d7b807fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.050+0000 7f13c3987f40 1 -- 172.21.15.19:0/10151868 shutdown_connections 2024-09-12T02:04:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.050+0000 7f13c3987f40 1 -- 172.21.15.19:0/10151868 wait complete. 2024-09-12T02:04:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.050+0000 7f13c3987f40 1 Processor -- start 2024-09-12T02:04:21.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.050+0000 7f13c3987f40 1 -- start start 2024-09-12T02:04:21.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.051+0000 7f13c3987f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d7b7329e0 0x559d7b7f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.051+0000 7f13c3987f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d7b77bff0 0x559d7b7f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.051+0000 7f13c3987f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d7b809fb0 0x559d7b80c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.051+0000 7f13c3987f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559d7b760040 con 0x559d7b809fb0 2024-09-12T02:04:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.051+0000 7f13c3987f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559d7b8008c0 con 0x559d7b77bff0 2024-09-12T02:04:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.051+0000 7f13c3987f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x559d7b779430 con 0x559d7b7329e0 2024-09-12T02:04:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.051+0000 7f13c1c7e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d7b809fb0 0x559d7b80c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.051+0000 7f13c147d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d7b7329e0 0x559d7b7f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.051+0000 7f13c1c7e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d7b809fb0 0x559d7b80c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58366/0 (socket says 172.21.15.19:58366) 2024-09-12T02:04:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.051+0000 7f13c0c7c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d7b77bff0 0x559d7b7f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.051+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 learned_addr learned my addr 172.21.15.19:0/1482995403 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.052+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d7b7329e0 msgr2=0x559d7b7f5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.052+0000 7f13c1c7e640 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d7b7329e0 0x559d7b7f5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.052+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d7b77bff0 msgr2=0x559d7b7f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.052+0000 7f13c1c7e640 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d7b77bff0 0x559d7b7f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.052+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d7b7fbb70 con 0x559d7b809fb0 2024-09-12T02:04:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.052+0000 7f13c1c7e640 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d7b809fb0 0x559d7b80c040 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f13bc025b20 tx=0x7f13bc003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.052+0000 7f13b27fc640 1 -- 172.21.15.19:0/1482995403 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc066020 con 0x559d7b809fb0 2024-09-12T02:04:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.052+0000 7f13b27fc640 1 -- 172.21.15.19:0/1482995403 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13bc05c040 con 0x559d7b809fb0 2024-09-12T02:04:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.052+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d7b808680 con 0x559d7b809fb0 2024-09-12T02:04:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.052+0000 7f13b27fc640 1 -- 172.21.15.19:0/1482995403 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc062400 con 0x559d7b809fb0 2024-09-12T02:04:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.052+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d7b7344c0 con 0x559d7b809fb0 2024-09-12T02:04:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.054+0000 7f13b27fc640 1 -- 172.21.15.19:0/1482995403 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f13bc069020 con 0x559d7b809fb0 2024-09-12T02:04:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.054+0000 7f13b27fc640 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f13a406a810 0x7f13a406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.054+0000 7f13b27fc640 1 -- 172.21.15.19:0/1482995403 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7f13bc0ce820 con 0x559d7b809fb0 2024-09-12T02:04:21.056 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:04:21.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.054+0000 7f13c147d640 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f13a406a810 0x7f13a406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.054+0000 7f13c3987f40 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x559d7b80b8b0 0x559d7b80c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.054+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b80cac0 con 0x559d7b80b8b0 2024-09-12T02:04:21.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.055+0000 7f13c0c7c640 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x559d7b80b8b0 0x559d7b80c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.055+0000 7f13c147d640 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f13a406a810 0x7f13a406ccd0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f13b4003f10 tx=0x7f13b4003890 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.055+0000 7f13c0c7c640 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x559d7b80b8b0 0x559d7b80c580 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.056+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v112'536 uv510 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.056+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b80ce90 con 0x559d7b80b8b0 2024-09-12T02:04:21.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.057+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v112'537 uv537 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.057+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8acd40 con 0x559d7b80b8b0 2024-09-12T02:04:21.059 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:04:21.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.058+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v112'538 uv538 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.059+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ae0f0 con 0x559d7b80b8b0 2024-09-12T02:04:21.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.059+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v112'539 uv539 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.060+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ae490 con 0x559d7b80b8b0 2024-09-12T02:04:21.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.060+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v112'540 uv540 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.060+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ad0e0 con 0x559d7b80b8b0 2024-09-12T02:04:21.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.061+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v112'541 uv541 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.062+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ad480 con 0x559d7b80b8b0 2024-09-12T02:04:21.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.063+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v112'542 uv516 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.063+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ad850 con 0x559d7b80b8b0 2024-09-12T02:04:21.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.064+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v112'543 uv543 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.064+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ad850 con 0x559d7b80b8b0 2024-09-12T02:04:21.065 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:04:21.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.065+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v112'544 uv544 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.065+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ad820 con 0x559d7b80b8b0 2024-09-12T02:04:21.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.066+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v112'545 uv545 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.066+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ad820 con 0x559d7b80b8b0 2024-09-12T02:04:21.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.067+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v112'546 uv546 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.067+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ad820 con 0x559d7b80b8b0 2024-09-12T02:04:21.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.068+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v112'547 uv547 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.068+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ad820 con 0x559d7b80b8b0 2024-09-12T02:04:21.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.069+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v112'548 uv523 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.069+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ad820 con 0x559d7b80b8b0 2024-09-12T02:04:21.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.070+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v112'549 uv549 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.070+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ad820 con 0x559d7b80b8b0 2024-09-12T02:04:21.071 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:04:21.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.071+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v112'550 uv550 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.071+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ad820 con 0x559d7b80b8b0 2024-09-12T02:04:21.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.072+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v112'551 uv551 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.072+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ad820 con 0x559d7b80b8b0 2024-09-12T02:04:21.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.073+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v112'552 uv552 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.073+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ad820 con 0x559d7b80b8b0 2024-09-12T02:04:21.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.074+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v112'553 uv553 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.074+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ae830 con 0x559d7b80b8b0 2024-09-12T02:04:21.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.075+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v112'554 uv554 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.075+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ae830 con 0x559d7b80b8b0 2024-09-12T02:04:21.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.076+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v112'555 uv529 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.076+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ae830 con 0x559d7b80b8b0 2024-09-12T02:04:21.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.078+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v112'556 uv556 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.078+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ae830 con 0x559d7b80b8b0 2024-09-12T02:04:21.079 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:04:21.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.079+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v112'557 uv557 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.079+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8af840 con 0x559d7b80b8b0 2024-09-12T02:04:21.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.080+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v112'558 uv558 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.080+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8af840 con 0x559d7b80b8b0 2024-09-12T02:04:21.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.081+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v112'559 uv559 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.081+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ae830 con 0x559d7b80b8b0 2024-09-12T02:04:21.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.081+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v112'560 uv560 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.081+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ae830 con 0x559d7b80b8b0 2024-09-12T02:04:21.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.082+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v112'561 uv535 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.082+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ae830 con 0x559d7b80b8b0 2024-09-12T02:04:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.083+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v112'562 uv562 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.083+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ae830 con 0x559d7b80b8b0 2024-09-12T02:04:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.084+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v112'563 uv563 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.085 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:04:21.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.084+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8af840 con 0x559d7b80b8b0 2024-09-12T02:04:21.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.085+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v112'564 uv564 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.085+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8af840 con 0x559d7b80b8b0 2024-09-12T02:04:21.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.086+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v112'565 uv565 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.086+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ae830 con 0x559d7b80b8b0 2024-09-12T02:04:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.087+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v112'566 uv566 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b80b8b0 2024-09-12T02:04:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.087+0000 7f13c3987f40 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559d7b8aed40 0x559d7b8b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.087+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b1670 con 0x559d7b8aed40 2024-09-12T02:04:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.088+0000 7f13c147d640 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559d7b8aed40 0x559d7b8b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.088+0000 7f13c147d640 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559d7b8aed40 0x559d7b8b1130 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.090+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v112'397 uv379 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.090+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b1a10 con 0x559d7b8aed40 2024-09-12T02:04:21.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.091+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v112'398 uv398 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.091+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b1db0 con 0x559d7b8aed40 2024-09-12T02:04:21.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.092+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v112'399 uv399 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.093 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:04:21.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.092+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b2600 con 0x559d7b8aed40 2024-09-12T02:04:21.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.094+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v112'400 uv400 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.094+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b29a0 con 0x559d7b8aed40 2024-09-12T02:04:21.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.095+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v112'401 uv401 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.095+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b2d40 con 0x559d7b8aed40 2024-09-12T02:04:21.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.096+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v112'402 uv384 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.096+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b30e0 con 0x559d7b8aed40 2024-09-12T02:04:21.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.097+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v112'403 uv403 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.097+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b3480 con 0x559d7b8aed40 2024-09-12T02:04:21.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.099+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v112'404 uv404 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.099 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:04:21.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.099+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b3480 con 0x559d7b8aed40 2024-09-12T02:04:21.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.100+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v112'405 uv405 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.100+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b3480 con 0x559d7b8aed40 2024-09-12T02:04:21.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.101+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v112'406 uv406 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.101+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b3480 con 0x559d7b8aed40 2024-09-12T02:04:21.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.102+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v112'407 uv396 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.102+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b3480 con 0x559d7b8aed40 2024-09-12T02:04:21.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.104+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v112'408 uv408 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.104+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b3480 con 0x559d7b8aed40 2024-09-12T02:04:21.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.105+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v112'409 uv409 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.105 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:04:21.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.105+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b7900 con 0x559d7b8aed40 2024-09-12T02:04:21.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.106+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v112'410 uv410 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.106+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b7900 con 0x559d7b8aed40 2024-09-12T02:04:21.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.107+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v112'411 uv411 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.107+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b3480 con 0x559d7b8aed40 2024-09-12T02:04:21.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.108+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v112'412 uv395 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.108+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b3480 con 0x559d7b8aed40 2024-09-12T02:04:21.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.109+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v112'413 uv413 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.109+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b3480 con 0x559d7b8aed40 2024-09-12T02:04:21.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.111+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v112'414 uv414 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.111 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:04:21.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.111+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b4490 con 0x559d7b8aed40 2024-09-12T02:04:21.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.112+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v112'415 uv415 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.112+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b4490 con 0x559d7b8aed40 2024-09-12T02:04:21.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.113+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v112'416 uv416 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.113+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b3480 con 0x559d7b8aed40 2024-09-12T02:04:21.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.114+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v112'417 uv417 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8aed40 2024-09-12T02:04:21.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.114+0000 7f13c3987f40 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x559d7b8b3990 0x559d7b8b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.114+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b62c0 con 0x559d7b8b3990 2024-09-12T02:04:21.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.114+0000 7f13c0c7c640 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x559d7b8b3990 0x559d7b8b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.115+0000 7f13c0c7c640 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x559d7b8b3990 0x559d7b8b5d80 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.116+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v112'105 uv104 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b8b3990 2024-09-12T02:04:21.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.116+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b6300 con 0x559d7b8b3990 2024-09-12T02:04:21.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.117+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v112'106 uv106 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b8b3990 2024-09-12T02:04:21.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.117+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b6720 con 0x559d7b8b3990 2024-09-12T02:04:21.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.118+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v112'107 uv107 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b8b3990 2024-09-12T02:04:21.118 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:04:21.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.118+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b7730 con 0x559d7b8b3990 2024-09-12T02:04:21.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.120+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v112'108 uv108 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b8b3990 2024-09-12T02:04:21.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.120+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b7730 con 0x559d7b8b3990 2024-09-12T02:04:21.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.121+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v112'109 uv109 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b8b3990 2024-09-12T02:04:21.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.121+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b6720 con 0x559d7b8b3990 2024-09-12T02:04:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.122+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v112'110 uv110 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b800d830 con 0x559d7b8b3990 2024-09-12T02:04:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.122+0000 7f13c3987f40 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x559d7b8b6da0 0x559d7b8b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.122+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b9880 con 0x559d7b8b6da0 2024-09-12T02:04:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.122+0000 7f13c1c7e640 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x559d7b8b6da0 0x559d7b8b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.122+0000 7f13c1c7e640 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x559d7b8b6da0 0x559d7b8b91b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.124+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v112'80 uv79 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.124+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8b9d90 con 0x559d7b8b6da0 2024-09-12T02:04:21.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.125+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v112'81 uv81 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.125+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ba250 con 0x559d7b8b6da0 2024-09-12T02:04:21.126 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:04:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.126+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v112'82 uv82 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.126+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bab40 con 0x559d7b8b6da0 2024-09-12T02:04:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.127+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v112'83 uv83 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.127+0000 7f13c3987f40 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559d7b8bb3f0 0x559d7b8bd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.127+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bdd20 con 0x559d7b8bb3f0 2024-09-12T02:04:21.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.127+0000 7f13c147d640 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559d7b8bb3f0 0x559d7b8bd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.128+0000 7f13c147d640 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559d7b8bb3f0 0x559d7b8bd7e0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.129+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v112'105 uv104 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.129+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bdde0 con 0x559d7b8bb3f0 2024-09-12T02:04:21.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.130+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v112'106 uv106 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.130+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8be200 con 0x559d7b8bb3f0 2024-09-12T02:04:21.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.131+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v112'107 uv107 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.132 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:04:21.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.131+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bf210 con 0x559d7b8bb3f0 2024-09-12T02:04:21.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.133+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v112'108 uv108 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.133+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bf210 con 0x559d7b8bb3f0 2024-09-12T02:04:21.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.134+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v112'109 uv109 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.134+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8be200 con 0x559d7b8bb3f0 2024-09-12T02:04:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.135+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v112'110 uv110 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.135+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8be200 con 0x559d7b8b6da0 2024-09-12T02:04:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.136+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v112'193 uv187 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.136+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8be5a0 con 0x559d7b8b6da0 2024-09-12T02:04:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.137+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v112'194 uv194 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.137+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8be940 con 0x559d7b8b6da0 2024-09-12T02:04:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.138+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v112'195 uv195 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.139 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:04:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.138+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bfcf0 con 0x559d7b8b6da0 2024-09-12T02:04:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.139+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v112'196 uv196 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.139+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bfcf0 con 0x559d7b8b6da0 2024-09-12T02:04:21.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.141+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v112'197 uv197 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.141+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8b6da0 2024-09-12T02:04:21.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.142+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v112'198 uv198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.142+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8b6da0 2024-09-12T02:04:21.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.143+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v112'199 uv192 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.143+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8b6da0 2024-09-12T02:04:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.144+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v112'200 uv200 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.144+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8b6da0 2024-09-12T02:04:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.145+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v112'201 uv201 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.145 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:04:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.145+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8b6da0 2024-09-12T02:04:21.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.146+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v112'202 uv202 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.146+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8b6da0 2024-09-12T02:04:21.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.147+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v112'203 uv203 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.147+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8b6da0 2024-09-12T02:04:21.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.148+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v112'86 uv85 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.148+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8b6da0 2024-09-12T02:04:21.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.149+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v112'87 uv87 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.149+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8b6da0 2024-09-12T02:04:21.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.150+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v112'88 uv88 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.150 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:04:21.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.150+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8b6da0 2024-09-12T02:04:21.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.151+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v112'89 uv89 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.151+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8b6da0 2024-09-12T02:04:21.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.152+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v112'90 uv90 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f13bc098a70 con 0x559d7b8b6da0 2024-09-12T02:04:21.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.152+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8bb3f0 2024-09-12T02:04:21.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.153+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v112'105 uv104 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.153+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8bb3f0 2024-09-12T02:04:21.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.154+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v112'106 uv106 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.154+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8bb3f0 2024-09-12T02:04:21.155 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:04:21.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.155+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v112'107 uv107 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.155+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bfcf0 con 0x559d7b8bb3f0 2024-09-12T02:04:21.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.156+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v112'108 uv108 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.156+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bfcf0 con 0x559d7b8bb3f0 2024-09-12T02:04:21.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.157+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v112'109 uv109 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.157+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8bb3f0 2024-09-12T02:04:21.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.158+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v112'110 uv110 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.158+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8bb3f0 2024-09-12T02:04:21.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.159+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v112'172 uv166 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.159+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8bb3f0 2024-09-12T02:04:21.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.160+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v112'173 uv173 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.160+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8bb3f0 2024-09-12T02:04:21.161 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:04:21.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.161+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v112'174 uv174 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.161+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8bb3f0 2024-09-12T02:04:21.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.162+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v112'175 uv175 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.162+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8bb3f0 2024-09-12T02:04:21.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.163+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v112'176 uv176 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.163+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8bb3f0 2024-09-12T02:04:21.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.164+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v112'177 uv171 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.164+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8bb3f0 2024-09-12T02:04:21.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.165+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v112'178 uv178 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.165+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8bb3f0 2024-09-12T02:04:21.166 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:04:21.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.166+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v112'179 uv179 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.166+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8bece0 con 0x559d7b8bb3f0 2024-09-12T02:04:21.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.167+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v112'180 uv180 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.167+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c1b80 con 0x559d7b8bb3f0 2024-09-12T02:04:21.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.168+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v112'181 uv181 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.168+0000 7f13c3987f40 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x559d7b8bf860 0x559d7b8c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.168+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2220 con 0x559d7b8bf860 2024-09-12T02:04:21.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.169+0000 7f13c0c7c640 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x559d7b8bf860 0x559d7b8c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.169+0000 7f13c0c7c640 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x559d7b8bf860 0x559d7b8c1c50 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.170+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v112'78 uv77 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8bf860 2024-09-12T02:04:21.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.170+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2220 con 0x559d7b8bf860 2024-09-12T02:04:21.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.171+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v112'79 uv79 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8bf860 2024-09-12T02:04:21.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.171+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2220 con 0x559d7b8bf860 2024-09-12T02:04:21.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.173+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v112'80 uv80 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8bf860 2024-09-12T02:04:21.173 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:04:21.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.173+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8ba790 con 0x559d7b8bf860 2024-09-12T02:04:21.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.174+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v112'81 uv81 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8bf860 2024-09-12T02:04:21.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.174+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2720 con 0x559d7b8bb3f0 2024-09-12T02:04:21.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.175+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v112'105 uv104 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.175+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2720 con 0x559d7b8bb3f0 2024-09-12T02:04:21.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.176+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v112'106 uv106 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.176+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2720 con 0x559d7b8bb3f0 2024-09-12T02:04:21.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.177+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v112'107 uv107 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.177 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:04:21.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.177+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c3730 con 0x559d7b8bb3f0 2024-09-12T02:04:21.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.178+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v112'108 uv108 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.178+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c3730 con 0x559d7b8bb3f0 2024-09-12T02:04:21.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.179+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v112'109 uv109 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.179+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2720 con 0x559d7b8bb3f0 2024-09-12T02:04:21.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.183+0000 7f13c147d640 1 -- 172.21.15.19:0/1482995403 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v112'110 uv110 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b400e040 con 0x559d7b8bb3f0 2024-09-12T02:04:21.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.183+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2720 con 0x559d7b8b3990 2024-09-12T02:04:21.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.184+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v112'89 uv88 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8b3990 2024-09-12T02:04:21.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.184+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2720 con 0x559d7b8b3990 2024-09-12T02:04:21.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.184+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v112'90 uv90 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8b3990 2024-09-12T02:04:21.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.185+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2690 con 0x559d7b8b3990 2024-09-12T02:04:21.186 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:04:21.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.186+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v112'91 uv91 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8b3990 2024-09-12T02:04:21.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.186+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2660 con 0x559d7b8b3990 2024-09-12T02:04:21.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.187+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v112'92 uv92 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8b3990 2024-09-12T02:04:21.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.187+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2660 con 0x559d7b8b3990 2024-09-12T02:04:21.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.188+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v112'93 uv93 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8b3990 2024-09-12T02:04:21.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.188+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2660 con 0x559d7b8b3990 2024-09-12T02:04:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.189+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v112'216 uv208 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8b3990 2024-09-12T02:04:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.189+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2680 con 0x559d7b8b3990 2024-09-12T02:04:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.190+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v112'217 uv217 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8b3990 2024-09-12T02:04:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.190+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2680 con 0x559d7b8b3990 2024-09-12T02:04:21.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.191+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v112'218 uv218 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8b3990 2024-09-12T02:04:21.192 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:04:21.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.191+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2680 con 0x559d7b8b3990 2024-09-12T02:04:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.193+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v112'219 uv219 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8b3990 2024-09-12T02:04:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.193+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2640 con 0x559d7b8b3990 2024-09-12T02:04:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.194+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v112'220 uv220 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8b3990 2024-09-12T02:04:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.194+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2640 con 0x559d7b8b3990 2024-09-12T02:04:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.195+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v112'221 uv215 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8b3990 2024-09-12T02:04:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.195+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2640 con 0x559d7b8b3990 2024-09-12T02:04:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.196+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v112'222 uv222 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8b3990 2024-09-12T02:04:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.196+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2640 con 0x559d7b8b3990 2024-09-12T02:04:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.197+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v112'223 uv223 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8b3990 2024-09-12T02:04:21.197 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:04:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.197+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2680 con 0x559d7b8b3990 2024-09-12T02:04:21.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.198+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v112'224 uv224 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8b3990 2024-09-12T02:04:21.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.198+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c3b60 con 0x559d7b8b3990 2024-09-12T02:04:21.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.199+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v112'225 uv225 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8b3990 2024-09-12T02:04:21.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.199+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2a50 con 0x559d7b8b3990 2024-09-12T02:04:21.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.200+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v112'226 uv226 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8b3990 2024-09-12T02:04:21.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.200+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x559d7b8c2e40 con 0x559d7b8b3990 2024-09-12T02:04:21.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c0c7c640 1 -- 172.21.15.19:0/1482995403 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v112'227 uv227 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f13b802a040 con 0x559d7b8b3990 2024-09-12T02:04:21.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559d7b8aed40 msgr2=0x559d7b8b1130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x559d7b8aed40 0x559d7b8b1130 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x559d7b80b8b0 msgr2=0x559d7b80c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x559d7b80b8b0 0x559d7b80c580 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x559d7b8b6da0 msgr2=0x559d7b8b91b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x559d7b8b6da0 0x559d7b8b91b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x559d7b8bf860 msgr2=0x559d7b8c1c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x559d7b8bf860 0x559d7b8c1c50 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x559d7b8b3990 msgr2=0x559d7b8b5d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 reap_dead start 2024-09-12T02:04:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x559d7b8b3990 0x559d7b8b5d80 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559d7b8bb3f0 msgr2=0x559d7b8bd7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559d7b8bb3f0 0x559d7b8bd7e0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c1c7e640 1 -- 172.21.15.19:0/1482995403 reap_dead start 2024-09-12T02:04:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f13a406a810 msgr2=0x7f13a406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f13a406a810 0x7f13a406ccd0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f13b4003f10 tx=0x7f13b4003890 comp rx=0 tx=0).stop 2024-09-12T02:04:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d7b809fb0 msgr2=0x559d7b80c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d7b809fb0 0x559d7b80c040 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f13bc025b20 tx=0x7f13bc003330 comp rx=0 tx=0).stop 2024-09-12T02:04:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 shutdown_connections 2024-09-12T02:04:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x559d7b8bb3f0 0x559d7b8bd7e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f13a406a810 0x7f13a406ccd0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.201+0000 7f13c3987f40 1 --2- 172.21.15.19:0/1482995403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d7b809fb0 0x559d7b80c040 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.202+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 >> 172.21.15.19:0/1482995403 conn(0x559d7b760490 msgr2=0x559d7b807720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:21.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.202+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 shutdown_connections 2024-09-12T02:04:21.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.202+0000 7f13c3987f40 1 -- 172.21.15.19:0/1482995403 wait complete. 2024-09-12T02:04:21.206 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put 500.00000000 - 2024-09-12T02:04:21.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.250+0000 7ff2db35ff40 1 Processor -- start 2024-09-12T02:04:21.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.250+0000 7ff2db35ff40 1 -- start start 2024-09-12T02:04:21.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.250+0000 7ff2db35ff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4a26a9e0 0x55dd4a33da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.250+0000 7ff2db35ff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55dd4a2b38e0 0x55dd4a2affe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.250+0000 7ff2db35ff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dd4a341fb0 0x55dd4a342390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.250+0000 7ff2db35ff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55dd4a1bc510 con 0x55dd4a341fb0 2024-09-12T02:04:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.250+0000 7ff2db35ff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55dd4a26af20 con 0x55dd4a26a9e0 2024-09-12T02:04:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.250+0000 7ff2db35ff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55dd4a2b2860 con 0x55dd4a2b38e0 2024-09-12T02:04:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.250+0000 7ff2d9656640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dd4a341fb0 0x55dd4a342390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.250+0000 7ff2d9656640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dd4a341fb0 0x55dd4a342390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58376/0 (socket says 172.21.15.19:58376) 2024-09-12T02:04:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.250+0000 7ff2d8e55640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4a26a9e0 0x55dd4a33da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.250+0000 7ff2d9656640 1 -- 172.21.15.19:0/1469249056 learned_addr learned my addr 172.21.15.19:0/1469249056 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.251+0000 7ff2d3fff640 1 --2- 172.21.15.19:0/1469249056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55dd4a2b38e0 0x55dd4a2affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.251+0000 7ff2d8e55640 1 -- 172.21.15.19:0/1469249056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55dd4a2b38e0 msgr2=0x55dd4a2affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.251+0000 7ff2d8e55640 1 --2- 172.21.15.19:0/1469249056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55dd4a2b38e0 0x55dd4a2affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.251+0000 7ff2d8e55640 1 -- 172.21.15.19:0/1469249056 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dd4a341fb0 msgr2=0x55dd4a342390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:21.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.251+0000 7ff2d8e55640 1 --2- 172.21.15.19:0/1469249056 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dd4a341fb0 0x55dd4a342390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.251+0000 7ff2d8e55640 1 -- 172.21.15.19:0/1469249056 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd4a333ca0 con 0x55dd4a26a9e0 2024-09-12T02:04:21.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.251+0000 7ff2d8e55640 1 --2- 172.21.15.19:0/1469249056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4a26a9e0 0x55dd4a33da30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc001d80 tx=0x7ff2cc001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89b8e653ed51e918 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.251+0000 7ff2d2ffd640 1 -- 172.21.15.19:0/1469249056 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc00f450 con 0x55dd4a26a9e0 2024-09-12T02:04:21.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.251+0000 7ff2d2ffd640 1 -- 172.21.15.19:0/1469249056 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2cc006070 con 0x55dd4a26a9e0 2024-09-12T02:04:21.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.251+0000 7ff2d2ffd640 1 -- 172.21.15.19:0/1469249056 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc00f850 con 0x55dd4a26a9e0 2024-09-12T02:04:21.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.252+0000 7ff2db35ff40 1 -- 172.21.15.19:0/1469249056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4a26a9e0 msgr2=0x55dd4a33da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.252+0000 7ff2db35ff40 1 --2- 172.21.15.19:0/1469249056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4a26a9e0 0x55dd4a33da30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc001d80 tx=0x7ff2cc001e70 comp rx=0 tx=0).stop 2024-09-12T02:04:21.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.252+0000 7ff2db35ff40 1 -- 172.21.15.19:0/1469249056 shutdown_connections 2024-09-12T02:04:21.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.252+0000 7ff2db35ff40 1 --2- 172.21.15.19:0/1469249056 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dd4a341fb0 0x55dd4a342390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.252+0000 7ff2db35ff40 1 --2- 172.21.15.19:0/1469249056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55dd4a2b38e0 0x55dd4a2affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.252+0000 7ff2db35ff40 1 --2- 172.21.15.19:0/1469249056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4a26a9e0 0x55dd4a33da30 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.252+0000 7ff2db35ff40 1 -- 172.21.15.19:0/1469249056 >> 172.21.15.19:0/1469249056 conn(0x55dd4a298490 msgr2=0x55dd4a299940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:21.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.252+0000 7ff2db35ff40 1 -- 172.21.15.19:0/1469249056 shutdown_connections 2024-09-12T02:04:21.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.252+0000 7ff2db35ff40 1 -- 172.21.15.19:0/1469249056 wait complete. 2024-09-12T02:04:21.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.252+0000 7ff2db35ff40 1 Processor -- start 2024-09-12T02:04:21.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.252+0000 7ff2db35ff40 1 -- start start 2024-09-12T02:04:21.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.253+0000 7ff2db35ff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55dd4a26a9e0 0x55dd4a33d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.253+0000 7ff2db35ff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4a2b38e0 0x55dd4a333110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.253+0000 7ff2db35ff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dd4a341fb0 0x55dd4a2b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.253+0000 7ff2db35ff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55dd4a2b2580 con 0x55dd4a341fb0 2024-09-12T02:04:21.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.253+0000 7ff2db35ff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55dd4a345370 con 0x55dd4a2b38e0 2024-09-12T02:04:21.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.253+0000 7ff2db35ff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55dd4a2b0e00 con 0x55dd4a26a9e0 2024-09-12T02:04:21.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.253+0000 7ff2d9656640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dd4a341fb0 0x55dd4a2b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.253+0000 7ff2d3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4a2b38e0 0x55dd4a333110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.253+0000 7ff2d9656640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dd4a341fb0 0x55dd4a2b1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58388/0 (socket says 172.21.15.19:58388) 2024-09-12T02:04:21.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.253+0000 7ff2d9656640 1 -- 172.21.15.19:0/3886937861 learned_addr learned my addr 172.21.15.19:0/3886937861 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:21.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.253+0000 7ff2d8e55640 1 --2- 172.21.15.19:0/3886937861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55dd4a26a9e0 0x55dd4a33d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.254+0000 7ff2d9656640 1 -- 172.21.15.19:0/3886937861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55dd4a26a9e0 msgr2=0x55dd4a33d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.254+0000 7ff2d9656640 1 --2- 172.21.15.19:0/3886937861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55dd4a26a9e0 0x55dd4a33d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.254+0000 7ff2d9656640 1 -- 172.21.15.19:0/3886937861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4a2b38e0 msgr2=0x55dd4a333110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.254+0000 7ff2d9656640 1 --2- 172.21.15.19:0/3886937861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4a2b38e0 0x55dd4a333110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.254+0000 7ff2d9656640 1 -- 172.21.15.19:0/3886937861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd4a335940 con 0x55dd4a341fb0 2024-09-12T02:04:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.254+0000 7ff2d3fff640 1 --2- 172.21.15.19:0/3886937861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4a2b38e0 0x55dd4a333110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.254+0000 7ff2d9656640 1 --2- 172.21.15.19:0/3886937861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dd4a341fb0 0x55dd4a2b1070 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40108b0 tx=0x7ff2d4010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.254+0000 7ff2d1ffb640 1 -- 172.21.15.19:0/3886937861 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4018070 con 0x55dd4a341fb0 2024-09-12T02:04:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.254+0000 7ff2d1ffb640 1 -- 172.21.15.19:0/3886937861 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d400ae50 con 0x55dd4a341fb0 2024-09-12T02:04:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.254+0000 7ff2db35ff40 1 -- 172.21.15.19:0/3886937861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd4a29a030 con 0x55dd4a341fb0 2024-09-12T02:04:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.254+0000 7ff2d1ffb640 1 -- 172.21.15.19:0/3886937861 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d400ebd0 con 0x55dd4a341fb0 2024-09-12T02:04:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.254+0000 7ff2db35ff40 1 -- 172.21.15.19:0/3886937861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd4a335be0 con 0x55dd4a341fb0 2024-09-12T02:04:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.255+0000 7ff2d1ffb640 1 -- 172.21.15.19:0/3886937861 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2d4011040 con 0x55dd4a341fb0 2024-09-12T02:04:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.256+0000 7ff2d1ffb640 1 --2- 172.21.15.19:0/3886937861 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff2bc06a810 0x7ff2bc06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.256+0000 7ff2d1ffb640 1 -- 172.21.15.19:0/3886937861 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7ff2d408a780 con 0x55dd4a341fb0 2024-09-12T02:04:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.256+0000 7ff2d8e55640 1 --2- 172.21.15.19:0/3886937861 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff2bc06a810 0x7ff2bc06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.256+0000 7ff2db35ff40 1 --2- 172.21.15.19:0/3886937861 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55dd4a340510 0x55dd4a3408f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.256+0000 7ff2db35ff40 1 -- 172.21.15.19:0/3886937861 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:1 13.15 13:aa448500:::500.00000000:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x55dd4a340e30 con 0x55dd4a340510 2024-09-12T02:04:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.256+0000 7ff2d3fff640 1 --2- 172.21.15.19:0/3886937861 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55dd4a340510 0x55dd4a3408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.256+0000 7ff2d8e55640 1 --2- 172.21.15.19:0/3886937861 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff2bc06a810 0x7ff2bc06ccd0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00c010 tx=0x7ff2cc009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.257+0000 7ff2d3fff640 1 --2- 172.21.15.19:0/3886937861 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55dd4a340510 0x55dd4a3408f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.258+0000 7ff2d3fff640 1 -- 172.21.15.19:0/3886937861 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(1 500.00000000 [writefull 0~80] v112'204 uv204 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff2c4054940 con 0x55dd4a340510 2024-09-12T02:04:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.258+0000 7ff2db35ff40 1 -- 172.21.15.19:0/3886937861 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55dd4a340510 msgr2=0x55dd4a3408f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.258+0000 7ff2db35ff40 1 --2- 172.21.15.19:0/3886937861 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55dd4a340510 0x55dd4a3408f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.258+0000 7ff2db35ff40 1 -- 172.21.15.19:0/3886937861 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff2bc06a810 msgr2=0x7ff2bc06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.258+0000 7ff2db35ff40 1 --2- 172.21.15.19:0/3886937861 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff2bc06a810 0x7ff2bc06ccd0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00c010 tx=0x7ff2cc009000 comp rx=0 tx=0).stop 2024-09-12T02:04:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.258+0000 7ff2db35ff40 1 -- 172.21.15.19:0/3886937861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dd4a341fb0 msgr2=0x55dd4a2b1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.258+0000 7ff2db35ff40 1 --2- 172.21.15.19:0/3886937861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dd4a341fb0 0x55dd4a2b1070 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40108b0 tx=0x7ff2d4010d70 comp rx=0 tx=0).stop 2024-09-12T02:04:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.258+0000 7ff2d9656640 1 -- 172.21.15.19:0/3886937861 reap_dead start 2024-09-12T02:04:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.258+0000 7ff2db35ff40 1 -- 172.21.15.19:0/3886937861 shutdown_connections 2024-09-12T02:04:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.258+0000 7ff2db35ff40 1 -- 172.21.15.19:0/3886937861 >> 172.21.15.19:0/3886937861 conn(0x55dd4a298490 msgr2=0x55dd4a342390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:21.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.258+0000 7ff2db35ff40 1 -- 172.21.15.19:0/3886937861 shutdown_connections 2024-09-12T02:04:21.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.258+0000 7ff2db35ff40 1 -- 172.21.15.19:0/3886937861 wait complete. 2024-09-12T02:04:21.263 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:04:21.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.408+0000 7f7c877e4640 1 Processor -- start 2024-09-12T02:04:21.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.408+0000 7f7c877e4640 1 -- start start 2024-09-12T02:04:21.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.409+0000 7f7c877e4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7c80161a20 0x7f7c800d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.409+0000 7f7c877e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c800cf330 0x7f7c8006d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.409+0000 7f7c877e4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c800d1830 con 0x7f7c800d1420 2024-09-12T02:04:21.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.409+0000 7f7c877e4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f7c800cf760 con 0x7f7c80161a20 2024-09-12T02:04:21.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.409+0000 7f7c877e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7c80161e00 con 0x7f7c800cf330 2024-09-12T02:04:21.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.409+0000 7f7c85d81640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c800cf330 0x7f7c8006d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.409+0000 7f7c85580640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7c80161a20 0x7f7c800d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.409+0000 7f7c84d7f640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f7c800d1420 0x7f7c800cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:59674/0 (socket says 172.21.15.19:59674) 2024-09-12T02:04:21.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.409+0000 7f7c85580640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7c80161a20 0x7f7c800d0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:57334/0 (socket says 172.21.15.19:57334) 2024-09-12T02:04:21.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.409+0000 7f7c85d81640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c800cf330 0x7f7c8006d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:50418/0 (socket says 172.21.15.19:50418) 2024-09-12T02:04:21.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.409+0000 7f7c84d7f640 1 -- 172.21.15.19:0/564812249 learned_addr learned my addr 172.21.15.19:0/564812249 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:21.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.409+0000 7f7c85580640 1 -- 172.21.15.19:0/564812249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c800cf330 msgr2=0x7f7c8006d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:21.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.409+0000 7f7c85580640 1 --2- 172.21.15.19:0/564812249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c800cf330 0x7f7c8006d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.409+0000 7f7c85580640 1 -- 172.21.15.19:0/564812249 >> v1:172.21.15.135:6789/0 conn(0x7f7c800d1420 legacy=0x7f7c800cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.409+0000 7f7c77fff640 1 -- 172.21.15.19:0/564812249 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2823447706 0 0) 0x7f7c70001110 con 0x7f7c800d1420 2024-09-12T02:04:21.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.410+0000 7f7c85580640 1 -- 172.21.15.19:0/564812249 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c800cf980 con 0x7f7c80161a20 2024-09-12T02:04:21.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.410+0000 7f7c85580640 1 --2- 172.21.15.19:0/564812249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c80161a20 0x7f7c800d0ee0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0097d0 tx=0x7f7c7c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df90da233f82ae93 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.410+0000 7f7c77fff640 1 -- 172.21.15.19:0/564812249 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c037070 con 0x7f7c80161a20 2024-09-12T02:04:21.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.410+0000 7f7c77fff640 1 -- 172.21.15.19:0/564812249 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c7c032440 con 0x7f7c80161a20 2024-09-12T02:04:21.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.410+0000 7f7c77fff640 1 -- 172.21.15.19:0/564812249 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c032810 con 0x7f7c80161a20 2024-09-12T02:04:21.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.411+0000 7f7c877e4640 1 -- 172.21.15.19:0/564812249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c80161a20 msgr2=0x7f7c800d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.411+0000 7f7c877e4640 1 --2- 172.21.15.19:0/564812249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c80161a20 0x7f7c800d0ee0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0097d0 tx=0x7f7c7c02a1c0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.411+0000 7f7c877e4640 1 -- 172.21.15.19:0/564812249 shutdown_connections 2024-09-12T02:04:21.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.411+0000 7f7c877e4640 1 --2- 172.21.15.19:0/564812249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c800cf330 0x7f7c8006d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.411+0000 7f7c877e4640 1 --2- 172.21.15.19:0/564812249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c80161a20 0x7f7c800d0ee0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.411+0000 7f7c877e4640 1 -- 172.21.15.19:0/564812249 >> 172.21.15.19:0/564812249 conn(0x7f7c8009d850 msgr2=0x7f7c8008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:21.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.411+0000 7f7c877e4640 1 -- 172.21.15.19:0/564812249 shutdown_connections 2024-09-12T02:04:21.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.411+0000 7f7c877e4640 1 -- 172.21.15.19:0/564812249 wait complete. 2024-09-12T02:04:21.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.412+0000 7f7c877e4640 1 Processor -- start 2024-09-12T02:04:21.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.412+0000 7f7c877e4640 1 -- start start 2024-09-12T02:04:21.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.413+0000 7f7c877e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c800cf330 0x7f7c800cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.413+0000 7f7c877e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c800d1420 0x7f7c800b9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.413+0000 7f7c877e4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c80161a20 0x7f7c800b7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.413+0000 7f7c877e4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7c800cff00 con 0x7f7c800cf330 2024-09-12T02:04:21.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.413+0000 7f7c877e4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8006d050 con 0x7f7c80161a20 2024-09-12T02:04:21.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.413+0000 7f7c877e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7c8006d2f0 con 0x7f7c800d1420 2024-09-12T02:04:21.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.413+0000 7f7c85580640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c800cf330 0x7f7c800cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.413+0000 7f7c85d81640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c80161a20 0x7f7c800b7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.413+0000 7f7c85580640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c800cf330 0x7f7c800cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58404/0 (socket says 172.21.15.19:58404) 2024-09-12T02:04:21.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.413+0000 7f7c85580640 1 -- 172.21.15.19:0/3976526405 learned_addr learned my addr 172.21.15.19:0/3976526405 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:21.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.413+0000 7f7c85d81640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c80161a20 0x7f7c800b7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:57350/0 (socket says 172.21.15.19:57350) 2024-09-12T02:04:21.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.413+0000 7f7c84d7f640 1 --2- 172.21.15.19:0/3976526405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c800d1420 0x7f7c800b9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.413+0000 7f7c85d81640 1 -- 172.21.15.19:0/3976526405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c800d1420 msgr2=0x7f7c800b9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.413+0000 7f7c85d81640 1 --2- 172.21.15.19:0/3976526405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c800d1420 0x7f7c800b9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.413+0000 7f7c85d81640 1 -- 172.21.15.19:0/3976526405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c800cf330 msgr2=0x7f7c800cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.413+0000 7f7c85d81640 1 --2- 172.21.15.19:0/3976526405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c800cf330 0x7f7c800cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.413+0000 7f7c85d81640 1 -- 172.21.15.19:0/3976526405 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c800ccef0 con 0x7f7c80161a20 2024-09-12T02:04:21.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.413+0000 7f7c85580640 1 --2- 172.21.15.19:0/3976526405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c800cf330 0x7f7c800cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:21.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.414+0000 7f7c85d81640 1 --2- 172.21.15.19:0/3976526405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c80161a20 0x7f7c800b7590 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800efc0 tx=0x7f7c7800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.414+0000 7f7c75ffb640 1 -- 172.21.15.19:0/3976526405 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c78018020 con 0x7f7c80161a20 2024-09-12T02:04:21.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.414+0000 7f7c75ffb640 1 -- 172.21.15.19:0/3976526405 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c78014480 con 0x7f7c80161a20 2024-09-12T02:04:21.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.414+0000 7f7c877e4640 1 -- 172.21.15.19:0/3976526405 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c800cd230 con 0x7f7c80161a20 2024-09-12T02:04:21.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.414+0000 7f7c75ffb640 1 -- 172.21.15.19:0/3976526405 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c78014870 con 0x7f7c80161a20 2024-09-12T02:04:21.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.414+0000 7f7c877e4640 1 -- 172.21.15.19:0/3976526405 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c800cda70 con 0x7f7c80161a20 2024-09-12T02:04:21.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.415+0000 7f7c877e4640 1 -- 172.21.15.19:0/3976526405 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c800b1040 con 0x7f7c80161a20 2024-09-12T02:04:21.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.416+0000 7f7c75ffb640 1 -- 172.21.15.19:0/3976526405 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c78005d10 con 0x7f7c80161a20 2024-09-12T02:04:21.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.416+0000 7f7c75ffb640 1 --2- 172.21.15.19:0/3976526405 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7c6406be30 0x7f7c6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.416+0000 7f7c75ffb640 1 -- 172.21.15.19:0/3976526405 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7f7c7808c4b0 con 0x7f7c80161a20 2024-09-12T02:04:21.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.416+0000 7f7c85580640 1 --2- 172.21.15.19:0/3976526405 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7c6406be30 0x7f7c6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.417+0000 7f7c85580640 1 --2- 172.21.15.19:0/3976526405 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7c6406be30 0x7f7c6406e2f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c009720 tx=0x7f7c7c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.421+0000 7f7c75ffb640 1 -- 172.21.15.19:0/3976526405 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7c78022030 con 0x7f7c80161a20 2024-09-12T02:04:21.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.635+0000 7f7c877e4640 1 -- 172.21.15.19:0/3976526405 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f7c80156df0 con 0x7f7c80161a20 2024-09-12T02:04:21.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.737+0000 7f7c75ffb640 1 -- 172.21.15.19:0/3976526405 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v186) ==== 162+0+0 (secure 0 0 0) 0x7f7c800cd230 con 0x7f7c80161a20 2024-09-12T02:04:21.738 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:04:21.739 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:04:21.739+0000 7f446bd25640 -1 mds.0.purge_queue operator(): Error -22 loading Journaler 2024-09-12T02:04:21.739 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:04:21.739+0000 7f446bd25640 -1 mds.0.186 unhandled write error (22) Invalid argument, force readonly... 2024-09-12T02:04:21.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.739+0000 7f7c877e4640 1 -- 172.21.15.19:0/3976526405 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7c6406be30 msgr2=0x7f7c6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.739+0000 7f7c877e4640 1 --2- 172.21.15.19:0/3976526405 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7c6406be30 0x7f7c6406e2f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c009720 tx=0x7f7c7c02e000 comp rx=0 tx=0).stop 2024-09-12T02:04:21.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.739+0000 7f7c877e4640 1 -- 172.21.15.19:0/3976526405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c80161a20 msgr2=0x7f7c800b7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.739+0000 7f7c877e4640 1 --2- 172.21.15.19:0/3976526405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c80161a20 0x7f7c800b7590 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800efc0 tx=0x7f7c7800c490 comp rx=0 tx=0).stop 2024-09-12T02:04:21.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.739+0000 7f7c877e4640 1 -- 172.21.15.19:0/3976526405 shutdown_connections 2024-09-12T02:04:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.739+0000 7f7c877e4640 1 --2- 172.21.15.19:0/3976526405 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7c6406be30 0x7f7c6406e2f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.739+0000 7f7c877e4640 1 --2- 172.21.15.19:0/3976526405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c80161a20 0x7f7c800b7590 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.739+0000 7f7c877e4640 1 --2- 172.21.15.19:0/3976526405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c800d1420 0x7f7c800b9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.739+0000 7f7c877e4640 1 --2- 172.21.15.19:0/3976526405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c800cf330 0x7f7c800cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.739+0000 7f7c877e4640 1 -- 172.21.15.19:0/3976526405 >> 172.21.15.19:0/3976526405 conn(0x7f7c8009d850 msgr2=0x7f7c800b14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.739+0000 7f7c877e4640 1 -- 172.21.15.19:0/3976526405 shutdown_connections 2024-09-12T02:04:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.739+0000 7f7c877e4640 1 -- 172.21.15.19:0/3976526405 wait complete. 2024-09-12T02:04:21.752 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:21.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.853+0000 7fe67dff8640 1 Processor -- start 2024-09-12T02:04:21.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.854+0000 7fe67dff8640 1 -- start start 2024-09-12T02:04:21.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.854+0000 7fe67dff8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6780d1540 0x7fe67806dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.854+0000 7fe67dff8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe67809b690 0x7fe67806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.854+0000 7fe67dff8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6780d1940 con 0x7fe67815e740 2024-09-12T02:04:21.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.854+0000 7fe67dff8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe67815eb20 con 0x7fe67809b690 2024-09-12T02:04:21.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.854+0000 7fe67dff8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe67806d260 con 0x7fe6780d1540 2024-09-12T02:04:21.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.855+0000 7fe676ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6780d1540 0x7fe67806dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.855+0000 7fe677fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe67809b690 0x7fe67806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.855+0000 7fe676ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6780d1540 0x7fe67806dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:50436/0 (socket says 172.21.15.19:50436) 2024-09-12T02:04:21.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.855+0000 7fe676ffd640 1 -- 172.21.15.19:0/4263809082 learned_addr learned my addr 172.21.15.19:0/4263809082 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:21.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.855+0000 7fe6777fe640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fe67815e740 0x7fe67806d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:59686/0 (socket says 172.21.15.19:59686) 2024-09-12T02:04:21.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.855+0000 7fe676ffd640 1 -- 172.21.15.19:0/4263809082 >> v2:172.21.15.135:3300/0 conn(0x7fe67809b690 msgr2=0x7fe67806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:21.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.855+0000 7fe676ffd640 1 --2- 172.21.15.19:0/4263809082 >> v2:172.21.15.135:3300/0 conn(0x7fe67809b690 0x7fe67806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.855+0000 7fe676ffd640 1 -- 172.21.15.19:0/4263809082 >> v1:172.21.15.135:6789/0 conn(0x7fe67815e740 legacy=0x7fe67806d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.855+0000 7fe6767fc640 1 -- 172.21.15.19:0/4263809082 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4204254815 0 0) 0x7fe6780d1940 con 0x7fe67815e740 2024-09-12T02:04:21.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.855+0000 7fe676ffd640 1 -- 172.21.15.19:0/4263809082 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67809bae0 con 0x7fe6780d1540 2024-09-12T02:04:21.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.855+0000 7fe677fff640 1 --2- 172.21.15.19:0/4263809082 >> v2:172.21.15.135:3300/0 conn(0x7fe67809b690 0x7fe67806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:21.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.856+0000 7fe676ffd640 1 --2- 172.21.15.19:0/4263809082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6780d1540 0x7fe67806dbd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009870 tx=0x7fe66c02a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0215f4c5d6d2801 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.856+0000 7fe6767fc640 1 -- 172.21.15.19:0/4263809082 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c037070 con 0x7fe6780d1540 2024-09-12T02:04:21.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.856+0000 7fe6767fc640 1 -- 172.21.15.19:0/4263809082 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe66c02ae50 con 0x7fe6780d1540 2024-09-12T02:04:21.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.856+0000 7fe6767fc640 1 -- 172.21.15.19:0/4263809082 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c032860 con 0x7fe6780d1540 2024-09-12T02:04:21.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.857+0000 7fe67dff8640 1 -- 172.21.15.19:0/4263809082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6780d1540 msgr2=0x7fe67806dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.857+0000 7fe67dff8640 1 --2- 172.21.15.19:0/4263809082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6780d1540 0x7fe67806dbd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009870 tx=0x7fe66c02a300 comp rx=0 tx=0).stop 2024-09-12T02:04:21.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.857+0000 7fe67dff8640 1 -- 172.21.15.19:0/4263809082 shutdown_connections 2024-09-12T02:04:21.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.857+0000 7fe67dff8640 1 --2- 172.21.15.19:0/4263809082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6780d1540 0x7fe67806dbd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.857+0000 7fe67dff8640 1 --2- 172.21.15.19:0/4263809082 >> v2:172.21.15.135:3300/0 conn(0x7fe67809b690 0x7fe67806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.857+0000 7fe67dff8640 1 -- 172.21.15.19:0/4263809082 >> 172.21.15.19:0/4263809082 conn(0x7fe6780d23a0 msgr2=0x7fe6780d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:21.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.857+0000 7fe67dff8640 1 -- 172.21.15.19:0/4263809082 shutdown_connections 2024-09-12T02:04:21.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.857+0000 7fe67dff8640 1 -- 172.21.15.19:0/4263809082 wait complete. 2024-09-12T02:04:21.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.858+0000 7fe67dff8640 1 Processor -- start 2024-09-12T02:04:21.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.858+0000 7fe67dff8640 1 -- start start 2024-09-12T02:04:21.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.859+0000 7fe67dff8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe67809b690 0x7fe6781562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.859+0000 7fe67dff8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6780d1540 0x7fe6780ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.859+0000 7fe67dff8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe67815e740 0x7fe67815b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.859+0000 7fe67dff8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe6780d0d40 con 0x7fe6780d1540 2024-09-12T02:04:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.859+0000 7fe67dff8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe6780d0a60 con 0x7fe67809b690 2024-09-12T02:04:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.859+0000 7fe67dff8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe6780d1020 con 0x7fe67815e740 2024-09-12T02:04:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.859+0000 7fe676ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6780d1540 0x7fe6780ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.859+0000 7fe676ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6780d1540 0x7fe6780ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58412/0 (socket says 172.21.15.19:58412) 2024-09-12T02:04:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.859+0000 7fe676ffd640 1 -- 172.21.15.19:0/4114370121 learned_addr learned my addr 172.21.15.19:0/4114370121 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.859+0000 7fe6777fe640 1 --2- 172.21.15.19:0/4114370121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe67809b690 0x7fe6781562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.859+0000 7fe677fff640 1 --2- 172.21.15.19:0/4114370121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe67815e740 0x7fe67815b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.860+0000 7fe676ffd640 1 -- 172.21.15.19:0/4114370121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe67815e740 msgr2=0x7fe67815b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.860+0000 7fe676ffd640 1 --2- 172.21.15.19:0/4114370121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe67815e740 0x7fe67815b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.860+0000 7fe676ffd640 1 -- 172.21.15.19:0/4114370121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe67809b690 msgr2=0x7fe6781562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.860+0000 7fe676ffd640 1 --2- 172.21.15.19:0/4114370121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe67809b690 0x7fe6781562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.860+0000 7fe676ffd640 1 -- 172.21.15.19:0/4114370121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6780b6dd0 con 0x7fe6780d1540 2024-09-12T02:04:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.860+0000 7fe677fff640 1 --2- 172.21.15.19:0/4114370121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe67815e740 0x7fe67815b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.860+0000 7fe6777fe640 1 --2- 172.21.15.19:0/4114370121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe67809b690 0x7fe6781562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.860+0000 7fe676ffd640 1 --2- 172.21.15.19:0/4114370121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6780d1540 0x7fe6780ce520 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0090b0 tx=0x7fe66c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.860+0000 7fe65ffff640 1 -- 172.21.15.19:0/4114370121 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c037040 con 0x7fe6780d1540 2024-09-12T02:04:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.860+0000 7fe65ffff640 1 -- 172.21.15.19:0/4114370121 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe66c004230 con 0x7fe6780d1540 2024-09-12T02:04:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.860+0000 7fe67dff8640 1 -- 172.21.15.19:0/4114370121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6781567e0 con 0x7fe6780d1540 2024-09-12T02:04:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.860+0000 7fe65ffff640 1 -- 172.21.15.19:0/4114370121 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c003610 con 0x7fe6780d1540 2024-09-12T02:04:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.860+0000 7fe67dff8640 1 -- 172.21.15.19:0/4114370121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6780b7350 con 0x7fe6780d1540 2024-09-12T02:04:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.861+0000 7fe67dff8640 1 -- 172.21.15.19:0/4114370121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe67806cd20 con 0x7fe6780d1540 2024-09-12T02:04:21.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.861+0000 7fe65ffff640 1 -- 172.21.15.19:0/4114370121 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe66c03a070 con 0x7fe6780d1540 2024-09-12T02:04:21.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.862+0000 7fe65ffff640 1 --2- 172.21.15.19:0/4114370121 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe66406be30 0x7fe66406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.862+0000 7fe65ffff640 1 -- 172.21.15.19:0/4114370121 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7fe66c0abd50 con 0x7fe6780d1540 2024-09-12T02:04:21.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.862+0000 7fe6777fe640 1 --2- 172.21.15.19:0/4114370121 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe66406be30 0x7fe66406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.863+0000 7fe6777fe640 1 --2- 172.21.15.19:0/4114370121 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe66406be30 0x7fe66406e2f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe668000f60 tx=0x7fe668007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:21.866+0000 7fe65ffff640 1 -- 172.21.15.19:0/4114370121 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe66c0af030 con 0x7fe6780d1540 2024-09-12T02:04:22.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.077+0000 7fe67dff8640 1 -- 172.21.15.19:0/4114370121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6780d1cb0 con 0x7fe6780d1540 2024-09-12T02:04:22.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.078+0000 7fe65ffff640 1 -- 172.21.15.19:0/4114370121 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 186 v186) ==== 95+0+4401 (secure 0 0 0) 0x7fe66c041020 con 0x7fe6780d1540 2024-09-12T02:04:22.079 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:22.079 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":186,"btime":"2024-09-12T02:04:21:734507+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":186,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:21.734488+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7103":{"gid":7103,"name":"d","rank":0,"incarnation":186,"state":"up:replay","state_seq":1,"addr":"172.21.15.135:6837/2405422603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2405422603},{"type":"v1","addr":"172.21.15.135:6837","nonce":2405422603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:22.079 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 186 2024-09-12T02:04:22.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.080+0000 7fe67dff8640 1 -- 172.21.15.19:0/4114370121 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe66406be30 msgr2=0x7fe66406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:22.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.080+0000 7fe67dff8640 1 --2- 172.21.15.19:0/4114370121 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe66406be30 0x7fe66406e2f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe668000f60 tx=0x7fe668007c10 comp rx=0 tx=0).stop 2024-09-12T02:04:22.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.080+0000 7fe67dff8640 1 -- 172.21.15.19:0/4114370121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6780d1540 msgr2=0x7fe6780ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:22.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.080+0000 7fe67dff8640 1 --2- 172.21.15.19:0/4114370121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6780d1540 0x7fe6780ce520 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0090b0 tx=0x7fe66c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.080+0000 7fe67dff8640 1 -- 172.21.15.19:0/4114370121 shutdown_connections 2024-09-12T02:04:22.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.080+0000 7fe67dff8640 1 --2- 172.21.15.19:0/4114370121 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe66406be30 0x7fe66406e2f0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.080+0000 7fe67dff8640 1 --2- 172.21.15.19:0/4114370121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe67815e740 0x7fe67815b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.080+0000 7fe67dff8640 1 --2- 172.21.15.19:0/4114370121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6780d1540 0x7fe6780ce520 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.080+0000 7fe67dff8640 1 --2- 172.21.15.19:0/4114370121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe67809b690 0x7fe6781562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.080+0000 7fe67dff8640 1 -- 172.21.15.19:0/4114370121 >> 172.21.15.19:0/4114370121 conn(0x7fe6780d23a0 msgr2=0x7fe6780b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:22.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.080+0000 7fe67dff8640 1 -- 172.21.15.19:0/4114370121 shutdown_connections 2024-09-12T02:04:22.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.080+0000 7fe67dff8640 1 -- 172.21.15.19:0/4114370121 wait complete. 2024-09-12T02:04:22.494 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:22.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.600+0000 7fbc913bd640 1 Processor -- start 2024-09-12T02:04:22.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.600+0000 7fbc913bd640 1 -- start start 2024-09-12T02:04:22.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.601+0000 7fbc913bd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbc8c0b5f80 0x7fbc8c0b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:22.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.601+0000 7fbc913bd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc8c0cd650 0x7fbc8c0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:22.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.601+0000 7fbc913bd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc8c06fdb0 con 0x7fbc8c0afd70 2024-09-12T02:04:22.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.601+0000 7fbc913bd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fbc8c0b6910 con 0x7fbc8c0b5f80 2024-09-12T02:04:22.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.601+0000 7fbc913bd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbc8c070090 con 0x7fbc8c0cd650 2024-09-12T02:04:22.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.601+0000 7fbc83fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbc8c0b5f80 0x7fbc8c0b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:22.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.601+0000 7fbc83fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbc8c0b5f80 0x7fbc8c0b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58426/0 (socket says 172.21.15.19:58426) 2024-09-12T02:04:22.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.601+0000 7fbc8affd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbc8c0afd70 0x7fbc8c160820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43112/0 (socket says 172.21.15.19:43112) 2024-09-12T02:04:22.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.601+0000 7fbc83fff640 1 -- 172.21.15.19:0/1155878812 learned_addr learned my addr 172.21.15.19:0/1155878812 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:22.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.601+0000 7fbc8b7fe640 1 --2- 172.21.15.19:0/1155878812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc8c0cd650 0x7fbc8c0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:22.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.601+0000 7fbc83fff640 1 -- 172.21.15.19:0/1155878812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc8c0cd650 msgr2=0x7fbc8c0cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:22.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.601+0000 7fbc83fff640 1 --2- 172.21.15.19:0/1155878812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc8c0cd650 0x7fbc8c0cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.601+0000 7fbc83fff640 1 -- 172.21.15.19:0/1155878812 >> v1:172.21.15.19:6789/0 conn(0x7fbc8c0afd70 legacy=0x7fbc8c160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:22.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.601+0000 7fbc83fff640 1 -- 172.21.15.19:0/1155878812 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc8c070370 con 0x7fbc8c0b5f80 2024-09-12T02:04:22.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.601+0000 7fbc8a7fc640 1 -- 172.21.15.19:0/1155878812 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2597424230 0 0) 0x7fbc8c06fdb0 con 0x7fbc8c0afd70 2024-09-12T02:04:22.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.602+0000 7fbc83fff640 1 --2- 172.21.15.19:0/1155878812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc8c0b5f80 0x7fbc8c0b63d0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009870 tx=0x7fbc7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec4a521a5589374 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:22.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.602+0000 7fbc8a7fc640 1 -- 172.21.15.19:0/1155878812 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74037070 con 0x7fbc8c0b5f80 2024-09-12T02:04:22.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.602+0000 7fbc8a7fc640 1 -- 172.21.15.19:0/1155878812 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc74032440 con 0x7fbc8c0b5f80 2024-09-12T02:04:22.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.602+0000 7fbc8a7fc640 1 -- 172.21.15.19:0/1155878812 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74032810 con 0x7fbc8c0b5f80 2024-09-12T02:04:22.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.603+0000 7fbc913bd640 1 -- 172.21.15.19:0/1155878812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc8c0b5f80 msgr2=0x7fbc8c0b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:22.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.603+0000 7fbc913bd640 1 --2- 172.21.15.19:0/1155878812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc8c0b5f80 0x7fbc8c0b63d0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009870 tx=0x7fbc7402a270 comp rx=0 tx=0).stop 2024-09-12T02:04:22.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.603+0000 7fbc913bd640 1 -- 172.21.15.19:0/1155878812 shutdown_connections 2024-09-12T02:04:22.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.603+0000 7fbc913bd640 1 --2- 172.21.15.19:0/1155878812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc8c0cd650 0x7fbc8c0cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.603+0000 7fbc913bd640 1 --2- 172.21.15.19:0/1155878812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc8c0b5f80 0x7fbc8c0b63d0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.603+0000 7fbc913bd640 1 -- 172.21.15.19:0/1155878812 >> 172.21.15.19:0/1155878812 conn(0x7fbc8c06bc10 msgr2=0x7fbc8c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:22.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.603+0000 7fbc913bd640 1 -- 172.21.15.19:0/1155878812 shutdown_connections 2024-09-12T02:04:22.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.603+0000 7fbc913bd640 1 -- 172.21.15.19:0/1155878812 wait complete. 2024-09-12T02:04:22.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.604+0000 7fbc913bd640 1 Processor -- start 2024-09-12T02:04:22.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.604+0000 7fbc913bd640 1 -- start start 2024-09-12T02:04:22.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc913bd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc8c0afd70 0x7fbc8c0c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:22.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc913bd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc8c0b5f80 0x7fbc8c1474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:22.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc913bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc8c0cd650 0x7fbc8c0c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:22.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc913bd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c0b0150 con 0x7fbc8c0cd650 2024-09-12T02:04:22.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc913bd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c06fa80 con 0x7fbc8c0afd70 2024-09-12T02:04:22.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc913bd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbc8c160060 con 0x7fbc8c0b5f80 2024-09-12T02:04:22.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc8b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc8c0cd650 0x7fbc8c0c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:22.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc8b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc8c0cd650 0x7fbc8c0c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58430/0 (socket says 172.21.15.19:58430) 2024-09-12T02:04:22.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc8b7fe640 1 -- 172.21.15.19:0/2870762696 learned_addr learned my addr 172.21.15.19:0/2870762696 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:22.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc83fff640 1 --2- 172.21.15.19:0/2870762696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc8c0b5f80 0x7fbc8c1474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:22.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc8affd640 1 --2- 172.21.15.19:0/2870762696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc8c0afd70 0x7fbc8c0c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:22.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc8b7fe640 1 -- 172.21.15.19:0/2870762696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc8c0b5f80 msgr2=0x7fbc8c1474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:22.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc8b7fe640 1 --2- 172.21.15.19:0/2870762696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc8c0b5f80 0x7fbc8c1474a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc8b7fe640 1 -- 172.21.15.19:0/2870762696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc8c0afd70 msgr2=0x7fbc8c0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:22.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc8b7fe640 1 --2- 172.21.15.19:0/2870762696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc8c0afd70 0x7fbc8c0c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc8b7fe640 1 -- 172.21.15.19:0/2870762696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc8c0ae9c0 con 0x7fbc8c0cd650 2024-09-12T02:04:22.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc8b7fe640 1 --2- 172.21.15.19:0/2870762696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc8c0cd650 0x7fbc8c0c6820 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fbc84007e60 tx=0x7fbc8400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:22.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc837fe640 1 -- 172.21.15.19:0/2870762696 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84014420 con 0x7fbc8c0cd650 2024-09-12T02:04:22.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.605+0000 7fbc837fe640 1 -- 172.21.15.19:0/2870762696 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc84019070 con 0x7fbc8c0cd650 2024-09-12T02:04:22.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.606+0000 7fbc913bd640 1 -- 172.21.15.19:0/2870762696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc8c0aeca0 con 0x7fbc8c0cd650 2024-09-12T02:04:22.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.606+0000 7fbc837fe640 1 -- 172.21.15.19:0/2870762696 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84014820 con 0x7fbc8c0cd650 2024-09-12T02:04:22.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.606+0000 7fbc913bd640 1 -- 172.21.15.19:0/2870762696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc8c0af260 con 0x7fbc8c0cd650 2024-09-12T02:04:22.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.606+0000 7fbc913bd640 1 -- 172.21.15.19:0/2870762696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc8c0b63d0 con 0x7fbc8c0cd650 2024-09-12T02:04:22.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.607+0000 7fbc837fe640 1 -- 172.21.15.19:0/2870762696 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc840149c0 con 0x7fbc8c0cd650 2024-09-12T02:04:22.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.607+0000 7fbc837fe640 1 --2- 172.21.15.19:0/2870762696 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbc6c06be30 0x7fbc6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:22.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.608+0000 7fbc837fe640 1 -- 172.21.15.19:0/2870762696 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7fbc8408be10 con 0x7fbc8c0cd650 2024-09-12T02:04:22.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.608+0000 7fbc8affd640 1 --2- 172.21.15.19:0/2870762696 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbc6c06be30 0x7fbc6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:22.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.608+0000 7fbc8affd640 1 --2- 172.21.15.19:0/2870762696 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbc6c06be30 0x7fbc6c06e2f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c000f60 tx=0x7fbc7c007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:22.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.612+0000 7fbc837fe640 1 -- 172.21.15.19:0/2870762696 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc8405a040 con 0x7fbc8c0cd650 2024-09-12T02:04:22.723 INFO:tasks.ceph.mds.c.smithi019.stderr: -38> 2024-09-12T02:04:17.971+0000 7fbc9b247640 -1 log_channel(cluster) log [ERR] : missing journal object 2024-09-12T02:04:22.758 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:04:22.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.840+0000 7fbc913bd640 1 -- 172.21.15.19:0/2870762696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc8c15f970 con 0x7fbc8c0cd650 2024-09-12T02:04:22.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.840+0000 7fbc837fe640 1 -- 172.21.15.19:0/2870762696 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 187 v187) ==== 95+0+4404 (secure 0 0 0) 0x7fbc84059940 con 0x7fbc8c0cd650 2024-09-12T02:04:22.841 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:22.841 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":187,"btime":"2024-09-12T02:04:22:735725+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":187,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:21.744541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7103":{"gid":7103,"name":"d","rank":0,"incarnation":186,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.135:6837/2405422603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2405422603},{"type":"v1","addr":"172.21.15.135:6837","nonce":2405422603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:22.841 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 187 2024-09-12T02:04:22.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.842+0000 7fbc913bd640 1 -- 172.21.15.19:0/2870762696 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbc6c06be30 msgr2=0x7fbc6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:22.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.842+0000 7fbc913bd640 1 --2- 172.21.15.19:0/2870762696 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbc6c06be30 0x7fbc6c06e2f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c000f60 tx=0x7fbc7c007b50 comp rx=0 tx=0).stop 2024-09-12T02:04:22.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.842+0000 7fbc913bd640 1 -- 172.21.15.19:0/2870762696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc8c0cd650 msgr2=0x7fbc8c0c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:22.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.842+0000 7fbc913bd640 1 --2- 172.21.15.19:0/2870762696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc8c0cd650 0x7fbc8c0c6820 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fbc84007e60 tx=0x7fbc8400e4b0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.842+0000 7fbc913bd640 1 -- 172.21.15.19:0/2870762696 shutdown_connections 2024-09-12T02:04:22.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.842+0000 7fbc913bd640 1 --2- 172.21.15.19:0/2870762696 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbc6c06be30 0x7fbc6c06e2f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.842+0000 7fbc913bd640 1 --2- 172.21.15.19:0/2870762696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc8c0cd650 0x7fbc8c0c6820 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.842+0000 7fbc913bd640 1 --2- 172.21.15.19:0/2870762696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc8c0b5f80 0x7fbc8c1474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.842+0000 7fbc913bd640 1 --2- 172.21.15.19:0/2870762696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc8c0afd70 0x7fbc8c0c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.842+0000 7fbc913bd640 1 -- 172.21.15.19:0/2870762696 >> 172.21.15.19:0/2870762696 conn(0x7fbc8c06bc10 msgr2=0x7fbc8c154f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:22.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.842+0000 7fbc913bd640 1 -- 172.21.15.19:0/2870762696 shutdown_connections 2024-09-12T02:04:22.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:22.842+0000 7fbc913bd640 1 -- 172.21.15.19:0/2870762696 wait complete. 2024-09-12T02:04:22.854 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 187, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:04:21.744541+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 112, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7103}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7103': {'gid': 7103, 'name': 'd', 'rank': 0, 'incarnation': 186, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.135:6837/2405422603', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 2405422603}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 2405422603}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:04:22.854 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7103:up:reconnect 2024-09-12T02:04:22.855 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-12T02:04:25.790 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:04:25.793 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:04:27.857 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.961+0000 7f8833a4c640 1 Processor -- start 2024-09-12T02:04:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.961+0000 7f8833a4c640 1 -- start start 2024-09-12T02:04:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.962+0000 7f8833a4c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f882c06c320 0x7f882c15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.962+0000 7f8833a4c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f882c0ae140 0x7f882c0af950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.962+0000 7f8833a4c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f882c0b3570 con 0x7f882c145bc0 2024-09-12T02:04:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.962+0000 7f8833a4c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f882c0b3850 con 0x7f882c06c320 2024-09-12T02:04:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.962+0000 7f8833a4c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f882c0b3b30 con 0x7f882c0ae140 2024-09-12T02:04:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.962+0000 7f8830fe7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f882c06c320 0x7f882c15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.962+0000 7f8830fe7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f882c06c320 0x7f882c15ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58444/0 (socket says 172.21.15.19:58444) 2024-09-12T02:04:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.962+0000 7f8830fe7640 1 -- 172.21.15.19:0/3031004320 learned_addr learned my addr 172.21.15.19:0/3031004320 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.962+0000 7f8831fe9640 1 --2- 172.21.15.19:0/3031004320 >> v2:172.21.15.135:3300/0 conn(0x7f882c0ae140 0x7f882c0af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.962+0000 7f8830fe7640 1 -- 172.21.15.19:0/3031004320 >> v2:172.21.15.135:3300/0 conn(0x7f882c0ae140 msgr2=0x7f882c0af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.962+0000 7f8830fe7640 1 --2- 172.21.15.19:0/3031004320 >> v2:172.21.15.135:3300/0 conn(0x7f882c0ae140 0x7f882c0af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.962+0000 7f8830fe7640 1 -- 172.21.15.19:0/3031004320 >> v1:172.21.15.135:6789/0 conn(0x7f882c145bc0 legacy=0x7f882c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.962+0000 7f8830fe7640 1 -- 172.21.15.19:0/3031004320 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c0b1610 con 0x7f882c06c320 2024-09-12T02:04:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.962+0000 7f8831fe9640 1 --2- 172.21.15.19:0/3031004320 >> v2:172.21.15.135:3300/0 conn(0x7f882c0ae140 0x7f882c0af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.963+0000 7f8830fe7640 1 --2- 172.21.15.19:0/3031004320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f882c06c320 0x7f882c15ca70 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f881c009870 tx=0x7f881c02a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6b2cd5acf29ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.963+0000 7f8823fff640 1 -- 172.21.15.19:0/3031004320 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881c037070 con 0x7f882c06c320 2024-09-12T02:04:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.963+0000 7f8823fff640 1 -- 172.21.15.19:0/3031004320 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f881c032640 con 0x7f882c06c320 2024-09-12T02:04:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.963+0000 7f8823fff640 1 -- 172.21.15.19:0/3031004320 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881c032a10 con 0x7f882c06c320 2024-09-12T02:04:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.964+0000 7f8833a4c640 1 -- 172.21.15.19:0/3031004320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f882c06c320 msgr2=0x7f882c15ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.964+0000 7f8833a4c640 1 --2- 172.21.15.19:0/3031004320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f882c06c320 0x7f882c15ca70 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f881c009870 tx=0x7f881c02a330 comp rx=0 tx=0).stop 2024-09-12T02:04:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.964+0000 7f8833a4c640 1 -- 172.21.15.19:0/3031004320 shutdown_connections 2024-09-12T02:04:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.964+0000 7f8833a4c640 1 --2- 172.21.15.19:0/3031004320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f882c06c320 0x7f882c15ca70 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.964+0000 7f8833a4c640 1 --2- 172.21.15.19:0/3031004320 >> v2:172.21.15.135:3300/0 conn(0x7f882c0ae140 0x7f882c0af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.964+0000 7f8833a4c640 1 -- 172.21.15.19:0/3031004320 >> 172.21.15.19:0/3031004320 conn(0x7f882c073490 msgr2=0x7f882c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.964+0000 7f8833a4c640 1 -- 172.21.15.19:0/3031004320 shutdown_connections 2024-09-12T02:04:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.964+0000 7f8833a4c640 1 -- 172.21.15.19:0/3031004320 wait complete. 2024-09-12T02:04:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.965+0000 7f8833a4c640 1 Processor -- start 2024-09-12T02:04:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.965+0000 7f8833a4c640 1 -- start start 2024-09-12T02:04:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.966+0000 7f8833a4c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f882c06c320 0x7f882c0c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.966+0000 7f8833a4c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f882c0ae140 0x7f882c13ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.966+0000 7f8833a4c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f882c145bc0 0x7f882c1f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.966+0000 7f8833a4c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f882c145fa0 con 0x7f882c0ae140 2024-09-12T02:04:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.966+0000 7f8833a4c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f882c09aa30 con 0x7f882c06c320 2024-09-12T02:04:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.966+0000 7f8833a4c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f882c144020 con 0x7f882c145bc0 2024-09-12T02:04:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.966+0000 7f8830fe7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f882c0ae140 0x7f882c13ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.966+0000 7f8830fe7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f882c0ae140 0x7f882c13ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58452/0 (socket says 172.21.15.19:58452) 2024-09-12T02:04:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.966+0000 7f8830fe7640 1 -- 172.21.15.19:0/623437955 learned_addr learned my addr 172.21.15.19:0/623437955 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.966+0000 7f88317e8640 1 --2- 172.21.15.19:0/623437955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f882c06c320 0x7f882c0c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.966+0000 7f8831fe9640 1 --2- 172.21.15.19:0/623437955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f882c145bc0 0x7f882c1f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.966+0000 7f8830fe7640 1 -- 172.21.15.19:0/623437955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f882c145bc0 msgr2=0x7f882c1f2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.966+0000 7f8830fe7640 1 --2- 172.21.15.19:0/623437955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f882c145bc0 0x7f882c1f2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.966+0000 7f8830fe7640 1 -- 172.21.15.19:0/623437955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f882c06c320 msgr2=0x7f882c0c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.966+0000 7f8830fe7640 1 --2- 172.21.15.19:0/623437955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f882c06c320 0x7f882c0c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.966+0000 7f8830fe7640 1 -- 172.21.15.19:0/623437955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c0c9500 con 0x7f882c0ae140 2024-09-12T02:04:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.966+0000 7f8831fe9640 1 --2- 172.21.15.19:0/623437955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f882c145bc0 0x7f882c1f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.967+0000 7f8830fe7640 1 --2- 172.21.15.19:0/623437955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f882c0ae140 0x7f882c13ab10 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f881c000c00 tx=0x7f881c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.967+0000 7f8821ffb640 1 -- 172.21.15.19:0/623437955 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881c037040 con 0x7f882c0ae140 2024-09-12T02:04:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.967+0000 7f8821ffb640 1 -- 172.21.15.19:0/623437955 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f881c042070 con 0x7f882c0ae140 2024-09-12T02:04:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.967+0000 7f8833a4c640 1 -- 172.21.15.19:0/623437955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f882c0c97e0 con 0x7f882c0ae140 2024-09-12T02:04:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.967+0000 7f8821ffb640 1 -- 172.21.15.19:0/623437955 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881c0309b0 con 0x7f882c0ae140 2024-09-12T02:04:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.967+0000 7f8833a4c640 1 -- 172.21.15.19:0/623437955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f882c0c9da0 con 0x7f882c0ae140 2024-09-12T02:04:27.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.968+0000 7f8833a4c640 1 -- 172.21.15.19:0/623437955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f882c15ca70 con 0x7f882c0ae140 2024-09-12T02:04:27.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.969+0000 7f8821ffb640 1 -- 172.21.15.19:0/623437955 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f881c030b50 con 0x7f882c0ae140 2024-09-12T02:04:27.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.969+0000 7f8821ffb640 1 --2- 172.21.15.19:0/623437955 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f881006be30 0x7f881006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:27.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.969+0000 7f8821ffb640 1 -- 172.21.15.19:0/623437955 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7f881c0abe10 con 0x7f882c0ae140 2024-09-12T02:04:27.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.969+0000 7f88317e8640 1 --2- 172.21.15.19:0/623437955 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f881006be30 0x7f881006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:27.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.970+0000 7f88317e8640 1 --2- 172.21.15.19:0/623437955 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f881006be30 0x7f881006e2f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f88280016e0 tx=0x7f8828009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:27.973+0000 7f8821ffb640 1 -- 172.21.15.19:0/623437955 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f881c07a160 con 0x7f882c0ae140 2024-09-12T02:04:28.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.186+0000 7f8833a4c640 1 -- 172.21.15.19:0/623437955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f882c09e9d0 con 0x7f882c0ae140 2024-09-12T02:04:28.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.187+0000 7f8821ffb640 1 -- 172.21.15.19:0/623437955 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 189 v189) ==== 95+0+5234 (secure 0 0 0) 0x7f881c079a60 con 0x7f882c0ae140 2024-09-12T02:04:28.187 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:28.187 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":189,"btime":"2024-09-12T02:04:24:739042+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8853,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3279314147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3279314147},{"type":"v1","addr":"172.21.15.19:6834","nonce":3279314147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":188}],"filesystems":[{"mdsmap":{"epoch":189,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:24.739037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7103":{"gid":7103,"name":"d","rank":0,"incarnation":186,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6837/2405422603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2405422603},{"type":"v1","addr":"172.21.15.135:6837","nonce":2405422603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7103,"qdb_cluster":[7103]},"id":6}]} 2024-09-12T02:04:28.188 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 189 2024-09-12T02:04:28.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.189+0000 7f8833a4c640 1 -- 172.21.15.19:0/623437955 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f881006be30 msgr2=0x7f881006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:28.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.189+0000 7f8833a4c640 1 --2- 172.21.15.19:0/623437955 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f881006be30 0x7f881006e2f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f88280016e0 tx=0x7f8828009040 comp rx=0 tx=0).stop 2024-09-12T02:04:28.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.189+0000 7f8833a4c640 1 -- 172.21.15.19:0/623437955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f882c0ae140 msgr2=0x7f882c13ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:28.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.189+0000 7f8833a4c640 1 --2- 172.21.15.19:0/623437955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f882c0ae140 0x7f882c13ab10 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f881c000c00 tx=0x7f881c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:04:28.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.189+0000 7f8833a4c640 1 -- 172.21.15.19:0/623437955 shutdown_connections 2024-09-12T02:04:28.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.189+0000 7f8833a4c640 1 --2- 172.21.15.19:0/623437955 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f881006be30 0x7f881006e2f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:28.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.189+0000 7f8833a4c640 1 --2- 172.21.15.19:0/623437955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f882c145bc0 0x7f882c1f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:28.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.189+0000 7f8833a4c640 1 --2- 172.21.15.19:0/623437955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f882c0ae140 0x7f882c13ab10 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:28.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.189+0000 7f8833a4c640 1 --2- 172.21.15.19:0/623437955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f882c06c320 0x7f882c0c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:28.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.189+0000 7f8833a4c640 1 -- 172.21.15.19:0/623437955 >> 172.21.15.19:0/623437955 conn(0x7f882c073490 msgr2=0x7f882c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:28.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.189+0000 7f8833a4c640 1 -- 172.21.15.19:0/623437955 shutdown_connections 2024-09-12T02:04:28.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.189+0000 7f8833a4c640 1 -- 172.21.15.19:0/623437955 wait complete. 2024-09-12T02:04:28.603 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:28.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.705+0000 7ff51aed2640 1 Processor -- start 2024-09-12T02:04:28.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.706+0000 7ff51aed2640 1 -- start start 2024-09-12T02:04:28.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.706+0000 7ff51aed2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff51415e5f0 0x7ff5140d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:28.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.706+0000 7ff51aed2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff5140d30f0 0x7ff5140b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:28.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.706+0000 7ff51aed2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5140d3690 con 0x7ff5140b64c0 2024-09-12T02:04:28.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.706+0000 7ff51aed2640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff51406d530 con 0x7ff5140d30f0 2024-09-12T02:04:28.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.706+0000 7ff51aed2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff5140d3970 con 0x7ff51415e5f0 2024-09-12T02:04:28.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.707+0000 7ff513fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff5140d30f0 0x7ff5140b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:28.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.707+0000 7ff513fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff5140d30f0 0x7ff5140b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58466/0 (socket says 172.21.15.19:58466) 2024-09-12T02:04:28.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.707+0000 7ff513fff640 1 -- 172.21.15.19:0/3741642754 learned_addr learned my addr 172.21.15.19:0/3741642754 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:28.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.707+0000 7ff518c6e640 1 --2- 172.21.15.19:0/3741642754 >> v2:172.21.15.135:3300/0 conn(0x7ff51415e5f0 0x7ff5140d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:28.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.707+0000 7ff513fff640 1 -- 172.21.15.19:0/3741642754 >> v2:172.21.15.135:3300/0 conn(0x7ff51415e5f0 msgr2=0x7ff5140d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:28.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.707+0000 7ff513fff640 1 --2- 172.21.15.19:0/3741642754 >> v2:172.21.15.135:3300/0 conn(0x7ff51415e5f0 0x7ff5140d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:28.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.707+0000 7ff513fff640 1 -- 172.21.15.19:0/3741642754 >> v1:172.21.15.135:6789/0 conn(0x7ff5140b64c0 legacy=0x7ff5140cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:28.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.707+0000 7ff513fff640 1 -- 172.21.15.19:0/3741642754 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51406cee0 con 0x7ff5140d30f0 2024-09-12T02:04:28.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.708+0000 7ff513fff640 1 --2- 172.21.15.19:0/3741642754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5140d30f0 0x7ff5140b5f80 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7ff5140d1f90 tx=0x7ff50002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb28931a7d2aabb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:28.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.708+0000 7ff5137fe640 1 -- 172.21.15.19:0/3741642754 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500037070 con 0x7ff5140d30f0 2024-09-12T02:04:28.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.708+0000 7ff5137fe640 1 -- 172.21.15.19:0/3741642754 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff500032440 con 0x7ff5140d30f0 2024-09-12T02:04:28.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.708+0000 7ff5137fe640 1 -- 172.21.15.19:0/3741642754 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500032810 con 0x7ff5140d30f0 2024-09-12T02:04:28.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.708+0000 7ff51aed2640 1 -- 172.21.15.19:0/3741642754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5140d30f0 msgr2=0x7ff5140b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:28.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.708+0000 7ff51aed2640 1 --2- 172.21.15.19:0/3741642754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5140d30f0 0x7ff5140b5f80 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7ff5140d1f90 tx=0x7ff50002a270 comp rx=0 tx=0).stop 2024-09-12T02:04:28.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.708+0000 7ff51aed2640 1 -- 172.21.15.19:0/3741642754 shutdown_connections 2024-09-12T02:04:28.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.708+0000 7ff51aed2640 1 --2- 172.21.15.19:0/3741642754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5140d30f0 0x7ff5140b5f80 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:28.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.708+0000 7ff51aed2640 1 --2- 172.21.15.19:0/3741642754 >> v2:172.21.15.135:3300/0 conn(0x7ff51415e5f0 0x7ff5140d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:28.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.708+0000 7ff51aed2640 1 -- 172.21.15.19:0/3741642754 >> 172.21.15.19:0/3741642754 conn(0x7ff51408bfc0 msgr2=0x7ff5140d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:28.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.709+0000 7ff51aed2640 1 -- 172.21.15.19:0/3741642754 shutdown_connections 2024-09-12T02:04:28.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.709+0000 7ff51aed2640 1 -- 172.21.15.19:0/3741642754 wait complete. 2024-09-12T02:04:28.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.710+0000 7ff51aed2640 1 Processor -- start 2024-09-12T02:04:28.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.710+0000 7ff51aed2640 1 -- start start 2024-09-12T02:04:28.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff51aed2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5140b64c0 0x7ff51409eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:28.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff51aed2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5140d30f0 0x7ff5140a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:28.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff51aed2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff51415e5f0 0x7ff514154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:28.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff51aed2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff5140d5310 con 0x7ff5140b64c0 2024-09-12T02:04:28.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff51aed2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff51415e9d0 con 0x7ff5140d30f0 2024-09-12T02:04:28.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff51aed2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff51406e9d0 con 0x7ff51415e5f0 2024-09-12T02:04:28.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff518c6e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5140b64c0 0x7ff51409eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:28.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff518c6e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5140b64c0 0x7ff51409eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58482/0 (socket says 172.21.15.19:58482) 2024-09-12T02:04:28.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff518c6e640 1 -- 172.21.15.19:0/3374558103 learned_addr learned my addr 172.21.15.19:0/3374558103 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:28.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff513fff640 1 --2- 172.21.15.19:0/3374558103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5140d30f0 0x7ff5140a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:28.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff51946f640 1 --2- 172.21.15.19:0/3374558103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff51415e5f0 0x7ff514154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:28.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff518c6e640 1 -- 172.21.15.19:0/3374558103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff51415e5f0 msgr2=0x7ff514154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:28.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff518c6e640 1 --2- 172.21.15.19:0/3374558103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff51415e5f0 0x7ff514154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:28.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff518c6e640 1 -- 172.21.15.19:0/3374558103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5140d30f0 msgr2=0x7ff5140a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:28.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff518c6e640 1 --2- 172.21.15.19:0/3374558103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5140d30f0 0x7ff5140a1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:28.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff518c6e640 1 -- 172.21.15.19:0/3374558103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5141f4620 con 0x7ff5140b64c0 2024-09-12T02:04:28.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff51946f640 1 --2- 172.21.15.19:0/3374558103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff51415e5f0 0x7ff514154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:28.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff518c6e640 1 --2- 172.21.15.19:0/3374558103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5140b64c0 0x7ff51409eb80 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7ff50800d620 tx=0x7ff50800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:28.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff5117fa640 1 -- 172.21.15.19:0/3374558103 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50800b620 con 0x7ff5140b64c0 2024-09-12T02:04:28.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff5117fa640 1 -- 172.21.15.19:0/3374558103 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff508019070 con 0x7ff5140b64c0 2024-09-12T02:04:28.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff51aed2640 1 -- 172.21.15.19:0/3374558103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff51409f280 con 0x7ff5140b64c0 2024-09-12T02:04:28.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.711+0000 7ff5117fa640 1 -- 172.21.15.19:0/3374558103 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50800ba00 con 0x7ff5140b64c0 2024-09-12T02:04:28.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.712+0000 7ff51aed2640 1 -- 172.21.15.19:0/3374558103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff514160490 con 0x7ff5140b64c0 2024-09-12T02:04:28.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.713+0000 7ff51aed2640 1 -- 172.21.15.19:0/3374558103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5140b5f80 con 0x7ff5140b64c0 2024-09-12T02:04:28.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.713+0000 7ff5117fa640 1 -- 172.21.15.19:0/3374558103 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff50800bba0 con 0x7ff5140b64c0 2024-09-12T02:04:28.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.714+0000 7ff5117fa640 1 --2- 172.21.15.19:0/3374558103 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff4f806be30 0x7ff4f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:28.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.714+0000 7ff5117fa640 1 -- 172.21.15.19:0/3374558103 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7ff50808b940 con 0x7ff5140b64c0 2024-09-12T02:04:28.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.714+0000 7ff513fff640 1 --2- 172.21.15.19:0/3374558103 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff4f806be30 0x7ff4f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:28.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.714+0000 7ff513fff640 1 --2- 172.21.15.19:0/3374558103 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff4f806be30 0x7ff4f806e2f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff500034000 tx=0x7ff50002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:28.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.718+0000 7ff5117fa640 1 -- 172.21.15.19:0/3374558103 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff508059b70 con 0x7ff5140b64c0 2024-09-12T02:04:28.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.928+0000 7ff51aed2640 1 -- 172.21.15.19:0/3374558103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5140d1d00 con 0x7ff5140b64c0 2024-09-12T02:04:28.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.929+0000 7ff5117fa640 1 -- 172.21.15.19:0/3374558103 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 189 v189) ==== 95+0+5234 (secure 0 0 0) 0x7ff508059470 con 0x7ff5140b64c0 2024-09-12T02:04:28.930 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:28.930 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":189,"btime":"2024-09-12T02:04:24:739042+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8853,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3279314147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3279314147},{"type":"v1","addr":"172.21.15.19:6834","nonce":3279314147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":188}],"filesystems":[{"mdsmap":{"epoch":189,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:24.739037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7103":{"gid":7103,"name":"d","rank":0,"incarnation":186,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6837/2405422603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2405422603},{"type":"v1","addr":"172.21.15.135:6837","nonce":2405422603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7103,"qdb_cluster":[7103]},"id":6}]} 2024-09-12T02:04:28.930 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 189 2024-09-12T02:04:28.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.931+0000 7ff51aed2640 1 -- 172.21.15.19:0/3374558103 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff4f806be30 msgr2=0x7ff4f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:28.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.931+0000 7ff51aed2640 1 --2- 172.21.15.19:0/3374558103 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff4f806be30 0x7ff4f806e2f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff500034000 tx=0x7ff50002e000 comp rx=0 tx=0).stop 2024-09-12T02:04:28.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.931+0000 7ff51aed2640 1 -- 172.21.15.19:0/3374558103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5140b64c0 msgr2=0x7ff51409eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:28.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.931+0000 7ff51aed2640 1 --2- 172.21.15.19:0/3374558103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5140b64c0 0x7ff51409eb80 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7ff50800d620 tx=0x7ff50800dae0 comp rx=0 tx=0).stop 2024-09-12T02:04:28.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.931+0000 7ff51aed2640 1 -- 172.21.15.19:0/3374558103 shutdown_connections 2024-09-12T02:04:28.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.931+0000 7ff51aed2640 1 --2- 172.21.15.19:0/3374558103 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff4f806be30 0x7ff4f806e2f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:28.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.931+0000 7ff51aed2640 1 --2- 172.21.15.19:0/3374558103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff51415e5f0 0x7ff514154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:28.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.931+0000 7ff51aed2640 1 --2- 172.21.15.19:0/3374558103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5140d30f0 0x7ff5140a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:28.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.931+0000 7ff51aed2640 1 --2- 172.21.15.19:0/3374558103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5140b64c0 0x7ff51409eb80 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:28.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.931+0000 7ff51aed2640 1 -- 172.21.15.19:0/3374558103 >> 172.21.15.19:0/3374558103 conn(0x7ff51408bfc0 msgr2=0x7ff5140d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:28.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.931+0000 7ff51aed2640 1 -- 172.21.15.19:0/3374558103 shutdown_connections 2024-09-12T02:04:28.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:28.931+0000 7ff51aed2640 1 -- 172.21.15.19:0/3374558103 wait complete. 2024-09-12T02:04:28.942 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 189, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:04:24.739037+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 112, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7103}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7103': {'gid': 7103, 'name': 'd', 'rank': 0, 'incarnation': 186, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.135:6837/2405422603', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 2405422603}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 2405422603}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7103, 'qdb_cluster': [7103]} 2024-09-12T02:04:28.942 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:04:28.942 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T02:04:28.983 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:04:28.983+0000 7f446ed2b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:04:29.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.046+0000 7f08b71f1640 1 Processor -- start 2024-09-12T02:04:29.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.046+0000 7f08b71f1640 1 -- start start 2024-09-12T02:04:29.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.047+0000 7f08b71f1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08b00afd70 0x7f08b0160820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.047+0000 7f08b71f1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f08b00b5f80 0x7f08b00b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.047+0000 7f08b71f1640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b00b68e0 con 0x7f08b006e7d0 2024-09-12T02:04:29.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.047+0000 7f08b71f1640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f08b0160d60 con 0x7f08b00b5f80 2024-09-12T02:04:29.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.047+0000 7f08b71f1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f08b006fdb0 con 0x7f08b00afd70 2024-09-12T02:04:29.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.047+0000 7f08affff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f08b00b5f80 0x7f08b00b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.047+0000 7f08affff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f08b00b5f80 0x7f08b00b63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58496/0 (socket says 172.21.15.19:58496) 2024-09-12T02:04:29.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.047+0000 7f08affff640 1 -- 172.21.15.19:0/1204631612 learned_addr learned my addr 172.21.15.19:0/1204631612 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:29.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.047+0000 7f08b4f8d640 1 --2- 172.21.15.19:0/1204631612 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08b00afd70 0x7f08b0160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.047+0000 7f08affff640 1 -- 172.21.15.19:0/1204631612 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08b00afd70 msgr2=0x7f08b0160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:29.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.047+0000 7f08affff640 1 --2- 172.21.15.19:0/1204631612 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08b00afd70 0x7f08b0160820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.048+0000 7f08affff640 1 -- 172.21.15.19:0/1204631612 >> v1:172.21.15.135:6789/0 conn(0x7f08b006e7d0 legacy=0x7f08b006ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.048+0000 7f08affff640 1 -- 172.21.15.19:0/1204631612 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b0070090 con 0x7f08b00b5f80 2024-09-12T02:04:29.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.048+0000 7f08affff640 1 --2- 172.21.15.19:0/1204631612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b00b5f80 0x7f08b00b63a0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009870 tx=0x7f08a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a950c5374646e1c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:29.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.049+0000 7f08af7fe640 1 -- 172.21.15.19:0/1204631612 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a4037070 con 0x7f08b00b5f80 2024-09-12T02:04:29.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.049+0000 7f08af7fe640 1 -- 172.21.15.19:0/1204631612 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a4032440 con 0x7f08b00b5f80 2024-09-12T02:04:29.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.049+0000 7f08af7fe640 1 -- 172.21.15.19:0/1204631612 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a4032810 con 0x7f08b00b5f80 2024-09-12T02:04:29.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.049+0000 7f08b71f1640 1 -- 172.21.15.19:0/1204631612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b00b5f80 msgr2=0x7f08b00b63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.049+0000 7f08b71f1640 1 --2- 172.21.15.19:0/1204631612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b00b5f80 0x7f08b00b63a0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009870 tx=0x7f08a402a270 comp rx=0 tx=0).stop 2024-09-12T02:04:29.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.049+0000 7f08b71f1640 1 -- 172.21.15.19:0/1204631612 shutdown_connections 2024-09-12T02:04:29.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.049+0000 7f08b71f1640 1 --2- 172.21.15.19:0/1204631612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b00b5f80 0x7f08b00b63a0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.049+0000 7f08b71f1640 1 --2- 172.21.15.19:0/1204631612 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08b00afd70 0x7f08b0160820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.049+0000 7f08b71f1640 1 -- 172.21.15.19:0/1204631612 >> 172.21.15.19:0/1204631612 conn(0x7f08b006bc10 msgr2=0x7f08b006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:29.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.049+0000 7f08b71f1640 1 -- 172.21.15.19:0/1204631612 shutdown_connections 2024-09-12T02:04:29.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.049+0000 7f08b71f1640 1 -- 172.21.15.19:0/1204631612 wait complete. 2024-09-12T02:04:29.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.050+0000 7f08b71f1640 1 Processor -- start 2024-09-12T02:04:29.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.050+0000 7f08b71f1640 1 -- start start 2024-09-12T02:04:29.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.051+0000 7f08b71f1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b006e7d0 0x7f08b00ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.051+0000 7f08b71f1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08b00afd70 0x7f08b01523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.051+0000 7f08b71f1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08b00b5f80 0x7f08b01528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.051+0000 7f08b71f1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f08b006fa80 con 0x7f08b006e7d0 2024-09-12T02:04:29.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.051+0000 7f08b71f1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f08b0070650 con 0x7f08b00b5f80 2024-09-12T02:04:29.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.051+0000 7f08b71f1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f08b00b0150 con 0x7f08b00afd70 2024-09-12T02:04:29.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.051+0000 7f08b4f8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b006e7d0 0x7f08b00ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.051+0000 7f08b4f8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b006e7d0 0x7f08b00ae330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58510/0 (socket says 172.21.15.19:58510) 2024-09-12T02:04:29.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.051+0000 7f08b4f8d640 1 -- 172.21.15.19:0/1574336898 learned_addr learned my addr 172.21.15.19:0/1574336898 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:29.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.051+0000 7f08affff640 1 --2- 172.21.15.19:0/1574336898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08b00afd70 0x7f08b01523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.051+0000 7f08b578e640 1 --2- 172.21.15.19:0/1574336898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08b00b5f80 0x7f08b01528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.052+0000 7f08b4f8d640 1 -- 172.21.15.19:0/1574336898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08b00afd70 msgr2=0x7f08b01523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.052+0000 7f08b4f8d640 1 --2- 172.21.15.19:0/1574336898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08b00afd70 0x7f08b01523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.052+0000 7f08b4f8d640 1 -- 172.21.15.19:0/1574336898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08b00b5f80 msgr2=0x7f08b01528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.052+0000 7f08b4f8d640 1 --2- 172.21.15.19:0/1574336898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08b00b5f80 0x7f08b01528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.052+0000 7f08b4f8d640 1 -- 172.21.15.19:0/1574336898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b01f69c0 con 0x7f08b006e7d0 2024-09-12T02:04:29.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.052+0000 7f08b4f8d640 1 --2- 172.21.15.19:0/1574336898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b006e7d0 0x7f08b00ae330 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f08a000d800 tx=0x7f08a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:29.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.052+0000 7f08ad7fa640 1 -- 172.21.15.19:0/1574336898 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a000b6c0 con 0x7f08b006e7d0 2024-09-12T02:04:29.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.052+0000 7f08ad7fa640 1 -- 172.21.15.19:0/1574336898 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a0019070 con 0x7f08b006e7d0 2024-09-12T02:04:29.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.052+0000 7f08b71f1640 1 -- 172.21.15.19:0/1574336898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b01f66e0 con 0x7f08b006e7d0 2024-09-12T02:04:29.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.052+0000 7f08ad7fa640 1 -- 172.21.15.19:0/1574336898 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a000ba80 con 0x7f08b006e7d0 2024-09-12T02:04:29.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.052+0000 7f08b71f1640 1 -- 172.21.15.19:0/1574336898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b00ab7d0 con 0x7f08b006e7d0 2024-09-12T02:04:29.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.054+0000 7f08ad7fa640 1 -- 172.21.15.19:0/1574336898 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08a000bc20 con 0x7f08b006e7d0 2024-09-12T02:04:29.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.054+0000 7f08ad7fa640 1 --2- 172.21.15.19:0/1574336898 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f089c06be30 0x7f089c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.054+0000 7f08ad7fa640 1 -- 172.21.15.19:0/1574336898 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7f08a008b9b0 con 0x7f08b006e7d0 2024-09-12T02:04:29.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.054+0000 7f08affff640 1 --2- 172.21.15.19:0/1574336898 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f089c06be30 0x7f089c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.055+0000 7f08affff640 1 --2- 172.21.15.19:0/1574336898 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f089c06be30 0x7f089c06e2f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f08a4034000 tx=0x7f08a402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:29.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.055+0000 7f08ba064740 1 Processor -- start 2024-09-12T02:04:29.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.055+0000 7f08ba064740 1 -- start start 2024-09-12T02:04:29.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.056+0000 7f08ba064740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c342c0 0x555f42c79a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.056+0000 7f08ba064740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c31a80 0x555f42c346a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.056+0000 7f08ba064740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c35a50 0x555f42c2e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.056+0000 7f08ba064740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x555f42b96520 con 0x555f42c342c0 2024-09-12T02:04:29.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.056+0000 7f08ba064740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555f42b3e3e0 con 0x555f42c35a50 2024-09-12T02:04:29.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.056+0000 7f08ba064740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x555f42b924e0 con 0x555f42c31a80 2024-09-12T02:04:29.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.056+0000 7f08b4f8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c342c0 0x555f42c79a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.056+0000 7f08b4f8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c342c0 0x555f42c79a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58526/0 (socket says 172.21.15.19:58526) 2024-09-12T02:04:29.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.056+0000 7f08b4f8d640 1 -- 172.21.15.19:0/1695784903 learned_addr learned my addr 172.21.15.19:0/1695784903 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:29.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.056+0000 7f08affff640 1 --2- 172.21.15.19:0/1695784903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c31a80 0x555f42c346a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.056+0000 7f08b578e640 1 --2- 172.21.15.19:0/1695784903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c35a50 0x555f42c2e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.056+0000 7f08b4f8d640 1 -- 172.21.15.19:0/1695784903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c31a80 msgr2=0x555f42c346a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:29.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.056+0000 7f08b4f8d640 1 --2- 172.21.15.19:0/1695784903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c31a80 0x555f42c346a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.056+0000 7f08b4f8d640 1 -- 172.21.15.19:0/1695784903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c35a50 msgr2=0x555f42c2e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:29.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.056+0000 7f08b4f8d640 1 --2- 172.21.15.19:0/1695784903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c35a50 0x555f42c2e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.056+0000 7f08b4f8d640 1 -- 172.21.15.19:0/1695784903 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f42b592f0 con 0x555f42c342c0 2024-09-12T02:04:29.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.057+0000 7f08b4f8d640 1 --2- 172.21.15.19:0/1695784903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c342c0 0x555f42c79a60 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f08a0089670 tx=0x7f08a0058f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c251fd5e205daefc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:29.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.057+0000 7f08967fc640 1 -- 172.21.15.19:0/1695784903 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a0057800 con 0x555f42c342c0 2024-09-12T02:04:29.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.057+0000 7f08967fc640 1 -- 172.21.15.19:0/1695784903 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a0055b70 con 0x555f42c342c0 2024-09-12T02:04:29.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.057+0000 7f08967fc640 1 -- 172.21.15.19:0/1695784903 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a0058b70 con 0x555f42c342c0 2024-09-12T02:04:29.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.057+0000 7f08ba064740 1 -- 172.21.15.19:0/1695784903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c342c0 msgr2=0x555f42c79a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.057+0000 7f08ba064740 1 --2- 172.21.15.19:0/1695784903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c342c0 0x555f42c79a60 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f08a0089670 tx=0x7f08a0058f90 comp rx=0 tx=0).stop 2024-09-12T02:04:29.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.057+0000 7f08ba064740 1 -- 172.21.15.19:0/1695784903 shutdown_connections 2024-09-12T02:04:29.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.057+0000 7f08ba064740 1 --2- 172.21.15.19:0/1695784903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c35a50 0x555f42c2e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.057+0000 7f08ba064740 1 --2- 172.21.15.19:0/1695784903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c31a80 0x555f42c346a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.057+0000 7f08ba064740 1 --2- 172.21.15.19:0/1695784903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c342c0 0x555f42c79a60 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.057+0000 7f08ba064740 1 -- 172.21.15.19:0/1695784903 >> 172.21.15.19:0/1695784903 conn(0x555f42c30a80 msgr2=0x555f42c78f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:29.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.057+0000 7f08ba064740 1 -- 172.21.15.19:0/1695784903 shutdown_connections 2024-09-12T02:04:29.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.057+0000 7f08ba064740 1 -- 172.21.15.19:0/1695784903 wait complete. 2024-09-12T02:04:29.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.058+0000 7f08ba064740 1 -- start start 2024-09-12T02:04:29.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.058+0000 7f08ba064740 1 Processor -- start 2024-09-12T02:04:29.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.059+0000 7f08ba064740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c342c0 0x555f42c578e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.059+0000 7f08ba064740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c35a50 0x555f42c5e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.059+0000 7f08ba064740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c56160 0x555f42c76500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.059+0000 7f08ba064740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x555f42c2ff20 con 0x555f42c56160 2024-09-12T02:04:29.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.059+0000 7f08ba064740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555f42b1f450 con 0x555f42c35a50 2024-09-12T02:04:29.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.059+0000 7f08ba064740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x555f42c7a290 con 0x555f42c342c0 2024-09-12T02:04:29.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.059+0000 7f08ba064740 10 client.0 _ll_register_callbacks cb 0x555f428a8ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:04:29.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.059+0000 7f08b578e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c56160 0x555f42c76500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.059+0000 7f08b578e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c56160 0x555f42c76500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58540/0 (socket says 172.21.15.19:58540) 2024-09-12T02:04:29.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.059+0000 7f08b578e640 1 -- 172.21.15.19:0/390668044 learned_addr learned my addr 172.21.15.19:0/390668044 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:29.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.059+0000 7f08affff640 1 --2- 172.21.15.19:0/390668044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c35a50 0x555f42c5e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.059+0000 7f08b4f8d640 1 --2- 172.21.15.19:0/390668044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c342c0 0x555f42c578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.059+0000 7f08b578e640 1 -- 172.21.15.19:0/390668044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c342c0 msgr2=0x555f42c578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:29.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.059+0000 7f08b578e640 1 --2- 172.21.15.19:0/390668044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c342c0 0x555f42c578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.059+0000 7f08b578e640 1 -- 172.21.15.19:0/390668044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c35a50 msgr2=0x555f42c5e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:29.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.059+0000 7f08b578e640 1 --2- 172.21.15.19:0/390668044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c35a50 0x555f42c5e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.059+0000 7f08b578e640 1 -- 172.21.15.19:0/390668044 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f428a92d0 con 0x555f42c56160 2024-09-12T02:04:29.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.060+0000 7f08b578e640 1 --2- 172.21.15.19:0/390668044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c56160 0x555f42c76500 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f08a8002090 tx=0x7f08a8005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99bd622959fc05bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:29.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.060+0000 7f088f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:04:29.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.060+0000 7f088f7fe640 1 -- 172.21.15.19:0/390668044 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a8006b50 con 0x555f42c56160 2024-09-12T02:04:29.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.060+0000 7f088f7fe640 1 -- 172.21.15.19:0/390668044 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7f08a8010040 con 0x555f42c56160 2024-09-12T02:04:29.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.060+0000 7f08ba064740 1 -- 172.21.15.19:0/390668044 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08a0055b70 con 0x555f42c56160 2024-09-12T02:04:29.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.060+0000 7f088f7fe640 1 -- 172.21.15.19:0/390668044 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=189) ==== 24+0+0 (secure 0 0 0) 0x7f08a8006cf0 con 0x555f42c56160 2024-09-12T02:04:29.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.060+0000 7f08ba064740 10 client.8877 fetch_fsmap learned FSMap version 189 2024-09-12T02:04:29.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.060+0000 7f08ba064740 1 -- 172.21.15.19:0/390668044 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=189,monmap=2+}) -- 0x555f429736b0 con 0x555f42c56160 2024-09-12T02:04:29.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.060+0000 7f088f7fe640 1 -- 172.21.15.19:0/390668044 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a0055b70 con 0x555f42c56160 2024-09-12T02:04:29.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.060+0000 7f088f7fe640 1 -- 172.21.15.19:0/390668044 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 189) ==== 3502+0+0 (secure 0 0 0) 0x7f08a80145e0 con 0x555f42c56160 2024-09-12T02:04:29.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.060+0000 7f08ba064740 10 client.8877 fetch_fsmap finished waiting for FSMap version 189 2024-09-12T02:04:29.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.060+0000 7f08ba064740 10 client.8877 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:04:29.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.060+0000 7f08ba064740 20 client.8877 populate_metadata read hostname 'smithi019' 2024-09-12T02:04:29.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.060+0000 7f08ba064740 1 --2- 172.21.15.19:0/390668044 >> [v2:172.21.15.135:6834/2405422603,v1:172.21.15.135:6837/2405422603] conn(0x555f42c47c60 0x555f42c5be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.060+0000 7f08ba064740 4 client.8877 mds_command: new command op to 7103 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:04:29.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.060+0000 7f08ba064740 1 -- 172.21.15.19:0/390668044 --> [v2:172.21.15.135:6834/2405422603,v1:172.21.15.135:6837/2405422603] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f42ba3c50 con 0x555f42c47c60 2024-09-12T02:04:29.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.060+0000 7f08b4f8d640 1 --2- 172.21.15.19:0/390668044 >> [v2:172.21.15.135:6834/2405422603,v1:172.21.15.135:6837/2405422603] conn(0x555f42c47c60 0x555f42c5be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.061+0000 7f08b4f8d640 1 --2- 172.21.15.19:0/390668044 >> [v2:172.21.15.135:6834/2405422603,v1:172.21.15.135:6837/2405422603] conn(0x555f42c47c60 0x555f42c5be40 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=637f3788dc329542 server_cookie=dc110a61554056e8 in_seq=0 out_seq=0 2024-09-12T02:04:29.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.061+0000 7f088f7fe640 10 client.8877 ms_handle_connect on v2:172.21.15.135:6834/2405422603 2024-09-12T02:04:29.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.062+0000 7f088f7fe640 1 -- 172.21.15.19:0/390668044 <== mds.0 v2:172.21.15.135:6834/2405422603 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f42ba3c50 con 0x555f42c47c60 2024-09-12T02:04:29.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.062+0000 7f088f7fe640 10 client.8877 handle_command_reply: tid=0 2024-09-12T02:04:29.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.062+0000 7f08ba064740 1 client.8877 shutdown 2024-09-12T02:04:29.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.062+0000 7f08ba064740 1 -- 172.21.15.19:0/390668044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c56160 msgr2=0x555f42c76500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.062+0000 7f08ba064740 1 --2- 172.21.15.19:0/390668044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c56160 0x555f42c76500 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f08a8002090 tx=0x7f08a8005420 comp rx=0 tx=0).stop 2024-09-12T02:04:29.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.062+0000 7f08ba064740 1 -- 172.21.15.19:0/390668044 shutdown_connections 2024-09-12T02:04:29.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.062+0000 7f08ba064740 1 --2- 172.21.15.19:0/390668044 >> [v2:172.21.15.135:6834/2405422603,v1:172.21.15.135:6837/2405422603] conn(0x555f42c47c60 0x555f42c5be40 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.062+0000 7f08ba064740 1 --2- 172.21.15.19:0/390668044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c56160 0x555f42c76500 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.062+0000 7f08ba064740 1 --2- 172.21.15.19:0/390668044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c35a50 0x555f42c5e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.062+0000 7f088f7fe640 0 client.8877 ms_handle_reset on v2:172.21.15.135:6834/2405422603 2024-09-12T02:04:29.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.062+0000 7f08ba064740 1 --2- 172.21.15.19:0/390668044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c342c0 0x555f42c578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.062+0000 7f08ba064740 1 -- 172.21.15.19:0/390668044 >> 172.21.15.19:0/390668044 conn(0x555f42c31a80 msgr2=0x555f42c78470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:29.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.062+0000 7f08ba064740 1 -- 172.21.15.19:0/390668044 shutdown_connections 2024-09-12T02:04:29.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.062+0000 7f08ba064740 1 -- 172.21.15.19:0/390668044 wait complete. 2024-09-12T02:04:29.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.062+0000 7f08ba064740 20 client.8877 trim_cache size 0 max 16384 2024-09-12T02:04:29.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.080+0000 7f08ba064740 1 Processor -- start 2024-09-12T02:04:29.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.080+0000 7f08ba064740 1 -- start start 2024-09-12T02:04:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08ba064740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c342c0 0x555f42c760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08ba064740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c35a50 0x555f42c76620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08ba064740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c56160 0x555f42c461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08ba064740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f08b01fede0 con 0x555f42c56160 2024-09-12T02:04:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08ba064740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f08b01fe140 con 0x555f42c35a50 2024-09-12T02:04:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08ba064740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f08b01fe790 con 0x555f42c342c0 2024-09-12T02:04:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08b578e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c56160 0x555f42c461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08b578e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c56160 0x555f42c461c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58542/0 (socket says 172.21.15.19:58542) 2024-09-12T02:04:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08b578e640 1 -- 172.21.15.19:0/3654738417 learned_addr learned my addr 172.21.15.19:0/3654738417 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08affff640 1 --2- 172.21.15.19:0/3654738417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c35a50 0x555f42c76620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08b578e640 1 -- 172.21.15.19:0/3654738417 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c342c0 msgr2=0x555f42c760e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08b4f8d640 1 --2- 172.21.15.19:0/3654738417 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c342c0 0x555f42c760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08b578e640 1 --2- 172.21.15.19:0/3654738417 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c342c0 0x555f42c760e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08b578e640 1 -- 172.21.15.19:0/3654738417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c35a50 msgr2=0x555f42c76620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08b578e640 1 --2- 172.21.15.19:0/3654738417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c35a50 0x555f42c76620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08b578e640 1 -- 172.21.15.19:0/3654738417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f42c30320 con 0x555f42c56160 2024-09-12T02:04:29.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08affff640 1 --2- 172.21.15.19:0/3654738417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c35a50 0x555f42c76620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:29.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08b4f8d640 1 --2- 172.21.15.19:0/3654738417 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c342c0 0x555f42c760e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:29.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f08b578e640 1 --2- 172.21.15.19:0/3654738417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c56160 0x555f42c461c0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f08a8001220 tx=0x7f08a800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c46ae47979df9f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:29.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.081+0000 7f0895ffb640 1 -- 172.21.15.19:0/3654738417 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a8014c30 con 0x555f42c56160 2024-09-12T02:04:29.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.082+0000 7f0895ffb640 1 -- 172.21.15.19:0/3654738417 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a80145e0 con 0x555f42c56160 2024-09-12T02:04:29.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.082+0000 7f0895ffb640 1 -- 172.21.15.19:0/3654738417 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a80156b0 con 0x555f42c56160 2024-09-12T02:04:29.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.082+0000 7f08ba064740 1 -- 172.21.15.19:0/3654738417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c56160 msgr2=0x555f42c461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.082+0000 7f08ba064740 1 --2- 172.21.15.19:0/3654738417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c56160 0x555f42c461c0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f08a8001220 tx=0x7f08a800f000 comp rx=0 tx=0).stop 2024-09-12T02:04:29.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.082+0000 7f08ba064740 1 -- 172.21.15.19:0/3654738417 shutdown_connections 2024-09-12T02:04:29.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.082+0000 7f08ba064740 1 --2- 172.21.15.19:0/3654738417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c56160 0x555f42c461c0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.082+0000 7f08ba064740 1 --2- 172.21.15.19:0/3654738417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c35a50 0x555f42c76620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.082+0000 7f08ba064740 1 --2- 172.21.15.19:0/3654738417 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c342c0 0x555f42c760e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.082+0000 7f08ba064740 1 -- 172.21.15.19:0/3654738417 >> 172.21.15.19:0/3654738417 conn(0x555f42c31a80 msgr2=0x555f42c558f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:29.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.082+0000 7f08ba064740 1 -- 172.21.15.19:0/3654738417 shutdown_connections 2024-09-12T02:04:29.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.082+0000 7f08ba064740 1 -- 172.21.15.19:0/3654738417 wait complete. 2024-09-12T02:04:29.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.083+0000 7f08ba064740 1 -- start start 2024-09-12T02:04:29.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.083+0000 7f08ba064740 1 Processor -- start 2024-09-12T02:04:29.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f08ba064740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c342c0 0x555f42c76450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f08ba064740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c35a50 0x555f42c547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f08ba064740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c56160 0x555f42cfa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f08ba064740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x555f42c47ae0 con 0x555f42c35a50 2024-09-12T02:04:29.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f08ba064740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555f42c481d0 con 0x555f42c56160 2024-09-12T02:04:29.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f08ba064740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x555f42c2f4a0 con 0x555f42c342c0 2024-09-12T02:04:29.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f08ba064740 10 client.0 _ll_register_callbacks cb 0x7f08a8003a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:04:29.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f08affff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c35a50 0x555f42c547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f08affff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c35a50 0x555f42c547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58552/0 (socket says 172.21.15.19:58552) 2024-09-12T02:04:29.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f08affff640 1 -- 172.21.15.19:0/3970771860 learned_addr learned my addr 172.21.15.19:0/3970771860 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:29.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f08b578e640 1 --2- 172.21.15.19:0/3970771860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c56160 0x555f42cfa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f08b4f8d640 1 --2- 172.21.15.19:0/3970771860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c342c0 0x555f42c76450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f08affff640 1 -- 172.21.15.19:0/3970771860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c342c0 msgr2=0x555f42c76450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:29.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f08affff640 1 --2- 172.21.15.19:0/3970771860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c342c0 0x555f42c76450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f08affff640 1 -- 172.21.15.19:0/3970771860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c56160 msgr2=0x555f42cfa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:29.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f08affff640 1 --2- 172.21.15.19:0/3970771860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c56160 0x555f42cfa1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f08affff640 1 -- 172.21.15.19:0/3970771860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f42cf6c00 con 0x555f42c35a50 2024-09-12T02:04:29.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f08affff640 1 --2- 172.21.15.19:0/3970771860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c35a50 0x555f42c547b0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f08a4035040 tx=0x7f08a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c61c39c9b9a815 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:29.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f088f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:04:29.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.084+0000 7f088f7fe640 1 -- 172.21.15.19:0/3970771860 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a4037040 con 0x555f42c35a50 2024-09-12T02:04:29.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.085+0000 7f088f7fe640 1 -- 172.21.15.19:0/3970771860 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7f08a403c910 con 0x555f42c35a50 2024-09-12T02:04:29.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.085+0000 7f08ba064740 1 -- 172.21.15.19:0/3970771860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08a80145e0 con 0x555f42c35a50 2024-09-12T02:04:29.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.085+0000 7f088f7fe640 1 -- 172.21.15.19:0/3970771860 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=189) ==== 24+0+0 (secure 0 0 0) 0x7f08a403cb10 con 0x555f42c35a50 2024-09-12T02:04:29.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.085+0000 7f08ba064740 10 client.8883 fetch_fsmap learned FSMap version 189 2024-09-12T02:04:29.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.085+0000 7f08ba064740 1 -- 172.21.15.19:0/3970771860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=189,monmap=2+}) -- 0x555f42c2ea00 con 0x555f42c35a50 2024-09-12T02:04:29.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.085+0000 7f088f7fe640 1 -- 172.21.15.19:0/3970771860 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a80145e0 con 0x555f42c35a50 2024-09-12T02:04:29.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.085+0000 7f088f7fe640 1 -- 172.21.15.19:0/3970771860 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 189) ==== 3502+0+0 (secure 0 0 0) 0x7f08a403ccb0 con 0x555f42c35a50 2024-09-12T02:04:29.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.085+0000 7f08ba064740 10 client.8883 fetch_fsmap finished waiting for FSMap version 189 2024-09-12T02:04:29.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.085+0000 7f08ba064740 10 client.8883 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:04:29.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.085+0000 7f08ba064740 20 client.8883 populate_metadata read hostname 'smithi019' 2024-09-12T02:04:29.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.085+0000 7f08ba064740 1 --2- 172.21.15.19:0/3970771860 >> [v2:172.21.15.135:6834/2405422603,v1:172.21.15.135:6837/2405422603] conn(0x555f42c8b450 0x555f42cdf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.085+0000 7f08ba064740 4 client.8883 mds_command: new command op to 7103 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:04:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.085+0000 7f08ba064740 1 -- 172.21.15.19:0/3970771860 --> [v2:172.21.15.135:6834/2405422603,v1:172.21.15.135:6837/2405422603] -- command(tid 0: {"prefix": "status"}) -- 0x555f42b9dfa0 con 0x555f42c8b450 2024-09-12T02:04:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.085+0000 7f08b4f8d640 1 --2- 172.21.15.19:0/3970771860 >> [v2:172.21.15.135:6834/2405422603,v1:172.21.15.135:6837/2405422603] conn(0x555f42c8b450 0x555f42cdf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.086+0000 7f08b4f8d640 1 --2- 172.21.15.19:0/3970771860 >> [v2:172.21.15.135:6834/2405422603,v1:172.21.15.135:6837/2405422603] conn(0x555f42c8b450 0x555f42cdf5d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=960f8194cfcd198a server_cookie=9bf3951539b5843a in_seq=0 out_seq=0 2024-09-12T02:04:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.086+0000 7f088f7fe640 10 client.8883 ms_handle_connect on v2:172.21.15.135:6834/2405422603 2024-09-12T02:04:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.086+0000 7f088f7fe640 1 -- 172.21.15.19:0/3970771860 <== mds.0 v2:172.21.15.135:6834/2405422603 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x555f42b9dfa0 con 0x555f42c8b450 2024-09-12T02:04:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.086+0000 7f088f7fe640 10 client.8883 handle_command_reply: tid=0 2024-09-12T02:04:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.086+0000 7f08ba064740 1 client.8883 shutdown 2024-09-12T02:04:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.086+0000 7f08ba064740 1 -- 172.21.15.19:0/3970771860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c35a50 msgr2=0x555f42c547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.086+0000 7f08ba064740 1 --2- 172.21.15.19:0/3970771860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c35a50 0x555f42c547b0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f08a4035040 tx=0x7f08a4004730 comp rx=0 tx=0).stop 2024-09-12T02:04:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.086+0000 7f08ba064740 1 -- 172.21.15.19:0/3970771860 shutdown_connections 2024-09-12T02:04:29.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.086+0000 7f08ba064740 1 --2- 172.21.15.19:0/3970771860 >> [v2:172.21.15.135:6834/2405422603,v1:172.21.15.135:6837/2405422603] conn(0x555f42c8b450 0x555f42cdf5d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.086+0000 7f08ba064740 1 --2- 172.21.15.19:0/3970771860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f42c56160 0x555f42cfa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.086+0000 7f088f7fe640 0 client.8883 ms_handle_reset on v2:172.21.15.135:6834/2405422603 2024-09-12T02:04:29.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.086+0000 7f08ba064740 1 --2- 172.21.15.19:0/3970771860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555f42c35a50 0x555f42c547b0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.086+0000 7f08ba064740 1 --2- 172.21.15.19:0/3970771860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555f42c342c0 0x555f42c76450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.086+0000 7f08ba064740 1 -- 172.21.15.19:0/3970771860 >> 172.21.15.19:0/3970771860 conn(0x555f42c31a80 msgr2=0x555f42c5b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:29.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.086+0000 7f08ba064740 1 -- 172.21.15.19:0/3970771860 shutdown_connections 2024-09-12T02:04:29.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.086+0000 7f08ba064740 1 -- 172.21.15.19:0/3970771860 wait complete. 2024-09-12T02:04:29.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.086+0000 7f08ba064740 20 client.8883 trim_cache size 0 max 16384 2024-09-12T02:04:29.095 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:04:29.095 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T02:04:29.095 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T02:04:29.095 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 7103, 2024-09-12T02:04:29.095 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T02:04:29.095 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T02:04:29.095 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T02:04:29.095 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 7.3505953210000001, 2024-09-12T02:04:29.095 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 189, 2024-09-12T02:04:29.095 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 112, 2024-09-12T02:04:29.095 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 112, 2024-09-12T02:04:29.095 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 10.369643537 2024-09-12T02:04:29.096 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:04:29.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.087+0000 7f08b71f1640 1 -- 172.21.15.19:0/1574336898 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f089c06be30 msgr2=0x7f089c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.087+0000 7f08b71f1640 1 --2- 172.21.15.19:0/1574336898 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f089c06be30 0x7f089c06e2f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f08a4034000 tx=0x7f08a402e000 comp rx=0 tx=0).stop 2024-09-12T02:04:29.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.087+0000 7f08b71f1640 1 -- 172.21.15.19:0/1574336898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b006e7d0 msgr2=0x7f08b00ae330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.087+0000 7f08b71f1640 1 --2- 172.21.15.19:0/1574336898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b006e7d0 0x7f08b00ae330 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f08a000d800 tx=0x7f08a000dcc0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.087+0000 7f08b71f1640 1 -- 172.21.15.19:0/1574336898 shutdown_connections 2024-09-12T02:04:29.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.087+0000 7f08b71f1640 1 --2- 172.21.15.19:0/1574336898 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f089c06be30 0x7f089c06e2f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.087+0000 7f08b71f1640 1 --2- 172.21.15.19:0/1574336898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08b00b5f80 0x7f08b01528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.087+0000 7f08b71f1640 1 --2- 172.21.15.19:0/1574336898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08b00afd70 0x7f08b01523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.087+0000 7f08b71f1640 1 --2- 172.21.15.19:0/1574336898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b006e7d0 0x7f08b00ae330 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.087+0000 7f08b71f1640 1 -- 172.21.15.19:0/1574336898 >> 172.21.15.19:0/1574336898 conn(0x7f08b006bc10 msgr2=0x7f08b015e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:29.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.087+0000 7f08b71f1640 1 -- 172.21.15.19:0/1574336898 shutdown_connections 2024-09-12T02:04:29.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.087+0000 7f08b71f1640 1 -- 172.21.15.19:0/1574336898 wait complete. 2024-09-12T02:04:29.098 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:04:29.098 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:29.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.200+0000 7f6f6b1bd640 1 Processor -- start 2024-09-12T02:04:29.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.200+0000 7f6f6b1bd640 1 -- start start 2024-09-12T02:04:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.201+0000 7f6f6b1bd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6f64161c80 0x7f6f6406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.201+0000 7f6f6b1bd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f640b6680 0x7f6f640cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.201+0000 7f6f6b1bd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6406e870 con 0x7f6f64162060 2024-09-12T02:04:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.201+0000 7f6f6b1bd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f6f6406d9f0 con 0x7f6f64161c80 2024-09-12T02:04:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.201+0000 7f6f6b1bd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6406dcd0 con 0x7f6f640b6680 2024-09-12T02:04:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.201+0000 7f6f68f59640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6f64161c80 0x7f6f6406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.201+0000 7f6f68f59640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6f64161c80 0x7f6f6406e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58564/0 (socket says 172.21.15.19:58564) 2024-09-12T02:04:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.201+0000 7f6f68f59640 1 -- 172.21.15.19:0/2576047117 learned_addr learned my addr 172.21.15.19:0/2576047117 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.202+0000 7f6f6975a640 1 --2- 172.21.15.19:0/2576047117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f640b6680 0x7f6f640cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.202+0000 7f6f68f59640 1 -- 172.21.15.19:0/2576047117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f640b6680 msgr2=0x7f6f640cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.202+0000 7f6f68f59640 1 --2- 172.21.15.19:0/2576047117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f640b6680 0x7f6f640cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.202+0000 7f6f68f59640 1 -- 172.21.15.19:0/2576047117 >> v1:172.21.15.135:6789/0 conn(0x7f6f64162060 legacy=0x7f6f640b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.202+0000 7f6f68f59640 1 -- 172.21.15.19:0/2576047117 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6406dfb0 con 0x7f6f64161c80 2024-09-12T02:04:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.202+0000 7f6f6975a640 1 --2- 172.21.15.19:0/2576047117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f640b6680 0x7f6f640cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.202+0000 7f6f68f59640 1 --2- 172.21.15.19:0/2576047117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f64161c80 0x7f6f6406e330 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009870 tx=0x7f6f5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d926f7de361df10d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.203+0000 7f6f637fe640 1 -- 172.21.15.19:0/2576047117 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f58037070 con 0x7f6f64161c80 2024-09-12T02:04:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.203+0000 7f6f637fe640 1 -- 172.21.15.19:0/2576047117 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f58032440 con 0x7f6f64161c80 2024-09-12T02:04:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.203+0000 7f6f637fe640 1 -- 172.21.15.19:0/2576047117 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f58032810 con 0x7f6f64161c80 2024-09-12T02:04:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.203+0000 7f6f6b1bd640 1 -- 172.21.15.19:0/2576047117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f64161c80 msgr2=0x7f6f6406e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.203+0000 7f6f6b1bd640 1 --2- 172.21.15.19:0/2576047117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f64161c80 0x7f6f6406e330 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009870 tx=0x7f6f5802a270 comp rx=0 tx=0).stop 2024-09-12T02:04:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.203+0000 7f6f6b1bd640 1 -- 172.21.15.19:0/2576047117 shutdown_connections 2024-09-12T02:04:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.203+0000 7f6f6b1bd640 1 --2- 172.21.15.19:0/2576047117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f640b6680 0x7f6f640cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.203+0000 7f6f6b1bd640 1 --2- 172.21.15.19:0/2576047117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f64161c80 0x7f6f6406e330 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.203+0000 7f6f6b1bd640 1 -- 172.21.15.19:0/2576047117 >> 172.21.15.19:0/2576047117 conn(0x7f6f640d44f0 msgr2=0x7f6f640d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.203+0000 7f6f6b1bd640 1 -- 172.21.15.19:0/2576047117 shutdown_connections 2024-09-12T02:04:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.203+0000 7f6f6b1bd640 1 -- 172.21.15.19:0/2576047117 wait complete. 2024-09-12T02:04:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.204+0000 7f6f6b1bd640 1 Processor -- start 2024-09-12T02:04:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.204+0000 7f6f6b1bd640 1 -- start start 2024-09-12T02:04:29.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.205+0000 7f6f6b1bd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f640b6680 0x7f6f641f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.205+0000 7f6f6b1bd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f64161c80 0x7f6f640cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.205+0000 7f6f6b1bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f64162060 0x7f6f640cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.205+0000 7f6f6b1bd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6f640b6cb0 con 0x7f6f64162060 2024-09-12T02:04:29.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.205+0000 7f6f6b1bd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f640b6b30 con 0x7f6f640b6680 2024-09-12T02:04:29.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.205+0000 7f6f6b1bd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6f640cf720 con 0x7f6f64161c80 2024-09-12T02:04:29.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.205+0000 7f6f6975a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f64162060 0x7f6f640cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.205+0000 7f6f6975a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f64162060 0x7f6f640cbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58580/0 (socket says 172.21.15.19:58580) 2024-09-12T02:04:29.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.205+0000 7f6f6975a640 1 -- 172.21.15.19:0/2688428229 learned_addr learned my addr 172.21.15.19:0/2688428229 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:29.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.205+0000 7f6f68f59640 1 --2- 172.21.15.19:0/2688428229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f640b6680 0x7f6f641f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.205+0000 7f6f63fff640 1 --2- 172.21.15.19:0/2688428229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f64161c80 0x7f6f640cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.206+0000 7f6f6975a640 1 -- 172.21.15.19:0/2688428229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f64161c80 msgr2=0x7f6f640cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.206+0000 7f6f6975a640 1 --2- 172.21.15.19:0/2688428229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f64161c80 0x7f6f640cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.206+0000 7f6f6975a640 1 -- 172.21.15.19:0/2688428229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f640b6680 msgr2=0x7f6f641f3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.206+0000 7f6f6975a640 1 --2- 172.21.15.19:0/2688428229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f640b6680 0x7f6f641f3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.206+0000 7f6f6975a640 1 -- 172.21.15.19:0/2688428229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f641f4050 con 0x7f6f64162060 2024-09-12T02:04:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.206+0000 7f6f6975a640 1 --2- 172.21.15.19:0/2688428229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f64162060 0x7f6f640cbb00 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00cf20 tx=0x7f6f5c00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.206+0000 7f6f617fa640 1 -- 172.21.15.19:0/2688428229 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c01a070 con 0x7f6f64162060 2024-09-12T02:04:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.206+0000 7f6f617fa640 1 -- 172.21.15.19:0/2688428229 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5c00d840 con 0x7f6f64162060 2024-09-12T02:04:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.206+0000 7f6f6b1bd640 1 -- 172.21.15.19:0/2688428229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f640ce540 con 0x7f6f64162060 2024-09-12T02:04:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.206+0000 7f6f617fa640 1 -- 172.21.15.19:0/2688428229 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c00dc30 con 0x7f6f64162060 2024-09-12T02:04:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.206+0000 7f6f6b1bd640 1 -- 172.21.15.19:0/2688428229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f640b2560 con 0x7f6f64162060 2024-09-12T02:04:29.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.207+0000 7f6f6b1bd640 1 -- 172.21.15.19:0/2688428229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f640ba470 con 0x7f6f64162060 2024-09-12T02:04:29.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.208+0000 7f6f617fa640 1 -- 172.21.15.19:0/2688428229 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f5c01d070 con 0x7f6f64162060 2024-09-12T02:04:29.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.208+0000 7f6f617fa640 1 --2- 172.21.15.19:0/2688428229 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6f4806be30 0x7f6f4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.208+0000 7f6f617fa640 1 -- 172.21.15.19:0/2688428229 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7f6f5c08be30 con 0x7f6f64162060 2024-09-12T02:04:29.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.208+0000 7f6f68f59640 1 --2- 172.21.15.19:0/2688428229 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6f4806be30 0x7f6f4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.209+0000 7f6f68f59640 1 --2- 172.21.15.19:0/2688428229 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6f4806be30 0x7f6f4806e2f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6f58034000 tx=0x7f6f5802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:29.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.213+0000 7f6f617fa640 1 -- 172.21.15.19:0/2688428229 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f5c059980 con 0x7f6f64162060 2024-09-12T02:04:29.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.425+0000 7f6f6b1bd640 1 -- 172.21.15.19:0/2688428229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f64160a70 con 0x7f6f64162060 2024-09-12T02:04:29.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.426+0000 7f6f617fa640 1 -- 172.21.15.19:0/2688428229 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 189 v189) ==== 95+0+5234 (secure 0 0 0) 0x7f6f5c05dc80 con 0x7f6f64162060 2024-09-12T02:04:29.426 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:29.426 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":189,"btime":"2024-09-12T02:04:24:739042+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8853,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3279314147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3279314147},{"type":"v1","addr":"172.21.15.19:6834","nonce":3279314147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":188}],"filesystems":[{"mdsmap":{"epoch":189,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:24.739037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7103":{"gid":7103,"name":"d","rank":0,"incarnation":186,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6837/2405422603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2405422603},{"type":"v1","addr":"172.21.15.135:6837","nonce":2405422603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7103,"qdb_cluster":[7103]},"id":6}]} 2024-09-12T02:04:29.427 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 189 2024-09-12T02:04:29.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.428+0000 7f6f6b1bd640 1 -- 172.21.15.19:0/2688428229 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6f4806be30 msgr2=0x7f6f4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.428+0000 7f6f6b1bd640 1 --2- 172.21.15.19:0/2688428229 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6f4806be30 0x7f6f4806e2f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6f58034000 tx=0x7f6f5802e000 comp rx=0 tx=0).stop 2024-09-12T02:04:29.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.428+0000 7f6f6b1bd640 1 -- 172.21.15.19:0/2688428229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f64162060 msgr2=0x7f6f640cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.428+0000 7f6f6b1bd640 1 --2- 172.21.15.19:0/2688428229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f64162060 0x7f6f640cbb00 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00cf20 tx=0x7f6f5c00a7d0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.428+0000 7f6f6b1bd640 1 -- 172.21.15.19:0/2688428229 shutdown_connections 2024-09-12T02:04:29.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.428+0000 7f6f6b1bd640 1 --2- 172.21.15.19:0/2688428229 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6f4806be30 0x7f6f4806e2f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.428+0000 7f6f6b1bd640 1 --2- 172.21.15.19:0/2688428229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f64162060 0x7f6f640cbb00 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.428+0000 7f6f6b1bd640 1 --2- 172.21.15.19:0/2688428229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f64161c80 0x7f6f640cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.428+0000 7f6f6b1bd640 1 --2- 172.21.15.19:0/2688428229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f640b6680 0x7f6f641f3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.428+0000 7f6f6b1bd640 1 -- 172.21.15.19:0/2688428229 >> 172.21.15.19:0/2688428229 conn(0x7f6f640d44f0 msgr2=0x7f6f640b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:29.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.428+0000 7f6f6b1bd640 1 -- 172.21.15.19:0/2688428229 shutdown_connections 2024-09-12T02:04:29.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.428+0000 7f6f6b1bd640 1 -- 172.21.15.19:0/2688428229 wait complete. 2024-09-12T02:04:29.440 INFO:tasks.cephfs.test_damage:Mutation 'Corrupt 500.00000000' did not prevent MDS startup, attempting ls... 2024-09-12T02:04:29.440 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:04:29.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.541+0000 7fca08378640 1 Processor -- start 2024-09-12T02:04:29.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.542+0000 7fca08378640 1 -- start start 2024-09-12T02:04:29.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.542+0000 7fca08378640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fca00162060 0x7fca000b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.542+0000 7fca08378640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fca000b64b0 0x7fca000b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.542+0000 7fca08378640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca0006d9f0 con 0x7fca00161c80 2024-09-12T02:04:29.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.542+0000 7fca08378640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fca0006dcd0 con 0x7fca000b64b0 2024-09-12T02:04:29.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.542+0000 7fca08378640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fca0006dfb0 con 0x7fca00162060 2024-09-12T02:04:29.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.543+0000 7fca06114640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fca00161c80 0x7fca0006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43128/0 (socket says 172.21.15.19:43128) 2024-09-12T02:04:29.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.543+0000 7fca06114640 1 -- 172.21.15.19:0/3133640517 learned_addr learned my addr 172.21.15.19:0/3133640517 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:29.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.543+0000 7fca06915640 1 --2- 172.21.15.19:0/3133640517 >> v2:172.21.15.19:3300/0 conn(0x7fca000b64b0 0x7fca000b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.543+0000 7fca05913640 1 --2- 172.21.15.19:0/3133640517 >> v2:172.21.15.135:3300/0 conn(0x7fca00162060 0x7fca000b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.543+0000 7fca06915640 1 -- 172.21.15.19:0/3133640517 >> v2:172.21.15.135:3300/0 conn(0x7fca00162060 msgr2=0x7fca000b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:29.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.543+0000 7fca06915640 1 --2- 172.21.15.19:0/3133640517 >> v2:172.21.15.135:3300/0 conn(0x7fca00162060 0x7fca000b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.543+0000 7fca06915640 1 -- 172.21.15.19:0/3133640517 >> v1:172.21.15.19:6789/0 conn(0x7fca00161c80 legacy=0x7fca0006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.543+0000 7fca06915640 1 -- 172.21.15.19:0/3133640517 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca000d01f0 con 0x7fca000b64b0 2024-09-12T02:04:29.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.543+0000 7fca05112640 1 -- 172.21.15.19:0/3133640517 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2181062440 0 0) 0x7fca0006d9f0 con 0x7fca00161c80 2024-09-12T02:04:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.544+0000 7fca06915640 1 --2- 172.21.15.19:0/3133640517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca000b64b0 0x7fca000b6960 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fca0008e830 tx=0x7fc9f002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e01277663b3568 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.544+0000 7fca05112640 1 -- 172.21.15.19:0/3133640517 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0007740 con 0x7fca000b64b0 2024-09-12T02:04:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.544+0000 7fca05112640 1 -- 172.21.15.19:0/3133640517 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f00078e0 con 0x7fca000b64b0 2024-09-12T02:04:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.544+0000 7fca05112640 1 -- 172.21.15.19:0/3133640517 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0007cb0 con 0x7fca000b64b0 2024-09-12T02:04:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.544+0000 7fca08378640 1 -- 172.21.15.19:0/3133640517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca000b64b0 msgr2=0x7fca000b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.544+0000 7fca08378640 1 --2- 172.21.15.19:0/3133640517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca000b64b0 0x7fca000b6960 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fca0008e830 tx=0x7fc9f002a680 comp rx=0 tx=0).stop 2024-09-12T02:04:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.544+0000 7fca08378640 1 -- 172.21.15.19:0/3133640517 shutdown_connections 2024-09-12T02:04:29.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.544+0000 7fca08378640 1 --2- 172.21.15.19:0/3133640517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca000b64b0 0x7fca000b6960 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.544+0000 7fca08378640 1 --2- 172.21.15.19:0/3133640517 >> v2:172.21.15.135:3300/0 conn(0x7fca00162060 0x7fca000b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.544+0000 7fca08378640 1 -- 172.21.15.19:0/3133640517 >> 172.21.15.19:0/3133640517 conn(0x7fca000d44f0 msgr2=0x7fca000d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:29.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.545+0000 7fca08378640 1 -- 172.21.15.19:0/3133640517 shutdown_connections 2024-09-12T02:04:29.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.545+0000 7fca08378640 1 -- 172.21.15.19:0/3133640517 wait complete. 2024-09-12T02:04:29.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.546+0000 7fca08378640 1 Processor -- start 2024-09-12T02:04:29.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.546+0000 7fca08378640 1 -- start start 2024-09-12T02:04:29.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.546+0000 7fca08378640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca000b64b0 0x7fca000cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.546+0000 7fca08378640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca00161c80 0x7fca00159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.546+0000 7fca08378640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca00162060 0x7fca000b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.546+0000 7fca08378640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fca000cf1e0 con 0x7fca00161c80 2024-09-12T02:04:29.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.546+0000 7fca08378640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca000d2aa0 con 0x7fca00162060 2024-09-12T02:04:29.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.547+0000 7fca08378640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fca000cf360 con 0x7fca000b64b0 2024-09-12T02:04:29.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.547+0000 7fca05913640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca00161c80 0x7fca00159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.547+0000 7fca05913640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca00161c80 0x7fca00159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58596/0 (socket says 172.21.15.19:58596) 2024-09-12T02:04:29.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.547+0000 7fca05913640 1 -- 172.21.15.19:0/2104501455 learned_addr learned my addr 172.21.15.19:0/2104501455 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:29.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.547+0000 7fca06915640 1 --2- 172.21.15.19:0/2104501455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca00162060 0x7fca000b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.547+0000 7fca06114640 1 --2- 172.21.15.19:0/2104501455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca000b64b0 0x7fca000cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.547+0000 7fca05913640 1 -- 172.21.15.19:0/2104501455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca000b64b0 msgr2=0x7fca000cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.547+0000 7fca05913640 1 --2- 172.21.15.19:0/2104501455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca000b64b0 0x7fca000cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.547+0000 7fca05913640 1 -- 172.21.15.19:0/2104501455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca00162060 msgr2=0x7fca000b7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.547+0000 7fca05913640 1 --2- 172.21.15.19:0/2104501455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca00162060 0x7fca000b7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.547+0000 7fca05913640 1 -- 172.21.15.19:0/2104501455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca000cb5c0 con 0x7fca00161c80 2024-09-12T02:04:29.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.547+0000 7fca06915640 1 --2- 172.21.15.19:0/2104501455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca00162060 0x7fca000b7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:29.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.547+0000 7fca05913640 1 --2- 172.21.15.19:0/2104501455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca00161c80 0x7fca00159a70 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400d5c0 tx=0x7fc9f400da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:29.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.547+0000 7fc9feffd640 1 -- 172.21.15.19:0/2104501455 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f40125f0 con 0x7fca00161c80 2024-09-12T02:04:29.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.547+0000 7fc9feffd640 1 -- 172.21.15.19:0/2104501455 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f4019070 con 0x7fca00161c80 2024-09-12T02:04:29.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.547+0000 7fca08378640 1 -- 172.21.15.19:0/2104501455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca000cb8a0 con 0x7fca00161c80 2024-09-12T02:04:29.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.547+0000 7fc9feffd640 1 -- 172.21.15.19:0/2104501455 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f40129d0 con 0x7fca00161c80 2024-09-12T02:04:29.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.547+0000 7fca08378640 1 -- 172.21.15.19:0/2104501455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca000cbe60 con 0x7fca00161c80 2024-09-12T02:04:29.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.548+0000 7fca08378640 1 -- 172.21.15.19:0/2104501455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca000b5f70 con 0x7fca00161c80 2024-09-12T02:04:29.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.549+0000 7fc9feffd640 1 -- 172.21.15.19:0/2104501455 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc9f4012b70 con 0x7fca00161c80 2024-09-12T02:04:29.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.549+0000 7fc9feffd640 1 --2- 172.21.15.19:0/2104501455 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc9ec06be80 0x7fc9ec06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.549+0000 7fc9feffd640 1 -- 172.21.15.19:0/2104501455 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7fc9f408b9e0 con 0x7fca00161c80 2024-09-12T02:04:29.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.550+0000 7fca06114640 1 --2- 172.21.15.19:0/2104501455 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc9ec06be80 0x7fc9ec06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.550+0000 7fca06114640 1 --2- 172.21.15.19:0/2104501455 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc9ec06be80 0x7fc9ec06e340 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8007fd0 tx=0x7fc9f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:29.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.554+0000 7fc9feffd640 1 -- 172.21.15.19:0/2104501455 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc9f4059bf0 con 0x7fca00161c80 2024-09-12T02:04:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.764+0000 7fca08378640 1 -- 172.21.15.19:0/2104501455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fca000ba470 con 0x7fca00161c80 2024-09-12T02:04:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.765+0000 7fc9feffd640 1 -- 172.21.15.19:0/2104501455 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v189) ==== 53+0+73 (secure 0 0 0) 0x7fc9f40594f0 con 0x7fca00161c80 2024-09-12T02:04:29.766 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:04:29.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.767+0000 7fca08378640 1 -- 172.21.15.19:0/2104501455 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc9ec06be80 msgr2=0x7fc9ec06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.767+0000 7fca08378640 1 --2- 172.21.15.19:0/2104501455 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc9ec06be80 0x7fc9ec06e340 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8007fd0 tx=0x7fc9f8009040 comp rx=0 tx=0).stop 2024-09-12T02:04:29.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.767+0000 7fca08378640 1 -- 172.21.15.19:0/2104501455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca00161c80 msgr2=0x7fca00159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.767+0000 7fca08378640 1 --2- 172.21.15.19:0/2104501455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca00161c80 0x7fca00159a70 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400d5c0 tx=0x7fc9f400da80 comp rx=0 tx=0).stop 2024-09-12T02:04:29.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.767+0000 7fca08378640 1 -- 172.21.15.19:0/2104501455 shutdown_connections 2024-09-12T02:04:29.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.767+0000 7fca08378640 1 --2- 172.21.15.19:0/2104501455 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc9ec06be80 0x7fc9ec06e340 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.767+0000 7fca08378640 1 --2- 172.21.15.19:0/2104501455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca00162060 0x7fca000b7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.767+0000 7fca08378640 1 --2- 172.21.15.19:0/2104501455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca00161c80 0x7fca00159a70 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.767+0000 7fca08378640 1 --2- 172.21.15.19:0/2104501455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca000b64b0 0x7fca000cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.767+0000 7fca08378640 1 -- 172.21.15.19:0/2104501455 >> 172.21.15.19:0/2104501455 conn(0x7fca000d44f0 msgr2=0x7fca000746d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:29.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.767+0000 7fca08378640 1 -- 172.21.15.19:0/2104501455 shutdown_connections 2024-09-12T02:04:29.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:29.767+0000 7fca08378640 1 -- 172.21.15.19:0/2104501455 wait complete. 2024-09-12T02:04:29.778 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:04:29.778 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:04:29.778 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T02:04:29.778 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:04:29.778 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:04:29.778 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:04:29.778 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:04:29.778 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:04:29.779 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:04:29.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:29.779 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T02:04:29.795 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:04:29.795 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:04:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:04:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:04:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T02:04:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:04:29.796 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:04:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:04:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T02:04:29.796 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:04:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:04:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T02:04:29.796 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:04:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:04:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T02:04:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:04:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42291sec preferred_lft 42291sec 2024-09-12T02:04:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T02:04:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:04:29.797 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:04:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:04:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T02:04:29.797 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:04:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T02:04:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:04:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:04:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T02:04:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:04:29.797 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:04:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:04:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T02:04:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:04:29.798 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:04:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:04:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T02:04:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:04:29.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:29.798 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:04:29.860 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T02:04:29.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:29.862 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T02:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T02:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:04:29.919 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:04:29.919 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T02:04:29.919 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:04:29.919 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:04:29.920 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:04:29.920 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T02:04:30.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:04:30.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:04:30.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:30.049 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T02:04:30.064 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:04:30.064 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:04:30.065 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:04:30.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:30.065 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T02:04:30.130 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:04:30.130 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:04:30.186 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:04:30.186 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:04:30.186 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:04:30.241 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:04:30.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:30.242 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:04:30.326 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:04:30.327 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:04:30.327 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:04:30.336 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:04:30.336 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:04:30.336 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:04:30.336 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:04:30.336 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:04:30.342 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:04:30.342 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:04:30.342 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:04:30.342 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:04:30.342 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:04:30.342 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T02:04:30.342 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T02:04:30.342 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T02:04:30.343 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:04:30.343 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:04:30.343 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:04:30.343 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:04:30.343 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:04:30.344 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:04:30.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:30.345 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:04:30.416 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:04:30.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:04:30.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:04:30.515 INFO:teuthology.orchestra.run.smithi019.stdout:client7966 2024-09-12T02:04:30.515 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:04:30.515 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:04:30.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:30.532 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2024-09-12T02:04:30.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:30.574 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir foo) 2024-09-12T02:04:30.591 INFO:teuthology.orchestra.run.smithi019.stdout:.: 2024-09-12T02:04:30.591 INFO:teuthology.orchestra.run.smithi019.stdout:subdir 2024-09-12T02:04:30.591 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:30.591 INFO:teuthology.orchestra.run.smithi019.stdout:./subdir: 2024-09-12T02:04:30.591 INFO:teuthology.orchestra.run.smithi019.stdout:sixmegs 2024-09-12T02:04:30.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:04:30.606 INFO:teuthology.orchestra.run.smithi019.stderr:mkdir: cannot create directory ‘foo’: Read-only file system 2024-09-12T02:04:30.606 INFO:tasks.cephfs.test_damage:mkdir: cannot create directory ‘foo’: Read-only file system 2024-09-12T02:04:30.606 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt mds_snaptable' 2024-09-12T02:04:30.606 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:04:30.606 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:04:30.662 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:04:30.662 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:04:30.718 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:04:30.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.861+0000 7fb35c1c4640 1 Processor -- start 2024-09-12T02:04:30.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.861+0000 7fb35c1c4640 1 -- start start 2024-09-12T02:04:30.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.862+0000 7fb35c1c4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb35406f8d0 0x7fb354165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:30.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.862+0000 7fb35c1c4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3540cdbe0 con 0x7fb35415b300 2024-09-12T02:04:30.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.862+0000 7fb35c1c4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3540cd900 con 0x7fb354072d30 2024-09-12T02:04:30.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.862+0000 7fb35c1c4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb3540728a0 con 0x7fb35406f8d0 2024-09-12T02:04:30.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.862+0000 7fb359f60640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb35415b300 0x7fb3540cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43138/0 (socket says 172.21.15.19:43138) 2024-09-12T02:04:30.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.862+0000 7fb359f60640 1 -- 172.21.15.19:0/2647754285 learned_addr learned my addr 172.21.15.19:0/2647754285 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:30.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.862+0000 7fb35a761640 1 --2- 172.21.15.19:0/2647754285 >> v2:172.21.15.19:3300/0 conn(0x7fb35406f8d0 0x7fb354165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:30.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.863+0000 7fb35a761640 1 -- 172.21.15.19:0/2647754285 >> v1:172.21.15.135:6789/0 conn(0x7fb354072d30 legacy=0x7fb35406f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:30.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.863+0000 7fb35a761640 1 -- 172.21.15.19:0/2647754285 >> v1:172.21.15.19:6789/0 conn(0x7fb35415b300 legacy=0x7fb3540cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:30.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.863+0000 7fb35a761640 1 -- 172.21.15.19:0/2647754285 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb354072250 con 0x7fb35406f8d0 2024-09-12T02:04:30.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.863+0000 7fb35a761640 1 --2- 172.21.15.19:0/2647754285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb35406f8d0 0x7fb354165de0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fb344009d90 tx=0x7fb34402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2dab112fc13a51 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:30.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.864+0000 7fb358f5e640 1 -- 172.21.15.19:0/2647754285 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb344007740 con 0x7fb35406f8d0 2024-09-12T02:04:30.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.864+0000 7fb358f5e640 1 -- 172.21.15.19:0/2647754285 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3440078e0 con 0x7fb35406f8d0 2024-09-12T02:04:30.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.864+0000 7fb358f5e640 1 -- 172.21.15.19:0/2647754285 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb344007cb0 con 0x7fb35406f8d0 2024-09-12T02:04:30.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.864+0000 7fb35c1c4640 1 -- 172.21.15.19:0/2647754285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb35406f8d0 msgr2=0x7fb354165de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:30.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.864+0000 7fb35c1c4640 1 --2- 172.21.15.19:0/2647754285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb35406f8d0 0x7fb354165de0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fb344009d90 tx=0x7fb34402a660 comp rx=0 tx=0).stop 2024-09-12T02:04:30.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.864+0000 7fb35c1c4640 1 -- 172.21.15.19:0/2647754285 shutdown_connections 2024-09-12T02:04:30.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.864+0000 7fb35c1c4640 1 --2- 172.21.15.19:0/2647754285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb35406f8d0 0x7fb354165de0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:30.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.864+0000 7fb35c1c4640 1 -- 172.21.15.19:0/2647754285 >> 172.21.15.19:0/2647754285 conn(0x7fb354067d70 msgr2=0x7fb35406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:30.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.864+0000 7fb35c1c4640 1 -- 172.21.15.19:0/2647754285 shutdown_connections 2024-09-12T02:04:30.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.864+0000 7fb35c1c4640 1 -- 172.21.15.19:0/2647754285 wait complete. 2024-09-12T02:04:30.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.865+0000 7fb35c1c4640 1 Processor -- start 2024-09-12T02:04:30.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.866+0000 7fb35c1c4640 1 -- start start 2024-09-12T02:04:30.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.866+0000 7fb35c1c4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb35406f8d0 0x7fb3541463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:30.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.866+0000 7fb35c1c4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb354072d30 0x7fb3540af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:30.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.866+0000 7fb35c1c4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb35415b300 0x7fb3540b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:30.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.866+0000 7fb35c1c4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb3540cffe0 con 0x7fb354072d30 2024-09-12T02:04:30.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.866+0000 7fb35c1c4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb3540cd5c0 con 0x7fb35406f8d0 2024-09-12T02:04:30.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.866+0000 7fb35c1c4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb3540d0160 con 0x7fb35415b300 2024-09-12T02:04:30.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.866+0000 7fb35975f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb354072d30 0x7fb3540af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:30.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.866+0000 7fb35975f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb354072d30 0x7fb3540af8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58608/0 (socket says 172.21.15.19:58608) 2024-09-12T02:04:30.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.866+0000 7fb35975f640 1 -- 172.21.15.19:0/2789680673 learned_addr learned my addr 172.21.15.19:0/2789680673 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.867+0000 7fb359f60640 1 --2- 172.21.15.19:0/2789680673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb35406f8d0 0x7fb3541463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.867+0000 7fb35a761640 1 --2- 172.21.15.19:0/2789680673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb35415b300 0x7fb3540b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.867+0000 7fb35975f640 1 -- 172.21.15.19:0/2789680673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb35415b300 msgr2=0x7fb3540b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.867+0000 7fb35975f640 1 --2- 172.21.15.19:0/2789680673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb35415b300 0x7fb3540b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.867+0000 7fb35975f640 1 -- 172.21.15.19:0/2789680673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb35406f8d0 msgr2=0x7fb3541463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.867+0000 7fb35975f640 1 --2- 172.21.15.19:0/2789680673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb35406f8d0 0x7fb3541463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.867+0000 7fb35975f640 1 -- 172.21.15.19:0/2789680673 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb354148420 con 0x7fb354072d30 2024-09-12T02:04:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.867+0000 7fb35975f640 1 --2- 172.21.15.19:0/2789680673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb354072d30 0x7fb3540af8d0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fb34800c400 tx=0x7fb34800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.867+0000 7fb3527fc640 1 -- 172.21.15.19:0/2789680673 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3480052d0 con 0x7fb354072d30 2024-09-12T02:04:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.867+0000 7fb3527fc640 1 -- 172.21.15.19:0/2789680673 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb348005490 con 0x7fb354072d30 2024-09-12T02:04:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.867+0000 7fb35c1c4640 1 -- 172.21.15.19:0/2789680673 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3541486d0 con 0x7fb354072d30 2024-09-12T02:04:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.867+0000 7fb3527fc640 1 -- 172.21.15.19:0/2789680673 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb348007260 con 0x7fb354072d30 2024-09-12T02:04:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.867+0000 7fb35c1c4640 1 -- 172.21.15.19:0/2789680673 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb354148c90 con 0x7fb354072d30 2024-09-12T02:04:30.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.868+0000 7fb35c1c4640 1 -- 172.21.15.19:0/2789680673 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb35406f1c0 con 0x7fb354072d30 2024-09-12T02:04:30.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.869+0000 7fb3527fc640 1 -- 172.21.15.19:0/2789680673 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb348007400 con 0x7fb354072d30 2024-09-12T02:04:30.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.869+0000 7fb3527fc640 1 --2- 172.21.15.19:0/2789680673 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb34006be30 0x7fb34006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:30.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.869+0000 7fb3527fc640 1 -- 172.21.15.19:0/2789680673 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7fb34808abf0 con 0x7fb354072d30 2024-09-12T02:04:30.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.870+0000 7fb359f60640 1 --2- 172.21.15.19:0/2789680673 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb34006be30 0x7fb34006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:30.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.870+0000 7fb359f60640 1 --2- 172.21.15.19:0/2789680673 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb34006be30 0x7fb34006e2f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fb34c005880 tx=0x7fb34c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:30.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:30.873+0000 7fb3527fc640 1 -- 172.21.15.19:0/2789680673 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb3480586a0 con 0x7fb354072d30 2024-09-12T02:04:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.059+0000 7fb35c1c4640 1 -- 172.21.15.19:0/2789680673 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb3540cd230 con 0x7fb354072d30 2024-09-12T02:04:31.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.060+0000 7fb3527fc640 1 -- 172.21.15.19:0/2789680673 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 36 entries v112) ==== 81+0+2198 (secure 0 0 0) 0x7fb34805c9a0 con 0x7fb354072d30 2024-09-12T02:04:31.060 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/961161264 2024-09-13T02:04:17.973298+0000 2024-09-12T02:04:31.060 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/926329492 2024-09-13T02:04:13.937157+0000 2024-09-12T02:04:31.060 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/926329492 2024-09-13T02:04:13.937157+0000 2024-09-12T02:04:31.061 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/4107165769 2024-09-13T02:04:03.869164+0000 2024-09-12T02:04:31.061 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3136344951 2024-09-13T02:02:58.521234+0000 2024-09-12T02:04:31.061 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/1101861733 2024-09-13T02:02:54.487980+0000 2024-09-12T02:04:31.061 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/650556594 2024-09-13T02:02:50.470816+0000 2024-09-12T02:04:31.061 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/4287312235 2024-09-13T02:03:11.277301+0000 2024-09-12T02:04:31.061 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/650556594 2024-09-13T02:02:50.470816+0000 2024-09-12T02:04:31.061 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/613869354 2024-09-13T02:02:39.104650+0000 2024-09-12T02:04:31.061 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3136344951 2024-09-13T02:02:58.521234+0000 2024-09-12T02:04:31.061 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/4107165769 2024-09-13T02:04:03.869164+0000 2024-09-12T02:04:31.061 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/613869354 2024-09-13T02:02:39.104650+0000 2024-09-12T02:04:31.061 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3985859189 2024-09-13T02:04:09.906953+0000 2024-09-12T02:04:31.061 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/2072535494 2024-09-13T02:02:44.440900+0000 2024-09-12T02:04:31.061 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/4124612835 2024-09-13T02:03:35.697598+0000 2024-09-12T02:04:31.062 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/1800650480 2024-09-13T02:03:56.737366+0000 2024-09-12T02:04:31.062 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:04:31.062 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/961161264 2024-09-13T02:04:17.973298+0000 2024-09-12T02:04:31.062 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/4287312235 2024-09-13T02:03:11.277301+0000 2024-09-12T02:04:31.062 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/46689513 2024-09-13T02:03:28.654366+0000 2024-09-12T02:04:31.062 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:04:31.062 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3866905323 2024-09-13T02:03:54.557384+0000 2024-09-12T02:04:31.062 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3995150987 2024-09-13T02:03:22.315702+0000 2024-09-12T02:04:31.062 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3995150987 2024-09-13T02:03:22.315702+0000 2024-09-12T02:04:31.062 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3985859189 2024-09-13T02:04:09.906953+0000 2024-09-12T02:04:31.062 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3598057058 2024-09-13T02:03:24.636971+0000 2024-09-12T02:04:31.062 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/46689513 2024-09-13T02:03:28.654366+0000 2024-09-12T02:04:31.063 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3598057058 2024-09-13T02:03:24.636971+0000 2024-09-12T02:04:31.063 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/1101861733 2024-09-13T02:02:54.487980+0000 2024-09-12T02:04:31.063 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/4124612835 2024-09-13T02:03:35.697598+0000 2024-09-12T02:04:31.063 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/1875416968 2024-09-13T02:03:41.731211+0000 2024-09-12T02:04:31.063 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/1875416968 2024-09-13T02:03:41.731211+0000 2024-09-12T02:04:31.063 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/2072535494 2024-09-13T02:02:44.440900+0000 2024-09-12T02:04:31.063 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3866905323 2024-09-13T02:03:54.557384+0000 2024-09-12T02:04:31.063 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/1800650480 2024-09-13T02:03:56.737366+0000 2024-09-12T02:04:31.064 INFO:teuthology.orchestra.run.smithi019.stderr:listed 36 entries 2024-09-12T02:04:31.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.061+0000 7fb35c1c4640 1 -- 172.21.15.19:0/2789680673 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb34006be30 msgr2=0x7fb34006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:31.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.061+0000 7fb35c1c4640 1 --2- 172.21.15.19:0/2789680673 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb34006be30 0x7fb34006e2f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fb34c005880 tx=0x7fb34c009040 comp rx=0 tx=0).stop 2024-09-12T02:04:31.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.062+0000 7fb35c1c4640 1 -- 172.21.15.19:0/2789680673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb354072d30 msgr2=0x7fb3540af8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:31.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.062+0000 7fb35c1c4640 1 --2- 172.21.15.19:0/2789680673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb354072d30 0x7fb3540af8d0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fb34800c400 tx=0x7fb34800c8c0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.062+0000 7fb35c1c4640 1 -- 172.21.15.19:0/2789680673 shutdown_connections 2024-09-12T02:04:31.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.062+0000 7fb35c1c4640 1 --2- 172.21.15.19:0/2789680673 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb34006be30 0x7fb34006e2f0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.062+0000 7fb35c1c4640 1 --2- 172.21.15.19:0/2789680673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb35415b300 0x7fb3540b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.062+0000 7fb35c1c4640 1 --2- 172.21.15.19:0/2789680673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb354072d30 0x7fb3540af8d0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.062+0000 7fb35c1c4640 1 --2- 172.21.15.19:0/2789680673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb35406f8d0 0x7fb3541463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.062+0000 7fb35c1c4640 1 -- 172.21.15.19:0/2789680673 >> 172.21.15.19:0/2789680673 conn(0x7fb354067d70 msgr2=0x7fb354152760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:31.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.062+0000 7fb35c1c4640 1 -- 172.21.15.19:0/2789680673 shutdown_connections 2024-09-12T02:04:31.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.062+0000 7fb35c1c4640 1 -- 172.21.15.19:0/2789680673 wait complete. 2024-09-12T02:04:31.073 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:04:31.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:31.073 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-12T02:04:31.115 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:04:31.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:31.116 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:04:31.172 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:04:31.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.317+0000 7f5ddea06640 1 Processor -- start 2024-09-12T02:04:31.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.317+0000 7f5ddea06640 1 -- start start 2024-09-12T02:04:31.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.317+0000 7f5ddea06640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dd8162060 0x7f5dd80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:31.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.317+0000 7f5ddea06640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5dd80b64b0 0x7f5dd80b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:31.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.317+0000 7f5ddea06640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd806d9f0 con 0x7f5dd8161c80 2024-09-12T02:04:31.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.318+0000 7f5ddea06640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f5dd806dcd0 con 0x7f5dd80b64b0 2024-09-12T02:04:31.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.318+0000 7f5ddea06640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd806dfb0 con 0x7f5dd8162060 2024-09-12T02:04:31.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.318+0000 7f5dd7fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5dd8161c80 0x7f5dd806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41330/0 (socket says 172.21.15.19:41330) 2024-09-12T02:04:31.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.318+0000 7f5dd7fff640 1 -- 172.21.15.19:0/3263584001 learned_addr learned my addr 172.21.15.19:0/3263584001 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:31.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.318+0000 7f5ddcfa3640 1 --2- 172.21.15.19:0/3263584001 >> v2:172.21.15.135:3300/0 conn(0x7f5dd80b64b0 0x7f5dd80b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:31.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.318+0000 7f5dcffff640 1 --2- 172.21.15.19:0/3263584001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dd8162060 0x7f5dd80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:31.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.318+0000 7f5dd77fe640 1 -- 172.21.15.19:0/3263584001 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1620259176 0 0) 0x7f5dd806d9f0 con 0x7f5dd8161c80 2024-09-12T02:04:31.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.318+0000 7f5dd77fe640 1 -- 172.21.15.19:0/3263584001 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dc4003520 con 0x7f5dd8161c80 2024-09-12T02:04:31.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.318+0000 7f5ddcfa3640 1 -- 172.21.15.19:0/3263584001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dd8162060 msgr2=0x7f5dd80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:31.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.318+0000 7f5ddcfa3640 1 --2- 172.21.15.19:0/3263584001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dd8162060 0x7f5dd80b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.318+0000 7f5ddcfa3640 1 -- 172.21.15.19:0/3263584001 >> v1:172.21.15.19:6789/0 conn(0x7f5dd8161c80 legacy=0x7f5dd806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:31.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.318+0000 7f5ddcfa3640 1 -- 172.21.15.19:0/3263584001 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd80d01f0 con 0x7f5dd80b64b0 2024-09-12T02:04:31.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.318+0000 7f5dcffff640 1 --2- 172.21.15.19:0/3263584001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dd8162060 0x7f5dd80b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:31.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.319+0000 7f5ddcfa3640 1 --2- 172.21.15.19:0/3263584001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd80b64b0 0x7f5dd80b6960 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009d90 tx=0x7f5dd002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ca6b7cb78409f24 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:31.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.319+0000 7f5dd77fe640 1 -- 172.21.15.19:0/3263584001 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0007740 con 0x7f5dd80b64b0 2024-09-12T02:04:31.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.319+0000 7f5dd77fe640 1 -- 172.21.15.19:0/3263584001 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd00078e0 con 0x7f5dd80b64b0 2024-09-12T02:04:31.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.319+0000 7f5dd77fe640 1 -- 172.21.15.19:0/3263584001 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0007c90 con 0x7f5dd80b64b0 2024-09-12T02:04:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.320+0000 7f5ddea06640 1 -- 172.21.15.19:0/3263584001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd80b64b0 msgr2=0x7f5dd80b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.320+0000 7f5ddea06640 1 --2- 172.21.15.19:0/3263584001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd80b64b0 0x7f5dd80b6960 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009d90 tx=0x7f5dd002a660 comp rx=0 tx=0).stop 2024-09-12T02:04:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.320+0000 7f5ddea06640 1 -- 172.21.15.19:0/3263584001 shutdown_connections 2024-09-12T02:04:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.320+0000 7f5ddea06640 1 --2- 172.21.15.19:0/3263584001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd80b64b0 0x7f5dd80b6960 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.320+0000 7f5ddea06640 1 --2- 172.21.15.19:0/3263584001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dd8162060 0x7f5dd80b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.320+0000 7f5ddea06640 1 -- 172.21.15.19:0/3263584001 >> 172.21.15.19:0/3263584001 conn(0x7f5dd80d44f0 msgr2=0x7f5dd80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.320+0000 7f5ddea06640 1 -- 172.21.15.19:0/3263584001 shutdown_connections 2024-09-12T02:04:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.320+0000 7f5ddea06640 1 -- 172.21.15.19:0/3263584001 wait complete. 2024-09-12T02:04:31.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.321+0000 7f5ddea06640 1 Processor -- start 2024-09-12T02:04:31.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.321+0000 7f5ddea06640 1 -- start start 2024-09-12T02:04:31.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.322+0000 7f5ddea06640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dd80b64b0 0x7f5dd80cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:31.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.322+0000 7f5ddea06640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd8161c80 0x7f5dd8159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:31.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.322+0000 7f5ddea06640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dd8162060 0x7f5dd80c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:31.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.322+0000 7f5ddea06640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd80cf1e0 con 0x7f5dd80b64b0 2024-09-12T02:04:31.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.322+0000 7f5ddea06640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd80d2aa0 con 0x7f5dd8161c80 2024-09-12T02:04:31.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.322+0000 7f5ddea06640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd80cf360 con 0x7f5dd8162060 2024-09-12T02:04:31.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.322+0000 7f5dd7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dd80b64b0 0x7f5dd80cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:31.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.322+0000 7f5dd7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dd80b64b0 0x7f5dd80cc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43770/0 (socket says 172.21.15.19:43770) 2024-09-12T02:04:31.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.322+0000 7f5dd7fff640 1 -- 172.21.15.19:0/3319909754 learned_addr learned my addr 172.21.15.19:0/3319909754 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:31.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.322+0000 7f5dcffff640 1 --2- 172.21.15.19:0/3319909754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd8161c80 0x7f5dd8159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:31.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.322+0000 7f5ddcfa3640 1 --2- 172.21.15.19:0/3319909754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dd8162060 0x7f5dd80c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:31.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.322+0000 7f5dd7fff640 1 -- 172.21.15.19:0/3319909754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dd8162060 msgr2=0x7f5dd80c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:31.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.322+0000 7f5dd7fff640 1 --2- 172.21.15.19:0/3319909754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dd8162060 0x7f5dd80c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.322+0000 7f5dd7fff640 1 -- 172.21.15.19:0/3319909754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd8161c80 msgr2=0x7f5dd8159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:31.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.322+0000 7f5dd7fff640 1 --2- 172.21.15.19:0/3319909754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd8161c80 0x7f5dd8159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.322+0000 7f5dd7fff640 1 -- 172.21.15.19:0/3319909754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd80ca9e0 con 0x7f5dd80b64b0 2024-09-12T02:04:31.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.322+0000 7f5dcffff640 1 --2- 172.21.15.19:0/3319909754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd8161c80 0x7f5dd8159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:31.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.322+0000 7f5dd7fff640 1 --2- 172.21.15.19:0/3319909754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dd80b64b0 0x7f5dd80cc7a0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800c460 tx=0x7f5dc800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:31.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.323+0000 7f5dd57fa640 1 -- 172.21.15.19:0/3319909754 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8017070 con 0x7f5dd80b64b0 2024-09-12T02:04:31.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.323+0000 7f5dd57fa640 1 -- 172.21.15.19:0/3319909754 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc8005ce0 con 0x7f5dd80b64b0 2024-09-12T02:04:31.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.323+0000 7f5ddea06640 1 -- 172.21.15.19:0/3319909754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd80c9940 con 0x7f5dd80b64b0 2024-09-12T02:04:31.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.323+0000 7f5dd57fa640 1 -- 172.21.15.19:0/3319909754 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8007290 con 0x7f5dd80b64b0 2024-09-12T02:04:31.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.323+0000 7f5ddea06640 1 -- 172.21.15.19:0/3319909754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd80c9f00 con 0x7f5dd80b64b0 2024-09-12T02:04:31.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.324+0000 7f5ddea06640 1 -- 172.21.15.19:0/3319909754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd80b5f70 con 0x7f5dd80b64b0 2024-09-12T02:04:31.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.324+0000 7f5dd57fa640 1 -- 172.21.15.19:0/3319909754 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5dc801a070 con 0x7f5dd80b64b0 2024-09-12T02:04:31.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.325+0000 7f5dd57fa640 1 --2- 172.21.15.19:0/3319909754 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5db806be60 0x7f5db806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:31.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.325+0000 7f5dd57fa640 1 -- 172.21.15.19:0/3319909754 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7765+0+0 (secure 0 0 0) 0x7f5dc808aa10 con 0x7f5dd80b64b0 2024-09-12T02:04:31.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.325+0000 7f5dcffff640 1 --2- 172.21.15.19:0/3319909754 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5db806be60 0x7f5db806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:31.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.325+0000 7f5dcffff640 1 --2- 172.21.15.19:0/3319909754 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5db806be60 0x7f5db806e320 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8075720 tx=0x7f5dc0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:31.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.329+0000 7f5dd57fa640 1 -- 172.21.15.19:0/3319909754 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5dc8058b30 con 0x7f5dd80b64b0 2024-09-12T02:04:31.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.540+0000 7f5ddea06640 1 -- 172.21.15.19:0/3319909754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5dd80ba470 con 0x7f5dd80b64b0 2024-09-12T02:04:31.541 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:31.541+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:04:31.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.542+0000 7f5dd57fa640 1 -- 172.21.15.19:0/3319909754 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v190) ==== 161+0+0 (secure 0 0 0) 0x7f5dc8058430 con 0x7f5dd80b64b0 2024-09-12T02:04:31.543 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:04:31.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.545+0000 7f5ddea06640 1 -- 172.21.15.19:0/3319909754 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5db806be60 msgr2=0x7f5db806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:31.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.545+0000 7f5ddea06640 1 --2- 172.21.15.19:0/3319909754 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5db806be60 0x7f5db806e320 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8075720 tx=0x7f5dc0008040 comp rx=0 tx=0).stop 2024-09-12T02:04:31.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.545+0000 7f5ddea06640 1 -- 172.21.15.19:0/3319909754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dd80b64b0 msgr2=0x7f5dd80cc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.546+0000 7f5ddea06640 1 --2- 172.21.15.19:0/3319909754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dd80b64b0 0x7f5dd80cc7a0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800c460 tx=0x7f5dc800c920 comp rx=0 tx=0).stop 2024-09-12T02:04:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.546+0000 7f5ddea06640 1 -- 172.21.15.19:0/3319909754 shutdown_connections 2024-09-12T02:04:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.546+0000 7f5ddea06640 1 --2- 172.21.15.19:0/3319909754 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5db806be60 0x7f5db806e320 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.546+0000 7f5ddea06640 1 --2- 172.21.15.19:0/3319909754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dd8162060 0x7f5dd80c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.546+0000 7f5ddea06640 1 --2- 172.21.15.19:0/3319909754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd8161c80 0x7f5dd8159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.546+0000 7f5ddea06640 1 --2- 172.21.15.19:0/3319909754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dd80b64b0 0x7f5dd80cc7a0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.546+0000 7f5ddea06640 1 -- 172.21.15.19:0/3319909754 >> 172.21.15.19:0/3319909754 conn(0x7f5dd80d44f0 msgr2=0x7f5dd80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.546+0000 7f5ddea06640 1 -- 172.21.15.19:0/3319909754 shutdown_connections 2024-09-12T02:04:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.546+0000 7f5ddea06640 1 -- 172.21.15.19:0/3319909754 wait complete. 2024-09-12T02:04:31.549 INFO:tasks.ceph.mds.d.smithi135.stderr: -1762> 2024-09-12T02:04:21.739+0000 7f446bd25640 -1 mds.0.purge_queue operator(): Error -22 loading Journaler 2024-09-12T02:04:31.549 INFO:tasks.ceph.mds.d.smithi135.stderr: -1759> 2024-09-12T02:04:21.739+0000 7f446bd25640 -1 mds.0.186 unhandled write error (22) Invalid argument, force readonly... 2024-09-12T02:04:31.550 INFO:tasks.ceph.mds.d.smithi135.stderr: -567> 2024-09-12T02:04:28.983+0000 7f446ed2b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:04:31.557 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:04:31.578 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T02:04:31.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.660+0000 7f9b4c711640 1 Processor -- start 2024-09-12T02:04:31.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.660+0000 7f9b4c711640 1 -- start start 2024-09-12T02:04:31.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.661+0000 7f9b4c711640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9b44162060 0x7f9b440b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:31.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.661+0000 7f9b4c711640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9b440b64b0 0x7f9b440b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:31.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.661+0000 7f9b4c711640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4406d9f0 con 0x7f9b44161c80 2024-09-12T02:04:31.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.661+0000 7f9b4c711640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f9b4406dcd0 con 0x7f9b440b64b0 2024-09-12T02:04:31.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.661+0000 7f9b4c711640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f9b4406dfb0 con 0x7f9b44162060 2024-09-12T02:04:31.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.662+0000 7f9b4acae640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9b440b64b0 0x7f9b440b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:31.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.662+0000 7f9b4a4ad640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9b44161c80 0x7f9b4406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41332/0 (socket says 172.21.15.19:41332) 2024-09-12T02:04:31.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.662+0000 7f9b4a4ad640 1 -- 172.21.15.19:0/1251826013 learned_addr learned my addr 172.21.15.19:0/1251826013 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:31.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.662+0000 7f9b49cac640 1 --2- 172.21.15.19:0/1251826013 >> v2:172.21.15.135:3300/0 conn(0x7f9b44162060 0x7f9b440b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:31.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.662+0000 7f9b4acae640 1 -- 172.21.15.19:0/1251826013 >> v2:172.21.15.135:3300/0 conn(0x7f9b44162060 msgr2=0x7f9b440b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:31.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.662+0000 7f9b4acae640 1 --2- 172.21.15.19:0/1251826013 >> v2:172.21.15.135:3300/0 conn(0x7f9b44162060 0x7f9b440b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.662+0000 7f9b4acae640 1 -- 172.21.15.19:0/1251826013 >> v1:172.21.15.19:6789/0 conn(0x7f9b44161c80 legacy=0x7f9b4406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:31.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.662+0000 7f9b4acae640 1 -- 172.21.15.19:0/1251826013 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b440d01f0 con 0x7f9b440b64b0 2024-09-12T02:04:31.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.663+0000 7f9b4acae640 1 --2- 172.21.15.19:0/1251826013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b440b64b0 0x7f9b440b6960 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f9b4408e830 tx=0x7f9b3c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a311f6a1547a557 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:31.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.663+0000 7f9b494ab640 1 -- 172.21.15.19:0/1251826013 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c037070 con 0x7f9b440b64b0 2024-09-12T02:04:31.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.663+0000 7f9b494ab640 1 -- 172.21.15.19:0/1251826013 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b3c032440 con 0x7f9b440b64b0 2024-09-12T02:04:31.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.663+0000 7f9b494ab640 1 -- 172.21.15.19:0/1251826013 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c032810 con 0x7f9b440b64b0 2024-09-12T02:04:31.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.663+0000 7f9b4c711640 1 -- 172.21.15.19:0/1251826013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b440b64b0 msgr2=0x7f9b440b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:31.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.663+0000 7f9b4c711640 1 --2- 172.21.15.19:0/1251826013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b440b64b0 0x7f9b440b6960 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f9b4408e830 tx=0x7f9b3c02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.663+0000 7f9b4c711640 1 -- 172.21.15.19:0/1251826013 shutdown_connections 2024-09-12T02:04:31.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.663+0000 7f9b4c711640 1 --2- 172.21.15.19:0/1251826013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b440b64b0 0x7f9b440b6960 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.663+0000 7f9b4c711640 1 --2- 172.21.15.19:0/1251826013 >> v2:172.21.15.135:3300/0 conn(0x7f9b44162060 0x7f9b440b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.663+0000 7f9b4c711640 1 -- 172.21.15.19:0/1251826013 >> 172.21.15.19:0/1251826013 conn(0x7f9b440d44f0 msgr2=0x7f9b440d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:31.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.663+0000 7f9b4c711640 1 -- 172.21.15.19:0/1251826013 shutdown_connections 2024-09-12T02:04:31.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.663+0000 7f9b4c711640 1 -- 172.21.15.19:0/1251826013 wait complete. 2024-09-12T02:04:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.665+0000 7f9b4c711640 1 Processor -- start 2024-09-12T02:04:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.665+0000 7f9b4c711640 1 -- start start 2024-09-12T02:04:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.665+0000 7f9b4c711640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b440b64b0 0x7f9b440b7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.665+0000 7f9b4c711640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b44161c80 0x7f9b4415ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.665+0000 7f9b4c711640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b44162060 0x7f9b4415ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.665+0000 7f9b4c711640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9b440cf1e0 con 0x7f9b44161c80 2024-09-12T02:04:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.665+0000 7f9b4c711640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9b440d2aa0 con 0x7f9b440b64b0 2024-09-12T02:04:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.665+0000 7f9b4c711640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9b440cf360 con 0x7f9b44162060 2024-09-12T02:04:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.666+0000 7f9b49cac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b44161c80 0x7f9b4415ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.666+0000 7f9b49cac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b44161c80 0x7f9b4415ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43782/0 (socket says 172.21.15.19:43782) 2024-09-12T02:04:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.666+0000 7f9b49cac640 1 -- 172.21.15.19:0/2902016894 learned_addr learned my addr 172.21.15.19:0/2902016894 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.666+0000 7f9b4a4ad640 1 --2- 172.21.15.19:0/2902016894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b440b64b0 0x7f9b440b7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.666+0000 7f9b4acae640 1 --2- 172.21.15.19:0/2902016894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b44162060 0x7f9b4415ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.666+0000 7f9b49cac640 1 -- 172.21.15.19:0/2902016894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b44162060 msgr2=0x7f9b4415ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.666+0000 7f9b49cac640 1 --2- 172.21.15.19:0/2902016894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b44162060 0x7f9b4415ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.666+0000 7f9b49cac640 1 -- 172.21.15.19:0/2902016894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b440b64b0 msgr2=0x7f9b440b7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.666+0000 7f9b49cac640 1 --2- 172.21.15.19:0/2902016894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b440b64b0 0x7f9b440b7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.666+0000 7f9b49cac640 1 -- 172.21.15.19:0/2902016894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b440b87a0 con 0x7f9b44161c80 2024-09-12T02:04:31.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.666+0000 7f9b4a4ad640 1 --2- 172.21.15.19:0/2902016894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b440b64b0 0x7f9b440b7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:31.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.666+0000 7f9b49cac640 1 --2- 172.21.15.19:0/2902016894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b44161c80 0x7f9b4415ea20 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f9b3800e840 tx=0x7f9b3800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:31.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.666+0000 7f9b42ffd640 1 -- 172.21.15.19:0/2902016894 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b38017070 con 0x7f9b44161c80 2024-09-12T02:04:31.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.666+0000 7f9b42ffd640 1 -- 172.21.15.19:0/2902016894 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b3800c940 con 0x7f9b44161c80 2024-09-12T02:04:31.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.666+0000 7f9b4c711640 1 -- 172.21.15.19:0/2902016894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b440b8a80 con 0x7f9b44161c80 2024-09-12T02:04:31.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.666+0000 7f9b42ffd640 1 -- 172.21.15.19:0/2902016894 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3800cd10 con 0x7f9b44161c80 2024-09-12T02:04:31.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.666+0000 7f9b4c711640 1 -- 172.21.15.19:0/2902016894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b440b9040 con 0x7f9b44161c80 2024-09-12T02:04:31.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.667+0000 7f9b4c711640 1 -- 172.21.15.19:0/2902016894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b440b5f70 con 0x7f9b44161c80 2024-09-12T02:04:31.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.668+0000 7f9b42ffd640 1 -- 172.21.15.19:0/2902016894 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b3801a070 con 0x7f9b44161c80 2024-09-12T02:04:31.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.668+0000 7f9b42ffd640 1 --2- 172.21.15.19:0/2902016894 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9b3006be30 0x7f9b3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:31.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.669+0000 7f9b42ffd640 1 -- 172.21.15.19:0/2902016894 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 7851+0+0 (secure 0 0 0) 0x7f9b3808b810 con 0x7f9b44161c80 2024-09-12T02:04:31.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.669+0000 7f9b4a4ad640 1 --2- 172.21.15.19:0/2902016894 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9b3006be30 0x7f9b3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:31.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.669+0000 7f9b4a4ad640 1 --2- 172.21.15.19:0/2902016894 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9b3006be30 0x7f9b3006e2f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9b44161650 tx=0x7f9b34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:31.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.673+0000 7f9b42ffd640 1 -- 172.21.15.19:0/2902016894 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b38059320 con 0x7f9b44161c80 2024-09-12T02:04:31.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:31.917+0000 7f9b4c711640 1 -- 172.21.15.19:0/2902016894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f9b440ba470 con 0x7f9b44161c80 2024-09-12T02:04:32.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.544+0000 7f9b42ffd640 1 -- 172.21.15.19:0/2902016894 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v191) ==== 107+0+0 (secure 0 0 0) 0x7f9b3805d620 con 0x7f9b44161c80 2024-09-12T02:04:32.545 INFO:teuthology.orchestra.run.smithi019.stderr:nothing to do: rank is not damaged 2024-09-12T02:04:32.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.546+0000 7f9b4c711640 1 -- 172.21.15.19:0/2902016894 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9b3006be30 msgr2=0x7f9b3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.546+0000 7f9b4c711640 1 --2- 172.21.15.19:0/2902016894 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9b3006be30 0x7f9b3006e2f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9b44161650 tx=0x7f9b34009040 comp rx=0 tx=0).stop 2024-09-12T02:04:32.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.546+0000 7f9b4c711640 1 -- 172.21.15.19:0/2902016894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b44161c80 msgr2=0x7f9b4415ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.546+0000 7f9b4c711640 1 --2- 172.21.15.19:0/2902016894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b44161c80 0x7f9b4415ea20 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f9b3800e840 tx=0x7f9b3800ed00 comp rx=0 tx=0).stop 2024-09-12T02:04:32.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.546+0000 7f9b4c711640 1 -- 172.21.15.19:0/2902016894 shutdown_connections 2024-09-12T02:04:32.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.546+0000 7f9b4c711640 1 --2- 172.21.15.19:0/2902016894 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9b3006be30 0x7f9b3006e2f0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.546+0000 7f9b4c711640 1 --2- 172.21.15.19:0/2902016894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b44162060 0x7f9b4415ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.546+0000 7f9b4c711640 1 --2- 172.21.15.19:0/2902016894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b44161c80 0x7f9b4415ea20 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.546+0000 7f9b4c711640 1 --2- 172.21.15.19:0/2902016894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b440b64b0 0x7f9b440b7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.547+0000 7f9b4c711640 1 -- 172.21.15.19:0/2902016894 >> 172.21.15.19:0/2902016894 conn(0x7f9b440d44f0 msgr2=0x7f9b440d3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:32.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.547+0000 7f9b4c711640 1 -- 172.21.15.19:0/2902016894 shutdown_connections 2024-09-12T02:04:32.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.547+0000 7f9b4c711640 1 -- 172.21.15.19:0/2902016894 wait complete. 2024-09-12T02:04:32.559 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:04:32.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.605+0000 7f6def7cef40 1 Processor -- start 2024-09-12T02:04:32.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.605+0000 7f6def7cef40 1 -- start start 2024-09-12T02:04:32.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.605+0000 7f6def7cef40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ddc0030f0 0x555811b38350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6def7cef40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555811aa7600 0x555811b39730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6def7cef40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555811a7c090 0x555811be7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6def7cef40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5558119cf510 con 0x7f6ddc0030f0 2024-09-12T02:04:32.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6def7cef40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555811a28c50 con 0x555811aa7600 2024-09-12T02:04:32.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6def7cef40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x555811a7ced0 con 0x555811a7c090 2024-09-12T02:04:32.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6ded2c4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ddc0030f0 0x555811b38350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6ded2c4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ddc0030f0 0x555811b38350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43800/0 (socket says 172.21.15.19:43800) 2024-09-12T02:04:32.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2766076859 learned_addr learned my addr 172.21.15.19:0/2766076859 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:32.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6decac3640 1 --2- 172.21.15.19:0/2766076859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555811aa7600 0x555811b39730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6dedac5640 1 --2- 172.21.15.19:0/2766076859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555811a7c090 0x555811be7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2766076859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555811a7c090 msgr2=0x555811be7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:32.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6ded2c4640 1 --2- 172.21.15.19:0/2766076859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555811a7c090 0x555811be7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2766076859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555811aa7600 msgr2=0x555811b39730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:32.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6ded2c4640 1 --2- 172.21.15.19:0/2766076859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555811aa7600 0x555811b39730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2766076859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555811b50530 con 0x7f6ddc0030f0 2024-09-12T02:04:32.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6ded2c4640 1 --2- 172.21.15.19:0/2766076859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ddc0030f0 0x555811b38350 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f6de8005fd0 tx=0x7f6de8005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199aea12ac8fbe69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:32.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6de77fe640 1 -- 172.21.15.19:0/2766076859 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de8007800 con 0x7f6ddc0030f0 2024-09-12T02:04:32.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6de77fe640 1 -- 172.21.15.19:0/2766076859 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de8019070 con 0x7f6ddc0030f0 2024-09-12T02:04:32.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.606+0000 7f6de77fe640 1 -- 172.21.15.19:0/2766076859 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de8007be0 con 0x7f6ddc0030f0 2024-09-12T02:04:32.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.607+0000 7f6def7cef40 1 -- 172.21.15.19:0/2766076859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ddc0030f0 msgr2=0x555811b38350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.607+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2766076859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ddc0030f0 0x555811b38350 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f6de8005fd0 tx=0x7f6de8005a00 comp rx=0 tx=0).stop 2024-09-12T02:04:32.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.607+0000 7f6def7cef40 1 -- 172.21.15.19:0/2766076859 shutdown_connections 2024-09-12T02:04:32.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.607+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2766076859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x555811a7c090 0x555811be7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.607+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2766076859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555811aa7600 0x555811b39730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.607+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2766076859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ddc0030f0 0x555811b38350 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.607+0000 7f6def7cef40 1 -- 172.21.15.19:0/2766076859 >> 172.21.15.19:0/2766076859 conn(0x555811a7f1d0 msgr2=0x555811aa9780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:32.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.607+0000 7f6def7cef40 1 -- 172.21.15.19:0/2766076859 shutdown_connections 2024-09-12T02:04:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.607+0000 7f6def7cef40 1 -- 172.21.15.19:0/2766076859 wait complete. 2024-09-12T02:04:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.607+0000 7f6def7cef40 1 Processor -- start 2024-09-12T02:04:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.607+0000 7f6def7cef40 1 -- start start 2024-09-12T02:04:32.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.608+0000 7f6def7cef40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555811a7c090 0x555811b37d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.608+0000 7f6def7cef40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555811aa7600 0x555811b38290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.608+0000 7f6def7cef40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ddc0030f0 0x555811b346d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.608+0000 7f6def7cef40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x555811a80190 con 0x555811aa7600 2024-09-12T02:04:32.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.608+0000 7f6def7cef40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555811b38890 con 0x555811a7c090 2024-09-12T02:04:32.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.608+0000 7f6def7cef40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x555811b379a0 con 0x7f6ddc0030f0 2024-09-12T02:04:32.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.608+0000 7f6decac3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555811aa7600 0x555811b38290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.608+0000 7f6decac3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555811aa7600 0x555811b38290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43810/0 (socket says 172.21.15.19:43810) 2024-09-12T02:04:32.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.608+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 learned_addr learned my addr 172.21.15.19:0/2038524526 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:32.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.608+0000 7f6ded2c4640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555811a7c090 0x555811b37d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.608+0000 7f6dedac5640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ddc0030f0 0x555811b346d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.609+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ddc0030f0 msgr2=0x555811b346d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.609+0000 7f6decac3640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ddc0030f0 0x555811b346d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.609+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555811a7c090 msgr2=0x555811b37d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.609+0000 7f6decac3640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555811a7c090 0x555811b37d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.609+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555811b3be80 con 0x555811aa7600 2024-09-12T02:04:32.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.609+0000 7f6decac3640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555811aa7600 0x555811b38290 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8057040 tx=0x7f6dd8001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:32.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.609+0000 7f6de67fc640 1 -- 172.21.15.19:0/2038524526 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd804dd40 con 0x555811aa7600 2024-09-12T02:04:32.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.609+0000 7f6de67fc640 1 -- 172.21.15.19:0/2038524526 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd8066070 con 0x555811aa7600 2024-09-12T02:04:32.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.609+0000 7f6de67fc640 1 -- 172.21.15.19:0/2038524526 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8061650 con 0x555811aa7600 2024-09-12T02:04:32.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.609+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555811b3b900 con 0x555811aa7600 2024-09-12T02:04:32.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.609+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555811b3bba0 con 0x555811aa7600 2024-09-12T02:04:32.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.611+0000 7f6de67fc640 1 -- 172.21.15.19:0/2038524526 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6dd805e070 con 0x555811aa7600 2024-09-12T02:04:32.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.611+0000 7f6de67fc640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6dd006a810 0x7f6dd006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.611+0000 7f6de67fc640 1 -- 172.21.15.19:0/2038524526 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 7851+0+0 (secure 0 0 0) 0x7f6dd80ce840 con 0x555811aa7600 2024-09-12T02:04:32.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.611+0000 7f6ded2c4640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6dd006a810 0x7f6dd006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.614 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:04:32.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.611+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x555811b35580 0x555811abe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.611+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811b4fff0 con 0x555811b35580 2024-09-12T02:04:32.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.611+0000 7f6dedac5640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x555811b35580 0x555811abe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.612+0000 7f6dedac5640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x555811b35580 0x555811abe0b0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:32.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.612+0000 7f6ded2c4640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6dd006a810 0x7f6dd006ccd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6de8002f10 tx=0x7f6de8013000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:32.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.613+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v113'567 uv541 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.613+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811abe5f0 con 0x555811b35580 2024-09-12T02:04:32.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.614+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v113'568 uv568 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.614+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811b34c10 con 0x555811b35580 2024-09-12T02:04:32.616 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:04:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.615+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v113'569 uv569 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.616+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811b34fb0 con 0x555811b35580 2024-09-12T02:04:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.616+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v113'570 uv570 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.616+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf9480 con 0x555811b35580 2024-09-12T02:04:32.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.617+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v113'571 uv571 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.617+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf8470 con 0x555811b35580 2024-09-12T02:04:32.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.619+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v113'572 uv572 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.619+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf8810 con 0x555811b35580 2024-09-12T02:04:32.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.620+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v113'573 uv547 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.620+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811bf8bb0 con 0x555811b35580 2024-09-12T02:04:32.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.621+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v113'574 uv574 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.621+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf8bb0 con 0x555811b35580 2024-09-12T02:04:32.622 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:04:32.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.622+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v113'575 uv575 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.622+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf8bb0 con 0x555811b35580 2024-09-12T02:04:32.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.623+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v113'576 uv576 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.623+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf8bb0 con 0x555811b35580 2024-09-12T02:04:32.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.623+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v113'577 uv577 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.624+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf8bb0 con 0x555811b35580 2024-09-12T02:04:32.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.625+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v113'578 uv578 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.625+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf8bb0 con 0x555811b35580 2024-09-12T02:04:32.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.626+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v113'579 uv554 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.626+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811bf8bb0 con 0x555811b35580 2024-09-12T02:04:32.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.627+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v113'580 uv580 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.627+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf8bb0 con 0x555811b35580 2024-09-12T02:04:32.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.627+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v113'581 uv581 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.628 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:04:32.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.628+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf8bb0 con 0x555811b35580 2024-09-12T02:04:32.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.629+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v113'582 uv582 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.629+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf8bb0 con 0x555811b35580 2024-09-12T02:04:32.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.630+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v113'583 uv583 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.630+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf8bb0 con 0x555811b35580 2024-09-12T02:04:32.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.631+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v113'584 uv584 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.631+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf9820 con 0x555811b35580 2024-09-12T02:04:32.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.632+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v113'585 uv585 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.632+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf9820 con 0x555811b35580 2024-09-12T02:04:32.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.633+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v113'586 uv560 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.633+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811bf9820 con 0x555811b35580 2024-09-12T02:04:32.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.634+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v113'587 uv587 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.634+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf9820 con 0x555811b35580 2024-09-12T02:04:32.635 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:04:32.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.635+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v113'588 uv588 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.635+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfa830 con 0x555811b35580 2024-09-12T02:04:32.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.636+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v113'589 uv589 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.636+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfa830 con 0x555811b35580 2024-09-12T02:04:32.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.637+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v113'590 uv590 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.637+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf9820 con 0x555811b35580 2024-09-12T02:04:32.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.638+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v113'591 uv591 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.638+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf9820 con 0x555811b35580 2024-09-12T02:04:32.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.639+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v113'592 uv566 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.639+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811bf9820 con 0x555811b35580 2024-09-12T02:04:32.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.640+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v113'593 uv593 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.640+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf9820 con 0x555811b35580 2024-09-12T02:04:32.641 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:04:32.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.641+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v113'594 uv594 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.641+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfa830 con 0x555811b35580 2024-09-12T02:04:32.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.642+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v113'595 uv595 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.642+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfa830 con 0x555811b35580 2024-09-12T02:04:32.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.643+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v113'596 uv596 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.643+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bf9820 con 0x555811b35580 2024-09-12T02:04:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.644+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v113'597 uv597 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811b35580 2024-09-12T02:04:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.644+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x555811bf9d30 0x555811bfc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.644+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfc660 con 0x555811bf9d30 2024-09-12T02:04:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.644+0000 7f6ded2c4640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x555811bf9d30 0x555811bfc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.644+0000 7f6ded2c4640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x555811bf9d30 0x555811bfc120 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:32.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.646+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v113'422 uv401 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.646+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811bfca00 con 0x555811bf9d30 2024-09-12T02:04:32.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.647+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v113'423 uv423 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.647+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfcda0 con 0x555811bf9d30 2024-09-12T02:04:32.648 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:04:32.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.648+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v113'424 uv424 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.648+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfd5f0 con 0x555811bf9d30 2024-09-12T02:04:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.650+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v113'425 uv425 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.650+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfd990 con 0x555811bf9d30 2024-09-12T02:04:32.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.651+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v113'426 uv426 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.651+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfdd30 con 0x555811bf9d30 2024-09-12T02:04:32.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.652+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v113'427 uv420 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.652+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811bfe0d0 con 0x555811bf9d30 2024-09-12T02:04:32.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.653+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v113'428 uv428 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.653+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfe470 con 0x555811bf9d30 2024-09-12T02:04:32.655 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:04:32.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.655+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v113'429 uv429 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.655+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfe470 con 0x555811bf9d30 2024-09-12T02:04:32.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.656+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v113'430 uv430 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.656+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfe470 con 0x555811bf9d30 2024-09-12T02:04:32.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.657+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v113'431 uv431 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.657+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfe470 con 0x555811bf9d30 2024-09-12T02:04:32.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.658+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v113'432 uv421 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.658+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811bfe470 con 0x555811bf9d30 2024-09-12T02:04:32.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.660+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v113'433 uv433 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.660+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfe470 con 0x555811bf9d30 2024-09-12T02:04:32.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.661+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v113'434 uv434 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.661 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:04:32.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.661+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfe470 con 0x555811bf9d30 2024-09-12T02:04:32.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.662+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v113'435 uv435 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.662+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfe470 con 0x555811bf9d30 2024-09-12T02:04:32.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.663+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v113'436 uv436 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.663+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfe470 con 0x555811bf9d30 2024-09-12T02:04:32.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.665+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v113'437 uv417 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.665+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811bfe470 con 0x555811bf9d30 2024-09-12T02:04:32.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.666+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v113'438 uv438 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.666+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfe470 con 0x555811bf9d30 2024-09-12T02:04:32.667 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:04:32.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.667+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v113'439 uv439 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.667+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfe470 con 0x555811bf9d30 2024-09-12T02:04:32.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.668+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v113'440 uv440 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.668+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfe470 con 0x555811bf9d30 2024-09-12T02:04:32.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.670+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v113'441 uv441 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.670+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811bfe470 con 0x555811bf9d30 2024-09-12T02:04:32.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.671+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v113'442 uv442 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811bf9d30 2024-09-12T02:04:32.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.671+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x555811bfed40 0x555811bff160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.671+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c018f0 con 0x555811bfed40 2024-09-12T02:04:32.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.672+0000 7f6decac3640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x555811bfed40 0x555811bff160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.672+0000 7f6decac3640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x555811bfed40 0x555811bff160 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:32.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.673+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v113'111 uv110 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.673+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811c01c90 con 0x555811bfed40 2024-09-12T02:04:32.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.674+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v113'112 uv112 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.674+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c02030 con 0x555811bfed40 2024-09-12T02:04:32.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.675+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v113'113 uv113 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.676 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:04:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.675+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c03440 con 0x555811bfed40 2024-09-12T02:04:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.676+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v113'114 uv114 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.676+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c038c0 con 0x555811bfed40 2024-09-12T02:04:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.677+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v113'115 uv115 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.677+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c023d0 con 0x555811bfed40 2024-09-12T02:04:32.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.678+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v113'116 uv116 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.678+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x555811c02e90 0x555811c05cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.678+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c06250 con 0x555811c02e90 2024-09-12T02:04:32.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.678+0000 7f6dedac5640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x555811c02e90 0x555811c05cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.679+0000 7f6dedac5640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x555811c02e90 0x555811c05cc0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:32.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.680+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v113'84 uv83 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.680+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811c06620 con 0x555811c02e90 2024-09-12T02:04:32.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.681+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v113'85 uv85 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.681+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c06620 con 0x555811c02e90 2024-09-12T02:04:32.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.682+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v113'86 uv86 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.683 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:04:32.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.683+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c06620 con 0x555811c02e90 2024-09-12T02:04:32.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.684+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v113'87 uv87 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.684+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x555811c06f50 0x555811c09340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.684+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09880 con 0x555811c06f50 2024-09-12T02:04:32.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.684+0000 7f6ded2c4640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x555811c06f50 0x555811c09340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.684+0000 7f6ded2c4640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x555811c06f50 0x555811c09340 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:32.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.685+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v113'111 uv110 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.686+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811c09880 con 0x555811c06f50 2024-09-12T02:04:32.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.687+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v113'112 uv112 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.687+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c06f50 2024-09-12T02:04:32.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.688+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v113'113 uv113 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.688 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:04:32.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.688+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0ac80 con 0x555811c06f50 2024-09-12T02:04:32.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.689+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v113'114 uv114 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.689+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0ac80 con 0x555811c06f50 2024-09-12T02:04:32.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.690+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v113'115 uv115 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.690+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c06f50 2024-09-12T02:04:32.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.691+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v113'116 uv116 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.691+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c02e90 2024-09-12T02:04:32.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.692+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v113'205 uv198 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.692+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c02e90 2024-09-12T02:04:32.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.693+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v113'206 uv206 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.693+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c02e90 2024-09-12T02:04:32.694 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:04:32.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.694+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v113'207 uv207 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.694+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0ac80 con 0x555811c02e90 2024-09-12T02:04:32.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.695+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v113'208 uv208 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.695+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0ac80 con 0x555811c02e90 2024-09-12T02:04:32.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.696+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v113'209 uv209 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.696+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c02e90 2024-09-12T02:04:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.697+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v113'210 uv210 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.697+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c02e90 2024-09-12T02:04:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.698+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v113'211 uv204 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.698+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c02e90 2024-09-12T02:04:32.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.700+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v113'212 uv212 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.700+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c02e90 2024-09-12T02:04:32.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.701+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v113'213 uv213 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.701 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:04:32.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.701+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c02e90 2024-09-12T02:04:32.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.702+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v113'214 uv214 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.702+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c02e90 2024-09-12T02:04:32.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.703+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v113'215 uv215 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.703+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c02e90 2024-09-12T02:04:32.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.704+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v113'91 uv90 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.704+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c02e90 2024-09-12T02:04:32.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.705+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v113'92 uv92 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.705+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c02e90 2024-09-12T02:04:32.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.706+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v113'93 uv93 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.706 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:04:32.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.706+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c02e90 2024-09-12T02:04:32.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.707+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v113'94 uv94 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.707+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c02e90 2024-09-12T02:04:32.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.708+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v113'95 uv95 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6de0003f80 con 0x555811c02e90 2024-09-12T02:04:32.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.708+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c06f50 2024-09-12T02:04:32.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.710+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v113'111 uv110 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.710+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c06f50 2024-09-12T02:04:32.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.711+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v113'112 uv112 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.711+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c06f50 2024-09-12T02:04:32.712 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:04:32.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.712+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v113'113 uv113 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.712+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0ac80 con 0x555811c06f50 2024-09-12T02:04:32.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.713+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v113'114 uv114 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.713+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0ac80 con 0x555811c06f50 2024-09-12T02:04:32.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.714+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v113'115 uv115 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.714+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c06f50 2024-09-12T02:04:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.715+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v113'116 uv116 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.715+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c06f50 2024-09-12T02:04:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.716+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v113'182 uv176 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.716+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c06f50 2024-09-12T02:04:32.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.717+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v113'183 uv183 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.717+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c06f50 2024-09-12T02:04:32.718 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:04:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.718+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v113'184 uv184 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.718+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c06f50 2024-09-12T02:04:32.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.719+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v113'185 uv185 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.719+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c06f50 2024-09-12T02:04:32.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.720+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v113'186 uv186 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.720+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c06f50 2024-09-12T02:04:32.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.721+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v113'187 uv181 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.721+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c06f50 2024-09-12T02:04:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.722+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v113'188 uv188 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.722+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c06f50 2024-09-12T02:04:32.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.723+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v113'189 uv189 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.723 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:04:32.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.723+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c09c70 con 0x555811c06f50 2024-09-12T02:04:32.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.724+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v113'190 uv190 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.724+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0ca80 con 0x555811c06f50 2024-09-12T02:04:32.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.725+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v113'191 uv191 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.725+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x555811c0a7a0 0x555811c0d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.725+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0cb90 con 0x555811c0a7a0 2024-09-12T02:04:32.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.725+0000 7f6decac3640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x555811c0a7a0 0x555811c0d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.725+0000 7f6decac3640 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x555811c0a7a0 0x555811c0d0c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:32.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.727+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v113'83 uv81 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811c0a7a0 2024-09-12T02:04:32.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.727+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811c0a7a0 2024-09-12T02:04:32.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.728+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v113'84 uv84 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811c0a7a0 2024-09-12T02:04:32.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.728+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811c0a7a0 2024-09-12T02:04:32.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.729+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v113'85 uv85 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811c0a7a0 2024-09-12T02:04:32.729 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:04:32.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.729+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811c0a7a0 2024-09-12T02:04:32.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.730+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v113'86 uv86 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811c0a7a0 2024-09-12T02:04:32.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.730+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811c06f50 2024-09-12T02:04:32.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.731+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v113'111 uv110 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.731+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811c06f50 2024-09-12T02:04:32.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.732+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v113'112 uv112 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.732+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811c06f50 2024-09-12T02:04:32.733 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:04:32.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.733+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v113'113 uv113 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.733+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811c06f50 2024-09-12T02:04:32.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.734+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v113'114 uv114 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.734+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811c06f50 2024-09-12T02:04:32.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.735+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v113'115 uv115 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.735+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811c06f50 2024-09-12T02:04:32.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.737+0000 7f6ded2c4640 1 -- 172.21.15.19:0/2038524526 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v113'116 uv116 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6de8007c20 con 0x555811c06f50 2024-09-12T02:04:32.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.737+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811bfed40 2024-09-12T02:04:32.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.738+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v113'94 uv93 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.738+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811bfed40 2024-09-12T02:04:32.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.739+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v113'95 uv95 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.739+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811bfed40 2024-09-12T02:04:32.741 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:04:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.740+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v113'96 uv96 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.740+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811bfed40 2024-09-12T02:04:32.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.742+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v113'97 uv97 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.742+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811bfed40 2024-09-12T02:04:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.743+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v113'98 uv98 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.743+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811bfed40 2024-09-12T02:04:32.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.744+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v113'229 uv220 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.744+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d620 con 0x555811bfed40 2024-09-12T02:04:32.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.745+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v113'230 uv230 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.745+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d620 con 0x555811bfed40 2024-09-12T02:04:32.746 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:04:32.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.746+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v113'231 uv231 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.746+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d620 con 0x555811bfed40 2024-09-12T02:04:32.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.747+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v113'232 uv232 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.747+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811bfed40 2024-09-12T02:04:32.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.748+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v113'233 uv233 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.748+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811bfed40 2024-09-12T02:04:32.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.749+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v113'234 uv227 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.749+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811bfed40 2024-09-12T02:04:32.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.750+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v113'235 uv235 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.750+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811bfed40 2024-09-12T02:04:32.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.751+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v113'236 uv236 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.751 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:04:32.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.751+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811bfed40 2024-09-12T02:04:32.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.751+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v113'237 uv237 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.752+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811bfed40 2024-09-12T02:04:32.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.752+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v113'238 uv238 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.752+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d600 con 0x555811bfed40 2024-09-12T02:04:32.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.753+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v113'239 uv239 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.753+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x555811c0d9e0 con 0x555811bfed40 2024-09-12T02:04:32.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.754+0000 7f6decac3640 1 -- 172.21.15.19:0/2038524526 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v113'240 uv240 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6dd8098b60 con 0x555811bfed40 2024-09-12T02:04:32.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.754+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x555811bf9d30 msgr2=0x555811bfc120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.754+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x555811bf9d30 0x555811bfc120 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.754+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x555811b35580 msgr2=0x555811abe0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.754+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x555811b35580 0x555811abe0b0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.754+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x555811c02e90 msgr2=0x555811c05cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.754+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x555811c02e90 0x555811c05cc0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.754+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x555811c0a7a0 msgr2=0x555811c0d0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.754+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x555811c0a7a0 0x555811c0d0c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.754+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x555811bfed40 msgr2=0x555811bff160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.754+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x555811bfed40 0x555811bff160 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.754+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x555811c06f50 msgr2=0x555811c09340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.754+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x555811c06f50 0x555811c09340 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.754+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 reap_dead start 2024-09-12T02:04:32.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.754+0000 7f6dedac5640 1 -- 172.21.15.19:0/2038524526 reap_dead start 2024-09-12T02:04:32.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.755+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6dd006a810 msgr2=0x7f6dd006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.755+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6dd006a810 0x7f6dd006ccd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6de8002f10 tx=0x7f6de8013000 comp rx=0 tx=0).stop 2024-09-12T02:04:32.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.755+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555811aa7600 msgr2=0x555811b38290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.755+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555811aa7600 0x555811b38290 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8057040 tx=0x7f6dd8001970 comp rx=0 tx=0).stop 2024-09-12T02:04:32.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.755+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 shutdown_connections 2024-09-12T02:04:32.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.755+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6dd006a810 0x7f6dd006ccd0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.755+0000 7f6def7cef40 1 --2- 172.21.15.19:0/2038524526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555811aa7600 0x555811b38290 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.755+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 >> 172.21.15.19:0/2038524526 conn(0x555811a7f1d0 msgr2=0x555811aae0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:32.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.755+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 shutdown_connections 2024-09-12T02:04:32.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.755+0000 7f6def7cef40 1 -- 172.21.15.19:0/2038524526 wait complete. 2024-09-12T02:04:32.759 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds_snaptable - 2024-09-12T02:04:32.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.843+0000 7f72e3cf1f40 1 Processor -- start 2024-09-12T02:04:32.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.843+0000 7f72e3cf1f40 1 -- start start 2024-09-12T02:04:32.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.844+0000 7f72e3cf1f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0e0ced350 0x55a0e0dc4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.844+0000 7f72e3cf1f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0e0d1b050 0x55a0e0dc46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.844+0000 7f72e3cf1f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0e0da5080 0x55a0e0d30a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.844+0000 7f72e3cf1f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a0e0ce9ae0 con 0x55a0e0da5080 2024-09-12T02:04:32.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.844+0000 7f72e3cf1f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a0e0c3c510 con 0x55a0e0d1b050 2024-09-12T02:04:32.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.844+0000 7f72e3cf1f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55a0e0ce9dc0 con 0x55a0e0ced350 2024-09-12T02:04:32.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.844+0000 7f72e1fe8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0e0da5080 0x55a0e0d30a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.844+0000 7f72e1fe8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0e0da5080 0x55a0e0d30a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43822/0 (socket says 172.21.15.19:43822) 2024-09-12T02:04:32.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.844+0000 7f72e1fe8640 1 -- 172.21.15.19:0/1086808062 learned_addr learned my addr 172.21.15.19:0/1086808062 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:32.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.844+0000 7f72e17e7640 1 --2- 172.21.15.19:0/1086808062 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0e0ced350 0x55a0e0dc4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.844+0000 7f72e0fe6640 1 --2- 172.21.15.19:0/1086808062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0e0d1b050 0x55a0e0dc46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.844+0000 7f72e1fe8640 1 -- 172.21.15.19:0/1086808062 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0e0ced350 msgr2=0x55a0e0dc4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:32.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.844+0000 7f72e1fe8640 1 --2- 172.21.15.19:0/1086808062 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0e0ced350 0x55a0e0dc4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.844+0000 7f72e1fe8640 1 -- 172.21.15.19:0/1086808062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0e0d1b050 msgr2=0x55a0e0dc46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:32.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.844+0000 7f72e1fe8640 1 --2- 172.21.15.19:0/1086808062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0e0d1b050 0x55a0e0dc46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.844+0000 7f72e1fe8640 1 -- 172.21.15.19:0/1086808062 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0e0dc2340 con 0x55a0e0da5080 2024-09-12T02:04:32.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.845+0000 7f72e1fe8640 1 --2- 172.21.15.19:0/1086808062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0e0da5080 0x55a0e0d30a40 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f72dc009820 tx=0x7f72dc005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c5c642f7a31071 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:32.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.845+0000 7f72d37fe640 1 -- 172.21.15.19:0/1086808062 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72dc0088d0 con 0x55a0e0da5080 2024-09-12T02:04:32.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.845+0000 7f72d37fe640 1 -- 172.21.15.19:0/1086808062 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72dc018070 con 0x55a0e0da5080 2024-09-12T02:04:32.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.845+0000 7f72d37fe640 1 -- 172.21.15.19:0/1086808062 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72dc008cb0 con 0x55a0e0da5080 2024-09-12T02:04:32.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.845+0000 7f72e3cf1f40 1 -- 172.21.15.19:0/1086808062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0e0da5080 msgr2=0x55a0e0d30a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.845+0000 7f72e3cf1f40 1 --2- 172.21.15.19:0/1086808062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0e0da5080 0x55a0e0d30a40 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f72dc009820 tx=0x7f72dc005a00 comp rx=0 tx=0).stop 2024-09-12T02:04:32.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.845+0000 7f72e3cf1f40 1 -- 172.21.15.19:0/1086808062 shutdown_connections 2024-09-12T02:04:32.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.845+0000 7f72e3cf1f40 1 --2- 172.21.15.19:0/1086808062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0e0da5080 0x55a0e0d30a40 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.845+0000 7f72e3cf1f40 1 --2- 172.21.15.19:0/1086808062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0e0d1b050 0x55a0e0dc46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.845+0000 7f72e3cf1f40 1 --2- 172.21.15.19:0/1086808062 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0e0ced350 0x55a0e0dc4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.845+0000 7f72e3cf1f40 1 -- 172.21.15.19:0/1086808062 >> 172.21.15.19:0/1086808062 conn(0x55a0e0cea9e0 msgr2=0x55a0e0d1a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:32.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.845+0000 7f72e3cf1f40 1 -- 172.21.15.19:0/1086808062 shutdown_connections 2024-09-12T02:04:32.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.845+0000 7f72e3cf1f40 1 -- 172.21.15.19:0/1086808062 wait complete. 2024-09-12T02:04:32.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.846+0000 7f72e3cf1f40 1 Processor -- start 2024-09-12T02:04:32.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.846+0000 7f72e3cf1f40 1 -- start start 2024-09-12T02:04:32.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.847+0000 7f72e3cf1f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0e0ced350 0x55a0e0da0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.847+0000 7f72e3cf1f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0e0d1b050 0x55a0e0dbe660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.847+0000 7f72e3cf1f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0e0da5080 0x55a0e0dbffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.847+0000 7f72e3cf1f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a0e0e50b30 con 0x55a0e0ced350 2024-09-12T02:04:32.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.847+0000 7f72e3cf1f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a0e0dc3df0 con 0x55a0e0d1b050 2024-09-12T02:04:32.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.847+0000 7f72e3cf1f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55a0e0dc38c0 con 0x55a0e0da5080 2024-09-12T02:04:32.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.847+0000 7f72e17e7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0e0ced350 0x55a0e0da0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.847+0000 7f72e17e7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0e0ced350 0x55a0e0da0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43832/0 (socket says 172.21.15.19:43832) 2024-09-12T02:04:32.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.847+0000 7f72e17e7640 1 -- 172.21.15.19:0/1111515676 learned_addr learned my addr 172.21.15.19:0/1111515676 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:32.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.847+0000 7f72e0fe6640 1 --2- 172.21.15.19:0/1111515676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0e0d1b050 0x55a0e0dbe660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.847+0000 7f72e1fe8640 1 --2- 172.21.15.19:0/1111515676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0e0da5080 0x55a0e0dbffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.847+0000 7f72e17e7640 1 -- 172.21.15.19:0/1111515676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0e0da5080 msgr2=0x55a0e0dbffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.847+0000 7f72e17e7640 1 --2- 172.21.15.19:0/1111515676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a0e0da5080 0x55a0e0dbffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.847+0000 7f72e17e7640 1 -- 172.21.15.19:0/1111515676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0e0d1b050 msgr2=0x55a0e0dbe660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.847+0000 7f72e17e7640 1 --2- 172.21.15.19:0/1111515676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0e0d1b050 0x55a0e0dbe660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.847+0000 7f72e17e7640 1 -- 172.21.15.19:0/1111515676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0e0dbeba0 con 0x55a0e0ced350 2024-09-12T02:04:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.847+0000 7f72e17e7640 1 --2- 172.21.15.19:0/1111515676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0e0ced350 0x55a0e0da0620 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f72d400a4b0 tx=0x7f72d4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.848+0000 7f72d27fc640 1 -- 172.21.15.19:0/1111515676 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d4062410 con 0x55a0e0ced350 2024-09-12T02:04:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.848+0000 7f72d27fc640 1 -- 172.21.15.19:0/1111515676 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d4067070 con 0x55a0e0ced350 2024-09-12T02:04:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.848+0000 7f72e3cf1f40 1 -- 172.21.15.19:0/1111515676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0e0d19b10 con 0x55a0e0ced350 2024-09-12T02:04:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.848+0000 7f72d27fc640 1 -- 172.21.15.19:0/1111515676 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d40627f0 con 0x55a0e0ced350 2024-09-12T02:04:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.848+0000 7f72e3cf1f40 1 -- 172.21.15.19:0/1111515676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0e0da5670 con 0x55a0e0ced350 2024-09-12T02:04:32.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.849+0000 7f72d27fc640 1 -- 172.21.15.19:0/1111515676 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72d4062990 con 0x55a0e0ced350 2024-09-12T02:04:32.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.849+0000 7f72d27fc640 1 --2- 172.21.15.19:0/1111515676 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f72c406a810 0x7f72c406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.850+0000 7f72d27fc640 1 -- 172.21.15.19:0/1111515676 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 7851+0+0 (secure 0 0 0) 0x7f72d40ce2f0 con 0x55a0e0ced350 2024-09-12T02:04:32.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.850+0000 7f72e0fe6640 1 --2- 172.21.15.19:0/1111515676 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f72c406a810 0x7f72c406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.850+0000 7f72e3cf1f40 1 --2- 172.21.15.19:0/1111515676 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55a0e0dc0520 0x55a0e0e51dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.850+0000 7f72e3cf1f40 1 -- 172.21.15.19:0/1111515676 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:1 13.d 13:b50e409b:::mds_snaptable:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x55a0e0e52300 con 0x55a0e0dc0520 2024-09-12T02:04:32.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.850+0000 7f72e1fe8640 1 --2- 172.21.15.19:0/1111515676 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55a0e0dc0520 0x55a0e0e51dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.850+0000 7f72e0fe6640 1 --2- 172.21.15.19:0/1111515676 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f72c406a810 0x7f72c406ccd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x55a0e0dc1380 tx=0x7f72d80017a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:32.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.850+0000 7f72e1fe8640 1 --2- 172.21.15.19:0/1111515676 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55a0e0dc0520 0x55a0e0e51dc0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:32.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.852+0000 7f72e1fe8640 1 -- 172.21.15.19:0/1111515676 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(1 mds_snaptable [writefull 0~80] v113'96 uv96 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f72dc008750 con 0x55a0e0dc0520 2024-09-12T02:04:32.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.852+0000 7f72e3cf1f40 1 -- 172.21.15.19:0/1111515676 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55a0e0dc0520 msgr2=0x55a0e0e51dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.852+0000 7f72e3cf1f40 1 --2- 172.21.15.19:0/1111515676 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55a0e0dc0520 0x55a0e0e51dc0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.852+0000 7f72e3cf1f40 1 -- 172.21.15.19:0/1111515676 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f72c406a810 msgr2=0x7f72c406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.852+0000 7f72e3cf1f40 1 --2- 172.21.15.19:0/1111515676 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f72c406a810 0x7f72c406ccd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x55a0e0dc1380 tx=0x7f72d80017a0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.852+0000 7f72e3cf1f40 1 -- 172.21.15.19:0/1111515676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0e0ced350 msgr2=0x55a0e0da0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.852+0000 7f72e3cf1f40 1 --2- 172.21.15.19:0/1111515676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a0e0ced350 0x55a0e0da0620 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f72d400a4b0 tx=0x7f72d4003330 comp rx=0 tx=0).stop 2024-09-12T02:04:32.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.852+0000 7f72e1fe8640 1 -- 172.21.15.19:0/1111515676 reap_dead start 2024-09-12T02:04:32.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.852+0000 7f72e3cf1f40 1 -- 172.21.15.19:0/1111515676 shutdown_connections 2024-09-12T02:04:32.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.852+0000 7f72e3cf1f40 1 -- 172.21.15.19:0/1111515676 >> 172.21.15.19:0/1111515676 conn(0x55a0e0cea9e0 msgr2=0x55a0e0dc3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:32.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.852+0000 7f72e3cf1f40 1 -- 172.21.15.19:0/1111515676 shutdown_connections 2024-09-12T02:04:32.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:32.852+0000 7f72e3cf1f40 1 -- 172.21.15.19:0/1111515676 wait complete. 2024-09-12T02:04:32.857 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:04:33.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.000+0000 7f239ad4b640 1 Processor -- start 2024-09-12T02:04:33.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.000+0000 7f239ad4b640 1 -- start start 2024-09-12T02:04:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.001+0000 7f239ad4b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2394159ce0 0x7f239415d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.001+0000 7f239ad4b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f23940b5f10 0x7f23940b6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.001+0000 7f239ad4b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f239406e6c0 0x7f239406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.001+0000 7f239ad4b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f23940b6850 con 0x7f239406e6c0 2024-09-12T02:04:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.001+0000 7f239ad4b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f239415d730 con 0x7f23940b5f10 2024-09-12T02:04:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.001+0000 7f239ad4b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f23940700b0 con 0x7f2394159ce0 2024-09-12T02:04:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.001+0000 7f23992e8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f239406e6c0 0x7f239406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.001+0000 7f23992e8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f239406e6c0 0x7f239406eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43846/0 (socket says 172.21.15.19:43846) 2024-09-12T02:04:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.001+0000 7f23992e8640 1 -- 172.21.15.19:0/1308565129 learned_addr learned my addr 172.21.15.19:0/1308565129 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:33.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.001+0000 7f2398ae7640 1 --2- 172.21.15.19:0/1308565129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2394159ce0 0x7f239415d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:33.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.001+0000 7f2393fff640 1 --2- 172.21.15.19:0/1308565129 >> v2:172.21.15.135:3300/0 conn(0x7f23940b5f10 0x7f23940b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:33.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.001+0000 7f23992e8640 1 -- 172.21.15.19:0/1308565129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2394159ce0 msgr2=0x7f239415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:33.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.001+0000 7f23992e8640 1 --2- 172.21.15.19:0/1308565129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2394159ce0 0x7f239415d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.001+0000 7f23992e8640 1 -- 172.21.15.19:0/1308565129 >> v2:172.21.15.135:3300/0 conn(0x7f23940b5f10 msgr2=0x7f23940b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:33.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.001+0000 7f23992e8640 1 --2- 172.21.15.19:0/1308565129 >> v2:172.21.15.135:3300/0 conn(0x7f23940b5f10 0x7f23940b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.001+0000 7f23992e8640 1 -- 172.21.15.19:0/1308565129 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23941601b0 con 0x7f239406e6c0 2024-09-12T02:04:33.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.002+0000 7f23992e8640 1 --2- 172.21.15.19:0/1308565129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239406e6c0 0x7f239406eb30 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f2394069820 tx=0x7f238c02a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d589994823399256 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:33.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.002+0000 7f23937fe640 1 -- 172.21.15.19:0/1308565129 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c036070 con 0x7f239406e6c0 2024-09-12T02:04:33.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.002+0000 7f23937fe640 1 -- 172.21.15.19:0/1308565129 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238c031600 con 0x7f239406e6c0 2024-09-12T02:04:33.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.002+0000 7f23937fe640 1 -- 172.21.15.19:0/1308565129 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c0319d0 con 0x7f239406e6c0 2024-09-12T02:04:33.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.003+0000 7f239ad4b640 1 -- 172.21.15.19:0/1308565129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239406e6c0 msgr2=0x7f239406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:33.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.003+0000 7f239ad4b640 1 --2- 172.21.15.19:0/1308565129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239406e6c0 0x7f239406eb30 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f2394069820 tx=0x7f238c02a570 comp rx=0 tx=0).stop 2024-09-12T02:04:33.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.003+0000 7f239ad4b640 1 -- 172.21.15.19:0/1308565129 shutdown_connections 2024-09-12T02:04:33.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.003+0000 7f239ad4b640 1 --2- 172.21.15.19:0/1308565129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239406e6c0 0x7f239406eb30 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.003+0000 7f239ad4b640 1 --2- 172.21.15.19:0/1308565129 >> v2:172.21.15.135:3300/0 conn(0x7f23940b5f10 0x7f23940b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.003+0000 7f239ad4b640 1 --2- 172.21.15.19:0/1308565129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2394159ce0 0x7f239415d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.003+0000 7f239ad4b640 1 -- 172.21.15.19:0/1308565129 >> 172.21.15.19:0/1308565129 conn(0x7f2394073590 msgr2=0x7f239406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:33.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.003+0000 7f239ad4b640 1 -- 172.21.15.19:0/1308565129 shutdown_connections 2024-09-12T02:04:33.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.003+0000 7f239ad4b640 1 -- 172.21.15.19:0/1308565129 wait complete. 2024-09-12T02:04:33.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.004+0000 7f239ad4b640 1 Processor -- start 2024-09-12T02:04:33.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.004+0000 7f239ad4b640 1 -- start start 2024-09-12T02:04:33.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.005+0000 7f239ad4b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f239406e6c0 0x7f2394156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:33.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.005+0000 7f239ad4b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23940b5f10 0x7f23940b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:33.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.005+0000 7f239ad4b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2394159ce0 0x7f23940b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:33.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.005+0000 7f239ad4b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2394160a50 con 0x7f23940b5f10 2024-09-12T02:04:33.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.005+0000 7f239ad4b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2394160770 con 0x7f2394159ce0 2024-09-12T02:04:33.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.005+0000 7f239ad4b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f239415a0c0 con 0x7f239406e6c0 2024-09-12T02:04:33.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.005+0000 7f2393fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23940b5f10 0x7f23940b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:33.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.005+0000 7f2393fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23940b5f10 0x7f23940b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43856/0 (socket says 172.21.15.19:43856) 2024-09-12T02:04:33.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.005+0000 7f2398ae7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f239406e6c0 0x7f2394156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:33.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.005+0000 7f2393fff640 1 -- 172.21.15.19:0/2558458983 learned_addr learned my addr 172.21.15.19:0/2558458983 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:33.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.005+0000 7f23992e8640 1 --2- 172.21.15.19:0/2558458983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2394159ce0 0x7f23940b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.005+0000 7f2393fff640 1 -- 172.21.15.19:0/2558458983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f239406e6c0 msgr2=0x7f2394156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.005+0000 7f2393fff640 1 --2- 172.21.15.19:0/2558458983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f239406e6c0 0x7f2394156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.005+0000 7f2393fff640 1 -- 172.21.15.19:0/2558458983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2394159ce0 msgr2=0x7f23940b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.005+0000 7f2393fff640 1 --2- 172.21.15.19:0/2558458983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2394159ce0 0x7f23940b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.005+0000 7f2393fff640 1 -- 172.21.15.19:0/2558458983 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23941f4320 con 0x7f23940b5f10 2024-09-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.006+0000 7f2398ae7640 1 --2- 172.21.15.19:0/2558458983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f239406e6c0 0x7f2394156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.006+0000 7f2393fff640 1 --2- 172.21.15.19:0/2558458983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23940b5f10 0x7f23940b18c0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f238000e890 tx=0x7f238000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.006+0000 7f23917fa640 1 -- 172.21.15.19:0/2558458983 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2380017070 con 0x7f23940b5f10 2024-09-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.006+0000 7f23917fa640 1 -- 172.21.15.19:0/2558458983 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238000c940 con 0x7f23940b5f10 2024-09-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.006+0000 7f23917fa640 1 -- 172.21.15.19:0/2558458983 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238000cd10 con 0x7f23940b5f10 2024-09-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.006+0000 7f239ad4b640 1 -- 172.21.15.19:0/2558458983 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23941f4600 con 0x7f23940b5f10 2024-09-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.006+0000 7f239ad4b640 1 -- 172.21.15.19:0/2558458983 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23941f4bc0 con 0x7f23940b5f10 2024-09-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.007+0000 7f239ad4b640 1 -- 172.21.15.19:0/2558458983 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f239415fda0 con 0x7f23940b5f10 2024-09-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.007+0000 7f23917fa640 1 -- 172.21.15.19:0/2558458983 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f238001a070 con 0x7f23940b5f10 2024-09-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.008+0000 7f23917fa640 1 --2- 172.21.15.19:0/2558458983 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f237806be30 0x7f237806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:33.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.008+0000 7f23917fa640 1 -- 172.21.15.19:0/2558458983 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 7851+0+0 (secure 0 0 0) 0x7f238008b980 con 0x7f23940b5f10 2024-09-12T02:04:33.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.008+0000 7f2398ae7640 1 --2- 172.21.15.19:0/2558458983 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f237806be30 0x7f237806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:33.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.009+0000 7f2398ae7640 1 --2- 172.21.15.19:0/2558458983 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f237806be30 0x7f237806e2f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2388009f30 tx=0x7f2388009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:33.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.012+0000 7f23917fa640 1 -- 172.21.15.19:0/2558458983 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2380059460 con 0x7f23940b5f10 2024-09-12T02:04:33.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.223+0000 7f239ad4b640 1 -- 172.21.15.19:0/2558458983 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f2394067d60 con 0x7f23940b5f10 2024-09-12T02:04:33.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.769+0000 7f23917fa640 1 -- 172.21.15.19:0/2558458983 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v192) ==== 162+0+0 (secure 0 0 0) 0x7f238005d760 con 0x7f23940b5f10 2024-09-12T02:04:33.770 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:04:33.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.772+0000 7f239ad4b640 1 -- 172.21.15.19:0/2558458983 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f237806be30 msgr2=0x7f237806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:33.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.772+0000 7f239ad4b640 1 --2- 172.21.15.19:0/2558458983 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f237806be30 0x7f237806e2f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2388009f30 tx=0x7f2388009190 comp rx=0 tx=0).stop 2024-09-12T02:04:33.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.772+0000 7f239ad4b640 1 -- 172.21.15.19:0/2558458983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23940b5f10 msgr2=0x7f23940b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:33.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.772+0000 7f239ad4b640 1 --2- 172.21.15.19:0/2558458983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23940b5f10 0x7f23940b18c0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f238000e890 tx=0x7f238000ed50 comp rx=0 tx=0).stop 2024-09-12T02:04:33.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.772+0000 7f239ad4b640 1 -- 172.21.15.19:0/2558458983 shutdown_connections 2024-09-12T02:04:33.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.772+0000 7f239ad4b640 1 --2- 172.21.15.19:0/2558458983 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f237806be30 0x7f237806e2f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.772+0000 7f239ad4b640 1 --2- 172.21.15.19:0/2558458983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2394159ce0 0x7f23940b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.772+0000 7f239ad4b640 1 --2- 172.21.15.19:0/2558458983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23940b5f10 0x7f23940b18c0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.772+0000 7f239ad4b640 1 --2- 172.21.15.19:0/2558458983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f239406e6c0 0x7f2394156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.772+0000 7f239ad4b640 1 -- 172.21.15.19:0/2558458983 >> 172.21.15.19:0/2558458983 conn(0x7f2394073590 msgr2=0x7f239406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:33.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.772+0000 7f239ad4b640 1 -- 172.21.15.19:0/2558458983 shutdown_connections 2024-09-12T02:04:33.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.772+0000 7f239ad4b640 1 -- 172.21.15.19:0/2558458983 wait complete. 2024-09-12T02:04:33.777 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:04:33.777+0000 7f0980888640 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds_snaptable': Decoder at 'virtual void SnapServer::decode_server_state(ceph::buffer::v15_2_0::list::const_iterator&)' v=5 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-09-12T02:04:33.778 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:33.778+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:04:33.778 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:33.778+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:04:33.787 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:33.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.895+0000 7f77b5a5e640 1 Processor -- start 2024-09-12T02:04:33.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.895+0000 7f77b5a5e640 1 -- start start 2024-09-12T02:04:33.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.896+0000 7f77b5a5e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f77b00d30f0 0x7f77b00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:33.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.896+0000 7f77b5a5e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f77b00b64c0 0x7f77b006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:33.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.896+0000 7f77b5a5e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b00d3690 con 0x7f77b015e5f0 2024-09-12T02:04:33.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.896+0000 7f77b5a5e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f77b006d530 con 0x7f77b00d30f0 2024-09-12T02:04:33.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.896+0000 7f77b5a5e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f77b00d3970 con 0x7f77b00b64c0 2024-09-12T02:04:33.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.896+0000 7f77ae7fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f77b00d30f0 0x7f77b00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:33.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.896+0000 7f77ae7fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f77b00d30f0 0x7f77b00b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43872/0 (socket says 172.21.15.19:43872) 2024-09-12T02:04:33.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.896+0000 7f77ae7fc640 1 -- 172.21.15.19:0/3340489217 learned_addr learned my addr 172.21.15.19:0/3340489217 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:33.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.896+0000 7f77af7fe640 1 --2- 172.21.15.19:0/3340489217 >> v2:172.21.15.135:3300/0 conn(0x7f77b00b64c0 0x7f77b006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:33.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.896+0000 7f77ae7fc640 1 -- 172.21.15.19:0/3340489217 >> v2:172.21.15.135:3300/0 conn(0x7f77b00b64c0 msgr2=0x7f77b006d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:33.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.896+0000 7f77ae7fc640 1 --2- 172.21.15.19:0/3340489217 >> v2:172.21.15.135:3300/0 conn(0x7f77b00b64c0 0x7f77b006d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.896+0000 7f77ae7fc640 1 -- 172.21.15.19:0/3340489217 >> v1:172.21.15.135:6789/0 conn(0x7f77b015e5f0 legacy=0x7f77b00d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:33.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.896+0000 7f77ae7fc640 1 -- 172.21.15.19:0/3340489217 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b006cee0 con 0x7f77b00d30f0 2024-09-12T02:04:33.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.897+0000 7f77ae7fc640 1 --2- 172.21.15.19:0/3340489217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77b00d30f0 0x7f77b00b5f80 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f77b00ba580 tx=0x7f77a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2482291228a4bdf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:33.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.897+0000 7f77adffb640 1 -- 172.21.15.19:0/3340489217 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a4037070 con 0x7f77b00d30f0 2024-09-12T02:04:33.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.897+0000 7f77adffb640 1 -- 172.21.15.19:0/3340489217 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a4032440 con 0x7f77b00d30f0 2024-09-12T02:04:33.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.897+0000 7f77adffb640 1 -- 172.21.15.19:0/3340489217 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a4032810 con 0x7f77b00d30f0 2024-09-12T02:04:33.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.898+0000 7f77b5a5e640 1 -- 172.21.15.19:0/3340489217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77b00d30f0 msgr2=0x7f77b00b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:33.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.898+0000 7f77b5a5e640 1 --2- 172.21.15.19:0/3340489217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77b00d30f0 0x7f77b00b5f80 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f77b00ba580 tx=0x7f77a402a270 comp rx=0 tx=0).stop 2024-09-12T02:04:33.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.898+0000 7f77b5a5e640 1 -- 172.21.15.19:0/3340489217 shutdown_connections 2024-09-12T02:04:33.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.898+0000 7f77b5a5e640 1 --2- 172.21.15.19:0/3340489217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77b00d30f0 0x7f77b00b5f80 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.898+0000 7f77b5a5e640 1 --2- 172.21.15.19:0/3340489217 >> v2:172.21.15.135:3300/0 conn(0x7f77b00b64c0 0x7f77b006d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.898+0000 7f77b5a5e640 1 -- 172.21.15.19:0/3340489217 >> 172.21.15.19:0/3340489217 conn(0x7f77b008bfc0 msgr2=0x7f77b00d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:33.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.898+0000 7f77b5a5e640 1 -- 172.21.15.19:0/3340489217 shutdown_connections 2024-09-12T02:04:33.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.898+0000 7f77b5a5e640 1 -- 172.21.15.19:0/3340489217 wait complete. 2024-09-12T02:04:33.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.899+0000 7f77b5a5e640 1 Processor -- start 2024-09-12T02:04:33.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.899+0000 7f77b5a5e640 1 -- start start 2024-09-12T02:04:33.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.900+0000 7f77b5a5e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77b00b64c0 0x7f77b00ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:33.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.900+0000 7f77b5a5e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77b00d30f0 0x7f77b015c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:33.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.900+0000 7f77b5a5e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77b015e5f0 0x7f77b01f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:33.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.900+0000 7f77b5a5e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f77b006df00 con 0x7f77b015e5f0 2024-09-12T02:04:33.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.900+0000 7f77b5a5e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f77b015e9d0 con 0x7f77b00d30f0 2024-09-12T02:04:33.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.900+0000 7f77b5a5e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f77b006e080 con 0x7f77b00b64c0 2024-09-12T02:04:33.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.900+0000 7f77af7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77b015e5f0 0x7f77b01f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:33.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.900+0000 7f77af7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77b015e5f0 0x7f77b01f52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43880/0 (socket says 172.21.15.19:43880) 2024-09-12T02:04:33.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.900+0000 7f77af7fe640 1 -- 172.21.15.19:0/167284647 learned_addr learned my addr 172.21.15.19:0/167284647 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:33.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.900+0000 7f77ae7fc640 1 --2- 172.21.15.19:0/167284647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77b00d30f0 0x7f77b015c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:33.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.900+0000 7f77aeffd640 1 --2- 172.21.15.19:0/167284647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77b00b64c0 0x7f77b00ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:33.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.901+0000 7f77af7fe640 1 -- 172.21.15.19:0/167284647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77b00b64c0 msgr2=0x7f77b00ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:33.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.901+0000 7f77af7fe640 1 --2- 172.21.15.19:0/167284647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77b00b64c0 0x7f77b00ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.901+0000 7f77af7fe640 1 -- 172.21.15.19:0/167284647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77b00d30f0 msgr2=0x7f77b015c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:33.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.901+0000 7f77af7fe640 1 --2- 172.21.15.19:0/167284647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77b00d30f0 0x7f77b015c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.901+0000 7f77af7fe640 1 -- 172.21.15.19:0/167284647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b015eeb0 con 0x7f77b015e5f0 2024-09-12T02:04:33.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.901+0000 7f77af7fe640 1 --2- 172.21.15.19:0/167284647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77b015e5f0 0x7f77b01f52e0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f77a800efc0 tx=0x7f77a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:33.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.901+0000 7f7797fff640 1 -- 172.21.15.19:0/167284647 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a8018020 con 0x7f77b015e5f0 2024-09-12T02:04:33.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.901+0000 7f7797fff640 1 -- 172.21.15.19:0/167284647 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a8014480 con 0x7f77b015e5f0 2024-09-12T02:04:33.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.901+0000 7f77b5a5e640 1 -- 172.21.15.19:0/167284647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77b015f150 con 0x7f77b015e5f0 2024-09-12T02:04:33.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.901+0000 7f7797fff640 1 -- 172.21.15.19:0/167284647 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a8014870 con 0x7f77b015e5f0 2024-09-12T02:04:33.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.901+0000 7f77b5a5e640 1 -- 172.21.15.19:0/167284647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77b015d090 con 0x7f77b015e5f0 2024-09-12T02:04:33.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.902+0000 7f77b5a5e640 1 -- 172.21.15.19:0/167284647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77b006d9c0 con 0x7f77b015e5f0 2024-09-12T02:04:33.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.903+0000 7f7797fff640 1 -- 172.21.15.19:0/167284647 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f77a8005d10 con 0x7f77b015e5f0 2024-09-12T02:04:33.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.903+0000 7f7797fff640 1 --2- 172.21.15.19:0/167284647 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f779c06be60 0x7f779c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:33.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.903+0000 7f7797fff640 1 -- 172.21.15.19:0/167284647 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 7937+0+0 (secure 0 0 0) 0x7f77a808bfe0 con 0x7f77b015e5f0 2024-09-12T02:04:33.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.903+0000 7f77aeffd640 1 --2- 172.21.15.19:0/167284647 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f779c06be60 0x7f779c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:33.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.904+0000 7f77aeffd640 1 --2- 172.21.15.19:0/167284647 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f779c06be60 0x7f779c06e320 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f77a00016e0 tx=0x7f77a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:33.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:33.907+0000 7f7797fff640 1 -- 172.21.15.19:0/167284647 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f77a8022070 con 0x7f77b015e5f0 2024-09-12T02:04:34.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.117+0000 7f77b5a5e640 1 -- 172.21.15.19:0/167284647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77b00d2aa0 con 0x7f77b015e5f0 2024-09-12T02:04:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.117+0000 7f7797fff640 1 -- 172.21.15.19:0/167284647 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 194 v194) ==== 95+0+4392 (secure 0 0 0) 0x7f77a8010040 con 0x7f77b015e5f0 2024-09-12T02:04:34.118 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:34.118 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":194,"btime":"2024-09-12T02:04:33:779216+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7981,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2333858704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2333858704},{"type":"v1","addr":"172.21.15.135:6837","nonce":2333858704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":191}],"filesystems":[{"mdsmap":{"epoch":194,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:33.779160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 194 2024-09-12T02:04:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.119+0000 7f77b5a5e640 1 -- 172.21.15.19:0/167284647 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f779c06be60 msgr2=0x7f779c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.119+0000 7f77b5a5e640 1 --2- 172.21.15.19:0/167284647 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f779c06be60 0x7f779c06e320 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f77a00016e0 tx=0x7f77a0009040 comp rx=0 tx=0).stop 2024-09-12T02:04:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.119+0000 7f77b5a5e640 1 -- 172.21.15.19:0/167284647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77b015e5f0 msgr2=0x7f77b01f52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.119+0000 7f77b5a5e640 1 --2- 172.21.15.19:0/167284647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77b015e5f0 0x7f77b01f52e0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f77a800efc0 tx=0x7f77a800c490 comp rx=0 tx=0).stop 2024-09-12T02:04:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.119+0000 7f77b5a5e640 1 -- 172.21.15.19:0/167284647 shutdown_connections 2024-09-12T02:04:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.119+0000 7f77b5a5e640 1 --2- 172.21.15.19:0/167284647 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f779c06be60 0x7f779c06e320 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.119+0000 7f77b5a5e640 1 --2- 172.21.15.19:0/167284647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77b015e5f0 0x7f77b01f52e0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.119+0000 7f77b5a5e640 1 --2- 172.21.15.19:0/167284647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77b00d30f0 0x7f77b015c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.119+0000 7f77b5a5e640 1 --2- 172.21.15.19:0/167284647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77b00b64c0 0x7f77b00ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.119+0000 7f77b5a5e640 1 -- 172.21.15.19:0/167284647 >> 172.21.15.19:0/167284647 conn(0x7f77b008bfc0 msgr2=0x7f77b00d16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.119+0000 7f77b5a5e640 1 -- 172.21.15.19:0/167284647 shutdown_connections 2024-09-12T02:04:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.119+0000 7f77b5a5e640 1 -- 172.21.15.19:0/167284647 wait complete. 2024-09-12T02:04:34.130 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:34.131 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:34.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.232+0000 7f26e2d0a640 1 Processor -- start 2024-09-12T02:04:34.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.232+0000 7f26e2d0a640 1 -- start start 2024-09-12T02:04:34.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.233+0000 7f26e2d0a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26dc161c80 0x7f26dc06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:34.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.233+0000 7f26e2d0a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f26dc162060 0x7f26dc0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:34.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.233+0000 7f26e2d0a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f26dc0b64b0 0x7f26dc0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:34.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.233+0000 7f26e2d0a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f26dc06e870 con 0x7f26dc162060 2024-09-12T02:04:34.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.233+0000 7f26e2d0a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f26dc06d9f0 con 0x7f26dc0b64b0 2024-09-12T02:04:34.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.233+0000 7f26e2d0a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f26dc06dcd0 con 0x7f26dc161c80 2024-09-12T02:04:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.233+0000 7f26dbfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f26dc162060 0x7f26dc0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.233+0000 7f26dbfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f26dc162060 0x7f26dc0b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43890/0 (socket says 172.21.15.19:43890) 2024-09-12T02:04:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.233+0000 7f26dbfff640 1 -- 172.21.15.19:0/3926307196 learned_addr learned my addr 172.21.15.19:0/3926307196 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.234+0000 7f26e0aa6640 1 --2- 172.21.15.19:0/3926307196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26dc161c80 0x7f26dc06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.234+0000 7f26e12a7640 1 --2- 172.21.15.19:0/3926307196 >> v2:172.21.15.135:3300/0 conn(0x7f26dc0b64b0 0x7f26dc0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.234+0000 7f26dbfff640 1 -- 172.21.15.19:0/3926307196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26dc161c80 msgr2=0x7f26dc06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.234+0000 7f26dbfff640 1 --2- 172.21.15.19:0/3926307196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26dc161c80 0x7f26dc06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.234+0000 7f26dbfff640 1 -- 172.21.15.19:0/3926307196 >> v2:172.21.15.135:3300/0 conn(0x7f26dc0b64b0 msgr2=0x7f26dc0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.234+0000 7f26dbfff640 1 --2- 172.21.15.19:0/3926307196 >> v2:172.21.15.135:3300/0 conn(0x7f26dc0b64b0 0x7f26dc0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.234+0000 7f26dbfff640 1 -- 172.21.15.19:0/3926307196 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26dc06dfb0 con 0x7f26dc162060 2024-09-12T02:04:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.234+0000 7f26e12a7640 1 --2- 172.21.15.19:0/3926307196 >> v2:172.21.15.135:3300/0 conn(0x7f26dc0b64b0 0x7f26dc0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:34.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.235+0000 7f26dbfff640 1 --2- 172.21.15.19:0/3926307196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26dc162060 0x7f26dc0b5f70 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0687b0 tx=0x7f26c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1955087dd5ee10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:34.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.235+0000 7f26db7fe640 1 -- 172.21.15.19:0/3926307196 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c4037070 con 0x7f26dc162060 2024-09-12T02:04:34.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.235+0000 7f26db7fe640 1 -- 172.21.15.19:0/3926307196 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c4032440 con 0x7f26dc162060 2024-09-12T02:04:34.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.235+0000 7f26db7fe640 1 -- 172.21.15.19:0/3926307196 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c4032810 con 0x7f26dc162060 2024-09-12T02:04:34.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.235+0000 7f26e2d0a640 1 -- 172.21.15.19:0/3926307196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26dc162060 msgr2=0x7f26dc0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:34.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.235+0000 7f26e2d0a640 1 --2- 172.21.15.19:0/3926307196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26dc162060 0x7f26dc0b5f70 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0687b0 tx=0x7f26c402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.235+0000 7f26e2d0a640 1 -- 172.21.15.19:0/3926307196 shutdown_connections 2024-09-12T02:04:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.235+0000 7f26e2d0a640 1 --2- 172.21.15.19:0/3926307196 >> v2:172.21.15.135:3300/0 conn(0x7f26dc0b64b0 0x7f26dc0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.235+0000 7f26e2d0a640 1 --2- 172.21.15.19:0/3926307196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26dc162060 0x7f26dc0b5f70 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.235+0000 7f26e2d0a640 1 --2- 172.21.15.19:0/3926307196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26dc161c80 0x7f26dc06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.235+0000 7f26e2d0a640 1 -- 172.21.15.19:0/3926307196 >> 172.21.15.19:0/3926307196 conn(0x7f26dc0d44f0 msgr2=0x7f26dc0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.235+0000 7f26e2d0a640 1 -- 172.21.15.19:0/3926307196 shutdown_connections 2024-09-12T02:04:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.235+0000 7f26e2d0a640 1 -- 172.21.15.19:0/3926307196 wait complete. 2024-09-12T02:04:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.237+0000 7f26e2d0a640 1 Processor -- start 2024-09-12T02:04:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.237+0000 7f26e2d0a640 1 -- start start 2024-09-12T02:04:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26e2d0a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26dc0b64b0 0x7f26dc0b88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26e2d0a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26dc161c80 0x7f26dc0ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26e2d0a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26dc162060 0x7f26dc0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26e2d0a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc162500 con 0x7f26dc162060 2024-09-12T02:04:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26e2d0a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc0d2aa0 con 0x7f26dc161c80 2024-09-12T02:04:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26e2d0a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f26dc162680 con 0x7f26dc0b64b0 2024-09-12T02:04:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26e12a7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26dc162060 0x7f26dc0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26e12a7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26dc162060 0x7f26dc0cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43904/0 (socket says 172.21.15.19:43904) 2024-09-12T02:04:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26e12a7640 1 -- 172.21.15.19:0/1772565002 learned_addr learned my addr 172.21.15.19:0/1772565002 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26e0aa6640 1 --2- 172.21.15.19:0/1772565002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26dc0b64b0 0x7f26dc0b88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26dbfff640 1 --2- 172.21.15.19:0/1772565002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26dc161c80 0x7f26dc0ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26e12a7640 1 -- 172.21.15.19:0/1772565002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26dc0b64b0 msgr2=0x7f26dc0b88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26e12a7640 1 --2- 172.21.15.19:0/1772565002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26dc0b64b0 0x7f26dc0b88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26e12a7640 1 -- 172.21.15.19:0/1772565002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26dc161c80 msgr2=0x7f26dc0ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26e12a7640 1 --2- 172.21.15.19:0/1772565002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26dc161c80 0x7f26dc0ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26e12a7640 1 -- 172.21.15.19:0/1772565002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26dc0b8e00 con 0x7f26dc162060 2024-09-12T02:04:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26e12a7640 1 --2- 172.21.15.19:0/1772565002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26dc162060 0x7f26dc0cb5c0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00ef00 tx=0x7f26cc00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26d97fa640 1 -- 172.21.15.19:0/1772565002 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc018030 con 0x7f26dc162060 2024-09-12T02:04:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26d97fa640 1 -- 172.21.15.19:0/1772565002 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26cc00bd20 con 0x7f26dc162060 2024-09-12T02:04:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26d97fa640 1 -- 172.21.15.19:0/1772565002 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc003bb0 con 0x7f26dc162060 2024-09-12T02:04:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.238+0000 7f26e2d0a640 1 -- 172.21.15.19:0/1772565002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26dc0ce1c0 con 0x7f26dc162060 2024-09-12T02:04:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.239+0000 7f26e2d0a640 1 -- 172.21.15.19:0/1772565002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26dc0c9a70 con 0x7f26dc162060 2024-09-12T02:04:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.240+0000 7f26e2d0a640 1 -- 172.21.15.19:0/1772565002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26dc06e330 con 0x7f26dc162060 2024-09-12T02:04:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.240+0000 7f26d97fa640 1 -- 172.21.15.19:0/1772565002 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f26cc005d10 con 0x7f26dc162060 2024-09-12T02:04:34.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.240+0000 7f26d97fa640 1 --2- 172.21.15.19:0/1772565002 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26bc06be30 0x7f26bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:34.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.241+0000 7f26d97fa640 1 -- 172.21.15.19:0/1772565002 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 7937+0+0 (secure 0 0 0) 0x7f26cc08bd50 con 0x7f26dc162060 2024-09-12T02:04:34.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.241+0000 7f26e0aa6640 1 --2- 172.21.15.19:0/1772565002 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26bc06be30 0x7f26bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:34.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.241+0000 7f26e0aa6640 1 --2- 172.21.15.19:0/1772565002 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26bc06be30 0x7f26bc06e2f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0ccd70 tx=0x7f26d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:34.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.245+0000 7f26d97fa640 1 -- 172.21.15.19:0/1772565002 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26cc08f030 con 0x7f26dc162060 2024-09-12T02:04:34.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.457+0000 7f26e2d0a640 1 -- 172.21.15.19:0/1772565002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26dc0d20a0 con 0x7f26dc162060 2024-09-12T02:04:34.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.457+0000 7f26d97fa640 1 -- 172.21.15.19:0/1772565002 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 194 v194) ==== 95+0+4392 (secure 0 0 0) 0x7f26cc022070 con 0x7f26dc162060 2024-09-12T02:04:34.458 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:34.458 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":194,"btime":"2024-09-12T02:04:33:779216+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7981,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2333858704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2333858704},{"type":"v1","addr":"172.21.15.135:6837","nonce":2333858704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":191}],"filesystems":[{"mdsmap":{"epoch":194,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:33.779160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:34.458 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 194 2024-09-12T02:04:34.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.459+0000 7f26e2d0a640 1 -- 172.21.15.19:0/1772565002 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26bc06be30 msgr2=0x7f26bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:34.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.459+0000 7f26e2d0a640 1 --2- 172.21.15.19:0/1772565002 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26bc06be30 0x7f26bc06e2f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0ccd70 tx=0x7f26d4008040 comp rx=0 tx=0).stop 2024-09-12T02:04:34.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.459+0000 7f26e2d0a640 1 -- 172.21.15.19:0/1772565002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26dc162060 msgr2=0x7f26dc0cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:34.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.459+0000 7f26e2d0a640 1 --2- 172.21.15.19:0/1772565002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26dc162060 0x7f26dc0cb5c0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00ef00 tx=0x7f26cc00b480 comp rx=0 tx=0).stop 2024-09-12T02:04:34.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.459+0000 7f26e2d0a640 1 -- 172.21.15.19:0/1772565002 shutdown_connections 2024-09-12T02:04:34.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.459+0000 7f26e2d0a640 1 --2- 172.21.15.19:0/1772565002 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26bc06be30 0x7f26bc06e2f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.459+0000 7f26e2d0a640 1 --2- 172.21.15.19:0/1772565002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26dc162060 0x7f26dc0cb5c0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.459+0000 7f26e2d0a640 1 --2- 172.21.15.19:0/1772565002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26dc161c80 0x7f26dc0ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.459+0000 7f26e2d0a640 1 --2- 172.21.15.19:0/1772565002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26dc0b64b0 0x7f26dc0b88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.459+0000 7f26e2d0a640 1 -- 172.21.15.19:0/1772565002 >> 172.21.15.19:0/1772565002 conn(0x7f26dc0d44f0 msgr2=0x7f26dc06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:34.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.459+0000 7f26e2d0a640 1 -- 172.21.15.19:0/1772565002 shutdown_connections 2024-09-12T02:04:34.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.459+0000 7f26e2d0a640 1 -- 172.21.15.19:0/1772565002 wait complete. 2024-09-12T02:04:34.470 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:34.471 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.572+0000 7f683a711640 1 Processor -- start 2024-09-12T02:04:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.572+0000 7f683a711640 1 -- start start 2024-09-12T02:04:34.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.573+0000 7f683a711640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6834072d30 0x7f683406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:34.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.573+0000 7f683a711640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68340cdbe0 con 0x7f683415b300 2024-09-12T02:04:34.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.573+0000 7f683a711640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68340cd900 con 0x7f683406f700 2024-09-12T02:04:34.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.573+0000 7f683a711640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f683406fb50 con 0x7f6834072d30 2024-09-12T02:04:34.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.573+0000 7f6833fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f683415b300 0x7f68340cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41356/0 (socket says 172.21.15.19:41356) 2024-09-12T02:04:34.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.573+0000 7f6833fff640 1 -- 172.21.15.19:0/4096170055 learned_addr learned my addr 172.21.15.19:0/4096170055 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:34.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.573+0000 7f68337fe640 1 --2- 172.21.15.19:0/4096170055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6834072d30 0x7f683406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:34.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.574+0000 7f6832ffd640 1 -- 172.21.15.19:0/4096170055 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2165653948 0 0) 0x7f68340cdbe0 con 0x7f683415b300 2024-09-12T02:04:34.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.574+0000 7f6832ffd640 1 -- 172.21.15.19:0/4096170055 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f681c003520 con 0x7f683415b300 2024-09-12T02:04:34.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.574+0000 7f6832ffd640 1 -- 172.21.15.19:0/4096170055 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1409902303 0 0) 0x7f68340cd900 con 0x7f683406f700 2024-09-12T02:04:34.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.574+0000 7f6832ffd640 1 -- 172.21.15.19:0/4096170055 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68340cdbe0 con 0x7f683406f700 2024-09-12T02:04:34.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.574+0000 7f68337fe640 1 -- 172.21.15.19:0/4096170055 >> v1:172.21.15.135:6789/0 conn(0x7f683406f700 legacy=0x7f683415b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:34.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.574+0000 7f68337fe640 1 -- 172.21.15.19:0/4096170055 >> v1:172.21.15.19:6789/0 conn(0x7f683415b300 legacy=0x7f68340cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:34.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.574+0000 7f68337fe640 1 -- 172.21.15.19:0/4096170055 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6834072250 con 0x7f6834072d30 2024-09-12T02:04:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.575+0000 7f68337fe640 1 --2- 172.21.15.19:0/4096170055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6834072d30 0x7f683406f1c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f68280097d0 tx=0x7f682802a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=120f07a86943c462 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.575+0000 7f6832ffd640 1 -- 172.21.15.19:0/4096170055 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828037070 con 0x7f6834072d30 2024-09-12T02:04:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.575+0000 7f6832ffd640 1 -- 172.21.15.19:0/4096170055 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6828032440 con 0x7f6834072d30 2024-09-12T02:04:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.575+0000 7f6832ffd640 1 -- 172.21.15.19:0/4096170055 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68280327f0 con 0x7f6834072d30 2024-09-12T02:04:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.575+0000 7f683a711640 1 -- 172.21.15.19:0/4096170055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6834072d30 msgr2=0x7f683406f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.575+0000 7f683a711640 1 --2- 172.21.15.19:0/4096170055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6834072d30 0x7f683406f1c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f68280097d0 tx=0x7f682802a200 comp rx=0 tx=0).stop 2024-09-12T02:04:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.575+0000 7f683a711640 1 -- 172.21.15.19:0/4096170055 shutdown_connections 2024-09-12T02:04:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.575+0000 7f683a711640 1 --2- 172.21.15.19:0/4096170055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6834072d30 0x7f683406f1c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.575+0000 7f683a711640 1 -- 172.21.15.19:0/4096170055 >> 172.21.15.19:0/4096170055 conn(0x7f6834067d70 msgr2=0x7f683406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:34.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.575+0000 7f683a711640 1 -- 172.21.15.19:0/4096170055 shutdown_connections 2024-09-12T02:04:34.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.575+0000 7f683a711640 1 -- 172.21.15.19:0/4096170055 wait complete. 2024-09-12T02:04:34.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.576+0000 7f683a711640 1 Processor -- start 2024-09-12T02:04:34.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.577+0000 7f683a711640 1 -- start start 2024-09-12T02:04:34.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.577+0000 7f683a711640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f683406f700 0x7f6834140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:34.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.577+0000 7f683a711640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6834072d30 0x7f6834152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:34.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.577+0000 7f683a711640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f683415b300 0x7f68341534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:34.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.577+0000 7f683a711640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f68340cd5c0 con 0x7f683415b300 2024-09-12T02:04:34.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.577+0000 7f683a711640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f68340728a0 con 0x7f683406f700 2024-09-12T02:04:34.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.577+0000 7f683a711640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f68340cffe0 con 0x7f6834072d30 2024-09-12T02:04:34.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.578+0000 7f6838cae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f683415b300 0x7f68341534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:34.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.578+0000 7f6838cae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f683415b300 0x7f68341534e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43906/0 (socket says 172.21.15.19:43906) 2024-09-12T02:04:34.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.578+0000 7f6838cae640 1 -- 172.21.15.19:0/1803547280 learned_addr learned my addr 172.21.15.19:0/1803547280 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:34.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.578+0000 7f6833fff640 1 --2- 172.21.15.19:0/1803547280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f683406f700 0x7f6834140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:34.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.578+0000 7f68337fe640 1 --2- 172.21.15.19:0/1803547280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6834072d30 0x7f6834152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:34.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.578+0000 7f6838cae640 1 -- 172.21.15.19:0/1803547280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6834072d30 msgr2=0x7f6834152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:34.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.578+0000 7f6838cae640 1 --2- 172.21.15.19:0/1803547280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6834072d30 0x7f6834152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.578+0000 7f6838cae640 1 -- 172.21.15.19:0/1803547280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f683406f700 msgr2=0x7f6834140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:34.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.578+0000 7f6838cae640 1 --2- 172.21.15.19:0/1803547280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f683406f700 0x7f6834140d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.578+0000 7f6838cae640 1 -- 172.21.15.19:0/1803547280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6834151a30 con 0x7f683415b300 2024-09-12T02:04:34.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.578+0000 7f68337fe640 1 --2- 172.21.15.19:0/1803547280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6834072d30 0x7f6834152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:34.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.578+0000 7f6838cae640 1 --2- 172.21.15.19:0/1803547280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f683415b300 0x7f68341534e0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f682c00c790 tx=0x7f682c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:34.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.578+0000 7f6830ff9640 1 -- 172.21.15.19:0/1803547280 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c003b70 con 0x7f683415b300 2024-09-12T02:04:34.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.578+0000 7f6830ff9640 1 -- 172.21.15.19:0/1803547280 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f682c003d10 con 0x7f683415b300 2024-09-12T02:04:34.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.578+0000 7f683a711640 1 -- 172.21.15.19:0/1803547280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6834151d10 con 0x7f683415b300 2024-09-12T02:04:34.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.578+0000 7f6830ff9640 1 -- 172.21.15.19:0/1803547280 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c00aa50 con 0x7f683415b300 2024-09-12T02:04:34.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.578+0000 7f683a711640 1 -- 172.21.15.19:0/1803547280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68341522d0 con 0x7f683415b300 2024-09-12T02:04:34.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.579+0000 7f683a711640 1 -- 172.21.15.19:0/1803547280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68340b4870 con 0x7f683415b300 2024-09-12T02:04:34.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.580+0000 7f6830ff9640 1 -- 172.21.15.19:0/1803547280 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f682c00abf0 con 0x7f683415b300 2024-09-12T02:04:34.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.580+0000 7f6830ff9640 1 --2- 172.21.15.19:0/1803547280 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f682006be30 0x7f682006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:34.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.580+0000 7f6830ff9640 1 -- 172.21.15.19:0/1803547280 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 7937+0+0 (secure 0 0 0) 0x7f682c08b650 con 0x7f683415b300 2024-09-12T02:04:34.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.580+0000 7f6833fff640 1 --2- 172.21.15.19:0/1803547280 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f682006be30 0x7f682006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:34.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.581+0000 7f6833fff640 1 --2- 172.21.15.19:0/1803547280 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f682006be30 0x7f682006e2f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f68240011e0 tx=0x7f6824007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:34.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.584+0000 7f6830ff9640 1 -- 172.21.15.19:0/1803547280 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f682c059740 con 0x7f683415b300 2024-09-12T02:04:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.793+0000 7f683a711640 1 -- 172.21.15.19:0/1803547280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68340b4590 con 0x7f683415b300 2024-09-12T02:04:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.794+0000 7f6830ff9640 1 -- 172.21.15.19:0/1803547280 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 194 v194) ==== 95+0+4392 (secure 0 0 0) 0x7f682c059040 con 0x7f683415b300 2024-09-12T02:04:34.794 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:34.794 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":194,"btime":"2024-09-12T02:04:33:779216+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7981,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2333858704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2333858704},{"type":"v1","addr":"172.21.15.135:6837","nonce":2333858704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":191}],"filesystems":[{"mdsmap":{"epoch":194,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:33.779160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 194 2024-09-12T02:04:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.796+0000 7f683a711640 1 -- 172.21.15.19:0/1803547280 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f682006be30 msgr2=0x7f682006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.796+0000 7f683a711640 1 --2- 172.21.15.19:0/1803547280 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f682006be30 0x7f682006e2f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f68240011e0 tx=0x7f6824007d30 comp rx=0 tx=0).stop 2024-09-12T02:04:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.796+0000 7f683a711640 1 -- 172.21.15.19:0/1803547280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f683415b300 msgr2=0x7f68341534e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.796+0000 7f683a711640 1 --2- 172.21.15.19:0/1803547280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f683415b300 0x7f68341534e0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f682c00c790 tx=0x7f682c00cc50 comp rx=0 tx=0).stop 2024-09-12T02:04:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.796+0000 7f683a711640 1 -- 172.21.15.19:0/1803547280 shutdown_connections 2024-09-12T02:04:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.796+0000 7f683a711640 1 --2- 172.21.15.19:0/1803547280 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f682006be30 0x7f682006e2f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.796+0000 7f683a711640 1 --2- 172.21.15.19:0/1803547280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f683415b300 0x7f68341534e0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.796+0000 7f683a711640 1 --2- 172.21.15.19:0/1803547280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6834072d30 0x7f6834152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.796+0000 7f683a711640 1 --2- 172.21.15.19:0/1803547280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f683406f700 0x7f6834140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.796+0000 7f683a711640 1 -- 172.21.15.19:0/1803547280 >> 172.21.15.19:0/1803547280 conn(0x7f6834067d70 msgr2=0x7f68340af990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.796+0000 7f683a711640 1 -- 172.21.15.19:0/1803547280 shutdown_connections 2024-09-12T02:04:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:34.796+0000 7f683a711640 1 -- 172.21.15.19:0/1803547280 wait complete. 2024-09-12T02:04:34.807 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt mds_snaptable' led to DAMAGED state 2024-09-12T02:04:34.807 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt mds0_inotable' 2024-09-12T02:04:34.807 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:04:34.808 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:04:34.824 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:04:34.824 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:04:34.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:34.824 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:04:34.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:04:34.880 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:04:34.880 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:04:35.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.023+0000 7f25362ae640 1 Processor -- start 2024-09-12T02:04:35.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.023+0000 7f25362ae640 1 -- start start 2024-09-12T02:04:35.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.024+0000 7f25362ae640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f25300d1540 0x7f253006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:35.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.024+0000 7f25362ae640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f253009b690 0x7f253006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:35.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.024+0000 7f25362ae640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25300d1970 con 0x7f253015e740 2024-09-12T02:04:35.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.024+0000 7f25362ae640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f253015eb20 con 0x7f25300d1540 2024-09-12T02:04:35.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.024+0000 7f25362ae640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f253006d260 con 0x7f253009b690 2024-09-12T02:04:35.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.025+0000 7f253484b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f253009b690 0x7f253006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:35.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.025+0000 7f252f7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f25300d1540 0x7f253006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:35.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.025+0000 7f253484b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f253009b690 0x7f253006cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:44412/0 (socket says 172.21.15.19:44412) 2024-09-12T02:04:35.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.025+0000 7f253484b640 1 -- 172.21.15.19:0/4223126548 learned_addr learned my addr 172.21.15.19:0/4223126548 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:35.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.025+0000 7f252ffff640 1 --1- 172.21.15.19:0/4223126548 >> v1:172.21.15.135:6789/0 conn(0x7f253015e740 0x7f253006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:40864/0 (socket says 172.21.15.19:40864) 2024-09-12T02:04:35.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.025+0000 7f253484b640 1 -- 172.21.15.19:0/4223126548 >> v2:172.21.15.135:3300/0 conn(0x7f25300d1540 msgr2=0x7f253006dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:35.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.025+0000 7f253484b640 1 --2- 172.21.15.19:0/4223126548 >> v2:172.21.15.135:3300/0 conn(0x7f25300d1540 0x7f253006dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:35.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.025+0000 7f253484b640 1 -- 172.21.15.19:0/4223126548 >> v1:172.21.15.135:6789/0 conn(0x7f253015e740 legacy=0x7f253006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:35.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.025+0000 7f253484b640 1 -- 172.21.15.19:0/4223126548 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25300d0780 con 0x7f253009b690 2024-09-12T02:04:35.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.025+0000 7f252effd640 1 -- 172.21.15.19:0/4223126548 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2517277479 0 0) 0x7f25300d1970 con 0x7f253015e740 2024-09-12T02:04:35.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.025+0000 7f252f7fe640 1 --2- 172.21.15.19:0/4223126548 >> v2:172.21.15.135:3300/0 conn(0x7f25300d1540 0x7f253006dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:35.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.026+0000 7f253484b640 1 --2- 172.21.15.19:0/4223126548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f253009b690 0x7f253006cd20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2528009e50 tx=0x7f252802a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e65c65eddef5be3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:35.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.026+0000 7f252effd640 1 -- 172.21.15.19:0/4223126548 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2528036070 con 0x7f253009b690 2024-09-12T02:04:35.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.026+0000 7f252effd640 1 -- 172.21.15.19:0/4223126548 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2528031600 con 0x7f253009b690 2024-09-12T02:04:35.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.026+0000 7f252effd640 1 -- 172.21.15.19:0/4223126548 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25280319d0 con 0x7f253009b690 2024-09-12T02:04:35.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.026+0000 7f25362ae640 1 -- 172.21.15.19:0/4223126548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f253009b690 msgr2=0x7f253006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:35.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.026+0000 7f25362ae640 1 --2- 172.21.15.19:0/4223126548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f253009b690 0x7f253006cd20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2528009e50 tx=0x7f252802a7a0 comp rx=0 tx=0).stop 2024-09-12T02:04:35.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.026+0000 7f25362ae640 1 -- 172.21.15.19:0/4223126548 shutdown_connections 2024-09-12T02:04:35.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.026+0000 7f25362ae640 1 --2- 172.21.15.19:0/4223126548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f253009b690 0x7f253006cd20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:35.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.027+0000 7f25362ae640 1 --2- 172.21.15.19:0/4223126548 >> v2:172.21.15.135:3300/0 conn(0x7f25300d1540 0x7f253006dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:35.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.027+0000 7f25362ae640 1 -- 172.21.15.19:0/4223126548 >> 172.21.15.19:0/4223126548 conn(0x7f25300d23a0 msgr2=0x7f25300d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:35.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.027+0000 7f25362ae640 1 -- 172.21.15.19:0/4223126548 shutdown_connections 2024-09-12T02:04:35.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.027+0000 7f25362ae640 1 -- 172.21.15.19:0/4223126548 wait complete. 2024-09-12T02:04:35.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.028+0000 7f25362ae640 1 Processor -- start 2024-09-12T02:04:35.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.028+0000 7f25362ae640 1 -- start start 2024-09-12T02:04:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.029+0000 7f25362ae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253009b690 0x7f2530156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.029+0000 7f25362ae640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25300d1540 0x7f25300c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.029+0000 7f25362ae640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f253015e740 0x7f25300b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.029+0000 7f25362ae640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f25300d1020 con 0x7f253009b690 2024-09-12T02:04:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.029+0000 7f25362ae640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f25300d0d40 con 0x7f253015e740 2024-09-12T02:04:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.029+0000 7f25362ae640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f253009bac0 con 0x7f25300d1540 2024-09-12T02:04:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.029+0000 7f252ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253009b690 0x7f2530156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.029+0000 7f252ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253009b690 0x7f2530156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43916/0 (socket says 172.21.15.19:43916) 2024-09-12T02:04:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.029+0000 7f252ffff640 1 -- 172.21.15.19:0/4042108185 learned_addr learned my addr 172.21.15.19:0/4042108185 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.029+0000 7f253484b640 1 --2- 172.21.15.19:0/4042108185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f253015e740 0x7f25300b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.029+0000 7f252f7fe640 1 --2- 172.21.15.19:0/4042108185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25300d1540 0x7f25300c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.029+0000 7f252ffff640 1 -- 172.21.15.19:0/4042108185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25300d1540 msgr2=0x7f25300c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.029+0000 7f252ffff640 1 --2- 172.21.15.19:0/4042108185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25300d1540 0x7f25300c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:35.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.029+0000 7f252ffff640 1 -- 172.21.15.19:0/4042108185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f253015e740 msgr2=0x7f25300b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:35.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.029+0000 7f252ffff640 1 --2- 172.21.15.19:0/4042108185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f253015e740 0x7f25300b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:35.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.029+0000 7f252ffff640 1 -- 172.21.15.19:0/4042108185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2530158300 con 0x7f253009b690 2024-09-12T02:04:35.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.029+0000 7f252ffff640 1 --2- 172.21.15.19:0/4042108185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253009b690 0x7f2530156aa0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f252000c4d0 tx=0x7f252000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:35.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.030+0000 7f252cff9640 1 -- 172.21.15.19:0/4042108185 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2520018070 con 0x7f253009b690 2024-09-12T02:04:35.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.030+0000 7f252cff9640 1 -- 172.21.15.19:0/4042108185 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2520007500 con 0x7f253009b690 2024-09-12T02:04:35.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.030+0000 7f25362ae640 1 -- 172.21.15.19:0/4042108185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25301585e0 con 0x7f253009b690 2024-09-12T02:04:35.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.030+0000 7f252cff9640 1 -- 172.21.15.19:0/4042108185 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2520004a20 con 0x7f253009b690 2024-09-12T02:04:35.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.030+0000 7f25362ae640 1 -- 172.21.15.19:0/4042108185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2530158ba0 con 0x7f253009b690 2024-09-12T02:04:35.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.031+0000 7f25362ae640 1 -- 172.21.15.19:0/4042108185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f253006cd20 con 0x7f253009b690 2024-09-12T02:04:35.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.031+0000 7f252cff9640 1 -- 172.21.15.19:0/4042108185 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f252001b070 con 0x7f253009b690 2024-09-12T02:04:35.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.032+0000 7f252cff9640 1 --2- 172.21.15.19:0/4042108185 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f251c06be30 0x7f251c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:35.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.032+0000 7f252cff9640 1 -- 172.21.15.19:0/4042108185 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 7937+0+0 (secure 0 0 0) 0x7f252008a8e0 con 0x7f253009b690 2024-09-12T02:04:35.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.032+0000 7f252f7fe640 1 --2- 172.21.15.19:0/4042108185 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f251c06be30 0x7f251c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:35.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.032+0000 7f252f7fe640 1 --2- 172.21.15.19:0/4042108185 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f251c06be30 0x7f251c06e2f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2524009560 tx=0x7f2524009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:35.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.036+0000 7f252cff9640 1 -- 172.21.15.19:0/4042108185 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2520058410 con 0x7f253009b690 2024-09-12T02:04:35.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.246+0000 7f25362ae640 1 -- 172.21.15.19:0/4042108185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f25300d1cb0 con 0x7f253009b690 2024-09-12T02:04:35.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.785+0000 7f252cff9640 1 -- 172.21.15.19:0/4042108185 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v195) ==== 161+0+0 (secure 0 0 0) 0x7f252005c710 con 0x7f253009b690 2024-09-12T02:04:35.785 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:04:35.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.787+0000 7f25362ae640 1 -- 172.21.15.19:0/4042108185 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f251c06be30 msgr2=0x7f251c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:35.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.787+0000 7f25362ae640 1 --2- 172.21.15.19:0/4042108185 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f251c06be30 0x7f251c06e2f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2524009560 tx=0x7f2524009190 comp rx=0 tx=0).stop 2024-09-12T02:04:35.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.787+0000 7f25362ae640 1 -- 172.21.15.19:0/4042108185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253009b690 msgr2=0x7f2530156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:35.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.787+0000 7f25362ae640 1 --2- 172.21.15.19:0/4042108185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253009b690 0x7f2530156aa0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f252000c4d0 tx=0x7f252000c990 comp rx=0 tx=0).stop 2024-09-12T02:04:35.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.787+0000 7f25362ae640 1 -- 172.21.15.19:0/4042108185 shutdown_connections 2024-09-12T02:04:35.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.787+0000 7f25362ae640 1 --2- 172.21.15.19:0/4042108185 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f251c06be30 0x7f251c06e2f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:35.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.787+0000 7f25362ae640 1 --2- 172.21.15.19:0/4042108185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f253015e740 0x7f25300b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:35.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.787+0000 7f25362ae640 1 --2- 172.21.15.19:0/4042108185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25300d1540 0x7f25300c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:35.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.787+0000 7f25362ae640 1 --2- 172.21.15.19:0/4042108185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253009b690 0x7f2530156aa0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:35.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.787+0000 7f25362ae640 1 -- 172.21.15.19:0/4042108185 >> 172.21.15.19:0/4042108185 conn(0x7f25300d23a0 msgr2=0x7f2530071830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:35.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.787+0000 7f25362ae640 1 -- 172.21.15.19:0/4042108185 shutdown_connections 2024-09-12T02:04:35.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.787+0000 7f25362ae640 1 -- 172.21.15.19:0/4042108185 wait complete. 2024-09-12T02:04:35.799 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:04:35.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.904+0000 7f6741a74640 1 Processor -- start 2024-09-12T02:04:35.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.904+0000 7f6741a74640 1 -- start start 2024-09-12T02:04:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.905+0000 7f6741a74640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f673c15e5f0 0x7f673c0d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.905+0000 7f6741a74640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f673c0d30f0 0x7f673c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.905+0000 7f6741a74640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f673c0b64c0 0x7f673c0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.905+0000 7f6741a74640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f673c06d530 con 0x7f673c15e5f0 2024-09-12T02:04:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.905+0000 7f6741a74640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f673c0d3690 con 0x7f673c0d30f0 2024-09-12T02:04:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.905+0000 7f6741a74640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f673c0d3970 con 0x7f673c0b64c0 2024-09-12T02:04:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.905+0000 7f673b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f673c15e5f0 0x7f673c0d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.905+0000 7f673b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f673c15e5f0 0x7f673c0d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43922/0 (socket says 172.21.15.19:43922) 2024-09-12T02:04:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.905+0000 7f673b7fe640 1 -- 172.21.15.19:0/1677843679 learned_addr learned my addr 172.21.15.19:0/1677843679 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.905+0000 7f673b7fe640 1 -- 172.21.15.19:0/1677843679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f673c0b64c0 msgr2=0x7f673c0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.905+0000 7f673b7fe640 1 --2- 172.21.15.19:0/1677843679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f673c0b64c0 0x7f673c0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:35.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.905+0000 7f673b7fe640 1 -- 172.21.15.19:0/1677843679 >> v2:172.21.15.135:3300/0 conn(0x7f673c0d30f0 msgr2=0x7f673c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:35.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.905+0000 7f673b7fe640 1 --2- 172.21.15.19:0/1677843679 >> v2:172.21.15.135:3300/0 conn(0x7f673c0d30f0 0x7f673c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:35.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.905+0000 7f673b7fe640 1 -- 172.21.15.19:0/1677843679 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673c06cee0 con 0x7f673c15e5f0 2024-09-12T02:04:35.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.906+0000 7f673b7fe640 1 --2- 172.21.15.19:0/1677843679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673c15e5f0 0x7f673c0d4dd0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f673c08e520 tx=0x7f672c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788335e4fa83870e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:35.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.906+0000 7f673a7fc640 1 -- 172.21.15.19:0/1677843679 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672c037070 con 0x7f673c15e5f0 2024-09-12T02:04:35.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.906+0000 7f673a7fc640 1 -- 172.21.15.19:0/1677843679 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f672c032440 con 0x7f673c15e5f0 2024-09-12T02:04:35.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.906+0000 7f673a7fc640 1 -- 172.21.15.19:0/1677843679 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672c032810 con 0x7f673c15e5f0 2024-09-12T02:04:35.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.907+0000 7f6741a74640 1 -- 172.21.15.19:0/1677843679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673c15e5f0 msgr2=0x7f673c0d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:35.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.907+0000 7f6741a74640 1 --2- 172.21.15.19:0/1677843679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673c15e5f0 0x7f673c0d4dd0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f673c08e520 tx=0x7f672c02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:04:35.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.907+0000 7f6741a74640 1 -- 172.21.15.19:0/1677843679 shutdown_connections 2024-09-12T02:04:35.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.907+0000 7f6741a74640 1 --2- 172.21.15.19:0/1677843679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f673c0b64c0 0x7f673c0cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:35.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.907+0000 7f6741a74640 1 --2- 172.21.15.19:0/1677843679 >> v2:172.21.15.135:3300/0 conn(0x7f673c0d30f0 0x7f673c0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:35.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.907+0000 7f6741a74640 1 --2- 172.21.15.19:0/1677843679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673c15e5f0 0x7f673c0d4dd0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:35.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.907+0000 7f6741a74640 1 -- 172.21.15.19:0/1677843679 >> 172.21.15.19:0/1677843679 conn(0x7f673c08bfc0 msgr2=0x7f673c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:35.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.907+0000 7f6741a74640 1 -- 172.21.15.19:0/1677843679 shutdown_connections 2024-09-12T02:04:35.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.907+0000 7f6741a74640 1 -- 172.21.15.19:0/1677843679 wait complete. 2024-09-12T02:04:35.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.908+0000 7f6741a74640 1 Processor -- start 2024-09-12T02:04:35.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.908+0000 7f6741a74640 1 -- start start 2024-09-12T02:04:35.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.909+0000 7f6741a74640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f673c0b64c0 0x7f673c15c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:35.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.909+0000 7f6741a74640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f673c0d30f0 0x7f673c160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:35.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.909+0000 7f6741a74640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673c15e5f0 0x7f673c161260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:35.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.909+0000 7f6741a74640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f673c0d5310 con 0x7f673c15e5f0 2024-09-12T02:04:35.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.909+0000 7f6741a74640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f673c15e9d0 con 0x7f673c0d30f0 2024-09-12T02:04:35.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.909+0000 7f6741a74640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f673c0cf540 con 0x7f673c0b64c0 2024-09-12T02:04:35.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.909+0000 7f673bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673c15e5f0 0x7f673c161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:35.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.909+0000 7f673bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673c15e5f0 0x7f673c161260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43934/0 (socket says 172.21.15.19:43934) 2024-09-12T02:04:35.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.909+0000 7f673bfff640 1 -- 172.21.15.19:0/804141690 learned_addr learned my addr 172.21.15.19:0/804141690 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:35.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.909+0000 7f673b7fe640 1 --2- 172.21.15.19:0/804141690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f673c0b64c0 0x7f673c15c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:35.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.909+0000 7f673affd640 1 --2- 172.21.15.19:0/804141690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f673c0d30f0 0x7f673c160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:35.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.909+0000 7f673bfff640 1 -- 172.21.15.19:0/804141690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f673c0b64c0 msgr2=0x7f673c15c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:35.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.909+0000 7f673bfff640 1 --2- 172.21.15.19:0/804141690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f673c0b64c0 0x7f673c15c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:35.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.909+0000 7f673bfff640 1 -- 172.21.15.19:0/804141690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f673c0d30f0 msgr2=0x7f673c160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:35.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.909+0000 7f673bfff640 1 --2- 172.21.15.19:0/804141690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f673c0d30f0 0x7f673c160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:35.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.909+0000 7f673bfff640 1 -- 172.21.15.19:0/804141690 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673c0cb3c0 con 0x7f673c15e5f0 2024-09-12T02:04:35.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.909+0000 7f673b7fe640 1 --2- 172.21.15.19:0/804141690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f673c0b64c0 0x7f673c15c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:35.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.909+0000 7f673affd640 1 --2- 172.21.15.19:0/804141690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f673c0d30f0 0x7f673c160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:35.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.910+0000 7f673bfff640 1 --2- 172.21.15.19:0/804141690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673c15e5f0 0x7f673c161260 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f673400b9a0 tx=0x7f673400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:35.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.910+0000 7f6723fff640 1 -- 172.21.15.19:0/804141690 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734019070 con 0x7f673c15e5f0 2024-09-12T02:04:35.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.910+0000 7f6723fff640 1 -- 172.21.15.19:0/804141690 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f673400cbc0 con 0x7f673c15e5f0 2024-09-12T02:04:35.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.910+0000 7f6741a74640 1 -- 172.21.15.19:0/804141690 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f673c0cab20 con 0x7f673c15e5f0 2024-09-12T02:04:35.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.910+0000 7f6723fff640 1 -- 172.21.15.19:0/804141690 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734014440 con 0x7f673c15e5f0 2024-09-12T02:04:35.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.910+0000 7f6741a74640 1 -- 172.21.15.19:0/804141690 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f673c0cb0e0 con 0x7f673c15e5f0 2024-09-12T02:04:35.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.911+0000 7f6741a74640 1 -- 172.21.15.19:0/804141690 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f673c0b5f80 con 0x7f673c15e5f0 2024-09-12T02:04:35.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.911+0000 7f6723fff640 1 -- 172.21.15.19:0/804141690 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f673401c070 con 0x7f673c15e5f0 2024-09-12T02:04:35.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.912+0000 7f6723fff640 1 --2- 172.21.15.19:0/804141690 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f672806be30 0x7f672806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:35.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.912+0000 7f6723fff640 1 -- 172.21.15.19:0/804141690 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 7937+0+0 (secure 0 0 0) 0x7f673408b470 con 0x7f673c15e5f0 2024-09-12T02:04:35.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.912+0000 7f673b7fe640 1 --2- 172.21.15.19:0/804141690 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f672806be30 0x7f672806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:35.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.913+0000 7f673b7fe640 1 --2- 172.21.15.19:0/804141690 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f672806be30 0x7f672806e2f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f672c034000 tx=0x7f672c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:35.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:35.916+0000 7f6723fff640 1 -- 172.21.15.19:0/804141690 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6734059560 con 0x7f673c15e5f0 2024-09-12T02:04:36.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.162+0000 7f6741a74640 1 -- 172.21.15.19:0/804141690 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f673c0d09f0 con 0x7f673c15e5f0 2024-09-12T02:04:36.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.790+0000 7f6723fff640 1 -- 172.21.15.19:0/804141690 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v196) ==== 101+0+0 (secure 0 0 0) 0x7f6734058e60 con 0x7f673c15e5f0 2024-09-12T02:04:36.790 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:04:36.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.792+0000 7f6741a74640 1 -- 172.21.15.19:0/804141690 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f672806be30 msgr2=0x7f672806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:36.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.792+0000 7f6741a74640 1 --2- 172.21.15.19:0/804141690 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f672806be30 0x7f672806e2f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f672c034000 tx=0x7f672c02e000 comp rx=0 tx=0).stop 2024-09-12T02:04:36.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.792+0000 7f6741a74640 1 -- 172.21.15.19:0/804141690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673c15e5f0 msgr2=0x7f673c161260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:36.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.792+0000 7f6741a74640 1 --2- 172.21.15.19:0/804141690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673c15e5f0 0x7f673c161260 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f673400b9a0 tx=0x7f673400be60 comp rx=0 tx=0).stop 2024-09-12T02:04:36.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.792+0000 7f6741a74640 1 -- 172.21.15.19:0/804141690 shutdown_connections 2024-09-12T02:04:36.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.792+0000 7f6741a74640 1 --2- 172.21.15.19:0/804141690 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f672806be30 0x7f672806e2f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:36.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.792+0000 7f6741a74640 1 --2- 172.21.15.19:0/804141690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673c15e5f0 0x7f673c161260 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:36.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.792+0000 7f6741a74640 1 --2- 172.21.15.19:0/804141690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f673c0d30f0 0x7f673c160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:36.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.792+0000 7f6741a74640 1 --2- 172.21.15.19:0/804141690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f673c0b64c0 0x7f673c15c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:36.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.792+0000 7f6741a74640 1 -- 172.21.15.19:0/804141690 >> 172.21.15.19:0/804141690 conn(0x7f673c08bfc0 msgr2=0x7f673c1e8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:36.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.792+0000 7f6741a74640 1 -- 172.21.15.19:0/804141690 shutdown_connections 2024-09-12T02:04:36.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.792+0000 7f6741a74640 1 -- 172.21.15.19:0/804141690 wait complete. 2024-09-12T02:04:36.805 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:04:36.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.850+0000 7f470c785f40 1 Processor -- start 2024-09-12T02:04:36.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.850+0000 7f470c785f40 1 -- start start 2024-09-12T02:04:36.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.851+0000 7f470c785f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a365802ff0 0x55a3658bc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:36.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.851+0000 7f470c785f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a365830450 0x55a365801e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:36.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.851+0000 7f470c785f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3658c1730 0x55a365802360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:36.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.851+0000 7f470c785f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a365754510 con 0x55a365802ff0 2024-09-12T02:04:36.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.851+0000 7f470c785f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a3657adc50 con 0x55a3658c1730 2024-09-12T02:04:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.851+0000 7f470c785f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55a3658314e0 con 0x55a365830450 2024-09-12T02:04:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.851+0000 7f470a27b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a365802ff0 0x55a3658bc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.851+0000 7f470a27b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a365802ff0 0x55a3658bc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43952/0 (socket says 172.21.15.19:43952) 2024-09-12T02:04:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.851+0000 7f470a27b640 1 -- 172.21.15.19:0/1543493126 learned_addr learned my addr 172.21.15.19:0/1543493126 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.851+0000 7f4709a7a640 1 --2- 172.21.15.19:0/1543493126 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a365830450 0x55a365801e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.851+0000 7f470aa7c640 1 --2- 172.21.15.19:0/1543493126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3658c1730 0x55a365802360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.851+0000 7f470a27b640 1 -- 172.21.15.19:0/1543493126 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a365830450 msgr2=0x55a365801e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.851+0000 7f470a27b640 1 --2- 172.21.15.19:0/1543493126 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a365830450 0x55a365801e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.851+0000 7f470a27b640 1 -- 172.21.15.19:0/1543493126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3658c1730 msgr2=0x55a365802360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.851+0000 7f470a27b640 1 --2- 172.21.15.19:0/1543493126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3658c1730 0x55a365802360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.851+0000 7f470a27b640 1 -- 172.21.15.19:0/1543493126 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a36584ad80 con 0x55a365802ff0 2024-09-12T02:04:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.851+0000 7f4709a7a640 1 --2- 172.21.15.19:0/1543493126 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a365830450 0x55a365801e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.852+0000 7f470a27b640 1 --2- 172.21.15.19:0/1543493126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a365802ff0 0x55a3658bc270 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f46fc057040 tx=0x7f46fc04f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50844c1c7931eeed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.852+0000 7f4708a78640 1 -- 172.21.15.19:0/1543493126 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc04d6f0 con 0x55a365802ff0 2024-09-12T02:04:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.852+0000 7f4708a78640 1 -- 172.21.15.19:0/1543493126 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46fc04d8d0 con 0x55a365802ff0 2024-09-12T02:04:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.852+0000 7f4708a78640 1 -- 172.21.15.19:0/1543493126 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc04dcc0 con 0x55a365802ff0 2024-09-12T02:04:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.852+0000 7f470c785f40 1 -- 172.21.15.19:0/1543493126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a365802ff0 msgr2=0x55a3658bc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.852+0000 7f470c785f40 1 --2- 172.21.15.19:0/1543493126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a365802ff0 0x55a3658bc270 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f46fc057040 tx=0x7f46fc04f000 comp rx=0 tx=0).stop 2024-09-12T02:04:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.852+0000 7f470c785f40 1 -- 172.21.15.19:0/1543493126 shutdown_connections 2024-09-12T02:04:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.852+0000 7f470c785f40 1 --2- 172.21.15.19:0/1543493126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3658c1730 0x55a365802360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.852+0000 7f470c785f40 1 --2- 172.21.15.19:0/1543493126 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a365830450 0x55a365801e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.852+0000 7f470c785f40 1 --2- 172.21.15.19:0/1543493126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a365802ff0 0x55a3658bc270 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.852+0000 7f470c785f40 1 -- 172.21.15.19:0/1543493126 >> 172.21.15.19:0/1543493126 conn(0x55a365803ad0 msgr2=0x55a365803eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.852+0000 7f470c785f40 1 -- 172.21.15.19:0/1543493126 shutdown_connections 2024-09-12T02:04:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.852+0000 7f470c785f40 1 -- 172.21.15.19:0/1543493126 wait complete. 2024-09-12T02:04:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.853+0000 7f470c785f40 1 Processor -- start 2024-09-12T02:04:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.853+0000 7f470c785f40 1 -- start start 2024-09-12T02:04:36.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.853+0000 7f470c785f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a365802ff0 0x55a3658d6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:36.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f470c785f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a365830450 0x55a3658bc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:36.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f470c785f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a3658c1730 0x55a3658bd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:36.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f470c785f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a36584b020 con 0x55a365830450 2024-09-12T02:04:36.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f470c785f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a3658db810 con 0x55a365802ff0 2024-09-12T02:04:36.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f470c785f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55a3658db250 con 0x55a3658c1730 2024-09-12T02:04:36.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f4709a7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a365830450 0x55a3658bc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:36.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f4709a7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a365830450 0x55a3658bc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43960/0 (socket says 172.21.15.19:43960) 2024-09-12T02:04:36.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 learned_addr learned my addr 172.21.15.19:0/951269081 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:36.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f470aa7c640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a3658c1730 0x55a3658bd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:36.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f470a27b640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a365802ff0 0x55a3658d6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:36.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a3658c1730 msgr2=0x55a3658bd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:36.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f4709a7a640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a3658c1730 0x55a3658bd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:36.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a365802ff0 msgr2=0x55a3658d6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:36.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f4709a7a640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a365802ff0 0x55a3658d6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:36.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a36582df90 con 0x55a365830450 2024-09-12T02:04:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f4709a7a640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a365830450 0x55a3658bc910 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f46f400dfb0 tx=0x7f46f4001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f47037fe640 1 -- 172.21.15.19:0/951269081 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f4014020 con 0x55a365830450 2024-09-12T02:04:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f47037fe640 1 -- 172.21.15.19:0/951269081 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f4010620 con 0x55a365830450 2024-09-12T02:04:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a36582e200 con 0x55a365830450 2024-09-12T02:04:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.854+0000 7f47037fe640 1 -- 172.21.15.19:0/951269081 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f4008030 con 0x55a365830450 2024-09-12T02:04:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.855+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3658bf640 con 0x55a365830450 2024-09-12T02:04:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.856+0000 7f47037fe640 1 -- 172.21.15.19:0/951269081 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46f4017020 con 0x55a365830450 2024-09-12T02:04:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.856+0000 7f47037fe640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f46ec06a810 0x7f46ec06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.856+0000 7f47037fe640 1 -- 172.21.15.19:0/951269081 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 7937+0+0 (secure 0 0 0) 0x7f46f408a3a0 con 0x55a365830450 2024-09-12T02:04:36.859 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:04:36.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.857+0000 7f470c785f40 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55a3658b9500 0x55a3658b98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.857+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a3658bce50 con 0x55a3658b9500 2024-09-12T02:04:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.857+0000 7f470a27b640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f46ec06a810 0x7f46ec06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.857+0000 7f470aa7c640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55a3658b9500 0x55a3658b98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.857+0000 7f470aa7c640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55a3658b9500 0x55a3658b98e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.857+0000 7f470a27b640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f46ec06a810 0x7f46ec06ccd0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f46fc061000 tx=0x7f46fc06a040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.859+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v114'598 uv572 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.859+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a3658b9e20 con 0x55a3658b9500 2024-09-12T02:04:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.860+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v114'599 uv599 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.860+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a3658ba1c0 con 0x55a3658b9500 2024-09-12T02:04:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.861+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v114'600 uv600 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.862 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:04:36.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.861+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a3658ba590 con 0x55a3658b9500 2024-09-12T02:04:36.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.862+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v114'601 uv601 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.862+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a3658ba970 con 0x55a3658b9500 2024-09-12T02:04:36.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.863+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v114'602 uv602 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.863+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597d0f0 con 0x55a3658b9500 2024-09-12T02:04:36.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.866+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v114'603 uv603 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.866+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597d490 con 0x55a3658b9500 2024-09-12T02:04:36.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.867+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v114'604 uv578 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.867+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a36597d830 con 0x55a3658b9500 2024-09-12T02:04:36.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.868+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v114'605 uv605 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.868+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597dbd0 con 0x55a3658b9500 2024-09-12T02:04:36.869 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:04:36.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.869+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v114'606 uv606 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.869+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597ebe0 con 0x55a3658b9500 2024-09-12T02:04:36.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.870+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v114'607 uv607 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.870+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597ebe0 con 0x55a3658b9500 2024-09-12T02:04:36.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.871+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v114'608 uv608 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.871+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597dbd0 con 0x55a3658b9500 2024-09-12T02:04:36.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.872+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v114'609 uv609 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.872+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597dbd0 con 0x55a3658b9500 2024-09-12T02:04:36.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.873+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v114'610 uv585 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.873+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a36597dbd0 con 0x55a3658b9500 2024-09-12T02:04:36.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.874+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v114'611 uv611 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.874+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597dbd0 con 0x55a3658b9500 2024-09-12T02:04:36.875 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:04:36.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.875+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v114'612 uv612 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.875+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597ebe0 con 0x55a3658b9500 2024-09-12T02:04:36.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.876+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v114'613 uv613 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.876+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597ebe0 con 0x55a3658b9500 2024-09-12T02:04:36.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.877+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v114'614 uv614 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.877+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597dbd0 con 0x55a3658b9500 2024-09-12T02:04:36.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.878+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v114'615 uv615 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.878+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597e330 con 0x55a3658b9500 2024-09-12T02:04:36.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.879+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v114'616 uv616 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.879+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597e330 con 0x55a3658b9500 2024-09-12T02:04:36.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.880+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v114'617 uv591 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.880+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a36597e330 con 0x55a3658b9500 2024-09-12T02:04:36.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.881+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v114'618 uv618 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.881+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597e330 con 0x55a3658b9500 2024-09-12T02:04:36.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.882+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v114'619 uv619 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.882 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:04:36.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.882+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597f340 con 0x55a3658b9500 2024-09-12T02:04:36.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.883+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v114'620 uv620 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.883+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597f340 con 0x55a3658b9500 2024-09-12T02:04:36.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.884+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v114'621 uv621 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.884+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597e330 con 0x55a3658b9500 2024-09-12T02:04:36.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.885+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v114'622 uv622 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.885+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597e330 con 0x55a3658b9500 2024-09-12T02:04:36.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.886+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v114'623 uv597 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.886+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a36597e330 con 0x55a3658b9500 2024-09-12T02:04:36.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.887+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v114'624 uv624 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.887+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597e330 con 0x55a3658b9500 2024-09-12T02:04:36.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.888+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v114'625 uv625 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.888 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:04:36.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.888+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597f340 con 0x55a3658b9500 2024-09-12T02:04:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.889+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v114'626 uv626 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.889+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597f340 con 0x55a3658b9500 2024-09-12T02:04:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.889+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v114'627 uv627 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.890+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36597e330 con 0x55a3658b9500 2024-09-12T02:04:36.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.891+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v114'628 uv628 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a3658b9500 2024-09-12T02:04:36.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.891+0000 7f470c785f40 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55a36597e840 0x55a365980c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:36.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.891+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365981170 con 0x55a36597e840 2024-09-12T02:04:36.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.891+0000 7f470a27b640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55a36597e840 0x55a365980c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:36.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.891+0000 7f470a27b640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55a36597e840 0x55a365980c30 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:36.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.893+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v114'443 uv426 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.893+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a365981510 con 0x55a36597e840 2024-09-12T02:04:36.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.894+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v114'444 uv444 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.894+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365981970 con 0x55a36597e840 2024-09-12T02:04:36.896 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:04:36.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.895+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v114'445 uv445 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.895+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365982230 con 0x55a36597e840 2024-09-12T02:04:36.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.897+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v114'446 uv446 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.897+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a3659825d0 con 0x55a36597e840 2024-09-12T02:04:36.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.898+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v114'447 uv447 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.898+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365982970 con 0x55a36597e840 2024-09-12T02:04:36.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.899+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v114'448 uv431 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.899+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a365982d10 con 0x55a36597e840 2024-09-12T02:04:36.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.900+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v114'449 uv449 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.900+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365982d10 con 0x55a36597e840 2024-09-12T02:04:36.901 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:04:36.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.901+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v114'450 uv450 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.901+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365982d10 con 0x55a36597e840 2024-09-12T02:04:36.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.902+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v114'451 uv451 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.902+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365982d10 con 0x55a36597e840 2024-09-12T02:04:36.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.904+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v114'452 uv452 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.904+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365982d10 con 0x55a36597e840 2024-09-12T02:04:36.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.905+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v114'453 uv436 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.905+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a365982d10 con 0x55a36597e840 2024-09-12T02:04:36.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.906+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v114'454 uv454 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.906+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365982d10 con 0x55a36597e840 2024-09-12T02:04:36.907 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:04:36.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.907+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v114'455 uv455 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.907+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365982d10 con 0x55a36597e840 2024-09-12T02:04:36.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.908+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v114'456 uv456 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.908+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365982d10 con 0x55a36597e840 2024-09-12T02:04:36.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.909+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v114'457 uv457 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.909+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365982d10 con 0x55a36597e840 2024-09-12T02:04:36.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.910+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v114'458 uv442 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.910+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a365982d10 con 0x55a36597e840 2024-09-12T02:04:36.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.911+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v114'459 uv459 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.911+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365982d10 con 0x55a36597e840 2024-09-12T02:04:36.913 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:04:36.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.912+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v114'460 uv460 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.913+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365984110 con 0x55a36597e840 2024-09-12T02:04:36.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.914+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v114'461 uv461 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.914+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365984110 con 0x55a36597e840 2024-09-12T02:04:36.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.915+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v114'462 uv462 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.915+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365982de0 con 0x55a36597e840 2024-09-12T02:04:36.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.916+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v114'463 uv463 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36597e840 2024-09-12T02:04:36.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.916+0000 7f470c785f40 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55a3659836e0 0x55a365985ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:36.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.916+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365986010 con 0x55a3659836e0 2024-09-12T02:04:36.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.916+0000 7f4709a7a640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55a3659836e0 0x55a365985ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:36.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.916+0000 7f4709a7a640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55a3659836e0 0x55a365985ad0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:36.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.918+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v114'117 uv116 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.918+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a3659863f0 con 0x55a3659836e0 2024-09-12T02:04:36.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.919+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v114'118 uv118 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.919+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a3659868d0 con 0x55a3659836e0 2024-09-12T02:04:36.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.920+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v114'119 uv119 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.920 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:04:36.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.920+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365988180 con 0x55a3659836e0 2024-09-12T02:04:36.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.921+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v114'120 uv120 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.921+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365988520 con 0x55a3659836e0 2024-09-12T02:04:36.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.922+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v114'121 uv121 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.922+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365987170 con 0x55a3659836e0 2024-09-12T02:04:36.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.923+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v114'122 uv122 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.923+0000 7f470c785f40 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55a365987a70 0x55a36598a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:36.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.923+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598ae10 con 0x55a365987a70 2024-09-12T02:04:36.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.924+0000 7f470aa7c640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55a365987a70 0x55a36598a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:36.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.924+0000 7f470aa7c640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55a365987a70 0x55a36598a8d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:36.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.925+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v114'88 uv87 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.925+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a36598ae10 con 0x55a365987a70 2024-09-12T02:04:36.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.926+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v114'89 uv89 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.926+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598ae10 con 0x55a365987a70 2024-09-12T02:04:36.927 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:04:36.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.927+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v114'90 uv90 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.927+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598b220 con 0x55a365987a70 2024-09-12T02:04:36.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.928+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v114'91 uv91 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.929+0000 7f470c785f40 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55a36598b8a0 0x55a36598dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:36.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.929+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e1d0 con 0x55a36598b8a0 2024-09-12T02:04:36.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.929+0000 7f470a27b640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55a36598b8a0 0x55a36598dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:36.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.929+0000 7f470a27b640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55a36598b8a0 0x55a36598dc90 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:36.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.930+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v114'117 uv116 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.930+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e1d0 con 0x55a36598b8a0 2024-09-12T02:04:36.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.931+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v114'118 uv118 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.931+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a36598b8a0 2024-09-12T02:04:36.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.932+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v114'119 uv119 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.933 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:04:36.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.933+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598f600 con 0x55a36598b8a0 2024-09-12T02:04:36.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.934+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v114'120 uv120 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.934+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598f600 con 0x55a36598b8a0 2024-09-12T02:04:36.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.935+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v114'121 uv121 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.935+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a36598b8a0 2024-09-12T02:04:36.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.936+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v114'122 uv122 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.936+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a365987a70 2024-09-12T02:04:36.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.937+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v114'216 uv210 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.937+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a365987a70 2024-09-12T02:04:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.938+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v114'217 uv217 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.938+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a365987a70 2024-09-12T02:04:36.939 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:04:36.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.939+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v114'218 uv218 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.939+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598f600 con 0x55a365987a70 2024-09-12T02:04:36.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.940+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v114'219 uv219 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.940+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598f600 con 0x55a365987a70 2024-09-12T02:04:36.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.941+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v114'220 uv220 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.941+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a365987a70 2024-09-12T02:04:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.942+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v114'221 uv221 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.942+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a365987a70 2024-09-12T02:04:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.944+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v114'222 uv215 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.944+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a365987a70 2024-09-12T02:04:36.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.945+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v114'223 uv223 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.945+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a365987a70 2024-09-12T02:04:36.946 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:04:36.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.946+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v114'224 uv224 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.946+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a365987a70 2024-09-12T02:04:36.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.948+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v114'225 uv225 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.948+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a365987a70 2024-09-12T02:04:36.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.949+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v114'226 uv226 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.949+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a365987a70 2024-09-12T02:04:36.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.950+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v114'97 uv96 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.950+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a365987a70 2024-09-12T02:04:36.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.951+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v114'98 uv98 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.951+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a365987a70 2024-09-12T02:04:36.952 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:04:36.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.952+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v114'99 uv99 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.952+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a365987a70 2024-09-12T02:04:36.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.953+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v114'100 uv100 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.953+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a365987a70 2024-09-12T02:04:36.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.954+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v114'101 uv101 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f470400e040 con 0x55a365987a70 2024-09-12T02:04:36.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.954+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a36598b8a0 2024-09-12T02:04:36.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.955+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v114'117 uv116 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.955+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a36598b8a0 2024-09-12T02:04:36.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.956+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v114'118 uv118 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.956+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a36598b8a0 2024-09-12T02:04:36.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.957+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v114'119 uv119 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.958 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:04:36.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.957+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598f600 con 0x55a36598b8a0 2024-09-12T02:04:36.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.958+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v114'120 uv120 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.958+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598f600 con 0x55a36598b8a0 2024-09-12T02:04:36.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.959+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v114'121 uv121 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.959+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a36598b8a0 2024-09-12T02:04:36.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.960+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v114'122 uv122 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.960+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a36598b8a0 2024-09-12T02:04:36.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.962+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v114'192 uv186 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.962+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a36598b8a0 2024-09-12T02:04:36.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.963+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v114'193 uv193 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.963+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a36598b8a0 2024-09-12T02:04:36.963 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:04:36.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.963+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v114'194 uv194 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.964+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a36598b8a0 2024-09-12T02:04:36.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.966+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v114'195 uv195 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.966+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a36598b8a0 2024-09-12T02:04:36.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.967+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v114'196 uv196 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.967+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a36598b8a0 2024-09-12T02:04:36.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.968+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v114'197 uv191 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.968+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a36598b8a0 2024-09-12T02:04:36.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.969+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v114'198 uv198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.969+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a36598b8a0 2024-09-12T02:04:36.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.970+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v114'199 uv199 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.971 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:04:36.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.970+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a36598e5f0 con 0x55a36598b8a0 2024-09-12T02:04:36.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.971+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v114'200 uv200 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.971+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a3659913f0 con 0x55a36598b8a0 2024-09-12T02:04:36.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.973+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v114'201 uv201 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.973+0000 7f470c785f40 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55a36598f0d0 0x55a3659914c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:36.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.973+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991ab0 con 0x55a36598f0d0 2024-09-12T02:04:36.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.973+0000 7f4709a7a640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55a36598f0d0 0x55a3659914c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:36.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.973+0000 7f4709a7a640 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55a36598f0d0 0x55a3659914c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:36.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.975+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v114'87 uv86 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a36598f0d0 2024-09-12T02:04:36.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.975+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a365991ab0 con 0x55a36598f0d0 2024-09-12T02:04:36.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.976+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v114'88 uv88 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a36598f0d0 2024-09-12T02:04:36.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.976+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991b30 con 0x55a36598f0d0 2024-09-12T02:04:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.977+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v114'89 uv89 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a36598f0d0 2024-09-12T02:04:36.977 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:04:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.977+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991f20 con 0x55a36598f0d0 2024-09-12T02:04:36.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.978+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v114'90 uv90 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a36598f0d0 2024-09-12T02:04:36.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.978+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991f20 con 0x55a36598b8a0 2024-09-12T02:04:36.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.979+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v114'117 uv116 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.979+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a365991f20 con 0x55a36598b8a0 2024-09-12T02:04:36.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.980+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v114'118 uv118 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.980+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991f20 con 0x55a36598b8a0 2024-09-12T02:04:36.981 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:04:36.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.981+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v114'119 uv119 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.981+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365992f30 con 0x55a36598b8a0 2024-09-12T02:04:36.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.983+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v114'120 uv120 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.983+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365992f30 con 0x55a36598b8a0 2024-09-12T02:04:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.984+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v114'121 uv121 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.984+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991f20 con 0x55a36598b8a0 2024-09-12T02:04:36.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.985+0000 7f470a27b640 1 -- 172.21.15.19:0/951269081 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v114'122 uv122 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46fc05b040 con 0x55a36598b8a0 2024-09-12T02:04:36.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.985+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991f20 con 0x55a3659836e0 2024-09-12T02:04:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.986+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v114'99 uv98 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.986+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a365991bb0 con 0x55a3659836e0 2024-09-12T02:04:36.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.987+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v114'100 uv100 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.987+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991bb0 con 0x55a3659836e0 2024-09-12T02:04:36.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.988+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v114'101 uv101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.988 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:04:36.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.988+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991bb0 con 0x55a3659836e0 2024-09-12T02:04:36.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.990+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v114'102 uv102 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.990+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991bb0 con 0x55a3659836e0 2024-09-12T02:04:36.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.991+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v114'103 uv103 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.991+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991bb0 con 0x55a3659836e0 2024-09-12T02:04:36.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.992+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v114'241 uv233 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.992+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a365991bb0 con 0x55a3659836e0 2024-09-12T02:04:36.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.993+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v114'242 uv242 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.993+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991bb0 con 0x55a3659836e0 2024-09-12T02:04:36.994 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:04:36.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.994+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v114'243 uv243 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.994+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991fa0 con 0x55a3659836e0 2024-09-12T02:04:36.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.995+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v114'244 uv244 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.995+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991c60 con 0x55a3659836e0 2024-09-12T02:04:36.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.996+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v114'245 uv245 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.996+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991c60 con 0x55a3659836e0 2024-09-12T02:04:36.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.997+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v114'246 uv240 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.997+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55a365991bb0 con 0x55a3659836e0 2024-09-12T02:04:36.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.997+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v114'247 uv247 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.997+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991bb0 con 0x55a3659836e0 2024-09-12T02:04:36.998 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:04:36.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.998+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v114'248 uv248 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.998+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991bb0 con 0x55a3659836e0 2024-09-12T02:04:36.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.999+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v114'249 uv249 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:36.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:36.999+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365992bc0 con 0x55a3659836e0 2024-09-12T02:04:37.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.000+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v114'250 uv250 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:37.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.000+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991bb0 con 0x55a3659836e0 2024-09-12T02:04:37.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.001+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v114'251 uv251 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:37.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.001+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55a365991fa0 con 0x55a3659836e0 2024-09-12T02:04:37.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f4709a7a640 1 -- 172.21.15.19:0/951269081 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v114'252 uv252 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f46f4020070 con 0x55a3659836e0 2024-09-12T02:04:37.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55a36597e840 msgr2=0x55a365980c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55a36597e840 0x55a365980c30 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55a3658b9500 msgr2=0x55a3658b98e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55a3658b9500 0x55a3658b98e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55a365987a70 msgr2=0x55a36598a8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55a365987a70 0x55a36598a8d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55a36598f0d0 msgr2=0x55a3659914c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55a36598f0d0 0x55a3659914c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55a3659836e0 msgr2=0x55a365985ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55a3659836e0 0x55a365985ad0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55a36598b8a0 msgr2=0x55a36598dc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55a36598b8a0 0x55a36598dc90 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 reap_dead start 2024-09-12T02:04:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470aa7c640 1 -- 172.21.15.19:0/951269081 reap_dead start 2024-09-12T02:04:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f46ec06a810 msgr2=0x7f46ec06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f46ec06a810 0x7f46ec06ccd0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f46fc061000 tx=0x7f46fc06a040 comp rx=0 tx=0).stop 2024-09-12T02:04:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a365830450 msgr2=0x55a3658bc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a365830450 0x55a3658bc910 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f46f400dfb0 tx=0x7f46f4001e90 comp rx=0 tx=0).stop 2024-09-12T02:04:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 shutdown_connections 2024-09-12T02:04:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f46ec06a810 0x7f46ec06ccd0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 --2- 172.21.15.19:0/951269081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a365830450 0x55a3658bc910 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 >> 172.21.15.19:0/951269081 conn(0x55a365803ad0 msgr2=0x55a365803eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:37.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 shutdown_connections 2024-09-12T02:04:37.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.002+0000 7f470c785f40 1 -- 172.21.15.19:0/951269081 wait complete. 2024-09-12T02:04:37.006 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2024-09-12T02:04:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.090+0000 7f3acd20cf40 1 Processor -- start 2024-09-12T02:04:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.090+0000 7f3acd20cf40 1 -- start start 2024-09-12T02:04:37.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3acd20cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56126ccb6350 0x56126ccb56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3acd20cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126cce4050 0x56126cd83f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3acd20cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56126cd6e080 0x56126cd8cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3acd20cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56126cc05510 con 0x56126ccb6350 2024-09-12T02:04:37.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3acd20cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56126cc5ec50 con 0x56126cce4050 2024-09-12T02:04:37.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3acd20cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56126ccb2dc0 con 0x56126cd6e080 2024-09-12T02:04:37.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3ac9f97640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56126ccb6350 0x56126ccb56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3ac9f97640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56126ccb6350 0x56126ccb56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43978/0 (socket says 172.21.15.19:43978) 2024-09-12T02:04:37.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3ac9f97640 1 -- 172.21.15.19:0/1015124441 learned_addr learned my addr 172.21.15.19:0/1015124441 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:37.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3ac1796640 1 --2- 172.21.15.19:0/1015124441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126cce4050 0x56126cd83f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3aca798640 1 --2- 172.21.15.19:0/1015124441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56126cd6e080 0x56126cd8cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3ac9f97640 1 -- 172.21.15.19:0/1015124441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56126cd6e080 msgr2=0x56126cd8cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3ac9f97640 1 --2- 172.21.15.19:0/1015124441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56126cd6e080 0x56126cd8cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3ac9f97640 1 -- 172.21.15.19:0/1015124441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126cce4050 msgr2=0x56126cd83f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3ac9f97640 1 --2- 172.21.15.19:0/1015124441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126cce4050 0x56126cd83f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3ac9f97640 1 -- 172.21.15.19:0/1015124441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56126cd8dfb0 con 0x56126ccb6350 2024-09-12T02:04:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3aca798640 1 --2- 172.21.15.19:0/1015124441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56126cd6e080 0x56126cd8cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3ac1796640 1 --2- 172.21.15.19:0/1015124441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126cce4050 0x56126cd83f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3ac9f97640 1 --2- 172.21.15.19:0/1015124441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56126ccb6350 0x56126ccb56d0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f3abc001d10 tx=0x7f3abc00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2562a393c8386cc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3ac8f95640 1 -- 172.21.15.19:0/1015124441 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc001e60 con 0x56126ccb6350 2024-09-12T02:04:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3ac8f95640 1 -- 172.21.15.19:0/1015124441 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3abc00bd80 con 0x56126ccb6350 2024-09-12T02:04:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.091+0000 7f3ac8f95640 1 -- 172.21.15.19:0/1015124441 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc00f640 con 0x56126ccb6350 2024-09-12T02:04:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.092+0000 7f3acd20cf40 1 -- 172.21.15.19:0/1015124441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56126ccb6350 msgr2=0x56126ccb56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.092+0000 7f3acd20cf40 1 --2- 172.21.15.19:0/1015124441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56126ccb6350 0x56126ccb56d0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f3abc001d10 tx=0x7f3abc00b5b0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.092+0000 7f3acd20cf40 1 -- 172.21.15.19:0/1015124441 shutdown_connections 2024-09-12T02:04:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.092+0000 7f3acd20cf40 1 --2- 172.21.15.19:0/1015124441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56126cd6e080 0x56126cd8cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.092+0000 7f3acd20cf40 1 --2- 172.21.15.19:0/1015124441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126cce4050 0x56126cd83f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.092+0000 7f3acd20cf40 1 --2- 172.21.15.19:0/1015124441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56126ccb6350 0x56126ccb56d0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.092+0000 7f3acd20cf40 1 -- 172.21.15.19:0/1015124441 >> 172.21.15.19:0/1015124441 conn(0x56126ccb39e0 msgr2=0x56126ccfd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:37.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.092+0000 7f3acd20cf40 1 -- 172.21.15.19:0/1015124441 shutdown_connections 2024-09-12T02:04:37.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.092+0000 7f3acd20cf40 1 -- 172.21.15.19:0/1015124441 wait complete. 2024-09-12T02:04:37.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.093+0000 7f3acd20cf40 1 Processor -- start 2024-09-12T02:04:37.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.093+0000 7f3acd20cf40 1 -- start start 2024-09-12T02:04:37.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.093+0000 7f3acd20cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56126ccb6350 0x56126cd8d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.093+0000 7f3acd20cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126cce4050 0x56126cd852e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.093+0000 7f3acd20cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56126cd6e080 0x56126cd85820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.093+0000 7f3acd20cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56126cd73c50 con 0x56126cd6e080 2024-09-12T02:04:37.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.093+0000 7f3acd20cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56126ccb40f0 con 0x56126cce4050 2024-09-12T02:04:37.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.093+0000 7f3acd20cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56126cd8e270 con 0x56126ccb6350 2024-09-12T02:04:37.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.093+0000 7f3aca798640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56126cd6e080 0x56126cd85820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.093+0000 7f3aca798640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56126cd6e080 0x56126cd85820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43982/0 (socket says 172.21.15.19:43982) 2024-09-12T02:04:37.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.093+0000 7f3aca798640 1 -- 172.21.15.19:0/3337732210 learned_addr learned my addr 172.21.15.19:0/3337732210 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:37.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.093+0000 7f3ac9f97640 1 --2- 172.21.15.19:0/3337732210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56126ccb6350 0x56126cd8d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.093+0000 7f3ac1796640 1 --2- 172.21.15.19:0/3337732210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126cce4050 0x56126cd852e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.094+0000 7f3aca798640 1 -- 172.21.15.19:0/3337732210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56126ccb6350 msgr2=0x56126cd8d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.094+0000 7f3aca798640 1 --2- 172.21.15.19:0/3337732210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56126ccb6350 0x56126cd8d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.094+0000 7f3aca798640 1 -- 172.21.15.19:0/3337732210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126cce4050 msgr2=0x56126cd852e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.094+0000 7f3aca798640 1 --2- 172.21.15.19:0/3337732210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126cce4050 0x56126cd852e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.094+0000 7f3aca798640 1 -- 172.21.15.19:0/3337732210 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56126cd87c60 con 0x56126cd6e080 2024-09-12T02:04:37.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.094+0000 7f3aca798640 1 --2- 172.21.15.19:0/3337732210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56126cd6e080 0x56126cd85820 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4025b90 tx=0x7f3ac4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:37.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.094+0000 7f3ac37fe640 1 -- 172.21.15.19:0/3337732210 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac405a040 con 0x56126cd6e080 2024-09-12T02:04:37.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.094+0000 7f3ac37fe640 1 -- 172.21.15.19:0/3337732210 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac4065070 con 0x56126cd6e080 2024-09-12T02:04:37.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.094+0000 7f3acd20cf40 1 -- 172.21.15.19:0/3337732210 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56126cd86ea0 con 0x56126cd6e080 2024-09-12T02:04:37.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.094+0000 7f3ac37fe640 1 -- 172.21.15.19:0/3337732210 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4005a80 con 0x56126cd6e080 2024-09-12T02:04:37.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.094+0000 7f3acd20cf40 1 -- 172.21.15.19:0/3337732210 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56126cd87460 con 0x56126cd6e080 2024-09-12T02:04:37.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.096+0000 7f3ac37fe640 1 -- 172.21.15.19:0/3337732210 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ac4060660 con 0x56126cd6e080 2024-09-12T02:04:37.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.096+0000 7f3ac37fe640 1 --2- 172.21.15.19:0/3337732210 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3aac06a840 0x7f3aac06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.096+0000 7f3ac37fe640 1 -- 172.21.15.19:0/3337732210 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 7937+0+0 (secure 0 0 0) 0x7f3ac40ce120 con 0x56126cd6e080 2024-09-12T02:04:37.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.096+0000 7f3ac9f97640 1 --2- 172.21.15.19:0/3337732210 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3aac06a840 0x7f3aac06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.096+0000 7f3acd20cf40 1 --2- 172.21.15.19:0/3337732210 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x56126cd8d640 0x56126cd88860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.096+0000 7f3acd20cf40 1 -- 172.21.15.19:0/3337732210 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:1 13.13 13:c91d4a1d:::mds0_inotable:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x56126ce252e0 con 0x56126cd8d640 2024-09-12T02:04:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.096+0000 7f3ac1796640 1 --2- 172.21.15.19:0/3337732210 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x56126cd8d640 0x56126cd88860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.097+0000 7f3ac9f97640 1 --2- 172.21.15.19:0/3337732210 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3aac06a840 0x7f3aac06cd00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00b5f0 tx=0x7f3abc009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.097+0000 7f3ac1796640 1 --2- 172.21.15.19:0/3337732210 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x56126cd8d640 0x56126cd88860 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:37.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.098+0000 7f3ac1796640 1 -- 172.21.15.19:0/3337732210 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~80] v114'202 uv202 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f3ab400c3c0 con 0x56126cd8d640 2024-09-12T02:04:37.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.098+0000 7f3acd20cf40 1 -- 172.21.15.19:0/3337732210 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x56126cd8d640 msgr2=0x56126cd88860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.098+0000 7f3acd20cf40 1 --2- 172.21.15.19:0/3337732210 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x56126cd8d640 0x56126cd88860 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.098+0000 7f3acd20cf40 1 -- 172.21.15.19:0/3337732210 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3aac06a840 msgr2=0x7f3aac06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.098+0000 7f3acd20cf40 1 --2- 172.21.15.19:0/3337732210 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3aac06a840 0x7f3aac06cd00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00b5f0 tx=0x7f3abc009000 comp rx=0 tx=0).stop 2024-09-12T02:04:37.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.098+0000 7f3acd20cf40 1 -- 172.21.15.19:0/3337732210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56126cd6e080 msgr2=0x56126cd85820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.098+0000 7f3acd20cf40 1 --2- 172.21.15.19:0/3337732210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56126cd6e080 0x56126cd85820 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4025b90 tx=0x7f3ac4003330 comp rx=0 tx=0).stop 2024-09-12T02:04:37.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.098+0000 7f3aca798640 1 -- 172.21.15.19:0/3337732210 reap_dead start 2024-09-12T02:04:37.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.098+0000 7f3acd20cf40 1 -- 172.21.15.19:0/3337732210 shutdown_connections 2024-09-12T02:04:37.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.098+0000 7f3acd20cf40 1 -- 172.21.15.19:0/3337732210 >> 172.21.15.19:0/3337732210 conn(0x56126ccb39e0 msgr2=0x56126ccfd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:37.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.098+0000 7f3acd20cf40 1 -- 172.21.15.19:0/3337732210 shutdown_connections 2024-09-12T02:04:37.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.098+0000 7f3acd20cf40 1 -- 172.21.15.19:0/3337732210 wait complete. 2024-09-12T02:04:37.103 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:04:37.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.247+0000 7f22069e8640 1 Processor -- start 2024-09-12T02:04:37.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.248+0000 7f22069e8640 1 -- start start 2024-09-12T02:04:37.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.248+0000 7f22069e8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2200162340 0x7f220006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.248+0000 7f22069e8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f220015ff70 con 0x7f22000cf280 2024-09-12T02:04:37.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.248+0000 7f22069e8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22000d4d10 con 0x7f2200162e30 2024-09-12T02:04:37.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.248+0000 7f22069e8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f22001632a0 con 0x7f2200162340 2024-09-12T02:04:37.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.248+0000 7f21fffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2200162340 0x7f220006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.249+0000 7f21ff7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f22000cf280 0x7f2200162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41374/0 (socket says 172.21.15.19:41374) 2024-09-12T02:04:37.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.249+0000 7f21ff7fe640 1 -- 172.21.15.19:0/1887888295 learned_addr learned my addr 172.21.15.19:0/1887888295 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:37.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.249+0000 7f21fffff640 1 -- 172.21.15.19:0/1887888295 >> v1:172.21.15.135:6789/0 conn(0x7f2200162e30 legacy=0x7f22000d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:37.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.249+0000 7f21fffff640 1 -- 172.21.15.19:0/1887888295 >> v1:172.21.15.19:6789/0 conn(0x7f22000cf280 legacy=0x7f2200162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.249+0000 7f21fffff640 1 -- 172.21.15.19:0/1887888295 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22000d4ff0 con 0x7f2200162340 2024-09-12T02:04:37.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.249+0000 7f21feffd640 1 -- 172.21.15.19:0/1887888295 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 968137251 0 0) 0x7f220015ff70 con 0x7f22000cf280 2024-09-12T02:04:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.250+0000 7f21fffff640 1 --2- 172.21.15.19:0/1887888295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2200162340 0x7f220006d740 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f21f00097a0 tx=0x7f21f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b8825032063b4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.250+0000 7f21feffd640 1 -- 172.21.15.19:0/1887888295 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0037070 con 0x7f2200162340 2024-09-12T02:04:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.250+0000 7f21feffd640 1 -- 172.21.15.19:0/1887888295 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f0032440 con 0x7f2200162340 2024-09-12T02:04:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.250+0000 7f21feffd640 1 -- 172.21.15.19:0/1887888295 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0032810 con 0x7f2200162340 2024-09-12T02:04:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.250+0000 7f22069e8640 1 -- 172.21.15.19:0/1887888295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2200162340 msgr2=0x7f220006d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.250+0000 7f22069e8640 1 --2- 172.21.15.19:0/1887888295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2200162340 0x7f220006d740 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f21f00097a0 tx=0x7f21f002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.250+0000 7f22069e8640 1 -- 172.21.15.19:0/1887888295 shutdown_connections 2024-09-12T02:04:37.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.250+0000 7f22069e8640 1 --2- 172.21.15.19:0/1887888295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2200162340 0x7f220006d740 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.250+0000 7f22069e8640 1 -- 172.21.15.19:0/1887888295 >> 172.21.15.19:0/1887888295 conn(0x7f220008bfc0 msgr2=0x7f22000d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:37.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.250+0000 7f22069e8640 1 -- 172.21.15.19:0/1887888295 shutdown_connections 2024-09-12T02:04:37.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.250+0000 7f22069e8640 1 -- 172.21.15.19:0/1887888295 wait complete. 2024-09-12T02:04:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.251+0000 7f22069e8640 1 Processor -- start 2024-09-12T02:04:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.252+0000 7f22069e8640 1 -- start start 2024-09-12T02:04:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.252+0000 7f22069e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22000cf280 0x7f22001559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.252+0000 7f22069e8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2200162340 0x7f22000b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.252+0000 7f22069e8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2200162e30 0x7f22000b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.252+0000 7f22069e8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f22000d52d0 con 0x7f22000cf280 2024-09-12T02:04:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.252+0000 7f22069e8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f220006de90 con 0x7f2200162e30 2024-09-12T02:04:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.252+0000 7f22069e8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f22000cf6c0 con 0x7f2200162340 2024-09-12T02:04:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.252+0000 7f21fffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22000cf280 0x7f22001559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.252+0000 7f21fffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22000cf280 0x7f22001559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44010/0 (socket says 172.21.15.19:44010) 2024-09-12T02:04:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.252+0000 7f21fffff640 1 -- 172.21.15.19:0/4081284725 learned_addr learned my addr 172.21.15.19:0/4081284725 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.253+0000 7f2204f85640 1 --2- 172.21.15.19:0/4081284725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2200162e30 0x7f22000b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.253+0000 7f21ff7fe640 1 --2- 172.21.15.19:0/4081284725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2200162340 0x7f22000b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.253+0000 7f21fffff640 1 -- 172.21.15.19:0/4081284725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2200162340 msgr2=0x7f22000b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.253+0000 7f21fffff640 1 --2- 172.21.15.19:0/4081284725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2200162340 0x7f22000b8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.253+0000 7f21fffff640 1 -- 172.21.15.19:0/4081284725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2200162e30 msgr2=0x7f22000b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.253+0000 7f21fffff640 1 --2- 172.21.15.19:0/4081284725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2200162e30 0x7f22000b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.253+0000 7f21fffff640 1 -- 172.21.15.19:0/4081284725 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2200155f30 con 0x7f22000cf280 2024-09-12T02:04:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.253+0000 7f21fffff640 1 --2- 172.21.15.19:0/4081284725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22000cf280 0x7f22001559f0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f21f00098c0 tx=0x7f21f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.253+0000 7f21fcff9640 1 -- 172.21.15.19:0/4081284725 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0037040 con 0x7f22000cf280 2024-09-12T02:04:37.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.253+0000 7f21fcff9640 1 -- 172.21.15.19:0/4081284725 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f0042070 con 0x7f22000cf280 2024-09-12T02:04:37.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.253+0000 7f22069e8640 1 -- 172.21.15.19:0/4081284725 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22000b4060 con 0x7f22000cf280 2024-09-12T02:04:37.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.253+0000 7f21fcff9640 1 -- 172.21.15.19:0/4081284725 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0030a70 con 0x7f22000cf280 2024-09-12T02:04:37.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.253+0000 7f22069e8640 1 -- 172.21.15.19:0/4081284725 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22000b4620 con 0x7f22000cf280 2024-09-12T02:04:37.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.254+0000 7f22069e8640 1 -- 172.21.15.19:0/4081284725 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22000b4950 con 0x7f22000cf280 2024-09-12T02:04:37.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.255+0000 7f21fcff9640 1 -- 172.21.15.19:0/4081284725 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21f0030c10 con 0x7f22000cf280 2024-09-12T02:04:37.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.255+0000 7f21fcff9640 1 --2- 172.21.15.19:0/4081284725 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f21ec06be30 0x7f21ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.255+0000 7f21fcff9640 1 -- 172.21.15.19:0/4081284725 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 7937+0+0 (secure 0 0 0) 0x7f21f00abfe0 con 0x7f22000cf280 2024-09-12T02:04:37.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.256+0000 7f21ff7fe640 1 --2- 172.21.15.19:0/4081284725 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f21ec06be30 0x7f21ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.256+0000 7f21ff7fe640 1 --2- 172.21.15.19:0/4081284725 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f21ec06be30 0x7f21ec06e2f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f21f4007fd0 tx=0x7f21f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:37.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.260+0000 7f21fcff9640 1 -- 172.21.15.19:0/4081284725 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2200155f30 con 0x7f22000cf280 2024-09-12T02:04:37.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.474+0000 7f22069e8640 1 -- 172.21.15.19:0/4081284725 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f220006d740 con 0x7f22000cf280 2024-09-12T02:04:37.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.794+0000 7f21fcff9640 1 -- 172.21.15.19:0/4081284725 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v197) ==== 162+0+0 (secure 0 0 0) 0x7f21f0079b10 con 0x7f22000cf280 2024-09-12T02:04:37.794 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:04:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.796+0000 7f22069e8640 1 -- 172.21.15.19:0/4081284725 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f21ec06be30 msgr2=0x7f21ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.796+0000 7f22069e8640 1 --2- 172.21.15.19:0/4081284725 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f21ec06be30 0x7f21ec06e2f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f21f4007fd0 tx=0x7f21f4009040 comp rx=0 tx=0).stop 2024-09-12T02:04:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.796+0000 7f22069e8640 1 -- 172.21.15.19:0/4081284725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22000cf280 msgr2=0x7f22001559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.796+0000 7f22069e8640 1 --2- 172.21.15.19:0/4081284725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22000cf280 0x7f22001559f0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f21f00098c0 tx=0x7f21f00046c0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.796+0000 7f22069e8640 1 -- 172.21.15.19:0/4081284725 shutdown_connections 2024-09-12T02:04:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.796+0000 7f22069e8640 1 --2- 172.21.15.19:0/4081284725 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f21ec06be30 0x7f21ec06e2f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.796+0000 7f22069e8640 1 --2- 172.21.15.19:0/4081284725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2200162e30 0x7f22000b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.796+0000 7f22069e8640 1 --2- 172.21.15.19:0/4081284725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2200162340 0x7f22000b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.796+0000 7f22069e8640 1 --2- 172.21.15.19:0/4081284725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22000cf280 0x7f22001559f0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.796+0000 7f22069e8640 1 -- 172.21.15.19:0/4081284725 >> 172.21.15.19:0/4081284725 conn(0x7f220008bfc0 msgr2=0x7f22000d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:37.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.796+0000 7f22069e8640 1 -- 172.21.15.19:0/4081284725 shutdown_connections 2024-09-12T02:04:37.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.796+0000 7f22069e8640 1 -- 172.21.15.19:0/4081284725 wait complete. 2024-09-12T02:04:37.800 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:04:37.801+0000 7f8b3c87f640 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds0_inotable': Decoder at 'virtual void InoTable::decode_state(ceph::buffer::v15_2_0::list::const_iterator&)' v=2 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-09-12T02:04:37.801 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:37.801+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:04:37.801 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:37.801+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:04:37.808 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:37.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.912+0000 7fea94f6f640 1 Processor -- start 2024-09-12T02:04:37.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.912+0000 7fea94f6f640 1 -- start start 2024-09-12T02:04:37.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.913+0000 7fea94f6f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fea90161c80 0x7fea9006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.913+0000 7fea94f6f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea90162060 0x7fea900b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.913+0000 7fea94f6f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9006e870 con 0x7fea900b64b0 2024-09-12T02:04:37.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.913+0000 7fea94f6f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fea9006d9f0 con 0x7fea90161c80 2024-09-12T02:04:37.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.913+0000 7fea94f6f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fea9006dcd0 con 0x7fea90162060 2024-09-12T02:04:37.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.913+0000 7fea8ed9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fea900b64b0 0x7fea90162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41390/0 (socket says 172.21.15.19:41390) 2024-09-12T02:04:37.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.914+0000 7fea8ed9d640 1 -- 172.21.15.19:0/2572073294 learned_addr learned my addr 172.21.15.19:0/2572073294 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:37.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.914+0000 7fea8e59c640 1 --2- 172.21.15.19:0/2572073294 >> v2:172.21.15.135:3300/0 conn(0x7fea90161c80 0x7fea9006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.914+0000 7fea8dd9b640 1 --2- 172.21.15.19:0/2572073294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea90162060 0x7fea900b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.914+0000 7fea8d59a640 1 -- 172.21.15.19:0/2572073294 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1405305948 0 0) 0x7fea88001110 con 0x7fea900b64b0 2024-09-12T02:04:37.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.914+0000 7fea8d59a640 1 -- 172.21.15.19:0/2572073294 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea78003520 con 0x7fea900b64b0 2024-09-12T02:04:37.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.914+0000 7fea8dd9b640 1 -- 172.21.15.19:0/2572073294 >> v2:172.21.15.135:3300/0 conn(0x7fea90161c80 msgr2=0x7fea9006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:37.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.914+0000 7fea8dd9b640 1 --2- 172.21.15.19:0/2572073294 >> v2:172.21.15.135:3300/0 conn(0x7fea90161c80 0x7fea9006e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.914+0000 7fea8d59a640 1 -- 172.21.15.19:0/2572073294 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1893688912 0 0) 0x7fea78003520 con 0x7fea900b64b0 2024-09-12T02:04:37.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.914+0000 7fea8dd9b640 1 -- 172.21.15.19:0/2572073294 >> v1:172.21.15.19:6789/0 conn(0x7fea900b64b0 legacy=0x7fea90162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.914+0000 7fea8dd9b640 1 -- 172.21.15.19:0/2572073294 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9006dfb0 con 0x7fea90162060 2024-09-12T02:04:37.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.914+0000 7fea8e59c640 1 --2- 172.21.15.19:0/2572073294 >> v2:172.21.15.135:3300/0 conn(0x7fea90161c80 0x7fea9006e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:37.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.915+0000 7fea8dd9b640 1 --2- 172.21.15.19:0/2572073294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea90162060 0x7fea900b5f70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fea840097a0 tx=0x7fea8402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=997d8f529ea54ffb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:37.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.915+0000 7fea8d59a640 1 -- 172.21.15.19:0/2572073294 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84037070 con 0x7fea90162060 2024-09-12T02:04:37.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.915+0000 7fea8d59a640 1 -- 172.21.15.19:0/2572073294 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea8402aba0 con 0x7fea90162060 2024-09-12T02:04:37.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.915+0000 7fea8d59a640 1 -- 172.21.15.19:0/2572073294 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea88001840 con 0x7fea90162060 2024-09-12T02:04:37.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.916+0000 7fea94f6f640 1 -- 172.21.15.19:0/2572073294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea90162060 msgr2=0x7fea900b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.916+0000 7fea94f6f640 1 --2- 172.21.15.19:0/2572073294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea90162060 0x7fea900b5f70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fea840097a0 tx=0x7fea8402a110 comp rx=0 tx=0).stop 2024-09-12T02:04:37.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.916+0000 7fea94f6f640 1 -- 172.21.15.19:0/2572073294 shutdown_connections 2024-09-12T02:04:37.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.916+0000 7fea94f6f640 1 --2- 172.21.15.19:0/2572073294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea90162060 0x7fea900b5f70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.916+0000 7fea94f6f640 1 --2- 172.21.15.19:0/2572073294 >> v2:172.21.15.135:3300/0 conn(0x7fea90161c80 0x7fea9006e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.916+0000 7fea94f6f640 1 -- 172.21.15.19:0/2572073294 >> 172.21.15.19:0/2572073294 conn(0x7fea900d44f0 msgr2=0x7fea900d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:37.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.916+0000 7fea94f6f640 1 -- 172.21.15.19:0/2572073294 shutdown_connections 2024-09-12T02:04:37.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.916+0000 7fea94f6f640 1 -- 172.21.15.19:0/2572073294 wait complete. 2024-09-12T02:04:37.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.917+0000 7fea94f6f640 1 Processor -- start 2024-09-12T02:04:37.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.917+0000 7fea94f6f640 1 -- start start 2024-09-12T02:04:37.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.918+0000 7fea94f6f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea900b64b0 0x7fea901f85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.918+0000 7fea94f6f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea90161c80 0x7fea900b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.918+0000 7fea94f6f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea90162060 0x7fea900cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.918+0000 7fea94f6f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fea900d2a10 con 0x7fea90161c80 2024-09-12T02:04:37.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.918+0000 7fea94f6f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea900d2890 con 0x7fea90162060 2024-09-12T02:04:37.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.918+0000 7fea94f6f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fea900b6960 con 0x7fea900b64b0 2024-09-12T02:04:37.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.918+0000 7fea8dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea90161c80 0x7fea900b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.918+0000 7fea8dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea90161c80 0x7fea900b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44026/0 (socket says 172.21.15.19:44026) 2024-09-12T02:04:37.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.918+0000 7fea8dd9b640 1 -- 172.21.15.19:0/1733570785 learned_addr learned my addr 172.21.15.19:0/1733570785 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:37.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.918+0000 7fea8e59c640 1 --2- 172.21.15.19:0/1733570785 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea900b64b0 0x7fea901f85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.918+0000 7fea8ed9d640 1 --2- 172.21.15.19:0/1733570785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea90162060 0x7fea900cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.918+0000 7fea8dd9b640 1 -- 172.21.15.19:0/1733570785 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea900b64b0 msgr2=0x7fea901f85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.918+0000 7fea8dd9b640 1 --2- 172.21.15.19:0/1733570785 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea900b64b0 0x7fea901f85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.918+0000 7fea8dd9b640 1 -- 172.21.15.19:0/1733570785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea90162060 msgr2=0x7fea900cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.918+0000 7fea8dd9b640 1 --2- 172.21.15.19:0/1733570785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea90162060 0x7fea900cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.918+0000 7fea8dd9b640 1 -- 172.21.15.19:0/1733570785 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea900b2b70 con 0x7fea90161c80 2024-09-12T02:04:37.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.919+0000 7fea8dd9b640 1 --2- 172.21.15.19:0/1733570785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea90161c80 0x7fea900b20b0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fea84035040 tx=0x7fea840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:37.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.919+0000 7fea7effd640 1 -- 172.21.15.19:0/1733570785 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84037050 con 0x7fea90161c80 2024-09-12T02:04:37.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.919+0000 7fea7effd640 1 -- 172.21.15.19:0/1733570785 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea84043070 con 0x7fea90161c80 2024-09-12T02:04:37.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.919+0000 7fea94f6f640 1 -- 172.21.15.19:0/1733570785 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea900b2e50 con 0x7fea90161c80 2024-09-12T02:04:37.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.919+0000 7fea7effd640 1 -- 172.21.15.19:0/1733570785 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84006e10 con 0x7fea90161c80 2024-09-12T02:04:37.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.919+0000 7fea94f6f640 1 -- 172.21.15.19:0/1733570785 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea901f8010 con 0x7fea90161c80 2024-09-12T02:04:37.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.920+0000 7fea94f6f640 1 -- 172.21.15.19:0/1733570785 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea90068ea0 con 0x7fea90161c80 2024-09-12T02:04:37.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.920+0000 7fea7effd640 1 -- 172.21.15.19:0/1733570785 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea84048460 con 0x7fea90161c80 2024-09-12T02:04:37.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.921+0000 7fea7effd640 1 --2- 172.21.15.19:0/1733570785 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fea7006be30 0x7fea7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.921+0000 7fea7effd640 1 -- 172.21.15.19:0/1733570785 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 8023+0+0 (secure 0 0 0) 0x7fea840abea0 con 0x7fea90161c80 2024-09-12T02:04:37.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.921+0000 7fea8e59c640 1 --2- 172.21.15.19:0/1733570785 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fea7006be30 0x7fea7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.922+0000 7fea8e59c640 1 --2- 172.21.15.19:0/1733570785 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fea7006be30 0x7fea7006e2f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fea80009bd0 tx=0x7fea8000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:37.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:37.925+0000 7fea7effd640 1 -- 172.21.15.19:0/1733570785 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea840798f0 con 0x7fea90161c80 2024-09-12T02:04:38.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.138+0000 7fea94f6f640 1 -- 172.21.15.19:0/1733570785 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea900ba470 con 0x7fea90161c80 2024-09-12T02:04:38.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.138+0000 7fea7effd640 1 -- 172.21.15.19:0/1733570785 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 199 v199) ==== 95+0+3563 (secure 0 0 0) 0x7fea8407dbf0 con 0x7fea90161c80 2024-09-12T02:04:38.139 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:38.139 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":199,"btime":"2024-09-12T02:04:37:802602+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":199,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:37.802552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:38.139 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 199 2024-09-12T02:04:38.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.140+0000 7fea94f6f640 1 -- 172.21.15.19:0/1733570785 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fea7006be30 msgr2=0x7fea7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.140+0000 7fea94f6f640 1 --2- 172.21.15.19:0/1733570785 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fea7006be30 0x7fea7006e2f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fea80009bd0 tx=0x7fea8000b040 comp rx=0 tx=0).stop 2024-09-12T02:04:38.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.140+0000 7fea94f6f640 1 -- 172.21.15.19:0/1733570785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea90161c80 msgr2=0x7fea900b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.140+0000 7fea94f6f640 1 --2- 172.21.15.19:0/1733570785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea90161c80 0x7fea900b20b0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fea84035040 tx=0x7fea840046c0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.140+0000 7fea94f6f640 1 -- 172.21.15.19:0/1733570785 shutdown_connections 2024-09-12T02:04:38.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.140+0000 7fea94f6f640 1 --2- 172.21.15.19:0/1733570785 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fea7006be30 0x7fea7006e2f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.140+0000 7fea94f6f640 1 --2- 172.21.15.19:0/1733570785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea90162060 0x7fea900cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.140+0000 7fea94f6f640 1 --2- 172.21.15.19:0/1733570785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea90161c80 0x7fea900b20b0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.140+0000 7fea94f6f640 1 --2- 172.21.15.19:0/1733570785 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea900b64b0 0x7fea901f85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.140+0000 7fea94f6f640 1 -- 172.21.15.19:0/1733570785 >> 172.21.15.19:0/1733570785 conn(0x7fea900d44f0 msgr2=0x7fea901563e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:38.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.140+0000 7fea94f6f640 1 -- 172.21.15.19:0/1733570785 shutdown_connections 2024-09-12T02:04:38.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.141+0000 7fea94f6f640 1 -- 172.21.15.19:0/1733570785 wait complete. 2024-09-12T02:04:38.152 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:38.152 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:38.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.254+0000 7fab0a09b640 1 Processor -- start 2024-09-12T02:04:38.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.254+0000 7fab0a09b640 1 -- start start 2024-09-12T02:04:38.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.255+0000 7fab0a09b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab0415e5f0 0x7fab040d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:38.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.255+0000 7fab0a09b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab040d3690 con 0x7fab040d30f0 2024-09-12T02:04:38.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.255+0000 7fab0a09b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab040d3970 con 0x7fab040b6690 2024-09-12T02:04:38.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.255+0000 7fab0a09b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fab0406d530 con 0x7fab0415e5f0 2024-09-12T02:04:38.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.255+0000 7fab02ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fab040d30f0 0x7fab040b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41398/0 (socket says 172.21.15.19:41398) 2024-09-12T02:04:38.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.255+0000 7fab02ffd640 1 -- 172.21.15.19:0/1867110541 learned_addr learned my addr 172.21.15.19:0/1867110541 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:38.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.255+0000 7fab037fe640 1 --2- 172.21.15.19:0/1867110541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab0415e5f0 0x7fab040d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:38.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.255+0000 7fab027fc640 1 -- 172.21.15.19:0/1867110541 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3312477011 0 0) 0x7fab040d3690 con 0x7fab040d30f0 2024-09-12T02:04:38.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.255+0000 7fab027fc640 1 -- 172.21.15.19:0/1867110541 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faaec003520 con 0x7fab040d30f0 2024-09-12T02:04:38.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.255+0000 7fab027fc640 1 -- 172.21.15.19:0/1867110541 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2937646930 0 0) 0x7fab040d3970 con 0x7fab040b6690 2024-09-12T02:04:38.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.255+0000 7fab027fc640 1 -- 172.21.15.19:0/1867110541 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab040d3690 con 0x7fab040b6690 2024-09-12T02:04:38.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.255+0000 7fab037fe640 1 -- 172.21.15.19:0/1867110541 >> v1:172.21.15.135:6789/0 conn(0x7fab040b6690 legacy=0x7fab0406d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.255+0000 7fab037fe640 1 -- 172.21.15.19:0/1867110541 >> v1:172.21.15.19:6789/0 conn(0x7fab040d30f0 legacy=0x7fab040b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.255+0000 7fab037fe640 1 -- 172.21.15.19:0/1867110541 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0406cee0 con 0x7fab0415e5f0 2024-09-12T02:04:38.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.256+0000 7fab037fe640 1 --2- 172.21.15.19:0/1867110541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab0415e5f0 0x7fab040d4dd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faaf40097d0 tx=0x7faaf402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9321ccacd3b50e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:38.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.256+0000 7fab027fc640 1 -- 172.21.15.19:0/1867110541 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf4037070 con 0x7fab0415e5f0 2024-09-12T02:04:38.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.256+0000 7fab027fc640 1 -- 172.21.15.19:0/1867110541 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf4032440 con 0x7fab0415e5f0 2024-09-12T02:04:38.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.256+0000 7fab027fc640 1 -- 172.21.15.19:0/1867110541 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf40327f0 con 0x7fab0415e5f0 2024-09-12T02:04:38.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.257+0000 7fab0a09b640 1 -- 172.21.15.19:0/1867110541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab0415e5f0 msgr2=0x7fab040d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.257+0000 7fab0a09b640 1 --2- 172.21.15.19:0/1867110541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab0415e5f0 0x7fab040d4dd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faaf40097d0 tx=0x7faaf402a210 comp rx=0 tx=0).stop 2024-09-12T02:04:38.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.257+0000 7fab0a09b640 1 -- 172.21.15.19:0/1867110541 shutdown_connections 2024-09-12T02:04:38.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.257+0000 7fab0a09b640 1 --2- 172.21.15.19:0/1867110541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab0415e5f0 0x7fab040d4dd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.257+0000 7fab0a09b640 1 -- 172.21.15.19:0/1867110541 >> 172.21.15.19:0/1867110541 conn(0x7fab0408bfc0 msgr2=0x7fab040d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:38.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.257+0000 7fab0a09b640 1 -- 172.21.15.19:0/1867110541 shutdown_connections 2024-09-12T02:04:38.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.257+0000 7fab0a09b640 1 -- 172.21.15.19:0/1867110541 wait complete. 2024-09-12T02:04:38.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.258+0000 7fab0a09b640 1 Processor -- start 2024-09-12T02:04:38.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.258+0000 7fab0a09b640 1 -- start start 2024-09-12T02:04:38.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.259+0000 7fab0a09b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab040b6690 0x7fab04161360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:38.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.259+0000 7fab0a09b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab040d30f0 0x7fab041584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:38.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.259+0000 7fab0a09b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab0415e5f0 0x7fab04158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:38.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.259+0000 7fab0a09b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fab040d5310 con 0x7fab040b6690 2024-09-12T02:04:38.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.259+0000 7fab0a09b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fab0415e9d0 con 0x7fab0415e5f0 2024-09-12T02:04:38.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.259+0000 7fab0a09b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fab0406e0d0 con 0x7fab040d30f0 2024-09-12T02:04:38.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.259+0000 7fab037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab040b6690 0x7fab04161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:38.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.259+0000 7fab037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab040b6690 0x7fab04161360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44040/0 (socket says 172.21.15.19:44040) 2024-09-12T02:04:38.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.259+0000 7fab037fe640 1 -- 172.21.15.19:0/847906330 learned_addr learned my addr 172.21.15.19:0/847906330 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:38.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.259+0000 7fab02ffd640 1 --2- 172.21.15.19:0/847906330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab040d30f0 0x7fab041584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:38.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.259+0000 7fab03fff640 1 --2- 172.21.15.19:0/847906330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab0415e5f0 0x7fab04158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:38.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.259+0000 7fab037fe640 1 -- 172.21.15.19:0/847906330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab040d30f0 msgr2=0x7fab041584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.259+0000 7fab037fe640 1 --2- 172.21.15.19:0/847906330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab040d30f0 0x7fab041584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.259+0000 7fab037fe640 1 -- 172.21.15.19:0/847906330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab0415e5f0 msgr2=0x7fab04158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.259+0000 7fab037fe640 1 --2- 172.21.15.19:0/847906330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab0415e5f0 0x7fab04158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.259+0000 7fab037fe640 1 -- 172.21.15.19:0/847906330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab040c8cf0 con 0x7fab040b6690 2024-09-12T02:04:38.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.259+0000 7fab02ffd640 1 --2- 172.21.15.19:0/847906330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab040d30f0 0x7fab041584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:38.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.259+0000 7fab03fff640 1 --2- 172.21.15.19:0/847906330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab0415e5f0 0x7fab04158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:38.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.260+0000 7fab037fe640 1 --2- 172.21.15.19:0/847906330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab040b6690 0x7fab04161360 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7faaf4035040 tx=0x7faaf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:38.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.260+0000 7faaebfff640 1 -- 172.21.15.19:0/847906330 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf4037040 con 0x7fab040b6690 2024-09-12T02:04:38.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.260+0000 7faaebfff640 1 -- 172.21.15.19:0/847906330 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf40044c0 con 0x7fab040b6690 2024-09-12T02:04:38.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.260+0000 7fab0a09b640 1 -- 172.21.15.19:0/847906330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab040c8fd0 con 0x7fab040b6690 2024-09-12T02:04:38.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.260+0000 7faaebfff640 1 -- 172.21.15.19:0/847906330 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf40325f0 con 0x7fab040b6690 2024-09-12T02:04:38.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.260+0000 7fab0a09b640 1 -- 172.21.15.19:0/847906330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab04160b60 con 0x7fab040b6690 2024-09-12T02:04:38.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.261+0000 7fab0a09b640 1 -- 172.21.15.19:0/847906330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab040d4dd0 con 0x7fab040b6690 2024-09-12T02:04:38.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.261+0000 7faaebfff640 1 -- 172.21.15.19:0/847906330 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faaf4044020 con 0x7fab040b6690 2024-09-12T02:04:38.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.262+0000 7faaebfff640 1 --2- 172.21.15.19:0/847906330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faaf006be30 0x7faaf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:38.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.262+0000 7faaebfff640 1 -- 172.21.15.19:0/847906330 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 8023+0+0 (secure 0 0 0) 0x7faaf40ab800 con 0x7fab040b6690 2024-09-12T02:04:38.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.262+0000 7fab02ffd640 1 --2- 172.21.15.19:0/847906330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faaf006be30 0x7faaf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:38.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.263+0000 7fab02ffd640 1 --2- 172.21.15.19:0/847906330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faaf006be30 0x7faaf006e2f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7faaf8007fd0 tx=0x7faaf8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:38.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.266+0000 7faaebfff640 1 -- 172.21.15.19:0/847906330 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faaf404b020 con 0x7fab040b6690 2024-09-12T02:04:38.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.479+0000 7fab0a09b640 1 -- 172.21.15.19:0/847906330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab040b3640 con 0x7fab040b6690 2024-09-12T02:04:38.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.480+0000 7faaebfff640 1 -- 172.21.15.19:0/847906330 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 199 v199) ==== 95+0+3563 (secure 0 0 0) 0x7faaf4079800 con 0x7fab040b6690 2024-09-12T02:04:38.480 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:38.481 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":199,"btime":"2024-09-12T02:04:37:802602+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":199,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:37.802552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:38.481 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 199 2024-09-12T02:04:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.482+0000 7fab0a09b640 1 -- 172.21.15.19:0/847906330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faaf006be30 msgr2=0x7faaf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.482+0000 7fab0a09b640 1 --2- 172.21.15.19:0/847906330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faaf006be30 0x7faaf006e2f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7faaf8007fd0 tx=0x7faaf8009040 comp rx=0 tx=0).stop 2024-09-12T02:04:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.482+0000 7fab0a09b640 1 -- 172.21.15.19:0/847906330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab040b6690 msgr2=0x7fab04161360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.482+0000 7fab0a09b640 1 --2- 172.21.15.19:0/847906330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab040b6690 0x7fab04161360 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7faaf4035040 tx=0x7faaf40046c0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.482+0000 7fab0a09b640 1 -- 172.21.15.19:0/847906330 shutdown_connections 2024-09-12T02:04:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.482+0000 7fab0a09b640 1 --2- 172.21.15.19:0/847906330 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faaf006be30 0x7faaf006e2f0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.482+0000 7fab0a09b640 1 --2- 172.21.15.19:0/847906330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab0415e5f0 0x7fab04158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.482+0000 7fab0a09b640 1 --2- 172.21.15.19:0/847906330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab040d30f0 0x7fab041584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.482+0000 7fab0a09b640 1 --2- 172.21.15.19:0/847906330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab040b6690 0x7fab04161360 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.482+0000 7fab0a09b640 1 -- 172.21.15.19:0/847906330 >> 172.21.15.19:0/847906330 conn(0x7fab0408bfc0 msgr2=0x7fab040b5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.482+0000 7fab0a09b640 1 -- 172.21.15.19:0/847906330 shutdown_connections 2024-09-12T02:04:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.482+0000 7fab0a09b640 1 -- 172.21.15.19:0/847906330 wait complete. 2024-09-12T02:04:38.493 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:38.494 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:38.529 INFO:tasks.ceph.mds.c.smithi019.stderr: -35> 2024-09-12T02:04:33.777+0000 7f0980888640 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds_snaptable': Decoder at 'virtual void SnapServer::decode_server_state(ceph::buffer::v15_2_0::list::const_iterator&)' v=5 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-09-12T02:04:38.554 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:04:38.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.597+0000 7f77279c4640 1 Processor -- start 2024-09-12T02:04:38.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.598+0000 7f77279c4640 1 -- start start 2024-09-12T02:04:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.598+0000 7f77279c4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7720161c80 0x7f772006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.598+0000 7f77279c4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f772006e870 con 0x7f7720162060 2024-09-12T02:04:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.598+0000 7f77279c4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f772006d9f0 con 0x7f77200b6680 2024-09-12T02:04:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.598+0000 7f77279c4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f772006dcd0 con 0x7f7720161c80 2024-09-12T02:04:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.598+0000 7f7725760640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7720161c80 0x7f772006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:38.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.598+0000 7f7724f5f640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7720162060 0x7f77200b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41410/0 (socket says 172.21.15.19:41410) 2024-09-12T02:04:38.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.599+0000 7f7724f5f640 1 -- 172.21.15.19:0/825926588 learned_addr learned my addr 172.21.15.19:0/825926588 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:38.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.599+0000 7f7725760640 1 -- 172.21.15.19:0/825926588 >> v1:172.21.15.135:6789/0 conn(0x7f77200b6680 legacy=0x7f77200cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.599+0000 7f7725760640 1 -- 172.21.15.19:0/825926588 >> v1:172.21.15.19:6789/0 conn(0x7f7720162060 legacy=0x7f77200b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.599+0000 7f7725760640 1 -- 172.21.15.19:0/825926588 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772006dfb0 con 0x7f7720161c80 2024-09-12T02:04:38.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.599+0000 7f7717fff640 1 -- 172.21.15.19:0/825926588 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1873544836 0 0) 0x7f7710001110 con 0x7f7720162060 2024-09-12T02:04:38.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.600+0000 7f7725760640 1 --2- 172.21.15.19:0/825926588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7720161c80 0x7f772006e330 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f771c0097a0 tx=0x7f771c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d74cee9a9b47c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:38.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.600+0000 7f7717fff640 1 -- 172.21.15.19:0/825926588 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771c037070 con 0x7f7720161c80 2024-09-12T02:04:38.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.600+0000 7f7717fff640 1 -- 172.21.15.19:0/825926588 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f771c032440 con 0x7f7720161c80 2024-09-12T02:04:38.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.600+0000 7f7717fff640 1 -- 172.21.15.19:0/825926588 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771c032810 con 0x7f7720161c80 2024-09-12T02:04:38.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.600+0000 7f77279c4640 1 -- 172.21.15.19:0/825926588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7720161c80 msgr2=0x7f772006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.600+0000 7f77279c4640 1 --2- 172.21.15.19:0/825926588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7720161c80 0x7f772006e330 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f771c0097a0 tx=0x7f771c02a230 comp rx=0 tx=0).stop 2024-09-12T02:04:38.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.600+0000 7f77279c4640 1 -- 172.21.15.19:0/825926588 shutdown_connections 2024-09-12T02:04:38.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.600+0000 7f77279c4640 1 --2- 172.21.15.19:0/825926588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7720161c80 0x7f772006e330 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.600+0000 7f77279c4640 1 -- 172.21.15.19:0/825926588 >> 172.21.15.19:0/825926588 conn(0x7f77200d44f0 msgr2=0x7f77200d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:38.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.600+0000 7f77279c4640 1 -- 172.21.15.19:0/825926588 shutdown_connections 2024-09-12T02:04:38.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.600+0000 7f77279c4640 1 -- 172.21.15.19:0/825926588 wait complete. 2024-09-12T02:04:38.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.602+0000 7f77279c4640 1 Processor -- start 2024-09-12T02:04:38.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.602+0000 7f77279c4640 1 -- start start 2024-09-12T02:04:38.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.602+0000 7f77279c4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77200b6680 0x7f77200b8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:38.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.602+0000 7f77279c4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7720161c80 0x7f772015ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:38.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.602+0000 7f77279c4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7720162060 0x7f77200b9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:38.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.602+0000 7f77279c4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f77200b6b30 con 0x7f7720162060 2024-09-12T02:04:38.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.602+0000 7f77279c4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f77200d2aa0 con 0x7f7720161c80 2024-09-12T02:04:38.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.602+0000 7f77279c4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f77200b6cb0 con 0x7f77200b6680 2024-09-12T02:04:38.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.602+0000 7f7725f61640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7720162060 0x7f77200b9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:38.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.602+0000 7f7725f61640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7720162060 0x7f77200b9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44070/0 (socket says 172.21.15.19:44070) 2024-09-12T02:04:38.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.602+0000 7f7725f61640 1 -- 172.21.15.19:0/266231755 learned_addr learned my addr 172.21.15.19:0/266231755 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:38.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.603+0000 7f7725760640 1 --2- 172.21.15.19:0/266231755 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77200b6680 0x7f77200b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:38.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.603+0000 7f7724f5f640 1 --2- 172.21.15.19:0/266231755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7720161c80 0x7f772015ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:38.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.603+0000 7f7725f61640 1 -- 172.21.15.19:0/266231755 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77200b6680 msgr2=0x7f77200b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.603+0000 7f7725f61640 1 --2- 172.21.15.19:0/266231755 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77200b6680 0x7f77200b8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.603+0000 7f7725f61640 1 -- 172.21.15.19:0/266231755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7720161c80 msgr2=0x7f772015ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.603+0000 7f7725f61640 1 --2- 172.21.15.19:0/266231755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7720161c80 0x7f772015ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.603+0000 7f7725f61640 1 -- 172.21.15.19:0/266231755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77200b8c40 con 0x7f7720162060 2024-09-12T02:04:38.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.603+0000 7f7725f61640 1 --2- 172.21.15.19:0/266231755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7720162060 0x7f77200b9ce0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f771800c6b0 tx=0x7f771800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:38.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.603+0000 7f7715ffb640 1 -- 172.21.15.19:0/266231755 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7718003b70 con 0x7f7720162060 2024-09-12T02:04:38.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.603+0000 7f7715ffb640 1 -- 172.21.15.19:0/266231755 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7718003d30 con 0x7f7720162060 2024-09-12T02:04:38.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.603+0000 7f77279c4640 1 -- 172.21.15.19:0/266231755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77200b8f20 con 0x7f7720162060 2024-09-12T02:04:38.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.603+0000 7f7715ffb640 1 -- 172.21.15.19:0/266231755 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7718005310 con 0x7f7720162060 2024-09-12T02:04:38.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.603+0000 7f77279c4640 1 -- 172.21.15.19:0/266231755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77200b94e0 con 0x7f7720162060 2024-09-12T02:04:38.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.604+0000 7f77279c4640 1 -- 172.21.15.19:0/266231755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f772006e330 con 0x7f7720162060 2024-09-12T02:04:38.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.605+0000 7f7715ffb640 1 -- 172.21.15.19:0/266231755 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f77180054b0 con 0x7f7720162060 2024-09-12T02:04:38.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.605+0000 7f7715ffb640 1 --2- 172.21.15.19:0/266231755 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f770406be30 0x7f770406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:38.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.605+0000 7f7715ffb640 1 -- 172.21.15.19:0/266231755 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 8023+0+0 (secure 0 0 0) 0x7f771808b390 con 0x7f7720162060 2024-09-12T02:04:38.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.605+0000 7f7725760640 1 --2- 172.21.15.19:0/266231755 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f770406be30 0x7f770406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:38.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.606+0000 7f7725760640 1 --2- 172.21.15.19:0/266231755 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f770406be30 0x7f770406e2f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f771c034000 tx=0x7f771c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:38.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.610+0000 7f7715ffb640 1 -- 172.21.15.19:0/266231755 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7718058e70 con 0x7f7720162060 2024-09-12T02:04:38.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.822+0000 7f77279c4640 1 -- 172.21.15.19:0/266231755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77200d4290 con 0x7f7720162060 2024-09-12T02:04:38.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.822+0000 7f7715ffb640 1 -- 172.21.15.19:0/266231755 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 200 v200) ==== 95+0+4386 (secure 0 0 0) 0x7f771805d170 con 0x7f7720162060 2024-09-12T02:04:38.823 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:38.823 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":200,"btime":"2024-09-12T02:04:38:804050+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":9024,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/626316140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":626316140},{"type":"v1","addr":"172.21.15.19:6834","nonce":626316140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":200}],"filesystems":[{"mdsmap":{"epoch":199,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:37.802552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:38.823 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 200 2024-09-12T02:04:38.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.824+0000 7f77279c4640 1 -- 172.21.15.19:0/266231755 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f770406be30 msgr2=0x7f770406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.824+0000 7f77279c4640 1 --2- 172.21.15.19:0/266231755 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f770406be30 0x7f770406e2f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f771c034000 tx=0x7f771c02e000 comp rx=0 tx=0).stop 2024-09-12T02:04:38.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.824+0000 7f77279c4640 1 -- 172.21.15.19:0/266231755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7720162060 msgr2=0x7f77200b9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.824+0000 7f77279c4640 1 --2- 172.21.15.19:0/266231755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7720162060 0x7f77200b9ce0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f771800c6b0 tx=0x7f771800cb70 comp rx=0 tx=0).stop 2024-09-12T02:04:38.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.824+0000 7f77279c4640 1 -- 172.21.15.19:0/266231755 shutdown_connections 2024-09-12T02:04:38.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.824+0000 7f77279c4640 1 --2- 172.21.15.19:0/266231755 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f770406be30 0x7f770406e2f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.824+0000 7f77279c4640 1 --2- 172.21.15.19:0/266231755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7720162060 0x7f77200b9ce0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.824+0000 7f77279c4640 1 --2- 172.21.15.19:0/266231755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7720161c80 0x7f772015ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.824+0000 7f77279c4640 1 --2- 172.21.15.19:0/266231755 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77200b6680 0x7f77200b8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.824+0000 7f77279c4640 1 -- 172.21.15.19:0/266231755 >> 172.21.15.19:0/266231755 conn(0x7f77200d44f0 msgr2=0x7f77200b4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:38.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.824+0000 7f77279c4640 1 -- 172.21.15.19:0/266231755 shutdown_connections 2024-09-12T02:04:38.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:38.824+0000 7f77279c4640 1 -- 172.21.15.19:0/266231755 wait complete. 2024-09-12T02:04:38.836 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt mds0_inotable' led to DAMAGED state 2024-09-12T02:04:38.836 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt 400.00000000' 2024-09-12T02:04:38.836 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:04:38.836 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:04:38.892 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:04:38.892 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:04:38.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:38.892 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:04:38.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:04:38.948 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:04:38.948 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:04:39.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.091+0000 7f3b07349640 1 Processor -- start 2024-09-12T02:04:39.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.091+0000 7f3b07349640 1 -- start start 2024-09-12T02:04:39.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.092+0000 7f3b07349640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b0015e740 0x7f3b000d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:39.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.092+0000 7f3b07349640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3b0006dbd0 0x7f3b0006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:39.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.092+0000 7f3b07349640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b0006e040 con 0x7f3b0009b690 2024-09-12T02:04:39.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.092+0000 7f3b07349640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f3b0015eb20 con 0x7f3b0006dbd0 2024-09-12T02:04:39.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.092+0000 7f3b07349640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3b0006d260 con 0x7f3b0015e740 2024-09-12T02:04:39.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.092+0000 7f3b048e4640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3b0009b690 0x7f3b0006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41418/0 (socket says 172.21.15.19:41418) 2024-09-12T02:04:39.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.092+0000 7f3b048e4640 1 -- 172.21.15.19:0/2962041295 learned_addr learned my addr 172.21.15.19:0/2962041295 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:39.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.092+0000 7f3b058e6640 1 --2- 172.21.15.19:0/2962041295 >> v2:172.21.15.135:3300/0 conn(0x7f3b0006dbd0 0x7f3b0006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:39.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.092+0000 7f3b050e5640 1 --2- 172.21.15.19:0/2962041295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b0015e740 0x7f3b000d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:39.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.092+0000 7f3af7fff640 1 -- 172.21.15.19:0/2962041295 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1583539448 0 0) 0x7f3b0006e040 con 0x7f3b0009b690 2024-09-12T02:04:39.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.092+0000 7f3af7fff640 1 -- 172.21.15.19:0/2962041295 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3aec003520 con 0x7f3b0009b690 2024-09-12T02:04:39.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.092+0000 7f3b050e5640 1 -- 172.21.15.19:0/2962041295 >> v2:172.21.15.135:3300/0 conn(0x7f3b0006dbd0 msgr2=0x7f3b0006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:39.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.092+0000 7f3b050e5640 1 --2- 172.21.15.19:0/2962041295 >> v2:172.21.15.135:3300/0 conn(0x7f3b0006dbd0 0x7f3b0006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:39.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.092+0000 7f3b050e5640 1 -- 172.21.15.19:0/2962041295 >> v1:172.21.15.19:6789/0 conn(0x7f3b0009b690 legacy=0x7f3b0006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:39.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.092+0000 7f3af7fff640 1 -- 172.21.15.19:0/2962041295 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2687800908 0 0) 0x7f3aec003520 con 0x7f3b0009b690 2024-09-12T02:04:39.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.093+0000 7f3b050e5640 1 -- 172.21.15.19:0/2962041295 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b000d0780 con 0x7f3b0015e740 2024-09-12T02:04:39.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.093+0000 7f3b058e6640 1 --2- 172.21.15.19:0/2962041295 >> v2:172.21.15.135:3300/0 conn(0x7f3b0006dbd0 0x7f3b0006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:39.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.093+0000 7f3b050e5640 1 --2- 172.21.15.19:0/2962041295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b0015e740 0x7f3b000d1540 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0097a0 tx=0x7f3afc02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b8edd7c12a52699 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:39.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.093+0000 7f3af7fff640 1 -- 172.21.15.19:0/2962041295 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc037070 con 0x7f3b0015e740 2024-09-12T02:04:39.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.094+0000 7f3af7fff640 1 -- 172.21.15.19:0/2962041295 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3afc02ac30 con 0x7f3b0015e740 2024-09-12T02:04:39.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.094+0000 7f3af7fff640 1 -- 172.21.15.19:0/2962041295 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af0001670 con 0x7f3b0015e740 2024-09-12T02:04:39.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.094+0000 7f3b07349640 1 -- 172.21.15.19:0/2962041295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b0015e740 msgr2=0x7f3b000d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:39.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.094+0000 7f3b07349640 1 --2- 172.21.15.19:0/2962041295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b0015e740 0x7f3b000d1540 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0097a0 tx=0x7f3afc02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:04:39.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.094+0000 7f3b07349640 1 -- 172.21.15.19:0/2962041295 shutdown_connections 2024-09-12T02:04:39.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.094+0000 7f3b07349640 1 --2- 172.21.15.19:0/2962041295 >> v2:172.21.15.135:3300/0 conn(0x7f3b0006dbd0 0x7f3b0006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:39.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.094+0000 7f3b07349640 1 --2- 172.21.15.19:0/2962041295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b0015e740 0x7f3b000d1540 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:39.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.094+0000 7f3b07349640 1 -- 172.21.15.19:0/2962041295 >> 172.21.15.19:0/2962041295 conn(0x7f3b000d23a0 msgr2=0x7f3b000d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:39.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.094+0000 7f3b07349640 1 -- 172.21.15.19:0/2962041295 shutdown_connections 2024-09-12T02:04:39.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.094+0000 7f3b07349640 1 -- 172.21.15.19:0/2962041295 wait complete. 2024-09-12T02:04:39.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.095+0000 7f3b07349640 1 Processor -- start 2024-09-12T02:04:39.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.095+0000 7f3b07349640 1 -- start start 2024-09-12T02:04:39.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.096+0000 7f3b07349640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b0006dbd0 0x7f3b00158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:39.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.096+0000 7f3b07349640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b0009b690 0x7f3b000cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:39.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.096+0000 7f3b07349640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b0015e740 0x7f3b001585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:39.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.096+0000 7f3b07349640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3b000d1020 con 0x7f3b0006dbd0 2024-09-12T02:04:39.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.096+0000 7f3b07349640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3b000d0d40 con 0x7f3b0015e740 2024-09-12T02:04:39.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.096+0000 7f3b07349640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3b0009ba90 con 0x7f3b0009b690 2024-09-12T02:04:39.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.096+0000 7f3b050e5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b0006dbd0 0x7f3b00158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:39.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.096+0000 7f3b050e5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b0006dbd0 0x7f3b00158d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44084/0 (socket says 172.21.15.19:44084) 2024-09-12T02:04:39.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.096+0000 7f3b050e5640 1 -- 172.21.15.19:0/2187482446 learned_addr learned my addr 172.21.15.19:0/2187482446 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:39.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.096+0000 7f3b048e4640 1 --2- 172.21.15.19:0/2187482446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b0009b690 0x7f3b000cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:39.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.096+0000 7f3b058e6640 1 --2- 172.21.15.19:0/2187482446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b0015e740 0x7f3b001585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:39.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.097+0000 7f3b050e5640 1 -- 172.21.15.19:0/2187482446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b0009b690 msgr2=0x7f3b000cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:39.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.097+0000 7f3b050e5640 1 --2- 172.21.15.19:0/2187482446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b0009b690 0x7f3b000cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:39.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.097+0000 7f3b050e5640 1 -- 172.21.15.19:0/2187482446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b0015e740 msgr2=0x7f3b001585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:39.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.097+0000 7f3b050e5640 1 --2- 172.21.15.19:0/2187482446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b0015e740 0x7f3b001585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:39.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.097+0000 7f3b050e5640 1 -- 172.21.15.19:0/2187482446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b000cd9b0 con 0x7f3b0006dbd0 2024-09-12T02:04:39.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.097+0000 7f3b058e6640 1 --2- 172.21.15.19:0/2187482446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b0015e740 0x7f3b001585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:39.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.097+0000 7f3b050e5640 1 --2- 172.21.15.19:0/2187482446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b0006dbd0 0x7f3b00158d00 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f3afc035040 tx=0x7f3afc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:39.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.097+0000 7f3af5ffb640 1 -- 172.21.15.19:0/2187482446 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc037050 con 0x7f3b0006dbd0 2024-09-12T02:04:39.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.097+0000 7f3af5ffb640 1 -- 172.21.15.19:0/2187482446 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3afc043070 con 0x7f3b0006dbd0 2024-09-12T02:04:39.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.097+0000 7f3b07349640 1 -- 172.21.15.19:0/2187482446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b000cdc90 con 0x7f3b0006dbd0 2024-09-12T02:04:39.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.097+0000 7f3af5ffb640 1 -- 172.21.15.19:0/2187482446 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc006e10 con 0x7f3b0006dbd0 2024-09-12T02:04:39.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.097+0000 7f3b07349640 1 -- 172.21.15.19:0/2187482446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b000cb200 con 0x7f3b0006dbd0 2024-09-12T02:04:39.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.098+0000 7f3b07349640 1 -- 172.21.15.19:0/2187482446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b0006cd20 con 0x7f3b0006dbd0 2024-09-12T02:04:39.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.099+0000 7f3af5ffb640 1 -- 172.21.15.19:0/2187482446 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3afc03ca50 con 0x7f3b0006dbd0 2024-09-12T02:04:39.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.099+0000 7f3af5ffb640 1 --2- 172.21.15.19:0/2187482446 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3ae406be30 0x7f3ae406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:39.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.099+0000 7f3af5ffb640 1 -- 172.21.15.19:0/2187482446 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 8023+0+0 (secure 0 0 0) 0x7f3afc0ac400 con 0x7f3b0006dbd0 2024-09-12T02:04:39.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.099+0000 7f3b048e4640 1 --2- 172.21.15.19:0/2187482446 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3ae406be30 0x7f3ae406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:39.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.100+0000 7f3b048e4640 1 --2- 172.21.15.19:0/2187482446 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3ae406be30 0x7f3ae406e2f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3b0006cfe0 tx=0x7f3af0001de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:39.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.104+0000 7f3af5ffb640 1 -- 172.21.15.19:0/2187482446 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3afc07a5d0 con 0x7f3b0006dbd0 2024-09-12T02:04:39.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.314+0000 7f3b07349640 1 -- 172.21.15.19:0/2187482446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3b000d1cb0 con 0x7f3b0006dbd0 2024-09-12T02:04:39.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.818+0000 7f3af5ffb640 1 -- 172.21.15.19:0/2187482446 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v201) ==== 161+0+0 (secure 0 0 0) 0x7f3afc079ed0 con 0x7f3b0006dbd0 2024-09-12T02:04:39.819 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:04:39.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.821+0000 7f3b07349640 1 -- 172.21.15.19:0/2187482446 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3ae406be30 msgr2=0x7f3ae406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:39.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.821+0000 7f3b07349640 1 --2- 172.21.15.19:0/2187482446 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3ae406be30 0x7f3ae406e2f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3b0006cfe0 tx=0x7f3af0001de0 comp rx=0 tx=0).stop 2024-09-12T02:04:39.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.821+0000 7f3b07349640 1 -- 172.21.15.19:0/2187482446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b0006dbd0 msgr2=0x7f3b00158d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:39.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.821+0000 7f3b07349640 1 --2- 172.21.15.19:0/2187482446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b0006dbd0 0x7f3b00158d00 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f3afc035040 tx=0x7f3afc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:04:39.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.821+0000 7f3b07349640 1 -- 172.21.15.19:0/2187482446 shutdown_connections 2024-09-12T02:04:39.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.821+0000 7f3b07349640 1 --2- 172.21.15.19:0/2187482446 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3ae406be30 0x7f3ae406e2f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:39.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.821+0000 7f3b07349640 1 --2- 172.21.15.19:0/2187482446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b0015e740 0x7f3b001585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:39.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.821+0000 7f3b07349640 1 --2- 172.21.15.19:0/2187482446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b0009b690 0x7f3b000cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:39.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.821+0000 7f3b07349640 1 --2- 172.21.15.19:0/2187482446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b0006dbd0 0x7f3b00158d00 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:39.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.821+0000 7f3b07349640 1 -- 172.21.15.19:0/2187482446 >> 172.21.15.19:0/2187482446 conn(0x7f3b000d23a0 msgr2=0x7f3b00070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:39.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.821+0000 7f3b07349640 1 -- 172.21.15.19:0/2187482446 shutdown_connections 2024-09-12T02:04:39.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.821+0000 7f3b07349640 1 -- 172.21.15.19:0/2187482446 wait complete. 2024-09-12T02:04:39.834 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:04:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.941+0000 7f9d8ddc6640 1 Processor -- start 2024-09-12T02:04:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.941+0000 7f9d8ddc6640 1 -- start start 2024-09-12T02:04:39.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.942+0000 7f9d8ddc6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9d8806f8d0 0x7f9d88165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:39.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.942+0000 7f9d8ddc6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d880cdbe0 con 0x7f9d8815b300 2024-09-12T02:04:39.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.942+0000 7f9d8ddc6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d880cd900 con 0x7f9d88072d30 2024-09-12T02:04:39.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.942+0000 7f9d8ddc6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f9d880728a0 con 0x7f9d8806f8d0 2024-09-12T02:04:39.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.942+0000 7f9d877fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9d8815b300 0x7f9d880cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41430/0 (socket says 172.21.15.19:41430) 2024-09-12T02:04:39.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.942+0000 7f9d877fe640 1 -- 172.21.15.19:0/360317771 learned_addr learned my addr 172.21.15.19:0/360317771 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:39.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.942+0000 7f9d87fff640 1 --2- 172.21.15.19:0/360317771 >> v2:172.21.15.135:3300/0 conn(0x7f9d8806f8d0 0x7f9d88165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.942+0000 7f9d867fc640 1 -- 172.21.15.19:0/360317771 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 994295419 0 0) 0x7f9d880cdbe0 con 0x7f9d8815b300 2024-09-12T02:04:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.942+0000 7f9d867fc640 1 -- 172.21.15.19:0/360317771 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d70003520 con 0x7f9d8815b300 2024-09-12T02:04:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.942+0000 7f9d867fc640 1 -- 172.21.15.19:0/360317771 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 44344553 0 0) 0x7f9d70003520 con 0x7f9d8815b300 2024-09-12T02:04:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.942+0000 7f9d867fc640 1 -- 172.21.15.19:0/360317771 >> v2:172.21.15.135:3300/0 conn(0x7f9d8806f8d0 msgr2=0x7f9d88165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.942+0000 7f9d867fc640 1 --2- 172.21.15.19:0/360317771 >> v2:172.21.15.135:3300/0 conn(0x7f9d8806f8d0 0x7f9d88165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.942+0000 7f9d867fc640 1 -- 172.21.15.19:0/360317771 >> v1:172.21.15.135:6789/0 conn(0x7f9d88072d30 legacy=0x7f9d8806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.943+0000 7f9d867fc640 1 -- 172.21.15.19:0/360317771 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d88072250 con 0x7f9d8815b300 2024-09-12T02:04:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.943+0000 7f9d867fc640 1 -- 172.21.15.19:0/360317771 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f9d78001670 con 0x7f9d8815b300 2024-09-12T02:04:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.943+0000 7f9d867fc640 1 -- 172.21.15.19:0/360317771 >> v1:172.21.15.19:6789/0 conn(0x7f9d8815b300 legacy=0x7f9d880cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.943+0000 7f9d867fc640 1 --2- 172.21.15.19:0/360317771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d700039b0 0x7f9d70003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.943+0000 7f9d867fc640 1 --2- 172.21.15.19:0/360317771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d70004800 0x7f9d70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.943+0000 7f9d867fc640 1 --2- 172.21.15.19:0/360317771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d700051c0 0x7f9d7000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.943+0000 7f9d867fc640 1 -- 172.21.15.19:0/360317771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9d880728a0 con 0x7f9d70004800 2024-09-12T02:04:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.943+0000 7f9d867fc640 1 -- 172.21.15.19:0/360317771 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7000c160 con 0x7f9d700039b0 2024-09-12T02:04:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.943+0000 7f9d867fc640 1 -- 172.21.15.19:0/360317771 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9d7000c360 con 0x7f9d700051c0 2024-09-12T02:04:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.943+0000 7f9d877fe640 1 --2- 172.21.15.19:0/360317771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d700039b0 0x7f9d70003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.943+0000 7f9d86ffd640 1 --2- 172.21.15.19:0/360317771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d70004800 0x7f9d70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.943+0000 7f9d87fff640 1 --2- 172.21.15.19:0/360317771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d700051c0 0x7f9d7000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.943+0000 7f9d86ffd640 1 -- 172.21.15.19:0/360317771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d700051c0 msgr2=0x7f9d7000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.943+0000 7f9d86ffd640 1 --2- 172.21.15.19:0/360317771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d700051c0 0x7f9d7000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.943+0000 7f9d86ffd640 1 -- 172.21.15.19:0/360317771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d700039b0 msgr2=0x7f9d70003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.943+0000 7f9d86ffd640 1 --2- 172.21.15.19:0/360317771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d700039b0 0x7f9d70003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.943+0000 7f9d86ffd640 1 -- 172.21.15.19:0/360317771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d70003520 con 0x7f9d70004800 2024-09-12T02:04:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.943+0000 7f9d87fff640 1 -- 172.21.15.19:0/360317771 reap_dead start 2024-09-12T02:04:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.944+0000 7f9d86ffd640 1 --2- 172.21.15.19:0/360317771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d70004800 0x7f9d70004c80 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c001750 tx=0x7f9d70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85f3b2b06d0e5bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.944+0000 7f9d867fc640 1 -- 172.21.15.19:0/360317771 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c001370 con 0x7f9d70004800 2024-09-12T02:04:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.944+0000 7f9d867fc640 1 -- 172.21.15.19:0/360317771 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d7c0052d0 con 0x7f9d70004800 2024-09-12T02:04:39.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.944+0000 7f9d867fc640 1 -- 172.21.15.19:0/360317771 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c02abc0 con 0x7f9d70004800 2024-09-12T02:04:39.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.944+0000 7f9d8ddc6640 1 -- 172.21.15.19:0/360317771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d70004800 msgr2=0x7f9d70004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:39.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.944+0000 7f9d8ddc6640 1 --2- 172.21.15.19:0/360317771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d70004800 0x7f9d70004c80 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c001750 tx=0x7f9d70005830 comp rx=0 tx=0).stop 2024-09-12T02:04:39.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.944+0000 7f9d8ddc6640 1 -- 172.21.15.19:0/360317771 shutdown_connections 2024-09-12T02:04:39.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.944+0000 7f9d8ddc6640 1 --2- 172.21.15.19:0/360317771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d70004800 0x7f9d70004c80 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:39.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.944+0000 7f9d8ddc6640 1 -- 172.21.15.19:0/360317771 >> 172.21.15.19:0/360317771 conn(0x7f9d88067d70 msgr2=0x7f9d8806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:39.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.944+0000 7f9d8ddc6640 1 -- 172.21.15.19:0/360317771 shutdown_connections 2024-09-12T02:04:39.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.945+0000 7f9d8ddc6640 1 -- 172.21.15.19:0/360317771 wait complete. 2024-09-12T02:04:39.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.946+0000 7f9d8ddc6640 1 Processor -- start 2024-09-12T02:04:39.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.946+0000 7f9d8ddc6640 1 -- start start 2024-09-12T02:04:39.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d8ddc6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d70004800 0x7f9d881e36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:39.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d8ddc6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d8815a0d0 0x7f9d8806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:39.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d8ddc6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d881e4fc0 0x7f9d8814e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:39.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d8ddc6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9d880d0160 con 0x7f9d8815a0d0 2024-09-12T02:04:39.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d8ddc6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d880cffe0 con 0x7f9d70004800 2024-09-12T02:04:39.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d8ddc6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9d8806f1c0 con 0x7f9d881e4fc0 2024-09-12T02:04:39.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d86ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d8815a0d0 0x7f9d8806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:39.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d86ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d8815a0d0 0x7f9d8806e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44104/0 (socket says 172.21.15.19:44104) 2024-09-12T02:04:39.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d86ffd640 1 -- 172.21.15.19:0/1489163697 learned_addr learned my addr 172.21.15.19:0/1489163697 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:39.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d877fe640 1 --2- 172.21.15.19:0/1489163697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d70004800 0x7f9d881e36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:39.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d87fff640 1 --2- 172.21.15.19:0/1489163697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d881e4fc0 0x7f9d8814e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:39.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d86ffd640 1 -- 172.21.15.19:0/1489163697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d881e4fc0 msgr2=0x7f9d8814e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:39.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d86ffd640 1 --2- 172.21.15.19:0/1489163697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d881e4fc0 0x7f9d8814e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:39.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d86ffd640 1 -- 172.21.15.19:0/1489163697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d70004800 msgr2=0x7f9d881e36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:39.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d86ffd640 1 --2- 172.21.15.19:0/1489163697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d70004800 0x7f9d881e36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:39.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d86ffd640 1 -- 172.21.15.19:0/1489163697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d881e3f20 con 0x7f9d8815a0d0 2024-09-12T02:04:39.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d87fff640 1 --2- 172.21.15.19:0/1489163697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d881e4fc0 0x7f9d8814e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:39.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d86ffd640 1 --2- 172.21.15.19:0/1489163697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d8815a0d0 0x7f9d8806e320 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c001870 tx=0x7f9d7c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:39.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d6ffff640 1 -- 172.21.15.19:0/1489163697 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c03f030 con 0x7f9d8815a0d0 2024-09-12T02:04:39.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d6ffff640 1 -- 172.21.15.19:0/1489163697 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d7c005480 con 0x7f9d8815a0d0 2024-09-12T02:04:39.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d8ddc6640 1 -- 172.21.15.19:0/1489163697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d881e4200 con 0x7f9d8815a0d0 2024-09-12T02:04:39.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d6ffff640 1 -- 172.21.15.19:0/1489163697 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c037040 con 0x7f9d8815a0d0 2024-09-12T02:04:39.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.947+0000 7f9d8ddc6640 1 -- 172.21.15.19:0/1489163697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d881e4aa0 con 0x7f9d8815a0d0 2024-09-12T02:04:39.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.948+0000 7f9d8ddc6640 1 -- 172.21.15.19:0/1489163697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d881e45f0 con 0x7f9d8815a0d0 2024-09-12T02:04:39.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.949+0000 7f9d6ffff640 1 -- 172.21.15.19:0/1489163697 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d7c042070 con 0x7f9d8815a0d0 2024-09-12T02:04:39.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.949+0000 7f9d6ffff640 1 --2- 172.21.15.19:0/1489163697 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9d7406be30 0x7f9d7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:39.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.949+0000 7f9d6ffff640 1 -- 172.21.15.19:0/1489163697 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 8023+0+0 (secure 0 0 0) 0x7f9d7c0aad70 con 0x7f9d8815a0d0 2024-09-12T02:04:39.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.950+0000 7f9d877fe640 1 --2- 172.21.15.19:0/1489163697 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9d7406be30 0x7f9d7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:39.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.950+0000 7f9d877fe640 1 --2- 172.21.15.19:0/1489163697 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9d7406be30 0x7f9d7406e2f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f9d78001050 tx=0x7f9d78000f80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:39.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:39.954+0000 7f9d6ffff640 1 -- 172.21.15.19:0/1489163697 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9d7c078ce0 con 0x7f9d8815a0d0 2024-09-12T02:04:40.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.198+0000 7f9d8ddc6640 1 -- 172.21.15.19:0/1489163697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f9d881e43d0 con 0x7f9d8815a0d0 2024-09-12T02:04:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.826+0000 7f9d6ffff640 1 -- 172.21.15.19:0/1489163697 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v202) ==== 101+0+0 (secure 0 0 0) 0x7f9d7c0785e0 con 0x7f9d8815a0d0 2024-09-12T02:04:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:04:40.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.829+0000 7f9d8ddc6640 1 -- 172.21.15.19:0/1489163697 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9d7406be30 msgr2=0x7f9d7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:40.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.829+0000 7f9d8ddc6640 1 --2- 172.21.15.19:0/1489163697 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9d7406be30 0x7f9d7406e2f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f9d78001050 tx=0x7f9d78000f80 comp rx=0 tx=0).stop 2024-09-12T02:04:40.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.829+0000 7f9d8ddc6640 1 -- 172.21.15.19:0/1489163697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d8815a0d0 msgr2=0x7f9d8806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:40.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.829+0000 7f9d8ddc6640 1 --2- 172.21.15.19:0/1489163697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d8815a0d0 0x7f9d8806e320 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c001870 tx=0x7f9d7c001120 comp rx=0 tx=0).stop 2024-09-12T02:04:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.829+0000 7f9d8ddc6640 1 -- 172.21.15.19:0/1489163697 shutdown_connections 2024-09-12T02:04:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.829+0000 7f9d8ddc6640 1 --2- 172.21.15.19:0/1489163697 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9d7406be30 0x7f9d7406e2f0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.829+0000 7f9d8ddc6640 1 --2- 172.21.15.19:0/1489163697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d881e4fc0 0x7f9d8814e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.829+0000 7f9d8ddc6640 1 --2- 172.21.15.19:0/1489163697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d8815a0d0 0x7f9d8806e320 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.829+0000 7f9d8ddc6640 1 --2- 172.21.15.19:0/1489163697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d70004800 0x7f9d881e36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.829+0000 7f9d8ddc6640 1 -- 172.21.15.19:0/1489163697 >> 172.21.15.19:0/1489163697 conn(0x7f9d88067d70 msgr2=0x7f9d8815ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.829+0000 7f9d8ddc6640 1 -- 172.21.15.19:0/1489163697 shutdown_connections 2024-09-12T02:04:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.829+0000 7f9d8ddc6640 1 -- 172.21.15.19:0/1489163697 wait complete. 2024-09-12T02:04:40.843 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:04:40.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.890+0000 7fc0f7f5ff40 1 Processor -- start 2024-09-12T02:04:40.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.890+0000 7fc0f7f5ff40 1 -- start start 2024-09-12T02:04:40.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.890+0000 7fc0f7f5ff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56209306b9e0 0x562093131cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.890+0000 7fc0f7f5ff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5620930b48e0 0x5620931455b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.890+0000 7fc0f7f5ff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562093142fb0 0x5620930b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.890+0000 7fc0f7f5ff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5620930b5230 con 0x562093142fb0 2024-09-12T02:04:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.890+0000 7fc0f7f5ff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562092fbd510 con 0x56209306b9e0 2024-09-12T02:04:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.890+0000 7fc0f7f5ff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56209306bf20 con 0x5620930b48e0 2024-09-12T02:04:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.890+0000 7fc0f6256640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562093142fb0 0x5620930b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.890+0000 7fc0f6256640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562093142fb0 0x5620930b63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44124/0 (socket says 172.21.15.19:44124) 2024-09-12T02:04:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.891+0000 7fc0f6256640 1 -- 172.21.15.19:0/1703160516 learned_addr learned my addr 172.21.15.19:0/1703160516 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.891+0000 7fc0f5a55640 1 --2- 172.21.15.19:0/1703160516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56209306b9e0 0x562093131cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.891+0000 7fc0f5254640 1 --2- 172.21.15.19:0/1703160516 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5620930b48e0 0x5620931455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.891+0000 7fc0f6256640 1 -- 172.21.15.19:0/1703160516 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5620930b48e0 msgr2=0x5620931455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.891+0000 7fc0f6256640 1 --2- 172.21.15.19:0/1703160516 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5620930b48e0 0x5620931455b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.891+0000 7fc0f6256640 1 -- 172.21.15.19:0/1703160516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56209306b9e0 msgr2=0x562093131cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.891+0000 7fc0f6256640 1 --2- 172.21.15.19:0/1703160516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56209306b9e0 0x562093131cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.891+0000 7fc0f6256640 1 -- 172.21.15.19:0/1703160516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56209306fa40 con 0x562093142fb0 2024-09-12T02:04:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.891+0000 7fc0f5a55640 1 --2- 172.21.15.19:0/1703160516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56209306b9e0 0x562093131cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:40.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.891+0000 7fc0f6256640 1 --2- 172.21.15.19:0/1703160516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562093142fb0 0x5620930b63c0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000a770 tx=0x7fc0f000a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96a3cbed5cecc20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:40.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.891+0000 7fc0effff640 1 -- 172.21.15.19:0/1703160516 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0019070 con 0x562093142fb0 2024-09-12T02:04:40.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.891+0000 7fc0effff640 1 -- 172.21.15.19:0/1703160516 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f0007600 con 0x562093142fb0 2024-09-12T02:04:40.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.891+0000 7fc0effff640 1 -- 172.21.15.19:0/1703160516 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0007a10 con 0x562093142fb0 2024-09-12T02:04:40.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.892+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1703160516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562093142fb0 msgr2=0x5620930b63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:40.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.892+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1703160516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562093142fb0 0x5620930b63c0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000a770 tx=0x7fc0f000a860 comp rx=0 tx=0).stop 2024-09-12T02:04:40.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.892+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1703160516 shutdown_connections 2024-09-12T02:04:40.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.892+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1703160516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562093142fb0 0x5620930b63c0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.892+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1703160516 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5620930b48e0 0x5620931455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.892+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1703160516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56209306b9e0 0x562093131cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.892+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1703160516 >> 172.21.15.19:0/1703160516 conn(0x562093099490 msgr2=0x562093099870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:40.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.892+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1703160516 shutdown_connections 2024-09-12T02:04:40.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.892+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1703160516 wait complete. 2024-09-12T02:04:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.892+0000 7fc0f7f5ff40 1 Processor -- start 2024-09-12T02:04:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.893+0000 7fc0f7f5ff40 1 -- start start 2024-09-12T02:04:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.893+0000 7fc0f7f5ff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56209306b9e0 0x56209313a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.893+0000 7fc0f7f5ff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5620930b48e0 0x562093144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.893+0000 7fc0f7f5ff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562093142fb0 0x5620931454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.893+0000 7fc0f7f5ff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5620931323b0 con 0x562093142fb0 2024-09-12T02:04:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.893+0000 7fc0f7f5ff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5620931435c0 con 0x56209306b9e0 2024-09-12T02:04:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.893+0000 7fc0f7f5ff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562093132600 con 0x5620930b48e0 2024-09-12T02:04:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.893+0000 7fc0f6256640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562093142fb0 0x5620931454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.893+0000 7fc0f6256640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562093142fb0 0x5620931454a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44138/0 (socket says 172.21.15.19:44138) 2024-09-12T02:04:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.893+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 learned_addr learned my addr 172.21.15.19:0/1998938773 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.893+0000 7fc0f5254640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5620930b48e0 0x562093144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.893+0000 7fc0f5a55640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56209306b9e0 0x56209313a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.894+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5620930b48e0 msgr2=0x562093144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.894+0000 7fc0f6256640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5620930b48e0 0x562093144f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.894+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56209306b9e0 msgr2=0x56209313a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.894+0000 7fc0f6256640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56209306b9e0 0x56209313a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.894+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56209313fb50 con 0x562093142fb0 2024-09-12T02:04:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.894+0000 7fc0f6256640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562093142fb0 0x5620931454a0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0013000 tx=0x7fc0f0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.894+0000 7fc0eeffd640 1 -- 172.21.15.19:0/1998938773 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0023020 con 0x562093142fb0 2024-09-12T02:04:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.894+0000 7fc0eeffd640 1 -- 172.21.15.19:0/1998938773 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f001f470 con 0x562093142fb0 2024-09-12T02:04:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.894+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562093139cc0 con 0x562093142fb0 2024-09-12T02:04:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.894+0000 7fc0eeffd640 1 -- 172.21.15.19:0/1998938773 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0019040 con 0x562093142fb0 2024-09-12T02:04:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.894+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56209313aa00 con 0x562093142fb0 2024-09-12T02:04:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.896+0000 7fc0eeffd640 1 -- 172.21.15.19:0/1998938773 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc0f0026020 con 0x562093142fb0 2024-09-12T02:04:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.896+0000 7fc0eeffd640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc0d806a840 0x7fc0d806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.896+0000 7fc0eeffd640 1 -- 172.21.15.19:0/1998938773 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 8023+0+0 (secure 0 0 0) 0x7fc0f008b800 con 0x562093142fb0 2024-09-12T02:04:40.899 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:04:40.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.896+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562093131290 0x56209313dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.896+0000 7fc0f5a55640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc0d806a840 0x7fc0d806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.896+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x56209313ee70 con 0x562093131290 2024-09-12T02:04:40.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.896+0000 7fc0f5254640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562093131290 0x56209313dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.897+0000 7fc0f5254640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562093131290 0x56209313dad0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:40.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.897+0000 7fc0f5a55640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc0d806a840 0x7fc0d806cd00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8056000 tx=0x7fc0e8007030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:40.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.898+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v115'629 uv603 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.898+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x562093130840 con 0x562093131290 2024-09-12T02:04:40.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.899+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v115'630 uv630 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.899+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e5fc0 con 0x562093131290 2024-09-12T02:04:40.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.901+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v115'631 uv631 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.902 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:04:40.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.901+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e7370 con 0x562093131290 2024-09-12T02:04:40.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.902+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v115'632 uv632 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.902+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e7710 con 0x562093131290 2024-09-12T02:04:40.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.903+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v115'633 uv633 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.903+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e6360 con 0x562093131290 2024-09-12T02:04:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.904+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v115'634 uv634 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.904+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e6700 con 0x562093131290 2024-09-12T02:04:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.905+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v115'635 uv609 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.905+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931e6700 con 0x562093131290 2024-09-12T02:04:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.906+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v115'636 uv636 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.906+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e6700 con 0x562093131290 2024-09-12T02:04:40.907 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:04:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.907+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v115'637 uv637 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.907+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e6700 con 0x562093131290 2024-09-12T02:04:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.908+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v115'638 uv638 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.908+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e6700 con 0x562093131290 2024-09-12T02:04:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.909+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v115'639 uv639 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.909+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e6700 con 0x562093131290 2024-09-12T02:04:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.910+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v115'640 uv640 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.910+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e6700 con 0x562093131290 2024-09-12T02:04:40.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.911+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v115'641 uv616 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.911+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931e6700 con 0x562093131290 2024-09-12T02:04:40.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.912+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v115'642 uv642 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.912+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e6700 con 0x562093131290 2024-09-12T02:04:40.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.913+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v115'643 uv643 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.914 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:04:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.913+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e6700 con 0x562093131290 2024-09-12T02:04:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.914+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v115'644 uv644 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.914+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e6700 con 0x562093131290 2024-09-12T02:04:40.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.915+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v115'645 uv645 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.915+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e6700 con 0x562093131290 2024-09-12T02:04:40.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.916+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v115'646 uv646 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.916+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e6ac0 con 0x562093131290 2024-09-12T02:04:40.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.917+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v115'647 uv647 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.917+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e6ac0 con 0x562093131290 2024-09-12T02:04:40.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.918+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v115'648 uv622 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.918+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931e69b0 con 0x562093131290 2024-09-12T02:04:40.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.919+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v115'649 uv649 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.919+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e69b0 con 0x562093131290 2024-09-12T02:04:40.920 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:04:40.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.920+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v115'650 uv650 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.920+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e69b0 con 0x562093131290 2024-09-12T02:04:40.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.921+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v115'651 uv651 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.921+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e69b0 con 0x562093131290 2024-09-12T02:04:40.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.922+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v115'652 uv652 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.922+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e69b0 con 0x562093131290 2024-09-12T02:04:40.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.923+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v115'653 uv653 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.923+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e69b0 con 0x562093131290 2024-09-12T02:04:40.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.924+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v115'654 uv628 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.924+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931e69b0 con 0x562093131290 2024-09-12T02:04:40.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.925+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v115'655 uv655 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.925+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e69b0 con 0x562093131290 2024-09-12T02:04:40.926 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:04:40.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.926+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v115'656 uv656 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.926+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e69b0 con 0x562093131290 2024-09-12T02:04:40.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.927+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v115'657 uv657 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.927+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e69b0 con 0x562093131290 2024-09-12T02:04:40.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.928+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v115'658 uv658 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.928+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931e69b0 con 0x562093131290 2024-09-12T02:04:40.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.929+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v115'659 uv659 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x562093131290 2024-09-12T02:04:40.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.929+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5620931e6ec0 0x5620931e9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.929+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931ea000 con 0x5620931e6ec0 2024-09-12T02:04:40.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.929+0000 7fc0f5a55640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5620931e6ec0 0x5620931e9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.930+0000 7fc0f5a55640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5620931e6ec0 0x5620931e9ac0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:40.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.932+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v115'464 uv447 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.932+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931ea3a0 con 0x5620931e6ec0 2024-09-12T02:04:40.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.933+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v115'465 uv465 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.933+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931ea740 con 0x5620931e6ec0 2024-09-12T02:04:40.934 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:04:40.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.934+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v115'466 uv466 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.934+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931eaae0 con 0x5620931e6ec0 2024-09-12T02:04:40.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.936+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v115'467 uv467 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.936+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931eae80 con 0x5620931e6ec0 2024-09-12T02:04:40.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.937+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v115'468 uv468 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.937+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931eb220 con 0x5620931e6ec0 2024-09-12T02:04:40.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.938+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v115'469 uv452 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.938+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931eb5c0 con 0x5620931e6ec0 2024-09-12T02:04:40.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.940+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v115'470 uv470 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.940+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931eb960 con 0x5620931e6ec0 2024-09-12T02:04:40.941 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:04:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.941+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v115'471 uv471 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.941+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931eb960 con 0x5620931e6ec0 2024-09-12T02:04:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.942+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v115'472 uv472 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.942+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931eb960 con 0x5620931e6ec0 2024-09-12T02:04:40.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.944+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v115'473 uv473 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.944+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931eb960 con 0x5620931e6ec0 2024-09-12T02:04:40.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.945+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v115'474 uv457 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.945+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931eb960 con 0x5620931e6ec0 2024-09-12T02:04:40.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.946+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v115'475 uv475 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.946+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931eb960 con 0x5620931e6ec0 2024-09-12T02:04:40.947 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:04:40.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.947+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v115'476 uv476 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.947+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931efde0 con 0x5620931e6ec0 2024-09-12T02:04:40.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.949+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v115'477 uv477 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.949+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931efde0 con 0x5620931e6ec0 2024-09-12T02:04:40.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.950+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v115'478 uv478 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.950+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931eb960 con 0x5620931e6ec0 2024-09-12T02:04:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.951+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v115'479 uv463 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.951+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931eb960 con 0x5620931e6ec0 2024-09-12T02:04:40.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.952+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v115'480 uv480 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.952+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931eb960 con 0x5620931e6ec0 2024-09-12T02:04:40.954 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:04:40.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.953+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v115'481 uv481 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.954+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931ec970 con 0x5620931e6ec0 2024-09-12T02:04:40.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.955+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v115'482 uv482 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.955+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931ec970 con 0x5620931e6ec0 2024-09-12T02:04:40.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.956+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v115'483 uv483 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.956+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931eb960 con 0x5620931e6ec0 2024-09-12T02:04:40.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.957+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v115'484 uv484 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931e6ec0 2024-09-12T02:04:40.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.957+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5620931ebfe0 0x5620931ee3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.957+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931ee9a0 con 0x5620931ebfe0 2024-09-12T02:04:40.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.957+0000 7fc0f5254640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5620931ebfe0 0x5620931ee3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.958+0000 7fc0f5254640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5620931ebfe0 0x5620931ee3d0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:40.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.959+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v115'123 uv122 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:40.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.959+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931eea60 con 0x5620931ebfe0 2024-09-12T02:04:40.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.960+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v115'124 uv124 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:40.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.960+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931eee50 con 0x5620931ebfe0 2024-09-12T02:04:40.961 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:04:40.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.961+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v115'125 uv125 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:40.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.961+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931efe60 con 0x5620931ebfe0 2024-09-12T02:04:40.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.962+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v115'126 uv126 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:40.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.962+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931efe60 con 0x5620931ebfe0 2024-09-12T02:04:40.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.963+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v115'127 uv127 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:40.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.963+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931eee50 con 0x5620931ebfe0 2024-09-12T02:04:40.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.966+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v115'128 uv128 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:40.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.966+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5620931ef4d0 0x5620931f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.966+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f1ef0 con 0x5620931ef4d0 2024-09-12T02:04:40.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.966+0000 7fc0f6256640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5620931ef4d0 0x5620931f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.966+0000 7fc0f6256640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5620931ef4d0 0x5620931f18c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:40.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.968+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v115'92 uv91 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.968+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931f2400 con 0x5620931ef4d0 2024-09-12T02:04:40.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.969+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v115'93 uv93 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.969+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f2900 con 0x5620931ef4d0 2024-09-12T02:04:40.970 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:04:40.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.970+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v115'94 uv94 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.970+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f31c0 con 0x5620931ef4d0 2024-09-12T02:04:40.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.971+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v115'95 uv95 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.971+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5620931f3a70 0x5620931f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.971+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f63a0 con 0x5620931f3a70 2024-09-12T02:04:40.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.971+0000 7fc0f5a55640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5620931f3a70 0x5620931f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.972+0000 7fc0f5a55640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5620931f3a70 0x5620931f5e60 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:40.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.973+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v115'123 uv122 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:40.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.973+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6460 con 0x5620931f3a70 2024-09-12T02:04:40.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.974+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v115'124 uv124 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:40.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.974+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6880 con 0x5620931f3a70 2024-09-12T02:04:40.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.976+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v115'125 uv125 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:40.976 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:04:40.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.976+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f7890 con 0x5620931f3a70 2024-09-12T02:04:40.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.977+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v115'126 uv126 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:40.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.977+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f7890 con 0x5620931f3a70 2024-09-12T02:04:40.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.978+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v115'127 uv127 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:40.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.978+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6880 con 0x5620931f3a70 2024-09-12T02:04:40.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.979+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v115'128 uv128 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:40.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.979+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6880 con 0x5620931ef4d0 2024-09-12T02:04:40.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.980+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v115'227 uv221 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.980+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6c20 con 0x5620931ef4d0 2024-09-12T02:04:40.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.982+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v115'228 uv228 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.982+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6c20 con 0x5620931ef4d0 2024-09-12T02:04:40.983 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:04:40.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.983+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v115'229 uv229 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.983+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f7c30 con 0x5620931ef4d0 2024-09-12T02:04:40.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.983+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v115'230 uv230 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.984+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f7c30 con 0x5620931ef4d0 2024-09-12T02:04:40.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.984+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v115'231 uv231 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.984+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6c20 con 0x5620931ef4d0 2024-09-12T02:04:40.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.985+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v115'232 uv232 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.985+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6c20 con 0x5620931ef4d0 2024-09-12T02:04:40.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.986+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v115'233 uv226 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.986+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6c20 con 0x5620931ef4d0 2024-09-12T02:04:40.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.987+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v115'234 uv234 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.987+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6c20 con 0x5620931ef4d0 2024-09-12T02:04:40.989 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:04:40.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.988+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v115'235 uv235 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.988+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6c20 con 0x5620931ef4d0 2024-09-12T02:04:40.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.989+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v115'236 uv236 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.989+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6c20 con 0x5620931ef4d0 2024-09-12T02:04:40.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.990+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v115'237 uv237 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.990+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6c20 con 0x5620931ef4d0 2024-09-12T02:04:40.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.991+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v115'102 uv101 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.991+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6c20 con 0x5620931ef4d0 2024-09-12T02:04:40.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.992+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v115'103 uv103 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.992+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6c20 con 0x5620931ef4d0 2024-09-12T02:04:40.993 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:04:40.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.993+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v115'104 uv104 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.993+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6c20 con 0x5620931ef4d0 2024-09-12T02:04:40.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.994+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v115'105 uv105 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.994+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6c20 con 0x5620931ef4d0 2024-09-12T02:04:40.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.995+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v115'106 uv106 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc0f001c040 con 0x5620931ef4d0 2024-09-12T02:04:40.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.995+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6c20 con 0x5620931f3a70 2024-09-12T02:04:40.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.996+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v115'123 uv122 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:40.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.996+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6c20 con 0x5620931f3a70 2024-09-12T02:04:40.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.997+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v115'124 uv124 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:40.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.997+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6c20 con 0x5620931f3a70 2024-09-12T02:04:40.998 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:04:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.998+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v115'125 uv125 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.998+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f8070 con 0x5620931f3a70 2024-09-12T02:04:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.999+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v115'126 uv126 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:40.999+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f8070 con 0x5620931f3a70 2024-09-12T02:04:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.000+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v115'127 uv127 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.000+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f7060 con 0x5620931f3a70 2024-09-12T02:04:41.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.002+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v115'128 uv128 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:41.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.002+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f7060 con 0x5620931f3a70 2024-09-12T02:04:41.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.004+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v115'203 uv202 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:41.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.004+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6c40 con 0x5620931f3a70 2024-09-12T02:04:41.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.005+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v115'204 uv204 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:41.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.005+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f6c40 con 0x5620931f3a70 2024-09-12T02:04:41.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.006+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v115'205 uv205 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:41.006 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:04:41.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.006+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f7060 con 0x5620931f3a70 2024-09-12T02:04:41.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.007+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v115'206 uv206 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:41.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.007+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f7060 con 0x5620931f3a70 2024-09-12T02:04:41.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.008+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v115'207 uv207 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:41.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.008+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f7060 con 0x5620931f3a70 2024-09-12T02:04:41.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.009+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v115'208 uv201 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:41.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.009+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931f7060 con 0x5620931f3a70 2024-09-12T02:04:41.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.010+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v115'209 uv209 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:41.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.010+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f7060 con 0x5620931f3a70 2024-09-12T02:04:41.011 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:04:41.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.011+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v115'210 uv210 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:41.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.011+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f7060 con 0x5620931f3a70 2024-09-12T02:04:41.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.012+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v115'211 uv211 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:41.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.012+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e70 con 0x5620931f3a70 2024-09-12T02:04:41.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.013+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v115'212 uv212 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:41.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.014+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5620931f7a20 0x5620931fa260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.014+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931f7a20 2024-09-12T02:04:41.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.014+0000 7fc0f5254640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5620931f7a20 0x5620931fa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.014+0000 7fc0f5254640 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5620931f7a20 0x5620931fa260 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:41.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.015+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v115'91 uv90 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931f7a20 2024-09-12T02:04:41.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.015+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931f7a20 2024-09-12T02:04:41.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.016+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v115'92 uv92 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931f7a20 2024-09-12T02:04:41.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.016+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931f7a20 2024-09-12T02:04:41.017 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:04:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.017+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v115'93 uv93 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931f7a20 2024-09-12T02:04:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.017+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931f7a20 2024-09-12T02:04:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.018+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v115'94 uv94 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931f7a20 2024-09-12T02:04:41.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.018+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931f3a70 2024-09-12T02:04:41.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.019+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v115'123 uv122 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:41.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.019+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931f3a70 2024-09-12T02:04:41.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.020+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v115'124 uv124 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:41.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.020+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931f3a70 2024-09-12T02:04:41.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.021+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v115'125 uv125 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:41.022 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:04:41.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.021+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931f3a70 2024-09-12T02:04:41.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.023+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v115'126 uv126 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:41.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.023+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931f3a70 2024-09-12T02:04:41.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.024+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v115'127 uv127 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:41.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.024+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931f3a70 2024-09-12T02:04:41.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.025+0000 7fc0f5a55640 1 -- 172.21.15.19:0/1998938773 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v115'128 uv128 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e8069430 con 0x5620931f3a70 2024-09-12T02:04:41.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.025+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931ebfe0 2024-09-12T02:04:41.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.026+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v115'104 uv103 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:41.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.026+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931ebfe0 2024-09-12T02:04:41.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.027+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v115'105 uv105 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:41.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.027+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931ebfe0 2024-09-12T02:04:41.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.028+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v115'106 uv106 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:41.029 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:04:41.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.028+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931ebfe0 2024-09-12T02:04:41.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.029+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v115'107 uv107 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:41.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.029+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931ebfe0 2024-09-12T02:04:41.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.030+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v115'108 uv108 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:41.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.031+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931ebfe0 2024-09-12T02:04:41.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.032+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v115'253 uv245 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:41.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.032+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931ebfe0 2024-09-12T02:04:41.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.033+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v115'254 uv254 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:41.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.033+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931ebfe0 2024-09-12T02:04:41.034 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:04:41.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.034+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v115'255 uv255 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:41.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.034+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931ebfe0 2024-09-12T02:04:41.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.035+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v115'256 uv256 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:41.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.035+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931ebfe0 2024-09-12T02:04:41.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.036+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v115'257 uv257 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:41.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.036+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931ebfe0 2024-09-12T02:04:41.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.037+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v115'258 uv252 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:41.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.037+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931ebfe0 2024-09-12T02:04:41.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.038+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v115'259 uv259 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:41.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.038+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931ebfe0 2024-09-12T02:04:41.039 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:04:41.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.039+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v115'260 uv260 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:41.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.039+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931ebfe0 2024-09-12T02:04:41.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.040+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v115'261 uv261 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:41.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.040+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931ebfe0 2024-09-12T02:04:41.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.041+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v115'262 uv262 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:41.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.041+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931f9e10 con 0x5620931ebfe0 2024-09-12T02:04:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.042+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v115'263 uv263 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.042+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620931facc0 con 0x5620931ebfe0 2024-09-12T02:04:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f5254640 1 -- 172.21.15.19:0/1998938773 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v115'264 uv264 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fc0e000b790 con 0x5620931ebfe0 2024-09-12T02:04:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5620931e6ec0 msgr2=0x5620931e9ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5620931e6ec0 0x5620931e9ac0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562093131290 msgr2=0x56209313dad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562093131290 0x56209313dad0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5620931ef4d0 msgr2=0x5620931f18c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5620931ef4d0 0x5620931f18c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5620931f7a20 msgr2=0x5620931fa260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5620931f7a20 0x5620931fa260 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5620931ebfe0 msgr2=0x5620931ee3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5620931ebfe0 0x5620931ee3d0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5620931f3a70 msgr2=0x5620931f5e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 reap_dead start 2024-09-12T02:04:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5620931f3a70 0x5620931f5e60 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 reap_dead start 2024-09-12T02:04:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f6256640 1 -- 172.21.15.19:0/1998938773 reap_dead start 2024-09-12T02:04:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc0d806a840 msgr2=0x7fc0d806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc0d806a840 0x7fc0d806cd00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8056000 tx=0x7fc0e8007030 comp rx=0 tx=0).stop 2024-09-12T02:04:41.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562093142fb0 msgr2=0x5620931454a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.043+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562093142fb0 0x5620931454a0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0013000 tx=0x7fc0f0003020 comp rx=0 tx=0).stop 2024-09-12T02:04:41.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.044+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 shutdown_connections 2024-09-12T02:04:41.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.044+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc0d806a840 0x7fc0d806cd00 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.044+0000 7fc0f7f5ff40 1 --2- 172.21.15.19:0/1998938773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562093142fb0 0x5620931454a0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.044+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 >> 172.21.15.19:0/1998938773 conn(0x562093099490 msgr2=0x562093099870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:41.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.044+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 shutdown_connections 2024-09-12T02:04:41.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.044+0000 7fc0f7f5ff40 1 -- 172.21.15.19:0/1998938773 wait complete. 2024-09-12T02:04:41.047 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put 400.00000000 - 2024-09-12T02:04:41.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.091+0000 7f36ce979f40 1 Processor -- start 2024-09-12T02:04:41.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.091+0000 7f36ce979f40 1 -- start start 2024-09-12T02:04:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.092+0000 7f36ce979f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b80022d0 0x55ea6bae3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.092+0000 7f36ce979f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6ba6fce0 0x55ea6bb05030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.092+0000 7f36ce979f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ea6bae43a0 0x55ea6bb01820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.092+0000 7f36ce979f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ea6b97c510 con 0x55ea6ba6fce0 2024-09-12T02:04:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.092+0000 7f36ce979f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ea6b9d5c50 con 0x7f36b80022d0 2024-09-12T02:04:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.092+0000 7f36ce979f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55ea6ba29dc0 con 0x55ea6bae43a0 2024-09-12T02:04:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.092+0000 7f36cbc70640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6ba6fce0 0x55ea6bb05030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.092+0000 7f36cbc70640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6ba6fce0 0x55ea6bb05030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59326/0 (socket says 172.21.15.19:59326) 2024-09-12T02:04:41.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.092+0000 7f36cbc70640 1 -- 172.21.15.19:0/645015757 learned_addr learned my addr 172.21.15.19:0/645015757 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:41.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.092+0000 7f36cc471640 1 --2- 172.21.15.19:0/645015757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b80022d0 0x55ea6bae3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.092+0000 7f36ccc72640 1 --2- 172.21.15.19:0/645015757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ea6bae43a0 0x55ea6bb01820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.092+0000 7f36cbc70640 1 -- 172.21.15.19:0/645015757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ea6bae43a0 msgr2=0x55ea6bb01820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:41.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.092+0000 7f36cbc70640 1 --2- 172.21.15.19:0/645015757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ea6bae43a0 0x55ea6bb01820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.092+0000 7f36cbc70640 1 -- 172.21.15.19:0/645015757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b80022d0 msgr2=0x55ea6bae3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:41.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.092+0000 7f36cbc70640 1 --2- 172.21.15.19:0/645015757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b80022d0 0x55ea6bae3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.092+0000 7f36cbc70640 1 -- 172.21.15.19:0/645015757 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea6ba56d20 con 0x55ea6ba6fce0 2024-09-12T02:04:41.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.092+0000 7f36cbc70640 1 --2- 172.21.15.19:0/645015757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6ba6fce0 0x55ea6bb05030 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f36b40097e0 tx=0x7f36b4005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2d6afd60e26010 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:41.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.093+0000 7f36cac6e640 1 -- 172.21.15.19:0/645015757 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4008890 con 0x55ea6ba6fce0 2024-09-12T02:04:41.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.093+0000 7f36cac6e640 1 -- 172.21.15.19:0/645015757 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36b401a070 con 0x55ea6ba6fce0 2024-09-12T02:04:41.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.093+0000 7f36cac6e640 1 -- 172.21.15.19:0/645015757 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4008c50 con 0x55ea6ba6fce0 2024-09-12T02:04:41.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.093+0000 7f36ce979f40 1 -- 172.21.15.19:0/645015757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6ba6fce0 msgr2=0x55ea6bb05030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.093+0000 7f36ce979f40 1 --2- 172.21.15.19:0/645015757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6ba6fce0 0x55ea6bb05030 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f36b40097e0 tx=0x7f36b4005a00 comp rx=0 tx=0).stop 2024-09-12T02:04:41.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.093+0000 7f36ce979f40 1 -- 172.21.15.19:0/645015757 shutdown_connections 2024-09-12T02:04:41.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.093+0000 7f36ce979f40 1 --2- 172.21.15.19:0/645015757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ea6bae43a0 0x55ea6bb01820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.093+0000 7f36ce979f40 1 --2- 172.21.15.19:0/645015757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6ba6fce0 0x55ea6bb05030 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.093+0000 7f36ce979f40 1 --2- 172.21.15.19:0/645015757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b80022d0 0x55ea6bae3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.093+0000 7f36ce979f40 1 -- 172.21.15.19:0/645015757 >> 172.21.15.19:0/645015757 conn(0x55ea6ba2a9e0 msgr2=0x55ea6ba28e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:41.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.093+0000 7f36ce979f40 1 -- 172.21.15.19:0/645015757 shutdown_connections 2024-09-12T02:04:41.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.093+0000 7f36ce979f40 1 -- 172.21.15.19:0/645015757 wait complete. 2024-09-12T02:04:41.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.094+0000 7f36ce979f40 1 Processor -- start 2024-09-12T02:04:41.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.094+0000 7f36ce979f40 1 -- start start 2024-09-12T02:04:41.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.094+0000 7f36ce979f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6ba6fce0 0x55ea6bb00a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.094+0000 7f36ce979f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6bae43a0 0x55ea6ba58fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.094+0000 7f36ce979f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36b80022d0 0x55ea6ba59500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36ce979f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ea6ba5a160 con 0x55ea6ba6fce0 2024-09-12T02:04:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36ce979f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ea6bb05570 con 0x55ea6bae43a0 2024-09-12T02:04:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36ce979f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55ea6ba6ed70 con 0x7f36b80022d0 2024-09-12T02:04:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36cc471640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6ba6fce0 0x55ea6bb00a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36cc471640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6ba6fce0 0x55ea6bb00a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59338/0 (socket says 172.21.15.19:59338) 2024-09-12T02:04:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36cc471640 1 -- 172.21.15.19:0/39159294 learned_addr learned my addr 172.21.15.19:0/39159294 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36cbc70640 1 --2- 172.21.15.19:0/39159294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6bae43a0 0x55ea6ba58fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36ccc72640 1 --2- 172.21.15.19:0/39159294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36b80022d0 0x55ea6ba59500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36cc471640 1 -- 172.21.15.19:0/39159294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36b80022d0 msgr2=0x55ea6ba59500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36cc471640 1 --2- 172.21.15.19:0/39159294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36b80022d0 0x55ea6ba59500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36cc471640 1 -- 172.21.15.19:0/39159294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6bae43a0 msgr2=0x55ea6ba58fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36cc471640 1 --2- 172.21.15.19:0/39159294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6bae43a0 0x55ea6ba58fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36cc471640 1 -- 172.21.15.19:0/39159294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea6baea500 con 0x55ea6ba6fce0 2024-09-12T02:04:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36cc471640 1 --2- 172.21.15.19:0/39159294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6ba6fce0 0x55ea6bb00a20 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f36bc006d60 tx=0x55ea6ba5b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36c9c6c640 1 -- 172.21.15.19:0/39159294 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc006980 con 0x55ea6ba6fce0 2024-09-12T02:04:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36c9c6c640 1 -- 172.21.15.19:0/39159294 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36bc006270 con 0x55ea6ba6fce0 2024-09-12T02:04:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36ce979f40 1 -- 172.21.15.19:0/39159294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea6bae5ff0 con 0x55ea6ba6fce0 2024-09-12T02:04:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36c9c6c640 1 -- 172.21.15.19:0/39159294 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc001fd0 con 0x55ea6ba6fce0 2024-09-12T02:04:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.095+0000 7f36ce979f40 1 -- 172.21.15.19:0/39159294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea6bb00f60 con 0x55ea6ba6fce0 2024-09-12T02:04:41.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.097+0000 7f36c9c6c640 1 -- 172.21.15.19:0/39159294 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f36bc04db70 con 0x55ea6ba6fce0 2024-09-12T02:04:41.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.097+0000 7f36c9c6c640 1 --2- 172.21.15.19:0/39159294 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f36ac06a810 0x7f36ac06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.097+0000 7f36c9c6c640 1 -- 172.21.15.19:0/39159294 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 8023+0+0 (secure 0 0 0) 0x7f36bc0cdc40 con 0x55ea6ba6fce0 2024-09-12T02:04:41.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.097+0000 7f36cbc70640 1 --2- 172.21.15.19:0/39159294 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f36ac06a810 0x7f36ac06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.097+0000 7f36ce979f40 1 --2- 172.21.15.19:0/39159294 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ea6baeada0 0x55ea6bae97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.097+0000 7f36ce979f40 1 -- 172.21.15.19:0/39159294 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 13.f 13:f1f69726:::400.00000000:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55ea6bae9d30 con 0x55ea6baeada0 2024-09-12T02:04:41.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.098+0000 7f36ccc72640 1 --2- 172.21.15.19:0/39159294 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ea6baeada0 0x55ea6bae97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.098+0000 7f36cbc70640 1 --2- 172.21.15.19:0/39159294 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f36ac06a810 0x7f36ac06ccd0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f36b4017040 tx=0x7f36b4008000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:41.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.098+0000 7f36ccc72640 1 --2- 172.21.15.19:0/39159294 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ea6baeada0 0x55ea6bae97f0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:41.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.099+0000 7f36ccc72640 1 -- 172.21.15.19:0/39159294 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 400.00000000 [writefull 0~80] v115'109 uv109 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f36c4012610 con 0x55ea6baeada0 2024-09-12T02:04:41.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.099+0000 7f36ce979f40 1 -- 172.21.15.19:0/39159294 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ea6baeada0 msgr2=0x55ea6bae97f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.099+0000 7f36ce979f40 1 --2- 172.21.15.19:0/39159294 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ea6baeada0 0x55ea6bae97f0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.099+0000 7f36ce979f40 1 -- 172.21.15.19:0/39159294 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f36ac06a810 msgr2=0x7f36ac06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.099+0000 7f36ce979f40 1 --2- 172.21.15.19:0/39159294 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f36ac06a810 0x7f36ac06ccd0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f36b4017040 tx=0x7f36b4008000 comp rx=0 tx=0).stop 2024-09-12T02:04:41.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.099+0000 7f36ce979f40 1 -- 172.21.15.19:0/39159294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6ba6fce0 msgr2=0x55ea6bb00a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.099+0000 7f36ce979f40 1 --2- 172.21.15.19:0/39159294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6ba6fce0 0x55ea6bb00a20 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f36bc006d60 tx=0x55ea6ba5b7e0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.099+0000 7f36ccc72640 1 -- 172.21.15.19:0/39159294 reap_dead start 2024-09-12T02:04:41.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.099+0000 7f36ce979f40 1 -- 172.21.15.19:0/39159294 shutdown_connections 2024-09-12T02:04:41.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.099+0000 7f36ce979f40 1 -- 172.21.15.19:0/39159294 >> 172.21.15.19:0/39159294 conn(0x55ea6ba2a9e0 msgr2=0x55ea6baeb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:41.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.099+0000 7f36ce979f40 1 -- 172.21.15.19:0/39159294 shutdown_connections 2024-09-12T02:04:41.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.099+0000 7f36ce979f40 1 -- 172.21.15.19:0/39159294 wait complete. 2024-09-12T02:04:41.105 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:04:41.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.248+0000 7f4344b26640 1 Processor -- start 2024-09-12T02:04:41.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.248+0000 7f4344b26640 1 -- start start 2024-09-12T02:04:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.249+0000 7f4344b26640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f434006d740 0x7f43400cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.249+0000 7f4344b26640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f434015ff70 con 0x7f4340162e30 2024-09-12T02:04:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.249+0000 7f4344b26640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43400d4d10 con 0x7f4340162340 2024-09-12T02:04:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.249+0000 7f4344b26640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f434006de90 con 0x7f434006d740 2024-09-12T02:04:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.249+0000 7f433dd9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4340162e30 0x7f43400d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41886/0 (socket says 172.21.15.19:41886) 2024-09-12T02:04:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.249+0000 7f433dd9b640 1 -- 172.21.15.19:0/2373423197 learned_addr learned my addr 172.21.15.19:0/2373423197 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.250+0000 7f433ed9d640 1 --2- 172.21.15.19:0/2373423197 >> v2:172.21.15.135:3300/0 conn(0x7f434006d740 0x7f43400cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.250+0000 7f433d59a640 1 -- 172.21.15.19:0/2373423197 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2668477628 0 0) 0x7f434015ff70 con 0x7f4340162e30 2024-09-12T02:04:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.250+0000 7f433d59a640 1 -- 172.21.15.19:0/2373423197 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4328003520 con 0x7f4340162e30 2024-09-12T02:04:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.250+0000 7f433ed9d640 1 -- 172.21.15.19:0/2373423197 >> v1:172.21.15.135:6789/0 conn(0x7f4340162340 legacy=0x7f4340162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.250+0000 7f433d59a640 1 -- 172.21.15.19:0/2373423197 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3935093824 0 0) 0x7f43400d4d10 con 0x7f4340162340 2024-09-12T02:04:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.250+0000 7f433ed9d640 1 -- 172.21.15.19:0/2373423197 >> v1:172.21.15.19:6789/0 conn(0x7f4340162e30 legacy=0x7f43400d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.250+0000 7f433ed9d640 1 -- 172.21.15.19:0/2373423197 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43400d4ff0 con 0x7f434006d740 2024-09-12T02:04:41.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.251+0000 7f433ed9d640 1 --2- 172.21.15.19:0/2373423197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f434006d740 0x7f43400cf280 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4338009d90 tx=0x7f433802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf4644325f38f333 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:41.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.251+0000 7f433d59a640 1 -- 172.21.15.19:0/2373423197 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338007740 con 0x7f434006d740 2024-09-12T02:04:41.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.251+0000 7f433d59a640 1 -- 172.21.15.19:0/2373423197 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43380078e0 con 0x7f434006d740 2024-09-12T02:04:41.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.251+0000 7f433d59a640 1 -- 172.21.15.19:0/2373423197 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338007c90 con 0x7f434006d740 2024-09-12T02:04:41.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.251+0000 7f4344b26640 1 -- 172.21.15.19:0/2373423197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f434006d740 msgr2=0x7f43400cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.251+0000 7f4344b26640 1 --2- 172.21.15.19:0/2373423197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f434006d740 0x7f43400cf280 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4338009d90 tx=0x7f433802a660 comp rx=0 tx=0).stop 2024-09-12T02:04:41.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.252+0000 7f4344b26640 1 -- 172.21.15.19:0/2373423197 shutdown_connections 2024-09-12T02:04:41.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.252+0000 7f4344b26640 1 --2- 172.21.15.19:0/2373423197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f434006d740 0x7f43400cf280 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.252+0000 7f4344b26640 1 -- 172.21.15.19:0/2373423197 >> 172.21.15.19:0/2373423197 conn(0x7f434008bfc0 msgr2=0x7f43400d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:41.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.252+0000 7f4344b26640 1 -- 172.21.15.19:0/2373423197 shutdown_connections 2024-09-12T02:04:41.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.252+0000 7f4344b26640 1 -- 172.21.15.19:0/2373423197 wait complete. 2024-09-12T02:04:41.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.253+0000 7f4344b26640 1 Processor -- start 2024-09-12T02:04:41.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.253+0000 7f4344b26640 1 -- start start 2024-09-12T02:04:41.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f4344b26640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f434006d740 0x7f434015c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f4344b26640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4340162340 0x7f434014e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f4344b26640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4340162e30 0x7f434014ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f4344b26640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4340163270 con 0x7f4340162e30 2024-09-12T02:04:41.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f4344b26640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f43400cf7c0 con 0x7f434006d740 2024-09-12T02:04:41.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f4344b26640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f434006dbb0 con 0x7f4340162340 2024-09-12T02:04:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f433ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4340162e30 0x7f434014ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f433ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4340162e30 0x7f434014ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59346/0 (socket says 172.21.15.19:59346) 2024-09-12T02:04:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f433ed9d640 1 -- 172.21.15.19:0/397528367 learned_addr learned my addr 172.21.15.19:0/397528367 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f433dd9b640 1 --2- 172.21.15.19:0/397528367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4340162340 0x7f434014e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f433e59c640 1 --2- 172.21.15.19:0/397528367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f434006d740 0x7f434015c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f433ed9d640 1 -- 172.21.15.19:0/397528367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4340162340 msgr2=0x7f434014e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f433ed9d640 1 --2- 172.21.15.19:0/397528367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4340162340 0x7f434014e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f433ed9d640 1 -- 172.21.15.19:0/397528367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f434006d740 msgr2=0x7f434015c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f433ed9d640 1 --2- 172.21.15.19:0/397528367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f434006d740 0x7f434015c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f433ed9d640 1 -- 172.21.15.19:0/397528367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4340153d40 con 0x7f4340162e30 2024-09-12T02:04:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f433e59c640 1 --2- 172.21.15.19:0/397528367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f434006d740 0x7f434015c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f433ed9d640 1 --2- 172.21.15.19:0/397528367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4340162e30 0x7f434014ee70 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f4338009eb0 tx=0x7f4338004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f432effd640 1 -- 172.21.15.19:0/397528367 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338009450 con 0x7f4340162e30 2024-09-12T02:04:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.254+0000 7f432effd640 1 -- 172.21.15.19:0/397528367 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4338004240 con 0x7f4340162e30 2024-09-12T02:04:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.255+0000 7f4344b26640 1 -- 172.21.15.19:0/397528367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4340154020 con 0x7f4340162e30 2024-09-12T02:04:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.255+0000 7f432effd640 1 -- 172.21.15.19:0/397528367 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338004610 con 0x7f4340162e30 2024-09-12T02:04:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.255+0000 7f4344b26640 1 -- 172.21.15.19:0/397528367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43401545e0 con 0x7f4340162e30 2024-09-12T02:04:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.255+0000 7f4344b26640 1 -- 172.21.15.19:0/397528367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43400d52d0 con 0x7f4340162e30 2024-09-12T02:04:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.256+0000 7f432effd640 1 -- 172.21.15.19:0/397528367 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4338039040 con 0x7f4340162e30 2024-09-12T02:04:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.256+0000 7f432effd640 1 --2- 172.21.15.19:0/397528367 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f432006be30 0x7f432006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.257+0000 7f432effd640 1 -- 172.21.15.19:0/397528367 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 8023+0+0 (secure 0 0 0) 0x7f43380ac790 con 0x7f4340162e30 2024-09-12T02:04:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.257+0000 7f433e59c640 1 --2- 172.21.15.19:0/397528367 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f432006be30 0x7f432006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.257+0000 7f433e59c640 1 --2- 172.21.15.19:0/397528367 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f432006be30 0x7f432006e2f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f4330000f60 tx=0x7f4330009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:41.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.261+0000 7f432effd640 1 -- 172.21.15.19:0/397528367 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4338040030 con 0x7f4340162e30 2024-09-12T02:04:41.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.471+0000 7f4344b26640 1 -- 172.21.15.19:0/397528367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f434008e640 con 0x7f4340162e30 2024-09-12T02:04:41.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.738+0000 7f432effd640 1 -- 172.21.15.19:0/397528367 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v203) ==== 162+0+0 (secure 0 0 0) 0x7f433807a1e0 con 0x7f4340162e30 2024-09-12T02:04:41.738 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:04:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.740+0000 7f4344b26640 1 -- 172.21.15.19:0/397528367 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f432006be30 msgr2=0x7f432006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.740+0000 7f4344b26640 1 --2- 172.21.15.19:0/397528367 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f432006be30 0x7f432006e2f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f4330000f60 tx=0x7f4330009040 comp rx=0 tx=0).stop 2024-09-12T02:04:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.740+0000 7f4344b26640 1 -- 172.21.15.19:0/397528367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4340162e30 msgr2=0x7f434014ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.740+0000 7f4344b26640 1 --2- 172.21.15.19:0/397528367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4340162e30 0x7f434014ee70 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f4338009eb0 tx=0x7f4338004a40 comp rx=0 tx=0).stop 2024-09-12T02:04:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.740+0000 7f4344b26640 1 -- 172.21.15.19:0/397528367 shutdown_connections 2024-09-12T02:04:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.740+0000 7f4344b26640 1 --2- 172.21.15.19:0/397528367 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f432006be30 0x7f432006e2f0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.740+0000 7f4344b26640 1 --2- 172.21.15.19:0/397528367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4340162e30 0x7f434014ee70 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.740+0000 7f4344b26640 1 --2- 172.21.15.19:0/397528367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4340162340 0x7f434014e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.740+0000 7f4344b26640 1 --2- 172.21.15.19:0/397528367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f434006d740 0x7f434015c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.740+0000 7f4344b26640 1 -- 172.21.15.19:0/397528367 >> 172.21.15.19:0/397528367 conn(0x7f434008bfc0 msgr2=0x7f4340162720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:41.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.740+0000 7f4344b26640 1 -- 172.21.15.19:0/397528367 shutdown_connections 2024-09-12T02:04:41.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.740+0000 7f4344b26640 1 -- 172.21.15.19:0/397528367 wait complete. 2024-09-12T02:04:41.742 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:04:41.742+0000 7f25295cc640 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -22 ((22) Invalid argument) 2024-09-12T02:04:41.743 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:41.743+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:04:41.743 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:41.743+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:04:41.754 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:41.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.856+0000 7f4108217640 1 Processor -- start 2024-09-12T02:04:41.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.856+0000 7f4108217640 1 -- start start 2024-09-12T02:04:41.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.857+0000 7f4108217640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4100072de0 0x7f410015d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.857+0000 7f4108217640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4100072700 0x7f410015d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.857+0000 7f4108217640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4100146140 con 0x7f4100072320 2024-09-12T02:04:41.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.857+0000 7f4108217640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f41000cd740 con 0x7f4100072700 2024-09-12T02:04:41.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.857+0000 7f4108217640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f41000cda20 con 0x7f4100072de0 2024-09-12T02:04:41.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.858+0000 7f41067b4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4100072700 0x7f410015d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.858+0000 7f41057b2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4100072de0 0x7f410015d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.858+0000 7f41067b4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4100072700 0x7f410015d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:49936/0 (socket says 172.21.15.19:49936) 2024-09-12T02:04:41.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.858+0000 7f4105fb3640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f4100072320 0x7f41000cce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:43536/0 (socket says 172.21.15.19:43536) 2024-09-12T02:04:41.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.858+0000 7f41067b4640 1 -- 172.21.15.19:0/890743501 learned_addr learned my addr 172.21.15.19:0/890743501 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:41.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.858+0000 7f41057b2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4100072de0 0x7f410015d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:55316/0 (socket says 172.21.15.19:55316) 2024-09-12T02:04:41.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.858+0000 7f4104fb1640 1 -- 172.21.15.19:0/890743501 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3125430005 0 0) 0x7f4100146140 con 0x7f4100072320 2024-09-12T02:04:41.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.858+0000 7f4104fb1640 1 -- 172.21.15.19:0/890743501 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40e8003520 con 0x7f4100072320 2024-09-12T02:04:41.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.858+0000 7f41057b2640 1 -- 172.21.15.19:0/890743501 >> v2:172.21.15.135:3300/0 conn(0x7f4100072700 msgr2=0x7f410015d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:41.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.858+0000 7f41057b2640 1 --2- 172.21.15.19:0/890743501 >> v2:172.21.15.135:3300/0 conn(0x7f4100072700 0x7f410015d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.858+0000 7f41057b2640 1 -- 172.21.15.19:0/890743501 >> v1:172.21.15.135:6789/0 conn(0x7f4100072320 legacy=0x7f41000cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.858+0000 7f41057b2640 1 -- 172.21.15.19:0/890743501 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41000cdd00 con 0x7f4100072de0 2024-09-12T02:04:41.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.858+0000 7f41067b4640 1 --2- 172.21.15.19:0/890743501 >> v2:172.21.15.135:3300/0 conn(0x7f4100072700 0x7f410015d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:41.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.859+0000 7f41057b2640 1 --2- 172.21.15.19:0/890743501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4100072de0 0x7f410015d1e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f40f40097a0 tx=0x7f40f402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5201d279a33c5e56 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.859+0000 7f4104fb1640 1 -- 172.21.15.19:0/890743501 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f4037070 con 0x7f4100072de0 2024-09-12T02:04:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.859+0000 7f4104fb1640 1 -- 172.21.15.19:0/890743501 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f402ae50 con 0x7f4100072de0 2024-09-12T02:04:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.859+0000 7f4104fb1640 1 -- 172.21.15.19:0/890743501 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f4032640 con 0x7f4100072de0 2024-09-12T02:04:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.859+0000 7f4108217640 1 -- 172.21.15.19:0/890743501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4100072de0 msgr2=0x7f410015d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.859+0000 7f4108217640 1 --2- 172.21.15.19:0/890743501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4100072de0 0x7f410015d1e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f40f40097a0 tx=0x7f40f402a100 comp rx=0 tx=0).stop 2024-09-12T02:04:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.859+0000 7f4108217640 1 -- 172.21.15.19:0/890743501 shutdown_connections 2024-09-12T02:04:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.859+0000 7f4108217640 1 --2- 172.21.15.19:0/890743501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4100072de0 0x7f410015d1e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.859+0000 7f4108217640 1 --2- 172.21.15.19:0/890743501 >> v2:172.21.15.135:3300/0 conn(0x7f4100072700 0x7f410015d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.860+0000 7f4108217640 1 -- 172.21.15.19:0/890743501 >> 172.21.15.19:0/890743501 conn(0x7f4100067d70 msgr2=0x7f410006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.860+0000 7f4108217640 1 -- 172.21.15.19:0/890743501 shutdown_connections 2024-09-12T02:04:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.860+0000 7f4108217640 1 -- 172.21.15.19:0/890743501 wait complete. 2024-09-12T02:04:41.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.861+0000 7f4108217640 1 Processor -- start 2024-09-12T02:04:41.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.861+0000 7f4108217640 1 -- start start 2024-09-12T02:04:41.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.861+0000 7f4108217640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4100072320 0x7f41000b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.861+0000 7f4108217640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4100072700 0x7f41000adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.861+0000 7f4108217640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4100072de0 0x7f41000b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.861+0000 7f4108217640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f410015dde0 con 0x7f4100072de0 2024-09-12T02:04:41.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.861+0000 7f4108217640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f410015dc60 con 0x7f4100072320 2024-09-12T02:04:41.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.861+0000 7f4108217640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f410015df60 con 0x7f4100072700 2024-09-12T02:04:41.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.862+0000 7f41067b4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4100072de0 0x7f41000b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.862+0000 7f41067b4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4100072de0 0x7f41000b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59352/0 (socket says 172.21.15.19:59352) 2024-09-12T02:04:41.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.862+0000 7f41067b4640 1 -- 172.21.15.19:0/3719778987 learned_addr learned my addr 172.21.15.19:0/3719778987 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:41.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.862+0000 7f4105fb3640 1 --2- 172.21.15.19:0/3719778987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4100072320 0x7f41000b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.862+0000 7f41057b2640 1 --2- 172.21.15.19:0/3719778987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4100072700 0x7f41000adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.862+0000 7f41067b4640 1 -- 172.21.15.19:0/3719778987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4100072700 msgr2=0x7f41000adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.862+0000 7f41067b4640 1 --2- 172.21.15.19:0/3719778987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4100072700 0x7f41000adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.862+0000 7f41067b4640 1 -- 172.21.15.19:0/3719778987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4100072320 msgr2=0x7f41000b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.862+0000 7f41067b4640 1 --2- 172.21.15.19:0/3719778987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4100072320 0x7f41000b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.862+0000 7f41067b4640 1 -- 172.21.15.19:0/3719778987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41000b4f20 con 0x7f4100072de0 2024-09-12T02:04:41.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.862+0000 7f41067b4640 1 --2- 172.21.15.19:0/3719778987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4100072de0 0x7f41000b0c70 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f40f000efc0 tx=0x7f40f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:41.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.862+0000 7f40fe7fc640 1 -- 172.21.15.19:0/3719778987 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f000cbe0 con 0x7f4100072de0 2024-09-12T02:04:41.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.862+0000 7f40fe7fc640 1 -- 172.21.15.19:0/3719778987 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f000cd80 con 0x7f4100072de0 2024-09-12T02:04:41.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.862+0000 7f4108217640 1 -- 172.21.15.19:0/3719778987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41000b39a0 con 0x7f4100072de0 2024-09-12T02:04:41.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.862+0000 7f40fe7fc640 1 -- 172.21.15.19:0/3719778987 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f0003bb0 con 0x7f4100072de0 2024-09-12T02:04:41.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.862+0000 7f4108217640 1 -- 172.21.15.19:0/3719778987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41000b41e0 con 0x7f4100072de0 2024-09-12T02:04:41.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.863+0000 7f4108217640 1 -- 172.21.15.19:0/3719778987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f410015e340 con 0x7f4100072de0 2024-09-12T02:04:41.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.864+0000 7f40fe7fc640 1 -- 172.21.15.19:0/3719778987 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f40f001b030 con 0x7f4100072de0 2024-09-12T02:04:41.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.864+0000 7f40fe7fc640 1 --2- 172.21.15.19:0/3719778987 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f40ec06be30 0x7f40ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.864+0000 7f40fe7fc640 1 -- 172.21.15.19:0/3719778987 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8109+0+0 (secure 0 0 0) 0x7f40f008bbe0 con 0x7f4100072de0 2024-09-12T02:04:41.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.865+0000 7f4105fb3640 1 --2- 172.21.15.19:0/3719778987 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f40ec06be30 0x7f40ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.865+0000 7f4105fb3640 1 --2- 172.21.15.19:0/3719778987 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f40ec06be30 0x7f40ec06e2f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f40f8000f60 tx=0x7f40f8007b10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:41.869+0000 7f40fe7fc640 1 -- 172.21.15.19:0/3719778987 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f40f0022020 con 0x7f4100072de0 2024-09-12T02:04:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.083+0000 7f4108217640 1 -- 172.21.15.19:0/3719778987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41000ceb20 con 0x7f4100072de0 2024-09-12T02:04:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.083+0000 7f40fe7fc640 1 -- 172.21.15.19:0/3719778987 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 204 v204) ==== 95+0+3563 (secure 0 0 0) 0x7f41000b39a0 con 0x7f4100072de0 2024-09-12T02:04:42.084 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:42.084 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":204,"btime":"2024-09-12T02:04:41:744453+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":204,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:41.744408+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 204 2024-09-12T02:04:42.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.085+0000 7f4108217640 1 -- 172.21.15.19:0/3719778987 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f40ec06be30 msgr2=0x7f40ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.085+0000 7f4108217640 1 --2- 172.21.15.19:0/3719778987 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f40ec06be30 0x7f40ec06e2f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f40f8000f60 tx=0x7f40f8007b10 comp rx=0 tx=0).stop 2024-09-12T02:04:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.085+0000 7f4108217640 1 -- 172.21.15.19:0/3719778987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4100072de0 msgr2=0x7f41000b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.085+0000 7f4108217640 1 --2- 172.21.15.19:0/3719778987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4100072de0 0x7f41000b0c70 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f40f000efc0 tx=0x7f40f000c490 comp rx=0 tx=0).stop 2024-09-12T02:04:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.085+0000 7f4108217640 1 -- 172.21.15.19:0/3719778987 shutdown_connections 2024-09-12T02:04:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.085+0000 7f4108217640 1 --2- 172.21.15.19:0/3719778987 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f40ec06be30 0x7f40ec06e2f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.085+0000 7f4108217640 1 --2- 172.21.15.19:0/3719778987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4100072de0 0x7f41000b0c70 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.085+0000 7f4108217640 1 --2- 172.21.15.19:0/3719778987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4100072700 0x7f41000adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.085+0000 7f4108217640 1 --2- 172.21.15.19:0/3719778987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4100072320 0x7f41000b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.085+0000 7f4108217640 1 -- 172.21.15.19:0/3719778987 >> 172.21.15.19:0/3719778987 conn(0x7f4100067d70 msgr2=0x7f410006e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.085+0000 7f4108217640 1 -- 172.21.15.19:0/3719778987 shutdown_connections 2024-09-12T02:04:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.085+0000 7f4108217640 1 -- 172.21.15.19:0/3719778987 wait complete. 2024-09-12T02:04:42.097 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:42.097 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:42.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.199+0000 7f22b22f8640 1 Processor -- start 2024-09-12T02:04:42.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.199+0000 7f22b22f8640 1 -- start start 2024-09-12T02:04:42.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.200+0000 7f22b22f8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22ac15e740 0x7f22ac0d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:42.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.200+0000 7f22b22f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22ac06dbd0 0x7f22ac06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:42.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.200+0000 7f22b22f8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22ac06e000 con 0x7f22ac09b690 2024-09-12T02:04:42.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.200+0000 7f22b22f8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f22ac15eb20 con 0x7f22ac15e740 2024-09-12T02:04:42.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.200+0000 7f22b22f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f22ac06d260 con 0x7f22ac06dbd0 2024-09-12T02:04:42.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.200+0000 7f22abfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22ac15e740 0x7f22ac0d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:42.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.200+0000 7f22abfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22ac15e740 0x7f22ac0d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59358/0 (socket says 172.21.15.19:59358) 2024-09-12T02:04:42.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.200+0000 7f22abfff640 1 -- 172.21.15.19:0/1074621853 learned_addr learned my addr 172.21.15.19:0/1074621853 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:42.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.201+0000 7f22b0895640 1 --2- 172.21.15.19:0/1074621853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22ac06dbd0 0x7f22ac06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:42.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.201+0000 7f22abfff640 1 -- 172.21.15.19:0/1074621853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22ac06dbd0 msgr2=0x7f22ac06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:42.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.201+0000 7f22abfff640 1 --2- 172.21.15.19:0/1074621853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22ac06dbd0 0x7f22ac06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.201+0000 7f22abfff640 1 -- 172.21.15.19:0/1074621853 >> v1:172.21.15.135:6789/0 conn(0x7f22ac09b690 legacy=0x7f22ac06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:42.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.201+0000 7f22abfff640 1 -- 172.21.15.19:0/1074621853 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ac0d0780 con 0x7f22ac15e740 2024-09-12T02:04:42.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.201+0000 7f22abfff640 1 --2- 172.21.15.19:0/1074621853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac15e740 0x7f22ac0d1540 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f229c009870 tx=0x7f229c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edc70781947422d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:42.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.202+0000 7f22aaffd640 1 -- 172.21.15.19:0/1074621853 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c037070 con 0x7f22ac15e740 2024-09-12T02:04:42.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.202+0000 7f22aaffd640 1 -- 172.21.15.19:0/1074621853 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f229c032440 con 0x7f22ac15e740 2024-09-12T02:04:42.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.202+0000 7f22aaffd640 1 -- 172.21.15.19:0/1074621853 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c032810 con 0x7f22ac15e740 2024-09-12T02:04:42.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.202+0000 7f22b22f8640 1 -- 172.21.15.19:0/1074621853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac15e740 msgr2=0x7f22ac0d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:42.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.202+0000 7f22b22f8640 1 --2- 172.21.15.19:0/1074621853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac15e740 0x7f22ac0d1540 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f229c009870 tx=0x7f229c02a2a0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.202+0000 7f22b22f8640 1 -- 172.21.15.19:0/1074621853 shutdown_connections 2024-09-12T02:04:42.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.202+0000 7f22b22f8640 1 --2- 172.21.15.19:0/1074621853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22ac06dbd0 0x7f22ac06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.202+0000 7f22b22f8640 1 --2- 172.21.15.19:0/1074621853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac15e740 0x7f22ac0d1540 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.202+0000 7f22b22f8640 1 -- 172.21.15.19:0/1074621853 >> 172.21.15.19:0/1074621853 conn(0x7f22ac0d23a0 msgr2=0x7f22ac0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:42.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.202+0000 7f22b22f8640 1 -- 172.21.15.19:0/1074621853 shutdown_connections 2024-09-12T02:04:42.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.202+0000 7f22b22f8640 1 -- 172.21.15.19:0/1074621853 wait complete. 2024-09-12T02:04:42.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.203+0000 7f22b22f8640 1 Processor -- start 2024-09-12T02:04:42.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.204+0000 7f22b22f8640 1 -- start start 2024-09-12T02:04:42.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.204+0000 7f22b22f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22ac06dbd0 0x7f22ac14fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:42.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.204+0000 7f22b22f8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22ac09b690 0x7f22ac1ea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:42.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.204+0000 7f22b22f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac15e740 0x7f22ac0c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:42.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.204+0000 7f22b22f8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac0d1020 con 0x7f22ac15e740 2024-09-12T02:04:42.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.204+0000 7f22b22f8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac0d0d40 con 0x7f22ac09b690 2024-09-12T02:04:42.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.204+0000 7f22b22f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f22ac09bac0 con 0x7f22ac06dbd0 2024-09-12T02:04:42.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.205+0000 7f22b0895640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac15e740 0x7f22ac0c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:42.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.205+0000 7f22b0895640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac15e740 0x7f22ac0c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59360/0 (socket says 172.21.15.19:59360) 2024-09-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.205+0000 7f22b0895640 1 -- 172.21.15.19:0/4166669544 learned_addr learned my addr 172.21.15.19:0/4166669544 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.205+0000 7f22abfff640 1 --2- 172.21.15.19:0/4166669544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22ac06dbd0 0x7f22ac14fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.205+0000 7f22ab7fe640 1 --2- 172.21.15.19:0/4166669544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22ac09b690 0x7f22ac1ea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.205+0000 7f22b0895640 1 -- 172.21.15.19:0/4166669544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22ac06dbd0 msgr2=0x7f22ac14fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.205+0000 7f22b0895640 1 --2- 172.21.15.19:0/4166669544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22ac06dbd0 0x7f22ac14fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.205+0000 7f22b0895640 1 -- 172.21.15.19:0/4166669544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22ac09b690 msgr2=0x7f22ac1ea2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.205+0000 7f22b0895640 1 --2- 172.21.15.19:0/4166669544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22ac09b690 0x7f22ac1ea2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.205+0000 7f22b0895640 1 -- 172.21.15.19:0/4166669544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ac0b5ff0 con 0x7f22ac15e740 2024-09-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.205+0000 7f22b0895640 1 --2- 172.21.15.19:0/4166669544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac15e740 0x7f22ac0c9590 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f22a4007e60 tx=0x7f22a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.205+0000 7f22a8ff9640 1 -- 172.21.15.19:0/4166669544 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a4014420 con 0x7f22ac15e740 2024-09-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.205+0000 7f22a8ff9640 1 -- 172.21.15.19:0/4166669544 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a4019070 con 0x7f22ac15e740 2024-09-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.205+0000 7f22b22f8640 1 -- 172.21.15.19:0/4166669544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ac0b62d0 con 0x7f22ac15e740 2024-09-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.205+0000 7f22a8ff9640 1 -- 172.21.15.19:0/4166669544 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a4014820 con 0x7f22ac15e740 2024-09-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.205+0000 7f22b22f8640 1 -- 172.21.15.19:0/4166669544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ac0b6890 con 0x7f22ac15e740 2024-09-12T02:04:42.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.206+0000 7f22b22f8640 1 -- 172.21.15.19:0/4166669544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22ac06cd20 con 0x7f22ac15e740 2024-09-12T02:04:42.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.207+0000 7f22a8ff9640 1 -- 172.21.15.19:0/4166669544 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22a40149c0 con 0x7f22ac15e740 2024-09-12T02:04:42.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.207+0000 7f22a8ff9640 1 --2- 172.21.15.19:0/4166669544 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f229806be30 0x7f229806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:42.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.207+0000 7f22a8ff9640 1 -- 172.21.15.19:0/4166669544 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8109+0+0 (secure 0 0 0) 0x7f22a408bf70 con 0x7f22ac15e740 2024-09-12T02:04:42.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.208+0000 7f22abfff640 1 --2- 172.21.15.19:0/4166669544 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f229806be30 0x7f229806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:42.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.208+0000 7f22abfff640 1 --2- 172.21.15.19:0/4166669544 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f229806be30 0x7f229806e2f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f229c034000 tx=0x7f229c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:42.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.212+0000 7f22a8ff9640 1 -- 172.21.15.19:0/4166669544 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f22a40598d0 con 0x7f22ac15e740 2024-09-12T02:04:42.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.422+0000 7f22b22f8640 1 -- 172.21.15.19:0/4166669544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22ac0d1cb0 con 0x7f22ac15e740 2024-09-12T02:04:42.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.422+0000 7f22a8ff9640 1 -- 172.21.15.19:0/4166669544 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 204 v204) ==== 95+0+3563 (secure 0 0 0) 0x7f22a405dbd0 con 0x7f22ac15e740 2024-09-12T02:04:42.423 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:42.423 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":204,"btime":"2024-09-12T02:04:41:744453+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":204,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:41.744408+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:42.423 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 204 2024-09-12T02:04:42.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.424+0000 7f22b22f8640 1 -- 172.21.15.19:0/4166669544 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f229806be30 msgr2=0x7f229806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:42.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.424+0000 7f22b22f8640 1 --2- 172.21.15.19:0/4166669544 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f229806be30 0x7f229806e2f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f229c034000 tx=0x7f229c02e000 comp rx=0 tx=0).stop 2024-09-12T02:04:42.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.424+0000 7f22b22f8640 1 -- 172.21.15.19:0/4166669544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac15e740 msgr2=0x7f22ac0c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:42.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.424+0000 7f22b22f8640 1 --2- 172.21.15.19:0/4166669544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac15e740 0x7f22ac0c9590 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f22a4007e60 tx=0x7f22a400e4b0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.424+0000 7f22b22f8640 1 -- 172.21.15.19:0/4166669544 shutdown_connections 2024-09-12T02:04:42.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.424+0000 7f22b22f8640 1 --2- 172.21.15.19:0/4166669544 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f229806be30 0x7f229806e2f0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.424+0000 7f22b22f8640 1 --2- 172.21.15.19:0/4166669544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac15e740 0x7f22ac0c9590 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.424+0000 7f22b22f8640 1 --2- 172.21.15.19:0/4166669544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22ac09b690 0x7f22ac1ea2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.424+0000 7f22b22f8640 1 --2- 172.21.15.19:0/4166669544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22ac06dbd0 0x7f22ac14fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.424+0000 7f22b22f8640 1 -- 172.21.15.19:0/4166669544 >> 172.21.15.19:0/4166669544 conn(0x7f22ac0d23a0 msgr2=0x7f22ac0b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:42.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.424+0000 7f22b22f8640 1 -- 172.21.15.19:0/4166669544 shutdown_connections 2024-09-12T02:04:42.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.424+0000 7f22b22f8640 1 -- 172.21.15.19:0/4166669544 wait complete. 2024-09-12T02:04:42.436 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:42.436 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:42.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.538+0000 7ff3bd178640 1 Processor -- start 2024-09-12T02:04:42.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.538+0000 7ff3bd178640 1 -- start start 2024-09-12T02:04:42.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.538+0000 7ff3bd178640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff3b815e5f0 0x7ff3b80d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:42.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.538+0000 7ff3bd178640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3b80d3690 con 0x7ff3b80b6690 2024-09-12T02:04:42.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.538+0000 7ff3bd178640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3b80d3970 con 0x7ff3b80d30f0 2024-09-12T02:04:42.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.538+0000 7ff3bd178640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff3b806d530 con 0x7ff3b815e5f0 2024-09-12T02:04:42.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b759e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff3b80b6690 0x7ff3b806d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41896/0 (socket says 172.21.15.19:41896) 2024-09-12T02:04:42.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b759e640 1 -- 172.21.15.19:0/1816345805 learned_addr learned my addr 172.21.15.19:0/1816345805 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:42.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b6d9d640 1 --2- 172.21.15.19:0/1816345805 >> v2:172.21.15.135:3300/0 conn(0x7ff3b815e5f0 0x7ff3b80d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:42.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b5d9b640 1 -- 172.21.15.19:0/1816345805 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2430202168 0 0) 0x7ff3b80d3690 con 0x7ff3b80b6690 2024-09-12T02:04:42.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b5d9b640 1 -- 172.21.15.19:0/1816345805 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3a0003520 con 0x7ff3b80b6690 2024-09-12T02:04:42.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b5d9b640 1 -- 172.21.15.19:0/1816345805 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3178800444 0 0) 0x7ff3a0003520 con 0x7ff3b80b6690 2024-09-12T02:04:42.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b5d9b640 1 -- 172.21.15.19:0/1816345805 >> v2:172.21.15.135:3300/0 conn(0x7ff3b815e5f0 msgr2=0x7ff3b80d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:42.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b5d9b640 1 --2- 172.21.15.19:0/1816345805 >> v2:172.21.15.135:3300/0 conn(0x7ff3b815e5f0 0x7ff3b80d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b5d9b640 1 -- 172.21.15.19:0/1816345805 >> v1:172.21.15.135:6789/0 conn(0x7ff3b80d30f0 legacy=0x7ff3b80b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:42.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b5d9b640 1 -- 172.21.15.19:0/1816345805 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b806cee0 con 0x7ff3b80b6690 2024-09-12T02:04:42.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b5d9b640 1 -- 172.21.15.19:0/1816345805 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7ff3b00019f0 con 0x7ff3b80b6690 2024-09-12T02:04:42.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b5d9b640 1 -- 172.21.15.19:0/1816345805 >> v1:172.21.15.19:6789/0 conn(0x7ff3b80b6690 legacy=0x7ff3b806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:42.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b5d9b640 1 --2- 172.21.15.19:0/1816345805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3a00039b0 0x7ff3a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:42.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b5d9b640 1 --2- 172.21.15.19:0/1816345805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0004800 0x7ff3a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:42.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b5d9b640 1 --2- 172.21.15.19:0/1816345805 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a00051c0 0x7ff3a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:42.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b5d9b640 1 -- 172.21.15.19:0/1816345805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b806d530 con 0x7ff3a0004800 2024-09-12T02:04:42.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b5d9b640 1 -- 172.21.15.19:0/1816345805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a000c060 con 0x7ff3a00039b0 2024-09-12T02:04:42.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b5d9b640 1 -- 172.21.15.19:0/1816345805 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a000c260 con 0x7ff3a00051c0 2024-09-12T02:04:42.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.539+0000 7ff3b659c640 1 --2- 172.21.15.19:0/1816345805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0004800 0x7ff3a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:42.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.540+0000 7ff3b6d9d640 1 --2- 172.21.15.19:0/1816345805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3a00039b0 0x7ff3a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:42.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.540+0000 7ff3b759e640 1 --2- 172.21.15.19:0/1816345805 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a00051c0 0x7ff3a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:42.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.540+0000 7ff3b659c640 1 -- 172.21.15.19:0/1816345805 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a00051c0 msgr2=0x7ff3a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:42.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.540+0000 7ff3b659c640 1 --2- 172.21.15.19:0/1816345805 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a00051c0 0x7ff3a000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.540+0000 7ff3b659c640 1 -- 172.21.15.19:0/1816345805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3a00039b0 msgr2=0x7ff3a0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:42.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.540+0000 7ff3b659c640 1 --2- 172.21.15.19:0/1816345805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3a00039b0 0x7ff3a0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.540+0000 7ff3b659c640 1 -- 172.21.15.19:0/1816345805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a0003520 con 0x7ff3a0004800 2024-09-12T02:04:42.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.540+0000 7ff3b759e640 1 -- 172.21.15.19:0/1816345805 reap_dead start 2024-09-12T02:04:42.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.540+0000 7ff3b659c640 1 --2- 172.21.15.19:0/1816345805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0004800 0x7ff3a0004c80 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac001750 tx=0x7ff3a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5dbe9e09a7aaed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:42.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.541+0000 7ff3b5d9b640 1 -- 172.21.15.19:0/1816345805 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac001370 con 0x7ff3a0004800 2024-09-12T02:04:42.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.541+0000 7ff3b5d9b640 1 -- 172.21.15.19:0/1816345805 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ac0052d0 con 0x7ff3a0004800 2024-09-12T02:04:42.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.541+0000 7ff3b5d9b640 1 -- 172.21.15.19:0/1816345805 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac02abc0 con 0x7ff3a0004800 2024-09-12T02:04:42.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.541+0000 7ff3bd178640 1 -- 172.21.15.19:0/1816345805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0004800 msgr2=0x7ff3a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:42.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.541+0000 7ff3bd178640 1 --2- 172.21.15.19:0/1816345805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0004800 0x7ff3a0004c80 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac001750 tx=0x7ff3a0005830 comp rx=0 tx=0).stop 2024-09-12T02:04:42.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.541+0000 7ff3bd178640 1 -- 172.21.15.19:0/1816345805 shutdown_connections 2024-09-12T02:04:42.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.541+0000 7ff3bd178640 1 --2- 172.21.15.19:0/1816345805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0004800 0x7ff3a0004c80 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.541+0000 7ff3bd178640 1 -- 172.21.15.19:0/1816345805 >> 172.21.15.19:0/1816345805 conn(0x7ff3b808bfc0 msgr2=0x7ff3b80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.541+0000 7ff3bd178640 1 -- 172.21.15.19:0/1816345805 shutdown_connections 2024-09-12T02:04:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.541+0000 7ff3bd178640 1 -- 172.21.15.19:0/1816345805 wait complete. 2024-09-12T02:04:42.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.543+0000 7ff3bd178640 1 Processor -- start 2024-09-12T02:04:42.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.543+0000 7ff3bd178640 1 -- start start 2024-09-12T02:04:42.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.543+0000 7ff3bd178640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a0004800 0x7ff3b815c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:42.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.543+0000 7ff3bd178640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3b80c8030 0x7ff3b80b8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:42.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.543+0000 7ff3bd178640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3b80b8e80 0x7ff3b80b9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.543+0000 7ff3bd178640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b80b5f80 con 0x7ff3b80c8030 2024-09-12T02:04:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.543+0000 7ff3bd178640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b815e9d0 con 0x7ff3b80b8e80 2024-09-12T02:04:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.543+0000 7ff3bd178640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff3b80b6100 con 0x7ff3a0004800 2024-09-12T02:04:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.543+0000 7ff3b659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3b80c8030 0x7ff3b80b8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.543+0000 7ff3b659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3b80c8030 0x7ff3b80b8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59378/0 (socket says 172.21.15.19:59378) 2024-09-12T02:04:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.544+0000 7ff3b659c640 1 -- 172.21.15.19:0/1392790846 learned_addr learned my addr 172.21.15.19:0/1392790846 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.544+0000 7ff3b6d9d640 1 --2- 172.21.15.19:0/1392790846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a0004800 0x7ff3b815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.544+0000 7ff3b759e640 1 --2- 172.21.15.19:0/1392790846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3b80b8e80 0x7ff3b80b9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.544+0000 7ff3b659c640 1 -- 172.21.15.19:0/1392790846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a0004800 msgr2=0x7ff3b815c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.544+0000 7ff3b659c640 1 --2- 172.21.15.19:0/1392790846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a0004800 0x7ff3b815c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.544+0000 7ff3b659c640 1 -- 172.21.15.19:0/1392790846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3b80b8e80 msgr2=0x7ff3b80b9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.544+0000 7ff3b659c640 1 --2- 172.21.15.19:0/1392790846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3b80b8e80 0x7ff3b80b9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.544+0000 7ff3b659c640 1 -- 172.21.15.19:0/1392790846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b815fc30 con 0x7ff3b80c8030 2024-09-12T02:04:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.544+0000 7ff3b659c640 1 --2- 172.21.15.19:0/1392790846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3b80c8030 0x7ff3b80b8940 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac02a570 tx=0x7ff3ac001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.544+0000 7ff39f7fe640 1 -- 172.21.15.19:0/1392790846 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac03f030 con 0x7ff3b80c8030 2024-09-12T02:04:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.544+0000 7ff39f7fe640 1 -- 172.21.15.19:0/1392790846 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ac005480 con 0x7ff3b80c8030 2024-09-12T02:04:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.544+0000 7ff3bd178640 1 -- 172.21.15.19:0/1392790846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3b80c8b50 con 0x7ff3b80c8030 2024-09-12T02:04:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.544+0000 7ff39f7fe640 1 -- 172.21.15.19:0/1392790846 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac037040 con 0x7ff3b80c8030 2024-09-12T02:04:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.544+0000 7ff3bd178640 1 -- 172.21.15.19:0/1392790846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3b80a20c0 con 0x7ff3b80c8030 2024-09-12T02:04:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.545+0000 7ff3bd178640 1 -- 172.21.15.19:0/1392790846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3b80d05d0 con 0x7ff3b80c8030 2024-09-12T02:04:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.546+0000 7ff39f7fe640 1 -- 172.21.15.19:0/1392790846 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3ac042070 con 0x7ff3b80c8030 2024-09-12T02:04:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.546+0000 7ff39f7fe640 1 --2- 172.21.15.19:0/1392790846 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3a406be30 0x7ff3a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.546+0000 7ff39f7fe640 1 -- 172.21.15.19:0/1392790846 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8109+0+0 (secure 0 0 0) 0x7ff3ac0ab0e0 con 0x7ff3b80c8030 2024-09-12T02:04:42.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.546+0000 7ff3b6d9d640 1 --2- 172.21.15.19:0/1392790846 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3a406be30 0x7ff3a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:42.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.547+0000 7ff3b6d9d640 1 --2- 172.21.15.19:0/1392790846 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3a406be30 0x7ff3a406e2f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009c40 tx=0x7ff3a8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:42.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.550+0000 7ff39f7fe640 1 -- 172.21.15.19:0/1392790846 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3b80d05d0 con 0x7ff3b80c8030 2024-09-12T02:04:42.552 INFO:tasks.ceph.mds.d.smithi135.stderr: -40> 2024-09-12T02:04:37.801+0000 7f8b3c87f640 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds0_inotable': Decoder at 'virtual void InoTable::decode_state(ceph::buffer::v15_2_0::list::const_iterator&)' v=2 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-09-12T02:04:42.580 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T02:04:42.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.761+0000 7ff3bd178640 1 -- 172.21.15.19:0/1392790846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3b80b1790 con 0x7ff3b80c8030 2024-09-12T02:04:42.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.762+0000 7ff39f7fe640 1 -- 172.21.15.19:0/1392790846 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 204 v204) ==== 95+0+3563 (secure 0 0 0) 0x7ff3ac079130 con 0x7ff3b80c8030 2024-09-12T02:04:42.763 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:42.763 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":204,"btime":"2024-09-12T02:04:41:744453+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":204,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:41.744408+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:42.763 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 204 2024-09-12T02:04:42.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.764+0000 7ff3bd178640 1 -- 172.21.15.19:0/1392790846 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3a406be30 msgr2=0x7ff3a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:42.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.764+0000 7ff3bd178640 1 --2- 172.21.15.19:0/1392790846 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3a406be30 0x7ff3a406e2f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009c40 tx=0x7ff3a8009190 comp rx=0 tx=0).stop 2024-09-12T02:04:42.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.764+0000 7ff3bd178640 1 -- 172.21.15.19:0/1392790846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3b80c8030 msgr2=0x7ff3b80b8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:42.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.764+0000 7ff3bd178640 1 --2- 172.21.15.19:0/1392790846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3b80c8030 0x7ff3b80b8940 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac02a570 tx=0x7ff3ac001120 comp rx=0 tx=0).stop 2024-09-12T02:04:42.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.764+0000 7ff3bd178640 1 -- 172.21.15.19:0/1392790846 shutdown_connections 2024-09-12T02:04:42.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.764+0000 7ff3bd178640 1 --2- 172.21.15.19:0/1392790846 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3a406be30 0x7ff3a406e2f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.764+0000 7ff3bd178640 1 --2- 172.21.15.19:0/1392790846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3b80b8e80 0x7ff3b80b9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.764+0000 7ff3bd178640 1 --2- 172.21.15.19:0/1392790846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3b80c8030 0x7ff3b80b8940 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.764+0000 7ff3bd178640 1 --2- 172.21.15.19:0/1392790846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a0004800 0x7ff3b815c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.764+0000 7ff3bd178640 1 -- 172.21.15.19:0/1392790846 >> 172.21.15.19:0/1392790846 conn(0x7ff3b808bfc0 msgr2=0x7ff3b806d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:42.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.764+0000 7ff3bd178640 1 -- 172.21.15.19:0/1392790846 shutdown_connections 2024-09-12T02:04:42.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.764+0000 7ff3bd178640 1 -- 172.21.15.19:0/1392790846 wait complete. 2024-09-12T02:04:42.775 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt 400.00000000' led to DAMAGED state 2024-09-12T02:04:42.776 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt 100.00000000.inode' 2024-09-12T02:04:42.776 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:04:42.776 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:04:42.792 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:04:42.792 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:04:42.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:42.793 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:04:42.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:04:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:04:42.850 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:04:42.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.993+0000 7f14fd2dd640 1 Processor -- start 2024-09-12T02:04:42.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.993+0000 7f14fd2dd640 1 -- start start 2024-09-12T02:04:42.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.994+0000 7f14fd2dd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f14f815e5f0 0x7f14f80d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:42.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.994+0000 7f14fd2dd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14f80d30f0 0x7f14f80b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:42.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.994+0000 7f14fd2dd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14f80d3690 con 0x7f14f80b64c0 2024-09-12T02:04:42.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.994+0000 7f14fd2dd640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f14f806d530 con 0x7f14f815e5f0 2024-09-12T02:04:42.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.994+0000 7f14fd2dd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f14f80d3970 con 0x7f14f80d30f0 2024-09-12T02:04:42.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.994+0000 7f14f77fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f14f80b64c0 0x7f14f80cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41902/0 (socket says 172.21.15.19:41902) 2024-09-12T02:04:42.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.994+0000 7f14f77fe640 1 -- 172.21.15.19:0/3298887568 learned_addr learned my addr 172.21.15.19:0/3298887568 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:42.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.994+0000 7f14f6ffd640 1 --2- 172.21.15.19:0/3298887568 >> v2:172.21.15.135:3300/0 conn(0x7f14f815e5f0 0x7f14f80d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:42.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.994+0000 7f14f67fc640 1 --2- 172.21.15.19:0/3298887568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14f80d30f0 0x7f14f80b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:42.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.994+0000 7f14f5ffb640 1 -- 172.21.15.19:0/3298887568 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2326808233 0 0) 0x7f14f80d3690 con 0x7f14f80b64c0 2024-09-12T02:04:42.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.994+0000 7f14f5ffb640 1 -- 172.21.15.19:0/3298887568 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14e4003520 con 0x7f14f80b64c0 2024-09-12T02:04:42.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.995+0000 7f14f5ffb640 1 -- 172.21.15.19:0/3298887568 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1649029344 0 0) 0x7f14e4003520 con 0x7f14f80b64c0 2024-09-12T02:04:42.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.995+0000 7f14f67fc640 1 -- 172.21.15.19:0/3298887568 >> v2:172.21.15.135:3300/0 conn(0x7f14f815e5f0 msgr2=0x7f14f80d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:42.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.995+0000 7f14f67fc640 1 --2- 172.21.15.19:0/3298887568 >> v2:172.21.15.135:3300/0 conn(0x7f14f815e5f0 0x7f14f80d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.995+0000 7f14f67fc640 1 -- 172.21.15.19:0/3298887568 >> v1:172.21.15.19:6789/0 conn(0x7f14f80b64c0 legacy=0x7f14f80cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:42.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.995+0000 7f14f67fc640 1 -- 172.21.15.19:0/3298887568 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f806cee0 con 0x7f14f80d30f0 2024-09-12T02:04:42.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.995+0000 7f14f6ffd640 1 --2- 172.21.15.19:0/3298887568 >> v2:172.21.15.135:3300/0 conn(0x7f14f815e5f0 0x7f14f80d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:42.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.995+0000 7f14f67fc640 1 --2- 172.21.15.19:0/3298887568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14f80d30f0 0x7f14f80b5f80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f14e00097a0 tx=0x7f14e002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f9a4785153365c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:42.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.996+0000 7f14f5ffb640 1 -- 172.21.15.19:0/3298887568 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0037070 con 0x7f14f80d30f0 2024-09-12T02:04:42.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.996+0000 7f14f5ffb640 1 -- 172.21.15.19:0/3298887568 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e002aba0 con 0x7f14f80d30f0 2024-09-12T02:04:42.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.996+0000 7f14f5ffb640 1 -- 172.21.15.19:0/3298887568 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e80019f0 con 0x7f14f80d30f0 2024-09-12T02:04:42.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.996+0000 7f14fd2dd640 1 -- 172.21.15.19:0/3298887568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14f80d30f0 msgr2=0x7f14f80b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:42.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.996+0000 7f14fd2dd640 1 --2- 172.21.15.19:0/3298887568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14f80d30f0 0x7f14f80b5f80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f14e00097a0 tx=0x7f14e002a110 comp rx=0 tx=0).stop 2024-09-12T02:04:42.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.996+0000 7f14fd2dd640 1 -- 172.21.15.19:0/3298887568 shutdown_connections 2024-09-12T02:04:42.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.996+0000 7f14fd2dd640 1 --2- 172.21.15.19:0/3298887568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14f80d30f0 0x7f14f80b5f80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.996+0000 7f14fd2dd640 1 --2- 172.21.15.19:0/3298887568 >> v2:172.21.15.135:3300/0 conn(0x7f14f815e5f0 0x7f14f80d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:42.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.996+0000 7f14fd2dd640 1 -- 172.21.15.19:0/3298887568 >> 172.21.15.19:0/3298887568 conn(0x7f14f808bfc0 msgr2=0x7f14f80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:42.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.996+0000 7f14fd2dd640 1 -- 172.21.15.19:0/3298887568 shutdown_connections 2024-09-12T02:04:42.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.996+0000 7f14fd2dd640 1 -- 172.21.15.19:0/3298887568 wait complete. 2024-09-12T02:04:42.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.998+0000 7f14fd2dd640 1 Processor -- start 2024-09-12T02:04:42.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.998+0000 7f14fd2dd640 1 -- start start 2024-09-12T02:04:43.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.998+0000 7f14fd2dd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14f80b64c0 0x7f14f8157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:43.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.998+0000 7f14fd2dd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14f80d30f0 0x7f14f80ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:43.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.998+0000 7f14fd2dd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14f815e5f0 0x7f14f81613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:43.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.998+0000 7f14fd2dd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f14f80d5310 con 0x7f14f80d30f0 2024-09-12T02:04:43.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.998+0000 7f14fd2dd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f14f815e9d0 con 0x7f14f815e5f0 2024-09-12T02:04:43.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.998+0000 7f14fd2dd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f14f806e9d0 con 0x7f14f80b64c0 2024-09-12T02:04:43.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.998+0000 7f14f67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14f80d30f0 0x7f14f80ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:43.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.998+0000 7f14f67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14f80d30f0 0x7f14f80ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59380/0 (socket says 172.21.15.19:59380) 2024-09-12T02:04:43.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.998+0000 7f14f67fc640 1 -- 172.21.15.19:0/1318865128 learned_addr learned my addr 172.21.15.19:0/1318865128 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:43.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.999+0000 7f14f77fe640 1 --2- 172.21.15.19:0/1318865128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14f815e5f0 0x7f14f81613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:43.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.999+0000 7f14f6ffd640 1 --2- 172.21.15.19:0/1318865128 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14f80b64c0 0x7f14f8157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:43.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.999+0000 7f14f67fc640 1 -- 172.21.15.19:0/1318865128 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14f80b64c0 msgr2=0x7f14f8157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:43.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.999+0000 7f14f67fc640 1 --2- 172.21.15.19:0/1318865128 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14f80b64c0 0x7f14f8157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:43.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.999+0000 7f14f67fc640 1 -- 172.21.15.19:0/1318865128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14f815e5f0 msgr2=0x7f14f81613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:43.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.999+0000 7f14f67fc640 1 --2- 172.21.15.19:0/1318865128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14f815e5f0 0x7f14f81613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:43.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.999+0000 7f14f67fc640 1 -- 172.21.15.19:0/1318865128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f80cb950 con 0x7f14f80d30f0 2024-09-12T02:04:43.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.999+0000 7f14f6ffd640 1 --2- 172.21.15.19:0/1318865128 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14f80b64c0 0x7f14f8157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:43.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.999+0000 7f14f67fc640 1 --2- 172.21.15.19:0/1318865128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14f80d30f0 0x7f14f80ca250 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f14e0035040 tx=0x7f14e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:43.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.999+0000 7f14ef7fe640 1 -- 172.21.15.19:0/1318865128 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0037050 con 0x7f14f80d30f0 2024-09-12T02:04:43.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.999+0000 7f14ef7fe640 1 -- 172.21.15.19:0/1318865128 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e0043070 con 0x7f14f80d30f0 2024-09-12T02:04:43.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.999+0000 7f14fd2dd640 1 -- 172.21.15.19:0/1318865128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f80cbc30 con 0x7f14f80d30f0 2024-09-12T02:04:43.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.999+0000 7f14ef7fe640 1 -- 172.21.15.19:0/1318865128 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0006e10 con 0x7f14f80d30f0 2024-09-12T02:04:43.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:42.999+0000 7f14fd2dd640 1 -- 172.21.15.19:0/1318865128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f80cc1f0 con 0x7f14f80d30f0 2024-09-12T02:04:43.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.000+0000 7f14fd2dd640 1 -- 172.21.15.19:0/1318865128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f80d3690 con 0x7f14f80d30f0 2024-09-12T02:04:43.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.001+0000 7f14ef7fe640 1 -- 172.21.15.19:0/1318865128 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f14e0048460 con 0x7f14f80d30f0 2024-09-12T02:04:43.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.001+0000 7f14ef7fe640 1 --2- 172.21.15.19:0/1318865128 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14d806be60 0x7f14d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:43.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.001+0000 7f14ef7fe640 1 -- 172.21.15.19:0/1318865128 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8109+0+0 (secure 0 0 0) 0x7f14e00abed0 con 0x7f14f80d30f0 2024-09-12T02:04:43.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.001+0000 7f14f6ffd640 1 --2- 172.21.15.19:0/1318865128 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14d806be60 0x7f14d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:43.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.002+0000 7f14f6ffd640 1 --2- 172.21.15.19:0/1318865128 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14d806be60 0x7f14d806e320 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009af0 tx=0x7f14f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:43.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.006+0000 7f14ef7fe640 1 -- 172.21.15.19:0/1318865128 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f14e0079fb0 con 0x7f14f80d30f0 2024-09-12T02:04:43.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.223+0000 7f14fd2dd640 1 -- 172.21.15.19:0/1318865128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f14f80cc3c0 con 0x7f14f80d30f0 2024-09-12T02:04:43.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.843+0000 7f14ef7fe640 1 -- 172.21.15.19:0/1318865128 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v206) ==== 161+0+0 (secure 0 0 0) 0x7f14e00798b0 con 0x7f14f80d30f0 2024-09-12T02:04:43.844 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:04:43.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.846+0000 7f14fd2dd640 1 -- 172.21.15.19:0/1318865128 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14d806be60 msgr2=0x7f14d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:43.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.846+0000 7f14fd2dd640 1 --2- 172.21.15.19:0/1318865128 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14d806be60 0x7f14d806e320 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009af0 tx=0x7f14f0008040 comp rx=0 tx=0).stop 2024-09-12T02:04:43.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.846+0000 7f14fd2dd640 1 -- 172.21.15.19:0/1318865128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14f80d30f0 msgr2=0x7f14f80ca250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:43.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.846+0000 7f14fd2dd640 1 --2- 172.21.15.19:0/1318865128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14f80d30f0 0x7f14f80ca250 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f14e0035040 tx=0x7f14e00046c0 comp rx=0 tx=0).stop 2024-09-12T02:04:43.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.846+0000 7f14fd2dd640 1 -- 172.21.15.19:0/1318865128 shutdown_connections 2024-09-12T02:04:43.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.846+0000 7f14fd2dd640 1 --2- 172.21.15.19:0/1318865128 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14d806be60 0x7f14d806e320 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:43.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.846+0000 7f14fd2dd640 1 --2- 172.21.15.19:0/1318865128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14f815e5f0 0x7f14f81613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:43.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.846+0000 7f14fd2dd640 1 --2- 172.21.15.19:0/1318865128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14f80d30f0 0x7f14f80ca250 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:43.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.846+0000 7f14fd2dd640 1 --2- 172.21.15.19:0/1318865128 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14f80b64c0 0x7f14f8157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:43.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.846+0000 7f14fd2dd640 1 -- 172.21.15.19:0/1318865128 >> 172.21.15.19:0/1318865128 conn(0x7f14f808bfc0 msgr2=0x7f14f80b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:43.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.847+0000 7f14fd2dd640 1 -- 172.21.15.19:0/1318865128 shutdown_connections 2024-09-12T02:04:43.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.847+0000 7f14fd2dd640 1 -- 172.21.15.19:0/1318865128 wait complete. 2024-09-12T02:04:43.860 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:04:43.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.969+0000 7f2df7cd2640 1 Processor -- start 2024-09-12T02:04:43.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.969+0000 7f2df7cd2640 1 -- start start 2024-09-12T02:04:43.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.970+0000 7f2df7cd2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2df0162060 0x7f2df00b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:43.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.970+0000 7f2df7cd2640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2df006d9f0 con 0x7f2df0161c80 2024-09-12T02:04:43.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.970+0000 7f2df7cd2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2df006dcd0 con 0x7f2df00b64b0 2024-09-12T02:04:43.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.970+0000 7f2df7cd2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2df006dfb0 con 0x7f2df0162060 2024-09-12T02:04:43.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.970+0000 7f2df5a6e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2df0161c80 0x7f2df006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41914/0 (socket says 172.21.15.19:41914) 2024-09-12T02:04:43.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.970+0000 7f2df5a6e640 1 -- 172.21.15.19:0/1645985293 learned_addr learned my addr 172.21.15.19:0/1645985293 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:43.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.970+0000 7f2df4a6c640 1 -- 172.21.15.19:0/1645985293 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 71310695 0 0) 0x7f2df006d9f0 con 0x7f2df0161c80 2024-09-12T02:04:43.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.970+0000 7f2df526d640 1 --2- 172.21.15.19:0/1645985293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2df0162060 0x7f2df00b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:43.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.970+0000 7f2df4a6c640 1 -- 172.21.15.19:0/1645985293 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ddc003520 con 0x7f2df0161c80 2024-09-12T02:04:43.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.970+0000 7f2df4a6c640 1 -- 172.21.15.19:0/1645985293 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1216650957 0 0) 0x7f2ddc003520 con 0x7f2df0161c80 2024-09-12T02:04:43.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.970+0000 7f2df4a6c640 1 -- 172.21.15.19:0/1645985293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2df0162060 msgr2=0x7f2df00b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:43.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.970+0000 7f2df4a6c640 1 --2- 172.21.15.19:0/1645985293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2df0162060 0x7f2df00b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:43.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.971+0000 7f2df4a6c640 1 -- 172.21.15.19:0/1645985293 >> v1:172.21.15.135:6789/0 conn(0x7f2df00b64b0 legacy=0x7f2df00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:43.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.971+0000 7f2df4a6c640 1 -- 172.21.15.19:0/1645985293 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df00d2890 con 0x7f2df0161c80 2024-09-12T02:04:43.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.971+0000 7f2df4a6c640 1 -- 172.21.15.19:0/1645985293 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f2dec001670 con 0x7f2df0161c80 2024-09-12T02:04:43.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.971+0000 7f2df4a6c640 1 -- 172.21.15.19:0/1645985293 >> v1:172.21.15.19:6789/0 conn(0x7f2df0161c80 legacy=0x7f2df006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:43.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.971+0000 7f2df4a6c640 1 --2- 172.21.15.19:0/1645985293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc0039e0 0x7f2ddc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:43.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.971+0000 7f2df4a6c640 1 --2- 172.21.15.19:0/1645985293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2df0162060 0x7f2ddc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:43.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.971+0000 7f2df4a6c640 1 --2- 172.21.15.19:0/1645985293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ddc004d40 0x7f2ddc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:43.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.971+0000 7f2df4a6c640 1 -- 172.21.15.19:0/1645985293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2df006dfb0 con 0x7f2ddc0039e0 2024-09-12T02:04:43.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.971+0000 7f2df4a6c640 1 -- 172.21.15.19:0/1645985293 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc00bb50 con 0x7f2ddc004d40 2024-09-12T02:04:43.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.971+0000 7f2df4a6c640 1 -- 172.21.15.19:0/1645985293 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2ddc00bd20 con 0x7f2df0162060 2024-09-12T02:04:43.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.971+0000 7f2df5a6e640 1 --2- 172.21.15.19:0/1645985293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc0039e0 0x7f2ddc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:43.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.971+0000 7f2df626f640 1 --2- 172.21.15.19:0/1645985293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ddc004d40 0x7f2ddc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:43.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.971+0000 7f2df526d640 1 --2- 172.21.15.19:0/1645985293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2df0162060 0x7f2ddc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:43.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.971+0000 7f2df5a6e640 1 -- 172.21.15.19:0/1645985293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2df0162060 msgr2=0x7f2ddc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:43.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.971+0000 7f2df5a6e640 1 --2- 172.21.15.19:0/1645985293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2df0162060 0x7f2ddc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:43.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.971+0000 7f2df5a6e640 1 -- 172.21.15.19:0/1645985293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ddc004d40 msgr2=0x7f2ddc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:43.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.971+0000 7f2df5a6e640 1 --2- 172.21.15.19:0/1645985293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ddc004d40 0x7f2ddc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:43.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.971+0000 7f2df5a6e640 1 -- 172.21.15.19:0/1645985293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ddc003520 con 0x7f2ddc0039e0 2024-09-12T02:04:43.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.972+0000 7f2df5a6e640 1 --2- 172.21.15.19:0/1645985293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc0039e0 0x7f2ddc003e00 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00c240 tx=0x7f2ddc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d333c2ae8bd07c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:43.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.972+0000 7f2df4a6c640 1 -- 172.21.15.19:0/1645985293 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec007d30 con 0x7f2ddc0039e0 2024-09-12T02:04:43.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.972+0000 7f2df4a6c640 1 -- 172.21.15.19:0/1645985293 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dec005af0 con 0x7f2ddc0039e0 2024-09-12T02:04:43.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.972+0000 7f2df4a6c640 1 -- 172.21.15.19:0/1645985293 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec007070 con 0x7f2ddc0039e0 2024-09-12T02:04:43.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.972+0000 7f2df7cd2640 1 -- 172.21.15.19:0/1645985293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc0039e0 msgr2=0x7f2ddc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:43.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.972+0000 7f2df7cd2640 1 --2- 172.21.15.19:0/1645985293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc0039e0 0x7f2ddc003e00 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00c240 tx=0x7f2ddc005830 comp rx=0 tx=0).stop 2024-09-12T02:04:43.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.972+0000 7f2df626f640 1 -- 172.21.15.19:0/1645985293 reap_dead start 2024-09-12T02:04:43.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.972+0000 7f2df7cd2640 1 -- 172.21.15.19:0/1645985293 shutdown_connections 2024-09-12T02:04:43.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.972+0000 7f2df7cd2640 1 -- 172.21.15.19:0/1645985293 >> 172.21.15.19:0/1645985293 conn(0x7f2df00d44f0 msgr2=0x7f2df00d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:43.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.973+0000 7f2df7cd2640 1 -- 172.21.15.19:0/1645985293 shutdown_connections 2024-09-12T02:04:43.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.973+0000 7f2df7cd2640 1 -- 172.21.15.19:0/1645985293 wait complete. 2024-09-12T02:04:43.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.974+0000 7f2df7cd2640 1 Processor -- start 2024-09-12T02:04:43.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.974+0000 7f2df7cd2640 1 -- start start 2024-09-12T02:04:43.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.974+0000 7f2df7cd2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc0039e0 0x7f2df0156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:43.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.974+0000 7f2df7cd2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2df00b8f90 0x7f2df01f49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:43.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.974+0000 7f2df7cd2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2df00b7340 0x7f2df015ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:43.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2df7cd2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2df00b6300 con 0x7f2ddc0039e0 2024-09-12T02:04:43.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2df7cd2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2df00b6180 con 0x7f2df00b7340 2024-09-12T02:04:43.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2df7cd2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2df00c7fc0 con 0x7f2df00b8f90 2024-09-12T02:04:43.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2df5a6e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc0039e0 0x7f2df0156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:43.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2df5a6e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc0039e0 0x7f2df0156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59402/0 (socket says 172.21.15.19:59402) 2024-09-12T02:04:43.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2df5a6e640 1 -- 172.21.15.19:0/2004519952 learned_addr learned my addr 172.21.15.19:0/2004519952 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:43.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2df626f640 1 --2- 172.21.15.19:0/2004519952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2df00b7340 0x7f2df015ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:43.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2df526d640 1 --2- 172.21.15.19:0/2004519952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2df00b8f90 0x7f2df01f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:43.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2df5a6e640 1 -- 172.21.15.19:0/2004519952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2df00b8f90 msgr2=0x7f2df01f49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:43.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2df5a6e640 1 --2- 172.21.15.19:0/2004519952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2df00b8f90 0x7f2df01f49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:43.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2df5a6e640 1 -- 172.21.15.19:0/2004519952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2df00b7340 msgr2=0x7f2df015ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:43.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2df5a6e640 1 --2- 172.21.15.19:0/2004519952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2df00b7340 0x7f2df015ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:43.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2df5a6e640 1 -- 172.21.15.19:0/2004519952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df01f5230 con 0x7f2ddc0039e0 2024-09-12T02:04:43.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2df5a6e640 1 --2- 172.21.15.19:0/2004519952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc0039e0 0x7f2df0156610 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f2dec02ae50 tx=0x7f2dec001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:43.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2de67fc640 1 -- 172.21.15.19:0/2004519952 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec042020 con 0x7f2ddc0039e0 2024-09-12T02:04:43.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2de67fc640 1 -- 172.21.15.19:0/2004519952 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dec007d10 con 0x7f2ddc0039e0 2024-09-12T02:04:43.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2de67fc640 1 -- 172.21.15.19:0/2004519952 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec0074c0 con 0x7f2ddc0039e0 2024-09-12T02:04:43.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2df7cd2640 1 -- 172.21.15.19:0/2004519952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df01f5510 con 0x7f2ddc0039e0 2024-09-12T02:04:43.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.975+0000 7f2df7cd2640 1 -- 172.21.15.19:0/2004519952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df00c8210 con 0x7f2ddc0039e0 2024-09-12T02:04:43.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.976+0000 7f2df7cd2640 1 -- 172.21.15.19:0/2004519952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2df00b6960 con 0x7f2ddc0039e0 2024-09-12T02:04:43.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.977+0000 7f2de67fc640 1 -- 172.21.15.19:0/2004519952 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2dec045020 con 0x7f2ddc0039e0 2024-09-12T02:04:43.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.977+0000 7f2de67fc640 1 --2- 172.21.15.19:0/2004519952 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dd406be60 0x7f2dd406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:43.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.977+0000 7f2de67fc640 1 -- 172.21.15.19:0/2004519952 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8109+0+0 (secure 0 0 0) 0x7f2dec0ac150 con 0x7f2ddc0039e0 2024-09-12T02:04:43.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.978+0000 7f2df526d640 1 --2- 172.21.15.19:0/2004519952 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dd406be60 0x7f2dd406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:43.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.978+0000 7f2df526d640 1 --2- 172.21.15.19:0/2004519952 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dd406be60 0x7f2dd406e320 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2df00d25c0 tx=0x7f2de0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:43.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:43.982+0000 7f2de67fc640 1 -- 172.21.15.19:0/2004519952 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2dec04c020 con 0x7f2ddc0039e0 2024-09-12T02:04:44.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.229+0000 7f2df7cd2640 1 -- 172.21.15.19:0/2004519952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f2df00d2a60 con 0x7f2ddc0039e0 2024-09-12T02:04:44.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.851+0000 7f2de67fc640 1 -- 172.21.15.19:0/2004519952 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v207) ==== 101+0+0 (secure 0 0 0) 0x7f2dec005ac0 con 0x7f2ddc0039e0 2024-09-12T02:04:44.852 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:04:44.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.854+0000 7f2df7cd2640 1 -- 172.21.15.19:0/2004519952 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dd406be60 msgr2=0x7f2dd406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:44.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.854+0000 7f2df7cd2640 1 --2- 172.21.15.19:0/2004519952 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dd406be60 0x7f2dd406e320 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2df00d25c0 tx=0x7f2de0008040 comp rx=0 tx=0).stop 2024-09-12T02:04:44.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.854+0000 7f2df7cd2640 1 -- 172.21.15.19:0/2004519952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc0039e0 msgr2=0x7f2df0156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:44.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.854+0000 7f2df7cd2640 1 --2- 172.21.15.19:0/2004519952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc0039e0 0x7f2df0156610 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f2dec02ae50 tx=0x7f2dec001a40 comp rx=0 tx=0).stop 2024-09-12T02:04:44.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.854+0000 7f2df7cd2640 1 -- 172.21.15.19:0/2004519952 shutdown_connections 2024-09-12T02:04:44.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.854+0000 7f2df7cd2640 1 --2- 172.21.15.19:0/2004519952 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dd406be60 0x7f2dd406e320 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.854+0000 7f2df7cd2640 1 --2- 172.21.15.19:0/2004519952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2df00b7340 0x7f2df015ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.854+0000 7f2df7cd2640 1 --2- 172.21.15.19:0/2004519952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2df00b8f90 0x7f2df01f49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.854+0000 7f2df7cd2640 1 --2- 172.21.15.19:0/2004519952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ddc0039e0 0x7f2df0156610 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.854+0000 7f2df7cd2640 1 -- 172.21.15.19:0/2004519952 >> 172.21.15.19:0/2004519952 conn(0x7f2df00d44f0 msgr2=0x7f2df00b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:44.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.854+0000 7f2df7cd2640 1 -- 172.21.15.19:0/2004519952 shutdown_connections 2024-09-12T02:04:44.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.854+0000 7f2df7cd2640 1 -- 172.21.15.19:0/2004519952 wait complete. 2024-09-12T02:04:44.867 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:04:44.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.912+0000 7f999a63cf40 1 Processor -- start 2024-09-12T02:04:44.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.912+0000 7f999a63cf40 1 -- start start 2024-09-12T02:04:44.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.913+0000 7f999a63cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56351f349e20 0x56351f3ff780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:44.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.913+0000 7f999a63cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56351f407660 0x56351f4af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:44.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.913+0000 7f999a63cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56351f407a40 0x56351f4189d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:44.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.913+0000 7f999a63cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56351f34a290 con 0x56351f407660 2024-09-12T02:04:44.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.913+0000 7f999a63cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56351f29b510 con 0x56351f349e20 2024-09-12T02:04:44.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.913+0000 7f999a63cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56351f3379b0 con 0x56351f407a40 2024-09-12T02:04:44.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.913+0000 7f9997931640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56351f407660 0x56351f4af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:44.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.913+0000 7f9997931640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56351f407660 0x56351f4af6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59418/0 (socket says 172.21.15.19:59418) 2024-09-12T02:04:44.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.913+0000 7f9997931640 1 -- 172.21.15.19:0/1568394503 learned_addr learned my addr 172.21.15.19:0/1568394503 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:44.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.913+0000 7f9998132640 1 --2- 172.21.15.19:0/1568394503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56351f349e20 0x56351f3ff780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:44.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.913+0000 7f9997931640 1 -- 172.21.15.19:0/1568394503 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56351f407a40 msgr2=0x56351f4189d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:44.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.913+0000 7f9997931640 1 --2- 172.21.15.19:0/1568394503 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56351f407a40 0x56351f4189d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.913+0000 7f9997931640 1 -- 172.21.15.19:0/1568394503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56351f349e20 msgr2=0x56351f3ff780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:44.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.913+0000 7f9997931640 1 --2- 172.21.15.19:0/1568394503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56351f349e20 0x56351f3ff780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.913+0000 7f9997931640 1 -- 172.21.15.19:0/1568394503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56351f3ffcc0 con 0x56351f407660 2024-09-12T02:04:44.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.913+0000 7f9998132640 1 --2- 172.21.15.19:0/1568394503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56351f349e20 0x56351f3ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:44.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.913+0000 7f9997931640 1 --2- 172.21.15.19:0/1568394503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56351f407660 0x56351f4af6f0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f998c0095d0 tx=0x7f998c009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3458e0321c6b1d72 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:44.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.914+0000 7f999692f640 1 -- 172.21.15.19:0/1568394503 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c017070 con 0x56351f407660 2024-09-12T02:04:44.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.914+0000 7f999692f640 1 -- 172.21.15.19:0/1568394503 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f998c006680 con 0x56351f407660 2024-09-12T02:04:44.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.914+0000 7f999692f640 1 -- 172.21.15.19:0/1568394503 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c006a30 con 0x56351f407660 2024-09-12T02:04:44.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.914+0000 7f999a63cf40 1 -- 172.21.15.19:0/1568394503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56351f407660 msgr2=0x56351f4af6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:44.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.914+0000 7f999a63cf40 1 --2- 172.21.15.19:0/1568394503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56351f407660 0x56351f4af6f0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f998c0095d0 tx=0x7f998c009a90 comp rx=0 tx=0).stop 2024-09-12T02:04:44.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.914+0000 7f999a63cf40 1 -- 172.21.15.19:0/1568394503 shutdown_connections 2024-09-12T02:04:44.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.914+0000 7f999a63cf40 1 --2- 172.21.15.19:0/1568394503 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56351f407a40 0x56351f4189d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.914+0000 7f999a63cf40 1 --2- 172.21.15.19:0/1568394503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56351f407660 0x56351f4af6f0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.914+0000 7f999a63cf40 1 --2- 172.21.15.19:0/1568394503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56351f349e20 0x56351f3ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.914+0000 7f999a63cf40 1 -- 172.21.15.19:0/1568394503 >> 172.21.15.19:0/1568394503 conn(0x56351f34aad0 msgr2=0x56351f34aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:44.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.914+0000 7f999a63cf40 1 -- 172.21.15.19:0/1568394503 shutdown_connections 2024-09-12T02:04:44.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.914+0000 7f999a63cf40 1 -- 172.21.15.19:0/1568394503 wait complete. 2024-09-12T02:04:44.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.915+0000 7f999a63cf40 1 Processor -- start 2024-09-12T02:04:44.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.915+0000 7f999a63cf40 1 -- start start 2024-09-12T02:04:44.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.915+0000 7f999a63cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56351f349e20 0x56351f404e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:44.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.915+0000 7f999a63cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56351f407660 0x56351f418bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.915+0000 7f999a63cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56351f407a40 0x56351f403430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.915+0000 7f999a63cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56351f3753b0 con 0x56351f407660 2024-09-12T02:04:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.915+0000 7f999a63cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56351f418340 con 0x56351f349e20 2024-09-12T02:04:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.915+0000 7f999a63cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56351f375600 con 0x56351f407a40 2024-09-12T02:04:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.916+0000 7f9997931640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56351f407660 0x56351f418bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.916+0000 7f9997931640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56351f407660 0x56351f418bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59432/0 (socket says 172.21.15.19:59432) 2024-09-12T02:04:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.916+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 learned_addr learned my addr 172.21.15.19:0/2078304851 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.916+0000 7f9998933640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56351f407a40 0x56351f403430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.916+0000 7f9998132640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56351f349e20 0x56351f404e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.916+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56351f407a40 msgr2=0x56351f403430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.916+0000 7f9997931640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56351f407a40 0x56351f403430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.916+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56351f349e20 msgr2=0x56351f404e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:44.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.916+0000 7f9997931640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56351f349e20 0x56351f404e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.916+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56351f3fb070 con 0x56351f407660 2024-09-12T02:04:44.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.916+0000 7f9997931640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56351f407660 0x56351f418bc0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f998c000c00 tx=0x7f998c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:44.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.916+0000 7f999592d640 1 -- 172.21.15.19:0/2078304851 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c017040 con 0x56351f407660 2024-09-12T02:04:44.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.916+0000 7f999592d640 1 -- 172.21.15.19:0/2078304851 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f998c022070 con 0x56351f407660 2024-09-12T02:04:44.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.916+0000 7f999592d640 1 -- 172.21.15.19:0/2078304851 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c01d8c0 con 0x56351f407660 2024-09-12T02:04:44.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.916+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56351f3fb350 con 0x56351f407660 2024-09-12T02:04:44.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.916+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56351f3fcd40 con 0x56351f407660 2024-09-12T02:04:44.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.918+0000 7f999592d640 1 -- 172.21.15.19:0/2078304851 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f998c01da60 con 0x56351f407660 2024-09-12T02:04:44.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.918+0000 7f999592d640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f998406a840 0x7f998406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:44.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.918+0000 7f999592d640 1 -- 172.21.15.19:0/2078304851 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8109+0+0 (secure 0 0 0) 0x7f998c08b4a0 con 0x56351f407660 2024-09-12T02:04:44.923 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:04:44.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.919+0000 7f9998132640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f998406a840 0x7f998406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:44.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.919+0000 7f999a63cf40 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56351f419100 0x56351f403e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:44.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.919+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f3fd540 con 0x56351f419100 2024-09-12T02:04:44.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.919+0000 7f9998933640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56351f419100 0x56351f403e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:44.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.919+0000 7f9998933640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56351f419100 0x56351f403e80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:44.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.919+0000 7f9998132640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f998406a840 0x7f998406cd00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9988000f80 tx=0x7f9988008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:44.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.920+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v116'660 uv634 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.921+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f3fd8e0 con 0x56351f419100 2024-09-12T02:04:44.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.922+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v116'661 uv661 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.922+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f3fdd40 con 0x56351f419100 2024-09-12T02:04:44.925 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:04:44.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.922+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v116'662 uv662 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.923+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f3fe0e0 con 0x56351f419100 2024-09-12T02:04:44.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.924+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v116'663 uv663 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.924+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f3fe4e0 con 0x56351f419100 2024-09-12T02:04:44.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.924+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v116'664 uv664 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.925+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c4030 con 0x56351f419100 2024-09-12T02:04:44.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.925+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v116'665 uv665 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.925+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c43d0 con 0x56351f419100 2024-09-12T02:04:44.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.927+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v116'666 uv640 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.927+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c4770 con 0x56351f419100 2024-09-12T02:04:44.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.928+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v116'667 uv667 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.928+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c4770 con 0x56351f419100 2024-09-12T02:04:44.929 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:04:44.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.928+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v116'668 uv668 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.928+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c5780 con 0x56351f419100 2024-09-12T02:04:44.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.929+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v116'669 uv669 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.929+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c5780 con 0x56351f419100 2024-09-12T02:04:44.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.930+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v116'670 uv670 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.931+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c4c20 con 0x56351f419100 2024-09-12T02:04:44.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.931+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v116'671 uv671 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.931+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c4c20 con 0x56351f419100 2024-09-12T02:04:44.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.933+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v116'672 uv647 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.933+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c4c20 con 0x56351f419100 2024-09-12T02:04:44.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.934+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v116'673 uv673 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.934+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c4c20 con 0x56351f419100 2024-09-12T02:04:44.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.935+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v116'674 uv674 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.935 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:04:44.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.935+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c5c30 con 0x56351f419100 2024-09-12T02:04:44.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.936+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v116'675 uv675 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.936+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c5c30 con 0x56351f419100 2024-09-12T02:04:44.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.937+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v116'676 uv676 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.937+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c4c20 con 0x56351f419100 2024-09-12T02:04:44.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.938+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v116'677 uv677 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.938+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c4ed0 con 0x56351f419100 2024-09-12T02:04:44.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.939+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v116'678 uv678 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.939+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c4ed0 con 0x56351f419100 2024-09-12T02:04:44.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.940+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v116'679 uv653 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.940+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c4ed0 con 0x56351f419100 2024-09-12T02:04:44.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.941+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v116'680 uv680 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.941+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c4ed0 con 0x56351f419100 2024-09-12T02:04:44.942 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:04:44.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.942+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v116'681 uv681 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.942+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c5ee0 con 0x56351f419100 2024-09-12T02:04:44.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.943+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v116'682 uv682 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.943+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c5ee0 con 0x56351f419100 2024-09-12T02:04:44.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.944+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v116'683 uv683 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.944+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c4ed0 con 0x56351f419100 2024-09-12T02:04:44.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.945+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v116'684 uv684 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.945+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c4ed0 con 0x56351f419100 2024-09-12T02:04:44.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.947+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v116'685 uv659 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.947+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c4ed0 con 0x56351f419100 2024-09-12T02:04:44.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.948+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v116'686 uv686 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.948+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c4ed0 con 0x56351f419100 2024-09-12T02:04:44.949 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:04:44.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.949+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v116'687 uv687 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.949+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c5ee0 con 0x56351f419100 2024-09-12T02:04:44.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.950+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v116'688 uv688 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.950+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c5ee0 con 0x56351f419100 2024-09-12T02:04:44.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.951+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v116'689 uv689 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.951+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c4ed0 con 0x56351f419100 2024-09-12T02:04:44.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.952+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v116'690 uv690 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f419100 2024-09-12T02:04:44.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.952+0000 7f999a63cf40 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x56351f4c5550 0x56351f4c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:44.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.952+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c7e80 con 0x56351f4c5550 2024-09-12T02:04:44.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.952+0000 7f9998132640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x56351f4c5550 0x56351f4c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:44.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.952+0000 7f9998132640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x56351f4c5550 0x56351f4c7940 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:44.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.954+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v116'485 uv468 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.954+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c8220 con 0x56351f4c5550 2024-09-12T02:04:44.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.956+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v116'486 uv486 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.956+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c85c0 con 0x56351f4c5550 2024-09-12T02:04:44.957 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:04:44.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.957+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v116'487 uv487 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.957+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c8e10 con 0x56351f4c5550 2024-09-12T02:04:44.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.958+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v116'488 uv488 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.958+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c91b0 con 0x56351f4c5550 2024-09-12T02:04:44.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.959+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v116'489 uv489 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.960+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c9550 con 0x56351f4c5550 2024-09-12T02:04:44.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.961+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v116'490 uv473 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.961+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c98f0 con 0x56351f4c5550 2024-09-12T02:04:44.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.962+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v116'491 uv491 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.962+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c9c90 con 0x56351f4c5550 2024-09-12T02:04:44.964 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:04:44.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.964+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v116'492 uv492 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.964+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c9c90 con 0x56351f4c5550 2024-09-12T02:04:44.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.965+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v116'493 uv493 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.965+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c9c90 con 0x56351f4c5550 2024-09-12T02:04:44.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.966+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v116'494 uv494 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.966+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c9c90 con 0x56351f4c5550 2024-09-12T02:04:44.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.968+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v116'495 uv478 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.968+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c9c90 con 0x56351f4c5550 2024-09-12T02:04:44.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.969+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v116'496 uv496 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.969+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c9c90 con 0x56351f4c5550 2024-09-12T02:04:44.971 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:04:44.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.970+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v116'497 uv497 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.970+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4ce110 con 0x56351f4c5550 2024-09-12T02:04:44.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.971+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v116'498 uv498 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.971+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4ce110 con 0x56351f4c5550 2024-09-12T02:04:44.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.973+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v116'499 uv499 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.973+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c9c90 con 0x56351f4c5550 2024-09-12T02:04:44.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.974+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v116'500 uv484 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.974+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c9c90 con 0x56351f4c5550 2024-09-12T02:04:44.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.975+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v116'501 uv501 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.975+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c9c90 con 0x56351f4c5550 2024-09-12T02:04:44.976 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:04:44.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.976+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v116'502 uv502 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.976+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4caca0 con 0x56351f4c5550 2024-09-12T02:04:44.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.977+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v116'503 uv503 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.977+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4caca0 con 0x56351f4c5550 2024-09-12T02:04:44.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.979+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v116'504 uv504 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.979+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4c9c90 con 0x56351f4c5550 2024-09-12T02:04:44.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.980+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v116'505 uv505 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4c5550 2024-09-12T02:04:44.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.980+0000 7f999a63cf40 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x56351f4ca310 0x56351f4cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:44.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.980+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4ccc40 con 0x56351f4ca310 2024-09-12T02:04:44.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.980+0000 7f9997931640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x56351f4ca310 0x56351f4cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:44.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.981+0000 7f9997931640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x56351f4ca310 0x56351f4cc700 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:44.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.982+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v116'129 uv128 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f998c01ed60 con 0x56351f4ca310 2024-09-12T02:04:44.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.982+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4cd0c0 con 0x56351f4ca310 2024-09-12T02:04:44.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.983+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v116'130 uv130 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:44.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.983+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4cd5a0 con 0x56351f4ca310 2024-09-12T02:04:44.984 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:04:44.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.984+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v116'131 uv131 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:44.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.984+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4cee50 con 0x56351f4ca310 2024-09-12T02:04:44.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.985+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v116'132 uv132 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:44.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.985+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4cf1f0 con 0x56351f4ca310 2024-09-12T02:04:44.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.986+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v116'133 uv133 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:44.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.986+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4cde40 con 0x56351f4ca310 2024-09-12T02:04:44.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.987+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v116'134 uv134 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:44.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.987+0000 7f999a63cf40 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x56351f4ce740 0x56351f4d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:44.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.987+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d1ae0 con 0x56351f4ce740 2024-09-12T02:04:44.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.987+0000 7f9998933640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x56351f4ce740 0x56351f4d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:44.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.987+0000 7f9998933640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x56351f4ce740 0x56351f4d15a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:44.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.989+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v116'96 uv95 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:44.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.989+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d1ae0 con 0x56351f4ce740 2024-09-12T02:04:44.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.990+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v116'97 uv97 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:44.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.990+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d1b60 con 0x56351f4ce740 2024-09-12T02:04:44.991 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:04:44.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.991+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v116'98 uv98 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:44.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.991+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d1f80 con 0x56351f4ce740 2024-09-12T02:04:44.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.993+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v116'99 uv99 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:44.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.993+0000 7f999a63cf40 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x56351f4d2490 0x56351f4d4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:44.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.993+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d4e00 con 0x56351f4d2490 2024-09-12T02:04:44.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.993+0000 7f9998132640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x56351f4d2490 0x56351f4d4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:44.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.993+0000 7f9998132640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x56351f4d2490 0x56351f4d4880 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:44.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.995+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v116'129 uv128 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:44.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.995+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d4ec0 con 0x56351f4d2490 2024-09-12T02:04:44.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.996+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v116'130 uv130 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:44.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.996+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4d2490 2024-09-12T02:04:44.998 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:04:44.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.997+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v116'131 uv131 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:44.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.998+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d62f0 con 0x56351f4d2490 2024-09-12T02:04:44.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.999+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v116'132 uv132 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:44.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:44.999+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d62f0 con 0x56351f4d2490 2024-09-12T02:04:45.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.000+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v116'133 uv133 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.000+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4d2490 2024-09-12T02:04:45.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.001+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v116'134 uv134 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.001+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4ce740 2024-09-12T02:04:45.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.003+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v116'238 uv232 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:45.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.003+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4ce740 2024-09-12T02:04:45.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.004+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v116'239 uv239 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:45.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.004+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4ce740 2024-09-12T02:04:45.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.005+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v116'240 uv240 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:45.005 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:04:45.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.005+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d62f0 con 0x56351f4ce740 2024-09-12T02:04:45.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.006+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v116'241 uv241 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:45.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.006+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d62f0 con 0x56351f4ce740 2024-09-12T02:04:45.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.007+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v116'242 uv242 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:45.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.007+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4ce740 2024-09-12T02:04:45.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.008+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v116'243 uv243 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:45.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.008+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4ce740 2024-09-12T02:04:45.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.009+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v116'244 uv237 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:45.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.009+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4ce740 2024-09-12T02:04:45.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.010+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v116'245 uv245 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:45.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.010+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4ce740 2024-09-12T02:04:45.011 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:04:45.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.011+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v116'246 uv246 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:45.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.011+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4ce740 2024-09-12T02:04:45.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.012+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v116'247 uv247 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:45.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.012+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4ce740 2024-09-12T02:04:45.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.013+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v116'248 uv248 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:45.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.013+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4ce740 2024-09-12T02:04:45.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.014+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v116'107 uv106 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:45.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.014+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4ce740 2024-09-12T02:04:45.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.015+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v116'108 uv108 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:45.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.015+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4ce740 2024-09-12T02:04:45.016 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:04:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.016+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v116'109 uv109 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.016+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4ce740 2024-09-12T02:04:45.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.017+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v116'110 uv110 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:45.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.017+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4ce740 2024-09-12T02:04:45.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.018+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v116'111 uv111 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f999000a0d0 con 0x56351f4ce740 2024-09-12T02:04:45.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.018+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4d2490 2024-09-12T02:04:45.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.019+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v116'129 uv128 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.019+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4d2490 2024-09-12T02:04:45.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.020+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v116'130 uv130 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.020+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4d2490 2024-09-12T02:04:45.021 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:04:45.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.021+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v116'131 uv131 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.021+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d62f0 con 0x56351f4d2490 2024-09-12T02:04:45.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.022+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v116'132 uv132 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.022+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d62f0 con 0x56351f4d2490 2024-09-12T02:04:45.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.023+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v116'133 uv133 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.023+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4d2490 2024-09-12T02:04:45.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.024+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v116'134 uv134 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.024+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4d2490 2024-09-12T02:04:45.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.026+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v116'213 uv207 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.026+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4d2490 2024-09-12T02:04:45.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.027+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v116'214 uv214 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.027+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d52e0 con 0x56351f4d2490 2024-09-12T02:04:45.028 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:04:45.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.028+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v116'215 uv215 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.028+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4cda30 con 0x56351f4d2490 2024-09-12T02:04:45.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.029+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v116'216 uv216 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.029+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4cda30 con 0x56351f4d2490 2024-09-12T02:04:45.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.030+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v116'217 uv217 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.030+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4cda30 con 0x56351f4d2490 2024-09-12T02:04:45.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.031+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v116'218 uv212 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.031+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4cda30 con 0x56351f4d2490 2024-09-12T02:04:45.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.032+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v116'219 uv219 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.032+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4cda30 con 0x56351f4d2490 2024-09-12T02:04:45.033 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:04:45.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.033+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v116'220 uv220 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.033+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4cda30 con 0x56351f4d2490 2024-09-12T02:04:45.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.034+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v116'221 uv221 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.034+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d80f0 con 0x56351f4d2490 2024-09-12T02:04:45.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.035+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v116'222 uv222 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.035+0000 7f999a63cf40 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x56351f4d5e10 0x56351f4d8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.035+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d87b0 con 0x56351f4d5e10 2024-09-12T02:04:45.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.036+0000 7f9997931640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x56351f4d5e10 0x56351f4d8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.036+0000 7f9997931640 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x56351f4d5e10 0x56351f4d8200 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:45.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.037+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v116'95 uv94 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4d5e10 2024-09-12T02:04:45.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.037+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d87b0 con 0x56351f4d5e10 2024-09-12T02:04:45.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.038+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v116'96 uv96 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4d5e10 2024-09-12T02:04:45.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.038+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d8830 con 0x56351f4d5e10 2024-09-12T02:04:45.041 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:04:45.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.041+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v116'97 uv97 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4d5e10 2024-09-12T02:04:45.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.041+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4d5e10 2024-09-12T02:04:45.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.042+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v116'98 uv98 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4d5e10 2024-09-12T02:04:45.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.042+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4d2490 2024-09-12T02:04:45.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.043+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v116'129 uv128 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.043+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4d2490 2024-09-12T02:04:45.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.044+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v116'130 uv130 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.044+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4d2490 2024-09-12T02:04:45.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.045+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v116'131 uv131 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.045 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:04:45.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.045+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4d2490 2024-09-12T02:04:45.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.046+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v116'132 uv132 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.046+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4d2490 2024-09-12T02:04:45.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.048+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v116'133 uv133 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.048+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4d2490 2024-09-12T02:04:45.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.049+0000 7f9998132640 1 -- 172.21.15.19:0/2078304851 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v116'134 uv134 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9988013810 con 0x56351f4d2490 2024-09-12T02:04:45.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.049+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4ca310 2024-09-12T02:04:45.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.050+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v116'110 uv109 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:45.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.050+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4ca310 2024-09-12T02:04:45.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.051+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v116'111 uv111 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.051+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4ca310 2024-09-12T02:04:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.052+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v116'112 uv112 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:45.053 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:04:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.052+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4ca310 2024-09-12T02:04:45.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.054+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v116'113 uv113 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:45.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.054+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4ca310 2024-09-12T02:04:45.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.055+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v116'114 uv114 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:45.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.055+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4ca310 2024-09-12T02:04:45.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.056+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v116'265 uv257 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:45.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.056+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4ca310 2024-09-12T02:04:45.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.057+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v116'266 uv266 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:45.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.057+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4ca310 2024-09-12T02:04:45.058 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:04:45.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.058+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v116'267 uv267 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:45.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.058+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4ca310 2024-09-12T02:04:45.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.059+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v116'268 uv268 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:45.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.059+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4ca310 2024-09-12T02:04:45.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.060+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v116'269 uv269 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:45.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.060+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4ca310 2024-09-12T02:04:45.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.061+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v116'270 uv264 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:45.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.061+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4ca310 2024-09-12T02:04:45.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.062+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v116'271 uv271 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:45.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.062+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4ca310 2024-09-12T02:04:45.063 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:04:45.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.063+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v116'272 uv272 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:45.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.063+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4ca310 2024-09-12T02:04:45.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.064+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v116'273 uv273 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:45.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.064+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4ca310 2024-09-12T02:04:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.067+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v116'274 uv274 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.067+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d88b0 con 0x56351f4ca310 2024-09-12T02:04:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.068+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v116'275 uv275 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.068+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x56351f4d8d10 con 0x56351f4ca310 2024-09-12T02:04:45.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f9997931640 1 -- 172.21.15.19:0/2078304851 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v116'276 uv276 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f998c0555a0 con 0x56351f4ca310 2024-09-12T02:04:45.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x56351f4c5550 msgr2=0x56351f4c7940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x56351f4c5550 0x56351f4c7940 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56351f419100 msgr2=0x56351f403e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56351f419100 0x56351f403e80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x56351f4ce740 msgr2=0x56351f4d15a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x56351f4ce740 0x56351f4d15a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x56351f4d5e10 msgr2=0x56351f4d8200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x56351f4d5e10 0x56351f4d8200 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x56351f4ca310 msgr2=0x56351f4cc700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x56351f4ca310 0x56351f4cc700 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x56351f4d2490 msgr2=0x56351f4d4880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x56351f4d2490 0x56351f4d4880 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 reap_dead start 2024-09-12T02:04:45.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f9998933640 1 -- 172.21.15.19:0/2078304851 reap_dead start 2024-09-12T02:04:45.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f998406a840 msgr2=0x7f998406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f998406a840 0x7f998406cd00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9988000f80 tx=0x7f9988008040 comp rx=0 tx=0).stop 2024-09-12T02:04:45.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56351f407660 msgr2=0x56351f418bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56351f407660 0x56351f418bc0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f998c000c00 tx=0x7f998c003020 comp rx=0 tx=0).stop 2024-09-12T02:04:45.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 shutdown_connections 2024-09-12T02:04:45.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f998406a840 0x7f998406cd00 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 --2- 172.21.15.19:0/2078304851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56351f407660 0x56351f418bc0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 >> 172.21.15.19:0/2078304851 conn(0x56351f34aad0 msgr2=0x56351f34aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:45.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 shutdown_connections 2024-09-12T02:04:45.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.069+0000 7f999a63cf40 1 -- 172.21.15.19:0/2078304851 wait complete. 2024-09-12T02:04:45.073 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put 100.00000000.inode - 2024-09-12T02:04:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.158+0000 7f5e3931cf40 1 Processor -- start 2024-09-12T02:04:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.158+0000 7f5e3931cf40 1 -- start start 2024-09-12T02:04:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.159+0000 7f5e3931cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d685c4c8e0 0x55d685c7a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.159+0000 7f5e3931cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d685d0a800 0x55d685c7a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.159+0000 7f5e3931cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d685d22f50 0x55d685c730c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.159+0000 7f5e3931cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d685d21f50 con 0x55d685d0a800 2024-09-12T02:04:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.159+0000 7f5e3931cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d685b9e510 con 0x55d685d22f50 2024-09-12T02:04:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.159+0000 7f5e3931cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55d685d221f0 con 0x55d685c4c8e0 2024-09-12T02:04:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.159+0000 7f5e36611640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d685d0a800 0x55d685c7a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.159+0000 7f5e36611640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d685d0a800 0x55d685c7a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59440/0 (socket says 172.21.15.19:59440) 2024-09-12T02:04:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.159+0000 7f5e36611640 1 -- 172.21.15.19:0/525416412 learned_addr learned my addr 172.21.15.19:0/525416412 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.159+0000 7f5e36e12640 1 --2- 172.21.15.19:0/525416412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d685c4c8e0 0x55d685c7a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.159+0000 7f5e37613640 1 --2- 172.21.15.19:0/525416412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d685d22f50 0x55d685c730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e36611640 1 -- 172.21.15.19:0/525416412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d685c4c8e0 msgr2=0x55d685c7a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e36611640 1 --2- 172.21.15.19:0/525416412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d685c4c8e0 0x55d685c7a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e36611640 1 -- 172.21.15.19:0/525416412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d685d22f50 msgr2=0x55d685c730c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e36611640 1 --2- 172.21.15.19:0/525416412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d685d22f50 0x55d685c730c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e36611640 1 -- 172.21.15.19:0/525416412 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d685d09770 con 0x55d685d0a800 2024-09-12T02:04:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e36e12640 1 --2- 172.21.15.19:0/525416412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d685c4c8e0 0x55d685c7a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e37613640 1 --2- 172.21.15.19:0/525416412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d685d22f50 0x55d685c730c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e36611640 1 --2- 172.21.15.19:0/525416412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d685d0a800 0x55d685c7a550 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c001eb0 tx=0x7f5e2c00b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7497ef31737d470 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e3560f640 1 -- 172.21.15.19:0/525416412 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c016070 con 0x55d685d0a800 2024-09-12T02:04:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e3560f640 1 -- 172.21.15.19:0/525416412 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e2c00d6b0 con 0x55d685d0a800 2024-09-12T02:04:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e3560f640 1 -- 172.21.15.19:0/525416412 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c00daa0 con 0x55d685d0a800 2024-09-12T02:04:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e3931cf40 1 -- 172.21.15.19:0/525416412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d685d0a800 msgr2=0x55d685c7a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e3931cf40 1 --2- 172.21.15.19:0/525416412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d685d0a800 0x55d685c7a550 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c001eb0 tx=0x7f5e2c00b650 comp rx=0 tx=0).stop 2024-09-12T02:04:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e3931cf40 1 -- 172.21.15.19:0/525416412 shutdown_connections 2024-09-12T02:04:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e3931cf40 1 --2- 172.21.15.19:0/525416412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d685d22f50 0x55d685c730c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e3931cf40 1 --2- 172.21.15.19:0/525416412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d685d0a800 0x55d685c7a550 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e3931cf40 1 --2- 172.21.15.19:0/525416412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d685c4c8e0 0x55d685c7a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e3931cf40 1 -- 172.21.15.19:0/525416412 >> 172.21.15.19:0/525416412 conn(0x55d685c4dad0 msgr2=0x55d685c4ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.160+0000 7f5e3931cf40 1 -- 172.21.15.19:0/525416412 shutdown_connections 2024-09-12T02:04:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.161+0000 7f5e3931cf40 1 -- 172.21.15.19:0/525416412 wait complete. 2024-09-12T02:04:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.161+0000 7f5e3931cf40 1 Processor -- start 2024-09-12T02:04:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.161+0000 7f5e3931cf40 1 -- start start 2024-09-12T02:04:45.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.162+0000 7f5e3931cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d685c4c8e0 0x55d685d01290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.162+0000 7f5e3931cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d685d0a800 0x55d685d07fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.162+0000 7f5e3931cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d685d22f50 0x55d685d08510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.162+0000 7f5e3931cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d685c7abe0 con 0x55d685d22f50 2024-09-12T02:04:45.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.162+0000 7f5e3931cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d685c4b520 con 0x55d685c4c8e0 2024-09-12T02:04:45.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.162+0000 7f5e3931cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55d685d09a10 con 0x55d685d0a800 2024-09-12T02:04:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.162+0000 7f5e37613640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d685d22f50 0x55d685d08510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.162+0000 7f5e37613640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d685d22f50 0x55d685d08510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59446/0 (socket says 172.21.15.19:59446) 2024-09-12T02:04:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.162+0000 7f5e37613640 1 -- 172.21.15.19:0/3789466136 learned_addr learned my addr 172.21.15.19:0/3789466136 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.162+0000 7f5e36611640 1 --2- 172.21.15.19:0/3789466136 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d685d0a800 0x55d685d07fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.162+0000 7f5e36e12640 1 --2- 172.21.15.19:0/3789466136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d685c4c8e0 0x55d685d01290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.162+0000 7f5e37613640 1 -- 172.21.15.19:0/3789466136 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d685d0a800 msgr2=0x55d685d07fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.162+0000 7f5e37613640 1 --2- 172.21.15.19:0/3789466136 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d685d0a800 0x55d685d07fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.162+0000 7f5e37613640 1 -- 172.21.15.19:0/3789466136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d685c4c8e0 msgr2=0x55d685d01290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.162+0000 7f5e37613640 1 --2- 172.21.15.19:0/3789466136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d685c4c8e0 0x55d685d01290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.162+0000 7f5e37613640 1 -- 172.21.15.19:0/3789466136 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d685d03870 con 0x55d685d22f50 2024-09-12T02:04:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.162+0000 7f5e37613640 1 --2- 172.21.15.19:0/3789466136 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d685d22f50 0x55d685d08510 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000c2a0 tx=0x7f5e3000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.163+0000 7f5e1ffff640 1 -- 172.21.15.19:0/3789466136 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30013730 con 0x55d685d22f50 2024-09-12T02:04:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.163+0000 7f5e1ffff640 1 -- 172.21.15.19:0/3789466136 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e300138d0 con 0x55d685d22f50 2024-09-12T02:04:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.163+0000 7f5e3931cf40 1 -- 172.21.15.19:0/3789466136 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d685d03b50 con 0x55d685d22f50 2024-09-12T02:04:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.163+0000 7f5e1ffff640 1 -- 172.21.15.19:0/3789466136 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30013cc0 con 0x55d685d22f50 2024-09-12T02:04:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.163+0000 7f5e3931cf40 1 -- 172.21.15.19:0/3789466136 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d685c4c190 con 0x55d685d22f50 2024-09-12T02:04:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.164+0000 7f5e1ffff640 1 -- 172.21.15.19:0/3789466136 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5e30011070 con 0x55d685d22f50 2024-09-12T02:04:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.164+0000 7f5e1ffff640 1 --2- 172.21.15.19:0/3789466136 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5e2406a810 0x7f5e2406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.165+0000 7f5e1ffff640 1 -- 172.21.15.19:0/3789466136 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8109+0+0 (secure 0 0 0) 0x7f5e3008ab30 con 0x55d685d22f50 2024-09-12T02:04:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.165+0000 7f5e36e12640 1 --2- 172.21.15.19:0/3789466136 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5e2406a810 0x7f5e2406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.165+0000 7f5e3931cf40 1 --2- 172.21.15.19:0/3789466136 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d685c952d0 0x55d685d03020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.165+0000 7f5e3931cf40 1 -- 172.21.15.19:0/3789466136 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 13.1f 13:fe07bba1:::100.00000000.inode:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x55d685d017d0 con 0x55d685c952d0 2024-09-12T02:04:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.165+0000 7f5e36611640 1 --2- 172.21.15.19:0/3789466136 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d685c952d0 0x55d685d03020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.165+0000 7f5e36e12640 1 --2- 172.21.15.19:0/3789466136 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5e2406a810 0x7f5e2406ccd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5e28057000 tx=0x7f5e28052000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.165+0000 7f5e36611640 1 --2- 172.21.15.19:0/3789466136 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d685c952d0 0x55d685d03020 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.167+0000 7f5e36611640 1 -- 172.21.15.19:0/3789466136 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 100.00000000.inode [writefull 0~80] v116'277 uv277 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f5e2c00d860 con 0x55d685c952d0 2024-09-12T02:04:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.167+0000 7f5e3931cf40 1 -- 172.21.15.19:0/3789466136 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d685c952d0 msgr2=0x55d685d03020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.167+0000 7f5e3931cf40 1 --2- 172.21.15.19:0/3789466136 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d685c952d0 0x55d685d03020 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.167+0000 7f5e3931cf40 1 -- 172.21.15.19:0/3789466136 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5e2406a810 msgr2=0x7f5e2406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.167+0000 7f5e3931cf40 1 --2- 172.21.15.19:0/3789466136 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5e2406a810 0x7f5e2406ccd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5e28057000 tx=0x7f5e28052000 comp rx=0 tx=0).stop 2024-09-12T02:04:45.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.167+0000 7f5e3931cf40 1 -- 172.21.15.19:0/3789466136 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d685d22f50 msgr2=0x55d685d08510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.167+0000 7f5e3931cf40 1 --2- 172.21.15.19:0/3789466136 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d685d22f50 0x55d685d08510 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000c2a0 tx=0x7f5e3000c760 comp rx=0 tx=0).stop 2024-09-12T02:04:45.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.167+0000 7f5e37613640 1 -- 172.21.15.19:0/3789466136 reap_dead start 2024-09-12T02:04:45.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.167+0000 7f5e3931cf40 1 -- 172.21.15.19:0/3789466136 shutdown_connections 2024-09-12T02:04:45.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.167+0000 7f5e3931cf40 1 -- 172.21.15.19:0/3789466136 >> 172.21.15.19:0/3789466136 conn(0x55d685c4dad0 msgr2=0x55d685c4b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:45.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.167+0000 7f5e3931cf40 1 -- 172.21.15.19:0/3789466136 shutdown_connections 2024-09-12T02:04:45.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.167+0000 7f5e3931cf40 1 -- 172.21.15.19:0/3789466136 wait complete. 2024-09-12T02:04:45.172 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:04:45.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.315+0000 7f5a0279f640 1 Processor -- start 2024-09-12T02:04:45.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.315+0000 7f5a0279f640 1 -- start start 2024-09-12T02:04:45.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.316+0000 7f5a0279f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f59fc15e900 0x7f59fc0b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.316+0000 7f5a0279f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59fc0b4620 con 0x7f59fc0b4a20 2024-09-12T02:04:45.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.316+0000 7f5a0279f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59fc0ce100 con 0x7f59fc072050 2024-09-12T02:04:45.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.316+0000 7f5a0279f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f59fc0ce3a0 con 0x7f59fc15e900 2024-09-12T02:04:45.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.316+0000 7f59fb7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f59fc0b4a20 0x7f59fc0ad020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41950/0 (socket says 172.21.15.19:41950) 2024-09-12T02:04:45.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.316+0000 7f59fb7fe640 1 -- 172.21.15.19:0/3569169457 learned_addr learned my addr 172.21.15.19:0/3569169457 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:45.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.316+0000 7f59faffd640 1 -- 172.21.15.19:0/3569169457 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3957435476 0 0) 0x7f59fc0b4620 con 0x7f59fc0b4a20 2024-09-12T02:04:45.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.316+0000 7f59fbfff640 1 --2- 172.21.15.19:0/3569169457 >> v2:172.21.15.135:3300/0 conn(0x7f59fc15e900 0x7f59fc0b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.316+0000 7f59faffd640 1 -- 172.21.15.19:0/3569169457 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59e4005730 con 0x7f59fc0b4a20 2024-09-12T02:04:45.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59faffd640 1 -- 172.21.15.19:0/3569169457 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2110823408 0 0) 0x7f59e4005730 con 0x7f59fc0b4a20 2024-09-12T02:04:45.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59faffd640 1 -- 172.21.15.19:0/3569169457 >> v2:172.21.15.135:3300/0 conn(0x7f59fc15e900 msgr2=0x7f59fc0b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:45.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59faffd640 1 --2- 172.21.15.19:0/3569169457 >> v2:172.21.15.135:3300/0 conn(0x7f59fc15e900 0x7f59fc0b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59faffd640 1 -- 172.21.15.19:0/3569169457 >> v1:172.21.15.135:6789/0 conn(0x7f59fc072050 legacy=0x7f59fc0cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59faffd640 1 -- 172.21.15.19:0/3569169457 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59fc0ce680 con 0x7f59fc0b4a20 2024-09-12T02:04:45.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59faffd640 1 -- 172.21.15.19:0/3569169457 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f59f0001670 con 0x7f59fc0b4a20 2024-09-12T02:04:45.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59faffd640 1 -- 172.21.15.19:0/3569169457 >> v1:172.21.15.19:6789/0 conn(0x7f59fc0b4a20 legacy=0x7f59fc0ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59faffd640 1 --2- 172.21.15.19:0/3569169457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59e4005bc0 0x7f59e4005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59faffd640 1 --2- 172.21.15.19:0/3569169457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59e4006a10 0x7f59e4006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59faffd640 1 --2- 172.21.15.19:0/3569169457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59e40073d0 0x7f59e400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59faffd640 1 -- 172.21.15.19:0/3569169457 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f59fc0ce3a0 con 0x7f59e4006a10 2024-09-12T02:04:45.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59faffd640 1 -- 172.21.15.19:0/3569169457 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f59e400e370 con 0x7f59e40073d0 2024-09-12T02:04:45.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59faffd640 1 -- 172.21.15.19:0/3569169457 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f59e400e570 con 0x7f59e4005bc0 2024-09-12T02:04:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59fb7fe640 1 --2- 172.21.15.19:0/3569169457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59e4006a10 0x7f59e4006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59fbfff640 1 --2- 172.21.15.19:0/3569169457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59e4005bc0 0x7f59e4005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f5a00d3c640 1 --2- 172.21.15.19:0/3569169457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59e40073d0 0x7f59e400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59fb7fe640 1 -- 172.21.15.19:0/3569169457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59e4005bc0 msgr2=0x7f59e4005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59fb7fe640 1 --2- 172.21.15.19:0/3569169457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59e4005bc0 0x7f59e4005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59fb7fe640 1 -- 172.21.15.19:0/3569169457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59e40073d0 msgr2=0x7f59e400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59fb7fe640 1 --2- 172.21.15.19:0/3569169457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59e40073d0 0x7f59e400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f5a00d3c640 1 -- 172.21.15.19:0/3569169457 reap_dead start 2024-09-12T02:04:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.317+0000 7f59fb7fe640 1 -- 172.21.15.19:0/3569169457 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e4005730 con 0x7f59e4006a10 2024-09-12T02:04:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.318+0000 7f59fb7fe640 1 --2- 172.21.15.19:0/3569169457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59e4006a10 0x7f59e4006e90 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f59f000c240 tx=0x7f59e4007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce09c80c904a628 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.318+0000 7f59faffd640 1 -- 172.21.15.19:0/3569169457 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f0007d10 con 0x7f59e4006a10 2024-09-12T02:04:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.318+0000 7f59faffd640 1 -- 172.21.15.19:0/3569169457 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f0005ad0 con 0x7f59e4006a10 2024-09-12T02:04:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.318+0000 7f59faffd640 1 -- 172.21.15.19:0/3569169457 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f0007070 con 0x7f59e4006a10 2024-09-12T02:04:45.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.319+0000 7f5a0279f640 1 -- 172.21.15.19:0/3569169457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59e4006a10 msgr2=0x7f59e4006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.319+0000 7f5a0279f640 1 --2- 172.21.15.19:0/3569169457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59e4006a10 0x7f59e4006e90 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f59f000c240 tx=0x7f59e4007a40 comp rx=0 tx=0).stop 2024-09-12T02:04:45.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.319+0000 7f5a0279f640 1 -- 172.21.15.19:0/3569169457 shutdown_connections 2024-09-12T02:04:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.319+0000 7f5a0279f640 1 --2- 172.21.15.19:0/3569169457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59e4006a10 0x7f59e4006e90 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.319+0000 7f5a0279f640 1 -- 172.21.15.19:0/3569169457 >> 172.21.15.19:0/3569169457 conn(0x7f59fc06bdf0 msgr2=0x7f59fc06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.319+0000 7f5a0279f640 1 -- 172.21.15.19:0/3569169457 shutdown_connections 2024-09-12T02:04:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.319+0000 7f5a0279f640 1 -- 172.21.15.19:0/3569169457 wait complete. 2024-09-12T02:04:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.320+0000 7f5a0279f640 1 Processor -- start 2024-09-12T02:04:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.320+0000 7f5a0279f640 1 -- start start 2024-09-12T02:04:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.321+0000 7f5a0279f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59e4006a10 0x7f59fc1546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.321+0000 7f5a0279f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59fc15dc80 0x7f59fc0cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.321+0000 7f5a0279f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59fc0cb050 0x7f59fc09d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.321+0000 7f5a0279f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f59fc0b4020 con 0x7f59e4006a10 2024-09-12T02:04:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.321+0000 7f5a0279f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f59fc0b4e50 con 0x7f59fc0cb050 2024-09-12T02:04:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.321+0000 7f5a0279f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f59fc0b41a0 con 0x7f59fc15dc80 2024-09-12T02:04:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.321+0000 7f59fbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59e4006a10 0x7f59fc1546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.321+0000 7f59fbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59e4006a10 0x7f59fc1546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59464/0 (socket says 172.21.15.19:59464) 2024-09-12T02:04:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.321+0000 7f59fbfff640 1 -- 172.21.15.19:0/2702266350 learned_addr learned my addr 172.21.15.19:0/2702266350 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.321+0000 7f59fb7fe640 1 --2- 172.21.15.19:0/2702266350 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59fc15dc80 0x7f59fc0cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.321+0000 7f5a00d3c640 1 --2- 172.21.15.19:0/2702266350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59fc0cb050 0x7f59fc09d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.321+0000 7f59fbfff640 1 -- 172.21.15.19:0/2702266350 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59fc15dc80 msgr2=0x7f59fc0cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.321+0000 7f59fbfff640 1 --2- 172.21.15.19:0/2702266350 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59fc15dc80 0x7f59fc0cca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.321+0000 7f59fbfff640 1 -- 172.21.15.19:0/2702266350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59fc0cb050 msgr2=0x7f59fc09d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.321+0000 7f59fbfff640 1 --2- 172.21.15.19:0/2702266350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59fc0cb050 0x7f59fc09d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.321+0000 7f59fbfff640 1 -- 172.21.15.19:0/2702266350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59fc0ccfa0 con 0x7f59e4006a10 2024-09-12T02:04:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.322+0000 7f59fbfff640 1 --2- 172.21.15.19:0/2702266350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59e4006a10 0x7f59fc1546b0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0119f0 tx=0x7f59ec011eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.322+0000 7f59f8ff9640 1 -- 172.21.15.19:0/2702266350 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec00fb50 con 0x7f59e4006a10 2024-09-12T02:04:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.322+0000 7f59f8ff9640 1 -- 172.21.15.19:0/2702266350 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59ec00fcf0 con 0x7f59e4006a10 2024-09-12T02:04:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.322+0000 7f59f8ff9640 1 -- 172.21.15.19:0/2702266350 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec014640 con 0x7f59e4006a10 2024-09-12T02:04:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.322+0000 7f5a0279f640 1 -- 172.21.15.19:0/2702266350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59fc0cb9c0 con 0x7f59e4006a10 2024-09-12T02:04:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.322+0000 7f5a0279f640 1 -- 172.21.15.19:0/2702266350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59fc0cbf80 con 0x7f59e4006a10 2024-09-12T02:04:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.323+0000 7f5a0279f640 1 -- 172.21.15.19:0/2702266350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59fc072480 con 0x7f59e4006a10 2024-09-12T02:04:45.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.323+0000 7f59f8ff9640 1 -- 172.21.15.19:0/2702266350 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f59ec012040 con 0x7f59e4006a10 2024-09-12T02:04:45.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.324+0000 7f59f8ff9640 1 --2- 172.21.15.19:0/2702266350 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f59e806be60 0x7f59e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.324+0000 7f59f8ff9640 1 -- 172.21.15.19:0/2702266350 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8109+0+0 (secure 0 0 0) 0x7f59ec08be30 con 0x7f59e4006a10 2024-09-12T02:04:45.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.324+0000 7f59fb7fe640 1 --2- 172.21.15.19:0/2702266350 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f59e806be60 0x7f59e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.325+0000 7f59fb7fe640 1 --2- 172.21.15.19:0/2702266350 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f59e806be60 0x7f59e806e320 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f59f0033000 tx=0x7f59f002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:45.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.328+0000 7f59f8ff9640 1 -- 172.21.15.19:0/2702266350 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59ec019030 con 0x7f59e4006a10 2024-09-12T02:04:45.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.544+0000 7f5a0279f640 1 -- 172.21.15.19:0/2702266350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f59fc0d05d0 con 0x7f59e4006a10 2024-09-12T02:04:45.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.858+0000 7f59f8ff9640 1 -- 172.21.15.19:0/2702266350 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v208) ==== 162+0+0 (secure 0 0 0) 0x7f59ec089e20 con 0x7f59e4006a10 2024-09-12T02:04:45.858 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:04:45.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.860+0000 7f5a0279f640 1 -- 172.21.15.19:0/2702266350 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f59e806be60 msgr2=0x7f59e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.860+0000 7f5a0279f640 1 --2- 172.21.15.19:0/2702266350 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f59e806be60 0x7f59e806e320 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f59f0033000 tx=0x7f59f002e000 comp rx=0 tx=0).stop 2024-09-12T02:04:45.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.860+0000 7f5a0279f640 1 -- 172.21.15.19:0/2702266350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59e4006a10 msgr2=0x7f59fc1546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.860+0000 7f5a0279f640 1 --2- 172.21.15.19:0/2702266350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59e4006a10 0x7f59fc1546b0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0119f0 tx=0x7f59ec011eb0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.860+0000 7f5a0279f640 1 -- 172.21.15.19:0/2702266350 shutdown_connections 2024-09-12T02:04:45.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.860+0000 7f5a0279f640 1 --2- 172.21.15.19:0/2702266350 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f59e806be60 0x7f59e806e320 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.860+0000 7f5a0279f640 1 --2- 172.21.15.19:0/2702266350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59fc0cb050 0x7f59fc09d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.860+0000 7f5a0279f640 1 --2- 172.21.15.19:0/2702266350 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59fc15dc80 0x7f59fc0cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.860+0000 7f5a0279f640 1 --2- 172.21.15.19:0/2702266350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59e4006a10 0x7f59fc1546b0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.860+0000 7f5a0279f640 1 -- 172.21.15.19:0/2702266350 >> 172.21.15.19:0/2702266350 conn(0x7f59fc06bdf0 msgr2=0x7f59fc06efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:45.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.860+0000 7f5a0279f640 1 -- 172.21.15.19:0/2702266350 shutdown_connections 2024-09-12T02:04:45.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.860+0000 7f5a0279f640 1 -- 172.21.15.19:0/2702266350 wait complete. 2024-09-12T02:04:45.870 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:04:45.869+0000 7f93b5b71640 -1 mds.0.cache.ino(0x100) Corrupt inode 0x100: End of buffer [buffer:2] 2024-09-12T02:04:45.870 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:04:45.869+0000 7f93b5b71640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2024-09-12T02:04:45.871 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:45.870+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:04:45.871 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:45.871+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:04:45.874 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:45.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.976+0000 7f11d0f78640 1 Processor -- start 2024-09-12T02:04:45.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.976+0000 7f11d0f78640 1 -- start start 2024-09-12T02:04:45.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.977+0000 7f11d0f78640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f11cc161c80 0x7f11cc06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.977+0000 7f11d0f78640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f11cc162060 0x7f11cc0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.977+0000 7f11d0f78640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11cc0b64b0 0x7f11cc0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.977+0000 7f11d0f78640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f11cc06e870 con 0x7f11cc162060 2024-09-12T02:04:45.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.977+0000 7f11d0f78640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f11cc06d9f0 con 0x7f11cc161c80 2024-09-12T02:04:45.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.977+0000 7f11d0f78640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f11cc06dcd0 con 0x7f11cc0b64b0 2024-09-12T02:04:45.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.977+0000 7f11c9d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f11cc162060 0x7f11cc0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.977+0000 7f11c9d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f11cc162060 0x7f11cc0b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59468/0 (socket says 172.21.15.19:59468) 2024-09-12T02:04:45.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.977+0000 7f11c9d9b640 1 -- 172.21.15.19:0/2026597689 learned_addr learned my addr 172.21.15.19:0/2026597689 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:45.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.978+0000 7f11ca59c640 1 --2- 172.21.15.19:0/2026597689 >> v2:172.21.15.135:3300/0 conn(0x7f11cc161c80 0x7f11cc06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.978+0000 7f11cad9d640 1 --2- 172.21.15.19:0/2026597689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11cc0b64b0 0x7f11cc0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.978+0000 7f11c9d9b640 1 -- 172.21.15.19:0/2026597689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11cc0b64b0 msgr2=0x7f11cc0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:45.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.978+0000 7f11c9d9b640 1 --2- 172.21.15.19:0/2026597689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11cc0b64b0 0x7f11cc0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.978+0000 7f11c9d9b640 1 -- 172.21.15.19:0/2026597689 >> v2:172.21.15.135:3300/0 conn(0x7f11cc161c80 msgr2=0x7f11cc06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:45.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.978+0000 7f11c9d9b640 1 --2- 172.21.15.19:0/2026597689 >> v2:172.21.15.135:3300/0 conn(0x7f11cc161c80 0x7f11cc06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.978+0000 7f11c9d9b640 1 -- 172.21.15.19:0/2026597689 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11cc06dfb0 con 0x7f11cc162060 2024-09-12T02:04:45.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.978+0000 7f11cad9d640 1 --2- 172.21.15.19:0/2026597689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11cc0b64b0 0x7f11cc0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:45.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.978+0000 7f11c9d9b640 1 --2- 172.21.15.19:0/2026597689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11cc162060 0x7f11cc0b5f70 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f11cc08d7a0 tx=0x7f11b402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7989e99eb46ba9e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:45.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.979+0000 7f11c959a640 1 -- 172.21.15.19:0/2026597689 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b4037070 con 0x7f11cc162060 2024-09-12T02:04:45.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.979+0000 7f11c959a640 1 -- 172.21.15.19:0/2026597689 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b4032440 con 0x7f11cc162060 2024-09-12T02:04:45.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.979+0000 7f11c959a640 1 -- 172.21.15.19:0/2026597689 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b4032810 con 0x7f11cc162060 2024-09-12T02:04:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.979+0000 7f11d0f78640 1 -- 172.21.15.19:0/2026597689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11cc162060 msgr2=0x7f11cc0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.979+0000 7f11d0f78640 1 --2- 172.21.15.19:0/2026597689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11cc162060 0x7f11cc0b5f70 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f11cc08d7a0 tx=0x7f11b402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.979+0000 7f11d0f78640 1 -- 172.21.15.19:0/2026597689 shutdown_connections 2024-09-12T02:04:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.979+0000 7f11d0f78640 1 --2- 172.21.15.19:0/2026597689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11cc0b64b0 0x7f11cc0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.979+0000 7f11d0f78640 1 --2- 172.21.15.19:0/2026597689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11cc162060 0x7f11cc0b5f70 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.979+0000 7f11d0f78640 1 --2- 172.21.15.19:0/2026597689 >> v2:172.21.15.135:3300/0 conn(0x7f11cc161c80 0x7f11cc06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.979+0000 7f11d0f78640 1 -- 172.21.15.19:0/2026597689 >> 172.21.15.19:0/2026597689 conn(0x7f11cc0d44f0 msgr2=0x7f11cc0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.979+0000 7f11d0f78640 1 -- 172.21.15.19:0/2026597689 shutdown_connections 2024-09-12T02:04:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.979+0000 7f11d0f78640 1 -- 172.21.15.19:0/2026597689 wait complete. 2024-09-12T02:04:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.981+0000 7f11d0f78640 1 Processor -- start 2024-09-12T02:04:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.981+0000 7f11d0f78640 1 -- start start 2024-09-12T02:04:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.981+0000 7f11d0f78640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11cc0b64b0 0x7f11cc155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.981+0000 7f11d0f78640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11cc161c80 0x7f11cc0b9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.981+0000 7f11d0f78640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11cc162060 0x7f11cc15ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.981+0000 7f11d0f78640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f11cc162500 con 0x7f11cc161c80 2024-09-12T02:04:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.981+0000 7f11d0f78640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f11cc0d2aa0 con 0x7f11cc0b64b0 2024-09-12T02:04:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.981+0000 7f11d0f78640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f11cc162680 con 0x7f11cc162060 2024-09-12T02:04:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.981+0000 7f11c9d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11cc161c80 0x7f11cc0b9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.981+0000 7f11c9d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11cc161c80 0x7f11cc0b9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59480/0 (socket says 172.21.15.19:59480) 2024-09-12T02:04:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.981+0000 7f11c9d9b640 1 -- 172.21.15.19:0/3151040326 learned_addr learned my addr 172.21.15.19:0/3151040326 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.982+0000 7f11c9d9b640 1 -- 172.21.15.19:0/3151040326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11cc162060 msgr2=0x7f11cc15ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.982+0000 7f11c9d9b640 1 --2- 172.21.15.19:0/3151040326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11cc162060 0x7f11cc15ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.982+0000 7f11ca59c640 1 --2- 172.21.15.19:0/3151040326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11cc0b64b0 0x7f11cc155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.982+0000 7f11c9d9b640 1 -- 172.21.15.19:0/3151040326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11cc0b64b0 msgr2=0x7f11cc155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:45.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.982+0000 7f11c9d9b640 1 --2- 172.21.15.19:0/3151040326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11cc0b64b0 0x7f11cc155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:45.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.982+0000 7f11c9d9b640 1 -- 172.21.15.19:0/3151040326 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11cc0cb5c0 con 0x7f11cc161c80 2024-09-12T02:04:45.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.982+0000 7f11c9d9b640 1 --2- 172.21.15.19:0/3151040326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11cc161c80 0x7f11cc0b9530 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f11b402a220 tx=0x7f11b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:45.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.982+0000 7f11c2ffd640 1 -- 172.21.15.19:0/3151040326 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b4037040 con 0x7f11cc161c80 2024-09-12T02:04:45.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.982+0000 7f11c2ffd640 1 -- 172.21.15.19:0/3151040326 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b4042070 con 0x7f11cc161c80 2024-09-12T02:04:45.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.982+0000 7f11d0f78640 1 -- 172.21.15.19:0/3151040326 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11cc0b9e30 con 0x7f11cc161c80 2024-09-12T02:04:45.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.982+0000 7f11c2ffd640 1 -- 172.21.15.19:0/3151040326 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b4030880 con 0x7f11cc161c80 2024-09-12T02:04:45.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.982+0000 7f11d0f78640 1 -- 172.21.15.19:0/3151040326 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11cc0c8180 con 0x7f11cc161c80 2024-09-12T02:04:45.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.983+0000 7f11d0f78640 1 -- 172.21.15.19:0/3151040326 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11cc06e330 con 0x7f11cc161c80 2024-09-12T02:04:45.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.984+0000 7f11c2ffd640 1 -- 172.21.15.19:0/3151040326 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11b4030a20 con 0x7f11cc161c80 2024-09-12T02:04:45.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.984+0000 7f11c2ffd640 1 --2- 172.21.15.19:0/3151040326 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f11ac06be30 0x7f11ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:45.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.984+0000 7f11c2ffd640 1 -- 172.21.15.19:0/3151040326 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8195+0+0 (secure 0 0 0) 0x7f11b40abfb0 con 0x7f11cc161c80 2024-09-12T02:04:45.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.984+0000 7f11ca59c640 1 --2- 172.21.15.19:0/3151040326 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f11ac06be30 0x7f11ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:45.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.985+0000 7f11ca59c640 1 --2- 172.21.15.19:0/3151040326 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f11ac06be30 0x7f11ac06e2f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f11bc009fd0 tx=0x7f11bc00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:45.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:45.988+0000 7f11c2ffd640 1 -- 172.21.15.19:0/3151040326 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f11b407a080 con 0x7f11cc161c80 2024-09-12T02:04:46.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.202+0000 7f11d0f78640 1 -- 172.21.15.19:0/3151040326 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11cc0ba470 con 0x7f11cc161c80 2024-09-12T02:04:46.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.203+0000 7f11c2ffd640 1 -- 172.21.15.19:0/3151040326 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 210 v210) ==== 95+0+3563 (secure 0 0 0) 0x7f11b4079980 con 0x7f11cc161c80 2024-09-12T02:04:46.203 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:46.203 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":210,"btime":"2024-09-12T02:04:45:872134+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":210,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:45.872080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:46.204 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 210 2024-09-12T02:04:46.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.205+0000 7f11d0f78640 1 -- 172.21.15.19:0/3151040326 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f11ac06be30 msgr2=0x7f11ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:46.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.205+0000 7f11d0f78640 1 --2- 172.21.15.19:0/3151040326 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f11ac06be30 0x7f11ac06e2f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f11bc009fd0 tx=0x7f11bc00b040 comp rx=0 tx=0).stop 2024-09-12T02:04:46.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.205+0000 7f11d0f78640 1 -- 172.21.15.19:0/3151040326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11cc161c80 msgr2=0x7f11cc0b9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:46.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.205+0000 7f11d0f78640 1 --2- 172.21.15.19:0/3151040326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11cc161c80 0x7f11cc0b9530 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f11b402a220 tx=0x7f11b40046c0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.205+0000 7f11d0f78640 1 -- 172.21.15.19:0/3151040326 shutdown_connections 2024-09-12T02:04:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.205+0000 7f11d0f78640 1 --2- 172.21.15.19:0/3151040326 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f11ac06be30 0x7f11ac06e2f0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.205+0000 7f11d0f78640 1 --2- 172.21.15.19:0/3151040326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11cc162060 0x7f11cc15ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.205+0000 7f11d0f78640 1 --2- 172.21.15.19:0/3151040326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11cc161c80 0x7f11cc0b9530 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.205+0000 7f11d0f78640 1 --2- 172.21.15.19:0/3151040326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11cc0b64b0 0x7f11cc155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.205+0000 7f11d0f78640 1 -- 172.21.15.19:0/3151040326 >> 172.21.15.19:0/3151040326 conn(0x7f11cc0d44f0 msgr2=0x7f11cc06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.205+0000 7f11d0f78640 1 -- 172.21.15.19:0/3151040326 shutdown_connections 2024-09-12T02:04:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.205+0000 7f11d0f78640 1 -- 172.21.15.19:0/3151040326 wait complete. 2024-09-12T02:04:46.216 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:46.216 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:46.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.318+0000 7f22c3f0a640 1 Processor -- start 2024-09-12T02:04:46.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.318+0000 7f22c3f0a640 1 -- start start 2024-09-12T02:04:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.319+0000 7f22c3f0a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22bc0d30f0 0x7f22bc0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.319+0000 7f22c3f0a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22bc0b64c0 0x7f22bc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.319+0000 7f22c3f0a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22bc0d3690 con 0x7f22bc15e5f0 2024-09-12T02:04:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.319+0000 7f22c3f0a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f22bc06d530 con 0x7f22bc0d30f0 2024-09-12T02:04:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.319+0000 7f22c3f0a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f22bc0d3970 con 0x7f22bc0b64c0 2024-09-12T02:04:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.319+0000 7f22c14a5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22bc0d30f0 0x7f22bc0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.319+0000 7f22c1ca6640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f22bc15e5f0 0x7f22bc0d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41952/0 (socket says 172.21.15.19:41952) 2024-09-12T02:04:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.319+0000 7f22c1ca6640 1 -- 172.21.15.19:0/2241516369 learned_addr learned my addr 172.21.15.19:0/2241516369 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.319+0000 7f22c24a7640 1 --2- 172.21.15.19:0/2241516369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22bc0b64c0 0x7f22bc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.319+0000 7f22c14a5640 1 -- 172.21.15.19:0/2241516369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22bc0b64c0 msgr2=0x7f22bc06d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.319+0000 7f22c14a5640 1 --2- 172.21.15.19:0/2241516369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22bc0b64c0 0x7f22bc06d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.319+0000 7f22c14a5640 1 -- 172.21.15.19:0/2241516369 >> v1:172.21.15.19:6789/0 conn(0x7f22bc15e5f0 legacy=0x7f22bc0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:46.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.319+0000 7f22c14a5640 1 -- 172.21.15.19:0/2241516369 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc06cee0 con 0x7f22bc0d30f0 2024-09-12T02:04:46.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.319+0000 7f22c0ca4640 1 -- 172.21.15.19:0/2241516369 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1016936368 0 0) 0x7f22bc0d3690 con 0x7f22bc15e5f0 2024-09-12T02:04:46.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.320+0000 7f22c14a5640 1 --2- 172.21.15.19:0/2241516369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22bc0d30f0 0x7f22bc0b5f80 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0097a0 tx=0x7f22ac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3246d3b6ca7706 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:46.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.320+0000 7f22c0ca4640 1 -- 172.21.15.19:0/2241516369 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac037070 con 0x7f22bc0d30f0 2024-09-12T02:04:46.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.320+0000 7f22c0ca4640 1 -- 172.21.15.19:0/2241516369 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22ac032440 con 0x7f22bc0d30f0 2024-09-12T02:04:46.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.320+0000 7f22c0ca4640 1 -- 172.21.15.19:0/2241516369 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac032810 con 0x7f22bc0d30f0 2024-09-12T02:04:46.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.321+0000 7f22c3f0a640 1 -- 172.21.15.19:0/2241516369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22bc0d30f0 msgr2=0x7f22bc0b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:46.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.321+0000 7f22c3f0a640 1 --2- 172.21.15.19:0/2241516369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22bc0d30f0 0x7f22bc0b5f80 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0097a0 tx=0x7f22ac02a180 comp rx=0 tx=0).stop 2024-09-12T02:04:46.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.321+0000 7f22c3f0a640 1 -- 172.21.15.19:0/2241516369 shutdown_connections 2024-09-12T02:04:46.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.321+0000 7f22c3f0a640 1 --2- 172.21.15.19:0/2241516369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22bc0b64c0 0x7f22bc06d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.321+0000 7f22c3f0a640 1 --2- 172.21.15.19:0/2241516369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22bc0d30f0 0x7f22bc0b5f80 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.321+0000 7f22c3f0a640 1 -- 172.21.15.19:0/2241516369 >> 172.21.15.19:0/2241516369 conn(0x7f22bc08bfc0 msgr2=0x7f22bc0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:46.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.321+0000 7f22c3f0a640 1 -- 172.21.15.19:0/2241516369 shutdown_connections 2024-09-12T02:04:46.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.321+0000 7f22c3f0a640 1 -- 172.21.15.19:0/2241516369 wait complete. 2024-09-12T02:04:46.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.322+0000 7f22c3f0a640 1 Processor -- start 2024-09-12T02:04:46.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.322+0000 7f22c3f0a640 1 -- start start 2024-09-12T02:04:46.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.323+0000 7f22c3f0a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22bc0b64c0 0x7f22bc09e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.323+0000 7f22c3f0a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22bc0d30f0 0x7f22bc14d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.323+0000 7f22c3f0a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22bc15e5f0 0x7f22bc14f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.323+0000 7f22c3f0a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc06df00 con 0x7f22bc15e5f0 2024-09-12T02:04:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.323+0000 7f22c3f0a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc15e9d0 con 0x7f22bc0d30f0 2024-09-12T02:04:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.323+0000 7f22c3f0a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f22bc06e080 con 0x7f22bc0b64c0 2024-09-12T02:04:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.323+0000 7f22c24a7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22bc15e5f0 0x7f22bc14f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.323+0000 7f22c24a7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22bc15e5f0 0x7f22bc14f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59492/0 (socket says 172.21.15.19:59492) 2024-09-12T02:04:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.323+0000 7f22c24a7640 1 -- 172.21.15.19:0/1438930138 learned_addr learned my addr 172.21.15.19:0/1438930138 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.323+0000 7f22c1ca6640 1 --2- 172.21.15.19:0/1438930138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22bc0b64c0 0x7f22bc09e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.323+0000 7f22c14a5640 1 --2- 172.21.15.19:0/1438930138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22bc0d30f0 0x7f22bc14d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.323+0000 7f22c24a7640 1 -- 172.21.15.19:0/1438930138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22bc0b64c0 msgr2=0x7f22bc09e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.323+0000 7f22c24a7640 1 --2- 172.21.15.19:0/1438930138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22bc0b64c0 0x7f22bc09e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.323+0000 7f22c24a7640 1 -- 172.21.15.19:0/1438930138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22bc0d30f0 msgr2=0x7f22bc14d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.323+0000 7f22c24a7640 1 --2- 172.21.15.19:0/1438930138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22bc0d30f0 0x7f22bc14d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.323+0000 7f22c24a7640 1 -- 172.21.15.19:0/1438930138 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc09e720 con 0x7f22bc15e5f0 2024-09-12T02:04:46.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.323+0000 7f22c1ca6640 1 --2- 172.21.15.19:0/1438930138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22bc0b64c0 0x7f22bc09e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:46.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.323+0000 7f22c24a7640 1 --2- 172.21.15.19:0/1438930138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22bc15e5f0 0x7f22bc14f390 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f22b4007e70 tx=0x7f22b400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:46.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.324+0000 7f22b27fc640 1 -- 172.21.15.19:0/1438930138 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4014620 con 0x7f22bc15e5f0 2024-09-12T02:04:46.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.324+0000 7f22b27fc640 1 -- 172.21.15.19:0/1438930138 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b4019070 con 0x7f22bc15e5f0 2024-09-12T02:04:46.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.324+0000 7f22c3f0a640 1 -- 172.21.15.19:0/1438930138 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22bc14e2f0 con 0x7f22bc15e5f0 2024-09-12T02:04:46.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.324+0000 7f22b27fc640 1 -- 172.21.15.19:0/1438930138 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4014a20 con 0x7f22bc15e5f0 2024-09-12T02:04:46.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.324+0000 7f22c3f0a640 1 -- 172.21.15.19:0/1438930138 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22bc14e8b0 con 0x7f22bc15e5f0 2024-09-12T02:04:46.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.325+0000 7f22c3f0a640 1 -- 172.21.15.19:0/1438930138 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22bc0d3690 con 0x7f22bc15e5f0 2024-09-12T02:04:46.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.325+0000 7f22b27fc640 1 -- 172.21.15.19:0/1438930138 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22b4014bc0 con 0x7f22bc15e5f0 2024-09-12T02:04:46.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.326+0000 7f22b27fc640 1 --2- 172.21.15.19:0/1438930138 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f22a006be30 0x7f22a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:46.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.326+0000 7f22b27fc640 1 -- 172.21.15.19:0/1438930138 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8195+0+0 (secure 0 0 0) 0x7f22b408c1c0 con 0x7f22bc15e5f0 2024-09-12T02:04:46.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.326+0000 7f22c1ca6640 1 --2- 172.21.15.19:0/1438930138 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f22a006be30 0x7f22a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:46.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.326+0000 7f22c1ca6640 1 --2- 172.21.15.19:0/1438930138 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f22a006be30 0x7f22a006e2f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f22b8000f60 tx=0x7f22b8007ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.330+0000 7f22b27fc640 1 -- 172.21.15.19:0/1438930138 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f22b405a160 con 0x7f22bc15e5f0 2024-09-12T02:04:46.494 INFO:tasks.ceph.mds.c.smithi019.stderr: -45> 2024-09-12T02:04:41.742+0000 7f25295cc640 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -22 ((22) Invalid argument) 2024-09-12T02:04:46.520 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:04:46.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.545+0000 7f22c3f0a640 1 -- 172.21.15.19:0/1438930138 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22bc075670 con 0x7f22bc15e5f0 2024-09-12T02:04:46.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.545+0000 7f22b27fc640 1 -- 172.21.15.19:0/1438930138 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 210 v210) ==== 95+0+3563 (secure 0 0 0) 0x7f22b4059a60 con 0x7f22bc15e5f0 2024-09-12T02:04:46.546 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:46.546 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":210,"btime":"2024-09-12T02:04:45:872134+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":210,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:45.872080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:46.546 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 210 2024-09-12T02:04:46.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.547+0000 7f22c3f0a640 1 -- 172.21.15.19:0/1438930138 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f22a006be30 msgr2=0x7f22a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:46.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.547+0000 7f22c3f0a640 1 --2- 172.21.15.19:0/1438930138 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f22a006be30 0x7f22a006e2f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f22b8000f60 tx=0x7f22b8007ca0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.547+0000 7f22c3f0a640 1 -- 172.21.15.19:0/1438930138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22bc15e5f0 msgr2=0x7f22bc14f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:46.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.547+0000 7f22c3f0a640 1 --2- 172.21.15.19:0/1438930138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22bc15e5f0 0x7f22bc14f390 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f22b4007e70 tx=0x7f22b400e4b0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.547+0000 7f22c3f0a640 1 -- 172.21.15.19:0/1438930138 shutdown_connections 2024-09-12T02:04:46.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.547+0000 7f22c3f0a640 1 --2- 172.21.15.19:0/1438930138 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f22a006be30 0x7f22a006e2f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.547+0000 7f22c3f0a640 1 --2- 172.21.15.19:0/1438930138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22bc15e5f0 0x7f22bc14f390 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.547+0000 7f22c3f0a640 1 --2- 172.21.15.19:0/1438930138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22bc0d30f0 0x7f22bc14d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.547+0000 7f22c3f0a640 1 --2- 172.21.15.19:0/1438930138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22bc0b64c0 0x7f22bc09e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.547+0000 7f22c3f0a640 1 -- 172.21.15.19:0/1438930138 >> 172.21.15.19:0/1438930138 conn(0x7f22bc08bfc0 msgr2=0x7f22bc0d1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:46.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.547+0000 7f22c3f0a640 1 -- 172.21.15.19:0/1438930138 shutdown_connections 2024-09-12T02:04:46.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.547+0000 7f22c3f0a640 1 -- 172.21.15.19:0/1438930138 wait complete. 2024-09-12T02:04:46.559 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:46.559 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:46.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.662+0000 7f2a4d931640 1 Processor -- start 2024-09-12T02:04:46.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.662+0000 7f2a4d931640 1 -- start start 2024-09-12T02:04:46.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.663+0000 7f2a4d931640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2a480d1090 0x7f2a4809b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:46.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.663+0000 7f2a4d931640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a480cec00 con 0x7f2a480b1620 2024-09-12T02:04:46.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.663+0000 7f2a4d931640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a4809bd90 con 0x7f2a4815c520 2024-09-12T02:04:46.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.663+0000 7f2a4d931640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2a480d0010 con 0x7f2a480d1090 2024-09-12T02:04:46.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.663+0000 7f2a467fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2a480d1090 0x7f2a4809b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:46.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.663+0000 7f2a467fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2a480d1090 0x7f2a4809b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59524/0 (socket says 172.21.15.19:59524) 2024-09-12T02:04:46.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.663+0000 7f2a477fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2a480b1620 0x7f2a480cd570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41956/0 (socket says 172.21.15.19:41956) 2024-09-12T02:04:46.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.663+0000 7f2a467fc640 1 -- 172.21.15.19:0/1399875650 learned_addr learned my addr 172.21.15.19:0/1399875650 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:46.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.664+0000 7f2a467fc640 1 -- 172.21.15.19:0/1399875650 >> v1:172.21.15.135:6789/0 conn(0x7f2a4815c520 legacy=0x7f2a480d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:46.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.664+0000 7f2a467fc640 1 -- 172.21.15.19:0/1399875650 >> v1:172.21.15.19:6789/0 conn(0x7f2a480b1620 legacy=0x7f2a480cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:46.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.664+0000 7f2a467fc640 1 -- 172.21.15.19:0/1399875650 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a480d02f0 con 0x7f2a480d1090 2024-09-12T02:04:46.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.665+0000 7f2a467fc640 1 --2- 172.21.15.19:0/1399875650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a480d1090 0x7f2a4809b720 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009870 tx=0x7f2a3002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b7adca0f0a0720 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:46.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.665+0000 7f2a45ffb640 1 -- 172.21.15.19:0/1399875650 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a30037070 con 0x7f2a480d1090 2024-09-12T02:04:46.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.665+0000 7f2a45ffb640 1 -- 172.21.15.19:0/1399875650 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a3002ae50 con 0x7f2a480d1090 2024-09-12T02:04:46.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.665+0000 7f2a45ffb640 1 -- 172.21.15.19:0/1399875650 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a30032860 con 0x7f2a480d1090 2024-09-12T02:04:46.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.665+0000 7f2a4d931640 1 -- 172.21.15.19:0/1399875650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a480d1090 msgr2=0x7f2a4809b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:46.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.665+0000 7f2a4d931640 1 --2- 172.21.15.19:0/1399875650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a480d1090 0x7f2a4809b720 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009870 tx=0x7f2a3002a300 comp rx=0 tx=0).stop 2024-09-12T02:04:46.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.665+0000 7f2a4d931640 1 -- 172.21.15.19:0/1399875650 shutdown_connections 2024-09-12T02:04:46.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.665+0000 7f2a4d931640 1 --2- 172.21.15.19:0/1399875650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a480d1090 0x7f2a4809b720 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.665+0000 7f2a4d931640 1 -- 172.21.15.19:0/1399875650 >> 172.21.15.19:0/1399875650 conn(0x7f2a480d23a0 msgr2=0x7f2a480d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:46.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.665+0000 7f2a4d931640 1 -- 172.21.15.19:0/1399875650 shutdown_connections 2024-09-12T02:04:46.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.665+0000 7f2a4d931640 1 -- 172.21.15.19:0/1399875650 wait complete. 2024-09-12T02:04:46.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.667+0000 7f2a4d931640 1 Processor -- start 2024-09-12T02:04:46.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.667+0000 7f2a4d931640 1 -- start start 2024-09-12T02:04:46.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.667+0000 7f2a4d931640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a480b1620 0x7f2a480c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:46.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a4d931640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a480d1090 0x7f2a480701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:46.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a4d931640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4815c520 0x7f2a480706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:46.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a4d931640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4815c900 con 0x7f2a4815c520 2024-09-12T02:04:46.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a4d931640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2a480d05d0 con 0x7f2a480b1620 2024-09-12T02:04:46.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a4d931640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2a480c7030 con 0x7f2a480d1090 2024-09-12T02:04:46.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4815c520 0x7f2a480706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:46.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4815c520 0x7f2a480706e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59530/0 (socket says 172.21.15.19:59530) 2024-09-12T02:04:46.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a477fe640 1 -- 172.21.15.19:0/2088979882 learned_addr learned my addr 172.21.15.19:0/2088979882 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:46.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a46ffd640 1 --2- 172.21.15.19:0/2088979882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a480b1620 0x7f2a480c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:46.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a467fc640 1 --2- 172.21.15.19:0/2088979882 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a480d1090 0x7f2a480701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:46.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a477fe640 1 -- 172.21.15.19:0/2088979882 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a480d1090 msgr2=0x7f2a480701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:46.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a477fe640 1 --2- 172.21.15.19:0/2088979882 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a480d1090 0x7f2a480701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a477fe640 1 -- 172.21.15.19:0/2088979882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a480b1620 msgr2=0x7f2a480c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:46.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a477fe640 1 --2- 172.21.15.19:0/2088979882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a480b1620 0x7f2a480c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a477fe640 1 -- 172.21.15.19:0/2088979882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a480cc7e0 con 0x7f2a4815c520 2024-09-12T02:04:46.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a46ffd640 1 --2- 172.21.15.19:0/2088979882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a480b1620 0x7f2a480c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:46.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a477fe640 1 --2- 172.21.15.19:0/2088979882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4815c520 0x7f2a480706e0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000c430 tx=0x7f2a4000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:46.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a3ffff640 1 -- 172.21.15.19:0/2088979882 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a400074e0 con 0x7f2a4815c520 2024-09-12T02:04:46.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a3ffff640 1 -- 172.21.15.19:0/2088979882 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a40007680 con 0x7f2a4815c520 2024-09-12T02:04:46.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a4d931640 1 -- 172.21.15.19:0/2088979882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a480c6120 con 0x7f2a4815c520 2024-09-12T02:04:46.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a3ffff640 1 -- 172.21.15.19:0/2088979882 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a400049e0 con 0x7f2a4815c520 2024-09-12T02:04:46.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.668+0000 7f2a4d931640 1 -- 172.21.15.19:0/2088979882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a480c6c20 con 0x7f2a4815c520 2024-09-12T02:04:46.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.670+0000 7f2a4d931640 1 -- 172.21.15.19:0/2088979882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a4806cd20 con 0x7f2a4815c520 2024-09-12T02:04:46.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.670+0000 7f2a3ffff640 1 -- 172.21.15.19:0/2088979882 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a4001a020 con 0x7f2a4815c520 2024-09-12T02:04:46.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.670+0000 7f2a3ffff640 1 --2- 172.21.15.19:0/2088979882 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2a2806be30 0x7f2a2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:46.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.670+0000 7f2a3ffff640 1 -- 172.21.15.19:0/2088979882 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8195+0+0 (secure 0 0 0) 0x7f2a4008b080 con 0x7f2a4815c520 2024-09-12T02:04:46.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.671+0000 7f2a46ffd640 1 --2- 172.21.15.19:0/2088979882 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2a2806be30 0x7f2a2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:46.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.671+0000 7f2a46ffd640 1 --2- 172.21.15.19:0/2088979882 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2a2806be30 0x7f2a2806e2f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2a380012e0 tx=0x7f2a38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:46.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.675+0000 7f2a3ffff640 1 -- 172.21.15.19:0/2088979882 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a40010300 con 0x7f2a4815c520 2024-09-12T02:04:46.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.885+0000 7f2a4d931640 1 -- 172.21.15.19:0/2088979882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a480b1400 con 0x7f2a4815c520 2024-09-12T02:04:46.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.885+0000 7f2a3ffff640 1 -- 172.21.15.19:0/2088979882 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 211 v211) ==== 95+0+4389 (secure 0 0 0) 0x7f2a40059030 con 0x7f2a4815c520 2024-09-12T02:04:46.886 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:46.886 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":211,"btime":"2024-09-12T02:04:46:875737+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":9153,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3545886366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3545886366},{"type":"v1","addr":"172.21.15.19:6834","nonce":3545886366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":211}],"filesystems":[{"mdsmap":{"epoch":210,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:45.872080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:46.886 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 211 2024-09-12T02:04:46.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.887+0000 7f2a4d931640 1 -- 172.21.15.19:0/2088979882 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2a2806be30 msgr2=0x7f2a2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:46.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.887+0000 7f2a4d931640 1 --2- 172.21.15.19:0/2088979882 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2a2806be30 0x7f2a2806e2f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2a380012e0 tx=0x7f2a38009040 comp rx=0 tx=0).stop 2024-09-12T02:04:46.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.887+0000 7f2a4d931640 1 -- 172.21.15.19:0/2088979882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4815c520 msgr2=0x7f2a480706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:46.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.887+0000 7f2a4d931640 1 --2- 172.21.15.19:0/2088979882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4815c520 0x7f2a480706e0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000c430 tx=0x7f2a4000c8f0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.888+0000 7f2a4d931640 1 -- 172.21.15.19:0/2088979882 shutdown_connections 2024-09-12T02:04:46.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.888+0000 7f2a4d931640 1 --2- 172.21.15.19:0/2088979882 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2a2806be30 0x7f2a2806e2f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.888+0000 7f2a4d931640 1 --2- 172.21.15.19:0/2088979882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4815c520 0x7f2a480706e0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.888+0000 7f2a4d931640 1 --2- 172.21.15.19:0/2088979882 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a480d1090 0x7f2a480701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.888+0000 7f2a4d931640 1 --2- 172.21.15.19:0/2088979882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a480b1620 0x7f2a480c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:46.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.888+0000 7f2a4d931640 1 -- 172.21.15.19:0/2088979882 >> 172.21.15.19:0/2088979882 conn(0x7f2a480d23a0 msgr2=0x7f2a48071200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:46.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.888+0000 7f2a4d931640 1 -- 172.21.15.19:0/2088979882 shutdown_connections 2024-09-12T02:04:46.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:46.888+0000 7f2a4d931640 1 -- 172.21.15.19:0/2088979882 wait complete. 2024-09-12T02:04:46.899 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt 100.00000000.inode' led to DAMAGED state 2024-09-12T02:04:46.900 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate 1.00000000.inode' 2024-09-12T02:04:46.900 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:04:46.900 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:04:46.916 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:04:46.916 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:04:46.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:46.916 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:04:46.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:04:46.972 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:04:46.972 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:04:47.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.114+0000 7f7eb8ce6640 1 Processor -- start 2024-09-12T02:04:47.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.115+0000 7f7eb8ce6640 1 -- start start 2024-09-12T02:04:47.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.115+0000 7f7eb8ce6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7eb40b6680 0x7f7eb4169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:47.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.115+0000 7f7eb8ce6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eb406d9f0 con 0x7f7eb4162060 2024-09-12T02:04:47.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb8ce6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eb406dcd0 con 0x7f7eb4161c80 2024-09-12T02:04:47.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb8ce6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb406dfb0 con 0x7f7eb40b6680 2024-09-12T02:04:47.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb1d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7eb4162060 0x7f7eb40b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41962/0 (socket says 172.21.15.19:41962) 2024-09-12T02:04:47.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb1d9b640 1 -- 172.21.15.19:0/2277460258 learned_addr learned my addr 172.21.15.19:0/2277460258 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb2d9d640 1 --2- 172.21.15.19:0/2277460258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7eb40b6680 0x7f7eb4169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb159a640 1 -- 172.21.15.19:0/2277460258 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052901832 0 0) 0x7f7eb406d9f0 con 0x7f7eb4162060 2024-09-12T02:04:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb159a640 1 -- 172.21.15.19:0/2277460258 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ea0003520 con 0x7f7eb4162060 2024-09-12T02:04:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb159a640 1 -- 172.21.15.19:0/2277460258 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4131331242 0 0) 0x7f7eb406dcd0 con 0x7f7eb4161c80 2024-09-12T02:04:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb159a640 1 -- 172.21.15.19:0/2277460258 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7eb406d9f0 con 0x7f7eb4161c80 2024-09-12T02:04:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb159a640 1 -- 172.21.15.19:0/2277460258 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1133403882 0 0) 0x7f7ea0003520 con 0x7f7eb4162060 2024-09-12T02:04:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb159a640 1 -- 172.21.15.19:0/2277460258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7eb40b6680 msgr2=0x7f7eb4169830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb159a640 1 --2- 172.21.15.19:0/2277460258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7eb40b6680 0x7f7eb4169830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb159a640 1 -- 172.21.15.19:0/2277460258 >> v1:172.21.15.135:6789/0 conn(0x7f7eb4161c80 legacy=0x7f7eb406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb159a640 1 -- 172.21.15.19:0/2277460258 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb40d01f0 con 0x7f7eb4162060 2024-09-12T02:04:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb159a640 1 -- 172.21.15.19:0/2277460258 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f7e9c001670 con 0x7f7eb4162060 2024-09-12T02:04:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb159a640 1 -- 172.21.15.19:0/2277460258 >> v1:172.21.15.19:6789/0 conn(0x7f7eb4162060 legacy=0x7f7eb40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb159a640 1 --2- 172.21.15.19:0/2277460258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7eb40b6680 0x7f7ea0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb159a640 1 --2- 172.21.15.19:0/2277460258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ea00040d0 0x7f7ea0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb159a640 1 --2- 172.21.15.19:0/2277460258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ea0004d40 0x7f7ea00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb159a640 1 -- 172.21.15.19:0/2277460258 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb406dfb0 con 0x7f7ea00040d0 2024-09-12T02:04:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb159a640 1 -- 172.21.15.19:0/2277460258 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea000baa0 con 0x7f7ea0004d40 2024-09-12T02:04:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.116+0000 7f7eb159a640 1 -- 172.21.15.19:0/2277460258 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7ea000bca0 con 0x7f7eb40b6680 2024-09-12T02:04:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.117+0000 7f7eb1d9b640 1 --2- 172.21.15.19:0/2277460258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ea00040d0 0x7f7ea0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.117+0000 7f7eb259c640 1 --2- 172.21.15.19:0/2277460258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7eb40b6680 0x7f7ea0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.117+0000 7f7eb2d9d640 1 --2- 172.21.15.19:0/2277460258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ea0004d40 0x7f7ea00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.117+0000 7f7eb1d9b640 1 -- 172.21.15.19:0/2277460258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7eb40b6680 msgr2=0x7f7ea0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.117+0000 7f7eb1d9b640 1 --2- 172.21.15.19:0/2277460258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7eb40b6680 0x7f7ea0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.117+0000 7f7eb1d9b640 1 -- 172.21.15.19:0/2277460258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ea0004d40 msgr2=0x7f7ea00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.117+0000 7f7eb1d9b640 1 --2- 172.21.15.19:0/2277460258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ea0004d40 0x7f7ea00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.117+0000 7f7eb1d9b640 1 -- 172.21.15.19:0/2277460258 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea0003520 con 0x7f7ea00040d0 2024-09-12T02:04:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.117+0000 7f7eb259c640 1 --2- 172.21.15.19:0/2277460258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7eb40b6680 0x7f7ea0003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.118+0000 7f7eb1d9b640 1 --2- 172.21.15.19:0/2277460258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ea00040d0 0x7f7ea0004800 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c007fd0 tx=0x7f7ea0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a3a11e06c1b534 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.118+0000 7f7eb159a640 1 -- 172.21.15.19:0/2277460258 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c007ce0 con 0x7f7ea00040d0 2024-09-12T02:04:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.118+0000 7f7eb159a640 1 -- 172.21.15.19:0/2277460258 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e9c005ad0 con 0x7f7ea00040d0 2024-09-12T02:04:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.118+0000 7f7eb159a640 1 -- 172.21.15.19:0/2277460258 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c007070 con 0x7f7ea00040d0 2024-09-12T02:04:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.118+0000 7f7eb8ce6640 1 -- 172.21.15.19:0/2277460258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ea00040d0 msgr2=0x7f7ea0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.118+0000 7f7eb8ce6640 1 --2- 172.21.15.19:0/2277460258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ea00040d0 0x7f7ea0004800 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c007fd0 tx=0x7f7ea0005830 comp rx=0 tx=0).stop 2024-09-12T02:04:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.118+0000 7f7eb2d9d640 1 -- 172.21.15.19:0/2277460258 reap_dead start 2024-09-12T02:04:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.118+0000 7f7eb8ce6640 1 -- 172.21.15.19:0/2277460258 shutdown_connections 2024-09-12T02:04:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.118+0000 7f7eb8ce6640 1 -- 172.21.15.19:0/2277460258 >> 172.21.15.19:0/2277460258 conn(0x7f7eb40d44f0 msgr2=0x7f7eb40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.118+0000 7f7eb8ce6640 1 -- 172.21.15.19:0/2277460258 shutdown_connections 2024-09-12T02:04:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.118+0000 7f7eb8ce6640 1 -- 172.21.15.19:0/2277460258 wait complete. 2024-09-12T02:04:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.120+0000 7f7eb8ce6640 1 Processor -- start 2024-09-12T02:04:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.120+0000 7f7eb8ce6640 1 -- start start 2024-09-12T02:04:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb8ce6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ea00040d0 0x7f7eb40b8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb8ce6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7eb4159840 0x7f7eb40cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb8ce6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eb4158f20 0x7f7eb40b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb8ce6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb40b6b30 con 0x7f7eb4158f20 2024-09-12T02:04:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb8ce6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb40d2aa0 con 0x7f7ea00040d0 2024-09-12T02:04:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb8ce6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb40b6cb0 con 0x7f7eb4159840 2024-09-12T02:04:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eb4158f20 0x7f7eb40b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eb4158f20 0x7f7eb40b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59546/0 (socket says 172.21.15.19:59546) 2024-09-12T02:04:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb2d9d640 1 -- 172.21.15.19:0/3218737769 learned_addr learned my addr 172.21.15.19:0/3218737769 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb259c640 1 --2- 172.21.15.19:0/3218737769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ea00040d0 0x7f7eb40b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb1d9b640 1 --2- 172.21.15.19:0/3218737769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7eb4159840 0x7f7eb40cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb2d9d640 1 -- 172.21.15.19:0/3218737769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7eb4159840 msgr2=0x7f7eb40cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb2d9d640 1 --2- 172.21.15.19:0/3218737769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7eb4159840 0x7f7eb40cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb2d9d640 1 -- 172.21.15.19:0/3218737769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ea00040d0 msgr2=0x7f7eb40b8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb2d9d640 1 --2- 172.21.15.19:0/3218737769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ea00040d0 0x7f7eb40b8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb2d9d640 1 -- 172.21.15.19:0/3218737769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb40cd150 con 0x7f7eb4158f20 2024-09-12T02:04:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb2d9d640 1 --2- 172.21.15.19:0/3218737769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eb4158f20 0x7f7eb40b20b0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f7eac011860 tx=0x7f7eac011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eaaffd640 1 -- 172.21.15.19:0/3218737769 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac011e50 con 0x7f7eb4158f20 2024-09-12T02:04:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb8ce6640 1 -- 172.21.15.19:0/3218737769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb40b7520 con 0x7f7eb4158f20 2024-09-12T02:04:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eaaffd640 1 -- 172.21.15.19:0/3218737769 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eac01b070 con 0x7f7eb4158f20 2024-09-12T02:04:47.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eaaffd640 1 -- 172.21.15.19:0/3218737769 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac004480 con 0x7f7eb4158f20 2024-09-12T02:04:47.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.121+0000 7f7eb8ce6640 1 -- 172.21.15.19:0/3218737769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb40b7ae0 con 0x7f7eb4158f20 2024-09-12T02:04:47.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.122+0000 7f7eb8ce6640 1 -- 172.21.15.19:0/3218737769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eb40b7340 con 0x7f7eb4158f20 2024-09-12T02:04:47.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.123+0000 7f7eaaffd640 1 -- 172.21.15.19:0/3218737769 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7eac012040 con 0x7f7eb4158f20 2024-09-12T02:04:47.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.123+0000 7f7eaaffd640 1 --2- 172.21.15.19:0/3218737769 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7e9406be30 0x7f7e9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:47.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.123+0000 7f7eaaffd640 1 -- 172.21.15.19:0/3218737769 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8195+0+0 (secure 0 0 0) 0x7f7eac08b4a0 con 0x7f7eb4158f20 2024-09-12T02:04:47.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.124+0000 7f7eb259c640 1 --2- 172.21.15.19:0/3218737769 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7e9406be30 0x7f7e9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:47.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.124+0000 7f7eb259c640 1 --2- 172.21.15.19:0/3218737769 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7e9406be30 0x7f7e9406e2f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4001f30 tx=0x7f7ea4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:47.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.128+0000 7f7eaaffd640 1 -- 172.21.15.19:0/3218737769 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7eb40b7340 con 0x7f7eb4158f20 2024-09-12T02:04:47.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.340+0000 7f7eb8ce6640 1 -- 172.21.15.19:0/3218737769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7eb406dcd0 con 0x7f7eb4158f20 2024-09-12T02:04:47.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.887+0000 7f7eaaffd640 1 -- 172.21.15.19:0/3218737769 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v212) ==== 161+0+0 (secure 0 0 0) 0x7f7eac0593c0 con 0x7f7eb4158f20 2024-09-12T02:04:47.888 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:04:47.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.889+0000 7f7eb8ce6640 1 -- 172.21.15.19:0/3218737769 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7e9406be30 msgr2=0x7f7e9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:47.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.889+0000 7f7eb8ce6640 1 --2- 172.21.15.19:0/3218737769 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7e9406be30 0x7f7e9406e2f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4001f30 tx=0x7f7ea4009040 comp rx=0 tx=0).stop 2024-09-12T02:04:47.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.889+0000 7f7eb8ce6640 1 -- 172.21.15.19:0/3218737769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eb4158f20 msgr2=0x7f7eb40b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:47.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.889+0000 7f7eb8ce6640 1 --2- 172.21.15.19:0/3218737769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eb4158f20 0x7f7eb40b20b0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f7eac011860 tx=0x7f7eac011c60 comp rx=0 tx=0).stop 2024-09-12T02:04:47.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.889+0000 7f7eb8ce6640 1 -- 172.21.15.19:0/3218737769 shutdown_connections 2024-09-12T02:04:47.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.889+0000 7f7eb8ce6640 1 --2- 172.21.15.19:0/3218737769 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f7e9406be30 0x7f7e9406e2f0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.890+0000 7f7eb8ce6640 1 --2- 172.21.15.19:0/3218737769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eb4158f20 0x7f7eb40b20b0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.890+0000 7f7eb8ce6640 1 --2- 172.21.15.19:0/3218737769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7eb4159840 0x7f7eb40cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.890+0000 7f7eb8ce6640 1 --2- 172.21.15.19:0/3218737769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ea00040d0 0x7f7eb40b8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.890+0000 7f7eb8ce6640 1 -- 172.21.15.19:0/3218737769 >> 172.21.15.19:0/3218737769 conn(0x7f7eb40d44f0 msgr2=0x7f7eb40b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:47.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.890+0000 7f7eb8ce6640 1 -- 172.21.15.19:0/3218737769 shutdown_connections 2024-09-12T02:04:47.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:47.890+0000 7f7eb8ce6640 1 -- 172.21.15.19:0/3218737769 wait complete. 2024-09-12T02:04:47.903 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:04:48.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.010+0000 7f61a66b7640 1 Processor -- start 2024-09-12T02:04:48.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.010+0000 7f61a66b7640 1 -- start start 2024-09-12T02:04:48.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.011+0000 7f61a66b7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61a00d1540 0x7f61a006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:48.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.011+0000 7f61a66b7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f61a009b690 0x7f61a006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:48.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.011+0000 7f61a66b7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61a00d1940 con 0x7f61a015e740 2024-09-12T02:04:48.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.011+0000 7f61a66b7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f61a015eb20 con 0x7f61a009b690 2024-09-12T02:04:48.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.011+0000 7f61a66b7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f61a006d260 con 0x7f61a00d1540 2024-09-12T02:04:48.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.011+0000 7f619f7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61a00d1540 0x7f61a006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:48.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.011+0000 7f61a4c54640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f61a009b690 0x7f61a006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:48.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.011+0000 7f619ffff640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f61a015e740 0x7f61a006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:43616/0 (socket says 172.21.15.19:43616) 2024-09-12T02:04:48.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.011+0000 7f619ffff640 1 -- 172.21.15.19:0/249337535 learned_addr learned my addr 172.21.15.19:0/249337535 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:48.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.012+0000 7f619f7fe640 1 -- 172.21.15.19:0/249337535 >> v2:172.21.15.135:3300/0 conn(0x7f61a009b690 msgr2=0x7f61a006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:48.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.012+0000 7f619f7fe640 1 --2- 172.21.15.19:0/249337535 >> v2:172.21.15.135:3300/0 conn(0x7f61a009b690 0x7f61a006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.012+0000 7f619effd640 1 -- 172.21.15.19:0/249337535 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1558080462 0 0) 0x7f61a00d1940 con 0x7f61a015e740 2024-09-12T02:04:48.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.012+0000 7f619f7fe640 1 -- 172.21.15.19:0/249337535 >> v1:172.21.15.135:6789/0 conn(0x7f61a015e740 legacy=0x7f61a006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:48.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.012+0000 7f619f7fe640 1 -- 172.21.15.19:0/249337535 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a009bae0 con 0x7f61a00d1540 2024-09-12T02:04:48.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.012+0000 7f619f7fe640 1 --2- 172.21.15.19:0/249337535 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61a00d1540 0x7f61a006dbd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f61940097a0 tx=0x7f619402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=931252fbe3c5533f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:48.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.013+0000 7f619effd640 1 -- 172.21.15.19:0/249337535 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194037070 con 0x7f61a00d1540 2024-09-12T02:04:48.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.013+0000 7f619effd640 1 -- 172.21.15.19:0/249337535 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6194032440 con 0x7f61a00d1540 2024-09-12T02:04:48.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.013+0000 7f619effd640 1 -- 172.21.15.19:0/249337535 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194032810 con 0x7f61a00d1540 2024-09-12T02:04:48.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.013+0000 7f61a66b7640 1 -- 172.21.15.19:0/249337535 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61a00d1540 msgr2=0x7f61a006dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:48.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.013+0000 7f61a66b7640 1 --2- 172.21.15.19:0/249337535 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61a00d1540 0x7f61a006dbd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f61940097a0 tx=0x7f619402a210 comp rx=0 tx=0).stop 2024-09-12T02:04:48.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.013+0000 7f61a66b7640 1 -- 172.21.15.19:0/249337535 shutdown_connections 2024-09-12T02:04:48.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.013+0000 7f61a66b7640 1 --2- 172.21.15.19:0/249337535 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61a00d1540 0x7f61a006dbd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.013+0000 7f61a66b7640 1 --2- 172.21.15.19:0/249337535 >> v2:172.21.15.135:3300/0 conn(0x7f61a009b690 0x7f61a006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.013+0000 7f61a66b7640 1 -- 172.21.15.19:0/249337535 >> 172.21.15.19:0/249337535 conn(0x7f61a00d23a0 msgr2=0x7f61a00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:48.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.013+0000 7f61a66b7640 1 -- 172.21.15.19:0/249337535 shutdown_connections 2024-09-12T02:04:48.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.013+0000 7f61a66b7640 1 -- 172.21.15.19:0/249337535 wait complete. 2024-09-12T02:04:48.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.014+0000 7f61a66b7640 1 Processor -- start 2024-09-12T02:04:48.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.014+0000 7f61a66b7640 1 -- start start 2024-09-12T02:04:48.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.015+0000 7f61a66b7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61a009b690 0x7f61a00b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:48.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.015+0000 7f61a66b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a00d1540 0x7f61a0155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:48.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.015+0000 7f61a66b7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61a015e740 0x7f61a00b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:48.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.015+0000 7f61a66b7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f61a00d0d40 con 0x7f61a00d1540 2024-09-12T02:04:48.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.015+0000 7f61a66b7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f61a00d0a60 con 0x7f61a009b690 2024-09-12T02:04:48.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.015+0000 7f61a66b7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f61a00d1020 con 0x7f61a015e740 2024-09-12T02:04:48.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.015+0000 7f619f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a00d1540 0x7f61a0155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:48.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.015+0000 7f619f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a00d1540 0x7f61a0155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59562/0 (socket says 172.21.15.19:59562) 2024-09-12T02:04:48.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.015+0000 7f619ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61a009b690 0x7f61a00b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:48.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.015+0000 7f619f7fe640 1 -- 172.21.15.19:0/4259139489 learned_addr learned my addr 172.21.15.19:0/4259139489 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:48.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.016+0000 7f61a4c54640 1 --2- 172.21.15.19:0/4259139489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61a015e740 0x7f61a00b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:48.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.016+0000 7f619f7fe640 1 -- 172.21.15.19:0/4259139489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61a015e740 msgr2=0x7f61a00b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:48.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.016+0000 7f619f7fe640 1 --2- 172.21.15.19:0/4259139489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61a015e740 0x7f61a00b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.016+0000 7f619f7fe640 1 -- 172.21.15.19:0/4259139489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61a009b690 msgr2=0x7f61a00b0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:48.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.016+0000 7f619f7fe640 1 --2- 172.21.15.19:0/4259139489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61a009b690 0x7f61a00b0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.016+0000 7f619f7fe640 1 -- 172.21.15.19:0/4259139489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a00af6f0 con 0x7f61a00d1540 2024-09-12T02:04:48.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.016+0000 7f619f7fe640 1 --2- 172.21.15.19:0/4259139489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a00d1540 0x7f61a0155d50 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f6194000c00 tx=0x7f61940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:48.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.016+0000 7f619cff9640 1 -- 172.21.15.19:0/4259139489 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194037040 con 0x7f61a00d1540 2024-09-12T02:04:48.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.016+0000 7f619cff9640 1 -- 172.21.15.19:0/4259139489 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6194042070 con 0x7f61a00d1540 2024-09-12T02:04:48.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.016+0000 7f619cff9640 1 -- 172.21.15.19:0/4259139489 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194030960 con 0x7f61a00d1540 2024-09-12T02:04:48.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.016+0000 7f61a66b7640 1 -- 172.21.15.19:0/4259139489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a00af9d0 con 0x7f61a00d1540 2024-09-12T02:04:48.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.016+0000 7f61a66b7640 1 -- 172.21.15.19:0/4259139489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a00aff90 con 0x7f61a00d1540 2024-09-12T02:04:48.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.017+0000 7f61a66b7640 1 -- 172.21.15.19:0/4259139489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61a006cd20 con 0x7f61a00d1540 2024-09-12T02:04:48.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.018+0000 7f619cff9640 1 -- 172.21.15.19:0/4259139489 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6194030b00 con 0x7f61a00d1540 2024-09-12T02:04:48.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.018+0000 7f619cff9640 1 --2- 172.21.15.19:0/4259139489 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f618c06be30 0x7f618c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:48.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.018+0000 7f619cff9640 1 -- 172.21.15.19:0/4259139489 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8195+0+0 (secure 0 0 0) 0x7f61940ac140 con 0x7f61a00d1540 2024-09-12T02:04:48.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.019+0000 7f619ffff640 1 --2- 172.21.15.19:0/4259139489 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f618c06be30 0x7f618c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:48.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.019+0000 7f619ffff640 1 --2- 172.21.15.19:0/4259139489 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f618c06be30 0x7f618c06e2f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6190000f60 tx=0x7f6190007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:48.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.023+0000 7f619cff9640 1 -- 172.21.15.19:0/4259139489 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6194079a10 con 0x7f61a00d1540 2024-09-12T02:04:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.273+0000 7f61a66b7640 1 -- 172.21.15.19:0/4259139489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f61a00d1cb0 con 0x7f61a00d1540 2024-09-12T02:04:48.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.889+0000 7f619cff9640 1 -- 172.21.15.19:0/4259139489 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v213) ==== 101+0+0 (secure 0 0 0) 0x7f619407dd10 con 0x7f61a00d1540 2024-09-12T02:04:48.889 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:04:48.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.891+0000 7f61a66b7640 1 -- 172.21.15.19:0/4259139489 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f618c06be30 msgr2=0x7f618c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:48.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.891+0000 7f61a66b7640 1 --2- 172.21.15.19:0/4259139489 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f618c06be30 0x7f618c06e2f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6190000f60 tx=0x7f6190007d50 comp rx=0 tx=0).stop 2024-09-12T02:04:48.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.891+0000 7f61a66b7640 1 -- 172.21.15.19:0/4259139489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a00d1540 msgr2=0x7f61a0155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:48.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.891+0000 7f61a66b7640 1 --2- 172.21.15.19:0/4259139489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a00d1540 0x7f61a0155d50 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f6194000c00 tx=0x7f61940046c0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.891+0000 7f61a66b7640 1 -- 172.21.15.19:0/4259139489 shutdown_connections 2024-09-12T02:04:48.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.891+0000 7f61a66b7640 1 --2- 172.21.15.19:0/4259139489 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f618c06be30 0x7f618c06e2f0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.891+0000 7f61a66b7640 1 --2- 172.21.15.19:0/4259139489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61a015e740 0x7f61a00b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.891+0000 7f61a66b7640 1 --2- 172.21.15.19:0/4259139489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a00d1540 0x7f61a0155d50 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.891+0000 7f61a66b7640 1 --2- 172.21.15.19:0/4259139489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61a009b690 0x7f61a00b0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.891+0000 7f61a66b7640 1 -- 172.21.15.19:0/4259139489 >> 172.21.15.19:0/4259139489 conn(0x7f61a00d23a0 msgr2=0x7f61a0071570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:48.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.891+0000 7f61a66b7640 1 -- 172.21.15.19:0/4259139489 shutdown_connections 2024-09-12T02:04:48.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.891+0000 7f61a66b7640 1 -- 172.21.15.19:0/4259139489 wait complete. 2024-09-12T02:04:48.906 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:04:48.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.952+0000 7f5eb4fb8f40 1 Processor -- start 2024-09-12T02:04:48.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.952+0000 7f5eb4fb8f40 1 -- start start 2024-09-12T02:04:48.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.953+0000 7f5eb4fb8f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ba60d37c0 0x562ba6173da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:48.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.953+0000 7f5eb4fb8f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ba60d3ba0 0x562ba61742e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:48.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.953+0000 7f5eb4fb8f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ba603e790 0x562ba6173110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:48.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.953+0000 7f5eb4fb8f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562ba605b930 con 0x562ba60d3ba0 2024-09-12T02:04:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.953+0000 7f5eb4fb8f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562ba5f64510 con 0x562ba603e790 2024-09-12T02:04:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.953+0000 7f5eb4fb8f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562ba6040c30 con 0x562ba60d37c0 2024-09-12T02:04:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.953+0000 7f5eb22ad640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ba60d3ba0 0x562ba61742e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.953+0000 7f5eb22ad640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ba60d3ba0 0x562ba61742e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59592/0 (socket says 172.21.15.19:59592) 2024-09-12T02:04:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.953+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3103076299 learned_addr learned my addr 172.21.15.19:0/3103076299 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.953+0000 7f5eb2aae640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ba60d37c0 0x562ba6173da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.953+0000 7f5eb32af640 1 --2- 172.21.15.19:0/3103076299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ba603e790 0x562ba6173110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.954+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3103076299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ba60d37c0 msgr2=0x562ba6173da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.954+0000 7f5eb22ad640 1 --2- 172.21.15.19:0/3103076299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ba60d37c0 0x562ba6173da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.954+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3103076299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ba603e790 msgr2=0x562ba6173110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.954+0000 7f5eb22ad640 1 --2- 172.21.15.19:0/3103076299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ba603e790 0x562ba6173110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.954+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3103076299 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ba603ba00 con 0x562ba60d3ba0 2024-09-12T02:04:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.954+0000 7f5eb22ad640 1 --2- 172.21.15.19:0/3103076299 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ba60d3ba0 0x562ba61742e0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800b2f0 tx=0x7f5ea800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306368e8db6c4349 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.954+0000 7f5eb12ab640 1 -- 172.21.15.19:0/3103076299 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8008070 con 0x562ba60d3ba0 2024-09-12T02:04:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.954+0000 7f5eb12ab640 1 -- 172.21.15.19:0/3103076299 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ea800d500 con 0x562ba60d3ba0 2024-09-12T02:04:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.954+0000 7f5eb12ab640 1 -- 172.21.15.19:0/3103076299 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea800d8d0 con 0x562ba60d3ba0 2024-09-12T02:04:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.954+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3103076299 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ba60d3ba0 msgr2=0x562ba61742e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.954+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3103076299 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ba60d3ba0 0x562ba61742e0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800b2f0 tx=0x7f5ea800b7b0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.955+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3103076299 shutdown_connections 2024-09-12T02:04:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.955+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3103076299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ba603e790 0x562ba6173110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.955+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3103076299 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ba60d3ba0 0x562ba61742e0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.955+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3103076299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ba60d37c0 0x562ba6173da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.955+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3103076299 >> 172.21.15.19:0/3103076299 conn(0x562ba6013ad0 msgr2=0x562ba60585f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.955+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3103076299 shutdown_connections 2024-09-12T02:04:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.955+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3103076299 wait complete. 2024-09-12T02:04:48.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.955+0000 7f5eb4fb8f40 1 Processor -- start 2024-09-12T02:04:48.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.955+0000 7f5eb4fb8f40 1 -- start start 2024-09-12T02:04:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.956+0000 7f5eb4fb8f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ba603e790 0x562ba60d1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.956+0000 7f5eb4fb8f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ba60d37c0 0x562ba60ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.956+0000 7f5eb4fb8f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ba60d3ba0 0x562ba60ce900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.956+0000 7f5eb4fb8f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562ba6056ed0 con 0x562ba60d3ba0 2024-09-12T02:04:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.956+0000 7f5eb4fb8f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562ba6056c80 con 0x562ba603e790 2024-09-12T02:04:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.956+0000 7f5eb4fb8f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562ba6056930 con 0x562ba60d37c0 2024-09-12T02:04:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.956+0000 7f5eb32af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ba60d3ba0 0x562ba60ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.956+0000 7f5eb32af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ba60d3ba0 0x562ba60ce900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59596/0 (socket says 172.21.15.19:59596) 2024-09-12T02:04:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.956+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 learned_addr learned my addr 172.21.15.19:0/3033168202 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.956+0000 7f5eb2aae640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ba603e790 0x562ba60d1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.956+0000 7f5eb22ad640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ba60d37c0 0x562ba60ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.956+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ba60d37c0 msgr2=0x562ba60ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.956+0000 7f5eb32af640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ba60d37c0 0x562ba60ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.956+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ba603e790 msgr2=0x562ba60d1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.956+0000 7f5eb32af640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ba603e790 0x562ba60d1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.956+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ba6176cd0 con 0x562ba60d3ba0 2024-09-12T02:04:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.957+0000 7f5eb32af640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ba60d3ba0 0x562ba60ce900 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00a190 tx=0x7f5eac003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.957+0000 7f5e9bfff640 1 -- 172.21.15.19:0/3033168202 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac04f440 con 0x562ba60d3ba0 2024-09-12T02:04:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.957+0000 7f5e9bfff640 1 -- 172.21.15.19:0/3033168202 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eac068070 con 0x562ba60d3ba0 2024-09-12T02:04:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.957+0000 7f5e9bfff640 1 -- 172.21.15.19:0/3033168202 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac057400 con 0x562ba60d3ba0 2024-09-12T02:04:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.957+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ba6176f40 con 0x562ba60d3ba0 2024-09-12T02:04:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.957+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ba6177500 con 0x562ba60d3ba0 2024-09-12T02:04:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.958+0000 7f5e9bfff640 1 -- 172.21.15.19:0/3033168202 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5eac0575a0 con 0x562ba60d3ba0 2024-09-12T02:04:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.959+0000 7f5e9bfff640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5ea006a810 0x7f5ea006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.959+0000 7f5e9bfff640 1 -- 172.21.15.19:0/3033168202 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8195+0+0 (secure 0 0 0) 0x7f5eac0ce8b0 con 0x562ba60d3ba0 2024-09-12T02:04:48.962 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:04:48.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.959+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562ba60d1db0 0x562ba6180ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:48.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.959+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6181000 con 0x562ba60d1db0 2024-09-12T02:04:48.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.959+0000 7f5eb2aae640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5ea006a810 0x7f5ea006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:48.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.959+0000 7f5eb22ad640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562ba60d1db0 0x562ba6180ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:48.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.960+0000 7f5eb22ad640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562ba60d1db0 0x562ba6180ac0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:48.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.960+0000 7f5eb2aae640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5ea006a810 0x7f5ea006ccd0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4005fd0 tx=0x7f5ea4005b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:48.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.961+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v117'691 uv665 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.961+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba6181430 con 0x562ba60d1db0 2024-09-12T02:04:48.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.962+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v117'692 uv692 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.962+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6181800 con 0x562ba60d1db0 2024-09-12T02:04:48.965 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:04:48.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.964+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v117'693 uv693 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.964+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6181ba0 con 0x562ba60d1db0 2024-09-12T02:04:48.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.965+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v117'694 uv694 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.965+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618ddb0 con 0x562ba60d1db0 2024-09-12T02:04:48.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.966+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v117'695 uv695 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.966+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618cda0 con 0x562ba60d1db0 2024-09-12T02:04:48.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.967+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v117'696 uv696 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.967+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618d1b0 con 0x562ba60d1db0 2024-09-12T02:04:48.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.968+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v117'697 uv671 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.968+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba618d550 con 0x562ba60d1db0 2024-09-12T02:04:48.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.969+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v117'698 uv698 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.969+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618d550 con 0x562ba60d1db0 2024-09-12T02:04:48.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.970+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v117'699 uv699 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.971 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:04:48.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.970+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618d550 con 0x562ba60d1db0 2024-09-12T02:04:48.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.971+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v117'700 uv700 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.971+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618d550 con 0x562ba60d1db0 2024-09-12T02:04:48.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.972+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v117'701 uv701 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.972+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618d550 con 0x562ba60d1db0 2024-09-12T02:04:48.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.973+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v117'702 uv702 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.973+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618d550 con 0x562ba60d1db0 2024-09-12T02:04:48.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.975+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v117'703 uv678 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.975+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba618d550 con 0x562ba60d1db0 2024-09-12T02:04:48.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.976+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v117'704 uv704 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.976+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618d550 con 0x562ba60d1db0 2024-09-12T02:04:48.977 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:04:48.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.977+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v117'705 uv705 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.977+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618d550 con 0x562ba60d1db0 2024-09-12T02:04:48.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.978+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v117'706 uv706 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.978+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618d9c0 con 0x562ba60d1db0 2024-09-12T02:04:48.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.979+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v117'707 uv707 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.979+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618d9c0 con 0x562ba60d1db0 2024-09-12T02:04:48.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.980+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v117'708 uv708 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.980+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618e150 con 0x562ba60d1db0 2024-09-12T02:04:48.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.982+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v117'709 uv709 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.982+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618e150 con 0x562ba60d1db0 2024-09-12T02:04:48.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.983+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v117'710 uv684 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.983+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba618e150 con 0x562ba60d1db0 2024-09-12T02:04:48.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.984+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v117'711 uv711 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.984+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618e150 con 0x562ba60d1db0 2024-09-12T02:04:48.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.985+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v117'712 uv712 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.985 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:04:48.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.985+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618f160 con 0x562ba60d1db0 2024-09-12T02:04:48.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.986+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v117'713 uv713 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.986+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618f160 con 0x562ba60d1db0 2024-09-12T02:04:48.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.987+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v117'714 uv714 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.987+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618e150 con 0x562ba60d1db0 2024-09-12T02:04:48.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.988+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v117'715 uv715 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.988+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618e150 con 0x562ba60d1db0 2024-09-12T02:04:48.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.989+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v117'716 uv690 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.989+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba618e150 con 0x562ba60d1db0 2024-09-12T02:04:48.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.990+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v117'717 uv717 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.990+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618e150 con 0x562ba60d1db0 2024-09-12T02:04:48.991 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:04:48.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.991+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v117'718 uv718 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.991+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618f160 con 0x562ba60d1db0 2024-09-12T02:04:48.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.992+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v117'719 uv719 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.992+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618f160 con 0x562ba60d1db0 2024-09-12T02:04:48.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.993+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v117'720 uv720 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.993+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba618e150 con 0x562ba60d1db0 2024-09-12T02:04:48.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.994+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v117'721 uv721 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba60d1db0 2024-09-12T02:04:48.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.994+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562ba618e660 0x562ba6190a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:48.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.994+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6190f90 con 0x562ba618e660 2024-09-12T02:04:48.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.994+0000 7f5eb2aae640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562ba618e660 0x562ba6190a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:48.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.995+0000 7f5eb2aae640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562ba618e660 0x562ba6190a50 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:48.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.996+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v117'506 uv489 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:48.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.996+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba6191330 con 0x562ba618e660 2024-09-12T02:04:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.998+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v117'507 uv507 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.998+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61916d0 con 0x562ba618e660 2024-09-12T02:04:48.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.999+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v117'508 uv508 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.000 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:04:49.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:48.999+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6191fa0 con 0x562ba618e660 2024-09-12T02:04:49.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.001+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v117'509 uv509 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.001+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6192340 con 0x562ba618e660 2024-09-12T02:04:49.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.002+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v117'510 uv510 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.002+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6192730 con 0x562ba618e660 2024-09-12T02:04:49.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.003+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v117'511 uv494 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.003+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba6192ad0 con 0x562ba618e660 2024-09-12T02:04:49.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.004+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v117'512 uv512 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.004+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6192ec0 con 0x562ba618e660 2024-09-12T02:04:49.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.005+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v117'513 uv513 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.005 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:04:49.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.005+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6192ec0 con 0x562ba618e660 2024-09-12T02:04:49.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.006+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v117'514 uv514 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.006+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6192e70 con 0x562ba618e660 2024-09-12T02:04:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.008+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v117'515 uv515 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.008+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6192e70 con 0x562ba618e660 2024-09-12T02:04:49.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.009+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v117'516 uv499 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.009+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba6192e70 con 0x562ba618e660 2024-09-12T02:04:49.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.010+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v117'517 uv517 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.010+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6192e70 con 0x562ba618e660 2024-09-12T02:04:49.011 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:04:49.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.011+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v117'518 uv518 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.011+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6192e70 con 0x562ba618e660 2024-09-12T02:04:49.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.012+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v117'519 uv519 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.013+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6192e70 con 0x562ba618e660 2024-09-12T02:04:49.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.014+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v117'520 uv520 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.014+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6192e70 con 0x562ba618e660 2024-09-12T02:04:49.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.015+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v117'521 uv505 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.015+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba6192e70 con 0x562ba618e660 2024-09-12T02:04:49.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.016+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v117'522 uv522 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.016+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6192e70 con 0x562ba618e660 2024-09-12T02:04:49.017 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:04:49.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.017+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v117'523 uv523 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.017+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6192e70 con 0x562ba618e660 2024-09-12T02:04:49.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.018+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v117'524 uv524 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.018+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6192e70 con 0x562ba618e660 2024-09-12T02:04:49.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.019+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v117'525 uv525 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.019+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6192e70 con 0x562ba618e660 2024-09-12T02:04:49.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.020+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v117'526 uv526 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba618e660 2024-09-12T02:04:49.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.021+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x562ba6193800 0x562ba6193c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.021+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6196370 con 0x562ba6193800 2024-09-12T02:04:49.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.021+0000 7f5eb22ad640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x562ba6193800 0x562ba6193c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.021+0000 7f5eb22ad640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x562ba6193800 0x562ba6193c80 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:49.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.022+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v117'135 uv134 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.022+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba6196370 con 0x562ba6193800 2024-09-12T02:04:49.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.023+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v117'136 uv136 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.024+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6196370 con 0x562ba6193800 2024-09-12T02:04:49.025 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:04:49.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.025+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v117'137 uv137 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.025+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61973c0 con 0x562ba6193800 2024-09-12T02:04:49.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.025+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v117'138 uv138 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.025+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6197380 con 0x562ba6193800 2024-09-12T02:04:49.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.026+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v117'139 uv139 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.026+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba6196370 con 0x562ba6193800 2024-09-12T02:04:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.028+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v117'140 uv140 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.028+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x562ba6196c40 0x562ba61970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.028+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61997d0 con 0x562ba6196c40 2024-09-12T02:04:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.028+0000 7f5eb32af640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x562ba6196c40 0x562ba61970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.028+0000 7f5eb32af640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x562ba6196c40 0x562ba61970d0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.029+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v117'100 uv99 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.029+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba6199b70 con 0x562ba6196c40 2024-09-12T02:04:49.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.031+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v117'101 uv101 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.031+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619a000 con 0x562ba6196c40 2024-09-12T02:04:49.032 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:04:49.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.032+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v117'102 uv102 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.032+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619a8c0 con 0x562ba6196c40 2024-09-12T02:04:49.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.033+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v117'103 uv103 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.033+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562ba619b170 0x562ba619d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.033+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619daa0 con 0x562ba619b170 2024-09-12T02:04:49.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.033+0000 7f5eb2aae640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562ba619b170 0x562ba619d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.034+0000 7f5eb2aae640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562ba619b170 0x562ba619d560 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.035+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v117'135 uv134 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.035+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba619db20 con 0x562ba619b170 2024-09-12T02:04:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.036+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v117'136 uv136 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.036+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619df40 con 0x562ba619b170 2024-09-12T02:04:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.037+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v117'137 uv137 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.037 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:04:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.037+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ef50 con 0x562ba619b170 2024-09-12T02:04:49.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.038+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v117'138 uv138 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.038+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ef50 con 0x562ba619b170 2024-09-12T02:04:49.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.039+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v117'139 uv139 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.039+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619df40 con 0x562ba619b170 2024-09-12T02:04:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.040+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v117'140 uv140 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.040+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619df40 con 0x562ba6196c40 2024-09-12T02:04:49.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.042+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v117'249 uv243 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.042+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba619e2e0 con 0x562ba6196c40 2024-09-12T02:04:49.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.043+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v117'250 uv250 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.043+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619e680 con 0x562ba6196c40 2024-09-12T02:04:49.044 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:04:49.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.044+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v117'251 uv251 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.044+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619fa80 con 0x562ba6196c40 2024-09-12T02:04:49.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.045+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v117'252 uv252 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.045+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619fa80 con 0x562ba6196c40 2024-09-12T02:04:49.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.046+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v117'253 uv253 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.046+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba6196c40 2024-09-12T02:04:49.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.048+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v117'254 uv254 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.048+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba6196c40 2024-09-12T02:04:49.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.049+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v117'255 uv248 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.049+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba6196c40 2024-09-12T02:04:49.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.050+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v117'256 uv256 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.050+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba6196c40 2024-09-12T02:04:49.051 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:04:49.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.051+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v117'257 uv257 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.051+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba6196c40 2024-09-12T02:04:49.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.052+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v117'258 uv258 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.052+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba6196c40 2024-09-12T02:04:49.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.053+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v117'259 uv259 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.053+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba6196c40 2024-09-12T02:04:49.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.054+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v117'112 uv111 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.054+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea60 con 0x562ba6196c40 2024-09-12T02:04:49.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.055+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v117'113 uv113 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.055+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba6196c40 2024-09-12T02:04:49.057 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:04:49.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.056+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v117'114 uv114 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.056+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba6196c40 2024-09-12T02:04:49.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.058+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v117'115 uv115 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.058+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba6196c40 2024-09-12T02:04:49.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.059+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v117'116 uv116 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5eac098870 con 0x562ba6196c40 2024-09-12T02:04:49.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.059+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba619b170 2024-09-12T02:04:49.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.060+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v117'135 uv134 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.060+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba619b170 2024-09-12T02:04:49.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.061+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v117'136 uv136 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.061+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba619b170 2024-09-12T02:04:49.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.062+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v117'137 uv137 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.063 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:04:49.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.062+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba619b170 2024-09-12T02:04:49.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.063+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v117'138 uv138 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.063+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba619b170 2024-09-12T02:04:49.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.064+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v117'139 uv139 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.064+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba619b170 2024-09-12T02:04:49.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.065+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v117'140 uv140 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.065+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba619b170 2024-09-12T02:04:49.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.066+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v117'223 uv217 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.066+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba619b170 2024-09-12T02:04:49.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.067+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v117'224 uv224 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.067+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619ea20 con 0x562ba619b170 2024-09-12T02:04:49.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.068+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v117'225 uv225 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.069 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:04:49.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.068+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619eea0 con 0x562ba619b170 2024-09-12T02:04:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.069+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v117'226 uv226 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.069+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619eea0 con 0x562ba619b170 2024-09-12T02:04:49.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.071+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v117'227 uv227 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.071+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619eea0 con 0x562ba619b170 2024-09-12T02:04:49.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.072+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v117'228 uv222 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.072+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba619eea0 con 0x562ba619b170 2024-09-12T02:04:49.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.073+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v117'229 uv229 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.073+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619eea0 con 0x562ba619b170 2024-09-12T02:04:49.074 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:04:49.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.074+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v117'230 uv230 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.074+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619eea0 con 0x562ba619b170 2024-09-12T02:04:49.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.075+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v117'231 uv231 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.075+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba619f350 con 0x562ba619b170 2024-09-12T02:04:49.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.077+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v117'232 uv232 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.077+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x562ba619fa10 0x562ba61a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.077+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba619fa10 2024-09-12T02:04:49.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.077+0000 7f5eb22ad640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x562ba619fa10 0x562ba61a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.077+0000 7f5eb22ad640 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x562ba619fa10 0x562ba61a1e50 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:49.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.078+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v117'99 uv98 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba619fa10 2024-09-12T02:04:49.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.078+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba619fa10 2024-09-12T02:04:49.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.079+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v117'100 uv100 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba619fa10 2024-09-12T02:04:49.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.079+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba619fa10 2024-09-12T02:04:49.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.080+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v117'101 uv101 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba619fa10 2024-09-12T02:04:49.081 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:04:49.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.080+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba619fa10 2024-09-12T02:04:49.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.083+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v117'102 uv102 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba619fa10 2024-09-12T02:04:49.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.083+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba619b170 2024-09-12T02:04:49.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.084+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v117'135 uv134 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.084+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba619b170 2024-09-12T02:04:49.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.086+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v117'136 uv136 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.086+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba619b170 2024-09-12T02:04:49.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.087+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v117'137 uv137 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.087 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:04:49.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.087+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a33a0 con 0x562ba619b170 2024-09-12T02:04:49.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.088+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v117'138 uv138 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.088+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a33a0 con 0x562ba619b170 2024-09-12T02:04:49.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.089+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v117'139 uv139 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.089+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba619b170 2024-09-12T02:04:49.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.090+0000 7f5eb2aae640 1 -- 172.21.15.19:0/3033168202 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v117'140 uv140 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea40089e0 con 0x562ba619b170 2024-09-12T02:04:49.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.090+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba6193800 2024-09-12T02:04:49.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.091+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v117'115 uv114 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.091+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba6193800 2024-09-12T02:04:49.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.092+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v117'116 uv116 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.092+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba6193800 2024-09-12T02:04:49.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.093+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v117'117 uv117 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.094 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:04:49.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.093+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba6193800 2024-09-12T02:04:49.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.094+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v117'118 uv118 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.094+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba6193800 2024-09-12T02:04:49.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.095+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v117'119 uv119 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.095+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba6193800 2024-09-12T02:04:49.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.097+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v117'278 uv277 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.097+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba6193800 2024-09-12T02:04:49.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.098+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v117'279 uv279 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.098+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba6193800 2024-09-12T02:04:49.099 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:04:49.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.099+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v117'280 uv280 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.099+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba6193800 2024-09-12T02:04:49.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.100+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v117'281 uv281 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.100+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba6193800 2024-09-12T02:04:49.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.101+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v117'282 uv282 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.101+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba6193800 2024-09-12T02:04:49.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.102+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v117'283 uv276 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.102+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba6193800 2024-09-12T02:04:49.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.103+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v117'284 uv284 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.103+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba6193800 2024-09-12T02:04:49.104 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:04:49.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.104+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v117'285 uv285 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.104+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a33a0 con 0x562ba6193800 2024-09-12T02:04:49.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.105+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v117'286 uv286 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.105+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a33a0 con 0x562ba6193800 2024-09-12T02:04:49.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.106+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v117'287 uv287 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.106+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2390 con 0x562ba6193800 2024-09-12T02:04:49.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.107+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v117'288 uv288 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.107+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x562ba61a2780 con 0x562ba6193800 2024-09-12T02:04:49.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb22ad640 1 -- 172.21.15.19:0/3033168202 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v117'289 uv289 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5ea800d830 con 0x562ba6193800 2024-09-12T02:04:49.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562ba618e660 msgr2=0x562ba6190a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562ba618e660 0x562ba6190a50 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562ba60d1db0 msgr2=0x562ba6180ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562ba60d1db0 0x562ba6180ac0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x562ba6196c40 msgr2=0x562ba61970d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x562ba6196c40 0x562ba61970d0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x562ba619fa10 msgr2=0x562ba61a1e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x562ba619fa10 0x562ba61a1e50 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x562ba6193800 msgr2=0x562ba6193c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x562ba6193800 0x562ba6193c80 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562ba619b170 msgr2=0x562ba619d560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562ba619b170 0x562ba619d560 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 reap_dead start 2024-09-12T02:04:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 reap_dead start 2024-09-12T02:04:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb32af640 1 -- 172.21.15.19:0/3033168202 reap_dead start 2024-09-12T02:04:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5ea006a810 msgr2=0x7f5ea006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5ea006a810 0x7f5ea006ccd0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4005fd0 tx=0x7f5ea4005b80 comp rx=0 tx=0).stop 2024-09-12T02:04:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ba60d3ba0 msgr2=0x562ba60ce900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ba60d3ba0 0x562ba60ce900 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00a190 tx=0x7f5eac003330 comp rx=0 tx=0).stop 2024-09-12T02:04:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 shutdown_connections 2024-09-12T02:04:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5ea006a810 0x7f5ea006ccd0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 --2- 172.21.15.19:0/3033168202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ba60d3ba0 0x562ba60ce900 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 >> 172.21.15.19:0/3033168202 conn(0x562ba6013ad0 msgr2=0x562ba6057550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 shutdown_connections 2024-09-12T02:04:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.108+0000 7f5eb4fb8f40 1 -- 172.21.15.19:0/3033168202 wait complete. 2024-09-12T02:04:49.112 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate 1.00000000.inode 0 2024-09-12T02:04:49.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.157+0000 7ff8aed09f40 1 Processor -- start 2024-09-12T02:04:49.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.157+0000 7ff8aed09f40 1 -- start start 2024-09-12T02:04:49.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.157+0000 7ff8aed09f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557256d99350 0x557256dc6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.157+0000 7ff8aed09f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557256dc7050 0x557256f00080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.157+0000 7ff8aed09f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557256e51080 0x557256f005c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.157+0000 7ff8aed09f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557256d95ae0 con 0x557256e51080 2024-09-12T02:04:49.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.157+0000 7ff8aed09f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557256ce8510 con 0x557256d99350 2024-09-12T02:04:49.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.157+0000 7ff8aed09f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x557256d95dc0 con 0x557256dc7050 2024-09-12T02:04:49.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.157+0000 7ff8ad000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557256e51080 0x557256f005c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.157+0000 7ff8ad000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557256e51080 0x557256f005c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59600/0 (socket says 172.21.15.19:59600) 2024-09-12T02:04:49.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.157+0000 7ff8ad000640 1 -- 172.21.15.19:0/2546026138 learned_addr learned my addr 172.21.15.19:0/2546026138 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:49.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.157+0000 7ff8ac7ff640 1 --2- 172.21.15.19:0/2546026138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557256d99350 0x557256dc6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.157+0000 7ff8abffe640 1 --2- 172.21.15.19:0/2546026138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557256dc7050 0x557256f00080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.158+0000 7ff8ad000640 1 -- 172.21.15.19:0/2546026138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557256dc7050 msgr2=0x557256f00080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.158+0000 7ff8ad000640 1 --2- 172.21.15.19:0/2546026138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557256dc7050 0x557256f00080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.158+0000 7ff8ad000640 1 -- 172.21.15.19:0/2546026138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557256d99350 msgr2=0x557256dc6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.158+0000 7ff8ad000640 1 --2- 172.21.15.19:0/2546026138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557256d99350 0x557256dc6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.158+0000 7ff8ad000640 1 -- 172.21.15.19:0/2546026138 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557256e56670 con 0x557256e51080 2024-09-12T02:04:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.158+0000 7ff8ad000640 1 --2- 172.21.15.19:0/2546026138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557256e51080 0x557256f005c0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40098b0 tx=0x7ff8a4005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5009054dc0bb66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.158+0000 7ff8aaffc640 1 -- 172.21.15.19:0/2546026138 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4008930 con 0x557256e51080 2024-09-12T02:04:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.158+0000 7ff8aaffc640 1 -- 172.21.15.19:0/2546026138 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a4008ad0 con 0x557256e51080 2024-09-12T02:04:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.158+0000 7ff8aaffc640 1 -- 172.21.15.19:0/2546026138 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4013420 con 0x557256e51080 2024-09-12T02:04:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.159+0000 7ff8aed09f40 1 -- 172.21.15.19:0/2546026138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557256e51080 msgr2=0x557256f005c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.159+0000 7ff8aed09f40 1 --2- 172.21.15.19:0/2546026138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557256e51080 0x557256f005c0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40098b0 tx=0x7ff8a4005a00 comp rx=0 tx=0).stop 2024-09-12T02:04:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.159+0000 7ff8aed09f40 1 -- 172.21.15.19:0/2546026138 shutdown_connections 2024-09-12T02:04:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.159+0000 7ff8aed09f40 1 --2- 172.21.15.19:0/2546026138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557256e51080 0x557256f005c0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.159+0000 7ff8aed09f40 1 --2- 172.21.15.19:0/2546026138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557256dc7050 0x557256f00080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.159+0000 7ff8aed09f40 1 --2- 172.21.15.19:0/2546026138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557256d99350 0x557256dc6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.159+0000 7ff8aed09f40 1 -- 172.21.15.19:0/2546026138 >> 172.21.15.19:0/2546026138 conn(0x557256d969e0 msgr2=0x557256d94e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:49.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.159+0000 7ff8aed09f40 1 -- 172.21.15.19:0/2546026138 shutdown_connections 2024-09-12T02:04:49.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.159+0000 7ff8aed09f40 1 -- 172.21.15.19:0/2546026138 wait complete. 2024-09-12T02:04:49.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.159+0000 7ff8aed09f40 1 Processor -- start 2024-09-12T02:04:49.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.159+0000 7ff8aed09f40 1 -- start start 2024-09-12T02:04:49.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.160+0000 7ff8aed09f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557256d99350 0x557256e4ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.160+0000 7ff8aed09f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557256dc7050 0x557256dc51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.160+0000 7ff8aed09f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557256e51080 0x557256f07da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.160+0000 7ff8aed09f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557256e56aa0 con 0x557256d99350 2024-09-12T02:04:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.160+0000 7ff8aed09f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557256d990e0 con 0x557256e51080 2024-09-12T02:04:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.160+0000 7ff8aed09f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x557256e71060 con 0x557256dc7050 2024-09-12T02:04:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.160+0000 7ff8ac7ff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557256d99350 0x557256e4ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.160+0000 7ff8ac7ff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557256d99350 0x557256e4ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59616/0 (socket says 172.21.15.19:59616) 2024-09-12T02:04:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.160+0000 7ff8ac7ff640 1 -- 172.21.15.19:0/591897078 learned_addr learned my addr 172.21.15.19:0/591897078 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.160+0000 7ff8ad000640 1 --2- 172.21.15.19:0/591897078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557256e51080 0x557256f07da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.160+0000 7ff8abffe640 1 --2- 172.21.15.19:0/591897078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557256dc7050 0x557256dc51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.160+0000 7ff8ac7ff640 1 -- 172.21.15.19:0/591897078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557256dc7050 msgr2=0x557256dc51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.160+0000 7ff8ac7ff640 1 --2- 172.21.15.19:0/591897078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557256dc7050 0x557256dc51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.160+0000 7ff8ac7ff640 1 -- 172.21.15.19:0/591897078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557256e51080 msgr2=0x557256f07da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.160+0000 7ff8ac7ff640 1 --2- 172.21.15.19:0/591897078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557256e51080 0x557256f07da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.160+0000 7ff8ac7ff640 1 -- 172.21.15.19:0/591897078 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557256e57870 con 0x557256d99350 2024-09-12T02:04:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.161+0000 7ff8ac7ff640 1 --2- 172.21.15.19:0/591897078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557256d99350 0x557256e4ed10 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00a4a0 tx=0x7ff89c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.161+0000 7ff8a9ffa640 1 -- 172.21.15.19:0/591897078 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c063480 con 0x557256d99350 2024-09-12T02:04:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.161+0000 7ff8a9ffa640 1 -- 172.21.15.19:0/591897078 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff89c068070 con 0x557256d99350 2024-09-12T02:04:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.161+0000 7ff8aed09f40 1 -- 172.21.15.19:0/591897078 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557256e57b50 con 0x557256d99350 2024-09-12T02:04:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.161+0000 7ff8a9ffa640 1 -- 172.21.15.19:0/591897078 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c063840 con 0x557256d99350 2024-09-12T02:04:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.161+0000 7ff8aed09f40 1 -- 172.21.15.19:0/591897078 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557256e53af0 con 0x557256d99350 2024-09-12T02:04:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.162+0000 7ff8a9ffa640 1 -- 172.21.15.19:0/591897078 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff89c061050 con 0x557256d99350 2024-09-12T02:04:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.163+0000 7ff8a9ffa640 1 --2- 172.21.15.19:0/591897078 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff88c06a810 0x7ff88c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.163+0000 7ff8a9ffa640 1 -- 172.21.15.19:0/591897078 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8195+0+0 (secure 0 0 0) 0x7ff89c0ce680 con 0x557256d99350 2024-09-12T02:04:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.163+0000 7ff8abffe640 1 --2- 172.21.15.19:0/591897078 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff88c06a810 0x7ff88c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.163+0000 7ff8aed09f40 1 --2- 172.21.15.19:0/591897078 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x557256e542d0 0x557256f0f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.163+0000 7ff8aed09f40 1 -- 172.21.15.19:0/591897078 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:1 13.14 13:287034c4:::1.00000000.inode:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x557256dc65b0 con 0x557256e542d0 2024-09-12T02:04:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.163+0000 7ff8ad000640 1 --2- 172.21.15.19:0/591897078 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x557256e542d0 0x557256f0f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.163+0000 7ff8abffe640 1 --2- 172.21.15.19:0/591897078 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff88c06a810 0x7ff88c06ccd0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x557256dc3360 tx=0x7ff8940017f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.164+0000 7ff8ad000640 1 --2- 172.21.15.19:0/591897078 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x557256e542d0 0x557256f0f060 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.165+0000 7ff8ad000640 1 -- 172.21.15.19:0/591897078 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(1 1.00000000.inode [truncate 0] v117'527 uv527 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ff8a4008c80 con 0x557256e542d0 2024-09-12T02:04:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.165+0000 7ff8aed09f40 1 -- 172.21.15.19:0/591897078 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x557256e542d0 msgr2=0x557256f0f060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.165+0000 7ff8aed09f40 1 --2- 172.21.15.19:0/591897078 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x557256e542d0 0x557256f0f060 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.165+0000 7ff8aed09f40 1 -- 172.21.15.19:0/591897078 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff88c06a810 msgr2=0x7ff88c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.165+0000 7ff8aed09f40 1 --2- 172.21.15.19:0/591897078 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff88c06a810 0x7ff88c06ccd0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x557256dc3360 tx=0x7ff8940017f0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.165+0000 7ff8aed09f40 1 -- 172.21.15.19:0/591897078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557256d99350 msgr2=0x557256e4ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.165+0000 7ff8aed09f40 1 --2- 172.21.15.19:0/591897078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557256d99350 0x557256e4ed10 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00a4a0 tx=0x7ff89c003330 comp rx=0 tx=0).stop 2024-09-12T02:04:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.165+0000 7ff8ad000640 1 -- 172.21.15.19:0/591897078 reap_dead start 2024-09-12T02:04:49.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.165+0000 7ff8aed09f40 1 -- 172.21.15.19:0/591897078 shutdown_connections 2024-09-12T02:04:49.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.165+0000 7ff8aed09f40 1 -- 172.21.15.19:0/591897078 >> 172.21.15.19:0/591897078 conn(0x557256d969e0 msgr2=0x557256ddc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:49.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.165+0000 7ff8aed09f40 1 -- 172.21.15.19:0/591897078 shutdown_connections 2024-09-12T02:04:49.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.165+0000 7ff8aed09f40 1 -- 172.21.15.19:0/591897078 wait complete. 2024-09-12T02:04:49.170 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:04:49.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.274+0000 7f37e22e6640 1 Processor -- start 2024-09-12T02:04:49.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.274+0000 7f37e22e6640 1 -- start start 2024-09-12T02:04:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.275+0000 7f37e22e6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f37dc0b5f80 0x7f37dc162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.275+0000 7f37e22e6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37dc0d4c10 0x7f37dc0b6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.275+0000 7f37e22e6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37dc0d3320 0x7f37dc0d37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.275+0000 7f37e22e6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f37dc0d5420 con 0x7f37dc0d4c10 2024-09-12T02:04:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.275+0000 7f37e22e6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f37dc0d2e90 con 0x7f37dc0b5f80 2024-09-12T02:04:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.275+0000 7f37e22e6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f37dc0d2600 con 0x7f37dc0d3320 2024-09-12T02:04:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.275+0000 7f37db7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37dc0d4c10 0x7f37dc0b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.275+0000 7f37db7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37dc0d4c10 0x7f37dc0b6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59618/0 (socket says 172.21.15.19:59618) 2024-09-12T02:04:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.275+0000 7f37db7fe640 1 -- 172.21.15.19:0/2832488626 learned_addr learned my addr 172.21.15.19:0/2832488626 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.276+0000 7f37dbfff640 1 --2- 172.21.15.19:0/2832488626 >> v2:172.21.15.135:3300/0 conn(0x7f37dc0b5f80 0x7f37dc162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.276+0000 7f37e0883640 1 --2- 172.21.15.19:0/2832488626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37dc0d3320 0x7f37dc0d37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.276+0000 7f37db7fe640 1 -- 172.21.15.19:0/2832488626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37dc0d3320 msgr2=0x7f37dc0d37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.276+0000 7f37db7fe640 1 --2- 172.21.15.19:0/2832488626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37dc0d3320 0x7f37dc0d37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.276+0000 7f37db7fe640 1 -- 172.21.15.19:0/2832488626 >> v2:172.21.15.135:3300/0 conn(0x7f37dc0b5f80 msgr2=0x7f37dc162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.276+0000 7f37db7fe640 1 --2- 172.21.15.19:0/2832488626 >> v2:172.21.15.135:3300/0 conn(0x7f37dc0b5f80 0x7f37dc162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.276+0000 7f37db7fe640 1 -- 172.21.15.19:0/2832488626 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc0b3c10 con 0x7f37dc0d4c10 2024-09-12T02:04:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.276+0000 7f37db7fe640 1 --2- 172.21.15.19:0/2832488626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc0d4c10 0x7f37dc0b6360 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f37d0009870 tx=0x7f37d002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705a084c8c47471a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.277+0000 7f37daffd640 1 -- 172.21.15.19:0/2832488626 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0037070 con 0x7f37dc0d4c10 2024-09-12T02:04:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.277+0000 7f37daffd640 1 -- 172.21.15.19:0/2832488626 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d0032440 con 0x7f37dc0d4c10 2024-09-12T02:04:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.277+0000 7f37daffd640 1 -- 172.21.15.19:0/2832488626 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0032810 con 0x7f37dc0d4c10 2024-09-12T02:04:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.277+0000 7f37e22e6640 1 -- 172.21.15.19:0/2832488626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc0d4c10 msgr2=0x7f37dc0b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.277+0000 7f37e22e6640 1 --2- 172.21.15.19:0/2832488626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc0d4c10 0x7f37dc0b6360 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f37d0009870 tx=0x7f37d002a210 comp rx=0 tx=0).stop 2024-09-12T02:04:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.277+0000 7f37e22e6640 1 -- 172.21.15.19:0/2832488626 shutdown_connections 2024-09-12T02:04:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.277+0000 7f37e22e6640 1 --2- 172.21.15.19:0/2832488626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37dc0d3320 0x7f37dc0d37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.277+0000 7f37e22e6640 1 --2- 172.21.15.19:0/2832488626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc0d4c10 0x7f37dc0b6360 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.277+0000 7f37e22e6640 1 --2- 172.21.15.19:0/2832488626 >> v2:172.21.15.135:3300/0 conn(0x7f37dc0b5f80 0x7f37dc162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.277+0000 7f37e22e6640 1 -- 172.21.15.19:0/2832488626 >> 172.21.15.19:0/2832488626 conn(0x7f37dc08bfc0 msgr2=0x7f37dc0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.277+0000 7f37e22e6640 1 -- 172.21.15.19:0/2832488626 shutdown_connections 2024-09-12T02:04:49.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.277+0000 7f37e22e6640 1 -- 172.21.15.19:0/2832488626 wait complete. 2024-09-12T02:04:49.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.278+0000 7f37e22e6640 1 Processor -- start 2024-09-12T02:04:49.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.279+0000 7f37e22e6640 1 -- start start 2024-09-12T02:04:49.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.279+0000 7f37e22e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc0b5f80 0x7f37dc1f5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.279+0000 7f37e22e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37dc0d3320 0x7f37dc1545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.279+0000 7f37e22e6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37dc0d4c10 0x7f37dc0b9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.279+0000 7f37e22e6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc0d5140 con 0x7f37dc0b5f80 2024-09-12T02:04:49.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.279+0000 7f37e22e6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc0d2880 con 0x7f37dc0d3320 2024-09-12T02:04:49.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.279+0000 7f37e22e6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f37dc0d2b20 con 0x7f37dc0d4c10 2024-09-12T02:04:49.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.279+0000 7f37dbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc0b5f80 0x7f37dc1f5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.279+0000 7f37dbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc0b5f80 0x7f37dc1f5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59622/0 (socket says 172.21.15.19:59622) 2024-09-12T02:04:49.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.279+0000 7f37dbfff640 1 -- 172.21.15.19:0/609675827 learned_addr learned my addr 172.21.15.19:0/609675827 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:49.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.279+0000 7f37db7fe640 1 --2- 172.21.15.19:0/609675827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37dc0d3320 0x7f37dc1545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.279+0000 7f37e0883640 1 --2- 172.21.15.19:0/609675827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37dc0d4c10 0x7f37dc0b9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.280+0000 7f37dbfff640 1 -- 172.21.15.19:0/609675827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37dc0d4c10 msgr2=0x7f37dc0b9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.280+0000 7f37dbfff640 1 --2- 172.21.15.19:0/609675827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37dc0d4c10 0x7f37dc0b9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.280+0000 7f37dbfff640 1 -- 172.21.15.19:0/609675827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37dc0d3320 msgr2=0x7f37dc1545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.280+0000 7f37dbfff640 1 --2- 172.21.15.19:0/609675827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37dc0d3320 0x7f37dc1545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.280+0000 7f37dbfff640 1 -- 172.21.15.19:0/609675827 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc1f5680 con 0x7f37dc0b5f80 2024-09-12T02:04:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.280+0000 7f37dbfff640 1 --2- 172.21.15.19:0/609675827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc0b5f80 0x7f37dc1f5140 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00d800 tx=0x7f37cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.280+0000 7f37d8ff9640 1 -- 172.21.15.19:0/609675827 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc018020 con 0x7f37dc0b5f80 2024-09-12T02:04:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.280+0000 7f37d8ff9640 1 -- 172.21.15.19:0/609675827 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37cc0096a0 con 0x7f37dc0b5f80 2024-09-12T02:04:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.280+0000 7f37e22e6640 1 -- 172.21.15.19:0/609675827 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37dc0b89d0 con 0x7f37dc0b5f80 2024-09-12T02:04:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.280+0000 7f37d8ff9640 1 -- 172.21.15.19:0/609675827 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc009a70 con 0x7f37dc0b5f80 2024-09-12T02:04:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.280+0000 7f37e22e6640 1 -- 172.21.15.19:0/609675827 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37dc0b8c70 con 0x7f37dc0b5f80 2024-09-12T02:04:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.281+0000 7f37e22e6640 1 -- 172.21.15.19:0/609675827 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37dc0d37b0 con 0x7f37dc0b5f80 2024-09-12T02:04:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.282+0000 7f37d8ff9640 1 -- 172.21.15.19:0/609675827 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f37cc01b020 con 0x7f37dc0b5f80 2024-09-12T02:04:49.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.282+0000 7f37d8ff9640 1 --2- 172.21.15.19:0/609675827 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f37c806be30 0x7f37c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:49.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.282+0000 7f37d8ff9640 1 -- 172.21.15.19:0/609675827 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8195+0+0 (secure 0 0 0) 0x7f37cc08bc90 con 0x7f37dc0b5f80 2024-09-12T02:04:49.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.282+0000 7f37db7fe640 1 --2- 172.21.15.19:0/609675827 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f37c806be30 0x7f37c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:49.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.283+0000 7f37db7fe640 1 --2- 172.21.15.19:0/609675827 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f37c806be30 0x7f37c806e2f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f37d0034000 tx=0x7f37d002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:49.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.286+0000 7f37d8ff9640 1 -- 172.21.15.19:0/609675827 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37cc022020 con 0x7f37dc0b5f80 2024-09-12T02:04:49.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.498+0000 7f37e22e6640 1 -- 172.21.15.19:0/609675827 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f37dc06dae0 con 0x7f37dc0b5f80 2024-09-12T02:04:49.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.894+0000 7f37d8ff9640 1 -- 172.21.15.19:0/609675827 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v214) ==== 162+0+0 (secure 0 0 0) 0x7f37dc1f5680 con 0x7f37dc0b5f80 2024-09-12T02:04:49.902 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:04:49.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.896+0000 7f37e22e6640 1 -- 172.21.15.19:0/609675827 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f37c806be30 msgr2=0x7f37c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.896+0000 7f37e22e6640 1 --2- 172.21.15.19:0/609675827 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f37c806be30 0x7f37c806e2f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f37d0034000 tx=0x7f37d002e000 comp rx=0 tx=0).stop 2024-09-12T02:04:49.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.896+0000 7f37e22e6640 1 -- 172.21.15.19:0/609675827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc0b5f80 msgr2=0x7f37dc1f5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.896+0000 7f37e22e6640 1 --2- 172.21.15.19:0/609675827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc0b5f80 0x7f37dc1f5140 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00d800 tx=0x7f37cc00dcc0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.896+0000 7f37e22e6640 1 -- 172.21.15.19:0/609675827 shutdown_connections 2024-09-12T02:04:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.896+0000 7f37e22e6640 1 --2- 172.21.15.19:0/609675827 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f37c806be30 0x7f37c806e2f0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.896+0000 7f37e22e6640 1 --2- 172.21.15.19:0/609675827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37dc0d4c10 0x7f37dc0b9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.896+0000 7f37e22e6640 1 --2- 172.21.15.19:0/609675827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37dc0d3320 0x7f37dc1545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.896+0000 7f37e22e6640 1 --2- 172.21.15.19:0/609675827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc0b5f80 0x7f37dc1f5140 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.896+0000 7f37e22e6640 1 -- 172.21.15.19:0/609675827 >> 172.21.15.19:0/609675827 conn(0x7f37dc08bfc0 msgr2=0x7f37dc160e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.896+0000 7f37e22e6640 1 -- 172.21.15.19:0/609675827 shutdown_connections 2024-09-12T02:04:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:49.896+0000 7f37e22e6640 1 -- 172.21.15.19:0/609675827 wait complete. 2024-09-12T02:04:49.906 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:04:49.906+0000 7f10c51f7640 -1 mds.0.cache.ino(0x1) No data while reading inode 0x1 2024-09-12T02:04:49.906 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:04:49.906+0000 7f10c51f7640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2024-09-12T02:04:49.906 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:49.906+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:04:49.906 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:49.906+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:04:49.912 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:50.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.015+0000 7ff52d43c640 1 Processor -- start 2024-09-12T02:04:50.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.015+0000 7ff52d43c640 1 -- start start 2024-09-12T02:04:50.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.016+0000 7ff52d43c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff52806f8d0 0x7ff528165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.016+0000 7ff52d43c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5280cdbe0 con 0x7ff52815b300 2024-09-12T02:04:50.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.016+0000 7ff52d43c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5280cd900 con 0x7ff528072d30 2024-09-12T02:04:50.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.016+0000 7ff52d43c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff5280728a0 con 0x7ff52806f8d0 2024-09-12T02:04:50.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.016+0000 7ff526ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff52815b300 0x7ff5280cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41970/0 (socket says 172.21.15.19:41970) 2024-09-12T02:04:50.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.016+0000 7ff526ffd640 1 -- 172.21.15.19:0/515115307 learned_addr learned my addr 172.21.15.19:0/515115307 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:50.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.016+0000 7ff5277fe640 1 --2- 172.21.15.19:0/515115307 >> v2:172.21.15.135:3300/0 conn(0x7ff52806f8d0 0x7ff528165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.016+0000 7ff525ffb640 1 -- 172.21.15.19:0/515115307 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158902390 0 0) 0x7ff5280cdbe0 con 0x7ff52815b300 2024-09-12T02:04:50.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.016+0000 7ff525ffb640 1 -- 172.21.15.19:0/515115307 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff514003520 con 0x7ff52815b300 2024-09-12T02:04:50.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff525ffb640 1 -- 172.21.15.19:0/515115307 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2878710397 0 0) 0x7ff514003520 con 0x7ff52815b300 2024-09-12T02:04:50.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff525ffb640 1 -- 172.21.15.19:0/515115307 >> v2:172.21.15.135:3300/0 conn(0x7ff52806f8d0 msgr2=0x7ff528165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:50.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff525ffb640 1 --2- 172.21.15.19:0/515115307 >> v2:172.21.15.135:3300/0 conn(0x7ff52806f8d0 0x7ff528165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff525ffb640 1 -- 172.21.15.19:0/515115307 >> v1:172.21.15.135:6789/0 conn(0x7ff528072d30 legacy=0x7ff52806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff525ffb640 1 -- 172.21.15.19:0/515115307 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff528072250 con 0x7ff52815b300 2024-09-12T02:04:50.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff525ffb640 1 -- 172.21.15.19:0/515115307 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7ff518001670 con 0x7ff52815b300 2024-09-12T02:04:50.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff525ffb640 1 -- 172.21.15.19:0/515115307 >> v1:172.21.15.19:6789/0 conn(0x7ff52815b300 legacy=0x7ff5280cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff525ffb640 1 --2- 172.21.15.19:0/515115307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff514003a00 0x7ff514003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff525ffb640 1 --2- 172.21.15.19:0/515115307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff514004800 0x7ff514004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff525ffb640 1 --2- 172.21.15.19:0/515115307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff514005210 0x7ff51400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff525ffb640 1 -- 172.21.15.19:0/515115307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff5280728a0 con 0x7ff514004800 2024-09-12T02:04:50.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff525ffb640 1 -- 172.21.15.19:0/515115307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff51400c160 con 0x7ff514005210 2024-09-12T02:04:50.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff525ffb640 1 -- 172.21.15.19:0/515115307 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff51400c360 con 0x7ff514003a00 2024-09-12T02:04:50.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff5267fc640 1 --2- 172.21.15.19:0/515115307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff514004800 0x7ff514004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff526ffd640 1 --2- 172.21.15.19:0/515115307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff514003a00 0x7ff514003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff5277fe640 1 --2- 172.21.15.19:0/515115307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff514005210 0x7ff51400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff5267fc640 1 -- 172.21.15.19:0/515115307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff514003a00 msgr2=0x7ff514003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:50.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff5267fc640 1 --2- 172.21.15.19:0/515115307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff514003a00 0x7ff514003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff5267fc640 1 -- 172.21.15.19:0/515115307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff514005210 msgr2=0x7ff51400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:50.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff5267fc640 1 --2- 172.21.15.19:0/515115307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff514005210 0x7ff51400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff5267fc640 1 -- 172.21.15.19:0/515115307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff514003520 con 0x7ff514004800 2024-09-12T02:04:50.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff5277fe640 1 -- 172.21.15.19:0/515115307 reap_dead start 2024-09-12T02:04:50.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.017+0000 7ff526ffd640 1 --2- 172.21.15.19:0/515115307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff514003a00 0x7ff514003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:50.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.018+0000 7ff5267fc640 1 --2- 172.21.15.19:0/515115307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff514004800 0x7ff514004c80 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7ff510001720 tx=0x7ff514005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f694f371805427 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:50.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.018+0000 7ff525ffb640 1 -- 172.21.15.19:0/515115307 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff510001370 con 0x7ff514004800 2024-09-12T02:04:50.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.018+0000 7ff525ffb640 1 -- 172.21.15.19:0/515115307 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5100052d0 con 0x7ff514004800 2024-09-12T02:04:50.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.018+0000 7ff525ffb640 1 -- 172.21.15.19:0/515115307 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51002ab90 con 0x7ff514004800 2024-09-12T02:04:50.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.019+0000 7ff52d43c640 1 -- 172.21.15.19:0/515115307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff514004800 msgr2=0x7ff514004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.019+0000 7ff52d43c640 1 --2- 172.21.15.19:0/515115307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff514004800 0x7ff514004c80 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7ff510001720 tx=0x7ff514005830 comp rx=0 tx=0).stop 2024-09-12T02:04:50.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.019+0000 7ff52d43c640 1 -- 172.21.15.19:0/515115307 shutdown_connections 2024-09-12T02:04:50.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.019+0000 7ff52d43c640 1 --2- 172.21.15.19:0/515115307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff514004800 0x7ff514004c80 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.019+0000 7ff52d43c640 1 -- 172.21.15.19:0/515115307 >> 172.21.15.19:0/515115307 conn(0x7ff528067d70 msgr2=0x7ff52806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:50.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.019+0000 7ff52d43c640 1 -- 172.21.15.19:0/515115307 shutdown_connections 2024-09-12T02:04:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.019+0000 7ff52d43c640 1 -- 172.21.15.19:0/515115307 wait complete. 2024-09-12T02:04:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.020+0000 7ff52d43c640 1 Processor -- start 2024-09-12T02:04:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.020+0000 7ff52d43c640 1 -- start start 2024-09-12T02:04:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.021+0000 7ff52d43c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff514004800 0x7ff52815a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.021+0000 7ff52d43c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff528152420 0x7ff528152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.021+0000 7ff52d43c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff52814ab10 0x7ff52814afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.021+0000 7ff52d43c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff5280d0160 con 0x7ff52814ab10 2024-09-12T02:04:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.021+0000 7ff52d43c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff5280cffe0 con 0x7ff514004800 2024-09-12T02:04:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.021+0000 7ff52d43c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff5280cceb0 con 0x7ff528152420 2024-09-12T02:04:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.021+0000 7ff5277fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff52814ab10 0x7ff52814afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.021+0000 7ff5277fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff52814ab10 0x7ff52814afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59648/0 (socket says 172.21.15.19:59648) 2024-09-12T02:04:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.021+0000 7ff5277fe640 1 -- 172.21.15.19:0/1482749998 learned_addr learned my addr 172.21.15.19:0/1482749998 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.021+0000 7ff526ffd640 1 --2- 172.21.15.19:0/1482749998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff514004800 0x7ff52815a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.021+0000 7ff5267fc640 1 --2- 172.21.15.19:0/1482749998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff528152420 0x7ff528152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.021+0000 7ff5277fe640 1 -- 172.21.15.19:0/1482749998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff528152420 msgr2=0x7ff528152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.021+0000 7ff5277fe640 1 --2- 172.21.15.19:0/1482749998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff528152420 0x7ff528152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.021+0000 7ff5277fe640 1 -- 172.21.15.19:0/1482749998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff514004800 msgr2=0x7ff52815a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.021+0000 7ff5277fe640 1 --2- 172.21.15.19:0/1482749998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff514004800 0x7ff52815a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.021+0000 7ff5277fe640 1 -- 172.21.15.19:0/1482749998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff528159050 con 0x7ff52814ab10 2024-09-12T02:04:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.021+0000 7ff5277fe640 1 --2- 172.21.15.19:0/1482749998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff52814ab10 0x7ff52814afa0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7ff528072810 tx=0x7ff5200115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.022+0000 7ff51f7fe640 1 -- 172.21.15.19:0/1482749998 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff520007e50 con 0x7ff52814ab10 2024-09-12T02:04:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.022+0000 7ff51f7fe640 1 -- 172.21.15.19:0/1482749998 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff52001b070 con 0x7ff52814ab10 2024-09-12T02:04:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.022+0000 7ff52d43c640 1 -- 172.21.15.19:0/1482749998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff528159330 con 0x7ff52814ab10 2024-09-12T02:04:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.022+0000 7ff51f7fe640 1 -- 172.21.15.19:0/1482749998 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff520011de0 con 0x7ff52814ab10 2024-09-12T02:04:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.022+0000 7ff52d43c640 1 -- 172.21.15.19:0/1482749998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5281598f0 con 0x7ff52814ab10 2024-09-12T02:04:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.023+0000 7ff52d43c640 1 -- 172.21.15.19:0/1482749998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5280b2e40 con 0x7ff52814ab10 2024-09-12T02:04:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.023+0000 7ff51f7fe640 1 -- 172.21.15.19:0/1482749998 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff520003990 con 0x7ff52814ab10 2024-09-12T02:04:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.024+0000 7ff51f7fe640 1 --2- 172.21.15.19:0/1482749998 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff50806be60 0x7ff50806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.024+0000 7ff51f7fe640 1 -- 172.21.15.19:0/1482749998 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 8281+0+0 (secure 0 0 0) 0x7ff52008c060 con 0x7ff52814ab10 2024-09-12T02:04:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.024+0000 7ff526ffd640 1 --2- 172.21.15.19:0/1482749998 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff50806be60 0x7ff50806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.024+0000 7ff526ffd640 1 --2- 172.21.15.19:0/1482749998 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff50806be60 0x7ff50806e320 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff518001eb0 tx=0x7ff518007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.028+0000 7ff51f7fe640 1 -- 172.21.15.19:0/1482749998 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5280b2e40 con 0x7ff52814ab10 2024-09-12T02:04:50.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.238+0000 7ff52d43c640 1 -- 172.21.15.19:0/1482749998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5280cd240 con 0x7ff52814ab10 2024-09-12T02:04:50.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.238+0000 7ff51f7fe640 1 -- 172.21.15.19:0/1482749998 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 216 v216) ==== 95+0+3563 (secure 0 0 0) 0x7ff520059f60 con 0x7ff52814ab10 2024-09-12T02:04:50.239 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:50.239 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":216,"btime":"2024-09-12T02:04:49:907742+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":216,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:49.907686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:50.239 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 216 2024-09-12T02:04:50.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.240+0000 7ff52d43c640 1 -- 172.21.15.19:0/1482749998 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff50806be60 msgr2=0x7ff50806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.240+0000 7ff52d43c640 1 --2- 172.21.15.19:0/1482749998 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff50806be60 0x7ff50806e320 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff518001eb0 tx=0x7ff518007040 comp rx=0 tx=0).stop 2024-09-12T02:04:50.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.240+0000 7ff52d43c640 1 -- 172.21.15.19:0/1482749998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff52814ab10 msgr2=0x7ff52814afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.240+0000 7ff52d43c640 1 --2- 172.21.15.19:0/1482749998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff52814ab10 0x7ff52814afa0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7ff528072810 tx=0x7ff5200115a0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.240+0000 7ff52d43c640 1 -- 172.21.15.19:0/1482749998 shutdown_connections 2024-09-12T02:04:50.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.240+0000 7ff52d43c640 1 --2- 172.21.15.19:0/1482749998 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff50806be60 0x7ff50806e320 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.240+0000 7ff52d43c640 1 --2- 172.21.15.19:0/1482749998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff52814ab10 0x7ff52814afa0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.240+0000 7ff52d43c640 1 --2- 172.21.15.19:0/1482749998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff528152420 0x7ff528152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.240+0000 7ff52d43c640 1 --2- 172.21.15.19:0/1482749998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff514004800 0x7ff52815a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.240+0000 7ff52d43c640 1 -- 172.21.15.19:0/1482749998 >> 172.21.15.19:0/1482749998 conn(0x7ff528067d70 msgr2=0x7ff5280b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:50.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.240+0000 7ff52d43c640 1 -- 172.21.15.19:0/1482749998 shutdown_connections 2024-09-12T02:04:50.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.240+0000 7ff52d43c640 1 -- 172.21.15.19:0/1482749998 wait complete. 2024-09-12T02:04:50.252 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:50.252 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:50.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.354+0000 7f014af2a640 1 Processor -- start 2024-09-12T02:04:50.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.354+0000 7f014af2a640 1 -- start start 2024-09-12T02:04:50.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.355+0000 7f014af2a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f014415e760 0x7f014406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.355+0000 7f014af2a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f01440cfcc0 0x7f01440d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.355+0000 7f014af2a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01440d2700 con 0x7f01440d4fd0 2024-09-12T02:04:50.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.355+0000 7f014af2a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f01440cedb0 con 0x7f01440cfcc0 2024-09-12T02:04:50.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.355+0000 7f014af2a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f01440cf090 con 0x7f014415e760 2024-09-12T02:04:50.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.355+0000 7f0148cc6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f014415e760 0x7f014406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.355+0000 7f0148cc6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f014415e760 0x7f014406cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:55598/0 (socket says 172.21.15.19:55598) 2024-09-12T02:04:50.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.355+0000 7f01494c7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f01440cfcc0 0x7f01440d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.355+0000 7f0148cc6640 1 -- 172.21.15.19:0/2793160889 learned_addr learned my addr 172.21.15.19:0/2793160889 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:50.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.355+0000 7f0148cc6640 1 -- 172.21.15.19:0/2793160889 >> v2:172.21.15.135:3300/0 conn(0x7f01440cfcc0 msgr2=0x7f01440d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:50.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.355+0000 7f0148cc6640 1 --2- 172.21.15.19:0/2793160889 >> v2:172.21.15.135:3300/0 conn(0x7f01440cfcc0 0x7f01440d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.355+0000 7f0148cc6640 1 -- 172.21.15.19:0/2793160889 >> v1:172.21.15.135:6789/0 conn(0x7f01440d4fd0 legacy=0x7f01440cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.355+0000 7f0148cc6640 1 -- 172.21.15.19:0/2793160889 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01440b3c80 con 0x7f014415e760 2024-09-12T02:04:50.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.355+0000 7f01494c7640 1 --2- 172.21.15.19:0/2793160889 >> v2:172.21.15.135:3300/0 conn(0x7f01440cfcc0 0x7f01440d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:50.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.355+0000 7f01437fe640 1 -- 172.21.15.19:0/2793160889 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3331986063 0 0) 0x7f0130001160 con 0x7f01440d4fd0 2024-09-12T02:04:50.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.356+0000 7f0148cc6640 1 --2- 172.21.15.19:0/2793160889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f014415e760 0x7f014406cdd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0138009870 tx=0x7f013802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90d3e6514c1ea829 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:50.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.356+0000 7f01437fe640 1 -- 172.21.15.19:0/2793160889 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138037070 con 0x7f014415e760 2024-09-12T02:04:50.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.357+0000 7f01437fe640 1 -- 172.21.15.19:0/2793160889 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0138032440 con 0x7f014415e760 2024-09-12T02:04:50.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.357+0000 7f01437fe640 1 -- 172.21.15.19:0/2793160889 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138032810 con 0x7f014415e760 2024-09-12T02:04:50.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.357+0000 7f014af2a640 1 -- 172.21.15.19:0/2793160889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f014415e760 msgr2=0x7f014406cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.357+0000 7f014af2a640 1 --2- 172.21.15.19:0/2793160889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f014415e760 0x7f014406cdd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0138009870 tx=0x7f013802a1c0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.357+0000 7f014af2a640 1 -- 172.21.15.19:0/2793160889 shutdown_connections 2024-09-12T02:04:50.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.357+0000 7f014af2a640 1 --2- 172.21.15.19:0/2793160889 >> v2:172.21.15.135:3300/0 conn(0x7f01440cfcc0 0x7f01440d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.357+0000 7f014af2a640 1 --2- 172.21.15.19:0/2793160889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f014415e760 0x7f014406cdd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.357+0000 7f014af2a640 1 -- 172.21.15.19:0/2793160889 >> 172.21.15.19:0/2793160889 conn(0x7f014408bfc0 msgr2=0x7f01440d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:50.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.357+0000 7f014af2a640 1 -- 172.21.15.19:0/2793160889 shutdown_connections 2024-09-12T02:04:50.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.357+0000 7f014af2a640 1 -- 172.21.15.19:0/2793160889 wait complete. 2024-09-12T02:04:50.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.358+0000 7f014af2a640 1 Processor -- start 2024-09-12T02:04:50.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.358+0000 7f014af2a640 1 -- start start 2024-09-12T02:04:50.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.359+0000 7f014af2a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01440cfcc0 0x7f0144155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.359+0000 7f014af2a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01440d4fd0 0x7f0144159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.359+0000 7f014af2a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f014415e760 0x7f014415c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.359+0000 7f014af2a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f01440d33e0 con 0x7f014415e760 2024-09-12T02:04:50.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.359+0000 7f014af2a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f01440b3860 con 0x7f01440cfcc0 2024-09-12T02:04:50.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.359+0000 7f014af2a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f01440d3560 con 0x7f01440d4fd0 2024-09-12T02:04:50.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.359+0000 7f01494c7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f014415e760 0x7f014415c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.359+0000 7f0148cc6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01440cfcc0 0x7f0144155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.359+0000 7f0148cc6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01440cfcc0 0x7f0144155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:50284/0 (socket says 172.21.15.19:50284) 2024-09-12T02:04:50.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.359+0000 7f0148cc6640 1 -- 172.21.15.19:0/3023971751 learned_addr learned my addr 172.21.15.19:0/3023971751 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:50.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.359+0000 7f0143fff640 1 --2- 172.21.15.19:0/3023971751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01440d4fd0 0x7f0144159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.360+0000 7f0148cc6640 1 -- 172.21.15.19:0/3023971751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01440d4fd0 msgr2=0x7f0144159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.360+0000 7f0148cc6640 1 --2- 172.21.15.19:0/3023971751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01440d4fd0 0x7f0144159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.360+0000 7f0148cc6640 1 -- 172.21.15.19:0/3023971751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f014415e760 msgr2=0x7f014415c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.360+0000 7f0148cc6640 1 --2- 172.21.15.19:0/3023971751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f014415e760 0x7f014415c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.360+0000 7f0148cc6640 1 -- 172.21.15.19:0/3023971751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0144159170 con 0x7f01440cfcc0 2024-09-12T02:04:50.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.360+0000 7f01494c7640 1 --2- 172.21.15.19:0/3023971751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f014415e760 0x7f014415c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:50.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.360+0000 7f0148cc6640 1 --2- 172.21.15.19:0/3023971751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01440cfcc0 0x7f0144155c20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0138000c00 tx=0x7f01380046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:50.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.360+0000 7f01417fa640 1 -- 172.21.15.19:0/3023971751 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138041070 con 0x7f01440cfcc0 2024-09-12T02:04:50.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.360+0000 7f01417fa640 1 -- 172.21.15.19:0/3023971751 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f013803c890 con 0x7f01440cfcc0 2024-09-12T02:04:50.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.360+0000 7f014af2a640 1 -- 172.21.15.19:0/3023971751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0144159450 con 0x7f01440cfcc0 2024-09-12T02:04:50.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.360+0000 7f01417fa640 1 -- 172.21.15.19:0/3023971751 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138037040 con 0x7f01440cfcc0 2024-09-12T02:04:50.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.360+0000 7f014af2a640 1 -- 172.21.15.19:0/3023971751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0144156160 con 0x7f01440cfcc0 2024-09-12T02:04:50.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.361+0000 7f014af2a640 1 -- 172.21.15.19:0/3023971751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01440d1e40 con 0x7f01440cfcc0 2024-09-12T02:04:50.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.362+0000 7f01417fa640 1 -- 172.21.15.19:0/3023971751 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0138044070 con 0x7f01440cfcc0 2024-09-12T02:04:50.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.362+0000 7f01417fa640 1 --2- 172.21.15.19:0/3023971751 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f012806be30 0x7f012806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.362+0000 7f01417fa640 1 -- 172.21.15.19:0/3023971751 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 8281+0+0 (secure 0 0 0) 0x7f01380ac320 con 0x7f01440cfcc0 2024-09-12T02:04:50.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.363+0000 7f0143fff640 1 --2- 172.21.15.19:0/3023971751 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f012806be30 0x7f012806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.363+0000 7f0143fff640 1 --2- 172.21.15.19:0/3023971751 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f012806be30 0x7f012806e2f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f014415d5c0 tx=0x7f0130009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:50.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.367+0000 7f01417fa640 1 -- 172.21.15.19:0/3023971751 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f01440d1e40 con 0x7f01440cfcc0 2024-09-12T02:04:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.582+0000 7f014af2a640 1 -- 172.21.15.19:0/3023971751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01440d3990 con 0x7f01440cfcc0 2024-09-12T02:04:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.583+0000 7f01417fa640 1 -- 172.21.15.19:0/3023971751 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 216 v216) ==== 95+0+3563 (secure 0 0 0) 0x7f0138079e50 con 0x7f01440cfcc0 2024-09-12T02:04:50.584 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:50.584 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":216,"btime":"2024-09-12T02:04:49:907742+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":216,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:49.907686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 216 2024-09-12T02:04:50.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.586+0000 7f014af2a640 1 -- 172.21.15.19:0/3023971751 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f012806be30 msgr2=0x7f012806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.586+0000 7f014af2a640 1 --2- 172.21.15.19:0/3023971751 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f012806be30 0x7f012806e2f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f014415d5c0 tx=0x7f0130009040 comp rx=0 tx=0).stop 2024-09-12T02:04:50.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.586+0000 7f014af2a640 1 -- 172.21.15.19:0/3023971751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01440cfcc0 msgr2=0x7f0144155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.586+0000 7f014af2a640 1 --2- 172.21.15.19:0/3023971751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01440cfcc0 0x7f0144155c20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0138000c00 tx=0x7f01380046c0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.586+0000 7f014af2a640 1 -- 172.21.15.19:0/3023971751 shutdown_connections 2024-09-12T02:04:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.586+0000 7f014af2a640 1 --2- 172.21.15.19:0/3023971751 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f012806be30 0x7f012806e2f0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.586+0000 7f014af2a640 1 --2- 172.21.15.19:0/3023971751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f014415e760 0x7f014415c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.586+0000 7f014af2a640 1 --2- 172.21.15.19:0/3023971751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01440d4fd0 0x7f0144159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.586+0000 7f014af2a640 1 --2- 172.21.15.19:0/3023971751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01440cfcc0 0x7f0144155c20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.586+0000 7f014af2a640 1 -- 172.21.15.19:0/3023971751 >> 172.21.15.19:0/3023971751 conn(0x7f014408bfc0 msgr2=0x7f01440d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.586+0000 7f014af2a640 1 -- 172.21.15.19:0/3023971751 shutdown_connections 2024-09-12T02:04:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.586+0000 7f014af2a640 1 -- 172.21.15.19:0/3023971751 wait complete. 2024-09-12T02:04:50.597 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:50.597 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:50.621 INFO:tasks.ceph.mds.d.smithi135.stderr: -46> 2024-09-12T02:04:45.869+0000 7f93b5b71640 -1 mds.0.cache.ino(0x100) Corrupt inode 0x100: End of buffer [buffer:2] 2024-09-12T02:04:50.621 INFO:tasks.ceph.mds.d.smithi135.stderr: -36> 2024-09-12T02:04:45.869+0000 7f93b5b71640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2024-09-12T02:04:50.647 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T02:04:50.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.699+0000 7f303e277640 1 Processor -- start 2024-09-12T02:04:50.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.699+0000 7f303e277640 1 -- start start 2024-09-12T02:04:50.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.700+0000 7f303e277640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f303815e760 0x7f303806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.700+0000 7f303e277640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30380d4fd0 0x7f30380cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.700+0000 7f303e277640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f30380b3650 0x7f30380cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.700+0000 7f303e277640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f30380d2700 con 0x7f30380b3650 2024-09-12T02:04:50.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.700+0000 7f303e277640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f30380cedb0 con 0x7f303815e760 2024-09-12T02:04:50.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.700+0000 7f303e277640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f30380cf090 con 0x7f30380d4fd0 2024-09-12T02:04:50.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.700+0000 7f303c814640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f30380b3650 0x7f30380cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.700+0000 7f303c814640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f30380b3650 0x7f30380cfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59672/0 (socket says 172.21.15.19:59672) 2024-09-12T02:04:50.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.700+0000 7f303c814640 1 -- 172.21.15.19:0/3203037666 learned_addr learned my addr 172.21.15.19:0/3203037666 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:50.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.700+0000 7f3037fff640 1 --2- 172.21.15.19:0/3203037666 >> v2:172.21.15.135:3300/0 conn(0x7f303815e760 0x7f303806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.700+0000 7f30377fe640 1 --2- 172.21.15.19:0/3203037666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30380d4fd0 0x7f30380cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.700+0000 7f303c814640 1 -- 172.21.15.19:0/3203037666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30380d4fd0 msgr2=0x7f30380cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:50.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.700+0000 7f303c814640 1 --2- 172.21.15.19:0/3203037666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30380d4fd0 0x7f30380cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.700+0000 7f303c814640 1 -- 172.21.15.19:0/3203037666 >> v2:172.21.15.135:3300/0 conn(0x7f303815e760 msgr2=0x7f303806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:50.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.700+0000 7f303c814640 1 --2- 172.21.15.19:0/3203037666 >> v2:172.21.15.135:3300/0 conn(0x7f303815e760 0x7f303806cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.700+0000 7f303c814640 1 -- 172.21.15.19:0/3203037666 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30380b3c80 con 0x7f30380b3650 2024-09-12T02:04:50.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.701+0000 7f303c814640 1 --2- 172.21.15.19:0/3203037666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30380b3650 0x7f30380cfaf0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f303808ca50 tx=0x7f303002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de06edf7ba1692 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:50.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.701+0000 7f3036ffd640 1 -- 172.21.15.19:0/3203037666 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3030036070 con 0x7f30380b3650 2024-09-12T02:04:50.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.701+0000 7f3036ffd640 1 -- 172.21.15.19:0/3203037666 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3030031600 con 0x7f30380b3650 2024-09-12T02:04:50.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.701+0000 7f3036ffd640 1 -- 172.21.15.19:0/3203037666 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30300319d0 con 0x7f30380b3650 2024-09-12T02:04:50.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.702+0000 7f303e277640 1 -- 172.21.15.19:0/3203037666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30380b3650 msgr2=0x7f30380cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.702+0000 7f303e277640 1 --2- 172.21.15.19:0/3203037666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30380b3650 0x7f30380cfaf0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f303808ca50 tx=0x7f303002a610 comp rx=0 tx=0).stop 2024-09-12T02:04:50.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.702+0000 7f303e277640 1 -- 172.21.15.19:0/3203037666 shutdown_connections 2024-09-12T02:04:50.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.702+0000 7f303e277640 1 --2- 172.21.15.19:0/3203037666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30380b3650 0x7f30380cfaf0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.702+0000 7f303e277640 1 --2- 172.21.15.19:0/3203037666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30380d4fd0 0x7f30380cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.702+0000 7f303e277640 1 --2- 172.21.15.19:0/3203037666 >> v2:172.21.15.135:3300/0 conn(0x7f303815e760 0x7f303806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.702+0000 7f303e277640 1 -- 172.21.15.19:0/3203037666 >> 172.21.15.19:0/3203037666 conn(0x7f303808bfc0 msgr2=0x7f30380d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:50.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.702+0000 7f303e277640 1 -- 172.21.15.19:0/3203037666 shutdown_connections 2024-09-12T02:04:50.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.702+0000 7f303e277640 1 -- 172.21.15.19:0/3203037666 wait complete. 2024-09-12T02:04:50.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.703+0000 7f303e277640 1 Processor -- start 2024-09-12T02:04:50.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.703+0000 7f303e277640 1 -- start start 2024-09-12T02:04:50.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.704+0000 7f303e277640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30380b3650 0x7f3038151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.704+0000 7f303e277640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30380d4fd0 0x7f30380c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.704+0000 7f303e277640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f303815e760 0x7f30380cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.704+0000 7f303e277640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f30380d3230 con 0x7f30380d4fd0 2024-09-12T02:04:50.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.704+0000 7f303e277640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f30380d30b0 con 0x7f30380b3650 2024-09-12T02:04:50.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.704+0000 7f303e277640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f30380d33b0 con 0x7f303815e760 2024-09-12T02:04:50.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.704+0000 7f30377fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30380d4fd0 0x7f30380c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.704+0000 7f3037fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30380b3650 0x7f3038151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.704+0000 7f30377fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30380d4fd0 0x7f30380c7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59682/0 (socket says 172.21.15.19:59682) 2024-09-12T02:04:50.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.704+0000 7f30377fe640 1 -- 172.21.15.19:0/3384250938 learned_addr learned my addr 172.21.15.19:0/3384250938 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:50.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.704+0000 7f303c814640 1 --2- 172.21.15.19:0/3384250938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f303815e760 0x7f30380cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.705+0000 7f30377fe640 1 -- 172.21.15.19:0/3384250938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f303815e760 msgr2=0x7f30380cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.705+0000 7f30377fe640 1 --2- 172.21.15.19:0/3384250938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f303815e760 0x7f30380cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.705+0000 7f30377fe640 1 -- 172.21.15.19:0/3384250938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30380b3650 msgr2=0x7f3038151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.705+0000 7f30377fe640 1 --2- 172.21.15.19:0/3384250938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30380b3650 0x7f3038151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.705+0000 7f30377fe640 1 -- 172.21.15.19:0/3384250938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3038151e90 con 0x7f30380d4fd0 2024-09-12T02:04:50.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.705+0000 7f30377fe640 1 --2- 172.21.15.19:0/3384250938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30380d4fd0 0x7f30380c7d50 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f302c00e8e0 tx=0x7f302c00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:50.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.705+0000 7f3034ff9640 1 -- 172.21.15.19:0/3384250938 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c005990 con 0x7f30380d4fd0 2024-09-12T02:04:50.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.705+0000 7f3034ff9640 1 -- 172.21.15.19:0/3384250938 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f302c005b30 con 0x7f30380d4fd0 2024-09-12T02:04:50.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.705+0000 7f3034ff9640 1 -- 172.21.15.19:0/3384250938 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c00c9a0 con 0x7f30380d4fd0 2024-09-12T02:04:50.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.705+0000 7f303e277640 1 -- 172.21.15.19:0/3384250938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30380c85a0 con 0x7f30380d4fd0 2024-09-12T02:04:50.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.705+0000 7f303e277640 1 -- 172.21.15.19:0/3384250938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30380c8b60 con 0x7f30380d4fd0 2024-09-12T02:04:50.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.706+0000 7f303e277640 1 -- 172.21.15.19:0/3384250938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30380d36f0 con 0x7f30380d4fd0 2024-09-12T02:04:50.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.707+0000 7f3034ff9640 1 -- 172.21.15.19:0/3384250938 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f302c00cb40 con 0x7f30380d4fd0 2024-09-12T02:04:50.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.707+0000 7f3034ff9640 1 --2- 172.21.15.19:0/3384250938 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f302406be60 0x7f302406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.707+0000 7f3034ff9640 1 -- 172.21.15.19:0/3384250938 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 8281+0+0 (secure 0 0 0) 0x7f302c08ba10 con 0x7f30380d4fd0 2024-09-12T02:04:50.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.707+0000 7f3037fff640 1 --2- 172.21.15.19:0/3384250938 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f302406be60 0x7f302406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.708+0000 7f3037fff640 1 --2- 172.21.15.19:0/3384250938 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f302406be60 0x7f302406e320 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f3028009aa0 tx=0x7f3028009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:50.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.711+0000 7f3034ff9640 1 -- 172.21.15.19:0/3384250938 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f302c017020 con 0x7f30380d4fd0 2024-09-12T02:04:50.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.922+0000 7f303e277640 1 -- 172.21.15.19:0/3384250938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30380b6d20 con 0x7f30380d4fd0 2024-09-12T02:04:50.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.923+0000 7f3034ff9640 1 -- 172.21.15.19:0/3384250938 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 217 v217) ==== 95+0+4392 (secure 0 0 0) 0x7f302c059310 con 0x7f30380d4fd0 2024-09-12T02:04:50.924 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:50.924 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":217,"btime":"2024-09-12T02:04:50:909198+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7388,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3377480547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3377480547},{"type":"v1","addr":"172.21.15.135:6837","nonce":3377480547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":217}],"filesystems":[{"mdsmap":{"epoch":216,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:49.907686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 217 2024-09-12T02:04:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.925+0000 7f303e277640 1 -- 172.21.15.19:0/3384250938 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f302406be60 msgr2=0x7f302406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.925+0000 7f303e277640 1 --2- 172.21.15.19:0/3384250938 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f302406be60 0x7f302406e320 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f3028009aa0 tx=0x7f3028009190 comp rx=0 tx=0).stop 2024-09-12T02:04:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.925+0000 7f303e277640 1 -- 172.21.15.19:0/3384250938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30380d4fd0 msgr2=0x7f30380c7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.925+0000 7f303e277640 1 --2- 172.21.15.19:0/3384250938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30380d4fd0 0x7f30380c7d50 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f302c00e8e0 tx=0x7f302c00eda0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.925+0000 7f303e277640 1 -- 172.21.15.19:0/3384250938 shutdown_connections 2024-09-12T02:04:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.925+0000 7f303e277640 1 --2- 172.21.15.19:0/3384250938 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f302406be60 0x7f302406e320 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.925+0000 7f303e277640 1 --2- 172.21.15.19:0/3384250938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f303815e760 0x7f30380cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.925+0000 7f303e277640 1 --2- 172.21.15.19:0/3384250938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30380d4fd0 0x7f30380c7d50 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.925+0000 7f303e277640 1 --2- 172.21.15.19:0/3384250938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30380b3650 0x7f3038151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.925+0000 7f303e277640 1 -- 172.21.15.19:0/3384250938 >> 172.21.15.19:0/3384250938 conn(0x7f303808bfc0 msgr2=0x7f30380cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.925+0000 7f303e277640 1 -- 172.21.15.19:0/3384250938 shutdown_connections 2024-09-12T02:04:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:50.925+0000 7f303e277640 1 -- 172.21.15.19:0/3384250938 wait complete. 2024-09-12T02:04:50.936 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate 1.00000000.inode' led to DAMAGED state 2024-09-12T02:04:50.937 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate 200.00000000' 2024-09-12T02:04:50.937 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:04:50.937 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:04:50.953 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:04:50.953 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:04:50.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:50.953 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:04:51.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:04:51.009 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:04:51.009 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:04:51.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.152+0000 7f6b116e6640 1 Processor -- start 2024-09-12T02:04:51.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.152+0000 7f6b116e6640 1 -- start start 2024-09-12T02:04:51.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.153+0000 7f6b116e6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b0c15b300 0x7f6b0c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.153+0000 7f6b116e6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6b0c0cd3f0 0x7f6b0c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.153+0000 7f6b116e6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b0c0cdbe0 con 0x7f6b0c072d30 2024-09-12T02:04:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.153+0000 7f6b116e6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f6b0c0728a0 con 0x7f6b0c15b300 2024-09-12T02:04:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.153+0000 7f6b116e6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6b0c0cd900 con 0x7f6b0c0cd3f0 2024-09-12T02:04:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.153+0000 7f6b0affd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b0c15b300 0x7f6b0c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.153+0000 7f6b0affd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b0c15b300 0x7f6b0c0cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43582/0 (socket says 172.21.15.19:43582) 2024-09-12T02:04:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.153+0000 7f6b0affd640 1 -- 172.21.15.19:0/3046334897 learned_addr learned my addr 172.21.15.19:0/3046334897 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.153+0000 7f6b0a7fc640 1 --2- 172.21.15.19:0/3046334897 >> v2:172.21.15.135:3300/0 conn(0x7f6b0c0cd3f0 0x7f6b0c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.153+0000 7f6b0affd640 1 -- 172.21.15.19:0/3046334897 >> v2:172.21.15.135:3300/0 conn(0x7f6b0c0cd3f0 msgr2=0x7f6b0c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.154+0000 7f6b0affd640 1 --2- 172.21.15.19:0/3046334897 >> v2:172.21.15.135:3300/0 conn(0x7f6b0c0cd3f0 0x7f6b0c06f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.154+0000 7f6b0affd640 1 -- 172.21.15.19:0/3046334897 >> v1:172.21.15.135:6789/0 conn(0x7f6b0c072d30 legacy=0x7f6b0c0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.154+0000 7f6b0affd640 1 -- 172.21.15.19:0/3046334897 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c072250 con 0x7f6b0c15b300 2024-09-12T02:04:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.154+0000 7f6b0affd640 1 --2- 172.21.15.19:0/3046334897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b0c15b300 0x7f6b0c0cceb0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c0b57c0 tx=0x7f6afc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b8ae13fc78406b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.154+0000 7f6b09ffb640 1 -- 172.21.15.19:0/3046334897 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6afc036070 con 0x7f6b0c15b300 2024-09-12T02:04:51.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.154+0000 7f6b09ffb640 1 -- 172.21.15.19:0/3046334897 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6afc031600 con 0x7f6b0c15b300 2024-09-12T02:04:51.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.154+0000 7f6b09ffb640 1 -- 172.21.15.19:0/3046334897 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0319d0 con 0x7f6b0c15b300 2024-09-12T02:04:51.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.155+0000 7f6b116e6640 1 -- 172.21.15.19:0/3046334897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b0c15b300 msgr2=0x7f6b0c0cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:51.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.155+0000 7f6b116e6640 1 --2- 172.21.15.19:0/3046334897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b0c15b300 0x7f6b0c0cceb0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c0b57c0 tx=0x7f6afc02a6f0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.155+0000 7f6b116e6640 1 -- 172.21.15.19:0/3046334897 shutdown_connections 2024-09-12T02:04:51.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.155+0000 7f6b116e6640 1 --2- 172.21.15.19:0/3046334897 >> v2:172.21.15.135:3300/0 conn(0x7f6b0c0cd3f0 0x7f6b0c06f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.155+0000 7f6b116e6640 1 --2- 172.21.15.19:0/3046334897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b0c15b300 0x7f6b0c0cceb0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.155+0000 7f6b116e6640 1 -- 172.21.15.19:0/3046334897 >> 172.21.15.19:0/3046334897 conn(0x7f6b0c067d70 msgr2=0x7f6b0c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:51.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.155+0000 7f6b116e6640 1 -- 172.21.15.19:0/3046334897 shutdown_connections 2024-09-12T02:04:51.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.155+0000 7f6b116e6640 1 -- 172.21.15.19:0/3046334897 wait complete. 2024-09-12T02:04:51.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.156+0000 7f6b116e6640 1 Processor -- start 2024-09-12T02:04:51.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.156+0000 7f6b116e6640 1 -- start start 2024-09-12T02:04:51.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.157+0000 7f6b116e6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b0c072d30 0x7f6b0c14afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.157+0000 7f6b116e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b0c0cd3f0 0x7f6b0c14b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.157+0000 7f6b116e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b0c15b300 0x7f6b0c1f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.157+0000 7f6b116e6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c0d0160 con 0x7f6b0c15b300 2024-09-12T02:04:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.157+0000 7f6b116e6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c0cffe0 con 0x7f6b0c0cd3f0 2024-09-12T02:04:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.157+0000 7f6b116e6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6b0c06f700 con 0x7f6b0c072d30 2024-09-12T02:04:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.157+0000 7f6b0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b0c15b300 0x7f6b0c1f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.157+0000 7f6b0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b0c15b300 0x7f6b0c1f5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43588/0 (socket says 172.21.15.19:43588) 2024-09-12T02:04:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.157+0000 7f6b0b7fe640 1 -- 172.21.15.19:0/107373789 learned_addr learned my addr 172.21.15.19:0/107373789 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.157+0000 7f6b0affd640 1 --2- 172.21.15.19:0/107373789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b0c072d30 0x7f6b0c14afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.157+0000 7f6b0a7fc640 1 --2- 172.21.15.19:0/107373789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b0c0cd3f0 0x7f6b0c14b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.158+0000 7f6b0b7fe640 1 -- 172.21.15.19:0/107373789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b0c072d30 msgr2=0x7f6b0c14afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.158+0000 7f6b0b7fe640 1 --2- 172.21.15.19:0/107373789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b0c072d30 0x7f6b0c14afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.158+0000 7f6b0b7fe640 1 -- 172.21.15.19:0/107373789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b0c0cd3f0 msgr2=0x7f6b0c14b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.158+0000 7f6b0b7fe640 1 --2- 172.21.15.19:0/107373789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b0c0cd3f0 0x7f6b0c14b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.158+0000 7f6b0b7fe640 1 -- 172.21.15.19:0/107373789 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c15a900 con 0x7f6b0c15b300 2024-09-12T02:04:51.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.158+0000 7f6b0b7fe640 1 --2- 172.21.15.19:0/107373789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b0c15b300 0x7f6b0c1f5f70 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400c410 tx=0x7f6b0400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:51.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.158+0000 7f6b037fe640 1 -- 172.21.15.19:0/107373789 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b04011790 con 0x7f6b0c15b300 2024-09-12T02:04:51.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.158+0000 7f6b037fe640 1 -- 172.21.15.19:0/107373789 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b04017070 con 0x7f6b0c15b300 2024-09-12T02:04:51.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.158+0000 7f6b116e6640 1 -- 172.21.15.19:0/107373789 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b0c1549b0 con 0x7f6b0c15b300 2024-09-12T02:04:51.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.158+0000 7f6b037fe640 1 -- 172.21.15.19:0/107373789 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b04011bb0 con 0x7f6b0c15b300 2024-09-12T02:04:51.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.158+0000 7f6b116e6640 1 -- 172.21.15.19:0/107373789 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b0c154f70 con 0x7f6b0c15b300 2024-09-12T02:04:51.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.159+0000 7f6b116e6640 1 -- 172.21.15.19:0/107373789 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b0c06fac0 con 0x7f6b0c15b300 2024-09-12T02:04:51.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.159+0000 7f6b037fe640 1 -- 172.21.15.19:0/107373789 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b0401c460 con 0x7f6b0c15b300 2024-09-12T02:04:51.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.160+0000 7f6b037fe640 1 --2- 172.21.15.19:0/107373789 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6aec06be30 0x7f6aec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:51.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.160+0000 7f6b037fe640 1 -- 172.21.15.19:0/107373789 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 8281+0+0 (secure 0 0 0) 0x7f6b0408b580 con 0x7f6b0c15b300 2024-09-12T02:04:51.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.160+0000 7f6b0affd640 1 --2- 172.21.15.19:0/107373789 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6aec06be30 0x7f6aec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:51.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.161+0000 7f6b0affd640 1 --2- 172.21.15.19:0/107373789 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6aec06be30 0x7f6aec06e2f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6afc033000 tx=0x7f6afc009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:51.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.164+0000 7f6b037fe640 1 -- 172.21.15.19:0/107373789 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b04058e80 con 0x7f6b0c15b300 2024-09-12T02:04:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.380+0000 7f6b116e6640 1 -- 172.21.15.19:0/107373789 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6b0c0b5380 con 0x7f6b0c15b300 2024-09-12T02:04:51.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.923+0000 7f6b037fe640 1 -- 172.21.15.19:0/107373789 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v218) ==== 161+0+0 (secure 0 0 0) 0x7f6b0405d180 con 0x7f6b0c15b300 2024-09-12T02:04:51.923 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:04:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.926+0000 7f6b116e6640 1 -- 172.21.15.19:0/107373789 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6aec06be30 msgr2=0x7f6aec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.926+0000 7f6b116e6640 1 --2- 172.21.15.19:0/107373789 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6aec06be30 0x7f6aec06e2f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6afc033000 tx=0x7f6afc009000 comp rx=0 tx=0).stop 2024-09-12T02:04:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.926+0000 7f6b116e6640 1 -- 172.21.15.19:0/107373789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b0c15b300 msgr2=0x7f6b0c1f5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.926+0000 7f6b116e6640 1 --2- 172.21.15.19:0/107373789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b0c15b300 0x7f6b0c1f5f70 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400c410 tx=0x7f6b0400c8d0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.926+0000 7f6b116e6640 1 -- 172.21.15.19:0/107373789 shutdown_connections 2024-09-12T02:04:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.926+0000 7f6b116e6640 1 --2- 172.21.15.19:0/107373789 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6aec06be30 0x7f6aec06e2f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.926+0000 7f6b116e6640 1 --2- 172.21.15.19:0/107373789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b0c15b300 0x7f6b0c1f5f70 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.926+0000 7f6b116e6640 1 --2- 172.21.15.19:0/107373789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b0c0cd3f0 0x7f6b0c14b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.926+0000 7f6b116e6640 1 --2- 172.21.15.19:0/107373789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b0c072d30 0x7f6b0c14afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.926+0000 7f6b116e6640 1 -- 172.21.15.19:0/107373789 >> 172.21.15.19:0/107373789 conn(0x7f6b0c067d70 msgr2=0x7f6b0c15ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.926+0000 7f6b116e6640 1 -- 172.21.15.19:0/107373789 shutdown_connections 2024-09-12T02:04:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:51.926+0000 7f6b116e6640 1 -- 172.21.15.19:0/107373789 wait complete. 2024-09-12T02:04:51.940 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:04:52.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.049+0000 7ff9eef03640 1 Processor -- start 2024-09-12T02:04:52.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.049+0000 7ff9eef03640 1 -- start start 2024-09-12T02:04:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.050+0000 7ff9eef03640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9e815b300 0x7ff9e80cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.050+0000 7ff9eef03640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e806f8d0 0x7ff9e815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.050+0000 7ff9eef03640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e80cdbe0 con 0x7ff9e80cd3f0 2024-09-12T02:04:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.050+0000 7ff9eef03640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e80728a0 con 0x7ff9e815b300 2024-09-12T02:04:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.050+0000 7ff9eef03640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e80cd900 con 0x7ff9e806f8d0 2024-09-12T02:04:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.050+0000 7ff9ecc9f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9e815b300 0x7ff9e80cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.050+0000 7ff9e7fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff9e80cd3f0 0x7ff9e806f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52320/0 (socket says 172.21.15.19:52320) 2024-09-12T02:04:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.050+0000 7ff9ecc9f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9e815b300 0x7ff9e80cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43598/0 (socket says 172.21.15.19:43598) 2024-09-12T02:04:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.050+0000 7ff9e7fff640 1 -- 172.21.15.19:0/1482237604 learned_addr learned my addr 172.21.15.19:0/1482237604 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.050+0000 7ff9ed4a0640 1 --2- 172.21.15.19:0/1482237604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e806f8d0 0x7ff9e815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.050+0000 7ff9ecc9f640 1 -- 172.21.15.19:0/1482237604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e806f8d0 msgr2=0x7ff9e815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.050+0000 7ff9ecc9f640 1 --2- 172.21.15.19:0/1482237604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e806f8d0 0x7ff9e815b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.050+0000 7ff9ecc9f640 1 -- 172.21.15.19:0/1482237604 >> v1:172.21.15.19:6789/0 conn(0x7ff9e80cd3f0 legacy=0x7ff9e806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.050+0000 7ff9ecc9f640 1 -- 172.21.15.19:0/1482237604 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e8072250 con 0x7ff9e815b300 2024-09-12T02:04:52.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.050+0000 7ff9e77fe640 1 -- 172.21.15.19:0/1482237604 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3369045575 0 0) 0x7ff9e80cdbe0 con 0x7ff9e80cd3f0 2024-09-12T02:04:52.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.051+0000 7ff9ecc9f640 1 --2- 172.21.15.19:0/1482237604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e815b300 0x7ff9e80cceb0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0097a0 tx=0x7ff9dc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16e097cd8ad1c72 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:52.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.051+0000 7ff9e77fe640 1 -- 172.21.15.19:0/1482237604 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc037070 con 0x7ff9e815b300 2024-09-12T02:04:52.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.051+0000 7ff9e77fe640 1 -- 172.21.15.19:0/1482237604 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9dc032440 con 0x7ff9e815b300 2024-09-12T02:04:52.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.051+0000 7ff9e77fe640 1 -- 172.21.15.19:0/1482237604 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc032810 con 0x7ff9e815b300 2024-09-12T02:04:52.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.052+0000 7ff9eef03640 1 -- 172.21.15.19:0/1482237604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e815b300 msgr2=0x7ff9e80cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:52.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.052+0000 7ff9eef03640 1 --2- 172.21.15.19:0/1482237604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e815b300 0x7ff9e80cceb0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0097a0 tx=0x7ff9dc02a180 comp rx=0 tx=0).stop 2024-09-12T02:04:52.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.052+0000 7ff9eef03640 1 -- 172.21.15.19:0/1482237604 shutdown_connections 2024-09-12T02:04:52.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.052+0000 7ff9eef03640 1 --2- 172.21.15.19:0/1482237604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e806f8d0 0x7ff9e815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.052+0000 7ff9eef03640 1 --2- 172.21.15.19:0/1482237604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e815b300 0x7ff9e80cceb0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.052+0000 7ff9eef03640 1 -- 172.21.15.19:0/1482237604 >> 172.21.15.19:0/1482237604 conn(0x7ff9e8067d70 msgr2=0x7ff9e806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:52.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.052+0000 7ff9eef03640 1 -- 172.21.15.19:0/1482237604 shutdown_connections 2024-09-12T02:04:52.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.052+0000 7ff9eef03640 1 -- 172.21.15.19:0/1482237604 wait complete. 2024-09-12T02:04:52.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.053+0000 7ff9eef03640 1 Processor -- start 2024-09-12T02:04:52.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.053+0000 7ff9eef03640 1 -- start start 2024-09-12T02:04:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.054+0000 7ff9eef03640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e806f8d0 0x7ff9e8157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.054+0000 7ff9eef03640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e80cd3f0 0x7ff9e806e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.054+0000 7ff9eef03640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e815b300 0x7ff9e8142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.054+0000 7ff9eef03640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e80d0160 con 0x7ff9e806f8d0 2024-09-12T02:04:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.054+0000 7ff9eef03640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e80cffe0 con 0x7ff9e80cd3f0 2024-09-12T02:04:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.054+0000 7ff9eef03640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e8072d30 con 0x7ff9e815b300 2024-09-12T02:04:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.054+0000 7ff9ecc9f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e806f8d0 0x7ff9e8157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.054+0000 7ff9ecc9f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e806f8d0 0x7ff9e8157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43614/0 (socket says 172.21.15.19:43614) 2024-09-12T02:04:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.054+0000 7ff9ecc9f640 1 -- 172.21.15.19:0/157191738 learned_addr learned my addr 172.21.15.19:0/157191738 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.054+0000 7ff9ed4a0640 1 --2- 172.21.15.19:0/157191738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e815b300 0x7ff9e8142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.054+0000 7ff9e7fff640 1 --2- 172.21.15.19:0/157191738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e80cd3f0 0x7ff9e806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.054+0000 7ff9ecc9f640 1 -- 172.21.15.19:0/157191738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e815b300 msgr2=0x7ff9e8142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.054+0000 7ff9ecc9f640 1 --2- 172.21.15.19:0/157191738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e815b300 0x7ff9e8142870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.054+0000 7ff9ecc9f640 1 -- 172.21.15.19:0/157191738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e80cd3f0 msgr2=0x7ff9e806e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.054+0000 7ff9ecc9f640 1 --2- 172.21.15.19:0/157191738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e80cd3f0 0x7ff9e806e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.054+0000 7ff9ecc9f640 1 -- 172.21.15.19:0/157191738 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e8156460 con 0x7ff9e806f8d0 2024-09-12T02:04:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.054+0000 7ff9e7fff640 1 --2- 172.21.15.19:0/157191738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e80cd3f0 0x7ff9e806e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.055+0000 7ff9ecc9f640 1 --2- 172.21.15.19:0/157191738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e806f8d0 0x7ff9e8157500 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0097a0 tx=0x7ff9dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.055+0000 7ff9e57fa640 1 -- 172.21.15.19:0/157191738 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc037050 con 0x7ff9e806f8d0 2024-09-12T02:04:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.055+0000 7ff9e57fa640 1 -- 172.21.15.19:0/157191738 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9dc038040 con 0x7ff9e806f8d0 2024-09-12T02:04:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.055+0000 7ff9eef03640 1 -- 172.21.15.19:0/157191738 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e8156740 con 0x7ff9e806f8d0 2024-09-12T02:04:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.055+0000 7ff9e57fa640 1 -- 172.21.15.19:0/157191738 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc004490 con 0x7ff9e806f8d0 2024-09-12T02:04:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.055+0000 7ff9eef03640 1 -- 172.21.15.19:0/157191738 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e8156d00 con 0x7ff9e806f8d0 2024-09-12T02:04:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.056+0000 7ff9eef03640 1 -- 172.21.15.19:0/157191738 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e815e160 con 0x7ff9e806f8d0 2024-09-12T02:04:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.056+0000 7ff9e57fa640 1 -- 172.21.15.19:0/157191738 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9dc03c6d0 con 0x7ff9e806f8d0 2024-09-12T02:04:52.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.057+0000 7ff9e57fa640 1 --2- 172.21.15.19:0/157191738 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9cc06be30 0x7ff9cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:52.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.057+0000 7ff9e57fa640 1 -- 172.21.15.19:0/157191738 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 8281+0+0 (secure 0 0 0) 0x7ff9dc0ac180 con 0x7ff9e806f8d0 2024-09-12T02:04:52.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.057+0000 7ff9e7fff640 1 --2- 172.21.15.19:0/157191738 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9cc06be30 0x7ff9cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:52.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.057+0000 7ff9e7fff640 1 --2- 172.21.15.19:0/157191738 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9cc06be30 0x7ff9cc06e2f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80b2cc0 tx=0x7ff9d4007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:52.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.061+0000 7ff9e57fa640 1 -- 172.21.15.19:0/157191738 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff9dc07a160 con 0x7ff9e806f8d0 2024-09-12T02:04:52.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.309+0000 7ff9eef03640 1 -- 172.21.15.19:0/157191738 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7ff9e815dba0 con 0x7ff9e806f8d0 2024-09-12T02:04:52.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.928+0000 7ff9e57fa640 1 -- 172.21.15.19:0/157191738 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v219) ==== 101+0+0 (secure 0 0 0) 0x7ff9dc079a60 con 0x7ff9e806f8d0 2024-09-12T02:04:52.929 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:04:52.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.931+0000 7ff9eef03640 1 -- 172.21.15.19:0/157191738 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9cc06be30 msgr2=0x7ff9cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:52.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.931+0000 7ff9eef03640 1 --2- 172.21.15.19:0/157191738 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9cc06be30 0x7ff9cc06e2f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80b2cc0 tx=0x7ff9d4007c10 comp rx=0 tx=0).stop 2024-09-12T02:04:52.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.931+0000 7ff9eef03640 1 -- 172.21.15.19:0/157191738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e806f8d0 msgr2=0x7ff9e8157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:52.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.931+0000 7ff9eef03640 1 --2- 172.21.15.19:0/157191738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e806f8d0 0x7ff9e8157500 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0097a0 tx=0x7ff9dc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.931+0000 7ff9eef03640 1 -- 172.21.15.19:0/157191738 shutdown_connections 2024-09-12T02:04:52.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.931+0000 7ff9eef03640 1 --2- 172.21.15.19:0/157191738 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9cc06be30 0x7ff9cc06e2f0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.931+0000 7ff9eef03640 1 --2- 172.21.15.19:0/157191738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e815b300 0x7ff9e8142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.931+0000 7ff9eef03640 1 --2- 172.21.15.19:0/157191738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e80cd3f0 0x7ff9e806e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.931+0000 7ff9eef03640 1 --2- 172.21.15.19:0/157191738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e806f8d0 0x7ff9e8157500 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.931+0000 7ff9eef03640 1 -- 172.21.15.19:0/157191738 >> 172.21.15.19:0/157191738 conn(0x7ff9e8067d70 msgr2=0x7ff9e80cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:52.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.931+0000 7ff9eef03640 1 -- 172.21.15.19:0/157191738 shutdown_connections 2024-09-12T02:04:52.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.931+0000 7ff9eef03640 1 -- 172.21.15.19:0/157191738 wait complete. 2024-09-12T02:04:52.946 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:04:52.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.992+0000 7f0e5051df40 1 Processor -- start 2024-09-12T02:04:52.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.992+0000 7f0e5051df40 1 -- start start 2024-09-12T02:04:52.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.993+0000 7f0e5051df40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560f4affaf30 0x560f4aff3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:52.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.993+0000 7f0e5051df40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560f4b087d20 0x560f4b081860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:52.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.993+0000 7f0e5051df40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f4b088100 0x560f4b081da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:52.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.993+0000 7f0e5051df40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560f4affc6b0 con 0x560f4b087d20 2024-09-12T02:04:52.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.993+0000 7f0e5051df40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560f4af04510 con 0x560f4b088100 2024-09-12T02:04:52.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.993+0000 7f0e5051df40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560f4afb72d0 con 0x560f4affaf30 2024-09-12T02:04:52.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.993+0000 7f0e4cdce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560f4b087d20 0x560f4b081860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:52.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.993+0000 7f0e4cdce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560f4b087d20 0x560f4b081860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43624/0 (socket says 172.21.15.19:43624) 2024-09-12T02:04:52.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.993+0000 7f0e4cdce640 1 -- 172.21.15.19:0/1476228274 learned_addr learned my addr 172.21.15.19:0/1476228274 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:52.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.993+0000 7f0e4d5cf640 1 --2- 172.21.15.19:0/1476228274 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560f4affaf30 0x560f4aff3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:52.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.993+0000 7f0e4cdce640 1 -- 172.21.15.19:0/1476228274 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560f4affaf30 msgr2=0x560f4aff3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:52.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.993+0000 7f0e4cdce640 1 --2- 172.21.15.19:0/1476228274 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560f4affaf30 0x560f4aff3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.993+0000 7f0e4cdce640 1 -- 172.21.15.19:0/1476228274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f4b088100 msgr2=0x560f4b081da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:52.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.993+0000 7f0e4ddd0640 1 --2- 172.21.15.19:0/1476228274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f4b088100 0x560f4b081da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:52.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.993+0000 7f0e4cdce640 1 --2- 172.21.15.19:0/1476228274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f4b088100 0x560f4b081da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.993+0000 7f0e4cdce640 1 -- 172.21.15.19:0/1476228274 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f4b08b190 con 0x560f4b087d20 2024-09-12T02:04:52.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.994+0000 7f0e4cdce640 1 --2- 172.21.15.19:0/1476228274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560f4b087d20 0x560f4b081860 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009760 tx=0x7f0e44009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b2f5d2e18860c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:52.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.994+0000 7f0e3f7fe640 1 -- 172.21.15.19:0/1476228274 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e440090d0 con 0x560f4b087d20 2024-09-12T02:04:52.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.994+0000 7f0e3f7fe640 1 -- 172.21.15.19:0/1476228274 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e44006960 con 0x560f4b087d20 2024-09-12T02:04:52.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.994+0000 7f0e3f7fe640 1 -- 172.21.15.19:0/1476228274 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e44009270 con 0x560f4b087d20 2024-09-12T02:04:52.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.994+0000 7f0e5051df40 1 -- 172.21.15.19:0/1476228274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560f4b087d20 msgr2=0x560f4b081860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:52.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.994+0000 7f0e5051df40 1 --2- 172.21.15.19:0/1476228274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560f4b087d20 0x560f4b081860 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009760 tx=0x7f0e44009c20 comp rx=0 tx=0).stop 2024-09-12T02:04:52.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.994+0000 7f0e5051df40 1 -- 172.21.15.19:0/1476228274 shutdown_connections 2024-09-12T02:04:52.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.994+0000 7f0e5051df40 1 --2- 172.21.15.19:0/1476228274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f4b088100 0x560f4b081da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.994+0000 7f0e5051df40 1 --2- 172.21.15.19:0/1476228274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560f4b087d20 0x560f4b081860 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.994+0000 7f0e5051df40 1 --2- 172.21.15.19:0/1476228274 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560f4affaf30 0x560f4aff3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.994+0000 7f0e5051df40 1 -- 172.21.15.19:0/1476228274 >> 172.21.15.19:0/1476228274 conn(0x560f4afe0490 msgr2=0x560f4affb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:52.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.994+0000 7f0e5051df40 1 -- 172.21.15.19:0/1476228274 shutdown_connections 2024-09-12T02:04:52.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.994+0000 7f0e5051df40 1 -- 172.21.15.19:0/1476228274 wait complete. 2024-09-12T02:04:52.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.995+0000 7f0e5051df40 1 Processor -- start 2024-09-12T02:04:52.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.995+0000 7f0e5051df40 1 -- start start 2024-09-12T02:04:52.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.996+0000 7f0e5051df40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f4affaf30 0x560f4affb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:52.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.996+0000 7f0e5051df40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560f4b087d20 0x560f4b089890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:52.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.996+0000 7f0e5051df40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560f4b088100 0x560f4b089dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.996+0000 7f0e5051df40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560f4aff3db0 con 0x560f4b088100 2024-09-12T02:04:53.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.996+0000 7f0e5051df40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560f4afe0230 con 0x560f4affaf30 2024-09-12T02:04:53.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.996+0000 7f0e5051df40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560f4b07b640 con 0x560f4b087d20 2024-09-12T02:04:53.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.996+0000 7f0e4ddd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560f4b088100 0x560f4b089dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.996+0000 7f0e4ddd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560f4b088100 0x560f4b089dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43630/0 (socket says 172.21.15.19:43630) 2024-09-12T02:04:53.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.996+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 learned_addr learned my addr 172.21.15.19:0/2309738626 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:53.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.996+0000 7f0e4d5cf640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f4affaf30 0x560f4affb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.996+0000 7f0e4cdce640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560f4b087d20 0x560f4b089890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.996+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560f4b087d20 msgr2=0x560f4b089890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.996+0000 7f0e4ddd0640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560f4b087d20 0x560f4b089890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.996+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f4affaf30 msgr2=0x560f4affb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.996+0000 7f0e4ddd0640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f4affaf30 0x560f4affb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.996+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f4affbb50 con 0x560f4b088100 2024-09-12T02:04:53.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.996+0000 7f0e4ddd0640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560f4b088100 0x560f4b089dd0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f0e48006fd0 tx=0x7f0e4800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:53.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.997+0000 7f0e3e7fc640 1 -- 172.21.15.19:0/2309738626 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e480062d0 con 0x560f4b088100 2024-09-12T02:04:53.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.997+0000 7f0e3e7fc640 1 -- 172.21.15.19:0/2309738626 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e48003450 con 0x560f4b088100 2024-09-12T02:04:53.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.997+0000 7f0e3e7fc640 1 -- 172.21.15.19:0/2309738626 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e48003860 con 0x560f4b088100 2024-09-12T02:04:53.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.997+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f4b083600 con 0x560f4b088100 2024-09-12T02:04:53.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.997+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f4b083bc0 con 0x560f4b088100 2024-09-12T02:04:53.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.998+0000 7f0e3e7fc640 1 -- 172.21.15.19:0/2309738626 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e4801a020 con 0x560f4b088100 2024-09-12T02:04:53.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.999+0000 7f0e3e7fc640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0e3006a810 0x7f0e3006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.999+0000 7f0e3e7fc640 1 -- 172.21.15.19:0/2309738626 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 8281+0+0 (secure 0 0 0) 0x7f0e48089fe0 con 0x560f4b088100 2024-09-12T02:04:53.002 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:04:53.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.999+0000 7f0e5051df40 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560f4b087090 0x560f4b084d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.999+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b069210 con 0x560f4b087090 2024-09-12T02:04:53.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.999+0000 7f0e4d5cf640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0e3006a810 0x7f0e3006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.999+0000 7f0e4cdce640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560f4b087090 0x560f4b084d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:52.999+0000 7f0e4cdce640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560f4b087090 0x560f4b084d80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:53.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.000+0000 7f0e4d5cf640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0e3006a810 0x7f0e3006ccd0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0e40057000 tx=0x7f0e4005e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:53.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.001+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v118'722 uv696 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.001+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b0852c0 con 0x560f4b087090 2024-09-12T02:04:53.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.002+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v118'723 uv723 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.002+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12cb30 con 0x560f4b087090 2024-09-12T02:04:53.004 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:04:53.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.003+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v118'724 uv724 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.003+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12dee0 con 0x560f4b087090 2024-09-12T02:04:53.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.004+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v118'725 uv725 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.004+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12e280 con 0x560f4b087090 2024-09-12T02:04:53.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.007+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v118'726 uv726 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.007+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12ced0 con 0x560f4b087090 2024-09-12T02:04:53.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.008+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v118'727 uv727 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.008+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12d270 con 0x560f4b087090 2024-09-12T02:04:53.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.009+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v118'728 uv702 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.009+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12d610 con 0x560f4b087090 2024-09-12T02:04:53.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.011+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v118'729 uv729 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.011+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12d610 con 0x560f4b087090 2024-09-12T02:04:53.012 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:04:53.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.012+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v118'730 uv730 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.012+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12d610 con 0x560f4b087090 2024-09-12T02:04:53.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.013+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v118'731 uv731 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.013+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12d610 con 0x560f4b087090 2024-09-12T02:04:53.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.014+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v118'732 uv732 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.014+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12d610 con 0x560f4b087090 2024-09-12T02:04:53.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.015+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v118'733 uv733 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.015+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12d610 con 0x560f4b087090 2024-09-12T02:04:53.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.016+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v118'734 uv709 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.016+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12d610 con 0x560f4b087090 2024-09-12T02:04:53.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.017+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v118'735 uv735 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.017+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12d610 con 0x560f4b087090 2024-09-12T02:04:53.018 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:04:53.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.018+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v118'736 uv736 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.018+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12d610 con 0x560f4b087090 2024-09-12T02:04:53.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.019+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v118'737 uv737 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.019+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12d610 con 0x560f4b087090 2024-09-12T02:04:53.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.020+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v118'738 uv738 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.020+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12d610 con 0x560f4b087090 2024-09-12T02:04:53.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.021+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v118'739 uv739 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.022+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12e620 con 0x560f4b087090 2024-09-12T02:04:53.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.023+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v118'740 uv740 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.023+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12e620 con 0x560f4b087090 2024-09-12T02:04:53.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.024+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v118'741 uv715 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.024+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12e620 con 0x560f4b087090 2024-09-12T02:04:53.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.025+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v118'742 uv742 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.025+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12e620 con 0x560f4b087090 2024-09-12T02:04:53.026 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:04:53.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.026+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v118'743 uv743 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.026+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12f630 con 0x560f4b087090 2024-09-12T02:04:53.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.027+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v118'744 uv744 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.027+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12f630 con 0x560f4b087090 2024-09-12T02:04:53.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.028+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v118'745 uv745 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.028+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12e620 con 0x560f4b087090 2024-09-12T02:04:53.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.029+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v118'746 uv746 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.029+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12e620 con 0x560f4b087090 2024-09-12T02:04:53.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.030+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v118'747 uv721 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.030+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12e620 con 0x560f4b087090 2024-09-12T02:04:53.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.031+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v118'748 uv748 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.031+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12e620 con 0x560f4b087090 2024-09-12T02:04:53.032 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:04:53.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.032+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v118'749 uv749 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.032+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12f630 con 0x560f4b087090 2024-09-12T02:04:53.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.033+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v118'750 uv750 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.033+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12f630 con 0x560f4b087090 2024-09-12T02:04:53.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.034+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v118'751 uv751 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.034+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b12e620 con 0x560f4b087090 2024-09-12T02:04:53.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.035+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v118'752 uv752 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b087090 2024-09-12T02:04:53.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.035+0000 7f0e5051df40 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560f4b12eb30 0x560f4b130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.035+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b131460 con 0x560f4b12eb30 2024-09-12T02:04:53.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.036+0000 7f0e4d5cf640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560f4b12eb30 0x560f4b130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.036+0000 7f0e4d5cf640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560f4b12eb30 0x560f4b130f20 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:53.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.038+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v118'528 uv527 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.038+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b131800 con 0x560f4b12eb30 2024-09-12T02:04:53.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.039+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v118'529 uv529 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.039+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b131ba0 con 0x560f4b12eb30 2024-09-12T02:04:53.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.041+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v118'530 uv530 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.041 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:04:53.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.041+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1323f0 con 0x560f4b12eb30 2024-09-12T02:04:53.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.042+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v118'531 uv531 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.042+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b132790 con 0x560f4b12eb30 2024-09-12T02:04:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.043+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v118'532 uv532 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.043+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b132b30 con 0x560f4b12eb30 2024-09-12T02:04:53.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.044+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v118'533 uv515 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.044+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b132ed0 con 0x560f4b12eb30 2024-09-12T02:04:53.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.046+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v118'534 uv534 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.046+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b133270 con 0x560f4b12eb30 2024-09-12T02:04:53.047 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:04:53.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.047+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v118'535 uv535 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.047+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b133270 con 0x560f4b12eb30 2024-09-12T02:04:53.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.048+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v118'536 uv536 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.048+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b133270 con 0x560f4b12eb30 2024-09-12T02:04:53.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.049+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v118'537 uv537 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.049+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b133270 con 0x560f4b12eb30 2024-09-12T02:04:53.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.050+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v118'538 uv520 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.050+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b133270 con 0x560f4b12eb30 2024-09-12T02:04:53.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.052+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v118'539 uv539 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.052+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b133270 con 0x560f4b12eb30 2024-09-12T02:04:53.053 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:04:53.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.053+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v118'540 uv540 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.053+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1376f0 con 0x560f4b12eb30 2024-09-12T02:04:53.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.054+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v118'541 uv541 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.054+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1376f0 con 0x560f4b12eb30 2024-09-12T02:04:53.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.055+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v118'542 uv542 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.055+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b133270 con 0x560f4b12eb30 2024-09-12T02:04:53.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.056+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v118'543 uv526 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.056+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b133270 con 0x560f4b12eb30 2024-09-12T02:04:53.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.057+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v118'544 uv544 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.057+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b133270 con 0x560f4b12eb30 2024-09-12T02:04:53.060 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:04:53.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.059+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v118'545 uv545 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.059+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b134280 con 0x560f4b12eb30 2024-09-12T02:04:53.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.060+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v118'546 uv546 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.060+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b134280 con 0x560f4b12eb30 2024-09-12T02:04:53.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.061+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v118'547 uv547 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.061+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b133270 con 0x560f4b12eb30 2024-09-12T02:04:53.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.062+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v118'548 uv548 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b12eb30 2024-09-12T02:04:53.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.062+0000 7f0e5051df40 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560f4b133780 0x560f4b135b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.062+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1360b0 con 0x560f4b133780 2024-09-12T02:04:53.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.062+0000 7f0e4cdce640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560f4b133780 0x560f4b135b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.063+0000 7f0e4cdce640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560f4b133780 0x560f4b135b70 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:53.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.064+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v118'141 uv140 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.064+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1360b0 con 0x560f4b133780 2024-09-12T02:04:53.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.065+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v118'142 uv142 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.065+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1360b0 con 0x560f4b133780 2024-09-12T02:04:53.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.066+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v118'143 uv143 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.066 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:04:53.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.066+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b137100 con 0x560f4b133780 2024-09-12T02:04:53.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.067+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v118'144 uv144 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.067+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1370c0 con 0x560f4b133780 2024-09-12T02:04:53.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.068+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v118'145 uv145 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.068+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1360b0 con 0x560f4b133780 2024-09-12T02:04:53.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.069+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v118'146 uv146 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.069+0000 7f0e5051df40 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560f4b136980 0x560f4b136df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.069+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b139540 con 0x560f4b136980 2024-09-12T02:04:53.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.069+0000 7f0e4ddd0640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560f4b136980 0x560f4b136df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.070+0000 7f0e4ddd0640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560f4b136980 0x560f4b136df0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:53.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.071+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v118'104 uv103 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.071+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1398e0 con 0x560f4b136980 2024-09-12T02:04:53.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.073+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v118'105 uv105 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.073+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b139da0 con 0x560f4b136980 2024-09-12T02:04:53.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.074+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v118'106 uv106 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.074 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:04:53.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.074+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13a660 con 0x560f4b136980 2024-09-12T02:04:53.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.075+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v118'107 uv107 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.075+0000 7f0e5051df40 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560f4b13af10 0x560f4b13d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.075+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13d840 con 0x560f4b13af10 2024-09-12T02:04:53.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.075+0000 7f0e4d5cf640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560f4b13af10 0x560f4b13d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.076+0000 7f0e4d5cf640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560f4b13af10 0x560f4b13d300 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:53.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.077+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v118'141 uv140 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.077+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13d900 con 0x560f4b13af10 2024-09-12T02:04:53.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.078+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v118'142 uv142 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.078+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13dd20 con 0x560f4b13af10 2024-09-12T02:04:53.079 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:04:53.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.079+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v118'143 uv143 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.079+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13ed30 con 0x560f4b13af10 2024-09-12T02:04:53.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.080+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v118'144 uv144 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.080+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13ed30 con 0x560f4b13af10 2024-09-12T02:04:53.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.081+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v118'145 uv145 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.082+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13dd20 con 0x560f4b13af10 2024-09-12T02:04:53.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.083+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v118'146 uv146 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.083+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13dd20 con 0x560f4b136980 2024-09-12T02:04:53.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.084+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v118'260 uv254 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.084+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e0c0 con 0x560f4b136980 2024-09-12T02:04:53.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.085+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v118'261 uv261 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.085+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e460 con 0x560f4b136980 2024-09-12T02:04:53.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.086+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v118'262 uv262 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.087 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:04:53.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.086+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13f810 con 0x560f4b136980 2024-09-12T02:04:53.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.087+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v118'263 uv263 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.087+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13f810 con 0x560f4b136980 2024-09-12T02:04:53.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.088+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v118'264 uv264 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.088+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e800 con 0x560f4b136980 2024-09-12T02:04:53.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.089+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v118'265 uv265 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.089+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e800 con 0x560f4b136980 2024-09-12T02:04:53.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.090+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v118'266 uv259 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.090+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e800 con 0x560f4b136980 2024-09-12T02:04:53.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.091+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v118'267 uv267 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.091+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e800 con 0x560f4b136980 2024-09-12T02:04:53.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.092+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v118'268 uv268 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.093 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:04:53.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.092+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e800 con 0x560f4b136980 2024-09-12T02:04:53.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.093+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v118'269 uv269 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.093+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e800 con 0x560f4b136980 2024-09-12T02:04:53.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.094+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v118'270 uv270 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.094+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e800 con 0x560f4b136980 2024-09-12T02:04:53.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.095+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v118'117 uv116 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.095+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e800 con 0x560f4b136980 2024-09-12T02:04:53.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.096+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v118'118 uv118 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.096+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e800 con 0x560f4b136980 2024-09-12T02:04:53.097 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:04:53.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.097+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v118'119 uv119 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.097+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e800 con 0x560f4b136980 2024-09-12T02:04:53.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.098+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v118'120 uv120 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.098+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e800 con 0x560f4b136980 2024-09-12T02:04:53.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.100+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v118'121 uv121 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0e4805e0b0 con 0x560f4b136980 2024-09-12T02:04:53.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.100+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e800 con 0x560f4b13af10 2024-09-12T02:04:53.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.101+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v118'141 uv140 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.101+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e800 con 0x560f4b13af10 2024-09-12T02:04:53.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.102+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v118'142 uv142 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.102+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e800 con 0x560f4b13af10 2024-09-12T02:04:53.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.103+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v118'143 uv143 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.103 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:04:53.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.103+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13f810 con 0x560f4b13af10 2024-09-12T02:04:53.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.104+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v118'144 uv144 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.104+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13f810 con 0x560f4b13af10 2024-09-12T02:04:53.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.105+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v118'145 uv145 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.105+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e800 con 0x560f4b13af10 2024-09-12T02:04:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.106+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v118'146 uv146 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.106+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e800 con 0x560f4b13af10 2024-09-12T02:04:53.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.107+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v118'233 uv227 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.107+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e800 con 0x560f4b13af10 2024-09-12T02:04:53.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.108+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v118'234 uv234 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.108+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13e800 con 0x560f4b13af10 2024-09-12T02:04:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.109+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v118'235 uv235 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.109 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:04:53.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.109+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13a270 con 0x560f4b13af10 2024-09-12T02:04:53.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.110+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v118'236 uv236 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.110+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13a270 con 0x560f4b13af10 2024-09-12T02:04:53.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.111+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v118'237 uv237 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.111+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13a250 con 0x560f4b13af10 2024-09-12T02:04:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.112+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v118'238 uv232 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.112+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13a250 con 0x560f4b13af10 2024-09-12T02:04:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.113+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v118'239 uv239 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.113+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13a250 con 0x560f4b13af10 2024-09-12T02:04:53.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.114+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v118'240 uv240 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.114 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:04:53.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.114+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13a250 con 0x560f4b13af10 2024-09-12T02:04:53.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.115+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v118'241 uv241 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.115+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b13ed50 con 0x560f4b13af10 2024-09-12T02:04:53.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.116+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v118'242 uv242 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.116+0000 7f0e5051df40 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560f4b13f410 0x560f4b141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.116+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b141d40 con 0x560f4b13f410 2024-09-12T02:04:53.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.117+0000 7f0e4cdce640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560f4b13f410 0x560f4b141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.117+0000 7f0e4cdce640 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560f4b13f410 0x560f4b141800 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:53.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.118+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v118'103 uv102 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b13f410 2024-09-12T02:04:53.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.118+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b141d40 con 0x560f4b13f410 2024-09-12T02:04:53.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.119+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v118'104 uv104 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b13f410 2024-09-12T02:04:53.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.119+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b141d40 con 0x560f4b13f410 2024-09-12T02:04:53.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.122+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v118'105 uv105 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b13f410 2024-09-12T02:04:53.123 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:04:53.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.122+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b13f410 2024-09-12T02:04:53.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.125+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v118'106 uv106 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b13f410 2024-09-12T02:04:53.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.125+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b13af10 2024-09-12T02:04:53.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.127+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v118'141 uv140 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.127+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b13af10 2024-09-12T02:04:53.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.128+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v118'142 uv142 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.128+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b13af10 2024-09-12T02:04:53.130 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:04:53.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.130+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v118'143 uv143 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.130+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b143200 con 0x560f4b13af10 2024-09-12T02:04:53.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.132+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v118'144 uv144 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.132+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b143200 con 0x560f4b13af10 2024-09-12T02:04:53.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.133+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v118'145 uv145 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.133+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b13af10 2024-09-12T02:04:53.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.134+0000 7f0e4d5cf640 1 -- 172.21.15.19:0/2309738626 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v118'146 uv146 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e4006a430 con 0x560f4b13af10 2024-09-12T02:04:53.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.134+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b133780 2024-09-12T02:04:53.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.135+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v118'120 uv119 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.135+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b133780 2024-09-12T02:04:53.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.136+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v118'121 uv121 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.136+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b133780 2024-09-12T02:04:53.138 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:04:53.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.137+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v118'122 uv122 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.138+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b133780 2024-09-12T02:04:53.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.139+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v118'123 uv123 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.139+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b133780 2024-09-12T02:04:53.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.140+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v118'124 uv124 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.140+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b133780 2024-09-12T02:04:53.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.141+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v118'290 uv282 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.141+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b133780 2024-09-12T02:04:53.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.142+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v118'291 uv291 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.142+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b133780 2024-09-12T02:04:53.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.143+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v118'292 uv292 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.144 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:04:53.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.143+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b133780 2024-09-12T02:04:53.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.144+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v118'293 uv293 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.144+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b133780 2024-09-12T02:04:53.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.145+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v118'294 uv294 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.145+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b133780 2024-09-12T02:04:53.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.146+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v118'295 uv289 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.146+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b133780 2024-09-12T02:04:53.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.148+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v118'296 uv296 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.148+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b133780 2024-09-12T02:04:53.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.149+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v118'297 uv297 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.149 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:04:53.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.149+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b143200 con 0x560f4b133780 2024-09-12T02:04:53.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.150+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v118'298 uv298 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.150+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b143200 con 0x560f4b133780 2024-09-12T02:04:53.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.151+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v118'299 uv299 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.151+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b133780 2024-09-12T02:04:53.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.152+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v118'300 uv300 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.152+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x560f4b1421f0 con 0x560f4b133780 2024-09-12T02:04:53.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e4cdce640 1 -- 172.21.15.19:0/2309738626 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v118'301 uv301 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0e44006b10 con 0x560f4b133780 2024-09-12T02:04:53.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560f4b12eb30 msgr2=0x560f4b130f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560f4b12eb30 0x560f4b130f20 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560f4b087090 msgr2=0x560f4b084d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560f4b087090 0x560f4b084d80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560f4b136980 msgr2=0x560f4b136df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560f4b136980 0x560f4b136df0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560f4b13f410 msgr2=0x560f4b141800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560f4b13f410 0x560f4b141800 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560f4b133780 msgr2=0x560f4b135b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560f4b133780 0x560f4b135b70 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560f4b13af10 msgr2=0x560f4b13d300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560f4b13af10 0x560f4b13d300 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 reap_dead start 2024-09-12T02:04:53.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 reap_dead start 2024-09-12T02:04:53.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e4ddd0640 1 -- 172.21.15.19:0/2309738626 reap_dead start 2024-09-12T02:04:53.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0e3006a810 msgr2=0x7f0e3006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0e3006a810 0x7f0e3006ccd0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0e40057000 tx=0x7f0e4005e040 comp rx=0 tx=0).stop 2024-09-12T02:04:53.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560f4b088100 msgr2=0x560f4b089dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560f4b088100 0x560f4b089dd0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f0e48006fd0 tx=0x7f0e4800c520 comp rx=0 tx=0).stop 2024-09-12T02:04:53.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 shutdown_connections 2024-09-12T02:04:53.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0e3006a810 0x7f0e3006ccd0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 --2- 172.21.15.19:0/2309738626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560f4b088100 0x560f4b089dd0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.153+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 >> 172.21.15.19:0/2309738626 conn(0x560f4afe0490 msgr2=0x560f4b0884e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:53.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.154+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 shutdown_connections 2024-09-12T02:04:53.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.154+0000 7f0e5051df40 1 -- 172.21.15.19:0/2309738626 wait complete. 2024-09-12T02:04:53.157 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate 200.00000000 0 2024-09-12T02:04:53.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.242+0000 7ff8da9daf40 1 Processor -- start 2024-09-12T02:04:53.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.242+0000 7ff8da9daf40 1 -- start start 2024-09-12T02:04:53.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.243+0000 7ff8da9daf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f44244180 0x556f442f9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.243+0000 7ff8da9daf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f44272050 0x556f4428b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.243+0000 7ff8da9daf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f442fc080 0x556f4428b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.243+0000 7ff8da9daf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556f44240ae0 con 0x556f442fc080 2024-09-12T02:04:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.243+0000 7ff8da9daf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556f44193510 con 0x556f44272050 2024-09-12T02:04:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.243+0000 7ff8da9daf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556f44240dc0 con 0x556f44244180 2024-09-12T02:04:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.243+0000 7ff8d8cd1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f442fc080 0x556f4428b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.243+0000 7ff8d8cd1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f442fc080 0x556f4428b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43640/0 (socket says 172.21.15.19:43640) 2024-09-12T02:04:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.243+0000 7ff8d8cd1640 1 -- 172.21.15.19:0/790838958 learned_addr learned my addr 172.21.15.19:0/790838958 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.243+0000 7ff8d7ccf640 1 --2- 172.21.15.19:0/790838958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f44272050 0x556f4428b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.243+0000 7ff8d84d0640 1 --2- 172.21.15.19:0/790838958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f44244180 0x556f442f9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.244+0000 7ff8d8cd1640 1 -- 172.21.15.19:0/790838958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f44244180 msgr2=0x556f442f9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.244+0000 7ff8d8cd1640 1 --2- 172.21.15.19:0/790838958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f44244180 0x556f442f9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.244+0000 7ff8d8cd1640 1 -- 172.21.15.19:0/790838958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f44272050 msgr2=0x556f4428b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.244+0000 7ff8d8cd1640 1 --2- 172.21.15.19:0/790838958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f44272050 0x556f4428b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.244+0000 7ff8d8cd1640 1 -- 172.21.15.19:0/790838958 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f4431b7a0 con 0x556f442fc080 2024-09-12T02:04:53.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.244+0000 7ff8d8cd1640 1 --2- 172.21.15.19:0/790838958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f442fc080 0x556f4428b640 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000c4b0 tx=0x7ff8d000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d069db946a1f0bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:53.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.244+0000 7ff8d6ccd640 1 -- 172.21.15.19:0/790838958 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00116b0 con 0x556f442fc080 2024-09-12T02:04:53.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.244+0000 7ff8d6ccd640 1 -- 172.21.15.19:0/790838958 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d0017070 con 0x556f442fc080 2024-09-12T02:04:53.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.244+0000 7ff8d6ccd640 1 -- 172.21.15.19:0/790838958 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0011a90 con 0x556f442fc080 2024-09-12T02:04:53.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.244+0000 7ff8da9daf40 1 -- 172.21.15.19:0/790838958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f442fc080 msgr2=0x556f4428b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.244+0000 7ff8da9daf40 1 --2- 172.21.15.19:0/790838958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f442fc080 0x556f4428b640 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000c4b0 tx=0x7ff8d000c970 comp rx=0 tx=0).stop 2024-09-12T02:04:53.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.244+0000 7ff8da9daf40 1 -- 172.21.15.19:0/790838958 shutdown_connections 2024-09-12T02:04:53.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.244+0000 7ff8da9daf40 1 --2- 172.21.15.19:0/790838958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f442fc080 0x556f4428b640 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.244+0000 7ff8da9daf40 1 --2- 172.21.15.19:0/790838958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f44272050 0x556f4428b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.244+0000 7ff8da9daf40 1 --2- 172.21.15.19:0/790838958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f44244180 0x556f442f9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.244+0000 7ff8da9daf40 1 -- 172.21.15.19:0/790838958 >> 172.21.15.19:0/790838958 conn(0x556f442419e0 msgr2=0x556f4431bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:53.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.244+0000 7ff8da9daf40 1 -- 172.21.15.19:0/790838958 shutdown_connections 2024-09-12T02:04:53.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.244+0000 7ff8da9daf40 1 -- 172.21.15.19:0/790838958 wait complete. 2024-09-12T02:04:53.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.245+0000 7ff8da9daf40 1 Processor -- start 2024-09-12T02:04:53.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.245+0000 7ff8da9daf40 1 -- start start 2024-09-12T02:04:53.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.246+0000 7ff8da9daf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f44244180 0x556f44286c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.246+0000 7ff8da9daf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f44272050 0x556f443b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.246+0000 7ff8da9daf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f442fc080 0x556f443b3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.246+0000 7ff8da9daf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556f442884e0 con 0x556f44272050 2024-09-12T02:04:53.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.246+0000 7ff8da9daf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556f443025a0 con 0x556f442fc080 2024-09-12T02:04:53.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.246+0000 7ff8da9daf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556f442fa380 con 0x556f44244180 2024-09-12T02:04:53.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.246+0000 7ff8d7ccf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f44272050 0x556f443b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.246+0000 7ff8d7ccf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f44272050 0x556f443b32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43652/0 (socket says 172.21.15.19:43652) 2024-09-12T02:04:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.246+0000 7ff8d7ccf640 1 -- 172.21.15.19:0/3953743231 learned_addr learned my addr 172.21.15.19:0/3953743231 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.246+0000 7ff8d84d0640 1 --2- 172.21.15.19:0/3953743231 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f44244180 0x556f44286c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.246+0000 7ff8d8cd1640 1 --2- 172.21.15.19:0/3953743231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f442fc080 0x556f443b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.246+0000 7ff8d7ccf640 1 -- 172.21.15.19:0/3953743231 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f44244180 msgr2=0x556f44286c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.246+0000 7ff8d7ccf640 1 --2- 172.21.15.19:0/3953743231 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556f44244180 0x556f44286c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.246+0000 7ff8d7ccf640 1 -- 172.21.15.19:0/3953743231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f442fc080 msgr2=0x556f443b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.246+0000 7ff8d7ccf640 1 --2- 172.21.15.19:0/3953743231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f442fc080 0x556f443b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.246+0000 7ff8d7ccf640 1 -- 172.21.15.19:0/3953743231 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f4431c5e0 con 0x556f44272050 2024-09-12T02:04:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.246+0000 7ff8d7ccf640 1 --2- 172.21.15.19:0/3953743231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f44272050 0x556f443b32e0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00a5a0 tx=0x7ff8cc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.247+0000 7ff8d5ccb640 1 -- 172.21.15.19:0/3953743231 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc056070 con 0x556f44272050 2024-09-12T02:04:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.247+0000 7ff8d5ccb640 1 -- 172.21.15.19:0/3953743231 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8cc052b50 con 0x556f44272050 2024-09-12T02:04:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.247+0000 7ff8da9daf40 1 -- 172.21.15.19:0/3953743231 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f442f8c20 con 0x556f44272050 2024-09-12T02:04:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.247+0000 7ff8d5ccb640 1 -- 172.21.15.19:0/3953743231 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc05c430 con 0x556f44272050 2024-09-12T02:04:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.247+0000 7ff8da9daf40 1 -- 172.21.15.19:0/3953743231 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f442fc500 con 0x556f44272050 2024-09-12T02:04:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.248+0000 7ff8d5ccb640 1 -- 172.21.15.19:0/3953743231 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff8cc059020 con 0x556f44272050 2024-09-12T02:04:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.248+0000 7ff8d5ccb640 1 --2- 172.21.15.19:0/3953743231 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff8c406a840 0x7ff8c406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.249+0000 7ff8d5ccb640 1 -- 172.21.15.19:0/3953743231 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 8281+0+0 (secure 0 0 0) 0x7ff8cc0ce690 con 0x556f44272050 2024-09-12T02:04:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.249+0000 7ff8d84d0640 1 --2- 172.21.15.19:0/3953743231 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff8c406a840 0x7ff8c406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.249+0000 7ff8da9daf40 1 --2- 172.21.15.19:0/3953743231 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556f442871b0 0x556f442fee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.249+0000 7ff8da9daf40 1 -- 172.21.15.19:0/3953743231 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:1 13.14 13:292cf221:::200.00000000:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x556f442ff340 con 0x556f442871b0 2024-09-12T02:04:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.249+0000 7ff8d8cd1640 1 --2- 172.21.15.19:0/3953743231 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556f442871b0 0x556f442fee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.249+0000 7ff8d84d0640 1 --2- 172.21.15.19:0/3953743231 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff8c406a840 0x7ff8c406cd00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800b6a0 tx=0x7ff8c800d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.249+0000 7ff8d8cd1640 1 --2- 172.21.15.19:0/3953743231 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556f442871b0 0x556f442fee00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.251+0000 7ff8d8cd1640 1 -- 172.21.15.19:0/3953743231 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(1 200.00000000 [truncate 0] v118'549 uv549 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff8d0011730 con 0x556f442871b0 2024-09-12T02:04:53.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.251+0000 7ff8da9daf40 1 -- 172.21.15.19:0/3953743231 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556f442871b0 msgr2=0x556f442fee00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.251+0000 7ff8da9daf40 1 --2- 172.21.15.19:0/3953743231 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556f442871b0 0x556f442fee00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.251+0000 7ff8da9daf40 1 -- 172.21.15.19:0/3953743231 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff8c406a840 msgr2=0x7ff8c406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.251+0000 7ff8da9daf40 1 --2- 172.21.15.19:0/3953743231 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff8c406a840 0x7ff8c406cd00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800b6a0 tx=0x7ff8c800d040 comp rx=0 tx=0).stop 2024-09-12T02:04:53.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.251+0000 7ff8da9daf40 1 -- 172.21.15.19:0/3953743231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f44272050 msgr2=0x556f443b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.251+0000 7ff8da9daf40 1 --2- 172.21.15.19:0/3953743231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f44272050 0x556f443b32e0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00a5a0 tx=0x7ff8cc002fb0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.251+0000 7ff8d8cd1640 1 -- 172.21.15.19:0/3953743231 reap_dead start 2024-09-12T02:04:53.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.251+0000 7ff8da9daf40 1 -- 172.21.15.19:0/3953743231 shutdown_connections 2024-09-12T02:04:53.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.251+0000 7ff8da9daf40 1 -- 172.21.15.19:0/3953743231 >> 172.21.15.19:0/3953743231 conn(0x556f442419e0 msgr2=0x556f44318240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:53.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.251+0000 7ff8da9daf40 1 -- 172.21.15.19:0/3953743231 shutdown_connections 2024-09-12T02:04:53.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.251+0000 7ff8da9daf40 1 -- 172.21.15.19:0/3953743231 wait complete. 2024-09-12T02:04:53.257 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:04:53.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.361+0000 7f1402a4c640 1 Processor -- start 2024-09-12T02:04:53.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.361+0000 7f1402a4c640 1 -- start start 2024-09-12T02:04:53.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.362+0000 7f1402a4c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f13fc06bc10 0x7f13fc06c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.362+0000 7f1402a4c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13fc0ae240 con 0x7f13fc0b5fe0 2024-09-12T02:04:53.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.362+0000 7f1402a4c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13fc0ae520 con 0x7f13fc15e410 2024-09-12T02:04:53.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.362+0000 7f1402a4c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f13fc06c5c0 con 0x7f13fc06bc10 2024-09-12T02:04:53.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.363+0000 7f1400fe9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f13fc06bc10 0x7f13fc06c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.363+0000 7f13f3fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f13fc0b5fe0 0x7f13fc0aff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52334/0 (socket says 172.21.15.19:52334) 2024-09-12T02:04:53.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.363+0000 7f13f3fff640 1 -- 172.21.15.19:0/2990335222 learned_addr learned my addr 172.21.15.19:0/2990335222 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:53.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.363+0000 7f1400fe9640 1 -- 172.21.15.19:0/2990335222 >> v1:172.21.15.135:6789/0 conn(0x7f13fc15e410 legacy=0x7f13fc0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.363+0000 7f1400fe9640 1 -- 172.21.15.19:0/2990335222 >> v1:172.21.15.19:6789/0 conn(0x7f13fc0b5fe0 legacy=0x7f13fc0aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.363+0000 7f1400fe9640 1 -- 172.21.15.19:0/2990335222 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13fc0ae800 con 0x7f13fc06bc10 2024-09-12T02:04:53.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.363+0000 7f13fb7fe640 1 -- 172.21.15.19:0/2990335222 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4179139809 0 0) 0x7f13fc0ae240 con 0x7f13fc0b5fe0 2024-09-12T02:04:53.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.364+0000 7f1400fe9640 1 --2- 172.21.15.19:0/2990335222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13fc06bc10 0x7f13fc06c080 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009d90 tx=0x7f13f402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12486786d5e8566e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:53.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.364+0000 7f13fb7fe640 1 -- 172.21.15.19:0/2990335222 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f4007740 con 0x7f13fc06bc10 2024-09-12T02:04:53.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.364+0000 7f13fb7fe640 1 -- 172.21.15.19:0/2990335222 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f40078e0 con 0x7f13fc06bc10 2024-09-12T02:04:53.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.364+0000 7f13fb7fe640 1 -- 172.21.15.19:0/2990335222 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f4007cb0 con 0x7f13fc06bc10 2024-09-12T02:04:53.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.364+0000 7f1402a4c640 1 -- 172.21.15.19:0/2990335222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13fc06bc10 msgr2=0x7f13fc06c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.364+0000 7f1402a4c640 1 --2- 172.21.15.19:0/2990335222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13fc06bc10 0x7f13fc06c080 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009d90 tx=0x7f13f402a660 comp rx=0 tx=0).stop 2024-09-12T02:04:53.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.364+0000 7f1402a4c640 1 -- 172.21.15.19:0/2990335222 shutdown_connections 2024-09-12T02:04:53.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.364+0000 7f1402a4c640 1 --2- 172.21.15.19:0/2990335222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13fc06bc10 0x7f13fc06c080 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.365+0000 7f1402a4c640 1 -- 172.21.15.19:0/2990335222 >> 172.21.15.19:0/2990335222 conn(0x7f13fc09aa30 msgr2=0x7f13fc0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:53.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.365+0000 7f1402a4c640 1 -- 172.21.15.19:0/2990335222 shutdown_connections 2024-09-12T02:04:53.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.365+0000 7f1402a4c640 1 -- 172.21.15.19:0/2990335222 wait complete. 2024-09-12T02:04:53.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.366+0000 7f1402a4c640 1 Processor -- start 2024-09-12T02:04:53.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.366+0000 7f1402a4c640 1 -- start start 2024-09-12T02:04:53.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.366+0000 7f1402a4c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13fc06bc10 0x7f13fc0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.366+0000 7f1402a4c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13fc0b5fe0 0x7f13fc159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.366+0000 7f1402a4c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13fc15e410 0x7f13fc0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f1402a4c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc15e7f0 con 0x7f13fc06bc10 2024-09-12T02:04:53.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f1402a4c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc15e970 con 0x7f13fc15e410 2024-09-12T02:04:53.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f1402a4c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f13fc0aefe0 con 0x7f13fc0b5fe0 2024-09-12T02:04:53.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f13fbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13fc06bc10 0x7f13fc0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f13fbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13fc06bc10 0x7f13fc0afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43672/0 (socket says 172.21.15.19:43672) 2024-09-12T02:04:53.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f13fbfff640 1 -- 172.21.15.19:0/3867147877 learned_addr learned my addr 172.21.15.19:0/3867147877 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:53.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f13f3fff640 1 --2- 172.21.15.19:0/3867147877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13fc0b5fe0 0x7f13fc159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f1400fe9640 1 --2- 172.21.15.19:0/3867147877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13fc15e410 0x7f13fc0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f13fbfff640 1 -- 172.21.15.19:0/3867147877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13fc0b5fe0 msgr2=0x7f13fc159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f13fbfff640 1 --2- 172.21.15.19:0/3867147877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13fc0b5fe0 0x7f13fc159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f13fbfff640 1 -- 172.21.15.19:0/3867147877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13fc15e410 msgr2=0x7f13fc0b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f13fbfff640 1 --2- 172.21.15.19:0/3867147877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13fc15e410 0x7f13fc0b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f13fbfff640 1 -- 172.21.15.19:0/3867147877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13fc0b08c0 con 0x7f13fc06bc10 2024-09-12T02:04:53.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f13f3fff640 1 --2- 172.21.15.19:0/3867147877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13fc0b5fe0 0x7f13fc159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:53.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f1400fe9640 1 --2- 172.21.15.19:0/3867147877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13fc15e410 0x7f13fc0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:53.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f13fbfff640 1 --2- 172.21.15.19:0/3867147877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13fc06bc10 0x7f13fc0afd80 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00c400 tx=0x7f13ec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:53.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f13f97fa640 1 -- 172.21.15.19:0/3867147877 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec017070 con 0x7f13fc06bc10 2024-09-12T02:04:53.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f13f97fa640 1 -- 172.21.15.19:0/3867147877 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13ec0052d0 con 0x7f13fc06bc10 2024-09-12T02:04:53.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f1402a4c640 1 -- 172.21.15.19:0/3867147877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13fc0b0ba0 con 0x7f13fc06bc10 2024-09-12T02:04:53.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f13f97fa640 1 -- 172.21.15.19:0/3867147877 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec003830 con 0x7f13fc06bc10 2024-09-12T02:04:53.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.367+0000 7f1402a4c640 1 -- 172.21.15.19:0/3867147877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13fc0b1680 con 0x7f13fc06bc10 2024-09-12T02:04:53.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.368+0000 7f1402a4c640 1 -- 172.21.15.19:0/3867147877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13fc06c080 con 0x7f13fc06bc10 2024-09-12T02:04:53.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.369+0000 7f13f97fa640 1 -- 172.21.15.19:0/3867147877 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f13ec01a070 con 0x7f13fc06bc10 2024-09-12T02:04:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.369+0000 7f13f97fa640 1 --2- 172.21.15.19:0/3867147877 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f13dc06be30 0x7f13dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.370+0000 7f13f97fa640 1 -- 172.21.15.19:0/3867147877 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 8281+0+0 (secure 0 0 0) 0x7f13ec08abf0 con 0x7f13fc06bc10 2024-09-12T02:04:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.370+0000 7f13f3fff640 1 --2- 172.21.15.19:0/3867147877 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f13dc06be30 0x7f13dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.370+0000 7f13f3fff640 1 --2- 172.21.15.19:0/3867147877 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f13dc06be30 0x7f13dc06e2f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0b56c0 tx=0x7f13e4007c70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:53.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.374+0000 7f13f97fa640 1 -- 172.21.15.19:0/3867147877 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f13ec058b40 con 0x7f13fc06bc10 2024-09-12T02:04:53.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.590+0000 7f1402a4c640 1 -- 172.21.15.19:0/3867147877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f13fc0b1940 con 0x7f13fc06bc10 2024-09-12T02:04:53.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.935+0000 7f13f97fa640 1 -- 172.21.15.19:0/3867147877 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v220) ==== 162+0+0 (secure 0 0 0) 0x7f13ec058440 con 0x7f13fc06bc10 2024-09-12T02:04:53.936 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:04:53.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.938+0000 7f1402a4c640 1 -- 172.21.15.19:0/3867147877 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f13dc06be30 msgr2=0x7f13dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.938+0000 7f1402a4c640 1 --2- 172.21.15.19:0/3867147877 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f13dc06be30 0x7f13dc06e2f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0b56c0 tx=0x7f13e4007c70 comp rx=0 tx=0).stop 2024-09-12T02:04:53.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.938+0000 7f1402a4c640 1 -- 172.21.15.19:0/3867147877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13fc06bc10 msgr2=0x7f13fc0afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:53.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.938+0000 7f1402a4c640 1 --2- 172.21.15.19:0/3867147877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13fc06bc10 0x7f13fc0afd80 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00c400 tx=0x7f13ec00c8c0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.938+0000 7f1402a4c640 1 -- 172.21.15.19:0/3867147877 shutdown_connections 2024-09-12T02:04:53.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.938+0000 7f1402a4c640 1 --2- 172.21.15.19:0/3867147877 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f13dc06be30 0x7f13dc06e2f0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.938+0000 7f1402a4c640 1 --2- 172.21.15.19:0/3867147877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13fc15e410 0x7f13fc0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.938+0000 7f1402a4c640 1 --2- 172.21.15.19:0/3867147877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13fc0b5fe0 0x7f13fc159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.938+0000 7f1402a4c640 1 --2- 172.21.15.19:0/3867147877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13fc06bc10 0x7f13fc0afd80 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:53.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.938+0000 7f1402a4c640 1 -- 172.21.15.19:0/3867147877 >> 172.21.15.19:0/3867147877 conn(0x7f13fc09aa30 msgr2=0x7f13fc070800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:53.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.938+0000 7f1402a4c640 1 -- 172.21.15.19:0/3867147877 shutdown_connections 2024-09-12T02:04:53.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:53.938+0000 7f1402a4c640 1 -- 172.21.15.19:0/3867147877 wait complete. 2024-09-12T02:04:53.947 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:04:53.946+0000 7fb486e7e640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2024-09-12T02:04:53.948 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:53.948+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:04:53.948 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:53.948+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:04:53.951 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:54.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.053+0000 7f16cb3cf640 1 Processor -- start 2024-09-12T02:04:54.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.054+0000 7f16cb3cf640 1 -- start start 2024-09-12T02:04:54.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.054+0000 7f16cb3cf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c40b6680 0x7f16c4169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.054+0000 7f16cb3cf640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16c406d9f0 con 0x7f16c4162060 2024-09-12T02:04:54.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.054+0000 7f16cb3cf640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16c406dcd0 con 0x7f16c4161c80 2024-09-12T02:04:54.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.054+0000 7f16cb3cf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f16c406dfb0 con 0x7f16c40b6680 2024-09-12T02:04:54.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.055+0000 7f16c896a640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f16c4162060 0x7f16c40b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52350/0 (socket says 172.21.15.19:52350) 2024-09-12T02:04:54.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.055+0000 7f16c896a640 1 -- 172.21.15.19:0/2387537778 learned_addr learned my addr 172.21.15.19:0/2387537778 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:54.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.055+0000 7f16c996c640 1 --2- 172.21.15.19:0/2387537778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c40b6680 0x7f16c4169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.055+0000 7f16bbfff640 1 -- 172.21.15.19:0/2387537778 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3880548610 0 0) 0x7f16c406d9f0 con 0x7f16c4162060 2024-09-12T02:04:54.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.055+0000 7f16bbfff640 1 -- 172.21.15.19:0/2387537778 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16b0003520 con 0x7f16c4162060 2024-09-12T02:04:54.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.055+0000 7f16bbfff640 1 -- 172.21.15.19:0/2387537778 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 35777353 0 0) 0x7f16c406dcd0 con 0x7f16c4161c80 2024-09-12T02:04:54.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.055+0000 7f16bbfff640 1 -- 172.21.15.19:0/2387537778 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16c406d9f0 con 0x7f16c4161c80 2024-09-12T02:04:54.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.055+0000 7f16c996c640 1 -- 172.21.15.19:0/2387537778 >> v1:172.21.15.135:6789/0 conn(0x7f16c4161c80 legacy=0x7f16c406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.055+0000 7f16bbfff640 1 -- 172.21.15.19:0/2387537778 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1016390548 0 0) 0x7f16b0003520 con 0x7f16c4162060 2024-09-12T02:04:54.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.055+0000 7f16c996c640 1 -- 172.21.15.19:0/2387537778 >> v1:172.21.15.19:6789/0 conn(0x7f16c4162060 legacy=0x7f16c40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.055+0000 7f16c996c640 1 -- 172.21.15.19:0/2387537778 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c40d01f0 con 0x7f16c40b6680 2024-09-12T02:04:54.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.056+0000 7f16c996c640 1 --2- 172.21.15.19:0/2387537778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c40b6680 0x7f16c4169830 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0097d0 tx=0x7f16bc02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29f1d406df678d59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:54.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.056+0000 7f16bbfff640 1 -- 172.21.15.19:0/2387537778 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc037070 con 0x7f16c40b6680 2024-09-12T02:04:54.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.056+0000 7f16bbfff640 1 -- 172.21.15.19:0/2387537778 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16bc02ac30 con 0x7f16c40b6680 2024-09-12T02:04:54.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.056+0000 7f16bbfff640 1 -- 172.21.15.19:0/2387537778 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4001670 con 0x7f16c40b6680 2024-09-12T02:04:54.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.057+0000 7f16cb3cf640 1 -- 172.21.15.19:0/2387537778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c40b6680 msgr2=0x7f16c4169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.057+0000 7f16cb3cf640 1 --2- 172.21.15.19:0/2387537778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c40b6680 0x7f16c4169830 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0097d0 tx=0x7f16bc02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.057+0000 7f16cb3cf640 1 -- 172.21.15.19:0/2387537778 shutdown_connections 2024-09-12T02:04:54.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.057+0000 7f16cb3cf640 1 --2- 172.21.15.19:0/2387537778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c40b6680 0x7f16c4169830 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.057+0000 7f16cb3cf640 1 -- 172.21.15.19:0/2387537778 >> 172.21.15.19:0/2387537778 conn(0x7f16c40d44f0 msgr2=0x7f16c40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:54.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.057+0000 7f16cb3cf640 1 -- 172.21.15.19:0/2387537778 shutdown_connections 2024-09-12T02:04:54.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.057+0000 7f16cb3cf640 1 -- 172.21.15.19:0/2387537778 wait complete. 2024-09-12T02:04:54.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.058+0000 7f16cb3cf640 1 Processor -- start 2024-09-12T02:04:54.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.058+0000 7f16cb3cf640 1 -- start start 2024-09-12T02:04:54.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.059+0000 7f16cb3cf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16c40b6680 0x7f16c4158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.059+0000 7f16cb3cf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c4161c80 0x7f16c4155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.059+0000 7f16cb3cf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16c4162060 0x7f16c4159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.059+0000 7f16cb3cf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f16c40b6cb0 con 0x7f16c4162060 2024-09-12T02:04:54.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.059+0000 7f16cb3cf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f16c40b6b30 con 0x7f16c40b6680 2024-09-12T02:04:54.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.059+0000 7f16cb3cf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f16c4169d70 con 0x7f16c4161c80 2024-09-12T02:04:54.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.059+0000 7f16c996c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16c4162060 0x7f16c4159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.059+0000 7f16c996c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16c4162060 0x7f16c4159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43674/0 (socket says 172.21.15.19:43674) 2024-09-12T02:04:54.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.059+0000 7f16c996c640 1 -- 172.21.15.19:0/1046453907 learned_addr learned my addr 172.21.15.19:0/1046453907 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.059+0000 7f16c916b640 1 --2- 172.21.15.19:0/1046453907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16c40b6680 0x7f16c4158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.059+0000 7f16c896a640 1 --2- 172.21.15.19:0/1046453907 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c4161c80 0x7f16c4155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.059+0000 7f16c996c640 1 -- 172.21.15.19:0/1046453907 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c4161c80 msgr2=0x7f16c4155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.059+0000 7f16c996c640 1 --2- 172.21.15.19:0/1046453907 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c4161c80 0x7f16c4155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.059+0000 7f16c996c640 1 -- 172.21.15.19:0/1046453907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16c40b6680 msgr2=0x7f16c4158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.059+0000 7f16c996c640 1 --2- 172.21.15.19:0/1046453907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16c40b6680 0x7f16c4158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.059+0000 7f16c996c640 1 -- 172.21.15.19:0/1046453907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c40c80f0 con 0x7f16c4162060 2024-09-12T02:04:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.059+0000 7f16c996c640 1 --2- 172.21.15.19:0/1046453907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16c4162060 0x7f16c4159970 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0097d0 tx=0x7f16bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.059+0000 7f16b9ffb640 1 -- 172.21.15.19:0/1046453907 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc037050 con 0x7f16c4162060 2024-09-12T02:04:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.060+0000 7f16b9ffb640 1 -- 172.21.15.19:0/1046453907 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16bc038040 con 0x7f16c4162060 2024-09-12T02:04:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.060+0000 7f16cb3cf640 1 -- 172.21.15.19:0/1046453907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c40c83d0 con 0x7f16c4162060 2024-09-12T02:04:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.060+0000 7f16b9ffb640 1 -- 172.21.15.19:0/1046453907 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc006e10 con 0x7f16c4162060 2024-09-12T02:04:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.060+0000 7f16cb3cf640 1 -- 172.21.15.19:0/1046453907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c40c8990 con 0x7f16c4162060 2024-09-12T02:04:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.061+0000 7f16cb3cf640 1 -- 172.21.15.19:0/1046453907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16c40b5f70 con 0x7f16c4162060 2024-09-12T02:04:54.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.061+0000 7f16b9ffb640 1 -- 172.21.15.19:0/1046453907 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f16bc003610 con 0x7f16c4162060 2024-09-12T02:04:54.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.062+0000 7f16b9ffb640 1 --2- 172.21.15.19:0/1046453907 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f16a806be30 0x7f16a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.062+0000 7f16b9ffb640 1 -- 172.21.15.19:0/1046453907 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8367+0+0 (secure 0 0 0) 0x7f16bc0ac080 con 0x7f16c4162060 2024-09-12T02:04:54.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.062+0000 7f16c916b640 1 --2- 172.21.15.19:0/1046453907 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f16a806be30 0x7f16a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.062+0000 7f16c916b640 1 --2- 172.21.15.19:0/1046453907 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f16a806be30 0x7f16a806e2f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f16c0001560 tx=0x7f16c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:54.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.066+0000 7f16b9ffb640 1 -- 172.21.15.19:0/1046453907 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f16bc079fb0 con 0x7f16c4162060 2024-09-12T02:04:54.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.278+0000 7f16cb3cf640 1 -- 172.21.15.19:0/1046453907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16c40ba470 con 0x7f16c4162060 2024-09-12T02:04:54.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.278+0000 7f16b9ffb640 1 -- 172.21.15.19:0/1046453907 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 222 v222) ==== 95+0+3563 (secure 0 0 0) 0x7f16bc0798b0 con 0x7f16c4162060 2024-09-12T02:04:54.279 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:54.279 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":222,"btime":"2024-09-12T02:04:53:949349+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":222,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:53.949283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:54.279 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 222 2024-09-12T02:04:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.280+0000 7f16cb3cf640 1 -- 172.21.15.19:0/1046453907 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f16a806be30 msgr2=0x7f16a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.280+0000 7f16cb3cf640 1 --2- 172.21.15.19:0/1046453907 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f16a806be30 0x7f16a806e2f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f16c0001560 tx=0x7f16c0009040 comp rx=0 tx=0).stop 2024-09-12T02:04:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.280+0000 7f16cb3cf640 1 -- 172.21.15.19:0/1046453907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16c4162060 msgr2=0x7f16c4159970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.280+0000 7f16cb3cf640 1 --2- 172.21.15.19:0/1046453907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16c4162060 0x7f16c4159970 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0097d0 tx=0x7f16bc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.280+0000 7f16cb3cf640 1 -- 172.21.15.19:0/1046453907 shutdown_connections 2024-09-12T02:04:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.280+0000 7f16cb3cf640 1 --2- 172.21.15.19:0/1046453907 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f16a806be30 0x7f16a806e2f0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.280+0000 7f16cb3cf640 1 --2- 172.21.15.19:0/1046453907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16c4162060 0x7f16c4159970 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.280+0000 7f16cb3cf640 1 --2- 172.21.15.19:0/1046453907 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c4161c80 0x7f16c4155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.280+0000 7f16cb3cf640 1 --2- 172.21.15.19:0/1046453907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16c40b6680 0x7f16c4158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.280+0000 7f16cb3cf640 1 -- 172.21.15.19:0/1046453907 >> 172.21.15.19:0/1046453907 conn(0x7f16c40d44f0 msgr2=0x7f16c40b5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:54.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.280+0000 7f16cb3cf640 1 -- 172.21.15.19:0/1046453907 shutdown_connections 2024-09-12T02:04:54.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.280+0000 7f16cb3cf640 1 -- 172.21.15.19:0/1046453907 wait complete. 2024-09-12T02:04:54.292 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:54.292 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:54.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.394+0000 7f8f76911640 1 Processor -- start 2024-09-12T02:04:54.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.394+0000 7f8f76911640 1 -- start start 2024-09-12T02:04:54.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.395+0000 7f8f76911640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f7015c520 0x7f8f7009b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.395+0000 7f8f76911640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f700cec00 con 0x7f8f700d1090 2024-09-12T02:04:54.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.395+0000 7f8f76911640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f7009bd90 con 0x7f8f700b1620 2024-09-12T02:04:54.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.395+0000 7f8f76911640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8f700d0010 con 0x7f8f7015c520 2024-09-12T02:04:54.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.395+0000 7f8f6ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f7015c520 0x7f8f7009b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.395+0000 7f8f74eae640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8f700d1090 0x7f8f700cd570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52366/0 (socket says 172.21.15.19:52366) 2024-09-12T02:04:54.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.395+0000 7f8f6ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f7015c520 0x7f8f7009b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43686/0 (socket says 172.21.15.19:43686) 2024-09-12T02:04:54.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.395+0000 7f8f74eae640 1 -- 172.21.15.19:0/4037191663 learned_addr learned my addr 172.21.15.19:0/4037191663 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:54.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.396+0000 7f8f6ffff640 1 -- 172.21.15.19:0/4037191663 >> v1:172.21.15.135:6789/0 conn(0x7f8f700b1620 legacy=0x7f8f700d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.396+0000 7f8f6ffff640 1 -- 172.21.15.19:0/4037191663 >> v1:172.21.15.19:6789/0 conn(0x7f8f700d1090 legacy=0x7f8f700cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.396+0000 7f8f6ffff640 1 -- 172.21.15.19:0/4037191663 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f700d02f0 con 0x7f8f7015c520 2024-09-12T02:04:54.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.396+0000 7f8f6effd640 1 -- 172.21.15.19:0/4037191663 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4237310742 0 0) 0x7f8f700cec00 con 0x7f8f700d1090 2024-09-12T02:04:54.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.396+0000 7f8f6ffff640 1 --2- 172.21.15.19:0/4037191663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f7015c520 0x7f8f7009b720 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f8f600097a0 tx=0x7f8f6002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f797d14a420fd8b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:54.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.397+0000 7f8f6effd640 1 -- 172.21.15.19:0/4037191663 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f60037070 con 0x7f8f7015c520 2024-09-12T02:04:54.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.397+0000 7f8f6effd640 1 -- 172.21.15.19:0/4037191663 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f60032440 con 0x7f8f7015c520 2024-09-12T02:04:54.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.397+0000 7f8f6effd640 1 -- 172.21.15.19:0/4037191663 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f60032810 con 0x7f8f7015c520 2024-09-12T02:04:54.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.397+0000 7f8f76911640 1 -- 172.21.15.19:0/4037191663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f7015c520 msgr2=0x7f8f7009b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.397+0000 7f8f76911640 1 --2- 172.21.15.19:0/4037191663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f7015c520 0x7f8f7009b720 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f8f600097a0 tx=0x7f8f6002a230 comp rx=0 tx=0).stop 2024-09-12T02:04:54.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.397+0000 7f8f76911640 1 -- 172.21.15.19:0/4037191663 shutdown_connections 2024-09-12T02:04:54.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.397+0000 7f8f76911640 1 --2- 172.21.15.19:0/4037191663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f7015c520 0x7f8f7009b720 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.397+0000 7f8f76911640 1 -- 172.21.15.19:0/4037191663 >> 172.21.15.19:0/4037191663 conn(0x7f8f700d23a0 msgr2=0x7f8f700d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:54.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.397+0000 7f8f76911640 1 -- 172.21.15.19:0/4037191663 shutdown_connections 2024-09-12T02:04:54.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.397+0000 7f8f76911640 1 -- 172.21.15.19:0/4037191663 wait complete. 2024-09-12T02:04:54.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.398+0000 7f8f76911640 1 Processor -- start 2024-09-12T02:04:54.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.399+0000 7f8f76911640 1 -- start start 2024-09-12T02:04:54.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.399+0000 7f8f76911640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f700b1620 0x7f8f700ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.399+0000 7f8f76911640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f700d1090 0x7f8f7014e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.399+0000 7f8f76911640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f7015c520 0x7f8f700c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.399+0000 7f8f76911640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7015c900 con 0x7f8f700d1090 2024-09-12T02:04:54.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.399+0000 7f8f76911640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8f700d05d0 con 0x7f8f7015c520 2024-09-12T02:04:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.399+0000 7f8f76911640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8f700ca6e0 con 0x7f8f700b1620 2024-09-12T02:04:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.399+0000 7f8f6f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f700d1090 0x7f8f7014e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.399+0000 7f8f6f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f700d1090 0x7f8f7014e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43688/0 (socket says 172.21.15.19:43688) 2024-09-12T02:04:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.399+0000 7f8f6f7fe640 1 -- 172.21.15.19:0/2184852102 learned_addr learned my addr 172.21.15.19:0/2184852102 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.399+0000 7f8f6ffff640 1 --2- 172.21.15.19:0/2184852102 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f700b1620 0x7f8f700ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.400+0000 7f8f74eae640 1 --2- 172.21.15.19:0/2184852102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f7015c520 0x7f8f700c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.400+0000 7f8f6f7fe640 1 -- 172.21.15.19:0/2184852102 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f700b1620 msgr2=0x7f8f700ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.400+0000 7f8f6f7fe640 1 --2- 172.21.15.19:0/2184852102 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f700b1620 0x7f8f700ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.400+0000 7f8f6f7fe640 1 -- 172.21.15.19:0/2184852102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f7015c520 msgr2=0x7f8f700c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.400+0000 7f8f6f7fe640 1 --2- 172.21.15.19:0/2184852102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f7015c520 0x7f8f700c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.400+0000 7f8f6f7fe640 1 -- 172.21.15.19:0/2184852102 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f700c8ee0 con 0x7f8f700d1090 2024-09-12T02:04:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.400+0000 7f8f74eae640 1 --2- 172.21.15.19:0/2184852102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f7015c520 0x7f8f700c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.400+0000 7f8f6f7fe640 1 --2- 172.21.15.19:0/2184852102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f700d1090 0x7f8f7014e6d0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400c450 tx=0x7f8f6400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.400+0000 7f8f6cff9640 1 -- 172.21.15.19:0/2184852102 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f640052d0 con 0x7f8f700d1090 2024-09-12T02:04:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.400+0000 7f8f6cff9640 1 -- 172.21.15.19:0/2184852102 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f64005470 con 0x7f8f700d1090 2024-09-12T02:04:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.400+0000 7f8f6cff9640 1 -- 172.21.15.19:0/2184852102 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f64012870 con 0x7f8f700d1090 2024-09-12T02:04:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.400+0000 7f8f76911640 1 -- 172.21.15.19:0/2184852102 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f700c96c0 con 0x7f8f700d1090 2024-09-12T02:04:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.400+0000 7f8f76911640 1 -- 172.21.15.19:0/2184852102 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f700c9c80 con 0x7f8f700d1090 2024-09-12T02:04:54.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.401+0000 7f8f76911640 1 -- 172.21.15.19:0/2184852102 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f7009b720 con 0x7f8f700d1090 2024-09-12T02:04:54.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.402+0000 7f8f6cff9640 1 -- 172.21.15.19:0/2184852102 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f64012a10 con 0x7f8f700d1090 2024-09-12T02:04:54.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.402+0000 7f8f6cff9640 1 --2- 172.21.15.19:0/2184852102 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8f5c06be30 0x7f8f5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.402+0000 7f8f6cff9640 1 -- 172.21.15.19:0/2184852102 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8367+0+0 (secure 0 0 0) 0x7f8f6408b480 con 0x7f8f700d1090 2024-09-12T02:04:54.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.402+0000 7f8f6ffff640 1 --2- 172.21.15.19:0/2184852102 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8f5c06be30 0x7f8f5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.403+0000 7f8f6ffff640 1 --2- 172.21.15.19:0/2184852102 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8f5c06be30 0x7f8f5c06e2f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8f60034000 tx=0x7f8f6002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:54.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.407+0000 7f8f6cff9640 1 -- 172.21.15.19:0/2184852102 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f64059380 con 0x7f8f700d1090 2024-09-12T02:04:54.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.619+0000 7f8f76911640 1 -- 172.21.15.19:0/2184852102 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f700b8320 con 0x7f8f700d1090 2024-09-12T02:04:54.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.620+0000 7f8f6cff9640 1 -- 172.21.15.19:0/2184852102 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 222 v222) ==== 95+0+3563 (secure 0 0 0) 0x7f8f64058c80 con 0x7f8f700d1090 2024-09-12T02:04:54.621 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:54.621 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":222,"btime":"2024-09-12T02:04:53:949349+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":222,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:53.949283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:54.621 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 222 2024-09-12T02:04:54.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.622+0000 7f8f76911640 1 -- 172.21.15.19:0/2184852102 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8f5c06be30 msgr2=0x7f8f5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.622+0000 7f8f76911640 1 --2- 172.21.15.19:0/2184852102 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8f5c06be30 0x7f8f5c06e2f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8f60034000 tx=0x7f8f6002e000 comp rx=0 tx=0).stop 2024-09-12T02:04:54.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.622+0000 7f8f76911640 1 -- 172.21.15.19:0/2184852102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f700d1090 msgr2=0x7f8f7014e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.622+0000 7f8f76911640 1 --2- 172.21.15.19:0/2184852102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f700d1090 0x7f8f7014e6d0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400c450 tx=0x7f8f6400c910 comp rx=0 tx=0).stop 2024-09-12T02:04:54.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.622+0000 7f8f76911640 1 -- 172.21.15.19:0/2184852102 shutdown_connections 2024-09-12T02:04:54.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.622+0000 7f8f76911640 1 --2- 172.21.15.19:0/2184852102 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8f5c06be30 0x7f8f5c06e2f0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.622+0000 7f8f76911640 1 --2- 172.21.15.19:0/2184852102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f7015c520 0x7f8f700c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.622+0000 7f8f76911640 1 --2- 172.21.15.19:0/2184852102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f700d1090 0x7f8f7014e6d0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.622+0000 7f8f76911640 1 --2- 172.21.15.19:0/2184852102 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f700b1620 0x7f8f700ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.622+0000 7f8f76911640 1 -- 172.21.15.19:0/2184852102 >> 172.21.15.19:0/2184852102 conn(0x7f8f700d23a0 msgr2=0x7f8f700d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:54.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.622+0000 7f8f76911640 1 -- 172.21.15.19:0/2184852102 shutdown_connections 2024-09-12T02:04:54.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.622+0000 7f8f76911640 1 -- 172.21.15.19:0/2184852102 wait complete. 2024-09-12T02:04:54.634 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:54.634 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:54.658 INFO:tasks.ceph.mds.c.smithi019.stderr: -38> 2024-09-12T02:04:49.906+0000 7f10c51f7640 -1 mds.0.cache.ino(0x1) No data while reading inode 0x1 2024-09-12T02:04:54.658 INFO:tasks.ceph.mds.c.smithi019.stderr: -36> 2024-09-12T02:04:49.906+0000 7f10c51f7640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2024-09-12T02:04:54.682 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:04:54.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.739+0000 7ffbf30af640 1 Processor -- start 2024-09-12T02:04:54.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.739+0000 7ffbf30af640 1 -- start start 2024-09-12T02:04:54.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.740+0000 7ffbf30af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec162060 0x7ffbec0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.740+0000 7ffbf30af640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffbec0b64b0 0x7ffbec0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.740+0000 7ffbf30af640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbec06d9f0 con 0x7ffbec161c80 2024-09-12T02:04:54.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.740+0000 7ffbf30af640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ffbec06dcd0 con 0x7ffbec0b64b0 2024-09-12T02:04:54.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.740+0000 7ffbf30af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ffbec06dfb0 con 0x7ffbec162060 2024-09-12T02:04:54.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.740+0000 7ffbebfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec162060 0x7ffbec0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.740+0000 7ffbf164c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffbec0b64b0 0x7ffbec0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.740+0000 7ffbf0e4b640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7ffbec161c80 0x7ffbec06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:51346/0 (socket says 172.21.15.19:51346) 2024-09-12T02:04:54.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.740+0000 7ffbf0e4b640 1 -- 172.21.15.19:0/2910148379 learned_addr learned my addr 172.21.15.19:0/2910148379 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:54.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.740+0000 7ffbf164c640 1 -- 172.21.15.19:0/2910148379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec162060 msgr2=0x7ffbec0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:54.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.740+0000 7ffbf164c640 1 --2- 172.21.15.19:0/2910148379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec162060 0x7ffbec0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.740+0000 7ffbf164c640 1 -- 172.21.15.19:0/2910148379 >> v1:172.21.15.135:6789/0 conn(0x7ffbec161c80 legacy=0x7ffbec06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.740+0000 7ffbf164c640 1 -- 172.21.15.19:0/2910148379 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbec0d01f0 con 0x7ffbec0b64b0 2024-09-12T02:04:54.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.740+0000 7ffbeb7fe640 1 -- 172.21.15.19:0/2910148379 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2107602456 0 0) 0x7ffbec06d9f0 con 0x7ffbec161c80 2024-09-12T02:04:54.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.741+0000 7ffbf164c640 1 --2- 172.21.15.19:0/2910148379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbec0b64b0 0x7ffbec0b6960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009d90 tx=0x7ffbe402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84d58fffae7042b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:54.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.741+0000 7ffbeb7fe640 1 -- 172.21.15.19:0/2910148379 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4007740 con 0x7ffbec0b64b0 2024-09-12T02:04:54.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.741+0000 7ffbeb7fe640 1 -- 172.21.15.19:0/2910148379 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbe40078e0 con 0x7ffbec0b64b0 2024-09-12T02:04:54.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.741+0000 7ffbeb7fe640 1 -- 172.21.15.19:0/2910148379 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4007cb0 con 0x7ffbec0b64b0 2024-09-12T02:04:54.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.742+0000 7ffbf30af640 1 -- 172.21.15.19:0/2910148379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbec0b64b0 msgr2=0x7ffbec0b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.742+0000 7ffbf30af640 1 --2- 172.21.15.19:0/2910148379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbec0b64b0 0x7ffbec0b6960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009d90 tx=0x7ffbe402a660 comp rx=0 tx=0).stop 2024-09-12T02:04:54.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.742+0000 7ffbf30af640 1 -- 172.21.15.19:0/2910148379 shutdown_connections 2024-09-12T02:04:54.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.742+0000 7ffbf30af640 1 --2- 172.21.15.19:0/2910148379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec162060 0x7ffbec0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.742+0000 7ffbf30af640 1 --2- 172.21.15.19:0/2910148379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbec0b64b0 0x7ffbec0b6960 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.742+0000 7ffbf30af640 1 -- 172.21.15.19:0/2910148379 >> 172.21.15.19:0/2910148379 conn(0x7ffbec0d44f0 msgr2=0x7ffbec0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:54.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.742+0000 7ffbf30af640 1 -- 172.21.15.19:0/2910148379 shutdown_connections 2024-09-12T02:04:54.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.742+0000 7ffbf30af640 1 -- 172.21.15.19:0/2910148379 wait complete. 2024-09-12T02:04:54.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.743+0000 7ffbf30af640 1 Processor -- start 2024-09-12T02:04:54.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.743+0000 7ffbf30af640 1 -- start start 2024-09-12T02:04:54.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.744+0000 7ffbf30af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec0b64b0 0x7ffbec1f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.744+0000 7ffbf30af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbec161c80 0x7ffbec0b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.744+0000 7ffbf30af640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbec162060 0x7ffbec0b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.744+0000 7ffbf30af640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec0cf1e0 con 0x7ffbec161c80 2024-09-12T02:04:54.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.744+0000 7ffbf30af640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec0d2aa0 con 0x7ffbec162060 2024-09-12T02:04:54.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.744+0000 7ffbf30af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ffbec0cf360 con 0x7ffbec0b64b0 2024-09-12T02:04:54.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.744+0000 7ffbebfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbec161c80 0x7ffbec0b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.744+0000 7ffbebfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbec161c80 0x7ffbec0b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43718/0 (socket says 172.21.15.19:43718) 2024-09-12T02:04:54.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.744+0000 7ffbebfff640 1 -- 172.21.15.19:0/462930553 learned_addr learned my addr 172.21.15.19:0/462930553 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:54.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.744+0000 7ffbf164c640 1 --2- 172.21.15.19:0/462930553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbec162060 0x7ffbec0b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.744+0000 7ffbf0e4b640 1 --2- 172.21.15.19:0/462930553 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec0b64b0 0x7ffbec1f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.745+0000 7ffbebfff640 1 -- 172.21.15.19:0/462930553 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec0b64b0 msgr2=0x7ffbec1f53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.745+0000 7ffbebfff640 1 --2- 172.21.15.19:0/462930553 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec0b64b0 0x7ffbec1f53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.745+0000 7ffbebfff640 1 -- 172.21.15.19:0/462930553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbec162060 msgr2=0x7ffbec0b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.745+0000 7ffbebfff640 1 --2- 172.21.15.19:0/462930553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbec162060 0x7ffbec0b2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.745+0000 7ffbebfff640 1 -- 172.21.15.19:0/462930553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbec1f4e50 con 0x7ffbec161c80 2024-09-12T02:04:54.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.745+0000 7ffbf164c640 1 --2- 172.21.15.19:0/462930553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbec162060 0x7ffbec0b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:54.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.745+0000 7ffbebfff640 1 --2- 172.21.15.19:0/462930553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbec161c80 0x7ffbec0b21e0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400e840 tx=0x7ffbd400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:54.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.745+0000 7ffbe97fa640 1 -- 172.21.15.19:0/462930553 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4017070 con 0x7ffbec161c80 2024-09-12T02:04:54.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.745+0000 7ffbe97fa640 1 -- 172.21.15.19:0/462930553 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbd400c730 con 0x7ffbec161c80 2024-09-12T02:04:54.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.745+0000 7ffbf30af640 1 -- 172.21.15.19:0/462930553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbec1f5130 con 0x7ffbec161c80 2024-09-12T02:04:54.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.745+0000 7ffbe97fa640 1 -- 172.21.15.19:0/462930553 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd400cb40 con 0x7ffbec161c80 2024-09-12T02:04:54.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.745+0000 7ffbf30af640 1 -- 172.21.15.19:0/462930553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbec0ccc60 con 0x7ffbec161c80 2024-09-12T02:04:54.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.746+0000 7ffbf30af640 1 -- 172.21.15.19:0/462930553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbec0b5f70 con 0x7ffbec161c80 2024-09-12T02:04:54.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.746+0000 7ffbe97fa640 1 -- 172.21.15.19:0/462930553 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffbd401a070 con 0x7ffbec161c80 2024-09-12T02:04:54.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.747+0000 7ffbe97fa640 1 --2- 172.21.15.19:0/462930553 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffbcc06be30 0x7ffbcc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.747+0000 7ffbe97fa640 1 -- 172.21.15.19:0/462930553 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8367+0+0 (secure 0 0 0) 0x7ffbd408b9a0 con 0x7ffbec161c80 2024-09-12T02:04:54.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.747+0000 7ffbf0e4b640 1 --2- 172.21.15.19:0/462930553 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffbcc06be30 0x7ffbcc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.748+0000 7ffbf0e4b640 1 --2- 172.21.15.19:0/462930553 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffbcc06be30 0x7ffbcc06e2f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc000f60 tx=0x7ffbdc007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:54.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.751+0000 7ffbe97fa640 1 -- 172.21.15.19:0/462930553 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffbd40592e0 con 0x7ffbec161c80 2024-09-12T02:04:54.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.970+0000 7ffbf30af640 1 -- 172.21.15.19:0/462930553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbec0d3560 con 0x7ffbec161c80 2024-09-12T02:04:54.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.970+0000 7ffbe97fa640 1 -- 172.21.15.19:0/462930553 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 223 v223) ==== 95+0+4389 (secure 0 0 0) 0x7ffbd405d5e0 con 0x7ffbec161c80 2024-09-12T02:04:54.971 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:54.971 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":223,"btime":"2024-09-12T02:04:54:953065+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":9279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/4087550164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":4087550164},{"type":"v1","addr":"172.21.15.19:6834","nonce":4087550164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":223}],"filesystems":[{"mdsmap":{"epoch":222,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:53.949283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:54.971 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 223 2024-09-12T02:04:54.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.973+0000 7ffbf30af640 1 -- 172.21.15.19:0/462930553 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffbcc06be30 msgr2=0x7ffbcc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.973+0000 7ffbf30af640 1 --2- 172.21.15.19:0/462930553 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffbcc06be30 0x7ffbcc06e2f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc000f60 tx=0x7ffbdc007d50 comp rx=0 tx=0).stop 2024-09-12T02:04:54.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.973+0000 7ffbf30af640 1 -- 172.21.15.19:0/462930553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbec161c80 msgr2=0x7ffbec0b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.973+0000 7ffbf30af640 1 --2- 172.21.15.19:0/462930553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbec161c80 0x7ffbec0b21e0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400e840 tx=0x7ffbd400ed00 comp rx=0 tx=0).stop 2024-09-12T02:04:54.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.973+0000 7ffbf30af640 1 -- 172.21.15.19:0/462930553 shutdown_connections 2024-09-12T02:04:54.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.973+0000 7ffbf30af640 1 --2- 172.21.15.19:0/462930553 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffbcc06be30 0x7ffbcc06e2f0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.973+0000 7ffbf30af640 1 --2- 172.21.15.19:0/462930553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbec162060 0x7ffbec0b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.973+0000 7ffbf30af640 1 --2- 172.21.15.19:0/462930553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbec161c80 0x7ffbec0b21e0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.973+0000 7ffbf30af640 1 --2- 172.21.15.19:0/462930553 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec0b64b0 0x7ffbec1f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.973+0000 7ffbf30af640 1 -- 172.21.15.19:0/462930553 >> 172.21.15.19:0/462930553 conn(0x7ffbec0d44f0 msgr2=0x7ffbec0b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:54.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.973+0000 7ffbf30af640 1 -- 172.21.15.19:0/462930553 shutdown_connections 2024-09-12T02:04:54.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:54.973+0000 7ffbf30af640 1 -- 172.21.15.19:0/462930553 wait complete. 2024-09-12T02:04:54.984 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate 200.00000000' led to DAMAGED state 2024-09-12T02:04:54.984 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate 200.00000001' 2024-09-12T02:04:54.985 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:04:54.985 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:04:55.041 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:04:55.041 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:04:55.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:55.041 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:04:55.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:04:55.097 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:04:55.097 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:04:55.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.240+0000 7ff4135d6640 1 Processor -- start 2024-09-12T02:04:55.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.241+0000 7ff4135d6640 1 -- start start 2024-09-12T02:04:55.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.241+0000 7ff4135d6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff40c162060 0x7ff40c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:55.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.241+0000 7ff4135d6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff40c06d9f0 con 0x7ff40c0b64b0 2024-09-12T02:04:55.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.241+0000 7ff4135d6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff40c06dcd0 con 0x7ff40c161c80 2024-09-12T02:04:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.241+0000 7ff4135d6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff40c06dfb0 con 0x7ff40c162060 2024-09-12T02:04:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.242+0000 7ff411b73640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff40c0b64b0 0x7ff40c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52374/0 (socket says 172.21.15.19:52374) 2024-09-12T02:04:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.242+0000 7ff411b73640 1 -- 172.21.15.19:0/1169374932 learned_addr learned my addr 172.21.15.19:0/1169374932 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.242+0000 7ff410b71640 1 --2- 172.21.15.19:0/1169374932 >> v2:172.21.15.135:3300/0 conn(0x7ff40c162060 0x7ff40c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.242+0000 7ff40bfff640 1 -- 172.21.15.19:0/1169374932 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2299200269 0 0) 0x7ff40c06d9f0 con 0x7ff40c0b64b0 2024-09-12T02:04:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.242+0000 7ff40bfff640 1 -- 172.21.15.19:0/1169374932 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3f4003520 con 0x7ff40c0b64b0 2024-09-12T02:04:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.242+0000 7ff40bfff640 1 -- 172.21.15.19:0/1169374932 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1504614581 0 0) 0x7ff40c06dcd0 con 0x7ff40c161c80 2024-09-12T02:04:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.242+0000 7ff40bfff640 1 -- 172.21.15.19:0/1169374932 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff40c06d9f0 con 0x7ff40c161c80 2024-09-12T02:04:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.242+0000 7ff410b71640 1 -- 172.21.15.19:0/1169374932 >> v1:172.21.15.135:6789/0 conn(0x7ff40c161c80 legacy=0x7ff40c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.242+0000 7ff410b71640 1 -- 172.21.15.19:0/1169374932 >> v1:172.21.15.19:6789/0 conn(0x7ff40c0b64b0 legacy=0x7ff40c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.242+0000 7ff40bfff640 1 -- 172.21.15.19:0/1169374932 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3187217605 0 0) 0x7ff3f4003520 con 0x7ff40c0b64b0 2024-09-12T02:04:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.242+0000 7ff410b71640 1 -- 172.21.15.19:0/1169374932 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40c0d2890 con 0x7ff40c162060 2024-09-12T02:04:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.243+0000 7ff410b71640 1 --2- 172.21.15.19:0/1169374932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff40c162060 0x7ff40c0b5f70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff4000097a0 tx=0x7ff40002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=375cd1ff004aeccc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.243+0000 7ff40bfff640 1 -- 172.21.15.19:0/1169374932 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff400037070 con 0x7ff40c162060 2024-09-12T02:04:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.243+0000 7ff40bfff640 1 -- 172.21.15.19:0/1169374932 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff40002ac50 con 0x7ff40c162060 2024-09-12T02:04:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.243+0000 7ff40bfff640 1 -- 172.21.15.19:0/1169374932 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0019f0 con 0x7ff40c162060 2024-09-12T02:04:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.244+0000 7ff4135d6640 1 -- 172.21.15.19:0/1169374932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff40c162060 msgr2=0x7ff40c0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.244+0000 7ff4135d6640 1 --2- 172.21.15.19:0/1169374932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff40c162060 0x7ff40c0b5f70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff4000097a0 tx=0x7ff40002a1c0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.244+0000 7ff4135d6640 1 -- 172.21.15.19:0/1169374932 shutdown_connections 2024-09-12T02:04:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.244+0000 7ff4135d6640 1 --2- 172.21.15.19:0/1169374932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff40c162060 0x7ff40c0b5f70 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.244+0000 7ff4135d6640 1 -- 172.21.15.19:0/1169374932 >> 172.21.15.19:0/1169374932 conn(0x7ff40c0d44f0 msgr2=0x7ff40c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.244+0000 7ff4135d6640 1 -- 172.21.15.19:0/1169374932 shutdown_connections 2024-09-12T02:04:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.244+0000 7ff4135d6640 1 -- 172.21.15.19:0/1169374932 wait complete. 2024-09-12T02:04:55.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.245+0000 7ff4135d6640 1 Processor -- start 2024-09-12T02:04:55.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.245+0000 7ff4135d6640 1 -- start start 2024-09-12T02:04:55.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff4135d6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff40c0b64b0 0x7ff40c0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:55.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff4135d6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff40c161c80 0x7ff40c159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:55.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff4135d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff40c162060 0x7ff40c0b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff4135d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff40c0b6d30 con 0x7ff40c162060 2024-09-12T02:04:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff4135d6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff40c0b6bb0 con 0x7ff40c0b64b0 2024-09-12T02:04:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff4135d6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff40c0cf8f0 con 0x7ff40c161c80 2024-09-12T02:04:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff411b73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff40c162060 0x7ff40c0b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff411b73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff40c162060 0x7ff40c0b9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43734/0 (socket says 172.21.15.19:43734) 2024-09-12T02:04:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff411b73640 1 -- 172.21.15.19:0/1513120959 learned_addr learned my addr 172.21.15.19:0/1513120959 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff411372640 1 --2- 172.21.15.19:0/1513120959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff40c0b64b0 0x7ff40c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff411b73640 1 -- 172.21.15.19:0/1513120959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff40c161c80 msgr2=0x7ff40c159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff410b71640 1 --2- 172.21.15.19:0/1513120959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff40c161c80 0x7ff40c159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff411b73640 1 --2- 172.21.15.19:0/1513120959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff40c161c80 0x7ff40c159ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff411b73640 1 -- 172.21.15.19:0/1513120959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff40c0b64b0 msgr2=0x7ff40c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff411b73640 1 --2- 172.21.15.19:0/1513120959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff40c0b64b0 0x7ff40c0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff411b73640 1 -- 172.21.15.19:0/1513120959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40c0cbcc0 con 0x7ff40c162060 2024-09-12T02:04:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff411b73640 1 --2- 172.21.15.19:0/1513120959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff40c162060 0x7ff40c0b9da0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc001f60 tx=0x7ff3fc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff409ffb640 1 -- 172.21.15.19:0/1513120959 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc017070 con 0x7ff40c162060 2024-09-12T02:04:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff409ffb640 1 -- 172.21.15.19:0/1513120959 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3fc012400 con 0x7ff40c162060 2024-09-12T02:04:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff4135d6640 1 -- 172.21.15.19:0/1513120959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff40c0cbfa0 con 0x7ff40c162060 2024-09-12T02:04:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.246+0000 7ff409ffb640 1 -- 172.21.15.19:0/1513120959 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0127f0 con 0x7ff40c162060 2024-09-12T02:04:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.247+0000 7ff4135d6640 1 -- 172.21.15.19:0/1513120959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff40c0cc560 con 0x7ff40c162060 2024-09-12T02:04:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.248+0000 7ff4135d6640 1 -- 172.21.15.19:0/1513120959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff40c0cc940 con 0x7ff40c162060 2024-09-12T02:04:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.248+0000 7ff409ffb640 1 -- 172.21.15.19:0/1513120959 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3fc01a070 con 0x7ff40c162060 2024-09-12T02:04:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.248+0000 7ff409ffb640 1 --2- 172.21.15.19:0/1513120959 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3f806be30 0x7ff3f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.248+0000 7ff409ffb640 1 -- 172.21.15.19:0/1513120959 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8367+0+0 (secure 0 0 0) 0x7ff3fc08b820 con 0x7ff40c162060 2024-09-12T02:04:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.249+0000 7ff411372640 1 --2- 172.21.15.19:0/1513120959 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3f806be30 0x7ff3f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.249+0000 7ff411372640 1 --2- 172.21.15.19:0/1513120959 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3f806be30 0x7ff3f806e2f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff4040011e0 tx=0x7ff404009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:55.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.253+0000 7ff409ffb640 1 -- 172.21.15.19:0/1513120959 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff40c0cc940 con 0x7ff40c162060 2024-09-12T02:04:55.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.463+0000 7ff4135d6640 1 -- 172.21.15.19:0/1513120959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff40c06dcd0 con 0x7ff40c162060 2024-09-12T02:04:55.858 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:04:55.861 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:04:55.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.966+0000 7ff409ffb640 1 -- 172.21.15.19:0/1513120959 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v224) ==== 161+0+0 (secure 0 0 0) 0x7ff3fc0780c0 con 0x7ff40c162060 2024-09-12T02:04:55.966 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:04:55.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.968+0000 7ff4135d6640 1 -- 172.21.15.19:0/1513120959 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3f806be30 msgr2=0x7ff3f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:55.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.968+0000 7ff4135d6640 1 --2- 172.21.15.19:0/1513120959 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3f806be30 0x7ff3f806e2f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff4040011e0 tx=0x7ff404009040 comp rx=0 tx=0).stop 2024-09-12T02:04:55.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.968+0000 7ff4135d6640 1 -- 172.21.15.19:0/1513120959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff40c162060 msgr2=0x7ff40c0b9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:55.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.968+0000 7ff4135d6640 1 --2- 172.21.15.19:0/1513120959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff40c162060 0x7ff40c0b9da0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc001f60 tx=0x7ff3fc00cf90 comp rx=0 tx=0).stop 2024-09-12T02:04:55.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.968+0000 7ff4135d6640 1 -- 172.21.15.19:0/1513120959 shutdown_connections 2024-09-12T02:04:55.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.968+0000 7ff4135d6640 1 --2- 172.21.15.19:0/1513120959 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3f806be30 0x7ff3f806e2f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.968+0000 7ff4135d6640 1 --2- 172.21.15.19:0/1513120959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff40c162060 0x7ff40c0b9da0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.968+0000 7ff4135d6640 1 --2- 172.21.15.19:0/1513120959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff40c161c80 0x7ff40c159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.968+0000 7ff4135d6640 1 --2- 172.21.15.19:0/1513120959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff40c0b64b0 0x7ff40c0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.968+0000 7ff4135d6640 1 -- 172.21.15.19:0/1513120959 >> 172.21.15.19:0/1513120959 conn(0x7ff40c0d44f0 msgr2=0x7ff40c0cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:55.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.968+0000 7ff4135d6640 1 -- 172.21.15.19:0/1513120959 shutdown_connections 2024-09-12T02:04:55.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:55.968+0000 7ff4135d6640 1 -- 172.21.15.19:0/1513120959 wait complete. 2024-09-12T02:04:55.982 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:04:56.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.086+0000 7ff31bba6640 1 Processor -- start 2024-09-12T02:04:56.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.087+0000 7ff31bba6640 1 -- start start 2024-09-12T02:04:56.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.087+0000 7ff31bba6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff3140b6680 0x7ff314169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:56.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.087+0000 7ff31bba6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff31406d9f0 con 0x7ff314161c80 2024-09-12T02:04:56.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.087+0000 7ff31bba6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff31406dcd0 con 0x7ff314162060 2024-09-12T02:04:56.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.087+0000 7ff31bba6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff31406dfb0 con 0x7ff3140b6680 2024-09-12T02:04:56.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.088+0000 7ff319942640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff314161c80 0x7ff31406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52376/0 (socket says 172.21.15.19:52376) 2024-09-12T02:04:56.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.088+0000 7ff319942640 1 -- 172.21.15.19:0/2606268654 learned_addr learned my addr 172.21.15.19:0/2606268654 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:56.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.088+0000 7ff31a143640 1 --2- 172.21.15.19:0/2606268654 >> v2:172.21.15.19:3300/0 conn(0x7ff3140b6680 0x7ff314169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:56.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.088+0000 7ff31a143640 1 -- 172.21.15.19:0/2606268654 >> v1:172.21.15.135:6789/0 conn(0x7ff314162060 legacy=0x7ff3140b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:56.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.088+0000 7ff31a143640 1 -- 172.21.15.19:0/2606268654 >> v1:172.21.15.19:6789/0 conn(0x7ff314161c80 legacy=0x7ff31406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:56.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.088+0000 7ff31a143640 1 -- 172.21.15.19:0/2606268654 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3140d01f0 con 0x7ff3140b6680 2024-09-12T02:04:56.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.088+0000 7ff318940640 1 -- 172.21.15.19:0/2606268654 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2155826925 0 0) 0x7ff31406d9f0 con 0x7ff314161c80 2024-09-12T02:04:56.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.089+0000 7ff31a143640 1 --2- 172.21.15.19:0/2606268654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3140b6680 0x7ff314169830 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7ff304009d90 tx=0x7ff30402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45c744d12405f2a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:56.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.089+0000 7ff318940640 1 -- 172.21.15.19:0/2606268654 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff304007740 con 0x7ff3140b6680 2024-09-12T02:04:56.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.089+0000 7ff318940640 1 -- 172.21.15.19:0/2606268654 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3040078e0 con 0x7ff3140b6680 2024-09-12T02:04:56.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.089+0000 7ff318940640 1 -- 172.21.15.19:0/2606268654 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff304007cb0 con 0x7ff3140b6680 2024-09-12T02:04:56.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.089+0000 7ff31bba6640 1 -- 172.21.15.19:0/2606268654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3140b6680 msgr2=0x7ff314169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:56.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.089+0000 7ff31bba6640 1 --2- 172.21.15.19:0/2606268654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3140b6680 0x7ff314169830 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7ff304009d90 tx=0x7ff30402a6f0 comp rx=0 tx=0).stop 2024-09-12T02:04:56.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.089+0000 7ff31bba6640 1 -- 172.21.15.19:0/2606268654 shutdown_connections 2024-09-12T02:04:56.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.089+0000 7ff31bba6640 1 --2- 172.21.15.19:0/2606268654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3140b6680 0x7ff314169830 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:56.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.089+0000 7ff31bba6640 1 -- 172.21.15.19:0/2606268654 >> 172.21.15.19:0/2606268654 conn(0x7ff3140d44f0 msgr2=0x7ff3140d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:56.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.089+0000 7ff31bba6640 1 -- 172.21.15.19:0/2606268654 shutdown_connections 2024-09-12T02:04:56.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.089+0000 7ff31bba6640 1 -- 172.21.15.19:0/2606268654 wait complete. 2024-09-12T02:04:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.090+0000 7ff31bba6640 1 Processor -- start 2024-09-12T02:04:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.091+0000 7ff31bba6640 1 -- start start 2024-09-12T02:04:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.091+0000 7ff31bba6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3140b6680 0x7ff3140c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.091+0000 7ff31bba6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff314161c80 0x7ff3141f7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.091+0000 7ff31bba6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff314162060 0x7ff3141f83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.091+0000 7ff31bba6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff3140b6cb0 con 0x7ff314162060 2024-09-12T02:04:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.091+0000 7ff31bba6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff3140b6b30 con 0x7ff314161c80 2024-09-12T02:04:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.091+0000 7ff31bba6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff314169d70 con 0x7ff3140b6680 2024-09-12T02:04:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.091+0000 7ff31a143640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff314162060 0x7ff3141f83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.091+0000 7ff31a143640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff314162060 0x7ff3141f83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43762/0 (socket says 172.21.15.19:43762) 2024-09-12T02:04:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.091+0000 7ff31a143640 1 -- 172.21.15.19:0/974981337 learned_addr learned my addr 172.21.15.19:0/974981337 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.092+0000 7ff31a143640 1 -- 172.21.15.19:0/974981337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3140b6680 msgr2=0x7ff3140c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.092+0000 7ff31a143640 1 --2- 172.21.15.19:0/974981337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3140b6680 0x7ff3140c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.092+0000 7ff31a143640 1 -- 172.21.15.19:0/974981337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff314161c80 msgr2=0x7ff3141f7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.092+0000 7ff319141640 1 --2- 172.21.15.19:0/974981337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff314161c80 0x7ff3141f7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.092+0000 7ff31a143640 1 --2- 172.21.15.19:0/974981337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff314161c80 0x7ff3141f7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.092+0000 7ff31a143640 1 -- 172.21.15.19:0/974981337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3140cadf0 con 0x7ff314162060 2024-09-12T02:04:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.092+0000 7ff31a143640 1 --2- 172.21.15.19:0/974981337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff314162060 0x7ff3141f83b0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7ff304009d90 tx=0x7ff304004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.092+0000 7ff3127fc640 1 -- 172.21.15.19:0/974981337 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30403f070 con 0x7ff314162060 2024-09-12T02:04:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.092+0000 7ff3127fc640 1 -- 172.21.15.19:0/974981337 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff304031c90 con 0x7ff314162060 2024-09-12T02:04:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.092+0000 7ff31bba6640 1 -- 172.21.15.19:0/974981337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3140b95d0 con 0x7ff314162060 2024-09-12T02:04:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.092+0000 7ff3127fc640 1 -- 172.21.15.19:0/974981337 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff304043630 con 0x7ff314162060 2024-09-12T02:04:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.092+0000 7ff31bba6640 1 -- 172.21.15.19:0/974981337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3140c8770 con 0x7ff314162060 2024-09-12T02:04:56.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.093+0000 7ff31bba6640 1 -- 172.21.15.19:0/974981337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3140b9be0 con 0x7ff314162060 2024-09-12T02:04:56.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.094+0000 7ff3127fc640 1 -- 172.21.15.19:0/974981337 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff30403b410 con 0x7ff314162060 2024-09-12T02:04:56.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.094+0000 7ff3127fc640 1 --2- 172.21.15.19:0/974981337 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff30006be60 0x7ff30006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:56.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.094+0000 7ff3127fc640 1 -- 172.21.15.19:0/974981337 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8367+0+0 (secure 0 0 0) 0x7ff3040acec0 con 0x7ff314162060 2024-09-12T02:04:56.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.095+0000 7ff319942640 1 --2- 172.21.15.19:0/974981337 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff30006be60 0x7ff30006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:56.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.095+0000 7ff319942640 1 --2- 172.21.15.19:0/974981337 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff30006be60 0x7ff30006e320 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff30c000c00 tx=0x7ff30c0079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:56.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.099+0000 7ff3127fc640 1 -- 172.21.15.19:0/974981337 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff30407ae80 con 0x7ff314162060 2024-09-12T02:04:56.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.343+0000 7ff31bba6640 1 -- 172.21.15.19:0/974981337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7ff3140b5f70 con 0x7ff314162060 2024-09-12T02:04:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.977+0000 7ff3127fc640 1 -- 172.21.15.19:0/974981337 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v225) ==== 101+0+0 (secure 0 0 0) 0x7ff30407a780 con 0x7ff314162060 2024-09-12T02:04:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:04:56.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.979+0000 7ff31bba6640 1 -- 172.21.15.19:0/974981337 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff30006be60 msgr2=0x7ff30006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:56.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.979+0000 7ff31bba6640 1 --2- 172.21.15.19:0/974981337 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff30006be60 0x7ff30006e320 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff30c000c00 tx=0x7ff30c0079c0 comp rx=0 tx=0).stop 2024-09-12T02:04:56.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.979+0000 7ff31bba6640 1 -- 172.21.15.19:0/974981337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff314162060 msgr2=0x7ff3141f83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:56.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.979+0000 7ff31bba6640 1 --2- 172.21.15.19:0/974981337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff314162060 0x7ff3141f83b0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7ff304009d90 tx=0x7ff304004a40 comp rx=0 tx=0).stop 2024-09-12T02:04:56.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.979+0000 7ff31bba6640 1 -- 172.21.15.19:0/974981337 shutdown_connections 2024-09-12T02:04:56.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.979+0000 7ff31bba6640 1 --2- 172.21.15.19:0/974981337 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff30006be60 0x7ff30006e320 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:56.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.980+0000 7ff31bba6640 1 --2- 172.21.15.19:0/974981337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff314162060 0x7ff3141f83b0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:56.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.980+0000 7ff31bba6640 1 --2- 172.21.15.19:0/974981337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff314161c80 0x7ff3141f7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:56.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.980+0000 7ff31bba6640 1 --2- 172.21.15.19:0/974981337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3140b6680 0x7ff3140c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:56.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.980+0000 7ff31bba6640 1 -- 172.21.15.19:0/974981337 >> 172.21.15.19:0/974981337 conn(0x7ff3140d44f0 msgr2=0x7ff3140b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:56.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.980+0000 7ff31bba6640 1 -- 172.21.15.19:0/974981337 shutdown_connections 2024-09-12T02:04:56.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:56.980+0000 7ff31bba6640 1 -- 172.21.15.19:0/974981337 wait complete. 2024-09-12T02:04:56.992 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:04:57.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.038+0000 7f64dcb1ef40 1 Processor -- start 2024-09-12T02:04:57.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.038+0000 7f64dcb1ef40 1 -- start start 2024-09-12T02:04:57.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.038+0000 7f64dcb1ef40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab944078e0 0x55ab944c4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.038+0000 7f64dcb1ef40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab944c5800 0x55ab944c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.038+0000 7f64dcb1ef40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ab944ddf50 0x55ab94435010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.038+0000 7f64dcb1ef40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ab94408230 con 0x55ab944078e0 2024-09-12T02:04:57.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.038+0000 7f64dcb1ef40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ab94359510 con 0x55ab944c5800 2024-09-12T02:04:57.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.038+0000 7f64dcb1ef40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55ab944dcf50 con 0x55ab944ddf50 2024-09-12T02:04:57.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.039+0000 7f64d9b47640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab944078e0 0x55ab944c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.039+0000 7f64d9b47640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab944078e0 0x55ab944c4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43778/0 (socket says 172.21.15.19:43778) 2024-09-12T02:04:57.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.039+0000 7f64d9b47640 1 -- 172.21.15.19:0/3219005750 learned_addr learned my addr 172.21.15.19:0/3219005750 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:57.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.039+0000 7f64d9346640 1 --2- 172.21.15.19:0/3219005750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab944c5800 0x55ab944c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.039+0000 7f64da348640 1 --2- 172.21.15.19:0/3219005750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ab944ddf50 0x55ab94435010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.039+0000 7f64d9b47640 1 -- 172.21.15.19:0/3219005750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ab944ddf50 msgr2=0x55ab94435010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:57.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.039+0000 7f64d9b47640 1 --2- 172.21.15.19:0/3219005750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ab944ddf50 0x55ab94435010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.039+0000 7f64d9b47640 1 -- 172.21.15.19:0/3219005750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab944c5800 msgr2=0x55ab944c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:57.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.039+0000 7f64d9b47640 1 --2- 172.21.15.19:0/3219005750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab944c5800 0x55ab944c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.039+0000 7f64d9b47640 1 -- 172.21.15.19:0/3219005750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab94407400 con 0x55ab944078e0 2024-09-12T02:04:57.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.039+0000 7f64da348640 1 --2- 172.21.15.19:0/3219005750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ab944ddf50 0x55ab94435010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:57.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.039+0000 7f64d9b47640 1 --2- 172.21.15.19:0/3219005750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab944078e0 0x55ab944c4500 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f64cc001d80 tx=0x7f64cc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d69965908776dbc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:57.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.039+0000 7f64cbfff640 1 -- 172.21.15.19:0/3219005750 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64cc00bd70 con 0x55ab944078e0 2024-09-12T02:04:57.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.039+0000 7f64cbfff640 1 -- 172.21.15.19:0/3219005750 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64cc00f400 con 0x55ab944078e0 2024-09-12T02:04:57.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.039+0000 7f64cbfff640 1 -- 172.21.15.19:0/3219005750 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64cc00f7f0 con 0x55ab944078e0 2024-09-12T02:04:57.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.040+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3219005750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab944078e0 msgr2=0x55ab944c4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.040+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3219005750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab944078e0 0x55ab944c4500 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f64cc001d80 tx=0x7f64cc001e70 comp rx=0 tx=0).stop 2024-09-12T02:04:57.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.040+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3219005750 shutdown_connections 2024-09-12T02:04:57.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.040+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3219005750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ab944ddf50 0x55ab94435010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.040+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3219005750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab944c5800 0x55ab944c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.040+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3219005750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab944078e0 0x55ab944c4500 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.040+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3219005750 >> 172.21.15.19:0/3219005750 conn(0x55ab94408ad0 msgr2=0x55ab944c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:57.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.040+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3219005750 shutdown_connections 2024-09-12T02:04:57.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.040+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3219005750 wait complete. 2024-09-12T02:04:57.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.040+0000 7f64dcb1ef40 1 Processor -- start 2024-09-12T02:04:57.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.040+0000 7f64dcb1ef40 1 -- start start 2024-09-12T02:04:57.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.041+0000 7f64dcb1ef40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab944078e0 0x55ab944d8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.041+0000 7f64dcb1ef40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab944c5800 0x55ab944d9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.041+0000 7f64dcb1ef40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ab944ddf50 0x55ab944d8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.041+0000 7f64dcb1ef40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ab944c21e0 con 0x55ab944c5800 2024-09-12T02:04:57.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.041+0000 7f64dcb1ef40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ab944076e0 con 0x55ab944078e0 2024-09-12T02:04:57.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.041+0000 7f64dcb1ef40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55ab944c24c0 con 0x55ab944ddf50 2024-09-12T02:04:57.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.041+0000 7f64d9346640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab944c5800 0x55ab944d9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.041+0000 7f64d9346640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab944c5800 0x55ab944d9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43786/0 (socket says 172.21.15.19:43786) 2024-09-12T02:04:57.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.041+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 learned_addr learned my addr 172.21.15.19:0/3885121576 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:57.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.041+0000 7f64d9b47640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab944078e0 0x55ab944d8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.041+0000 7f64da348640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ab944ddf50 0x55ab944d8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.042+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ab944ddf50 msgr2=0x55ab944d8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.042+0000 7f64d9346640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ab944ddf50 0x55ab944d8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.042+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab944078e0 msgr2=0x55ab944d8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.042+0000 7f64d9346640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab944078e0 0x55ab944d8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.042+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab94573ae0 con 0x55ab944c5800 2024-09-12T02:04:57.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.042+0000 7f64d9346640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab944c5800 0x55ab944d9fb0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f64d0045ff0 tx=0x7f64d0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:57.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.042+0000 7f64caffd640 1 -- 172.21.15.19:0/3885121576 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d0056040 con 0x55ab944c5800 2024-09-12T02:04:57.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.042+0000 7f64caffd640 1 -- 172.21.15.19:0/3885121576 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64d00529b0 con 0x55ab944c5800 2024-09-12T02:04:57.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.042+0000 7f64caffd640 1 -- 172.21.15.19:0/3885121576 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d0052d60 con 0x55ab944c5800 2024-09-12T02:04:57.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.042+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab94431ad0 con 0x55ab944c5800 2024-09-12T02:04:57.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.042+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab94574800 con 0x55ab944c5800 2024-09-12T02:04:57.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.043+0000 7f64caffd640 1 -- 172.21.15.19:0/3885121576 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f64d0059020 con 0x55ab944c5800 2024-09-12T02:04:57.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.044+0000 7f64caffd640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f64bc06a810 0x7f64bc06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.044+0000 7f64caffd640 1 -- 172.21.15.19:0/3885121576 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8367+0+0 (secure 0 0 0) 0x7f64d00ce1a0 con 0x55ab944c5800 2024-09-12T02:04:57.050 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:04:57.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.044+0000 7f64d9b47640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f64bc06a810 0x7f64bc06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.044+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55ab944da4f0 0x55ab944327e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.044+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab9457fe90 con 0x55ab944da4f0 2024-09-12T02:04:57.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.044+0000 7f64da348640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55ab944da4f0 0x55ab944327e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.045+0000 7f64d9b47640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f64bc06a810 0x7f64bc06ccd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f64cc003040 tx=0x7f64cc009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:57.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.045+0000 7f64da348640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55ab944da4f0 0x55ab944327e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:57.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.046+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v119'753 uv727 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.046+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab94580230 con 0x55ab944da4f0 2024-09-12T02:04:57.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.047+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v119'754 uv754 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.047+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945805d0 con 0x55ab944da4f0 2024-09-12T02:04:57.052 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:04:57.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.048+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v119'755 uv755 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.048+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94581980 con 0x55ab944da4f0 2024-09-12T02:04:57.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.049+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v119'756 uv756 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.049+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94581d20 con 0x55ab944da4f0 2024-09-12T02:04:57.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.050+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v119'757 uv757 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.050+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94580970 con 0x55ab944da4f0 2024-09-12T02:04:57.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.051+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v119'758 uv758 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.051+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94580d40 con 0x55ab944da4f0 2024-09-12T02:04:57.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.052+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v119'759 uv733 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.053+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab94581110 con 0x55ab944da4f0 2024-09-12T02:04:57.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.053+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v119'760 uv760 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.054+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94581110 con 0x55ab944da4f0 2024-09-12T02:04:57.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.055+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v119'761 uv761 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.056 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:04:57.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.055+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.055+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v119'762 uv762 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.056+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.056+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v119'763 uv763 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.056+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.057+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v119'764 uv764 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.058+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.059+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v119'765 uv740 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.059+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.060+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v119'766 uv766 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.060+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.061+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v119'767 uv767 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.061 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:04:57.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.061+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.062+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v119'768 uv768 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.062+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.063+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v119'769 uv769 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.063+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.064+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v119'770 uv770 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.064+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.065+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v119'771 uv771 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.065+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.066+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v119'772 uv746 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.066+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.067+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v119'773 uv773 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.067+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.068+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v119'774 uv774 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.068 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:04:57.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.068+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.069+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v119'775 uv775 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.069+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.070+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v119'776 uv776 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.070+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.071+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v119'777 uv777 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.071+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.073+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v119'778 uv752 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.073+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.074+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v119'779 uv779 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.074+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.075 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:04:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.075+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v119'780 uv780 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.075+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.076+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v119'781 uv781 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.076+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.077+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v119'782 uv782 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.077+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab944da4f0 2024-09-12T02:04:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.078+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v119'783 uv783 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab944da4f0 2024-09-12T02:04:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.078+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55ab945820c0 0x55ab945844b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.078+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945810e0 con 0x55ab945820c0 2024-09-12T02:04:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.078+0000 7f64d9b47640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55ab945820c0 0x55ab945844b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.078+0000 7f64d9b47640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55ab945820c0 0x55ab945844b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.080+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v119'550 uv532 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.080+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab945849f0 con 0x55ab945820c0 2024-09-12T02:04:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.082+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v119'551 uv551 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.082+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94584d90 con 0x55ab945820c0 2024-09-12T02:04:57.083 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:04:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.083+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v119'552 uv552 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.083+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945855e0 con 0x55ab945820c0 2024-09-12T02:04:57.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.085+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v119'553 uv553 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.085+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94585980 con 0x55ab945820c0 2024-09-12T02:04:57.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.086+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v119'554 uv554 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.086+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94585d20 con 0x55ab945820c0 2024-09-12T02:04:57.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.087+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v119'555 uv549 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.087+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab945860c0 con 0x55ab945820c0 2024-09-12T02:04:57.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.089+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v119'556 uv556 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.089+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94586460 con 0x55ab945820c0 2024-09-12T02:04:57.090 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:04:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.090+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v119'557 uv557 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.090+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94586460 con 0x55ab945820c0 2024-09-12T02:04:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.091+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v119'558 uv558 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.091+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94586460 con 0x55ab945820c0 2024-09-12T02:04:57.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.093+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v119'559 uv559 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.093+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94586460 con 0x55ab945820c0 2024-09-12T02:04:57.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.094+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v119'560 uv542 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.094+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab94586460 con 0x55ab945820c0 2024-09-12T02:04:57.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.095+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v119'561 uv561 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.095+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94586460 con 0x55ab945820c0 2024-09-12T02:04:57.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.096+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v119'562 uv562 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.097 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:04:57.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.096+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab9458a8e0 con 0x55ab945820c0 2024-09-12T02:04:57.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.098+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v119'563 uv563 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.098+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab9458a8e0 con 0x55ab945820c0 2024-09-12T02:04:57.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.099+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v119'564 uv564 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.099+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94586460 con 0x55ab945820c0 2024-09-12T02:04:57.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.100+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v119'565 uv548 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.100+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab94586460 con 0x55ab945820c0 2024-09-12T02:04:57.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.101+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v119'566 uv566 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.101+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94586460 con 0x55ab945820c0 2024-09-12T02:04:57.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.103+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v119'567 uv567 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.103 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:04:57.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.103+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94587470 con 0x55ab945820c0 2024-09-12T02:04:57.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.104+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v119'568 uv568 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.104+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94587470 con 0x55ab945820c0 2024-09-12T02:04:57.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.105+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v119'569 uv569 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.105+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94586460 con 0x55ab945820c0 2024-09-12T02:04:57.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.106+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v119'570 uv570 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab945820c0 2024-09-12T02:04:57.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.106+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ab94586970 0x55ab94588d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.106+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945892a0 con 0x55ab94586970 2024-09-12T02:04:57.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.106+0000 7f64d9346640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ab94586970 0x55ab94588d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.107+0000 7f64d9346640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ab94586970 0x55ab94588d60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:57.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.108+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v119'147 uv146 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.108+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab94589640 con 0x55ab94586970 2024-09-12T02:04:57.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.109+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v119'148 uv148 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.109+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94589aa0 con 0x55ab94586970 2024-09-12T02:04:57.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.110+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v119'149 uv149 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.111 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:04:57.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.110+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945851b0 con 0x55ab94586970 2024-09-12T02:04:57.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.111+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v119'150 uv150 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.111+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab9458b3a0 con 0x55ab94586970 2024-09-12T02:04:57.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.112+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v119'151 uv151 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.112+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab9458a340 con 0x55ab94586970 2024-09-12T02:04:57.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.113+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v119'152 uv152 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.113+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55ab9458ae00 0x55ab9458d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.113+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab9458dd60 con 0x55ab9458ae00 2024-09-12T02:04:57.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.114+0000 7f64da348640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55ab9458ae00 0x55ab9458d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.114+0000 7f64da348640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55ab9458ae00 0x55ab9458d7e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:57.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.115+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v119'108 uv107 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.115+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab9458e150 con 0x55ab9458ae00 2024-09-12T02:04:57.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.117+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v119'109 uv109 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.117+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab9458e150 con 0x55ab9458ae00 2024-09-12T02:04:57.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.118+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v119'110 uv110 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.118 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:04:57.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.118+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab9458e190 con 0x55ab9458ae00 2024-09-12T02:04:57.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.119+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v119'111 uv111 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.119+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55ab9458eb00 0x55ab94590ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.119+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591430 con 0x55ab9458eb00 2024-09-12T02:04:57.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.119+0000 7f64d9b47640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55ab9458eb00 0x55ab94590ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.120+0000 7f64d9b47640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55ab9458eb00 0x55ab94590ef0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:57.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.121+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v119'147 uv146 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.121+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591430 con 0x55ab9458eb00 2024-09-12T02:04:57.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.122+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v119'148 uv148 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.122+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458eb00 2024-09-12T02:04:57.123 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:04:57.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.123+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v119'149 uv149 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.123+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94592830 con 0x55ab9458eb00 2024-09-12T02:04:57.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.124+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v119'150 uv150 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.124+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94592830 con 0x55ab9458eb00 2024-09-12T02:04:57.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.126+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v119'151 uv151 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.126+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458eb00 2024-09-12T02:04:57.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.126+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v119'152 uv152 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.126+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458ae00 2024-09-12T02:04:57.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.128+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v119'271 uv265 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.128+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458ae00 2024-09-12T02:04:57.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.129+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v119'272 uv272 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.129+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458ae00 2024-09-12T02:04:57.130 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:04:57.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.130+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v119'273 uv273 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.130+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94592830 con 0x55ab9458ae00 2024-09-12T02:04:57.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.131+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v119'274 uv274 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.131+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94592830 con 0x55ab9458ae00 2024-09-12T02:04:57.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.132+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v119'275 uv275 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.132+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458ae00 2024-09-12T02:04:57.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.133+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v119'276 uv276 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.133+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458ae00 2024-09-12T02:04:57.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.134+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v119'277 uv270 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.134+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458ae00 2024-09-12T02:04:57.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.135+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v119'278 uv278 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.135+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458ae00 2024-09-12T02:04:57.136 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:04:57.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.136+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v119'279 uv279 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.136+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458ae00 2024-09-12T02:04:57.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.137+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v119'280 uv280 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.137+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458ae00 2024-09-12T02:04:57.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.138+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v119'281 uv281 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.138+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458ae00 2024-09-12T02:04:57.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.139+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v119'122 uv121 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.139+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458ae00 2024-09-12T02:04:57.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.141+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v119'123 uv123 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.141+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458ae00 2024-09-12T02:04:57.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.142+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v119'124 uv124 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.142 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:04:57.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.142+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458ae00 2024-09-12T02:04:57.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.143+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v119'125 uv125 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.143+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458ae00 2024-09-12T02:04:57.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.144+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v119'126 uv126 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f64d400b9c0 con 0x55ab9458ae00 2024-09-12T02:04:57.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.144+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458eb00 2024-09-12T02:04:57.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.145+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v119'147 uv146 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.145+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458eb00 2024-09-12T02:04:57.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.146+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v119'148 uv148 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.146+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458eb00 2024-09-12T02:04:57.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.147+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v119'149 uv149 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.147 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:04:57.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.147+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94592830 con 0x55ab9458eb00 2024-09-12T02:04:57.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.148+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v119'150 uv150 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.148+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94592830 con 0x55ab9458eb00 2024-09-12T02:04:57.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.149+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v119'151 uv151 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.149+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458eb00 2024-09-12T02:04:57.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.150+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v119'152 uv152 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.150+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458eb00 2024-09-12T02:04:57.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.151+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v119'243 uv237 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.151+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458eb00 2024-09-12T02:04:57.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.152+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v119'244 uv244 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.152+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94591820 con 0x55ab9458eb00 2024-09-12T02:04:57.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.153+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v119'245 uv245 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.157 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:04:57.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.153+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94589f70 con 0x55ab9458eb00 2024-09-12T02:04:57.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.154+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v119'246 uv246 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.154+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94589f70 con 0x55ab9458eb00 2024-09-12T02:04:57.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.155+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v119'247 uv247 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.155+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94589f70 con 0x55ab9458eb00 2024-09-12T02:04:57.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.156+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v119'248 uv242 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.156+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab94589f70 con 0x55ab9458eb00 2024-09-12T02:04:57.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.157+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v119'249 uv249 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.157+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94589f70 con 0x55ab9458eb00 2024-09-12T02:04:57.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.158+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v119'250 uv250 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.159 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:04:57.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.158+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94589f70 con 0x55ab9458eb00 2024-09-12T02:04:57.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.159+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v119'251 uv251 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.159+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945918d0 con 0x55ab9458eb00 2024-09-12T02:04:57.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.161+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v119'252 uv252 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.161+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55ab945926e0 0x55ab94594df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.161+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab945926e0 2024-09-12T02:04:57.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.161+0000 7f64d9346640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55ab945926e0 0x55ab94594df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.161+0000 7f64d9346640 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55ab945926e0 0x55ab94594df0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:57.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.163+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v119'107 uv106 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab945926e0 2024-09-12T02:04:57.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.163+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab945926e0 2024-09-12T02:04:57.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.164+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v119'108 uv108 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab945926e0 2024-09-12T02:04:57.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.164+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab945926e0 2024-09-12T02:04:57.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.165+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v119'109 uv109 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab945926e0 2024-09-12T02:04:57.165 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:04:57.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.165+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab945926e0 2024-09-12T02:04:57.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.166+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v119'110 uv110 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab945926e0 2024-09-12T02:04:57.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.166+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab9458eb00 2024-09-12T02:04:57.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.167+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v119'147 uv146 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.167+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab9458eb00 2024-09-12T02:04:57.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.168+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v119'148 uv148 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.168+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab9458eb00 2024-09-12T02:04:57.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.169+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v119'149 uv149 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.169 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:04:57.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.169+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94596340 con 0x55ab9458eb00 2024-09-12T02:04:57.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.170+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v119'150 uv150 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.170+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94596340 con 0x55ab9458eb00 2024-09-12T02:04:57.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.171+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v119'151 uv151 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.171+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab9458eb00 2024-09-12T02:04:57.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.171+0000 7f64d9b47640 1 -- 172.21.15.19:0/3885121576 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v119'152 uv152 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64cc00f7a0 con 0x55ab9458eb00 2024-09-12T02:04:57.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.172+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab94586970 2024-09-12T02:04:57.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.172+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v119'125 uv124 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.173+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab94586970 2024-09-12T02:04:57.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.173+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v119'126 uv126 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.174+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab94586970 2024-09-12T02:04:57.175 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:04:57.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.175+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v119'127 uv127 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.175+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab94586970 2024-09-12T02:04:57.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.176+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v119'128 uv128 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.176+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab94586970 2024-09-12T02:04:57.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.178+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v119'129 uv129 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.178+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab94586970 2024-09-12T02:04:57.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.178+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v119'302 uv294 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.178+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab94586970 2024-09-12T02:04:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.179+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v119'303 uv303 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.179+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab94586970 2024-09-12T02:04:57.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.180+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v119'304 uv304 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.181 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:04:57.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.180+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab94586970 2024-09-12T02:04:57.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.181+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v119'305 uv305 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.181+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab94586970 2024-09-12T02:04:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.182+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v119'306 uv306 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.182+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab94586970 2024-09-12T02:04:57.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.183+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v119'307 uv301 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.183+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab94586970 2024-09-12T02:04:57.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.184+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v119'308 uv308 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.184+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab94586970 2024-09-12T02:04:57.185 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:04:57.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.185+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v119'309 uv309 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.185+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94596340 con 0x55ab94586970 2024-09-12T02:04:57.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.186+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v119'310 uv310 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.186+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94596340 con 0x55ab94586970 2024-09-12T02:04:57.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.187+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v119'311 uv311 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.187+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab94595330 con 0x55ab94586970 2024-09-12T02:04:57.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.188+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v119'312 uv312 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.188+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55ab945957e0 con 0x55ab94586970 2024-09-12T02:04:57.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64d9346640 1 -- 172.21.15.19:0/3885121576 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v119'313 uv313 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f64d006c020 con 0x55ab94586970 2024-09-12T02:04:57.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55ab945820c0 msgr2=0x55ab945844b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55ab945820c0 0x55ab945844b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55ab944da4f0 msgr2=0x55ab944327e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55ab944da4f0 0x55ab944327e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55ab9458ae00 msgr2=0x55ab9458d7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55ab9458ae00 0x55ab9458d7e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55ab945926e0 msgr2=0x55ab94594df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55ab945926e0 0x55ab94594df0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ab94586970 msgr2=0x55ab94588d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55ab94586970 0x55ab94588d60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55ab9458eb00 msgr2=0x55ab94590ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55ab9458eb00 0x55ab94590ef0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 reap_dead start 2024-09-12T02:04:57.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64da348640 1 -- 172.21.15.19:0/3885121576 reap_dead start 2024-09-12T02:04:57.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f64bc06a810 msgr2=0x7f64bc06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f64bc06a810 0x7f64bc06ccd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f64cc003040 tx=0x7f64cc009000 comp rx=0 tx=0).stop 2024-09-12T02:04:57.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab944c5800 msgr2=0x55ab944d9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.189+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab944c5800 0x55ab944d9fb0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f64d0045ff0 tx=0x7f64d0002fb0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.190+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 shutdown_connections 2024-09-12T02:04:57.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.190+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55ab9458eb00 0x55ab94590ef0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.190+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f64bc06a810 0x7f64bc06ccd0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.190+0000 7f64dcb1ef40 1 --2- 172.21.15.19:0/3885121576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab944c5800 0x55ab944d9fb0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.190+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 >> 172.21.15.19:0/3885121576 conn(0x55ab94408ad0 msgr2=0x55ab944db9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:57.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.190+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 shutdown_connections 2024-09-12T02:04:57.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.190+0000 7f64dcb1ef40 1 -- 172.21.15.19:0/3885121576 wait complete. 2024-09-12T02:04:57.194 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate 200.00000001 0 2024-09-12T02:04:57.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.279+0000 7f65a7c93f40 1 Processor -- start 2024-09-12T02:04:57.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.279+0000 7f65a7c93f40 1 -- start start 2024-09-12T02:04:57.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.280+0000 7f65a7c93f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f0ad23570 0x563f0ac67e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.280+0000 7f65a7c93f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563f0ac936c0 0x563f0ac68350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.280+0000 7f65a7c93f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f0acaad10 0x563f0acab190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.280+0000 7f65a7c93f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563f0ac984e0 con 0x563f0acaad10 2024-09-12T02:04:57.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.280+0000 7f65a7c93f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563f0abbb510 con 0x563f0ad23570 2024-09-12T02:04:57.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.280+0000 7f65a7c93f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x563f0ac97970 con 0x563f0ac936c0 2024-09-12T02:04:57.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.280+0000 7f65a5f8a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f0acaad10 0x563f0acab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.280+0000 7f65a5f8a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f0acaad10 0x563f0acab190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43804/0 (socket says 172.21.15.19:43804) 2024-09-12T02:04:57.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.280+0000 7f65a5f8a640 1 -- 172.21.15.19:0/1725680239 learned_addr learned my addr 172.21.15.19:0/1725680239 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:57.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.280+0000 7f65a5789640 1 --2- 172.21.15.19:0/1725680239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f0ad23570 0x563f0ac67e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.280+0000 7f65a4f88640 1 --2- 172.21.15.19:0/1725680239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563f0ac936c0 0x563f0ac68350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.280+0000 7f65a5f8a640 1 -- 172.21.15.19:0/1725680239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563f0ac936c0 msgr2=0x563f0ac68350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:57.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.280+0000 7f65a5f8a640 1 --2- 172.21.15.19:0/1725680239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563f0ac936c0 0x563f0ac68350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.280+0000 7f65a5f8a640 1 -- 172.21.15.19:0/1725680239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f0ad23570 msgr2=0x563f0ac67e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:57.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.280+0000 7f65a5f8a640 1 --2- 172.21.15.19:0/1725680239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f0ad23570 0x563f0ac67e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.280+0000 7f65a5f8a640 1 -- 172.21.15.19:0/1725680239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f0ac68ac0 con 0x563f0acaad10 2024-09-12T02:04:57.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.281+0000 7f65a5f8a640 1 --2- 172.21.15.19:0/1725680239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f0acaad10 0x563f0acab190 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f65a0025e60 tx=0x7f65a004f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a8a4961afa03d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:57.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.281+0000 7f65977fe640 1 -- 172.21.15.19:0/1725680239 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a001a440 con 0x563f0acaad10 2024-09-12T02:04:57.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.281+0000 7f65977fe640 1 -- 172.21.15.19:0/1725680239 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a0065070 con 0x563f0acaad10 2024-09-12T02:04:57.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.281+0000 7f65977fe640 1 -- 172.21.15.19:0/1725680239 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a004dd50 con 0x563f0acaad10 2024-09-12T02:04:57.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.281+0000 7f65a7c93f40 1 -- 172.21.15.19:0/1725680239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f0acaad10 msgr2=0x563f0acab190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.281+0000 7f65a7c93f40 1 --2- 172.21.15.19:0/1725680239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f0acaad10 0x563f0acab190 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f65a0025e60 tx=0x7f65a004f000 comp rx=0 tx=0).stop 2024-09-12T02:04:57.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.281+0000 7f65a7c93f40 1 -- 172.21.15.19:0/1725680239 shutdown_connections 2024-09-12T02:04:57.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.281+0000 7f65a7c93f40 1 --2- 172.21.15.19:0/1725680239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f0acaad10 0x563f0acab190 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.281+0000 7f65a7c93f40 1 --2- 172.21.15.19:0/1725680239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563f0ac936c0 0x563f0ac68350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.281+0000 7f65a7c93f40 1 --2- 172.21.15.19:0/1725680239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f0ad23570 0x563f0ac67e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.281+0000 7f65a7c93f40 1 -- 172.21.15.19:0/1725680239 >> 172.21.15.19:0/1725680239 conn(0x563f0ac6aad0 msgr2=0x563f0acaf720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:57.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.281+0000 7f65a7c93f40 1 -- 172.21.15.19:0/1725680239 shutdown_connections 2024-09-12T02:04:57.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.281+0000 7f65a7c93f40 1 -- 172.21.15.19:0/1725680239 wait complete. 2024-09-12T02:04:57.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.282+0000 7f65a7c93f40 1 Processor -- start 2024-09-12T02:04:57.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.282+0000 7f65a7c93f40 1 -- start start 2024-09-12T02:04:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a7c93f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f0ac936c0 0x563f0acb2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a7c93f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563f0acaad10 0x563f0ad3eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a7c93f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f0ad23570 0x563f0ad25930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a7c93f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563f0ac69e40 con 0x563f0ad23570 2024-09-12T02:04:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a7c93f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563f0ac68da0 con 0x563f0ac936c0 2024-09-12T02:04:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a7c93f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x563f0ad3dd80 con 0x563f0acaad10 2024-09-12T02:04:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a5f8a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f0ad23570 0x563f0ad25930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a4f88640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563f0acaad10 0x563f0ad3eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a5789640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f0ac936c0 0x563f0acb2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a5f8a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f0ad23570 0x563f0ad25930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43818/0 (socket says 172.21.15.19:43818) 2024-09-12T02:04:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a4f88640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563f0acaad10 0x563f0ad3eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:42732/0 (socket says 172.21.15.19:42732) 2024-09-12T02:04:57.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a5f8a640 1 -- 172.21.15.19:0/3138686962 learned_addr learned my addr 172.21.15.19:0/3138686962 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:57.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a5f8a640 1 -- 172.21.15.19:0/3138686962 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563f0acaad10 msgr2=0x563f0ad3eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a5f8a640 1 --2- 172.21.15.19:0/3138686962 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563f0acaad10 0x563f0ad3eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a5f8a640 1 -- 172.21.15.19:0/3138686962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f0ac936c0 msgr2=0x563f0acb2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a5f8a640 1 --2- 172.21.15.19:0/3138686962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f0ac936c0 0x563f0acb2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a5f8a640 1 -- 172.21.15.19:0/3138686962 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f0acb2820 con 0x563f0ad23570 2024-09-12T02:04:57.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a5789640 1 --2- 172.21.15.19:0/3138686962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f0ac936c0 0x563f0acb2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:57.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65a5f8a640 1 --2- 172.21.15.19:0/3138686962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f0ad23570 0x563f0ad25930 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f65a0025e60 tx=0x7f65a00033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:57.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.283+0000 7f65967fc640 1 -- 172.21.15.19:0/3138686962 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a006d030 con 0x563f0ad23570 2024-09-12T02:04:57.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.284+0000 7f65967fc640 1 -- 172.21.15.19:0/3138686962 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a000e090 con 0x563f0ad23570 2024-09-12T02:04:57.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.284+0000 7f65a7c93f40 1 -- 172.21.15.19:0/3138686962 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f0ad3dfd0 con 0x563f0ad23570 2024-09-12T02:04:57.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.284+0000 7f65967fc640 1 -- 172.21.15.19:0/3138686962 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a001a440 con 0x563f0ad23570 2024-09-12T02:04:57.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.284+0000 7f65a7c93f40 1 -- 172.21.15.19:0/3138686962 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f0ad3e590 con 0x563f0ad23570 2024-09-12T02:04:57.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.285+0000 7f65967fc640 1 -- 172.21.15.19:0/3138686962 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65a0070030 con 0x563f0ad23570 2024-09-12T02:04:57.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.285+0000 7f65967fc640 1 --2- 172.21.15.19:0/3138686962 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f658806a810 0x7f658806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.286+0000 7f65967fc640 1 -- 172.21.15.19:0/3138686962 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8367+0+0 (secure 0 0 0) 0x7f65a00cef20 con 0x563f0ad23570 2024-09-12T02:04:57.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.286+0000 7f65a5789640 1 --2- 172.21.15.19:0/3138686962 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f658806a810 0x7f658806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.286+0000 7f65a7c93f40 1 --2- 172.21.15.19:0/3138686962 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x563f0ac57970 0x563f0acb0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.286+0000 7f65a7c93f40 1 -- 172.21.15.19:0/3138686962 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:1 13.14 13:2e2fa760:::200.00000001:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x563f0acb0ea0 con 0x563f0ac57970 2024-09-12T02:04:57.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.286+0000 7f65a4f88640 1 --2- 172.21.15.19:0/3138686962 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x563f0ac57970 0x563f0acb0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.286+0000 7f65a4f88640 1 --2- 172.21.15.19:0/3138686962 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x563f0ac57970 0x563f0acb0960 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:57.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.286+0000 7f65a5789640 1 --2- 172.21.15.19:0/3138686962 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f658806a810 0x7f658806ccd0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6598005cf0 tx=0x7f659800c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:57.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.288+0000 7f65a4f88640 1 -- 172.21.15.19:0/3138686962 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(1 200.00000001 [truncate 0] v119'571 uv571 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f659c009910 con 0x563f0ac57970 2024-09-12T02:04:57.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.288+0000 7f65a7c93f40 1 -- 172.21.15.19:0/3138686962 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x563f0ac57970 msgr2=0x563f0acb0960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.288+0000 7f65a7c93f40 1 --2- 172.21.15.19:0/3138686962 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x563f0ac57970 0x563f0acb0960 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.288+0000 7f65a7c93f40 1 -- 172.21.15.19:0/3138686962 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f658806a810 msgr2=0x7f658806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.288+0000 7f65a7c93f40 1 --2- 172.21.15.19:0/3138686962 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f658806a810 0x7f658806ccd0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6598005cf0 tx=0x7f659800c040 comp rx=0 tx=0).stop 2024-09-12T02:04:57.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.288+0000 7f65a7c93f40 1 -- 172.21.15.19:0/3138686962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f0ad23570 msgr2=0x563f0ad25930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.288+0000 7f65a7c93f40 1 --2- 172.21.15.19:0/3138686962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f0ad23570 0x563f0ad25930 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f65a0025e60 tx=0x7f65a00033a0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.288+0000 7f65a5f8a640 1 -- 172.21.15.19:0/3138686962 reap_dead start 2024-09-12T02:04:57.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.288+0000 7f65a7c93f40 1 -- 172.21.15.19:0/3138686962 shutdown_connections 2024-09-12T02:04:57.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.288+0000 7f65a7c93f40 1 -- 172.21.15.19:0/3138686962 >> 172.21.15.19:0/3138686962 conn(0x563f0ac6aad0 msgr2=0x563f0ac6aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:57.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.288+0000 7f65a7c93f40 1 -- 172.21.15.19:0/3138686962 shutdown_connections 2024-09-12T02:04:57.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.288+0000 7f65a7c93f40 1 -- 172.21.15.19:0/3138686962 wait complete. 2024-09-12T02:04:57.293 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:04:57.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.397+0000 7f3e0ddc4640 1 Processor -- start 2024-09-12T02:04:57.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.397+0000 7f3e0ddc4640 1 -- start start 2024-09-12T02:04:57.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.398+0000 7f3e0ddc4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3e08162340 0x7f3e0806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.398+0000 7f3e0ddc4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3e08162e30 0x7f3e080d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.398+0000 7f3e0ddc4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e0815ff70 con 0x7f3e080cf280 2024-09-12T02:04:57.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.398+0000 7f3e0ddc4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f3e081632a0 con 0x7f3e08162340 2024-09-12T02:04:57.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.398+0000 7f3e0ddc4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f3e0806de90 con 0x7f3e08162e30 2024-09-12T02:04:57.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.398+0000 7f3e077fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3e08162340 0x7f3e0806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.398+0000 7f3e077fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3e08162340 0x7f3e0806d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43828/0 (socket says 172.21.15.19:43828) 2024-09-12T02:04:57.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.398+0000 7f3e077fe640 1 -- 172.21.15.19:0/2549179896 learned_addr learned my addr 172.21.15.19:0/2549179896 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:57.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.399+0000 7f3e07fff640 1 --2- 172.21.15.19:0/2549179896 >> v2:172.21.15.135:3300/0 conn(0x7f3e08162e30 0x7f3e080d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.399+0000 7f3e077fe640 1 -- 172.21.15.19:0/2549179896 >> v2:172.21.15.135:3300/0 conn(0x7f3e08162e30 msgr2=0x7f3e080d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:57.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.399+0000 7f3e077fe640 1 --2- 172.21.15.19:0/2549179896 >> v2:172.21.15.135:3300/0 conn(0x7f3e08162e30 0x7f3e080d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.399+0000 7f3e077fe640 1 -- 172.21.15.19:0/2549179896 >> v1:172.21.15.135:6789/0 conn(0x7f3e080cf280 legacy=0x7f3e08162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.399+0000 7f3e077fe640 1 -- 172.21.15.19:0/2549179896 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e080d4d10 con 0x7f3e08162340 2024-09-12T02:04:57.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.399+0000 7f3e077fe640 1 --2- 172.21.15.19:0/2549179896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e08162340 0x7f3e0806d740 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f3e0806c3d0 tx=0x7f3df802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4b3d32d8142cd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:57.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.400+0000 7f3e067fc640 1 -- 172.21.15.19:0/2549179896 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8037070 con 0x7f3e08162340 2024-09-12T02:04:57.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.400+0000 7f3e067fc640 1 -- 172.21.15.19:0/2549179896 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df8032440 con 0x7f3e08162340 2024-09-12T02:04:57.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.400+0000 7f3e067fc640 1 -- 172.21.15.19:0/2549179896 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8032810 con 0x7f3e08162340 2024-09-12T02:04:57.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.400+0000 7f3e0ddc4640 1 -- 172.21.15.19:0/2549179896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e08162340 msgr2=0x7f3e0806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.400+0000 7f3e0ddc4640 1 --2- 172.21.15.19:0/2549179896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e08162340 0x7f3e0806d740 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f3e0806c3d0 tx=0x7f3df802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.400+0000 7f3e0ddc4640 1 -- 172.21.15.19:0/2549179896 shutdown_connections 2024-09-12T02:04:57.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.400+0000 7f3e0ddc4640 1 --2- 172.21.15.19:0/2549179896 >> v2:172.21.15.135:3300/0 conn(0x7f3e08162e30 0x7f3e080d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.400+0000 7f3e0ddc4640 1 --2- 172.21.15.19:0/2549179896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e08162340 0x7f3e0806d740 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.400+0000 7f3e0ddc4640 1 -- 172.21.15.19:0/2549179896 >> 172.21.15.19:0/2549179896 conn(0x7f3e0808bfc0 msgr2=0x7f3e080d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:57.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.400+0000 7f3e0ddc4640 1 -- 172.21.15.19:0/2549179896 shutdown_connections 2024-09-12T02:04:57.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.400+0000 7f3e0ddc4640 1 -- 172.21.15.19:0/2549179896 wait complete. 2024-09-12T02:04:57.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.401+0000 7f3e0ddc4640 1 Processor -- start 2024-09-12T02:04:57.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.402+0000 7f3e0ddc4640 1 -- start start 2024-09-12T02:04:57.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.402+0000 7f3e0ddc4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e080cf280 0x7f3e080b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.402+0000 7f3e0ddc4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e08162340 0x7f3e081e9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.402+0000 7f3e0ddc4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e08162e30 0x7f3e081e9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.402+0000 7f3e0ddc4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e080d52d0 con 0x7f3e08162340 2024-09-12T02:04:57.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.402+0000 7f3e0ddc4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e080d2470 con 0x7f3e080cf280 2024-09-12T02:04:57.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.402+0000 7f3e0ddc4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3e080cf6c0 con 0x7f3e08162e30 2024-09-12T02:04:57.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.402+0000 7f3e06ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e08162340 0x7f3e081e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.402+0000 7f3e077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e080cf280 0x7f3e080b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.403+0000 7f3e06ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e08162340 0x7f3e081e9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43836/0 (socket says 172.21.15.19:43836) 2024-09-12T02:04:57.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.403+0000 7f3e06ffd640 1 -- 172.21.15.19:0/678822720 learned_addr learned my addr 172.21.15.19:0/678822720 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:57.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.403+0000 7f3e07fff640 1 --2- 172.21.15.19:0/678822720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e08162e30 0x7f3e081e9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.403+0000 7f3e06ffd640 1 -- 172.21.15.19:0/678822720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e08162e30 msgr2=0x7f3e081e9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.403+0000 7f3e06ffd640 1 --2- 172.21.15.19:0/678822720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e08162e30 0x7f3e081e9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.403+0000 7f3e06ffd640 1 -- 172.21.15.19:0/678822720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e080cf280 msgr2=0x7f3e080b7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.403+0000 7f3e06ffd640 1 --2- 172.21.15.19:0/678822720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e080cf280 0x7f3e080b7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.403+0000 7f3e06ffd640 1 -- 172.21.15.19:0/678822720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e080b7c70 con 0x7f3e08162340 2024-09-12T02:04:57.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.403+0000 7f3e077fe640 1 --2- 172.21.15.19:0/678822720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e080cf280 0x7f3e080b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:04:57.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.403+0000 7f3e06ffd640 1 --2- 172.21.15.19:0/678822720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e08162340 0x7f3e081e9760 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00c3f0 tx=0x7f3dfc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:57.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.403+0000 7f3deffff640 1 -- 172.21.15.19:0/678822720 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0052d0 con 0x7f3e08162340 2024-09-12T02:04:57.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.403+0000 7f3deffff640 1 -- 172.21.15.19:0/678822720 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dfc0054b0 con 0x7f3e08162340 2024-09-12T02:04:57.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.403+0000 7f3deffff640 1 -- 172.21.15.19:0/678822720 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc006a60 con 0x7f3e08162340 2024-09-12T02:04:57.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.403+0000 7f3e0ddc4640 1 -- 172.21.15.19:0/678822720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e080b7f50 con 0x7f3e08162340 2024-09-12T02:04:57.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.403+0000 7f3e0ddc4640 1 -- 172.21.15.19:0/678822720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e080cc840 con 0x7f3e08162340 2024-09-12T02:04:57.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.404+0000 7f3e0ddc4640 1 -- 172.21.15.19:0/678822720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e0806d740 con 0x7f3e08162340 2024-09-12T02:04:57.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.405+0000 7f3deffff640 1 -- 172.21.15.19:0/678822720 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3dfc006c00 con 0x7f3e08162340 2024-09-12T02:04:57.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.405+0000 7f3deffff640 1 --2- 172.21.15.19:0/678822720 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3df406be30 0x7f3df406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:57.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.405+0000 7f3deffff640 1 -- 172.21.15.19:0/678822720 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8367+0+0 (secure 0 0 0) 0x7f3dfc08abe0 con 0x7f3e08162340 2024-09-12T02:04:57.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.406+0000 7f3e077fe640 1 --2- 172.21.15.19:0/678822720 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3df406be30 0x7f3df406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:57.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.406+0000 7f3e077fe640 1 --2- 172.21.15.19:0/678822720 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3df406be30 0x7f3df406e2f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3df8034000 tx=0x7f3df802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:57.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.410+0000 7f3deffff640 1 -- 172.21.15.19:0/678822720 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3dfc058520 con 0x7f3e08162340 2024-09-12T02:04:57.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.624+0000 7f3e0ddc4640 1 -- 172.21.15.19:0/678822720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f3e0808e640 con 0x7f3e08162340 2024-09-12T02:04:57.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.978+0000 7f3deffff640 1 -- 172.21.15.19:0/678822720 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v226) ==== 162+0+0 (secure 0 0 0) 0x7f3dfc05c820 con 0x7f3e08162340 2024-09-12T02:04:57.979 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:04:57.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.980+0000 7f3e0ddc4640 1 -- 172.21.15.19:0/678822720 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3df406be30 msgr2=0x7f3df406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.980+0000 7f3e0ddc4640 1 --2- 172.21.15.19:0/678822720 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3df406be30 0x7f3df406e2f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3df8034000 tx=0x7f3df802e000 comp rx=0 tx=0).stop 2024-09-12T02:04:57.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.980+0000 7f3e0ddc4640 1 -- 172.21.15.19:0/678822720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e08162340 msgr2=0x7f3e081e9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:57.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.980+0000 7f3e0ddc4640 1 --2- 172.21.15.19:0/678822720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e08162340 0x7f3e081e9760 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00c3f0 tx=0x7f3dfc00c8b0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.981+0000 7f3e0ddc4640 1 -- 172.21.15.19:0/678822720 shutdown_connections 2024-09-12T02:04:57.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.981+0000 7f3e0ddc4640 1 --2- 172.21.15.19:0/678822720 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3df406be30 0x7f3df406e2f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.981+0000 7f3e0ddc4640 1 --2- 172.21.15.19:0/678822720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e08162e30 0x7f3e081e9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.981+0000 7f3e0ddc4640 1 --2- 172.21.15.19:0/678822720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e08162340 0x7f3e081e9760 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.981+0000 7f3e0ddc4640 1 --2- 172.21.15.19:0/678822720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e080cf280 0x7f3e080b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:57.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.981+0000 7f3e0ddc4640 1 -- 172.21.15.19:0/678822720 >> 172.21.15.19:0/678822720 conn(0x7f3e0808bfc0 msgr2=0x7f3e080d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:57.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.981+0000 7f3e0ddc4640 1 -- 172.21.15.19:0/678822720 shutdown_connections 2024-09-12T02:04:57.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:57.981+0000 7f3e0ddc4640 1 -- 172.21.15.19:0/678822720 wait complete. 2024-09-12T02:04:57.989 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:04:57.989+0000 7f07bfc64640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2024-09-12T02:04:57.989 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:57.989+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:04:57.990 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:04:57.989+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:04:57.995 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:58.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.098+0000 7f4ea36f8640 1 Processor -- start 2024-09-12T02:04:58.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.098+0000 7f4ea36f8640 1 -- start start 2024-09-12T02:04:58.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.099+0000 7f4ea36f8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4e9c06df60 0x7f4e9c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.099+0000 7f4ea36f8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4e9c09af70 0x7f4e9c168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.099+0000 7f4ea36f8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e9c06cec0 con 0x7f4e9c15e5d0 2024-09-12T02:04:58.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.099+0000 7f4ea36f8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f4e9c06dad0 con 0x7f4e9c09af70 2024-09-12T02:04:58.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.099+0000 7f4ea36f8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f4e9c06d1a0 con 0x7f4e9c06df60 2024-09-12T02:04:58.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.099+0000 7f4ea1494640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4e9c15e5d0 0x7f4e9c0d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52400/0 (socket says 172.21.15.19:52400) 2024-09-12T02:04:58.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.099+0000 7f4ea1494640 1 -- 172.21.15.19:0/640295389 learned_addr learned my addr 172.21.15.19:0/640295389 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:58.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.099+0000 7f4ea1c95640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4e9c09af70 0x7f4e9c168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.099+0000 7f4ea0c93640 1 --2- 172.21.15.19:0/640295389 >> v2:172.21.15.135:3300/0 conn(0x7f4e9c06df60 0x7f4e9c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.099+0000 7f4ea1c95640 1 -- 172.21.15.19:0/640295389 >> v2:172.21.15.135:3300/0 conn(0x7f4e9c06df60 msgr2=0x7f4e9c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.099+0000 7f4ea1c95640 1 --2- 172.21.15.19:0/640295389 >> v2:172.21.15.135:3300/0 conn(0x7f4e9c06df60 0x7f4e9c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.099+0000 7f4ea1c95640 1 -- 172.21.15.19:0/640295389 >> v1:172.21.15.19:6789/0 conn(0x7f4e9c15e5d0 legacy=0x7f4e9c0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.099+0000 7f4e8ffff640 1 -- 172.21.15.19:0/640295389 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1922211239 0 0) 0x7f4e9c06cec0 con 0x7f4e9c15e5d0 2024-09-12T02:04:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.099+0000 7f4ea1c95640 1 -- 172.21.15.19:0/640295389 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9c06d480 con 0x7f4e9c09af70 2024-09-12T02:04:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.099+0000 7f4ea0c93640 1 --2- 172.21.15.19:0/640295389 >> v2:172.21.15.135:3300/0 conn(0x7f4e9c06df60 0x7f4e9c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.100+0000 7f4ea1c95640 1 --2- 172.21.15.19:0/640295389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e9c09af70 0x7f4e9c168560 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0a0490 tx=0x7f4e9402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b1b8e2acfd18ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.100+0000 7f4e8ffff640 1 -- 172.21.15.19:0/640295389 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e94007740 con 0x7f4e9c09af70 2024-09-12T02:04:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.100+0000 7f4e8ffff640 1 -- 172.21.15.19:0/640295389 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e940078e0 con 0x7f4e9c09af70 2024-09-12T02:04:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.100+0000 7f4e8ffff640 1 -- 172.21.15.19:0/640295389 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e94007cb0 con 0x7f4e9c09af70 2024-09-12T02:04:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.101+0000 7f4ea36f8640 1 -- 172.21.15.19:0/640295389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e9c09af70 msgr2=0x7f4e9c168560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.101+0000 7f4ea36f8640 1 --2- 172.21.15.19:0/640295389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e9c09af70 0x7f4e9c168560 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0a0490 tx=0x7f4e9402a710 comp rx=0 tx=0).stop 2024-09-12T02:04:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.101+0000 7f4ea36f8640 1 -- 172.21.15.19:0/640295389 shutdown_connections 2024-09-12T02:04:58.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.101+0000 7f4ea36f8640 1 --2- 172.21.15.19:0/640295389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e9c09af70 0x7f4e9c168560 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.101+0000 7f4ea36f8640 1 --2- 172.21.15.19:0/640295389 >> v2:172.21.15.135:3300/0 conn(0x7f4e9c06df60 0x7f4e9c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.101+0000 7f4ea36f8640 1 -- 172.21.15.19:0/640295389 >> 172.21.15.19:0/640295389 conn(0x7f4e9c0d23a0 msgr2=0x7f4e9c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:58.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.101+0000 7f4ea36f8640 1 -- 172.21.15.19:0/640295389 shutdown_connections 2024-09-12T02:04:58.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.101+0000 7f4ea36f8640 1 -- 172.21.15.19:0/640295389 wait complete. 2024-09-12T02:04:58.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.102+0000 7f4ea36f8640 1 Processor -- start 2024-09-12T02:04:58.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.102+0000 7f4ea36f8640 1 -- start start 2024-09-12T02:04:58.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea36f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e9c06df60 0x7f4e9c0c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea36f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e9c09af70 0x7f4e9c1f7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea36f8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e9c15e5d0 0x7f4e9c0b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea36f8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c0d1980 con 0x7f4e9c09af70 2024-09-12T02:04:58.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea36f8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c0d1800 con 0x7f4e9c15e5d0 2024-09-12T02:04:58.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea36f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4e9c15e9b0 con 0x7f4e9c06df60 2024-09-12T02:04:58.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea0c93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e9c09af70 0x7f4e9c1f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea0c93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e9c09af70 0x7f4e9c1f7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43854/0 (socket says 172.21.15.19:43854) 2024-09-12T02:04:58.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea0c93640 1 -- 172.21.15.19:0/1849937041 learned_addr learned my addr 172.21.15.19:0/1849937041 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:58.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea1c95640 1 --2- 172.21.15.19:0/1849937041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e9c15e5d0 0x7f4e9c0b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea1494640 1 --2- 172.21.15.19:0/1849937041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e9c06df60 0x7f4e9c0c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea0c93640 1 -- 172.21.15.19:0/1849937041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e9c06df60 msgr2=0x7f4e9c0c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea0c93640 1 --2- 172.21.15.19:0/1849937041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e9c06df60 0x7f4e9c0c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea0c93640 1 -- 172.21.15.19:0/1849937041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e9c15e5d0 msgr2=0x7f4e9c0b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea0c93640 1 --2- 172.21.15.19:0/1849937041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e9c15e5d0 0x7f4e9c0b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea0c93640 1 -- 172.21.15.19:0/1849937041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9c0c6fb0 con 0x7f4e9c09af70 2024-09-12T02:04:58.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea1c95640 1 --2- 172.21.15.19:0/1849937041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e9c15e5d0 0x7f4e9c0b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:58.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea1494640 1 --2- 172.21.15.19:0/1849937041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e9c06df60 0x7f4e9c0c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:58.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.103+0000 7f4ea0c93640 1 --2- 172.21.15.19:0/1849937041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e9c09af70 0x7f4e9c1f7250 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800c7f0 tx=0x7f4e9800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:58.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.104+0000 7f4e8dffb640 1 -- 172.21.15.19:0/1849937041 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e98015070 con 0x7f4e9c09af70 2024-09-12T02:04:58.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.104+0000 7f4e8dffb640 1 -- 172.21.15.19:0/1849937041 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e98007820 con 0x7f4e9c09af70 2024-09-12T02:04:58.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.104+0000 7f4ea36f8640 1 -- 172.21.15.19:0/1849937041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e9c0c7290 con 0x7f4e9c09af70 2024-09-12T02:04:58.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.104+0000 7f4e8dffb640 1 -- 172.21.15.19:0/1849937041 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e98007bd0 con 0x7f4e9c09af70 2024-09-12T02:04:58.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.104+0000 7f4ea36f8640 1 -- 172.21.15.19:0/1849937041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e9c1f7790 con 0x7f4e9c09af70 2024-09-12T02:04:58.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.105+0000 7f4ea36f8640 1 -- 172.21.15.19:0/1849937041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e9c09aa30 con 0x7f4e9c09af70 2024-09-12T02:04:58.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.105+0000 7f4e8dffb640 1 -- 172.21.15.19:0/1849937041 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e98018070 con 0x7f4e9c09af70 2024-09-12T02:04:58.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.106+0000 7f4e8dffb640 1 --2- 172.21.15.19:0/1849937041 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4e8006be30 0x7f4e8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.106+0000 7f4e8dffb640 1 -- 172.21.15.19:0/1849937041 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8453+0+0 (secure 0 0 0) 0x7f4e9808b9e0 con 0x7f4e9c09af70 2024-09-12T02:04:58.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.106+0000 7f4ea1494640 1 --2- 172.21.15.19:0/1849937041 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4e8006be30 0x7f4e8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.107+0000 7f4ea1494640 1 --2- 172.21.15.19:0/1849937041 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4e8006be30 0x7f4e8006e2f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4e90000f60 tx=0x7f4e90009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:58.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.110+0000 7f4e8dffb640 1 -- 172.21.15.19:0/1849937041 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e98059910 con 0x7f4e9c09af70 2024-09-12T02:04:58.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.325+0000 7f4ea36f8640 1 -- 172.21.15.19:0/1849937041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e9c145e00 con 0x7f4e9c09af70 2024-09-12T02:04:58.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.325+0000 7f4e8dffb640 1 -- 172.21.15.19:0/1849937041 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 228 v228) ==== 95+0+3563 (secure 0 0 0) 0x7f4e98059210 con 0x7f4e9c09af70 2024-09-12T02:04:58.326 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:58.326 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":228,"btime":"2024-09-12T02:04:57:990966+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":228,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:57.990909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:58.326 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 228 2024-09-12T02:04:58.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.328+0000 7f4ea36f8640 1 -- 172.21.15.19:0/1849937041 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4e8006be30 msgr2=0x7f4e8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.328+0000 7f4ea36f8640 1 --2- 172.21.15.19:0/1849937041 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4e8006be30 0x7f4e8006e2f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4e90000f60 tx=0x7f4e90009040 comp rx=0 tx=0).stop 2024-09-12T02:04:58.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.328+0000 7f4ea36f8640 1 -- 172.21.15.19:0/1849937041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e9c09af70 msgr2=0x7f4e9c1f7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.328+0000 7f4ea36f8640 1 --2- 172.21.15.19:0/1849937041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e9c09af70 0x7f4e9c1f7250 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800c7f0 tx=0x7f4e9800ccb0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.328+0000 7f4ea36f8640 1 -- 172.21.15.19:0/1849937041 shutdown_connections 2024-09-12T02:04:58.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.328+0000 7f4ea36f8640 1 --2- 172.21.15.19:0/1849937041 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4e8006be30 0x7f4e8006e2f0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.328+0000 7f4ea36f8640 1 --2- 172.21.15.19:0/1849937041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e9c15e5d0 0x7f4e9c0b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.328+0000 7f4ea36f8640 1 --2- 172.21.15.19:0/1849937041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e9c09af70 0x7f4e9c1f7250 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.328+0000 7f4ea36f8640 1 --2- 172.21.15.19:0/1849937041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e9c06df60 0x7f4e9c0c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.328+0000 7f4ea36f8640 1 -- 172.21.15.19:0/1849937041 >> 172.21.15.19:0/1849937041 conn(0x7f4e9c0d23a0 msgr2=0x7f4e9c09b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:58.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.328+0000 7f4ea36f8640 1 -- 172.21.15.19:0/1849937041 shutdown_connections 2024-09-12T02:04:58.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.328+0000 7f4ea36f8640 1 -- 172.21.15.19:0/1849937041 wait complete. 2024-09-12T02:04:58.339 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:58.339 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.441+0000 7ffbf3dfd640 1 Processor -- start 2024-09-12T02:04:58.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.441+0000 7ffbf3dfd640 1 -- start start 2024-09-12T02:04:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.442+0000 7ffbf3dfd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec161c80 0x7ffbec06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.442+0000 7ffbf3dfd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffbec0b6680 0x7ffbec0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.442+0000 7ffbf3dfd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbec06e870 con 0x7ffbec162060 2024-09-12T02:04:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.442+0000 7ffbf3dfd640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ffbec06d9f0 con 0x7ffbec0b6680 2024-09-12T02:04:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.442+0000 7ffbf3dfd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ffbec06dcd0 con 0x7ffbec161c80 2024-09-12T02:04:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.442+0000 7ffbf1398640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ffbec162060 0x7ffbec0b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52408/0 (socket says 172.21.15.19:52408) 2024-09-12T02:04:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.442+0000 7ffbf1398640 1 -- 172.21.15.19:0/265080312 learned_addr learned my addr 172.21.15.19:0/265080312 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:04:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.442+0000 7ffbf239a640 1 --2- 172.21.15.19:0/265080312 >> v2:172.21.15.135:3300/0 conn(0x7ffbec0b6680 0x7ffbec0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.442+0000 7ffbf0b97640 1 -- 172.21.15.19:0/265080312 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1360012185 0 0) 0x7ffbdc001110 con 0x7ffbec162060 2024-09-12T02:04:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.442+0000 7ffbf0b97640 1 -- 172.21.15.19:0/265080312 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbd8003520 con 0x7ffbec162060 2024-09-12T02:04:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.442+0000 7ffbf1b99640 1 --2- 172.21.15.19:0/265080312 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec161c80 0x7ffbec06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf0b97640 1 -- 172.21.15.19:0/265080312 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2542174871 0 0) 0x7ffbd8003520 con 0x7ffbec162060 2024-09-12T02:04:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf0b97640 1 -- 172.21.15.19:0/265080312 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec161c80 msgr2=0x7ffbec06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf0b97640 1 --2- 172.21.15.19:0/265080312 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec161c80 0x7ffbec06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf0b97640 1 -- 172.21.15.19:0/265080312 >> v2:172.21.15.135:3300/0 conn(0x7ffbec0b6680 msgr2=0x7ffbec0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf0b97640 1 --2- 172.21.15.19:0/265080312 >> v2:172.21.15.135:3300/0 conn(0x7ffbec0b6680 0x7ffbec0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf0b97640 1 -- 172.21.15.19:0/265080312 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbec06dfb0 con 0x7ffbec162060 2024-09-12T02:04:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf0b97640 1 -- 172.21.15.19:0/265080312 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7ffbdc001840 con 0x7ffbec162060 2024-09-12T02:04:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf0b97640 1 -- 172.21.15.19:0/265080312 >> v1:172.21.15.19:6789/0 conn(0x7ffbec162060 legacy=0x7ffbec0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf0b97640 1 --2- 172.21.15.19:0/265080312 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec161c80 0x7ffbd80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf0b97640 1 --2- 172.21.15.19:0/265080312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd8003f30 0x7ffbd8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf0b97640 1 --2- 172.21.15.19:0/265080312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd8004d40 0x7ffbd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf0b97640 1 -- 172.21.15.19:0/265080312 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec06d9f0 con 0x7ffbd8004d40 2024-09-12T02:04:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf0b97640 1 -- 172.21.15.19:0/265080312 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec06dcd0 con 0x7ffbd8003f30 2024-09-12T02:04:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf0b97640 1 -- 172.21.15.19:0/265080312 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ffbd800b9c0 con 0x7ffbec161c80 2024-09-12T02:04:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf239a640 1 --2- 172.21.15.19:0/265080312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd8004d40 0x7ffbd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf1b99640 1 --2- 172.21.15.19:0/265080312 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec161c80 0x7ffbd80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf1398640 1 --2- 172.21.15.19:0/265080312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd8003f30 0x7ffbd8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf239a640 1 -- 172.21.15.19:0/265080312 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec161c80 msgr2=0x7ffbd80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf239a640 1 --2- 172.21.15.19:0/265080312 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec161c80 0x7ffbd80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf239a640 1 -- 172.21.15.19:0/265080312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd8003f30 msgr2=0x7ffbd8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf239a640 1 --2- 172.21.15.19:0/265080312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd8003f30 0x7ffbd8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.443+0000 7ffbf239a640 1 -- 172.21.15.19:0/265080312 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd8003520 con 0x7ffbd8004d40 2024-09-12T02:04:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.444+0000 7ffbf239a640 1 --2- 172.21.15.19:0/265080312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd8004d40 0x7ffbd80051c0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009fc0 tx=0x7ffbd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a952c4f9ccbb577e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.444+0000 7ffbf0b97640 1 -- 172.21.15.19:0/265080312 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4009c10 con 0x7ffbd8004d40 2024-09-12T02:04:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.444+0000 7ffbf0b97640 1 -- 172.21.15.19:0/265080312 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbe4036070 con 0x7ffbd8004d40 2024-09-12T02:04:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.444+0000 7ffbf0b97640 1 -- 172.21.15.19:0/265080312 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe402d070 con 0x7ffbd8004d40 2024-09-12T02:04:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.445+0000 7ffbf3dfd640 1 -- 172.21.15.19:0/265080312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd8004d40 msgr2=0x7ffbd80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.445+0000 7ffbf3dfd640 1 --2- 172.21.15.19:0/265080312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd8004d40 0x7ffbd80051c0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009fc0 tx=0x7ffbd8005830 comp rx=0 tx=0).stop 2024-09-12T02:04:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.445+0000 7ffbf239a640 1 -- 172.21.15.19:0/265080312 reap_dead start 2024-09-12T02:04:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.445+0000 7ffbf3dfd640 1 -- 172.21.15.19:0/265080312 shutdown_connections 2024-09-12T02:04:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.445+0000 7ffbf3dfd640 1 -- 172.21.15.19:0/265080312 >> 172.21.15.19:0/265080312 conn(0x7ffbec0d44f0 msgr2=0x7ffbec0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.445+0000 7ffbf3dfd640 1 -- 172.21.15.19:0/265080312 shutdown_connections 2024-09-12T02:04:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.445+0000 7ffbf3dfd640 1 -- 172.21.15.19:0/265080312 wait complete. 2024-09-12T02:04:58.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.446+0000 7ffbf3dfd640 1 Processor -- start 2024-09-12T02:04:58.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.446+0000 7ffbf3dfd640 1 -- start start 2024-09-12T02:04:58.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbf3dfd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd8004d40 0x7ffbec0b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbf3dfd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbec151d00 0x7ffbec151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbf3dfd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec15b4f0 0x7ffbec15b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbf3dfd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec0b6b30 con 0x7ffbd8004d40 2024-09-12T02:04:58.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbf3dfd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec0d2aa0 con 0x7ffbec151d00 2024-09-12T02:04:58.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbf3dfd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ffbec0b6cb0 con 0x7ffbec15b4f0 2024-09-12T02:04:58.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbf1b99640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd8004d40 0x7ffbec0b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbf1b99640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd8004d40 0x7ffbec0b8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43878/0 (socket says 172.21.15.19:43878) 2024-09-12T02:04:58.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbf1b99640 1 -- 172.21.15.19:0/1831287519 learned_addr learned my addr 172.21.15.19:0/1831287519 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:58.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbf1398640 1 --2- 172.21.15.19:0/1831287519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbec151d00 0x7ffbec151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbf239a640 1 --2- 172.21.15.19:0/1831287519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec15b4f0 0x7ffbec15b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbf1b99640 1 -- 172.21.15.19:0/1831287519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec15b4f0 msgr2=0x7ffbec15b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbf1b99640 1 --2- 172.21.15.19:0/1831287519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec15b4f0 0x7ffbec15b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbf1b99640 1 -- 172.21.15.19:0/1831287519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbec151d00 msgr2=0x7ffbec151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbf1b99640 1 --2- 172.21.15.19:0/1831287519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbec151d00 0x7ffbec151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbf1b99640 1 -- 172.21.15.19:0/1831287519 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbec0b94a0 con 0x7ffbd8004d40 2024-09-12T02:04:58.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbf1b99640 1 --2- 172.21.15.19:0/1831287519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd8004d40 0x7ffbec0b8da0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7ffbe8011a00 tx=0x7ffbe8011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:58.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbe27fc640 1 -- 172.21.15.19:0/1831287519 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe800faf0 con 0x7ffbd8004d40 2024-09-12T02:04:58.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.447+0000 7ffbe27fc640 1 -- 172.21.15.19:0/1831287519 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbe800fc90 con 0x7ffbd8004d40 2024-09-12T02:04:58.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.448+0000 7ffbf3dfd640 1 -- 172.21.15.19:0/1831287519 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbec0b9780 con 0x7ffbd8004d40 2024-09-12T02:04:58.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.448+0000 7ffbe27fc640 1 -- 172.21.15.19:0/1831287519 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8014440 con 0x7ffbd8004d40 2024-09-12T02:04:58.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.448+0000 7ffbf3dfd640 1 -- 172.21.15.19:0/1831287519 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbec15d550 con 0x7ffbd8004d40 2024-09-12T02:04:58.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.448+0000 7ffbf3dfd640 1 -- 172.21.15.19:0/1831287519 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbec0b9ca0 con 0x7ffbd8004d40 2024-09-12T02:04:58.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.449+0000 7ffbe27fc640 1 -- 172.21.15.19:0/1831287519 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffbe8012040 con 0x7ffbd8004d40 2024-09-12T02:04:58.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.449+0000 7ffbe27fc640 1 --2- 172.21.15.19:0/1831287519 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffbd006be60 0x7ffbd006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.450+0000 7ffbe27fc640 1 -- 172.21.15.19:0/1831287519 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8453+0+0 (secure 0 0 0) 0x7ffbe808bfa0 con 0x7ffbd8004d40 2024-09-12T02:04:58.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.450+0000 7ffbf1398640 1 --2- 172.21.15.19:0/1831287519 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffbd006be60 0x7ffbd006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.450+0000 7ffbf1398640 1 --2- 172.21.15.19:0/1831287519 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffbd006be60 0x7ffbd006e320 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ffbec0b9ea0 tx=0x7ffbdc007ae0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:58.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.454+0000 7ffbe27fc640 1 -- 172.21.15.19:0/1831287519 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffbec0b9ca0 con 0x7ffbd8004d40 2024-09-12T02:04:58.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.664+0000 7ffbf3dfd640 1 -- 172.21.15.19:0/1831287519 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbec06e330 con 0x7ffbd8004d40 2024-09-12T02:04:58.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.665+0000 7ffbe27fc640 1 -- 172.21.15.19:0/1831287519 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 228 v228) ==== 95+0+3563 (secure 0 0 0) 0x7ffbe8019030 con 0x7ffbd8004d40 2024-09-12T02:04:58.665 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:58.665 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":228,"btime":"2024-09-12T02:04:57:990966+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":228,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:57.990909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:58.665 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 228 2024-09-12T02:04:58.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.667+0000 7ffbf3dfd640 1 -- 172.21.15.19:0/1831287519 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffbd006be60 msgr2=0x7ffbd006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.667+0000 7ffbf3dfd640 1 --2- 172.21.15.19:0/1831287519 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffbd006be60 0x7ffbd006e320 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ffbec0b9ea0 tx=0x7ffbdc007ae0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.667+0000 7ffbf3dfd640 1 -- 172.21.15.19:0/1831287519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd8004d40 msgr2=0x7ffbec0b8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.667+0000 7ffbf3dfd640 1 --2- 172.21.15.19:0/1831287519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd8004d40 0x7ffbec0b8da0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7ffbe8011a00 tx=0x7ffbe8011ec0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.667+0000 7ffbf3dfd640 1 -- 172.21.15.19:0/1831287519 shutdown_connections 2024-09-12T02:04:58.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.667+0000 7ffbf3dfd640 1 --2- 172.21.15.19:0/1831287519 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ffbd006be60 0x7ffbd006e320 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.667+0000 7ffbf3dfd640 1 --2- 172.21.15.19:0/1831287519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbec15b4f0 0x7ffbec15b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.667+0000 7ffbf3dfd640 1 --2- 172.21.15.19:0/1831287519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbec151d00 0x7ffbec151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.667+0000 7ffbf3dfd640 1 --2- 172.21.15.19:0/1831287519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd8004d40 0x7ffbec0b8da0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.667+0000 7ffbf3dfd640 1 -- 172.21.15.19:0/1831287519 >> 172.21.15.19:0/1831287519 conn(0x7ffbec0d44f0 msgr2=0x7ffbec0b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:58.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.667+0000 7ffbf3dfd640 1 -- 172.21.15.19:0/1831287519 shutdown_connections 2024-09-12T02:04:58.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.667+0000 7ffbf3dfd640 1 -- 172.21.15.19:0/1831287519 wait complete. 2024-09-12T02:04:58.678 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:04:58.678 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:04:58.698 INFO:tasks.ceph.mds.d.smithi135.stderr: -36> 2024-09-12T02:04:53.946+0000 7fb486e7e640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2024-09-12T02:04:58.726 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T02:04:58.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.779+0000 7f9e7f159640 1 Processor -- start 2024-09-12T02:04:58.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.779+0000 7f9e7f159640 1 -- start start 2024-09-12T02:04:58.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.780+0000 7f9e7f159640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9e78162060 0x7f9e780b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.780+0000 7f9e7f159640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e7806d9f0 con 0x7f9e78161c80 2024-09-12T02:04:58.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.780+0000 7f9e7f159640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e7806dcd0 con 0x7f9e780b64b0 2024-09-12T02:04:58.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.780+0000 7f9e7f159640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f9e7806dfb0 con 0x7f9e78162060 2024-09-12T02:04:58.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.780+0000 7f9e77fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9e78162060 0x7f9e780b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.780+0000 7f9e77fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9e78162060 0x7f9e780b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43888/0 (socket says 172.21.15.19:43888) 2024-09-12T02:04:58.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.780+0000 7f9e7cef5640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9e78161c80 0x7f9e7806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52414/0 (socket says 172.21.15.19:52414) 2024-09-12T02:04:58.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.780+0000 7f9e77fff640 1 -- 172.21.15.19:0/3978937112 learned_addr learned my addr 172.21.15.19:0/3978937112 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:58.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.781+0000 7f9e77fff640 1 -- 172.21.15.19:0/3978937112 >> v1:172.21.15.135:6789/0 conn(0x7f9e780b64b0 legacy=0x7f9e780cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.781+0000 7f9e77fff640 1 -- 172.21.15.19:0/3978937112 >> v1:172.21.15.19:6789/0 conn(0x7f9e78161c80 legacy=0x7f9e7806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.781+0000 7f9e77fff640 1 -- 172.21.15.19:0/3978937112 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e780d2890 con 0x7f9e78162060 2024-09-12T02:04:58.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.781+0000 7f9e77fff640 1 --2- 172.21.15.19:0/3978937112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e78162060 0x7f9e780b5f70 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009870 tx=0x7f9e6c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6cc157265fb2701 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:58.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.782+0000 7f9e777fe640 1 -- 172.21.15.19:0/3978937112 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c037070 con 0x7f9e78162060 2024-09-12T02:04:58.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.782+0000 7f9e777fe640 1 -- 172.21.15.19:0/3978937112 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e6c02ae50 con 0x7f9e78162060 2024-09-12T02:04:58.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.782+0000 7f9e777fe640 1 -- 172.21.15.19:0/3978937112 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c032860 con 0x7f9e78162060 2024-09-12T02:04:58.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.782+0000 7f9e7f159640 1 -- 172.21.15.19:0/3978937112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e78162060 msgr2=0x7f9e780b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.782+0000 7f9e7f159640 1 --2- 172.21.15.19:0/3978937112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e78162060 0x7f9e780b5f70 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009870 tx=0x7f9e6c02a300 comp rx=0 tx=0).stop 2024-09-12T02:04:58.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.782+0000 7f9e7f159640 1 -- 172.21.15.19:0/3978937112 shutdown_connections 2024-09-12T02:04:58.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.782+0000 7f9e7f159640 1 --2- 172.21.15.19:0/3978937112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e78162060 0x7f9e780b5f70 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.782+0000 7f9e7f159640 1 -- 172.21.15.19:0/3978937112 >> 172.21.15.19:0/3978937112 conn(0x7f9e780d44f0 msgr2=0x7f9e780d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:58.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.782+0000 7f9e7f159640 1 -- 172.21.15.19:0/3978937112 shutdown_connections 2024-09-12T02:04:58.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.782+0000 7f9e7f159640 1 -- 172.21.15.19:0/3978937112 wait complete. 2024-09-12T02:04:58.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.783+0000 7f9e7f159640 1 Processor -- start 2024-09-12T02:04:58.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.783+0000 7f9e7f159640 1 -- start start 2024-09-12T02:04:58.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.784+0000 7f9e7f159640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e780b64b0 0x7f9e7814ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.784+0000 7f9e7f159640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e78161c80 0x7f9e780cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.784+0000 7f9e7f159640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e78162060 0x7f9e780cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.784+0000 7f9e7f159640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9e780b6d30 con 0x7f9e780b64b0 2024-09-12T02:04:58.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.784+0000 7f9e7f159640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9e780b6bb0 con 0x7f9e78161c80 2024-09-12T02:04:58.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.784+0000 7f9e7f159640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9e780cf8f0 con 0x7f9e78162060 2024-09-12T02:04:58.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.784+0000 7f9e7cef5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e780b64b0 0x7f9e7814ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.784+0000 7f9e7cef5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e780b64b0 0x7f9e7814ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43892/0 (socket says 172.21.15.19:43892) 2024-09-12T02:04:58.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.784+0000 7f9e7cef5640 1 -- 172.21.15.19:0/466643375 learned_addr learned my addr 172.21.15.19:0/466643375 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:58.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.785+0000 7f9e77fff640 1 --2- 172.21.15.19:0/466643375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e78161c80 0x7f9e780cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.785+0000 7f9e7d6f6640 1 --2- 172.21.15.19:0/466643375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e78162060 0x7f9e780cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.785+0000 7f9e7cef5640 1 -- 172.21.15.19:0/466643375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e78162060 msgr2=0x7f9e780cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.785+0000 7f9e7cef5640 1 --2- 172.21.15.19:0/466643375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e78162060 0x7f9e780cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.785+0000 7f9e7cef5640 1 -- 172.21.15.19:0/466643375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e78161c80 msgr2=0x7f9e780cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.785+0000 7f9e7cef5640 1 --2- 172.21.15.19:0/466643375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e78161c80 0x7f9e780cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.785+0000 7f9e7cef5640 1 -- 172.21.15.19:0/466643375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7814f710 con 0x7f9e780b64b0 2024-09-12T02:04:58.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.785+0000 7f9e7d6f6640 1 --2- 172.21.15.19:0/466643375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e78162060 0x7f9e780cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:58.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.785+0000 7f9e77fff640 1 --2- 172.21.15.19:0/466643375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e78161c80 0x7f9e780cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:58.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.785+0000 7f9e7cef5640 1 --2- 172.21.15.19:0/466643375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e780b64b0 0x7f9e7814ebe0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000c800 tx=0x7f9e7000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:58.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.785+0000 7f9e757fa640 1 -- 172.21.15.19:0/466643375 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70017070 con 0x7f9e780b64b0 2024-09-12T02:04:58.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.785+0000 7f9e757fa640 1 -- 172.21.15.19:0/466643375 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7000a640 con 0x7f9e780b64b0 2024-09-12T02:04:58.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.785+0000 7f9e757fa640 1 -- 172.21.15.19:0/466643375 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7000a9f0 con 0x7f9e780b64b0 2024-09-12T02:04:58.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.785+0000 7f9e7f159640 1 -- 172.21.15.19:0/466643375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e780cc110 con 0x7f9e780b64b0 2024-09-12T02:04:58.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.785+0000 7f9e7f159640 1 -- 172.21.15.19:0/466643375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e780b74c0 con 0x7f9e780b64b0 2024-09-12T02:04:58.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.786+0000 7f9e7f159640 1 -- 172.21.15.19:0/466643375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e780b5f70 con 0x7f9e780b64b0 2024-09-12T02:04:58.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.787+0000 7f9e757fa640 1 -- 172.21.15.19:0/466643375 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e7001a070 con 0x7f9e780b64b0 2024-09-12T02:04:58.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.787+0000 7f9e757fa640 1 --2- 172.21.15.19:0/466643375 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e6406be30 0x7f9e6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.787+0000 7f9e757fa640 1 -- 172.21.15.19:0/466643375 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8453+0+0 (secure 0 0 0) 0x7f9e7008aeb0 con 0x7f9e780b64b0 2024-09-12T02:04:58.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.788+0000 7f9e77fff640 1 --2- 172.21.15.19:0/466643375 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e6406be30 0x7f9e6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.788+0000 7f9e77fff640 1 --2- 172.21.15.19:0/466643375 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e6406be30 0x7f9e6406e2f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c034000 tx=0x7f9e6c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:58.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:58.792+0000 7f9e757fa640 1 -- 172.21.15.19:0/466643375 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e70058790 con 0x7f9e780b64b0 2024-09-12T02:04:59.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.003+0000 7f9e7f159640 1 -- 172.21.15.19:0/466643375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e780ba470 con 0x7f9e780b64b0 2024-09-12T02:04:59.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.003+0000 7f9e757fa640 1 -- 172.21.15.19:0/466643375 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 229 v229) ==== 95+0+4392 (secure 0 0 0) 0x7f9e7005ca90 con 0x7f9e780b64b0 2024-09-12T02:04:59.005 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:04:59.005 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":229,"btime":"2024-09-12T02:04:58:993195+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2201380819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2201380819},{"type":"v1","addr":"172.21.15.135:6837","nonce":2201380819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":229}],"filesystems":[{"mdsmap":{"epoch":228,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:04:57.990909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:04:59.006 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 229 2024-09-12T02:04:59.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.005+0000 7f9e7f159640 1 -- 172.21.15.19:0/466643375 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e6406be30 msgr2=0x7f9e6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:59.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.005+0000 7f9e7f159640 1 --2- 172.21.15.19:0/466643375 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e6406be30 0x7f9e6406e2f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c034000 tx=0x7f9e6c02e000 comp rx=0 tx=0).stop 2024-09-12T02:04:59.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.005+0000 7f9e7f159640 1 -- 172.21.15.19:0/466643375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e780b64b0 msgr2=0x7f9e7814ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:59.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.005+0000 7f9e7f159640 1 --2- 172.21.15.19:0/466643375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e780b64b0 0x7f9e7814ebe0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000c800 tx=0x7f9e7000ccc0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.005+0000 7f9e7f159640 1 -- 172.21.15.19:0/466643375 shutdown_connections 2024-09-12T02:04:59.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.005+0000 7f9e7f159640 1 --2- 172.21.15.19:0/466643375 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9e6406be30 0x7f9e6406e2f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.005+0000 7f9e7f159640 1 --2- 172.21.15.19:0/466643375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e78162060 0x7f9e780cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.005+0000 7f9e7f159640 1 --2- 172.21.15.19:0/466643375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e78161c80 0x7f9e780cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.005+0000 7f9e7f159640 1 --2- 172.21.15.19:0/466643375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e780b64b0 0x7f9e7814ebe0 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.005+0000 7f9e7f159640 1 -- 172.21.15.19:0/466643375 >> 172.21.15.19:0/466643375 conn(0x7f9e780d44f0 msgr2=0x7f9e780d3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:59.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.005+0000 7f9e7f159640 1 -- 172.21.15.19:0/466643375 shutdown_connections 2024-09-12T02:04:59.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.005+0000 7f9e7f159640 1 -- 172.21.15.19:0/466643375 wait complete. 2024-09-12T02:04:59.017 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate 200.00000001' led to DAMAGED state 2024-09-12T02:04:59.017 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate 500.00000000' 2024-09-12T02:04:59.017 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:04:59.017 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:04:59.033 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:04:59.033 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:04:59.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:04:59.033 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:04:59.088 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:04:59.089 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:04:59.089 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:04:59.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.231+0000 7f6fc1cd2640 1 Processor -- start 2024-09-12T02:04:59.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.231+0000 7f6fc1cd2640 1 -- start start 2024-09-12T02:04:59.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.232+0000 7f6fc1cd2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6fbc15b300 0x7f6fbc0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:59.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.232+0000 7f6fc1cd2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6fbc0cd3f0 0x7f6fbc06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:59.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.232+0000 7f6fc1cd2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fbc0cdbe0 con 0x7f6fbc072d30 2024-09-12T02:04:59.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.232+0000 7f6fc1cd2640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f6fbc0728a0 con 0x7f6fbc0cd3f0 2024-09-12T02:04:59.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.232+0000 7f6fc1cd2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6fbc0cd900 con 0x7f6fbc15b300 2024-09-12T02:04:59.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.232+0000 7f6fbaffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6fbc0cd3f0 0x7f6fbc06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:59.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.232+0000 7f6fbaffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6fbc0cd3f0 0x7f6fbc06f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43894/0 (socket says 172.21.15.19:43894) 2024-09-12T02:04:59.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.232+0000 7f6fbaffd640 1 -- 172.21.15.19:0/3593404725 learned_addr learned my addr 172.21.15.19:0/3593404725 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:59.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.233+0000 7f6fbb7fe640 1 --2- 172.21.15.19:0/3593404725 >> v2:172.21.15.135:3300/0 conn(0x7f6fbc15b300 0x7f6fbc0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:59.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.233+0000 7f6fbaffd640 1 -- 172.21.15.19:0/3593404725 >> v2:172.21.15.135:3300/0 conn(0x7f6fbc15b300 msgr2=0x7f6fbc0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:59.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.233+0000 7f6fbaffd640 1 --2- 172.21.15.19:0/3593404725 >> v2:172.21.15.135:3300/0 conn(0x7f6fbc15b300 0x7f6fbc0cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.233+0000 7f6fbaffd640 1 -- 172.21.15.19:0/3593404725 >> v1:172.21.15.135:6789/0 conn(0x7f6fbc072d30 legacy=0x7f6fbc0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:04:59.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.233+0000 7f6fbaffd640 1 -- 172.21.15.19:0/3593404725 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fbc072250 con 0x7f6fbc0cd3f0 2024-09-12T02:04:59.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.233+0000 7f6fbaffd640 1 --2- 172.21.15.19:0/3593404725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fbc0cd3f0 0x7f6fbc06f1c0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc070250 tx=0x7f6fb002c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e19df18f0aea91 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:59.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.234+0000 7f6fba7fc640 1 -- 172.21.15.19:0/3593404725 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb00325a0 con 0x7f6fbc0cd3f0 2024-09-12T02:04:59.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.234+0000 7f6fba7fc640 1 -- 172.21.15.19:0/3593404725 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb0038070 con 0x7f6fbc0cd3f0 2024-09-12T02:04:59.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.234+0000 7f6fba7fc640 1 -- 172.21.15.19:0/3593404725 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0032960 con 0x7f6fbc0cd3f0 2024-09-12T02:04:59.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.234+0000 7f6fc1cd2640 1 -- 172.21.15.19:0/3593404725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fbc0cd3f0 msgr2=0x7f6fbc06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:59.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.234+0000 7f6fc1cd2640 1 --2- 172.21.15.19:0/3593404725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fbc0cd3f0 0x7f6fbc06f1c0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc070250 tx=0x7f6fb002c8e0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.234+0000 7f6fc1cd2640 1 -- 172.21.15.19:0/3593404725 shutdown_connections 2024-09-12T02:04:59.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.234+0000 7f6fc1cd2640 1 --2- 172.21.15.19:0/3593404725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fbc0cd3f0 0x7f6fbc06f1c0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.234+0000 7f6fc1cd2640 1 --2- 172.21.15.19:0/3593404725 >> v2:172.21.15.135:3300/0 conn(0x7f6fbc15b300 0x7f6fbc0cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.234+0000 7f6fc1cd2640 1 -- 172.21.15.19:0/3593404725 >> 172.21.15.19:0/3593404725 conn(0x7f6fbc067d70 msgr2=0x7f6fbc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:59.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.234+0000 7f6fc1cd2640 1 -- 172.21.15.19:0/3593404725 shutdown_connections 2024-09-12T02:04:59.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.234+0000 7f6fc1cd2640 1 -- 172.21.15.19:0/3593404725 wait complete. 2024-09-12T02:04:59.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.235+0000 7f6fc1cd2640 1 Processor -- start 2024-09-12T02:04:59.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.236+0000 7f6fc1cd2640 1 -- start start 2024-09-12T02:04:59.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.236+0000 7f6fc1cd2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fbc072d30 0x7f6fbc14ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:59.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.236+0000 7f6fc1cd2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fbc0cd3f0 0x7f6fbc0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:59.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.236+0000 7f6fc1cd2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fbc15b300 0x7f6fbc0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:59.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.236+0000 7f6fc1cd2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc0d0160 con 0x7f6fbc0cd3f0 2024-09-12T02:04:59.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.236+0000 7f6fc1cd2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc0cffe0 con 0x7f6fbc072d30 2024-09-12T02:04:59.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.236+0000 7f6fc1cd2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6fbc06f700 con 0x7f6fbc15b300 2024-09-12T02:04:59.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.237+0000 7f6fbaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fbc0cd3f0 0x7f6fbc0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:59.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.237+0000 7f6fbaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fbc0cd3f0 0x7f6fbc0c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43898/0 (socket says 172.21.15.19:43898) 2024-09-12T02:04:59.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.237+0000 7f6fbaffd640 1 -- 172.21.15.19:0/4125519278 learned_addr learned my addr 172.21.15.19:0/4125519278 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:04:59.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.237+0000 7f6fbb7fe640 1 --2- 172.21.15.19:0/4125519278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fbc072d30 0x7f6fbc14ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:59.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.237+0000 7f6fbaffd640 1 -- 172.21.15.19:0/4125519278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fbc15b300 msgr2=0x7f6fbc0ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:59.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.237+0000 7f6fbaffd640 1 --2- 172.21.15.19:0/4125519278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fbc15b300 0x7f6fbc0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.237+0000 7f6fbaffd640 1 -- 172.21.15.19:0/4125519278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fbc072d30 msgr2=0x7f6fbc14ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:59.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.237+0000 7f6fbaffd640 1 --2- 172.21.15.19:0/4125519278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fbc072d30 0x7f6fbc14ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.237+0000 7f6fbaffd640 1 -- 172.21.15.19:0/4125519278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fbc158ab0 con 0x7f6fbc0cd3f0 2024-09-12T02:04:59.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.237+0000 7f6fbb7fe640 1 --2- 172.21.15.19:0/4125519278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fbc072d30 0x7f6fbc14ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:59.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.237+0000 7f6fbaffd640 1 --2- 172.21.15.19:0/4125519278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fbc0cd3f0 0x7f6fbc0c9b90 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f6fb002c920 tx=0x7f6fb0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:59.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.237+0000 7f6fa3fff640 1 -- 172.21.15.19:0/4125519278 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0043070 con 0x7f6fbc0cd3f0 2024-09-12T02:04:59.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.237+0000 7f6fa3fff640 1 -- 172.21.15.19:0/4125519278 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb0033c90 con 0x7f6fbc0cd3f0 2024-09-12T02:04:59.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.237+0000 7f6fc1cd2640 1 -- 172.21.15.19:0/4125519278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fbc158d90 con 0x7f6fbc0cd3f0 2024-09-12T02:04:59.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.237+0000 7f6fa3fff640 1 -- 172.21.15.19:0/4125519278 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb003c660 con 0x7f6fbc0cd3f0 2024-09-12T02:04:59.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.237+0000 7f6fc1cd2640 1 -- 172.21.15.19:0/4125519278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fbc159350 con 0x7f6fbc0cd3f0 2024-09-12T02:04:59.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.238+0000 7f6fc1cd2640 1 -- 172.21.15.19:0/4125519278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fbc06fac0 con 0x7f6fbc0cd3f0 2024-09-12T02:04:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.239+0000 7f6fa3fff640 1 -- 172.21.15.19:0/4125519278 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6fb0046070 con 0x7f6fbc0cd3f0 2024-09-12T02:04:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.239+0000 7f6fa3fff640 1 --2- 172.21.15.19:0/4125519278 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6fa806be30 0x7f6fa806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.239+0000 7f6fa3fff640 1 -- 172.21.15.19:0/4125519278 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8453+0+0 (secure 0 0 0) 0x7f6fb0030020 con 0x7f6fbc0cd3f0 2024-09-12T02:04:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.240+0000 7f6fbb7fe640 1 --2- 172.21.15.19:0/4125519278 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6fa806be30 0x7f6fa806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.240+0000 7f6fbb7fe640 1 --2- 172.21.15.19:0/4125519278 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6fa806be30 0x7f6fa806e2f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00b820 tx=0x7f6fac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:59.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.244+0000 7f6fa3fff640 1 -- 172.21.15.19:0/4125519278 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6fb004d030 con 0x7f6fbc0cd3f0 2024-09-12T02:04:59.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.458+0000 7f6fc1cd2640 1 -- 172.21.15.19:0/4125519278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6fbc1e3790 con 0x7f6fbc0cd3f0 2024-09-12T02:04:59.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.996+0000 7f6fa3fff640 1 -- 172.21.15.19:0/4125519278 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v230) ==== 161+0+0 (secure 0 0 0) 0x7f6fb007a5e0 con 0x7f6fbc0cd3f0 2024-09-12T02:04:59.997 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:04:59.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.999+0000 7f6fc1cd2640 1 -- 172.21.15.19:0/4125519278 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6fa806be30 msgr2=0x7f6fa806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:59.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.999+0000 7f6fc1cd2640 1 --2- 172.21.15.19:0/4125519278 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6fa806be30 0x7f6fa806e2f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00b820 tx=0x7f6fac008040 comp rx=0 tx=0).stop 2024-09-12T02:04:59.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.999+0000 7f6fc1cd2640 1 -- 172.21.15.19:0/4125519278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fbc0cd3f0 msgr2=0x7f6fbc0c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:00.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.999+0000 7f6fc1cd2640 1 --2- 172.21.15.19:0/4125519278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fbc0cd3f0 0x7f6fbc0c9b90 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f6fb002c920 tx=0x7f6fb0004730 comp rx=0 tx=0).stop 2024-09-12T02:05:00.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.999+0000 7f6fc1cd2640 1 -- 172.21.15.19:0/4125519278 shutdown_connections 2024-09-12T02:05:00.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.999+0000 7f6fc1cd2640 1 --2- 172.21.15.19:0/4125519278 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6fa806be30 0x7f6fa806e2f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:00.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.999+0000 7f6fc1cd2640 1 --2- 172.21.15.19:0/4125519278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fbc15b300 0x7f6fbc0ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:00.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.999+0000 7f6fc1cd2640 1 --2- 172.21.15.19:0/4125519278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fbc0cd3f0 0x7f6fbc0c9b90 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:00.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.999+0000 7f6fc1cd2640 1 --2- 172.21.15.19:0/4125519278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fbc072d30 0x7f6fbc14ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:00.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.999+0000 7f6fc1cd2640 1 -- 172.21.15.19:0/4125519278 >> 172.21.15.19:0/4125519278 conn(0x7f6fbc067d70 msgr2=0x7f6fbc06e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:00.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.999+0000 7f6fc1cd2640 1 -- 172.21.15.19:0/4125519278 shutdown_connections 2024-09-12T02:05:00.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:04:59.999+0000 7f6fc1cd2640 1 -- 172.21.15.19:0/4125519278 wait complete. 2024-09-12T02:05:00.013 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:05:00.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.120+0000 7f0f0152c640 1 Processor -- start 2024-09-12T02:05:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.120+0000 7f0f0152c640 1 -- start start 2024-09-12T02:05:00.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.121+0000 7f0f0152c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0efc15e5d0 0x7f0efc0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:00.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.121+0000 7f0f0152c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0efc09b140 0x7f0efc168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:00.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.121+0000 7f0f0152c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0efc06cec0 con 0x7f0efc06df60 2024-09-12T02:05:00.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.121+0000 7f0f0152c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f0efc06dad0 con 0x7f0efc09b140 2024-09-12T02:05:00.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.121+0000 7f0f0152c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0efc06d1a0 con 0x7f0efc15e5d0 2024-09-12T02:05:00.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.121+0000 7f0efb7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0efc09b140 0x7f0efc168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:00.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.121+0000 7f0efb7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0efc09b140 0x7f0efc168560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43908/0 (socket says 172.21.15.19:43908) 2024-09-12T02:05:00.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.121+0000 7f0efb7fe640 1 -- 172.21.15.19:0/3662352856 learned_addr learned my addr 172.21.15.19:0/3662352856 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:00.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.121+0000 7f0efb7fe640 1 -- 172.21.15.19:0/3662352856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0efc15e5d0 msgr2=0x7f0efc0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:00.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.121+0000 7f0efaffd640 1 --2- 172.21.15.19:0/3662352856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0efc15e5d0 0x7f0efc0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:00.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.121+0000 7f0efb7fe640 1 --2- 172.21.15.19:0/3662352856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0efc15e5d0 0x7f0efc0d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:00.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.121+0000 7f0efb7fe640 1 -- 172.21.15.19:0/3662352856 >> v1:172.21.15.135:6789/0 conn(0x7f0efc06df60 legacy=0x7f0efc09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:00.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.121+0000 7f0efb7fe640 1 -- 172.21.15.19:0/3662352856 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0efc06d480 con 0x7f0efc09b140 2024-09-12T02:05:00.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.121+0000 7f0efaffd640 1 --2- 172.21.15.19:0/3662352856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0efc15e5d0 0x7f0efc0d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:00.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.122+0000 7f0efb7fe640 1 --2- 172.21.15.19:0/3662352856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc09b140 0x7f0efc168560 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009e50 tx=0x7f0ef402a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55cf2d08d1effe38 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:00.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.122+0000 7f0ef9ffb640 1 -- 172.21.15.19:0/3662352856 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4036070 con 0x7f0efc09b140 2024-09-12T02:05:00.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.122+0000 7f0ef9ffb640 1 -- 172.21.15.19:0/3662352856 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef4031600 con 0x7f0efc09b140 2024-09-12T02:05:00.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.122+0000 7f0ef9ffb640 1 -- 172.21.15.19:0/3662352856 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef40319d0 con 0x7f0efc09b140 2024-09-12T02:05:00.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.123+0000 7f0f0152c640 1 -- 172.21.15.19:0/3662352856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc09b140 msgr2=0x7f0efc168560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:00.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.123+0000 7f0f0152c640 1 --2- 172.21.15.19:0/3662352856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc09b140 0x7f0efc168560 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009e50 tx=0x7f0ef402a750 comp rx=0 tx=0).stop 2024-09-12T02:05:00.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.123+0000 7f0f0152c640 1 -- 172.21.15.19:0/3662352856 shutdown_connections 2024-09-12T02:05:00.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.123+0000 7f0f0152c640 1 --2- 172.21.15.19:0/3662352856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc09b140 0x7f0efc168560 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:00.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.123+0000 7f0f0152c640 1 --2- 172.21.15.19:0/3662352856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0efc15e5d0 0x7f0efc0d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:00.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.123+0000 7f0f0152c640 1 -- 172.21.15.19:0/3662352856 >> 172.21.15.19:0/3662352856 conn(0x7f0efc0d23a0 msgr2=0x7f0efc0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:00.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.123+0000 7f0f0152c640 1 -- 172.21.15.19:0/3662352856 shutdown_connections 2024-09-12T02:05:00.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.123+0000 7f0f0152c640 1 -- 172.21.15.19:0/3662352856 wait complete. 2024-09-12T02:05:00.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.124+0000 7f0f0152c640 1 Processor -- start 2024-09-12T02:05:00.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.124+0000 7f0f0152c640 1 -- start start 2024-09-12T02:05:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.125+0000 7f0f0152c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc06df60 0x7f0efc152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.125+0000 7f0f0152c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0efc09b140 0x7f0efc0c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.125+0000 7f0f0152c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0efc15e5d0 0x7f0efc0c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.125+0000 7f0f0152c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0efc15eb30 con 0x7f0efc06df60 2024-09-12T02:05:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.125+0000 7f0f0152c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0efc15e9b0 con 0x7f0efc15e5d0 2024-09-12T02:05:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.125+0000 7f0f0152c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0efc0d1630 con 0x7f0efc09b140 2024-09-12T02:05:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.125+0000 7f0efaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc06df60 0x7f0efc152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.125+0000 7f0efaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc06df60 0x7f0efc152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43914/0 (socket says 172.21.15.19:43914) 2024-09-12T02:05:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.125+0000 7f0efaffd640 1 -- 172.21.15.19:0/989008295 learned_addr learned my addr 172.21.15.19:0/989008295 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.125+0000 7f0efb7fe640 1 --2- 172.21.15.19:0/989008295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0efc15e5d0 0x7f0efc0c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.125+0000 7f0efa7fc640 1 --2- 172.21.15.19:0/989008295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0efc09b140 0x7f0efc0c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:00.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.125+0000 7f0efaffd640 1 -- 172.21.15.19:0/989008295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0efc09b140 msgr2=0x7f0efc0c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:00.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.125+0000 7f0efaffd640 1 --2- 172.21.15.19:0/989008295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0efc09b140 0x7f0efc0c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:00.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.125+0000 7f0efaffd640 1 -- 172.21.15.19:0/989008295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0efc15e5d0 msgr2=0x7f0efc0c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:00.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.125+0000 7f0efaffd640 1 --2- 172.21.15.19:0/989008295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0efc15e5d0 0x7f0efc0c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:00.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.125+0000 7f0efaffd640 1 -- 172.21.15.19:0/989008295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0efc0b5590 con 0x7f0efc06df60 2024-09-12T02:05:00.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.125+0000 7f0efa7fc640 1 --2- 172.21.15.19:0/989008295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0efc09b140 0x7f0efc0c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:00.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.125+0000 7f0efb7fe640 1 --2- 172.21.15.19:0/989008295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0efc15e5d0 0x7f0efc0c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:00.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.126+0000 7f0efaffd640 1 --2- 172.21.15.19:0/989008295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc06df60 0x7f0efc152b60 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00c820 tx=0x7f0eec00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:00.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.126+0000 7f0ee37fe640 1 -- 172.21.15.19:0/989008295 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec015070 con 0x7f0efc06df60 2024-09-12T02:05:00.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.126+0000 7f0ee37fe640 1 -- 172.21.15.19:0/989008295 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eec007a30 con 0x7f0efc06df60 2024-09-12T02:05:00.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.126+0000 7f0ee37fe640 1 -- 172.21.15.19:0/989008295 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec007de0 con 0x7f0efc06df60 2024-09-12T02:05:00.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.126+0000 7f0f0152c640 1 -- 172.21.15.19:0/989008295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0efc1f80c0 con 0x7f0efc06df60 2024-09-12T02:05:00.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.126+0000 7f0f0152c640 1 -- 172.21.15.19:0/989008295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0efc1f8680 con 0x7f0efc06df60 2024-09-12T02:05:00.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.127+0000 7f0f0152c640 1 -- 172.21.15.19:0/989008295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0efc0d10f0 con 0x7f0efc06df60 2024-09-12T02:05:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.127+0000 7f0ee37fe640 1 -- 172.21.15.19:0/989008295 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0eec018070 con 0x7f0efc06df60 2024-09-12T02:05:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.128+0000 7f0ee37fe640 1 --2- 172.21.15.19:0/989008295 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0ee806be30 0x7f0ee806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.128+0000 7f0ee37fe640 1 -- 172.21.15.19:0/989008295 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8453+0+0 (secure 0 0 0) 0x7f0eec08b800 con 0x7f0efc06df60 2024-09-12T02:05:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.128+0000 7f0efa7fc640 1 --2- 172.21.15.19:0/989008295 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0ee806be30 0x7f0ee806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.129+0000 7f0efa7fc640 1 --2- 172.21.15.19:0/989008295 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0ee806be30 0x7f0ee806e2f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0efc1e63f0 tx=0x7f0ef0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:00.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.132+0000 7f0ee37fe640 1 -- 172.21.15.19:0/989008295 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0eec059730 con 0x7f0efc06df60 2024-09-12T02:05:00.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:00.379+0000 7f0f0152c640 1 -- 172.21.15.19:0/989008295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f0efc0b8320 con 0x7f0efc06df60 2024-09-12T02:05:01.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.001+0000 7f0ee37fe640 1 -- 172.21.15.19:0/989008295 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v231) ==== 101+0+0 (secure 0 0 0) 0x7f0eec059030 con 0x7f0efc06df60 2024-09-12T02:05:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:05:01.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.003+0000 7f0f0152c640 1 -- 172.21.15.19:0/989008295 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0ee806be30 msgr2=0x7f0ee806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.003+0000 7f0f0152c640 1 --2- 172.21.15.19:0/989008295 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0ee806be30 0x7f0ee806e2f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0efc1e63f0 tx=0x7f0ef0009040 comp rx=0 tx=0).stop 2024-09-12T02:05:01.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.004+0000 7f0f0152c640 1 -- 172.21.15.19:0/989008295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc06df60 msgr2=0x7f0efc152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.004+0000 7f0f0152c640 1 --2- 172.21.15.19:0/989008295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc06df60 0x7f0efc152b60 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00c820 tx=0x7f0eec00cce0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.004+0000 7f0f0152c640 1 -- 172.21.15.19:0/989008295 shutdown_connections 2024-09-12T02:05:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.004+0000 7f0f0152c640 1 --2- 172.21.15.19:0/989008295 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0ee806be30 0x7f0ee806e2f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.004+0000 7f0f0152c640 1 --2- 172.21.15.19:0/989008295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0efc15e5d0 0x7f0efc0c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.004+0000 7f0f0152c640 1 --2- 172.21.15.19:0/989008295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0efc09b140 0x7f0efc0c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.004+0000 7f0f0152c640 1 --2- 172.21.15.19:0/989008295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc06df60 0x7f0efc152b60 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.004+0000 7f0f0152c640 1 -- 172.21.15.19:0/989008295 >> 172.21.15.19:0/989008295 conn(0x7f0efc0d23a0 msgr2=0x7f0efc0b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.004+0000 7f0f0152c640 1 -- 172.21.15.19:0/989008295 shutdown_connections 2024-09-12T02:05:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.004+0000 7f0f0152c640 1 -- 172.21.15.19:0/989008295 wait complete. 2024-09-12T02:05:01.018 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:05:01.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.064+0000 7f4bad44af40 1 Processor -- start 2024-09-12T02:05:01.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.064+0000 7f4bad44af40 1 -- start start 2024-09-12T02:05:01.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.065+0000 7f4bad44af40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b940030f0 0x560db7654f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.065+0000 7f4bad44af40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560db76e3d00 0x560db76e47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.065+0000 7f4bad44af40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560db76e2cc0 0x560db7652ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.065+0000 7f4bad44af40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560db7579510 con 0x560db76e2cc0 2024-09-12T02:05:01.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.065+0000 7f4bad44af40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560db75d2c50 con 0x7f4b940030f0 2024-09-12T02:05:01.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.065+0000 7f4bad44af40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560db76fd1f0 con 0x560db76e3d00 2024-09-12T02:05:01.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.065+0000 7f4bab741640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560db76e2cc0 0x560db7652ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.065+0000 7f4bab741640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560db76e2cc0 0x560db7652ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53660/0 (socket says 172.21.15.19:53660) 2024-09-12T02:05:01.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.065+0000 7f4bab741640 1 -- 172.21.15.19:0/2324810006 learned_addr learned my addr 172.21.15.19:0/2324810006 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:01.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.065+0000 7f4baaf40640 1 --2- 172.21.15.19:0/2324810006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b940030f0 0x560db7654f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.065+0000 7f4baa73f640 1 --2- 172.21.15.19:0/2324810006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560db76e3d00 0x560db76e47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.065+0000 7f4bab741640 1 -- 172.21.15.19:0/2324810006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560db76e3d00 msgr2=0x560db76e47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:01.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.065+0000 7f4bab741640 1 --2- 172.21.15.19:0/2324810006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560db76e3d00 0x560db76e47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.065+0000 7f4bab741640 1 -- 172.21.15.19:0/2324810006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b940030f0 msgr2=0x560db7654f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:01.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.065+0000 7f4bab741640 1 --2- 172.21.15.19:0/2324810006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b940030f0 0x560db7654f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.065+0000 7f4bab741640 1 -- 172.21.15.19:0/2324810006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560db7655450 con 0x560db76e2cc0 2024-09-12T02:05:01.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.065+0000 7f4baaf40640 1 --2- 172.21.15.19:0/2324810006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b940030f0 0x560db7654f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:01.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.066+0000 7f4bab741640 1 --2- 172.21.15.19:0/2324810006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560db76e2cc0 0x560db7652ad0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x560db7671330 tx=0x7f4ba40064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2fa28649efed582 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:01.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.066+0000 7f4ba973d640 1 -- 172.21.15.19:0/2324810006 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4018070 con 0x560db76e2cc0 2024-09-12T02:05:01.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.066+0000 7f4ba973d640 1 -- 172.21.15.19:0/2324810006 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba40104c0 con 0x560db76e2cc0 2024-09-12T02:05:01.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.066+0000 7f4ba973d640 1 -- 172.21.15.19:0/2324810006 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4010870 con 0x560db76e2cc0 2024-09-12T02:05:01.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.066+0000 7f4bad44af40 1 -- 172.21.15.19:0/2324810006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560db76e2cc0 msgr2=0x560db7652ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.066+0000 7f4bad44af40 1 --2- 172.21.15.19:0/2324810006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560db76e2cc0 0x560db7652ad0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x560db7671330 tx=0x7f4ba40064f0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.066+0000 7f4bad44af40 1 -- 172.21.15.19:0/2324810006 shutdown_connections 2024-09-12T02:05:01.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.066+0000 7f4bad44af40 1 --2- 172.21.15.19:0/2324810006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560db76e2cc0 0x560db7652ad0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.066+0000 7f4bad44af40 1 --2- 172.21.15.19:0/2324810006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560db76e3d00 0x560db76e47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.066+0000 7f4bad44af40 1 --2- 172.21.15.19:0/2324810006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b940030f0 0x560db7654f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.066+0000 7f4bad44af40 1 -- 172.21.15.19:0/2324810006 >> 172.21.15.19:0/2324810006 conn(0x560db7628ad0 msgr2=0x560db7626be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:01.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.066+0000 7f4bad44af40 1 -- 172.21.15.19:0/2324810006 shutdown_connections 2024-09-12T02:05:01.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.066+0000 7f4bad44af40 1 -- 172.21.15.19:0/2324810006 wait complete. 2024-09-12T02:05:01.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.067+0000 7f4bad44af40 1 Processor -- start 2024-09-12T02:05:01.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.067+0000 7f4bad44af40 1 -- start start 2024-09-12T02:05:01.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.068+0000 7f4bad44af40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560db76e2cc0 0x560db7626dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.068+0000 7f4bad44af40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560db76e3d00 0x560db7797b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.068+0000 7f4bad44af40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b940030f0 0x560db77980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.068+0000 7f4bad44af40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560db76e4180 con 0x7f4b940030f0 2024-09-12T02:05:01.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.068+0000 7f4bad44af40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560db7670120 con 0x560db76e3d00 2024-09-12T02:05:01.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.068+0000 7f4bad44af40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560db76cf7a0 con 0x560db76e2cc0 2024-09-12T02:05:01.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.068+0000 7f4bab741640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b940030f0 0x560db77980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.068+0000 7f4bab741640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b940030f0 0x560db77980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53670/0 (socket says 172.21.15.19:53670) 2024-09-12T02:05:01.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.068+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 learned_addr learned my addr 172.21.15.19:0/771056504 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:01.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.068+0000 7f4baaf40640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560db76e2cc0 0x560db7626dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.068+0000 7f4baa73f640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560db76e3d00 0x560db7797b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.068+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560db76e2cc0 msgr2=0x560db7626dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.068+0000 7f4bab741640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560db76e2cc0 0x560db7626dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.068+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560db76e3d00 msgr2=0x560db7797b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.068+0000 7f4bab741640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560db76e3d00 0x560db7797b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.068+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560db76e4f50 con 0x7f4b940030f0 2024-09-12T02:05:01.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.068+0000 7f4bab741640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b940030f0 0x560db77980d0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x560db7657820 tx=0x560db7671360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:01.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.069+0000 7f4b93fff640 1 -- 172.21.15.19:0/771056504 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4023070 con 0x7f4b940030f0 2024-09-12T02:05:01.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.069+0000 7f4b93fff640 1 -- 172.21.15.19:0/771056504 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba4003650 con 0x7f4b940030f0 2024-09-12T02:05:01.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.069+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560db76cfc30 con 0x7f4b940030f0 2024-09-12T02:05:01.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.069+0000 7f4b93fff640 1 -- 172.21.15.19:0/771056504 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4018040 con 0x7f4b940030f0 2024-09-12T02:05:01.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.069+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560db76d7c70 con 0x7f4b940030f0 2024-09-12T02:05:01.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.070+0000 7f4b93fff640 1 -- 172.21.15.19:0/771056504 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ba4003a00 con 0x7f4b940030f0 2024-09-12T02:05:01.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.071+0000 7f4b93fff640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4b9806a840 0x7f4b9806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.071+0000 7f4b93fff640 1 -- 172.21.15.19:0/771056504 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8453+0+0 (secure 0 0 0) 0x7f4ba408ad60 con 0x7f4b940030f0 2024-09-12T02:05:01.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.071+0000 7f4baaf40640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4b9806a840 0x7f4b9806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.074 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:05:01.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.071+0000 7f4bad44af40 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560db7627310 0x560db76f9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.071+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db76fa3f0 con 0x560db7627310 2024-09-12T02:05:01.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.071+0000 7f4baa73f640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560db7627310 0x560db76f9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.071+0000 7f4baaf40640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4b9806a840 0x7f4b9806cd00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x560db76142d0 tx=0x7f4b9c00c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:01.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.071+0000 7f4baa73f640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560db7627310 0x560db76f9eb0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:01.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.073+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v120'784 uv758 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.073+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db76fa7f0 con 0x560db7627310 2024-09-12T02:05:01.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.074+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v120'785 uv785 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.074+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db76fac20 con 0x560db7627310 2024-09-12T02:05:01.076 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:05:01.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.076+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v120'786 uv786 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.076+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a1e70 con 0x560db7627310 2024-09-12T02:05:01.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.077+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v120'787 uv787 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.077+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a2210 con 0x560db7627310 2024-09-12T02:05:01.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.078+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v120'788 uv788 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.078+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a0e60 con 0x560db7627310 2024-09-12T02:05:01.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.079+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v120'789 uv789 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.079+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a1220 con 0x560db7627310 2024-09-12T02:05:01.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.080+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v120'790 uv764 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.080+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77a15c0 con 0x560db7627310 2024-09-12T02:05:01.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.081+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v120'791 uv791 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.081+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a15c0 con 0x560db7627310 2024-09-12T02:05:01.083 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:05:01.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.082+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v120'792 uv792 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.082+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a15c0 con 0x560db7627310 2024-09-12T02:05:01.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.083+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v120'793 uv793 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.083+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a15c0 con 0x560db7627310 2024-09-12T02:05:01.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.084+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v120'794 uv794 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.084+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a15c0 con 0x560db7627310 2024-09-12T02:05:01.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.085+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v120'795 uv795 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.085+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a15c0 con 0x560db7627310 2024-09-12T02:05:01.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.087+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v120'796 uv771 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.087+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77a15c0 con 0x560db7627310 2024-09-12T02:05:01.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.088+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v120'797 uv797 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.088+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a15c0 con 0x560db7627310 2024-09-12T02:05:01.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.089+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v120'798 uv798 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.089 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:05:01.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.089+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a15c0 con 0x560db7627310 2024-09-12T02:05:01.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.090+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v120'799 uv799 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.090+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a15c0 con 0x560db7627310 2024-09-12T02:05:01.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.091+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v120'800 uv800 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.091+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a15c0 con 0x560db7627310 2024-09-12T02:05:01.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.092+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v120'801 uv801 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.092+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db7655620 con 0x560db7627310 2024-09-12T02:05:01.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.093+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v120'802 uv802 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.093+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db7655620 con 0x560db7627310 2024-09-12T02:05:01.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.094+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v120'803 uv777 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.094+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db7655620 con 0x560db7627310 2024-09-12T02:05:01.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.095+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v120'804 uv804 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.095+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a1870 con 0x560db7627310 2024-09-12T02:05:01.097 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:05:01.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.096+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v120'805 uv805 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.097+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a1870 con 0x560db7627310 2024-09-12T02:05:01.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.098+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v120'806 uv806 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.098+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a1870 con 0x560db7627310 2024-09-12T02:05:01.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.099+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v120'807 uv807 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.099+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a1870 con 0x560db7627310 2024-09-12T02:05:01.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.100+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v120'808 uv808 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.100+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a1870 con 0x560db7627310 2024-09-12T02:05:01.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.101+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v120'809 uv783 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.101+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77a1870 con 0x560db7627310 2024-09-12T02:05:01.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.102+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v120'810 uv810 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.102+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a1870 con 0x560db7627310 2024-09-12T02:05:01.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.103+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v120'811 uv811 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.103 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:05:01.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.103+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a1870 con 0x560db7627310 2024-09-12T02:05:01.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.104+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v120'812 uv812 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.104+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a1870 con 0x560db7627310 2024-09-12T02:05:01.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.105+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v120'813 uv813 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.105+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a1870 con 0x560db7627310 2024-09-12T02:05:01.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.106+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v120'814 uv814 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db7627310 2024-09-12T02:05:01.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.106+0000 7f4bad44af40 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560db77a2ac0 0x560db77a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.106+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a1870 con 0x560db77a2ac0 2024-09-12T02:05:01.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.106+0000 7f4baaf40640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560db77a2ac0 0x560db77a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.106+0000 7f4baaf40640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560db77a2ac0 0x560db77a4eb0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:01.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.108+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v120'572 uv554 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.108+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77a53f0 con 0x560db77a2ac0 2024-09-12T02:05:01.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.109+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v120'573 uv573 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.109+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a5790 con 0x560db77a2ac0 2024-09-12T02:05:01.111 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:05:01.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.111+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v120'574 uv574 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.111+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a5fe0 con 0x560db77a2ac0 2024-09-12T02:05:01.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.112+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v120'575 uv575 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.112+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a6380 con 0x560db77a2ac0 2024-09-12T02:05:01.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.113+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v120'576 uv576 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.113+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a6720 con 0x560db77a2ac0 2024-09-12T02:05:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.114+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v120'577 uv559 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.114+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77a6ac0 con 0x560db77a2ac0 2024-09-12T02:05:01.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.115+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v120'578 uv578 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.115+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a6ac0 con 0x560db77a2ac0 2024-09-12T02:05:01.116 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:05:01.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.116+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v120'579 uv579 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.116+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a6ac0 con 0x560db77a2ac0 2024-09-12T02:05:01.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.117+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v120'580 uv580 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.117+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a6ac0 con 0x560db77a2ac0 2024-09-12T02:05:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.119+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v120'581 uv581 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.119+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a6ac0 con 0x560db77a2ac0 2024-09-12T02:05:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.120+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v120'582 uv571 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.120+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77a6ac0 con 0x560db77a2ac0 2024-09-12T02:05:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.121+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v120'583 uv583 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.121+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a6ac0 con 0x560db77a2ac0 2024-09-12T02:05:01.122 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:05:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.122+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v120'584 uv584 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.122+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77aaf40 con 0x560db77a2ac0 2024-09-12T02:05:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.123+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v120'585 uv585 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.123+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77aaf40 con 0x560db77a2ac0 2024-09-12T02:05:01.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.124+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v120'586 uv586 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.124+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a6ac0 con 0x560db77a2ac0 2024-09-12T02:05:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.125+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v120'587 uv570 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.125+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77a6ac0 con 0x560db77a2ac0 2024-09-12T02:05:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.126+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v120'588 uv588 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.126+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a6ac0 con 0x560db77a2ac0 2024-09-12T02:05:01.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.127+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v120'589 uv589 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.128 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:05:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.127+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a7ad0 con 0x560db77a2ac0 2024-09-12T02:05:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.128+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v120'590 uv590 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.128+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a7ad0 con 0x560db77a2ac0 2024-09-12T02:05:01.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.129+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v120'591 uv591 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.129+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a6ac0 con 0x560db77a2ac0 2024-09-12T02:05:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.131+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v120'592 uv592 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77a2ac0 2024-09-12T02:05:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.131+0000 7f4bad44af40 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560db77a6fd0 0x560db77a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.131+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a9900 con 0x560db77a6fd0 2024-09-12T02:05:01.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.131+0000 7f4baa73f640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560db77a6fd0 0x560db77a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.131+0000 7f4baa73f640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560db77a6fd0 0x560db77a93c0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:01.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.133+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v120'153 uv152 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.133+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77a9980 con 0x560db77a6fd0 2024-09-12T02:05:01.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.134+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v120'154 uv154 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.134+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a9d70 con 0x560db77a6fd0 2024-09-12T02:05:01.135 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:05:01.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.135+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v120'155 uv155 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.135+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77aad80 con 0x560db77a6fd0 2024-09-12T02:05:01.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.136+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v120'156 uv156 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.136+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77aad80 con 0x560db77a6fd0 2024-09-12T02:05:01.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.137+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v120'157 uv157 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.137+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77a9d70 con 0x560db77a6fd0 2024-09-12T02:05:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.138+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v120'158 uv158 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.138+0000 7f4bad44af40 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560db77aa3f0 0x560db77ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.138+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77acdd0 con 0x560db77aa3f0 2024-09-12T02:05:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.138+0000 7f4bab741640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560db77aa3f0 0x560db77ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.138+0000 7f4bab741640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560db77aa3f0 0x560db77ac7e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.140+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v120'112 uv111 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.140+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77ad2e0 con 0x560db77aa3f0 2024-09-12T02:05:01.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.141+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v120'113 uv113 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.141+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77ad7e0 con 0x560db77aa3f0 2024-09-12T02:05:01.142 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:05:01.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.143+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v120'114 uv114 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.143+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77ae0a0 con 0x560db77aa3f0 2024-09-12T02:05:01.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.144+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v120'115 uv115 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.144+0000 7f4bad44af40 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560db77ae950 0x560db77b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.144+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b12d0 con 0x560db77ae950 2024-09-12T02:05:01.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.144+0000 7f4baaf40640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560db77ae950 0x560db77b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.144+0000 7f4baaf40640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560db77ae950 0x560db77b0d40 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:01.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.145+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v120'153 uv152 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.145+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77b16a0 con 0x560db77ae950 2024-09-12T02:05:01.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.146+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v120'154 uv154 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.146+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b16a0 con 0x560db77ae950 2024-09-12T02:05:01.148 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:05:01.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.147+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v120'155 uv155 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.147+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b26b0 con 0x560db77ae950 2024-09-12T02:05:01.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.149+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v120'156 uv156 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.149+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b26b0 con 0x560db77ae950 2024-09-12T02:05:01.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.151+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v120'157 uv157 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.151+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b16a0 con 0x560db77ae950 2024-09-12T02:05:01.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.152+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v120'158 uv158 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.152+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b16a0 con 0x560db77aa3f0 2024-09-12T02:05:01.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.152+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v120'282 uv276 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.152+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1a60 con 0x560db77aa3f0 2024-09-12T02:05:01.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.153+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v120'283 uv283 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.153+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e50 con 0x560db77aa3f0 2024-09-12T02:05:01.154 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:05:01.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.154+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v120'284 uv284 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.154+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b3250 con 0x560db77aa3f0 2024-09-12T02:05:01.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.155+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v120'285 uv285 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.155+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b3250 con 0x560db77aa3f0 2024-09-12T02:05:01.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.156+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v120'286 uv286 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.156+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1f20 con 0x560db77aa3f0 2024-09-12T02:05:01.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.157+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v120'287 uv287 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.157+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1eb0 con 0x560db77aa3f0 2024-09-12T02:05:01.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.158+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v120'288 uv281 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.158+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e60 con 0x560db77aa3f0 2024-09-12T02:05:01.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.159+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v120'289 uv289 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.160+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e40 con 0x560db77aa3f0 2024-09-12T02:05:01.161 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:05:01.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.161+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v120'290 uv290 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.161+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e00 con 0x560db77aa3f0 2024-09-12T02:05:01.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.162+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v120'291 uv291 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.162+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e00 con 0x560db77aa3f0 2024-09-12T02:05:01.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.163+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v120'292 uv292 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.163+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e00 con 0x560db77aa3f0 2024-09-12T02:05:01.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.164+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v120'127 uv126 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.164+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e00 con 0x560db77aa3f0 2024-09-12T02:05:01.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.165+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v120'128 uv128 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.165+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e00 con 0x560db77aa3f0 2024-09-12T02:05:01.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.166+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v120'129 uv129 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.167 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:05:01.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.166+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e00 con 0x560db77aa3f0 2024-09-12T02:05:01.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.167+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v120'130 uv130 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.167+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e00 con 0x560db77aa3f0 2024-09-12T02:05:01.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.168+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v120'131 uv131 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f4ba401b040 con 0x560db77aa3f0 2024-09-12T02:05:01.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.168+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e00 con 0x560db77ae950 2024-09-12T02:05:01.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.169+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v120'153 uv152 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.169+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e00 con 0x560db77ae950 2024-09-12T02:05:01.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.170+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v120'154 uv154 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.170+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e00 con 0x560db77ae950 2024-09-12T02:05:01.171 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:05:01.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.171+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v120'155 uv155 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.171+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e60 con 0x560db77ae950 2024-09-12T02:05:01.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.172+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v120'156 uv156 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.172+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e20 con 0x560db77ae950 2024-09-12T02:05:01.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.173+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v120'157 uv157 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.173+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e20 con 0x560db77ae950 2024-09-12T02:05:01.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.174+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v120'158 uv158 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.174+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e20 con 0x560db77ae950 2024-09-12T02:05:01.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.176+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v120'253 uv247 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.176+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e20 con 0x560db77ae950 2024-09-12T02:05:01.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.177+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v120'254 uv254 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.177+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b1e20 con 0x560db77ae950 2024-09-12T02:05:01.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.178+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v120'255 uv255 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.179 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:05:01.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.178+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b22f0 con 0x560db77ae950 2024-09-12T02:05:01.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.179+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v120'256 uv256 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.179+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b22f0 con 0x560db77ae950 2024-09-12T02:05:01.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.180+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v120'257 uv257 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.180+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b22f0 con 0x560db77ae950 2024-09-12T02:05:01.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.181+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v120'258 uv252 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.181+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77b22f0 con 0x560db77ae950 2024-09-12T02:05:01.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.182+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v120'259 uv259 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.182+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b22f0 con 0x560db77ae950 2024-09-12T02:05:01.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.183+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v120'260 uv260 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.184 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:05:01.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.183+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b22f0 con 0x560db77ae950 2024-09-12T02:05:01.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.184+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v120'261 uv261 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.184+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b2700 con 0x560db77ae950 2024-09-12T02:05:01.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.185+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v120'262 uv262 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.185+0000 7f4bad44af40 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560db77b2dc0 0x560db77b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.185+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77b2dc0 2024-09-12T02:05:01.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.186+0000 7f4baa73f640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560db77b2dc0 0x560db77b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.186+0000 7f4baa73f640 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560db77b2dc0 0x560db77b51b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:01.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.187+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v120'111 uv110 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77b2dc0 2024-09-12T02:05:01.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.187+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77b2dc0 2024-09-12T02:05:01.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.188+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v120'112 uv112 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77b2dc0 2024-09-12T02:05:01.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.188+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77b2dc0 2024-09-12T02:05:01.189 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:05:01.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.189+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v120'113 uv113 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77b2dc0 2024-09-12T02:05:01.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.189+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77b2dc0 2024-09-12T02:05:01.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.190+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v120'114 uv114 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77b2dc0 2024-09-12T02:05:01.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.190+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77ae950 2024-09-12T02:05:01.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.191+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v120'153 uv152 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.191+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77ae950 2024-09-12T02:05:01.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.192+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v120'154 uv154 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.192+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77ae950 2024-09-12T02:05:01.194 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:05:01.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.193+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v120'155 uv155 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.193+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b6700 con 0x560db77ae950 2024-09-12T02:05:01.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.194+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v120'156 uv156 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.194+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b6700 con 0x560db77ae950 2024-09-12T02:05:01.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.195+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v120'157 uv157 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.196+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77ae950 2024-09-12T02:05:01.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.196+0000 7f4baaf40640 1 -- 172.21.15.19:0/771056504 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v120'158 uv158 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4b9c007910 con 0x560db77ae950 2024-09-12T02:05:01.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.196+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77a6fd0 2024-09-12T02:05:01.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.197+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v120'130 uv129 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.197+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77a6fd0 2024-09-12T02:05:01.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.199+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v120'131 uv131 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.199+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77a6fd0 2024-09-12T02:05:01.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.200+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v120'132 uv132 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.200 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:05:01.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.200+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77a6fd0 2024-09-12T02:05:01.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.201+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v120'133 uv133 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.201+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77a6fd0 2024-09-12T02:05:01.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.202+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v120'134 uv134 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.202+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77a6fd0 2024-09-12T02:05:01.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.203+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v120'314 uv306 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.203+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77a6fd0 2024-09-12T02:05:01.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.204+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v120'315 uv315 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.204+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77a6fd0 2024-09-12T02:05:01.205 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:05:01.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.205+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v120'316 uv316 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.205+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77a6fd0 2024-09-12T02:05:01.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.206+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v120'317 uv317 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.206+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77a6fd0 2024-09-12T02:05:01.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.208+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v120'318 uv318 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.208+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77a6fd0 2024-09-12T02:05:01.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.209+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v120'319 uv313 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.209+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77a6fd0 2024-09-12T02:05:01.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.210+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v120'320 uv320 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.210+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77a6fd0 2024-09-12T02:05:01.211 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:05:01.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.211+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v120'321 uv321 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.211+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b6700 con 0x560db77a6fd0 2024-09-12T02:05:01.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.212+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v120'322 uv322 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.212+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b6700 con 0x560db77a6fd0 2024-09-12T02:05:01.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.213+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v120'323 uv323 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.213+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b56f0 con 0x560db77a6fd0 2024-09-12T02:05:01.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.214+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v120'324 uv324 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.214+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x560db77b5ba0 con 0x560db77a6fd0 2024-09-12T02:05:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4baa73f640 1 -- 172.21.15.19:0/771056504 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v120'325 uv325 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f4ba00547a0 con 0x560db77a6fd0 2024-09-12T02:05:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560db77a2ac0 msgr2=0x560db77a4eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560db77a2ac0 0x560db77a4eb0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560db7627310 msgr2=0x560db76f9eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560db7627310 0x560db76f9eb0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560db77aa3f0 msgr2=0x560db77ac7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560db77aa3f0 0x560db77ac7e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560db77b2dc0 msgr2=0x560db77b51b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560db77b2dc0 0x560db77b51b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560db77a6fd0 msgr2=0x560db77a93c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560db77a6fd0 0x560db77a93c0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560db77ae950 msgr2=0x560db77b0d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560db77ae950 0x560db77b0d40 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 reap_dead start 2024-09-12T02:05:01.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 reap_dead start 2024-09-12T02:05:01.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bab741640 1 -- 172.21.15.19:0/771056504 reap_dead start 2024-09-12T02:05:01.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4b9806a840 msgr2=0x7f4b9806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4b9806a840 0x7f4b9806cd00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x560db76142d0 tx=0x7f4b9c00c040 comp rx=0 tx=0).stop 2024-09-12T02:05:01.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b940030f0 msgr2=0x560db77980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b940030f0 0x560db77980d0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x560db7657820 tx=0x560db7671360 comp rx=0 tx=0).stop 2024-09-12T02:05:01.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 shutdown_connections 2024-09-12T02:05:01.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4b9806a840 0x7f4b9806cd00 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 --2- 172.21.15.19:0/771056504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b940030f0 0x560db77980d0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 >> 172.21.15.19:0/771056504 conn(0x560db7628ad0 msgr2=0x560db7654d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:01.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 shutdown_connections 2024-09-12T02:05:01.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.215+0000 7f4bad44af40 1 -- 172.21.15.19:0/771056504 wait complete. 2024-09-12T02:05:01.220 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate 500.00000000 0 2024-09-12T02:05:01.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.264+0000 7fd0908d0f40 1 Processor -- start 2024-09-12T02:05:01.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.264+0000 7fd0908d0f40 1 -- start start 2024-09-12T02:05:01.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.264+0000 7fd0908d0f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4be323180 0x55b4be3d8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd0908d0f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4be351050 0x55b4be3f8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd0908d0f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b4be3db080 0x55b4be3f9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd0908d0f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b4be31fdc0 con 0x55b4be351050 2024-09-12T02:05:01.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd0908d0f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b4be31fae0 con 0x55b4be323180 2024-09-12T02:05:01.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd0908d0f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55b4be3200a0 con 0x55b4be3db080 2024-09-12T02:05:01.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd08dbc5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4be351050 0x55b4be3f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd08dbc5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4be351050 0x55b4be3f8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53682/0 (socket says 172.21.15.19:53682) 2024-09-12T02:05:01.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd08dbc5640 1 -- 172.21.15.19:0/933608024 learned_addr learned my addr 172.21.15.19:0/933608024 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:01.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd08e3c6640 1 --2- 172.21.15.19:0/933608024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4be323180 0x55b4be3d8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd08ebc7640 1 --2- 172.21.15.19:0/933608024 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b4be3db080 0x55b4be3f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd08dbc5640 1 -- 172.21.15.19:0/933608024 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b4be3db080 msgr2=0x55b4be3f9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:01.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd08dbc5640 1 --2- 172.21.15.19:0/933608024 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b4be3db080 0x55b4be3f9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd08dbc5640 1 -- 172.21.15.19:0/933608024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4be323180 msgr2=0x55b4be3d8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:01.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd08dbc5640 1 --2- 172.21.15.19:0/933608024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4be323180 0x55b4be3d8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd08dbc5640 1 -- 172.21.15.19:0/933608024 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4be24bcb0 con 0x55b4be351050 2024-09-12T02:05:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd08e3c6640 1 --2- 172.21.15.19:0/933608024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4be323180 0x55b4be3d8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:05:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd08dbc5640 1 --2- 172.21.15.19:0/933608024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4be351050 0x55b4be3f8ef0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fd084000c00 tx=0x7fd084051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72ba9e52a930a74 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd08cbc3640 1 -- 172.21.15.19:0/933608024 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084056070 con 0x55b4be351050 2024-09-12T02:05:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd08cbc3640 1 -- 172.21.15.19:0/933608024 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0840529d0 con 0x55b4be351050 2024-09-12T02:05:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.265+0000 7fd08cbc3640 1 -- 172.21.15.19:0/933608024 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084052dc0 con 0x55b4be351050 2024-09-12T02:05:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.266+0000 7fd0908d0f40 1 -- 172.21.15.19:0/933608024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4be351050 msgr2=0x55b4be3f8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.266+0000 7fd0908d0f40 1 --2- 172.21.15.19:0/933608024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4be351050 0x55b4be3f8ef0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fd084000c00 tx=0x7fd084051000 comp rx=0 tx=0).stop 2024-09-12T02:05:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.266+0000 7fd0908d0f40 1 -- 172.21.15.19:0/933608024 shutdown_connections 2024-09-12T02:05:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.266+0000 7fd0908d0f40 1 --2- 172.21.15.19:0/933608024 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b4be3db080 0x55b4be3f9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.266+0000 7fd0908d0f40 1 --2- 172.21.15.19:0/933608024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4be351050 0x55b4be3f8ef0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.266+0000 7fd0908d0f40 1 --2- 172.21.15.19:0/933608024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4be323180 0x55b4be3d8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.266+0000 7fd0908d0f40 1 -- 172.21.15.19:0/933608024 >> 172.21.15.19:0/933608024 conn(0x55b4be3209e0 msgr2=0x55b4be34b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:01.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.266+0000 7fd0908d0f40 1 -- 172.21.15.19:0/933608024 shutdown_connections 2024-09-12T02:05:01.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.266+0000 7fd0908d0f40 1 -- 172.21.15.19:0/933608024 wait complete. 2024-09-12T02:05:01.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.266+0000 7fd0908d0f40 1 Processor -- start 2024-09-12T02:05:01.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.266+0000 7fd0908d0f40 1 -- start start 2024-09-12T02:05:01.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.267+0000 7fd0908d0f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4be323180 0x55b4be3f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.267+0000 7fd0908d0f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4be351050 0x55b4be3f39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.267+0000 7fd0908d0f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b4be3db080 0x55b4be3f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.267+0000 7fd0908d0f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b4be36ad00 con 0x55b4be323180 2024-09-12T02:05:01.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.267+0000 7fd0908d0f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b4be31fdc0 con 0x55b4be351050 2024-09-12T02:05:01.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.267+0000 7fd0908d0f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55b4be36aa20 con 0x55b4be3db080 2024-09-12T02:05:01.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.267+0000 7fd08e3c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4be323180 0x55b4be3f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.267+0000 7fd08e3c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4be323180 0x55b4be3f5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53690/0 (socket says 172.21.15.19:53690) 2024-09-12T02:05:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.267+0000 7fd08e3c6640 1 -- 172.21.15.19:0/429311625 learned_addr learned my addr 172.21.15.19:0/429311625 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.267+0000 7fd08dbc5640 1 --2- 172.21.15.19:0/429311625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4be351050 0x55b4be3f39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.267+0000 7fd08ebc7640 1 --2- 172.21.15.19:0/429311625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b4be3db080 0x55b4be3f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.268+0000 7fd08e3c6640 1 -- 172.21.15.19:0/429311625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b4be3db080 msgr2=0x55b4be3f4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.268+0000 7fd08e3c6640 1 --2- 172.21.15.19:0/429311625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b4be3db080 0x55b4be3f4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.268+0000 7fd08e3c6640 1 -- 172.21.15.19:0/429311625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4be351050 msgr2=0x55b4be3f39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.268+0000 7fd08e3c6640 1 --2- 172.21.15.19:0/429311625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4be351050 0x55b4be3f39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.268+0000 7fd08e3c6640 1 -- 172.21.15.19:0/429311625 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4be3f6450 con 0x55b4be323180 2024-09-12T02:05:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.268+0000 7fd08ebc7640 1 --2- 172.21.15.19:0/429311625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b4be3db080 0x55b4be3f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.268+0000 7fd08e3c6640 1 --2- 172.21.15.19:0/429311625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4be323180 0x55b4be3f5f10 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fd0800086b0 tx=0x7fd0800087a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:01.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.268+0000 7fd07f7fe640 1 -- 172.21.15.19:0/429311625 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd080009e60 con 0x55b4be323180 2024-09-12T02:05:01.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.268+0000 7fd07f7fe640 1 -- 172.21.15.19:0/429311625 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd080006790 con 0x55b4be323180 2024-09-12T02:05:01.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.268+0000 7fd07f7fe640 1 -- 172.21.15.19:0/429311625 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd080006b40 con 0x55b4be323180 2024-09-12T02:05:01.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.268+0000 7fd0908d0f40 1 -- 172.21.15.19:0/429311625 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4be3f4e70 con 0x55b4be323180 2024-09-12T02:05:01.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.268+0000 7fd0908d0f40 1 -- 172.21.15.19:0/429311625 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4be3f5430 con 0x55b4be323180 2024-09-12T02:05:01.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.269+0000 7fd07f7fe640 1 -- 172.21.15.19:0/429311625 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd080006ce0 con 0x55b4be323180 2024-09-12T02:05:01.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.270+0000 7fd07f7fe640 1 --2- 172.21.15.19:0/429311625 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd07006a840 0x7fd07006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.270+0000 7fd07f7fe640 1 -- 172.21.15.19:0/429311625 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8453+0+0 (secure 0 0 0) 0x7fd08008a3f0 con 0x55b4be323180 2024-09-12T02:05:01.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.270+0000 7fd08dbc5640 1 --2- 172.21.15.19:0/429311625 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd07006a840 0x7fd07006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.270+0000 7fd0908d0f40 1 --2- 172.21.15.19:0/429311625 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b4be3f7a60 0x55b4be3c3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.270+0000 7fd0908d0f40 1 -- 172.21.15.19:0/429311625 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:1 13.15 13:aa448500:::500.00000000:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b4be3c39c0 con 0x55b4be3f7a60 2024-09-12T02:05:01.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.270+0000 7fd08ebc7640 1 --2- 172.21.15.19:0/429311625 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b4be3f7a60 0x55b4be3c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.271+0000 7fd08dbc5640 1 --2- 172.21.15.19:0/429311625 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd07006a840 0x7fd07006cd00 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd084064000 tx=0x7fd084053000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:01.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.271+0000 7fd08ebc7640 1 --2- 172.21.15.19:0/429311625 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b4be3f7a60 0x55b4be3c3480 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.272+0000 7fd08ebc7640 1 -- 172.21.15.19:0/429311625 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(1 500.00000000 [truncate 0] v120'293 uv293 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd088002a00 con 0x55b4be3f7a60 2024-09-12T02:05:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.272+0000 7fd0908d0f40 1 -- 172.21.15.19:0/429311625 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b4be3f7a60 msgr2=0x55b4be3c3480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.272+0000 7fd0908d0f40 1 --2- 172.21.15.19:0/429311625 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b4be3f7a60 0x55b4be3c3480 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.272+0000 7fd0908d0f40 1 -- 172.21.15.19:0/429311625 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd07006a840 msgr2=0x7fd07006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.272+0000 7fd0908d0f40 1 --2- 172.21.15.19:0/429311625 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd07006a840 0x7fd07006cd00 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd084064000 tx=0x7fd084053000 comp rx=0 tx=0).stop 2024-09-12T02:05:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.272+0000 7fd0908d0f40 1 -- 172.21.15.19:0/429311625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4be323180 msgr2=0x55b4be3f5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.272+0000 7fd0908d0f40 1 --2- 172.21.15.19:0/429311625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4be323180 0x55b4be3f5f10 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fd0800086b0 tx=0x7fd0800087a0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.272+0000 7fd08ebc7640 1 -- 172.21.15.19:0/429311625 reap_dead start 2024-09-12T02:05:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.272+0000 7fd0908d0f40 1 -- 172.21.15.19:0/429311625 shutdown_connections 2024-09-12T02:05:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.272+0000 7fd0908d0f40 1 -- 172.21.15.19:0/429311625 >> 172.21.15.19:0/429311625 conn(0x55b4be3209e0 msgr2=0x55b4be31ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.272+0000 7fd0908d0f40 1 -- 172.21.15.19:0/429311625 shutdown_connections 2024-09-12T02:05:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.272+0000 7fd0908d0f40 1 -- 172.21.15.19:0/429311625 wait complete. 2024-09-12T02:05:01.279 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:05:01.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.384+0000 7f475b1fd640 1 Processor -- start 2024-09-12T02:05:01.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.384+0000 7f475b1fd640 1 -- start start 2024-09-12T02:05:01.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.385+0000 7f475b1fd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47540d15f0 0x7f47540cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.385+0000 7f475b1fd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47540cf980 con 0x7f47540cf160 2024-09-12T02:05:01.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.385+0000 7f475b1fd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f475406d050 con 0x7f4754161a20 2024-09-12T02:05:01.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.385+0000 7f475b1fd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4754161e00 con 0x7f47540d15f0 2024-09-12T02:05:01.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.385+0000 7f475979a640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f47540cf160 0x7f475406d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48974/0 (socket says 172.21.15.19:48974) 2024-09-12T02:05:01.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.385+0000 7f475979a640 1 -- 172.21.15.19:0/3142151438 learned_addr learned my addr 172.21.15.19:0/3142151438 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:01.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.385+0000 7f4753fff640 1 --2- 172.21.15.19:0/3142151438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47540d15f0 0x7f47540cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.385+0000 7f47537fe640 1 -- 172.21.15.19:0/3142151438 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4006458318 0 0) 0x7f47540cf980 con 0x7f47540cf160 2024-09-12T02:05:01.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.385+0000 7f47537fe640 1 -- 172.21.15.19:0/3142151438 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f473c003520 con 0x7f47540cf160 2024-09-12T02:05:01.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.386+0000 7f4753fff640 1 -- 172.21.15.19:0/3142151438 >> v1:172.21.15.135:6789/0 conn(0x7f4754161a20 legacy=0x7f47540d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.386+0000 7f4753fff640 1 -- 172.21.15.19:0/3142151438 >> v1:172.21.15.19:6789/0 conn(0x7f47540cf160 legacy=0x7f475406d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.386+0000 7f47537fe640 1 -- 172.21.15.19:0/3142151438 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 328267453 0 0) 0x7f475406d050 con 0x7f4754161a20 2024-09-12T02:05:01.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.386+0000 7f4753fff640 1 -- 172.21.15.19:0/3142151438 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47540cfc20 con 0x7f47540d15f0 2024-09-12T02:05:01.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.386+0000 7f4753fff640 1 --2- 172.21.15.19:0/3142151438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47540d15f0 0x7f47540cec20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f47480097d0 tx=0x7f474802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af539d8bf7ccef80 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:01.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.387+0000 7f47537fe640 1 -- 172.21.15.19:0/3142151438 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4748037070 con 0x7f47540d15f0 2024-09-12T02:05:01.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.387+0000 7f47537fe640 1 -- 172.21.15.19:0/3142151438 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4748032440 con 0x7f47540d15f0 2024-09-12T02:05:01.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.387+0000 7f47537fe640 1 -- 172.21.15.19:0/3142151438 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47480327f0 con 0x7f47540d15f0 2024-09-12T02:05:01.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.387+0000 7f475b1fd640 1 -- 172.21.15.19:0/3142151438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47540d15f0 msgr2=0x7f47540cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.387+0000 7f475b1fd640 1 --2- 172.21.15.19:0/3142151438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47540d15f0 0x7f47540cec20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f47480097d0 tx=0x7f474802a210 comp rx=0 tx=0).stop 2024-09-12T02:05:01.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.387+0000 7f475b1fd640 1 -- 172.21.15.19:0/3142151438 shutdown_connections 2024-09-12T02:05:01.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.387+0000 7f475b1fd640 1 --2- 172.21.15.19:0/3142151438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47540d15f0 0x7f47540cec20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.387+0000 7f475b1fd640 1 -- 172.21.15.19:0/3142151438 >> 172.21.15.19:0/3142151438 conn(0x7f475409d850 msgr2=0x7f475408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:01.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.387+0000 7f475b1fd640 1 -- 172.21.15.19:0/3142151438 shutdown_connections 2024-09-12T02:05:01.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.387+0000 7f475b1fd640 1 -- 172.21.15.19:0/3142151438 wait complete. 2024-09-12T02:05:01.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.388+0000 7f475b1fd640 1 Processor -- start 2024-09-12T02:05:01.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.388+0000 7f475b1fd640 1 -- start start 2024-09-12T02:05:01.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.389+0000 7f475b1fd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47540cf160 0x7f4754158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.389+0000 7f475b1fd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47540d15f0 0x7f47541f4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.389+0000 7f475b1fd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4754161a20 0x7f47540cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.389+0000 7f475b1fd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f47540b1040 con 0x7f4754161a20 2024-09-12T02:05:01.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.389+0000 7f475b1fd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f475406d2f0 con 0x7f47540d15f0 2024-09-12T02:05:01.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.389+0000 7f475b1fd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f47540cf5f0 con 0x7f47540cf160 2024-09-12T02:05:01.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.389+0000 7f475979a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4754161a20 0x7f47540cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.390+0000 7f475979a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4754161a20 0x7f47540cd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53694/0 (socket says 172.21.15.19:53694) 2024-09-12T02:05:01.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.390+0000 7f475979a640 1 -- 172.21.15.19:0/3496775779 learned_addr learned my addr 172.21.15.19:0/3496775779 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:01.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.390+0000 7f4758f99640 1 --2- 172.21.15.19:0/3496775779 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47540cf160 0x7f4754158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.390+0000 7f4753fff640 1 --2- 172.21.15.19:0/3496775779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47540d15f0 0x7f47541f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.390+0000 7f475979a640 1 -- 172.21.15.19:0/3496775779 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47540cf160 msgr2=0x7f4754158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.390+0000 7f475979a640 1 --2- 172.21.15.19:0/3496775779 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47540cf160 0x7f4754158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.390+0000 7f475979a640 1 -- 172.21.15.19:0/3496775779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47540d15f0 msgr2=0x7f47541f4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.390+0000 7f475979a640 1 --2- 172.21.15.19:0/3496775779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47540d15f0 0x7f47541f4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.390+0000 7f475979a640 1 -- 172.21.15.19:0/3496775779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47540ce4e0 con 0x7f4754161a20 2024-09-12T02:05:01.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.390+0000 7f475979a640 1 --2- 172.21.15.19:0/3496775779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4754161a20 0x7f47540cd9f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f474c00cb40 tx=0x7f474c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:01.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.390+0000 7f47517fa640 1 -- 172.21.15.19:0/3496775779 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c017070 con 0x7f4754161a20 2024-09-12T02:05:01.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.390+0000 7f47517fa640 1 -- 172.21.15.19:0/3496775779 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f474c00aca0 con 0x7f4754161a20 2024-09-12T02:05:01.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.390+0000 7f475b1fd640 1 -- 172.21.15.19:0/3496775779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47540ce7c0 con 0x7f4754161a20 2024-09-12T02:05:01.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.390+0000 7f47517fa640 1 -- 172.21.15.19:0/3496775779 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c012620 con 0x7f4754161a20 2024-09-12T02:05:01.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.390+0000 7f475b1fd640 1 -- 172.21.15.19:0/3496775779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47540b54d0 con 0x7f4754161a20 2024-09-12T02:05:01.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.391+0000 7f475b1fd640 1 -- 172.21.15.19:0/3496775779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4754075770 con 0x7f4754161a20 2024-09-12T02:05:01.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.392+0000 7f47517fa640 1 -- 172.21.15.19:0/3496775779 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f474c01a070 con 0x7f4754161a20 2024-09-12T02:05:01.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.392+0000 7f47517fa640 1 --2- 172.21.15.19:0/3496775779 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f474006be30 0x7f474006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.393+0000 7f47517fa640 1 -- 172.21.15.19:0/3496775779 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8453+0+0 (secure 0 0 0) 0x7f474c08b700 con 0x7f4754161a20 2024-09-12T02:05:01.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.393+0000 7f4758f99640 1 --2- 172.21.15.19:0/3496775779 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f474006be30 0x7f474006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.393+0000 7f4758f99640 1 --2- 172.21.15.19:0/3496775779 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f474006be30 0x7f474006e2f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4744000f60 tx=0x7f4744009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:01.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.397+0000 7f47517fa640 1 -- 172.21.15.19:0/3496775779 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4754075770 con 0x7f4754161a20 2024-09-12T02:05:01.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.608+0000 7f475b1fd640 1 -- 172.21.15.19:0/3496775779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f47540b2630 con 0x7f4754161a20 2024-09-12T02:05:01.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.741+0000 7f47517fa640 1 -- 172.21.15.19:0/3496775779 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v232) ==== 162+0+0 (secure 0 0 0) 0x7f474c058f80 con 0x7f4754161a20 2024-09-12T02:05:01.741 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:05:01.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.743+0000 7f475b1fd640 1 -- 172.21.15.19:0/3496775779 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f474006be30 msgr2=0x7f474006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.743+0000 7f475b1fd640 1 --2- 172.21.15.19:0/3496775779 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f474006be30 0x7f474006e2f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4744000f60 tx=0x7f4744009040 comp rx=0 tx=0).stop 2024-09-12T02:05:01.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.743+0000 7f475b1fd640 1 -- 172.21.15.19:0/3496775779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4754161a20 msgr2=0x7f47540cd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.743+0000 7f475b1fd640 1 --2- 172.21.15.19:0/3496775779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4754161a20 0x7f47540cd9f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f474c00cb40 tx=0x7f474c00a060 comp rx=0 tx=0).stop 2024-09-12T02:05:01.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.743+0000 7f475b1fd640 1 -- 172.21.15.19:0/3496775779 shutdown_connections 2024-09-12T02:05:01.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.743+0000 7f475b1fd640 1 --2- 172.21.15.19:0/3496775779 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f474006be30 0x7f474006e2f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.743+0000 7f475b1fd640 1 --2- 172.21.15.19:0/3496775779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4754161a20 0x7f47540cd9f0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.743+0000 7f475b1fd640 1 --2- 172.21.15.19:0/3496775779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47540d15f0 0x7f47541f4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.743+0000 7f475b1fd640 1 --2- 172.21.15.19:0/3496775779 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47540cf160 0x7f4754158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.743+0000 7f475b1fd640 1 -- 172.21.15.19:0/3496775779 >> 172.21.15.19:0/3496775779 conn(0x7f475409d850 msgr2=0x7f47540d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:01.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.743+0000 7f475b1fd640 1 -- 172.21.15.19:0/3496775779 shutdown_connections 2024-09-12T02:05:01.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:01.743+0000 7f475b1fd640 1 -- 172.21.15.19:0/3496775779 wait complete. 2024-09-12T02:05:02.158 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:02.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.267+0000 7f0266d11640 1 Processor -- start 2024-09-12T02:05:02.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.267+0000 7f0266d11640 1 -- start start 2024-09-12T02:05:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.268+0000 7f0266d11640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f02600b69d0 0x7f0260162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.268+0000 7f0266d11640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02600af280 0x7f02600afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.268+0000 7f0266d11640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f026015eb60 con 0x7f02600affb0 2024-09-12T02:05:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.268+0000 7f0266d11640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f02600b6db0 con 0x7f02600b69d0 2024-09-12T02:05:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.268+0000 7f0266d11640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f026015ee40 con 0x7f02600af280 2024-09-12T02:05:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.268+0000 7f0264aad640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f02600b69d0 0x7f0260162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.268+0000 7f0264aad640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f02600b69d0 0x7f0260162a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53704/0 (socket says 172.21.15.19:53704) 2024-09-12T02:05:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.268+0000 7f0264aad640 1 -- 172.21.15.19:0/2016476747 learned_addr learned my addr 172.21.15.19:0/2016476747 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.268+0000 7f025ffff640 1 --2- 172.21.15.19:0/2016476747 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02600af280 0x7f02600afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.268+0000 7f0264aad640 1 -- 172.21.15.19:0/2016476747 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02600af280 msgr2=0x7f02600afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.268+0000 7f0264aad640 1 --2- 172.21.15.19:0/2016476747 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02600af280 0x7f02600afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.268+0000 7f0264aad640 1 -- 172.21.15.19:0/2016476747 >> v1:172.21.15.135:6789/0 conn(0x7f02600affb0 legacy=0x7f0260154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:02.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.268+0000 7f0264aad640 1 -- 172.21.15.19:0/2016476747 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026015f120 con 0x7f02600b69d0 2024-09-12T02:05:02.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.269+0000 7f0264aad640 1 --2- 172.21.15.19:0/2016476747 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02600b69d0 0x7f0260162a50 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f02540098a0 tx=0x7f025402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b7630394af297a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:02.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.269+0000 7f025f7fe640 1 -- 172.21.15.19:0/2016476747 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0254037070 con 0x7f02600b69d0 2024-09-12T02:05:02.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.269+0000 7f025f7fe640 1 -- 172.21.15.19:0/2016476747 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f025402ae20 con 0x7f02600b69d0 2024-09-12T02:05:02.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.269+0000 7f025f7fe640 1 -- 172.21.15.19:0/2016476747 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0254032660 con 0x7f02600b69d0 2024-09-12T02:05:02.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.270+0000 7f0266d11640 1 -- 172.21.15.19:0/2016476747 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02600b69d0 msgr2=0x7f0260162a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:02.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.270+0000 7f0266d11640 1 --2- 172.21.15.19:0/2016476747 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02600b69d0 0x7f0260162a50 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f02540098a0 tx=0x7f025402a110 comp rx=0 tx=0).stop 2024-09-12T02:05:02.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.270+0000 7f0266d11640 1 -- 172.21.15.19:0/2016476747 shutdown_connections 2024-09-12T02:05:02.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.270+0000 7f0266d11640 1 --2- 172.21.15.19:0/2016476747 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02600af280 0x7f02600afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:02.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.270+0000 7f0266d11640 1 --2- 172.21.15.19:0/2016476747 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02600b69d0 0x7f0260162a50 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:02.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.270+0000 7f0266d11640 1 -- 172.21.15.19:0/2016476747 >> 172.21.15.19:0/2016476747 conn(0x7f026006bc10 msgr2=0x7f026006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:02.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.270+0000 7f0266d11640 1 -- 172.21.15.19:0/2016476747 shutdown_connections 2024-09-12T02:05:02.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.270+0000 7f0266d11640 1 -- 172.21.15.19:0/2016476747 wait complete. 2024-09-12T02:05:02.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.271+0000 7f0266d11640 1 Processor -- start 2024-09-12T02:05:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.271+0000 7f0266d11640 1 -- start start 2024-09-12T02:05:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.272+0000 7f0266d11640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02600af280 0x7f02601f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.272+0000 7f0266d11640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02600affb0 0x7f02600ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.272+0000 7f0266d11640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02600b69d0 0x7f02600aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.272+0000 7f0266d11640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0260155410 con 0x7f02600affb0 2024-09-12T02:05:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.272+0000 7f0266d11640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f02600af6e0 con 0x7f02600b69d0 2024-09-12T02:05:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.272+0000 7f0266d11640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0260155590 con 0x7f02600af280 2024-09-12T02:05:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.272+0000 7f025ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02600affb0 0x7f02600ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.272+0000 7f025ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02600affb0 0x7f02600ae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53716/0 (socket says 172.21.15.19:53716) 2024-09-12T02:05:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.272+0000 7f025ffff640 1 -- 172.21.15.19:0/2310041787 learned_addr learned my addr 172.21.15.19:0/2310041787 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.272+0000 7f02652ae640 1 --2- 172.21.15.19:0/2310041787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02600b69d0 0x7f02600aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.272+0000 7f0264aad640 1 --2- 172.21.15.19:0/2310041787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02600af280 0x7f02601f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.272+0000 7f025ffff640 1 -- 172.21.15.19:0/2310041787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02600af280 msgr2=0x7f02601f48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.272+0000 7f025ffff640 1 --2- 172.21.15.19:0/2310041787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02600af280 0x7f02601f48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.272+0000 7f025ffff640 1 -- 172.21.15.19:0/2310041787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02600b69d0 msgr2=0x7f02600aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.272+0000 7f025ffff640 1 --2- 172.21.15.19:0/2310041787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02600b69d0 0x7f02600aea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.272+0000 7f025ffff640 1 -- 172.21.15.19:0/2310041787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02600ced50 con 0x7f02600affb0 2024-09-12T02:05:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.273+0000 7f025ffff640 1 --2- 172.21.15.19:0/2310041787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02600affb0 0x7f02600ae4c0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f024c00c7f0 tx=0x7f024c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.273+0000 7f025d7fa640 1 -- 172.21.15.19:0/2310041787 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c015070 con 0x7f02600affb0 2024-09-12T02:05:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.273+0000 7f025d7fa640 1 -- 172.21.15.19:0/2310041787 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f024c004240 con 0x7f02600affb0 2024-09-12T02:05:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.273+0000 7f025d7fa640 1 -- 172.21.15.19:0/2310041787 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c007620 con 0x7f02600affb0 2024-09-12T02:05:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.273+0000 7f0266d11640 1 -- 172.21.15.19:0/2310041787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02600cf030 con 0x7f02600affb0 2024-09-12T02:05:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.273+0000 7f0266d11640 1 -- 172.21.15.19:0/2310041787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02600cf5f0 con 0x7f02600affb0 2024-09-12T02:05:02.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.274+0000 7f0266d11640 1 -- 172.21.15.19:0/2310041787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02600008d0 con 0x7f02600affb0 2024-09-12T02:05:02.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.274+0000 7f025d7fa640 1 -- 172.21.15.19:0/2310041787 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f024c0079d0 con 0x7f02600affb0 2024-09-12T02:05:02.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.275+0000 7f025d7fa640 1 --2- 172.21.15.19:0/2310041787 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f024406be30 0x7f024406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:02.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.275+0000 7f025d7fa640 1 -- 172.21.15.19:0/2310041787 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8453+0+0 (secure 0 0 0) 0x7f024c08bd80 con 0x7f02600affb0 2024-09-12T02:05:02.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.275+0000 7f0264aad640 1 --2- 172.21.15.19:0/2310041787 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f024406be30 0x7f024406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:02.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.276+0000 7f0264aad640 1 --2- 172.21.15.19:0/2310041787 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f024406be30 0x7f024406e2f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0254034000 tx=0x7f025402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.279+0000 7f025d7fa640 1 -- 172.21.15.19:0/2310041787 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f024c059cb0 con 0x7f02600affb0 2024-09-12T02:05:02.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.489+0000 7f0266d11640 1 -- 172.21.15.19:0/2310041787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02600adad0 con 0x7f02600affb0 2024-09-12T02:05:02.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.489+0000 7f025d7fa640 1 -- 172.21.15.19:0/2310041787 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 232 v232) ==== 95+0+4401 (secure 0 0 0) 0x7f024c0595b0 con 0x7f02600affb0 2024-09-12T02:05:02.490 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:02.490 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":232,"btime":"2024-09-12T02:05:01:741354+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":232,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:01.741341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7469":{"gid":7469,"name":"d","rank":0,"incarnation":232,"state":"up:replay","state_seq":1,"addr":"172.21.15.135:6837/2201380819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2201380819},{"type":"v1","addr":"172.21.15.135:6837","nonce":2201380819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:02.490 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 232 2024-09-12T02:05:02.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.491+0000 7f0266d11640 1 -- 172.21.15.19:0/2310041787 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f024406be30 msgr2=0x7f024406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:02.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.491+0000 7f0266d11640 1 --2- 172.21.15.19:0/2310041787 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f024406be30 0x7f024406e2f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0254034000 tx=0x7f025402e000 comp rx=0 tx=0).stop 2024-09-12T02:05:02.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.491+0000 7f0266d11640 1 -- 172.21.15.19:0/2310041787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02600affb0 msgr2=0x7f02600ae4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:02.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.491+0000 7f0266d11640 1 --2- 172.21.15.19:0/2310041787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02600affb0 0x7f02600ae4c0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f024c00c7f0 tx=0x7f024c00ccb0 comp rx=0 tx=0).stop 2024-09-12T02:05:02.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.491+0000 7f0266d11640 1 -- 172.21.15.19:0/2310041787 shutdown_connections 2024-09-12T02:05:02.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.491+0000 7f0266d11640 1 --2- 172.21.15.19:0/2310041787 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f024406be30 0x7f024406e2f0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:02.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.491+0000 7f0266d11640 1 --2- 172.21.15.19:0/2310041787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02600b69d0 0x7f02600aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:02.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.492+0000 7f0266d11640 1 --2- 172.21.15.19:0/2310041787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02600affb0 0x7f02600ae4c0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:02.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.492+0000 7f0266d11640 1 --2- 172.21.15.19:0/2310041787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02600af280 0x7f02601f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:02.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.492+0000 7f0266d11640 1 -- 172.21.15.19:0/2310041787 >> 172.21.15.19:0/2310041787 conn(0x7f026006bc10 msgr2=0x7f026015d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:02.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.492+0000 7f0266d11640 1 -- 172.21.15.19:0/2310041787 shutdown_connections 2024-09-12T02:05:02.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:02.492+0000 7f0266d11640 1 -- 172.21.15.19:0/2310041787 wait complete. 2024-09-12T02:05:02.503 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 232, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:05:01.741341+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 120, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7469}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7469': {'gid': 7469, 'name': 'd', 'rank': 0, 'incarnation': 232, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.135:6837/2201380819', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 2201380819}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 2201380819}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:05:02.503 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7469:up:replay 2024-09-12T02:05:02.503 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-12T02:05:02.740 INFO:tasks.ceph.mds.c.smithi019.stderr: -36> 2024-09-12T02:04:57.989+0000 7f07bfc64640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2024-09-12T02:05:02.766 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:05:07.907 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:08.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.024+0000 7f2e06423640 1 Processor -- start 2024-09-12T02:05:08.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.024+0000 7f2e06423640 1 -- start start 2024-09-12T02:05:08.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.025+0000 7f2e06423640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e000d30f0 0x7f2e000b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.025+0000 7f2e06423640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2e000b64c0 0x7f2e0006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.025+0000 7f2e06423640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e000d3690 con 0x7f2e0015e5f0 2024-09-12T02:05:08.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.025+0000 7f2e06423640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f2e0006d530 con 0x7f2e000b64c0 2024-09-12T02:05:08.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.025+0000 7f2e06423640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2e000d3970 con 0x7f2e000d30f0 2024-09-12T02:05:08.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.025+0000 7f2e049c0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2e000b64c0 0x7f2e0006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.025+0000 7f2dff7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e000d30f0 0x7f2e000b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.025+0000 7f2e049c0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2e000b64c0 0x7f2e0006d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:50052/0 (socket says 172.21.15.19:50052) 2024-09-12T02:05:08.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.025+0000 7f2dfffff640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f2e0015e5f0 0x7f2e000d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:37508/0 (socket says 172.21.15.19:37508) 2024-09-12T02:05:08.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.025+0000 7f2e049c0640 1 -- 172.21.15.19:0/4133304912 learned_addr learned my addr 172.21.15.19:0/4133304912 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:08.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.026+0000 7f2dff7fe640 1 -- 172.21.15.19:0/4133304912 >> v2:172.21.15.135:3300/0 conn(0x7f2e000b64c0 msgr2=0x7f2e0006d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:08.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.026+0000 7f2dff7fe640 1 --2- 172.21.15.19:0/4133304912 >> v2:172.21.15.135:3300/0 conn(0x7f2e000b64c0 0x7f2e0006d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.026+0000 7f2dff7fe640 1 -- 172.21.15.19:0/4133304912 >> v1:172.21.15.135:6789/0 conn(0x7f2e0015e5f0 legacy=0x7f2e000d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.026+0000 7f2dff7fe640 1 -- 172.21.15.19:0/4133304912 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0006cee0 con 0x7f2e000d30f0 2024-09-12T02:05:08.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.026+0000 7f2dfeffd640 1 -- 172.21.15.19:0/4133304912 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2934208281 0 0) 0x7f2e000d3690 con 0x7f2e0015e5f0 2024-09-12T02:05:08.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.026+0000 7f2e049c0640 1 --2- 172.21.15.19:0/4133304912 >> v2:172.21.15.135:3300/0 conn(0x7f2e000b64c0 0x7f2e0006d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:05:08.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.027+0000 7f2dff7fe640 1 --2- 172.21.15.19:0/4133304912 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e000d30f0 0x7f2e000b5f80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2df40097a0 tx=0x7f2df402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5cbd68fbbbb31d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:08.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.027+0000 7f2dfeffd640 1 -- 172.21.15.19:0/4133304912 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df4037070 con 0x7f2e000d30f0 2024-09-12T02:05:08.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.027+0000 7f2dfeffd640 1 -- 172.21.15.19:0/4133304912 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df4032440 con 0x7f2e000d30f0 2024-09-12T02:05:08.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.027+0000 7f2dfeffd640 1 -- 172.21.15.19:0/4133304912 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df4032810 con 0x7f2e000d30f0 2024-09-12T02:05:08.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.027+0000 7f2e06423640 1 -- 172.21.15.19:0/4133304912 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e000d30f0 msgr2=0x7f2e000b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.027+0000 7f2e06423640 1 --2- 172.21.15.19:0/4133304912 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e000d30f0 0x7f2e000b5f80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2df40097a0 tx=0x7f2df402a180 comp rx=0 tx=0).stop 2024-09-12T02:05:08.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.027+0000 7f2e06423640 1 -- 172.21.15.19:0/4133304912 shutdown_connections 2024-09-12T02:05:08.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.027+0000 7f2e06423640 1 --2- 172.21.15.19:0/4133304912 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e000d30f0 0x7f2e000b5f80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.027+0000 7f2e06423640 1 --2- 172.21.15.19:0/4133304912 >> v2:172.21.15.135:3300/0 conn(0x7f2e000b64c0 0x7f2e0006d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.028+0000 7f2e06423640 1 -- 172.21.15.19:0/4133304912 >> 172.21.15.19:0/4133304912 conn(0x7f2e0008bfc0 msgr2=0x7f2e000d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:08.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.028+0000 7f2e06423640 1 -- 172.21.15.19:0/4133304912 shutdown_connections 2024-09-12T02:05:08.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.028+0000 7f2e06423640 1 -- 172.21.15.19:0/4133304912 wait complete. 2024-09-12T02:05:08.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.029+0000 7f2e06423640 1 Processor -- start 2024-09-12T02:05:08.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.029+0000 7f2e06423640 1 -- start start 2024-09-12T02:05:08.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.030+0000 7f2e06423640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e000b64c0 0x7f2e0014e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.030+0000 7f2e06423640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e000d30f0 0x7f2e000cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.030+0000 7f2e06423640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e0015e5f0 0x7f2e000b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.030+0000 7f2e06423640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0006df00 con 0x7f2e000d30f0 2024-09-12T02:05:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.030+0000 7f2e06423640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0015e9d0 con 0x7f2e000b64c0 2024-09-12T02:05:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.030+0000 7f2e06423640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0006e080 con 0x7f2e0015e5f0 2024-09-12T02:05:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.030+0000 7f2dff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e000d30f0 0x7f2e000cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.030+0000 7f2dff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e000d30f0 0x7f2e000cd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53756/0 (socket says 172.21.15.19:53756) 2024-09-12T02:05:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.030+0000 7f2dff7fe640 1 -- 172.21.15.19:0/1443942902 learned_addr learned my addr 172.21.15.19:0/1443942902 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.030+0000 7f2dfffff640 1 --2- 172.21.15.19:0/1443942902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e000b64c0 0x7f2e0014e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.030+0000 7f2e049c0640 1 --2- 172.21.15.19:0/1443942902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e0015e5f0 0x7f2e000b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.030+0000 7f2dff7fe640 1 -- 172.21.15.19:0/1443942902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e0015e5f0 msgr2=0x7f2e000b9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.030+0000 7f2dff7fe640 1 --2- 172.21.15.19:0/1443942902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e0015e5f0 0x7f2e000b9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.030+0000 7f2dff7fe640 1 -- 172.21.15.19:0/1443942902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e000b64c0 msgr2=0x7f2e0014e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.030+0000 7f2dff7fe640 1 --2- 172.21.15.19:0/1443942902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e000b64c0 0x7f2e0014e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.030+0000 7f2dff7fe640 1 -- 172.21.15.19:0/1443942902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e000c98b0 con 0x7f2e000d30f0 2024-09-12T02:05:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.030+0000 7f2e049c0640 1 --2- 172.21.15.19:0/1443942902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e0015e5f0 0x7f2e000b9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.030+0000 7f2dff7fe640 1 --2- 172.21.15.19:0/1443942902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e000d30f0 0x7f2e000cd9f0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f2df40098c0 tx=0x7f2df40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.031+0000 7f2dfcff9640 1 -- 172.21.15.19:0/1443942902 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df4037040 con 0x7f2e000d30f0 2024-09-12T02:05:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.031+0000 7f2dfcff9640 1 -- 172.21.15.19:0/1443942902 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df4030500 con 0x7f2e000d30f0 2024-09-12T02:05:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.031+0000 7f2e06423640 1 -- 172.21.15.19:0/1443942902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e000c9b90 con 0x7f2e000d30f0 2024-09-12T02:05:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.031+0000 7f2dfcff9640 1 -- 172.21.15.19:0/1443942902 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df40308d0 con 0x7f2e000d30f0 2024-09-12T02:05:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.031+0000 7f2e06423640 1 -- 172.21.15.19:0/1443942902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e000ca150 con 0x7f2e000d30f0 2024-09-12T02:05:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.032+0000 7f2e06423640 1 -- 172.21.15.19:0/1443942902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e0006d9a0 con 0x7f2e000d30f0 2024-09-12T02:05:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.032+0000 7f2dfcff9640 1 -- 172.21.15.19:0/1443942902 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2df4044020 con 0x7f2e000d30f0 2024-09-12T02:05:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.033+0000 7f2dfcff9640 1 --2- 172.21.15.19:0/1443942902 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dec06be30 0x7f2dec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.033+0000 7f2dfcff9640 1 -- 172.21.15.19:0/1443942902 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8453+0+0 (secure 0 0 0) 0x7f2df40abc30 con 0x7f2e000d30f0 2024-09-12T02:05:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.033+0000 7f2dfffff640 1 --2- 172.21.15.19:0/1443942902 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dec06be30 0x7f2dec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.034+0000 7f2dfffff640 1 --2- 172.21.15.19:0/1443942902 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dec06be30 0x7f2dec06e2f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2df0000f60 tx=0x7f2df0007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:08.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.037+0000 7f2dfcff9640 1 -- 172.21.15.19:0/1443942902 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2df4079ad0 con 0x7f2e000d30f0 2024-09-12T02:05:08.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.251+0000 7f2e06423640 1 -- 172.21.15.19:0/1443942902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e000cfb80 con 0x7f2e000d30f0 2024-09-12T02:05:08.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.252+0000 7f2dfcff9640 1 -- 172.21.15.19:0/1443942902 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 235 v235) ==== 95+0+5234 (secure 0 0 0) 0x7f2df40793d0 con 0x7f2e000d30f0 2024-09-12T02:05:08.252 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:08.252 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":235,"btime":"2024-09-12T02:05:04:745521+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":9402,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/2195405214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2195405214},{"type":"v1","addr":"172.21.15.19:6834","nonce":2195405214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":234}],"filesystems":[{"mdsmap":{"epoch":235,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:04.745513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7469":{"gid":7469,"name":"d","rank":0,"incarnation":232,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6837/2201380819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2201380819},{"type":"v1","addr":"172.21.15.135:6837","nonce":2201380819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7469,"qdb_cluster":[7469]},"id":6}]} 2024-09-12T02:05:08.252 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 235 2024-09-12T02:05:08.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.254+0000 7f2e06423640 1 -- 172.21.15.19:0/1443942902 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dec06be30 msgr2=0x7f2dec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.254+0000 7f2e06423640 1 --2- 172.21.15.19:0/1443942902 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dec06be30 0x7f2dec06e2f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2df0000f60 tx=0x7f2df0007c00 comp rx=0 tx=0).stop 2024-09-12T02:05:08.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.254+0000 7f2e06423640 1 -- 172.21.15.19:0/1443942902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e000d30f0 msgr2=0x7f2e000cd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.254+0000 7f2e06423640 1 --2- 172.21.15.19:0/1443942902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e000d30f0 0x7f2e000cd9f0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f2df40098c0 tx=0x7f2df40046c0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.254+0000 7f2e06423640 1 -- 172.21.15.19:0/1443942902 shutdown_connections 2024-09-12T02:05:08.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.254+0000 7f2e06423640 1 --2- 172.21.15.19:0/1443942902 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2dec06be30 0x7f2dec06e2f0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.254+0000 7f2e06423640 1 --2- 172.21.15.19:0/1443942902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e0015e5f0 0x7f2e000b9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.254+0000 7f2e06423640 1 --2- 172.21.15.19:0/1443942902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e000d30f0 0x7f2e000cd9f0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.254+0000 7f2e06423640 1 --2- 172.21.15.19:0/1443942902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e000b64c0 0x7f2e0014e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.254+0000 7f2e06423640 1 -- 172.21.15.19:0/1443942902 >> 172.21.15.19:0/1443942902 conn(0x7f2e0008bfc0 msgr2=0x7f2e000b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:08.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.254+0000 7f2e06423640 1 -- 172.21.15.19:0/1443942902 shutdown_connections 2024-09-12T02:05:08.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.254+0000 7f2e06423640 1 -- 172.21.15.19:0/1443942902 wait complete. 2024-09-12T02:05:08.264 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 235, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:05:04.745513+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 120, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7469}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7469': {'gid': 7469, 'name': 'd', 'rank': 0, 'incarnation': 232, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.135:6837/2201380819', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 2201380819}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 2201380819}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7469, 'qdb_cluster': [7469]} 2024-09-12T02:05:08.265 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:05:08.265 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T02:05:08.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.371+0000 7fd9b7e77640 1 Processor -- start 2024-09-12T02:05:08.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.371+0000 7fd9b7e77640 1 -- start start 2024-09-12T02:05:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.372+0000 7fd9b7e77640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd9b015e5f0 0x7fd9b00d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.372+0000 7fd9b7e77640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9b00b6690 0x7fd9b006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.372+0000 7fd9b7e77640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9b00d3690 con 0x7fd9b00d30f0 2024-09-12T02:05:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.372+0000 7fd9b7e77640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd9b006d530 con 0x7fd9b015e5f0 2024-09-12T02:05:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.372+0000 7fd9b7e77640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b00d3970 con 0x7fd9b00b6690 2024-09-12T02:05:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.372+0000 7fd9b5c13640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd9b015e5f0 0x7fd9b00d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.372+0000 7fd9b5c13640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd9b015e5f0 0x7fd9b00d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53764/0 (socket says 172.21.15.19:53764) 2024-09-12T02:05:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.372+0000 7fd9b5c13640 1 -- 172.21.15.19:0/3440521049 learned_addr learned my addr 172.21.15.19:0/3440521049 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.372+0000 7fd9b5412640 1 --1- 172.21.15.19:0/3440521049 >> v1:172.21.15.19:6789/0 conn(0x7fd9b00d30f0 0x7fd9b00b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48988/0 (socket says 172.21.15.19:48988) 2024-09-12T02:05:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.372+0000 7fd9b6414640 1 --2- 172.21.15.19:0/3440521049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9b00b6690 0x7fd9b006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.372+0000 7fd9b5c13640 1 -- 172.21.15.19:0/3440521049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9b00b6690 msgr2=0x7fd9b006d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.372+0000 7fd9b5c13640 1 --2- 172.21.15.19:0/3440521049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9b00b6690 0x7fd9b006d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.372+0000 7fd9b5c13640 1 -- 172.21.15.19:0/3440521049 >> v1:172.21.15.19:6789/0 conn(0x7fd9b00d30f0 legacy=0x7fd9b00b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.372+0000 7fd9b5c13640 1 -- 172.21.15.19:0/3440521049 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b006cee0 con 0x7fd9b015e5f0 2024-09-12T02:05:08.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.372+0000 7fd9b4c11640 1 -- 172.21.15.19:0/3440521049 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1599800069 0 0) 0x7fd9b00d3690 con 0x7fd9b00d30f0 2024-09-12T02:05:08.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.373+0000 7fd9b5c13640 1 --2- 172.21.15.19:0/3440521049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b015e5f0 0x7fd9b00d4dd0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac009870 tx=0x7fd9ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75cf216e0bfcb4e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:08.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.373+0000 7fd9b4c11640 1 -- 172.21.15.19:0/3440521049 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac037070 con 0x7fd9b015e5f0 2024-09-12T02:05:08.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.373+0000 7fd9b4c11640 1 -- 172.21.15.19:0/3440521049 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9ac032440 con 0x7fd9b015e5f0 2024-09-12T02:05:08.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.373+0000 7fd9b4c11640 1 -- 172.21.15.19:0/3440521049 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac032810 con 0x7fd9b015e5f0 2024-09-12T02:05:08.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.374+0000 7fd9b7e77640 1 -- 172.21.15.19:0/3440521049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b015e5f0 msgr2=0x7fd9b00d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.374+0000 7fd9b7e77640 1 --2- 172.21.15.19:0/3440521049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b015e5f0 0x7fd9b00d4dd0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac009870 tx=0x7fd9ac02a270 comp rx=0 tx=0).stop 2024-09-12T02:05:08.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.374+0000 7fd9b7e77640 1 -- 172.21.15.19:0/3440521049 shutdown_connections 2024-09-12T02:05:08.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.374+0000 7fd9b7e77640 1 --2- 172.21.15.19:0/3440521049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9b00b6690 0x7fd9b006d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.374+0000 7fd9b7e77640 1 --2- 172.21.15.19:0/3440521049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b015e5f0 0x7fd9b00d4dd0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.374+0000 7fd9b7e77640 1 -- 172.21.15.19:0/3440521049 >> 172.21.15.19:0/3440521049 conn(0x7fd9b008bfc0 msgr2=0x7fd9b00d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:08.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.374+0000 7fd9b7e77640 1 -- 172.21.15.19:0/3440521049 shutdown_connections 2024-09-12T02:05:08.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.374+0000 7fd9b7e77640 1 -- 172.21.15.19:0/3440521049 wait complete. 2024-09-12T02:05:08.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.375+0000 7fd9b7e77640 1 Processor -- start 2024-09-12T02:05:08.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.375+0000 7fd9b7e77640 1 -- start start 2024-09-12T02:05:08.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9b7e77640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9b00b6690 0x7fd9b00b9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9b7e77640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9b00d30f0 0x7fd9b015cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9b7e77640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b015e5f0 0x7fd9b01603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9b7e77640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b00d5310 con 0x7fd9b015e5f0 2024-09-12T02:05:08.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9b7e77640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b015e9d0 con 0x7fd9b00b6690 2024-09-12T02:05:08.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9b7e77640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b006df00 con 0x7fd9b00d30f0 2024-09-12T02:05:08.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9b6414640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b015e5f0 0x7fd9b01603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9b6414640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b015e5f0 0x7fd9b01603b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53772/0 (socket says 172.21.15.19:53772) 2024-09-12T02:05:08.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9b6414640 1 -- 172.21.15.19:0/3610295481 learned_addr learned my addr 172.21.15.19:0/3610295481 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:08.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9b5c13640 1 --2- 172.21.15.19:0/3610295481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9b00b6690 0x7fd9b00b9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9b5412640 1 --2- 172.21.15.19:0/3610295481 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9b00d30f0 0x7fd9b015cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9b6414640 1 -- 172.21.15.19:0/3610295481 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9b00d30f0 msgr2=0x7fd9b015cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9b6414640 1 --2- 172.21.15.19:0/3610295481 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9b00d30f0 0x7fd9b015cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9b6414640 1 -- 172.21.15.19:0/3610295481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9b00b6690 msgr2=0x7fd9b00b9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9b6414640 1 --2- 172.21.15.19:0/3610295481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9b00b6690 0x7fd9b00b9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9b6414640 1 -- 172.21.15.19:0/3610295481 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b015d520 con 0x7fd9b015e5f0 2024-09-12T02:05:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9b5412640 1 --2- 172.21.15.19:0/3610295481 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9b00d30f0 0x7fd9b015cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9b6414640 1 --2- 172.21.15.19:0/3610295481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b015e5f0 0x7fd9b01603b0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8007e70 tx=0x7fd9a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9a67fc640 1 -- 172.21.15.19:0/3610295481 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8014620 con 0x7fd9b015e5f0 2024-09-12T02:05:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.376+0000 7fd9a67fc640 1 -- 172.21.15.19:0/3610295481 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a8019070 con 0x7fd9b015e5f0 2024-09-12T02:05:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.377+0000 7fd9b7e77640 1 -- 172.21.15.19:0/3610295481 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9b00b8d00 con 0x7fd9b015e5f0 2024-09-12T02:05:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.377+0000 7fd9a67fc640 1 -- 172.21.15.19:0/3610295481 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8014a20 con 0x7fd9b015e5f0 2024-09-12T02:05:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.377+0000 7fd9b7e77640 1 -- 172.21.15.19:0/3610295481 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9b00b96c0 con 0x7fd9b015e5f0 2024-09-12T02:05:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.378+0000 7fd9a67fc640 1 -- 172.21.15.19:0/3610295481 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9a8014bc0 con 0x7fd9b015e5f0 2024-09-12T02:05:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.378+0000 7fd9a67fc640 1 --2- 172.21.15.19:0/3610295481 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd99406be30 0x7fd99406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.379+0000 7fd9a67fc640 1 -- 172.21.15.19:0/3610295481 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8453+0+0 (secure 0 0 0) 0x7fd9a808c2c0 con 0x7fd9b015e5f0 2024-09-12T02:05:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.379+0000 7fd9b5c13640 1 --2- 172.21.15.19:0/3610295481 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd99406be30 0x7fd99406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.379+0000 7fd9b5c13640 1 --2- 172.21.15.19:0/3610295481 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd99406be30 0x7fd99406e2f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac034000 tx=0x7fd9ac02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.380+0000 7fd9bac0d740 1 Processor -- start 2024-09-12T02:05:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.380+0000 7fd9bac0d740 1 -- start start 2024-09-12T02:05:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.380+0000 7fd9bac0d740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67aec2c0 0x556a67b31a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9bac0d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67ae9a80 0x556a67aec6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9bac0d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67aeda50 0x556a67ae68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9bac0d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556a67a4e520 con 0x556a67aeda50 2024-09-12T02:05:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9bac0d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556a679f63e0 con 0x556a67ae9a80 2024-09-12T02:05:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9bac0d740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556a67a4a4e0 con 0x556a67aec2c0 2024-09-12T02:05:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9b6414640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67aeda50 0x556a67ae68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9b6414640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67aeda50 0x556a67ae68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53778/0 (socket says 172.21.15.19:53778) 2024-09-12T02:05:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9b6414640 1 -- 172.21.15.19:0/3084905658 learned_addr learned my addr 172.21.15.19:0/3084905658 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9b5c13640 1 --2- 172.21.15.19:0/3084905658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67aec2c0 0x556a67b31a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9b5412640 1 --2- 172.21.15.19:0/3084905658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67ae9a80 0x556a67aec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9b6414640 1 -- 172.21.15.19:0/3084905658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67aec2c0 msgr2=0x556a67b31a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9b6414640 1 --2- 172.21.15.19:0/3084905658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67aec2c0 0x556a67b31a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9b6414640 1 -- 172.21.15.19:0/3084905658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67ae9a80 msgr2=0x556a67aec6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9b6414640 1 --2- 172.21.15.19:0/3084905658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67ae9a80 0x556a67aec6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9b6414640 1 -- 172.21.15.19:0/3084905658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a67a112f0 con 0x556a67aeda50 2024-09-12T02:05:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9b5c13640 1 --2- 172.21.15.19:0/3084905658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67aec2c0 0x556a67b31a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9b6414640 1 --2- 172.21.15.19:0/3084905658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67aeda50 0x556a67ae68b0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8062110 tx=0x7fd9a8059a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3a45e8269eedbc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9937fe640 1 -- 172.21.15.19:0/3084905658 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8057d60 con 0x556a67aeda50 2024-09-12T02:05:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9937fe640 1 -- 172.21.15.19:0/3084905658 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a80560d0 con 0x556a67aeda50 2024-09-12T02:05:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.381+0000 7fd9937fe640 1 -- 172.21.15.19:0/3084905658 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a80602c0 con 0x556a67aeda50 2024-09-12T02:05:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.382+0000 7fd9bac0d740 1 -- 172.21.15.19:0/3084905658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67aeda50 msgr2=0x556a67ae68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.382+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/3084905658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67aeda50 0x556a67ae68b0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8062110 tx=0x7fd9a8059a60 comp rx=0 tx=0).stop 2024-09-12T02:05:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.382+0000 7fd9bac0d740 1 -- 172.21.15.19:0/3084905658 shutdown_connections 2024-09-12T02:05:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.382+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/3084905658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67aeda50 0x556a67ae68b0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.382+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/3084905658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67ae9a80 0x556a67aec6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.382+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/3084905658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67aec2c0 0x556a67b31a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.382+0000 7fd9bac0d740 1 -- 172.21.15.19:0/3084905658 >> 172.21.15.19:0/3084905658 conn(0x556a67ae8a80 msgr2=0x556a67b30f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.382+0000 7fd9bac0d740 1 -- 172.21.15.19:0/3084905658 shutdown_connections 2024-09-12T02:05:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.382+0000 7fd9bac0d740 1 -- 172.21.15.19:0/3084905658 wait complete. 2024-09-12T02:05:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.383+0000 7fd9bac0d740 1 -- start start 2024-09-12T02:05:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.383+0000 7fd9bac0d740 1 Processor -- start 2024-09-12T02:05:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9bac0d740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67aec2c0 0x556a67b0b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9bac0d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67aeda50 0x556a67ae76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9bac0d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67b0ad90 0x556a67aea950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9bac0d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556a67ae7f20 con 0x556a67b0ad90 2024-09-12T02:05:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9bac0d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556a679d7450 con 0x556a67aeda50 2024-09-12T02:05:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9bac0d740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556a67b32290 con 0x556a67aec2c0 2024-09-12T02:05:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9bac0d740 10 client.0 _ll_register_callbacks cb 0x556a67760ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:05:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9b6414640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67b0ad90 0x556a67aea950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9b6414640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67b0ad90 0x556a67aea950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53794/0 (socket says 172.21.15.19:53794) 2024-09-12T02:05:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9b6414640 1 -- 172.21.15.19:0/211135792 learned_addr learned my addr 172.21.15.19:0/211135792 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9b5c13640 1 --2- 172.21.15.19:0/211135792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67aec2c0 0x556a67b0b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9b5412640 1 --2- 172.21.15.19:0/211135792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67aeda50 0x556a67ae76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9b6414640 1 -- 172.21.15.19:0/211135792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67aec2c0 msgr2=0x556a67b0b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9b6414640 1 --2- 172.21.15.19:0/211135792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67aec2c0 0x556a67b0b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9b6414640 1 -- 172.21.15.19:0/211135792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67aeda50 msgr2=0x556a67ae76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9b6414640 1 --2- 172.21.15.19:0/211135792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67aeda50 0x556a67ae76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9b6414640 1 -- 172.21.15.19:0/211135792 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a677612d0 con 0x556a67b0ad90 2024-09-12T02:05:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9b6414640 1 --2- 172.21.15.19:0/211135792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67b0ad90 0x556a67aea950 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8055ec0 tx=0x7fd9a8060050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174852f7bd5d3d39 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd990ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:05:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd990ff9640 1 -- 172.21.15.19:0/211135792 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a80600c0 con 0x556a67b0ad90 2024-09-12T02:05:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd990ff9640 1 -- 172.21.15.19:0/211135792 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 8453+0+0 (secure 0 0 0) 0x7fd9a8060260 con 0x556a67b0ad90 2024-09-12T02:05:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9bac0d740 1 -- 172.21.15.19:0/211135792 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9a80560d0 con 0x556a67b0ad90 2024-09-12T02:05:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd990ff9640 1 -- 172.21.15.19:0/211135792 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=235) ==== 24+0+0 (secure 0 0 0) 0x7fd9a8058eb0 con 0x556a67b0ad90 2024-09-12T02:05:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9bac0d740 10 client.9420 fetch_fsmap learned FSMap version 235 2024-09-12T02:05:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.384+0000 7fd9bac0d740 1 -- 172.21.15.19:0/211135792 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=235,monmap=2+}) -- 0x556a6782b6b0 con 0x556a67b0ad90 2024-09-12T02:05:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.385+0000 7fd990ff9640 1 -- 172.21.15.19:0/211135792 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a80560d0 con 0x556a67b0ad90 2024-09-12T02:05:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.385+0000 7fd990ff9640 1 -- 172.21.15.19:0/211135792 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 235) ==== 3502+0+0 (secure 0 0 0) 0x7fd9a8059050 con 0x556a67b0ad90 2024-09-12T02:05:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.385+0000 7fd9bac0d740 10 client.9420 fetch_fsmap finished waiting for FSMap version 235 2024-09-12T02:05:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.385+0000 7fd9bac0d740 10 client.9420 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:05:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.385+0000 7fd9bac0d740 20 client.9420 populate_metadata read hostname 'smithi019' 2024-09-12T02:05:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.385+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/211135792 >> [v2:172.21.15.135:6834/2201380819,v1:172.21.15.135:6837/2201380819] conn(0x556a67ae60b0 0x556a67b4e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.385+0000 7fd9bac0d740 4 client.9420 mds_command: new command op to 7469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:05:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.385+0000 7fd9bac0d740 1 -- 172.21.15.19:0/211135792 --> [v2:172.21.15.135:6834/2201380819,v1:172.21.15.135:6837/2201380819] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a67a5bc50 con 0x556a67ae60b0 2024-09-12T02:05:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.385+0000 7fd9b5c13640 1 --2- 172.21.15.19:0/211135792 >> [v2:172.21.15.135:6834/2201380819,v1:172.21.15.135:6837/2201380819] conn(0x556a67ae60b0 0x556a67b4e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.385+0000 7fd9b5c13640 1 --2- 172.21.15.19:0/211135792 >> [v2:172.21.15.135:6834/2201380819,v1:172.21.15.135:6837/2201380819] conn(0x556a67ae60b0 0x556a67b4e900 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcba8b404331b50c server_cookie=3c0b3760989565ee in_seq=0 out_seq=0 2024-09-12T02:05:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.385+0000 7fd990ff9640 10 client.9420 ms_handle_connect on v2:172.21.15.135:6834/2201380819 2024-09-12T02:05:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.386+0000 7fd990ff9640 1 -- 172.21.15.19:0/211135792 <== mds.0 v2:172.21.15.135:6834/2201380819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556a67a5bc50 con 0x556a67ae60b0 2024-09-12T02:05:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.386+0000 7fd990ff9640 10 client.9420 handle_command_reply: tid=0 2024-09-12T02:05:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.386+0000 7fd9bac0d740 1 client.9420 shutdown 2024-09-12T02:05:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.386+0000 7fd9bac0d740 1 -- 172.21.15.19:0/211135792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67b0ad90 msgr2=0x556a67aea950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.386+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/211135792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67b0ad90 0x556a67aea950 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8055ec0 tx=0x7fd9a8060050 comp rx=0 tx=0).stop 2024-09-12T02:05:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.386+0000 7fd9bac0d740 1 -- 172.21.15.19:0/211135792 shutdown_connections 2024-09-12T02:05:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.386+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/211135792 >> [v2:172.21.15.135:6834/2201380819,v1:172.21.15.135:6837/2201380819] conn(0x556a67ae60b0 0x556a67b4e900 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.386+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/211135792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67b0ad90 0x556a67aea950 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.386+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/211135792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67aeda50 0x556a67ae76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.386+0000 7fd990ff9640 0 client.9420 ms_handle_reset on v2:172.21.15.135:6834/2201380819 2024-09-12T02:05:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.386+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/211135792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67aec2c0 0x556a67b0b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.386+0000 7fd9bac0d740 1 -- 172.21.15.19:0/211135792 >> 172.21.15.19:0/211135792 conn(0x556a67ae9a80 msgr2=0x556a67b32a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.387+0000 7fd9bac0d740 1 -- 172.21.15.19:0/211135792 shutdown_connections 2024-09-12T02:05:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.387+0000 7fd9bac0d740 1 -- 172.21.15.19:0/211135792 wait complete. 2024-09-12T02:05:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.387+0000 7fd9bac0d740 20 client.9420 trim_cache size 0 max 16384 2024-09-12T02:05:08.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.405+0000 7fd9bac0d740 1 Processor -- start 2024-09-12T02:05:08.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.405+0000 7fd9bac0d740 1 -- start start 2024-09-12T02:05:08.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd9bac0d740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67aec2c0 0x556a67ba5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd9bac0d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67aeda50 0x556a67b30ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd9bac0d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67b0ad90 0x556a67b31410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd9bac0d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b02015c0 con 0x556a67b0ad90 2024-09-12T02:05:08.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd9bac0d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b0200950 con 0x556a67aeda50 2024-09-12T02:05:08.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd9bac0d740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b0200fa0 con 0x556a67aec2c0 2024-09-12T02:05:08.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd9b6414640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67b0ad90 0x556a67b31410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd9b6414640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67b0ad90 0x556a67b31410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53810/0 (socket says 172.21.15.19:53810) 2024-09-12T02:05:08.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd9b6414640 1 -- 172.21.15.19:0/2780987053 learned_addr learned my addr 172.21.15.19:0/2780987053 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:08.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd9b5412640 1 --2- 172.21.15.19:0/2780987053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67aeda50 0x556a67b30ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd9b5c13640 1 --2- 172.21.15.19:0/2780987053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67aec2c0 0x556a67ba5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd9b6414640 1 -- 172.21.15.19:0/2780987053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67aec2c0 msgr2=0x556a67ba5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:08.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd9b6414640 1 --2- 172.21.15.19:0/2780987053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67aec2c0 0x556a67ba5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd9b6414640 1 -- 172.21.15.19:0/2780987053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67aeda50 msgr2=0x556a67b30ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:08.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd9b6414640 1 --2- 172.21.15.19:0/2780987053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67aeda50 0x556a67b30ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd9b6414640 1 -- 172.21.15.19:0/2780987053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a67a88800 con 0x556a67b0ad90 2024-09-12T02:05:08.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd9b6414640 1 --2- 172.21.15.19:0/2780987053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67b0ad90 0x556a67b31410 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8007e40 tx=0x7fd9a8084000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e281e94d73f391bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:08.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd992ffd640 1 -- 172.21.15.19:0/2780987053 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8055d00 con 0x556a67b0ad90 2024-09-12T02:05:08.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd992ffd640 1 -- 172.21.15.19:0/2780987053 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a80560d0 con 0x556a67b0ad90 2024-09-12T02:05:08.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.406+0000 7fd992ffd640 1 -- 172.21.15.19:0/2780987053 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a80558a0 con 0x556a67b0ad90 2024-09-12T02:05:08.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.407+0000 7fd9bac0d740 1 -- 172.21.15.19:0/2780987053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67b0ad90 msgr2=0x556a67b31410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.407+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/2780987053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67b0ad90 0x556a67b31410 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8007e40 tx=0x7fd9a8084000 comp rx=0 tx=0).stop 2024-09-12T02:05:08.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.407+0000 7fd9bac0d740 1 -- 172.21.15.19:0/2780987053 shutdown_connections 2024-09-12T02:05:08.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.407+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/2780987053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67b0ad90 0x556a67b31410 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.407+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/2780987053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67aeda50 0x556a67b30ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.407+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/2780987053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67aec2c0 0x556a67ba5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.407+0000 7fd9bac0d740 1 -- 172.21.15.19:0/2780987053 >> 172.21.15.19:0/2780987053 conn(0x556a67ae9a80 msgr2=0x556a67b09f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:08.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.407+0000 7fd9bac0d740 1 -- 172.21.15.19:0/2780987053 shutdown_connections 2024-09-12T02:05:08.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.407+0000 7fd9bac0d740 1 -- 172.21.15.19:0/2780987053 wait complete. 2024-09-12T02:05:08.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.407+0000 7fd9bac0d740 1 -- start start 2024-09-12T02:05:08.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.408+0000 7fd9bac0d740 1 Processor -- start 2024-09-12T02:05:08.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.408+0000 7fd9bac0d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67aec2c0 0x556a67b91020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.408+0000 7fd9bac0d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67aeda50 0x556a67b131e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.408+0000 7fd9bac0d740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67b0ad90 0x556a67b2ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.408+0000 7fd9bac0d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556a67ae7f20 con 0x556a67aeda50 2024-09-12T02:05:08.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.408+0000 7fd9bac0d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556a679d7450 con 0x556a67aec2c0 2024-09-12T02:05:08.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.408+0000 7fd9bac0d740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556a67ae5b80 con 0x556a67b0ad90 2024-09-12T02:05:08.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.408+0000 7fd9bac0d740 10 client.0 _ll_register_callbacks cb 0x7fd9a8059490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:05:08.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.409+0000 7fd9b5412640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67aeda50 0x556a67b131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.409+0000 7fd9b5412640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67aeda50 0x556a67b131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53812/0 (socket says 172.21.15.19:53812) 2024-09-12T02:05:08.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.409+0000 7fd9b5412640 1 -- 172.21.15.19:0/4011931351 learned_addr learned my addr 172.21.15.19:0/4011931351 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:08.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.409+0000 7fd9b5c13640 1 --2- 172.21.15.19:0/4011931351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67aec2c0 0x556a67b91020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.409+0000 7fd9b6414640 1 --2- 172.21.15.19:0/4011931351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67b0ad90 0x556a67b2ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.409+0000 7fd9b5412640 1 -- 172.21.15.19:0/4011931351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67b0ad90 msgr2=0x556a67b2ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:08.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.409+0000 7fd9b5412640 1 --2- 172.21.15.19:0/4011931351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67b0ad90 0x556a67b2ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.409+0000 7fd9b5412640 1 -- 172.21.15.19:0/4011931351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67aec2c0 msgr2=0x556a67b91020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:08.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.409+0000 7fd9b5412640 1 --2- 172.21.15.19:0/4011931351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67aec2c0 0x556a67b91020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.409+0000 7fd9b5412640 1 -- 172.21.15.19:0/4011931351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a67b34c40 con 0x556a67aeda50 2024-09-12T02:05:08.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.409+0000 7fd9b5412640 1 --2- 172.21.15.19:0/4011931351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67aeda50 0x556a67b131e0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0000f60 tx=0x7fd9a0001680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8effb99a35ecea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:08.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.409+0000 7fd990ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:05:08.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.409+0000 7fd990ff9640 1 -- 172.21.15.19:0/4011931351 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a001a070 con 0x556a67aeda50 2024-09-12T02:05:08.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.409+0000 7fd9bac0d740 1 -- 172.21.15.19:0/4011931351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9a80560d0 con 0x556a67aeda50 2024-09-12T02:05:08.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.409+0000 7fd990ff9640 1 -- 172.21.15.19:0/4011931351 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 8453+0+0 (secure 0 0 0) 0x7fd9a0001ce0 con 0x556a67aeda50 2024-09-12T02:05:08.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.409+0000 7fd990ff9640 1 -- 172.21.15.19:0/4011931351 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=235) ==== 24+0+0 (secure 0 0 0) 0x7fd9a0026050 con 0x556a67aeda50 2024-09-12T02:05:08.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.409+0000 7fd9bac0d740 10 client.9426 fetch_fsmap learned FSMap version 235 2024-09-12T02:05:08.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.409+0000 7fd9bac0d740 1 -- 172.21.15.19:0/4011931351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=235,monmap=2+}) -- 0x556a67b915c0 con 0x556a67aeda50 2024-09-12T02:05:08.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.410+0000 7fd990ff9640 1 -- 172.21.15.19:0/4011931351 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a80560d0 con 0x556a67aeda50 2024-09-12T02:05:08.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.410+0000 7fd990ff9640 1 -- 172.21.15.19:0/4011931351 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 235) ==== 3502+0+0 (secure 0 0 0) 0x7fd9a0016630 con 0x556a67aeda50 2024-09-12T02:05:08.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.410+0000 7fd9bac0d740 10 client.9426 fetch_fsmap finished waiting for FSMap version 235 2024-09-12T02:05:08.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.410+0000 7fd9bac0d740 10 client.9426 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:05:08.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.410+0000 7fd9bac0d740 20 client.9426 populate_metadata read hostname 'smithi019' 2024-09-12T02:05:08.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.410+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/4011931351 >> [v2:172.21.15.135:6834/2201380819,v1:172.21.15.135:6837/2201380819] conn(0x556a67b2f620 0x556a67bb2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.410+0000 7fd9bac0d740 4 client.9426 mds_command: new command op to 7469 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:05:08.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.410+0000 7fd9bac0d740 1 -- 172.21.15.19:0/4011931351 --> [v2:172.21.15.135:6834/2201380819,v1:172.21.15.135:6837/2201380819] -- command(tid 0: {"prefix": "status"}) -- 0x556a67a55fa0 con 0x556a67b2f620 2024-09-12T02:05:08.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.410+0000 7fd9b5c13640 1 --2- 172.21.15.19:0/4011931351 >> [v2:172.21.15.135:6834/2201380819,v1:172.21.15.135:6837/2201380819] conn(0x556a67b2f620 0x556a67bb2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.410+0000 7fd9b5c13640 1 --2- 172.21.15.19:0/4011931351 >> [v2:172.21.15.135:6834/2201380819,v1:172.21.15.135:6837/2201380819] conn(0x556a67b2f620 0x556a67bb2c10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f529e51b4e5d1a10 server_cookie=33245cb863f5ee97 in_seq=0 out_seq=0 2024-09-12T02:05:08.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.410+0000 7fd990ff9640 10 client.9426 ms_handle_connect on v2:172.21.15.135:6834/2201380819 2024-09-12T02:05:08.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.410+0000 7fd990ff9640 1 -- 172.21.15.19:0/4011931351 <== mds.0 v2:172.21.15.135:6834/2201380819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x556a67a55fa0 con 0x556a67b2f620 2024-09-12T02:05:08.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.410+0000 7fd990ff9640 10 client.9426 handle_command_reply: tid=0 2024-09-12T02:05:08.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.410+0000 7fd9bac0d740 1 client.9426 shutdown 2024-09-12T02:05:08.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9bac0d740 1 -- 172.21.15.19:0/4011931351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67aeda50 msgr2=0x556a67b131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/4011931351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67aeda50 0x556a67b131e0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0000f60 tx=0x7fd9a0001680 comp rx=0 tx=0).stop 2024-09-12T02:05:08.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9bac0d740 1 -- 172.21.15.19:0/4011931351 shutdown_connections 2024-09-12T02:05:08.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/4011931351 >> [v2:172.21.15.135:6834/2201380819,v1:172.21.15.135:6837/2201380819] conn(0x556a67b2f620 0x556a67bb2c10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/4011931351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556a67b0ad90 0x556a67b2ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd990ff9640 0 client.9426 ms_handle_reset on v2:172.21.15.135:6834/2201380819 2024-09-12T02:05:08.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/4011931351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a67aeda50 0x556a67b131e0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9bac0d740 1 --2- 172.21.15.19:0/4011931351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a67aec2c0 0x556a67b91020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9bac0d740 1 -- 172.21.15.19:0/4011931351 >> 172.21.15.19:0/4011931351 conn(0x556a67ae9a80 msgr2=0x556a67aed250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:08.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9bac0d740 1 -- 172.21.15.19:0/4011931351 shutdown_connections 2024-09-12T02:05:08.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9bac0d740 1 -- 172.21.15.19:0/4011931351 wait complete. 2024-09-12T02:05:08.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9bac0d740 20 client.9426 trim_cache size 0 max 16384 2024-09-12T02:05:08.421 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:05:08.421 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T02:05:08.421 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T02:05:08.422 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 7469, 2024-09-12T02:05:08.422 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T02:05:08.422 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T02:05:08.422 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T02:05:08.422 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 6.667718571, 2024-09-12T02:05:08.422 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 235, 2024-09-12T02:05:08.423 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 120, 2024-09-12T02:05:08.423 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 120, 2024-09-12T02:05:08.423 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 9.6823837019999992 2024-09-12T02:05:08.423 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:05:08.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9b7e77640 1 -- 172.21.15.19:0/3610295481 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd99406be30 msgr2=0x7fd99406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9b7e77640 1 --2- 172.21.15.19:0/3610295481 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd99406be30 0x7fd99406e2f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac034000 tx=0x7fd9ac02e000 comp rx=0 tx=0).stop 2024-09-12T02:05:08.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9b7e77640 1 -- 172.21.15.19:0/3610295481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b015e5f0 msgr2=0x7fd9b01603b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9b7e77640 1 --2- 172.21.15.19:0/3610295481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b015e5f0 0x7fd9b01603b0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8007e70 tx=0x7fd9a800e4b0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9b7e77640 1 -- 172.21.15.19:0/3610295481 shutdown_connections 2024-09-12T02:05:08.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9b7e77640 1 --2- 172.21.15.19:0/3610295481 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd99406be30 0x7fd99406e2f0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9b7e77640 1 --2- 172.21.15.19:0/3610295481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b015e5f0 0x7fd9b01603b0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9b7e77640 1 --2- 172.21.15.19:0/3610295481 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9b00d30f0 0x7fd9b015cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9b7e77640 1 --2- 172.21.15.19:0/3610295481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9b00b6690 0x7fd9b00b9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.411+0000 7fd9b7e77640 1 -- 172.21.15.19:0/3610295481 >> 172.21.15.19:0/3610295481 conn(0x7fd9b008bfc0 msgr2=0x7fd9b00ca040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:08.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.412+0000 7fd9b7e77640 1 -- 172.21.15.19:0/3610295481 shutdown_connections 2024-09-12T02:05:08.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.412+0000 7fd9b7e77640 1 -- 172.21.15.19:0/3610295481 wait complete. 2024-09-12T02:05:08.428 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:05:08.428 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Truncate 500.00000000', proceeding to ls 2024-09-12T02:05:08.428 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:05:08.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.532+0000 7fe7eed4b640 1 Processor -- start 2024-09-12T02:05:08.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.532+0000 7fe7eed4b640 1 -- start start 2024-09-12T02:05:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.533+0000 7fe7eed4b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe7e815b300 0x7fe7e80cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.533+0000 7fe7eed4b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7e806f8d0 0x7fe7e815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.533+0000 7fe7eed4b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7e80cdbe0 con 0x7fe7e80cd3f0 2024-09-12T02:05:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.533+0000 7fe7eed4b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fe7e80728a0 con 0x7fe7e815b300 2024-09-12T02:05:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.533+0000 7fe7eed4b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe7e80cd900 con 0x7fe7e806f8d0 2024-09-12T02:05:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.533+0000 7fe7ecae7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe7e815b300 0x7fe7e80cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.533+0000 7fe7ecae7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe7e815b300 0x7fe7e80cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53822/0 (socket says 172.21.15.19:53822) 2024-09-12T02:05:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.533+0000 7fe7e7fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe7e80cd3f0 0x7fe7e806f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48994/0 (socket says 172.21.15.19:48994) 2024-09-12T02:05:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.533+0000 7fe7ecae7640 1 -- 172.21.15.19:0/2509331516 learned_addr learned my addr 172.21.15.19:0/2509331516 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.533+0000 7fe7ed2e8640 1 --2- 172.21.15.19:0/2509331516 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7e806f8d0 0x7fe7e815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.533+0000 7fe7ecae7640 1 -- 172.21.15.19:0/2509331516 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7e806f8d0 msgr2=0x7fe7e815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.533+0000 7fe7ecae7640 1 --2- 172.21.15.19:0/2509331516 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7e806f8d0 0x7fe7e815b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.533+0000 7fe7ecae7640 1 -- 172.21.15.19:0/2509331516 >> v1:172.21.15.19:6789/0 conn(0x7fe7e80cd3f0 legacy=0x7fe7e806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.533+0000 7fe7ecae7640 1 -- 172.21.15.19:0/2509331516 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e8072250 con 0x7fe7e815b300 2024-09-12T02:05:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.533+0000 7fe7e77fe640 1 -- 172.21.15.19:0/2509331516 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2074344640 0 0) 0x7fe7e80cdbe0 con 0x7fe7e80cd3f0 2024-09-12T02:05:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.533+0000 7fe7ed2e8640 1 --2- 172.21.15.19:0/2509331516 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7e806f8d0 0x7fe7e815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.534+0000 7fe7ecae7640 1 --2- 172.21.15.19:0/2509331516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e815b300 0x7fe7e80cceb0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009870 tx=0x7fe7dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41a841401431f4d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:08.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.534+0000 7fe7e77fe640 1 -- 172.21.15.19:0/2509331516 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc037070 con 0x7fe7e815b300 2024-09-12T02:05:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.534+0000 7fe7e77fe640 1 -- 172.21.15.19:0/2509331516 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7dc032440 con 0x7fe7e815b300 2024-09-12T02:05:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.534+0000 7fe7e77fe640 1 -- 172.21.15.19:0/2509331516 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc032810 con 0x7fe7e815b300 2024-09-12T02:05:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.535+0000 7fe7eed4b640 1 -- 172.21.15.19:0/2509331516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e815b300 msgr2=0x7fe7e80cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.535+0000 7fe7eed4b640 1 --2- 172.21.15.19:0/2509331516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e815b300 0x7fe7e80cceb0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009870 tx=0x7fe7dc02a270 comp rx=0 tx=0).stop 2024-09-12T02:05:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.535+0000 7fe7eed4b640 1 -- 172.21.15.19:0/2509331516 shutdown_connections 2024-09-12T02:05:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.535+0000 7fe7eed4b640 1 --2- 172.21.15.19:0/2509331516 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7e806f8d0 0x7fe7e815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.535+0000 7fe7eed4b640 1 --2- 172.21.15.19:0/2509331516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e815b300 0x7fe7e80cceb0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.535+0000 7fe7eed4b640 1 -- 172.21.15.19:0/2509331516 >> 172.21.15.19:0/2509331516 conn(0x7fe7e8067d70 msgr2=0x7fe7e806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.535+0000 7fe7eed4b640 1 -- 172.21.15.19:0/2509331516 shutdown_connections 2024-09-12T02:05:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.535+0000 7fe7eed4b640 1 -- 172.21.15.19:0/2509331516 wait complete. 2024-09-12T02:05:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.536+0000 7fe7eed4b640 1 Processor -- start 2024-09-12T02:05:08.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.536+0000 7fe7eed4b640 1 -- start start 2024-09-12T02:05:08.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.537+0000 7fe7eed4b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7e806f8d0 0x7fe7e8158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.537+0000 7fe7eed4b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7e80cd3f0 0x7fe7e814f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.537+0000 7fe7eed4b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e815b300 0x7fe7e81589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.537+0000 7fe7eed4b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e80d0160 con 0x7fe7e815b300 2024-09-12T02:05:08.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.537+0000 7fe7eed4b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e80cffe0 con 0x7fe7e80cd3f0 2024-09-12T02:05:08.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.537+0000 7fe7eed4b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe7e8072d30 con 0x7fe7e806f8d0 2024-09-12T02:05:08.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.537+0000 7fe7ed2e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e815b300 0x7fe7e81589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.537+0000 7fe7ed2e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e815b300 0x7fe7e81589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53838/0 (socket says 172.21.15.19:53838) 2024-09-12T02:05:08.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.537+0000 7fe7ed2e8640 1 -- 172.21.15.19:0/231282364 learned_addr learned my addr 172.21.15.19:0/231282364 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:08.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.537+0000 7fe7e7fff640 1 --2- 172.21.15.19:0/231282364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7e80cd3f0 0x7fe7e814f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.537+0000 7fe7ecae7640 1 --2- 172.21.15.19:0/231282364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7e806f8d0 0x7fe7e8158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.538+0000 7fe7ed2e8640 1 -- 172.21.15.19:0/231282364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7e806f8d0 msgr2=0x7fe7e8158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.538+0000 7fe7ed2e8640 1 --2- 172.21.15.19:0/231282364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7e806f8d0 0x7fe7e8158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.538+0000 7fe7ed2e8640 1 -- 172.21.15.19:0/231282364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7e80cd3f0 msgr2=0x7fe7e814f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.538+0000 7fe7ed2e8640 1 --2- 172.21.15.19:0/231282364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7e80cd3f0 0x7fe7e814f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.538+0000 7fe7ed2e8640 1 -- 172.21.15.19:0/231282364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e8156de0 con 0x7fe7e815b300 2024-09-12T02:05:08.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.538+0000 7fe7ed2e8640 1 --2- 172.21.15.19:0/231282364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e815b300 0x7fe7e81589d0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0007e70 tx=0x7fe7e000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:08.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.538+0000 7fe7e57fa640 1 -- 172.21.15.19:0/231282364 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e001a070 con 0x7fe7e815b300 2024-09-12T02:05:08.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.538+0000 7fe7e57fa640 1 -- 172.21.15.19:0/231282364 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e0015600 con 0x7fe7e815b300 2024-09-12T02:05:08.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.538+0000 7fe7eed4b640 1 -- 172.21.15.19:0/231282364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7e81570c0 con 0x7fe7e815b300 2024-09-12T02:05:08.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.538+0000 7fe7e57fa640 1 -- 172.21.15.19:0/231282364 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e00159f0 con 0x7fe7e815b300 2024-09-12T02:05:08.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.538+0000 7fe7eed4b640 1 -- 172.21.15.19:0/231282364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7e8157680 con 0x7fe7e815b300 2024-09-12T02:05:08.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.539+0000 7fe7eed4b640 1 -- 172.21.15.19:0/231282364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7e80b2a70 con 0x7fe7e815b300 2024-09-12T02:05:08.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.539+0000 7fe7e57fa640 1 -- 172.21.15.19:0/231282364 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe7e001d070 con 0x7fe7e815b300 2024-09-12T02:05:08.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.540+0000 7fe7e57fa640 1 --2- 172.21.15.19:0/231282364 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe7cc06be60 0x7fe7cc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:08.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.540+0000 7fe7e57fa640 1 -- 172.21.15.19:0/231282364 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8453+0+0 (secure 0 0 0) 0x7fe7e008bb80 con 0x7fe7e815b300 2024-09-12T02:05:08.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.540+0000 7fe7ecae7640 1 --2- 172.21.15.19:0/231282364 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe7cc06be60 0x7fe7cc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:08.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.541+0000 7fe7ecae7640 1 --2- 172.21.15.19:0/231282364 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe7cc06be60 0x7fe7cc06e320 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc034000 tx=0x7fe7dc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:08.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.544+0000 7fe7e57fa640 1 -- 172.21.15.19:0/231282364 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe7e0010070 con 0x7fe7e815b300 2024-09-12T02:05:08.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.754+0000 7fe7eed4b640 1 -- 172.21.15.19:0/231282364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe7e80b2790 con 0x7fe7e815b300 2024-09-12T02:05:08.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.754+0000 7fe7e57fa640 1 -- 172.21.15.19:0/231282364 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v235) ==== 53+0+73 (secure 0 0 0) 0x7fe7e00593d0 con 0x7fe7e815b300 2024-09-12T02:05:08.754 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:05:08.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.756+0000 7fe7eed4b640 1 -- 172.21.15.19:0/231282364 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe7cc06be60 msgr2=0x7fe7cc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.756+0000 7fe7eed4b640 1 --2- 172.21.15.19:0/231282364 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe7cc06be60 0x7fe7cc06e320 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc034000 tx=0x7fe7dc02e000 comp rx=0 tx=0).stop 2024-09-12T02:05:08.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.756+0000 7fe7eed4b640 1 -- 172.21.15.19:0/231282364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e815b300 msgr2=0x7fe7e81589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.756+0000 7fe7eed4b640 1 --2- 172.21.15.19:0/231282364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e815b300 0x7fe7e81589d0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0007e70 tx=0x7fe7e000d4a0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.756+0000 7fe7eed4b640 1 -- 172.21.15.19:0/231282364 shutdown_connections 2024-09-12T02:05:08.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.756+0000 7fe7eed4b640 1 --2- 172.21.15.19:0/231282364 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe7cc06be60 0x7fe7cc06e320 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.756+0000 7fe7eed4b640 1 --2- 172.21.15.19:0/231282364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e815b300 0x7fe7e81589d0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.756+0000 7fe7eed4b640 1 --2- 172.21.15.19:0/231282364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7e80cd3f0 0x7fe7e814f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.756+0000 7fe7eed4b640 1 --2- 172.21.15.19:0/231282364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7e806f8d0 0x7fe7e8158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.756+0000 7fe7eed4b640 1 -- 172.21.15.19:0/231282364 >> 172.21.15.19:0/231282364 conn(0x7fe7e8067d70 msgr2=0x7fe7e815d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:08.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.756+0000 7fe7eed4b640 1 -- 172.21.15.19:0/231282364 shutdown_connections 2024-09-12T02:05:08.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08.756+0000 7fe7eed4b640 1 -- 172.21.15.19:0/231282364 wait complete. 2024-09-12T02:05:08.767 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:05:08.767 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:05:08.767 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T02:05:08.767 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:05:08.767 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:05:08.767 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:05:08.767 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:05:08.768 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:05:08.768 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:05:08.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:08.768 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T02:05:08.784 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:05:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:05:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:05:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T02:05:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:08.785 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:05:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:05:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T02:05:08.785 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:05:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:05:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T02:05:08.785 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:05:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:05:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T02:05:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:05:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42252sec preferred_lft 42252sec 2024-09-12T02:05:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T02:05:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:08.786 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:05:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:05:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T02:05:08.786 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:05:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T02:05:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:05:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T02:05:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:08.787 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:05:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:05:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T02:05:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:08.787 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:05:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:05:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T02:05:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:08.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:08.788 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:05:08.849 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T02:05:08.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:08.851 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T02:05:08.907 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T02:05:08.908 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:05:08.908 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:05:08.908 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:05:08.908 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:05:08.908 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:05:08.908 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T02:05:08.908 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:05:08.908 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:05:08.909 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:05:08.909 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T02:05:08.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:05:09.001 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:05:09.001+0000 7f0f741c4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:05:09.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:05:09.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:09.038 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T02:05:09.054 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:05:09.054 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:05:09.054 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:05:09.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:09.054 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T02:05:09.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:05:09.120 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:05:09.176 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:05:09.177 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:05:09.177 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:05:09.233 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:05:09.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:09.233 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:05:09.318 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:05:09.319 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:05:09.319 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:05:09.327 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:05:09.327 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:05:09.327 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:05:09.327 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:05:09.327 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:05:09.333 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:05:09.333 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:05:09.333 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:05:09.333 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:05:09.334 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:05:09.334 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T02:05:09.334 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T02:05:09.334 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T02:05:09.334 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:05:09.334 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:05:09.334 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:05:09.334 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:05:09.334 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:05:09.336 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:05:09.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:09.336 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:05:09.362 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:05:09.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:05:09.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:05:09.460 INFO:teuthology.orchestra.run.smithi019.stdout:client7523 2024-09-12T02:05:09.460 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:05:09.460 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:05:09.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:09.477 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2024-09-12T02:05:09.518 INFO:teuthology.orchestra.run:waiting for 20 2024-09-12T02:05:09.534 INFO:teuthology.orchestra.run.smithi019.stdout:.: 2024-09-12T02:05:09.534 INFO:teuthology.orchestra.run.smithi019.stdout:subdir 2024-09-12T02:05:09.534 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:09.534 INFO:teuthology.orchestra.run.smithi019.stdout:./subdir: 2024-09-12T02:05:09.534 INFO:teuthology.orchestra.run.smithi019.stdout:sixmegs 2024-09-12T02:05:09.535 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate 500.00000000' did not caused DAMAGED state 2024-09-12T02:05:09.535 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate mds_snaptable' 2024-09-12T02:05:09.535 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:05:09.535 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:05:09.591 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:05:09.591 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:05:09.648 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:05:09.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.792+0000 7ff9373a6640 1 Processor -- start 2024-09-12T02:05:09.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.792+0000 7ff9373a6640 1 -- start start 2024-09-12T02:05:09.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.793+0000 7ff9373a6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9300b6690 0x7ff9301691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:09.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.793+0000 7ff9373a6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9300d3690 con 0x7ff9300d30f0 2024-09-12T02:05:09.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.793+0000 7ff9373a6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9300d3970 con 0x7ff93015e5f0 2024-09-12T02:05:09.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.793+0000 7ff9373a6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff93006d530 con 0x7ff9300b6690 2024-09-12T02:05:09.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.793+0000 7ff935943640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9300b6690 0x7ff9301691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:09.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.793+0000 7ff934941640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff9300d30f0 0x7ff9300b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49010/0 (socket says 172.21.15.19:49010) 2024-09-12T02:05:09.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.793+0000 7ff934941640 1 -- 172.21.15.19:0/89062251 learned_addr learned my addr 172.21.15.19:0/89062251 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:09.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.793+0000 7ff935943640 1 -- 172.21.15.19:0/89062251 >> v1:172.21.15.135:6789/0 conn(0x7ff93015e5f0 legacy=0x7ff9300d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:09.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.793+0000 7ff935943640 1 -- 172.21.15.19:0/89062251 >> v1:172.21.15.19:6789/0 conn(0x7ff9300d30f0 legacy=0x7ff9300b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:09.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.793+0000 7ff923fff640 1 -- 172.21.15.19:0/89062251 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3363436648 0 0) 0x7ff9300d3690 con 0x7ff9300d30f0 2024-09-12T02:05:09.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.793+0000 7ff935943640 1 -- 172.21.15.19:0/89062251 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93006cee0 con 0x7ff9300b6690 2024-09-12T02:05:09.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.794+0000 7ff935943640 1 --2- 172.21.15.19:0/89062251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9300b6690 0x7ff9301691a0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7ff928009dc0 tx=0x7ff92802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56458a1605c48b73 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:09.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.794+0000 7ff923fff640 1 -- 172.21.15.19:0/89062251 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff928007740 con 0x7ff9300b6690 2024-09-12T02:05:09.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.794+0000 7ff923fff640 1 -- 172.21.15.19:0/89062251 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9280078e0 con 0x7ff9300b6690 2024-09-12T02:05:09.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.794+0000 7ff923fff640 1 -- 172.21.15.19:0/89062251 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff928007cb0 con 0x7ff9300b6690 2024-09-12T02:05:09.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.795+0000 7ff9373a6640 1 -- 172.21.15.19:0/89062251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9300b6690 msgr2=0x7ff9301691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:09.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.795+0000 7ff9373a6640 1 --2- 172.21.15.19:0/89062251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9300b6690 0x7ff9301691a0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7ff928009dc0 tx=0x7ff92802a730 comp rx=0 tx=0).stop 2024-09-12T02:05:09.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.795+0000 7ff9373a6640 1 -- 172.21.15.19:0/89062251 shutdown_connections 2024-09-12T02:05:09.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.795+0000 7ff9373a6640 1 --2- 172.21.15.19:0/89062251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9300b6690 0x7ff9301691a0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:09.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.795+0000 7ff9373a6640 1 -- 172.21.15.19:0/89062251 >> 172.21.15.19:0/89062251 conn(0x7ff93008bfc0 msgr2=0x7ff9300d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:09.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.795+0000 7ff9373a6640 1 -- 172.21.15.19:0/89062251 shutdown_connections 2024-09-12T02:05:09.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.795+0000 7ff9373a6640 1 -- 172.21.15.19:0/89062251 wait complete. 2024-09-12T02:05:09.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.796+0000 7ff9373a6640 1 Processor -- start 2024-09-12T02:05:09.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.796+0000 7ff9373a6640 1 -- start start 2024-09-12T02:05:09.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.797+0000 7ff9373a6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9300b6690 0x7ff9300a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:09.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.797+0000 7ff9373a6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9300d30f0 0x7ff9300b9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:09.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.797+0000 7ff9373a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff93015e5f0 0x7ff93015d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:09.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.797+0000 7ff9373a6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff93006e9d0 con 0x7ff93015e5f0 2024-09-12T02:05:09.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.797+0000 7ff9373a6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff93015e9d0 con 0x7ff9300b6690 2024-09-12T02:05:09.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.797+0000 7ff9373a6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff93006eb50 con 0x7ff9300d30f0 2024-09-12T02:05:09.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.797+0000 7ff935943640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff93015e5f0 0x7ff93015d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:09.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.797+0000 7ff935142640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9300b6690 0x7ff9300a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:09.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.797+0000 7ff935943640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff93015e5f0 0x7ff93015d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53858/0 (socket says 172.21.15.19:53858) 2024-09-12T02:05:09.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.797+0000 7ff935943640 1 -- 172.21.15.19:0/2805079009 learned_addr learned my addr 172.21.15.19:0/2805079009 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:09.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.797+0000 7ff934941640 1 --2- 172.21.15.19:0/2805079009 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9300d30f0 0x7ff9300b9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:09.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.797+0000 7ff935142640 1 -- 172.21.15.19:0/2805079009 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9300d30f0 msgr2=0x7ff9300b9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:09.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.797+0000 7ff935142640 1 --2- 172.21.15.19:0/2805079009 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9300d30f0 0x7ff9300b9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:09.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.797+0000 7ff935142640 1 -- 172.21.15.19:0/2805079009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff93015e5f0 msgr2=0x7ff93015d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:09.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.797+0000 7ff935142640 1 --2- 172.21.15.19:0/2805079009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff93015e5f0 0x7ff93015d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:09.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.797+0000 7ff935142640 1 -- 172.21.15.19:0/2805079009 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9300a1740 con 0x7ff9300b6690 2024-09-12T02:05:09.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.797+0000 7ff935943640 1 --2- 172.21.15.19:0/2805079009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff93015e5f0 0x7ff93015d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:05:09.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.798+0000 7ff935142640 1 --2- 172.21.15.19:0/2805079009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9300b6690 0x7ff9300a0e10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff92400c390 tx=0x7ff92400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:09.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.798+0000 7ff921ffb640 1 -- 172.21.15.19:0/2805079009 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924017070 con 0x7ff9300b6690 2024-09-12T02:05:09.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.798+0000 7ff921ffb640 1 -- 172.21.15.19:0/2805079009 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9240052d0 con 0x7ff9300b6690 2024-09-12T02:05:09.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.798+0000 7ff9373a6640 1 -- 172.21.15.19:0/2805079009 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9300a1a80 con 0x7ff9300b6690 2024-09-12T02:05:09.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.798+0000 7ff921ffb640 1 -- 172.21.15.19:0/2805079009 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924003830 con 0x7ff9300b6690 2024-09-12T02:05:09.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.798+0000 7ff9373a6640 1 -- 172.21.15.19:0/2805079009 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9301605a0 con 0x7ff9300b6690 2024-09-12T02:05:09.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.799+0000 7ff9373a6640 1 -- 172.21.15.19:0/2805079009 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9300b5f80 con 0x7ff9300b6690 2024-09-12T02:05:09.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.800+0000 7ff921ffb640 1 -- 172.21.15.19:0/2805079009 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff92401a070 con 0x7ff9300b6690 2024-09-12T02:05:09.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.800+0000 7ff921ffb640 1 --2- 172.21.15.19:0/2805079009 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff91406be30 0x7ff91406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:09.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.800+0000 7ff921ffb640 1 -- 172.21.15.19:0/2805079009 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8453+0+0 (secure 0 0 0) 0x7ff92408ac90 con 0x7ff9300b6690 2024-09-12T02:05:09.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.800+0000 7ff934941640 1 --2- 172.21.15.19:0/2805079009 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff91406be30 0x7ff91406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:09.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.801+0000 7ff934941640 1 --2- 172.21.15.19:0/2805079009 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff91406be30 0x7ff91406e2f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff92c007f70 tx=0x7ff92c007f00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:09.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.805+0000 7ff921ffb640 1 -- 172.21.15.19:0/2805079009 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff9300a1a80 con 0x7ff9300b6690 2024-09-12T02:05:09.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.991+0000 7ff9373a6640 1 -- 172.21.15.19:0/2805079009 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff930161da0 con 0x7ff9300b6690 2024-09-12T02:05:09.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.992+0000 7ff921ffb640 1 -- 172.21.15.19:0/2805079009 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 52 entries v120) ==== 81+0+3180 (secure 0 0 0) 0x7ff924058480 con 0x7ff9300b6690 2024-09-12T02:05:09.991 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/4087550164 2024-09-13T02:04:57.990681+0000 2024-09-12T02:05:09.992 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3377480547 2024-09-13T02:04:53.949050+0000 2024-09-12T02:05:09.992 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3377480547 2024-09-13T02:04:53.949050+0000 2024-09-12T02:05:09.992 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3545886366 2024-09-13T02:04:49.907498+0000 2024-09-12T02:05:09.992 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3545886366 2024-09-13T02:04:49.907498+0000 2024-09-12T02:05:09.992 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2017831568 2024-09-13T02:04:45.871893+0000 2024-09-12T02:05:09.992 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/626316140 2024-09-13T02:04:41.744221+0000 2024-09-12T02:05:09.992 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2333858704 2024-09-13T02:04:37.802344+0000 2024-09-12T02:05:09.992 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2333858704 2024-09-13T02:04:37.802344+0000 2024-09-12T02:05:09.992 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2405422603 2024-09-13T02:04:31.542456+0000 2024-09-12T02:05:09.992 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/961161264 2024-09-13T02:04:17.973298+0000 2024-09-12T02:05:09.992 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/926329492 2024-09-13T02:04:13.937157+0000 2024-09-12T02:05:09.992 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/926329492 2024-09-13T02:04:13.937157+0000 2024-09-12T02:05:09.992 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/4107165769 2024-09-13T02:04:03.869164+0000 2024-09-12T02:05:09.993 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3136344951 2024-09-13T02:02:58.521234+0000 2024-09-12T02:05:09.993 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/1101861733 2024-09-13T02:02:54.487980+0000 2024-09-12T02:05:09.993 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/650556594 2024-09-13T02:02:50.470816+0000 2024-09-12T02:05:09.993 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/4287312235 2024-09-13T02:03:11.277301+0000 2024-09-12T02:05:09.993 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/650556594 2024-09-13T02:02:50.470816+0000 2024-09-12T02:05:09.993 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/613869354 2024-09-13T02:02:39.104650+0000 2024-09-12T02:05:09.993 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2017831568 2024-09-13T02:04:45.871893+0000 2024-09-12T02:05:09.993 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3136344951 2024-09-13T02:02:58.521234+0000 2024-09-12T02:05:09.993 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/4107165769 2024-09-13T02:04:03.869164+0000 2024-09-12T02:05:09.993 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/613869354 2024-09-13T02:02:39.104650+0000 2024-09-12T02:05:09.993 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3985859189 2024-09-13T02:04:09.906953+0000 2024-09-12T02:05:09.993 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/2072535494 2024-09-13T02:02:44.440900+0000 2024-09-12T02:05:09.993 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/4124612835 2024-09-13T02:03:35.697598+0000 2024-09-12T02:05:09.993 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/4087550164 2024-09-13T02:04:57.990681+0000 2024-09-12T02:05:09.993 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3279314147 2024-09-13T02:04:33.778955+0000 2024-09-12T02:05:09.994 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/1800650480 2024-09-13T02:03:56.737366+0000 2024-09-12T02:05:09.994 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3279314147 2024-09-13T02:04:33.778955+0000 2024-09-12T02:05:09.994 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:05:09.994 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/961161264 2024-09-13T02:04:17.973298+0000 2024-09-12T02:05:09.994 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/4287312235 2024-09-13T02:03:11.277301+0000 2024-09-12T02:05:09.994 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/46689513 2024-09-13T02:03:28.654366+0000 2024-09-12T02:05:09.994 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:05:09.994 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3866905323 2024-09-13T02:03:54.557384+0000 2024-09-12T02:05:09.994 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3995150987 2024-09-13T02:03:22.315702+0000 2024-09-12T02:05:09.994 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3995150987 2024-09-13T02:03:22.315702+0000 2024-09-12T02:05:09.994 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3985859189 2024-09-13T02:04:09.906953+0000 2024-09-12T02:05:09.994 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3598057058 2024-09-13T02:03:24.636971+0000 2024-09-12T02:05:09.994 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/46689513 2024-09-13T02:03:28.654366+0000 2024-09-12T02:05:09.994 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3598057058 2024-09-13T02:03:24.636971+0000 2024-09-12T02:05:09.995 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/1101861733 2024-09-13T02:02:54.487980+0000 2024-09-12T02:05:09.995 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/4124612835 2024-09-13T02:03:35.697598+0000 2024-09-12T02:05:09.995 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/626316140 2024-09-13T02:04:41.744221+0000 2024-09-12T02:05:09.995 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/1875416968 2024-09-13T02:03:41.731211+0000 2024-09-12T02:05:09.995 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2405422603 2024-09-13T02:04:31.542456+0000 2024-09-12T02:05:09.995 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/1875416968 2024-09-13T02:03:41.731211+0000 2024-09-12T02:05:09.995 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/2072535494 2024-09-13T02:02:44.440900+0000 2024-09-12T02:05:09.995 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3866905323 2024-09-13T02:03:54.557384+0000 2024-09-12T02:05:09.995 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/1800650480 2024-09-13T02:03:56.737366+0000 2024-09-12T02:05:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:listed 52 entries 2024-09-12T02:05:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.994+0000 7ff9373a6640 1 -- 172.21.15.19:0/2805079009 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff91406be30 msgr2=0x7ff91406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.994+0000 7ff9373a6640 1 --2- 172.21.15.19:0/2805079009 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff91406be30 0x7ff91406e2f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff92c007f70 tx=0x7ff92c007f00 comp rx=0 tx=0).stop 2024-09-12T02:05:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.994+0000 7ff9373a6640 1 -- 172.21.15.19:0/2805079009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9300b6690 msgr2=0x7ff9300a0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.994+0000 7ff9373a6640 1 --2- 172.21.15.19:0/2805079009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9300b6690 0x7ff9300a0e10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff92400c390 tx=0x7ff92400c850 comp rx=0 tx=0).stop 2024-09-12T02:05:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.994+0000 7ff9373a6640 1 -- 172.21.15.19:0/2805079009 shutdown_connections 2024-09-12T02:05:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.994+0000 7ff9373a6640 1 --2- 172.21.15.19:0/2805079009 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff91406be30 0x7ff91406e2f0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.994+0000 7ff9373a6640 1 --2- 172.21.15.19:0/2805079009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff93015e5f0 0x7ff93015d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.994+0000 7ff9373a6640 1 --2- 172.21.15.19:0/2805079009 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9300d30f0 0x7ff9300b9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.994+0000 7ff9373a6640 1 --2- 172.21.15.19:0/2805079009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9300b6690 0x7ff9300a0e10 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:09.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.994+0000 7ff9373a6640 1 -- 172.21.15.19:0/2805079009 >> 172.21.15.19:0/2805079009 conn(0x7ff93008bfc0 msgr2=0x7ff9300cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:09.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.994+0000 7ff9373a6640 1 -- 172.21.15.19:0/2805079009 shutdown_connections 2024-09-12T02:05:09.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:09.994+0000 7ff9373a6640 1 -- 172.21.15.19:0/2805079009 wait complete. 2024-09-12T02:05:10.004 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:05:10.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:10.005 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-12T02:05:10.048 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:05:10.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:10.049 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:05:10.104 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:05:10.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.248+0000 7f03a632c640 1 Processor -- start 2024-09-12T02:05:10.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.248+0000 7f03a632c640 1 -- start start 2024-09-12T02:05:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.249+0000 7f03a632c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f03a00d30f0 0x7f03a00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.249+0000 7f03a632c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03a00d3690 con 0x7f03a015e5f0 2024-09-12T02:05:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.249+0000 7f03a632c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03a00d3970 con 0x7f03a00b64c0 2024-09-12T02:05:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.249+0000 7f03a632c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f03a006d530 con 0x7f03a00d30f0 2024-09-12T02:05:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.249+0000 7f039ffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f03a015e5f0 0x7f03a00d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49020/0 (socket says 172.21.15.19:49020) 2024-09-12T02:05:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.249+0000 7f039ffff640 1 -- 172.21.15.19:0/1128490398 learned_addr learned my addr 172.21.15.19:0/1128490398 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.249+0000 7f039f7fe640 1 --2- 172.21.15.19:0/1128490398 >> v2:172.21.15.135:3300/0 conn(0x7f03a00d30f0 0x7f03a00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039effd640 1 -- 172.21.15.19:0/1128490398 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1145592672 0 0) 0x7f03a00d3690 con 0x7f03a015e5f0 2024-09-12T02:05:10.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039effd640 1 -- 172.21.15.19:0/1128490398 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0388003520 con 0x7f03a015e5f0 2024-09-12T02:05:10.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039effd640 1 -- 172.21.15.19:0/1128490398 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 928549899 0 0) 0x7f03a00d3970 con 0x7f03a00b64c0 2024-09-12T02:05:10.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039effd640 1 -- 172.21.15.19:0/1128490398 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03a00d3690 con 0x7f03a00b64c0 2024-09-12T02:05:10.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039effd640 1 -- 172.21.15.19:0/1128490398 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3743774451 0 0) 0x7f0388003520 con 0x7f03a015e5f0 2024-09-12T02:05:10.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039effd640 1 -- 172.21.15.19:0/1128490398 >> v2:172.21.15.135:3300/0 conn(0x7f03a00d30f0 msgr2=0x7f03a00b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:10.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039effd640 1 --2- 172.21.15.19:0/1128490398 >> v2:172.21.15.135:3300/0 conn(0x7f03a00d30f0 0x7f03a00b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:10.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039effd640 1 -- 172.21.15.19:0/1128490398 >> v1:172.21.15.135:6789/0 conn(0x7f03a00b64c0 legacy=0x7f03a006d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:10.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039effd640 1 -- 172.21.15.19:0/1128490398 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a006cee0 con 0x7f03a015e5f0 2024-09-12T02:05:10.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039effd640 1 -- 172.21.15.19:0/1128490398 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f0390001670 con 0x7f03a015e5f0 2024-09-12T02:05:10.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039effd640 1 -- 172.21.15.19:0/1128490398 >> v1:172.21.15.19:6789/0 conn(0x7f03a015e5f0 legacy=0x7f03a00d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:10.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039effd640 1 --2- 172.21.15.19:0/1128490398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0388003b40 0x7f0388003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:10.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039effd640 1 --2- 172.21.15.19:0/1128490398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0388004800 0x7f0388004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:10.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039effd640 1 --2- 172.21.15.19:0/1128490398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03880051c0 0x7f038800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:10.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039effd640 1 -- 172.21.15.19:0/1128490398 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f03a006d530 con 0x7f0388003b40 2024-09-12T02:05:10.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039effd640 1 -- 172.21.15.19:0/1128490398 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f038800c040 con 0x7f0388004800 2024-09-12T02:05:10.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039effd640 1 -- 172.21.15.19:0/1128490398 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f038800c240 con 0x7f03880051c0 2024-09-12T02:05:10.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039ffff640 1 --2- 172.21.15.19:0/1128490398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0388003b40 0x7f0388003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:10.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039f7fe640 1 --2- 172.21.15.19:0/1128490398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0388004800 0x7f0388004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:10.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f03a48c9640 1 --2- 172.21.15.19:0/1128490398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03880051c0 0x7f038800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:10.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039ffff640 1 -- 172.21.15.19:0/1128490398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03880051c0 msgr2=0x7f038800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:10.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039ffff640 1 --2- 172.21.15.19:0/1128490398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03880051c0 0x7f038800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:10.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039ffff640 1 -- 172.21.15.19:0/1128490398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0388004800 msgr2=0x7f0388004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:10.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039ffff640 1 --2- 172.21.15.19:0/1128490398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0388004800 0x7f0388004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:10.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f03a48c9640 1 -- 172.21.15.19:0/1128490398 reap_dead start 2024-09-12T02:05:10.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.250+0000 7f039ffff640 1 -- 172.21.15.19:0/1128490398 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0388003520 con 0x7f0388003b40 2024-09-12T02:05:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.251+0000 7f039ffff640 1 --2- 172.21.15.19:0/1128490398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0388003b40 0x7f0388003f40 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f039000c190 tx=0x7f0388005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d174dfc55a51ffb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.251+0000 7f039effd640 1 -- 172.21.15.19:0/1128490398 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0390007ce0 con 0x7f0388003b40 2024-09-12T02:05:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.251+0000 7f039effd640 1 -- 172.21.15.19:0/1128490398 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0390005ad0 con 0x7f0388003b40 2024-09-12T02:05:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.251+0000 7f039effd640 1 -- 172.21.15.19:0/1128490398 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0390007070 con 0x7f0388003b40 2024-09-12T02:05:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.252+0000 7f03a632c640 1 -- 172.21.15.19:0/1128490398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0388003b40 msgr2=0x7f0388003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.252+0000 7f03a632c640 1 --2- 172.21.15.19:0/1128490398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0388003b40 0x7f0388003f40 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f039000c190 tx=0x7f0388005830 comp rx=0 tx=0).stop 2024-09-12T02:05:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.252+0000 7f03a632c640 1 -- 172.21.15.19:0/1128490398 shutdown_connections 2024-09-12T02:05:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.252+0000 7f03a632c640 1 --2- 172.21.15.19:0/1128490398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0388003b40 0x7f0388003f40 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.252+0000 7f03a632c640 1 -- 172.21.15.19:0/1128490398 >> 172.21.15.19:0/1128490398 conn(0x7f03a008bfc0 msgr2=0x7f03a00d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.252+0000 7f03a632c640 1 -- 172.21.15.19:0/1128490398 shutdown_connections 2024-09-12T02:05:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.252+0000 7f03a632c640 1 -- 172.21.15.19:0/1128490398 wait complete. 2024-09-12T02:05:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.253+0000 7f03a632c640 1 Processor -- start 2024-09-12T02:05:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.253+0000 7f03a632c640 1 -- start start 2024-09-12T02:05:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.254+0000 7f03a632c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0388003b40 0x7f03a00a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.254+0000 7f03a632c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03a00b9010 0x7f03a014f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.254+0000 7f03a632c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03a0160b40 0x7f03a0160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.254+0000 7f03a632c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f03a00b5f80 con 0x7f03a00b9010 2024-09-12T02:05:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.254+0000 7f03a632c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f03a015e9d0 con 0x7f0388003b40 2024-09-12T02:05:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.254+0000 7f03a632c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f03a00b6100 con 0x7f03a0160b40 2024-09-12T02:05:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.254+0000 7f039f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03a00b9010 0x7f03a014f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.254+0000 7f039f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03a00b9010 0x7f03a014f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53868/0 (socket says 172.21.15.19:53868) 2024-09-12T02:05:10.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.254+0000 7f039f7fe640 1 -- 172.21.15.19:0/2133984994 learned_addr learned my addr 172.21.15.19:0/2133984994 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:10.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.254+0000 7f03a48c9640 1 --2- 172.21.15.19:0/2133984994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03a0160b40 0x7f03a0160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:10.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.254+0000 7f039ffff640 1 --2- 172.21.15.19:0/2133984994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0388003b40 0x7f03a00a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:10.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.254+0000 7f039f7fe640 1 -- 172.21.15.19:0/2133984994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03a0160b40 msgr2=0x7f03a0160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:10.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.254+0000 7f039f7fe640 1 --2- 172.21.15.19:0/2133984994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03a0160b40 0x7f03a0160fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:10.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.254+0000 7f039f7fe640 1 -- 172.21.15.19:0/2133984994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0388003b40 msgr2=0x7f03a00a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:10.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.254+0000 7f039f7fe640 1 --2- 172.21.15.19:0/2133984994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0388003b40 0x7f03a00a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:10.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.254+0000 7f039f7fe640 1 -- 172.21.15.19:0/2133984994 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a01f4800 con 0x7f03a00b9010 2024-09-12T02:05:10.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.255+0000 7f039f7fe640 1 --2- 172.21.15.19:0/2133984994 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03a00b9010 0x7f03a014f950 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f0394011890 tx=0x7f0394011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:10.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.255+0000 7f039cff9640 1 -- 172.21.15.19:0/2133984994 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0394019070 con 0x7f03a00b9010 2024-09-12T02:05:10.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.255+0000 7f039cff9640 1 -- 172.21.15.19:0/2133984994 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0394004240 con 0x7f03a00b9010 2024-09-12T02:05:10.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.255+0000 7f039cff9640 1 -- 172.21.15.19:0/2133984994 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039400f820 con 0x7f03a00b9010 2024-09-12T02:05:10.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.255+0000 7f03a632c640 1 -- 172.21.15.19:0/2133984994 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a01f4ae0 con 0x7f03a00b9010 2024-09-12T02:05:10.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.255+0000 7f03a632c640 1 -- 172.21.15.19:0/2133984994 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a01f50a0 con 0x7f03a00b9010 2024-09-12T02:05:10.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.256+0000 7f03a632c640 1 -- 172.21.15.19:0/2133984994 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a01f52a0 con 0x7f03a00b9010 2024-09-12T02:05:10.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.256+0000 7f039cff9640 1 -- 172.21.15.19:0/2133984994 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f039401c070 con 0x7f03a00b9010 2024-09-12T02:05:10.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.257+0000 7f039cff9640 1 --2- 172.21.15.19:0/2133984994 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f038c06be60 0x7f038c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:10.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.257+0000 7f039cff9640 1 -- 172.21.15.19:0/2133984994 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8453+0+0 (secure 0 0 0) 0x7f039408bc30 con 0x7f03a00b9010 2024-09-12T02:05:10.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.257+0000 7f039ffff640 1 --2- 172.21.15.19:0/2133984994 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f038c06be60 0x7f038c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:10.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.257+0000 7f039ffff640 1 --2- 172.21.15.19:0/2133984994 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f038c06be60 0x7f038c06e320 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0390032000 tx=0x7f0390009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:10.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.261+0000 7f039cff9640 1 -- 172.21.15.19:0/2133984994 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03a01f52a0 con 0x7f03a00b9010 2024-09-12T02:05:10.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.473+0000 7f03a632c640 1 -- 172.21.15.19:0/2133984994 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f03a00d4dd0 con 0x7f03a00b9010 2024-09-12T02:05:10.473 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:05:10.473+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:05:10.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.475+0000 7f039cff9640 1 -- 172.21.15.19:0/2133984994 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v236) ==== 161+0+0 (secure 0 0 0) 0x7f0394059570 con 0x7f03a00b9010 2024-09-12T02:05:10.474 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:05:10.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.478+0000 7f03a632c640 1 -- 172.21.15.19:0/2133984994 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f038c06be60 msgr2=0x7f038c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:10.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.478+0000 7f03a632c640 1 --2- 172.21.15.19:0/2133984994 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f038c06be60 0x7f038c06e320 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0390032000 tx=0x7f0390009030 comp rx=0 tx=0).stop 2024-09-12T02:05:10.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.478+0000 7f03a632c640 1 -- 172.21.15.19:0/2133984994 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03a00b9010 msgr2=0x7f03a014f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:10.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.478+0000 7f03a632c640 1 --2- 172.21.15.19:0/2133984994 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03a00b9010 0x7f03a014f950 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f0394011890 tx=0x7f0394011c90 comp rx=0 tx=0).stop 2024-09-12T02:05:10.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.478+0000 7f03a632c640 1 -- 172.21.15.19:0/2133984994 shutdown_connections 2024-09-12T02:05:10.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.478+0000 7f03a632c640 1 --2- 172.21.15.19:0/2133984994 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f038c06be60 0x7f038c06e320 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:10.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.478+0000 7f03a632c640 1 --2- 172.21.15.19:0/2133984994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03a0160b40 0x7f03a0160fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:10.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.478+0000 7f03a632c640 1 --2- 172.21.15.19:0/2133984994 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03a00b9010 0x7f03a014f950 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:10.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.478+0000 7f03a632c640 1 --2- 172.21.15.19:0/2133984994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0388003b40 0x7f03a00a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:10.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.478+0000 7f03a632c640 1 -- 172.21.15.19:0/2133984994 >> 172.21.15.19:0/2133984994 conn(0x7f03a008bfc0 msgr2=0x7f03a00d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:10.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.478+0000 7f03a632c640 1 -- 172.21.15.19:0/2133984994 shutdown_connections 2024-09-12T02:05:10.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.478+0000 7f03a632c640 1 -- 172.21.15.19:0/2133984994 wait complete. 2024-09-12T02:05:10.480 INFO:tasks.ceph.mds.d.smithi135.stderr: -501> 2024-09-12T02:05:09.001+0000 7f0f741c4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:05:10.488 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:05:10.507 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T02:05:10.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.593+0000 7f61bbcae640 1 Processor -- start 2024-09-12T02:05:10.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.593+0000 7f61bbcae640 1 -- start start 2024-09-12T02:05:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.595+0000 7f61bbcae640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f61b415ea90 0x7f61b40cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.595+0000 7f61bbcae640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61b40ce620 con 0x7f61b40720b0 2024-09-12T02:05:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.595+0000 7f61bbcae640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61b40ce8c0 con 0x7f61b415a2c0 2024-09-12T02:05:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.595+0000 7f61bbcae640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f61b40ce3f0 con 0x7f61b415ea90 2024-09-12T02:05:10.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.595+0000 7f61b9249640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f61b415ea90 0x7f61b40cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:10.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.595+0000 7f61ba24b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f61b40720b0 0x7f61b40b34d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49032/0 (socket says 172.21.15.19:49032) 2024-09-12T02:05:10.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.595+0000 7f61b9249640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f61b415ea90 0x7f61b40cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53880/0 (socket says 172.21.15.19:53880) 2024-09-12T02:05:10.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.595+0000 7f61ba24b640 1 -- 172.21.15.19:0/146438349 learned_addr learned my addr 172.21.15.19:0/146438349 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:10.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.595+0000 7f61b9249640 1 -- 172.21.15.19:0/146438349 >> v1:172.21.15.135:6789/0 conn(0x7f61b415a2c0 legacy=0x7f61b40cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:10.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.595+0000 7f61b9249640 1 -- 172.21.15.19:0/146438349 >> v1:172.21.15.19:6789/0 conn(0x7f61b40720b0 legacy=0x7f61b40b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:10.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.595+0000 7f61b8a48640 1 -- 172.21.15.19:0/146438349 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1515479330 0 0) 0x7f61b40ce8c0 con 0x7f61b415a2c0 2024-09-12T02:05:10.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.595+0000 7f61b9249640 1 -- 172.21.15.19:0/146438349 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b40ceba0 con 0x7f61b415ea90 2024-09-12T02:05:10.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.596+0000 7f61b9249640 1 --2- 172.21.15.19:0/146438349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61b415ea90 0x7f61b40cf680 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f61a40097a0 tx=0x7f61a402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1271d4eb985be0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:10.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.596+0000 7f61b8a48640 1 -- 172.21.15.19:0/146438349 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4037070 con 0x7f61b415ea90 2024-09-12T02:05:10.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.596+0000 7f61b8a48640 1 -- 172.21.15.19:0/146438349 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a402adc0 con 0x7f61b415ea90 2024-09-12T02:05:10.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.596+0000 7f61b8a48640 1 -- 172.21.15.19:0/146438349 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4032660 con 0x7f61b415ea90 2024-09-12T02:05:10.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.597+0000 7f61bbcae640 1 -- 172.21.15.19:0/146438349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61b415ea90 msgr2=0x7f61b40cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:10.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.597+0000 7f61bbcae640 1 --2- 172.21.15.19:0/146438349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61b415ea90 0x7f61b40cf680 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f61a40097a0 tx=0x7f61a402a130 comp rx=0 tx=0).stop 2024-09-12T02:05:10.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.597+0000 7f61bbcae640 1 -- 172.21.15.19:0/146438349 shutdown_connections 2024-09-12T02:05:10.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.597+0000 7f61bbcae640 1 --2- 172.21.15.19:0/146438349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61b415ea90 0x7f61b40cf680 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:10.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.597+0000 7f61bbcae640 1 -- 172.21.15.19:0/146438349 >> 172.21.15.19:0/146438349 conn(0x7f61b4067b30 msgr2=0x7f61b406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:10.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.597+0000 7f61bbcae640 1 -- 172.21.15.19:0/146438349 shutdown_connections 2024-09-12T02:05:10.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.597+0000 7f61bbcae640 1 -- 172.21.15.19:0/146438349 wait complete. 2024-09-12T02:05:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.598+0000 7f61bbcae640 1 Processor -- start 2024-09-12T02:05:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.598+0000 7f61bbcae640 1 -- start start 2024-09-12T02:05:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.599+0000 7f61bbcae640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61b40720b0 0x7f61b41460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.599+0000 7f61bbcae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61b415a2c0 0x7f61b4152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.599+0000 7f61bbcae640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61b415ea90 0x7f61b4153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.599+0000 7f61bbcae640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f61b40cfbc0 con 0x7f61b415a2c0 2024-09-12T02:05:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.599+0000 7f61bbcae640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f61b40cf1f0 con 0x7f61b40720b0 2024-09-12T02:05:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.599+0000 7f61bbcae640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f61b415a6a0 con 0x7f61b415ea90 2024-09-12T02:05:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.599+0000 7f61b9249640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61b415a2c0 0x7f61b4152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.599+0000 7f61b9249640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61b415a2c0 0x7f61b4152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53884/0 (socket says 172.21.15.19:53884) 2024-09-12T02:05:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.599+0000 7f61b9249640 1 -- 172.21.15.19:0/2886694313 learned_addr learned my addr 172.21.15.19:0/2886694313 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.599+0000 7f61b9a4a640 1 --2- 172.21.15.19:0/2886694313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61b40720b0 0x7f61b41460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.599+0000 7f61b9249640 1 -- 172.21.15.19:0/2886694313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61b415ea90 msgr2=0x7f61b4153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.599+0000 7f61b9249640 1 --2- 172.21.15.19:0/2886694313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61b415ea90 0x7f61b4153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.599+0000 7f61b9249640 1 -- 172.21.15.19:0/2886694313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61b40720b0 msgr2=0x7f61b41460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.599+0000 7f61b9249640 1 --2- 172.21.15.19:0/2886694313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61b40720b0 0x7f61b41460f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.599+0000 7f61b9249640 1 -- 172.21.15.19:0/2886694313 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b4151570 con 0x7f61b415a2c0 2024-09-12T02:05:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.599+0000 7f61b9249640 1 --2- 172.21.15.19:0/2886694313 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61b415a2c0 0x7f61b4152640 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f61a4035040 tx=0x7f61a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.600+0000 7f61aa7fc640 1 -- 172.21.15.19:0/2886694313 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4037040 con 0x7f61b415a2c0 2024-09-12T02:05:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.600+0000 7f61aa7fc640 1 -- 172.21.15.19:0/2886694313 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a4032e20 con 0x7f61b415a2c0 2024-09-12T02:05:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.600+0000 7f61bbcae640 1 -- 172.21.15.19:0/2886694313 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b4151b60 con 0x7f61b415a2c0 2024-09-12T02:05:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.600+0000 7f61aa7fc640 1 -- 172.21.15.19:0/2886694313 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4004270 con 0x7f61b415a2c0 2024-09-12T02:05:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.600+0000 7f61bbcae640 1 -- 172.21.15.19:0/2886694313 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b4152120 con 0x7f61b415a2c0 2024-09-12T02:05:10.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.601+0000 7f61bbcae640 1 -- 172.21.15.19:0/2886694313 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b4067f40 con 0x7f61b415a2c0 2024-09-12T02:05:10.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.601+0000 7f61aa7fc640 1 -- 172.21.15.19:0/2886694313 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61a403a070 con 0x7f61b415a2c0 2024-09-12T02:05:10.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.602+0000 7f61aa7fc640 1 --2- 172.21.15.19:0/2886694313 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f619806be30 0x7f619806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:10.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.602+0000 7f61aa7fc640 1 -- 172.21.15.19:0/2886694313 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 8539+0+0 (secure 0 0 0) 0x7f61a40ac250 con 0x7f61b415a2c0 2024-09-12T02:05:10.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.602+0000 7f61b9a4a640 1 --2- 172.21.15.19:0/2886694313 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f619806be30 0x7f619806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:10.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.602+0000 7f61b9a4a640 1 --2- 172.21.15.19:0/2886694313 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f619806be30 0x7f619806e2f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f61b0001120 tx=0x7f61b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:10.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.606+0000 7f61aa7fc640 1 -- 172.21.15.19:0/2886694313 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61a4041020 con 0x7f61b415a2c0 2024-09-12T02:05:10.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:10.852+0000 7f61bbcae640 1 -- 172.21.15.19:0/2886694313 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f61b40cd420 con 0x7f61b415a2c0 2024-09-12T02:05:11.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.477+0000 7f61aa7fc640 1 -- 172.21.15.19:0/2886694313 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v237) ==== 107+0+0 (secure 0 0 0) 0x7f61a407a0a0 con 0x7f61b415a2c0 2024-09-12T02:05:11.477 INFO:teuthology.orchestra.run.smithi019.stderr:nothing to do: rank is not damaged 2024-09-12T02:05:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.479+0000 7f61bbcae640 1 -- 172.21.15.19:0/2886694313 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f619806be30 msgr2=0x7f619806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.479+0000 7f61bbcae640 1 --2- 172.21.15.19:0/2886694313 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f619806be30 0x7f619806e2f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f61b0001120 tx=0x7f61b0009040 comp rx=0 tx=0).stop 2024-09-12T02:05:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.479+0000 7f61bbcae640 1 -- 172.21.15.19:0/2886694313 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61b415a2c0 msgr2=0x7f61b4152640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.479+0000 7f61bbcae640 1 --2- 172.21.15.19:0/2886694313 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61b415a2c0 0x7f61b4152640 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f61a4035040 tx=0x7f61a40046c0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.479+0000 7f61bbcae640 1 -- 172.21.15.19:0/2886694313 shutdown_connections 2024-09-12T02:05:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.479+0000 7f61bbcae640 1 --2- 172.21.15.19:0/2886694313 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f619806be30 0x7f619806e2f0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.479+0000 7f61bbcae640 1 --2- 172.21.15.19:0/2886694313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61b415ea90 0x7f61b4153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.479+0000 7f61bbcae640 1 --2- 172.21.15.19:0/2886694313 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61b415a2c0 0x7f61b4152640 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.479+0000 7f61bbcae640 1 --2- 172.21.15.19:0/2886694313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61b40720b0 0x7f61b41460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.479+0000 7f61bbcae640 1 -- 172.21.15.19:0/2886694313 >> 172.21.15.19:0/2886694313 conn(0x7f61b4067b30 msgr2=0x7f61b41693a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.479+0000 7f61bbcae640 1 -- 172.21.15.19:0/2886694313 shutdown_connections 2024-09-12T02:05:11.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.479+0000 7f61bbcae640 1 -- 172.21.15.19:0/2886694313 wait complete. 2024-09-12T02:05:11.492 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:05:11.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.539+0000 7f5edf33ff40 1 Processor -- start 2024-09-12T02:05:11.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.539+0000 7f5edf33ff40 1 -- start start 2024-09-12T02:05:11.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.540+0000 7f5edf33ff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5582c6fa3cf0 0x5582c6fcd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.540+0000 7f5edf33ff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582c705d160 0x5582c6fcc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.540+0000 7f5edf33ff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582c70786a0 0x5582c7075e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.540+0000 7f5edf33ff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5582c705d540 con 0x5582c705d160 2024-09-12T02:05:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.540+0000 7f5edf33ff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5582c6ef3510 con 0x5582c70786a0 2024-09-12T02:05:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.540+0000 7f5edf33ff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5582c6fd2620 con 0x5582c6fa3cf0 2024-09-12T02:05:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.540+0000 7f5edc634640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582c705d160 0x5582c6fcc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.540+0000 7f5edd636640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582c70786a0 0x5582c7075e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.540+0000 7f5edc634640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582c705d160 0x5582c6fcc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38242/0 (socket says 172.21.15.19:38242) 2024-09-12T02:05:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.540+0000 7f5edc634640 1 -- 172.21.15.19:0/3972257672 learned_addr learned my addr 172.21.15.19:0/3972257672 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.540+0000 7f5edce35640 1 --2- 172.21.15.19:0/3972257672 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5582c6fa3cf0 0x5582c6fcd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.540+0000 7f5edc634640 1 -- 172.21.15.19:0/3972257672 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5582c6fa3cf0 msgr2=0x5582c6fcd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.540+0000 7f5edc634640 1 --2- 172.21.15.19:0/3972257672 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5582c6fa3cf0 0x5582c6fcd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.540+0000 7f5edc634640 1 -- 172.21.15.19:0/3972257672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582c70786a0 msgr2=0x5582c7075e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.540+0000 7f5edc634640 1 --2- 172.21.15.19:0/3972257672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582c70786a0 0x5582c7075e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.540+0000 7f5edc634640 1 -- 172.21.15.19:0/3972257672 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582c6fa3ae0 con 0x5582c705d160 2024-09-12T02:05:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.540+0000 7f5edd636640 1 --2- 172.21.15.19:0/3972257672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582c70786a0 0x5582c7075e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:05:11.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.540+0000 7f5edc634640 1 --2- 172.21.15.19:0/3972257672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582c705d160 0x5582c6fcc380 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00098b0 tx=0x7f5ed0005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab93c83cb831942c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:11.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.541+0000 7f5edb632640 1 -- 172.21.15.19:0/3972257672 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0008930 con 0x5582c705d160 2024-09-12T02:05:11.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.541+0000 7f5edb632640 1 -- 172.21.15.19:0/3972257672 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ed0018070 con 0x5582c705d160 2024-09-12T02:05:11.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.541+0000 7f5edb632640 1 -- 172.21.15.19:0/3972257672 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0008cd0 con 0x5582c705d160 2024-09-12T02:05:11.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.541+0000 7f5edf33ff40 1 -- 172.21.15.19:0/3972257672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582c705d160 msgr2=0x5582c6fcc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.541+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/3972257672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582c705d160 0x5582c6fcc380 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00098b0 tx=0x7f5ed0005a00 comp rx=0 tx=0).stop 2024-09-12T02:05:11.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.541+0000 7f5edf33ff40 1 -- 172.21.15.19:0/3972257672 shutdown_connections 2024-09-12T02:05:11.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.541+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/3972257672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582c70786a0 0x5582c7075e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.541+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/3972257672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582c705d160 0x5582c6fcc380 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.541+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/3972257672 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5582c6fa3cf0 0x5582c6fcd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.541+0000 7f5edf33ff40 1 -- 172.21.15.19:0/3972257672 >> 172.21.15.19:0/3972257672 conn(0x5582c6fa31d0 msgr2=0x5582c6fa0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:11.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.541+0000 7f5edf33ff40 1 -- 172.21.15.19:0/3972257672 shutdown_connections 2024-09-12T02:05:11.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.541+0000 7f5edf33ff40 1 -- 172.21.15.19:0/3972257672 wait complete. 2024-09-12T02:05:11.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.542+0000 7f5edf33ff40 1 Processor -- start 2024-09-12T02:05:11.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.542+0000 7f5edf33ff40 1 -- start start 2024-09-12T02:05:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5edf33ff40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582c6fa3cf0 0x5582c6fcd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5edf33ff40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582c705d160 0x5582c7057e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5edf33ff40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5582c70786a0 0x5582c7071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5edf33ff40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5582c70744c0 con 0x5582c6fa3cf0 2024-09-12T02:05:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5edf33ff40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5582c7074c30 con 0x5582c705d160 2024-09-12T02:05:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5edf33ff40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5582c6fcce80 con 0x5582c70786a0 2024-09-12T02:05:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5edce35640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582c6fa3cf0 0x5582c6fcd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5edce35640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582c6fa3cf0 0x5582c6fcd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38252/0 (socket says 172.21.15.19:38252) 2024-09-12T02:05:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 learned_addr learned my addr 172.21.15.19:0/1630311146 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5582c70786a0 msgr2=0x5582c7071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5edd636640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5582c70786a0 0x5582c7071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5edce35640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5582c70786a0 0x5582c7071460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582c705d160 msgr2=0x5582c7057e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5edc634640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582c705d160 0x5582c7057e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5edce35640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582c705d160 0x5582c7057e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582c6fc46a0 con 0x5582c6fa3cf0 2024-09-12T02:05:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5edce35640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582c6fa3cf0 0x5582c6fcd6c0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc002d40 tx=0x7f5ecc00c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5eda630640 1 -- 172.21.15.19:0/1630311146 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc015020 con 0x5582c6fa3cf0 2024-09-12T02:05:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5eda630640 1 -- 172.21.15.19:0/1630311146 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ecc011450 con 0x5582c6fa3cf0 2024-09-12T02:05:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.543+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582c6fc40e0 con 0x5582c6fa3cf0 2024-09-12T02:05:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.544+0000 7f5eda630640 1 -- 172.21.15.19:0/1630311146 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc011820 con 0x5582c6fa3cf0 2024-09-12T02:05:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.544+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582c7058850 con 0x5582c6fa3cf0 2024-09-12T02:05:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.545+0000 7f5eda630640 1 -- 172.21.15.19:0/1630311146 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ecc018020 con 0x5582c6fa3cf0 2024-09-12T02:05:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.545+0000 7f5eda630640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5ec806a840 0x7f5ec806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.546+0000 7f5eda630640 1 -- 172.21.15.19:0/1630311146 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 8539+0+0 (secure 0 0 0) 0x7f5ecc08a8e0 con 0x5582c6fa3cf0 2024-09-12T02:05:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.546+0000 7f5edc634640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5ec806a840 0x7f5ec806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.548 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:05:11.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.546+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5582c70719a0 0x5582c7059560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.546+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c7078ab0 con 0x5582c70719a0 2024-09-12T02:05:11.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.546+0000 7f5edd636640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5582c70719a0 0x5582c7059560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.546+0000 7f5edc634640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5ec806a840 0x7f5ec806cd00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x5582c6feaf80 tx=0x7f5ed0012000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:11.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.546+0000 7f5edd636640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5582c70719a0 0x5582c7059560 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:11.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.548+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v121'815 uv789 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.548+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c7078eb0 con 0x5582c70719a0 2024-09-12T02:05:11.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.549+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v121'816 uv816 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.549+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c7119df0 con 0x5582c70719a0 2024-09-12T02:05:11.550 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:05:11.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.550+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v121'817 uv817 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.550+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711b1a0 con 0x5582c70719a0 2024-09-12T02:05:11.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.552+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v121'818 uv818 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.552+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711b540 con 0x5582c70719a0 2024-09-12T02:05:11.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.553+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v121'819 uv819 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.553+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a190 con 0x5582c70719a0 2024-09-12T02:05:11.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.554+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v121'820 uv820 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.554+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a5a0 con 0x5582c70719a0 2024-09-12T02:05:11.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.555+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v121'821 uv795 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.555+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a990 con 0x5582c70719a0 2024-09-12T02:05:11.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.556+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v121'822 uv822 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.556+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a990 con 0x5582c70719a0 2024-09-12T02:05:11.556 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:05:11.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.557+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v121'823 uv823 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.557+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.558+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v121'824 uv824 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.558+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.560+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v121'825 uv825 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.560+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.561+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v121'826 uv826 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.561+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.562+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v121'827 uv802 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.562+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.563+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v121'828 uv828 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.563+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.563 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:05:11.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.564+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v121'829 uv829 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.564+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.565+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v121'830 uv830 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.565+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.566+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v121'831 uv831 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.566+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.567+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v121'832 uv832 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.567+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.569+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v121'833 uv833 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.569+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.570+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v121'834 uv808 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.570+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.571+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v121'835 uv835 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.571+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.571 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:05:11.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.572+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v121'836 uv836 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.572+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.573+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v121'837 uv837 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.573+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.575+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v121'838 uv838 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.575+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.576+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v121'839 uv839 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.576+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.577+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v121'840 uv814 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.577+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.578+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v121'841 uv841 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.578+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.578 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:05:11.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.579+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v121'842 uv842 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.579+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.580+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v121'843 uv843 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.580+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.581+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v121'844 uv844 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.581+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711a940 con 0x5582c70719a0 2024-09-12T02:05:11.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.582+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v121'845 uv845 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c70719a0 2024-09-12T02:05:11.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.583+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5582c711ad40 0x5582c711de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.583+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711e340 con 0x5582c711ad40 2024-09-12T02:05:11.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.583+0000 7f5edce35640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5582c711ad40 0x5582c711de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.583+0000 7f5edce35640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5582c711ad40 0x5582c711de00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:11.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.585+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v121'597 uv576 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.585+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c711e6e0 con 0x5582c711ad40 2024-09-12T02:05:11.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.586+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v121'598 uv598 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.586+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711ea80 con 0x5582c711ad40 2024-09-12T02:05:11.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.587+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v121'599 uv599 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.587 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:05:11.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.587+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711f2d0 con 0x5582c711ad40 2024-09-12T02:05:11.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.589+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v121'600 uv600 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.589+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711f670 con 0x5582c711ad40 2024-09-12T02:05:11.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.590+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v121'601 uv601 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.590+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711fa10 con 0x5582c711ad40 2024-09-12T02:05:11.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.592+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v121'602 uv595 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.592+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c711fdb0 con 0x5582c711ad40 2024-09-12T02:05:11.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.593+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v121'603 uv603 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.593+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c7120150 con 0x5582c711ad40 2024-09-12T02:05:11.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.594+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v121'604 uv604 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.594 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:05:11.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.594+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c7120150 con 0x5582c711ad40 2024-09-12T02:05:11.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.596+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v121'605 uv605 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.596+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c7120150 con 0x5582c711ad40 2024-09-12T02:05:11.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.597+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v121'606 uv606 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.597+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c7120150 con 0x5582c711ad40 2024-09-12T02:05:11.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.598+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v121'607 uv596 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.598+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c7120150 con 0x5582c711ad40 2024-09-12T02:05:11.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.599+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v121'608 uv608 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.600+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c7120150 con 0x5582c711ad40 2024-09-12T02:05:11.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.601+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v121'609 uv609 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.600 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:05:11.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.601+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c71245d0 con 0x5582c711ad40 2024-09-12T02:05:11.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.602+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v121'610 uv610 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.602+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c71245d0 con 0x5582c711ad40 2024-09-12T02:05:11.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.603+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v121'611 uv611 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.603+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c7120150 con 0x5582c711ad40 2024-09-12T02:05:11.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.605+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v121'612 uv592 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.605+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c7120150 con 0x5582c711ad40 2024-09-12T02:05:11.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.606+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v121'613 uv613 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.606+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c7120150 con 0x5582c711ad40 2024-09-12T02:05:11.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.607+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v121'614 uv614 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.607 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:05:11.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.607+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c7121160 con 0x5582c711ad40 2024-09-12T02:05:11.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.609+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v121'615 uv615 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.609+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c7121160 con 0x5582c711ad40 2024-09-12T02:05:11.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.610+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v121'616 uv616 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.610+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c7120150 con 0x5582c711ad40 2024-09-12T02:05:11.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.611+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v121'617 uv617 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c711ad40 2024-09-12T02:05:11.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.611+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5582c7120660 0x5582c7122a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.611+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c7122f90 con 0x5582c7120660 2024-09-12T02:05:11.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.611+0000 7f5edc634640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5582c7120660 0x5582c7122a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.612+0000 7f5edc634640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5582c7120660 0x5582c7122a50 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:11.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.613+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v121'159 uv158 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.613+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c71233f0 con 0x5582c7120660 2024-09-12T02:05:11.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.614+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v121'160 uv160 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.614+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c71238a0 con 0x5582c7120660 2024-09-12T02:05:11.614 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:05:11.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.615+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v121'161 uv161 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.615+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c711ef00 con 0x5582c7120660 2024-09-12T02:05:11.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.616+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v121'162 uv162 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.616+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c7125210 con 0x5582c7120660 2024-09-12T02:05:11.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.617+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v121'163 uv163 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.617+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c7124140 con 0x5582c7120660 2024-09-12T02:05:11.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.618+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v121'164 uv164 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.618+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5582c7124c20 0x5582c7127650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.618+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c7127bb0 con 0x5582c7124c20 2024-09-12T02:05:11.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.618+0000 7f5edd636640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5582c7124c20 0x5582c7127650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.619+0000 7f5edd636640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5582c7124c20 0x5582c7127650 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:11.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.620+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v121'118 uv117 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.620+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c7127c70 con 0x5582c7124c20 2024-09-12T02:05:11.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.622+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v121'119 uv119 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.622+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c71280b0 con 0x5582c7124c20 2024-09-12T02:05:11.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.623+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v121'120 uv120 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.622 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:05:11.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.623+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c71280b0 con 0x5582c7124c20 2024-09-12T02:05:11.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.624+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v121'121 uv121 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.624+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5582c7128730 0x5582c712ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.624+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b060 con 0x5582c7128730 2024-09-12T02:05:11.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.624+0000 7f5edce35640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5582c7128730 0x5582c712ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.624+0000 7f5edce35640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5582c7128730 0x5582c712ab20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:11.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.626+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v121'159 uv158 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.626+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b0e0 con 0x5582c7128730 2024-09-12T02:05:11.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.627+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v121'160 uv160 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.627+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7128730 2024-09-12T02:05:11.627 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:05:11.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.628+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v121'161 uv161 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.628+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712c510 con 0x5582c7128730 2024-09-12T02:05:11.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.629+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v121'162 uv162 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.629+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712c510 con 0x5582c7128730 2024-09-12T02:05:11.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.631+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v121'163 uv163 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.631+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7128730 2024-09-12T02:05:11.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.632+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v121'164 uv164 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.632+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7124c20 2024-09-12T02:05:11.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.633+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v121'294 uv287 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.633+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7124c20 2024-09-12T02:05:11.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.635+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v121'295 uv295 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.635+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7124c20 2024-09-12T02:05:11.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.636+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v121'296 uv296 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.635 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:05:11.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.636+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712c510 con 0x5582c7124c20 2024-09-12T02:05:11.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.637+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v121'297 uv297 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.637+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712c510 con 0x5582c7124c20 2024-09-12T02:05:11.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.638+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v121'298 uv298 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.638+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7124c20 2024-09-12T02:05:11.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.639+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v121'299 uv299 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.639+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7124c20 2024-09-12T02:05:11.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.640+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v121'300 uv293 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.640+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7124c20 2024-09-12T02:05:11.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.642+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v121'301 uv301 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.642+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7124c20 2024-09-12T02:05:11.642 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:05:11.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.643+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v121'302 uv302 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.643+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7124c20 2024-09-12T02:05:11.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.645+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v121'303 uv303 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.645+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7124c20 2024-09-12T02:05:11.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.646+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v121'304 uv304 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.646+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7124c20 2024-09-12T02:05:11.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.647+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v121'132 uv131 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.647+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7124c20 2024-09-12T02:05:11.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.648+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v121'133 uv133 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.648+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7124c20 2024-09-12T02:05:11.648 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:05:11.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.649+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v121'134 uv134 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.649+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7124c20 2024-09-12T02:05:11.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.650+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v121'135 uv135 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.650+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7124c20 2024-09-12T02:05:11.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.651+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v121'136 uv136 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5ed404f990 con 0x5582c7124c20 2024-09-12T02:05:11.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.651+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7128730 2024-09-12T02:05:11.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.653+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v121'159 uv158 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.653+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7128730 2024-09-12T02:05:11.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.654+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v121'160 uv160 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.654+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7128730 2024-09-12T02:05:11.654 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:05:11.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.655+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v121'161 uv161 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.655+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712c510 con 0x5582c7128730 2024-09-12T02:05:11.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.656+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v121'162 uv162 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.656+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712c510 con 0x5582c7128730 2024-09-12T02:05:11.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.657+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v121'163 uv163 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.657+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7128730 2024-09-12T02:05:11.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.658+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v121'164 uv164 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.658+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7128730 2024-09-12T02:05:11.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.659+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v121'263 uv257 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.659+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7128730 2024-09-12T02:05:11.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.660+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v121'264 uv264 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.661+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b500 con 0x5582c7128730 2024-09-12T02:05:11.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.662+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v121'265 uv265 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.661 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:05:11.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.662+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b8f0 con 0x5582c7128730 2024-09-12T02:05:11.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.663+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v121'266 uv266 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.663+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b5c0 con 0x5582c7128730 2024-09-12T02:05:11.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.664+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v121'267 uv267 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.664+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b5c0 con 0x5582c7128730 2024-09-12T02:05:11.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.666+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v121'268 uv262 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.666+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b5c0 con 0x5582c7128730 2024-09-12T02:05:11.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.667+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v121'269 uv269 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.667+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b5a0 con 0x5582c7128730 2024-09-12T02:05:11.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.669+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v121'270 uv270 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.668 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:05:11.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.669+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712b5a0 con 0x5582c7128730 2024-09-12T02:05:11.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.670+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v121'271 uv271 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.670+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ba60 con 0x5582c7128730 2024-09-12T02:05:11.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.671+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v121'272 uv272 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.671+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5582c712c120 0x5582c712e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.671+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ea50 con 0x5582c712c120 2024-09-12T02:05:11.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.671+0000 7f5edc634640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5582c712c120 0x5582c712e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.672+0000 7f5edc634640 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5582c712c120 0x5582c712e510 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:11.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.673+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v121'116 uv114 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c712c120 2024-09-12T02:05:11.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.673+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ea50 con 0x5582c712c120 2024-09-12T02:05:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.674+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v121'117 uv117 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c712c120 2024-09-12T02:05:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.674+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ea50 con 0x5582c712c120 2024-09-12T02:05:11.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.675+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v121'118 uv118 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c712c120 2024-09-12T02:05:11.675 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:05:11.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.675+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ead0 con 0x5582c712c120 2024-09-12T02:05:11.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.676+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v121'119 uv119 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c712c120 2024-09-12T02:05:11.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.676+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ead0 con 0x5582c7128730 2024-09-12T02:05:11.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.678+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v121'159 uv158 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.678+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ead0 con 0x5582c7128730 2024-09-12T02:05:11.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.679+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v121'160 uv160 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.679+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ead0 con 0x5582c7128730 2024-09-12T02:05:11.680 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:05:11.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.680+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v121'161 uv161 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.680+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ead0 con 0x5582c7128730 2024-09-12T02:05:11.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.681+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v121'162 uv162 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.681+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ead0 con 0x5582c7128730 2024-09-12T02:05:11.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.682+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v121'163 uv163 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.682+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ead0 con 0x5582c7128730 2024-09-12T02:05:11.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.683+0000 7f5edce35640 1 -- 172.21.15.19:0/1630311146 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v121'164 uv164 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ecc021070 con 0x5582c7128730 2024-09-12T02:05:11.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.683+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ead0 con 0x5582c7120660 2024-09-12T02:05:11.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.684+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v121'135 uv134 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.684+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ead0 con 0x5582c7120660 2024-09-12T02:05:11.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.684+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v121'136 uv136 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.685+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ef90 con 0x5582c7120660 2024-09-12T02:05:11.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.686+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v121'137 uv137 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.685 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:05:11.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.686+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ead0 con 0x5582c7120660 2024-09-12T02:05:11.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.687+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v121'138 uv138 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.687+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ead0 con 0x5582c7120660 2024-09-12T02:05:11.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.688+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v121'139 uv139 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.688+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ead0 con 0x5582c7120660 2024-09-12T02:05:11.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.689+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v121'327 uv318 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.689+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ead0 con 0x5582c7120660 2024-09-12T02:05:11.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.692+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v121'328 uv328 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.692+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ead0 con 0x5582c7120660 2024-09-12T02:05:11.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.693+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v121'329 uv329 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.692 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:05:11.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.693+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712eaf0 con 0x5582c7120660 2024-09-12T02:05:11.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.694+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v121'330 uv330 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.694+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712f090 con 0x5582c7120660 2024-09-12T02:05:11.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.695+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v121'331 uv331 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.695+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712f090 con 0x5582c7120660 2024-09-12T02:05:11.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.696+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v121'332 uv325 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.696+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ef50 con 0x5582c7120660 2024-09-12T02:05:11.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.697+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v121'333 uv333 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.697+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ef50 con 0x5582c7120660 2024-09-12T02:05:11.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.698+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v121'334 uv334 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.697 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:05:11.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.698+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712ef20 con 0x5582c7120660 2024-09-12T02:05:11.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.699+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v121'335 uv335 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.699+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712eee0 con 0x5582c7120660 2024-09-12T02:05:11.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.700+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v121'336 uv336 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.700+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712eec0 con 0x5582c7120660 2024-09-12T02:05:11.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.701+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v121'337 uv337 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.701+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5582c712f3d0 con 0x5582c7120660 2024-09-12T02:05:11.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edc634640 1 -- 172.21.15.19:0/1630311146 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v121'338 uv338 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5ed0008db0 con 0x5582c7120660 2024-09-12T02:05:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5582c711ad40 msgr2=0x5582c711de00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5582c711ad40 0x5582c711de00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5582c70719a0 msgr2=0x5582c7059560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5582c70719a0 0x5582c7059560 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5582c7124c20 msgr2=0x5582c7127650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5582c7124c20 0x5582c7127650 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5582c712c120 msgr2=0x5582c712e510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5582c712c120 0x5582c712e510 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5582c7120660 msgr2=0x5582c7122a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5582c7120660 0x5582c7122a50 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5582c7128730 msgr2=0x5582c712ab20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 reap_dead start 2024-09-12T02:05:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5582c7128730 0x5582c712ab20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edd636640 1 -- 172.21.15.19:0/1630311146 reap_dead start 2024-09-12T02:05:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5ec806a840 msgr2=0x7f5ec806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5ec806a840 0x7f5ec806cd00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x5582c6feaf80 tx=0x7f5ed0012000 comp rx=0 tx=0).stop 2024-09-12T02:05:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582c6fa3cf0 msgr2=0x5582c6fcd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582c6fa3cf0 0x5582c6fcd6c0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc002d40 tx=0x7f5ecc00c620 comp rx=0 tx=0).stop 2024-09-12T02:05:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 shutdown_connections 2024-09-12T02:05:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5ec806a840 0x7f5ec806cd00 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 --2- 172.21.15.19:0/1630311146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582c6fa3cf0 0x5582c6fcd6c0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.702+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 >> 172.21.15.19:0/1630311146 conn(0x5582c6fa31d0 msgr2=0x5582c6f9fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.703+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 shutdown_connections 2024-09-12T02:05:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.703+0000 7f5edf33ff40 1 -- 172.21.15.19:0/1630311146 wait complete. 2024-09-12T02:05:11.705 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate mds_snaptable 0 2024-09-12T02:05:11.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.750+0000 7f5bdf11bf40 1 Processor -- start 2024-09-12T02:05:11.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.750+0000 7f5bdf11bf40 1 -- start start 2024-09-12T02:05:11.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.751+0000 7f5bdf11bf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c332e350 0x5605c3405230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.751+0000 7f5bdf11bf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c335c050 0x5605c33e3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.751+0000 7f5bdf11bf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605c33e6080 0x5605c3372080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.751+0000 7f5bdf11bf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5605c327d510 con 0x5605c335c050 2024-09-12T02:05:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.751+0000 7f5bdf11bf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5605c32d6c50 con 0x5605c332e350 2024-09-12T02:05:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.751+0000 7f5bdf11bf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5605c332adc0 con 0x5605c33e6080 2024-09-12T02:05:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.751+0000 7f5bdb962640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c335c050 0x5605c33e3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.751+0000 7f5bdb962640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c335c050 0x5605c33e3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38266/0 (socket says 172.21.15.19:38266) 2024-09-12T02:05:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.751+0000 7f5bdb962640 1 -- 172.21.15.19:0/1730148958 learned_addr learned my addr 172.21.15.19:0/1730148958 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.751+0000 7f5bdc163640 1 --2- 172.21.15.19:0/1730148958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c332e350 0x5605c3405230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.751+0000 7f5bdc964640 1 --2- 172.21.15.19:0/1730148958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605c33e6080 0x5605c3372080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bdb962640 1 -- 172.21.15.19:0/1730148958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605c33e6080 msgr2=0x5605c3372080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bdb962640 1 --2- 172.21.15.19:0/1730148958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605c33e6080 0x5605c3372080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bdb962640 1 -- 172.21.15.19:0/1730148958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c332e350 msgr2=0x5605c3405230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bdb962640 1 --2- 172.21.15.19:0/1730148958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c332e350 0x5605c3405230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bdb962640 1 -- 172.21.15.19:0/1730148958 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c34037a0 con 0x5605c335c050 2024-09-12T02:05:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bdc163640 1 --2- 172.21.15.19:0/1730148958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c332e350 0x5605c3405230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bdb962640 1 --2- 172.21.15.19:0/1730148958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c335c050 0x5605c33e3fd0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000b470 tx=0x7f5bd000b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392c053b0d6771ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bda960640 1 -- 172.21.15.19:0/1730148958 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0012070 con 0x5605c335c050 2024-09-12T02:05:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bda960640 1 -- 172.21.15.19:0/1730148958 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd000d690 con 0x5605c335c050 2024-09-12T02:05:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bda960640 1 -- 172.21.15.19:0/1730148958 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd000da80 con 0x5605c335c050 2024-09-12T02:05:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bdf11bf40 1 -- 172.21.15.19:0/1730148958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c335c050 msgr2=0x5605c33e3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bdf11bf40 1 --2- 172.21.15.19:0/1730148958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c335c050 0x5605c33e3fd0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000b470 tx=0x7f5bd000b930 comp rx=0 tx=0).stop 2024-09-12T02:05:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bdf11bf40 1 -- 172.21.15.19:0/1730148958 shutdown_connections 2024-09-12T02:05:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bdf11bf40 1 --2- 172.21.15.19:0/1730148958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605c33e6080 0x5605c3372080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bdf11bf40 1 --2- 172.21.15.19:0/1730148958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c335c050 0x5605c33e3fd0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bdf11bf40 1 --2- 172.21.15.19:0/1730148958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c332e350 0x5605c3405230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bdf11bf40 1 -- 172.21.15.19:0/1730148958 >> 172.21.15.19:0/1730148958 conn(0x5605c332b9e0 msgr2=0x5605c3404110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:11.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bdf11bf40 1 -- 172.21.15.19:0/1730148958 shutdown_connections 2024-09-12T02:05:11.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.752+0000 7f5bdf11bf40 1 -- 172.21.15.19:0/1730148958 wait complete. 2024-09-12T02:05:11.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.753+0000 7f5bdf11bf40 1 Processor -- start 2024-09-12T02:05:11.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.753+0000 7f5bdf11bf40 1 -- start start 2024-09-12T02:05:11.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.754+0000 7f5bdf11bf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c332e350 0x5605c3404300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.754+0000 7f5bdf11bf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c335c050 0x5605c34943e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.754+0000 7f5bdf11bf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605c33e6080 0x5605c3494920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.754+0000 7f5bdf11bf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5605c3403a80 con 0x5605c332e350 2024-09-12T02:05:11.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.754+0000 7f5bdf11bf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5605c3402650 con 0x5605c335c050 2024-09-12T02:05:11.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.754+0000 7f5bdf11bf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5605c3402000 con 0x5605c33e6080 2024-09-12T02:05:11.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.754+0000 7f5bdc163640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c332e350 0x5605c3404300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.754+0000 7f5bdc163640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c332e350 0x5605c3404300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38278/0 (socket says 172.21.15.19:38278) 2024-09-12T02:05:11.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.754+0000 7f5bdc163640 1 -- 172.21.15.19:0/2789447663 learned_addr learned my addr 172.21.15.19:0/2789447663 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:11.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.754+0000 7f5bdc964640 1 --2- 172.21.15.19:0/2789447663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605c33e6080 0x5605c3494920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.754+0000 7f5bdb962640 1 --2- 172.21.15.19:0/2789447663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c335c050 0x5605c34943e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.754+0000 7f5bdc163640 1 -- 172.21.15.19:0/2789447663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605c33e6080 msgr2=0x5605c3494920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.754+0000 7f5bdc163640 1 --2- 172.21.15.19:0/2789447663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5605c33e6080 0x5605c3494920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.754+0000 7f5bdc163640 1 -- 172.21.15.19:0/2789447663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c335c050 msgr2=0x5605c34943e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.754+0000 7f5bdc163640 1 --2- 172.21.15.19:0/2789447663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605c335c050 0x5605c34943e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.754+0000 7f5bdc163640 1 -- 172.21.15.19:0/2789447663 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c33e3710 con 0x5605c332e350 2024-09-12T02:05:11.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.754+0000 7f5bdc163640 1 --2- 172.21.15.19:0/2789447663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c332e350 0x5605c3404300 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc004240 tx=0x7f5bcc00d5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:11.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.755+0000 7f5bd995e640 1 -- 172.21.15.19:0/2789447663 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc018070 con 0x5605c332e350 2024-09-12T02:05:11.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.755+0000 7f5bd995e640 1 -- 172.21.15.19:0/2789447663 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bcc0030d0 con 0x5605c332e350 2024-09-12T02:05:11.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.755+0000 7f5bdf11bf40 1 -- 172.21.15.19:0/2789447663 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605c3491ff0 con 0x5605c332e350 2024-09-12T02:05:11.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.755+0000 7f5bd995e640 1 -- 172.21.15.19:0/2789447663 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc001590 con 0x5605c332e350 2024-09-12T02:05:11.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.755+0000 7f5bdf11bf40 1 -- 172.21.15.19:0/2789447663 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605c3494e60 con 0x5605c332e350 2024-09-12T02:05:11.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.756+0000 7f5bd995e640 1 -- 172.21.15.19:0/2789447663 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5bcc01b070 con 0x5605c332e350 2024-09-12T02:05:11.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.756+0000 7f5bd995e640 1 --2- 172.21.15.19:0/2789447663 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5bc806a810 0x7f5bc806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.756+0000 7f5bd995e640 1 -- 172.21.15.19:0/2789447663 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 8539+0+0 (secure 0 0 0) 0x7f5bcc089bb0 con 0x5605c332e350 2024-09-12T02:05:11.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.757+0000 7f5bdf11bf40 1 --2- 172.21.15.19:0/2789447663 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5605c3404840 0x5605c349dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.757+0000 7f5bdb962640 1 --2- 172.21.15.19:0/2789447663 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5bc806a810 0x7f5bc806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.757+0000 7f5bdf11bf40 1 -- 172.21.15.19:0/2789447663 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:1 13.d 13:b50e409b:::mds_snaptable:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5605c33e2ff0 con 0x5605c3404840 2024-09-12T02:05:11.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.757+0000 7f5bdc964640 1 --2- 172.21.15.19:0/2789447663 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5605c3404840 0x5605c349dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.757+0000 7f5bdb962640 1 --2- 172.21.15.19:0/2789447663 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5bc806a810 0x7f5bc806ccd0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0014000 tx=0x7f5bd000f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:11.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.757+0000 7f5bdc964640 1 --2- 172.21.15.19:0/2789447663 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5605c3404840 0x5605c349dcc0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:11.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.758+0000 7f5bdc964640 1 -- 172.21.15.19:0/2789447663 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(1 mds_snaptable [truncate 0] v121'137 uv137 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5bd405c040 con 0x5605c3404840 2024-09-12T02:05:11.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.758+0000 7f5bdf11bf40 1 -- 172.21.15.19:0/2789447663 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5605c3404840 msgr2=0x5605c349dcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.758+0000 7f5bdf11bf40 1 --2- 172.21.15.19:0/2789447663 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5605c3404840 0x5605c349dcc0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.758+0000 7f5bdf11bf40 1 -- 172.21.15.19:0/2789447663 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5bc806a810 msgr2=0x7f5bc806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.758+0000 7f5bdf11bf40 1 --2- 172.21.15.19:0/2789447663 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5bc806a810 0x7f5bc806ccd0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0014000 tx=0x7f5bd000f000 comp rx=0 tx=0).stop 2024-09-12T02:05:11.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.759+0000 7f5bdf11bf40 1 -- 172.21.15.19:0/2789447663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c332e350 msgr2=0x5605c3404300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.759+0000 7f5bdf11bf40 1 --2- 172.21.15.19:0/2789447663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605c332e350 0x5605c3404300 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc004240 tx=0x7f5bcc00d5f0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.759+0000 7f5bdc964640 1 -- 172.21.15.19:0/2789447663 reap_dead start 2024-09-12T02:05:11.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.759+0000 7f5bdf11bf40 1 -- 172.21.15.19:0/2789447663 shutdown_connections 2024-09-12T02:05:11.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.759+0000 7f5bdf11bf40 1 -- 172.21.15.19:0/2789447663 >> 172.21.15.19:0/2789447663 conn(0x5605c332b9e0 msgr2=0x5605c3405d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:11.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.759+0000 7f5bdf11bf40 1 -- 172.21.15.19:0/2789447663 shutdown_connections 2024-09-12T02:05:11.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.759+0000 7f5bdf11bf40 1 -- 172.21.15.19:0/2789447663 wait complete. 2024-09-12T02:05:11.762 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:05:11.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.868+0000 7f2817bfd640 1 Processor -- start 2024-09-12T02:05:11.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.868+0000 7f2817bfd640 1 -- start start 2024-09-12T02:05:11.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.869+0000 7f2817bfd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2810161a20 0x7f28100d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.869+0000 7f2817bfd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28100d1420 0x7f28100cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.869+0000 7f2817bfd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28100cf160 0x7f28100b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.869+0000 7f2817bfd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2810161e00 con 0x7f28100cf160 2024-09-12T02:05:11.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.869+0000 7f2817bfd640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f28100d1830 con 0x7f2810161a20 2024-09-12T02:05:11.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.869+0000 7f2817bfd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f28100cf980 con 0x7f28100d1420 2024-09-12T02:05:11.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.869+0000 7f281619a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28100cf160 0x7f28100b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.869+0000 7f281619a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28100cf160 0x7f28100b5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38286/0 (socket says 172.21.15.19:38286) 2024-09-12T02:05:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.869+0000 7f281619a640 1 -- 172.21.15.19:0/2809569542 learned_addr learned my addr 172.21.15.19:0/2809569542 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.869+0000 7f2815999640 1 --2- 172.21.15.19:0/2809569542 >> v2:172.21.15.135:3300/0 conn(0x7f2810161a20 0x7f28100d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.869+0000 7f2815198640 1 --2- 172.21.15.19:0/2809569542 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28100d1420 0x7f28100cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.869+0000 7f281619a640 1 -- 172.21.15.19:0/2809569542 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28100d1420 msgr2=0x7f28100cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.869+0000 7f281619a640 1 --2- 172.21.15.19:0/2809569542 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28100d1420 0x7f28100cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.869+0000 7f281619a640 1 -- 172.21.15.19:0/2809569542 >> v2:172.21.15.135:3300/0 conn(0x7f2810161a20 msgr2=0x7f28100d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.869+0000 7f281619a640 1 --2- 172.21.15.19:0/2809569542 >> v2:172.21.15.135:3300/0 conn(0x7f2810161a20 0x7f28100d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.869+0000 7f281619a640 1 -- 172.21.15.19:0/2809569542 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f281006d050 con 0x7f28100cf160 2024-09-12T02:05:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.869+0000 7f2815999640 1 --2- 172.21.15.19:0/2809569542 >> v2:172.21.15.135:3300/0 conn(0x7f2810161a20 0x7f28100d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:11.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.870+0000 7f281619a640 1 --2- 172.21.15.19:0/2809569542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28100cf160 0x7f28100b5f50 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f281008c910 tx=0x7f280802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cf363974a7e3e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:11.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.870+0000 7f2814997640 1 -- 172.21.15.19:0/2809569542 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2808036070 con 0x7f28100cf160 2024-09-12T02:05:11.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.870+0000 7f2814997640 1 -- 172.21.15.19:0/2809569542 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2808031600 con 0x7f28100cf160 2024-09-12T02:05:11.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.870+0000 7f2814997640 1 -- 172.21.15.19:0/2809569542 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28080319d0 con 0x7f28100cf160 2024-09-12T02:05:11.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.871+0000 7f2817bfd640 1 -- 172.21.15.19:0/2809569542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28100cf160 msgr2=0x7f28100b5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.871+0000 7f2817bfd640 1 --2- 172.21.15.19:0/2809569542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28100cf160 0x7f28100b5f50 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f281008c910 tx=0x7f280802a6a0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.871+0000 7f2817bfd640 1 -- 172.21.15.19:0/2809569542 shutdown_connections 2024-09-12T02:05:11.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.871+0000 7f2817bfd640 1 --2- 172.21.15.19:0/2809569542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28100cf160 0x7f28100b5f50 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.871+0000 7f2817bfd640 1 --2- 172.21.15.19:0/2809569542 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28100d1420 0x7f28100cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.871+0000 7f2817bfd640 1 --2- 172.21.15.19:0/2809569542 >> v2:172.21.15.135:3300/0 conn(0x7f2810161a20 0x7f28100d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.871+0000 7f2817bfd640 1 -- 172.21.15.19:0/2809569542 >> 172.21.15.19:0/2809569542 conn(0x7f281009d850 msgr2=0x7f281008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:11.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.871+0000 7f2817bfd640 1 -- 172.21.15.19:0/2809569542 shutdown_connections 2024-09-12T02:05:11.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.871+0000 7f2817bfd640 1 -- 172.21.15.19:0/2809569542 wait complete. 2024-09-12T02:05:11.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.872+0000 7f2817bfd640 1 Processor -- start 2024-09-12T02:05:11.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.872+0000 7f2817bfd640 1 -- start start 2024-09-12T02:05:11.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f2817bfd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28100cf160 0x7f28101f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f2817bfd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28100d1420 0x7f28100c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f2817bfd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2810161a20 0x7f28100cd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f2817bfd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f281006d2f0 con 0x7f28100d1420 2024-09-12T02:05:11.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f2817bfd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f28100cff00 con 0x7f28100cf160 2024-09-12T02:05:11.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f2817bfd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f28100b1040 con 0x7f2810161a20 2024-09-12T02:05:11.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f2815198640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28100d1420 0x7f28100c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f2815198640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28100d1420 0x7f28100c9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38292/0 (socket says 172.21.15.19:38292) 2024-09-12T02:05:11.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f2815198640 1 -- 172.21.15.19:0/4273150263 learned_addr learned my addr 172.21.15.19:0/4273150263 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:11.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f2815198640 1 -- 172.21.15.19:0/4273150263 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2810161a20 msgr2=0x7f28100cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f2815198640 1 --2- 172.21.15.19:0/4273150263 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2810161a20 0x7f28100cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f2815198640 1 -- 172.21.15.19:0/4273150263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28100cf160 msgr2=0x7f28101f3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f2815999640 1 --2- 172.21.15.19:0/4273150263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28100cf160 0x7f28101f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f2815198640 1 --2- 172.21.15.19:0/4273150263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28100cf160 0x7f28101f3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f2815198640 1 -- 172.21.15.19:0/4273150263 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28100ca730 con 0x7f28100d1420 2024-09-12T02:05:11.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f2815999640 1 --2- 172.21.15.19:0/4273150263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28100cf160 0x7f28101f3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:11.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f2815198640 1 --2- 172.21.15.19:0/4273150263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28100d1420 0x7f28100c9e00 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f280000c7f0 tx=0x7f280000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:11.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f28067fc640 1 -- 172.21.15.19:0/4273150263 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2800015070 con 0x7f28100d1420 2024-09-12T02:05:11.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f28067fc640 1 -- 172.21.15.19:0/4273150263 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2800004240 con 0x7f28100d1420 2024-09-12T02:05:11.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f28067fc640 1 -- 172.21.15.19:0/4273150263 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2800007620 con 0x7f28100d1420 2024-09-12T02:05:11.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.873+0000 7f2817bfd640 1 -- 172.21.15.19:0/4273150263 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28100caa10 con 0x7f28100d1420 2024-09-12T02:05:11.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.874+0000 7f2817bfd640 1 -- 172.21.15.19:0/4273150263 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28100cafd0 con 0x7f28100d1420 2024-09-12T02:05:11.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.875+0000 7f2817bfd640 1 -- 172.21.15.19:0/4273150263 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28100cf5f0 con 0x7f28100d1420 2024-09-12T02:05:11.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.875+0000 7f28067fc640 1 -- 172.21.15.19:0/4273150263 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28000079d0 con 0x7f28100d1420 2024-09-12T02:05:11.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.876+0000 7f28067fc640 1 --2- 172.21.15.19:0/4273150263 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f27f406be30 0x7f27f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:11.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.876+0000 7f28067fc640 1 -- 172.21.15.19:0/4273150263 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 8539+0+0 (secure 0 0 0) 0x7f280008bac0 con 0x7f28100d1420 2024-09-12T02:05:11.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.876+0000 7f2815999640 1 --2- 172.21.15.19:0/4273150263 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f27f406be30 0x7f27f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:11.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.877+0000 7f2815999640 1 --2- 172.21.15.19:0/4273150263 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f27f406be30 0x7f27f406e2f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f280c006fd0 tx=0x7f280c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:11.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:11.880+0000 7f28067fc640 1 -- 172.21.15.19:0/4273150263 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2800059910 con 0x7f28100d1420 2024-09-12T02:05:12.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.094+0000 7f2817bfd640 1 -- 172.21.15.19:0/4273150263 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f28100d3ed0 con 0x7f28100d1420 2024-09-12T02:05:12.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.779+0000 7f28067fc640 1 -- 172.21.15.19:0/4273150263 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v238) ==== 162+0+0 (secure 0 0 0) 0x7f2800059210 con 0x7f28100d1420 2024-09-12T02:05:12.779 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:05:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.782+0000 7f2817bfd640 1 -- 172.21.15.19:0/4273150263 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f27f406be30 msgr2=0x7f27f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.782+0000 7f2817bfd640 1 --2- 172.21.15.19:0/4273150263 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f27f406be30 0x7f27f406e2f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f280c006fd0 tx=0x7f280c008040 comp rx=0 tx=0).stop 2024-09-12T02:05:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.782+0000 7f2817bfd640 1 -- 172.21.15.19:0/4273150263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28100d1420 msgr2=0x7f28100c9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.782+0000 7f2817bfd640 1 --2- 172.21.15.19:0/4273150263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28100d1420 0x7f28100c9e00 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f280000c7f0 tx=0x7f280000ccb0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.782+0000 7f2817bfd640 1 -- 172.21.15.19:0/4273150263 shutdown_connections 2024-09-12T02:05:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.782+0000 7f2817bfd640 1 --2- 172.21.15.19:0/4273150263 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f27f406be30 0x7f27f406e2f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.782+0000 7f2817bfd640 1 --2- 172.21.15.19:0/4273150263 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2810161a20 0x7f28100cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.782+0000 7f2817bfd640 1 --2- 172.21.15.19:0/4273150263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28100d1420 0x7f28100c9e00 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.782+0000 7f2817bfd640 1 --2- 172.21.15.19:0/4273150263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28100cf160 0x7f28101f3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.782+0000 7f2817bfd640 1 -- 172.21.15.19:0/4273150263 >> 172.21.15.19:0/4273150263 conn(0x7f281009d850 msgr2=0x7f281015d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.782+0000 7f2817bfd640 1 -- 172.21.15.19:0/4273150263 shutdown_connections 2024-09-12T02:05:12.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.782+0000 7f2817bfd640 1 -- 172.21.15.19:0/4273150263 wait complete. 2024-09-12T02:05:12.790 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:05:12.791+0000 7f356185b640 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds_snaptable': End of buffer [buffer:2] 2024-09-12T02:05:12.791 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:05:12.792+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:05:12.791 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:05:12.792+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:05:12.797 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:12.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.906+0000 7f863e186640 1 Processor -- start 2024-09-12T02:05:12.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.906+0000 7f863e186640 1 -- start start 2024-09-12T02:05:12.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.907+0000 7f863e186640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8638147360 0x7f8638070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:12.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.907+0000 7f863e186640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8638070dd0 0x7f86380d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:12.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.907+0000 7f863e186640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f863806cb30 con 0x7f86380d09e0 2024-09-12T02:05:12.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.907+0000 7f863e186640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f863806bfb0 con 0x7f8638147360 2024-09-12T02:05:12.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.907+0000 7f863e186640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f863806c290 con 0x7f8638070dd0 2024-09-12T02:05:12.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.907+0000 7f86377fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8638147360 0x7f8638070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:12.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.907+0000 7f8637fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f86380d09e0 0x7f863806f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53326/0 (socket says 172.21.15.19:53326) 2024-09-12T02:05:12.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.907+0000 7f8637fff640 1 -- 172.21.15.19:0/4090624339 learned_addr learned my addr 172.21.15.19:0/4090624339 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:12.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.907+0000 7f86377fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8638147360 0x7f8638070890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38306/0 (socket says 172.21.15.19:38306) 2024-09-12T02:05:12.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.907+0000 7f8636ffd640 1 --2- 172.21.15.19:0/4090624339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8638070dd0 0x7f86380d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:12.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.907+0000 7f86377fe640 1 -- 172.21.15.19:0/4090624339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8638070dd0 msgr2=0x7f86380d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:12.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.907+0000 7f86377fe640 1 --2- 172.21.15.19:0/4090624339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8638070dd0 0x7f86380d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.907+0000 7f86377fe640 1 -- 172.21.15.19:0/4090624339 >> v1:172.21.15.19:6789/0 conn(0x7f86380d09e0 legacy=0x7f863806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:12.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.907+0000 7f86367fc640 1 -- 172.21.15.19:0/4090624339 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1188678531 0 0) 0x7f863806cb30 con 0x7f86380d09e0 2024-09-12T02:05:12.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.907+0000 7f86377fe640 1 -- 172.21.15.19:0/4090624339 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863806c570 con 0x7f8638147360 2024-09-12T02:05:12.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.908+0000 7f86377fe640 1 --2- 172.21.15.19:0/4090624339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8638147360 0x7f8638070890 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f86280097a0 tx=0x7f862802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740c785e6d34e619 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:12.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.908+0000 7f86367fc640 1 -- 172.21.15.19:0/4090624339 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8628037070 con 0x7f8638147360 2024-09-12T02:05:12.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.908+0000 7f86367fc640 1 -- 172.21.15.19:0/4090624339 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f862802ae50 con 0x7f8638147360 2024-09-12T02:05:12.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.908+0000 7f86367fc640 1 -- 172.21.15.19:0/4090624339 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8628032660 con 0x7f8638147360 2024-09-12T02:05:12.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.909+0000 7f863e186640 1 -- 172.21.15.19:0/4090624339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8638147360 msgr2=0x7f8638070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:12.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.909+0000 7f863e186640 1 --2- 172.21.15.19:0/4090624339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8638147360 0x7f8638070890 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f86280097a0 tx=0x7f862802a100 comp rx=0 tx=0).stop 2024-09-12T02:05:12.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.909+0000 7f863e186640 1 -- 172.21.15.19:0/4090624339 shutdown_connections 2024-09-12T02:05:12.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.909+0000 7f863e186640 1 --2- 172.21.15.19:0/4090624339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8638070dd0 0x7f86380d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.909+0000 7f863e186640 1 --2- 172.21.15.19:0/4090624339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8638147360 0x7f8638070890 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.909+0000 7f863e186640 1 -- 172.21.15.19:0/4090624339 >> 172.21.15.19:0/4090624339 conn(0x7f86380b2f40 msgr2=0x7f86380b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:12.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.909+0000 7f863e186640 1 -- 172.21.15.19:0/4090624339 shutdown_connections 2024-09-12T02:05:12.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.909+0000 7f863e186640 1 -- 172.21.15.19:0/4090624339 wait complete. 2024-09-12T02:05:12.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.910+0000 7f863e186640 1 Processor -- start 2024-09-12T02:05:12.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.910+0000 7f863e186640 1 -- start start 2024-09-12T02:05:12.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.911+0000 7f863e186640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8638070dd0 0x7f86380b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:12.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.911+0000 7f863e186640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86380d09e0 0x7f86381f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:12.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.911+0000 7f863e186640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8638147360 0x7f86381617a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:12.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.911+0000 7f863e186640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f863806bc10 con 0x7f8638147360 2024-09-12T02:05:12.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.911+0000 7f863e186640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f86380d0e10 con 0x7f86380d09e0 2024-09-12T02:05:12.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.911+0000 7f863e186640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f863806bd90 con 0x7f8638070dd0 2024-09-12T02:05:12.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.911+0000 7f8637fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8638147360 0x7f86381617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:12.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.911+0000 7f8637fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8638147360 0x7f86381617a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38322/0 (socket says 172.21.15.19:38322) 2024-09-12T02:05:12.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.911+0000 7f8637fff640 1 -- 172.21.15.19:0/2682082185 learned_addr learned my addr 172.21.15.19:0/2682082185 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:12.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.911+0000 7f86377fe640 1 --2- 172.21.15.19:0/2682082185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8638070dd0 0x7f86380b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:12.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.911+0000 7f8636ffd640 1 --2- 172.21.15.19:0/2682082185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86380d09e0 0x7f86381f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:12.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.911+0000 7f8637fff640 1 -- 172.21.15.19:0/2682082185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8638070dd0 msgr2=0x7f86380b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:12.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.911+0000 7f8637fff640 1 --2- 172.21.15.19:0/2682082185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8638070dd0 0x7f86380b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.911+0000 7f8637fff640 1 -- 172.21.15.19:0/2682082185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86380d09e0 msgr2=0x7f86381f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:12.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.911+0000 7f8637fff640 1 --2- 172.21.15.19:0/2682082185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86380d09e0 0x7f86381f4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.911+0000 7f8637fff640 1 -- 172.21.15.19:0/2682082185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863813afd0 con 0x7f8638147360 2024-09-12T02:05:12.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.912+0000 7f8637fff640 1 --2- 172.21.15.19:0/2682082185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8638147360 0x7f86381617a0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f863000c7a0 tx=0x7f863000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:12.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.912+0000 7f861ffff640 1 -- 172.21.15.19:0/2682082185 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8630018070 con 0x7f8638147360 2024-09-12T02:05:12.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.912+0000 7f861ffff640 1 -- 172.21.15.19:0/2682082185 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f863000a640 con 0x7f8638147360 2024-09-12T02:05:12.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.912+0000 7f863e186640 1 -- 172.21.15.19:0/2682082185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86380b4a20 con 0x7f8638147360 2024-09-12T02:05:12.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.912+0000 7f861ffff640 1 -- 172.21.15.19:0/2682082185 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863000aab0 con 0x7f8638147360 2024-09-12T02:05:12.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.912+0000 7f863e186640 1 -- 172.21.15.19:0/2682082185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86380b4fe0 con 0x7f8638147360 2024-09-12T02:05:12.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.913+0000 7f863e186640 1 -- 172.21.15.19:0/2682082185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86380d04a0 con 0x7f8638147360 2024-09-12T02:05:12.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.913+0000 7f861ffff640 1 -- 172.21.15.19:0/2682082185 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f863001b070 con 0x7f8638147360 2024-09-12T02:05:12.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.914+0000 7f861ffff640 1 --2- 172.21.15.19:0/2682082185 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f862406be30 0x7f862406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:12.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.914+0000 7f861ffff640 1 -- 172.21.15.19:0/2682082185 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8625+0+0 (secure 0 0 0) 0x7f863008afc0 con 0x7f8638147360 2024-09-12T02:05:12.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.914+0000 7f86377fe640 1 --2- 172.21.15.19:0/2682082185 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f862406be30 0x7f862406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:12.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.915+0000 7f86377fe640 1 --2- 172.21.15.19:0/2682082185 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f862406be30 0x7f862406e2f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8628034000 tx=0x7f862802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:12.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:12.919+0000 7f861ffff640 1 -- 172.21.15.19:0/2682082185 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f863813afd0 con 0x7f8638147360 2024-09-12T02:05:13.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.134+0000 7f863e186640 1 -- 172.21.15.19:0/2682082185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86380701f0 con 0x7f8638147360 2024-09-12T02:05:13.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.134+0000 7f861ffff640 1 -- 172.21.15.19:0/2682082185 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 240 v240) ==== 95+0+4392 (secure 0 0 0) 0x7f8630058760 con 0x7f8638147360 2024-09-12T02:05:13.134 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:13.134 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":240,"btime":"2024-09-12T02:05:12:792196+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8437,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3997032797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3997032797},{"type":"v1","addr":"172.21.15.135:6837","nonce":3997032797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":237}],"filesystems":[{"mdsmap":{"epoch":240,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:12.792138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":122,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:13.134 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 240 2024-09-12T02:05:13.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.137+0000 7f863e186640 1 -- 172.21.15.19:0/2682082185 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f862406be30 msgr2=0x7f862406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:13.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.137+0000 7f863e186640 1 --2- 172.21.15.19:0/2682082185 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f862406be30 0x7f862406e2f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8628034000 tx=0x7f862802e000 comp rx=0 tx=0).stop 2024-09-12T02:05:13.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.137+0000 7f863e186640 1 -- 172.21.15.19:0/2682082185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8638147360 msgr2=0x7f86381617a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:13.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.137+0000 7f863e186640 1 --2- 172.21.15.19:0/2682082185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8638147360 0x7f86381617a0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f863000c7a0 tx=0x7f863000cc60 comp rx=0 tx=0).stop 2024-09-12T02:05:13.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.137+0000 7f863e186640 1 -- 172.21.15.19:0/2682082185 shutdown_connections 2024-09-12T02:05:13.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.137+0000 7f863e186640 1 --2- 172.21.15.19:0/2682082185 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f862406be30 0x7f862406e2f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.137+0000 7f863e186640 1 --2- 172.21.15.19:0/2682082185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8638147360 0x7f86381617a0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.137+0000 7f863e186640 1 --2- 172.21.15.19:0/2682082185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86380d09e0 0x7f86381f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.137+0000 7f863e186640 1 --2- 172.21.15.19:0/2682082185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8638070dd0 0x7f86380b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.137+0000 7f863e186640 1 -- 172.21.15.19:0/2682082185 >> 172.21.15.19:0/2682082185 conn(0x7f86380b2f40 msgr2=0x7f86380b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:13.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.137+0000 7f863e186640 1 -- 172.21.15.19:0/2682082185 shutdown_connections 2024-09-12T02:05:13.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.137+0000 7f863e186640 1 -- 172.21.15.19:0/2682082185 wait complete. 2024-09-12T02:05:13.147 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:05:13.148 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:13.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.251+0000 7fe9c60a6640 1 Processor -- start 2024-09-12T02:05:13.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.251+0000 7fe9c60a6640 1 -- start start 2024-09-12T02:05:13.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.252+0000 7fe9c60a6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe9c0165260 0x7fe9c0167650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:13.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.252+0000 7fe9c60a6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c00d01c0 con 0x7fe9c015c490 2024-09-12T02:05:13.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.252+0000 7fe9c60a6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c00d04a0 con 0x7fe9c015c870 2024-09-12T02:05:13.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.252+0000 7fe9c60a6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fe9c00cff70 con 0x7fe9c0165260 2024-09-12T02:05:13.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.252+0000 7fe9bffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe9c0165260 0x7fe9c0167650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:13.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.252+0000 7fe9bffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe9c0165260 0x7fe9c0167650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38334/0 (socket says 172.21.15.19:38334) 2024-09-12T02:05:13.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.252+0000 7fe9bf7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe9c015c490 0x7fe9c009b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53340/0 (socket says 172.21.15.19:53340) 2024-09-12T02:05:13.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.252+0000 7fe9bffff640 1 -- 172.21.15.19:0/1826490270 learned_addr learned my addr 172.21.15.19:0/1826490270 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.253+0000 7fe9bffff640 1 -- 172.21.15.19:0/1826490270 >> v1:172.21.15.135:6789/0 conn(0x7fe9c015c870 legacy=0x7fe9c015cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.253+0000 7fe9bffff640 1 -- 172.21.15.19:0/1826490270 >> v1:172.21.15.19:6789/0 conn(0x7fe9c015c490 legacy=0x7fe9c009b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.253+0000 7fe9bffff640 1 -- 172.21.15.19:0/1826490270 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c00d0780 con 0x7fe9c0165260 2024-09-12T02:05:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.253+0000 7fe9beffd640 1 -- 172.21.15.19:0/1826490270 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158497128 0 0) 0x7fe9c00d01c0 con 0x7fe9c015c490 2024-09-12T02:05:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.253+0000 7fe9bffff640 1 --2- 172.21.15.19:0/1826490270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9c0165260 0x7fe9c0167650 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009e50 tx=0x7fe9b802a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9517192c6a9170d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.254+0000 7fe9beffd640 1 -- 172.21.15.19:0/1826490270 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8037070 con 0x7fe9c0165260 2024-09-12T02:05:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.254+0000 7fe9beffd640 1 -- 172.21.15.19:0/1826490270 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b8032630 con 0x7fe9c0165260 2024-09-12T02:05:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.254+0000 7fe9beffd640 1 -- 172.21.15.19:0/1826490270 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b802e050 con 0x7fe9c0165260 2024-09-12T02:05:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.254+0000 7fe9c60a6640 1 -- 172.21.15.19:0/1826490270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9c0165260 msgr2=0x7fe9c0167650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.254+0000 7fe9c60a6640 1 --2- 172.21.15.19:0/1826490270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9c0165260 0x7fe9c0167650 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009e50 tx=0x7fe9b802a840 comp rx=0 tx=0).stop 2024-09-12T02:05:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.254+0000 7fe9c60a6640 1 -- 172.21.15.19:0/1826490270 shutdown_connections 2024-09-12T02:05:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.254+0000 7fe9c60a6640 1 --2- 172.21.15.19:0/1826490270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9c0165260 0x7fe9c0167650 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.254+0000 7fe9c60a6640 1 -- 172.21.15.19:0/1826490270 >> 172.21.15.19:0/1826490270 conn(0x7fe9c00d23a0 msgr2=0x7fe9c00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:13.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.254+0000 7fe9c60a6640 1 -- 172.21.15.19:0/1826490270 shutdown_connections 2024-09-12T02:05:13.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.254+0000 7fe9c60a6640 1 -- 172.21.15.19:0/1826490270 wait complete. 2024-09-12T02:05:13.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.255+0000 7fe9c60a6640 1 Processor -- start 2024-09-12T02:05:13.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.255+0000 7fe9c60a6640 1 -- start start 2024-09-12T02:05:13.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.256+0000 7fe9c60a6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c015c490 0x7fe9c0153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:13.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.256+0000 7fe9c60a6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9c015c870 0x7fe9c0156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:13.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.256+0000 7fe9c60a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9c0165260 0x7fe9c0156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:13.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.256+0000 7fe9c60a6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c00cdfa0 con 0x7fe9c0165260 2024-09-12T02:05:13.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.256+0000 7fe9c60a6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c00d0dd0 con 0x7fe9c015c490 2024-09-12T02:05:13.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.256+0000 7fe9c60a6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c00d1260 con 0x7fe9c015c870 2024-09-12T02:05:13.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.256+0000 7fe9bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9c0165260 0x7fe9c0156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:13.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.256+0000 7fe9bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9c0165260 0x7fe9c0156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38346/0 (socket says 172.21.15.19:38346) 2024-09-12T02:05:13.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.256+0000 7fe9bffff640 1 -- 172.21.15.19:0/3565265193 learned_addr learned my addr 172.21.15.19:0/3565265193 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:13.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.256+0000 7fe9bf7fe640 1 --2- 172.21.15.19:0/3565265193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c015c490 0x7fe9c0153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:13.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.256+0000 7fe9b7fff640 1 --2- 172.21.15.19:0/3565265193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9c015c870 0x7fe9c0156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:13.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.257+0000 7fe9bffff640 1 -- 172.21.15.19:0/3565265193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9c015c870 msgr2=0x7fe9c0156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:13.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.257+0000 7fe9bffff640 1 --2- 172.21.15.19:0/3565265193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9c015c870 0x7fe9c0156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.257+0000 7fe9bffff640 1 -- 172.21.15.19:0/3565265193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c015c490 msgr2=0x7fe9c0153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:13.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.257+0000 7fe9bffff640 1 --2- 172.21.15.19:0/3565265193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c015c490 0x7fe9c0153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.257+0000 7fe9bffff640 1 -- 172.21.15.19:0/3565265193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c0155870 con 0x7fe9c0165260 2024-09-12T02:05:13.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.257+0000 7fe9bffff640 1 --2- 172.21.15.19:0/3565265193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9c0165260 0x7fe9c0156640 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009e50 tx=0x7fe9b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:13.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.257+0000 7fe9bcff9640 1 -- 172.21.15.19:0/3565265193 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8037050 con 0x7fe9c0165260 2024-09-12T02:05:13.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.257+0000 7fe9bcff9640 1 -- 172.21.15.19:0/3565265193 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b8043070 con 0x7fe9c0165260 2024-09-12T02:05:13.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.257+0000 7fe9bcff9640 1 -- 172.21.15.19:0/3565265193 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8009510 con 0x7fe9c0165260 2024-09-12T02:05:13.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.257+0000 7fe9c60a6640 1 -- 172.21.15.19:0/3565265193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c01545c0 con 0x7fe9c0165260 2024-09-12T02:05:13.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.257+0000 7fe9c60a6640 1 -- 172.21.15.19:0/3565265193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c01540b0 con 0x7fe9c0165260 2024-09-12T02:05:13.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.258+0000 7fe9c60a6640 1 -- 172.21.15.19:0/3565265193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c015cce0 con 0x7fe9c0165260 2024-09-12T02:05:13.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.259+0000 7fe9bcff9640 1 -- 172.21.15.19:0/3565265193 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe9b8007bf0 con 0x7fe9c0165260 2024-09-12T02:05:13.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.259+0000 7fe9bcff9640 1 --2- 172.21.15.19:0/3565265193 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe9a006be30 0x7fe9a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:13.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.259+0000 7fe9bcff9640 1 -- 172.21.15.19:0/3565265193 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8625+0+0 (secure 0 0 0) 0x7fe9b80ac4a0 con 0x7fe9c0165260 2024-09-12T02:05:13.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.259+0000 7fe9bf7fe640 1 --2- 172.21.15.19:0/3565265193 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe9a006be30 0x7fe9a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:13.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.260+0000 7fe9bf7fe640 1 --2- 172.21.15.19:0/3565265193 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe9a006be30 0x7fe9a006e2f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0007f70 tx=0x7fe9b0007f00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:13.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.264+0000 7fe9bcff9640 1 -- 172.21.15.19:0/3565265193 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9b8079df0 con 0x7fe9c0165260 2024-09-12T02:05:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.474+0000 7fe9c60a6640 1 -- 172.21.15.19:0/3565265193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9c00d3190 con 0x7fe9c0165260 2024-09-12T02:05:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.475+0000 7fe9bcff9640 1 -- 172.21.15.19:0/3565265193 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 240 v240) ==== 95+0+4392 (secure 0 0 0) 0x7fe9b807e0f0 con 0x7fe9c0165260 2024-09-12T02:05:13.475 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:13.475 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":240,"btime":"2024-09-12T02:05:12:792196+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8437,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3997032797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3997032797},{"type":"v1","addr":"172.21.15.135:6837","nonce":3997032797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":237}],"filesystems":[{"mdsmap":{"epoch":240,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:12.792138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":122,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 240 2024-09-12T02:05:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.477+0000 7fe9c60a6640 1 -- 172.21.15.19:0/3565265193 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe9a006be30 msgr2=0x7fe9a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.477+0000 7fe9c60a6640 1 --2- 172.21.15.19:0/3565265193 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe9a006be30 0x7fe9a006e2f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0007f70 tx=0x7fe9b0007f00 comp rx=0 tx=0).stop 2024-09-12T02:05:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.477+0000 7fe9c60a6640 1 -- 172.21.15.19:0/3565265193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9c0165260 msgr2=0x7fe9c0156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.477+0000 7fe9c60a6640 1 --2- 172.21.15.19:0/3565265193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9c0165260 0x7fe9c0156640 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009e50 tx=0x7fe9b8004a40 comp rx=0 tx=0).stop 2024-09-12T02:05:13.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.477+0000 7fe9c60a6640 1 -- 172.21.15.19:0/3565265193 shutdown_connections 2024-09-12T02:05:13.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.477+0000 7fe9c60a6640 1 --2- 172.21.15.19:0/3565265193 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe9a006be30 0x7fe9a006e2f0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.477+0000 7fe9c60a6640 1 --2- 172.21.15.19:0/3565265193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9c0165260 0x7fe9c0156640 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.477+0000 7fe9c60a6640 1 --2- 172.21.15.19:0/3565265193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9c015c870 0x7fe9c0156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.477+0000 7fe9c60a6640 1 --2- 172.21.15.19:0/3565265193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c015c490 0x7fe9c0153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.477+0000 7fe9c60a6640 1 -- 172.21.15.19:0/3565265193 >> 172.21.15.19:0/3565265193 conn(0x7fe9c00d23a0 msgr2=0x7fe9c00cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:13.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.477+0000 7fe9c60a6640 1 -- 172.21.15.19:0/3565265193 shutdown_connections 2024-09-12T02:05:13.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.477+0000 7fe9c60a6640 1 -- 172.21.15.19:0/3565265193 wait complete. 2024-09-12T02:05:13.488 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:05:13.488 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:13.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.592+0000 7f41397d6640 1 Processor -- start 2024-09-12T02:05:13.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.592+0000 7f41397d6640 1 -- start start 2024-09-12T02:05:13.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.592+0000 7f41397d6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41340cfcc0 0x7f413406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:13.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.592+0000 7f41397d6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41340d2700 con 0x7f413415e760 2024-09-12T02:05:13.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.592+0000 7f41397d6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41340cedb0 con 0x7f41340d4fd0 2024-09-12T02:05:13.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.592+0000 7f41397d6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f41340cf090 con 0x7f41340cfcc0 2024-09-12T02:05:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f4132ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f413415e760 0x7f41340cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53342/0 (socket says 172.21.15.19:53342) 2024-09-12T02:05:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f4132ffd640 1 -- 172.21.15.19:0/1362791255 learned_addr learned my addr 172.21.15.19:0/1362791255 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f41327fc640 1 --2- 172.21.15.19:0/1362791255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41340cfcc0 0x7f413406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f4131ffb640 1 -- 172.21.15.19:0/1362791255 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3722790898 0 0) 0x7f4124001110 con 0x7f413415e760 2024-09-12T02:05:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f4131ffb640 1 -- 172.21.15.19:0/1362791255 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f411c003520 con 0x7f413415e760 2024-09-12T02:05:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f4131ffb640 1 -- 172.21.15.19:0/1362791255 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3505895522 0 0) 0x7f411c003520 con 0x7f413415e760 2024-09-12T02:05:13.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f4131ffb640 1 -- 172.21.15.19:0/1362791255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41340cfcc0 msgr2=0x7f413406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:13.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f4131ffb640 1 --2- 172.21.15.19:0/1362791255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41340cfcc0 0x7f413406cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f4131ffb640 1 -- 172.21.15.19:0/1362791255 >> v1:172.21.15.135:6789/0 conn(0x7f41340d4fd0 legacy=0x7f41340d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:13.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f4131ffb640 1 -- 172.21.15.19:0/1362791255 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41340b3c80 con 0x7f413415e760 2024-09-12T02:05:13.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f4131ffb640 1 -- 172.21.15.19:0/1362791255 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f4124001840 con 0x7f413415e760 2024-09-12T02:05:13.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f4131ffb640 1 -- 172.21.15.19:0/1362791255 >> v1:172.21.15.19:6789/0 conn(0x7f413415e760 legacy=0x7f41340cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:13.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f4131ffb640 1 --2- 172.21.15.19:0/1362791255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f411c0039e0 0x7f411c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:13.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f4131ffb640 1 --2- 172.21.15.19:0/1362791255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41340cfcc0 0x7f411c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:13.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f4131ffb640 1 --2- 172.21.15.19:0/1362791255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f411c004d40 0x7f411c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:13.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f4131ffb640 1 -- 172.21.15.19:0/1362791255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f41340cf090 con 0x7f411c0039e0 2024-09-12T02:05:13.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f4131ffb640 1 -- 172.21.15.19:0/1362791255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f411c00baa0 con 0x7f411c004d40 2024-09-12T02:05:13.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f4131ffb640 1 -- 172.21.15.19:0/1362791255 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f411c00bca0 con 0x7f41340cfcc0 2024-09-12T02:05:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f4132ffd640 1 --2- 172.21.15.19:0/1362791255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f411c0039e0 0x7f411c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f41337fe640 1 --2- 172.21.15.19:0/1362791255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f411c004d40 0x7f411c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.593+0000 7f41327fc640 1 --2- 172.21.15.19:0/1362791255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41340cfcc0 0x7f411c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.594+0000 7f4132ffd640 1 -- 172.21.15.19:0/1362791255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41340cfcc0 msgr2=0x7f411c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.594+0000 7f4132ffd640 1 --2- 172.21.15.19:0/1362791255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41340cfcc0 0x7f411c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.594+0000 7f4132ffd640 1 -- 172.21.15.19:0/1362791255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f411c004d40 msgr2=0x7f411c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.594+0000 7f4132ffd640 1 --2- 172.21.15.19:0/1362791255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f411c004d40 0x7f411c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.594+0000 7f4132ffd640 1 -- 172.21.15.19:0/1362791255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411c003520 con 0x7f411c0039e0 2024-09-12T02:05:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.594+0000 7f41327fc640 1 --2- 172.21.15.19:0/1362791255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41340cfcc0 0x7f411c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:13.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.594+0000 7f4132ffd640 1 --2- 172.21.15.19:0/1362791255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f411c0039e0 0x7f411c003e00 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f412400c490 tx=0x7f411c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392876e53a8a8cc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:13.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.594+0000 7f4131ffb640 1 -- 172.21.15.19:0/1362791255 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412400c0e0 con 0x7f411c0039e0 2024-09-12T02:05:13.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.595+0000 7f4131ffb640 1 -- 172.21.15.19:0/1362791255 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4124034070 con 0x7f411c0039e0 2024-09-12T02:05:13.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.595+0000 7f4131ffb640 1 -- 172.21.15.19:0/1362791255 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4124005d30 con 0x7f411c0039e0 2024-09-12T02:05:13.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.595+0000 7f41397d6640 1 -- 172.21.15.19:0/1362791255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f411c0039e0 msgr2=0x7f411c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:13.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.595+0000 7f41397d6640 1 --2- 172.21.15.19:0/1362791255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f411c0039e0 0x7f411c003e00 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f412400c490 tx=0x7f411c005830 comp rx=0 tx=0).stop 2024-09-12T02:05:13.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.595+0000 7f41337fe640 1 -- 172.21.15.19:0/1362791255 reap_dead start 2024-09-12T02:05:13.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.595+0000 7f41397d6640 1 -- 172.21.15.19:0/1362791255 shutdown_connections 2024-09-12T02:05:13.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.595+0000 7f41397d6640 1 -- 172.21.15.19:0/1362791255 >> 172.21.15.19:0/1362791255 conn(0x7f413408bfc0 msgr2=0x7f41340d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:13.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.595+0000 7f41397d6640 1 -- 172.21.15.19:0/1362791255 shutdown_connections 2024-09-12T02:05:13.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.595+0000 7f41397d6640 1 -- 172.21.15.19:0/1362791255 wait complete. 2024-09-12T02:05:13.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.596+0000 7f41397d6640 1 Processor -- start 2024-09-12T02:05:13.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.596+0000 7f41397d6640 1 -- start start 2024-09-12T02:05:13.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.597+0000 7f41397d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f411c0039e0 0x7f4134155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:13.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.597+0000 7f41397d6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f413406d8a0 0x7f413406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:13.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.597+0000 7f41397d6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41340b8ba0 0x7f41340b9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:13.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.597+0000 7f41397d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f413406cdd0 con 0x7f411c0039e0 2024-09-12T02:05:13.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.597+0000 7f41397d6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f41340b3860 con 0x7f413406d8a0 2024-09-12T02:05:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.597+0000 7f41397d6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f413406cf50 con 0x7f41340b8ba0 2024-09-12T02:05:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.597+0000 7f4132ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f411c0039e0 0x7f4134155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.597+0000 7f4132ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f411c0039e0 0x7f4134155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38364/0 (socket says 172.21.15.19:38364) 2024-09-12T02:05:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.597+0000 7f4132ffd640 1 -- 172.21.15.19:0/2162924362 learned_addr learned my addr 172.21.15.19:0/2162924362 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.597+0000 7f41327fc640 1 --2- 172.21.15.19:0/2162924362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f413406d8a0 0x7f413406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.597+0000 7f41337fe640 1 --2- 172.21.15.19:0/2162924362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41340b8ba0 0x7f41340b9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.598+0000 7f4132ffd640 1 -- 172.21.15.19:0/2162924362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41340b8ba0 msgr2=0x7f41340b9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.598+0000 7f4132ffd640 1 --2- 172.21.15.19:0/2162924362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41340b8ba0 0x7f41340b9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.598+0000 7f4132ffd640 1 -- 172.21.15.19:0/2162924362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f413406d8a0 msgr2=0x7f413406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.598+0000 7f4132ffd640 1 --2- 172.21.15.19:0/2162924362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f413406d8a0 0x7f413406dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.598+0000 7f4132ffd640 1 -- 172.21.15.19:0/2162924362 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41340b9560 con 0x7f411c0039e0 2024-09-12T02:05:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.598+0000 7f41337fe640 1 --2- 172.21.15.19:0/2162924362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41340b8ba0 0x7f41340b9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:13.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.598+0000 7f4132ffd640 1 --2- 172.21.15.19:0/2162924362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f411c0039e0 0x7f4134155b00 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f4124031040 tx=0x7f4124001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.598+0000 7f411b7fe640 1 -- 172.21.15.19:0/2162924362 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4124007270 con 0x7f411c0039e0 2024-09-12T02:05:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.598+0000 7f411b7fe640 1 -- 172.21.15.19:0/2162924362 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4124007410 con 0x7f411c0039e0 2024-09-12T02:05:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.598+0000 7f41397d6640 1 -- 172.21.15.19:0/2162924362 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41340b75d0 con 0x7f411c0039e0 2024-09-12T02:05:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.598+0000 7f411b7fe640 1 -- 172.21.15.19:0/2162924362 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41240077c0 con 0x7f411c0039e0 2024-09-12T02:05:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.598+0000 7f41397d6640 1 -- 172.21.15.19:0/2162924362 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41340b7b90 con 0x7f411c0039e0 2024-09-12T02:05:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.599+0000 7f41397d6640 1 -- 172.21.15.19:0/2162924362 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4134068e20 con 0x7f411c0039e0 2024-09-12T02:05:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.599+0000 7f411b7fe640 1 -- 172.21.15.19:0/2162924362 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f412402f460 con 0x7f411c0039e0 2024-09-12T02:05:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.600+0000 7f411b7fe640 1 --2- 172.21.15.19:0/2162924362 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f412006c000 0x7f412006e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.600+0000 7f411b7fe640 1 -- 172.21.15.19:0/2162924362 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8625+0+0 (secure 0 0 0) 0x7f41240abf70 con 0x7f411c0039e0 2024-09-12T02:05:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.600+0000 7f41327fc640 1 --2- 172.21.15.19:0/2162924362 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f412006c000 0x7f412006e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:13.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.601+0000 7f41327fc640 1 --2- 172.21.15.19:0/2162924362 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f412006c000 0x7f412006e4c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f413406e670 tx=0x7f4128008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:13.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.604+0000 7f411b7fe640 1 -- 172.21.15.19:0/2162924362 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4134068e20 con 0x7f411c0039e0 2024-09-12T02:05:13.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.816+0000 7f41397d6640 1 -- 172.21.15.19:0/2162924362 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41340b6d20 con 0x7f411c0039e0 2024-09-12T02:05:13.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.817+0000 7f411b7fe640 1 -- 172.21.15.19:0/2162924362 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 240 v240) ==== 95+0+4392 (secure 0 0 0) 0x7f4124049070 con 0x7f411c0039e0 2024-09-12T02:05:13.817 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:13.817 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":240,"btime":"2024-09-12T02:05:12:792196+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8437,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3997032797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3997032797},{"type":"v1","addr":"172.21.15.135:6837","nonce":3997032797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":237}],"filesystems":[{"mdsmap":{"epoch":240,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:12.792138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":122,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:13.817 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 240 2024-09-12T02:05:13.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.819+0000 7f41397d6640 1 -- 172.21.15.19:0/2162924362 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f412006c000 msgr2=0x7f412006e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:13.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.819+0000 7f41397d6640 1 --2- 172.21.15.19:0/2162924362 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f412006c000 0x7f412006e4c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f413406e670 tx=0x7f4128008040 comp rx=0 tx=0).stop 2024-09-12T02:05:13.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.819+0000 7f41397d6640 1 -- 172.21.15.19:0/2162924362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f411c0039e0 msgr2=0x7f4134155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:13.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.819+0000 7f41397d6640 1 --2- 172.21.15.19:0/2162924362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f411c0039e0 0x7f4134155b00 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f4124031040 tx=0x7f4124001c10 comp rx=0 tx=0).stop 2024-09-12T02:05:13.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.819+0000 7f41397d6640 1 -- 172.21.15.19:0/2162924362 shutdown_connections 2024-09-12T02:05:13.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.819+0000 7f41397d6640 1 --2- 172.21.15.19:0/2162924362 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f412006c000 0x7f412006e4c0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.819+0000 7f41397d6640 1 --2- 172.21.15.19:0/2162924362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41340b8ba0 0x7f41340b9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.819+0000 7f41397d6640 1 --2- 172.21.15.19:0/2162924362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f413406d8a0 0x7f413406dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.819+0000 7f41397d6640 1 --2- 172.21.15.19:0/2162924362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f411c0039e0 0x7f4134155b00 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.819+0000 7f41397d6640 1 -- 172.21.15.19:0/2162924362 >> 172.21.15.19:0/2162924362 conn(0x7f413408bfc0 msgr2=0x7f41340b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:13.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.819+0000 7f41397d6640 1 -- 172.21.15.19:0/2162924362 shutdown_connections 2024-09-12T02:05:13.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:13.819+0000 7f41397d6640 1 -- 172.21.15.19:0/2162924362 wait complete. 2024-09-12T02:05:13.830 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate mds_snaptable' led to DAMAGED state 2024-09-12T02:05:13.830 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate mds0_inotable' 2024-09-12T02:05:13.830 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:05:13.830 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:05:13.847 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:05:13.847 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:05:13.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:13.848 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:05:13.903 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:05:13.903 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:05:13.904 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:05:14.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.048+0000 7f8f12865640 1 Processor -- start 2024-09-12T02:05:14.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.048+0000 7f8f12865640 1 -- start start 2024-09-12T02:05:14.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.049+0000 7f8f12865640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f0c0b6690 0x7f8f0c1691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.049+0000 7f8f12865640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f0c0d3690 con 0x7f8f0c15e5f0 2024-09-12T02:05:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.049+0000 7f8f12865640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f0c0d3970 con 0x7f8f0c0d30f0 2024-09-12T02:05:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.049+0000 7f8f12865640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8f0c06d530 con 0x7f8f0c0b6690 2024-09-12T02:05:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.049+0000 7f8f0bfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8f0c15e5f0 0x7f8f0c0d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53346/0 (socket says 172.21.15.19:53346) 2024-09-12T02:05:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.049+0000 7f8f0bfff640 1 -- 172.21.15.19:0/1694558225 learned_addr learned my addr 172.21.15.19:0/1694558225 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.049+0000 7f8f10e02640 1 --2- 172.21.15.19:0/1694558225 >> v2:172.21.15.19:3300/0 conn(0x7f8f0c0b6690 0x7f8f0c1691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.049+0000 7f8f0affd640 1 -- 172.21.15.19:0/1694558225 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 249240383 0 0) 0x7f8f0c0d3690 con 0x7f8f0c15e5f0 2024-09-12T02:05:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.049+0000 7f8f0affd640 1 -- 172.21.15.19:0/1694558225 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ef4003520 con 0x7f8f0c15e5f0 2024-09-12T02:05:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.049+0000 7f8f10e02640 1 -- 172.21.15.19:0/1694558225 >> v1:172.21.15.135:6789/0 conn(0x7f8f0c0d30f0 legacy=0x7f8f0c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.049+0000 7f8f10e02640 1 -- 172.21.15.19:0/1694558225 >> v1:172.21.15.19:6789/0 conn(0x7f8f0c15e5f0 legacy=0x7f8f0c0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:14.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.049+0000 7f8f10e02640 1 -- 172.21.15.19:0/1694558225 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0c06cee0 con 0x7f8f0c0b6690 2024-09-12T02:05:14.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.050+0000 7f8f10e02640 1 --2- 172.21.15.19:0/1694558225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0c0b6690 0x7f8f0c1691a0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009dc0 tx=0x7f8f0402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8cd13b0fc8bc4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:14.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.050+0000 7f8f0affd640 1 -- 172.21.15.19:0/1694558225 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f04007740 con 0x7f8f0c0b6690 2024-09-12T02:05:14.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.050+0000 7f8f0affd640 1 -- 172.21.15.19:0/1694558225 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f040078e0 con 0x7f8f0c0b6690 2024-09-12T02:05:14.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.050+0000 7f8f0affd640 1 -- 172.21.15.19:0/1694558225 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f04007cb0 con 0x7f8f0c0b6690 2024-09-12T02:05:14.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.051+0000 7f8f12865640 1 -- 172.21.15.19:0/1694558225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0c0b6690 msgr2=0x7f8f0c1691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:14.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.051+0000 7f8f12865640 1 --2- 172.21.15.19:0/1694558225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0c0b6690 0x7f8f0c1691a0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009dc0 tx=0x7f8f0402a730 comp rx=0 tx=0).stop 2024-09-12T02:05:14.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.051+0000 7f8f12865640 1 -- 172.21.15.19:0/1694558225 shutdown_connections 2024-09-12T02:05:14.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.051+0000 7f8f12865640 1 --2- 172.21.15.19:0/1694558225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0c0b6690 0x7f8f0c1691a0 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.051+0000 7f8f12865640 1 -- 172.21.15.19:0/1694558225 >> 172.21.15.19:0/1694558225 conn(0x7f8f0c08bfc0 msgr2=0x7f8f0c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:14.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.051+0000 7f8f12865640 1 -- 172.21.15.19:0/1694558225 shutdown_connections 2024-09-12T02:05:14.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.051+0000 7f8f12865640 1 -- 172.21.15.19:0/1694558225 wait complete. 2024-09-12T02:05:14.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.052+0000 7f8f12865640 1 Processor -- start 2024-09-12T02:05:14.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.052+0000 7f8f12865640 1 -- start start 2024-09-12T02:05:14.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.053+0000 7f8f12865640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f0c0b6690 0x7f8f0c15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.053+0000 7f8f12865640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0c0d30f0 0x7f8f0c0cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.053+0000 7f8f12865640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f0c15e5f0 0x7f8f0c14c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.053+0000 7f8f12865640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c06e9d0 con 0x7f8f0c0d30f0 2024-09-12T02:05:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.053+0000 7f8f12865640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c15e9d0 con 0x7f8f0c15e5f0 2024-09-12T02:05:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.053+0000 7f8f12865640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8f0c06eb50 con 0x7f8f0c0b6690 2024-09-12T02:05:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.053+0000 7f8f0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0c0d30f0 0x7f8f0c0cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.053+0000 7f8f0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0c0d30f0 0x7f8f0c0cab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38396/0 (socket says 172.21.15.19:38396) 2024-09-12T02:05:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.053+0000 7f8f0b7fe640 1 -- 172.21.15.19:0/2674237297 learned_addr learned my addr 172.21.15.19:0/2674237297 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.053+0000 7f8f0bfff640 1 --2- 172.21.15.19:0/2674237297 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f0c0b6690 0x7f8f0c15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.053+0000 7f8f10e02640 1 --2- 172.21.15.19:0/2674237297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f0c15e5f0 0x7f8f0c14c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.053+0000 7f8f0b7fe640 1 -- 172.21.15.19:0/2674237297 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f0c0b6690 msgr2=0x7f8f0c15eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.053+0000 7f8f0b7fe640 1 --2- 172.21.15.19:0/2674237297 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f0c0b6690 0x7f8f0c15eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.053+0000 7f8f0b7fe640 1 -- 172.21.15.19:0/2674237297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f0c15e5f0 msgr2=0x7f8f0c14c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:14.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.053+0000 7f8f0b7fe640 1 --2- 172.21.15.19:0/2674237297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f0c15e5f0 0x7f8f0c14c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.053+0000 7f8f0b7fe640 1 -- 172.21.15.19:0/2674237297 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0c0b8d80 con 0x7f8f0c0d30f0 2024-09-12T02:05:14.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.054+0000 7f8f0b7fe640 1 --2- 172.21.15.19:0/2674237297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0c0d30f0 0x7f8f0c0cab70 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000c400 tx=0x7f8f0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:14.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.054+0000 7f8f08ff9640 1 -- 172.21.15.19:0/2674237297 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f000052d0 con 0x7f8f0c0d30f0 2024-09-12T02:05:14.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.054+0000 7f8f08ff9640 1 -- 172.21.15.19:0/2674237297 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f00005490 con 0x7f8f0c0d30f0 2024-09-12T02:05:14.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.054+0000 7f8f08ff9640 1 -- 172.21.15.19:0/2674237297 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f00007260 con 0x7f8f0c0d30f0 2024-09-12T02:05:14.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.054+0000 7f8f12865640 1 -- 172.21.15.19:0/2674237297 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0c0cb0b0 con 0x7f8f0c0d30f0 2024-09-12T02:05:14.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.054+0000 7f8f12865640 1 -- 172.21.15.19:0/2674237297 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f0c0b9000 con 0x7f8f0c0d30f0 2024-09-12T02:05:14.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.055+0000 7f8f12865640 1 -- 172.21.15.19:0/2674237297 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f0c14a180 con 0x7f8f0c0d30f0 2024-09-12T02:05:14.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.055+0000 7f8f08ff9640 1 -- 172.21.15.19:0/2674237297 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f00007400 con 0x7f8f0c0d30f0 2024-09-12T02:05:14.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.056+0000 7f8f08ff9640 1 --2- 172.21.15.19:0/2674237297 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8ef806be30 0x7f8ef806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:14.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.056+0000 7f8f08ff9640 1 -- 172.21.15.19:0/2674237297 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8625+0+0 (secure 0 0 0) 0x7f8f0008aed0 con 0x7f8f0c0d30f0 2024-09-12T02:05:14.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.056+0000 7f8f0bfff640 1 --2- 172.21.15.19:0/2674237297 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8ef806be30 0x7f8ef806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:14.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.057+0000 7f8f0bfff640 1 --2- 172.21.15.19:0/2674237297 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8ef806be30 0x7f8ef806e2f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0011e0 tx=0x7f8efc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:14.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.060+0000 7f8f08ff9640 1 -- 172.21.15.19:0/2674237297 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f0c14a180 con 0x7f8f0c0d30f0 2024-09-12T02:05:14.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.271+0000 7f8f12865640 1 -- 172.21.15.19:0/2674237297 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8f0c0b5f80 con 0x7f8f0c0d30f0 2024-09-12T02:05:14.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.788+0000 7f8f08ff9640 1 -- 172.21.15.19:0/2674237297 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v241) ==== 161+0+0 (secure 0 0 0) 0x7f8f0c0cb0b0 con 0x7f8f0c0d30f0 2024-09-12T02:05:14.788 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:05:14.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.790+0000 7f8f12865640 1 -- 172.21.15.19:0/2674237297 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8ef806be30 msgr2=0x7f8ef806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:14.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.790+0000 7f8f12865640 1 --2- 172.21.15.19:0/2674237297 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8ef806be30 0x7f8ef806e2f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0011e0 tx=0x7f8efc009040 comp rx=0 tx=0).stop 2024-09-12T02:05:14.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.790+0000 7f8f12865640 1 -- 172.21.15.19:0/2674237297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0c0d30f0 msgr2=0x7f8f0c0cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:14.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.790+0000 7f8f12865640 1 --2- 172.21.15.19:0/2674237297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0c0d30f0 0x7f8f0c0cab70 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000c400 tx=0x7f8f0000c8c0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.790+0000 7f8f12865640 1 -- 172.21.15.19:0/2674237297 shutdown_connections 2024-09-12T02:05:14.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.791+0000 7f8f12865640 1 --2- 172.21.15.19:0/2674237297 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8ef806be30 0x7f8ef806e2f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.791+0000 7f8f12865640 1 --2- 172.21.15.19:0/2674237297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f0c15e5f0 0x7f8f0c14c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.791+0000 7f8f12865640 1 --2- 172.21.15.19:0/2674237297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0c0d30f0 0x7f8f0c0cab70 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.791+0000 7f8f12865640 1 --2- 172.21.15.19:0/2674237297 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f0c0b6690 0x7f8f0c15eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.791+0000 7f8f12865640 1 -- 172.21.15.19:0/2674237297 >> 172.21.15.19:0/2674237297 conn(0x7f8f0c08bfc0 msgr2=0x7f8f0c1e8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:14.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.791+0000 7f8f12865640 1 -- 172.21.15.19:0/2674237297 shutdown_connections 2024-09-12T02:05:14.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.791+0000 7f8f12865640 1 -- 172.21.15.19:0/2674237297 wait complete. 2024-09-12T02:05:14.803 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:05:14.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.910+0000 7fd1e168d640 1 Processor -- start 2024-09-12T02:05:14.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.910+0000 7fd1e168d640 1 -- start start 2024-09-12T02:05:14.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.911+0000 7fd1e168d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd1dc161c80 0x7fd1dc06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:14.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.911+0000 7fd1e168d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1dc162060 0x7fd1dc0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:14.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.911+0000 7fd1e168d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1dc06e870 con 0x7fd1dc0b64b0 2024-09-12T02:05:14.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.911+0000 7fd1e168d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd1dc06d9f0 con 0x7fd1dc162060 2024-09-12T02:05:14.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.911+0000 7fd1e168d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd1dc06dcd0 con 0x7fd1dc161c80 2024-09-12T02:05:14.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.911+0000 7fd1da7fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1dc162060 0x7fd1dc0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:14.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.911+0000 7fd1db7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd1dc0b64b0 0x7fd1dc162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53348/0 (socket says 172.21.15.19:53348) 2024-09-12T02:05:14.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.911+0000 7fd1db7fe640 1 -- 172.21.15.19:0/3324132600 learned_addr learned my addr 172.21.15.19:0/3324132600 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:14.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.912+0000 7fd1daffd640 1 --2- 172.21.15.19:0/3324132600 >> v2:172.21.15.135:3300/0 conn(0x7fd1dc161c80 0x7fd1dc06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:14.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.912+0000 7fd1da7fc640 1 -- 172.21.15.19:0/3324132600 >> v2:172.21.15.135:3300/0 conn(0x7fd1dc161c80 msgr2=0x7fd1dc06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:14.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.912+0000 7fd1da7fc640 1 --2- 172.21.15.19:0/3324132600 >> v2:172.21.15.135:3300/0 conn(0x7fd1dc161c80 0x7fd1dc06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.912+0000 7fd1da7fc640 1 -- 172.21.15.19:0/3324132600 >> v1:172.21.15.19:6789/0 conn(0x7fd1dc0b64b0 legacy=0x7fd1dc162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:14.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.912+0000 7fd1da7fc640 1 -- 172.21.15.19:0/3324132600 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1dc06dfb0 con 0x7fd1dc162060 2024-09-12T02:05:14.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.912+0000 7fd1d9ffb640 1 -- 172.21.15.19:0/3324132600 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1554051273 0 0) 0x7fd1cc001490 con 0x7fd1dc0b64b0 2024-09-12T02:05:14.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.912+0000 7fd1da7fc640 1 --2- 172.21.15.19:0/3324132600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1dc162060 0x7fd1dc0b5f70 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc08d7a0 tx=0x7fd1c402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c692b552794bd04 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.913+0000 7fd1d9ffb640 1 -- 172.21.15.19:0/3324132600 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4037070 con 0x7fd1dc162060 2024-09-12T02:05:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.913+0000 7fd1d9ffb640 1 -- 172.21.15.19:0/3324132600 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c4032440 con 0x7fd1dc162060 2024-09-12T02:05:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.913+0000 7fd1d9ffb640 1 -- 172.21.15.19:0/3324132600 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4032810 con 0x7fd1dc162060 2024-09-12T02:05:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.913+0000 7fd1e168d640 1 -- 172.21.15.19:0/3324132600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1dc162060 msgr2=0x7fd1dc0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.913+0000 7fd1e168d640 1 --2- 172.21.15.19:0/3324132600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1dc162060 0x7fd1dc0b5f70 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc08d7a0 tx=0x7fd1c402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.913+0000 7fd1e168d640 1 -- 172.21.15.19:0/3324132600 shutdown_connections 2024-09-12T02:05:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.913+0000 7fd1e168d640 1 --2- 172.21.15.19:0/3324132600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1dc162060 0x7fd1dc0b5f70 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.913+0000 7fd1e168d640 1 --2- 172.21.15.19:0/3324132600 >> v2:172.21.15.135:3300/0 conn(0x7fd1dc161c80 0x7fd1dc06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.913+0000 7fd1e168d640 1 -- 172.21.15.19:0/3324132600 >> 172.21.15.19:0/3324132600 conn(0x7fd1dc0d44f0 msgr2=0x7fd1dc0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.913+0000 7fd1e168d640 1 -- 172.21.15.19:0/3324132600 shutdown_connections 2024-09-12T02:05:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.913+0000 7fd1e168d640 1 -- 172.21.15.19:0/3324132600 wait complete. 2024-09-12T02:05:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.914+0000 7fd1e168d640 1 Processor -- start 2024-09-12T02:05:14.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.915+0000 7fd1e168d640 1 -- start start 2024-09-12T02:05:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.915+0000 7fd1e168d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1dc0b64b0 0x7fd1dc156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.915+0000 7fd1e168d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1dc161c80 0x7fd1dc0b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.915+0000 7fd1e168d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1dc162060 0x7fd1dc1f77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.915+0000 7fd1e168d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc0d2a10 con 0x7fd1dc161c80 2024-09-12T02:05:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.915+0000 7fd1e168d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc0d2890 con 0x7fd1dc0b64b0 2024-09-12T02:05:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.915+0000 7fd1e168d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd1dc0b6960 con 0x7fd1dc162060 2024-09-12T02:05:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.915+0000 7fd1da7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1dc161c80 0x7fd1dc0b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.915+0000 7fd1da7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1dc161c80 0x7fd1dc0b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38424/0 (socket says 172.21.15.19:38424) 2024-09-12T02:05:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.915+0000 7fd1da7fc640 1 -- 172.21.15.19:0/1424939150 learned_addr learned my addr 172.21.15.19:0/1424939150 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.915+0000 7fd1daffd640 1 --2- 172.21.15.19:0/1424939150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1dc0b64b0 0x7fd1dc156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.916+0000 7fd1db7fe640 1 --2- 172.21.15.19:0/1424939150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1dc162060 0x7fd1dc1f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:14.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.916+0000 7fd1da7fc640 1 -- 172.21.15.19:0/1424939150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1dc162060 msgr2=0x7fd1dc1f77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:14.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.916+0000 7fd1da7fc640 1 --2- 172.21.15.19:0/1424939150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1dc162060 0x7fd1dc1f77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.916+0000 7fd1da7fc640 1 -- 172.21.15.19:0/1424939150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1dc0b64b0 msgr2=0x7fd1dc156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:14.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.916+0000 7fd1da7fc640 1 --2- 172.21.15.19:0/1424939150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1dc0b64b0 0x7fd1dc156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.916+0000 7fd1da7fc640 1 -- 172.21.15.19:0/1424939150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1dc1f85f0 con 0x7fd1dc161c80 2024-09-12T02:05:14.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.916+0000 7fd1daffd640 1 --2- 172.21.15.19:0/1424939150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1dc0b64b0 0x7fd1dc156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:14.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.916+0000 7fd1da7fc640 1 --2- 172.21.15.19:0/1424939150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1dc161c80 0x7fd1dc0b3230 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4000c00 tx=0x7fd1c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:14.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.916+0000 7fd1d37fe640 1 -- 172.21.15.19:0/1424939150 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4037040 con 0x7fd1dc161c80 2024-09-12T02:05:14.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.916+0000 7fd1d37fe640 1 -- 172.21.15.19:0/1424939150 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c4042070 con 0x7fd1dc161c80 2024-09-12T02:05:14.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.916+0000 7fd1e168d640 1 -- 172.21.15.19:0/1424939150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1dc0cc370 con 0x7fd1dc161c80 2024-09-12T02:05:14.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.916+0000 7fd1d37fe640 1 -- 172.21.15.19:0/1424939150 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4030bd0 con 0x7fd1dc161c80 2024-09-12T02:05:14.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.916+0000 7fd1e168d640 1 -- 172.21.15.19:0/1424939150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1dc0cc930 con 0x7fd1dc161c80 2024-09-12T02:05:14.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.917+0000 7fd1e168d640 1 -- 172.21.15.19:0/1424939150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1dc1613e0 con 0x7fd1dc161c80 2024-09-12T02:05:14.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.917+0000 7fd1d37fe640 1 -- 172.21.15.19:0/1424939150 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd1c4047460 con 0x7fd1dc161c80 2024-09-12T02:05:14.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.918+0000 7fd1d37fe640 1 --2- 172.21.15.19:0/1424939150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd1bc06be30 0x7fd1bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:14.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.918+0000 7fd1d37fe640 1 -- 172.21.15.19:0/1424939150 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8625+0+0 (secure 0 0 0) 0x7fd1c40ac5b0 con 0x7fd1dc161c80 2024-09-12T02:05:14.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.918+0000 7fd1daffd640 1 --2- 172.21.15.19:0/1424939150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd1bc06be30 0x7fd1bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:14.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.919+0000 7fd1daffd640 1 --2- 172.21.15.19:0/1424939150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd1bc06be30 0x7fd1bc06e2f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4006fd0 tx=0x7fd1d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:14.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:14.922+0000 7fd1d37fe640 1 -- 172.21.15.19:0/1424939150 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd1dc1613e0 con 0x7fd1dc161c80 2024-09-12T02:05:15.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.173+0000 7fd1e168d640 1 -- 172.21.15.19:0/1424939150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7fd1dc0ba470 con 0x7fd1dc161c80 2024-09-12T02:05:15.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.798+0000 7fd1d37fe640 1 -- 172.21.15.19:0/1424939150 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v242) ==== 101+0+0 (secure 0 0 0) 0x7fd1c4032e20 con 0x7fd1dc161c80 2024-09-12T02:05:15.798 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:05:15.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.801+0000 7fd1e168d640 1 -- 172.21.15.19:0/1424939150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd1bc06be30 msgr2=0x7fd1bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:15.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.801+0000 7fd1e168d640 1 --2- 172.21.15.19:0/1424939150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd1bc06be30 0x7fd1bc06e2f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4006fd0 tx=0x7fd1d4008040 comp rx=0 tx=0).stop 2024-09-12T02:05:15.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.801+0000 7fd1e168d640 1 -- 172.21.15.19:0/1424939150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1dc161c80 msgr2=0x7fd1dc0b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:15.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.801+0000 7fd1e168d640 1 --2- 172.21.15.19:0/1424939150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1dc161c80 0x7fd1dc0b3230 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4000c00 tx=0x7fd1c40046c0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.801+0000 7fd1e168d640 1 -- 172.21.15.19:0/1424939150 shutdown_connections 2024-09-12T02:05:15.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.801+0000 7fd1e168d640 1 --2- 172.21.15.19:0/1424939150 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd1bc06be30 0x7fd1bc06e2f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.801+0000 7fd1e168d640 1 --2- 172.21.15.19:0/1424939150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1dc162060 0x7fd1dc1f77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.801+0000 7fd1e168d640 1 --2- 172.21.15.19:0/1424939150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1dc161c80 0x7fd1dc0b3230 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.801+0000 7fd1e168d640 1 --2- 172.21.15.19:0/1424939150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1dc0b64b0 0x7fd1dc156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.801+0000 7fd1e168d640 1 -- 172.21.15.19:0/1424939150 >> 172.21.15.19:0/1424939150 conn(0x7fd1dc0d44f0 msgr2=0x7fd1dc06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:15.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.801+0000 7fd1e168d640 1 -- 172.21.15.19:0/1424939150 shutdown_connections 2024-09-12T02:05:15.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.801+0000 7fd1e168d640 1 -- 172.21.15.19:0/1424939150 wait complete. 2024-09-12T02:05:15.813 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:05:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.859+0000 7fab0a122f40 1 Processor -- start 2024-09-12T02:05:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.859+0000 7fab0a122f40 1 -- start start 2024-09-12T02:05:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab0a122f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f447122f30 0x55f4471b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab0a122f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f4471afd20 0x55f4471b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab0a122f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f4471b0100 0x55f4471b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab0a122f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f4470df2d0 con 0x55f4471b0100 2024-09-12T02:05:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab0a122f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f4471246b0 con 0x55f447122f30 2024-09-12T02:05:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab0a122f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55f447126520 con 0x55f4471afd20 2024-09-12T02:05:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab0841b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f4471b0100 0x55f4471b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab0841b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f4471b0100 0x55f4471b26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38440/0 (socket says 172.21.15.19:38440) 2024-09-12T02:05:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab0841b640 1 -- 172.21.15.19:0/1946467695 learned_addr learned my addr 172.21.15.19:0/1946467695 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab07419640 1 --2- 172.21.15.19:0/1946467695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f4471afd20 0x55f4471b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab07c1a640 1 --2- 172.21.15.19:0/1946467695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f447122f30 0x55f4471b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab0841b640 1 -- 172.21.15.19:0/1946467695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f4471afd20 msgr2=0x55f4471b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab0841b640 1 --2- 172.21.15.19:0/1946467695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f4471afd20 0x55f4471b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab0841b640 1 -- 172.21.15.19:0/1946467695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f447122f30 msgr2=0x55f4471b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab0841b640 1 --2- 172.21.15.19:0/1946467695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f447122f30 0x55f4471b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab0841b640 1 -- 172.21.15.19:0/1946467695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f447005cb0 con 0x55f4471b0100 2024-09-12T02:05:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab0841b640 1 --2- 172.21.15.19:0/1946467695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f4471b0100 0x55f4471b26e0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fab00025a20 tx=0x7fab00050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24052f9110d79b29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab06417640 1 -- 172.21.15.19:0/1946467695 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00054040 con 0x55f4471b0100 2024-09-12T02:05:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab06417640 1 -- 172.21.15.19:0/1946467695 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab000508c0 con 0x55f4471b0100 2024-09-12T02:05:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.860+0000 7fab06417640 1 -- 172.21.15.19:0/1946467695 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00050c90 con 0x55f4471b0100 2024-09-12T02:05:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.861+0000 7fab0a122f40 1 -- 172.21.15.19:0/1946467695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f4471b0100 msgr2=0x55f4471b26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.861+0000 7fab0a122f40 1 --2- 172.21.15.19:0/1946467695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f4471b0100 0x55f4471b26e0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fab00025a20 tx=0x7fab00050000 comp rx=0 tx=0).stop 2024-09-12T02:05:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.861+0000 7fab0a122f40 1 -- 172.21.15.19:0/1946467695 shutdown_connections 2024-09-12T02:05:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.861+0000 7fab0a122f40 1 --2- 172.21.15.19:0/1946467695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f4471b0100 0x55f4471b26e0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.861+0000 7fab0a122f40 1 --2- 172.21.15.19:0/1946467695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f4471afd20 0x55f4471b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.861+0000 7fab0a122f40 1 --2- 172.21.15.19:0/1946467695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f447122f30 0x55f4471b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.861+0000 7fab0a122f40 1 -- 172.21.15.19:0/1946467695 >> 172.21.15.19:0/1946467695 conn(0x55f447108490 msgr2=0x55f447108870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.861+0000 7fab0a122f40 1 -- 172.21.15.19:0/1946467695 shutdown_connections 2024-09-12T02:05:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.861+0000 7fab0a122f40 1 -- 172.21.15.19:0/1946467695 wait complete. 2024-09-12T02:05:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.861+0000 7fab0a122f40 1 Processor -- start 2024-09-12T02:05:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.862+0000 7fab0a122f40 1 -- start start 2024-09-12T02:05:15.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.862+0000 7fab0a122f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f447122f30 0x55f4471b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:15.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.862+0000 7fab0a122f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4471afd20 0x55f4471960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.862+0000 7fab0a122f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f4471b0100 0x55f44710a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.862+0000 7fab0a122f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f4471b1df0 con 0x55f447122f30 2024-09-12T02:05:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.862+0000 7fab0a122f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f4471b1b10 con 0x55f4471afd20 2024-09-12T02:05:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.862+0000 7fab0a122f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55f4471b0630 con 0x55f4471b0100 2024-09-12T02:05:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.862+0000 7fab07c1a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f447122f30 0x55f4471b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.862+0000 7fab07c1a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f447122f30 0x55f4471b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38450/0 (socket says 172.21.15.19:38450) 2024-09-12T02:05:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.862+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 learned_addr learned my addr 172.21.15.19:0/3686677912 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.862+0000 7fab07419640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4471afd20 0x55f4471960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.862+0000 7fab0841b640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f4471b0100 0x55f44710a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.863+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f4471b0100 msgr2=0x55f44710a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.863+0000 7fab07c1a640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f4471b0100 0x55f44710a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.863+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4471afd20 msgr2=0x55f4471960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.863+0000 7fab07c1a640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4471afd20 0x55f4471960d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.863+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f447107c70 con 0x55f447122f30 2024-09-12T02:05:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.863+0000 7fab07c1a640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f447122f30 0x55f4471b1340 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009ec0 tx=0x7faaf8008400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.863+0000 7fab05415640 1 -- 172.21.15.19:0/3686677912 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf8008e40 con 0x55f447122f30 2024-09-12T02:05:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.863+0000 7fab05415640 1 -- 172.21.15.19:0/3686677912 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf80143f0 con 0x55f447122f30 2024-09-12T02:05:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.863+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f447121470 con 0x55f447122f30 2024-09-12T02:05:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.863+0000 7fab05415640 1 -- 172.21.15.19:0/3686677912 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf80147a0 con 0x55f447122f30 2024-09-12T02:05:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.863+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4471206b0 con 0x55f447122f30 2024-09-12T02:05:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.865+0000 7fab05415640 1 -- 172.21.15.19:0/3686677912 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faaf801b020 con 0x55f447122f30 2024-09-12T02:05:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.865+0000 7fab05415640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faaf406a810 0x7faaf406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.865+0000 7fab05415640 1 -- 172.21.15.19:0/3686677912 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8625+0+0 (secure 0 0 0) 0x7faaf8089d40 con 0x55f447122f30 2024-09-12T02:05:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.865+0000 7fab07419640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faaf406a810 0x7faaf406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:15.868 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:05:15.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.865+0000 7fab0a122f40 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55f4472466b0 0x55f447246a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:15.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.865+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447246fd0 con 0x55f4472466b0 2024-09-12T02:05:15.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.866+0000 7fab0841b640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55f4472466b0 0x55f447246a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:15.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.866+0000 7fab07419640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faaf406a810 0x7faaf406ccd0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x55f44710b570 tx=0x7faafc005b00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:15.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.866+0000 7fab0841b640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55f4472466b0 0x55f447246a90 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:15.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.867+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v122'846 uv820 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.867+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f4472473e0 con 0x55f4472466b0 2024-09-12T02:05:15.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.869+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v122'847 uv847 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.869+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447252cd0 con 0x55f4472466b0 2024-09-12T02:05:15.870 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:05:15.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.870+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v122'848 uv848 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.870+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447254080 con 0x55f4472466b0 2024-09-12T02:05:15.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.871+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v122'849 uv849 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.871+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447254420 con 0x55f4472466b0 2024-09-12T02:05:15.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.872+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v122'850 uv850 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.872+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447253070 con 0x55f4472466b0 2024-09-12T02:05:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.873+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v122'851 uv851 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.873+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447253410 con 0x55f4472466b0 2024-09-12T02:05:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.874+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v122'852 uv826 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.874+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f447253410 con 0x55f4472466b0 2024-09-12T02:05:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.875+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v122'853 uv853 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.875+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447253410 con 0x55f4472466b0 2024-09-12T02:05:15.875 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:05:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.876+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v122'854 uv854 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.876+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447253410 con 0x55f4472466b0 2024-09-12T02:05:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.877+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v122'855 uv855 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.877+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447253410 con 0x55f4472466b0 2024-09-12T02:05:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.878+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v122'856 uv856 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.878+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447253410 con 0x55f4472466b0 2024-09-12T02:05:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.879+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v122'857 uv857 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.880+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447253410 con 0x55f4472466b0 2024-09-12T02:05:15.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.881+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v122'858 uv833 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.881+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f447253410 con 0x55f4472466b0 2024-09-12T02:05:15.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.882+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v122'859 uv859 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.882+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447253410 con 0x55f4472466b0 2024-09-12T02:05:15.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.883+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v122'860 uv860 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.882 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:05:15.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.883+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447253410 con 0x55f4472466b0 2024-09-12T02:05:15.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.884+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v122'861 uv861 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.884+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447253410 con 0x55f4472466b0 2024-09-12T02:05:15.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.885+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v122'862 uv862 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.885+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447253410 con 0x55f4472466b0 2024-09-12T02:05:15.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.886+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v122'863 uv863 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.886+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472537d0 con 0x55f4472466b0 2024-09-12T02:05:15.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.887+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v122'864 uv864 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.887+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472537d0 con 0x55f4472466b0 2024-09-12T02:05:15.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.888+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v122'865 uv839 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.888+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f4472536c0 con 0x55f4472466b0 2024-09-12T02:05:15.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.889+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v122'866 uv866 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.889+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447253bb0 con 0x55f4472466b0 2024-09-12T02:05:15.889 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:05:15.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.890+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v122'867 uv867 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.890+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447253bb0 con 0x55f4472466b0 2024-09-12T02:05:15.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.891+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v122'868 uv868 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.891+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447253b90 con 0x55f4472466b0 2024-09-12T02:05:15.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.892+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v122'869 uv869 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.892+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447253b90 con 0x55f4472466b0 2024-09-12T02:05:15.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.893+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v122'870 uv870 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.893+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447253b90 con 0x55f4472466b0 2024-09-12T02:05:15.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.894+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v122'871 uv845 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.894+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f447253b90 con 0x55f4472466b0 2024-09-12T02:05:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.895+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v122'872 uv872 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.895+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472536c0 con 0x55f4472466b0 2024-09-12T02:05:15.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.896+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v122'873 uv873 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.895 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:05:15.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.896+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472536c0 con 0x55f4472466b0 2024-09-12T02:05:15.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.897+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v122'874 uv874 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.897+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472536c0 con 0x55f4472466b0 2024-09-12T02:05:15.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.898+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v122'875 uv875 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.898+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472536c0 con 0x55f4472466b0 2024-09-12T02:05:15.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.899+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v122'876 uv876 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f4472466b0 2024-09-12T02:05:15.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.899+0000 7fab0a122f40 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55f4472547c0 0x55f447256bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:15.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.899+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472570f0 con 0x55f4472547c0 2024-09-12T02:05:15.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.899+0000 7fab07c1a640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55f4472547c0 0x55f447256bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:15.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.900+0000 7fab07c1a640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55f4472547c0 0x55f447256bb0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:15.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.902+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v122'618 uv601 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.902+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f447257490 con 0x55f4472547c0 2024-09-12T02:05:15.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.903+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v122'619 uv619 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.903+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447257830 con 0x55f4472547c0 2024-09-12T02:05:15.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.904+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v122'620 uv620 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.903 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:05:15.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.904+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447258080 con 0x55f4472547c0 2024-09-12T02:05:15.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.905+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v122'621 uv621 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.906+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447258420 con 0x55f4472547c0 2024-09-12T02:05:15.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.907+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v122'622 uv622 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.907+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472587c0 con 0x55f4472547c0 2024-09-12T02:05:15.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.908+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v122'623 uv606 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.908+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f447258b60 con 0x55f4472547c0 2024-09-12T02:05:15.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.910+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v122'624 uv624 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.910+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447258b60 con 0x55f4472547c0 2024-09-12T02:05:15.910 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:05:15.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.911+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v122'625 uv625 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.911+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447258b60 con 0x55f4472547c0 2024-09-12T02:05:15.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.912+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v122'626 uv626 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.912+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447258b60 con 0x55f4472547c0 2024-09-12T02:05:15.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.914+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v122'627 uv627 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.914+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447258b60 con 0x55f4472547c0 2024-09-12T02:05:15.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.915+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v122'628 uv611 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.915+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f447258b60 con 0x55f4472547c0 2024-09-12T02:05:15.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.916+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v122'629 uv629 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.916+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447258b60 con 0x55f4472547c0 2024-09-12T02:05:15.917 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:05:15.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.918+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v122'630 uv630 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.918+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f44725cfe0 con 0x55f4472547c0 2024-09-12T02:05:15.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.919+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v122'631 uv631 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.919+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f44725cfe0 con 0x55f4472547c0 2024-09-12T02:05:15.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.921+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v122'632 uv632 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.921+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447258b60 con 0x55f4472547c0 2024-09-12T02:05:15.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.922+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v122'633 uv617 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.922+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f447258b60 con 0x55f4472547c0 2024-09-12T02:05:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.923+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v122'634 uv634 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.923+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447258b60 con 0x55f4472547c0 2024-09-12T02:05:15.923 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:05:15.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.924+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v122'635 uv635 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.924+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447259b70 con 0x55f4472547c0 2024-09-12T02:05:15.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.926+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v122'636 uv636 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.926+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447259b70 con 0x55f4472547c0 2024-09-12T02:05:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.927+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v122'637 uv637 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.927+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447258b60 con 0x55f4472547c0 2024-09-12T02:05:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.928+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v122'638 uv638 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472547c0 2024-09-12T02:05:15.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.928+0000 7fab0a122f40 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55f447259070 0x55f44725b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:15.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.928+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f44725b9a0 con 0x55f447259070 2024-09-12T02:05:15.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.928+0000 7fab07419640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55f447259070 0x55f44725b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:15.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.929+0000 7fab07419640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55f447259070 0x55f44725b460 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:15.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.930+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v122'165 uv164 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:15.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.930+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f44725bdc0 con 0x55f447259070 2024-09-12T02:05:15.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.932+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v122'166 uv166 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:15.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.932+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447257cc0 con 0x55f447259070 2024-09-12T02:05:15.932 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:05:15.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.933+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v122'167 uv167 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:15.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.933+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f44725dba0 con 0x55f447259070 2024-09-12T02:05:15.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.934+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v122'168 uv168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:15.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.934+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f44725df40 con 0x55f447259070 2024-09-12T02:05:15.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.935+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v122'169 uv169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:15.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.935+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f44725cb90 con 0x55f447259070 2024-09-12T02:05:15.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.936+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v122'170 uv170 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:15.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.936+0000 7fab0a122f40 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55f44725d490 0x55f4472602f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:15.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.936+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447260830 con 0x55f44725d490 2024-09-12T02:05:15.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.937+0000 7fab0841b640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55f44725d490 0x55f4472602f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:15.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.937+0000 7fab0841b640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55f44725d490 0x55f4472602f0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:15.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.938+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v122'122 uv121 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.938+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f447260830 con 0x55f44725d490 2024-09-12T02:05:15.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.939+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v122'123 uv123 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.939+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447260c20 con 0x55f44725d490 2024-09-12T02:05:15.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.940+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v122'124 uv124 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.940 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:05:15.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.941+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447260c20 con 0x55f44725d490 2024-09-12T02:05:15.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.942+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v122'125 uv125 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.942+0000 7fab0a122f40 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55f4472612a0 0x55f447263690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:15.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.942+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447263bd0 con 0x55f4472612a0 2024-09-12T02:05:15.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.942+0000 7fab07c1a640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55f4472612a0 0x55f447263690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:15.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.943+0000 7fab07c1a640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55f4472612a0 0x55f447263690 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:15.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.944+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v122'165 uv164 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472612a0 2024-09-12T02:05:15.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.944+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f447263c10 con 0x55f4472612a0 2024-09-12T02:05:15.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.945+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v122'166 uv166 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472612a0 2024-09-12T02:05:15.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.945+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f4472612a0 2024-09-12T02:05:15.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.946+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v122'167 uv167 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8053be0 con 0x55f4472612a0 2024-09-12T02:05:15.945 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:05:15.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.946+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447265040 con 0x55f4472612a0 2024-09-12T02:05:15.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.947+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v122'168 uv168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.947+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447265040 con 0x55f4472612a0 2024-09-12T02:05:15.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.948+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v122'169 uv169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.948+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f4472612a0 2024-09-12T02:05:15.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.949+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v122'170 uv170 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.949+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f44725d490 2024-09-12T02:05:15.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.950+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v122'305 uv299 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.950+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f44725d490 2024-09-12T02:05:15.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.952+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v122'306 uv306 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.952+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f44725d490 2024-09-12T02:05:15.952 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:05:15.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.953+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v122'307 uv307 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.953+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447265040 con 0x55f44725d490 2024-09-12T02:05:15.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.954+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v122'308 uv308 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.954+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447265040 con 0x55f44725d490 2024-09-12T02:05:15.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.955+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v122'309 uv309 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.955+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f44725d490 2024-09-12T02:05:15.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.956+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v122'310 uv310 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.956+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f44725d490 2024-09-12T02:05:15.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.957+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v122'311 uv304 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.957+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f44725d490 2024-09-12T02:05:15.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.958+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v122'312 uv312 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.958+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f44725d490 2024-09-12T02:05:15.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.959+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v122'313 uv313 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.959 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:05:15.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.959+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f44725d490 2024-09-12T02:05:15.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.961+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v122'314 uv314 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.961+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f44725d490 2024-09-12T02:05:15.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.962+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v122'315 uv315 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.962+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f44725d490 2024-09-12T02:05:15.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.963+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v122'138 uv137 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.963+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f44725d490 2024-09-12T02:05:15.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.964+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v122'139 uv139 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.964+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f44725d490 2024-09-12T02:05:15.964 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:05:15.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.965+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v122'140 uv140 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.965+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f44725d490 2024-09-12T02:05:15.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.966+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v122'141 uv141 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.966+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f44725d490 2024-09-12T02:05:15.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.967+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v122'142 uv142 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fab00056030 con 0x55f44725d490 2024-09-12T02:05:15.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.967+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f4472612a0 2024-09-12T02:05:15.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.968+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v122'165 uv164 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.968+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f4472612a0 2024-09-12T02:05:15.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.969+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v122'166 uv166 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.969+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f4472612a0 2024-09-12T02:05:15.970 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:05:15.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.970+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v122'167 uv167 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.970+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447265040 con 0x55f4472612a0 2024-09-12T02:05:15.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.971+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v122'168 uv168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.971+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447265040 con 0x55f4472612a0 2024-09-12T02:05:15.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.972+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v122'169 uv169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.972+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f4472612a0 2024-09-12T02:05:15.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.973+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v122'170 uv170 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.973+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f4472612a0 2024-09-12T02:05:15.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.974+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v122'273 uv267 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.974+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f4472612a0 2024-09-12T02:05:15.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.975+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v122'274 uv274 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.975+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447264030 con 0x55f4472612a0 2024-09-12T02:05:15.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.976+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v122'275 uv275 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.976 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:05:15.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.976+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f44725c780 con 0x55f4472612a0 2024-09-12T02:05:15.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.977+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v122'276 uv276 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.977+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f44725c780 con 0x55f4472612a0 2024-09-12T02:05:15.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.978+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v122'277 uv277 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.978+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f44725c780 con 0x55f4472612a0 2024-09-12T02:05:15.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.979+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v122'278 uv272 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.979+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f44725c780 con 0x55f4472612a0 2024-09-12T02:05:15.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.980+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v122'279 uv279 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.980+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f44725c780 con 0x55f4472612a0 2024-09-12T02:05:15.980 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:05:15.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.981+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v122'280 uv280 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.981+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f44725c780 con 0x55f4472612a0 2024-09-12T02:05:15.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.982+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v122'281 uv281 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.982+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447266e80 con 0x55f4472612a0 2024-09-12T02:05:15.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.983+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v122'282 uv282 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.983+0000 7fab0a122f40 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55f4472649f0 0x55f447266de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:15.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.983+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447267520 con 0x55f4472649f0 2024-09-12T02:05:15.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.983+0000 7fab07419640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55f4472649f0 0x55f447266de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:15.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.983+0000 7fab07419640 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55f4472649f0 0x55f447266de0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:15.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.985+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v122'120 uv119 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f4472649f0 2024-09-12T02:05:15.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.985+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f4472678c0 con 0x55f4472649f0 2024-09-12T02:05:15.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.986+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v122'121 uv121 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f4472649f0 2024-09-12T02:05:15.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.986+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472678c0 con 0x55f4472649f0 2024-09-12T02:05:15.986 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:05:15.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.987+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v122'122 uv122 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f4472649f0 2024-09-12T02:05:15.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.987+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472678c0 con 0x55f4472649f0 2024-09-12T02:05:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.988+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v122'123 uv123 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f4472649f0 2024-09-12T02:05:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.988+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472678c0 con 0x55f4472612a0 2024-09-12T02:05:15.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.989+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v122'165 uv164 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.989+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f4472678c0 con 0x55f4472612a0 2024-09-12T02:05:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.990+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v122'166 uv166 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.990+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472678c0 con 0x55f4472612a0 2024-09-12T02:05:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.991+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v122'167 uv167 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.990 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:05:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.991+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472678c0 con 0x55f4472612a0 2024-09-12T02:05:15.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.992+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v122'168 uv168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.992+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472678c0 con 0x55f4472612a0 2024-09-12T02:05:15.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.993+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v122'169 uv169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.993+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472678c0 con 0x55f4472612a0 2024-09-12T02:05:15.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.994+0000 7fab07c1a640 1 -- 172.21.15.19:0/3686677912 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v122'170 uv170 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faaf8086040 con 0x55f4472612a0 2024-09-12T02:05:15.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.994+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472678c0 con 0x55f447259070 2024-09-12T02:05:15.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.995+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v122'140 uv139 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:15.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.995+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f4472678c0 con 0x55f447259070 2024-09-12T02:05:15.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.997+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v122'141 uv141 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:15.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.997+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472678c0 con 0x55f447259070 2024-09-12T02:05:15.997 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:05:15.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.998+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v122'142 uv142 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:15.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.998+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472678c0 con 0x55f447259070 2024-09-12T02:05:15.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.999+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v122'143 uv143 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:15.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:15.999+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f4472678c0 con 0x55f447259070 2024-09-12T02:05:15.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.000+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v122'144 uv144 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:16.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.000+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447267900 con 0x55f447259070 2024-09-12T02:05:16.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.002+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v122'339 uv331 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:16.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.002+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f447267da0 con 0x55f447259070 2024-09-12T02:05:16.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.003+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v122'340 uv340 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:16.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.003+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447267da0 con 0x55f447259070 2024-09-12T02:05:16.003 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:05:16.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.004+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v122'341 uv341 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:16.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.004+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447267d50 con 0x55f447259070 2024-09-12T02:05:16.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.006+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v122'342 uv342 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:16.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.006+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447267d20 con 0x55f447259070 2024-09-12T02:05:16.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.007+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v122'343 uv343 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:16.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.007+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447267d20 con 0x55f447259070 2024-09-12T02:05:16.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.008+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v122'344 uv338 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:16.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.008+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55f447267d20 con 0x55f447259070 2024-09-12T02:05:16.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.009+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v122'345 uv345 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:16.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.009+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447267d00 con 0x55f447259070 2024-09-12T02:05:16.009 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:05:16.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.010+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v122'346 uv346 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:16.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.010+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447267d40 con 0x55f447259070 2024-09-12T02:05:16.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.012+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v122'347 uv347 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:16.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.012+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447268240 con 0x55f447259070 2024-09-12T02:05:16.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.013+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v122'348 uv348 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:16.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.013+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447268240 con 0x55f447259070 2024-09-12T02:05:16.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.014+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v122'349 uv349 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:16.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.014+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55f447268630 con 0x55f447259070 2024-09-12T02:05:16.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.015+0000 7fab07419640 1 -- 172.21.15.19:0/3686677912 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v122'350 uv350 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7faafc0168a0 con 0x55f447259070 2024-09-12T02:05:16.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55f4472547c0 msgr2=0x55f447256bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55f4472547c0 0x55f447256bb0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55f4472466b0 msgr2=0x55f447246a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55f4472466b0 0x55f447246a90 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55f44725d490 msgr2=0x55f4472602f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55f44725d490 0x55f4472602f0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55f4472649f0 msgr2=0x55f447266de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55f4472649f0 0x55f447266de0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55f447259070 msgr2=0x55f44725b460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55f447259070 0x55f44725b460 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55f4472612a0 msgr2=0x55f447263690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55f4472612a0 0x55f447263690 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 reap_dead start 2024-09-12T02:05:16.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0841b640 1 -- 172.21.15.19:0/3686677912 reap_dead start 2024-09-12T02:05:16.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faaf406a810 msgr2=0x7faaf406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faaf406a810 0x7faaf406ccd0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x55f44710b570 tx=0x7faafc005b00 comp rx=0 tx=0).stop 2024-09-12T02:05:16.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f447122f30 msgr2=0x55f4471b1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f447122f30 0x55f4471b1340 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009ec0 tx=0x7faaf8008400 comp rx=0 tx=0).stop 2024-09-12T02:05:16.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 shutdown_connections 2024-09-12T02:05:16.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faaf406a810 0x7faaf406ccd0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 --2- 172.21.15.19:0/3686677912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f447122f30 0x55f4471b1340 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 >> 172.21.15.19:0/3686677912 conn(0x55f447108490 msgr2=0x55f447108870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:16.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 shutdown_connections 2024-09-12T02:05:16.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.016+0000 7fab0a122f40 1 -- 172.21.15.19:0/3686677912 wait complete. 2024-09-12T02:05:16.020 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate mds0_inotable 0 2024-09-12T02:05:16.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.065+0000 7fcaa8b5cf40 1 Processor -- start 2024-09-12T02:05:16.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.065+0000 7fcaa8b5cf40 1 -- start start 2024-09-12T02:05:16.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa8b5cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55bf2c23d9e0 0x55bf2c3070a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa8b5cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf2c286ff0 0x55bf2c26d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa8b5cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2c314fb0 0x55bf2c284340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa8b5cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55bf2c18f510 con 0x55bf2c314fb0 2024-09-12T02:05:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa8b5cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bf2c1e8c50 con 0x55bf2c286ff0 2024-09-12T02:05:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa8b5cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55bf2c23e1c0 con 0x55bf2c23d9e0 2024-09-12T02:05:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa6e53640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2c314fb0 0x55bf2c284340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa6e53640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2c314fb0 0x55bf2c284340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38464/0 (socket says 172.21.15.19:38464) 2024-09-12T02:05:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa6e53640 1 -- 172.21.15.19:0/869328596 learned_addr learned my addr 172.21.15.19:0/869328596 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa5e51640 1 --2- 172.21.15.19:0/869328596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf2c286ff0 0x55bf2c26d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa6652640 1 --2- 172.21.15.19:0/869328596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55bf2c23d9e0 0x55bf2c3070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa6e53640 1 -- 172.21.15.19:0/869328596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55bf2c23d9e0 msgr2=0x55bf2c3070a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa6e53640 1 --2- 172.21.15.19:0/869328596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55bf2c23d9e0 0x55bf2c3070a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa6e53640 1 -- 172.21.15.19:0/869328596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf2c286ff0 msgr2=0x55bf2c26d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa6e53640 1 --2- 172.21.15.19:0/869328596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf2c286ff0 0x55bf2c26d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa6e53640 1 -- 172.21.15.19:0/869328596 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf2c312630 con 0x55bf2c314fb0 2024-09-12T02:05:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa6652640 1 --2- 172.21.15.19:0/869328596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55bf2c23d9e0 0x55bf2c3070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa6e53640 1 --2- 172.21.15.19:0/869328596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2c314fb0 0x55bf2c284340 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000a4a0 tx=0x7fcaa0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3a9d6ed183ab7f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa4e4f640 1 -- 172.21.15.19:0/869328596 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0052b40 con 0x55bf2c314fb0 2024-09-12T02:05:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa4e4f640 1 -- 172.21.15.19:0/869328596 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa0052ce0 con 0x55bf2c314fb0 2024-09-12T02:05:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.066+0000 7fcaa4e4f640 1 -- 172.21.15.19:0/869328596 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0066680 con 0x55bf2c314fb0 2024-09-12T02:05:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.067+0000 7fcaa8b5cf40 1 -- 172.21.15.19:0/869328596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2c314fb0 msgr2=0x55bf2c284340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.067+0000 7fcaa8b5cf40 1 --2- 172.21.15.19:0/869328596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2c314fb0 0x55bf2c284340 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000a4a0 tx=0x7fcaa0051000 comp rx=0 tx=0).stop 2024-09-12T02:05:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.067+0000 7fcaa8b5cf40 1 -- 172.21.15.19:0/869328596 shutdown_connections 2024-09-12T02:05:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.067+0000 7fcaa8b5cf40 1 --2- 172.21.15.19:0/869328596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2c314fb0 0x55bf2c284340 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.067+0000 7fcaa8b5cf40 1 --2- 172.21.15.19:0/869328596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf2c286ff0 0x55bf2c26d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.067+0000 7fcaa8b5cf40 1 --2- 172.21.15.19:0/869328596 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55bf2c23d9e0 0x55bf2c3070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.067+0000 7fcaa8b5cf40 1 -- 172.21.15.19:0/869328596 >> 172.21.15.19:0/869328596 conn(0x55bf2c26b490 msgr2=0x55bf2c240e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.067+0000 7fcaa8b5cf40 1 -- 172.21.15.19:0/869328596 shutdown_connections 2024-09-12T02:05:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.067+0000 7fcaa8b5cf40 1 -- 172.21.15.19:0/869328596 wait complete. 2024-09-12T02:05:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.068+0000 7fcaa8b5cf40 1 Processor -- start 2024-09-12T02:05:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.068+0000 7fcaa8b5cf40 1 -- start start 2024-09-12T02:05:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.068+0000 7fcaa8b5cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2c23d9e0 0x55bf2c3063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.068+0000 7fcaa8b5cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf2c286ff0 0x55bf2c306f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.068+0000 7fcaa8b5cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55bf2c314fb0 0x55bf2c307460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.068+0000 7fcaa8b5cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55bf2c241b90 con 0x55bf2c23d9e0 2024-09-12T02:05:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.068+0000 7fcaa8b5cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bf2c285770 con 0x55bf2c286ff0 2024-09-12T02:05:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.068+0000 7fcaa8b5cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55bf2c2413d0 con 0x55bf2c314fb0 2024-09-12T02:05:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.068+0000 7fcaa6652640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2c23d9e0 0x55bf2c3063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.068+0000 7fcaa6652640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2c23d9e0 0x55bf2c3063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38474/0 (socket says 172.21.15.19:38474) 2024-09-12T02:05:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.068+0000 7fcaa6652640 1 -- 172.21.15.19:0/920809351 learned_addr learned my addr 172.21.15.19:0/920809351 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.069+0000 7fcaa5e51640 1 --2- 172.21.15.19:0/920809351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf2c286ff0 0x55bf2c306f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.069+0000 7fcaa6e53640 1 --2- 172.21.15.19:0/920809351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55bf2c314fb0 0x55bf2c307460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.069+0000 7fcaa6652640 1 -- 172.21.15.19:0/920809351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55bf2c314fb0 msgr2=0x55bf2c307460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.069+0000 7fcaa6652640 1 --2- 172.21.15.19:0/920809351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55bf2c314fb0 0x55bf2c307460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.069+0000 7fcaa6652640 1 -- 172.21.15.19:0/920809351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf2c286ff0 msgr2=0x55bf2c306f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.069+0000 7fcaa6652640 1 --2- 172.21.15.19:0/920809351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf2c286ff0 0x55bf2c306f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.069+0000 7fcaa6652640 1 -- 172.21.15.19:0/920809351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf2c30c8f0 con 0x55bf2c23d9e0 2024-09-12T02:05:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.069+0000 7fcaa6652640 1 --2- 172.21.15.19:0/920809351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2c23d9e0 0x55bf2c3063a0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fca9800cf40 tx=0x7fca9800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.069+0000 7fca977fe640 1 -- 172.21.15.19:0/920809351 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98014070 con 0x55bf2c23d9e0 2024-09-12T02:05:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.069+0000 7fca977fe640 1 -- 172.21.15.19:0/920809351 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9800ae30 con 0x55bf2c23d9e0 2024-09-12T02:05:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.069+0000 7fcaa8b5cf40 1 -- 172.21.15.19:0/920809351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf2c30ba90 con 0x55bf2c23d9e0 2024-09-12T02:05:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.069+0000 7fca977fe640 1 -- 172.21.15.19:0/920809351 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98010880 con 0x55bf2c23d9e0 2024-09-12T02:05:16.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.069+0000 7fcaa8b5cf40 1 -- 172.21.15.19:0/920809351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf2c30c050 con 0x55bf2c23d9e0 2024-09-12T02:05:16.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.071+0000 7fca977fe640 1 -- 172.21.15.19:0/920809351 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca98017070 con 0x55bf2c23d9e0 2024-09-12T02:05:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.071+0000 7fca977fe640 1 --2- 172.21.15.19:0/920809351 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca8806a810 0x7fca8806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.071+0000 7fca977fe640 1 -- 172.21.15.19:0/920809351 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8625+0+0 (secure 0 0 0) 0x7fca9808a410 con 0x55bf2c23d9e0 2024-09-12T02:05:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.071+0000 7fcaa5e51640 1 --2- 172.21.15.19:0/920809351 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca8806a810 0x7fca8806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.071+0000 7fcaa8b5cf40 1 --2- 172.21.15.19:0/920809351 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55bf2c316c90 0x55bf2c317070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.071+0000 7fcaa8b5cf40 1 -- 172.21.15.19:0/920809351 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:1 13.13 13:c91d4a1d:::mds0_inotable:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55bf2c30e8a0 con 0x55bf2c316c90 2024-09-12T02:05:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.071+0000 7fcaa6e53640 1 --2- 172.21.15.19:0/920809351 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55bf2c316c90 0x55bf2c317070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.072+0000 7fcaa5e51640 1 --2- 172.21.15.19:0/920809351 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca8806a810 0x7fca8806ccd0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x55bf2c313140 tx=0x7fca9c0017c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.072+0000 7fcaa6e53640 1 --2- 172.21.15.19:0/920809351 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55bf2c316c90 0x55bf2c317070 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.073+0000 7fcaa6e53640 1 -- 172.21.15.19:0/920809351 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(1 mds0_inotable [truncate 0] v122'283 uv283 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcaa0052940 con 0x55bf2c316c90 2024-09-12T02:05:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.073+0000 7fcaa8b5cf40 1 -- 172.21.15.19:0/920809351 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55bf2c316c90 msgr2=0x55bf2c317070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.073+0000 7fcaa8b5cf40 1 --2- 172.21.15.19:0/920809351 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55bf2c316c90 0x55bf2c317070 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.073+0000 7fcaa8b5cf40 1 -- 172.21.15.19:0/920809351 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca8806a810 msgr2=0x7fca8806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.073+0000 7fcaa8b5cf40 1 --2- 172.21.15.19:0/920809351 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fca8806a810 0x7fca8806ccd0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x55bf2c313140 tx=0x7fca9c0017c0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.073+0000 7fcaa8b5cf40 1 -- 172.21.15.19:0/920809351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2c23d9e0 msgr2=0x55bf2c3063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.073+0000 7fcaa8b5cf40 1 --2- 172.21.15.19:0/920809351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2c23d9e0 0x55bf2c3063a0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fca9800cf40 tx=0x7fca9800a660 comp rx=0 tx=0).stop 2024-09-12T02:05:16.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.073+0000 7fcaa6e53640 1 -- 172.21.15.19:0/920809351 reap_dead start 2024-09-12T02:05:16.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.073+0000 7fcaa8b5cf40 1 -- 172.21.15.19:0/920809351 shutdown_connections 2024-09-12T02:05:16.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.073+0000 7fcaa8b5cf40 1 -- 172.21.15.19:0/920809351 >> 172.21.15.19:0/920809351 conn(0x55bf2c26b490 msgr2=0x55bf2c26d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:16.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.073+0000 7fcaa8b5cf40 1 -- 172.21.15.19:0/920809351 shutdown_connections 2024-09-12T02:05:16.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.073+0000 7fcaa8b5cf40 1 -- 172.21.15.19:0/920809351 wait complete. 2024-09-12T02:05:16.077 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:05:16.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.223+0000 7f9de1d91640 1 Processor -- start 2024-09-12T02:05:16.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.223+0000 7f9de1d91640 1 -- start start 2024-09-12T02:05:16.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.224+0000 7f9de1d91640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ddc072760 0x7f9ddc0b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.224+0000 7f9de1d91640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ddc0b4620 con 0x7f9ddc15e900 2024-09-12T02:05:16.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.224+0000 7f9de1d91640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ddc0ce100 con 0x7f9ddc0b4020 2024-09-12T02:05:16.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.224+0000 7f9de1d91640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9ddc0b4f60 con 0x7f9ddc072760 2024-09-12T02:05:16.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.224+0000 7f9ddb7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9ddc15e900 0x7f9ddc0ad020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53370/0 (socket says 172.21.15.19:53370) 2024-09-12T02:05:16.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.224+0000 7f9ddb7fe640 1 -- 172.21.15.19:0/3681316754 learned_addr learned my addr 172.21.15.19:0/3681316754 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:16.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.224+0000 7f9ddbfff640 1 --2- 172.21.15.19:0/3681316754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ddc072760 0x7f9ddc0b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.224+0000 7f9dda7fc640 1 -- 172.21.15.19:0/3681316754 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1533610568 0 0) 0x7f9ddc0b4620 con 0x7f9ddc15e900 2024-09-12T02:05:16.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.224+0000 7f9dda7fc640 1 -- 172.21.15.19:0/3681316754 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dc4003520 con 0x7f9ddc15e900 2024-09-12T02:05:16.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.224+0000 7f9dda7fc640 1 -- 172.21.15.19:0/3681316754 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3978099837 0 0) 0x7f9ddc0ce100 con 0x7f9ddc0b4020 2024-09-12T02:05:16.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.224+0000 7f9dda7fc640 1 -- 172.21.15.19:0/3681316754 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ddc0b4620 con 0x7f9ddc0b4020 2024-09-12T02:05:16.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.224+0000 7f9ddbfff640 1 -- 172.21.15.19:0/3681316754 >> v1:172.21.15.135:6789/0 conn(0x7f9ddc0b4020 legacy=0x7f9ddc072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.224+0000 7f9ddbfff640 1 -- 172.21.15.19:0/3681316754 >> v1:172.21.15.19:6789/0 conn(0x7f9ddc15e900 legacy=0x7f9ddc0ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.224+0000 7f9ddbfff640 1 -- 172.21.15.19:0/3681316754 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ddc0ce3a0 con 0x7f9ddc072760 2024-09-12T02:05:16.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.225+0000 7f9ddbfff640 1 --2- 172.21.15.19:0/3681316754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ddc072760 0x7f9ddc0b4a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4009dc0 tx=0x7f9dd402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eccfeadcd961023 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:16.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.225+0000 7f9dda7fc640 1 -- 172.21.15.19:0/3681316754 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd402ae60 con 0x7f9ddc072760 2024-09-12T02:05:16.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.225+0000 7f9dda7fc640 1 -- 172.21.15.19:0/3681316754 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd4007740 con 0x7f9ddc072760 2024-09-12T02:05:16.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.225+0000 7f9dda7fc640 1 -- 172.21.15.19:0/3681316754 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4007b10 con 0x7f9ddc072760 2024-09-12T02:05:16.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.226+0000 7f9de1d91640 1 -- 172.21.15.19:0/3681316754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ddc072760 msgr2=0x7f9ddc0b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.226+0000 7f9de1d91640 1 --2- 172.21.15.19:0/3681316754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ddc072760 0x7f9ddc0b4a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4009dc0 tx=0x7f9dd402a640 comp rx=0 tx=0).stop 2024-09-12T02:05:16.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.226+0000 7f9de1d91640 1 -- 172.21.15.19:0/3681316754 shutdown_connections 2024-09-12T02:05:16.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.226+0000 7f9de1d91640 1 --2- 172.21.15.19:0/3681316754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ddc072760 0x7f9ddc0b4a20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.226+0000 7f9de1d91640 1 -- 172.21.15.19:0/3681316754 >> 172.21.15.19:0/3681316754 conn(0x7f9ddc06bdf0 msgr2=0x7f9ddc06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:16.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.226+0000 7f9de1d91640 1 -- 172.21.15.19:0/3681316754 shutdown_connections 2024-09-12T02:05:16.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.226+0000 7f9de1d91640 1 -- 172.21.15.19:0/3681316754 wait complete. 2024-09-12T02:05:16.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.227+0000 7f9de1d91640 1 Processor -- start 2024-09-12T02:05:16.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.227+0000 7f9de1d91640 1 -- start start 2024-09-12T02:05:16.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.228+0000 7f9de1d91640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ddc072760 0x7f9ddc0ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.228+0000 7f9de1d91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ddc0b4020 0x7f9ddc155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.228+0000 7f9de1d91640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ddc15e900 0x7f9ddc1f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.228+0000 7f9de1d91640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc0cee80 con 0x7f9ddc0b4020 2024-09-12T02:05:16.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.228+0000 7f9de1d91640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc0ce960 con 0x7f9ddc15e900 2024-09-12T02:05:16.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.228+0000 7f9de1d91640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9ddc0cf000 con 0x7f9ddc072760 2024-09-12T02:05:16.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.228+0000 7f9ddaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ddc0b4020 0x7f9ddc155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.228+0000 7f9ddaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ddc0b4020 0x7f9ddc155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38486/0 (socket says 172.21.15.19:38486) 2024-09-12T02:05:16.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.228+0000 7f9ddaffd640 1 -- 172.21.15.19:0/3155539195 learned_addr learned my addr 172.21.15.19:0/3155539195 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:16.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.228+0000 7f9ddb7fe640 1 --2- 172.21.15.19:0/3155539195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ddc072760 0x7f9ddc0ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.228+0000 7f9ddaffd640 1 -- 172.21.15.19:0/3155539195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ddc072760 msgr2=0x7f9ddc0ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.228+0000 7f9ddaffd640 1 --2- 172.21.15.19:0/3155539195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ddc072760 0x7f9ddc0ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.228+0000 7f9ddaffd640 1 -- 172.21.15.19:0/3155539195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ddc15e900 msgr2=0x7f9ddc1f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.228+0000 7f9ddbfff640 1 --2- 172.21.15.19:0/3155539195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ddc15e900 0x7f9ddc1f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.228+0000 7f9ddaffd640 1 --2- 172.21.15.19:0/3155539195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ddc15e900 0x7f9ddc1f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.228+0000 7f9ddaffd640 1 -- 172.21.15.19:0/3155539195 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ddc153f70 con 0x7f9ddc0b4020 2024-09-12T02:05:16.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.228+0000 7f9ddbfff640 1 --2- 172.21.15.19:0/3155539195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ddc15e900 0x7f9ddc1f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:16.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.228+0000 7f9ddaffd640 1 --2- 172.21.15.19:0/3155539195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ddc0b4020 0x7f9ddc155010 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000c500 tx=0x7f9dd000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:16.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.229+0000 7f9dc3fff640 1 -- 172.21.15.19:0/3155539195 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00052d0 con 0x7f9ddc0b4020 2024-09-12T02:05:16.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.229+0000 7f9dc3fff640 1 -- 172.21.15.19:0/3155539195 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd0005490 con 0x7f9ddc0b4020 2024-09-12T02:05:16.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.229+0000 7f9dc3fff640 1 -- 172.21.15.19:0/3155539195 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0012870 con 0x7f9ddc0b4020 2024-09-12T02:05:16.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.229+0000 7f9de1d91640 1 -- 172.21.15.19:0/3155539195 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ddc154250 con 0x7f9ddc0b4020 2024-09-12T02:05:16.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.229+0000 7f9de1d91640 1 -- 172.21.15.19:0/3155539195 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ddc154810 con 0x7f9ddc0b4020 2024-09-12T02:05:16.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.230+0000 7f9de1d91640 1 -- 172.21.15.19:0/3155539195 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ddc0b4a20 con 0x7f9ddc0b4020 2024-09-12T02:05:16.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.230+0000 7f9dc3fff640 1 -- 172.21.15.19:0/3155539195 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9dd0012a10 con 0x7f9ddc0b4020 2024-09-12T02:05:16.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.231+0000 7f9dc3fff640 1 --2- 172.21.15.19:0/3155539195 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9dc806be30 0x7f9dc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.231+0000 7f9dc3fff640 1 -- 172.21.15.19:0/3155539195 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8625+0+0 (secure 0 0 0) 0x7f9dd008b6f0 con 0x7f9ddc0b4020 2024-09-12T02:05:16.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.231+0000 7f9ddb7fe640 1 --2- 172.21.15.19:0/3155539195 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9dc806be30 0x7f9dc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.232+0000 7f9ddb7fe640 1 --2- 172.21.15.19:0/3155539195 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9dc806be30 0x7f9dc806e2f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0011e0 tx=0x7f9dcc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:16.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.235+0000 7f9dc3fff640 1 -- 172.21.15.19:0/3155539195 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9dd00594f0 con 0x7f9ddc0b4020 2024-09-12T02:05:16.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.452+0000 7f9de1d91640 1 -- 172.21.15.19:0/3155539195 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f9ddc06c270 con 0x7f9ddc0b4020 2024-09-12T02:05:16.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.745+0000 7f9dc3fff640 1 -- 172.21.15.19:0/3155539195 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v243) ==== 162+0+0 (secure 0 0 0) 0x7f9dd0058df0 con 0x7f9ddc0b4020 2024-09-12T02:05:16.745 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:05:16.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.747+0000 7f9de1d91640 1 -- 172.21.15.19:0/3155539195 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9dc806be30 msgr2=0x7f9dc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.747+0000 7f9de1d91640 1 --2- 172.21.15.19:0/3155539195 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9dc806be30 0x7f9dc806e2f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0011e0 tx=0x7f9dcc009040 comp rx=0 tx=0).stop 2024-09-12T02:05:16.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.747+0000 7f9de1d91640 1 -- 172.21.15.19:0/3155539195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ddc0b4020 msgr2=0x7f9ddc155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.747+0000 7f9de1d91640 1 --2- 172.21.15.19:0/3155539195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ddc0b4020 0x7f9ddc155010 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000c500 tx=0x7f9dd000c9c0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.747+0000 7f9de1d91640 1 -- 172.21.15.19:0/3155539195 shutdown_connections 2024-09-12T02:05:16.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.747+0000 7f9de1d91640 1 --2- 172.21.15.19:0/3155539195 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9dc806be30 0x7f9dc806e2f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.747+0000 7f9de1d91640 1 --2- 172.21.15.19:0/3155539195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ddc15e900 0x7f9ddc1f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.747+0000 7f9de1d91640 1 --2- 172.21.15.19:0/3155539195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ddc0b4020 0x7f9ddc155010 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.747+0000 7f9de1d91640 1 --2- 172.21.15.19:0/3155539195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ddc072760 0x7f9ddc0ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.747+0000 7f9de1d91640 1 -- 172.21.15.19:0/3155539195 >> 172.21.15.19:0/3155539195 conn(0x7f9ddc06bdf0 msgr2=0x7f9ddc15ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:16.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.748+0000 7f9de1d91640 1 -- 172.21.15.19:0/3155539195 shutdown_connections 2024-09-12T02:05:16.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.748+0000 7f9de1d91640 1 -- 172.21.15.19:0/3155539195 wait complete. 2024-09-12T02:05:16.750 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:05:16.750+0000 7f0c1b74b640 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds0_inotable': End of buffer [buffer:2] 2024-09-12T02:05:16.750 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:05:16.751+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:05:16.750 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:05:16.751+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:05:16.760 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:16.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.865+0000 7fa4179c0640 1 Processor -- start 2024-09-12T02:05:16.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.865+0000 7fa4179c0640 1 -- start start 2024-09-12T02:05:16.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.866+0000 7fa4179c0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa4100b6690 0x7fa4101691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.866+0000 7fa4179c0640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4100d3690 con 0x7fa4100d30f0 2024-09-12T02:05:16.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.866+0000 7fa4179c0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4100d3970 con 0x7fa41015e5f0 2024-09-12T02:05:16.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.866+0000 7fa4179c0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa41006d530 con 0x7fa4100b6690 2024-09-12T02:05:16.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.866+0000 7fa414f5b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa4100d30f0 0x7fa4100b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53378/0 (socket says 172.21.15.19:53378) 2024-09-12T02:05:16.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.866+0000 7fa414f5b640 1 -- 172.21.15.19:0/2028472958 learned_addr learned my addr 172.21.15.19:0/2028472958 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:16.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.866+0000 7fa415f5d640 1 --2- 172.21.15.19:0/2028472958 >> v2:172.21.15.135:3300/0 conn(0x7fa4100b6690 0x7fa4101691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.866+0000 7fa40ffff640 1 -- 172.21.15.19:0/2028472958 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3703503378 0 0) 0x7fa4100d3690 con 0x7fa4100d30f0 2024-09-12T02:05:16.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.866+0000 7fa40ffff640 1 -- 172.21.15.19:0/2028472958 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3f8003520 con 0x7fa4100d30f0 2024-09-12T02:05:16.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.867+0000 7fa40ffff640 1 -- 172.21.15.19:0/2028472958 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1965329511 0 0) 0x7fa4100d3970 con 0x7fa41015e5f0 2024-09-12T02:05:16.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.867+0000 7fa40ffff640 1 -- 172.21.15.19:0/2028472958 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4100d3690 con 0x7fa41015e5f0 2024-09-12T02:05:16.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.867+0000 7fa415f5d640 1 -- 172.21.15.19:0/2028472958 >> v1:172.21.15.135:6789/0 conn(0x7fa41015e5f0 legacy=0x7fa4100d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.867+0000 7fa415f5d640 1 -- 172.21.15.19:0/2028472958 >> v1:172.21.15.19:6789/0 conn(0x7fa4100d30f0 legacy=0x7fa4100b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.867+0000 7fa40ffff640 1 -- 172.21.15.19:0/2028472958 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 973658423 0 0) 0x7fa3f8003520 con 0x7fa4100d30f0 2024-09-12T02:05:16.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.867+0000 7fa415f5d640 1 -- 172.21.15.19:0/2028472958 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa41006cee0 con 0x7fa4100b6690 2024-09-12T02:05:16.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.868+0000 7fa415f5d640 1 --2- 172.21.15.19:0/2028472958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4100b6690 0x7fa4101691a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa4080097d0 tx=0x7fa40802a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da4256848976402b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:16.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.868+0000 7fa40ffff640 1 -- 172.21.15.19:0/2028472958 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408037070 con 0x7fa4100b6690 2024-09-12T02:05:16.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.868+0000 7fa40ffff640 1 -- 172.21.15.19:0/2028472958 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40802ac90 con 0x7fa4100b6690 2024-09-12T02:05:16.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.868+0000 7fa40ffff640 1 -- 172.21.15.19:0/2028472958 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa404001670 con 0x7fa4100b6690 2024-09-12T02:05:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.868+0000 7fa4179c0640 1 -- 172.21.15.19:0/2028472958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4100b6690 msgr2=0x7fa4101691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.868+0000 7fa4179c0640 1 --2- 172.21.15.19:0/2028472958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4100b6690 0x7fa4101691a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa4080097d0 tx=0x7fa40802a200 comp rx=0 tx=0).stop 2024-09-12T02:05:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.868+0000 7fa4179c0640 1 -- 172.21.15.19:0/2028472958 shutdown_connections 2024-09-12T02:05:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.868+0000 7fa4179c0640 1 --2- 172.21.15.19:0/2028472958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4100b6690 0x7fa4101691a0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.868+0000 7fa4179c0640 1 -- 172.21.15.19:0/2028472958 >> 172.21.15.19:0/2028472958 conn(0x7fa41008bfc0 msgr2=0x7fa4100d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.868+0000 7fa4179c0640 1 -- 172.21.15.19:0/2028472958 shutdown_connections 2024-09-12T02:05:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.868+0000 7fa4179c0640 1 -- 172.21.15.19:0/2028472958 wait complete. 2024-09-12T02:05:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.869+0000 7fa4179c0640 1 Processor -- start 2024-09-12T02:05:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.870+0000 7fa4179c0640 1 -- start start 2024-09-12T02:05:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.870+0000 7fa4179c0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4100b6690 0x7fa41014baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.870+0000 7fa4179c0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4100d30f0 0x7fa4100c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.870+0000 7fa4179c0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa41015e5f0 0x7fa4100b8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.870+0000 7fa4179c0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa41006e9d0 con 0x7fa41015e5f0 2024-09-12T02:05:16.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.870+0000 7fa4179c0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa41015e9d0 con 0x7fa4100d30f0 2024-09-12T02:05:16.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.870+0000 7fa4179c0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa41006eb50 con 0x7fa4100b6690 2024-09-12T02:05:16.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.870+0000 7fa415f5d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa41015e5f0 0x7fa4100b8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.870+0000 7fa415f5d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa41015e5f0 0x7fa4100b8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38502/0 (socket says 172.21.15.19:38502) 2024-09-12T02:05:16.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.870+0000 7fa415f5d640 1 -- 172.21.15.19:0/3086897970 learned_addr learned my addr 172.21.15.19:0/3086897970 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:16.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.871+0000 7fa414f5b640 1 --2- 172.21.15.19:0/3086897970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4100d30f0 0x7fa4100c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.871+0000 7fa41575c640 1 --2- 172.21.15.19:0/3086897970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4100b6690 0x7fa41014baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.871+0000 7fa415f5d640 1 -- 172.21.15.19:0/3086897970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4100b6690 msgr2=0x7fa41014baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.871+0000 7fa415f5d640 1 --2- 172.21.15.19:0/3086897970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4100b6690 0x7fa41014baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.871+0000 7fa415f5d640 1 -- 172.21.15.19:0/3086897970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4100d30f0 msgr2=0x7fa4100c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.871+0000 7fa415f5d640 1 --2- 172.21.15.19:0/3086897970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4100d30f0 0x7fa4100c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.871+0000 7fa415f5d640 1 -- 172.21.15.19:0/3086897970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4100caf90 con 0x7fa41015e5f0 2024-09-12T02:05:16.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.871+0000 7fa415f5d640 1 --2- 172.21.15.19:0/3086897970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa41015e5f0 0x7fa4100b8fb0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fa4080097d0 tx=0x7fa4080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:16.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.871+0000 7fa40dffb640 1 -- 172.21.15.19:0/3086897970 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408041020 con 0x7fa41015e5f0 2024-09-12T02:05:16.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.871+0000 7fa40dffb640 1 -- 172.21.15.19:0/3086897970 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40803d620 con 0x7fa41015e5f0 2024-09-12T02:05:16.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.871+0000 7fa4179c0640 1 -- 172.21.15.19:0/3086897970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4100ca410 con 0x7fa41015e5f0 2024-09-12T02:05:16.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.871+0000 7fa40dffb640 1 -- 172.21.15.19:0/3086897970 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408037040 con 0x7fa41015e5f0 2024-09-12T02:05:16.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.871+0000 7fa4179c0640 1 -- 172.21.15.19:0/3086897970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4100ca9d0 con 0x7fa41015e5f0 2024-09-12T02:05:16.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.872+0000 7fa4179c0640 1 -- 172.21.15.19:0/3086897970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4100b5f80 con 0x7fa41015e5f0 2024-09-12T02:05:16.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.873+0000 7fa40dffb640 1 -- 172.21.15.19:0/3086897970 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa408044020 con 0x7fa41015e5f0 2024-09-12T02:05:16.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.873+0000 7fa40dffb640 1 --2- 172.21.15.19:0/3086897970 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa3fc06be30 0x7fa3fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.873+0000 7fa40dffb640 1 -- 172.21.15.19:0/3086897970 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 8711+0+0 (secure 0 0 0) 0x7fa4080abe30 con 0x7fa41015e5f0 2024-09-12T02:05:16.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.874+0000 7fa41575c640 1 --2- 172.21.15.19:0/3086897970 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa3fc06be30 0x7fa3fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.874+0000 7fa41575c640 1 --2- 172.21.15.19:0/3086897970 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa3fc06be30 0x7fa3fc06e2f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa400001560 tx=0x7fa400009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:16.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:16.878+0000 7fa40dffb640 1 -- 172.21.15.19:0/3086897970 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa40804b030 con 0x7fa41015e5f0 2024-09-12T02:05:17.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.088+0000 7fa4179c0640 1 -- 172.21.15.19:0/3086897970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4100b3270 con 0x7fa41015e5f0 2024-09-12T02:05:17.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.089+0000 7fa40dffb640 1 -- 172.21.15.19:0/3086897970 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 244 v244) ==== 95+0+3563 (secure 0 0 0) 0x7fa408079bd0 con 0x7fa41015e5f0 2024-09-12T02:05:17.088 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:17.089 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":244,"btime":"2024-09-12T02:05:16:751850+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":244,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:16.751801+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":123,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:17.089 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 244 2024-09-12T02:05:17.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.091+0000 7fa4179c0640 1 -- 172.21.15.19:0/3086897970 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa3fc06be30 msgr2=0x7fa3fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:17.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.091+0000 7fa4179c0640 1 --2- 172.21.15.19:0/3086897970 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa3fc06be30 0x7fa3fc06e2f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa400001560 tx=0x7fa400009040 comp rx=0 tx=0).stop 2024-09-12T02:05:17.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.091+0000 7fa4179c0640 1 -- 172.21.15.19:0/3086897970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa41015e5f0 msgr2=0x7fa4100b8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:17.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.091+0000 7fa4179c0640 1 --2- 172.21.15.19:0/3086897970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa41015e5f0 0x7fa4100b8fb0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fa4080097d0 tx=0x7fa4080046c0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.091+0000 7fa4179c0640 1 -- 172.21.15.19:0/3086897970 shutdown_connections 2024-09-12T02:05:17.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.091+0000 7fa4179c0640 1 --2- 172.21.15.19:0/3086897970 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa3fc06be30 0x7fa3fc06e2f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.091+0000 7fa4179c0640 1 --2- 172.21.15.19:0/3086897970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa41015e5f0 0x7fa4100b8fb0 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.091+0000 7fa4179c0640 1 --2- 172.21.15.19:0/3086897970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4100d30f0 0x7fa4100c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.091+0000 7fa4179c0640 1 --2- 172.21.15.19:0/3086897970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4100b6690 0x7fa41014baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.091+0000 7fa4179c0640 1 -- 172.21.15.19:0/3086897970 >> 172.21.15.19:0/3086897970 conn(0x7fa41008bfc0 msgr2=0x7fa4100cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:17.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.091+0000 7fa4179c0640 1 -- 172.21.15.19:0/3086897970 shutdown_connections 2024-09-12T02:05:17.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.091+0000 7fa4179c0640 1 -- 172.21.15.19:0/3086897970 wait complete. 2024-09-12T02:05:17.101 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:05:17.101 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:17.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.204+0000 7f0b68077640 1 Processor -- start 2024-09-12T02:05:17.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.204+0000 7f0b68077640 1 -- start start 2024-09-12T02:05:17.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.205+0000 7f0b68077640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b600cfcc0 0x7f0b6006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:17.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.205+0000 7f0b68077640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0b600d4fd0 0x7f0b600d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:17.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.205+0000 7f0b68077640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b600d2700 con 0x7f0b6015e760 2024-09-12T02:05:17.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.205+0000 7f0b68077640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f0b600cedb0 con 0x7f0b600d4fd0 2024-09-12T02:05:17.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.205+0000 7f0b68077640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0b600cf090 con 0x7f0b600cfcc0 2024-09-12T02:05:17.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.205+0000 7f0b66614640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0b600d4fd0 0x7f0b600d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:17.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.205+0000 7f0b65e13640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0b6015e760 0x7f0b600cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53380/0 (socket says 172.21.15.19:53380) 2024-09-12T02:05:17.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.205+0000 7f0b66614640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0b600d4fd0 0x7f0b600d2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38510/0 (socket says 172.21.15.19:38510) 2024-09-12T02:05:17.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.205+0000 7f0b65e13640 1 -- 172.21.15.19:0/1807265625 learned_addr learned my addr 172.21.15.19:0/1807265625 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:17.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.206+0000 7f0b65612640 1 --2- 172.21.15.19:0/1807265625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b600cfcc0 0x7f0b6006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:17.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.206+0000 7f0b66614640 1 -- 172.21.15.19:0/1807265625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b600cfcc0 msgr2=0x7f0b6006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:17.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.206+0000 7f0b66614640 1 --2- 172.21.15.19:0/1807265625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b600cfcc0 0x7f0b6006cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.206+0000 7f0b66614640 1 -- 172.21.15.19:0/1807265625 >> v1:172.21.15.19:6789/0 conn(0x7f0b6015e760 legacy=0x7f0b600cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:17.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.206+0000 7f0b66614640 1 -- 172.21.15.19:0/1807265625 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b600b3c80 con 0x7f0b600d4fd0 2024-09-12T02:05:17.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.206+0000 7f0b66614640 1 --2- 172.21.15.19:0/1807265625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b600d4fd0 0x7f0b600d2ea0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f0b580097a0 tx=0x7f0b5802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ebe4e59a52f48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:17.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.207+0000 7f0b64e11640 1 -- 172.21.15.19:0/1807265625 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58037070 con 0x7f0b600d4fd0 2024-09-12T02:05:17.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.207+0000 7f0b64e11640 1 -- 172.21.15.19:0/1807265625 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b58032440 con 0x7f0b600d4fd0 2024-09-12T02:05:17.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.207+0000 7f0b64e11640 1 -- 172.21.15.19:0/1807265625 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58032810 con 0x7f0b600d4fd0 2024-09-12T02:05:17.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.207+0000 7f0b68077640 1 -- 172.21.15.19:0/1807265625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b600d4fd0 msgr2=0x7f0b600d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:17.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.207+0000 7f0b68077640 1 --2- 172.21.15.19:0/1807265625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b600d4fd0 0x7f0b600d2ea0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f0b580097a0 tx=0x7f0b5802a180 comp rx=0 tx=0).stop 2024-09-12T02:05:17.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.207+0000 7f0b68077640 1 -- 172.21.15.19:0/1807265625 shutdown_connections 2024-09-12T02:05:17.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.207+0000 7f0b68077640 1 --2- 172.21.15.19:0/1807265625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b600d4fd0 0x7f0b600d2ea0 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.207+0000 7f0b68077640 1 --2- 172.21.15.19:0/1807265625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b600cfcc0 0x7f0b6006cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.207+0000 7f0b68077640 1 -- 172.21.15.19:0/1807265625 >> 172.21.15.19:0/1807265625 conn(0x7f0b6008bfc0 msgr2=0x7f0b600d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:17.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.207+0000 7f0b68077640 1 -- 172.21.15.19:0/1807265625 shutdown_connections 2024-09-12T02:05:17.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.207+0000 7f0b68077640 1 -- 172.21.15.19:0/1807265625 wait complete. 2024-09-12T02:05:17.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.208+0000 7f0b68077640 1 Processor -- start 2024-09-12T02:05:17.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.208+0000 7f0b68077640 1 -- start start 2024-09-12T02:05:17.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.209+0000 7f0b68077640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b600cfcc0 0x7f0b600cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:17.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.209+0000 7f0b68077640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b600d4fd0 0x7f0b60157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:17.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.209+0000 7f0b68077640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b6015e760 0x7f0b6015f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:17.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.209+0000 7f0b68077640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0b600d33e0 con 0x7f0b600cfcc0 2024-09-12T02:05:17.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.209+0000 7f0b68077640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b600b38a0 con 0x7f0b600d4fd0 2024-09-12T02:05:17.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.209+0000 7f0b68077640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0b600d3560 con 0x7f0b6015e760 2024-09-12T02:05:17.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.209+0000 7f0b65e13640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b600cfcc0 0x7f0b600cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:17.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.209+0000 7f0b65e13640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b600cfcc0 0x7f0b600cb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38518/0 (socket says 172.21.15.19:38518) 2024-09-12T02:05:17.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.209+0000 7f0b65e13640 1 -- 172.21.15.19:0/674481401 learned_addr learned my addr 172.21.15.19:0/674481401 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:17.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.209+0000 7f0b65612640 1 --2- 172.21.15.19:0/674481401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b600d4fd0 0x7f0b60157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:17.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.209+0000 7f0b66614640 1 --2- 172.21.15.19:0/674481401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b6015e760 0x7f0b6015f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:17.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.209+0000 7f0b65e13640 1 -- 172.21.15.19:0/674481401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b6015e760 msgr2=0x7f0b6015f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:17.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.209+0000 7f0b65e13640 1 --2- 172.21.15.19:0/674481401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b6015e760 0x7f0b6015f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.210+0000 7f0b65e13640 1 -- 172.21.15.19:0/674481401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b600d4fd0 msgr2=0x7f0b60157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:17.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.210+0000 7f0b65e13640 1 --2- 172.21.15.19:0/674481401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b600d4fd0 0x7f0b60157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.210+0000 7f0b65e13640 1 -- 172.21.15.19:0/674481401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b60157ca0 con 0x7f0b600cfcc0 2024-09-12T02:05:17.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.210+0000 7f0b65e13640 1 --2- 172.21.15.19:0/674481401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b600cfcc0 0x7f0b600cb620 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00caa0 tx=0x7f0b5c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:17.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.210+0000 7f0b567fc640 1 -- 172.21.15.19:0/674481401 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c017070 con 0x7f0b600cfcc0 2024-09-12T02:05:17.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.210+0000 7f0b567fc640 1 -- 172.21.15.19:0/674481401 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b5c00ac00 con 0x7f0b600cfcc0 2024-09-12T02:05:17.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.210+0000 7f0b68077640 1 -- 172.21.15.19:0/674481401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b601602d0 con 0x7f0b600cfcc0 2024-09-12T02:05:17.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.210+0000 7f0b567fc640 1 -- 172.21.15.19:0/674481401 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c012400 con 0x7f0b600cfcc0 2024-09-12T02:05:17.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.210+0000 7f0b68077640 1 -- 172.21.15.19:0/674481401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b6015a2c0 con 0x7f0b600cfcc0 2024-09-12T02:05:17.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.211+0000 7f0b68077640 1 -- 172.21.15.19:0/674481401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b600d38e0 con 0x7f0b600cfcc0 2024-09-12T02:05:17.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.211+0000 7f0b567fc640 1 -- 172.21.15.19:0/674481401 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b5c01a070 con 0x7f0b600cfcc0 2024-09-12T02:05:17.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.212+0000 7f0b567fc640 1 --2- 172.21.15.19:0/674481401 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0b4406be60 0x7f0b4406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:17.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.212+0000 7f0b567fc640 1 -- 172.21.15.19:0/674481401 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 8711+0+0 (secure 0 0 0) 0x7f0b5c08b7a0 con 0x7f0b600cfcc0 2024-09-12T02:05:17.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.212+0000 7f0b65612640 1 --2- 172.21.15.19:0/674481401 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0b4406be60 0x7f0b4406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:17.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.213+0000 7f0b65612640 1 --2- 172.21.15.19:0/674481401 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0b4406be60 0x7f0b4406e320 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0b601f7b40 tx=0x7f0b50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:17.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.216+0000 7f0b567fc640 1 -- 172.21.15.19:0/674481401 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b600d2700 con 0x7f0b600cfcc0 2024-09-12T02:05:17.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.427+0000 7f0b68077640 1 -- 172.21.15.19:0/674481401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b600b6d20 con 0x7f0b600cfcc0 2024-09-12T02:05:17.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.427+0000 7f0b567fc640 1 -- 172.21.15.19:0/674481401 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 244 v244) ==== 95+0+3563 (secure 0 0 0) 0x7f0b5c059540 con 0x7f0b600cfcc0 2024-09-12T02:05:17.427 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:17.427 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":244,"btime":"2024-09-12T02:05:16:751850+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":244,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:16.751801+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":123,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:17.427 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 244 2024-09-12T02:05:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.429+0000 7f0b68077640 1 -- 172.21.15.19:0/674481401 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0b4406be60 msgr2=0x7f0b4406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.429+0000 7f0b68077640 1 --2- 172.21.15.19:0/674481401 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0b4406be60 0x7f0b4406e320 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0b601f7b40 tx=0x7f0b50008040 comp rx=0 tx=0).stop 2024-09-12T02:05:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.429+0000 7f0b68077640 1 -- 172.21.15.19:0/674481401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b600cfcc0 msgr2=0x7f0b600cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.429+0000 7f0b68077640 1 --2- 172.21.15.19:0/674481401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b600cfcc0 0x7f0b600cb620 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00caa0 tx=0x7f0b5c00cf60 comp rx=0 tx=0).stop 2024-09-12T02:05:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.429+0000 7f0b68077640 1 -- 172.21.15.19:0/674481401 shutdown_connections 2024-09-12T02:05:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.429+0000 7f0b68077640 1 --2- 172.21.15.19:0/674481401 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0b4406be60 0x7f0b4406e320 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.429+0000 7f0b68077640 1 --2- 172.21.15.19:0/674481401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b6015e760 0x7f0b6015f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.429+0000 7f0b68077640 1 --2- 172.21.15.19:0/674481401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b600d4fd0 0x7f0b60157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.429+0000 7f0b68077640 1 --2- 172.21.15.19:0/674481401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b600cfcc0 0x7f0b600cb620 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.429+0000 7f0b68077640 1 -- 172.21.15.19:0/674481401 >> 172.21.15.19:0/674481401 conn(0x7f0b6008bfc0 msgr2=0x7f0b600d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:17.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.429+0000 7f0b68077640 1 -- 172.21.15.19:0/674481401 shutdown_connections 2024-09-12T02:05:17.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.429+0000 7f0b68077640 1 -- 172.21.15.19:0/674481401 wait complete. 2024-09-12T02:05:17.440 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:05:17.440 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:17.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.543+0000 7f9665391640 1 Processor -- start 2024-09-12T02:05:17.542 INFO:tasks.ceph.mds.c.smithi019.stderr: -43> 2024-09-12T02:05:12.791+0000 7f356185b640 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds_snaptable': End of buffer [buffer:2] 2024-09-12T02:05:17.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.543+0000 7f9665391640 1 -- start start 2024-09-12T02:05:17.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.544+0000 7f9665391640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9660145bc0 0x7f966015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:17.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.544+0000 7f9665391640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f96600ae140 0x7f966006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:17.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.544+0000 7f9665391640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f966009aa30 0x7f966006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:17.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.544+0000 7f9665391640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f96600b3570 con 0x7f96600ae140 2024-09-12T02:05:17.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.544+0000 7f9665391640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f96600b3850 con 0x7f966009aa30 2024-09-12T02:05:17.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.544+0000 7f9665391640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f96600b3b30 con 0x7f9660145bc0 2024-09-12T02:05:17.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.544+0000 7f965e7fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f96600ae140 0x7f966006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:17.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.544+0000 7f965e7fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f96600ae140 0x7f966006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38520/0 (socket says 172.21.15.19:38520) 2024-09-12T02:05:17.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.544+0000 7f965e7fc640 1 -- 172.21.15.19:0/2275198344 learned_addr learned my addr 172.21.15.19:0/2275198344 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:17.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.544+0000 7f965f7fe640 1 --2- 172.21.15.19:0/2275198344 >> v2:172.21.15.135:3300/0 conn(0x7f966009aa30 0x7f966006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:17.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.544+0000 7f965effd640 1 --2- 172.21.15.19:0/2275198344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9660145bc0 0x7f966015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:17.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.544+0000 7f965e7fc640 1 -- 172.21.15.19:0/2275198344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9660145bc0 msgr2=0x7f966015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:17.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.544+0000 7f965e7fc640 1 --2- 172.21.15.19:0/2275198344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9660145bc0 0x7f966015ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.544+0000 7f965e7fc640 1 -- 172.21.15.19:0/2275198344 >> v2:172.21.15.135:3300/0 conn(0x7f966009aa30 msgr2=0x7f966006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:17.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.544+0000 7f965e7fc640 1 --2- 172.21.15.19:0/2275198344 >> v2:172.21.15.135:3300/0 conn(0x7f966009aa30 0x7f966006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.544+0000 7f965e7fc640 1 -- 172.21.15.19:0/2275198344 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96600b1610 con 0x7f96600ae140 2024-09-12T02:05:17.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.544+0000 7f965effd640 1 --2- 172.21.15.19:0/2275198344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9660145bc0 0x7f966015ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:17.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.545+0000 7f965e7fc640 1 --2- 172.21.15.19:0/2275198344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96600ae140 0x7f966006bc10 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f96600ae560 tx=0x7f965402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c546815d1a9756ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:17.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.545+0000 7f965dffb640 1 -- 172.21.15.19:0/2275198344 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9654037070 con 0x7f96600ae140 2024-09-12T02:05:17.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.545+0000 7f965dffb640 1 -- 172.21.15.19:0/2275198344 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9654032440 con 0x7f96600ae140 2024-09-12T02:05:17.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.545+0000 7f965dffb640 1 -- 172.21.15.19:0/2275198344 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9654032810 con 0x7f96600ae140 2024-09-12T02:05:17.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.546+0000 7f9665391640 1 -- 172.21.15.19:0/2275198344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96600ae140 msgr2=0x7f966006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:17.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.546+0000 7f9665391640 1 --2- 172.21.15.19:0/2275198344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96600ae140 0x7f966006bc10 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f96600ae560 tx=0x7f965402a270 comp rx=0 tx=0).stop 2024-09-12T02:05:17.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.546+0000 7f9665391640 1 -- 172.21.15.19:0/2275198344 shutdown_connections 2024-09-12T02:05:17.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.546+0000 7f9665391640 1 --2- 172.21.15.19:0/2275198344 >> v2:172.21.15.135:3300/0 conn(0x7f966009aa30 0x7f966006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.546+0000 7f9665391640 1 --2- 172.21.15.19:0/2275198344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96600ae140 0x7f966006bc10 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.546+0000 7f9665391640 1 --2- 172.21.15.19:0/2275198344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9660145bc0 0x7f966015ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.546+0000 7f9665391640 1 -- 172.21.15.19:0/2275198344 >> 172.21.15.19:0/2275198344 conn(0x7f9660073490 msgr2=0x7f96600b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:17.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.546+0000 7f9665391640 1 -- 172.21.15.19:0/2275198344 shutdown_connections 2024-09-12T02:05:17.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.546+0000 7f9665391640 1 -- 172.21.15.19:0/2275198344 wait complete. 2024-09-12T02:05:17.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.547+0000 7f9665391640 1 Processor -- start 2024-09-12T02:05:17.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.547+0000 7f9665391640 1 -- start start 2024-09-12T02:05:17.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.548+0000 7f9665391640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f966009aa30 0x7f96600cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:17.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.548+0000 7f9665391640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96600ae140 0x7f966015bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:17.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.548+0000 7f9665391640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9660145bc0 0x7f966015c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:17.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.548+0000 7f9665391640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9660145fa0 con 0x7f96600ae140 2024-09-12T02:05:17.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.548+0000 7f9665391640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f96600b1e10 con 0x7f9660145bc0 2024-09-12T02:05:17.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.548+0000 7f9665391640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f96600c9d00 con 0x7f966009aa30 2024-09-12T02:05:17.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.548+0000 7f965e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96600ae140 0x7f966015bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:17.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.548+0000 7f965e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96600ae140 0x7f966015bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38532/0 (socket says 172.21.15.19:38532) 2024-09-12T02:05:17.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.548+0000 7f965e7fc640 1 -- 172.21.15.19:0/2715526157 learned_addr learned my addr 172.21.15.19:0/2715526157 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:17.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.548+0000 7f965f7fe640 1 --2- 172.21.15.19:0/2715526157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9660145bc0 0x7f966015c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:17.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.548+0000 7f965effd640 1 --2- 172.21.15.19:0/2715526157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f966009aa30 0x7f96600cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:17.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.548+0000 7f965e7fc640 1 -- 172.21.15.19:0/2715526157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f966009aa30 msgr2=0x7f96600cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.548+0000 7f965e7fc640 1 --2- 172.21.15.19:0/2715526157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f966009aa30 0x7f96600cba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.548+0000 7f965e7fc640 1 -- 172.21.15.19:0/2715526157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9660145bc0 msgr2=0x7f966015c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.548+0000 7f965e7fc640 1 --2- 172.21.15.19:0/2715526157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9660145bc0 0x7f966015c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.548+0000 7f965e7fc640 1 -- 172.21.15.19:0/2715526157 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96600c9fe0 con 0x7f96600ae140 2024-09-12T02:05:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.548+0000 7f965effd640 1 --2- 172.21.15.19:0/2715526157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f966009aa30 0x7f96600cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.548+0000 7f965f7fe640 1 --2- 172.21.15.19:0/2715526157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9660145bc0 0x7f966015c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.549+0000 7f965e7fc640 1 --2- 172.21.15.19:0/2715526157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96600ae140 0x7f966015bd20 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f9654000c00 tx=0x7f96540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.549+0000 7f96477fe640 1 -- 172.21.15.19:0/2715526157 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9654041020 con 0x7f96600ae140 2024-09-12T02:05:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.549+0000 7f96477fe640 1 -- 172.21.15.19:0/2715526157 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96540306c0 con 0x7f96600ae140 2024-09-12T02:05:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.549+0000 7f9665391640 1 -- 172.21.15.19:0/2715526157 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96600ca2c0 con 0x7f96600ae140 2024-09-12T02:05:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.549+0000 7f96477fe640 1 -- 172.21.15.19:0/2715526157 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9654037040 con 0x7f96600ae140 2024-09-12T02:05:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.549+0000 7f9665391640 1 -- 172.21.15.19:0/2715526157 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96600ca880 con 0x7f96600ae140 2024-09-12T02:05:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.550+0000 7f9665391640 1 -- 172.21.15.19:0/2715526157 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96600b0de0 con 0x7f96600ae140 2024-09-12T02:05:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.550+0000 7f96477fe640 1 -- 172.21.15.19:0/2715526157 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9654044020 con 0x7f96600ae140 2024-09-12T02:05:17.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.551+0000 7f96477fe640 1 --2- 172.21.15.19:0/2715526157 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f964c06be60 0x7f964c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:17.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.551+0000 7f96477fe640 1 -- 172.21.15.19:0/2715526157 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 8711+0+0 (secure 0 0 0) 0x7f96540ac1a0 con 0x7f96600ae140 2024-09-12T02:05:17.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.551+0000 7f965effd640 1 --2- 172.21.15.19:0/2715526157 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f964c06be60 0x7f964c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:17.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.552+0000 7f965effd640 1 --2- 172.21.15.19:0/2715526157 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f964c06be60 0x7f964c06e320 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9650006fd0 tx=0x7f9650008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:17.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.555+0000 7f96477fe640 1 -- 172.21.15.19:0/2715526157 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f96600b0de0 con 0x7f96600ae140 2024-09-12T02:05:17.567 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:05:17.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.765+0000 7f9665391640 1 -- 172.21.15.19:0/2715526157 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f966015ca70 con 0x7f96600ae140 2024-09-12T02:05:17.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.765+0000 7f96477fe640 1 -- 172.21.15.19:0/2715526157 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 244 v244) ==== 95+0+3563 (secure 0 0 0) 0x7f965404b030 con 0x7f96600ae140 2024-09-12T02:05:17.765 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:17.765 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":244,"btime":"2024-09-12T02:05:16:751850+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":244,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:16.751801+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":123,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:17.765 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 244 2024-09-12T02:05:17.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.767+0000 7f9665391640 1 -- 172.21.15.19:0/2715526157 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f964c06be60 msgr2=0x7f964c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:17.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.767+0000 7f9665391640 1 --2- 172.21.15.19:0/2715526157 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f964c06be60 0x7f964c06e320 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9650006fd0 tx=0x7f9650008040 comp rx=0 tx=0).stop 2024-09-12T02:05:17.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.767+0000 7f9665391640 1 -- 172.21.15.19:0/2715526157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96600ae140 msgr2=0x7f966015bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:17.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.767+0000 7f9665391640 1 --2- 172.21.15.19:0/2715526157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96600ae140 0x7f966015bd20 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f9654000c00 tx=0x7f96540046c0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.767+0000 7f9665391640 1 -- 172.21.15.19:0/2715526157 shutdown_connections 2024-09-12T02:05:17.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.767+0000 7f9665391640 1 --2- 172.21.15.19:0/2715526157 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f964c06be60 0x7f964c06e320 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.767+0000 7f9665391640 1 --2- 172.21.15.19:0/2715526157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9660145bc0 0x7f966015c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.767+0000 7f9665391640 1 --2- 172.21.15.19:0/2715526157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96600ae140 0x7f966015bd20 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.767+0000 7f9665391640 1 --2- 172.21.15.19:0/2715526157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f966009aa30 0x7f96600cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.767+0000 7f9665391640 1 -- 172.21.15.19:0/2715526157 >> 172.21.15.19:0/2715526157 conn(0x7f9660073490 msgr2=0x7f966015d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:17.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.767+0000 7f9665391640 1 -- 172.21.15.19:0/2715526157 shutdown_connections 2024-09-12T02:05:17.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.767+0000 7f9665391640 1 -- 172.21.15.19:0/2715526157 wait complete. 2024-09-12T02:05:17.777 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate mds0_inotable' led to DAMAGED state 2024-09-12T02:05:17.777 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate 400.00000000' 2024-09-12T02:05:17.778 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:05:17.778 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:05:17.794 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:05:17.794 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:05:17.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:17.795 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:05:17.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:05:17.850 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:05:17.850 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:05:17.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.994+0000 7fc553823640 1 Processor -- start 2024-09-12T02:05:17.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.994+0000 7fc553823640 1 -- start start 2024-09-12T02:05:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.995+0000 7fc553823640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc54c06df60 0x7fc54c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.995+0000 7fc553823640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc54c09af70 0x7fc54c168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.995+0000 7fc553823640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc54c06cec0 con 0x7fc54c15e5d0 2024-09-12T02:05:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.995+0000 7fc553823640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fc54c06dad0 con 0x7fc54c09af70 2024-09-12T02:05:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.995+0000 7fc553823640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc54c06d1a0 con 0x7fc54c06df60 2024-09-12T02:05:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.995+0000 7fc5515bf640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc54c15e5d0 0x7fc54c0d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53390/0 (socket says 172.21.15.19:53390) 2024-09-12T02:05:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.995+0000 7fc5515bf640 1 -- 172.21.15.19:0/1992000642 learned_addr learned my addr 172.21.15.19:0/1992000642 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.995+0000 7fc551dc0640 1 --2- 172.21.15.19:0/1992000642 >> v2:172.21.15.19:3300/0 conn(0x7fc54c09af70 0x7fc54c168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.995+0000 7fc550dbe640 1 --2- 172.21.15.19:0/1992000642 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc54c06df60 0x7fc54c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.995+0000 7fc543fff640 1 -- 172.21.15.19:0/1992000642 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2364651128 0 0) 0x7fc54c06cec0 con 0x7fc54c15e5d0 2024-09-12T02:05:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.995+0000 7fc543fff640 1 -- 172.21.15.19:0/1992000642 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc538003520 con 0x7fc54c15e5d0 2024-09-12T02:05:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.995+0000 7fc551dc0640 1 -- 172.21.15.19:0/1992000642 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc54c06df60 msgr2=0x7fc54c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:17.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.995+0000 7fc551dc0640 1 --2- 172.21.15.19:0/1992000642 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc54c06df60 0x7fc54c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.995+0000 7fc551dc0640 1 -- 172.21.15.19:0/1992000642 >> v1:172.21.15.19:6789/0 conn(0x7fc54c15e5d0 legacy=0x7fc54c0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:17.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.995+0000 7fc551dc0640 1 -- 172.21.15.19:0/1992000642 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54c06d480 con 0x7fc54c09af70 2024-09-12T02:05:17.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.996+0000 7fc551dc0640 1 --2- 172.21.15.19:0/1992000642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc54c09af70 0x7fc54c168560 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fc544009d90 tx=0x7fc54402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c828448e7a6e1c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:17.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.996+0000 7fc543fff640 1 -- 172.21.15.19:0/1992000642 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544007740 con 0x7fc54c09af70 2024-09-12T02:05:17.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.996+0000 7fc543fff640 1 -- 172.21.15.19:0/1992000642 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5440078e0 con 0x7fc54c09af70 2024-09-12T02:05:17.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.996+0000 7fc543fff640 1 -- 172.21.15.19:0/1992000642 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544007cb0 con 0x7fc54c09af70 2024-09-12T02:05:17.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.997+0000 7fc553823640 1 -- 172.21.15.19:0/1992000642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc54c09af70 msgr2=0x7fc54c168560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.997+0000 7fc553823640 1 --2- 172.21.15.19:0/1992000642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc54c09af70 0x7fc54c168560 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fc544009d90 tx=0x7fc54402a6f0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.997+0000 7fc553823640 1 -- 172.21.15.19:0/1992000642 shutdown_connections 2024-09-12T02:05:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.997+0000 7fc553823640 1 --2- 172.21.15.19:0/1992000642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc54c09af70 0x7fc54c168560 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.997+0000 7fc553823640 1 --2- 172.21.15.19:0/1992000642 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc54c06df60 0x7fc54c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.997+0000 7fc553823640 1 -- 172.21.15.19:0/1992000642 >> 172.21.15.19:0/1992000642 conn(0x7fc54c0d23a0 msgr2=0x7fc54c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.997+0000 7fc553823640 1 -- 172.21.15.19:0/1992000642 shutdown_connections 2024-09-12T02:05:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.997+0000 7fc553823640 1 -- 172.21.15.19:0/1992000642 wait complete. 2024-09-12T02:05:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.998+0000 7fc553823640 1 Processor -- start 2024-09-12T02:05:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.998+0000 7fc553823640 1 -- start start 2024-09-12T02:05:18.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.999+0000 7fc553823640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc54c06df60 0x7fc54c1f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:18.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.999+0000 7fc553823640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc54c09af70 0x7fc54c0d2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:18.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.999+0000 7fc553823640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc54c15e5d0 0x7fc54c0d2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:18.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.999+0000 7fc553823640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c0d1980 con 0x7fc54c06df60 2024-09-12T02:05:18.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.999+0000 7fc553823640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c0d1800 con 0x7fc54c09af70 2024-09-12T02:05:18.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.999+0000 7fc553823640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc54c15e9b0 con 0x7fc54c15e5d0 2024-09-12T02:05:18.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.999+0000 7fc5515bf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc54c06df60 0x7fc54c1f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:18.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.999+0000 7fc5515bf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc54c06df60 0x7fc54c1f3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38578/0 (socket says 172.21.15.19:38578) 2024-09-12T02:05:18.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.999+0000 7fc5515bf640 1 -- 172.21.15.19:0/3482973202 learned_addr learned my addr 172.21.15.19:0/3482973202 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.999+0000 7fc5515bf640 1 -- 172.21.15.19:0/3482973202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc54c15e5d0 msgr2=0x7fc54c0d2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.999+0000 7fc5515bf640 1 --2- 172.21.15.19:0/3482973202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc54c15e5d0 0x7fc54c0d2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.999+0000 7fc5515bf640 1 -- 172.21.15.19:0/3482973202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc54c09af70 msgr2=0x7fc54c0d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.999+0000 7fc5515bf640 1 --2- 172.21.15.19:0/3482973202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc54c09af70 0x7fc54c0d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.999+0000 7fc5515bf640 1 -- 172.21.15.19:0/3482973202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54c0c8320 con 0x7fc54c06df60 2024-09-12T02:05:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.999+0000 7fc5515bf640 1 --2- 172.21.15.19:0/3482973202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc54c06df60 0x7fc54c1f3a30 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fc54800c430 tx=0x7fc54800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:17.999+0000 7fc541ffb640 1 -- 172.21.15.19:0/3482973202 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548017070 con 0x7fc54c06df60 2024-09-12T02:05:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.000+0000 7fc541ffb640 1 -- 172.21.15.19:0/3482973202 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc548005ce0 con 0x7fc54c06df60 2024-09-12T02:05:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.000+0000 7fc553823640 1 -- 172.21.15.19:0/3482973202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54c0c8600 con 0x7fc54c06df60 2024-09-12T02:05:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.000+0000 7fc541ffb640 1 -- 172.21.15.19:0/3482973202 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5480072f0 con 0x7fc54c06df60 2024-09-12T02:05:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.000+0000 7fc553823640 1 -- 172.21.15.19:0/3482973202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc54c0c8010 con 0x7fc54c06df60 2024-09-12T02:05:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.001+0000 7fc553823640 1 -- 172.21.15.19:0/3482973202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc54c06cec0 con 0x7fc54c06df60 2024-09-12T02:05:18.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.001+0000 7fc541ffb640 1 -- 172.21.15.19:0/3482973202 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc54801a070 con 0x7fc54c06df60 2024-09-12T02:05:18.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.002+0000 7fc541ffb640 1 --2- 172.21.15.19:0/3482973202 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc53006be30 0x7fc53006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:18.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.002+0000 7fc541ffb640 1 -- 172.21.15.19:0/3482973202 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 8711+0+0 (secure 0 0 0) 0x7fc54808af70 con 0x7fc54c06df60 2024-09-12T02:05:18.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.002+0000 7fc550dbe640 1 --2- 172.21.15.19:0/3482973202 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc53006be30 0x7fc53006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:18.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.003+0000 7fc550dbe640 1 --2- 172.21.15.19:0/3482973202 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc53006be30 0x7fc53006e2f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc54c146170 tx=0x7fc53c009500 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:18.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.006+0000 7fc541ffb640 1 -- 172.21.15.19:0/3482973202 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc548058d10 con 0x7fc54c06df60 2024-09-12T02:05:18.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.221+0000 7fc553823640 1 -- 172.21.15.19:0/3482973202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc54c14a290 con 0x7fc54c06df60 2024-09-12T02:05:18.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.815+0000 7fc541ffb640 1 -- 172.21.15.19:0/3482973202 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v246) ==== 161+0+0 (secure 0 0 0) 0x7fc548058610 con 0x7fc54c06df60 2024-09-12T02:05:18.815 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:05:18.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.817+0000 7fc553823640 1 -- 172.21.15.19:0/3482973202 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc53006be30 msgr2=0x7fc53006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:18.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.817+0000 7fc553823640 1 --2- 172.21.15.19:0/3482973202 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc53006be30 0x7fc53006e2f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc54c146170 tx=0x7fc53c009500 comp rx=0 tx=0).stop 2024-09-12T02:05:18.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.817+0000 7fc553823640 1 -- 172.21.15.19:0/3482973202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc54c06df60 msgr2=0x7fc54c1f3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:18.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.817+0000 7fc553823640 1 --2- 172.21.15.19:0/3482973202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc54c06df60 0x7fc54c1f3a30 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fc54800c430 tx=0x7fc54800c8f0 comp rx=0 tx=0).stop 2024-09-12T02:05:18.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.818+0000 7fc553823640 1 -- 172.21.15.19:0/3482973202 shutdown_connections 2024-09-12T02:05:18.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.818+0000 7fc553823640 1 --2- 172.21.15.19:0/3482973202 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc53006be30 0x7fc53006e2f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:18.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.818+0000 7fc553823640 1 --2- 172.21.15.19:0/3482973202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc54c15e5d0 0x7fc54c0d2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:18.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.818+0000 7fc553823640 1 --2- 172.21.15.19:0/3482973202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc54c09af70 0x7fc54c0d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:18.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.818+0000 7fc553823640 1 --2- 172.21.15.19:0/3482973202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc54c06df60 0x7fc54c1f3a30 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:18.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.818+0000 7fc553823640 1 -- 172.21.15.19:0/3482973202 >> 172.21.15.19:0/3482973202 conn(0x7fc54c0d23a0 msgr2=0x7fc54c157290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:18.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.818+0000 7fc553823640 1 -- 172.21.15.19:0/3482973202 shutdown_connections 2024-09-12T02:05:18.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.818+0000 7fc553823640 1 -- 172.21.15.19:0/3482973202 wait complete. 2024-09-12T02:05:18.830 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:05:18.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.939+0000 7f3b65af8640 1 Processor -- start 2024-09-12T02:05:18.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.939+0000 7f3b65af8640 1 -- start start 2024-09-12T02:05:18.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.940+0000 7f3b65af8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3b60161c80 0x7f3b6006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:18.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.940+0000 7f3b65af8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3b600b6680 0x7f3b600cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:18.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.940+0000 7f3b65af8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b6006e870 con 0x7f3b60162060 2024-09-12T02:05:18.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.940+0000 7f3b65af8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f3b6006d9f0 con 0x7f3b60161c80 2024-09-12T02:05:18.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.940+0000 7f3b65af8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f3b6006dcd0 con 0x7f3b600b6680 2024-09-12T02:05:18.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.940+0000 7f3b5f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3b60161c80 0x7f3b6006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:18.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.940+0000 7f3b5f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3b60161c80 0x7f3b6006e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38592/0 (socket says 172.21.15.19:38592) 2024-09-12T02:05:18.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.940+0000 7f3b5f7fe640 1 -- 172.21.15.19:0/174404801 learned_addr learned my addr 172.21.15.19:0/174404801 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:18.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.940+0000 7f3b5ffff640 1 --2- 172.21.15.19:0/174404801 >> v2:172.21.15.135:3300/0 conn(0x7f3b600b6680 0x7f3b600cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:18.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.940+0000 7f3b5f7fe640 1 -- 172.21.15.19:0/174404801 >> v2:172.21.15.135:3300/0 conn(0x7f3b600b6680 msgr2=0x7f3b600cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:18.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.940+0000 7f3b5f7fe640 1 --2- 172.21.15.19:0/174404801 >> v2:172.21.15.135:3300/0 conn(0x7f3b600b6680 0x7f3b600cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:18.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.940+0000 7f3b5f7fe640 1 -- 172.21.15.19:0/174404801 >> v1:172.21.15.135:6789/0 conn(0x7f3b60162060 legacy=0x7f3b600b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:18.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.940+0000 7f3b5f7fe640 1 -- 172.21.15.19:0/174404801 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6006dfb0 con 0x7f3b60161c80 2024-09-12T02:05:18.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.941+0000 7f3b5f7fe640 1 --2- 172.21.15.19:0/174404801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b60161c80 0x7f3b6006e330 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f3b6008d750 tx=0x7f3b5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a1a5f8d8aa77f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:18.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.941+0000 7f3b5effd640 1 -- 172.21.15.19:0/174404801 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b50037070 con 0x7f3b60161c80 2024-09-12T02:05:18.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.941+0000 7f3b5effd640 1 -- 172.21.15.19:0/174404801 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b50032440 con 0x7f3b60161c80 2024-09-12T02:05:18.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.941+0000 7f3b5effd640 1 -- 172.21.15.19:0/174404801 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b50032810 con 0x7f3b60161c80 2024-09-12T02:05:18.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.942+0000 7f3b65af8640 1 -- 172.21.15.19:0/174404801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b60161c80 msgr2=0x7f3b6006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:18.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.942+0000 7f3b65af8640 1 --2- 172.21.15.19:0/174404801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b60161c80 0x7f3b6006e330 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f3b6008d750 tx=0x7f3b5002a270 comp rx=0 tx=0).stop 2024-09-12T02:05:18.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.942+0000 7f3b65af8640 1 -- 172.21.15.19:0/174404801 shutdown_connections 2024-09-12T02:05:18.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.942+0000 7f3b65af8640 1 --2- 172.21.15.19:0/174404801 >> v2:172.21.15.135:3300/0 conn(0x7f3b600b6680 0x7f3b600cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:18.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.942+0000 7f3b65af8640 1 --2- 172.21.15.19:0/174404801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b60161c80 0x7f3b6006e330 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:18.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.942+0000 7f3b65af8640 1 -- 172.21.15.19:0/174404801 >> 172.21.15.19:0/174404801 conn(0x7f3b600d44f0 msgr2=0x7f3b600d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:18.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.942+0000 7f3b65af8640 1 -- 172.21.15.19:0/174404801 shutdown_connections 2024-09-12T02:05:18.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.942+0000 7f3b65af8640 1 -- 172.21.15.19:0/174404801 wait complete. 2024-09-12T02:05:18.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.943+0000 7f3b65af8640 1 Processor -- start 2024-09-12T02:05:18.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.943+0000 7f3b65af8640 1 -- start start 2024-09-12T02:05:18.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b65af8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b600b6680 0x7f3b6014e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:18.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b65af8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b60161c80 0x7f3b6014fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:18.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b65af8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b60162060 0x7f3b6015eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:18.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b65af8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3b600b6b30 con 0x7f3b60162060 2024-09-12T02:05:18.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b65af8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3b600d2aa0 con 0x7f3b600b6680 2024-09-12T02:05:18.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b65af8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3b600b6cb0 con 0x7f3b60161c80 2024-09-12T02:05:18.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b5ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b60162060 0x7f3b6015eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:18.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b5ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b60162060 0x7f3b6015eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38606/0 (socket says 172.21.15.19:38606) 2024-09-12T02:05:18.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b5ffff640 1 -- 172.21.15.19:0/2734801407 learned_addr learned my addr 172.21.15.19:0/2734801407 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:18.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b5f7fe640 1 --2- 172.21.15.19:0/2734801407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b600b6680 0x7f3b6014e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:18.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b57fff640 1 --2- 172.21.15.19:0/2734801407 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b60161c80 0x7f3b6014fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:18.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b5ffff640 1 -- 172.21.15.19:0/2734801407 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b60161c80 msgr2=0x7f3b6014fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:18.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b5ffff640 1 --2- 172.21.15.19:0/2734801407 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b60161c80 0x7f3b6014fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:18.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b5ffff640 1 -- 172.21.15.19:0/2734801407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b600b6680 msgr2=0x7f3b6014e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:18.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b5ffff640 1 --2- 172.21.15.19:0/2734801407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b600b6680 0x7f3b6014e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:18.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b5ffff640 1 -- 172.21.15.19:0/2734801407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b601502d0 con 0x7f3b60162060 2024-09-12T02:05:18.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b5ffff640 1 --2- 172.21.15.19:0/2734801407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b60162060 0x7f3b6015eca0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f3b58009d30 tx=0x7f3b5800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:18.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b5cff9640 1 -- 172.21.15.19:0/2734801407 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b58018020 con 0x7f3b60162060 2024-09-12T02:05:18.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b5cff9640 1 -- 172.21.15.19:0/2734801407 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b58014480 con 0x7f3b60162060 2024-09-12T02:05:18.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.944+0000 7f3b65af8640 1 -- 172.21.15.19:0/2734801407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b601f8850 con 0x7f3b60162060 2024-09-12T02:05:18.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.945+0000 7f3b5cff9640 1 -- 172.21.15.19:0/2734801407 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b58014870 con 0x7f3b60162060 2024-09-12T02:05:18.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.945+0000 7f3b65af8640 1 -- 172.21.15.19:0/2734801407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b600ccf40 con 0x7f3b60162060 2024-09-12T02:05:18.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.946+0000 7f3b65af8640 1 -- 172.21.15.19:0/2734801407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b6006e330 con 0x7f3b60162060 2024-09-12T02:05:18.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.946+0000 7f3b5cff9640 1 -- 172.21.15.19:0/2734801407 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b58005d10 con 0x7f3b60162060 2024-09-12T02:05:18.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.947+0000 7f3b5cff9640 1 --2- 172.21.15.19:0/2734801407 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3b4006be30 0x7f3b4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:18.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.947+0000 7f3b5cff9640 1 -- 172.21.15.19:0/2734801407 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 8711+0+0 (secure 0 0 0) 0x7f3b5808c330 con 0x7f3b60162060 2024-09-12T02:05:18.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.947+0000 7f3b5f7fe640 1 --2- 172.21.15.19:0/2734801407 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3b4006be30 0x7f3b4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:18.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.947+0000 7f3b5f7fe640 1 --2- 172.21.15.19:0/2734801407 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3b4006be30 0x7f3b4006e2f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3b50034000 tx=0x7f3b5002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:18.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:18.951+0000 7f3b5cff9640 1 -- 172.21.15.19:0/2734801407 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b58022070 con 0x7f3b60162060 2024-09-12T02:05:19.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.197+0000 7f3b65af8640 1 -- 172.21.15.19:0/2734801407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f3b600ba470 con 0x7f3b60162060 2024-09-12T02:05:19.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.816+0000 7f3b5cff9640 1 -- 172.21.15.19:0/2734801407 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v247) ==== 101+0+0 (secure 0 0 0) 0x7f3b58010040 con 0x7f3b60162060 2024-09-12T02:05:19.816 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:05:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.819+0000 7f3b65af8640 1 -- 172.21.15.19:0/2734801407 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3b4006be30 msgr2=0x7f3b4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.819+0000 7f3b65af8640 1 --2- 172.21.15.19:0/2734801407 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3b4006be30 0x7f3b4006e2f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3b50034000 tx=0x7f3b5002e000 comp rx=0 tx=0).stop 2024-09-12T02:05:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.819+0000 7f3b65af8640 1 -- 172.21.15.19:0/2734801407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b60162060 msgr2=0x7f3b6015eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.819+0000 7f3b65af8640 1 --2- 172.21.15.19:0/2734801407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b60162060 0x7f3b6015eca0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f3b58009d30 tx=0x7f3b5800c490 comp rx=0 tx=0).stop 2024-09-12T02:05:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.819+0000 7f3b65af8640 1 -- 172.21.15.19:0/2734801407 shutdown_connections 2024-09-12T02:05:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.819+0000 7f3b65af8640 1 --2- 172.21.15.19:0/2734801407 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3b4006be30 0x7f3b4006e2f0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.819+0000 7f3b65af8640 1 --2- 172.21.15.19:0/2734801407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b60162060 0x7f3b6015eca0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.819+0000 7f3b65af8640 1 --2- 172.21.15.19:0/2734801407 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b60161c80 0x7f3b6014fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.819+0000 7f3b65af8640 1 --2- 172.21.15.19:0/2734801407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b600b6680 0x7f3b6014e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.819+0000 7f3b65af8640 1 -- 172.21.15.19:0/2734801407 >> 172.21.15.19:0/2734801407 conn(0x7f3b600d44f0 msgr2=0x7f3b600cf920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.819+0000 7f3b65af8640 1 -- 172.21.15.19:0/2734801407 shutdown_connections 2024-09-12T02:05:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.819+0000 7f3b65af8640 1 -- 172.21.15.19:0/2734801407 wait complete. 2024-09-12T02:05:19.831 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:05:19.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.876+0000 7fbf0176cf40 1 Processor -- start 2024-09-12T02:05:19.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.876+0000 7fbf0176cf40 1 -- start start 2024-09-12T02:05:19.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.876+0000 7fbf0176cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623c121a180 0x5623c12d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.876+0000 7fbf0176cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5623c1248050 0x5623c12610c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.876+0000 7fbf0176cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623c12d2080 0x5623c1261600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.876+0000 7fbf0176cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5623c121a5c0 con 0x5623c12d2080 2024-09-12T02:05:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.876+0000 7fbf0176cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5623c1169510 con 0x5623c121a180 2024-09-12T02:05:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.876+0000 7fbf0176cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5623c1216ae0 con 0x5623c1248050 2024-09-12T02:05:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.877+0000 7fbeffa63640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623c12d2080 0x5623c1261600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.877+0000 7fbeffa63640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623c12d2080 0x5623c1261600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38626/0 (socket says 172.21.15.19:38626) 2024-09-12T02:05:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.877+0000 7fbeffa63640 1 -- 172.21.15.19:0/615603303 learned_addr learned my addr 172.21.15.19:0/615603303 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.877+0000 7fbeffa63640 1 -- 172.21.15.19:0/615603303 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5623c1248050 msgr2=0x5623c12610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.877+0000 7fbeffa63640 1 --2- 172.21.15.19:0/615603303 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5623c1248050 0x5623c12610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.877+0000 7fbeffa63640 1 -- 172.21.15.19:0/615603303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623c121a180 msgr2=0x5623c12d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.877+0000 7fbeffa63640 1 --2- 172.21.15.19:0/615603303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623c121a180 0x5623c12d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.877+0000 7fbeffa63640 1 -- 172.21.15.19:0/615603303 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c12ee770 con 0x5623c12d2080 2024-09-12T02:05:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.877+0000 7fbeffa63640 1 --2- 172.21.15.19:0/615603303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623c12d2080 0x5623c1261600 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fbef8025b00 tx=0x7fbef8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fcd54f84401309 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.877+0000 7fbefda5f640 1 -- 172.21.15.19:0/615603303 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8056b70 con 0x5623c12d2080 2024-09-12T02:05:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.877+0000 7fbefda5f640 1 -- 172.21.15.19:0/615603303 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef8056d10 con 0x5623c12d2080 2024-09-12T02:05:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.877+0000 7fbefda5f640 1 -- 172.21.15.19:0/615603303 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8060670 con 0x5623c12d2080 2024-09-12T02:05:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.878+0000 7fbf0176cf40 1 -- 172.21.15.19:0/615603303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623c12d2080 msgr2=0x5623c1261600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.878+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/615603303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623c12d2080 0x5623c1261600 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fbef8025b00 tx=0x7fbef8051000 comp rx=0 tx=0).stop 2024-09-12T02:05:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.878+0000 7fbf0176cf40 1 -- 172.21.15.19:0/615603303 shutdown_connections 2024-09-12T02:05:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.878+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/615603303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623c12d2080 0x5623c1261600 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.878+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/615603303 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5623c1248050 0x5623c12610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.878+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/615603303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623c121a180 0x5623c12d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.878+0000 7fbf0176cf40 1 -- 172.21.15.19:0/615603303 >> 172.21.15.19:0/615603303 conn(0x5623c12179e0 msgr2=0x5623c1219a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.878+0000 7fbf0176cf40 1 -- 172.21.15.19:0/615603303 shutdown_connections 2024-09-12T02:05:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.878+0000 7fbf0176cf40 1 -- 172.21.15.19:0/615603303 wait complete. 2024-09-12T02:05:19.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.878+0000 7fbf0176cf40 1 Processor -- start 2024-09-12T02:05:19.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.878+0000 7fbf0176cf40 1 -- start start 2024-09-12T02:05:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.879+0000 7fbf0176cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5623c121a180 0x5623c12d2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.879+0000 7fbf0176cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623c1248050 0x5623c1217e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.879+0000 7fbf0176cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623c12d2080 0x5623c12d5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.879+0000 7fbf0176cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5623c12d7700 con 0x5623c1248050 2024-09-12T02:05:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.879+0000 7fbf0176cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5623c12d79e0 con 0x5623c12d2080 2024-09-12T02:05:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.879+0000 7fbf0176cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5623c12f1d50 con 0x5623c121a180 2024-09-12T02:05:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.879+0000 7fbefea61640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623c1248050 0x5623c1217e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.879+0000 7fbefea61640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623c1248050 0x5623c1217e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38630/0 (socket says 172.21.15.19:38630) 2024-09-12T02:05:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.879+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 learned_addr learned my addr 172.21.15.19:0/2759027893 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:19.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.879+0000 7fbeffa63640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623c12d2080 0x5623c12d5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:19.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.879+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5623c121a180 msgr2=0x5623c12d2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:19.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.879+0000 7fbefea61640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5623c121a180 0x5623c12d2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:19.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.879+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623c12d2080 msgr2=0x5623c12d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:19.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.879+0000 7fbefea61640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623c12d2080 0x5623c12d5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:19.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.879+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c12ef280 con 0x5623c1248050 2024-09-12T02:05:19.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.880+0000 7fbefea61640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623c1248050 0x5623c1217e60 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009da0 tx=0x7fbef4006750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:19.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.880+0000 7fbefca5d640 1 -- 172.21.15.19:0/2759027893 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4017070 con 0x5623c1248050 2024-09-12T02:05:19.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.880+0000 7fbefca5d640 1 -- 172.21.15.19:0/2759027893 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef4012410 con 0x5623c1248050 2024-09-12T02:05:19.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.880+0000 7fbefca5d640 1 -- 172.21.15.19:0/2759027893 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4006e60 con 0x5623c1248050 2024-09-12T02:05:19.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.880+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623c12eeb40 con 0x5623c1248050 2024-09-12T02:05:19.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.880+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623c12edba0 con 0x5623c1248050 2024-09-12T02:05:19.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.881+0000 7fbefca5d640 1 -- 172.21.15.19:0/2759027893 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbef401a070 con 0x5623c1248050 2024-09-12T02:05:19.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.882+0000 7fbefca5d640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbeec06a810 0x7fbeec06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:19.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.882+0000 7fbefca5d640 1 -- 172.21.15.19:0/2759027893 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 8711+0+0 (secure 0 0 0) 0x7fbef40896c0 con 0x5623c1248050 2024-09-12T02:05:19.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.882+0000 7fbeff262640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbeec06a810 0x7fbeec06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:19.884 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:05:19.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.882+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5623c125e140 0x5623c12ce630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:19.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.882+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c12d62e0 con 0x5623c125e140 2024-09-12T02:05:19.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.882+0000 7fbeffa63640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5623c125e140 0x5623c12ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:19.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.882+0000 7fbeff262640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbeec06a810 0x7fbeec06ccd0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fbef0001d30 tx=0x7fbef00012c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:19.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.883+0000 7fbeffa63640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5623c125e140 0x5623c12ce630 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:19.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.884+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v123'877 uv851 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.884+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c12ceb70 con 0x5623c125e140 2024-09-12T02:05:19.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.885+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v123'878 uv878 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.885+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c12cef10 con 0x5623c125e140 2024-09-12T02:05:19.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.887+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v123'879 uv879 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.886 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:05:19.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.887+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c12cf2b0 con 0x5623c125e140 2024-09-12T02:05:19.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.888+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v123'880 uv880 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.888+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1393220 con 0x5623c125e140 2024-09-12T02:05:19.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.889+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v123'881 uv881 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.889+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1392210 con 0x5623c125e140 2024-09-12T02:05:19.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.890+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v123'882 uv882 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.890+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1392620 con 0x5623c125e140 2024-09-12T02:05:19.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.891+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v123'883 uv857 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.891+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c1392a10 con 0x5623c125e140 2024-09-12T02:05:19.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.892+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v123'884 uv884 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.892+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1392e00 con 0x5623c125e140 2024-09-12T02:05:19.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.893+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v123'885 uv885 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.893 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:05:19.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.893+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1392e00 con 0x5623c125e140 2024-09-12T02:05:19.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.894+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v123'886 uv886 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.894+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1392db0 con 0x5623c125e140 2024-09-12T02:05:19.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.895+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v123'887 uv887 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.895+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1392db0 con 0x5623c125e140 2024-09-12T02:05:19.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.896+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v123'888 uv888 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.896+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1392db0 con 0x5623c125e140 2024-09-12T02:05:19.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.898+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v123'889 uv864 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.898+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c1392db0 con 0x5623c125e140 2024-09-12T02:05:19.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.899+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v123'890 uv890 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.899+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1392db0 con 0x5623c125e140 2024-09-12T02:05:19.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.900+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v123'891 uv891 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.899 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:05:19.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.900+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1392db0 con 0x5623c125e140 2024-09-12T02:05:19.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.901+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v123'892 uv892 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.901+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1392db0 con 0x5623c125e140 2024-09-12T02:05:19.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.902+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v123'893 uv893 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.902+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1392db0 con 0x5623c125e140 2024-09-12T02:05:19.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.903+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v123'894 uv894 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.903+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1393a70 con 0x5623c125e140 2024-09-12T02:05:19.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.904+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v123'895 uv895 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.904+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1393a70 con 0x5623c125e140 2024-09-12T02:05:19.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.905+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v123'896 uv870 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.905+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c1393a70 con 0x5623c125e140 2024-09-12T02:05:19.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.906+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v123'897 uv897 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.906+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1393a70 con 0x5623c125e140 2024-09-12T02:05:19.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.907+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v123'898 uv898 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.906 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:05:19.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.907+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1394a80 con 0x5623c125e140 2024-09-12T02:05:19.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.908+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v123'899 uv899 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.908+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1394a80 con 0x5623c125e140 2024-09-12T02:05:19.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.909+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v123'900 uv900 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.909+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1393a70 con 0x5623c125e140 2024-09-12T02:05:19.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.910+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v123'901 uv901 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.910+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1393a70 con 0x5623c125e140 2024-09-12T02:05:19.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.911+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v123'902 uv876 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.911+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c1393a70 con 0x5623c125e140 2024-09-12T02:05:19.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.912+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v123'903 uv903 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.912+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1393a70 con 0x5623c125e140 2024-09-12T02:05:19.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.913+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v123'904 uv904 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.912 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:05:19.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.913+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1394a80 con 0x5623c125e140 2024-09-12T02:05:19.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.914+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v123'905 uv905 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.914+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1394a80 con 0x5623c125e140 2024-09-12T02:05:19.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.915+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v123'906 uv906 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.915+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1393a70 con 0x5623c125e140 2024-09-12T02:05:19.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.916+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v123'907 uv907 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c125e140 2024-09-12T02:05:19.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.916+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5623c1393f80 0x5623c1396370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:19.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.916+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13968b0 con 0x5623c1393f80 2024-09-12T02:05:19.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.916+0000 7fbeff262640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5623c1393f80 0x5623c1396370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:19.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.917+0000 7fbeff262640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5623c1393f80 0x5623c1396370 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:19.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.918+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v123'639 uv622 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.918+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c1396c50 con 0x5623c1393f80 2024-09-12T02:05:19.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.920+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v123'640 uv640 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.920+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1396ff0 con 0x5623c1393f80 2024-09-12T02:05:19.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.921+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v123'641 uv641 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.920 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:05:19.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.921+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1397840 con 0x5623c1393f80 2024-09-12T02:05:19.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.922+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v123'642 uv642 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.922+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1397be0 con 0x5623c1393f80 2024-09-12T02:05:19.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.923+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v123'643 uv643 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.923+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c1397f80 con 0x5623c1393f80 2024-09-12T02:05:19.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.925+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v123'644 uv627 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.925+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c1398320 con 0x5623c1393f80 2024-09-12T02:05:19.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.926+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v123'645 uv645 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.926+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13986c0 con 0x5623c1393f80 2024-09-12T02:05:19.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.927+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v123'646 uv646 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.926 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:05:19.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.927+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13986c0 con 0x5623c1393f80 2024-09-12T02:05:19.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.928+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v123'647 uv647 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.928+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13986c0 con 0x5623c1393f80 2024-09-12T02:05:19.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.929+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v123'648 uv648 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.929+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13986c0 con 0x5623c1393f80 2024-09-12T02:05:19.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.931+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v123'649 uv632 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.931+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c13986c0 con 0x5623c1393f80 2024-09-12T02:05:19.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.932+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v123'650 uv650 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.932+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13986c0 con 0x5623c1393f80 2024-09-12T02:05:19.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.933+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v123'651 uv651 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.932 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:05:19.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.933+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c139cb40 con 0x5623c1393f80 2024-09-12T02:05:19.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.934+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v123'652 uv652 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.934+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c139cb40 con 0x5623c1393f80 2024-09-12T02:05:19.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.935+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v123'653 uv653 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.935+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13986c0 con 0x5623c1393f80 2024-09-12T02:05:19.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.937+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v123'654 uv638 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.937+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c13986c0 con 0x5623c1393f80 2024-09-12T02:05:19.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.938+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v123'655 uv655 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.938+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13986c0 con 0x5623c1393f80 2024-09-12T02:05:19.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.939+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v123'656 uv656 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.939 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:05:19.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.939+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13996d0 con 0x5623c1393f80 2024-09-12T02:05:19.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.940+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v123'657 uv657 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.940+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13996d0 con 0x5623c1393f80 2024-09-12T02:05:19.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.941+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v123'658 uv658 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.941+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13986c0 con 0x5623c1393f80 2024-09-12T02:05:19.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.943+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v123'659 uv659 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c1393f80 2024-09-12T02:05:19.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.943+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5623c1398bd0 0x5623c139afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:19.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.943+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c139b500 con 0x5623c1398bd0 2024-09-12T02:05:19.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.943+0000 7fbefea61640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5623c1398bd0 0x5623c139afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:19.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.943+0000 7fbefea61640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5623c1398bd0 0x5623c139afc0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:19.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.944+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v123'171 uv170 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:19.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.944+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c139b8a0 con 0x5623c1398bd0 2024-09-12T02:05:19.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.945+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v123'172 uv172 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:19.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.945+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c139bc40 con 0x5623c1398bd0 2024-09-12T02:05:19.945 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:05:19.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.946+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v123'173 uv173 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:19.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.946+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c139d050 con 0x5623c1398bd0 2024-09-12T02:05:19.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.947+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v123'174 uv174 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:19.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.947+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c139d4d0 con 0x5623c1398bd0 2024-09-12T02:05:19.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.948+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v123'175 uv175 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:19.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.948+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c139bfe0 con 0x5623c1398bd0 2024-09-12T02:05:19.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.949+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v123'176 uv176 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:19.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.949+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5623c139ca50 0x5623c139f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:19.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.949+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c139fe90 con 0x5623c139ca50 2024-09-12T02:05:19.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.950+0000 7fbeffa63640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5623c139ca50 0x5623c139f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:19.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.950+0000 7fbeffa63640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5623c139ca50 0x5623c139f910 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:19.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.951+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v123'126 uv125 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.951+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a0260 con 0x5623c139ca50 2024-09-12T02:05:19.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.952+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v123'127 uv127 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.952+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a0260 con 0x5623c139ca50 2024-09-12T02:05:19.953 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:05:19.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.954+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v123'128 uv128 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.954+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a0260 con 0x5623c139ca50 2024-09-12T02:05:19.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.955+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v123'129 uv129 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.955+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5623c13a0b90 0x5623c13a2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:19.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.955+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a34c0 con 0x5623c13a0b90 2024-09-12T02:05:19.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.955+0000 7fbeff262640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5623c13a0b90 0x5623c13a2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:19.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.955+0000 7fbeff262640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5623c13a0b90 0x5623c13a2f80 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:19.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.957+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v123'171 uv170 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.957+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a34c0 con 0x5623c13a0b90 2024-09-12T02:05:19.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.958+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v123'172 uv172 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.958+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a34c0 con 0x5623c13a0b90 2024-09-12T02:05:19.958 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:05:19.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.959+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v123'173 uv173 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.959+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a48f0 con 0x5623c13a0b90 2024-09-12T02:05:19.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.961+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v123'174 uv174 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.961+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a48f0 con 0x5623c13a0b90 2024-09-12T02:05:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.962+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v123'175 uv175 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.962+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c13a0b90 2024-09-12T02:05:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.963+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v123'176 uv176 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.963+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c139ca50 2024-09-12T02:05:19.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.965+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v123'316 uv310 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.965+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c139ca50 2024-09-12T02:05:19.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.966+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v123'317 uv317 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.966+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c139ca50 2024-09-12T02:05:19.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.967+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v123'318 uv318 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.966 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:05:19.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.967+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a48f0 con 0x5623c139ca50 2024-09-12T02:05:19.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.968+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v123'319 uv319 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.968+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a48f0 con 0x5623c139ca50 2024-09-12T02:05:19.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.969+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v123'320 uv320 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.969+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c139ca50 2024-09-12T02:05:19.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.970+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v123'321 uv321 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.970+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c139ca50 2024-09-12T02:05:19.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.971+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v123'322 uv315 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.971+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c139ca50 2024-09-12T02:05:19.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.972+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v123'323 uv323 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.972+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c139ca50 2024-09-12T02:05:19.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.973+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v123'324 uv324 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.972 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:05:19.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.973+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c139ca50 2024-09-12T02:05:19.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.974+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v123'325 uv325 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.974+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c139ca50 2024-09-12T02:05:19.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.975+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v123'326 uv326 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.975+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c139ca50 2024-09-12T02:05:19.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.976+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v123'143 uv142 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.976+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c139ca50 2024-09-12T02:05:19.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.977+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v123'144 uv144 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.977+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c139ca50 2024-09-12T02:05:19.977 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:05:19.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.978+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v123'145 uv145 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.978+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c139ca50 2024-09-12T02:05:19.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.979+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v123'146 uv146 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.979+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c139ca50 2024-09-12T02:05:19.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.980+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v123'147 uv147 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fbef8068020 con 0x5623c139ca50 2024-09-12T02:05:19.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.980+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c13a0b90 2024-09-12T02:05:19.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.981+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v123'171 uv170 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.981+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c13a0b90 2024-09-12T02:05:19.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.983+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v123'172 uv172 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.983+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c13a0b90 2024-09-12T02:05:19.983 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:05:19.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.984+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v123'173 uv173 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.984+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a48f0 con 0x5623c13a0b90 2024-09-12T02:05:19.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.985+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v123'174 uv174 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.985+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a48f0 con 0x5623c13a0b90 2024-09-12T02:05:19.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.986+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v123'175 uv175 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.987+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c13a0b90 2024-09-12T02:05:19.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.989+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v123'176 uv176 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.989+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c13a0b90 2024-09-12T02:05:19.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.991+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v123'284 uv283 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.991+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c13a0b90 2024-09-12T02:05:19.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.992+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v123'285 uv285 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.992+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c13a0b90 2024-09-12T02:05:19.993 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:05:19.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.993+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v123'286 uv286 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.994+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c13a0b90 2024-09-12T02:05:19.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.995+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v123'287 uv287 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.995+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c13a0b90 2024-09-12T02:05:19.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.996+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v123'288 uv288 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.996+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c13a0b90 2024-09-12T02:05:19.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.997+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v123'289 uv282 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.997+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c13a0b90 2024-09-12T02:05:19.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.998+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v123'290 uv290 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.998+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c13a0b90 2024-09-12T02:05:19.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.999+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v123'291 uv291 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.998 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:05:19.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:19.999+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a38e0 con 0x5623c13a0b90 2024-09-12T02:05:19.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.000+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v123'292 uv292 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:19.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.000+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a66f0 con 0x5623c13a0b90 2024-09-12T02:05:20.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.001+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v123'293 uv293 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:20.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.001+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5623c13a4410 0x5623c13a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.001+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a6800 con 0x5623c13a4410 2024-09-12T02:05:20.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.002+0000 7fbefea61640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5623c13a4410 0x5623c13a6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.006+0000 7fbefea61640 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5623c13a4410 0x5623c13a6d50 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:20.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.009+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v123'124 uv123 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c13a4410 2024-09-12T02:05:20.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.009+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a6800 con 0x5623c13a4410 2024-09-12T02:05:20.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.010+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v123'125 uv125 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c13a4410 2024-09-12T02:05:20.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.010+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a6800 con 0x5623c13a4410 2024-09-12T02:05:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.012+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v123'126 uv126 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c13a4410 2024-09-12T02:05:20.011 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:05:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.012+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a6800 con 0x5623c13a4410 2024-09-12T02:05:20.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.015+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v123'127 uv127 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c13a4410 2024-09-12T02:05:20.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.015+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a6800 con 0x5623c13a0b90 2024-09-12T02:05:20.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.016+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v123'171 uv170 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:20.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.016+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a6800 con 0x5623c13a0b90 2024-09-12T02:05:20.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.017+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v123'172 uv172 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:20.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.017+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a6800 con 0x5623c13a0b90 2024-09-12T02:05:20.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.018+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v123'173 uv173 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:20.017 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:05:20.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.018+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a6800 con 0x5623c13a0b90 2024-09-12T02:05:20.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.019+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v123'174 uv174 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:20.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.019+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a6800 con 0x5623c13a0b90 2024-09-12T02:05:20.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.020+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v123'175 uv175 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:20.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.020+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a6800 con 0x5623c13a0b90 2024-09-12T02:05:20.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.021+0000 7fbeff262640 1 -- 172.21.15.19:0/2759027893 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v123'176 uv176 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef000f670 con 0x5623c13a0b90 2024-09-12T02:05:20.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.021+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a6800 con 0x5623c1398bd0 2024-09-12T02:05:20.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.023+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v123'145 uv144 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:20.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.023+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a6800 con 0x5623c1398bd0 2024-09-12T02:05:20.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.024+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v123'146 uv146 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:20.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.024+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a6800 con 0x5623c1398bd0 2024-09-12T02:05:20.024 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:05:20.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.025+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v123'147 uv147 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:20.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.025+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a6800 con 0x5623c1398bd0 2024-09-12T02:05:20.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.026+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v123'148 uv148 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:20.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.026+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a6800 con 0x5623c1398bd0 2024-09-12T02:05:20.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.027+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v123'149 uv149 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:20.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.027+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a6800 con 0x5623c1398bd0 2024-09-12T02:05:20.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.029+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v123'351 uv343 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:20.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.029+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a7330 con 0x5623c1398bd0 2024-09-12T02:05:20.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.030+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v123'352 uv352 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:20.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.030+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a7330 con 0x5623c1398bd0 2024-09-12T02:05:20.031 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:05:20.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.032+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v123'353 uv353 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:20.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.032+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a72e0 con 0x5623c1398bd0 2024-09-12T02:05:20.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.034+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v123'354 uv354 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:20.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.034+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a72e0 con 0x5623c1398bd0 2024-09-12T02:05:20.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.035+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v123'355 uv355 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:20.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.035+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a7290 con 0x5623c1398bd0 2024-09-12T02:05:20.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.036+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v123'356 uv350 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:20.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.036+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a7290 con 0x5623c1398bd0 2024-09-12T02:05:20.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.037+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v123'357 uv357 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:20.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.037+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a6800 con 0x5623c1398bd0 2024-09-12T02:05:20.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.038+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v123'358 uv358 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:20.038 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:05:20.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.038+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a82f0 con 0x5623c1398bd0 2024-09-12T02:05:20.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.039+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v123'359 uv359 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:20.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.039+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a82f0 con 0x5623c1398bd0 2024-09-12T02:05:20.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.040+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v123'360 uv360 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:20.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.040+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a7290 con 0x5623c1398bd0 2024-09-12T02:05:20.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.041+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v123'361 uv361 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:20.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.041+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5623c13a7290 con 0x5623c1398bd0 2024-09-12T02:05:20.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbefea61640 1 -- 172.21.15.19:0/2759027893 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v123'362 uv362 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fbef4019030 con 0x5623c1398bd0 2024-09-12T02:05:20.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5623c1393f80 msgr2=0x5623c1396370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5623c1393f80 0x5623c1396370 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5623c125e140 msgr2=0x5623c12ce630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5623c125e140 0x5623c12ce630 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5623c139ca50 msgr2=0x5623c139f910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5623c139ca50 0x5623c139f910 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5623c13a4410 msgr2=0x5623c13a6d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5623c13a4410 0x5623c13a6d50 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5623c1398bd0 msgr2=0x5623c139afc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5623c1398bd0 0x5623c139afc0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5623c13a0b90 msgr2=0x5623c13a2f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5623c13a0b90 0x5623c13a2f80 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 reap_dead start 2024-09-12T02:05:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 reap_dead start 2024-09-12T02:05:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbeffa63640 1 -- 172.21.15.19:0/2759027893 reap_dead start 2024-09-12T02:05:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbeec06a810 msgr2=0x7fbeec06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbeec06a810 0x7fbeec06ccd0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fbef0001d30 tx=0x7fbef00012c0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623c1248050 msgr2=0x5623c1217e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623c1248050 0x5623c1217e60 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009da0 tx=0x7fbef4006750 comp rx=0 tx=0).stop 2024-09-12T02:05:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 shutdown_connections 2024-09-12T02:05:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbeec06a810 0x7fbeec06ccd0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 --2- 172.21.15.19:0/2759027893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623c1248050 0x5623c1217e60 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 >> 172.21.15.19:0/2759027893 conn(0x5623c12179e0 msgr2=0x5623c1219a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 shutdown_connections 2024-09-12T02:05:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.042+0000 7fbf0176cf40 1 -- 172.21.15.19:0/2759027893 wait complete. 2024-09-12T02:05:20.045 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate 400.00000000 0 2024-09-12T02:05:20.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.130+0000 7f5f3011df40 1 Processor -- start 2024-09-12T02:05:20.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.130+0000 7f5f3011df40 1 -- start start 2024-09-12T02:05:20.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.131+0000 7f5f3011df40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5582b2bfff40 0x5582b2ca1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.131+0000 7f5f3011df40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582b2cae240 0x5582b2c01d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.131+0000 7f5f3011df40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582b2bd8140 0x5582b2ca9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.131+0000 7f5f3011df40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5582b2c1cf20 con 0x5582b2bd8140 2024-09-12T02:05:20.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.131+0000 7f5f3011df40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5582b2b27510 con 0x5582b2cae240 2024-09-12T02:05:20.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.131+0000 7f5f3011df40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5582b2c1d4a0 con 0x5582b2bfff40 2024-09-12T02:05:20.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.131+0000 7f5f2d9d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582b2bd8140 0x5582b2ca9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.131+0000 7f5f2d9d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582b2bd8140 0x5582b2ca9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38650/0 (socket says 172.21.15.19:38650) 2024-09-12T02:05:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.131+0000 7f5f2d9d0640 1 -- 172.21.15.19:0/979548601 learned_addr learned my addr 172.21.15.19:0/979548601 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.131+0000 7f5f2d1cf640 1 --2- 172.21.15.19:0/979548601 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5582b2bfff40 0x5582b2ca1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.131+0000 7f5f2d9d0640 1 -- 172.21.15.19:0/979548601 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5582b2bfff40 msgr2=0x5582b2ca1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.131+0000 7f5f2d9d0640 1 --2- 172.21.15.19:0/979548601 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5582b2bfff40 0x5582b2ca1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.131+0000 7f5f2d9d0640 1 -- 172.21.15.19:0/979548601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582b2cae240 msgr2=0x5582b2c01d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:05:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.131+0000 7f5f2d9d0640 1 --2- 172.21.15.19:0/979548601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582b2cae240 0x5582b2c01d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.131+0000 7f5f2d9d0640 1 -- 172.21.15.19:0/979548601 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582b2caa190 con 0x5582b2bd8140 2024-09-12T02:05:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.131+0000 7f5f2d1cf640 1 --2- 172.21.15.19:0/979548601 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5582b2bfff40 0x5582b2ca1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.132+0000 7f5f2d9d0640 1 --2- 172.21.15.19:0/979548601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582b2bd8140 0x5582b2ca9c50 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000a460 tx=0x7f5f2000a920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1952a2d81b3837b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.132+0000 7f5f277fe640 1 -- 172.21.15.19:0/979548601 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2000f7b0 con 0x5582b2bd8140 2024-09-12T02:05:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.132+0000 7f5f277fe640 1 -- 172.21.15.19:0/979548601 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f20015070 con 0x5582b2bd8140 2024-09-12T02:05:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.132+0000 7f5f277fe640 1 -- 172.21.15.19:0/979548601 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2000fb90 con 0x5582b2bd8140 2024-09-12T02:05:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.132+0000 7f5f3011df40 1 -- 172.21.15.19:0/979548601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582b2bd8140 msgr2=0x5582b2ca9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.132+0000 7f5f3011df40 1 --2- 172.21.15.19:0/979548601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582b2bd8140 0x5582b2ca9c50 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000a460 tx=0x7f5f2000a920 comp rx=0 tx=0).stop 2024-09-12T02:05:20.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.132+0000 7f5f3011df40 1 -- 172.21.15.19:0/979548601 shutdown_connections 2024-09-12T02:05:20.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.132+0000 7f5f3011df40 1 --2- 172.21.15.19:0/979548601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582b2bd8140 0x5582b2ca9c50 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.132+0000 7f5f3011df40 1 --2- 172.21.15.19:0/979548601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582b2cae240 0x5582b2c01d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.132+0000 7f5f3011df40 1 --2- 172.21.15.19:0/979548601 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5582b2bfff40 0x5582b2ca1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.132+0000 7f5f3011df40 1 -- 172.21.15.19:0/979548601 >> 172.21.15.19:0/979548601 conn(0x5582b2bd59e0 msgr2=0x5582b2c1af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:20.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.132+0000 7f5f3011df40 1 -- 172.21.15.19:0/979548601 shutdown_connections 2024-09-12T02:05:20.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.132+0000 7f5f3011df40 1 -- 172.21.15.19:0/979548601 wait complete. 2024-09-12T02:05:20.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.133+0000 7f5f3011df40 1 Processor -- start 2024-09-12T02:05:20.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.133+0000 7f5f3011df40 1 -- start start 2024-09-12T02:05:20.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f3011df40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582b2bd8140 0x5582b2c9c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f3011df40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5582b2bfff40 0x5582b2ca0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f3011df40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582b2cae240 0x5582b2bd3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f3011df40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5582b2c1ab40 con 0x5582b2cae240 2024-09-12T02:05:20.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f3011df40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5582b2c1a8c0 con 0x5582b2bd8140 2024-09-12T02:05:20.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f3011df40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5582b2ca8e80 con 0x5582b2bfff40 2024-09-12T02:05:20.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f2d9d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582b2cae240 0x5582b2bd3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f2d9d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582b2cae240 0x5582b2bd3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38660/0 (socket says 172.21.15.19:38660) 2024-09-12T02:05:20.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f2d9d0640 1 -- 172.21.15.19:0/4145114208 learned_addr learned my addr 172.21.15.19:0/4145114208 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:20.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f2d9d0640 1 -- 172.21.15.19:0/4145114208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5582b2bfff40 msgr2=0x5582b2ca0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f2d9d0640 1 --2- 172.21.15.19:0/4145114208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5582b2bfff40 0x5582b2ca0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f2d9d0640 1 -- 172.21.15.19:0/4145114208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582b2bd8140 msgr2=0x5582b2c9c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f2d1cf640 1 --2- 172.21.15.19:0/4145114208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582b2bd8140 0x5582b2c9c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f2d9d0640 1 --2- 172.21.15.19:0/4145114208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582b2bd8140 0x5582b2c9c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f2d9d0640 1 -- 172.21.15.19:0/4145114208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582b2c9ca20 con 0x5582b2cae240 2024-09-12T02:05:20.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f2d1cf640 1 --2- 172.21.15.19:0/4145114208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582b2bd8140 0x5582b2c9c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:20.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f2d9d0640 1 --2- 172.21.15.19:0/4145114208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582b2cae240 0x5582b2bd3e10 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f5f20012040 tx=0x7f5f20003350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:20.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f267fc640 1 -- 172.21.15.19:0/4145114208 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f20010850 con 0x5582b2cae240 2024-09-12T02:05:20.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f267fc640 1 -- 172.21.15.19:0/4145114208 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f200109f0 con 0x5582b2cae240 2024-09-12T02:05:20.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f3011df40 1 -- 172.21.15.19:0/4145114208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582b2c1b890 con 0x5582b2cae240 2024-09-12T02:05:20.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f267fc640 1 -- 172.21.15.19:0/4145114208 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f20010de0 con 0x5582b2cae240 2024-09-12T02:05:20.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.134+0000 7f5f3011df40 1 -- 172.21.15.19:0/4145114208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582b2c9fd30 con 0x5582b2cae240 2024-09-12T02:05:20.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.136+0000 7f5f267fc640 1 -- 172.21.15.19:0/4145114208 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5f20019420 con 0x5582b2cae240 2024-09-12T02:05:20.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.136+0000 7f5f267fc640 1 --2- 172.21.15.19:0/4145114208 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5f1006a810 0x7f5f1006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.136+0000 7f5f267fc640 1 -- 172.21.15.19:0/4145114208 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 8711+0+0 (secure 0 0 0) 0x7f5f2008c2b0 con 0x5582b2cae240 2024-09-12T02:05:20.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.136+0000 7f5f3011df40 1 --2- 172.21.15.19:0/4145114208 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5582b2bc0a90 0x5582b2d44590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.136+0000 7f5f3011df40 1 -- 172.21.15.19:0/4145114208 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 13.f 13:f1f69726:::400.00000000:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x5582b2d44ad0 con 0x5582b2bc0a90 2024-09-12T02:05:20.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.137+0000 7f5f2c9ce640 1 --2- 172.21.15.19:0/4145114208 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5582b2bc0a90 0x5582b2d44590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.137+0000 7f5f2c9ce640 1 --2- 172.21.15.19:0/4145114208 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5582b2bc0a90 0x5582b2d44590 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:20.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.138+0000 7f5f2c9ce640 1 -- 172.21.15.19:0/4145114208 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 400.00000000 [truncate 0] v123'150 uv150 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5f18057030 con 0x5582b2bc0a90 2024-09-12T02:05:20.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.138+0000 7f5f2d1cf640 1 --2- 172.21.15.19:0/4145114208 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5f1006a810 0x7f5f1006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.138+0000 7f5f3011df40 1 -- 172.21.15.19:0/4145114208 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5582b2bc0a90 msgr2=0x5582b2d44590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.138+0000 7f5f3011df40 1 --2- 172.21.15.19:0/4145114208 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5582b2bc0a90 0x5582b2d44590 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.138+0000 7f5f3011df40 1 -- 172.21.15.19:0/4145114208 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5f1006a810 msgr2=0x7f5f1006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.138+0000 7f5f3011df40 1 --2- 172.21.15.19:0/4145114208 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5f1006a810 0x7f5f1006ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.138+0000 7f5f3011df40 1 -- 172.21.15.19:0/4145114208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582b2cae240 msgr2=0x5582b2bd3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.138+0000 7f5f3011df40 1 --2- 172.21.15.19:0/4145114208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5582b2cae240 0x5582b2bd3e10 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f5f20012040 tx=0x7f5f20003350 comp rx=0 tx=0).stop 2024-09-12T02:05:20.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.138+0000 7f5f2d9d0640 1 -- 172.21.15.19:0/4145114208 reap_dead start 2024-09-12T02:05:20.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.138+0000 7f5f3011df40 1 -- 172.21.15.19:0/4145114208 shutdown_connections 2024-09-12T02:05:20.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.138+0000 7f5f3011df40 1 -- 172.21.15.19:0/4145114208 >> 172.21.15.19:0/4145114208 conn(0x5582b2bd59e0 msgr2=0x5582b2bd4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:20.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.138+0000 7f5f3011df40 1 -- 172.21.15.19:0/4145114208 shutdown_connections 2024-09-12T02:05:20.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.138+0000 7f5f3011df40 1 -- 172.21.15.19:0/4145114208 wait complete. 2024-09-12T02:05:20.141 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:05:20.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.247+0000 7fa58d38d640 1 Processor -- start 2024-09-12T02:05:20.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.247+0000 7fa58d38d640 1 -- start start 2024-09-12T02:05:20.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.248+0000 7fa58d38d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa588162e30 0x7fa58806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.248+0000 7fa58d38d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5880cf280 0x7fa5880d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.248+0000 7fa58d38d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa58815ff70 con 0x7fa588162340 2024-09-12T02:05:20.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.248+0000 7fa58d38d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa58806de90 con 0x7fa588162e30 2024-09-12T02:05:20.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.248+0000 7fa58d38d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa588163270 con 0x7fa5880cf280 2024-09-12T02:05:20.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.248+0000 7fa5867fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa588162e30 0x7fa58806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.248+0000 7fa5867fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa588162e30 0x7fa58806d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38674/0 (socket says 172.21.15.19:38674) 2024-09-12T02:05:20.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.248+0000 7fa5867fc640 1 -- 172.21.15.19:0/2656687900 learned_addr learned my addr 172.21.15.19:0/2656687900 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:20.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.248+0000 7fa586ffd640 1 --1- 172.21.15.19:0/2656687900 >> v1:172.21.15.135:6789/0 conn(0x7fa588162340 0x7fa588162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:41512/0 (socket says 172.21.15.19:41512) 2024-09-12T02:05:20.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.249+0000 7fa5877fe640 1 --2- 172.21.15.19:0/2656687900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5880cf280 0x7fa5880d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.249+0000 7fa5867fc640 1 -- 172.21.15.19:0/2656687900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5880cf280 msgr2=0x7fa5880d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:20.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.249+0000 7fa5867fc640 1 --2- 172.21.15.19:0/2656687900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5880cf280 0x7fa5880d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.249+0000 7fa5867fc640 1 -- 172.21.15.19:0/2656687900 >> v1:172.21.15.135:6789/0 conn(0x7fa588162340 legacy=0x7fa588162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.249+0000 7fa5867fc640 1 -- 172.21.15.19:0/2656687900 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5880d4d10 con 0x7fa588162e30 2024-09-12T02:05:20.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.249+0000 7fa585ffb640 1 -- 172.21.15.19:0/2656687900 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3955918045 0 0) 0x7fa58815ff70 con 0x7fa588162340 2024-09-12T02:05:20.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.249+0000 7fa5877fe640 1 --2- 172.21.15.19:0/2656687900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5880cf280 0x7fa5880d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:20.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.250+0000 7fa5867fc640 1 --2- 172.21.15.19:0/2656687900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa588162e30 0x7fa58806d740 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fa570009850 tx=0x7fa57002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9e3b70aa2b7267 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:20.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.250+0000 7fa585ffb640 1 -- 172.21.15.19:0/2656687900 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570004030 con 0x7fa588162e30 2024-09-12T02:05:20.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.250+0000 7fa585ffb640 1 -- 172.21.15.19:0/2656687900 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5700041d0 con 0x7fa588162e30 2024-09-12T02:05:20.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.250+0000 7fa585ffb640 1 -- 172.21.15.19:0/2656687900 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570003610 con 0x7fa588162e30 2024-09-12T02:05:20.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.250+0000 7fa58d38d640 1 -- 172.21.15.19:0/2656687900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa588162e30 msgr2=0x7fa58806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.250+0000 7fa58d38d640 1 --2- 172.21.15.19:0/2656687900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa588162e30 0x7fa58806d740 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fa570009850 tx=0x7fa57002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.250+0000 7fa58d38d640 1 -- 172.21.15.19:0/2656687900 shutdown_connections 2024-09-12T02:05:20.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.250+0000 7fa58d38d640 1 --2- 172.21.15.19:0/2656687900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5880cf280 0x7fa5880d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.250+0000 7fa58d38d640 1 --2- 172.21.15.19:0/2656687900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa588162e30 0x7fa58806d740 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.250+0000 7fa58d38d640 1 -- 172.21.15.19:0/2656687900 >> 172.21.15.19:0/2656687900 conn(0x7fa58808bfc0 msgr2=0x7fa5880d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:20.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.251+0000 7fa58d38d640 1 -- 172.21.15.19:0/2656687900 shutdown_connections 2024-09-12T02:05:20.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.251+0000 7fa58d38d640 1 -- 172.21.15.19:0/2656687900 wait complete. 2024-09-12T02:05:20.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.252+0000 7fa58d38d640 1 Processor -- start 2024-09-12T02:05:20.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.252+0000 7fa58d38d640 1 -- start start 2024-09-12T02:05:20.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa58d38d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5880cf280 0x7fa588155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa58d38d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa588162340 0x7fa5881e8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa58d38d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa588162e30 0x7fa5881e8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa58d38d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa5880cf710 con 0x7fa588162e30 2024-09-12T02:05:20.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa58d38d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa5880d2470 con 0x7fa588162340 2024-09-12T02:05:20.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa58d38d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa5880d52d0 con 0x7fa5880cf280 2024-09-12T02:05:20.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa5877fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa588162e30 0x7fa5881e8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa5877fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa588162e30 0x7fa5881e8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38682/0 (socket says 172.21.15.19:38682) 2024-09-12T02:05:20.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa5877fe640 1 -- 172.21.15.19:0/3353212106 learned_addr learned my addr 172.21.15.19:0/3353212106 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:20.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa586ffd640 1 --2- 172.21.15.19:0/3353212106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5880cf280 0x7fa588155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa5867fc640 1 --2- 172.21.15.19:0/3353212106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa588162340 0x7fa5881e8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa5877fe640 1 -- 172.21.15.19:0/3353212106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5880cf280 msgr2=0x7fa588155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa5877fe640 1 --2- 172.21.15.19:0/3353212106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5880cf280 0x7fa588155090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa5877fe640 1 -- 172.21.15.19:0/3353212106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa588162340 msgr2=0x7fa5881e8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa5877fe640 1 --2- 172.21.15.19:0/3353212106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa588162340 0x7fa5881e8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa5877fe640 1 -- 172.21.15.19:0/3353212106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5880cbc60 con 0x7fa588162e30 2024-09-12T02:05:20.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa5877fe640 1 --2- 172.21.15.19:0/3353212106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa588162e30 0x7fa5881e8aa0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fa57800cd50 tx=0x7fa57800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:20.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa57f7fe640 1 -- 172.21.15.19:0/3353212106 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57800f680 con 0x7fa588162e30 2024-09-12T02:05:20.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa57f7fe640 1 -- 172.21.15.19:0/3353212106 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa57800f840 con 0x7fa588162e30 2024-09-12T02:05:20.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa58d38d640 1 -- 172.21.15.19:0/3353212106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5880cb980 con 0x7fa588162e30 2024-09-12T02:05:20.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa57f7fe640 1 -- 172.21.15.19:0/3353212106 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57800fc30 con 0x7fa588162e30 2024-09-12T02:05:20.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.253+0000 7fa58d38d640 1 -- 172.21.15.19:0/3353212106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa588159bc0 con 0x7fa588162e30 2024-09-12T02:05:20.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.254+0000 7fa58d38d640 1 -- 172.21.15.19:0/3353212106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa58806d740 con 0x7fa588162e30 2024-09-12T02:05:20.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.255+0000 7fa57f7fe640 1 -- 172.21.15.19:0/3353212106 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa5780213f0 con 0x7fa588162e30 2024-09-12T02:05:20.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.255+0000 7fa57f7fe640 1 --2- 172.21.15.19:0/3353212106 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa56806be30 0x7fa56806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.255+0000 7fa57f7fe640 1 -- 172.21.15.19:0/3353212106 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 8711+0+0 (secure 0 0 0) 0x7fa57808c800 con 0x7fa588162e30 2024-09-12T02:05:20.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.256+0000 7fa586ffd640 1 --2- 172.21.15.19:0/3353212106 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa56806be30 0x7fa56806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.257+0000 7fa586ffd640 1 --2- 172.21.15.19:0/3353212106 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa56806be30 0x7fa56806e2f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa580000f60 tx=0x7fa580009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:20.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.260+0000 7fa57f7fe640 1 -- 172.21.15.19:0/3353212106 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa578014030 con 0x7fa588162e30 2024-09-12T02:05:20.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.471+0000 7fa58d38d640 1 -- 172.21.15.19:0/3353212106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fa58808e640 con 0x7fa588162e30 2024-09-12T02:05:20.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.828+0000 7fa57f7fe640 1 -- 172.21.15.19:0/3353212106 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v248) ==== 162+0+0 (secure 0 0 0) 0x7fa57805a5d0 con 0x7fa588162e30 2024-09-12T02:05:20.934 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:05:20.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.830+0000 7fa58d38d640 1 -- 172.21.15.19:0/3353212106 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa56806be30 msgr2=0x7fa56806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.830+0000 7fa58d38d640 1 --2- 172.21.15.19:0/3353212106 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa56806be30 0x7fa56806e2f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa580000f60 tx=0x7fa580009040 comp rx=0 tx=0).stop 2024-09-12T02:05:20.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.830+0000 7fa58d38d640 1 -- 172.21.15.19:0/3353212106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa588162e30 msgr2=0x7fa5881e8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.830+0000 7fa58d38d640 1 --2- 172.21.15.19:0/3353212106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa588162e30 0x7fa5881e8aa0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fa57800cd50 tx=0x7fa57800a650 comp rx=0 tx=0).stop 2024-09-12T02:05:20.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.830+0000 7fa58d38d640 1 -- 172.21.15.19:0/3353212106 shutdown_connections 2024-09-12T02:05:20.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.830+0000 7fa58d38d640 1 --2- 172.21.15.19:0/3353212106 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa56806be30 0x7fa56806e2f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.830+0000 7fa58d38d640 1 --2- 172.21.15.19:0/3353212106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa588162e30 0x7fa5881e8aa0 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.830+0000 7fa58d38d640 1 --2- 172.21.15.19:0/3353212106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa588162340 0x7fa5881e8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.830+0000 7fa58d38d640 1 --2- 172.21.15.19:0/3353212106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5880cf280 0x7fa588155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.830+0000 7fa58d38d640 1 -- 172.21.15.19:0/3353212106 >> 172.21.15.19:0/3353212106 conn(0x7fa58808bfc0 msgr2=0x7fa5880cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:20.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.830+0000 7fa58d38d640 1 -- 172.21.15.19:0/3353212106 shutdown_connections 2024-09-12T02:05:20.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:20.830+0000 7fa58d38d640 1 -- 172.21.15.19:0/3353212106 wait complete. 2024-09-12T02:05:20.937 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:05:20.836+0000 7f99b24e3640 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -22 ((22) Invalid argument) 2024-09-12T02:05:20.938 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:05:20.836+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:05:20.938 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:05:20.836+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:05:20.939 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:21.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.047+0000 7f62020e4640 1 Processor -- start 2024-09-12T02:05:21.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.047+0000 7f62020e4640 1 -- start start 2024-09-12T02:05:21.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.048+0000 7f62020e4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f61fc162060 0x7f61fc0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:21.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.048+0000 7f62020e4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61fc06d9f0 con 0x7f61fc0b64b0 2024-09-12T02:05:21.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.048+0000 7f62020e4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61fc06dcd0 con 0x7f61fc161c80 2024-09-12T02:05:21.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.048+0000 7f62020e4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f61fc06dfb0 con 0x7f61fc162060 2024-09-12T02:05:21.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.048+0000 7f61faffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f61fc162060 0x7f61fc0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:21.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.048+0000 7f61fbfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f61fc0b64b0 0x7f61fc0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37040/0 (socket says 172.21.15.19:37040) 2024-09-12T02:05:21.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.048+0000 7f61fbfff640 1 -- 172.21.15.19:0/1116788002 learned_addr learned my addr 172.21.15.19:0/1116788002 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:21.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.049+0000 7f61faffd640 1 -- 172.21.15.19:0/1116788002 >> v1:172.21.15.135:6789/0 conn(0x7f61fc161c80 legacy=0x7f61fc06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:21.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.049+0000 7f61faffd640 1 -- 172.21.15.19:0/1116788002 >> v1:172.21.15.19:6789/0 conn(0x7f61fc0b64b0 legacy=0x7f61fc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:21.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.049+0000 7f61faffd640 1 -- 172.21.15.19:0/1116788002 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61fc0d2890 con 0x7f61fc162060 2024-09-12T02:05:21.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.049+0000 7f61faffd640 1 --2- 172.21.15.19:0/1116788002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61fc162060 0x7f61fc0b5f70 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f61f00097a0 tx=0x7f61f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e6f9f3eeacdb39 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:21.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.049+0000 7f61fa7fc640 1 -- 172.21.15.19:0/1116788002 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0037070 con 0x7f61fc162060 2024-09-12T02:05:21.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.049+0000 7f61fa7fc640 1 -- 172.21.15.19:0/1116788002 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f0032440 con 0x7f61fc162060 2024-09-12T02:05:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.050+0000 7f61fa7fc640 1 -- 172.21.15.19:0/1116788002 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0032810 con 0x7f61fc162060 2024-09-12T02:05:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.050+0000 7f62020e4640 1 -- 172.21.15.19:0/1116788002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61fc162060 msgr2=0x7f61fc0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.050+0000 7f62020e4640 1 --2- 172.21.15.19:0/1116788002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61fc162060 0x7f61fc0b5f70 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f61f00097a0 tx=0x7f61f002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.050+0000 7f62020e4640 1 -- 172.21.15.19:0/1116788002 shutdown_connections 2024-09-12T02:05:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.050+0000 7f62020e4640 1 --2- 172.21.15.19:0/1116788002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61fc162060 0x7f61fc0b5f70 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.050+0000 7f62020e4640 1 -- 172.21.15.19:0/1116788002 >> 172.21.15.19:0/1116788002 conn(0x7f61fc0d44f0 msgr2=0x7f61fc0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.050+0000 7f62020e4640 1 -- 172.21.15.19:0/1116788002 shutdown_connections 2024-09-12T02:05:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.050+0000 7f62020e4640 1 -- 172.21.15.19:0/1116788002 wait complete. 2024-09-12T02:05:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.051+0000 7f62020e4640 1 Processor -- start 2024-09-12T02:05:21.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.051+0000 7f62020e4640 1 -- start start 2024-09-12T02:05:21.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.052+0000 7f62020e4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61fc0b64b0 0x7f61fc0b9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:21.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.052+0000 7f62020e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61fc161c80 0x7f61fc0caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:21.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.052+0000 7f62020e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61fc162060 0x7f61fc0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:21.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.052+0000 7f62020e4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc0b6d30 con 0x7f61fc162060 2024-09-12T02:05:21.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.052+0000 7f62020e4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc0b6bb0 con 0x7f61fc0b64b0 2024-09-12T02:05:21.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.052+0000 7f62020e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f61fc0cf8f0 con 0x7f61fc161c80 2024-09-12T02:05:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.052+0000 7f61fbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61fc162060 0x7f61fc0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.052+0000 7f61fbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61fc162060 0x7f61fc0cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51130/0 (socket says 172.21.15.19:51130) 2024-09-12T02:05:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.052+0000 7f61fbfff640 1 -- 172.21.15.19:0/1210207482 learned_addr learned my addr 172.21.15.19:0/1210207482 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.053+0000 7f61faffd640 1 --2- 172.21.15.19:0/1210207482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61fc161c80 0x7f61fc0caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.053+0000 7f61fb7fe640 1 --2- 172.21.15.19:0/1210207482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61fc0b64b0 0x7f61fc0b9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.053+0000 7f61fbfff640 1 -- 172.21.15.19:0/1210207482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61fc161c80 msgr2=0x7f61fc0caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.053+0000 7f61fbfff640 1 --2- 172.21.15.19:0/1210207482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61fc161c80 0x7f61fc0caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.053+0000 7f61fbfff640 1 -- 172.21.15.19:0/1210207482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61fc0b64b0 msgr2=0x7f61fc0b9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.053+0000 7f61fbfff640 1 --2- 172.21.15.19:0/1210207482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61fc0b64b0 0x7f61fc0b9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.053+0000 7f61fbfff640 1 -- 172.21.15.19:0/1210207482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61fc0ca4c0 con 0x7f61fc162060 2024-09-12T02:05:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.053+0000 7f61fb7fe640 1 --2- 172.21.15.19:0/1210207482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61fc0b64b0 0x7f61fc0b9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.053+0000 7f61fbfff640 1 --2- 172.21.15.19:0/1210207482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61fc162060 0x7f61fc0cd950 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f61f400cbc0 tx=0x7f61f400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.053+0000 7f61e3fff640 1 -- 172.21.15.19:0/1210207482 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4017070 con 0x7f61fc162060 2024-09-12T02:05:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.053+0000 7f61e3fff640 1 -- 172.21.15.19:0/1210207482 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f400ad40 con 0x7f61fc162060 2024-09-12T02:05:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.053+0000 7f62020e4640 1 -- 172.21.15.19:0/1210207482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61fc0c80b0 con 0x7f61fc162060 2024-09-12T02:05:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.053+0000 7f61e3fff640 1 -- 172.21.15.19:0/1210207482 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4012600 con 0x7f61fc162060 2024-09-12T02:05:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.053+0000 7f62020e4640 1 -- 172.21.15.19:0/1210207482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61fc0ca780 con 0x7f61fc162060 2024-09-12T02:05:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.054+0000 7f62020e4640 1 -- 172.21.15.19:0/1210207482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61fc0b5f70 con 0x7f61fc162060 2024-09-12T02:05:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.054+0000 7f61e3fff640 1 -- 172.21.15.19:0/1210207482 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61f401a070 con 0x7f61fc162060 2024-09-12T02:05:21.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.055+0000 7f61e3fff640 1 --2- 172.21.15.19:0/1210207482 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f61e806be60 0x7f61e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:21.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.055+0000 7f61e3fff640 1 -- 172.21.15.19:0/1210207482 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 8797+0+0 (secure 0 0 0) 0x7f61f408b6d0 con 0x7f61fc162060 2024-09-12T02:05:21.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.055+0000 7f61fb7fe640 1 --2- 172.21.15.19:0/1210207482 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f61e806be60 0x7f61e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:21.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.056+0000 7f61fb7fe640 1 --2- 172.21.15.19:0/1210207482 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f61e806be60 0x7f61e806e320 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f61ec003eb0 tx=0x7f61ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:21.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.059+0000 7f61e3fff640 1 -- 172.21.15.19:0/1210207482 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61f4058dd0 con 0x7f61fc162060 2024-09-12T02:05:21.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.270+0000 7f62020e4640 1 -- 172.21.15.19:0/1210207482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61fc0d0700 con 0x7f61fc162060 2024-09-12T02:05:21.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.271+0000 7f61e3fff640 1 -- 172.21.15.19:0/1210207482 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 250 v250) ==== 95+0+3563 (secure 0 0 0) 0x7f61f405d0d0 con 0x7f61fc162060 2024-09-12T02:05:21.270 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:21.270 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":250,"btime":"2024-09-12T02:05:20:836972+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":250,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:20.836911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:21.271 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 250 2024-09-12T02:05:21.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.273+0000 7f62020e4640 1 -- 172.21.15.19:0/1210207482 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f61e806be60 msgr2=0x7f61e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:21.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.273+0000 7f62020e4640 1 --2- 172.21.15.19:0/1210207482 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f61e806be60 0x7f61e806e320 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f61ec003eb0 tx=0x7f61ec009040 comp rx=0 tx=0).stop 2024-09-12T02:05:21.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.273+0000 7f62020e4640 1 -- 172.21.15.19:0/1210207482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61fc162060 msgr2=0x7f61fc0cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:21.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.273+0000 7f62020e4640 1 --2- 172.21.15.19:0/1210207482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61fc162060 0x7f61fc0cd950 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f61f400cbc0 tx=0x7f61f400a430 comp rx=0 tx=0).stop 2024-09-12T02:05:21.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.273+0000 7f62020e4640 1 -- 172.21.15.19:0/1210207482 shutdown_connections 2024-09-12T02:05:21.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.273+0000 7f62020e4640 1 --2- 172.21.15.19:0/1210207482 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f61e806be60 0x7f61e806e320 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.273+0000 7f62020e4640 1 --2- 172.21.15.19:0/1210207482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61fc162060 0x7f61fc0cd950 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.273+0000 7f62020e4640 1 --2- 172.21.15.19:0/1210207482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61fc161c80 0x7f61fc0caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.273+0000 7f62020e4640 1 --2- 172.21.15.19:0/1210207482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61fc0b64b0 0x7f61fc0b9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.273+0000 7f62020e4640 1 -- 172.21.15.19:0/1210207482 >> 172.21.15.19:0/1210207482 conn(0x7f61fc0d44f0 msgr2=0x7f61fc0b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:21.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.273+0000 7f62020e4640 1 -- 172.21.15.19:0/1210207482 shutdown_connections 2024-09-12T02:05:21.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.273+0000 7f62020e4640 1 -- 172.21.15.19:0/1210207482 wait complete. 2024-09-12T02:05:21.284 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:05:21.284 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:21.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.386+0000 7fb290f11640 1 Processor -- start 2024-09-12T02:05:21.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.386+0000 7fb290f11640 1 -- start start 2024-09-12T02:05:21.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.387+0000 7fb290f11640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb28c0b69d0 0x7fb28c162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:21.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.387+0000 7fb290f11640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb28c0af280 0x7fb28c0afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:21.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.387+0000 7fb290f11640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb28c15eb60 con 0x7fb28c0affb0 2024-09-12T02:05:21.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.387+0000 7fb290f11640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb28c0b6db0 con 0x7fb28c0af280 2024-09-12T02:05:21.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.387+0000 7fb290f11640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb28c15ee40 con 0x7fb28c0b69d0 2024-09-12T02:05:21.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.388+0000 7fb289d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb28c0af280 0x7fb28c0afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:21.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.388+0000 7fb289d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb28c0af280 0x7fb28c0afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51132/0 (socket says 172.21.15.19:51132) 2024-09-12T02:05:21.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.388+0000 7fb289d9b640 1 -- 172.21.15.19:0/3021853209 learned_addr learned my addr 172.21.15.19:0/3021853209 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:21.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.388+0000 7fb28a59c640 1 --2- 172.21.15.19:0/3021853209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb28c0b69d0 0x7fb28c162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:21.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.388+0000 7fb289d9b640 1 -- 172.21.15.19:0/3021853209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb28c0b69d0 msgr2=0x7fb28c162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:21.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.388+0000 7fb289d9b640 1 --2- 172.21.15.19:0/3021853209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb28c0b69d0 0x7fb28c162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.388+0000 7fb289d9b640 1 -- 172.21.15.19:0/3021853209 >> v1:172.21.15.135:6789/0 conn(0x7fb28c0affb0 legacy=0x7fb28c154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:21.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.388+0000 7fb289d9b640 1 -- 172.21.15.19:0/3021853209 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28c15f120 con 0x7fb28c0af280 2024-09-12T02:05:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.389+0000 7fb289d9b640 1 --2- 172.21.15.19:0/3021853209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0af280 0x7fb28c0afa70 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fb2800098a0 tx=0x7fb28002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6a8e6f91b34ce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.389+0000 7fb28959a640 1 -- 172.21.15.19:0/3021853209 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb280037070 con 0x7fb28c0af280 2024-09-12T02:05:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.389+0000 7fb28959a640 1 -- 172.21.15.19:0/3021853209 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb280032440 con 0x7fb28c0af280 2024-09-12T02:05:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.389+0000 7fb28959a640 1 -- 172.21.15.19:0/3021853209 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb280032810 con 0x7fb28c0af280 2024-09-12T02:05:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.389+0000 7fb290f11640 1 -- 172.21.15.19:0/3021853209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0af280 msgr2=0x7fb28c0afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.389+0000 7fb290f11640 1 --2- 172.21.15.19:0/3021853209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0af280 0x7fb28c0afa70 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fb2800098a0 tx=0x7fb28002a160 comp rx=0 tx=0).stop 2024-09-12T02:05:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.389+0000 7fb290f11640 1 -- 172.21.15.19:0/3021853209 shutdown_connections 2024-09-12T02:05:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.389+0000 7fb290f11640 1 --2- 172.21.15.19:0/3021853209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0af280 0x7fb28c0afa70 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.389+0000 7fb290f11640 1 --2- 172.21.15.19:0/3021853209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb28c0b69d0 0x7fb28c162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.389+0000 7fb290f11640 1 -- 172.21.15.19:0/3021853209 >> 172.21.15.19:0/3021853209 conn(0x7fb28c06bc10 msgr2=0x7fb28c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:21.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.390+0000 7fb290f11640 1 -- 172.21.15.19:0/3021853209 shutdown_connections 2024-09-12T02:05:21.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.390+0000 7fb290f11640 1 -- 172.21.15.19:0/3021853209 wait complete. 2024-09-12T02:05:21.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.391+0000 7fb290f11640 1 Processor -- start 2024-09-12T02:05:21.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.391+0000 7fb290f11640 1 -- start start 2024-09-12T02:05:21.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb290f11640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0af280 0x7fb28c1f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:21.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb290f11640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb28c0affb0 0x7fb28c15a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:21.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb290f11640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb28c0b69d0 0x7fb28c15a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:21.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb290f11640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c155410 con 0x7fb28c0af280 2024-09-12T02:05:21.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb290f11640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c0af6e0 con 0x7fb28c0b69d0 2024-09-12T02:05:21.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb290f11640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb28c155590 con 0x7fb28c0affb0 2024-09-12T02:05:21.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb28a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0af280 0x7fb28c1f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:21.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb28a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0af280 0x7fb28c1f4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51134/0 (socket says 172.21.15.19:51134) 2024-09-12T02:05:21.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb28a59c640 1 -- 172.21.15.19:0/3696258469 learned_addr learned my addr 172.21.15.19:0/3696258469 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:21.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb289d9b640 1 --2- 172.21.15.19:0/3696258469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb28c0affb0 0x7fb28c15a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:21.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb28ad9d640 1 --2- 172.21.15.19:0/3696258469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb28c0b69d0 0x7fb28c15a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:21.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb28a59c640 1 -- 172.21.15.19:0/3696258469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb28c0affb0 msgr2=0x7fb28c15a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:21.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb28a59c640 1 --2- 172.21.15.19:0/3696258469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb28c0affb0 0x7fb28c15a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb28a59c640 1 -- 172.21.15.19:0/3696258469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb28c0b69d0 msgr2=0x7fb28c15a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:21.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb28a59c640 1 --2- 172.21.15.19:0/3696258469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb28c0b69d0 0x7fb28c15a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb28a59c640 1 -- 172.21.15.19:0/3696258469 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28c0ce100 con 0x7fb28c0af280 2024-09-12T02:05:21.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb28a59c640 1 --2- 172.21.15.19:0/3696258469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0af280 0x7fb28c1f4370 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00d5d0 tx=0x7fb27c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:21.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb27affd640 1 -- 172.21.15.19:0/3696258469 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0125f0 con 0x7fb28c0af280 2024-09-12T02:05:21.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb27affd640 1 -- 172.21.15.19:0/3696258469 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb27c019070 con 0x7fb28c0af280 2024-09-12T02:05:21.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb290f11640 1 -- 172.21.15.19:0/3696258469 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb28c0ce3e0 con 0x7fb28c0af280 2024-09-12T02:05:21.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.392+0000 7fb27affd640 1 -- 172.21.15.19:0/3696258469 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0129f0 con 0x7fb28c0af280 2024-09-12T02:05:21.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.393+0000 7fb290f11640 1 -- 172.21.15.19:0/3696258469 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb28c0ce9a0 con 0x7fb28c0af280 2024-09-12T02:05:21.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.393+0000 7fb290f11640 1 -- 172.21.15.19:0/3696258469 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb28c06ec40 con 0x7fb28c0af280 2024-09-12T02:05:21.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.394+0000 7fb27affd640 1 -- 172.21.15.19:0/3696258469 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb27c012b90 con 0x7fb28c0af280 2024-09-12T02:05:21.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.394+0000 7fb27affd640 1 --2- 172.21.15.19:0/3696258469 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb26c06be30 0x7fb26c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:21.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.395+0000 7fb27affd640 1 -- 172.21.15.19:0/3696258469 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 8797+0+0 (secure 0 0 0) 0x7fb27c08bde0 con 0x7fb28c0af280 2024-09-12T02:05:21.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.395+0000 7fb289d9b640 1 --2- 172.21.15.19:0/3696258469 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb26c06be30 0x7fb26c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:21.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.395+0000 7fb289d9b640 1 --2- 172.21.15.19:0/3696258469 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb26c06be30 0x7fb26c06e2f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb280034000 tx=0x7fb28002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.399+0000 7fb27affd640 1 -- 172.21.15.19:0/3696258469 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb27c059510 con 0x7fb28c0af280 2024-09-12T02:05:21.501 INFO:tasks.ceph.mds.d.smithi135.stderr: -43> 2024-09-12T02:05:16.750+0000 7f0c1b74b640 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds0_inotable': End of buffer [buffer:2] 2024-09-12T02:05:21.527 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T02:05:21.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.611+0000 7fb290f11640 1 -- 172.21.15.19:0/3696258469 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb28c0b4c30 con 0x7fb28c0af280 2024-09-12T02:05:21.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.612+0000 7fb27affd640 1 -- 172.21.15.19:0/3696258469 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 250 v250) ==== 95+0+3563 (secure 0 0 0) 0x7fb27c05d810 con 0x7fb28c0af280 2024-09-12T02:05:21.611 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:21.611 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":250,"btime":"2024-09-12T02:05:20:836972+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":250,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:20.836911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:21.612 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 250 2024-09-12T02:05:21.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.613+0000 7fb290f11640 1 -- 172.21.15.19:0/3696258469 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb26c06be30 msgr2=0x7fb26c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:21.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.613+0000 7fb290f11640 1 --2- 172.21.15.19:0/3696258469 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb26c06be30 0x7fb26c06e2f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb280034000 tx=0x7fb28002e000 comp rx=0 tx=0).stop 2024-09-12T02:05:21.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.614+0000 7fb290f11640 1 -- 172.21.15.19:0/3696258469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0af280 msgr2=0x7fb28c1f4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:21.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.614+0000 7fb290f11640 1 --2- 172.21.15.19:0/3696258469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0af280 0x7fb28c1f4370 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00d5d0 tx=0x7fb27c00da90 comp rx=0 tx=0).stop 2024-09-12T02:05:21.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.614+0000 7fb290f11640 1 -- 172.21.15.19:0/3696258469 shutdown_connections 2024-09-12T02:05:21.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.614+0000 7fb290f11640 1 --2- 172.21.15.19:0/3696258469 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb26c06be30 0x7fb26c06e2f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.614+0000 7fb290f11640 1 --2- 172.21.15.19:0/3696258469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb28c0b69d0 0x7fb28c15a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.614+0000 7fb290f11640 1 --2- 172.21.15.19:0/3696258469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb28c0affb0 0x7fb28c15a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.614+0000 7fb290f11640 1 --2- 172.21.15.19:0/3696258469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0af280 0x7fb28c1f4370 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.614+0000 7fb290f11640 1 -- 172.21.15.19:0/3696258469 >> 172.21.15.19:0/3696258469 conn(0x7fb28c06bc10 msgr2=0x7fb28c06f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:21.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.614+0000 7fb290f11640 1 -- 172.21.15.19:0/3696258469 shutdown_connections 2024-09-12T02:05:21.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.614+0000 7fb290f11640 1 -- 172.21.15.19:0/3696258469 wait complete. 2024-09-12T02:05:21.624 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:05:21.624 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:21.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.727+0000 7fb29ae8d640 1 Processor -- start 2024-09-12T02:05:21.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.727+0000 7fb29ae8d640 1 -- start start 2024-09-12T02:05:21.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.728+0000 7fb29ae8d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb29415e740 0x7fb2940d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:21.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.728+0000 7fb29ae8d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb29406dbd0 0x7fb29406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:21.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.728+0000 7fb29ae8d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2940d0780 con 0x7fb29409b690 2024-09-12T02:05:21.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.728+0000 7fb29ae8d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb29415eb20 con 0x7fb29415e740 2024-09-12T02:05:21.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.728+0000 7fb29ae8d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb29406d260 con 0x7fb29406dbd0 2024-09-12T02:05:21.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.728+0000 7fb298c29640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb29415e740 0x7fb2940d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:21.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.728+0000 7fb293fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb29409b690 0x7fb29406d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37054/0 (socket says 172.21.15.19:37054) 2024-09-12T02:05:21.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.728+0000 7fb293fff640 1 -- 172.21.15.19:0/983031038 learned_addr learned my addr 172.21.15.19:0/983031038 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:21.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.728+0000 7fb29942a640 1 --2- 172.21.15.19:0/983031038 >> v2:172.21.15.135:3300/0 conn(0x7fb29406dbd0 0x7fb29406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:21.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.728+0000 7fb298c29640 1 -- 172.21.15.19:0/983031038 >> v2:172.21.15.135:3300/0 conn(0x7fb29406dbd0 msgr2=0x7fb29406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:21.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.728+0000 7fb298c29640 1 --2- 172.21.15.19:0/983031038 >> v2:172.21.15.135:3300/0 conn(0x7fb29406dbd0 0x7fb29406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.728+0000 7fb298c29640 1 -- 172.21.15.19:0/983031038 >> v1:172.21.15.19:6789/0 conn(0x7fb29409b690 legacy=0x7fb29406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:21.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.728+0000 7fb2937fe640 1 -- 172.21.15.19:0/983031038 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1161753717 0 0) 0x7fb2940d0780 con 0x7fb29409b690 2024-09-12T02:05:21.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.728+0000 7fb298c29640 1 -- 172.21.15.19:0/983031038 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2940d0a60 con 0x7fb29415e740 2024-09-12T02:05:21.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.728+0000 7fb29942a640 1 --2- 172.21.15.19:0/983031038 >> v2:172.21.15.135:3300/0 conn(0x7fb29406dbd0 0x7fb29406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:21.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.729+0000 7fb298c29640 1 --2- 172.21.15.19:0/983031038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb29415e740 0x7fb2940d1540 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7fb29406cba0 tx=0x7fb28802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99b0b399d930a68 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:21.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.729+0000 7fb2937fe640 1 -- 172.21.15.19:0/983031038 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb288037070 con 0x7fb29415e740 2024-09-12T02:05:21.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.729+0000 7fb2937fe640 1 -- 172.21.15.19:0/983031038 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb288032440 con 0x7fb29415e740 2024-09-12T02:05:21.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.729+0000 7fb2937fe640 1 -- 172.21.15.19:0/983031038 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb288032810 con 0x7fb29415e740 2024-09-12T02:05:21.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.730+0000 7fb29ae8d640 1 -- 172.21.15.19:0/983031038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb29415e740 msgr2=0x7fb2940d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:21.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.730+0000 7fb29ae8d640 1 --2- 172.21.15.19:0/983031038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb29415e740 0x7fb2940d1540 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7fb29406cba0 tx=0x7fb28802a230 comp rx=0 tx=0).stop 2024-09-12T02:05:21.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.730+0000 7fb29ae8d640 1 -- 172.21.15.19:0/983031038 shutdown_connections 2024-09-12T02:05:21.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.730+0000 7fb29ae8d640 1 --2- 172.21.15.19:0/983031038 >> v2:172.21.15.135:3300/0 conn(0x7fb29406dbd0 0x7fb29406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.730+0000 7fb29ae8d640 1 --2- 172.21.15.19:0/983031038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb29415e740 0x7fb2940d1540 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.730+0000 7fb29ae8d640 1 -- 172.21.15.19:0/983031038 >> 172.21.15.19:0/983031038 conn(0x7fb2940d23a0 msgr2=0x7fb2940d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:21.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.730+0000 7fb29ae8d640 1 -- 172.21.15.19:0/983031038 shutdown_connections 2024-09-12T02:05:21.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.730+0000 7fb29ae8d640 1 -- 172.21.15.19:0/983031038 wait complete. 2024-09-12T02:05:21.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.731+0000 7fb29ae8d640 1 Processor -- start 2024-09-12T02:05:21.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.731+0000 7fb29ae8d640 1 -- start start 2024-09-12T02:05:21.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.732+0000 7fb29ae8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb29406dbd0 0x7fb2940c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:21.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.732+0000 7fb29ae8d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb29409b690 0x7fb2940b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:21.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.732+0000 7fb29ae8d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb29415e740 0x7fb2940cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:21.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.732+0000 7fb29ae8d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb29409bac0 con 0x7fb29406dbd0 2024-09-12T02:05:21.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.732+0000 7fb29ae8d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb2940d1020 con 0x7fb29409b690 2024-09-12T02:05:21.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.732+0000 7fb29ae8d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb29406dfe0 con 0x7fb29415e740 2024-09-12T02:05:21.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.732+0000 7fb298c29640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb29406dbd0 0x7fb2940c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:21.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.732+0000 7fb298c29640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb29406dbd0 0x7fb2940c9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51162/0 (socket says 172.21.15.19:51162) 2024-09-12T02:05:21.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.732+0000 7fb298c29640 1 -- 172.21.15.19:0/1421797426 learned_addr learned my addr 172.21.15.19:0/1421797426 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:21.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.732+0000 7fb293fff640 1 --2- 172.21.15.19:0/1421797426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb29409b690 0x7fb2940b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:21.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.732+0000 7fb29942a640 1 --2- 172.21.15.19:0/1421797426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb29415e740 0x7fb2940cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:21.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.732+0000 7fb298c29640 1 -- 172.21.15.19:0/1421797426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb29415e740 msgr2=0x7fb2940cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:21.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.732+0000 7fb298c29640 1 --2- 172.21.15.19:0/1421797426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb29415e740 0x7fb2940cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.732+0000 7fb298c29640 1 -- 172.21.15.19:0/1421797426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb29409b690 msgr2=0x7fb2940b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:21.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.732+0000 7fb298c29640 1 --2- 172.21.15.19:0/1421797426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb29409b690 0x7fb2940b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.732+0000 7fb298c29640 1 -- 172.21.15.19:0/1421797426 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2940b03a0 con 0x7fb29406dbd0 2024-09-12T02:05:21.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.732+0000 7fb293fff640 1 --2- 172.21.15.19:0/1421797426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb29409b690 0x7fb2940b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:21.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.732+0000 7fb298c29640 1 --2- 172.21.15.19:0/1421797426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb29406dbd0 0x7fb2940c9500 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fb288000c00 tx=0x7fb2880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:21.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.733+0000 7fb2917fa640 1 -- 172.21.15.19:0/1421797426 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb288037050 con 0x7fb29406dbd0 2024-09-12T02:05:21.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.733+0000 7fb2917fa640 1 -- 172.21.15.19:0/1421797426 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb288038040 con 0x7fb29406dbd0 2024-09-12T02:05:21.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.733+0000 7fb29ae8d640 1 -- 172.21.15.19:0/1421797426 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2940b0680 con 0x7fb29406dbd0 2024-09-12T02:05:21.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.733+0000 7fb2917fa640 1 -- 172.21.15.19:0/1421797426 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb288004470 con 0x7fb29406dbd0 2024-09-12T02:05:21.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.733+0000 7fb29ae8d640 1 -- 172.21.15.19:0/1421797426 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2940cc160 con 0x7fb29406dbd0 2024-09-12T02:05:21.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.734+0000 7fb29ae8d640 1 -- 172.21.15.19:0/1421797426 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2940d0780 con 0x7fb29406dbd0 2024-09-12T02:05:21.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.734+0000 7fb2917fa640 1 -- 172.21.15.19:0/1421797426 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb288030900 con 0x7fb29406dbd0 2024-09-12T02:05:21.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.735+0000 7fb2917fa640 1 --2- 172.21.15.19:0/1421797426 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb27806be30 0x7fb27806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:21.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.735+0000 7fb2917fa640 1 -- 172.21.15.19:0/1421797426 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 8797+0+0 (secure 0 0 0) 0x7fb2880ac670 con 0x7fb29406dbd0 2024-09-12T02:05:21.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.735+0000 7fb293fff640 1 --2- 172.21.15.19:0/1421797426 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb27806be30 0x7fb27806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:21.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.736+0000 7fb293fff640 1 --2- 172.21.15.19:0/1421797426 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb27806be30 0x7fb27806e2f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb2940b82f0 tx=0x7fb280009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:21.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.739+0000 7fb2917fa640 1 -- 172.21.15.19:0/1421797426 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb28807a570 con 0x7fb29406dbd0 2024-09-12T02:05:21.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.956+0000 7fb29ae8d640 1 -- 172.21.15.19:0/1421797426 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2940d1cb0 con 0x7fb29406dbd0 2024-09-12T02:05:21.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.957+0000 7fb2917fa640 1 -- 172.21.15.19:0/1421797426 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 251 v251) ==== 95+0+4392 (secure 0 0 0) 0x7fb288079e70 con 0x7fb29406dbd0 2024-09-12T02:05:21.957 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:21.957 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":251,"btime":"2024-09-12T02:05:21:838202+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3910102099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910102099},{"type":"v1","addr":"172.21.15.135:6837","nonce":3910102099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":251}],"filesystems":[{"mdsmap":{"epoch":250,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:20.836911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:21.957 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 251 2024-09-12T02:05:21.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.959+0000 7fb29ae8d640 1 -- 172.21.15.19:0/1421797426 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb27806be30 msgr2=0x7fb27806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:21.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.959+0000 7fb29ae8d640 1 --2- 172.21.15.19:0/1421797426 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb27806be30 0x7fb27806e2f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb2940b82f0 tx=0x7fb280009040 comp rx=0 tx=0).stop 2024-09-12T02:05:21.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.959+0000 7fb29ae8d640 1 -- 172.21.15.19:0/1421797426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb29406dbd0 msgr2=0x7fb2940c9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:21.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.959+0000 7fb29ae8d640 1 --2- 172.21.15.19:0/1421797426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb29406dbd0 0x7fb2940c9500 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fb288000c00 tx=0x7fb2880046c0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.959+0000 7fb29ae8d640 1 -- 172.21.15.19:0/1421797426 shutdown_connections 2024-09-12T02:05:21.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.959+0000 7fb29ae8d640 1 --2- 172.21.15.19:0/1421797426 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb27806be30 0x7fb27806e2f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.959+0000 7fb29ae8d640 1 --2- 172.21.15.19:0/1421797426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb29415e740 0x7fb2940cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.959+0000 7fb29ae8d640 1 --2- 172.21.15.19:0/1421797426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb29409b690 0x7fb2940b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.959+0000 7fb29ae8d640 1 --2- 172.21.15.19:0/1421797426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb29406dbd0 0x7fb2940c9500 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:21.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.959+0000 7fb29ae8d640 1 -- 172.21.15.19:0/1421797426 >> 172.21.15.19:0/1421797426 conn(0x7fb2940d23a0 msgr2=0x7fb2940b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:21.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.959+0000 7fb29ae8d640 1 -- 172.21.15.19:0/1421797426 shutdown_connections 2024-09-12T02:05:21.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:21.959+0000 7fb29ae8d640 1 -- 172.21.15.19:0/1421797426 wait complete. 2024-09-12T02:05:21.970 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate 400.00000000' led to DAMAGED state 2024-09-12T02:05:21.970 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate 100.00000000.inode' 2024-09-12T02:05:21.970 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:05:21.971 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:05:21.987 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:05:21.987 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:05:21.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:21.987 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:05:22.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:05:22.043 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:05:22.043 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:05:22.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.186+0000 7f1d99e80640 1 Processor -- start 2024-09-12T02:05:22.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.186+0000 7f1d99e80640 1 -- start start 2024-09-12T02:05:22.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.187+0000 7f1d99e80640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d94147360 0x7f1d94070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:22.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.187+0000 7f1d99e80640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1d94070dd0 0x7f1d940d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:22.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.187+0000 7f1d99e80640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1d940d09e0 0x7f1d9406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:22.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.187+0000 7f1d99e80640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f1d9406cb30 con 0x7f1d940d09e0 2024-09-12T02:05:22.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.187+0000 7f1d99e80640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f1d940d0e30 con 0x7f1d94070dd0 2024-09-12T02:05:22.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.187+0000 7f1d99e80640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1d9406bfb0 con 0x7f1d94147360 2024-09-12T02:05:22.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.187+0000 7f1d93fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1d940d09e0 0x7f1d9406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:22.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.187+0000 7f1d93fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1d940d09e0 0x7f1d9406f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51172/0 (socket says 172.21.15.19:51172) 2024-09-12T02:05:22.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.187+0000 7f1d93fff640 1 -- 172.21.15.19:0/103609936 learned_addr learned my addr 172.21.15.19:0/103609936 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:22.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.188+0000 7f1d92ffd640 1 --2- 172.21.15.19:0/103609936 >> v2:172.21.15.135:3300/0 conn(0x7f1d94070dd0 0x7f1d940d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:22.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.188+0000 7f1d937fe640 1 --2- 172.21.15.19:0/103609936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d94147360 0x7f1d94070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:22.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.188+0000 7f1d93fff640 1 -- 172.21.15.19:0/103609936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d94147360 msgr2=0x7f1d94070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:22.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.188+0000 7f1d93fff640 1 --2- 172.21.15.19:0/103609936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d94147360 0x7f1d94070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.188+0000 7f1d93fff640 1 -- 172.21.15.19:0/103609936 >> v2:172.21.15.135:3300/0 conn(0x7f1d94070dd0 msgr2=0x7f1d940d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:22.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.188+0000 7f1d93fff640 1 --2- 172.21.15.19:0/103609936 >> v2:172.21.15.135:3300/0 conn(0x7f1d94070dd0 0x7f1d940d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.188+0000 7f1d93fff640 1 -- 172.21.15.19:0/103609936 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d9406c290 con 0x7f1d940d09e0 2024-09-12T02:05:22.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.188+0000 7f1d937fe640 1 --2- 172.21.15.19:0/103609936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d94147360 0x7f1d94070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:22.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.188+0000 7f1d93fff640 1 --2- 172.21.15.19:0/103609936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d940d09e0 0x7f1d9406f060 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f1d940ced90 tx=0x7f1d8c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dddbeadfaae855c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:22.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.189+0000 7f1d927fc640 1 -- 172.21.15.19:0/103609936 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c036070 con 0x7f1d940d09e0 2024-09-12T02:05:22.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.189+0000 7f1d927fc640 1 -- 172.21.15.19:0/103609936 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d8c031600 con 0x7f1d940d09e0 2024-09-12T02:05:22.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.189+0000 7f1d927fc640 1 -- 172.21.15.19:0/103609936 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0319d0 con 0x7f1d940d09e0 2024-09-12T02:05:22.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.189+0000 7f1d99e80640 1 -- 172.21.15.19:0/103609936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d940d09e0 msgr2=0x7f1d9406f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:22.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.189+0000 7f1d99e80640 1 --2- 172.21.15.19:0/103609936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d940d09e0 0x7f1d9406f060 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f1d940ced90 tx=0x7f1d8c02a610 comp rx=0 tx=0).stop 2024-09-12T02:05:22.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.189+0000 7f1d99e80640 1 -- 172.21.15.19:0/103609936 shutdown_connections 2024-09-12T02:05:22.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.189+0000 7f1d99e80640 1 --2- 172.21.15.19:0/103609936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d940d09e0 0x7f1d9406f060 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.189+0000 7f1d99e80640 1 --2- 172.21.15.19:0/103609936 >> v2:172.21.15.135:3300/0 conn(0x7f1d94070dd0 0x7f1d940d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.189+0000 7f1d99e80640 1 --2- 172.21.15.19:0/103609936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d94147360 0x7f1d94070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.189+0000 7f1d99e80640 1 -- 172.21.15.19:0/103609936 >> 172.21.15.19:0/103609936 conn(0x7f1d940b2f40 msgr2=0x7f1d940b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:22.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.189+0000 7f1d99e80640 1 -- 172.21.15.19:0/103609936 shutdown_connections 2024-09-12T02:05:22.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.189+0000 7f1d99e80640 1 -- 172.21.15.19:0/103609936 wait complete. 2024-09-12T02:05:22.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.190+0000 7f1d99e80640 1 Processor -- start 2024-09-12T02:05:22.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.191+0000 7f1d99e80640 1 -- start start 2024-09-12T02:05:22.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.191+0000 7f1d99e80640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d94070dd0 0x7f1d9415ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:22.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.191+0000 7f1d99e80640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d940d09e0 0x7f1d941e8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:22.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.191+0000 7f1d99e80640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d94147360 0x7f1d941423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:22.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.191+0000 7f1d99e80640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9406bc10 con 0x7f1d940d09e0 2024-09-12T02:05:22.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.191+0000 7f1d99e80640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9406c850 con 0x7f1d94070dd0 2024-09-12T02:05:22.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.191+0000 7f1d99e80640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1d9406bd90 con 0x7f1d94147360 2024-09-12T02:05:22.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.191+0000 7f1d92ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d940d09e0 0x7f1d941e8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:22.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.191+0000 7f1d92ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d940d09e0 0x7f1d941e8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51178/0 (socket says 172.21.15.19:51178) 2024-09-12T02:05:22.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.191+0000 7f1d92ffd640 1 -- 172.21.15.19:0/3307672089 learned_addr learned my addr 172.21.15.19:0/3307672089 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:22.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.192+0000 7f1d93fff640 1 --2- 172.21.15.19:0/3307672089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d94147360 0x7f1d941423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:22.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.192+0000 7f1d937fe640 1 --2- 172.21.15.19:0/3307672089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d94070dd0 0x7f1d9415ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:22.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.192+0000 7f1d92ffd640 1 -- 172.21.15.19:0/3307672089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d94147360 msgr2=0x7f1d941423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:22.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.192+0000 7f1d92ffd640 1 --2- 172.21.15.19:0/3307672089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d94147360 0x7f1d941423e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.192+0000 7f1d92ffd640 1 -- 172.21.15.19:0/3307672089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d94070dd0 msgr2=0x7f1d9415ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:22.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.192+0000 7f1d92ffd640 1 --2- 172.21.15.19:0/3307672089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d94070dd0 0x7f1d9415ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.192+0000 7f1d92ffd640 1 -- 172.21.15.19:0/3307672089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d941431c0 con 0x7f1d940d09e0 2024-09-12T02:05:22.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.192+0000 7f1d937fe640 1 --2- 172.21.15.19:0/3307672089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d94070dd0 0x7f1d9415ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:22.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.192+0000 7f1d92ffd640 1 --2- 172.21.15.19:0/3307672089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d940d09e0 0x7f1d941e8ae0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800d5f0 tx=0x7f1d8800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:22.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.192+0000 7f1d7bfff640 1 -- 172.21.15.19:0/3307672089 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d88004240 con 0x7f1d940d09e0 2024-09-12T02:05:22.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.192+0000 7f1d7bfff640 1 -- 172.21.15.19:0/3307672089 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d880043e0 con 0x7f1d940d09e0 2024-09-12T02:05:22.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.192+0000 7f1d7bfff640 1 -- 172.21.15.19:0/3307672089 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d88003610 con 0x7f1d940d09e0 2024-09-12T02:05:22.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.192+0000 7f1d99e80640 1 -- 172.21.15.19:0/3307672089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d941e9020 con 0x7f1d940d09e0 2024-09-12T02:05:22.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.192+0000 7f1d99e80640 1 -- 172.21.15.19:0/3307672089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d940b4e90 con 0x7f1d940d09e0 2024-09-12T02:05:22.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.193+0000 7f1d99e80640 1 -- 172.21.15.19:0/3307672089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d9406fa00 con 0x7f1d940d09e0 2024-09-12T02:05:22.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.194+0000 7f1d7bfff640 1 -- 172.21.15.19:0/3307672089 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1d8801b020 con 0x7f1d940d09e0 2024-09-12T02:05:22.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.194+0000 7f1d7bfff640 1 --2- 172.21.15.19:0/3307672089 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1d8006be30 0x7f1d8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:22.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.194+0000 7f1d7bfff640 1 -- 172.21.15.19:0/3307672089 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 8797+0+0 (secure 0 0 0) 0x7f1d8808b6b0 con 0x7f1d940d09e0 2024-09-12T02:05:22.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.194+0000 7f1d937fe640 1 --2- 172.21.15.19:0/3307672089 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1d8006be30 0x7f1d8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:22.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.195+0000 7f1d937fe640 1 --2- 172.21.15.19:0/3307672089 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1d8006be30 0x7f1d8006e2f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1d941f7890 tx=0x7f1d84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:22.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.198+0000 7f1d7bfff640 1 -- 172.21.15.19:0/3307672089 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1d88059490 con 0x7f1d940d09e0 2024-09-12T02:05:22.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.412+0000 7f1d99e80640 1 -- 172.21.15.19:0/3307672089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1d94145960 con 0x7f1d940d09e0 2024-09-12T02:05:22.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.844+0000 7f1d7bfff640 1 -- 172.21.15.19:0/3307672089 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v252) ==== 161+0+0 (secure 0 0 0) 0x7f1d88058d90 con 0x7f1d940d09e0 2024-09-12T02:05:22.844 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:05:22.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.846+0000 7f1d99e80640 1 -- 172.21.15.19:0/3307672089 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1d8006be30 msgr2=0x7f1d8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:22.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.846+0000 7f1d99e80640 1 --2- 172.21.15.19:0/3307672089 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1d8006be30 0x7f1d8006e2f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1d941f7890 tx=0x7f1d84008040 comp rx=0 tx=0).stop 2024-09-12T02:05:22.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.846+0000 7f1d99e80640 1 -- 172.21.15.19:0/3307672089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d940d09e0 msgr2=0x7f1d941e8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:22.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.846+0000 7f1d99e80640 1 --2- 172.21.15.19:0/3307672089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d940d09e0 0x7f1d941e8ae0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800d5f0 tx=0x7f1d8800dab0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.846+0000 7f1d99e80640 1 -- 172.21.15.19:0/3307672089 shutdown_connections 2024-09-12T02:05:22.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.846+0000 7f1d99e80640 1 --2- 172.21.15.19:0/3307672089 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1d8006be30 0x7f1d8006e2f0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.846+0000 7f1d99e80640 1 --2- 172.21.15.19:0/3307672089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d94147360 0x7f1d941423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.846+0000 7f1d99e80640 1 --2- 172.21.15.19:0/3307672089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d940d09e0 0x7f1d941e8ae0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.846+0000 7f1d99e80640 1 --2- 172.21.15.19:0/3307672089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d94070dd0 0x7f1d9415ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.846+0000 7f1d99e80640 1 -- 172.21.15.19:0/3307672089 >> 172.21.15.19:0/3307672089 conn(0x7f1d940b2f40 msgr2=0x7f1d94146590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:22.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.847+0000 7f1d99e80640 1 -- 172.21.15.19:0/3307672089 shutdown_connections 2024-09-12T02:05:22.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.847+0000 7f1d99e80640 1 -- 172.21.15.19:0/3307672089 wait complete. 2024-09-12T02:05:22.859 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:05:22.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.965+0000 7f0f183ef640 1 Processor -- start 2024-09-12T02:05:22.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.965+0000 7f0f183ef640 1 -- start start 2024-09-12T02:05:22.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.966+0000 7f0f183ef640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0f1015e5f0 0x7f0f100d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:22.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.966+0000 7f0f183ef640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f100d30f0 0x7f0f100b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:22.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.966+0000 7f0f183ef640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0f100b64c0 0x7f0f100cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:22.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.966+0000 7f0f183ef640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f0f1006d530 con 0x7f0f1015e5f0 2024-09-12T02:05:22.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.966+0000 7f0f183ef640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0f100d3690 con 0x7f0f100b64c0 2024-09-12T02:05:22.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.966+0000 7f0f183ef640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0f100d3970 con 0x7f0f100d30f0 2024-09-12T02:05:22.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.966+0000 7f0f1618b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0f1015e5f0 0x7f0f100d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:22.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.966+0000 7f0f1618b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0f1015e5f0 0x7f0f100d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51192/0 (socket says 172.21.15.19:51192) 2024-09-12T02:05:22.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.966+0000 7f0f1618b640 1 -- 172.21.15.19:0/2578093351 learned_addr learned my addr 172.21.15.19:0/2578093351 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:22.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.966+0000 7f0f1698c640 1 --2- 172.21.15.19:0/2578093351 >> v2:172.21.15.135:3300/0 conn(0x7f0f100b64c0 0x7f0f100cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:22.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.966+0000 7f0f1598a640 1 --2- 172.21.15.19:0/2578093351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f100d30f0 0x7f0f100b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:22.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.966+0000 7f0f1618b640 1 -- 172.21.15.19:0/2578093351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f100d30f0 msgr2=0x7f0f100b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:22.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.966+0000 7f0f1618b640 1 --2- 172.21.15.19:0/2578093351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f100d30f0 0x7f0f100b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.966+0000 7f0f1618b640 1 -- 172.21.15.19:0/2578093351 >> v2:172.21.15.135:3300/0 conn(0x7f0f100b64c0 msgr2=0x7f0f100cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:22.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.966+0000 7f0f1618b640 1 --2- 172.21.15.19:0/2578093351 >> v2:172.21.15.135:3300/0 conn(0x7f0f100b64c0 0x7f0f100cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.966+0000 7f0f1618b640 1 -- 172.21.15.19:0/2578093351 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1006cee0 con 0x7f0f1015e5f0 2024-09-12T02:05:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.967+0000 7f0f1618b640 1 --2- 172.21.15.19:0/2578093351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f1015e5f0 0x7f0f100d4dd0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f0f100a23f0 tx=0x7f0f0802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f2f69bc27035f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.967+0000 7f0f15189640 1 -- 172.21.15.19:0/2578093351 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f08037070 con 0x7f0f1015e5f0 2024-09-12T02:05:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.967+0000 7f0f15189640 1 -- 172.21.15.19:0/2578093351 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f08032440 con 0x7f0f1015e5f0 2024-09-12T02:05:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.967+0000 7f0f15189640 1 -- 172.21.15.19:0/2578093351 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f08032810 con 0x7f0f1015e5f0 2024-09-12T02:05:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.968+0000 7f0f183ef640 1 -- 172.21.15.19:0/2578093351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f1015e5f0 msgr2=0x7f0f100d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.968+0000 7f0f183ef640 1 --2- 172.21.15.19:0/2578093351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f1015e5f0 0x7f0f100d4dd0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f0f100a23f0 tx=0x7f0f0802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.968+0000 7f0f183ef640 1 -- 172.21.15.19:0/2578093351 shutdown_connections 2024-09-12T02:05:22.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.968+0000 7f0f183ef640 1 --2- 172.21.15.19:0/2578093351 >> v2:172.21.15.135:3300/0 conn(0x7f0f100b64c0 0x7f0f100cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.968+0000 7f0f183ef640 1 --2- 172.21.15.19:0/2578093351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f100d30f0 0x7f0f100b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.968+0000 7f0f183ef640 1 --2- 172.21.15.19:0/2578093351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f1015e5f0 0x7f0f100d4dd0 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.968+0000 7f0f183ef640 1 -- 172.21.15.19:0/2578093351 >> 172.21.15.19:0/2578093351 conn(0x7f0f1008bfc0 msgr2=0x7f0f100d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:22.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.968+0000 7f0f183ef640 1 -- 172.21.15.19:0/2578093351 shutdown_connections 2024-09-12T02:05:22.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.968+0000 7f0f183ef640 1 -- 172.21.15.19:0/2578093351 wait complete. 2024-09-12T02:05:22.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.969+0000 7f0f183ef640 1 Processor -- start 2024-09-12T02:05:22.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.969+0000 7f0f183ef640 1 -- start start 2024-09-12T02:05:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.970+0000 7f0f183ef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f100b64c0 0x7f0f101588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.970+0000 7f0f183ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f100d30f0 0x7f0f100c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.970+0000 7f0f183ef640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f1015e5f0 0x7f0f100c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.970+0000 7f0f183ef640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0f100d5310 con 0x7f0f100b64c0 2024-09-12T02:05:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.970+0000 7f0f183ef640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1015e9d0 con 0x7f0f100d30f0 2024-09-12T02:05:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.970+0000 7f0f183ef640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0f100cf540 con 0x7f0f1015e5f0 2024-09-12T02:05:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.970+0000 7f0f1618b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f100b64c0 0x7f0f101588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:22.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.970+0000 7f0f1618b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f100b64c0 0x7f0f101588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51196/0 (socket says 172.21.15.19:51196) 2024-09-12T02:05:22.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.970+0000 7f0f1618b640 1 -- 172.21.15.19:0/2332994700 learned_addr learned my addr 172.21.15.19:0/2332994700 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:22.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.970+0000 7f0f1598a640 1 --2- 172.21.15.19:0/2332994700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f100d30f0 0x7f0f100c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:22.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.970+0000 7f0f1698c640 1 --2- 172.21.15.19:0/2332994700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f1015e5f0 0x7f0f100c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:22.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.971+0000 7f0f1618b640 1 -- 172.21.15.19:0/2332994700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f1015e5f0 msgr2=0x7f0f100c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:22.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.971+0000 7f0f1618b640 1 --2- 172.21.15.19:0/2332994700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f1015e5f0 0x7f0f100c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.971+0000 7f0f1618b640 1 -- 172.21.15.19:0/2332994700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f100d30f0 msgr2=0x7f0f100c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:22.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.971+0000 7f0f1618b640 1 --2- 172.21.15.19:0/2332994700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f100d30f0 0x7f0f100c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.971+0000 7f0f1618b640 1 -- 172.21.15.19:0/2332994700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f100b7350 con 0x7f0f100b64c0 2024-09-12T02:05:22.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.971+0000 7f0f1618b640 1 --2- 172.21.15.19:0/2332994700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f100b64c0 0x7f0f101588b0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f0f08000c00 tx=0x7f0f080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:22.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.971+0000 7f0f0effd640 1 -- 172.21.15.19:0/2332994700 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f08041020 con 0x7f0f100b64c0 2024-09-12T02:05:22.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.971+0000 7f0f0effd640 1 -- 172.21.15.19:0/2332994700 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f080306c0 con 0x7f0f100b64c0 2024-09-12T02:05:22.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.971+0000 7f0f183ef640 1 -- 172.21.15.19:0/2332994700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f100b9ba0 con 0x7f0f100b64c0 2024-09-12T02:05:22.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.971+0000 7f0f0effd640 1 -- 172.21.15.19:0/2332994700 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f08037040 con 0x7f0f100b64c0 2024-09-12T02:05:22.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.971+0000 7f0f183ef640 1 -- 172.21.15.19:0/2332994700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f100ba160 con 0x7f0f100b64c0 2024-09-12T02:05:22.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.972+0000 7f0f183ef640 1 -- 172.21.15.19:0/2332994700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f100b5f80 con 0x7f0f100b64c0 2024-09-12T02:05:22.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.973+0000 7f0f0effd640 1 -- 172.21.15.19:0/2332994700 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f08044020 con 0x7f0f100b64c0 2024-09-12T02:05:22.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.973+0000 7f0f0effd640 1 --2- 172.21.15.19:0/2332994700 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0efc06be80 0x7f0efc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:22.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.973+0000 7f0f0effd640 1 -- 172.21.15.19:0/2332994700 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 8797+0+0 (secure 0 0 0) 0x7f0f080ac130 con 0x7f0f100b64c0 2024-09-12T02:05:22.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.973+0000 7f0f1598a640 1 --2- 172.21.15.19:0/2332994700 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0efc06be80 0x7f0efc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:22.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.974+0000 7f0f1598a640 1 --2- 172.21.15.19:0/2332994700 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0efc06be80 0x7f0efc06e340 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0f100b6b00 tx=0x7f0f04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:22.978+0000 7f0f0effd640 1 -- 172.21.15.19:0/2332994700 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f0804b030 con 0x7f0f100b64c0 2024-09-12T02:05:23.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.226+0000 7f0f183ef640 1 -- 172.21.15.19:0/2332994700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f0f100b6c00 con 0x7f0f100b64c0 2024-09-12T02:05:23.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.846+0000 7f0f0effd640 1 -- 172.21.15.19:0/2332994700 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v253) ==== 101+0+0 (secure 0 0 0) 0x7f0f080798b0 con 0x7f0f100b64c0 2024-09-12T02:05:23.846 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:05:23.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.849+0000 7f0f183ef640 1 -- 172.21.15.19:0/2332994700 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0efc06be80 msgr2=0x7f0efc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:23.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.849+0000 7f0f183ef640 1 --2- 172.21.15.19:0/2332994700 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0efc06be80 0x7f0efc06e340 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0f100b6b00 tx=0x7f0f04008040 comp rx=0 tx=0).stop 2024-09-12T02:05:23.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.849+0000 7f0f183ef640 1 -- 172.21.15.19:0/2332994700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f100b64c0 msgr2=0x7f0f101588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:23.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.849+0000 7f0f183ef640 1 --2- 172.21.15.19:0/2332994700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f100b64c0 0x7f0f101588b0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f0f08000c00 tx=0x7f0f080046c0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.849+0000 7f0f183ef640 1 -- 172.21.15.19:0/2332994700 shutdown_connections 2024-09-12T02:05:23.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.849+0000 7f0f183ef640 1 --2- 172.21.15.19:0/2332994700 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0efc06be80 0x7f0efc06e340 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.849+0000 7f0f183ef640 1 --2- 172.21.15.19:0/2332994700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f1015e5f0 0x7f0f100c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.849+0000 7f0f183ef640 1 --2- 172.21.15.19:0/2332994700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f100d30f0 0x7f0f100c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.849+0000 7f0f183ef640 1 --2- 172.21.15.19:0/2332994700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f100b64c0 0x7f0f101588b0 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.849+0000 7f0f183ef640 1 -- 172.21.15.19:0/2332994700 >> 172.21.15.19:0/2332994700 conn(0x7f0f1008bfc0 msgr2=0x7f0f100b55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:23.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.849+0000 7f0f183ef640 1 -- 172.21.15.19:0/2332994700 shutdown_connections 2024-09-12T02:05:23.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.849+0000 7f0f183ef640 1 -- 172.21.15.19:0/2332994700 wait complete. 2024-09-12T02:05:23.862 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:05:23.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.911+0000 7fd35520cf40 1 Processor -- start 2024-09-12T02:05:23.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.911+0000 7fd35520cf40 1 -- start start 2024-09-12T02:05:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd35520cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c0030f0 0x55fd27fb92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd35520cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fd27f35b20 0x55fd27f36ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd35520cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fd27f37530 0x55fd27fc7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd35520cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fd27e41510 con 0x55fd27f37530 2024-09-12T02:05:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd35520cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fd27eeff20 con 0x7fd33c0030f0 2024-09-12T02:05:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd35520cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55fd27fc3e70 con 0x55fd27f35b20 2024-09-12T02:05:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd352798640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fd27f37530 0x55fd27fc7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd352798640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fd27f37530 0x55fd27fc7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51214/0 (socket says 172.21.15.19:51214) 2024-09-12T02:05:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd352798640 1 -- 172.21.15.19:0/2724625421 learned_addr learned my addr 172.21.15.19:0/2724625421 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd351f97640 1 --2- 172.21.15.19:0/2724625421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c0030f0 0x55fd27fb92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd351796640 1 --2- 172.21.15.19:0/2724625421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fd27f35b20 0x55fd27f36ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd352798640 1 -- 172.21.15.19:0/2724625421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fd27f35b20 msgr2=0x55fd27f36ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd352798640 1 --2- 172.21.15.19:0/2724625421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fd27f35b20 0x55fd27f36ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd352798640 1 -- 172.21.15.19:0/2724625421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c0030f0 msgr2=0x55fd27fb92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd352798640 1 --2- 172.21.15.19:0/2724625421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c0030f0 0x55fd27fb92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd352798640 1 -- 172.21.15.19:0/2724625421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd27fc9280 con 0x55fd27f37530 2024-09-12T02:05:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd352798640 1 --2- 172.21.15.19:0/2724625421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fd27f37530 0x55fd27fc7730 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fd34c005fd0 tx=0x7fd34c005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108dc2a85396d0d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd343fff640 1 -- 172.21.15.19:0/2724625421 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34c017030 con 0x55fd27f37530 2024-09-12T02:05:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd343fff640 1 -- 172.21.15.19:0/2724625421 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd34c0106d0 con 0x55fd27f37530 2024-09-12T02:05:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.912+0000 7fd343fff640 1 -- 172.21.15.19:0/2724625421 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34c010880 con 0x55fd27f37530 2024-09-12T02:05:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.913+0000 7fd35520cf40 1 -- 172.21.15.19:0/2724625421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fd27f37530 msgr2=0x55fd27fc7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.913+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2724625421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fd27f37530 0x55fd27fc7730 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fd34c005fd0 tx=0x7fd34c005d80 comp rx=0 tx=0).stop 2024-09-12T02:05:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.913+0000 7fd35520cf40 1 -- 172.21.15.19:0/2724625421 shutdown_connections 2024-09-12T02:05:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.913+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2724625421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fd27f37530 0x55fd27fc7730 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.913+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2724625421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fd27f35b20 0x55fd27f36ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.913+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2724625421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c0030f0 0x55fd27fb92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.913+0000 7fd35520cf40 1 -- 172.21.15.19:0/2724625421 >> 172.21.15.19:0/2724625421 conn(0x55fd27f1d490 msgr2=0x55fd27f36180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.913+0000 7fd35520cf40 1 -- 172.21.15.19:0/2724625421 shutdown_connections 2024-09-12T02:05:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.913+0000 7fd35520cf40 1 -- 172.21.15.19:0/2724625421 wait complete. 2024-09-12T02:05:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.914+0000 7fd35520cf40 1 Processor -- start 2024-09-12T02:05:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.914+0000 7fd35520cf40 1 -- start start 2024-09-12T02:05:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.914+0000 7fd35520cf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fd27f35b20 0x55fd27fb84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.914+0000 7fd35520cf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fd27f37530 0x55fd27fb4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.914+0000 7fd35520cf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c0030f0 0x55fd27fbbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.914+0000 7fd35520cf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fd27fc9560 con 0x55fd27f37530 2024-09-12T02:05:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.914+0000 7fd35520cf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fd27f379b0 con 0x7fd33c0030f0 2024-09-12T02:05:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.914+0000 7fd35520cf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55fd27fc9840 con 0x55fd27f35b20 2024-09-12T02:05:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.915+0000 7fd351796640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fd27f37530 0x55fd27fb4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.915+0000 7fd351796640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fd27f37530 0x55fd27fb4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51226/0 (socket says 172.21.15.19:51226) 2024-09-12T02:05:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.915+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 learned_addr learned my addr 172.21.15.19:0/2256233242 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.915+0000 7fd351f97640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fd27f35b20 0x55fd27fb84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.915+0000 7fd352798640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c0030f0 0x55fd27fbbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.915+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fd27f35b20 msgr2=0x55fd27fb84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.915+0000 7fd351796640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55fd27f35b20 0x55fd27fb84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.915+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c0030f0 msgr2=0x55fd27fbbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.915+0000 7fd351796640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c0030f0 0x55fd27fbbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.915+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd27fbaf40 con 0x55fd27f37530 2024-09-12T02:05:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.915+0000 7fd351796640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fd27f37530 0x55fd27fb4740 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fd348025e30 tx=0x7fd348003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.915+0000 7fd342ffd640 1 -- 172.21.15.19:0/2256233242 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd348068070 con 0x55fd27f37530 2024-09-12T02:05:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.915+0000 7fd342ffd640 1 -- 172.21.15.19:0/2256233242 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd34804f860 con 0x55fd27f37530 2024-09-12T02:05:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.915+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd27fbb220 con 0x55fd27f37530 2024-09-12T02:05:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.915+0000 7fd342ffd640 1 -- 172.21.15.19:0/2256233242 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34804fc50 con 0x55fd27f37530 2024-09-12T02:05:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.915+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd27fbb7e0 con 0x55fd27f37530 2024-09-12T02:05:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.917+0000 7fd342ffd640 1 -- 172.21.15.19:0/2256233242 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd348063400 con 0x55fd27f37530 2024-09-12T02:05:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.917+0000 7fd342ffd640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd33406a810 0x7fd33406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.917+0000 7fd342ffd640 1 -- 172.21.15.19:0/2256233242 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 8797+0+0 (secure 0 0 0) 0x7fd3480cdae0 con 0x55fd27f37530 2024-09-12T02:05:23.919 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:05:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.918+0000 7fd351f97640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd33406a810 0x7fd33406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.918+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55fd27f36730 0x55fd2805e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.918+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2805e620 con 0x55fd27f36730 2024-09-12T02:05:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.918+0000 7fd352798640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55fd27f36730 0x55fd2805e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.918+0000 7fd351f97640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd33406a810 0x7fd33406ccd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd344001860 tx=0x7fd344011040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.918+0000 7fd352798640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55fd27f36730 0x55fd2805e0e0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.920+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v124'908 uv882 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.920+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd2805ea30 con 0x55fd27f36730 2024-09-12T02:05:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.921+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v124'909 uv909 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.921+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806a6a0 con 0x55fd27f36730 2024-09-12T02:05:23.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.922+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v124'910 uv910 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.922 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:05:23.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.922+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806ba50 con 0x55fd27f36730 2024-09-12T02:05:23.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.923+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v124'911 uv911 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.923+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806bdf0 con 0x55fd27f36730 2024-09-12T02:05:23.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.924+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v124'912 uv912 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.924+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806aa40 con 0x55fd27f36730 2024-09-12T02:05:23.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.925+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v124'913 uv913 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.925+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806ade0 con 0x55fd27f36730 2024-09-12T02:05:23.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.927+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v124'914 uv888 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.927+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b1d0 con 0x55fd27f36730 2024-09-12T02:05:23.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.928+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v124'915 uv915 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.928+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b1d0 con 0x55fd27f36730 2024-09-12T02:05:23.928 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:05:23.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.929+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v124'916 uv916 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.929+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.930+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v124'917 uv917 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.930+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.931+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v124'918 uv918 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.931+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.932+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v124'919 uv919 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.932+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.933+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v124'920 uv895 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.933+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.935+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v124'921 uv921 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.935+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.936+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v124'922 uv922 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.935 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:05:23.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.936+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.937+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v124'923 uv923 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.937+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.938+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v124'924 uv924 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.938+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.939+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v124'925 uv925 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.939+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.940+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v124'926 uv926 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.940+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.941+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v124'927 uv901 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.941+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.942+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v124'928 uv928 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.942+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.943+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v124'929 uv929 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.943 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:05:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.943+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.944+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v124'930 uv930 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.944+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.945+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v124'931 uv931 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.945+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.946+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v124'932 uv932 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.946+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.948+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v124'933 uv907 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.948+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.949+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v124'934 uv934 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.949+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.949 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:05:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.950+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v124'935 uv935 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.950+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.951+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v124'936 uv936 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.951+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.952+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v124'937 uv937 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.952+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd27f36730 2024-09-12T02:05:23.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.953+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v124'938 uv938 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd27f36730 2024-09-12T02:05:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.953+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55fd2806b600 0x55fd2806e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.953+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806b180 con 0x55fd2806b600 2024-09-12T02:05:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.953+0000 7fd351f97640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55fd2806b600 0x55fd2806e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.954+0000 7fd351f97640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55fd2806b600 0x55fd2806e6b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:23.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.956+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v124'660 uv643 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.956+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806ebf0 con 0x55fd2806b600 2024-09-12T02:05:23.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.957+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v124'661 uv661 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.957+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806ef90 con 0x55fd2806b600 2024-09-12T02:05:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.959+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v124'662 uv662 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.958 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:05:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.959+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806f7e0 con 0x55fd2806b600 2024-09-12T02:05:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.960+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v124'663 uv663 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.960+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806fb80 con 0x55fd2806b600 2024-09-12T02:05:23.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.961+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v124'664 uv664 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.961+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806ff20 con 0x55fd2806b600 2024-09-12T02:05:23.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.963+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v124'665 uv648 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.963+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd280702c0 con 0x55fd2806b600 2024-09-12T02:05:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.964+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v124'666 uv666 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.964+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28070660 con 0x55fd2806b600 2024-09-12T02:05:23.964 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:05:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.965+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v124'667 uv667 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.965+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28070660 con 0x55fd2806b600 2024-09-12T02:05:23.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.966+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v124'668 uv668 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.966+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28070660 con 0x55fd2806b600 2024-09-12T02:05:23.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.968+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v124'669 uv669 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.968+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28070660 con 0x55fd2806b600 2024-09-12T02:05:23.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.969+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v124'670 uv653 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.969+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd28070660 con 0x55fd2806b600 2024-09-12T02:05:23.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.970+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v124'671 uv671 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.970+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28070660 con 0x55fd2806b600 2024-09-12T02:05:23.971 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:05:23.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.972+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v124'672 uv672 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.972+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28070660 con 0x55fd2806b600 2024-09-12T02:05:23.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.973+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v124'673 uv673 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.973+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28070660 con 0x55fd2806b600 2024-09-12T02:05:23.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.974+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v124'674 uv674 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.974+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28070660 con 0x55fd2806b600 2024-09-12T02:05:23.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.975+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v124'675 uv659 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.976+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd28070660 con 0x55fd2806b600 2024-09-12T02:05:23.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.977+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v124'676 uv676 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.977+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28070660 con 0x55fd2806b600 2024-09-12T02:05:23.977 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:05:23.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.978+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v124'677 uv677 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.978+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28070660 con 0x55fd2806b600 2024-09-12T02:05:23.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.979+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v124'678 uv678 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.979+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28070660 con 0x55fd2806b600 2024-09-12T02:05:23.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.980+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v124'679 uv679 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.980+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28070660 con 0x55fd2806b600 2024-09-12T02:05:23.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.982+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v124'680 uv680 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd2806b600 2024-09-12T02:05:23.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.982+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55fd28071130 0x55fd28071510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:23.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.982+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28073b20 con 0x55fd28071130 2024-09-12T02:05:23.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.982+0000 7fd351796640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55fd28071130 0x55fd28071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:23.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.982+0000 7fd351796640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55fd28071130 0x55fd28071510 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:23.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.984+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v124'177 uv176 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:23.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.984+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd28073ec0 con 0x55fd28071130 2024-09-12T02:05:23.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.985+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v124'178 uv178 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:23.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.985+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28074260 con 0x55fd28071130 2024-09-12T02:05:23.985 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:05:23.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.986+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v124'179 uv179 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:23.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.986+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2806f430 con 0x55fd28071130 2024-09-12T02:05:23.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.987+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v124'180 uv180 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:23.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.987+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28075bf0 con 0x55fd28071130 2024-09-12T02:05:23.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.988+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v124'181 uv181 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:23.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.988+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28074b00 con 0x55fd28071130 2024-09-12T02:05:23.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.989+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v124'182 uv182 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:23.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.989+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55fd280755e0 0x55fd28078030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:23.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.989+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd280785b0 con 0x55fd280755e0 2024-09-12T02:05:23.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.989+0000 7fd352798640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55fd280755e0 0x55fd28078030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:23.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.990+0000 7fd352798640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55fd280755e0 0x55fd28078030 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:23.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.991+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v124'130 uv129 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:23.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.991+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd28078980 con 0x55fd280755e0 2024-09-12T02:05:23.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.992+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v124'131 uv131 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:23.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.993+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28078980 con 0x55fd280755e0 2024-09-12T02:05:23.993 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:05:23.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.994+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v124'132 uv132 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:23.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.994+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28078980 con 0x55fd280755e0 2024-09-12T02:05:23.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.995+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v124'133 uv133 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:23.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.995+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55fd28079280 0x55fd2807b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:23.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.995+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bbb0 con 0x55fd28079280 2024-09-12T02:05:23.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.995+0000 7fd351f97640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55fd28079280 0x55fd2807b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:23.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.996+0000 7fd351f97640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55fd28079280 0x55fd2807b670 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:23.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.997+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v124'177 uv176 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:23.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.997+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bbb0 con 0x55fd28079280 2024-09-12T02:05:23.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.998+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v124'178 uv178 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:23.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.998+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bbb0 con 0x55fd28079280 2024-09-12T02:05:23.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.999+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v124'179 uv179 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:23.999 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:05:23.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:23.999+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807cfe0 con 0x55fd28079280 2024-09-12T02:05:24.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.001+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v124'180 uv180 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.001+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807cfe0 con 0x55fd28079280 2024-09-12T02:05:24.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.002+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v124'181 uv181 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.002+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd28079280 2024-09-12T02:05:24.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.003+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v124'182 uv182 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.003+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd280755e0 2024-09-12T02:05:24.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.004+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v124'327 uv321 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:24.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.004+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd280755e0 2024-09-12T02:05:24.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.005+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v124'328 uv328 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:24.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.005+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd280755e0 2024-09-12T02:05:24.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.006+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v124'329 uv329 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:24.006 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:05:24.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.007+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807cfe0 con 0x55fd280755e0 2024-09-12T02:05:24.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.007+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v124'330 uv330 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:24.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.007+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807cfe0 con 0x55fd280755e0 2024-09-12T02:05:24.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.008+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v124'331 uv331 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:24.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.008+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd280755e0 2024-09-12T02:05:24.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.009+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v124'332 uv332 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:24.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.009+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd280755e0 2024-09-12T02:05:24.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.010+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v124'333 uv326 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:24.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.010+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd280755e0 2024-09-12T02:05:24.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.011+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v124'334 uv334 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:24.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.011+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd280755e0 2024-09-12T02:05:24.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.012+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v124'335 uv335 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:24.012 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:05:24.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.012+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd280755e0 2024-09-12T02:05:24.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.013+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v124'336 uv336 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:24.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.013+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd280755e0 2024-09-12T02:05:24.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.014+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v124'337 uv337 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:24.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.014+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd280755e0 2024-09-12T02:05:24.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.015+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v124'148 uv147 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:24.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.015+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd280755e0 2024-09-12T02:05:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.016+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v124'149 uv149 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.016+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd280755e0 2024-09-12T02:05:24.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.017+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v124'150 uv150 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:24.017 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:05:24.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.017+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd280755e0 2024-09-12T02:05:24.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.018+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v124'151 uv151 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:24.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.018+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd280755e0 2024-09-12T02:05:24.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.019+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v124'152 uv152 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fd34c010c40 con 0x55fd280755e0 2024-09-12T02:05:24.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.019+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd28079280 2024-09-12T02:05:24.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.021+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v124'177 uv176 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.021+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd28079280 2024-09-12T02:05:24.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.022+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v124'178 uv178 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.022+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd28079280 2024-09-12T02:05:24.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.023+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v124'179 uv179 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.022 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:05:24.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.023+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807cfe0 con 0x55fd28079280 2024-09-12T02:05:24.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.024+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v124'180 uv180 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.024+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807cfe0 con 0x55fd28079280 2024-09-12T02:05:24.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.025+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v124'181 uv181 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.025+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd28079280 2024-09-12T02:05:24.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.026+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v124'182 uv182 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.026+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd28079280 2024-09-12T02:05:24.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.027+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v124'294 uv288 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.027+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd28079280 2024-09-12T02:05:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.028+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v124'295 uv295 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.028+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd28079280 2024-09-12T02:05:24.029 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:05:24.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.030+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v124'296 uv296 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.030+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd28079280 2024-09-12T02:05:24.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.031+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v124'297 uv297 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.031+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd28079280 2024-09-12T02:05:24.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.032+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v124'298 uv298 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.032+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd28079280 2024-09-12T02:05:24.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.033+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v124'299 uv293 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.033+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd28079280 2024-09-12T02:05:24.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.034+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v124'300 uv300 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.034+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd28079280 2024-09-12T02:05:24.034 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:05:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.035+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v124'301 uv301 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.035+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd28079280 2024-09-12T02:05:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.036+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v124'302 uv302 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.036+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807ede0 con 0x55fd28079280 2024-09-12T02:05:24.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.037+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v124'303 uv303 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.037+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55fd2807cb00 0x55fd2807f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.037+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807eef0 con 0x55fd2807cb00 2024-09-12T02:05:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.037+0000 7fd351796640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55fd2807cb00 0x55fd2807f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.038+0000 7fd351796640 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55fd2807cb00 0x55fd2807f3c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:24.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.039+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v124'128 uv127 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd2807cb00 2024-09-12T02:05:24.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.039+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807f900 con 0x55fd2807cb00 2024-09-12T02:05:24.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.040+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v124'129 uv129 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd2807cb00 2024-09-12T02:05:24.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.040+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807fca0 con 0x55fd2807cb00 2024-09-12T02:05:24.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.041+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v124'130 uv130 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd2807cb00 2024-09-12T02:05:24.041 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:05:24.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.041+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807fca0 con 0x55fd2807cb00 2024-09-12T02:05:24.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.042+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v124'131 uv131 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd2807cb00 2024-09-12T02:05:24.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.042+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807c050 con 0x55fd28079280 2024-09-12T02:05:24.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.043+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v124'177 uv176 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.043+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807c050 con 0x55fd28079280 2024-09-12T02:05:24.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.044+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v124'178 uv178 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.044+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807c050 con 0x55fd28079280 2024-09-12T02:05:24.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.045+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v124'179 uv179 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.045 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:05:24.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.045+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807c050 con 0x55fd28079280 2024-09-12T02:05:24.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.046+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v124'180 uv180 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.046+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd28079280 2024-09-12T02:05:24.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.047+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v124'181 uv181 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.047+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807bfd0 con 0x55fd28079280 2024-09-12T02:05:24.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.048+0000 7fd351f97640 1 -- 172.21.15.19:0/2256233242 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v124'182 uv182 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd344009040 con 0x55fd28079280 2024-09-12T02:05:24.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.049+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807fca0 con 0x55fd28071130 2024-09-12T02:05:24.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.050+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v124'151 uv150 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:24.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.050+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807fca0 con 0x55fd28071130 2024-09-12T02:05:24.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.051+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v124'152 uv152 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:24.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.051+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807fca0 con 0x55fd28071130 2024-09-12T02:05:24.051 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:05:24.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.052+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v124'153 uv153 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:24.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.052+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807fca0 con 0x55fd28071130 2024-09-12T02:05:24.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.053+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v124'154 uv154 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:24.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.054+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807c050 con 0x55fd28071130 2024-09-12T02:05:24.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.055+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v124'155 uv155 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:24.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.055+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807c050 con 0x55fd28071130 2024-09-12T02:05:24.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.056+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v124'363 uv355 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:24.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.056+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807fca0 con 0x55fd28071130 2024-09-12T02:05:24.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.057+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v124'364 uv364 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:24.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.057+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807fca0 con 0x55fd28071130 2024-09-12T02:05:24.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.058+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v124'365 uv365 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:24.058 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:05:24.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.058+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807fca0 con 0x55fd28071130 2024-09-12T02:05:24.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.059+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v124'366 uv366 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:24.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.059+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807fca0 con 0x55fd28071130 2024-09-12T02:05:24.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.060+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v124'367 uv367 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:24.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.060+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807fca0 con 0x55fd28071130 2024-09-12T02:05:24.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.061+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v124'368 uv362 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:24.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.061+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807fca0 con 0x55fd28071130 2024-09-12T02:05:24.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.063+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v124'369 uv369 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:24.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.063+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807fca0 con 0x55fd28071130 2024-09-12T02:05:24.063 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:05:24.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.064+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v124'370 uv370 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:24.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.064+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28080cf0 con 0x55fd28071130 2024-09-12T02:05:24.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.065+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v124'371 uv371 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:24.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.065+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28080cb0 con 0x55fd28071130 2024-09-12T02:05:24.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.066+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v124'372 uv372 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:24.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.066+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd2807fca0 con 0x55fd28071130 2024-09-12T02:05:24.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.067+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v124'373 uv373 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:24.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.067+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55fd28080150 con 0x55fd28071130 2024-09-12T02:05:24.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd351796640 1 -- 172.21.15.19:0/2256233242 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v124'374 uv374 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fd348061070 con 0x55fd28071130 2024-09-12T02:05:24.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55fd2806b600 msgr2=0x55fd2806e6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55fd2806b600 0x55fd2806e6b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55fd27f36730 msgr2=0x55fd2805e0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55fd27f36730 0x55fd2805e0e0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55fd280755e0 msgr2=0x55fd28078030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55fd280755e0 0x55fd28078030 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55fd2807cb00 msgr2=0x55fd2807f3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55fd2807cb00 0x55fd2807f3c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55fd28071130 msgr2=0x55fd28071510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55fd28071130 0x55fd28071510 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55fd28079280 msgr2=0x55fd2807b670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55fd28079280 0x55fd2807b670 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 reap_dead start 2024-09-12T02:05:24.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd352798640 1 -- 172.21.15.19:0/2256233242 reap_dead start 2024-09-12T02:05:24.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd33406a810 msgr2=0x7fd33406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd33406a810 0x7fd33406ccd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd344001860 tx=0x7fd344011040 comp rx=0 tx=0).stop 2024-09-12T02:05:24.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fd27f37530 msgr2=0x55fd27fb4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fd27f37530 0x55fd27fb4740 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fd348025e30 tx=0x7fd348003020 comp rx=0 tx=0).stop 2024-09-12T02:05:24.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 shutdown_connections 2024-09-12T02:05:24.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd33406a810 0x7fd33406ccd0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 --2- 172.21.15.19:0/2256233242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fd27f37530 0x55fd27fb4740 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 >> 172.21.15.19:0/2256233242 conn(0x55fd27f1d490 msgr2=0x55fd27fbcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:24.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 shutdown_connections 2024-09-12T02:05:24.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.068+0000 7fd35520cf40 1 -- 172.21.15.19:0/2256233242 wait complete. 2024-09-12T02:05:24.071 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate 100.00000000.inode 0 2024-09-12T02:05:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.116+0000 7f6b31c1af40 1 Processor -- start 2024-09-12T02:05:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.116+0000 7f6b31c1af40 1 -- start start 2024-09-12T02:05:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.117+0000 7f6b31c1af40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b18002810 0x5634f8e6be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.117+0000 7f6b31c1af40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634f8ddf8a0 0x5634f8e60ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.117+0000 7f6b31c1af40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5634f8dc4e80 0x5634f8dc3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.117+0000 7f6b31c1af40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5634f8cea510 con 0x7f6b18002810 2024-09-12T02:05:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.117+0000 7f6b31c1af40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5634f8d43c50 con 0x5634f8ddf8a0 2024-09-12T02:05:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.117+0000 7f6b31c1af40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5634f8de06f0 con 0x5634f8dc4e80 2024-09-12T02:05:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.117+0000 7f6b2f710640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b18002810 0x5634f8e6be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.117+0000 7f6b2f710640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b18002810 0x5634f8e6be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51232/0 (socket says 172.21.15.19:51232) 2024-09-12T02:05:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.117+0000 7f6b2f710640 1 -- 172.21.15.19:0/801664618 learned_addr learned my addr 172.21.15.19:0/801664618 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.117+0000 7f6b2ef0f640 1 --2- 172.21.15.19:0/801664618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634f8ddf8a0 0x5634f8e60ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.117+0000 7f6b2ff11640 1 --2- 172.21.15.19:0/801664618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5634f8dc4e80 0x5634f8dc3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.117+0000 7f6b2f710640 1 -- 172.21.15.19:0/801664618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5634f8dc4e80 msgr2=0x5634f8dc3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.117+0000 7f6b2f710640 1 --2- 172.21.15.19:0/801664618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5634f8dc4e80 0x5634f8dc3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.117+0000 7f6b2f710640 1 -- 172.21.15.19:0/801664618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634f8ddf8a0 msgr2=0x5634f8e60ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.117+0000 7f6b2f710640 1 --2- 172.21.15.19:0/801664618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634f8ddf8a0 0x5634f8e60ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.117+0000 7f6b2f710640 1 -- 172.21.15.19:0/801664618 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634f8e65da0 con 0x7f6b18002810 2024-09-12T02:05:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.118+0000 7f6b2f710640 1 --2- 172.21.15.19:0/801664618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b18002810 0x5634f8e6be70 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f6b200017a0 tx=0x7f6b20009ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e364bf6f4918de78 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.118+0000 7f6b2df0d640 1 -- 172.21.15.19:0/801664618 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2000e850 con 0x7f6b18002810 2024-09-12T02:05:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.118+0000 7f6b2df0d640 1 -- 172.21.15.19:0/801664618 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b20013030 con 0x7f6b18002810 2024-09-12T02:05:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.118+0000 7f6b2df0d640 1 -- 172.21.15.19:0/801664618 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2000ec50 con 0x7f6b18002810 2024-09-12T02:05:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.118+0000 7f6b31c1af40 1 -- 172.21.15.19:0/801664618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b18002810 msgr2=0x5634f8e6be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.118+0000 7f6b31c1af40 1 --2- 172.21.15.19:0/801664618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b18002810 0x5634f8e6be70 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f6b200017a0 tx=0x7f6b20009ac0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.118+0000 7f6b31c1af40 1 -- 172.21.15.19:0/801664618 shutdown_connections 2024-09-12T02:05:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.118+0000 7f6b31c1af40 1 --2- 172.21.15.19:0/801664618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5634f8dc4e80 0x5634f8dc3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.118+0000 7f6b31c1af40 1 --2- 172.21.15.19:0/801664618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634f8ddf8a0 0x5634f8e60ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.118+0000 7f6b31c1af40 1 --2- 172.21.15.19:0/801664618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b18002810 0x5634f8e6be70 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.118+0000 7f6b31c1af40 1 -- 172.21.15.19:0/801664618 >> 172.21.15.19:0/801664618 conn(0x5634f8d989e0 msgr2=0x5634f8d96e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.118+0000 7f6b31c1af40 1 -- 172.21.15.19:0/801664618 shutdown_connections 2024-09-12T02:05:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.118+0000 7f6b31c1af40 1 -- 172.21.15.19:0/801664618 wait complete. 2024-09-12T02:05:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.119+0000 7f6b31c1af40 1 Processor -- start 2024-09-12T02:05:24.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.119+0000 7f6b31c1af40 1 -- start start 2024-09-12T02:05:24.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.120+0000 7f6b31c1af40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634f8dc4e80 0x5634f8e61dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.120+0000 7f6b31c1af40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5634f8ddf8a0 0x5634f8e60080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.120+0000 7f6b31c1af40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b18002810 0x5634f8d978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.120+0000 7f6b31c1af40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5634f8e6b330 con 0x5634f8ddf8a0 2024-09-12T02:05:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.120+0000 7f6b31c1af40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5634f8e6b8f0 con 0x5634f8dc4e80 2024-09-12T02:05:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.120+0000 7f6b31c1af40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5634f8e6d7f0 con 0x7f6b18002810 2024-09-12T02:05:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.120+0000 7f6b2ef0f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5634f8ddf8a0 0x5634f8e60080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.120+0000 7f6b2f710640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634f8dc4e80 0x5634f8e61dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.120+0000 7f6b2ef0f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5634f8ddf8a0 0x5634f8e60080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51234/0 (socket says 172.21.15.19:51234) 2024-09-12T02:05:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.120+0000 7f6b2ef0f640 1 -- 172.21.15.19:0/638443984 learned_addr learned my addr 172.21.15.19:0/638443984 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.120+0000 7f6b2ff11640 1 --2- 172.21.15.19:0/638443984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b18002810 0x5634f8d978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.120+0000 7f6b2f710640 1 -- 172.21.15.19:0/638443984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b18002810 msgr2=0x5634f8d978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.120+0000 7f6b2f710640 1 --2- 172.21.15.19:0/638443984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b18002810 0x5634f8d978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.120+0000 7f6b2f710640 1 -- 172.21.15.19:0/638443984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5634f8ddf8a0 msgr2=0x5634f8e60080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.120+0000 7f6b2f710640 1 --2- 172.21.15.19:0/638443984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5634f8ddf8a0 0x5634f8e60080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.120+0000 7f6b2f710640 1 -- 172.21.15.19:0/638443984 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634f8e605c0 con 0x5634f8dc4e80 2024-09-12T02:05:24.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.120+0000 7f6b2ef0f640 1 --2- 172.21.15.19:0/638443984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5634f8ddf8a0 0x5634f8e60080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:05:24.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.120+0000 7f6b2f710640 1 --2- 172.21.15.19:0/638443984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634f8dc4e80 0x5634f8e61dd0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6b200017a0 tx=0x7f6b20001a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:24.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.121+0000 7f6b2cf0b640 1 -- 172.21.15.19:0/638443984 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2000f650 con 0x5634f8dc4e80 2024-09-12T02:05:24.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.121+0000 7f6b2cf0b640 1 -- 172.21.15.19:0/638443984 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b2000f810 con 0x5634f8dc4e80 2024-09-12T02:05:24.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.121+0000 7f6b31c1af40 1 -- 172.21.15.19:0/638443984 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634f8e70a20 con 0x5634f8dc4e80 2024-09-12T02:05:24.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.121+0000 7f6b2cf0b640 1 -- 172.21.15.19:0/638443984 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2000fc00 con 0x5634f8dc4e80 2024-09-12T02:05:24.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.121+0000 7f6b31c1af40 1 -- 172.21.15.19:0/638443984 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634f8e70ce0 con 0x5634f8dc4e80 2024-09-12T02:05:24.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.122+0000 7f6b2cf0b640 1 -- 172.21.15.19:0/638443984 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b20024070 con 0x5634f8dc4e80 2024-09-12T02:05:24.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.123+0000 7f6b2cf0b640 1 --2- 172.21.15.19:0/638443984 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b1c06a810 0x7f6b1c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.123+0000 7f6b2cf0b640 1 -- 172.21.15.19:0/638443984 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 8797+0+0 (secure 0 0 0) 0x7f6b2008ca60 con 0x5634f8dc4e80 2024-09-12T02:05:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.123+0000 7f6b2ef0f640 1 --2- 172.21.15.19:0/638443984 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b1c06a810 0x7f6b1c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.123+0000 7f6b31c1af40 1 --2- 172.21.15.19:0/638443984 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5634f8dc8930 0x5634f8f07200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.123+0000 7f6b31c1af40 1 -- 172.21.15.19:0/638443984 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 13.1f 13:fe07bba1:::100.00000000.inode:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x5634f8f07740 con 0x5634f8dc8930 2024-09-12T02:05:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.123+0000 7f6b2ff11640 1 --2- 172.21.15.19:0/638443984 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5634f8dc8930 0x5634f8f07200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.123+0000 7f6b2ef0f640 1 --2- 172.21.15.19:0/638443984 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b1c06a810 0x7f6b1c06ccd0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x5634f8de02e0 tx=0x7f6b24060040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.123+0000 7f6b2ff11640 1 --2- 172.21.15.19:0/638443984 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5634f8dc8930 0x5634f8f07200 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.125+0000 7f6b2ff11640 1 -- 172.21.15.19:0/638443984 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 100.00000000.inode [truncate 0] v124'375 uv375 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f6b2800a8c0 con 0x5634f8dc8930 2024-09-12T02:05:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.125+0000 7f6b31c1af40 1 -- 172.21.15.19:0/638443984 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5634f8dc8930 msgr2=0x5634f8f07200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.125+0000 7f6b31c1af40 1 --2- 172.21.15.19:0/638443984 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5634f8dc8930 0x5634f8f07200 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.125+0000 7f6b31c1af40 1 -- 172.21.15.19:0/638443984 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b1c06a810 msgr2=0x7f6b1c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.125+0000 7f6b31c1af40 1 --2- 172.21.15.19:0/638443984 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b1c06a810 0x7f6b1c06ccd0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x5634f8de02e0 tx=0x7f6b24060040 comp rx=0 tx=0).stop 2024-09-12T02:05:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.125+0000 7f6b31c1af40 1 -- 172.21.15.19:0/638443984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634f8dc4e80 msgr2=0x5634f8e61dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.125+0000 7f6b31c1af40 1 --2- 172.21.15.19:0/638443984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634f8dc4e80 0x5634f8e61dd0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6b200017a0 tx=0x7f6b20001a60 comp rx=0 tx=0).stop 2024-09-12T02:05:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.125+0000 7f6b2ff11640 1 -- 172.21.15.19:0/638443984 reap_dead start 2024-09-12T02:05:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.125+0000 7f6b31c1af40 1 -- 172.21.15.19:0/638443984 shutdown_connections 2024-09-12T02:05:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.125+0000 7f6b31c1af40 1 -- 172.21.15.19:0/638443984 >> 172.21.15.19:0/638443984 conn(0x5634f8d989e0 msgr2=0x5634f8e65f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.125+0000 7f6b31c1af40 1 -- 172.21.15.19:0/638443984 shutdown_connections 2024-09-12T02:05:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.125+0000 7f6b31c1af40 1 -- 172.21.15.19:0/638443984 wait complete. 2024-09-12T02:05:24.129 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:05:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.275+0000 7f535b2f8640 1 Processor -- start 2024-09-12T02:05:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.276+0000 7f535b2f8640 1 -- start start 2024-09-12T02:05:24.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.276+0000 7f535b2f8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5354162e30 0x7f535406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.276+0000 7f535b2f8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f53540cf280 0x7f53540d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.276+0000 7f535b2f8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f535415ff70 con 0x7f5354162340 2024-09-12T02:05:24.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.276+0000 7f535b2f8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f535406de90 con 0x7f53540cf280 2024-09-12T02:05:24.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.276+0000 7f535b2f8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f5354163270 con 0x7f5354162e30 2024-09-12T02:05:24.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.276+0000 7f5359895640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f53540cf280 0x7f53540d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.277+0000 7f5359895640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f53540cf280 0x7f53540d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51246/0 (socket says 172.21.15.19:51246) 2024-09-12T02:05:24.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.277+0000 7f5359895640 1 -- 172.21.15.19:0/2176922777 learned_addr learned my addr 172.21.15.19:0/2176922777 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:24.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.277+0000 7f5358893640 1 --2- 172.21.15.19:0/2176922777 >> v2:172.21.15.135:3300/0 conn(0x7f5354162e30 0x7f535406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.277+0000 7f5353fff640 1 -- 172.21.15.19:0/2176922777 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2721043972 0 0) 0x7f535415ff70 con 0x7f5354162340 2024-09-12T02:05:24.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.277+0000 7f5359895640 1 -- 172.21.15.19:0/2176922777 >> v2:172.21.15.135:3300/0 conn(0x7f5354162e30 msgr2=0x7f535406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:24.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.277+0000 7f5359895640 1 --2- 172.21.15.19:0/2176922777 >> v2:172.21.15.135:3300/0 conn(0x7f5354162e30 0x7f535406d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.277+0000 7f5359895640 1 -- 172.21.15.19:0/2176922777 >> v1:172.21.15.135:6789/0 conn(0x7f5354162340 legacy=0x7f5354162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.277+0000 7f5359895640 1 -- 172.21.15.19:0/2176922777 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53540d4d10 con 0x7f53540cf280 2024-09-12T02:05:24.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.278+0000 7f5359895640 1 --2- 172.21.15.19:0/2176922777 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53540cf280 0x7f53540d2990 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f53540a23d0 tx=0x7f534402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8718d0d8c00f8b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:24.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.278+0000 7f5353fff640 1 -- 172.21.15.19:0/2176922777 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344036070 con 0x7f53540cf280 2024-09-12T02:05:24.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.278+0000 7f5353fff640 1 -- 172.21.15.19:0/2176922777 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5344031600 con 0x7f53540cf280 2024-09-12T02:05:24.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.278+0000 7f5353fff640 1 -- 172.21.15.19:0/2176922777 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53440319d0 con 0x7f53540cf280 2024-09-12T02:05:24.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.278+0000 7f535b2f8640 1 -- 172.21.15.19:0/2176922777 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53540cf280 msgr2=0x7f53540d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.278+0000 7f535b2f8640 1 --2- 172.21.15.19:0/2176922777 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53540cf280 0x7f53540d2990 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f53540a23d0 tx=0x7f534402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.278+0000 7f535b2f8640 1 -- 172.21.15.19:0/2176922777 shutdown_connections 2024-09-12T02:05:24.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.278+0000 7f535b2f8640 1 --2- 172.21.15.19:0/2176922777 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53540cf280 0x7f53540d2990 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.278+0000 7f535b2f8640 1 --2- 172.21.15.19:0/2176922777 >> v2:172.21.15.135:3300/0 conn(0x7f5354162e30 0x7f535406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.278+0000 7f535b2f8640 1 -- 172.21.15.19:0/2176922777 >> 172.21.15.19:0/2176922777 conn(0x7f535408bfc0 msgr2=0x7f53540d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:24.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.278+0000 7f535b2f8640 1 -- 172.21.15.19:0/2176922777 shutdown_connections 2024-09-12T02:05:24.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.278+0000 7f535b2f8640 1 -- 172.21.15.19:0/2176922777 wait complete. 2024-09-12T02:05:24.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.280+0000 7f535b2f8640 1 Processor -- start 2024-09-12T02:05:24.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.280+0000 7f535b2f8640 1 -- start start 2024-09-12T02:05:24.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.280+0000 7f535b2f8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53540cf280 0x7f535415d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.280+0000 7f535b2f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5354162340 0x7f53540b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.280+0000 7f535b2f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5354162e30 0x7f535415f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.280+0000 7f535b2f8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f53540cf6f0 con 0x7f5354162e30 2024-09-12T02:05:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.280+0000 7f535b2f8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53540d2470 con 0x7f53540cf280 2024-09-12T02:05:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.280+0000 7f535b2f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f53540d52d0 con 0x7f5354162340 2024-09-12T02:05:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.280+0000 7f5359895640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5354162e30 0x7f535415f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.280+0000 7f5359895640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5354162e30 0x7f535415f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51258/0 (socket says 172.21.15.19:51258) 2024-09-12T02:05:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.280+0000 7f5359895640 1 -- 172.21.15.19:0/3715827379 learned_addr learned my addr 172.21.15.19:0/3715827379 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.281+0000 7f5359094640 1 --2- 172.21.15.19:0/3715827379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53540cf280 0x7f535415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.281+0000 7f5358893640 1 --2- 172.21.15.19:0/3715827379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5354162340 0x7f53540b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.281+0000 7f5359895640 1 -- 172.21.15.19:0/3715827379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5354162340 msgr2=0x7f53540b7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.281+0000 7f5359895640 1 --2- 172.21.15.19:0/3715827379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5354162340 0x7f53540b7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.281+0000 7f5359895640 1 -- 172.21.15.19:0/3715827379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53540cf280 msgr2=0x7f535415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.281+0000 7f5359895640 1 --2- 172.21.15.19:0/3715827379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53540cf280 0x7f535415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.281+0000 7f5359895640 1 -- 172.21.15.19:0/3715827379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535415f7a0 con 0x7f5354162e30 2024-09-12T02:05:24.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.281+0000 7f5359895640 1 --2- 172.21.15.19:0/3715827379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5354162e30 0x7f535415f260 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f5344034040 tx=0x7f5344004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:24.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.281+0000 7f5351ffb640 1 -- 172.21.15.19:0/3715827379 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344036050 con 0x7f5354162e30 2024-09-12T02:05:24.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.281+0000 7f5351ffb640 1 -- 172.21.15.19:0/3715827379 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5344042070 con 0x7f5354162e30 2024-09-12T02:05:24.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.281+0000 7f535b2f8640 1 -- 172.21.15.19:0/3715827379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f535415db40 con 0x7f5354162e30 2024-09-12T02:05:24.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.281+0000 7f5351ffb640 1 -- 172.21.15.19:0/3715827379 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344009510 con 0x7f5354162e30 2024-09-12T02:05:24.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.281+0000 7f535b2f8640 1 -- 172.21.15.19:0/3715827379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f535415e100 con 0x7f5354162e30 2024-09-12T02:05:24.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.282+0000 7f535b2f8640 1 -- 172.21.15.19:0/3715827379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f535406d740 con 0x7f5354162e30 2024-09-12T02:05:24.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.283+0000 7f5351ffb640 1 -- 172.21.15.19:0/3715827379 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5344007bf0 con 0x7f5354162e30 2024-09-12T02:05:24.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.283+0000 7f5351ffb640 1 --2- 172.21.15.19:0/3715827379 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f534006be30 0x7f534006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.284+0000 7f5351ffb640 1 -- 172.21.15.19:0/3715827379 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 8797+0+0 (secure 0 0 0) 0x7f53440ac770 con 0x7f5354162e30 2024-09-12T02:05:24.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.284+0000 7f5359094640 1 --2- 172.21.15.19:0/3715827379 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f534006be30 0x7f534006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.284+0000 7f5359094640 1 --2- 172.21.15.19:0/3715827379 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f534006be30 0x7f534006e2f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f534c000f60 tx=0x7f534c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:24.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.288+0000 7f5351ffb640 1 -- 172.21.15.19:0/3715827379 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5344079e10 con 0x7f5354162e30 2024-09-12T02:05:24.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.509+0000 7f535b2f8640 1 -- 172.21.15.19:0/3715827379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f535408e640 con 0x7f5354162e30 2024-09-12T02:05:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.855+0000 7f5351ffb640 1 -- 172.21.15.19:0/3715827379 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v254) ==== 162+0+0 (secure 0 0 0) 0x7f534407e110 con 0x7f5354162e30 2024-09-12T02:05:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:05:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.858+0000 7f535b2f8640 1 -- 172.21.15.19:0/3715827379 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f534006be30 msgr2=0x7f534006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.858+0000 7f535b2f8640 1 --2- 172.21.15.19:0/3715827379 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f534006be30 0x7f534006e2f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f534c000f60 tx=0x7f534c009040 comp rx=0 tx=0).stop 2024-09-12T02:05:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.858+0000 7f535b2f8640 1 -- 172.21.15.19:0/3715827379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5354162e30 msgr2=0x7f535415f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.858+0000 7f535b2f8640 1 --2- 172.21.15.19:0/3715827379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5354162e30 0x7f535415f260 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f5344034040 tx=0x7f5344004a40 comp rx=0 tx=0).stop 2024-09-12T02:05:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.858+0000 7f535b2f8640 1 -- 172.21.15.19:0/3715827379 shutdown_connections 2024-09-12T02:05:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.858+0000 7f535b2f8640 1 --2- 172.21.15.19:0/3715827379 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f534006be30 0x7f534006e2f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.858+0000 7f535b2f8640 1 --2- 172.21.15.19:0/3715827379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5354162e30 0x7f535415f260 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.858+0000 7f535b2f8640 1 --2- 172.21.15.19:0/3715827379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5354162340 0x7f53540b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.858+0000 7f535b2f8640 1 --2- 172.21.15.19:0/3715827379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53540cf280 0x7f535415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.858+0000 7f535b2f8640 1 -- 172.21.15.19:0/3715827379 >> 172.21.15.19:0/3715827379 conn(0x7f535408bfc0 msgr2=0x7f5354161a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.858+0000 7f535b2f8640 1 -- 172.21.15.19:0/3715827379 shutdown_connections 2024-09-12T02:05:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.858+0000 7f535b2f8640 1 -- 172.21.15.19:0/3715827379 wait complete. 2024-09-12T02:05:24.864 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:05:24.865+0000 7f608fe4c640 -1 mds.0.cache.ino(0x100) No data while reading inode 0x100 2024-09-12T02:05:24.865 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:05:24.865+0000 7f608fe4c640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2024-09-12T02:05:24.865 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:05:24.866+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:05:24.866 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:05:24.866+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:05:24.871 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:24.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.974+0000 7f3c3a2b7640 1 Processor -- start 2024-09-12T02:05:24.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.974+0000 7f3c3a2b7640 1 -- start start 2024-09-12T02:05:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.974+0000 7f3c3a2b7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3c34161c80 0x7f3c3406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.974+0000 7f3c3a2b7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3c340b6680 0x7f3c340cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.974+0000 7f3c3a2b7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c3406e870 con 0x7f3c34162060 2024-09-12T02:05:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.974+0000 7f3c3a2b7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f3c3406d9f0 con 0x7f3c340b6680 2024-09-12T02:05:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.974+0000 7f3c3a2b7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f3c3406dcd0 con 0x7f3c34161c80 2024-09-12T02:05:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.975+0000 7f3c38854640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3c340b6680 0x7f3c340cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.975+0000 7f3c38854640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3c340b6680 0x7f3c340cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51272/0 (socket says 172.21.15.19:51272) 2024-09-12T02:05:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.975+0000 7f3c38854640 1 -- 172.21.15.19:0/2922143110 learned_addr learned my addr 172.21.15.19:0/2922143110 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.975+0000 7f3c38854640 1 -- 172.21.15.19:0/2922143110 >> v2:172.21.15.135:3300/0 conn(0x7f3c34161c80 msgr2=0x7f3c3406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.975+0000 7f3c33fff640 1 --2- 172.21.15.19:0/2922143110 >> v2:172.21.15.135:3300/0 conn(0x7f3c34161c80 0x7f3c3406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.975+0000 7f3c38854640 1 --2- 172.21.15.19:0/2922143110 >> v2:172.21.15.135:3300/0 conn(0x7f3c34161c80 0x7f3c3406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.975+0000 7f3c38854640 1 -- 172.21.15.19:0/2922143110 >> v1:172.21.15.135:6789/0 conn(0x7f3c34162060 legacy=0x7f3c340b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.975+0000 7f3c38854640 1 -- 172.21.15.19:0/2922143110 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3406dfb0 con 0x7f3c340b6680 2024-09-12T02:05:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.975+0000 7f3c33fff640 1 --2- 172.21.15.19:0/2922143110 >> v2:172.21.15.135:3300/0 conn(0x7f3c34161c80 0x7f3c3406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.976+0000 7f3c38854640 1 --2- 172.21.15.19:0/2922143110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c340b6680 0x7f3c340cf1e0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f3c3408d7a0 tx=0x7f3c2c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833b1a7d2da5f149 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.976+0000 7f3c32ffd640 1 -- 172.21.15.19:0/2922143110 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c036070 con 0x7f3c340b6680 2024-09-12T02:05:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.976+0000 7f3c32ffd640 1 -- 172.21.15.19:0/2922143110 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c2c031600 con 0x7f3c340b6680 2024-09-12T02:05:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.976+0000 7f3c32ffd640 1 -- 172.21.15.19:0/2922143110 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0319d0 con 0x7f3c340b6680 2024-09-12T02:05:24.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.976+0000 7f3c3a2b7640 1 -- 172.21.15.19:0/2922143110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c340b6680 msgr2=0x7f3c340cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.976+0000 7f3c3a2b7640 1 --2- 172.21.15.19:0/2922143110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c340b6680 0x7f3c340cf1e0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f3c3408d7a0 tx=0x7f3c2c02a6f0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.976+0000 7f3c3a2b7640 1 -- 172.21.15.19:0/2922143110 shutdown_connections 2024-09-12T02:05:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.976+0000 7f3c3a2b7640 1 --2- 172.21.15.19:0/2922143110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c340b6680 0x7f3c340cf1e0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.976+0000 7f3c3a2b7640 1 --2- 172.21.15.19:0/2922143110 >> v2:172.21.15.135:3300/0 conn(0x7f3c34161c80 0x7f3c3406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.976+0000 7f3c3a2b7640 1 -- 172.21.15.19:0/2922143110 >> 172.21.15.19:0/2922143110 conn(0x7f3c340d44f0 msgr2=0x7f3c340d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.977+0000 7f3c3a2b7640 1 -- 172.21.15.19:0/2922143110 shutdown_connections 2024-09-12T02:05:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.977+0000 7f3c3a2b7640 1 -- 172.21.15.19:0/2922143110 wait complete. 2024-09-12T02:05:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.978+0000 7f3c3a2b7640 1 Processor -- start 2024-09-12T02:05:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.978+0000 7f3c3a2b7640 1 -- start start 2024-09-12T02:05:24.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c3a2b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c340b6680 0x7f3c340cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c3a2b7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c34161c80 0x7f3c340b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c3a2b7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c34162060 0x7f3c340b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c3a2b7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3c340b6b30 con 0x7f3c340b6680 2024-09-12T02:05:24.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c3a2b7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3c340d2aa0 con 0x7f3c34161c80 2024-09-12T02:05:24.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c3a2b7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3c340b6cb0 con 0x7f3c34162060 2024-09-12T02:05:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c33fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c340b6680 0x7f3c340cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c33fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c340b6680 0x7f3c340cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51288/0 (socket says 172.21.15.19:51288) 2024-09-12T02:05:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c33fff640 1 -- 172.21.15.19:0/1187712893 learned_addr learned my addr 172.21.15.19:0/1187712893 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c38854640 1 --2- 172.21.15.19:0/1187712893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c34162060 0x7f3c340b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c337fe640 1 --2- 172.21.15.19:0/1187712893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c34161c80 0x7f3c340b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c33fff640 1 -- 172.21.15.19:0/1187712893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c34162060 msgr2=0x7f3c340b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c33fff640 1 --2- 172.21.15.19:0/1187712893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c34162060 0x7f3c340b2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c33fff640 1 -- 172.21.15.19:0/1187712893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c34161c80 msgr2=0x7f3c340b8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c33fff640 1 --2- 172.21.15.19:0/1187712893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c34161c80 0x7f3c340b8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c33fff640 1 -- 172.21.15.19:0/1187712893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c340b9090 con 0x7f3c340b6680 2024-09-12T02:05:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c33fff640 1 --2- 172.21.15.19:0/1187712893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c340b6680 0x7f3c340cb5c0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400c7f0 tx=0x7f3c2400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c30ff9640 1 -- 172.21.15.19:0/1187712893 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c24015070 con 0x7f3c340b6680 2024-09-12T02:05:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.979+0000 7f3c30ff9640 1 -- 172.21.15.19:0/1187712893 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c24007a30 con 0x7f3c340b6680 2024-09-12T02:05:24.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.980+0000 7f3c3a2b7640 1 -- 172.21.15.19:0/1187712893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c340b9370 con 0x7f3c340b6680 2024-09-12T02:05:24.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.980+0000 7f3c30ff9640 1 -- 172.21.15.19:0/1187712893 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c24007e00 con 0x7f3c340b6680 2024-09-12T02:05:24.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.980+0000 7f3c3a2b7640 1 -- 172.21.15.19:0/1187712893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c340b9930 con 0x7f3c340b6680 2024-09-12T02:05:24.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.981+0000 7f3c3a2b7640 1 -- 172.21.15.19:0/1187712893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c3406e330 con 0x7f3c340b6680 2024-09-12T02:05:24.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.981+0000 7f3c30ff9640 1 -- 172.21.15.19:0/1187712893 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c24018070 con 0x7f3c340b6680 2024-09-12T02:05:24.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.981+0000 7f3c30ff9640 1 --2- 172.21.15.19:0/1187712893 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3c2006be30 0x7f3c2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:24.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.982+0000 7f3c30ff9640 1 -- 172.21.15.19:0/1187712893 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7f3c2408bab0 con 0x7f3c340b6680 2024-09-12T02:05:24.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.982+0000 7f3c337fe640 1 --2- 172.21.15.19:0/1187712893 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3c2006be30 0x7f3c2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:24.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.982+0000 7f3c337fe640 1 --2- 172.21.15.19:0/1187712893 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3c2006be30 0x7f3c2006e2f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f3c340cbb00 tx=0x7f3c28007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:24.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:24.986+0000 7f3c30ff9640 1 -- 172.21.15.19:0/1187712893 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3c24059100 con 0x7f3c340b6680 2024-09-12T02:05:25.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.198+0000 7f3c3a2b7640 1 -- 172.21.15.19:0/1187712893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c340ba470 con 0x7f3c340b6680 2024-09-12T02:05:25.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.199+0000 7f3c30ff9640 1 -- 172.21.15.19:0/1187712893 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 256 v256) ==== 95+0+3563 (secure 0 0 0) 0x7f3c2405d400 con 0x7f3c340b6680 2024-09-12T02:05:25.199 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:25.199 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":256,"btime":"2024-09-12T02:05:24:867057+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":256,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:24.867005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:25.199 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 256 2024-09-12T02:05:25.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.201+0000 7f3c3a2b7640 1 -- 172.21.15.19:0/1187712893 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3c2006be30 msgr2=0x7f3c2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:25.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.201+0000 7f3c3a2b7640 1 --2- 172.21.15.19:0/1187712893 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3c2006be30 0x7f3c2006e2f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f3c340cbb00 tx=0x7f3c28007e30 comp rx=0 tx=0).stop 2024-09-12T02:05:25.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.201+0000 7f3c3a2b7640 1 -- 172.21.15.19:0/1187712893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c340b6680 msgr2=0x7f3c340cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:25.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.201+0000 7f3c3a2b7640 1 --2- 172.21.15.19:0/1187712893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c340b6680 0x7f3c340cb5c0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400c7f0 tx=0x7f3c2400cbf0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.201+0000 7f3c3a2b7640 1 -- 172.21.15.19:0/1187712893 shutdown_connections 2024-09-12T02:05:25.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.201+0000 7f3c3a2b7640 1 --2- 172.21.15.19:0/1187712893 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3c2006be30 0x7f3c2006e2f0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.201+0000 7f3c3a2b7640 1 --2- 172.21.15.19:0/1187712893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c34162060 0x7f3c340b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.201+0000 7f3c3a2b7640 1 --2- 172.21.15.19:0/1187712893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c34161c80 0x7f3c340b8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.201+0000 7f3c3a2b7640 1 --2- 172.21.15.19:0/1187712893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c340b6680 0x7f3c340cb5c0 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.201+0000 7f3c3a2b7640 1 -- 172.21.15.19:0/1187712893 >> 172.21.15.19:0/1187712893 conn(0x7f3c340d44f0 msgr2=0x7f3c340b5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:25.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.201+0000 7f3c3a2b7640 1 -- 172.21.15.19:0/1187712893 shutdown_connections 2024-09-12T02:05:25.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.201+0000 7f3c3a2b7640 1 -- 172.21.15.19:0/1187712893 wait complete. 2024-09-12T02:05:25.212 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:05:25.212 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:25.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.316+0000 7f8c34f4b640 1 Processor -- start 2024-09-12T02:05:25.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.316+0000 7f8c34f4b640 1 -- start start 2024-09-12T02:05:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.317+0000 7f8c34f4b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8c300afd60 0x7f8c300726b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.317+0000 7f8c34f4b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c300b3e60 0x7f8c3006f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.317+0000 7f8c34f4b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c300b44c0 con 0x7f8c30072bf0 2024-09-12T02:05:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.317+0000 7f8c34f4b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8c300b4290 con 0x7f8c300b3e60 2024-09-12T02:05:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.317+0000 7f8c34f4b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f8c300b0140 con 0x7f8c300afd60 2024-09-12T02:05:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.317+0000 7f8c2ed9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c300b3e60 0x7f8c3006f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.317+0000 7f8c2ed9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c300b3e60 0x7f8c3006f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51292/0 (socket says 172.21.15.19:51292) 2024-09-12T02:05:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.317+0000 7f8c2ed9d640 1 -- 172.21.15.19:0/1889199578 learned_addr learned my addr 172.21.15.19:0/1889199578 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.317+0000 7f8c2e59c640 1 --2- 172.21.15.19:0/1889199578 >> v2:172.21.15.135:3300/0 conn(0x7f8c300afd60 0x7f8c300726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.317+0000 7f8c2ed9d640 1 -- 172.21.15.19:0/1889199578 >> v2:172.21.15.135:3300/0 conn(0x7f8c300afd60 msgr2=0x7f8c300726b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:25.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.317+0000 7f8c2ed9d640 1 --2- 172.21.15.19:0/1889199578 >> v2:172.21.15.135:3300/0 conn(0x7f8c300afd60 0x7f8c300726b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.317+0000 7f8c2ed9d640 1 -- 172.21.15.19:0/1889199578 >> v1:172.21.15.135:6789/0 conn(0x7f8c30072bf0 legacy=0x7f8c300b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:25.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.317+0000 7f8c2ed9d640 1 -- 172.21.15.19:0/1889199578 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c3015ead0 con 0x7f8c300b3e60 2024-09-12T02:05:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.318+0000 7f8c2ed9d640 1 --2- 172.21.15.19:0/1889199578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c300b3e60 0x7f8c3006f5a0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f8c30071ca0 tx=0x7f8c2802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a5328f6ca1675a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.318+0000 7f8c2d59a640 1 -- 172.21.15.19:0/1889199578 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c28036070 con 0x7f8c300b3e60 2024-09-12T02:05:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.318+0000 7f8c2d59a640 1 -- 172.21.15.19:0/1889199578 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c28031600 con 0x7f8c300b3e60 2024-09-12T02:05:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.318+0000 7f8c2d59a640 1 -- 172.21.15.19:0/1889199578 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c280319d0 con 0x7f8c300b3e60 2024-09-12T02:05:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.319+0000 7f8c34f4b640 1 -- 172.21.15.19:0/1889199578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c300b3e60 msgr2=0x7f8c3006f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.319+0000 7f8c34f4b640 1 --2- 172.21.15.19:0/1889199578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c300b3e60 0x7f8c3006f5a0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f8c30071ca0 tx=0x7f8c2802a730 comp rx=0 tx=0).stop 2024-09-12T02:05:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.319+0000 7f8c34f4b640 1 -- 172.21.15.19:0/1889199578 shutdown_connections 2024-09-12T02:05:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.319+0000 7f8c34f4b640 1 --2- 172.21.15.19:0/1889199578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c300b3e60 0x7f8c3006f5a0 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.319+0000 7f8c34f4b640 1 --2- 172.21.15.19:0/1889199578 >> v2:172.21.15.135:3300/0 conn(0x7f8c300afd60 0x7f8c300726b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.319+0000 7f8c34f4b640 1 -- 172.21.15.19:0/1889199578 >> 172.21.15.19:0/1889199578 conn(0x7f8c3006c030 msgr2=0x7f8c3006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:25.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.319+0000 7f8c34f4b640 1 -- 172.21.15.19:0/1889199578 shutdown_connections 2024-09-12T02:05:25.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.319+0000 7f8c34f4b640 1 -- 172.21.15.19:0/1889199578 wait complete. 2024-09-12T02:05:25.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.320+0000 7f8c34f4b640 1 Processor -- start 2024-09-12T02:05:25.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.320+0000 7f8c34f4b640 1 -- start start 2024-09-12T02:05:25.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.321+0000 7f8c34f4b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c30072bf0 0x7f8c30141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:25.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.321+0000 7f8c34f4b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c300afd60 0x7f8c30157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:25.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.321+0000 7f8c34f4b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c300b3e60 0x7f8c30159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:25.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.321+0000 7f8c34f4b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3015f090 con 0x7f8c300afd60 2024-09-12T02:05:25.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.321+0000 7f8c34f4b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8c30073030 con 0x7f8c30072bf0 2024-09-12T02:05:25.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.321+0000 7f8c34f4b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8c3015f370 con 0x7f8c300b3e60 2024-09-12T02:05:25.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.321+0000 7f8c2dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c300afd60 0x7f8c30157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:25.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.321+0000 7f8c2dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c300afd60 0x7f8c30157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51296/0 (socket says 172.21.15.19:51296) 2024-09-12T02:05:25.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.321+0000 7f8c2dd9b640 1 -- 172.21.15.19:0/777228540 learned_addr learned my addr 172.21.15.19:0/777228540 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:25.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.321+0000 7f8c2e59c640 1 --2- 172.21.15.19:0/777228540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c30072bf0 0x7f8c30141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:25.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.321+0000 7f8c2ed9d640 1 --2- 172.21.15.19:0/777228540 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c300b3e60 0x7f8c30159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:25.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.321+0000 7f8c2dd9b640 1 -- 172.21.15.19:0/777228540 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c300b3e60 msgr2=0x7f8c30159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:25.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.321+0000 7f8c2dd9b640 1 --2- 172.21.15.19:0/777228540 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c300b3e60 0x7f8c30159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.321+0000 7f8c2dd9b640 1 -- 172.21.15.19:0/777228540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c30072bf0 msgr2=0x7f8c30141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:25.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.321+0000 7f8c2dd9b640 1 --2- 172.21.15.19:0/777228540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c30072bf0 0x7f8c30141d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.321+0000 7f8c2dd9b640 1 -- 172.21.15.19:0/777228540 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c301422d0 con 0x7f8c300afd60 2024-09-12T02:05:25.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.322+0000 7f8c2dd9b640 1 --2- 172.21.15.19:0/777228540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c300afd60 0x7f8c30157540 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400c430 tx=0x7f8c2400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:25.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.322+0000 7f8c1effd640 1 -- 172.21.15.19:0/777228540 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c240052d0 con 0x7f8c300afd60 2024-09-12T02:05:25.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.322+0000 7f8c1effd640 1 -- 172.21.15.19:0/777228540 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c24005490 con 0x7f8c300afd60 2024-09-12T02:05:25.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.322+0000 7f8c34f4b640 1 -- 172.21.15.19:0/777228540 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c30157e40 con 0x7f8c300afd60 2024-09-12T02:05:25.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.322+0000 7f8c1effd640 1 -- 172.21.15.19:0/777228540 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c24007260 con 0x7f8c300afd60 2024-09-12T02:05:25.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.322+0000 7f8c34f4b640 1 -- 172.21.15.19:0/777228540 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c30158400 con 0x7f8c300afd60 2024-09-12T02:05:25.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.323+0000 7f8c34f4b640 1 -- 172.21.15.19:0/777228540 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c3015f890 con 0x7f8c300afd60 2024-09-12T02:05:25.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.323+0000 7f8c1effd640 1 -- 172.21.15.19:0/777228540 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c24007400 con 0x7f8c300afd60 2024-09-12T02:05:25.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.324+0000 7f8c1effd640 1 --2- 172.21.15.19:0/777228540 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c1006be30 0x7f8c1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:25.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.324+0000 7f8c1effd640 1 -- 172.21.15.19:0/777228540 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7f8c2408b040 con 0x7f8c300afd60 2024-09-12T02:05:25.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.324+0000 7f8c2e59c640 1 --2- 172.21.15.19:0/777228540 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c1006be30 0x7f8c1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:25.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.325+0000 7f8c2e59c640 1 --2- 172.21.15.19:0/777228540 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c1006be30 0x7f8c1006e2f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8c20006fd0 tx=0x7f8c20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:25.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.328+0000 7f8c1effd640 1 -- 172.21.15.19:0/777228540 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8c24058650 con 0x7f8c300afd60 2024-09-12T02:05:25.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.542+0000 7f8c34f4b640 1 -- 172.21.15.19:0/777228540 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c300703d0 con 0x7f8c300afd60 2024-09-12T02:05:25.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.542+0000 7f8c1effd640 1 -- 172.21.15.19:0/777228540 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 256 v256) ==== 95+0+3563 (secure 0 0 0) 0x7f8c2405c950 con 0x7f8c300afd60 2024-09-12T02:05:25.542 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:25.542 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":256,"btime":"2024-09-12T02:05:24:867057+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":256,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:24.867005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:25.542 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 256 2024-09-12T02:05:25.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.544+0000 7f8c34f4b640 1 -- 172.21.15.19:0/777228540 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c1006be30 msgr2=0x7f8c1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:25.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.544+0000 7f8c34f4b640 1 --2- 172.21.15.19:0/777228540 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c1006be30 0x7f8c1006e2f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8c20006fd0 tx=0x7f8c20008040 comp rx=0 tx=0).stop 2024-09-12T02:05:25.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.544+0000 7f8c34f4b640 1 -- 172.21.15.19:0/777228540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c300afd60 msgr2=0x7f8c30157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:25.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.544+0000 7f8c34f4b640 1 --2- 172.21.15.19:0/777228540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c300afd60 0x7f8c30157540 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400c430 tx=0x7f8c2400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.544+0000 7f8c34f4b640 1 -- 172.21.15.19:0/777228540 shutdown_connections 2024-09-12T02:05:25.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.544+0000 7f8c34f4b640 1 --2- 172.21.15.19:0/777228540 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8c1006be30 0x7f8c1006e2f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.544+0000 7f8c34f4b640 1 --2- 172.21.15.19:0/777228540 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c300b3e60 0x7f8c30159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.544+0000 7f8c34f4b640 1 --2- 172.21.15.19:0/777228540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c300afd60 0x7f8c30157540 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.544+0000 7f8c34f4b640 1 --2- 172.21.15.19:0/777228540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c30072bf0 0x7f8c30141d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.544+0000 7f8c34f4b640 1 -- 172.21.15.19:0/777228540 >> 172.21.15.19:0/777228540 conn(0x7f8c3006c030 msgr2=0x7f8c300b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:25.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.544+0000 7f8c34f4b640 1 -- 172.21.15.19:0/777228540 shutdown_connections 2024-09-12T02:05:25.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.544+0000 7f8c34f4b640 1 -- 172.21.15.19:0/777228540 wait complete. 2024-09-12T02:05:25.555 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:05:25.555 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:25.587 INFO:tasks.ceph.mds.c.smithi019.stderr: -50> 2024-09-12T02:05:20.836+0000 7f99b24e3640 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -22 ((22) Invalid argument) 2024-09-12T02:05:25.612 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:05:25.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.660+0000 7f11cf0e4640 1 Processor -- start 2024-09-12T02:05:25.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.660+0000 7f11cf0e4640 1 -- start start 2024-09-12T02:05:25.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.661+0000 7f11cf0e4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f11c815b300 0x7f11c80cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:25.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.661+0000 7f11cf0e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11c80cd3f0 0x7f11c806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:25.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.661+0000 7f11cf0e4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f11c8072d30 0x7f11c806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:25.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.661+0000 7f11cf0e4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f11c80728a0 con 0x7f11c815b300 2024-09-12T02:05:25.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.661+0000 7f11cf0e4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f11c80cdbe0 con 0x7f11c8072d30 2024-09-12T02:05:25.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.661+0000 7f11cf0e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f11c80cd900 con 0x7f11c80cd3f0 2024-09-12T02:05:25.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.661+0000 7f11cce80640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f11c815b300 0x7f11c80cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:25.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.661+0000 7f11cce80640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f11c815b300 0x7f11c80cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51342/0 (socket says 172.21.15.19:51342) 2024-09-12T02:05:25.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.661+0000 7f11cce80640 1 -- 172.21.15.19:0/2618168122 learned_addr learned my addr 172.21.15.19:0/2618168122 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:25.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.661+0000 7f11cd681640 1 --2- 172.21.15.19:0/2618168122 >> v2:172.21.15.135:3300/0 conn(0x7f11c8072d30 0x7f11c806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:25.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.661+0000 7f11c7fff640 1 --2- 172.21.15.19:0/2618168122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11c80cd3f0 0x7f11c806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:25.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.661+0000 7f11cce80640 1 -- 172.21.15.19:0/2618168122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11c80cd3f0 msgr2=0x7f11c806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:25.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.661+0000 7f11cce80640 1 --2- 172.21.15.19:0/2618168122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11c80cd3f0 0x7f11c806f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.661+0000 7f11cce80640 1 -- 172.21.15.19:0/2618168122 >> v2:172.21.15.135:3300/0 conn(0x7f11c8072d30 msgr2=0x7f11c806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:25.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.661+0000 7f11cce80640 1 --2- 172.21.15.19:0/2618168122 >> v2:172.21.15.135:3300/0 conn(0x7f11c8072d30 0x7f11c806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.661+0000 7f11cce80640 1 -- 172.21.15.19:0/2618168122 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c8072250 con 0x7f11c815b300 2024-09-12T02:05:25.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.662+0000 7f11cce80640 1 --2- 172.21.15.19:0/2618168122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11c815b300 0x7f11c80cceb0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f11c8072040 tx=0x7f11bc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4a14f1b6246039 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:25.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.662+0000 7f11c77fe640 1 -- 172.21.15.19:0/2618168122 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc037070 con 0x7f11c815b300 2024-09-12T02:05:25.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.662+0000 7f11c77fe640 1 -- 172.21.15.19:0/2618168122 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11bc032440 con 0x7f11c815b300 2024-09-12T02:05:25.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.662+0000 7f11c77fe640 1 -- 172.21.15.19:0/2618168122 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc032810 con 0x7f11c815b300 2024-09-12T02:05:25.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.663+0000 7f11cf0e4640 1 -- 172.21.15.19:0/2618168122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11c815b300 msgr2=0x7f11c80cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:25.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.663+0000 7f11cf0e4640 1 --2- 172.21.15.19:0/2618168122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11c815b300 0x7f11c80cceb0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f11c8072040 tx=0x7f11bc02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.663+0000 7f11cf0e4640 1 -- 172.21.15.19:0/2618168122 shutdown_connections 2024-09-12T02:05:25.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.663+0000 7f11cf0e4640 1 --2- 172.21.15.19:0/2618168122 >> v2:172.21.15.135:3300/0 conn(0x7f11c8072d30 0x7f11c806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.663+0000 7f11cf0e4640 1 --2- 172.21.15.19:0/2618168122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11c80cd3f0 0x7f11c806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.663+0000 7f11cf0e4640 1 --2- 172.21.15.19:0/2618168122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11c815b300 0x7f11c80cceb0 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.663+0000 7f11cf0e4640 1 -- 172.21.15.19:0/2618168122 >> 172.21.15.19:0/2618168122 conn(0x7f11c8067d70 msgr2=0x7f11c806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:25.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.663+0000 7f11cf0e4640 1 -- 172.21.15.19:0/2618168122 shutdown_connections 2024-09-12T02:05:25.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.663+0000 7f11cf0e4640 1 -- 172.21.15.19:0/2618168122 wait complete. 2024-09-12T02:05:25.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.664+0000 7f11cf0e4640 1 Processor -- start 2024-09-12T02:05:25.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.664+0000 7f11cf0e4640 1 -- start start 2024-09-12T02:05:25.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.665+0000 7f11cf0e4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11c8072d30 0x7f11c81560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.665+0000 7f11cf0e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11c80cd3f0 0x7f11c80b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.665+0000 7f11cf0e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11c815b300 0x7f11c8154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.665+0000 7f11cf0e4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f11c80d0160 con 0x7f11c80cd3f0 2024-09-12T02:05:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.665+0000 7f11cf0e4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f11c80cffe0 con 0x7f11c8072d30 2024-09-12T02:05:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.665+0000 7f11cf0e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f11c80b3c40 con 0x7f11c815b300 2024-09-12T02:05:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.665+0000 7f11c7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11c80cd3f0 0x7f11c80b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.665+0000 7f11c7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11c80cd3f0 0x7f11c80b29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51358/0 (socket says 172.21.15.19:51358) 2024-09-12T02:05:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.665+0000 7f11c7fff640 1 -- 172.21.15.19:0/2400369390 learned_addr learned my addr 172.21.15.19:0/2400369390 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.665+0000 7f11cce80640 1 --2- 172.21.15.19:0/2400369390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11c8072d30 0x7f11c81560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.665+0000 7f11cd681640 1 --2- 172.21.15.19:0/2400369390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11c815b300 0x7f11c8154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.665+0000 7f11c7fff640 1 -- 172.21.15.19:0/2400369390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11c815b300 msgr2=0x7f11c8154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.665+0000 7f11c7fff640 1 --2- 172.21.15.19:0/2400369390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11c815b300 0x7f11c8154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.665+0000 7f11c7fff640 1 -- 172.21.15.19:0/2400369390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11c8072d30 msgr2=0x7f11c81560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.665+0000 7f11c7fff640 1 --2- 172.21.15.19:0/2400369390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11c8072d30 0x7f11c81560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.665+0000 7f11c7fff640 1 -- 172.21.15.19:0/2400369390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c8156690 con 0x7f11c80cd3f0 2024-09-12T02:05:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.666+0000 7f11c7fff640 1 --2- 172.21.15.19:0/2400369390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11c80cd3f0 0x7f11c80b29c0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f11b400e980 tx=0x7f11b400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.666+0000 7f11c57fa640 1 -- 172.21.15.19:0/2400369390 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b4017070 con 0x7f11c80cd3f0 2024-09-12T02:05:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.666+0000 7f11c57fa640 1 -- 172.21.15.19:0/2400369390 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b400ca00 con 0x7f11c80cd3f0 2024-09-12T02:05:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.666+0000 7f11c57fa640 1 -- 172.21.15.19:0/2400369390 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b400cdd0 con 0x7f11c80cd3f0 2024-09-12T02:05:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.666+0000 7f11cf0e4640 1 -- 172.21.15.19:0/2400369390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c8156970 con 0x7f11c80cd3f0 2024-09-12T02:05:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.666+0000 7f11cf0e4640 1 -- 172.21.15.19:0/2400369390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c8156f30 con 0x7f11c80cd3f0 2024-09-12T02:05:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.667+0000 7f11cf0e4640 1 -- 172.21.15.19:0/2400369390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c815a730 con 0x7f11c80cd3f0 2024-09-12T02:05:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.667+0000 7f11c57fa640 1 -- 172.21.15.19:0/2400369390 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11b401a070 con 0x7f11c80cd3f0 2024-09-12T02:05:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.668+0000 7f11c57fa640 1 --2- 172.21.15.19:0/2400369390 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f11ac06be30 0x7f11ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.668+0000 7f11c57fa640 1 -- 172.21.15.19:0/2400369390 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7f11b408be70 con 0x7f11c80cd3f0 2024-09-12T02:05:25.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.668+0000 7f11cce80640 1 --2- 172.21.15.19:0/2400369390 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f11ac06be30 0x7f11ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:25.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.668+0000 7f11cce80640 1 --2- 172.21.15.19:0/2400369390 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f11ac06be30 0x7f11ac06e2f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f11bc034000 tx=0x7f11bc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:25.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.672+0000 7f11c57fa640 1 -- 172.21.15.19:0/2400369390 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f11b4059480 con 0x7f11c80cd3f0 2024-09-12T02:05:25.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.887+0000 7f11cf0e4640 1 -- 172.21.15.19:0/2400369390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11c815c120 con 0x7f11c80cd3f0 2024-09-12T02:05:25.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.887+0000 7f11c57fa640 1 -- 172.21.15.19:0/2400369390 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 257 v257) ==== 95+0+4389 (secure 0 0 0) 0x7f11b405d780 con 0x7f11c80cd3f0 2024-09-12T02:05:25.888 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:25.888 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":257,"btime":"2024-09-12T02:05:25:868303+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":9711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3818656517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3818656517},{"type":"v1","addr":"172.21.15.19:6834","nonce":3818656517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":257}],"filesystems":[{"mdsmap":{"epoch":256,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:24.867005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:25.890 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 257 2024-09-12T02:05:25.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.889+0000 7f11cf0e4640 1 -- 172.21.15.19:0/2400369390 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f11ac06be30 msgr2=0x7f11ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:25.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.889+0000 7f11cf0e4640 1 --2- 172.21.15.19:0/2400369390 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f11ac06be30 0x7f11ac06e2f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f11bc034000 tx=0x7f11bc02e000 comp rx=0 tx=0).stop 2024-09-12T02:05:25.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.889+0000 7f11cf0e4640 1 -- 172.21.15.19:0/2400369390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11c80cd3f0 msgr2=0x7f11c80b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:25.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.889+0000 7f11cf0e4640 1 --2- 172.21.15.19:0/2400369390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11c80cd3f0 0x7f11c80b29c0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f11b400e980 tx=0x7f11b400ee40 comp rx=0 tx=0).stop 2024-09-12T02:05:25.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.890+0000 7f11cf0e4640 1 -- 172.21.15.19:0/2400369390 shutdown_connections 2024-09-12T02:05:25.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.890+0000 7f11cf0e4640 1 --2- 172.21.15.19:0/2400369390 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f11ac06be30 0x7f11ac06e2f0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.890+0000 7f11cf0e4640 1 --2- 172.21.15.19:0/2400369390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11c815b300 0x7f11c8154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.890+0000 7f11cf0e4640 1 --2- 172.21.15.19:0/2400369390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11c80cd3f0 0x7f11c80b29c0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.890+0000 7f11cf0e4640 1 --2- 172.21.15.19:0/2400369390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11c8072d30 0x7f11c81560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.890+0000 7f11cf0e4640 1 -- 172.21.15.19:0/2400369390 >> 172.21.15.19:0/2400369390 conn(0x7f11c8067d70 msgr2=0x7f11c815a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:25.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.890+0000 7f11cf0e4640 1 -- 172.21.15.19:0/2400369390 shutdown_connections 2024-09-12T02:05:25.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:25.890+0000 7f11cf0e4640 1 -- 172.21.15.19:0/2400369390 wait complete. 2024-09-12T02:05:25.901 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate 100.00000000.inode' led to DAMAGED state 2024-09-12T02:05:25.901 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap key 10000000000.00000000:sixmegs_head' 2024-09-12T02:05:25.901 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:05:25.902 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:05:25.960 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:05:25.960 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:05:25.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:25.961 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:05:25.985 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:05:26.007 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:05:26.019 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:05:26.020 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:05:26.020 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:05:26.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.164+0000 7f2a181bd640 1 Processor -- start 2024-09-12T02:05:26.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.164+0000 7f2a181bd640 1 -- start start 2024-09-12T02:05:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.165+0000 7f2a181bd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2a1015e5f0 0x7f2a100d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.165+0000 7f2a181bd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a100d30f0 0x7f2a100b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.165+0000 7f2a181bd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a100d3690 con 0x7f2a100b64c0 2024-09-12T02:05:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.165+0000 7f2a181bd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2a1006d530 con 0x7f2a1015e5f0 2024-09-12T02:05:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.165+0000 7f2a181bd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2a100d3970 con 0x7f2a100d30f0 2024-09-12T02:05:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.165+0000 7f2a15f59640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2a1015e5f0 0x7f2a100d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.165+0000 7f2a15f59640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2a1015e5f0 0x7f2a100d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51370/0 (socket says 172.21.15.19:51370) 2024-09-12T02:05:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.165+0000 7f2a15f59640 1 -- 172.21.15.19:0/4276151697 learned_addr learned my addr 172.21.15.19:0/4276151697 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:26.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.165+0000 7f2a15f59640 1 -- 172.21.15.19:0/4276151697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a100d30f0 msgr2=0x7f2a100b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:26.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.166+0000 7f2a15758640 1 --2- 172.21.15.19:0/4276151697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a100d30f0 0x7f2a100b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:26.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.166+0000 7f2a15f59640 1 --2- 172.21.15.19:0/4276151697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a100d30f0 0x7f2a100b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:26.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.166+0000 7f2a15f59640 1 -- 172.21.15.19:0/4276151697 >> v1:172.21.15.135:6789/0 conn(0x7f2a100b64c0 legacy=0x7f2a100cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:26.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.166+0000 7f2a15f59640 1 -- 172.21.15.19:0/4276151697 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1006cee0 con 0x7f2a1015e5f0 2024-09-12T02:05:26.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.166+0000 7f2a15758640 1 --2- 172.21.15.19:0/4276151697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a100d30f0 0x7f2a100b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:26.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.166+0000 7f2a15f59640 1 --2- 172.21.15.19:0/4276151697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a1015e5f0 0x7f2a100d4dd0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009e50 tx=0x7f2a0002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202fe3f1cf7d1c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:26.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.166+0000 7f2a14f57640 1 -- 172.21.15.19:0/4276151697 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00036070 con 0x7f2a1015e5f0 2024-09-12T02:05:26.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.166+0000 7f2a14f57640 1 -- 172.21.15.19:0/4276151697 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a00031600 con 0x7f2a1015e5f0 2024-09-12T02:05:26.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.166+0000 7f2a14f57640 1 -- 172.21.15.19:0/4276151697 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a000319d0 con 0x7f2a1015e5f0 2024-09-12T02:05:26.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.167+0000 7f2a181bd640 1 -- 172.21.15.19:0/4276151697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a1015e5f0 msgr2=0x7f2a100d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:26.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.167+0000 7f2a181bd640 1 --2- 172.21.15.19:0/4276151697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a1015e5f0 0x7f2a100d4dd0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009e50 tx=0x7f2a0002a6c0 comp rx=0 tx=0).stop 2024-09-12T02:05:26.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.167+0000 7f2a181bd640 1 -- 172.21.15.19:0/4276151697 shutdown_connections 2024-09-12T02:05:26.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.167+0000 7f2a181bd640 1 --2- 172.21.15.19:0/4276151697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a100d30f0 0x7f2a100b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:26.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.167+0000 7f2a181bd640 1 --2- 172.21.15.19:0/4276151697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a1015e5f0 0x7f2a100d4dd0 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:26.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.167+0000 7f2a181bd640 1 -- 172.21.15.19:0/4276151697 >> 172.21.15.19:0/4276151697 conn(0x7f2a1008bfc0 msgr2=0x7f2a100d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:26.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.167+0000 7f2a181bd640 1 -- 172.21.15.19:0/4276151697 shutdown_connections 2024-09-12T02:05:26.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.167+0000 7f2a181bd640 1 -- 172.21.15.19:0/4276151697 wait complete. 2024-09-12T02:05:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.168+0000 7f2a181bd640 1 Processor -- start 2024-09-12T02:05:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.168+0000 7f2a181bd640 1 -- start start 2024-09-12T02:05:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.169+0000 7f2a181bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a100b64c0 0x7f2a100cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.169+0000 7f2a181bd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a100d30f0 0x7f2a101f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.169+0000 7f2a181bd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a1015e5f0 0x7f2a10148440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.169+0000 7f2a181bd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2a100d5310 con 0x7f2a100b64c0 2024-09-12T02:05:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.169+0000 7f2a181bd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1015e9d0 con 0x7f2a1015e5f0 2024-09-12T02:05:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.169+0000 7f2a181bd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2a1006e9d0 con 0x7f2a100d30f0 2024-09-12T02:05:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.169+0000 7f2a15f59640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a100b64c0 0x7f2a100cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.169+0000 7f2a15f59640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a100b64c0 0x7f2a100cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51374/0 (socket says 172.21.15.19:51374) 2024-09-12T02:05:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.169+0000 7f2a15f59640 1 -- 172.21.15.19:0/2951803764 learned_addr learned my addr 172.21.15.19:0/2951803764 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.169+0000 7f2a15758640 1 --2- 172.21.15.19:0/2951803764 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a100d30f0 0x7f2a101f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.169+0000 7f2a1675a640 1 --2- 172.21.15.19:0/2951803764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a1015e5f0 0x7f2a10148440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.170+0000 7f2a15f59640 1 -- 172.21.15.19:0/2951803764 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a100d30f0 msgr2=0x7f2a101f4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.170+0000 7f2a15f59640 1 --2- 172.21.15.19:0/2951803764 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a100d30f0 0x7f2a101f4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.170+0000 7f2a15f59640 1 -- 172.21.15.19:0/2951803764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a1015e5f0 msgr2=0x7f2a10148440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.170+0000 7f2a15f59640 1 --2- 172.21.15.19:0/2951803764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a1015e5f0 0x7f2a10148440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.170+0000 7f2a15f59640 1 -- 172.21.15.19:0/2951803764 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a100cbc60 con 0x7f2a100b64c0 2024-09-12T02:05:26.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.170+0000 7f2a15f59640 1 --2- 172.21.15.19:0/2951803764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a100b64c0 0x7f2a100cb5d0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009e50 tx=0x7f2a00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:26.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.170+0000 7f2a0e7fc640 1 -- 172.21.15.19:0/2951803764 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00036050 con 0x7f2a100b64c0 2024-09-12T02:05:26.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.170+0000 7f2a0e7fc640 1 -- 172.21.15.19:0/2951803764 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a00042070 con 0x7f2a100b64c0 2024-09-12T02:05:26.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.170+0000 7f2a181bd640 1 -- 172.21.15.19:0/2951803764 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a100b8590 con 0x7f2a100b64c0 2024-09-12T02:05:26.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.170+0000 7f2a0e7fc640 1 -- 172.21.15.19:0/2951803764 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00009510 con 0x7f2a100b64c0 2024-09-12T02:05:26.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.170+0000 7f2a181bd640 1 -- 172.21.15.19:0/2951803764 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a100b8b50 con 0x7f2a100b64c0 2024-09-12T02:05:26.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.171+0000 7f2a181bd640 1 -- 172.21.15.19:0/2951803764 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a100b5f80 con 0x7f2a100b64c0 2024-09-12T02:05:26.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.171+0000 7f2a0e7fc640 1 -- 172.21.15.19:0/2951803764 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a00007c70 con 0x7f2a100b64c0 2024-09-12T02:05:26.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.172+0000 7f2a0e7fc640 1 --2- 172.21.15.19:0/2951803764 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f29fc06be30 0x7f29fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:26.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.172+0000 7f2a0e7fc640 1 -- 172.21.15.19:0/2951803764 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7f2a000ac9c0 con 0x7f2a100b64c0 2024-09-12T02:05:26.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.172+0000 7f2a15758640 1 --2- 172.21.15.19:0/2951803764 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f29fc06be30 0x7f29fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:26.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.173+0000 7f2a15758640 1 --2- 172.21.15.19:0/2951803764 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f29fc06be30 0x7f29fc06e2f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2a10161f90 tx=0x7f2a04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:26.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.176+0000 7f2a0e7fc640 1 -- 172.21.15.19:0/2951803764 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a000aee20 con 0x7f2a100b64c0 2024-09-12T02:05:26.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.388+0000 7f2a181bd640 1 -- 172.21.15.19:0/2951803764 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2a100d3da0 con 0x7f2a100b64c0 2024-09-12T02:05:26.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.876+0000 7f2a0e7fc640 1 -- 172.21.15.19:0/2951803764 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v258) ==== 161+0+0 (secure 0 0 0) 0x7f2a0007a740 con 0x7f2a100b64c0 2024-09-12T02:05:26.875 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:05:26.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.878+0000 7f2a181bd640 1 -- 172.21.15.19:0/2951803764 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f29fc06be30 msgr2=0x7f29fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:26.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.878+0000 7f2a181bd640 1 --2- 172.21.15.19:0/2951803764 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f29fc06be30 0x7f29fc06e2f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2a10161f90 tx=0x7f2a04008040 comp rx=0 tx=0).stop 2024-09-12T02:05:26.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.878+0000 7f2a181bd640 1 -- 172.21.15.19:0/2951803764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a100b64c0 msgr2=0x7f2a100cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:26.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.878+0000 7f2a181bd640 1 --2- 172.21.15.19:0/2951803764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a100b64c0 0x7f2a100cb5d0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009e50 tx=0x7f2a00004a40 comp rx=0 tx=0).stop 2024-09-12T02:05:26.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.878+0000 7f2a181bd640 1 -- 172.21.15.19:0/2951803764 shutdown_connections 2024-09-12T02:05:26.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.878+0000 7f2a181bd640 1 --2- 172.21.15.19:0/2951803764 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f29fc06be30 0x7f29fc06e2f0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:26.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.878+0000 7f2a181bd640 1 --2- 172.21.15.19:0/2951803764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a1015e5f0 0x7f2a10148440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:26.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.878+0000 7f2a181bd640 1 --2- 172.21.15.19:0/2951803764 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a100d30f0 0x7f2a101f4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:26.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.878+0000 7f2a181bd640 1 --2- 172.21.15.19:0/2951803764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a100b64c0 0x7f2a100cb5d0 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:26.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.878+0000 7f2a181bd640 1 -- 172.21.15.19:0/2951803764 >> 172.21.15.19:0/2951803764 conn(0x7f2a1008bfc0 msgr2=0x7f2a10157ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:26.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.878+0000 7f2a181bd640 1 -- 172.21.15.19:0/2951803764 shutdown_connections 2024-09-12T02:05:26.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.878+0000 7f2a181bd640 1 -- 172.21.15.19:0/2951803764 wait complete. 2024-09-12T02:05:26.890 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:05:26.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.997+0000 7efd4f245640 1 Processor -- start 2024-09-12T02:05:26.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.997+0000 7efd4f245640 1 -- start start 2024-09-12T02:05:27.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.998+0000 7efd4f245640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd480b6690 0x7efd481691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.998+0000 7efd4f245640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd480d3690 con 0x7efd480d30f0 2024-09-12T02:05:27.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.998+0000 7efd4f245640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd480d3970 con 0x7efd4815e5f0 2024-09-12T02:05:27.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.998+0000 7efd4f245640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7efd4806d530 con 0x7efd480b6690 2024-09-12T02:05:27.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.998+0000 7efd47fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efd480d30f0 0x7efd480b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37090/0 (socket says 172.21.15.19:37090) 2024-09-12T02:05:27.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.998+0000 7efd47fff640 1 -- 172.21.15.19:0/1926849192 learned_addr learned my addr 172.21.15.19:0/1926849192 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:27.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.998+0000 7efd477fe640 1 -- 172.21.15.19:0/1926849192 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2294154315 0 0) 0x7efd480d3690 con 0x7efd480d30f0 2024-09-12T02:05:27.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.998+0000 7efd4d7e2640 1 --2- 172.21.15.19:0/1926849192 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd480b6690 0x7efd481691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.998+0000 7efd477fe640 1 -- 172.21.15.19:0/1926849192 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd38003520 con 0x7efd480d30f0 2024-09-12T02:05:27.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.998+0000 7efd477fe640 1 -- 172.21.15.19:0/1926849192 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4077139070 0 0) 0x7efd38003520 con 0x7efd480d30f0 2024-09-12T02:05:27.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.998+0000 7efd477fe640 1 -- 172.21.15.19:0/1926849192 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd480b6690 msgr2=0x7efd481691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:27.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.998+0000 7efd477fe640 1 --2- 172.21.15.19:0/1926849192 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd480b6690 0x7efd481691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.998+0000 7efd477fe640 1 -- 172.21.15.19:0/1926849192 >> v1:172.21.15.135:6789/0 conn(0x7efd4815e5f0 legacy=0x7efd480d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:27.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.998+0000 7efd477fe640 1 -- 172.21.15.19:0/1926849192 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4806cee0 con 0x7efd480d30f0 2024-09-12T02:05:27.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.998+0000 7efd477fe640 1 -- 172.21.15.19:0/1926849192 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7efd34001690 con 0x7efd480d30f0 2024-09-12T02:05:27.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.998+0000 7efd477fe640 1 -- 172.21.15.19:0/1926849192 >> v1:172.21.15.19:6789/0 conn(0x7efd480d30f0 legacy=0x7efd480b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:27.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.998+0000 7efd477fe640 1 --2- 172.21.15.19:0/1926849192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd380039e0 0x7efd38003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.999+0000 7efd477fe640 1 --2- 172.21.15.19:0/1926849192 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd480b6690 0x7efd38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.999+0000 7efd477fe640 1 --2- 172.21.15.19:0/1926849192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd38004d40 0x7efd380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.999+0000 7efd477fe640 1 -- 172.21.15.19:0/1926849192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efd4806d530 con 0x7efd38004d40 2024-09-12T02:05:27.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.999+0000 7efd477fe640 1 -- 172.21.15.19:0/1926849192 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efd3800b9f0 con 0x7efd380039e0 2024-09-12T02:05:27.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.999+0000 7efd477fe640 1 -- 172.21.15.19:0/1926849192 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7efd3800bbf0 con 0x7efd480b6690 2024-09-12T02:05:27.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.999+0000 7efd4d7e2640 1 --2- 172.21.15.19:0/1926849192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd38004d40 0x7efd380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.999+0000 7efd4cfe1640 1 --2- 172.21.15.19:0/1926849192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd380039e0 0x7efd38003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.999+0000 7efd47fff640 1 --2- 172.21.15.19:0/1926849192 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd480b6690 0x7efd38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.999+0000 7efd4d7e2640 1 -- 172.21.15.19:0/1926849192 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd480b6690 msgr2=0x7efd38004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:27.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.999+0000 7efd4d7e2640 1 --2- 172.21.15.19:0/1926849192 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd480b6690 0x7efd38004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.999+0000 7efd4d7e2640 1 -- 172.21.15.19:0/1926849192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd380039e0 msgr2=0x7efd38003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:27.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.999+0000 7efd4d7e2640 1 --2- 172.21.15.19:0/1926849192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd380039e0 0x7efd38003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:26.999+0000 7efd4d7e2640 1 -- 172.21.15.19:0/1926849192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd38003520 con 0x7efd38004d40 2024-09-12T02:05:27.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.000+0000 7efd4d7e2640 1 --2- 172.21.15.19:0/1926849192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd38004d40 0x7efd380051c0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7efd40009fc0 tx=0x7efd38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb905269b20eefd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:27.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.000+0000 7efd477fe640 1 -- 172.21.15.19:0/1926849192 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40009c10 con 0x7efd38004d40 2024-09-12T02:05:27.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.000+0000 7efd477fe640 1 -- 172.21.15.19:0/1926849192 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd40036070 con 0x7efd38004d40 2024-09-12T02:05:27.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.000+0000 7efd477fe640 1 -- 172.21.15.19:0/1926849192 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40031880 con 0x7efd38004d40 2024-09-12T02:05:27.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.000+0000 7efd4f245640 1 -- 172.21.15.19:0/1926849192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd38004d40 msgr2=0x7efd380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:27.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.000+0000 7efd4f245640 1 --2- 172.21.15.19:0/1926849192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd38004d40 0x7efd380051c0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7efd40009fc0 tx=0x7efd38005830 comp rx=0 tx=0).stop 2024-09-12T02:05:27.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.000+0000 7efd4d7e2640 1 -- 172.21.15.19:0/1926849192 reap_dead start 2024-09-12T02:05:27.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.000+0000 7efd4f245640 1 -- 172.21.15.19:0/1926849192 shutdown_connections 2024-09-12T02:05:27.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.000+0000 7efd4f245640 1 -- 172.21.15.19:0/1926849192 >> 172.21.15.19:0/1926849192 conn(0x7efd4808bfc0 msgr2=0x7efd480d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:27.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.001+0000 7efd4f245640 1 -- 172.21.15.19:0/1926849192 shutdown_connections 2024-09-12T02:05:27.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.001+0000 7efd4f245640 1 -- 172.21.15.19:0/1926849192 wait complete. 2024-09-12T02:05:27.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.002+0000 7efd4f245640 1 Processor -- start 2024-09-12T02:05:27.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.002+0000 7efd4f245640 1 -- start start 2024-09-12T02:05:27.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd4f245640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd38004d40 0x7efd481f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd4f245640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd480b8cc0 0x7efd481f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd4f245640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd480b1cc0 0x7efd480b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd4f245640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efd4806e9d0 con 0x7efd480b1cc0 2024-09-12T02:05:27.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd4f245640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efd4815e9d0 con 0x7efd38004d40 2024-09-12T02:05:27.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd4f245640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7efd4806eb50 con 0x7efd480b8cc0 2024-09-12T02:05:27.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd4d7e2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd480b1cc0 0x7efd480b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd4d7e2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd480b1cc0 0x7efd480b2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51388/0 (socket says 172.21.15.19:51388) 2024-09-12T02:05:27.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd4d7e2640 1 -- 172.21.15.19:0/2728134298 learned_addr learned my addr 172.21.15.19:0/2728134298 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:27.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd4cfe1640 1 --2- 172.21.15.19:0/2728134298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd38004d40 0x7efd481f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd47fff640 1 --2- 172.21.15.19:0/2728134298 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd480b8cc0 0x7efd481f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd4d7e2640 1 -- 172.21.15.19:0/2728134298 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd480b8cc0 msgr2=0x7efd481f3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:27.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd4d7e2640 1 --2- 172.21.15.19:0/2728134298 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd480b8cc0 0x7efd481f3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd4d7e2640 1 -- 172.21.15.19:0/2728134298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd38004d40 msgr2=0x7efd481f7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:27.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd4d7e2640 1 --2- 172.21.15.19:0/2728134298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd38004d40 0x7efd481f7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd4d7e2640 1 -- 172.21.15.19:0/2728134298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4815ebf0 con 0x7efd480b1cc0 2024-09-12T02:05:27.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd4d7e2640 1 --2- 172.21.15.19:0/2728134298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd480b1cc0 0x7efd480b2150 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7efd40033040 tx=0x7efd40009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:27.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd457fa640 1 -- 172.21.15.19:0/2728134298 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40009c10 con 0x7efd480b1cc0 2024-09-12T02:05:27.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd457fa640 1 -- 172.21.15.19:0/2728134298 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd40031dd0 con 0x7efd480b1cc0 2024-09-12T02:05:27.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd4f245640 1 -- 172.21.15.19:0/2728134298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd48156840 con 0x7efd480b1cc0 2024-09-12T02:05:27.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.003+0000 7efd457fa640 1 -- 172.21.15.19:0/2728134298 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40003bd0 con 0x7efd480b1cc0 2024-09-12T02:05:27.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.004+0000 7efd4f245640 1 -- 172.21.15.19:0/2728134298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd4815ee90 con 0x7efd480b1cc0 2024-09-12T02:05:27.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.004+0000 7efd4f245640 1 -- 172.21.15.19:0/2728134298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd480b5f80 con 0x7efd480b1cc0 2024-09-12T02:05:27.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.005+0000 7efd457fa640 1 -- 172.21.15.19:0/2728134298 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd40005d10 con 0x7efd480b1cc0 2024-09-12T02:05:27.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.005+0000 7efd457fa640 1 --2- 172.21.15.19:0/2728134298 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7efd2c06be30 0x7efd2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.005+0000 7efd457fa640 1 -- 172.21.15.19:0/2728134298 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7efd400ad2a0 con 0x7efd480b1cc0 2024-09-12T02:05:27.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.006+0000 7efd4cfe1640 1 --2- 172.21.15.19:0/2728134298 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7efd2c06be30 0x7efd2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.006+0000 7efd4cfe1640 1 --2- 172.21.15.19:0/2728134298 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7efd2c06be30 0x7efd2c06e2f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7efd3c003700 tx=0x7efd3c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:27.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.010+0000 7efd457fa640 1 -- 172.21.15.19:0/2728134298 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efd4004a060 con 0x7efd480b1cc0 2024-09-12T02:05:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.253+0000 7efd4f245640 1 -- 172.21.15.19:0/2728134298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7efd480b3410 con 0x7efd480b1cc0 2024-09-12T02:05:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.881+0000 7efd457fa640 1 -- 172.21.15.19:0/2728134298 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v259) ==== 101+0+0 (secure 0 0 0) 0x7efd4007af90 con 0x7efd480b1cc0 2024-09-12T02:05:27.882 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:05:27.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.883+0000 7efd4f245640 1 -- 172.21.15.19:0/2728134298 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7efd2c06be30 msgr2=0x7efd2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:27.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.883+0000 7efd4f245640 1 --2- 172.21.15.19:0/2728134298 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7efd2c06be30 0x7efd2c06e2f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7efd3c003700 tx=0x7efd3c009040 comp rx=0 tx=0).stop 2024-09-12T02:05:27.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.883+0000 7efd4f245640 1 -- 172.21.15.19:0/2728134298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd480b1cc0 msgr2=0x7efd480b2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:27.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.883+0000 7efd4f245640 1 --2- 172.21.15.19:0/2728134298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd480b1cc0 0x7efd480b2150 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7efd40033040 tx=0x7efd40009750 comp rx=0 tx=0).stop 2024-09-12T02:05:27.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.884+0000 7efd4f245640 1 -- 172.21.15.19:0/2728134298 shutdown_connections 2024-09-12T02:05:27.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.884+0000 7efd4f245640 1 --2- 172.21.15.19:0/2728134298 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7efd2c06be30 0x7efd2c06e2f0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.884+0000 7efd4f245640 1 --2- 172.21.15.19:0/2728134298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd480b1cc0 0x7efd480b2150 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.884+0000 7efd4f245640 1 --2- 172.21.15.19:0/2728134298 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd480b8cc0 0x7efd481f3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.884+0000 7efd4f245640 1 --2- 172.21.15.19:0/2728134298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd38004d40 0x7efd481f7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.884+0000 7efd4f245640 1 -- 172.21.15.19:0/2728134298 >> 172.21.15.19:0/2728134298 conn(0x7efd4808bfc0 msgr2=0x7efd480cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:27.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.884+0000 7efd4f245640 1 -- 172.21.15.19:0/2728134298 shutdown_connections 2024-09-12T02:05:27.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.884+0000 7efd4f245640 1 -- 172.21.15.19:0/2728134298 wait complete. 2024-09-12T02:05:27.897 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:05:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.942+0000 7fa366157f40 1 Processor -- start 2024-09-12T02:05:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.942+0000 7fa366157f40 1 -- start start 2024-09-12T02:05:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.943+0000 7fa366157f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604ba07df30 0x5604ba10d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.943+0000 7fa366157f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5604ba10ad20 0x5604ba102a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.943+0000 7fa366157f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604ba10b100 0x5604ba102fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.943+0000 7fa366157f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5604ba07f6b0 con 0x5604ba07df30 2024-09-12T02:05:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.943+0000 7fa366157f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5604b9f87510 con 0x5604ba10b100 2024-09-12T02:05:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.943+0000 7fa366157f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5604ba03a2d0 con 0x5604ba10ad20 2024-09-12T02:05:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.943+0000 7fa363c4d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604ba07df30 0x5604ba10d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.943+0000 7fa363c4d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604ba07df30 0x5604ba10d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51420/0 (socket says 172.21.15.19:51420) 2024-09-12T02:05:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.943+0000 7fa363c4d640 1 -- 172.21.15.19:0/3206523273 learned_addr learned my addr 172.21.15.19:0/3206523273 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.943+0000 7fa36444e640 1 --2- 172.21.15.19:0/3206523273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604ba10b100 0x5604ba102fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.943+0000 7fa36344c640 1 --2- 172.21.15.19:0/3206523273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5604ba10ad20 0x5604ba102a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.943+0000 7fa363c4d640 1 -- 172.21.15.19:0/3206523273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5604ba10ad20 msgr2=0x5604ba102a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.943+0000 7fa363c4d640 1 --2- 172.21.15.19:0/3206523273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5604ba10ad20 0x5604ba102a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.943+0000 7fa363c4d640 1 -- 172.21.15.19:0/3206523273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604ba10b100 msgr2=0x5604ba102fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.943+0000 7fa363c4d640 1 --2- 172.21.15.19:0/3206523273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604ba10b100 0x5604ba102fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.943+0000 7fa363c4d640 1 -- 172.21.15.19:0/3206523273 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604ba108b60 con 0x5604ba07df30 2024-09-12T02:05:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.943+0000 7fa36444e640 1 --2- 172.21.15.19:0/3206523273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604ba10b100 0x5604ba102fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.944+0000 7fa363c4d640 1 --2- 172.21.15.19:0/3206523273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604ba07df30 0x5604ba10d260 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fa354000c00 tx=0x7fa354051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e6012cd5171377 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.944+0000 7fa36244a640 1 -- 172.21.15.19:0/3206523273 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa354069070 con 0x5604ba07df30 2024-09-12T02:05:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.944+0000 7fa36244a640 1 -- 172.21.15.19:0/3206523273 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3540517d0 con 0x5604ba07df30 2024-09-12T02:05:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.944+0000 7fa36244a640 1 -- 172.21.15.19:0/3206523273 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa354055070 con 0x5604ba07df30 2024-09-12T02:05:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.944+0000 7fa366157f40 1 -- 172.21.15.19:0/3206523273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604ba07df30 msgr2=0x5604ba10d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.944+0000 7fa366157f40 1 --2- 172.21.15.19:0/3206523273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604ba07df30 0x5604ba10d260 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fa354000c00 tx=0x7fa354051000 comp rx=0 tx=0).stop 2024-09-12T02:05:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.944+0000 7fa366157f40 1 -- 172.21.15.19:0/3206523273 shutdown_connections 2024-09-12T02:05:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.944+0000 7fa366157f40 1 --2- 172.21.15.19:0/3206523273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604ba10b100 0x5604ba102fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.944+0000 7fa366157f40 1 --2- 172.21.15.19:0/3206523273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5604ba10ad20 0x5604ba102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.944+0000 7fa366157f40 1 --2- 172.21.15.19:0/3206523273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604ba07df30 0x5604ba10d260 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.944+0000 7fa366157f40 1 -- 172.21.15.19:0/3206523273 >> 172.21.15.19:0/3206523273 conn(0x5604ba063490 msgr2=0x5604ba063870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:27.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.944+0000 7fa366157f40 1 -- 172.21.15.19:0/3206523273 shutdown_connections 2024-09-12T02:05:27.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.944+0000 7fa366157f40 1 -- 172.21.15.19:0/3206523273 wait complete. 2024-09-12T02:05:27.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.945+0000 7fa366157f40 1 Processor -- start 2024-09-12T02:05:27.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.945+0000 7fa366157f40 1 -- start start 2024-09-12T02:05:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.946+0000 7fa366157f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5604ba07df30 0x5604ba101160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.946+0000 7fa366157f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604ba10ad20 0x5604ba062d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.946+0000 7fa366157f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604ba10b100 0x5604ba10c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.946+0000 7fa366157f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5604ba080e70 con 0x5604ba10ad20 2024-09-12T02:05:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.946+0000 7fa366157f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5604ba10b500 con 0x5604ba10b100 2024-09-12T02:05:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.946+0000 7fa366157f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5604ba0810c0 con 0x5604ba07df30 2024-09-12T02:05:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.946+0000 7fa36344c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604ba10ad20 0x5604ba062d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.946+0000 7fa36344c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604ba10ad20 0x5604ba062d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51432/0 (socket says 172.21.15.19:51432) 2024-09-12T02:05:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.946+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 learned_addr learned my addr 172.21.15.19:0/3766200184 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.946+0000 7fa36444e640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604ba10b100 0x5604ba10c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.946+0000 7fa363c4d640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5604ba07df30 0x5604ba101160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.946+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5604ba07df30 msgr2=0x5604ba101160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.946+0000 7fa36344c640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5604ba07df30 0x5604ba101160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.946+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604ba10b100 msgr2=0x5604ba10c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.946+0000 7fa36344c640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604ba10b100 0x5604ba10c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.946+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604ba1016a0 con 0x5604ba10ad20 2024-09-12T02:05:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.947+0000 7fa36344c640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604ba10ad20 0x5604ba062d20 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fa358009e90 tx=0x7fa358009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.947+0000 7fa361448640 1 -- 172.21.15.19:0/3766200184 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3580143f0 con 0x5604ba10ad20 2024-09-12T02:05:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.947+0000 7fa361448640 1 -- 172.21.15.19:0/3766200184 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa358019070 con 0x5604ba10ad20 2024-09-12T02:05:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.947+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604ba108550 con 0x5604ba10ad20 2024-09-12T02:05:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.947+0000 7fa361448640 1 -- 172.21.15.19:0/3766200184 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3580147d0 con 0x5604ba10ad20 2024-09-12T02:05:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.947+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604ba1074b0 con 0x5604ba10ad20 2024-09-12T02:05:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.948+0000 7fa361448640 1 -- 172.21.15.19:0/3766200184 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa358014970 con 0x5604ba10ad20 2024-09-12T02:05:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.949+0000 7fa361448640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa35006a810 0x7fa35006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.949+0000 7fa361448640 1 -- 172.21.15.19:0/3766200184 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7fa35808a480 con 0x5604ba10ad20 2024-09-12T02:05:27.957 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:05:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.949+0000 7fa366157f40 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5604ba0ffa80 0x5604ba0ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.949+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1003d0 con 0x5604ba0ffa80 2024-09-12T02:05:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.949+0000 7fa363c4d640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa35006a810 0x7fa35006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.949+0000 7fa36444e640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5604ba0ffa80 0x5604ba0ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.950+0000 7fa36444e640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5604ba0ffa80 0x5604ba0ffe90 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.950+0000 7fa363c4d640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa35006a810 0x7fa35006ccd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa354066000 tx=0x7fa354053000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.951+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v125'939 uv913 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.951+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1adcd0 con 0x5604ba0ffa80 2024-09-12T02:05:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.952+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v125'940 uv940 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.953+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1ae070 con 0x5604ba0ffa80 2024-09-12T02:05:27.962 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:05:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.954+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v125'941 uv941 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.954+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1af420 con 0x5604ba0ffa80 2024-09-12T02:05:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.955+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v125'942 uv942 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.955+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1af7c0 con 0x5604ba0ffa80 2024-09-12T02:05:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.956+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v125'943 uv943 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.956+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1ae410 con 0x5604ba0ffa80 2024-09-12T02:05:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.957+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v125'944 uv944 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.957+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1ae820 con 0x5604ba0ffa80 2024-09-12T02:05:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.959+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v125'945 uv919 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.959+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1aebc0 con 0x5604ba0ffa80 2024-09-12T02:05:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.960+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v125'946 uv946 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.960+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1aebc0 con 0x5604ba0ffa80 2024-09-12T02:05:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.961+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v125'947 uv947 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.966 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:05:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.961+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1aebc0 con 0x5604ba0ffa80 2024-09-12T02:05:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.962+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v125'948 uv948 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.962+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1af040 con 0x5604ba0ffa80 2024-09-12T02:05:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.963+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v125'949 uv949 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.963+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1af040 con 0x5604ba0ffa80 2024-09-12T02:05:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.964+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v125'950 uv950 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.964+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1af040 con 0x5604ba0ffa80 2024-09-12T02:05:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.965+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v125'951 uv926 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.965+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1af040 con 0x5604ba0ffa80 2024-09-12T02:05:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.966+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v125'952 uv952 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.966+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1af040 con 0x5604ba0ffa80 2024-09-12T02:05:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.967+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v125'953 uv953 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.969 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:05:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.968+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1af040 con 0x5604ba0ffa80 2024-09-12T02:05:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.969+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v125'954 uv954 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.969+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1af040 con 0x5604ba0ffa80 2024-09-12T02:05:27.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.970+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v125'955 uv955 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.970+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1af040 con 0x5604ba0ffa80 2024-09-12T02:05:27.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.971+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v125'956 uv956 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.971+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1aebc0 con 0x5604ba0ffa80 2024-09-12T02:05:27.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.972+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v125'957 uv957 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.972+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1aebc0 con 0x5604ba0ffa80 2024-09-12T02:05:27.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.973+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v125'958 uv932 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.973+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1aebc0 con 0x5604ba0ffa80 2024-09-12T02:05:27.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.974+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v125'959 uv959 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.974+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1aebc0 con 0x5604ba0ffa80 2024-09-12T02:05:27.975 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:05:27.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.975+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v125'960 uv960 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.975+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1aebc0 con 0x5604ba0ffa80 2024-09-12T02:05:27.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.976+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v125'961 uv961 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.976+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1aebc0 con 0x5604ba0ffa80 2024-09-12T02:05:27.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.977+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v125'962 uv962 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.977+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1aebc0 con 0x5604ba0ffa80 2024-09-12T02:05:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.978+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v125'963 uv963 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.978+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1aebc0 con 0x5604ba0ffa80 2024-09-12T02:05:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.980+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v125'964 uv938 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.980+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1aebc0 con 0x5604ba0ffa80 2024-09-12T02:05:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.981+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v125'965 uv965 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.981+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1aebc0 con 0x5604ba0ffa80 2024-09-12T02:05:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.982+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v125'966 uv966 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.982 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:05:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.982+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1aebc0 con 0x5604ba0ffa80 2024-09-12T02:05:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.983+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v125'967 uv967 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.983+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1aebc0 con 0x5604ba0ffa80 2024-09-12T02:05:27.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.984+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v125'968 uv968 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.984+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1aebc0 con 0x5604ba0ffa80 2024-09-12T02:05:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.985+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v125'969 uv969 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba0ffa80 2024-09-12T02:05:27.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.985+0000 7fa366157f40 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5604ba1b0070 0x5604ba1b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.985+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1aebc0 con 0x5604ba1b0070 2024-09-12T02:05:27.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.985+0000 7fa363c4d640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5604ba1b0070 0x5604ba1b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.986+0000 7fa363c4d640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5604ba1b0070 0x5604ba1b2460 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:27.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.988+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v125'681 uv664 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:27.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.988+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b29a0 con 0x5604ba1b0070 2024-09-12T02:05:27.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.989+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v125'682 uv682 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:27.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.989+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b2d40 con 0x5604ba1b0070 2024-09-12T02:05:27.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.990+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v125'683 uv683 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:27.991 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:05:27.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.990+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b3590 con 0x5604ba1b0070 2024-09-12T02:05:27.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.992+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v125'684 uv684 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:27.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.992+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b3930 con 0x5604ba1b0070 2024-09-12T02:05:27.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.993+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v125'685 uv685 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:27.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.993+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b3cd0 con 0x5604ba1b0070 2024-09-12T02:05:27.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.994+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v125'686 uv669 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:27.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.995+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b4070 con 0x5604ba1b0070 2024-09-12T02:05:27.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.996+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v125'687 uv687 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:27.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.996+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b4070 con 0x5604ba1b0070 2024-09-12T02:05:27.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.997+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v125'688 uv688 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:27.997 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:05:27.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.997+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b4070 con 0x5604ba1b0070 2024-09-12T02:05:27.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.998+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v125'689 uv689 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:27.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:27.998+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b4070 con 0x5604ba1b0070 2024-09-12T02:05:28.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.000+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v125'690 uv690 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:28.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.000+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b4070 con 0x5604ba1b0070 2024-09-12T02:05:28.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.001+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v125'691 uv674 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:28.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.001+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b4070 con 0x5604ba1b0070 2024-09-12T02:05:28.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.002+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v125'692 uv692 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:28.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.002+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b4070 con 0x5604ba1b0070 2024-09-12T02:05:28.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.004+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v125'693 uv693 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:28.004 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:05:28.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.004+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b84f0 con 0x5604ba1b0070 2024-09-12T02:05:28.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.005+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v125'694 uv694 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:28.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.005+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b84f0 con 0x5604ba1b0070 2024-09-12T02:05:28.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.006+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v125'695 uv695 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:28.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.006+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b4070 con 0x5604ba1b0070 2024-09-12T02:05:28.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.008+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v125'696 uv680 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:28.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.008+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b4070 con 0x5604ba1b0070 2024-09-12T02:05:28.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.009+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v125'697 uv697 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:28.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.009+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b4070 con 0x5604ba1b0070 2024-09-12T02:05:28.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.010+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v125'698 uv698 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:28.010 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:05:28.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.010+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b5080 con 0x5604ba1b0070 2024-09-12T02:05:28.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.011+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v125'699 uv699 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:28.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.011+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b5080 con 0x5604ba1b0070 2024-09-12T02:05:28.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.012+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v125'700 uv700 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:28.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.013+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b4070 con 0x5604ba1b0070 2024-09-12T02:05:28.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.014+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v125'701 uv701 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1b0070 2024-09-12T02:05:28.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.014+0000 7fa366157f40 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5604ba1b4580 0x5604ba1b6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.014+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b6eb0 con 0x5604ba1b4580 2024-09-12T02:05:28.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.014+0000 7fa36344c640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5604ba1b4580 0x5604ba1b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.014+0000 7fa36344c640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5604ba1b4580 0x5604ba1b6970 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:28.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.016+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v125'183 uv182 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.016+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b7250 con 0x5604ba1b4580 2024-09-12T02:05:28.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.017+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v125'184 uv184 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.017+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b7670 con 0x5604ba1b4580 2024-09-12T02:05:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.018+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v125'185 uv185 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.018 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:05:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.018+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b8f20 con 0x5604ba1b4580 2024-09-12T02:05:28.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.019+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v125'186 uv186 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.019+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b92c0 con 0x5604ba1b4580 2024-09-12T02:05:28.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.020+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v125'187 uv187 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.020+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1b7f10 con 0x5604ba1b4580 2024-09-12T02:05:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.021+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v125'188 uv188 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.021+0000 7fa366157f40 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5604ba1b87e0 0x5604ba1bb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.021+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bbbb0 con 0x5604ba1b87e0 2024-09-12T02:05:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.021+0000 7fa36444e640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5604ba1b87e0 0x5604ba1bb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.022+0000 7fa36444e640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5604ba1b87e0 0x5604ba1bb670 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:28.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.023+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v125'134 uv133 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.023+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bbbb0 con 0x5604ba1b87e0 2024-09-12T02:05:28.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.024+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v125'135 uv135 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.024+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bbbb0 con 0x5604ba1b87e0 2024-09-12T02:05:28.025 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:05:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.025+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v125'136 uv136 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.025+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bbfc0 con 0x5604ba1b87e0 2024-09-12T02:05:28.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.026+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v125'137 uv137 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.026+0000 7fa366157f40 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5604ba1bc4d0 0x5604ba1be8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.026+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bee40 con 0x5604ba1bc4d0 2024-09-12T02:05:28.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.026+0000 7fa363c4d640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5604ba1bc4d0 0x5604ba1be8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.027+0000 7fa363c4d640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5604ba1bc4d0 0x5604ba1be8c0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.028+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v125'183 uv182 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.028+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bef00 con 0x5604ba1bc4d0 2024-09-12T02:05:28.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.029+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v125'184 uv184 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.029+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1bc4d0 2024-09-12T02:05:28.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.030+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v125'185 uv185 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.031 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:05:28.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.030+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c0330 con 0x5604ba1bc4d0 2024-09-12T02:05:28.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.031+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v125'186 uv186 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.031+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c0330 con 0x5604ba1bc4d0 2024-09-12T02:05:28.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.032+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v125'187 uv187 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.032+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1bc4d0 2024-09-12T02:05:28.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.034+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v125'188 uv188 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.034+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1b87e0 2024-09-12T02:05:28.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.035+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v125'338 uv332 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.035+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1b87e0 2024-09-12T02:05:28.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.036+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v125'339 uv339 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.036+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1b87e0 2024-09-12T02:05:28.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.037+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v125'340 uv340 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.038 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:05:28.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.037+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c0330 con 0x5604ba1b87e0 2024-09-12T02:05:28.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.038+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v125'341 uv341 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.038+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c0330 con 0x5604ba1b87e0 2024-09-12T02:05:28.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.040+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v125'342 uv342 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.040+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1b87e0 2024-09-12T02:05:28.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.041+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v125'343 uv343 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.041+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1b87e0 2024-09-12T02:05:28.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.042+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v125'344 uv337 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.042+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1b87e0 2024-09-12T02:05:28.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.043+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v125'345 uv345 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.043+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1b87e0 2024-09-12T02:05:28.046 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:05:28.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.044+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v125'346 uv346 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.044+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1b87e0 2024-09-12T02:05:28.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.045+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v125'347 uv347 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.045+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1b87e0 2024-09-12T02:05:28.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.046+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v125'348 uv348 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.046+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1b87e0 2024-09-12T02:05:28.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.047+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v125'153 uv152 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.047+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1b87e0 2024-09-12T02:05:28.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.048+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v125'154 uv154 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.048+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1b87e0 2024-09-12T02:05:28.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.049+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v125'155 uv155 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.049 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:05:28.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.049+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1b87e0 2024-09-12T02:05:28.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.050+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v125'156 uv156 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.050+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1b87e0 2024-09-12T02:05:28.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.051+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v125'157 uv157 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa35c004540 con 0x5604ba1b87e0 2024-09-12T02:05:28.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.051+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1bc4d0 2024-09-12T02:05:28.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.052+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v125'183 uv182 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.052+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1bc4d0 2024-09-12T02:05:28.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.053+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v125'184 uv184 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.053+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1bc4d0 2024-09-12T02:05:28.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.054+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v125'185 uv185 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.054 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:05:28.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.054+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1bc4d0 2024-09-12T02:05:28.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.055+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v125'186 uv186 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.055+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1bc4d0 2024-09-12T02:05:28.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.056+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v125'187 uv187 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.056+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1bc4d0 2024-09-12T02:05:28.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.057+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v125'188 uv188 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.057+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1bc4d0 2024-09-12T02:05:28.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.059+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v125'304 uv298 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.059+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1bc4d0 2024-09-12T02:05:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.060+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v125'305 uv305 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.060+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf320 con 0x5604ba1bc4d0 2024-09-12T02:05:28.061 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:05:28.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.061+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v125'306 uv306 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.061+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf710 con 0x5604ba1bc4d0 2024-09-12T02:05:28.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.062+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v125'307 uv307 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.062+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf710 con 0x5604ba1bc4d0 2024-09-12T02:05:28.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.063+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v125'308 uv308 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.063+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf710 con 0x5604ba1bc4d0 2024-09-12T02:05:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.065+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v125'309 uv303 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.065+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf710 con 0x5604ba1bc4d0 2024-09-12T02:05:28.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.066+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v125'310 uv310 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.066+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf710 con 0x5604ba1bc4d0 2024-09-12T02:05:28.067 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:05:28.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.067+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v125'311 uv311 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.067+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1bf710 con 0x5604ba1bc4d0 2024-09-12T02:05:28.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.068+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v125'312 uv312 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.068+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2520 con 0x5604ba1bc4d0 2024-09-12T02:05:28.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.069+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v125'313 uv313 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.069+0000 7fa366157f40 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5604ba1c00d0 0x5604ba1c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.069+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a00 con 0x5604ba1c00d0 2024-09-12T02:05:28.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.070+0000 7fa36344c640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5604ba1c00d0 0x5604ba1c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.070+0000 7fa36344c640 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5604ba1c00d0 0x5604ba1c24c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:28.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.071+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v125'132 uv131 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1c00d0 2024-09-12T02:05:28.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.071+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a00 con 0x5604ba1c00d0 2024-09-12T02:05:28.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.072+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v125'133 uv133 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1c00d0 2024-09-12T02:05:28.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.072+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a00 con 0x5604ba1c00d0 2024-09-12T02:05:28.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.073+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v125'134 uv134 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1c00d0 2024-09-12T02:05:28.074 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:05:28.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.073+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a00 con 0x5604ba1c00d0 2024-09-12T02:05:28.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.074+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v125'135 uv135 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1c00d0 2024-09-12T02:05:28.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.074+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a00 con 0x5604ba1bc4d0 2024-09-12T02:05:28.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.075+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v125'183 uv182 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.075+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a00 con 0x5604ba1bc4d0 2024-09-12T02:05:28.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.076+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v125'184 uv184 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.076+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a00 con 0x5604ba1bc4d0 2024-09-12T02:05:28.078 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:05:28.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.078+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v125'185 uv185 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.078+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c3a10 con 0x5604ba1bc4d0 2024-09-12T02:05:28.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.079+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v125'186 uv186 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.079+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c3a10 con 0x5604ba1bc4d0 2024-09-12T02:05:28.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.080+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v125'187 uv187 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.080+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a00 con 0x5604ba1bc4d0 2024-09-12T02:05:28.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.081+0000 7fa363c4d640 1 -- 172.21.15.19:0/3766200184 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v125'188 uv188 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa35406c070 con 0x5604ba1bc4d0 2024-09-12T02:05:28.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.081+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a00 con 0x5604ba1b4580 2024-09-12T02:05:28.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.082+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v125'156 uv155 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.082+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a00 con 0x5604ba1b4580 2024-09-12T02:05:28.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.083+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v125'157 uv157 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.083+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a00 con 0x5604ba1b4580 2024-09-12T02:05:28.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.085+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v125'158 uv158 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.085 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:05:28.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.085+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a00 con 0x5604ba1b4580 2024-09-12T02:05:28.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.086+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v125'159 uv159 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.086+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a00 con 0x5604ba1b4580 2024-09-12T02:05:28.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.087+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v125'160 uv160 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.087+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a00 con 0x5604ba1b4580 2024-09-12T02:05:28.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.088+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v125'376 uv375 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.088+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a60 con 0x5604ba1b4580 2024-09-12T02:05:28.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.089+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v125'377 uv377 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.089+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a60 con 0x5604ba1b4580 2024-09-12T02:05:28.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.091+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v125'378 uv378 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.091 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:05:28.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.091+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2aa0 con 0x5604ba1b4580 2024-09-12T02:05:28.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.092+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v125'379 uv379 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.092+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a40 con 0x5604ba1b4580 2024-09-12T02:05:28.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.093+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v125'380 uv380 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.093+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a40 con 0x5604ba1b4580 2024-09-12T02:05:28.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.094+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v125'381 uv374 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.094+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a20 con 0x5604ba1b4580 2024-09-12T02:05:28.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.095+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v125'382 uv382 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.095+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a00 con 0x5604ba1b4580 2024-09-12T02:05:28.096 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:05:28.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.096+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v125'383 uv383 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.096+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a00 con 0x5604ba1b4580 2024-09-12T02:05:28.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.097+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v125'384 uv384 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.097+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a00 con 0x5604ba1b4580 2024-09-12T02:05:28.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.098+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v125'385 uv385 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.098+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2a00 con 0x5604ba1b4580 2024-09-12T02:05:28.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.099+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v125'386 uv386 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.099+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x5604ba1c2ea0 con 0x5604ba1b4580 2024-09-12T02:05:28.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa36344c640 1 -- 172.21.15.19:0/3766200184 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v125'387 uv387 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fa3580541c0 con 0x5604ba1b4580 2024-09-12T02:05:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5604ba1b0070 msgr2=0x5604ba1b2460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5604ba1b0070 0x5604ba1b2460 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5604ba0ffa80 msgr2=0x5604ba0ffe90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5604ba0ffa80 0x5604ba0ffe90 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5604ba1b87e0 msgr2=0x5604ba1bb670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5604ba1b87e0 0x5604ba1bb670 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5604ba1c00d0 msgr2=0x5604ba1c24c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5604ba1c00d0 0x5604ba1c24c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5604ba1b4580 msgr2=0x5604ba1b6970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5604ba1b4580 0x5604ba1b6970 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 reap_dead start 2024-09-12T02:05:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5604ba1bc4d0 msgr2=0x5604ba1be8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5604ba1bc4d0 0x5604ba1be8c0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 reap_dead start 2024-09-12T02:05:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa36444e640 1 -- 172.21.15.19:0/3766200184 reap_dead start 2024-09-12T02:05:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa35006a810 msgr2=0x7fa35006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa35006a810 0x7fa35006ccd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa354066000 tx=0x7fa354053000 comp rx=0 tx=0).stop 2024-09-12T02:05:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604ba10ad20 msgr2=0x5604ba062d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604ba10ad20 0x5604ba062d20 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fa358009e90 tx=0x7fa358009f80 comp rx=0 tx=0).stop 2024-09-12T02:05:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 shutdown_connections 2024-09-12T02:05:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa35006a810 0x7fa35006ccd0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 --2- 172.21.15.19:0/3766200184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604ba10ad20 0x5604ba062d20 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.100+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 >> 172.21.15.19:0/3766200184 conn(0x5604ba063490 msgr2=0x5604ba10d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:28.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.101+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 shutdown_connections 2024-09-12T02:05:28.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.101+0000 7fa366157f40 1 -- 172.21.15.19:0/3766200184 wait complete. 2024-09-12T02:05:28.105 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 sixmegs_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-09-12T02:05:28.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.150+0000 7fda837b6f40 1 Processor -- start 2024-09-12T02:05:28.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.150+0000 7fda837b6f40 1 -- start start 2024-09-12T02:05:28.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda837b6f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56188f8258e0 0x56188f8e2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda837b6f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56188f8e4730 0x56188f8fd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda837b6f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56188f8fb960 0x56188f8fd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda837b6f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56188f8544e0 con 0x56188f8e4730 2024-09-12T02:05:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda837b6f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56188f777510 con 0x56188f8fb960 2024-09-12T02:05:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda837b6f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56188f853970 con 0x56188f8258e0 2024-09-12T02:05:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda80aab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56188f8e4730 0x56188f8fd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda80aab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56188f8e4730 0x56188f8fd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51446/0 (socket says 172.21.15.19:51446) 2024-09-12T02:05:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda80aab640 1 -- 172.21.15.19:0/3403600376 learned_addr learned my addr 172.21.15.19:0/3403600376 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda81aad640 1 --2- 172.21.15.19:0/3403600376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56188f8fb960 0x56188f8fd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda812ac640 1 --2- 172.21.15.19:0/3403600376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56188f8258e0 0x56188f8e2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda80aab640 1 -- 172.21.15.19:0/3403600376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56188f8258e0 msgr2=0x56188f8e2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda80aab640 1 --2- 172.21.15.19:0/3403600376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56188f8258e0 0x56188f8e2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda80aab640 1 -- 172.21.15.19:0/3403600376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56188f8fb960 msgr2=0x56188f8fd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda80aab640 1 --2- 172.21.15.19:0/3403600376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56188f8fb960 0x56188f8fd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda80aab640 1 -- 172.21.15.19:0/3403600376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56188f8e34a0 con 0x56188f8e4730 2024-09-12T02:05:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda812ac640 1 --2- 172.21.15.19:0/3403600376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56188f8258e0 0x56188f8e2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda80aab640 1 --2- 172.21.15.19:0/3403600376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56188f8e4730 0x56188f8fd000 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0098b0 tx=0x7fda6c005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150b1aa6c3d98083 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda7b7fe640 1 -- 172.21.15.19:0/3403600376 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c008930 con 0x56188f8e4730 2024-09-12T02:05:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.151+0000 7fda7b7fe640 1 -- 172.21.15.19:0/3403600376 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda6c018070 con 0x56188f8e4730 2024-09-12T02:05:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.152+0000 7fda7b7fe640 1 -- 172.21.15.19:0/3403600376 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c008cd0 con 0x56188f8e4730 2024-09-12T02:05:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.152+0000 7fda837b6f40 1 -- 172.21.15.19:0/3403600376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56188f8e4730 msgr2=0x56188f8fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.152+0000 7fda837b6f40 1 --2- 172.21.15.19:0/3403600376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56188f8e4730 0x56188f8fd000 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0098b0 tx=0x7fda6c005a00 comp rx=0 tx=0).stop 2024-09-12T02:05:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.152+0000 7fda837b6f40 1 -- 172.21.15.19:0/3403600376 shutdown_connections 2024-09-12T02:05:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.152+0000 7fda837b6f40 1 --2- 172.21.15.19:0/3403600376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56188f8fb960 0x56188f8fd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.152+0000 7fda837b6f40 1 --2- 172.21.15.19:0/3403600376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56188f8e4730 0x56188f8fd000 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.152+0000 7fda837b6f40 1 --2- 172.21.15.19:0/3403600376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56188f8258e0 0x56188f8e2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.152+0000 7fda837b6f40 1 -- 172.21.15.19:0/3403600376 >> 172.21.15.19:0/3403600376 conn(0x56188f826ad0 msgr2=0x56188f824be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.152+0000 7fda837b6f40 1 -- 172.21.15.19:0/3403600376 shutdown_connections 2024-09-12T02:05:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.152+0000 7fda837b6f40 1 -- 172.21.15.19:0/3403600376 wait complete. 2024-09-12T02:05:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.153+0000 7fda837b6f40 1 Processor -- start 2024-09-12T02:05:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.153+0000 7fda837b6f40 1 -- start start 2024-09-12T02:05:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.153+0000 7fda837b6f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56188f8258e0 0x56188f824dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.153+0000 7fda837b6f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56188f8e4730 0x56188f8fa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.153+0000 7fda837b6f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56188f8fb960 0x56188f8fa660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.153+0000 7fda837b6f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56188f827190 con 0x56188f8e4730 2024-09-12T02:05:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.153+0000 7fda837b6f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56188f826eb0 con 0x56188f8fb960 2024-09-12T02:05:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.153+0000 7fda837b6f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56188f86e380 con 0x56188f8258e0 2024-09-12T02:05:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.153+0000 7fda80aab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56188f8e4730 0x56188f8fa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.153+0000 7fda80aab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56188f8e4730 0x56188f8fa120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51448/0 (socket says 172.21.15.19:51448) 2024-09-12T02:05:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.154+0000 7fda80aab640 1 -- 172.21.15.19:0/1472687722 learned_addr learned my addr 172.21.15.19:0/1472687722 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.154+0000 7fda81aad640 1 --2- 172.21.15.19:0/1472687722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56188f8fb960 0x56188f8fa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.154+0000 7fda812ac640 1 --2- 172.21.15.19:0/1472687722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56188f8258e0 0x56188f824dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.154+0000 7fda80aab640 1 -- 172.21.15.19:0/1472687722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56188f8258e0 msgr2=0x56188f824dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.154+0000 7fda80aab640 1 --2- 172.21.15.19:0/1472687722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56188f8258e0 0x56188f824dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.154+0000 7fda80aab640 1 -- 172.21.15.19:0/1472687722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56188f8fb960 msgr2=0x56188f8fa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.154+0000 7fda80aab640 1 --2- 172.21.15.19:0/1472687722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56188f8fb960 0x56188f8fa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.154+0000 7fda80aab640 1 -- 172.21.15.19:0/1472687722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56188f8df210 con 0x56188f8e4730 2024-09-12T02:05:28.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.154+0000 7fda80aab640 1 --2- 172.21.15.19:0/1472687722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56188f8e4730 0x56188f8fa120 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fda6c005fd0 tx=0x7fda6c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:28.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.154+0000 7fda7a7fc640 1 -- 172.21.15.19:0/1472687722 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c013830 con 0x56188f8e4730 2024-09-12T02:05:28.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.154+0000 7fda7a7fc640 1 -- 172.21.15.19:0/1472687722 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda6c022070 con 0x56188f8e4730 2024-09-12T02:05:28.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.154+0000 7fda837b6f40 1 -- 172.21.15.19:0/1472687722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56188f84f8c0 con 0x56188f8e4730 2024-09-12T02:05:28.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.154+0000 7fda7a7fc640 1 -- 172.21.15.19:0/1472687722 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c013bf0 con 0x56188f8e4730 2024-09-12T02:05:28.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.154+0000 7fda837b6f40 1 -- 172.21.15.19:0/1472687722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56188f8fd160 con 0x56188f8e4730 2024-09-12T02:05:28.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.156+0000 7fda7a7fc640 1 -- 172.21.15.19:0/1472687722 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda6c01e410 con 0x56188f8e4730 2024-09-12T02:05:28.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.156+0000 7fda7a7fc640 1 --2- 172.21.15.19:0/1472687722 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fda6406a840 0x7fda6406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.156+0000 7fda7a7fc640 1 -- 172.21.15.19:0/1472687722 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7fda6c08c850 con 0x56188f8e4730 2024-09-12T02:05:28.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.156+0000 7fda812ac640 1 --2- 172.21.15.19:0/1472687722 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fda6406a840 0x7fda6406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.156+0000 7fda837b6f40 1 --2- 172.21.15.19:0/1472687722 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56188f8e3020 0x56188f84e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.156+0000 7fda837b6f40 1 -- 172.21.15.19:0/1472687722 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=104b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x56188f825310 con 0x56188f8e3020 2024-09-12T02:05:28.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.156+0000 7fda81aad640 1 --2- 172.21.15.19:0/1472687722 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56188f8e3020 0x56188f84e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.157+0000 7fda812ac640 1 --2- 172.21.15.19:0/1472687722 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fda6406a840 0x7fda6406cd00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x56188f8e3fc0 tx=0x7fda7c003870 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:28.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.157+0000 7fda81aad640 1 --2- 172.21.15.19:0/1472687722 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56188f8e3020 0x56188f84e020 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:28.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.158+0000 7fda81aad640 1 -- 172.21.15.19:0/1472687722 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v125'970 uv970 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fda7404f9b0 con 0x56188f8e3020 2024-09-12T02:05:28.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.158+0000 7fda837b6f40 1 -- 172.21.15.19:0/1472687722 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56188f8e3020 msgr2=0x56188f84e020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.158+0000 7fda837b6f40 1 --2- 172.21.15.19:0/1472687722 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56188f8e3020 0x56188f84e020 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.158+0000 7fda837b6f40 1 -- 172.21.15.19:0/1472687722 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fda6406a840 msgr2=0x7fda6406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.158+0000 7fda837b6f40 1 --2- 172.21.15.19:0/1472687722 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fda6406a840 0x7fda6406cd00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x56188f8e3fc0 tx=0x7fda7c003870 comp rx=0 tx=0).stop 2024-09-12T02:05:28.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.158+0000 7fda837b6f40 1 -- 172.21.15.19:0/1472687722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56188f8e4730 msgr2=0x56188f8fa120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.158+0000 7fda837b6f40 1 --2- 172.21.15.19:0/1472687722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56188f8e4730 0x56188f8fa120 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fda6c005fd0 tx=0x7fda6c003020 comp rx=0 tx=0).stop 2024-09-12T02:05:28.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.158+0000 7fda81aad640 1 -- 172.21.15.19:0/1472687722 reap_dead start 2024-09-12T02:05:28.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.158+0000 7fda837b6f40 1 -- 172.21.15.19:0/1472687722 shutdown_connections 2024-09-12T02:05:28.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.158+0000 7fda837b6f40 1 -- 172.21.15.19:0/1472687722 >> 172.21.15.19:0/1472687722 conn(0x56188f826ad0 msgr2=0x56188f84fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:28.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.158+0000 7fda837b6f40 1 -- 172.21.15.19:0/1472687722 shutdown_connections 2024-09-12T02:05:28.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.158+0000 7fda837b6f40 1 -- 172.21.15.19:0/1472687722 wait complete. 2024-09-12T02:05:28.163 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:05:28.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.268+0000 7f5796de4640 1 Processor -- start 2024-09-12T02:05:28.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.268+0000 7f5796de4640 1 -- start start 2024-09-12T02:05:28.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.269+0000 7f5796de4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f57900b5f80 0x7f5790162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.269+0000 7f5796de4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f57900d4c10 0x7f57900b6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.269+0000 7f5796de4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57900d2600 con 0x7f57900d3320 2024-09-12T02:05:28.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.269+0000 7f5796de4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f57900d5420 con 0x7f57900b5f80 2024-09-12T02:05:28.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.269+0000 7f5796de4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f57900d2e90 con 0x7f57900d4c10 2024-09-12T02:05:28.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.269+0000 7f5794b80640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f57900b5f80 0x7f5790162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.269+0000 7f5794b80640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f57900b5f80 0x7f5790162980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51464/0 (socket says 172.21.15.19:51464) 2024-09-12T02:05:28.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.269+0000 7f5794b80640 1 -- 172.21.15.19:0/3267526218 learned_addr learned my addr 172.21.15.19:0/3267526218 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:28.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.269+0000 7f5795381640 1 --1- 172.21.15.19:0/3267526218 >> v1:172.21.15.19:6789/0 conn(0x7f57900d3320 0x7f57900ceb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37104/0 (socket says 172.21.15.19:37104) 2024-09-12T02:05:28.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.269+0000 7f578ffff640 1 --2- 172.21.15.19:0/3267526218 >> v2:172.21.15.135:3300/0 conn(0x7f57900d4c10 0x7f57900b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.269+0000 7f5794b80640 1 -- 172.21.15.19:0/3267526218 >> v2:172.21.15.135:3300/0 conn(0x7f57900d4c10 msgr2=0x7f57900b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:28.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.269+0000 7f5794b80640 1 --2- 172.21.15.19:0/3267526218 >> v2:172.21.15.135:3300/0 conn(0x7f57900d4c10 0x7f57900b6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.269+0000 7f5794b80640 1 -- 172.21.15.19:0/3267526218 >> v1:172.21.15.19:6789/0 conn(0x7f57900d3320 legacy=0x7f57900ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.269+0000 7f5794b80640 1 -- 172.21.15.19:0/3267526218 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57900b3c10 con 0x7f57900b5f80 2024-09-12T02:05:28.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.270+0000 7f5794b80640 1 --2- 172.21.15.19:0/3267526218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57900b5f80 0x7f5790162980 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f5780009e50 tx=0x7f578002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cf4fcb8fc4f8f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:28.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.270+0000 7f578f7fe640 1 -- 172.21.15.19:0/3267526218 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780036070 con 0x7f57900b5f80 2024-09-12T02:05:28.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.270+0000 7f578f7fe640 1 -- 172.21.15.19:0/3267526218 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5780031600 con 0x7f57900b5f80 2024-09-12T02:05:28.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.270+0000 7f578f7fe640 1 -- 172.21.15.19:0/3267526218 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57800319d0 con 0x7f57900b5f80 2024-09-12T02:05:28.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.271+0000 7f5796de4640 1 -- 172.21.15.19:0/3267526218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57900b5f80 msgr2=0x7f5790162980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.271+0000 7f5796de4640 1 --2- 172.21.15.19:0/3267526218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57900b5f80 0x7f5790162980 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f5780009e50 tx=0x7f578002a760 comp rx=0 tx=0).stop 2024-09-12T02:05:28.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.271+0000 7f5796de4640 1 -- 172.21.15.19:0/3267526218 shutdown_connections 2024-09-12T02:05:28.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.271+0000 7f5796de4640 1 --2- 172.21.15.19:0/3267526218 >> v2:172.21.15.135:3300/0 conn(0x7f57900d4c10 0x7f57900b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.271+0000 7f5796de4640 1 --2- 172.21.15.19:0/3267526218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57900b5f80 0x7f5790162980 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.271+0000 7f5796de4640 1 -- 172.21.15.19:0/3267526218 >> 172.21.15.19:0/3267526218 conn(0x7f579008bfc0 msgr2=0x7f57900d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:28.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.271+0000 7f5796de4640 1 -- 172.21.15.19:0/3267526218 shutdown_connections 2024-09-12T02:05:28.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.271+0000 7f5796de4640 1 -- 172.21.15.19:0/3267526218 wait complete. 2024-09-12T02:05:28.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.272+0000 7f5796de4640 1 Processor -- start 2024-09-12T02:05:28.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.272+0000 7f5796de4640 1 -- start start 2024-09-12T02:05:28.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.273+0000 7f5796de4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57900b5f80 0x7f57900b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.273+0000 7f5796de4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57900d3320 0x7f57900b9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.273+0000 7f5796de4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57900d4c10 0x7f5790153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.273+0000 7f5796de4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f57900d5140 con 0x7f57900d4c10 2024-09-12T02:05:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.273+0000 7f5796de4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f57900d2880 con 0x7f57900b5f80 2024-09-12T02:05:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.273+0000 7f5796de4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f57900d2b20 con 0x7f57900d3320 2024-09-12T02:05:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.273+0000 7f5795381640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57900d4c10 0x7f5790153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.273+0000 7f5795381640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57900d4c10 0x7f5790153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51480/0 (socket says 172.21.15.19:51480) 2024-09-12T02:05:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.273+0000 7f5795381640 1 -- 172.21.15.19:0/3099615888 learned_addr learned my addr 172.21.15.19:0/3099615888 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.273+0000 7f5794b80640 1 --2- 172.21.15.19:0/3099615888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57900b5f80 0x7f57900b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.273+0000 7f578ffff640 1 --2- 172.21.15.19:0/3099615888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57900d3320 0x7f57900b9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.273+0000 7f5795381640 1 -- 172.21.15.19:0/3099615888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57900d3320 msgr2=0x7f57900b9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.273+0000 7f5795381640 1 --2- 172.21.15.19:0/3099615888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57900d3320 0x7f57900b9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.273+0000 7f5795381640 1 -- 172.21.15.19:0/3099615888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57900b5f80 msgr2=0x7f57900b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.273+0000 7f5795381640 1 --2- 172.21.15.19:0/3099615888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57900b5f80 0x7f57900b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.273+0000 7f5795381640 1 -- 172.21.15.19:0/3099615888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5790154230 con 0x7f57900d4c10 2024-09-12T02:05:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.274+0000 7f5795381640 1 --2- 172.21.15.19:0/3099615888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57900d4c10 0x7f5790153560 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f578800c400 tx=0x7f578800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.274+0000 7f578d7fa640 1 -- 172.21.15.19:0/3099615888 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57880074e0 con 0x7f57900d4c10 2024-09-12T02:05:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.274+0000 7f578d7fa640 1 -- 172.21.15.19:0/3099615888 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5788007680 con 0x7f57900d4c10 2024-09-12T02:05:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.274+0000 7f5796de4640 1 -- 172.21.15.19:0/3099615888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5790154520 con 0x7f57900d4c10 2024-09-12T02:05:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.274+0000 7f578d7fa640 1 -- 172.21.15.19:0/3099615888 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57880049e0 con 0x7f57900d4c10 2024-09-12T02:05:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.274+0000 7f5796de4640 1 -- 172.21.15.19:0/3099615888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5790154d60 con 0x7f57900d4c10 2024-09-12T02:05:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.275+0000 7f5796de4640 1 -- 172.21.15.19:0/3099615888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57900b6360 con 0x7f57900d4c10 2024-09-12T02:05:28.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.275+0000 7f578d7fa640 1 -- 172.21.15.19:0/3099615888 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f578801a020 con 0x7f57900d4c10 2024-09-12T02:05:28.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.276+0000 7f578d7fa640 1 --2- 172.21.15.19:0/3099615888 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f577006be30 0x7f577006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.276+0000 7f578d7fa640 1 -- 172.21.15.19:0/3099615888 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7f578808b1e0 con 0x7f57900d4c10 2024-09-12T02:05:28.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.276+0000 7f5794b80640 1 --2- 172.21.15.19:0/3099615888 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f577006be30 0x7f577006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.276+0000 7f5794b80640 1 --2- 172.21.15.19:0/3099615888 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f577006be30 0x7f577006e2f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f5780033000 tx=0x7f5780009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:28.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.280+0000 7f578d7fa640 1 -- 172.21.15.19:0/3099615888 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5790154520 con 0x7f57900d4c10 2024-09-12T02:05:28.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.493+0000 7f5796de4640 1 -- 172.21.15.19:0/3099615888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f57901e9da0 con 0x7f57900d4c10 2024-09-12T02:05:28.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.885+0000 7f578d7fa640 1 -- 172.21.15.19:0/3099615888 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v260) ==== 162+0+0 (secure 0 0 0) 0x7f57900d2600 con 0x7f57900d4c10 2024-09-12T02:05:28.885 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:05:28.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.887+0000 7f5796de4640 1 -- 172.21.15.19:0/3099615888 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f577006be30 msgr2=0x7f577006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.887+0000 7f5796de4640 1 --2- 172.21.15.19:0/3099615888 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f577006be30 0x7f577006e2f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f5780033000 tx=0x7f5780009000 comp rx=0 tx=0).stop 2024-09-12T02:05:28.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.887+0000 7f5796de4640 1 -- 172.21.15.19:0/3099615888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57900d4c10 msgr2=0x7f5790153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.887+0000 7f5796de4640 1 --2- 172.21.15.19:0/3099615888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57900d4c10 0x7f5790153560 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f578800c400 tx=0x7f578800c8c0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.887+0000 7f5796de4640 1 -- 172.21.15.19:0/3099615888 shutdown_connections 2024-09-12T02:05:28.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.887+0000 7f5796de4640 1 --2- 172.21.15.19:0/3099615888 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f577006be30 0x7f577006e2f0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.887+0000 7f5796de4640 1 --2- 172.21.15.19:0/3099615888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57900d4c10 0x7f5790153560 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.887+0000 7f5796de4640 1 --2- 172.21.15.19:0/3099615888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57900d3320 0x7f57900b9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.887+0000 7f5796de4640 1 --2- 172.21.15.19:0/3099615888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57900b5f80 0x7f57900b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.887+0000 7f5796de4640 1 -- 172.21.15.19:0/3099615888 >> 172.21.15.19:0/3099615888 conn(0x7f579008bfc0 msgr2=0x7f57900b40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:28.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.887+0000 7f5796de4640 1 -- 172.21.15.19:0/3099615888 shutdown_connections 2024-09-12T02:05:28.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:28.887+0000 7f5796de4640 1 -- 172.21.15.19:0/3099615888 wait complete. 2024-09-12T02:05:29.304 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:29.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.420+0000 7fc9dddd6640 1 Processor -- start 2024-09-12T02:05:29.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.420+0000 7fc9dddd6640 1 -- start start 2024-09-12T02:05:29.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.421+0000 7fc9dddd6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc9d80b6680 0x7fc9d8169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:29.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.421+0000 7fc9dddd6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9d806d9f0 con 0x7fc9d8162060 2024-09-12T02:05:29.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.421+0000 7fc9dddd6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9d806dcd0 con 0x7fc9d8161c80 2024-09-12T02:05:29.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.421+0000 7fc9dddd6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fc9d806dfb0 con 0x7fc9d80b6680 2024-09-12T02:05:29.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.421+0000 7fc9d6ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc9d8162060 0x7fc9d80b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37112/0 (socket says 172.21.15.19:37112) 2024-09-12T02:05:29.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.421+0000 7fc9d7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc9d80b6680 0x7fc9d8169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:29.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.421+0000 7fc9d6ffd640 1 -- 172.21.15.19:0/3580834915 learned_addr learned my addr 172.21.15.19:0/3580834915 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:29.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.421+0000 7fc9d7fff640 1 -- 172.21.15.19:0/3580834915 >> v1:172.21.15.135:6789/0 conn(0x7fc9d8161c80 legacy=0x7fc9d806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:29.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.421+0000 7fc9d7fff640 1 -- 172.21.15.19:0/3580834915 >> v1:172.21.15.19:6789/0 conn(0x7fc9d8162060 legacy=0x7fc9d80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:29.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.421+0000 7fc9d7fff640 1 -- 172.21.15.19:0/3580834915 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d80d01f0 con 0x7fc9d80b6680 2024-09-12T02:05:29.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.421+0000 7fc9d67fc640 1 -- 172.21.15.19:0/3580834915 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2811961564 0 0) 0x7fc9d806d9f0 con 0x7fc9d8162060 2024-09-12T02:05:29.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.422+0000 7fc9d7fff640 1 --2- 172.21.15.19:0/3580834915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d80b6680 0x7fc9d8169830 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0009d90 tx=0x7fc9d002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd2ae068df453ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:29.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.422+0000 7fc9d67fc640 1 -- 172.21.15.19:0/3580834915 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0007740 con 0x7fc9d80b6680 2024-09-12T02:05:29.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.422+0000 7fc9d67fc640 1 -- 172.21.15.19:0/3580834915 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d00078e0 con 0x7fc9d80b6680 2024-09-12T02:05:29.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.422+0000 7fc9d67fc640 1 -- 172.21.15.19:0/3580834915 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0007cb0 con 0x7fc9d80b6680 2024-09-12T02:05:29.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.423+0000 7fc9dddd6640 1 -- 172.21.15.19:0/3580834915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d80b6680 msgr2=0x7fc9d8169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:29.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.423+0000 7fc9dddd6640 1 --2- 172.21.15.19:0/3580834915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d80b6680 0x7fc9d8169830 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0009d90 tx=0x7fc9d002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:05:29.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.423+0000 7fc9dddd6640 1 -- 172.21.15.19:0/3580834915 shutdown_connections 2024-09-12T02:05:29.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.423+0000 7fc9dddd6640 1 --2- 172.21.15.19:0/3580834915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d80b6680 0x7fc9d8169830 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:29.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.423+0000 7fc9dddd6640 1 -- 172.21.15.19:0/3580834915 >> 172.21.15.19:0/3580834915 conn(0x7fc9d80d44f0 msgr2=0x7fc9d80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:29.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.423+0000 7fc9dddd6640 1 -- 172.21.15.19:0/3580834915 shutdown_connections 2024-09-12T02:05:29.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.423+0000 7fc9dddd6640 1 -- 172.21.15.19:0/3580834915 wait complete. 2024-09-12T02:05:29.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.424+0000 7fc9dddd6640 1 Processor -- start 2024-09-12T02:05:29.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.424+0000 7fc9dddd6640 1 -- start start 2024-09-12T02:05:29.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.425+0000 7fc9dddd6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9d80b6680 0x7fc9d80c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:29.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.425+0000 7fc9dddd6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9d8161c80 0x7fc9d80ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:29.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.425+0000 7fc9dddd6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d8162060 0x7fc9d80cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:29.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.425+0000 7fc9dddd6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d80b6cb0 con 0x7fc9d8162060 2024-09-12T02:05:29.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.425+0000 7fc9dddd6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d80b6b30 con 0x7fc9d8161c80 2024-09-12T02:05:29.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.425+0000 7fc9dddd6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc9d8169d70 con 0x7fc9d80b6680 2024-09-12T02:05:29.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.425+0000 7fc9d7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d8162060 0x7fc9d80cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:29.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.425+0000 7fc9d7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d8162060 0x7fc9d80cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51496/0 (socket says 172.21.15.19:51496) 2024-09-12T02:05:29.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.425+0000 7fc9d7fff640 1 -- 172.21.15.19:0/878285286 learned_addr learned my addr 172.21.15.19:0/878285286 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:29.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.425+0000 7fc9d6ffd640 1 --2- 172.21.15.19:0/878285286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9d8161c80 0x7fc9d80ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:29.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.425+0000 7fc9d77fe640 1 --2- 172.21.15.19:0/878285286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9d80b6680 0x7fc9d80c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:29.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.425+0000 7fc9d7fff640 1 -- 172.21.15.19:0/878285286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9d80b6680 msgr2=0x7fc9d80c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:29.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.425+0000 7fc9d7fff640 1 --2- 172.21.15.19:0/878285286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9d80b6680 0x7fc9d80c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:29.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.425+0000 7fc9d7fff640 1 -- 172.21.15.19:0/878285286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9d8161c80 msgr2=0x7fc9d80ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:29.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.425+0000 7fc9d7fff640 1 --2- 172.21.15.19:0/878285286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9d8161c80 0x7fc9d80ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:29.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.425+0000 7fc9d7fff640 1 -- 172.21.15.19:0/878285286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d80c8730 con 0x7fc9d8162060 2024-09-12T02:05:29.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.425+0000 7fc9d77fe640 1 --2- 172.21.15.19:0/878285286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9d80b6680 0x7fc9d80c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:29.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.426+0000 7fc9d7fff640 1 --2- 172.21.15.19:0/878285286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d8162060 0x7fc9d80cb5c0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0009d90 tx=0x7fc9d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:29.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.426+0000 7fc9cffff640 1 -- 172.21.15.19:0/878285286 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d003f070 con 0x7fc9d8162060 2024-09-12T02:05:29.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.426+0000 7fc9cffff640 1 -- 172.21.15.19:0/878285286 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d0031c90 con 0x7fc9d8162060 2024-09-12T02:05:29.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.426+0000 7fc9dddd6640 1 -- 172.21.15.19:0/878285286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d80c8a10 con 0x7fc9d8162060 2024-09-12T02:05:29.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.426+0000 7fc9cffff640 1 -- 172.21.15.19:0/878285286 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0043630 con 0x7fc9d8162060 2024-09-12T02:05:29.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.426+0000 7fc9dddd6640 1 -- 172.21.15.19:0/878285286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d80c8cf0 con 0x7fc9d8162060 2024-09-12T02:05:29.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.427+0000 7fc9dddd6640 1 -- 172.21.15.19:0/878285286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9d80b5f70 con 0x7fc9d8162060 2024-09-12T02:05:29.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.427+0000 7fc9cffff640 1 -- 172.21.15.19:0/878285286 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc9d003b410 con 0x7fc9d8162060 2024-09-12T02:05:29.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.428+0000 7fc9cffff640 1 --2- 172.21.15.19:0/878285286 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc9b806be30 0x7fc9b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:29.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.428+0000 7fc9cffff640 1 -- 172.21.15.19:0/878285286 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7fc9d00ad0c0 con 0x7fc9d8162060 2024-09-12T02:05:29.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.428+0000 7fc9d77fe640 1 --2- 172.21.15.19:0/878285286 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc9b806be30 0x7fc9b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:29.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.429+0000 7fc9d77fe640 1 --2- 172.21.15.19:0/878285286 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc9b806be30 0x7fc9b806e2f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8000f60 tx=0x7fc9c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:29.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.432+0000 7fc9cffff640 1 -- 172.21.15.19:0/878285286 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc9d007af00 con 0x7fc9d8162060 2024-09-12T02:05:29.616 INFO:tasks.ceph.mds.d.smithi135.stderr: -46> 2024-09-12T02:05:24.865+0000 7f608fe4c640 -1 mds.0.cache.ino(0x100) No data while reading inode 0x100 2024-09-12T02:05:29.616 INFO:tasks.ceph.mds.d.smithi135.stderr: -36> 2024-09-12T02:05:24.865+0000 7f608fe4c640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2024-09-12T02:05:29.642 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T02:05:29.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.647+0000 7fc9dddd6640 1 -- 172.21.15.19:0/878285286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9d80ba470 con 0x7fc9d8162060 2024-09-12T02:05:29.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.648+0000 7fc9cffff640 1 -- 172.21.15.19:0/878285286 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 261 v261) ==== 95+0+4398 (secure 0 0 0) 0x7fc9d007a800 con 0x7fc9d8162060 2024-09-12T02:05:29.648 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:29.648 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":261,"btime":"2024-09-12T02:05:28:887952+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":261,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:28.887942+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"c","rank":0,"incarnation":261,"state":"up:replay","state_seq":1,"addr":"172.21.15.19:6834/3818656517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3818656517},{"type":"v1","addr":"172.21.15.19:6834","nonce":3818656517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:29.649 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 261 2024-09-12T02:05:29.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.650+0000 7fc9dddd6640 1 -- 172.21.15.19:0/878285286 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc9b806be30 msgr2=0x7fc9b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:29.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.650+0000 7fc9dddd6640 1 --2- 172.21.15.19:0/878285286 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc9b806be30 0x7fc9b806e2f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8000f60 tx=0x7fc9c8009040 comp rx=0 tx=0).stop 2024-09-12T02:05:29.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.650+0000 7fc9dddd6640 1 -- 172.21.15.19:0/878285286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d8162060 msgr2=0x7fc9d80cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:29.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.650+0000 7fc9dddd6640 1 --2- 172.21.15.19:0/878285286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d8162060 0x7fc9d80cb5c0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0009d90 tx=0x7fc9d0004a40 comp rx=0 tx=0).stop 2024-09-12T02:05:29.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.650+0000 7fc9dddd6640 1 -- 172.21.15.19:0/878285286 shutdown_connections 2024-09-12T02:05:29.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.650+0000 7fc9dddd6640 1 --2- 172.21.15.19:0/878285286 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc9b806be30 0x7fc9b806e2f0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:29.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.650+0000 7fc9dddd6640 1 --2- 172.21.15.19:0/878285286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d8162060 0x7fc9d80cb5c0 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:29.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.650+0000 7fc9dddd6640 1 --2- 172.21.15.19:0/878285286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9d8161c80 0x7fc9d80ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:29.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.650+0000 7fc9dddd6640 1 --2- 172.21.15.19:0/878285286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9d80b6680 0x7fc9d80c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:29.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.650+0000 7fc9dddd6640 1 -- 172.21.15.19:0/878285286 >> 172.21.15.19:0/878285286 conn(0x7fc9d80d44f0 msgr2=0x7fc9d815d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:29.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.650+0000 7fc9dddd6640 1 -- 172.21.15.19:0/878285286 shutdown_connections 2024-09-12T02:05:29.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:29.650+0000 7fc9dddd6640 1 -- 172.21.15.19:0/878285286 wait complete. 2024-09-12T02:05:29.662 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 261, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:05:28.887942+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 125, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9711}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9711': {'gid': 9711, 'name': 'c', 'rank': 0, 'incarnation': 261, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.19:6834/3818656517', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 3818656517}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 3818656517}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:05:29.662 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9711:up:replay 2024-09-12T02:05:29.662 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-12T02:05:35.066 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:35.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.182+0000 7f04c0ec9640 1 Processor -- start 2024-09-12T02:05:35.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.182+0000 7f04c0ec9640 1 -- start start 2024-09-12T02:05:35.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.183+0000 7f04c0ec9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04bc165260 0x7f04bc167650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.183+0000 7f04c0ec9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04bc0d01c0 con 0x7f04bc15c870 2024-09-12T02:05:35.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.183+0000 7f04c0ec9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04bc0d04a0 con 0x7f04bc15c490 2024-09-12T02:05:35.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.183+0000 7f04c0ec9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f04bc0cff70 con 0x7f04bc165260 2024-09-12T02:05:35.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.183+0000 7f04b9d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f04bc15c870 0x7f04bc15cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53958/0 (socket says 172.21.15.19:53958) 2024-09-12T02:05:35.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.183+0000 7f04b9d9b640 1 -- 172.21.15.19:0/2333547798 learned_addr learned my addr 172.21.15.19:0/2333547798 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:35.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.183+0000 7f04bad9d640 1 --2- 172.21.15.19:0/2333547798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04bc165260 0x7f04bc167650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.184+0000 7f04b959a640 1 -- 172.21.15.19:0/2333547798 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 699562855 0 0) 0x7f04bc0d01c0 con 0x7f04bc15c870 2024-09-12T02:05:35.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.184+0000 7f04b959a640 1 -- 172.21.15.19:0/2333547798 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04a4003520 con 0x7f04bc15c870 2024-09-12T02:05:35.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.184+0000 7f04b959a640 1 -- 172.21.15.19:0/2333547798 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2420573291 0 0) 0x7f04bc0d04a0 con 0x7f04bc15c490 2024-09-12T02:05:35.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.184+0000 7f04b959a640 1 -- 172.21.15.19:0/2333547798 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04bc0d01c0 con 0x7f04bc15c490 2024-09-12T02:05:35.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.184+0000 7f04bad9d640 1 -- 172.21.15.19:0/2333547798 >> v1:172.21.15.135:6789/0 conn(0x7f04bc15c490 legacy=0x7f04bc09b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.184+0000 7f04bad9d640 1 -- 172.21.15.19:0/2333547798 >> v1:172.21.15.19:6789/0 conn(0x7f04bc15c870 legacy=0x7f04bc15cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.184+0000 7f04bad9d640 1 -- 172.21.15.19:0/2333547798 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04bc0d0780 con 0x7f04bc165260 2024-09-12T02:05:35.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.185+0000 7f04bad9d640 1 --2- 172.21.15.19:0/2333547798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04bc165260 0x7f04bc167650 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f04b4009dc0 tx=0x7f04b402a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1053d6541ee942ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:35.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.185+0000 7f04b959a640 1 -- 172.21.15.19:0/2333547798 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b4007740 con 0x7f04bc165260 2024-09-12T02:05:35.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.185+0000 7f04b959a640 1 -- 172.21.15.19:0/2333547798 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b40078e0 con 0x7f04bc165260 2024-09-12T02:05:35.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.185+0000 7f04b959a640 1 -- 172.21.15.19:0/2333547798 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b4007cb0 con 0x7f04bc165260 2024-09-12T02:05:35.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.185+0000 7f04c0ec9640 1 -- 172.21.15.19:0/2333547798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04bc165260 msgr2=0x7f04bc167650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.185+0000 7f04c0ec9640 1 --2- 172.21.15.19:0/2333547798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04bc165260 0x7f04bc167650 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f04b4009dc0 tx=0x7f04b402a760 comp rx=0 tx=0).stop 2024-09-12T02:05:35.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.186+0000 7f04c0ec9640 1 -- 172.21.15.19:0/2333547798 shutdown_connections 2024-09-12T02:05:35.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.186+0000 7f04c0ec9640 1 --2- 172.21.15.19:0/2333547798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04bc165260 0x7f04bc167650 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.186+0000 7f04c0ec9640 1 -- 172.21.15.19:0/2333547798 >> 172.21.15.19:0/2333547798 conn(0x7f04bc0d23a0 msgr2=0x7f04bc0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:35.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.186+0000 7f04c0ec9640 1 -- 172.21.15.19:0/2333547798 shutdown_connections 2024-09-12T02:05:35.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.186+0000 7f04c0ec9640 1 -- 172.21.15.19:0/2333547798 wait complete. 2024-09-12T02:05:35.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.187+0000 7f04c0ec9640 1 Processor -- start 2024-09-12T02:05:35.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.187+0000 7f04c0ec9640 1 -- start start 2024-09-12T02:05:35.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.188+0000 7f04c0ec9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04bc15c490 0x7f04bc156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.188+0000 7f04c0ec9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04bc15c870 0x7f04bc0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.188+0000 7f04c0ec9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04bc165260 0x7f04bc0c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.188+0000 7f04c0ec9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc0cdfa0 con 0x7f04bc15c870 2024-09-12T02:05:35.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.188+0000 7f04c0ec9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc0d0dd0 con 0x7f04bc15c490 2024-09-12T02:05:35.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.188+0000 7f04c0ec9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f04bc0d1260 con 0x7f04bc165260 2024-09-12T02:05:35.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.188+0000 7f04b9d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04bc15c870 0x7f04bc0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.188+0000 7f04b9d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04bc15c870 0x7f04bc0b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54806/0 (socket says 172.21.15.19:54806) 2024-09-12T02:05:35.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.188+0000 7f04b9d9b640 1 -- 172.21.15.19:0/2548689019 learned_addr learned my addr 172.21.15.19:0/2548689019 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:35.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.188+0000 7f04ba59c640 1 --2- 172.21.15.19:0/2548689019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04bc15c490 0x7f04bc156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.188+0000 7f04bad9d640 1 --2- 172.21.15.19:0/2548689019 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04bc165260 0x7f04bc0c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.188+0000 7f04b9d9b640 1 -- 172.21.15.19:0/2548689019 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04bc165260 msgr2=0x7f04bc0c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.188+0000 7f04b9d9b640 1 --2- 172.21.15.19:0/2548689019 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04bc165260 0x7f04bc0c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.188+0000 7f04b9d9b640 1 -- 172.21.15.19:0/2548689019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04bc15c490 msgr2=0x7f04bc156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.188+0000 7f04b9d9b640 1 --2- 172.21.15.19:0/2548689019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04bc15c490 0x7f04bc156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.188+0000 7f04b9d9b640 1 -- 172.21.15.19:0/2548689019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04bc0cab40 con 0x7f04bc15c870 2024-09-12T02:05:35.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.188+0000 7f04b9d9b640 1 --2- 172.21.15.19:0/2548689019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04bc15c870 0x7f04bc0b5f80 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f04b000c530 tx=0x7f04b000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:35.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.189+0000 7f04aaffd640 1 -- 172.21.15.19:0/2548689019 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0017070 con 0x7f04bc15c870 2024-09-12T02:05:35.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.189+0000 7f04aaffd640 1 -- 172.21.15.19:0/2548689019 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b0005ce0 con 0x7f04bc15c870 2024-09-12T02:05:35.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.189+0000 7f04aaffd640 1 -- 172.21.15.19:0/2548689019 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0007270 con 0x7f04bc15c870 2024-09-12T02:05:35.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.189+0000 7f04c0ec9640 1 -- 172.21.15.19:0/2548689019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04bc0cae20 con 0x7f04bc15c870 2024-09-12T02:05:35.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.189+0000 7f04c0ec9640 1 -- 172.21.15.19:0/2548689019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04bc0cb3e0 con 0x7f04bc15c870 2024-09-12T02:05:35.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.190+0000 7f04c0ec9640 1 -- 172.21.15.19:0/2548689019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04bc0d04a0 con 0x7f04bc15c870 2024-09-12T02:05:35.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.190+0000 7f04aaffd640 1 -- 172.21.15.19:0/2548689019 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f04b001a070 con 0x7f04bc15c870 2024-09-12T02:05:35.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.191+0000 7f04aaffd640 1 --2- 172.21.15.19:0/2548689019 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f049c06be30 0x7f049c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.191+0000 7f04aaffd640 1 -- 172.21.15.19:0/2548689019 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7f04b008ada0 con 0x7f04bc15c870 2024-09-12T02:05:35.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.191+0000 7f04ba59c640 1 --2- 172.21.15.19:0/2548689019 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f049c06be30 0x7f049c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.192+0000 7f04ba59c640 1 --2- 172.21.15.19:0/2548689019 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f049c06be30 0x7f049c06e2f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0011e0 tx=0x7f04ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.196+0000 7f04aaffd640 1 -- 172.21.15.19:0/2548689019 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f04b00584d0 con 0x7f04bc15c870 2024-09-12T02:05:35.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.410+0000 7f04c0ec9640 1 -- 172.21.15.19:0/2548689019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04bc164730 con 0x7f04bc15c870 2024-09-12T02:05:35.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.410+0000 7f04aaffd640 1 -- 172.21.15.19:0/2548689019 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 264 v264) ==== 95+0+5234 (secure 0 0 0) 0x7f04b005c7d0 con 0x7f04bc15c870 2024-09-12T02:05:35.411 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:35.411 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":264,"btime":"2024-09-12T02:05:31:897961+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":264,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:31.897954+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"c","rank":0,"incarnation":261,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6834/3818656517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3818656517},{"type":"v1","addr":"172.21.15.19:6834","nonce":3818656517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9711,"qdb_cluster":[9711]},"id":6}]} 2024-09-12T02:05:35.411 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 264 2024-09-12T02:05:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.412+0000 7f04c0ec9640 1 -- 172.21.15.19:0/2548689019 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f049c06be30 msgr2=0x7f049c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.412+0000 7f04c0ec9640 1 --2- 172.21.15.19:0/2548689019 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f049c06be30 0x7f049c06e2f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0011e0 tx=0x7f04ac009040 comp rx=0 tx=0).stop 2024-09-12T02:05:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.412+0000 7f04c0ec9640 1 -- 172.21.15.19:0/2548689019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04bc15c870 msgr2=0x7f04bc0b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.412+0000 7f04c0ec9640 1 --2- 172.21.15.19:0/2548689019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04bc15c870 0x7f04bc0b5f80 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f04b000c530 tx=0x7f04b000c9f0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.412+0000 7f04c0ec9640 1 -- 172.21.15.19:0/2548689019 shutdown_connections 2024-09-12T02:05:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.412+0000 7f04c0ec9640 1 --2- 172.21.15.19:0/2548689019 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f049c06be30 0x7f049c06e2f0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.412+0000 7f04c0ec9640 1 --2- 172.21.15.19:0/2548689019 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04bc165260 0x7f04bc0c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.412+0000 7f04c0ec9640 1 --2- 172.21.15.19:0/2548689019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04bc15c870 0x7f04bc0b5f80 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.412+0000 7f04c0ec9640 1 --2- 172.21.15.19:0/2548689019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04bc15c490 0x7f04bc156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.412+0000 7f04c0ec9640 1 -- 172.21.15.19:0/2548689019 >> 172.21.15.19:0/2548689019 conn(0x7f04bc0d23a0 msgr2=0x7f04bc071510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:35.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.412+0000 7f04c0ec9640 1 -- 172.21.15.19:0/2548689019 shutdown_connections 2024-09-12T02:05:35.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.412+0000 7f04c0ec9640 1 -- 172.21.15.19:0/2548689019 wait complete. 2024-09-12T02:05:35.424 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 264, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:05:31.897954+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 125, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9711}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9711': {'gid': 9711, 'name': 'c', 'rank': 0, 'incarnation': 261, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.19:6834/3818656517', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 3818656517}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 3818656517}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9711, 'qdb_cluster': [9711]} 2024-09-12T02:05:35.424 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:05:35.424 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T02:05:35.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.527+0000 7f81616a4640 1 Processor -- start 2024-09-12T02:05:35.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.527+0000 7f81616a4640 1 -- start start 2024-09-12T02:05:35.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.528+0000 7f81616a4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f815c0d1540 0x7f815c06dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.528+0000 7f81616a4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f815c09b690 0x7f815c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.528+0000 7f81616a4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f815c0d1970 con 0x7f815c15e740 2024-09-12T02:05:35.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.528+0000 7f81616a4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f815c15eb20 con 0x7f815c09b690 2024-09-12T02:05:35.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.528+0000 7f81616a4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f815c06d260 con 0x7f815c0d1540 2024-09-12T02:05:35.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.528+0000 7f815b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f815c09b690 0x7f815c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.528+0000 7f815b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f815c09b690 0x7f815c06cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54812/0 (socket says 172.21.15.19:54812) 2024-09-12T02:05:35.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.528+0000 7f815affd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f815c15e740 0x7f815c06d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53966/0 (socket says 172.21.15.19:53966) 2024-09-12T02:05:35.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.528+0000 7f815b7fe640 1 -- 172.21.15.19:0/4202455591 learned_addr learned my addr 172.21.15.19:0/4202455591 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:35.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.528+0000 7f815a7fc640 1 --2- 172.21.15.19:0/4202455591 >> v2:172.21.15.135:3300/0 conn(0x7f815c0d1540 0x7f815c06dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.528+0000 7f815b7fe640 1 -- 172.21.15.19:0/4202455591 >> v2:172.21.15.135:3300/0 conn(0x7f815c0d1540 msgr2=0x7f815c06dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:35.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.528+0000 7f815b7fe640 1 --2- 172.21.15.19:0/4202455591 >> v2:172.21.15.135:3300/0 conn(0x7f815c0d1540 0x7f815c06dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.528+0000 7f815b7fe640 1 -- 172.21.15.19:0/4202455591 >> v1:172.21.15.19:6789/0 conn(0x7f815c15e740 legacy=0x7f815c06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.528+0000 7f8159ffb640 1 -- 172.21.15.19:0/4202455591 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3878039316 0 0) 0x7f815c0d1970 con 0x7f815c15e740 2024-09-12T02:05:35.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.528+0000 7f815b7fe640 1 -- 172.21.15.19:0/4202455591 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815c0d0780 con 0x7f815c09b690 2024-09-12T02:05:35.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.528+0000 7f815a7fc640 1 --2- 172.21.15.19:0/4202455591 >> v2:172.21.15.135:3300/0 conn(0x7f815c0d1540 0x7f815c06dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:35.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.529+0000 7f815b7fe640 1 --2- 172.21.15.19:0/4202455591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815c09b690 0x7f815c06cd20 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f815c163240 tx=0x7f815402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4e0e374bda556e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:35.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.529+0000 7f8159ffb640 1 -- 172.21.15.19:0/4202455591 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8154036070 con 0x7f815c09b690 2024-09-12T02:05:35.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.529+0000 7f8159ffb640 1 -- 172.21.15.19:0/4202455591 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8154031600 con 0x7f815c09b690 2024-09-12T02:05:35.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.529+0000 7f8159ffb640 1 -- 172.21.15.19:0/4202455591 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81540319f0 con 0x7f815c09b690 2024-09-12T02:05:35.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.529+0000 7f81616a4640 1 -- 172.21.15.19:0/4202455591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815c09b690 msgr2=0x7f815c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.529+0000 7f81616a4640 1 --2- 172.21.15.19:0/4202455591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815c09b690 0x7f815c06cd20 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f815c163240 tx=0x7f815402a7c0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.530+0000 7f81616a4640 1 -- 172.21.15.19:0/4202455591 shutdown_connections 2024-09-12T02:05:35.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.530+0000 7f81616a4640 1 --2- 172.21.15.19:0/4202455591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815c09b690 0x7f815c06cd20 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.530+0000 7f81616a4640 1 --2- 172.21.15.19:0/4202455591 >> v2:172.21.15.135:3300/0 conn(0x7f815c0d1540 0x7f815c06dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.530+0000 7f81616a4640 1 -- 172.21.15.19:0/4202455591 >> 172.21.15.19:0/4202455591 conn(0x7f815c0d23a0 msgr2=0x7f815c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:35.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.530+0000 7f81616a4640 1 -- 172.21.15.19:0/4202455591 shutdown_connections 2024-09-12T02:05:35.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.530+0000 7f81616a4640 1 -- 172.21.15.19:0/4202455591 wait complete. 2024-09-12T02:05:35.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.531+0000 7f81616a4640 1 Processor -- start 2024-09-12T02:05:35.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.531+0000 7f81616a4640 1 -- start start 2024-09-12T02:05:35.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.532+0000 7f81616a4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f815c09b690 0x7f815c1528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.532+0000 7f81616a4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815c0d1540 0x7f815c0b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.532+0000 7f81616a4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f815c15e740 0x7f815c15d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.532+0000 7f81616a4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f815c0d1020 con 0x7f815c0d1540 2024-09-12T02:05:35.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.532+0000 7f81616a4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f815c0d0d40 con 0x7f815c15e740 2024-09-12T02:05:35.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.532+0000 7f81616a4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f815c09baa0 con 0x7f815c09b690 2024-09-12T02:05:35.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.532+0000 7f815a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815c0d1540 0x7f815c0b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.532+0000 7f815a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815c0d1540 0x7f815c0b51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54824/0 (socket says 172.21.15.19:54824) 2024-09-12T02:05:35.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.532+0000 7f815a7fc640 1 -- 172.21.15.19:0/1199662812 learned_addr learned my addr 172.21.15.19:0/1199662812 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:35.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.532+0000 7f815b7fe640 1 --2- 172.21.15.19:0/1199662812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f815c15e740 0x7f815c15d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.532+0000 7f815affd640 1 --2- 172.21.15.19:0/1199662812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f815c09b690 0x7f815c1528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.532+0000 7f815a7fc640 1 -- 172.21.15.19:0/1199662812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f815c09b690 msgr2=0x7f815c1528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.532+0000 7f815a7fc640 1 --2- 172.21.15.19:0/1199662812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f815c09b690 0x7f815c1528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.532+0000 7f815a7fc640 1 -- 172.21.15.19:0/1199662812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f815c15e740 msgr2=0x7f815c15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.532+0000 7f815a7fc640 1 --2- 172.21.15.19:0/1199662812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f815c15e740 0x7f815c15d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.532+0000 7f815a7fc640 1 -- 172.21.15.19:0/1199662812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815c0b5730 con 0x7f815c0d1540 2024-09-12T02:05:35.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.532+0000 7f815b7fe640 1 --2- 172.21.15.19:0/1199662812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f815c15e740 0x7f815c15d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:35.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.532+0000 7f815a7fc640 1 --2- 172.21.15.19:0/1199662812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815c0d1540 0x7f815c0b51f0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f815000c7f0 tx=0x7f815000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:35.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.533+0000 7f81437fe640 1 -- 172.21.15.19:0/1199662812 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8150015070 con 0x7f815c0d1540 2024-09-12T02:05:35.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.533+0000 7f81437fe640 1 -- 172.21.15.19:0/1199662812 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8150007a30 con 0x7f815c0d1540 2024-09-12T02:05:35.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.533+0000 7f81437fe640 1 -- 172.21.15.19:0/1199662812 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8150007e00 con 0x7f815c0d1540 2024-09-12T02:05:35.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.533+0000 7f81616a4640 1 -- 172.21.15.19:0/1199662812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f815c0b59d0 con 0x7f815c0d1540 2024-09-12T02:05:35.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.533+0000 7f81616a4640 1 -- 172.21.15.19:0/1199662812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f815c0b5f90 con 0x7f815c0d1540 2024-09-12T02:05:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.534+0000 7f81437fe640 1 -- 172.21.15.19:0/1199662812 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8150018070 con 0x7f815c0d1540 2024-09-12T02:05:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.535+0000 7f81437fe640 1 --2- 172.21.15.19:0/1199662812 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f814806be30 0x7f814806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.535+0000 7f81437fe640 1 -- 172.21.15.19:0/1199662812 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7f815008ba80 con 0x7f815c0d1540 2024-09-12T02:05:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.535+0000 7f815affd640 1 --2- 172.21.15.19:0/1199662812 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f814806be30 0x7f814806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.536+0000 7f8164437740 1 Processor -- start 2024-09-12T02:05:35.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.536+0000 7f815affd640 1 --2- 172.21.15.19:0/1199662812 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f814806be30 0x7f814806e2f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f814c000f60 tx=0x7f814c007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:35.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.536+0000 7f8164437740 1 -- start start 2024-09-12T02:05:35.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.536+0000 7f8164437740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3a2c0 0x560175d7fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.536+0000 7f8164437740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d37a80 0x560175d3a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.536+0000 7f8164437740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3ba50 0x560175d348b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.536+0000 7f8164437740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560175c9c520 con 0x560175d3ba50 2024-09-12T02:05:35.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.536+0000 7f8164437740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560175c443e0 con 0x560175d37a80 2024-09-12T02:05:35.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.536+0000 7f8164437740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560175c984e0 con 0x560175d3a2c0 2024-09-12T02:05:35.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.537+0000 7f815b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3ba50 0x560175d348b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.537+0000 7f815b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3ba50 0x560175d348b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54828/0 (socket says 172.21.15.19:54828) 2024-09-12T02:05:35.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.537+0000 7f815a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d37a80 0x560175d3a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.537+0000 7f815b7fe640 1 -- 172.21.15.19:0/327947548 learned_addr learned my addr 172.21.15.19:0/327947548 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:35.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.537+0000 7f815affd640 1 --2- 172.21.15.19:0/327947548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3a2c0 0x560175d7fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.537+0000 7f815b7fe640 1 -- 172.21.15.19:0/327947548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3a2c0 msgr2=0x560175d7fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.537+0000 7f815b7fe640 1 --2- 172.21.15.19:0/327947548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3a2c0 0x560175d7fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.537+0000 7f815b7fe640 1 -- 172.21.15.19:0/327947548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d37a80 msgr2=0x560175d3a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.537+0000 7f815b7fe640 1 --2- 172.21.15.19:0/327947548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d37a80 0x560175d3a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.537+0000 7f815b7fe640 1 -- 172.21.15.19:0/327947548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560175c5f2f0 con 0x560175d3ba50 2024-09-12T02:05:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.537+0000 7f815b7fe640 1 --2- 172.21.15.19:0/327947548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3ba50 0x560175d348b0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f815402adb0 tx=0x7f815402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd578c3d0814900a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.537+0000 7f8140ff9640 1 -- 172.21.15.19:0/327947548 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8154036030 con 0x560175d3ba50 2024-09-12T02:05:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.537+0000 7f8140ff9640 1 -- 172.21.15.19:0/327947548 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8154041070 con 0x560175d3ba50 2024-09-12T02:05:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.537+0000 7f8140ff9640 1 -- 172.21.15.19:0/327947548 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8154004040 con 0x560175d3ba50 2024-09-12T02:05:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.538+0000 7f8164437740 1 -- 172.21.15.19:0/327947548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3ba50 msgr2=0x560175d348b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.538+0000 7f8164437740 1 --2- 172.21.15.19:0/327947548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3ba50 0x560175d348b0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f815402adb0 tx=0x7f815402e000 comp rx=0 tx=0).stop 2024-09-12T02:05:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.538+0000 7f8164437740 1 -- 172.21.15.19:0/327947548 shutdown_connections 2024-09-12T02:05:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.538+0000 7f8164437740 1 --2- 172.21.15.19:0/327947548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3ba50 0x560175d348b0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.538+0000 7f8164437740 1 --2- 172.21.15.19:0/327947548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d37a80 0x560175d3a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.538+0000 7f8164437740 1 --2- 172.21.15.19:0/327947548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3a2c0 0x560175d7fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.538+0000 7f8164437740 1 -- 172.21.15.19:0/327947548 >> 172.21.15.19:0/327947548 conn(0x560175d36a80 msgr2=0x560175d7ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:35.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.538+0000 7f8164437740 1 -- 172.21.15.19:0/327947548 shutdown_connections 2024-09-12T02:05:35.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.538+0000 7f8164437740 1 -- 172.21.15.19:0/327947548 wait complete. 2024-09-12T02:05:35.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.539+0000 7f8164437740 1 -- start start 2024-09-12T02:05:35.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.539+0000 7f8164437740 1 Processor -- start 2024-09-12T02:05:35.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.539+0000 7f8164437740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3a2c0 0x560175d5f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.539+0000 7f8164437740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3ba50 0x560175d7c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.539+0000 7f8164437740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d7c8d0 0x560175d5d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.539+0000 7f8164437740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560175d35f20 con 0x560175d3ba50 2024-09-12T02:05:35.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.539+0000 7f8164437740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560175c25450 con 0x560175d7c8d0 2024-09-12T02:05:35.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f8164437740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560175d80290 con 0x560175d3a2c0 2024-09-12T02:05:35.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f8164437740 10 client.0 _ll_register_callbacks cb 0x5601759aeac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:05:35.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f815a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3ba50 0x560175d7c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f815a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3ba50 0x560175d7c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54832/0 (socket says 172.21.15.19:54832) 2024-09-12T02:05:35.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f815a7fc640 1 -- 172.21.15.19:0/340162442 learned_addr learned my addr 172.21.15.19:0/340162442 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:35.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f815affd640 1 --2- 172.21.15.19:0/340162442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3a2c0 0x560175d5f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f815a7fc640 1 -- 172.21.15.19:0/340162442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3a2c0 msgr2=0x560175d5f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:35.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f815b7fe640 1 --2- 172.21.15.19:0/340162442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d7c8d0 0x560175d5d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f815a7fc640 1 --2- 172.21.15.19:0/340162442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3a2c0 0x560175d5f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f815a7fc640 1 -- 172.21.15.19:0/340162442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d7c8d0 msgr2=0x560175d5d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:35.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f815a7fc640 1 --2- 172.21.15.19:0/340162442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d7c8d0 0x560175d5d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f815a7fc640 1 -- 172.21.15.19:0/340162442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601759af2d0 con 0x560175d3ba50 2024-09-12T02:05:35.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f815a7fc640 1 --2- 172.21.15.19:0/340162442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3ba50 0x560175d7c390 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f8150089660 tx=0x7f8150059100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca99f8395ab1466 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:35.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f8139ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:05:35.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f8139ffb640 1 -- 172.21.15.19:0/340162442 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815001f040 con 0x560175d3ba50 2024-09-12T02:05:35.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f8139ffb640 1 -- 172.21.15.19:0/340162442 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7f8150058550 con 0x560175d3ba50 2024-09-12T02:05:35.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f8164437740 1 -- 172.21.15.19:0/340162442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8154041070 con 0x560175d3ba50 2024-09-12T02:05:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f8139ffb640 1 -- 172.21.15.19:0/340162442 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=264) ==== 24+0+0 (secure 0 0 0) 0x7f8150089080 con 0x560175d3ba50 2024-09-12T02:05:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f8164437740 10 client.9798 fetch_fsmap learned FSMap version 264 2024-09-12T02:05:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f8164437740 1 -- 172.21.15.19:0/340162442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=264,monmap=2+}) -- 0x560175a796b0 con 0x560175d3ba50 2024-09-12T02:05:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.540+0000 7f8139ffb640 1 -- 172.21.15.19:0/340162442 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8154041070 con 0x560175d3ba50 2024-09-12T02:05:35.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.541+0000 7f8139ffb640 1 -- 172.21.15.19:0/340162442 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 264) ==== 3502+0+0 (secure 0 0 0) 0x7f8150082ce0 con 0x560175d3ba50 2024-09-12T02:05:35.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.541+0000 7f8164437740 10 client.9798 fetch_fsmap finished waiting for FSMap version 264 2024-09-12T02:05:35.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.541+0000 7f8164437740 10 client.9798 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:05:35.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.541+0000 7f8164437740 20 client.9798 populate_metadata read hostname 'smithi019' 2024-09-12T02:05:35.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.541+0000 7f8164437740 1 --2- 172.21.15.19:0/340162442 >> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] conn(0x560175d91f30 0x560175d633e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.541+0000 7f8164437740 4 client.9798 mds_command: new command op to 9711 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:05:35.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.541+0000 7f8164437740 1 -- 172.21.15.19:0/340162442 --> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560175ca9c50 con 0x560175d91f30 2024-09-12T02:05:35.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.541+0000 7f815affd640 1 --2- 172.21.15.19:0/340162442 >> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] conn(0x560175d91f30 0x560175d633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.541+0000 7f815affd640 1 --2- 172.21.15.19:0/340162442 >> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] conn(0x560175d91f30 0x560175d633e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=936d6aaf9b3b07ff server_cookie=4d55946e25b287b8 in_seq=0 out_seq=0 2024-09-12T02:05:35.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.541+0000 7f8139ffb640 10 client.9798 ms_handle_connect on v2:172.21.15.19:6832/3818656517 2024-09-12T02:05:35.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.542+0000 7f8139ffb640 1 -- 172.21.15.19:0/340162442 <== mds.0 v2:172.21.15.19:6832/3818656517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560175ca9c50 con 0x560175d91f30 2024-09-12T02:05:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.542+0000 7f8139ffb640 10 client.9798 handle_command_reply: tid=0 2024-09-12T02:05:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.542+0000 7f8164437740 1 client.9798 shutdown 2024-09-12T02:05:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.542+0000 7f8164437740 1 -- 172.21.15.19:0/340162442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3ba50 msgr2=0x560175d7c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.542+0000 7f8164437740 1 --2- 172.21.15.19:0/340162442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3ba50 0x560175d7c390 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f8150089660 tx=0x7f8150059100 comp rx=0 tx=0).stop 2024-09-12T02:05:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.542+0000 7f8164437740 1 -- 172.21.15.19:0/340162442 shutdown_connections 2024-09-12T02:05:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.542+0000 7f8164437740 1 --2- 172.21.15.19:0/340162442 >> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] conn(0x560175d91f30 0x560175d633e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.542+0000 7f8164437740 1 --2- 172.21.15.19:0/340162442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d7c8d0 0x560175d5d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.542+0000 7f8164437740 1 --2- 172.21.15.19:0/340162442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3ba50 0x560175d7c390 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.542+0000 7f8139ffb640 0 client.9798 ms_handle_reset on v2:172.21.15.19:6832/3818656517 2024-09-12T02:05:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.542+0000 7f8164437740 1 --2- 172.21.15.19:0/340162442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3a2c0 0x560175d5f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.542+0000 7f8164437740 1 -- 172.21.15.19:0/340162442 >> 172.21.15.19:0/340162442 conn(0x560175d37a80 msgr2=0x560175d81070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.542+0000 7f8164437740 1 -- 172.21.15.19:0/340162442 shutdown_connections 2024-09-12T02:05:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.542+0000 7f8164437740 1 -- 172.21.15.19:0/340162442 wait complete. 2024-09-12T02:05:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.542+0000 7f8164437740 20 client.9798 trim_cache size 0 max 16384 2024-09-12T02:05:35.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.560+0000 7f8164437740 1 Processor -- start 2024-09-12T02:05:35.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.560+0000 7f8164437740 1 -- start start 2024-09-12T02:05:35.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.561+0000 7f8164437740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3a2c0 0x560175d63c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.561+0000 7f8164437740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3ba50 0x560175d80a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.561+0000 7f8164437740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d7c8d0 0x560175d80fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.561+0000 7f8164437740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f815c201ab0 con 0x560175d3a2c0 2024-09-12T02:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.561+0000 7f8164437740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f815c200e10 con 0x560175d7c8d0 2024-09-12T02:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.561+0000 7f8164437740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f815c201460 con 0x560175d3ba50 2024-09-12T02:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.561+0000 7f815affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3a2c0 0x560175d63c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.561+0000 7f815affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3a2c0 0x560175d63c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54844/0 (socket says 172.21.15.19:54844) 2024-09-12T02:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.561+0000 7f815affd640 1 -- 172.21.15.19:0/1783386345 learned_addr learned my addr 172.21.15.19:0/1783386345 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.561+0000 7f815b7fe640 1 --2- 172.21.15.19:0/1783386345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d7c8d0 0x560175d80fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.561+0000 7f815a7fc640 1 --2- 172.21.15.19:0/1783386345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3ba50 0x560175d80a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.561+0000 7f815affd640 1 -- 172.21.15.19:0/1783386345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3ba50 msgr2=0x560175d80a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.561+0000 7f815affd640 1 --2- 172.21.15.19:0/1783386345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3ba50 0x560175d80a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.561+0000 7f815affd640 1 -- 172.21.15.19:0/1783386345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d7c8d0 msgr2=0x560175d80fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.561+0000 7f815affd640 1 --2- 172.21.15.19:0/1783386345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d7c8d0 0x560175d80fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.562+0000 7f815affd640 1 -- 172.21.15.19:0/1783386345 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560175d824b0 con 0x560175d3a2c0 2024-09-12T02:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.562+0000 7f815affd640 1 --2- 172.21.15.19:0/1783386345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3a2c0 0x560175d63c20 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x560175d92790 tx=0x7f814c009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed19e488c99387f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.562+0000 7f813bfff640 1 -- 172.21.15.19:0/1783386345 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814c028070 con 0x560175d3a2c0 2024-09-12T02:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.562+0000 7f813bfff640 1 -- 172.21.15.19:0/1783386345 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f814c0139b0 con 0x560175d3a2c0 2024-09-12T02:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.562+0000 7f813bfff640 1 -- 172.21.15.19:0/1783386345 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814c013b60 con 0x560175d3a2c0 2024-09-12T02:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.562+0000 7f8164437740 1 -- 172.21.15.19:0/1783386345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3a2c0 msgr2=0x560175d63c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.562+0000 7f8164437740 1 --2- 172.21.15.19:0/1783386345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3a2c0 0x560175d63c20 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x560175d92790 tx=0x7f814c009030 comp rx=0 tx=0).stop 2024-09-12T02:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.562+0000 7f8164437740 1 -- 172.21.15.19:0/1783386345 shutdown_connections 2024-09-12T02:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.562+0000 7f8164437740 1 --2- 172.21.15.19:0/1783386345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d7c8d0 0x560175d80fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.562+0000 7f8164437740 1 --2- 172.21.15.19:0/1783386345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3ba50 0x560175d80a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.562+0000 7f8164437740 1 --2- 172.21.15.19:0/1783386345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d3a2c0 0x560175d63c20 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.562+0000 7f8164437740 1 -- 172.21.15.19:0/1783386345 >> 172.21.15.19:0/1783386345 conn(0x560175d37a80 msgr2=0x560175d7bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.562+0000 7f8164437740 1 -- 172.21.15.19:0/1783386345 shutdown_connections 2024-09-12T02:05:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.563+0000 7f8164437740 1 -- 172.21.15.19:0/1783386345 wait complete. 2024-09-12T02:05:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.563+0000 7f8164437740 1 -- start start 2024-09-12T02:05:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.563+0000 7f8164437740 1 Processor -- start 2024-09-12T02:05:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.564+0000 7f8164437740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d3a2c0 0x560175dfce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.564+0000 7f8164437740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3ba50 0x560175da1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.564+0000 7f8164437740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d7c8d0 0x560175d7ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.564+0000 7f8164437740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560175d5feb0 con 0x560175d7c8d0 2024-09-12T02:05:35.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.564+0000 7f8164437740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560175d643c0 con 0x560175d3a2c0 2024-09-12T02:05:35.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.564+0000 7f8164437740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560175d92330 con 0x560175d3ba50 2024-09-12T02:05:35.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.564+0000 7f8164437740 10 client.0 _ll_register_callbacks cb 0x7f815000c740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:05:35.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.564+0000 7f815b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d7c8d0 0x560175d7ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.564+0000 7f815b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d7c8d0 0x560175d7ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54854/0 (socket says 172.21.15.19:54854) 2024-09-12T02:05:35.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.564+0000 7f815b7fe640 1 -- 172.21.15.19:0/645827888 learned_addr learned my addr 172.21.15.19:0/645827888 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:35.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.564+0000 7f815affd640 1 --2- 172.21.15.19:0/645827888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d3a2c0 0x560175dfce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.564+0000 7f815a7fc640 1 --2- 172.21.15.19:0/645827888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3ba50 0x560175da1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.564+0000 7f815b7fe640 1 -- 172.21.15.19:0/645827888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3ba50 msgr2=0x560175da1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:35.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.564+0000 7f815b7fe640 1 --2- 172.21.15.19:0/645827888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3ba50 0x560175da1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.564+0000 7f815b7fe640 1 -- 172.21.15.19:0/645827888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d3a2c0 msgr2=0x560175dfce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:35.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.564+0000 7f815b7fe640 1 --2- 172.21.15.19:0/645827888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d3a2c0 0x560175dfce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.564+0000 7f815b7fe640 1 -- 172.21.15.19:0/645827888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560175da22f0 con 0x560175d7c8d0 2024-09-12T02:05:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.565+0000 7f815b7fe640 1 --2- 172.21.15.19:0/645827888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d7c8d0 0x560175d7ae20 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f815403e040 tx=0x7f8154004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7a111dbc0e1c38 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.565+0000 7f8139ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:05:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.565+0000 7f8139ffb640 1 -- 172.21.15.19:0/645827888 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8154036040 con 0x560175d7c8d0 2024-09-12T02:05:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.565+0000 7f8139ffb640 1 -- 172.21.15.19:0/645827888 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7f815403c930 con 0x560175d7c8d0 2024-09-12T02:05:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.565+0000 7f8164437740 1 -- 172.21.15.19:0/645827888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f814c0139b0 con 0x560175d7c8d0 2024-09-12T02:05:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.565+0000 7f8139ffb640 1 -- 172.21.15.19:0/645827888 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=264) ==== 24+0+0 (secure 0 0 0) 0x7f815403cb70 con 0x560175d7c8d0 2024-09-12T02:05:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.565+0000 7f8164437740 10 client.9804 fetch_fsmap learned FSMap version 264 2024-09-12T02:05:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.565+0000 7f8164437740 1 -- 172.21.15.19:0/645827888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=264,monmap=2+}) -- 0x560175d634c0 con 0x560175d7c8d0 2024-09-12T02:05:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.565+0000 7f8139ffb640 1 -- 172.21.15.19:0/645827888 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f814c0139b0 con 0x560175d7c8d0 2024-09-12T02:05:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.565+0000 7f8139ffb640 1 -- 172.21.15.19:0/645827888 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 264) ==== 3502+0+0 (secure 0 0 0) 0x7f8154008040 con 0x560175d7c8d0 2024-09-12T02:05:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.565+0000 7f8164437740 10 client.9804 fetch_fsmap finished waiting for FSMap version 264 2024-09-12T02:05:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.565+0000 7f8164437740 10 client.9804 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:05:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.565+0000 7f8164437740 20 client.9804 populate_metadata read hostname 'smithi019' 2024-09-12T02:05:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.565+0000 7f8164437740 1 --2- 172.21.15.19:0/645827888 >> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] conn(0x560175d8e0c0 0x560175d74dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.565+0000 7f8164437740 4 client.9804 mds_command: new command op to 9711 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:05:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.565+0000 7f8164437740 1 -- 172.21.15.19:0/645827888 --> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] -- command(tid 0: {"prefix": "status"}) -- 0x560175ca3fa0 con 0x560175d8e0c0 2024-09-12T02:05:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.565+0000 7f815affd640 1 --2- 172.21.15.19:0/645827888 >> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] conn(0x560175d8e0c0 0x560175d74dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.566+0000 7f815affd640 1 --2- 172.21.15.19:0/645827888 >> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] conn(0x560175d8e0c0 0x560175d74dd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f99de3e8f347ee88 server_cookie=63c53b09c43a9bd4 in_seq=0 out_seq=0 2024-09-12T02:05:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.566+0000 7f8139ffb640 10 client.9804 ms_handle_connect on v2:172.21.15.19:6832/3818656517 2024-09-12T02:05:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.566+0000 7f8139ffb640 1 -- 172.21.15.19:0/645827888 <== mds.0 v2:172.21.15.19:6832/3818656517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x560175ca3fa0 con 0x560175d8e0c0 2024-09-12T02:05:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.566+0000 7f8139ffb640 10 client.9804 handle_command_reply: tid=0 2024-09-12T02:05:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.566+0000 7f8164437740 1 client.9804 shutdown 2024-09-12T02:05:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.566+0000 7f8164437740 1 -- 172.21.15.19:0/645827888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d7c8d0 msgr2=0x560175d7ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.566+0000 7f8164437740 1 --2- 172.21.15.19:0/645827888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d7c8d0 0x560175d7ae20 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f815403e040 tx=0x7f8154004ab0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.566+0000 7f8164437740 1 -- 172.21.15.19:0/645827888 shutdown_connections 2024-09-12T02:05:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.566+0000 7f8164437740 1 --2- 172.21.15.19:0/645827888 >> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] conn(0x560175d8e0c0 0x560175d74dd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.566+0000 7f8164437740 1 --2- 172.21.15.19:0/645827888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560175d7c8d0 0x560175d7ae20 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.566+0000 7f8139ffb640 0 client.9804 ms_handle_reset on v2:172.21.15.19:6832/3818656517 2024-09-12T02:05:35.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.566+0000 7f8164437740 1 --2- 172.21.15.19:0/645827888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560175d3ba50 0x560175da1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.566+0000 7f8164437740 1 --2- 172.21.15.19:0/645827888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560175d3a2c0 0x560175dfce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.566+0000 7f8164437740 1 -- 172.21.15.19:0/645827888 >> 172.21.15.19:0/645827888 conn(0x560175d37a80 msgr2=0x560175d7bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:35.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.566+0000 7f8164437740 1 -- 172.21.15.19:0/645827888 shutdown_connections 2024-09-12T02:05:35.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.566+0000 7f8164437740 1 -- 172.21.15.19:0/645827888 wait complete. 2024-09-12T02:05:35.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.566+0000 7f8164437740 20 client.9804 trim_cache size 0 max 16384 2024-09-12T02:05:35.573 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:05:35.573 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T02:05:35.574 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T02:05:35.574 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 9711, 2024-09-12T02:05:35.574 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T02:05:35.574 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T02:05:35.574 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T02:05:35.574 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 6.6779815439999997, 2024-09-12T02:05:35.574 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 264, 2024-09-12T02:05:35.574 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 125, 2024-09-12T02:05:35.574 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 125, 2024-09-12T02:05:35.575 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 9.9527768279999993 2024-09-12T02:05:35.575 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:05:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.567+0000 7f81616a4640 1 -- 172.21.15.19:0/1199662812 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f814806be30 msgr2=0x7f814806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.567+0000 7f81616a4640 1 --2- 172.21.15.19:0/1199662812 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f814806be30 0x7f814806e2f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f814c000f60 tx=0x7f814c007b50 comp rx=0 tx=0).stop 2024-09-12T02:05:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.567+0000 7f81616a4640 1 -- 172.21.15.19:0/1199662812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815c0d1540 msgr2=0x7f815c0b51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.567+0000 7f81616a4640 1 --2- 172.21.15.19:0/1199662812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815c0d1540 0x7f815c0b51f0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f815000c7f0 tx=0x7f815000cbf0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.567+0000 7f81616a4640 1 -- 172.21.15.19:0/1199662812 shutdown_connections 2024-09-12T02:05:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.567+0000 7f81616a4640 1 --2- 172.21.15.19:0/1199662812 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f814806be30 0x7f814806e2f0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.567+0000 7f81616a4640 1 --2- 172.21.15.19:0/1199662812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f815c15e740 0x7f815c15d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.567+0000 7f81616a4640 1 --2- 172.21.15.19:0/1199662812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815c0d1540 0x7f815c0b51f0 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.567+0000 7f81616a4640 1 --2- 172.21.15.19:0/1199662812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f815c09b690 0x7f815c1528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.567+0000 7f81616a4640 1 -- 172.21.15.19:0/1199662812 >> 172.21.15.19:0/1199662812 conn(0x7f815c0d23a0 msgr2=0x7f815c0b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:35.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.567+0000 7f81616a4640 1 -- 172.21.15.19:0/1199662812 shutdown_connections 2024-09-12T02:05:35.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.567+0000 7f81616a4640 1 -- 172.21.15.19:0/1199662812 wait complete. 2024-09-12T02:05:35.578 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:05:35.578 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Corrupt omap key 10000000000.00000000:sixmegs_head', proceeding to ls 2024-09-12T02:05:35.578 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:05:35.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.680+0000 7f679e447640 1 Processor -- start 2024-09-12T02:05:35.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.680+0000 7f679e447640 1 -- start start 2024-09-12T02:05:35.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.681+0000 7f679e447640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67980b6690 0x7f67981691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.681+0000 7f679e447640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67980d3690 con 0x7f67980d30f0 2024-09-12T02:05:35.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.681+0000 7f679e447640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67980d3970 con 0x7f679815e5f0 2024-09-12T02:05:35.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.681+0000 7f679e447640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f679806d530 con 0x7f67980b6690 2024-09-12T02:05:35.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.681+0000 7f67977fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f67980d30f0 0x7f67980b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53978/0 (socket says 172.21.15.19:53978) 2024-09-12T02:05:35.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.681+0000 7f67977fe640 1 -- 172.21.15.19:0/3795033374 learned_addr learned my addr 172.21.15.19:0/3795033374 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:35.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.681+0000 7f679c9e4640 1 --2- 172.21.15.19:0/3795033374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67980b6690 0x7f67981691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.681+0000 7f6796ffd640 1 -- 172.21.15.19:0/3795033374 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4214334343 0 0) 0x7f67980d3690 con 0x7f67980d30f0 2024-09-12T02:05:35.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.681+0000 7f6796ffd640 1 -- 172.21.15.19:0/3795033374 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6780003520 con 0x7f67980d30f0 2024-09-12T02:05:35.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.681+0000 7f6796ffd640 1 -- 172.21.15.19:0/3795033374 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4108020917 0 0) 0x7f67980d3970 con 0x7f679815e5f0 2024-09-12T02:05:35.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.682+0000 7f6796ffd640 1 -- 172.21.15.19:0/3795033374 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67980d3690 con 0x7f679815e5f0 2024-09-12T02:05:35.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.682+0000 7f6796ffd640 1 -- 172.21.15.19:0/3795033374 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1907700489 0 0) 0x7f6780003520 con 0x7f67980d30f0 2024-09-12T02:05:35.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.682+0000 7f679c9e4640 1 -- 172.21.15.19:0/3795033374 >> v1:172.21.15.135:6789/0 conn(0x7f679815e5f0 legacy=0x7f67980d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.682+0000 7f679c9e4640 1 -- 172.21.15.19:0/3795033374 >> v1:172.21.15.19:6789/0 conn(0x7f67980d30f0 legacy=0x7f67980b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.682+0000 7f679c9e4640 1 -- 172.21.15.19:0/3795033374 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679806cee0 con 0x7f67980b6690 2024-09-12T02:05:35.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.682+0000 7f679c9e4640 1 --2- 172.21.15.19:0/3795033374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67980b6690 0x7f67981691a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6790009dc0 tx=0x7f679002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=742f287737589877 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:35.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.683+0000 7f6796ffd640 1 -- 172.21.15.19:0/3795033374 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c001690 con 0x7f67980b6690 2024-09-12T02:05:35.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.683+0000 7f6796ffd640 1 -- 172.21.15.19:0/3795033374 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6790007540 con 0x7f67980b6690 2024-09-12T02:05:35.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.683+0000 7f6796ffd640 1 -- 172.21.15.19:0/3795033374 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6790007910 con 0x7f67980b6690 2024-09-12T02:05:35.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.683+0000 7f679e447640 1 -- 172.21.15.19:0/3795033374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67980b6690 msgr2=0x7f67981691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.683+0000 7f679e447640 1 --2- 172.21.15.19:0/3795033374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67980b6690 0x7f67981691a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6790009dc0 tx=0x7f679002a660 comp rx=0 tx=0).stop 2024-09-12T02:05:35.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.683+0000 7f679e447640 1 -- 172.21.15.19:0/3795033374 shutdown_connections 2024-09-12T02:05:35.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.683+0000 7f679e447640 1 --2- 172.21.15.19:0/3795033374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67980b6690 0x7f67981691a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.683+0000 7f679e447640 1 -- 172.21.15.19:0/3795033374 >> 172.21.15.19:0/3795033374 conn(0x7f679808bfc0 msgr2=0x7f67980d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:35.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.683+0000 7f679e447640 1 -- 172.21.15.19:0/3795033374 shutdown_connections 2024-09-12T02:05:35.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.683+0000 7f679e447640 1 -- 172.21.15.19:0/3795033374 wait complete. 2024-09-12T02:05:35.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.684+0000 7f679e447640 1 Processor -- start 2024-09-12T02:05:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.685+0000 7f679e447640 1 -- start start 2024-09-12T02:05:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.686+0000 7f679e447640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67980b6690 0x7f679815ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.686+0000 7f679e447640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67980d30f0 0x7f67980b9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.686+0000 7f679e447640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f679815e5f0 0x7f67981e8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.686+0000 7f679e447640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f679806e9d0 con 0x7f679815e5f0 2024-09-12T02:05:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.686+0000 7f679e447640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f679815e9d0 con 0x7f67980b6690 2024-09-12T02:05:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.686+0000 7f679e447640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f679806eb50 con 0x7f67980d30f0 2024-09-12T02:05:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.686+0000 7f679c9e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f679815e5f0 0x7f67981e8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.686+0000 7f679c9e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f679815e5f0 0x7f67981e8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54866/0 (socket says 172.21.15.19:54866) 2024-09-12T02:05:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.686+0000 7f679c9e4640 1 -- 172.21.15.19:0/600764453 learned_addr learned my addr 172.21.15.19:0/600764453 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.686+0000 7f6797fff640 1 --2- 172.21.15.19:0/600764453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67980b6690 0x7f679815ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.686+0000 7f67977fe640 1 --2- 172.21.15.19:0/600764453 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67980d30f0 0x7f67980b9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.686+0000 7f679c9e4640 1 -- 172.21.15.19:0/600764453 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67980d30f0 msgr2=0x7f67980b9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.686+0000 7f679c9e4640 1 --2- 172.21.15.19:0/600764453 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67980d30f0 0x7f67980b9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.686+0000 7f679c9e4640 1 -- 172.21.15.19:0/600764453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67980b6690 msgr2=0x7f679815ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.686+0000 7f679c9e4640 1 --2- 172.21.15.19:0/600764453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67980b6690 0x7f679815ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.686+0000 7f679c9e4640 1 -- 172.21.15.19:0/600764453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67981e7d30 con 0x7f679815e5f0 2024-09-12T02:05:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.686+0000 7f67977fe640 1 --2- 172.21.15.19:0/600764453 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67980d30f0 0x7f67980b9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.686+0000 7f6797fff640 1 --2- 172.21.15.19:0/600764453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67980b6690 0x7f679815ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.687+0000 7f679c9e4640 1 --2- 172.21.15.19:0/600764453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f679815e5f0 0x7f67981e8dd0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f6790009ee0 tx=0x7f6790004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.687+0000 7f6794ff9640 1 -- 172.21.15.19:0/600764453 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6790040070 con 0x7f679815e5f0 2024-09-12T02:05:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.687+0000 7f6794ff9640 1 -- 172.21.15.19:0/600764453 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6790031bc0 con 0x7f679815e5f0 2024-09-12T02:05:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.687+0000 7f679e447640 1 -- 172.21.15.19:0/600764453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67981e8010 con 0x7f679815e5f0 2024-09-12T02:05:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.687+0000 7f6794ff9640 1 -- 172.21.15.19:0/600764453 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6790009450 con 0x7f679815e5f0 2024-09-12T02:05:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.687+0000 7f679e447640 1 -- 172.21.15.19:0/600764453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67981e85d0 con 0x7f679815e5f0 2024-09-12T02:05:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.688+0000 7f679e447640 1 -- 172.21.15.19:0/600764453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67980b5f80 con 0x7f679815e5f0 2024-09-12T02:05:35.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.688+0000 7f6794ff9640 1 -- 172.21.15.19:0/600764453 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6790039040 con 0x7f679815e5f0 2024-09-12T02:05:35.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.689+0000 7f6794ff9640 1 --2- 172.21.15.19:0/600764453 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f678406be30 0x7f678406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.689+0000 7f6794ff9640 1 -- 172.21.15.19:0/600764453 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7f67900acf80 con 0x7f679815e5f0 2024-09-12T02:05:35.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.689+0000 7f6797fff640 1 --2- 172.21.15.19:0/600764453 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f678406be30 0x7f678406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.690+0000 7f6797fff640 1 --2- 172.21.15.19:0/600764453 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f678406be30 0x7f678406e2f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6788001670 tx=0x7f6788009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:35.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.693+0000 7f6794ff9640 1 -- 172.21.15.19:0/600764453 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f679007ac10 con 0x7f679815e5f0 2024-09-12T02:05:35.874 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:05:35.874+0000 7f4d9824f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:05:35.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.905+0000 7f679e447640 1 -- 172.21.15.19:0/600764453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f679806bda0 con 0x7f679815e5f0 2024-09-12T02:05:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.905+0000 7f6794ff9640 1 -- 172.21.15.19:0/600764453 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v264) ==== 53+0+73 (secure 0 0 0) 0x7f679007a510 con 0x7f679815e5f0 2024-09-12T02:05:35.906 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:05:35.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.907+0000 7f679e447640 1 -- 172.21.15.19:0/600764453 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f678406be30 msgr2=0x7f678406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.907+0000 7f679e447640 1 --2- 172.21.15.19:0/600764453 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f678406be30 0x7f678406e2f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6788001670 tx=0x7f6788009040 comp rx=0 tx=0).stop 2024-09-12T02:05:35.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.907+0000 7f679e447640 1 -- 172.21.15.19:0/600764453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f679815e5f0 msgr2=0x7f67981e8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.907+0000 7f679e447640 1 --2- 172.21.15.19:0/600764453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f679815e5f0 0x7f67981e8dd0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f6790009ee0 tx=0x7f6790004a40 comp rx=0 tx=0).stop 2024-09-12T02:05:35.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.907+0000 7f679e447640 1 -- 172.21.15.19:0/600764453 shutdown_connections 2024-09-12T02:05:35.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.907+0000 7f679e447640 1 --2- 172.21.15.19:0/600764453 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f678406be30 0x7f678406e2f0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.907+0000 7f679e447640 1 --2- 172.21.15.19:0/600764453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f679815e5f0 0x7f67981e8dd0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.907+0000 7f679e447640 1 --2- 172.21.15.19:0/600764453 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67980d30f0 0x7f67980b9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.907+0000 7f679e447640 1 --2- 172.21.15.19:0/600764453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67980b6690 0x7f679815ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.907+0000 7f679e447640 1 -- 172.21.15.19:0/600764453 >> 172.21.15.19:0/600764453 conn(0x7f679808bfc0 msgr2=0x7f67980d0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:35.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.908+0000 7f679e447640 1 -- 172.21.15.19:0/600764453 shutdown_connections 2024-09-12T02:05:35.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:35.908+0000 7f679e447640 1 -- 172.21.15.19:0/600764453 wait complete. 2024-09-12T02:05:35.919 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:05:35.919 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:05:35.919 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T02:05:35.919 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:05:35.919 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:05:35.919 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:05:35.919 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:05:35.920 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:05:35.920 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:05:35.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:35.920 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T02:05:35.937 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:05:35.937 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:05:35.937 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:05:35.937 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:35.937 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T02:05:35.937 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:35.937 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:05:35.937 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:05:35.937 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T02:05:35.938 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:05:35.938 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:05:35.938 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T02:05:35.938 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:05:35.938 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:05:35.938 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T02:05:35.938 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:05:35.938 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42225sec preferred_lft 42225sec 2024-09-12T02:05:35.938 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T02:05:35.938 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:35.938 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:05:35.938 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:05:35.938 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T02:05:35.938 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:05:35.938 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T02:05:35.939 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:05:35.939 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:35.939 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T02:05:35.939 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:35.939 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:05:35.939 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:05:35.939 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T02:05:35.939 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:35.939 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:05:35.939 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:05:35.939 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T02:05:35.940 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:35.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:35.940 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:05:36.001 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T02:05:36.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:36.003 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T02:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T02:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:05:36.060 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:05:36.060 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T02:05:36.060 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:05:36.060 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:05:36.060 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:05:36.060 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T02:05:36.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:05:36.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:05:36.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:36.188 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T02:05:36.204 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:05:36.204 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:05:36.205 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:05:36.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:36.205 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T02:05:36.270 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:05:36.270 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:05:36.326 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:05:36.326 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:05:36.326 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:05:36.381 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:05:36.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:36.382 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:05:36.467 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:05:36.467 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:05:36.467 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:05:36.476 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:05:36.476 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:05:36.476 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:05:36.476 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:05:36.476 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:05:36.483 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:05:36.483 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:05:36.483 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:05:36.483 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:05:36.483 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:05:36.483 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T02:05:36.483 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T02:05:36.483 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T02:05:36.483 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:05:36.484 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:05:36.484 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:05:36.484 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:05:36.484 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:05:36.485 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:05:36.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:36.486 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:05:36.511 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:05:36.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:05:36.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:05:36.609 INFO:teuthology.orchestra.run.smithi019.stdout:client8680 2024-09-12T02:05:36.609 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:05:36.609 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:05:36.625 DEBUG:teuthology.orchestra.run.smithi019:> stdin-killer -- python3 -c ' 2024-09-12T02:05:36.626 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-09-12T02:05:36.626 DEBUG:teuthology.orchestra.run.smithi019:> import stat 2024-09-12T02:05:36.626 DEBUG:teuthology.orchestra.run.smithi019:> import json 2024-09-12T02:05:36.626 DEBUG:teuthology.orchestra.run.smithi019:> import sys 2024-09-12T02:05:36.626 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T02:05:36.626 DEBUG:teuthology.orchestra.run.smithi019:> try: 2024-09-12T02:05:36.626 DEBUG:teuthology.orchestra.run.smithi019:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/./subdir/sixmegs'"'"') 2024-09-12T02:05:36.626 DEBUG:teuthology.orchestra.run.smithi019:> except OSError as e: 2024-09-12T02:05:36.626 DEBUG:teuthology.orchestra.run.smithi019:> sys.exit(e.errno) 2024-09-12T02:05:36.626 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T02:05:36.626 DEBUG:teuthology.orchestra.run.smithi019:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-12T02:05:36.626 DEBUG:teuthology.orchestra.run.smithi019:> print(json.dumps( 2024-09-12T02:05:36.626 DEBUG:teuthology.orchestra.run.smithi019:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-12T02:05:36.626 DEBUG:teuthology.orchestra.run.smithi019:> indent=2)) 2024-09-12T02:05:36.627 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-09-12T02:05:36.668 INFO:teuthology.orchestra.run:waiting for 20 2024-09-12T02:05:36.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36 stdin-killer INFO: command exited with status 5: exiting normally with same code! 2024-09-12T02:05:36.745 DEBUG:teuthology.orchestra.run:got remote process result: 5 2024-09-12T02:05:36.745 INFO:tasks.cephfs.test_damage:Result: EIO on client 2024-09-12T02:05:36.745 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:36.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.887+0000 7fac7269b640 1 Processor -- start 2024-09-12T02:05:36.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.887+0000 7fac7269b640 1 -- start start 2024-09-12T02:05:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.888+0000 7fac7269b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fac6c15e760 0x7fac6c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.888+0000 7fac7269b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac6c0d4fd0 0x7fac6c0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.888+0000 7fac7269b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac6c0b3650 0x7fac6c0cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.888+0000 7fac7269b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fac6c0d2700 con 0x7fac6c0d4fd0 2024-09-12T02:05:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.888+0000 7fac7269b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fac6c0cedb0 con 0x7fac6c15e760 2024-09-12T02:05:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.888+0000 7fac7269b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fac6c0cf090 con 0x7fac6c0b3650 2024-09-12T02:05:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.888+0000 7fac6b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac6c0d4fd0 0x7fac6c0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.888+0000 7fac6b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac6c0d4fd0 0x7fac6c0cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54872/0 (socket says 172.21.15.19:54872) 2024-09-12T02:05:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.888+0000 7fac6b7fe640 1 -- 172.21.15.19:0/3359642162 learned_addr learned my addr 172.21.15.19:0/3359642162 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.888+0000 7fac6bfff640 1 --2- 172.21.15.19:0/3359642162 >> v2:172.21.15.135:3300/0 conn(0x7fac6c15e760 0x7fac6c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.888+0000 7fac70c38640 1 --2- 172.21.15.19:0/3359642162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac6c0b3650 0x7fac6c0cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.888+0000 7fac6b7fe640 1 -- 172.21.15.19:0/3359642162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac6c0b3650 msgr2=0x7fac6c0cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.888+0000 7fac6b7fe640 1 --2- 172.21.15.19:0/3359642162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac6c0b3650 0x7fac6c0cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.888+0000 7fac6b7fe640 1 -- 172.21.15.19:0/3359642162 >> v2:172.21.15.135:3300/0 conn(0x7fac6c15e760 msgr2=0x7fac6c06cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.888+0000 7fac6b7fe640 1 --2- 172.21.15.19:0/3359642162 >> v2:172.21.15.135:3300/0 conn(0x7fac6c15e760 0x7fac6c06cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.888+0000 7fac6b7fe640 1 -- 172.21.15.19:0/3359642162 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac6c0b3c80 con 0x7fac6c0d4fd0 2024-09-12T02:05:36.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.889+0000 7fac6b7fe640 1 --2- 172.21.15.19:0/3359642162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac6c0d4fd0 0x7fac6c0cf5b0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7fac6c08ca50 tx=0x7fac6002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc90f1642d7009c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:36.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.889+0000 7fac6affd640 1 -- 172.21.15.19:0/3359642162 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac60004030 con 0x7fac6c0d4fd0 2024-09-12T02:05:36.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.889+0000 7fac6affd640 1 -- 172.21.15.19:0/3359642162 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac600041d0 con 0x7fac6c0d4fd0 2024-09-12T02:05:36.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.889+0000 7fac6affd640 1 -- 172.21.15.19:0/3359642162 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac60003610 con 0x7fac6c0d4fd0 2024-09-12T02:05:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.890+0000 7fac7269b640 1 -- 172.21.15.19:0/3359642162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac6c0d4fd0 msgr2=0x7fac6c0cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.890+0000 7fac7269b640 1 --2- 172.21.15.19:0/3359642162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac6c0d4fd0 0x7fac6c0cf5b0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7fac6c08ca50 tx=0x7fac6002a1c0 comp rx=0 tx=0).stop 2024-09-12T02:05:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.890+0000 7fac7269b640 1 -- 172.21.15.19:0/3359642162 shutdown_connections 2024-09-12T02:05:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.890+0000 7fac7269b640 1 --2- 172.21.15.19:0/3359642162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac6c0b3650 0x7fac6c0cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.890+0000 7fac7269b640 1 --2- 172.21.15.19:0/3359642162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac6c0d4fd0 0x7fac6c0cf5b0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.890+0000 7fac7269b640 1 --2- 172.21.15.19:0/3359642162 >> v2:172.21.15.135:3300/0 conn(0x7fac6c15e760 0x7fac6c06cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.890+0000 7fac7269b640 1 -- 172.21.15.19:0/3359642162 >> 172.21.15.19:0/3359642162 conn(0x7fac6c08bfc0 msgr2=0x7fac6c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.890+0000 7fac7269b640 1 -- 172.21.15.19:0/3359642162 shutdown_connections 2024-09-12T02:05:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.890+0000 7fac7269b640 1 -- 172.21.15.19:0/3359642162 wait complete. 2024-09-12T02:05:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.891+0000 7fac7269b640 1 Processor -- start 2024-09-12T02:05:36.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.891+0000 7fac7269b640 1 -- start start 2024-09-12T02:05:36.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.892+0000 7fac7269b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac6c0b3650 0x7fac6c0b9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:36.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.892+0000 7fac7269b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac6c0d4fd0 0x7fac6c0ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:36.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.892+0000 7fac7269b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac6c15e760 0x7fac6c15c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:36.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.892+0000 7fac7269b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fac6c0d3270 con 0x7fac6c0d4fd0 2024-09-12T02:05:36.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.892+0000 7fac7269b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fac6c0d30f0 con 0x7fac6c0b3650 2024-09-12T02:05:36.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.892+0000 7fac7269b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fac6c0d33f0 con 0x7fac6c15e760 2024-09-12T02:05:36.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.892+0000 7fac6b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac6c0d4fd0 0x7fac6c0ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:36.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.892+0000 7fac6b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac6c0d4fd0 0x7fac6c0ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54876/0 (socket says 172.21.15.19:54876) 2024-09-12T02:05:36.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.892+0000 7fac6b7fe640 1 -- 172.21.15.19:0/404463217 learned_addr learned my addr 172.21.15.19:0/404463217 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:36.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.892+0000 7fac6bfff640 1 --2- 172.21.15.19:0/404463217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac6c0b3650 0x7fac6c0b9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:36.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.892+0000 7fac70c38640 1 --2- 172.21.15.19:0/404463217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac6c15e760 0x7fac6c15c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:36.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.892+0000 7fac6b7fe640 1 -- 172.21.15.19:0/404463217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac6c15e760 msgr2=0x7fac6c15c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:36.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.892+0000 7fac6b7fe640 1 --2- 172.21.15.19:0/404463217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac6c15e760 0x7fac6c15c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:36.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.892+0000 7fac6b7fe640 1 -- 172.21.15.19:0/404463217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac6c0b3650 msgr2=0x7fac6c0b9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:36.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.892+0000 7fac6b7fe640 1 --2- 172.21.15.19:0/404463217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac6c0b3650 0x7fac6c0b9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:36.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.893+0000 7fac6b7fe640 1 -- 172.21.15.19:0/404463217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac6c0b9e60 con 0x7fac6c0d4fd0 2024-09-12T02:05:36.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.893+0000 7fac6b7fe640 1 --2- 172.21.15.19:0/404463217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac6c0d4fd0 0x7fac6c0ce290 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fac60034040 tx=0x7fac600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:36.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.893+0000 7fac68ff9640 1 -- 172.21.15.19:0/404463217 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac60041020 con 0x7fac6c0d4fd0 2024-09-12T02:05:36.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.893+0000 7fac68ff9640 1 -- 172.21.15.19:0/404463217 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac60003c50 con 0x7fac6c0d4fd0 2024-09-12T02:05:36.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.893+0000 7fac7269b640 1 -- 172.21.15.19:0/404463217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac6c0ccf10 con 0x7fac6c0d4fd0 2024-09-12T02:05:36.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.893+0000 7fac68ff9640 1 -- 172.21.15.19:0/404463217 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac60004030 con 0x7fac6c0d4fd0 2024-09-12T02:05:36.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.893+0000 7fac7269b640 1 -- 172.21.15.19:0/404463217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac6c0cd4d0 con 0x7fac6c0d4fd0 2024-09-12T02:05:36.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.894+0000 7fac7269b640 1 -- 172.21.15.19:0/404463217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac6c06cdd0 con 0x7fac6c0d4fd0 2024-09-12T02:05:36.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.895+0000 7fac68ff9640 1 -- 172.21.15.19:0/404463217 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac60044020 con 0x7fac6c0d4fd0 2024-09-12T02:05:36.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.895+0000 7fac68ff9640 1 --2- 172.21.15.19:0/404463217 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac5806be30 0x7fac5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:36.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.895+0000 7fac68ff9640 1 -- 172.21.15.19:0/404463217 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7fac600ac520 con 0x7fac6c0d4fd0 2024-09-12T02:05:36.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.895+0000 7fac6bfff640 1 --2- 172.21.15.19:0/404463217 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac5806be30 0x7fac5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:36.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.896+0000 7fac6bfff640 1 --2- 172.21.15.19:0/404463217 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac5806be30 0x7fac5806e2f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fac6c15eef0 tx=0x7fac5c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:36.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:36.899+0000 7fac68ff9640 1 -- 172.21.15.19:0/404463217 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac6004b030 con 0x7fac6c0d4fd0 2024-09-12T02:05:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.113+0000 7fac7269b640 1 -- 172.21.15.19:0/404463217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac6c0d4710 con 0x7fac6c0d4fd0 2024-09-12T02:05:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.113+0000 7fac68ff9640 1 -- 172.21.15.19:0/404463217 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 264 v264) ==== 95+0+5234 (secure 0 0 0) 0x7fac6c0b9e60 con 0x7fac6c0d4fd0 2024-09-12T02:05:37.114 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:37.114 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":264,"btime":"2024-09-12T02:05:31:897961+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":264,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:31.897954+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"c","rank":0,"incarnation":261,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6834/3818656517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3818656517},{"type":"v1","addr":"172.21.15.19:6834","nonce":3818656517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9711,"qdb_cluster":[9711]},"id":6}]} 2024-09-12T02:05:37.114 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 264 2024-09-12T02:05:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.115+0000 7fac7269b640 1 -- 172.21.15.19:0/404463217 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac5806be30 msgr2=0x7fac5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.115+0000 7fac7269b640 1 --2- 172.21.15.19:0/404463217 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac5806be30 0x7fac5806e2f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fac6c15eef0 tx=0x7fac5c008040 comp rx=0 tx=0).stop 2024-09-12T02:05:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.115+0000 7fac7269b640 1 -- 172.21.15.19:0/404463217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac6c0d4fd0 msgr2=0x7fac6c0ce290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.115+0000 7fac7269b640 1 --2- 172.21.15.19:0/404463217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac6c0d4fd0 0x7fac6c0ce290 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fac60034040 tx=0x7fac600046c0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.115+0000 7fac7269b640 1 -- 172.21.15.19:0/404463217 shutdown_connections 2024-09-12T02:05:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.115+0000 7fac7269b640 1 --2- 172.21.15.19:0/404463217 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fac5806be30 0x7fac5806e2f0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.115+0000 7fac7269b640 1 --2- 172.21.15.19:0/404463217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac6c15e760 0x7fac6c15c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.115+0000 7fac7269b640 1 --2- 172.21.15.19:0/404463217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac6c0d4fd0 0x7fac6c0ce290 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.115+0000 7fac7269b640 1 --2- 172.21.15.19:0/404463217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac6c0b3650 0x7fac6c0b9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.115+0000 7fac7269b640 1 -- 172.21.15.19:0/404463217 >> 172.21.15.19:0/404463217 conn(0x7fac6c08bfc0 msgr2=0x7fac6c06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:37.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.115+0000 7fac7269b640 1 -- 172.21.15.19:0/404463217 shutdown_connections 2024-09-12T02:05:37.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.115+0000 7fac7269b640 1 -- 172.21.15.19:0/404463217 wait complete. 2024-09-12T02:05:37.127 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-09-12T02:05:37.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.230+0000 7f4f0d2d7640 1 Processor -- start 2024-09-12T02:05:37.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.230+0000 7f4f0d2d7640 1 -- start start 2024-09-12T02:05:37.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.231+0000 7f4f0d2d7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0809b9c0 0x7f4f080b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.231+0000 7f4f0d2d7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4f0809aa30 0x7f4f0809ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.231+0000 7f4f0d2d7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f080afcd0 con 0x7f4f0815c620 2024-09-12T02:05:37.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.231+0000 7f4f0d2d7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f4f080b0600 con 0x7f4f0809aa30 2024-09-12T02:05:37.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.231+0000 7f4f0d2d7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4f0809b3a0 con 0x7f4f0809b9c0 2024-09-12T02:05:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.231+0000 7f4f077fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4f0809aa30 0x7f4f0809ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.231+0000 7f4f067fc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0809b9c0 0x7f4f080b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.231+0000 7f4f06ffd640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f4f0815c620 0x7f4f080b0a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:52940/0 (socket says 172.21.15.19:52940) 2024-09-12T02:05:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.231+0000 7f4f06ffd640 1 -- 172.21.15.19:0/332665014 learned_addr learned my addr 172.21.15.19:0/332665014 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.232+0000 7f4f067fc640 1 -- 172.21.15.19:0/332665014 >> v2:172.21.15.135:3300/0 conn(0x7f4f0809aa30 msgr2=0x7f4f0809ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.232+0000 7f4f067fc640 1 --2- 172.21.15.19:0/332665014 >> v2:172.21.15.135:3300/0 conn(0x7f4f0809aa30 0x7f4f0809ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.232+0000 7f4f067fc640 1 -- 172.21.15.19:0/332665014 >> v1:172.21.15.135:6789/0 conn(0x7f4f0815c620 legacy=0x7f4f080b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.232+0000 7f4f067fc640 1 -- 172.21.15.19:0/332665014 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f080affb0 con 0x7f4f0809b9c0 2024-09-12T02:05:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.232+0000 7f4f077fe640 1 --2- 172.21.15.19:0/332665014 >> v2:172.21.15.135:3300/0 conn(0x7f4f0809aa30 0x7f4f0809ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:05:37.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.232+0000 7f4f067fc640 1 --2- 172.21.15.19:0/332665014 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0809b9c0 0x7f4f080b67a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4f080b0780 tx=0x7f4efc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=990de285d8f07546 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:37.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.232+0000 7f4f05ffb640 1 -- 172.21.15.19:0/332665014 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc037070 con 0x7f4f0809b9c0 2024-09-12T02:05:37.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.233+0000 7f4f05ffb640 1 -- 172.21.15.19:0/332665014 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4efc032440 con 0x7f4f0809b9c0 2024-09-12T02:05:37.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.233+0000 7f4f05ffb640 1 -- 172.21.15.19:0/332665014 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc032810 con 0x7f4f0809b9c0 2024-09-12T02:05:37.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.233+0000 7f4f0d2d7640 1 -- 172.21.15.19:0/332665014 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0809b9c0 msgr2=0x7f4f080b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.233+0000 7f4f0d2d7640 1 --2- 172.21.15.19:0/332665014 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0809b9c0 0x7f4f080b67a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4f080b0780 tx=0x7f4efc02a180 comp rx=0 tx=0).stop 2024-09-12T02:05:37.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.233+0000 7f4f0d2d7640 1 -- 172.21.15.19:0/332665014 shutdown_connections 2024-09-12T02:05:37.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.233+0000 7f4f0d2d7640 1 --2- 172.21.15.19:0/332665014 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0809b9c0 0x7f4f080b67a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.233+0000 7f4f0d2d7640 1 --2- 172.21.15.19:0/332665014 >> v2:172.21.15.135:3300/0 conn(0x7f4f0809aa30 0x7f4f0809ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.233+0000 7f4f0d2d7640 1 -- 172.21.15.19:0/332665014 >> 172.21.15.19:0/332665014 conn(0x7f4f080b79e0 msgr2=0x7f4f080b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:37.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.233+0000 7f4f0d2d7640 1 -- 172.21.15.19:0/332665014 shutdown_connections 2024-09-12T02:05:37.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.233+0000 7f4f0d2d7640 1 -- 172.21.15.19:0/332665014 wait complete. 2024-09-12T02:05:37.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.234+0000 7f4f0d2d7640 1 Processor -- start 2024-09-12T02:05:37.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.235+0000 7f4f0d2d7640 1 -- start start 2024-09-12T02:05:37.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.235+0000 7f4f0d2d7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f0809aa30 0x7f4f08150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.235+0000 7f4f0d2d7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0809b9c0 0x7f4f08151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.235+0000 7f4f0d2d7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f0806e090 0x7f4f08151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.235+0000 7f4f0d2d7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4f080af980 con 0x7f4f0806e090 2024-09-12T02:05:37.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.235+0000 7f4f0d2d7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f080b17a0 con 0x7f4f0809aa30 2024-09-12T02:05:37.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.235+0000 7f4f0d2d7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4f0806fdb0 con 0x7f4f0809b9c0 2024-09-12T02:05:37.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.235+0000 7f4f077fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f0806e090 0x7f4f08151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.235+0000 7f4f077fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f0806e090 0x7f4f08151160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54884/0 (socket says 172.21.15.19:54884) 2024-09-12T02:05:37.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.235+0000 7f4f077fe640 1 -- 172.21.15.19:0/3238428390 learned_addr learned my addr 172.21.15.19:0/3238428390 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:37.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.235+0000 7f4f06ffd640 1 --2- 172.21.15.19:0/3238428390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f0809aa30 0x7f4f08150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.235+0000 7f4f067fc640 1 --2- 172.21.15.19:0/3238428390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0809b9c0 0x7f4f08151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.236+0000 7f4f077fe640 1 -- 172.21.15.19:0/3238428390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0809b9c0 msgr2=0x7f4f08151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.236+0000 7f4f077fe640 1 --2- 172.21.15.19:0/3238428390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0809b9c0 0x7f4f08151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.236+0000 7f4f077fe640 1 -- 172.21.15.19:0/3238428390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f0809aa30 msgr2=0x7f4f08150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.236+0000 7f4f077fe640 1 --2- 172.21.15.19:0/3238428390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f0809aa30 0x7f4f08150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.236+0000 7f4f077fe640 1 -- 172.21.15.19:0/3238428390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f08152260 con 0x7f4f0806e090 2024-09-12T02:05:37.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.236+0000 7f4f077fe640 1 --2- 172.21.15.19:0/3238428390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f0806e090 0x7f4f08151160 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000efc0 tx=0x7f4f00009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:37.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.236+0000 7f4eef7fe640 1 -- 172.21.15.19:0/3238428390 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f00018030 con 0x7f4f0806e090 2024-09-12T02:05:37.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.236+0000 7f4eef7fe640 1 -- 172.21.15.19:0/3238428390 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f0000cde0 con 0x7f4f0806e090 2024-09-12T02:05:37.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.236+0000 7f4f0d2d7640 1 -- 172.21.15.19:0/3238428390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f08154b90 con 0x7f4f0806e090 2024-09-12T02:05:37.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.236+0000 7f4eef7fe640 1 -- 172.21.15.19:0/3238428390 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f00003bb0 con 0x7f4f0806e090 2024-09-12T02:05:37.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.236+0000 7f4f0d2d7640 1 -- 172.21.15.19:0/3238428390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f0814f920 con 0x7f4f0806e090 2024-09-12T02:05:37.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.238+0000 7f4eef7fe640 1 -- 172.21.15.19:0/3238428390 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f00005d10 con 0x7f4f0806e090 2024-09-12T02:05:37.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.238+0000 7f4eef7fe640 1 --2- 172.21.15.19:0/3238428390 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4ef406be30 0x7f4ef406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.238+0000 7f4eef7fe640 1 -- 172.21.15.19:0/3238428390 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7f4f0008c4d0 con 0x7f4f0806e090 2024-09-12T02:05:37.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.239+0000 7f4f06ffd640 1 --2- 172.21.15.19:0/3238428390 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4ef406be30 0x7f4ef406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.239+0000 7f4f06ffd640 1 --2- 172.21.15.19:0/3238428390 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4ef406be30 0x7f4ef406e2f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8007fd0 tx=0x7f4ef8007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:37.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.239+0000 7f4f10072740 1 Processor -- start 2024-09-12T02:05:37.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.240+0000 7f4f10072740 1 -- start start 2024-09-12T02:05:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.240+0000 7f4f10072740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e63f00 0x556690e642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.240+0000 7f4f10072740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e616c0 0x556690e63250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.240+0000 7f4f10072740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e61b20 0x556690e43e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.240+0000 7f4f10072740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556690d80930 con 0x556690e63f00 2024-09-12T02:05:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.240+0000 7f4f10072740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556690d28570 con 0x556690e616c0 2024-09-12T02:05:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.240+0000 7f4f10072740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556690d7c8f0 con 0x556690e61b20 2024-09-12T02:05:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.240+0000 7f4f06ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e63f00 0x556690e642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.240+0000 7f4f06ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e63f00 0x556690e642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54890/0 (socket says 172.21.15.19:54890) 2024-09-12T02:05:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.240+0000 7f4f06ffd640 1 -- 172.21.15.19:0/4258971913 learned_addr learned my addr 172.21.15.19:0/4258971913 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.241+0000 7f4f077fe640 1 --2- 172.21.15.19:0/4258971913 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e61b20 0x556690e43e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.241+0000 7f4f067fc640 1 --2- 172.21.15.19:0/4258971913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e616c0 0x556690e63250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.241+0000 7f4f06ffd640 1 -- 172.21.15.19:0/4258971913 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e61b20 msgr2=0x556690e43e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:37.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.241+0000 7f4f06ffd640 1 --2- 172.21.15.19:0/4258971913 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e61b20 0x556690e43e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.241+0000 7f4f06ffd640 1 -- 172.21.15.19:0/4258971913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e616c0 msgr2=0x556690e63250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:37.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.241+0000 7f4f06ffd640 1 --2- 172.21.15.19:0/4258971913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e616c0 0x556690e63250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.241+0000 7f4f06ffd640 1 -- 172.21.15.19:0/4258971913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556690d3d200 con 0x556690e63f00 2024-09-12T02:05:37.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.241+0000 7f4f06ffd640 1 --2- 172.21.15.19:0/4258971913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e63f00 0x556690e642e0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8001780 tx=0x7f4ef8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185c82e9e1bbf048 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:37.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.241+0000 7f4eecff9640 1 -- 172.21.15.19:0/4258971913 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8026070 con 0x556690e63f00 2024-09-12T02:05:37.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.241+0000 7f4eecff9640 1 -- 172.21.15.19:0/4258971913 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef8001d00 con 0x556690e63f00 2024-09-12T02:05:37.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.241+0000 7f4eecff9640 1 -- 172.21.15.19:0/4258971913 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8013d80 con 0x556690e63f00 2024-09-12T02:05:37.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.242+0000 7f4f10072740 1 -- 172.21.15.19:0/4258971913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e63f00 msgr2=0x556690e642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.242+0000 7f4f10072740 1 --2- 172.21.15.19:0/4258971913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e63f00 0x556690e642e0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8001780 tx=0x7f4ef8013000 comp rx=0 tx=0).stop 2024-09-12T02:05:37.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.242+0000 7f4f10072740 1 -- 172.21.15.19:0/4258971913 shutdown_connections 2024-09-12T02:05:37.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.242+0000 7f4f10072740 1 --2- 172.21.15.19:0/4258971913 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e61b20 0x556690e43e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.242+0000 7f4f10072740 1 --2- 172.21.15.19:0/4258971913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e616c0 0x556690e63250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.242+0000 7f4f10072740 1 --2- 172.21.15.19:0/4258971913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e63f00 0x556690e642e0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.242+0000 7f4f10072740 1 -- 172.21.15.19:0/4258971913 >> 172.21.15.19:0/4258971913 conn(0x556690e19df0 msgr2=0x556690e61f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:37.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.242+0000 7f4f10072740 1 -- 172.21.15.19:0/4258971913 shutdown_connections 2024-09-12T02:05:37.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.242+0000 7f4f10072740 1 -- 172.21.15.19:0/4258971913 wait complete. 2024-09-12T02:05:37.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.242+0000 7f4f10072740 1 -- start start 2024-09-12T02:05:37.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.243+0000 7f4f10072740 1 Processor -- start 2024-09-12T02:05:37.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.243+0000 7f4f10072740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 0x556690e1b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.243+0000 7f4f10072740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e63f00 0x556690e43c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.243+0000 7f4f10072740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e76840 0x556690e441a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.243+0000 7f4f10072740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556690e60620 con 0x556690e61b20 2024-09-12T02:05:37.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.243+0000 7f4f10072740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556690d096a0 con 0x556690e63f00 2024-09-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.243+0000 7f4f10072740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556690e60900 con 0x556690e76840 2024-09-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.243+0000 7f4f10072740 10 client.0 _ll_register_callbacks cb 0x556690d41300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.243+0000 7f4f06ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 0x556690e1b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.243+0000 7f4f06ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 0x556690e1b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54904/0 (socket says 172.21.15.19:54904) 2024-09-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.243+0000 7f4f06ffd640 1 -- 172.21.15.19:0/2239596987 learned_addr learned my addr 172.21.15.19:0/2239596987 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.244+0000 7f4f067fc640 1 --2- 172.21.15.19:0/2239596987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e63f00 0x556690e43c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.244+0000 7f4f06ffd640 1 -- 172.21.15.19:0/2239596987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e76840 msgr2=0x556690e441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.244+0000 7f4f06ffd640 1 --2- 172.21.15.19:0/2239596987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e76840 0x556690e441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.244+0000 7f4f06ffd640 1 -- 172.21.15.19:0/2239596987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e63f00 msgr2=0x556690e43c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.244+0000 7f4f06ffd640 1 --2- 172.21.15.19:0/2239596987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e63f00 0x556690e43c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.244+0000 7f4f06ffd640 1 -- 172.21.15.19:0/2239596987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556690b5f7c0 con 0x556690e61b20 2024-09-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.244+0000 7f4f067fc640 1 --2- 172.21.15.19:0/2239596987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e63f00 0x556690e43c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.244+0000 7f4f06ffd640 1 --2- 172.21.15.19:0/2239596987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 0x556690e1b100 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8007bc0 tx=0x7f4ef8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb26282f1fcf8d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.244+0000 7f4ee5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:05:37.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.244+0000 7f4ee5ffb640 1 -- 172.21.15.19:0/2239596987 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8030060 con 0x556690e61b20 2024-09-12T02:05:37.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.244+0000 7f4f10072740 1 -- 172.21.15.19:0/2239596987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ef8001d00 con 0x556690e61b20 2024-09-12T02:05:37.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.244+0000 7f4ee5ffb640 1 -- 172.21.15.19:0/2239596987 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7f4ef8022070 con 0x556690e61b20 2024-09-12T02:05:37.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.244+0000 7f4ee5ffb640 1 -- 172.21.15.19:0/2239596987 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=264) ==== 24+0+0 (secure 0 0 0) 0x7f4ef8037050 con 0x556690e61b20 2024-09-12T02:05:37.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.244+0000 7f4f10072740 10 client.9825 fetch_fsmap learned FSMap version 264 2024-09-12T02:05:37.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.244+0000 7f4f10072740 1 -- 172.21.15.19:0/2239596987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=264,monmap=2+}) -- 0x556690bbff50 con 0x556690e61b20 2024-09-12T02:05:37.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.244+0000 7f4ee5ffb640 1 -- 172.21.15.19:0/2239596987 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef8001d00 con 0x556690e61b20 2024-09-12T02:05:37.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.245+0000 7f4ee5ffb640 1 -- 172.21.15.19:0/2239596987 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 264) ==== 3502+0+0 (secure 0 0 0) 0x7f4ef8022540 con 0x556690e61b20 2024-09-12T02:05:37.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.245+0000 7f4f10072740 10 client.9825 fetch_fsmap finished waiting for FSMap version 264 2024-09-12T02:05:37.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.245+0000 7f4f10072740 10 client.9825 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:05:37.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.245+0000 7f4f10072740 20 client.9825 populate_metadata read hostname 'smithi019' 2024-09-12T02:05:37.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.245+0000 7f4f10072740 1 --2- 172.21.15.19:0/2239596987 >> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] conn(0x556690e7e1a0 0x556690e80590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.245+0000 7f4f10072740 4 client.9825 mds_command: new command op to 9711 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:05:37.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.245+0000 7f4f10072740 1 -- 172.21.15.19:0/2239596987 --> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556690d8e060 con 0x556690e7e1a0 2024-09-12T02:05:37.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.245+0000 7f4f067fc640 1 --2- 172.21.15.19:0/2239596987 >> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] conn(0x556690e7e1a0 0x556690e80590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.245+0000 7f4ee5ffb640 10 client.9825 ms_handle_connect on v2:172.21.15.19:6832/3818656517 2024-09-12T02:05:37.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.245+0000 7f4f067fc640 1 --2- 172.21.15.19:0/2239596987 >> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] conn(0x556690e7e1a0 0x556690e80590 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cb6258d41e00b92 server_cookie=eb77363e913b6d3b in_seq=0 out_seq=0 2024-09-12T02:05:37.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.246+0000 7f4ee5ffb640 1 -- 172.21.15.19:0/2239596987 <== mds.0 v2:172.21.15.19:6832/3818656517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556690d8e060 con 0x556690e7e1a0 2024-09-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.246+0000 7f4ee5ffb640 10 client.9825 handle_command_reply: tid=0 2024-09-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.246+0000 7f4f10072740 1 client.9825 shutdown 2024-09-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.246+0000 7f4f10072740 1 -- 172.21.15.19:0/2239596987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 msgr2=0x556690e1b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.246+0000 7f4f10072740 1 --2- 172.21.15.19:0/2239596987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 0x556690e1b100 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8007bc0 tx=0x7f4ef8000bc0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.246+0000 7f4f10072740 1 -- 172.21.15.19:0/2239596987 shutdown_connections 2024-09-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.246+0000 7f4f10072740 1 --2- 172.21.15.19:0/2239596987 >> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] conn(0x556690e7e1a0 0x556690e80590 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.246+0000 7f4f10072740 1 --2- 172.21.15.19:0/2239596987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e76840 0x556690e441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.246+0000 7f4f10072740 1 --2- 172.21.15.19:0/2239596987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e63f00 0x556690e43c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.246+0000 7f4f10072740 1 --2- 172.21.15.19:0/2239596987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 0x556690e1b100 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.246+0000 7f4ee5ffb640 0 client.9825 ms_handle_reset on v2:172.21.15.19:6832/3818656517 2024-09-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.246+0000 7f4f10072740 1 -- 172.21.15.19:0/2239596987 >> 172.21.15.19:0/2239596987 conn(0x556690e616c0 msgr2=0x556690e654d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.246+0000 7f4f10072740 1 -- 172.21.15.19:0/2239596987 shutdown_connections 2024-09-12T02:05:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.246+0000 7f4f10072740 1 -- 172.21.15.19:0/2239596987 wait complete. 2024-09-12T02:05:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.246+0000 7f4f10072740 20 client.9825 trim_cache size 0 max 16384 2024-09-12T02:05:37.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.259+0000 7f4f10072740 1 Processor -- start 2024-09-12T02:05:37.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.259+0000 7f4f10072740 1 -- start start 2024-09-12T02:05:37.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.260+0000 7f4f10072740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 0x556690e43ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.260+0000 7f4f10072740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e63f00 0x556690e440e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.260+0000 7f4f10072740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e76840 0x556690e71310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.260+0000 7f4f10072740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4f08201e40 con 0x556690e61b20 2024-09-12T02:05:37.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.260+0000 7f4f10072740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f082011a0 con 0x556690e76840 2024-09-12T02:05:37.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.260+0000 7f4f10072740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4f082017f0 con 0x556690e63f00 2024-09-12T02:05:37.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.260+0000 7f4f06ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 0x556690e43ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.260+0000 7f4f06ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 0x556690e43ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54920/0 (socket says 172.21.15.19:54920) 2024-09-12T02:05:37.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.260+0000 7f4f06ffd640 1 -- 172.21.15.19:0/3087974119 learned_addr learned my addr 172.21.15.19:0/3087974119 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:37.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.260+0000 7f4f06ffd640 1 -- 172.21.15.19:0/3087974119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e63f00 msgr2=0x556690e440e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:37.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.260+0000 7f4f06ffd640 1 --2- 172.21.15.19:0/3087974119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e63f00 0x556690e440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.260+0000 7f4f06ffd640 1 -- 172.21.15.19:0/3087974119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e76840 msgr2=0x556690e71310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:37.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.260+0000 7f4f06ffd640 1 --2- 172.21.15.19:0/3087974119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e76840 0x556690e71310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.260+0000 7f4f06ffd640 1 -- 172.21.15.19:0/3087974119 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556690a530b0 con 0x556690e61b20 2024-09-12T02:05:37.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.260+0000 7f4f06ffd640 1 --2- 172.21.15.19:0/3087974119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 0x556690e43ba0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8007c70 tx=0x7f4ef8027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f8abbc25c48722 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:37.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.260+0000 7f4ee7fff640 1 -- 172.21.15.19:0/3087974119 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8022e60 con 0x556690e61b20 2024-09-12T02:05:37.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.260+0000 7f4ee7fff640 1 -- 172.21.15.19:0/3087974119 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef8001d00 con 0x556690e61b20 2024-09-12T02:05:37.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.260+0000 7f4ee7fff640 1 -- 172.21.15.19:0/3087974119 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8030040 con 0x556690e61b20 2024-09-12T02:05:37.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.261+0000 7f4f10072740 1 -- 172.21.15.19:0/3087974119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 msgr2=0x556690e43ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.261+0000 7f4f10072740 1 --2- 172.21.15.19:0/3087974119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 0x556690e43ba0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8007c70 tx=0x7f4ef8027000 comp rx=0 tx=0).stop 2024-09-12T02:05:37.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.261+0000 7f4f10072740 1 -- 172.21.15.19:0/3087974119 shutdown_connections 2024-09-12T02:05:37.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.261+0000 7f4f10072740 1 --2- 172.21.15.19:0/3087974119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e76840 0x556690e71310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.261+0000 7f4f10072740 1 --2- 172.21.15.19:0/3087974119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e63f00 0x556690e440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.261+0000 7f4f10072740 1 --2- 172.21.15.19:0/3087974119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 0x556690e43ba0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.261+0000 7f4f10072740 1 -- 172.21.15.19:0/3087974119 >> 172.21.15.19:0/3087974119 conn(0x556690e616c0 msgr2=0x556690e586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:37.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.261+0000 7f4f10072740 1 -- 172.21.15.19:0/3087974119 shutdown_connections 2024-09-12T02:05:37.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.261+0000 7f4f10072740 1 -- 172.21.15.19:0/3087974119 wait complete. 2024-09-12T02:05:37.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.262+0000 7f4f10072740 1 -- start start 2024-09-12T02:05:37.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.262+0000 7f4f10072740 1 Processor -- start 2024-09-12T02:05:37.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.262+0000 7f4f10072740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 0x556690edfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.262+0000 7f4f10072740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e63f00 0x556690e75ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.262+0000 7f4f10072740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e76840 0x556690e76220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.262+0000 7f4f10072740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556690e45040 con 0x556690e61b20 2024-09-12T02:05:37.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.262+0000 7f4f10072740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556690e45280 con 0x556690e76840 2024-09-12T02:05:37.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.262+0000 7f4f10072740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556690e73540 con 0x556690e63f00 2024-09-12T02:05:37.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.262+0000 7f4f10072740 10 client.0 _ll_register_callbacks cb 0x7f4ef8024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:05:37.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4f06ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 0x556690edfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4f06ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 0x556690edfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54926/0 (socket says 172.21.15.19:54926) 2024-09-12T02:05:37.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4f06ffd640 1 -- 172.21.15.19:0/3303784120 learned_addr learned my addr 172.21.15.19:0/3303784120 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:37.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4f067fc640 1 --2- 172.21.15.19:0/3303784120 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e63f00 0x556690e75ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4f077fe640 1 --2- 172.21.15.19:0/3303784120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e76840 0x556690e76220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4f06ffd640 1 -- 172.21.15.19:0/3303784120 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e63f00 msgr2=0x556690e75ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:37.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4f06ffd640 1 --2- 172.21.15.19:0/3303784120 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e63f00 0x556690e75ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4f06ffd640 1 -- 172.21.15.19:0/3303784120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e76840 msgr2=0x556690e76220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:37.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4f06ffd640 1 --2- 172.21.15.19:0/3303784120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e76840 0x556690e76220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4f06ffd640 1 -- 172.21.15.19:0/3303784120 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556690e43cd0 con 0x556690e61b20 2024-09-12T02:05:37.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4f067fc640 1 --2- 172.21.15.19:0/3303784120 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e63f00 0x556690e75ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:37.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4f06ffd640 1 --2- 172.21.15.19:0/3303784120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 0x556690edfd40 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80012a0 tx=0x7f4ef8009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930a8f93e8889f27 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:37.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4ee5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:05:37.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4ee5ffb640 1 -- 172.21.15.19:0/3303784120 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8022e60 con 0x556690e61b20 2024-09-12T02:05:37.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4ee5ffb640 1 -- 172.21.15.19:0/3303784120 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7f4ef80222c0 con 0x556690e61b20 2024-09-12T02:05:37.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4f10072740 1 -- 172.21.15.19:0/3303784120 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ef8001d00 con 0x556690e61b20 2024-09-12T02:05:37.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4ee5ffb640 1 -- 172.21.15.19:0/3303784120 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=264) ==== 24+0+0 (secure 0 0 0) 0x7f4ef8030040 con 0x556690e61b20 2024-09-12T02:05:37.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4f10072740 10 client.9831 fetch_fsmap learned FSMap version 264 2024-09-12T02:05:37.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4f10072740 1 -- 172.21.15.19:0/3303784120 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=264,monmap=2+}) -- 0x556690e43cd0 con 0x556690e61b20 2024-09-12T02:05:37.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.263+0000 7f4ee5ffb640 1 -- 172.21.15.19:0/3303784120 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef8001d00 con 0x556690e61b20 2024-09-12T02:05:37.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4ee5ffb640 1 -- 172.21.15.19:0/3303784120 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 264) ==== 3502+0+0 (secure 0 0 0) 0x7f4ef80224c0 con 0x556690e61b20 2024-09-12T02:05:37.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f10072740 10 client.9831 fetch_fsmap finished waiting for FSMap version 264 2024-09-12T02:05:37.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f10072740 10 client.9831 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:05:37.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f10072740 20 client.9831 populate_metadata read hostname 'smithi019' 2024-09-12T02:05:37.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f10072740 1 --2- 172.21.15.19:0/3303784120 >> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] conn(0x556690e42d40 0x556690e43120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f10072740 4 client.9831 mds_command: new command op to 9711 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-09-12T02:05:37.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f10072740 1 -- 172.21.15.19:0/3303784120 --> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x556690d883b0 con 0x556690e42d40 2024-09-12T02:05:37.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f067fc640 1 --2- 172.21.15.19:0/3303784120 >> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] conn(0x556690e42d40 0x556690e43120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f067fc640 1 --2- 172.21.15.19:0/3303784120 >> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] conn(0x556690e42d40 0x556690e43120 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fce280a10170ff1 server_cookie=ed09fab820326677 in_seq=0 out_seq=0 2024-09-12T02:05:37.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4ee5ffb640 10 client.9831 ms_handle_connect on v2:172.21.15.19:6832/3818656517 2024-09-12T02:05:37.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4ee5ffb640 1 -- 172.21.15.19:0/3303784120 <== mds.0 v2:172.21.15.19:6832/3818656517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+215 (crc 0 0 0) 0x556690d883b0 con 0x556690e42d40 2024-09-12T02:05:37.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4ee5ffb640 10 client.9831 handle_command_reply: tid=0 2024-09-12T02:05:37.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f10072740 1 client.9831 shutdown 2024-09-12T02:05:37.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f10072740 1 -- 172.21.15.19:0/3303784120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 msgr2=0x556690edfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f10072740 1 --2- 172.21.15.19:0/3303784120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 0x556690edfd40 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80012a0 tx=0x7f4ef8009030 comp rx=0 tx=0).stop 2024-09-12T02:05:37.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f10072740 1 -- 172.21.15.19:0/3303784120 shutdown_connections 2024-09-12T02:05:37.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f10072740 1 --2- 172.21.15.19:0/3303784120 >> [v2:172.21.15.19:6832/3818656517,v1:172.21.15.19:6834/3818656517] conn(0x556690e42d40 0x556690e43120 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f10072740 1 --2- 172.21.15.19:0/3303784120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556690e76840 0x556690e76220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f10072740 1 --2- 172.21.15.19:0/3303784120 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556690e63f00 0x556690e75ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4ee5ffb640 0 client.9831 ms_handle_reset on v2:172.21.15.19:6832/3818656517 2024-09-12T02:05:37.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f10072740 1 --2- 172.21.15.19:0/3303784120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556690e61b20 0x556690edfd40 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f10072740 1 -- 172.21.15.19:0/3303784120 >> 172.21.15.19:0/3303784120 conn(0x556690e616c0 msgr2=0x556690e47320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:37.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f10072740 1 -- 172.21.15.19:0/3303784120 shutdown_connections 2024-09-12T02:05:37.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.264+0000 7f4f10072740 1 -- 172.21.15.19:0/3303784120 wait complete. 2024-09-12T02:05:37.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.265+0000 7f4f10072740 20 client.9831 trim_cache size 0 max 16384 2024-09-12T02:05:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:37.273 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-09-12T02:05:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:05:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: "damage_type": "dentry", 2024-09-12T02:05:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 3420949560, 2024-09-12T02:05:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: "ino": 1099511627776, 2024-09-12T02:05:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: "frag": "*", 2024-09-12T02:05:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: "dname": "sixmegs", 2024-09-12T02:05:37.273 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_id": "head", 2024-09-12T02:05:37.274 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/subdir/sixmegs" 2024-09-12T02:05:37.274 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:05:37.274 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-09-12T02:05:37.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.265+0000 7f4f0d2d7640 1 -- 172.21.15.19:0/3238428390 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4ef406be30 msgr2=0x7f4ef406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.265+0000 7f4f0d2d7640 1 --2- 172.21.15.19:0/3238428390 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4ef406be30 0x7f4ef406e2f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8007fd0 tx=0x7f4ef8007e80 comp rx=0 tx=0).stop 2024-09-12T02:05:37.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.265+0000 7f4f0d2d7640 1 -- 172.21.15.19:0/3238428390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f0806e090 msgr2=0x7f4f08151160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.265+0000 7f4f0d2d7640 1 --2- 172.21.15.19:0/3238428390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f0806e090 0x7f4f08151160 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000efc0 tx=0x7f4f00009f90 comp rx=0 tx=0).stop 2024-09-12T02:05:37.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.265+0000 7f4f0d2d7640 1 -- 172.21.15.19:0/3238428390 shutdown_connections 2024-09-12T02:05:37.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.265+0000 7f4f0d2d7640 1 --2- 172.21.15.19:0/3238428390 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4ef406be30 0x7f4ef406e2f0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.265+0000 7f4f0d2d7640 1 --2- 172.21.15.19:0/3238428390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f0806e090 0x7f4f08151160 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.265+0000 7f4f0d2d7640 1 --2- 172.21.15.19:0/3238428390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0809b9c0 0x7f4f08151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.265+0000 7f4f0d2d7640 1 --2- 172.21.15.19:0/3238428390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f0809aa30 0x7f4f08150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.265+0000 7f4f0d2d7640 1 -- 172.21.15.19:0/3238428390 >> 172.21.15.19:0/3238428390 conn(0x7f4f080b79e0 msgr2=0x7f4f08158030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:37.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.265+0000 7f4f0d2d7640 1 -- 172.21.15.19:0/3238428390 shutdown_connections 2024-09-12T02:05:37.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.265+0000 7f4f0d2d7640 1 -- 172.21.15.19:0/3238428390 wait complete. 2024-09-12T02:05:37.276 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap key 100.00000000:stray0_head' 2024-09-12T02:05:37.276 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:05:37.276 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:05:37.293 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:05:37.293 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:05:37.349 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:05:37.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.491+0000 7f8f184a5640 1 Processor -- start 2024-09-12T02:05:37.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.491+0000 7f8f184a5640 1 -- start start 2024-09-12T02:05:37.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.492+0000 7f8f184a5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f10162060 0x7f8f100b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.492+0000 7f8f184a5640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f1006d9f0 con 0x7f8f10161c80 2024-09-12T02:05:37.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.492+0000 7f8f184a5640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f1006dcd0 con 0x7f8f100b64b0 2024-09-12T02:05:37.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.492+0000 7f8f184a5640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8f1006dfb0 con 0x7f8f10162060 2024-09-12T02:05:37.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.492+0000 7f8f15a40640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f10162060 0x7f8f100b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.492+0000 7f8f16241640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8f10161c80 0x7f8f1006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53980/0 (socket says 172.21.15.19:53980) 2024-09-12T02:05:37.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.492+0000 7f8f15a40640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f10162060 0x7f8f100b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54930/0 (socket says 172.21.15.19:54930) 2024-09-12T02:05:37.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.492+0000 7f8f16241640 1 -- 172.21.15.19:0/778884978 learned_addr learned my addr 172.21.15.19:0/778884978 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:37.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.493+0000 7f8f15a40640 1 -- 172.21.15.19:0/778884978 >> v1:172.21.15.135:6789/0 conn(0x7f8f100b64b0 legacy=0x7f8f100cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:37.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.493+0000 7f8f15a40640 1 -- 172.21.15.19:0/778884978 >> v1:172.21.15.19:6789/0 conn(0x7f8f10161c80 legacy=0x7f8f1006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.493+0000 7f8f15a40640 1 -- 172.21.15.19:0/778884978 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f100d2890 con 0x7f8f10162060 2024-09-12T02:05:37.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.493+0000 7f8f1523f640 1 -- 172.21.15.19:0/778884978 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1162643866 0 0) 0x7f8f1006d9f0 con 0x7f8f10161c80 2024-09-12T02:05:37.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.493+0000 7f8f15a40640 1 --2- 172.21.15.19:0/778884978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f10162060 0x7f8f100b5f70 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f8f040097a0 tx=0x7f8f0402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781501fcf618cd8d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:37.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.494+0000 7f8f1523f640 1 -- 172.21.15.19:0/778884978 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f04037070 con 0x7f8f10162060 2024-09-12T02:05:37.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.494+0000 7f8f1523f640 1 -- 172.21.15.19:0/778884978 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f04032440 con 0x7f8f10162060 2024-09-12T02:05:37.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.494+0000 7f8f1523f640 1 -- 172.21.15.19:0/778884978 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f04032810 con 0x7f8f10162060 2024-09-12T02:05:37.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.494+0000 7f8f184a5640 1 -- 172.21.15.19:0/778884978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f10162060 msgr2=0x7f8f100b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.494+0000 7f8f184a5640 1 --2- 172.21.15.19:0/778884978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f10162060 0x7f8f100b5f70 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f8f040097a0 tx=0x7f8f0402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.494+0000 7f8f184a5640 1 -- 172.21.15.19:0/778884978 shutdown_connections 2024-09-12T02:05:37.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.494+0000 7f8f184a5640 1 --2- 172.21.15.19:0/778884978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f10162060 0x7f8f100b5f70 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.494+0000 7f8f184a5640 1 -- 172.21.15.19:0/778884978 >> 172.21.15.19:0/778884978 conn(0x7f8f100d44f0 msgr2=0x7f8f100d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:37.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.494+0000 7f8f184a5640 1 -- 172.21.15.19:0/778884978 shutdown_connections 2024-09-12T02:05:37.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.494+0000 7f8f184a5640 1 -- 172.21.15.19:0/778884978 wait complete. 2024-09-12T02:05:37.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.495+0000 7f8f184a5640 1 Processor -- start 2024-09-12T02:05:37.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.495+0000 7f8f184a5640 1 -- start start 2024-09-12T02:05:37.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.496+0000 7f8f184a5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f100b64b0 0x7f8f100b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.496+0000 7f8f184a5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f10161c80 0x7f8f10155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.496+0000 7f8f184a5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f10162060 0x7f8f100cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.496+0000 7f8f184a5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8f100b6d30 con 0x7f8f10162060 2024-09-12T02:05:37.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.496+0000 7f8f184a5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8f100b6bb0 con 0x7f8f10161c80 2024-09-12T02:05:37.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.496+0000 7f8f184a5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8f100cf8f0 con 0x7f8f100b64b0 2024-09-12T02:05:37.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.496+0000 7f8f16a42640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f10162060 0x7f8f100cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.496+0000 7f8f16a42640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f10162060 0x7f8f100cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54942/0 (socket says 172.21.15.19:54942) 2024-09-12T02:05:37.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.496+0000 7f8f16a42640 1 -- 172.21.15.19:0/2670075354 learned_addr learned my addr 172.21.15.19:0/2670075354 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:37.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.496+0000 7f8f15a40640 1 --2- 172.21.15.19:0/2670075354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f10161c80 0x7f8f10155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.496+0000 7f8f16241640 1 --2- 172.21.15.19:0/2670075354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f100b64b0 0x7f8f100b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.497+0000 7f8f16a42640 1 -- 172.21.15.19:0/2670075354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f100b64b0 msgr2=0x7f8f100b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.497+0000 7f8f16a42640 1 --2- 172.21.15.19:0/2670075354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f100b64b0 0x7f8f100b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.497+0000 7f8f16a42640 1 -- 172.21.15.19:0/2670075354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f10161c80 msgr2=0x7f8f10155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.497+0000 7f8f16a42640 1 --2- 172.21.15.19:0/2670075354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f10161c80 0x7f8f10155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.497+0000 7f8f16a42640 1 -- 172.21.15.19:0/2670075354 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f100b90c0 con 0x7f8f10162060 2024-09-12T02:05:37.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.497+0000 7f8f16a42640 1 --2- 172.21.15.19:0/2670075354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f10162060 0x7f8f100cdb30 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800c410 tx=0x7f8f0800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:37.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.497+0000 7f8f0effd640 1 -- 172.21.15.19:0/2670075354 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08011790 con 0x7f8f10162060 2024-09-12T02:05:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.497+0000 7f8f0effd640 1 -- 172.21.15.19:0/2670075354 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f08017070 con 0x7f8f10162060 2024-09-12T02:05:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.497+0000 7f8f184a5640 1 -- 172.21.15.19:0/2670075354 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f100b9390 con 0x7f8f10162060 2024-09-12T02:05:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.497+0000 7f8f0effd640 1 -- 172.21.15.19:0/2670075354 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08011bb0 con 0x7f8f10162060 2024-09-12T02:05:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.497+0000 7f8f184a5640 1 -- 172.21.15.19:0/2670075354 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f100b9950 con 0x7f8f10162060 2024-09-12T02:05:37.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.498+0000 7f8f184a5640 1 -- 172.21.15.19:0/2670075354 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f1006d9f0 con 0x7f8f10162060 2024-09-12T02:05:37.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.499+0000 7f8f0effd640 1 -- 172.21.15.19:0/2670075354 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f0801c460 con 0x7f8f10162060 2024-09-12T02:05:37.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.499+0000 7f8f0effd640 1 --2- 172.21.15.19:0/2670075354 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8efc06be30 0x7f8efc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.499+0000 7f8f0effd640 1 -- 172.21.15.19:0/2670075354 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7f8f0808b510 con 0x7f8f10162060 2024-09-12T02:05:37.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.500+0000 7f8f16241640 1 --2- 172.21.15.19:0/2670075354 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8efc06be30 0x7f8efc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.500+0000 7f8f16241640 1 --2- 172.21.15.19:0/2670075354 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8efc06be30 0x7f8efc06e2f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8f000012e0 tx=0x7f8f00001700 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:37.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.503+0000 7f8f0effd640 1 -- 172.21.15.19:0/2670075354 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f08021020 con 0x7f8f10162060 2024-09-12T02:05:37.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.690+0000 7f8f184a5640 1 -- 172.21.15.19:0/2670075354 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8f10160580 con 0x7f8f10162060 2024-09-12T02:05:37.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.691+0000 7f8f0effd640 1 -- 172.21.15.19:0/2670075354 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 62 entries v125) ==== 81+0+3796 (secure 0 0 0) 0x7f8f08058c40 con 0x7f8f10162060 2024-09-12T02:05:37.691 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3910102099 2024-09-13T02:05:24.866817+0000 2024-09-12T02:05:37.692 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/2839344629 2024-09-13T02:05:20.836728+0000 2024-09-12T02:05:37.692 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/2072535494 2024-09-13T02:02:44.440900+0000 2024-09-12T02:05:37.692 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2405422603 2024-09-13T02:04:31.542456+0000 2024-09-12T02:05:37.692 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/1875416968 2024-09-13T02:03:41.731211+0000 2024-09-12T02:05:37.692 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/4124612835 2024-09-13T02:03:35.697598+0000 2024-09-12T02:05:37.692 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/1101861733 2024-09-13T02:02:54.487980+0000 2024-09-12T02:05:37.692 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3598057058 2024-09-13T02:03:24.636971+0000 2024-09-12T02:05:37.692 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/626316140 2024-09-13T02:04:41.744221+0000 2024-09-12T02:05:37.692 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/46689513 2024-09-13T02:03:28.654366+0000 2024-09-12T02:05:37.693 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3985859189 2024-09-13T02:04:09.906953+0000 2024-09-12T02:05:37.693 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3866905323 2024-09-13T02:03:54.557384+0000 2024-09-12T02:05:37.693 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3997032797 2024-09-13T02:05:16.751616+0000 2024-09-12T02:05:37.693 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:05:37.693 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3995150987 2024-09-13T02:03:22.315702+0000 2024-09-12T02:05:37.693 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/46689513 2024-09-13T02:03:28.654366+0000 2024-09-12T02:05:37.693 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/4287312235 2024-09-13T02:03:11.277301+0000 2024-09-12T02:05:37.693 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/961161264 2024-09-13T02:04:17.973298+0000 2024-09-12T02:05:37.693 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:05:37.693 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3279314147 2024-09-13T02:04:33.778955+0000 2024-09-12T02:05:37.693 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/1800650480 2024-09-13T02:03:56.737366+0000 2024-09-12T02:05:37.693 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3279314147 2024-09-13T02:04:33.778955+0000 2024-09-12T02:05:37.694 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/4087550164 2024-09-13T02:04:57.990681+0000 2024-09-12T02:05:37.694 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2201380819 2024-09-13T02:05:10.473806+0000 2024-09-12T02:05:37.694 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3995150987 2024-09-13T02:03:22.315702+0000 2024-09-12T02:05:37.694 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/4124612835 2024-09-13T02:03:35.697598+0000 2024-09-12T02:05:37.694 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/2072535494 2024-09-13T02:02:44.440900+0000 2024-09-12T02:05:37.694 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3985859189 2024-09-13T02:04:09.906953+0000 2024-09-12T02:05:37.694 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/613869354 2024-09-13T02:02:39.104650+0000 2024-09-12T02:05:37.694 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/613869354 2024-09-13T02:02:39.104650+0000 2024-09-12T02:05:37.694 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/650556594 2024-09-13T02:02:50.470816+0000 2024-09-12T02:05:37.694 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/4287312235 2024-09-13T02:03:11.277301+0000 2024-09-12T02:05:37.694 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/650556594 2024-09-13T02:02:50.470816+0000 2024-09-12T02:05:37.694 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/4107165769 2024-09-13T02:04:03.869164+0000 2024-09-12T02:05:37.694 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/1101861733 2024-09-13T02:02:54.487980+0000 2024-09-12T02:05:37.694 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/1800650480 2024-09-13T02:03:56.737366+0000 2024-09-12T02:05:37.695 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2017831568 2024-09-13T02:04:45.871893+0000 2024-09-12T02:05:37.695 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3136344951 2024-09-13T02:02:58.521234+0000 2024-09-12T02:05:37.695 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3136344951 2024-09-13T02:02:58.521234+0000 2024-09-12T02:05:37.695 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/4107165769 2024-09-13T02:04:03.869164+0000 2024-09-12T02:05:37.695 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/926329492 2024-09-13T02:04:13.937157+0000 2024-09-12T02:05:37.695 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3866905323 2024-09-13T02:03:54.557384+0000 2024-09-12T02:05:37.695 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/926329492 2024-09-13T02:04:13.937157+0000 2024-09-12T02:05:37.695 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/961161264 2024-09-13T02:04:17.973298+0000 2024-09-12T02:05:37.695 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2201380819 2024-09-13T02:05:10.473806+0000 2024-09-12T02:05:37.695 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3910102099 2024-09-13T02:05:24.866817+0000 2024-09-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2405422603 2024-09-13T02:04:31.542456+0000 2024-09-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2333858704 2024-09-13T02:04:37.802344+0000 2024-09-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/1875416968 2024-09-13T02:03:41.731211+0000 2024-09-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2333858704 2024-09-13T02:04:37.802344+0000 2024-09-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/626316140 2024-09-13T02:04:41.744221+0000 2024-09-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2017831568 2024-09-13T02:04:45.871893+0000 2024-09-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3545886366 2024-09-13T02:04:49.907498+0000 2024-09-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3545886366 2024-09-13T02:04:49.907498+0000 2024-09-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3377480547 2024-09-13T02:04:53.949050+0000 2024-09-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3598057058 2024-09-13T02:03:24.636971+0000 2024-09-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3377480547 2024-09-13T02:04:53.949050+0000 2024-09-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/4087550164 2024-09-13T02:04:57.990681+0000 2024-09-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/2195405214 2024-09-13T02:05:12.791934+0000 2024-09-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/2195405214 2024-09-13T02:05:12.791934+0000 2024-09-12T02:05:37.697 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3997032797 2024-09-13T02:05:16.751616+0000 2024-09-12T02:05:37.697 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/2839344629 2024-09-13T02:05:20.836728+0000 2024-09-12T02:05:37.697 INFO:teuthology.orchestra.run.smithi019.stderr:listed 62 entries 2024-09-12T02:05:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.693+0000 7f8f184a5640 1 -- 172.21.15.19:0/2670075354 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8efc06be30 msgr2=0x7f8efc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.693+0000 7f8f184a5640 1 --2- 172.21.15.19:0/2670075354 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8efc06be30 0x7f8efc06e2f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8f000012e0 tx=0x7f8f00001700 comp rx=0 tx=0).stop 2024-09-12T02:05:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.693+0000 7f8f184a5640 1 -- 172.21.15.19:0/2670075354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f10162060 msgr2=0x7f8f100cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.693+0000 7f8f184a5640 1 --2- 172.21.15.19:0/2670075354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f10162060 0x7f8f100cdb30 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800c410 tx=0x7f8f0800c8d0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.693+0000 7f8f184a5640 1 -- 172.21.15.19:0/2670075354 shutdown_connections 2024-09-12T02:05:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.693+0000 7f8f184a5640 1 --2- 172.21.15.19:0/2670075354 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8efc06be30 0x7f8efc06e2f0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.693+0000 7f8f184a5640 1 --2- 172.21.15.19:0/2670075354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f10162060 0x7f8f100cdb30 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.693+0000 7f8f184a5640 1 --2- 172.21.15.19:0/2670075354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f10161c80 0x7f8f10155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.693+0000 7f8f184a5640 1 --2- 172.21.15.19:0/2670075354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f100b64b0 0x7f8f100b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.693+0000 7f8f184a5640 1 -- 172.21.15.19:0/2670075354 >> 172.21.15.19:0/2670075354 conn(0x7f8f100d44f0 msgr2=0x7f8f100746d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:37.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.693+0000 7f8f184a5640 1 -- 172.21.15.19:0/2670075354 shutdown_connections 2024-09-12T02:05:37.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.693+0000 7f8f184a5640 1 -- 172.21.15.19:0/2670075354 wait complete. 2024-09-12T02:05:37.704 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:05:37.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:37.704 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-12T02:05:37.731 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:05:37.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:37.731 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:05:37.788 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:05:37.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.931+0000 7fd9fd511640 1 Processor -- start 2024-09-12T02:05:37.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.931+0000 7fd9fd511640 1 -- start start 2024-09-12T02:05:37.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.932+0000 7fd9fd511640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd9f80d06e0 0x7fd9f80ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.932+0000 7fd9fd511640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9f80d00a0 con 0x7fd9f815d3e0 2024-09-12T02:05:37.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.932+0000 7fd9fd511640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9f80d0380 con 0x7fd9f809b510 2024-09-12T02:05:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.932+0000 7fd9fd511640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd9f809b080 con 0x7fd9f80d06e0 2024-09-12T02:05:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.932+0000 7fd9f6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd9f80d06e0 0x7fd9f80ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.932+0000 7fd9f67fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd9f815d3e0 0x7fd9f80d0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53984/0 (socket says 172.21.15.19:53984) 2024-09-12T02:05:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.932+0000 7fd9f67fc640 1 -- 172.21.15.19:0/2415922317 learned_addr learned my addr 172.21.15.19:0/2415922317 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.933+0000 7fd9f6ffd640 1 -- 172.21.15.19:0/2415922317 >> v1:172.21.15.135:6789/0 conn(0x7fd9f809b510 legacy=0x7fd9f80ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.933+0000 7fd9f6ffd640 1 -- 172.21.15.19:0/2415922317 >> v1:172.21.15.19:6789/0 conn(0x7fd9f815d3e0 legacy=0x7fd9f80d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.933+0000 7fd9f6ffd640 1 -- 172.21.15.19:0/2415922317 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f809aa30 con 0x7fd9f80d06e0 2024-09-12T02:05:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.933+0000 7fd9f5ffb640 1 -- 172.21.15.19:0/2415922317 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687539863 0 0) 0x7fd9f80d00a0 con 0x7fd9f815d3e0 2024-09-12T02:05:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.933+0000 7fd9f6ffd640 1 --2- 172.21.15.19:0/2415922317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f80d06e0 0x7fd9f80ce8b0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80097a0 tx=0x7fd9e802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac30904a9ff9e8e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.934+0000 7fd9f5ffb640 1 -- 172.21.15.19:0/2415922317 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8037070 con 0x7fd9f80d06e0 2024-09-12T02:05:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.934+0000 7fd9f5ffb640 1 -- 172.21.15.19:0/2415922317 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e8032440 con 0x7fd9f80d06e0 2024-09-12T02:05:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.934+0000 7fd9f5ffb640 1 -- 172.21.15.19:0/2415922317 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8032810 con 0x7fd9f80d06e0 2024-09-12T02:05:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.934+0000 7fd9fd511640 1 -- 172.21.15.19:0/2415922317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f80d06e0 msgr2=0x7fd9f80ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.934+0000 7fd9fd511640 1 --2- 172.21.15.19:0/2415922317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f80d06e0 0x7fd9f80ce8b0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80097a0 tx=0x7fd9e802a230 comp rx=0 tx=0).stop 2024-09-12T02:05:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.934+0000 7fd9fd511640 1 -- 172.21.15.19:0/2415922317 shutdown_connections 2024-09-12T02:05:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.934+0000 7fd9fd511640 1 --2- 172.21.15.19:0/2415922317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f80d06e0 0x7fd9f80ce8b0 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.934+0000 7fd9fd511640 1 -- 172.21.15.19:0/2415922317 >> 172.21.15.19:0/2415922317 conn(0x7fd9f80d23a0 msgr2=0x7fd9f80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.934+0000 7fd9fd511640 1 -- 172.21.15.19:0/2415922317 shutdown_connections 2024-09-12T02:05:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.934+0000 7fd9fd511640 1 -- 172.21.15.19:0/2415922317 wait complete. 2024-09-12T02:05:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.935+0000 7fd9fd511640 1 Processor -- start 2024-09-12T02:05:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.936+0000 7fd9fd511640 1 -- start start 2024-09-12T02:05:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.936+0000 7fd9fd511640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9f809b510 0x7fd9f80b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.936+0000 7fd9fd511640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9f80d06e0 0x7fd9f81e8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.936+0000 7fd9fd511640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f815d3e0 0x7fd9f80b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.936+0000 7fd9fd511640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f815c740 con 0x7fd9f815d3e0 2024-09-12T02:05:37.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.936+0000 7fd9fd511640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f815d800 con 0x7fd9f809b510 2024-09-12T02:05:37.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.936+0000 7fd9fd511640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd9f80cd6a0 con 0x7fd9f80d06e0 2024-09-12T02:05:37.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.936+0000 7fd9f77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f815d3e0 0x7fd9f80b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.936+0000 7fd9f77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f815d3e0 0x7fd9f80b6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54964/0 (socket says 172.21.15.19:54964) 2024-09-12T02:05:37.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.936+0000 7fd9f77fe640 1 -- 172.21.15.19:0/3056508452 learned_addr learned my addr 172.21.15.19:0/3056508452 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:37.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.936+0000 7fd9f6ffd640 1 --2- 172.21.15.19:0/3056508452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9f809b510 0x7fd9f80b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.937+0000 7fd9f67fc640 1 --2- 172.21.15.19:0/3056508452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9f80d06e0 0x7fd9f81e8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.937+0000 7fd9f77fe640 1 -- 172.21.15.19:0/3056508452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9f80d06e0 msgr2=0x7fd9f81e8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.937+0000 7fd9f77fe640 1 --2- 172.21.15.19:0/3056508452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9f80d06e0 0x7fd9f81e8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.937+0000 7fd9f77fe640 1 -- 172.21.15.19:0/3056508452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9f809b510 msgr2=0x7fd9f80b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.937+0000 7fd9f77fe640 1 --2- 172.21.15.19:0/3056508452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9f809b510 0x7fd9f80b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.937+0000 7fd9f77fe640 1 -- 172.21.15.19:0/3056508452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f80b5710 con 0x7fd9f815d3e0 2024-09-12T02:05:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.937+0000 7fd9f77fe640 1 --2- 172.21.15.19:0/3056508452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f815d3e0 0x7fd9f80b6ba0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fd9f000c7a0 tx=0x7fd9f000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.937+0000 7fd9ef7fe640 1 -- 172.21.15.19:0/3056508452 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0003b70 con 0x7fd9f815d3e0 2024-09-12T02:05:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.937+0000 7fd9ef7fe640 1 -- 172.21.15.19:0/3056508452 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f0003d30 con 0x7fd9f815d3e0 2024-09-12T02:05:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.937+0000 7fd9fd511640 1 -- 172.21.15.19:0/3056508452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f80b7a20 con 0x7fd9f815d3e0 2024-09-12T02:05:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.937+0000 7fd9ef7fe640 1 -- 172.21.15.19:0/3056508452 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f000aa90 con 0x7fd9f815d3e0 2024-09-12T02:05:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.937+0000 7fd9fd511640 1 -- 172.21.15.19:0/3056508452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f80b7fe0 con 0x7fd9f815d3e0 2024-09-12T02:05:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.938+0000 7fd9fd511640 1 -- 172.21.15.19:0/3056508452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9f80d00a0 con 0x7fd9f815d3e0 2024-09-12T02:05:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.939+0000 7fd9ef7fe640 1 -- 172.21.15.19:0/3056508452 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9f000ac30 con 0x7fd9f815d3e0 2024-09-12T02:05:37.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.939+0000 7fd9ef7fe640 1 --2- 172.21.15.19:0/3056508452 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd9d806be60 0x7fd9d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.940+0000 7fd9ef7fe640 1 -- 172.21.15.19:0/3056508452 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 8883+0+0 (secure 0 0 0) 0x7fd9f008b7e0 con 0x7fd9f815d3e0 2024-09-12T02:05:37.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.940+0000 7fd9f6ffd640 1 --2- 172.21.15.19:0/3056508452 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd9d806be60 0x7fd9d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.940+0000 7fd9f6ffd640 1 --2- 172.21.15.19:0/3056508452 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd9d806be60 0x7fd9d806e320 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8034000 tx=0x7fd9e802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:37.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:37.944+0000 7fd9ef7fe640 1 -- 172.21.15.19:0/3056508452 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd9f0058f10 con 0x7fd9f815d3e0 2024-09-12T02:05:38.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.156+0000 7fd9fd511640 1 -- 172.21.15.19:0/3056508452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd9f80d31d0 con 0x7fd9f815d3e0 2024-09-12T02:05:38.157 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:05:38.157+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:05:38.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.158+0000 7fd9ef7fe640 1 -- 172.21.15.19:0/3056508452 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v265) ==== 161+0+0 (secure 0 0 0) 0x7fd9f005d210 con 0x7fd9f815d3e0 2024-09-12T02:05:38.159 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:05:38.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.161+0000 7fd9fd511640 1 -- 172.21.15.19:0/3056508452 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd9d806be60 msgr2=0x7fd9d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:38.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.161+0000 7fd9fd511640 1 --2- 172.21.15.19:0/3056508452 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd9d806be60 0x7fd9d806e320 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8034000 tx=0x7fd9e802e000 comp rx=0 tx=0).stop 2024-09-12T02:05:38.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.161+0000 7fd9fd511640 1 -- 172.21.15.19:0/3056508452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f815d3e0 msgr2=0x7fd9f80b6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:38.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.161+0000 7fd9fd511640 1 --2- 172.21.15.19:0/3056508452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f815d3e0 0x7fd9f80b6ba0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fd9f000c7a0 tx=0x7fd9f000cc60 comp rx=0 tx=0).stop 2024-09-12T02:05:38.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.161+0000 7fd9fd511640 1 -- 172.21.15.19:0/3056508452 shutdown_connections 2024-09-12T02:05:38.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.161+0000 7fd9fd511640 1 --2- 172.21.15.19:0/3056508452 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd9d806be60 0x7fd9d806e320 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:38.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.161+0000 7fd9fd511640 1 --2- 172.21.15.19:0/3056508452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f815d3e0 0x7fd9f80b6ba0 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:38.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.161+0000 7fd9fd511640 1 --2- 172.21.15.19:0/3056508452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9f80d06e0 0x7fd9f81e8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:38.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.161+0000 7fd9fd511640 1 --2- 172.21.15.19:0/3056508452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9f809b510 0x7fd9f80b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:38.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.161+0000 7fd9fd511640 1 -- 172.21.15.19:0/3056508452 >> 172.21.15.19:0/3056508452 conn(0x7fd9f80d23a0 msgr2=0x7fd9f815c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:38.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.161+0000 7fd9fd511640 1 -- 172.21.15.19:0/3056508452 shutdown_connections 2024-09-12T02:05:38.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.161+0000 7fd9fd511640 1 -- 172.21.15.19:0/3056508452 wait complete. 2024-09-12T02:05:38.164 INFO:tasks.ceph.mds.c.smithi019.stderr: -542> 2024-09-12T02:05:35.874+0000 7f4d9824f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:05:38.174 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:05:38.189 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:05:38.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.277+0000 7fd014896640 1 Processor -- start 2024-09-12T02:05:38.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.277+0000 7fd014896640 1 -- start start 2024-09-12T02:05:38.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.278+0000 7fd014896640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd0100d0270 0x7fd0100d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:38.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.278+0000 7fd014896640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0100d2170 con 0x7fd0100b6010 2024-09-12T02:05:38.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.278+0000 7fd014896640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0100d2410 con 0x7fd01015e710 2024-09-12T02:05:38.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.278+0000 7fd014896640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd0100d2d20 con 0x7fd0100d0270 2024-09-12T02:05:38.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00ed9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd0100b6010 0x7fd01006ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54002/0 (socket says 172.21.15.19:54002) 2024-09-12T02:05:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00ed9d640 1 -- 172.21.15.19:0/3297738232 learned_addr learned my addr 172.21.15.19:0/3297738232 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00dd9b640 1 --2- 172.21.15.19:0/3297738232 >> v2:172.21.15.135:3300/0 conn(0x7fd0100d0270 0x7fd0100d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00d59a640 1 -- 172.21.15.19:0/3297738232 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 812362090 0 0) 0x7fd0100d2170 con 0x7fd0100b6010 2024-09-12T02:05:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00d59a640 1 -- 172.21.15.19:0/3297738232 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcffc003520 con 0x7fd0100b6010 2024-09-12T02:05:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00d59a640 1 -- 172.21.15.19:0/3297738232 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3095051713 0 0) 0x7fcffc003520 con 0x7fd0100b6010 2024-09-12T02:05:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00d59a640 1 -- 172.21.15.19:0/3297738232 >> v2:172.21.15.135:3300/0 conn(0x7fd0100d0270 msgr2=0x7fd0100d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00d59a640 1 --2- 172.21.15.19:0/3297738232 >> v2:172.21.15.135:3300/0 conn(0x7fd0100d0270 0x7fd0100d31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00d59a640 1 -- 172.21.15.19:0/3297738232 >> v1:172.21.15.135:6789/0 conn(0x7fd01015e710 legacy=0x7fd0100cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00d59a640 1 -- 172.21.15.19:0/3297738232 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0100d5240 con 0x7fd0100b6010 2024-09-12T02:05:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00d59a640 1 -- 172.21.15.19:0/3297738232 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fd008001690 con 0x7fd0100b6010 2024-09-12T02:05:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00dd9b640 1 --2- 172.21.15.19:0/3297738232 >> v2:172.21.15.135:3300/0 conn(0x7fd0100d0270 0x7fd0100d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:05:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00d59a640 1 -- 172.21.15.19:0/3297738232 >> v1:172.21.15.19:6789/0 conn(0x7fd0100b6010 legacy=0x7fd01006ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00d59a640 1 --2- 172.21.15.19:0/3297738232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcffc0039b0 0x7fcffc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00d59a640 1 --2- 172.21.15.19:0/3297738232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcffc004800 0x7fcffc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00d59a640 1 --2- 172.21.15.19:0/3297738232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcffc0051c0 0x7fcffc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00d59a640 1 -- 172.21.15.19:0/3297738232 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd0100d2d20 con 0x7fcffc0051c0 2024-09-12T02:05:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00d59a640 1 -- 172.21.15.19:0/3297738232 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc00c060 con 0x7fcffc004800 2024-09-12T02:05:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00d59a640 1 -- 172.21.15.19:0/3297738232 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcffc00c260 con 0x7fcffc0039b0 2024-09-12T02:05:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00ed9d640 1 --2- 172.21.15.19:0/3297738232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcffc0051c0 0x7fcffc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00dd9b640 1 --2- 172.21.15.19:0/3297738232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcffc004800 0x7fcffc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.279+0000 7fd00e59c640 1 --2- 172.21.15.19:0/3297738232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcffc0039b0 0x7fcffc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.280+0000 7fd00ed9d640 1 -- 172.21.15.19:0/3297738232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcffc0039b0 msgr2=0x7fcffc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.280+0000 7fd00ed9d640 1 --2- 172.21.15.19:0/3297738232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcffc0039b0 0x7fcffc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:38.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.280+0000 7fd00ed9d640 1 -- 172.21.15.19:0/3297738232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcffc004800 msgr2=0x7fcffc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:38.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.280+0000 7fd00ed9d640 1 --2- 172.21.15.19:0/3297738232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcffc004800 0x7fcffc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:38.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.280+0000 7fd00ed9d640 1 -- 172.21.15.19:0/3297738232 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc003520 con 0x7fcffc0051c0 2024-09-12T02:05:38.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.280+0000 7fd00e59c640 1 --2- 172.21.15.19:0/3297738232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcffc0039b0 0x7fcffc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:38.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.280+0000 7fd00dd9b640 1 --2- 172.21.15.19:0/3297738232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcffc004800 0x7fcffc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:38.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.280+0000 7fd00ed9d640 1 -- 172.21.15.19:0/3297738232 reap_dead start 2024-09-12T02:05:38.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.280+0000 7fd00ed9d640 1 --2- 172.21.15.19:0/3297738232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcffc0051c0 0x7fcffc00b9c0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fd008007fd0 tx=0x7fcffc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42d476de0a707de server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:38.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.280+0000 7fd00d59a640 1 -- 172.21.15.19:0/3297738232 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd008007d50 con 0x7fcffc0051c0 2024-09-12T02:05:38.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.281+0000 7fd00d59a640 1 -- 172.21.15.19:0/3297738232 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0080058d0 con 0x7fcffc0051c0 2024-09-12T02:05:38.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.281+0000 7fd00d59a640 1 -- 172.21.15.19:0/3297738232 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd008005ca0 con 0x7fcffc0051c0 2024-09-12T02:05:38.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.281+0000 7fd014896640 1 -- 172.21.15.19:0/3297738232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcffc0051c0 msgr2=0x7fcffc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:38.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.281+0000 7fd014896640 1 --2- 172.21.15.19:0/3297738232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcffc0051c0 0x7fcffc00b9c0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fd008007fd0 tx=0x7fcffc005830 comp rx=0 tx=0).stop 2024-09-12T02:05:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.281+0000 7fd014896640 1 -- 172.21.15.19:0/3297738232 shutdown_connections 2024-09-12T02:05:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.281+0000 7fd014896640 1 --2- 172.21.15.19:0/3297738232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcffc0051c0 0x7fcffc00b9c0 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.281+0000 7fd014896640 1 -- 172.21.15.19:0/3297738232 >> 172.21.15.19:0/3297738232 conn(0x7fd01008bfc0 msgr2=0x7fd0100d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.281+0000 7fd014896640 1 -- 172.21.15.19:0/3297738232 shutdown_connections 2024-09-12T02:05:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.281+0000 7fd014896640 1 -- 172.21.15.19:0/3297738232 wait complete. 2024-09-12T02:05:38.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.282+0000 7fd014896640 1 Processor -- start 2024-09-12T02:05:38.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.283+0000 7fd014896640 1 -- start start 2024-09-12T02:05:38.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.283+0000 7fd014896640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcffc0051c0 0x7fd0100b82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:38.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.283+0000 7fd014896640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0101588d0 0x7fd0100b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:38.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.283+0000 7fd014896640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0101554a0 0x7fd010155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.283+0000 7fd014896640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd0100d31b0 con 0x7fd0101588d0 2024-09-12T02:05:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.283+0000 7fd014896640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd0100d29b0 con 0x7fd0101554a0 2024-09-12T02:05:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.283+0000 7fd014896640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd0100d3330 con 0x7fcffc0051c0 2024-09-12T02:05:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.283+0000 7fd00dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0101588d0 0x7fd0100b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.283+0000 7fd00dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0101588d0 0x7fd0100b2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54992/0 (socket says 172.21.15.19:54992) 2024-09-12T02:05:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.283+0000 7fd00dd9b640 1 -- 172.21.15.19:0/3756348368 learned_addr learned my addr 172.21.15.19:0/3756348368 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.283+0000 7fd00ed9d640 1 --2- 172.21.15.19:0/3756348368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0101554a0 0x7fd010155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.284+0000 7fd00e59c640 1 --2- 172.21.15.19:0/3756348368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcffc0051c0 0x7fd0100b82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.284+0000 7fd00dd9b640 1 -- 172.21.15.19:0/3756348368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcffc0051c0 msgr2=0x7fd0100b82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.284+0000 7fd00dd9b640 1 --2- 172.21.15.19:0/3756348368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcffc0051c0 0x7fd0100b82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.284+0000 7fd00dd9b640 1 -- 172.21.15.19:0/3756348368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0101554a0 msgr2=0x7fd010155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.284+0000 7fd00dd9b640 1 --2- 172.21.15.19:0/3756348368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0101554a0 0x7fd010155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.284+0000 7fd00dd9b640 1 -- 172.21.15.19:0/3756348368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd010155e40 con 0x7fd0101588d0 2024-09-12T02:05:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.284+0000 7fd00dd9b640 1 --2- 172.21.15.19:0/3756348368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0101588d0 0x7fd0100b2c30 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7fcff8011900 tx=0x7fcff8011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.284+0000 7fd006ffd640 1 -- 172.21.15.19:0/3756348368 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff800fbd0 con 0x7fd0101588d0 2024-09-12T02:05:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.284+0000 7fd006ffd640 1 -- 172.21.15.19:0/3756348368 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff800fd70 con 0x7fd0101588d0 2024-09-12T02:05:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.284+0000 7fd014896640 1 -- 172.21.15.19:0/3756348368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0100b76c0 con 0x7fd0101588d0 2024-09-12T02:05:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.284+0000 7fd006ffd640 1 -- 172.21.15.19:0/3756348368 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff8015660 con 0x7fd0101588d0 2024-09-12T02:05:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.284+0000 7fd014896640 1 -- 172.21.15.19:0/3756348368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd010158e60 con 0x7fd0101588d0 2024-09-12T02:05:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.285+0000 7fd014896640 1 -- 172.21.15.19:0/3756348368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0100b6460 con 0x7fd0101588d0 2024-09-12T02:05:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.286+0000 7fd006ffd640 1 -- 172.21.15.19:0/3756348368 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcff8015800 con 0x7fd0101588d0 2024-09-12T02:05:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.286+0000 7fd006ffd640 1 --2- 172.21.15.19:0/3756348368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcff006be60 0x7fcff006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.286+0000 7fd006ffd640 1 -- 172.21.15.19:0/3756348368 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 8969+0+0 (secure 0 0 0) 0x7fcff808c420 con 0x7fd0101588d0 2024-09-12T02:05:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.287+0000 7fd00e59c640 1 --2- 172.21.15.19:0/3756348368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcff006be60 0x7fcff006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.287+0000 7fd00e59c640 1 --2- 172.21.15.19:0/3756348368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcff006be60 0x7fcff006e320 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd000000f80 tx=0x7fd000009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.291+0000 7fd006ffd640 1 -- 172.21.15.19:0/3756348368 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd010155e40 con 0x7fd0101588d0 2024-09-12T02:05:38.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:38.538+0000 7fd014896640 1 -- 172.21.15.19:0/3756348368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7fd0100b6cf0 con 0x7fd0101588d0 2024-09-12T02:05:39.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.164+0000 7fd006ffd640 1 -- 172.21.15.19:0/3756348368 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v266) ==== 107+0+0 (secure 0 0 0) 0x7fcff8019030 con 0x7fd0101588d0 2024-09-12T02:05:39.165 INFO:teuthology.orchestra.run.smithi019.stderr:nothing to do: rank is not damaged 2024-09-12T02:05:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.167+0000 7fd014896640 1 -- 172.21.15.19:0/3756348368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcff006be60 msgr2=0x7fcff006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.167+0000 7fd014896640 1 --2- 172.21.15.19:0/3756348368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcff006be60 0x7fcff006e320 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd000000f80 tx=0x7fd000009040 comp rx=0 tx=0).stop 2024-09-12T02:05:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.167+0000 7fd014896640 1 -- 172.21.15.19:0/3756348368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0101588d0 msgr2=0x7fd0100b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.167+0000 7fd014896640 1 --2- 172.21.15.19:0/3756348368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0101588d0 0x7fd0100b2c30 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7fcff8011900 tx=0x7fcff8011dc0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.167+0000 7fd014896640 1 -- 172.21.15.19:0/3756348368 shutdown_connections 2024-09-12T02:05:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.167+0000 7fd014896640 1 --2- 172.21.15.19:0/3756348368 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcff006be60 0x7fcff006e320 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.167+0000 7fd014896640 1 --2- 172.21.15.19:0/3756348368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0101554a0 0x7fd010155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.167+0000 7fd014896640 1 --2- 172.21.15.19:0/3756348368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0101588d0 0x7fd0100b2c30 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.167+0000 7fd014896640 1 --2- 172.21.15.19:0/3756348368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcffc0051c0 0x7fd0100b82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.167+0000 7fd014896640 1 -- 172.21.15.19:0/3756348368 >> 172.21.15.19:0/3756348368 conn(0x7fd01008bfc0 msgr2=0x7fd0100d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.167+0000 7fd014896640 1 -- 172.21.15.19:0/3756348368 shutdown_connections 2024-09-12T02:05:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.168+0000 7fd014896640 1 -- 172.21.15.19:0/3756348368 wait complete. 2024-09-12T02:05:39.181 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:05:39.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.270+0000 7f8f22023f40 1 Processor -- start 2024-09-12T02:05:39.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.270+0000 7f8f22023f40 1 -- start start 2024-09-12T02:05:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.271+0000 7f8f22023f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562f438dba10 0x562f438bead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.271+0000 7f8f22023f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f4396b130 0x562f43966b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.271+0000 7f8f22023f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562f43960e10 0x562f438bf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.271+0000 7f8f22023f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562f438db6f0 con 0x562f438dba10 2024-09-12T02:05:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.271+0000 7f8f22023f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562f437e5510 con 0x562f4396b130 2024-09-12T02:05:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.271+0000 7f8f22023f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562f438960d0 con 0x562f43960e10 2024-09-12T02:05:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.271+0000 7f8f1fb19640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562f438dba10 0x562f438bead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.271+0000 7f8f1fb19640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562f438dba10 0x562f438bead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55010/0 (socket says 172.21.15.19:55010) 2024-09-12T02:05:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.271+0000 7f8f1fb19640 1 -- 172.21.15.19:0/4281214413 learned_addr learned my addr 172.21.15.19:0/4281214413 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.271+0000 7f8f2031a640 1 --2- 172.21.15.19:0/4281214413 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562f43960e10 0x562f438bf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.271+0000 7f8f1f318640 1 --2- 172.21.15.19:0/4281214413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f4396b130 0x562f43966b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.271+0000 7f8f1fb19640 1 -- 172.21.15.19:0/4281214413 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562f43960e10 msgr2=0x562f438bf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.271+0000 7f8f1fb19640 1 --2- 172.21.15.19:0/4281214413 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562f43960e10 0x562f438bf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.271+0000 7f8f1fb19640 1 -- 172.21.15.19:0/4281214413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f4396b130 msgr2=0x562f43966b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.271+0000 7f8f1fb19640 1 --2- 172.21.15.19:0/4281214413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f4396b130 0x562f43966b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.271+0000 7f8f1fb19640 1 -- 172.21.15.19:0/4281214413 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f438d9830 con 0x562f438dba10 2024-09-12T02:05:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.272+0000 7f8f1fb19640 1 --2- 172.21.15.19:0/4281214413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562f438dba10 0x562f438bead0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f8f10001620 tx=0x7f8f10001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1672c55d382c3e35 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.272+0000 7f8f1e316640 1 -- 172.21.15.19:0/4281214413 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10017070 con 0x562f438dba10 2024-09-12T02:05:39.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.272+0000 7f8f1e316640 1 -- 172.21.15.19:0/4281214413 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1000f730 con 0x562f438dba10 2024-09-12T02:05:39.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.272+0000 7f8f1e316640 1 -- 172.21.15.19:0/4281214413 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1000fb20 con 0x562f438dba10 2024-09-12T02:05:39.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.272+0000 7f8f22023f40 1 -- 172.21.15.19:0/4281214413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562f438dba10 msgr2=0x562f438bead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.272+0000 7f8f22023f40 1 --2- 172.21.15.19:0/4281214413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562f438dba10 0x562f438bead0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f8f10001620 tx=0x7f8f10001ae0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.272+0000 7f8f22023f40 1 -- 172.21.15.19:0/4281214413 shutdown_connections 2024-09-12T02:05:39.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.272+0000 7f8f22023f40 1 --2- 172.21.15.19:0/4281214413 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562f43960e10 0x562f438bf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.272+0000 7f8f22023f40 1 --2- 172.21.15.19:0/4281214413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f4396b130 0x562f43966b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.272+0000 7f8f22023f40 1 --2- 172.21.15.19:0/4281214413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562f438dba10 0x562f438bead0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.272+0000 7f8f22023f40 1 -- 172.21.15.19:0/4281214413 >> 172.21.15.19:0/4281214413 conn(0x562f438939e0 msgr2=0x562f438be210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:39.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.272+0000 7f8f22023f40 1 -- 172.21.15.19:0/4281214413 shutdown_connections 2024-09-12T02:05:39.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.272+0000 7f8f22023f40 1 -- 172.21.15.19:0/4281214413 wait complete. 2024-09-12T02:05:39.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.273+0000 7f8f22023f40 1 Processor -- start 2024-09-12T02:05:39.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.273+0000 7f8f22023f40 1 -- start start 2024-09-12T02:05:39.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.274+0000 7f8f22023f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562f438dba10 0x562f438bf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.274+0000 7f8f22023f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562f43960e10 0x562f43958270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.274+0000 7f8f22023f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f4396b130 0x562f438be7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.274+0000 7f8f22023f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562f438c22a0 con 0x562f438dba10 2024-09-12T02:05:39.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.274+0000 7f8f22023f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562f438c2580 con 0x562f4396b130 2024-09-12T02:05:39.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.274+0000 7f8f22023f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562f438d9ad0 con 0x562f43960e10 2024-09-12T02:05:39.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.274+0000 7f8f1fb19640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562f438dba10 0x562f438bf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.274+0000 7f8f1fb19640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562f438dba10 0x562f438bf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55022/0 (socket says 172.21.15.19:55022) 2024-09-12T02:05:39.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.274+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 learned_addr learned my addr 172.21.15.19:0/3118366892 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:39.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.274+0000 7f8f2031a640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f4396b130 0x562f438be7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.274+0000 7f8f1f318640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562f43960e10 0x562f43958270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.274+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562f43960e10 msgr2=0x562f43958270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.274+0000 7f8f1fb19640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562f43960e10 0x562f43958270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.274+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f4396b130 msgr2=0x562f438be7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.274+0000 7f8f1fb19640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f4396b130 0x562f438be7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.274+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4395cc30 con 0x562f438dba10 2024-09-12T02:05:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.274+0000 7f8f2031a640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f4396b130 0x562f438be7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.274+0000 7f8f1fb19640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562f438dba10 0x562f438bf9b0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x562f4395e960 tx=0x7f8f10000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.275+0000 7f8f1d314640 1 -- 172.21.15.19:0/3118366892 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10017030 con 0x562f438dba10 2024-09-12T02:05:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.275+0000 7f8f1d314640 1 -- 172.21.15.19:0/3118366892 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f10023070 con 0x562f438dba10 2024-09-12T02:05:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.275+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f438d8820 con 0x562f438dba10 2024-09-12T02:05:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.275+0000 7f8f1d314640 1 -- 172.21.15.19:0/3118366892 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10011890 con 0x562f438dba10 2024-09-12T02:05:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.275+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f438d9410 con 0x562f438dba10 2024-09-12T02:05:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.276+0000 7f8f1d314640 1 -- 172.21.15.19:0/3118366892 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f10011a30 con 0x562f438dba10 2024-09-12T02:05:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.277+0000 7f8f1d314640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8f0c06a840 0x7f8f0c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.277+0000 7f8f1d314640 1 -- 172.21.15.19:0/3118366892 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 8969+0+0 (secure 0 0 0) 0x7f8f1008be70 con 0x562f438dba10 2024-09-12T02:05:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.277+0000 7f8f1f318640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8f0c06a840 0x7f8f0c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.280 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:05:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.277+0000 7f8f22023f40 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562f4395b4c0 0x562f4395d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.277+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f4395d650 con 0x562f4395b4c0 2024-09-12T02:05:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.277+0000 7f8f2031a640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562f4395b4c0 0x562f4395d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.278+0000 7f8f1f318640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8f0c06a840 0x7f8f0c06cd00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x562f438dc240 tx=0x7f8f14005b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.278+0000 7f8f2031a640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562f4395b4c0 0x562f4395d110 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.282+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v126'971 uv944 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.282+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f4395da60 con 0x562f4395b4c0 2024-09-12T02:05:39.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.283+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v126'972 uv972 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.283+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a0e410 con 0x562f4395b4c0 2024-09-12T02:05:39.284 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:05:39.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.284+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v126'973 uv973 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.284+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a0f7c0 con 0x562f4395b4c0 2024-09-12T02:05:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.286+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v126'974 uv974 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.286+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a0fb60 con 0x562f4395b4c0 2024-09-12T02:05:39.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.287+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v126'975 uv975 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.287+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a0e7b0 con 0x562f4395b4c0 2024-09-12T02:05:39.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.288+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v126'976 uv976 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.288+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a0eb50 con 0x562f4395b4c0 2024-09-12T02:05:39.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.290+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v126'977 uv950 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.290+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a0eef0 con 0x562f4395b4c0 2024-09-12T02:05:39.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.291+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v126'978 uv978 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.291+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a0eef0 con 0x562f4395b4c0 2024-09-12T02:05:39.292 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:05:39.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.292+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v126'979 uv979 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.292+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a0eef0 con 0x562f4395b4c0 2024-09-12T02:05:39.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.293+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v126'980 uv980 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.293+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a0eef0 con 0x562f4395b4c0 2024-09-12T02:05:39.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.295+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v126'981 uv981 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.295+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a0eef0 con 0x562f4395b4c0 2024-09-12T02:05:39.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.296+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v126'982 uv982 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.296+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a0eef0 con 0x562f4395b4c0 2024-09-12T02:05:39.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.298+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v126'983 uv970 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.298+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a0eef0 con 0x562f4395b4c0 2024-09-12T02:05:39.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.299+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v126'984 uv984 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.299+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a0eef0 con 0x562f4395b4c0 2024-09-12T02:05:39.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.300+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v126'985 uv985 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.301 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:05:39.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.300+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a0eef0 con 0x562f4395b4c0 2024-09-12T02:05:39.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.301+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v126'986 uv986 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.301+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a0eef0 con 0x562f4395b4c0 2024-09-12T02:05:39.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.303+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v126'987 uv987 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.303+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a0eef0 con 0x562f4395b4c0 2024-09-12T02:05:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.304+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v126'988 uv988 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.304+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a01e50 con 0x562f4395b4c0 2024-09-12T02:05:39.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.306+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v126'989 uv989 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.306+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a01e50 con 0x562f4395b4c0 2024-09-12T02:05:39.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.308+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v126'990 uv963 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.308+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a01e50 con 0x562f4395b4c0 2024-09-12T02:05:39.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.309+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v126'991 uv991 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.309+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a01e50 con 0x562f4395b4c0 2024-09-12T02:05:39.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.310+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v126'992 uv992 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.311 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:05:39.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.310+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a01e50 con 0x562f4395b4c0 2024-09-12T02:05:39.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.311+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v126'993 uv993 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.311+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a01e50 con 0x562f4395b4c0 2024-09-12T02:05:39.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.313+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v126'994 uv994 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.313+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a01e50 con 0x562f4395b4c0 2024-09-12T02:05:39.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.314+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v126'995 uv995 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.314+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a01e50 con 0x562f4395b4c0 2024-09-12T02:05:39.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.315+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v126'996 uv969 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.315+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a01e50 con 0x562f4395b4c0 2024-09-12T02:05:39.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.317+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v126'997 uv997 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.317+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a01e50 con 0x562f4395b4c0 2024-09-12T02:05:39.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.318+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v126'998 uv998 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.318 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:05:39.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.318+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a01e50 con 0x562f4395b4c0 2024-09-12T02:05:39.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.319+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v126'999 uv999 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.319+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a01e50 con 0x562f4395b4c0 2024-09-12T02:05:39.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.320+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v126'1000 uv1000 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.320+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a01e50 con 0x562f4395b4c0 2024-09-12T02:05:39.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.321+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v126'1001 uv1001 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f4395b4c0 2024-09-12T02:05:39.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.321+0000 7f8f22023f40 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562f43a10410 0x562f43a12800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.321+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a01e50 con 0x562f43a10410 2024-09-12T02:05:39.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.321+0000 7f8f1fb19640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562f43a10410 0x562f43a12800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.321+0000 7f8f1fb19640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562f43a10410 0x562f43a12800 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.323+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v126'706 uv685 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.323+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a12d40 con 0x562f43a10410 2024-09-12T02:05:39.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.325+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v126'707 uv707 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.325+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a130e0 con 0x562f43a10410 2024-09-12T02:05:39.326 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:05:39.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.326+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v126'708 uv708 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.326+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a13930 con 0x562f43a10410 2024-09-12T02:05:39.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.328+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v126'709 uv709 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.328+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a13cd0 con 0x562f43a10410 2024-09-12T02:05:39.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.329+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v126'710 uv710 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.329+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a14070 con 0x562f43a10410 2024-09-12T02:05:39.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.330+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v126'711 uv704 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.330+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a14410 con 0x562f43a10410 2024-09-12T02:05:39.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.332+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v126'712 uv712 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.332+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a147b0 con 0x562f43a10410 2024-09-12T02:05:39.333 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:05:39.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.333+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v126'713 uv713 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.333+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a147b0 con 0x562f43a10410 2024-09-12T02:05:39.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.334+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v126'714 uv714 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.334+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a147b0 con 0x562f43a10410 2024-09-12T02:05:39.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.336+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v126'715 uv715 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.336+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a147b0 con 0x562f43a10410 2024-09-12T02:05:39.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.337+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v126'716 uv705 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.337+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a147b0 con 0x562f43a10410 2024-09-12T02:05:39.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.338+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v126'717 uv717 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.338+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a147b0 con 0x562f43a10410 2024-09-12T02:05:39.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.339+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v126'718 uv718 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.340 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:05:39.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.339+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a18c30 con 0x562f43a10410 2024-09-12T02:05:39.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.341+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v126'719 uv719 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.341+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a18c30 con 0x562f43a10410 2024-09-12T02:05:39.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.342+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v126'720 uv720 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.342+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a147b0 con 0x562f43a10410 2024-09-12T02:05:39.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.343+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v126'721 uv701 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.343+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a147b0 con 0x562f43a10410 2024-09-12T02:05:39.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.344+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v126'722 uv722 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.344+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a147b0 con 0x562f43a10410 2024-09-12T02:05:39.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.345+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v126'723 uv723 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.346 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:05:39.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.346+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a157c0 con 0x562f43a10410 2024-09-12T02:05:39.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.347+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v126'724 uv724 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.347+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a157c0 con 0x562f43a10410 2024-09-12T02:05:39.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.348+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v126'725 uv725 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.348+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a147b0 con 0x562f43a10410 2024-09-12T02:05:39.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.349+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v126'726 uv726 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a10410 2024-09-12T02:05:39.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.349+0000 7f8f22023f40 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x562f43a14e30 0x562f43a17220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.349+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a17760 con 0x562f43a14e30 2024-09-12T02:05:39.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.349+0000 7f8f1f318640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x562f43a14e30 0x562f43a17220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.349+0000 7f8f1f318640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x562f43a14e30 0x562f43a17220 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.351+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v126'189 uv188 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.351+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a17fe0 con 0x562f43a14e30 2024-09-12T02:05:39.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.352+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v126'190 uv190 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.352+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a18380 con 0x562f43a14e30 2024-09-12T02:05:39.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.353+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v126'191 uv191 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.353 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:05:39.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.353+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a19730 con 0x562f43a14e30 2024-09-12T02:05:39.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.354+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v126'192 uv192 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.354+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a19b50 con 0x562f43a14e30 2024-09-12T02:05:39.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.355+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v126'193 uv193 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.355+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a18720 con 0x562f43a14e30 2024-09-12T02:05:39.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.356+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v126'194 uv194 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.356+0000 7f8f22023f40 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x562f43a19200 0x562f43a1bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.356+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1c4d0 con 0x562f43a19200 2024-09-12T02:05:39.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.356+0000 7f8f2031a640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x562f43a19200 0x562f43a1bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.357+0000 7f8f2031a640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x562f43a19200 0x562f43a1bf00 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.358+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v126'141 uv140 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.358+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1c5b0 con 0x562f43a19200 2024-09-12T02:05:39.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.360+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v126'142 uv142 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.360+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1c9f0 con 0x562f43a19200 2024-09-12T02:05:39.361 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:05:39.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.361+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v126'143 uv143 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.361+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1c9f0 con 0x562f43a19200 2024-09-12T02:05:39.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.362+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v126'144 uv144 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.362+0000 7f8f22023f40 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562f43a1d070 0x562f43a1f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.362+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1f9e0 con 0x562f43a1d070 2024-09-12T02:05:39.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.362+0000 7f8f1fb19640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562f43a1d070 0x562f43a1f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.363+0000 7f8f1fb19640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562f43a1d070 0x562f43a1f460 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.364+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v126'189 uv188 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.364+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a1d070 2024-09-12T02:05:39.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.365+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v126'190 uv190 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.365+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a1d070 2024-09-12T02:05:39.367 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:05:39.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.366+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v126'191 uv191 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.367+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a20dc0 con 0x562f43a1d070 2024-09-12T02:05:39.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.368+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v126'192 uv192 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.368+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a20dc0 con 0x562f43a1d070 2024-09-12T02:05:39.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.369+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v126'193 uv193 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.369+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a1d070 2024-09-12T02:05:39.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.370+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v126'194 uv194 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.370+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a19200 2024-09-12T02:05:39.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.371+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v126'349 uv343 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.371+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a19200 2024-09-12T02:05:39.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.372+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v126'350 uv350 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.372+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a19200 2024-09-12T02:05:39.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.373+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v126'351 uv351 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.374 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:05:39.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.373+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a19200 2024-09-12T02:05:39.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.374+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v126'352 uv352 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.374+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a19200 2024-09-12T02:05:39.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.375+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v126'353 uv353 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.375+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a19200 2024-09-12T02:05:39.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.377+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v126'354 uv354 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.377+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a19200 2024-09-12T02:05:39.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.378+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v126'355 uv348 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.378+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a19200 2024-09-12T02:05:39.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.379+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v126'356 uv356 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.379+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a19200 2024-09-12T02:05:39.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.380+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v126'357 uv357 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.380 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:05:39.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.380+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a19200 2024-09-12T02:05:39.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.381+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v126'358 uv358 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.381+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a19200 2024-09-12T02:05:39.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.382+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v126'359 uv359 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.382+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a19200 2024-09-12T02:05:39.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.383+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v126'158 uv157 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.384+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a19200 2024-09-12T02:05:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.385+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v126'159 uv159 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.385+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a19200 2024-09-12T02:05:39.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.386+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v126'160 uv160 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.386 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:05:39.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.386+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a19200 2024-09-12T02:05:39.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.387+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v126'161 uv161 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.387+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a19200 2024-09-12T02:05:39.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.388+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v126'162 uv162 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8f18057030 con 0x562f43a19200 2024-09-12T02:05:39.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.388+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a1d070 2024-09-12T02:05:39.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.389+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v126'189 uv188 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.389+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a1d070 2024-09-12T02:05:39.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.390+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v126'190 uv190 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.390+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a1d070 2024-09-12T02:05:39.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.391+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v126'191 uv191 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.392 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:05:39.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.391+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a1d070 2024-09-12T02:05:39.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.392+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v126'192 uv192 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.392+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a1d070 2024-09-12T02:05:39.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.393+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v126'193 uv193 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.393+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a1d070 2024-09-12T02:05:39.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.394+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v126'194 uv194 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.394+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a1d070 2024-09-12T02:05:39.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.395+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v126'314 uv308 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.395+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a1d070 2024-09-12T02:05:39.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.396+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v126'315 uv315 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.396+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a1fdb0 con 0x562f43a1d070 2024-09-12T02:05:39.397 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:05:39.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.397+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v126'316 uv316 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.397+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a201c0 con 0x562f43a1d070 2024-09-12T02:05:39.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.398+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v126'317 uv317 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.398+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a201c0 con 0x562f43a1d070 2024-09-12T02:05:39.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.399+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v126'318 uv318 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.399+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a20170 con 0x562f43a1d070 2024-09-12T02:05:39.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.400+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v126'319 uv313 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.400+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a20170 con 0x562f43a1d070 2024-09-12T02:05:39.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.401+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v126'320 uv320 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.401+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a20170 con 0x562f43a1d070 2024-09-12T02:05:39.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.403+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v126'321 uv321 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.403 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:05:39.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.403+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a20170 con 0x562f43a1d070 2024-09-12T02:05:39.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.404+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v126'322 uv322 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.404+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a22f80 con 0x562f43a1d070 2024-09-12T02:05:39.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.405+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v126'323 uv323 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.405+0000 7f8f22023f40 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x562f43a20b30 0x562f43a23420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.405+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a22f20 con 0x562f43a20b30 2024-09-12T02:05:39.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.405+0000 7f8f1f318640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x562f43a20b30 0x562f43a23420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.406+0000 7f8f1f318640 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x562f43a20b30 0x562f43a23420 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.407+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v126'137 uv135 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a20b30 2024-09-12T02:05:39.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.407+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a20b30 2024-09-12T02:05:39.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.408+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v126'138 uv138 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a20b30 2024-09-12T02:05:39.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.408+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a20b30 2024-09-12T02:05:39.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.409+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v126'139 uv139 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a20b30 2024-09-12T02:05:39.409 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:05:39.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.409+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a20b30 2024-09-12T02:05:39.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.410+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v126'140 uv140 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a20b30 2024-09-12T02:05:39.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.410+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a1d070 2024-09-12T02:05:39.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.411+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v126'189 uv188 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.411+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a1d070 2024-09-12T02:05:39.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.412+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v126'190 uv190 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.412+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a1d070 2024-09-12T02:05:39.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.413+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v126'191 uv191 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.414 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:05:39.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.414+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a24970 con 0x562f43a1d070 2024-09-12T02:05:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.415+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v126'192 uv192 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.415+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a24970 con 0x562f43a1d070 2024-09-12T02:05:39.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.416+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v126'193 uv193 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.416+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a1d070 2024-09-12T02:05:39.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.417+0000 7f8f1fb19640 1 -- 172.21.15.19:0/3118366892 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v126'194 uv194 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f10006d70 con 0x562f43a1d070 2024-09-12T02:05:39.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.417+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a14e30 2024-09-12T02:05:39.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.418+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v126'161 uv160 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.418+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a14e30 2024-09-12T02:05:39.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.420+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v126'162 uv162 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.420+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a14e30 2024-09-12T02:05:39.421 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:05:39.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.421+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v126'163 uv163 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.421+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a14e30 2024-09-12T02:05:39.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.422+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v126'164 uv164 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.422+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a14e30 2024-09-12T02:05:39.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.423+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v126'165 uv165 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.423+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a14e30 2024-09-12T02:05:39.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.425+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v126'389 uv380 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.425+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a14e30 2024-09-12T02:05:39.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.426+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v126'390 uv390 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.426+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a14e30 2024-09-12T02:05:39.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.427+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v126'391 uv391 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.428 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:05:39.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.427+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a14e30 2024-09-12T02:05:39.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.428+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v126'392 uv392 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.428+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a14e30 2024-09-12T02:05:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.429+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v126'393 uv393 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.429+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a14e30 2024-09-12T02:05:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.430+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v126'394 uv387 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.430+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a14e30 2024-09-12T02:05:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.431+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v126'395 uv395 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.432+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a14e30 2024-09-12T02:05:39.433 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:05:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.433+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v126'396 uv396 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.433+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a14e30 2024-09-12T02:05:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.434+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v126'397 uv397 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.434+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a14e30 2024-09-12T02:05:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.435+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v126'398 uv398 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.435+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23960 con 0x562f43a14e30 2024-09-12T02:05:39.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.436+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v126'399 uv399 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.436+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x562f43a23da0 con 0x562f43a14e30 2024-09-12T02:05:39.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f1f318640 1 -- 172.21.15.19:0/3118366892 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v126'400 uv400 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f8f14013030 con 0x562f43a14e30 2024-09-12T02:05:39.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562f43a10410 msgr2=0x562f43a12800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x562f43a10410 0x562f43a12800 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562f4395b4c0 msgr2=0x562f4395d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x562f4395b4c0 0x562f4395d110 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x562f43a19200 msgr2=0x562f43a1bf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x562f43a19200 0x562f43a1bf00 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x562f43a20b30 msgr2=0x562f43a23420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x562f43a20b30 0x562f43a23420 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x562f43a14e30 msgr2=0x562f43a17220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x562f43a14e30 0x562f43a17220 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562f43a1d070 msgr2=0x562f43a1f460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x562f43a1d070 0x562f43a1f460 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 reap_dead start 2024-09-12T02:05:39.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f2031a640 1 -- 172.21.15.19:0/3118366892 reap_dead start 2024-09-12T02:05:39.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8f0c06a840 msgr2=0x7f8f0c06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8f0c06a840 0x7f8f0c06cd00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x562f438dc240 tx=0x7f8f14005b80 comp rx=0 tx=0).stop 2024-09-12T02:05:39.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562f438dba10 msgr2=0x562f438bf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562f438dba10 0x562f438bf9b0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x562f4395e960 tx=0x7f8f10000f40 comp rx=0 tx=0).stop 2024-09-12T02:05:39.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 shutdown_connections 2024-09-12T02:05:39.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8f0c06a840 0x7f8f0c06cd00 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 --2- 172.21.15.19:0/3118366892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562f438dba10 0x562f438bf9b0 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 >> 172.21.15.19:0/3118366892 conn(0x562f438939e0 msgr2=0x562f43965370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:39.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 shutdown_connections 2024-09-12T02:05:39.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.437+0000 7f8f22023f40 1 -- 172.21.15.19:0/3118366892 wait complete. 2024-09-12T02:05:39.444 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 100.00000000 stray0_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-09-12T02:05:39.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.490+0000 7f4560d05f40 1 Processor -- start 2024-09-12T02:05:39.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.490+0000 7f4560d05f40 1 -- start start 2024-09-12T02:05:39.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.491+0000 7f4560d05f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f66f16f640 0x55f66f1fa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.491+0000 7f4560d05f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f66f1fbd20 0x55f66f127690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.491+0000 7f4560d05f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f66f1fc100 0x55f66f1fee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.491+0000 7f4560d05f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f66f1706b0 con 0x55f66f1fbd20 2024-09-12T02:05:39.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.491+0000 7f4560d05f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f66f078510 con 0x55f66f16f640 2024-09-12T02:05:39.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.491+0000 7f4560d05f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55f66f12b2d0 con 0x55f66f1fc100 2024-09-12T02:05:39.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.491+0000 7f455dffa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f66f1fbd20 0x55f66f127690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.491+0000 7f455dffa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f66f1fbd20 0x55f66f127690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55040/0 (socket says 172.21.15.19:55040) 2024-09-12T02:05:39.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.491+0000 7f455dffa640 1 -- 172.21.15.19:0/868908546 learned_addr learned my addr 172.21.15.19:0/868908546 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:39.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.491+0000 7f455effc640 1 --2- 172.21.15.19:0/868908546 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f66f1fc100 0x55f66f1fee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.491+0000 7f455e7fb640 1 --2- 172.21.15.19:0/868908546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f66f16f640 0x55f66f1fa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.491+0000 7f455dffa640 1 -- 172.21.15.19:0/868908546 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f66f1fc100 msgr2=0x55f66f1fee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:39.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.491+0000 7f455dffa640 1 --2- 172.21.15.19:0/868908546 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f66f1fc100 0x55f66f1fee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.491+0000 7f455dffa640 1 -- 172.21.15.19:0/868908546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f66f16f640 msgr2=0x55f66f1fa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.491+0000 7f455dffa640 1 --2- 172.21.15.19:0/868908546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f66f16f640 0x55f66f1fa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.491+0000 7f455dffa640 1 -- 172.21.15.19:0/868908546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f66f127bd0 con 0x55f66f1fbd20 2024-09-12T02:05:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.492+0000 7f455e7fb640 1 --2- 172.21.15.19:0/868908546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f66f16f640 0x55f66f1fa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.492+0000 7f455dffa640 1 --2- 172.21.15.19:0/868908546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f66f1fbd20 0x55f66f127690 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f455400a7a0 tx=0x7f455400a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d59eaa61f1177cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.492+0000 7f455cff8640 1 -- 172.21.15.19:0/868908546 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554018070 con 0x55f66f1fbd20 2024-09-12T02:05:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.492+0000 7f455cff8640 1 -- 172.21.15.19:0/868908546 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4554007600 con 0x55f66f1fbd20 2024-09-12T02:05:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.492+0000 7f455cff8640 1 -- 172.21.15.19:0/868908546 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45540079f0 con 0x55f66f1fbd20 2024-09-12T02:05:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.492+0000 7f4560d05f40 1 -- 172.21.15.19:0/868908546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f66f1fbd20 msgr2=0x55f66f127690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.492+0000 7f4560d05f40 1 --2- 172.21.15.19:0/868908546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f66f1fbd20 0x55f66f127690 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f455400a7a0 tx=0x7f455400a890 comp rx=0 tx=0).stop 2024-09-12T02:05:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.492+0000 7f4560d05f40 1 -- 172.21.15.19:0/868908546 shutdown_connections 2024-09-12T02:05:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.492+0000 7f4560d05f40 1 --2- 172.21.15.19:0/868908546 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f66f1fc100 0x55f66f1fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.492+0000 7f4560d05f40 1 --2- 172.21.15.19:0/868908546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f66f1fbd20 0x55f66f127690 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.492+0000 7f4560d05f40 1 --2- 172.21.15.19:0/868908546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f66f16f640 0x55f66f1fa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.492+0000 7f4560d05f40 1 -- 172.21.15.19:0/868908546 >> 172.21.15.19:0/868908546 conn(0x55f66f154490 msgr2=0x55f66f16ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:39.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.492+0000 7f4560d05f40 1 -- 172.21.15.19:0/868908546 shutdown_connections 2024-09-12T02:05:39.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.492+0000 7f4560d05f40 1 -- 172.21.15.19:0/868908546 wait complete. 2024-09-12T02:05:39.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.493+0000 7f4560d05f40 1 Processor -- start 2024-09-12T02:05:39.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.493+0000 7f4560d05f40 1 -- start start 2024-09-12T02:05:39.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f4560d05f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f66f16f640 0x55f66f2945c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f4560d05f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f66f1fbd20 0x55f66f1fb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f4560d05f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f66f1fc100 0x55f66f1f3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f4560d05f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f66f1f93c0 con 0x55f66f1fbd20 2024-09-12T02:05:39.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f4560d05f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f66f16d640 con 0x55f66f16f640 2024-09-12T02:05:39.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f4560d05f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55f66f16da00 con 0x55f66f1fc100 2024-09-12T02:05:39.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f455dffa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f66f1fbd20 0x55f66f1fb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f455dffa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f66f1fbd20 0x55f66f1fb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55050/0 (socket says 172.21.15.19:55050) 2024-09-12T02:05:39.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f455dffa640 1 -- 172.21.15.19:0/601023421 learned_addr learned my addr 172.21.15.19:0/601023421 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:39.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f455effc640 1 --2- 172.21.15.19:0/601023421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f66f1fc100 0x55f66f1f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f455e7fb640 1 --2- 172.21.15.19:0/601023421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f66f16f640 0x55f66f2945c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f455dffa640 1 -- 172.21.15.19:0/601023421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f66f1fc100 msgr2=0x55f66f1f3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f455dffa640 1 --2- 172.21.15.19:0/601023421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f66f1fc100 0x55f66f1f3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f455dffa640 1 -- 172.21.15.19:0/601023421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f66f16f640 msgr2=0x55f66f2945c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f455dffa640 1 --2- 172.21.15.19:0/601023421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f66f16f640 0x55f66f2945c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f455dffa640 1 -- 172.21.15.19:0/601023421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f66f1f98d0 con 0x55f66f1fbd20 2024-09-12T02:05:39.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f455e7fb640 1 --2- 172.21.15.19:0/601023421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f66f16f640 0x55f66f2945c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:39.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f455dffa640 1 --2- 172.21.15.19:0/601023421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f66f1fbd20 0x55f66f1fb520 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f455400bfd0 tx=0x7f4554003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f454f7fe640 1 -- 172.21.15.19:0/601023421 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554018050 con 0x55f66f1fbd20 2024-09-12T02:05:39.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f454f7fe640 1 -- 172.21.15.19:0/601023421 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4554024070 con 0x55f66f1fbd20 2024-09-12T02:05:39.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.494+0000 7f454f7fe640 1 -- 172.21.15.19:0/601023421 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554013a80 con 0x55f66f1fbd20 2024-09-12T02:05:39.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.495+0000 7f4560d05f40 1 -- 172.21.15.19:0/601023421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f66f153890 con 0x55f66f1fbd20 2024-09-12T02:05:39.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.495+0000 7f4560d05f40 1 -- 172.21.15.19:0/601023421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f66f1fa8f0 con 0x55f66f1fbd20 2024-09-12T02:05:39.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.496+0000 7f454f7fe640 1 -- 172.21.15.19:0/601023421 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4554013c20 con 0x55f66f1fbd20 2024-09-12T02:05:39.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.496+0000 7f454f7fe640 1 --2- 172.21.15.19:0/601023421 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f454006a810 0x7f454006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.496+0000 7f454f7fe640 1 -- 172.21.15.19:0/601023421 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 8969+0+0 (secure 0 0 0) 0x7f455408ba60 con 0x55f66f1fbd20 2024-09-12T02:05:39.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.497+0000 7f4560d05f40 1 --2- 172.21.15.19:0/601023421 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55f66f1f7100 0x55f66f1f74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.497+0000 7f4560d05f40 1 -- 172.21.15.19:0/601023421 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:1 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=103b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) -- 0x55f66f1f7a20 con 0x55f66f1f7100 2024-09-12T02:05:39.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.497+0000 7f455e7fb640 1 --2- 172.21.15.19:0/601023421 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f454006a810 0x7f454006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.497+0000 7f455effc640 1 --2- 172.21.15.19:0/601023421 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55f66f1f7100 0x55f66f1f74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.497+0000 7f455e7fb640 1 --2- 172.21.15.19:0/601023421 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f454006a810 0x7f454006ccd0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4550003ef0 tx=0x7f45500036b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.497+0000 7f455effc640 1 --2- 172.21.15.19:0/601023421 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55f66f1f7100 0x55f66f1f74e0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.499+0000 7f455effc640 1 -- 172.21.15.19:0/601023421 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(1 100.00000000 [omap-set-vals] v126'324 uv324 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f455804f4c0 con 0x55f66f1f7100 2024-09-12T02:05:39.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.499+0000 7f4560d05f40 1 -- 172.21.15.19:0/601023421 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55f66f1f7100 msgr2=0x55f66f1f74e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.499+0000 7f4560d05f40 1 --2- 172.21.15.19:0/601023421 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55f66f1f7100 0x55f66f1f74e0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.499+0000 7f4560d05f40 1 -- 172.21.15.19:0/601023421 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f454006a810 msgr2=0x7f454006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.499+0000 7f4560d05f40 1 --2- 172.21.15.19:0/601023421 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f454006a810 0x7f454006ccd0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4550003ef0 tx=0x7f45500036b0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.499+0000 7f4560d05f40 1 -- 172.21.15.19:0/601023421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f66f1fbd20 msgr2=0x55f66f1fb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.499+0000 7f4560d05f40 1 --2- 172.21.15.19:0/601023421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f66f1fbd20 0x55f66f1fb520 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f455400bfd0 tx=0x7f4554003020 comp rx=0 tx=0).stop 2024-09-12T02:05:39.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.499+0000 7f455effc640 1 -- 172.21.15.19:0/601023421 reap_dead start 2024-09-12T02:05:39.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.499+0000 7f4560d05f40 1 -- 172.21.15.19:0/601023421 shutdown_connections 2024-09-12T02:05:39.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.499+0000 7f4560d05f40 1 -- 172.21.15.19:0/601023421 >> 172.21.15.19:0/601023421 conn(0x55f66f154490 msgr2=0x55f66f16ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:39.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.499+0000 7f4560d05f40 1 -- 172.21.15.19:0/601023421 shutdown_connections 2024-09-12T02:05:39.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.499+0000 7f4560d05f40 1 -- 172.21.15.19:0/601023421 wait complete. 2024-09-12T02:05:39.504 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:05:39.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.609+0000 7f30afd68640 1 Processor -- start 2024-09-12T02:05:39.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.609+0000 7f30afd68640 1 -- start start 2024-09-12T02:05:39.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.610+0000 7f30afd68640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30a80d15f0 0x7f30a80cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.610+0000 7f30afd68640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f30a80cf160 0x7f30a806d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.610+0000 7f30afd68640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30a80cf980 con 0x7f30a8161a20 2024-09-12T02:05:39.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.610+0000 7f30afd68640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f30a8161e00 con 0x7f30a80cf160 2024-09-12T02:05:39.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.610+0000 7f30afd68640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f30a806d050 con 0x7f30a80d15f0 2024-09-12T02:05:39.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.610+0000 7f30ae305640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f30a80cf160 0x7f30a806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.610+0000 7f30adb04640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f30a8161a20 0x7f30a80d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54024/0 (socket says 172.21.15.19:54024) 2024-09-12T02:05:39.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.610+0000 7f30ae305640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f30a80cf160 0x7f30a806d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55052/0 (socket says 172.21.15.19:55052) 2024-09-12T02:05:39.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.610+0000 7f30adb04640 1 -- 172.21.15.19:0/3617664831 learned_addr learned my addr 172.21.15.19:0/3617664831 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:39.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.610+0000 7f30ad303640 1 --2- 172.21.15.19:0/3617664831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30a80d15f0 0x7f30a80cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.610+0000 7f30ae305640 1 -- 172.21.15.19:0/3617664831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30a80d15f0 msgr2=0x7f30a80cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:39.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.610+0000 7f30ae305640 1 --2- 172.21.15.19:0/3617664831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30a80d15f0 0x7f30a80cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.610+0000 7f30ae305640 1 -- 172.21.15.19:0/3617664831 >> v1:172.21.15.19:6789/0 conn(0x7f30a8161a20 legacy=0x7f30a80d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.610+0000 7f30ae305640 1 -- 172.21.15.19:0/3617664831 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a80cfc20 con 0x7f30a80cf160 2024-09-12T02:05:39.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.610+0000 7f30acb02640 1 -- 172.21.15.19:0/3617664831 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2462164456 0 0) 0x7f30a80cf980 con 0x7f30a8161a20 2024-09-12T02:05:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.611+0000 7f30ae305640 1 --2- 172.21.15.19:0/3617664831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30a80cf160 0x7f30a806d810 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f30a0009d90 tx=0x7f30a002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15cb26c2c18f5560 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.611+0000 7f30acb02640 1 -- 172.21.15.19:0/3617664831 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0007740 con 0x7f30a80cf160 2024-09-12T02:05:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.611+0000 7f30acb02640 1 -- 172.21.15.19:0/3617664831 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a00078e0 con 0x7f30a80cf160 2024-09-12T02:05:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.611+0000 7f30acb02640 1 -- 172.21.15.19:0/3617664831 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0007cb0 con 0x7f30a80cf160 2024-09-12T02:05:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.612+0000 7f30afd68640 1 -- 172.21.15.19:0/3617664831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30a80cf160 msgr2=0x7f30a806d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.612+0000 7f30afd68640 1 --2- 172.21.15.19:0/3617664831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30a80cf160 0x7f30a806d810 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f30a0009d90 tx=0x7f30a002a660 comp rx=0 tx=0).stop 2024-09-12T02:05:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.612+0000 7f30afd68640 1 -- 172.21.15.19:0/3617664831 shutdown_connections 2024-09-12T02:05:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.612+0000 7f30afd68640 1 --2- 172.21.15.19:0/3617664831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30a80cf160 0x7f30a806d810 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.612+0000 7f30afd68640 1 --2- 172.21.15.19:0/3617664831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30a80d15f0 0x7f30a80cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.612+0000 7f30afd68640 1 -- 172.21.15.19:0/3617664831 >> 172.21.15.19:0/3617664831 conn(0x7f30a809d850 msgr2=0x7f30a808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.612+0000 7f30afd68640 1 -- 172.21.15.19:0/3617664831 shutdown_connections 2024-09-12T02:05:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.612+0000 7f30afd68640 1 -- 172.21.15.19:0/3617664831 wait complete. 2024-09-12T02:05:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.613+0000 7f30afd68640 1 Processor -- start 2024-09-12T02:05:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.613+0000 7f30afd68640 1 -- start start 2024-09-12T02:05:39.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.614+0000 7f30afd68640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30a80cf160 0x7f30a81f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.614+0000 7f30afd68640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30a80d15f0 0x7f30a81588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.614+0000 7f30afd68640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30a8161a20 0x7f30a80b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.614+0000 7f30afd68640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f30a80b1040 con 0x7f30a8161a20 2024-09-12T02:05:39.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.614+0000 7f30afd68640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f30a806d2f0 con 0x7f30a80d15f0 2024-09-12T02:05:39.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.614+0000 7f30afd68640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f30a80cf5f0 con 0x7f30a80cf160 2024-09-12T02:05:39.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.614+0000 7f30ae305640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30a8161a20 0x7f30a80b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.614+0000 7f30ae305640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30a8161a20 0x7f30a80b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55064/0 (socket says 172.21.15.19:55064) 2024-09-12T02:05:39.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.614+0000 7f30ae305640 1 -- 172.21.15.19:0/2430329317 learned_addr learned my addr 172.21.15.19:0/2430329317 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:39.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.614+0000 7f30adb04640 1 --2- 172.21.15.19:0/2430329317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30a80cf160 0x7f30a81f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.614+0000 7f30ad303640 1 --2- 172.21.15.19:0/2430329317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30a80d15f0 0x7f30a81588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.614+0000 7f30ae305640 1 -- 172.21.15.19:0/2430329317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30a80cf160 msgr2=0x7f30a81f4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.614+0000 7f30ae305640 1 --2- 172.21.15.19:0/2430329317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30a80cf160 0x7f30a81f4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.614+0000 7f30ae305640 1 -- 172.21.15.19:0/2430329317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30a80d15f0 msgr2=0x7f30a81588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.614+0000 7f30ae305640 1 --2- 172.21.15.19:0/2430329317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30a80d15f0 0x7f30a81588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.614+0000 7f30ae305640 1 -- 172.21.15.19:0/2430329317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a80b47d0 con 0x7f30a8161a20 2024-09-12T02:05:39.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.614+0000 7f30ae305640 1 --2- 172.21.15.19:0/2430329317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30a8161a20 0x7f30a80b4290 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f30a002ac50 tx=0x7f30a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.614+0000 7f309e7fc640 1 -- 172.21.15.19:0/2430329317 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0040070 con 0x7f30a8161a20 2024-09-12T02:05:39.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.615+0000 7f309e7fc640 1 -- 172.21.15.19:0/2430329317 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a0031bc0 con 0x7f30a8161a20 2024-09-12T02:05:39.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.615+0000 7f30afd68640 1 -- 172.21.15.19:0/2430329317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a80b4a70 con 0x7f30a8161a20 2024-09-12T02:05:39.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.615+0000 7f309e7fc640 1 -- 172.21.15.19:0/2430329317 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0009450 con 0x7f30a8161a20 2024-09-12T02:05:39.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.615+0000 7f30afd68640 1 -- 172.21.15.19:0/2430329317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a80b5030 con 0x7f30a8161a20 2024-09-12T02:05:39.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.616+0000 7f30afd68640 1 -- 172.21.15.19:0/2430329317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a80b5230 con 0x7f30a8161a20 2024-09-12T02:05:39.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.616+0000 7f309e7fc640 1 -- 172.21.15.19:0/2430329317 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f30a0039040 con 0x7f30a8161a20 2024-09-12T02:05:39.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.617+0000 7f309e7fc640 1 --2- 172.21.15.19:0/2430329317 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f308c06be30 0x7f308c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.617+0000 7f309e7fc640 1 -- 172.21.15.19:0/2430329317 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 8969+0+0 (secure 0 0 0) 0x7f30a00ad260 con 0x7f30a8161a20 2024-09-12T02:05:39.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.617+0000 7f30adb04640 1 --2- 172.21.15.19:0/2430329317 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f308c06be30 0x7f308c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.617+0000 7f30adb04640 1 --2- 172.21.15.19:0/2430329317 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f308c06be30 0x7f308c06e2f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f30a4007fd0 tx=0x7f30a4007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.621+0000 7f309e7fc640 1 -- 172.21.15.19:0/2430329317 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f30a80b5230 con 0x7f30a8161a20 2024-09-12T02:05:39.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:39.834+0000 7f30afd68640 1 -- 172.21.15.19:0/2430329317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f30a80cec20 con 0x7f30a8161a20 2024-09-12T02:05:40.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.165+0000 7f309e7fc640 1 -- 172.21.15.19:0/2430329317 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v267) ==== 162+0+0 (secure 0 0 0) 0x7f30a00810d0 con 0x7f30a8161a20 2024-09-12T02:05:40.166 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:05:40.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.168+0000 7f30afd68640 1 -- 172.21.15.19:0/2430329317 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f308c06be30 msgr2=0x7f308c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:40.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.168+0000 7f30afd68640 1 --2- 172.21.15.19:0/2430329317 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f308c06be30 0x7f308c06e2f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f30a4007fd0 tx=0x7f30a4007de0 comp rx=0 tx=0).stop 2024-09-12T02:05:40.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.168+0000 7f30afd68640 1 -- 172.21.15.19:0/2430329317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30a8161a20 msgr2=0x7f30a80b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:40.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.168+0000 7f30afd68640 1 --2- 172.21.15.19:0/2430329317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30a8161a20 0x7f30a80b4290 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f30a002ac50 tx=0x7f30a0004a40 comp rx=0 tx=0).stop 2024-09-12T02:05:40.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.168+0000 7f30afd68640 1 -- 172.21.15.19:0/2430329317 shutdown_connections 2024-09-12T02:05:40.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.168+0000 7f30afd68640 1 --2- 172.21.15.19:0/2430329317 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f308c06be30 0x7f308c06e2f0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:40.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.168+0000 7f30afd68640 1 --2- 172.21.15.19:0/2430329317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30a8161a20 0x7f30a80b4290 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:40.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.168+0000 7f30afd68640 1 --2- 172.21.15.19:0/2430329317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30a80d15f0 0x7f30a81588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:40.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.168+0000 7f30afd68640 1 --2- 172.21.15.19:0/2430329317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30a80cf160 0x7f30a81f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:40.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.168+0000 7f30afd68640 1 -- 172.21.15.19:0/2430329317 >> 172.21.15.19:0/2430329317 conn(0x7f30a809d850 msgr2=0x7f30a815d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:40.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.168+0000 7f30afd68640 1 -- 172.21.15.19:0/2430329317 shutdown_connections 2024-09-12T02:05:40.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.168+0000 7f30afd68640 1 -- 172.21.15.19:0/2430329317 wait complete. 2024-09-12T02:05:40.183 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:40.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.287+0000 7fa4e905e640 1 Processor -- start 2024-09-12T02:05:40.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.287+0000 7fa4e905e640 1 -- start start 2024-09-12T02:05:40.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.288+0000 7fa4e905e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa4e40d30f0 0x7fa4e40b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:40.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.288+0000 7fa4e905e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa4e40b64c0 0x7fa4e406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:40.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.288+0000 7fa4e905e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4e40d3690 con 0x7fa4e415e5f0 2024-09-12T02:05:40.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.288+0000 7fa4e905e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa4e406d530 con 0x7fa4e40b64c0 2024-09-12T02:05:40.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.288+0000 7fa4e905e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa4e40d3970 con 0x7fa4e40d30f0 2024-09-12T02:05:40.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.288+0000 7fa4e359e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa4e40b64c0 0x7fa4e406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:40.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.288+0000 7fa4e359e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa4e40b64c0 0x7fa4e406d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55078/0 (socket says 172.21.15.19:55078) 2024-09-12T02:05:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.288+0000 7fa4e359e640 1 -- 172.21.15.19:0/734466241 learned_addr learned my addr 172.21.15.19:0/734466241 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.288+0000 7fa4e2d9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa4e415e5f0 0x7fa4e40d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54040/0 (socket says 172.21.15.19:54040) 2024-09-12T02:05:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.288+0000 7fa4e259c640 1 --2- 172.21.15.19:0/734466241 >> v2:172.21.15.135:3300/0 conn(0x7fa4e40d30f0 0x7fa4e40b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.288+0000 7fa4e359e640 1 -- 172.21.15.19:0/734466241 >> v2:172.21.15.135:3300/0 conn(0x7fa4e40d30f0 msgr2=0x7fa4e40b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.288+0000 7fa4e359e640 1 --2- 172.21.15.19:0/734466241 >> v2:172.21.15.135:3300/0 conn(0x7fa4e40d30f0 0x7fa4e40b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.288+0000 7fa4e359e640 1 -- 172.21.15.19:0/734466241 >> v1:172.21.15.19:6789/0 conn(0x7fa4e415e5f0 legacy=0x7fa4e40d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.288+0000 7fa4e1d9b640 1 -- 172.21.15.19:0/734466241 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 238718885 0 0) 0x7fa4e40d3690 con 0x7fa4e415e5f0 2024-09-12T02:05:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.288+0000 7fa4e359e640 1 -- 172.21.15.19:0/734466241 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e406cee0 con 0x7fa4e40b64c0 2024-09-12T02:05:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.289+0000 7fa4e359e640 1 --2- 172.21.15.19:0/734466241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4e40b64c0 0x7fa4e406d9c0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fa4e408e520 tx=0x7fa4dc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f240f3314343165 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.289+0000 7fa4e1d9b640 1 -- 172.21.15.19:0/734466241 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc036070 con 0x7fa4e40b64c0 2024-09-12T02:05:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.289+0000 7fa4e1d9b640 1 -- 172.21.15.19:0/734466241 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4dc031600 con 0x7fa4e40b64c0 2024-09-12T02:05:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.289+0000 7fa4e1d9b640 1 -- 172.21.15.19:0/734466241 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc0319d0 con 0x7fa4e40b64c0 2024-09-12T02:05:40.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.289+0000 7fa4e905e640 1 -- 172.21.15.19:0/734466241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4e40b64c0 msgr2=0x7fa4e406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:40.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.289+0000 7fa4e905e640 1 --2- 172.21.15.19:0/734466241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4e40b64c0 0x7fa4e406d9c0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fa4e408e520 tx=0x7fa4dc02a730 comp rx=0 tx=0).stop 2024-09-12T02:05:40.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.289+0000 7fa4e905e640 1 -- 172.21.15.19:0/734466241 shutdown_connections 2024-09-12T02:05:40.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.289+0000 7fa4e905e640 1 --2- 172.21.15.19:0/734466241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4e40b64c0 0x7fa4e406d9c0 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:40.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.289+0000 7fa4e905e640 1 --2- 172.21.15.19:0/734466241 >> v2:172.21.15.135:3300/0 conn(0x7fa4e40d30f0 0x7fa4e40b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:40.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.289+0000 7fa4e905e640 1 -- 172.21.15.19:0/734466241 >> 172.21.15.19:0/734466241 conn(0x7fa4e408bfc0 msgr2=0x7fa4e40d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:40.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.289+0000 7fa4e905e640 1 -- 172.21.15.19:0/734466241 shutdown_connections 2024-09-12T02:05:40.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.289+0000 7fa4e905e640 1 -- 172.21.15.19:0/734466241 wait complete. 2024-09-12T02:05:40.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.291+0000 7fa4e905e640 1 Processor -- start 2024-09-12T02:05:40.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.291+0000 7fa4e905e640 1 -- start start 2024-09-12T02:05:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.292+0000 7fa4e905e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4e40b64c0 0x7fa4e41f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.292+0000 7fa4e905e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4e40d30f0 0x7fa4e41f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.292+0000 7fa4e905e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4e415e5f0 0x7fa4e40ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.292+0000 7fa4e905e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e406df00 con 0x7fa4e40b64c0 2024-09-12T02:05:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.292+0000 7fa4e905e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e415e9d0 con 0x7fa4e40d30f0 2024-09-12T02:05:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.292+0000 7fa4e905e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e406e080 con 0x7fa4e415e5f0 2024-09-12T02:05:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.292+0000 7fa4e2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4e40b64c0 0x7fa4e41f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.292+0000 7fa4e2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4e40b64c0 0x7fa4e41f4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55094/0 (socket says 172.21.15.19:55094) 2024-09-12T02:05:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.292+0000 7fa4e2d9d640 1 -- 172.21.15.19:0/870512473 learned_addr learned my addr 172.21.15.19:0/870512473 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.292+0000 7fa4e359e640 1 --2- 172.21.15.19:0/870512473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4e415e5f0 0x7fa4e40ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.292+0000 7fa4e259c640 1 --2- 172.21.15.19:0/870512473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4e40d30f0 0x7fa4e41f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.292+0000 7fa4e2d9d640 1 -- 172.21.15.19:0/870512473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4e415e5f0 msgr2=0x7fa4e40ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.292+0000 7fa4e2d9d640 1 --2- 172.21.15.19:0/870512473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4e415e5f0 0x7fa4e40ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.292+0000 7fa4e2d9d640 1 -- 172.21.15.19:0/870512473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4e40d30f0 msgr2=0x7fa4e41f6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.292+0000 7fa4e2d9d640 1 --2- 172.21.15.19:0/870512473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4e40d30f0 0x7fa4e41f6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.292+0000 7fa4e2d9d640 1 -- 172.21.15.19:0/870512473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e41f3d80 con 0x7fa4e40b64c0 2024-09-12T02:05:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.292+0000 7fa4e2d9d640 1 --2- 172.21.15.19:0/870512473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4e40b64c0 0x7fa4e41f4f40 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400c430 tx=0x7fa4d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.292+0000 7fa4cb7fe640 1 -- 172.21.15.19:0/870512473 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40074e0 con 0x7fa4e40b64c0 2024-09-12T02:05:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.293+0000 7fa4cb7fe640 1 -- 172.21.15.19:0/870512473 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d40047e0 con 0x7fa4e40b64c0 2024-09-12T02:05:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.293+0000 7fa4cb7fe640 1 -- 172.21.15.19:0/870512473 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4004bd0 con 0x7fa4e40b64c0 2024-09-12T02:05:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.293+0000 7fa4e905e640 1 -- 172.21.15.19:0/870512473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e41f4040 con 0x7fa4e40b64c0 2024-09-12T02:05:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.293+0000 7fa4e905e640 1 -- 172.21.15.19:0/870512473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e41f4600 con 0x7fa4e40b64c0 2024-09-12T02:05:40.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.294+0000 7fa4e905e640 1 -- 172.21.15.19:0/870512473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4e41f4cc0 con 0x7fa4e40b64c0 2024-09-12T02:05:40.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.294+0000 7fa4cb7fe640 1 -- 172.21.15.19:0/870512473 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4d4011070 con 0x7fa4e40b64c0 2024-09-12T02:05:40.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.295+0000 7fa4cb7fe640 1 --2- 172.21.15.19:0/870512473 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa4d006be30 0x7fa4d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:40.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.295+0000 7fa4cb7fe640 1 -- 172.21.15.19:0/870512473 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 8969+0+0 (secure 0 0 0) 0x7fa4d408b650 con 0x7fa4e40b64c0 2024-09-12T02:05:40.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.295+0000 7fa4e259c640 1 --2- 172.21.15.19:0/870512473 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa4d006be30 0x7fa4d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:40.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.295+0000 7fa4e259c640 1 --2- 172.21.15.19:0/870512473 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa4d006be30 0x7fa4d006e2f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fa4e40b5fa0 tx=0x7fa4d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:40.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.299+0000 7fa4cb7fe640 1 -- 172.21.15.19:0/870512473 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa4e41f4cc0 con 0x7fa4e40b64c0 2024-09-12T02:05:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.514+0000 7fa4e905e640 1 -- 172.21.15.19:0/870512473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4e40b68a0 con 0x7fa4e40b64c0 2024-09-12T02:05:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.514+0000 7fa4cb7fe640 1 -- 172.21.15.19:0/870512473 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 268 v268) ==== 95+0+5227 (secure 0 0 0) 0x7fa4d4058ca0 con 0x7fa4e40b64c0 2024-09-12T02:05:40.515 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:40.515 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":268,"btime":"2024-09-12T02:05:40:169139+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":268,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:40.169121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9855},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9855":{"gid":9855,"name":"c","rank":0,"incarnation":268,"state":"up:replay","state_seq":1,"addr":"172.21.15.19:6834/1975440909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1975440909},{"type":"v1","addr":"172.21.15.19:6834","nonce":1975440909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 268 2024-09-12T02:05:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.516+0000 7fa4e905e640 1 -- 172.21.15.19:0/870512473 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa4d006be30 msgr2=0x7fa4d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.516+0000 7fa4e905e640 1 --2- 172.21.15.19:0/870512473 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa4d006be30 0x7fa4d006e2f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fa4e40b5fa0 tx=0x7fa4d8008040 comp rx=0 tx=0).stop 2024-09-12T02:05:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.516+0000 7fa4e905e640 1 -- 172.21.15.19:0/870512473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4e40b64c0 msgr2=0x7fa4e41f4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.516+0000 7fa4e905e640 1 --2- 172.21.15.19:0/870512473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4e40b64c0 0x7fa4e41f4f40 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400c430 tx=0x7fa4d400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:05:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.516+0000 7fa4e905e640 1 -- 172.21.15.19:0/870512473 shutdown_connections 2024-09-12T02:05:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.516+0000 7fa4e905e640 1 --2- 172.21.15.19:0/870512473 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa4d006be30 0x7fa4d006e2f0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.516+0000 7fa4e905e640 1 --2- 172.21.15.19:0/870512473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4e415e5f0 0x7fa4e40ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.516+0000 7fa4e905e640 1 --2- 172.21.15.19:0/870512473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4e40d30f0 0x7fa4e41f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.517+0000 7fa4e905e640 1 --2- 172.21.15.19:0/870512473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4e40b64c0 0x7fa4e41f4f40 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.517+0000 7fa4e905e640 1 -- 172.21.15.19:0/870512473 >> 172.21.15.19:0/870512473 conn(0x7fa4e408bfc0 msgr2=0x7fa4e40b9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.517+0000 7fa4e905e640 1 -- 172.21.15.19:0/870512473 shutdown_connections 2024-09-12T02:05:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:40.517+0000 7fa4e905e640 1 -- 172.21.15.19:0/870512473 wait complete. 2024-09-12T02:05:40.528 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-12T02:05:43.187 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:05:43.187+0000 7f0a867b8640 -1 mds.0.damage notify_dentry Damage to dentries in fragment * of ino 0x100is fatal because it is a system directory for this rank 2024-09-12T02:05:43.188 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:05:43.188+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:05:43.189 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:05:43.188+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:05:44.171 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:05:44.171+0000 7f0a8a7c0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:05:45.529 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:45.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.644+0000 7f935701e640 1 Processor -- start 2024-09-12T02:05:45.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.644+0000 7f935701e640 1 -- start start 2024-09-12T02:05:45.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.645+0000 7f935701e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f935015e5d0 0x7f93500d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.645+0000 7f935701e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f935006df60 0x7f935009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.645+0000 7f935701e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93500d1630 0x7f935009af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.645+0000 7f935701e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f935006dad0 con 0x7f935006df60 2024-09-12T02:05:45.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.645+0000 7f935701e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f935006cec0 con 0x7f935015e5d0 2024-09-12T02:05:45.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.645+0000 7f935701e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f935006d1a0 con 0x7f93500d1630 2024-09-12T02:05:45.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.645+0000 7f9347fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f935006df60 0x7f935009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.645+0000 7f9347fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f935006df60 0x7f935009aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47540/0 (socket says 172.21.15.19:47540) 2024-09-12T02:05:45.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.645+0000 7f9347fff640 1 -- 172.21.15.19:0/2147267711 learned_addr learned my addr 172.21.15.19:0/2147267711 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:45.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.645+0000 7f9354dba640 1 --2- 172.21.15.19:0/2147267711 >> v2:172.21.15.135:3300/0 conn(0x7f935015e5d0 0x7f93500d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.645+0000 7f93555bb640 1 --2- 172.21.15.19:0/2147267711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93500d1630 0x7f935009af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.645+0000 7f9347fff640 1 -- 172.21.15.19:0/2147267711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93500d1630 msgr2=0x7f935009af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:45.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.645+0000 7f9347fff640 1 --2- 172.21.15.19:0/2147267711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93500d1630 0x7f935009af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.645+0000 7f9347fff640 1 -- 172.21.15.19:0/2147267711 >> v2:172.21.15.135:3300/0 conn(0x7f935015e5d0 msgr2=0x7f93500d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:45.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.645+0000 7f9347fff640 1 --2- 172.21.15.19:0/2147267711 >> v2:172.21.15.135:3300/0 conn(0x7f935015e5d0 0x7f93500d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.645+0000 7f9347fff640 1 -- 172.21.15.19:0/2147267711 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935006d480 con 0x7f935006df60 2024-09-12T02:05:45.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.645+0000 7f9354dba640 1 --2- 172.21.15.19:0/2147267711 >> v2:172.21.15.135:3300/0 conn(0x7f935015e5d0 0x7f93500d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:45.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.645+0000 7f93555bb640 1 --2- 172.21.15.19:0/2147267711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93500d1630 0x7f935009af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.646+0000 7f9347fff640 1 --2- 172.21.15.19:0/2147267711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f935006df60 0x7f935009aa30 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f93500734a0 tx=0x7f934002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135c4a93d2d7a04b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.646+0000 7f93477fe640 1 -- 172.21.15.19:0/2147267711 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340037070 con 0x7f935006df60 2024-09-12T02:05:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.646+0000 7f93477fe640 1 -- 172.21.15.19:0/2147267711 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9340032440 con 0x7f935006df60 2024-09-12T02:05:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.646+0000 7f93477fe640 1 -- 172.21.15.19:0/2147267711 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340032810 con 0x7f935006df60 2024-09-12T02:05:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.647+0000 7f935701e640 1 -- 172.21.15.19:0/2147267711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f935006df60 msgr2=0x7f935009aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.647+0000 7f935701e640 1 --2- 172.21.15.19:0/2147267711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f935006df60 0x7f935009aa30 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f93500734a0 tx=0x7f934002a270 comp rx=0 tx=0).stop 2024-09-12T02:05:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.647+0000 7f935701e640 1 -- 172.21.15.19:0/2147267711 shutdown_connections 2024-09-12T02:05:45.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.647+0000 7f935701e640 1 --2- 172.21.15.19:0/2147267711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93500d1630 0x7f935009af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.647+0000 7f935701e640 1 --2- 172.21.15.19:0/2147267711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f935006df60 0x7f935009aa30 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.647+0000 7f935701e640 1 --2- 172.21.15.19:0/2147267711 >> v2:172.21.15.135:3300/0 conn(0x7f935015e5d0 0x7f93500d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.647+0000 7f935701e640 1 -- 172.21.15.19:0/2147267711 >> 172.21.15.19:0/2147267711 conn(0x7f93500d23a0 msgr2=0x7f93500d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:45.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.647+0000 7f935701e640 1 -- 172.21.15.19:0/2147267711 shutdown_connections 2024-09-12T02:05:45.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.647+0000 7f935701e640 1 -- 172.21.15.19:0/2147267711 wait complete. 2024-09-12T02:05:45.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.648+0000 7f935701e640 1 Processor -- start 2024-09-12T02:05:45.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.648+0000 7f935701e640 1 -- start start 2024-09-12T02:05:45.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.649+0000 7f935701e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f935006df60 0x7f93500c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.649+0000 7f935701e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93500d1630 0x7f93500c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.649+0000 7f935701e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f935015e5d0 0x7f9350152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.649+0000 7f935701e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f935015eb30 con 0x7f935006df60 2024-09-12T02:05:45.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.649+0000 7f935701e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f935015e9b0 con 0x7f93500d1630 2024-09-12T02:05:45.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.649+0000 7f935701e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9350162230 con 0x7f935015e5d0 2024-09-12T02:05:45.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.649+0000 7f9354dba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f935006df60 0x7f93500c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.649+0000 7f9354dba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f935006df60 0x7f93500c89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47542/0 (socket says 172.21.15.19:47542) 2024-09-12T02:05:45.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.649+0000 7f9354dba640 1 -- 172.21.15.19:0/638850512 learned_addr learned my addr 172.21.15.19:0/638850512 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:45.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.650+0000 7f9347fff640 1 --2- 172.21.15.19:0/638850512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93500d1630 0x7f93500c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.650+0000 7f9354dba640 1 -- 172.21.15.19:0/638850512 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f935015e5d0 msgr2=0x7f9350152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.650+0000 7f93555bb640 1 --2- 172.21.15.19:0/638850512 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f935015e5d0 0x7f9350152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.650+0000 7f9354dba640 1 --2- 172.21.15.19:0/638850512 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f935015e5d0 0x7f9350152bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.650+0000 7f9354dba640 1 -- 172.21.15.19:0/638850512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93500d1630 msgr2=0x7f93500c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.650+0000 7f9354dba640 1 --2- 172.21.15.19:0/638850512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93500d1630 0x7f93500c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.650+0000 7f9354dba640 1 -- 172.21.15.19:0/638850512 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93500c7690 con 0x7f935006df60 2024-09-12T02:05:45.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.650+0000 7f9354dba640 1 --2- 172.21.15.19:0/638850512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f935006df60 0x7f93500c89d0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f934c00c7f0 tx=0x7f934c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:45.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.650+0000 7f93457fa640 1 -- 172.21.15.19:0/638850512 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c015070 con 0x7f935006df60 2024-09-12T02:05:45.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.650+0000 7f93457fa640 1 -- 172.21.15.19:0/638850512 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f934c007820 con 0x7f935006df60 2024-09-12T02:05:45.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.650+0000 7f935701e640 1 -- 172.21.15.19:0/638850512 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93500c7930 con 0x7f935006df60 2024-09-12T02:05:45.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.650+0000 7f93457fa640 1 -- 172.21.15.19:0/638850512 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c007bd0 con 0x7f935006df60 2024-09-12T02:05:45.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.650+0000 7f935701e640 1 -- 172.21.15.19:0/638850512 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93500c7ef0 con 0x7f935006df60 2024-09-12T02:05:45.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.651+0000 7f935701e640 1 -- 172.21.15.19:0/638850512 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93500d10f0 con 0x7f935006df60 2024-09-12T02:05:45.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.652+0000 7f93457fa640 1 -- 172.21.15.19:0/638850512 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f934c018070 con 0x7f935006df60 2024-09-12T02:05:45.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.652+0000 7f93457fa640 1 --2- 172.21.15.19:0/638850512 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f933c06be60 0x7f933c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.652+0000 7f93457fa640 1 -- 172.21.15.19:0/638850512 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7f934c08bc80 con 0x7f935006df60 2024-09-12T02:05:45.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.652+0000 7f9347fff640 1 --2- 172.21.15.19:0/638850512 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f933c06be60 0x7f933c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.653+0000 7f9347fff640 1 --2- 172.21.15.19:0/638850512 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f933c06be60 0x7f933c06e320 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f9340034000 tx=0x7f934002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:45.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.657+0000 7f93457fa640 1 -- 172.21.15.19:0/638850512 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f934c0598d0 con 0x7f935006df60 2024-09-12T02:05:45.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.867+0000 7f935701e640 1 -- 172.21.15.19:0/638850512 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93501630b0 con 0x7f935006df60 2024-09-12T02:05:45.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.867+0000 7f93457fa640 1 -- 172.21.15.19:0/638850512 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 272 v272) ==== 95+0+4392 (secure 0 0 0) 0x7f934c0591d0 con 0x7f935006df60 2024-09-12T02:05:45.868 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:45.868 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":272,"btime":"2024-09-12T02:05:43:189791+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":272,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:43.189786+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":127,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:45.868 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 272 2024-09-12T02:05:45.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.869+0000 7f935701e640 1 -- 172.21.15.19:0/638850512 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f933c06be60 msgr2=0x7f933c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.869+0000 7f935701e640 1 --2- 172.21.15.19:0/638850512 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f933c06be60 0x7f933c06e320 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f9340034000 tx=0x7f934002e000 comp rx=0 tx=0).stop 2024-09-12T02:05:45.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.869+0000 7f935701e640 1 -- 172.21.15.19:0/638850512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f935006df60 msgr2=0x7f93500c89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.869+0000 7f935701e640 1 --2- 172.21.15.19:0/638850512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f935006df60 0x7f93500c89d0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f934c00c7f0 tx=0x7f934c00ccb0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.869+0000 7f935701e640 1 -- 172.21.15.19:0/638850512 shutdown_connections 2024-09-12T02:05:45.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.869+0000 7f935701e640 1 --2- 172.21.15.19:0/638850512 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f933c06be60 0x7f933c06e320 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.869+0000 7f935701e640 1 --2- 172.21.15.19:0/638850512 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f935015e5d0 0x7f9350152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.869+0000 7f935701e640 1 --2- 172.21.15.19:0/638850512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93500d1630 0x7f93500c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.869+0000 7f935701e640 1 --2- 172.21.15.19:0/638850512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f935006df60 0x7f93500c89d0 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.869+0000 7f935701e640 1 -- 172.21.15.19:0/638850512 >> 172.21.15.19:0/638850512 conn(0x7f93500d23a0 msgr2=0x7f93500b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:45.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.869+0000 7f935701e640 1 -- 172.21.15.19:0/638850512 shutdown_connections 2024-09-12T02:05:45.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.869+0000 7f935701e640 1 -- 172.21.15.19:0/638850512 wait complete. 2024-09-12T02:05:45.881 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:05:45.881 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.982+0000 7fe24c053640 1 Processor -- start 2024-09-12T02:05:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.983+0000 7fe24c053640 1 -- start start 2024-09-12T02:05:45.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.983+0000 7fe24c053640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe244161c80 0x7fe24406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.983+0000 7fe24c053640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe24406e870 con 0x7fe2440b6680 2024-09-12T02:05:45.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.983+0000 7fe24c053640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe24406d9f0 con 0x7fe244162060 2024-09-12T02:05:45.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.983+0000 7fe24c053640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe24406dcd0 con 0x7fe244161c80 2024-09-12T02:05:45.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.983+0000 7fe24a5f0640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe2440b6680 0x7fe2440cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34586/0 (socket says 172.21.15.19:34586) 2024-09-12T02:05:45.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.983+0000 7fe24a5f0640 1 -- 172.21.15.19:0/2610004518 learned_addr learned my addr 172.21.15.19:0/2610004518 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:45.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe249def640 1 --2- 172.21.15.19:0/2610004518 >> v2:172.21.15.135:3300/0 conn(0x7fe244161c80 0x7fe24406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe248ded640 1 -- 172.21.15.19:0/2610004518 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2825919697 0 0) 0x7fe23c001490 con 0x7fe2440b6680 2024-09-12T02:05:45.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe248ded640 1 -- 172.21.15.19:0/2610004518 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe230003520 con 0x7fe2440b6680 2024-09-12T02:05:45.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe248ded640 1 -- 172.21.15.19:0/2610004518 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3344403844 0 0) 0x7fe24406d9f0 con 0x7fe244162060 2024-09-12T02:05:45.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe248ded640 1 -- 172.21.15.19:0/2610004518 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe23c001490 con 0x7fe244162060 2024-09-12T02:05:45.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe248ded640 1 -- 172.21.15.19:0/2610004518 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3419935135 0 0) 0x7fe230003520 con 0x7fe2440b6680 2024-09-12T02:05:45.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe248ded640 1 -- 172.21.15.19:0/2610004518 >> v2:172.21.15.135:3300/0 conn(0x7fe244161c80 msgr2=0x7fe24406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:45.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe248ded640 1 --2- 172.21.15.19:0/2610004518 >> v2:172.21.15.135:3300/0 conn(0x7fe244161c80 0x7fe24406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe248ded640 1 -- 172.21.15.19:0/2610004518 >> v1:172.21.15.135:6789/0 conn(0x7fe244162060 legacy=0x7fe2440b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe248ded640 1 -- 172.21.15.19:0/2610004518 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24406dfb0 con 0x7fe2440b6680 2024-09-12T02:05:45.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe248ded640 1 -- 172.21.15.19:0/2610004518 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fe23c001bc0 con 0x7fe2440b6680 2024-09-12T02:05:45.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe248ded640 1 -- 172.21.15.19:0/2610004518 >> v1:172.21.15.19:6789/0 conn(0x7fe2440b6680 legacy=0x7fe2440cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe248ded640 1 --2- 172.21.15.19:0/2610004518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe230003b90 0x7fe230003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe248ded640 1 --2- 172.21.15.19:0/2610004518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe230004800 0x7fe230004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe248ded640 1 --2- 172.21.15.19:0/2610004518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2300051c0 0x7fe23000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe248ded640 1 -- 172.21.15.19:0/2610004518 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe24406dcd0 con 0x7fe230004800 2024-09-12T02:05:45.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe248ded640 1 -- 172.21.15.19:0/2610004518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe23000c090 con 0x7fe230003b90 2024-09-12T02:05:45.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe248ded640 1 -- 172.21.15.19:0/2610004518 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe23000c290 con 0x7fe2300051c0 2024-09-12T02:05:45.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe2495ee640 1 --2- 172.21.15.19:0/2610004518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe230004800 0x7fe230004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe249def640 1 --2- 172.21.15.19:0/2610004518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe230003b90 0x7fe230003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.984+0000 7fe24a5f0640 1 --2- 172.21.15.19:0/2610004518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2300051c0 0x7fe23000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.985+0000 7fe2495ee640 1 -- 172.21.15.19:0/2610004518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2300051c0 msgr2=0x7fe23000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:45.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.985+0000 7fe2495ee640 1 --2- 172.21.15.19:0/2610004518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2300051c0 0x7fe23000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.985+0000 7fe2495ee640 1 -- 172.21.15.19:0/2610004518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe230003b90 msgr2=0x7fe230003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:45.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.985+0000 7fe2495ee640 1 --2- 172.21.15.19:0/2610004518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe230003b90 0x7fe230003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.985+0000 7fe2495ee640 1 -- 172.21.15.19:0/2610004518 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe230003520 con 0x7fe230004800 2024-09-12T02:05:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.985+0000 7fe24a5f0640 1 --2- 172.21.15.19:0/2610004518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2300051c0 0x7fe23000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.985+0000 7fe24a5f0640 1 -- 172.21.15.19:0/2610004518 reap_dead start 2024-09-12T02:05:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.985+0000 7fe2495ee640 1 --2- 172.21.15.19:0/2610004518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe230004800 0x7fe230004c80 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fe2340018a0 tx=0x7fe230005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd28e16a992e3c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.985+0000 7fe248ded640 1 -- 172.21.15.19:0/2610004518 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2340014f0 con 0x7fe230004800 2024-09-12T02:05:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.985+0000 7fe248ded640 1 -- 172.21.15.19:0/2610004518 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2340052d0 con 0x7fe230004800 2024-09-12T02:05:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.985+0000 7fe248ded640 1 -- 172.21.15.19:0/2610004518 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23402ac40 con 0x7fe230004800 2024-09-12T02:05:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.986+0000 7fe24c053640 1 -- 172.21.15.19:0/2610004518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe230004800 msgr2=0x7fe230004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.986+0000 7fe24c053640 1 --2- 172.21.15.19:0/2610004518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe230004800 0x7fe230004c80 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fe2340018a0 tx=0x7fe230005830 comp rx=0 tx=0).stop 2024-09-12T02:05:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.986+0000 7fe24c053640 1 -- 172.21.15.19:0/2610004518 shutdown_connections 2024-09-12T02:05:45.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.986+0000 7fe24c053640 1 --2- 172.21.15.19:0/2610004518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe230004800 0x7fe230004c80 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.986+0000 7fe24c053640 1 -- 172.21.15.19:0/2610004518 >> 172.21.15.19:0/2610004518 conn(0x7fe2440d44f0 msgr2=0x7fe2440d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:45.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.986+0000 7fe24c053640 1 -- 172.21.15.19:0/2610004518 shutdown_connections 2024-09-12T02:05:45.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.986+0000 7fe24c053640 1 -- 172.21.15.19:0/2610004518 wait complete. 2024-09-12T02:05:45.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.987+0000 7fe24c053640 1 Processor -- start 2024-09-12T02:05:45.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.987+0000 7fe24c053640 1 -- start start 2024-09-12T02:05:45.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.988+0000 7fe24c053640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe230004800 0x7fe2440b7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.988+0000 7fe24c053640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe244155550 0x7fe24415a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.988+0000 7fe24c053640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2440b9720 0x7fe2440b9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.988+0000 7fe24c053640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe2440b6b30 con 0x7fe2440b9720 2024-09-12T02:05:45.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.988+0000 7fe24c053640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe2440d2aa0 con 0x7fe230004800 2024-09-12T02:05:45.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.988+0000 7fe24c053640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe2440b6cb0 con 0x7fe244155550 2024-09-12T02:05:45.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.988+0000 7fe24a5f0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2440b9720 0x7fe2440b9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.988+0000 7fe24a5f0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2440b9720 0x7fe2440b9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47562/0 (socket says 172.21.15.19:47562) 2024-09-12T02:05:45.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.988+0000 7fe24a5f0640 1 -- 172.21.15.19:0/2699022152 learned_addr learned my addr 172.21.15.19:0/2699022152 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:45.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.988+0000 7fe249def640 1 --2- 172.21.15.19:0/2699022152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe230004800 0x7fe2440b7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.988+0000 7fe2495ee640 1 --2- 172.21.15.19:0/2699022152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe244155550 0x7fe24415a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.988+0000 7fe24a5f0640 1 -- 172.21.15.19:0/2699022152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe244155550 msgr2=0x7fe24415a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.988+0000 7fe24a5f0640 1 --2- 172.21.15.19:0/2699022152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe244155550 0x7fe24415a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.988+0000 7fe24a5f0640 1 -- 172.21.15.19:0/2699022152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe230004800 msgr2=0x7fe2440b7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.988+0000 7fe24a5f0640 1 --2- 172.21.15.19:0/2699022152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe230004800 0x7fe2440b7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.988+0000 7fe24a5f0640 1 -- 172.21.15.19:0/2699022152 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2440b21e0 con 0x7fe2440b9720 2024-09-12T02:05:45.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.989+0000 7fe24a5f0640 1 --2- 172.21.15.19:0/2699022152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2440b9720 0x7fe2440b9bd0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7fe24406ed60 tx=0x7fe23c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:45.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.989+0000 7fe23a7fc640 1 -- 172.21.15.19:0/2699022152 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00eb90 con 0x7fe2440b9720 2024-09-12T02:05:45.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.989+0000 7fe23a7fc640 1 -- 172.21.15.19:0/2699022152 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe23c00ed50 con 0x7fe2440b9720 2024-09-12T02:05:45.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.989+0000 7fe24c053640 1 -- 172.21.15.19:0/2699022152 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2440b24c0 con 0x7fe2440b9720 2024-09-12T02:05:45.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.989+0000 7fe23a7fc640 1 -- 172.21.15.19:0/2699022152 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c014670 con 0x7fe2440b9720 2024-09-12T02:05:45.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.989+0000 7fe24c053640 1 -- 172.21.15.19:0/2699022152 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2441559d0 con 0x7fe2440b9720 2024-09-12T02:05:45.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.990+0000 7fe24c053640 1 -- 172.21.15.19:0/2699022152 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe24406e330 con 0x7fe2440b9720 2024-09-12T02:05:45.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.990+0000 7fe23a7fc640 1 -- 172.21.15.19:0/2699022152 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe23c014810 con 0x7fe2440b9720 2024-09-12T02:05:45.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.991+0000 7fe23a7fc640 1 --2- 172.21.15.19:0/2699022152 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe22806be60 0x7fe22806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.991+0000 7fe23a7fc640 1 -- 172.21.15.19:0/2699022152 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7fe23c08b860 con 0x7fe2440b9720 2024-09-12T02:05:45.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.991+0000 7fe249def640 1 --2- 172.21.15.19:0/2699022152 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe22806be60 0x7fe22806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.991+0000 7fe249def640 1 --2- 172.21.15.19:0/2699022152 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe22806be60 0x7fe22806e320 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe2440cbee0 tx=0x7fe240009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:45.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:45.995+0000 7fe23a7fc640 1 -- 172.21.15.19:0/2699022152 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe24406e870 con 0x7fe2440b9720 2024-09-12T02:05:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.206+0000 7fe24c053640 1 -- 172.21.15.19:0/2699022152 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2440ba470 con 0x7fe2440b9720 2024-09-12T02:05:46.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.206+0000 7fe23a7fc640 1 -- 172.21.15.19:0/2699022152 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 272 v272) ==== 95+0+4392 (secure 0 0 0) 0x7fe23c058e70 con 0x7fe2440b9720 2024-09-12T02:05:46.207 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:46.207 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":272,"btime":"2024-09-12T02:05:43:189791+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":272,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:43.189786+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":127,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:46.207 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 272 2024-09-12T02:05:46.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.208+0000 7fe24c053640 1 -- 172.21.15.19:0/2699022152 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe22806be60 msgr2=0x7fe22806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:46.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.208+0000 7fe24c053640 1 --2- 172.21.15.19:0/2699022152 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe22806be60 0x7fe22806e320 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe2440cbee0 tx=0x7fe240009190 comp rx=0 tx=0).stop 2024-09-12T02:05:46.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.208+0000 7fe24c053640 1 -- 172.21.15.19:0/2699022152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2440b9720 msgr2=0x7fe2440b9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:46.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.208+0000 7fe24c053640 1 --2- 172.21.15.19:0/2699022152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2440b9720 0x7fe2440b9bd0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7fe24406ed60 tx=0x7fe23c00e530 comp rx=0 tx=0).stop 2024-09-12T02:05:46.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.208+0000 7fe24c053640 1 -- 172.21.15.19:0/2699022152 shutdown_connections 2024-09-12T02:05:46.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.208+0000 7fe24c053640 1 --2- 172.21.15.19:0/2699022152 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe22806be60 0x7fe22806e320 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.208+0000 7fe24c053640 1 --2- 172.21.15.19:0/2699022152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2440b9720 0x7fe2440b9bd0 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.208+0000 7fe24c053640 1 --2- 172.21.15.19:0/2699022152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe244155550 0x7fe24415a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.208+0000 7fe24c053640 1 --2- 172.21.15.19:0/2699022152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe230004800 0x7fe2440b7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.208+0000 7fe24c053640 1 -- 172.21.15.19:0/2699022152 >> 172.21.15.19:0/2699022152 conn(0x7fe2440d44f0 msgr2=0x7fe2440b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:46.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.208+0000 7fe24c053640 1 -- 172.21.15.19:0/2699022152 shutdown_connections 2024-09-12T02:05:46.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.208+0000 7fe24c053640 1 -- 172.21.15.19:0/2699022152 wait complete. 2024-09-12T02:05:46.220 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:05:46.220 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:46.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.321+0000 7f2e3588d640 1 Processor -- start 2024-09-12T02:05:46.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.322+0000 7f2e3588d640 1 -- start start 2024-09-12T02:05:46.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.322+0000 7f2e3588d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2e30162060 0x7f2e300b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:46.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.322+0000 7f2e3588d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e300b64b0 0x7f2e300b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:46.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.322+0000 7f2e3588d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e3006d9f0 con 0x7f2e30161c80 2024-09-12T02:05:46.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.322+0000 7f2e3588d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2e3006dcd0 con 0x7f2e300b64b0 2024-09-12T02:05:46.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.322+0000 7f2e3588d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f2e3006dfb0 con 0x7f2e30162060 2024-09-12T02:05:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.323+0000 7f2e2effd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2e30161c80 0x7f2e3006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34600/0 (socket says 172.21.15.19:34600) 2024-09-12T02:05:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.323+0000 7f2e2effd640 1 -- 172.21.15.19:0/2182595922 learned_addr learned my addr 172.21.15.19:0/2182595922 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.323+0000 7f2e2f7fe640 1 --2- 172.21.15.19:0/2182595922 >> v2:172.21.15.19:3300/0 conn(0x7f2e300b64b0 0x7f2e300b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.323+0000 7f2e27fff640 1 --2- 172.21.15.19:0/2182595922 >> v2:172.21.15.135:3300/0 conn(0x7f2e30162060 0x7f2e300b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.323+0000 7f2e2f7fe640 1 -- 172.21.15.19:0/2182595922 >> v2:172.21.15.135:3300/0 conn(0x7f2e30162060 msgr2=0x7f2e300b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.323+0000 7f2e2f7fe640 1 --2- 172.21.15.19:0/2182595922 >> v2:172.21.15.135:3300/0 conn(0x7f2e30162060 0x7f2e300b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.323+0000 7f2e2f7fe640 1 -- 172.21.15.19:0/2182595922 >> v1:172.21.15.19:6789/0 conn(0x7f2e30161c80 legacy=0x7f2e3006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.323+0000 7f2e2f7fe640 1 -- 172.21.15.19:0/2182595922 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e300d01f0 con 0x7f2e300b64b0 2024-09-12T02:05:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.323+0000 7f2e2e7fc640 1 -- 172.21.15.19:0/2182595922 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 583866553 0 0) 0x7f2e3006d9f0 con 0x7f2e30161c80 2024-09-12T02:05:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.323+0000 7f2e27fff640 1 --2- 172.21.15.19:0/2182595922 >> v2:172.21.15.135:3300/0 conn(0x7f2e30162060 0x7f2e300b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:46.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.324+0000 7f2e2f7fe640 1 --2- 172.21.15.19:0/2182595922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e300b64b0 0x7f2e300b6960 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f2e3008e830 tx=0x7f2e2802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ce7c47eb4b1ba9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:46.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.324+0000 7f2e2e7fc640 1 -- 172.21.15.19:0/2182595922 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e28007740 con 0x7f2e300b64b0 2024-09-12T02:05:46.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.324+0000 7f2e2e7fc640 1 -- 172.21.15.19:0/2182595922 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e280078e0 con 0x7f2e300b64b0 2024-09-12T02:05:46.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.324+0000 7f2e2e7fc640 1 -- 172.21.15.19:0/2182595922 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e28007cb0 con 0x7f2e300b64b0 2024-09-12T02:05:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.324+0000 7f2e3588d640 1 -- 172.21.15.19:0/2182595922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e300b64b0 msgr2=0x7f2e300b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.324+0000 7f2e3588d640 1 --2- 172.21.15.19:0/2182595922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e300b64b0 0x7f2e300b6960 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f2e3008e830 tx=0x7f2e2802a680 comp rx=0 tx=0).stop 2024-09-12T02:05:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.324+0000 7f2e3588d640 1 -- 172.21.15.19:0/2182595922 shutdown_connections 2024-09-12T02:05:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.324+0000 7f2e3588d640 1 --2- 172.21.15.19:0/2182595922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e300b64b0 0x7f2e300b6960 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.324+0000 7f2e3588d640 1 --2- 172.21.15.19:0/2182595922 >> v2:172.21.15.135:3300/0 conn(0x7f2e30162060 0x7f2e300b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.324+0000 7f2e3588d640 1 -- 172.21.15.19:0/2182595922 >> 172.21.15.19:0/2182595922 conn(0x7f2e300d44f0 msgr2=0x7f2e300d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.324+0000 7f2e3588d640 1 -- 172.21.15.19:0/2182595922 shutdown_connections 2024-09-12T02:05:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.324+0000 7f2e3588d640 1 -- 172.21.15.19:0/2182595922 wait complete. 2024-09-12T02:05:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.326+0000 7f2e3588d640 1 Processor -- start 2024-09-12T02:05:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.326+0000 7f2e3588d640 1 -- start start 2024-09-12T02:05:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.326+0000 7f2e3588d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e300b64b0 0x7f2e300cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.326+0000 7f2e3588d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e30161c80 0x7f2e30159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.326+0000 7f2e3588d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e30162060 0x7f2e300b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.326+0000 7f2e3588d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2e300cf1e0 con 0x7f2e30162060 2024-09-12T02:05:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.326+0000 7f2e3588d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e300d2aa0 con 0x7f2e30161c80 2024-09-12T02:05:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.326+0000 7f2e3588d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2e300cf360 con 0x7f2e300b64b0 2024-09-12T02:05:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.326+0000 7f2e2f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e30162060 0x7f2e300b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.327+0000 7f2e2f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e30162060 0x7f2e300b7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47566/0 (socket says 172.21.15.19:47566) 2024-09-12T02:05:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.327+0000 7f2e2f7fe640 1 -- 172.21.15.19:0/613967938 learned_addr learned my addr 172.21.15.19:0/613967938 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.327+0000 7f2e2effd640 1 --2- 172.21.15.19:0/613967938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e300b64b0 0x7f2e300cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.327+0000 7f2e27fff640 1 --2- 172.21.15.19:0/613967938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e30161c80 0x7f2e30159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.327+0000 7f2e2f7fe640 1 -- 172.21.15.19:0/613967938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e300b64b0 msgr2=0x7f2e300cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.327+0000 7f2e2f7fe640 1 --2- 172.21.15.19:0/613967938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e300b64b0 0x7f2e300cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.327+0000 7f2e2f7fe640 1 -- 172.21.15.19:0/613967938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e30161c80 msgr2=0x7f2e30159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.327+0000 7f2e2f7fe640 1 --2- 172.21.15.19:0/613967938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e30161c80 0x7f2e30159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.327+0000 7f2e2f7fe640 1 -- 172.21.15.19:0/613967938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e300cb5c0 con 0x7f2e30162060 2024-09-12T02:05:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.327+0000 7f2e2f7fe640 1 --2- 172.21.15.19:0/613967938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e30162060 0x7f2e300b7f60 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f2e2802ac70 tx=0x7f2e28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.327+0000 7f2e2cff9640 1 -- 172.21.15.19:0/613967938 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e28040070 con 0x7f2e30162060 2024-09-12T02:05:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.327+0000 7f2e2cff9640 1 -- 172.21.15.19:0/613967938 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e28031bc0 con 0x7f2e30162060 2024-09-12T02:05:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.327+0000 7f2e2cff9640 1 -- 172.21.15.19:0/613967938 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e28045460 con 0x7f2e30162060 2024-09-12T02:05:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.327+0000 7f2e3588d640 1 -- 172.21.15.19:0/613967938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e300cb8a0 con 0x7f2e30162060 2024-09-12T02:05:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.327+0000 7f2e3588d640 1 -- 172.21.15.19:0/613967938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e300cbe60 con 0x7f2e30162060 2024-09-12T02:05:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.328+0000 7f2e3588d640 1 -- 172.21.15.19:0/613967938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e300b5f70 con 0x7f2e30162060 2024-09-12T02:05:46.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.329+0000 7f2e2cff9640 1 -- 172.21.15.19:0/613967938 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e28039040 con 0x7f2e30162060 2024-09-12T02:05:46.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.329+0000 7f2e2cff9640 1 --2- 172.21.15.19:0/613967938 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e1006be30 0x7f2e1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:46.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.329+0000 7f2e2cff9640 1 -- 172.21.15.19:0/613967938 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7f2e280ad330 con 0x7f2e30162060 2024-09-12T02:05:46.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.330+0000 7f2e2effd640 1 --2- 172.21.15.19:0/613967938 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e1006be30 0x7f2e1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:46.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.330+0000 7f2e2effd640 1 --2- 172.21.15.19:0/613967938 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e1006be30 0x7f2e1006e2f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2e20000f60 tx=0x7f2e20007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.333+0000 7f2e2cff9640 1 -- 172.21.15.19:0/613967938 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e2807a9c0 con 0x7f2e30162060 2024-09-12T02:05:46.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.545+0000 7f2e3588d640 1 -- 172.21.15.19:0/613967938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e300ba470 con 0x7f2e30162060 2024-09-12T02:05:46.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.546+0000 7f2e2cff9640 1 -- 172.21.15.19:0/613967938 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 272 v272) ==== 95+0+4392 (secure 0 0 0) 0x7f2e2807ecc0 con 0x7f2e30162060 2024-09-12T02:05:46.546 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:46.546 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":272,"btime":"2024-09-12T02:05:43:189791+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":272,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:43.189786+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":127,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:46.547 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 272 2024-09-12T02:05:46.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.548+0000 7f2e3588d640 1 -- 172.21.15.19:0/613967938 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e1006be30 msgr2=0x7f2e1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:46.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.548+0000 7f2e3588d640 1 --2- 172.21.15.19:0/613967938 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e1006be30 0x7f2e1006e2f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2e20000f60 tx=0x7f2e20007d50 comp rx=0 tx=0).stop 2024-09-12T02:05:46.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.548+0000 7f2e3588d640 1 -- 172.21.15.19:0/613967938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e30162060 msgr2=0x7f2e300b7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:46.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.548+0000 7f2e3588d640 1 --2- 172.21.15.19:0/613967938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e30162060 0x7f2e300b7f60 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f2e2802ac70 tx=0x7f2e28004a40 comp rx=0 tx=0).stop 2024-09-12T02:05:46.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.548+0000 7f2e3588d640 1 -- 172.21.15.19:0/613967938 shutdown_connections 2024-09-12T02:05:46.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.548+0000 7f2e3588d640 1 --2- 172.21.15.19:0/613967938 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e1006be30 0x7f2e1006e2f0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.548+0000 7f2e3588d640 1 --2- 172.21.15.19:0/613967938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e30162060 0x7f2e300b7f60 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.548+0000 7f2e3588d640 1 --2- 172.21.15.19:0/613967938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e30161c80 0x7f2e30159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.548+0000 7f2e3588d640 1 --2- 172.21.15.19:0/613967938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2e300b64b0 0x7f2e300cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.548+0000 7f2e3588d640 1 -- 172.21.15.19:0/613967938 >> 172.21.15.19:0/613967938 conn(0x7f2e300d44f0 msgr2=0x7f2e300746d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:46.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.548+0000 7f2e3588d640 1 -- 172.21.15.19:0/613967938 shutdown_connections 2024-09-12T02:05:46.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.548+0000 7f2e3588d640 1 -- 172.21.15.19:0/613967938 wait complete. 2024-09-12T02:05:46.559 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap key 100.00000000:stray0_head' led to DAMAGED state 2024-09-12T02:05:46.560 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap key 1.00000000:subdir_head' 2024-09-12T02:05:46.560 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:05:46.560 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:05:46.576 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:05:46.576 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:05:46.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:46.577 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:05:46.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:05:46.632 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:05:46.632 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:05:46.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.776+0000 7f3019c0a640 1 Processor -- start 2024-09-12T02:05:46.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.776+0000 7f3019c0a640 1 -- start start 2024-09-12T02:05:46.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.777+0000 7f3019c0a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f30140d30f0 0x7f30140b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:46.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.777+0000 7f3019c0a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f30140b64c0 0x7f301406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:46.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.777+0000 7f3019c0a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30140d3690 con 0x7f301415e5f0 2024-09-12T02:05:46.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.777+0000 7f3019c0a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f301406d530 con 0x7f30140b64c0 2024-09-12T02:05:46.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.777+0000 7f3019c0a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f30140d3970 con 0x7f30140d30f0 2024-09-12T02:05:46.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.777+0000 7f3013fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f30140b64c0 0x7f301406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:46.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.777+0000 7f3013fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f30140b64c0 0x7f301406d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47572/0 (socket says 172.21.15.19:47572) 2024-09-12T02:05:46.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.777+0000 7f3013fff640 1 -- 172.21.15.19:0/2421955192 learned_addr learned my addr 172.21.15.19:0/2421955192 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:46.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.777+0000 7f3012ffd640 1 --2- 172.21.15.19:0/2421955192 >> v2:172.21.15.135:3300/0 conn(0x7f30140d30f0 0x7f30140b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:46.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.777+0000 7f3013fff640 1 -- 172.21.15.19:0/2421955192 >> v2:172.21.15.135:3300/0 conn(0x7f30140d30f0 msgr2=0x7f30140b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:46.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.777+0000 7f3013fff640 1 --2- 172.21.15.19:0/2421955192 >> v2:172.21.15.135:3300/0 conn(0x7f30140d30f0 0x7f30140b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.777+0000 7f3013fff640 1 -- 172.21.15.19:0/2421955192 >> v1:172.21.15.135:6789/0 conn(0x7f301415e5f0 legacy=0x7f30140d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.777+0000 7f3013fff640 1 -- 172.21.15.19:0/2421955192 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301406cee0 con 0x7f30140b64c0 2024-09-12T02:05:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.778+0000 7f3013fff640 1 --2- 172.21.15.19:0/2421955192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30140b64c0 0x7f301406d9c0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f301408e520 tx=0x7f300c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66529eeadb35a07c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.778+0000 7f30127fc640 1 -- 172.21.15.19:0/2421955192 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c036070 con 0x7f30140b64c0 2024-09-12T02:05:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.778+0000 7f30127fc640 1 -- 172.21.15.19:0/2421955192 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f300c031600 con 0x7f30140b64c0 2024-09-12T02:05:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.778+0000 7f30127fc640 1 -- 172.21.15.19:0/2421955192 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c0319d0 con 0x7f30140b64c0 2024-09-12T02:05:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.779+0000 7f3019c0a640 1 -- 172.21.15.19:0/2421955192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30140b64c0 msgr2=0x7f301406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.779+0000 7f3019c0a640 1 --2- 172.21.15.19:0/2421955192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30140b64c0 0x7f301406d9c0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f301408e520 tx=0x7f300c02a6f0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.779+0000 7f3019c0a640 1 -- 172.21.15.19:0/2421955192 shutdown_connections 2024-09-12T02:05:46.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.779+0000 7f3019c0a640 1 --2- 172.21.15.19:0/2421955192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30140b64c0 0x7f301406d9c0 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.779+0000 7f3019c0a640 1 --2- 172.21.15.19:0/2421955192 >> v2:172.21.15.135:3300/0 conn(0x7f30140d30f0 0x7f30140b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.779+0000 7f3019c0a640 1 -- 172.21.15.19:0/2421955192 >> 172.21.15.19:0/2421955192 conn(0x7f301408bfc0 msgr2=0x7f30140d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:46.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.779+0000 7f3019c0a640 1 -- 172.21.15.19:0/2421955192 shutdown_connections 2024-09-12T02:05:46.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.779+0000 7f3019c0a640 1 -- 172.21.15.19:0/2421955192 wait complete. 2024-09-12T02:05:46.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.780+0000 7f3019c0a640 1 Processor -- start 2024-09-12T02:05:46.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.780+0000 7f3019c0a640 1 -- start start 2024-09-12T02:05:46.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.781+0000 7f3019c0a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30140b64c0 0x7f30141615a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:46.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.781+0000 7f3019c0a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30140d30f0 0x7f30140b9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:46.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.781+0000 7f3019c0a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f301415e5f0 0x7f3014153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:46.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.781+0000 7f3019c0a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f301406df00 con 0x7f30140b64c0 2024-09-12T02:05:46.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.781+0000 7f3019c0a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f301415e9d0 con 0x7f301415e5f0 2024-09-12T02:05:46.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.781+0000 7f3019c0a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f301406e080 con 0x7f30140d30f0 2024-09-12T02:05:46.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.781+0000 7f30137fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30140b64c0 0x7f30141615a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:46.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.781+0000 7f30137fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30140b64c0 0x7f30141615a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47588/0 (socket says 172.21.15.19:47588) 2024-09-12T02:05:46.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.781+0000 7f30137fe640 1 -- 172.21.15.19:0/3563666724 learned_addr learned my addr 172.21.15.19:0/3563666724 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:46.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.781+0000 7f3012ffd640 1 --2- 172.21.15.19:0/3563666724 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30140d30f0 0x7f30140b9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:46.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.781+0000 7f3013fff640 1 --2- 172.21.15.19:0/3563666724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f301415e5f0 0x7f3014153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:46.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.781+0000 7f30137fe640 1 -- 172.21.15.19:0/3563666724 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30140d30f0 msgr2=0x7f30140b9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:46.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.781+0000 7f30137fe640 1 --2- 172.21.15.19:0/3563666724 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30140d30f0 0x7f30140b9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.781+0000 7f30137fe640 1 -- 172.21.15.19:0/3563666724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f301415e5f0 msgr2=0x7f3014153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:46.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.781+0000 7f30137fe640 1 --2- 172.21.15.19:0/3563666724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f301415e5f0 0x7f3014153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.781+0000 7f30137fe640 1 -- 172.21.15.19:0/3563666724 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301415d2f0 con 0x7f30140b64c0 2024-09-12T02:05:46.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.781+0000 7f3013fff640 1 --2- 172.21.15.19:0/3563666724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f301415e5f0 0x7f3014153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:46.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.781+0000 7f30137fe640 1 --2- 172.21.15.19:0/3563666724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30140b64c0 0x7f30141615a0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f300400b3e0 tx=0x7f300400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:46.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.782+0000 7f2ffbfff640 1 -- 172.21.15.19:0/3563666724 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3004015020 con 0x7f30140b64c0 2024-09-12T02:05:46.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.782+0000 7f2ffbfff640 1 -- 172.21.15.19:0/3563666724 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3004011850 con 0x7f30140b64c0 2024-09-12T02:05:46.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.782+0000 7f3019c0a640 1 -- 172.21.15.19:0/3563666724 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f301415fbc0 con 0x7f30140b64c0 2024-09-12T02:05:46.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.782+0000 7f2ffbfff640 1 -- 172.21.15.19:0/3563666724 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3004011c40 con 0x7f30140b64c0 2024-09-12T02:05:46.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.782+0000 7f3019c0a640 1 -- 172.21.15.19:0/3563666724 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3014160180 con 0x7f30140b64c0 2024-09-12T02:05:46.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.783+0000 7f3019c0a640 1 -- 172.21.15.19:0/3563666724 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3014160520 con 0x7f30140b64c0 2024-09-12T02:05:46.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.783+0000 7f2ffbfff640 1 -- 172.21.15.19:0/3563666724 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3004018020 con 0x7f30140b64c0 2024-09-12T02:05:46.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.784+0000 7f2ffbfff640 1 --2- 172.21.15.19:0/3563666724 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f300006be30 0x7f300006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:46.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.784+0000 7f2ffbfff640 1 -- 172.21.15.19:0/3563666724 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7f300408ba40 con 0x7f30140b64c0 2024-09-12T02:05:46.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.784+0000 7f3012ffd640 1 --2- 172.21.15.19:0/3563666724 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f300006be30 0x7f300006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:46.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.785+0000 7f3012ffd640 1 --2- 172.21.15.19:0/3563666724 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f300006be30 0x7f300006e2f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f30140ca2e0 tx=0x7f3008008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:46.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:46.788+0000 7f2ffbfff640 1 -- 172.21.15.19:0/3563666724 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f300401f020 con 0x7f30140b64c0 2024-09-12T02:05:47.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.000+0000 7f3019c0a640 1 -- 172.21.15.19:0/3563666724 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f30140b22a0 con 0x7f30140b64c0 2024-09-12T02:05:47.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.198+0000 7f2ffbfff640 1 -- 172.21.15.19:0/3563666724 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v273) ==== 161+0+0 (secure 0 0 0) 0x7f300408be20 con 0x7f30140b64c0 2024-09-12T02:05:47.198 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:05:47.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.200+0000 7f3019c0a640 1 -- 172.21.15.19:0/3563666724 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f300006be30 msgr2=0x7f300006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:47.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.200+0000 7f3019c0a640 1 --2- 172.21.15.19:0/3563666724 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f300006be30 0x7f300006e2f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f30140ca2e0 tx=0x7f3008008040 comp rx=0 tx=0).stop 2024-09-12T02:05:47.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.200+0000 7f3019c0a640 1 -- 172.21.15.19:0/3563666724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30140b64c0 msgr2=0x7f30141615a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:47.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.200+0000 7f3019c0a640 1 --2- 172.21.15.19:0/3563666724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30140b64c0 0x7f30141615a0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f300400b3e0 tx=0x7f300400b8a0 comp rx=0 tx=0).stop 2024-09-12T02:05:47.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.200+0000 7f3019c0a640 1 -- 172.21.15.19:0/3563666724 shutdown_connections 2024-09-12T02:05:47.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.200+0000 7f3019c0a640 1 --2- 172.21.15.19:0/3563666724 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f300006be30 0x7f300006e2f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:47.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.200+0000 7f3019c0a640 1 --2- 172.21.15.19:0/3563666724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f301415e5f0 0x7f3014153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:47.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.200+0000 7f3019c0a640 1 --2- 172.21.15.19:0/3563666724 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30140d30f0 0x7f30140b9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:47.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.200+0000 7f3019c0a640 1 --2- 172.21.15.19:0/3563666724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30140b64c0 0x7f30141615a0 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:47.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.200+0000 7f3019c0a640 1 -- 172.21.15.19:0/3563666724 >> 172.21.15.19:0/3563666724 conn(0x7f301408bfc0 msgr2=0x7f30140b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:47.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.200+0000 7f3019c0a640 1 -- 172.21.15.19:0/3563666724 shutdown_connections 2024-09-12T02:05:47.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.200+0000 7f3019c0a640 1 -- 172.21.15.19:0/3563666724 wait complete. 2024-09-12T02:05:47.212 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:05:47.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.316+0000 7f08d5398640 1 Processor -- start 2024-09-12T02:05:47.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.316+0000 7f08d5398640 1 -- start start 2024-09-12T02:05:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08d5398640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f08d00d30f0 0x7f08d00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08d5398640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08d00d3690 con 0x7f08d00b64c0 2024-09-12T02:05:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08d5398640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08d00d3970 con 0x7f08d015e5f0 2024-09-12T02:05:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08d5398640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f08d006d530 con 0x7f08d00d30f0 2024-09-12T02:05:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08cf7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f08d00b64c0 0x7f08d006d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34604/0 (socket says 172.21.15.19:34604) 2024-09-12T02:05:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08cf7fe640 1 -- 172.21.15.19:0/1064405186 learned_addr learned my addr 172.21.15.19:0/1064405186 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08ce7fc640 1 --2- 172.21.15.19:0/1064405186 >> v2:172.21.15.135:3300/0 conn(0x7f08d00d30f0 0x7f08d00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08cdffb640 1 -- 172.21.15.19:0/1064405186 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2024678445 0 0) 0x7f08d00d3690 con 0x7f08d00b64c0 2024-09-12T02:05:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08cdffb640 1 -- 172.21.15.19:0/1064405186 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08b8003520 con 0x7f08d00b64c0 2024-09-12T02:05:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08cdffb640 1 -- 172.21.15.19:0/1064405186 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2817549710 0 0) 0x7f08d00d3970 con 0x7f08d015e5f0 2024-09-12T02:05:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08cdffb640 1 -- 172.21.15.19:0/1064405186 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08d00d3690 con 0x7f08d015e5f0 2024-09-12T02:05:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08cdffb640 1 -- 172.21.15.19:0/1064405186 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 24855149 0 0) 0x7f08b8003520 con 0x7f08d00b64c0 2024-09-12T02:05:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08cdffb640 1 -- 172.21.15.19:0/1064405186 >> v2:172.21.15.135:3300/0 conn(0x7f08d00d30f0 msgr2=0x7f08d00b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08cdffb640 1 --2- 172.21.15.19:0/1064405186 >> v2:172.21.15.135:3300/0 conn(0x7f08d00d30f0 0x7f08d00b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08cdffb640 1 -- 172.21.15.19:0/1064405186 >> v1:172.21.15.135:6789/0 conn(0x7f08d015e5f0 legacy=0x7f08d00d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08cdffb640 1 -- 172.21.15.19:0/1064405186 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d006cee0 con 0x7f08d00b64c0 2024-09-12T02:05:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08cdffb640 1 -- 172.21.15.19:0/1064405186 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f08c80019f0 con 0x7f08d00b64c0 2024-09-12T02:05:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08ce7fc640 1 --2- 172.21.15.19:0/1064405186 >> v2:172.21.15.135:3300/0 conn(0x7f08d00d30f0 0x7f08d00b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:05:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.317+0000 7f08cdffb640 1 -- 172.21.15.19:0/1064405186 >> v1:172.21.15.19:6789/0 conn(0x7f08d00b64c0 legacy=0x7f08d006d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.318+0000 7f08cdffb640 1 --2- 172.21.15.19:0/1064405186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b8003b90 0x7f08b8003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.318+0000 7f08cdffb640 1 --2- 172.21.15.19:0/1064405186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08b8004800 0x7f08b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.318+0000 7f08cdffb640 1 --2- 172.21.15.19:0/1064405186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08b80051c0 0x7f08b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.318+0000 7f08cdffb640 1 -- 172.21.15.19:0/1064405186 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f08d006d530 con 0x7f08b8003b90 2024-09-12T02:05:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.318+0000 7f08cdffb640 1 -- 172.21.15.19:0/1064405186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f08b800c090 con 0x7f08b8004800 2024-09-12T02:05:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.318+0000 7f08cdffb640 1 -- 172.21.15.19:0/1064405186 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f08b800c290 con 0x7f08b80051c0 2024-09-12T02:05:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.318+0000 7f08ceffd640 1 --2- 172.21.15.19:0/1064405186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b8003b90 0x7f08b8003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.318+0000 7f08ce7fc640 1 --2- 172.21.15.19:0/1064405186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08b8004800 0x7f08b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.318+0000 7f08cf7fe640 1 --2- 172.21.15.19:0/1064405186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08b80051c0 0x7f08b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.318+0000 7f08ceffd640 1 -- 172.21.15.19:0/1064405186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08b80051c0 msgr2=0x7f08b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.318+0000 7f08ceffd640 1 --2- 172.21.15.19:0/1064405186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08b80051c0 0x7f08b800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.318+0000 7f08ceffd640 1 -- 172.21.15.19:0/1064405186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08b8004800 msgr2=0x7f08b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.318+0000 7f08ceffd640 1 --2- 172.21.15.19:0/1064405186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08b8004800 0x7f08b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.318+0000 7f08ceffd640 1 -- 172.21.15.19:0/1064405186 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b8003520 con 0x7f08b8003b90 2024-09-12T02:05:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.318+0000 7f08cf7fe640 1 -- 172.21.15.19:0/1064405186 reap_dead start 2024-09-12T02:05:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.319+0000 7f08ceffd640 1 --2- 172.21.15.19:0/1064405186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b8003b90 0x7f08b8003f90 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f08c00018d0 tx=0x7f08b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9df8aea3eb74533 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.319+0000 7f08cdffb640 1 -- 172.21.15.19:0/1064405186 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c00014f0 con 0x7f08b8003b90 2024-09-12T02:05:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.319+0000 7f08cdffb640 1 -- 172.21.15.19:0/1064405186 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c00052d0 con 0x7f08b8003b90 2024-09-12T02:05:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.319+0000 7f08cdffb640 1 -- 172.21.15.19:0/1064405186 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c002aca0 con 0x7f08b8003b90 2024-09-12T02:05:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.319+0000 7f08d5398640 1 -- 172.21.15.19:0/1064405186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b8003b90 msgr2=0x7f08b8003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.319+0000 7f08d5398640 1 --2- 172.21.15.19:0/1064405186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b8003b90 0x7f08b8003f90 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f08c00018d0 tx=0x7f08b8005830 comp rx=0 tx=0).stop 2024-09-12T02:05:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.319+0000 7f08d5398640 1 -- 172.21.15.19:0/1064405186 shutdown_connections 2024-09-12T02:05:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.319+0000 7f08d5398640 1 --2- 172.21.15.19:0/1064405186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b8003b90 0x7f08b8003f90 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.319+0000 7f08d5398640 1 -- 172.21.15.19:0/1064405186 >> 172.21.15.19:0/1064405186 conn(0x7f08d008bfc0 msgr2=0x7f08d00d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.319+0000 7f08d5398640 1 -- 172.21.15.19:0/1064405186 shutdown_connections 2024-09-12T02:05:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.320+0000 7f08d5398640 1 -- 172.21.15.19:0/1064405186 wait complete. 2024-09-12T02:05:47.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.321+0000 7f08d5398640 1 Processor -- start 2024-09-12T02:05:47.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.321+0000 7f08d5398640 1 -- start start 2024-09-12T02:05:47.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08d5398640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08b8003b90 0x7f08d0152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:47.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08d5398640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08d015bc40 0x7f08d00b8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:47.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08d5398640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08d00b8ad0 0x7f08d00c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:47.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08d5398640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f08d00b5f80 con 0x7f08d00b8ad0 2024-09-12T02:05:47.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08d5398640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f08d015e9d0 con 0x7f08b8003b90 2024-09-12T02:05:47.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08d5398640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f08d00b6100 con 0x7f08d015bc40 2024-09-12T02:05:47.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08cf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08d00b8ad0 0x7f08d00c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:47.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08cf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08d00b8ad0 0x7f08d00c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47610/0 (socket says 172.21.15.19:47610) 2024-09-12T02:05:47.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08cf7fe640 1 -- 172.21.15.19:0/2677436034 learned_addr learned my addr 172.21.15.19:0/2677436034 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:47.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08ceffd640 1 --2- 172.21.15.19:0/2677436034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08b8003b90 0x7f08d0152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:47.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08ce7fc640 1 --2- 172.21.15.19:0/2677436034 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08d015bc40 0x7f08d00b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:47.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08cf7fe640 1 -- 172.21.15.19:0/2677436034 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08d015bc40 msgr2=0x7f08d00b8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:47.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08cf7fe640 1 --2- 172.21.15.19:0/2677436034 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08d015bc40 0x7f08d00b8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:47.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08cf7fe640 1 -- 172.21.15.19:0/2677436034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08b8003b90 msgr2=0x7f08d0152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:47.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08cf7fe640 1 --2- 172.21.15.19:0/2677436034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08b8003b90 0x7f08d0152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:47.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08cf7fe640 1 -- 172.21.15.19:0/2677436034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d00b74f0 con 0x7f08d00b8ad0 2024-09-12T02:05:47.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08ce7fc640 1 --2- 172.21.15.19:0/2677436034 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08d015bc40 0x7f08d00b8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:47.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08cf7fe640 1 --2- 172.21.15.19:0/2677436034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08d00b8ad0 0x7f08d00c9ae0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f08d00d30c0 tx=0x7f08c8007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:47.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08b77fe640 1 -- 172.21.15.19:0/2677436034 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c800e960 con 0x7f08d00b8ad0 2024-09-12T02:05:47.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08b77fe640 1 -- 172.21.15.19:0/2677436034 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c8018070 con 0x7f08d00b8ad0 2024-09-12T02:05:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08d5398640 1 -- 172.21.15.19:0/2677436034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08d00b77d0 con 0x7f08d00b8ad0 2024-09-12T02:05:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08b77fe640 1 -- 172.21.15.19:0/2677436034 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c800ed40 con 0x7f08d00b8ad0 2024-09-12T02:05:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.322+0000 7f08d5398640 1 -- 172.21.15.19:0/2677436034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08d00b7d90 con 0x7f08d00b8ad0 2024-09-12T02:05:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.324+0000 7f08d5398640 1 -- 172.21.15.19:0/2677436034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08d00d4dd0 con 0x7f08d00b8ad0 2024-09-12T02:05:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.324+0000 7f08b77fe640 1 -- 172.21.15.19:0/2677436034 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08c801d460 con 0x7f08d00b8ad0 2024-09-12T02:05:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.324+0000 7f08b77fe640 1 --2- 172.21.15.19:0/2677436034 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f08bc06be30 0x7f08bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.325+0000 7f08b77fe640 1 -- 172.21.15.19:0/2677436034 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7f08c808bdd0 con 0x7f08d00b8ad0 2024-09-12T02:05:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.325+0000 7f08ceffd640 1 --2- 172.21.15.19:0/2677436034 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f08bc06be30 0x7f08bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.325+0000 7f08ceffd640 1 --2- 172.21.15.19:0/2677436034 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f08bc06be30 0x7f08bc06e2f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f08c0032000 tx=0x7f08c0009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.329+0000 7f08b77fe640 1 -- 172.21.15.19:0/2677436034 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f08c8059a20 con 0x7f08d00b8ad0 2024-09-12T02:05:47.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:47.574+0000 7f08d5398640 1 -- 172.21.15.19:0/2677436034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f08d00b3320 con 0x7f08d00b8ad0 2024-09-12T02:05:47.940 INFO:tasks.ceph.mds.c.smithi019.stderr: -48> 2024-09-12T02:05:43.187+0000 7f0a867b8640 -1 mds.0.damage notify_dentry Damage to dentries in fragment * of ino 0x100is fatal because it is a system directory for this rank 2024-09-12T02:05:47.940 INFO:tasks.ceph.mds.c.smithi019.stderr: -30> 2024-09-12T02:05:44.171+0000 7f0a8a7c0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:05:47.965 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:05:48.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.203+0000 7f08b77fe640 1 -- 172.21.15.19:0/2677436034 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v274) ==== 101+0+0 (secure 0 0 0) 0x7f08c808d070 con 0x7f08d00b8ad0 2024-09-12T02:05:48.203 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:05:48.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.205+0000 7f08d5398640 1 -- 172.21.15.19:0/2677436034 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f08bc06be30 msgr2=0x7f08bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.205+0000 7f08d5398640 1 --2- 172.21.15.19:0/2677436034 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f08bc06be30 0x7f08bc06e2f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f08c0032000 tx=0x7f08c0009030 comp rx=0 tx=0).stop 2024-09-12T02:05:48.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.205+0000 7f08d5398640 1 -- 172.21.15.19:0/2677436034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08d00b8ad0 msgr2=0x7f08d00c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.205+0000 7f08d5398640 1 --2- 172.21.15.19:0/2677436034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08d00b8ad0 0x7f08d00c9ae0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f08d00d30c0 tx=0x7f08c8007af0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.205+0000 7f08d5398640 1 -- 172.21.15.19:0/2677436034 shutdown_connections 2024-09-12T02:05:48.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.205+0000 7f08d5398640 1 --2- 172.21.15.19:0/2677436034 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f08bc06be30 0x7f08bc06e2f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.205+0000 7f08d5398640 1 --2- 172.21.15.19:0/2677436034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08d00b8ad0 0x7f08d00c9ae0 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.205+0000 7f08d5398640 1 --2- 172.21.15.19:0/2677436034 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08d015bc40 0x7f08d00b8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.205+0000 7f08d5398640 1 --2- 172.21.15.19:0/2677436034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08b8003b90 0x7f08d0152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.205+0000 7f08d5398640 1 -- 172.21.15.19:0/2677436034 >> 172.21.15.19:0/2677436034 conn(0x7f08d008bfc0 msgr2=0x7f08d00b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:48.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.205+0000 7f08d5398640 1 -- 172.21.15.19:0/2677436034 shutdown_connections 2024-09-12T02:05:48.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.205+0000 7f08d5398640 1 -- 172.21.15.19:0/2677436034 wait complete. 2024-09-12T02:05:48.219 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:05:48.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.265+0000 7f99c8c93f40 1 Processor -- start 2024-09-12T02:05:48.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.265+0000 7f99c8c93f40 1 -- start start 2024-09-12T02:05:48.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.266+0000 7f99c8c93f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e473e9ff0 0x556e473e88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.266+0000 7f99c8c93f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e474a7660 0x556e474bb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.266+0000 7f99c8c93f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556e474a7a40 0x556e474bbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.266+0000 7f99c8c93f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556e473d79b0 con 0x556e473e9ff0 2024-09-12T02:05:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.266+0000 7f99c8c93f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556e4733b510 con 0x556e474a7660 2024-09-12T02:05:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.266+0000 7f99c8c93f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556e474bf2f0 con 0x556e474a7a40 2024-09-12T02:05:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.266+0000 7f99c6789640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e473e9ff0 0x556e473e88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.266+0000 7f99c6789640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e473e9ff0 0x556e473e88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47628/0 (socket says 172.21.15.19:47628) 2024-09-12T02:05:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.266+0000 7f99c6789640 1 -- 172.21.15.19:0/3774923589 learned_addr learned my addr 172.21.15.19:0/3774923589 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.266+0000 7f99c6f8a640 1 --2- 172.21.15.19:0/3774923589 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556e474a7a40 0x556e474bbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.266+0000 7f99c5f88640 1 --2- 172.21.15.19:0/3774923589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e474a7660 0x556e474bb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.266+0000 7f99c6789640 1 -- 172.21.15.19:0/3774923589 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556e474a7a40 msgr2=0x556e474bbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.266+0000 7f99c6789640 1 --2- 172.21.15.19:0/3774923589 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556e474a7a40 0x556e474bbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.266+0000 7f99c6789640 1 -- 172.21.15.19:0/3774923589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e474a7660 msgr2=0x556e474bb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.266+0000 7f99c6789640 1 --2- 172.21.15.19:0/3774923589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e474a7660 0x556e474bb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.266+0000 7f99c6789640 1 -- 172.21.15.19:0/3774923589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e474bccc0 con 0x556e473e9ff0 2024-09-12T02:05:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.267+0000 7f99c6789640 1 --2- 172.21.15.19:0/3774923589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e473e9ff0 0x556e473e88b0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f99b80098e0 tx=0x7f99b8005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c691fc7c1bc91f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.267+0000 7f99c4f86640 1 -- 172.21.15.19:0/3774923589 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8008950 con 0x556e473e9ff0 2024-09-12T02:05:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.267+0000 7f99c4f86640 1 -- 172.21.15.19:0/3774923589 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b8018070 con 0x556e473e9ff0 2024-09-12T02:05:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.267+0000 7f99c4f86640 1 -- 172.21.15.19:0/3774923589 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8008d30 con 0x556e473e9ff0 2024-09-12T02:05:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.267+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3774923589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e473e9ff0 msgr2=0x556e473e88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.267+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3774923589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e473e9ff0 0x556e473e88b0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f99b80098e0 tx=0x7f99b8005a00 comp rx=0 tx=0).stop 2024-09-12T02:05:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.267+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3774923589 shutdown_connections 2024-09-12T02:05:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.267+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3774923589 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556e474a7a40 0x556e474bbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.267+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3774923589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e474a7660 0x556e474bb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.267+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3774923589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e473e9ff0 0x556e473e88b0 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.267+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3774923589 >> 172.21.15.19:0/3774923589 conn(0x556e473eaad0 msgr2=0x556e474b89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.267+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3774923589 shutdown_connections 2024-09-12T02:05:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.267+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3774923589 wait complete. 2024-09-12T02:05:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.268+0000 7f99c8c93f40 1 Processor -- start 2024-09-12T02:05:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.268+0000 7f99c8c93f40 1 -- start start 2024-09-12T02:05:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.269+0000 7f99c8c93f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e473e9ff0 0x556e47493750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.269+0000 7f99c8c93f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556e474a7660 0x556e474a3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.269+0000 7f99c8c93f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e474a7a40 0x556e474bbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.269+0000 7f99c8c93f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556e474bd1c0 con 0x556e473e9ff0 2024-09-12T02:05:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.269+0000 7f99c8c93f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556e474bd740 con 0x556e474a7a40 2024-09-12T02:05:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.269+0000 7f99c8c93f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x556e474bd460 con 0x556e474a7660 2024-09-12T02:05:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.269+0000 7f99c6789640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e473e9ff0 0x556e47493750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.269+0000 7f99c6789640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e473e9ff0 0x556e47493750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47632/0 (socket says 172.21.15.19:47632) 2024-09-12T02:05:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.269+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 learned_addr learned my addr 172.21.15.19:0/3041518991 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.269+0000 7f99c5f88640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556e474a7660 0x556e474a3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.269+0000 7f99c6f8a640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e474a7a40 0x556e474bbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.269+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556e474a7660 msgr2=0x556e474a3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.269+0000 7f99c6789640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556e474a7660 0x556e474a3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.269+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e474a7a40 msgr2=0x556e474bbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.269+0000 7f99c6789640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e474a7a40 0x556e474bbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.269+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e474a4650 con 0x556e473e9ff0 2024-09-12T02:05:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.269+0000 7f99c5f88640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556e474a7660 0x556e474a3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.269+0000 7f99c6789640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e473e9ff0 0x556e47493750 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x556e474bdee0 tx=0x7f99b8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.270+0000 7f99b77fe640 1 -- 172.21.15.19:0/3041518991 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8026630 con 0x556e473e9ff0 2024-09-12T02:05:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.270+0000 7f99b77fe640 1 -- 172.21.15.19:0/3041518991 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b80267f0 con 0x556e473e9ff0 2024-09-12T02:05:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.270+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e474a4930 con 0x556e473e9ff0 2024-09-12T02:05:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.270+0000 7f99b77fe640 1 -- 172.21.15.19:0/3041518991 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8026be0 con 0x556e473e9ff0 2024-09-12T02:05:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.270+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e474a4ef0 con 0x556e473e9ff0 2024-09-12T02:05:48.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.271+0000 7f99b77fe640 1 -- 172.21.15.19:0/3041518991 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f99b8013420 con 0x556e473e9ff0 2024-09-12T02:05:48.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.271+0000 7f99b77fe640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f99a806a840 0x7f99a806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.272+0000 7f99b77fe640 1 -- 172.21.15.19:0/3041518991 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7f99b808c8f0 con 0x556e473e9ff0 2024-09-12T02:05:48.276 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:05:48.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.272+0000 7f99c5f88640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f99a806a840 0x7f99a806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.272+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x556e474a1f20 0x556e474a2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.272+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e474a2840 con 0x556e474a1f20 2024-09-12T02:05:48.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.272+0000 7f99c6f8a640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x556e474a1f20 0x556e474a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.272+0000 7f99c5f88640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f99a806a840 0x7f99a806cd00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x556e47419b60 tx=0x7f99bc000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.272+0000 7f99c6f8a640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x556e474a1f20 0x556e474a2300 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.274+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v127'1002 uv976 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.274+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e4755f6a0 con 0x556e474a1f20 2024-09-12T02:05:48.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.275+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v127'1003 uv1003 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.275+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e4755fa40 con 0x556e474a1f20 2024-09-12T02:05:48.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.277+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v127'1004 uv1004 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.278 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:05:48.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.277+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560df0 con 0x556e474a1f20 2024-09-12T02:05:48.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.278+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v127'1005 uv1005 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.278+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47561190 con 0x556e474a1f20 2024-09-12T02:05:48.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.279+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v127'1006 uv1006 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.279+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e4755fde0 con 0x556e474a1f20 2024-09-12T02:05:48.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.280+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v127'1007 uv1007 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.280+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.281+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v127'1008 uv982 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.281+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.283+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v127'1009 uv1009 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.283+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.284 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:05:48.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.284+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v127'1010 uv1010 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.284+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.285+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v127'1011 uv1011 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.285+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.286+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v127'1012 uv1012 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.286+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.287+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v127'1013 uv1013 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.287+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.288+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v127'1014 uv989 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.288+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.289+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v127'1015 uv1015 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.289+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.290+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v127'1016 uv1016 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.291 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:05:48.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.290+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.291+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v127'1017 uv1017 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.291+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.293+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v127'1018 uv1018 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.293+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.294+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v127'1019 uv1019 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.294+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.295+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v127'1020 uv1020 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.295+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.296+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v127'1021 uv995 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.296+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.297+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v127'1022 uv1022 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.297+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.298+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v127'1023 uv1023 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.299 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:05:48.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.298+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.299+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v127'1024 uv1024 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.299+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.300+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v127'1025 uv1025 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.300+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.301+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v127'1026 uv1026 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.302+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.303+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v127'1027 uv1001 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.303+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.304+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v127'1028 uv1028 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.304+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.305 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:05:48.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.305+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v127'1029 uv1029 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.305+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.306+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v127'1030 uv1030 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.306+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.307+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v127'1031 uv1031 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.307+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e474a1f20 2024-09-12T02:05:48.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.308+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v127'1032 uv1032 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e474a1f20 2024-09-12T02:05:48.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.308+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556e47561530 0x556e47563920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.308+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47560180 con 0x556e47561530 2024-09-12T02:05:48.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.308+0000 7f99c6789640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556e47561530 0x556e47563920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.308+0000 7f99c6789640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556e47561530 0x556e47563920 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.310+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v127'728 uv710 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.311+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47563e60 con 0x556e47561530 2024-09-12T02:05:48.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.312+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v127'729 uv729 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.312+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47564200 con 0x556e47561530 2024-09-12T02:05:48.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.313+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v127'730 uv730 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.314 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:05:48.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.314+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e475645a0 con 0x556e47561530 2024-09-12T02:05:48.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.315+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v127'731 uv731 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.315+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47564940 con 0x556e47561530 2024-09-12T02:05:48.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.316+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v127'732 uv732 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.317+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47564ce0 con 0x556e47561530 2024-09-12T02:05:48.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.318+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v127'733 uv715 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.318+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47565080 con 0x556e47561530 2024-09-12T02:05:48.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.319+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v127'734 uv734 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.319+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47565420 con 0x556e47561530 2024-09-12T02:05:48.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.321+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v127'735 uv735 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.321 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:05:48.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.321+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47565420 con 0x556e47561530 2024-09-12T02:05:48.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.322+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v127'736 uv736 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.322+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47565420 con 0x556e47561530 2024-09-12T02:05:48.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.324+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v127'737 uv737 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.324+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47565420 con 0x556e47561530 2024-09-12T02:05:48.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.325+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v127'738 uv720 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.325+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47565420 con 0x556e47561530 2024-09-12T02:05:48.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.326+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v127'739 uv739 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.326+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47565420 con 0x556e47561530 2024-09-12T02:05:48.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.327+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v127'740 uv740 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.328 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:05:48.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.327+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e475698a0 con 0x556e47561530 2024-09-12T02:05:48.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.329+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v127'741 uv741 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.329+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e475698a0 con 0x556e47561530 2024-09-12T02:05:48.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.330+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v127'742 uv742 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.330+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47565420 con 0x556e47561530 2024-09-12T02:05:48.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.331+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v127'743 uv726 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.331+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47565420 con 0x556e47561530 2024-09-12T02:05:48.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.333+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v127'744 uv744 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.333+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47565420 con 0x556e47561530 2024-09-12T02:05:48.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.334+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v127'745 uv745 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.334 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:05:48.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.334+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47566430 con 0x556e47561530 2024-09-12T02:05:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.335+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v127'746 uv746 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.335+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47566430 con 0x556e47561530 2024-09-12T02:05:48.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.336+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v127'747 uv747 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.336+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47565420 con 0x556e47561530 2024-09-12T02:05:48.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.337+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v127'748 uv748 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e47561530 2024-09-12T02:05:48.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.337+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x556e47565aa0 0x556e47567e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.337+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47568460 con 0x556e47565aa0 2024-09-12T02:05:48.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.338+0000 7f99c5f88640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x556e47565aa0 0x556e47567e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.338+0000 7f99c5f88640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x556e47565aa0 0x556e47567e90 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.339+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v127'195 uv194 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.339+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47568920 con 0x556e47565aa0 2024-09-12T02:05:48.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.340+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v127'196 uv196 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.340+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47568e00 con 0x556e47565aa0 2024-09-12T02:05:48.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.341+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v127'197 uv197 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.342 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:05:48.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.341+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e4756a6b0 con 0x556e47565aa0 2024-09-12T02:05:48.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.343+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v127'198 uv198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.343+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e4756aa50 con 0x556e47565aa0 2024-09-12T02:05:48.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.344+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v127'199 uv199 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.344+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e475696a0 con 0x556e47565aa0 2024-09-12T02:05:48.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.345+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v127'200 uv200 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.345+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x556e47569fa0 0x556e4756ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.345+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e475696a0 con 0x556e47569fa0 2024-09-12T02:05:48.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.345+0000 7f99c6f8a640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x556e47569fa0 0x556e4756ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.345+0000 7f99c6f8a640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x556e47569fa0 0x556e4756ce00 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.347+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v127'145 uv144 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.347+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e475696a0 con 0x556e47569fa0 2024-09-12T02:05:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.348+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v127'146 uv146 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.348+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e4756d340 con 0x556e47569fa0 2024-09-12T02:05:48.349 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:05:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.349+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v127'147 uv147 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.349+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e4756d340 con 0x556e47569fa0 2024-09-12T02:05:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.350+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v127'148 uv148 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.350+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x556e4756d9c0 0x556e4756fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.350+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e475702f0 con 0x556e4756d9c0 2024-09-12T02:05:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.351+0000 7f99c6789640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x556e4756d9c0 0x556e4756fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.351+0000 7f99c6789640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x556e4756d9c0 0x556e4756fdb0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.352+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v127'195 uv194 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.352+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47570370 con 0x556e4756d9c0 2024-09-12T02:05:48.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.354+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v127'196 uv196 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.354+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e4756d9c0 2024-09-12T02:05:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.355+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v127'197 uv197 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.355 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:05:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.355+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e475717a0 con 0x556e4756d9c0 2024-09-12T02:05:48.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.356+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v127'198 uv198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.356+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e475717a0 con 0x556e4756d9c0 2024-09-12T02:05:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.357+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v127'199 uv199 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.357+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e4756d9c0 2024-09-12T02:05:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.358+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v127'200 uv200 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.358+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e47569fa0 2024-09-12T02:05:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.360+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v127'360 uv354 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.360+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e47569fa0 2024-09-12T02:05:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.361+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v127'361 uv361 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.361+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e47569fa0 2024-09-12T02:05:48.362 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:05:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.362+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v127'362 uv362 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.362+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e475717a0 con 0x556e47569fa0 2024-09-12T02:05:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.363+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v127'363 uv363 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.363+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e475717a0 con 0x556e47569fa0 2024-09-12T02:05:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.364+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v127'364 uv364 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.364+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e47569fa0 2024-09-12T02:05:48.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.365+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v127'365 uv365 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.365+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e47569fa0 2024-09-12T02:05:48.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.366+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v127'366 uv359 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.366+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e47569fa0 2024-09-12T02:05:48.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.367+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v127'367 uv367 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.367+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e47569fa0 2024-09-12T02:05:48.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.368+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v127'368 uv368 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.368 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:05:48.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.368+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e47569fa0 2024-09-12T02:05:48.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.369+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v127'369 uv369 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.369+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e47569fa0 2024-09-12T02:05:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.370+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v127'370 uv370 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.370+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e47569fa0 2024-09-12T02:05:48.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.371+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v127'163 uv162 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.372+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e47569fa0 2024-09-12T02:05:48.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.373+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v127'164 uv164 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.373+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e47569fa0 2024-09-12T02:05:48.374 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:05:48.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.374+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v127'165 uv165 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.374+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e47569fa0 2024-09-12T02:05:48.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.375+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v127'166 uv166 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.375+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e47569fa0 2024-09-12T02:05:48.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.376+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v127'167 uv167 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f99c0057030 con 0x556e47569fa0 2024-09-12T02:05:48.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.376+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e4756d9c0 2024-09-12T02:05:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.377+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v127'195 uv194 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.377+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e4756d9c0 2024-09-12T02:05:48.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.378+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v127'196 uv196 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.378+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e4756d9c0 2024-09-12T02:05:48.379 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:05:48.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.379+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v127'197 uv197 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.379+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e475717a0 con 0x556e4756d9c0 2024-09-12T02:05:48.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.380+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v127'198 uv198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.380+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e475717a0 con 0x556e4756d9c0 2024-09-12T02:05:48.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.381+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v127'199 uv199 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.381+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e4756d9c0 2024-09-12T02:05:48.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.382+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v127'200 uv200 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.382+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e4756d9c0 2024-09-12T02:05:48.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.383+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v127'325 uv318 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.384+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e4756d9c0 2024-09-12T02:05:48.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.385+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v127'326 uv326 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.385+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47570790 con 0x556e4756d9c0 2024-09-12T02:05:48.386 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:05:48.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.386+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v127'327 uv327 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.386+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e475692b0 con 0x556e4756d9c0 2024-09-12T02:05:48.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.387+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v127'328 uv328 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.387+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e475692b0 con 0x556e4756d9c0 2024-09-12T02:05:48.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.388+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v127'329 uv329 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.388+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e475692b0 con 0x556e4756d9c0 2024-09-12T02:05:48.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.389+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v127'330 uv324 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.389+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e475692b0 con 0x556e4756d9c0 2024-09-12T02:05:48.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.390+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v127'331 uv331 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.390+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47569290 con 0x556e4756d9c0 2024-09-12T02:05:48.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.391+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v127'332 uv332 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.392 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:05:48.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.391+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47569290 con 0x556e4756d9c0 2024-09-12T02:05:48.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.392+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v127'333 uv333 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.392+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e475735a0 con 0x556e4756d9c0 2024-09-12T02:05:48.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.393+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v127'334 uv334 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.394+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x556e47571150 0x556e47573540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.394+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573c60 con 0x556e47571150 2024-09-12T02:05:48.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.394+0000 7f99c5f88640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x556e47571150 0x556e47573540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.394+0000 7f99c5f88640 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x556e47571150 0x556e47573540 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.395+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v127'142 uv140 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47571150 2024-09-12T02:05:48.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.395+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47573c60 con 0x556e47571150 2024-09-12T02:05:48.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.397+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v127'143 uv143 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47571150 2024-09-12T02:05:48.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.397+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573c60 con 0x556e47571150 2024-09-12T02:05:48.398 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:05:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.398+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v127'144 uv144 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47571150 2024-09-12T02:05:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.398+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e47571150 2024-09-12T02:05:48.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.398+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v127'145 uv145 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47571150 2024-09-12T02:05:48.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.399+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e4756d9c0 2024-09-12T02:05:48.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.400+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v127'195 uv194 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.400+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e4756d9c0 2024-09-12T02:05:48.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.401+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v127'196 uv196 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.401+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e4756d9c0 2024-09-12T02:05:48.402 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:05:48.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.402+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v127'197 uv197 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.402+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e4756d9c0 2024-09-12T02:05:48.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.403+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v127'198 uv198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.403+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e4756d9c0 2024-09-12T02:05:48.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.404+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v127'199 uv199 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.404+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e4756d9c0 2024-09-12T02:05:48.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.405+0000 7f99c6789640 1 -- 172.21.15.19:0/3041518991 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v127'200 uv200 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99b802c020 con 0x556e4756d9c0 2024-09-12T02:05:48.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.405+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e47565aa0 2024-09-12T02:05:48.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.406+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v127'166 uv165 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.406+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e47565aa0 2024-09-12T02:05:48.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.408+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v127'167 uv167 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.408+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e47565aa0 2024-09-12T02:05:48.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.409+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v127'168 uv168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.409 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:05:48.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.409+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e47565aa0 2024-09-12T02:05:48.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.410+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v127'169 uv169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.410+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e47565aa0 2024-09-12T02:05:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.411+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v127'170 uv170 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.411+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573d00 con 0x556e47565aa0 2024-09-12T02:05:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.412+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v127'402 uv393 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.412+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47573d00 con 0x556e47565aa0 2024-09-12T02:05:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.413+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v127'403 uv403 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.413+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573d00 con 0x556e47565aa0 2024-09-12T02:05:48.414 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:05:48.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.414+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v127'404 uv404 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.414+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573d00 con 0x556e47565aa0 2024-09-12T02:05:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.415+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v127'405 uv405 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.415+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e47565aa0 2024-09-12T02:05:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.416+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v127'406 uv406 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.416+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e47565aa0 2024-09-12T02:05:48.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.417+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v127'407 uv400 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.417+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e47565aa0 2024-09-12T02:05:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.419+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v127'408 uv408 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.419+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e47565aa0 2024-09-12T02:05:48.420 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:05:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.420+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v127'409 uv409 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.420+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e47565aa0 2024-09-12T02:05:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.421+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v127'410 uv410 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.421+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e47565aa0 2024-09-12T02:05:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.422+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v127'411 uv411 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.422+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47573ce0 con 0x556e47565aa0 2024-09-12T02:05:48.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.423+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v127'412 uv412 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.423+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x556e47574650 con 0x556e47565aa0 2024-09-12T02:05:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c5f88640 1 -- 172.21.15.19:0/3041518991 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v127'413 uv413 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f99bc00d970 con 0x556e47565aa0 2024-09-12T02:05:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556e47561530 msgr2=0x556e47563920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x556e47561530 0x556e47563920 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x556e474a1f20 msgr2=0x556e474a2300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x556e474a1f20 0x556e474a2300 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x556e47569fa0 msgr2=0x556e4756ce00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x556e47569fa0 0x556e4756ce00 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x556e47571150 msgr2=0x556e47573540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x556e47571150 0x556e47573540 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x556e47565aa0 msgr2=0x556e47567e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x556e47565aa0 0x556e47567e90 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x556e4756d9c0 msgr2=0x556e4756fdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x556e4756d9c0 0x556e4756fdb0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 reap_dead start 2024-09-12T02:05:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c6f8a640 1 -- 172.21.15.19:0/3041518991 reap_dead start 2024-09-12T02:05:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f99a806a840 msgr2=0x7f99a806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f99a806a840 0x7f99a806cd00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x556e47419b60 tx=0x7f99bc000bc0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e473e9ff0 msgr2=0x556e47493750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e473e9ff0 0x556e47493750 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x556e474bdee0 tx=0x7f99b8003020 comp rx=0 tx=0).stop 2024-09-12T02:05:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 shutdown_connections 2024-09-12T02:05:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f99a806a840 0x7f99a806cd00 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 --2- 172.21.15.19:0/3041518991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e473e9ff0 0x556e47493750 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 >> 172.21.15.19:0/3041518991 conn(0x556e473eaad0 msgr2=0x556e473e88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 shutdown_connections 2024-09-12T02:05:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.424+0000 7f99c8c93f40 1 -- 172.21.15.19:0/3041518991 wait complete. 2024-09-12T02:05:48.428 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 1.00000000 subdir_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-09-12T02:05:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.474+0000 7f989fb1ef40 1 Processor -- start 2024-09-12T02:05:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.474+0000 7f989fb1ef40 1 -- start start 2024-09-12T02:05:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.475+0000 7f989fb1ef40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a7b9c6f890 0x55a7b9c6bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.475+0000 7f989fb1ef40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7b9b94520 0x55a7b9c6c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.475+0000 7f989fb1ef40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7b9c6fc70 0x55a7b9c6d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.475+0000 7f989fb1ef40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a7b9b94ae0 con 0x55a7b9b94520 2024-09-12T02:05:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.475+0000 7f989fb1ef40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a7b9ae7510 con 0x55a7b9c6fc70 2024-09-12T02:05:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.475+0000 7f989fb1ef40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55a7b9b94dc0 con 0x55a7b9c6f890 2024-09-12T02:05:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.475+0000 7f989ce13640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7b9b94520 0x55a7b9c6c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.475+0000 7f989ce13640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7b9b94520 0x55a7b9c6c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47662/0 (socket says 172.21.15.19:47662) 2024-09-12T02:05:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.475+0000 7f989ce13640 1 -- 172.21.15.19:0/2157284771 learned_addr learned my addr 172.21.15.19:0/2157284771 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.475+0000 7f989de15640 1 --2- 172.21.15.19:0/2157284771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7b9c6fc70 0x55a7b9c6d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.475+0000 7f989d614640 1 --2- 172.21.15.19:0/2157284771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a7b9c6f890 0x55a7b9c6bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.475+0000 7f989ce13640 1 -- 172.21.15.19:0/2157284771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a7b9c6f890 msgr2=0x55a7b9c6bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.475+0000 7f989ce13640 1 --2- 172.21.15.19:0/2157284771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a7b9c6f890 0x55a7b9c6bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.475+0000 7f989ce13640 1 -- 172.21.15.19:0/2157284771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7b9c6fc70 msgr2=0x55a7b9c6d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.475+0000 7f989ce13640 1 --2- 172.21.15.19:0/2157284771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7b9c6fc70 0x55a7b9c6d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.475+0000 7f989ce13640 1 -- 172.21.15.19:0/2157284771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7b9bc59d0 con 0x55a7b9b94520 2024-09-12T02:05:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.475+0000 7f989d614640 1 --2- 172.21.15.19:0/2157284771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a7b9c6f890 0x55a7b9c6bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.475+0000 7f989ce13640 1 --2- 172.21.15.19:0/2157284771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7b9b94520 0x55a7b9c6c230 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f9888026420 tx=0x7f988804f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f286f7a92bc3a1c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.476+0000 7f98977fe640 1 -- 172.21.15.19:0/2157284771 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98880015b0 con 0x55a7b9b94520 2024-09-12T02:05:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.476+0000 7f98977fe640 1 -- 172.21.15.19:0/2157284771 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9888001750 con 0x55a7b9b94520 2024-09-12T02:05:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.476+0000 7f98977fe640 1 -- 172.21.15.19:0/2157284771 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9888065420 con 0x55a7b9b94520 2024-09-12T02:05:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.476+0000 7f989fb1ef40 1 -- 172.21.15.19:0/2157284771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7b9b94520 msgr2=0x55a7b9c6c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.476+0000 7f989fb1ef40 1 --2- 172.21.15.19:0/2157284771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7b9b94520 0x55a7b9c6c230 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f9888026420 tx=0x7f988804f000 comp rx=0 tx=0).stop 2024-09-12T02:05:48.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.476+0000 7f989fb1ef40 1 -- 172.21.15.19:0/2157284771 shutdown_connections 2024-09-12T02:05:48.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.476+0000 7f989fb1ef40 1 --2- 172.21.15.19:0/2157284771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7b9c6fc70 0x55a7b9c6d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.476+0000 7f989fb1ef40 1 --2- 172.21.15.19:0/2157284771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7b9b94520 0x55a7b9c6c230 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.476+0000 7f989fb1ef40 1 --2- 172.21.15.19:0/2157284771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a7b9c6f890 0x55a7b9c6bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.476+0000 7f989fb1ef40 1 -- 172.21.15.19:0/2157284771 >> 172.21.15.19:0/2157284771 conn(0x55a7b9b959e0 msgr2=0x55a7b9b93e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:48.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.476+0000 7f989fb1ef40 1 -- 172.21.15.19:0/2157284771 shutdown_connections 2024-09-12T02:05:48.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.476+0000 7f989fb1ef40 1 -- 172.21.15.19:0/2157284771 wait complete. 2024-09-12T02:05:48.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.477+0000 7f989fb1ef40 1 Processor -- start 2024-09-12T02:05:48.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.477+0000 7f989fb1ef40 1 -- start start 2024-09-12T02:05:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.477+0000 7f989fb1ef40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a7b9b94520 0x55a7b9c4eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.477+0000 7f989fb1ef40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7b9c6f890 0x55a7b9c6bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.477+0000 7f989fb1ef40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7b9c6fc70 0x55a7b9cfdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.477+0000 7f989fb1ef40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a7b9c70290 con 0x55a7b9c6fc70 2024-09-12T02:05:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.477+0000 7f989fb1ef40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a7b9c6c770 con 0x55a7b9c6f890 2024-09-12T02:05:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.477+0000 7f989fb1ef40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55a7b9bc5c90 con 0x55a7b9b94520 2024-09-12T02:05:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.478+0000 7f989de15640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7b9c6fc70 0x55a7b9cfdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.478+0000 7f989de15640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7b9c6fc70 0x55a7b9cfdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47668/0 (socket says 172.21.15.19:47668) 2024-09-12T02:05:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.478+0000 7f989de15640 1 -- 172.21.15.19:0/4084170841 learned_addr learned my addr 172.21.15.19:0/4084170841 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.478+0000 7f989d614640 1 --2- 172.21.15.19:0/4084170841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a7b9b94520 0x55a7b9c4eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.478+0000 7f989ce13640 1 --2- 172.21.15.19:0/4084170841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7b9c6f890 0x55a7b9c6bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.478+0000 7f989de15640 1 -- 172.21.15.19:0/4084170841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a7b9b94520 msgr2=0x55a7b9c4eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.478+0000 7f989de15640 1 --2- 172.21.15.19:0/4084170841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a7b9b94520 0x55a7b9c4eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.478+0000 7f989de15640 1 -- 172.21.15.19:0/4084170841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7b9c6f890 msgr2=0x55a7b9c6bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.478+0000 7f989de15640 1 --2- 172.21.15.19:0/4084170841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7b9c6f890 0x55a7b9c6bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.478+0000 7f989de15640 1 -- 172.21.15.19:0/4084170841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7b9cfba40 con 0x55a7b9c6fc70 2024-09-12T02:05:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.478+0000 7f989de15640 1 --2- 172.21.15.19:0/4084170841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7b9c6fc70 0x55a7b9cfdcd0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f9898005fd0 tx=0x7f9898013a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.478+0000 7f98967fc640 1 -- 172.21.15.19:0/4084170841 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9898014600 con 0x55a7b9c6fc70 2024-09-12T02:05:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.478+0000 7f98967fc640 1 -- 172.21.15.19:0/4084170841 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98980147a0 con 0x55a7b9c6fc70 2024-09-12T02:05:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.478+0000 7f98967fc640 1 -- 172.21.15.19:0/4084170841 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9898014b90 con 0x55a7b9c6fc70 2024-09-12T02:05:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.478+0000 7f989fb1ef40 1 -- 172.21.15.19:0/4084170841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7b9c6ca90 con 0x55a7b9c6fc70 2024-09-12T02:05:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.478+0000 7f989fb1ef40 1 -- 172.21.15.19:0/4084170841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7b9c4ae60 con 0x55a7b9c6fc70 2024-09-12T02:05:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.480+0000 7f98967fc640 1 -- 172.21.15.19:0/4084170841 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9898011040 con 0x55a7b9c6fc70 2024-09-12T02:05:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.480+0000 7f98967fc640 1 --2- 172.21.15.19:0/4084170841 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f988006a810 0x7f988006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.480+0000 7f98967fc640 1 -- 172.21.15.19:0/4084170841 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7f989808b320 con 0x55a7b9c6fc70 2024-09-12T02:05:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.480+0000 7f989d614640 1 --2- 172.21.15.19:0/4084170841 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f988006a810 0x7f988006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.480+0000 7f989fb1ef40 1 --2- 172.21.15.19:0/4084170841 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55a7b9cfe6c0 0x55a7b9d08640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.480+0000 7f989fb1ef40 1 -- 172.21.15.19:0/4084170841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=103b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) -- 0x55a7b9c6c1f0 con 0x55a7b9cfe6c0 2024-09-12T02:05:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.480+0000 7f989ce13640 1 --2- 172.21.15.19:0/4084170841 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55a7b9cfe6c0 0x55a7b9d08640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.481+0000 7f989d614640 1 --2- 172.21.15.19:0/4084170841 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f988006a810 0x7f988006ccd0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9890005fd0 tx=0x7f989000c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.481+0000 7f989ce13640 1 --2- 172.21.15.19:0/4084170841 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55a7b9cfe6c0 0x55a7b9d08640 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.482+0000 7f989ce13640 1 -- 172.21.15.19:0/4084170841 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 1.00000000 [omap-set-vals] v127'414 uv414 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f98880543c0 con 0x55a7b9cfe6c0 2024-09-12T02:05:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.482+0000 7f989fb1ef40 1 -- 172.21.15.19:0/4084170841 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55a7b9cfe6c0 msgr2=0x55a7b9d08640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.482+0000 7f989fb1ef40 1 --2- 172.21.15.19:0/4084170841 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55a7b9cfe6c0 0x55a7b9d08640 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.482+0000 7f989fb1ef40 1 -- 172.21.15.19:0/4084170841 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f988006a810 msgr2=0x7f988006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.482+0000 7f989fb1ef40 1 --2- 172.21.15.19:0/4084170841 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f988006a810 0x7f988006ccd0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9890005fd0 tx=0x7f989000c040 comp rx=0 tx=0).stop 2024-09-12T02:05:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.482+0000 7f989fb1ef40 1 -- 172.21.15.19:0/4084170841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7b9c6fc70 msgr2=0x55a7b9cfdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.482+0000 7f989fb1ef40 1 --2- 172.21.15.19:0/4084170841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7b9c6fc70 0x55a7b9cfdcd0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f9898005fd0 tx=0x7f9898013a20 comp rx=0 tx=0).stop 2024-09-12T02:05:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.482+0000 7f989de15640 1 -- 172.21.15.19:0/4084170841 reap_dead start 2024-09-12T02:05:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.482+0000 7f989fb1ef40 1 -- 172.21.15.19:0/4084170841 shutdown_connections 2024-09-12T02:05:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.482+0000 7f989fb1ef40 1 -- 172.21.15.19:0/4084170841 >> 172.21.15.19:0/4084170841 conn(0x55a7b9b959e0 msgr2=0x55a7b9c69c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.482+0000 7f989fb1ef40 1 -- 172.21.15.19:0/4084170841 shutdown_connections 2024-09-12T02:05:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.482+0000 7f989fb1ef40 1 -- 172.21.15.19:0/4084170841 wait complete. 2024-09-12T02:05:48.487 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:05:48.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.592+0000 7fdbd2b28640 1 Processor -- start 2024-09-12T02:05:48.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.592+0000 7fdbd2b28640 1 -- start start 2024-09-12T02:05:48.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.593+0000 7fdbd2b28640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbcc072270 0x7fdbcc072650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.593+0000 7fdbd2b28640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdbcc0ce6a0 0x7fdbcc06e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.593+0000 7fdbd2b28640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbcc072b90 con 0x7fdbcc06e2d0 2024-09-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.593+0000 7fdbd2b28640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fdbcc0b00b0 con 0x7fdbcc0ce6a0 2024-09-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.593+0000 7fdbd2b28640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdbcc156ca0 con 0x7fdbcc072270 2024-09-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.593+0000 7fdbcbfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdbcc06e2d0 0x7fdbcc15fdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34640/0 (socket says 172.21.15.19:34640) 2024-09-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.593+0000 7fdbcbfff640 1 -- 172.21.15.19:0/1058818040 learned_addr learned my addr 172.21.15.19:0/1058818040 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.593+0000 7fdbd10c5640 1 --2- 172.21.15.19:0/1058818040 >> v2:172.21.15.135:3300/0 conn(0x7fdbcc0ce6a0 0x7fdbcc06e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.593+0000 7fdbcb7fe640 1 -- 172.21.15.19:0/1058818040 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2804202092 0 0) 0x7fdbcc072b90 con 0x7fdbcc06e2d0 2024-09-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.593+0000 7fdbd08c4640 1 --2- 172.21.15.19:0/1058818040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbcc072270 0x7fdbcc072650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.593+0000 7fdbcb7fe640 1 -- 172.21.15.19:0/1058818040 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbbc003520 con 0x7fdbcc06e2d0 2024-09-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcb7fe640 1 -- 172.21.15.19:0/1058818040 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2977862107 0 0) 0x7fdbbc003520 con 0x7fdbcc06e2d0 2024-09-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcb7fe640 1 -- 172.21.15.19:0/1058818040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbcc072270 msgr2=0x7fdbcc072650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcb7fe640 1 --2- 172.21.15.19:0/1058818040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbcc072270 0x7fdbcc072650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcb7fe640 1 -- 172.21.15.19:0/1058818040 >> v2:172.21.15.135:3300/0 conn(0x7fdbcc0ce6a0 msgr2=0x7fdbcc06e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcb7fe640 1 --2- 172.21.15.19:0/1058818040 >> v2:172.21.15.135:3300/0 conn(0x7fdbcc0ce6a0 0x7fdbcc06e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcb7fe640 1 -- 172.21.15.19:0/1058818040 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbcc06ed90 con 0x7fdbcc06e2d0 2024-09-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcb7fe640 1 -- 172.21.15.19:0/1058818040 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fdbb8001670 con 0x7fdbcc06e2d0 2024-09-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcb7fe640 1 -- 172.21.15.19:0/1058818040 >> v1:172.21.15.19:6789/0 conn(0x7fdbcc06e2d0 legacy=0x7fdbcc15fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcb7fe640 1 --2- 172.21.15.19:0/1058818040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbcc072270 0x7fdbbc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcb7fe640 1 --2- 172.21.15.19:0/1058818040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbbc003f30 0x7fdbbc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcb7fe640 1 --2- 172.21.15.19:0/1058818040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbbc004d40 0x7fdbbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcb7fe640 1 -- 172.21.15.19:0/1058818040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc156ca0 con 0x7fdbbc003f30 2024-09-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcb7fe640 1 -- 172.21.15.19:0/1058818040 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc00b9c0 con 0x7fdbbc004d40 2024-09-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcb7fe640 1 -- 172.21.15.19:0/1058818040 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdbbc00bb40 con 0x7fdbcc072270 2024-09-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcbfff640 1 --2- 172.21.15.19:0/1058818040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbbc003f30 0x7fdbbc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbd08c4640 1 --2- 172.21.15.19:0/1058818040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbcc072270 0x7fdbbc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbd10c5640 1 --2- 172.21.15.19:0/1058818040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbbc004d40 0x7fdbbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcbfff640 1 -- 172.21.15.19:0/1058818040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbcc072270 msgr2=0x7fdbbc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcbfff640 1 --2- 172.21.15.19:0/1058818040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbcc072270 0x7fdbbc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcbfff640 1 -- 172.21.15.19:0/1058818040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbbc004d40 msgr2=0x7fdbbc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcbfff640 1 --2- 172.21.15.19:0/1058818040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbbc004d40 0x7fdbbc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.594+0000 7fdbcbfff640 1 -- 172.21.15.19:0/1058818040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbbc003520 con 0x7fdbbc003f30 2024-09-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.595+0000 7fdbcbfff640 1 --2- 172.21.15.19:0/1058818040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbbc003f30 0x7fdbbc004800 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8007fd0 tx=0x7fdbbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd1f608c59818d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.595+0000 7fdbcb7fe640 1 -- 172.21.15.19:0/1058818040 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8007d50 con 0x7fdbbc003f30 2024-09-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.595+0000 7fdbcb7fe640 1 -- 172.21.15.19:0/1058818040 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbb8005af0 con 0x7fdbbc003f30 2024-09-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.595+0000 7fdbcb7fe640 1 -- 172.21.15.19:0/1058818040 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8007070 con 0x7fdbbc003f30 2024-09-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.595+0000 7fdbd2b28640 1 -- 172.21.15.19:0/1058818040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbbc003f30 msgr2=0x7fdbbc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.595+0000 7fdbd2b28640 1 --2- 172.21.15.19:0/1058818040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbbc003f30 0x7fdbbc004800 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8007fd0 tx=0x7fdbbc005830 comp rx=0 tx=0).stop 2024-09-12T02:05:48.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.595+0000 7fdbd10c5640 1 -- 172.21.15.19:0/1058818040 reap_dead start 2024-09-12T02:05:48.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.595+0000 7fdbd2b28640 1 -- 172.21.15.19:0/1058818040 shutdown_connections 2024-09-12T02:05:48.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.595+0000 7fdbd2b28640 1 -- 172.21.15.19:0/1058818040 >> 172.21.15.19:0/1058818040 conn(0x7fdbcc06bc10 msgr2=0x7fdbcc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:48.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.596+0000 7fdbd2b28640 1 -- 172.21.15.19:0/1058818040 shutdown_connections 2024-09-12T02:05:48.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.596+0000 7fdbd2b28640 1 -- 172.21.15.19:0/1058818040 wait complete. 2024-09-12T02:05:48.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.597+0000 7fdbd2b28640 1 Processor -- start 2024-09-12T02:05:48.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.597+0000 7fdbd2b28640 1 -- start start 2024-09-12T02:05:48.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbd2b28640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbbc003f30 0x7fdbcc1f2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbd2b28640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbcc1450d0 0x7fdbcc151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbd2b28640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbcc15b630 0x7fdbcc15bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbd2b28640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc0cd170 con 0x7fdbcc15b630 2024-09-12T02:05:48.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbd2b28640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc06f350 con 0x7fdbbc003f30 2024-09-12T02:05:48.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbd2b28640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdbcc15ca20 con 0x7fdbcc1450d0 2024-09-12T02:05:48.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbd10c5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbcc15b630 0x7fdbcc15bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbd10c5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbcc15b630 0x7fdbcc15bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47692/0 (socket says 172.21.15.19:47692) 2024-09-12T02:05:48.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbd10c5640 1 -- 172.21.15.19:0/1560107457 learned_addr learned my addr 172.21.15.19:0/1560107457 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:48.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbd08c4640 1 --2- 172.21.15.19:0/1560107457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbbc003f30 0x7fdbcc1f2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbcbfff640 1 --2- 172.21.15.19:0/1560107457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbcc1450d0 0x7fdbcc151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbd10c5640 1 -- 172.21.15.19:0/1560107457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbcc1450d0 msgr2=0x7fdbcc151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbd10c5640 1 --2- 172.21.15.19:0/1560107457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbcc1450d0 0x7fdbcc151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbd10c5640 1 -- 172.21.15.19:0/1560107457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbbc003f30 msgr2=0x7fdbcc1f2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbd10c5640 1 --2- 172.21.15.19:0/1560107457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbbc003f30 0x7fdbcc1f2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbd10c5640 1 -- 172.21.15.19:0/1560107457 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbcc1f3530 con 0x7fdbcc15b630 2024-09-12T02:05:48.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbd10c5640 1 --2- 172.21.15.19:0/1560107457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbcc15b630 0x7fdbcc15bab0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc06fcf0 tx=0x7fdbc400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbc97fa640 1 -- 172.21.15.19:0/1560107457 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4019070 con 0x7fdbcc15b630 2024-09-12T02:05:48.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.598+0000 7fdbc97fa640 1 -- 172.21.15.19:0/1560107457 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc400f8d0 con 0x7fdbcc15b630 2024-09-12T02:05:48.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.599+0000 7fdbd2b28640 1 -- 172.21.15.19:0/1560107457 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbcc1f3810 con 0x7fdbcc15b630 2024-09-12T02:05:48.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.599+0000 7fdbc97fa640 1 -- 172.21.15.19:0/1560107457 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc400fcc0 con 0x7fdbcc15b630 2024-09-12T02:05:48.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.599+0000 7fdbd2b28640 1 -- 172.21.15.19:0/1560107457 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbcc1f3dd0 con 0x7fdbcc15b630 2024-09-12T02:05:48.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.600+0000 7fdbd2b28640 1 -- 172.21.15.19:0/1560107457 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbcc069400 con 0x7fdbcc15b630 2024-09-12T02:05:48.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.600+0000 7fdbc97fa640 1 -- 172.21.15.19:0/1560107457 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdbc401c070 con 0x7fdbcc15b630 2024-09-12T02:05:48.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.601+0000 7fdbc97fa640 1 --2- 172.21.15.19:0/1560107457 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdbb006be60 0x7fdbb006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.601+0000 7fdbc97fa640 1 -- 172.21.15.19:0/1560107457 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7fdbc408c3d0 con 0x7fdbcc15b630 2024-09-12T02:05:48.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.601+0000 7fdbd08c4640 1 --2- 172.21.15.19:0/1560107457 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdbb006be60 0x7fdbb006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.601+0000 7fdbd08c4640 1 --2- 172.21.15.19:0/1560107457 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdbb006be60 0x7fdbb006e320 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0af7d0 tx=0x7fdbc0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.605+0000 7fdbc97fa640 1 -- 172.21.15.19:0/1560107457 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdbcc069400 con 0x7fdbcc15b630 2024-09-12T02:05:48.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:48.816+0000 7fdbd2b28640 1 -- 172.21.15.19:0/1560107457 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fdbcc06e730 con 0x7fdbcc15b630 2024-09-12T02:05:49.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.211+0000 7fdbc97fa640 1 -- 172.21.15.19:0/1560107457 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v275) ==== 162+0+0 (secure 0 0 0) 0x7fdbc4010040 con 0x7fdbcc15b630 2024-09-12T02:05:49.212 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:05:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.214+0000 7fdbd2b28640 1 -- 172.21.15.19:0/1560107457 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdbb006be60 msgr2=0x7fdbb006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.214+0000 7fdbd2b28640 1 --2- 172.21.15.19:0/1560107457 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdbb006be60 0x7fdbb006e320 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0af7d0 tx=0x7fdbc0009190 comp rx=0 tx=0).stop 2024-09-12T02:05:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.214+0000 7fdbd2b28640 1 -- 172.21.15.19:0/1560107457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbcc15b630 msgr2=0x7fdbcc15bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.214+0000 7fdbd2b28640 1 --2- 172.21.15.19:0/1560107457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbcc15b630 0x7fdbcc15bab0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc06fcf0 tx=0x7fdbc400f1b0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.214+0000 7fdbd2b28640 1 -- 172.21.15.19:0/1560107457 shutdown_connections 2024-09-12T02:05:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.214+0000 7fdbd2b28640 1 --2- 172.21.15.19:0/1560107457 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdbb006be60 0x7fdbb006e320 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.215+0000 7fdbd2b28640 1 --2- 172.21.15.19:0/1560107457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbcc15b630 0x7fdbcc15bab0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.215+0000 7fdbd2b28640 1 --2- 172.21.15.19:0/1560107457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbcc1450d0 0x7fdbcc151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.215+0000 7fdbd2b28640 1 --2- 172.21.15.19:0/1560107457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbbc003f30 0x7fdbcc1f2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.215+0000 7fdbd2b28640 1 -- 172.21.15.19:0/1560107457 >> 172.21.15.19:0/1560107457 conn(0x7fdbcc06bc10 msgr2=0x7fdbcc15ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.215+0000 7fdbd2b28640 1 -- 172.21.15.19:0/1560107457 shutdown_connections 2024-09-12T02:05:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.215+0000 7fdbd2b28640 1 -- 172.21.15.19:0/1560107457 wait complete. 2024-09-12T02:05:49.632 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:49.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.747+0000 7f06c7b9f640 1 Processor -- start 2024-09-12T02:05:49.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.747+0000 7f06c7b9f640 1 -- start start 2024-09-12T02:05:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.748+0000 7f06c7b9f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f06c015e5f0 0x7f06c00d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.748+0000 7f06c7b9f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06c00d30f0 0x7f06c00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.748+0000 7f06c7b9f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06c00d3690 con 0x7f06c00b64c0 2024-09-12T02:05:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.748+0000 7f06c7b9f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f06c006d530 con 0x7f06c015e5f0 2024-09-12T02:05:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.748+0000 7f06c7b9f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f06c00d3970 con 0x7f06c00d30f0 2024-09-12T02:05:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.748+0000 7f06c613c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f06c00b64c0 0x7f06c00cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34644/0 (socket says 172.21.15.19:34644) 2024-09-12T02:05:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.748+0000 7f06c613c640 1 -- 172.21.15.19:0/598589632 learned_addr learned my addr 172.21.15.19:0/598589632 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.748+0000 7f06c593b640 1 --2- 172.21.15.19:0/598589632 >> v2:172.21.15.135:3300/0 conn(0x7f06c015e5f0 0x7f06c00d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.748+0000 7f06c513a640 1 --2- 172.21.15.19:0/598589632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06c00d30f0 0x7f06c00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.748+0000 7f06c4939640 1 -- 172.21.15.19:0/598589632 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399209585 0 0) 0x7f06c00d3690 con 0x7f06c00b64c0 2024-09-12T02:05:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.748+0000 7f06c4939640 1 -- 172.21.15.19:0/598589632 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06ac003520 con 0x7f06c00b64c0 2024-09-12T02:05:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c4939640 1 -- 172.21.15.19:0/598589632 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 151630819 0 0) 0x7f06ac003520 con 0x7f06c00b64c0 2024-09-12T02:05:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c4939640 1 -- 172.21.15.19:0/598589632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06c00d30f0 msgr2=0x7f06c00b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c4939640 1 --2- 172.21.15.19:0/598589632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06c00d30f0 0x7f06c00b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c4939640 1 -- 172.21.15.19:0/598589632 >> v2:172.21.15.135:3300/0 conn(0x7f06c015e5f0 msgr2=0x7f06c00d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c4939640 1 --2- 172.21.15.19:0/598589632 >> v2:172.21.15.135:3300/0 conn(0x7f06c015e5f0 0x7f06c00d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c4939640 1 -- 172.21.15.19:0/598589632 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c006cee0 con 0x7f06c00b64c0 2024-09-12T02:05:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c4939640 1 -- 172.21.15.19:0/598589632 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f06b80019f0 con 0x7f06c00b64c0 2024-09-12T02:05:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c4939640 1 -- 172.21.15.19:0/598589632 >> v1:172.21.15.19:6789/0 conn(0x7f06c00b64c0 legacy=0x7f06c00cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c4939640 1 --2- 172.21.15.19:0/598589632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06c00d30f0 0x7f06ac0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c4939640 1 --2- 172.21.15.19:0/598589632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06ac003f30 0x7f06ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c4939640 1 --2- 172.21.15.19:0/598589632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ac004d40 0x7f06ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c4939640 1 -- 172.21.15.19:0/598589632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f06c006d530 con 0x7f06ac003f30 2024-09-12T02:05:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c4939640 1 -- 172.21.15.19:0/598589632 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06c00d3970 con 0x7f06ac004d40 2024-09-12T02:05:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c4939640 1 -- 172.21.15.19:0/598589632 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f06ac00b9c0 con 0x7f06c00d30f0 2024-09-12T02:05:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c513a640 1 --2- 172.21.15.19:0/598589632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06ac003f30 0x7f06ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c593b640 1 --2- 172.21.15.19:0/598589632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06c00d30f0 0x7f06ac0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c613c640 1 --2- 172.21.15.19:0/598589632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ac004d40 0x7f06ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c513a640 1 -- 172.21.15.19:0/598589632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06c00d30f0 msgr2=0x7f06ac0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:49.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c513a640 1 --2- 172.21.15.19:0/598589632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06c00d30f0 0x7f06ac0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c513a640 1 -- 172.21.15.19:0/598589632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ac004d40 msgr2=0x7f06ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:49.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c513a640 1 --2- 172.21.15.19:0/598589632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ac004d40 0x7f06ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.749+0000 7f06c513a640 1 -- 172.21.15.19:0/598589632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ac003520 con 0x7f06ac003f30 2024-09-12T02:05:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.750+0000 7f06c513a640 1 --2- 172.21.15.19:0/598589632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06ac003f30 0x7f06ac004800 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f06b0009a90 tx=0x7f06ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb59d497bffe919 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.750+0000 7f06c4939640 1 -- 172.21.15.19:0/598589632 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0036070 con 0x7f06ac003f30 2024-09-12T02:05:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.750+0000 7f06c4939640 1 -- 172.21.15.19:0/598589632 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b0031400 con 0x7f06ac003f30 2024-09-12T02:05:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.750+0000 7f06c4939640 1 -- 172.21.15.19:0/598589632 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0009690 con 0x7f06ac003f30 2024-09-12T02:05:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.751+0000 7f06c7b9f640 1 -- 172.21.15.19:0/598589632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06ac003f30 msgr2=0x7f06ac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.751+0000 7f06c7b9f640 1 --2- 172.21.15.19:0/598589632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06ac003f30 0x7f06ac004800 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f06b0009a90 tx=0x7f06ac005830 comp rx=0 tx=0).stop 2024-09-12T02:05:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.751+0000 7f06c613c640 1 -- 172.21.15.19:0/598589632 reap_dead start 2024-09-12T02:05:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.751+0000 7f06c7b9f640 1 -- 172.21.15.19:0/598589632 shutdown_connections 2024-09-12T02:05:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.751+0000 7f06c7b9f640 1 -- 172.21.15.19:0/598589632 >> 172.21.15.19:0/598589632 conn(0x7f06c008bfc0 msgr2=0x7f06c00d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.751+0000 7f06c7b9f640 1 -- 172.21.15.19:0/598589632 shutdown_connections 2024-09-12T02:05:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.751+0000 7f06c7b9f640 1 -- 172.21.15.19:0/598589632 wait complete. 2024-09-12T02:05:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.752+0000 7f06c7b9f640 1 Processor -- start 2024-09-12T02:05:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.752+0000 7f06c7b9f640 1 -- start start 2024-09-12T02:05:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.753+0000 7f06c7b9f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ac003f30 0x7f06c00b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.753+0000 7f06c7b9f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c00b9720 0x7f06c00cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.753+0000 7f06c7b9f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06c0153480 0x7f06c0153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.753+0000 7f06c7b9f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f06c00d5310 con 0x7f06c00b9720 2024-09-12T02:05:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.753+0000 7f06c7b9f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06c015e9d0 con 0x7f06ac003f30 2024-09-12T02:05:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.753+0000 7f06c7b9f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f06c006e9d0 con 0x7f06c0153480 2024-09-12T02:05:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.753+0000 7f06c513a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c00b9720 0x7f06c00cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.753+0000 7f06c513a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c00b9720 0x7f06c00cd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47704/0 (socket says 172.21.15.19:47704) 2024-09-12T02:05:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.753+0000 7f06c513a640 1 -- 172.21.15.19:0/2135374103 learned_addr learned my addr 172.21.15.19:0/2135374103 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.753+0000 7f06c593b640 1 --2- 172.21.15.19:0/2135374103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ac003f30 0x7f06c00b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.753+0000 7f06c613c640 1 --2- 172.21.15.19:0/2135374103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06c0153480 0x7f06c0153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.753+0000 7f06c513a640 1 -- 172.21.15.19:0/2135374103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06c0153480 msgr2=0x7f06c0153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.753+0000 7f06c513a640 1 --2- 172.21.15.19:0/2135374103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06c0153480 0x7f06c0153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.753+0000 7f06c513a640 1 -- 172.21.15.19:0/2135374103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ac003f30 msgr2=0x7f06c00b7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.753+0000 7f06c513a640 1 --2- 172.21.15.19:0/2135374103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ac003f30 0x7f06c00b7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.753+0000 7f06c513a640 1 -- 172.21.15.19:0/2135374103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c015eda0 con 0x7f06c00b9720 2024-09-12T02:05:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.753+0000 7f06c613c640 1 --2- 172.21.15.19:0/2135374103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06c0153480 0x7f06c0153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.753+0000 7f06c513a640 1 --2- 172.21.15.19:0/2135374103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c00b9720 0x7f06c00cd850 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f06b0000c00 tx=0x7f06b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.754+0000 7f06b67fc640 1 -- 172.21.15.19:0/2135374103 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0040020 con 0x7f06c00b9720 2024-09-12T02:05:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.754+0000 7f06b67fc640 1 -- 172.21.15.19:0/2135374103 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b003b660 con 0x7f06c00b9720 2024-09-12T02:05:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.754+0000 7f06c7b9f640 1 -- 172.21.15.19:0/2135374103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c015f080 con 0x7f06c00b9720 2024-09-12T02:05:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.754+0000 7f06b67fc640 1 -- 172.21.15.19:0/2135374103 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0036040 con 0x7f06c00b9720 2024-09-12T02:05:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.754+0000 7f06c7b9f640 1 -- 172.21.15.19:0/2135374103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c015f640 con 0x7f06c00b9720 2024-09-12T02:05:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.755+0000 7f06c7b9f640 1 -- 172.21.15.19:0/2135374103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06c00d3690 con 0x7f06c00b9720 2024-09-12T02:05:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.755+0000 7f06b67fc640 1 -- 172.21.15.19:0/2135374103 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f06b0043020 con 0x7f06c00b9720 2024-09-12T02:05:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.756+0000 7f06b67fc640 1 --2- 172.21.15.19:0/2135374103 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f06a406be30 0x7f06a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.756+0000 7f06b67fc640 1 -- 172.21.15.19:0/2135374103 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7f06b00ac490 con 0x7f06c00b9720 2024-09-12T02:05:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.756+0000 7f06c593b640 1 --2- 172.21.15.19:0/2135374103 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f06a406be30 0x7f06a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.757+0000 7f06c593b640 1 --2- 172.21.15.19:0/2135374103 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f06a406be30 0x7f06a406e2f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009c40 tx=0x7f06bc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:49.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.760+0000 7f06b67fc640 1 -- 172.21.15.19:0/2135374103 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f06b004a020 con 0x7f06c00b9720 2024-09-12T02:05:49.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.975+0000 7f06c7b9f640 1 -- 172.21.15.19:0/2135374103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06c00cb300 con 0x7f06c00b9720 2024-09-12T02:05:49.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.975+0000 7f06b67fc640 1 -- 172.21.15.19:0/2135374103 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 276 v276) ==== 95+0+5227 (secure 0 0 0) 0x7f06b007a0e0 con 0x7f06c00b9720 2024-09-12T02:05:49.976 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:49.976 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":276,"btime":"2024-09-12T02:05:49:215201+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":276,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:49.215185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":127,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9939":{"gid":9939,"name":"c","rank":0,"incarnation":276,"state":"up:replay","state_seq":1,"addr":"172.21.15.19:6834/3065327567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3065327567},{"type":"v1","addr":"172.21.15.19:6834","nonce":3065327567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:05:49.976 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 276 2024-09-12T02:05:49.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.978+0000 7f06c7b9f640 1 -- 172.21.15.19:0/2135374103 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f06a406be30 msgr2=0x7f06a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.978+0000 7f06c7b9f640 1 --2- 172.21.15.19:0/2135374103 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f06a406be30 0x7f06a406e2f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009c40 tx=0x7f06bc009190 comp rx=0 tx=0).stop 2024-09-12T02:05:49.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.978+0000 7f06c7b9f640 1 -- 172.21.15.19:0/2135374103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c00b9720 msgr2=0x7f06c00cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.978+0000 7f06c7b9f640 1 --2- 172.21.15.19:0/2135374103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c00b9720 0x7f06c00cd850 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f06b0000c00 tx=0x7f06b0004730 comp rx=0 tx=0).stop 2024-09-12T02:05:49.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.978+0000 7f06c7b9f640 1 -- 172.21.15.19:0/2135374103 shutdown_connections 2024-09-12T02:05:49.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.978+0000 7f06c7b9f640 1 --2- 172.21.15.19:0/2135374103 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f06a406be30 0x7f06a406e2f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.978+0000 7f06c7b9f640 1 --2- 172.21.15.19:0/2135374103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06c0153480 0x7f06c0153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.978+0000 7f06c7b9f640 1 --2- 172.21.15.19:0/2135374103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c00b9720 0x7f06c00cd850 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.978+0000 7f06c7b9f640 1 --2- 172.21.15.19:0/2135374103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ac003f30 0x7f06c00b7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.978+0000 7f06c7b9f640 1 -- 172.21.15.19:0/2135374103 >> 172.21.15.19:0/2135374103 conn(0x7f06c008bfc0 msgr2=0x7f06c00b5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:49.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.978+0000 7f06c7b9f640 1 -- 172.21.15.19:0/2135374103 shutdown_connections 2024-09-12T02:05:49.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:49.978+0000 7f06c7b9f640 1 -- 172.21.15.19:0/2135374103 wait complete. 2024-09-12T02:05:49.990 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 276, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:05:49.215185+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 127, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9939}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9939': {'gid': 9939, 'name': 'c', 'rank': 0, 'incarnation': 276, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.19:6834/3065327567', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 3065327567}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 3065327567}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:05:49.990 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9939:up:replay 2024-09-12T02:05:49.990 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-12T02:05:53.209 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:05:53.209+0000 7fd7ef435640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:05:55.284 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:05:55.284+0000 7f0214f49640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-12T02:05:55.394 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:55.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.509+0000 7fae4805c640 1 Processor -- start 2024-09-12T02:05:55.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.510+0000 7fae4805c640 1 -- start start 2024-09-12T02:05:55.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.510+0000 7fae4805c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fae40161c80 0x7fae4006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.510+0000 7fae4805c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae400b6680 0x7fae400cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.510+0000 7fae4805c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae4006e870 con 0x7fae40162060 2024-09-12T02:05:55.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.510+0000 7fae4805c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fae4006d9f0 con 0x7fae40161c80 2024-09-12T02:05:55.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.510+0000 7fae4805c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fae4006dcd0 con 0x7fae400b6680 2024-09-12T02:05:55.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.511+0000 7fae45df8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fae40161c80 0x7fae4006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.511+0000 7fae455f7640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fae40162060 0x7fae400b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58366/0 (socket says 172.21.15.19:58366) 2024-09-12T02:05:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.511+0000 7fae45df8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fae40161c80 0x7fae4006e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55222/0 (socket says 172.21.15.19:55222) 2024-09-12T02:05:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.511+0000 7fae455f7640 1 -- 172.21.15.19:0/909004811 learned_addr learned my addr 172.21.15.19:0/909004811 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.511+0000 7fae465f9640 1 --2- 172.21.15.19:0/909004811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae400b6680 0x7fae400cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.511+0000 7fae45df8640 1 -- 172.21.15.19:0/909004811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae400b6680 msgr2=0x7fae400cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.511+0000 7fae45df8640 1 --2- 172.21.15.19:0/909004811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae400b6680 0x7fae400cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.511+0000 7fae45df8640 1 -- 172.21.15.19:0/909004811 >> v1:172.21.15.19:6789/0 conn(0x7fae40162060 legacy=0x7fae400b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.511+0000 7fae45df8640 1 -- 172.21.15.19:0/909004811 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4006dfb0 con 0x7fae40161c80 2024-09-12T02:05:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.511+0000 7fae44df6640 1 -- 172.21.15.19:0/909004811 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074319635 0 0) 0x7fae30001110 con 0x7fae40162060 2024-09-12T02:05:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.511+0000 7fae465f9640 1 --2- 172.21.15.19:0/909004811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae400b6680 0x7fae400cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.512+0000 7fae45df8640 1 --2- 172.21.15.19:0/909004811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae40161c80 0x7fae4006e330 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0097a0 tx=0x7fae3c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b185620a91cda85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.512+0000 7fae44df6640 1 -- 172.21.15.19:0/909004811 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c037070 con 0x7fae40161c80 2024-09-12T02:05:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.512+0000 7fae44df6640 1 -- 172.21.15.19:0/909004811 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae3c032440 con 0x7fae40161c80 2024-09-12T02:05:55.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.512+0000 7fae44df6640 1 -- 172.21.15.19:0/909004811 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c032810 con 0x7fae40161c80 2024-09-12T02:05:55.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.512+0000 7fae4805c640 1 -- 172.21.15.19:0/909004811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae40161c80 msgr2=0x7fae4006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:55.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.512+0000 7fae4805c640 1 --2- 172.21.15.19:0/909004811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae40161c80 0x7fae4006e330 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0097a0 tx=0x7fae3c02a180 comp rx=0 tx=0).stop 2024-09-12T02:05:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.513+0000 7fae4805c640 1 -- 172.21.15.19:0/909004811 shutdown_connections 2024-09-12T02:05:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.513+0000 7fae4805c640 1 --2- 172.21.15.19:0/909004811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae400b6680 0x7fae400cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.513+0000 7fae4805c640 1 --2- 172.21.15.19:0/909004811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae40161c80 0x7fae4006e330 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.513+0000 7fae4805c640 1 -- 172.21.15.19:0/909004811 >> 172.21.15.19:0/909004811 conn(0x7fae400d44f0 msgr2=0x7fae400d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.513+0000 7fae4805c640 1 -- 172.21.15.19:0/909004811 shutdown_connections 2024-09-12T02:05:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.513+0000 7fae4805c640 1 -- 172.21.15.19:0/909004811 wait complete. 2024-09-12T02:05:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.514+0000 7fae4805c640 1 Processor -- start 2024-09-12T02:05:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.514+0000 7fae4805c640 1 -- start start 2024-09-12T02:05:55.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.515+0000 7fae4805c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae400b6680 0x7fae400b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.515+0000 7fae4805c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae40161c80 0x7fae401f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.515+0000 7fae4805c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae40162060 0x7fae400cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.515+0000 7fae4805c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fae400b6cb0 con 0x7fae40161c80 2024-09-12T02:05:55.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.515+0000 7fae4805c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fae400b6b30 con 0x7fae400b6680 2024-09-12T02:05:55.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.515+0000 7fae4805c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fae400cf720 con 0x7fae40162060 2024-09-12T02:05:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.515+0000 7fae455f7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae40161c80 0x7fae401f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.515+0000 7fae455f7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae40161c80 0x7fae401f4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55226/0 (socket says 172.21.15.19:55226) 2024-09-12T02:05:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.515+0000 7fae455f7640 1 -- 172.21.15.19:0/2870938608 learned_addr learned my addr 172.21.15.19:0/2870938608 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.515+0000 7fae465f9640 1 --2- 172.21.15.19:0/2870938608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae40162060 0x7fae400cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.515+0000 7fae45df8640 1 --2- 172.21.15.19:0/2870938608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae400b6680 0x7fae400b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.515+0000 7fae455f7640 1 -- 172.21.15.19:0/2870938608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae40162060 msgr2=0x7fae400cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.515+0000 7fae455f7640 1 --2- 172.21.15.19:0/2870938608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae40162060 0x7fae400cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.515+0000 7fae455f7640 1 -- 172.21.15.19:0/2870938608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae400b6680 msgr2=0x7fae400b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.515+0000 7fae455f7640 1 --2- 172.21.15.19:0/2870938608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae400b6680 0x7fae400b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.515+0000 7fae455f7640 1 -- 172.21.15.19:0/2870938608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae400b3c30 con 0x7fae40161c80 2024-09-12T02:05:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.515+0000 7fae455f7640 1 --2- 172.21.15.19:0/2870938608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae40161c80 0x7fae401f4b00 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7fae3000c440 tx=0x7fae3000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.516+0000 7fae367fc640 1 -- 172.21.15.19:0/2870938608 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae30018070 con 0x7fae40161c80 2024-09-12T02:05:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.516+0000 7fae367fc640 1 -- 172.21.15.19:0/2870938608 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae300074e0 con 0x7fae40161c80 2024-09-12T02:05:55.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.516+0000 7fae4805c640 1 -- 172.21.15.19:0/2870938608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae400b26b0 con 0x7fae40161c80 2024-09-12T02:05:55.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.516+0000 7fae367fc640 1 -- 172.21.15.19:0/2870938608 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae30004a20 con 0x7fae40161c80 2024-09-12T02:05:55.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.516+0000 7fae4805c640 1 -- 172.21.15.19:0/2870938608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae400b2ef0 con 0x7fae40161c80 2024-09-12T02:05:55.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.517+0000 7fae4805c640 1 -- 172.21.15.19:0/2870938608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae400ba470 con 0x7fae40161c80 2024-09-12T02:05:55.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.517+0000 7fae367fc640 1 -- 172.21.15.19:0/2870938608 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae3001b070 con 0x7fae40161c80 2024-09-12T02:05:55.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.518+0000 7fae367fc640 1 --2- 172.21.15.19:0/2870938608 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae2406be30 0x7fae2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.518+0000 7fae367fc640 1 -- 172.21.15.19:0/2870938608 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7fae3008adc0 con 0x7fae40161c80 2024-09-12T02:05:55.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.518+0000 7fae45df8640 1 --2- 172.21.15.19:0/2870938608 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae2406be30 0x7fae2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.519+0000 7fae45df8640 1 --2- 172.21.15.19:0/2870938608 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae2406be30 0x7fae2406e2f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fae3c034000 tx=0x7fae3c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:55.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.522+0000 7fae367fc640 1 -- 172.21.15.19:0/2870938608 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae400b26b0 con 0x7fae40161c80 2024-09-12T02:05:55.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.734+0000 7fae4805c640 1 -- 172.21.15.19:0/2870938608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae400b6100 con 0x7fae40161c80 2024-09-12T02:05:55.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.734+0000 7fae367fc640 1 -- 172.21.15.19:0/2870938608 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 280 v280) ==== 95+0+5234 (secure 0 0 0) 0x7fae4006e870 con 0x7fae40161c80 2024-09-12T02:05:55.735 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:55.735 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":280,"btime":"2024-09-12T02:05:55:285473+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":280,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:55.224267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":127,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9939":{"gid":9939,"name":"c","rank":0,"incarnation":276,"state":"up:active","state_seq":5,"addr":"172.21.15.19:6834/3065327567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3065327567},{"type":"v1","addr":"172.21.15.19:6834","nonce":3065327567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9939,"qdb_cluster":[9939]},"id":6}]} 2024-09-12T02:05:55.735 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 280 2024-09-12T02:05:55.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.736+0000 7fae4805c640 1 -- 172.21.15.19:0/2870938608 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae2406be30 msgr2=0x7fae2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:55.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.736+0000 7fae4805c640 1 --2- 172.21.15.19:0/2870938608 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae2406be30 0x7fae2406e2f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fae3c034000 tx=0x7fae3c02e000 comp rx=0 tx=0).stop 2024-09-12T02:05:55.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.736+0000 7fae4805c640 1 -- 172.21.15.19:0/2870938608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae40161c80 msgr2=0x7fae401f4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:55.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.736+0000 7fae4805c640 1 --2- 172.21.15.19:0/2870938608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae40161c80 0x7fae401f4b00 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7fae3000c440 tx=0x7fae3000c900 comp rx=0 tx=0).stop 2024-09-12T02:05:55.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.736+0000 7fae4805c640 1 -- 172.21.15.19:0/2870938608 shutdown_connections 2024-09-12T02:05:55.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.736+0000 7fae4805c640 1 --2- 172.21.15.19:0/2870938608 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae2406be30 0x7fae2406e2f0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.736+0000 7fae4805c640 1 --2- 172.21.15.19:0/2870938608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae40162060 0x7fae400cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.736+0000 7fae4805c640 1 --2- 172.21.15.19:0/2870938608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae40161c80 0x7fae401f4b00 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.736+0000 7fae4805c640 1 --2- 172.21.15.19:0/2870938608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae400b6680 0x7fae400b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.736+0000 7fae4805c640 1 -- 172.21.15.19:0/2870938608 >> 172.21.15.19:0/2870938608 conn(0x7fae400d44f0 msgr2=0x7fae40160490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:55.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.737+0000 7fae4805c640 1 -- 172.21.15.19:0/2870938608 shutdown_connections 2024-09-12T02:05:55.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.737+0000 7fae4805c640 1 -- 172.21.15.19:0/2870938608 wait complete. 2024-09-12T02:05:55.748 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 280, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:05:55.224267+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 127, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9939}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9939': {'gid': 9939, 'name': 'c', 'rank': 0, 'incarnation': 276, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.19:6834/3065327567', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 3065327567}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 3065327567}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9939, 'qdb_cluster': [9939]} 2024-09-12T02:05:55.748 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:05:55.748 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T02:05:55.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.851+0000 7f2ea9af8640 1 Processor -- start 2024-09-12T02:05:55.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.851+0000 7f2ea9af8640 1 -- start start 2024-09-12T02:05:55.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.852+0000 7f2ea9af8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea415e740 0x7f2ea40d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.852+0000 7f2ea9af8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2ea409b690 0x7f2ea406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.852+0000 7f2ea9af8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2ea406d4c0 0x7f2ea406d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.852+0000 7f2ea9af8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea415eb20 con 0x7f2ea409b690 2024-09-12T02:05:55.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.852+0000 7f2ea9af8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea406d260 con 0x7f2ea406d4c0 2024-09-12T02:05:55.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.852+0000 7f2ea9af8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea40d0780 con 0x7f2ea415e740 2024-09-12T02:05:55.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.852+0000 7f2ea2ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2ea409b690 0x7f2ea406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.852+0000 7f2ea2ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2ea409b690 0x7f2ea406cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55230/0 (socket says 172.21.15.19:55230) 2024-09-12T02:05:55.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.852+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/3490963773 learned_addr learned my addr 172.21.15.19:0/3490963773 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:55.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.852+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/3490963773 >> v2:172.21.15.135:3300/0 conn(0x7f2ea406d4c0 0x7f2ea406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.852+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/3490963773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea415e740 0x7f2ea40d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.852+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/3490963773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea415e740 msgr2=0x7f2ea40d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:55.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.852+0000 7f2ea2ffd640 1 --2- 172.21.15.19:0/3490963773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea415e740 0x7f2ea40d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.852+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/3490963773 >> v2:172.21.15.135:3300/0 conn(0x7f2ea406d4c0 msgr2=0x7f2ea406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:55.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.852+0000 7f2ea2ffd640 1 --2- 172.21.15.19:0/3490963773 >> v2:172.21.15.135:3300/0 conn(0x7f2ea406d4c0 0x7f2ea406d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.852+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/3490963773 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea40d0a60 con 0x7f2ea409b690 2024-09-12T02:05:55.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.852+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/3490963773 >> v2:172.21.15.135:3300/0 conn(0x7f2ea406d4c0 0x7f2ea406d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:55.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.853+0000 7f2ea2ffd640 1 --2- 172.21.15.19:0/3490963773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea409b690 0x7f2ea406cd20 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4163240 tx=0x7f2e9802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c18ed7de0e2b49 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:55.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.853+0000 7f2ea27fc640 1 -- 172.21.15.19:0/3490963773 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98037070 con 0x7f2ea409b690 2024-09-12T02:05:55.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.853+0000 7f2ea27fc640 1 -- 172.21.15.19:0/3490963773 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e98032440 con 0x7f2ea409b690 2024-09-12T02:05:55.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.853+0000 7f2ea27fc640 1 -- 172.21.15.19:0/3490963773 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98032810 con 0x7f2ea409b690 2024-09-12T02:05:55.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.854+0000 7f2ea9af8640 1 -- 172.21.15.19:0/3490963773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea409b690 msgr2=0x7f2ea406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:55.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.854+0000 7f2ea9af8640 1 --2- 172.21.15.19:0/3490963773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea409b690 0x7f2ea406cd20 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4163240 tx=0x7f2e9802a2a0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.854+0000 7f2ea9af8640 1 -- 172.21.15.19:0/3490963773 shutdown_connections 2024-09-12T02:05:55.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.854+0000 7f2ea9af8640 1 --2- 172.21.15.19:0/3490963773 >> v2:172.21.15.135:3300/0 conn(0x7f2ea406d4c0 0x7f2ea406d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.854+0000 7f2ea9af8640 1 --2- 172.21.15.19:0/3490963773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea409b690 0x7f2ea406cd20 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.854+0000 7f2ea9af8640 1 --2- 172.21.15.19:0/3490963773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea415e740 0x7f2ea40d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.854+0000 7f2ea9af8640 1 -- 172.21.15.19:0/3490963773 >> 172.21.15.19:0/3490963773 conn(0x7f2ea40d23a0 msgr2=0x7f2ea40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:55.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.854+0000 7f2ea9af8640 1 -- 172.21.15.19:0/3490963773 shutdown_connections 2024-09-12T02:05:55.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.854+0000 7f2ea9af8640 1 -- 172.21.15.19:0/3490963773 wait complete. 2024-09-12T02:05:55.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.855+0000 7f2ea9af8640 1 Processor -- start 2024-09-12T02:05:55.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.855+0000 7f2ea9af8640 1 -- start start 2024-09-12T02:05:55.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.856+0000 7f2ea9af8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea406d4c0 0x7f2ea415d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.856+0000 7f2ea9af8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea409b690 0x7f2ea4160880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.856+0000 7f2ea9af8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea415e740 0x7f2ea41f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.856+0000 7f2ea9af8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea409ba90 con 0x7f2ea409b690 2024-09-12T02:05:55.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.856+0000 7f2ea9af8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea40d1020 con 0x7f2ea415e740 2024-09-12T02:05:55.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.856+0000 7f2ea9af8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea406de50 con 0x7f2ea406d4c0 2024-09-12T02:05:55.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.856+0000 7f2ea2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea409b690 0x7f2ea4160880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.856+0000 7f2ea2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea409b690 0x7f2ea4160880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55232/0 (socket says 172.21.15.19:55232) 2024-09-12T02:05:55.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.856+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/337574326 learned_addr learned my addr 172.21.15.19:0/337574326 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:55.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.856+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/337574326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea415e740 0x7f2ea41f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.856+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/337574326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea406d4c0 0x7f2ea415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.856+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/337574326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea406d4c0 msgr2=0x7f2ea415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:55.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.856+0000 7f2ea2ffd640 1 --2- 172.21.15.19:0/337574326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea406d4c0 0x7f2ea415d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.856+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/337574326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea415e740 msgr2=0x7f2ea41f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:55.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.856+0000 7f2ea2ffd640 1 --2- 172.21.15.19:0/337574326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea415e740 0x7f2ea41f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.856+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/337574326 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea415f7e0 con 0x7f2ea409b690 2024-09-12T02:05:55.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.857+0000 7f2ea2ffd640 1 --2- 172.21.15.19:0/337574326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea409b690 0x7f2ea4160880 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f2e98000c00 tx=0x7f2e980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:55.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.857+0000 7f2e8bfff640 1 -- 172.21.15.19:0/337574326 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98041020 con 0x7f2ea409b690 2024-09-12T02:05:55.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.857+0000 7f2e8bfff640 1 -- 172.21.15.19:0/337574326 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e980306c0 con 0x7f2ea409b690 2024-09-12T02:05:55.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.857+0000 7f2ea9af8640 1 -- 172.21.15.19:0/337574326 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea415fac0 con 0x7f2ea409b690 2024-09-12T02:05:55.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.857+0000 7f2e8bfff640 1 -- 172.21.15.19:0/337574326 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98037040 con 0x7f2ea409b690 2024-09-12T02:05:55.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.857+0000 7f2ea9af8640 1 -- 172.21.15.19:0/337574326 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea4160360 con 0x7f2ea409b690 2024-09-12T02:05:55.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.859+0000 7f2e8bfff640 1 -- 172.21.15.19:0/337574326 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e98044020 con 0x7f2ea409b690 2024-09-12T02:05:55.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.859+0000 7f2e8bfff640 1 --2- 172.21.15.19:0/337574326 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e9006be30 0x7f2e9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.859+0000 7f2e8bfff640 1 -- 172.21.15.19:0/337574326 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7f2e980ac2a0 con 0x7f2ea409b690 2024-09-12T02:05:55.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.859+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/337574326 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e9006be30 0x7f2e9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.860+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/337574326 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e9006be30 0x7f2e9006e2f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2e94007920 tx=0x7f2e94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:55.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.860+0000 7f2eac896740 1 Processor -- start 2024-09-12T02:05:55.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.860+0000 7f2eac896740 1 -- start start 2024-09-12T02:05:55.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2eac896740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb462c0 0x55eb1eb8ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2eac896740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb43a80 0x55eb1eb466a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2eac896740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb47a50 0x55eb1eb408b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2eac896740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55eb1eaa8520 con 0x55eb1eb462c0 2024-09-12T02:05:55.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2eac896740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55eb1ea503e0 con 0x55eb1eb43a80 2024-09-12T02:05:55.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2eac896740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55eb1eaa44e0 con 0x55eb1eb47a50 2024-09-12T02:05:55.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2ea37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb462c0 0x55eb1eb8ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2ea37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb462c0 0x55eb1eb8ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55240/0 (socket says 172.21.15.19:55240) 2024-09-12T02:05:55.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2ea37fe640 1 -- 172.21.15.19:0/3795803720 learned_addr learned my addr 172.21.15.19:0/3795803720 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:55.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2ea2ffd640 1 --2- 172.21.15.19:0/3795803720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb43a80 0x55eb1eb466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/3795803720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb47a50 0x55eb1eb408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2ea37fe640 1 -- 172.21.15.19:0/3795803720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb47a50 msgr2=0x55eb1eb408b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:55.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/3795803720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb47a50 0x55eb1eb408b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2ea37fe640 1 -- 172.21.15.19:0/3795803720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb43a80 msgr2=0x55eb1eb466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/3795803720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb43a80 0x55eb1eb466a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2ea37fe640 1 -- 172.21.15.19:0/3795803720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb1ea6b2f0 con 0x55eb1eb462c0 2024-09-12T02:05:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/3795803720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb47a50 0x55eb1eb408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/3795803720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb462c0 0x55eb1eb8ba60 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f2e94010aa0 tx=0x7f2e94013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5dbd879715be03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2e897fa640 1 -- 172.21.15.19:0/3795803720 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9401c050 con 0x55eb1eb462c0 2024-09-12T02:05:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2e897fa640 1 -- 172.21.15.19:0/3795803720 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e94026070 con 0x55eb1eb462c0 2024-09-12T02:05:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.861+0000 7f2e897fa640 1 -- 172.21.15.19:0/3795803720 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94016e30 con 0x55eb1eb462c0 2024-09-12T02:05:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.862+0000 7f2eac896740 1 -- 172.21.15.19:0/3795803720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb462c0 msgr2=0x55eb1eb8ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.862+0000 7f2eac896740 1 --2- 172.21.15.19:0/3795803720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb462c0 0x55eb1eb8ba60 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f2e94010aa0 tx=0x7f2e94013000 comp rx=0 tx=0).stop 2024-09-12T02:05:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.862+0000 7f2eac896740 1 -- 172.21.15.19:0/3795803720 shutdown_connections 2024-09-12T02:05:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.862+0000 7f2eac896740 1 --2- 172.21.15.19:0/3795803720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb47a50 0x55eb1eb408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.862+0000 7f2eac896740 1 --2- 172.21.15.19:0/3795803720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb43a80 0x55eb1eb466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.862+0000 7f2eac896740 1 --2- 172.21.15.19:0/3795803720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb462c0 0x55eb1eb8ba60 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.862+0000 7f2eac896740 1 -- 172.21.15.19:0/3795803720 >> 172.21.15.19:0/3795803720 conn(0x55eb1eb42a80 msgr2=0x55eb1eb8af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:55.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.862+0000 7f2eac896740 1 -- 172.21.15.19:0/3795803720 shutdown_connections 2024-09-12T02:05:55.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.862+0000 7f2eac896740 1 -- 172.21.15.19:0/3795803720 wait complete. 2024-09-12T02:05:55.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.863+0000 7f2eac896740 1 -- start start 2024-09-12T02:05:55.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.863+0000 7f2eac896740 1 Processor -- start 2024-09-12T02:05:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2eac896740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb462c0 0x55eb1eb92090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2eac896740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb47a50 0x55eb1eb65d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2eac896740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb8fff0 0x55eb1eb90470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2eac896740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55eb1eb41f20 con 0x55eb1eb462c0 2024-09-12T02:05:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2eac896740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55eb1ea31450 con 0x55eb1eb8fff0 2024-09-12T02:05:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2eac896740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55eb1eb8c290 con 0x55eb1eb47a50 2024-09-12T02:05:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2eac896740 10 client.0 _ll_register_callbacks cb 0x55eb1e7baac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:05:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2ea37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb462c0 0x55eb1eb92090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2ea37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb462c0 0x55eb1eb92090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55242/0 (socket says 172.21.15.19:55242) 2024-09-12T02:05:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2ea37fe640 1 -- 172.21.15.19:0/1182121963 learned_addr learned my addr 172.21.15.19:0/1182121963 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/1182121963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb8fff0 0x55eb1eb90470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2ea2ffd640 1 --2- 172.21.15.19:0/1182121963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb47a50 0x55eb1eb65d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2ea37fe640 1 -- 172.21.15.19:0/1182121963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb47a50 msgr2=0x55eb1eb65d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/1182121963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb47a50 0x55eb1eb65d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2ea37fe640 1 -- 172.21.15.19:0/1182121963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb8fff0 msgr2=0x55eb1eb90470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/1182121963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb8fff0 0x55eb1eb90470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2ea37fe640 1 -- 172.21.15.19:0/1182121963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb1e7bb2d0 con 0x55eb1eb462c0 2024-09-12T02:05:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/1182121963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb462c0 0x55eb1eb92090 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f2e94016850 tx=0x7f2e94004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acac8305b0ec6e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:55.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2e827fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:05:55.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.864+0000 7f2e827fc640 1 -- 172.21.15.19:0/1182121963 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94021650 con 0x55eb1eb462c0 2024-09-12T02:05:55.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.865+0000 7f2e827fc640 1 -- 172.21.15.19:0/1182121963 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7f2e940217f0 con 0x55eb1eb462c0 2024-09-12T02:05:55.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.865+0000 7f2eac896740 1 -- 172.21.15.19:0/1182121963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e94026070 con 0x55eb1eb462c0 2024-09-12T02:05:55.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.865+0000 7f2e827fc640 1 -- 172.21.15.19:0/1182121963 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=280) ==== 24+0+0 (secure 0 0 0) 0x7f2e9401c030 con 0x55eb1eb462c0 2024-09-12T02:05:55.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.865+0000 7f2eac896740 10 client.9990 fetch_fsmap learned FSMap version 280 2024-09-12T02:05:55.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.865+0000 7f2eac896740 1 -- 172.21.15.19:0/1182121963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=280,monmap=2+}) -- 0x55eb1e8856b0 con 0x55eb1eb462c0 2024-09-12T02:05:55.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.865+0000 7f2e827fc640 1 -- 172.21.15.19:0/1182121963 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e94026070 con 0x55eb1eb462c0 2024-09-12T02:05:55.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.865+0000 7f2e827fc640 1 -- 172.21.15.19:0/1182121963 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 280) ==== 3502+0+0 (secure 0 0 0) 0x7f2e94021a30 con 0x55eb1eb462c0 2024-09-12T02:05:55.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.865+0000 7f2eac896740 10 client.9990 fetch_fsmap finished waiting for FSMap version 280 2024-09-12T02:05:55.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.865+0000 7f2eac896740 10 client.9990 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:05:55.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.865+0000 7f2eac896740 20 client.9990 populate_metadata read hostname 'smithi019' 2024-09-12T02:05:55.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.865+0000 7f2eac896740 1 --2- 172.21.15.19:0/1182121963 >> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] conn(0x55eb1eb9b6f0 0x55eb1eb9bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.865+0000 7f2eac896740 4 client.9990 mds_command: new command op to 9939 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:05:55.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.865+0000 7f2eac896740 1 -- 172.21.15.19:0/1182121963 --> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb1eab5c50 con 0x55eb1eb9b6f0 2024-09-12T02:05:55.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.865+0000 7f2ea2ffd640 1 --2- 172.21.15.19:0/1182121963 >> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] conn(0x55eb1eb9b6f0 0x55eb1eb9bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.865+0000 7f2e827fc640 10 client.9990 ms_handle_connect on v2:172.21.15.19:6832/3065327567 2024-09-12T02:05:55.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.865+0000 7f2ea2ffd640 1 --2- 172.21.15.19:0/1182121963 >> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] conn(0x55eb1eb9b6f0 0x55eb1eb9bad0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e97318ab60e8a5ac server_cookie=dabbe271df333bcf in_seq=0 out_seq=0 2024-09-12T02:05:55.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.866+0000 7f2e827fc640 1 -- 172.21.15.19:0/1182121963 <== mds.0 v2:172.21.15.19:6832/3065327567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb1eab5c50 con 0x55eb1eb9b6f0 2024-09-12T02:05:55.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.866+0000 7f2e827fc640 10 client.9990 handle_command_reply: tid=0 2024-09-12T02:05:55.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.866+0000 7f2eac896740 1 client.9990 shutdown 2024-09-12T02:05:55.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.866+0000 7f2eac896740 1 -- 172.21.15.19:0/1182121963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb462c0 msgr2=0x55eb1eb92090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:55.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.866+0000 7f2eac896740 1 --2- 172.21.15.19:0/1182121963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb462c0 0x55eb1eb92090 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f2e94016850 tx=0x7f2e94004730 comp rx=0 tx=0).stop 2024-09-12T02:05:55.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.866+0000 7f2eac896740 1 -- 172.21.15.19:0/1182121963 shutdown_connections 2024-09-12T02:05:55.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.866+0000 7f2eac896740 1 --2- 172.21.15.19:0/1182121963 >> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] conn(0x55eb1eb9b6f0 0x55eb1eb9bad0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.866+0000 7f2eac896740 1 --2- 172.21.15.19:0/1182121963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb8fff0 0x55eb1eb90470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.866+0000 7f2eac896740 1 --2- 172.21.15.19:0/1182121963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb47a50 0x55eb1eb65d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.866+0000 7f2eac896740 1 --2- 172.21.15.19:0/1182121963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb462c0 0x55eb1eb92090 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.866+0000 7f2e827fc640 0 client.9990 ms_handle_reset on v2:172.21.15.19:6832/3065327567 2024-09-12T02:05:55.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.866+0000 7f2eac896740 1 -- 172.21.15.19:0/1182121963 >> 172.21.15.19:0/1182121963 conn(0x55eb1eb43a80 msgr2=0x55eb1eb89d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:55.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.866+0000 7f2eac896740 1 -- 172.21.15.19:0/1182121963 shutdown_connections 2024-09-12T02:05:55.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.866+0000 7f2eac896740 1 -- 172.21.15.19:0/1182121963 wait complete. 2024-09-12T02:05:55.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.867+0000 7f2eac896740 20 client.9990 trim_cache size 0 max 16384 2024-09-12T02:05:55.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.884+0000 7f2eac896740 1 Processor -- start 2024-09-12T02:05:55.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.884+0000 7f2eac896740 1 -- start start 2024-09-12T02:05:55.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.885+0000 7f2eac896740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb462c0 0x55eb1eb3bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.885+0000 7f2eac896740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb47a50 0x55eb1eb88ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.885+0000 7f2eac896740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb8fff0 0x55eb1eb89420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.885+0000 7f2eac896740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea4202010 con 0x55eb1eb47a50 2024-09-12T02:05:55.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.885+0000 7f2eac896740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea4201370 con 0x55eb1eb462c0 2024-09-12T02:05:55.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.885+0000 7f2eac896740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea42019c0 con 0x55eb1eb8fff0 2024-09-12T02:05:55.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.885+0000 7f2ea2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb47a50 0x55eb1eb88ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.885+0000 7f2ea2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb47a50 0x55eb1eb88ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55250/0 (socket says 172.21.15.19:55250) 2024-09-12T02:05:55.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.886+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/4138020860 learned_addr learned my addr 172.21.15.19:0/4138020860 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:55.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.886+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/4138020860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb462c0 0x55eb1eb3bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.886+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/4138020860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb8fff0 msgr2=0x55eb1eb89420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:55.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.886+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/4138020860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb8fff0 0x55eb1eb89420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.886+0000 7f2ea2ffd640 1 --2- 172.21.15.19:0/4138020860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb8fff0 0x55eb1eb89420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.886+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/4138020860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb462c0 msgr2=0x55eb1eb3bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:55.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.886+0000 7f2ea2ffd640 1 --2- 172.21.15.19:0/4138020860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb462c0 0x55eb1eb3bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.886+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/4138020860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb1eb6d200 con 0x55eb1eb47a50 2024-09-12T02:05:55.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.886+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/4138020860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb462c0 0x55eb1eb3bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:55.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.886+0000 7f2ea2ffd640 1 --2- 172.21.15.19:0/4138020860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb47a50 0x55eb1eb88ee0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f2e9802a2e0 tx=0x7f2e980a99d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4835b216d9a84eab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:55.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.886+0000 7f2e88ff9640 1 -- 172.21.15.19:0/4138020860 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e980823e0 con 0x55eb1eb47a50 2024-09-12T02:05:55.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.886+0000 7f2e88ff9640 1 -- 172.21.15.19:0/4138020860 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e98077950 con 0x55eb1eb47a50 2024-09-12T02:05:55.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.886+0000 7f2e88ff9640 1 -- 172.21.15.19:0/4138020860 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98077bb0 con 0x55eb1eb47a50 2024-09-12T02:05:55.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.887+0000 7f2eac896740 1 -- 172.21.15.19:0/4138020860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb47a50 msgr2=0x55eb1eb88ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:55.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.887+0000 7f2eac896740 1 --2- 172.21.15.19:0/4138020860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb47a50 0x55eb1eb88ee0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f2e9802a2e0 tx=0x7f2e980a99d0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.887+0000 7f2eac896740 1 -- 172.21.15.19:0/4138020860 shutdown_connections 2024-09-12T02:05:55.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.887+0000 7f2eac896740 1 --2- 172.21.15.19:0/4138020860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb8fff0 0x55eb1eb89420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.887+0000 7f2eac896740 1 --2- 172.21.15.19:0/4138020860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb47a50 0x55eb1eb88ee0 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.887+0000 7f2eac896740 1 --2- 172.21.15.19:0/4138020860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb462c0 0x55eb1eb3bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.887+0000 7f2eac896740 1 -- 172.21.15.19:0/4138020860 >> 172.21.15.19:0/4138020860 conn(0x55eb1eb43a80 msgr2=0x55eb1eb92210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:55.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.887+0000 7f2eac896740 1 -- 172.21.15.19:0/4138020860 shutdown_connections 2024-09-12T02:05:55.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.887+0000 7f2eac896740 1 -- 172.21.15.19:0/4138020860 wait complete. 2024-09-12T02:05:55.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.887+0000 7f2eac896740 1 -- start start 2024-09-12T02:05:55.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.887+0000 7f2eac896740 1 Processor -- start 2024-09-12T02:05:55.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.888+0000 7f2eac896740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb462c0 0x55eb1eb88ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.888+0000 7f2eac896740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb47a50 0x55eb1eb89420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.888+0000 7f2eac896740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb8fff0 0x55eb1eb87570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.888+0000 7f2eac896740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55eb1eb41510 con 0x55eb1eb47a50 2024-09-12T02:05:55.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.888+0000 7f2eac896740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55eb1eb706e0 con 0x55eb1eb462c0 2024-09-12T02:05:55.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.888+0000 7f2eac896740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55eb1eb40990 con 0x55eb1eb8fff0 2024-09-12T02:05:55.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.888+0000 7f2eac896740 10 client.0 _ll_register_callbacks cb 0x7f2e98009550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:05:55.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.888+0000 7f2ea2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb47a50 0x55eb1eb89420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.888+0000 7f2ea2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb47a50 0x55eb1eb89420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55264/0 (socket says 172.21.15.19:55264) 2024-09-12T02:05:55.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.888+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/2464553595 learned_addr learned my addr 172.21.15.19:0/2464553595 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:55.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.889+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/2464553595 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb8fff0 0x55eb1eb87570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.889+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/2464553595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb462c0 0x55eb1eb88ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.889+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/2464553595 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb8fff0 msgr2=0x55eb1eb87570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:55.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.889+0000 7f2ea2ffd640 1 --2- 172.21.15.19:0/2464553595 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb8fff0 0x55eb1eb87570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.889+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/2464553595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb462c0 msgr2=0x55eb1eb88ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:55.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.889+0000 7f2ea2ffd640 1 --2- 172.21.15.19:0/2464553595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb462c0 0x55eb1eb88ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.889+0000 7f2ea2ffd640 1 -- 172.21.15.19:0/2464553595 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb1eb6c670 con 0x55eb1eb47a50 2024-09-12T02:05:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.889+0000 7f2ea3fff640 1 --2- 172.21.15.19:0/2464553595 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb8fff0 0x55eb1eb87570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.889+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/2464553595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb462c0 0x55eb1eb88ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.889+0000 7f2ea2ffd640 1 --2- 172.21.15.19:0/2464553595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb47a50 0x55eb1eb89420 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f2e98006da0 tx=0x7f2e98008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe9d0955f59141 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.889+0000 7f2e827fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:05:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.889+0000 7f2e827fc640 1 -- 172.21.15.19:0/2464553595 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98096020 con 0x55eb1eb47a50 2024-09-12T02:05:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.889+0000 7f2e827fc640 1 -- 172.21.15.19:0/2464553595 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7f2e98097220 con 0x55eb1eb47a50 2024-09-12T02:05:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.889+0000 7f2eac896740 1 -- 172.21.15.19:0/2464553595 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e98077950 con 0x55eb1eb47a50 2024-09-12T02:05:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.889+0000 7f2e827fc640 1 -- 172.21.15.19:0/2464553595 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=280) ==== 24+0+0 (secure 0 0 0) 0x7f2e98075f20 con 0x55eb1eb47a50 2024-09-12T02:05:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.889+0000 7f2eac896740 10 client.9996 fetch_fsmap learned FSMap version 280 2024-09-12T02:05:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.889+0000 7f2eac896740 1 -- 172.21.15.19:0/2464553595 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=280,monmap=2+}) -- 0x55eb1eb41890 con 0x55eb1eb47a50 2024-09-12T02:05:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.889+0000 7f2e827fc640 1 -- 172.21.15.19:0/2464553595 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e98077950 con 0x55eb1eb47a50 2024-09-12T02:05:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.890+0000 7f2e827fc640 1 -- 172.21.15.19:0/2464553595 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 280) ==== 3502+0+0 (secure 0 0 0) 0x7f2e9803a030 con 0x55eb1eb47a50 2024-09-12T02:05:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.890+0000 7f2eac896740 10 client.9996 fetch_fsmap finished waiting for FSMap version 280 2024-09-12T02:05:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.890+0000 7f2eac896740 10 client.9996 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:05:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.890+0000 7f2eac896740 20 client.9996 populate_metadata read hostname 'smithi019' 2024-09-12T02:05:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.890+0000 7f2eac896740 1 --2- 172.21.15.19:0/2464553595 >> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] conn(0x55eb1eb87dd0 0x55eb1ec08ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.890+0000 7f2eac896740 4 client.9996 mds_command: new command op to 9939 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:05:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.890+0000 7f2eac896740 1 -- 172.21.15.19:0/2464553595 --> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] -- command(tid 0: {"prefix": "status"}) -- 0x55eb1eaaffa0 con 0x55eb1eb87dd0 2024-09-12T02:05:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.890+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/2464553595 >> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] conn(0x55eb1eb87dd0 0x55eb1ec08ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.890+0000 7f2e827fc640 10 client.9996 ms_handle_connect on v2:172.21.15.19:6832/3065327567 2024-09-12T02:05:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.890+0000 7f2ea37fe640 1 --2- 172.21.15.19:0/2464553595 >> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] conn(0x55eb1eb87dd0 0x55eb1ec08ca0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84891f20fa933608 server_cookie=4dc2b4b41cc1ae64 in_seq=0 out_seq=0 2024-09-12T02:05:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.890+0000 7f2e827fc640 1 -- 172.21.15.19:0/2464553595 <== mds.0 v2:172.21.15.19:6832/3065327567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x55eb1eaaffa0 con 0x55eb1eb87dd0 2024-09-12T02:05:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.890+0000 7f2e827fc640 10 client.9996 handle_command_reply: tid=0 2024-09-12T02:05:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.890+0000 7f2eac896740 1 client.9996 shutdown 2024-09-12T02:05:55.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2eac896740 1 -- 172.21.15.19:0/2464553595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb47a50 msgr2=0x55eb1eb89420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:55.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2eac896740 1 --2- 172.21.15.19:0/2464553595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb47a50 0x55eb1eb89420 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f2e98006da0 tx=0x7f2e98008040 comp rx=0 tx=0).stop 2024-09-12T02:05:55.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2eac896740 1 -- 172.21.15.19:0/2464553595 shutdown_connections 2024-09-12T02:05:55.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2eac896740 1 --2- 172.21.15.19:0/2464553595 >> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] conn(0x55eb1eb87dd0 0x55eb1ec08ca0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2eac896740 1 --2- 172.21.15.19:0/2464553595 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55eb1eb8fff0 0x55eb1eb87570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2eac896740 1 --2- 172.21.15.19:0/2464553595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eb1eb47a50 0x55eb1eb89420 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2e827fc640 0 client.9996 ms_handle_reset on v2:172.21.15.19:6832/3065327567 2024-09-12T02:05:55.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2eac896740 1 --2- 172.21.15.19:0/2464553595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb1eb462c0 0x55eb1eb88ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2eac896740 1 -- 172.21.15.19:0/2464553595 >> 172.21.15.19:0/2464553595 conn(0x55eb1eb43a80 msgr2=0x55eb1eb6f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:55.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2eac896740 1 -- 172.21.15.19:0/2464553595 shutdown_connections 2024-09-12T02:05:55.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2eac896740 1 -- 172.21.15.19:0/2464553595 wait complete. 2024-09-12T02:05:55.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2eac896740 20 client.9996 trim_cache size 0 max 16384 2024-09-12T02:05:55.899 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:05:55.899 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T02:05:55.899 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T02:05:55.900 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 9939, 2024-09-12T02:05:55.900 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T02:05:55.900 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T02:05:55.900 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T02:05:55.900 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 6.6751901800000004, 2024-09-12T02:05:55.901 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 280, 2024-09-12T02:05:55.901 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 127, 2024-09-12T02:05:55.901 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 127, 2024-09-12T02:05:55.901 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 7.9234780689999997 2024-09-12T02:05:55.901 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:05:55.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2ea9af8640 1 -- 172.21.15.19:0/337574326 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e9006be30 msgr2=0x7f2e9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:55.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2ea9af8640 1 --2- 172.21.15.19:0/337574326 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e9006be30 0x7f2e9006e2f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2e94007920 tx=0x7f2e94008040 comp rx=0 tx=0).stop 2024-09-12T02:05:55.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2ea9af8640 1 -- 172.21.15.19:0/337574326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea409b690 msgr2=0x7f2ea4160880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2ea9af8640 1 --2- 172.21.15.19:0/337574326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea409b690 0x7f2ea4160880 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f2e98000c00 tx=0x7f2e980046c0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2ea9af8640 1 -- 172.21.15.19:0/337574326 shutdown_connections 2024-09-12T02:05:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2ea9af8640 1 --2- 172.21.15.19:0/337574326 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e9006be30 0x7f2e9006e2f0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2ea9af8640 1 --2- 172.21.15.19:0/337574326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea415e740 0x7f2ea41f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2ea9af8640 1 --2- 172.21.15.19:0/337574326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ea409b690 0x7f2ea4160880 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2ea9af8640 1 --2- 172.21.15.19:0/337574326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ea406d4c0 0x7f2ea415d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2ea9af8640 1 -- 172.21.15.19:0/337574326 >> 172.21.15.19:0/337574326 conn(0x7f2ea40d23a0 msgr2=0x7f2ea40b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2ea9af8640 1 -- 172.21.15.19:0/337574326 shutdown_connections 2024-09-12T02:05:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:55.891+0000 7f2ea9af8640 1 -- 172.21.15.19:0/337574326 wait complete. 2024-09-12T02:05:55.907 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:05:55.908 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Corrupt omap key 1.00000000:subdir_head', proceeding to ls 2024-09-12T02:05:55.908 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:05:56.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.010+0000 7f4fe0a17640 1 Processor -- start 2024-09-12T02:05:56.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.010+0000 7f4fe0a17640 1 -- start start 2024-09-12T02:05:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.011+0000 7f4fe0a17640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fdc072320 0x7f4fdc0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.011+0000 7f4fe0a17640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4fdc15e1f0 0x7f4fdc06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.011+0000 7f4fe0a17640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fdc146140 con 0x7f4fdc072de0 2024-09-12T02:05:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.011+0000 7f4fe0a17640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f4fdc0cd740 con 0x7f4fdc15e1f0 2024-09-12T02:05:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.011+0000 7f4fe0a17640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4fdc0cda20 con 0x7f4fdc072320 2024-09-12T02:05:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.011+0000 7f4fdad9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4fdc15e1f0 0x7f4fdc06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.011+0000 7f4fdad9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4fdc15e1f0 0x7f4fdc06e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55266/0 (socket says 172.21.15.19:55266) 2024-09-12T02:05:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.011+0000 7f4fdad9d640 1 -- 172.21.15.19:0/1373475064 learned_addr learned my addr 172.21.15.19:0/1373475064 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.011+0000 7f4fda59c640 1 --2- 172.21.15.19:0/1373475064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fdc072320 0x7f4fdc0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.011+0000 7f4fdad9d640 1 -- 172.21.15.19:0/1373475064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fdc072320 msgr2=0x7f4fdc0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.011+0000 7f4fdad9d640 1 --2- 172.21.15.19:0/1373475064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fdc072320 0x7f4fdc0cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.011+0000 7f4fdad9d640 1 -- 172.21.15.19:0/1373475064 >> v1:172.21.15.135:6789/0 conn(0x7f4fdc072de0 legacy=0x7f4fdc06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.011+0000 7f4fdad9d640 1 -- 172.21.15.19:0/1373475064 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc0cdd00 con 0x7f4fdc15e1f0 2024-09-12T02:05:56.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.012+0000 7f4fdad9d640 1 --2- 172.21.15.19:0/1373475064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fdc15e1f0 0x7f4fdc06e7c0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4009e50 tx=0x7f4fd402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e88caf09364c01c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:56.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.012+0000 7f4fd959a640 1 -- 172.21.15.19:0/1373475064 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4036070 con 0x7f4fdc15e1f0 2024-09-12T02:05:56.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.012+0000 7f4fd959a640 1 -- 172.21.15.19:0/1373475064 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fd4031600 con 0x7f4fdc15e1f0 2024-09-12T02:05:56.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.012+0000 7f4fd959a640 1 -- 172.21.15.19:0/1373475064 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd40319d0 con 0x7f4fdc15e1f0 2024-09-12T02:05:56.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.013+0000 7f4fe0a17640 1 -- 172.21.15.19:0/1373475064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fdc15e1f0 msgr2=0x7f4fdc06e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:56.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.013+0000 7f4fe0a17640 1 --2- 172.21.15.19:0/1373475064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fdc15e1f0 0x7f4fdc06e7c0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4009e50 tx=0x7f4fd402a630 comp rx=0 tx=0).stop 2024-09-12T02:05:56.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.013+0000 7f4fe0a17640 1 -- 172.21.15.19:0/1373475064 shutdown_connections 2024-09-12T02:05:56.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.013+0000 7f4fe0a17640 1 --2- 172.21.15.19:0/1373475064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fdc15e1f0 0x7f4fdc06e7c0 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.013+0000 7f4fe0a17640 1 --2- 172.21.15.19:0/1373475064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fdc072320 0x7f4fdc0cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.013+0000 7f4fe0a17640 1 -- 172.21.15.19:0/1373475064 >> 172.21.15.19:0/1373475064 conn(0x7f4fdc067d70 msgr2=0x7f4fdc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:56.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.013+0000 7f4fe0a17640 1 -- 172.21.15.19:0/1373475064 shutdown_connections 2024-09-12T02:05:56.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.013+0000 7f4fe0a17640 1 -- 172.21.15.19:0/1373475064 wait complete. 2024-09-12T02:05:56.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.014+0000 7f4fe0a17640 1 Processor -- start 2024-09-12T02:05:56.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.014+0000 7f4fe0a17640 1 -- start start 2024-09-12T02:05:56.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.015+0000 7f4fe0a17640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fdc072320 0x7f4fdc1e6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:56.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.015+0000 7f4fe0a17640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fdc072de0 0x7f4fdc0c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:56.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.015+0000 7f4fe0a17640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fdc15e1f0 0x7f4fdc1f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:56.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.015+0000 7f4fe0a17640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc0cd520 con 0x7f4fdc072320 2024-09-12T02:05:56.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.015+0000 7f4fe0a17640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc0cd3a0 con 0x7f4fdc15e1f0 2024-09-12T02:05:56.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.015+0000 7f4fe0a17640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4fdc06ed00 con 0x7f4fdc072de0 2024-09-12T02:05:56.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.015+0000 7f4fda59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fdc072320 0x7f4fdc1e6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:56.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.015+0000 7f4fda59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fdc072320 0x7f4fdc1e6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55276/0 (socket says 172.21.15.19:55276) 2024-09-12T02:05:56.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.015+0000 7f4fda59c640 1 -- 172.21.15.19:0/1989609359 learned_addr learned my addr 172.21.15.19:0/1989609359 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:56.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.015+0000 7f4fd9d9b640 1 --2- 172.21.15.19:0/1989609359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fdc072de0 0x7f4fdc0c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:56.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.015+0000 7f4fda59c640 1 -- 172.21.15.19:0/1989609359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fdc072de0 msgr2=0x7f4fdc0c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:56.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.015+0000 7f4fdad9d640 1 --2- 172.21.15.19:0/1989609359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fdc15e1f0 0x7f4fdc1f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:56.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.015+0000 7f4fda59c640 1 --2- 172.21.15.19:0/1989609359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fdc072de0 0x7f4fdc0c7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.015+0000 7f4fda59c640 1 -- 172.21.15.19:0/1989609359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fdc15e1f0 msgr2=0x7f4fdc1f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:56.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.015+0000 7f4fda59c640 1 --2- 172.21.15.19:0/1989609359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fdc15e1f0 0x7f4fdc1f1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.015+0000 7f4fda59c640 1 -- 172.21.15.19:0/1989609359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc1e5880 con 0x7f4fdc072320 2024-09-12T02:05:56.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.015+0000 7f4fda59c640 1 --2- 172.21.15.19:0/1989609359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fdc072320 0x7f4fdc1e6920 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00c820 tx=0x7f4fcc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:56.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.016+0000 7f4fcaffd640 1 -- 172.21.15.19:0/1989609359 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc015070 con 0x7f4fdc072320 2024-09-12T02:05:56.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.016+0000 7f4fcaffd640 1 -- 172.21.15.19:0/1989609359 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fcc004020 con 0x7f4fdc072320 2024-09-12T02:05:56.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.016+0000 7f4fe0a17640 1 -- 172.21.15.19:0/1989609359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fdc1e5b60 con 0x7f4fdc072320 2024-09-12T02:05:56.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.016+0000 7f4fcaffd640 1 -- 172.21.15.19:0/1989609359 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc0043f0 con 0x7f4fdc072320 2024-09-12T02:05:56.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.016+0000 7f4fe0a17640 1 -- 172.21.15.19:0/1989609359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fdc1e6120 con 0x7f4fdc072320 2024-09-12T02:05:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.017+0000 7f4fe0a17640 1 -- 172.21.15.19:0/1989609359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fdc06c5f0 con 0x7f4fdc072320 2024-09-12T02:05:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.017+0000 7f4fcaffd640 1 -- 172.21.15.19:0/1989609359 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fcc007830 con 0x7f4fdc072320 2024-09-12T02:05:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.018+0000 7f4fcaffd640 1 --2- 172.21.15.19:0/1989609359 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4fbc06be60 0x7f4fbc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.018+0000 7f4fcaffd640 1 -- 172.21.15.19:0/1989609359 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7f4fcc08b900 con 0x7f4fdc072320 2024-09-12T02:05:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.018+0000 7f4fd9d9b640 1 --2- 172.21.15.19:0/1989609359 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4fbc06be60 0x7f4fbc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.018+0000 7f4fd9d9b640 1 --2- 172.21.15.19:0/1989609359 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4fbc06be60 0x7f4fbc06e320 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc0cd1d0 tx=0x7f4fd0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:56.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.022+0000 7f4fcaffd640 1 -- 172.21.15.19:0/1989609359 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4fdc06c5f0 con 0x7f4fdc072320 2024-09-12T02:05:56.090 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:05:56.092 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:05:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.236+0000 7f4fe0a17640 1 -- 172.21.15.19:0/1989609359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4fdc1e6e60 con 0x7f4fdc072320 2024-09-12T02:05:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.237+0000 7f4fcaffd640 1 -- 172.21.15.19:0/1989609359 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v280) ==== 53+0+73 (secure 0 0 0) 0x7f4fcc0595e0 con 0x7f4fdc072320 2024-09-12T02:05:56.238 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:05:56.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.239+0000 7f4fe0a17640 1 -- 172.21.15.19:0/1989609359 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4fbc06be60 msgr2=0x7f4fbc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:56.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.239+0000 7f4fe0a17640 1 --2- 172.21.15.19:0/1989609359 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4fbc06be60 0x7f4fbc06e320 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc0cd1d0 tx=0x7f4fd0009040 comp rx=0 tx=0).stop 2024-09-12T02:05:56.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.239+0000 7f4fe0a17640 1 -- 172.21.15.19:0/1989609359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fdc072320 msgr2=0x7f4fdc1e6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.239+0000 7f4fe0a17640 1 --2- 172.21.15.19:0/1989609359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fdc072320 0x7f4fdc1e6920 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00c820 tx=0x7f4fcc00cce0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.239+0000 7f4fe0a17640 1 -- 172.21.15.19:0/1989609359 shutdown_connections 2024-09-12T02:05:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.239+0000 7f4fe0a17640 1 --2- 172.21.15.19:0/1989609359 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4fbc06be60 0x7f4fbc06e320 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.239+0000 7f4fe0a17640 1 --2- 172.21.15.19:0/1989609359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fdc15e1f0 0x7f4fdc1f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.239+0000 7f4fe0a17640 1 --2- 172.21.15.19:0/1989609359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fdc072de0 0x7f4fdc0c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.239+0000 7f4fe0a17640 1 --2- 172.21.15.19:0/1989609359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fdc072320 0x7f4fdc1e6920 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.239+0000 7f4fe0a17640 1 -- 172.21.15.19:0/1989609359 >> 172.21.15.19:0/1989609359 conn(0x7f4fdc067d70 msgr2=0x7f4fdc06e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.239+0000 7f4fe0a17640 1 -- 172.21.15.19:0/1989609359 shutdown_connections 2024-09-12T02:05:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56.239+0000 7f4fe0a17640 1 -- 172.21.15.19:0/1989609359 wait complete. 2024-09-12T02:05:56.250 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:05:56.250 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:05:56.251 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T02:05:56.251 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:05:56.251 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:05:56.251 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:05:56.251 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:05:56.251 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:05:56.251 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:05:56.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:56.251 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T02:05:56.267 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:05:56.268 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:05:56.268 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:05:56.268 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:56.268 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T02:05:56.268 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:56.268 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:05:56.268 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:05:56.268 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T02:05:56.268 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:05:56.268 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:05:56.268 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T02:05:56.268 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:05:56.269 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:05:56.269 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T02:05:56.269 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:05:56.269 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42204sec preferred_lft 42204sec 2024-09-12T02:05:56.269 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T02:05:56.269 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:56.269 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:05:56.269 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:05:56.269 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T02:05:56.269 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:05:56.269 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T02:05:56.269 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:05:56.269 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:56.270 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T02:05:56.270 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:56.270 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:05:56.270 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:05:56.270 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T02:05:56.270 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:56.270 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:05:56.270 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:05:56.270 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T02:05:56.270 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:05:56.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:56.270 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:05:56.333 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T02:05:56.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:56.335 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T02:05:56.392 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T02:05:56.392 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:05:56.392 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:05:56.392 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:05:56.392 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:05:56.392 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:05:56.393 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T02:05:56.393 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:05:56.393 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:05:56.393 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:05:56.393 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T02:05:56.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:05:56.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:05:56.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:56.523 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T02:05:56.545 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:05:56.545 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:05:56.545 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:05:56.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:56.546 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T02:05:56.613 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:05:56.614 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:05:56.672 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:05:56.672 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:05:56.672 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:05:56.728 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:05:56.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:56.728 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:05:56.813 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:05:56.813 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:05:56.813 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:05:56.822 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:05:56.822 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:05:56.822 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:05:56.822 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:05:56.822 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:05:56.827 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:05:56.827 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:05:56.827 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:05:56.827 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:05:56.828 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:05:56.828 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T02:05:56.828 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T02:05:56.828 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T02:05:56.828 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:05:56.828 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:05:56.829 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:05:56.829 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:05:56.829 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:05:56.830 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:05:56.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:56.830 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:05:56.855 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:05:56.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:05:56.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:05:56.952 INFO:teuthology.orchestra.run.smithi019.stdout:client10005 2024-09-12T02:05:56.952 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:05:56.953 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:05:56.969 DEBUG:teuthology.orchestra.run.smithi019:> stdin-killer -- python3 -c ' 2024-09-12T02:05:56.969 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-09-12T02:05:56.969 DEBUG:teuthology.orchestra.run.smithi019:> import stat 2024-09-12T02:05:56.969 DEBUG:teuthology.orchestra.run.smithi019:> import json 2024-09-12T02:05:56.969 DEBUG:teuthology.orchestra.run.smithi019:> import sys 2024-09-12T02:05:56.970 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T02:05:56.970 DEBUG:teuthology.orchestra.run.smithi019:> try: 2024-09-12T02:05:56.970 DEBUG:teuthology.orchestra.run.smithi019:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/./subdir'"'"') 2024-09-12T02:05:56.970 DEBUG:teuthology.orchestra.run.smithi019:> except OSError as e: 2024-09-12T02:05:56.970 DEBUG:teuthology.orchestra.run.smithi019:> sys.exit(e.errno) 2024-09-12T02:05:56.970 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T02:05:56.970 DEBUG:teuthology.orchestra.run.smithi019:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-12T02:05:56.970 DEBUG:teuthology.orchestra.run.smithi019:> print(json.dumps( 2024-09-12T02:05:56.970 DEBUG:teuthology.orchestra.run.smithi019:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-12T02:05:56.970 DEBUG:teuthology.orchestra.run.smithi019:> indent=2)) 2024-09-12T02:05:56.970 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-09-12T02:05:57.012 INFO:teuthology.orchestra.run:waiting for 20 2024-09-12T02:05:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57 stdin-killer INFO: command exited with status 5: exiting normally with same code! 2024-09-12T02:05:57.086 DEBUG:teuthology.orchestra.run:got remote process result: 5 2024-09-12T02:05:57.087 INFO:tasks.cephfs.test_damage:Result: EIO on client 2024-09-12T02:05:57.087 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:05:57.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.229+0000 7f3de3684640 1 Processor -- start 2024-09-12T02:05:57.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.229+0000 7f3de3684640 1 -- start start 2024-09-12T02:05:57.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.230+0000 7f3de3684640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3ddc09b140 0x7f3ddc169570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.230+0000 7f3de3684640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ddc06cec0 con 0x7f3ddc06df60 2024-09-12T02:05:57.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.230+0000 7f3de3684640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ddc06d1a0 con 0x7f3ddc15e5d0 2024-09-12T02:05:57.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.230+0000 7f3de3684640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f3ddc06dad0 con 0x7f3ddc09b140 2024-09-12T02:05:57.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.230+0000 7f3de0c1f640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3ddc06df60 0x7f3ddc09aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58382/0 (socket says 172.21.15.19:58382) 2024-09-12T02:05:57.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.230+0000 7f3de0c1f640 1 -- 172.21.15.19:0/840184795 learned_addr learned my addr 172.21.15.19:0/840184795 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:57.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.230+0000 7f3dd3fff640 1 -- 172.21.15.19:0/840184795 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2396046758 0 0) 0x7f3ddc06cec0 con 0x7f3ddc06df60 2024-09-12T02:05:57.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.230+0000 7f3dd3fff640 1 -- 172.21.15.19:0/840184795 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dc8003520 con 0x7f3ddc06df60 2024-09-12T02:05:57.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.230+0000 7f3de1c21640 1 --2- 172.21.15.19:0/840184795 >> v2:172.21.15.135:3300/0 conn(0x7f3ddc09b140 0x7f3ddc169570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.230+0000 7f3dd3fff640 1 -- 172.21.15.19:0/840184795 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1342501242 0 0) 0x7f3dc8003520 con 0x7f3ddc06df60 2024-09-12T02:05:57.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.230+0000 7f3dd3fff640 1 -- 172.21.15.19:0/840184795 >> v2:172.21.15.135:3300/0 conn(0x7f3ddc09b140 msgr2=0x7f3ddc169570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:57.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.230+0000 7f3dd3fff640 1 --2- 172.21.15.19:0/840184795 >> v2:172.21.15.135:3300/0 conn(0x7f3ddc09b140 0x7f3ddc169570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.230+0000 7f3dd3fff640 1 -- 172.21.15.19:0/840184795 >> v1:172.21.15.135:6789/0 conn(0x7f3ddc15e5d0 legacy=0x7f3ddc0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.230+0000 7f3dd3fff640 1 -- 172.21.15.19:0/840184795 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ddc06d480 con 0x7f3ddc06df60 2024-09-12T02:05:57.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.230+0000 7f3dd3fff640 1 -- 172.21.15.19:0/840184795 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f3dcc001670 con 0x7f3ddc06df60 2024-09-12T02:05:57.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.230+0000 7f3dd3fff640 1 -- 172.21.15.19:0/840184795 >> v1:172.21.15.19:6789/0 conn(0x7f3ddc06df60 legacy=0x7f3ddc09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.230+0000 7f3dd3fff640 1 --2- 172.21.15.19:0/840184795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dc80039e0 0x7f3dc8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.231+0000 7f3dd3fff640 1 --2- 172.21.15.19:0/840184795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dc8004800 0x7f3dc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.231+0000 7f3dd3fff640 1 --2- 172.21.15.19:0/840184795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3dc80051c0 0x7f3dc800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.231+0000 7f3dd3fff640 1 -- 172.21.15.19:0/840184795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc06dad0 con 0x7f3dc80039e0 2024-09-12T02:05:57.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.231+0000 7f3dd3fff640 1 -- 172.21.15.19:0/840184795 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc800c070 con 0x7f3dc8004800 2024-09-12T02:05:57.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.231+0000 7f3dd3fff640 1 -- 172.21.15.19:0/840184795 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3dc800c270 con 0x7f3dc80051c0 2024-09-12T02:05:57.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.231+0000 7f3de1420640 1 --2- 172.21.15.19:0/840184795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dc80039e0 0x7f3dc8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.231+0000 7f3de0c1f640 1 --2- 172.21.15.19:0/840184795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dc8004800 0x7f3dc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.231+0000 7f3de1c21640 1 --2- 172.21.15.19:0/840184795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3dc80051c0 0x7f3dc800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.231+0000 7f3de1420640 1 -- 172.21.15.19:0/840184795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3dc80051c0 msgr2=0x7f3dc800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.231+0000 7f3de1420640 1 --2- 172.21.15.19:0/840184795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3dc80051c0 0x7f3dc800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.231+0000 7f3de1420640 1 -- 172.21.15.19:0/840184795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dc8004800 msgr2=0x7f3dc8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.231+0000 7f3de1420640 1 --2- 172.21.15.19:0/840184795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dc8004800 0x7f3dc8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.231+0000 7f3de1420640 1 -- 172.21.15.19:0/840184795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc8003520 con 0x7f3dc80039e0 2024-09-12T02:05:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.231+0000 7f3de1c21640 1 --2- 172.21.15.19:0/840184795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3dc80051c0 0x7f3dc800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.231+0000 7f3de1c21640 1 -- 172.21.15.19:0/840184795 reap_dead start 2024-09-12T02:05:57.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.232+0000 7f3de1420640 1 --2- 172.21.15.19:0/840184795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dc80039e0 0x7f3dc8003e00 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8001750 tx=0x7f3dc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a872db5cf776b9dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:57.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.232+0000 7f3dd3fff640 1 -- 172.21.15.19:0/840184795 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8001370 con 0x7f3dc80039e0 2024-09-12T02:05:57.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.232+0000 7f3dd3fff640 1 -- 172.21.15.19:0/840184795 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dd80052d0 con 0x7f3dc80039e0 2024-09-12T02:05:57.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.232+0000 7f3dd3fff640 1 -- 172.21.15.19:0/840184795 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd802abc0 con 0x7f3dc80039e0 2024-09-12T02:05:57.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.232+0000 7f3de3684640 1 -- 172.21.15.19:0/840184795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dc80039e0 msgr2=0x7f3dc8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.232+0000 7f3de3684640 1 --2- 172.21.15.19:0/840184795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dc80039e0 0x7f3dc8003e00 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8001750 tx=0x7f3dc8005830 comp rx=0 tx=0).stop 2024-09-12T02:05:57.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.232+0000 7f3de3684640 1 -- 172.21.15.19:0/840184795 shutdown_connections 2024-09-12T02:05:57.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.232+0000 7f3de3684640 1 --2- 172.21.15.19:0/840184795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dc80039e0 0x7f3dc8003e00 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.232+0000 7f3de3684640 1 -- 172.21.15.19:0/840184795 >> 172.21.15.19:0/840184795 conn(0x7f3ddc0d23a0 msgr2=0x7f3ddc0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:57.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.232+0000 7f3de3684640 1 -- 172.21.15.19:0/840184795 shutdown_connections 2024-09-12T02:05:57.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.233+0000 7f3de3684640 1 -- 172.21.15.19:0/840184795 wait complete. 2024-09-12T02:05:57.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.234+0000 7f3de3684640 1 Processor -- start 2024-09-12T02:05:57.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.234+0000 7f3de3684640 1 -- start start 2024-09-12T02:05:57.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.234+0000 7f3de3684640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dc80039e0 0x7f3ddc1f7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.234+0000 7f3de3684640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ddc0c5f70 0x7f3ddc0b6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3de3684640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ddc071350 0x7f3ddc071800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3de3684640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc15eb30 con 0x7f3dc80039e0 2024-09-12T02:05:57.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3de3684640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc15e9b0 con 0x7f3ddc0c5f70 2024-09-12T02:05:57.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3de3684640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3ddc09aa30 con 0x7f3ddc071350 2024-09-12T02:05:57.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3de1420640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dc80039e0 0x7f3ddc1f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3de1420640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dc80039e0 0x7f3ddc1f7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55290/0 (socket says 172.21.15.19:55290) 2024-09-12T02:05:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3de1420640 1 -- 172.21.15.19:0/1946637571 learned_addr learned my addr 172.21.15.19:0/1946637571 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3de0c1f640 1 --2- 172.21.15.19:0/1946637571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ddc0c5f70 0x7f3ddc0b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3de1c21640 1 --2- 172.21.15.19:0/1946637571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ddc071350 0x7f3ddc071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3de1420640 1 -- 172.21.15.19:0/1946637571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ddc071350 msgr2=0x7f3ddc071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3de1420640 1 --2- 172.21.15.19:0/1946637571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ddc071350 0x7f3ddc071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3de1420640 1 -- 172.21.15.19:0/1946637571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ddc0c5f70 msgr2=0x7f3ddc0b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3de1420640 1 --2- 172.21.15.19:0/1946637571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ddc0c5f70 0x7f3ddc0b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3de1420640 1 -- 172.21.15.19:0/1946637571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ddc0b7190 con 0x7f3dc80039e0 2024-09-12T02:05:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3de1c21640 1 --2- 172.21.15.19:0/1946637571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ddc071350 0x7f3ddc071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3de1420640 1 --2- 172.21.15.19:0/1946637571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dc80039e0 0x7f3ddc1f7470 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8001870 tx=0x7f3dd8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3dd1ffb640 1 -- 172.21.15.19:0/1946637571 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd803f030 con 0x7f3dc80039e0 2024-09-12T02:05:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3dd1ffb640 1 -- 172.21.15.19:0/1946637571 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dd8005480 con 0x7f3dc80039e0 2024-09-12T02:05:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3de3684640 1 -- 172.21.15.19:0/1946637571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ddc0b7470 con 0x7f3dc80039e0 2024-09-12T02:05:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.235+0000 7f3dd1ffb640 1 -- 172.21.15.19:0/1946637571 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8037040 con 0x7f3dc80039e0 2024-09-12T02:05:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.236+0000 7f3de3684640 1 -- 172.21.15.19:0/1946637571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ddc0b7a30 con 0x7f3dc80039e0 2024-09-12T02:05:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.236+0000 7f3de3684640 1 -- 172.21.15.19:0/1946637571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ddc09ae20 con 0x7f3dc80039e0 2024-09-12T02:05:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.237+0000 7f3dd1ffb640 1 -- 172.21.15.19:0/1946637571 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3dd8042070 con 0x7f3dc80039e0 2024-09-12T02:05:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.238+0000 7f3dd1ffb640 1 --2- 172.21.15.19:0/1946637571 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3dc006be30 0x7f3dc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.238+0000 7f3dd1ffb640 1 -- 172.21.15.19:0/1946637571 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7f3dd80ab200 con 0x7f3dc80039e0 2024-09-12T02:05:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.238+0000 7f3de0c1f640 1 --2- 172.21.15.19:0/1946637571 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3dc006be30 0x7f3dc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.238+0000 7f3de0c1f640 1 --2- 172.21.15.19:0/1946637571 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3dc006be30 0x7f3dc006e2f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc000fb0 tx=0x7f3dcc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:57.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.242+0000 7f3dd1ffb640 1 -- 172.21.15.19:0/1946637571 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3dd8078dc0 con 0x7f3dc80039e0 2024-09-12T02:05:57.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.456+0000 7f3de3684640 1 -- 172.21.15.19:0/1946637571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ddc0b8320 con 0x7f3dc80039e0 2024-09-12T02:05:57.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.456+0000 7f3dd1ffb640 1 -- 172.21.15.19:0/1946637571 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 280 v280) ==== 95+0+5234 (secure 0 0 0) 0x7f3dd80786c0 con 0x7f3dc80039e0 2024-09-12T02:05:57.457 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:57.457 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":280,"btime":"2024-09-12T02:05:55:285473+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":280,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:05:55.224267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":127,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9939":{"gid":9939,"name":"c","rank":0,"incarnation":276,"state":"up:active","state_seq":5,"addr":"172.21.15.19:6834/3065327567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3065327567},{"type":"v1","addr":"172.21.15.19:6834","nonce":3065327567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9939,"qdb_cluster":[9939]},"id":6}]} 2024-09-12T02:05:57.457 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 280 2024-09-12T02:05:57.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.459+0000 7f3de3684640 1 -- 172.21.15.19:0/1946637571 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3dc006be30 msgr2=0x7f3dc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.459+0000 7f3de3684640 1 --2- 172.21.15.19:0/1946637571 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3dc006be30 0x7f3dc006e2f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc000fb0 tx=0x7f3dcc009040 comp rx=0 tx=0).stop 2024-09-12T02:05:57.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.459+0000 7f3de3684640 1 -- 172.21.15.19:0/1946637571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dc80039e0 msgr2=0x7f3ddc1f7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.459+0000 7f3de3684640 1 --2- 172.21.15.19:0/1946637571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dc80039e0 0x7f3ddc1f7470 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8001870 tx=0x7f3dd8001120 comp rx=0 tx=0).stop 2024-09-12T02:05:57.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.459+0000 7f3de3684640 1 -- 172.21.15.19:0/1946637571 shutdown_connections 2024-09-12T02:05:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.459+0000 7f3de3684640 1 --2- 172.21.15.19:0/1946637571 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3dc006be30 0x7f3dc006e2f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.459+0000 7f3de3684640 1 --2- 172.21.15.19:0/1946637571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ddc071350 0x7f3ddc071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.459+0000 7f3de3684640 1 --2- 172.21.15.19:0/1946637571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ddc0c5f70 0x7f3ddc0b6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.459+0000 7f3de3684640 1 --2- 172.21.15.19:0/1946637571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dc80039e0 0x7f3ddc1f7470 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.459+0000 7f3de3684640 1 -- 172.21.15.19:0/1946637571 >> 172.21.15.19:0/1946637571 conn(0x7f3ddc0d23a0 msgr2=0x7f3ddc09b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.459+0000 7f3de3684640 1 -- 172.21.15.19:0/1946637571 shutdown_connections 2024-09-12T02:05:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.459+0000 7f3de3684640 1 -- 172.21.15.19:0/1946637571 wait complete. 2024-09-12T02:05:57.470 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-09-12T02:05:57.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.574+0000 7f661dedd640 1 Processor -- start 2024-09-12T02:05:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.574+0000 7f661dedd640 1 -- start start 2024-09-12T02:05:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.574+0000 7f661dedd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6618162340 0x7f661806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.574+0000 7f661dedd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f661815ff70 con 0x7f6618162e30 2024-09-12T02:05:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.575+0000 7f661dedd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66180d4d10 con 0x7f66180cf280 2024-09-12T02:05:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.575+0000 7f661dedd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f66181632a0 con 0x7f6618162340 2024-09-12T02:05:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.575+0000 7f66177fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6618162340 0x7f661806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.575+0000 7f66177fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6618162340 0x7f661806d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55294/0 (socket says 172.21.15.19:55294) 2024-09-12T02:05:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.575+0000 7f66177fe640 1 -- 172.21.15.19:0/4212755781 learned_addr learned my addr 172.21.15.19:0/4212755781 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.575+0000 7f66177fe640 1 -- 172.21.15.19:0/4212755781 >> v1:172.21.15.135:6789/0 conn(0x7f66180cf280 legacy=0x7f6618162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.575+0000 7f66177fe640 1 -- 172.21.15.19:0/4212755781 >> v1:172.21.15.19:6789/0 conn(0x7f6618162e30 legacy=0x7f66180d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.575+0000 7f66177fe640 1 -- 172.21.15.19:0/4212755781 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66180d4ff0 con 0x7f6618162340 2024-09-12T02:05:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.576+0000 7f66177fe640 1 --2- 172.21.15.19:0/4212755781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6618162340 0x7f661806d740 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f6608009870 tx=0x7f660802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e87a89dfea7141 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.576+0000 7f6616ffd640 1 -- 172.21.15.19:0/4212755781 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608037070 con 0x7f6618162340 2024-09-12T02:05:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.576+0000 7f6616ffd640 1 -- 172.21.15.19:0/4212755781 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6608032440 con 0x7f6618162340 2024-09-12T02:05:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.576+0000 7f6616ffd640 1 -- 172.21.15.19:0/4212755781 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608032810 con 0x7f6618162340 2024-09-12T02:05:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.576+0000 7f661dedd640 1 -- 172.21.15.19:0/4212755781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6618162340 msgr2=0x7f661806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.576+0000 7f661dedd640 1 --2- 172.21.15.19:0/4212755781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6618162340 0x7f661806d740 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f6608009870 tx=0x7f660802a210 comp rx=0 tx=0).stop 2024-09-12T02:05:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.576+0000 7f661dedd640 1 -- 172.21.15.19:0/4212755781 shutdown_connections 2024-09-12T02:05:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.576+0000 7f661dedd640 1 --2- 172.21.15.19:0/4212755781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6618162340 0x7f661806d740 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.576+0000 7f661dedd640 1 -- 172.21.15.19:0/4212755781 >> 172.21.15.19:0/4212755781 conn(0x7f661808bfc0 msgr2=0x7f66180d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.576+0000 7f661dedd640 1 -- 172.21.15.19:0/4212755781 shutdown_connections 2024-09-12T02:05:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.576+0000 7f661dedd640 1 -- 172.21.15.19:0/4212755781 wait complete. 2024-09-12T02:05:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.578+0000 7f661dedd640 1 Processor -- start 2024-09-12T02:05:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.578+0000 7f661dedd640 1 -- start start 2024-09-12T02:05:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.578+0000 7f661dedd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66180cf280 0x7f66180b84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.578+0000 7f661dedd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6618162340 0x7f66180b9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f661dedd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6618162e30 0x7f66180ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f661dedd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f66180d52d0 con 0x7f66180cf280 2024-09-12T02:05:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f661dedd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f661806de90 con 0x7f6618162340 2024-09-12T02:05:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f661dedd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f66180cf6c0 con 0x7f6618162e30 2024-09-12T02:05:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f66177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66180cf280 0x7f66180b84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f66177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66180cf280 0x7f66180b84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55302/0 (socket says 172.21.15.19:55302) 2024-09-12T02:05:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f66177fe640 1 -- 172.21.15.19:0/2596463532 learned_addr learned my addr 172.21.15.19:0/2596463532 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f660effd640 1 --2- 172.21.15.19:0/2596463532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6618162340 0x7f66180b9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f6617fff640 1 --2- 172.21.15.19:0/2596463532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6618162e30 0x7f66180ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f66177fe640 1 -- 172.21.15.19:0/2596463532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6618162e30 msgr2=0x7f66180ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f66177fe640 1 --2- 172.21.15.19:0/2596463532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6618162e30 0x7f66180ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f66177fe640 1 -- 172.21.15.19:0/2596463532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6618162340 msgr2=0x7f66180b9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f66177fe640 1 --2- 172.21.15.19:0/2596463532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6618162340 0x7f66180b9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f66177fe640 1 -- 172.21.15.19:0/2596463532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66180c98b0 con 0x7f66180cf280 2024-09-12T02:05:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f660effd640 1 --2- 172.21.15.19:0/2596463532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6618162340 0x7f66180b9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f66177fe640 1 --2- 172.21.15.19:0/2596463532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66180cf280 0x7f66180b84e0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f6608009870 tx=0x7f66080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f6614ff9640 1 -- 172.21.15.19:0/2596463532 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608041070 con 0x7f66180cf280 2024-09-12T02:05:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f6614ff9640 1 -- 172.21.15.19:0/2596463532 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660803c870 con 0x7f66180cf280 2024-09-12T02:05:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f661dedd640 1 -- 172.21.15.19:0/2596463532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66180c9b90 con 0x7f66180cf280 2024-09-12T02:05:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f6614ff9640 1 -- 172.21.15.19:0/2596463532 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608037040 con 0x7f66180cf280 2024-09-12T02:05:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.579+0000 7f661dedd640 1 -- 172.21.15.19:0/2596463532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66180ca150 con 0x7f66180cf280 2024-09-12T02:05:57.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.581+0000 7f6614ff9640 1 -- 172.21.15.19:0/2596463532 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6608044070 con 0x7f66180cf280 2024-09-12T02:05:57.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.581+0000 7f6614ff9640 1 --2- 172.21.15.19:0/2596463532 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f65f806be30 0x7f65f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.582+0000 7f6614ff9640 1 -- 172.21.15.19:0/2596463532 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7f66080ac950 con 0x7f66180cf280 2024-09-12T02:05:57.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.582+0000 7f660effd640 1 --2- 172.21.15.19:0/2596463532 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f65f806be30 0x7f65f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.582+0000 7f6620c7c740 1 Processor -- start 2024-09-12T02:05:57.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.582+0000 7f6620c7c740 1 -- start start 2024-09-12T02:05:57.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.583+0000 7f660effd640 1 --2- 172.21.15.19:0/2596463532 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f65f806be30 0x7f65f806e2f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f66180c7c90 tx=0x7f6600009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:57.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.583+0000 7f6620c7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736ff00 0x55e8a73702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.583+0000 7f6620c7c740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736d6c0 0x55e8a736f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.583+0000 7f6620c7c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a736db20 0x55e8a734fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.583+0000 7f6620c7c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e8a728c930 con 0x55e8a736db20 2024-09-12T02:05:57.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.583+0000 7f6620c7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e8a7234570 con 0x55e8a736ff00 2024-09-12T02:05:57.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.583+0000 7f6620c7c740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55e8a72888f0 con 0x55e8a736d6c0 2024-09-12T02:05:57.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.583+0000 7f6617fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a736db20 0x55e8a734fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.583+0000 7f6617fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a736db20 0x55e8a734fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55308/0 (socket says 172.21.15.19:55308) 2024-09-12T02:05:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.583+0000 7f6617fff640 1 -- 172.21.15.19:0/3834955459 learned_addr learned my addr 172.21.15.19:0/3834955459 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.583+0000 7f66177fe640 1 --2- 172.21.15.19:0/3834955459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736ff00 0x55e8a73702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.584+0000 7f660effd640 1 --2- 172.21.15.19:0/3834955459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736d6c0 0x55e8a736f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.584+0000 7f6617fff640 1 -- 172.21.15.19:0/3834955459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736d6c0 msgr2=0x55e8a736f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.584+0000 7f6617fff640 1 --2- 172.21.15.19:0/3834955459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736d6c0 0x55e8a736f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.584+0000 7f6617fff640 1 -- 172.21.15.19:0/3834955459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736ff00 msgr2=0x55e8a73702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.584+0000 7f6617fff640 1 --2- 172.21.15.19:0/3834955459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736ff00 0x55e8a73702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.584+0000 7f6617fff640 1 -- 172.21.15.19:0/3834955459 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8a7249200 con 0x55e8a736db20 2024-09-12T02:05:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.584+0000 7f66177fe640 1 --2- 172.21.15.19:0/3834955459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736ff00 0x55e8a73702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.584+0000 7f6617fff640 1 --2- 172.21.15.19:0/3834955459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a736db20 0x55e8a734fe80 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f6610001ba0 tx=0x7f6610002060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952a719f566bdb28 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.584+0000 7f660d7fa640 1 -- 172.21.15.19:0/3834955459 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6610019070 con 0x55e8a736db20 2024-09-12T02:05:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.584+0000 7f660d7fa640 1 -- 172.21.15.19:0/3834955459 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6610003b80 con 0x55e8a736db20 2024-09-12T02:05:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.584+0000 7f660d7fa640 1 -- 172.21.15.19:0/3834955459 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661000e800 con 0x55e8a736db20 2024-09-12T02:05:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.585+0000 7f6620c7c740 1 -- 172.21.15.19:0/3834955459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a736db20 msgr2=0x55e8a734fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.585+0000 7f6620c7c740 1 --2- 172.21.15.19:0/3834955459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a736db20 0x55e8a734fe80 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f6610001ba0 tx=0x7f6610002060 comp rx=0 tx=0).stop 2024-09-12T02:05:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.585+0000 7f6620c7c740 1 -- 172.21.15.19:0/3834955459 shutdown_connections 2024-09-12T02:05:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.585+0000 7f6620c7c740 1 --2- 172.21.15.19:0/3834955459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a736db20 0x55e8a734fe80 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.585+0000 7f6620c7c740 1 --2- 172.21.15.19:0/3834955459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736d6c0 0x55e8a736f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.585+0000 7f6620c7c740 1 --2- 172.21.15.19:0/3834955459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736ff00 0x55e8a73702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.585+0000 7f6620c7c740 1 -- 172.21.15.19:0/3834955459 >> 172.21.15.19:0/3834955459 conn(0x55e8a7325df0 msgr2=0x55e8a736df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.585+0000 7f6620c7c740 1 -- 172.21.15.19:0/3834955459 shutdown_connections 2024-09-12T02:05:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.585+0000 7f6620c7c740 1 -- 172.21.15.19:0/3834955459 wait complete. 2024-09-12T02:05:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.585+0000 7f6620c7c740 1 -- start start 2024-09-12T02:05:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.585+0000 7f6620c7c740 1 Processor -- start 2024-09-12T02:05:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.586+0000 7f6620c7c740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736db20 0x55e8a7350f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.586+0000 7f6620c7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736ff00 0x55e8a734d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.586+0000 7f6620c7c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 0x55e8a7353260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.586+0000 7f6620c7c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e8a736c620 con 0x55e8a734dad0 2024-09-12T02:05:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.586+0000 7f6620c7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e8a72156a0 con 0x55e8a736ff00 2024-09-12T02:05:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.586+0000 7f6620c7c740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55e8a736c900 con 0x55e8a736db20 2024-09-12T02:05:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.586+0000 7f6620c7c740 10 client.0 _ll_register_callbacks cb 0x55e8a724d300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:05:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.586+0000 7f6617fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 0x55e8a7353260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.586+0000 7f6617fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 0x55e8a7353260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55320/0 (socket says 172.21.15.19:55320) 2024-09-12T02:05:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.586+0000 7f6617fff640 1 -- 172.21.15.19:0/3499770809 learned_addr learned my addr 172.21.15.19:0/3499770809 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f66177fe640 1 --2- 172.21.15.19:0/3499770809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736db20 0x55e8a7350f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f660effd640 1 --2- 172.21.15.19:0/3499770809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736ff00 0x55e8a734d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f6617fff640 1 -- 172.21.15.19:0/3499770809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736db20 msgr2=0x55e8a7350f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f6617fff640 1 --2- 172.21.15.19:0/3499770809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736db20 0x55e8a7350f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f6617fff640 1 -- 172.21.15.19:0/3499770809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736ff00 msgr2=0x55e8a734d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f6617fff640 1 --2- 172.21.15.19:0/3499770809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736ff00 0x55e8a734d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f6617fff640 1 -- 172.21.15.19:0/3499770809 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8a706b7c0 con 0x55e8a734dad0 2024-09-12T02:05:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f6617fff640 1 --2- 172.21.15.19:0/3499770809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 0x55e8a7353260 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f66100012e0 tx=0x7f6610001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc68db203e741969 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f65f67fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:05:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f65f67fc640 1 -- 172.21.15.19:0/3499770809 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6610022060 con 0x55e8a734dad0 2024-09-12T02:05:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f6620c7c740 1 -- 172.21.15.19:0/3499770809 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6610003b80 con 0x55e8a734dad0 2024-09-12T02:05:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f65f67fc640 1 -- 172.21.15.19:0/3499770809 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7f6610006d50 con 0x55e8a734dad0 2024-09-12T02:05:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f65f67fc640 1 -- 172.21.15.19:0/3499770809 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=280) ==== 24+0+0 (secure 0 0 0) 0x7f6610029050 con 0x55e8a734dad0 2024-09-12T02:05:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f6620c7c740 10 client.10026 fetch_fsmap learned FSMap version 280 2024-09-12T02:05:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f6620c7c740 1 -- 172.21.15.19:0/3499770809 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=280,monmap=2+}) -- 0x55e8a70cbf50 con 0x55e8a734dad0 2024-09-12T02:05:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f65f67fc640 1 -- 172.21.15.19:0/3499770809 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6610003b80 con 0x55e8a734dad0 2024-09-12T02:05:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f65f67fc640 1 -- 172.21.15.19:0/3499770809 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 280) ==== 3502+0+0 (secure 0 0 0) 0x7f661000e800 con 0x55e8a734dad0 2024-09-12T02:05:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f6620c7c740 10 client.10026 fetch_fsmap finished waiting for FSMap version 280 2024-09-12T02:05:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f6620c7c740 10 client.10026 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:05:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f6620c7c740 20 client.10026 populate_metadata read hostname 'smithi019' 2024-09-12T02:05:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f6620c7c740 1 --2- 172.21.15.19:0/3499770809 >> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] conn(0x55e8a737df40 0x55e8a737e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f6620c7c740 4 client.10026 mds_command: new command op to 9939 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:05:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.587+0000 7f6620c7c740 1 -- 172.21.15.19:0/3499770809 --> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8a729a060 con 0x55e8a737df40 2024-09-12T02:05:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.588+0000 7f66177fe640 1 --2- 172.21.15.19:0/3499770809 >> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] conn(0x55e8a737df40 0x55e8a737e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.588+0000 7f66177fe640 1 --2- 172.21.15.19:0/3499770809 >> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] conn(0x55e8a737df40 0x55e8a737e320 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0903adf37d4d9f1 server_cookie=f1974f5ec35e5869 in_seq=0 out_seq=0 2024-09-12T02:05:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.588+0000 7f65f67fc640 10 client.10026 ms_handle_connect on v2:172.21.15.19:6832/3065327567 2024-09-12T02:05:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.588+0000 7f65f67fc640 1 -- 172.21.15.19:0/3499770809 <== mds.0 v2:172.21.15.19:6832/3065327567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e8a729a060 con 0x55e8a737df40 2024-09-12T02:05:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.588+0000 7f65f67fc640 10 client.10026 handle_command_reply: tid=0 2024-09-12T02:05:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.588+0000 7f6620c7c740 1 client.10026 shutdown 2024-09-12T02:05:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.589+0000 7f6620c7c740 1 -- 172.21.15.19:0/3499770809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 msgr2=0x55e8a7353260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.589+0000 7f6620c7c740 1 --2- 172.21.15.19:0/3499770809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 0x55e8a7353260 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f66100012e0 tx=0x7f6610001250 comp rx=0 tx=0).stop 2024-09-12T02:05:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.589+0000 7f6620c7c740 1 -- 172.21.15.19:0/3499770809 shutdown_connections 2024-09-12T02:05:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.589+0000 7f6620c7c740 1 --2- 172.21.15.19:0/3499770809 >> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] conn(0x55e8a737df40 0x55e8a737e320 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.589+0000 7f6620c7c740 1 --2- 172.21.15.19:0/3499770809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 0x55e8a7353260 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.589+0000 7f6620c7c740 1 --2- 172.21.15.19:0/3499770809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736ff00 0x55e8a734d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.589+0000 7f65f67fc640 0 client.10026 ms_handle_reset on v2:172.21.15.19:6832/3065327567 2024-09-12T02:05:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.589+0000 7f6620c7c740 1 --2- 172.21.15.19:0/3499770809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736db20 0x55e8a7350f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.589+0000 7f6620c7c740 1 -- 172.21.15.19:0/3499770809 >> 172.21.15.19:0/3499770809 conn(0x55e8a736d6c0 msgr2=0x55e8a7350470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.589+0000 7f6620c7c740 1 -- 172.21.15.19:0/3499770809 shutdown_connections 2024-09-12T02:05:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.589+0000 7f6620c7c740 1 -- 172.21.15.19:0/3499770809 wait complete. 2024-09-12T02:05:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.589+0000 7f6620c7c740 20 client.10026 trim_cache size 0 max 16384 2024-09-12T02:05:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.602+0000 7f6620c7c740 1 Processor -- start 2024-09-12T02:05:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.602+0000 7f6620c7c740 1 -- start start 2024-09-12T02:05:57.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.603+0000 7f6620c7c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 0x55e8a7325350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.603+0000 7f6620c7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736db20 0x55e8a736ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.603+0000 7f6620c7c740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736ff00 0x55e8a736b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.603+0000 7f6620c7c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6618202010 con 0x55e8a734dad0 2024-09-12T02:05:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.603+0000 7f6620c7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6618201370 con 0x55e8a736db20 2024-09-12T02:05:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.603+0000 7f6620c7c740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f66182019c0 con 0x55e8a736ff00 2024-09-12T02:05:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.603+0000 7f66177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 0x55e8a7325350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.603+0000 7f66177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 0x55e8a7325350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55332/0 (socket says 172.21.15.19:55332) 2024-09-12T02:05:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.603+0000 7f66177fe640 1 -- 172.21.15.19:0/3210861676 learned_addr learned my addr 172.21.15.19:0/3210861676 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.603+0000 7f6617fff640 1 --2- 172.21.15.19:0/3210861676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736ff00 0x55e8a736b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.603+0000 7f66177fe640 1 -- 172.21.15.19:0/3210861676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736ff00 msgr2=0x55e8a736b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.603+0000 7f66177fe640 1 --2- 172.21.15.19:0/3210861676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736ff00 0x55e8a736b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.603+0000 7f66177fe640 1 -- 172.21.15.19:0/3210861676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736db20 msgr2=0x55e8a736ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.603+0000 7f660effd640 1 --2- 172.21.15.19:0/3210861676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736db20 0x55e8a736ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.603+0000 7f66177fe640 1 --2- 172.21.15.19:0/3210861676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736db20 0x55e8a736ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.603+0000 7f66177fe640 1 -- 172.21.15.19:0/3210861676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8a6f5f0b0 con 0x55e8a734dad0 2024-09-12T02:05:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.603+0000 7f660effd640 1 --2- 172.21.15.19:0/3210861676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736db20 0x55e8a736ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.603+0000 7f66177fe640 1 --2- 172.21.15.19:0/3210861676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 0x55e8a7325350 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f6608079d50 tx=0x7f660803f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b05b25959ea09cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.604+0000 7f660cff9640 1 -- 172.21.15.19:0/3210861676 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66080a8070 con 0x55e8a734dad0 2024-09-12T02:05:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.604+0000 7f660cff9640 1 -- 172.21.15.19:0/3210861676 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660807e400 con 0x55e8a734dad0 2024-09-12T02:05:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.604+0000 7f660cff9640 1 -- 172.21.15.19:0/3210861676 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608092070 con 0x55e8a734dad0 2024-09-12T02:05:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.604+0000 7f6620c7c740 1 -- 172.21.15.19:0/3210861676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 msgr2=0x55e8a7325350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.604+0000 7f6620c7c740 1 --2- 172.21.15.19:0/3210861676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 0x55e8a7325350 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f6608079d50 tx=0x7f660803f040 comp rx=0 tx=0).stop 2024-09-12T02:05:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.604+0000 7f6620c7c740 1 -- 172.21.15.19:0/3210861676 shutdown_connections 2024-09-12T02:05:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.604+0000 7f6620c7c740 1 --2- 172.21.15.19:0/3210861676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736ff00 0x55e8a736b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.604+0000 7f6620c7c740 1 --2- 172.21.15.19:0/3210861676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736db20 0x55e8a736ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.604+0000 7f6620c7c740 1 --2- 172.21.15.19:0/3210861676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 0x55e8a7325350 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.604+0000 7f6620c7c740 1 -- 172.21.15.19:0/3210861676 >> 172.21.15.19:0/3210861676 conn(0x55e8a736d6c0 msgr2=0x55e8a736f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.604+0000 7f6620c7c740 1 -- 172.21.15.19:0/3210861676 shutdown_connections 2024-09-12T02:05:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.604+0000 7f6620c7c740 1 -- 172.21.15.19:0/3210861676 wait complete. 2024-09-12T02:05:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.605+0000 7f6620c7c740 1 -- start start 2024-09-12T02:05:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.605+0000 7f6620c7c740 1 Processor -- start 2024-09-12T02:05:57.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f6620c7c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 0x55e8a737ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f6620c7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736db20 0x55e8a73eb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f6620c7c740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736ff00 0x55e8a7391b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f6620c7c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e8a73820e0 con 0x55e8a734dad0 2024-09-12T02:05:57.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f6620c7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e8a737fde0 con 0x55e8a736db20 2024-09-12T02:05:57.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f6620c7c740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55e8a737f0a0 con 0x55e8a736ff00 2024-09-12T02:05:57.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f6620c7c740 10 client.0 _ll_register_callbacks cb 0x7f6610017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:05:57.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f66177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 0x55e8a737ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f66177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 0x55e8a737ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55334/0 (socket says 172.21.15.19:55334) 2024-09-12T02:05:57.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f66177fe640 1 -- 172.21.15.19:0/2518615659 learned_addr learned my addr 172.21.15.19:0/2518615659 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:57.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f66177fe640 1 -- 172.21.15.19:0/2518615659 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736ff00 msgr2=0x55e8a7391b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:57.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f66177fe640 1 --2- 172.21.15.19:0/2518615659 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736ff00 0x55e8a7391b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f66177fe640 1 -- 172.21.15.19:0/2518615659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736db20 msgr2=0x55e8a73eb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:57.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f660effd640 1 --2- 172.21.15.19:0/2518615659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736db20 0x55e8a73eb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f66177fe640 1 --2- 172.21.15.19:0/2518615659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736db20 0x55e8a73eb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f66177fe640 1 -- 172.21.15.19:0/2518615659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8a7383c50 con 0x55e8a734dad0 2024-09-12T02:05:57.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f660effd640 1 --2- 172.21.15.19:0/2518615659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736db20 0x55e8a73eb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:57.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f66177fe640 1 --2- 172.21.15.19:0/2518615659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 0x55e8a737ea80 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f66080764b0 tx=0x7f6608008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3def47e5592d1e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:57.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f65f67fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:05:57.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f65f67fc640 1 -- 172.21.15.19:0/2518615659 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66080a8070 con 0x55e8a734dad0 2024-09-12T02:05:57.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f65f67fc640 1 -- 172.21.15.19:0/2518615659 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7f660807e0f0 con 0x55e8a734dad0 2024-09-12T02:05:57.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.606+0000 7f6620c7c740 1 -- 172.21.15.19:0/2518615659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f660807e400 con 0x55e8a734dad0 2024-09-12T02:05:57.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.607+0000 7f65f67fc640 1 -- 172.21.15.19:0/2518615659 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=280) ==== 24+0+0 (secure 0 0 0) 0x7f6608092040 con 0x55e8a734dad0 2024-09-12T02:05:57.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.607+0000 7f6620c7c740 10 client.10032 fetch_fsmap learned FSMap version 280 2024-09-12T02:05:57.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.607+0000 7f6620c7c740 1 -- 172.21.15.19:0/2518615659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=280,monmap=2+}) -- 0x55e8a7383450 con 0x55e8a734dad0 2024-09-12T02:05:57.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.607+0000 7f65f67fc640 1 -- 172.21.15.19:0/2518615659 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660807e400 con 0x55e8a734dad0 2024-09-12T02:05:57.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.607+0000 7f65f67fc640 1 -- 172.21.15.19:0/2518615659 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 280) ==== 3502+0+0 (secure 0 0 0) 0x7f66080766c0 con 0x55e8a734dad0 2024-09-12T02:05:57.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.607+0000 7f6620c7c740 10 client.10032 fetch_fsmap finished waiting for FSMap version 280 2024-09-12T02:05:57.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.607+0000 7f6620c7c740 10 client.10032 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:05:57.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.607+0000 7f6620c7c740 20 client.10032 populate_metadata read hostname 'smithi019' 2024-09-12T02:05:57.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.607+0000 7f6620c7c740 1 --2- 172.21.15.19:0/2518615659 >> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] conn(0x55e8a73ef260 0x55e8a73ef640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.607+0000 7f6620c7c740 4 client.10032 mds_command: new command op to 9939 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-09-12T02:05:57.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.607+0000 7f6620c7c740 1 -- 172.21.15.19:0/2518615659 --> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55e8a72943b0 con 0x55e8a73ef260 2024-09-12T02:05:57.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.607+0000 7f660effd640 1 --2- 172.21.15.19:0/2518615659 >> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] conn(0x55e8a73ef260 0x55e8a73ef640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.607+0000 7f65f67fc640 10 client.10032 ms_handle_connect on v2:172.21.15.19:6832/3065327567 2024-09-12T02:05:57.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.607+0000 7f660effd640 1 --2- 172.21.15.19:0/2518615659 >> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] conn(0x55e8a73ef260 0x55e8a73ef640 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=219b35d7236b3aeb server_cookie=7d89e0fbd7fdc5dc in_seq=0 out_seq=0 2024-09-12T02:05:57.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.607+0000 7f65f67fc640 1 -- 172.21.15.19:0/2518615659 <== mds.0 v2:172.21.15.19:6832/3065327567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+194 (crc 0 0 0) 0x55e8a72943b0 con 0x55e8a73ef260 2024-09-12T02:05:57.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.607+0000 7f65f67fc640 10 client.10032 handle_command_reply: tid=0 2024-09-12T02:05:57.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f6620c7c740 1 client.10032 shutdown 2024-09-12T02:05:57.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f6620c7c740 1 -- 172.21.15.19:0/2518615659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 msgr2=0x55e8a737ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f6620c7c740 1 --2- 172.21.15.19:0/2518615659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 0x55e8a737ea80 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f66080764b0 tx=0x7f6608008040 comp rx=0 tx=0).stop 2024-09-12T02:05:57.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f6620c7c740 1 -- 172.21.15.19:0/2518615659 shutdown_connections 2024-09-12T02:05:57.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f6620c7c740 1 --2- 172.21.15.19:0/2518615659 >> [v2:172.21.15.19:6832/3065327567,v1:172.21.15.19:6834/3065327567] conn(0x55e8a73ef260 0x55e8a73ef640 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f6620c7c740 1 --2- 172.21.15.19:0/2518615659 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e8a736ff00 0x55e8a7391b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f6620c7c740 1 --2- 172.21.15.19:0/2518615659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8a736db20 0x55e8a73eb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f65f67fc640 0 client.10032 ms_handle_reset on v2:172.21.15.19:6832/3065327567 2024-09-12T02:05:57.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f6620c7c740 1 --2- 172.21.15.19:0/2518615659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8a734dad0 0x55e8a737ea80 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f6620c7c740 1 -- 172.21.15.19:0/2518615659 >> 172.21.15.19:0/2518615659 conn(0x55e8a736d6c0 msgr2=0x55e8a7366ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:57.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f6620c7c740 1 -- 172.21.15.19:0/2518615659 shutdown_connections 2024-09-12T02:05:57.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f6620c7c740 1 -- 172.21.15.19:0/2518615659 wait complete. 2024-09-12T02:05:57.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f6620c7c740 20 client.10032 trim_cache size 0 max 16384 2024-09-12T02:05:57.616 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:05:57.616 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-09-12T02:05:57.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:05:57.616 INFO:teuthology.orchestra.run.smithi019.stdout: "damage_type": "dentry", 2024-09-12T02:05:57.616 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 1840739222, 2024-09-12T02:05:57.616 INFO:teuthology.orchestra.run.smithi019.stdout: "ino": 1, 2024-09-12T02:05:57.616 INFO:teuthology.orchestra.run.smithi019.stdout: "frag": "*", 2024-09-12T02:05:57.616 INFO:teuthology.orchestra.run.smithi019.stdout: "dname": "subdir", 2024-09-12T02:05:57.616 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_id": "head", 2024-09-12T02:05:57.616 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/subdir" 2024-09-12T02:05:57.616 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:05:57.616 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-09-12T02:05:57.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f661dedd640 1 -- 172.21.15.19:0/2596463532 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f65f806be30 msgr2=0x7f65f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f661dedd640 1 --2- 172.21.15.19:0/2596463532 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f65f806be30 0x7f65f806e2f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f66180c7c90 tx=0x7f6600009040 comp rx=0 tx=0).stop 2024-09-12T02:05:57.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f661dedd640 1 -- 172.21.15.19:0/2596463532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66180cf280 msgr2=0x7f66180b84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f661dedd640 1 --2- 172.21.15.19:0/2596463532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66180cf280 0x7f66180b84e0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f6608009870 tx=0x7f66080046c0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f661dedd640 1 -- 172.21.15.19:0/2596463532 shutdown_connections 2024-09-12T02:05:57.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f661dedd640 1 --2- 172.21.15.19:0/2596463532 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f65f806be30 0x7f65f806e2f0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f661dedd640 1 --2- 172.21.15.19:0/2596463532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6618162e30 0x7f66180ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f661dedd640 1 --2- 172.21.15.19:0/2596463532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6618162340 0x7f66180b9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f661dedd640 1 --2- 172.21.15.19:0/2596463532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66180cf280 0x7f66180b84e0 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.608+0000 7f661dedd640 1 -- 172.21.15.19:0/2596463532 >> 172.21.15.19:0/2596463532 conn(0x7f661808bfc0 msgr2=0x7f661806e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:57.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.609+0000 7f661dedd640 1 -- 172.21.15.19:0/2596463532 shutdown_connections 2024-09-12T02:05:57.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.609+0000 7f661dedd640 1 -- 172.21.15.19:0/2596463532 wait complete. 2024-09-12T02:05:57.620 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap header on 10000000000.00000000' 2024-09-12T02:05:57.620 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:05:57.620 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:05:57.637 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:05:57.637 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:05:57.694 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:05:57.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.837+0000 7f3a5fedd640 1 Processor -- start 2024-09-12T02:05:57.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.837+0000 7f3a5fedd640 1 -- start start 2024-09-12T02:05:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.838+0000 7f3a5fedd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3a580b69d0 0x7f3a58162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.838+0000 7f3a5fedd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3a580af280 0x7f3a580afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.838+0000 7f3a5fedd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a5815eb60 con 0x7f3a580affb0 2024-09-12T02:05:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.838+0000 7f3a5fedd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f3a580b0400 con 0x7f3a580af280 2024-09-12T02:05:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.838+0000 7f3a5fedd640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f3a580b6db0 con 0x7f3a580b69d0 2024-09-12T02:05:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.838+0000 7f3a5d478640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3a580af280 0x7f3a580afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.838+0000 7f3a5d478640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3a580af280 0x7f3a580afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55342/0 (socket says 172.21.15.19:55342) 2024-09-12T02:05:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.838+0000 7f3a5d478640 1 -- 172.21.15.19:0/2431470502 learned_addr learned my addr 172.21.15.19:0/2431470502 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.838+0000 7f3a5dc79640 1 --2- 172.21.15.19:0/2431470502 >> v2:172.21.15.135:3300/0 conn(0x7f3a580b69d0 0x7f3a58162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.838+0000 7f3a5d478640 1 -- 172.21.15.19:0/2431470502 >> v2:172.21.15.135:3300/0 conn(0x7f3a580b69d0 msgr2=0x7f3a58162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:57.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.838+0000 7f3a5d478640 1 --2- 172.21.15.19:0/2431470502 >> v2:172.21.15.135:3300/0 conn(0x7f3a580b69d0 0x7f3a58162a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.838+0000 7f3a5d478640 1 -- 172.21.15.19:0/2431470502 >> v1:172.21.15.135:6789/0 conn(0x7f3a580affb0 legacy=0x7f3a58154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:57.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.838+0000 7f3a5d478640 1 -- 172.21.15.19:0/2431470502 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5815ee40 con 0x7f3a580af280 2024-09-12T02:05:57.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.839+0000 7f3a5d478640 1 --2- 172.21.15.19:0/2431470502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a580af280 0x7f3a580afa70 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f3a58070980 tx=0x7f3a4c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d980539589e1194e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:57.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.839+0000 7f3a5cc77640 1 -- 172.21.15.19:0/2431470502 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c037070 con 0x7f3a580af280 2024-09-12T02:05:57.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.839+0000 7f3a5cc77640 1 -- 172.21.15.19:0/2431470502 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a4c02ae20 con 0x7f3a580af280 2024-09-12T02:05:57.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.839+0000 7f3a5cc77640 1 -- 172.21.15.19:0/2431470502 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c032660 con 0x7f3a580af280 2024-09-12T02:05:57.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.840+0000 7f3a5fedd640 1 -- 172.21.15.19:0/2431470502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a580af280 msgr2=0x7f3a580afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.840+0000 7f3a5fedd640 1 --2- 172.21.15.19:0/2431470502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a580af280 0x7f3a580afa70 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f3a58070980 tx=0x7f3a4c02a110 comp rx=0 tx=0).stop 2024-09-12T02:05:57.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.840+0000 7f3a5fedd640 1 -- 172.21.15.19:0/2431470502 shutdown_connections 2024-09-12T02:05:57.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.840+0000 7f3a5fedd640 1 --2- 172.21.15.19:0/2431470502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a580af280 0x7f3a580afa70 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.840+0000 7f3a5fedd640 1 --2- 172.21.15.19:0/2431470502 >> v2:172.21.15.135:3300/0 conn(0x7f3a580b69d0 0x7f3a58162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.840+0000 7f3a5fedd640 1 -- 172.21.15.19:0/2431470502 >> 172.21.15.19:0/2431470502 conn(0x7f3a5806bc10 msgr2=0x7f3a5806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.840+0000 7f3a5fedd640 1 -- 172.21.15.19:0/2431470502 shutdown_connections 2024-09-12T02:05:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.840+0000 7f3a5fedd640 1 -- 172.21.15.19:0/2431470502 wait complete. 2024-09-12T02:05:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.841+0000 7f3a5fedd640 1 Processor -- start 2024-09-12T02:05:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.841+0000 7f3a5fedd640 1 -- start start 2024-09-12T02:05:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.842+0000 7f3a5fedd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a580af280 0x7f3a58150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.842+0000 7f3a5fedd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a580affb0 0x7f3a5815b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.842+0000 7f3a5fedd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a580b69d0 0x7f3a581532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.842+0000 7f3a5fedd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3a580af710 con 0x7f3a580b69d0 2024-09-12T02:05:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.842+0000 7f3a5fedd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5815f400 con 0x7f3a580af280 2024-09-12T02:05:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.842+0000 7f3a5fedd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3a58155410 con 0x7f3a580affb0 2024-09-12T02:05:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.842+0000 7f3a5e47a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a580b69d0 0x7f3a581532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.842+0000 7f3a5e47a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a580b69d0 0x7f3a581532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55352/0 (socket says 172.21.15.19:55352) 2024-09-12T02:05:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.842+0000 7f3a5e47a640 1 -- 172.21.15.19:0/3254245106 learned_addr learned my addr 172.21.15.19:0/3254245106 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.842+0000 7f3a5dc79640 1 --2- 172.21.15.19:0/3254245106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a580af280 0x7f3a58150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.842+0000 7f3a5d478640 1 --2- 172.21.15.19:0/3254245106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a580affb0 0x7f3a5815b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.842+0000 7f3a5e47a640 1 -- 172.21.15.19:0/3254245106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a580affb0 msgr2=0x7f3a5815b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.842+0000 7f3a5e47a640 1 --2- 172.21.15.19:0/3254245106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a580affb0 0x7f3a5815b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.842+0000 7f3a5e47a640 1 -- 172.21.15.19:0/3254245106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a580af280 msgr2=0x7f3a58150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:57.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.842+0000 7f3a5e47a640 1 --2- 172.21.15.19:0/3254245106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a580af280 0x7f3a58150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:57.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.842+0000 7f3a5e47a640 1 -- 172.21.15.19:0/3254245106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a58153d50 con 0x7f3a580b69d0 2024-09-12T02:05:57.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.842+0000 7f3a5e47a640 1 --2- 172.21.15.19:0/3254245106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a580b69d0 0x7f3a581532d0 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f3a4800c780 tx=0x7f3a4800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:57.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.843+0000 7f3a567fc640 1 -- 172.21.15.19:0/3254245106 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a48017070 con 0x7f3a580b69d0 2024-09-12T02:05:57.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.843+0000 7f3a567fc640 1 -- 172.21.15.19:0/3254245106 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a48003da0 con 0x7f3a580b69d0 2024-09-12T02:05:57.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.843+0000 7f3a5fedd640 1 -- 172.21.15.19:0/3254245106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a5815a660 con 0x7f3a580b69d0 2024-09-12T02:05:57.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.843+0000 7f3a567fc640 1 -- 172.21.15.19:0/3254245106 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a480052b0 con 0x7f3a580b69d0 2024-09-12T02:05:57.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.843+0000 7f3a5fedd640 1 -- 172.21.15.19:0/3254245106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a5815b680 con 0x7f3a580b69d0 2024-09-12T02:05:57.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.844+0000 7f3a5fedd640 1 -- 172.21.15.19:0/3254245106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a581557a0 con 0x7f3a580b69d0 2024-09-12T02:05:57.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.844+0000 7f3a567fc640 1 -- 172.21.15.19:0/3254245106 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a4801a070 con 0x7f3a580b69d0 2024-09-12T02:05:57.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.845+0000 7f3a567fc640 1 --2- 172.21.15.19:0/3254245106 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3a4406be30 0x7f3a4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:57.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.845+0000 7f3a567fc640 1 -- 172.21.15.19:0/3254245106 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7f3a4808b270 con 0x7f3a580b69d0 2024-09-12T02:05:57.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.845+0000 7f3a5dc79640 1 --2- 172.21.15.19:0/3254245106 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3a4406be30 0x7f3a4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:57.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.845+0000 7f3a5dc79640 1 --2- 172.21.15.19:0/3254245106 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3a4406be30 0x7f3a4406e2f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f3a50006fd0 tx=0x7f3a50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:57.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:57.849+0000 7f3a567fc640 1 -- 172.21.15.19:0/3254245106 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a48058ef0 con 0x7f3a580b69d0 2024-09-12T02:05:58.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.037+0000 7f3a5fedd640 1 -- 172.21.15.19:0/3254245106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3a58154d80 con 0x7f3a580b69d0 2024-09-12T02:05:58.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.037+0000 7f3a567fc640 1 -- 172.21.15.19:0/3254245106 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 66 entries v127) ==== 81+0+4040 (secure 0 0 0) 0x7f3a480587f0 con 0x7f3a580b69d0 2024-09-12T02:05:58.038 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/1975440909 2024-09-13T02:05:43.189507+0000 2024-09-12T02:05:58.038 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3910102099 2024-09-13T02:05:24.866817+0000 2024-09-12T02:05:58.038 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/2839344629 2024-09-13T02:05:20.836728+0000 2024-09-12T02:05:58.038 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/2072535494 2024-09-13T02:02:44.440900+0000 2024-09-12T02:05:58.038 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2405422603 2024-09-13T02:04:31.542456+0000 2024-09-12T02:05:58.038 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/1875416968 2024-09-13T02:03:41.731211+0000 2024-09-12T02:05:58.038 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/4124612835 2024-09-13T02:03:35.697598+0000 2024-09-12T02:05:58.039 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/1101861733 2024-09-13T02:02:54.487980+0000 2024-09-12T02:05:58.039 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3598057058 2024-09-13T02:03:24.636971+0000 2024-09-12T02:05:58.039 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/626316140 2024-09-13T02:04:41.744221+0000 2024-09-12T02:05:58.039 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/46689513 2024-09-13T02:03:28.654366+0000 2024-09-12T02:05:58.039 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3985859189 2024-09-13T02:04:09.906953+0000 2024-09-12T02:05:58.039 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3866905323 2024-09-13T02:03:54.557384+0000 2024-09-12T02:05:58.039 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3997032797 2024-09-13T02:05:16.751616+0000 2024-09-12T02:05:58.039 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:05:58.039 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3995150987 2024-09-13T02:03:22.315702+0000 2024-09-12T02:05:58.039 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/46689513 2024-09-13T02:03:28.654366+0000 2024-09-12T02:05:58.039 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/4287312235 2024-09-13T02:03:11.277301+0000 2024-09-12T02:05:58.039 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/961161264 2024-09-13T02:04:17.973298+0000 2024-09-12T02:05:58.039 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/1975440909 2024-09-13T02:05:43.189507+0000 2024-09-12T02:05:58.039 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:05:58.040 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3279314147 2024-09-13T02:04:33.778955+0000 2024-09-12T02:05:58.040 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/1800650480 2024-09-13T02:03:56.737366+0000 2024-09-12T02:05:58.040 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3279314147 2024-09-13T02:04:33.778955+0000 2024-09-12T02:05:58.040 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/4087550164 2024-09-13T02:04:57.990681+0000 2024-09-12T02:05:58.040 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2201380819 2024-09-13T02:05:10.473806+0000 2024-09-12T02:05:58.040 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3995150987 2024-09-13T02:03:22.315702+0000 2024-09-12T02:05:58.040 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/4124612835 2024-09-13T02:03:35.697598+0000 2024-09-12T02:05:58.040 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/2072535494 2024-09-13T02:02:44.440900+0000 2024-09-12T02:05:58.040 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3985859189 2024-09-13T02:04:09.906953+0000 2024-09-12T02:05:58.040 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/613869354 2024-09-13T02:02:39.104650+0000 2024-09-12T02:05:58.040 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/613869354 2024-09-13T02:02:39.104650+0000 2024-09-12T02:05:58.040 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/650556594 2024-09-13T02:02:50.470816+0000 2024-09-12T02:05:58.040 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3818656517 2024-09-13T02:05:38.158172+0000 2024-09-12T02:05:58.041 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/4287312235 2024-09-13T02:03:11.277301+0000 2024-09-12T02:05:58.041 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/650556594 2024-09-13T02:02:50.470816+0000 2024-09-12T02:05:58.041 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/4107165769 2024-09-13T02:04:03.869164+0000 2024-09-12T02:05:58.041 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/1101861733 2024-09-13T02:02:54.487980+0000 2024-09-12T02:05:58.041 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/1800650480 2024-09-13T02:03:56.737366+0000 2024-09-12T02:05:58.041 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2017831568 2024-09-13T02:04:45.871893+0000 2024-09-12T02:05:58.041 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3136344951 2024-09-13T02:02:58.521234+0000 2024-09-12T02:05:58.041 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3136344951 2024-09-13T02:02:58.521234+0000 2024-09-12T02:05:58.041 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/4107165769 2024-09-13T02:04:03.869164+0000 2024-09-12T02:05:58.041 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/926329492 2024-09-13T02:04:13.937157+0000 2024-09-12T02:05:58.042 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3866905323 2024-09-13T02:03:54.557384+0000 2024-09-12T02:05:58.042 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/926329492 2024-09-13T02:04:13.937157+0000 2024-09-12T02:05:58.042 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/961161264 2024-09-13T02:04:17.973298+0000 2024-09-12T02:05:58.042 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2201380819 2024-09-13T02:05:10.473806+0000 2024-09-12T02:05:58.042 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3910102099 2024-09-13T02:05:24.866817+0000 2024-09-12T02:05:58.042 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2405422603 2024-09-13T02:04:31.542456+0000 2024-09-12T02:05:58.042 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2333858704 2024-09-13T02:04:37.802344+0000 2024-09-12T02:05:58.042 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/1875416968 2024-09-13T02:03:41.731211+0000 2024-09-12T02:05:58.042 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2333858704 2024-09-13T02:04:37.802344+0000 2024-09-12T02:05:58.042 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/626316140 2024-09-13T02:04:41.744221+0000 2024-09-12T02:05:58.042 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2017831568 2024-09-13T02:04:45.871893+0000 2024-09-12T02:05:58.042 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3545886366 2024-09-13T02:04:49.907498+0000 2024-09-12T02:05:58.042 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3818656517 2024-09-13T02:05:38.158172+0000 2024-09-12T02:05:58.043 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3545886366 2024-09-13T02:04:49.907498+0000 2024-09-12T02:05:58.043 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3377480547 2024-09-13T02:04:53.949050+0000 2024-09-12T02:05:58.043 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3598057058 2024-09-13T02:03:24.636971+0000 2024-09-12T02:05:58.043 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3377480547 2024-09-13T02:04:53.949050+0000 2024-09-12T02:05:58.043 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/4087550164 2024-09-13T02:04:57.990681+0000 2024-09-12T02:05:58.043 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/2195405214 2024-09-13T02:05:12.791934+0000 2024-09-12T02:05:58.043 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/2195405214 2024-09-13T02:05:12.791934+0000 2024-09-12T02:05:58.043 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3997032797 2024-09-13T02:05:16.751616+0000 2024-09-12T02:05:58.043 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/2839344629 2024-09-13T02:05:20.836728+0000 2024-09-12T02:05:58.044 INFO:teuthology.orchestra.run.smithi019.stderr:listed 66 entries 2024-09-12T02:05:58.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.039+0000 7f3a5fedd640 1 -- 172.21.15.19:0/3254245106 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3a4406be30 msgr2=0x7f3a4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:58.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.039+0000 7f3a5fedd640 1 --2- 172.21.15.19:0/3254245106 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3a4406be30 0x7f3a4406e2f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f3a50006fd0 tx=0x7f3a50008040 comp rx=0 tx=0).stop 2024-09-12T02:05:58.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.039+0000 7f3a5fedd640 1 -- 172.21.15.19:0/3254245106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a580b69d0 msgr2=0x7f3a581532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:58.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.039+0000 7f3a5fedd640 1 --2- 172.21.15.19:0/3254245106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a580b69d0 0x7f3a581532d0 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f3a4800c780 tx=0x7f3a4800cc40 comp rx=0 tx=0).stop 2024-09-12T02:05:58.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.039+0000 7f3a5fedd640 1 -- 172.21.15.19:0/3254245106 shutdown_connections 2024-09-12T02:05:58.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.039+0000 7f3a5fedd640 1 --2- 172.21.15.19:0/3254245106 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3a4406be30 0x7f3a4406e2f0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.039+0000 7f3a5fedd640 1 --2- 172.21.15.19:0/3254245106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a580b69d0 0x7f3a581532d0 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.039+0000 7f3a5fedd640 1 --2- 172.21.15.19:0/3254245106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a580affb0 0x7f3a5815b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.039+0000 7f3a5fedd640 1 --2- 172.21.15.19:0/3254245106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a580af280 0x7f3a58150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.039+0000 7f3a5fedd640 1 -- 172.21.15.19:0/3254245106 >> 172.21.15.19:0/3254245106 conn(0x7f3a5806bc10 msgr2=0x7f3a5806f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:58.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.040+0000 7f3a5fedd640 1 -- 172.21.15.19:0/3254245106 shutdown_connections 2024-09-12T02:05:58.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.040+0000 7f3a5fedd640 1 -- 172.21.15.19:0/3254245106 wait complete. 2024-09-12T02:05:58.050 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:05:58.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:58.051 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-12T02:05:58.077 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:05:58.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:05:58.078 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:05:58.134 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:05:58.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.278+0000 7f613945e640 1 Processor -- start 2024-09-12T02:05:58.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.279+0000 7f613945e640 1 -- start start 2024-09-12T02:05:58.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.279+0000 7f613945e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f613415e710 0x7f61340d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:58.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.279+0000 7f613945e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f61340cfb60 0x7f61340cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:58.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.279+0000 7f613945e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61340d2170 con 0x7f61340b6010 2024-09-12T02:05:58.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.279+0000 7f613945e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f61340d2d20 con 0x7f61340cfb60 2024-09-12T02:05:58.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.279+0000 7f613945e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f61340d04b0 con 0x7f613415e710 2024-09-12T02:05:58.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.280+0000 7f61327fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f61340cfb60 0x7f61340cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:58.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.280+0000 7f61327fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f61340cfb60 0x7f61340cff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55354/0 (socket says 172.21.15.19:55354) 2024-09-12T02:05:58.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.280+0000 7f61327fc640 1 -- 172.21.15.19:0/4166233292 learned_addr learned my addr 172.21.15.19:0/4166233292 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:58.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.280+0000 7f6132ffd640 1 --2- 172.21.15.19:0/4166233292 >> v2:172.21.15.135:3300/0 conn(0x7f613415e710 0x7f61340d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:58.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.280+0000 7f61327fc640 1 -- 172.21.15.19:0/4166233292 >> v2:172.21.15.135:3300/0 conn(0x7f613415e710 msgr2=0x7f61340d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:58.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.280+0000 7f61327fc640 1 --2- 172.21.15.19:0/4166233292 >> v2:172.21.15.135:3300/0 conn(0x7f613415e710 0x7f61340d31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.280+0000 7f61327fc640 1 -- 172.21.15.19:0/4166233292 >> v1:172.21.15.135:6789/0 conn(0x7f61340b6010 legacy=0x7f613406ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:58.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.280+0000 7f61327fc640 1 -- 172.21.15.19:0/4166233292 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61340d2410 con 0x7f61340cfb60 2024-09-12T02:05:58.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.281+0000 7f61327fc640 1 --2- 172.21.15.19:0/4166233292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61340cfb60 0x7f61340cff70 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f613408dee0 tx=0x7f612802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8375a31935cb5c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:58.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.281+0000 7f6131ffb640 1 -- 172.21.15.19:0/4166233292 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6128004030 con 0x7f61340cfb60 2024-09-12T02:05:58.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.281+0000 7f6131ffb640 1 -- 172.21.15.19:0/4166233292 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61280041d0 con 0x7f61340cfb60 2024-09-12T02:05:58.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.281+0000 7f6131ffb640 1 -- 172.21.15.19:0/4166233292 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6128003610 con 0x7f61340cfb60 2024-09-12T02:05:58.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.281+0000 7f613945e640 1 -- 172.21.15.19:0/4166233292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61340cfb60 msgr2=0x7f61340cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:58.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.281+0000 7f613945e640 1 --2- 172.21.15.19:0/4166233292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61340cfb60 0x7f61340cff70 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f613408dee0 tx=0x7f612802a210 comp rx=0 tx=0).stop 2024-09-12T02:05:58.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.281+0000 7f613945e640 1 -- 172.21.15.19:0/4166233292 shutdown_connections 2024-09-12T02:05:58.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.281+0000 7f613945e640 1 --2- 172.21.15.19:0/4166233292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61340cfb60 0x7f61340cff70 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.281+0000 7f613945e640 1 --2- 172.21.15.19:0/4166233292 >> v2:172.21.15.135:3300/0 conn(0x7f613415e710 0x7f61340d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.281+0000 7f613945e640 1 -- 172.21.15.19:0/4166233292 >> 172.21.15.19:0/4166233292 conn(0x7f613408bfc0 msgr2=0x7f61340d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:58.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.281+0000 7f613945e640 1 -- 172.21.15.19:0/4166233292 shutdown_connections 2024-09-12T02:05:58.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.281+0000 7f613945e640 1 -- 172.21.15.19:0/4166233292 wait complete. 2024-09-12T02:05:58.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.283+0000 7f613945e640 1 Processor -- start 2024-09-12T02:05:58.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.283+0000 7f613945e640 1 -- start start 2024-09-12T02:05:58.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.283+0000 7f613945e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61340b6010 0x7f61341559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:58.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.283+0000 7f613945e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61340cfb60 0x7f613415a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:58.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.283+0000 7f613945e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f613415e710 0x7f61340b96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:58.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.283+0000 7f613945e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f61340d29b0 con 0x7f613415e710 2024-09-12T02:05:58.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.283+0000 7f613945e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f61340d26d0 con 0x7f61340b6010 2024-09-12T02:05:58.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.283+0000 7f613945e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f61340b64a0 con 0x7f61340cfb60 2024-09-12T02:05:58.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.284+0000 7f61337fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f613415e710 0x7f61340b96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:58.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.284+0000 7f61337fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f613415e710 0x7f61340b96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55358/0 (socket says 172.21.15.19:55358) 2024-09-12T02:05:58.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.284+0000 7f61337fe640 1 -- 172.21.15.19:0/1352217643 learned_addr learned my addr 172.21.15.19:0/1352217643 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:58.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.284+0000 7f6132ffd640 1 --2- 172.21.15.19:0/1352217643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61340b6010 0x7f61341559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:58.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.284+0000 7f61327fc640 1 --2- 172.21.15.19:0/1352217643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61340cfb60 0x7f613415a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:58.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.284+0000 7f61337fe640 1 -- 172.21.15.19:0/1352217643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61340cfb60 msgr2=0x7f613415a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:58.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.284+0000 7f61337fe640 1 --2- 172.21.15.19:0/1352217643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61340cfb60 0x7f613415a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.284+0000 7f61337fe640 1 -- 172.21.15.19:0/1352217643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61340b6010 msgr2=0x7f61341559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:58.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.284+0000 7f61337fe640 1 --2- 172.21.15.19:0/1352217643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61340b6010 0x7f61341559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.284+0000 7f61337fe640 1 -- 172.21.15.19:0/1352217643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6134159300 con 0x7f613415e710 2024-09-12T02:05:58.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.284+0000 7f61337fe640 1 --2- 172.21.15.19:0/1352217643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f613415e710 0x7f61340b96d0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f612c00c780 tx=0x7f612c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:58.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.284+0000 7f611b7fe640 1 -- 172.21.15.19:0/1352217643 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c017070 con 0x7f613415e710 2024-09-12T02:05:58.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.284+0000 7f611b7fe640 1 -- 172.21.15.19:0/1352217643 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f612c003da0 con 0x7f613415e710 2024-09-12T02:05:58.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.284+0000 7f613945e640 1 -- 172.21.15.19:0/1352217643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6134159ad0 con 0x7f613415e710 2024-09-12T02:05:58.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.284+0000 7f611b7fe640 1 -- 172.21.15.19:0/1352217643 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c0052b0 con 0x7f613415e710 2024-09-12T02:05:58.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.284+0000 7f613945e640 1 -- 172.21.15.19:0/1352217643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f613415aaf0 con 0x7f613415e710 2024-09-12T02:05:58.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.285+0000 7f613945e640 1 -- 172.21.15.19:0/1352217643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f613415ad80 con 0x7f613415e710 2024-09-12T02:05:58.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.286+0000 7f611b7fe640 1 -- 172.21.15.19:0/1352217643 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f612c01a070 con 0x7f613415e710 2024-09-12T02:05:58.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.286+0000 7f611b7fe640 1 --2- 172.21.15.19:0/1352217643 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f612006be30 0x7f612006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:58.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.286+0000 7f611b7fe640 1 -- 172.21.15.19:0/1352217643 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 9055+0+0 (secure 0 0 0) 0x7f612c08b0f0 con 0x7f613415e710 2024-09-12T02:05:58.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.286+0000 7f6132ffd640 1 --2- 172.21.15.19:0/1352217643 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f612006be30 0x7f612006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:58.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.287+0000 7f6132ffd640 1 --2- 172.21.15.19:0/1352217643 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f612006be30 0x7f612006e2f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f612400aa20 tx=0x7f6124008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:58.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.290+0000 7f611b7fe640 1 -- 172.21.15.19:0/1352217643 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f612c058780 con 0x7f613415e710 2024-09-12T02:05:58.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.502+0000 7f613945e640 1 -- 172.21.15.19:0/1352217643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f61340b6830 con 0x7f613415e710 2024-09-12T02:05:58.503 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:05:58.503+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:05:58.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.504+0000 7f611b7fe640 1 -- 172.21.15.19:0/1352217643 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v281) ==== 161+0+0 (secure 0 0 0) 0x7f612c05ca80 con 0x7f613415e710 2024-09-12T02:05:58.505 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:05:58.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.507+0000 7f613945e640 1 -- 172.21.15.19:0/1352217643 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f612006be30 msgr2=0x7f612006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:58.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.507+0000 7f613945e640 1 --2- 172.21.15.19:0/1352217643 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f612006be30 0x7f612006e2f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f612400aa20 tx=0x7f6124008040 comp rx=0 tx=0).stop 2024-09-12T02:05:58.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.507+0000 7f613945e640 1 -- 172.21.15.19:0/1352217643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f613415e710 msgr2=0x7f61340b96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:58.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.507+0000 7f613945e640 1 --2- 172.21.15.19:0/1352217643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f613415e710 0x7f61340b96d0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f612c00c780 tx=0x7f612c00cc40 comp rx=0 tx=0).stop 2024-09-12T02:05:58.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.507+0000 7f613945e640 1 -- 172.21.15.19:0/1352217643 shutdown_connections 2024-09-12T02:05:58.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.507+0000 7f613945e640 1 --2- 172.21.15.19:0/1352217643 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f612006be30 0x7f612006e2f0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.507+0000 7f613945e640 1 --2- 172.21.15.19:0/1352217643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f613415e710 0x7f61340b96d0 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.507+0000 7f613945e640 1 --2- 172.21.15.19:0/1352217643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61340cfb60 0x7f613415a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.507+0000 7f613945e640 1 --2- 172.21.15.19:0/1352217643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61340b6010 0x7f61341559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.507+0000 7f613945e640 1 -- 172.21.15.19:0/1352217643 >> 172.21.15.19:0/1352217643 conn(0x7f613408bfc0 msgr2=0x7f61340cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:58.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.508+0000 7f613945e640 1 -- 172.21.15.19:0/1352217643 shutdown_connections 2024-09-12T02:05:58.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.508+0000 7f613945e640 1 -- 172.21.15.19:0/1352217643 wait complete. 2024-09-12T02:05:58.511 INFO:tasks.ceph.mds.c.smithi019.stderr: -549> 2024-09-12T02:05:53.209+0000 7fd7ef435640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:05:58.520 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:05:58.535 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:05:58.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.624+0000 7fb7d0dcd640 1 Processor -- start 2024-09-12T02:05:58.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.624+0000 7fb7d0dcd640 1 -- start start 2024-09-12T02:05:58.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.625+0000 7fb7d0dcd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb7cc0d30f0 0x7fb7cc0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:58.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.625+0000 7fb7d0dcd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb7cc0b64c0 0x7fb7cc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:58.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.625+0000 7fb7d0dcd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7cc0d3690 con 0x7fb7cc15e5f0 2024-09-12T02:05:58.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.625+0000 7fb7d0dcd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb7cc06d530 con 0x7fb7cc0b64c0 2024-09-12T02:05:58.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.625+0000 7fb7d0dcd640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb7cc0d3970 con 0x7fb7cc0d30f0 2024-09-12T02:05:58.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.625+0000 7fb7cad9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb7cc0b64c0 0x7fb7cc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:58.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.625+0000 7fb7cad9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb7cc0b64c0 0x7fb7cc06d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55372/0 (socket says 172.21.15.19:55372) 2024-09-12T02:05:58.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.625+0000 7fb7cad9d640 1 -- 172.21.15.19:0/971221464 learned_addr learned my addr 172.21.15.19:0/971221464 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:58.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.625+0000 7fb7c9d9b640 1 --2- 172.21.15.19:0/971221464 >> v2:172.21.15.135:3300/0 conn(0x7fb7cc0d30f0 0x7fb7cc0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:58.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.625+0000 7fb7cad9d640 1 -- 172.21.15.19:0/971221464 >> v2:172.21.15.135:3300/0 conn(0x7fb7cc0d30f0 msgr2=0x7fb7cc0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:58.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.625+0000 7fb7cad9d640 1 --2- 172.21.15.19:0/971221464 >> v2:172.21.15.135:3300/0 conn(0x7fb7cc0d30f0 0x7fb7cc0b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.625+0000 7fb7cad9d640 1 -- 172.21.15.19:0/971221464 >> v1:172.21.15.135:6789/0 conn(0x7fb7cc15e5f0 legacy=0x7fb7cc0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:58.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.625+0000 7fb7cad9d640 1 -- 172.21.15.19:0/971221464 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc06cee0 con 0x7fb7cc0b64c0 2024-09-12T02:05:58.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.626+0000 7fb7cad9d640 1 --2- 172.21.15.19:0/971221464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7cc0b64c0 0x7fb7cc06d9c0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc08e520 tx=0x7fb7c402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1329a56b59b028e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:58.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.626+0000 7fb7c959a640 1 -- 172.21.15.19:0/971221464 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4036070 con 0x7fb7cc0b64c0 2024-09-12T02:05:58.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.626+0000 7fb7c959a640 1 -- 172.21.15.19:0/971221464 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c4031600 con 0x7fb7cc0b64c0 2024-09-12T02:05:58.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.626+0000 7fb7c959a640 1 -- 172.21.15.19:0/971221464 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c40319d0 con 0x7fb7cc0b64c0 2024-09-12T02:05:58.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.626+0000 7fb7d0dcd640 1 -- 172.21.15.19:0/971221464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7cc0b64c0 msgr2=0x7fb7cc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:58.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.626+0000 7fb7d0dcd640 1 --2- 172.21.15.19:0/971221464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7cc0b64c0 0x7fb7cc06d9c0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc08e520 tx=0x7fb7c402a730 comp rx=0 tx=0).stop 2024-09-12T02:05:58.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.627+0000 7fb7d0dcd640 1 -- 172.21.15.19:0/971221464 shutdown_connections 2024-09-12T02:05:58.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.627+0000 7fb7d0dcd640 1 --2- 172.21.15.19:0/971221464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7cc0b64c0 0x7fb7cc06d9c0 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.627+0000 7fb7d0dcd640 1 --2- 172.21.15.19:0/971221464 >> v2:172.21.15.135:3300/0 conn(0x7fb7cc0d30f0 0x7fb7cc0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.627+0000 7fb7d0dcd640 1 -- 172.21.15.19:0/971221464 >> 172.21.15.19:0/971221464 conn(0x7fb7cc08bfc0 msgr2=0x7fb7cc0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:58.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.627+0000 7fb7d0dcd640 1 -- 172.21.15.19:0/971221464 shutdown_connections 2024-09-12T02:05:58.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.627+0000 7fb7d0dcd640 1 -- 172.21.15.19:0/971221464 wait complete. 2024-09-12T02:05:58.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.628+0000 7fb7d0dcd640 1 Processor -- start 2024-09-12T02:05:58.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.628+0000 7fb7d0dcd640 1 -- start start 2024-09-12T02:05:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.629+0000 7fb7d0dcd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7cc0b64c0 0x7fb7cc0b9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.629+0000 7fb7d0dcd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7cc0d30f0 0x7fb7cc0b9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.629+0000 7fb7d0dcd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7cc15e5f0 0x7fb7cc15d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.629+0000 7fb7d0dcd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc06df00 con 0x7fb7cc0b64c0 2024-09-12T02:05:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.629+0000 7fb7d0dcd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc15e9d0 con 0x7fb7cc0d30f0 2024-09-12T02:05:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.629+0000 7fb7d0dcd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb7cc06e080 con 0x7fb7cc15e5f0 2024-09-12T02:05:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.629+0000 7fb7ca59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7cc0b64c0 0x7fb7cc0b9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.629+0000 7fb7ca59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7cc0b64c0 0x7fb7cc0b9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55376/0 (socket says 172.21.15.19:55376) 2024-09-12T02:05:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.629+0000 7fb7ca59c640 1 -- 172.21.15.19:0/1443965095 learned_addr learned my addr 172.21.15.19:0/1443965095 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.629+0000 7fb7c9d9b640 1 --2- 172.21.15.19:0/1443965095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7cc0d30f0 0x7fb7cc0b9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.629+0000 7fb7cad9d640 1 --2- 172.21.15.19:0/1443965095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7cc15e5f0 0x7fb7cc15d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:58.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.629+0000 7fb7ca59c640 1 -- 172.21.15.19:0/1443965095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7cc15e5f0 msgr2=0x7fb7cc15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:58.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.629+0000 7fb7ca59c640 1 --2- 172.21.15.19:0/1443965095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7cc15e5f0 0x7fb7cc15d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.629+0000 7fb7ca59c640 1 -- 172.21.15.19:0/1443965095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7cc0d30f0 msgr2=0x7fb7cc0b9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:58.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.629+0000 7fb7ca59c640 1 --2- 172.21.15.19:0/1443965095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7cc0d30f0 0x7fb7cc0b9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.629+0000 7fb7ca59c640 1 -- 172.21.15.19:0/1443965095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc1e9a10 con 0x7fb7cc0b64c0 2024-09-12T02:05:58.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.629+0000 7fb7ca59c640 1 --2- 172.21.15.19:0/1443965095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7cc0b64c0 0x7fb7cc0b9520 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00c3c0 tx=0x7fb7bc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:58.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.630+0000 7fb7baffd640 1 -- 172.21.15.19:0/1443965095 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc0052d0 con 0x7fb7cc0b64c0 2024-09-12T02:05:58.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.630+0000 7fb7baffd640 1 -- 172.21.15.19:0/1443965095 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7bc005490 con 0x7fb7cc0b64c0 2024-09-12T02:05:58.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.630+0000 7fb7d0dcd640 1 -- 172.21.15.19:0/1443965095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7cc1e9cf0 con 0x7fb7cc0b64c0 2024-09-12T02:05:58.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.630+0000 7fb7baffd640 1 -- 172.21.15.19:0/1443965095 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc007260 con 0x7fb7cc0b64c0 2024-09-12T02:05:58.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.630+0000 7fb7d0dcd640 1 -- 172.21.15.19:0/1443965095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7cc1ea2b0 con 0x7fb7cc0b64c0 2024-09-12T02:05:58.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.631+0000 7fb7d0dcd640 1 -- 172.21.15.19:0/1443965095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7cc06d9c0 con 0x7fb7cc0b64c0 2024-09-12T02:05:58.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.631+0000 7fb7baffd640 1 -- 172.21.15.19:0/1443965095 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7bc007400 con 0x7fb7cc0b64c0 2024-09-12T02:05:58.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.632+0000 7fb7baffd640 1 --2- 172.21.15.19:0/1443965095 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb7ac06be30 0x7fb7ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:58.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.632+0000 7fb7baffd640 1 -- 172.21.15.19:0/1443965095 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 9141+0+0 (secure 0 0 0) 0x7fb7bc08afc0 con 0x7fb7cc0b64c0 2024-09-12T02:05:58.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.632+0000 7fb7c9d9b640 1 --2- 172.21.15.19:0/1443965095 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb7ac06be30 0x7fb7ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:58.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.632+0000 7fb7c9d9b640 1 --2- 172.21.15.19:0/1443965095 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb7ac06be30 0x7fb7ac06e2f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc15dd70 tx=0x7fb7c0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:58.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.636+0000 7fb7baffd640 1 -- 172.21.15.19:0/1443965095 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7bc0585f0 con 0x7fb7cc0b64c0 2024-09-12T02:05:58.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:58.886+0000 7fb7d0dcd640 1 -- 172.21.15.19:0/1443965095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7fb7cc0b6cf0 con 0x7fb7cc0b64c0 2024-09-12T02:05:59.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.506+0000 7fb7baffd640 1 -- 172.21.15.19:0/1443965095 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v282) ==== 107+0+0 (secure 0 0 0) 0x7fb7bc05c8f0 con 0x7fb7cc0b64c0 2024-09-12T02:05:59.507 INFO:teuthology.orchestra.run.smithi019.stderr:nothing to do: rank is not damaged 2024-09-12T02:05:59.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.509+0000 7fb7d0dcd640 1 -- 172.21.15.19:0/1443965095 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb7ac06be30 msgr2=0x7fb7ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.509+0000 7fb7d0dcd640 1 --2- 172.21.15.19:0/1443965095 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb7ac06be30 0x7fb7ac06e2f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc15dd70 tx=0x7fb7c0009190 comp rx=0 tx=0).stop 2024-09-12T02:05:59.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.509+0000 7fb7d0dcd640 1 -- 172.21.15.19:0/1443965095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7cc0b64c0 msgr2=0x7fb7cc0b9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.509+0000 7fb7d0dcd640 1 --2- 172.21.15.19:0/1443965095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7cc0b64c0 0x7fb7cc0b9520 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00c3c0 tx=0x7fb7bc00c880 comp rx=0 tx=0).stop 2024-09-12T02:05:59.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.509+0000 7fb7d0dcd640 1 -- 172.21.15.19:0/1443965095 shutdown_connections 2024-09-12T02:05:59.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.509+0000 7fb7d0dcd640 1 --2- 172.21.15.19:0/1443965095 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb7ac06be30 0x7fb7ac06e2f0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.509+0000 7fb7d0dcd640 1 --2- 172.21.15.19:0/1443965095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7cc15e5f0 0x7fb7cc15d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.509+0000 7fb7d0dcd640 1 --2- 172.21.15.19:0/1443965095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7cc0d30f0 0x7fb7cc0b9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.509+0000 7fb7d0dcd640 1 --2- 172.21.15.19:0/1443965095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7cc0b64c0 0x7fb7cc0b9520 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.509+0000 7fb7d0dcd640 1 -- 172.21.15.19:0/1443965095 >> 172.21.15.19:0/1443965095 conn(0x7fb7cc08bfc0 msgr2=0x7fb7cc0d0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:59.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.510+0000 7fb7d0dcd640 1 -- 172.21.15.19:0/1443965095 shutdown_connections 2024-09-12T02:05:59.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.510+0000 7fb7d0dcd640 1 -- 172.21.15.19:0/1443965095 wait complete. 2024-09-12T02:05:59.524 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:05:59.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.611+0000 7f71b1353f40 1 Processor -- start 2024-09-12T02:05:59.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.611+0000 7f71b1353f40 1 -- start start 2024-09-12T02:05:59.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.611+0000 7f71b1353f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d632118e0 0x560d631ff970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.612+0000 7f71b1353f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d632d0730 0x560d632ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.612+0000 7f71b1353f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d632e7960 0x560d63210be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.612+0000 7f71b1353f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560d632404e0 con 0x560d632118e0 2024-09-12T02:05:59.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.612+0000 7f71b1353f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560d63163510 con 0x560d632e7960 2024-09-12T02:05:59.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.612+0000 7f71b1353f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560d6323f970 con 0x560d632d0730 2024-09-12T02:05:59.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.612+0000 7f71aee49640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d632118e0 0x560d631ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.612+0000 7f71aee49640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d632118e0 0x560d631ff970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55384/0 (socket says 172.21.15.19:55384) 2024-09-12T02:05:59.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.612+0000 7f71aee49640 1 -- 172.21.15.19:0/221172148 learned_addr learned my addr 172.21.15.19:0/221172148 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:59.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.612+0000 7f71aee49640 1 -- 172.21.15.19:0/221172148 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d632d0730 msgr2=0x560d632ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:59.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.612+0000 7f71aee49640 1 --2- 172.21.15.19:0/221172148 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d632d0730 0x560d632ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.612+0000 7f71aee49640 1 -- 172.21.15.19:0/221172148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d632e7960 msgr2=0x560d63210be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:59.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.612+0000 7f71aee49640 1 --2- 172.21.15.19:0/221172148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d632e7960 0x560d63210be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.612+0000 7f71aee49640 1 -- 172.21.15.19:0/221172148 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d632ce9e0 con 0x560d632118e0 2024-09-12T02:05:59.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.612+0000 7f71aee49640 1 --2- 172.21.15.19:0/221172148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d632118e0 0x560d631ff970 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f71a00017b0 tx=0x7f71a0001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d289dc5d67a9edb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:59.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.612+0000 7f71ad646640 1 -- 172.21.15.19:0/221172148 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a0003650 con 0x560d632118e0 2024-09-12T02:05:59.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.612+0000 7f71ad646640 1 -- 172.21.15.19:0/221172148 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a00037f0 con 0x560d632118e0 2024-09-12T02:05:59.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.612+0000 7f71ad646640 1 -- 172.21.15.19:0/221172148 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a0003c00 con 0x560d632118e0 2024-09-12T02:05:59.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.613+0000 7f71b1353f40 1 -- 172.21.15.19:0/221172148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d632118e0 msgr2=0x560d631ff970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.613+0000 7f71b1353f40 1 --2- 172.21.15.19:0/221172148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d632118e0 0x560d631ff970 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f71a00017b0 tx=0x7f71a0001c70 comp rx=0 tx=0).stop 2024-09-12T02:05:59.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.613+0000 7f71b1353f40 1 -- 172.21.15.19:0/221172148 shutdown_connections 2024-09-12T02:05:59.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.613+0000 7f71b1353f40 1 --2- 172.21.15.19:0/221172148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d632e7960 0x560d63210be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.613+0000 7f71b1353f40 1 --2- 172.21.15.19:0/221172148 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d632d0730 0x560d632ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.613+0000 7f71b1353f40 1 --2- 172.21.15.19:0/221172148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d632118e0 0x560d631ff970 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.613+0000 7f71b1353f40 1 -- 172.21.15.19:0/221172148 >> 172.21.15.19:0/221172148 conn(0x560d63212ad0 msgr2=0x560d632e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:59.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.613+0000 7f71b1353f40 1 -- 172.21.15.19:0/221172148 shutdown_connections 2024-09-12T02:05:59.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.613+0000 7f71b1353f40 1 -- 172.21.15.19:0/221172148 wait complete. 2024-09-12T02:05:59.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.613+0000 7f71b1353f40 1 Processor -- start 2024-09-12T02:05:59.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.614+0000 7f71b1353f40 1 -- start start 2024-09-12T02:05:59.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.614+0000 7f71b1353f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d632118e0 0x560d632572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.614+0000 7f71b1353f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d632d0730 0x560d632cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.614+0000 7f71b1353f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d632e7960 0x560d63210be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.614+0000 7f71b1353f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560d632ea500 con 0x560d632e7960 2024-09-12T02:05:59.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.614+0000 7f71b1353f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560d631ffeb0 con 0x560d632d0730 2024-09-12T02:05:59.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.614+0000 7f71b1353f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560d632cef50 con 0x560d632118e0 2024-09-12T02:05:59.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.614+0000 7f71af64a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d632e7960 0x560d63210be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.614+0000 7f71af64a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d632e7960 0x560d63210be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55396/0 (socket says 172.21.15.19:55396) 2024-09-12T02:05:59.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.614+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 learned_addr learned my addr 172.21.15.19:0/3375056305 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:59.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.615+0000 7f71aee49640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d632118e0 0x560d632572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.615+0000 7f71ae648640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d632d0730 0x560d632cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.615+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d632118e0 msgr2=0x560d632572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.615+0000 7f71af64a640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d632118e0 0x560d632572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.615+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d632d0730 msgr2=0x560d632cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.615+0000 7f71af64a640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d632d0730 0x560d632cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.615+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d632caec0 con 0x560d632e7960 2024-09-12T02:05:59.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.615+0000 7f71aee49640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560d632118e0 0x560d632572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:59.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.615+0000 7f71ae648640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d632d0730 0x560d632cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:59.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.615+0000 7f71af64a640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d632e7960 0x560d63210be0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f71a8025d40 tx=0x7f71a80058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:59.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.615+0000 7f7197fff640 1 -- 172.21.15.19:0/3375056305 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8069070 con 0x560d632e7960 2024-09-12T02:05:59.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.615+0000 7f7197fff640 1 -- 172.21.15.19:0/3375056305 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a80517d0 con 0x560d632e7960 2024-09-12T02:05:59.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.615+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560d632cb1a0 con 0x560d632e7960 2024-09-12T02:05:59.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.615+0000 7f7197fff640 1 -- 172.21.15.19:0/3375056305 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8055070 con 0x560d632e7960 2024-09-12T02:05:59.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.615+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d632cf6c0 con 0x560d632e7960 2024-09-12T02:05:59.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.617+0000 7f7197fff640 1 -- 172.21.15.19:0/3375056305 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f71a806c070 con 0x560d632e7960 2024-09-12T02:05:59.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.617+0000 7f7197fff640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f719c06a810 0x7f719c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.617+0000 7f7197fff640 1 -- 172.21.15.19:0/3375056305 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 9141+0+0 (secure 0 0 0) 0x7f71a80ce000 con 0x560d632e7960 2024-09-12T02:05:59.621 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:05:59.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.617+0000 7f71aee49640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f719c06a810 0x7f719c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.617+0000 7f71b1353f40 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560d632e5c40 0x560d63255300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.618+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d63255840 con 0x560d632e5c40 2024-09-12T02:05:59.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.618+0000 7f71ae648640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560d632e5c40 0x560d63255300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.618+0000 7f71ae648640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560d632e5c40 0x560d63255300 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:59.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.618+0000 7f71aee49640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f719c06a810 0x7f719c06ccd0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f71a00017b0 tx=0x7f71a0008070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:59.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.620+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v128'1033 uv1007 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.620+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d63255be0 con 0x560d632e5c40 2024-09-12T02:05:59.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.621+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v128'1034 uv1034 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.621+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d63389c00 con 0x560d632e5c40 2024-09-12T02:05:59.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.622+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v128'1035 uv1035 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.623 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:05:59.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.622+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338afb0 con 0x560d632e5c40 2024-09-12T02:05:59.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.624+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v128'1036 uv1036 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.624+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338b350 con 0x560d632e5c40 2024-09-12T02:05:59.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.625+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v128'1037 uv1037 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.625+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d63389fa0 con 0x560d632e5c40 2024-09-12T02:05:59.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.626+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v128'1038 uv1038 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.626+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a390 con 0x560d632e5c40 2024-09-12T02:05:59.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.627+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v128'1039 uv1013 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.627+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a390 con 0x560d632e5c40 2024-09-12T02:05:59.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.628+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v128'1040 uv1040 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.628+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a390 con 0x560d632e5c40 2024-09-12T02:05:59.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.629+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v128'1041 uv1041 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.630 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:05:59.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.630+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a390 con 0x560d632e5c40 2024-09-12T02:05:59.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.631+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v128'1042 uv1042 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.631+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a390 con 0x560d632e5c40 2024-09-12T02:05:59.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.632+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v128'1043 uv1043 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.632+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a390 con 0x560d632e5c40 2024-09-12T02:05:59.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.633+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v128'1044 uv1044 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.633+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a390 con 0x560d632e5c40 2024-09-12T02:05:59.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.634+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v128'1045 uv1020 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.634+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a390 con 0x560d632e5c40 2024-09-12T02:05:59.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.635+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v128'1046 uv1046 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.635+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a390 con 0x560d632e5c40 2024-09-12T02:05:59.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.637+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v128'1047 uv1047 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.637 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:05:59.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.637+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a390 con 0x560d632e5c40 2024-09-12T02:05:59.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.638+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v128'1048 uv1048 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.638+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a390 con 0x560d632e5c40 2024-09-12T02:05:59.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.639+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v128'1049 uv1049 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.639+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a390 con 0x560d632e5c40 2024-09-12T02:05:59.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.640+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v128'1050 uv1050 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.640+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a810 con 0x560d632e5c40 2024-09-12T02:05:59.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.642+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v128'1051 uv1051 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.642+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a640 con 0x560d632e5c40 2024-09-12T02:05:59.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.643+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v128'1052 uv1026 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.643+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a640 con 0x560d632e5c40 2024-09-12T02:05:59.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.644+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v128'1053 uv1053 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.644+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a640 con 0x560d632e5c40 2024-09-12T02:05:59.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.645+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v128'1054 uv1054 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.646 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:05:59.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.645+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a640 con 0x560d632e5c40 2024-09-12T02:05:59.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.646+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v128'1055 uv1055 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.646+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a640 con 0x560d632e5c40 2024-09-12T02:05:59.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.648+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v128'1056 uv1056 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.648+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a640 con 0x560d632e5c40 2024-09-12T02:05:59.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.649+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v128'1057 uv1057 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.649+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a640 con 0x560d632e5c40 2024-09-12T02:05:59.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.650+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v128'1058 uv1032 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.650+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a640 con 0x560d632e5c40 2024-09-12T02:05:59.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.651+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v128'1059 uv1059 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.651+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a640 con 0x560d632e5c40 2024-09-12T02:05:59.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.652+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v128'1060 uv1060 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.653 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:05:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.652+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a640 con 0x560d632e5c40 2024-09-12T02:05:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.653+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v128'1061 uv1061 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.653+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a640 con 0x560d632e5c40 2024-09-12T02:05:59.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.654+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v128'1062 uv1062 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.654+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338a640 con 0x560d632e5c40 2024-09-12T02:05:59.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.655+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v128'1063 uv1063 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d632e5c40 2024-09-12T02:05:59.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.656+0000 7f71b1353f40 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560d6338b6f0 0x560d6338dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.656+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338e020 con 0x560d6338b6f0 2024-09-12T02:05:59.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.656+0000 7f71aee49640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560d6338b6f0 0x560d6338dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.656+0000 7f71aee49640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560d6338b6f0 0x560d6338dae0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:59.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.658+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v128'753 uv732 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.658+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6338e3c0 con 0x560d6338b6f0 2024-09-12T02:05:59.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.660+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v128'754 uv754 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.660+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338e760 con 0x560d6338b6f0 2024-09-12T02:05:59.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.661+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v128'755 uv755 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.662 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:05:59.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.661+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338efb0 con 0x560d6338b6f0 2024-09-12T02:05:59.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.663+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v128'756 uv756 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.663+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338f350 con 0x560d6338b6f0 2024-09-12T02:05:59.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.664+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v128'757 uv757 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.664+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338f6f0 con 0x560d6338b6f0 2024-09-12T02:05:59.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.665+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v128'758 uv751 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.665+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6338fa90 con 0x560d6338b6f0 2024-09-12T02:05:59.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.667+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v128'759 uv759 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.667+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338fa90 con 0x560d6338b6f0 2024-09-12T02:05:59.668 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:05:59.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.668+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v128'760 uv760 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.668+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338fa90 con 0x560d6338b6f0 2024-09-12T02:05:59.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.670+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v128'761 uv761 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.670+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338fa90 con 0x560d6338b6f0 2024-09-12T02:05:59.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.671+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v128'762 uv762 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.671+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338fa90 con 0x560d6338b6f0 2024-09-12T02:05:59.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.672+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v128'763 uv752 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.672+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6338fa90 con 0x560d6338b6f0 2024-09-12T02:05:59.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.674+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v128'764 uv764 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.674+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338fa90 con 0x560d6338b6f0 2024-09-12T02:05:59.675 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:05:59.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.675+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v128'765 uv765 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.675+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d63393f10 con 0x560d6338b6f0 2024-09-12T02:05:59.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.676+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v128'766 uv766 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.677+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d63393f10 con 0x560d6338b6f0 2024-09-12T02:05:59.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.678+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v128'767 uv767 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.678+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338fa90 con 0x560d6338b6f0 2024-09-12T02:05:59.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.679+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v128'768 uv748 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.679+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6338fa90 con 0x560d6338b6f0 2024-09-12T02:05:59.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.680+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v128'769 uv769 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.680+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338fa90 con 0x560d6338b6f0 2024-09-12T02:05:59.682 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:05:59.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.681+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v128'770 uv770 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.682+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d63390aa0 con 0x560d6338b6f0 2024-09-12T02:05:59.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.683+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v128'771 uv771 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.683+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d63390aa0 con 0x560d6338b6f0 2024-09-12T02:05:59.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.684+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v128'772 uv772 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.684+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6338fa90 con 0x560d6338b6f0 2024-09-12T02:05:59.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.685+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v128'773 uv773 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d6338b6f0 2024-09-12T02:05:59.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.685+0000 7f71b1353f40 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560d6338ffa0 0x560d63392390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.685+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d633928d0 con 0x560d6338ffa0 2024-09-12T02:05:59.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.686+0000 7f71ae648640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560d6338ffa0 0x560d63392390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.686+0000 7f71ae648640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560d6338ffa0 0x560d63392390 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:59.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.687+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v128'201 uv200 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.687+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d633928d0 con 0x560d6338ffa0 2024-09-12T02:05:59.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.689+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v128'202 uv202 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.689+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d633928d0 con 0x560d6338ffa0 2024-09-12T02:05:59.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.690+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v128'203 uv203 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.690 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:05:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.690+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d633938e0 con 0x560d6338ffa0 2024-09-12T02:05:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.691+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v128'204 uv204 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.691+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d633938e0 con 0x560d6338ffa0 2024-09-12T02:05:59.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.692+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v128'205 uv205 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.692+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d633928d0 con 0x560d6338ffa0 2024-09-12T02:05:59.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.693+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v128'206 uv206 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.693+0000 7f71b1353f40 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560d63392f50 0x560d63395340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.693+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d633959f0 con 0x560d63392f50 2024-09-12T02:05:59.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.693+0000 7f71af64a640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560d63392f50 0x560d63395340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.693+0000 7f71af64a640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560d63392f50 0x560d63395340 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:59.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.695+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v128'150 uv149 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.695+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d63395f00 con 0x560d63392f50 2024-09-12T02:05:59.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.696+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v128'151 uv151 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.696+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d63396400 con 0x560d63392f50 2024-09-12T02:05:59.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.697+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v128'152 uv152 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.698 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:05:59.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.697+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d63396cc0 con 0x560d63392f50 2024-09-12T02:05:59.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.698+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v128'153 uv153 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.698+0000 7f71b1353f40 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560d63397570 0x560d63399960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.698+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d63399ea0 con 0x560d63397570 2024-09-12T02:05:59.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.698+0000 7f71aee49640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560d63397570 0x560d63399960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.699+0000 7f71aee49640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560d63397570 0x560d63399960 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:59.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.700+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v128'201 uv200 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.700+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d63399f60 con 0x560d63397570 2024-09-12T02:05:59.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.701+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v128'202 uv202 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.701+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339a380 con 0x560d63397570 2024-09-12T02:05:59.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.703+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v128'203 uv203 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.704 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:05:59.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.703+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339b390 con 0x560d63397570 2024-09-12T02:05:59.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.704+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v128'204 uv204 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.704+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339b390 con 0x560d63397570 2024-09-12T02:05:59.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.705+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v128'205 uv205 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.705+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339a380 con 0x560d63397570 2024-09-12T02:05:59.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.706+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v128'206 uv206 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.706+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339a380 con 0x560d63392f50 2024-09-12T02:05:59.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.708+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v128'371 uv365 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.708+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6339a720 con 0x560d63392f50 2024-09-12T02:05:59.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.709+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v128'372 uv372 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.709+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339aac0 con 0x560d63392f50 2024-09-12T02:05:59.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.710+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v128'373 uv373 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.711 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:05:59.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.710+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339bad0 con 0x560d63392f50 2024-09-12T02:05:59.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.711+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v128'374 uv374 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.711+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339bad0 con 0x560d63392f50 2024-09-12T02:05:59.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.713+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v128'375 uv375 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.713+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339aac0 con 0x560d63392f50 2024-09-12T02:05:59.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.714+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v128'376 uv376 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.714+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339aac0 con 0x560d63392f50 2024-09-12T02:05:59.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.715+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v128'377 uv370 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.715+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6339aac0 con 0x560d63392f50 2024-09-12T02:05:59.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.716+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v128'378 uv378 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.716+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339aac0 con 0x560d63392f50 2024-09-12T02:05:59.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.718+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v128'379 uv379 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.718 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:05:59.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.718+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339aac0 con 0x560d63392f50 2024-09-12T02:05:59.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.719+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v128'380 uv380 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.719+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339aac0 con 0x560d63392f50 2024-09-12T02:05:59.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.720+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v128'381 uv381 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.720+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339aac0 con 0x560d63392f50 2024-09-12T02:05:59.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.721+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v128'168 uv167 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.721+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6339aac0 con 0x560d63392f50 2024-09-12T02:05:59.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.723+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v128'169 uv169 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.723+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339aac0 con 0x560d63392f50 2024-09-12T02:05:59.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.724+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v128'170 uv170 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.724 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:05:59.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.724+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339aac0 con 0x560d63392f50 2024-09-12T02:05:59.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.725+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v128'171 uv171 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.725+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339aac0 con 0x560d63392f50 2024-09-12T02:05:59.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.726+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v128'172 uv172 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f71a806b030 con 0x560d63392f50 2024-09-12T02:05:59.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.726+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339aac0 con 0x560d63397570 2024-09-12T02:05:59.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.727+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v128'201 uv200 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.727+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6339aac0 con 0x560d63397570 2024-09-12T02:05:59.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.728+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v128'202 uv202 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.728+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339aac0 con 0x560d63397570 2024-09-12T02:05:59.729 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:05:59.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.729+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v128'203 uv203 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.729+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339bf10 con 0x560d63397570 2024-09-12T02:05:59.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.730+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v128'204 uv204 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.730+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339bf10 con 0x560d63397570 2024-09-12T02:05:59.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.731+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v128'205 uv205 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.731+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339af00 con 0x560d63397570 2024-09-12T02:05:59.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.732+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v128'206 uv206 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.732+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339af00 con 0x560d63397570 2024-09-12T02:05:59.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.734+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v128'335 uv329 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.734+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6339af00 con 0x560d63397570 2024-09-12T02:05:59.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.735+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v128'336 uv336 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.735+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339af00 con 0x560d63397570 2024-09-12T02:05:59.736 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:05:59.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.736+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v128'337 uv337 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.736+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339af00 con 0x560d63397570 2024-09-12T02:05:59.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.737+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v128'338 uv338 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.737+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339af00 con 0x560d63397570 2024-09-12T02:05:59.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.738+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v128'339 uv339 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.738+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339af00 con 0x560d63397570 2024-09-12T02:05:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.739+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v128'340 uv334 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.739+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6339af00 con 0x560d63397570 2024-09-12T02:05:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.740+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v128'341 uv341 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.740+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339af00 con 0x560d63397570 2024-09-12T02:05:59.741 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:05:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.741+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v128'342 uv342 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.741+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339af00 con 0x560d63397570 2024-09-12T02:05:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.742+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v128'343 uv343 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.742+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dd10 con 0x560d63397570 2024-09-12T02:05:59.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.743+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v128'344 uv344 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.743+0000 7f71b1353f40 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560d6339b8c0 0x560d6339e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.743+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6339b8c0 2024-09-12T02:05:59.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.743+0000 7f71ae648640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560d6339b8c0 0x560d6339e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.744+0000 7f71ae648640 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560d6339b8c0 0x560d6339e130 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.745+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v128'147 uv145 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6339b8c0 2024-09-12T02:05:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.745+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6339b8c0 2024-09-12T02:05:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.746+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v128'148 uv148 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6339b8c0 2024-09-12T02:05:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.746+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6339b8c0 2024-09-12T02:05:59.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.747+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v128'149 uv149 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6339b8c0 2024-09-12T02:05:59.747 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:05:59.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.747+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6339b8c0 2024-09-12T02:05:59.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.748+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v128'150 uv150 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6339b8c0 2024-09-12T02:05:59.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.748+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d63397570 2024-09-12T02:05:59.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.749+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v128'201 uv200 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.749+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d63397570 2024-09-12T02:05:59.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.750+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v128'202 uv202 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.750+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d63397570 2024-09-12T02:05:59.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.751+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v128'203 uv203 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.752 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:05:59.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.751+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d63397570 2024-09-12T02:05:59.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.752+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v128'204 uv204 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.752+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d63397570 2024-09-12T02:05:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.753+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v128'205 uv205 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.753+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d63397570 2024-09-12T02:05:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.754+0000 7f71aee49640 1 -- 172.21.15.19:0/3375056305 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v128'206 uv206 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a000f030 con 0x560d63397570 2024-09-12T02:05:59.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.754+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6338ffa0 2024-09-12T02:05:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.755+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v128'171 uv170 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.755+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6338ffa0 2024-09-12T02:05:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.757+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v128'172 uv172 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.757+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6338ffa0 2024-09-12T02:05:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.758+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v128'173 uv173 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.758 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:05:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.758+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6338ffa0 2024-09-12T02:05:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.759+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v128'174 uv174 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.759+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6338ffa0 2024-09-12T02:05:59.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.760+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v128'175 uv175 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.760+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6338ffa0 2024-09-12T02:05:59.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.761+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v128'416 uv406 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.761+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6338ffa0 2024-09-12T02:05:59.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.762+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v128'417 uv417 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.762+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6338ffa0 2024-09-12T02:05:59.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.763+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v128'418 uv418 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.764 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:05:59.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.763+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6338ffa0 2024-09-12T02:05:59.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.764+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v128'419 uv419 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.764+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6338ffa0 2024-09-12T02:05:59.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.765+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v128'420 uv420 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.765+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6338ffa0 2024-09-12T02:05:59.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.767+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v128'421 uv414 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.767+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6338ffa0 2024-09-12T02:05:59.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.768+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v128'422 uv422 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.768+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6338ffa0 2024-09-12T02:05:59.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.769+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v128'423 uv423 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.769 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:05:59.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.769+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6338ffa0 2024-09-12T02:05:59.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.770+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v128'424 uv424 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.770+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6338ffa0 2024-09-12T02:05:59.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.770+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v128'425 uv425 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.770+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339dcb0 con 0x560d6338ffa0 2024-09-12T02:05:59.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.771+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v128'426 uv426 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.771+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x560d6339e670 con 0x560d6338ffa0 2024-09-12T02:05:59.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71ae648640 1 -- 172.21.15.19:0/3375056305 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v128'427 uv427 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f71a40098b0 con 0x560d6338ffa0 2024-09-12T02:05:59.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560d6338b6f0 msgr2=0x560d6338dae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x560d6338b6f0 0x560d6338dae0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560d632e5c40 msgr2=0x560d63255300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x560d632e5c40 0x560d63255300 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560d63392f50 msgr2=0x560d63395340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x560d63392f50 0x560d63395340 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560d6339b8c0 msgr2=0x560d6339e130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x560d6339b8c0 0x560d6339e130 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 reap_dead start 2024-09-12T02:05:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560d6338ffa0 msgr2=0x560d63392390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x560d6338ffa0 0x560d63392390 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560d63397570 msgr2=0x560d63399960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x560d63397570 0x560d63399960 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71af64a640 1 -- 172.21.15.19:0/3375056305 reap_dead start 2024-09-12T02:05:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f719c06a810 msgr2=0x7f719c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f719c06a810 0x7f719c06ccd0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f71a00017b0 tx=0x7f71a0008070 comp rx=0 tx=0).stop 2024-09-12T02:05:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d632e7960 msgr2=0x560d63210be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d632e7960 0x560d63210be0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f71a8025d40 tx=0x7f71a80058b0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 shutdown_connections 2024-09-12T02:05:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f719c06a810 0x7f719c06ccd0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 --2- 172.21.15.19:0/3375056305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d632e7960 0x560d63210be0 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 >> 172.21.15.19:0/3375056305 conn(0x560d63212ad0 msgr2=0x560d63257d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:59.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 shutdown_connections 2024-09-12T02:05:59.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.773+0000 7f71b1353f40 1 -- 172.21.15.19:0/3375056305 wait complete. 2024-09-12T02:05:59.777 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapheader 10000000000.00000000 deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-09-12T02:05:59.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.862+0000 7f1ccd9ccf40 1 Processor -- start 2024-09-12T02:05:59.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.862+0000 7f1ccd9ccf40 1 -- start start 2024-09-12T02:05:59.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.862+0000 7f1ccd9ccf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56301ae09350 0x56301aebefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.862+0000 7f1ccd9ccf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56301ae37050 0x56301aee0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.863+0000 7f1ccd9ccf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56301aec1080 0x56301aee1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.863+0000 7f1ccd9ccf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56301ad58510 con 0x56301ae37050 2024-09-12T02:05:59.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.863+0000 7f1ccd9ccf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56301adb1c50 con 0x56301ae09350 2024-09-12T02:05:59.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.863+0000 7f1ccd9ccf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56301ae05dc0 con 0x56301aec1080 2024-09-12T02:05:59.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.863+0000 7f1ccacc1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56301ae37050 0x56301aee0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.863+0000 7f1ccacc1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56301ae37050 0x56301aee0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55400/0 (socket says 172.21.15.19:55400) 2024-09-12T02:05:59.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.863+0000 7f1ccacc1640 1 -- 172.21.15.19:0/1627130411 learned_addr learned my addr 172.21.15.19:0/1627130411 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:59.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.863+0000 7f1ccb4c2640 1 --2- 172.21.15.19:0/1627130411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56301ae09350 0x56301aebefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.863+0000 7f1ccbcc3640 1 --2- 172.21.15.19:0/1627130411 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56301aec1080 0x56301aee1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.863+0000 7f1ccacc1640 1 -- 172.21.15.19:0/1627130411 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56301aec1080 msgr2=0x56301aee1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:59.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.863+0000 7f1ccacc1640 1 --2- 172.21.15.19:0/1627130411 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56301aec1080 0x56301aee1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.863+0000 7f1ccacc1640 1 -- 172.21.15.19:0/1627130411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56301ae09350 msgr2=0x56301aebefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:05:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.863+0000 7f1ccacc1640 1 --2- 172.21.15.19:0/1627130411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56301ae09350 0x56301aebefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.863+0000 7f1ccacc1640 1 -- 172.21.15.19:0/1627130411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56301ae331b0 con 0x56301ae37050 2024-09-12T02:05:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.863+0000 7f1ccacc1640 1 --2- 172.21.15.19:0/1627130411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56301ae37050 0x56301aee0cd0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0001eb0 tx=0x7f1cc000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7320bce608220ad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.863+0000 7f1cc9cbf640 1 -- 172.21.15.19:0/1627130411 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0012020 con 0x56301ae37050 2024-09-12T02:05:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.863+0000 7f1cc9cbf640 1 -- 172.21.15.19:0/1627130411 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc000e670 con 0x56301ae37050 2024-09-12T02:05:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.863+0000 7f1cc9cbf640 1 -- 172.21.15.19:0/1627130411 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc000ea80 con 0x56301ae37050 2024-09-12T02:05:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.864+0000 7f1ccd9ccf40 1 -- 172.21.15.19:0/1627130411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56301ae37050 msgr2=0x56301aee0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.864+0000 7f1ccd9ccf40 1 --2- 172.21.15.19:0/1627130411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56301ae37050 0x56301aee0cd0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0001eb0 tx=0x7f1cc000b780 comp rx=0 tx=0).stop 2024-09-12T02:05:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.864+0000 7f1ccd9ccf40 1 -- 172.21.15.19:0/1627130411 shutdown_connections 2024-09-12T02:05:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.864+0000 7f1ccd9ccf40 1 --2- 172.21.15.19:0/1627130411 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56301aec1080 0x56301aee1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.864+0000 7f1ccd9ccf40 1 --2- 172.21.15.19:0/1627130411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56301ae37050 0x56301aee0cd0 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.864+0000 7f1ccd9ccf40 1 --2- 172.21.15.19:0/1627130411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56301ae09350 0x56301aebefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.864+0000 7f1ccd9ccf40 1 -- 172.21.15.19:0/1627130411 >> 172.21.15.19:0/1627130411 conn(0x56301ae069e0 msgr2=0x56301ae088b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.864+0000 7f1ccd9ccf40 1 -- 172.21.15.19:0/1627130411 shutdown_connections 2024-09-12T02:05:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.864+0000 7f1ccd9ccf40 1 -- 172.21.15.19:0/1627130411 wait complete. 2024-09-12T02:05:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.864+0000 7f1ccd9ccf40 1 Processor -- start 2024-09-12T02:05:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.864+0000 7f1ccd9ccf40 1 -- start start 2024-09-12T02:05:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.865+0000 7f1ccd9ccf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56301ae09350 0x56301aed9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.865+0000 7f1ccd9ccf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56301ae37050 0x56301aedd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.865+0000 7f1ccd9ccf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56301aec1080 0x56301aedd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.865+0000 7f1ccd9ccf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56301ae32ed0 con 0x56301aec1080 2024-09-12T02:05:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.865+0000 7f1ccd9ccf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56301ae4ce70 con 0x56301ae09350 2024-09-12T02:05:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.865+0000 7f1ccd9ccf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56301aec6ac0 con 0x56301ae37050 2024-09-12T02:05:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.865+0000 7f1ccbcc3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56301aec1080 0x56301aedd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.865+0000 7f1ccbcc3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56301aec1080 0x56301aedd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55414/0 (socket says 172.21.15.19:55414) 2024-09-12T02:05:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.865+0000 7f1ccbcc3640 1 -- 172.21.15.19:0/1982900300 learned_addr learned my addr 172.21.15.19:0/1982900300 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.865+0000 7f1ccb4c2640 1 --2- 172.21.15.19:0/1982900300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56301ae09350 0x56301aed9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.865+0000 7f1ccacc1640 1 --2- 172.21.15.19:0/1982900300 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56301ae37050 0x56301aedd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.866+0000 7f1ccbcc3640 1 -- 172.21.15.19:0/1982900300 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56301ae37050 msgr2=0x56301aedd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.866+0000 7f1ccbcc3640 1 --2- 172.21.15.19:0/1982900300 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56301ae37050 0x56301aedd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.866+0000 7f1ccbcc3640 1 -- 172.21.15.19:0/1982900300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56301ae09350 msgr2=0x56301aed9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.866+0000 7f1ccbcc3640 1 --2- 172.21.15.19:0/1982900300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56301ae09350 0x56301aed9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.866+0000 7f1ccbcc3640 1 -- 172.21.15.19:0/1982900300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56301aedc730 con 0x56301aec1080 2024-09-12T02:05:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.866+0000 7f1ccbcc3640 1 --2- 172.21.15.19:0/1982900300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56301aec1080 0x56301aedd860 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400a4a0 tx=0x7f1cc4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:59.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.866+0000 7f1cc8cbd640 1 -- 172.21.15.19:0/1982900300 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4069070 con 0x56301aec1080 2024-09-12T02:05:59.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.866+0000 7f1cc8cbd640 1 -- 172.21.15.19:0/1982900300 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc404fb90 con 0x56301aec1080 2024-09-12T02:05:59.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.866+0000 7f1ccd9ccf40 1 -- 172.21.15.19:0/1982900300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56301aeddec0 con 0x56301aec1080 2024-09-12T02:05:59.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.866+0000 7f1cc8cbd640 1 -- 172.21.15.19:0/1982900300 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4058400 con 0x56301aec1080 2024-09-12T02:05:59.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.866+0000 7f1ccd9ccf40 1 -- 172.21.15.19:0/1982900300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56301aebc960 con 0x56301aec1080 2024-09-12T02:05:59.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.867+0000 7f1cc8cbd640 1 -- 172.21.15.19:0/1982900300 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1cc40585a0 con 0x56301aec1080 2024-09-12T02:05:59.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.868+0000 7f1cc8cbd640 1 --2- 172.21.15.19:0/1982900300 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cb806a810 0x7f1cb806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.868+0000 7f1cc8cbd640 1 -- 172.21.15.19:0/1982900300 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 9141+0+0 (secure 0 0 0) 0x7f1cc40cdcc0 con 0x56301aec1080 2024-09-12T02:05:59.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.868+0000 7f1ccd9ccf40 1 --2- 172.21.15.19:0/1982900300 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56301aebd160 0x56301aebd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.868+0000 7f1ccd9ccf40 1 -- 172.21.15.19:0/1982900300 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) -- 0x56301aebdb30 con 0x56301aebd160 2024-09-12T02:05:59.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.868+0000 7f1ccb4c2640 1 --2- 172.21.15.19:0/1982900300 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cb806a810 0x7f1cb806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.868+0000 7f1ccacc1640 1 --2- 172.21.15.19:0/1982900300 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56301aebd160 0x56301aebd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.869+0000 7f1ccacc1640 1 --2- 172.21.15.19:0/1982900300 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56301aebd160 0x56301aebd5f0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:59.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.869+0000 7f1ccb4c2640 1 --2- 172.21.15.19:0/1982900300 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cb806a810 0x7f1cb806ccd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc011480 tx=0x7f1cbc0016f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:59.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.870+0000 7f1ccacc1640 1 -- 172.21.15.19:0/1982900300 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-header] v128'1064 uv1064 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1cc000e820 con 0x56301aebd160 2024-09-12T02:05:59.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.870+0000 7f1ccd9ccf40 1 -- 172.21.15.19:0/1982900300 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56301aebd160 msgr2=0x56301aebd5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.870+0000 7f1ccd9ccf40 1 --2- 172.21.15.19:0/1982900300 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x56301aebd160 0x56301aebd5f0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.870+0000 7f1ccd9ccf40 1 -- 172.21.15.19:0/1982900300 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cb806a810 msgr2=0x7f1cb806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.870+0000 7f1ccd9ccf40 1 --2- 172.21.15.19:0/1982900300 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cb806a810 0x7f1cb806ccd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc011480 tx=0x7f1cbc0016f0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.870+0000 7f1ccd9ccf40 1 -- 172.21.15.19:0/1982900300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56301aec1080 msgr2=0x56301aedd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.870+0000 7f1ccd9ccf40 1 --2- 172.21.15.19:0/1982900300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56301aec1080 0x56301aedd860 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400a4a0 tx=0x7f1cc4003330 comp rx=0 tx=0).stop 2024-09-12T02:05:59.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.870+0000 7f1ccbcc3640 1 -- 172.21.15.19:0/1982900300 reap_dead start 2024-09-12T02:05:59.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.870+0000 7f1ccd9ccf40 1 -- 172.21.15.19:0/1982900300 shutdown_connections 2024-09-12T02:05:59.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.870+0000 7f1ccd9ccf40 1 -- 172.21.15.19:0/1982900300 >> 172.21.15.19:0/1982900300 conn(0x56301ae069e0 msgr2=0x56301aee0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:59.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.870+0000 7f1ccd9ccf40 1 -- 172.21.15.19:0/1982900300 shutdown_connections 2024-09-12T02:05:59.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.870+0000 7f1ccd9ccf40 1 -- 172.21.15.19:0/1982900300 wait complete. 2024-09-12T02:05:59.877 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:05:59.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.981+0000 7f2ebb27b640 1 Processor -- start 2024-09-12T02:05:59.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.982+0000 7f2ebb27b640 1 -- start start 2024-09-12T02:05:59.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.982+0000 7f2ebb27b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2eb406d740 0x7f2eb40cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.982+0000 7f2ebb27b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb415ff70 con 0x7f2eb4162e30 2024-09-12T02:05:59.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.983+0000 7f2ebb27b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb40d4d10 con 0x7f2eb4162340 2024-09-12T02:05:59.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.983+0000 7f2ebb27b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb406de90 con 0x7f2eb406d740 2024-09-12T02:05:59.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.983+0000 7f2eb8816640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2eb4162e30 0x7f2eb40d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58422/0 (socket says 172.21.15.19:58422) 2024-09-12T02:05:59.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.983+0000 7f2eb8816640 1 -- 172.21.15.19:0/4021009395 learned_addr learned my addr 172.21.15.19:0/4021009395 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:05:59.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.983+0000 7f2eb9818640 1 --2- 172.21.15.19:0/4021009395 >> v2:172.21.15.135:3300/0 conn(0x7f2eb406d740 0x7f2eb40cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.983+0000 7f2eabfff640 1 -- 172.21.15.19:0/4021009395 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3341400772 0 0) 0x7f2eb415ff70 con 0x7f2eb4162e30 2024-09-12T02:05:59.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.983+0000 7f2eabfff640 1 -- 172.21.15.19:0/4021009395 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ea0003520 con 0x7f2eb4162e30 2024-09-12T02:05:59.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.983+0000 7f2eabfff640 1 -- 172.21.15.19:0/4021009395 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 650673574 0 0) 0x7f2ea0003520 con 0x7f2eb4162e30 2024-09-12T02:05:59.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.983+0000 7f2eb9818640 1 -- 172.21.15.19:0/4021009395 >> v1:172.21.15.135:6789/0 conn(0x7f2eb4162340 legacy=0x7f2eb4162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.983+0000 7f2eb9818640 1 -- 172.21.15.19:0/4021009395 >> v1:172.21.15.19:6789/0 conn(0x7f2eb4162e30 legacy=0x7f2eb40d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.983+0000 7f2eb9818640 1 -- 172.21.15.19:0/4021009395 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb40d4ff0 con 0x7f2eb406d740 2024-09-12T02:05:59.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.984+0000 7f2eb9818640 1 --2- 172.21.15.19:0/4021009395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb406d740 0x7f2eb40cf280 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009d90 tx=0x7f2eac02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0e667f969d12b35 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.984+0000 7f2eabfff640 1 -- 172.21.15.19:0/4021009395 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40017f0 con 0x7f2eb406d740 2024-09-12T02:05:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.984+0000 7f2eabfff640 1 -- 172.21.15.19:0/4021009395 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac007540 con 0x7f2eb406d740 2024-09-12T02:05:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.984+0000 7f2eabfff640 1 -- 172.21.15.19:0/4021009395 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac007910 con 0x7f2eb406d740 2024-09-12T02:05:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.985+0000 7f2ebb27b640 1 -- 172.21.15.19:0/4021009395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb406d740 msgr2=0x7f2eb40cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.985+0000 7f2ebb27b640 1 --2- 172.21.15.19:0/4021009395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb406d740 0x7f2eb40cf280 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009d90 tx=0x7f2eac02a5f0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.985+0000 7f2ebb27b640 1 -- 172.21.15.19:0/4021009395 shutdown_connections 2024-09-12T02:05:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.985+0000 7f2ebb27b640 1 --2- 172.21.15.19:0/4021009395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb406d740 0x7f2eb40cf280 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.985+0000 7f2ebb27b640 1 -- 172.21.15.19:0/4021009395 >> 172.21.15.19:0/4021009395 conn(0x7f2eb408bfc0 msgr2=0x7f2eb40d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.985+0000 7f2ebb27b640 1 -- 172.21.15.19:0/4021009395 shutdown_connections 2024-09-12T02:05:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.985+0000 7f2ebb27b640 1 -- 172.21.15.19:0/4021009395 wait complete. 2024-09-12T02:05:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.986+0000 7f2ebb27b640 1 Processor -- start 2024-09-12T02:05:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.986+0000 7f2ebb27b640 1 -- start start 2024-09-12T02:05:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2ebb27b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2eb406d740 0x7f2eb40cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2ebb27b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb4162340 0x7f2eb41538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2ebb27b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2eb4162e30 0x7f2eb40c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2ebb27b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb4163270 con 0x7f2eb4162e30 2024-09-12T02:05:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2ebb27b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb40cf7c0 con 0x7f2eb4162340 2024-09-12T02:05:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2ebb27b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb406dbb0 con 0x7f2eb406d740 2024-09-12T02:05:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2eb9818640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2eb4162e30 0x7f2eb40c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2eb9818640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2eb4162e30 0x7f2eb40c9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55428/0 (socket says 172.21.15.19:55428) 2024-09-12T02:05:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2eb9818640 1 -- 172.21.15.19:0/887744089 learned_addr learned my addr 172.21.15.19:0/887744089 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:05:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2eb8816640 1 --2- 172.21.15.19:0/887744089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb4162340 0x7f2eb41538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2eb9017640 1 --2- 172.21.15.19:0/887744089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2eb406d740 0x7f2eb40cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2eb9818640 1 -- 172.21.15.19:0/887744089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2eb406d740 msgr2=0x7f2eb40cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2eb9818640 1 --2- 172.21.15.19:0/887744089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2eb406d740 0x7f2eb40cdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2eb9818640 1 -- 172.21.15.19:0/887744089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb4162340 msgr2=0x7f2eb41538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2eb9818640 1 --2- 172.21.15.19:0/887744089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb4162340 0x7f2eb41538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2eb9818640 1 -- 172.21.15.19:0/887744089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb40c9f00 con 0x7f2eb4162e30 2024-09-12T02:05:59.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2eb8816640 1 --2- 172.21.15.19:0/887744089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb4162340 0x7f2eb41538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:59.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2eb9818640 1 --2- 172.21.15.19:0/887744089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2eb4162e30 0x7f2eb40c9600 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009d90 tx=0x7f2eac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:59.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2ea9ffb640 1 -- 172.21.15.19:0/887744089 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac040070 con 0x7f2eb4162e30 2024-09-12T02:05:59.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2ea9ffb640 1 -- 172.21.15.19:0/887744089 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac031bc0 con 0x7f2eb4162e30 2024-09-12T02:05:59.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2ebb27b640 1 -- 172.21.15.19:0/887744089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb40cd420 con 0x7f2eb4162e30 2024-09-12T02:05:59.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.987+0000 7f2ea9ffb640 1 -- 172.21.15.19:0/887744089 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac009450 con 0x7f2eb4162e30 2024-09-12T02:05:59.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.988+0000 7f2ebb27b640 1 -- 172.21.15.19:0/887744089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb4153e30 con 0x7f2eb4162e30 2024-09-12T02:05:59.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.989+0000 7f2ebb27b640 1 -- 172.21.15.19:0/887744089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb40d52d0 con 0x7f2eb4162e30 2024-09-12T02:05:59.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.989+0000 7f2ea9ffb640 1 -- 172.21.15.19:0/887744089 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2eac039040 con 0x7f2eb4162e30 2024-09-12T02:05:59.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.990+0000 7f2ea9ffb640 1 --2- 172.21.15.19:0/887744089 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e9806be30 0x7f2e9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.990+0000 7f2ea9ffb640 1 -- 172.21.15.19:0/887744089 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 9141+0+0 (secure 0 0 0) 0x7f2eac0ad110 con 0x7f2eb4162e30 2024-09-12T02:05:59.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.990+0000 7f2eb9017640 1 --2- 172.21.15.19:0/887744089 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e9806be30 0x7f2e9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.990+0000 7f2eb9017640 1 --2- 172.21.15.19:0/887744089 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e9806be30 0x7f2e9806e2f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f2eb41f7fc0 tx=0x7f2eb0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:59.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:05:59.994+0000 7f2ea9ffb640 1 -- 172.21.15.19:0/887744089 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2eac038350 con 0x7f2eb4162e30 2024-09-12T02:06:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:00.204+0000 7f2ebb27b640 1 -- 172.21.15.19:0/887744089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f2eb40d0160 con 0x7f2eb4162e30 2024-09-12T02:06:00.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:00.511+0000 7f2ea9ffb640 1 -- 172.21.15.19:0/887744089 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v283) ==== 162+0+0 (secure 0 0 0) 0x7f2eac07ad90 con 0x7f2eb4162e30 2024-09-12T02:06:00.511 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:06:00.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:00.513+0000 7f2ebb27b640 1 -- 172.21.15.19:0/887744089 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e9806be30 msgr2=0x7f2e9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:00.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:00.513+0000 7f2ebb27b640 1 --2- 172.21.15.19:0/887744089 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e9806be30 0x7f2e9806e2f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f2eb41f7fc0 tx=0x7f2eb0009040 comp rx=0 tx=0).stop 2024-09-12T02:06:00.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:00.513+0000 7f2ebb27b640 1 -- 172.21.15.19:0/887744089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2eb4162e30 msgr2=0x7f2eb40c9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:00.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:00.513+0000 7f2ebb27b640 1 --2- 172.21.15.19:0/887744089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2eb4162e30 0x7f2eb40c9600 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009d90 tx=0x7f2eac004a40 comp rx=0 tx=0).stop 2024-09-12T02:06:00.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:00.513+0000 7f2ebb27b640 1 -- 172.21.15.19:0/887744089 shutdown_connections 2024-09-12T02:06:00.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:00.513+0000 7f2ebb27b640 1 --2- 172.21.15.19:0/887744089 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2e9806be30 0x7f2e9806e2f0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:00.513+0000 7f2ebb27b640 1 --2- 172.21.15.19:0/887744089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2eb4162e30 0x7f2eb40c9600 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:00.513+0000 7f2ebb27b640 1 --2- 172.21.15.19:0/887744089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb4162340 0x7f2eb41538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:00.513+0000 7f2ebb27b640 1 --2- 172.21.15.19:0/887744089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2eb406d740 0x7f2eb40cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:00.513+0000 7f2ebb27b640 1 -- 172.21.15.19:0/887744089 >> 172.21.15.19:0/887744089 conn(0x7f2eb408bfc0 msgr2=0x7f2eb4160340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:00.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:00.513+0000 7f2ebb27b640 1 -- 172.21.15.19:0/887744089 shutdown_connections 2024-09-12T02:06:00.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:00.513+0000 7f2ebb27b640 1 -- 172.21.15.19:0/887744089 wait complete. 2024-09-12T02:06:00.931 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:01.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.040+0000 7fe16d2d0640 1 Processor -- start 2024-09-12T02:06:01.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.040+0000 7fe16d2d0640 1 -- start start 2024-09-12T02:06:01.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.041+0000 7fe16d2d0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe1680b3760 0x7fe1680b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:01.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.041+0000 7fe16d2d0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe16806cd20 0x7fe168162340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:01.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.041+0000 7fe16d2d0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1680b2790 con 0x7fe16809aa30 2024-09-12T02:06:01.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.041+0000 7fe16d2d0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe1680d0670 con 0x7fe1680b3760 2024-09-12T02:06:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.041+0000 7fe16d2d0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe1680b2a70 con 0x7fe16806cd20 2024-09-12T02:06:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.042+0000 7fe1667fc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe1680b3760 0x7fe1680b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.042+0000 7fe1677fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe16806cd20 0x7fe168162340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.042+0000 7fe1667fc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe1680b3760 0x7fe1680b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:44040/0 (socket says 172.21.15.19:44040) 2024-09-12T02:06:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.042+0000 7fe1667fc640 1 -- 172.21.15.19:0/3765438320 learned_addr learned my addr 172.21.15.19:0/3765438320 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.042+0000 7fe1677fe640 1 -- 172.21.15.19:0/3765438320 >> v2:172.21.15.135:3300/0 conn(0x7fe1680b3760 msgr2=0x7fe1680b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.042+0000 7fe1677fe640 1 --2- 172.21.15.19:0/3765438320 >> v2:172.21.15.135:3300/0 conn(0x7fe1680b3760 0x7fe1680b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.042+0000 7fe1677fe640 1 -- 172.21.15.19:0/3765438320 >> v1:172.21.15.135:6789/0 conn(0x7fe16809aa30 legacy=0x7fe16809ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.042+0000 7fe1677fe640 1 -- 172.21.15.19:0/3765438320 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1680b2d50 con 0x7fe16806cd20 2024-09-12T02:06:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.043+0000 7fe1677fe640 1 --2- 172.21.15.19:0/3765438320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe16806cd20 0x7fe168162340 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe1580097a0 tx=0x7fe15802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a7d3e29bf04d98f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.043+0000 7fe165ffb640 1 -- 172.21.15.19:0/3765438320 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158037070 con 0x7fe16806cd20 2024-09-12T02:06:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.043+0000 7fe165ffb640 1 -- 172.21.15.19:0/3765438320 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe15802ae50 con 0x7fe16806cd20 2024-09-12T02:06:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.043+0000 7fe165ffb640 1 -- 172.21.15.19:0/3765438320 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158032660 con 0x7fe16806cd20 2024-09-12T02:06:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.044+0000 7fe16d2d0640 1 -- 172.21.15.19:0/3765438320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe16806cd20 msgr2=0x7fe168162340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.044+0000 7fe16d2d0640 1 --2- 172.21.15.19:0/3765438320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe16806cd20 0x7fe168162340 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe1580097a0 tx=0x7fe15802a100 comp rx=0 tx=0).stop 2024-09-12T02:06:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.044+0000 7fe16d2d0640 1 -- 172.21.15.19:0/3765438320 shutdown_connections 2024-09-12T02:06:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.044+0000 7fe16d2d0640 1 --2- 172.21.15.19:0/3765438320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe16806cd20 0x7fe168162340 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.044+0000 7fe16d2d0640 1 --2- 172.21.15.19:0/3765438320 >> v2:172.21.15.135:3300/0 conn(0x7fe1680b3760 0x7fe1680b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.044+0000 7fe16d2d0640 1 -- 172.21.15.19:0/3765438320 >> 172.21.15.19:0/3765438320 conn(0x7fe1680d23a0 msgr2=0x7fe1680d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.044+0000 7fe16d2d0640 1 -- 172.21.15.19:0/3765438320 shutdown_connections 2024-09-12T02:06:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.044+0000 7fe16d2d0640 1 -- 172.21.15.19:0/3765438320 wait complete. 2024-09-12T02:06:01.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.045+0000 7fe16d2d0640 1 Processor -- start 2024-09-12T02:06:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.045+0000 7fe16d2d0640 1 -- start start 2024-09-12T02:06:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.046+0000 7fe16d2d0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16806cd20 0x7fe1680b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.046+0000 7fe16d2d0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe16809aa30 0x7fe1680b7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.046+0000 7fe16d2d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1680b3760 0x7fe1680b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.046+0000 7fe16d2d0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe16815fe20 con 0x7fe1680b3760 2024-09-12T02:06:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.046+0000 7fe16d2d0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe16815fca0 con 0x7fe16806cd20 2024-09-12T02:06:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.046+0000 7fe16d2d0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe1680d1fe0 con 0x7fe16809aa30 2024-09-12T02:06:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.046+0000 7fe1677fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1680b3760 0x7fe1680b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.046+0000 7fe1677fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1680b3760 0x7fe1680b7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60822/0 (socket says 172.21.15.19:60822) 2024-09-12T02:06:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.046+0000 7fe1677fe640 1 -- 172.21.15.19:0/3650480344 learned_addr learned my addr 172.21.15.19:0/3650480344 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.046+0000 7fe1667fc640 1 --2- 172.21.15.19:0/3650480344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe16809aa30 0x7fe1680b7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.046+0000 7fe166ffd640 1 --2- 172.21.15.19:0/3650480344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16806cd20 0x7fe1680b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.046+0000 7fe1677fe640 1 -- 172.21.15.19:0/3650480344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe16809aa30 msgr2=0x7fe1680b7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.047+0000 7fe1677fe640 1 --2- 172.21.15.19:0/3650480344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe16809aa30 0x7fe1680b7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.047+0000 7fe1677fe640 1 -- 172.21.15.19:0/3650480344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16806cd20 msgr2=0x7fe1680b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.047+0000 7fe1677fe640 1 --2- 172.21.15.19:0/3650480344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16806cd20 0x7fe1680b5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.047+0000 7fe1677fe640 1 -- 172.21.15.19:0/3650480344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe168160f60 con 0x7fe1680b3760 2024-09-12T02:06:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.047+0000 7fe1677fe640 1 --2- 172.21.15.19:0/3650480344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1680b3760 0x7fe1680b7970 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7fe15802a140 tx=0x7fe1580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.047+0000 7fe15f7fe640 1 -- 172.21.15.19:0/3650480344 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158041070 con 0x7fe1680b3760 2024-09-12T02:06:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.047+0000 7fe15f7fe640 1 -- 172.21.15.19:0/3650480344 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe15803c670 con 0x7fe1680b3760 2024-09-12T02:06:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.047+0000 7fe16d2d0640 1 -- 172.21.15.19:0/3650480344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe168161240 con 0x7fe1680b3760 2024-09-12T02:06:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.047+0000 7fe15f7fe640 1 -- 172.21.15.19:0/3650480344 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158037040 con 0x7fe1680b3760 2024-09-12T02:06:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.047+0000 7fe16d2d0640 1 -- 172.21.15.19:0/3650480344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe168161800 con 0x7fe1680b3760 2024-09-12T02:06:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.048+0000 7fe16d2d0640 1 -- 172.21.15.19:0/3650480344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1680b3030 con 0x7fe1680b3760 2024-09-12T02:06:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.048+0000 7fe15f7fe640 1 -- 172.21.15.19:0/3650480344 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe158044070 con 0x7fe1680b3760 2024-09-12T02:06:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.049+0000 7fe15f7fe640 1 --2- 172.21.15.19:0/3650480344 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe14806be30 0x7fe14806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.049+0000 7fe15f7fe640 1 -- 172.21.15.19:0/3650480344 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 9141+0+0 (secure 0 0 0) 0x7fe1580ac240 con 0x7fe1680b3760 2024-09-12T02:06:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.049+0000 7fe166ffd640 1 --2- 172.21.15.19:0/3650480344 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe14806be30 0x7fe14806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.050+0000 7fe166ffd640 1 --2- 172.21.15.19:0/3650480344 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe14806be30 0x7fe14806e2f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe160001f10 tx=0x7fe160009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.053+0000 7fe15f7fe640 1 -- 172.21.15.19:0/3650480344 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1580797e0 con 0x7fe1680b3760 2024-09-12T02:06:01.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.264+0000 7fe16d2d0640 1 -- 172.21.15.19:0/3650480344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1680b3cb0 con 0x7fe1680b3760 2024-09-12T02:06:01.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.265+0000 7fe15f7fe640 1 -- 172.21.15.19:0/3650480344 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 284 v284) ==== 95+0+5230 (secure 0 0 0) 0x7fe15807dae0 con 0x7fe1680b3760 2024-09-12T02:06:01.265 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:01.265 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":284,"btime":"2024-09-12T02:06:00:515068+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":284,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:00.515051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":128,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10050},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10050":{"gid":10050,"name":"c","rank":0,"incarnation":284,"state":"up:replay","state_seq":1,"addr":"172.21.15.19:6834/2316269679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2316269679},{"type":"v1","addr":"172.21.15.19:6834","nonce":2316269679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:01.266 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 284 2024-09-12T02:06:01.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.267+0000 7fe16d2d0640 1 -- 172.21.15.19:0/3650480344 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe14806be30 msgr2=0x7fe14806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:01.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.267+0000 7fe16d2d0640 1 --2- 172.21.15.19:0/3650480344 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe14806be30 0x7fe14806e2f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe160001f10 tx=0x7fe160009040 comp rx=0 tx=0).stop 2024-09-12T02:06:01.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.267+0000 7fe16d2d0640 1 -- 172.21.15.19:0/3650480344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1680b3760 msgr2=0x7fe1680b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:01.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.267+0000 7fe16d2d0640 1 --2- 172.21.15.19:0/3650480344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1680b3760 0x7fe1680b7970 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7fe15802a140 tx=0x7fe1580046c0 comp rx=0 tx=0).stop 2024-09-12T02:06:01.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.267+0000 7fe16d2d0640 1 -- 172.21.15.19:0/3650480344 shutdown_connections 2024-09-12T02:06:01.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.267+0000 7fe16d2d0640 1 --2- 172.21.15.19:0/3650480344 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe14806be30 0x7fe14806e2f0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:01.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.267+0000 7fe16d2d0640 1 --2- 172.21.15.19:0/3650480344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1680b3760 0x7fe1680b7970 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:01.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.267+0000 7fe16d2d0640 1 --2- 172.21.15.19:0/3650480344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe16809aa30 0x7fe1680b7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:01.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.267+0000 7fe16d2d0640 1 --2- 172.21.15.19:0/3650480344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16806cd20 0x7fe1680b5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:01.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.267+0000 7fe16d2d0640 1 -- 172.21.15.19:0/3650480344 >> 172.21.15.19:0/3650480344 conn(0x7fe1680d23a0 msgr2=0x7fe16815ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:01.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.267+0000 7fe16d2d0640 1 -- 172.21.15.19:0/3650480344 shutdown_connections 2024-09-12T02:06:01.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:01.267+0000 7fe16d2d0640 1 -- 172.21.15.19:0/3650480344 wait complete. 2024-09-12T02:06:01.279 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 284, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:06:00.515051+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 128, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10050}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10050': {'gid': 10050, 'name': 'c', 'rank': 0, 'incarnation': 284, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.19:6834/2316269679', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 2316269679}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 2316269679}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:06:01.279 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10050:up:replay 2024-09-12T02:06:01.279 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-12T02:06:04.513 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:06:04.513+0000 7ff62a41c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:06:06.684 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:06.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.800+0000 7f263d6c9640 1 Processor -- start 2024-09-12T02:06:06.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.800+0000 7f263d6c9640 1 -- start start 2024-09-12T02:06:06.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.801+0000 7f263d6c9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f263815e5f0 0x7f26380d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:06.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.801+0000 7f263d6c9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26380d3690 con 0x7f26380b6690 2024-09-12T02:06:06.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.801+0000 7f263d6c9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26380d3970 con 0x7f26380d30f0 2024-09-12T02:06:06.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.801+0000 7f263d6c9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f263806d530 con 0x7f263815e5f0 2024-09-12T02:06:06.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.801+0000 7f26377fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f26380b6690 0x7f263806d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54318/0 (socket says 172.21.15.19:54318) 2024-09-12T02:06:06.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.801+0000 7f26377fe640 1 -- 172.21.15.19:0/199088869 learned_addr learned my addr 172.21.15.19:0/199088869 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:06.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.802+0000 7f2636ffd640 1 --2- 172.21.15.19:0/199088869 >> v2:172.21.15.135:3300/0 conn(0x7f263815e5f0 0x7f26380d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:06.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.802+0000 7f2635ffb640 1 -- 172.21.15.19:0/199088869 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 125519534 0 0) 0x7f26380d3690 con 0x7f26380b6690 2024-09-12T02:06:06.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.802+0000 7f2635ffb640 1 -- 172.21.15.19:0/199088869 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2620003520 con 0x7f26380b6690 2024-09-12T02:06:06.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.802+0000 7f2635ffb640 1 -- 172.21.15.19:0/199088869 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 692214466 0 0) 0x7f2620003520 con 0x7f26380b6690 2024-09-12T02:06:06.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.802+0000 7f2636ffd640 1 -- 172.21.15.19:0/199088869 >> v1:172.21.15.135:6789/0 conn(0x7f26380d30f0 legacy=0x7f26380b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:06.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.802+0000 7f2636ffd640 1 -- 172.21.15.19:0/199088869 >> v1:172.21.15.19:6789/0 conn(0x7f26380b6690 legacy=0x7f263806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:06.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.802+0000 7f2636ffd640 1 -- 172.21.15.19:0/199088869 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263806cee0 con 0x7f263815e5f0 2024-09-12T02:06:06.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.803+0000 7f2636ffd640 1 --2- 172.21.15.19:0/199088869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f263815e5f0 0x7f26380d4dd0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f26280097d0 tx=0x7f262802a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79dfada9b087f666 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:06.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.803+0000 7f2635ffb640 1 -- 172.21.15.19:0/199088869 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2628037070 con 0x7f263815e5f0 2024-09-12T02:06:06.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.803+0000 7f2635ffb640 1 -- 172.21.15.19:0/199088869 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262802ac90 con 0x7f263815e5f0 2024-09-12T02:06:06.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.803+0000 7f2635ffb640 1 -- 172.21.15.19:0/199088869 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26300019f0 con 0x7f263815e5f0 2024-09-12T02:06:06.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.804+0000 7f263d6c9640 1 -- 172.21.15.19:0/199088869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f263815e5f0 msgr2=0x7f26380d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:06.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.804+0000 7f263d6c9640 1 --2- 172.21.15.19:0/199088869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f263815e5f0 0x7f26380d4dd0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f26280097d0 tx=0x7f262802a200 comp rx=0 tx=0).stop 2024-09-12T02:06:06.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.804+0000 7f263d6c9640 1 -- 172.21.15.19:0/199088869 shutdown_connections 2024-09-12T02:06:06.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.804+0000 7f263d6c9640 1 --2- 172.21.15.19:0/199088869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f263815e5f0 0x7f26380d4dd0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:06.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.804+0000 7f263d6c9640 1 -- 172.21.15.19:0/199088869 >> 172.21.15.19:0/199088869 conn(0x7f263808bfc0 msgr2=0x7f26380d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:06.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.804+0000 7f263d6c9640 1 -- 172.21.15.19:0/199088869 shutdown_connections 2024-09-12T02:06:06.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.804+0000 7f263d6c9640 1 -- 172.21.15.19:0/199088869 wait complete. 2024-09-12T02:06:06.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.805+0000 7f263d6c9640 1 Processor -- start 2024-09-12T02:06:06.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.805+0000 7f263d6c9640 1 -- start start 2024-09-12T02:06:06.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.806+0000 7f263d6c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26380b6690 0x7f26380ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:06.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.806+0000 7f263d6c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26380d30f0 0x7f26380b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:06.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.806+0000 7f263d6c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f263815e5f0 0x7f26380b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:06.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.806+0000 7f263d6c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f26380d5310 con 0x7f26380d30f0 2024-09-12T02:06:06.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.806+0000 7f263d6c9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f263815e9d0 con 0x7f263815e5f0 2024-09-12T02:06:06.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.806+0000 7f263d6c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f263806e0d0 con 0x7f26380b6690 2024-09-12T02:06:06.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.806+0000 7f26367fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26380d30f0 0x7f26380b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:06.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.806+0000 7f26367fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26380d30f0 0x7f26380b1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60824/0 (socket says 172.21.15.19:60824) 2024-09-12T02:06:06.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.806+0000 7f26367fc640 1 -- 172.21.15.19:0/441827295 learned_addr learned my addr 172.21.15.19:0/441827295 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:06.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.806+0000 7f26377fe640 1 --2- 172.21.15.19:0/441827295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f263815e5f0 0x7f26380b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:06.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.806+0000 7f2636ffd640 1 --2- 172.21.15.19:0/441827295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26380b6690 0x7f26380ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:06.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.806+0000 7f26367fc640 1 -- 172.21.15.19:0/441827295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26380b6690 msgr2=0x7f26380ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:06.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.806+0000 7f26367fc640 1 --2- 172.21.15.19:0/441827295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26380b6690 0x7f26380ca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:06.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.806+0000 7f26367fc640 1 -- 172.21.15.19:0/441827295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f263815e5f0 msgr2=0x7f26380b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:06.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.806+0000 7f26367fc640 1 --2- 172.21.15.19:0/441827295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f263815e5f0 0x7f26380b2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:06.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.807+0000 7f26367fc640 1 -- 172.21.15.19:0/441827295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26380b8440 con 0x7f26380d30f0 2024-09-12T02:06:06.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.807+0000 7f26367fc640 1 --2- 172.21.15.19:0/441827295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26380d30f0 0x7f26380b1d10 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f262c00c450 tx=0x7f262c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:06.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.807+0000 7f261f7fe640 1 -- 172.21.15.19:0/441827295 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c0052d0 con 0x7f26380d30f0 2024-09-12T02:06:06.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.807+0000 7f261f7fe640 1 -- 172.21.15.19:0/441827295 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262c005470 con 0x7f26380d30f0 2024-09-12T02:06:06.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.807+0000 7f263d6c9640 1 -- 172.21.15.19:0/441827295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26380b86e0 con 0x7f26380d30f0 2024-09-12T02:06:06.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.807+0000 7f261f7fe640 1 -- 172.21.15.19:0/441827295 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c012870 con 0x7f26380d30f0 2024-09-12T02:06:06.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.807+0000 7f263d6c9640 1 -- 172.21.15.19:0/441827295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26380b8ca0 con 0x7f26380d30f0 2024-09-12T02:06:06.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.808+0000 7f263d6c9640 1 -- 172.21.15.19:0/441827295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26380d4dd0 con 0x7f26380d30f0 2024-09-12T02:06:06.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.809+0000 7f261f7fe640 1 -- 172.21.15.19:0/441827295 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f262c012a10 con 0x7f26380d30f0 2024-09-12T02:06:06.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.809+0000 7f261f7fe640 1 --2- 172.21.15.19:0/441827295 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f262406be30 0x7f262406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:06.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.809+0000 7f261f7fe640 1 -- 172.21.15.19:0/441827295 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 9141+0+0 (secure 0 0 0) 0x7f262c08b700 con 0x7f26380d30f0 2024-09-12T02:06:06.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.809+0000 7f2636ffd640 1 --2- 172.21.15.19:0/441827295 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f262406be30 0x7f262406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:06.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.810+0000 7f2636ffd640 1 --2- 172.21.15.19:0/441827295 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f262406be30 0x7f262406e2f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f2628034000 tx=0x7f262802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:06.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:06.814+0000 7f261f7fe640 1 -- 172.21.15.19:0/441827295 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f262c058ca0 con 0x7f26380d30f0 2024-09-12T02:06:07.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.026+0000 7f263d6c9640 1 -- 172.21.15.19:0/441827295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26380b3230 con 0x7f26380d30f0 2024-09-12T02:06:07.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.027+0000 7f261f7fe640 1 -- 172.21.15.19:0/441827295 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 287 v287) ==== 95+0+5239 (secure 0 0 0) 0x7f262c05cfa0 con 0x7f26380d30f0 2024-09-12T02:06:07.027 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:07.027 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":287,"btime":"2024-09-12T02:06:03:528098+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":287,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:03.528092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":128,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10050},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10050":{"gid":10050,"name":"c","rank":0,"incarnation":284,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6834/2316269679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2316269679},{"type":"v1","addr":"172.21.15.19:6834","nonce":2316269679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10050,"qdb_cluster":[10050]},"id":6}]} 2024-09-12T02:06:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 287 2024-09-12T02:06:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.029+0000 7f263d6c9640 1 -- 172.21.15.19:0/441827295 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f262406be30 msgr2=0x7f262406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.029+0000 7f263d6c9640 1 --2- 172.21.15.19:0/441827295 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f262406be30 0x7f262406e2f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f2628034000 tx=0x7f262802e000 comp rx=0 tx=0).stop 2024-09-12T02:06:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.029+0000 7f263d6c9640 1 -- 172.21.15.19:0/441827295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26380d30f0 msgr2=0x7f26380b1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.029+0000 7f263d6c9640 1 --2- 172.21.15.19:0/441827295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26380d30f0 0x7f26380b1d10 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f262c00c450 tx=0x7f262c00c910 comp rx=0 tx=0).stop 2024-09-12T02:06:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.029+0000 7f263d6c9640 1 -- 172.21.15.19:0/441827295 shutdown_connections 2024-09-12T02:06:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.029+0000 7f263d6c9640 1 --2- 172.21.15.19:0/441827295 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f262406be30 0x7f262406e2f0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.029+0000 7f263d6c9640 1 --2- 172.21.15.19:0/441827295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f263815e5f0 0x7f26380b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.029+0000 7f263d6c9640 1 --2- 172.21.15.19:0/441827295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26380d30f0 0x7f26380b1d10 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.029+0000 7f263d6c9640 1 --2- 172.21.15.19:0/441827295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26380b6690 0x7f26380ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.029+0000 7f263d6c9640 1 -- 172.21.15.19:0/441827295 >> 172.21.15.19:0/441827295 conn(0x7f263808bfc0 msgr2=0x7f26380b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.029+0000 7f263d6c9640 1 -- 172.21.15.19:0/441827295 shutdown_connections 2024-09-12T02:06:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.029+0000 7f263d6c9640 1 -- 172.21.15.19:0/441827295 wait complete. 2024-09-12T02:06:07.041 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 287, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:06:03.528092+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 128, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10050}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10050': {'gid': 10050, 'name': 'c', 'rank': 0, 'incarnation': 284, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.19:6834/2316269679', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 2316269679}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 2316269679}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10050, 'qdb_cluster': [10050]} 2024-09-12T02:06:07.041 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:06:07.042 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T02:06:07.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.145+0000 7f4d48d31640 1 Processor -- start 2024-09-12T02:06:07.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.145+0000 7f4d48d31640 1 -- start start 2024-09-12T02:06:07.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.146+0000 7f4d48d31640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4d440d30f0 0x7f4d440b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.146+0000 7f4d48d31640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d440d3690 con 0x7f4d440b64c0 2024-09-12T02:06:07.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.146+0000 7f4d48d31640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d440d3970 con 0x7f4d4415e5f0 2024-09-12T02:06:07.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.146+0000 7f4d48d31640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f4d4406d530 con 0x7f4d440d30f0 2024-09-12T02:06:07.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.146+0000 7f4d3bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4d440d30f0 0x7f4d440b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.146+0000 7f4d42d9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4d440b64c0 0x7f4d4406d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54332/0 (socket says 172.21.15.19:54332) 2024-09-12T02:06:07.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.146+0000 7f4d42d9d640 1 -- 172.21.15.19:0/2492157630 learned_addr learned my addr 172.21.15.19:0/2492157630 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:07.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.146+0000 7f4d3bfff640 1 -- 172.21.15.19:0/2492157630 >> v1:172.21.15.135:6789/0 conn(0x7f4d4415e5f0 legacy=0x7f4d440d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:07.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.146+0000 7f4d3bfff640 1 -- 172.21.15.19:0/2492157630 >> v1:172.21.15.19:6789/0 conn(0x7f4d440b64c0 legacy=0x7f4d4406d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:07.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.146+0000 7f4d41d9b640 1 -- 172.21.15.19:0/2492157630 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3558603816 0 0) 0x7f4d440d3690 con 0x7f4d440b64c0 2024-09-12T02:06:07.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.146+0000 7f4d3bfff640 1 -- 172.21.15.19:0/2492157630 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4406cee0 con 0x7f4d440d30f0 2024-09-12T02:06:07.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.147+0000 7f4d3bfff640 1 --2- 172.21.15.19:0/2492157630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d440d30f0 0x7f4d440b5f80 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0097a0 tx=0x7f4d2c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dfba86771ec04d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:07.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.147+0000 7f4d41d9b640 1 -- 172.21.15.19:0/2492157630 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c037070 con 0x7f4d440d30f0 2024-09-12T02:06:07.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.147+0000 7f4d41d9b640 1 -- 172.21.15.19:0/2492157630 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d2c032440 con 0x7f4d440d30f0 2024-09-12T02:06:07.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.147+0000 7f4d41d9b640 1 -- 172.21.15.19:0/2492157630 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c032810 con 0x7f4d440d30f0 2024-09-12T02:06:07.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.148+0000 7f4d48d31640 1 -- 172.21.15.19:0/2492157630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d440d30f0 msgr2=0x7f4d440b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:07.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.148+0000 7f4d48d31640 1 --2- 172.21.15.19:0/2492157630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d440d30f0 0x7f4d440b5f80 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0097a0 tx=0x7f4d2c02a230 comp rx=0 tx=0).stop 2024-09-12T02:06:07.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.148+0000 7f4d48d31640 1 -- 172.21.15.19:0/2492157630 shutdown_connections 2024-09-12T02:06:07.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.148+0000 7f4d48d31640 1 --2- 172.21.15.19:0/2492157630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d440d30f0 0x7f4d440b5f80 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.148+0000 7f4d48d31640 1 -- 172.21.15.19:0/2492157630 >> 172.21.15.19:0/2492157630 conn(0x7f4d4408bfc0 msgr2=0x7f4d440d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:07.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.148+0000 7f4d48d31640 1 -- 172.21.15.19:0/2492157630 shutdown_connections 2024-09-12T02:06:07.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.148+0000 7f4d48d31640 1 -- 172.21.15.19:0/2492157630 wait complete. 2024-09-12T02:06:07.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.149+0000 7f4d48d31640 1 Processor -- start 2024-09-12T02:06:07.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.149+0000 7f4d48d31640 1 -- start start 2024-09-12T02:06:07.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.150+0000 7f4d48d31640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d440b64c0 0x7f4d441f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.150+0000 7f4d48d31640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d440d30f0 0x7f4d4409ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.150+0000 7f4d48d31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d4415e5f0 0x7f4d4409f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.150+0000 7f4d48d31640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4406e0d0 con 0x7f4d4415e5f0 2024-09-12T02:06:07.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.150+0000 7f4d48d31640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4415e9d0 con 0x7f4d440d30f0 2024-09-12T02:06:07.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.150+0000 7f4d48d31640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4d4406e250 con 0x7f4d440b64c0 2024-09-12T02:06:07.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.150+0000 7f4d42d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d4415e5f0 0x7f4d4409f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.150+0000 7f4d42d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d4415e5f0 0x7f4d4409f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60848/0 (socket says 172.21.15.19:60848) 2024-09-12T02:06:07.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.150+0000 7f4d42d9d640 1 -- 172.21.15.19:0/3051374950 learned_addr learned my addr 172.21.15.19:0/3051374950 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:07.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.150+0000 7f4d3bfff640 1 --2- 172.21.15.19:0/3051374950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d440d30f0 0x7f4d4409ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.150+0000 7f4d4259c640 1 --2- 172.21.15.19:0/3051374950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d440b64c0 0x7f4d441f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.150+0000 7f4d42d9d640 1 -- 172.21.15.19:0/3051374950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d440b64c0 msgr2=0x7f4d441f4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.150+0000 7f4d42d9d640 1 --2- 172.21.15.19:0/3051374950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d440b64c0 0x7f4d441f4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.150+0000 7f4d42d9d640 1 -- 172.21.15.19:0/3051374950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d440d30f0 msgr2=0x7f4d4409ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.150+0000 7f4d42d9d640 1 --2- 172.21.15.19:0/3051374950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d440d30f0 0x7f4d4409ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.150+0000 7f4d42d9d640 1 -- 172.21.15.19:0/3051374950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4409f970 con 0x7f4d4415e5f0 2024-09-12T02:06:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.150+0000 7f4d3bfff640 1 --2- 172.21.15.19:0/3051374950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d440d30f0 0x7f4d4409ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.151+0000 7f4d42d9d640 1 --2- 172.21.15.19:0/3051374950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d4415e5f0 0x7f4d4409f340 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00c7a0 tx=0x7f4d3c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.151+0000 7f4d3affd640 1 -- 172.21.15.19:0/3051374950 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c018070 con 0x7f4d4415e5f0 2024-09-12T02:06:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.151+0000 7f4d3affd640 1 -- 172.21.15.19:0/3051374950 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3c00a640 con 0x7f4d4415e5f0 2024-09-12T02:06:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.151+0000 7f4d48d31640 1 -- 172.21.15.19:0/3051374950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d4415eda0 con 0x7f4d4415e5f0 2024-09-12T02:06:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.151+0000 7f4d3affd640 1 -- 172.21.15.19:0/3051374950 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c00aab0 con 0x7f4d4415e5f0 2024-09-12T02:06:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.151+0000 7f4d48d31640 1 -- 172.21.15.19:0/3051374950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d4415f360 con 0x7f4d4415e5f0 2024-09-12T02:06:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.152+0000 7f4d3affd640 1 -- 172.21.15.19:0/3051374950 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d3c01b070 con 0x7f4d4415e5f0 2024-09-12T02:06:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.153+0000 7f4d3affd640 1 --2- 172.21.15.19:0/3051374950 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4d2406be30 0x7f4d2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.153+0000 7f4d3affd640 1 -- 172.21.15.19:0/3051374950 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 9141+0+0 (secure 0 0 0) 0x7f4d3c08b130 con 0x7f4d4415e5f0 2024-09-12T02:06:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.153+0000 7f4d4259c640 1 --2- 172.21.15.19:0/3051374950 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4d2406be30 0x7f4d2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.154+0000 7f4d4259c640 1 --2- 172.21.15.19:0/3051374950 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4d2406be30 0x7f4d2406e2f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4d440d0100 tx=0x7f4d34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.154+0000 7f4d4bace740 1 Processor -- start 2024-09-12T02:06:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.154+0000 7f4d4bace740 1 -- start start 2024-09-12T02:06:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d4bace740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562177452c0 0x55621778aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d4bace740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556217742a80 0x5562177456a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d4bace740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556217746a50 0x55621773f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d4bace740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5562176a7520 con 0x5562177452c0 2024-09-12T02:06:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d4bace740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55621764f3e0 con 0x556217746a50 2024-09-12T02:06:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d4bace740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5562176a34e0 con 0x556217742a80 2024-09-12T02:06:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d4259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562177452c0 0x55621778aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d4259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562177452c0 0x55621778aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60854/0 (socket says 172.21.15.19:60854) 2024-09-12T02:06:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d4259c640 1 -- 172.21.15.19:0/1857609978 learned_addr learned my addr 172.21.15.19:0/1857609978 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d4259c640 1 -- 172.21.15.19:0/1857609978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556217742a80 msgr2=0x5562177456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d42d9d640 1 --2- 172.21.15.19:0/1857609978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556217746a50 0x55621773f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d4259c640 1 --2- 172.21.15.19:0/1857609978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556217742a80 0x5562177456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d4259c640 1 -- 172.21.15.19:0/1857609978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556217746a50 msgr2=0x55621773f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d4259c640 1 --2- 172.21.15.19:0/1857609978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556217746a50 0x55621773f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d4259c640 1 -- 172.21.15.19:0/1857609978 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55621766a2f0 con 0x5562177452c0 2024-09-12T02:06:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d4259c640 1 --2- 172.21.15.19:0/1857609978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562177452c0 0x55621778aa60 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400fa40 tx=0x7f4d34012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aac97f327a6fae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d23fff640 1 -- 172.21.15.19:0/1857609978 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34025070 con 0x5562177452c0 2024-09-12T02:06:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d23fff640 1 -- 172.21.15.19:0/1857609978 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3401b050 con 0x5562177452c0 2024-09-12T02:06:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.155+0000 7f4d23fff640 1 -- 172.21.15.19:0/1857609978 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34014e20 con 0x5562177452c0 2024-09-12T02:06:07.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.156+0000 7f4d4bace740 1 -- 172.21.15.19:0/1857609978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562177452c0 msgr2=0x55621778aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:07.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.156+0000 7f4d4bace740 1 --2- 172.21.15.19:0/1857609978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562177452c0 0x55621778aa60 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400fa40 tx=0x7f4d34012000 comp rx=0 tx=0).stop 2024-09-12T02:06:07.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.156+0000 7f4d4bace740 1 -- 172.21.15.19:0/1857609978 shutdown_connections 2024-09-12T02:06:07.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.156+0000 7f4d4bace740 1 --2- 172.21.15.19:0/1857609978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556217746a50 0x55621773f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.156+0000 7f4d4bace740 1 --2- 172.21.15.19:0/1857609978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556217742a80 0x5562177456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.156+0000 7f4d4bace740 1 --2- 172.21.15.19:0/1857609978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562177452c0 0x55621778aa60 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.156+0000 7f4d4bace740 1 -- 172.21.15.19:0/1857609978 >> 172.21.15.19:0/1857609978 conn(0x556217741a80 msgr2=0x556217789f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:07.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.156+0000 7f4d4bace740 1 -- 172.21.15.19:0/1857609978 shutdown_connections 2024-09-12T02:06:07.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.156+0000 7f4d4bace740 1 -- 172.21.15.19:0/1857609978 wait complete. 2024-09-12T02:06:07.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.157+0000 7f4d4bace740 1 -- start start 2024-09-12T02:06:07.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.157+0000 7f4d4bace740 1 Processor -- start 2024-09-12T02:06:07.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d4bace740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562177452c0 0x556217743ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d4bace740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556217746a50 0x5562177628e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d4bace740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556217744220 0x556217762e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d4bace740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556217740f20 con 0x556217744220 2024-09-12T02:06:07.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d4bace740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556217630450 con 0x5562177452c0 2024-09-12T02:06:07.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d4bace740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55621778b290 con 0x556217746a50 2024-09-12T02:06:07.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d4bace740 10 client.0 _ll_register_callbacks cb 0x5562173b9ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:07.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d42d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556217744220 0x556217762e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d42d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556217744220 0x556217762e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60858/0 (socket says 172.21.15.19:60858) 2024-09-12T02:06:07.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d42d9d640 1 -- 172.21.15.19:0/919526610 learned_addr learned my addr 172.21.15.19:0/919526610 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:07.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d4259c640 1 --2- 172.21.15.19:0/919526610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562177452c0 0x556217743ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d3bfff640 1 --2- 172.21.15.19:0/919526610 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556217746a50 0x5562177628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d42d9d640 1 -- 172.21.15.19:0/919526610 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556217746a50 msgr2=0x5562177628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:07.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d42d9d640 1 --2- 172.21.15.19:0/919526610 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556217746a50 0x5562177628e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d42d9d640 1 -- 172.21.15.19:0/919526610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562177452c0 msgr2=0x556217743ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:07.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d42d9d640 1 --2- 172.21.15.19:0/919526610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562177452c0 0x556217743ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d42d9d640 1 -- 172.21.15.19:0/919526610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562173ba2d0 con 0x556217744220 2024-09-12T02:06:07.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d42d9d640 1 --2- 172.21.15.19:0/919526610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556217744220 0x556217762e20 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00a430 tx=0x7f4d3c058180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d129b9de502ffcdb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:07.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d217fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:06:07.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d217fa640 1 -- 172.21.15.19:0/919526610 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c00ae50 con 0x556217744220 2024-09-12T02:06:07.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.158+0000 7f4d217fa640 1 -- 172.21.15.19:0/919526610 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(128..128 src has 1..128) ==== 9141+0+0 (secure 0 0 0) 0x7f4d3c06cb40 con 0x556217744220 2024-09-12T02:06:07.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.159+0000 7f4d4bace740 1 -- 172.21.15.19:0/919526610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d3401b050 con 0x556217744220 2024-09-12T02:06:07.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.159+0000 7f4d217fa640 1 -- 172.21.15.19:0/919526610 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=287) ==== 24+0+0 (secure 0 0 0) 0x7f4d3c061290 con 0x556217744220 2024-09-12T02:06:07.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.159+0000 7f4d4bace740 10 client.10107 fetch_fsmap learned FSMap version 287 2024-09-12T02:06:07.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.159+0000 7f4d4bace740 1 -- 172.21.15.19:0/919526610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=287,monmap=2+}) -- 0x5562174846b0 con 0x556217744220 2024-09-12T02:06:07.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.159+0000 7f4d217fa640 1 -- 172.21.15.19:0/919526610 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3401b050 con 0x556217744220 2024-09-12T02:06:07.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.159+0000 7f4d217fa640 1 -- 172.21.15.19:0/919526610 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 287) ==== 3502+0+0 (secure 0 0 0) 0x7f4d3c057bb0 con 0x556217744220 2024-09-12T02:06:07.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.159+0000 7f4d4bace740 10 client.10107 fetch_fsmap finished waiting for FSMap version 287 2024-09-12T02:06:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.159+0000 7f4d4bace740 10 client.10107 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:06:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.159+0000 7f4d4bace740 20 client.10107 populate_metadata read hostname 'smithi019' 2024-09-12T02:06:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.159+0000 7f4d4bace740 1 --2- 172.21.15.19:0/919526610 >> [v2:172.21.15.19:6832/2316269679,v1:172.21.15.19:6834/2316269679] conn(0x55621773e7d0 0x556217764940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.159+0000 7f4d4bace740 4 client.10107 mds_command: new command op to 10050 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:06:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.159+0000 7f4d4bace740 1 -- 172.21.15.19:0/919526610 --> [v2:172.21.15.19:6832/2316269679,v1:172.21.15.19:6834/2316269679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562176b4c50 con 0x55621773e7d0 2024-09-12T02:06:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.159+0000 7f4d4259c640 1 --2- 172.21.15.19:0/919526610 >> [v2:172.21.15.19:6832/2316269679,v1:172.21.15.19:6834/2316269679] conn(0x55621773e7d0 0x556217764940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.159+0000 7f4d4259c640 1 --2- 172.21.15.19:0/919526610 >> [v2:172.21.15.19:6832/2316269679,v1:172.21.15.19:6834/2316269679] conn(0x55621773e7d0 0x556217764940 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3c4b0d17d59063c server_cookie=4c3f88b10d516af9 in_seq=0 out_seq=0 2024-09-12T02:06:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.159+0000 7f4d217fa640 10 client.10107 ms_handle_connect on v2:172.21.15.19:6832/2316269679 2024-09-12T02:06:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.160+0000 7f4d217fa640 1 -- 172.21.15.19:0/919526610 <== mds.0 v2:172.21.15.19:6832/2316269679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5562176b4c50 con 0x55621773e7d0 2024-09-12T02:06:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.160+0000 7f4d217fa640 10 client.10107 handle_command_reply: tid=0 2024-09-12T02:06:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.160+0000 7f4d4bace740 1 client.10107 shutdown 2024-09-12T02:06:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.160+0000 7f4d4bace740 1 -- 172.21.15.19:0/919526610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556217744220 msgr2=0x556217762e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:07.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.160+0000 7f4d4bace740 1 --2- 172.21.15.19:0/919526610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556217744220 0x556217762e20 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00a430 tx=0x7f4d3c058180 comp rx=0 tx=0).stop 2024-09-12T02:06:07.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.160+0000 7f4d4bace740 1 -- 172.21.15.19:0/919526610 shutdown_connections 2024-09-12T02:06:07.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.160+0000 7f4d4bace740 1 --2- 172.21.15.19:0/919526610 >> [v2:172.21.15.19:6832/2316269679,v1:172.21.15.19:6834/2316269679] conn(0x55621773e7d0 0x556217764940 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.160+0000 7f4d4bace740 1 --2- 172.21.15.19:0/919526610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556217744220 0x556217762e20 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.160+0000 7f4d4bace740 1 --2- 172.21.15.19:0/919526610 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556217746a50 0x5562177628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.160+0000 7f4d4bace740 1 --2- 172.21.15.19:0/919526610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562177452c0 0x556217743ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.160+0000 7f4d217fa640 0 client.10107 ms_handle_reset on v2:172.21.15.19:6832/2316269679 2024-09-12T02:06:07.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.160+0000 7f4d4bace740 1 -- 172.21.15.19:0/919526610 >> 172.21.15.19:0/919526610 conn(0x556217742a80 msgr2=0x556217789470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:07.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.160+0000 7f4d4bace740 1 -- 172.21.15.19:0/919526610 shutdown_connections 2024-09-12T02:06:07.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.160+0000 7f4d4bace740 1 -- 172.21.15.19:0/919526610 wait complete. 2024-09-12T02:06:07.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.161+0000 7f4d4bace740 20 client.10107 trim_cache size 0 max 16384 2024-09-12T02:06:07.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.179+0000 7f4d4bace740 1 Processor -- start 2024-09-12T02:06:07.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.179+0000 7f4d4bace740 1 -- start start 2024-09-12T02:06:07.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.179+0000 7f4d4bace740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556217744220 0x5562177ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.179+0000 7f4d4bace740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562177452c0 0x5562177ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.179+0000 7f4d4bace740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556217746a50 0x55621773f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.179+0000 7f4d4bace740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4d44201f60 con 0x556217744220 2024-09-12T02:06:07.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.179+0000 7f4d4bace740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4d44201360 con 0x5562177452c0 2024-09-12T02:06:07.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.179+0000 7f4d4bace740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4d44201910 con 0x556217746a50 2024-09-12T02:06:07.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.179+0000 7f4d4259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556217744220 0x5562177ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.179+0000 7f4d4259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556217744220 0x5562177ae190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60872/0 (socket says 172.21.15.19:60872) 2024-09-12T02:06:07.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.179+0000 7f4d4259c640 1 -- 172.21.15.19:0/1846628590 learned_addr learned my addr 172.21.15.19:0/1846628590 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:07.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.180+0000 7f4d4259c640 1 -- 172.21.15.19:0/1846628590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556217746a50 msgr2=0x55621773f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:07.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.180+0000 7f4d4259c640 1 --2- 172.21.15.19:0/1846628590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556217746a50 0x55621773f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.180+0000 7f4d4259c640 1 -- 172.21.15.19:0/1846628590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562177452c0 msgr2=0x5562177ae6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:07.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.180+0000 7f4d4259c640 1 --2- 172.21.15.19:0/1846628590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562177452c0 0x5562177ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.180+0000 7f4d4259c640 1 -- 172.21.15.19:0/1846628590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55621778c340 con 0x556217744220 2024-09-12T02:06:07.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.180+0000 7f4d4259c640 1 --2- 172.21.15.19:0/1846628590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556217744220 0x5562177ae190 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f4d34020000 tx=0x7f4d34015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e87a6d0fd93eeda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:07.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.180+0000 7f4d237fe640 1 -- 172.21.15.19:0/1846628590 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34030030 con 0x556217744220 2024-09-12T02:06:07.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.180+0000 7f4d237fe640 1 -- 172.21.15.19:0/1846628590 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3401b040 con 0x556217744220 2024-09-12T02:06:07.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.180+0000 7f4d237fe640 1 -- 172.21.15.19:0/1846628590 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34025040 con 0x556217744220 2024-09-12T02:06:07.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.180+0000 7f4d4bace740 1 -- 172.21.15.19:0/1846628590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556217744220 msgr2=0x5562177ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:07.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.180+0000 7f4d4bace740 1 --2- 172.21.15.19:0/1846628590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556217744220 0x5562177ae190 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f4d34020000 tx=0x7f4d34015000 comp rx=0 tx=0).stop 2024-09-12T02:06:07.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.181+0000 7f4d4bace740 1 -- 172.21.15.19:0/1846628590 shutdown_connections 2024-09-12T02:06:07.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.181+0000 7f4d4bace740 1 --2- 172.21.15.19:0/1846628590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556217746a50 0x55621773f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.181+0000 7f4d4bace740 1 --2- 172.21.15.19:0/1846628590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562177452c0 0x5562177ae6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.181+0000 7f4d4bace740 1 --2- 172.21.15.19:0/1846628590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556217744220 0x5562177ae190 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.181+0000 7f4d4bace740 1 -- 172.21.15.19:0/1846628590 >> 172.21.15.19:0/1846628590 conn(0x556217742a80 msgr2=0x5562177874d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:07.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.181+0000 7f4d4bace740 1 -- 172.21.15.19:0/1846628590 shutdown_connections 2024-09-12T02:06:07.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.181+0000 7f4d4bace740 1 -- 172.21.15.19:0/1846628590 wait complete. 2024-09-12T02:06:07.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.181+0000 7f4d4bace740 1 -- start start 2024-09-12T02:06:07.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.181+0000 7f4d4bace740 1 Processor -- start 2024-09-12T02:06:07.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.182+0000 7f4d4bace740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556217744220 0x556217808920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.182+0000 7f4d4bace740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562177452c0 0x55621779c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.182+0000 7f4d4bace740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556217746a50 0x55621779cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.182+0000 7f4d4bace740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556217763780 con 0x5562177452c0 2024-09-12T02:06:07.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.182+0000 7f4d4bace740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55621776e6e0 con 0x556217744220 2024-09-12T02:06:07.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.182+0000 7f4d4bace740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55621773ec50 con 0x556217746a50 2024-09-12T02:06:07.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.182+0000 7f4d4bace740 10 client.0 _ll_register_callbacks cb 0x7f4d3c00ceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:07.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.182+0000 7f4d3bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562177452c0 0x55621779c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.182+0000 7f4d3bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562177452c0 0x55621779c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60888/0 (socket says 172.21.15.19:60888) 2024-09-12T02:06:07.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.182+0000 7f4d3bfff640 1 -- 172.21.15.19:0/307166193 learned_addr learned my addr 172.21.15.19:0/307166193 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:07.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.182+0000 7f4d42d9d640 1 --2- 172.21.15.19:0/307166193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556217746a50 0x55621779cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.182+0000 7f4d4259c640 1 --2- 172.21.15.19:0/307166193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556217744220 0x556217808920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.182+0000 7f4d3bfff640 1 -- 172.21.15.19:0/307166193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556217746a50 msgr2=0x55621779cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:07.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.182+0000 7f4d3bfff640 1 --2- 172.21.15.19:0/307166193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556217746a50 0x55621779cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.182+0000 7f4d3bfff640 1 -- 172.21.15.19:0/307166193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556217744220 msgr2=0x556217808920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:07.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.182+0000 7f4d3bfff640 1 --2- 172.21.15.19:0/307166193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556217744220 0x556217808920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.183+0000 7f4d3bfff640 1 -- 172.21.15.19:0/307166193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55621776fa10 con 0x5562177452c0 2024-09-12T02:06:07.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.183+0000 7f4d3bfff640 1 --2- 172.21.15.19:0/307166193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562177452c0 0x55621779c670 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c02a270 tx=0x7f4d2c032910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1304c921724e9d58 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:07.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.183+0000 7f4d217fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:06:07.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.183+0000 7f4d217fa640 1 -- 172.21.15.19:0/307166193 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c042070 con 0x5562177452c0 2024-09-12T02:06:07.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.183+0000 7f4d217fa640 1 -- 172.21.15.19:0/307166193 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(128..128 src has 1..128) ==== 9141+0+0 (secure 0 0 0) 0x7f4d2c03c440 con 0x5562177452c0 2024-09-12T02:06:07.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.183+0000 7f4d4bace740 1 -- 172.21.15.19:0/307166193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d3401b040 con 0x5562177452c0 2024-09-12T02:06:07.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.183+0000 7f4d217fa640 1 -- 172.21.15.19:0/307166193 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=287) ==== 24+0+0 (secure 0 0 0) 0x7f4d2c04e050 con 0x5562177452c0 2024-09-12T02:06:07.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.183+0000 7f4d4bace740 10 client.10113 fetch_fsmap learned FSMap version 287 2024-09-12T02:06:07.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.183+0000 7f4d4bace740 1 -- 172.21.15.19:0/307166193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=287,monmap=2+}) -- 0x556217788710 con 0x5562177452c0 2024-09-12T02:06:07.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.183+0000 7f4d217fa640 1 -- 172.21.15.19:0/307166193 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3401b040 con 0x5562177452c0 2024-09-12T02:06:07.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.183+0000 7f4d217fa640 1 -- 172.21.15.19:0/307166193 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 287) ==== 3502+0+0 (secure 0 0 0) 0x7f4d2c03c640 con 0x5562177452c0 2024-09-12T02:06:07.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.183+0000 7f4d4bace740 10 client.10113 fetch_fsmap finished waiting for FSMap version 287 2024-09-12T02:06:07.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.183+0000 7f4d4bace740 10 client.10113 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:06:07.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.183+0000 7f4d4bace740 20 client.10113 populate_metadata read hostname 'smithi019' 2024-09-12T02:06:07.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.183+0000 7f4d4bace740 1 --2- 172.21.15.19:0/307166193 >> [v2:172.21.15.19:6832/2316269679,v1:172.21.15.19:6834/2316269679] conn(0x556217786f00 0x55621776e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.183+0000 7f4d4bace740 4 client.10113 mds_command: new command op to 10050 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:06:07.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.183+0000 7f4d4bace740 1 -- 172.21.15.19:0/307166193 --> [v2:172.21.15.19:6832/2316269679,v1:172.21.15.19:6834/2316269679] -- command(tid 0: {"prefix": "status"}) -- 0x5562176aefa0 con 0x556217786f00 2024-09-12T02:06:07.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.184+0000 7f4d4259c640 1 --2- 172.21.15.19:0/307166193 >> [v2:172.21.15.19:6832/2316269679,v1:172.21.15.19:6834/2316269679] conn(0x556217786f00 0x55621776e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.184+0000 7f4d4259c640 1 --2- 172.21.15.19:0/307166193 >> [v2:172.21.15.19:6832/2316269679,v1:172.21.15.19:6834/2316269679] conn(0x556217786f00 0x55621776e860 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10a52ed656b7a03b server_cookie=e34534069ba418a3 in_seq=0 out_seq=0 2024-09-12T02:06:07.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.184+0000 7f4d217fa640 10 client.10113 ms_handle_connect on v2:172.21.15.19:6832/2316269679 2024-09-12T02:06:07.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.184+0000 7f4d217fa640 1 -- 172.21.15.19:0/307166193 <== mds.0 v2:172.21.15.19:6832/2316269679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x5562176aefa0 con 0x556217786f00 2024-09-12T02:06:07.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.184+0000 7f4d217fa640 10 client.10113 handle_command_reply: tid=0 2024-09-12T02:06:07.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.184+0000 7f4d4bace740 1 client.10113 shutdown 2024-09-12T02:06:07.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.184+0000 7f4d4bace740 1 -- 172.21.15.19:0/307166193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562177452c0 msgr2=0x55621779c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:07.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.184+0000 7f4d4bace740 1 --2- 172.21.15.19:0/307166193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562177452c0 0x55621779c670 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c02a270 tx=0x7f4d2c032910 comp rx=0 tx=0).stop 2024-09-12T02:06:07.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.184+0000 7f4d4bace740 1 -- 172.21.15.19:0/307166193 shutdown_connections 2024-09-12T02:06:07.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.184+0000 7f4d4bace740 1 --2- 172.21.15.19:0/307166193 >> [v2:172.21.15.19:6832/2316269679,v1:172.21.15.19:6834/2316269679] conn(0x556217786f00 0x55621776e860 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.184+0000 7f4d4bace740 1 --2- 172.21.15.19:0/307166193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556217746a50 0x55621779cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.184+0000 7f4d4bace740 1 --2- 172.21.15.19:0/307166193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5562177452c0 0x55621779c670 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.184+0000 7f4d4bace740 1 --2- 172.21.15.19:0/307166193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556217744220 0x556217808920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.184+0000 7f4d217fa640 0 client.10113 ms_handle_reset on v2:172.21.15.19:6832/2316269679 2024-09-12T02:06:07.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.184+0000 7f4d4bace740 1 -- 172.21.15.19:0/307166193 >> 172.21.15.19:0/307166193 conn(0x556217742a80 msgr2=0x5562177874d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:07.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.184+0000 7f4d4bace740 1 -- 172.21.15.19:0/307166193 shutdown_connections 2024-09-12T02:06:07.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.184+0000 7f4d4bace740 1 -- 172.21.15.19:0/307166193 wait complete. 2024-09-12T02:06:07.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.184+0000 7f4d4bace740 20 client.10113 trim_cache size 0 max 16384 2024-09-12T02:06:07.191 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:06:07.191 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T02:06:07.191 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T02:06:07.191 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 10050, 2024-09-12T02:06:07.191 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T02:06:07.191 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T02:06:07.191 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T02:06:07.191 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 6.6689312410000001, 2024-09-12T02:06:07.191 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 287, 2024-09-12T02:06:07.191 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 128, 2024-09-12T02:06:07.192 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 128, 2024-09-12T02:06:07.192 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 8.6474837969999996 2024-09-12T02:06:07.192 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:06:07.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.185+0000 7f4d48d31640 1 -- 172.21.15.19:0/3051374950 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4d2406be30 msgr2=0x7f4d2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:07.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.185+0000 7f4d48d31640 1 --2- 172.21.15.19:0/3051374950 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4d2406be30 0x7f4d2406e2f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4d440d0100 tx=0x7f4d34009040 comp rx=0 tx=0).stop 2024-09-12T02:06:07.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.185+0000 7f4d48d31640 1 -- 172.21.15.19:0/3051374950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d4415e5f0 msgr2=0x7f4d4409f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:07.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.185+0000 7f4d48d31640 1 --2- 172.21.15.19:0/3051374950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d4415e5f0 0x7f4d4409f340 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00c7a0 tx=0x7f4d3c00cc60 comp rx=0 tx=0).stop 2024-09-12T02:06:07.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.185+0000 7f4d48d31640 1 -- 172.21.15.19:0/3051374950 shutdown_connections 2024-09-12T02:06:07.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.185+0000 7f4d48d31640 1 --2- 172.21.15.19:0/3051374950 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4d2406be30 0x7f4d2406e2f0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.185+0000 7f4d48d31640 1 --2- 172.21.15.19:0/3051374950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d4415e5f0 0x7f4d4409f340 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.185+0000 7f4d48d31640 1 --2- 172.21.15.19:0/3051374950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d440d30f0 0x7f4d4409ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.185+0000 7f4d48d31640 1 --2- 172.21.15.19:0/3051374950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d440b64c0 0x7f4d441f4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.185+0000 7f4d48d31640 1 -- 172.21.15.19:0/3051374950 >> 172.21.15.19:0/3051374950 conn(0x7f4d4408bfc0 msgr2=0x7f4d440d0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:07.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.185+0000 7f4d48d31640 1 -- 172.21.15.19:0/3051374950 shutdown_connections 2024-09-12T02:06:07.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.185+0000 7f4d48d31640 1 -- 172.21.15.19:0/3051374950 wait complete. 2024-09-12T02:06:07.196 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:06:07.196 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Corrupt omap header on 10000000000.00000000', proceeding to ls 2024-09-12T02:06:07.196 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:06:07.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.298+0000 7fd06a3e4640 1 Processor -- start 2024-09-12T02:06:07.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.298+0000 7fd06a3e4640 1 -- start start 2024-09-12T02:06:07.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.299+0000 7fd06a3e4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd06406df60 0x7fd06409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.299+0000 7fd06a3e4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd06409af70 0x7fd064168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.299+0000 7fd06a3e4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd06406cec0 con 0x7fd06415e5d0 2024-09-12T02:06:07.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.299+0000 7fd06a3e4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd06406dad0 con 0x7fd06406df60 2024-09-12T02:06:07.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.299+0000 7fd06a3e4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd06406d1a0 con 0x7fd06409af70 2024-09-12T02:06:07.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.299+0000 7fd0637fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd06406df60 0x7fd06409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.299+0000 7fd0637fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd06406df60 0x7fd06409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60892/0 (socket says 172.21.15.19:60892) 2024-09-12T02:06:07.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.299+0000 7fd0637fe640 1 -- 172.21.15.19:0/850048038 learned_addr learned my addr 172.21.15.19:0/850048038 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:07.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.299+0000 7fd0637fe640 1 -- 172.21.15.19:0/850048038 >> v2:172.21.15.135:3300/0 conn(0x7fd06409af70 msgr2=0x7fd064168560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:06:07.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.299+0000 7fd0637fe640 1 --2- 172.21.15.19:0/850048038 >> v2:172.21.15.135:3300/0 conn(0x7fd06409af70 0x7fd064168560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.299+0000 7fd0637fe640 1 -- 172.21.15.19:0/850048038 >> v1:172.21.15.135:6789/0 conn(0x7fd06415e5d0 legacy=0x7fd0640d10f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:06:07.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.299+0000 7fd0637fe640 1 -- 172.21.15.19:0/850048038 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06406d480 con 0x7fd06406df60 2024-09-12T02:06:07.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.300+0000 7fd0637fe640 1 --2- 172.21.15.19:0/850048038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06406df60 0x7fd06409aa30 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fd0640d2350 tx=0x7fd05802a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19cb47f3fa9504a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:07.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.300+0000 7fd062ffd640 1 -- 172.21.15.19:0/850048038 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058037070 con 0x7fd06406df60 2024-09-12T02:06:07.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.300+0000 7fd062ffd640 1 -- 172.21.15.19:0/850048038 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd058032440 con 0x7fd06406df60 2024-09-12T02:06:07.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.300+0000 7fd062ffd640 1 -- 172.21.15.19:0/850048038 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058032810 con 0x7fd06406df60 2024-09-12T02:06:07.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.301+0000 7fd06a3e4640 1 -- 172.21.15.19:0/850048038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06406df60 msgr2=0x7fd06409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:07.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.301+0000 7fd06a3e4640 1 --2- 172.21.15.19:0/850048038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06406df60 0x7fd06409aa30 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fd0640d2350 tx=0x7fd05802a2e0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.301+0000 7fd06a3e4640 1 -- 172.21.15.19:0/850048038 shutdown_connections 2024-09-12T02:06:07.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.301+0000 7fd06a3e4640 1 --2- 172.21.15.19:0/850048038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06406df60 0x7fd06409aa30 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.301+0000 7fd06a3e4640 1 --2- 172.21.15.19:0/850048038 >> v2:172.21.15.135:3300/0 conn(0x7fd06409af70 0x7fd064168560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.301+0000 7fd06a3e4640 1 -- 172.21.15.19:0/850048038 >> 172.21.15.19:0/850048038 conn(0x7fd0640d23a0 msgr2=0x7fd0640d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:07.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.301+0000 7fd06a3e4640 1 -- 172.21.15.19:0/850048038 shutdown_connections 2024-09-12T02:06:07.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.301+0000 7fd06a3e4640 1 -- 172.21.15.19:0/850048038 wait complete. 2024-09-12T02:06:07.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.302+0000 7fd06a3e4640 1 Processor -- start 2024-09-12T02:06:07.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.302+0000 7fd06a3e4640 1 -- start start 2024-09-12T02:06:07.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.303+0000 7fd06a3e4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd06406df60 0x7fd0641469d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.303+0000 7fd06a3e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd06409af70 0x7fd06415bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.303+0000 7fd06a3e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06415e5d0 0x7fd0641f3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.303+0000 7fd06a3e4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd0640d1980 con 0x7fd06415e5d0 2024-09-12T02:06:07.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.303+0000 7fd06a3e4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd0640d1800 con 0x7fd06406df60 2024-09-12T02:06:07.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.303+0000 7fd06a3e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd06415e9b0 con 0x7fd06409af70 2024-09-12T02:06:07.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.303+0000 7fd068981640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06415e5d0 0x7fd0641f3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.303+0000 7fd068981640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06415e5d0 0x7fd0641f3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60904/0 (socket says 172.21.15.19:60904) 2024-09-12T02:06:07.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.303+0000 7fd068981640 1 -- 172.21.15.19:0/2267251693 learned_addr learned my addr 172.21.15.19:0/2267251693 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:07.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.303+0000 7fd068981640 1 -- 172.21.15.19:0/2267251693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd06409af70 msgr2=0x7fd06415bf10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:06:07.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.303+0000 7fd068981640 1 --2- 172.21.15.19:0/2267251693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd06409af70 0x7fd06415bf10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.303+0000 7fd068981640 1 -- 172.21.15.19:0/2267251693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd06406df60 msgr2=0x7fd0641469d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:07.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.303+0000 7fd068981640 1 --2- 172.21.15.19:0/2267251693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd06406df60 0x7fd0641469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.303+0000 7fd068981640 1 -- 172.21.15.19:0/2267251693 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0640b7a60 con 0x7fd06415e5d0 2024-09-12T02:06:07.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.303+0000 7fd068981640 1 --2- 172.21.15.19:0/2267251693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06415e5d0 0x7fd0641f3970 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00b990 tx=0x7fd05c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:07.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.304+0000 7fd060ff9640 1 -- 172.21.15.19:0/2267251693 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05c019070 con 0x7fd06415e5d0 2024-09-12T02:06:07.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.304+0000 7fd060ff9640 1 -- 172.21.15.19:0/2267251693 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd05c00cba0 con 0x7fd06415e5d0 2024-09-12T02:06:07.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.304+0000 7fd06a3e4640 1 -- 172.21.15.19:0/2267251693 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd064146f10 con 0x7fd06415e5d0 2024-09-12T02:06:07.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.304+0000 7fd060ff9640 1 -- 172.21.15.19:0/2267251693 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05c014440 con 0x7fd06415e5d0 2024-09-12T02:06:07.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.304+0000 7fd06a3e4640 1 -- 172.21.15.19:0/2267251693 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0640b7fc0 con 0x7fd06415e5d0 2024-09-12T02:06:07.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.305+0000 7fd06a3e4640 1 -- 172.21.15.19:0/2267251693 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd06409aa30 con 0x7fd06415e5d0 2024-09-12T02:06:07.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.305+0000 7fd060ff9640 1 -- 172.21.15.19:0/2267251693 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd05c01c070 con 0x7fd06415e5d0 2024-09-12T02:06:07.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.306+0000 7fd060ff9640 1 --2- 172.21.15.19:0/2267251693 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd05006be30 0x7fd05006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:07.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.306+0000 7fd060ff9640 1 -- 172.21.15.19:0/2267251693 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 9141+0+0 (secure 0 0 0) 0x7fd05c08b9d0 con 0x7fd06415e5d0 2024-09-12T02:06:07.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.307+0000 7fd063fff640 1 --2- 172.21.15.19:0/2267251693 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd05006be30 0x7fd05006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:07.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.310+0000 7fd060ff9640 1 -- 172.21.15.19:0/2267251693 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd0640b7a60 con 0x7fd06415e5d0 2024-09-12T02:06:07.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.311+0000 7fd063fff640 1 --2- 172.21.15.19:0/2267251693 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd05006be30 0x7fd05006e2f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fd0540096f0 tx=0x7fd054006c40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:07.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.520+0000 7fd06a3e4640 1 -- 172.21.15.19:0/2267251693 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd064071300 con 0x7fd06415e5d0 2024-09-12T02:06:07.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.521+0000 7fd060ff9640 1 -- 172.21.15.19:0/2267251693 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v287) ==== 53+0+73 (secure 0 0 0) 0x7fd05c0595c0 con 0x7fd06415e5d0 2024-09-12T02:06:07.522 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:06:07.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.523+0000 7fd06a3e4640 1 -- 172.21.15.19:0/2267251693 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd05006be30 msgr2=0x7fd05006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:07.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.523+0000 7fd06a3e4640 1 --2- 172.21.15.19:0/2267251693 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd05006be30 0x7fd05006e2f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fd0540096f0 tx=0x7fd054006c40 comp rx=0 tx=0).stop 2024-09-12T02:06:07.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.523+0000 7fd06a3e4640 1 -- 172.21.15.19:0/2267251693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06415e5d0 msgr2=0x7fd0641f3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:07.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.523+0000 7fd06a3e4640 1 --2- 172.21.15.19:0/2267251693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06415e5d0 0x7fd0641f3970 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00b990 tx=0x7fd05c00be50 comp rx=0 tx=0).stop 2024-09-12T02:06:07.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.523+0000 7fd06a3e4640 1 -- 172.21.15.19:0/2267251693 shutdown_connections 2024-09-12T02:06:07.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.523+0000 7fd06a3e4640 1 --2- 172.21.15.19:0/2267251693 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd05006be30 0x7fd05006e2f0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.523+0000 7fd06a3e4640 1 --2- 172.21.15.19:0/2267251693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06415e5d0 0x7fd0641f3970 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.523+0000 7fd06a3e4640 1 --2- 172.21.15.19:0/2267251693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd06409af70 0x7fd06415bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.523+0000 7fd06a3e4640 1 --2- 172.21.15.19:0/2267251693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd06406df60 0x7fd0641469d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:07.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.523+0000 7fd06a3e4640 1 -- 172.21.15.19:0/2267251693 >> 172.21.15.19:0/2267251693 conn(0x7fd0640d23a0 msgr2=0x7fd0640b2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:07.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.523+0000 7fd06a3e4640 1 -- 172.21.15.19:0/2267251693 shutdown_connections 2024-09-12T02:06:07.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07.523+0000 7fd06a3e4640 1 -- 172.21.15.19:0/2267251693 wait complete. 2024-09-12T02:06:07.535 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:06:07.535 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:06:07.535 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T02:06:07.535 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:06:07.535 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:06:07.535 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:06:07.535 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:06:07.535 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:06:07.535 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:06:07.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:07.536 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T02:06:07.553 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:06:07.553 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:06:07.553 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:06:07.553 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:06:07.553 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T02:06:07.553 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:06:07.553 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:06:07.553 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:06:07.553 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T02:06:07.553 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:06:07.554 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:06:07.554 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T02:06:07.554 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:06:07.554 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:06:07.554 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T02:06:07.554 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:06:07.554 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42193sec preferred_lft 42193sec 2024-09-12T02:06:07.554 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T02:06:07.554 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:06:07.554 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:06:07.554 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:06:07.554 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T02:06:07.554 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:06:07.554 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T02:06:07.555 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:06:07.555 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:06:07.555 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T02:06:07.555 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:06:07.555 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:06:07.555 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:06:07.555 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T02:06:07.555 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:06:07.555 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:06:07.555 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:06:07.555 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T02:06:07.555 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:06:07.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:07.556 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:06:07.618 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T02:06:07.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:07.619 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T02:06:07.676 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T02:06:07.676 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:06:07.676 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:06:07.676 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:06:07.677 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:06:07.677 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:06:07.678 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T02:06:07.678 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:06:07.678 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:06:07.678 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:06:07.678 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T02:06:07.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:06:07.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:06:07.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:07.805 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T02:06:07.821 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:06:07.822 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:06:07.822 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:06:07.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:07.822 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T02:06:07.888 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:06:07.888 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:06:07.944 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:06:07.944 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:06:07.945 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:06:07.999 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:06:08.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:08.000 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:06:08.085 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:06:08.085 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:06:08.085 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:06:08.114 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:06:08.114 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:06:08.114 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:06:08.114 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T02:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T02:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T02:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:06:08.117 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:06:08.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:08.117 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:06:08.143 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:06:08.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:06:08.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:06:08.241 INFO:teuthology.orchestra.run.smithi019.stdout:client7889 2024-09-12T02:06:08.241 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:06:08.241 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:06:08.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:08.258 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2024-09-12T02:06:08.301 INFO:teuthology.orchestra.run:waiting for 20 2024-09-12T02:06:08.315 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:06:08.315+0000 7ff626414640 -1 mds.0.cache.dir(0x10000000000) Corrupt fnode in dirfrag 0x10000000000: Decoder at 'void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)' v=3 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-09-12T02:06:08.316 INFO:teuthology.orchestra.run.smithi019.stdout:.: 2024-09-12T02:06:08.316 INFO:teuthology.orchestra.run.smithi019.stdout:subdir 2024-09-12T02:06:08.316 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:08.316 INFO:teuthology.orchestra.run.smithi019.stdout:./subdir: 2024-09-12T02:06:08.316 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap header on 10000000000.00000000' did not caused DAMAGED state 2024-09-12T02:06:08.316 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap header on 600.00000000' 2024-09-12T02:06:08.317 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:06:08.317 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:06:08.373 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:06:08.373 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:06:08.430 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:06:08.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.575+0000 7f534e703640 1 Processor -- start 2024-09-12T02:06:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.575+0000 7f534e703640 1 -- start start 2024-09-12T02:06:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.576+0000 7f534e703640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53480ce940 0x7f53480cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.576+0000 7f534e703640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f534815ce80 0x7f5348072b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.576+0000 7f534e703640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53480b4f20 con 0x7f53480726b0 2024-09-12T02:06:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.576+0000 7f534e703640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f5348073050 con 0x7f534815ce80 2024-09-12T02:06:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.576+0000 7f534e703640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f53480cd630 con 0x7f53480ce940 2024-09-12T02:06:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.576+0000 7f534cca0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f534815ce80 0x7f5348072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.576+0000 7f5347fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53480ce940 0x7f53480cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.576+0000 7f5347fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53480ce940 0x7f53480cdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:55514/0 (socket says 172.21.15.19:55514) 2024-09-12T02:06:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.576+0000 7f534cca0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f534815ce80 0x7f5348072b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:46622/0 (socket says 172.21.15.19:46622) 2024-09-12T02:06:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.576+0000 7f5347fff640 1 -- 172.21.15.19:0/3088682100 learned_addr learned my addr 172.21.15.19:0/3088682100 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.576+0000 7f53477fe640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f53480726b0 0x7f534815c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:43412/0 (socket says 172.21.15.19:43412) 2024-09-12T02:06:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.577+0000 7f5347fff640 1 -- 172.21.15.19:0/3088682100 >> v2:172.21.15.135:3300/0 conn(0x7f534815ce80 msgr2=0x7f5348072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.577+0000 7f5347fff640 1 --2- 172.21.15.19:0/3088682100 >> v2:172.21.15.135:3300/0 conn(0x7f534815ce80 0x7f5348072b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.577+0000 7f5347fff640 1 -- 172.21.15.19:0/3088682100 >> v1:172.21.15.135:6789/0 conn(0x7f53480726b0 legacy=0x7f534815c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.577+0000 7f5347fff640 1 -- 172.21.15.19:0/3088682100 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534815d350 con 0x7f53480ce940 2024-09-12T02:06:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.577+0000 7f534cca0640 1 --2- 172.21.15.19:0/3088682100 >> v2:172.21.15.135:3300/0 conn(0x7f534815ce80 0x7f5348072b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.577+0000 7f5347fff640 1 --2- 172.21.15.19:0/3088682100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53480ce940 0x7f53480cdac0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5338009870 tx=0x7f533802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17dc8909bfe01505 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.577+0000 7f5346ffd640 1 -- 172.21.15.19:0/3088682100 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338037070 con 0x7f53480ce940 2024-09-12T02:06:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.578+0000 7f5346ffd640 1 -- 172.21.15.19:0/3088682100 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5338032440 con 0x7f53480ce940 2024-09-12T02:06:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.578+0000 7f5346ffd640 1 -- 172.21.15.19:0/3088682100 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338032810 con 0x7f53480ce940 2024-09-12T02:06:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.578+0000 7f534e703640 1 -- 172.21.15.19:0/3088682100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53480ce940 msgr2=0x7f53480cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.578+0000 7f534e703640 1 --2- 172.21.15.19:0/3088682100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53480ce940 0x7f53480cdac0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5338009870 tx=0x7f533802a270 comp rx=0 tx=0).stop 2024-09-12T02:06:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.578+0000 7f534e703640 1 -- 172.21.15.19:0/3088682100 shutdown_connections 2024-09-12T02:06:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.578+0000 7f534e703640 1 --2- 172.21.15.19:0/3088682100 >> v2:172.21.15.135:3300/0 conn(0x7f534815ce80 0x7f5348072b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.578+0000 7f534e703640 1 --2- 172.21.15.19:0/3088682100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53480ce940 0x7f53480cdac0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.578+0000 7f534e703640 1 -- 172.21.15.19:0/3088682100 >> 172.21.15.19:0/3088682100 conn(0x7f534806c030 msgr2=0x7f534806c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.578+0000 7f534e703640 1 -- 172.21.15.19:0/3088682100 shutdown_connections 2024-09-12T02:06:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.578+0000 7f534e703640 1 -- 172.21.15.19:0/3088682100 wait complete. 2024-09-12T02:06:08.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.579+0000 7f534e703640 1 Processor -- start 2024-09-12T02:06:08.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.579+0000 7f534e703640 1 -- start start 2024-09-12T02:06:08.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.580+0000 7f534e703640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53480726b0 0x7f5348155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:08.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.580+0000 7f534e703640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53480ce940 0x7f534806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:08.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.580+0000 7f534e703640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534815ce80 0x7f534806e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:08.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.580+0000 7f534e703640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f53480cd2c0 con 0x7f53480726b0 2024-09-12T02:06:08.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.580+0000 7f534e703640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53480ccfe0 con 0x7f534815ce80 2024-09-12T02:06:08.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.580+0000 7f534e703640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f53480ced20 con 0x7f53480ce940 2024-09-12T02:06:08.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.580+0000 7f5347fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53480726b0 0x7f5348155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:08.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.580+0000 7f5347fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53480726b0 0x7f5348155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60914/0 (socket says 172.21.15.19:60914) 2024-09-12T02:06:08.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.580+0000 7f5347fff640 1 -- 172.21.15.19:0/1703143107 learned_addr learned my addr 172.21.15.19:0/1703143107 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:08.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.580+0000 7f53477fe640 1 --2- 172.21.15.19:0/1703143107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53480ce940 0x7f534806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:08.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.580+0000 7f534cca0640 1 --2- 172.21.15.19:0/1703143107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534815ce80 0x7f534806e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:08.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.581+0000 7f5347fff640 1 -- 172.21.15.19:0/1703143107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53480ce940 msgr2=0x7f534806e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:08.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.581+0000 7f5347fff640 1 --2- 172.21.15.19:0/1703143107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53480ce940 0x7f534806e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.581+0000 7f5347fff640 1 -- 172.21.15.19:0/1703143107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534815ce80 msgr2=0x7f534806e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:08.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.581+0000 7f5347fff640 1 --2- 172.21.15.19:0/1703143107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534815ce80 0x7f534806e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.581+0000 7f5347fff640 1 -- 172.21.15.19:0/1703143107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5348070010 con 0x7f53480726b0 2024-09-12T02:06:08.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.581+0000 7f5347fff640 1 --2- 172.21.15.19:0/1703143107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53480726b0 0x7f5348155860 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f5338000c00 tx=0x7f53380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:08.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.581+0000 7f5344ff9640 1 -- 172.21.15.19:0/1703143107 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338037040 con 0x7f53480726b0 2024-09-12T02:06:08.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.581+0000 7f534e703640 1 -- 172.21.15.19:0/1703143107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534806ef50 con 0x7f53480726b0 2024-09-12T02:06:08.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.581+0000 7f5344ff9640 1 -- 172.21.15.19:0/1703143107 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5338042070 con 0x7f53480726b0 2024-09-12T02:06:08.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.581+0000 7f5344ff9640 1 -- 172.21.15.19:0/1703143107 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338030880 con 0x7f53480726b0 2024-09-12T02:06:08.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.581+0000 7f534e703640 1 -- 172.21.15.19:0/1703143107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f534806fb80 con 0x7f53480726b0 2024-09-12T02:06:08.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.582+0000 7f534e703640 1 -- 172.21.15.19:0/1703143107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53480cdac0 con 0x7f53480726b0 2024-09-12T02:06:08.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.583+0000 7f5344ff9640 1 -- 172.21.15.19:0/1703143107 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5338030a20 con 0x7f53480726b0 2024-09-12T02:06:08.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.583+0000 7f5344ff9640 1 --2- 172.21.15.19:0/1703143107 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f533406be30 0x7f533406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:08.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.583+0000 7f5344ff9640 1 -- 172.21.15.19:0/1703143107 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 9141+0+0 (secure 0 0 0) 0x7f53380ac340 con 0x7f53480726b0 2024-09-12T02:06:08.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.583+0000 7f53477fe640 1 --2- 172.21.15.19:0/1703143107 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f533406be30 0x7f533406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:08.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.584+0000 7f53477fe640 1 --2- 172.21.15.19:0/1703143107 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f533406be30 0x7f533406e2f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f534815ce10 tx=0x7f533c007e20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:08.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.587+0000 7f5344ff9640 1 -- 172.21.15.19:0/1703143107 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f53380798f0 con 0x7f53480726b0 2024-09-12T02:06:08.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.774+0000 7f534e703640 1 -- 172.21.15.19:0/1703143107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f534815cb60 con 0x7f53480726b0 2024-09-12T02:06:08.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.774+0000 7f5344ff9640 1 -- 172.21.15.19:0/1703143107 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 68 entries v128) ==== 81+0+4162 (secure 0 0 0) 0x7f533807dbf0 con 0x7f53480726b0 2024-09-12T02:06:08.775 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3065327567 2024-09-13T02:05:58.503981+0000 2024-09-12T02:06:08.775 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/1975440909 2024-09-13T02:05:43.189507+0000 2024-09-12T02:06:08.775 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3910102099 2024-09-13T02:05:24.866817+0000 2024-09-12T02:06:08.775 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/2839344629 2024-09-13T02:05:20.836728+0000 2024-09-12T02:06:08.776 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/2072535494 2024-09-13T02:02:44.440900+0000 2024-09-12T02:06:08.776 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2405422603 2024-09-13T02:04:31.542456+0000 2024-09-12T02:06:08.776 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/1875416968 2024-09-13T02:03:41.731211+0000 2024-09-12T02:06:08.776 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/4124612835 2024-09-13T02:03:35.697598+0000 2024-09-12T02:06:08.776 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/1101861733 2024-09-13T02:02:54.487980+0000 2024-09-12T02:06:08.776 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3598057058 2024-09-13T02:03:24.636971+0000 2024-09-12T02:06:08.776 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/626316140 2024-09-13T02:04:41.744221+0000 2024-09-12T02:06:08.776 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/46689513 2024-09-13T02:03:28.654366+0000 2024-09-12T02:06:08.776 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3985859189 2024-09-13T02:04:09.906953+0000 2024-09-12T02:06:08.776 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3866905323 2024-09-13T02:03:54.557384+0000 2024-09-12T02:06:08.776 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3997032797 2024-09-13T02:05:16.751616+0000 2024-09-12T02:06:08.776 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:06:08.776 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3995150987 2024-09-13T02:03:22.315702+0000 2024-09-12T02:06:08.777 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/46689513 2024-09-13T02:03:28.654366+0000 2024-09-12T02:06:08.777 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/4287312235 2024-09-13T02:03:11.277301+0000 2024-09-12T02:06:08.777 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/961161264 2024-09-13T02:04:17.973298+0000 2024-09-12T02:06:08.777 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/1975440909 2024-09-13T02:05:43.189507+0000 2024-09-12T02:06:08.777 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:06:08.777 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3279314147 2024-09-13T02:04:33.778955+0000 2024-09-12T02:06:08.777 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/1800650480 2024-09-13T02:03:56.737366+0000 2024-09-12T02:06:08.777 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3279314147 2024-09-13T02:04:33.778955+0000 2024-09-12T02:06:08.777 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/4087550164 2024-09-13T02:04:57.990681+0000 2024-09-12T02:06:08.777 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2201380819 2024-09-13T02:05:10.473806+0000 2024-09-12T02:06:08.777 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3995150987 2024-09-13T02:03:22.315702+0000 2024-09-12T02:06:08.777 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/4124612835 2024-09-13T02:03:35.697598+0000 2024-09-12T02:06:08.777 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/2072535494 2024-09-13T02:02:44.440900+0000 2024-09-12T02:06:08.777 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3985859189 2024-09-13T02:04:09.906953+0000 2024-09-12T02:06:08.778 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/613869354 2024-09-13T02:02:39.104650+0000 2024-09-12T02:06:08.778 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/613869354 2024-09-13T02:02:39.104650+0000 2024-09-12T02:06:08.778 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/650556594 2024-09-13T02:02:50.470816+0000 2024-09-12T02:06:08.778 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3818656517 2024-09-13T02:05:38.158172+0000 2024-09-12T02:06:08.778 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/4287312235 2024-09-13T02:03:11.277301+0000 2024-09-12T02:06:08.778 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/650556594 2024-09-13T02:02:50.470816+0000 2024-09-12T02:06:08.778 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/4107165769 2024-09-13T02:04:03.869164+0000 2024-09-12T02:06:08.778 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/1101861733 2024-09-13T02:02:54.487980+0000 2024-09-12T02:06:08.778 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/1800650480 2024-09-13T02:03:56.737366+0000 2024-09-12T02:06:08.778 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2017831568 2024-09-13T02:04:45.871893+0000 2024-09-12T02:06:08.778 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3136344951 2024-09-13T02:02:58.521234+0000 2024-09-12T02:06:08.778 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3136344951 2024-09-13T02:02:58.521234+0000 2024-09-12T02:06:08.778 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/4107165769 2024-09-13T02:04:03.869164+0000 2024-09-12T02:06:08.778 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/926329492 2024-09-13T02:04:13.937157+0000 2024-09-12T02:06:08.779 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3866905323 2024-09-13T02:03:54.557384+0000 2024-09-12T02:06:08.779 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/926329492 2024-09-13T02:04:13.937157+0000 2024-09-12T02:06:08.779 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/961161264 2024-09-13T02:04:17.973298+0000 2024-09-12T02:06:08.779 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2201380819 2024-09-13T02:05:10.473806+0000 2024-09-12T02:06:08.779 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3910102099 2024-09-13T02:05:24.866817+0000 2024-09-12T02:06:08.779 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2405422603 2024-09-13T02:04:31.542456+0000 2024-09-12T02:06:08.779 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2333858704 2024-09-13T02:04:37.802344+0000 2024-09-12T02:06:08.779 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/1875416968 2024-09-13T02:03:41.731211+0000 2024-09-12T02:06:08.779 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2333858704 2024-09-13T02:04:37.802344+0000 2024-09-12T02:06:08.779 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/626316140 2024-09-13T02:04:41.744221+0000 2024-09-12T02:06:08.779 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2017831568 2024-09-13T02:04:45.871893+0000 2024-09-12T02:06:08.779 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3545886366 2024-09-13T02:04:49.907498+0000 2024-09-12T02:06:08.779 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3818656517 2024-09-13T02:05:38.158172+0000 2024-09-12T02:06:08.779 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3545886366 2024-09-13T02:04:49.907498+0000 2024-09-12T02:06:08.780 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3377480547 2024-09-13T02:04:53.949050+0000 2024-09-12T02:06:08.780 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3598057058 2024-09-13T02:03:24.636971+0000 2024-09-12T02:06:08.780 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3377480547 2024-09-13T02:04:53.949050+0000 2024-09-12T02:06:08.780 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3065327567 2024-09-13T02:05:58.503981+0000 2024-09-12T02:06:08.780 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/4087550164 2024-09-13T02:04:57.990681+0000 2024-09-12T02:06:08.780 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/2195405214 2024-09-13T02:05:12.791934+0000 2024-09-12T02:06:08.780 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/2195405214 2024-09-13T02:05:12.791934+0000 2024-09-12T02:06:08.780 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3997032797 2024-09-13T02:05:16.751616+0000 2024-09-12T02:06:08.780 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/2839344629 2024-09-13T02:05:20.836728+0000 2024-09-12T02:06:08.781 INFO:teuthology.orchestra.run.smithi019.stderr:listed 68 entries 2024-09-12T02:06:08.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.776+0000 7f534e703640 1 -- 172.21.15.19:0/1703143107 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f533406be30 msgr2=0x7f533406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:08.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.776+0000 7f534e703640 1 --2- 172.21.15.19:0/1703143107 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f533406be30 0x7f533406e2f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f534815ce10 tx=0x7f533c007e20 comp rx=0 tx=0).stop 2024-09-12T02:06:08.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.776+0000 7f534e703640 1 -- 172.21.15.19:0/1703143107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53480726b0 msgr2=0x7f5348155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:08.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.776+0000 7f534e703640 1 --2- 172.21.15.19:0/1703143107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53480726b0 0x7f5348155860 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f5338000c00 tx=0x7f53380046c0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.776+0000 7f534e703640 1 -- 172.21.15.19:0/1703143107 shutdown_connections 2024-09-12T02:06:08.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.777+0000 7f534e703640 1 --2- 172.21.15.19:0/1703143107 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f533406be30 0x7f533406e2f0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.777+0000 7f534e703640 1 --2- 172.21.15.19:0/1703143107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534815ce80 0x7f534806e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.777+0000 7f534e703640 1 --2- 172.21.15.19:0/1703143107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53480ce940 0x7f534806e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.777+0000 7f534e703640 1 --2- 172.21.15.19:0/1703143107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53480726b0 0x7f5348155860 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.777+0000 7f534e703640 1 -- 172.21.15.19:0/1703143107 >> 172.21.15.19:0/1703143107 conn(0x7f534806c030 msgr2=0x7f53480b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:08.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.777+0000 7f534e703640 1 -- 172.21.15.19:0/1703143107 shutdown_connections 2024-09-12T02:06:08.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:08.777+0000 7f534e703640 1 -- 172.21.15.19:0/1703143107 wait complete. 2024-09-12T02:06:08.788 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:06:08.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:08.788 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-12T02:06:08.822 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:06:08.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:08.823 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:06:08.878 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:06:09.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.023+0000 7f86e5035640 1 Processor -- start 2024-09-12T02:06:09.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.023+0000 7f86e5035640 1 -- start start 2024-09-12T02:06:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.024+0000 7f86e5035640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86e0162700 0x7f86e0070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.024+0000 7f86e5035640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f86e006f0f0 0x7f86e00b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.024+0000 7f86e5035640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86e00b5130 con 0x7f86e00d0380 2024-09-12T02:06:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.024+0000 7f86e5035640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f86e006f5f0 con 0x7f86e006f0f0 2024-09-12T02:06:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.024+0000 7f86e5035640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f86e006f8d0 con 0x7f86e0162700 2024-09-12T02:06:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.024+0000 7f86ded9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f86e00d0380 0x7f86e0161ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54334/0 (socket says 172.21.15.19:54334) 2024-09-12T02:06:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.024+0000 7f86ded9d640 1 -- 172.21.15.19:0/2807883680 learned_addr learned my addr 172.21.15.19:0/2807883680 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.024+0000 7f86de59c640 1 --2- 172.21.15.19:0/2807883680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86e0162700 0x7f86e0070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.024+0000 7f86df59e640 1 --2- 172.21.15.19:0/2807883680 >> v2:172.21.15.135:3300/0 conn(0x7f86e006f0f0 0x7f86e00b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:09.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.024+0000 7f86ddd9b640 1 -- 172.21.15.19:0/2807883680 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2551598895 0 0) 0x7f86e00b5130 con 0x7f86e00d0380 2024-09-12T02:06:09.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.024+0000 7f86ddd9b640 1 -- 172.21.15.19:0/2807883680 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86c8003520 con 0x7f86e00d0380 2024-09-12T02:06:09.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.024+0000 7f86ddd9b640 1 -- 172.21.15.19:0/2807883680 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 424056914 0 0) 0x7f86c8003520 con 0x7f86e00d0380 2024-09-12T02:06:09.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.024+0000 7f86df59e640 1 -- 172.21.15.19:0/2807883680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86e0162700 msgr2=0x7f86e0070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:09.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.024+0000 7f86df59e640 1 --2- 172.21.15.19:0/2807883680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86e0162700 0x7f86e0070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.024+0000 7f86df59e640 1 -- 172.21.15.19:0/2807883680 >> v1:172.21.15.19:6789/0 conn(0x7f86e00d0380 legacy=0x7f86e0161ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:09.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.024+0000 7f86df59e640 1 -- 172.21.15.19:0/2807883680 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e006fbb0 con 0x7f86e006f0f0 2024-09-12T02:06:09.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.024+0000 7f86de59c640 1 --2- 172.21.15.19:0/2807883680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86e0162700 0x7f86e0070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:09.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.025+0000 7f86df59e640 1 --2- 172.21.15.19:0/2807883680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86e006f0f0 0x7f86e00b5610 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009d90 tx=0x7f86d802a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f34877976828e3fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:09.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.025+0000 7f86ddd9b640 1 -- 172.21.15.19:0/2807883680 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d0001690 con 0x7f86e006f0f0 2024-09-12T02:06:09.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.025+0000 7f86ddd9b640 1 -- 172.21.15.19:0/2807883680 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d8007540 con 0x7f86e006f0f0 2024-09-12T02:06:09.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.025+0000 7f86ddd9b640 1 -- 172.21.15.19:0/2807883680 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d80078f0 con 0x7f86e006f0f0 2024-09-12T02:06:09.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.026+0000 7f86e5035640 1 -- 172.21.15.19:0/2807883680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86e006f0f0 msgr2=0x7f86e00b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:09.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.026+0000 7f86e5035640 1 --2- 172.21.15.19:0/2807883680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86e006f0f0 0x7f86e00b5610 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009d90 tx=0x7f86d802a560 comp rx=0 tx=0).stop 2024-09-12T02:06:09.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.026+0000 7f86e5035640 1 -- 172.21.15.19:0/2807883680 shutdown_connections 2024-09-12T02:06:09.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.026+0000 7f86e5035640 1 --2- 172.21.15.19:0/2807883680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86e006f0f0 0x7f86e00b5610 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.026+0000 7f86e5035640 1 --2- 172.21.15.19:0/2807883680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86e0162700 0x7f86e0070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.026+0000 7f86e5035640 1 -- 172.21.15.19:0/2807883680 >> 172.21.15.19:0/2807883680 conn(0x7f86e006bc10 msgr2=0x7f86e006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:09.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.026+0000 7f86e5035640 1 -- 172.21.15.19:0/2807883680 shutdown_connections 2024-09-12T02:06:09.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.026+0000 7f86e5035640 1 -- 172.21.15.19:0/2807883680 wait complete. 2024-09-12T02:06:09.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.027+0000 7f86e5035640 1 Processor -- start 2024-09-12T02:06:09.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.027+0000 7f86e5035640 1 -- start start 2024-09-12T02:06:09.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.028+0000 7f86e5035640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86e006f0f0 0x7f86e0144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:09.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.028+0000 7f86e5035640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86e00d0380 0x7f86e013c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:09.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.028+0000 7f86e5035640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86e0162700 0x7f86e013d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:09.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.028+0000 7f86e5035640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f86e00d0760 con 0x7f86e006f0f0 2024-09-12T02:06:09.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.028+0000 7f86e5035640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f86e0147ea0 con 0x7f86e00d0380 2024-09-12T02:06:09.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.028+0000 7f86e5035640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f86e00d08e0 con 0x7f86e0162700 2024-09-12T02:06:09.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.028+0000 7f86ded9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86e006f0f0 0x7f86e0144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:09.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.028+0000 7f86ded9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86e006f0f0 0x7f86e0144b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60924/0 (socket says 172.21.15.19:60924) 2024-09-12T02:06:09.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.028+0000 7f86ded9d640 1 -- 172.21.15.19:0/220720344 learned_addr learned my addr 172.21.15.19:0/220720344 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:09.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.028+0000 7f86df59e640 1 --2- 172.21.15.19:0/220720344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86e0162700 0x7f86e013d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:09.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.028+0000 7f86de59c640 1 --2- 172.21.15.19:0/220720344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86e00d0380 0x7f86e013c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:09.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.029+0000 7f86ded9d640 1 -- 172.21.15.19:0/220720344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86e0162700 msgr2=0x7f86e013d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:09.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.029+0000 7f86ded9d640 1 --2- 172.21.15.19:0/220720344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86e0162700 0x7f86e013d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.029+0000 7f86ded9d640 1 -- 172.21.15.19:0/220720344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86e00d0380 msgr2=0x7f86e013c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:09.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.029+0000 7f86ded9d640 1 --2- 172.21.15.19:0/220720344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86e00d0380 0x7f86e013c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.029+0000 7f86ded9d640 1 -- 172.21.15.19:0/220720344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e01f45a0 con 0x7f86e006f0f0 2024-09-12T02:06:09.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.029+0000 7f86ded9d640 1 --2- 172.21.15.19:0/220720344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86e006f0f0 0x7f86e0144b70 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f86d000c780 tx=0x7f86d000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:09.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.029+0000 7f86c77fe640 1 -- 172.21.15.19:0/220720344 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d0018070 con 0x7f86e006f0f0 2024-09-12T02:06:09.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.029+0000 7f86c77fe640 1 -- 172.21.15.19:0/220720344 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d00072d0 con 0x7f86e006f0f0 2024-09-12T02:06:09.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.029+0000 7f86c77fe640 1 -- 172.21.15.19:0/220720344 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d00047e0 con 0x7f86e006f0f0 2024-09-12T02:06:09.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.029+0000 7f86e5035640 1 -- 172.21.15.19:0/220720344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e015f290 con 0x7f86e006f0f0 2024-09-12T02:06:09.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.029+0000 7f86e5035640 1 -- 172.21.15.19:0/220720344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e015f810 con 0x7f86e006f0f0 2024-09-12T02:06:09.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.030+0000 7f86e5035640 1 -- 172.21.15.19:0/220720344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86e0070a10 con 0x7f86e006f0f0 2024-09-12T02:06:09.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.031+0000 7f86c77fe640 1 -- 172.21.15.19:0/220720344 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f86d001b070 con 0x7f86e006f0f0 2024-09-12T02:06:09.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.031+0000 7f86c77fe640 1 --2- 172.21.15.19:0/220720344 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f86cc06be30 0x7f86cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:09.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.031+0000 7f86c77fe640 1 -- 172.21.15.19:0/220720344 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 9141+0+0 (secure 0 0 0) 0x7f86d008b0c0 con 0x7f86e006f0f0 2024-09-12T02:06:09.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.031+0000 7f86de59c640 1 --2- 172.21.15.19:0/220720344 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f86cc06be30 0x7f86cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:09.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.032+0000 7f86de59c640 1 --2- 172.21.15.19:0/220720344 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f86cc06be30 0x7f86cc06e2f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009560 tx=0x7f86d4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:09.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.036+0000 7f86c77fe640 1 -- 172.21.15.19:0/220720344 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f86d0058660 con 0x7f86e006f0f0 2024-09-12T02:06:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.249+0000 7f86e5035640 1 -- 172.21.15.19:0/220720344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f86e01468c0 con 0x7f86e006f0f0 2024-09-12T02:06:09.250 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:06:09.250+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:06:09.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.252+0000 7f86c77fe640 1 -- 172.21.15.19:0/220720344 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v288) ==== 161+0+0 (secure 0 0 0) 0x7f86d005c960 con 0x7f86e006f0f0 2024-09-12T02:06:09.252 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:06:09.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.255+0000 7f86e5035640 1 -- 172.21.15.19:0/220720344 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f86cc06be30 msgr2=0x7f86cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:09.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.255+0000 7f86e5035640 1 --2- 172.21.15.19:0/220720344 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f86cc06be30 0x7f86cc06e2f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009560 tx=0x7f86d4009190 comp rx=0 tx=0).stop 2024-09-12T02:06:09.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.255+0000 7f86e5035640 1 -- 172.21.15.19:0/220720344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86e006f0f0 msgr2=0x7f86e0144b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:09.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.255+0000 7f86e5035640 1 --2- 172.21.15.19:0/220720344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86e006f0f0 0x7f86e0144b70 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f86d000c780 tx=0x7f86d000cc40 comp rx=0 tx=0).stop 2024-09-12T02:06:09.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.255+0000 7f86e5035640 1 -- 172.21.15.19:0/220720344 shutdown_connections 2024-09-12T02:06:09.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.255+0000 7f86e5035640 1 --2- 172.21.15.19:0/220720344 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f86cc06be30 0x7f86cc06e2f0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.255+0000 7f86e5035640 1 --2- 172.21.15.19:0/220720344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86e0162700 0x7f86e013d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.255+0000 7f86e5035640 1 --2- 172.21.15.19:0/220720344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86e00d0380 0x7f86e013c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.255+0000 7f86e5035640 1 --2- 172.21.15.19:0/220720344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86e006f0f0 0x7f86e0144b70 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.255+0000 7f86e5035640 1 -- 172.21.15.19:0/220720344 >> 172.21.15.19:0/220720344 conn(0x7f86e006bc10 msgr2=0x7f86e00b64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:09.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.255+0000 7f86e5035640 1 -- 172.21.15.19:0/220720344 shutdown_connections 2024-09-12T02:06:09.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.255+0000 7f86e5035640 1 -- 172.21.15.19:0/220720344 wait complete. 2024-09-12T02:06:09.257 INFO:tasks.ceph.mds.c.smithi019.stderr: -647> 2024-09-12T02:06:04.513+0000 7ff62a41c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:06:09.257 INFO:tasks.ceph.mds.c.smithi019.stderr: -152> 2024-09-12T02:06:08.315+0000 7ff626414640 -1 mds.0.cache.dir(0x10000000000) Corrupt fnode in dirfrag 0x10000000000: Decoder at 'void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)' v=3 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-09-12T02:06:09.267 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:06:09.281 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:06:09.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.370+0000 7f1b94def640 1 Processor -- start 2024-09-12T02:06:09.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.370+0000 7f1b94def640 1 -- start start 2024-09-12T02:06:09.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.371+0000 7f1b94def640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b9015e740 0x7f1b900d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:09.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.371+0000 7f1b94def640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9009b690 0x7f1b9006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:09.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.371+0000 7f1b94def640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b9006e000 con 0x7f1b9006d4c0 2024-09-12T02:06:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.371+0000 7f1b94def640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f1b9015eb20 con 0x7f1b9015e740 2024-09-12T02:06:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.371+0000 7f1b94def640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1b9006d260 con 0x7f1b9009b690 2024-09-12T02:06:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.371+0000 7f1b8e59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b9015e740 0x7f1b900d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.371+0000 7f1b8e59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b9015e740 0x7f1b900d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60950/0 (socket says 172.21.15.19:60950) 2024-09-12T02:06:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.371+0000 7f1b8e59c640 1 -- 172.21.15.19:0/2528992814 learned_addr learned my addr 172.21.15.19:0/2528992814 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.371+0000 7f1b8e59c640 1 -- 172.21.15.19:0/2528992814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9009b690 msgr2=0x7f1b9006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.371+0000 7f1b87fff640 1 --2- 172.21.15.19:0/2528992814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9009b690 0x7f1b9006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.371+0000 7f1b8e59c640 1 --2- 172.21.15.19:0/2528992814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9009b690 0x7f1b9006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.371+0000 7f1b8e59c640 1 -- 172.21.15.19:0/2528992814 >> v1:172.21.15.135:6789/0 conn(0x7f1b9006d4c0 legacy=0x7f1b9006d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.371+0000 7f1b8e59c640 1 -- 172.21.15.19:0/2528992814 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b900d0780 con 0x7f1b9015e740 2024-09-12T02:06:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.371+0000 7f1b87fff640 1 --2- 172.21.15.19:0/2528992814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9009b690 0x7f1b9006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.372+0000 7f1b8e59c640 1 --2- 172.21.15.19:0/2528992814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9015e740 0x7f1b900d1540 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f1b80009870 tx=0x7f1b8002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219eb081ec31efb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.372+0000 7f1b8dd9b640 1 -- 172.21.15.19:0/2528992814 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b80037070 con 0x7f1b9015e740 2024-09-12T02:06:09.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.372+0000 7f1b8dd9b640 1 -- 172.21.15.19:0/2528992814 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b80032440 con 0x7f1b9015e740 2024-09-12T02:06:09.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.372+0000 7f1b8dd9b640 1 -- 172.21.15.19:0/2528992814 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b80032810 con 0x7f1b9015e740 2024-09-12T02:06:09.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.373+0000 7f1b94def640 1 -- 172.21.15.19:0/2528992814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9015e740 msgr2=0x7f1b900d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:09.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.373+0000 7f1b94def640 1 --2- 172.21.15.19:0/2528992814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9015e740 0x7f1b900d1540 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f1b80009870 tx=0x7f1b8002a2a0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.373+0000 7f1b94def640 1 -- 172.21.15.19:0/2528992814 shutdown_connections 2024-09-12T02:06:09.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.373+0000 7f1b94def640 1 --2- 172.21.15.19:0/2528992814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9009b690 0x7f1b9006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.373+0000 7f1b94def640 1 --2- 172.21.15.19:0/2528992814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9015e740 0x7f1b900d1540 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.373+0000 7f1b94def640 1 -- 172.21.15.19:0/2528992814 >> 172.21.15.19:0/2528992814 conn(0x7f1b900d23a0 msgr2=0x7f1b900d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:09.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.373+0000 7f1b94def640 1 -- 172.21.15.19:0/2528992814 shutdown_connections 2024-09-12T02:06:09.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.373+0000 7f1b94def640 1 -- 172.21.15.19:0/2528992814 wait complete. 2024-09-12T02:06:09.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.374+0000 7f1b94def640 1 Processor -- start 2024-09-12T02:06:09.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.374+0000 7f1b94def640 1 -- start start 2024-09-12T02:06:09.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.375+0000 7f1b94def640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b9006d4c0 0x7f1b900c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:09.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.375+0000 7f1b94def640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9009b690 0x7f1b900b7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:09.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.375+0000 7f1b94def640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9015e740 0x7f1b9014c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:09.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.375+0000 7f1b94def640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1b900d1020 con 0x7f1b9015e740 2024-09-12T02:06:09.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.375+0000 7f1b94def640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1b900d0d40 con 0x7f1b9006d4c0 2024-09-12T02:06:09.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.375+0000 7f1b94def640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1b9009ba90 con 0x7f1b9009b690 2024-09-12T02:06:09.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.375+0000 7f1b8ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9015e740 0x7f1b9014c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:09.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.375+0000 7f1b8ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9015e740 0x7f1b9014c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60956/0 (socket says 172.21.15.19:60956) 2024-09-12T02:06:09.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.375+0000 7f1b8ed9d640 1 -- 172.21.15.19:0/1015586314 learned_addr learned my addr 172.21.15.19:0/1015586314 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:09.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.375+0000 7f1b87fff640 1 --2- 172.21.15.19:0/1015586314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9009b690 0x7f1b900b7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:09.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.375+0000 7f1b8e59c640 1 --2- 172.21.15.19:0/1015586314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b9006d4c0 0x7f1b900c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:09.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.375+0000 7f1b8ed9d640 1 -- 172.21.15.19:0/1015586314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9009b690 msgr2=0x7f1b900b7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:09.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.375+0000 7f1b8ed9d640 1 --2- 172.21.15.19:0/1015586314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9009b690 0x7f1b900b7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.375+0000 7f1b8ed9d640 1 -- 172.21.15.19:0/1015586314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b9006d4c0 msgr2=0x7f1b900c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:09.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.375+0000 7f1b8ed9d640 1 --2- 172.21.15.19:0/1015586314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b9006d4c0 0x7f1b900c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.375+0000 7f1b8ed9d640 1 -- 172.21.15.19:0/1015586314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b900b8140 con 0x7f1b9015e740 2024-09-12T02:06:09.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.376+0000 7f1b8ed9d640 1 --2- 172.21.15.19:0/1015586314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9015e740 0x7f1b9014c6b0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800b970 tx=0x7f1b8800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:09.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.376+0000 7f1b86ffd640 1 -- 172.21.15.19:0/1015586314 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88019070 con 0x7f1b9015e740 2024-09-12T02:06:09.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.376+0000 7f1b86ffd640 1 -- 172.21.15.19:0/1015586314 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b8800cb40 con 0x7f1b9015e740 2024-09-12T02:06:09.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.376+0000 7f1b94def640 1 -- 172.21.15.19:0/1015586314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b900b6b60 con 0x7f1b9015e740 2024-09-12T02:06:09.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.376+0000 7f1b86ffd640 1 -- 172.21.15.19:0/1015586314 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88014440 con 0x7f1b9015e740 2024-09-12T02:06:09.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.376+0000 7f1b94def640 1 -- 172.21.15.19:0/1015586314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b900b7120 con 0x7f1b9015e740 2024-09-12T02:06:09.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.377+0000 7f1b94def640 1 -- 172.21.15.19:0/1015586314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b9006cd20 con 0x7f1b9015e740 2024-09-12T02:06:09.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.377+0000 7f1b86ffd640 1 -- 172.21.15.19:0/1015586314 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b8801c070 con 0x7f1b9015e740 2024-09-12T02:06:09.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.378+0000 7f1b86ffd640 1 --2- 172.21.15.19:0/1015586314 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1b7006be30 0x7f1b7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:09.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.378+0000 7f1b86ffd640 1 -- 172.21.15.19:0/1015586314 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 9227+0+0 (secure 0 0 0) 0x7f1b8808b7e0 con 0x7f1b9015e740 2024-09-12T02:06:09.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.378+0000 7f1b8e59c640 1 --2- 172.21.15.19:0/1015586314 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1b7006be30 0x7f1b7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:09.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.379+0000 7f1b8e59c640 1 --2- 172.21.15.19:0/1015586314 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1b7006be30 0x7f1b7006e2f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1b80034000 tx=0x7f1b8002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:09.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.382+0000 7f1b86ffd640 1 -- 172.21.15.19:0/1015586314 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b900b8140 con 0x7f1b9015e740 2024-09-12T02:06:09.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:09.628+0000 7f1b94def640 1 -- 172.21.15.19:0/1015586314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f1b900b8320 con 0x7f1b9015e740 2024-09-12T02:06:10.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.253+0000 7f1b86ffd640 1 -- 172.21.15.19:0/1015586314 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v289) ==== 107+0+0 (secure 0 0 0) 0x7f1b88058d30 con 0x7f1b9015e740 2024-09-12T02:06:10.257 INFO:teuthology.orchestra.run.smithi019.stderr:nothing to do: rank is not damaged 2024-09-12T02:06:10.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.256+0000 7f1b94def640 1 -- 172.21.15.19:0/1015586314 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1b7006be30 msgr2=0x7f1b7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.256+0000 7f1b94def640 1 --2- 172.21.15.19:0/1015586314 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1b7006be30 0x7f1b7006e2f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1b80034000 tx=0x7f1b8002e000 comp rx=0 tx=0).stop 2024-09-12T02:06:10.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.256+0000 7f1b94def640 1 -- 172.21.15.19:0/1015586314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9015e740 msgr2=0x7f1b9014c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.256+0000 7f1b94def640 1 --2- 172.21.15.19:0/1015586314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9015e740 0x7f1b9014c6b0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800b970 tx=0x7f1b8800be30 comp rx=0 tx=0).stop 2024-09-12T02:06:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.256+0000 7f1b94def640 1 -- 172.21.15.19:0/1015586314 shutdown_connections 2024-09-12T02:06:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.256+0000 7f1b94def640 1 --2- 172.21.15.19:0/1015586314 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1b7006be30 0x7f1b7006e2f0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.256+0000 7f1b94def640 1 --2- 172.21.15.19:0/1015586314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9015e740 0x7f1b9014c6b0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.256+0000 7f1b94def640 1 --2- 172.21.15.19:0/1015586314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9009b690 0x7f1b900b7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.256+0000 7f1b94def640 1 --2- 172.21.15.19:0/1015586314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b9006d4c0 0x7f1b900c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.256+0000 7f1b94def640 1 -- 172.21.15.19:0/1015586314 >> 172.21.15.19:0/1015586314 conn(0x7f1b900d23a0 msgr2=0x7f1b900ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.256+0000 7f1b94def640 1 -- 172.21.15.19:0/1015586314 shutdown_connections 2024-09-12T02:06:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.256+0000 7f1b94def640 1 -- 172.21.15.19:0/1015586314 wait complete. 2024-09-12T02:06:10.270 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:06:10.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.357+0000 7fdfb891df40 1 Processor -- start 2024-09-12T02:06:10.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.357+0000 7fdfb891df40 1 -- start start 2024-09-12T02:06:10.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.358+0000 7fdfb891df40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x565243f4c9e0 0x565243f91b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.358+0000 7fdfb891df40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565243f4e460 0x56524401e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.358+0000 7fdfb891df40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565244023fb0 0x565243f978b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.358+0000 7fdfb891df40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x565243f4d1c0 con 0x565244023fb0 2024-09-12T02:06:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.358+0000 7fdfb891df40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x565243f4cf20 con 0x565243f4e460 2024-09-12T02:06:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.358+0000 7fdfb891df40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x565243f4d720 con 0x565243f4c9e0 2024-09-12T02:06:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.358+0000 7fdfb61d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565244023fb0 0x565243f978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.358+0000 7fdfb59cf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x565243f4c9e0 0x565243f91b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.358+0000 7fdfb61d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565244023fb0 0x565243f978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60970/0 (socket says 172.21.15.19:60970) 2024-09-12T02:06:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.358+0000 7fdfb51ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565243f4e460 0x56524401e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.358+0000 7fdfb61d0640 1 -- 172.21.15.19:0/1306043970 learned_addr learned my addr 172.21.15.19:0/1306043970 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:10.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.359+0000 7fdfb61d0640 1 -- 172.21.15.19:0/1306043970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x565243f4c9e0 msgr2=0x565243f91b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:10.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.359+0000 7fdfb61d0640 1 --2- 172.21.15.19:0/1306043970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x565243f4c9e0 0x565243f91b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.359+0000 7fdfb61d0640 1 -- 172.21.15.19:0/1306043970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565243f4e460 msgr2=0x56524401e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:10.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.359+0000 7fdfb61d0640 1 --2- 172.21.15.19:0/1306043970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565243f4e460 0x56524401e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.359+0000 7fdfb61d0640 1 -- 172.21.15.19:0/1306043970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565243e77cb0 con 0x565244023fb0 2024-09-12T02:06:10.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.359+0000 7fdfb61d0640 1 --2- 172.21.15.19:0/1306043970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565244023fb0 0x565243f978b0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0005fd0 tx=0x7fdfb0050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62cd68feac1c42a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:10.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.359+0000 7fdfa7fff640 1 -- 172.21.15.19:0/1306043970 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0054040 con 0x565244023fb0 2024-09-12T02:06:10.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.359+0000 7fdfa7fff640 1 -- 172.21.15.19:0/1306043970 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb0050800 con 0x565244023fb0 2024-09-12T02:06:10.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.359+0000 7fdfa7fff640 1 -- 172.21.15.19:0/1306043970 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0050bd0 con 0x565244023fb0 2024-09-12T02:06:10.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.360+0000 7fdfb891df40 1 -- 172.21.15.19:0/1306043970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565244023fb0 msgr2=0x565243f978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.360+0000 7fdfb891df40 1 --2- 172.21.15.19:0/1306043970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565244023fb0 0x565243f978b0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0005fd0 tx=0x7fdfb0050000 comp rx=0 tx=0).stop 2024-09-12T02:06:10.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.360+0000 7fdfb891df40 1 -- 172.21.15.19:0/1306043970 shutdown_connections 2024-09-12T02:06:10.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.360+0000 7fdfb891df40 1 --2- 172.21.15.19:0/1306043970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565244023fb0 0x565243f978b0 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.360+0000 7fdfb891df40 1 --2- 172.21.15.19:0/1306043970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565243f4e460 0x56524401e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.360+0000 7fdfb891df40 1 --2- 172.21.15.19:0/1306043970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x565243f4c9e0 0x565243f91b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.360+0000 7fdfb891df40 1 -- 172.21.15.19:0/1306043970 >> 172.21.15.19:0/1306043970 conn(0x565243f7a490 msgr2=0x565243f50690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:10.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.360+0000 7fdfb891df40 1 -- 172.21.15.19:0/1306043970 shutdown_connections 2024-09-12T02:06:10.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.360+0000 7fdfb891df40 1 -- 172.21.15.19:0/1306043970 wait complete. 2024-09-12T02:06:10.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.360+0000 7fdfb891df40 1 Processor -- start 2024-09-12T02:06:10.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.360+0000 7fdfb891df40 1 -- start start 2024-09-12T02:06:10.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.361+0000 7fdfb891df40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565243f4c9e0 0x565243f79b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.361+0000 7fdfb891df40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565243f4e460 0x5652440160b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.361+0000 7fdfb891df40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x565244023fb0 0x565244016b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.361+0000 7fdfb891df40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x565244021dc0 con 0x565243f4e460 2024-09-12T02:06:10.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.361+0000 7fdfb891df40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x565243f94b30 con 0x565243f4c9e0 2024-09-12T02:06:10.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.361+0000 7fdfb891df40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x565243f7bd80 con 0x565244023fb0 2024-09-12T02:06:10.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.361+0000 7fdfb51ce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565243f4e460 0x5652440160b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.361+0000 7fdfb51ce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565243f4e460 0x5652440160b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60986/0 (socket says 172.21.15.19:60986) 2024-09-12T02:06:10.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.361+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 learned_addr learned my addr 172.21.15.19:0/422360841 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:10.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.361+0000 7fdfb59cf640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565243f4c9e0 0x565243f79b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.361+0000 7fdfb61d0640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x565244023fb0 0x565244016b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.362+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x565244023fb0 msgr2=0x565244016b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.362+0000 7fdfb51ce640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x565244023fb0 0x565244016b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.362+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565243f4c9e0 msgr2=0x565243f79b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.362+0000 7fdfb51ce640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565243f4c9e0 0x565243f79b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.362+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565244026c20 con 0x565243f4e460 2024-09-12T02:06:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.362+0000 7fdfb59cf640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565243f4c9e0 0x565243f79b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.362+0000 7fdfb51ce640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565243f4e460 0x5652440160b0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fdfac008710 tx=0x7fdfac008800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.362+0000 7fdfa6ffd640 1 -- 172.21.15.19:0/422360841 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac019020 con 0x565243f4e460 2024-09-12T02:06:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.362+0000 7fdfa6ffd640 1 -- 172.21.15.19:0/422360841 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfac015940 con 0x565243f4e460 2024-09-12T02:06:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.362+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652440271a0 con 0x565243f4e460 2024-09-12T02:06:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.362+0000 7fdfa6ffd640 1 -- 172.21.15.19:0/422360841 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac015d30 con 0x565243f4e460 2024-09-12T02:06:10.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.362+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565244026ec0 con 0x565243f4e460 2024-09-12T02:06:10.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.364+0000 7fdfa6ffd640 1 -- 172.21.15.19:0/422360841 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdfac01c020 con 0x565243f4e460 2024-09-12T02:06:10.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.364+0000 7fdfa6ffd640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdf9806a840 0x7fdf9806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.364+0000 7fdfa6ffd640 1 -- 172.21.15.19:0/422360841 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 9227+0+0 (secure 0 0 0) 0x7fdfac08b250 con 0x565243f4e460 2024-09-12T02:06:10.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.364+0000 7fdfb59cf640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdf9806a840 0x7fdf9806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.368 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:06:10.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.364+0000 7fdfb891df40 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x565243f506e0 0x56524401f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.364+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440170a0 con 0x565243f506e0 2024-09-12T02:06:10.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.365+0000 7fdfb61d0640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x565243f506e0 0x56524401f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.365+0000 7fdfb59cf640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdf9806a840 0x7fdf9806cd00 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8005fd0 tx=0x7fdfa800c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:10.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.365+0000 7fdfb61d0640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x565243f506e0 0x56524401f810 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:10.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.367+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v129'1065 uv1038 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fdfb0056030 con 0x565243f506e0 2024-09-12T02:06:10.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.367+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x56524401fd50 con 0x565243f506e0 2024-09-12T02:06:10.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.368+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v129'1066 uv1066 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.368+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c6db0 con 0x565243f506e0 2024-09-12T02:06:10.370 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:06:10.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.369+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v129'1067 uv1067 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.369+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c8160 con 0x565243f506e0 2024-09-12T02:06:10.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.370+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v129'1068 uv1068 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.370+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c8500 con 0x565243f506e0 2024-09-12T02:06:10.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.372+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v129'1069 uv1069 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.372+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c7150 con 0x565243f506e0 2024-09-12T02:06:10.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.373+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v129'1070 uv1070 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.373+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c7540 con 0x565243f506e0 2024-09-12T02:06:10.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.374+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v129'1071 uv1044 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.374+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.375+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v129'1072 uv1072 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.376+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.377+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v129'1073 uv1073 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.377 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:06:10.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.377+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.378+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v129'1074 uv1074 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.378+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.379+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v129'1075 uv1075 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.379+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.380+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v129'1076 uv1076 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.380+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.381+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v129'1077 uv1064 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.381+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.383+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v129'1078 uv1078 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.383+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.384+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v129'1079 uv1079 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.384 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:06:10.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.384+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.385+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v129'1080 uv1080 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.385+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.386+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v129'1081 uv1081 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.386+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.387+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v129'1082 uv1082 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.387+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.388+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v129'1083 uv1083 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.389+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.390+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v129'1084 uv1057 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.390+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.391+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v129'1085 uv1085 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.391+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.392 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:06:10.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.392+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v129'1086 uv1086 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.392+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.394+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v129'1087 uv1087 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.394+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.395+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v129'1088 uv1088 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.395+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.396+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v129'1089 uv1089 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.396+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.397+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v129'1090 uv1063 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.397+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.398+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v129'1091 uv1091 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.398+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.399 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:06:10.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.399+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v129'1092 uv1092 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.399+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.400+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v129'1093 uv1093 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.400+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.401+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v129'1094 uv1094 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.401+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440c78e0 con 0x565243f506e0 2024-09-12T02:06:10.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.402+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v129'1095 uv1095 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x565243f506e0 2024-09-12T02:06:10.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.402+0000 7fdfb891df40 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5652440c88a0 0x5652440cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.402+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440cb1d0 con 0x5652440c88a0 2024-09-12T02:06:10.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.403+0000 7fdfb59cf640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5652440c88a0 0x5652440cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.403+0000 7fdfb59cf640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5652440c88a0 0x5652440cac90 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:10.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.405+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v129'778 uv757 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.405+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440cb570 con 0x5652440c88a0 2024-09-12T02:06:10.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.407+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v129'779 uv779 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.407+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440cb910 con 0x5652440c88a0 2024-09-12T02:06:10.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.408+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v129'780 uv780 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.408 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:06:10.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.408+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440cc160 con 0x5652440c88a0 2024-09-12T02:06:10.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.409+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v129'781 uv781 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.409+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440cc500 con 0x5652440c88a0 2024-09-12T02:06:10.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.411+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v129'782 uv782 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.411+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440cc8a0 con 0x5652440c88a0 2024-09-12T02:06:10.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.413+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v129'783 uv776 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.413+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440ccc40 con 0x5652440c88a0 2024-09-12T02:06:10.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.414+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v129'784 uv784 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.414+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440ccfe0 con 0x5652440c88a0 2024-09-12T02:06:10.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.415+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v129'785 uv785 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.416 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:06:10.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.415+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440ccfe0 con 0x5652440c88a0 2024-09-12T02:06:10.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.417+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v129'786 uv786 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.417+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440ccfe0 con 0x5652440c88a0 2024-09-12T02:06:10.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.418+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v129'787 uv787 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.418+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440ccfe0 con 0x5652440c88a0 2024-09-12T02:06:10.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.419+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v129'788 uv777 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.419+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440ccfe0 con 0x5652440c88a0 2024-09-12T02:06:10.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.421+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v129'789 uv789 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.421+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440ccfe0 con 0x5652440c88a0 2024-09-12T02:06:10.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.422+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v129'790 uv790 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.422 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:06:10.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.422+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d1460 con 0x5652440c88a0 2024-09-12T02:06:10.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.424+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v129'791 uv791 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.424+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d1460 con 0x5652440c88a0 2024-09-12T02:06:10.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.425+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v129'792 uv792 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.425+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440ccfe0 con 0x5652440c88a0 2024-09-12T02:06:10.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.426+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v129'793 uv773 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.427+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440ccfe0 con 0x5652440c88a0 2024-09-12T02:06:10.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.428+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v129'794 uv794 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.428+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440ccfe0 con 0x5652440c88a0 2024-09-12T02:06:10.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.429+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v129'795 uv795 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.429 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:06:10.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.429+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440cdff0 con 0x5652440c88a0 2024-09-12T02:06:10.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.430+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v129'796 uv796 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.430+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440cdff0 con 0x5652440c88a0 2024-09-12T02:06:10.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.431+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v129'797 uv797 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.431+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440ccfe0 con 0x5652440c88a0 2024-09-12T02:06:10.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.433+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v129'798 uv798 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440c88a0 2024-09-12T02:06:10.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.433+0000 7fdfb891df40 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5652440cd8e0 0x5652440cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.433+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d0210 con 0x5652440cd8e0 2024-09-12T02:06:10.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.433+0000 7fdfb51ce640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5652440cd8e0 0x5652440cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.433+0000 7fdfb51ce640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5652440cd8e0 0x5652440cfcd0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:10.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.435+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v129'207 uv206 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.435+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440d05f0 con 0x5652440cd8e0 2024-09-12T02:06:10.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.436+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v129'208 uv208 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.436+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d0aa0 con 0x5652440cd8e0 2024-09-12T02:06:10.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.437+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v129'209 uv209 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.437 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:06:10.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.437+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440cbd90 con 0x5652440cd8e0 2024-09-12T02:06:10.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.438+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v129'210 uv210 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.438+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d2410 con 0x5652440cd8e0 2024-09-12T02:06:10.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.439+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v129'211 uv211 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.439+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d1340 con 0x5652440cd8e0 2024-09-12T02:06:10.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.440+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v129'212 uv212 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.440+0000 7fdfb891df40 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5652440d1e00 0x5652440d4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.440+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d4db0 con 0x5652440d1e00 2024-09-12T02:06:10.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.440+0000 7fdfb61d0640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5652440d1e00 0x5652440d4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.441+0000 7fdfb61d0640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5652440d1e00 0x5652440d4870 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:10.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.442+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v129'156 uv155 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.442+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440d51a0 con 0x5652440d1e00 2024-09-12T02:06:10.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.443+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v129'157 uv157 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.443+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d51a0 con 0x5652440d1e00 2024-09-12T02:06:10.445 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:06:10.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.444+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v129'158 uv158 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.444+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d51a0 con 0x5652440d1e00 2024-09-12T02:06:10.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.446+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v129'159 uv159 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.446+0000 7fdfb891df40 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5652440d5aa0 0x5652440d7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.446+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d83d0 con 0x5652440d5aa0 2024-09-12T02:06:10.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.446+0000 7fdfb59cf640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5652440d5aa0 0x5652440d7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.447+0000 7fdfb59cf640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5652440d5aa0 0x5652440d7e90 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:10.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.448+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v129'207 uv206 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.448+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440d83d0 con 0x5652440d5aa0 2024-09-12T02:06:10.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.449+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v129'208 uv208 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.449+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8450 con 0x5652440d5aa0 2024-09-12T02:06:10.450 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:06:10.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.450+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v129'209 uv209 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.450+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d9850 con 0x5652440d5aa0 2024-09-12T02:06:10.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.451+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v129'210 uv210 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.451+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d9850 con 0x5652440d5aa0 2024-09-12T02:06:10.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.452+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v129'211 uv211 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.453+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d5aa0 2024-09-12T02:06:10.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.454+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v129'212 uv212 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.454+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d1e00 2024-09-12T02:06:10.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.455+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v129'382 uv376 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.455+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d1e00 2024-09-12T02:06:10.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.456+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v129'383 uv383 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.456+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d1e00 2024-09-12T02:06:10.460 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:06:10.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.458+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v129'384 uv384 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.458+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d9850 con 0x5652440d1e00 2024-09-12T02:06:10.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.459+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v129'385 uv385 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.459+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d9850 con 0x5652440d1e00 2024-09-12T02:06:10.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.460+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v129'386 uv386 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.460+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d1e00 2024-09-12T02:06:10.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.461+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v129'387 uv387 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.461+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d1e00 2024-09-12T02:06:10.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.462+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v129'388 uv381 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.462+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d1e00 2024-09-12T02:06:10.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.463+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v129'389 uv389 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.463+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d1e00 2024-09-12T02:06:10.464 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:06:10.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.464+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v129'390 uv390 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.464+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d1e00 2024-09-12T02:06:10.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.465+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v129'391 uv391 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.465+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d1e00 2024-09-12T02:06:10.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.466+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v129'392 uv392 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.466+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d1e00 2024-09-12T02:06:10.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.467+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v129'173 uv172 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.467+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d1e00 2024-09-12T02:06:10.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.468+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v129'174 uv174 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.468+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d1e00 2024-09-12T02:06:10.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.469+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v129'175 uv175 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.470 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:06:10.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.469+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d1e00 2024-09-12T02:06:10.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.470+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v129'176 uv176 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.470+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d1e00 2024-09-12T02:06:10.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.471+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v129'177 uv177 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fdfb006d040 con 0x5652440d1e00 2024-09-12T02:06:10.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.471+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d5aa0 2024-09-12T02:06:10.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.473+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v129'207 uv206 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.473+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d5aa0 2024-09-12T02:06:10.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.474+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v129'208 uv208 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.474+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d5aa0 2024-09-12T02:06:10.475 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:06:10.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.474+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v129'209 uv209 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.475+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d9850 con 0x5652440d5aa0 2024-09-12T02:06:10.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.475+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v129'210 uv210 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.475+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d9850 con 0x5652440d5aa0 2024-09-12T02:06:10.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.477+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v129'211 uv211 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.477+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d5aa0 2024-09-12T02:06:10.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.478+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v129'212 uv212 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.478+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d5aa0 2024-09-12T02:06:10.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.479+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v129'345 uv339 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.479+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d5aa0 2024-09-12T02:06:10.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.480+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v129'346 uv346 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.480+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d5aa0 2024-09-12T02:06:10.481 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:06:10.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.481+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v129'347 uv347 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.481+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d5aa0 2024-09-12T02:06:10.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.482+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v129'348 uv348 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.482+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d5aa0 2024-09-12T02:06:10.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.483+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v129'349 uv349 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.483+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d5aa0 2024-09-12T02:06:10.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.484+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v129'350 uv344 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.484+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d5aa0 2024-09-12T02:06:10.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.485+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v129'351 uv351 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.485+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d5aa0 2024-09-12T02:06:10.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.486+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v129'352 uv352 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.486 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:06:10.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.486+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440d8840 con 0x5652440d5aa0 2024-09-12T02:06:10.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.487+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v129'353 uv353 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.487+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440db650 con 0x5652440d5aa0 2024-09-12T02:06:10.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.488+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v129'354 uv354 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.488+0000 7fdfb891df40 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5652440d9200 0x5652440db5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.488+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dbc10 con 0x5652440d9200 2024-09-12T02:06:10.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.489+0000 7fdfb51ce640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5652440d9200 0x5652440db5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.489+0000 7fdfb51ce640 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5652440d9200 0x5652440db5f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:10.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.490+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v129'152 uv150 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440d9200 2024-09-12T02:06:10.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.490+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440dbfb0 con 0x5652440d9200 2024-09-12T02:06:10.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.492+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v129'153 uv153 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440d9200 2024-09-12T02:06:10.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.492+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dbfb0 con 0x5652440d9200 2024-09-12T02:06:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.493+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v129'154 uv154 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440d9200 2024-09-12T02:06:10.493 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:06:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.493+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dc030 con 0x5652440d9200 2024-09-12T02:06:10.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.495+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v129'155 uv155 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440d9200 2024-09-12T02:06:10.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.495+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dc030 con 0x5652440d5aa0 2024-09-12T02:06:10.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.497+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v129'207 uv206 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.497+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440dc030 con 0x5652440d5aa0 2024-09-12T02:06:10.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.498+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v129'208 uv208 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.498+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dc030 con 0x5652440d5aa0 2024-09-12T02:06:10.499 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:06:10.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.499+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v129'209 uv209 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.499+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dd040 con 0x5652440d5aa0 2024-09-12T02:06:10.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.500+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v129'210 uv210 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.500+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dd040 con 0x5652440d5aa0 2024-09-12T02:06:10.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.502+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v129'211 uv211 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.502+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dc030 con 0x5652440d5aa0 2024-09-12T02:06:10.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.503+0000 7fdfb59cf640 1 -- 172.21.15.19:0/422360841 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v129'212 uv212 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfa8022040 con 0x5652440d5aa0 2024-09-12T02:06:10.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.503+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dc030 con 0x5652440cd8e0 2024-09-12T02:06:10.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.504+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v129'176 uv175 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.504+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440dc030 con 0x5652440cd8e0 2024-09-12T02:06:10.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.505+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v129'177 uv177 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.505+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dbfb0 con 0x5652440cd8e0 2024-09-12T02:06:10.506 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:06:10.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.506+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v129'178 uv178 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.506+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dbfb0 con 0x5652440cd8e0 2024-09-12T02:06:10.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.507+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v129'179 uv179 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.507+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dbfb0 con 0x5652440cd8e0 2024-09-12T02:06:10.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.508+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v129'180 uv180 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.508+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dbfb0 con 0x5652440cd8e0 2024-09-12T02:06:10.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.510+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v129'429 uv420 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.510+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440dbfb0 con 0x5652440cd8e0 2024-09-12T02:06:10.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.511+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v129'430 uv430 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.511+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dbfb0 con 0x5652440cd8e0 2024-09-12T02:06:10.512 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:06:10.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.512+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v129'431 uv431 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.512+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dbfb0 con 0x5652440cd8e0 2024-09-12T02:06:10.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.513+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v129'432 uv432 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.513+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dc400 con 0x5652440cd8e0 2024-09-12T02:06:10.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.514+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v129'433 uv433 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.514+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dc400 con 0x5652440cd8e0 2024-09-12T02:06:10.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.515+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v129'434 uv427 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.515+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) -- 0x5652440dbfb0 con 0x5652440cd8e0 2024-09-12T02:06:10.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.516+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v129'435 uv435 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.516+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dbfb0 con 0x5652440cd8e0 2024-09-12T02:06:10.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.517+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v129'436 uv436 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.517 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:06:10.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.517+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dbff0 con 0x5652440cd8e0 2024-09-12T02:06:10.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.518+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v129'437 uv437 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.518+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dbfb0 con 0x5652440cd8e0 2024-09-12T02:06:10.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.519+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v129'438 uv438 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.519+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dbfb0 con 0x5652440cd8e0 2024-09-12T02:06:10.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.520+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v129'439 uv439 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.520+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5652440dc3b0 con 0x5652440cd8e0 2024-09-12T02:06:10.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb51ce640 1 -- 172.21.15.19:0/422360841 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v129'440 uv440 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fdfac025070 con 0x5652440cd8e0 2024-09-12T02:06:10.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5652440c88a0 msgr2=0x5652440cac90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x5652440c88a0 0x5652440cac90 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x565243f506e0 msgr2=0x56524401f810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x565243f506e0 0x56524401f810 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5652440d1e00 msgr2=0x5652440d4870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5652440d1e00 0x5652440d4870 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5652440d9200 msgr2=0x5652440db5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x5652440d9200 0x5652440db5f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5652440cd8e0 msgr2=0x5652440cfcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5652440cd8e0 0x5652440cfcd0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5652440d5aa0 msgr2=0x5652440d7e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x5652440d5aa0 0x5652440d7e90 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 reap_dead start 2024-09-12T02:06:10.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb61d0640 1 -- 172.21.15.19:0/422360841 reap_dead start 2024-09-12T02:06:10.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdf9806a840 msgr2=0x7fdf9806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdf9806a840 0x7fdf9806cd00 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8005fd0 tx=0x7fdfa800c040 comp rx=0 tx=0).stop 2024-09-12T02:06:10.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565243f4e460 msgr2=0x5652440160b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565243f4e460 0x5652440160b0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fdfac008710 tx=0x7fdfac008800 comp rx=0 tx=0).stop 2024-09-12T02:06:10.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 shutdown_connections 2024-09-12T02:06:10.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdf9806a840 0x7fdf9806cd00 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 --2- 172.21.15.19:0/422360841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565243f4e460 0x5652440160b0 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 >> 172.21.15.19:0/422360841 conn(0x565243f7a490 msgr2=0x565244019eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:10.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 shutdown_connections 2024-09-12T02:06:10.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.521+0000 7fdfb891df40 1 -- 172.21.15.19:0/422360841 wait complete. 2024-09-12T02:06:10.525 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapheader 600.00000000 deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-09-12T02:06:10.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.609+0000 7fa69f3eef40 1 Processor -- start 2024-09-12T02:06:10.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.610+0000 7fa69f3eef40 1 -- start start 2024-09-12T02:06:10.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.610+0000 7fa69f3eef40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5557b741d180 0x5557b74d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.610+0000 7fa69f3eef40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557b744b050 0x5557b74f1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.610+0000 7fa69f3eef40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5557b74d5080 0x5557b74f4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.610+0000 7fa69f3eef40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5557b741d5c0 con 0x5557b74d5080 2024-09-12T02:06:10.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.610+0000 7fa69f3eef40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5557b736c510 con 0x5557b744b050 2024-09-12T02:06:10.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.610+0000 7fa69f3eef40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5557b7419ae0 con 0x5557b741d180 2024-09-12T02:06:10.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.610+0000 7fa69d6e7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5557b74d5080 0x5557b74f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.610+0000 7fa69d6e7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5557b74d5080 0x5557b74f4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32782/0 (socket says 172.21.15.19:32782) 2024-09-12T02:06:10.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.610+0000 7fa69d6e7640 1 -- 172.21.15.19:0/4136351199 learned_addr learned my addr 172.21.15.19:0/4136351199 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:10.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.610+0000 7fa69cee6640 1 --2- 172.21.15.19:0/4136351199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5557b741d180 0x5557b74d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.610+0000 7fa697fff640 1 --2- 172.21.15.19:0/4136351199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557b744b050 0x5557b74f1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.611+0000 7fa69d6e7640 1 -- 172.21.15.19:0/4136351199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5557b741d180 msgr2=0x5557b74d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:10.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.611+0000 7fa69d6e7640 1 --2- 172.21.15.19:0/4136351199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5557b741d180 0x5557b74d1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.611+0000 7fa69d6e7640 1 -- 172.21.15.19:0/4136351199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557b744b050 msgr2=0x5557b74f1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:10.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.611+0000 7fa69d6e7640 1 --2- 172.21.15.19:0/4136351199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557b744b050 0x5557b74f1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.611+0000 7fa69d6e7640 1 -- 172.21.15.19:0/4136351199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557b74471b0 con 0x5557b74d5080 2024-09-12T02:06:10.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.611+0000 7fa69d6e7640 1 --2- 172.21.15.19:0/4136351199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5557b74d5080 0x5557b74f4370 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7fa698001660 tx=0x7fa698001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34e878f8416f3a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:10.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.611+0000 7fa696ffd640 1 -- 172.21.15.19:0/4136351199 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698003650 con 0x5557b74d5080 2024-09-12T02:06:10.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.611+0000 7fa696ffd640 1 -- 172.21.15.19:0/4136351199 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa698003830 con 0x5557b74d5080 2024-09-12T02:06:10.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.611+0000 7fa696ffd640 1 -- 172.21.15.19:0/4136351199 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698003ca0 con 0x5557b74d5080 2024-09-12T02:06:10.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.611+0000 7fa69f3eef40 1 -- 172.21.15.19:0/4136351199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5557b74d5080 msgr2=0x5557b74f4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.611+0000 7fa69f3eef40 1 --2- 172.21.15.19:0/4136351199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5557b74d5080 0x5557b74f4370 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7fa698001660 tx=0x7fa698001b20 comp rx=0 tx=0).stop 2024-09-12T02:06:10.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.611+0000 7fa69f3eef40 1 -- 172.21.15.19:0/4136351199 shutdown_connections 2024-09-12T02:06:10.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.611+0000 7fa69f3eef40 1 --2- 172.21.15.19:0/4136351199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5557b74d5080 0x5557b74f4370 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.611+0000 7fa69f3eef40 1 --2- 172.21.15.19:0/4136351199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557b744b050 0x5557b74f1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.611+0000 7fa69f3eef40 1 --2- 172.21.15.19:0/4136351199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5557b741d180 0x5557b74d1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.611+0000 7fa69f3eef40 1 -- 172.21.15.19:0/4136351199 >> 172.21.15.19:0/4136351199 conn(0x5557b741a9e0 msgr2=0x5557b74611b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:10.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.611+0000 7fa69f3eef40 1 -- 172.21.15.19:0/4136351199 shutdown_connections 2024-09-12T02:06:10.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.612+0000 7fa69f3eef40 1 -- 172.21.15.19:0/4136351199 wait complete. 2024-09-12T02:06:10.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.612+0000 7fa69f3eef40 1 Processor -- start 2024-09-12T02:06:10.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.612+0000 7fa69f3eef40 1 -- start start 2024-09-12T02:06:10.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.613+0000 7fa69f3eef40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5557b741d180 0x5557b74491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.613+0000 7fa69f3eef40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557b744b050 0x5557b7580a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.613+0000 7fa69f3eef40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5557b74d5080 0x5557b7580f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.613+0000 7fa69f3eef40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5557b74db790 con 0x5557b74d5080 2024-09-12T02:06:10.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.613+0000 7fa69f3eef40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5557b74f48b0 con 0x5557b744b050 2024-09-12T02:06:10.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.613+0000 7fa69f3eef40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5557b7446ed0 con 0x5557b741d180 2024-09-12T02:06:10.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.613+0000 7fa69d6e7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5557b74d5080 0x5557b7580f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.613+0000 7fa69d6e7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5557b74d5080 0x5557b7580f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32796/0 (socket says 172.21.15.19:32796) 2024-09-12T02:06:10.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.613+0000 7fa69d6e7640 1 -- 172.21.15.19:0/355174543 learned_addr learned my addr 172.21.15.19:0/355174543 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:10.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.613+0000 7fa697fff640 1 --2- 172.21.15.19:0/355174543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557b744b050 0x5557b7580a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.613+0000 7fa69cee6640 1 --2- 172.21.15.19:0/355174543 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5557b741d180 0x5557b74491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.613+0000 7fa69d6e7640 1 -- 172.21.15.19:0/355174543 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5557b741d180 msgr2=0x5557b74491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.613+0000 7fa69d6e7640 1 --2- 172.21.15.19:0/355174543 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5557b741d180 0x5557b74491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.613+0000 7fa69d6e7640 1 -- 172.21.15.19:0/355174543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557b744b050 msgr2=0x5557b7580a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.613+0000 7fa69d6e7640 1 --2- 172.21.15.19:0/355174543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557b744b050 0x5557b7580a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.613+0000 7fa69d6e7640 1 -- 172.21.15.19:0/355174543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557b74618f0 con 0x5557b74d5080 2024-09-12T02:06:10.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.613+0000 7fa69d6e7640 1 --2- 172.21.15.19:0/355174543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5557b74d5080 0x5557b7580f80 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7fa698001660 tx=0x7fa698001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:10.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.614+0000 7fa695ffb640 1 -- 172.21.15.19:0/355174543 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698025070 con 0x5557b74d5080 2024-09-12T02:06:10.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.614+0000 7fa695ffb640 1 -- 172.21.15.19:0/355174543 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa698019040 con 0x5557b74d5080 2024-09-12T02:06:10.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.614+0000 7fa69f3eef40 1 -- 172.21.15.19:0/355174543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557b74f0890 con 0x5557b74d5080 2024-09-12T02:06:10.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.614+0000 7fa695ffb640 1 -- 172.21.15.19:0/355174543 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698013a90 con 0x5557b74d5080 2024-09-12T02:06:10.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.614+0000 7fa69f3eef40 1 -- 172.21.15.19:0/355174543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557b74f0d90 con 0x5557b74d5080 2024-09-12T02:06:10.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.615+0000 7fa695ffb640 1 -- 172.21.15.19:0/355174543 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa698010070 con 0x5557b74d5080 2024-09-12T02:06:10.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.615+0000 7fa695ffb640 1 --2- 172.21.15.19:0/355174543 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa68006a810 0x7fa68006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.616+0000 7fa695ffb640 1 -- 172.21.15.19:0/355174543 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 9227+0+0 (secure 0 0 0) 0x7fa69808bb60 con 0x5557b74d5080 2024-09-12T02:06:10.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.616+0000 7fa69cee6640 1 --2- 172.21.15.19:0/355174543 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa68006a810 0x7fa68006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.616+0000 7fa69f3eef40 1 --2- 172.21.15.19:0/355174543 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5557b74496f0 0x5557b7582dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.616+0000 7fa69f3eef40 1 -- 172.21.15.19:0/355174543 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) -- 0x5557b74d3470 con 0x5557b74496f0 2024-09-12T02:06:10.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.616+0000 7fa697fff640 1 --2- 172.21.15.19:0/355174543 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5557b74496f0 0x5557b7582dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.616+0000 7fa69cee6640 1 --2- 172.21.15.19:0/355174543 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa68006a810 0x7fa68006ccd0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fa690057000 tx=0x7fa690052000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:10.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.616+0000 7fa697fff640 1 --2- 172.21.15.19:0/355174543 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5557b74496f0 0x5557b7582dc0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:10.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.618+0000 7fa697fff640 1 -- 172.21.15.19:0/355174543 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 600.00000000 [omap-set-header] v129'1096 uv1096 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa6880098d0 con 0x5557b74496f0 2024-09-12T02:06:10.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.618+0000 7fa69f3eef40 1 -- 172.21.15.19:0/355174543 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5557b74496f0 msgr2=0x5557b7582dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.618+0000 7fa69f3eef40 1 --2- 172.21.15.19:0/355174543 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x5557b74496f0 0x5557b7582dc0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.618+0000 7fa69f3eef40 1 -- 172.21.15.19:0/355174543 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa68006a810 msgr2=0x7fa68006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.618+0000 7fa69f3eef40 1 --2- 172.21.15.19:0/355174543 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa68006a810 0x7fa68006ccd0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fa690057000 tx=0x7fa690052000 comp rx=0 tx=0).stop 2024-09-12T02:06:10.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.618+0000 7fa69f3eef40 1 -- 172.21.15.19:0/355174543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5557b74d5080 msgr2=0x5557b7580f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.618+0000 7fa69f3eef40 1 --2- 172.21.15.19:0/355174543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5557b74d5080 0x5557b7580f80 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7fa698001660 tx=0x7fa698001250 comp rx=0 tx=0).stop 2024-09-12T02:06:10.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.618+0000 7fa69d6e7640 1 -- 172.21.15.19:0/355174543 reap_dead start 2024-09-12T02:06:10.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.618+0000 7fa69f3eef40 1 -- 172.21.15.19:0/355174543 shutdown_connections 2024-09-12T02:06:10.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.618+0000 7fa69f3eef40 1 -- 172.21.15.19:0/355174543 >> 172.21.15.19:0/355174543 conn(0x5557b741a9e0 msgr2=0x5557b7418e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:10.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.618+0000 7fa69f3eef40 1 -- 172.21.15.19:0/355174543 shutdown_connections 2024-09-12T02:06:10.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.618+0000 7fa69f3eef40 1 -- 172.21.15.19:0/355174543 wait complete. 2024-09-12T02:06:10.622 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:06:10.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.727+0000 7f157f731640 1 Processor -- start 2024-09-12T02:06:10.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.727+0000 7f157f731640 1 -- start start 2024-09-12T02:06:10.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.728+0000 7f157f731640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f157806d740 0x7f15780cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.728+0000 7f157f731640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f157815ff70 con 0x7f1578162340 2024-09-12T02:06:10.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.728+0000 7f157f731640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15780d4d10 con 0x7f1578162e30 2024-09-12T02:06:10.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.728+0000 7f157f731640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f157806de90 con 0x7f157806d740 2024-09-12T02:06:10.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.728+0000 7f157d4cd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1578162340 0x7f1578162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54368/0 (socket says 172.21.15.19:54368) 2024-09-12T02:06:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.728+0000 7f157d4cd640 1 -- 172.21.15.19:0/796682509 learned_addr learned my addr 172.21.15.19:0/796682509 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.728+0000 7f157dcce640 1 --2- 172.21.15.19:0/796682509 >> v2:172.21.15.135:3300/0 conn(0x7f157806d740 0x7f15780cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.728+0000 7f156ffff640 1 -- 172.21.15.19:0/796682509 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1797217177 0 0) 0x7f157815ff70 con 0x7f1578162340 2024-09-12T02:06:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.728+0000 7f156ffff640 1 -- 172.21.15.19:0/796682509 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1564003520 con 0x7f1578162340 2024-09-12T02:06:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f156ffff640 1 -- 172.21.15.19:0/796682509 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2164920597 0 0) 0x7f1564003520 con 0x7f1578162340 2024-09-12T02:06:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f156ffff640 1 -- 172.21.15.19:0/796682509 >> v2:172.21.15.135:3300/0 conn(0x7f157806d740 msgr2=0x7f15780cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f156ffff640 1 --2- 172.21.15.19:0/796682509 >> v2:172.21.15.135:3300/0 conn(0x7f157806d740 0x7f15780cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f156ffff640 1 -- 172.21.15.19:0/796682509 >> v1:172.21.15.135:6789/0 conn(0x7f1578162e30 legacy=0x7f15780d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f156ffff640 1 -- 172.21.15.19:0/796682509 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15780d4ff0 con 0x7f1578162340 2024-09-12T02:06:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f156ffff640 1 -- 172.21.15.19:0/796682509 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f15740019f0 con 0x7f1578162340 2024-09-12T02:06:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f157dcce640 1 --2- 172.21.15.19:0/796682509 >> v2:172.21.15.135:3300/0 conn(0x7f157806d740 0x7f15780cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f156ffff640 1 -- 172.21.15.19:0/796682509 >> v1:172.21.15.19:6789/0 conn(0x7f1578162340 legacy=0x7f1578162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f156ffff640 1 --2- 172.21.15.19:0/796682509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15640039b0 0x7f1564003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f156ffff640 1 --2- 172.21.15.19:0/796682509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15640043b0 0x7f1564004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f156ffff640 1 --2- 172.21.15.19:0/796682509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1564005120 0x7f156400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f156ffff640 1 -- 172.21.15.19:0/796682509 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f157806de90 con 0x7f15640039b0 2024-09-12T02:06:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f156ffff640 1 -- 172.21.15.19:0/796682509 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f156400c060 con 0x7f15640043b0 2024-09-12T02:06:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f156ffff640 1 -- 172.21.15.19:0/796682509 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f156400c260 con 0x7f1564005120 2024-09-12T02:06:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f157d4cd640 1 --2- 172.21.15.19:0/796682509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15640039b0 0x7f1564003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f157dcce640 1 --2- 172.21.15.19:0/796682509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1564005120 0x7f156400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f157cccc640 1 --2- 172.21.15.19:0/796682509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15640043b0 0x7f1564004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f157d4cd640 1 -- 172.21.15.19:0/796682509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1564005120 msgr2=0x7f156400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f157d4cd640 1 --2- 172.21.15.19:0/796682509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1564005120 0x7f156400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f157d4cd640 1 -- 172.21.15.19:0/796682509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15640043b0 msgr2=0x7f1564004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:10.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f157d4cd640 1 --2- 172.21.15.19:0/796682509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15640043b0 0x7f1564004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f157d4cd640 1 -- 172.21.15.19:0/796682509 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1564003520 con 0x7f15640039b0 2024-09-12T02:06:10.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f157cccc640 1 --2- 172.21.15.19:0/796682509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15640043b0 0x7f1564004880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:10.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f157dcce640 1 --2- 172.21.15.19:0/796682509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1564005120 0x7f156400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:10.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.729+0000 7f157dcce640 1 -- 172.21.15.19:0/796682509 reap_dead start 2024-09-12T02:06:10.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.730+0000 7f157d4cd640 1 --2- 172.21.15.19:0/796682509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15640039b0 0x7f1564003d90 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f157400a920 tx=0x7f1564005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dee891a371d981c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:10.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.730+0000 7f156ffff640 1 -- 172.21.15.19:0/796682509 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157400a4c0 con 0x7f15640039b0 2024-09-12T02:06:10.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.730+0000 7f156ffff640 1 -- 172.21.15.19:0/796682509 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157402f070 con 0x7f15640039b0 2024-09-12T02:06:10.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.730+0000 7f156ffff640 1 -- 172.21.15.19:0/796682509 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157402bcd0 con 0x7f15640039b0 2024-09-12T02:06:10.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.731+0000 7f157f731640 1 -- 172.21.15.19:0/796682509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15640039b0 msgr2=0x7f1564003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.731+0000 7f157f731640 1 --2- 172.21.15.19:0/796682509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15640039b0 0x7f1564003d90 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f157400a920 tx=0x7f1564005830 comp rx=0 tx=0).stop 2024-09-12T02:06:10.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.731+0000 7f157f731640 1 -- 172.21.15.19:0/796682509 shutdown_connections 2024-09-12T02:06:10.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.731+0000 7f157f731640 1 --2- 172.21.15.19:0/796682509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15640039b0 0x7f1564003d90 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.731+0000 7f157f731640 1 -- 172.21.15.19:0/796682509 >> 172.21.15.19:0/796682509 conn(0x7f157808bfc0 msgr2=0x7f15780d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:10.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.731+0000 7f157f731640 1 -- 172.21.15.19:0/796682509 shutdown_connections 2024-09-12T02:06:10.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.731+0000 7f157f731640 1 -- 172.21.15.19:0/796682509 wait complete. 2024-09-12T02:06:10.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.732+0000 7f157f731640 1 Processor -- start 2024-09-12T02:06:10.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.732+0000 7f157f731640 1 -- start start 2024-09-12T02:06:10.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.733+0000 7f157f731640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15640039b0 0x7f15781f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.733+0000 7f157f731640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15780b7ea0 0x7f15780ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.733+0000 7f157f731640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f157815b2b0 0x7f15780b98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.733+0000 7f157f731640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f157806dbb0 con 0x7f157815b2b0 2024-09-12T02:06:10.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.733+0000 7f157f731640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1578163270 con 0x7f15640039b0 2024-09-12T02:06:10.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.733+0000 7f157f731640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f15780d52d0 con 0x7f15780b7ea0 2024-09-12T02:06:10.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.733+0000 7f157dcce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f157815b2b0 0x7f15780b98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.733+0000 7f157dcce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f157815b2b0 0x7f15780b98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32814/0 (socket says 172.21.15.19:32814) 2024-09-12T02:06:10.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.733+0000 7f157dcce640 1 -- 172.21.15.19:0/262134427 learned_addr learned my addr 172.21.15.19:0/262134427 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:10.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.733+0000 7f157cccc640 1 --2- 172.21.15.19:0/262134427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15780b7ea0 0x7f15780ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.733+0000 7f157d4cd640 1 --2- 172.21.15.19:0/262134427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15640039b0 0x7f15781f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.733+0000 7f157dcce640 1 -- 172.21.15.19:0/262134427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15780b7ea0 msgr2=0x7f15780ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.733+0000 7f157dcce640 1 --2- 172.21.15.19:0/262134427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15780b7ea0 0x7f15780ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.733+0000 7f157dcce640 1 -- 172.21.15.19:0/262134427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15640039b0 msgr2=0x7f15781f4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.733+0000 7f157dcce640 1 --2- 172.21.15.19:0/262134427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15640039b0 0x7f15781f4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.733+0000 7f157dcce640 1 -- 172.21.15.19:0/262134427 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15780ca750 con 0x7f157815b2b0 2024-09-12T02:06:10.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.733+0000 7f157dcce640 1 --2- 172.21.15.19:0/262134427 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f157815b2b0 0x7f15780b98a0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f157806e060 tx=0x7f1570011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:10.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.734+0000 7f156dffb640 1 -- 172.21.15.19:0/262134427 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570019070 con 0x7f157815b2b0 2024-09-12T02:06:10.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.734+0000 7f156dffb640 1 -- 172.21.15.19:0/262134427 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1570004460 con 0x7f157815b2b0 2024-09-12T02:06:10.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.734+0000 7f157f731640 1 -- 172.21.15.19:0/262134427 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15781f4a80 con 0x7f157815b2b0 2024-09-12T02:06:10.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.734+0000 7f156dffb640 1 -- 172.21.15.19:0/262134427 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570003850 con 0x7f157815b2b0 2024-09-12T02:06:10.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.734+0000 7f157f731640 1 -- 172.21.15.19:0/262134427 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15781f5040 con 0x7f157815b2b0 2024-09-12T02:06:10.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.735+0000 7f157f731640 1 -- 172.21.15.19:0/262134427 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15780cf280 con 0x7f157815b2b0 2024-09-12T02:06:10.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.735+0000 7f156dffb640 1 -- 172.21.15.19:0/262134427 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f157001c070 con 0x7f157815b2b0 2024-09-12T02:06:10.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.736+0000 7f156dffb640 1 --2- 172.21.15.19:0/262134427 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f155c06be60 0x7f155c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:10.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.736+0000 7f156dffb640 1 -- 172.21.15.19:0/262134427 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 9227+0+0 (secure 0 0 0) 0x7f157008b940 con 0x7f157815b2b0 2024-09-12T02:06:10.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.736+0000 7f157d4cd640 1 --2- 172.21.15.19:0/262134427 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f155c06be60 0x7f155c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:10.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.737+0000 7f157d4cd640 1 --2- 172.21.15.19:0/262134427 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f155c06be60 0x7f155c06e320 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1574033000 tx=0x7f1574009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:10.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.740+0000 7f156dffb640 1 -- 172.21.15.19:0/262134427 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1570058f20 con 0x7f157815b2b0 2024-09-12T02:06:10.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:10.954+0000 7f157f731640 1 -- 172.21.15.19:0/262134427 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f157808e640 con 0x7f157815b2b0 2024-09-12T02:06:11.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.560+0000 7f156dffb640 1 -- 172.21.15.19:0/262134427 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v290) ==== 162+0+0 (secure 0 0 0) 0x7f157005d220 con 0x7f157815b2b0 2024-09-12T02:06:11.561 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:06:11.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.563+0000 7f157f731640 1 -- 172.21.15.19:0/262134427 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f155c06be60 msgr2=0x7f155c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:11.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.563+0000 7f157f731640 1 --2- 172.21.15.19:0/262134427 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f155c06be60 0x7f155c06e320 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1574033000 tx=0x7f1574009030 comp rx=0 tx=0).stop 2024-09-12T02:06:11.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.563+0000 7f157f731640 1 -- 172.21.15.19:0/262134427 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f157815b2b0 msgr2=0x7f15780b98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:11.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.563+0000 7f157f731640 1 --2- 172.21.15.19:0/262134427 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f157815b2b0 0x7f15780b98a0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f157806e060 tx=0x7f1570011a80 comp rx=0 tx=0).stop 2024-09-12T02:06:11.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.563+0000 7f157f731640 1 -- 172.21.15.19:0/262134427 shutdown_connections 2024-09-12T02:06:11.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.563+0000 7f157f731640 1 --2- 172.21.15.19:0/262134427 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f155c06be60 0x7f155c06e320 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.563+0000 7f157f731640 1 --2- 172.21.15.19:0/262134427 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f157815b2b0 0x7f15780b98a0 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.563+0000 7f157f731640 1 --2- 172.21.15.19:0/262134427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15780b7ea0 0x7f15780ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.563+0000 7f157f731640 1 --2- 172.21.15.19:0/262134427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15640039b0 0x7f15781f4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.563+0000 7f157f731640 1 -- 172.21.15.19:0/262134427 >> 172.21.15.19:0/262134427 conn(0x7f157808bfc0 msgr2=0x7f1578160f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:11.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.563+0000 7f157f731640 1 -- 172.21.15.19:0/262134427 shutdown_connections 2024-09-12T02:06:11.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.563+0000 7f157f731640 1 -- 172.21.15.19:0/262134427 wait complete. 2024-09-12T02:06:11.579 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:11.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.686+0000 7f8d4a28c640 1 Processor -- start 2024-09-12T02:06:11.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.686+0000 7f8d4a28c640 1 -- start start 2024-09-12T02:06:11.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.687+0000 7f8d4a28c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d4415e760 0x7f8d4406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:11.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.687+0000 7f8d4a28c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8d440d4fd0 0x7f8d440cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:11.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.687+0000 7f8d4a28c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d440b3650 0x7f8d440cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:11.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.687+0000 7f8d4a28c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8d440d2700 con 0x7f8d4415e760 2024-09-12T02:06:11.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.687+0000 7f8d4a28c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f8d440cedb0 con 0x7f8d440d4fd0 2024-09-12T02:06:11.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.687+0000 7f8d4a28c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8d440cf090 con 0x7f8d440b3650 2024-09-12T02:06:11.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.687+0000 7f8d43fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d4415e760 0x7f8d4406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:11.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.687+0000 7f8d43fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d4415e760 0x7f8d4406cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37210/0 (socket says 172.21.15.19:37210) 2024-09-12T02:06:11.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.687+0000 7f8d43fff640 1 -- 172.21.15.19:0/2322554686 learned_addr learned my addr 172.21.15.19:0/2322554686 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:11.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.687+0000 7f8d437fe640 1 --2- 172.21.15.19:0/2322554686 >> v2:172.21.15.135:3300/0 conn(0x7f8d440d4fd0 0x7f8d440cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:11.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.687+0000 7f8d48829640 1 --2- 172.21.15.19:0/2322554686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d440b3650 0x7f8d440cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:11.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.688+0000 7f8d43fff640 1 -- 172.21.15.19:0/2322554686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d440b3650 msgr2=0x7f8d440cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:11.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.688+0000 7f8d43fff640 1 --2- 172.21.15.19:0/2322554686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d440b3650 0x7f8d440cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.688+0000 7f8d43fff640 1 -- 172.21.15.19:0/2322554686 >> v2:172.21.15.135:3300/0 conn(0x7f8d440d4fd0 msgr2=0x7f8d440cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:11.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.688+0000 7f8d43fff640 1 --2- 172.21.15.19:0/2322554686 >> v2:172.21.15.135:3300/0 conn(0x7f8d440d4fd0 0x7f8d440cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.688+0000 7f8d43fff640 1 -- 172.21.15.19:0/2322554686 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d440b3c80 con 0x7f8d4415e760 2024-09-12T02:06:11.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.688+0000 7f8d437fe640 1 --2- 172.21.15.19:0/2322554686 >> v2:172.21.15.135:3300/0 conn(0x7f8d440d4fd0 0x7f8d440cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:11.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.688+0000 7f8d48829640 1 --2- 172.21.15.19:0/2322554686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d440b3650 0x7f8d440cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:11.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.688+0000 7f8d43fff640 1 --2- 172.21.15.19:0/2322554686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d4415e760 0x7f8d4406cdd0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f8d4408ca80 tx=0x7f8d3402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6d2bbf6af460e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:11.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.688+0000 7f8d42ffd640 1 -- 172.21.15.19:0/2322554686 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34037070 con 0x7f8d4415e760 2024-09-12T02:06:11.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.688+0000 7f8d42ffd640 1 -- 172.21.15.19:0/2322554686 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d34032440 con 0x7f8d4415e760 2024-09-12T02:06:11.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.688+0000 7f8d42ffd640 1 -- 172.21.15.19:0/2322554686 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34032810 con 0x7f8d4415e760 2024-09-12T02:06:11.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.689+0000 7f8d4a28c640 1 -- 172.21.15.19:0/2322554686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d4415e760 msgr2=0x7f8d4406cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:11.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.689+0000 7f8d4a28c640 1 --2- 172.21.15.19:0/2322554686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d4415e760 0x7f8d4406cdd0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f8d4408ca80 tx=0x7f8d3402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.689+0000 7f8d4a28c640 1 -- 172.21.15.19:0/2322554686 shutdown_connections 2024-09-12T02:06:11.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.689+0000 7f8d4a28c640 1 --2- 172.21.15.19:0/2322554686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d440b3650 0x7f8d440cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.689+0000 7f8d4a28c640 1 --2- 172.21.15.19:0/2322554686 >> v2:172.21.15.135:3300/0 conn(0x7f8d440d4fd0 0x7f8d440cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.689+0000 7f8d4a28c640 1 --2- 172.21.15.19:0/2322554686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d4415e760 0x7f8d4406cdd0 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.689+0000 7f8d4a28c640 1 -- 172.21.15.19:0/2322554686 >> 172.21.15.19:0/2322554686 conn(0x7f8d4408bfc0 msgr2=0x7f8d440d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:11.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.689+0000 7f8d4a28c640 1 -- 172.21.15.19:0/2322554686 shutdown_connections 2024-09-12T02:06:11.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.689+0000 7f8d4a28c640 1 -- 172.21.15.19:0/2322554686 wait complete. 2024-09-12T02:06:11.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.690+0000 7f8d4a28c640 1 Processor -- start 2024-09-12T02:06:11.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.690+0000 7f8d4a28c640 1 -- start start 2024-09-12T02:06:11.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.691+0000 7f8d4a28c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d440b3650 0x7f8d440c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:11.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.691+0000 7f8d4a28c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d440d4fd0 0x7f8d440cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:11.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.691+0000 7f8d4a28c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d4415e760 0x7f8d4414bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:11.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.691+0000 7f8d4a28c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8d440d3270 con 0x7f8d4415e760 2024-09-12T02:06:11.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.691+0000 7f8d4a28c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8d440d30f0 con 0x7f8d440d4fd0 2024-09-12T02:06:11.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.691+0000 7f8d4a28c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8d440d33f0 con 0x7f8d440b3650 2024-09-12T02:06:11.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.691+0000 7f8d48829640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d4415e760 0x7f8d4414bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:11.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.691+0000 7f8d48829640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d4415e760 0x7f8d4414bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37220/0 (socket says 172.21.15.19:37220) 2024-09-12T02:06:11.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.691+0000 7f8d48829640 1 -- 172.21.15.19:0/541465924 learned_addr learned my addr 172.21.15.19:0/541465924 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:11.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.691+0000 7f8d43fff640 1 --2- 172.21.15.19:0/541465924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d440b3650 0x7f8d440c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:11.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.691+0000 7f8d437fe640 1 --2- 172.21.15.19:0/541465924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d440d4fd0 0x7f8d440cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:11.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.692+0000 7f8d48829640 1 -- 172.21.15.19:0/541465924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d440b3650 msgr2=0x7f8d440c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:11.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.692+0000 7f8d48829640 1 --2- 172.21.15.19:0/541465924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d440b3650 0x7f8d440c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.692+0000 7f8d48829640 1 -- 172.21.15.19:0/541465924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d440d4fd0 msgr2=0x7f8d440cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:11.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.692+0000 7f8d48829640 1 --2- 172.21.15.19:0/541465924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d440d4fd0 0x7f8d440cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.692+0000 7f8d48829640 1 -- 172.21.15.19:0/541465924 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4414b880 con 0x7f8d4415e760 2024-09-12T02:06:11.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.692+0000 7f8d437fe640 1 --2- 172.21.15.19:0/541465924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d440d4fd0 0x7f8d440cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:11.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.692+0000 7f8d48829640 1 --2- 172.21.15.19:0/541465924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d4415e760 0x7f8d4414bb50 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c007d60 tx=0x7f8d3c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:11.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.692+0000 7f8d40ff9640 1 -- 172.21.15.19:0/541465924 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c01a070 con 0x7f8d4415e760 2024-09-12T02:06:11.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.692+0000 7f8d40ff9640 1 -- 172.21.15.19:0/541465924 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d3c003990 con 0x7f8d4415e760 2024-09-12T02:06:11.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.692+0000 7f8d4a28c640 1 -- 172.21.15.19:0/541465924 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d440c95d0 con 0x7f8d4415e760 2024-09-12T02:06:11.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.692+0000 7f8d40ff9640 1 -- 172.21.15.19:0/541465924 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c003d80 con 0x7f8d4415e760 2024-09-12T02:06:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.692+0000 7f8d4a28c640 1 -- 172.21.15.19:0/541465924 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d440c9b90 con 0x7f8d4415e760 2024-09-12T02:06:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.693+0000 7f8d4a28c640 1 -- 172.21.15.19:0/541465924 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d440ca360 con 0x7f8d4415e760 2024-09-12T02:06:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.694+0000 7f8d40ff9640 1 -- 172.21.15.19:0/541465924 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d3c01d070 con 0x7f8d4415e760 2024-09-12T02:06:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.694+0000 7f8d40ff9640 1 --2- 172.21.15.19:0/541465924 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d3006be30 0x7f8d3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.694+0000 7f8d40ff9640 1 -- 172.21.15.19:0/541465924 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 9227+0+0 (secure 0 0 0) 0x7f8d3c08bdc0 con 0x7f8d4415e760 2024-09-12T02:06:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.694+0000 7f8d43fff640 1 --2- 172.21.15.19:0/541465924 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d3006be30 0x7f8d3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.695+0000 7f8d43fff640 1 --2- 172.21.15.19:0/541465924 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d3006be30 0x7f8d3006e2f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8d34034000 tx=0x7f8d3402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:11.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.698+0000 7f8d40ff9640 1 -- 172.21.15.19:0/541465924 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d3c010070 con 0x7f8d4415e760 2024-09-12T02:06:11.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.912+0000 7f8d4a28c640 1 -- 172.21.15.19:0/541465924 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d440b6d20 con 0x7f8d4415e760 2024-09-12T02:06:11.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.913+0000 7f8d40ff9640 1 -- 172.21.15.19:0/541465924 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 291 v291) ==== 95+0+5230 (secure 0 0 0) 0x7f8d3c059310 con 0x7f8d4415e760 2024-09-12T02:06:11.913 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:11.913 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":291,"btime":"2024-09-12T02:06:11:564331+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":291,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:11.564312+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":129,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10137":{"gid":10137,"name":"c","rank":0,"incarnation":291,"state":"up:replay","state_seq":1,"addr":"172.21.15.19:6834/3550997018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3550997018},{"type":"v1","addr":"172.21.15.19:6834","nonce":3550997018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:11.913 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 291 2024-09-12T02:06:11.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.914+0000 7f8d4a28c640 1 -- 172.21.15.19:0/541465924 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d3006be30 msgr2=0x7f8d3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:11.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.914+0000 7f8d4a28c640 1 --2- 172.21.15.19:0/541465924 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d3006be30 0x7f8d3006e2f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8d34034000 tx=0x7f8d3402e000 comp rx=0 tx=0).stop 2024-09-12T02:06:11.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.914+0000 7f8d4a28c640 1 -- 172.21.15.19:0/541465924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d4415e760 msgr2=0x7f8d4414bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:11.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.914+0000 7f8d4a28c640 1 --2- 172.21.15.19:0/541465924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d4415e760 0x7f8d4414bb50 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c007d60 tx=0x7f8d3c00d4a0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.914+0000 7f8d4a28c640 1 -- 172.21.15.19:0/541465924 shutdown_connections 2024-09-12T02:06:11.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.914+0000 7f8d4a28c640 1 --2- 172.21.15.19:0/541465924 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8d3006be30 0x7f8d3006e2f0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.914+0000 7f8d4a28c640 1 --2- 172.21.15.19:0/541465924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d4415e760 0x7f8d4414bb50 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.914+0000 7f8d4a28c640 1 --2- 172.21.15.19:0/541465924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d440d4fd0 0x7f8d440cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.914+0000 7f8d4a28c640 1 --2- 172.21.15.19:0/541465924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d440b3650 0x7f8d440c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.915+0000 7f8d4a28c640 1 -- 172.21.15.19:0/541465924 >> 172.21.15.19:0/541465924 conn(0x7f8d4408bfc0 msgr2=0x7f8d440b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:11.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.915+0000 7f8d4a28c640 1 -- 172.21.15.19:0/541465924 shutdown_connections 2024-09-12T02:06:11.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:11.915+0000 7f8d4a28c640 1 -- 172.21.15.19:0/541465924 wait complete. 2024-09-12T02:06:11.925 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-12T02:06:14.592 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:06:14.591+0000 7f1c7bf2d640 -1 mds.0.cache.dir(0x600) Corrupt fnode in dirfrag 0x600: Decoder at 'void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)' v=3 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-09-12T02:06:14.592 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:06:14.592+0000 7f1c7bf2d640 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x600 is fatal because it is a system directory for this rank 2024-09-12T02:06:14.592 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:06:14.592+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:06:14.593 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:06:14.592+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:06:15.260 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:06:15.261+0000 7f1c7ff35640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:06:16.927 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:17.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.042+0000 7fdd7465e640 1 Processor -- start 2024-09-12T02:06:17.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.042+0000 7fdd7465e640 1 -- start start 2024-09-12T02:06:17.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.043+0000 7fdd7465e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd6c15ba30 0x7fdd6c06f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.043+0000 7fdd7465e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdd6c06fd50 0x7fdd6c072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.043+0000 7fdd7465e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd6c0b3570 con 0x7fdd6c072e80 2024-09-12T02:06:17.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.043+0000 7fdd7465e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fdd6c0b4180 con 0x7fdd6c06fd50 2024-09-12T02:06:17.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.043+0000 7fdd7465e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdd6c0b3850 con 0x7fdd6c15ba30 2024-09-12T02:06:17.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.043+0000 7fdd71bf9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdd6c06fd50 0x7fdd6c072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.043+0000 7fdd71bf9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdd6c06fd50 0x7fdd6c072940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37230/0 (socket says 172.21.15.19:37230) 2024-09-12T02:06:17.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.043+0000 7fdd71bf9640 1 -- 172.21.15.19:0/1449870252 learned_addr learned my addr 172.21.15.19:0/1449870252 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:17.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.044+0000 7fdd723fa640 1 --2- 172.21.15.19:0/1449870252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd6c15ba30 0x7fdd6c06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.044+0000 7fdd71bf9640 1 -- 172.21.15.19:0/1449870252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd6c15ba30 msgr2=0x7fdd6c06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:17.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.044+0000 7fdd71bf9640 1 --2- 172.21.15.19:0/1449870252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd6c15ba30 0x7fdd6c06f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.044+0000 7fdd71bf9640 1 -- 172.21.15.19:0/1449870252 >> v1:172.21.15.135:6789/0 conn(0x7fdd6c072e80 legacy=0x7fdd6c06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:17.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.044+0000 7fdd71bf9640 1 -- 172.21.15.19:0/1449870252 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6c0b3b30 con 0x7fdd6c06fd50 2024-09-12T02:06:17.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.044+0000 7fdd71bf9640 1 --2- 172.21.15.19:0/1449870252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd6c06fd50 0x7fdd6c072940 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009870 tx=0x7fdd5c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c3a0df85df8924 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:17.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.045+0000 7fdd713f8640 1 -- 172.21.15.19:0/1449870252 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c037070 con 0x7fdd6c06fd50 2024-09-12T02:06:17.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.045+0000 7fdd713f8640 1 -- 172.21.15.19:0/1449870252 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd5c032440 con 0x7fdd6c06fd50 2024-09-12T02:06:17.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.045+0000 7fdd713f8640 1 -- 172.21.15.19:0/1449870252 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c032810 con 0x7fdd6c06fd50 2024-09-12T02:06:17.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.045+0000 7fdd7465e640 1 -- 172.21.15.19:0/1449870252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd6c06fd50 msgr2=0x7fdd6c072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.045+0000 7fdd7465e640 1 --2- 172.21.15.19:0/1449870252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd6c06fd50 0x7fdd6c072940 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009870 tx=0x7fdd5c02a210 comp rx=0 tx=0).stop 2024-09-12T02:06:17.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.045+0000 7fdd7465e640 1 -- 172.21.15.19:0/1449870252 shutdown_connections 2024-09-12T02:06:17.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.045+0000 7fdd7465e640 1 --2- 172.21.15.19:0/1449870252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd6c06fd50 0x7fdd6c072940 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.045+0000 7fdd7465e640 1 --2- 172.21.15.19:0/1449870252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd6c15ba30 0x7fdd6c06f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.045+0000 7fdd7465e640 1 -- 172.21.15.19:0/1449870252 >> 172.21.15.19:0/1449870252 conn(0x7fdd6c067d70 msgr2=0x7fdd6c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:17.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.045+0000 7fdd7465e640 1 -- 172.21.15.19:0/1449870252 shutdown_connections 2024-09-12T02:06:17.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.045+0000 7fdd7465e640 1 -- 172.21.15.19:0/1449870252 wait complete. 2024-09-12T02:06:17.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.047+0000 7fdd7465e640 1 Processor -- start 2024-09-12T02:06:17.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.047+0000 7fdd7465e640 1 -- start start 2024-09-12T02:06:17.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.047+0000 7fdd7465e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd6c06fd50 0x7fdd6c14e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.047+0000 7fdd7465e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd6c072e80 0x7fdd6c15f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.047+0000 7fdd7465e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd6c15ba30 0x7fdd6c15fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.048+0000 7fdd7465e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c0b5890 con 0x7fdd6c06fd50 2024-09-12T02:06:17.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.048+0000 7fdd7465e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c0ce810 con 0x7fdd6c15ba30 2024-09-12T02:06:17.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.048+0000 7fdd7465e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdd6c0b5a10 con 0x7fdd6c072e80 2024-09-12T02:06:17.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.048+0000 7fdd723fa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd6c06fd50 0x7fdd6c14e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.048+0000 7fdd723fa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd6c06fd50 0x7fdd6c14e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37246/0 (socket says 172.21.15.19:37246) 2024-09-12T02:06:17.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.048+0000 7fdd723fa640 1 -- 172.21.15.19:0/3370205402 learned_addr learned my addr 172.21.15.19:0/3370205402 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:17.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.048+0000 7fdd71bf9640 1 --2- 172.21.15.19:0/3370205402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd6c072e80 0x7fdd6c15f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.048+0000 7fdd72bfb640 1 --2- 172.21.15.19:0/3370205402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd6c15ba30 0x7fdd6c15fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.048+0000 7fdd723fa640 1 -- 172.21.15.19:0/3370205402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd6c072e80 msgr2=0x7fdd6c15f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.048+0000 7fdd723fa640 1 --2- 172.21.15.19:0/3370205402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd6c072e80 0x7fdd6c15f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.048+0000 7fdd723fa640 1 -- 172.21.15.19:0/3370205402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd6c15ba30 msgr2=0x7fdd6c15fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.048+0000 7fdd723fa640 1 --2- 172.21.15.19:0/3370205402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd6c15ba30 0x7fdd6c15fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.048+0000 7fdd723fa640 1 -- 172.21.15.19:0/3370205402 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6c150140 con 0x7fdd6c06fd50 2024-09-12T02:06:17.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.048+0000 7fdd723fa640 1 --2- 172.21.15.19:0/3370205402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd6c06fd50 0x7fdd6c14e170 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fdd6800d5f0 tx=0x7fdd6800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:17.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.048+0000 7fdd62ffd640 1 -- 172.21.15.19:0/3370205402 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd680125f0 con 0x7fdd6c06fd50 2024-09-12T02:06:17.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.048+0000 7fdd62ffd640 1 -- 172.21.15.19:0/3370205402 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd68019070 con 0x7fdd6c06fd50 2024-09-12T02:06:17.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.048+0000 7fdd62ffd640 1 -- 172.21.15.19:0/3370205402 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd680129d0 con 0x7fdd6c06fd50 2024-09-12T02:06:17.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.048+0000 7fdd7465e640 1 -- 172.21.15.19:0/3370205402 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6c150420 con 0x7fdd6c06fd50 2024-09-12T02:06:17.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.049+0000 7fdd7465e640 1 -- 172.21.15.19:0/3370205402 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd6c1509e0 con 0x7fdd6c06fd50 2024-09-12T02:06:17.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.049+0000 7fdd7465e640 1 -- 172.21.15.19:0/3370205402 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd6c0ccfe0 con 0x7fdd6c06fd50 2024-09-12T02:06:17.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.050+0000 7fdd62ffd640 1 -- 172.21.15.19:0/3370205402 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd68012b70 con 0x7fdd6c06fd50 2024-09-12T02:06:17.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.050+0000 7fdd62ffd640 1 --2- 172.21.15.19:0/3370205402 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdd5006be60 0x7fdd5006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.051+0000 7fdd62ffd640 1 -- 172.21.15.19:0/3370205402 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 9313+0+0 (secure 0 0 0) 0x7fdd6808bfd0 con 0x7fdd6c06fd50 2024-09-12T02:06:17.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.051+0000 7fdd71bf9640 1 --2- 172.21.15.19:0/3370205402 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdd5006be60 0x7fdd5006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.051+0000 7fdd71bf9640 1 --2- 172.21.15.19:0/3370205402 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdd5006be60 0x7fdd5006e320 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c034000 tx=0x7fdd5c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:17.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.055+0000 7fdd62ffd640 1 -- 172.21.15.19:0/3370205402 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd680594c0 con 0x7fdd6c06fd50 2024-09-12T02:06:17.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.266+0000 7fdd7465e640 1 -- 172.21.15.19:0/3370205402 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd6c06d090 con 0x7fdd6c06fd50 2024-09-12T02:06:17.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.267+0000 7fdd62ffd640 1 -- 172.21.15.19:0/3370205402 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 295 v295) ==== 95+0+4392 (secure 0 0 0) 0x7fdd6805d7c0 con 0x7fdd6c06fd50 2024-09-12T02:06:17.267 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:17.267 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":295,"btime":"2024-09-12T02:06:14:593730+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":295,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:14.593726+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":130,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:17.268 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 295 2024-09-12T02:06:17.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.268+0000 7fdd7465e640 1 -- 172.21.15.19:0/3370205402 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdd5006be60 msgr2=0x7fdd5006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.268+0000 7fdd7465e640 1 --2- 172.21.15.19:0/3370205402 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdd5006be60 0x7fdd5006e320 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c034000 tx=0x7fdd5c02e000 comp rx=0 tx=0).stop 2024-09-12T02:06:17.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.268+0000 7fdd7465e640 1 -- 172.21.15.19:0/3370205402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd6c06fd50 msgr2=0x7fdd6c14e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.268+0000 7fdd7465e640 1 --2- 172.21.15.19:0/3370205402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd6c06fd50 0x7fdd6c14e170 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fdd6800d5f0 tx=0x7fdd6800dab0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.269+0000 7fdd7465e640 1 -- 172.21.15.19:0/3370205402 shutdown_connections 2024-09-12T02:06:17.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.269+0000 7fdd7465e640 1 --2- 172.21.15.19:0/3370205402 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdd5006be60 0x7fdd5006e320 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.269+0000 7fdd7465e640 1 --2- 172.21.15.19:0/3370205402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd6c15ba30 0x7fdd6c15fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.269+0000 7fdd7465e640 1 --2- 172.21.15.19:0/3370205402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd6c072e80 0x7fdd6c15f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.269+0000 7fdd7465e640 1 --2- 172.21.15.19:0/3370205402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd6c06fd50 0x7fdd6c14e170 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.269+0000 7fdd7465e640 1 -- 172.21.15.19:0/3370205402 >> 172.21.15.19:0/3370205402 conn(0x7fdd6c067d70 msgr2=0x7fdd6c0b4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:17.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.269+0000 7fdd7465e640 1 -- 172.21.15.19:0/3370205402 shutdown_connections 2024-09-12T02:06:17.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.269+0000 7fdd7465e640 1 -- 172.21.15.19:0/3370205402 wait complete. 2024-09-12T02:06:17.280 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:06:17.280 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.382+0000 7f6d00df6640 1 Processor -- start 2024-09-12T02:06:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.382+0000 7f6d00df6640 1 -- start start 2024-09-12T02:06:17.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.383+0000 7f6d00df6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6cfc0d04a0 0x7f6cfc0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.383+0000 7f6d00df6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cfc06cb30 con 0x7f6cfc147360 2024-09-12T02:06:17.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.383+0000 7f6d00df6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cfc0d0e50 con 0x7f6cfc0ae550 2024-09-12T02:06:17.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.383+0000 7f6d00df6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6cfc06bfb0 con 0x7f6cfc0d04a0 2024-09-12T02:06:17.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.383+0000 7f6cfa59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6cfc147360 0x7f6cfc070890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56590/0 (socket says 172.21.15.19:56590) 2024-09-12T02:06:17.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.383+0000 7f6cfa59c640 1 -- 172.21.15.19:0/3828494456 learned_addr learned my addr 172.21.15.19:0/3828494456 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:17.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.383+0000 7f6cf1d9b640 1 --2- 172.21.15.19:0/3828494456 >> v2:172.21.15.135:3300/0 conn(0x7f6cfc0d04a0 0x7f6cfc0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.383+0000 7f6cf9d9b640 1 -- 172.21.15.19:0/3828494456 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 662425698 0 0) 0x7f6cfc06cb30 con 0x7f6cfc147360 2024-09-12T02:06:17.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.383+0000 7f6cf9d9b640 1 -- 172.21.15.19:0/3828494456 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ce8003520 con 0x7f6cfc147360 2024-09-12T02:06:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.383+0000 7f6cf9d9b640 1 -- 172.21.15.19:0/3828494456 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2273871372 0 0) 0x7f6cfc0d0e50 con 0x7f6cfc0ae550 2024-09-12T02:06:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.383+0000 7f6cf9d9b640 1 -- 172.21.15.19:0/3828494456 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cfc06cb30 con 0x7f6cfc0ae550 2024-09-12T02:06:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.383+0000 7f6cf9d9b640 1 -- 172.21.15.19:0/3828494456 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2093648890 0 0) 0x7f6ce8003520 con 0x7f6cfc147360 2024-09-12T02:06:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.383+0000 7f6cf1d9b640 1 -- 172.21.15.19:0/3828494456 >> v1:172.21.15.135:6789/0 conn(0x7f6cfc0ae550 legacy=0x7f6cfc0ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.383+0000 7f6cf1d9b640 1 -- 172.21.15.19:0/3828494456 >> v1:172.21.15.19:6789/0 conn(0x7f6cfc147360 legacy=0x7f6cfc070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.383+0000 7f6cf1d9b640 1 -- 172.21.15.19:0/3828494456 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc06c290 con 0x7f6cfc0d04a0 2024-09-12T02:06:17.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.384+0000 7f6cf1d9b640 1 --2- 172.21.15.19:0/3828494456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cfc0d04a0 0x7f6cfc0d0910 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40097a0 tx=0x7f6ce402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c5406830fa03fc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:17.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.384+0000 7f6cf9d9b640 1 -- 172.21.15.19:0/3828494456 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4037070 con 0x7f6cfc0d04a0 2024-09-12T02:06:17.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.384+0000 7f6cf9d9b640 1 -- 172.21.15.19:0/3828494456 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce402abc0 con 0x7f6cfc0d04a0 2024-09-12T02:06:17.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.384+0000 7f6cf9d9b640 1 -- 172.21.15.19:0/3828494456 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0015f0 con 0x7f6cfc0d04a0 2024-09-12T02:06:17.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.385+0000 7f6d00df6640 1 -- 172.21.15.19:0/3828494456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cfc0d04a0 msgr2=0x7f6cfc0d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.385+0000 7f6d00df6640 1 --2- 172.21.15.19:0/3828494456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cfc0d04a0 0x7f6cfc0d0910 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40097a0 tx=0x7f6ce402a130 comp rx=0 tx=0).stop 2024-09-12T02:06:17.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.385+0000 7f6d00df6640 1 -- 172.21.15.19:0/3828494456 shutdown_connections 2024-09-12T02:06:17.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.385+0000 7f6d00df6640 1 --2- 172.21.15.19:0/3828494456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cfc0d04a0 0x7f6cfc0d0910 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.385+0000 7f6d00df6640 1 -- 172.21.15.19:0/3828494456 >> 172.21.15.19:0/3828494456 conn(0x7f6cfc0b2f40 msgr2=0x7f6cfc0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:17.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.385+0000 7f6d00df6640 1 -- 172.21.15.19:0/3828494456 shutdown_connections 2024-09-12T02:06:17.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.385+0000 7f6d00df6640 1 -- 172.21.15.19:0/3828494456 wait complete. 2024-09-12T02:06:17.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.386+0000 7f6d00df6640 1 Processor -- start 2024-09-12T02:06:17.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.386+0000 7f6d00df6640 1 -- start start 2024-09-12T02:06:17.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.387+0000 7f6d00df6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cfc0ae550 0x7f6cfc15c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.387+0000 7f6d00df6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cfc0d04a0 0x7f6cfc15f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.387+0000 7f6d00df6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6cfc147360 0x7f6cfc145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.387+0000 7f6d00df6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc070fa0 con 0x7f6cfc0ae550 2024-09-12T02:06:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.387+0000 7f6d00df6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc06c850 con 0x7f6cfc0d04a0 2024-09-12T02:06:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.387+0000 7f6d00df6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6cfc06bc10 con 0x7f6cfc147360 2024-09-12T02:06:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.387+0000 7f6cfa59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cfc0ae550 0x7f6cfc15c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.387+0000 7f6cfa59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cfc0ae550 0x7f6cfc15c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37252/0 (socket says 172.21.15.19:37252) 2024-09-12T02:06:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.387+0000 7f6cfa59c640 1 -- 172.21.15.19:0/1890890707 learned_addr learned my addr 172.21.15.19:0/1890890707 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.387+0000 7f6cf1d9b640 1 --2- 172.21.15.19:0/1890890707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cfc0d04a0 0x7f6cfc15f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.388+0000 7f6cfad9d640 1 --2- 172.21.15.19:0/1890890707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6cfc147360 0x7f6cfc145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.388+0000 7f6cfa59c640 1 -- 172.21.15.19:0/1890890707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6cfc147360 msgr2=0x7f6cfc145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.388+0000 7f6cfa59c640 1 --2- 172.21.15.19:0/1890890707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6cfc147360 0x7f6cfc145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.388+0000 7f6cfa59c640 1 -- 172.21.15.19:0/1890890707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cfc0d04a0 msgr2=0x7f6cfc15f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.388+0000 7f6cfa59c640 1 --2- 172.21.15.19:0/1890890707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cfc0d04a0 0x7f6cfc15f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.388+0000 7f6cfa59c640 1 -- 172.21.15.19:0/1890890707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc141e60 con 0x7f6cfc0ae550 2024-09-12T02:06:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.388+0000 7f6cf1d9b640 1 --2- 172.21.15.19:0/1890890707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cfc0d04a0 0x7f6cfc15f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.388+0000 7f6cfa59c640 1 --2- 172.21.15.19:0/1890890707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cfc0ae550 0x7f6cfc15c400 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00c550 tx=0x7f6cec00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:17.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.388+0000 7f6cf37fe640 1 -- 172.21.15.19:0/1890890707 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec005ce0 con 0x7f6cfc0ae550 2024-09-12T02:06:17.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.388+0000 7f6d00df6640 1 -- 172.21.15.19:0/1890890707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cfc0b4cf0 con 0x7f6cfc0ae550 2024-09-12T02:06:17.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.388+0000 7f6cf37fe640 1 -- 172.21.15.19:0/1890890707 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cec007070 con 0x7f6cfc0ae550 2024-09-12T02:06:17.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.388+0000 7f6cf37fe640 1 -- 172.21.15.19:0/1890890707 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec007460 con 0x7f6cfc0ae550 2024-09-12T02:06:17.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.388+0000 7f6d00df6640 1 -- 172.21.15.19:0/1890890707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cfc0b59e0 con 0x7f6cfc0ae550 2024-09-12T02:06:17.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.389+0000 7f6d00df6640 1 -- 172.21.15.19:0/1890890707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cfc0d0910 con 0x7f6cfc0ae550 2024-09-12T02:06:17.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.390+0000 7f6cf37fe640 1 -- 172.21.15.19:0/1890890707 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6cec007600 con 0x7f6cfc0ae550 2024-09-12T02:06:17.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.390+0000 7f6cf37fe640 1 --2- 172.21.15.19:0/1890890707 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6cdc06be30 0x7f6cdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.390+0000 7f6cf37fe640 1 -- 172.21.15.19:0/1890890707 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 9313+0+0 (secure 0 0 0) 0x7f6cec08bac0 con 0x7f6cfc0ae550 2024-09-12T02:06:17.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.390+0000 7f6cf1d9b640 1 --2- 172.21.15.19:0/1890890707 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6cdc06be30 0x7f6cdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.391+0000 7f6cf1d9b640 1 --2- 172.21.15.19:0/1890890707 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6cdc06be30 0x7f6cdc06e2f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4034000 tx=0x7f6ce402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:17.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.395+0000 7f6cf37fe640 1 -- 172.21.15.19:0/1890890707 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6cfc141e60 con 0x7f6cfc0ae550 2024-09-12T02:06:17.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.606+0000 7f6d00df6640 1 -- 172.21.15.19:0/1890890707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cfc0cf720 con 0x7f6cfc0ae550 2024-09-12T02:06:17.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.607+0000 7f6cf37fe640 1 -- 172.21.15.19:0/1890890707 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 295 v295) ==== 95+0+4392 (secure 0 0 0) 0x7f6cec059610 con 0x7f6cfc0ae550 2024-09-12T02:06:17.607 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:17.608 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":295,"btime":"2024-09-12T02:06:14:593730+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":295,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:14.593726+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":130,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:17.608 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 295 2024-09-12T02:06:17.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.609+0000 7f6d00df6640 1 -- 172.21.15.19:0/1890890707 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6cdc06be30 msgr2=0x7f6cdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.609+0000 7f6d00df6640 1 --2- 172.21.15.19:0/1890890707 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6cdc06be30 0x7f6cdc06e2f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4034000 tx=0x7f6ce402e000 comp rx=0 tx=0).stop 2024-09-12T02:06:17.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.609+0000 7f6d00df6640 1 -- 172.21.15.19:0/1890890707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cfc0ae550 msgr2=0x7f6cfc15c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.609+0000 7f6d00df6640 1 --2- 172.21.15.19:0/1890890707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cfc0ae550 0x7f6cfc15c400 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00c550 tx=0x7f6cec00ca10 comp rx=0 tx=0).stop 2024-09-12T02:06:17.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.609+0000 7f6d00df6640 1 -- 172.21.15.19:0/1890890707 shutdown_connections 2024-09-12T02:06:17.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.609+0000 7f6d00df6640 1 --2- 172.21.15.19:0/1890890707 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6cdc06be30 0x7f6cdc06e2f0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.609+0000 7f6d00df6640 1 --2- 172.21.15.19:0/1890890707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6cfc147360 0x7f6cfc145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.609+0000 7f6d00df6640 1 --2- 172.21.15.19:0/1890890707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cfc0d04a0 0x7f6cfc15f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.609+0000 7f6d00df6640 1 --2- 172.21.15.19:0/1890890707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cfc0ae550 0x7f6cfc15c400 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.609+0000 7f6d00df6640 1 -- 172.21.15.19:0/1890890707 >> 172.21.15.19:0/1890890707 conn(0x7f6cfc0b2f40 msgr2=0x7f6cfc0b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:17.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.609+0000 7f6d00df6640 1 -- 172.21.15.19:0/1890890707 shutdown_connections 2024-09-12T02:06:17.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.609+0000 7f6d00df6640 1 -- 172.21.15.19:0/1890890707 wait complete. 2024-09-12T02:06:17.621 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:06:17.621 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.723+0000 7feaff62c640 1 Processor -- start 2024-09-12T02:06:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.723+0000 7feaff62c640 1 -- start start 2024-09-12T02:06:17.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.724+0000 7feaff62c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7feaf815b300 0x7feaf80cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.724+0000 7feaff62c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feaf806f8d0 0x7feaf815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.724+0000 7feaff62c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaf80cdbe0 con 0x7feaf80cd3f0 2024-09-12T02:06:17.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.724+0000 7feaff62c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7feaf80728a0 con 0x7feaf815b300 2024-09-12T02:06:17.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.724+0000 7feaff62c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7feaf80cd900 con 0x7feaf806f8d0 2024-09-12T02:06:17.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.724+0000 7feafd3c8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7feaf815b300 0x7feaf80cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.724+0000 7feafdbc9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feaf806f8d0 0x7feaf815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.724+0000 7feafd3c8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7feaf815b300 0x7feaf80cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:38228/0 (socket says 172.21.15.19:38228) 2024-09-12T02:06:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.724+0000 7feafd3c8640 1 -- 172.21.15.19:0/2541960943 learned_addr learned my addr 172.21.15.19:0/2541960943 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.724+0000 7feafd3c8640 1 -- 172.21.15.19:0/2541960943 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feaf806f8d0 msgr2=0x7feaf815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.724+0000 7feafd3c8640 1 --2- 172.21.15.19:0/2541960943 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feaf806f8d0 0x7feaf815b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.724+0000 7feafd3c8640 1 -- 172.21.15.19:0/2541960943 >> v1:172.21.15.135:6789/0 conn(0x7feaf80cd3f0 legacy=0x7feaf806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.724+0000 7feafd3c8640 1 -- 172.21.15.19:0/2541960943 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf8072250 con 0x7feaf815b300 2024-09-12T02:06:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.725+0000 7feafd3c8640 1 --2- 172.21.15.19:0/2541960943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf815b300 0x7feaf80cceb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009870 tx=0x7feaf402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a858b9d610d472 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.725+0000 7feaeffff640 1 -- 172.21.15.19:0/2541960943 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf4037070 con 0x7feaf815b300 2024-09-12T02:06:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.725+0000 7feaeffff640 1 -- 172.21.15.19:0/2541960943 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf4032440 con 0x7feaf815b300 2024-09-12T02:06:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.726+0000 7feaeffff640 1 -- 172.21.15.19:0/2541960943 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf4032810 con 0x7feaf815b300 2024-09-12T02:06:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.726+0000 7feaff62c640 1 -- 172.21.15.19:0/2541960943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf815b300 msgr2=0x7feaf80cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.726+0000 7feaff62c640 1 --2- 172.21.15.19:0/2541960943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf815b300 0x7feaf80cceb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009870 tx=0x7feaf402a270 comp rx=0 tx=0).stop 2024-09-12T02:06:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.726+0000 7feaff62c640 1 -- 172.21.15.19:0/2541960943 shutdown_connections 2024-09-12T02:06:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.726+0000 7feaff62c640 1 --2- 172.21.15.19:0/2541960943 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feaf806f8d0 0x7feaf815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.726+0000 7feaff62c640 1 --2- 172.21.15.19:0/2541960943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf815b300 0x7feaf80cceb0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.726+0000 7feaff62c640 1 -- 172.21.15.19:0/2541960943 >> 172.21.15.19:0/2541960943 conn(0x7feaf8067d70 msgr2=0x7feaf806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.726+0000 7feaff62c640 1 -- 172.21.15.19:0/2541960943 shutdown_connections 2024-09-12T02:06:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.726+0000 7feaff62c640 1 -- 172.21.15.19:0/2541960943 wait complete. 2024-09-12T02:06:17.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.727+0000 7feaff62c640 1 Processor -- start 2024-09-12T02:06:17.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.727+0000 7feaff62c640 1 -- start start 2024-09-12T02:06:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.728+0000 7feaff62c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feaf806f8d0 0x7feaf81f3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.728+0000 7feaff62c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf80cd3f0 0x7feaf81538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.728+0000 7feaff62c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feaf815b300 0x7feaf8156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.728+0000 7feaff62c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feaf80d0160 con 0x7feaf815b300 2024-09-12T02:06:17.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.728+0000 7feaff62c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feaf80cffe0 con 0x7feaf80cd3f0 2024-09-12T02:06:17.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.728+0000 7feaff62c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7feaf8072d30 con 0x7feaf806f8d0 2024-09-12T02:06:17.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.728+0000 7feafdbc9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feaf815b300 0x7feaf8156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.728+0000 7feafdbc9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feaf815b300 0x7feaf8156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37262/0 (socket says 172.21.15.19:37262) 2024-09-12T02:06:17.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.728+0000 7feafdbc9640 1 -- 172.21.15.19:0/639655744 learned_addr learned my addr 172.21.15.19:0/639655744 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:17.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.728+0000 7feafd3c8640 1 --2- 172.21.15.19:0/639655744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feaf806f8d0 0x7feaf81f3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.728+0000 7feafcbc7640 1 --2- 172.21.15.19:0/639655744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf80cd3f0 0x7feaf81538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.729+0000 7feafdbc9640 1 -- 172.21.15.19:0/639655744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feaf806f8d0 msgr2=0x7feaf81f3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.729+0000 7feafdbc9640 1 --2- 172.21.15.19:0/639655744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feaf806f8d0 0x7feaf81f3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.729+0000 7feafdbc9640 1 -- 172.21.15.19:0/639655744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf80cd3f0 msgr2=0x7feaf81538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.729+0000 7feafdbc9640 1 --2- 172.21.15.19:0/639655744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf80cd3f0 0x7feaf81538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.729+0000 7feafdbc9640 1 -- 172.21.15.19:0/639655744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf8147450 con 0x7feaf815b300 2024-09-12T02:06:17.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.729+0000 7feafdbc9640 1 --2- 172.21.15.19:0/639655744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feaf815b300 0x7feaf8156de0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7feaf000efc0 tx=0x7feaf000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:17.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.729+0000 7feaedffb640 1 -- 172.21.15.19:0/639655744 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0018020 con 0x7feaf815b300 2024-09-12T02:06:17.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.729+0000 7feaedffb640 1 -- 172.21.15.19:0/639655744 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf0014480 con 0x7feaf815b300 2024-09-12T02:06:17.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.729+0000 7feaff62c640 1 -- 172.21.15.19:0/639655744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf8155d40 con 0x7feaf815b300 2024-09-12T02:06:17.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.729+0000 7feaedffb640 1 -- 172.21.15.19:0/639655744 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0014870 con 0x7feaf815b300 2024-09-12T02:06:17.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.729+0000 7feaff62c640 1 -- 172.21.15.19:0/639655744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf8156300 con 0x7feaf815b300 2024-09-12T02:06:17.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.730+0000 7feaff62c640 1 -- 172.21.15.19:0/639655744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf815ab00 con 0x7feaf815b300 2024-09-12T02:06:17.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.731+0000 7feaedffb640 1 -- 172.21.15.19:0/639655744 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feaf0005d10 con 0x7feaf815b300 2024-09-12T02:06:17.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.731+0000 7feaedffb640 1 --2- 172.21.15.19:0/639655744 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7feadc06be30 0x7feadc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.731+0000 7feaedffb640 1 -- 172.21.15.19:0/639655744 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 9313+0+0 (secure 0 0 0) 0x7feaf008ca80 con 0x7feaf815b300 2024-09-12T02:06:17.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.731+0000 7feafd3c8640 1 --2- 172.21.15.19:0/639655744 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7feadc06be30 0x7feadc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.732+0000 7feafd3c8640 1 --2- 172.21.15.19:0/639655744 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7feadc06be30 0x7feadc06e2f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7feaf4034000 tx=0x7feaf402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.735+0000 7feaedffb640 1 -- 172.21.15.19:0/639655744 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feaf0022030 con 0x7feaf815b300 2024-09-12T02:06:17.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.948+0000 7feaff62c640 1 -- 172.21.15.19:0/639655744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feaf80b0f60 con 0x7feaf815b300 2024-09-12T02:06:17.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.949+0000 7feaedffb640 1 -- 172.21.15.19:0/639655744 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 295 v295) ==== 95+0+4392 (secure 0 0 0) 0x7feaf8147450 con 0x7feaf815b300 2024-09-12T02:06:17.949 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:17.950 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":295,"btime":"2024-09-12T02:06:14:593730+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":295,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:14.593726+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":130,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:17.950 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 295 2024-09-12T02:06:17.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.951+0000 7feaff62c640 1 -- 172.21.15.19:0/639655744 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7feadc06be30 msgr2=0x7feadc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.951+0000 7feaff62c640 1 --2- 172.21.15.19:0/639655744 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7feadc06be30 0x7feadc06e2f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7feaf4034000 tx=0x7feaf402e000 comp rx=0 tx=0).stop 2024-09-12T02:06:17.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.951+0000 7feaff62c640 1 -- 172.21.15.19:0/639655744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feaf815b300 msgr2=0x7feaf8156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.951+0000 7feaff62c640 1 --2- 172.21.15.19:0/639655744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feaf815b300 0x7feaf8156de0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7feaf000efc0 tx=0x7feaf000c490 comp rx=0 tx=0).stop 2024-09-12T02:06:17.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.951+0000 7feaff62c640 1 -- 172.21.15.19:0/639655744 shutdown_connections 2024-09-12T02:06:17.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.951+0000 7feaff62c640 1 --2- 172.21.15.19:0/639655744 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7feadc06be30 0x7feadc06e2f0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.951+0000 7feaff62c640 1 --2- 172.21.15.19:0/639655744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feaf815b300 0x7feaf8156de0 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.951+0000 7feaff62c640 1 --2- 172.21.15.19:0/639655744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf80cd3f0 0x7feaf81538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.951+0000 7feaff62c640 1 --2- 172.21.15.19:0/639655744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feaf806f8d0 0x7feaf81f3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.951+0000 7feaff62c640 1 -- 172.21.15.19:0/639655744 >> 172.21.15.19:0/639655744 conn(0x7feaf8067d70 msgr2=0x7feaf806ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:17.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.951+0000 7feaff62c640 1 -- 172.21.15.19:0/639655744 shutdown_connections 2024-09-12T02:06:17.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:17.951+0000 7feaff62c640 1 -- 172.21.15.19:0/639655744 wait complete. 2024-09-12T02:06:17.963 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap header on 600.00000000' led to DAMAGED state 2024-09-12T02:06:17.963 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap header on mds0_openfiles.0' 2024-09-12T02:06:17.963 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:06:17.963 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:06:17.980 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:06:17.980 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:06:17.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:17.980 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:06:18.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:06:18.036 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:06:18.036 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:06:18.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.179+0000 7febca15b640 1 Processor -- start 2024-09-12T02:06:18.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.179+0000 7febca15b640 1 -- start start 2024-09-12T02:06:18.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.180+0000 7febca15b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febc415e5f0 0x7febc40d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.180+0000 7febca15b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7febc40d30f0 0x7febc40b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.180+0000 7febca15b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febc40d3690 con 0x7febc40b64c0 2024-09-12T02:06:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.180+0000 7febca15b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7febc406d530 con 0x7febc40d30f0 2024-09-12T02:06:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.180+0000 7febca15b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7febc40d3970 con 0x7febc415e5f0 2024-09-12T02:06:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.180+0000 7febc2ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7febc40d30f0 0x7febc40b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.180+0000 7febc3fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7febc40b64c0 0x7febc40cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56602/0 (socket says 172.21.15.19:56602) 2024-09-12T02:06:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.180+0000 7febc2ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7febc40d30f0 0x7febc40b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37268/0 (socket says 172.21.15.19:37268) 2024-09-12T02:06:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.180+0000 7febc3fff640 1 -- 172.21.15.19:0/3508212356 learned_addr learned my addr 172.21.15.19:0/3508212356 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.180+0000 7febc37fe640 1 --2- 172.21.15.19:0/3508212356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febc415e5f0 0x7febc40d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.180+0000 7febc2ffd640 1 -- 172.21.15.19:0/3508212356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febc415e5f0 msgr2=0x7febc40d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.180+0000 7febc2ffd640 1 --2- 172.21.15.19:0/3508212356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febc415e5f0 0x7febc40d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.180+0000 7febc2ffd640 1 -- 172.21.15.19:0/3508212356 >> v1:172.21.15.19:6789/0 conn(0x7febc40b64c0 legacy=0x7febc40cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.180+0000 7febc27fc640 1 -- 172.21.15.19:0/3508212356 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2309509374 0 0) 0x7febc40d3690 con 0x7febc40b64c0 2024-09-12T02:06:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.180+0000 7febc2ffd640 1 -- 172.21.15.19:0/3508212356 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc406cee0 con 0x7febc40d30f0 2024-09-12T02:06:18.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.181+0000 7febc2ffd640 1 --2- 172.21.15.19:0/3508212356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febc40d30f0 0x7febc40b5f80 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7febb80097a0 tx=0x7febb802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8d1fc48e0e1065 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:18.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.181+0000 7febc27fc640 1 -- 172.21.15.19:0/3508212356 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8037070 con 0x7febc40d30f0 2024-09-12T02:06:18.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.181+0000 7febc27fc640 1 -- 172.21.15.19:0/3508212356 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb8032440 con 0x7febc40d30f0 2024-09-12T02:06:18.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.181+0000 7febc27fc640 1 -- 172.21.15.19:0/3508212356 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8032810 con 0x7febc40d30f0 2024-09-12T02:06:18.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.182+0000 7febca15b640 1 -- 172.21.15.19:0/3508212356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febc40d30f0 msgr2=0x7febc40b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.182+0000 7febca15b640 1 --2- 172.21.15.19:0/3508212356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febc40d30f0 0x7febc40b5f80 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7febb80097a0 tx=0x7febb802a180 comp rx=0 tx=0).stop 2024-09-12T02:06:18.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.182+0000 7febca15b640 1 -- 172.21.15.19:0/3508212356 shutdown_connections 2024-09-12T02:06:18.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.182+0000 7febca15b640 1 --2- 172.21.15.19:0/3508212356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febc40d30f0 0x7febc40b5f80 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.182+0000 7febca15b640 1 --2- 172.21.15.19:0/3508212356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febc415e5f0 0x7febc40d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.182+0000 7febca15b640 1 -- 172.21.15.19:0/3508212356 >> 172.21.15.19:0/3508212356 conn(0x7febc408bfc0 msgr2=0x7febc40d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:18.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.182+0000 7febca15b640 1 -- 172.21.15.19:0/3508212356 shutdown_connections 2024-09-12T02:06:18.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.182+0000 7febca15b640 1 -- 172.21.15.19:0/3508212356 wait complete. 2024-09-12T02:06:18.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.183+0000 7febca15b640 1 Processor -- start 2024-09-12T02:06:18.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.183+0000 7febca15b640 1 -- start start 2024-09-12T02:06:18.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.184+0000 7febca15b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febc40b64c0 0x7febc41570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.184+0000 7febca15b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febc40d30f0 0x7febc41f7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.184+0000 7febca15b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc415e5f0 0x7febc4161360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.184+0000 7febca15b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7febc40d5310 con 0x7febc40d30f0 2024-09-12T02:06:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.184+0000 7febca15b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7febc415e9d0 con 0x7febc415e5f0 2024-09-12T02:06:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.184+0000 7febca15b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7febc406e9d0 con 0x7febc40b64c0 2024-09-12T02:06:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.184+0000 7febc2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febc40d30f0 0x7febc41f7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.184+0000 7febc2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febc40d30f0 0x7febc41f7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37280/0 (socket says 172.21.15.19:37280) 2024-09-12T02:06:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.184+0000 7febc2ffd640 1 -- 172.21.15.19:0/1061482825 learned_addr learned my addr 172.21.15.19:0/1061482825 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.184+0000 7febc3fff640 1 --2- 172.21.15.19:0/1061482825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc415e5f0 0x7febc4161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.184+0000 7febc37fe640 1 --2- 172.21.15.19:0/1061482825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febc40b64c0 0x7febc41570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.184+0000 7febc2ffd640 1 -- 172.21.15.19:0/1061482825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febc40b64c0 msgr2=0x7febc41570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.184+0000 7febc2ffd640 1 --2- 172.21.15.19:0/1061482825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febc40b64c0 0x7febc41570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.185+0000 7febc2ffd640 1 -- 172.21.15.19:0/1061482825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc415e5f0 msgr2=0x7febc4161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.185+0000 7febc2ffd640 1 --2- 172.21.15.19:0/1061482825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc415e5f0 0x7febc4161360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.185+0000 7febc2ffd640 1 -- 172.21.15.19:0/1061482825 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc41f83e0 con 0x7febc40d30f0 2024-09-12T02:06:18.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.185+0000 7febc2ffd640 1 --2- 172.21.15.19:0/1061482825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febc40d30f0 0x7febc41f7a70 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7febb8035040 tx=0x7febb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:18.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.185+0000 7febabfff640 1 -- 172.21.15.19:0/1061482825 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8037040 con 0x7febc40d30f0 2024-09-12T02:06:18.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.185+0000 7febabfff640 1 -- 172.21.15.19:0/1061482825 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb8030770 con 0x7febc40d30f0 2024-09-12T02:06:18.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.185+0000 7febca15b640 1 -- 172.21.15.19:0/1061482825 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc41f86c0 con 0x7febc40d30f0 2024-09-12T02:06:18.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.185+0000 7febabfff640 1 -- 172.21.15.19:0/1061482825 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8030b80 con 0x7febc40d30f0 2024-09-12T02:06:18.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.185+0000 7febca15b640 1 -- 172.21.15.19:0/1061482825 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc40b8c40 con 0x7febc40d30f0 2024-09-12T02:06:18.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.186+0000 7febca15b640 1 -- 172.21.15.19:0/1061482825 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc40b5f80 con 0x7febc40d30f0 2024-09-12T02:06:18.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.186+0000 7febabfff640 1 -- 172.21.15.19:0/1061482825 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7febb8044020 con 0x7febc40d30f0 2024-09-12T02:06:18.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.187+0000 7febabfff640 1 --2- 172.21.15.19:0/1061482825 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7febb006be30 0x7febb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.187+0000 7febabfff640 1 -- 172.21.15.19:0/1061482825 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 9313+0+0 (secure 0 0 0) 0x7febb80ac140 con 0x7febc40d30f0 2024-09-12T02:06:18.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.188+0000 7febc37fe640 1 --2- 172.21.15.19:0/1061482825 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7febb006be30 0x7febb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.189+0000 7febc37fe640 1 --2- 172.21.15.19:0/1061482825 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7febb006be30 0x7febb006e2f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7febb4006fd0 tx=0x7febb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:18.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.191+0000 7febabfff640 1 -- 172.21.15.19:0/1061482825 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7febb8032e20 con 0x7febc40d30f0 2024-09-12T02:06:18.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.405+0000 7febca15b640 1 -- 172.21.15.19:0/1061482825 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7febc40b42d0 con 0x7febc40d30f0 2024-09-12T02:06:18.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.593+0000 7febabfff640 1 -- 172.21.15.19:0/1061482825 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v296) ==== 161+0+0 (secure 0 0 0) 0x7febb8079cb0 con 0x7febc40d30f0 2024-09-12T02:06:18.594 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:06:18.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.595+0000 7febca15b640 1 -- 172.21.15.19:0/1061482825 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7febb006be30 msgr2=0x7febb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.595+0000 7febca15b640 1 --2- 172.21.15.19:0/1061482825 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7febb006be30 0x7febb006e2f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7febb4006fd0 tx=0x7febb4008040 comp rx=0 tx=0).stop 2024-09-12T02:06:18.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.595+0000 7febca15b640 1 -- 172.21.15.19:0/1061482825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febc40d30f0 msgr2=0x7febc41f7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.595+0000 7febca15b640 1 --2- 172.21.15.19:0/1061482825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febc40d30f0 0x7febc41f7a70 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7febb8035040 tx=0x7febb80046c0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.596+0000 7febca15b640 1 -- 172.21.15.19:0/1061482825 shutdown_connections 2024-09-12T02:06:18.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.596+0000 7febca15b640 1 --2- 172.21.15.19:0/1061482825 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7febb006be30 0x7febb006e2f0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.596+0000 7febca15b640 1 --2- 172.21.15.19:0/1061482825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc415e5f0 0x7febc4161360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.596+0000 7febca15b640 1 --2- 172.21.15.19:0/1061482825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febc40d30f0 0x7febc41f7a70 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.596+0000 7febca15b640 1 --2- 172.21.15.19:0/1061482825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febc40b64c0 0x7febc41570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.596+0000 7febca15b640 1 -- 172.21.15.19:0/1061482825 >> 172.21.15.19:0/1061482825 conn(0x7febc408bfc0 msgr2=0x7febc40d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:18.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.596+0000 7febca15b640 1 -- 172.21.15.19:0/1061482825 shutdown_connections 2024-09-12T02:06:18.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.596+0000 7febca15b640 1 -- 172.21.15.19:0/1061482825 wait complete. 2024-09-12T02:06:18.607 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:06:18.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.710+0000 7fe5b295f640 1 Processor -- start 2024-09-12T02:06:18.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.710+0000 7fe5b295f640 1 -- start start 2024-09-12T02:06:18.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.711+0000 7fe5b295f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe5ac072de0 0x7fe5ac15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.711+0000 7fe5b295f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5ac146140 con 0x7fe5ac072320 2024-09-12T02:06:18.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.711+0000 7fe5b295f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5ac0cd740 con 0x7fe5ac072700 2024-09-12T02:06:18.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.711+0000 7fe5b295f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fe5ac0cda20 con 0x7fe5ac072de0 2024-09-12T02:06:18.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.711+0000 7fe5ab7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe5ac072de0 0x7fe5ac15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.711+0000 7fe5ab7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe5ac072de0 0x7fe5ac15d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37292/0 (socket says 172.21.15.19:37292) 2024-09-12T02:06:18.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.711+0000 7fe5abfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe5ac072320 0x7fe5ac0cce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56604/0 (socket says 172.21.15.19:56604) 2024-09-12T02:06:18.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.711+0000 7fe5ab7fe640 1 -- 172.21.15.19:0/3215088497 learned_addr learned my addr 172.21.15.19:0/3215088497 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:18.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.712+0000 7fe5ab7fe640 1 -- 172.21.15.19:0/3215088497 >> v1:172.21.15.135:6789/0 conn(0x7fe5ac072700 legacy=0x7fe5ac15d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:18.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.712+0000 7fe5ab7fe640 1 -- 172.21.15.19:0/3215088497 >> v1:172.21.15.19:6789/0 conn(0x7fe5ac072320 legacy=0x7fe5ac0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.712+0000 7fe5ab7fe640 1 -- 172.21.15.19:0/3215088497 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5ac0cdd00 con 0x7fe5ac072de0 2024-09-12T02:06:18.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.712+0000 7fe5aaffd640 1 -- 172.21.15.19:0/3215088497 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4193414725 0 0) 0x7fe5ac146140 con 0x7fe5ac072320 2024-09-12T02:06:18.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.713+0000 7fe5ab7fe640 1 --2- 172.21.15.19:0/3215088497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5ac072de0 0x7fe5ac15d1e0 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009870 tx=0x7fe5a002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac0d9a8eb22d022 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:18.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.713+0000 7fe5aaffd640 1 -- 172.21.15.19:0/3215088497 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0037070 con 0x7fe5ac072de0 2024-09-12T02:06:18.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.713+0000 7fe5aaffd640 1 -- 172.21.15.19:0/3215088497 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a0032440 con 0x7fe5ac072de0 2024-09-12T02:06:18.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.713+0000 7fe5aaffd640 1 -- 172.21.15.19:0/3215088497 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0032810 con 0x7fe5ac072de0 2024-09-12T02:06:18.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.713+0000 7fe5b295f640 1 -- 172.21.15.19:0/3215088497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5ac072de0 msgr2=0x7fe5ac15d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.713+0000 7fe5b295f640 1 --2- 172.21.15.19:0/3215088497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5ac072de0 0x7fe5ac15d1e0 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009870 tx=0x7fe5a002a210 comp rx=0 tx=0).stop 2024-09-12T02:06:18.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.713+0000 7fe5b295f640 1 -- 172.21.15.19:0/3215088497 shutdown_connections 2024-09-12T02:06:18.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.713+0000 7fe5b295f640 1 --2- 172.21.15.19:0/3215088497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5ac072de0 0x7fe5ac15d1e0 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.713+0000 7fe5b295f640 1 -- 172.21.15.19:0/3215088497 >> 172.21.15.19:0/3215088497 conn(0x7fe5ac067d70 msgr2=0x7fe5ac06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:18.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.713+0000 7fe5b295f640 1 -- 172.21.15.19:0/3215088497 shutdown_connections 2024-09-12T02:06:18.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.713+0000 7fe5b295f640 1 -- 172.21.15.19:0/3215088497 wait complete. 2024-09-12T02:06:18.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.714+0000 7fe5b295f640 1 Processor -- start 2024-09-12T02:06:18.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.715+0000 7fe5b295f640 1 -- start start 2024-09-12T02:06:18.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.715+0000 7fe5b295f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5ac072320 0x7fe5ac15ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.715+0000 7fe5b295f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5ac072700 0x7fe5ac0aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.715+0000 7fe5b295f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5ac072de0 0x7fe5ac0acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.715+0000 7fe5b295f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac15dfb0 con 0x7fe5ac072320 2024-09-12T02:06:18.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.715+0000 7fe5b295f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac15de30 con 0x7fe5ac072700 2024-09-12T02:06:18.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.715+0000 7fe5b295f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe5ac15e130 con 0x7fe5ac072de0 2024-09-12T02:06:18.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.716+0000 7fe5abfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5ac072320 0x7fe5ac15ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.716+0000 7fe5abfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5ac072320 0x7fe5ac15ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37304/0 (socket says 172.21.15.19:37304) 2024-09-12T02:06:18.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.716+0000 7fe5abfff640 1 -- 172.21.15.19:0/2898182890 learned_addr learned my addr 172.21.15.19:0/2898182890 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:18.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.716+0000 7fe5b0efc640 1 --2- 172.21.15.19:0/2898182890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5ac072de0 0x7fe5ac0acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.716+0000 7fe5abfff640 1 -- 172.21.15.19:0/2898182890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5ac072de0 msgr2=0x7fe5ac0acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.716+0000 7fe5ab7fe640 1 --2- 172.21.15.19:0/2898182890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5ac072700 0x7fe5ac0aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.716+0000 7fe5abfff640 1 --2- 172.21.15.19:0/2898182890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5ac072de0 0x7fe5ac0acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.716+0000 7fe5abfff640 1 -- 172.21.15.19:0/2898182890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5ac072700 msgr2=0x7fe5ac0aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.716+0000 7fe5abfff640 1 --2- 172.21.15.19:0/2898182890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5ac072700 0x7fe5ac0aca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.716+0000 7fe5abfff640 1 -- 172.21.15.19:0/2898182890 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5ac1f2890 con 0x7fe5ac072320 2024-09-12T02:06:18.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.716+0000 7fe5b0efc640 1 --2- 172.21.15.19:0/2898182890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5ac072de0 0x7fe5ac0acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:18.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.716+0000 7fe5ab7fe640 1 --2- 172.21.15.19:0/2898182890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5ac072700 0x7fe5ac0aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:18.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.716+0000 7fe5abfff640 1 --2- 172.21.15.19:0/2898182890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5ac072320 0x7fe5ac15ba50 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00c500 tx=0x7fe59c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:18.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.716+0000 7fe5a8ff9640 1 -- 172.21.15.19:0/2898182890 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c018070 con 0x7fe5ac072320 2024-09-12T02:06:18.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.716+0000 7fe5a8ff9640 1 -- 172.21.15.19:0/2898182890 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe59c007580 con 0x7fe5ac072320 2024-09-12T02:06:18.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.716+0000 7fe5a8ff9640 1 -- 172.21.15.19:0/2898182890 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c004a20 con 0x7fe5ac072320 2024-09-12T02:06:18.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.716+0000 7fe5b295f640 1 -- 172.21.15.19:0/2898182890 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5ac1f2ec0 con 0x7fe5ac072320 2024-09-12T02:06:18.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.716+0000 7fe5b295f640 1 -- 172.21.15.19:0/2898182890 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5ac15bf90 con 0x7fe5ac072320 2024-09-12T02:06:18.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.717+0000 7fe5b295f640 1 -- 172.21.15.19:0/2898182890 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5ac0cce60 con 0x7fe5ac072320 2024-09-12T02:06:18.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.718+0000 7fe5a8ff9640 1 -- 172.21.15.19:0/2898182890 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe59c01b070 con 0x7fe5ac072320 2024-09-12T02:06:18.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.718+0000 7fe5a8ff9640 1 --2- 172.21.15.19:0/2898182890 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe59806be30 0x7fe59806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.718+0000 7fe5a8ff9640 1 -- 172.21.15.19:0/2898182890 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 9313+0+0 (secure 0 0 0) 0x7fe59c08b010 con 0x7fe5ac072320 2024-09-12T02:06:18.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.719+0000 7fe5ab7fe640 1 --2- 172.21.15.19:0/2898182890 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe59806be30 0x7fe59806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.719+0000 7fe5ab7fe640 1 --2- 172.21.15.19:0/2898182890 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe59806be30 0x7fe59806e2f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0034000 tx=0x7fe5a002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:18.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.722+0000 7fe5a8ff9640 1 -- 172.21.15.19:0/2898182890 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe59c058b80 con 0x7fe5ac072320 2024-09-12T02:06:18.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:18.966+0000 7fe5b295f640 1 -- 172.21.15.19:0/2898182890 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7fe5ac0b1f40 con 0x7fe5ac072320 2024-09-12T02:06:19.345 INFO:tasks.ceph.mds.c.smithi019.stderr: -49> 2024-09-12T02:06:14.591+0000 7f1c7bf2d640 -1 mds.0.cache.dir(0x600) Corrupt fnode in dirfrag 0x600: Decoder at 'void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)' v=3 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-09-12T02:06:19.345 INFO:tasks.ceph.mds.c.smithi019.stderr: -46> 2024-09-12T02:06:14.592+0000 7f1c7bf2d640 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x600 is fatal because it is a system directory for this rank 2024-09-12T02:06:19.345 INFO:tasks.ceph.mds.c.smithi019.stderr: -34> 2024-09-12T02:06:15.261+0000 7f1c7ff35640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:06:19.370 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:06:19.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.600+0000 7fe5a8ff9640 1 -- 172.21.15.19:0/2898182890 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v297) ==== 101+0+0 (secure 0 0 0) 0x7fe59c058480 con 0x7fe5ac072320 2024-09-12T02:06:19.601 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:06:19.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.603+0000 7fe5b295f640 1 -- 172.21.15.19:0/2898182890 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe59806be30 msgr2=0x7fe59806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.603+0000 7fe5b295f640 1 --2- 172.21.15.19:0/2898182890 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe59806be30 0x7fe59806e2f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0034000 tx=0x7fe5a002e000 comp rx=0 tx=0).stop 2024-09-12T02:06:19.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.603+0000 7fe5b295f640 1 -- 172.21.15.19:0/2898182890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5ac072320 msgr2=0x7fe5ac15ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.603+0000 7fe5b295f640 1 --2- 172.21.15.19:0/2898182890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5ac072320 0x7fe5ac15ba50 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00c500 tx=0x7fe59c00c9c0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.603+0000 7fe5b295f640 1 -- 172.21.15.19:0/2898182890 shutdown_connections 2024-09-12T02:06:19.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.603+0000 7fe5b295f640 1 --2- 172.21.15.19:0/2898182890 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe59806be30 0x7fe59806e2f0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.603+0000 7fe5b295f640 1 --2- 172.21.15.19:0/2898182890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5ac072de0 0x7fe5ac0acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.603+0000 7fe5b295f640 1 --2- 172.21.15.19:0/2898182890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5ac072700 0x7fe5ac0aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.603+0000 7fe5b295f640 1 --2- 172.21.15.19:0/2898182890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5ac072320 0x7fe5ac15ba50 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.603+0000 7fe5b295f640 1 -- 172.21.15.19:0/2898182890 >> 172.21.15.19:0/2898182890 conn(0x7fe5ac067d70 msgr2=0x7fe5ac144210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:19.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.603+0000 7fe5b295f640 1 -- 172.21.15.19:0/2898182890 shutdown_connections 2024-09-12T02:06:19.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.603+0000 7fe5b295f640 1 -- 172.21.15.19:0/2898182890 wait complete. 2024-09-12T02:06:19.616 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:06:19.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.660+0000 7fe0c021af40 1 Processor -- start 2024-09-12T02:06:19.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.660+0000 7fe0c021af40 1 -- start start 2024-09-12T02:06:19.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.661+0000 7fe0c021af40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5508c7350 0x55c5509847b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.661+0000 7fe0c021af40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5508f5050 0x55c55099ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.661+0000 7fe0c021af40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c55097f080 0x55c550a2ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.661+0000 7fe0c021af40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c550816510 con 0x55c5508c7350 2024-09-12T02:06:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.661+0000 7fe0c021af40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c55086fc50 con 0x55c55097f080 2024-09-12T02:06:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.661+0000 7fe0c021af40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55c5508c3dc0 con 0x55c5508f5050 2024-09-12T02:06:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.661+0000 7fe0bd0a3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5508c7350 0x55c5509847b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.661+0000 7fe0bd0a3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5508c7350 0x55c5509847b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37342/0 (socket says 172.21.15.19:37342) 2024-09-12T02:06:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.661+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/848937149 learned_addr learned my addr 172.21.15.19:0/848937149 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.661+0000 7fe0bd8a4640 1 --2- 172.21.15.19:0/848937149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c55097f080 0x55c550a2ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.661+0000 7fe0b7fff640 1 --2- 172.21.15.19:0/848937149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5508f5050 0x55c55099ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.661+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/848937149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5508f5050 msgr2=0x55c55099ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.662+0000 7fe0bd0a3640 1 --2- 172.21.15.19:0/848937149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5508f5050 0x55c55099ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.662+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/848937149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c55097f080 msgr2=0x55c550a2ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.662+0000 7fe0bd0a3640 1 --2- 172.21.15.19:0/848937149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c55097f080 0x55c550a2ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.662+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/848937149 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c55099d8b0 con 0x55c5508c7350 2024-09-12T02:06:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.662+0000 7fe0bd8a4640 1 --2- 172.21.15.19:0/848937149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c55097f080 0x55c550a2ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.662+0000 7fe0bd0a3640 1 --2- 172.21.15.19:0/848937149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5508c7350 0x55c5509847b0 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0025cc0 tx=0x7fe0b0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca732eed76a448 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:19.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.662+0000 7fe0b77fe640 1 -- 172.21.15.19:0/848937149 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0069070 con 0x55c5508c7350 2024-09-12T02:06:19.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.662+0000 7fe0b77fe640 1 -- 172.21.15.19:0/848937149 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b0052b30 con 0x55c5508c7350 2024-09-12T02:06:19.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.662+0000 7fe0b77fe640 1 -- 172.21.15.19:0/848937149 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b005b420 con 0x55c5508c7350 2024-09-12T02:06:19.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.662+0000 7fe0c021af40 1 -- 172.21.15.19:0/848937149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5508c7350 msgr2=0x55c5509847b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.662+0000 7fe0c021af40 1 --2- 172.21.15.19:0/848937149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5508c7350 0x55c5509847b0 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0025cc0 tx=0x7fe0b0051000 comp rx=0 tx=0).stop 2024-09-12T02:06:19.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.662+0000 7fe0c021af40 1 -- 172.21.15.19:0/848937149 shutdown_connections 2024-09-12T02:06:19.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.662+0000 7fe0c021af40 1 --2- 172.21.15.19:0/848937149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c55097f080 0x55c550a2ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.662+0000 7fe0c021af40 1 --2- 172.21.15.19:0/848937149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5508f5050 0x55c55099ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.662+0000 7fe0c021af40 1 --2- 172.21.15.19:0/848937149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5508c7350 0x55c5509847b0 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.662+0000 7fe0c021af40 1 -- 172.21.15.19:0/848937149 >> 172.21.15.19:0/848937149 conn(0x55c5508c49e0 msgr2=0x55c55090b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:19.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.662+0000 7fe0c021af40 1 -- 172.21.15.19:0/848937149 shutdown_connections 2024-09-12T02:06:19.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.663+0000 7fe0c021af40 1 -- 172.21.15.19:0/848937149 wait complete. 2024-09-12T02:06:19.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.663+0000 7fe0c021af40 1 Processor -- start 2024-09-12T02:06:19.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.663+0000 7fe0c021af40 1 -- start start 2024-09-12T02:06:19.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.664+0000 7fe0c021af40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5508c7350 0x55c55097a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.664+0000 7fe0c021af40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c5508f5050 0x55c5508f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.664+0000 7fe0c021af40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c55097f080 0x55c5508f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.664+0000 7fe0c021af40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c550908b60 con 0x55c55097f080 2024-09-12T02:06:19.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.664+0000 7fe0c021af40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c55099db90 con 0x55c5508f5050 2024-09-12T02:06:19.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.664+0000 7fe0c021af40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55c550908e40 con 0x55c5508c7350 2024-09-12T02:06:19.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.664+0000 7fe0bd8a4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c55097f080 0x55c5508f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.664+0000 7fe0bd8a4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c55097f080 0x55c5508f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37356/0 (socket says 172.21.15.19:37356) 2024-09-12T02:06:19.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.664+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 learned_addr learned my addr 172.21.15.19:0/1512345341 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:19.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.664+0000 7fe0bd0a3640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5508c7350 0x55c55097a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.664+0000 7fe0b7fff640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c5508f5050 0x55c5508f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.664+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5508c7350 msgr2=0x55c55097a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.664+0000 7fe0bd8a4640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c5508c7350 0x55c55097a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.664+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c5508f5050 msgr2=0x55c5508f4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.664+0000 7fe0bd8a4640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c5508f5050 0x55c5508f4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.664+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c55099e5f0 con 0x55c55097f080 2024-09-12T02:06:19.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.664+0000 7fe0bd8a4640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c55097f080 0x55c5508f4680 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8004e70 tx=0x7fe0b8001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:19.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.665+0000 7fe0b67fc640 1 -- 172.21.15.19:0/1512345341 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8018070 con 0x55c55097f080 2024-09-12T02:06:19.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.665+0000 7fe0b67fc640 1 -- 172.21.15.19:0/1512345341 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b80104f0 con 0x55c55097f080 2024-09-12T02:06:19.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.665+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c55090bb60 con 0x55c55097f080 2024-09-12T02:06:19.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.665+0000 7fe0b67fc640 1 -- 172.21.15.19:0/1512345341 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b80108e0 con 0x55c55097f080 2024-09-12T02:06:19.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.665+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5509986d0 con 0x55c55097f080 2024-09-12T02:06:19.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.666+0000 7fe0b67fc640 1 -- 172.21.15.19:0/1512345341 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe0b801b070 con 0x55c55097f080 2024-09-12T02:06:19.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.666+0000 7fe0b67fc640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe0a006a840 0x7fe0a006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.667+0000 7fe0b67fc640 1 -- 172.21.15.19:0/1512345341 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 9313+0+0 (secure 0 0 0) 0x7fe0b808a0f0 con 0x55c55097f080 2024-09-12T02:06:19.670 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:06:19.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.667+0000 7fe0bd0a3640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe0a006a840 0x7fe0a006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.667+0000 7fe0c021af40 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55c55097c1b0 0x55c550997a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.667+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550997fd0 con 0x55c55097c1b0 2024-09-12T02:06:19.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.667+0000 7fe0b7fff640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55c55097c1b0 0x55c550997a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.667+0000 7fe0bd0a3640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe0a006a840 0x7fe0a006cd00 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0066000 tx=0x7fe0b0053000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:19.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.667+0000 7fe0b7fff640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55c55097c1b0 0x55c550997a90 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:19.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.669+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v130'1097 uv1070 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.669+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a3f460 con 0x55c55097c1b0 2024-09-12T02:06:19.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.670+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v130'1098 uv1098 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.670+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a3f800 con 0x55c55097c1b0 2024-09-12T02:06:19.672 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:06:19.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.671+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v130'1099 uv1099 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.671+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a40bb0 con 0x55c55097c1b0 2024-09-12T02:06:19.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.672+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v130'1100 uv1100 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.672+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a40f50 con 0x55c55097c1b0 2024-09-12T02:06:19.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.674+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v130'1101 uv1101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.674+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a3fba0 con 0x55c55097c1b0 2024-09-12T02:06:19.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.675+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v130'1102 uv1102 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.675+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a3ff40 con 0x55c55097c1b0 2024-09-12T02:06:19.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.676+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v130'1103 uv1076 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.676+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a40330 con 0x55c55097c1b0 2024-09-12T02:06:19.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.677+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v130'1104 uv1104 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.677+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a40330 con 0x55c55097c1b0 2024-09-12T02:06:19.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.678+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v130'1105 uv1105 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.678 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:06:19.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.678+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a402e0 con 0x55c55097c1b0 2024-09-12T02:06:19.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.679+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v130'1106 uv1106 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.679+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a402e0 con 0x55c55097c1b0 2024-09-12T02:06:19.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.680+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v130'1107 uv1107 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.680+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a402e0 con 0x55c55097c1b0 2024-09-12T02:06:19.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.681+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v130'1108 uv1108 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.681+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a402e0 con 0x55c55097c1b0 2024-09-12T02:06:19.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.682+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v130'1109 uv1083 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.682+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a402e0 con 0x55c55097c1b0 2024-09-12T02:06:19.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.683+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v130'1110 uv1110 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.684+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a402e0 con 0x55c55097c1b0 2024-09-12T02:06:19.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.685+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v130'1111 uv1111 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.685 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:06:19.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.685+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a402e0 con 0x55c55097c1b0 2024-09-12T02:06:19.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.686+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v130'1112 uv1112 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.686+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a402e0 con 0x55c55097c1b0 2024-09-12T02:06:19.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.687+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v130'1113 uv1113 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.687+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a402e0 con 0x55c55097c1b0 2024-09-12T02:06:19.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.688+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v130'1114 uv1114 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.688+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a40710 con 0x55c55097c1b0 2024-09-12T02:06:19.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.689+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v130'1115 uv1115 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.689+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a406c0 con 0x55c55097c1b0 2024-09-12T02:06:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.690+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v130'1116 uv1096 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.690+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a406c0 con 0x55c55097c1b0 2024-09-12T02:06:19.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.691+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v130'1117 uv1117 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.691+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a406c0 con 0x55c55097c1b0 2024-09-12T02:06:19.692 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:06:19.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.692+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v130'1118 uv1118 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.692+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a406c0 con 0x55c55097c1b0 2024-09-12T02:06:19.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.693+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v130'1119 uv1119 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.693+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a406c0 con 0x55c55097c1b0 2024-09-12T02:06:19.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.694+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v130'1120 uv1120 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.694+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a406c0 con 0x55c55097c1b0 2024-09-12T02:06:19.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.695+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v130'1121 uv1121 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.695+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a406c0 con 0x55c55097c1b0 2024-09-12T02:06:19.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.696+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v130'1122 uv1095 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.697+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a406c0 con 0x55c55097c1b0 2024-09-12T02:06:19.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.703+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v130'1123 uv1123 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.703+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a406c0 con 0x55c55097c1b0 2024-09-12T02:06:19.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.705+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v130'1124 uv1124 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.705 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:06:19.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.705+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a406c0 con 0x55c55097c1b0 2024-09-12T02:06:19.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.706+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v130'1125 uv1125 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.706+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a40590 con 0x55c55097c1b0 2024-09-12T02:06:19.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.707+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v130'1126 uv1126 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.707+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a40590 con 0x55c55097c1b0 2024-09-12T02:06:19.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.708+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v130'1127 uv1127 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c55097c1b0 2024-09-12T02:06:19.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.708+0000 7fe0c021af40 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55c550a41800 0x55c550a43bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.708+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a40590 con 0x55c550a41800 2024-09-12T02:06:19.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.709+0000 7fe0bd0a3640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55c550a41800 0x55c550a43bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.709+0000 7fe0bd0a3640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55c550a41800 0x55c550a43bf0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:19.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.711+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v130'800 uv782 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.711+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a44130 con 0x55c550a41800 2024-09-12T02:06:19.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.713+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v130'801 uv801 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.713+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a444d0 con 0x55c550a41800 2024-09-12T02:06:19.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.715+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v130'802 uv802 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.716 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:06:19.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.715+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a44d20 con 0x55c550a41800 2024-09-12T02:06:19.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.717+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v130'803 uv803 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.717+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a450c0 con 0x55c550a41800 2024-09-12T02:06:19.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.718+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v130'804 uv804 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.718+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a45460 con 0x55c550a41800 2024-09-12T02:06:19.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.720+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v130'805 uv787 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.720+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a45800 con 0x55c550a41800 2024-09-12T02:06:19.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.721+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v130'806 uv806 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.721+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a45ba0 con 0x55c550a41800 2024-09-12T02:06:19.723 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:06:19.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.722+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v130'807 uv807 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.722+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a45ba0 con 0x55c550a41800 2024-09-12T02:06:19.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.724+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v130'808 uv808 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.724+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a45ba0 con 0x55c550a41800 2024-09-12T02:06:19.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.725+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v130'809 uv809 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.725+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a45ba0 con 0x55c550a41800 2024-09-12T02:06:19.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.727+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v130'810 uv792 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.727+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a45ba0 con 0x55c550a41800 2024-09-12T02:06:19.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.728+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v130'811 uv811 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.728+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a45ba0 con 0x55c550a41800 2024-09-12T02:06:19.730 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:06:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.729+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v130'812 uv812 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.730+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a4a020 con 0x55c550a41800 2024-09-12T02:06:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.731+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v130'813 uv813 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.731+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a4a020 con 0x55c550a41800 2024-09-12T02:06:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.732+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v130'814 uv814 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.732+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a45ba0 con 0x55c550a41800 2024-09-12T02:06:19.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.734+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v130'815 uv798 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.734+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a45ba0 con 0x55c550a41800 2024-09-12T02:06:19.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.736+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v130'816 uv816 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.736+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a45ba0 con 0x55c550a41800 2024-09-12T02:06:19.737 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:06:19.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.737+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v130'817 uv817 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.737+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a46bb0 con 0x55c550a41800 2024-09-12T02:06:19.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.738+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v130'818 uv818 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.738+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a46bb0 con 0x55c550a41800 2024-09-12T02:06:19.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.740+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v130'819 uv819 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.740+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a45ba0 con 0x55c550a41800 2024-09-12T02:06:19.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.741+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v130'820 uv820 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a41800 2024-09-12T02:06:19.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.741+0000 7fe0c021af40 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c550a460b0 0x55c550a484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.741+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a489e0 con 0x55c550a460b0 2024-09-12T02:06:19.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.741+0000 7fe0b7fff640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c550a460b0 0x55c550a484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.742+0000 7fe0b7fff640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c550a460b0 0x55c550a484a0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:19.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.743+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v130'213 uv212 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c550a460b0 2024-09-12T02:06:19.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.743+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a489e0 con 0x55c550a460b0 2024-09-12T02:06:19.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.744+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v130'214 uv214 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c550a460b0 2024-09-12T02:06:19.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.744+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a489e0 con 0x55c550a460b0 2024-09-12T02:06:19.745 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:06:19.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.745+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v130'215 uv215 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c550a460b0 2024-09-12T02:06:19.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.745+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a49de0 con 0x55c550a460b0 2024-09-12T02:06:19.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.746+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v130'216 uv216 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c550a460b0 2024-09-12T02:06:19.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.746+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a49de0 con 0x55c550a460b0 2024-09-12T02:06:19.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.747+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v130'217 uv217 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c550a460b0 2024-09-12T02:06:19.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.747+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a48dd0 con 0x55c550a460b0 2024-09-12T02:06:19.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.748+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v130'218 uv218 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a800e040 con 0x55c550a460b0 2024-09-12T02:06:19.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.748+0000 7fe0c021af40 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55c550a492e0 0x55c550a4b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.748+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a4bd30 con 0x55c550a492e0 2024-09-12T02:06:19.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.748+0000 7fe0bd8a4640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55c550a492e0 0x55c550a4b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.749+0000 7fe0bd8a4640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55c550a492e0 0x55c550a4b6d0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:19.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.750+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v130'160 uv159 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.750+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a4c240 con 0x55c550a492e0 2024-09-12T02:06:19.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.751+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v130'161 uv161 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.751+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a4c740 con 0x55c550a492e0 2024-09-12T02:06:19.753 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:06:19.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.753+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v130'162 uv162 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.753+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a4d000 con 0x55c550a492e0 2024-09-12T02:06:19.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.755+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v130'163 uv163 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.755+0000 7fe0c021af40 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55c550a4d8b0 0x55c550a4fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.755+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a501e0 con 0x55c550a4d8b0 2024-09-12T02:06:19.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.755+0000 7fe0bd0a3640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55c550a4d8b0 0x55c550a4fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.756+0000 7fe0bd0a3640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55c550a4d8b0 0x55c550a4fca0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:19.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.758+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v130'213 uv212 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.758+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a502a0 con 0x55c550a4d8b0 2024-09-12T02:06:19.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.759+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v130'214 uv214 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.759+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a506c0 con 0x55c550a4d8b0 2024-09-12T02:06:19.760 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:06:19.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.760+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v130'215 uv215 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.760+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a516d0 con 0x55c550a4d8b0 2024-09-12T02:06:19.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.761+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v130'216 uv216 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.761+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a516d0 con 0x55c550a4d8b0 2024-09-12T02:06:19.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.763+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v130'217 uv217 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.763+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a506c0 con 0x55c550a4d8b0 2024-09-12T02:06:19.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.764+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v130'218 uv218 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.764+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a506c0 con 0x55c550a492e0 2024-09-12T02:06:19.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.765+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v130'393 uv387 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.765+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a50a60 con 0x55c550a492e0 2024-09-12T02:06:19.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.766+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v130'394 uv394 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.766+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a50e00 con 0x55c550a492e0 2024-09-12T02:06:19.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.767+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v130'395 uv395 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.768 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:06:19.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.767+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a521b0 con 0x55c550a492e0 2024-09-12T02:06:19.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.768+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v130'396 uv396 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.768+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a521b0 con 0x55c550a492e0 2024-09-12T02:06:19.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.769+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v130'397 uv397 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.769+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a511a0 con 0x55c550a492e0 2024-09-12T02:06:19.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.770+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v130'398 uv398 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.770+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a511a0 con 0x55c550a492e0 2024-09-12T02:06:19.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.771+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v130'399 uv392 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.771+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a511a0 con 0x55c550a492e0 2024-09-12T02:06:19.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.772+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v130'400 uv400 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.772+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a511a0 con 0x55c550a492e0 2024-09-12T02:06:19.774 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:06:19.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.774+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v130'401 uv401 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.774+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a511a0 con 0x55c550a492e0 2024-09-12T02:06:19.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.775+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v130'402 uv402 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.775+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a511a0 con 0x55c550a492e0 2024-09-12T02:06:19.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.776+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v130'403 uv403 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.776+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a511a0 con 0x55c550a492e0 2024-09-12T02:06:19.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.778+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v130'178 uv177 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.778+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a511a0 con 0x55c550a492e0 2024-09-12T02:06:19.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.779+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v130'179 uv179 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.779+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a511a0 con 0x55c550a492e0 2024-09-12T02:06:19.780 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:06:19.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.780+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v130'180 uv180 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.780+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a511a0 con 0x55c550a492e0 2024-09-12T02:06:19.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.781+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v130'181 uv181 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.781+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a511a0 con 0x55c550a492e0 2024-09-12T02:06:19.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.782+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v130'182 uv182 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe0b801a030 con 0x55c550a492e0 2024-09-12T02:06:19.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.782+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a511a0 con 0x55c550a4d8b0 2024-09-12T02:06:19.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.783+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v130'213 uv212 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.783+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a511a0 con 0x55c550a4d8b0 2024-09-12T02:06:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.785+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v130'214 uv214 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.785+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a511a0 con 0x55c550a4d8b0 2024-09-12T02:06:19.786 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:06:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.786+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v130'215 uv215 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.786+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a521f0 con 0x55c550a4d8b0 2024-09-12T02:06:19.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.788+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v130'216 uv216 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.788+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a521b0 con 0x55c550a4d8b0 2024-09-12T02:06:19.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.790+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v130'217 uv217 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.790+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a511a0 con 0x55c550a4d8b0 2024-09-12T02:06:19.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.791+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v130'218 uv218 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.791+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a511a0 con 0x55c550a4d8b0 2024-09-12T02:06:19.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.792+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v130'355 uv349 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.792+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a511a0 con 0x55c550a4d8b0 2024-09-12T02:06:19.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.793+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v130'356 uv356 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.793+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a511a0 con 0x55c550a4d8b0 2024-09-12T02:06:19.794 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:06:19.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.794+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v130'357 uv357 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.794+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a51240 con 0x55c550a4d8b0 2024-09-12T02:06:19.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.795+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v130'358 uv358 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.795+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a51240 con 0x55c550a4d8b0 2024-09-12T02:06:19.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.796+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v130'359 uv359 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.796+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a51240 con 0x55c550a4d8b0 2024-09-12T02:06:19.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.797+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v130'360 uv354 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.797+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a51240 con 0x55c550a4d8b0 2024-09-12T02:06:19.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.798+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v130'361 uv361 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.798+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a51240 con 0x55c550a4d8b0 2024-09-12T02:06:19.799 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:06:19.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.799+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v130'362 uv362 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.799+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a51240 con 0x55c550a4d8b0 2024-09-12T02:06:19.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.801+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v130'363 uv363 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.801+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a4cc40 con 0x55c550a4d8b0 2024-09-12T02:06:19.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.802+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v130'364 uv364 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.802+0000 7fe0c021af40 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55c550a518e0 0x55c550a54300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.802+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a54840 con 0x55c550a518e0 2024-09-12T02:06:19.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.802+0000 7fe0b7fff640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55c550a518e0 0x55c550a54300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.803+0000 7fe0b7fff640 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55c550a518e0 0x55c550a54300 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:19.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.804+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v130'157 uv155 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a518e0 2024-09-12T02:06:19.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.804+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a54840 con 0x55c550a518e0 2024-09-12T02:06:19.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.805+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v130'158 uv158 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a518e0 2024-09-12T02:06:19.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.805+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a54840 con 0x55c550a518e0 2024-09-12T02:06:19.808 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:06:19.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.808+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v130'159 uv159 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a518e0 2024-09-12T02:06:19.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.808+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a54840 con 0x55c550a518e0 2024-09-12T02:06:19.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.810+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v130'160 uv160 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a518e0 2024-09-12T02:06:19.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.810+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a54c30 con 0x55c550a4d8b0 2024-09-12T02:06:19.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.811+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v130'213 uv212 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.811+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a54c00 con 0x55c550a4d8b0 2024-09-12T02:06:19.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.812+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v130'214 uv214 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.812+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a54c00 con 0x55c550a4d8b0 2024-09-12T02:06:19.813 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:06:19.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.813+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v130'215 uv215 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.813+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a55c10 con 0x55c550a4d8b0 2024-09-12T02:06:19.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.814+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v130'216 uv216 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.814+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a55920 con 0x55c550a4d8b0 2024-09-12T02:06:19.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.815+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v130'217 uv217 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.815+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a54910 con 0x55c550a4d8b0 2024-09-12T02:06:19.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.816+0000 7fe0bd0a3640 1 -- 172.21.15.19:0/1512345341 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v130'218 uv218 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0b005b420 con 0x55c550a4d8b0 2024-09-12T02:06:19.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.816+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a548c0 con 0x55c550a460b0 2024-09-12T02:06:19.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.817+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v130'181 uv180 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a460b0 2024-09-12T02:06:19.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.817+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a548c0 con 0x55c550a460b0 2024-09-12T02:06:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.819+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v130'182 uv182 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a460b0 2024-09-12T02:06:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.819+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a548c0 con 0x55c550a460b0 2024-09-12T02:06:19.819 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:06:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.819+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v130'183 uv183 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a460b0 2024-09-12T02:06:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.819+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a548c0 con 0x55c550a460b0 2024-09-12T02:06:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.821+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v130'184 uv184 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a460b0 2024-09-12T02:06:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.821+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a548c0 con 0x55c550a460b0 2024-09-12T02:06:19.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.821+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v130'185 uv185 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a460b0 2024-09-12T02:06:19.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.821+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a548c0 con 0x55c550a460b0 2024-09-12T02:06:19.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.824+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v130'442 uv433 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a460b0 2024-09-12T02:06:19.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.824+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a54900 con 0x55c550a460b0 2024-09-12T02:06:19.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.825+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v130'443 uv443 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a460b0 2024-09-12T02:06:19.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.825+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a54d70 con 0x55c550a460b0 2024-09-12T02:06:19.826 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:06:19.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.826+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v130'444 uv444 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a460b0 2024-09-12T02:06:19.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.826+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a54d70 con 0x55c550a460b0 2024-09-12T02:06:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.828+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v130'445 uv445 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a460b0 2024-09-12T02:06:19.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.828+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a54d00 con 0x55c550a460b0 2024-09-12T02:06:19.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.830+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v130'446 uv446 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a460b0 2024-09-12T02:06:19.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.830+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a54cd0 con 0x55c550a460b0 2024-09-12T02:06:19.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.831+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v130'447 uv440 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a460b0 2024-09-12T02:06:19.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.831+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) -- 0x55c550a54cd0 con 0x55c550a460b0 2024-09-12T02:06:19.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.832+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v130'448 uv448 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a460b0 2024-09-12T02:06:19.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.832+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a54cd0 con 0x55c550a460b0 2024-09-12T02:06:19.834 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:06:19.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.833+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v130'449 uv449 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a460b0 2024-09-12T02:06:19.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.834+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a54cd0 con 0x55c550a460b0 2024-09-12T02:06:19.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.835+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v130'450 uv450 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a460b0 2024-09-12T02:06:19.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.835+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a54cd0 con 0x55c550a460b0 2024-09-12T02:06:19.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.836+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v130'451 uv451 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a460b0 2024-09-12T02:06:19.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.836+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a54cd0 con 0x55c550a460b0 2024-09-12T02:06:19.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.837+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v130'452 uv452 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a460b0 2024-09-12T02:06:19.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.837+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x55c550a55180 con 0x55c550a460b0 2024-09-12T02:06:19.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0b7fff640 1 -- 172.21.15.19:0/1512345341 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v130'453 uv453 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fe0a8029040 con 0x55c550a460b0 2024-09-12T02:06:19.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55c550a41800 msgr2=0x55c550a43bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55c550a41800 0x55c550a43bf0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55c55097c1b0 msgr2=0x55c550997a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55c55097c1b0 0x55c550997a90 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55c550a492e0 msgr2=0x55c550a4b6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55c550a492e0 0x55c550a4b6d0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55c550a518e0 msgr2=0x55c550a54300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55c550a518e0 0x55c550a54300 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c550a460b0 msgr2=0x55c550a484a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c550a460b0 0x55c550a484a0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 reap_dead start 2024-09-12T02:06:19.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55c550a4d8b0 msgr2=0x55c550a4fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55c550a4d8b0 0x55c550a4fca0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 reap_dead start 2024-09-12T02:06:19.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0bd8a4640 1 -- 172.21.15.19:0/1512345341 reap_dead start 2024-09-12T02:06:19.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe0a006a840 msgr2=0x7fe0a006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe0a006a840 0x7fe0a006cd00 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0066000 tx=0x7fe0b0053000 comp rx=0 tx=0).stop 2024-09-12T02:06:19.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c55097f080 msgr2=0x55c5508f4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c55097f080 0x55c5508f4680 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8004e70 tx=0x7fe0b8001a00 comp rx=0 tx=0).stop 2024-09-12T02:06:19.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 shutdown_connections 2024-09-12T02:06:19.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe0a006a840 0x7fe0a006cd00 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 --2- 172.21.15.19:0/1512345341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c55097f080 0x55c5508f4680 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 >> 172.21.15.19:0/1512345341 conn(0x55c5508c49e0 msgr2=0x55c5508c30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:19.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 shutdown_connections 2024-09-12T02:06:19.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.839+0000 7fe0c021af40 1 -- 172.21.15.19:0/1512345341 wait complete. 2024-09-12T02:06:19.843 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapheader mds0_openfiles.0 deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-09-12T02:06:19.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.928+0000 7f2d3afdcf40 1 Processor -- start 2024-09-12T02:06:19.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.928+0000 7f2d3afdcf40 1 -- start start 2024-09-12T02:06:19.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.928+0000 7f2d3afdcf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573458109e0 0x5573458e6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.928+0000 7f2d3afdcf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573458598e0 0x55734597a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.928+0000 7f2d3afdcf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573458e7fb0 0x55734597ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.928+0000 7f2d3afdcf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55734585a230 con 0x5573458109e0 2024-09-12T02:06:19.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.928+0000 7f2d3afdcf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557345762510 con 0x5573458598e0 2024-09-12T02:06:19.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.928+0000 7f2d3afdcf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x557345810f20 con 0x5573458e7fb0 2024-09-12T02:06:19.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.928+0000 7f2d38ad2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573458109e0 0x5573458e6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.928+0000 7f2d38ad2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573458109e0 0x5573458e6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37372/0 (socket says 172.21.15.19:37372) 2024-09-12T02:06:19.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.928+0000 7f2d38ad2640 1 -- 172.21.15.19:0/783904616 learned_addr learned my addr 172.21.15.19:0/783904616 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:19.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.929+0000 7f2d382d1640 1 --2- 172.21.15.19:0/783904616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573458598e0 0x55734597a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.929+0000 7f2d392d3640 1 --2- 172.21.15.19:0/783904616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573458e7fb0 0x55734597ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.929+0000 7f2d38ad2640 1 -- 172.21.15.19:0/783904616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573458e7fb0 msgr2=0x55734597ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:19.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.929+0000 7f2d38ad2640 1 --2- 172.21.15.19:0/783904616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573458e7fb0 0x55734597ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.929+0000 7f2d38ad2640 1 -- 172.21.15.19:0/783904616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573458598e0 msgr2=0x55734597a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:19.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.929+0000 7f2d38ad2640 1 --2- 172.21.15.19:0/783904616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573458598e0 0x55734597a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.929+0000 7f2d38ad2640 1 -- 172.21.15.19:0/783904616 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557345814550 con 0x5573458109e0 2024-09-12T02:06:19.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.929+0000 7f2d382d1640 1 --2- 172.21.15.19:0/783904616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573458598e0 0x55734597a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:19.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.929+0000 7f2d38ad2640 1 --2- 172.21.15.19:0/783904616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573458109e0 0x5573458e6fe0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800a590 tx=0x7f2d2800aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd12e6f953c2128 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:19.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.929+0000 7f2d372cf640 1 -- 172.21.15.19:0/783904616 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2800b980 con 0x5573458109e0 2024-09-12T02:06:19.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.929+0000 7f2d372cf640 1 -- 172.21.15.19:0/783904616 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d2800f070 con 0x5573458109e0 2024-09-12T02:06:19.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.929+0000 7f2d372cf640 1 -- 172.21.15.19:0/783904616 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2800bd80 con 0x5573458109e0 2024-09-12T02:06:19.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.930+0000 7f2d3afdcf40 1 -- 172.21.15.19:0/783904616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573458109e0 msgr2=0x5573458e6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.930+0000 7f2d3afdcf40 1 --2- 172.21.15.19:0/783904616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573458109e0 0x5573458e6fe0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800a590 tx=0x7f2d2800aa50 comp rx=0 tx=0).stop 2024-09-12T02:06:19.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.930+0000 7f2d3afdcf40 1 -- 172.21.15.19:0/783904616 shutdown_connections 2024-09-12T02:06:19.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.930+0000 7f2d3afdcf40 1 --2- 172.21.15.19:0/783904616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573458e7fb0 0x55734597ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.930+0000 7f2d3afdcf40 1 --2- 172.21.15.19:0/783904616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573458598e0 0x55734597a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.930+0000 7f2d3afdcf40 1 --2- 172.21.15.19:0/783904616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573458109e0 0x5573458e6fe0 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.930+0000 7f2d3afdcf40 1 -- 172.21.15.19:0/783904616 >> 172.21.15.19:0/783904616 conn(0x55734583e490 msgr2=0x557345813c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:19.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.930+0000 7f2d3afdcf40 1 -- 172.21.15.19:0/783904616 shutdown_connections 2024-09-12T02:06:19.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.930+0000 7f2d3afdcf40 1 -- 172.21.15.19:0/783904616 wait complete. 2024-09-12T02:06:19.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.930+0000 7f2d3afdcf40 1 Processor -- start 2024-09-12T02:06:19.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.930+0000 7f2d3afdcf40 1 -- start start 2024-09-12T02:06:19.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.931+0000 7f2d3afdcf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573458109e0 0x5573458d9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.931+0000 7f2d3afdcf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573458598e0 0x5573458db880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.931+0000 7f2d3afdcf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573458e7fb0 0x557345840330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.931+0000 7f2d3afdcf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5573458e67f0 con 0x5573458109e0 2024-09-12T02:06:19.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.931+0000 7f2d3afdcf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5573458e65a0 con 0x5573458e7fb0 2024-09-12T02:06:19.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.931+0000 7f2d3afdcf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55734583df80 con 0x5573458598e0 2024-09-12T02:06:19.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.931+0000 7f2d38ad2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573458109e0 0x5573458d9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.931+0000 7f2d38ad2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573458109e0 0x5573458d9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37382/0 (socket says 172.21.15.19:37382) 2024-09-12T02:06:19.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.931+0000 7f2d38ad2640 1 -- 172.21.15.19:0/878797280 learned_addr learned my addr 172.21.15.19:0/878797280 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:19.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.931+0000 7f2d382d1640 1 --2- 172.21.15.19:0/878797280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573458598e0 0x5573458db880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.931+0000 7f2d392d3640 1 --2- 172.21.15.19:0/878797280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573458e7fb0 0x557345840330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.931+0000 7f2d38ad2640 1 -- 172.21.15.19:0/878797280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573458598e0 msgr2=0x5573458db880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.931+0000 7f2d38ad2640 1 --2- 172.21.15.19:0/878797280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573458598e0 0x5573458db880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.931+0000 7f2d38ad2640 1 -- 172.21.15.19:0/878797280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573458e7fb0 msgr2=0x557345840330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.931+0000 7f2d38ad2640 1 --2- 172.21.15.19:0/878797280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573458e7fb0 0x557345840330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.931+0000 7f2d38ad2640 1 -- 172.21.15.19:0/878797280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573458d9f80 con 0x5573458109e0 2024-09-12T02:06:19.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.931+0000 7f2d382d1640 1 --2- 172.21.15.19:0/878797280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5573458598e0 0x5573458db880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:19.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.931+0000 7f2d392d3640 1 --2- 172.21.15.19:0/878797280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573458e7fb0 0x557345840330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:19.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.932+0000 7f2d38ad2640 1 --2- 172.21.15.19:0/878797280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573458109e0 0x5573458d9330 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x55734585c5f0 tx=0x7f2d28002fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:19.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.932+0000 7f2d362cd640 1 -- 172.21.15.19:0/878797280 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d28014a00 con 0x5573458109e0 2024-09-12T02:06:19.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.932+0000 7f2d362cd640 1 -- 172.21.15.19:0/878797280 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d28024070 con 0x5573458109e0 2024-09-12T02:06:19.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.932+0000 7f2d362cd640 1 -- 172.21.15.19:0/878797280 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d28014e00 con 0x5573458109e0 2024-09-12T02:06:19.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.932+0000 7f2d3afdcf40 1 -- 172.21.15.19:0/878797280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573458d9ca0 con 0x5573458109e0 2024-09-12T02:06:19.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.932+0000 7f2d3afdcf40 1 -- 172.21.15.19:0/878797280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573458dde20 con 0x5573458109e0 2024-09-12T02:06:19.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.933+0000 7f2d362cd640 1 -- 172.21.15.19:0/878797280 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d28029460 con 0x5573458109e0 2024-09-12T02:06:19.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.934+0000 7f2d362cd640 1 --2- 172.21.15.19:0/878797280 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2d2406a810 0x7f2d2406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.934+0000 7f2d362cd640 1 -- 172.21.15.19:0/878797280 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 9313+0+0 (secure 0 0 0) 0x7f2d2808c6c0 con 0x5573458109e0 2024-09-12T02:06:19.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.934+0000 7f2d3afdcf40 1 --2- 172.21.15.19:0/878797280 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5573458dd6c0 0x55734597edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:19.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.934+0000 7f2d3afdcf40 1 -- 172.21.15.19:0/878797280 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:1 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) -- 0x5573458582d0 con 0x5573458dd6c0 2024-09-12T02:06:19.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.934+0000 7f2d382d1640 1 --2- 172.21.15.19:0/878797280 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2d2406a810 0x7f2d2406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.934+0000 7f2d392d3640 1 --2- 172.21.15.19:0/878797280 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5573458dd6c0 0x55734597edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:19.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.935+0000 7f2d382d1640 1 --2- 172.21.15.19:0/878797280 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2d2406a810 0x7f2d2406ccd0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x5573458e42a0 tx=0x7f2d2c005810 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:19.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.935+0000 7f2d392d3640 1 --2- 172.21.15.19:0/878797280 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5573458dd6c0 0x55734597edf0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:19.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.937+0000 7f2d392d3640 1 -- 172.21.15.19:0/878797280 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(1 mds0_openfiles.0 [omap-set-header] v130'164 uv164 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f2d3004f980 con 0x5573458dd6c0 2024-09-12T02:06:19.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.937+0000 7f2d3afdcf40 1 -- 172.21.15.19:0/878797280 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5573458dd6c0 msgr2=0x55734597edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.937+0000 7f2d3afdcf40 1 --2- 172.21.15.19:0/878797280 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x5573458dd6c0 0x55734597edf0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.937+0000 7f2d3afdcf40 1 -- 172.21.15.19:0/878797280 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2d2406a810 msgr2=0x7f2d2406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.937+0000 7f2d3afdcf40 1 --2- 172.21.15.19:0/878797280 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2d2406a810 0x7f2d2406ccd0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x5573458e42a0 tx=0x7f2d2c005810 comp rx=0 tx=0).stop 2024-09-12T02:06:19.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.937+0000 7f2d3afdcf40 1 -- 172.21.15.19:0/878797280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573458109e0 msgr2=0x5573458d9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:19.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.937+0000 7f2d3afdcf40 1 --2- 172.21.15.19:0/878797280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5573458109e0 0x5573458d9330 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x55734585c5f0 tx=0x7f2d28002fd0 comp rx=0 tx=0).stop 2024-09-12T02:06:19.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.937+0000 7f2d392d3640 1 -- 172.21.15.19:0/878797280 reap_dead start 2024-09-12T02:06:19.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.937+0000 7f2d3afdcf40 1 -- 172.21.15.19:0/878797280 shutdown_connections 2024-09-12T02:06:19.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.937+0000 7f2d3afdcf40 1 -- 172.21.15.19:0/878797280 >> 172.21.15.19:0/878797280 conn(0x55734583e490 msgr2=0x5573458e6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:19.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.937+0000 7f2d3afdcf40 1 -- 172.21.15.19:0/878797280 shutdown_connections 2024-09-12T02:06:19.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:19.938+0000 7f2d3afdcf40 1 -- 172.21.15.19:0/878797280 wait complete. 2024-09-12T02:06:19.942 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:06:20.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.047+0000 7fd216986640 1 Processor -- start 2024-09-12T02:06:20.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.047+0000 7fd216986640 1 -- start start 2024-09-12T02:06:20.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.048+0000 7fd216986640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd21015c490 0x7fd21009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.048+0000 7fd216986640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd21009af70 0x7fd2100b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.048+0000 7fd216986640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd210072180 con 0x7fd2100b0a00 2024-09-12T02:06:20.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.048+0000 7fd216986640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd21009b3b0 con 0x7fd21009af70 2024-09-12T02:06:20.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.048+0000 7fd216986640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd21015c870 con 0x7fd21015c490 2024-09-12T02:06:20.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.048+0000 7fd20f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd21009af70 0x7fd2100b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.048+0000 7fd214f23640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd2100b0a00 0x7fd2100b0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56632/0 (socket says 172.21.15.19:56632) 2024-09-12T02:06:20.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.048+0000 7fd20f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd21009af70 0x7fd2100b04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37388/0 (socket says 172.21.15.19:37388) 2024-09-12T02:06:20.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.048+0000 7fd214f23640 1 -- 172.21.15.19:0/2483196245 learned_addr learned my addr 172.21.15.19:0/2483196245 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.048+0000 7fd20ffff640 1 --2- 172.21.15.19:0/2483196245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd21015c490 0x7fd21009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.048+0000 7fd20f7fe640 1 -- 172.21.15.19:0/2483196245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd21015c490 msgr2=0x7fd21009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.048+0000 7fd20f7fe640 1 --2- 172.21.15.19:0/2483196245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd21015c490 0x7fd21009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.048+0000 7fd20f7fe640 1 -- 172.21.15.19:0/2483196245 >> v1:172.21.15.19:6789/0 conn(0x7fd2100b0a00 legacy=0x7fd2100b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.048+0000 7fd20f7fe640 1 -- 172.21.15.19:0/2483196245 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd210071bc0 con 0x7fd21009af70 2024-09-12T02:06:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.048+0000 7fd20effd640 1 -- 172.21.15.19:0/2483196245 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3898554567 0 0) 0x7fd210072180 con 0x7fd2100b0a00 2024-09-12T02:06:20.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.049+0000 7fd20f7fe640 1 --2- 172.21.15.19:0/2483196245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd21009af70 0x7fd2100b04c0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7fd2040097a0 tx=0x7fd20402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7d9fabbb058992 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:20.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.049+0000 7fd20effd640 1 -- 172.21.15.19:0/2483196245 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204037070 con 0x7fd21009af70 2024-09-12T02:06:20.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.049+0000 7fd20effd640 1 -- 172.21.15.19:0/2483196245 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd204032440 con 0x7fd21009af70 2024-09-12T02:06:20.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.049+0000 7fd20effd640 1 -- 172.21.15.19:0/2483196245 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204032810 con 0x7fd21009af70 2024-09-12T02:06:20.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.050+0000 7fd216986640 1 -- 172.21.15.19:0/2483196245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd21009af70 msgr2=0x7fd2100b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:20.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.050+0000 7fd216986640 1 --2- 172.21.15.19:0/2483196245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd21009af70 0x7fd2100b04c0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7fd2040097a0 tx=0x7fd20402a180 comp rx=0 tx=0).stop 2024-09-12T02:06:20.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.050+0000 7fd216986640 1 -- 172.21.15.19:0/2483196245 shutdown_connections 2024-09-12T02:06:20.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.050+0000 7fd216986640 1 --2- 172.21.15.19:0/2483196245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd21009af70 0x7fd2100b04c0 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.050+0000 7fd216986640 1 --2- 172.21.15.19:0/2483196245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd21015c490 0x7fd21009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.050+0000 7fd216986640 1 -- 172.21.15.19:0/2483196245 >> 172.21.15.19:0/2483196245 conn(0x7fd2100b3f30 msgr2=0x7fd2100b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:20.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.050+0000 7fd216986640 1 -- 172.21.15.19:0/2483196245 shutdown_connections 2024-09-12T02:06:20.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.050+0000 7fd216986640 1 -- 172.21.15.19:0/2483196245 wait complete. 2024-09-12T02:06:20.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.051+0000 7fd216986640 1 Processor -- start 2024-09-12T02:06:20.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.051+0000 7fd216986640 1 -- start start 2024-09-12T02:06:20.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.052+0000 7fd216986640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd21009af70 0x7fd2101e4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.052+0000 7fd216986640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2100b0a00 0x7fd210145e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.052+0000 7fd216986640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd21015c490 0x7fd21014d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.052+0000 7fd216986640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd2100affa0 con 0x7fd2100b0a00 2024-09-12T02:06:20.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.052+0000 7fd216986640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd2100afcc0 con 0x7fd21015c490 2024-09-12T02:06:20.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.052+0000 7fd216986640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd21009b8f0 con 0x7fd21009af70 2024-09-12T02:06:20.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.052+0000 7fd20f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2100b0a00 0x7fd210145e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.052+0000 7fd20f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2100b0a00 0x7fd210145e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37394/0 (socket says 172.21.15.19:37394) 2024-09-12T02:06:20.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.052+0000 7fd20f7fe640 1 -- 172.21.15.19:0/1095014168 learned_addr learned my addr 172.21.15.19:0/1095014168 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:20.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.052+0000 7fd214f23640 1 --2- 172.21.15.19:0/1095014168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd21015c490 0x7fd21014d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.052+0000 7fd20f7fe640 1 -- 172.21.15.19:0/1095014168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd21009af70 msgr2=0x7fd2101e4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:20.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.052+0000 7fd20ffff640 1 --2- 172.21.15.19:0/1095014168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd21009af70 0x7fd2101e4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.052+0000 7fd20f7fe640 1 --2- 172.21.15.19:0/1095014168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd21009af70 0x7fd2101e4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.052+0000 7fd20f7fe640 1 -- 172.21.15.19:0/1095014168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd21015c490 msgr2=0x7fd21014d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:20.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.052+0000 7fd20f7fe640 1 --2- 172.21.15.19:0/1095014168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd21015c490 0x7fd21014d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.052+0000 7fd20f7fe640 1 -- 172.21.15.19:0/1095014168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd210158f60 con 0x7fd2100b0a00 2024-09-12T02:06:20.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.052+0000 7fd214f23640 1 --2- 172.21.15.19:0/1095014168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd21015c490 0x7fd21014d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:20.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.052+0000 7fd20ffff640 1 --2- 172.21.15.19:0/1095014168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd21009af70 0x7fd2101e4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:20.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.053+0000 7fd20f7fe640 1 --2- 172.21.15.19:0/1095014168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2100b0a00 0x7fd210145e00 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7fd2040097a0 tx=0x7fd2040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:20.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.053+0000 7fd20cff9640 1 -- 172.21.15.19:0/1095014168 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204037050 con 0x7fd2100b0a00 2024-09-12T02:06:20.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.053+0000 7fd20cff9640 1 -- 172.21.15.19:0/1095014168 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd204038040 con 0x7fd2100b0a00 2024-09-12T02:06:20.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.053+0000 7fd216986640 1 -- 172.21.15.19:0/1095014168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21015d620 con 0x7fd2100b0a00 2024-09-12T02:06:20.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.053+0000 7fd20cff9640 1 -- 172.21.15.19:0/1095014168 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204004470 con 0x7fd2100b0a00 2024-09-12T02:06:20.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.053+0000 7fd216986640 1 -- 172.21.15.19:0/1095014168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd21015dba0 con 0x7fd2100b0a00 2024-09-12T02:06:20.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.054+0000 7fd216986640 1 -- 172.21.15.19:0/1095014168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2100b04c0 con 0x7fd2100b0a00 2024-09-12T02:06:20.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.054+0000 7fd20cff9640 1 -- 172.21.15.19:0/1095014168 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd204030900 con 0x7fd2100b0a00 2024-09-12T02:06:20.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.055+0000 7fd20cff9640 1 --2- 172.21.15.19:0/1095014168 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd1fc06be30 0x7fd1fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.055+0000 7fd20cff9640 1 -- 172.21.15.19:0/1095014168 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 9313+0+0 (secure 0 0 0) 0x7fd2040ac7d0 con 0x7fd2100b0a00 2024-09-12T02:06:20.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.055+0000 7fd20ffff640 1 --2- 172.21.15.19:0/1095014168 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd1fc06be30 0x7fd1fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.056+0000 7fd20ffff640 1 --2- 172.21.15.19:0/1095014168 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd1fc06be30 0x7fd1fc06e2f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd200006fd0 tx=0x7fd200008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:20.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.059+0000 7fd20cff9640 1 -- 172.21.15.19:0/1095014168 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd20407a3a0 con 0x7fd2100b0a00 2024-09-12T02:06:20.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.271+0000 7fd216986640 1 -- 172.21.15.19:0/1095014168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fd210070470 con 0x7fd2100b0a00 2024-09-12T02:06:20.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.608+0000 7fd20cff9640 1 -- 172.21.15.19:0/1095014168 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v298) ==== 162+0+0 (secure 0 0 0) 0x7fd204079ca0 con 0x7fd2100b0a00 2024-09-12T02:06:20.609 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:06:20.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.611+0000 7fd216986640 1 -- 172.21.15.19:0/1095014168 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd1fc06be30 msgr2=0x7fd1fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:20.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.611+0000 7fd216986640 1 --2- 172.21.15.19:0/1095014168 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd1fc06be30 0x7fd1fc06e2f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd200006fd0 tx=0x7fd200008040 comp rx=0 tx=0).stop 2024-09-12T02:06:20.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.611+0000 7fd216986640 1 -- 172.21.15.19:0/1095014168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2100b0a00 msgr2=0x7fd210145e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:20.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.611+0000 7fd216986640 1 --2- 172.21.15.19:0/1095014168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2100b0a00 0x7fd210145e00 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7fd2040097a0 tx=0x7fd2040046c0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.611+0000 7fd216986640 1 -- 172.21.15.19:0/1095014168 shutdown_connections 2024-09-12T02:06:20.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.611+0000 7fd216986640 1 --2- 172.21.15.19:0/1095014168 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd1fc06be30 0x7fd1fc06e2f0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.611+0000 7fd216986640 1 --2- 172.21.15.19:0/1095014168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd21015c490 0x7fd21014d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.611+0000 7fd216986640 1 --2- 172.21.15.19:0/1095014168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2100b0a00 0x7fd210145e00 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.611+0000 7fd216986640 1 --2- 172.21.15.19:0/1095014168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd21009af70 0x7fd2101e4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.611+0000 7fd216986640 1 -- 172.21.15.19:0/1095014168 >> 172.21.15.19:0/1095014168 conn(0x7fd2100b3f30 msgr2=0x7fd2100b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.611+0000 7fd216986640 1 -- 172.21.15.19:0/1095014168 shutdown_connections 2024-09-12T02:06:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:20.611+0000 7fd216986640 1 -- 172.21.15.19:0/1095014168 wait complete. 2024-09-12T02:06:20.618 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:06:20.618+0000 7f6cf7bd4640 -1 mds.0.openfiles _load_finish: corrupted header/values: End of buffer [buffer:2] 2024-09-12T02:06:21.028 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.135+0000 7f0f2aec9640 1 Processor -- start 2024-09-12T02:06:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.135+0000 7f0f2aec9640 1 -- start start 2024-09-12T02:06:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.136+0000 7f0f2aec9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f240d30f0 0x7f0f240b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.136+0000 7f0f2aec9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f240d3690 con 0x7f0f240b64c0 2024-09-12T02:06:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.136+0000 7f0f2aec9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f240d3970 con 0x7f0f2415e5f0 2024-09-12T02:06:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.136+0000 7f0f2aec9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0f2406d530 con 0x7f0f240d30f0 2024-09-12T02:06:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.136+0000 7f0f29466640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0f240b64c0 0x7f0f2406d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36646/0 (socket says 172.21.15.19:36646) 2024-09-12T02:06:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.136+0000 7f0f29466640 1 -- 172.21.15.19:0/1435621351 learned_addr learned my addr 172.21.15.19:0/1435621351 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f23fff640 1 --2- 172.21.15.19:0/1435621351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f240d30f0 0x7f0f240b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f237fe640 1 -- 172.21.15.19:0/1435621351 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2651181670 0 0) 0x7f0f240d3690 con 0x7f0f240b64c0 2024-09-12T02:06:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f237fe640 1 -- 172.21.15.19:0/1435621351 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f14003520 con 0x7f0f240b64c0 2024-09-12T02:06:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f237fe640 1 -- 172.21.15.19:0/1435621351 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1907753456 0 0) 0x7f0f14003520 con 0x7f0f240b64c0 2024-09-12T02:06:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f237fe640 1 -- 172.21.15.19:0/1435621351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f240d30f0 msgr2=0x7f0f240b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f237fe640 1 --2- 172.21.15.19:0/1435621351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f240d30f0 0x7f0f240b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f237fe640 1 -- 172.21.15.19:0/1435621351 >> v1:172.21.15.135:6789/0 conn(0x7f0f2415e5f0 legacy=0x7f0f240d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f237fe640 1 -- 172.21.15.19:0/1435621351 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2406cee0 con 0x7f0f240b64c0 2024-09-12T02:06:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f237fe640 1 -- 172.21.15.19:0/1435621351 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f0f1c0019f0 con 0x7f0f240b64c0 2024-09-12T02:06:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f237fe640 1 -- 172.21.15.19:0/1435621351 >> v1:172.21.15.19:6789/0 conn(0x7f0f240b64c0 legacy=0x7f0f2406d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f237fe640 1 --2- 172.21.15.19:0/1435621351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f140039e0 0x7f0f14003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f237fe640 1 --2- 172.21.15.19:0/1435621351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f240d30f0 0x7f0f14004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f237fe640 1 --2- 172.21.15.19:0/1435621351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f14004d40 0x7f0f140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f237fe640 1 -- 172.21.15.19:0/1435621351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2406d530 con 0x7f0f14004d40 2024-09-12T02:06:21.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f237fe640 1 -- 172.21.15.19:0/1435621351 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1400bb50 con 0x7f0f140039e0 2024-09-12T02:06:21.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f237fe640 1 -- 172.21.15.19:0/1435621351 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0f1400bd20 con 0x7f0f240d30f0 2024-09-12T02:06:21.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f29466640 1 --2- 172.21.15.19:0/1435621351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f14004d40 0x7f0f140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f23fff640 1 --2- 172.21.15.19:0/1435621351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f240d30f0 0x7f0f14004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f29466640 1 -- 172.21.15.19:0/1435621351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f240d30f0 msgr2=0x7f0f14004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:21.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f29466640 1 --2- 172.21.15.19:0/1435621351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f240d30f0 0x7f0f14004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f29466640 1 -- 172.21.15.19:0/1435621351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f140039e0 msgr2=0x7f0f14003e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:06:21.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f29466640 1 --2- 172.21.15.19:0/1435621351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f140039e0 0x7f0f14003e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.137+0000 7f0f29466640 1 -- 172.21.15.19:0/1435621351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f14003520 con 0x7f0f14004d40 2024-09-12T02:06:21.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.138+0000 7f0f29466640 1 --2- 172.21.15.19:0/1435621351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f14004d40 0x7f0f140051c0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00a880 tx=0x7f0f14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9976840b81d676c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:21.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.138+0000 7f0f237fe640 1 -- 172.21.15.19:0/1435621351 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c00a4a0 con 0x7f0f14004d40 2024-09-12T02:06:21.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.138+0000 7f0f237fe640 1 -- 172.21.15.19:0/1435621351 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f1c02f070 con 0x7f0f14004d40 2024-09-12T02:06:21.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.138+0000 7f0f237fe640 1 -- 172.21.15.19:0/1435621351 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c02bcc0 con 0x7f0f14004d40 2024-09-12T02:06:21.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.139+0000 7f0f2aec9640 1 -- 172.21.15.19:0/1435621351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f14004d40 msgr2=0x7f0f140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:21.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.139+0000 7f0f2aec9640 1 --2- 172.21.15.19:0/1435621351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f14004d40 0x7f0f140051c0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00a880 tx=0x7f0f14005830 comp rx=0 tx=0).stop 2024-09-12T02:06:21.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.139+0000 7f0f29466640 1 -- 172.21.15.19:0/1435621351 reap_dead start 2024-09-12T02:06:21.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.139+0000 7f0f2aec9640 1 -- 172.21.15.19:0/1435621351 shutdown_connections 2024-09-12T02:06:21.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.139+0000 7f0f2aec9640 1 -- 172.21.15.19:0/1435621351 >> 172.21.15.19:0/1435621351 conn(0x7f0f2408bfc0 msgr2=0x7f0f240d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.139+0000 7f0f2aec9640 1 -- 172.21.15.19:0/1435621351 shutdown_connections 2024-09-12T02:06:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.139+0000 7f0f2aec9640 1 -- 172.21.15.19:0/1435621351 wait complete. 2024-09-12T02:06:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.140+0000 7f0f2aec9640 1 Processor -- start 2024-09-12T02:06:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.140+0000 7f0f2aec9640 1 -- start start 2024-09-12T02:06:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.141+0000 7f0f2aec9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f24155cd0 0x7f0f241f7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.141+0000 7f0f2aec9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f240ccd40 0x7f0f240b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.141+0000 7f0f2aec9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f240b9ef0 0x7f0f240cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.141+0000 7f0f2aec9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0f240b5f80 con 0x7f0f240ccd40 2024-09-12T02:06:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.141+0000 7f0f2aec9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2415e9d0 con 0x7f0f24155cd0 2024-09-12T02:06:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.141+0000 7f0f2aec9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0f240b6100 con 0x7f0f240b9ef0 2024-09-12T02:06:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.141+0000 7f0f23fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f240ccd40 0x7f0f240b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.141+0000 7f0f23fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f240ccd40 0x7f0f240b99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40724/0 (socket says 172.21.15.19:40724) 2024-09-12T02:06:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.141+0000 7f0f23fff640 1 -- 172.21.15.19:0/2030644858 learned_addr learned my addr 172.21.15.19:0/2030644858 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.141+0000 7f0f29466640 1 --2- 172.21.15.19:0/2030644858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f240b9ef0 0x7f0f240cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.141+0000 7f0f28c65640 1 --2- 172.21.15.19:0/2030644858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f24155cd0 0x7f0f241f7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.141+0000 7f0f23fff640 1 -- 172.21.15.19:0/2030644858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f240b9ef0 msgr2=0x7f0f240cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.141+0000 7f0f23fff640 1 --2- 172.21.15.19:0/2030644858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f240b9ef0 0x7f0f240cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.141+0000 7f0f23fff640 1 -- 172.21.15.19:0/2030644858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f24155cd0 msgr2=0x7f0f241f7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.141+0000 7f0f23fff640 1 --2- 172.21.15.19:0/2030644858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f24155cd0 0x7f0f241f7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.141+0000 7f0f23fff640 1 -- 172.21.15.19:0/2030644858 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f241f7d50 con 0x7f0f240ccd40 2024-09-12T02:06:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.141+0000 7f0f28c65640 1 --2- 172.21.15.19:0/2030644858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f24155cd0 0x7f0f241f7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.142+0000 7f0f23fff640 1 --2- 172.21.15.19:0/2030644858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f240ccd40 0x7f0f240b99b0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f0f10010840 tx=0x7f0f10010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.142+0000 7f0f217fa640 1 -- 172.21.15.19:0/2030644858 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1001a020 con 0x7f0f240ccd40 2024-09-12T02:06:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.142+0000 7f0f217fa640 1 -- 172.21.15.19:0/2030644858 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f1000e960 con 0x7f0f240ccd40 2024-09-12T02:06:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.142+0000 7f0f2aec9640 1 -- 172.21.15.19:0/2030644858 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f241f8030 con 0x7f0f240ccd40 2024-09-12T02:06:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.142+0000 7f0f217fa640 1 -- 172.21.15.19:0/2030644858 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1000ed10 con 0x7f0f240ccd40 2024-09-12T02:06:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.142+0000 7f0f2aec9640 1 -- 172.21.15.19:0/2030644858 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f241f85f0 con 0x7f0f240ccd40 2024-09-12T02:06:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.143+0000 7f0f2aec9640 1 -- 172.21.15.19:0/2030644858 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f240d4dd0 con 0x7f0f240ccd40 2024-09-12T02:06:21.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.143+0000 7f0f217fa640 1 -- 172.21.15.19:0/2030644858 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f1001d020 con 0x7f0f240ccd40 2024-09-12T02:06:21.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.144+0000 7f0f217fa640 1 --2- 172.21.15.19:0/2030644858 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0f0806be30 0x7f0f0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.144+0000 7f0f217fa640 1 -- 172.21.15.19:0/2030644858 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 9313+0+0 (secure 0 0 0) 0x7f0f1008c6b0 con 0x7f0f240ccd40 2024-09-12T02:06:21.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.144+0000 7f0f28c65640 1 --2- 172.21.15.19:0/2030644858 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0f0806be30 0x7f0f0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.145+0000 7f0f28c65640 1 --2- 172.21.15.19:0/2030644858 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0f0806be30 0x7f0f0806e2f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0f18001680 tx=0x7f0f18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:21.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.148+0000 7f0f217fa640 1 -- 172.21.15.19:0/2030644858 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f10024020 con 0x7f0f240ccd40 2024-09-12T02:06:21.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.358+0000 7f0f2aec9640 1 -- 172.21.15.19:0/2030644858 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f240cea20 con 0x7f0f240ccd40 2024-09-12T02:06:21.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.358+0000 7f0f217fa640 1 -- 172.21.15.19:0/2030644858 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 299 v299) ==== 95+0+5230 (secure 0 0 0) 0x7f0f1005a190 con 0x7f0f240ccd40 2024-09-12T02:06:21.359 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:21.359 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":299,"btime":"2024-09-12T02:06:20:611727+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":299,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:20.611715+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":130,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10215":{"gid":10215,"name":"c","rank":0,"incarnation":299,"state":"up:replay","state_seq":1,"addr":"172.21.15.19:6834/3083563091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3083563091},{"type":"v1","addr":"172.21.15.19:6834","nonce":3083563091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:21.359 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 299 2024-09-12T02:06:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.360+0000 7f0f2aec9640 1 -- 172.21.15.19:0/2030644858 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0f0806be30 msgr2=0x7f0f0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.360+0000 7f0f2aec9640 1 --2- 172.21.15.19:0/2030644858 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0f0806be30 0x7f0f0806e2f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0f18001680 tx=0x7f0f18009040 comp rx=0 tx=0).stop 2024-09-12T02:06:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.360+0000 7f0f2aec9640 1 -- 172.21.15.19:0/2030644858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f240ccd40 msgr2=0x7f0f240b99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.360+0000 7f0f2aec9640 1 --2- 172.21.15.19:0/2030644858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f240ccd40 0x7f0f240b99b0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f0f10010840 tx=0x7f0f10010d00 comp rx=0 tx=0).stop 2024-09-12T02:06:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.360+0000 7f0f2aec9640 1 -- 172.21.15.19:0/2030644858 shutdown_connections 2024-09-12T02:06:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.360+0000 7f0f2aec9640 1 --2- 172.21.15.19:0/2030644858 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0f0806be30 0x7f0f0806e2f0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.360+0000 7f0f2aec9640 1 --2- 172.21.15.19:0/2030644858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f240b9ef0 0x7f0f240cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.360+0000 7f0f2aec9640 1 --2- 172.21.15.19:0/2030644858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f240ccd40 0x7f0f240b99b0 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.360+0000 7f0f2aec9640 1 --2- 172.21.15.19:0/2030644858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f24155cd0 0x7f0f241f7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.360+0000 7f0f2aec9640 1 -- 172.21.15.19:0/2030644858 >> 172.21.15.19:0/2030644858 conn(0x7f0f2408bfc0 msgr2=0x7f0f240b4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.360+0000 7f0f2aec9640 1 -- 172.21.15.19:0/2030644858 shutdown_connections 2024-09-12T02:06:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:21.360+0000 7f0f2aec9640 1 -- 172.21.15.19:0/2030644858 wait complete. 2024-09-12T02:06:21.372 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 299, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:06:20.611715+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 130, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10215}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10215': {'gid': 10215, 'name': 'c', 'rank': 0, 'incarnation': 299, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.19:6834/3083563091', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 3083563091}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 3083563091}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:06:21.372 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10215:up:replay 2024-09-12T02:06:21.372 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-12T02:06:24.607 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:06:24.606+0000 7f6cfbbdc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:06:26.204 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:06:26.207 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:06:26.776 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.892+0000 7fdcb4fa6640 1 Processor -- start 2024-09-12T02:06:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.892+0000 7fdcb4fa6640 1 -- start start 2024-09-12T02:06:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.893+0000 7fdcb4fa6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdcb015c490 0x7fdcb009b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.893+0000 7fdcb4fa6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcb00d01c0 con 0x7fdcb015cf80 2024-09-12T02:06:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.893+0000 7fdcb4fa6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcb00d04a0 con 0x7fdcb009b980 2024-09-12T02:06:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.893+0000 7fdcb4fa6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fdcb00cff70 con 0x7fdcb015c490 2024-09-12T02:06:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.893+0000 7fdcae59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdcb015c490 0x7fdcb009b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.893+0000 7fdcae59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdcb015c490 0x7fdcb009b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40726/0 (socket says 172.21.15.19:40726) 2024-09-12T02:06:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.893+0000 7fdcaed9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdcb015cf80 0x7fdcb00ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36650/0 (socket says 172.21.15.19:36650) 2024-09-12T02:06:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.893+0000 7fdcae59c640 1 -- 172.21.15.19:0/1691495921 learned_addr learned my addr 172.21.15.19:0/1691495921 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.894+0000 7fdcae59c640 1 -- 172.21.15.19:0/1691495921 >> v1:172.21.15.135:6789/0 conn(0x7fdcb009b980 legacy=0x7fdcb015c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.894+0000 7fdcae59c640 1 -- 172.21.15.19:0/1691495921 >> v1:172.21.15.19:6789/0 conn(0x7fdcb015cf80 legacy=0x7fdcb00ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:26.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.894+0000 7fdcae59c640 1 -- 172.21.15.19:0/1691495921 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb00d0780 con 0x7fdcb015c490 2024-09-12T02:06:26.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.894+0000 7fdcad59a640 1 -- 172.21.15.19:0/1691495921 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4093141120 0 0) 0x7fdcb00d01c0 con 0x7fdcb015cf80 2024-09-12T02:06:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.894+0000 7fdcae59c640 1 --2- 172.21.15.19:0/1691495921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcb015c490 0x7fdcb009b440 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009870 tx=0x7fdca002a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388a0cc37c70784e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.895+0000 7fdcad59a640 1 -- 172.21.15.19:0/1691495921 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca0037070 con 0x7fdcb015c490 2024-09-12T02:06:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.895+0000 7fdcad59a640 1 -- 172.21.15.19:0/1691495921 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca0032640 con 0x7fdcb015c490 2024-09-12T02:06:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.895+0000 7fdcad59a640 1 -- 172.21.15.19:0/1691495921 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca0032a10 con 0x7fdcb015c490 2024-09-12T02:06:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.895+0000 7fdcb4fa6640 1 -- 172.21.15.19:0/1691495921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcb015c490 msgr2=0x7fdcb009b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.895+0000 7fdcb4fa6640 1 --2- 172.21.15.19:0/1691495921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcb015c490 0x7fdcb009b440 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009870 tx=0x7fdca002a330 comp rx=0 tx=0).stop 2024-09-12T02:06:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.895+0000 7fdcb4fa6640 1 -- 172.21.15.19:0/1691495921 shutdown_connections 2024-09-12T02:06:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.895+0000 7fdcb4fa6640 1 --2- 172.21.15.19:0/1691495921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcb015c490 0x7fdcb009b440 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.895+0000 7fdcb4fa6640 1 -- 172.21.15.19:0/1691495921 >> 172.21.15.19:0/1691495921 conn(0x7fdcb00d23a0 msgr2=0x7fdcb00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.895+0000 7fdcb4fa6640 1 -- 172.21.15.19:0/1691495921 shutdown_connections 2024-09-12T02:06:26.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.895+0000 7fdcb4fa6640 1 -- 172.21.15.19:0/1691495921 wait complete. 2024-09-12T02:06:26.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.897+0000 7fdcb4fa6640 1 Processor -- start 2024-09-12T02:06:26.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.897+0000 7fdcb4fa6640 1 -- start start 2024-09-12T02:06:26.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.897+0000 7fdcb4fa6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcb009b980 0x7fdcb01f5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:26.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.897+0000 7fdcb4fa6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcb015c490 0x7fdcb006def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:26.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.897+0000 7fdcb4fa6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdcb015cf80 0x7fdcb006e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:26.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.897+0000 7fdcb4fa6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb00d1260 con 0x7fdcb015c490 2024-09-12T02:06:26.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.897+0000 7fdcb4fa6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb00d0dd0 con 0x7fdcb009b980 2024-09-12T02:06:26.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.897+0000 7fdcb4fa6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdcb006e970 con 0x7fdcb015cf80 2024-09-12T02:06:26.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.898+0000 7fdcadd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcb015c490 0x7fdcb006def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:26.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.898+0000 7fdcadd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcb015c490 0x7fdcb006def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40736/0 (socket says 172.21.15.19:40736) 2024-09-12T02:06:26.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.898+0000 7fdcadd9b640 1 -- 172.21.15.19:0/1814962005 learned_addr learned my addr 172.21.15.19:0/1814962005 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:26.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.898+0000 7fdcae59c640 1 --2- 172.21.15.19:0/1814962005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcb009b980 0x7fdcb01f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:26.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.898+0000 7fdcaed9d640 1 --2- 172.21.15.19:0/1814962005 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdcb015cf80 0x7fdcb006e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:26.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.898+0000 7fdcadd9b640 1 -- 172.21.15.19:0/1814962005 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdcb015cf80 msgr2=0x7fdcb006e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:26.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.898+0000 7fdcadd9b640 1 --2- 172.21.15.19:0/1814962005 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdcb015cf80 0x7fdcb006e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:26.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.898+0000 7fdcadd9b640 1 -- 172.21.15.19:0/1814962005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcb009b980 msgr2=0x7fdcb01f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:26.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.898+0000 7fdcadd9b640 1 --2- 172.21.15.19:0/1814962005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcb009b980 0x7fdcb01f5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:26.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.898+0000 7fdcadd9b640 1 -- 172.21.15.19:0/1814962005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb006ce50 con 0x7fdcb015c490 2024-09-12T02:06:26.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.898+0000 7fdcaed9d640 1 --2- 172.21.15.19:0/1814962005 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdcb015cf80 0x7fdcb006e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:26.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.898+0000 7fdcadd9b640 1 --2- 172.21.15.19:0/1814962005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcb015c490 0x7fdcb006def0 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7fdca400c460 tx=0x7fdca400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:26.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.898+0000 7fdc9effd640 1 -- 172.21.15.19:0/1814962005 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca4016020 con 0x7fdcb015c490 2024-09-12T02:06:26.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.898+0000 7fdc9effd640 1 -- 172.21.15.19:0/1814962005 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca4012870 con 0x7fdcb015c490 2024-09-12T02:06:26.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.898+0000 7fdcb4fa6640 1 -- 172.21.15.19:0/1814962005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcb006d130 con 0x7fdcb015c490 2024-09-12T02:06:26.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.898+0000 7fdc9effd640 1 -- 172.21.15.19:0/1814962005 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca4012c60 con 0x7fdcb015c490 2024-09-12T02:06:26.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.898+0000 7fdcb4fa6640 1 -- 172.21.15.19:0/1814962005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcb006d6f0 con 0x7fdcb015c490 2024-09-12T02:06:26.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.899+0000 7fdcb4fa6640 1 -- 172.21.15.19:0/1814962005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcb00d01c0 con 0x7fdcb015c490 2024-09-12T02:06:26.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.900+0000 7fdc9effd640 1 -- 172.21.15.19:0/1814962005 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdca4019020 con 0x7fdcb015c490 2024-09-12T02:06:26.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.900+0000 7fdc9effd640 1 --2- 172.21.15.19:0/1814962005 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdc9006be30 0x7fdc9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:26.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.901+0000 7fdc9effd640 1 -- 172.21.15.19:0/1814962005 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 9313+0+0 (secure 0 0 0) 0x7fdca408b8d0 con 0x7fdcb015c490 2024-09-12T02:06:26.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.901+0000 7fdcae59c640 1 --2- 172.21.15.19:0/1814962005 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdc9006be30 0x7fdc9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:26.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.901+0000 7fdcae59c640 1 --2- 172.21.15.19:0/1814962005 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdc9006be30 0x7fdc9006e2f0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fdca0034000 tx=0x7fdca002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:26.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:26.905+0000 7fdc9effd640 1 -- 172.21.15.19:0/1814962005 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdca4020030 con 0x7fdcb015c490 2024-09-12T02:06:27.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.114+0000 7fdcb4fa6640 1 -- 172.21.15.19:0/1814962005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdcb00d3190 con 0x7fdcb015c490 2024-09-12T02:06:27.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.115+0000 7fdc9effd640 1 -- 172.21.15.19:0/1814962005 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 302 v302) ==== 95+0+5239 (secure 0 0 0) 0x7fdca40594a0 con 0x7fdcb015c490 2024-09-12T02:06:27.115 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:27.115 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":302,"btime":"2024-09-12T02:06:23:627738+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":302,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:23.627732+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":130,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10215":{"gid":10215,"name":"c","rank":0,"incarnation":299,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6834/3083563091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3083563091},{"type":"v1","addr":"172.21.15.19:6834","nonce":3083563091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10215,"qdb_cluster":[10215]},"id":6}]} 2024-09-12T02:06:27.116 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 302 2024-09-12T02:06:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.117+0000 7fdcb4fa6640 1 -- 172.21.15.19:0/1814962005 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdc9006be30 msgr2=0x7fdc9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.117+0000 7fdcb4fa6640 1 --2- 172.21.15.19:0/1814962005 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdc9006be30 0x7fdc9006e2f0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fdca0034000 tx=0x7fdca002e000 comp rx=0 tx=0).stop 2024-09-12T02:06:27.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.117+0000 7fdcb4fa6640 1 -- 172.21.15.19:0/1814962005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcb015c490 msgr2=0x7fdcb006def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.117+0000 7fdcb4fa6640 1 --2- 172.21.15.19:0/1814962005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcb015c490 0x7fdcb006def0 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7fdca400c460 tx=0x7fdca400c920 comp rx=0 tx=0).stop 2024-09-12T02:06:27.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.117+0000 7fdcb4fa6640 1 -- 172.21.15.19:0/1814962005 shutdown_connections 2024-09-12T02:06:27.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.117+0000 7fdcb4fa6640 1 --2- 172.21.15.19:0/1814962005 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdc9006be30 0x7fdc9006e2f0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.117+0000 7fdcb4fa6640 1 --2- 172.21.15.19:0/1814962005 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdcb015cf80 0x7fdcb006e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.117+0000 7fdcb4fa6640 1 --2- 172.21.15.19:0/1814962005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcb015c490 0x7fdcb006def0 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.117+0000 7fdcb4fa6640 1 --2- 172.21.15.19:0/1814962005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcb009b980 0x7fdcb01f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.117+0000 7fdcb4fa6640 1 -- 172.21.15.19:0/1814962005 >> 172.21.15.19:0/1814962005 conn(0x7fdcb00d23a0 msgr2=0x7fdcb00ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:27.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.117+0000 7fdcb4fa6640 1 -- 172.21.15.19:0/1814962005 shutdown_connections 2024-09-12T02:06:27.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.117+0000 7fdcb4fa6640 1 -- 172.21.15.19:0/1814962005 wait complete. 2024-09-12T02:06:27.128 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 302, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:02:11.686429+0000', 'modified': '2024-09-12T02:06:23.627732+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 130, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10215}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10215': {'gid': 10215, 'name': 'c', 'rank': 0, 'incarnation': 299, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.19:6834/3083563091', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 3083563091}, {'type': 'v1', 'addr': '172.21.15.19:6834', 'nonce': 3083563091}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10215, 'qdb_cluster': [10215]} 2024-09-12T02:06:27.128 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:06:27.129 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T02:06:27.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.231+0000 7fcea7eba640 1 Processor -- start 2024-09-12T02:06:27.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.231+0000 7fcea7eba640 1 -- start start 2024-09-12T02:06:27.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.232+0000 7fcea7eba640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcea015e5f0 0x7fcea00d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.232+0000 7fcea7eba640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcea00d30f0 0x7fcea00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.232+0000 7fcea7eba640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcea00d3690 con 0x7fcea00b64c0 2024-09-12T02:06:27.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.232+0000 7fcea7eba640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fcea006d530 con 0x7fcea015e5f0 2024-09-12T02:06:27.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.232+0000 7fcea7eba640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fcea00d3970 con 0x7fcea00d30f0 2024-09-12T02:06:27.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.232+0000 7fcea5c56640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcea015e5f0 0x7fcea00d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.232+0000 7fcea5c56640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcea015e5f0 0x7fcea00d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40742/0 (socket says 172.21.15.19:40742) 2024-09-12T02:06:27.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.232+0000 7fcea6457640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcea00b64c0 0x7fcea00cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36662/0 (socket says 172.21.15.19:36662) 2024-09-12T02:06:27.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.232+0000 7fcea5c56640 1 -- 172.21.15.19:0/745786205 learned_addr learned my addr 172.21.15.19:0/745786205 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:27.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.232+0000 7fcea5455640 1 --2- 172.21.15.19:0/745786205 >> v2:172.21.15.135:3300/0 conn(0x7fcea00d30f0 0x7fcea00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.232+0000 7fcea5c56640 1 -- 172.21.15.19:0/745786205 >> v2:172.21.15.135:3300/0 conn(0x7fcea00d30f0 msgr2=0x7fcea00b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:27.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.232+0000 7fcea5c56640 1 --2- 172.21.15.19:0/745786205 >> v2:172.21.15.135:3300/0 conn(0x7fcea00d30f0 0x7fcea00b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.232+0000 7fcea5c56640 1 -- 172.21.15.19:0/745786205 >> v1:172.21.15.19:6789/0 conn(0x7fcea00b64c0 legacy=0x7fcea00cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.232+0000 7fcea5c56640 1 -- 172.21.15.19:0/745786205 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea006cee0 con 0x7fcea015e5f0 2024-09-12T02:06:27.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.232+0000 7fcea5455640 1 --2- 172.21.15.19:0/745786205 >> v2:172.21.15.135:3300/0 conn(0x7fcea00d30f0 0x7fcea00b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:27.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.232+0000 7fcea4c54640 1 -- 172.21.15.19:0/745786205 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1520256516 0 0) 0x7fcea00d3690 con 0x7fcea00b64c0 2024-09-12T02:06:27.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.233+0000 7fcea5c56640 1 --2- 172.21.15.19:0/745786205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcea015e5f0 0x7fcea00d4dd0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7fcea008e520 tx=0x7fce9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fbb88eae347a032 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:27.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.233+0000 7fcea4c54640 1 -- 172.21.15.19:0/745786205 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c037070 con 0x7fcea015e5f0 2024-09-12T02:06:27.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.233+0000 7fcea4c54640 1 -- 172.21.15.19:0/745786205 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce9c032440 con 0x7fcea015e5f0 2024-09-12T02:06:27.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.233+0000 7fcea4c54640 1 -- 172.21.15.19:0/745786205 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c032810 con 0x7fcea015e5f0 2024-09-12T02:06:27.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.234+0000 7fcea7eba640 1 -- 172.21.15.19:0/745786205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcea015e5f0 msgr2=0x7fcea00d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.234+0000 7fcea7eba640 1 --2- 172.21.15.19:0/745786205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcea015e5f0 0x7fcea00d4dd0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7fcea008e520 tx=0x7fce9c02a270 comp rx=0 tx=0).stop 2024-09-12T02:06:27.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.234+0000 7fcea7eba640 1 -- 172.21.15.19:0/745786205 shutdown_connections 2024-09-12T02:06:27.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.234+0000 7fcea7eba640 1 --2- 172.21.15.19:0/745786205 >> v2:172.21.15.135:3300/0 conn(0x7fcea00d30f0 0x7fcea00b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.234+0000 7fcea7eba640 1 --2- 172.21.15.19:0/745786205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcea015e5f0 0x7fcea00d4dd0 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.234+0000 7fcea7eba640 1 -- 172.21.15.19:0/745786205 >> 172.21.15.19:0/745786205 conn(0x7fcea008bfc0 msgr2=0x7fcea00d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:27.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.234+0000 7fcea7eba640 1 -- 172.21.15.19:0/745786205 shutdown_connections 2024-09-12T02:06:27.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.234+0000 7fcea7eba640 1 -- 172.21.15.19:0/745786205 wait complete. 2024-09-12T02:06:27.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.235+0000 7fcea7eba640 1 Processor -- start 2024-09-12T02:06:27.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.235+0000 7fcea7eba640 1 -- start start 2024-09-12T02:06:27.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fcea7eba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcea00b64c0 0x7fcea00a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fcea7eba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcea00d30f0 0x7fcea015b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fcea7eba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcea015e5f0 0x7fcea015ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fcea7eba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcea00d5310 con 0x7fcea00b64c0 2024-09-12T02:06:27.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fcea7eba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcea015e9d0 con 0x7fcea00d30f0 2024-09-12T02:06:27.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fcea7eba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcea006e9d0 con 0x7fcea015e5f0 2024-09-12T02:06:27.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fcea5c56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcea00b64c0 0x7fcea00a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fcea5c56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcea00b64c0 0x7fcea00a1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40754/0 (socket says 172.21.15.19:40754) 2024-09-12T02:06:27.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fcea5c56640 1 -- 172.21.15.19:0/443295296 learned_addr learned my addr 172.21.15.19:0/443295296 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:27.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fcea5455640 1 --2- 172.21.15.19:0/443295296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcea00d30f0 0x7fcea015b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fcea6457640 1 --2- 172.21.15.19:0/443295296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcea015e5f0 0x7fcea015ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fcea5c56640 1 -- 172.21.15.19:0/443295296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcea015e5f0 msgr2=0x7fcea015ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fcea5c56640 1 --2- 172.21.15.19:0/443295296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcea015e5f0 0x7fcea015ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fcea5c56640 1 -- 172.21.15.19:0/443295296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcea00d30f0 msgr2=0x7fcea015b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fcea5c56640 1 --2- 172.21.15.19:0/443295296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcea00d30f0 0x7fcea015b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fcea5c56640 1 -- 172.21.15.19:0/443295296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea00a0c00 con 0x7fcea00b64c0 2024-09-12T02:06:27.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fcea5455640 1 --2- 172.21.15.19:0/443295296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcea00d30f0 0x7fcea015b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:27.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fcea5c56640 1 --2- 172.21.15.19:0/443295296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcea00b64c0 0x7fcea00a1c30 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7fce9c02a2b0 tx=0x7fce9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:27.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.236+0000 7fce967fc640 1 -- 172.21.15.19:0/443295296 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c037040 con 0x7fcea00b64c0 2024-09-12T02:06:27.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.237+0000 7fce967fc640 1 -- 172.21.15.19:0/443295296 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce9c042070 con 0x7fcea00b64c0 2024-09-12T02:06:27.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.237+0000 7fcea7eba640 1 -- 172.21.15.19:0/443295296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea00a0e70 con 0x7fcea00b64c0 2024-09-12T02:06:27.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.237+0000 7fce967fc640 1 -- 172.21.15.19:0/443295296 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c030bb0 con 0x7fcea00b64c0 2024-09-12T02:06:27.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.237+0000 7fcea7eba640 1 -- 172.21.15.19:0/443295296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea00a1430 con 0x7fcea00b64c0 2024-09-12T02:06:27.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.238+0000 7fce967fc640 1 -- 172.21.15.19:0/443295296 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce9c047460 con 0x7fcea00b64c0 2024-09-12T02:06:27.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.239+0000 7fce967fc640 1 --2- 172.21.15.19:0/443295296 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce8406be30 0x7fce8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.239+0000 7fce967fc640 1 -- 172.21.15.19:0/443295296 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 9313+0+0 (secure 0 0 0) 0x7fce9c0ac870 con 0x7fcea00b64c0 2024-09-12T02:06:27.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.239+0000 7fcea5455640 1 --2- 172.21.15.19:0/443295296 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce8406be30 0x7fce8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.239+0000 7fcea5455640 1 --2- 172.21.15.19:0/443295296 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce8406be30 0x7fce8406e2f0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fcea0160d30 tx=0x7fce90008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:27.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.239+0000 7fceaac55740 1 Processor -- start 2024-09-12T02:06:27.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.240+0000 7fceaac55740 1 -- start start 2024-09-12T02:06:27.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.240+0000 7fceaac55740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a282c0 0x557d52a6da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.240+0000 7fceaac55740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a25a80 0x557d52a286a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.240+0000 7fceaac55740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a29a50 0x557d52a228b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.240+0000 7fceaac55740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557d5298a520 con 0x557d52a29a50 2024-09-12T02:06:27.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.240+0000 7fceaac55740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557d529323e0 con 0x557d52a25a80 2024-09-12T02:06:27.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.240+0000 7fceaac55740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x557d529864e0 con 0x557d52a282c0 2024-09-12T02:06:27.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.240+0000 7fcea6457640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a29a50 0x557d52a228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.240+0000 7fcea6457640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a29a50 0x557d52a228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40762/0 (socket says 172.21.15.19:40762) 2024-09-12T02:06:27.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.240+0000 7fcea6457640 1 -- 172.21.15.19:0/316389324 learned_addr learned my addr 172.21.15.19:0/316389324 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:27.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.240+0000 7fcea5c56640 1 --2- 172.21.15.19:0/316389324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a282c0 0x557d52a6da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.240+0000 7fcea5455640 1 --2- 172.21.15.19:0/316389324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a25a80 0x557d52a286a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.241+0000 7fcea6457640 1 -- 172.21.15.19:0/316389324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a282c0 msgr2=0x557d52a6da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.241+0000 7fcea6457640 1 --2- 172.21.15.19:0/316389324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a282c0 0x557d52a6da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.241+0000 7fcea6457640 1 -- 172.21.15.19:0/316389324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a25a80 msgr2=0x557d52a286a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.241+0000 7fcea6457640 1 --2- 172.21.15.19:0/316389324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a25a80 0x557d52a286a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.241+0000 7fcea6457640 1 -- 172.21.15.19:0/316389324 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5294d2f0 con 0x557d52a29a50 2024-09-12T02:06:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.241+0000 7fcea6457640 1 --2- 172.21.15.19:0/316389324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a29a50 0x557d52a228b0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7fce98007300 tx=0x7fce980077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e329138daeee893 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.241+0000 7fce837fe640 1 -- 172.21.15.19:0/316389324 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce98019070 con 0x557d52a29a50 2024-09-12T02:06:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.241+0000 7fce837fe640 1 -- 172.21.15.19:0/316389324 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce98004d70 con 0x557d52a29a50 2024-09-12T02:06:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.241+0000 7fce837fe640 1 -- 172.21.15.19:0/316389324 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce98001e50 con 0x557d52a29a50 2024-09-12T02:06:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.242+0000 7fceaac55740 1 -- 172.21.15.19:0/316389324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a29a50 msgr2=0x557d52a228b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.242+0000 7fceaac55740 1 --2- 172.21.15.19:0/316389324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a29a50 0x557d52a228b0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7fce98007300 tx=0x7fce980077c0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.242+0000 7fceaac55740 1 -- 172.21.15.19:0/316389324 shutdown_connections 2024-09-12T02:06:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.242+0000 7fceaac55740 1 --2- 172.21.15.19:0/316389324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a29a50 0x557d52a228b0 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.242+0000 7fceaac55740 1 --2- 172.21.15.19:0/316389324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a25a80 0x557d52a286a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.242+0000 7fceaac55740 1 --2- 172.21.15.19:0/316389324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a282c0 0x557d52a6da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.242+0000 7fceaac55740 1 -- 172.21.15.19:0/316389324 >> 172.21.15.19:0/316389324 conn(0x557d52a24a80 msgr2=0x557d52a6cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:27.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.242+0000 7fceaac55740 1 -- 172.21.15.19:0/316389324 shutdown_connections 2024-09-12T02:06:27.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.242+0000 7fceaac55740 1 -- 172.21.15.19:0/316389324 wait complete. 2024-09-12T02:06:27.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.242+0000 7fceaac55740 1 -- start start 2024-09-12T02:06:27.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.242+0000 7fceaac55740 1 Processor -- start 2024-09-12T02:06:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.243+0000 7fceaac55740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a282c0 0x557d52a507d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.243+0000 7fceaac55740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a29a50 0x557d52a7cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.243+0000 7fceaac55740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a7d060 0x557d52a72e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.243+0000 7fceaac55740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557d52a23f20 con 0x557d52a7d060 2024-09-12T02:06:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.243+0000 7fceaac55740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557d52913450 con 0x557d52a282c0 2024-09-12T02:06:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.243+0000 7fceaac55740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x557d52a6e290 con 0x557d52a29a50 2024-09-12T02:06:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.243+0000 7fceaac55740 10 client.0 _ll_register_callbacks cb 0x557d5269cac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.243+0000 7fcea6457640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a7d060 0x557d52a72e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fcea6457640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a7d060 0x557d52a72e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40768/0 (socket says 172.21.15.19:40768) 2024-09-12T02:06:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fcea6457640 1 -- 172.21.15.19:0/3792475296 learned_addr learned my addr 172.21.15.19:0/3792475296 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fcea5c56640 1 --2- 172.21.15.19:0/3792475296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a282c0 0x557d52a507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fcea5455640 1 --2- 172.21.15.19:0/3792475296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a29a50 0x557d52a7cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fcea6457640 1 -- 172.21.15.19:0/3792475296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a29a50 msgr2=0x557d52a7cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fcea6457640 1 --2- 172.21.15.19:0/3792475296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a29a50 0x557d52a7cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fcea6457640 1 -- 172.21.15.19:0/3792475296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a282c0 msgr2=0x557d52a507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fcea6457640 1 --2- 172.21.15.19:0/3792475296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a282c0 0x557d52a507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fcea6457640 1 -- 172.21.15.19:0/3792475296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d5269d2d0 con 0x557d52a7d060 2024-09-12T02:06:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fcea5c56640 1 --2- 172.21.15.19:0/3792475296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a282c0 0x557d52a507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fcea5455640 1 --2- 172.21.15.19:0/3792475296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a29a50 0x557d52a7cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fcea6457640 1 --2- 172.21.15.19:0/3792475296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a7d060 0x557d52a72e10 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7fce98017040 tx=0x7fce98007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74273dbfa7f2973e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fce80ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:06:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fce80ff9640 1 -- 172.21.15.19:0/3792475296 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce98019040 con 0x557d52a7d060 2024-09-12T02:06:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fce80ff9640 1 -- 172.21.15.19:0/3792475296 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 9313+0+0 (secure 0 0 0) 0x7fce98001fc0 con 0x557d52a7d060 2024-09-12T02:06:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fceaac55740 1 -- 172.21.15.19:0/3792475296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce98004d70 con 0x557d52a7d060 2024-09-12T02:06:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fce80ff9640 1 -- 172.21.15.19:0/3792475296 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=302) ==== 24+0+0 (secure 0 0 0) 0x7fce98005050 con 0x557d52a7d060 2024-09-12T02:06:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fceaac55740 10 client.10275 fetch_fsmap learned FSMap version 302 2024-09-12T02:06:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fceaac55740 1 -- 172.21.15.19:0/3792475296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=302,monmap=2+}) -- 0x557d527676b0 con 0x557d52a7d060 2024-09-12T02:06:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.244+0000 7fce80ff9640 1 -- 172.21.15.19:0/3792475296 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce98004d70 con 0x557d52a7d060 2024-09-12T02:06:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.245+0000 7fce80ff9640 1 -- 172.21.15.19:0/3792475296 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 302) ==== 3502+0+0 (secure 0 0 0) 0x7fce980051f0 con 0x557d52a7d060 2024-09-12T02:06:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.245+0000 7fceaac55740 10 client.10275 fetch_fsmap finished waiting for FSMap version 302 2024-09-12T02:06:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.245+0000 7fceaac55740 10 client.10275 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:06:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.245+0000 7fceaac55740 20 client.10275 populate_metadata read hostname 'smithi019' 2024-09-12T02:06:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.245+0000 7fceaac55740 1 --2- 172.21.15.19:0/3792475296 >> [v2:172.21.15.19:6832/3083563091,v1:172.21.15.19:6834/3083563091] conn(0x557d52a80940 0x557d52a80d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.245+0000 7fceaac55740 4 client.10275 mds_command: new command op to 10215 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:06:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.245+0000 7fceaac55740 1 -- 172.21.15.19:0/3792475296 --> [v2:172.21.15.19:6832/3083563091,v1:172.21.15.19:6834/3083563091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d52997c50 con 0x557d52a80940 2024-09-12T02:06:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.245+0000 7fcea5c56640 1 --2- 172.21.15.19:0/3792475296 >> [v2:172.21.15.19:6832/3083563091,v1:172.21.15.19:6834/3083563091] conn(0x557d52a80940 0x557d52a80d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.245+0000 7fce80ff9640 10 client.10275 ms_handle_connect on v2:172.21.15.19:6832/3083563091 2024-09-12T02:06:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.245+0000 7fcea5c56640 1 --2- 172.21.15.19:0/3792475296 >> [v2:172.21.15.19:6832/3083563091,v1:172.21.15.19:6834/3083563091] conn(0x557d52a80940 0x557d52a80d20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db8ba7ea6d4efaf9 server_cookie=b6a970b881abc763 in_seq=0 out_seq=0 2024-09-12T02:06:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.246+0000 7fce80ff9640 1 -- 172.21.15.19:0/3792475296 <== mds.0 v2:172.21.15.19:6832/3083563091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d52997c50 con 0x557d52a80940 2024-09-12T02:06:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.246+0000 7fce80ff9640 10 client.10275 handle_command_reply: tid=0 2024-09-12T02:06:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.246+0000 7fceaac55740 1 client.10275 shutdown 2024-09-12T02:06:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.246+0000 7fceaac55740 1 -- 172.21.15.19:0/3792475296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a7d060 msgr2=0x557d52a72e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.246+0000 7fceaac55740 1 --2- 172.21.15.19:0/3792475296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a7d060 0x557d52a72e10 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7fce98017040 tx=0x7fce98007d90 comp rx=0 tx=0).stop 2024-09-12T02:06:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.246+0000 7fceaac55740 1 -- 172.21.15.19:0/3792475296 shutdown_connections 2024-09-12T02:06:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.246+0000 7fceaac55740 1 --2- 172.21.15.19:0/3792475296 >> [v2:172.21.15.19:6832/3083563091,v1:172.21.15.19:6834/3083563091] conn(0x557d52a80940 0x557d52a80d20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.246+0000 7fceaac55740 1 --2- 172.21.15.19:0/3792475296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a7d060 0x557d52a72e10 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.246+0000 7fceaac55740 1 --2- 172.21.15.19:0/3792475296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a29a50 0x557d52a7cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.246+0000 7fce80ff9640 0 client.10275 ms_handle_reset on v2:172.21.15.19:6832/3083563091 2024-09-12T02:06:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.246+0000 7fceaac55740 1 --2- 172.21.15.19:0/3792475296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a282c0 0x557d52a507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.246+0000 7fceaac55740 1 -- 172.21.15.19:0/3792475296 >> 172.21.15.19:0/3792475296 conn(0x557d52a25a80 msgr2=0x557d52a6afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.246+0000 7fceaac55740 1 -- 172.21.15.19:0/3792475296 shutdown_connections 2024-09-12T02:06:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.246+0000 7fceaac55740 1 -- 172.21.15.19:0/3792475296 wait complete. 2024-09-12T02:06:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.246+0000 7fceaac55740 20 client.10275 trim_cache size 0 max 16384 2024-09-12T02:06:27.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.264+0000 7fceaac55740 1 Processor -- start 2024-09-12T02:06:27.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.264+0000 7fceaac55740 1 -- start start 2024-09-12T02:06:27.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.265+0000 7fceaac55740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a282c0 0x557d52a73b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.265+0000 7fceaac55740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a29a50 0x557d52a74060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.265+0000 7fceaac55740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a7d060 0x557d52a90dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.265+0000 7fceaac55740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcea0201d90 con 0x557d52a282c0 2024-09-12T02:06:27.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.265+0000 7fceaac55740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcea0201070 con 0x557d52a7d060 2024-09-12T02:06:27.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.265+0000 7fceaac55740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcea02016c0 con 0x557d52a29a50 2024-09-12T02:06:27.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.265+0000 7fcea5c56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a282c0 0x557d52a73b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.265+0000 7fcea5c56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a282c0 0x557d52a73b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40770/0 (socket says 172.21.15.19:40770) 2024-09-12T02:06:27.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.265+0000 7fcea5c56640 1 -- 172.21.15.19:0/1448366222 learned_addr learned my addr 172.21.15.19:0/1448366222 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:27.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.265+0000 7fcea5c56640 1 -- 172.21.15.19:0/1448366222 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a29a50 msgr2=0x557d52a74060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:27.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.265+0000 7fcea5c56640 1 --2- 172.21.15.19:0/1448366222 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a29a50 0x557d52a74060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.265+0000 7fcea5c56640 1 -- 172.21.15.19:0/1448366222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a7d060 msgr2=0x557d52a90dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:27.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.265+0000 7fcea5c56640 1 --2- 172.21.15.19:0/1448366222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a7d060 0x557d52a90dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.265+0000 7fcea5c56640 1 -- 172.21.15.19:0/1448366222 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d52a24290 con 0x557d52a282c0 2024-09-12T02:06:27.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.266+0000 7fcea5c56640 1 --2- 172.21.15.19:0/1448366222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a282c0 0x557d52a73b20 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0761a0 tx=0x7fce9c0ac040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc74a538ca6c3e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:27.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.266+0000 7fce82ffd640 1 -- 172.21.15.19:0/1448366222 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c07e0f0 con 0x557d52a282c0 2024-09-12T02:06:27.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.266+0000 7fce82ffd640 1 -- 172.21.15.19:0/1448366222 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce9c096070 con 0x557d52a282c0 2024-09-12T02:06:27.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.266+0000 7fce82ffd640 1 -- 172.21.15.19:0/1448366222 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c082920 con 0x557d52a282c0 2024-09-12T02:06:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.266+0000 7fceaac55740 1 -- 172.21.15.19:0/1448366222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a282c0 msgr2=0x557d52a73b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.266+0000 7fceaac55740 1 --2- 172.21.15.19:0/1448366222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a282c0 0x557d52a73b20 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0761a0 tx=0x7fce9c0ac040 comp rx=0 tx=0).stop 2024-09-12T02:06:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.266+0000 7fceaac55740 1 -- 172.21.15.19:0/1448366222 shutdown_connections 2024-09-12T02:06:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.266+0000 7fceaac55740 1 --2- 172.21.15.19:0/1448366222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a7d060 0x557d52a90dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.266+0000 7fceaac55740 1 --2- 172.21.15.19:0/1448366222 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a29a50 0x557d52a74060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.266+0000 7fceaac55740 1 --2- 172.21.15.19:0/1448366222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a282c0 0x557d52a73b20 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.266+0000 7fceaac55740 1 -- 172.21.15.19:0/1448366222 >> 172.21.15.19:0/1448366222 conn(0x557d52a25a80 msgr2=0x557d52a6a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.266+0000 7fceaac55740 1 -- 172.21.15.19:0/1448366222 shutdown_connections 2024-09-12T02:06:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.266+0000 7fceaac55740 1 -- 172.21.15.19:0/1448366222 wait complete. 2024-09-12T02:06:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.267+0000 7fceaac55740 1 -- start start 2024-09-12T02:06:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.267+0000 7fceaac55740 1 Processor -- start 2024-09-12T02:06:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fceaac55740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a282c0 0x557d52aeea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fceaac55740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a29a50 0x557d52aead60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fceaac55740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a7d060 0x557d52a50420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fceaac55740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557d52a50d10 con 0x557d52a282c0 2024-09-12T02:06:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fceaac55740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557d52a4cdc0 con 0x557d52a7d060 2024-09-12T02:06:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fceaac55740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x557d52a51490 con 0x557d52a29a50 2024-09-12T02:06:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fceaac55740 10 client.0 _ll_register_callbacks cb 0x7fce98017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fcea5c56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a282c0 0x557d52aeea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fcea5c56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a282c0 0x557d52aeea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40784/0 (socket says 172.21.15.19:40784) 2024-09-12T02:06:27.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fcea5c56640 1 -- 172.21.15.19:0/3563614193 learned_addr learned my addr 172.21.15.19:0/3563614193 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fcea5455640 1 --2- 172.21.15.19:0/3563614193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a29a50 0x557d52aead60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fcea6457640 1 --2- 172.21.15.19:0/3563614193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a7d060 0x557d52a50420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fcea5c56640 1 -- 172.21.15.19:0/3563614193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a29a50 msgr2=0x557d52aead60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fcea5c56640 1 --2- 172.21.15.19:0/3563614193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a29a50 0x557d52aead60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fcea5c56640 1 -- 172.21.15.19:0/3563614193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a7d060 msgr2=0x557d52a50420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fcea5c56640 1 --2- 172.21.15.19:0/3563614193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a7d060 0x557d52a50420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fcea5c56640 1 -- 172.21.15.19:0/3563614193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d52a4afd0 con 0x557d52a282c0 2024-09-12T02:06:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fcea5c56640 1 --2- 172.21.15.19:0/3563614193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a282c0 0x557d52aeea80 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0761a0 tx=0x7fce9c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c5fdde6426f927 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fce80ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:06:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fce80ff9640 1 -- 172.21.15.19:0/3563614193 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c082920 con 0x557d52a282c0 2024-09-12T02:06:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fce80ff9640 1 -- 172.21.15.19:0/3563614193 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 9313+0+0 (secure 0 0 0) 0x7fce9c030d50 con 0x557d52a282c0 2024-09-12T02:06:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.268+0000 7fceaac55740 1 -- 172.21.15.19:0/3563614193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce9c096070 con 0x557d52a282c0 2024-09-12T02:06:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.269+0000 7fce80ff9640 1 -- 172.21.15.19:0/3563614193 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=302) ==== 24+0+0 (secure 0 0 0) 0x7fce9c0763b0 con 0x557d52a282c0 2024-09-12T02:06:27.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.269+0000 7fceaac55740 10 client.10281 fetch_fsmap learned FSMap version 302 2024-09-12T02:06:27.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.269+0000 7fceaac55740 1 -- 172.21.15.19:0/3563614193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=302,monmap=2+}) -- 0x557d52aef240 con 0x557d52a282c0 2024-09-12T02:06:27.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.269+0000 7fce80ff9640 1 -- 172.21.15.19:0/3563614193 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce9c096070 con 0x557d52a282c0 2024-09-12T02:06:27.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.269+0000 7fce80ff9640 1 -- 172.21.15.19:0/3563614193 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 302) ==== 3502+0+0 (secure 0 0 0) 0x7fce9c03a030 con 0x557d52a282c0 2024-09-12T02:06:27.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.269+0000 7fceaac55740 10 client.10281 fetch_fsmap finished waiting for FSMap version 302 2024-09-12T02:06:27.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.269+0000 7fceaac55740 10 client.10281 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:06:27.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.269+0000 7fceaac55740 20 client.10281 populate_metadata read hostname 'smithi019' 2024-09-12T02:06:27.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.269+0000 7fceaac55740 1 --2- 172.21.15.19:0/3563614193 >> [v2:172.21.15.19:6832/3083563091,v1:172.21.15.19:6834/3083563091] conn(0x557d52a6bfc0 0x557d52a6c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.269+0000 7fceaac55740 4 client.10281 mds_command: new command op to 10215 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:06:27.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.269+0000 7fceaac55740 1 -- 172.21.15.19:0/3563614193 --> [v2:172.21.15.19:6832/3083563091,v1:172.21.15.19:6834/3083563091] -- command(tid 0: {"prefix": "status"}) -- 0x557d52991fa0 con 0x557d52a6bfc0 2024-09-12T02:06:27.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.269+0000 7fcea5455640 1 --2- 172.21.15.19:0/3563614193 >> [v2:172.21.15.19:6832/3083563091,v1:172.21.15.19:6834/3083563091] conn(0x557d52a6bfc0 0x557d52a6c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.269+0000 7fce80ff9640 10 client.10281 ms_handle_connect on v2:172.21.15.19:6832/3083563091 2024-09-12T02:06:27.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.269+0000 7fcea5455640 1 --2- 172.21.15.19:0/3563614193 >> [v2:172.21.15.19:6832/3083563091,v1:172.21.15.19:6834/3083563091] conn(0x557d52a6bfc0 0x557d52a6c3a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38d9618cabc2175f server_cookie=e90775d3ad770acd in_seq=0 out_seq=0 2024-09-12T02:06:27.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fce80ff9640 1 -- 172.21.15.19:0/3563614193 <== mds.0 v2:172.21.15.19:6832/3083563091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x557d52991fa0 con 0x557d52a6bfc0 2024-09-12T02:06:27.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fce80ff9640 10 client.10281 handle_command_reply: tid=0 2024-09-12T02:06:27.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fceaac55740 1 client.10281 shutdown 2024-09-12T02:06:27.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fceaac55740 1 -- 172.21.15.19:0/3563614193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a282c0 msgr2=0x557d52aeea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fceaac55740 1 --2- 172.21.15.19:0/3563614193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a282c0 0x557d52aeea80 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0761a0 tx=0x7fce9c008040 comp rx=0 tx=0).stop 2024-09-12T02:06:27.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fceaac55740 1 -- 172.21.15.19:0/3563614193 shutdown_connections 2024-09-12T02:06:27.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fceaac55740 1 --2- 172.21.15.19:0/3563614193 >> [v2:172.21.15.19:6832/3083563091,v1:172.21.15.19:6834/3083563091] conn(0x557d52a6bfc0 0x557d52a6c3a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fceaac55740 1 --2- 172.21.15.19:0/3563614193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d52a7d060 0x557d52a50420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fceaac55740 1 --2- 172.21.15.19:0/3563614193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557d52a29a50 0x557d52aead60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fce80ff9640 0 client.10281 ms_handle_reset on v2:172.21.15.19:6832/3083563091 2024-09-12T02:06:27.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fceaac55740 1 --2- 172.21.15.19:0/3563614193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d52a282c0 0x557d52aeea80 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fceaac55740 1 -- 172.21.15.19:0/3563614193 >> 172.21.15.19:0/3563614193 conn(0x557d52a25a80 msgr2=0x557d52a6b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:27.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fceaac55740 1 -- 172.21.15.19:0/3563614193 shutdown_connections 2024-09-12T02:06:27.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fceaac55740 1 -- 172.21.15.19:0/3563614193 wait complete. 2024-09-12T02:06:27.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fceaac55740 20 client.10281 trim_cache size 0 max 16384 2024-09-12T02:06:27.277 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:06:27.277 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T02:06:27.277 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T02:06:27.277 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 10215, 2024-09-12T02:06:27.277 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T02:06:27.277 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T02:06:27.277 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T02:06:27.277 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 6.6549729949999996, 2024-09-12T02:06:27.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 302, 2024-09-12T02:06:27.277 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 130, 2024-09-12T02:06:27.277 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 130, 2024-09-12T02:06:27.277 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 7.8975257919999997 2024-09-12T02:06:27.278 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:06:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fcea7eba640 1 -- 172.21.15.19:0/443295296 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce8406be30 msgr2=0x7fce8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fcea7eba640 1 --2- 172.21.15.19:0/443295296 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce8406be30 0x7fce8406e2f0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fcea0160d30 tx=0x7fce90008040 comp rx=0 tx=0).stop 2024-09-12T02:06:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fcea7eba640 1 -- 172.21.15.19:0/443295296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcea00b64c0 msgr2=0x7fcea00a1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.270+0000 7fcea7eba640 1 --2- 172.21.15.19:0/443295296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcea00b64c0 0x7fcea00a1c30 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7fce9c02a2b0 tx=0x7fce9c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.271+0000 7fcea7eba640 1 -- 172.21.15.19:0/443295296 shutdown_connections 2024-09-12T02:06:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.271+0000 7fcea7eba640 1 --2- 172.21.15.19:0/443295296 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce8406be30 0x7fce8406e2f0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.271+0000 7fcea7eba640 1 --2- 172.21.15.19:0/443295296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcea015e5f0 0x7fcea015ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.271+0000 7fcea7eba640 1 --2- 172.21.15.19:0/443295296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcea00d30f0 0x7fcea015b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.271+0000 7fcea7eba640 1 --2- 172.21.15.19:0/443295296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcea00b64c0 0x7fcea00a1c30 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.271+0000 7fcea7eba640 1 -- 172.21.15.19:0/443295296 >> 172.21.15.19:0/443295296 conn(0x7fcea008bfc0 msgr2=0x7fcea00b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.271+0000 7fcea7eba640 1 -- 172.21.15.19:0/443295296 shutdown_connections 2024-09-12T02:06:27.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.271+0000 7fcea7eba640 1 -- 172.21.15.19:0/443295296 wait complete. 2024-09-12T02:06:27.282 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:06:27.282 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Corrupt omap header on mds0_openfiles.0', proceeding to ls 2024-09-12T02:06:27.282 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:06:27.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.385+0000 7fee214f1640 1 Processor -- start 2024-09-12T02:06:27.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.385+0000 7fee214f1640 1 -- start start 2024-09-12T02:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.386+0000 7fee214f1640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fee1c0d1540 0x7fee1c06dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.386+0000 7fee214f1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee1c09b690 0x7fee1c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.386+0000 7fee214f1640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee1c0d1970 con 0x7fee1c15e740 2024-09-12T02:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.386+0000 7fee214f1640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fee1c15eb20 con 0x7fee1c0d1540 2024-09-12T02:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.386+0000 7fee214f1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fee1c06d260 con 0x7fee1c09b690 2024-09-12T02:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.386+0000 7fee1affd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fee1c15e740 0x7fee1c06d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36668/0 (socket says 172.21.15.19:36668) 2024-09-12T02:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.386+0000 7fee1affd640 1 -- 172.21.15.19:0/2842909532 learned_addr learned my addr 172.21.15.19:0/2842909532 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.386+0000 7fee1a7fc640 1 --2- 172.21.15.19:0/2842909532 >> v2:172.21.15.135:3300/0 conn(0x7fee1c0d1540 0x7fee1c06dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.386+0000 7fee1b7fe640 1 --2- 172.21.15.19:0/2842909532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee1c09b690 0x7fee1c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.386+0000 7fee19ffb640 1 -- 172.21.15.19:0/2842909532 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1221509554 0 0) 0x7fee1c0d1970 con 0x7fee1c15e740 2024-09-12T02:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.386+0000 7fee19ffb640 1 -- 172.21.15.19:0/2842909532 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee04003520 con 0x7fee1c15e740 2024-09-12T02:06:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.386+0000 7fee1b7fe640 1 -- 172.21.15.19:0/2842909532 >> v2:172.21.15.135:3300/0 conn(0x7fee1c0d1540 msgr2=0x7fee1c06dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.386+0000 7fee1b7fe640 1 --2- 172.21.15.19:0/2842909532 >> v2:172.21.15.135:3300/0 conn(0x7fee1c0d1540 0x7fee1c06dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.386+0000 7fee19ffb640 1 -- 172.21.15.19:0/2842909532 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 900654937 0 0) 0x7fee04003520 con 0x7fee1c15e740 2024-09-12T02:06:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.386+0000 7fee1b7fe640 1 -- 172.21.15.19:0/2842909532 >> v1:172.21.15.19:6789/0 conn(0x7fee1c15e740 legacy=0x7fee1c06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.386+0000 7fee1b7fe640 1 -- 172.21.15.19:0/2842909532 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee1c0d0780 con 0x7fee1c09b690 2024-09-12T02:06:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.387+0000 7fee1b7fe640 1 --2- 172.21.15.19:0/2842909532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee1c09b690 0x7fee1c06cd20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fee14009d90 tx=0x7fee1402a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=866bbabdfbb58a59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.387+0000 7fee19ffb640 1 -- 172.21.15.19:0/2842909532 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c001670 con 0x7fee1c09b690 2024-09-12T02:06:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.388+0000 7fee19ffb640 1 -- 172.21.15.19:0/2842909532 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee14007540 con 0x7fee1c09b690 2024-09-12T02:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.388+0000 7fee19ffb640 1 -- 172.21.15.19:0/2842909532 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14007910 con 0x7fee1c09b690 2024-09-12T02:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.388+0000 7fee214f1640 1 -- 172.21.15.19:0/2842909532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee1c09b690 msgr2=0x7fee1c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.388+0000 7fee214f1640 1 --2- 172.21.15.19:0/2842909532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee1c09b690 0x7fee1c06cd20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fee14009d90 tx=0x7fee1402a680 comp rx=0 tx=0).stop 2024-09-12T02:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.388+0000 7fee214f1640 1 -- 172.21.15.19:0/2842909532 shutdown_connections 2024-09-12T02:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.388+0000 7fee214f1640 1 --2- 172.21.15.19:0/2842909532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee1c09b690 0x7fee1c06cd20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.388+0000 7fee214f1640 1 --2- 172.21.15.19:0/2842909532 >> v2:172.21.15.135:3300/0 conn(0x7fee1c0d1540 0x7fee1c06dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.388+0000 7fee214f1640 1 -- 172.21.15.19:0/2842909532 >> 172.21.15.19:0/2842909532 conn(0x7fee1c0d23a0 msgr2=0x7fee1c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.388+0000 7fee214f1640 1 -- 172.21.15.19:0/2842909532 shutdown_connections 2024-09-12T02:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.388+0000 7fee214f1640 1 -- 172.21.15.19:0/2842909532 wait complete. 2024-09-12T02:06:27.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.389+0000 7fee214f1640 1 Processor -- start 2024-09-12T02:06:27.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.390+0000 7fee214f1640 1 -- start start 2024-09-12T02:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.390+0000 7fee214f1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee1c09b690 0x7fee1c0ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.390+0000 7fee214f1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee1c0d1540 0x7fee1c159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.390+0000 7fee214f1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee1c15e740 0x7fee1c09f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.390+0000 7fee214f1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c0d1020 con 0x7fee1c0d1540 2024-09-12T02:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.390+0000 7fee214f1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c0d0d40 con 0x7fee1c09b690 2024-09-12T02:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.390+0000 7fee214f1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fee1c09bac0 con 0x7fee1c15e740 2024-09-12T02:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.390+0000 7fee1a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee1c0d1540 0x7fee1c159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.390+0000 7fee1a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee1c0d1540 0x7fee1c159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40788/0 (socket says 172.21.15.19:40788) 2024-09-12T02:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.390+0000 7fee1a7fc640 1 -- 172.21.15.19:0/2978517903 learned_addr learned my addr 172.21.15.19:0/2978517903 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.391+0000 7fee1affd640 1 --2- 172.21.15.19:0/2978517903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee1c09b690 0x7fee1c0ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.391+0000 7fee1b7fe640 1 --2- 172.21.15.19:0/2978517903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee1c15e740 0x7fee1c09f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.391+0000 7fee1a7fc640 1 -- 172.21.15.19:0/2978517903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee1c15e740 msgr2=0x7fee1c09f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.391+0000 7fee1a7fc640 1 --2- 172.21.15.19:0/2978517903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee1c15e740 0x7fee1c09f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.391+0000 7fee1a7fc640 1 -- 172.21.15.19:0/2978517903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee1c09b690 msgr2=0x7fee1c0ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.391+0000 7fee1a7fc640 1 --2- 172.21.15.19:0/2978517903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee1c09b690 0x7fee1c0ca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.391+0000 7fee1a7fc640 1 -- 172.21.15.19:0/2978517903 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee1c15a440 con 0x7fee1c0d1540 2024-09-12T02:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.391+0000 7fee1a7fc640 1 --2- 172.21.15.19:0/2978517903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee1c0d1540 0x7fee1c159f00 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7fee1000e9b0 tx=0x7fee1000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.391+0000 7fee037fe640 1 -- 172.21.15.19:0/2978517903 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10017070 con 0x7fee1c0d1540 2024-09-12T02:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.391+0000 7fee037fe640 1 -- 172.21.15.19:0/2978517903 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1000c9a0 con 0x7fee1c0d1540 2024-09-12T02:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.391+0000 7fee214f1640 1 -- 172.21.15.19:0/2978517903 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee1c0c95f0 con 0x7fee1c0d1540 2024-09-12T02:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.391+0000 7fee037fe640 1 -- 172.21.15.19:0/2978517903 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1000cd90 con 0x7fee1c0d1540 2024-09-12T02:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.391+0000 7fee214f1640 1 -- 172.21.15.19:0/2978517903 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee1c0c9bb0 con 0x7fee1c0d1540 2024-09-12T02:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.392+0000 7fee214f1640 1 -- 172.21.15.19:0/2978517903 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee1c06cd20 con 0x7fee1c0d1540 2024-09-12T02:06:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.393+0000 7fee037fe640 1 -- 172.21.15.19:0/2978517903 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee1001a070 con 0x7fee1c0d1540 2024-09-12T02:06:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.393+0000 7fee037fe640 1 --2- 172.21.15.19:0/2978517903 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fee0806be60 0x7fee0806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.393+0000 7fee037fe640 1 -- 172.21.15.19:0/2978517903 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 9313+0+0 (secure 0 0 0) 0x7fee1008bca0 con 0x7fee1c0d1540 2024-09-12T02:06:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.393+0000 7fee1affd640 1 --2- 172.21.15.19:0/2978517903 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fee0806be60 0x7fee0806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.394+0000 7fee1affd640 1 --2- 172.21.15.19:0/2978517903 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fee0806be60 0x7fee0806e320 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fee0c005880 tx=0x7fee0c0057f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:27.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.398+0000 7fee037fe640 1 -- 172.21.15.19:0/2978517903 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee1c15a440 con 0x7fee1c0d1540 2024-09-12T02:06:27.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.607+0000 7fee214f1640 1 -- 172.21.15.19:0/2978517903 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fee1c0d1cb0 con 0x7fee1c0d1540 2024-09-12T02:06:27.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.607+0000 7fee037fe640 1 -- 172.21.15.19:0/2978517903 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v302) ==== 53+0+73 (secure 0 0 0) 0x7fee10059100 con 0x7fee1c0d1540 2024-09-12T02:06:27.608 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:06:27.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.609+0000 7fee214f1640 1 -- 172.21.15.19:0/2978517903 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fee0806be60 msgr2=0x7fee0806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.609+0000 7fee214f1640 1 --2- 172.21.15.19:0/2978517903 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fee0806be60 0x7fee0806e320 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fee0c005880 tx=0x7fee0c0057f0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.609+0000 7fee214f1640 1 -- 172.21.15.19:0/2978517903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee1c0d1540 msgr2=0x7fee1c159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.609+0000 7fee214f1640 1 --2- 172.21.15.19:0/2978517903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee1c0d1540 0x7fee1c159f00 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7fee1000e9b0 tx=0x7fee1000ee70 comp rx=0 tx=0).stop 2024-09-12T02:06:27.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.609+0000 7fee214f1640 1 -- 172.21.15.19:0/2978517903 shutdown_connections 2024-09-12T02:06:27.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.609+0000 7fee214f1640 1 --2- 172.21.15.19:0/2978517903 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fee0806be60 0x7fee0806e320 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.609+0000 7fee214f1640 1 --2- 172.21.15.19:0/2978517903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee1c15e740 0x7fee1c09f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.609+0000 7fee214f1640 1 --2- 172.21.15.19:0/2978517903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee1c0d1540 0x7fee1c159f00 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.609+0000 7fee214f1640 1 --2- 172.21.15.19:0/2978517903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee1c09b690 0x7fee1c0ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.609+0000 7fee214f1640 1 -- 172.21.15.19:0/2978517903 >> 172.21.15.19:0/2978517903 conn(0x7fee1c0d23a0 msgr2=0x7fee1c0b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:27.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.609+0000 7fee214f1640 1 -- 172.21.15.19:0/2978517903 shutdown_connections 2024-09-12T02:06:27.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27.609+0000 7fee214f1640 1 -- 172.21.15.19:0/2978517903 wait complete. 2024-09-12T02:06:27.621 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:06:27.621 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:06:27.621 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T02:06:27.621 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:06:27.621 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:06:27.621 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:06:27.621 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:06:27.621 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:06:27.621 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:06:27.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:27.622 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T02:06:27.638 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:06:27.638 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:06:27.638 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:06:27.638 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:06:27.638 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T02:06:27.638 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:06:27.638 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:06:27.638 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:06:27.638 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T02:06:27.639 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:06:27.639 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:06:27.639 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T02:06:27.639 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:06:27.639 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:06:27.639 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T02:06:27.639 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:06:27.639 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42173sec preferred_lft 42173sec 2024-09-12T02:06:27.639 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T02:06:27.639 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:06:27.639 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:06:27.639 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:06:27.639 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T02:06:27.640 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:06:27.640 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T02:06:27.640 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:06:27.640 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:06:27.640 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T02:06:27.640 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:06:27.640 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:06:27.640 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:06:27.640 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T02:06:27.640 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:06:27.640 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:06:27.640 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:06:27.640 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T02:06:27.641 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:06:27.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:27.641 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:06:27.703 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T02:06:27.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:27.705 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T02:06:27.761 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T02:06:27.762 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:06:27.762 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:06:27.762 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:06:27.762 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:06:27.762 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:06:27.762 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T02:06:27.762 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:06:27.762 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:06:27.762 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:06:27.763 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T02:06:27.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:06:27.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:06:27.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:27.891 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T02:06:27.907 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:06:27.907 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:06:27.907 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:06:27.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:27.907 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T02:06:27.973 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:06:27.973 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:06:28.029 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:06:28.029 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:06:28.029 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:06:28.085 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:06:28.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:28.085 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:06:28.169 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:06:28.170 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:06:28.170 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:06:28.178 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:06:28.179 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:06:28.179 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:06:28.179 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:06:28.179 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:06:28.185 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:06:28.185 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:06:28.185 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:06:28.185 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:06:28.185 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:06:28.185 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T02:06:28.185 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T02:06:28.185 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T02:06:28.186 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:06:28.186 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:06:28.186 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:06:28.186 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:06:28.186 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:06:28.188 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:06:28.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:28.188 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:06:28.213 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:06:28.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:06:28.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:06:28.310 INFO:teuthology.orchestra.run.smithi019.stdout:client8000 2024-09-12T02:06:28.311 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:06:28.311 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:06:28.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:28.328 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2024-09-12T02:06:28.370 INFO:teuthology.orchestra.run:waiting for 20 2024-09-12T02:06:28.385 INFO:teuthology.orchestra.run.smithi019.stdout:.: 2024-09-12T02:06:28.385 INFO:teuthology.orchestra.run.smithi019.stdout:subdir 2024-09-12T02:06:28.385 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:28.385 INFO:teuthology.orchestra.run.smithi019.stdout:./subdir: 2024-09-12T02:06:28.385 INFO:teuthology.orchestra.run.smithi019.stdout:sixmegs 2024-09-12T02:06:28.386 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap header on mds0_openfiles.0' did not caused DAMAGED state 2024-09-12T02:06:28.386 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap header on 100.00000000' 2024-09-12T02:06:28.386 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:06:28.386 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:06:28.442 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:06:28.442 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:06:28.499 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:06:28.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.643+0000 7fe70cd86640 1 Processor -- start 2024-09-12T02:06:28.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.643+0000 7fe70cd86640 1 -- start start 2024-09-12T02:06:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.644+0000 7fe70cd86640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe708072d30 0x7fe70806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.644+0000 7fe70cd86640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe70806f700 0x7fe70815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.644+0000 7fe70cd86640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7080cdbe0 con 0x7fe70815b300 2024-09-12T02:06:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.644+0000 7fe70cd86640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fe70806fb50 con 0x7fe70806f700 2024-09-12T02:06:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.644+0000 7fe70cd86640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe7080728a0 con 0x7fe708072d30 2024-09-12T02:06:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.644+0000 7fe706d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe70806f700 0x7fe70815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.644+0000 7fe706d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe70806f700 0x7fe70815b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40800/0 (socket says 172.21.15.19:40800) 2024-09-12T02:06:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.644+0000 7fe706d9d640 1 -- 172.21.15.19:0/1436596593 learned_addr learned my addr 172.21.15.19:0/1436596593 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.644+0000 7fe705d9b640 1 --2- 172.21.15.19:0/1436596593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe708072d30 0x7fe70806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.644+0000 7fe706d9d640 1 -- 172.21.15.19:0/1436596593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe708072d30 msgr2=0x7fe70806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.644+0000 7fe706d9d640 1 --2- 172.21.15.19:0/1436596593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe708072d30 0x7fe70806f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:28.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.644+0000 7fe706d9d640 1 -- 172.21.15.19:0/1436596593 >> v1:172.21.15.135:6789/0 conn(0x7fe70815b300 legacy=0x7fe7080cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:28.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.644+0000 7fe706d9d640 1 -- 172.21.15.19:0/1436596593 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7080cd900 con 0x7fe70806f700 2024-09-12T02:06:28.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.645+0000 7fe706d9d640 1 --2- 172.21.15.19:0/1436596593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe70806f700 0x7fe70815b6e0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7fe70000d150 tx=0x7fe70002c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7134f20ed12d61b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:28.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.645+0000 7fe70559a640 1 -- 172.21.15.19:0/1436596593 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe700009600 con 0x7fe70806f700 2024-09-12T02:06:28.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.645+0000 7fe70559a640 1 -- 172.21.15.19:0/1436596593 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe700037070 con 0x7fe70806f700 2024-09-12T02:06:28.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.645+0000 7fe70559a640 1 -- 172.21.15.19:0/1436596593 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7000099c0 con 0x7fe70806f700 2024-09-12T02:06:28.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.646+0000 7fe70cd86640 1 -- 172.21.15.19:0/1436596593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe70806f700 msgr2=0x7fe70815b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:28.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.646+0000 7fe70cd86640 1 --2- 172.21.15.19:0/1436596593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe70806f700 0x7fe70815b6e0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7fe70000d150 tx=0x7fe70002c930 comp rx=0 tx=0).stop 2024-09-12T02:06:28.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.646+0000 7fe70cd86640 1 -- 172.21.15.19:0/1436596593 shutdown_connections 2024-09-12T02:06:28.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.646+0000 7fe70cd86640 1 --2- 172.21.15.19:0/1436596593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe70806f700 0x7fe70815b6e0 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:28.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.646+0000 7fe70cd86640 1 --2- 172.21.15.19:0/1436596593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe708072d30 0x7fe70806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:28.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.646+0000 7fe70cd86640 1 -- 172.21.15.19:0/1436596593 >> 172.21.15.19:0/1436596593 conn(0x7fe708067d70 msgr2=0x7fe70806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:28.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.646+0000 7fe70cd86640 1 -- 172.21.15.19:0/1436596593 shutdown_connections 2024-09-12T02:06:28.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.646+0000 7fe70cd86640 1 -- 172.21.15.19:0/1436596593 wait complete. 2024-09-12T02:06:28.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.647+0000 7fe70cd86640 1 Processor -- start 2024-09-12T02:06:28.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.648+0000 7fe70cd86640 1 -- start start 2024-09-12T02:06:28.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.648+0000 7fe70cd86640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe70806f700 0x7fe708142f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:28.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.648+0000 7fe70cd86640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe708072d30 0x7fe708155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:28.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.648+0000 7fe70cd86640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe70815b300 0x7fe7081e3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:28.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.648+0000 7fe70cd86640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe7080cd5c0 con 0x7fe70806f700 2024-09-12T02:06:28.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.648+0000 7fe70cd86640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe708072530 con 0x7fe70815b300 2024-09-12T02:06:28.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.648+0000 7fe70cd86640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe7080cffe0 con 0x7fe708072d30 2024-09-12T02:06:28.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.648+0000 7fe70659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe70806f700 0x7fe708142f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:28.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.648+0000 7fe70659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe70806f700 0x7fe708142f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40812/0 (socket says 172.21.15.19:40812) 2024-09-12T02:06:28.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.648+0000 7fe70659c640 1 -- 172.21.15.19:0/1138258098 learned_addr learned my addr 172.21.15.19:0/1138258098 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:28.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.648+0000 7fe705d9b640 1 --2- 172.21.15.19:0/1138258098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe708072d30 0x7fe708155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:28.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.648+0000 7fe706d9d640 1 --2- 172.21.15.19:0/1138258098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe70815b300 0x7fe7081e3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:28.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.649+0000 7fe70659c640 1 -- 172.21.15.19:0/1138258098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe708072d30 msgr2=0x7fe708155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:28.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.649+0000 7fe70659c640 1 --2- 172.21.15.19:0/1138258098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe708072d30 0x7fe708155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:28.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.649+0000 7fe70659c640 1 -- 172.21.15.19:0/1138258098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe70815b300 msgr2=0x7fe7081e3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:28.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.649+0000 7fe70659c640 1 --2- 172.21.15.19:0/1138258098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe70815b300 0x7fe7081e3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:28.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.649+0000 7fe70659c640 1 -- 172.21.15.19:0/1138258098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7081e7c30 con 0x7fe70806f700 2024-09-12T02:06:28.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.649+0000 7fe70659c640 1 --2- 172.21.15.19:0/1138258098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe70806f700 0x7fe708142f50 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800c3f0 tx=0x7fe6f800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:28.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.649+0000 7fe6f6ffd640 1 -- 172.21.15.19:0/1138258098 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f80052d0 con 0x7fe70806f700 2024-09-12T02:06:28.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.649+0000 7fe6f6ffd640 1 -- 172.21.15.19:0/1138258098 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f8005490 con 0x7fe70806f700 2024-09-12T02:06:28.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.649+0000 7fe70cd86640 1 -- 172.21.15.19:0/1138258098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe708155650 con 0x7fe70806f700 2024-09-12T02:06:28.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.649+0000 7fe6f6ffd640 1 -- 172.21.15.19:0/1138258098 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8007260 con 0x7fe70806f700 2024-09-12T02:06:28.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.649+0000 7fe70cd86640 1 -- 172.21.15.19:0/1138258098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7081e8180 con 0x7fe70806f700 2024-09-12T02:06:28.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.650+0000 7fe70cd86640 1 -- 172.21.15.19:0/1138258098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe70806c710 con 0x7fe70806f700 2024-09-12T02:06:28.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.651+0000 7fe6f6ffd640 1 -- 172.21.15.19:0/1138258098 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6f8007400 con 0x7fe70806f700 2024-09-12T02:06:28.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.651+0000 7fe6f6ffd640 1 --2- 172.21.15.19:0/1138258098 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe6e806be30 0x7fe6e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:28.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.651+0000 7fe6f6ffd640 1 -- 172.21.15.19:0/1138258098 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 9313+0+0 (secure 0 0 0) 0x7fe6f808b050 con 0x7fe70806f700 2024-09-12T02:06:28.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.651+0000 7fe705d9b640 1 --2- 172.21.15.19:0/1138258098 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe6e806be30 0x7fe6e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:28.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.652+0000 7fe705d9b640 1 --2- 172.21.15.19:0/1138258098 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe6e806be30 0x7fe6e806e2f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe708157c00 tx=0x7fe6fc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:28.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.655+0000 7fe6f6ffd640 1 -- 172.21.15.19:0/1138258098 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe6f80585d0 con 0x7fe70806f700 2024-09-12T02:06:28.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.841+0000 7fe70cd86640 1 -- 172.21.15.19:0/1138258098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe7081590d0 con 0x7fe70806f700 2024-09-12T02:06:28.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.842+0000 7fe6f6ffd640 1 -- 172.21.15.19:0/1138258098 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 72 entries v130) ==== 81+0+4406 (secure 0 0 0) 0x7fe6f805c8d0 con 0x7fe70806f700 2024-09-12T02:06:28.843 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3550997018 2024-09-13T02:06:14.593467+0000 2024-09-12T02:06:28.843 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/2316269679 2024-09-13T02:06:09.251347+0000 2024-09-12T02:06:28.843 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/2316269679 2024-09-13T02:06:09.251347+0000 2024-09-12T02:06:28.843 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3065327567 2024-09-13T02:05:58.503981+0000 2024-09-12T02:06:28.843 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/1975440909 2024-09-13T02:05:43.189507+0000 2024-09-12T02:06:28.843 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3910102099 2024-09-13T02:05:24.866817+0000 2024-09-12T02:06:28.843 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/2839344629 2024-09-13T02:05:20.836728+0000 2024-09-12T02:06:28.843 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/2072535494 2024-09-13T02:02:44.440900+0000 2024-09-12T02:06:28.843 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2405422603 2024-09-13T02:04:31.542456+0000 2024-09-12T02:06:28.843 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/1875416968 2024-09-13T02:03:41.731211+0000 2024-09-12T02:06:28.843 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/4124612835 2024-09-13T02:03:35.697598+0000 2024-09-12T02:06:28.843 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/1101861733 2024-09-13T02:02:54.487980+0000 2024-09-12T02:06:28.844 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3598057058 2024-09-13T02:03:24.636971+0000 2024-09-12T02:06:28.844 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/626316140 2024-09-13T02:04:41.744221+0000 2024-09-12T02:06:28.844 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/46689513 2024-09-13T02:03:28.654366+0000 2024-09-12T02:06:28.844 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3985859189 2024-09-13T02:04:09.906953+0000 2024-09-12T02:06:28.844 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3866905323 2024-09-13T02:03:54.557384+0000 2024-09-12T02:06:28.844 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3997032797 2024-09-13T02:05:16.751616+0000 2024-09-12T02:06:28.844 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:06:28.844 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3995150987 2024-09-13T02:03:22.315702+0000 2024-09-12T02:06:28.844 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/46689513 2024-09-13T02:03:28.654366+0000 2024-09-12T02:06:28.844 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/4287312235 2024-09-13T02:03:11.277301+0000 2024-09-12T02:06:28.844 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/961161264 2024-09-13T02:04:17.973298+0000 2024-09-12T02:06:28.844 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/1975440909 2024-09-13T02:05:43.189507+0000 2024-09-12T02:06:28.844 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3774685060 2024-09-13T02:02:24.172690+0000 2024-09-12T02:06:28.845 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3279314147 2024-09-13T02:04:33.778955+0000 2024-09-12T02:06:28.845 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/1800650480 2024-09-13T02:03:56.737366+0000 2024-09-12T02:06:28.845 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3550997018 2024-09-13T02:06:14.593467+0000 2024-09-12T02:06:28.845 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3279314147 2024-09-13T02:04:33.778955+0000 2024-09-12T02:06:28.845 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/4087550164 2024-09-13T02:04:57.990681+0000 2024-09-12T02:06:28.845 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2201380819 2024-09-13T02:05:10.473806+0000 2024-09-12T02:06:28.845 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3995150987 2024-09-13T02:03:22.315702+0000 2024-09-12T02:06:28.845 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/4124612835 2024-09-13T02:03:35.697598+0000 2024-09-12T02:06:28.845 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/2072535494 2024-09-13T02:02:44.440900+0000 2024-09-12T02:06:28.845 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3985859189 2024-09-13T02:04:09.906953+0000 2024-09-12T02:06:28.845 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/613869354 2024-09-13T02:02:39.104650+0000 2024-09-12T02:06:28.845 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/613869354 2024-09-13T02:02:39.104650+0000 2024-09-12T02:06:28.845 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/650556594 2024-09-13T02:02:50.470816+0000 2024-09-12T02:06:28.845 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3818656517 2024-09-13T02:05:38.158172+0000 2024-09-12T02:06:28.846 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/4287312235 2024-09-13T02:03:11.277301+0000 2024-09-12T02:06:28.846 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/650556594 2024-09-13T02:02:50.470816+0000 2024-09-12T02:06:28.846 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/4107165769 2024-09-13T02:04:03.869164+0000 2024-09-12T02:06:28.846 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/1101861733 2024-09-13T02:02:54.487980+0000 2024-09-12T02:06:28.846 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/1800650480 2024-09-13T02:03:56.737366+0000 2024-09-12T02:06:28.846 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2017831568 2024-09-13T02:04:45.871893+0000 2024-09-12T02:06:28.846 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3136344951 2024-09-13T02:02:58.521234+0000 2024-09-12T02:06:28.846 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3136344951 2024-09-13T02:02:58.521234+0000 2024-09-12T02:06:28.846 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/4107165769 2024-09-13T02:04:03.869164+0000 2024-09-12T02:06:28.846 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/926329492 2024-09-13T02:04:13.937157+0000 2024-09-12T02:06:28.846 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3866905323 2024-09-13T02:03:54.557384+0000 2024-09-12T02:06:28.846 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/926329492 2024-09-13T02:04:13.937157+0000 2024-09-12T02:06:28.846 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/961161264 2024-09-13T02:04:17.973298+0000 2024-09-12T02:06:28.846 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2201380819 2024-09-13T02:05:10.473806+0000 2024-09-12T02:06:28.847 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3910102099 2024-09-13T02:05:24.866817+0000 2024-09-12T02:06:28.847 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2405422603 2024-09-13T02:04:31.542456+0000 2024-09-12T02:06:28.847 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/2333858704 2024-09-13T02:04:37.802344+0000 2024-09-12T02:06:28.847 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/1875416968 2024-09-13T02:03:41.731211+0000 2024-09-12T02:06:28.847 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2333858704 2024-09-13T02:04:37.802344+0000 2024-09-12T02:06:28.847 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/626316140 2024-09-13T02:04:41.744221+0000 2024-09-12T02:06:28.847 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/2017831568 2024-09-13T02:04:45.871893+0000 2024-09-12T02:06:28.847 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/3545886366 2024-09-13T02:04:49.907498+0000 2024-09-12T02:06:28.847 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3818656517 2024-09-13T02:05:38.158172+0000 2024-09-12T02:06:28.847 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3545886366 2024-09-13T02:04:49.907498+0000 2024-09-12T02:06:28.847 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3377480547 2024-09-13T02:04:53.949050+0000 2024-09-12T02:06:28.847 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3598057058 2024-09-13T02:03:24.636971+0000 2024-09-12T02:06:28.847 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6837/3377480547 2024-09-13T02:04:53.949050+0000 2024-09-12T02:06:28.847 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/3065327567 2024-09-13T02:05:58.503981+0000 2024-09-12T02:06:28.847 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/4087550164 2024-09-13T02:04:57.990681+0000 2024-09-12T02:06:28.848 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6834/2195405214 2024-09-13T02:05:12.791934+0000 2024-09-12T02:06:28.848 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/2195405214 2024-09-13T02:05:12.791934+0000 2024-09-12T02:06:28.848 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.135:6834/3997032797 2024-09-13T02:05:16.751616+0000 2024-09-12T02:06:28.848 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6832/2839344629 2024-09-13T02:05:20.836728+0000 2024-09-12T02:06:28.849 INFO:teuthology.orchestra.run.smithi019.stderr:listed 72 entries 2024-09-12T02:06:28.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.844+0000 7fe70cd86640 1 -- 172.21.15.19:0/1138258098 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe6e806be30 msgr2=0x7fe6e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:28.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.844+0000 7fe70cd86640 1 --2- 172.21.15.19:0/1138258098 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe6e806be30 0x7fe6e806e2f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe708157c00 tx=0x7fe6fc009190 comp rx=0 tx=0).stop 2024-09-12T02:06:28.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.844+0000 7fe70cd86640 1 -- 172.21.15.19:0/1138258098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe70806f700 msgr2=0x7fe708142f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:28.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.844+0000 7fe70cd86640 1 --2- 172.21.15.19:0/1138258098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe70806f700 0x7fe708142f50 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800c3f0 tx=0x7fe6f800c8b0 comp rx=0 tx=0).stop 2024-09-12T02:06:28.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.844+0000 7fe70cd86640 1 -- 172.21.15.19:0/1138258098 shutdown_connections 2024-09-12T02:06:28.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.844+0000 7fe70cd86640 1 --2- 172.21.15.19:0/1138258098 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe6e806be30 0x7fe6e806e2f0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:28.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.844+0000 7fe70cd86640 1 --2- 172.21.15.19:0/1138258098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe70815b300 0x7fe7081e3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:28.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.844+0000 7fe70cd86640 1 --2- 172.21.15.19:0/1138258098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe708072d30 0x7fe708155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:28.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.844+0000 7fe70cd86640 1 --2- 172.21.15.19:0/1138258098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe70806f700 0x7fe708142f50 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:28.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.844+0000 7fe70cd86640 1 -- 172.21.15.19:0/1138258098 >> 172.21.15.19:0/1138258098 conn(0x7fe708067d70 msgr2=0x7fe70806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:28.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.844+0000 7fe70cd86640 1 -- 172.21.15.19:0/1138258098 shutdown_connections 2024-09-12T02:06:28.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:28.844+0000 7fe70cd86640 1 -- 172.21.15.19:0/1138258098 wait complete. 2024-09-12T02:06:28.856 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:06:28.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:28.856 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-12T02:06:28.890 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:06:28.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:28.890 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:06:28.946 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:06:29.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.090+0000 7fd069add640 1 Processor -- start 2024-09-12T02:06:29.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.090+0000 7fd069add640 1 -- start start 2024-09-12T02:06:29.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.091+0000 7fd069add640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd064161a20 0x7fd0640d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:29.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.091+0000 7fd069add640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0640d1420 0x7fd0640cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:29.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.091+0000 7fd069add640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd06406e820 con 0x7fd0640cf160 2024-09-12T02:06:29.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.091+0000 7fd069add640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd064161e00 con 0x7fd0640d1420 2024-09-12T02:06:29.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.091+0000 7fd069add640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd0640d1830 con 0x7fd064161a20 2024-09-12T02:06:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.091+0000 7fd062ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0640d1420 0x7fd0640cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.091+0000 7fd063fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd0640cf160 0x7fd0640b5f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36672/0 (socket says 172.21.15.19:36672) 2024-09-12T02:06:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.091+0000 7fd063fff640 1 -- 172.21.15.19:0/3053996921 learned_addr learned my addr 172.21.15.19:0/3053996921 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.091+0000 7fd0637fe640 1 --2- 172.21.15.19:0/3053996921 >> v2:172.21.15.135:3300/0 conn(0x7fd064161a20 0x7fd0640d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.091+0000 7fd062ffd640 1 -- 172.21.15.19:0/3053996921 >> v2:172.21.15.135:3300/0 conn(0x7fd064161a20 msgr2=0x7fd0640d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.091+0000 7fd062ffd640 1 --2- 172.21.15.19:0/3053996921 >> v2:172.21.15.135:3300/0 conn(0x7fd064161a20 0x7fd0640d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.091+0000 7fd062ffd640 1 -- 172.21.15.19:0/3053996921 >> v1:172.21.15.19:6789/0 conn(0x7fd0640cf160 legacy=0x7fd0640b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.092+0000 7fd062ffd640 1 -- 172.21.15.19:0/3053996921 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0640cf980 con 0x7fd0640d1420 2024-09-12T02:06:29.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.092+0000 7fd0627fc640 1 -- 172.21.15.19:0/3053996921 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3605787304 0 0) 0x7fd06406e820 con 0x7fd0640cf160 2024-09-12T02:06:29.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.092+0000 7fd062ffd640 1 --2- 172.21.15.19:0/3053996921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0640d1420 0x7fd0640cec20 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7fd06408c910 tx=0x7fd05802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1d9865198cce0b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:29.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.092+0000 7fd0627fc640 1 -- 172.21.15.19:0/3053996921 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058037070 con 0x7fd0640d1420 2024-09-12T02:06:29.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.092+0000 7fd0627fc640 1 -- 172.21.15.19:0/3053996921 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd058032440 con 0x7fd0640d1420 2024-09-12T02:06:29.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.093+0000 7fd0627fc640 1 -- 172.21.15.19:0/3053996921 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058032810 con 0x7fd0640d1420 2024-09-12T02:06:29.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.093+0000 7fd069add640 1 -- 172.21.15.19:0/3053996921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0640d1420 msgr2=0x7fd0640cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:29.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.093+0000 7fd069add640 1 --2- 172.21.15.19:0/3053996921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0640d1420 0x7fd0640cec20 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7fd06408c910 tx=0x7fd05802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.093+0000 7fd069add640 1 -- 172.21.15.19:0/3053996921 shutdown_connections 2024-09-12T02:06:29.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.093+0000 7fd069add640 1 --2- 172.21.15.19:0/3053996921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0640d1420 0x7fd0640cec20 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.093+0000 7fd069add640 1 --2- 172.21.15.19:0/3053996921 >> v2:172.21.15.135:3300/0 conn(0x7fd064161a20 0x7fd0640d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.093+0000 7fd069add640 1 -- 172.21.15.19:0/3053996921 >> 172.21.15.19:0/3053996921 conn(0x7fd06409d850 msgr2=0x7fd06408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:29.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.093+0000 7fd069add640 1 -- 172.21.15.19:0/3053996921 shutdown_connections 2024-09-12T02:06:29.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.093+0000 7fd069add640 1 -- 172.21.15.19:0/3053996921 wait complete. 2024-09-12T02:06:29.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.094+0000 7fd069add640 1 Processor -- start 2024-09-12T02:06:29.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.095+0000 7fd069add640 1 -- start start 2024-09-12T02:06:29.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.095+0000 7fd069add640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0640cf160 0x7fd06415bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:29.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.095+0000 7fd069add640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd064161a20 0x7fd064152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:29.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.095+0000 7fd069add640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0640ce360 0x7fd0641f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:29.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.095+0000 7fd069add640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd0640cff00 con 0x7fd0640ce360 2024-09-12T02:06:29.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.095+0000 7fd069add640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd06406d050 con 0x7fd0640cf160 2024-09-12T02:06:29.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.095+0000 7fd069add640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd06406d2f0 con 0x7fd064161a20 2024-09-12T02:06:29.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.096+0000 7fd063fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0640ce360 0x7fd0641f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:29.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.096+0000 7fd063fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0640ce360 0x7fd0641f4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40824/0 (socket says 172.21.15.19:40824) 2024-09-12T02:06:29.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.096+0000 7fd063fff640 1 -- 172.21.15.19:0/446737749 learned_addr learned my addr 172.21.15.19:0/446737749 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:29.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.096+0000 7fd062ffd640 1 --2- 172.21.15.19:0/446737749 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd064161a20 0x7fd064152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:29.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.096+0000 7fd0637fe640 1 --2- 172.21.15.19:0/446737749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0640cf160 0x7fd06415bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:29.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.096+0000 7fd063fff640 1 -- 172.21.15.19:0/446737749 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd064161a20 msgr2=0x7fd064152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:29.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.096+0000 7fd063fff640 1 --2- 172.21.15.19:0/446737749 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd064161a20 0x7fd064152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.096+0000 7fd063fff640 1 -- 172.21.15.19:0/446737749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0640cf160 msgr2=0x7fd06415bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:29.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.096+0000 7fd063fff640 1 --2- 172.21.15.19:0/446737749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0640cf160 0x7fd06415bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.096+0000 7fd063fff640 1 -- 172.21.15.19:0/446737749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd064152cd0 con 0x7fd0640ce360 2024-09-12T02:06:29.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.096+0000 7fd0637fe640 1 --2- 172.21.15.19:0/446737749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0640cf160 0x7fd06415bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:29.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.096+0000 7fd063fff640 1 --2- 172.21.15.19:0/446737749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0640ce360 0x7fd0641f4140 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00c810 tx=0x7fd05c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:29.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.096+0000 7fd04bfff640 1 -- 172.21.15.19:0/446737749 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05c018070 con 0x7fd0640ce360 2024-09-12T02:06:29.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.096+0000 7fd04bfff640 1 -- 172.21.15.19:0/446737749 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd05c00a640 con 0x7fd0640ce360 2024-09-12T02:06:29.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.096+0000 7fd069add640 1 -- 172.21.15.19:0/446737749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0640b8b50 con 0x7fd0640ce360 2024-09-12T02:06:29.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.096+0000 7fd04bfff640 1 -- 172.21.15.19:0/446737749 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05c00aa30 con 0x7fd0640ce360 2024-09-12T02:06:29.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.096+0000 7fd069add640 1 -- 172.21.15.19:0/446737749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0640b9110 con 0x7fd0640ce360 2024-09-12T02:06:29.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.097+0000 7fd069add640 1 -- 172.21.15.19:0/446737749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0640b21c0 con 0x7fd0640ce360 2024-09-12T02:06:29.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.098+0000 7fd04bfff640 1 -- 172.21.15.19:0/446737749 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd05c01b070 con 0x7fd0640ce360 2024-09-12T02:06:29.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.098+0000 7fd04bfff640 1 --2- 172.21.15.19:0/446737749 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd05006be30 0x7fd05006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:29.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.099+0000 7fd04bfff640 1 -- 172.21.15.19:0/446737749 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 9313+0+0 (secure 0 0 0) 0x7fd05c08b240 con 0x7fd0640ce360 2024-09-12T02:06:29.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.099+0000 7fd0637fe640 1 --2- 172.21.15.19:0/446737749 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd05006be30 0x7fd05006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:29.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.099+0000 7fd0637fe640 1 --2- 172.21.15.19:0/446737749 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd05006be30 0x7fd05006e2f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd054009a20 tx=0x7fd054008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:29.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.103+0000 7fd04bfff640 1 -- 172.21.15.19:0/446737749 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd05c058e10 con 0x7fd0640ce360 2024-09-12T02:06:29.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.313+0000 7fd069add640 1 -- 172.21.15.19:0/446737749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd06408c280 con 0x7fd0640ce360 2024-09-12T02:06:29.314 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:06:29.314+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:06:29.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.316+0000 7fd04bfff640 1 -- 172.21.15.19:0/446737749 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v303) ==== 161+0+0 (secure 0 0 0) 0x7fd05c058710 con 0x7fd0640ce360 2024-09-12T02:06:29.316 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:06:29.318 INFO:tasks.ceph.mds.c.smithi019.stderr: -1764> 2024-09-12T02:06:20.618+0000 7f6cf7bd4640 -1 mds.0.openfiles _load_finish: corrupted header/values: End of buffer [buffer:2] 2024-09-12T02:06:29.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.318+0000 7fd069add640 1 -- 172.21.15.19:0/446737749 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd05006be30 msgr2=0x7fd05006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:29.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.318+0000 7fd069add640 1 --2- 172.21.15.19:0/446737749 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd05006be30 0x7fd05006e2f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd054009a20 tx=0x7fd054008040 comp rx=0 tx=0).stop 2024-09-12T02:06:29.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.318+0000 7fd069add640 1 -- 172.21.15.19:0/446737749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0640ce360 msgr2=0x7fd0641f4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:29.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.318+0000 7fd069add640 1 --2- 172.21.15.19:0/446737749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0640ce360 0x7fd0641f4140 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00c810 tx=0x7fd05c00ccd0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.318+0000 7fd069add640 1 -- 172.21.15.19:0/446737749 shutdown_connections 2024-09-12T02:06:29.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.318+0000 7fd069add640 1 --2- 172.21.15.19:0/446737749 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd05006be30 0x7fd05006e2f0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.318+0000 7fd069add640 1 --2- 172.21.15.19:0/446737749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0640ce360 0x7fd0641f4140 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.318+0000 7fd069add640 1 --2- 172.21.15.19:0/446737749 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd064161a20 0x7fd064152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.318+0000 7fd069add640 1 --2- 172.21.15.19:0/446737749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0640cf160 0x7fd06415bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.318+0000 7fd069add640 1 -- 172.21.15.19:0/446737749 >> 172.21.15.19:0/446737749 conn(0x7fd06409d850 msgr2=0x7fd06415e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:29.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.319+0000 7fd069add640 1 -- 172.21.15.19:0/446737749 shutdown_connections 2024-09-12T02:06:29.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.319+0000 7fd069add640 1 -- 172.21.15.19:0/446737749 wait complete. 2024-09-12T02:06:29.321 INFO:tasks.ceph.mds.c.smithi019.stderr: -642> 2024-09-12T02:06:24.606+0000 7f6cfbbdc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:06:29.331 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:06:29.347 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:06:29.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.436+0000 7febde4f8640 1 Processor -- start 2024-09-12T02:06:29.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.436+0000 7febde4f8640 1 -- start start 2024-09-12T02:06:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.437+0000 7febde4f8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7febd815e760 0x7febd806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.437+0000 7febde4f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febd80d4fd0 0x7febd80cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.437+0000 7febde4f8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7febd80b3650 0x7febd80cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.437+0000 7febde4f8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7febd80d2700 con 0x7febd815e760 2024-09-12T02:06:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.437+0000 7febde4f8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7febd80cedb0 con 0x7febd80b3650 2024-09-12T02:06:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.437+0000 7febde4f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7febd80cf090 con 0x7febd80d4fd0 2024-09-12T02:06:29.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.437+0000 7febd7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7febd815e760 0x7febd806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:29.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.437+0000 7febd7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7febd815e760 0x7febd806cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40852/0 (socket says 172.21.15.19:40852) 2024-09-12T02:06:29.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.437+0000 7febd7fff640 1 -- 172.21.15.19:0/1472954115 learned_addr learned my addr 172.21.15.19:0/1472954115 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:29.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.437+0000 7febdca95640 1 --2- 172.21.15.19:0/1472954115 >> v2:172.21.15.135:3300/0 conn(0x7febd80b3650 0x7febd80cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:29.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.437+0000 7febd77fe640 1 --2- 172.21.15.19:0/1472954115 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febd80d4fd0 0x7febd80cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:29.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.437+0000 7febd7fff640 1 -- 172.21.15.19:0/1472954115 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febd80d4fd0 msgr2=0x7febd80cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:29.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.437+0000 7febd7fff640 1 --2- 172.21.15.19:0/1472954115 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febd80d4fd0 0x7febd80cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.437+0000 7febd7fff640 1 -- 172.21.15.19:0/1472954115 >> v2:172.21.15.135:3300/0 conn(0x7febd80b3650 msgr2=0x7febd80cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:29.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.437+0000 7febd7fff640 1 --2- 172.21.15.19:0/1472954115 >> v2:172.21.15.135:3300/0 conn(0x7febd80b3650 0x7febd80cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.437+0000 7febd7fff640 1 -- 172.21.15.19:0/1472954115 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd80b3c80 con 0x7febd815e760 2024-09-12T02:06:29.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.438+0000 7febd7fff640 1 --2- 172.21.15.19:0/1472954115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febd815e760 0x7febd806cdd0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7febd808c8c0 tx=0x7febc802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688a2d546d250b67 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:29.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.438+0000 7febd6ffd640 1 -- 172.21.15.19:0/1472954115 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8037070 con 0x7febd815e760 2024-09-12T02:06:29.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.438+0000 7febd6ffd640 1 -- 172.21.15.19:0/1472954115 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc8032440 con 0x7febd815e760 2024-09-12T02:06:29.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.438+0000 7febd6ffd640 1 -- 172.21.15.19:0/1472954115 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8032810 con 0x7febd815e760 2024-09-12T02:06:29.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.438+0000 7febde4f8640 1 -- 172.21.15.19:0/1472954115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febd815e760 msgr2=0x7febd806cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:29.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.438+0000 7febde4f8640 1 --2- 172.21.15.19:0/1472954115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febd815e760 0x7febd806cdd0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7febd808c8c0 tx=0x7febc802a140 comp rx=0 tx=0).stop 2024-09-12T02:06:29.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.439+0000 7febde4f8640 1 -- 172.21.15.19:0/1472954115 shutdown_connections 2024-09-12T02:06:29.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.439+0000 7febde4f8640 1 --2- 172.21.15.19:0/1472954115 >> v2:172.21.15.135:3300/0 conn(0x7febd80b3650 0x7febd80cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.439+0000 7febde4f8640 1 --2- 172.21.15.19:0/1472954115 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febd80d4fd0 0x7febd80cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.439+0000 7febde4f8640 1 --2- 172.21.15.19:0/1472954115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febd815e760 0x7febd806cdd0 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.439+0000 7febde4f8640 1 -- 172.21.15.19:0/1472954115 >> 172.21.15.19:0/1472954115 conn(0x7febd808bfc0 msgr2=0x7febd80d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:29.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.439+0000 7febde4f8640 1 -- 172.21.15.19:0/1472954115 shutdown_connections 2024-09-12T02:06:29.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.439+0000 7febde4f8640 1 -- 172.21.15.19:0/1472954115 wait complete. 2024-09-12T02:06:29.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.440+0000 7febde4f8640 1 Processor -- start 2024-09-12T02:06:29.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.440+0000 7febde4f8640 1 -- start start 2024-09-12T02:06:29.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febde4f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febd80b3650 0x7febd80b88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:29.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febde4f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febd80d4fd0 0x7febd80ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:29.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febde4f8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febd815e760 0x7febd80cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:29.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febde4f8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7febd80d3230 con 0x7febd80d4fd0 2024-09-12T02:06:29.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febde4f8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7febd80d30b0 con 0x7febd815e760 2024-09-12T02:06:29.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febde4f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7febd80d33b0 con 0x7febd80b3650 2024-09-12T02:06:29.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febd77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febd80d4fd0 0x7febd80ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:29.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febd77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febd80d4fd0 0x7febd80ca7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40860/0 (socket says 172.21.15.19:40860) 2024-09-12T02:06:29.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febd77fe640 1 -- 172.21.15.19:0/138728557 learned_addr learned my addr 172.21.15.19:0/138728557 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:29.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febd7fff640 1 --2- 172.21.15.19:0/138728557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febd80b3650 0x7febd80b88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:29.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febdca95640 1 --2- 172.21.15.19:0/138728557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febd815e760 0x7febd80cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:29.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febd77fe640 1 -- 172.21.15.19:0/138728557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febd80b3650 msgr2=0x7febd80b88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:29.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febd77fe640 1 --2- 172.21.15.19:0/138728557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febd80b3650 0x7febd80b88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febd77fe640 1 -- 172.21.15.19:0/138728557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febd815e760 msgr2=0x7febd80cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:29.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febd77fe640 1 --2- 172.21.15.19:0/138728557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febd815e760 0x7febd80cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febd77fe640 1 -- 172.21.15.19:0/138728557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd80cd4c0 con 0x7febd80d4fd0 2024-09-12T02:06:29.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febd77fe640 1 --2- 172.21.15.19:0/138728557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febd80d4fd0 0x7febd80ca7c0 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7febcc00d800 tx=0x7febcc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:29.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febd4ff9640 1 -- 172.21.15.19:0/138728557 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febcc004020 con 0x7febd80d4fd0 2024-09-12T02:06:29.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.441+0000 7febd4ff9640 1 -- 172.21.15.19:0/138728557 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febcc0041c0 con 0x7febd80d4fd0 2024-09-12T02:06:29.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.442+0000 7febde4f8640 1 -- 172.21.15.19:0/138728557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febd80cd7a0 con 0x7febd80d4fd0 2024-09-12T02:06:29.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.442+0000 7febd4ff9640 1 -- 172.21.15.19:0/138728557 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febcc0043b0 con 0x7febd80d4fd0 2024-09-12T02:06:29.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.442+0000 7febde4f8640 1 -- 172.21.15.19:0/138728557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febd80cdd60 con 0x7febd80d4fd0 2024-09-12T02:06:29.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.442+0000 7febde4f8640 1 -- 172.21.15.19:0/138728557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febd80d36a0 con 0x7febd80d4fd0 2024-09-12T02:06:29.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.443+0000 7febd4ff9640 1 -- 172.21.15.19:0/138728557 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7febcc01b020 con 0x7febd80d4fd0 2024-09-12T02:06:29.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.443+0000 7febd4ff9640 1 --2- 172.21.15.19:0/138728557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7febc406be60 0x7febc406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:29.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.444+0000 7febd4ff9640 1 -- 172.21.15.19:0/138728557 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 9399+0+0 (secure 0 0 0) 0x7febcc08b6c0 con 0x7febd80d4fd0 2024-09-12T02:06:29.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.444+0000 7febd7fff640 1 --2- 172.21.15.19:0/138728557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7febc406be60 0x7febc406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:29.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.444+0000 7febd7fff640 1 --2- 172.21.15.19:0/138728557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7febc406be60 0x7febc406e320 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7febc8034000 tx=0x7febc802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:29.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.448+0000 7febd4ff9640 1 -- 172.21.15.19:0/138728557 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7febcc022020 con 0x7febd80d4fd0 2024-09-12T02:06:29.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:29.695+0000 7febde4f8640 1 -- 172.21.15.19:0/138728557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7febd80b6d20 con 0x7febd80d4fd0 2024-09-12T02:06:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.317+0000 7febd4ff9640 1 -- 172.21.15.19:0/138728557 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v304) ==== 107+0+0 (secure 0 0 0) 0x7febcc058bf0 con 0x7febd80d4fd0 2024-09-12T02:06:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:nothing to do: rank is not damaged 2024-09-12T02:06:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.320+0000 7febde4f8640 1 -- 172.21.15.19:0/138728557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7febc406be60 msgr2=0x7febc406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.320+0000 7febde4f8640 1 --2- 172.21.15.19:0/138728557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7febc406be60 0x7febc406e320 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7febc8034000 tx=0x7febc802e000 comp rx=0 tx=0).stop 2024-09-12T02:06:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.320+0000 7febde4f8640 1 -- 172.21.15.19:0/138728557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febd80d4fd0 msgr2=0x7febd80ca7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.320+0000 7febde4f8640 1 --2- 172.21.15.19:0/138728557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febd80d4fd0 0x7febd80ca7c0 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7febcc00d800 tx=0x7febcc00dcc0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.320+0000 7febde4f8640 1 -- 172.21.15.19:0/138728557 shutdown_connections 2024-09-12T02:06:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.320+0000 7febde4f8640 1 --2- 172.21.15.19:0/138728557 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7febc406be60 0x7febc406e320 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.320+0000 7febde4f8640 1 --2- 172.21.15.19:0/138728557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febd815e760 0x7febd80cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.320+0000 7febde4f8640 1 --2- 172.21.15.19:0/138728557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febd80d4fd0 0x7febd80ca7c0 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.320+0000 7febde4f8640 1 --2- 172.21.15.19:0/138728557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febd80b3650 0x7febd80b88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.320+0000 7febde4f8640 1 -- 172.21.15.19:0/138728557 >> 172.21.15.19:0/138728557 conn(0x7febd808bfc0 msgr2=0x7febd80b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:30.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.320+0000 7febde4f8640 1 -- 172.21.15.19:0/138728557 shutdown_connections 2024-09-12T02:06:30.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.320+0000 7febde4f8640 1 -- 172.21.15.19:0/138728557 wait complete. 2024-09-12T02:06:30.335 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:06:30.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.422+0000 7f22ccaeaf40 1 Processor -- start 2024-09-12T02:06:30.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.422+0000 7f22ccaeaf40 1 -- start start 2024-09-12T02:06:30.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.423+0000 7f22ccaeaf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b3df570350 0x55b3df56f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.423+0000 7f22ccaeaf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3df5b5970 0x55b3df6330b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.423+0000 7f22ccaeaf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3df63d3d0 0x55b3df6335f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.423+0000 7f22ccaeaf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b3df4bf510 con 0x55b3df5b5970 2024-09-12T02:06:30.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.423+0000 7f22ccaeaf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b3df518c50 con 0x55b3df63d3d0 2024-09-12T02:06:30.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.423+0000 7f22ccaeaf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55b3df643b70 con 0x55b3df570350 2024-09-12T02:06:30.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.423+0000 7f22c9ddf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3df5b5970 0x55b3df6330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.423+0000 7f22c9ddf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3df5b5970 0x55b3df6330b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40872/0 (socket says 172.21.15.19:40872) 2024-09-12T02:06:30.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.423+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1070553781 learned_addr learned my addr 172.21.15.19:0/1070553781 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:30.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.423+0000 7f22cade1640 1 --2- 172.21.15.19:0/1070553781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3df63d3d0 0x55b3df6335f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.423+0000 7f22ca5e0640 1 --2- 172.21.15.19:0/1070553781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b3df570350 0x55b3df56f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.423+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1070553781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b3df570350 msgr2=0x55b3df56f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:30.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.423+0000 7f22c9ddf640 1 --2- 172.21.15.19:0/1070553781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b3df570350 0x55b3df56f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.423+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1070553781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3df63d3d0 msgr2=0x55b3df6335f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:30.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.423+0000 7f22c9ddf640 1 --2- 172.21.15.19:0/1070553781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3df63d3d0 0x55b3df6335f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.423+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1070553781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3df56dff0 con 0x55b3df5b5970 2024-09-12T02:06:30.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.424+0000 7f22c9ddf640 1 --2- 172.21.15.19:0/1070553781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3df5b5970 0x55b3df6330b0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f22c0001eb0 tx=0x7f22c000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7df51cb0d816db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:30.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.424+0000 7f22c8ddd640 1 -- 172.21.15.19:0/1070553781 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c0012020 con 0x55b3df5b5970 2024-09-12T02:06:30.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.424+0000 7f22c8ddd640 1 -- 172.21.15.19:0/1070553781 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c000e670 con 0x55b3df5b5970 2024-09-12T02:06:30.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.424+0000 7f22c8ddd640 1 -- 172.21.15.19:0/1070553781 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c000ea40 con 0x55b3df5b5970 2024-09-12T02:06:30.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.424+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1070553781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3df5b5970 msgr2=0x55b3df6330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.424+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1070553781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3df5b5970 0x55b3df6330b0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f22c0001eb0 tx=0x7f22c000b780 comp rx=0 tx=0).stop 2024-09-12T02:06:30.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.424+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1070553781 shutdown_connections 2024-09-12T02:06:30.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.424+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1070553781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3df63d3d0 0x55b3df6335f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.424+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1070553781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3df5b5970 0x55b3df6330b0 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.424+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1070553781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b3df570350 0x55b3df56f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.424+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1070553781 >> 172.21.15.19:0/1070553781 conn(0x55b3df56d9e0 msgr2=0x55b3df644640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:30.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.424+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1070553781 shutdown_connections 2024-09-12T02:06:30.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.424+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1070553781 wait complete. 2024-09-12T02:06:30.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.425+0000 7f22ccaeaf40 1 Processor -- start 2024-09-12T02:06:30.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.425+0000 7f22ccaeaf40 1 -- start start 2024-09-12T02:06:30.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.426+0000 7f22ccaeaf40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b3df570350 0x55b3df644bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.426+0000 7f22ccaeaf40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3df5b5970 0x55b3df62ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.426+0000 7f22ccaeaf40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3df63d3d0 0x55b3df5b6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.426+0000 7f22ccaeaf40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b3df5b4130 con 0x55b3df5b5970 2024-09-12T02:06:30.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.426+0000 7f22ccaeaf40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b3df642f80 con 0x55b3df63d3d0 2024-09-12T02:06:30.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.426+0000 7f22ccaeaf40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55b3df56fc10 con 0x55b3df570350 2024-09-12T02:06:30.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.426+0000 7f22c9ddf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3df5b5970 0x55b3df62ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.426+0000 7f22c9ddf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3df5b5970 0x55b3df62ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40888/0 (socket says 172.21.15.19:40888) 2024-09-12T02:06:30.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.426+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 learned_addr learned my addr 172.21.15.19:0/1807299541 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:30.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.426+0000 7f22ca5e0640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b3df570350 0x55b3df644bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.426+0000 7f22cade1640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3df63d3d0 0x55b3df5b6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.426+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b3df570350 msgr2=0x55b3df644bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.426+0000 7f22c9ddf640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b3df570350 0x55b3df644bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.426+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3df63d3d0 msgr2=0x55b3df5b6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.426+0000 7f22c9ddf640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3df63d3d0 0x55b3df5b6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.426+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3df639560 con 0x55b3df5b5970 2024-09-12T02:06:30.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.427+0000 7f22c9ddf640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3df5b5970 0x55b3df62ec80 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f22c000b7c0 tx=0x7f22c0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:30.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.427+0000 7f22bb7fe640 1 -- 172.21.15.19:0/1807299541 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c0027070 con 0x55b3df5b5970 2024-09-12T02:06:30.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.427+0000 7f22bb7fe640 1 -- 172.21.15.19:0/1807299541 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c000e470 con 0x55b3df5b5970 2024-09-12T02:06:30.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.427+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3df645810 con 0x55b3df5b5970 2024-09-12T02:06:30.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.427+0000 7f22bb7fe640 1 -- 172.21.15.19:0/1807299541 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c00199b0 con 0x55b3df5b5970 2024-09-12T02:06:30.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.427+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3df645af0 con 0x55b3df5b5970 2024-09-12T02:06:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.428+0000 7f22bb7fe640 1 -- 172.21.15.19:0/1807299541 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22c002a070 con 0x55b3df5b5970 2024-09-12T02:06:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.429+0000 7f22bb7fe640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f22ac06a810 0x7f22ac06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.429+0000 7f22bb7fe640 1 -- 172.21.15.19:0/1807299541 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 9399+0+0 (secure 0 0 0) 0x7f22c008c120 con 0x55b3df5b5970 2024-09-12T02:06:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.429+0000 7f22ca5e0640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f22ac06a810 0x7f22ac06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.433 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:06:30.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.429+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55b3df641740 0x55b3df641b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.429+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df642060 con 0x55b3df641740 2024-09-12T02:06:30.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.429+0000 7f22cade1640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55b3df641740 0x55b3df641b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.430+0000 7f22ca5e0640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f22ac06a810 0x7f22ac06ccd0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f22bc001620 tx=0x7f22bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:30.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.430+0000 7f22cade1640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55b3df641740 0x55b3df641b20 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:30.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.432+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v131'1128 uv1102 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.432+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df642430 con 0x55b3df641740 2024-09-12T02:06:30.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.433+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v131'1129 uv1129 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.433+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df642800 con 0x55b3df641740 2024-09-12T02:06:30.435 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:06:30.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.434+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v131'1130 uv1130 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.434+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e6f50 con 0x55b3df641740 2024-09-12T02:06:30.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.436+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v131'1131 uv1131 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.436+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e72f0 con 0x55b3df641740 2024-09-12T02:06:30.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.437+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v131'1132 uv1132 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.437+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e5f40 con 0x55b3df641740 2024-09-12T02:06:30.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.438+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v131'1133 uv1133 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.438+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e62e0 con 0x55b3df641740 2024-09-12T02:06:30.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.440+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v131'1134 uv1108 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.440+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e6680 con 0x55b3df641740 2024-09-12T02:06:30.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.441+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v131'1135 uv1135 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.441+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e6680 con 0x55b3df641740 2024-09-12T02:06:30.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.442+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v131'1136 uv1136 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.443 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:06:30.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.442+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e6680 con 0x55b3df641740 2024-09-12T02:06:30.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.444+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v131'1137 uv1137 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.444+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e6680 con 0x55b3df641740 2024-09-12T02:06:30.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.445+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v131'1138 uv1138 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.445+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e6680 con 0x55b3df641740 2024-09-12T02:06:30.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.446+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v131'1139 uv1139 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.446+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e6680 con 0x55b3df641740 2024-09-12T02:06:30.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.448+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v131'1140 uv1115 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.448+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e6680 con 0x55b3df641740 2024-09-12T02:06:30.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.449+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v131'1141 uv1141 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.449+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e6680 con 0x55b3df641740 2024-09-12T02:06:30.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.450+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v131'1142 uv1142 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.451 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:06:30.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.450+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e6680 con 0x55b3df641740 2024-09-12T02:06:30.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.452+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v131'1143 uv1143 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.452+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e6680 con 0x55b3df641740 2024-09-12T02:06:30.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.453+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v131'1144 uv1144 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.453+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e6680 con 0x55b3df641740 2024-09-12T02:06:30.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.454+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v131'1145 uv1145 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.454+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e7690 con 0x55b3df641740 2024-09-12T02:06:30.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.456+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v131'1146 uv1146 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.456+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e7690 con 0x55b3df641740 2024-09-12T02:06:30.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.457+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v131'1147 uv1121 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.457+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e7690 con 0x55b3df641740 2024-09-12T02:06:30.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.458+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v131'1148 uv1148 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.458+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e7690 con 0x55b3df641740 2024-09-12T02:06:30.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.460+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v131'1149 uv1149 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.460 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:06:30.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.460+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e86a0 con 0x55b3df641740 2024-09-12T02:06:30.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.461+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v131'1150 uv1150 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.461+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e86a0 con 0x55b3df641740 2024-09-12T02:06:30.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.462+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v131'1151 uv1151 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.462+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e7690 con 0x55b3df641740 2024-09-12T02:06:30.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.463+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v131'1152 uv1152 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.463+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e7690 con 0x55b3df641740 2024-09-12T02:06:30.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.465+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v131'1153 uv1127 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.465+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e7690 con 0x55b3df641740 2024-09-12T02:06:30.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.466+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v131'1154 uv1154 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.466+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e7690 con 0x55b3df641740 2024-09-12T02:06:30.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.467+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v131'1155 uv1155 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.468 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:06:30.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.467+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e86a0 con 0x55b3df641740 2024-09-12T02:06:30.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.468+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v131'1156 uv1156 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.468+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e86a0 con 0x55b3df641740 2024-09-12T02:06:30.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.470+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v131'1157 uv1157 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.470+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6e7690 con 0x55b3df641740 2024-09-12T02:06:30.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.471+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v131'1158 uv1158 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df641740 2024-09-12T02:06:30.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.471+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55b3df6e7ba0 0x55b3df6e9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.471+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6ea4d0 con 0x55b3df6e7ba0 2024-09-12T02:06:30.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.471+0000 7f22ca5e0640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55b3df6e7ba0 0x55b3df6e9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.472+0000 7f22ca5e0640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55b3df6e7ba0 0x55b3df6e9f90 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:30.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.474+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v131'825 uv804 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.474+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6ea870 con 0x55b3df6e7ba0 2024-09-12T02:06:30.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.475+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v131'826 uv826 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.475+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6eac10 con 0x55b3df6e7ba0 2024-09-12T02:06:30.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.477+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v131'827 uv827 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.477 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:06:30.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.477+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6eb460 con 0x55b3df6e7ba0 2024-09-12T02:06:30.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.478+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v131'828 uv828 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.478+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6eb800 con 0x55b3df6e7ba0 2024-09-12T02:06:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.479+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v131'829 uv829 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.480+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6ebba0 con 0x55b3df6e7ba0 2024-09-12T02:06:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.481+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v131'830 uv823 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.481+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6ebf40 con 0x55b3df6e7ba0 2024-09-12T02:06:30.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.482+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v131'831 uv831 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.482+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6ec2e0 con 0x55b3df6e7ba0 2024-09-12T02:06:30.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.484+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v131'832 uv832 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.484 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:06:30.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.484+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6ec2e0 con 0x55b3df6e7ba0 2024-09-12T02:06:30.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.485+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v131'833 uv833 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.485+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6ec2e0 con 0x55b3df6e7ba0 2024-09-12T02:06:30.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.487+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v131'834 uv834 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.487+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6ec2e0 con 0x55b3df6e7ba0 2024-09-12T02:06:30.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.488+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v131'835 uv824 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.488+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6ec2e0 con 0x55b3df6e7ba0 2024-09-12T02:06:30.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.489+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v131'836 uv836 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.489+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6ec2e0 con 0x55b3df6e7ba0 2024-09-12T02:06:30.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.491+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v131'837 uv837 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.491 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:06:30.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.491+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f0760 con 0x55b3df6e7ba0 2024-09-12T02:06:30.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.492+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v131'838 uv838 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.492+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f0760 con 0x55b3df6e7ba0 2024-09-12T02:06:30.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.493+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v131'839 uv839 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.493+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6ec2e0 con 0x55b3df6e7ba0 2024-09-12T02:06:30.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.495+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v131'840 uv820 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.495+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6ec2e0 con 0x55b3df6e7ba0 2024-09-12T02:06:30.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.496+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v131'841 uv841 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.496+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6ec2e0 con 0x55b3df6e7ba0 2024-09-12T02:06:30.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.497+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v131'842 uv842 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.498 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:06:30.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.497+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6ed2f0 con 0x55b3df6e7ba0 2024-09-12T02:06:30.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.499+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v131'843 uv843 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.499+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6ed2f0 con 0x55b3df6e7ba0 2024-09-12T02:06:30.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.500+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v131'844 uv844 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.500+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6ec2e0 con 0x55b3df6e7ba0 2024-09-12T02:06:30.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.501+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v131'845 uv845 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6e7ba0 2024-09-12T02:06:30.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.501+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55b3df6ec7f0 0x55b3df6eebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.501+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6ef120 con 0x55b3df6ec7f0 2024-09-12T02:06:30.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.501+0000 7f22c9ddf640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55b3df6ec7f0 0x55b3df6eebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.502+0000 7f22c9ddf640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55b3df6ec7f0 0x55b3df6eebe0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:30.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.504+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v131'219 uv218 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.504+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6ef540 con 0x55b3df6ec7f0 2024-09-12T02:06:30.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.505+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v131'220 uv220 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.505+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6efa20 con 0x55b3df6ec7f0 2024-09-12T02:06:30.506 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:06:30.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.506+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v131'221 uv221 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.506+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f12d0 con 0x55b3df6ec7f0 2024-09-12T02:06:30.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.507+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v131'222 uv222 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.507+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f1670 con 0x55b3df6ec7f0 2024-09-12T02:06:30.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.508+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v131'223 uv223 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.508+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f02c0 con 0x55b3df6ec7f0 2024-09-12T02:06:30.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.509+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v131'224 uv224 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.509+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b3df6f0d30 0x55b3df6f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.509+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f3f60 con 0x55b3df6f0d30 2024-09-12T02:06:30.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.509+0000 7f22cade1640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b3df6f0d30 0x55b3df6f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.510+0000 7f22cade1640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b3df6f0d30 0x55b3df6f3a20 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:30.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.511+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v131'167 uv166 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.511+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f3fa0 con 0x55b3df6f0d30 2024-09-12T02:06:30.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.512+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v131'168 uv168 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.512+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f43e0 con 0x55b3df6f0d30 2024-09-12T02:06:30.514 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:06:30.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.514+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v131'169 uv169 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.514+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f43e0 con 0x55b3df6f0d30 2024-09-12T02:06:30.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.515+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v131'170 uv170 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.515+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55b3df6f4a60 0x55b3df6f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.515+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f73d0 con 0x55b3df6f4a60 2024-09-12T02:06:30.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.515+0000 7f22ca5e0640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55b3df6f4a60 0x55b3df6f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.515+0000 7f22ca5e0640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55b3df6f4a60 0x55b3df6f6e50 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:30.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.517+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v131'219 uv218 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.517+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f4a60 2024-09-12T02:06:30.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.518+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v131'220 uv220 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.518+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f4a60 2024-09-12T02:06:30.520 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:06:30.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.520+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v131'221 uv221 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.520+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f87b0 con 0x55b3df6f4a60 2024-09-12T02:06:30.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.521+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v131'222 uv222 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.521+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f87b0 con 0x55b3df6f4a60 2024-09-12T02:06:30.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.522+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v131'223 uv223 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.522+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f4a60 2024-09-12T02:06:30.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.524+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v131'224 uv224 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.524+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f0d30 2024-09-12T02:06:30.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.525+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v131'404 uv398 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.525+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f0d30 2024-09-12T02:06:30.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.526+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v131'405 uv405 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.526+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f0d30 2024-09-12T02:06:30.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.527+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v131'406 uv406 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.528 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:06:30.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.527+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f87b0 con 0x55b3df6f0d30 2024-09-12T02:06:30.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.528+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v131'407 uv407 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.529+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f87b0 con 0x55b3df6f0d30 2024-09-12T02:06:30.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.530+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v131'408 uv408 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.530+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f0d30 2024-09-12T02:06:30.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.531+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v131'409 uv409 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.531+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f0d30 2024-09-12T02:06:30.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.532+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v131'410 uv403 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.532+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f0d30 2024-09-12T02:06:30.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.533+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v131'411 uv411 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.533+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f0d30 2024-09-12T02:06:30.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.534+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v131'412 uv412 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.534 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:06:30.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.534+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f0d30 2024-09-12T02:06:30.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.535+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v131'413 uv413 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.535+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f0d30 2024-09-12T02:06:30.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.536+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v131'414 uv414 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.536+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f0d30 2024-09-12T02:06:30.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.538+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v131'183 uv182 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.538+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f0d30 2024-09-12T02:06:30.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.539+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v131'184 uv184 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.539+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f0d30 2024-09-12T02:06:30.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.540+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v131'185 uv185 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.540 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:06:30.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.540+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f0d30 2024-09-12T02:06:30.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.541+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v131'186 uv186 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.541+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f0d30 2024-09-12T02:06:30.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.542+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v131'187 uv187 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f22c4052820 con 0x55b3df6f0d30 2024-09-12T02:06:30.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.542+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f4a60 2024-09-12T02:06:30.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.543+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v131'219 uv218 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.543+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f4a60 2024-09-12T02:06:30.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.544+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v131'220 uv220 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.544+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f4a60 2024-09-12T02:06:30.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.545+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v131'221 uv221 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.546 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:06:30.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.545+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f8b70 con 0x55b3df6f4a60 2024-09-12T02:06:30.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.546+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v131'222 uv222 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.546+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f8b70 con 0x55b3df6f4a60 2024-09-12T02:06:30.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.547+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v131'223 uv223 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.547+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f7b60 con 0x55b3df6f4a60 2024-09-12T02:06:30.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.548+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v131'224 uv224 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.548+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f7b60 con 0x55b3df6f4a60 2024-09-12T02:06:30.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.549+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v131'365 uv359 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.549+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f4a60 2024-09-12T02:06:30.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.551+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v131'366 uv366 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.551+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f77a0 con 0x55b3df6f4a60 2024-09-12T02:06:30.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.552+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v131'367 uv367 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.552 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:06:30.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.552+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f7bb0 con 0x55b3df6f4a60 2024-09-12T02:06:30.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.553+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v131'368 uv368 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.553+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f7b60 con 0x55b3df6f4a60 2024-09-12T02:06:30.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.554+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v131'369 uv369 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.554+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f7b60 con 0x55b3df6f4a60 2024-09-12T02:06:30.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.555+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v131'370 uv364 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.555+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f7b60 con 0x55b3df6f4a60 2024-09-12T02:06:30.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.556+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v131'371 uv371 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.556+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f7b60 con 0x55b3df6f4a60 2024-09-12T02:06:30.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.557+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v131'372 uv372 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.557 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:06:30.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.557+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6f7b60 con 0x55b3df6f4a60 2024-09-12T02:06:30.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.558+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v131'373 uv373 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.558+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa970 con 0x55b3df6f4a60 2024-09-12T02:06:30.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.559+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v131'374 uv374 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.559+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55b3df6f8520 0x55b3df6fad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.559+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6f8520 2024-09-12T02:06:30.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.559+0000 7f22c9ddf640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55b3df6f8520 0x55b3df6fad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.560+0000 7f22c9ddf640 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55b3df6f8520 0x55b3df6fad90 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:30.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.561+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v131'162 uv160 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6f8520 2024-09-12T02:06:30.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.561+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6f8520 2024-09-12T02:06:30.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.562+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v131'163 uv163 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6f8520 2024-09-12T02:06:30.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.562+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6f8520 2024-09-12T02:06:30.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.564+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v131'164 uv164 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6f8520 2024-09-12T02:06:30.565 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:06:30.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.564+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6f8520 2024-09-12T02:06:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.566+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v131'165 uv165 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6f8520 2024-09-12T02:06:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.566+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6f4a60 2024-09-12T02:06:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.567+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v131'219 uv218 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.567+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6f4a60 2024-09-12T02:06:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.568+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v131'220 uv220 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.568+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6f4a60 2024-09-12T02:06:30.569 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:06:30.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.569+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v131'221 uv221 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.569+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6f4a60 2024-09-12T02:06:30.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.570+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v131'222 uv222 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.571+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6f4a60 2024-09-12T02:06:30.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.572+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v131'223 uv223 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.572+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6f4a60 2024-09-12T02:06:30.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.573+0000 7f22ca5e0640 1 -- 172.21.15.19:0/1807299541 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v131'224 uv224 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22bc00f860 con 0x55b3df6f4a60 2024-09-12T02:06:30.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.573+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6ec7f0 2024-09-12T02:06:30.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.574+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v131'186 uv185 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.574+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6ec7f0 2024-09-12T02:06:30.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.575+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v131'187 uv187 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.575+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6ec7f0 2024-09-12T02:06:30.577 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:06:30.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.576+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v131'188 uv188 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.577+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6ec7f0 2024-09-12T02:06:30.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.578+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v131'189 uv189 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.578+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6ec7f0 2024-09-12T02:06:30.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.579+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v131'190 uv190 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.579+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6ec7f0 2024-09-12T02:06:30.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.580+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v131'455 uv446 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.580+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6ec7f0 2024-09-12T02:06:30.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.581+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v131'456 uv456 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.581+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6ec7f0 2024-09-12T02:06:30.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.582+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v131'457 uv457 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.583 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:06:30.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.582+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6ec7f0 2024-09-12T02:06:30.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.583+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v131'458 uv458 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.583+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6ec7f0 2024-09-12T02:06:30.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.584+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v131'459 uv459 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.584+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6ec7f0 2024-09-12T02:06:30.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.585+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v131'460 uv453 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.585+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6ec7f0 2024-09-12T02:06:30.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.586+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v131'461 uv461 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.586+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6ec7f0 2024-09-12T02:06:30.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.587+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v131'462 uv462 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.588 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:06:30.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.587+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6ec7f0 2024-09-12T02:06:30.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.588+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v131'463 uv463 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.588+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6ec7f0 2024-09-12T02:06:30.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.589+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v131'464 uv464 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.589+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fa910 con 0x55b3df6ec7f0 2024-09-12T02:06:30.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.590+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v131'465 uv465 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.590+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55b3df6fb2f0 con 0x55b3df6ec7f0 2024-09-12T02:06:30.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22c9ddf640 1 -- 172.21.15.19:0/1807299541 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v131'466 uv466 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f22c0029030 con 0x55b3df6ec7f0 2024-09-12T02:06:30.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55b3df6e7ba0 msgr2=0x55b3df6e9f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55b3df6e7ba0 0x55b3df6e9f90 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55b3df641740 msgr2=0x55b3df641b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55b3df641740 0x55b3df641b20 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b3df6f0d30 msgr2=0x55b3df6f3a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55b3df6f0d30 0x55b3df6f3a20 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55b3df6f8520 msgr2=0x55b3df6fad90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55b3df6f8520 0x55b3df6fad90 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55b3df6ec7f0 msgr2=0x55b3df6eebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55b3df6ec7f0 0x55b3df6eebe0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55b3df6f4a60 msgr2=0x55b3df6f6e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55b3df6f4a60 0x55b3df6f6e50 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 reap_dead start 2024-09-12T02:06:30.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22cade1640 1 -- 172.21.15.19:0/1807299541 reap_dead start 2024-09-12T02:06:30.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f22ac06a810 msgr2=0x7f22ac06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f22ac06a810 0x7f22ac06ccd0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f22bc001620 tx=0x7f22bc008040 comp rx=0 tx=0).stop 2024-09-12T02:06:30.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3df5b5970 msgr2=0x55b3df62ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.591+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3df5b5970 0x55b3df62ec80 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f22c000b7c0 tx=0x7f22c0000ed0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.592+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 shutdown_connections 2024-09-12T02:06:30.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.592+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f22ac06a810 0x7f22ac06ccd0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.592+0000 7f22ccaeaf40 1 --2- 172.21.15.19:0/1807299541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3df5b5970 0x55b3df62ec80 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.592+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 >> 172.21.15.19:0/1807299541 conn(0x55b3df56d9e0 msgr2=0x55b3df56d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:30.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.592+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 shutdown_connections 2024-09-12T02:06:30.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.592+0000 7f22ccaeaf40 1 -- 172.21.15.19:0/1807299541 wait complete. 2024-09-12T02:06:30.595 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapheader 100.00000000 deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-09-12T02:06:30.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.682+0000 7f89c9bb4f40 1 Processor -- start 2024-09-12T02:06:30.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.682+0000 7f89c9bb4f40 1 -- start start 2024-09-12T02:06:30.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.682+0000 7f89c9bb4f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89b40022d0 0x55bf2b3209c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.682+0000 7f89c9bb4f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf2b335e30 0x55bf2b28bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.682+0000 7f89c9bb4f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2b28b6b0 0x55bf2b32fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.682+0000 7f89c9bb4f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55bf2b1b2510 con 0x55bf2b28b6b0 2024-09-12T02:06:30.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.682+0000 7f89c9bb4f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bf2b20bc50 con 0x55bf2b335e30 2024-09-12T02:06:30.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.682+0000 7f89c9bb4f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55bf2b2a84a0 con 0x7f89b40022d0 2024-09-12T02:06:30.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.682+0000 7f89c7eab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2b28b6b0 0x55bf2b32fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.682+0000 7f89c7eab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2b28b6b0 0x55bf2b32fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40896/0 (socket says 172.21.15.19:40896) 2024-09-12T02:06:30.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.682+0000 7f89c7eab640 1 -- 172.21.15.19:0/3338553543 learned_addr learned my addr 172.21.15.19:0/3338553543 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:30.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.683+0000 7f89c76aa640 1 --2- 172.21.15.19:0/3338553543 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89b40022d0 0x55bf2b3209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.683+0000 7f89c6ea9640 1 --2- 172.21.15.19:0/3338553543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf2b335e30 0x55bf2b28bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.683+0000 7f89c7eab640 1 -- 172.21.15.19:0/3338553543 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89b40022d0 msgr2=0x55bf2b3209c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:30.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.683+0000 7f89c7eab640 1 --2- 172.21.15.19:0/3338553543 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89b40022d0 0x55bf2b3209c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.683+0000 7f89c7eab640 1 -- 172.21.15.19:0/3338553543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf2b335e30 msgr2=0x55bf2b28bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:30.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.683+0000 7f89c7eab640 1 --2- 172.21.15.19:0/3338553543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf2b335e30 0x55bf2b28bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.683+0000 7f89c7eab640 1 -- 172.21.15.19:0/3338553543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf2b31e360 con 0x55bf2b28b6b0 2024-09-12T02:06:30.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.683+0000 7f89c76aa640 1 --2- 172.21.15.19:0/3338553543 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89b40022d0 0x55bf2b3209c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:30.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.683+0000 7f89c7eab640 1 --2- 172.21.15.19:0/3338553543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2b28b6b0 0x55bf2b32fd70 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x55bf2b2ab420 tx=0x7f89c0009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a1890f8bd6eeee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:30.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.683+0000 7f89c5ea7640 1 -- 172.21.15.19:0/3338553543 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c000e7a0 con 0x55bf2b28b6b0 2024-09-12T02:06:30.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.683+0000 7f89c5ea7640 1 -- 172.21.15.19:0/3338553543 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c0013030 con 0x55bf2b28b6b0 2024-09-12T02:06:30.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.683+0000 7f89c5ea7640 1 -- 172.21.15.19:0/3338553543 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c000eb60 con 0x55bf2b28b6b0 2024-09-12T02:06:30.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.683+0000 7f89c9bb4f40 1 -- 172.21.15.19:0/3338553543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2b28b6b0 msgr2=0x55bf2b32fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.683+0000 7f89c9bb4f40 1 --2- 172.21.15.19:0/3338553543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2b28b6b0 0x55bf2b32fd70 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x55bf2b2ab420 tx=0x7f89c0009a90 comp rx=0 tx=0).stop 2024-09-12T02:06:30.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.684+0000 7f89c9bb4f40 1 -- 172.21.15.19:0/3338553543 shutdown_connections 2024-09-12T02:06:30.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.684+0000 7f89c9bb4f40 1 --2- 172.21.15.19:0/3338553543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2b28b6b0 0x55bf2b32fd70 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.684+0000 7f89c9bb4f40 1 --2- 172.21.15.19:0/3338553543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf2b335e30 0x55bf2b28bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.684+0000 7f89c9bb4f40 1 --2- 172.21.15.19:0/3338553543 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89b40022d0 0x55bf2b3209c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.684+0000 7f89c9bb4f40 1 -- 172.21.15.19:0/3338553543 >> 172.21.15.19:0/3338553543 conn(0x55bf2b2609e0 msgr2=0x55bf2b25fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:30.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.684+0000 7f89c9bb4f40 1 -- 172.21.15.19:0/3338553543 shutdown_connections 2024-09-12T02:06:30.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.684+0000 7f89c9bb4f40 1 -- 172.21.15.19:0/3338553543 wait complete. 2024-09-12T02:06:30.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.684+0000 7f89c9bb4f40 1 Processor -- start 2024-09-12T02:06:30.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.684+0000 7f89c9bb4f40 1 -- start start 2024-09-12T02:06:30.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.685+0000 7f89c9bb4f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf2b28b6b0 0x55bf2b3cf310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.685+0000 7f89c9bb4f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2b335e30 0x55bf2b31d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.685+0000 7f89c9bb4f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89b40022d0 0x55bf2b31fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.685+0000 7f89c9bb4f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55bf2b28cbb0 con 0x55bf2b335e30 2024-09-12T02:06:30.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.685+0000 7f89c9bb4f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bf2b28cdf0 con 0x55bf2b28b6b0 2024-09-12T02:06:30.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.685+0000 7f89c9bb4f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55bf2b31e080 con 0x7f89b40022d0 2024-09-12T02:06:30.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.685+0000 7f89c6ea9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2b335e30 0x55bf2b31d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.685+0000 7f89c6ea9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2b335e30 0x55bf2b31d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40908/0 (socket says 172.21.15.19:40908) 2024-09-12T02:06:30.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.685+0000 7f89c6ea9640 1 -- 172.21.15.19:0/407602888 learned_addr learned my addr 172.21.15.19:0/407602888 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:30.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.685+0000 7f89c76aa640 1 --2- 172.21.15.19:0/407602888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf2b28b6b0 0x55bf2b3cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.685+0000 7f89c7eab640 1 --2- 172.21.15.19:0/407602888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89b40022d0 0x55bf2b31fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.685+0000 7f89c6ea9640 1 -- 172.21.15.19:0/407602888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89b40022d0 msgr2=0x55bf2b31fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.685+0000 7f89c6ea9640 1 --2- 172.21.15.19:0/407602888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89b40022d0 0x55bf2b31fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.685+0000 7f89c6ea9640 1 -- 172.21.15.19:0/407602888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf2b28b6b0 msgr2=0x55bf2b3cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.685+0000 7f89c6ea9640 1 --2- 172.21.15.19:0/407602888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf2b28b6b0 0x55bf2b3cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.685+0000 7f89c6ea9640 1 -- 172.21.15.19:0/407602888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf2b2a6810 con 0x55bf2b335e30 2024-09-12T02:06:30.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.686+0000 7f89c6ea9640 1 --2- 172.21.15.19:0/407602888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2b335e30 0x55bf2b31d620 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x55bf2b28e780 tx=0x7f89b0009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:30.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.686+0000 7f89c4ea5640 1 -- 172.21.15.19:0/407602888 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b0016480 con 0x55bf2b335e30 2024-09-12T02:06:30.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.686+0000 7f89c4ea5640 1 -- 172.21.15.19:0/407602888 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89b001b070 con 0x55bf2b335e30 2024-09-12T02:06:30.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.686+0000 7f89c9bb4f40 1 -- 172.21.15.19:0/407602888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf2b3211b0 con 0x55bf2b335e30 2024-09-12T02:06:30.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.686+0000 7f89c4ea5640 1 -- 172.21.15.19:0/407602888 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b0016860 con 0x55bf2b335e30 2024-09-12T02:06:30.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.686+0000 7f89c9bb4f40 1 -- 172.21.15.19:0/407602888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf2b332d10 con 0x55bf2b335e30 2024-09-12T02:06:30.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.687+0000 7f89c4ea5640 1 -- 172.21.15.19:0/407602888 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89b0016a00 con 0x55bf2b335e30 2024-09-12T02:06:30.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.688+0000 7f89c4ea5640 1 --2- 172.21.15.19:0/407602888 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89a806a840 0x7f89a806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.688+0000 7f89c4ea5640 1 -- 172.21.15.19:0/407602888 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 9399+0+0 (secure 0 0 0) 0x7f89b008aa70 con 0x55bf2b335e30 2024-09-12T02:06:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.688+0000 7f89c76aa640 1 --2- 172.21.15.19:0/407602888 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89a806a840 0x7f89a806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.688+0000 7f89c9bb4f40 1 --2- 172.21.15.19:0/407602888 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55bf2b3321e0 0x55bf2b334930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.688+0000 7f89c9bb4f40 1 -- 172.21.15.19:0/407602888 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:1 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) -- 0x55bf2b334e70 con 0x55bf2b3321e0 2024-09-12T02:06:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.688+0000 7f89c7eab640 1 --2- 172.21.15.19:0/407602888 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55bf2b3321e0 0x55bf2b334930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.688+0000 7f89c76aa640 1 --2- 172.21.15.19:0/407602888 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89a806a840 0x7f89a806cd00 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f89b8055000 tx=0x7f89b8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.688+0000 7f89c7eab640 1 --2- 172.21.15.19:0/407602888 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55bf2b3321e0 0x55bf2b334930 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.690+0000 7f89c7eab640 1 -- 172.21.15.19:0/407602888 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(1 100.00000000 [omap-set-header] v131'375 uv375 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f89c000e920 con 0x55bf2b3321e0 2024-09-12T02:06:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.690+0000 7f89c9bb4f40 1 -- 172.21.15.19:0/407602888 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55bf2b3321e0 msgr2=0x55bf2b334930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.690+0000 7f89c9bb4f40 1 --2- 172.21.15.19:0/407602888 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55bf2b3321e0 0x55bf2b334930 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.690+0000 7f89c9bb4f40 1 -- 172.21.15.19:0/407602888 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89a806a840 msgr2=0x7f89a806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.690+0000 7f89c9bb4f40 1 --2- 172.21.15.19:0/407602888 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89a806a840 0x7f89a806cd00 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f89b8055000 tx=0x7f89b8008030 comp rx=0 tx=0).stop 2024-09-12T02:06:30.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.690+0000 7f89c9bb4f40 1 -- 172.21.15.19:0/407602888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2b335e30 msgr2=0x55bf2b31d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.690+0000 7f89c9bb4f40 1 --2- 172.21.15.19:0/407602888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2b335e30 0x55bf2b31d620 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x55bf2b28e780 tx=0x7f89b0009de0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.690+0000 7f89c7eab640 1 -- 172.21.15.19:0/407602888 reap_dead start 2024-09-12T02:06:30.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.690+0000 7f89c9bb4f40 1 -- 172.21.15.19:0/407602888 shutdown_connections 2024-09-12T02:06:30.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.690+0000 7f89c9bb4f40 1 -- 172.21.15.19:0/407602888 >> 172.21.15.19:0/407602888 conn(0x55bf2b2609e0 msgr2=0x55bf2b2a9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:30.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.690+0000 7f89c9bb4f40 1 -- 172.21.15.19:0/407602888 shutdown_connections 2024-09-12T02:06:30.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.690+0000 7f89c9bb4f40 1 -- 172.21.15.19:0/407602888 wait complete. 2024-09-12T02:06:30.696 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:06:30.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.801+0000 7f5d6f159640 1 Processor -- start 2024-09-12T02:06:30.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.801+0000 7f5d6f159640 1 -- start start 2024-09-12T02:06:30.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.802+0000 7f5d6f159640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d680d15f0 0x7f5d680cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.802+0000 7f5d6f159640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5d680cf160 0x7f5d6806d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.802+0000 7f5d6f159640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d680cf980 con 0x7f5d68161a20 2024-09-12T02:06:30.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.802+0000 7f5d6f159640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f5d68161e00 con 0x7f5d680d15f0 2024-09-12T02:06:30.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.802+0000 7f5d6f159640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f5d6806d050 con 0x7f5d680cf160 2024-09-12T02:06:30.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.802+0000 7f5d67fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d680d15f0 0x7f5d680cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.802+0000 7f5d67fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d680d15f0 0x7f5d680cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40920/0 (socket says 172.21.15.19:40920) 2024-09-12T02:06:30.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.802+0000 7f5d67fff640 1 -- 172.21.15.19:0/3737415952 learned_addr learned my addr 172.21.15.19:0/3737415952 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:30.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.802+0000 7f5d67fff640 1 -- 172.21.15.19:0/3737415952 >> v2:172.21.15.135:3300/0 conn(0x7f5d680cf160 msgr2=0x7f5d6806d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:30.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.802+0000 7f5d6d6f6640 1 --2- 172.21.15.19:0/3737415952 >> v2:172.21.15.135:3300/0 conn(0x7f5d680cf160 0x7f5d6806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.802+0000 7f5d67fff640 1 --2- 172.21.15.19:0/3737415952 >> v2:172.21.15.135:3300/0 conn(0x7f5d680cf160 0x7f5d6806d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.802+0000 7f5d67fff640 1 -- 172.21.15.19:0/3737415952 >> v1:172.21.15.135:6789/0 conn(0x7f5d68161a20 legacy=0x7f5d680d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:30.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.802+0000 7f5d67fff640 1 -- 172.21.15.19:0/3737415952 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d680cfc20 con 0x7f5d680d15f0 2024-09-12T02:06:30.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.803+0000 7f5d67fff640 1 --2- 172.21.15.19:0/3737415952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d680d15f0 0x7f5d680cec20 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f5d6806c7d0 tx=0x7f5d5402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e6c06e612c8fde server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:30.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.803+0000 7f5d677fe640 1 -- 172.21.15.19:0/3737415952 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d54037070 con 0x7f5d680d15f0 2024-09-12T02:06:30.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.803+0000 7f5d677fe640 1 -- 172.21.15.19:0/3737415952 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d54032440 con 0x7f5d680d15f0 2024-09-12T02:06:30.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.803+0000 7f5d677fe640 1 -- 172.21.15.19:0/3737415952 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d54032810 con 0x7f5d680d15f0 2024-09-12T02:06:30.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.804+0000 7f5d6f159640 1 -- 172.21.15.19:0/3737415952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d680d15f0 msgr2=0x7f5d680cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.804+0000 7f5d6f159640 1 --2- 172.21.15.19:0/3737415952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d680d15f0 0x7f5d680cec20 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f5d6806c7d0 tx=0x7f5d5402a210 comp rx=0 tx=0).stop 2024-09-12T02:06:30.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.804+0000 7f5d6f159640 1 -- 172.21.15.19:0/3737415952 shutdown_connections 2024-09-12T02:06:30.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.804+0000 7f5d6f159640 1 --2- 172.21.15.19:0/3737415952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d680d15f0 0x7f5d680cec20 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.804+0000 7f5d6f159640 1 --2- 172.21.15.19:0/3737415952 >> v2:172.21.15.135:3300/0 conn(0x7f5d680cf160 0x7f5d6806d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.804+0000 7f5d6f159640 1 -- 172.21.15.19:0/3737415952 >> 172.21.15.19:0/3737415952 conn(0x7f5d6809d850 msgr2=0x7f5d6808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:30.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.804+0000 7f5d6f159640 1 -- 172.21.15.19:0/3737415952 shutdown_connections 2024-09-12T02:06:30.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.804+0000 7f5d6f159640 1 -- 172.21.15.19:0/3737415952 wait complete. 2024-09-12T02:06:30.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.805+0000 7f5d6f159640 1 Processor -- start 2024-09-12T02:06:30.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.805+0000 7f5d6f159640 1 -- start start 2024-09-12T02:06:30.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.806+0000 7f5d6f159640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d680cf160 0x7f5d68150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.806+0000 7f5d6f159640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d680d15f0 0x7f5d6815b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.806+0000 7f5d6f159640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d68161a20 0x7f5d6815b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.806+0000 7f5d6f159640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5d680b1040 con 0x7f5d680cf160 2024-09-12T02:06:30.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.806+0000 7f5d6f159640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6806d2f0 con 0x7f5d680d15f0 2024-09-12T02:06:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.806+0000 7f5d6f159640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5d680cf590 con 0x7f5d68161a20 2024-09-12T02:06:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.806+0000 7f5d6cef5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d680cf160 0x7f5d68150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.806+0000 7f5d6cef5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d680cf160 0x7f5d68150a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40928/0 (socket says 172.21.15.19:40928) 2024-09-12T02:06:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.806+0000 7f5d6cef5640 1 -- 172.21.15.19:0/593045435 learned_addr learned my addr 172.21.15.19:0/593045435 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.806+0000 7f5d67fff640 1 --2- 172.21.15.19:0/593045435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d680d15f0 0x7f5d6815b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.806+0000 7f5d6d6f6640 1 --2- 172.21.15.19:0/593045435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d68161a20 0x7f5d6815b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.806+0000 7f5d6cef5640 1 -- 172.21.15.19:0/593045435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d68161a20 msgr2=0x7f5d6815b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.806+0000 7f5d6cef5640 1 --2- 172.21.15.19:0/593045435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d68161a20 0x7f5d6815b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.806+0000 7f5d6cef5640 1 -- 172.21.15.19:0/593045435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d680d15f0 msgr2=0x7f5d6815b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.806+0000 7f5d6cef5640 1 --2- 172.21.15.19:0/593045435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d680d15f0 0x7f5d6815b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.806+0000 7f5d6cef5640 1 -- 172.21.15.19:0/593045435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d680b8610 con 0x7f5d680cf160 2024-09-12T02:06:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.806+0000 7f5d6cef5640 1 --2- 172.21.15.19:0/593045435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d680cf160 0x7f5d68150a30 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00b3e0 tx=0x7f5d5c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.807+0000 7f5d657fa640 1 -- 172.21.15.19:0/593045435 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c015020 con 0x7f5d680cf160 2024-09-12T02:06:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.807+0000 7f5d657fa640 1 -- 172.21.15.19:0/593045435 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d5c011850 con 0x7f5d680cf160 2024-09-12T02:06:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.807+0000 7f5d6f159640 1 -- 172.21.15.19:0/593045435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d680b7570 con 0x7f5d680cf160 2024-09-12T02:06:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.807+0000 7f5d657fa640 1 -- 172.21.15.19:0/593045435 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c011c40 con 0x7f5d680cf160 2024-09-12T02:06:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.807+0000 7f5d6f159640 1 -- 172.21.15.19:0/593045435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d680b7b30 con 0x7f5d680cf160 2024-09-12T02:06:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.808+0000 7f5d6f159640 1 -- 172.21.15.19:0/593045435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d680cec20 con 0x7f5d680cf160 2024-09-12T02:06:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.808+0000 7f5d657fa640 1 -- 172.21.15.19:0/593045435 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d5c018020 con 0x7f5d680cf160 2024-09-12T02:06:30.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.809+0000 7f5d657fa640 1 --2- 172.21.15.19:0/593045435 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.809+0000 7f5d657fa640 1 -- 172.21.15.19:0/593045435 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 9399+0+0 (secure 0 0 0) 0x7f5d5c08bbe0 con 0x7f5d680cf160 2024-09-12T02:06:30.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.809+0000 7f5d67fff640 1 --2- 172.21.15.19:0/593045435 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.809+0000 7f5d67fff640 1 --2- 172.21.15.19:0/593045435 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f5d54034000 tx=0x7f5d5402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:30.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:30.813+0000 7f5d657fa640 1 -- 172.21.15.19:0/593045435 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d5c01f020 con 0x7f5d680cf160 2024-09-12T02:06:31.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.024+0000 7f5d6f159640 1 -- 172.21.15.19:0/593045435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f5d680c7950 con 0x7f5d680cf160 2024-09-12T02:06:31.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.651+0000 7f5d657fa640 1 -- 172.21.15.19:0/593045435 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v305) ==== 162+0+0 (secure 0 0 0) 0x7f5d5c059670 con 0x7f5d680cf160 2024-09-12T02:06:31.651 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:06:31.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.653+0000 7f5d6f159640 1 -- 172.21.15.19:0/593045435 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5d4c06be30 msgr2=0x7f5d4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:31.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.653+0000 7f5d6f159640 1 --2- 172.21.15.19:0/593045435 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f5d54034000 tx=0x7f5d5402e000 comp rx=0 tx=0).stop 2024-09-12T02:06:31.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.653+0000 7f5d6f159640 1 -- 172.21.15.19:0/593045435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d680cf160 msgr2=0x7f5d68150a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:31.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.653+0000 7f5d6f159640 1 --2- 172.21.15.19:0/593045435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d680cf160 0x7f5d68150a30 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00b3e0 tx=0x7f5d5c00b8a0 comp rx=0 tx=0).stop 2024-09-12T02:06:31.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.654+0000 7f5d6f159640 1 -- 172.21.15.19:0/593045435 shutdown_connections 2024-09-12T02:06:31.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.654+0000 7f5d6f159640 1 --2- 172.21.15.19:0/593045435 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:31.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.654+0000 7f5d6f159640 1 --2- 172.21.15.19:0/593045435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d68161a20 0x7f5d6815b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:31.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.654+0000 7f5d6f159640 1 --2- 172.21.15.19:0/593045435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d680d15f0 0x7f5d6815b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:31.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.654+0000 7f5d6f159640 1 --2- 172.21.15.19:0/593045435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d680cf160 0x7f5d68150a30 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:31.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.654+0000 7f5d6f159640 1 -- 172.21.15.19:0/593045435 >> 172.21.15.19:0/593045435 conn(0x7f5d6809d850 msgr2=0x7f5d6815d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:31.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.654+0000 7f5d6f159640 1 -- 172.21.15.19:0/593045435 shutdown_connections 2024-09-12T02:06:31.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.654+0000 7f5d6f159640 1 -- 172.21.15.19:0/593045435 wait complete. 2024-09-12T02:06:31.669 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:31.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.775+0000 7f6977f11640 1 Processor -- start 2024-09-12T02:06:31.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.775+0000 7f6977f11640 1 -- start start 2024-09-12T02:06:31.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.776+0000 7f6977f11640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f697015e5d0 0x7f69700d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:31.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.776+0000 7f6977f11640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f697006df60 0x7f697009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:31.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.776+0000 7f6977f11640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f69700d1630 0x7f697009af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:31.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.776+0000 7f6977f11640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f697006dad0 con 0x7f69700d1630 2024-09-12T02:06:31.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.776+0000 7f6977f11640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f697006cec0 con 0x7f697015e5d0 2024-09-12T02:06:31.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.776+0000 7f6977f11640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f697006d1a0 con 0x7f697006df60 2024-09-12T02:06:31.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.776+0000 7f69764ae640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f69700d1630 0x7f697009af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:31.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.776+0000 7f69764ae640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f69700d1630 0x7f697009af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41610/0 (socket says 172.21.15.19:41610) 2024-09-12T02:06:31.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.776+0000 7f69764ae640 1 -- 172.21.15.19:0/1659841566 learned_addr learned my addr 172.21.15.19:0/1659841566 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:31.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.776+0000 7f6975cad640 1 --2- 172.21.15.19:0/1659841566 >> v2:172.21.15.135:3300/0 conn(0x7f697015e5d0 0x7f69700d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:31.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.776+0000 7f69754ac640 1 --2- 172.21.15.19:0/1659841566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f697006df60 0x7f697009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:31.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.776+0000 7f69764ae640 1 -- 172.21.15.19:0/1659841566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f697006df60 msgr2=0x7f697009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:31.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.776+0000 7f69764ae640 1 --2- 172.21.15.19:0/1659841566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f697006df60 0x7f697009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:31.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.776+0000 7f69764ae640 1 -- 172.21.15.19:0/1659841566 >> v2:172.21.15.135:3300/0 conn(0x7f697015e5d0 msgr2=0x7f69700d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:31.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.776+0000 7f69764ae640 1 --2- 172.21.15.19:0/1659841566 >> v2:172.21.15.135:3300/0 conn(0x7f697015e5d0 0x7f69700d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:31.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.776+0000 7f69764ae640 1 -- 172.21.15.19:0/1659841566 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697006d480 con 0x7f69700d1630 2024-09-12T02:06:31.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.777+0000 7f69764ae640 1 --2- 172.21.15.19:0/1659841566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69700d1630 0x7f697009af70 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f69700734a0 tx=0x7f696802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eddf1932ec6627e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:31.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.777+0000 7f6974cab640 1 -- 172.21.15.19:0/1659841566 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6968036070 con 0x7f69700d1630 2024-09-12T02:06:31.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.777+0000 7f6974cab640 1 -- 172.21.15.19:0/1659841566 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6968031600 con 0x7f69700d1630 2024-09-12T02:06:31.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.777+0000 7f6974cab640 1 -- 172.21.15.19:0/1659841566 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69680319d0 con 0x7f69700d1630 2024-09-12T02:06:31.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.778+0000 7f6977f11640 1 -- 172.21.15.19:0/1659841566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69700d1630 msgr2=0x7f697009af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:31.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.778+0000 7f6977f11640 1 --2- 172.21.15.19:0/1659841566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69700d1630 0x7f697009af70 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f69700734a0 tx=0x7f696802a730 comp rx=0 tx=0).stop 2024-09-12T02:06:31.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.778+0000 7f6977f11640 1 -- 172.21.15.19:0/1659841566 shutdown_connections 2024-09-12T02:06:31.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.778+0000 7f6977f11640 1 --2- 172.21.15.19:0/1659841566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69700d1630 0x7f697009af70 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:31.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.778+0000 7f6977f11640 1 --2- 172.21.15.19:0/1659841566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f697006df60 0x7f697009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:31.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.778+0000 7f6977f11640 1 --2- 172.21.15.19:0/1659841566 >> v2:172.21.15.135:3300/0 conn(0x7f697015e5d0 0x7f69700d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:31.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.778+0000 7f6977f11640 1 -- 172.21.15.19:0/1659841566 >> 172.21.15.19:0/1659841566 conn(0x7f69700d23a0 msgr2=0x7f69700d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:31.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.778+0000 7f6977f11640 1 -- 172.21.15.19:0/1659841566 shutdown_connections 2024-09-12T02:06:31.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.778+0000 7f6977f11640 1 -- 172.21.15.19:0/1659841566 wait complete. 2024-09-12T02:06:31.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.779+0000 7f6977f11640 1 Processor -- start 2024-09-12T02:06:31.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.779+0000 7f6977f11640 1 -- start start 2024-09-12T02:06:31.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f6977f11640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f697006df60 0x7f69700c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:31.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f6977f11640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69700d1630 0x7f69701f8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:31.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f6977f11640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f697015e5d0 0x7f69701f7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:31.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f6977f11640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f697015eb30 con 0x7f697006df60 2024-09-12T02:06:31.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f6977f11640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f697015e9b0 con 0x7f697015e5d0 2024-09-12T02:06:31.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f6977f11640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6970162230 con 0x7f69700d1630 2024-09-12T02:06:31.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f6975cad640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f697006df60 0x7f69700c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:31.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f6975cad640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f697006df60 0x7f69700c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41622/0 (socket says 172.21.15.19:41622) 2024-09-12T02:06:31.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f6975cad640 1 -- 172.21.15.19:0/2010170710 learned_addr learned my addr 172.21.15.19:0/2010170710 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:31.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f69754ac640 1 --2- 172.21.15.19:0/2010170710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69700d1630 0x7f69701f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:31.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f69764ae640 1 --2- 172.21.15.19:0/2010170710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f697015e5d0 0x7f69701f7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:31.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f6975cad640 1 -- 172.21.15.19:0/2010170710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69700d1630 msgr2=0x7f69701f8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f6975cad640 1 --2- 172.21.15.19:0/2010170710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69700d1630 0x7f69701f8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f6975cad640 1 -- 172.21.15.19:0/2010170710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f697015e5d0 msgr2=0x7f69701f7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f6975cad640 1 --2- 172.21.15.19:0/2010170710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f697015e5d0 0x7f69701f7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f6975cad640 1 -- 172.21.15.19:0/2010170710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69701f7a40 con 0x7f697006df60 2024-09-12T02:06:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f69754ac640 1 --2- 172.21.15.19:0/2010170710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69700d1630 0x7f69701f8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f69764ae640 1 --2- 172.21.15.19:0/2010170710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f697015e5d0 0x7f69701f7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.780+0000 7f6975cad640 1 --2- 172.21.15.19:0/2010170710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f697006df60 0x7f69700c75e0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f696c00d5f0 tx=0x7f696c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.781+0000 7f69667fc640 1 -- 172.21.15.19:0/2010170710 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c0125f0 con 0x7f697006df60 2024-09-12T02:06:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.781+0000 7f69667fc640 1 -- 172.21.15.19:0/2010170710 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f696c019070 con 0x7f697006df60 2024-09-12T02:06:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.781+0000 7f6977f11640 1 -- 172.21.15.19:0/2010170710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69700c7c50 con 0x7f697006df60 2024-09-12T02:06:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.781+0000 7f69667fc640 1 -- 172.21.15.19:0/2010170710 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c0129d0 con 0x7f697006df60 2024-09-12T02:06:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.781+0000 7f6977f11640 1 -- 172.21.15.19:0/2010170710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69700c8210 con 0x7f697006df60 2024-09-12T02:06:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.782+0000 7f6977f11640 1 -- 172.21.15.19:0/2010170710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69700d10f0 con 0x7f697006df60 2024-09-12T02:06:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.782+0000 7f69667fc640 1 -- 172.21.15.19:0/2010170710 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f696c012b70 con 0x7f697006df60 2024-09-12T02:06:31.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.783+0000 7f69667fc640 1 --2- 172.21.15.19:0/2010170710 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f695406be30 0x7f695406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:31.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.783+0000 7f69667fc640 1 -- 172.21.15.19:0/2010170710 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 9399+0+0 (secure 0 0 0) 0x7f696c08c0a0 con 0x7f697006df60 2024-09-12T02:06:31.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.783+0000 7f69754ac640 1 --2- 172.21.15.19:0/2010170710 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f695406be30 0x7f695406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:31.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.783+0000 7f69754ac640 1 --2- 172.21.15.19:0/2010170710 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f695406be30 0x7f695406e2f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f69700ce730 tx=0x7f6960008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.787+0000 7f69667fc640 1 -- 172.21.15.19:0/2010170710 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f696c059c20 con 0x7f697006df60 2024-09-12T02:06:31.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.997+0000 7f6977f11640 1 -- 172.21.15.19:0/2010170710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69700b8320 con 0x7f697006df60 2024-09-12T02:06:31.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:31.998+0000 7f69667fc640 1 -- 172.21.15.19:0/2010170710 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 306 v306) ==== 95+0+5230 (secure 0 0 0) 0x7f696c059520 con 0x7f697006df60 2024-09-12T02:06:31.998 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:31.998 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":306,"btime":"2024-09-12T02:06:31:654736+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":306,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:31.654716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":131,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10308":{"gid":10308,"name":"c","rank":0,"incarnation":306,"state":"up:replay","state_seq":1,"addr":"172.21.15.19:6834/1700320729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1700320729},{"type":"v1","addr":"172.21.15.19:6834","nonce":1700320729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:31.999 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 306 2024-09-12T02:06:32.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:32.000+0000 7f6977f11640 1 -- 172.21.15.19:0/2010170710 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f695406be30 msgr2=0x7f695406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:32.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:32.000+0000 7f6977f11640 1 --2- 172.21.15.19:0/2010170710 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f695406be30 0x7f695406e2f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f69700ce730 tx=0x7f6960008040 comp rx=0 tx=0).stop 2024-09-12T02:06:32.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:32.000+0000 7f6977f11640 1 -- 172.21.15.19:0/2010170710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f697006df60 msgr2=0x7f69700c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:32.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:32.000+0000 7f6977f11640 1 --2- 172.21.15.19:0/2010170710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f697006df60 0x7f69700c75e0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f696c00d5f0 tx=0x7f696c00dab0 comp rx=0 tx=0).stop 2024-09-12T02:06:32.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:32.000+0000 7f6977f11640 1 -- 172.21.15.19:0/2010170710 shutdown_connections 2024-09-12T02:06:32.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:32.000+0000 7f6977f11640 1 --2- 172.21.15.19:0/2010170710 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f695406be30 0x7f695406e2f0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:32.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:32.000+0000 7f6977f11640 1 --2- 172.21.15.19:0/2010170710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f697015e5d0 0x7f69701f7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:32.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:32.000+0000 7f6977f11640 1 --2- 172.21.15.19:0/2010170710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69700d1630 0x7f69701f8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:32.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:32.000+0000 7f6977f11640 1 --2- 172.21.15.19:0/2010170710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f697006df60 0x7f69700c75e0 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:32.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:32.000+0000 7f6977f11640 1 -- 172.21.15.19:0/2010170710 >> 172.21.15.19:0/2010170710 conn(0x7f69700d23a0 msgr2=0x7f697015cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:32.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:32.000+0000 7f6977f11640 1 -- 172.21.15.19:0/2010170710 shutdown_connections 2024-09-12T02:06:32.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:32.000+0000 7f6977f11640 1 -- 172.21.15.19:0/2010170710 wait complete. 2024-09-12T02:06:32.011 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-12T02:06:34.682 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:06:34.682+0000 7efda326c640 -1 mds.0.cache.dir(0x100) Corrupt fnode in dirfrag 0x100: Decoder at 'void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)' v=3 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-09-12T02:06:34.683 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:06:34.683+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:06:34.683 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:06:34.683+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:06:35.325 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:06:35.325+0000 7efda7274640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:06:37.012 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:37.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.128+0000 7fefbcd42640 1 Processor -- start 2024-09-12T02:06:37.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.128+0000 7fefbcd42640 1 -- start start 2024-09-12T02:06:37.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefbcd42640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80d30f0 0x7fefb80b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefbcd42640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fefb80b64c0 0x7fefb806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefbcd42640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefb80d3690 con 0x7fefb815e5f0 2024-09-12T02:06:37.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefbcd42640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fefb806d530 con 0x7fefb80b64c0 2024-09-12T02:06:37.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefbcd42640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fefb80d3970 con 0x7fefb80d30f0 2024-09-12T02:06:37.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb659c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fefb815e5f0 0x7fefb80d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43908/0 (socket says 172.21.15.19:43908) 2024-09-12T02:06:37.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb659c640 1 -- 172.21.15.19:0/3256786430 learned_addr learned my addr 172.21.15.19:0/3256786430 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb559a640 1 -- 172.21.15.19:0/3256786430 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3755703555 0 0) 0x7fefb80d3690 con 0x7fefb815e5f0 2024-09-12T02:06:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb5d9b640 1 --2- 172.21.15.19:0/3256786430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80d30f0 0x7fefb80b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb559a640 1 -- 172.21.15.19:0/3256786430 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefa4003520 con 0x7fefb815e5f0 2024-09-12T02:06:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb6d9d640 1 --2- 172.21.15.19:0/3256786430 >> v2:172.21.15.135:3300/0 conn(0x7fefb80b64c0 0x7fefb806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb559a640 1 -- 172.21.15.19:0/3256786430 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1016345309 0 0) 0x7fefa4003520 con 0x7fefb815e5f0 2024-09-12T02:06:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb559a640 1 -- 172.21.15.19:0/3256786430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80d30f0 msgr2=0x7fefb80b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb559a640 1 --2- 172.21.15.19:0/3256786430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80d30f0 0x7fefb80b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb559a640 1 -- 172.21.15.19:0/3256786430 >> v2:172.21.15.135:3300/0 conn(0x7fefb80b64c0 msgr2=0x7fefb806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb559a640 1 --2- 172.21.15.19:0/3256786430 >> v2:172.21.15.135:3300/0 conn(0x7fefb80b64c0 0x7fefb806d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb559a640 1 -- 172.21.15.19:0/3256786430 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb806cee0 con 0x7fefb815e5f0 2024-09-12T02:06:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb559a640 1 -- 172.21.15.19:0/3256786430 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fefa80019f0 con 0x7fefb815e5f0 2024-09-12T02:06:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb559a640 1 -- 172.21.15.19:0/3256786430 >> v1:172.21.15.19:6789/0 conn(0x7fefb815e5f0 legacy=0x7fefb80d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb559a640 1 --2- 172.21.15.19:0/3256786430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80d30f0 0x7fefa40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb559a640 1 --2- 172.21.15.19:0/3256786430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa4003f30 0x7fefa4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb559a640 1 --2- 172.21.15.19:0/3256786430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefa4004d40 0x7fefa40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb559a640 1 -- 172.21.15.19:0/3256786430 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fefb806d530 con 0x7fefa4004d40 2024-09-12T02:06:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb559a640 1 -- 172.21.15.19:0/3256786430 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fefb80d3970 con 0x7fefa4003f30 2024-09-12T02:06:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb559a640 1 -- 172.21.15.19:0/3256786430 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fefa400b9c0 con 0x7fefb80d30f0 2024-09-12T02:06:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb6d9d640 1 --2- 172.21.15.19:0/3256786430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefa4004d40 0x7fefa40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb659c640 1 --2- 172.21.15.19:0/3256786430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80d30f0 0x7fefa40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb5d9b640 1 --2- 172.21.15.19:0/3256786430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa4003f30 0x7fefa4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb6d9d640 1 -- 172.21.15.19:0/3256786430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80d30f0 msgr2=0x7fefa40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb6d9d640 1 --2- 172.21.15.19:0/3256786430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80d30f0 0x7fefa40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb6d9d640 1 -- 172.21.15.19:0/3256786430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa4003f30 msgr2=0x7fefa4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb6d9d640 1 --2- 172.21.15.19:0/3256786430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa4003f30 0x7fefa4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.130+0000 7fefb6d9d640 1 -- 172.21.15.19:0/3256786430 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa4003520 con 0x7fefa4004d40 2024-09-12T02:06:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.131+0000 7fefb6d9d640 1 --2- 172.21.15.19:0/3256786430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefa4004d40 0x7fefa40051c0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009ac0 tx=0x7fefa4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7d9128b395554c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.131+0000 7fefb559a640 1 -- 172.21.15.19:0/3256786430 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0036070 con 0x7fefa4004d40 2024-09-12T02:06:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.131+0000 7fefb559a640 1 -- 172.21.15.19:0/3256786430 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb0031400 con 0x7fefa4004d40 2024-09-12T02:06:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.131+0000 7fefb559a640 1 -- 172.21.15.19:0/3256786430 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0009690 con 0x7fefa4004d40 2024-09-12T02:06:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.131+0000 7fefbcd42640 1 -- 172.21.15.19:0/3256786430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefa4004d40 msgr2=0x7fefa40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.131+0000 7fefbcd42640 1 --2- 172.21.15.19:0/3256786430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefa4004d40 0x7fefa40051c0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009ac0 tx=0x7fefa4005830 comp rx=0 tx=0).stop 2024-09-12T02:06:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.132+0000 7fefb6d9d640 1 -- 172.21.15.19:0/3256786430 reap_dead start 2024-09-12T02:06:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.132+0000 7fefbcd42640 1 -- 172.21.15.19:0/3256786430 shutdown_connections 2024-09-12T02:06:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.132+0000 7fefbcd42640 1 -- 172.21.15.19:0/3256786430 >> 172.21.15.19:0/3256786430 conn(0x7fefb808bfc0 msgr2=0x7fefb80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:37.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.132+0000 7fefbcd42640 1 -- 172.21.15.19:0/3256786430 shutdown_connections 2024-09-12T02:06:37.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.132+0000 7fefbcd42640 1 -- 172.21.15.19:0/3256786430 wait complete. 2024-09-12T02:06:37.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.133+0000 7fefbcd42640 1 Processor -- start 2024-09-12T02:06:37.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.133+0000 7fefbcd42640 1 -- start start 2024-09-12T02:06:37.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.134+0000 7fefbcd42640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefa4004d40 0x7fefb8153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.134+0000 7fefbcd42640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefb80cae30 0x7fefb80b9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.134+0000 7fefbcd42640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80c8e50 0x7fefb80cd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.134+0000 7fefbcd42640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fefb80b5f80 con 0x7fefa4004d40 2024-09-12T02:06:37.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.134+0000 7fefbcd42640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fefb815e9d0 con 0x7fefb80cae30 2024-09-12T02:06:37.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.134+0000 7fefbcd42640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fefb80b6100 con 0x7fefb80c8e50 2024-09-12T02:06:37.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.134+0000 7fefb659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefa4004d40 0x7fefb8153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.134+0000 7fefb659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefa4004d40 0x7fefb8153ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41644/0 (socket says 172.21.15.19:41644) 2024-09-12T02:06:37.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.134+0000 7fefb659c640 1 -- 172.21.15.19:0/1060311598 learned_addr learned my addr 172.21.15.19:0/1060311598 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:37.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.134+0000 7fefb5d9b640 1 --2- 172.21.15.19:0/1060311598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefb80cae30 0x7fefb80b9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.134+0000 7fefb6d9d640 1 --2- 172.21.15.19:0/1060311598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80c8e50 0x7fefb80cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.134+0000 7fefb659c640 1 -- 172.21.15.19:0/1060311598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80c8e50 msgr2=0x7fefb80cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.134+0000 7fefb659c640 1 --2- 172.21.15.19:0/1060311598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80c8e50 0x7fefb80cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.134+0000 7fefb659c640 1 -- 172.21.15.19:0/1060311598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefb80cae30 msgr2=0x7fefb80b9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.134+0000 7fefb659c640 1 --2- 172.21.15.19:0/1060311598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefb80cae30 0x7fefb80b9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.134+0000 7fefb659c640 1 -- 172.21.15.19:0/1060311598 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb80cb770 con 0x7fefa4004d40 2024-09-12T02:06:37.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.135+0000 7fefb659c640 1 --2- 172.21.15.19:0/1060311598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefa4004d40 0x7fefb8153ef0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7fefa8007a20 tx=0x7fefa800a790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:37.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.135+0000 7fefaeffd640 1 -- 172.21.15.19:0/1060311598 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8017020 con 0x7fefa4004d40 2024-09-12T02:06:37.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.135+0000 7fefaeffd640 1 -- 172.21.15.19:0/1060311598 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa80133f0 con 0x7fefa4004d40 2024-09-12T02:06:37.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.135+0000 7fefbcd42640 1 -- 172.21.15.19:0/1060311598 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb80cba50 con 0x7fefa4004d40 2024-09-12T02:06:37.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.135+0000 7fefaeffd640 1 -- 172.21.15.19:0/1060311598 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa80137e0 con 0x7fefa4004d40 2024-09-12T02:06:37.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.135+0000 7fefbcd42640 1 -- 172.21.15.19:0/1060311598 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb80cc010 con 0x7fefa4004d40 2024-09-12T02:06:37.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.136+0000 7fefbcd42640 1 -- 172.21.15.19:0/1060311598 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefb80d3690 con 0x7fefa4004d40 2024-09-12T02:06:37.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.136+0000 7fefaeffd640 1 -- 172.21.15.19:0/1060311598 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fefa801a020 con 0x7fefa4004d40 2024-09-12T02:06:37.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.137+0000 7fefaeffd640 1 --2- 172.21.15.19:0/1060311598 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef9806be60 0x7fef9806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.137+0000 7fefaeffd640 1 -- 172.21.15.19:0/1060311598 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 9485+0+0 (secure 0 0 0) 0x7fefa808ca80 con 0x7fefa4004d40 2024-09-12T02:06:37.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.137+0000 7fefb5d9b640 1 --2- 172.21.15.19:0/1060311598 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef9806be60 0x7fef9806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.138+0000 7fefb5d9b640 1 --2- 172.21.15.19:0/1060311598 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef9806be60 0x7fef9806e320 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fefb80b9b70 tx=0x7fefa0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:37.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.141+0000 7fefaeffd640 1 -- 172.21.15.19:0/1060311598 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fefa8021020 con 0x7fefa4004d40 2024-09-12T02:06:37.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.352+0000 7fefbcd42640 1 -- 172.21.15.19:0/1060311598 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefb80c7980 con 0x7fefa4004d40 2024-09-12T02:06:37.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.352+0000 7fefaeffd640 1 -- 172.21.15.19:0/1060311598 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 310 v310) ==== 95+0+4392 (secure 0 0 0) 0x7fefa805a5b0 con 0x7fefa4004d40 2024-09-12T02:06:37.353 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:37.353 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":310,"btime":"2024-09-12T02:06:34:684660+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":310,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:34.684656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":132,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:37.353 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 310 2024-09-12T02:06:37.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.354+0000 7fefbcd42640 1 -- 172.21.15.19:0/1060311598 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef9806be60 msgr2=0x7fef9806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.354+0000 7fefbcd42640 1 --2- 172.21.15.19:0/1060311598 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef9806be60 0x7fef9806e320 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fefb80b9b70 tx=0x7fefa0009190 comp rx=0 tx=0).stop 2024-09-12T02:06:37.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.354+0000 7fefbcd42640 1 -- 172.21.15.19:0/1060311598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefa4004d40 msgr2=0x7fefb8153ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.354+0000 7fefbcd42640 1 --2- 172.21.15.19:0/1060311598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefa4004d40 0x7fefb8153ef0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7fefa8007a20 tx=0x7fefa800a790 comp rx=0 tx=0).stop 2024-09-12T02:06:37.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.354+0000 7fefbcd42640 1 -- 172.21.15.19:0/1060311598 shutdown_connections 2024-09-12T02:06:37.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.354+0000 7fefbcd42640 1 --2- 172.21.15.19:0/1060311598 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fef9806be60 0x7fef9806e320 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.354+0000 7fefbcd42640 1 --2- 172.21.15.19:0/1060311598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80c8e50 0x7fefb80cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.354+0000 7fefbcd42640 1 --2- 172.21.15.19:0/1060311598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefb80cae30 0x7fefb80b9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.354+0000 7fefbcd42640 1 --2- 172.21.15.19:0/1060311598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefa4004d40 0x7fefb8153ef0 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.354+0000 7fefbcd42640 1 -- 172.21.15.19:0/1060311598 >> 172.21.15.19:0/1060311598 conn(0x7fefb808bfc0 msgr2=0x7fefb80cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:37.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.354+0000 7fefbcd42640 1 -- 172.21.15.19:0/1060311598 shutdown_connections 2024-09-12T02:06:37.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.354+0000 7fefbcd42640 1 -- 172.21.15.19:0/1060311598 wait complete. 2024-09-12T02:06:37.366 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:06:37.366 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:37.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.469+0000 7f0738df6640 1 Processor -- start 2024-09-12T02:06:37.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.469+0000 7f0738df6640 1 -- start start 2024-09-12T02:06:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.469+0000 7f0738df6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f073406dbd0 0x7f073409b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.469+0000 7f0738df6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07340d1970 con 0x7f073415e740 2024-09-12T02:06:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.469+0000 7f0738df6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07340d0780 con 0x7f07340d1540 2024-09-12T02:06:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.469+0000 7f0738df6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f073415eb20 con 0x7f073406dbd0 2024-09-12T02:06:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.469+0000 7f0732d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f073406dbd0 0x7f073409b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.469+0000 7f073259c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f073415e740 0x7f073406d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43910/0 (socket says 172.21.15.19:43910) 2024-09-12T02:06:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.469+0000 7f0732d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f073406dbd0 0x7f073409b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41656/0 (socket says 172.21.15.19:41656) 2024-09-12T02:06:37.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.469+0000 7f073259c640 1 -- 172.21.15.19:0/855861718 learned_addr learned my addr 172.21.15.19:0/855861718 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:37.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.469+0000 7f0732d9d640 1 -- 172.21.15.19:0/855861718 >> v1:172.21.15.135:6789/0 conn(0x7f07340d1540 legacy=0x7f0734070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.469+0000 7f0732d9d640 1 -- 172.21.15.19:0/855861718 >> v1:172.21.15.19:6789/0 conn(0x7f073415e740 legacy=0x7f073406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.469+0000 7f073159a640 1 -- 172.21.15.19:0/855861718 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2500987425 0 0) 0x7f07340d1970 con 0x7f073415e740 2024-09-12T02:06:37.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.469+0000 7f0732d9d640 1 -- 172.21.15.19:0/855861718 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07340d0a60 con 0x7f073406dbd0 2024-09-12T02:06:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.470+0000 7f0732d9d640 1 --2- 172.21.15.19:0/855861718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f073406dbd0 0x7f073409b690 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f072c009d90 tx=0x7f072c02a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bfc6a336156ec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.470+0000 7f073159a640 1 -- 172.21.15.19:0/855861718 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c037070 con 0x7f073406dbd0 2024-09-12T02:06:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.470+0000 7f073159a640 1 -- 172.21.15.19:0/855861718 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f072c007740 con 0x7f073406dbd0 2024-09-12T02:06:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.470+0000 7f073159a640 1 -- 172.21.15.19:0/855861718 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c007b10 con 0x7f073406dbd0 2024-09-12T02:06:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.471+0000 7f0738df6640 1 -- 172.21.15.19:0/855861718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f073406dbd0 msgr2=0x7f073409b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.471+0000 7f0738df6640 1 --2- 172.21.15.19:0/855861718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f073406dbd0 0x7f073409b690 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f072c009d90 tx=0x7f072c02a780 comp rx=0 tx=0).stop 2024-09-12T02:06:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.471+0000 7f0738df6640 1 -- 172.21.15.19:0/855861718 shutdown_connections 2024-09-12T02:06:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.471+0000 7f0738df6640 1 --2- 172.21.15.19:0/855861718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f073406dbd0 0x7f073409b690 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.471+0000 7f0738df6640 1 -- 172.21.15.19:0/855861718 >> 172.21.15.19:0/855861718 conn(0x7f07340d23a0 msgr2=0x7f07340d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.471+0000 7f0738df6640 1 -- 172.21.15.19:0/855861718 shutdown_connections 2024-09-12T02:06:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.471+0000 7f0738df6640 1 -- 172.21.15.19:0/855861718 wait complete. 2024-09-12T02:06:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.472+0000 7f0738df6640 1 Processor -- start 2024-09-12T02:06:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.472+0000 7f0738df6640 1 -- start start 2024-09-12T02:06:37.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.473+0000 7f0738df6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f073406dbd0 0x7f0734155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.473+0000 7f0738df6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07340d1540 0x7f07341575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.473+0000 7f0738df6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f073415e740 0x7f07340cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.473+0000 7f0738df6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f073406dfe0 con 0x7f073415e740 2024-09-12T02:06:37.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.473+0000 7f0738df6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f07340d1020 con 0x7f073406dbd0 2024-09-12T02:06:37.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.473+0000 7f0738df6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f073406cd20 con 0x7f07340d1540 2024-09-12T02:06:37.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.473+0000 7f0732d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f073415e740 0x7f07340cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.473+0000 7f0732d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f073415e740 0x7f07340cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41658/0 (socket says 172.21.15.19:41658) 2024-09-12T02:06:37.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.473+0000 7f0732d9d640 1 -- 172.21.15.19:0/1396192383 learned_addr learned my addr 172.21.15.19:0/1396192383 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:37.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.473+0000 7f073259c640 1 --2- 172.21.15.19:0/1396192383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f073406dbd0 0x7f0734155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.473+0000 7f0731d9b640 1 --2- 172.21.15.19:0/1396192383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07340d1540 0x7f07341575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.473+0000 7f0732d9d640 1 -- 172.21.15.19:0/1396192383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07340d1540 msgr2=0x7f07341575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.473+0000 7f0732d9d640 1 --2- 172.21.15.19:0/1396192383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07340d1540 0x7f07341575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.473+0000 7f0732d9d640 1 -- 172.21.15.19:0/1396192383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f073406dbd0 msgr2=0x7f0734155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.473+0000 7f0732d9d640 1 --2- 172.21.15.19:0/1396192383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f073406dbd0 0x7f0734155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.473+0000 7f0732d9d640 1 -- 172.21.15.19:0/1396192383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07341562c0 con 0x7f073415e740 2024-09-12T02:06:37.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.474+0000 7f073259c640 1 --2- 172.21.15.19:0/1396192383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f073406dbd0 0x7f0734155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:37.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.474+0000 7f0732d9d640 1 --2- 172.21.15.19:0/1396192383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f073415e740 0x7f07340cda20 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f072c009d90 tx=0x7f072c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:37.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.474+0000 7f0722ffd640 1 -- 172.21.15.19:0/1396192383 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c042070 con 0x7f073415e740 2024-09-12T02:06:37.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.474+0000 7f0722ffd640 1 -- 172.21.15.19:0/1396192383 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f072c003bb0 con 0x7f073415e740 2024-09-12T02:06:37.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.474+0000 7f0722ffd640 1 -- 172.21.15.19:0/1396192383 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c037040 con 0x7f073415e740 2024-09-12T02:06:37.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.474+0000 7f0738df6640 1 -- 172.21.15.19:0/1396192383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0734156560 con 0x7f073415e740 2024-09-12T02:06:37.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.474+0000 7f0738df6640 1 -- 172.21.15.19:0/1396192383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0734156b20 con 0x7f073415e740 2024-09-12T02:06:37.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.475+0000 7f0738df6640 1 -- 172.21.15.19:0/1396192383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07340c9140 con 0x7f073415e740 2024-09-12T02:06:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.475+0000 7f0722ffd640 1 -- 172.21.15.19:0/1396192383 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f072c007600 con 0x7f073415e740 2024-09-12T02:06:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.476+0000 7f0722ffd640 1 --2- 172.21.15.19:0/1396192383 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f071406be30 0x7f071406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.476+0000 7f0722ffd640 1 -- 172.21.15.19:0/1396192383 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 9485+0+0 (secure 0 0 0) 0x7f072c0ace40 con 0x7f073415e740 2024-09-12T02:06:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.476+0000 7f073259c640 1 --2- 172.21.15.19:0/1396192383 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f071406be30 0x7f071406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.477+0000 7f073259c640 1 --2- 172.21.15.19:0/1396192383 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f071406be30 0x7f071406e2f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f0724007fd0 tx=0x7f0724007dc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:37.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.480+0000 7f0722ffd640 1 -- 172.21.15.19:0/1396192383 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f07340c9140 con 0x7f073415e740 2024-09-12T02:06:37.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.694+0000 7f0738df6640 1 -- 172.21.15.19:0/1396192383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f073406d0b0 con 0x7f073415e740 2024-09-12T02:06:37.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.694+0000 7f0722ffd640 1 -- 172.21.15.19:0/1396192383 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 310 v310) ==== 95+0+4392 (secure 0 0 0) 0x7f072c04c020 con 0x7f073415e740 2024-09-12T02:06:37.695 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:37.695 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":310,"btime":"2024-09-12T02:06:34:684660+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":310,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:34.684656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":132,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:37.695 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 310 2024-09-12T02:06:37.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.696+0000 7f0738df6640 1 -- 172.21.15.19:0/1396192383 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f071406be30 msgr2=0x7f071406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.696+0000 7f0738df6640 1 --2- 172.21.15.19:0/1396192383 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f071406be30 0x7f071406e2f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f0724007fd0 tx=0x7f0724007dc0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.696+0000 7f0738df6640 1 -- 172.21.15.19:0/1396192383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f073415e740 msgr2=0x7f07340cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.696+0000 7f0738df6640 1 --2- 172.21.15.19:0/1396192383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f073415e740 0x7f07340cda20 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f072c009d90 tx=0x7f072c004a40 comp rx=0 tx=0).stop 2024-09-12T02:06:37.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.696+0000 7f0738df6640 1 -- 172.21.15.19:0/1396192383 shutdown_connections 2024-09-12T02:06:37.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.696+0000 7f0738df6640 1 --2- 172.21.15.19:0/1396192383 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f071406be30 0x7f071406e2f0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.696+0000 7f0738df6640 1 --2- 172.21.15.19:0/1396192383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f073415e740 0x7f07340cda20 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.696+0000 7f0738df6640 1 --2- 172.21.15.19:0/1396192383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07340d1540 0x7f07341575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.696+0000 7f0738df6640 1 --2- 172.21.15.19:0/1396192383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f073406dbd0 0x7f0734155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.696+0000 7f0738df6640 1 -- 172.21.15.19:0/1396192383 >> 172.21.15.19:0/1396192383 conn(0x7f07340d23a0 msgr2=0x7f073415ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.696+0000 7f0738df6640 1 -- 172.21.15.19:0/1396192383 shutdown_connections 2024-09-12T02:06:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.696+0000 7f0738df6640 1 -- 172.21.15.19:0/1396192383 wait complete. 2024-09-12T02:06:37.707 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:06:37.708 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:37.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.809+0000 7f0c334d0640 1 Processor -- start 2024-09-12T02:06:37.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.809+0000 7f0c334d0640 1 -- start start 2024-09-12T02:06:37.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.810+0000 7f0c334d0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c2c06df60 0x7f0c2c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.810+0000 7f0c334d0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c2c09af70 0x7f0c2c168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.810+0000 7f0c334d0640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c2c06cec0 con 0x7f0c2c15e5d0 2024-09-12T02:06:37.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.810+0000 7f0c334d0640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f0c2c06dad0 con 0x7f0c2c09af70 2024-09-12T02:06:37.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.810+0000 7f0c334d0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2c06d1a0 con 0x7f0c2c06df60 2024-09-12T02:06:37.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.810+0000 7f0c3126c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0c2c15e5d0 0x7f0c2c0d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43922/0 (socket says 172.21.15.19:43922) 2024-09-12T02:06:37.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.810+0000 7f0c3126c640 1 -- 172.21.15.19:0/1043482429 learned_addr learned my addr 172.21.15.19:0/1043482429 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:37.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.810+0000 7f0c31a6d640 1 --2- 172.21.15.19:0/1043482429 >> v2:172.21.15.19:3300/0 conn(0x7f0c2c09af70 0x7f0c2c168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.810+0000 7f0c30a6b640 1 --2- 172.21.15.19:0/1043482429 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c2c06df60 0x7f0c2c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.810+0000 7f0c23fff640 1 -- 172.21.15.19:0/1043482429 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 142438670 0 0) 0x7f0c2c06cec0 con 0x7f0c2c15e5d0 2024-09-12T02:06:37.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.810+0000 7f0c23fff640 1 -- 172.21.15.19:0/1043482429 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c18003520 con 0x7f0c2c15e5d0 2024-09-12T02:06:37.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.811+0000 7f0c31a6d640 1 -- 172.21.15.19:0/1043482429 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c2c06df60 msgr2=0x7f0c2c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:37.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.811+0000 7f0c31a6d640 1 --2- 172.21.15.19:0/1043482429 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c2c06df60 0x7f0c2c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.811+0000 7f0c31a6d640 1 -- 172.21.15.19:0/1043482429 >> v1:172.21.15.19:6789/0 conn(0x7f0c2c15e5d0 legacy=0x7f0c2c0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.811+0000 7f0c31a6d640 1 -- 172.21.15.19:0/1043482429 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c06d480 con 0x7f0c2c09af70 2024-09-12T02:06:37.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.811+0000 7f0c31a6d640 1 --2- 172.21.15.19:0/1043482429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c2c09af70 0x7f0c2c168560 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009d90 tx=0x7f0c2402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4381faf50a68a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:37.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.811+0000 7f0c23fff640 1 -- 172.21.15.19:0/1043482429 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c24007740 con 0x7f0c2c09af70 2024-09-12T02:06:37.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.811+0000 7f0c23fff640 1 -- 172.21.15.19:0/1043482429 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c240078e0 con 0x7f0c2c09af70 2024-09-12T02:06:37.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.812+0000 7f0c23fff640 1 -- 172.21.15.19:0/1043482429 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c24007cb0 con 0x7f0c2c09af70 2024-09-12T02:06:37.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.812+0000 7f0c334d0640 1 -- 172.21.15.19:0/1043482429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c2c09af70 msgr2=0x7f0c2c168560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.812+0000 7f0c334d0640 1 --2- 172.21.15.19:0/1043482429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c2c09af70 0x7f0c2c168560 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009d90 tx=0x7f0c2402a6f0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.812+0000 7f0c334d0640 1 -- 172.21.15.19:0/1043482429 shutdown_connections 2024-09-12T02:06:37.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.812+0000 7f0c334d0640 1 --2- 172.21.15.19:0/1043482429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c2c09af70 0x7f0c2c168560 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.812+0000 7f0c334d0640 1 --2- 172.21.15.19:0/1043482429 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c2c06df60 0x7f0c2c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.812+0000 7f0c334d0640 1 -- 172.21.15.19:0/1043482429 >> 172.21.15.19:0/1043482429 conn(0x7f0c2c0d23a0 msgr2=0x7f0c2c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:37.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.812+0000 7f0c334d0640 1 -- 172.21.15.19:0/1043482429 shutdown_connections 2024-09-12T02:06:37.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.812+0000 7f0c334d0640 1 -- 172.21.15.19:0/1043482429 wait complete. 2024-09-12T02:06:37.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.813+0000 7f0c334d0640 1 Processor -- start 2024-09-12T02:06:37.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.813+0000 7f0c334d0640 1 -- start start 2024-09-12T02:06:37.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.814+0000 7f0c334d0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c2c06df60 0x7f0c2c15c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.814+0000 7f0c334d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c2c09af70 0x7f0c2c1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.814+0000 7f0c334d0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c2c15e5d0 0x7f0c2c0c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.814+0000 7f0c334d0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c0d1980 con 0x7f0c2c09af70 2024-09-12T02:06:37.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.814+0000 7f0c334d0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c0d1800 con 0x7f0c2c15e5d0 2024-09-12T02:06:37.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.814+0000 7f0c334d0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2c15e9b0 con 0x7f0c2c06df60 2024-09-12T02:06:37.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.814+0000 7f0c30a6b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c2c09af70 0x7f0c2c1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.814+0000 7f0c30a6b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c2c09af70 0x7f0c2c1571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41676/0 (socket says 172.21.15.19:41676) 2024-09-12T02:06:37.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.814+0000 7f0c30a6b640 1 -- 172.21.15.19:0/3083290353 learned_addr learned my addr 172.21.15.19:0/3083290353 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:37.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.814+0000 7f0c3126c640 1 --2- 172.21.15.19:0/3083290353 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c2c06df60 0x7f0c2c15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.814+0000 7f0c31a6d640 1 --2- 172.21.15.19:0/3083290353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c2c15e5d0 0x7f0c2c0c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.815+0000 7f0c30a6b640 1 -- 172.21.15.19:0/3083290353 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c2c06df60 msgr2=0x7f0c2c15c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.815+0000 7f0c30a6b640 1 --2- 172.21.15.19:0/3083290353 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c2c06df60 0x7f0c2c15c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.815+0000 7f0c30a6b640 1 -- 172.21.15.19:0/3083290353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c2c15e5d0 msgr2=0x7f0c2c0c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.815+0000 7f0c30a6b640 1 --2- 172.21.15.19:0/3083290353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c2c15e5d0 0x7f0c2c0c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.815+0000 7f0c30a6b640 1 -- 172.21.15.19:0/3083290353 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c15c860 con 0x7f0c2c09af70 2024-09-12T02:06:37.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.815+0000 7f0c30a6b640 1 --2- 172.21.15.19:0/3083290353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c2c09af70 0x7f0c2c1571a0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00d600 tx=0x7f0c1c00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:37.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.815+0000 7f0c21ffb640 1 -- 172.21.15.19:0/3083290353 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c004240 con 0x7f0c2c09af70 2024-09-12T02:06:37.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.815+0000 7f0c21ffb640 1 -- 172.21.15.19:0/3083290353 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1c0043e0 con 0x7f0c2c09af70 2024-09-12T02:06:37.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.815+0000 7f0c334d0640 1 -- 172.21.15.19:0/3083290353 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2c15cb40 con 0x7f0c2c09af70 2024-09-12T02:06:37.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.815+0000 7f0c21ffb640 1 -- 172.21.15.19:0/3083290353 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c003830 con 0x7f0c2c09af70 2024-09-12T02:06:37.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.815+0000 7f0c334d0640 1 -- 172.21.15.19:0/3083290353 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2c15d100 con 0x7f0c2c09af70 2024-09-12T02:06:37.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.816+0000 7f0c334d0640 1 -- 172.21.15.19:0/3083290353 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c2c15dd50 con 0x7f0c2c09af70 2024-09-12T02:06:37.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.816+0000 7f0c21ffb640 1 -- 172.21.15.19:0/3083290353 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c1c0039d0 con 0x7f0c2c09af70 2024-09-12T02:06:37.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.817+0000 7f0c21ffb640 1 --2- 172.21.15.19:0/3083290353 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0c1006be30 0x7f0c1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:37.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.817+0000 7f0c21ffb640 1 -- 172.21.15.19:0/3083290353 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 9485+0+0 (secure 0 0 0) 0x7f0c1c08bf20 con 0x7f0c2c09af70 2024-09-12T02:06:37.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.817+0000 7f0c3126c640 1 --2- 172.21.15.19:0/3083290353 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0c1006be30 0x7f0c1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:37.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.818+0000 7f0c3126c640 1 --2- 172.21.15.19:0/3083290353 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0c1006be30 0x7f0c1006e2f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0c28005880 tx=0x7f0c28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:37.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:37.822+0000 7f0c21ffb640 1 -- 172.21.15.19:0/3083290353 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c2c15dd50 con 0x7f0c2c09af70 2024-09-12T02:06:38.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.036+0000 7f0c334d0640 1 -- 172.21.15.19:0/3083290353 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c2c0b8320 con 0x7f0c2c09af70 2024-09-12T02:06:38.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.037+0000 7f0c21ffb640 1 -- 172.21.15.19:0/3083290353 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 310 v310) ==== 95+0+4392 (secure 0 0 0) 0x7f0c1c059370 con 0x7f0c2c09af70 2024-09-12T02:06:38.036 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:38.036 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":310,"btime":"2024-09-12T02:06:34:684660+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":310,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:34.684656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":132,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:38.037 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 310 2024-09-12T02:06:38.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.039+0000 7f0c334d0640 1 -- 172.21.15.19:0/3083290353 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0c1006be30 msgr2=0x7f0c1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.039+0000 7f0c334d0640 1 --2- 172.21.15.19:0/3083290353 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0c1006be30 0x7f0c1006e2f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0c28005880 tx=0x7f0c28009040 comp rx=0 tx=0).stop 2024-09-12T02:06:38.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.039+0000 7f0c334d0640 1 -- 172.21.15.19:0/3083290353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c2c09af70 msgr2=0x7f0c2c1571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.039+0000 7f0c334d0640 1 --2- 172.21.15.19:0/3083290353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c2c09af70 0x7f0c2c1571a0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00d600 tx=0x7f0c1c00dac0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.039+0000 7f0c334d0640 1 -- 172.21.15.19:0/3083290353 shutdown_connections 2024-09-12T02:06:38.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.039+0000 7f0c334d0640 1 --2- 172.21.15.19:0/3083290353 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f0c1006be30 0x7f0c1006e2f0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.039+0000 7f0c334d0640 1 --2- 172.21.15.19:0/3083290353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c2c15e5d0 0x7f0c2c0c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.039+0000 7f0c334d0640 1 --2- 172.21.15.19:0/3083290353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c2c09af70 0x7f0c2c1571a0 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.039+0000 7f0c334d0640 1 --2- 172.21.15.19:0/3083290353 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c2c06df60 0x7f0c2c15c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.039+0000 7f0c334d0640 1 -- 172.21.15.19:0/3083290353 >> 172.21.15.19:0/3083290353 conn(0x7f0c2c0d23a0 msgr2=0x7f0c2c149e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:38.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.039+0000 7f0c334d0640 1 -- 172.21.15.19:0/3083290353 shutdown_connections 2024-09-12T02:06:38.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.039+0000 7f0c334d0640 1 -- 172.21.15.19:0/3083290353 wait complete. 2024-09-12T02:06:38.049 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap header on 100.00000000' led to DAMAGED state 2024-09-12T02:06:38.049 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap header on mds0_sessionmap' 2024-09-12T02:06:38.050 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:06:38.050 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:06:38.066 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:06:38.066 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:06:38.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:38.066 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:06:38.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:06:38.122 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:06:38.122 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:06:38.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.266+0000 7f589996d640 1 Processor -- start 2024-09-12T02:06:38.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.266+0000 7f589996d640 1 -- start start 2024-09-12T02:06:38.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.266+0000 7f589996d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f589409aa30 0x7f58940b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.266+0000 7f589996d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f589406cd20 0x7f5894162340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.266+0000 7f589996d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58940b2790 con 0x7f58940b3760 2024-09-12T02:06:38.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.266+0000 7f589996d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f58940d0670 con 0x7f589406cd20 2024-09-12T02:06:38.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.266+0000 7f589996d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f58940b2a70 con 0x7f589409aa30 2024-09-12T02:06:38.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.267+0000 7f58937fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f589406cd20 0x7f5894162340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.267+0000 7f5892ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f589409aa30 0x7f58940b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.267+0000 7f5892ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f589409aa30 0x7f58940b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:38638/0 (socket says 172.21.15.19:38638) 2024-09-12T02:06:38.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.267+0000 7f58927fc640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f58940b3760 0x7f589409ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:49506/0 (socket says 172.21.15.19:49506) 2024-09-12T02:06:38.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.267+0000 7f5892ffd640 1 -- 172.21.15.19:0/3987401213 learned_addr learned my addr 172.21.15.19:0/3987401213 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:38.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.267+0000 7f58937fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f589406cd20 0x7f5894162340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:46316/0 (socket says 172.21.15.19:46316) 2024-09-12T02:06:38.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.267+0000 7f58937fe640 1 -- 172.21.15.19:0/3987401213 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f589409aa30 msgr2=0x7f58940b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:38.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.267+0000 7f58937fe640 1 --2- 172.21.15.19:0/3987401213 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f589409aa30 0x7f58940b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.267+0000 7f58937fe640 1 -- 172.21.15.19:0/3987401213 >> v1:172.21.15.135:6789/0 conn(0x7f58940b3760 legacy=0x7f589409ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.267+0000 7f5891ffb640 1 -- 172.21.15.19:0/3987401213 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 928368758 0 0) 0x7f58940b2790 con 0x7f58940b3760 2024-09-12T02:06:38.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.267+0000 7f58937fe640 1 -- 172.21.15.19:0/3987401213 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58940b2d50 con 0x7f589406cd20 2024-09-12T02:06:38.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.267+0000 7f5892ffd640 1 --2- 172.21.15.19:0/3987401213 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f589409aa30 0x7f58940b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:38.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.268+0000 7f58937fe640 1 --2- 172.21.15.19:0/3987401213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f589406cd20 0x7f5894162340 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f588c0097a0 tx=0x7f588c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbdb5d6c8e3b5b57 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:38.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.268+0000 7f5891ffb640 1 -- 172.21.15.19:0/3987401213 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588c037070 con 0x7f589406cd20 2024-09-12T02:06:38.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.268+0000 7f5891ffb640 1 -- 172.21.15.19:0/3987401213 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f588c02ae50 con 0x7f589406cd20 2024-09-12T02:06:38.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.268+0000 7f5891ffb640 1 -- 172.21.15.19:0/3987401213 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588c032660 con 0x7f589406cd20 2024-09-12T02:06:38.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.269+0000 7f589996d640 1 -- 172.21.15.19:0/3987401213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f589406cd20 msgr2=0x7f5894162340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.269+0000 7f589996d640 1 --2- 172.21.15.19:0/3987401213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f589406cd20 0x7f5894162340 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f588c0097a0 tx=0x7f588c02a100 comp rx=0 tx=0).stop 2024-09-12T02:06:38.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.269+0000 7f589996d640 1 -- 172.21.15.19:0/3987401213 shutdown_connections 2024-09-12T02:06:38.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.269+0000 7f589996d640 1 --2- 172.21.15.19:0/3987401213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f589406cd20 0x7f5894162340 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.269+0000 7f589996d640 1 --2- 172.21.15.19:0/3987401213 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f589409aa30 0x7f58940b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.269+0000 7f589996d640 1 -- 172.21.15.19:0/3987401213 >> 172.21.15.19:0/3987401213 conn(0x7f58940d23a0 msgr2=0x7f58940d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:38.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.269+0000 7f589996d640 1 -- 172.21.15.19:0/3987401213 shutdown_connections 2024-09-12T02:06:38.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.269+0000 7f589996d640 1 -- 172.21.15.19:0/3987401213 wait complete. 2024-09-12T02:06:38.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.270+0000 7f589996d640 1 Processor -- start 2024-09-12T02:06:38.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.270+0000 7f589996d640 1 -- start start 2024-09-12T02:06:38.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.271+0000 7f589996d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f589406cd20 0x7f58941f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.271+0000 7f589996d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f589409aa30 0x7f589415ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.271+0000 7f589996d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58940b3760 0x7f589415d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.271+0000 7f589996d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f589415fe20 con 0x7f589406cd20 2024-09-12T02:06:38.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.271+0000 7f589996d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f589415fca0 con 0x7f58940b3760 2024-09-12T02:06:38.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.271+0000 7f589996d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f58940d1fe0 con 0x7f589409aa30 2024-09-12T02:06:38.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.271+0000 7f5892ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f589406cd20 0x7f58941f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.271+0000 7f5892ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f589406cd20 0x7f58941f47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41678/0 (socket says 172.21.15.19:41678) 2024-09-12T02:06:38.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.271+0000 7f5892ffd640 1 -- 172.21.15.19:0/667299807 learned_addr learned my addr 172.21.15.19:0/667299807 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:38.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.271+0000 7f58927fc640 1 --2- 172.21.15.19:0/667299807 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f589409aa30 0x7f589415ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.271+0000 7f58937fe640 1 --2- 172.21.15.19:0/667299807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58940b3760 0x7f589415d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.271+0000 7f5892ffd640 1 -- 172.21.15.19:0/667299807 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f589409aa30 msgr2=0x7f589415ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.271+0000 7f5892ffd640 1 --2- 172.21.15.19:0/667299807 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f589409aa30 0x7f589415ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.271+0000 7f5892ffd640 1 -- 172.21.15.19:0/667299807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58940b3760 msgr2=0x7f589415d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.271+0000 7f5892ffd640 1 --2- 172.21.15.19:0/667299807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58940b3760 0x7f589415d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.271+0000 7f5892ffd640 1 -- 172.21.15.19:0/667299807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58940ce0e0 con 0x7f589406cd20 2024-09-12T02:06:38.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.272+0000 7f5892ffd640 1 --2- 172.21.15.19:0/667299807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f589406cd20 0x7f58941f47f0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f5884009f20 tx=0x7f588400c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:38.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.272+0000 7f588bfff640 1 -- 172.21.15.19:0/667299807 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884014480 con 0x7f589406cd20 2024-09-12T02:06:38.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.272+0000 7f588bfff640 1 -- 172.21.15.19:0/667299807 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5884019070 con 0x7f589406cd20 2024-09-12T02:06:38.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.272+0000 7f589996d640 1 -- 172.21.15.19:0/667299807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58940c99d0 con 0x7f589406cd20 2024-09-12T02:06:38.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.272+0000 7f588bfff640 1 -- 172.21.15.19:0/667299807 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884014820 con 0x7f589406cd20 2024-09-12T02:06:38.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.272+0000 7f589996d640 1 -- 172.21.15.19:0/667299807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f589415d770 con 0x7f589406cd20 2024-09-12T02:06:38.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.273+0000 7f589996d640 1 -- 172.21.15.19:0/667299807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f589406e4e0 con 0x7f589406cd20 2024-09-12T02:06:38.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.273+0000 7f588bfff640 1 -- 172.21.15.19:0/667299807 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5884005d10 con 0x7f589406cd20 2024-09-12T02:06:38.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.274+0000 7f588bfff640 1 --2- 172.21.15.19:0/667299807 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f587406be30 0x7f587406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.274+0000 7f588bfff640 1 -- 172.21.15.19:0/667299807 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 9485+0+0 (secure 0 0 0) 0x7f588408c2a0 con 0x7f589406cd20 2024-09-12T02:06:38.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.274+0000 7f58927fc640 1 --2- 172.21.15.19:0/667299807 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f587406be30 0x7f587406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.275+0000 7f58927fc640 1 --2- 172.21.15.19:0/667299807 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f587406be30 0x7f587406e2f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f58941f8300 tx=0x7f587c007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:38.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.278+0000 7f588bfff640 1 -- 172.21.15.19:0/667299807 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f589406e4e0 con 0x7f589406cd20 2024-09-12T02:06:38.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.488+0000 7f589996d640 1 -- 172.21.15.19:0/667299807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f58940b3030 con 0x7f589406cd20 2024-09-12T02:06:38.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.682+0000 7f588bfff640 1 -- 172.21.15.19:0/667299807 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v311) ==== 161+0+0 (secure 0 0 0) 0x7f5884023020 con 0x7f589406cd20 2024-09-12T02:06:38.682 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:06:38.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.685+0000 7f589996d640 1 -- 172.21.15.19:0/667299807 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f587406be30 msgr2=0x7f587406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.685+0000 7f589996d640 1 --2- 172.21.15.19:0/667299807 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f587406be30 0x7f587406e2f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f58941f8300 tx=0x7f587c007de0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.685+0000 7f589996d640 1 -- 172.21.15.19:0/667299807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f589406cd20 msgr2=0x7f58941f47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.685+0000 7f589996d640 1 --2- 172.21.15.19:0/667299807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f589406cd20 0x7f58941f47f0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f5884009f20 tx=0x7f588400c550 comp rx=0 tx=0).stop 2024-09-12T02:06:38.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.685+0000 7f589996d640 1 -- 172.21.15.19:0/667299807 shutdown_connections 2024-09-12T02:06:38.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.685+0000 7f589996d640 1 --2- 172.21.15.19:0/667299807 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f587406be30 0x7f587406e2f0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.685+0000 7f589996d640 1 --2- 172.21.15.19:0/667299807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58940b3760 0x7f589415d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.685+0000 7f589996d640 1 --2- 172.21.15.19:0/667299807 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f589409aa30 0x7f589415ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.685+0000 7f589996d640 1 --2- 172.21.15.19:0/667299807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f589406cd20 0x7f58941f47f0 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.685+0000 7f589996d640 1 -- 172.21.15.19:0/667299807 >> 172.21.15.19:0/667299807 conn(0x7f58940d23a0 msgr2=0x7f589415b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:38.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.685+0000 7f589996d640 1 -- 172.21.15.19:0/667299807 shutdown_connections 2024-09-12T02:06:38.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.685+0000 7f589996d640 1 -- 172.21.15.19:0/667299807 wait complete. 2024-09-12T02:06:38.696 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:06:38.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.800+0000 7f00b1445640 1 Processor -- start 2024-09-12T02:06:38.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.800+0000 7f00b1445640 1 -- start start 2024-09-12T02:06:38.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.801+0000 7f00b1445640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f00ac15c490 0x7f00ac09b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.801+0000 7f00b1445640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00ac15cf80 0x7f00ac0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.801+0000 7f00b1445640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00ac0d01c0 con 0x7f00ac09b980 2024-09-12T02:06:38.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.801+0000 7f00b1445640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f00ac0cff70 con 0x7f00ac15c490 2024-09-12T02:06:38.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.801+0000 7f00b1445640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f00ac0d0dd0 con 0x7f00ac15cf80 2024-09-12T02:06:38.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.801+0000 7f00aaffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f00ac15c490 0x7f00ac09b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.801+0000 7f00aaffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f00ac15c490 0x7f00ac09b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41680/0 (socket says 172.21.15.19:41680) 2024-09-12T02:06:38.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.801+0000 7f00aaffd640 1 -- 172.21.15.19:0/3479035581 learned_addr learned my addr 172.21.15.19:0/3479035581 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:38.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.801+0000 7f00ab7fe640 1 --2- 172.21.15.19:0/3479035581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00ac15cf80 0x7f00ac0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.801+0000 7f00aaffd640 1 -- 172.21.15.19:0/3479035581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00ac15cf80 msgr2=0x7f00ac0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:38.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.801+0000 7f00aaffd640 1 --2- 172.21.15.19:0/3479035581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00ac15cf80 0x7f00ac0ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.801+0000 7f00aaffd640 1 -- 172.21.15.19:0/3479035581 >> v1:172.21.15.135:6789/0 conn(0x7f00ac09b980 legacy=0x7f00ac15c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:38.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.801+0000 7f00aaffd640 1 -- 172.21.15.19:0/3479035581 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ac0d04a0 con 0x7f00ac15c490 2024-09-12T02:06:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.802+0000 7f00aaffd640 1 --2- 172.21.15.19:0/3479035581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00ac15c490 0x7f00ac09b440 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f009c009870 tx=0x7f009c02e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7f04e3d03b8a9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.802+0000 7f00a9ffb640 1 -- 172.21.15.19:0/3479035581 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c03a070 con 0x7f00ac15c490 2024-09-12T02:06:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.802+0000 7f00a9ffb640 1 -- 172.21.15.19:0/3479035581 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009c033710 con 0x7f00ac15c490 2024-09-12T02:06:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.802+0000 7f00a9ffb640 1 -- 172.21.15.19:0/3479035581 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c033ae0 con 0x7f00ac15c490 2024-09-12T02:06:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.803+0000 7f00b1445640 1 -- 172.21.15.19:0/3479035581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00ac15c490 msgr2=0x7f00ac09b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.803+0000 7f00b1445640 1 --2- 172.21.15.19:0/3479035581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00ac15c490 0x7f00ac09b440 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f009c009870 tx=0x7f009c02e710 comp rx=0 tx=0).stop 2024-09-12T02:06:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.803+0000 7f00b1445640 1 -- 172.21.15.19:0/3479035581 shutdown_connections 2024-09-12T02:06:38.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.803+0000 7f00b1445640 1 --2- 172.21.15.19:0/3479035581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00ac15cf80 0x7f00ac0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.803+0000 7f00b1445640 1 --2- 172.21.15.19:0/3479035581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00ac15c490 0x7f00ac09b440 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.803+0000 7f00b1445640 1 -- 172.21.15.19:0/3479035581 >> 172.21.15.19:0/3479035581 conn(0x7f00ac0d23a0 msgr2=0x7f00ac0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:38.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.803+0000 7f00b1445640 1 -- 172.21.15.19:0/3479035581 shutdown_connections 2024-09-12T02:06:38.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.803+0000 7f00b1445640 1 -- 172.21.15.19:0/3479035581 wait complete. 2024-09-12T02:06:38.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.804+0000 7f00b1445640 1 Processor -- start 2024-09-12T02:06:38.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.804+0000 7f00b1445640 1 -- start start 2024-09-12T02:06:38.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.805+0000 7f00b1445640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00ac09b980 0x7f00ac15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.805+0000 7f00b1445640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00ac15c490 0x7f00ac0b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.805+0000 7f00b1445640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00ac15cf80 0x7f00ac0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.805+0000 7f00b1445640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac0d1260 con 0x7f00ac09b980 2024-09-12T02:06:38.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.805+0000 7f00b1445640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac0d0a60 con 0x7f00ac15cf80 2024-09-12T02:06:38.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.805+0000 7f00b1445640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f00ac15b120 con 0x7f00ac15c490 2024-09-12T02:06:38.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.805+0000 7f00aaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00ac09b980 0x7f00ac15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.805+0000 7f00aaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00ac09b980 0x7f00ac15abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41694/0 (socket says 172.21.15.19:41694) 2024-09-12T02:06:38.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.805+0000 7f00aaffd640 1 -- 172.21.15.19:0/2238162775 learned_addr learned my addr 172.21.15.19:0/2238162775 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:38.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.805+0000 7f00aa7fc640 1 --2- 172.21.15.19:0/2238162775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00ac15c490 0x7f00ac0b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.805+0000 7f00ab7fe640 1 --2- 172.21.15.19:0/2238162775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00ac15cf80 0x7f00ac0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.805+0000 7f00aaffd640 1 -- 172.21.15.19:0/2238162775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00ac15c490 msgr2=0x7f00ac0b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.805+0000 7f00aaffd640 1 --2- 172.21.15.19:0/2238162775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00ac15c490 0x7f00ac0b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.805+0000 7f00aaffd640 1 -- 172.21.15.19:0/2238162775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00ac15cf80 msgr2=0x7f00ac0b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.806+0000 7f00aaffd640 1 --2- 172.21.15.19:0/2238162775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00ac15cf80 0x7f00ac0b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.806+0000 7f00aaffd640 1 -- 172.21.15.19:0/2238162775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ac06dd30 con 0x7f00ac09b980 2024-09-12T02:06:38.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.806+0000 7f00aaffd640 1 --2- 172.21.15.19:0/2238162775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00ac09b980 0x7f00ac15abe0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f009c000c00 tx=0x7f009c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:38.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.806+0000 7f00937fe640 1 -- 172.21.15.19:0/2238162775 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c044020 con 0x7f00ac09b980 2024-09-12T02:06:38.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.806+0000 7f00937fe640 1 -- 172.21.15.19:0/2238162775 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009c03f870 con 0x7f00ac09b980 2024-09-12T02:06:38.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.806+0000 7f00b1445640 1 -- 172.21.15.19:0/2238162775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00ac06e010 con 0x7f00ac09b980 2024-09-12T02:06:38.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.806+0000 7f00937fe640 1 -- 172.21.15.19:0/2238162775 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c03a040 con 0x7f00ac09b980 2024-09-12T02:06:38.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.806+0000 7f00b1445640 1 -- 172.21.15.19:0/2238162775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00ac06e9b0 con 0x7f00ac09b980 2024-09-12T02:06:38.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.807+0000 7f00b1445640 1 -- 172.21.15.19:0/2238162775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00ac09b440 con 0x7f00ac09b980 2024-09-12T02:06:38.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.807+0000 7f00937fe640 1 -- 172.21.15.19:0/2238162775 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f009c047020 con 0x7f00ac09b980 2024-09-12T02:06:38.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.808+0000 7f00937fe640 1 --2- 172.21.15.19:0/2238162775 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f009806be30 0x7f009806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.808+0000 7f00937fe640 1 -- 172.21.15.19:0/2238162775 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 9485+0+0 (secure 0 0 0) 0x7f009c0b0680 con 0x7f00ac09b980 2024-09-12T02:06:38.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.808+0000 7f00aa7fc640 1 --2- 172.21.15.19:0/2238162775 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f009806be30 0x7f009806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.809+0000 7f00aa7fc640 1 --2- 172.21.15.19:0/2238162775 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f009806be30 0x7f009806e2f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f00ac15bfe0 tx=0x7f00a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:38.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:38.812+0000 7f00937fe640 1 -- 172.21.15.19:0/2238162775 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f009c04e030 con 0x7f00ac09b980 2024-09-12T02:06:39.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.061+0000 7f00b1445640 1 -- 172.21.15.19:0/2238162775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f00ac0d3190 con 0x7f00ac09b980 2024-09-12T02:06:39.434 INFO:tasks.ceph.mds.c.smithi019.stderr: -53> 2024-09-12T02:06:34.682+0000 7efda326c640 -1 mds.0.cache.dir(0x100) Corrupt fnode in dirfrag 0x100: Decoder at 'void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)' v=3 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-09-12T02:06:39.434 INFO:tasks.ceph.mds.c.smithi019.stderr: -33> 2024-09-12T02:06:35.325+0000 7efda7274640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:06:39.459 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:06:39.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.684+0000 7f00937fe640 1 -- 172.21.15.19:0/2238162775 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v312) ==== 101+0+0 (secure 0 0 0) 0x7f009c07dad0 con 0x7f00ac09b980 2024-09-12T02:06:39.684 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:06:39.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.687+0000 7f00b1445640 1 -- 172.21.15.19:0/2238162775 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f009806be30 msgr2=0x7f009806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.687+0000 7f00b1445640 1 --2- 172.21.15.19:0/2238162775 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f009806be30 0x7f009806e2f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f00ac15bfe0 tx=0x7f00a0009040 comp rx=0 tx=0).stop 2024-09-12T02:06:39.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.687+0000 7f00b1445640 1 -- 172.21.15.19:0/2238162775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00ac09b980 msgr2=0x7f00ac15abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.687+0000 7f00b1445640 1 --2- 172.21.15.19:0/2238162775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00ac09b980 0x7f00ac15abe0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f009c000c00 tx=0x7f009c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.687+0000 7f00b1445640 1 -- 172.21.15.19:0/2238162775 shutdown_connections 2024-09-12T02:06:39.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.687+0000 7f00b1445640 1 --2- 172.21.15.19:0/2238162775 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f009806be30 0x7f009806e2f0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.687+0000 7f00b1445640 1 --2- 172.21.15.19:0/2238162775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00ac15cf80 0x7f00ac0b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.687+0000 7f00b1445640 1 --2- 172.21.15.19:0/2238162775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00ac15c490 0x7f00ac0b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.687+0000 7f00b1445640 1 --2- 172.21.15.19:0/2238162775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00ac09b980 0x7f00ac15abe0 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.687+0000 7f00b1445640 1 -- 172.21.15.19:0/2238162775 >> 172.21.15.19:0/2238162775 conn(0x7f00ac0d23a0 msgr2=0x7f00ac0d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:39.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.687+0000 7f00b1445640 1 -- 172.21.15.19:0/2238162775 shutdown_connections 2024-09-12T02:06:39.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.687+0000 7f00b1445640 1 -- 172.21.15.19:0/2238162775 wait complete. 2024-09-12T02:06:39.700 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:06:39.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.747+0000 7fc4d8322f40 1 Processor -- start 2024-09-12T02:06:39.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.747+0000 7fc4d8322f40 1 -- start start 2024-09-12T02:06:39.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.748+0000 7fc4d8322f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c32f2259e0 0x55c32f26ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.748+0000 7fc4d8322f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c32f26e8e0 0x55c32f26b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.748+0000 7fc4d8322f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c32f2fcfb0 0x55c32f26c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.748+0000 7fc4d8322f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c32f26f230 con 0x55c32f26e8e0 2024-09-12T02:06:39.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.748+0000 7fc4d8322f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c32f177510 con 0x55c32f2259e0 2024-09-12T02:06:39.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.748+0000 7fc4d8322f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55c32f225f20 con 0x55c32f2fcfb0 2024-09-12T02:06:39.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.748+0000 7fc4d5617640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c32f26e8e0 0x55c32f26b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.748+0000 7fc4d5617640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c32f26e8e0 0x55c32f26b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41734/0 (socket says 172.21.15.19:41734) 2024-09-12T02:06:39.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.748+0000 7fc4d5617640 1 -- 172.21.15.19:0/3831538798 learned_addr learned my addr 172.21.15.19:0/3831538798 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:39.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.748+0000 7fc4d5e18640 1 --2- 172.21.15.19:0/3831538798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c32f2259e0 0x55c32f26ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.748+0000 7fc4d6619640 1 --2- 172.21.15.19:0/3831538798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c32f2fcfb0 0x55c32f26c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.749+0000 7fc4d5617640 1 -- 172.21.15.19:0/3831538798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c32f2fcfb0 msgr2=0x55c32f26c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:39.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.749+0000 7fc4d5617640 1 --2- 172.21.15.19:0/3831538798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c32f2fcfb0 0x55c32f26c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.749+0000 7fc4d5617640 1 -- 172.21.15.19:0/3831538798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c32f2259e0 msgr2=0x55c32f26ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.749+0000 7fc4d5617640 1 --2- 172.21.15.19:0/3831538798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c32f2259e0 0x55c32f26ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.749+0000 7fc4d5617640 1 -- 172.21.15.19:0/3831538798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c32f2fd430 con 0x55c32f26e8e0 2024-09-12T02:06:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.749+0000 7fc4d5617640 1 --2- 172.21.15.19:0/3831538798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c32f26e8e0 0x55c32f26b3d0 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc000c00 tx=0x7fc4cc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306746bad70cd801 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.749+0000 7fc4c7fff640 1 -- 172.21.15.19:0/3831538798 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc053920 con 0x55c32f26e8e0 2024-09-12T02:06:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.749+0000 7fc4c7fff640 1 -- 172.21.15.19:0/3831538798 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4cc062070 con 0x55c32f26e8e0 2024-09-12T02:06:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.749+0000 7fc4c7fff640 1 -- 172.21.15.19:0/3831538798 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc053ce0 con 0x55c32f26e8e0 2024-09-12T02:06:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.749+0000 7fc4d8322f40 1 -- 172.21.15.19:0/3831538798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c32f26e8e0 msgr2=0x55c32f26b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.750+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/3831538798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c32f26e8e0 0x55c32f26b3d0 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc000c00 tx=0x7fc4cc051000 comp rx=0 tx=0).stop 2024-09-12T02:06:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.750+0000 7fc4d8322f40 1 -- 172.21.15.19:0/3831538798 shutdown_connections 2024-09-12T02:06:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.750+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/3831538798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c32f2fcfb0 0x55c32f26c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.750+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/3831538798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c32f26e8e0 0x55c32f26b3d0 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.750+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/3831538798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c32f2259e0 0x55c32f26ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.750+0000 7fc4d8322f40 1 -- 172.21.15.19:0/3831538798 >> 172.21.15.19:0/3831538798 conn(0x55c32f253490 msgr2=0x55c32f253870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:39.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.750+0000 7fc4d8322f40 1 -- 172.21.15.19:0/3831538798 shutdown_connections 2024-09-12T02:06:39.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.750+0000 7fc4d8322f40 1 -- 172.21.15.19:0/3831538798 wait complete. 2024-09-12T02:06:39.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.750+0000 7fc4d8322f40 1 Processor -- start 2024-09-12T02:06:39.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.750+0000 7fc4d8322f40 1 -- start start 2024-09-12T02:06:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.751+0000 7fc4d8322f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c32f2259e0 0x55c32f270590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.751+0000 7fc4d8322f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c32f26e8e0 0x55c32f2fc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.751+0000 7fc4d8322f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c32f2fcfb0 0x55c32f2f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.751+0000 7fc4d8322f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c32f2fd710 con 0x55c32f26e8e0 2024-09-12T02:06:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.751+0000 7fc4d8322f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c32f26bf30 con 0x55c32f2259e0 2024-09-12T02:06:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.751+0000 7fc4d8322f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55c32f2fd9f0 con 0x55c32f2fcfb0 2024-09-12T02:06:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.751+0000 7fc4d5617640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c32f26e8e0 0x55c32f2fc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.751+0000 7fc4d5617640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c32f26e8e0 0x55c32f2fc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41738/0 (socket says 172.21.15.19:41738) 2024-09-12T02:06:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.751+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 learned_addr learned my addr 172.21.15.19:0/1880927632 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.751+0000 7fc4d5e18640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c32f2259e0 0x55c32f270590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.751+0000 7fc4d6619640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c32f2fcfb0 0x55c32f2f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.751+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c32f2fcfb0 msgr2=0x55c32f2f7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.751+0000 7fc4d5617640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c32f2fcfb0 0x55c32f2f7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.751+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c32f2259e0 msgr2=0x55c32f270590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.751+0000 7fc4d5617640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c32f2259e0 0x55c32f270590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.751+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c32f2f3070 con 0x55c32f26e8e0 2024-09-12T02:06:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.752+0000 7fc4d5617640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c32f26e8e0 0x55c32f2fc160 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc045f70 tx=0x7fc4cc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.752+0000 7fc4c6ffd640 1 -- 172.21.15.19:0/1880927632 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc077070 con 0x55c32f26e8e0 2024-09-12T02:06:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.752+0000 7fc4c6ffd640 1 -- 172.21.15.19:0/1880927632 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4cc053920 con 0x55c32f26e8e0 2024-09-12T02:06:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.752+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c32f2f7470 con 0x55c32f26e8e0 2024-09-12T02:06:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.752+0000 7fc4c6ffd640 1 -- 172.21.15.19:0/1880927632 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc053cf0 con 0x55c32f26e8e0 2024-09-12T02:06:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.752+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c32f2fb680 con 0x55c32f26e8e0 2024-09-12T02:06:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.753+0000 7fc4c6ffd640 1 -- 172.21.15.19:0/1880927632 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc4cc067470 con 0x55c32f26e8e0 2024-09-12T02:06:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.754+0000 7fc4c6ffd640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc4b806a810 0x7fc4b806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.754+0000 7fc4c6ffd640 1 -- 172.21.15.19:0/1880927632 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 9485+0+0 (secure 0 0 0) 0x7fc4cc0d0120 con 0x55c32f26e8e0 2024-09-12T02:06:39.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.754+0000 7fc4d5e18640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc4b806a810 0x7fc4b806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.756 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:06:39.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.754+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55c32f2f81e0 0x55c32f2e8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.754+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f2f3a90 con 0x55c32f2f81e0 2024-09-12T02:06:39.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.754+0000 7fc4d6619640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55c32f2f81e0 0x55c32f2e8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.754+0000 7fc4d5e18640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc4b806a810 0x7fc4b806ccd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8001ed0 tx=0x7fc4c80016b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.755+0000 7fc4d6619640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55c32f2f81e0 0x55c32f2e8f90 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.756+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v132'1159 uv1133 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.757+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f2f3e60 con 0x55c32f2f81e0 2024-09-12T02:06:39.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.758+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v132'1160 uv1160 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.758+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f2f42c0 con 0x55c32f2f81e0 2024-09-12T02:06:39.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.759+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v132'1161 uv1161 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.758 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:06:39.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.759+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a0da0 con 0x55c32f2f81e0 2024-09-12T02:06:39.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.760+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v132'1162 uv1162 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.760+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a1140 con 0x55c32f2f81e0 2024-09-12T02:06:39.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.761+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v132'1163 uv1163 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.761+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f39fd90 con 0x55c32f2f81e0 2024-09-12T02:06:39.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.762+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v132'1164 uv1164 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.762+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a0180 con 0x55c32f2f81e0 2024-09-12T02:06:39.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.764+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v132'1165 uv1139 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.764+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a0570 con 0x55c32f2f81e0 2024-09-12T02:06:39.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.765+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v132'1166 uv1166 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.765+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a0570 con 0x55c32f2f81e0 2024-09-12T02:06:39.765 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:06:39.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.766+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v132'1167 uv1167 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.766+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a0520 con 0x55c32f2f81e0 2024-09-12T02:06:39.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.767+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v132'1168 uv1168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.767+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a0520 con 0x55c32f2f81e0 2024-09-12T02:06:39.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.768+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v132'1169 uv1169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.768+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a0520 con 0x55c32f2f81e0 2024-09-12T02:06:39.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.769+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v132'1170 uv1170 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.769+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a0520 con 0x55c32f2f81e0 2024-09-12T02:06:39.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.771+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v132'1171 uv1146 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.771+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a0520 con 0x55c32f2f81e0 2024-09-12T02:06:39.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.772+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v132'1172 uv1172 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.772+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a0520 con 0x55c32f2f81e0 2024-09-12T02:06:39.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.773+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v132'1173 uv1173 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.772 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:06:39.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.773+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a0520 con 0x55c32f2f81e0 2024-09-12T02:06:39.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.774+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v132'1174 uv1174 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.774+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a0520 con 0x55c32f2f81e0 2024-09-12T02:06:39.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.775+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v132'1175 uv1175 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.775+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a0520 con 0x55c32f2f81e0 2024-09-12T02:06:39.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.776+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v132'1176 uv1176 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.776+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a14e0 con 0x55c32f2f81e0 2024-09-12T02:06:39.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.777+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v132'1177 uv1177 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.777+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a14e0 con 0x55c32f2f81e0 2024-09-12T02:06:39.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.778+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v132'1178 uv1152 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.778+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a14e0 con 0x55c32f2f81e0 2024-09-12T02:06:39.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.779+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v132'1179 uv1179 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.779+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a14e0 con 0x55c32f2f81e0 2024-09-12T02:06:39.780 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:06:39.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.781+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v132'1180 uv1180 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.781+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a24f0 con 0x55c32f2f81e0 2024-09-12T02:06:39.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.782+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v132'1181 uv1181 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.782+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a24f0 con 0x55c32f2f81e0 2024-09-12T02:06:39.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.783+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v132'1182 uv1182 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.783+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a14e0 con 0x55c32f2f81e0 2024-09-12T02:06:39.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.784+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v132'1183 uv1183 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.784+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a14e0 con 0x55c32f2f81e0 2024-09-12T02:06:39.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.785+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v132'1184 uv1158 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.785+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a14e0 con 0x55c32f2f81e0 2024-09-12T02:06:39.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.786+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v132'1185 uv1185 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.786+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a14e0 con 0x55c32f2f81e0 2024-09-12T02:06:39.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.787+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v132'1186 uv1186 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.787 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:06:39.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.787+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a24f0 con 0x55c32f2f81e0 2024-09-12T02:06:39.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.788+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v132'1187 uv1187 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.788+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a24f0 con 0x55c32f2f81e0 2024-09-12T02:06:39.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.789+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v132'1188 uv1188 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.789+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a14e0 con 0x55c32f2f81e0 2024-09-12T02:06:39.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.791+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v132'1189 uv1189 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f2f81e0 2024-09-12T02:06:39.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.791+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55c32f3a19f0 0x55c32f3a3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.791+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a4320 con 0x55c32f3a19f0 2024-09-12T02:06:39.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.791+0000 7fc4d5e18640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55c32f3a19f0 0x55c32f3a3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.791+0000 7fc4d5e18640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55c32f3a19f0 0x55c32f3a3de0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.793+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v132'847 uv829 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.793+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a46c0 con 0x55c32f3a19f0 2024-09-12T02:06:39.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.794+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v132'848 uv848 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.795+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a4a60 con 0x55c32f3a19f0 2024-09-12T02:06:39.795 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:06:39.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.796+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v132'849 uv849 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.796+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a52b0 con 0x55c32f3a19f0 2024-09-12T02:06:39.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.797+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v132'850 uv850 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.797+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a5650 con 0x55c32f3a19f0 2024-09-12T02:06:39.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.798+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v132'851 uv851 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.799+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a59f0 con 0x55c32f3a19f0 2024-09-12T02:06:39.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.800+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v132'852 uv834 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.800+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a5d90 con 0x55c32f3a19f0 2024-09-12T02:06:39.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.801+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v132'853 uv853 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.801+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a6130 con 0x55c32f3a19f0 2024-09-12T02:06:39.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.803+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v132'854 uv854 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.802 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:06:39.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.803+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a6130 con 0x55c32f3a19f0 2024-09-12T02:06:39.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.804+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v132'855 uv855 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.804+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a6130 con 0x55c32f3a19f0 2024-09-12T02:06:39.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.805+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v132'856 uv856 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.805+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a6130 con 0x55c32f3a19f0 2024-09-12T02:06:39.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.807+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v132'857 uv839 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.807+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a6130 con 0x55c32f3a19f0 2024-09-12T02:06:39.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.808+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v132'858 uv858 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.808+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a6130 con 0x55c32f3a19f0 2024-09-12T02:06:39.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.809+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v132'859 uv859 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.809 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:06:39.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.809+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3aa5b0 con 0x55c32f3a19f0 2024-09-12T02:06:39.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.811+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v132'860 uv860 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.811+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3aa5b0 con 0x55c32f3a19f0 2024-09-12T02:06:39.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.812+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v132'861 uv861 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.812+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a6130 con 0x55c32f3a19f0 2024-09-12T02:06:39.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.813+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v132'862 uv845 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.813+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a6130 con 0x55c32f3a19f0 2024-09-12T02:06:39.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.815+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v132'863 uv863 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.815+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a6130 con 0x55c32f3a19f0 2024-09-12T02:06:39.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.816+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v132'864 uv864 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.815 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:06:39.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.816+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a7140 con 0x55c32f3a19f0 2024-09-12T02:06:39.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.817+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v132'865 uv865 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.817+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a7140 con 0x55c32f3a19f0 2024-09-12T02:06:39.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.819+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v132'866 uv866 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.819+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a6130 con 0x55c32f3a19f0 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.820+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v132'867 uv867 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3a19f0 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.820+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c32f3a6640 0x55c32f3a8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.820+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a8f70 con 0x55c32f3a6640 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.821+0000 7fc4d5617640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c32f3a6640 0x55c32f3a8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.821+0000 7fc4d5617640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c32f3a6640 0x55c32f3a8a30 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.822+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v132'225 uv224 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.822+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a93d0 con 0x55c32f3a6640 2024-09-12T02:06:39.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.823+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v132'226 uv226 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.824+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a98b0 con 0x55c32f3a6640 2024-09-12T02:06:39.824 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:06:39.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.825+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v132'227 uv227 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.825+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3ab160 con 0x55c32f3a6640 2024-09-12T02:06:39.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.826+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v132'228 uv228 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.826+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3ab500 con 0x55c32f3a6640 2024-09-12T02:06:39.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.827+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v132'229 uv229 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.827+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3aa150 con 0x55c32f3a6640 2024-09-12T02:06:39.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.828+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v132'230 uv230 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.828+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55c32f3aaa50 0x55c32f3ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.828+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3addf0 con 0x55c32f3aaa50 2024-09-12T02:06:39.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.828+0000 7fc4d6619640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55c32f3aaa50 0x55c32f3ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.829+0000 7fc4d6619640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55c32f3aaa50 0x55c32f3ad8b0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.830+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v132'171 uv170 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.830+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3addf0 con 0x55c32f3aaa50 2024-09-12T02:06:39.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.831+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v132'172 uv172 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.831+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3ade70 con 0x55c32f3aaa50 2024-09-12T02:06:39.831 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:06:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.832+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v132'173 uv173 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.832+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3a9da0 con 0x55c32f3aaa50 2024-09-12T02:06:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.833+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v132'174 uv174 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.833+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55c32f3aea60 0x55c32f3b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.833+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1460 con 0x55c32f3aea60 2024-09-12T02:06:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.834+0000 7fc4d5e18640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55c32f3aea60 0x55c32f3b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.834+0000 7fc4d5e18640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55c32f3aea60 0x55c32f3b0e50 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.835+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v132'225 uv224 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.835+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1520 con 0x55c32f3aea60 2024-09-12T02:06:39.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.837+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v132'226 uv226 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.837+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aea60 2024-09-12T02:06:39.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.838+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v132'227 uv227 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.837 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:06:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.838+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b2950 con 0x55c32f3aea60 2024-09-12T02:06:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.839+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v132'228 uv228 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.839+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b2950 con 0x55c32f3aea60 2024-09-12T02:06:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.840+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v132'229 uv229 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.840+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aea60 2024-09-12T02:06:39.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.842+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v132'230 uv230 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.842+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aaa50 2024-09-12T02:06:39.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.843+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v132'415 uv409 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.843+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aaa50 2024-09-12T02:06:39.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.844+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v132'416 uv416 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.844+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aaa50 2024-09-12T02:06:39.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.845+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v132'417 uv417 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.845 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:06:39.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.845+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b2950 con 0x55c32f3aaa50 2024-09-12T02:06:39.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.846+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v132'418 uv418 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.846+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b2950 con 0x55c32f3aaa50 2024-09-12T02:06:39.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.847+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v132'419 uv419 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.848+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aaa50 2024-09-12T02:06:39.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.849+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v132'420 uv420 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.849+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aaa50 2024-09-12T02:06:39.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.850+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v132'421 uv414 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.850+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aaa50 2024-09-12T02:06:39.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.851+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v132'422 uv422 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.851+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aaa50 2024-09-12T02:06:39.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.852+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v132'423 uv423 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.851 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:06:39.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.852+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aaa50 2024-09-12T02:06:39.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.853+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v132'424 uv424 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.853+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aaa50 2024-09-12T02:06:39.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.854+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v132'425 uv425 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.854+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aaa50 2024-09-12T02:06:39.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.855+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v132'188 uv187 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.855+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aaa50 2024-09-12T02:06:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.856+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v132'189 uv189 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.856+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aaa50 2024-09-12T02:06:39.856 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:06:39.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.857+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v132'190 uv190 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.857+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aaa50 2024-09-12T02:06:39.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.858+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v132'191 uv191 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.858+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aaa50 2024-09-12T02:06:39.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.859+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v132'192 uv192 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc4d000c970 con 0x55c32f3aaa50 2024-09-12T02:06:39.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.859+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aea60 2024-09-12T02:06:39.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.860+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v132'225 uv224 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.860+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aea60 2024-09-12T02:06:39.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.861+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v132'226 uv226 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.861+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aea60 2024-09-12T02:06:39.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.862+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v132'227 uv227 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.862 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:06:39.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.862+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b2950 con 0x55c32f3aea60 2024-09-12T02:06:39.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.863+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v132'228 uv228 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.863+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b2950 con 0x55c32f3aea60 2024-09-12T02:06:39.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.866+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v132'229 uv229 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.866+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aea60 2024-09-12T02:06:39.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.867+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v132'230 uv230 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.867+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aea60 2024-09-12T02:06:39.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.868+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v132'376 uv369 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.868+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aea60 2024-09-12T02:06:39.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.869+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v132'377 uv377 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.869+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1940 con 0x55c32f3aea60 2024-09-12T02:06:39.869 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:06:39.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.870+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v132'378 uv378 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.870+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1d50 con 0x55c32f3aea60 2024-09-12T02:06:39.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.871+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v132'379 uv379 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.871+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1d50 con 0x55c32f3aea60 2024-09-12T02:06:39.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.872+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v132'380 uv380 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.872+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1d00 con 0x55c32f3aea60 2024-09-12T02:06:39.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.873+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v132'381 uv375 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.873+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1d00 con 0x55c32f3aea60 2024-09-12T02:06:39.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.874+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v132'382 uv382 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.874+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1d00 con 0x55c32f3aea60 2024-09-12T02:06:39.874 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:06:39.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.875+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v132'383 uv383 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.875+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b1d00 con 0x55c32f3aea60 2024-09-12T02:06:39.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.876+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v132'384 uv384 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.876+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b4b10 con 0x55c32f3aea60 2024-09-12T02:06:39.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.877+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v132'385 uv385 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.877+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55c32f3b2580 0x55c32f3b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.877+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b4eb0 con 0x55c32f3b2580 2024-09-12T02:06:39.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.877+0000 7fc4d5617640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55c32f3b2580 0x55c32f3b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.878+0000 7fc4d5617640 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55c32f3b2580 0x55c32f3b4970 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.879+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v132'167 uv165 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3b2580 2024-09-12T02:06:39.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.879+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b4eb0 con 0x55c32f3b2580 2024-09-12T02:06:39.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.880+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v132'168 uv168 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3b2580 2024-09-12T02:06:39.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.880+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b4eb0 con 0x55c32f3b2580 2024-09-12T02:06:39.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.881+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v132'169 uv169 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3b2580 2024-09-12T02:06:39.881 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:06:39.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.881+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b4eb0 con 0x55c32f3b2580 2024-09-12T02:06:39.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.882+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v132'170 uv170 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3b2580 2024-09-12T02:06:39.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.882+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b4eb0 con 0x55c32f3aea60 2024-09-12T02:06:39.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.883+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v132'225 uv224 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.883+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b4eb0 con 0x55c32f3aea60 2024-09-12T02:06:39.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.884+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v132'226 uv226 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.884+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b4eb0 con 0x55c32f3aea60 2024-09-12T02:06:39.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.886+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v132'227 uv227 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.885 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:06:39.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.886+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b4eb0 con 0x55c32f3aea60 2024-09-12T02:06:39.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.887+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v132'228 uv228 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.887+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b4eb0 con 0x55c32f3aea60 2024-09-12T02:06:39.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.888+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v132'229 uv229 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.888+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b4eb0 con 0x55c32f3aea60 2024-09-12T02:06:39.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.889+0000 7fc4d5e18640 1 -- 172.21.15.19:0/1880927632 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v132'230 uv230 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4c800ea80 con 0x55c32f3aea60 2024-09-12T02:06:39.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.889+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b4eb0 con 0x55c32f3a6640 2024-09-12T02:06:39.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.890+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v132'191 uv190 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.890+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b4eb0 con 0x55c32f3a6640 2024-09-12T02:06:39.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.891+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v132'192 uv192 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.891+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b4eb0 con 0x55c32f3a6640 2024-09-12T02:06:39.891 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:06:39.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.892+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v132'193 uv193 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.892+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b4ef0 con 0x55c32f3a6640 2024-09-12T02:06:39.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.894+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v132'194 uv194 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.894+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b5340 con 0x55c32f3a6640 2024-09-12T02:06:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.895+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v132'195 uv195 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.895+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b5340 con 0x55c32f3a6640 2024-09-12T02:06:39.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.896+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v132'468 uv459 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.896+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b52f0 con 0x55c32f3a6640 2024-09-12T02:06:39.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.897+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v132'469 uv469 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.897+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b52f0 con 0x55c32f3a6640 2024-09-12T02:06:39.897 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:06:39.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.898+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v132'470 uv470 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.898+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b52f0 con 0x55c32f3a6640 2024-09-12T02:06:39.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.900+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v132'471 uv471 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.900+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b52f0 con 0x55c32f3a6640 2024-09-12T02:06:39.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.901+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v132'472 uv472 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.901+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b52f0 con 0x55c32f3a6640 2024-09-12T02:06:39.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.902+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v132'473 uv466 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.902+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b52f0 con 0x55c32f3a6640 2024-09-12T02:06:39.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.903+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v132'474 uv474 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.903+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b52f0 con 0x55c32f3a6640 2024-09-12T02:06:39.903 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:06:39.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.904+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v132'475 uv475 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.904+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b5330 con 0x55c32f3a6640 2024-09-12T02:06:39.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.905+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v132'476 uv476 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.905+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b52f0 con 0x55c32f3a6640 2024-09-12T02:06:39.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.906+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v132'477 uv477 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.906+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b52f0 con 0x55c32f3a6640 2024-09-12T02:06:39.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.907+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v132'478 uv478 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.907+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55c32f3b57b0 con 0x55c32f3a6640 2024-09-12T02:06:39.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d5617640 1 -- 172.21.15.19:0/1880927632 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v132'479 uv479 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fc4cc099bc0 con 0x55c32f3a6640 2024-09-12T02:06:39.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55c32f3a19f0 msgr2=0x55c32f3a3de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55c32f3a19f0 0x55c32f3a3de0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55c32f2f81e0 msgr2=0x55c32f2e8f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55c32f2f81e0 0x55c32f2e8f90 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55c32f3aaa50 msgr2=0x55c32f3ad8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55c32f3aaa50 0x55c32f3ad8b0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55c32f3b2580 msgr2=0x55c32f3b4970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55c32f3b2580 0x55c32f3b4970 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c32f3a6640 msgr2=0x55c32f3a8a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55c32f3a6640 0x55c32f3a8a30 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55c32f3aea60 msgr2=0x55c32f3b0e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55c32f3aea60 0x55c32f3b0e50 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 reap_dead start 2024-09-12T02:06:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d6619640 1 -- 172.21.15.19:0/1880927632 reap_dead start 2024-09-12T02:06:39.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc4b806a810 msgr2=0x7fc4b806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc4b806a810 0x7fc4b806ccd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8001ed0 tx=0x7fc4c80016b0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c32f26e8e0 msgr2=0x55c32f2fc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c32f26e8e0 0x55c32f2fc160 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc045f70 tx=0x7fc4cc002fb0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 shutdown_connections 2024-09-12T02:06:39.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc4b806a810 0x7fc4b806ccd0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 --2- 172.21.15.19:0/1880927632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c32f26e8e0 0x55c32f2fc160 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 >> 172.21.15.19:0/1880927632 conn(0x55c32f253490 msgr2=0x55c32f26c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:39.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 shutdown_connections 2024-09-12T02:06:39.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.908+0000 7fc4d8322f40 1 -- 172.21.15.19:0/1880927632 wait complete. 2024-09-12T02:06:39.911 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapheader mds0_sessionmap deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-09-12T02:06:39.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.956+0000 7f135900af40 1 Processor -- start 2024-09-12T02:06:39.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.956+0000 7f135900af40 1 -- start start 2024-09-12T02:06:39.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.957+0000 7f135900af40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff7c50b350 0x55ff7c5c3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.957+0000 7f135900af40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ff7c539050 0x55ff7c5c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.957+0000 7f135900af40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff7c5c3080 0x55ff7c5e2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.957+0000 7f135900af40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ff7c507ae0 con 0x55ff7c50b350 2024-09-12T02:06:39.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.957+0000 7f135900af40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ff7c45a510 con 0x55ff7c5c3080 2024-09-12T02:06:39.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.957+0000 7f135900af40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55ff7c507dc0 con 0x55ff7c539050 2024-09-12T02:06:39.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.957+0000 7f1355eb3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff7c50b350 0x55ff7c5c3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.957+0000 7f1355eb3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff7c50b350 0x55ff7c5c3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41758/0 (socket says 172.21.15.19:41758) 2024-09-12T02:06:39.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.957+0000 7f1355eb3640 1 -- 172.21.15.19:0/3657105710 learned_addr learned my addr 172.21.15.19:0/3657105710 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:39.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.957+0000 7f13556b2640 1 --2- 172.21.15.19:0/3657105710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ff7c539050 0x55ff7c5c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.957+0000 7f13566b4640 1 --2- 172.21.15.19:0/3657105710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff7c5c3080 0x55ff7c5e2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.957+0000 7f1355eb3640 1 -- 172.21.15.19:0/3657105710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ff7c539050 msgr2=0x55ff7c5c0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:39.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.957+0000 7f1355eb3640 1 --2- 172.21.15.19:0/3657105710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ff7c539050 0x55ff7c5c0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.957+0000 7f1355eb3640 1 -- 172.21.15.19:0/3657105710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff7c5c3080 msgr2=0x55ff7c5e2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:39.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.957+0000 7f1355eb3640 1 --2- 172.21.15.19:0/3657105710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff7c5c3080 0x55ff7c5e2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.957+0000 7f1355eb3640 1 -- 172.21.15.19:0/3657105710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff7c552800 con 0x55ff7c50b350 2024-09-12T02:06:39.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.957+0000 7f13566b4640 1 --2- 172.21.15.19:0/3657105710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff7c5c3080 0x55ff7c5e2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.957+0000 7f13556b2640 1 --2- 172.21.15.19:0/3657105710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ff7c539050 0x55ff7c5c0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.958+0000 7f1355eb3640 1 --2- 172.21.15.19:0/3657105710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff7c50b350 0x55ff7c5c3460 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f134800a770 tx=0x7f134800a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ac64922f4d7aca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.958+0000 7f1347fff640 1 -- 172.21.15.19:0/3657105710 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1348019070 con 0x55ff7c50b350 2024-09-12T02:06:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.958+0000 7f1347fff640 1 -- 172.21.15.19:0/3657105710 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1348007600 con 0x55ff7c50b350 2024-09-12T02:06:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.958+0000 7f1347fff640 1 -- 172.21.15.19:0/3657105710 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13480079d0 con 0x55ff7c50b350 2024-09-12T02:06:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.958+0000 7f135900af40 1 -- 172.21.15.19:0/3657105710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff7c50b350 msgr2=0x55ff7c5c3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.958+0000 7f135900af40 1 --2- 172.21.15.19:0/3657105710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff7c50b350 0x55ff7c5c3460 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f134800a770 tx=0x7f134800a860 comp rx=0 tx=0).stop 2024-09-12T02:06:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.958+0000 7f135900af40 1 -- 172.21.15.19:0/3657105710 shutdown_connections 2024-09-12T02:06:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.958+0000 7f135900af40 1 --2- 172.21.15.19:0/3657105710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff7c5c3080 0x55ff7c5e2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.958+0000 7f135900af40 1 --2- 172.21.15.19:0/3657105710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ff7c539050 0x55ff7c5c0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.958+0000 7f135900af40 1 --2- 172.21.15.19:0/3657105710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff7c50b350 0x55ff7c5c3460 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.958+0000 7f135900af40 1 -- 172.21.15.19:0/3657105710 >> 172.21.15.19:0/3657105710 conn(0x55ff7c5089e0 msgr2=0x55ff7c538840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.958+0000 7f135900af40 1 -- 172.21.15.19:0/3657105710 shutdown_connections 2024-09-12T02:06:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.958+0000 7f135900af40 1 -- 172.21.15.19:0/3657105710 wait complete. 2024-09-12T02:06:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.959+0000 7f135900af40 1 Processor -- start 2024-09-12T02:06:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.959+0000 7f135900af40 1 -- start start 2024-09-12T02:06:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f135900af40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ff7c50b350 0x55ff7c5e1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f135900af40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff7c539050 0x55ff7c5de580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f135900af40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff7c5c3080 0x55ff7c5deac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f135900af40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ff7c5c14a0 con 0x55ff7c539050 2024-09-12T02:06:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f135900af40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ff7c536fc0 con 0x55ff7c5c3080 2024-09-12T02:06:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f135900af40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55ff7c552aa0 con 0x55ff7c50b350 2024-09-12T02:06:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f13556b2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff7c539050 0x55ff7c5de580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f13556b2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff7c539050 0x55ff7c5de580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41770/0 (socket says 172.21.15.19:41770) 2024-09-12T02:06:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f13556b2640 1 -- 172.21.15.19:0/35666470 learned_addr learned my addr 172.21.15.19:0/35666470 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f13566b4640 1 --2- 172.21.15.19:0/35666470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff7c5c3080 0x55ff7c5deac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f1355eb3640 1 --2- 172.21.15.19:0/35666470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ff7c50b350 0x55ff7c5e1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f13556b2640 1 -- 172.21.15.19:0/35666470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ff7c50b350 msgr2=0x55ff7c5e1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f13556b2640 1 --2- 172.21.15.19:0/35666470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55ff7c50b350 0x55ff7c5e1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f13556b2640 1 -- 172.21.15.19:0/35666470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff7c5c3080 msgr2=0x55ff7c5deac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f13556b2640 1 --2- 172.21.15.19:0/35666470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff7c5c3080 0x55ff7c5deac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f13556b2640 1 -- 172.21.15.19:0/35666470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff7c5381f0 con 0x55ff7c539050 2024-09-12T02:06:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f13556b2640 1 --2- 172.21.15.19:0/35666470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff7c539050 0x55ff7c5de580 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f134c000f60 tx=0x7f134c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f1346ffd640 1 -- 172.21.15.19:0/35666470 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c00f650 con 0x55ff7c539050 2024-09-12T02:06:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f1346ffd640 1 -- 172.21.15.19:0/35666470 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f134c00f7f0 con 0x55ff7c539050 2024-09-12T02:06:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f135900af40 1 -- 172.21.15.19:0/35666470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff7c5bfdd0 con 0x55ff7c539050 2024-09-12T02:06:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f1346ffd640 1 -- 172.21.15.19:0/35666470 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c00fbc0 con 0x55ff7c539050 2024-09-12T02:06:39.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.960+0000 7f135900af40 1 -- 172.21.15.19:0/35666470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff7c5bfa60 con 0x55ff7c539050 2024-09-12T02:06:39.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.962+0000 7f1346ffd640 1 -- 172.21.15.19:0/35666470 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f134c017400 con 0x55ff7c539050 2024-09-12T02:06:39.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.962+0000 7f1346ffd640 1 --2- 172.21.15.19:0/35666470 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f133806a840 0x7f133806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.962+0000 7f1346ffd640 1 -- 172.21.15.19:0/35666470 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 9485+0+0 (secure 0 0 0) 0x7f134c08b250 con 0x55ff7c539050 2024-09-12T02:06:39.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.963+0000 7f1355eb3640 1 --2- 172.21.15.19:0/35666470 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f133806a840 0x7f133806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.963+0000 7f135900af40 1 --2- 172.21.15.19:0/35666470 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55ff7c5e2390 0x55ff7c54d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.963+0000 7f135900af40 1 -- 172.21.15.19:0/35666470 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:1 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) -- 0x55ff7c5c00d0 con 0x55ff7c5e2390 2024-09-12T02:06:39.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.963+0000 7f13566b4640 1 --2- 172.21.15.19:0/35666470 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55ff7c5e2390 0x55ff7c54d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.963+0000 7f1355eb3640 1 --2- 172.21.15.19:0/35666470 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f133806a840 0x7f133806cd00 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f1348017040 tx=0x7f134800c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.963+0000 7f13566b4640 1 --2- 172.21.15.19:0/35666470 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55ff7c5e2390 0x55ff7c54d5f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.964+0000 7f13566b4640 1 -- 172.21.15.19:0/35666470 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(1 mds0_sessionmap [omap-set-header] v132'171 uv171 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f135004e040 con 0x55ff7c5e2390 2024-09-12T02:06:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.964+0000 7f135900af40 1 -- 172.21.15.19:0/35666470 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55ff7c5e2390 msgr2=0x55ff7c54d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.965+0000 7f135900af40 1 --2- 172.21.15.19:0/35666470 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55ff7c5e2390 0x55ff7c54d5f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.965+0000 7f135900af40 1 -- 172.21.15.19:0/35666470 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f133806a840 msgr2=0x7f133806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.965+0000 7f135900af40 1 --2- 172.21.15.19:0/35666470 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f133806a840 0x7f133806cd00 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f1348017040 tx=0x7f134800c000 comp rx=0 tx=0).stop 2024-09-12T02:06:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.965+0000 7f135900af40 1 -- 172.21.15.19:0/35666470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff7c539050 msgr2=0x55ff7c5de580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.965+0000 7f135900af40 1 --2- 172.21.15.19:0/35666470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff7c539050 0x55ff7c5de580 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f134c000f60 tx=0x7f134c00b6c0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.965+0000 7f13566b4640 1 -- 172.21.15.19:0/35666470 reap_dead start 2024-09-12T02:06:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.965+0000 7f135900af40 1 -- 172.21.15.19:0/35666470 shutdown_connections 2024-09-12T02:06:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.965+0000 7f135900af40 1 -- 172.21.15.19:0/35666470 >> 172.21.15.19:0/35666470 conn(0x55ff7c5089e0 msgr2=0x55ff7c506e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.965+0000 7f135900af40 1 -- 172.21.15.19:0/35666470 shutdown_connections 2024-09-12T02:06:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:39.965+0000 7f135900af40 1 -- 172.21.15.19:0/35666470 wait complete. 2024-09-12T02:06:39.969 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:06:40.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.074+0000 7f155e8f8640 1 Processor -- start 2024-09-12T02:06:40.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.074+0000 7f155e8f8640 1 -- start start 2024-09-12T02:06:40.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.075+0000 7f155e8f8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f15580d15f0 0x7f15580cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:40.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.075+0000 7f155e8f8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15580cf980 con 0x7f15580cf160 2024-09-12T02:06:40.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.075+0000 7f155e8f8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f155806d050 con 0x7f1558161a20 2024-09-12T02:06:40.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.075+0000 7f155e8f8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f1558161e00 con 0x7f15580d15f0 2024-09-12T02:06:40.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.075+0000 7f155ce95640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f15580cf160 0x7f155806d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43954/0 (socket says 172.21.15.19:43954) 2024-09-12T02:06:40.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.075+0000 7f155ce95640 1 -- 172.21.15.19:0/4105109337 learned_addr learned my addr 172.21.15.19:0/4105109337 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:40.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.075+0000 7f15577fe640 1 --2- 172.21.15.19:0/4105109337 >> v2:172.21.15.135:3300/0 conn(0x7f15580d15f0 0x7f15580cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:40.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.075+0000 7f1556ffd640 1 -- 172.21.15.19:0/4105109337 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 926812333 0 0) 0x7f15580cf980 con 0x7f15580cf160 2024-09-12T02:06:40.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.076+0000 7f1556ffd640 1 -- 172.21.15.19:0/4105109337 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1540003520 con 0x7f15580cf160 2024-09-12T02:06:40.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.076+0000 7f15577fe640 1 -- 172.21.15.19:0/4105109337 >> v1:172.21.15.135:6789/0 conn(0x7f1558161a20 legacy=0x7f15580d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:40.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.076+0000 7f15577fe640 1 -- 172.21.15.19:0/4105109337 >> v1:172.21.15.19:6789/0 conn(0x7f15580cf160 legacy=0x7f155806d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:40.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.076+0000 7f15577fe640 1 -- 172.21.15.19:0/4105109337 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15580cfc20 con 0x7f15580d15f0 2024-09-12T02:06:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.076+0000 7f15577fe640 1 --2- 172.21.15.19:0/4105109337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15580d15f0 0x7f15580cec20 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f154c0097a0 tx=0x7f154c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2413d07611674c6a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.077+0000 7f1556ffd640 1 -- 172.21.15.19:0/4105109337 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c037070 con 0x7f15580d15f0 2024-09-12T02:06:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.077+0000 7f1556ffd640 1 -- 172.21.15.19:0/4105109337 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f154c032440 con 0x7f15580d15f0 2024-09-12T02:06:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.077+0000 7f1556ffd640 1 -- 172.21.15.19:0/4105109337 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c032810 con 0x7f15580d15f0 2024-09-12T02:06:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.077+0000 7f155e8f8640 1 -- 172.21.15.19:0/4105109337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15580d15f0 msgr2=0x7f15580cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.077+0000 7f155e8f8640 1 --2- 172.21.15.19:0/4105109337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15580d15f0 0x7f15580cec20 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f154c0097a0 tx=0x7f154c02a230 comp rx=0 tx=0).stop 2024-09-12T02:06:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.077+0000 7f155e8f8640 1 -- 172.21.15.19:0/4105109337 shutdown_connections 2024-09-12T02:06:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.077+0000 7f155e8f8640 1 --2- 172.21.15.19:0/4105109337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15580d15f0 0x7f15580cec20 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.077+0000 7f155e8f8640 1 -- 172.21.15.19:0/4105109337 >> 172.21.15.19:0/4105109337 conn(0x7f155809d850 msgr2=0x7f155808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.077+0000 7f155e8f8640 1 -- 172.21.15.19:0/4105109337 shutdown_connections 2024-09-12T02:06:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.077+0000 7f155e8f8640 1 -- 172.21.15.19:0/4105109337 wait complete. 2024-09-12T02:06:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.078+0000 7f155e8f8640 1 Processor -- start 2024-09-12T02:06:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.079+0000 7f155e8f8640 1 -- start start 2024-09-12T02:06:40.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.079+0000 7f155e8f8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15580cf160 0x7f1558158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:40.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.079+0000 7f155e8f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15580d15f0 0x7f15580b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:40.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.079+0000 7f155e8f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1558161a20 0x7f15580b6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:40.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.079+0000 7f155e8f8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f15580b1040 con 0x7f1558161a20 2024-09-12T02:06:40.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.079+0000 7f155e8f8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f155806d2f0 con 0x7f15580cf160 2024-09-12T02:06:40.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.079+0000 7f155e8f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f15580cf590 con 0x7f15580d15f0 2024-09-12T02:06:40.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.079+0000 7f155ce95640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1558161a20 0x7f15580b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:40.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.079+0000 7f155ce95640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1558161a20 0x7f15580b6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41784/0 (socket says 172.21.15.19:41784) 2024-09-12T02:06:40.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.079+0000 7f155ce95640 1 -- 172.21.15.19:0/3473173918 learned_addr learned my addr 172.21.15.19:0/3473173918 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:40.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.079+0000 7f1557fff640 1 --2- 172.21.15.19:0/3473173918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15580cf160 0x7f1558158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:40.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.080+0000 7f15577fe640 1 --2- 172.21.15.19:0/3473173918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15580d15f0 0x7f15580b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:40.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.080+0000 7f155ce95640 1 -- 172.21.15.19:0/3473173918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15580d15f0 msgr2=0x7f15580b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:40.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.080+0000 7f155ce95640 1 --2- 172.21.15.19:0/3473173918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15580d15f0 0x7f15580b6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:40.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.080+0000 7f155ce95640 1 -- 172.21.15.19:0/3473173918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15580cf160 msgr2=0x7f1558158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:40.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.080+0000 7f155ce95640 1 --2- 172.21.15.19:0/3473173918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15580cf160 0x7f1558158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:40.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.080+0000 7f155ce95640 1 -- 172.21.15.19:0/3473173918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15581f4b30 con 0x7f1558161a20 2024-09-12T02:06:40.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.080+0000 7f155ce95640 1 --2- 172.21.15.19:0/3473173918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1558161a20 0x7f15580b6640 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f155000cb60 tx=0x7f155000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:40.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.080+0000 7f1554ff9640 1 -- 172.21.15.19:0/3473173918 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1550017070 con 0x7f1558161a20 2024-09-12T02:06:40.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.080+0000 7f1554ff9640 1 -- 172.21.15.19:0/3473173918 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f155000ad40 con 0x7f1558161a20 2024-09-12T02:06:40.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.080+0000 7f1554ff9640 1 -- 172.21.15.19:0/3473173918 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1550012600 con 0x7f1558161a20 2024-09-12T02:06:40.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.080+0000 7f155e8f8640 1 -- 172.21.15.19:0/3473173918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15581f4e10 con 0x7f1558161a20 2024-09-12T02:06:40.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.080+0000 7f155e8f8640 1 -- 172.21.15.19:0/3473173918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15580b7600 con 0x7f1558161a20 2024-09-12T02:06:40.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.081+0000 7f155e8f8640 1 -- 172.21.15.19:0/3473173918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15580cec20 con 0x7f1558161a20 2024-09-12T02:06:40.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.082+0000 7f1554ff9640 1 -- 172.21.15.19:0/3473173918 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f155001a070 con 0x7f1558161a20 2024-09-12T02:06:40.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.082+0000 7f1554ff9640 1 --2- 172.21.15.19:0/3473173918 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f154406be30 0x7f154406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:40.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.082+0000 7f1554ff9640 1 -- 172.21.15.19:0/3473173918 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 9485+0+0 (secure 0 0 0) 0x7f155008ba20 con 0x7f1558161a20 2024-09-12T02:06:40.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.082+0000 7f1557fff640 1 --2- 172.21.15.19:0/3473173918 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f154406be30 0x7f154406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:40.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.083+0000 7f1557fff640 1 --2- 172.21.15.19:0/3473173918 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f154406be30 0x7f154406e2f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f15480016e0 tx=0x7f1548009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:40.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.086+0000 7f1554ff9640 1 -- 172.21.15.19:0/3473173918 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1550058f00 con 0x7f1558161a20 2024-09-12T02:06:40.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.298+0000 7f155e8f8640 1 -- 172.21.15.19:0/3473173918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f1558160680 con 0x7f1558161a20 2024-09-12T02:06:40.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.695+0000 7f1554ff9640 1 -- 172.21.15.19:0/3473173918 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v313) ==== 162+0+0 (secure 0 0 0) 0x7f155005d200 con 0x7f1558161a20 2024-09-12T02:06:40.695 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:06:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.698+0000 7f155e8f8640 1 -- 172.21.15.19:0/3473173918 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f154406be30 msgr2=0x7f154406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.698+0000 7f155e8f8640 1 --2- 172.21.15.19:0/3473173918 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f154406be30 0x7f154406e2f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f15480016e0 tx=0x7f1548009040 comp rx=0 tx=0).stop 2024-09-12T02:06:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.698+0000 7f155e8f8640 1 -- 172.21.15.19:0/3473173918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1558161a20 msgr2=0x7f15580b6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.698+0000 7f155e8f8640 1 --2- 172.21.15.19:0/3473173918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1558161a20 0x7f15580b6640 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f155000cb60 tx=0x7f155000a430 comp rx=0 tx=0).stop 2024-09-12T02:06:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.698+0000 7f155e8f8640 1 -- 172.21.15.19:0/3473173918 shutdown_connections 2024-09-12T02:06:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.698+0000 7f155e8f8640 1 --2- 172.21.15.19:0/3473173918 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f154406be30 0x7f154406e2f0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.698+0000 7f155e8f8640 1 --2- 172.21.15.19:0/3473173918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1558161a20 0x7f15580b6640 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.698+0000 7f155e8f8640 1 --2- 172.21.15.19:0/3473173918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15580d15f0 0x7f15580b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.698+0000 7f155e8f8640 1 --2- 172.21.15.19:0/3473173918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15580cf160 0x7f1558158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.698+0000 7f155e8f8640 1 -- 172.21.15.19:0/3473173918 >> 172.21.15.19:0/3473173918 conn(0x7f155809d850 msgr2=0x7f155815d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.698+0000 7f155e8f8640 1 -- 172.21.15.19:0/3473173918 shutdown_connections 2024-09-12T02:06:40.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.698+0000 7f155e8f8640 1 -- 172.21.15.19:0/3473173918 wait complete. 2024-09-12T02:06:40.704 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-09-12T02:06:40.705+0000 7fd60e0f5640 -1 log_channel(cluster) log [ERR] : corrupt sessionmap header: Decoder at 'virtual void SessionMapStore::decode_header(ceph::bufferlist&)' v=1 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-09-12T02:06:40.705 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:06:40.706+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:06:40.705 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:06:40.706+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:06:40.711 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:40.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.817+0000 7f26eae50640 1 Processor -- start 2024-09-12T02:06:40.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.817+0000 7f26eae50640 1 -- start start 2024-09-12T02:06:40.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.818+0000 7f26eae50640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26e40d30f0 0x7f26e40b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:40.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.818+0000 7f26eae50640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26e40d3690 con 0x7f26e40b64c0 2024-09-12T02:06:40.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.818+0000 7f26eae50640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26e40d3970 con 0x7f26e415e5f0 2024-09-12T02:06:40.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.818+0000 7f26eae50640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f26e406d530 con 0x7f26e40d30f0 2024-09-12T02:06:40.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.818+0000 7f26e93ed640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f26e40b64c0 0x7f26e406d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43956/0 (socket says 172.21.15.19:43956) 2024-09-12T02:06:40.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.818+0000 7f26e93ed640 1 -- 172.21.15.19:0/3464296895 learned_addr learned my addr 172.21.15.19:0/3464296895 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:40.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.818+0000 7f26dbfff640 1 --2- 172.21.15.19:0/3464296895 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26e40d30f0 0x7f26e40b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:40.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.818+0000 7f26db7fe640 1 -- 172.21.15.19:0/3464296895 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1583954351 0 0) 0x7f26e40d3690 con 0x7f26e40b64c0 2024-09-12T02:06:40.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.818+0000 7f26db7fe640 1 -- 172.21.15.19:0/3464296895 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26cc003520 con 0x7f26e40b64c0 2024-09-12T02:06:40.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.818+0000 7f26db7fe640 1 -- 172.21.15.19:0/3464296895 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1190631396 0 0) 0x7f26e40d3970 con 0x7f26e415e5f0 2024-09-12T02:06:40.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.818+0000 7f26db7fe640 1 -- 172.21.15.19:0/3464296895 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26e40d3690 con 0x7f26e415e5f0 2024-09-12T02:06:40.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.818+0000 7f26dbfff640 1 -- 172.21.15.19:0/3464296895 >> v1:172.21.15.135:6789/0 conn(0x7f26e415e5f0 legacy=0x7f26e40d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:40.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.818+0000 7f26dbfff640 1 -- 172.21.15.19:0/3464296895 >> v1:172.21.15.19:6789/0 conn(0x7f26e40b64c0 legacy=0x7f26e406d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:40.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.818+0000 7f26dbfff640 1 -- 172.21.15.19:0/3464296895 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e406cee0 con 0x7f26e40d30f0 2024-09-12T02:06:40.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.819+0000 7f26dbfff640 1 --2- 172.21.15.19:0/3464296895 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26e40d30f0 0x7f26e40b5f80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f26d40097d0 tx=0x7f26d402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b27e3e3c326f002 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:40.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.820+0000 7f26db7fe640 1 -- 172.21.15.19:0/3464296895 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d4037070 con 0x7f26e40d30f0 2024-09-12T02:06:40.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.820+0000 7f26db7fe640 1 -- 172.21.15.19:0/3464296895 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26d4032440 con 0x7f26e40d30f0 2024-09-12T02:06:40.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.820+0000 7f26db7fe640 1 -- 172.21.15.19:0/3464296895 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d4032810 con 0x7f26e40d30f0 2024-09-12T02:06:40.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.820+0000 7f26eae50640 1 -- 172.21.15.19:0/3464296895 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26e40d30f0 msgr2=0x7f26e40b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:40.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.820+0000 7f26eae50640 1 --2- 172.21.15.19:0/3464296895 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26e40d30f0 0x7f26e40b5f80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f26d40097d0 tx=0x7f26d402a210 comp rx=0 tx=0).stop 2024-09-12T02:06:40.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.820+0000 7f26eae50640 1 -- 172.21.15.19:0/3464296895 shutdown_connections 2024-09-12T02:06:40.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.820+0000 7f26eae50640 1 --2- 172.21.15.19:0/3464296895 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26e40d30f0 0x7f26e40b5f80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:40.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.820+0000 7f26eae50640 1 -- 172.21.15.19:0/3464296895 >> 172.21.15.19:0/3464296895 conn(0x7f26e408bfc0 msgr2=0x7f26e40d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:40.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.820+0000 7f26eae50640 1 -- 172.21.15.19:0/3464296895 shutdown_connections 2024-09-12T02:06:40.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.820+0000 7f26eae50640 1 -- 172.21.15.19:0/3464296895 wait complete. 2024-09-12T02:06:40.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.821+0000 7f26eae50640 1 Processor -- start 2024-09-12T02:06:40.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.822+0000 7f26eae50640 1 -- start start 2024-09-12T02:06:40.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.822+0000 7f26eae50640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26e40b64c0 0x7f26e41613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:40.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.822+0000 7f26eae50640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26e40d30f0 0x7f26e40cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:40.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.822+0000 7f26eae50640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26e415e5f0 0x7f26e40c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:40.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.822+0000 7f26eae50640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f26e406e0d0 con 0x7f26e415e5f0 2024-09-12T02:06:40.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.822+0000 7f26eae50640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f26e415e9d0 con 0x7f26e40b64c0 2024-09-12T02:06:40.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.822+0000 7f26eae50640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f26e406e250 con 0x7f26e40d30f0 2024-09-12T02:06:40.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.822+0000 7f26e93ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26e415e5f0 0x7f26e40c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:40.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.822+0000 7f26e93ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26e415e5f0 0x7f26e40c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41794/0 (socket says 172.21.15.19:41794) 2024-09-12T02:06:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.823+0000 7f26e93ed640 1 -- 172.21.15.19:0/31176212 learned_addr learned my addr 172.21.15.19:0/31176212 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.823+0000 7f26e8bec640 1 --2- 172.21.15.19:0/31176212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26e40b64c0 0x7f26e41613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.823+0000 7f26dbfff640 1 --2- 172.21.15.19:0/31176212 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26e40d30f0 0x7f26e40cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.823+0000 7f26e93ed640 1 -- 172.21.15.19:0/31176212 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26e40d30f0 msgr2=0x7f26e40cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.823+0000 7f26e93ed640 1 --2- 172.21.15.19:0/31176212 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26e40d30f0 0x7f26e40cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.823+0000 7f26e93ed640 1 -- 172.21.15.19:0/31176212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26e40b64c0 msgr2=0x7f26e41613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.823+0000 7f26e93ed640 1 --2- 172.21.15.19:0/31176212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26e40b64c0 0x7f26e41613d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.823+0000 7f26e93ed640 1 -- 172.21.15.19:0/31176212 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e41573f0 con 0x7f26e415e5f0 2024-09-12T02:06:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.823+0000 7f26e8bec640 1 --2- 172.21.15.19:0/31176212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26e40b64c0 0x7f26e41613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.823+0000 7f26e93ed640 1 --2- 172.21.15.19:0/31176212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26e415e5f0 0x7f26e40c8dc0 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00cba0 tx=0x7f26dc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.823+0000 7f26d97fa640 1 -- 172.21.15.19:0/31176212 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26dc017070 con 0x7f26e415e5f0 2024-09-12T02:06:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.823+0000 7f26d97fa640 1 -- 172.21.15.19:0/31176212 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26dc00ace0 con 0x7f26e415e5f0 2024-09-12T02:06:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.823+0000 7f26d97fa640 1 -- 172.21.15.19:0/31176212 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26dc012620 con 0x7f26e415e5f0 2024-09-12T02:06:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.823+0000 7f26eae50640 1 -- 172.21.15.19:0/31176212 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e41576d0 con 0x7f26e415e5f0 2024-09-12T02:06:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.823+0000 7f26eae50640 1 -- 172.21.15.19:0/31176212 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e40c85c0 con 0x7f26e415e5f0 2024-09-12T02:06:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.824+0000 7f26eae50640 1 -- 172.21.15.19:0/31176212 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e40b5f80 con 0x7f26e415e5f0 2024-09-12T02:06:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.825+0000 7f26d97fa640 1 -- 172.21.15.19:0/31176212 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f26dc01a070 con 0x7f26e415e5f0 2024-09-12T02:06:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.825+0000 7f26d97fa640 1 --2- 172.21.15.19:0/31176212 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26d006be30 0x7f26d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.825+0000 7f26d97fa640 1 -- 172.21.15.19:0/31176212 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 9571+0+0 (secure 0 0 0) 0x7f26dc08bbb0 con 0x7f26e415e5f0 2024-09-12T02:06:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.826+0000 7f26e8bec640 1 --2- 172.21.15.19:0/31176212 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26d006be30 0x7f26d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.826+0000 7f26e8bec640 1 --2- 172.21.15.19:0/31176212 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26d006be30 0x7f26d006e2f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f26e00011e0 tx=0x7f26e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:40.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:40.830+0000 7f26d97fa640 1 -- 172.21.15.19:0/31176212 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26dc059680 con 0x7f26e415e5f0 2024-09-12T02:06:41.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.042+0000 7f26eae50640 1 -- 172.21.15.19:0/31176212 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26e40d0ab0 con 0x7f26e415e5f0 2024-09-12T02:06:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.043+0000 7f26d97fa640 1 -- 172.21.15.19:0/31176212 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 315 v315) ==== 95+0+4392 (secure 0 0 0) 0x7f26dc058f80 con 0x7f26e415e5f0 2024-09-12T02:06:41.042 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:41.042 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":315,"btime":"2024-09-12T02:06:40:706481+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":315,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:40.706432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":133,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 315 2024-09-12T02:06:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.045+0000 7f26eae50640 1 -- 172.21.15.19:0/31176212 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26d006be30 msgr2=0x7f26d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.045+0000 7f26eae50640 1 --2- 172.21.15.19:0/31176212 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26d006be30 0x7f26d006e2f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f26e00011e0 tx=0x7f26e0009040 comp rx=0 tx=0).stop 2024-09-12T02:06:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.045+0000 7f26eae50640 1 -- 172.21.15.19:0/31176212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26e415e5f0 msgr2=0x7f26e40c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.045+0000 7f26eae50640 1 --2- 172.21.15.19:0/31176212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26e415e5f0 0x7f26e40c8dc0 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00cba0 tx=0x7f26dc00a430 comp rx=0 tx=0).stop 2024-09-12T02:06:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.045+0000 7f26eae50640 1 -- 172.21.15.19:0/31176212 shutdown_connections 2024-09-12T02:06:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.045+0000 7f26eae50640 1 --2- 172.21.15.19:0/31176212 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f26d006be30 0x7f26d006e2f0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.045+0000 7f26eae50640 1 --2- 172.21.15.19:0/31176212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26e415e5f0 0x7f26e40c8dc0 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.045+0000 7f26eae50640 1 --2- 172.21.15.19:0/31176212 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26e40d30f0 0x7f26e40cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.045+0000 7f26eae50640 1 --2- 172.21.15.19:0/31176212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26e40b64c0 0x7f26e41613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.045+0000 7f26eae50640 1 -- 172.21.15.19:0/31176212 >> 172.21.15.19:0/31176212 conn(0x7f26e408bfc0 msgr2=0x7f26e40b5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.045+0000 7f26eae50640 1 -- 172.21.15.19:0/31176212 shutdown_connections 2024-09-12T02:06:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.045+0000 7f26eae50640 1 -- 172.21.15.19:0/31176212 wait complete. 2024-09-12T02:06:41.056 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:06:41.056 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:41.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.158+0000 7fa7c79d8640 1 Processor -- start 2024-09-12T02:06:41.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.158+0000 7fa7c79d8640 1 -- start start 2024-09-12T02:06:41.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.159+0000 7fa7c79d8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa7c015e740 0x7fa7c00d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.159+0000 7fa7c79d8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7c009b690 0x7fa7c006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.159+0000 7fa7c79d8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7c006d4c0 0x7fa7c006d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.159+0000 7fa7c79d8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa7c015eb20 con 0x7fa7c006d4c0 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.159+0000 7fa7c79d8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa7c006d260 con 0x7fa7c015e740 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.159+0000 7fa7c79d8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c00d0780 con 0x7fa7c009b690 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.159+0000 7fa7c5f75640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7c006d4c0 0x7fa7c006d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.159+0000 7fa7c5f75640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7c006d4c0 0x7fa7c006d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51598/0 (socket says 172.21.15.19:51598) 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.159+0000 7fa7c5f75640 1 -- 172.21.15.19:0/3291552234 learned_addr learned my addr 172.21.15.19:0/3291552234 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.159+0000 7fa7c5774640 1 --2- 172.21.15.19:0/3291552234 >> v2:172.21.15.135:3300/0 conn(0x7fa7c015e740 0x7fa7c00d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.159+0000 7fa7c4f73640 1 --2- 172.21.15.19:0/3291552234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7c009b690 0x7fa7c006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.159+0000 7fa7c5f75640 1 -- 172.21.15.19:0/3291552234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7c009b690 msgr2=0x7fa7c006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.159+0000 7fa7c5f75640 1 --2- 172.21.15.19:0/3291552234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7c009b690 0x7fa7c006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.159+0000 7fa7c5f75640 1 -- 172.21.15.19:0/3291552234 >> v2:172.21.15.135:3300/0 conn(0x7fa7c015e740 msgr2=0x7fa7c00d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.159+0000 7fa7c5f75640 1 --2- 172.21.15.19:0/3291552234 >> v2:172.21.15.135:3300/0 conn(0x7fa7c015e740 0x7fa7c00d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.159+0000 7fa7c5f75640 1 -- 172.21.15.19:0/3291552234 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c00d0a60 con 0x7fa7c006d4c0 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.159+0000 7fa7c5774640 1 --2- 172.21.15.19:0/3291552234 >> v2:172.21.15.135:3300/0 conn(0x7fa7c015e740 0x7fa7c00d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.160+0000 7fa7c5f75640 1 --2- 172.21.15.19:0/3291552234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7c006d4c0 0x7fa7c006d8f0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0074070 tx=0x7fa7b802a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44943473a9e215a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.160+0000 7fa7b3fff640 1 -- 172.21.15.19:0/3291552234 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8036070 con 0x7fa7c006d4c0 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.160+0000 7fa7b3fff640 1 -- 172.21.15.19:0/3291552234 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b8031600 con 0x7fa7c006d4c0 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.160+0000 7fa7b3fff640 1 -- 172.21.15.19:0/3291552234 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b80319d0 con 0x7fa7c006d4c0 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.161+0000 7fa7c79d8640 1 -- 172.21.15.19:0/3291552234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7c006d4c0 msgr2=0x7fa7c006d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.161+0000 7fa7c79d8640 1 --2- 172.21.15.19:0/3291552234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7c006d4c0 0x7fa7c006d8f0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0074070 tx=0x7fa7b802a750 comp rx=0 tx=0).stop 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.161+0000 7fa7c79d8640 1 -- 172.21.15.19:0/3291552234 shutdown_connections 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.161+0000 7fa7c79d8640 1 --2- 172.21.15.19:0/3291552234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7c006d4c0 0x7fa7c006d8f0 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.161+0000 7fa7c79d8640 1 --2- 172.21.15.19:0/3291552234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7c009b690 0x7fa7c006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.161+0000 7fa7c79d8640 1 --2- 172.21.15.19:0/3291552234 >> v2:172.21.15.135:3300/0 conn(0x7fa7c015e740 0x7fa7c00d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.161+0000 7fa7c79d8640 1 -- 172.21.15.19:0/3291552234 >> 172.21.15.19:0/3291552234 conn(0x7fa7c00d23a0 msgr2=0x7fa7c00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.161+0000 7fa7c79d8640 1 -- 172.21.15.19:0/3291552234 shutdown_connections 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.161+0000 7fa7c79d8640 1 -- 172.21.15.19:0/3291552234 wait complete. 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.162+0000 7fa7c79d8640 1 Processor -- start 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.162+0000 7fa7c79d8640 1 -- start start 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.163+0000 7fa7c79d8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7c006d4c0 0x7fa7c00b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.163+0000 7fa7c79d8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7c009b690 0x7fa7c00b7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.163+0000 7fa7c79d8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7c015e740 0x7fa7c00b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.163+0000 7fa7c79d8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c009ba90 con 0x7fa7c006d4c0 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.163+0000 7fa7c79d8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c00d1020 con 0x7fa7c009b690 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.163+0000 7fa7c79d8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c006de30 con 0x7fa7c015e740 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.163+0000 7fa7c5774640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7c006d4c0 0x7fa7c00b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.163+0000 7fa7c5774640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7c006d4c0 0x7fa7c00b6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51606/0 (socket says 172.21.15.19:51606) 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.163+0000 7fa7c5774640 1 -- 172.21.15.19:0/1631485147 learned_addr learned my addr 172.21.15.19:0/1631485147 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:41.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.163+0000 7fa7c4f73640 1 --2- 172.21.15.19:0/1631485147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7c009b690 0x7fa7c00b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.163+0000 7fa7c5f75640 1 --2- 172.21.15.19:0/1631485147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7c015e740 0x7fa7c00b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.163+0000 7fa7c5774640 1 -- 172.21.15.19:0/1631485147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7c015e740 msgr2=0x7fa7c00b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.163+0000 7fa7c5774640 1 --2- 172.21.15.19:0/1631485147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7c015e740 0x7fa7c00b79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.163+0000 7fa7c5774640 1 -- 172.21.15.19:0/1631485147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7c009b690 msgr2=0x7fa7c00b7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.163+0000 7fa7c5774640 1 --2- 172.21.15.19:0/1631485147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7c009b690 0x7fa7c00b7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.163+0000 7fa7c5774640 1 -- 172.21.15.19:0/1631485147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c00b6330 con 0x7fa7c006d4c0 2024-09-12T02:06:41.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.164+0000 7fa7c5774640 1 --2- 172.21.15.19:0/1631485147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7c006d4c0 0x7fa7c00b6f30 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400d800 tx=0x7fa7b400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:41.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.164+0000 7fa7b1ffb640 1 -- 172.21.15.19:0/1631485147 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4004030 con 0x7fa7c006d4c0 2024-09-12T02:06:41.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.164+0000 7fa7b1ffb640 1 -- 172.21.15.19:0/1631485147 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b40041d0 con 0x7fa7c006d4c0 2024-09-12T02:06:41.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.164+0000 7fa7b1ffb640 1 -- 172.21.15.19:0/1631485147 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b400b6c0 con 0x7fa7c006d4c0 2024-09-12T02:06:41.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.164+0000 7fa7c79d8640 1 -- 172.21.15.19:0/1631485147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c00b6610 con 0x7fa7c006d4c0 2024-09-12T02:06:41.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.164+0000 7fa7c79d8640 1 -- 172.21.15.19:0/1631485147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c00b6bd0 con 0x7fa7c006d4c0 2024-09-12T02:06:41.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.165+0000 7fa7c79d8640 1 -- 172.21.15.19:0/1631485147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c00c95d0 con 0x7fa7c006d4c0 2024-09-12T02:06:41.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.165+0000 7fa7b1ffb640 1 -- 172.21.15.19:0/1631485147 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa7b400b860 con 0x7fa7c006d4c0 2024-09-12T02:06:41.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.166+0000 7fa7b1ffb640 1 --2- 172.21.15.19:0/1631485147 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa7a406be30 0x7fa7a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.166+0000 7fa7b1ffb640 1 -- 172.21.15.19:0/1631485147 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 9571+0+0 (secure 0 0 0) 0x7fa7b408bfa0 con 0x7fa7c006d4c0 2024-09-12T02:06:41.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.166+0000 7fa7c4f73640 1 --2- 172.21.15.19:0/1631485147 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa7a406be30 0x7fa7a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.167+0000 7fa7c4f73640 1 --2- 172.21.15.19:0/1631485147 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa7a406be30 0x7fa7a406e2f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00b2ea0 tx=0x7fa7bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:41.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.170+0000 7fa7b1ffb640 1 -- 172.21.15.19:0/1631485147 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa7b4059a70 con 0x7fa7c006d4c0 2024-09-12T02:06:41.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.381+0000 7fa7c79d8640 1 -- 172.21.15.19:0/1631485147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7c00d1cb0 con 0x7fa7c006d4c0 2024-09-12T02:06:41.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.381+0000 7fa7b1ffb640 1 -- 172.21.15.19:0/1631485147 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 315 v315) ==== 95+0+4392 (secure 0 0 0) 0x7fa7b4059370 con 0x7fa7c006d4c0 2024-09-12T02:06:41.381 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:41.381 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":315,"btime":"2024-09-12T02:06:40:706481+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":315,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:40.706432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":133,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:41.381 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 315 2024-09-12T02:06:41.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.384+0000 7fa7c79d8640 1 -- 172.21.15.19:0/1631485147 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa7a406be30 msgr2=0x7fa7a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.384+0000 7fa7c79d8640 1 --2- 172.21.15.19:0/1631485147 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa7a406be30 0x7fa7a406e2f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00b2ea0 tx=0x7fa7bc008040 comp rx=0 tx=0).stop 2024-09-12T02:06:41.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.384+0000 7fa7c79d8640 1 -- 172.21.15.19:0/1631485147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7c006d4c0 msgr2=0x7fa7c00b6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.384+0000 7fa7c79d8640 1 --2- 172.21.15.19:0/1631485147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7c006d4c0 0x7fa7c00b6f30 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400d800 tx=0x7fa7b400dcc0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.384+0000 7fa7c79d8640 1 -- 172.21.15.19:0/1631485147 shutdown_connections 2024-09-12T02:06:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.384+0000 7fa7c79d8640 1 --2- 172.21.15.19:0/1631485147 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa7a406be30 0x7fa7a406e2f0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.384+0000 7fa7c79d8640 1 --2- 172.21.15.19:0/1631485147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7c015e740 0x7fa7c00b79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.384+0000 7fa7c79d8640 1 --2- 172.21.15.19:0/1631485147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7c009b690 0x7fa7c00b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.384+0000 7fa7c79d8640 1 --2- 172.21.15.19:0/1631485147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7c006d4c0 0x7fa7c00b6f30 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.384+0000 7fa7c79d8640 1 -- 172.21.15.19:0/1631485147 >> 172.21.15.19:0/1631485147 conn(0x7fa7c00d23a0 msgr2=0x7fa7c015d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.384+0000 7fa7c79d8640 1 -- 172.21.15.19:0/1631485147 shutdown_connections 2024-09-12T02:06:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.384+0000 7fa7c79d8640 1 -- 172.21.15.19:0/1631485147 wait complete. 2024-09-12T02:06:41.395 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:06:41.395 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:41.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.498+0000 7ffa165f6640 1 Processor -- start 2024-09-12T02:06:41.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.498+0000 7ffa165f6640 1 -- start start 2024-09-12T02:06:41.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.499+0000 7ffa165f6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffa100cfcc0 0x7ffa1006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.499+0000 7ffa165f6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa100d2700 con 0x7ffa1015e760 2024-09-12T02:06:41.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.499+0000 7ffa165f6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa100cedb0 con 0x7ffa100d4fd0 2024-09-12T02:06:41.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.499+0000 7ffa165f6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ffa100cf090 con 0x7ffa100cfcc0 2024-09-12T02:06:41.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.499+0000 7ffa0f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffa100cfcc0 0x7ffa1006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.499+0000 7ffa0f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffa100cfcc0 0x7ffa1006cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51622/0 (socket says 172.21.15.19:51622) 2024-09-12T02:06:41.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.499+0000 7ffa0f7fe640 1 -- 172.21.15.19:0/537857593 learned_addr learned my addr 172.21.15.19:0/537857593 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:41.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.499+0000 7ffa0ffff640 1 --1- 172.21.15.19:0/537857593 >> v1:172.21.15.19:6789/0 conn(0x7ffa1015e760 0x7ffa100cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52400/0 (socket says 172.21.15.19:52400) 2024-09-12T02:06:41.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.499+0000 7ffa0f7fe640 1 -- 172.21.15.19:0/537857593 >> v1:172.21.15.135:6789/0 conn(0x7ffa100d4fd0 legacy=0x7ffa100d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.499+0000 7ffa0f7fe640 1 -- 172.21.15.19:0/537857593 >> v1:172.21.15.19:6789/0 conn(0x7ffa1015e760 legacy=0x7ffa100cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.499+0000 7ffa0effd640 1 -- 172.21.15.19:0/537857593 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1672828726 0 0) 0x7ffa00001110 con 0x7ffa1015e760 2024-09-12T02:06:41.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.499+0000 7ffa0f7fe640 1 -- 172.21.15.19:0/537857593 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa100b3c80 con 0x7ffa100cfcc0 2024-09-12T02:06:41.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.500+0000 7ffa0f7fe640 1 --2- 172.21.15.19:0/537857593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa100cfcc0 0x7ffa1006cdd0 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009850 tx=0x7ffa0402a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc93897ec2052e75 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:41.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.500+0000 7ffa0effd640 1 -- 172.21.15.19:0/537857593 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04004230 con 0x7ffa100cfcc0 2024-09-12T02:06:41.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.500+0000 7ffa0effd640 1 -- 172.21.15.19:0/537857593 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa040043d0 con 0x7ffa100cfcc0 2024-09-12T02:06:41.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.500+0000 7ffa0effd640 1 -- 172.21.15.19:0/537857593 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04003810 con 0x7ffa100cfcc0 2024-09-12T02:06:41.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.501+0000 7ffa165f6640 1 -- 172.21.15.19:0/537857593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa100cfcc0 msgr2=0x7ffa1006cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.501+0000 7ffa165f6640 1 --2- 172.21.15.19:0/537857593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa100cfcc0 0x7ffa1006cdd0 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009850 tx=0x7ffa0402a2e0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.501+0000 7ffa165f6640 1 -- 172.21.15.19:0/537857593 shutdown_connections 2024-09-12T02:06:41.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.501+0000 7ffa165f6640 1 --2- 172.21.15.19:0/537857593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa100cfcc0 0x7ffa1006cdd0 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.501+0000 7ffa165f6640 1 -- 172.21.15.19:0/537857593 >> 172.21.15.19:0/537857593 conn(0x7ffa1008bfc0 msgr2=0x7ffa100d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:41.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.501+0000 7ffa165f6640 1 -- 172.21.15.19:0/537857593 shutdown_connections 2024-09-12T02:06:41.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.501+0000 7ffa165f6640 1 -- 172.21.15.19:0/537857593 wait complete. 2024-09-12T02:06:41.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.502+0000 7ffa165f6640 1 Processor -- start 2024-09-12T02:06:41.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.502+0000 7ffa165f6640 1 -- start start 2024-09-12T02:06:41.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.503+0000 7ffa165f6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa100cfcc0 0x7ffa10156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.503+0000 7ffa165f6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa100d4fd0 0x7ffa100b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.503+0000 7ffa165f6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa1015e760 0x7ffa100b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.503+0000 7ffa165f6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ffa100d35b0 con 0x7ffa100cfcc0 2024-09-12T02:06:41.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.503+0000 7ffa165f6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffa100b3920 con 0x7ffa1015e760 2024-09-12T02:06:41.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.503+0000 7ffa165f6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ffa100d3730 con 0x7ffa100d4fd0 2024-09-12T02:06:41.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.503+0000 7ffa0ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa100cfcc0 0x7ffa10156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.503+0000 7ffa0ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa100cfcc0 0x7ffa10156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51636/0 (socket says 172.21.15.19:51636) 2024-09-12T02:06:41.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.503+0000 7ffa0ffff640 1 -- 172.21.15.19:0/2326431915 learned_addr learned my addr 172.21.15.19:0/2326431915 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:41.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.503+0000 7ffa14b93640 1 --2- 172.21.15.19:0/2326431915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa1015e760 0x7ffa100b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.503+0000 7ffa0f7fe640 1 --2- 172.21.15.19:0/2326431915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa100d4fd0 0x7ffa100b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.503+0000 7ffa0ffff640 1 -- 172.21.15.19:0/2326431915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa100d4fd0 msgr2=0x7ffa100b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.503+0000 7ffa0ffff640 1 --2- 172.21.15.19:0/2326431915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa100d4fd0 0x7ffa100b7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.503+0000 7ffa0ffff640 1 -- 172.21.15.19:0/2326431915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa1015e760 msgr2=0x7ffa100b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.503+0000 7ffa0ffff640 1 --2- 172.21.15.19:0/2326431915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa1015e760 0x7ffa100b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.503+0000 7ffa0ffff640 1 -- 172.21.15.19:0/2326431915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa10156d90 con 0x7ffa100cfcc0 2024-09-12T02:06:41.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.503+0000 7ffa14b93640 1 --2- 172.21.15.19:0/2326431915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa1015e760 0x7ffa100b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:41.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.503+0000 7ffa0f7fe640 1 --2- 172.21.15.19:0/2326431915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa100d4fd0 0x7ffa100b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:41.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.504+0000 7ffa0ffff640 1 --2- 172.21.15.19:0/2326431915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa100cfcc0 0x7ffa10156850 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000c420 tx=0x7ffa0000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:41.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.504+0000 7ffa0cff9640 1 -- 172.21.15.19:0/2326431915 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa000074e0 con 0x7ffa100cfcc0 2024-09-12T02:06:41.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.504+0000 7ffa0cff9640 1 -- 172.21.15.19:0/2326431915 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa000047e0 con 0x7ffa100cfcc0 2024-09-12T02:06:41.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.504+0000 7ffa165f6640 1 -- 172.21.15.19:0/2326431915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa100b8020 con 0x7ffa100cfcc0 2024-09-12T02:06:41.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.504+0000 7ffa0cff9640 1 -- 172.21.15.19:0/2326431915 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa00004c10 con 0x7ffa100cfcc0 2024-09-12T02:06:41.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.504+0000 7ffa165f6640 1 -- 172.21.15.19:0/2326431915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa100cc440 con 0x7ffa100cfcc0 2024-09-12T02:06:41.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.505+0000 7ffa165f6640 1 -- 172.21.15.19:0/2326431915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa100d3a60 con 0x7ffa100cfcc0 2024-09-12T02:06:41.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.505+0000 7ffa0cff9640 1 -- 172.21.15.19:0/2326431915 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa00011070 con 0x7ffa100cfcc0 2024-09-12T02:06:41.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.506+0000 7ffa0cff9640 1 --2- 172.21.15.19:0/2326431915 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9fc06be30 0x7ff9fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.506+0000 7ffa0cff9640 1 -- 172.21.15.19:0/2326431915 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 9571+0+0 (secure 0 0 0) 0x7ffa0008b9b0 con 0x7ffa100cfcc0 2024-09-12T02:06:41.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.506+0000 7ffa0f7fe640 1 --2- 172.21.15.19:0/2326431915 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9fc06be30 0x7ff9fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.507+0000 7ffa0f7fe640 1 --2- 172.21.15.19:0/2326431915 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9fc06be30 0x7ff9fc06e2f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ffa04033000 tx=0x7ffa0402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:41.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.510+0000 7ffa0cff9640 1 -- 172.21.15.19:0/2326431915 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa100d2700 con 0x7ffa100cfcc0 2024-09-12T02:06:41.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.718+0000 7ffa165f6640 1 -- 172.21.15.19:0/2326431915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa100b6d20 con 0x7ffa100cfcc0 2024-09-12T02:06:41.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.719+0000 7ffa0cff9640 1 -- 172.21.15.19:0/2326431915 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 315 v315) ==== 95+0+4392 (secure 0 0 0) 0x7ffa00059480 con 0x7ffa100cfcc0 2024-09-12T02:06:41.719 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:41.719 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":315,"btime":"2024-09-12T02:06:40:706481+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":262}],"filesystems":[{"mdsmap":{"epoch":315,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:40.706432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":133,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:41.719 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 315 2024-09-12T02:06:41.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.721+0000 7ffa165f6640 1 -- 172.21.15.19:0/2326431915 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9fc06be30 msgr2=0x7ff9fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.721+0000 7ffa165f6640 1 --2- 172.21.15.19:0/2326431915 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9fc06be30 0x7ff9fc06e2f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ffa04033000 tx=0x7ffa0402e000 comp rx=0 tx=0).stop 2024-09-12T02:06:41.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.721+0000 7ffa165f6640 1 -- 172.21.15.19:0/2326431915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa100cfcc0 msgr2=0x7ffa10156850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.721+0000 7ffa165f6640 1 --2- 172.21.15.19:0/2326431915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa100cfcc0 0x7ffa10156850 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000c420 tx=0x7ffa0000c8e0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.721+0000 7ffa165f6640 1 -- 172.21.15.19:0/2326431915 shutdown_connections 2024-09-12T02:06:41.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.721+0000 7ffa165f6640 1 --2- 172.21.15.19:0/2326431915 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9fc06be30 0x7ff9fc06e2f0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.721+0000 7ffa165f6640 1 --2- 172.21.15.19:0/2326431915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa1015e760 0x7ffa100b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.721+0000 7ffa165f6640 1 --2- 172.21.15.19:0/2326431915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa100d4fd0 0x7ffa100b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.721+0000 7ffa165f6640 1 --2- 172.21.15.19:0/2326431915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa100cfcc0 0x7ffa10156850 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.721+0000 7ffa165f6640 1 -- 172.21.15.19:0/2326431915 >> 172.21.15.19:0/2326431915 conn(0x7ffa1008bfc0 msgr2=0x7ffa100b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:41.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.721+0000 7ffa165f6640 1 -- 172.21.15.19:0/2326431915 shutdown_connections 2024-09-12T02:06:41.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.721+0000 7ffa165f6640 1 -- 172.21.15.19:0/2326431915 wait complete. 2024-09-12T02:06:41.733 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap header on mds0_sessionmap' led to DAMAGED state 2024-09-12T02:06:41.733 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap header on 1.00000000' 2024-09-12T02:06:41.733 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:06:41.734 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:06:41.750 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:06:41.750 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:06:41.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:41.750 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:06:41.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:06:41.806 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:06:41.806 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:06:41.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.950+0000 7fae3cb18640 1 Processor -- start 2024-09-12T02:06:41.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.950+0000 7fae3cb18640 1 -- start start 2024-09-12T02:06:41.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.951+0000 7fae3cb18640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae3815b300 0x7fae380cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.951+0000 7fae3cb18640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fae380cd3f0 0x7fae3806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.951+0000 7fae3cb18640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae380cdbe0 con 0x7fae38072d30 2024-09-12T02:06:41.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.951+0000 7fae3cb18640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fae380728a0 con 0x7fae380cd3f0 2024-09-12T02:06:41.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.951+0000 7fae3cb18640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fae380cd900 con 0x7fae3815b300 2024-09-12T02:06:41.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.951+0000 7fae3659c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae3815b300 0x7fae380cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.951+0000 7fae35d9b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fae380cd3f0 0x7fae3806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.951+0000 7fae3659c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae3815b300 0x7fae380cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:49580/0 (socket says 172.21.15.19:49580) 2024-09-12T02:06:41.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.951+0000 7fae35d9b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fae380cd3f0 0x7fae3806f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:45530/0 (socket says 172.21.15.19:45530) 2024-09-12T02:06:41.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.951+0000 7fae3659c640 1 -- 172.21.15.19:0/262414658 learned_addr learned my addr 172.21.15.19:0/262414658 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:41.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.951+0000 7fae36d9d640 1 --1- 172.21.15.19:0/262414658 >> v1:172.21.15.135:6789/0 conn(0x7fae38072d30 0x7fae380b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:47764/0 (socket says 172.21.15.19:47764) 2024-09-12T02:06:41.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.952+0000 7fae3659c640 1 -- 172.21.15.19:0/262414658 >> v2:172.21.15.135:3300/0 conn(0x7fae380cd3f0 msgr2=0x7fae3806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:41.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.952+0000 7fae3659c640 1 --2- 172.21.15.19:0/262414658 >> v2:172.21.15.135:3300/0 conn(0x7fae380cd3f0 0x7fae3806f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.952+0000 7fae3659c640 1 -- 172.21.15.19:0/262414658 >> v1:172.21.15.135:6789/0 conn(0x7fae38072d30 legacy=0x7fae380b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.952+0000 7fae3659c640 1 -- 172.21.15.19:0/262414658 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae38072250 con 0x7fae3815b300 2024-09-12T02:06:41.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.952+0000 7fae3659c640 1 --2- 172.21.15.19:0/262414658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae3815b300 0x7fae380cceb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fae28009870 tx=0x7fae2802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebdc6e70fa3f83bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:41.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.953+0000 7fae3559a640 1 -- 172.21.15.19:0/262414658 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae28037070 con 0x7fae3815b300 2024-09-12T02:06:41.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.953+0000 7fae3559a640 1 -- 172.21.15.19:0/262414658 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae28032440 con 0x7fae3815b300 2024-09-12T02:06:41.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.953+0000 7fae3559a640 1 -- 172.21.15.19:0/262414658 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae28032810 con 0x7fae3815b300 2024-09-12T02:06:41.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.953+0000 7fae3cb18640 1 -- 172.21.15.19:0/262414658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae3815b300 msgr2=0x7fae380cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.953+0000 7fae3cb18640 1 --2- 172.21.15.19:0/262414658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae3815b300 0x7fae380cceb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fae28009870 tx=0x7fae2802a270 comp rx=0 tx=0).stop 2024-09-12T02:06:41.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.953+0000 7fae3cb18640 1 -- 172.21.15.19:0/262414658 shutdown_connections 2024-09-12T02:06:41.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.953+0000 7fae3cb18640 1 --2- 172.21.15.19:0/262414658 >> v2:172.21.15.135:3300/0 conn(0x7fae380cd3f0 0x7fae3806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.953+0000 7fae3cb18640 1 --2- 172.21.15.19:0/262414658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae3815b300 0x7fae380cceb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.953+0000 7fae3cb18640 1 -- 172.21.15.19:0/262414658 >> 172.21.15.19:0/262414658 conn(0x7fae38067d70 msgr2=0x7fae3806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:41.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.953+0000 7fae3cb18640 1 -- 172.21.15.19:0/262414658 shutdown_connections 2024-09-12T02:06:41.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.953+0000 7fae3cb18640 1 -- 172.21.15.19:0/262414658 wait complete. 2024-09-12T02:06:41.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.955+0000 7fae3cb18640 1 Processor -- start 2024-09-12T02:06:41.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.955+0000 7fae3cb18640 1 -- start start 2024-09-12T02:06:41.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.955+0000 7fae3cb18640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae38072d30 0x7fae380cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.955+0000 7fae3cb18640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae380cd3f0 0x7fae381f0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.955+0000 7fae3cb18640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae3815b300 0x7fae381f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.955+0000 7fae3cb18640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fae380d0160 con 0x7fae3815b300 2024-09-12T02:06:41.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.955+0000 7fae3cb18640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fae380cffe0 con 0x7fae38072d30 2024-09-12T02:06:41.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.955+0000 7fae3cb18640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fae3806f700 con 0x7fae380cd3f0 2024-09-12T02:06:41.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.956+0000 7fae36d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae3815b300 0x7fae381f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.956+0000 7fae36d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae3815b300 0x7fae381f3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51644/0 (socket says 172.21.15.19:51644) 2024-09-12T02:06:41.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.956+0000 7fae36d9d640 1 -- 172.21.15.19:0/3641227768 learned_addr learned my addr 172.21.15.19:0/3641227768 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:41.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.956+0000 7fae35d9b640 1 --2- 172.21.15.19:0/3641227768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae380cd3f0 0x7fae381f0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.956+0000 7fae3659c640 1 --2- 172.21.15.19:0/3641227768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae38072d30 0x7fae380cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.956+0000 7fae36d9d640 1 -- 172.21.15.19:0/3641227768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae380cd3f0 msgr2=0x7fae381f0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.956+0000 7fae36d9d640 1 --2- 172.21.15.19:0/3641227768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae380cd3f0 0x7fae381f0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.956+0000 7fae36d9d640 1 -- 172.21.15.19:0/3641227768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae38072d30 msgr2=0x7fae380cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.956+0000 7fae36d9d640 1 --2- 172.21.15.19:0/3641227768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae38072d30 0x7fae380cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.956+0000 7fae36d9d640 1 -- 172.21.15.19:0/3641227768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae381f3ac0 con 0x7fae3815b300 2024-09-12T02:06:41.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.956+0000 7fae35d9b640 1 --2- 172.21.15.19:0/3641227768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae380cd3f0 0x7fae381f0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:41.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.956+0000 7fae36d9d640 1 --2- 172.21.15.19:0/3641227768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae3815b300 0x7fae381f3150 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7fae3000c780 tx=0x7fae3000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:41.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.956+0000 7fae26ffd640 1 -- 172.21.15.19:0/3641227768 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae30017070 con 0x7fae3815b300 2024-09-12T02:06:41.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.956+0000 7fae26ffd640 1 -- 172.21.15.19:0/3641227768 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae3000a640 con 0x7fae3815b300 2024-09-12T02:06:41.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.956+0000 7fae3cb18640 1 -- 172.21.15.19:0/3641227768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae381f3da0 con 0x7fae3815b300 2024-09-12T02:06:41.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.956+0000 7fae26ffd640 1 -- 172.21.15.19:0/3641227768 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3000a9f0 con 0x7fae3815b300 2024-09-12T02:06:41.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.956+0000 7fae3cb18640 1 -- 172.21.15.19:0/3641227768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae381f0a40 con 0x7fae3815b300 2024-09-12T02:06:41.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.957+0000 7fae3cb18640 1 -- 172.21.15.19:0/3641227768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae3815a7a0 con 0x7fae3815b300 2024-09-12T02:06:41.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.958+0000 7fae26ffd640 1 -- 172.21.15.19:0/3641227768 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae3001a070 con 0x7fae3815b300 2024-09-12T02:06:41.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.958+0000 7fae26ffd640 1 --2- 172.21.15.19:0/3641227768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae1806be30 0x7fae1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.958+0000 7fae26ffd640 1 -- 172.21.15.19:0/3641227768 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 9571+0+0 (secure 0 0 0) 0x7fae3008b2f0 con 0x7fae3815b300 2024-09-12T02:06:41.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.958+0000 7fae3659c640 1 --2- 172.21.15.19:0/3641227768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae1806be30 0x7fae1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.959+0000 7fae3659c640 1 --2- 172.21.15.19:0/3641227768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae1806be30 0x7fae1806e2f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fae28034000 tx=0x7fae2802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:41.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:41.963+0000 7fae26ffd640 1 -- 172.21.15.19:0/3641227768 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae300586e0 con 0x7fae3815b300 2024-09-12T02:06:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.174+0000 7fae3cb18640 1 -- 172.21.15.19:0/3641227768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fae3806d090 con 0x7fae3815b300 2024-09-12T02:06:42.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.705+0000 7fae26ffd640 1 -- 172.21.15.19:0/3641227768 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v316) ==== 161+0+0 (secure 0 0 0) 0x7fae3005c9e0 con 0x7fae3815b300 2024-09-12T02:06:42.705 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:06:42.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.707+0000 7fae3cb18640 1 -- 172.21.15.19:0/3641227768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae1806be30 msgr2=0x7fae1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:42.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.707+0000 7fae3cb18640 1 --2- 172.21.15.19:0/3641227768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae1806be30 0x7fae1806e2f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fae28034000 tx=0x7fae2802e000 comp rx=0 tx=0).stop 2024-09-12T02:06:42.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.707+0000 7fae3cb18640 1 -- 172.21.15.19:0/3641227768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae3815b300 msgr2=0x7fae381f3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:42.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.707+0000 7fae3cb18640 1 --2- 172.21.15.19:0/3641227768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae3815b300 0x7fae381f3150 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7fae3000c780 tx=0x7fae3000cc40 comp rx=0 tx=0).stop 2024-09-12T02:06:42.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.707+0000 7fae3cb18640 1 -- 172.21.15.19:0/3641227768 shutdown_connections 2024-09-12T02:06:42.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.707+0000 7fae3cb18640 1 --2- 172.21.15.19:0/3641227768 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae1806be30 0x7fae1806e2f0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:42.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.707+0000 7fae3cb18640 1 --2- 172.21.15.19:0/3641227768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae3815b300 0x7fae381f3150 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:42.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.707+0000 7fae3cb18640 1 --2- 172.21.15.19:0/3641227768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae380cd3f0 0x7fae381f0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:42.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.707+0000 7fae3cb18640 1 --2- 172.21.15.19:0/3641227768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae38072d30 0x7fae380cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:42.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.707+0000 7fae3cb18640 1 -- 172.21.15.19:0/3641227768 >> 172.21.15.19:0/3641227768 conn(0x7fae38067d70 msgr2=0x7fae3815b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:42.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.708+0000 7fae3cb18640 1 -- 172.21.15.19:0/3641227768 shutdown_connections 2024-09-12T02:06:42.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.708+0000 7fae3cb18640 1 -- 172.21.15.19:0/3641227768 wait complete. 2024-09-12T02:06:42.721 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-09-12T02:06:42.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.836+0000 7f5df3482640 1 Processor -- start 2024-09-12T02:06:42.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.837+0000 7f5df3482640 1 -- start start 2024-09-12T02:06:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.837+0000 7f5df3482640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dec15e5f0 0x7f5dec0d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.837+0000 7f5df3482640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5dec0b6690 0x7f5dec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.837+0000 7f5df3482640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dec0d3690 con 0x7f5dec0d30f0 2024-09-12T02:06:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.837+0000 7f5df3482640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f5dec06d530 con 0x7f5dec0b6690 2024-09-12T02:06:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.837+0000 7f5df3482640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5dec0d3970 con 0x7f5dec15e5f0 2024-09-12T02:06:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.838+0000 7f5df1a1f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5dec0b6690 0x7f5dec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.838+0000 7f5df0a1d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5dec0d30f0 0x7f5dec0b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52410/0 (socket says 172.21.15.19:52410) 2024-09-12T02:06:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.838+0000 7f5df0a1d640 1 -- 172.21.15.19:0/875063068 learned_addr learned my addr 172.21.15.19:0/875063068 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.838+0000 7f5df121e640 1 --2- 172.21.15.19:0/875063068 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dec15e5f0 0x7f5dec0d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.838+0000 7f5df1a1f640 1 -- 172.21.15.19:0/875063068 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dec15e5f0 msgr2=0x7f5dec0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.838+0000 7f5df1a1f640 1 --2- 172.21.15.19:0/875063068 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dec15e5f0 0x7f5dec0d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.838+0000 7f5df1a1f640 1 -- 172.21.15.19:0/875063068 >> v1:172.21.15.19:6789/0 conn(0x7f5dec0d30f0 legacy=0x7f5dec0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.838+0000 7f5df1a1f640 1 -- 172.21.15.19:0/875063068 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dec06cee0 con 0x7f5dec0b6690 2024-09-12T02:06:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.838+0000 7f5de3fff640 1 -- 172.21.15.19:0/875063068 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3787228057 0 0) 0x7f5dec0d3690 con 0x7f5dec0d30f0 2024-09-12T02:06:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.839+0000 7f5df1a1f640 1 --2- 172.21.15.19:0/875063068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dec0b6690 0x7f5dec06d9c0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009d90 tx=0x7f5de402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b830dab4be0ca172 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.839+0000 7f5de3fff640 1 -- 172.21.15.19:0/875063068 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4007740 con 0x7f5dec0b6690 2024-09-12T02:06:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.839+0000 7f5de3fff640 1 -- 172.21.15.19:0/875063068 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de40078e0 con 0x7f5dec0b6690 2024-09-12T02:06:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.839+0000 7f5de3fff640 1 -- 172.21.15.19:0/875063068 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4007cb0 con 0x7f5dec0b6690 2024-09-12T02:06:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.839+0000 7f5df3482640 1 -- 172.21.15.19:0/875063068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dec0b6690 msgr2=0x7f5dec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.839+0000 7f5df3482640 1 --2- 172.21.15.19:0/875063068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dec0b6690 0x7f5dec06d9c0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009d90 tx=0x7f5de402a660 comp rx=0 tx=0).stop 2024-09-12T02:06:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.839+0000 7f5df3482640 1 -- 172.21.15.19:0/875063068 shutdown_connections 2024-09-12T02:06:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.839+0000 7f5df3482640 1 --2- 172.21.15.19:0/875063068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dec0b6690 0x7f5dec06d9c0 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.839+0000 7f5df3482640 1 --2- 172.21.15.19:0/875063068 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dec15e5f0 0x7f5dec0d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.839+0000 7f5df3482640 1 -- 172.21.15.19:0/875063068 >> 172.21.15.19:0/875063068 conn(0x7f5dec08bfc0 msgr2=0x7f5dec0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.840+0000 7f5df3482640 1 -- 172.21.15.19:0/875063068 shutdown_connections 2024-09-12T02:06:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.840+0000 7f5df3482640 1 -- 172.21.15.19:0/875063068 wait complete. 2024-09-12T02:06:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.841+0000 7f5df3482640 1 Processor -- start 2024-09-12T02:06:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.841+0000 7f5df3482640 1 -- start start 2024-09-12T02:06:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.841+0000 7f5df3482640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dec0b6690 0x7f5dec0b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.841+0000 7f5df3482640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dec0d30f0 0x7f5dec15d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.841+0000 7f5df3482640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dec15e5f0 0x7f5dec15dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.841+0000 7f5df3482640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec0d5310 con 0x7f5dec0d30f0 2024-09-12T02:06:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.842+0000 7f5df3482640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec15e9d0 con 0x7f5dec15e5f0 2024-09-12T02:06:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.842+0000 7f5df3482640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5dec06df00 con 0x7f5dec0b6690 2024-09-12T02:06:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.842+0000 7f5df0a1d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dec0d30f0 0x7f5dec15d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.842+0000 7f5df0a1d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dec0d30f0 0x7f5dec15d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51662/0 (socket says 172.21.15.19:51662) 2024-09-12T02:06:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.842+0000 7f5df0a1d640 1 -- 172.21.15.19:0/4135846550 learned_addr learned my addr 172.21.15.19:0/4135846550 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.842+0000 7f5df121e640 1 --2- 172.21.15.19:0/4135846550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dec0b6690 0x7f5dec0b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.842+0000 7f5df1a1f640 1 --2- 172.21.15.19:0/4135846550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dec15e5f0 0x7f5dec15dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:42.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.842+0000 7f5df0a1d640 1 -- 172.21.15.19:0/4135846550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dec0b6690 msgr2=0x7f5dec0b75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:42.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.842+0000 7f5df0a1d640 1 --2- 172.21.15.19:0/4135846550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dec0b6690 0x7f5dec0b75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:42.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.842+0000 7f5df0a1d640 1 -- 172.21.15.19:0/4135846550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dec15e5f0 msgr2=0x7f5dec15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:42.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.842+0000 7f5df0a1d640 1 --2- 172.21.15.19:0/4135846550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dec15e5f0 0x7f5dec15dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:42.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.842+0000 7f5df0a1d640 1 -- 172.21.15.19:0/4135846550 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dec0cff50 con 0x7f5dec0d30f0 2024-09-12T02:06:42.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.842+0000 7f5df0a1d640 1 --2- 172.21.15.19:0/4135846550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dec0d30f0 0x7f5dec15d590 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00c4b0 tx=0x7f5ddc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.842+0000 7f5de1ffb640 1 -- 172.21.15.19:0/4135846550 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc018070 con 0x7f5dec0d30f0 2024-09-12T02:06:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.842+0000 7f5de1ffb640 1 -- 172.21.15.19:0/4135846550 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ddc007500 con 0x7f5dec0d30f0 2024-09-12T02:06:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.842+0000 7f5df3482640 1 -- 172.21.15.19:0/4135846550 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dec0a13b0 con 0x7f5dec0d30f0 2024-09-12T02:06:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.842+0000 7f5de1ffb640 1 -- 172.21.15.19:0/4135846550 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc004a20 con 0x7f5dec0d30f0 2024-09-12T02:06:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.843+0000 7f5df3482640 1 -- 172.21.15.19:0/4135846550 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dec0a1c50 con 0x7f5dec0d30f0 2024-09-12T02:06:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.843+0000 7f5df3482640 1 -- 172.21.15.19:0/4135846550 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dec0a17a0 con 0x7f5dec0d30f0 2024-09-12T02:06:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.844+0000 7f5de1ffb640 1 -- 172.21.15.19:0/4135846550 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ddc01b070 con 0x7f5dec0d30f0 2024-09-12T02:06:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.845+0000 7f5de1ffb640 1 --2- 172.21.15.19:0/4135846550 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5dd006be30 0x7f5dd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.845+0000 7f5de1ffb640 1 -- 172.21.15.19:0/4135846550 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 9571+0+0 (secure 0 0 0) 0x7f5ddc08b0c0 con 0x7f5dec0d30f0 2024-09-12T02:06:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.845+0000 7f5df121e640 1 --2- 172.21.15.19:0/4135846550 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5dd006be30 0x7f5dd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.845+0000 7f5df121e640 1 --2- 172.21.15.19:0/4135846550 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5dd006be30 0x7f5dd006e2f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5de80079a0 tx=0x7f5de8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:42.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:42.849+0000 7f5de1ffb640 1 -- 172.21.15.19:0/4135846550 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ddc058570 con 0x7f5dec0d30f0 2024-09-12T02:06:43.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.094+0000 7f5df3482640 1 -- 172.21.15.19:0/4135846550 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f5dec06d9c0 con 0x7f5dec0d30f0 2024-09-12T02:06:43.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.706+0000 7f5de1ffb640 1 -- 172.21.15.19:0/4135846550 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v317) ==== 101+0+0 (secure 0 0 0) 0x7f5ddc05c870 con 0x7f5dec0d30f0 2024-09-12T02:06:43.706 INFO:teuthology.orchestra.run.smithi019.stderr:repaired: restoring rank 6:0 2024-09-12T02:06:43.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.709+0000 7f5df3482640 1 -- 172.21.15.19:0/4135846550 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5dd006be30 msgr2=0x7f5dd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:43.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.709+0000 7f5df3482640 1 --2- 172.21.15.19:0/4135846550 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5dd006be30 0x7f5dd006e2f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5de80079a0 tx=0x7f5de8008040 comp rx=0 tx=0).stop 2024-09-12T02:06:43.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.709+0000 7f5df3482640 1 -- 172.21.15.19:0/4135846550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dec0d30f0 msgr2=0x7f5dec15d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:43.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.709+0000 7f5df3482640 1 --2- 172.21.15.19:0/4135846550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dec0d30f0 0x7f5dec15d590 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00c4b0 tx=0x7f5ddc00c970 comp rx=0 tx=0).stop 2024-09-12T02:06:43.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.709+0000 7f5df3482640 1 -- 172.21.15.19:0/4135846550 shutdown_connections 2024-09-12T02:06:43.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.709+0000 7f5df3482640 1 --2- 172.21.15.19:0/4135846550 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5dd006be30 0x7f5dd006e2f0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.709+0000 7f5df3482640 1 --2- 172.21.15.19:0/4135846550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dec15e5f0 0x7f5dec15dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.709+0000 7f5df3482640 1 --2- 172.21.15.19:0/4135846550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dec0d30f0 0x7f5dec15d590 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.709+0000 7f5df3482640 1 --2- 172.21.15.19:0/4135846550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5dec0b6690 0x7f5dec0b75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.709+0000 7f5df3482640 1 -- 172.21.15.19:0/4135846550 >> 172.21.15.19:0/4135846550 conn(0x7f5dec08bfc0 msgr2=0x7f5dec06e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:43.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.709+0000 7f5df3482640 1 -- 172.21.15.19:0/4135846550 shutdown_connections 2024-09-12T02:06:43.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.709+0000 7f5df3482640 1 -- 172.21.15.19:0/4135846550 wait complete. 2024-09-12T02:06:43.721 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-09-12T02:06:43.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.767+0000 7f966e891f40 1 Processor -- start 2024-09-12T02:06:43.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.767+0000 7f966e891f40 1 -- start start 2024-09-12T02:06:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.767+0000 7f966e891f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d72d54f180 0x55d72d6238a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.767+0000 7f966e891f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d72d57d050 0x55d72d625b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.767+0000 7f966e891f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d72d607080 0x55d72d596340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.767+0000 7f966e891f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d72d54bae0 con 0x55d72d54f180 2024-09-12T02:06:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.767+0000 7f966e891f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d72d49e510 con 0x55d72d57d050 2024-09-12T02:06:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.767+0000 7f966e891f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55d72d54bdc0 con 0x55d72d607080 2024-09-12T02:06:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.767+0000 7f966c387640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d72d54f180 0x55d72d6238a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.767+0000 7f966c387640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d72d54f180 0x55d72d6238a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51682/0 (socket says 172.21.15.19:51682) 2024-09-12T02:06:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.767+0000 7f966c387640 1 -- 172.21.15.19:0/3205841550 learned_addr learned my addr 172.21.15.19:0/3205841550 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.768+0000 7f966c387640 1 -- 172.21.15.19:0/3205841550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d72d607080 msgr2=0x55d72d596340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.768+0000 7f966cb88640 1 --2- 172.21.15.19:0/3205841550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d72d607080 0x55d72d596340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.768+0000 7f9663fff640 1 --2- 172.21.15.19:0/3205841550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d72d57d050 0x55d72d625b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.768+0000 7f966c387640 1 --2- 172.21.15.19:0/3205841550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d72d607080 0x55d72d596340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.768+0000 7f966c387640 1 -- 172.21.15.19:0/3205841550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d72d57d050 msgr2=0x55d72d625b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.768+0000 7f966c387640 1 --2- 172.21.15.19:0/3205841550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d72d57d050 0x55d72d625b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.768+0000 7f966c387640 1 -- 172.21.15.19:0/3205841550 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d72d6243d0 con 0x55d72d54f180 2024-09-12T02:06:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.768+0000 7f9663fff640 1 --2- 172.21.15.19:0/3205841550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d72d57d050 0x55d72d625b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.768+0000 7f966cb88640 1 --2- 172.21.15.19:0/3205841550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d72d607080 0x55d72d596340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.768+0000 7f966c387640 1 --2- 172.21.15.19:0/3205841550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d72d54f180 0x55d72d6238a0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f965c00b230 tx=0x7f965c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4848a9f513fad090 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.768+0000 7f966b385640 1 -- 172.21.15.19:0/3205841550 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c00e5c0 con 0x55d72d54f180 2024-09-12T02:06:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.768+0000 7f966b385640 1 -- 172.21.15.19:0/3205841550 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f965c006070 con 0x55d72d54f180 2024-09-12T02:06:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.768+0000 7f966b385640 1 -- 172.21.15.19:0/3205841550 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c00e9a0 con 0x55d72d54f180 2024-09-12T02:06:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.768+0000 7f966e891f40 1 -- 172.21.15.19:0/3205841550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d72d54f180 msgr2=0x55d72d6238a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:43.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.768+0000 7f966e891f40 1 --2- 172.21.15.19:0/3205841550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d72d54f180 0x55d72d6238a0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f965c00b230 tx=0x7f965c00b6f0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.769+0000 7f966e891f40 1 -- 172.21.15.19:0/3205841550 shutdown_connections 2024-09-12T02:06:43.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.769+0000 7f966e891f40 1 --2- 172.21.15.19:0/3205841550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d72d607080 0x55d72d596340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.769+0000 7f966e891f40 1 --2- 172.21.15.19:0/3205841550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d72d57d050 0x55d72d625b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.769+0000 7f966e891f40 1 --2- 172.21.15.19:0/3205841550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d72d54f180 0x55d72d6238a0 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.769+0000 7f966e891f40 1 -- 172.21.15.19:0/3205841550 >> 172.21.15.19:0/3205841550 conn(0x55d72d54c9e0 msgr2=0x55d72d54ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:43.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.769+0000 7f966e891f40 1 -- 172.21.15.19:0/3205841550 shutdown_connections 2024-09-12T02:06:43.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.769+0000 7f966e891f40 1 -- 172.21.15.19:0/3205841550 wait complete. 2024-09-12T02:06:43.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.769+0000 7f966e891f40 1 Processor -- start 2024-09-12T02:06:43.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.769+0000 7f966e891f40 1 -- start start 2024-09-12T02:06:43.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.770+0000 7f966e891f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d72d54f180 0x55d72d590c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.770+0000 7f966e891f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d72d57d050 0x55d72d6bdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.770+0000 7f966e891f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d72d607080 0x55d72d6be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.770+0000 7f966e891f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d72d60c660 con 0x55d72d607080 2024-09-12T02:06:43.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.770+0000 7f966e891f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d72d624180 con 0x55d72d54f180 2024-09-12T02:06:43.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.770+0000 7f966e891f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55d72d60c940 con 0x55d72d57d050 2024-09-12T02:06:43.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.770+0000 7f966cb88640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d72d607080 0x55d72d6be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.770+0000 7f966cb88640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d72d607080 0x55d72d6be2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51692/0 (socket says 172.21.15.19:51692) 2024-09-12T02:06:43.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.770+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 learned_addr learned my addr 172.21.15.19:0/1632823714 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:43.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.770+0000 7f9663fff640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d72d57d050 0x55d72d6bdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.770+0000 7f966c387640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d72d54f180 0x55d72d590c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.770+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d72d57d050 msgr2=0x55d72d6bdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:43.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.770+0000 7f966cb88640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d72d57d050 0x55d72d6bdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.770+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d72d54f180 msgr2=0x55d72d590c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:43.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.770+0000 7f966cb88640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d72d54f180 0x55d72d590c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.770+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d72d6acf00 con 0x55d72d607080 2024-09-12T02:06:43.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.770+0000 7f9663fff640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d72d57d050 0x55d72d6bdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:43.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.770+0000 7f966c387640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d72d54f180 0x55d72d590c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:43.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.771+0000 7f966cb88640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d72d607080 0x55d72d6be2c0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f9664008450 tx=0x7f9664008910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:43.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.771+0000 7f966a383640 1 -- 172.21.15.19:0/1632823714 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966400e040 con 0x55d72d607080 2024-09-12T02:06:43.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.771+0000 7f966a383640 1 -- 172.21.15.19:0/1632823714 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9664017070 con 0x55d72d607080 2024-09-12T02:06:43.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.771+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d72d609470 con 0x55d72d607080 2024-09-12T02:06:43.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.771+0000 7f966a383640 1 -- 172.21.15.19:0/1632823714 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96640118b0 con 0x55d72d607080 2024-09-12T02:06:43.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.771+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d72d60b750 con 0x55d72d607080 2024-09-12T02:06:43.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.772+0000 7f966a383640 1 -- 172.21.15.19:0/1632823714 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9664011a50 con 0x55d72d607080 2024-09-12T02:06:43.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.773+0000 7f966a383640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f964c06a840 0x7f964c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.773+0000 7f966a383640 1 -- 172.21.15.19:0/1632823714 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 9571+0+0 (secure 0 0 0) 0x7f966408a830 con 0x55d72d607080 2024-09-12T02:06:43.776 INFO:teuthology.orchestra.run.smithi019.stdout:Importing pool 2024-09-12T02:06:43.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.773+0000 7f966c387640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f964c06a840 0x7f964c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.773+0000 7f966e891f40 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55d72d591160 0x55d72d6c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.773+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:1 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d596920 con 0x55d72d591160 2024-09-12T02:06:43.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.773+0000 7f9663fff640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55d72d591160 0x55d72d6c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.774+0000 7f966c387640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f964c06a840 0x7f964c06cd00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f965c00b730 tx=0x7f965c009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:43.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.774+0000 7f9663fff640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55d72d591160 0x55d72d6c6050 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:43.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.775+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== osd_op_reply(1 601.00000000 [create] v133'1190 uv1164 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.775+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:2 13.10 13:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c6590 con 0x55d72d591160 2024-09-12T02:06:43.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.777+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== osd_op_reply(2 601.00000000 [delete] v133'1191 uv1191 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.777+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:3 13.10 13:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c6930 con 0x55d72d591160 2024-09-12T02:06:43.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.778+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 3 ==== osd_op_reply(3 601.00000000 [create] v133'1192 uv1192 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.778 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-09-12T02:06:43.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.778+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:4 13.10 13:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c7ce0 con 0x55d72d591160 2024-09-12T02:06:43.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.779+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v133'1193 uv1193 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.779+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:5 13.10 13:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c8080 con 0x55d72d591160 2024-09-12T02:06:43.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.780+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v133'1194 uv1194 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.780+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:6 13.10 13:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c6cd0 con 0x55d72d591160 2024-09-12T02:06:43.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.781+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v133'1195 uv1195 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.781+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:7 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.782+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 7 ==== osd_op_reply(7 602.00000000 [create] v133'1196 uv1170 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.782+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:8 13.10 13:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.783+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 8 ==== osd_op_reply(8 602.00000000 [delete] v133'1197 uv1197 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.783+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:9 13.10 13:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.784 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-09-12T02:06:43.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.785+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 9 ==== osd_op_reply(9 602.00000000 [create] v133'1198 uv1198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.785+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:10 13.10 13:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.786+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v133'1199 uv1199 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.786+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:11 13.10 13:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.787+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v133'1200 uv1200 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.787+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:12 13.10 13:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.788+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v133'1201 uv1201 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.788+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:13 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.790+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 13 ==== osd_op_reply(13 10000000000.00000000 [create] v133'1202 uv1177 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.790+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:14 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.791+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v133'1203 uv1203 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.791+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:15 13.10 13:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.793+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 15 ==== osd_op_reply(15 10000000000.00000000 [create] v133'1204 uv1204 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.792 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-09-12T02:06:43.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.793+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:16 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.795+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v133'1205 uv1205 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.795+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:17 13.10 13:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.797+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v133'1206 uv1206 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.798+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:18 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.799+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v133'1207 uv1207 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.799+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:19 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=585b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.800+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v133'1208 uv1208 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.800+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:20 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.801+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 20 ==== osd_op_reply(20 600.00000000 [create] v133'1209 uv1183 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.801+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:21 13.10 13:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.803+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 21 ==== osd_op_reply(21 600.00000000 [delete] v133'1210 uv1210 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.803+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:22 13.10 13:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.804+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 22 ==== osd_op_reply(22 600.00000000 [create] v133'1211 uv1211 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.803 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-09-12T02:06:43.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.804+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:23 13.10 13:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.805+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v133'1212 uv1212 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.805+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:24 13.10 13:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.806+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v133'1213 uv1213 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.806+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:25 13.10 13:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.808+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v133'1214 uv1214 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.808+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:26 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.809+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 26 ==== osd_op_reply(26 603.00000000 [create] v133'1215 uv1189 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.809+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:27 13.10 13:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.810+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 27 ==== osd_op_reply(27 603.00000000 [delete] v133'1216 uv1216 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.810+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:28 13.10 13:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.811+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 28 ==== osd_op_reply(28 603.00000000 [create] v133'1217 uv1217 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.810 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-09-12T02:06:43.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.811+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:29 13.10 13:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.812+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v133'1218 uv1218 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.812+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:30 13.10 13:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.814+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v133'1219 uv1219 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.814+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- osd_op(unknown.0.0:31 13.10 13:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6c70c0 con 0x55d72d591160 2024-09-12T02:06:43.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.815+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.1 v2:172.21.15.19:6808/1048134887 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v133'1220 uv1220 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d591160 2024-09-12T02:06:43.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.815+0000 7f966e891f40 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55d72d6c8420 0x55d72d6ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.815+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:32 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6cad50 con 0x55d72d6c8420 2024-09-12T02:06:43.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.815+0000 7f966c387640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55d72d6c8420 0x55d72d6ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.815+0000 7f966c387640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55d72d6c8420 0x55d72d6ca810 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:43.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.818+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== osd_op_reply(32 1.00000000.inode [create] v133'868 uv851 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.818+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:33 13.14 13:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6cb0f0 con 0x55d72d6c8420 2024-09-12T02:06:43.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.819+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== osd_op_reply(33 1.00000000.inode [delete] v133'869 uv869 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.819+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:34 13.14 13:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6cb490 con 0x55d72d6c8420 2024-09-12T02:06:43.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.821+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 3 ==== osd_op_reply(34 1.00000000.inode [create] v133'870 uv870 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.820 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-09-12T02:06:43.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.821+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:35 13.14 13:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6cbce0 con 0x55d72d6c8420 2024-09-12T02:06:43.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.822+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v133'871 uv871 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.822+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:36 13.14 13:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6cc080 con 0x55d72d6c8420 2024-09-12T02:06:43.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.823+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v133'872 uv872 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.823+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:37 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6cc420 con 0x55d72d6c8420 2024-09-12T02:06:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.825+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 6 ==== osd_op_reply(37 200.00000000 [create] v133'873 uv856 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.825+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:38 13.14 13:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6cc7c0 con 0x55d72d6c8420 2024-09-12T02:06:43.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.826+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 7 ==== osd_op_reply(38 200.00000000 [delete] v133'874 uv874 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.826+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:39 13.14 13:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6ccb60 con 0x55d72d6c8420 2024-09-12T02:06:43.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.828+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 8 ==== osd_op_reply(39 200.00000000 [create] v133'875 uv875 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.827 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-09-12T02:06:43.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.828+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:40 13.14 13:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6ccb60 con 0x55d72d6c8420 2024-09-12T02:06:43.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.829+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v133'876 uv876 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.829+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:41 13.14 13:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6ccb60 con 0x55d72d6c8420 2024-09-12T02:06:43.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.830+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v133'877 uv877 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.831+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:42 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6ccb60 con 0x55d72d6c8420 2024-09-12T02:06:43.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.832+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 11 ==== osd_op_reply(42 200.00000001 [create] v133'878 uv861 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.832+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:43 13.14 13:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6ccb60 con 0x55d72d6c8420 2024-09-12T02:06:43.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.833+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 12 ==== osd_op_reply(43 200.00000001 [delete] v133'879 uv879 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.833+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:44 13.14 13:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6ccb60 con 0x55d72d6c8420 2024-09-12T02:06:43.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.835+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 13 ==== osd_op_reply(44 200.00000001 [create] v133'880 uv880 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.834 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-09-12T02:06:43.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.835+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:45 13.14 13:2e2fa760:::200.00000001:head [write 0~17490 in=17490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d0fe0 con 0x55d72d6c8420 2024-09-12T02:06:43.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.836+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 14 ==== osd_op_reply(45 200.00000001 [write 0~17490] v133'881 uv881 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.836+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:46 13.14 13:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d0fe0 con 0x55d72d6c8420 2024-09-12T02:06:43.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.839+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v133'882 uv882 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.839+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:47 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6ccb60 con 0x55d72d6c8420 2024-09-12T02:06:43.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.840+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 16 ==== osd_op_reply(47 606.00000000 [create] v133'883 uv867 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.841+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:48 13.14 13:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6ccb60 con 0x55d72d6c8420 2024-09-12T02:06:43.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.842+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 17 ==== osd_op_reply(48 606.00000000 [delete] v133'884 uv884 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.842+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:49 13.14 13:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6ccb60 con 0x55d72d6c8420 2024-09-12T02:06:43.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.843+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 18 ==== osd_op_reply(49 606.00000000 [create] v133'885 uv885 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.843 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-09-12T02:06:43.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.843+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:50 13.14 13:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6cdb70 con 0x55d72d6c8420 2024-09-12T02:06:43.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.845+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v133'886 uv886 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.845+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:51 13.14 13:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6cdb70 con 0x55d72d6c8420 2024-09-12T02:06:43.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.846+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v133'887 uv887 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.846+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- osd_op(unknown.0.0:52 13.14 13:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6ccb60 con 0x55d72d6c8420 2024-09-12T02:06:43.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.847+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.0 v2:172.21.15.19:6824/541180533 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v133'888 uv888 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6c8420 2024-09-12T02:06:43.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.847+0000 7f966e891f40 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d72d6cd1e0 0x55d72d6cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.847+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:53 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6cfb50 con 0x55d72d6cd1e0 2024-09-12T02:06:43.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.848+0000 7f9663fff640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d72d6cd1e0 0x55d72d6cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.848+0000 7f9663fff640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d72d6cd1e0 0x55d72d6cf5d0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:43.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.849+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(53 607.00000000 [create] v133'231 uv230 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.849+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:54 13.1c 13:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6cff20 con 0x55d72d6cd1e0 2024-09-12T02:06:43.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.850+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(54 607.00000000 [delete] v133'232 uv232 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.850+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:55 13.1c 13:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6cff20 con 0x55d72d6cd1e0 2024-09-12T02:06:43.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.851+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(55 607.00000000 [create] v133'233 uv233 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.851 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-09-12T02:06:43.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.851+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:56 13.1c 13:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d0f30 con 0x55d72d6cd1e0 2024-09-12T02:06:43.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.853+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v133'234 uv234 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.853+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:57 13.1c 13:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d0f30 con 0x55d72d6cd1e0 2024-09-12T02:06:43.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.854+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v133'235 uv235 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.854+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:58 13.1c 13:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6cff20 con 0x55d72d6cd1e0 2024-09-12T02:06:43.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.856+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v133'236 uv236 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.857+0000 7f966e891f40 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55d72d6d05a0 0x55d72d6d2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.857+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:59 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d30d0 con 0x55d72d6d05a0 2024-09-12T02:06:43.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.857+0000 7f966cb88640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55d72d6d05a0 0x55d72d6d2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.857+0000 7f966cb88640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55d72d6d05a0 0x55d72d6d2a00 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:43.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.858+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(59 mds0_openfiles.0 [create] v133'175 uv174 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.858+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:60 13.6 13:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d35e0 con 0x55d72d6d05a0 2024-09-12T02:06:43.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.860+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v133'176 uv176 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.860+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:61 13.6 13:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d3ae0 con 0x55d72d6d05a0 2024-09-12T02:06:43.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.861+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 3 ==== osd_op_reply(61 mds0_openfiles.0 [create] v133'177 uv177 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.860 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-09-12T02:06:43.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.861+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:62 13.6 13:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6cb910 con 0x55d72d6d05a0 2024-09-12T02:06:43.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.862+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 4 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v133'178 uv178 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.863+0000 7f966e891f40 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d72d6d4a90 0x55d72d6d6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.863+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:63 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d74b0 con 0x55d72d6d4a90 2024-09-12T02:06:43.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.863+0000 7f966c387640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d72d6d4a90 0x55d72d6d6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.863+0000 7f966c387640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d72d6d4a90 0x55d72d6d6e80 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:43.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.864+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(63 608.00000000 [create] v133'231 uv230 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.865+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:64 13.e 13:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d7880 con 0x55d72d6d4a90 2024-09-12T02:06:43.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.866+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(64 608.00000000 [delete] v133'232 uv232 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.866+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:65 13.e 13:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d7880 con 0x55d72d6d4a90 2024-09-12T02:06:43.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.867+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(65 608.00000000 [create] v133'233 uv233 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.867 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-09-12T02:06:43.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.867+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:66 13.e 13:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d8890 con 0x55d72d6d4a90 2024-09-12T02:06:43.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.868+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v133'234 uv234 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.868+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:67 13.e 13:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d8890 con 0x55d72d6d4a90 2024-09-12T02:06:43.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.870+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v133'235 uv235 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.870+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:68 13.e 13:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d7880 con 0x55d72d6d4a90 2024-09-12T02:06:43.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.871+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v133'236 uv236 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.871+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:69 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d7880 con 0x55d72d6d05a0 2024-09-12T02:06:43.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.873+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 5 ==== osd_op_reply(69 604.00000000 [create] v133'426 uv420 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.873+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:70 13.15 13:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d7c20 con 0x55d72d6d05a0 2024-09-12T02:06:43.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.874+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 6 ==== osd_op_reply(70 604.00000000 [delete] v133'427 uv427 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.874+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:71 13.15 13:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d8010 con 0x55d72d6d05a0 2024-09-12T02:06:43.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.875+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 7 ==== osd_op_reply(71 604.00000000 [create] v133'428 uv428 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.874 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-09-12T02:06:43.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.875+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:72 13.15 13:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d8400 con 0x55d72d6d05a0 2024-09-12T02:06:43.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.876+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 8 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v133'429 uv429 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.876+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:73 13.15 13:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d8400 con 0x55d72d6d05a0 2024-09-12T02:06:43.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.877+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 9 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v133'430 uv430 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.877+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:74 13.15 13:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d8880 con 0x55d72d6d05a0 2024-09-12T02:06:43.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.878+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 10 ==== osd_op_reply(74 604.00000000 [omap-set-header] v133'431 uv431 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.878+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:75 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d8400 con 0x55d72d6d05a0 2024-09-12T02:06:43.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.879+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 11 ==== osd_op_reply(75 500.00000000 [create] v133'432 uv425 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.879+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:76 13.15 13:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d8400 con 0x55d72d6d05a0 2024-09-12T02:06:43.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.880+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 12 ==== osd_op_reply(76 500.00000000 [delete] v133'433 uv433 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.880+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:77 13.15 13:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d83b0 con 0x55d72d6d05a0 2024-09-12T02:06:43.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.881+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 13 ==== osd_op_reply(77 500.00000000 [create] v133'434 uv434 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.881 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-09-12T02:06:43.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.882+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:78 13.15 13:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d83b0 con 0x55d72d6d05a0 2024-09-12T02:06:43.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.883+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 14 ==== osd_op_reply(78 500.00000000 [write 0~90] v133'435 uv435 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.883+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:79 13.15 13:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d83b0 con 0x55d72d6d05a0 2024-09-12T02:06:43.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.884+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 15 ==== osd_op_reply(79 500.00000000 [omap-set-header] v133'436 uv436 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.884+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:80 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d83b0 con 0x55d72d6d05a0 2024-09-12T02:06:43.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.885+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 16 ==== osd_op_reply(80 mds_snaptable [create] v133'193 uv192 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.885+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:81 13.d 13:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d83b0 con 0x55d72d6d05a0 2024-09-12T02:06:43.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.886+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 17 ==== osd_op_reply(81 mds_snaptable [delete] v133'194 uv194 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.886+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:82 13.d 13:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d83b0 con 0x55d72d6d05a0 2024-09-12T02:06:43.886 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-09-12T02:06:43.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.887+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 18 ==== osd_op_reply(82 mds_snaptable [create] v133'195 uv195 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.887+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:83 13.d 13:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d83b0 con 0x55d72d6d05a0 2024-09-12T02:06:43.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.888+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 19 ==== osd_op_reply(83 mds_snaptable [write 0~70] v133'196 uv196 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.888+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:84 13.d 13:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d83b0 con 0x55d72d6d05a0 2024-09-12T02:06:43.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.889+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 <== osd.4 v2:172.21.15.135:6800/1904467046 20 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v133'197 uv197 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9664011d40 con 0x55d72d6d05a0 2024-09-12T02:06:43.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.889+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:85 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d83b0 con 0x55d72d6d4a90 2024-09-12T02:06:43.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.890+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 7 ==== osd_op_reply(85 605.00000000 [create] v133'231 uv230 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.890+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:86 13.1d 13:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d83b0 con 0x55d72d6d4a90 2024-09-12T02:06:43.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.891+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 8 ==== osd_op_reply(86 605.00000000 [delete] v133'232 uv232 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.891+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:87 13.1d 13:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d83b0 con 0x55d72d6d4a90 2024-09-12T02:06:43.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.892+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 9 ==== osd_op_reply(87 605.00000000 [create] v133'233 uv233 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.892 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-09-12T02:06:43.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.893+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:88 13.1d 13:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d98b0 con 0x55d72d6d4a90 2024-09-12T02:06:43.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.894+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 10 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v133'234 uv234 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.894+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d9860 con 0x55d72d6d4a90 2024-09-12T02:06:43.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.895+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 11 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v133'235 uv235 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.895+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:90 13.1d 13:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d8850 con 0x55d72d6d4a90 2024-09-12T02:06:43.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.896+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 12 ==== osd_op_reply(90 605.00000000 [omap-set-header] v133'236 uv236 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.896+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:91 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d8850 con 0x55d72d6d4a90 2024-09-12T02:06:43.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.898+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 13 ==== osd_op_reply(91 mds0_inotable [create] v133'386 uv380 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.898+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:92 13.13 13:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d8850 con 0x55d72d6d4a90 2024-09-12T02:06:43.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.899+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 14 ==== osd_op_reply(92 mds0_inotable [delete] v133'387 uv387 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.899+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:93 13.13 13:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d8850 con 0x55d72d6d4a90 2024-09-12T02:06:43.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.900+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 15 ==== osd_op_reply(93 mds0_inotable [create] v133'388 uv388 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.899 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-09-12T02:06:43.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.900+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:94 13.13 13:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d8850 con 0x55d72d6d4a90 2024-09-12T02:06:43.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.901+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 16 ==== osd_op_reply(94 mds0_inotable [write 0~34] v133'389 uv389 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.901+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:95 13.13 13:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d8850 con 0x55d72d6d4a90 2024-09-12T02:06:43.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.902+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 17 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v133'390 uv390 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.902+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:96 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d8850 con 0x55d72d6d4a90 2024-09-12T02:06:43.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.903+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 18 ==== osd_op_reply(96 100.00000000 [create] v133'391 uv385 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.903+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:97 13.13 13:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d8850 con 0x55d72d6d4a90 2024-09-12T02:06:43.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.904+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 19 ==== osd_op_reply(97 100.00000000 [delete] v133'392 uv392 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.904+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:98 13.13 13:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d8850 con 0x55d72d6d4a90 2024-09-12T02:06:43.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.905+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 20 ==== osd_op_reply(98 100.00000000 [create] v133'393 uv393 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.904 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-09-12T02:06:43.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.905+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:99 13.13 13:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6d8850 con 0x55d72d6d4a90 2024-09-12T02:06:43.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.906+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 21 ==== osd_op_reply(99 100.00000000 [omap-set-header] v133'394 uv394 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.906+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:100 13.13 13:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db660 con 0x55d72d6d4a90 2024-09-12T02:06:43.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.907+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 22 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v133'395 uv395 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.907+0000 7f966e891f40 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d72d6d9210 0x55d72d6dbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.907+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:101 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6d9210 2024-09-12T02:06:43.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.907+0000 7f9663fff640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d72d6d9210 0x55d72d6dbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.907+0000 7f9663fff640 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d72d6d9210 0x55d72d6dbaa0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:43.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.908+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(101 mds0_sessionmap [create] v133'172 uv171 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6d9210 2024-09-12T02:06:43.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.908+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:102 13.b 13:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6d9210 2024-09-12T02:06:43.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.909+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== osd_op_reply(102 mds0_sessionmap [delete] v133'173 uv173 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6d9210 2024-09-12T02:06:43.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.909+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:103 13.b 13:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6d9210 2024-09-12T02:06:43.909 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-09-12T02:06:43.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.910+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.5 v2:172.21.15.135:6808/3846812594 3 ==== osd_op_reply(103 mds0_sessionmap [create] v133'174 uv174 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6d9210 2024-09-12T02:06:43.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.910+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:104 13.b 13:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6d9210 2024-09-12T02:06:43.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.911+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.5 v2:172.21.15.135:6808/3846812594 4 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v133'175 uv175 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6d9210 2024-09-12T02:06:43.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.911+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:105 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6d4a90 2024-09-12T02:06:43.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.913+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 23 ==== osd_op_reply(105 609.00000000 [create] v133'231 uv230 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.913+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:106 13.7 13:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6d4a90 2024-09-12T02:06:43.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.914+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 24 ==== osd_op_reply(106 609.00000000 [delete] v133'232 uv232 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.914+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:107 13.7 13:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6d4a90 2024-09-12T02:06:43.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.915+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 25 ==== osd_op_reply(107 609.00000000 [create] v133'233 uv233 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.914 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-09-12T02:06:43.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.915+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:108 13.7 13:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6d4a90 2024-09-12T02:06:43.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.916+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 26 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v133'234 uv234 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.916+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:109 13.7 13:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6d4a90 2024-09-12T02:06:43.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.917+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 27 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v133'235 uv235 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.917+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:110 13.7 13:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6d4a90 2024-09-12T02:06:43.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.918+0000 7f966c387640 1 -- 172.21.15.19:0/1632823714 <== osd.7 v2:172.21.15.135:6824/872608380 28 ==== osd_op_reply(110 609.00000000 [omap-set-header] v133'236 uv236 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965c00ed00 con 0x55d72d6d4a90 2024-09-12T02:06:43.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.918+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:111 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6cd1e0 2024-09-12T02:06:43.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.919+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 7 ==== osd_op_reply(111 400.00000000 [create] v133'196 uv195 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.919+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:112 13.f 13:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6cd1e0 2024-09-12T02:06:43.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.921+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 8 ==== osd_op_reply(112 400.00000000 [delete] v133'197 uv197 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.921+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:113 13.f 13:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6cd1e0 2024-09-12T02:06:43.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.922+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 9 ==== osd_op_reply(113 400.00000000 [create] v133'198 uv198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.921 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-09-12T02:06:43.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.922+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:114 13.f 13:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6cd1e0 2024-09-12T02:06:43.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.923+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 10 ==== osd_op_reply(114 400.00000000 [write 0~22] v133'199 uv199 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.923+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:115 13.f 13:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6cd1e0 2024-09-12T02:06:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.924+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 11 ==== osd_op_reply(115 400.00000000 [omap-set-header] v133'200 uv200 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.924+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:116 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6cd1e0 2024-09-12T02:06:43.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.926+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 12 ==== osd_op_reply(116 100.00000000.inode [create] v133'480 uv472 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.926+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:117 13.1f 13:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6cd1e0 2024-09-12T02:06:43.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.927+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 13 ==== osd_op_reply(117 100.00000000.inode [delete] v133'481 uv481 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.927+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:118 13.1f 13:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6cd1e0 2024-09-12T02:06:43.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.928+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 14 ==== osd_op_reply(118 100.00000000.inode [create] v133'482 uv482 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.927 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-09-12T02:06:43.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.928+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:119 13.1f 13:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6cd1e0 2024-09-12T02:06:43.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.929+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 15 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v133'483 uv483 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.929+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:120 13.1f 13:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6cd1e0 2024-09-12T02:06:43.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.930+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 16 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v133'484 uv484 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.930+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:121 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6cd1e0 2024-09-12T02:06:43.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.932+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 17 ==== osd_op_reply(121 1.00000000 [create] v133'485 uv479 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.932+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:122 13.1f 13:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6cd1e0 2024-09-12T02:06:43.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.933+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 18 ==== osd_op_reply(122 1.00000000 [delete] v133'486 uv486 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.933+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:123 13.1f 13:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6cd1e0 2024-09-12T02:06:43.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.934+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 19 ==== osd_op_reply(123 1.00000000 [create] v133'487 uv487 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.934 INFO:teuthology.orchestra.run.smithi019.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-09-12T02:06:43.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.934+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:124 13.1f 13:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6cd1e0 2024-09-12T02:06:43.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.936+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 20 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v133'488 uv488 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.936+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:125 13.1f 13:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6cd1e0 2024-09-12T02:06:43.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.937+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 21 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v133'489 uv489 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.937+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:126 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6db600 con 0x55d72d6cd1e0 2024-09-12T02:06:43.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.938+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 22 ==== osd_op_reply(126 1.00000000 [omap-set-header] v133'490 uv490 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.938+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:127 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x55d72d6dbfe0 con 0x55d72d6cd1e0 2024-09-12T02:06:43.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.939+0000 7f9663fff640 1 -- 172.21.15.19:0/1632823714 <== osd.6 v2:172.21.15.135:6816/580453075 23 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v133'491 uv491 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f9654057030 con 0x55d72d6cd1e0 2024-09-12T02:06:43.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.939+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55d72d6c8420 msgr2=0x55d72d6ca810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:43.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.939+0000 7f966e891f40 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x55d72d6c8420 0x55d72d6ca810 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.939+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55d72d591160 msgr2=0x55d72d6c6050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:43.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.939+0000 7f966e891f40 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x55d72d591160 0x55d72d6c6050 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.939+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55d72d6d05a0 msgr2=0x55d72d6d2a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:43.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.939+0000 7f966e891f40 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55d72d6d05a0 0x55d72d6d2a00 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.939+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d72d6d9210 msgr2=0x55d72d6dbaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:43.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.939+0000 7f966e891f40 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d72d6d9210 0x55d72d6dbaa0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.939+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d72d6cd1e0 msgr2=0x55d72d6cf5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:43.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.939+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 reap_dead start 2024-09-12T02:06:43.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.939+0000 7f966e891f40 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d72d6cd1e0 0x55d72d6cf5d0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.939+0000 7f966cb88640 1 -- 172.21.15.19:0/1632823714 reap_dead start 2024-09-12T02:06:43.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.939+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d72d6d4a90 msgr2=0x55d72d6d6e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:43.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.939+0000 7f966e891f40 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d72d6d4a90 0x55d72d6d6e80 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.939+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f964c06a840 msgr2=0x7f964c06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:43.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.939+0000 7f966e891f40 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f964c06a840 0x7f964c06cd00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f965c00b730 tx=0x7f965c009000 comp rx=0 tx=0).stop 2024-09-12T02:06:43.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.940+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d72d607080 msgr2=0x55d72d6be2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:43.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.940+0000 7f966e891f40 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d72d607080 0x55d72d6be2c0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f9664008450 tx=0x7f9664008910 comp rx=0 tx=0).stop 2024-09-12T02:06:43.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.940+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 shutdown_connections 2024-09-12T02:06:43.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.940+0000 7f966e891f40 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d72d6d4a90 0x55d72d6d6e80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.940+0000 7f966e891f40 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f964c06a840 0x7f964c06cd00 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.940+0000 7f966e891f40 1 --2- 172.21.15.19:0/1632823714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d72d607080 0x55d72d6be2c0 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.940+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 >> 172.21.15.19:0/1632823714 conn(0x55d72d54c9e0 msgr2=0x55d72d626a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:43.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.940+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 shutdown_connections 2024-09-12T02:06:43.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.940+0000 7f966e891f40 1 -- 172.21.15.19:0/1632823714 wait complete. 2024-09-12T02:06:43.943 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapheader 1.00000000 deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-09-12T02:06:43.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.989+0000 7f6771f43f40 1 Processor -- start 2024-09-12T02:06:43.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.989+0000 7f6771f43f40 1 -- start start 2024-09-12T02:06:43.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.989+0000 7f6771f43f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6758002850 0x5591255e10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.989+0000 7f6771f43f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5591255c2460 0x5591255c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.989+0000 7f6771f43f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5591255c84e0 0x559125536fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.989+0000 7f6771f43f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559125459510 con 0x5591255c84e0 2024-09-12T02:06:43.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.989+0000 7f6771f43f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5591254b2c50 con 0x7f6758002850 2024-09-12T02:06:43.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.990+0000 7f6771f43f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x559125506dc0 con 0x5591255c2460 2024-09-12T02:06:43.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.990+0000 7f677023a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5591255c84e0 0x559125536fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.990+0000 7f677023a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5591255c84e0 0x559125536fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51712/0 (socket says 172.21.15.19:51712) 2024-09-12T02:06:43.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.990+0000 7f677023a640 1 -- 172.21.15.19:0/762120162 learned_addr learned my addr 172.21.15.19:0/762120162 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:43.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.990+0000 7f676f238640 1 --2- 172.21.15.19:0/762120162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5591255c2460 0x5591255c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.990+0000 7f676fa39640 1 --2- 172.21.15.19:0/762120162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6758002850 0x5591255e10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.990+0000 7f677023a640 1 -- 172.21.15.19:0/762120162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5591255c2460 msgr2=0x5591255c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:43.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.990+0000 7f677023a640 1 --2- 172.21.15.19:0/762120162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5591255c2460 0x5591255c05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.990+0000 7f677023a640 1 -- 172.21.15.19:0/762120162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6758002850 msgr2=0x5591255e10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:43.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.990+0000 7f677023a640 1 --2- 172.21.15.19:0/762120162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6758002850 0x5591255e10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.990+0000 7f677023a640 1 -- 172.21.15.19:0/762120162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591255df450 con 0x5591255c84e0 2024-09-12T02:06:43.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.990+0000 7f677023a640 1 --2- 172.21.15.19:0/762120162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5591255c84e0 0x559125536fd0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x559125508b00 tx=0x7f67680064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7583d6867491a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:43.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.990+0000 7f676e236640 1 -- 172.21.15.19:0/762120162 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6768018070 con 0x5591255c84e0 2024-09-12T02:06:43.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.990+0000 7f676e236640 1 -- 172.21.15.19:0/762120162 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67680104c0 con 0x5591255c84e0 2024-09-12T02:06:43.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.990+0000 7f676e236640 1 -- 172.21.15.19:0/762120162 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6768010890 con 0x5591255c84e0 2024-09-12T02:06:43.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.991+0000 7f6771f43f40 1 -- 172.21.15.19:0/762120162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5591255c84e0 msgr2=0x559125536fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:43.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.991+0000 7f6771f43f40 1 --2- 172.21.15.19:0/762120162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5591255c84e0 0x559125536fd0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x559125508b00 tx=0x7f67680064f0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.991+0000 7f6771f43f40 1 -- 172.21.15.19:0/762120162 shutdown_connections 2024-09-12T02:06:43.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.991+0000 7f6771f43f40 1 --2- 172.21.15.19:0/762120162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5591255c84e0 0x559125536fd0 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.991+0000 7f6771f43f40 1 --2- 172.21.15.19:0/762120162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5591255c2460 0x5591255c05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.991+0000 7f6771f43f40 1 --2- 172.21.15.19:0/762120162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6758002850 0x5591255e10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.991+0000 7f6771f43f40 1 -- 172.21.15.19:0/762120162 >> 172.21.15.19:0/762120162 conn(0x5591255079e0 msgr2=0x5591255e19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:43.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.991+0000 7f6771f43f40 1 -- 172.21.15.19:0/762120162 shutdown_connections 2024-09-12T02:06:43.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.991+0000 7f6771f43f40 1 -- 172.21.15.19:0/762120162 wait complete. 2024-09-12T02:06:43.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.991+0000 7f6771f43f40 1 Processor -- start 2024-09-12T02:06:43.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.991+0000 7f6771f43f40 1 -- start start 2024-09-12T02:06:43.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.992+0000 7f6771f43f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591255c2460 0x5591255bf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.992+0000 7f6771f43f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5591255c84e0 0x5591255ddb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.992+0000 7f6771f43f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6758002850 0x5591255c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.992+0000 7f6771f43f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5591255c1580 con 0x7f6758002850 2024-09-12T02:06:43.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.992+0000 7f6771f43f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5591255e1600 con 0x5591255c2460 2024-09-12T02:06:43.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.992+0000 7f6771f43f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x5591255c0df0 con 0x5591255c84e0 2024-09-12T02:06:43.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.992+0000 7f677023a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6758002850 0x5591255c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.992+0000 7f676fa39640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591255c2460 0x5591255bf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.992+0000 7f677023a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6758002850 0x5591255c53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51722/0 (socket says 172.21.15.19:51722) 2024-09-12T02:06:43.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.992+0000 7f677023a640 1 -- 172.21.15.19:0/3873492713 learned_addr learned my addr 172.21.15.19:0/3873492713 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:43.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.992+0000 7f676f238640 1 --2- 172.21.15.19:0/3873492713 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5591255c84e0 0x5591255ddb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:43.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.993+0000 7f677023a640 1 -- 172.21.15.19:0/3873492713 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5591255c84e0 msgr2=0x5591255ddb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:43.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.993+0000 7f677023a640 1 --2- 172.21.15.19:0/3873492713 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5591255c84e0 0x5591255ddb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.993+0000 7f677023a640 1 -- 172.21.15.19:0/3873492713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591255c2460 msgr2=0x5591255bf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:43.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.993+0000 7f677023a640 1 --2- 172.21.15.19:0/3873492713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591255c2460 0x5591255bf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.993+0000 7f677023a640 1 -- 172.21.15.19:0/3873492713 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591255bfbe0 con 0x7f6758002850 2024-09-12T02:06:43.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.993+0000 7f676fa39640 1 --2- 172.21.15.19:0/3873492713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591255c2460 0x5591255bf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:43.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.993+0000 7f677023a640 1 --2- 172.21.15.19:0/3873492713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6758002850 0x5591255c53b0 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f6768001b60 tx=0x5591255387e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:43.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.993+0000 7f676d234640 1 -- 172.21.15.19:0/3873492713 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6768025070 con 0x7f6758002850 2024-09-12T02:06:43.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.993+0000 7f676d234640 1 -- 172.21.15.19:0/3873492713 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6768019040 con 0x7f6758002850 2024-09-12T02:06:43.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.993+0000 7f6771f43f40 1 -- 172.21.15.19:0/3873492713 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591255c5cb0 con 0x7f6758002850 2024-09-12T02:06:43.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.993+0000 7f676d234640 1 -- 172.21.15.19:0/3873492713 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6768018070 con 0x7f6758002850 2024-09-12T02:06:43.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.993+0000 7f6771f43f40 1 -- 172.21.15.19:0/3873492713 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591255dd370 con 0x7f6758002850 2024-09-12T02:06:43.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.994+0000 7f676d234640 1 -- 172.21.15.19:0/3873492713 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6768028070 con 0x7f6758002850 2024-09-12T02:06:43.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.995+0000 7f676d234640 1 --2- 172.21.15.19:0/3873492713 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f675c06a840 0x7f675c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:43.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.995+0000 7f676d234640 1 -- 172.21.15.19:0/3873492713 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 9571+0+0 (secure 0 0 0) 0x7f676808b880 con 0x7f6758002850 2024-09-12T02:06:44.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.995+0000 7f676fa39640 1 --2- 172.21.15.19:0/3873492713 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f675c06a840 0x7f675c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:44.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.995+0000 7f6771f43f40 1 --2- 172.21.15.19:0/3873492713 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5591255c7900 0x559125676280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:44.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.995+0000 7f6771f43f40 1 -- 172.21.15.19:0/3873492713 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 13.1f 13:ff5b34d6:::1.00000000:head [omap-set-header in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) -- 0x5591256767c0 con 0x5591255c7900 2024-09-12T02:06:44.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.995+0000 7f676f238640 1 --2- 172.21.15.19:0/3873492713 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5591255c7900 0x559125676280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:44.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.996+0000 7f676fa39640 1 --2- 172.21.15.19:0/3873492713 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f675c06a840 0x7f675c06cd00 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f6760005400 tx=0x7f676000c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:44.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.996+0000 7f676f238640 1 --2- 172.21.15.19:0/3873492713 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5591255c7900 0x559125676280 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:44.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.997+0000 7f676f238640 1 -- 172.21.15.19:0/3873492713 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 1.00000000 [omap-set-header] v133'492 uv492 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6764055810 con 0x5591255c7900 2024-09-12T02:06:44.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.997+0000 7f6771f43f40 1 -- 172.21.15.19:0/3873492713 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5591255c7900 msgr2=0x559125676280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:44.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.997+0000 7f6771f43f40 1 --2- 172.21.15.19:0/3873492713 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x5591255c7900 0x559125676280 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:44.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.997+0000 7f6771f43f40 1 -- 172.21.15.19:0/3873492713 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f675c06a840 msgr2=0x7f675c06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:44.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.997+0000 7f6771f43f40 1 --2- 172.21.15.19:0/3873492713 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f675c06a840 0x7f675c06cd00 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f6760005400 tx=0x7f676000c040 comp rx=0 tx=0).stop 2024-09-12T02:06:44.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.997+0000 7f6771f43f40 1 -- 172.21.15.19:0/3873492713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6758002850 msgr2=0x5591255c53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:44.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.997+0000 7f6771f43f40 1 --2- 172.21.15.19:0/3873492713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6758002850 0x5591255c53b0 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f6768001b60 tx=0x5591255387e0 comp rx=0 tx=0).stop 2024-09-12T02:06:44.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.997+0000 7f677023a640 1 -- 172.21.15.19:0/3873492713 reap_dead start 2024-09-12T02:06:44.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.997+0000 7f6771f43f40 1 -- 172.21.15.19:0/3873492713 shutdown_connections 2024-09-12T02:06:44.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.997+0000 7f6771f43f40 1 -- 172.21.15.19:0/3873492713 >> 172.21.15.19:0/3873492713 conn(0x5591255079e0 msgr2=0x559125509a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:44.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.997+0000 7f6771f43f40 1 -- 172.21.15.19:0/3873492713 shutdown_connections 2024-09-12T02:06:44.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:43.997+0000 7f6771f43f40 1 -- 172.21.15.19:0/3873492713 wait complete. 2024-09-12T02:06:44.001 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:06:44.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.108+0000 7f205a749640 1 Processor -- start 2024-09-12T02:06:44.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.108+0000 7f205a749640 1 -- start start 2024-09-12T02:06:44.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.108+0000 7f205a749640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2054162e30 0x7f205406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:44.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.108+0000 7f205a749640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f20540cf280 0x7f20540d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:44.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.108+0000 7f205a749640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f205415ff70 con 0x7f2054162340 2024-09-12T02:06:44.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.108+0000 7f205a749640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f205406de90 con 0x7f20540cf280 2024-09-12T02:06:44.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.108+0000 7f205a749640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2054163270 con 0x7f2054162e30 2024-09-12T02:06:44.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.109+0000 7f2053fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2054162340 0x7f2054162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52432/0 (socket says 172.21.15.19:52432) 2024-09-12T02:06:44.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.109+0000 7f2053fff640 1 -- 172.21.15.19:0/1350750107 learned_addr learned my addr 172.21.15.19:0/1350750107 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:44.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.109+0000 7f2058ce6640 1 --2- 172.21.15.19:0/1350750107 >> v2:172.21.15.19:3300/0 conn(0x7f20540cf280 0x7f20540d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:44.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.109+0000 7f204bfff640 1 --2- 172.21.15.19:0/1350750107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2054162e30 0x7f205406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:44.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.109+0000 7f2058ce6640 1 -- 172.21.15.19:0/1350750107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2054162e30 msgr2=0x7f205406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:44.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.109+0000 7f2058ce6640 1 --2- 172.21.15.19:0/1350750107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2054162e30 0x7f205406d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:44.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.109+0000 7f2058ce6640 1 -- 172.21.15.19:0/1350750107 >> v1:172.21.15.19:6789/0 conn(0x7f2054162340 legacy=0x7f2054162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:44.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.109+0000 7f2058ce6640 1 -- 172.21.15.19:0/1350750107 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20540d4d10 con 0x7f20540cf280 2024-09-12T02:06:44.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.110+0000 7f2058ce6640 1 --2- 172.21.15.19:0/1350750107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20540cf280 0x7f20540d2990 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f204c009d90 tx=0x7f204c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6e820f2e80fdd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:44.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.110+0000 7f20537fe640 1 -- 172.21.15.19:0/1350750107 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c031600 con 0x7f20540cf280 2024-09-12T02:06:44.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.110+0000 7f20537fe640 1 -- 172.21.15.19:0/1350750107 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f204c0317a0 con 0x7f20540cf280 2024-09-12T02:06:44.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.110+0000 7f20537fe640 1 -- 172.21.15.19:0/1350750107 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c031b70 con 0x7f20540cf280 2024-09-12T02:06:44.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.110+0000 7f205a749640 1 -- 172.21.15.19:0/1350750107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20540cf280 msgr2=0x7f20540d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:44.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.110+0000 7f205a749640 1 --2- 172.21.15.19:0/1350750107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20540cf280 0x7f20540d2990 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f204c009d90 tx=0x7f204c02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:06:44.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.110+0000 7f205a749640 1 -- 172.21.15.19:0/1350750107 shutdown_connections 2024-09-12T02:06:44.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.110+0000 7f205a749640 1 --2- 172.21.15.19:0/1350750107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20540cf280 0x7f20540d2990 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:44.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.110+0000 7f205a749640 1 --2- 172.21.15.19:0/1350750107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2054162e30 0x7f205406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:44.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.110+0000 7f205a749640 1 -- 172.21.15.19:0/1350750107 >> 172.21.15.19:0/1350750107 conn(0x7f205408bfc0 msgr2=0x7f20540d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:44.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.110+0000 7f205a749640 1 -- 172.21.15.19:0/1350750107 shutdown_connections 2024-09-12T02:06:44.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.110+0000 7f205a749640 1 -- 172.21.15.19:0/1350750107 wait complete. 2024-09-12T02:06:44.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.112+0000 7f205a749640 1 Processor -- start 2024-09-12T02:06:44.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.112+0000 7f205a749640 1 -- start start 2024-09-12T02:06:44.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.112+0000 7f205a749640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20540cf280 0x7f20540b9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:44.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.112+0000 7f205a749640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2054162340 0x7f20541514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:44.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.112+0000 7f205a749640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2054162e30 0x7f20541519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:44.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.112+0000 7f205a749640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f20540cf710 con 0x7f20540cf280 2024-09-12T02:06:44.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.112+0000 7f205a749640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f20540d2470 con 0x7f2054162e30 2024-09-12T02:06:44.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.112+0000 7f205a749640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f20540d52d0 con 0x7f2054162340 2024-09-12T02:06:44.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.113+0000 7f2053fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20540cf280 0x7f20540b9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:44.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.113+0000 7f2053fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20540cf280 0x7f20540b9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51746/0 (socket says 172.21.15.19:51746) 2024-09-12T02:06:44.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.113+0000 7f2053fff640 1 -- 172.21.15.19:0/1879150205 learned_addr learned my addr 172.21.15.19:0/1879150205 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:44.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.113+0000 7f204bfff640 1 --2- 172.21.15.19:0/1879150205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2054162340 0x7f20541514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:44.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.113+0000 7f2058ce6640 1 --2- 172.21.15.19:0/1879150205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2054162e30 0x7f20541519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:44.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.113+0000 7f2053fff640 1 -- 172.21.15.19:0/1879150205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2054162340 msgr2=0x7f20541514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:44.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.113+0000 7f2053fff640 1 --2- 172.21.15.19:0/1879150205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2054162340 0x7f20541514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:44.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.113+0000 7f2053fff640 1 -- 172.21.15.19:0/1879150205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2054162e30 msgr2=0x7f20541519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:44.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.113+0000 7f2053fff640 1 --2- 172.21.15.19:0/1879150205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2054162e30 0x7f20541519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:44.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.113+0000 7f2053fff640 1 -- 172.21.15.19:0/1879150205 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20540b42e0 con 0x7f20540cf280 2024-09-12T02:06:44.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.113+0000 7f204bfff640 1 --2- 172.21.15.19:0/1879150205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2054162340 0x7f20541514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:44.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.113+0000 7f2058ce6640 1 --2- 172.21.15.19:0/1879150205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2054162e30 0x7f20541519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:44.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.113+0000 7f2053fff640 1 --2- 172.21.15.19:0/1879150205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20540cf280 0x7f20540b9b00 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f204400c430 tx=0x7f204400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:44.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.113+0000 7f20517fa640 1 -- 172.21.15.19:0/1879150205 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044017070 con 0x7f20540cf280 2024-09-12T02:06:44.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.113+0000 7f20517fa640 1 -- 172.21.15.19:0/1879150205 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2044005ce0 con 0x7f20540cf280 2024-09-12T02:06:44.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.113+0000 7f205a749640 1 -- 172.21.15.19:0/1879150205 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20540cc610 con 0x7f20540cf280 2024-09-12T02:06:44.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.113+0000 7f20517fa640 1 -- 172.21.15.19:0/1879150205 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20440072f0 con 0x7f20540cf280 2024-09-12T02:06:44.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.113+0000 7f205a749640 1 -- 172.21.15.19:0/1879150205 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20540ccbd0 con 0x7f20540cf280 2024-09-12T02:06:44.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.114+0000 7f205a749640 1 -- 172.21.15.19:0/1879150205 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f205406d740 con 0x7f20540cf280 2024-09-12T02:06:44.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.115+0000 7f20517fa640 1 -- 172.21.15.19:0/1879150205 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f204401a070 con 0x7f20540cf280 2024-09-12T02:06:44.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.115+0000 7f20517fa640 1 --2- 172.21.15.19:0/1879150205 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f203406be30 0x7f203406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:44.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.115+0000 7f20517fa640 1 -- 172.21.15.19:0/1879150205 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 9571+0+0 (secure 0 0 0) 0x7f204408b140 con 0x7f20540cf280 2024-09-12T02:06:44.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.116+0000 7f204bfff640 1 --2- 172.21.15.19:0/1879150205 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f203406be30 0x7f203406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:44.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.116+0000 7f204bfff640 1 --2- 172.21.15.19:0/1879150205 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f203406be30 0x7f203406e2f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f20540d3c40 tx=0x7f203c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:44.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.120+0000 7f20517fa640 1 -- 172.21.15.19:0/1879150205 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2044058c10 con 0x7f20540cf280 2024-09-12T02:06:44.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.331+0000 7f205a749640 1 -- 172.21.15.19:0/1879150205 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f205406e3e0 con 0x7f20540cf280 2024-09-12T02:06:44.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.717+0000 7f20517fa640 1 -- 172.21.15.19:0/1879150205 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v318) ==== 162+0+0 (secure 0 0 0) 0x7f2044058510 con 0x7f20540cf280 2024-09-12T02:06:44.717 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:06:44.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.719+0000 7f205a749640 1 -- 172.21.15.19:0/1879150205 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f203406be30 msgr2=0x7f203406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:44.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.719+0000 7f205a749640 1 --2- 172.21.15.19:0/1879150205 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f203406be30 0x7f203406e2f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f20540d3c40 tx=0x7f203c008040 comp rx=0 tx=0).stop 2024-09-12T02:06:44.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.719+0000 7f205a749640 1 -- 172.21.15.19:0/1879150205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20540cf280 msgr2=0x7f20540b9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:44.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.719+0000 7f205a749640 1 --2- 172.21.15.19:0/1879150205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20540cf280 0x7f20540b9b00 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f204400c430 tx=0x7f204400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:06:44.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.719+0000 7f205a749640 1 -- 172.21.15.19:0/1879150205 shutdown_connections 2024-09-12T02:06:44.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.719+0000 7f205a749640 1 --2- 172.21.15.19:0/1879150205 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f203406be30 0x7f203406e2f0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:44.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.719+0000 7f205a749640 1 --2- 172.21.15.19:0/1879150205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2054162e30 0x7f20541519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:44.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.719+0000 7f205a749640 1 --2- 172.21.15.19:0/1879150205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2054162340 0x7f20541514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:44.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.719+0000 7f205a749640 1 --2- 172.21.15.19:0/1879150205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20540cf280 0x7f20540b9b00 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:44.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.719+0000 7f205a749640 1 -- 172.21.15.19:0/1879150205 >> 172.21.15.19:0/1879150205 conn(0x7f205408bfc0 msgr2=0x7f20540d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:44.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.720+0000 7f205a749640 1 -- 172.21.15.19:0/1879150205 shutdown_connections 2024-09-12T02:06:44.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.720+0000 7f205a749640 1 -- 172.21.15.19:0/1879150205 wait complete. 2024-09-12T02:06:44.733 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.839+0000 7f4766a77640 1 Processor -- start 2024-09-12T02:06:44.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.839+0000 7f4766a77640 1 -- start start 2024-09-12T02:06:44.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.840+0000 7f4766a77640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f47600b5f80 0x7f47600b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:44.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.840+0000 7f4766a77640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f47600cd650 0x7f47600cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:44.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.840+0000 7f4766a77640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f476006fdb0 con 0x7f47600afd70 2024-09-12T02:06:44.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.840+0000 7f4766a77640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f47600b6910 con 0x7f47600cd650 2024-09-12T02:06:44.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.840+0000 7f4766a77640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f4760070090 con 0x7f47600b5f80 2024-09-12T02:06:44.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.840+0000 7f4765014640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f47600cd650 0x7f47600cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:44.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.840+0000 7f4765014640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f47600cd650 0x7f47600cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51748/0 (socket says 172.21.15.19:51748) 2024-09-12T02:06:44.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.840+0000 7f4765014640 1 -- 172.21.15.19:0/1313004570 learned_addr learned my addr 172.21.15.19:0/1313004570 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:44.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.840+0000 7f475ffff640 1 --2- 172.21.15.19:0/1313004570 >> v2:172.21.15.135:3300/0 conn(0x7f47600b5f80 0x7f47600b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:44.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.840+0000 7f4765014640 1 -- 172.21.15.19:0/1313004570 >> v2:172.21.15.135:3300/0 conn(0x7f47600b5f80 msgr2=0x7f47600b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:44.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.840+0000 7f4765014640 1 --2- 172.21.15.19:0/1313004570 >> v2:172.21.15.135:3300/0 conn(0x7f47600b5f80 0x7f47600b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:44.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.840+0000 7f4765014640 1 -- 172.21.15.19:0/1313004570 >> v1:172.21.15.135:6789/0 conn(0x7f47600afd70 legacy=0x7f4760160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:44.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.840+0000 7f4765014640 1 -- 172.21.15.19:0/1313004570 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4760070370 con 0x7f47600cd650 2024-09-12T02:06:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.841+0000 7f4765014640 1 --2- 172.21.15.19:0/1313004570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47600cd650 0x7f47600cdab0 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f476015a410 tx=0x7f475802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c83bc4427832e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.841+0000 7f475f7fe640 1 -- 172.21.15.19:0/1313004570 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4758036070 con 0x7f47600cd650 2024-09-12T02:06:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.841+0000 7f475f7fe640 1 -- 172.21.15.19:0/1313004570 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4758031600 con 0x7f47600cd650 2024-09-12T02:06:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.841+0000 7f475f7fe640 1 -- 172.21.15.19:0/1313004570 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47580319d0 con 0x7f47600cd650 2024-09-12T02:06:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.842+0000 7f4766a77640 1 -- 172.21.15.19:0/1313004570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47600cd650 msgr2=0x7f47600cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.842+0000 7f4766a77640 1 --2- 172.21.15.19:0/1313004570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47600cd650 0x7f47600cdab0 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f476015a410 tx=0x7f475802a730 comp rx=0 tx=0).stop 2024-09-12T02:06:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.842+0000 7f4766a77640 1 -- 172.21.15.19:0/1313004570 shutdown_connections 2024-09-12T02:06:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.842+0000 7f4766a77640 1 --2- 172.21.15.19:0/1313004570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47600cd650 0x7f47600cdab0 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.842+0000 7f4766a77640 1 --2- 172.21.15.19:0/1313004570 >> v2:172.21.15.135:3300/0 conn(0x7f47600b5f80 0x7f47600b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.842+0000 7f4766a77640 1 -- 172.21.15.19:0/1313004570 >> 172.21.15.19:0/1313004570 conn(0x7f476006bc10 msgr2=0x7f476006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.842+0000 7f4766a77640 1 -- 172.21.15.19:0/1313004570 shutdown_connections 2024-09-12T02:06:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.842+0000 7f4766a77640 1 -- 172.21.15.19:0/1313004570 wait complete. 2024-09-12T02:06:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.843+0000 7f4766a77640 1 Processor -- start 2024-09-12T02:06:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.843+0000 7f4766a77640 1 -- start start 2024-09-12T02:06:44.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f4766a77640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47600afd70 0x7f47600b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:44.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f4766a77640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47600b5f80 0x7f4760155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:44.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f4766a77640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47600cd650 0x7f4760155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:44.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f4766a77640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f47600b0150 con 0x7f47600afd70 2024-09-12T02:06:44.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f4766a77640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f476006fa80 con 0x7f47600b5f80 2024-09-12T02:06:44.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f4766a77640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4760160060 con 0x7f47600cd650 2024-09-12T02:06:44.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f4764813640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47600afd70 0x7f47600b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:44.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f4764813640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47600afd70 0x7f47600b5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51750/0 (socket says 172.21.15.19:51750) 2024-09-12T02:06:44.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f4764813640 1 -- 172.21.15.19:0/3441015779 learned_addr learned my addr 172.21.15.19:0/3441015779 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:44.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f475ffff640 1 --2- 172.21.15.19:0/3441015779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47600b5f80 0x7f4760155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f4765014640 1 --2- 172.21.15.19:0/3441015779 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47600cd650 0x7f4760155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f4764813640 1 -- 172.21.15.19:0/3441015779 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47600cd650 msgr2=0x7f4760155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f4764813640 1 --2- 172.21.15.19:0/3441015779 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47600cd650 0x7f4760155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f4764813640 1 -- 172.21.15.19:0/3441015779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47600b5f80 msgr2=0x7f4760155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f4764813640 1 --2- 172.21.15.19:0/3441015779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47600b5f80 0x7f4760155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f4764813640 1 -- 172.21.15.19:0/3441015779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47601f8760 con 0x7f47600afd70 2024-09-12T02:06:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f4764813640 1 --2- 172.21.15.19:0/3441015779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47600afd70 0x7f47600b5940 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f475000c400 tx=0x7f475000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f475d7fa640 1 -- 172.21.15.19:0/3441015779 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47500052d0 con 0x7f47600afd70 2024-09-12T02:06:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f475d7fa640 1 -- 172.21.15.19:0/3441015779 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4750005490 con 0x7f47600afd70 2024-09-12T02:06:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f4766a77640 1 -- 172.21.15.19:0/3441015779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47601f4390 con 0x7f47600afd70 2024-09-12T02:06:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.844+0000 7f475d7fa640 1 -- 172.21.15.19:0/3441015779 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4750007260 con 0x7f47600afd70 2024-09-12T02:06:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.845+0000 7f4766a77640 1 -- 172.21.15.19:0/3441015779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47601f4950 con 0x7f47600afd70 2024-09-12T02:06:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.846+0000 7f4766a77640 1 -- 172.21.15.19:0/3441015779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47600b63d0 con 0x7f47600afd70 2024-09-12T02:06:44.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.846+0000 7f475d7fa640 1 -- 172.21.15.19:0/3441015779 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4750007400 con 0x7f47600afd70 2024-09-12T02:06:44.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.846+0000 7f475d7fa640 1 --2- 172.21.15.19:0/3441015779 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f474006be30 0x7f474006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:44.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.847+0000 7f475d7fa640 1 -- 172.21.15.19:0/3441015779 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 9571+0+0 (secure 0 0 0) 0x7f475008b310 con 0x7f47600afd70 2024-09-12T02:06:44.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.847+0000 7f475ffff640 1 --2- 172.21.15.19:0/3441015779 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f474006be30 0x7f474006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:44.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.847+0000 7f475ffff640 1 --2- 172.21.15.19:0/3441015779 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f474006be30 0x7f474006e2f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f47600cd4c0 tx=0x7f4748008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:44.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:44.851+0000 7f475d7fa640 1 -- 172.21.15.19:0/3441015779 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4750058d50 con 0x7f47600afd70 2024-09-12T02:06:45.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:45.064+0000 7f4766a77640 1 -- 172.21.15.19:0/3441015779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4760155550 con 0x7f47600afd70 2024-09-12T02:06:45.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:45.065+0000 7f475d7fa640 1 -- 172.21.15.19:0/3441015779 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 319 v319) ==== 95+0+4401 (secure 0 0 0) 0x7f4750058650 con 0x7f47600afd70 2024-09-12T02:06:45.065 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:45.065 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":319,"btime":"2024-09-12T02:06:44:720420+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":319,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:44.720407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":133,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8653":{"gid":8653,"name":"d","rank":0,"incarnation":319,"state":"up:replay","state_seq":1,"addr":"172.21.15.135:6837/2377195932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2377195932},{"type":"v1","addr":"172.21.15.135:6837","nonce":2377195932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:45.065 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 319 2024-09-12T02:06:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:45.067+0000 7f4766a77640 1 -- 172.21.15.19:0/3441015779 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f474006be30 msgr2=0x7f474006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:45.067+0000 7f4766a77640 1 --2- 172.21.15.19:0/3441015779 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f474006be30 0x7f474006e2f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f47600cd4c0 tx=0x7f4748008040 comp rx=0 tx=0).stop 2024-09-12T02:06:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:45.067+0000 7f4766a77640 1 -- 172.21.15.19:0/3441015779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47600afd70 msgr2=0x7f47600b5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:45.067+0000 7f4766a77640 1 --2- 172.21.15.19:0/3441015779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47600afd70 0x7f47600b5940 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f475000c400 tx=0x7f475000c8c0 comp rx=0 tx=0).stop 2024-09-12T02:06:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:45.067+0000 7f4766a77640 1 -- 172.21.15.19:0/3441015779 shutdown_connections 2024-09-12T02:06:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:45.067+0000 7f4766a77640 1 --2- 172.21.15.19:0/3441015779 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f474006be30 0x7f474006e2f0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:45.067+0000 7f4766a77640 1 --2- 172.21.15.19:0/3441015779 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47600cd650 0x7f4760155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:45.067+0000 7f4766a77640 1 --2- 172.21.15.19:0/3441015779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47600b5f80 0x7f4760155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:45.067+0000 7f4766a77640 1 --2- 172.21.15.19:0/3441015779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47600afd70 0x7f47600b5940 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:45.067+0000 7f4766a77640 1 -- 172.21.15.19:0/3441015779 >> 172.21.15.19:0/3441015779 conn(0x7f476006bc10 msgr2=0x7f47600b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:45.068+0000 7f4766a77640 1 -- 172.21.15.19:0/3441015779 shutdown_connections 2024-09-12T02:06:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:45.068+0000 7f4766a77640 1 -- 172.21.15.19:0/3441015779 wait complete. 2024-09-12T02:06:45.078 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-12T02:06:45.456 INFO:tasks.ceph.mds.c.smithi019.stderr: -37> 2024-09-12T02:06:40.705+0000 7fd60e0f5640 -1 log_channel(cluster) log [ERR] : corrupt sessionmap header: Decoder at 'virtual void SessionMapStore::decode_header(ceph::bufferlist&)' v=1 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-09-12T02:06:45.481 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:06:47.734 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:06:47.733+0000 7f06c366c640 -1 mds.0.cache.dir(0x1) Corrupt fnode in dirfrag 0x1: Decoder at 'void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)' v=3 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-09-12T02:06:47.734 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:06:47.734+0000 7f06c366c640 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x1 is fatal because it is a system directory for this rank 2024-09-12T02:06:47.735 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:06:47.735+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:06:47.736 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:06:47.735+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:06:49.899 INFO:tasks.ceph.mds.d.smithi135.stderr:2024-09-12T02:06:49.899+0000 7f06c7674640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:06:50.079 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:50.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.195+0000 7ff6dc9a6640 1 Processor -- start 2024-09-12T02:06:50.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.195+0000 7ff6dc9a6640 1 -- start start 2024-09-12T02:06:50.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.196+0000 7ff6dc9a6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6d80b6690 0x7ff6d81691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.196+0000 7ff6dc9a6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d80d3690 con 0x7ff6d815e5f0 2024-09-12T02:06:50.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.196+0000 7ff6dc9a6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d80d3970 con 0x7ff6d80d30f0 2024-09-12T02:06:50.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.196+0000 7ff6dc9a6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d806d530 con 0x7ff6d80b6690 2024-09-12T02:06:50.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.196+0000 7ff6d659c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff6d815e5f0 0x7ff6d80d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52434/0 (socket says 172.21.15.19:52434) 2024-09-12T02:06:50.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.196+0000 7ff6d659c640 1 -- 172.21.15.19:0/270820516 learned_addr learned my addr 172.21.15.19:0/270820516 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:50.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.197+0000 7ff6d6d9d640 1 --2- 172.21.15.19:0/270820516 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6d80b6690 0x7ff6d81691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:50.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.197+0000 7ff6d559a640 1 -- 172.21.15.19:0/270820516 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 430442531 0 0) 0x7ff6d80d3690 con 0x7ff6d815e5f0 2024-09-12T02:06:50.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.197+0000 7ff6d559a640 1 -- 172.21.15.19:0/270820516 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6c0003520 con 0x7ff6d815e5f0 2024-09-12T02:06:50.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.197+0000 7ff6d559a640 1 -- 172.21.15.19:0/270820516 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1257651221 0 0) 0x7ff6d80d3970 con 0x7ff6d80d30f0 2024-09-12T02:06:50.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.197+0000 7ff6d559a640 1 -- 172.21.15.19:0/270820516 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6d80d3690 con 0x7ff6d80d30f0 2024-09-12T02:06:50.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.197+0000 7ff6d6d9d640 1 -- 172.21.15.19:0/270820516 >> v1:172.21.15.135:6789/0 conn(0x7ff6d80d30f0 legacy=0x7ff6d80b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.197+0000 7ff6d6d9d640 1 -- 172.21.15.19:0/270820516 >> v1:172.21.15.19:6789/0 conn(0x7ff6d815e5f0 legacy=0x7ff6d80d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.197+0000 7ff6d6d9d640 1 -- 172.21.15.19:0/270820516 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d806cee0 con 0x7ff6d80b6690 2024-09-12T02:06:50.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.198+0000 7ff6d6d9d640 1 --2- 172.21.15.19:0/270820516 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6d80b6690 0x7ff6d81691a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009dc0 tx=0x7ff6d002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=499f5f02d5b11056 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:50.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.198+0000 7ff6d559a640 1 -- 172.21.15.19:0/270820516 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0007740 con 0x7ff6d80b6690 2024-09-12T02:06:50.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.198+0000 7ff6d559a640 1 -- 172.21.15.19:0/270820516 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d00078e0 con 0x7ff6d80b6690 2024-09-12T02:06:50.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.198+0000 7ff6d559a640 1 -- 172.21.15.19:0/270820516 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0007cb0 con 0x7ff6d80b6690 2024-09-12T02:06:50.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.198+0000 7ff6dc9a6640 1 -- 172.21.15.19:0/270820516 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6d80b6690 msgr2=0x7ff6d81691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.198+0000 7ff6dc9a6640 1 --2- 172.21.15.19:0/270820516 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6d80b6690 0x7ff6d81691a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009dc0 tx=0x7ff6d002a6d0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.199+0000 7ff6dc9a6640 1 -- 172.21.15.19:0/270820516 shutdown_connections 2024-09-12T02:06:50.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.199+0000 7ff6dc9a6640 1 --2- 172.21.15.19:0/270820516 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6d80b6690 0x7ff6d81691a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.199+0000 7ff6dc9a6640 1 -- 172.21.15.19:0/270820516 >> 172.21.15.19:0/270820516 conn(0x7ff6d808bfc0 msgr2=0x7ff6d80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:50.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.199+0000 7ff6dc9a6640 1 -- 172.21.15.19:0/270820516 shutdown_connections 2024-09-12T02:06:50.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.199+0000 7ff6dc9a6640 1 -- 172.21.15.19:0/270820516 wait complete. 2024-09-12T02:06:50.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.200+0000 7ff6dc9a6640 1 Processor -- start 2024-09-12T02:06:50.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.200+0000 7ff6dc9a6640 1 -- start start 2024-09-12T02:06:50.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6dc9a6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6d80b6690 0x7ff6d8157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6dc9a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d80d30f0 0x7ff6d815f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6dc9a6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6d815e5f0 0x7ff6d81610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6dc9a6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d806e9d0 con 0x7ff6d80d30f0 2024-09-12T02:06:50.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6dc9a6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d815e9d0 con 0x7ff6d815e5f0 2024-09-12T02:06:50.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6dc9a6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d806eb50 con 0x7ff6d80b6690 2024-09-12T02:06:50.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6d5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d80d30f0 0x7ff6d815f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:50.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6d5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d80d30f0 0x7ff6d815f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51776/0 (socket says 172.21.15.19:51776) 2024-09-12T02:06:50.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6d5d9b640 1 -- 172.21.15.19:0/3732314798 learned_addr learned my addr 172.21.15.19:0/3732314798 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:50.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6d659c640 1 --2- 172.21.15.19:0/3732314798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6d80b6690 0x7ff6d8157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:50.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6d6d9d640 1 --2- 172.21.15.19:0/3732314798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6d815e5f0 0x7ff6d81610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:50.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6d5d9b640 1 -- 172.21.15.19:0/3732314798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6d80b6690 msgr2=0x7ff6d8157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6d5d9b640 1 --2- 172.21.15.19:0/3732314798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6d80b6690 0x7ff6d8157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6d5d9b640 1 -- 172.21.15.19:0/3732314798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6d815e5f0 msgr2=0x7ff6d81610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6d5d9b640 1 --2- 172.21.15.19:0/3732314798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6d815e5f0 0x7ff6d81610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6d5d9b640 1 -- 172.21.15.19:0/3732314798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d80cb220 con 0x7ff6d80d30f0 2024-09-12T02:06:50.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6d659c640 1 --2- 172.21.15.19:0/3732314798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6d80b6690 0x7ff6d8157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:50.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6d6d9d640 1 --2- 172.21.15.19:0/3732314798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6d815e5f0 0x7ff6d81610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:50.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.201+0000 7ff6d5d9b640 1 --2- 172.21.15.19:0/3732314798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d80d30f0 0x7ff6d815f440 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00c530 tx=0x7ff6cc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:50.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.202+0000 7ff6c6ffd640 1 -- 172.21.15.19:0/3732314798 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0052d0 con 0x7ff6d80d30f0 2024-09-12T02:06:50.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.202+0000 7ff6c6ffd640 1 -- 172.21.15.19:0/3732314798 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6cc005490 con 0x7ff6d80d30f0 2024-09-12T02:06:50.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.202+0000 7ff6c6ffd640 1 -- 172.21.15.19:0/3732314798 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc012870 con 0x7ff6d80d30f0 2024-09-12T02:06:50.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.202+0000 7ff6dc9a6640 1 -- 172.21.15.19:0/3732314798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d80b96c0 con 0x7ff6d80d30f0 2024-09-12T02:06:50.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.202+0000 7ff6dc9a6640 1 -- 172.21.15.19:0/3732314798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d80b9c80 con 0x7ff6d80d30f0 2024-09-12T02:06:50.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.203+0000 7ff6dc9a6640 1 -- 172.21.15.19:0/3732314798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6d80b5f80 con 0x7ff6d80d30f0 2024-09-12T02:06:50.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.203+0000 7ff6c6ffd640 1 -- 172.21.15.19:0/3732314798 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6cc012a10 con 0x7ff6d80d30f0 2024-09-12T02:06:50.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.204+0000 7ff6c6ffd640 1 --2- 172.21.15.19:0/3732314798 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff6b806be30 0x7ff6b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.204+0000 7ff6c6ffd640 1 -- 172.21.15.19:0/3732314798 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 9657+0+0 (secure 0 0 0) 0x7ff6cc08ba50 con 0x7ff6d80d30f0 2024-09-12T02:06:50.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.204+0000 7ff6d659c640 1 --2- 172.21.15.19:0/3732314798 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff6b806be30 0x7ff6b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:50.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.205+0000 7ff6d659c640 1 --2- 172.21.15.19:0/3732314798 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff6b806be30 0x7ff6b806e2f0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8007fd0 tx=0x7ff6c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:50.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.208+0000 7ff6c6ffd640 1 -- 172.21.15.19:0/3732314798 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff6d80cb220 con 0x7ff6d80d30f0 2024-09-12T02:06:50.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.419+0000 7ff6dc9a6640 1 -- 172.21.15.19:0/3732314798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6d80b4450 con 0x7ff6d80d30f0 2024-09-12T02:06:50.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.419+0000 7ff6c6ffd640 1 -- 172.21.15.19:0/3732314798 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 323 v323) ==== 95+0+4390 (secure 0 0 0) 0x7ff6cc059450 con 0x7ff6d80d30f0 2024-09-12T02:06:50.419 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:50.419 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":323,"btime":"2024-09-12T02:06:47:735956+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":10488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3905580508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3905580508},{"type":"v1","addr":"172.21.15.19:6834","nonce":3905580508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":320}],"filesystems":[{"mdsmap":{"epoch":323,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:47.735952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:50.419 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 323 2024-09-12T02:06:50.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.421+0000 7ff6dc9a6640 1 -- 172.21.15.19:0/3732314798 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff6b806be30 msgr2=0x7ff6b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.421+0000 7ff6dc9a6640 1 --2- 172.21.15.19:0/3732314798 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff6b806be30 0x7ff6b806e2f0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8007fd0 tx=0x7ff6c8009040 comp rx=0 tx=0).stop 2024-09-12T02:06:50.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.421+0000 7ff6dc9a6640 1 -- 172.21.15.19:0/3732314798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d80d30f0 msgr2=0x7ff6d815f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.421+0000 7ff6dc9a6640 1 --2- 172.21.15.19:0/3732314798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d80d30f0 0x7ff6d815f440 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00c530 tx=0x7ff6cc00c9f0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.421+0000 7ff6dc9a6640 1 -- 172.21.15.19:0/3732314798 shutdown_connections 2024-09-12T02:06:50.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.421+0000 7ff6dc9a6640 1 --2- 172.21.15.19:0/3732314798 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff6b806be30 0x7ff6b806e2f0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.421+0000 7ff6dc9a6640 1 --2- 172.21.15.19:0/3732314798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6d815e5f0 0x7ff6d81610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.421+0000 7ff6dc9a6640 1 --2- 172.21.15.19:0/3732314798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d80d30f0 0x7ff6d815f440 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.421+0000 7ff6dc9a6640 1 --2- 172.21.15.19:0/3732314798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6d80b6690 0x7ff6d8157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.421+0000 7ff6dc9a6640 1 -- 172.21.15.19:0/3732314798 >> 172.21.15.19:0/3732314798 conn(0x7ff6d808bfc0 msgr2=0x7ff6d80cf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:50.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.422+0000 7ff6dc9a6640 1 -- 172.21.15.19:0/3732314798 shutdown_connections 2024-09-12T02:06:50.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.422+0000 7ff6dc9a6640 1 -- 172.21.15.19:0/3732314798 wait complete. 2024-09-12T02:06:50.432 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:06:50.432 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:50.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.535+0000 7f390affd640 1 Processor -- start 2024-09-12T02:06:50.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.535+0000 7f390affd640 1 -- start start 2024-09-12T02:06:50.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.536+0000 7f390affd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f390415e5d0 0x7f39040d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.536+0000 7f390affd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f390409b140 0x7f3904168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.536+0000 7f390affd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f390406cec0 con 0x7f390406df60 2024-09-12T02:06:50.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.536+0000 7f390affd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f390406dad0 con 0x7f390415e5d0 2024-09-12T02:06:50.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.536+0000 7f390affd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f390406d1a0 con 0x7f390409b140 2024-09-12T02:06:50.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.536+0000 7f3908d99640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f390415e5d0 0x7f39040d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:50.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.536+0000 7f3903fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f390406df60 0x7f390409aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52444/0 (socket says 172.21.15.19:52444) 2024-09-12T02:06:50.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.536+0000 7f3903fff640 1 -- 172.21.15.19:0/3501457518 learned_addr learned my addr 172.21.15.19:0/3501457518 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:50.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.537+0000 7f390959a640 1 --2- 172.21.15.19:0/3501457518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f390409b140 0x7f3904168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:50.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.537+0000 7f3908d99640 1 -- 172.21.15.19:0/3501457518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f390409b140 msgr2=0x7f3904168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:50.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.537+0000 7f3908d99640 1 --2- 172.21.15.19:0/3501457518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f390409b140 0x7f3904168560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.537+0000 7f3908d99640 1 -- 172.21.15.19:0/3501457518 >> v1:172.21.15.19:6789/0 conn(0x7f390406df60 legacy=0x7f390409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.537+0000 7f3908d99640 1 -- 172.21.15.19:0/3501457518 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390406d480 con 0x7f390415e5d0 2024-09-12T02:06:50.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.537+0000 7f39037fe640 1 -- 172.21.15.19:0/3501457518 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1757331451 0 0) 0x7f390406cec0 con 0x7f390406df60 2024-09-12T02:06:50.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.537+0000 7f3908d99640 1 --2- 172.21.15.19:0/3501457518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f390415e5d0 0x7f39040d10f0 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009d90 tx=0x7f38fc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea08986c0cbad58 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:50.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.537+0000 7f39037fe640 1 -- 172.21.15.19:0/3501457518 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc007740 con 0x7f390415e5d0 2024-09-12T02:06:50.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.538+0000 7f39037fe640 1 -- 172.21.15.19:0/3501457518 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38fc0078e0 con 0x7f390415e5d0 2024-09-12T02:06:50.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.538+0000 7f39037fe640 1 -- 172.21.15.19:0/3501457518 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc007cb0 con 0x7f390415e5d0 2024-09-12T02:06:50.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.538+0000 7f390affd640 1 -- 172.21.15.19:0/3501457518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f390415e5d0 msgr2=0x7f39040d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.538+0000 7f390affd640 1 --2- 172.21.15.19:0/3501457518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f390415e5d0 0x7f39040d10f0 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009d90 tx=0x7f38fc02a6f0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.538+0000 7f390affd640 1 -- 172.21.15.19:0/3501457518 shutdown_connections 2024-09-12T02:06:50.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.538+0000 7f390affd640 1 --2- 172.21.15.19:0/3501457518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f390409b140 0x7f3904168560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.538+0000 7f390affd640 1 --2- 172.21.15.19:0/3501457518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f390415e5d0 0x7f39040d10f0 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.538+0000 7f390affd640 1 -- 172.21.15.19:0/3501457518 >> 172.21.15.19:0/3501457518 conn(0x7f39040d23a0 msgr2=0x7f39040d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:50.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.538+0000 7f390affd640 1 -- 172.21.15.19:0/3501457518 shutdown_connections 2024-09-12T02:06:50.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.538+0000 7f390affd640 1 -- 172.21.15.19:0/3501457518 wait complete. 2024-09-12T02:06:50.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.539+0000 7f390affd640 1 Processor -- start 2024-09-12T02:06:50.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.539+0000 7f390affd640 1 -- start start 2024-09-12T02:06:50.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.540+0000 7f390affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f390406df60 0x7f39041537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.540+0000 7f390affd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f390409b140 0x7f39040b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.540+0000 7f390affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f390415e5d0 0x7f3904155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.540+0000 7f390affd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f390415eb30 con 0x7f390406df60 2024-09-12T02:06:50.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.540+0000 7f390affd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f390415e9b0 con 0x7f390415e5d0 2024-09-12T02:06:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.540+0000 7f390affd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f39040d1630 con 0x7f390409b140 2024-09-12T02:06:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.540+0000 7f3908d99640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f390406df60 0x7f39041537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.540+0000 7f3908d99640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f390406df60 0x7f39041537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51794/0 (socket says 172.21.15.19:51794) 2024-09-12T02:06:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.540+0000 7f3908d99640 1 -- 172.21.15.19:0/1661712947 learned_addr learned my addr 172.21.15.19:0/1661712947 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.541+0000 7f390959a640 1 --2- 172.21.15.19:0/1661712947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f390415e5d0 0x7f3904155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.541+0000 7f3903fff640 1 --2- 172.21.15.19:0/1661712947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f390409b140 0x7f39040b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.541+0000 7f3908d99640 1 -- 172.21.15.19:0/1661712947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f390409b140 msgr2=0x7f39040b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.541+0000 7f3908d99640 1 --2- 172.21.15.19:0/1661712947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f390409b140 0x7f39040b0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.541+0000 7f3908d99640 1 -- 172.21.15.19:0/1661712947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f390415e5d0 msgr2=0x7f3904155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.541+0000 7f3908d99640 1 --2- 172.21.15.19:0/1661712947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f390415e5d0 0x7f3904155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.541+0000 7f3908d99640 1 -- 172.21.15.19:0/1661712947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39040c6050 con 0x7f390406df60 2024-09-12T02:06:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.541+0000 7f3908d99640 1 --2- 172.21.15.19:0/1661712947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f390406df60 0x7f39041537e0 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009d90 tx=0x7f38fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.541+0000 7f39017fa640 1 -- 172.21.15.19:0/1661712947 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc03f070 con 0x7f390406df60 2024-09-12T02:06:50.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.541+0000 7f39017fa640 1 -- 172.21.15.19:0/1661712947 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38fc031c40 con 0x7f390406df60 2024-09-12T02:06:50.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.541+0000 7f39017fa640 1 -- 172.21.15.19:0/1661712947 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc043410 con 0x7f390406df60 2024-09-12T02:06:50.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.541+0000 7f390affd640 1 -- 172.21.15.19:0/1661712947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39040c6330 con 0x7f390406df60 2024-09-12T02:06:50.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.541+0000 7f390affd640 1 -- 172.21.15.19:0/1661712947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39040c6e10 con 0x7f390406df60 2024-09-12T02:06:50.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.542+0000 7f390affd640 1 -- 172.21.15.19:0/1661712947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39040d10f0 con 0x7f390406df60 2024-09-12T02:06:50.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.543+0000 7f39017fa640 1 -- 172.21.15.19:0/1661712947 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38fc0435b0 con 0x7f390406df60 2024-09-12T02:06:50.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.543+0000 7f39017fa640 1 --2- 172.21.15.19:0/1661712947 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f38f006be30 0x7f38f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.544+0000 7f39017fa640 1 -- 172.21.15.19:0/1661712947 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 9657+0+0 (secure 0 0 0) 0x7f38fc0ad2d0 con 0x7f390406df60 2024-09-12T02:06:50.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.544+0000 7f3903fff640 1 --2- 172.21.15.19:0/1661712947 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f38f006be30 0x7f38f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:50.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.544+0000 7f3903fff640 1 --2- 172.21.15.19:0/1661712947 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f38f006be30 0x7f38f006e2f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f38f8007fd0 tx=0x7f38f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.548+0000 7f39017fa640 1 -- 172.21.15.19:0/1661712947 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f38fc07acd0 con 0x7f390406df60 2024-09-12T02:06:50.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.762+0000 7f390affd640 1 -- 172.21.15.19:0/1661712947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39040b8320 con 0x7f390406df60 2024-09-12T02:06:50.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.763+0000 7f39017fa640 1 -- 172.21.15.19:0/1661712947 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 323 v323) ==== 95+0+4390 (secure 0 0 0) 0x7f38fc07a5d0 con 0x7f390406df60 2024-09-12T02:06:50.762 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:50.762 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":323,"btime":"2024-09-12T02:06:47:735956+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":10488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3905580508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3905580508},{"type":"v1","addr":"172.21.15.19:6834","nonce":3905580508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":320}],"filesystems":[{"mdsmap":{"epoch":323,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:47.735952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:50.763 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 323 2024-09-12T02:06:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.765+0000 7f390affd640 1 -- 172.21.15.19:0/1661712947 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f38f006be30 msgr2=0x7f38f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.765+0000 7f390affd640 1 --2- 172.21.15.19:0/1661712947 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f38f006be30 0x7f38f006e2f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f38f8007fd0 tx=0x7f38f8009040 comp rx=0 tx=0).stop 2024-09-12T02:06:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.765+0000 7f390affd640 1 -- 172.21.15.19:0/1661712947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f390406df60 msgr2=0x7f39041537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.765+0000 7f390affd640 1 --2- 172.21.15.19:0/1661712947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f390406df60 0x7f39041537e0 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009d90 tx=0x7f38fc004a40 comp rx=0 tx=0).stop 2024-09-12T02:06:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.765+0000 7f390affd640 1 -- 172.21.15.19:0/1661712947 shutdown_connections 2024-09-12T02:06:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.765+0000 7f390affd640 1 --2- 172.21.15.19:0/1661712947 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f38f006be30 0x7f38f006e2f0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.765+0000 7f390affd640 1 --2- 172.21.15.19:0/1661712947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f390415e5d0 0x7f3904155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.765+0000 7f390affd640 1 --2- 172.21.15.19:0/1661712947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f390409b140 0x7f39040b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.765+0000 7f390affd640 1 --2- 172.21.15.19:0/1661712947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f390406df60 0x7f39041537e0 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.765+0000 7f390affd640 1 -- 172.21.15.19:0/1661712947 >> 172.21.15.19:0/1661712947 conn(0x7f39040d23a0 msgr2=0x7f39040b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:50.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.765+0000 7f390affd640 1 -- 172.21.15.19:0/1661712947 shutdown_connections 2024-09-12T02:06:50.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.765+0000 7f390affd640 1 -- 172.21.15.19:0/1661712947 wait complete. 2024-09-12T02:06:50.775 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:06:50.775 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:50.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.877+0000 7fe955ee6640 1 Processor -- start 2024-09-12T02:06:50.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.878+0000 7fe955ee6640 1 -- start start 2024-09-12T02:06:50.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.878+0000 7fe955ee6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe950161c80 0x7fe95006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.878+0000 7fe955ee6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe950162060 0x7fe9500b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.878+0000 7fe955ee6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe95006e870 con 0x7fe9500b64b0 2024-09-12T02:06:50.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.878+0000 7fe955ee6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fe95006d9f0 con 0x7fe950162060 2024-09-12T02:06:50.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.878+0000 7fe955ee6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe95006dcd0 con 0x7fe950161c80 2024-09-12T02:06:50.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.879+0000 7fe94effd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe950162060 0x7fe9500b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:50.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.879+0000 7fe94effd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe950162060 0x7fe9500b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51810/0 (socket says 172.21.15.19:51810) 2024-09-12T02:06:50.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.879+0000 7fe94effd640 1 -- 172.21.15.19:0/2742692224 learned_addr learned my addr 172.21.15.19:0/2742692224 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:50.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.879+0000 7fe94ffff640 1 --1- 172.21.15.19:0/2742692224 >> v1:172.21.15.19:6789/0 conn(0x7fe9500b64b0 0x7fe950162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52456/0 (socket says 172.21.15.19:52456) 2024-09-12T02:06:50.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.879+0000 7fe94f7fe640 1 --2- 172.21.15.19:0/2742692224 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe950161c80 0x7fe95006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:50.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.879+0000 7fe94effd640 1 -- 172.21.15.19:0/2742692224 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe950161c80 msgr2=0x7fe95006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:50.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.879+0000 7fe94effd640 1 --2- 172.21.15.19:0/2742692224 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe950161c80 0x7fe95006e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.879+0000 7fe94effd640 1 -- 172.21.15.19:0/2742692224 >> v1:172.21.15.19:6789/0 conn(0x7fe9500b64b0 legacy=0x7fe950162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.879+0000 7fe94e7fc640 1 -- 172.21.15.19:0/2742692224 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 95668515 0 0) 0x7fe948001490 con 0x7fe9500b64b0 2024-09-12T02:06:50.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.879+0000 7fe94effd640 1 -- 172.21.15.19:0/2742692224 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95006dfb0 con 0x7fe950162060 2024-09-12T02:06:50.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.879+0000 7fe94f7fe640 1 --2- 172.21.15.19:0/2742692224 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe950161c80 0x7fe95006e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:50.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.880+0000 7fe94effd640 1 --2- 172.21.15.19:0/2742692224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe950162060 0x7fe9500b5f70 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7fe944009870 tx=0x7fe94402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c752bbccf527cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:50.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.880+0000 7fe94e7fc640 1 -- 172.21.15.19:0/2742692224 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944037070 con 0x7fe950162060 2024-09-12T02:06:50.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.880+0000 7fe94e7fc640 1 -- 172.21.15.19:0/2742692224 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe944032440 con 0x7fe950162060 2024-09-12T02:06:50.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.880+0000 7fe94e7fc640 1 -- 172.21.15.19:0/2742692224 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944032810 con 0x7fe950162060 2024-09-12T02:06:50.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.880+0000 7fe955ee6640 1 -- 172.21.15.19:0/2742692224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe950162060 msgr2=0x7fe9500b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.880+0000 7fe955ee6640 1 --2- 172.21.15.19:0/2742692224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe950162060 0x7fe9500b5f70 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7fe944009870 tx=0x7fe94402a270 comp rx=0 tx=0).stop 2024-09-12T02:06:50.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.880+0000 7fe955ee6640 1 -- 172.21.15.19:0/2742692224 shutdown_connections 2024-09-12T02:06:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.880+0000 7fe955ee6640 1 --2- 172.21.15.19:0/2742692224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe950162060 0x7fe9500b5f70 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.880+0000 7fe955ee6640 1 --2- 172.21.15.19:0/2742692224 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe950161c80 0x7fe95006e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.880+0000 7fe955ee6640 1 -- 172.21.15.19:0/2742692224 >> 172.21.15.19:0/2742692224 conn(0x7fe9500d44f0 msgr2=0x7fe9500d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.880+0000 7fe955ee6640 1 -- 172.21.15.19:0/2742692224 shutdown_connections 2024-09-12T02:06:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.880+0000 7fe955ee6640 1 -- 172.21.15.19:0/2742692224 wait complete. 2024-09-12T02:06:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.882+0000 7fe955ee6640 1 Processor -- start 2024-09-12T02:06:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.882+0000 7fe955ee6640 1 -- start start 2024-09-12T02:06:50.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe955ee6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9500b64b0 0x7fe9500b9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe955ee6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe950161c80 0x7fe9500ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe955ee6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe950162060 0x7fe9500b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe955ee6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe9500d2a10 con 0x7fe9500b64b0 2024-09-12T02:06:50.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe955ee6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe9500d2890 con 0x7fe950162060 2024-09-12T02:06:50.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe955ee6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe9500b6960 con 0x7fe950161c80 2024-09-12T02:06:50.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe94f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9500b64b0 0x7fe9500b9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:50.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe94f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9500b64b0 0x7fe9500b9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51812/0 (socket says 172.21.15.19:51812) 2024-09-12T02:06:50.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe94f7fe640 1 -- 172.21.15.19:0/4273880096 learned_addr learned my addr 172.21.15.19:0/4273880096 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:50.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe94f7fe640 1 -- 172.21.15.19:0/4273880096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe950161c80 msgr2=0x7fe9500ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe94f7fe640 1 --2- 172.21.15.19:0/4273880096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe950161c80 0x7fe9500ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe94f7fe640 1 -- 172.21.15.19:0/4273880096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe950162060 msgr2=0x7fe9500b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe94f7fe640 1 --2- 172.21.15.19:0/4273880096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe950162060 0x7fe9500b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe94f7fe640 1 -- 172.21.15.19:0/4273880096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9500cb760 con 0x7fe9500b64b0 2024-09-12T02:06:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe94f7fe640 1 --2- 172.21.15.19:0/4273880096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9500b64b0 0x7fe9500b9a20 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7fe94000c7f0 tx=0x7fe94000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe937fff640 1 -- 172.21.15.19:0/4273880096 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe940015070 con 0x7fe9500b64b0 2024-09-12T02:06:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe937fff640 1 -- 172.21.15.19:0/4273880096 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9400079d0 con 0x7fe9500b64b0 2024-09-12T02:06:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe955ee6640 1 -- 172.21.15.19:0/4273880096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9500cba40 con 0x7fe9500b64b0 2024-09-12T02:06:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe937fff640 1 -- 172.21.15.19:0/4273880096 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe940007da0 con 0x7fe9500b64b0 2024-09-12T02:06:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.883+0000 7fe955ee6640 1 -- 172.21.15.19:0/4273880096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9500cc000 con 0x7fe9500b64b0 2024-09-12T02:06:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.884+0000 7fe955ee6640 1 -- 172.21.15.19:0/4273880096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9500d0d80 con 0x7fe9500b64b0 2024-09-12T02:06:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.885+0000 7fe937fff640 1 -- 172.21.15.19:0/4273880096 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe940018070 con 0x7fe9500b64b0 2024-09-12T02:06:50.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.885+0000 7fe937fff640 1 --2- 172.21.15.19:0/4273880096 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe93c06be60 0x7fe93c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.885+0000 7fe937fff640 1 -- 172.21.15.19:0/4273880096 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 9657+0+0 (secure 0 0 0) 0x7fe94008be00 con 0x7fe9500b64b0 2024-09-12T02:06:50.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.886+0000 7fe94effd640 1 --2- 172.21.15.19:0/4273880096 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe93c06be60 0x7fe93c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:50.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.886+0000 7fe94effd640 1 --2- 172.21.15.19:0/4273880096 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe93c06be60 0x7fe93c06e320 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe944034000 tx=0x7fe94402c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:50.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:50.889+0000 7fe937fff640 1 -- 172.21.15.19:0/4273880096 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9500d0d80 con 0x7fe9500b64b0 2024-09-12T02:06:51.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.104+0000 7fe955ee6640 1 -- 172.21.15.19:0/4273880096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9500ba470 con 0x7fe9500b64b0 2024-09-12T02:06:51.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.105+0000 7fe937fff640 1 -- 172.21.15.19:0/4273880096 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 323 v323) ==== 95+0+4390 (secure 0 0 0) 0x7fe940059760 con 0x7fe9500b64b0 2024-09-12T02:06:51.105 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:51.105 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":323,"btime":"2024-09-12T02:06:47:735956+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":10488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3905580508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3905580508},{"type":"v1","addr":"172.21.15.19:6834","nonce":3905580508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":320}],"filesystems":[{"mdsmap":{"epoch":323,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:47.735952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:51.105 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 323 2024-09-12T02:06:51.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.107+0000 7fe955ee6640 1 -- 172.21.15.19:0/4273880096 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe93c06be60 msgr2=0x7fe93c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.107+0000 7fe955ee6640 1 --2- 172.21.15.19:0/4273880096 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe93c06be60 0x7fe93c06e320 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe944034000 tx=0x7fe94402c000 comp rx=0 tx=0).stop 2024-09-12T02:06:51.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.107+0000 7fe955ee6640 1 -- 172.21.15.19:0/4273880096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9500b64b0 msgr2=0x7fe9500b9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.107+0000 7fe955ee6640 1 --2- 172.21.15.19:0/4273880096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9500b64b0 0x7fe9500b9a20 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7fe94000c7f0 tx=0x7fe94000cbf0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.107+0000 7fe955ee6640 1 -- 172.21.15.19:0/4273880096 shutdown_connections 2024-09-12T02:06:51.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.107+0000 7fe955ee6640 1 --2- 172.21.15.19:0/4273880096 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe93c06be60 0x7fe93c06e320 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.107+0000 7fe955ee6640 1 --2- 172.21.15.19:0/4273880096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe950162060 0x7fe9500b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.107+0000 7fe955ee6640 1 --2- 172.21.15.19:0/4273880096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe950161c80 0x7fe9500ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.107+0000 7fe955ee6640 1 --2- 172.21.15.19:0/4273880096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9500b64b0 0x7fe9500b9a20 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.107+0000 7fe955ee6640 1 -- 172.21.15.19:0/4273880096 >> 172.21.15.19:0/4273880096 conn(0x7fe9500d44f0 msgr2=0x7fe9500d3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:51.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.107+0000 7fe955ee6640 1 -- 172.21.15.19:0/4273880096 shutdown_connections 2024-09-12T02:06:51.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.107+0000 7fe955ee6640 1 -- 172.21.15.19:0/4273880096 wait complete. 2024-09-12T02:06:51.117 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap header on 1.00000000' led to DAMAGED state 2024-09-12T02:06:51.117 INFO:tasks.cephfs.test_damage:All 39 mutations had expected outcomes 2024-09-12T02:06:51.118 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:06:51.118 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:06:51.163 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:06:51.204 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:06:51.205 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:06:51.205 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:06:51.205 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:06:51.221 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:06:51.221 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:06:51.221 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T02:06:51.221 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:06:51.264 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:06:51.264 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:06:51.264 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:06:51.264 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:06:51.280 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:06:51.280 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:06:51.280 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T02:06:51.280 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:06:51.322 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:06:51.322 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:51.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.425+0000 7fb872a4c640 1 Processor -- start 2024-09-12T02:06:51.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.425+0000 7fb872a4c640 1 -- start start 2024-09-12T02:06:51.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.426+0000 7fb872a4c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb86c0b6680 0x7fb86c169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:51.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.426+0000 7fb872a4c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb86c06d9f0 con 0x7fb86c162060 2024-09-12T02:06:51.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.426+0000 7fb872a4c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb86c06dcd0 con 0x7fb86c161c80 2024-09-12T02:06:51.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.426+0000 7fb872a4c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb86c06dfb0 con 0x7fb86c0b6680 2024-09-12T02:06:51.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.426+0000 7fb870fe9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb86c0b6680 0x7fb86c169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:51.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.426+0000 7fb86b7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb86c162060 0x7fb86c0b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52004/0 (socket says 172.21.15.19:52004) 2024-09-12T02:06:51.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.426+0000 7fb870fe9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb86c0b6680 0x7fb86c169830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41998/0 (socket says 172.21.15.19:41998) 2024-09-12T02:06:51.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.427+0000 7fb86b7fe640 1 -- 172.21.15.19:0/1878673651 learned_addr learned my addr 172.21.15.19:0/1878673651 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:51.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.427+0000 7fb870fe9640 1 -- 172.21.15.19:0/1878673651 >> v1:172.21.15.135:6789/0 conn(0x7fb86c161c80 legacy=0x7fb86c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:51.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.427+0000 7fb870fe9640 1 -- 172.21.15.19:0/1878673651 >> v1:172.21.15.19:6789/0 conn(0x7fb86c162060 legacy=0x7fb86c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.427+0000 7fb870fe9640 1 -- 172.21.15.19:0/1878673651 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86c0d01f0 con 0x7fb86c0b6680 2024-09-12T02:06:51.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.427+0000 7fb86affd640 1 -- 172.21.15.19:0/1878673651 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3357035691 0 0) 0x7fb86c06d9f0 con 0x7fb86c162060 2024-09-12T02:06:51.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.428+0000 7fb870fe9640 1 --2- 172.21.15.19:0/1878673651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb86c0b6680 0x7fb86c169830 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7fb864009d90 tx=0x7fb86402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb0edfb74eef9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:51.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.428+0000 7fb86affd640 1 -- 172.21.15.19:0/1878673651 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb864007740 con 0x7fb86c0b6680 2024-09-12T02:06:51.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.428+0000 7fb86affd640 1 -- 172.21.15.19:0/1878673651 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8640078e0 con 0x7fb86c0b6680 2024-09-12T02:06:51.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.428+0000 7fb86affd640 1 -- 172.21.15.19:0/1878673651 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb864007cb0 con 0x7fb86c0b6680 2024-09-12T02:06:51.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.428+0000 7fb872a4c640 1 -- 172.21.15.19:0/1878673651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb86c0b6680 msgr2=0x7fb86c169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.428+0000 7fb872a4c640 1 --2- 172.21.15.19:0/1878673651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb86c0b6680 0x7fb86c169830 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7fb864009d90 tx=0x7fb86402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.428+0000 7fb872a4c640 1 -- 172.21.15.19:0/1878673651 shutdown_connections 2024-09-12T02:06:51.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.428+0000 7fb872a4c640 1 --2- 172.21.15.19:0/1878673651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb86c0b6680 0x7fb86c169830 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.428+0000 7fb872a4c640 1 -- 172.21.15.19:0/1878673651 >> 172.21.15.19:0/1878673651 conn(0x7fb86c0d44f0 msgr2=0x7fb86c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:51.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.428+0000 7fb872a4c640 1 -- 172.21.15.19:0/1878673651 shutdown_connections 2024-09-12T02:06:51.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.428+0000 7fb872a4c640 1 -- 172.21.15.19:0/1878673651 wait complete. 2024-09-12T02:06:51.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.429+0000 7fb872a4c640 1 Processor -- start 2024-09-12T02:06:51.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.430+0000 7fb872a4c640 1 -- start start 2024-09-12T02:06:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.430+0000 7fb872a4c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb86c0b6680 0x7fb86c0cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.430+0000 7fb872a4c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb86c161c80 0x7fb86c0b9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.430+0000 7fb872a4c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb86c162060 0x7fb86c0cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.430+0000 7fb872a4c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c0b6cb0 con 0x7fb86c161c80 2024-09-12T02:06:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.430+0000 7fb872a4c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c0b6b30 con 0x7fb86c162060 2024-09-12T02:06:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.430+0000 7fb872a4c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb86c169d70 con 0x7fb86c0b6680 2024-09-12T02:06:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.430+0000 7fb86b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb86c161c80 0x7fb86c0b9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.431+0000 7fb86b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb86c161c80 0x7fb86c0b9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42004/0 (socket says 172.21.15.19:42004) 2024-09-12T02:06:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.431+0000 7fb86b7fe640 1 -- 172.21.15.19:0/2306262473 learned_addr learned my addr 172.21.15.19:0/2306262473 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.431+0000 7fb870fe9640 1 --2- 172.21.15.19:0/2306262473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb86c162060 0x7fb86c0cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.431+0000 7fb86bfff640 1 --2- 172.21.15.19:0/2306262473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb86c0b6680 0x7fb86c0cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:51.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.431+0000 7fb86b7fe640 1 -- 172.21.15.19:0/2306262473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb86c0b6680 msgr2=0x7fb86c0cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.431+0000 7fb86b7fe640 1 --2- 172.21.15.19:0/2306262473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb86c0b6680 0x7fb86c0cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.431+0000 7fb86b7fe640 1 -- 172.21.15.19:0/2306262473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb86c162060 msgr2=0x7fb86c0cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.431+0000 7fb86b7fe640 1 --2- 172.21.15.19:0/2306262473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb86c162060 0x7fb86c0cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.431+0000 7fb86b7fe640 1 -- 172.21.15.19:0/2306262473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86c0c8490 con 0x7fb86c161c80 2024-09-12T02:06:51.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.431+0000 7fb86b7fe640 1 --2- 172.21.15.19:0/2306262473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb86c161c80 0x7fb86c0b9480 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7fb86000c4b0 tx=0x7fb86000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:51.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.431+0000 7fb868ff9640 1 -- 172.21.15.19:0/2306262473 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb860018070 con 0x7fb86c161c80 2024-09-12T02:06:51.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.431+0000 7fb868ff9640 1 -- 172.21.15.19:0/2306262473 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb860007500 con 0x7fb86c161c80 2024-09-12T02:06:51.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.431+0000 7fb868ff9640 1 -- 172.21.15.19:0/2306262473 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb860004a20 con 0x7fb86c161c80 2024-09-12T02:06:51.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.431+0000 7fb872a4c640 1 -- 172.21.15.19:0/2306262473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb86c0c8770 con 0x7fb86c161c80 2024-09-12T02:06:51.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.431+0000 7fb872a4c640 1 -- 172.21.15.19:0/2306262473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb86c0c8d30 con 0x7fb86c161c80 2024-09-12T02:06:51.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.432+0000 7fb872a4c640 1 -- 172.21.15.19:0/2306262473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb86c0b5f70 con 0x7fb86c161c80 2024-09-12T02:06:51.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.433+0000 7fb868ff9640 1 -- 172.21.15.19:0/2306262473 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb86001b070 con 0x7fb86c161c80 2024-09-12T02:06:51.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.433+0000 7fb868ff9640 1 --2- 172.21.15.19:0/2306262473 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb85806be60 0x7fb85806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:51.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.433+0000 7fb868ff9640 1 -- 172.21.15.19:0/2306262473 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 9657+0+0 (secure 0 0 0) 0x7fb86008b210 con 0x7fb86c161c80 2024-09-12T02:06:51.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.434+0000 7fb86bfff640 1 --2- 172.21.15.19:0/2306262473 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb85806be60 0x7fb85806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:51.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.434+0000 7fb86bfff640 1 --2- 172.21.15.19:0/2306262473 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb85806be60 0x7fb85806e320 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb85c006fd0 tx=0x7fb85c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:51.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.438+0000 7fb868ff9640 1 -- 172.21.15.19:0/2306262473 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb860058bd0 con 0x7fb86c161c80 2024-09-12T02:06:51.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.648+0000 7fb872a4c640 1 -- 172.21.15.19:0/2306262473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb86c0d1470 con 0x7fb86c161c80 2024-09-12T02:06:51.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.649+0000 7fb868ff9640 1 -- 172.21.15.19:0/2306262473 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 323 v323) ==== 95+0+4390 (secure 0 0 0) 0x7fb8600584d0 con 0x7fb86c161c80 2024-09-12T02:06:51.648 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:51.648 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":323,"btime":"2024-09-12T02:06:47:735956+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":10488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3905580508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3905580508},{"type":"v1","addr":"172.21.15.19:6834","nonce":3905580508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":320}],"filesystems":[{"mdsmap":{"epoch":323,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:47.735952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:51.648 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 323 2024-09-12T02:06:51.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.651+0000 7fb872a4c640 1 -- 172.21.15.19:0/2306262473 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb85806be60 msgr2=0x7fb85806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.651+0000 7fb872a4c640 1 --2- 172.21.15.19:0/2306262473 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb85806be60 0x7fb85806e320 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb85c006fd0 tx=0x7fb85c008040 comp rx=0 tx=0).stop 2024-09-12T02:06:51.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.651+0000 7fb872a4c640 1 -- 172.21.15.19:0/2306262473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb86c161c80 msgr2=0x7fb86c0b9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.651+0000 7fb872a4c640 1 --2- 172.21.15.19:0/2306262473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb86c161c80 0x7fb86c0b9480 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7fb86000c4b0 tx=0x7fb86000c970 comp rx=0 tx=0).stop 2024-09-12T02:06:51.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.651+0000 7fb872a4c640 1 -- 172.21.15.19:0/2306262473 shutdown_connections 2024-09-12T02:06:51.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.651+0000 7fb872a4c640 1 --2- 172.21.15.19:0/2306262473 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb85806be60 0x7fb85806e320 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.651+0000 7fb872a4c640 1 --2- 172.21.15.19:0/2306262473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb86c162060 0x7fb86c0cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.651+0000 7fb872a4c640 1 --2- 172.21.15.19:0/2306262473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb86c161c80 0x7fb86c0b9480 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.651+0000 7fb872a4c640 1 --2- 172.21.15.19:0/2306262473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb86c0b6680 0x7fb86c0cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.651+0000 7fb872a4c640 1 -- 172.21.15.19:0/2306262473 >> 172.21.15.19:0/2306262473 conn(0x7fb86c0d44f0 msgr2=0x7fb86c0b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:51.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.651+0000 7fb872a4c640 1 -- 172.21.15.19:0/2306262473 shutdown_connections 2024-09-12T02:06:51.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.651+0000 7fb872a4c640 1 -- 172.21.15.19:0/2306262473 wait complete. 2024-09-12T02:06:51.661 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:51.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.766+0000 7fc33b5ef640 1 Processor -- start 2024-09-12T02:06:51.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.766+0000 7fc33b5ef640 1 -- start start 2024-09-12T02:06:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.767+0000 7fc33b5ef640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc33415e760 0x7fc33406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.767+0000 7fc33b5ef640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc3340d4fd0 0x7fc3340cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.767+0000 7fc33b5ef640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3340d2700 con 0x7fc3340b3650 2024-09-12T02:06:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.767+0000 7fc33b5ef640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fc3340cedb0 con 0x7fc3340d4fd0 2024-09-12T02:06:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.767+0000 7fc33b5ef640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc3340cf090 con 0x7fc33415e760 2024-09-12T02:06:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.767+0000 7fc338b8a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc3340d4fd0 0x7fc3340cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.767+0000 7fc338b8a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc3340d4fd0 0x7fc3340cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42012/0 (socket says 172.21.15.19:42012) 2024-09-12T02:06:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.767+0000 7fc338b8a640 1 -- 172.21.15.19:0/4186211166 learned_addr learned my addr 172.21.15.19:0/4186211166 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:51.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.767+0000 7fc339b8c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc3340b3650 0x7fc3340d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52012/0 (socket says 172.21.15.19:52012) 2024-09-12T02:06:51.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.767+0000 7fc33938b640 1 --2- 172.21.15.19:0/4186211166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc33415e760 0x7fc33406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:51.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.767+0000 7fc338b8a640 1 -- 172.21.15.19:0/4186211166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc33415e760 msgr2=0x7fc33406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:51.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.767+0000 7fc338b8a640 1 --2- 172.21.15.19:0/4186211166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc33415e760 0x7fc33406cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.767+0000 7fc338b8a640 1 -- 172.21.15.19:0/4186211166 >> v1:172.21.15.19:6789/0 conn(0x7fc3340b3650 legacy=0x7fc3340d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.768+0000 7fc338b8a640 1 -- 172.21.15.19:0/4186211166 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3340b3c80 con 0x7fc3340d4fd0 2024-09-12T02:06:51.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.767+0000 7fc32bfff640 1 -- 172.21.15.19:0/4186211166 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4106408058 0 0) 0x7fc32c001490 con 0x7fc3340b3650 2024-09-12T02:06:51.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.768+0000 7fc338b8a640 1 --2- 172.21.15.19:0/4186211166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3340d4fd0 0x7fc3340cf5b0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fc324009850 tx=0x7fc32402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a36fc3ed705600 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:51.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.768+0000 7fc32bfff640 1 -- 172.21.15.19:0/4186211166 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324004030 con 0x7fc3340d4fd0 2024-09-12T02:06:51.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.768+0000 7fc32bfff640 1 -- 172.21.15.19:0/4186211166 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3240041d0 con 0x7fc3340d4fd0 2024-09-12T02:06:51.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.768+0000 7fc32bfff640 1 -- 172.21.15.19:0/4186211166 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324003610 con 0x7fc3340d4fd0 2024-09-12T02:06:51.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.769+0000 7fc33b5ef640 1 -- 172.21.15.19:0/4186211166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3340d4fd0 msgr2=0x7fc3340cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.769+0000 7fc33b5ef640 1 --2- 172.21.15.19:0/4186211166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3340d4fd0 0x7fc3340cf5b0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fc324009850 tx=0x7fc32402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.769+0000 7fc33b5ef640 1 -- 172.21.15.19:0/4186211166 shutdown_connections 2024-09-12T02:06:51.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.769+0000 7fc33b5ef640 1 --2- 172.21.15.19:0/4186211166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3340d4fd0 0x7fc3340cf5b0 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.769+0000 7fc33b5ef640 1 --2- 172.21.15.19:0/4186211166 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc33415e760 0x7fc33406cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.769+0000 7fc33b5ef640 1 -- 172.21.15.19:0/4186211166 >> 172.21.15.19:0/4186211166 conn(0x7fc33408bfc0 msgr2=0x7fc3340d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:51.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.769+0000 7fc33b5ef640 1 -- 172.21.15.19:0/4186211166 shutdown_connections 2024-09-12T02:06:51.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.769+0000 7fc33b5ef640 1 -- 172.21.15.19:0/4186211166 wait complete. 2024-09-12T02:06:51.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.770+0000 7fc33b5ef640 1 Processor -- start 2024-09-12T02:06:51.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.770+0000 7fc33b5ef640 1 -- start start 2024-09-12T02:06:51.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.771+0000 7fc33b5ef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3340b3650 0x7fc33414a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:51.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.771+0000 7fc33b5ef640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3340d4fd0 0x7fc3340cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:51.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.771+0000 7fc33b5ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc33415e760 0x7fc3340b9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:51.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.771+0000 7fc33b5ef640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc3340cfe80 con 0x7fc3340b3650 2024-09-12T02:06:51.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.771+0000 7fc33b5ef640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc3340cfd00 con 0x7fc33415e760 2024-09-12T02:06:51.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.771+0000 7fc33b5ef640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc3340d35b0 con 0x7fc3340d4fd0 2024-09-12T02:06:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.771+0000 7fc33938b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3340b3650 0x7fc33414a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.771+0000 7fc33938b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3340b3650 0x7fc33414a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42020/0 (socket says 172.21.15.19:42020) 2024-09-12T02:06:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.771+0000 7fc33938b640 1 -- 172.21.15.19:0/3329066053 learned_addr learned my addr 172.21.15.19:0/3329066053 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.771+0000 7fc338b8a640 1 --2- 172.21.15.19:0/3329066053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3340d4fd0 0x7fc3340cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.771+0000 7fc339b8c640 1 --2- 172.21.15.19:0/3329066053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc33415e760 0x7fc3340b9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.771+0000 7fc33938b640 1 -- 172.21.15.19:0/3329066053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3340d4fd0 msgr2=0x7fc3340cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.771+0000 7fc33938b640 1 --2- 172.21.15.19:0/3329066053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3340d4fd0 0x7fc3340cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.771+0000 7fc33938b640 1 -- 172.21.15.19:0/3329066053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc33415e760 msgr2=0x7fc3340b9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.771+0000 7fc33938b640 1 --2- 172.21.15.19:0/3329066053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc33415e760 0x7fc3340b9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.771+0000 7fc33938b640 1 -- 172.21.15.19:0/3329066053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3340b83d0 con 0x7fc3340b3650 2024-09-12T02:06:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.771+0000 7fc338b8a640 1 --2- 172.21.15.19:0/3329066053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3340d4fd0 0x7fc3340cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.771+0000 7fc339b8c640 1 --2- 172.21.15.19:0/3329066053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc33415e760 0x7fc3340b9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.772+0000 7fc33938b640 1 --2- 172.21.15.19:0/3329066053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3340b3650 0x7fc33414a3d0 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7fc33000d5f0 tx=0x7fc33000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.772+0000 7fc329ffb640 1 -- 172.21.15.19:0/3329066053 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3300125f0 con 0x7fc3340b3650 2024-09-12T02:06:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.772+0000 7fc329ffb640 1 -- 172.21.15.19:0/3329066053 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc330019070 con 0x7fc3340b3650 2024-09-12T02:06:51.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.772+0000 7fc33b5ef640 1 -- 172.21.15.19:0/3329066053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3340b8690 con 0x7fc3340b3650 2024-09-12T02:06:51.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.772+0000 7fc329ffb640 1 -- 172.21.15.19:0/3329066053 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3300129d0 con 0x7fc3340b3650 2024-09-12T02:06:51.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.772+0000 7fc33b5ef640 1 -- 172.21.15.19:0/3329066053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3340b8f30 con 0x7fc3340b3650 2024-09-12T02:06:51.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.773+0000 7fc33b5ef640 1 -- 172.21.15.19:0/3329066053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3340b8860 con 0x7fc3340b3650 2024-09-12T02:06:51.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.773+0000 7fc329ffb640 1 -- 172.21.15.19:0/3329066053 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc330012b70 con 0x7fc3340b3650 2024-09-12T02:06:51.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.774+0000 7fc329ffb640 1 --2- 172.21.15.19:0/3329066053 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc31806be30 0x7fc31806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:51.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.774+0000 7fc329ffb640 1 -- 172.21.15.19:0/3329066053 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 9657+0+0 (secure 0 0 0) 0x7fc33008c230 con 0x7fc3340b3650 2024-09-12T02:06:51.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.774+0000 7fc338b8a640 1 --2- 172.21.15.19:0/3329066053 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc31806be30 0x7fc31806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:51.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.775+0000 7fc338b8a640 1 --2- 172.21.15.19:0/3329066053 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc31806be30 0x7fc31806e2f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc324033000 tx=0x7fc32402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:51.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.778+0000 7fc329ffb640 1 -- 172.21.15.19:0/3329066053 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc330059c20 con 0x7fc3340b3650 2024-09-12T02:06:51.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.988+0000 7fc33b5ef640 1 -- 172.21.15.19:0/3329066053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3340d3980 con 0x7fc3340b3650 2024-09-12T02:06:51.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.989+0000 7fc329ffb640 1 -- 172.21.15.19:0/3329066053 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 323 v323) ==== 95+0+4390 (secure 0 0 0) 0x7fc330059520 con 0x7fc3340b3650 2024-09-12T02:06:51.988 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:51.989 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":323,"btime":"2024-09-12T02:06:47:735956+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":10488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3905580508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3905580508},{"type":"v1","addr":"172.21.15.19:6834","nonce":3905580508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":320}],"filesystems":[{"mdsmap":{"epoch":323,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:47.735952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:51.989 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 323 2024-09-12T02:06:51.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.991+0000 7fc33b5ef640 1 -- 172.21.15.19:0/3329066053 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc31806be30 msgr2=0x7fc31806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.991+0000 7fc33b5ef640 1 --2- 172.21.15.19:0/3329066053 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc31806be30 0x7fc31806e2f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc324033000 tx=0x7fc32402e000 comp rx=0 tx=0).stop 2024-09-12T02:06:51.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.991+0000 7fc33b5ef640 1 -- 172.21.15.19:0/3329066053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3340b3650 msgr2=0x7fc33414a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.991+0000 7fc33b5ef640 1 --2- 172.21.15.19:0/3329066053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3340b3650 0x7fc33414a3d0 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7fc33000d5f0 tx=0x7fc33000dab0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.991+0000 7fc33b5ef640 1 -- 172.21.15.19:0/3329066053 shutdown_connections 2024-09-12T02:06:51.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.991+0000 7fc33b5ef640 1 --2- 172.21.15.19:0/3329066053 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc31806be30 0x7fc31806e2f0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.991+0000 7fc33b5ef640 1 --2- 172.21.15.19:0/3329066053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc33415e760 0x7fc3340b9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.991+0000 7fc33b5ef640 1 --2- 172.21.15.19:0/3329066053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3340d4fd0 0x7fc3340cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.991+0000 7fc33b5ef640 1 --2- 172.21.15.19:0/3329066053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3340b3650 0x7fc33414a3d0 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.991+0000 7fc33b5ef640 1 -- 172.21.15.19:0/3329066053 >> 172.21.15.19:0/3329066053 conn(0x7fc33408bfc0 msgr2=0x7fc3340d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:51.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.991+0000 7fc33b5ef640 1 -- 172.21.15.19:0/3329066053 shutdown_connections 2024-09-12T02:06:51.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:51.991+0000 7fc33b5ef640 1 -- 172.21.15.19:0/3329066053 wait complete. 2024-09-12T02:06:52.001 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:06:52.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.104+0000 7fafa03c4640 1 Processor -- start 2024-09-12T02:06:52.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.104+0000 7fafa03c4640 1 -- start start 2024-09-12T02:06:52.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.105+0000 7fafa03c4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf9815e760 0x7faf9806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.105+0000 7fafa03c4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faf980cfcc0 0x7faf980d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.105+0000 7fafa03c4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf980d2700 con 0x7faf980d4fd0 2024-09-12T02:06:52.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.105+0000 7fafa03c4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7faf980cedb0 con 0x7faf980cfcc0 2024-09-12T02:06:52.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.105+0000 7fafa03c4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7faf980cf090 con 0x7faf9815e760 2024-09-12T02:06:52.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.105+0000 7faf9e961640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faf980cfcc0 0x7faf980d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.105+0000 7faf9e961640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faf980cfcc0 0x7faf980d2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42026/0 (socket says 172.21.15.19:42026) 2024-09-12T02:06:52.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.105+0000 7faf9e961640 1 -- 172.21.15.19:0/207208916 learned_addr learned my addr 172.21.15.19:0/207208916 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:52.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.105+0000 7faf9e160640 1 --2- 172.21.15.19:0/207208916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf9815e760 0x7faf9806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.105+0000 7faf9e961640 1 -- 172.21.15.19:0/207208916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf9815e760 msgr2=0x7faf9806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:52.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.105+0000 7faf9e961640 1 --2- 172.21.15.19:0/207208916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf9815e760 0x7faf9806cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.105+0000 7faf9e961640 1 -- 172.21.15.19:0/207208916 >> v1:172.21.15.19:6789/0 conn(0x7faf980d4fd0 legacy=0x7faf980cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.105+0000 7faf9d15e640 1 -- 172.21.15.19:0/207208916 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 542592006 0 0) 0x7faf8c001160 con 0x7faf980d4fd0 2024-09-12T02:06:52.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.105+0000 7faf9e961640 1 -- 172.21.15.19:0/207208916 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf980b3c80 con 0x7faf980cfcc0 2024-09-12T02:06:52.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.106+0000 7faf9e961640 1 --2- 172.21.15.19:0/207208916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf980cfcc0 0x7faf980d2ea0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7faf88009e50 tx=0x7faf8802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bacc7756a032681 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:52.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.106+0000 7faf9d15e640 1 -- 172.21.15.19:0/207208916 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf88036070 con 0x7faf980cfcc0 2024-09-12T02:06:52.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.106+0000 7faf9d15e640 1 -- 172.21.15.19:0/207208916 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf88031600 con 0x7faf980cfcc0 2024-09-12T02:06:52.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.106+0000 7faf9d15e640 1 -- 172.21.15.19:0/207208916 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf880319d0 con 0x7faf980cfcc0 2024-09-12T02:06:52.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.107+0000 7fafa03c4640 1 -- 172.21.15.19:0/207208916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf980cfcc0 msgr2=0x7faf980d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.107+0000 7fafa03c4640 1 --2- 172.21.15.19:0/207208916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf980cfcc0 0x7faf980d2ea0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7faf88009e50 tx=0x7faf8802a680 comp rx=0 tx=0).stop 2024-09-12T02:06:52.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.107+0000 7fafa03c4640 1 -- 172.21.15.19:0/207208916 shutdown_connections 2024-09-12T02:06:52.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.107+0000 7fafa03c4640 1 --2- 172.21.15.19:0/207208916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf980cfcc0 0x7faf980d2ea0 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.107+0000 7fafa03c4640 1 --2- 172.21.15.19:0/207208916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf9815e760 0x7faf9806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.107+0000 7fafa03c4640 1 -- 172.21.15.19:0/207208916 >> 172.21.15.19:0/207208916 conn(0x7faf9808bfc0 msgr2=0x7faf980d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:52.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.107+0000 7fafa03c4640 1 -- 172.21.15.19:0/207208916 shutdown_connections 2024-09-12T02:06:52.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.107+0000 7fafa03c4640 1 -- 172.21.15.19:0/207208916 wait complete. 2024-09-12T02:06:52.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.108+0000 7fafa03c4640 1 Processor -- start 2024-09-12T02:06:52.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.108+0000 7fafa03c4640 1 -- start start 2024-09-12T02:06:52.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7fafa03c4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf980cfcc0 0x7faf98156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7fafa03c4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf980d4fd0 0x7faf98156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7fafa03c4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf9815e760 0x7faf981f7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7fafa03c4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7faf980d33e0 con 0x7faf980cfcc0 2024-09-12T02:06:52.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7fafa03c4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faf980b3860 con 0x7faf980d4fd0 2024-09-12T02:06:52.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7fafa03c4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7faf980d3560 con 0x7faf9815e760 2024-09-12T02:06:52.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7faf9e160640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf980cfcc0 0x7faf98156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7faf9e160640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf980cfcc0 0x7faf98156820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42034/0 (socket says 172.21.15.19:42034) 2024-09-12T02:06:52.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7faf9e160640 1 -- 172.21.15.19:0/3042593177 learned_addr learned my addr 172.21.15.19:0/3042593177 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:52.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7faf9e961640 1 --2- 172.21.15.19:0/3042593177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf9815e760 0x7faf981f7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7faf9e160640 1 -- 172.21.15.19:0/3042593177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf9815e760 msgr2=0x7faf981f7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7faf9e160640 1 --2- 172.21.15.19:0/3042593177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf9815e760 0x7faf981f7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7faf9d95f640 1 --2- 172.21.15.19:0/3042593177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf980d4fd0 0x7faf98156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7faf9e160640 1 -- 172.21.15.19:0/3042593177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf980d4fd0 msgr2=0x7faf98156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7faf9e160640 1 --2- 172.21.15.19:0/3042593177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf980d4fd0 0x7faf98156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7faf9e160640 1 -- 172.21.15.19:0/3042593177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf980b9c20 con 0x7faf980cfcc0 2024-09-12T02:06:52.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7faf9e961640 1 --2- 172.21.15.19:0/3042593177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf9815e760 0x7faf981f7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:52.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7faf9d95f640 1 --2- 172.21.15.19:0/3042593177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf980d4fd0 0x7faf98156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:52.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.109+0000 7faf9e160640 1 --2- 172.21.15.19:0/3042593177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf980cfcc0 0x7faf98156820 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7faf9000d600 tx=0x7faf9000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:52.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.110+0000 7faf96ffd640 1 -- 172.21.15.19:0/3042593177 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf900125f0 con 0x7faf980cfcc0 2024-09-12T02:06:52.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.110+0000 7faf96ffd640 1 -- 172.21.15.19:0/3042593177 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf90019070 con 0x7faf980cfcc0 2024-09-12T02:06:52.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.110+0000 7fafa03c4640 1 -- 172.21.15.19:0/3042593177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf980b9ec0 con 0x7faf980cfcc0 2024-09-12T02:06:52.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.110+0000 7faf96ffd640 1 -- 172.21.15.19:0/3042593177 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf900129f0 con 0x7faf980cfcc0 2024-09-12T02:06:52.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.110+0000 7fafa03c4640 1 -- 172.21.15.19:0/3042593177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf980cda60 con 0x7faf980cfcc0 2024-09-12T02:06:52.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.111+0000 7fafa03c4640 1 -- 172.21.15.19:0/3042593177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf980d3990 con 0x7faf980cfcc0 2024-09-12T02:06:52.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.111+0000 7faf96ffd640 1 -- 172.21.15.19:0/3042593177 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf90012b90 con 0x7faf980cfcc0 2024-09-12T02:06:52.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.111+0000 7faf96ffd640 1 --2- 172.21.15.19:0/3042593177 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faf8406be30 0x7faf8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.112+0000 7faf96ffd640 1 -- 172.21.15.19:0/3042593177 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 9657+0+0 (secure 0 0 0) 0x7faf9008c2b0 con 0x7faf980cfcc0 2024-09-12T02:06:52.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.112+0000 7faf9d95f640 1 --2- 172.21.15.19:0/3042593177 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faf8406be30 0x7faf8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.112+0000 7faf9d95f640 1 --2- 172.21.15.19:0/3042593177 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faf8406be30 0x7faf8406e2f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7faf980d0410 tx=0x7faf8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:52.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.116+0000 7faf96ffd640 1 -- 172.21.15.19:0/3042593177 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faf90059ca0 con 0x7faf980cfcc0 2024-09-12T02:06:52.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.292+0000 7fafa03c4640 1 -- 172.21.15.19:0/3042593177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf980b6d20 con 0x7faf980cfcc0 2024-09-12T02:06:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.293+0000 7faf96ffd640 1 -- 172.21.15.19:0/3042593177 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) ==== 74+0+22342 (secure 0 0 0) 0x7faf900595a0 con 0x7faf980cfcc0 2024-09-12T02:06:52.293 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:52.293 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":134,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:06:47.735683+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:02:09.629825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-12T02:02:10.664335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1","mappings":[{"from":1,"to":2}]},{"pgid":"14.10","mappings":[{"from":1,"to":2}]},{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6834/2377195932":"2024-09-13T02:06:47.735659+0000","172.21.15.19:6834/4161442390":"2024-09-13T02:06:40.706190+0000","172.21.15.19:6832/4161442390":"2024-09-13T02:06:40.706190+0000","172.21.15.19:6834/1700320729":"2024-09-13T02:06:34.684378+0000","172.21.15.19:6834/3083563091":"2024-09-13T02:06:29.315464+0000","172.21.15.19:6832/3083563091":"2024-09-13T02:06:29.315464+0000","172.21.15.19:6834/3550997018":"2024-09-13T02:06:14.593467+0000","172.21.15.19:6834/2316269679":"2024-09-13T02:06:09.251347+0000","172.21.15.19:6832/2316269679":"2024-09-13T02:06:09.251347+0000","172.21.15.19:6832/3065327567":"2024-09-13T02:05:58.503981+0000","172.21.15.19:6834/1975440909":"2024-09-13T02:05:43.189507+0000","172.21.15.135:6837/3910102099":"2024-09-13T02:05:24.866817+0000","172.21.15.19:6834/2839344629":"2024-09-13T02:05:20.836728+0000","172.21.15.19:6832/2072535494":"2024-09-13T02:02:44.440900+0000","172.21.15.135:6834/2405422603":"2024-09-13T02:04:31.542456+0000","172.21.15.19:6832/1875416968":"2024-09-13T02:03:41.731211+0000","172.21.15.19:6832/4124612835":"2024-09-13T02:03:35.697598+0000","172.21.15.135:6834/1101861733":"2024-09-13T02:02:54.487980+0000","172.21.15.19:6832/3598057058":"2024-09-13T02:03:24.636971+0000","172.21.15.19:6832/626316140":"2024-09-13T02:04:41.744221+0000","172.21.15.135:6834/46689513":"2024-09-13T02:03:28.654366+0000","172.21.15.19:6832/3985859189":"2024-09-13T02:04:09.906953+0000","172.21.15.135:6837/3866905323":"2024-09-13T02:03:54.557384+0000","172.21.15.135:6837/3997032797":"2024-09-13T02:05:16.751616+0000","172.21.15.135:6834/3774685060":"2024-09-13T02:02:24.172690+0000","172.21.15.19:6834/3995150987":"2024-09-13T02:03:22.315702+0000","172.21.15.135:6837/46689513":"2024-09-13T02:03:28.654366+0000","172.21.15.135:6837/4287312235":"2024-09-13T02:03:11.277301+0000","172.21.15.19:6834/961161264":"2024-09-13T02:04:17.973298+0000","172.21.15.19:6832/1975440909":"2024-09-13T02:05:43.189507+0000","172.21.15.135:6837/3774685060":"2024-09-13T02:02:24.172690+0000","172.21.15.19:6834/3279314147":"2024-09-13T02:04:33.778955+0000","172.21.15.19:6832/1800650480":"2024-09-13T02:03:56.737366+0000","172.21.15.19:6832/3550997018":"2024-09-13T02:06:14.593467+0000","172.21.15.19:6832/3279314147":"2024-09-13T02:04:33.778955+0000","172.21.15.19:6832/4087550164":"2024-09-13T02:04:57.990681+0000","172.21.15.135:6834/2201380819":"2024-09-13T02:05:10.473806+0000","172.21.15.19:6832/3995150987":"2024-09-13T02:03:22.315702+0000","172.21.15.19:6834/4124612835":"2024-09-13T02:03:35.697598+0000","172.21.15.19:6834/2072535494":"2024-09-13T02:02:44.440900+0000","172.21.15.135:6837/2377195932":"2024-09-13T02:06:47.735659+0000","172.21.15.19:6834/3985859189":"2024-09-13T02:04:09.906953+0000","172.21.15.19:6832/1700320729":"2024-09-13T02:06:34.684378+0000","172.21.15.19:6832/613869354":"2024-09-13T02:02:39.104650+0000","172.21.15.19:6834/613869354":"2024-09-13T02:02:39.104650+0000","172.21.15.19:6832/650556594":"2024-09-13T02:02:50.470816+0000","172.21.15.19:6832/3818656517":"2024-09-13T02:05:38.158172+0000","172.21.15.135:6834/4287312235":"2024-09-13T02:03:11.277301+0000","172.21.15.19:6834/650556594":"2024-09-13T02:02:50.470816+0000","172.21.15.135:6834/4107165769":"2024-09-13T02:04:03.869164+0000","172.21.15.135:6837/1101861733":"2024-09-13T02:02:54.487980+0000","172.21.15.19:6834/1800650480":"2024-09-13T02:03:56.737366+0000","172.21.15.135:6834/2017831568":"2024-09-13T02:04:45.871893+0000","172.21.15.19:6832/3136344951":"2024-09-13T02:02:58.521234+0000","172.21.15.19:6834/3136344951":"2024-09-13T02:02:58.521234+0000","172.21.15.135:6837/4107165769":"2024-09-13T02:04:03.869164+0000","172.21.15.135:6834/926329492":"2024-09-13T02:04:13.937157+0000","172.21.15.135:6834/3866905323":"2024-09-13T02:03:54.557384+0000","172.21.15.135:6837/926329492":"2024-09-13T02:04:13.937157+0000","172.21.15.19:6832/961161264":"2024-09-13T02:04:17.973298+0000","172.21.15.135:6837/2201380819":"2024-09-13T02:05:10.473806+0000","172.21.15.135:6834/3910102099":"2024-09-13T02:05:24.866817+0000","172.21.15.135:6837/2405422603":"2024-09-13T02:04:31.542456+0000","172.21.15.135:6834/2333858704":"2024-09-13T02:04:37.802344+0000","172.21.15.19:6834/1875416968":"2024-09-13T02:03:41.731211+0000","172.21.15.135:6837/2333858704":"2024-09-13T02:04:37.802344+0000","172.21.15.19:6834/626316140":"2024-09-13T02:04:41.744221+0000","172.21.15.135:6837/2017831568":"2024-09-13T02:04:45.871893+0000","172.21.15.19:6832/3545886366":"2024-09-13T02:04:49.907498+0000","172.21.15.19:6834/3818656517":"2024-09-13T02:05:38.158172+0000","172.21.15.19:6834/3545886366":"2024-09-13T02:04:49.907498+0000","172.21.15.135:6834/3377480547":"2024-09-13T02:04:53.949050+0000","172.21.15.19:6834/3598057058":"2024-09-13T02:03:24.636971+0000","172.21.15.135:6837/3377480547":"2024-09-13T02:04:53.949050+0000","172.21.15.19:6834/3065327567":"2024-09-13T02:05:58.503981+0000","172.21.15.19:6834/4087550164":"2024-09-13T02:04:57.990681+0000","172.21.15.19:6834/2195405214":"2024-09-13T02:05:12.791934+0000","172.21.15.19:6832/2195405214":"2024-09-13T02:05:12.791934+0000","172.21.15.135:6834/3997032797":"2024-09-13T02:05:16.751616+0000","172.21.15.19:6832/2839344629":"2024-09-13T02:05:20.836728+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:06:52.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.296+0000 7fafa03c4640 1 -- 172.21.15.19:0/3042593177 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faf8406be30 msgr2=0x7faf8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.296+0000 7fafa03c4640 1 --2- 172.21.15.19:0/3042593177 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faf8406be30 0x7faf8406e2f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7faf980d0410 tx=0x7faf8c009040 comp rx=0 tx=0).stop 2024-09-12T02:06:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.296+0000 7fafa03c4640 1 -- 172.21.15.19:0/3042593177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf980cfcc0 msgr2=0x7faf98156820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.296+0000 7fafa03c4640 1 --2- 172.21.15.19:0/3042593177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf980cfcc0 0x7faf98156820 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7faf9000d600 tx=0x7faf9000dac0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.296+0000 7fafa03c4640 1 -- 172.21.15.19:0/3042593177 shutdown_connections 2024-09-12T02:06:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.296+0000 7fafa03c4640 1 --2- 172.21.15.19:0/3042593177 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7faf8406be30 0x7faf8406e2f0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.296+0000 7fafa03c4640 1 --2- 172.21.15.19:0/3042593177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf9815e760 0x7faf981f7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.296+0000 7fafa03c4640 1 --2- 172.21.15.19:0/3042593177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf980d4fd0 0x7faf98156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.296+0000 7fafa03c4640 1 --2- 172.21.15.19:0/3042593177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf980cfcc0 0x7faf98156820 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.296+0000 7fafa03c4640 1 -- 172.21.15.19:0/3042593177 >> 172.21.15.19:0/3042593177 conn(0x7faf9808bfc0 msgr2=0x7faf980b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.296+0000 7fafa03c4640 1 -- 172.21.15.19:0/3042593177 shutdown_connections 2024-09-12T02:06:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.296+0000 7fafa03c4640 1 -- 172.21.15.19:0/3042593177 wait complete. 2024-09-12T02:06:52.306 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:06:52.306 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.411+0000 7f2029b31640 1 Processor -- start 2024-09-12T02:06:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.411+0000 7f2029b31640 1 -- start start 2024-09-12T02:06:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.411+0000 7f2029b31640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2024161c80 0x7f202406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.411+0000 7f2029b31640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2024162060 0x7f20240b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.411+0000 7f2029b31640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f202406e870 con 0x7f20240b64b0 2024-09-12T02:06:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.411+0000 7f2029b31640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f202406d9f0 con 0x7f2024162060 2024-09-12T02:06:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.411+0000 7f2029b31640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f202406dcd0 con 0x7f2024161c80 2024-09-12T02:06:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.412+0000 7f2022ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2024162060 0x7f20240b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.412+0000 7f2023fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f20240b64b0 0x7f2024162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52028/0 (socket says 172.21.15.19:52028) 2024-09-12T02:06:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.412+0000 7f2023fff640 1 -- 172.21.15.19:0/436854602 learned_addr learned my addr 172.21.15.19:0/436854602 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.412+0000 7f20237fe640 1 --2- 172.21.15.19:0/436854602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2024161c80 0x7f202406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.412+0000 7f20227fc640 1 -- 172.21.15.19:0/436854602 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3274136671 0 0) 0x7f201c001490 con 0x7f20240b64b0 2024-09-12T02:06:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.412+0000 7f20227fc640 1 -- 172.21.15.19:0/436854602 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f200c003520 con 0x7f20240b64b0 2024-09-12T02:06:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.412+0000 7f2022ffd640 1 -- 172.21.15.19:0/436854602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2024161c80 msgr2=0x7f202406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.412+0000 7f2022ffd640 1 --2- 172.21.15.19:0/436854602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2024161c80 0x7f202406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.412+0000 7f2022ffd640 1 -- 172.21.15.19:0/436854602 >> v1:172.21.15.19:6789/0 conn(0x7f20240b64b0 legacy=0x7f2024162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.412+0000 7f2022ffd640 1 -- 172.21.15.19:0/436854602 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202406dfb0 con 0x7f2024162060 2024-09-12T02:06:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.412+0000 7f20237fe640 1 --2- 172.21.15.19:0/436854602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2024161c80 0x7f202406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.413+0000 7f2022ffd640 1 --2- 172.21.15.19:0/436854602 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2024162060 0x7f20240b5f70 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f20180097a0 tx=0x7f201802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475a205abe9cf972 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.413+0000 7f20227fc640 1 -- 172.21.15.19:0/436854602 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2018037070 con 0x7f2024162060 2024-09-12T02:06:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.413+0000 7f20227fc640 1 -- 172.21.15.19:0/436854602 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2018032440 con 0x7f2024162060 2024-09-12T02:06:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.413+0000 7f20227fc640 1 -- 172.21.15.19:0/436854602 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2018032810 con 0x7f2024162060 2024-09-12T02:06:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.413+0000 7f2029b31640 1 -- 172.21.15.19:0/436854602 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2024162060 msgr2=0x7f20240b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.413+0000 7f2029b31640 1 --2- 172.21.15.19:0/436854602 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2024162060 0x7f20240b5f70 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f20180097a0 tx=0x7f201802a180 comp rx=0 tx=0).stop 2024-09-12T02:06:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.414+0000 7f2029b31640 1 -- 172.21.15.19:0/436854602 shutdown_connections 2024-09-12T02:06:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.414+0000 7f2029b31640 1 --2- 172.21.15.19:0/436854602 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2024162060 0x7f20240b5f70 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.414+0000 7f2029b31640 1 --2- 172.21.15.19:0/436854602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2024161c80 0x7f202406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.414+0000 7f2029b31640 1 -- 172.21.15.19:0/436854602 >> 172.21.15.19:0/436854602 conn(0x7f20240d44f0 msgr2=0x7f20240d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.414+0000 7f2029b31640 1 -- 172.21.15.19:0/436854602 shutdown_connections 2024-09-12T02:06:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.414+0000 7f2029b31640 1 -- 172.21.15.19:0/436854602 wait complete. 2024-09-12T02:06:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.415+0000 7f2029b31640 1 Processor -- start 2024-09-12T02:06:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.415+0000 7f2029b31640 1 -- start start 2024-09-12T02:06:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f2029b31640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20240b64b0 0x7f202415c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f2029b31640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2024161c80 0x7f20240d3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f2029b31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2024162060 0x7f20240d3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f2029b31640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f20240d2a10 con 0x7f2024162060 2024-09-12T02:06:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f2029b31640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f20240d2890 con 0x7f20240b64b0 2024-09-12T02:06:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f2029b31640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f20240b6960 con 0x7f2024161c80 2024-09-12T02:06:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f2023fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2024162060 0x7f20240d3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f2023fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2024162060 0x7f20240d3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42048/0 (socket says 172.21.15.19:42048) 2024-09-12T02:06:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f2023fff640 1 -- 172.21.15.19:0/1542147742 learned_addr learned my addr 172.21.15.19:0/1542147742 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f2023fff640 1 -- 172.21.15.19:0/1542147742 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2024161c80 msgr2=0x7f20240d3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f2023fff640 1 --2- 172.21.15.19:0/1542147742 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2024161c80 0x7f20240d3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f2023fff640 1 -- 172.21.15.19:0/1542147742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20240b64b0 msgr2=0x7f202415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f2023fff640 1 --2- 172.21.15.19:0/1542147742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20240b64b0 0x7f202415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f2023fff640 1 -- 172.21.15.19:0/1542147742 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20241f57e0 con 0x7f2024162060 2024-09-12T02:06:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f2023fff640 1 --2- 172.21.15.19:0/1542147742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2024162060 0x7f20240d3c50 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f201c00cb50 tx=0x7f201c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f200bfff640 1 -- 172.21.15.19:0/1542147742 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c017070 con 0x7f2024162060 2024-09-12T02:06:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f200bfff640 1 -- 172.21.15.19:0/1542147742 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f201c00ad40 con 0x7f2024162060 2024-09-12T02:06:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f2029b31640 1 -- 172.21.15.19:0/1542147742 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f202415d260 con 0x7f2024162060 2024-09-12T02:06:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f200bfff640 1 -- 172.21.15.19:0/1542147742 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c012620 con 0x7f2024162060 2024-09-12T02:06:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.416+0000 7f2029b31640 1 -- 172.21.15.19:0/1542147742 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20240cb8a0 con 0x7f2024162060 2024-09-12T02:06:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.417+0000 7f2029b31640 1 -- 172.21.15.19:0/1542147742 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2024068ea0 con 0x7f2024162060 2024-09-12T02:06:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.418+0000 7f200bfff640 1 -- 172.21.15.19:0/1542147742 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f201c01a070 con 0x7f2024162060 2024-09-12T02:06:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.418+0000 7f200bfff640 1 --2- 172.21.15.19:0/1542147742 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f201006be30 0x7f201006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.419+0000 7f200bfff640 1 -- 172.21.15.19:0/1542147742 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 9657+0+0 (secure 0 0 0) 0x7f201c08bce0 con 0x7f2024162060 2024-09-12T02:06:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.419+0000 7f20237fe640 1 --2- 172.21.15.19:0/1542147742 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f201006be30 0x7f201006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.419+0000 7f20237fe640 1 --2- 172.21.15.19:0/1542147742 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f201006be30 0x7f201006e2f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f2014006fd0 tx=0x7f2014008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:52.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.423+0000 7f200bfff640 1 -- 172.21.15.19:0/1542147742 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f202406e870 con 0x7f2024162060 2024-09-12T02:06:52.487 INFO:tasks.ceph.mds.d.smithi135.stderr: -48> 2024-09-12T02:06:47.733+0000 7f06c366c640 -1 mds.0.cache.dir(0x1) Corrupt fnode in dirfrag 0x1: Decoder at 'void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)' v=3 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-09-12T02:06:52.487 INFO:tasks.ceph.mds.d.smithi135.stderr: -45> 2024-09-12T02:06:47.734+0000 7f06c366c640 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x1 is fatal because it is a system directory for this rank 2024-09-12T02:06:52.487 INFO:tasks.ceph.mds.d.smithi135.stderr: -20> 2024-09-12T02:06:49.899+0000 7f06c7674640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:06:52.514 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T02:06:52.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.635+0000 7f2029b31640 1 -- 172.21.15.19:0/1542147742 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2024159540 con 0x7f2024162060 2024-09-12T02:06:52.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.635+0000 7f200bfff640 1 -- 172.21.15.19:0/1542147742 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 323 v323) ==== 95+0+4390 (secure 0 0 0) 0x7f201c0596d0 con 0x7f2024162060 2024-09-12T02:06:52.635 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:52.635 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":323,"btime":"2024-09-12T02:06:47:735956+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":10488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3905580508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3905580508},{"type":"v1","addr":"172.21.15.19:6834","nonce":3905580508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":320}],"filesystems":[{"mdsmap":{"epoch":323,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:47.735952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:52.635 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 323 2024-09-12T02:06:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.637+0000 7f2029b31640 1 -- 172.21.15.19:0/1542147742 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f201006be30 msgr2=0x7f201006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.637+0000 7f2029b31640 1 --2- 172.21.15.19:0/1542147742 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f201006be30 0x7f201006e2f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f2014006fd0 tx=0x7f2014008040 comp rx=0 tx=0).stop 2024-09-12T02:06:52.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.637+0000 7f2029b31640 1 -- 172.21.15.19:0/1542147742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2024162060 msgr2=0x7f20240d3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.637+0000 7f2029b31640 1 --2- 172.21.15.19:0/1542147742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2024162060 0x7f20240d3c50 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f201c00cb50 tx=0x7f201c00a430 comp rx=0 tx=0).stop 2024-09-12T02:06:52.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.637+0000 7f2029b31640 1 -- 172.21.15.19:0/1542147742 shutdown_connections 2024-09-12T02:06:52.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.637+0000 7f2029b31640 1 --2- 172.21.15.19:0/1542147742 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f201006be30 0x7f201006e2f0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.637+0000 7f2029b31640 1 --2- 172.21.15.19:0/1542147742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2024162060 0x7f20240d3c50 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.637+0000 7f2029b31640 1 --2- 172.21.15.19:0/1542147742 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2024161c80 0x7f20240d3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.637+0000 7f2029b31640 1 --2- 172.21.15.19:0/1542147742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20240b64b0 0x7f202415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.637+0000 7f2029b31640 1 -- 172.21.15.19:0/1542147742 >> 172.21.15.19:0/1542147742 conn(0x7f20240d44f0 msgr2=0x7f202406ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.637+0000 7f2029b31640 1 -- 172.21.15.19:0/1542147742 shutdown_connections 2024-09-12T02:06:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.637+0000 7f2029b31640 1 -- 172.21.15.19:0/1542147742 wait complete. 2024-09-12T02:06:52.648 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:06:52.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.751+0000 7ff3fd931640 1 Processor -- start 2024-09-12T02:06:52.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.751+0000 7ff3fd931640 1 -- start start 2024-09-12T02:06:52.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.752+0000 7ff3fd931640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff3f815ba30 0x7ff3f806f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.752+0000 7ff3fd931640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff3f806fd50 0x7ff3f8072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.752+0000 7ff3fd931640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3f80b3570 con 0x7ff3f8072e80 2024-09-12T02:06:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.752+0000 7ff3fd931640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff3f80732f0 con 0x7ff3f815ba30 2024-09-12T02:06:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.752+0000 7ff3fd931640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff3f80b4180 con 0x7ff3f806fd50 2024-09-12T02:06:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.752+0000 7ff3f6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff3f815ba30 0x7ff3f806f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.752+0000 7ff3f6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff3f815ba30 0x7ff3f806f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42062/0 (socket says 172.21.15.19:42062) 2024-09-12T02:06:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.752+0000 7ff3f6ffd640 1 -- 172.21.15.19:0/3941149411 learned_addr learned my addr 172.21.15.19:0/3941149411 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.752+0000 7ff3f67fc640 1 --2- 172.21.15.19:0/3941149411 >> v2:172.21.15.135:3300/0 conn(0x7ff3f806fd50 0x7ff3f8072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.752+0000 7ff3f6ffd640 1 -- 172.21.15.19:0/3941149411 >> v2:172.21.15.135:3300/0 conn(0x7ff3f806fd50 msgr2=0x7ff3f8072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:52.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.752+0000 7ff3f6ffd640 1 --2- 172.21.15.19:0/3941149411 >> v2:172.21.15.135:3300/0 conn(0x7ff3f806fd50 0x7ff3f8072940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.752+0000 7ff3f6ffd640 1 -- 172.21.15.19:0/3941149411 >> v1:172.21.15.135:6789/0 conn(0x7ff3f8072e80 legacy=0x7ff3f806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:52.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.752+0000 7ff3f6ffd640 1 -- 172.21.15.19:0/3941149411 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f80b3850 con 0x7ff3f815ba30 2024-09-12T02:06:52.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.753+0000 7ff3f6ffd640 1 --2- 172.21.15.19:0/3941149411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3f815ba30 0x7ff3f806f810 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7ff3f80cfff0 tx=0x7ff3e802c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd91d9818e798749 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:52.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.755+0000 7ff3f5ffb640 1 -- 172.21.15.19:0/3941149411 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e803a070 con 0x7ff3f815ba30 2024-09-12T02:06:52.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.755+0000 7ff3f5ffb640 1 -- 172.21.15.19:0/3941149411 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e8032480 con 0x7ff3f815ba30 2024-09-12T02:06:52.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.755+0000 7ff3f5ffb640 1 -- 172.21.15.19:0/3941149411 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8032850 con 0x7ff3f815ba30 2024-09-12T02:06:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.756+0000 7ff3fd931640 1 -- 172.21.15.19:0/3941149411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3f815ba30 msgr2=0x7ff3f806f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.756+0000 7ff3fd931640 1 --2- 172.21.15.19:0/3941149411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3f815ba30 0x7ff3f806f810 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7ff3f80cfff0 tx=0x7ff3e802c6b0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.756+0000 7ff3fd931640 1 -- 172.21.15.19:0/3941149411 shutdown_connections 2024-09-12T02:06:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.756+0000 7ff3fd931640 1 --2- 172.21.15.19:0/3941149411 >> v2:172.21.15.135:3300/0 conn(0x7ff3f806fd50 0x7ff3f8072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.756+0000 7ff3fd931640 1 --2- 172.21.15.19:0/3941149411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3f815ba30 0x7ff3f806f810 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.756+0000 7ff3fd931640 1 -- 172.21.15.19:0/3941149411 >> 172.21.15.19:0/3941149411 conn(0x7ff3f8067d70 msgr2=0x7ff3f806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:52.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.756+0000 7ff3fd931640 1 -- 172.21.15.19:0/3941149411 shutdown_connections 2024-09-12T02:06:52.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.756+0000 7ff3fd931640 1 -- 172.21.15.19:0/3941149411 wait complete. 2024-09-12T02:06:52.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.757+0000 7ff3fd931640 1 Processor -- start 2024-09-12T02:06:52.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.757+0000 7ff3fd931640 1 -- start start 2024-09-12T02:06:52.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.758+0000 7ff3fd931640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3f806fd50 0x7ff3f813e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.758+0000 7ff3fd931640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3f8072e80 0x7ff3f81f09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.758+0000 7ff3fd931640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3f815ba30 0x7ff3f81587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.758+0000 7ff3fd931640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f80ce810 con 0x7ff3f815ba30 2024-09-12T02:06:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.758+0000 7ff3fd931640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f80b3e10 con 0x7ff3f8072e80 2024-09-12T02:06:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.758+0000 7ff3fd931640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f80b5890 con 0x7ff3f806fd50 2024-09-12T02:06:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.758+0000 7ff3f77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3f815ba30 0x7ff3f81587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.758+0000 7ff3f77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3f815ba30 0x7ff3f81587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42070/0 (socket says 172.21.15.19:42070) 2024-09-12T02:06:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.758+0000 7ff3f77fe640 1 -- 172.21.15.19:0/143083139 learned_addr learned my addr 172.21.15.19:0/143083139 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.758+0000 7ff3f67fc640 1 --2- 172.21.15.19:0/143083139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3f8072e80 0x7ff3f81f09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.758+0000 7ff3f6ffd640 1 --2- 172.21.15.19:0/143083139 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3f806fd50 0x7ff3f813e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.758+0000 7ff3f77fe640 1 -- 172.21.15.19:0/143083139 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3f806fd50 msgr2=0x7ff3f813e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.758+0000 7ff3f77fe640 1 --2- 172.21.15.19:0/143083139 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3f806fd50 0x7ff3f813e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.758+0000 7ff3f77fe640 1 -- 172.21.15.19:0/143083139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3f8072e80 msgr2=0x7ff3f81f09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.758+0000 7ff3f77fe640 1 --2- 172.21.15.19:0/143083139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3f8072e80 0x7ff3f81f09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.758+0000 7ff3f77fe640 1 -- 172.21.15.19:0/143083139 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f8140c50 con 0x7ff3f815ba30 2024-09-12T02:06:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.759+0000 7ff3f77fe640 1 --2- 172.21.15.19:0/143083139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3f815ba30 0x7ff3f81587f0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000c780 tx=0x7ff3f000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:52.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.762+0000 7ff3dffff640 1 -- 172.21.15.19:0/143083139 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0004b60 con 0x7ff3f815ba30 2024-09-12T02:06:52.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.762+0000 7ff3dffff640 1 -- 172.21.15.19:0/143083139 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3f0004d00 con 0x7ff3f815ba30 2024-09-12T02:06:52.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.762+0000 7ff3fd931640 1 -- 172.21.15.19:0/143083139 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f8140f30 con 0x7ff3f815ba30 2024-09-12T02:06:52.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.762+0000 7ff3dffff640 1 -- 172.21.15.19:0/143083139 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f000aa90 con 0x7ff3f815ba30 2024-09-12T02:06:52.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.762+0000 7ff3fd931640 1 -- 172.21.15.19:0/143083139 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f81414f0 con 0x7ff3f815ba30 2024-09-12T02:06:52.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.763+0000 7ff3fd931640 1 -- 172.21.15.19:0/143083139 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f8141930 con 0x7ff3f815ba30 2024-09-12T02:06:52.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.764+0000 7ff3dffff640 1 -- 172.21.15.19:0/143083139 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3f000ac30 con 0x7ff3f815ba30 2024-09-12T02:06:52.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.764+0000 7ff3dffff640 1 --2- 172.21.15.19:0/143083139 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3e406be30 0x7ff3e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.764+0000 7ff3dffff640 1 -- 172.21.15.19:0/143083139 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 9657+0+0 (secure 0 0 0) 0x7ff3f008c290 con 0x7ff3f815ba30 2024-09-12T02:06:52.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.764+0000 7ff3f6ffd640 1 --2- 172.21.15.19:0/143083139 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3e406be30 0x7ff3e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.765+0000 7ff3f6ffd640 1 --2- 172.21.15.19:0/143083139 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3e406be30 0x7ff3e406e2f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8037000 tx=0x7ff3e8030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:52.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.768+0000 7ff3dffff640 1 -- 172.21.15.19:0/143083139 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3f0059630 con 0x7ff3f815ba30 2024-09-12T02:06:52.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.980+0000 7ff3fd931640 1 -- 172.21.15.19:0/143083139 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3f80ccfe0 con 0x7ff3f815ba30 2024-09-12T02:06:52.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.980+0000 7ff3dffff640 1 -- 172.21.15.19:0/143083139 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 324 v324) ==== 95+0+5216 (secure 0 0 0) 0x7ff3f005d930 con 0x7ff3f815ba30 2024-09-12T02:06:52.980 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:52.980 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":324,"btime":"2024-09-12T02:06:52:752938+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8150,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/739861373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":739861373},{"type":"v1","addr":"172.21.15.135:6837","nonce":739861373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":324},{"gid":10488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3905580508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3905580508},{"type":"v1","addr":"172.21.15.19:6834","nonce":3905580508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":320}],"filesystems":[{"mdsmap":{"epoch":323,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:02:11.686429+0000","modified":"2024-09-12T02:06:47.735952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T02:06:52.980 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 324 2024-09-12T02:06:52.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.982+0000 7ff3fd931640 1 -- 172.21.15.19:0/143083139 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3e406be30 msgr2=0x7ff3e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.982+0000 7ff3fd931640 1 --2- 172.21.15.19:0/143083139 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3e406be30 0x7ff3e406e2f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8037000 tx=0x7ff3e8030000 comp rx=0 tx=0).stop 2024-09-12T02:06:52.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.982+0000 7ff3fd931640 1 -- 172.21.15.19:0/143083139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3f815ba30 msgr2=0x7ff3f81587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.982+0000 7ff3fd931640 1 --2- 172.21.15.19:0/143083139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3f815ba30 0x7ff3f81587f0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000c780 tx=0x7ff3f000cc40 comp rx=0 tx=0).stop 2024-09-12T02:06:52.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.982+0000 7ff3fd931640 1 -- 172.21.15.19:0/143083139 shutdown_connections 2024-09-12T02:06:52.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.982+0000 7ff3fd931640 1 --2- 172.21.15.19:0/143083139 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3e406be30 0x7ff3e406e2f0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.982+0000 7ff3fd931640 1 --2- 172.21.15.19:0/143083139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3f815ba30 0x7ff3f81587f0 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.982+0000 7ff3fd931640 1 --2- 172.21.15.19:0/143083139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3f8072e80 0x7ff3f81f09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.982+0000 7ff3fd931640 1 --2- 172.21.15.19:0/143083139 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3f806fd50 0x7ff3f813e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.982+0000 7ff3fd931640 1 -- 172.21.15.19:0/143083139 >> 172.21.15.19:0/143083139 conn(0x7ff3f8067d70 msgr2=0x7ff3f80720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:52.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.983+0000 7ff3fd931640 1 -- 172.21.15.19:0/143083139 shutdown_connections 2024-09-12T02:06:52.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:52.983+0000 7ff3fd931640 1 -- 172.21.15.19:0/143083139 wait complete. 2024-09-12T02:06:52.993 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:06:53.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.096+0000 7f9acc14b640 1 Processor -- start 2024-09-12T02:06:53.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.096+0000 7f9acc14b640 1 -- start start 2024-09-12T02:06:53.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9acc14b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ac415b300 0x7f9ac40cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9acc14b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9ac40cd3f0 0x7f9ac406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9acc14b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ac40cdbe0 con 0x7f9ac4072d30 2024-09-12T02:06:53.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9acc14b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac40728a0 con 0x7f9ac40cd3f0 2024-09-12T02:06:53.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9acc14b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac40cd900 con 0x7f9ac415b300 2024-09-12T02:06:53.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9aca6e8640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9ac4072d30 0x7f9ac40b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52032/0 (socket says 172.21.15.19:52032) 2024-09-12T02:06:53.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9aca6e8640 1 -- 172.21.15.19:0/2772390940 learned_addr learned my addr 172.21.15.19:0/2772390940 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:53.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac96e6640 1 --2- 172.21.15.19:0/2772390940 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40cd3f0 0x7f9ac406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac8ee5640 1 -- 172.21.15.19:0/2772390940 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2924941102 0 0) 0x7f9ac40cdbe0 con 0x7f9ac4072d30 2024-09-12T02:06:53.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac9ee7640 1 --2- 172.21.15.19:0/2772390940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ac415b300 0x7f9ac40cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac8ee5640 1 -- 172.21.15.19:0/2772390940 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9aac003520 con 0x7f9ac4072d30 2024-09-12T02:06:53.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac8ee5640 1 -- 172.21.15.19:0/2772390940 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2582010449 0 0) 0x7f9aac003520 con 0x7f9ac4072d30 2024-09-12T02:06:53.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac8ee5640 1 -- 172.21.15.19:0/2772390940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ac415b300 msgr2=0x7f9ac40cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:53.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac8ee5640 1 --2- 172.21.15.19:0/2772390940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ac415b300 0x7f9ac40cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac8ee5640 1 -- 172.21.15.19:0/2772390940 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40cd3f0 msgr2=0x7f9ac406f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:53.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac8ee5640 1 --2- 172.21.15.19:0/2772390940 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40cd3f0 0x7f9ac406f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac8ee5640 1 -- 172.21.15.19:0/2772390940 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac4072250 con 0x7f9ac4072d30 2024-09-12T02:06:53.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac8ee5640 1 -- 172.21.15.19:0/2772390940 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f9abc001670 con 0x7f9ac4072d30 2024-09-12T02:06:53.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac8ee5640 1 -- 172.21.15.19:0/2772390940 >> v1:172.21.15.19:6789/0 conn(0x7f9ac4072d30 legacy=0x7f9ac40b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:53.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac8ee5640 1 --2- 172.21.15.19:0/2772390940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ac415b300 0x7f9aac0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac8ee5640 1 --2- 172.21.15.19:0/2772390940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9aac003f30 0x7f9aac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac8ee5640 1 --2- 172.21.15.19:0/2772390940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aac004d40 0x7f9aac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac8ee5640 1 -- 172.21.15.19:0/2772390940 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac40728a0 con 0x7f9aac003f30 2024-09-12T02:06:53.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac8ee5640 1 -- 172.21.15.19:0/2772390940 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac40cd900 con 0x7f9aac004d40 2024-09-12T02:06:53.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac8ee5640 1 -- 172.21.15.19:0/2772390940 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9aac00ba10 con 0x7f9ac415b300 2024-09-12T02:06:53.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.097+0000 7f9ac96e6640 1 --2- 172.21.15.19:0/2772390940 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40cd3f0 0x7f9ac406f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:53.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.098+0000 7f9ac9ee7640 1 --2- 172.21.15.19:0/2772390940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ac415b300 0x7f9aac0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.098+0000 7f9aca6e8640 1 --2- 172.21.15.19:0/2772390940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aac004d40 0x7f9aac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.098+0000 7f9ac96e6640 1 --2- 172.21.15.19:0/2772390940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9aac003f30 0x7f9aac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.098+0000 7f9aca6e8640 1 -- 172.21.15.19:0/2772390940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ac415b300 msgr2=0x7f9aac0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:53.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.098+0000 7f9aca6e8640 1 --2- 172.21.15.19:0/2772390940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ac415b300 0x7f9aac0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.098+0000 7f9aca6e8640 1 -- 172.21.15.19:0/2772390940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9aac003f30 msgr2=0x7f9aac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:53.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.098+0000 7f9aca6e8640 1 --2- 172.21.15.19:0/2772390940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9aac003f30 0x7f9aac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.098+0000 7f9aca6e8640 1 -- 172.21.15.19:0/2772390940 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aac003520 con 0x7f9aac004d40 2024-09-12T02:06:53.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.098+0000 7f9ac96e6640 1 --2- 172.21.15.19:0/2772390940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9aac003f30 0x7f9aac004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:53.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.098+0000 7f9ac9ee7640 1 --2- 172.21.15.19:0/2772390940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ac415b300 0x7f9aac0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:53.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.099+0000 7f9aca6e8640 1 --2- 172.21.15.19:0/2772390940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aac004d40 0x7f9aac0051c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9abc001050 tx=0x7f9aac005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b154fb09bf1ae22 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:53.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.099+0000 7f9ac8ee5640 1 -- 172.21.15.19:0/2772390940 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc02e070 con 0x7f9aac004d40 2024-09-12T02:06:53.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.099+0000 7f9ac8ee5640 1 -- 172.21.15.19:0/2772390940 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9abc005af0 con 0x7f9aac004d40 2024-09-12T02:06:53.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.099+0000 7f9ac8ee5640 1 -- 172.21.15.19:0/2772390940 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc007d70 con 0x7f9aac004d40 2024-09-12T02:06:53.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.099+0000 7f9acc14b640 1 -- 172.21.15.19:0/2772390940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aac004d40 msgr2=0x7f9aac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:53.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.099+0000 7f9acc14b640 1 --2- 172.21.15.19:0/2772390940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aac004d40 0x7f9aac0051c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9abc001050 tx=0x7f9aac005830 comp rx=0 tx=0).stop 2024-09-12T02:06:53.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.099+0000 7f9aca6e8640 1 -- 172.21.15.19:0/2772390940 reap_dead start 2024-09-12T02:06:53.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.099+0000 7f9acc14b640 1 -- 172.21.15.19:0/2772390940 shutdown_connections 2024-09-12T02:06:53.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.099+0000 7f9acc14b640 1 -- 172.21.15.19:0/2772390940 >> 172.21.15.19:0/2772390940 conn(0x7f9ac4067d70 msgr2=0x7f9ac406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:53.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.100+0000 7f9acc14b640 1 -- 172.21.15.19:0/2772390940 shutdown_connections 2024-09-12T02:06:53.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.100+0000 7f9acc14b640 1 -- 172.21.15.19:0/2772390940 wait complete. 2024-09-12T02:06:53.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.101+0000 7f9acc14b640 1 Processor -- start 2024-09-12T02:06:53.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.101+0000 7f9acc14b640 1 -- start start 2024-09-12T02:06:53.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.101+0000 7f9acc14b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aac004d40 0x7f9ac4155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.101+0000 7f9acc14b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ac415d5d0 0x7f9ac414fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.101+0000 7f9acc14b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ac415da50 0x7f9ac414ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.101+0000 7f9acc14b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac40d0160 con 0x7f9ac415da50 2024-09-12T02:06:53.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.101+0000 7f9acc14b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac40cffe0 con 0x7f9aac004d40 2024-09-12T02:06:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.101+0000 7f9acc14b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac40cceb0 con 0x7f9ac415d5d0 2024-09-12T02:06:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.102+0000 7f9aca6e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ac415da50 0x7f9ac414ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.102+0000 7f9aca6e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ac415da50 0x7f9ac414ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42086/0 (socket says 172.21.15.19:42086) 2024-09-12T02:06:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.102+0000 7f9aca6e8640 1 -- 172.21.15.19:0/338513200 learned_addr learned my addr 172.21.15.19:0/338513200 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.102+0000 7f9ac9ee7640 1 --2- 172.21.15.19:0/338513200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aac004d40 0x7f9ac4155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.102+0000 7f9ac96e6640 1 --2- 172.21.15.19:0/338513200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ac415d5d0 0x7f9ac414fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.102+0000 7f9aca6e8640 1 -- 172.21.15.19:0/338513200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ac415d5d0 msgr2=0x7f9ac414fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.102+0000 7f9aca6e8640 1 --2- 172.21.15.19:0/338513200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ac415d5d0 0x7f9ac414fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.102+0000 7f9aca6e8640 1 -- 172.21.15.19:0/338513200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aac004d40 msgr2=0x7f9ac4155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.102+0000 7f9aca6e8640 1 --2- 172.21.15.19:0/338513200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aac004d40 0x7f9ac4155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.102+0000 7f9aca6e8640 1 -- 172.21.15.19:0/338513200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac4153d80 con 0x7f9ac415da50 2024-09-12T02:06:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.102+0000 7f9ac9ee7640 1 --2- 172.21.15.19:0/338513200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aac004d40 0x7f9ac4155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.102+0000 7f9aca6e8640 1 --2- 172.21.15.19:0/338513200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ac415da50 0x7f9ac414ffb0 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f9abc034040 tx=0x7f9abc000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.102+0000 7f9ac27fc640 1 -- 172.21.15.19:0/338513200 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc042020 con 0x7f9ac415da50 2024-09-12T02:06:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.102+0000 7f9ac27fc640 1 -- 172.21.15.19:0/338513200 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9abc007480 con 0x7f9ac415da50 2024-09-12T02:06:53.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.102+0000 7f9acc14b640 1 -- 172.21.15.19:0/338513200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac4150f70 con 0x7f9ac415da50 2024-09-12T02:06:53.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.102+0000 7f9ac27fc640 1 -- 172.21.15.19:0/338513200 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab800f040 con 0x7f9ac415da50 2024-09-12T02:06:53.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.102+0000 7f9acc14b640 1 -- 172.21.15.19:0/338513200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac4151530 con 0x7f9ac415da50 2024-09-12T02:06:53.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.103+0000 7f9acc14b640 1 -- 172.21.15.19:0/338513200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ac415ab00 con 0x7f9ac415da50 2024-09-12T02:06:53.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.104+0000 7f9ac27fc640 1 -- 172.21.15.19:0/338513200 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9abc045020 con 0x7f9ac415da50 2024-09-12T02:06:53.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.104+0000 7f9ac27fc640 1 --2- 172.21.15.19:0/338513200 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9ab006be60 0x7f9ab006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.104+0000 7f9ac27fc640 1 -- 172.21.15.19:0/338513200 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 9657+0+0 (secure 0 0 0) 0x7f9abc0ac040 con 0x7f9ac415da50 2024-09-12T02:06:53.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.105+0000 7f9ac9ee7640 1 --2- 172.21.15.19:0/338513200 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9ab006be60 0x7f9ab006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.105+0000 7f9ac9ee7640 1 --2- 172.21.15.19:0/338513200 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9ab006be60 0x7f9ab006e320 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40af2f0 tx=0x7f9ab400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:53.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.109+0000 7f9ac27fc640 1 -- 172.21.15.19:0/338513200 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9abc04c070 con 0x7f9ac415da50 2024-09-12T02:06:53.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.287+0000 7f9acc14b640 1 -- 172.21.15.19:0/338513200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ac40b0b10 con 0x7f9ac415da50 2024-09-12T02:06:53.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.288+0000 7f9ac27fc640 1 -- 172.21.15.19:0/338513200 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) ==== 74+0+22342 (secure 0 0 0) 0x7f9abc079be0 con 0x7f9ac415da50 2024-09-12T02:06:53.288 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:53.288 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":134,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:06:47.735683+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:02:09.629825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-12T02:02:10.664335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1","mappings":[{"from":1,"to":2}]},{"pgid":"14.10","mappings":[{"from":1,"to":2}]},{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6834/2377195932":"2024-09-13T02:06:47.735659+0000","172.21.15.19:6834/4161442390":"2024-09-13T02:06:40.706190+0000","172.21.15.19:6832/4161442390":"2024-09-13T02:06:40.706190+0000","172.21.15.19:6834/1700320729":"2024-09-13T02:06:34.684378+0000","172.21.15.19:6834/3083563091":"2024-09-13T02:06:29.315464+0000","172.21.15.19:6832/3083563091":"2024-09-13T02:06:29.315464+0000","172.21.15.19:6834/3550997018":"2024-09-13T02:06:14.593467+0000","172.21.15.19:6834/2316269679":"2024-09-13T02:06:09.251347+0000","172.21.15.19:6832/2316269679":"2024-09-13T02:06:09.251347+0000","172.21.15.19:6832/3065327567":"2024-09-13T02:05:58.503981+0000","172.21.15.19:6834/1975440909":"2024-09-13T02:05:43.189507+0000","172.21.15.135:6837/3910102099":"2024-09-13T02:05:24.866817+0000","172.21.15.19:6834/2839344629":"2024-09-13T02:05:20.836728+0000","172.21.15.19:6832/2072535494":"2024-09-13T02:02:44.440900+0000","172.21.15.135:6834/2405422603":"2024-09-13T02:04:31.542456+0000","172.21.15.19:6832/1875416968":"2024-09-13T02:03:41.731211+0000","172.21.15.19:6832/4124612835":"2024-09-13T02:03:35.697598+0000","172.21.15.135:6834/1101861733":"2024-09-13T02:02:54.487980+0000","172.21.15.19:6832/3598057058":"2024-09-13T02:03:24.636971+0000","172.21.15.19:6832/626316140":"2024-09-13T02:04:41.744221+0000","172.21.15.135:6834/46689513":"2024-09-13T02:03:28.654366+0000","172.21.15.19:6832/3985859189":"2024-09-13T02:04:09.906953+0000","172.21.15.135:6837/3866905323":"2024-09-13T02:03:54.557384+0000","172.21.15.135:6837/3997032797":"2024-09-13T02:05:16.751616+0000","172.21.15.135:6834/3774685060":"2024-09-13T02:02:24.172690+0000","172.21.15.19:6834/3995150987":"2024-09-13T02:03:22.315702+0000","172.21.15.135:6837/46689513":"2024-09-13T02:03:28.654366+0000","172.21.15.135:6837/4287312235":"2024-09-13T02:03:11.277301+0000","172.21.15.19:6834/961161264":"2024-09-13T02:04:17.973298+0000","172.21.15.19:6832/1975440909":"2024-09-13T02:05:43.189507+0000","172.21.15.135:6837/3774685060":"2024-09-13T02:02:24.172690+0000","172.21.15.19:6834/3279314147":"2024-09-13T02:04:33.778955+0000","172.21.15.19:6832/1800650480":"2024-09-13T02:03:56.737366+0000","172.21.15.19:6832/3550997018":"2024-09-13T02:06:14.593467+0000","172.21.15.19:6832/3279314147":"2024-09-13T02:04:33.778955+0000","172.21.15.19:6832/4087550164":"2024-09-13T02:04:57.990681+0000","172.21.15.135:6834/2201380819":"2024-09-13T02:05:10.473806+0000","172.21.15.19:6832/3995150987":"2024-09-13T02:03:22.315702+0000","172.21.15.19:6834/4124612835":"2024-09-13T02:03:35.697598+0000","172.21.15.19:6834/2072535494":"2024-09-13T02:02:44.440900+0000","172.21.15.135:6837/2377195932":"2024-09-13T02:06:47.735659+0000","172.21.15.19:6834/3985859189":"2024-09-13T02:04:09.906953+0000","172.21.15.19:6832/1700320729":"2024-09-13T02:06:34.684378+0000","172.21.15.19:6832/613869354":"2024-09-13T02:02:39.104650+0000","172.21.15.19:6834/613869354":"2024-09-13T02:02:39.104650+0000","172.21.15.19:6832/650556594":"2024-09-13T02:02:50.470816+0000","172.21.15.19:6832/3818656517":"2024-09-13T02:05:38.158172+0000","172.21.15.135:6834/4287312235":"2024-09-13T02:03:11.277301+0000","172.21.15.19:6834/650556594":"2024-09-13T02:02:50.470816+0000","172.21.15.135:6834/4107165769":"2024-09-13T02:04:03.869164+0000","172.21.15.135:6837/1101861733":"2024-09-13T02:02:54.487980+0000","172.21.15.19:6834/1800650480":"2024-09-13T02:03:56.737366+0000","172.21.15.135:6834/2017831568":"2024-09-13T02:04:45.871893+0000","172.21.15.19:6832/3136344951":"2024-09-13T02:02:58.521234+0000","172.21.15.19:6834/3136344951":"2024-09-13T02:02:58.521234+0000","172.21.15.135:6837/4107165769":"2024-09-13T02:04:03.869164+0000","172.21.15.135:6834/926329492":"2024-09-13T02:04:13.937157+0000","172.21.15.135:6834/3866905323":"2024-09-13T02:03:54.557384+0000","172.21.15.135:6837/926329492":"2024-09-13T02:04:13.937157+0000","172.21.15.19:6832/961161264":"2024-09-13T02:04:17.973298+0000","172.21.15.135:6837/2201380819":"2024-09-13T02:05:10.473806+0000","172.21.15.135:6834/3910102099":"2024-09-13T02:05:24.866817+0000","172.21.15.135:6837/2405422603":"2024-09-13T02:04:31.542456+0000","172.21.15.135:6834/2333858704":"2024-09-13T02:04:37.802344+0000","172.21.15.19:6834/1875416968":"2024-09-13T02:03:41.731211+0000","172.21.15.135:6837/2333858704":"2024-09-13T02:04:37.802344+0000","172.21.15.19:6834/626316140":"2024-09-13T02:04:41.744221+0000","172.21.15.135:6837/2017831568":"2024-09-13T02:04:45.871893+0000","172.21.15.19:6832/3545886366":"2024-09-13T02:04:49.907498+0000","172.21.15.19:6834/3818656517":"2024-09-13T02:05:38.158172+0000","172.21.15.19:6834/3545886366":"2024-09-13T02:04:49.907498+0000","172.21.15.135:6834/3377480547":"2024-09-13T02:04:53.949050+0000","172.21.15.19:6834/3598057058":"2024-09-13T02:03:24.636971+0000","172.21.15.135:6837/3377480547":"2024-09-13T02:04:53.949050+0000","172.21.15.19:6834/3065327567":"2024-09-13T02:05:58.503981+0000","172.21.15.19:6834/4087550164":"2024-09-13T02:04:57.990681+0000","172.21.15.19:6834/2195405214":"2024-09-13T02:05:12.791934+0000","172.21.15.19:6832/2195405214":"2024-09-13T02:05:12.791934+0000","172.21.15.135:6834/3997032797":"2024-09-13T02:05:16.751616+0000","172.21.15.19:6832/2839344629":"2024-09-13T02:05:20.836728+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:06:53.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.291+0000 7f9acc14b640 1 -- 172.21.15.19:0/338513200 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9ab006be60 msgr2=0x7f9ab006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:53.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.291+0000 7f9acc14b640 1 --2- 172.21.15.19:0/338513200 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9ab006be60 0x7f9ab006e320 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40af2f0 tx=0x7f9ab400b040 comp rx=0 tx=0).stop 2024-09-12T02:06:53.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.291+0000 7f9acc14b640 1 -- 172.21.15.19:0/338513200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ac415da50 msgr2=0x7f9ac414ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:53.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.291+0000 7f9acc14b640 1 --2- 172.21.15.19:0/338513200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ac415da50 0x7f9ac414ffb0 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f9abc034040 tx=0x7f9abc000fe0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.291+0000 7f9acc14b640 1 -- 172.21.15.19:0/338513200 shutdown_connections 2024-09-12T02:06:53.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.291+0000 7f9acc14b640 1 --2- 172.21.15.19:0/338513200 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9ab006be60 0x7f9ab006e320 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.291+0000 7f9acc14b640 1 --2- 172.21.15.19:0/338513200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ac415da50 0x7f9ac414ffb0 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.291+0000 7f9acc14b640 1 --2- 172.21.15.19:0/338513200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ac415d5d0 0x7f9ac414fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.291+0000 7f9acc14b640 1 --2- 172.21.15.19:0/338513200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aac004d40 0x7f9ac4155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.291+0000 7f9acc14b640 1 -- 172.21.15.19:0/338513200 >> 172.21.15.19:0/338513200 conn(0x7f9ac4067d70 msgr2=0x7f9ac40b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:53.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.291+0000 7f9acc14b640 1 -- 172.21.15.19:0/338513200 shutdown_connections 2024-09-12T02:06:53.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.291+0000 7f9acc14b640 1 -- 172.21.15.19:0/338513200 wait complete. 2024-09-12T02:06:53.301 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:06:53.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.405+0000 7f2131d86640 1 Processor -- start 2024-09-12T02:06:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.405+0000 7f2131d86640 1 -- start start 2024-09-12T02:06:53.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.406+0000 7f2131d86640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f212c15c490 0x7f212c09b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.406+0000 7f2131d86640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f212c09b980 0x7f212c15c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.406+0000 7f2131d86640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f212c15cdb0 0x7f212c15ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.406+0000 7f2131d86640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f212c0cff70 con 0x7f212c15c490 2024-09-12T02:06:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.406+0000 7f2131d86640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f212c0d0dd0 con 0x7f212c09b980 2024-09-12T02:06:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.406+0000 7f2131d86640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f212c0d01c0 con 0x7f212c15cdb0 2024-09-12T02:06:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.406+0000 7f212b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f212c15c490 0x7f212c09b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.406+0000 7f212b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f212c15c490 0x7f212c09b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42092/0 (socket says 172.21.15.19:42092) 2024-09-12T02:06:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.406+0000 7f212b7fe640 1 -- 172.21.15.19:0/2917102337 learned_addr learned my addr 172.21.15.19:0/2917102337 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.406+0000 7f212affd640 1 --2- 172.21.15.19:0/2917102337 >> v2:172.21.15.135:3300/0 conn(0x7f212c09b980 0x7f212c15c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.406+0000 7f212bfff640 1 --2- 172.21.15.19:0/2917102337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f212c15cdb0 0x7f212c15ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.406+0000 7f212b7fe640 1 -- 172.21.15.19:0/2917102337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f212c15cdb0 msgr2=0x7f212c15ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.406+0000 7f212b7fe640 1 --2- 172.21.15.19:0/2917102337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f212c15cdb0 0x7f212c15ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.406+0000 7f212b7fe640 1 -- 172.21.15.19:0/2917102337 >> v2:172.21.15.135:3300/0 conn(0x7f212c09b980 msgr2=0x7f212c15c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.406+0000 7f212b7fe640 1 --2- 172.21.15.19:0/2917102337 >> v2:172.21.15.135:3300/0 conn(0x7f212c09b980 0x7f212c15c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.406+0000 7f212b7fe640 1 -- 172.21.15.19:0/2917102337 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212c0d04a0 con 0x7f212c15c490 2024-09-12T02:06:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.406+0000 7f212affd640 1 --2- 172.21.15.19:0/2917102337 >> v2:172.21.15.135:3300/0 conn(0x7f212c09b980 0x7f212c15c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.406+0000 7f212bfff640 1 --2- 172.21.15.19:0/2917102337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f212c15cdb0 0x7f212c15ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.407+0000 7f212b7fe640 1 --2- 172.21.15.19:0/2917102337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c15c490 0x7f212c09b440 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f212c074070 tx=0x7f211c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95ccc4c9160fef0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.407+0000 7f212a7fc640 1 -- 172.21.15.19:0/2917102337 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c037070 con 0x7f212c15c490 2024-09-12T02:06:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.407+0000 7f212a7fc640 1 -- 172.21.15.19:0/2917102337 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f211c032440 con 0x7f212c15c490 2024-09-12T02:06:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.407+0000 7f212a7fc640 1 -- 172.21.15.19:0/2917102337 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c032810 con 0x7f212c15c490 2024-09-12T02:06:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.408+0000 7f2131d86640 1 -- 172.21.15.19:0/2917102337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c15c490 msgr2=0x7f212c09b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.408+0000 7f2131d86640 1 --2- 172.21.15.19:0/2917102337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c15c490 0x7f212c09b440 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f212c074070 tx=0x7f211c02a270 comp rx=0 tx=0).stop 2024-09-12T02:06:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.408+0000 7f2131d86640 1 -- 172.21.15.19:0/2917102337 shutdown_connections 2024-09-12T02:06:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.408+0000 7f2131d86640 1 --2- 172.21.15.19:0/2917102337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f212c15cdb0 0x7f212c15ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.408+0000 7f2131d86640 1 --2- 172.21.15.19:0/2917102337 >> v2:172.21.15.135:3300/0 conn(0x7f212c09b980 0x7f212c15c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.408+0000 7f2131d86640 1 --2- 172.21.15.19:0/2917102337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c15c490 0x7f212c09b440 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.408+0000 7f2131d86640 1 -- 172.21.15.19:0/2917102337 >> 172.21.15.19:0/2917102337 conn(0x7f212c0d23a0 msgr2=0x7f212c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.408+0000 7f2131d86640 1 -- 172.21.15.19:0/2917102337 shutdown_connections 2024-09-12T02:06:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.408+0000 7f2131d86640 1 -- 172.21.15.19:0/2917102337 wait complete. 2024-09-12T02:06:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.409+0000 7f2131d86640 1 Processor -- start 2024-09-12T02:06:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.409+0000 7f2131d86640 1 -- start start 2024-09-12T02:06:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.410+0000 7f2131d86640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f212c09b980 0x7f212c0b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.410+0000 7f2131d86640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c15c490 0x7f212c0c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.410+0000 7f2131d86640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f212c15cdb0 0x7f212c0b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.410+0000 7f2131d86640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f212c15d240 con 0x7f212c15c490 2024-09-12T02:06:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.410+0000 7f2131d86640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f212c0d0a60 con 0x7f212c09b980 2024-09-12T02:06:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.410+0000 7f2131d86640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f212c0d1260 con 0x7f212c15cdb0 2024-09-12T02:06:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.410+0000 7f212affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c15c490 0x7f212c0c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.410+0000 7f212affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c15c490 0x7f212c0c7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42096/0 (socket says 172.21.15.19:42096) 2024-09-12T02:06:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.410+0000 7f212affd640 1 -- 172.21.15.19:0/1012824276 learned_addr learned my addr 172.21.15.19:0/1012824276 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.410+0000 7f212b7fe640 1 --2- 172.21.15.19:0/1012824276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f212c09b980 0x7f212c0b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.410+0000 7f212bfff640 1 --2- 172.21.15.19:0/1012824276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f212c15cdb0 0x7f212c0b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.410+0000 7f212affd640 1 -- 172.21.15.19:0/1012824276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f212c15cdb0 msgr2=0x7f212c0b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.410+0000 7f212affd640 1 --2- 172.21.15.19:0/1012824276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f212c15cdb0 0x7f212c0b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.410+0000 7f212affd640 1 -- 172.21.15.19:0/1012824276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f212c09b980 msgr2=0x7f212c0b7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.410+0000 7f212affd640 1 --2- 172.21.15.19:0/1012824276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f212c09b980 0x7f212c0b7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.410+0000 7f212affd640 1 -- 172.21.15.19:0/1012824276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212c0c7cd0 con 0x7f212c15c490 2024-09-12T02:06:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.411+0000 7f212affd640 1 --2- 172.21.15.19:0/1012824276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c15c490 0x7f212c0c7280 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f212000e730 tx=0x7f212000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.411+0000 7f2113fff640 1 -- 172.21.15.19:0/1012824276 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212000f040 con 0x7f212c15c490 2024-09-12T02:06:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.411+0000 7f2113fff640 1 -- 172.21.15.19:0/1012824276 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2120004230 con 0x7f212c15c490 2024-09-12T02:06:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.411+0000 7f2131d86640 1 -- 172.21.15.19:0/1012824276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f212c0c7fb0 con 0x7f212c15c490 2024-09-12T02:06:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.411+0000 7f2113fff640 1 -- 172.21.15.19:0/1012824276 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212000ee40 con 0x7f212c15c490 2024-09-12T02:06:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.411+0000 7f2131d86640 1 -- 172.21.15.19:0/1012824276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f212c0c8570 con 0x7f212c15c490 2024-09-12T02:06:53.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.412+0000 7f2131d86640 1 -- 172.21.15.19:0/1012824276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f212c06c070 con 0x7f212c15c490 2024-09-12T02:06:53.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.412+0000 7f2113fff640 1 -- 172.21.15.19:0/1012824276 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f212000c6d0 con 0x7f212c15c490 2024-09-12T02:06:53.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.413+0000 7f2113fff640 1 --2- 172.21.15.19:0/1012824276 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f211806be30 0x7f211806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.413+0000 7f2113fff640 1 -- 172.21.15.19:0/1012824276 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 9657+0+0 (secure 0 0 0) 0x7f212008bb60 con 0x7f212c15c490 2024-09-12T02:06:53.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.413+0000 7f212b7fe640 1 --2- 172.21.15.19:0/1012824276 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f211806be30 0x7f211806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.414+0000 7f212b7fe640 1 --2- 172.21.15.19:0/1012824276 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f211806be30 0x7f211806e2f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f211c034000 tx=0x7f211c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:53.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.417+0000 7f2113fff640 1 -- 172.21.15.19:0/1012824276 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f212c06c070 con 0x7f212c15c490 2024-09-12T02:06:53.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.628+0000 7f2131d86640 1 -- 172.21.15.19:0/1012824276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f212c15c870 con 0x7f212c15c490 2024-09-12T02:06:53.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.767+0000 7f2113fff640 1 -- 172.21.15.19:0/1012824276 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v325) ==== 161+0+0 (secure 0 0 0) 0x7f2120017020 con 0x7f212c15c490 2024-09-12T02:06:53.766 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:06:53.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.770+0000 7f2131d86640 1 -- 172.21.15.19:0/1012824276 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f211806be30 msgr2=0x7f211806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:53.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.770+0000 7f2131d86640 1 --2- 172.21.15.19:0/1012824276 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f211806be30 0x7f211806e2f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f211c034000 tx=0x7f211c02e000 comp rx=0 tx=0).stop 2024-09-12T02:06:53.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.770+0000 7f2131d86640 1 -- 172.21.15.19:0/1012824276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c15c490 msgr2=0x7f212c0c7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:53.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.770+0000 7f2131d86640 1 --2- 172.21.15.19:0/1012824276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c15c490 0x7f212c0c7280 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f212000e730 tx=0x7f212000ebf0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.770+0000 7f2131d86640 1 -- 172.21.15.19:0/1012824276 shutdown_connections 2024-09-12T02:06:53.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.770+0000 7f2131d86640 1 --2- 172.21.15.19:0/1012824276 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f211806be30 0x7f211806e2f0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.770+0000 7f2131d86640 1 --2- 172.21.15.19:0/1012824276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f212c15cdb0 0x7f212c0b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.770+0000 7f2131d86640 1 --2- 172.21.15.19:0/1012824276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c15c490 0x7f212c0c7280 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.770+0000 7f2131d86640 1 --2- 172.21.15.19:0/1012824276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f212c09b980 0x7f212c0b7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.770+0000 7f2131d86640 1 -- 172.21.15.19:0/1012824276 >> 172.21.15.19:0/1012824276 conn(0x7f212c0d23a0 msgr2=0x7f212c0ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:53.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.770+0000 7f2131d86640 1 -- 172.21.15.19:0/1012824276 shutdown_connections 2024-09-12T02:06:53.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.770+0000 7f2131d86640 1 -- 172.21.15.19:0/1012824276 wait complete. 2024-09-12T02:06:53.780 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:06:53.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.885+0000 7fc74a3f6640 1 Processor -- start 2024-09-12T02:06:53.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.885+0000 7fc74a3f6640 1 -- start start 2024-09-12T02:06:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.886+0000 7fc74a3f6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc744158b50 0x7fc7440b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.886+0000 7fc74a3f6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc7440b6360 0x7fc74409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.886+0000 7fc74a3f6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc74415f950 0x7fc74409af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.886+0000 7fc74a3f6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fc7440b6820 con 0x7fc7440b6360 2024-09-12T02:06:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.886+0000 7fc74a3f6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc7440b6b00 con 0x7fc744158b50 2024-09-12T02:06:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.886+0000 7fc74a3f6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc7440b6de0 con 0x7fc74415f950 2024-09-12T02:06:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.886+0000 7fc7437fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc7440b6360 0x7fc74409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.886+0000 7fc7437fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc7440b6360 0x7fc74409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42110/0 (socket says 172.21.15.19:42110) 2024-09-12T02:06:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.886+0000 7fc7437fe640 1 -- 172.21.15.19:0/711192649 learned_addr learned my addr 172.21.15.19:0/711192649 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.886+0000 7fc748993640 1 --2- 172.21.15.19:0/711192649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc74415f950 0x7fc74409af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.886+0000 7fc743fff640 1 --2- 172.21.15.19:0/711192649 >> v2:172.21.15.135:3300/0 conn(0x7fc744158b50 0x7fc7440b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.886+0000 7fc7437fe640 1 -- 172.21.15.19:0/711192649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc74415f950 msgr2=0x7fc74409af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:53.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.886+0000 7fc7437fe640 1 --2- 172.21.15.19:0/711192649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc74415f950 0x7fc74409af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.886+0000 7fc7437fe640 1 -- 172.21.15.19:0/711192649 >> v2:172.21.15.135:3300/0 conn(0x7fc744158b50 msgr2=0x7fc7440b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:53.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.886+0000 7fc7437fe640 1 --2- 172.21.15.19:0/711192649 >> v2:172.21.15.135:3300/0 conn(0x7fc744158b50 0x7fc7440b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.886+0000 7fc7437fe640 1 -- 172.21.15.19:0/711192649 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7440b70c0 con 0x7fc7440b6360 2024-09-12T02:06:53.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.887+0000 7fc7437fe640 1 --2- 172.21.15.19:0/711192649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7440b6360 0x7fc74409aa30 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7fc7440b8510 tx=0x7fc73802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64db51bc623a840a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.887+0000 7fc742ffd640 1 -- 172.21.15.19:0/711192649 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc738037070 con 0x7fc7440b6360 2024-09-12T02:06:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.887+0000 7fc742ffd640 1 -- 172.21.15.19:0/711192649 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc738032440 con 0x7fc7440b6360 2024-09-12T02:06:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.887+0000 7fc742ffd640 1 -- 172.21.15.19:0/711192649 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc738032810 con 0x7fc7440b6360 2024-09-12T02:06:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.888+0000 7fc74a3f6640 1 -- 172.21.15.19:0/711192649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7440b6360 msgr2=0x7fc74409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.888+0000 7fc74a3f6640 1 --2- 172.21.15.19:0/711192649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7440b6360 0x7fc74409aa30 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7fc7440b8510 tx=0x7fc73802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.888+0000 7fc74a3f6640 1 -- 172.21.15.19:0/711192649 shutdown_connections 2024-09-12T02:06:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.888+0000 7fc74a3f6640 1 --2- 172.21.15.19:0/711192649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc74415f950 0x7fc74409af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.888+0000 7fc74a3f6640 1 --2- 172.21.15.19:0/711192649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7440b6360 0x7fc74409aa30 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.888+0000 7fc74a3f6640 1 --2- 172.21.15.19:0/711192649 >> v2:172.21.15.135:3300/0 conn(0x7fc744158b50 0x7fc7440b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.888+0000 7fc74a3f6640 1 -- 172.21.15.19:0/711192649 >> 172.21.15.19:0/711192649 conn(0x7fc7440b79e0 msgr2=0x7fc7440b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.888+0000 7fc74a3f6640 1 -- 172.21.15.19:0/711192649 shutdown_connections 2024-09-12T02:06:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.888+0000 7fc74a3f6640 1 -- 172.21.15.19:0/711192649 wait complete. 2024-09-12T02:06:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.889+0000 7fc74a3f6640 1 Processor -- start 2024-09-12T02:06:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.889+0000 7fc74a3f6640 1 -- start start 2024-09-12T02:06:53.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.890+0000 7fc74a3f6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7440b6360 0x7fc744153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.890+0000 7fc74a3f6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc744158b50 0x7fc744147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.890+0000 7fc74a3f6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc74415f950 0x7fc7440b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.890+0000 7fc74a3f6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc7441590b0 con 0x7fc744158b50 2024-09-12T02:06:53.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.890+0000 7fc74a3f6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc744158f30 con 0x7fc7440b6360 2024-09-12T02:06:53.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.890+0000 7fc74a3f6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc744162220 con 0x7fc74415f950 2024-09-12T02:06:53.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.890+0000 7fc7437fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc744158b50 0x7fc744147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.890+0000 7fc7437fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc744158b50 0x7fc744147d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42120/0 (socket says 172.21.15.19:42120) 2024-09-12T02:06:53.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.890+0000 7fc7437fe640 1 -- 172.21.15.19:0/2387807832 learned_addr learned my addr 172.21.15.19:0/2387807832 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:53.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.890+0000 7fc743fff640 1 --2- 172.21.15.19:0/2387807832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7440b6360 0x7fc744153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.890+0000 7fc748993640 1 --2- 172.21.15.19:0/2387807832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc74415f950 0x7fc7440b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.890+0000 7fc7437fe640 1 -- 172.21.15.19:0/2387807832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc74415f950 msgr2=0x7fc7440b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:53.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.890+0000 7fc7437fe640 1 --2- 172.21.15.19:0/2387807832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc74415f950 0x7fc7440b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.890+0000 7fc7437fe640 1 -- 172.21.15.19:0/2387807832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7440b6360 msgr2=0x7fc744153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:53.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.890+0000 7fc7437fe640 1 --2- 172.21.15.19:0/2387807832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7440b6360 0x7fc744153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:53.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.890+0000 7fc7437fe640 1 -- 172.21.15.19:0/2387807832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc744152880 con 0x7fc744158b50 2024-09-12T02:06:53.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.891+0000 7fc7437fe640 1 --2- 172.21.15.19:0/2387807832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc744158b50 0x7fc744147d90 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7fc738000c00 tx=0x7fc7380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:53.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.891+0000 7fc740ff9640 1 -- 172.21.15.19:0/2387807832 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc738041020 con 0x7fc744158b50 2024-09-12T02:06:53.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.891+0000 7fc740ff9640 1 -- 172.21.15.19:0/2387807832 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7380306c0 con 0x7fc744158b50 2024-09-12T02:06:53.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.891+0000 7fc74a3f6640 1 -- 172.21.15.19:0/2387807832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7440b12a0 con 0x7fc744158b50 2024-09-12T02:06:53.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.891+0000 7fc740ff9640 1 -- 172.21.15.19:0/2387807832 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc738037040 con 0x7fc744158b50 2024-09-12T02:06:53.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.891+0000 7fc74a3f6640 1 -- 172.21.15.19:0/2387807832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7440b0ee0 con 0x7fc744158b50 2024-09-12T02:06:53.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.892+0000 7fc74a3f6640 1 -- 172.21.15.19:0/2387807832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7440b5e20 con 0x7fc744158b50 2024-09-12T02:06:53.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.892+0000 7fc740ff9640 1 -- 172.21.15.19:0/2387807832 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc738044020 con 0x7fc744158b50 2024-09-12T02:06:53.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.893+0000 7fc740ff9640 1 --2- 172.21.15.19:0/2387807832 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc73006be30 0x7fc73006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:53.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.893+0000 7fc740ff9640 1 -- 172.21.15.19:0/2387807832 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 9657+0+0 (secure 0 0 0) 0x7fc7380ac4b0 con 0x7fc744158b50 2024-09-12T02:06:53.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.893+0000 7fc743fff640 1 --2- 172.21.15.19:0/2387807832 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc73006be30 0x7fc73006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:53.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.894+0000 7fc743fff640 1 --2- 172.21.15.19:0/2387807832 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc73006be30 0x7fc73006e2f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc734006fd0 tx=0x7fc734008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:53.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:53.897+0000 7fc740ff9640 1 -- 172.21.15.19:0/2387807832 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc73804b030 con 0x7fc744158b50 2024-09-12T02:06:54.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.105+0000 7fc74a3f6640 1 -- 172.21.15.19:0/2387807832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc7440b77a0 con 0x7fc744158b50 2024-09-12T02:06:54.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.774+0000 7fc740ff9640 1 -- 172.21.15.19:0/2387807832 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v326) ==== 104+0+0 (secure 0 0 0) 0x7fc7380798e0 con 0x7fc744158b50 2024-09-12T02:06:54.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.777+0000 7fc74a3f6640 1 -- 172.21.15.19:0/2387807832 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc73006be30 msgr2=0x7fc73006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:54.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.777+0000 7fc74a3f6640 1 --2- 172.21.15.19:0/2387807832 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc73006be30 0x7fc73006e2f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc734006fd0 tx=0x7fc734008040 comp rx=0 tx=0).stop 2024-09-12T02:06:54.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.777+0000 7fc74a3f6640 1 -- 172.21.15.19:0/2387807832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc744158b50 msgr2=0x7fc744147d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:54.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.777+0000 7fc74a3f6640 1 --2- 172.21.15.19:0/2387807832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc744158b50 0x7fc744147d90 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7fc738000c00 tx=0x7fc7380046c0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.777+0000 7fc74a3f6640 1 -- 172.21.15.19:0/2387807832 shutdown_connections 2024-09-12T02:06:54.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.777+0000 7fc74a3f6640 1 --2- 172.21.15.19:0/2387807832 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc73006be30 0x7fc73006e2f0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.777+0000 7fc74a3f6640 1 --2- 172.21.15.19:0/2387807832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc74415f950 0x7fc7440b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.777+0000 7fc74a3f6640 1 --2- 172.21.15.19:0/2387807832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc744158b50 0x7fc744147d90 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.777+0000 7fc74a3f6640 1 --2- 172.21.15.19:0/2387807832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7440b6360 0x7fc744153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.777+0000 7fc74a3f6640 1 -- 172.21.15.19:0/2387807832 >> 172.21.15.19:0/2387807832 conn(0x7fc7440b79e0 msgr2=0x7fc744161800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.777+0000 7fc74a3f6640 1 -- 172.21.15.19:0/2387807832 shutdown_connections 2024-09-12T02:06:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.777+0000 7fc74a3f6640 1 -- 172.21.15.19:0/2387807832 wait complete. 2024-09-12T02:06:54.790 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:06:54.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.903+0000 7f1cd511f640 1 Processor -- start 2024-09-12T02:06:54.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.903+0000 7f1cd511f640 1 -- start start 2024-09-12T02:06:54.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.903+0000 7f1cd511f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1cd015e900 0x7f1cd00b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.903+0000 7f1cd511f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cd00b4620 con 0x7f1cd0072050 2024-09-12T02:06:54.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.903+0000 7f1cd511f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cd00ce100 con 0x7f1cd00b4a20 2024-09-12T02:06:54.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.903+0000 7f1cd511f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f1cd00ce3a0 con 0x7f1cd015e900 2024-09-12T02:06:54.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.904+0000 7f1cced9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1cd015e900 0x7f1cd00b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.904+0000 7f1cced9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1cd015e900 0x7f1cd00b4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42136/0 (socket says 172.21.15.19:42136) 2024-09-12T02:06:54.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.904+0000 7f1ccf59e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1cd0072050 0x7f1cd00cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52046/0 (socket says 172.21.15.19:52046) 2024-09-12T02:06:54.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.904+0000 7f1cced9d640 1 -- 172.21.15.19:0/600364670 learned_addr learned my addr 172.21.15.19:0/600364670 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:54.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.904+0000 7f1cced9d640 1 -- 172.21.15.19:0/600364670 >> v1:172.21.15.135:6789/0 conn(0x7f1cd00b4a20 legacy=0x7f1cd00ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:54.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.904+0000 7f1cced9d640 1 -- 172.21.15.19:0/600364670 >> v1:172.21.15.19:6789/0 conn(0x7f1cd0072050 legacy=0x7f1cd00cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:54.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.904+0000 7f1cced9d640 1 -- 172.21.15.19:0/600364670 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd00ce680 con 0x7f1cd015e900 2024-09-12T02:06:54.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.904+0000 7f1ccdd9b640 1 -- 172.21.15.19:0/600364670 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553590774 0 0) 0x7f1cd00b4620 con 0x7f1cd0072050 2024-09-12T02:06:54.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.905+0000 7f1cced9d640 1 --2- 172.21.15.19:0/600364670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cd015e900 0x7f1cd00b4020 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009870 tx=0x7f1cc002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3cc69779314be2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:54.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.905+0000 7f1ccdd9b640 1 -- 172.21.15.19:0/600364670 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0037070 con 0x7f1cd015e900 2024-09-12T02:06:54.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.905+0000 7f1ccdd9b640 1 -- 172.21.15.19:0/600364670 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc0032440 con 0x7f1cd015e900 2024-09-12T02:06:54.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.905+0000 7f1ccdd9b640 1 -- 172.21.15.19:0/600364670 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0032810 con 0x7f1cd015e900 2024-09-12T02:06:54.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.905+0000 7f1cd511f640 1 -- 172.21.15.19:0/600364670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cd015e900 msgr2=0x7f1cd00b4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:54.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.905+0000 7f1cd511f640 1 --2- 172.21.15.19:0/600364670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cd015e900 0x7f1cd00b4020 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009870 tx=0x7f1cc002a210 comp rx=0 tx=0).stop 2024-09-12T02:06:54.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.905+0000 7f1cd511f640 1 -- 172.21.15.19:0/600364670 shutdown_connections 2024-09-12T02:06:54.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.905+0000 7f1cd511f640 1 --2- 172.21.15.19:0/600364670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cd015e900 0x7f1cd00b4020 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.905+0000 7f1cd511f640 1 -- 172.21.15.19:0/600364670 >> 172.21.15.19:0/600364670 conn(0x7f1cd006bdf0 msgr2=0x7f1cd006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:54.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.906+0000 7f1cd511f640 1 -- 172.21.15.19:0/600364670 shutdown_connections 2024-09-12T02:06:54.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.906+0000 7f1cd511f640 1 -- 172.21.15.19:0/600364670 wait complete. 2024-09-12T02:06:54.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.907+0000 7f1cd511f640 1 Processor -- start 2024-09-12T02:06:54.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.907+0000 7f1cd511f640 1 -- start start 2024-09-12T02:06:54.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.908+0000 7f1cd511f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cd0072050 0x7f1cd0155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.908+0000 7f1cd511f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cd00b4a20 0x7f1cd01f7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.908+0000 7f1cd511f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cd015e900 0x7f1cd0155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.908+0000 7f1cd511f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd00cf590 con 0x7f1cd015e900 2024-09-12T02:06:54.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.908+0000 7f1cd511f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd00b4e50 con 0x7f1cd0072050 2024-09-12T02:06:54.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.908+0000 7f1cd511f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1cd00cf710 con 0x7f1cd00b4a20 2024-09-12T02:06:54.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.908+0000 7f1ccf59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cd015e900 0x7f1cd0155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.908+0000 7f1ccf59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cd015e900 0x7f1cd0155120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42142/0 (socket says 172.21.15.19:42142) 2024-09-12T02:06:54.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.908+0000 7f1ccf59e640 1 -- 172.21.15.19:0/1566202109 learned_addr learned my addr 172.21.15.19:0/1566202109 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:54.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.908+0000 7f1cced9d640 1 --2- 172.21.15.19:0/1566202109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cd0072050 0x7f1cd0155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.908+0000 7f1cce59c640 1 --2- 172.21.15.19:0/1566202109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cd00b4a20 0x7f1cd01f7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.908+0000 7f1ccf59e640 1 -- 172.21.15.19:0/1566202109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cd00b4a20 msgr2=0x7f1cd01f7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:54.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.908+0000 7f1ccf59e640 1 --2- 172.21.15.19:0/1566202109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cd00b4a20 0x7f1cd01f7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.908+0000 7f1ccf59e640 1 -- 172.21.15.19:0/1566202109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cd0072050 msgr2=0x7f1cd0155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:54.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.908+0000 7f1ccf59e640 1 --2- 172.21.15.19:0/1566202109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cd0072050 0x7f1cd0155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.908+0000 7f1ccf59e640 1 -- 172.21.15.19:0/1566202109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd00cce80 con 0x7f1cd015e900 2024-09-12T02:06:54.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.908+0000 7f1ccf59e640 1 --2- 172.21.15.19:0/1566202109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cd015e900 0x7f1cd0155120 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800c7e0 tx=0x7f1cc800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:54.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.909+0000 7f1cb77fe640 1 -- 172.21.15.19:0/1566202109 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8018070 con 0x7f1cd015e900 2024-09-12T02:06:54.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.909+0000 7f1cb77fe640 1 -- 172.21.15.19:0/1566202109 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc800a640 con 0x7f1cd015e900 2024-09-12T02:06:54.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.909+0000 7f1cd511f640 1 -- 172.21.15.19:0/1566202109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cd01f88f0 con 0x7f1cd015e900 2024-09-12T02:06:54.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.909+0000 7f1cb77fe640 1 -- 172.21.15.19:0/1566202109 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc800aa30 con 0x7f1cd015e900 2024-09-12T02:06:54.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.909+0000 7f1cd511f640 1 -- 172.21.15.19:0/1566202109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cd0157030 con 0x7f1cd015e900 2024-09-12T02:06:54.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.910+0000 7f1cd511f640 1 -- 172.21.15.19:0/1566202109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cd015a860 con 0x7f1cd015e900 2024-09-12T02:06:54.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.910+0000 7f1cb77fe640 1 -- 172.21.15.19:0/1566202109 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1cc801b070 con 0x7f1cd015e900 2024-09-12T02:06:54.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.911+0000 7f1cb77fe640 1 --2- 172.21.15.19:0/1566202109 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cbc06be30 0x7f1cbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.911+0000 7f1cb77fe640 1 -- 172.21.15.19:0/1566202109 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 9657+0+0 (secure 0 0 0) 0x7f1cc808b3d0 con 0x7f1cd015e900 2024-09-12T02:06:54.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.911+0000 7f1cced9d640 1 --2- 172.21.15.19:0/1566202109 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cbc06be30 0x7f1cbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.912+0000 7f1cced9d640 1 --2- 172.21.15.19:0/1566202109 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cbc06be30 0x7f1cbc06e2f0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0034000 tx=0x7f1cc002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:54.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:54.915+0000 7f1cb77fe640 1 -- 172.21.15.19:0/1566202109 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1cc8058770 con 0x7f1cd015e900 2024-09-12T02:06:55.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.089+0000 7f1cd511f640 1 -- 172.21.15.19:0/1566202109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1cd0070750 con 0x7f1cd015e900 2024-09-12T02:06:55.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.776+0000 7f1cb77fe640 1 -- 172.21.15.19:0/1566202109 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v135) ==== 181+0+0 (secure 0 0 0) 0x7f1cc805ca70 con 0x7f1cd015e900 2024-09-12T02:06:55.776 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:06:55.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.779+0000 7f1cd511f640 1 -- 172.21.15.19:0/1566202109 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cbc06be30 msgr2=0x7f1cbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:55.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.779+0000 7f1cd511f640 1 --2- 172.21.15.19:0/1566202109 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cbc06be30 0x7f1cbc06e2f0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0034000 tx=0x7f1cc002e000 comp rx=0 tx=0).stop 2024-09-12T02:06:55.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.779+0000 7f1cd511f640 1 -- 172.21.15.19:0/1566202109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cd015e900 msgr2=0x7f1cd0155120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:55.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.779+0000 7f1cd511f640 1 --2- 172.21.15.19:0/1566202109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cd015e900 0x7f1cd0155120 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800c7e0 tx=0x7f1cc800cca0 comp rx=0 tx=0).stop 2024-09-12T02:06:55.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.779+0000 7f1cd511f640 1 -- 172.21.15.19:0/1566202109 shutdown_connections 2024-09-12T02:06:55.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.779+0000 7f1cd511f640 1 --2- 172.21.15.19:0/1566202109 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cbc06be30 0x7f1cbc06e2f0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:55.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.779+0000 7f1cd511f640 1 --2- 172.21.15.19:0/1566202109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cd015e900 0x7f1cd0155120 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:55.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.779+0000 7f1cd511f640 1 --2- 172.21.15.19:0/1566202109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cd00b4a20 0x7f1cd01f7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:55.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.779+0000 7f1cd511f640 1 --2- 172.21.15.19:0/1566202109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cd0072050 0x7f1cd0155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:55.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.779+0000 7f1cd511f640 1 -- 172.21.15.19:0/1566202109 >> 172.21.15.19:0/1566202109 conn(0x7f1cd006bdf0 msgr2=0x7f1cd00ae2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:55.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.779+0000 7f1cd511f640 1 -- 172.21.15.19:0/1566202109 shutdown_connections 2024-09-12T02:06:55.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.779+0000 7f1cd511f640 1 -- 172.21.15.19:0/1566202109 wait complete. 2024-09-12T02:06:55.795 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:06:55.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.908+0000 7fad72053640 1 Processor -- start 2024-09-12T02:06:55.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.908+0000 7fad72053640 1 -- start start 2024-09-12T02:06:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.909+0000 7fad72053640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fad6c0b5fe0 0x7fad6c0aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.909+0000 7fad72053640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad6c06bc10 0x7fad6c06c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.909+0000 7fad72053640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad6c0ae240 con 0x7fad6c15e410 2024-09-12T02:06:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.909+0000 7fad72053640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fad6c06c5c0 con 0x7fad6c0b5fe0 2024-09-12T02:06:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.909+0000 7fad72053640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fad6c0b6430 con 0x7fad6c06bc10 2024-09-12T02:06:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.909+0000 7fad6bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad6c06bc10 0x7fad6c06c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.909+0000 7fad6bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad6c06bc10 0x7fad6c06c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:52666/0 (socket says 172.21.15.19:52666) 2024-09-12T02:06:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.909+0000 7fad6bfff640 1 -- 172.21.15.19:0/1482438520 learned_addr learned my addr 172.21.15.19:0/1482438520 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:55.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.909+0000 7fad6affd640 1 --2- 172.21.15.19:0/1482438520 >> v2:172.21.15.135:3300/0 conn(0x7fad6c0b5fe0 0x7fad6c0aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:55.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.910+0000 7fad6a7fc640 1 -- 172.21.15.19:0/1482438520 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2155283807 0 0) 0x7fad6c0ae240 con 0x7fad6c15e410 2024-09-12T02:06:55.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.910+0000 7fad6bfff640 1 -- 172.21.15.19:0/1482438520 >> v2:172.21.15.135:3300/0 conn(0x7fad6c0b5fe0 msgr2=0x7fad6c0aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:55.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.910+0000 7fad6bfff640 1 --2- 172.21.15.19:0/1482438520 >> v2:172.21.15.135:3300/0 conn(0x7fad6c0b5fe0 0x7fad6c0aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:55.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.910+0000 7fad6bfff640 1 -- 172.21.15.19:0/1482438520 >> v1:172.21.15.135:6789/0 conn(0x7fad6c15e410 legacy=0x7fad6c0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:55.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.910+0000 7fad6bfff640 1 -- 172.21.15.19:0/1482438520 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6c0ae520 con 0x7fad6c06bc10 2024-09-12T02:06:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.910+0000 7fad6bfff640 1 --2- 172.21.15.19:0/1482438520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad6c06bc10 0x7fad6c06c080 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fad64009e50 tx=0x7fad6402a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc2caa928035b82e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.911+0000 7fad6a7fc640 1 -- 172.21.15.19:0/1482438520 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64036070 con 0x7fad6c06bc10 2024-09-12T02:06:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.911+0000 7fad6a7fc640 1 -- 172.21.15.19:0/1482438520 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad64031600 con 0x7fad6c06bc10 2024-09-12T02:06:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.911+0000 7fad6a7fc640 1 -- 172.21.15.19:0/1482438520 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad640319d0 con 0x7fad6c06bc10 2024-09-12T02:06:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.911+0000 7fad72053640 1 -- 172.21.15.19:0/1482438520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad6c06bc10 msgr2=0x7fad6c06c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.911+0000 7fad72053640 1 --2- 172.21.15.19:0/1482438520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad6c06bc10 0x7fad6c06c080 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fad64009e50 tx=0x7fad6402a680 comp rx=0 tx=0).stop 2024-09-12T02:06:55.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.911+0000 7fad72053640 1 -- 172.21.15.19:0/1482438520 shutdown_connections 2024-09-12T02:06:55.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.911+0000 7fad72053640 1 --2- 172.21.15.19:0/1482438520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad6c06bc10 0x7fad6c06c080 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:55.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.911+0000 7fad72053640 1 --2- 172.21.15.19:0/1482438520 >> v2:172.21.15.135:3300/0 conn(0x7fad6c0b5fe0 0x7fad6c0aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:55.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.911+0000 7fad72053640 1 -- 172.21.15.19:0/1482438520 >> 172.21.15.19:0/1482438520 conn(0x7fad6c09aa30 msgr2=0x7fad6c0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:55.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.911+0000 7fad72053640 1 -- 172.21.15.19:0/1482438520 shutdown_connections 2024-09-12T02:06:55.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.911+0000 7fad72053640 1 -- 172.21.15.19:0/1482438520 wait complete. 2024-09-12T02:06:55.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.913+0000 7fad72053640 1 Processor -- start 2024-09-12T02:06:55.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.913+0000 7fad72053640 1 -- start start 2024-09-12T02:06:55.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.913+0000 7fad72053640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad6c06bc10 0x7fad6c15d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:55.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.913+0000 7fad72053640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad6c0b5fe0 0x7fad6c09d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:55.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.913+0000 7fad72053640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad6c15e410 0x7fad6c09d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:55.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.913+0000 7fad72053640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fad6c0b0480 con 0x7fad6c06bc10 2024-09-12T02:06:55.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.913+0000 7fad72053640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad6c0aeae0 con 0x7fad6c15e410 2024-09-12T02:06:55.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.913+0000 7fad72053640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fad6c15e7f0 con 0x7fad6c0b5fe0 2024-09-12T02:06:55.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.914+0000 7fad6b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad6c06bc10 0x7fad6c15d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:55.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.914+0000 7fad6b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad6c06bc10 0x7fad6c15d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42154/0 (socket says 172.21.15.19:42154) 2024-09-12T02:06:55.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.914+0000 7fad6b7fe640 1 -- 172.21.15.19:0/2062558625 learned_addr learned my addr 172.21.15.19:0/2062558625 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:55.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.914+0000 7fad6bfff640 1 --2- 172.21.15.19:0/2062558625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad6c15e410 0x7fad6c09d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:55.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.914+0000 7fad6affd640 1 --2- 172.21.15.19:0/2062558625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad6c0b5fe0 0x7fad6c09d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:55.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.914+0000 7fad6b7fe640 1 -- 172.21.15.19:0/2062558625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad6c0b5fe0 msgr2=0x7fad6c09d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:55.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.914+0000 7fad6b7fe640 1 --2- 172.21.15.19:0/2062558625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad6c0b5fe0 0x7fad6c09d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:55.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.914+0000 7fad6b7fe640 1 -- 172.21.15.19:0/2062558625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad6c15e410 msgr2=0x7fad6c09d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:55.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.914+0000 7fad6b7fe640 1 --2- 172.21.15.19:0/2062558625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad6c15e410 0x7fad6c09d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:55.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.914+0000 7fad6b7fe640 1 -- 172.21.15.19:0/2062558625 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6c09b570 con 0x7fad6c06bc10 2024-09-12T02:06:55.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.914+0000 7fad6b7fe640 1 --2- 172.21.15.19:0/2062558625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad6c06bc10 0x7fad6c15d410 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00c440 tx=0x7fad5c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:55.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.914+0000 7fad53fff640 1 -- 172.21.15.19:0/2062558625 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c017070 con 0x7fad6c06bc10 2024-09-12T02:06:55.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.914+0000 7fad53fff640 1 -- 172.21.15.19:0/2062558625 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad5c005480 con 0x7fad6c06bc10 2024-09-12T02:06:55.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.914+0000 7fad72053640 1 -- 172.21.15.19:0/2062558625 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad6c09b850 con 0x7fad6c06bc10 2024-09-12T02:06:55.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.914+0000 7fad53fff640 1 -- 172.21.15.19:0/2062558625 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c003830 con 0x7fad6c06bc10 2024-09-12T02:06:55.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.914+0000 7fad72053640 1 -- 172.21.15.19:0/2062558625 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad6c09be10 con 0x7fad6c06bc10 2024-09-12T02:06:55.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.915+0000 7fad72053640 1 -- 172.21.15.19:0/2062558625 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad6c06c080 con 0x7fad6c06bc10 2024-09-12T02:06:55.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.916+0000 7fad53fff640 1 -- 172.21.15.19:0/2062558625 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad5c01a070 con 0x7fad6c06bc10 2024-09-12T02:06:55.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.916+0000 7fad53fff640 1 --2- 172.21.15.19:0/2062558625 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fad5806be30 0x7fad5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:55.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.916+0000 7fad53fff640 1 -- 172.21.15.19:0/2062558625 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 9219+0+0 (secure 0 0 0) 0x7fad5c08b020 con 0x7fad6c06bc10 2024-09-12T02:06:55.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.917+0000 7fad6affd640 1 --2- 172.21.15.19:0/2062558625 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fad5806be30 0x7fad5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:55.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.917+0000 7fad6affd640 1 --2- 172.21.15.19:0/2062558625 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fad5806be30 0x7fad5806e2f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fad6c151660 tx=0x7fad60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:55.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:55.921+0000 7fad53fff640 1 -- 172.21.15.19:0/2062558625 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad5c058b40 con 0x7fad6c06bc10 2024-09-12T02:06:56.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.097+0000 7fad72053640 1 -- 172.21.15.19:0/2062558625 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fad6c160f30 con 0x7fad6c06bc10 2024-09-12T02:06:56.275 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:06:56.278 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:06:56.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.794+0000 7fad53fff640 1 -- 172.21.15.19:0/2062558625 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v136) ==== 169+0+0 (secure 0 0 0) 0x7fad5c058440 con 0x7fad6c06bc10 2024-09-12T02:06:56.793 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-09-12T02:06:56.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.796+0000 7fad72053640 1 -- 172.21.15.19:0/2062558625 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fad5806be30 msgr2=0x7fad5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:56.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.796+0000 7fad72053640 1 --2- 172.21.15.19:0/2062558625 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fad5806be30 0x7fad5806e2f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fad6c151660 tx=0x7fad60008040 comp rx=0 tx=0).stop 2024-09-12T02:06:56.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.797+0000 7fad72053640 1 -- 172.21.15.19:0/2062558625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad6c06bc10 msgr2=0x7fad6c15d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:56.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.797+0000 7fad72053640 1 --2- 172.21.15.19:0/2062558625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad6c06bc10 0x7fad6c15d410 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00c440 tx=0x7fad5c00c900 comp rx=0 tx=0).stop 2024-09-12T02:06:56.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.797+0000 7fad72053640 1 -- 172.21.15.19:0/2062558625 shutdown_connections 2024-09-12T02:06:56.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.797+0000 7fad72053640 1 --2- 172.21.15.19:0/2062558625 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fad5806be30 0x7fad5806e2f0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.797+0000 7fad72053640 1 --2- 172.21.15.19:0/2062558625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad6c15e410 0x7fad6c09d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.797+0000 7fad72053640 1 --2- 172.21.15.19:0/2062558625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad6c0b5fe0 0x7fad6c09d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.797+0000 7fad72053640 1 --2- 172.21.15.19:0/2062558625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad6c06bc10 0x7fad6c15d410 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.797+0000 7fad72053640 1 -- 172.21.15.19:0/2062558625 >> 172.21.15.19:0/2062558625 conn(0x7fad6c09aa30 msgr2=0x7fad6c0b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:56.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.797+0000 7fad72053640 1 -- 172.21.15.19:0/2062558625 shutdown_connections 2024-09-12T02:06:56.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.797+0000 7fad72053640 1 -- 172.21.15.19:0/2062558625 wait complete. 2024-09-12T02:06:56.813 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:06:56.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.925+0000 7f8ab31d6640 1 Processor -- start 2024-09-12T02:06:56.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.925+0000 7f8ab31d6640 1 -- start start 2024-09-12T02:06:56.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.926+0000 7f8ab31d6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8aac158b50 0x7f8aac0b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.926+0000 7f8ab31d6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8aac0b6360 0x7f8aac09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.926+0000 7f8ab31d6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aac0b6820 con 0x7f8aac15f950 2024-09-12T02:06:56.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.926+0000 7f8ab31d6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8aac0b6b00 con 0x7f8aac158b50 2024-09-12T02:06:56.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.926+0000 7f8ab31d6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac0b6de0 con 0x7f8aac0b6360 2024-09-12T02:06:56.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.926+0000 7f8ab0f72640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8aac158b50 0x7f8aac0b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.926+0000 7f8ab1773640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8aac15f950 0x7f8aac162220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52058/0 (socket says 172.21.15.19:52058) 2024-09-12T02:06:56.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.926+0000 7f8ab1773640 1 -- 172.21.15.19:0/2008478901 learned_addr learned my addr 172.21.15.19:0/2008478901 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:56.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.926+0000 7f8aabfff640 1 --2- 172.21.15.19:0/2008478901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8aac0b6360 0x7f8aac09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.927+0000 7f8ab0f72640 1 -- 172.21.15.19:0/2008478901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8aac0b6360 msgr2=0x7f8aac09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:56.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.927+0000 7f8ab0f72640 1 --2- 172.21.15.19:0/2008478901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8aac0b6360 0x7f8aac09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.927+0000 7f8ab0f72640 1 -- 172.21.15.19:0/2008478901 >> v1:172.21.15.19:6789/0 conn(0x7f8aac15f950 legacy=0x7f8aac162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:56.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.927+0000 7f8ab0f72640 1 -- 172.21.15.19:0/2008478901 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac0b70c0 con 0x7f8aac158b50 2024-09-12T02:06:56.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.927+0000 7f8aab7fe640 1 -- 172.21.15.19:0/2008478901 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2253074075 0 0) 0x7f8aac0b6820 con 0x7f8aac15f950 2024-09-12T02:06:56.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.927+0000 7f8ab0f72640 1 --2- 172.21.15.19:0/2008478901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac158b50 0x7f8aac0b5e20 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0097a0 tx=0x7f8a9c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41bb7e8b71f4ff33 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:56.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.928+0000 7f8aab7fe640 1 -- 172.21.15.19:0/2008478901 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c037070 con 0x7f8aac158b50 2024-09-12T02:06:56.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.928+0000 7f8aab7fe640 1 -- 172.21.15.19:0/2008478901 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9c032440 con 0x7f8aac158b50 2024-09-12T02:06:56.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.928+0000 7f8aab7fe640 1 -- 172.21.15.19:0/2008478901 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c032810 con 0x7f8aac158b50 2024-09-12T02:06:56.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.928+0000 7f8ab31d6640 1 -- 172.21.15.19:0/2008478901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac158b50 msgr2=0x7f8aac0b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:56.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.928+0000 7f8ab31d6640 1 --2- 172.21.15.19:0/2008478901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac158b50 0x7f8aac0b5e20 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0097a0 tx=0x7f8a9c02a180 comp rx=0 tx=0).stop 2024-09-12T02:06:56.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.928+0000 7f8ab31d6640 1 -- 172.21.15.19:0/2008478901 shutdown_connections 2024-09-12T02:06:56.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.928+0000 7f8ab31d6640 1 --2- 172.21.15.19:0/2008478901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8aac0b6360 0x7f8aac09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.928+0000 7f8ab31d6640 1 --2- 172.21.15.19:0/2008478901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac158b50 0x7f8aac0b5e20 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.928+0000 7f8ab31d6640 1 -- 172.21.15.19:0/2008478901 >> 172.21.15.19:0/2008478901 conn(0x7f8aac0b79e0 msgr2=0x7f8aac0b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:56.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.928+0000 7f8ab31d6640 1 -- 172.21.15.19:0/2008478901 shutdown_connections 2024-09-12T02:06:56.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.928+0000 7f8ab31d6640 1 -- 172.21.15.19:0/2008478901 wait complete. 2024-09-12T02:06:56.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.929+0000 7f8ab31d6640 1 Processor -- start 2024-09-12T02:06:56.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.929+0000 7f8ab31d6640 1 -- start start 2024-09-12T02:06:56.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.930+0000 7f8ab31d6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8aac0b6360 0x7f8aac1541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.930+0000 7f8ab31d6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8aac158b50 0x7f8aac154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.930+0000 7f8ab31d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac15f950 0x7f8aac0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.930+0000 7f8ab31d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac1590b0 con 0x7f8aac15f950 2024-09-12T02:06:56.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.930+0000 7f8ab31d6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac158f30 con 0x7f8aac158b50 2024-09-12T02:06:56.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.930+0000 7f8ab31d6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac070ea0 con 0x7f8aac0b6360 2024-09-12T02:06:56.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.931+0000 7f8ab1773640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac15f950 0x7f8aac0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.931+0000 7f8ab1773640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac15f950 0x7f8aac0af3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42158/0 (socket says 172.21.15.19:42158) 2024-09-12T02:06:56.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.931+0000 7f8ab1773640 1 -- 172.21.15.19:0/1766936645 learned_addr learned my addr 172.21.15.19:0/1766936645 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:56.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.931+0000 7f8aabfff640 1 --2- 172.21.15.19:0/1766936645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8aac158b50 0x7f8aac154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.931+0000 7f8ab0f72640 1 --2- 172.21.15.19:0/1766936645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8aac0b6360 0x7f8aac1541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.931+0000 7f8ab1773640 1 -- 172.21.15.19:0/1766936645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8aac0b6360 msgr2=0x7f8aac1541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:56.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.931+0000 7f8ab1773640 1 --2- 172.21.15.19:0/1766936645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8aac0b6360 0x7f8aac1541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.931+0000 7f8ab1773640 1 -- 172.21.15.19:0/1766936645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8aac158b50 msgr2=0x7f8aac154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:56.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.931+0000 7f8ab1773640 1 --2- 172.21.15.19:0/1766936645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8aac158b50 0x7f8aac154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.931+0000 7f8ab1773640 1 -- 172.21.15.19:0/1766936645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac09e8a0 con 0x7f8aac15f950 2024-09-12T02:06:56.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.931+0000 7f8ab0f72640 1 --2- 172.21.15.19:0/1766936645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8aac0b6360 0x7f8aac1541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:56.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.931+0000 7f8ab1773640 1 --2- 172.21.15.19:0/1766936645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac15f950 0x7f8aac0af3a0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400c6d0 tx=0x7f8aa400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:56.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.931+0000 7f8aa97fa640 1 -- 172.21.15.19:0/1766936645 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4018070 con 0x7f8aac15f950 2024-09-12T02:06:56.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.931+0000 7f8aa97fa640 1 -- 172.21.15.19:0/1766936645 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa4004d60 con 0x7f8aac15f950 2024-09-12T02:06:56.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.931+0000 7f8ab31d6640 1 -- 172.21.15.19:0/1766936645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aac155000 con 0x7f8aac15f950 2024-09-12T02:06:56.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.931+0000 7f8aa97fa640 1 -- 172.21.15.19:0/1766936645 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa400a880 con 0x7f8aac15f950 2024-09-12T02:06:56.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.931+0000 7f8ab31d6640 1 -- 172.21.15.19:0/1766936645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aac0b0e20 con 0x7f8aac15f950 2024-09-12T02:06:56.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.932+0000 7f8ab31d6640 1 -- 172.21.15.19:0/1766936645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aac0b5e20 con 0x7f8aac15f950 2024-09-12T02:06:56.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.933+0000 7f8aa97fa640 1 -- 172.21.15.19:0/1766936645 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8aa401b070 con 0x7f8aac15f950 2024-09-12T02:06:56.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.933+0000 7f8aa97fa640 1 --2- 172.21.15.19:0/1766936645 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a9806be60 0x7f8a9806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.933+0000 7f8aa97fa640 1 -- 172.21.15.19:0/1766936645 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 8689+0+0 (secure 0 0 0) 0x7f8aa408b060 con 0x7f8aac15f950 2024-09-12T02:06:56.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.934+0000 7f8ab0f72640 1 --2- 172.21.15.19:0/1766936645 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a9806be60 0x7f8a9806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.934+0000 7f8ab0f72640 1 --2- 172.21.15.19:0/1766936645 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a9806be60 0x7f8a9806e320 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c034000 tx=0x7f8a9c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:56.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:56.938+0000 7f8aa97fa640 1 -- 172.21.15.19:0/1766936645 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8aac09e8a0 con 0x7f8aac15f950 2024-09-12T02:06:57.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.123+0000 7f8ab31d6640 1 -- 172.21.15.19:0/1766936645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f8aac0b77a0 con 0x7f8aac15f950 2024-09-12T02:06:57.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.126+0000 7f8aa97fa640 1 -- 172.21.15.19:0/1766936645 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) ==== 104+0+0 (secure 0 0 0) 0x7f8aa4058db0 con 0x7f8aac15f950 2024-09-12T02:06:57.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.128+0000 7f8ab31d6640 1 -- 172.21.15.19:0/1766936645 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a9806be60 msgr2=0x7f8a9806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:57.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.128+0000 7f8ab31d6640 1 --2- 172.21.15.19:0/1766936645 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a9806be60 0x7f8a9806e320 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c034000 tx=0x7f8a9c02e000 comp rx=0 tx=0).stop 2024-09-12T02:06:57.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.128+0000 7f8ab31d6640 1 -- 172.21.15.19:0/1766936645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac15f950 msgr2=0x7f8aac0af3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:57.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.128+0000 7f8ab31d6640 1 --2- 172.21.15.19:0/1766936645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac15f950 0x7f8aac0af3a0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400c6d0 tx=0x7f8aa400cb90 comp rx=0 tx=0).stop 2024-09-12T02:06:57.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.129+0000 7f8ab31d6640 1 -- 172.21.15.19:0/1766936645 shutdown_connections 2024-09-12T02:06:57.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.129+0000 7f8ab31d6640 1 --2- 172.21.15.19:0/1766936645 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a9806be60 0x7f8a9806e320 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.129+0000 7f8ab31d6640 1 --2- 172.21.15.19:0/1766936645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aac15f950 0x7f8aac0af3a0 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.129+0000 7f8ab31d6640 1 --2- 172.21.15.19:0/1766936645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8aac158b50 0x7f8aac154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.129+0000 7f8ab31d6640 1 --2- 172.21.15.19:0/1766936645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8aac0b6360 0x7f8aac1541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.129+0000 7f8ab31d6640 1 -- 172.21.15.19:0/1766936645 >> 172.21.15.19:0/1766936645 conn(0x7f8aac0b79e0 msgr2=0x7f8aac06fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:57.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.129+0000 7f8ab31d6640 1 -- 172.21.15.19:0/1766936645 shutdown_connections 2024-09-12T02:06:57.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.129+0000 7f8ab31d6640 1 -- 172.21.15.19:0/1766936645 wait complete. 2024-09-12T02:06:57.139 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_damage.TestDamage.test_object_deletion' 2024-09-12T02:06:57.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.242+0000 7ff42edd6640 1 Processor -- start 2024-09-12T02:06:57.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.242+0000 7ff42edd6640 1 -- start start 2024-09-12T02:06:57.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.243+0000 7ff42edd6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff42815e5d0 0x7ff4280d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:57.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.243+0000 7ff42edd6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42806cec0 con 0x7ff42809b140 2024-09-12T02:06:57.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.243+0000 7ff42edd6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42806d1a0 con 0x7ff42806df60 2024-09-12T02:06:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.243+0000 7ff42edd6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff42806dad0 con 0x7ff42815e5d0 2024-09-12T02:06:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.243+0000 7ff42d373640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff42809b140 0x7ff428168560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52070/0 (socket says 172.21.15.19:52070) 2024-09-12T02:06:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.243+0000 7ff42d373640 1 -- 172.21.15.19:0/4034003416 learned_addr learned my addr 172.21.15.19:0/4034003416 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.243+0000 7ff42cb72640 1 --2- 172.21.15.19:0/4034003416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff42815e5d0 0x7ff4280d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.244+0000 7ff4277fe640 1 -- 172.21.15.19:0/4034003416 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1445047405 0 0) 0x7ff42806cec0 con 0x7ff42809b140 2024-09-12T02:06:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.244+0000 7ff4277fe640 1 -- 172.21.15.19:0/4034003416 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff414003520 con 0x7ff42809b140 2024-09-12T02:06:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.244+0000 7ff4277fe640 1 -- 172.21.15.19:0/4034003416 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1007272129 0 0) 0x7ff42806d1a0 con 0x7ff42806df60 2024-09-12T02:06:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.244+0000 7ff4277fe640 1 -- 172.21.15.19:0/4034003416 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff42806cec0 con 0x7ff42806df60 2024-09-12T02:06:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.244+0000 7ff42cb72640 1 -- 172.21.15.19:0/4034003416 >> v1:172.21.15.135:6789/0 conn(0x7ff42806df60 legacy=0x7ff42809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.244+0000 7ff42cb72640 1 -- 172.21.15.19:0/4034003416 >> v1:172.21.15.19:6789/0 conn(0x7ff42809b140 legacy=0x7ff428168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.244+0000 7ff4277fe640 1 -- 172.21.15.19:0/4034003416 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2121501930 0 0) 0x7ff414003520 con 0x7ff42809b140 2024-09-12T02:06:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.244+0000 7ff42cb72640 1 -- 172.21.15.19:0/4034003416 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff42806d480 con 0x7ff42815e5d0 2024-09-12T02:06:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.245+0000 7ff42cb72640 1 --2- 172.21.15.19:0/4034003416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff42815e5d0 0x7ff4280d10f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff418009dc0 tx=0x7ff41802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9e38534e8f2104f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.245+0000 7ff4277fe640 1 -- 172.21.15.19:0/4034003416 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff420001670 con 0x7ff42815e5d0 2024-09-12T02:06:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.245+0000 7ff4277fe640 1 -- 172.21.15.19:0/4034003416 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff41802ae50 con 0x7ff42815e5d0 2024-09-12T02:06:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.245+0000 7ff4277fe640 1 -- 172.21.15.19:0/4034003416 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418007760 con 0x7ff42815e5d0 2024-09-12T02:06:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.245+0000 7ff42edd6640 1 -- 172.21.15.19:0/4034003416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff42815e5d0 msgr2=0x7ff4280d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.245+0000 7ff42edd6640 1 --2- 172.21.15.19:0/4034003416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff42815e5d0 0x7ff4280d10f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff418009dc0 tx=0x7ff41802a6f0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.245+0000 7ff42edd6640 1 -- 172.21.15.19:0/4034003416 shutdown_connections 2024-09-12T02:06:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.245+0000 7ff42edd6640 1 --2- 172.21.15.19:0/4034003416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff42815e5d0 0x7ff4280d10f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.245+0000 7ff42edd6640 1 -- 172.21.15.19:0/4034003416 >> 172.21.15.19:0/4034003416 conn(0x7ff4280d23a0 msgr2=0x7ff4280d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.245+0000 7ff42edd6640 1 -- 172.21.15.19:0/4034003416 shutdown_connections 2024-09-12T02:06:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.245+0000 7ff42edd6640 1 -- 172.21.15.19:0/4034003416 wait complete. 2024-09-12T02:06:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.247+0000 7ff42edd6640 1 Processor -- start 2024-09-12T02:06:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.247+0000 7ff42edd6640 1 -- start start 2024-09-12T02:06:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff42edd6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff42806df60 0x7ff428158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff42edd6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff42809b140 0x7ff4280b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff42edd6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff42815e5d0 0x7ff4281564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff42edd6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff42815eb30 con 0x7ff42809b140 2024-09-12T02:06:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff42edd6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff42815e9b0 con 0x7ff42815e5d0 2024-09-12T02:06:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff42edd6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff4280d1630 con 0x7ff42806df60 2024-09-12T02:06:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff427fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff42809b140 0x7ff4280b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff427fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff42809b140 0x7ff4280b79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42174/0 (socket says 172.21.15.19:42174) 2024-09-12T02:06:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff427fff640 1 -- 172.21.15.19:0/3421601600 learned_addr learned my addr 172.21.15.19:0/3421601600 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff42d373640 1 --2- 172.21.15.19:0/3421601600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff42815e5d0 0x7ff4281564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff42cb72640 1 --2- 172.21.15.19:0/3421601600 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff42806df60 0x7ff428158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff427fff640 1 -- 172.21.15.19:0/3421601600 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff42806df60 msgr2=0x7ff428158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff427fff640 1 --2- 172.21.15.19:0/3421601600 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff42806df60 0x7ff428158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff427fff640 1 -- 172.21.15.19:0/3421601600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff42815e5d0 msgr2=0x7ff4281564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff427fff640 1 --2- 172.21.15.19:0/3421601600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff42815e5d0 0x7ff4281564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff427fff640 1 -- 172.21.15.19:0/3421601600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff428157e20 con 0x7ff42809b140 2024-09-12T02:06:57.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff42cb72640 1 --2- 172.21.15.19:0/3421601600 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff42806df60 0x7ff428158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:57.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff427fff640 1 --2- 172.21.15.19:0/3421601600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff42809b140 0x7ff4280b79c0 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7ff41000c450 tx=0x7ff41000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:57.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff4257fa640 1 -- 172.21.15.19:0/3421601600 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4100052d0 con 0x7ff42809b140 2024-09-12T02:06:57.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff4257fa640 1 -- 172.21.15.19:0/3421601600 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff410005470 con 0x7ff42809b140 2024-09-12T02:06:57.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.248+0000 7ff42edd6640 1 -- 172.21.15.19:0/3421601600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff428158100 con 0x7ff42809b140 2024-09-12T02:06:57.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.249+0000 7ff4257fa640 1 -- 172.21.15.19:0/3421601600 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff410012870 con 0x7ff42809b140 2024-09-12T02:06:57.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.249+0000 7ff42edd6640 1 -- 172.21.15.19:0/3421601600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4280b55e0 con 0x7ff42809b140 2024-09-12T02:06:57.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.250+0000 7ff42edd6640 1 -- 172.21.15.19:0/3421601600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4280d10f0 con 0x7ff42809b140 2024-09-12T02:06:57.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.250+0000 7ff4257fa640 1 -- 172.21.15.19:0/3421601600 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff410012a10 con 0x7ff42809b140 2024-09-12T02:06:57.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.251+0000 7ff4257fa640 1 --2- 172.21.15.19:0/3421601600 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff40806be30 0x7ff40806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:57.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.251+0000 7ff4257fa640 1 -- 172.21.15.19:0/3421601600 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 8689+0+0 (secure 0 0 0) 0x7ff41008b640 con 0x7ff42809b140 2024-09-12T02:06:57.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.251+0000 7ff42cb72640 1 --2- 172.21.15.19:0/3421601600 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff40806be30 0x7ff40806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:57.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.251+0000 7ff42cb72640 1 --2- 172.21.15.19:0/3421601600 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff40806be30 0x7ff40806e2f0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ff418034000 tx=0x7ff418033040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:57.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.255+0000 7ff4257fa640 1 -- 172.21.15.19:0/3421601600 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff4100594c0 con 0x7ff42809b140 2024-09-12T02:06:57.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.496+0000 7ff42edd6640 1 -- 172.21.15.19:0/3421601600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_object_deletion"]} v 0) -- 0x7ff42806f0c0 con 0x7ff42809b140 2024-09-12T02:06:57.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.795+0000 7ff4257fa640 1 -- 172.21.15.19:0/3421601600 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_object_deletion"]}]=0 v564) ==== 135+0+0 (secure 0 0 0) 0x7ff410058dc0 con 0x7ff42809b140 2024-09-12T02:06:57.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.797+0000 7ff42edd6640 1 -- 172.21.15.19:0/3421601600 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff40806be30 msgr2=0x7ff40806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:57.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.797+0000 7ff42edd6640 1 --2- 172.21.15.19:0/3421601600 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff40806be30 0x7ff40806e2f0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ff418034000 tx=0x7ff418033040 comp rx=0 tx=0).stop 2024-09-12T02:06:57.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.797+0000 7ff42edd6640 1 -- 172.21.15.19:0/3421601600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff42809b140 msgr2=0x7ff4280b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:57.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.797+0000 7ff42edd6640 1 --2- 172.21.15.19:0/3421601600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff42809b140 0x7ff4280b79c0 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7ff41000c450 tx=0x7ff41000c910 comp rx=0 tx=0).stop 2024-09-12T02:06:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.798+0000 7ff42edd6640 1 -- 172.21.15.19:0/3421601600 shutdown_connections 2024-09-12T02:06:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.798+0000 7ff42edd6640 1 --2- 172.21.15.19:0/3421601600 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff40806be30 0x7ff40806e2f0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.798+0000 7ff42edd6640 1 --2- 172.21.15.19:0/3421601600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff42815e5d0 0x7ff4281564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.798+0000 7ff42edd6640 1 --2- 172.21.15.19:0/3421601600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff42809b140 0x7ff4280b79c0 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.798+0000 7ff42edd6640 1 --2- 172.21.15.19:0/3421601600 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff42806df60 0x7ff428158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.798+0000 7ff42edd6640 1 -- 172.21.15.19:0/3421601600 >> 172.21.15.19:0/3421601600 conn(0x7ff4280d23a0 msgr2=0x7ff4280b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.798+0000 7ff42edd6640 1 -- 172.21.15.19:0/3421601600 shutdown_connections 2024-09-12T02:06:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.798+0000 7ff42edd6640 1 -- 172.21.15.19:0/3421601600 wait complete. 2024-09-12T02:06:57.809 INFO:tasks.cephfs_test_runner:That the MDS has a clean 'damaged' response to loss of any single metadata object ... ok 2024-09-12T02:06:57.809 INFO:tasks.cephfs_test_runner:Starting test: test_open_ino_errors (tasks.cephfs.test_damage.TestDamage) That errors encountered during opening inos are properly propagated 2024-09-12T02:06:57.809 INFO:tasks.cephfs_test_runner:test_open_ino_errors (tasks.cephfs.test_damage.TestDamage) 2024-09-12T02:06:57.809 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:06:57.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.914+0000 7fa81d5bd640 1 Processor -- start 2024-09-12T02:06:58.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.914+0000 7fa81d5bd640 1 -- start start 2024-09-12T02:06:58.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.915+0000 7fa81d5bd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa81815c520 0x7fa81809b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.915+0000 7fa81d5bd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa8180d1090 0x7fa8180b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.915+0000 7fa81d5bd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8180cec00 con 0x7fa8180b1620 2024-09-12T02:06:58.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.915+0000 7fa81d5bd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa81809bd90 con 0x7fa8180d1090 2024-09-12T02:06:58.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.915+0000 7fa81d5bd640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa8180d0010 con 0x7fa81815c520 2024-09-12T02:06:58.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.915+0000 7fa8177fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa8180d1090 0x7fa8180b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.915+0000 7fa8177fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa8180d1090 0x7fa8180b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42190/0 (socket says 172.21.15.19:42190) 2024-09-12T02:06:58.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.915+0000 7fa8177fe640 1 -- 172.21.15.19:0/1249595938 learned_addr learned my addr 172.21.15.19:0/1249595938 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:58.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.916+0000 7fa816ffd640 1 --2- 172.21.15.19:0/1249595938 >> v2:172.21.15.135:3300/0 conn(0x7fa81815c520 0x7fa81809b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.916+0000 7fa8177fe640 1 -- 172.21.15.19:0/1249595938 >> v2:172.21.15.135:3300/0 conn(0x7fa81815c520 msgr2=0x7fa81809b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:58.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.916+0000 7fa8177fe640 1 --2- 172.21.15.19:0/1249595938 >> v2:172.21.15.135:3300/0 conn(0x7fa81815c520 0x7fa81809b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.916+0000 7fa8177fe640 1 -- 172.21.15.19:0/1249595938 >> v1:172.21.15.135:6789/0 conn(0x7fa8180b1620 legacy=0x7fa8180d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:58.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.916+0000 7fa8177fe640 1 -- 172.21.15.19:0/1249595938 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8180d02f0 con 0x7fa8180d1090 2024-09-12T02:06:58.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.916+0000 7fa816ffd640 1 --2- 172.21.15.19:0/1249595938 >> v2:172.21.15.135:3300/0 conn(0x7fa81815c520 0x7fa81809b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:58.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.916+0000 7fa8177fe640 1 --2- 172.21.15.19:0/1249595938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8180d1090 0x7fa8180b1d40 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7fa818073340 tx=0x7fa80802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff19c9e5efcc3bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:58.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.917+0000 7fa815ffb640 1 -- 172.21.15.19:0/1249595938 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa808036070 con 0x7fa8180d1090 2024-09-12T02:06:58.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.917+0000 7fa815ffb640 1 -- 172.21.15.19:0/1249595938 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa808031600 con 0x7fa8180d1090 2024-09-12T02:06:58.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.917+0000 7fa815ffb640 1 -- 172.21.15.19:0/1249595938 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8080319d0 con 0x7fa8180d1090 2024-09-12T02:06:58.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.917+0000 7fa81d5bd640 1 -- 172.21.15.19:0/1249595938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8180d1090 msgr2=0x7fa8180b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:58.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.917+0000 7fa81d5bd640 1 --2- 172.21.15.19:0/1249595938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8180d1090 0x7fa8180b1d40 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7fa818073340 tx=0x7fa80802a730 comp rx=0 tx=0).stop 2024-09-12T02:06:58.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.917+0000 7fa81d5bd640 1 -- 172.21.15.19:0/1249595938 shutdown_connections 2024-09-12T02:06:58.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.917+0000 7fa81d5bd640 1 --2- 172.21.15.19:0/1249595938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8180d1090 0x7fa8180b1d40 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.917+0000 7fa81d5bd640 1 --2- 172.21.15.19:0/1249595938 >> v2:172.21.15.135:3300/0 conn(0x7fa81815c520 0x7fa81809b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.917+0000 7fa81d5bd640 1 -- 172.21.15.19:0/1249595938 >> 172.21.15.19:0/1249595938 conn(0x7fa8180d23a0 msgr2=0x7fa8180d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:58.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.917+0000 7fa81d5bd640 1 -- 172.21.15.19:0/1249595938 shutdown_connections 2024-09-12T02:06:58.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.917+0000 7fa81d5bd640 1 -- 172.21.15.19:0/1249595938 wait complete. 2024-09-12T02:06:58.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.919+0000 7fa81d5bd640 1 Processor -- start 2024-09-12T02:06:58.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.919+0000 7fa81d5bd640 1 -- start start 2024-09-12T02:06:58.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.919+0000 7fa81d5bd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8180b1620 0x7fa818153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.919+0000 7fa81d5bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8180d1090 0x7fa818159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.919+0000 7fa81d5bd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa81815c520 0x7fa8181e37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.919+0000 7fa81d5bd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa81815c900 con 0x7fa8180d1090 2024-09-12T02:06:58.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.919+0000 7fa81d5bd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa8180d05d0 con 0x7fa8180b1620 2024-09-12T02:06:58.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.919+0000 7fa81d5bd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa8180b56d0 con 0x7fa81815c520 2024-09-12T02:06:58.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.919+0000 7fa8167fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8180d1090 0x7fa818159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.919+0000 7fa8167fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8180d1090 0x7fa818159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42206/0 (socket says 172.21.15.19:42206) 2024-09-12T02:06:58.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.920+0000 7fa8167fc640 1 -- 172.21.15.19:0/1696601308 learned_addr learned my addr 172.21.15.19:0/1696601308 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:58.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.920+0000 7fa816ffd640 1 --2- 172.21.15.19:0/1696601308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8180b1620 0x7fa818153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.920+0000 7fa8177fe640 1 --2- 172.21.15.19:0/1696601308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa81815c520 0x7fa8181e37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.920+0000 7fa8167fc640 1 -- 172.21.15.19:0/1696601308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa81815c520 msgr2=0x7fa8181e37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:58.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.920+0000 7fa8167fc640 1 --2- 172.21.15.19:0/1696601308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa81815c520 0x7fa8181e37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.920+0000 7fa8167fc640 1 -- 172.21.15.19:0/1696601308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8180b1620 msgr2=0x7fa818153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:58.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.920+0000 7fa8167fc640 1 --2- 172.21.15.19:0/1696601308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8180b1620 0x7fa818153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.920+0000 7fa8167fc640 1 -- 172.21.15.19:0/1696601308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8180b59b0 con 0x7fa8180d1090 2024-09-12T02:06:58.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.920+0000 7fa8177fe640 1 --2- 172.21.15.19:0/1696601308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa81815c520 0x7fa8181e37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:58.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.920+0000 7fa8167fc640 1 --2- 172.21.15.19:0/1696601308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8180d1090 0x7fa818159030 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7fa80000c480 tx=0x7fa80000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:58.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.920+0000 7fa80f7fe640 1 -- 172.21.15.19:0/1696601308 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8000052d0 con 0x7fa8180d1090 2024-09-12T02:06:58.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.920+0000 7fa80f7fe640 1 -- 172.21.15.19:0/1696601308 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa800005470 con 0x7fa8180d1090 2024-09-12T02:06:58.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.920+0000 7fa80f7fe640 1 -- 172.21.15.19:0/1696601308 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa800012870 con 0x7fa8180d1090 2024-09-12T02:06:58.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.920+0000 7fa81d5bd640 1 -- 172.21.15.19:0/1696601308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8180b5c90 con 0x7fa8180d1090 2024-09-12T02:06:58.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.920+0000 7fa81d5bd640 1 -- 172.21.15.19:0/1696601308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8180b6770 con 0x7fa8180d1090 2024-09-12T02:06:58.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.921+0000 7fa81d5bd640 1 -- 172.21.15.19:0/1696601308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa81815be80 con 0x7fa8180d1090 2024-09-12T02:06:58.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.922+0000 7fa80f7fe640 1 -- 172.21.15.19:0/1696601308 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa800012a10 con 0x7fa8180d1090 2024-09-12T02:06:58.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.922+0000 7fa80f7fe640 1 --2- 172.21.15.19:0/1696601308 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa7f806be30 0x7fa7f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.922+0000 7fa80f7fe640 1 -- 172.21.15.19:0/1696601308 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 8689+0+0 (secure 0 0 0) 0x7fa80008b620 con 0x7fa8180d1090 2024-09-12T02:06:58.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.922+0000 7fa816ffd640 1 --2- 172.21.15.19:0/1696601308 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa7f806be30 0x7fa7f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.923+0000 7fa816ffd640 1 --2- 172.21.15.19:0/1696601308 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa7f806be30 0x7fa7f806e2f0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa8180c8e20 tx=0x7fa810008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:58.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:57.927+0000 7fa80f7fe640 1 -- 172.21.15.19:0/1696601308 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa800059400 con 0x7fa8180d1090 2024-09-12T02:06:58.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.105+0000 7fa81d5bd640 1 -- 172.21.15.19:0/1696601308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8180b1d40 con 0x7fa8180d1090 2024-09-12T02:06:58.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.106+0000 7fa80f7fe640 1 -- 172.21.15.19:0/1696601308 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) ==== 74+0+18381 (secure 0 0 0) 0x7fa800058d00 con 0x7fa8180d1090 2024-09-12T02:06:58.302 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:06:58.303 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":136,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:06:56.787512+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6834/2377195932":"2024-09-13T02:06:47.735659+0000","172.21.15.19:6834/4161442390":"2024-09-13T02:06:40.706190+0000","172.21.15.19:6832/4161442390":"2024-09-13T02:06:40.706190+0000","172.21.15.19:6834/1700320729":"2024-09-13T02:06:34.684378+0000","172.21.15.19:6834/3083563091":"2024-09-13T02:06:29.315464+0000","172.21.15.19:6832/3083563091":"2024-09-13T02:06:29.315464+0000","172.21.15.19:6834/3550997018":"2024-09-13T02:06:14.593467+0000","172.21.15.19:6834/2316269679":"2024-09-13T02:06:09.251347+0000","172.21.15.19:6832/2316269679":"2024-09-13T02:06:09.251347+0000","172.21.15.19:6832/3065327567":"2024-09-13T02:05:58.503981+0000","172.21.15.19:6834/1975440909":"2024-09-13T02:05:43.189507+0000","172.21.15.135:6837/3910102099":"2024-09-13T02:05:24.866817+0000","172.21.15.19:6834/2839344629":"2024-09-13T02:05:20.836728+0000","172.21.15.19:6832/2072535494":"2024-09-13T02:02:44.440900+0000","172.21.15.135:6834/2405422603":"2024-09-13T02:04:31.542456+0000","172.21.15.19:6832/1875416968":"2024-09-13T02:03:41.731211+0000","172.21.15.19:6832/4124612835":"2024-09-13T02:03:35.697598+0000","172.21.15.135:6834/1101861733":"2024-09-13T02:02:54.487980+0000","172.21.15.19:6832/3598057058":"2024-09-13T02:03:24.636971+0000","172.21.15.19:6832/626316140":"2024-09-13T02:04:41.744221+0000","172.21.15.135:6834/46689513":"2024-09-13T02:03:28.654366+0000","172.21.15.19:6832/3985859189":"2024-09-13T02:04:09.906953+0000","172.21.15.135:6837/3866905323":"2024-09-13T02:03:54.557384+0000","172.21.15.135:6837/3997032797":"2024-09-13T02:05:16.751616+0000","172.21.15.135:6834/3774685060":"2024-09-13T02:02:24.172690+0000","172.21.15.19:6834/3995150987":"2024-09-13T02:03:22.315702+0000","172.21.15.135:6837/46689513":"2024-09-13T02:03:28.654366+0000","172.21.15.135:6837/4287312235":"2024-09-13T02:03:11.277301+0000","172.21.15.19:6834/961161264":"2024-09-13T02:04:17.973298+0000","172.21.15.19:6832/1975440909":"2024-09-13T02:05:43.189507+0000","172.21.15.135:6837/3774685060":"2024-09-13T02:02:24.172690+0000","172.21.15.19:6834/3279314147":"2024-09-13T02:04:33.778955+0000","172.21.15.19:6832/1800650480":"2024-09-13T02:03:56.737366+0000","172.21.15.19:6832/3550997018":"2024-09-13T02:06:14.593467+0000","172.21.15.19:6832/3279314147":"2024-09-13T02:04:33.778955+0000","172.21.15.19:6832/4087550164":"2024-09-13T02:04:57.990681+0000","172.21.15.135:6834/2201380819":"2024-09-13T02:05:10.473806+0000","172.21.15.19:6832/3995150987":"2024-09-13T02:03:22.315702+0000","172.21.15.19:6834/4124612835":"2024-09-13T02:03:35.697598+0000","172.21.15.19:6834/2072535494":"2024-09-13T02:02:44.440900+0000","172.21.15.135:6837/2377195932":"2024-09-13T02:06:47.735659+0000","172.21.15.19:6834/3985859189":"2024-09-13T02:04:09.906953+0000","172.21.15.19:6832/1700320729":"2024-09-13T02:06:34.684378+0000","172.21.15.19:6832/613869354":"2024-09-13T02:02:39.104650+0000","172.21.15.19:6834/613869354":"2024-09-13T02:02:39.104650+0000","172.21.15.19:6832/650556594":"2024-09-13T02:02:50.470816+0000","172.21.15.19:6832/3818656517":"2024-09-13T02:05:38.158172+0000","172.21.15.135:6834/4287312235":"2024-09-13T02:03:11.277301+0000","172.21.15.19:6834/650556594":"2024-09-13T02:02:50.470816+0000","172.21.15.135:6834/4107165769":"2024-09-13T02:04:03.869164+0000","172.21.15.135:6837/1101861733":"2024-09-13T02:02:54.487980+0000","172.21.15.19:6834/1800650480":"2024-09-13T02:03:56.737366+0000","172.21.15.135:6834/2017831568":"2024-09-13T02:04:45.871893+0000","172.21.15.19:6832/3136344951":"2024-09-13T02:02:58.521234+0000","172.21.15.19:6834/3136344951":"2024-09-13T02:02:58.521234+0000","172.21.15.135:6837/4107165769":"2024-09-13T02:04:03.869164+0000","172.21.15.135:6834/926329492":"2024-09-13T02:04:13.937157+0000","172.21.15.135:6834/3866905323":"2024-09-13T02:03:54.557384+0000","172.21.15.135:6837/926329492":"2024-09-13T02:04:13.937157+0000","172.21.15.19:6832/961161264":"2024-09-13T02:04:17.973298+0000","172.21.15.135:6837/2201380819":"2024-09-13T02:05:10.473806+0000","172.21.15.135:6834/3910102099":"2024-09-13T02:05:24.866817+0000","172.21.15.135:6837/2405422603":"2024-09-13T02:04:31.542456+0000","172.21.15.135:6834/2333858704":"2024-09-13T02:04:37.802344+0000","172.21.15.19:6834/1875416968":"2024-09-13T02:03:41.731211+0000","172.21.15.135:6837/2333858704":"2024-09-13T02:04:37.802344+0000","172.21.15.19:6834/626316140":"2024-09-13T02:04:41.744221+0000","172.21.15.135:6837/2017831568":"2024-09-13T02:04:45.871893+0000","172.21.15.19:6832/3545886366":"2024-09-13T02:04:49.907498+0000","172.21.15.19:6834/3818656517":"2024-09-13T02:05:38.158172+0000","172.21.15.19:6834/3545886366":"2024-09-13T02:04:49.907498+0000","172.21.15.135:6834/3377480547":"2024-09-13T02:04:53.949050+0000","172.21.15.19:6834/3598057058":"2024-09-13T02:03:24.636971+0000","172.21.15.135:6837/3377480547":"2024-09-13T02:04:53.949050+0000","172.21.15.19:6834/3065327567":"2024-09-13T02:05:58.503981+0000","172.21.15.19:6834/4087550164":"2024-09-13T02:04:57.990681+0000","172.21.15.19:6834/2195405214":"2024-09-13T02:05:12.791934+0000","172.21.15.19:6832/2195405214":"2024-09-13T02:05:12.791934+0000","172.21.15.135:6834/3997032797":"2024-09-13T02:05:16.751616+0000","172.21.15.19:6832/2839344629":"2024-09-13T02:05:20.836728+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:06:58.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.108+0000 7fa81d5bd640 1 -- 172.21.15.19:0/1696601308 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa7f806be30 msgr2=0x7fa7f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:58.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.108+0000 7fa81d5bd640 1 --2- 172.21.15.19:0/1696601308 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa7f806be30 0x7fa7f806e2f0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa8180c8e20 tx=0x7fa810008040 comp rx=0 tx=0).stop 2024-09-12T02:06:58.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.108+0000 7fa81d5bd640 1 -- 172.21.15.19:0/1696601308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8180d1090 msgr2=0x7fa818159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:58.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.108+0000 7fa81d5bd640 1 --2- 172.21.15.19:0/1696601308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8180d1090 0x7fa818159030 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7fa80000c480 tx=0x7fa80000c940 comp rx=0 tx=0).stop 2024-09-12T02:06:58.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.108+0000 7fa81d5bd640 1 -- 172.21.15.19:0/1696601308 shutdown_connections 2024-09-12T02:06:58.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.108+0000 7fa81d5bd640 1 --2- 172.21.15.19:0/1696601308 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa7f806be30 0x7fa7f806e2f0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.108+0000 7fa81d5bd640 1 --2- 172.21.15.19:0/1696601308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa81815c520 0x7fa8181e37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.108+0000 7fa81d5bd640 1 --2- 172.21.15.19:0/1696601308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8180d1090 0x7fa818159030 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.108+0000 7fa81d5bd640 1 --2- 172.21.15.19:0/1696601308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8180b1620 0x7fa818153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.108+0000 7fa81d5bd640 1 -- 172.21.15.19:0/1696601308 >> 172.21.15.19:0/1696601308 conn(0x7fa8180d23a0 msgr2=0x7fa8180b2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:58.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.108+0000 7fa81d5bd640 1 -- 172.21.15.19:0/1696601308 shutdown_connections 2024-09-12T02:06:58.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.108+0000 7fa81d5bd640 1 -- 172.21.15.19:0/1696601308 wait complete. 2024-09-12T02:06:58.309 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:55:44.127030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:06:58.309 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:06:58.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.421+0000 7f86bedf6640 1 Processor -- start 2024-09-12T02:06:58.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.421+0000 7f86bedf6640 1 -- start start 2024-09-12T02:06:58.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.422+0000 7f86bedf6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f86b80b5f80 0x7f86b8162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.422+0000 7f86bedf6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86b80d2600 con 0x7f86b80d3320 2024-09-12T02:06:58.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.422+0000 7f86bedf6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86b80b3c10 con 0x7f86b80d4c10 2024-09-12T02:06:58.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.422+0000 7f86bedf6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f86b80d5420 con 0x7f86b80b5f80 2024-09-12T02:06:58.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.422+0000 7f86bd393640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f86b80d3320 0x7f86b80ceb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52072/0 (socket says 172.21.15.19:52072) 2024-09-12T02:06:58.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.422+0000 7f86bd393640 1 -- 172.21.15.19:0/3479700546 learned_addr learned my addr 172.21.15.19:0/3479700546 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:58.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86b77fe640 1 -- 172.21.15.19:0/3479700546 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2032113660 0 0) 0x7f86b0001490 con 0x7f86b80d3320 2024-09-12T02:06:58.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86bcb92640 1 --2- 172.21.15.19:0/3479700546 >> v2:172.21.15.135:3300/0 conn(0x7f86b80b5f80 0x7f86b8162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86b77fe640 1 -- 172.21.15.19:0/3479700546 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86a0003520 con 0x7f86b80d3320 2024-09-12T02:06:58.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86b77fe640 1 -- 172.21.15.19:0/3479700546 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3083562143 0 0) 0x7f86a0003520 con 0x7f86b80d3320 2024-09-12T02:06:58.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86b77fe640 1 -- 172.21.15.19:0/3479700546 >> v2:172.21.15.135:3300/0 conn(0x7f86b80b5f80 msgr2=0x7f86b8162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:58.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86b77fe640 1 --2- 172.21.15.19:0/3479700546 >> v2:172.21.15.135:3300/0 conn(0x7f86b80b5f80 0x7f86b8162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86b77fe640 1 -- 172.21.15.19:0/3479700546 >> v1:172.21.15.135:6789/0 conn(0x7f86b80d4c10 legacy=0x7f86b80b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:58.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86b77fe640 1 -- 172.21.15.19:0/3479700546 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b80d2880 con 0x7f86b80d3320 2024-09-12T02:06:58.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86b77fe640 1 -- 172.21.15.19:0/3479700546 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f86b0001bc0 con 0x7f86b80d3320 2024-09-12T02:06:58.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86b77fe640 1 -- 172.21.15.19:0/3479700546 >> v1:172.21.15.19:6789/0 conn(0x7f86b80d3320 legacy=0x7f86b80ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:58.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86b77fe640 1 --2- 172.21.15.19:0/3479700546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00039b0 0x7f86a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86b77fe640 1 --2- 172.21.15.19:0/3479700546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86a00043b0 0x7f86a0004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86b77fe640 1 --2- 172.21.15.19:0/3479700546 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86a0005080 0x7f86a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86b77fe640 1 -- 172.21.15.19:0/3479700546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f86b80d5420 con 0x7f86a00039b0 2024-09-12T02:06:58.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86b77fe640 1 -- 172.21.15.19:0/3479700546 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f86a000bfe0 con 0x7f86a00043b0 2024-09-12T02:06:58.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86b77fe640 1 -- 172.21.15.19:0/3479700546 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f86a000c1e0 con 0x7f86a0005080 2024-09-12T02:06:58.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86bcb92640 1 --2- 172.21.15.19:0/3479700546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00039b0 0x7f86a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86b7fff640 1 --2- 172.21.15.19:0/3479700546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86a00043b0 0x7f86a0004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86bcb92640 1 -- 172.21.15.19:0/3479700546 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86a0005080 msgr2=0x7f86a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:58.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86bcb92640 1 --2- 172.21.15.19:0/3479700546 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86a0005080 0x7f86a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.423+0000 7f86bcb92640 1 -- 172.21.15.19:0/3479700546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86a00043b0 msgr2=0x7f86a0004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:58.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.424+0000 7f86bcb92640 1 --2- 172.21.15.19:0/3479700546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86a00043b0 0x7f86a0004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.424+0000 7f86bcb92640 1 -- 172.21.15.19:0/3479700546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a0003520 con 0x7f86a00039b0 2024-09-12T02:06:58.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.424+0000 7f86bd393640 1 -- 172.21.15.19:0/3479700546 reap_dead start 2024-09-12T02:06:58.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.424+0000 7f86bcb92640 1 --2- 172.21.15.19:0/3479700546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00039b0 0x7f86a0003d90 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009ac0 tx=0x7f86a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858b8241fdfdc19b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:58.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.424+0000 7f86b77fe640 1 -- 172.21.15.19:0/3479700546 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8036070 con 0x7f86a00039b0 2024-09-12T02:06:58.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.424+0000 7f86b77fe640 1 -- 172.21.15.19:0/3479700546 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86a8031400 con 0x7f86a00039b0 2024-09-12T02:06:58.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.424+0000 7f86b77fe640 1 -- 172.21.15.19:0/3479700546 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8009690 con 0x7f86a00039b0 2024-09-12T02:06:58.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.425+0000 7f86bedf6640 1 -- 172.21.15.19:0/3479700546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00039b0 msgr2=0x7f86a0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:58.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.425+0000 7f86bedf6640 1 --2- 172.21.15.19:0/3479700546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00039b0 0x7f86a0003d90 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009ac0 tx=0x7f86a0005830 comp rx=0 tx=0).stop 2024-09-12T02:06:58.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.425+0000 7f86bedf6640 1 -- 172.21.15.19:0/3479700546 shutdown_connections 2024-09-12T02:06:58.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.425+0000 7f86bedf6640 1 --2- 172.21.15.19:0/3479700546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00039b0 0x7f86a0003d90 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.425+0000 7f86bedf6640 1 -- 172.21.15.19:0/3479700546 >> 172.21.15.19:0/3479700546 conn(0x7f86b808bfc0 msgr2=0x7f86b80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.425+0000 7f86bedf6640 1 -- 172.21.15.19:0/3479700546 shutdown_connections 2024-09-12T02:06:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.425+0000 7f86bedf6640 1 -- 172.21.15.19:0/3479700546 wait complete. 2024-09-12T02:06:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.426+0000 7f86bedf6640 1 Processor -- start 2024-09-12T02:06:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.426+0000 7f86bedf6640 1 -- start start 2024-09-12T02:06:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.427+0000 7f86bedf6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00039b0 0x7f86b80ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.427+0000 7f86bedf6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86b80cadb0 0x7f86b81f81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.427+0000 7f86bedf6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86b81f8700 0x7f86b815a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.427+0000 7f86bedf6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f86b80d2b20 con 0x7f86a00039b0 2024-09-12T02:06:58.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.427+0000 7f86bedf6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f86b80d2e90 con 0x7f86b80cadb0 2024-09-12T02:06:58.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.427+0000 7f86bedf6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f86b80d37b0 con 0x7f86b81f8700 2024-09-12T02:06:58.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.427+0000 7f86bcb92640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00039b0 0x7f86b80ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.427+0000 7f86bcb92640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00039b0 0x7f86b80ca870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42214/0 (socket says 172.21.15.19:42214) 2024-09-12T02:06:58.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.427+0000 7f86bcb92640 1 -- 172.21.15.19:0/4156985198 learned_addr learned my addr 172.21.15.19:0/4156985198 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:58.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.427+0000 7f86b7fff640 1 --2- 172.21.15.19:0/4156985198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86b80cadb0 0x7f86b81f81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.427+0000 7f86bd393640 1 --2- 172.21.15.19:0/4156985198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86b81f8700 0x7f86b815a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.428+0000 7f86bcb92640 1 -- 172.21.15.19:0/4156985198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86b81f8700 msgr2=0x7f86b815a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:58.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.428+0000 7f86bcb92640 1 --2- 172.21.15.19:0/4156985198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86b81f8700 0x7f86b815a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.428+0000 7f86bcb92640 1 -- 172.21.15.19:0/4156985198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86b80cadb0 msgr2=0x7f86b81f81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.428+0000 7f86bcb92640 1 --2- 172.21.15.19:0/4156985198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86b80cadb0 0x7f86b81f81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.428+0000 7f86bcb92640 1 -- 172.21.15.19:0/4156985198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b80b2920 con 0x7f86a00039b0 2024-09-12T02:06:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.428+0000 7f86bcb92640 1 --2- 172.21.15.19:0/4156985198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00039b0 0x7f86b80ca870 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f86a8034040 tx=0x7f86a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.428+0000 7f86b57fa640 1 -- 172.21.15.19:0/4156985198 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a803f020 con 0x7f86a00039b0 2024-09-12T02:06:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.428+0000 7f86b57fa640 1 -- 172.21.15.19:0/4156985198 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86a8037040 con 0x7f86a00039b0 2024-09-12T02:06:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.428+0000 7f86b57fa640 1 -- 172.21.15.19:0/4156985198 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8036070 con 0x7f86a00039b0 2024-09-12T02:06:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.428+0000 7f86bedf6640 1 -- 172.21.15.19:0/4156985198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b80b2c00 con 0x7f86a00039b0 2024-09-12T02:06:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.428+0000 7f86bedf6640 1 -- 172.21.15.19:0/4156985198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b80b31c0 con 0x7f86a00039b0 2024-09-12T02:06:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.429+0000 7f86bedf6640 1 -- 172.21.15.19:0/4156985198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86b8162980 con 0x7f86a00039b0 2024-09-12T02:06:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.430+0000 7f86b57fa640 1 -- 172.21.15.19:0/4156985198 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f86a8042020 con 0x7f86a00039b0 2024-09-12T02:06:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.430+0000 7f86b57fa640 1 --2- 172.21.15.19:0/4156985198 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f86a406be30 0x7f86a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.430+0000 7f86b57fa640 1 -- 172.21.15.19:0/4156985198 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 8689+0+0 (secure 0 0 0) 0x7f86a80ab900 con 0x7f86a00039b0 2024-09-12T02:06:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.430+0000 7f86b7fff640 1 --2- 172.21.15.19:0/4156985198 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f86a406be30 0x7f86a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.431+0000 7f86b7fff640 1 --2- 172.21.15.19:0/4156985198 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f86a406be30 0x7f86a406e2f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f86b80b8290 tx=0x7f86ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.434+0000 7f86b57fa640 1 -- 172.21.15.19:0/4156985198 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f86a8049030 con 0x7f86a00039b0 2024-09-12T02:06:58.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.608+0000 7f86bedf6640 1 -- 172.21.15.19:0/4156985198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f86b81f8ae0 con 0x7f86a00039b0 2024-09-12T02:06:58.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.609+0000 7f86b57fa640 1 -- 172.21.15.19:0/4156985198 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v136) ==== 93+0+10 (secure 0 0 0) 0x7f86a80791b0 con 0x7f86a00039b0 2024-09-12T02:06:58.609 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-09-12T02:06:58.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.611+0000 7f86bedf6640 1 -- 172.21.15.19:0/4156985198 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f86a406be30 msgr2=0x7f86a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:58.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.611+0000 7f86bedf6640 1 --2- 172.21.15.19:0/4156985198 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f86a406be30 0x7f86a406e2f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f86b80b8290 tx=0x7f86ac009040 comp rx=0 tx=0).stop 2024-09-12T02:06:58.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.611+0000 7f86bedf6640 1 -- 172.21.15.19:0/4156985198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00039b0 msgr2=0x7f86b80ca870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:58.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.611+0000 7f86bedf6640 1 --2- 172.21.15.19:0/4156985198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00039b0 0x7f86b80ca870 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f86a8034040 tx=0x7f86a8004730 comp rx=0 tx=0).stop 2024-09-12T02:06:58.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.611+0000 7f86bedf6640 1 -- 172.21.15.19:0/4156985198 shutdown_connections 2024-09-12T02:06:58.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.611+0000 7f86bedf6640 1 --2- 172.21.15.19:0/4156985198 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f86a406be30 0x7f86a406e2f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.611+0000 7f86bedf6640 1 --2- 172.21.15.19:0/4156985198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86b81f8700 0x7f86b815a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.611+0000 7f86bedf6640 1 --2- 172.21.15.19:0/4156985198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86b80cadb0 0x7f86b81f81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.611+0000 7f86bedf6640 1 --2- 172.21.15.19:0/4156985198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86a00039b0 0x7f86b80ca870 unknown :-1 s=CLOSED pgs=2215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.611+0000 7f86bedf6640 1 -- 172.21.15.19:0/4156985198 >> 172.21.15.19:0/4156985198 conn(0x7f86b808bfc0 msgr2=0x7f86b815d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:58.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.611+0000 7f86bedf6640 1 -- 172.21.15.19:0/4156985198 shutdown_connections 2024-09-12T02:06:58.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.611+0000 7f86bedf6640 1 -- 172.21.15.19:0/4156985198 wait complete. 2024-09-12T02:06:58.621 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_damage.TestDamage.test_open_ino_errors' 2024-09-12T02:06:58.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.724+0000 7fb8f55b7640 1 Processor -- start 2024-09-12T02:06:58.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.724+0000 7fb8f55b7640 1 -- start start 2024-09-12T02:06:58.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.725+0000 7fb8f55b7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8f015e5d0 0x7fb8f00d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.725+0000 7fb8f55b7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb8f006df60 0x7fb8f009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.725+0000 7fb8f55b7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f006cec0 con 0x7fb8f00d1630 2024-09-12T02:06:58.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.725+0000 7fb8f55b7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb8f006dad0 con 0x7fb8f006df60 2024-09-12T02:06:58.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.725+0000 7fb8f55b7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f006d1a0 con 0x7fb8f015e5d0 2024-09-12T02:06:58.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.725+0000 7fb8ee7fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb8f006df60 0x7fb8f009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.725+0000 7fb8ef7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb8f00d1630 0x7fb8f0162230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52078/0 (socket says 172.21.15.19:52078) 2024-09-12T02:06:58.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.725+0000 7fb8ef7fe640 1 -- 172.21.15.19:0/1766754411 learned_addr learned my addr 172.21.15.19:0/1766754411 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:06:58.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.725+0000 7fb8eeffd640 1 --2- 172.21.15.19:0/1766754411 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8f015e5d0 0x7fb8f00d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.725+0000 7fb8ee7fc640 1 -- 172.21.15.19:0/1766754411 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8f015e5d0 msgr2=0x7fb8f00d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:58.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.725+0000 7fb8ee7fc640 1 --2- 172.21.15.19:0/1766754411 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8f015e5d0 0x7fb8f00d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.725+0000 7fb8ee7fc640 1 -- 172.21.15.19:0/1766754411 >> v1:172.21.15.19:6789/0 conn(0x7fb8f00d1630 legacy=0x7fb8f0162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:58.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.725+0000 7fb8edffb640 1 -- 172.21.15.19:0/1766754411 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3309743624 0 0) 0x7fb8f006cec0 con 0x7fb8f00d1630 2024-09-12T02:06:58.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.725+0000 7fb8ee7fc640 1 -- 172.21.15.19:0/1766754411 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f006d480 con 0x7fb8f006df60 2024-09-12T02:06:58.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.726+0000 7fb8ee7fc640 1 --2- 172.21.15.19:0/1766754411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f006df60 0x7fb8f009aa30 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40097a0 tx=0x7fb8e402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ca04484a971402 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:58.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.726+0000 7fb8edffb640 1 -- 172.21.15.19:0/1766754411 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4037070 con 0x7fb8f006df60 2024-09-12T02:06:58.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.726+0000 7fb8edffb640 1 -- 172.21.15.19:0/1766754411 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e4032440 con 0x7fb8f006df60 2024-09-12T02:06:58.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.726+0000 7fb8edffb640 1 -- 172.21.15.19:0/1766754411 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4032810 con 0x7fb8f006df60 2024-09-12T02:06:58.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.727+0000 7fb8f55b7640 1 -- 172.21.15.19:0/1766754411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f006df60 msgr2=0x7fb8f009aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:58.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.727+0000 7fb8f55b7640 1 --2- 172.21.15.19:0/1766754411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f006df60 0x7fb8f009aa30 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40097a0 tx=0x7fb8e402a210 comp rx=0 tx=0).stop 2024-09-12T02:06:58.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.727+0000 7fb8f55b7640 1 -- 172.21.15.19:0/1766754411 shutdown_connections 2024-09-12T02:06:58.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.727+0000 7fb8f55b7640 1 --2- 172.21.15.19:0/1766754411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f006df60 0x7fb8f009aa30 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.727+0000 7fb8f55b7640 1 --2- 172.21.15.19:0/1766754411 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8f015e5d0 0x7fb8f00d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.727+0000 7fb8f55b7640 1 -- 172.21.15.19:0/1766754411 >> 172.21.15.19:0/1766754411 conn(0x7fb8f00d23a0 msgr2=0x7fb8f00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:58.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.727+0000 7fb8f55b7640 1 -- 172.21.15.19:0/1766754411 shutdown_connections 2024-09-12T02:06:58.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.727+0000 7fb8f55b7640 1 -- 172.21.15.19:0/1766754411 wait complete. 2024-09-12T02:06:58.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.728+0000 7fb8f55b7640 1 Processor -- start 2024-09-12T02:06:58.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.728+0000 7fb8f55b7640 1 -- start start 2024-09-12T02:06:58.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.729+0000 7fb8f55b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f006df60 0x7fb8f00b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.729+0000 7fb8f55b7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8f00d1630 0x7fb8f00cee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.729+0000 7fb8f55b7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8f015e5d0 0x7fb8f00cf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.729+0000 7fb8f55b7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f015eb30 con 0x7fb8f006df60 2024-09-12T02:06:58.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.729+0000 7fb8f55b7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f015e9b0 con 0x7fb8f00d1630 2024-09-12T02:06:58.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.729+0000 7fb8f55b7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f009af70 con 0x7fb8f015e5d0 2024-09-12T02:06:58.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.729+0000 7fb8eeffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f006df60 0x7fb8f00b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.729+0000 7fb8eeffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f006df60 0x7fb8f00b7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42232/0 (socket says 172.21.15.19:42232) 2024-09-12T02:06:58.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.729+0000 7fb8eeffd640 1 -- 172.21.15.19:0/3118018521 learned_addr learned my addr 172.21.15.19:0/3118018521 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:58.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.729+0000 7fb8ee7fc640 1 --2- 172.21.15.19:0/3118018521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8f00d1630 0x7fb8f00cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.729+0000 7fb8ef7fe640 1 --2- 172.21.15.19:0/3118018521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8f015e5d0 0x7fb8f00cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.730+0000 7fb8eeffd640 1 -- 172.21.15.19:0/3118018521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8f015e5d0 msgr2=0x7fb8f00cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:58.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.730+0000 7fb8eeffd640 1 --2- 172.21.15.19:0/3118018521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8f015e5d0 0x7fb8f00cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.730+0000 7fb8eeffd640 1 -- 172.21.15.19:0/3118018521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8f00d1630 msgr2=0x7fb8f00cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:58.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.730+0000 7fb8eeffd640 1 --2- 172.21.15.19:0/3118018521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8f00d1630 0x7fb8f00cee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:58.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.730+0000 7fb8eeffd640 1 -- 172.21.15.19:0/3118018521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f00c72d0 con 0x7fb8f006df60 2024-09-12T02:06:58.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.730+0000 7fb8ee7fc640 1 --2- 172.21.15.19:0/3118018521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8f00d1630 0x7fb8f00cee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:58.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.730+0000 7fb8eeffd640 1 --2- 172.21.15.19:0/3118018521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f006df60 0x7fb8f00b7ba0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000d5f0 tx=0x7fb8e000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:58.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.730+0000 7fb8d77fe640 1 -- 172.21.15.19:0/3118018521 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e00125f0 con 0x7fb8f006df60 2024-09-12T02:06:58.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.730+0000 7fb8d77fe640 1 -- 172.21.15.19:0/3118018521 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e0019070 con 0x7fb8f006df60 2024-09-12T02:06:58.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.730+0000 7fb8d77fe640 1 -- 172.21.15.19:0/3118018521 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e00129d0 con 0x7fb8f006df60 2024-09-12T02:06:58.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.730+0000 7fb8f55b7640 1 -- 172.21.15.19:0/3118018521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f00c7570 con 0x7fb8f006df60 2024-09-12T02:06:58.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.730+0000 7fb8f55b7640 1 -- 172.21.15.19:0/3118018521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f00c7b30 con 0x7fb8f006df60 2024-09-12T02:06:58.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.731+0000 7fb8f55b7640 1 -- 172.21.15.19:0/3118018521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8f006cec0 con 0x7fb8f006df60 2024-09-12T02:06:58.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.732+0000 7fb8d77fe640 1 -- 172.21.15.19:0/3118018521 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb8e0012b70 con 0x7fb8f006df60 2024-09-12T02:06:58.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.732+0000 7fb8d77fe640 1 --2- 172.21.15.19:0/3118018521 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb8dc06be30 0x7fb8dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:58.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.732+0000 7fb8d77fe640 1 -- 172.21.15.19:0/3118018521 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 8689+0+0 (secure 0 0 0) 0x7fb8e008bde0 con 0x7fb8f006df60 2024-09-12T02:06:58.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.732+0000 7fb8ee7fc640 1 --2- 172.21.15.19:0/3118018521 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb8dc06be30 0x7fb8dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:58.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.733+0000 7fb8ee7fc640 1 --2- 172.21.15.19:0/3118018521 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb8dc06be30 0x7fb8dc06e2f0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4034000 tx=0x7fb8e402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:58.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.736+0000 7fb8d77fe640 1 -- 172.21.15.19:0/3118018521 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb8e0059c20 con 0x7fb8f006df60 2024-09-12T02:06:58.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:58.981+0000 7fb8f55b7640 1 -- 172.21.15.19:0/3118018521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_open_ino_errors"]} v 0) -- 0x7fb8f0070f90 con 0x7fb8f006df60 2024-09-12T02:06:59.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.805+0000 7fb8d77fe640 1 -- 172.21.15.19:0/3118018521 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_open_ino_errors"]}]=0 v566) ==== 138+0+0 (secure 0 0 0) 0x7fb8e0059520 con 0x7fb8f006df60 2024-09-12T02:06:59.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.809+0000 7fb8f55b7640 1 -- 172.21.15.19:0/3118018521 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb8dc06be30 msgr2=0x7fb8dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:59.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.809+0000 7fb8f55b7640 1 --2- 172.21.15.19:0/3118018521 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb8dc06be30 0x7fb8dc06e2f0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4034000 tx=0x7fb8e402e000 comp rx=0 tx=0).stop 2024-09-12T02:06:59.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.809+0000 7fb8f55b7640 1 -- 172.21.15.19:0/3118018521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f006df60 msgr2=0x7fb8f00b7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:59.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.809+0000 7fb8f55b7640 1 --2- 172.21.15.19:0/3118018521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f006df60 0x7fb8f00b7ba0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000d5f0 tx=0x7fb8e000dab0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.809+0000 7fb8f55b7640 1 -- 172.21.15.19:0/3118018521 shutdown_connections 2024-09-12T02:06:59.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.809+0000 7fb8f55b7640 1 --2- 172.21.15.19:0/3118018521 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb8dc06be30 0x7fb8dc06e2f0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.809+0000 7fb8f55b7640 1 --2- 172.21.15.19:0/3118018521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8f015e5d0 0x7fb8f00cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.809+0000 7fb8f55b7640 1 --2- 172.21.15.19:0/3118018521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8f00d1630 0x7fb8f00cee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.809+0000 7fb8f55b7640 1 --2- 172.21.15.19:0/3118018521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f006df60 0x7fb8f00b7ba0 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.809+0000 7fb8f55b7640 1 -- 172.21.15.19:0/3118018521 >> 172.21.15.19:0/3118018521 conn(0x7fb8f00d23a0 msgr2=0x7fb8f00b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:59.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.809+0000 7fb8f55b7640 1 -- 172.21.15.19:0/3118018521 shutdown_connections 2024-09-12T02:06:59.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.809+0000 7fb8f55b7640 1 -- 172.21.15.19:0/3118018521 wait complete. 2024-09-12T02:06:59.823 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:06:59.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.934+0000 7fa7091bd640 1 Processor -- start 2024-09-12T02:06:59.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.934+0000 7fa7091bd640 1 -- start start 2024-09-12T02:06:59.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.935+0000 7fa7091bd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa704161a20 0x7fa7040d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:59.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.935+0000 7fa7091bd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7040cf330 0x7fa70406d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:59.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.935+0000 7fa7091bd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7040d1830 con 0x7fa7040d1420 2024-09-12T02:06:59.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.935+0000 7fa7091bd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa7040cf760 con 0x7fa7040cf330 2024-09-12T02:06:59.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.935+0000 7fa7091bd640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa704161e00 con 0x7fa704161a20 2024-09-12T02:06:59.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.935+0000 7fa70359e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7040cf330 0x7fa70406d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:59.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.935+0000 7fa70359e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7040cf330 0x7fa70406d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42248/0 (socket says 172.21.15.19:42248) 2024-09-12T02:06:59.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.935+0000 7fa70359e640 1 -- 172.21.15.19:0/2103322652 learned_addr learned my addr 172.21.15.19:0/2103322652 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:59.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.935+0000 7fa702d9d640 1 --2- 172.21.15.19:0/2103322652 >> v2:172.21.15.135:3300/0 conn(0x7fa704161a20 0x7fa7040d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:59.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.935+0000 7fa70359e640 1 -- 172.21.15.19:0/2103322652 >> v2:172.21.15.135:3300/0 conn(0x7fa704161a20 msgr2=0x7fa7040d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:59.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.935+0000 7fa70359e640 1 --2- 172.21.15.19:0/2103322652 >> v2:172.21.15.135:3300/0 conn(0x7fa704161a20 0x7fa7040d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.935+0000 7fa70359e640 1 -- 172.21.15.19:0/2103322652 >> v1:172.21.15.135:6789/0 conn(0x7fa7040d1420 legacy=0x7fa7040cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:59.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.935+0000 7fa70359e640 1 -- 172.21.15.19:0/2103322652 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7040cf980 con 0x7fa7040cf330 2024-09-12T02:06:59.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.936+0000 7fa70359e640 1 --2- 172.21.15.19:0/2103322652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040cf330 0x7fa70406d810 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7fa70408c910 tx=0x7fa6fc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a840c6efc8e871 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:59.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.936+0000 7fa701d9b640 1 -- 172.21.15.19:0/2103322652 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc037070 con 0x7fa7040cf330 2024-09-12T02:06:59.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.936+0000 7fa701d9b640 1 -- 172.21.15.19:0/2103322652 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6fc032440 con 0x7fa7040cf330 2024-09-12T02:06:59.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.936+0000 7fa701d9b640 1 -- 172.21.15.19:0/2103322652 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc032810 con 0x7fa7040cf330 2024-09-12T02:06:59.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.937+0000 7fa7091bd640 1 -- 172.21.15.19:0/2103322652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040cf330 msgr2=0x7fa70406d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:59.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.937+0000 7fa7091bd640 1 --2- 172.21.15.19:0/2103322652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040cf330 0x7fa70406d810 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7fa70408c910 tx=0x7fa6fc02a230 comp rx=0 tx=0).stop 2024-09-12T02:06:59.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.937+0000 7fa7091bd640 1 -- 172.21.15.19:0/2103322652 shutdown_connections 2024-09-12T02:06:59.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.937+0000 7fa7091bd640 1 --2- 172.21.15.19:0/2103322652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040cf330 0x7fa70406d810 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.937+0000 7fa7091bd640 1 --2- 172.21.15.19:0/2103322652 >> v2:172.21.15.135:3300/0 conn(0x7fa704161a20 0x7fa7040d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.937+0000 7fa7091bd640 1 -- 172.21.15.19:0/2103322652 >> 172.21.15.19:0/2103322652 conn(0x7fa70409d850 msgr2=0x7fa70408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:59.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.937+0000 7fa7091bd640 1 -- 172.21.15.19:0/2103322652 shutdown_connections 2024-09-12T02:06:59.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.937+0000 7fa7091bd640 1 -- 172.21.15.19:0/2103322652 wait complete. 2024-09-12T02:06:59.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.938+0000 7fa7091bd640 1 Processor -- start 2024-09-12T02:06:59.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.938+0000 7fa7091bd640 1 -- start start 2024-09-12T02:06:59.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.939+0000 7fa7091bd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7040cf330 0x7fa7040b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:59.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.939+0000 7fa7091bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040d1420 0x7fa70406dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:59.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.939+0000 7fa7091bd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa704161a20 0x7fa70406e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:59.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.939+0000 7fa7091bd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa7040cff00 con 0x7fa7040d1420 2024-09-12T02:06:59.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.939+0000 7fa7091bd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa70406d050 con 0x7fa704161a20 2024-09-12T02:06:59.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.939+0000 7fa7091bd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa70406d2f0 con 0x7fa7040cf330 2024-09-12T02:06:59.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.939+0000 7fa70259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040d1420 0x7fa70406dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:59.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.939+0000 7fa70259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040d1420 0x7fa70406dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42254/0 (socket says 172.21.15.19:42254) 2024-09-12T02:06:59.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.939+0000 7fa70259c640 1 -- 172.21.15.19:0/1884966194 learned_addr learned my addr 172.21.15.19:0/1884966194 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:06:59.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.939+0000 7fa70359e640 1 --2- 172.21.15.19:0/1884966194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa704161a20 0x7fa70406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:59.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.939+0000 7fa702d9d640 1 --2- 172.21.15.19:0/1884966194 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7040cf330 0x7fa7040b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:59.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.940+0000 7fa70259c640 1 -- 172.21.15.19:0/1884966194 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7040cf330 msgr2=0x7fa7040b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:59.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.940+0000 7fa70259c640 1 --2- 172.21.15.19:0/1884966194 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7040cf330 0x7fa7040b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.940+0000 7fa70259c640 1 -- 172.21.15.19:0/1884966194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa704161a20 msgr2=0x7fa70406e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:59.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.940+0000 7fa70259c640 1 --2- 172.21.15.19:0/1884966194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa704161a20 0x7fa70406e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.940+0000 7fa70259c640 1 -- 172.21.15.19:0/1884966194 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7040b64d0 con 0x7fa7040d1420 2024-09-12T02:06:59.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.940+0000 7fa70259c640 1 --2- 172.21.15.19:0/1884966194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040d1420 0x7fa70406dff0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800c430 tx=0x7fa6f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:59.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.940+0000 7fa6eb7fe640 1 -- 172.21.15.19:0/1884966194 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8011790 con 0x7fa7040d1420 2024-09-12T02:06:59.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.940+0000 7fa6eb7fe640 1 -- 172.21.15.19:0/1884966194 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f8017070 con 0x7fa7040d1420 2024-09-12T02:06:59.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.940+0000 7fa7091bd640 1 -- 172.21.15.19:0/1884966194 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7040b67b0 con 0x7fa7040d1420 2024-09-12T02:06:59.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.940+0000 7fa6eb7fe640 1 -- 172.21.15.19:0/1884966194 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8011bb0 con 0x7fa7040d1420 2024-09-12T02:06:59.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.940+0000 7fa7091bd640 1 -- 172.21.15.19:0/1884966194 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7040b6d70 con 0x7fa7040d1420 2024-09-12T02:06:59.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.941+0000 7fa7091bd640 1 -- 172.21.15.19:0/1884966194 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7040b1040 con 0x7fa7040d1420 2024-09-12T02:06:59.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.942+0000 7fa6eb7fe640 1 -- 172.21.15.19:0/1884966194 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa6f801c460 con 0x7fa7040d1420 2024-09-12T02:06:59.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.942+0000 7fa6eb7fe640 1 --2- 172.21.15.19:0/1884966194 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6f006be30 0x7fa6f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:59.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.942+0000 7fa6eb7fe640 1 -- 172.21.15.19:0/1884966194 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 8689+0+0 (secure 0 0 0) 0x7fa6f808b820 con 0x7fa7040d1420 2024-09-12T02:06:59.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.942+0000 7fa702d9d640 1 --2- 172.21.15.19:0/1884966194 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6f006be30 0x7fa6f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:59.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.943+0000 7fa702d9d640 1 --2- 172.21.15.19:0/1884966194 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6f006be30 0x7fa6f006e2f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40099c0 tx=0x7fa6f4003990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:59.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:06:59.947+0000 7fa6eb7fe640 1 -- 172.21.15.19:0/1884966194 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6f8059660 con 0x7fa7040d1420 2024-09-12T02:07:00.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.123+0000 7fa7091bd640 1 -- 172.21.15.19:0/1884966194 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa70415ee90 con 0x7fa7040d1420 2024-09-12T02:07:00.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.126+0000 7fa6eb7fe640 1 -- 172.21.15.19:0/1884966194 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7fa6f8058f60 con 0x7fa7040d1420 2024-09-12T02:07:00.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.129+0000 7fa7091bd640 1 -- 172.21.15.19:0/1884966194 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6f006be30 msgr2=0x7fa6f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:00.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.129+0000 7fa7091bd640 1 --2- 172.21.15.19:0/1884966194 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6f006be30 0x7fa6f006e2f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40099c0 tx=0x7fa6f4003990 comp rx=0 tx=0).stop 2024-09-12T02:07:00.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.129+0000 7fa7091bd640 1 -- 172.21.15.19:0/1884966194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040d1420 msgr2=0x7fa70406dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:00.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.129+0000 7fa7091bd640 1 --2- 172.21.15.19:0/1884966194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040d1420 0x7fa70406dff0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800c430 tx=0x7fa6f800c8f0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.129+0000 7fa7091bd640 1 -- 172.21.15.19:0/1884966194 shutdown_connections 2024-09-12T02:07:00.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.129+0000 7fa7091bd640 1 --2- 172.21.15.19:0/1884966194 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa6f006be30 0x7fa6f006e2f0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.129+0000 7fa7091bd640 1 --2- 172.21.15.19:0/1884966194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa704161a20 0x7fa70406e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.129+0000 7fa7091bd640 1 --2- 172.21.15.19:0/1884966194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7040d1420 0x7fa70406dff0 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.129+0000 7fa7091bd640 1 --2- 172.21.15.19:0/1884966194 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7040cf330 0x7fa7040b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.129+0000 7fa7091bd640 1 -- 172.21.15.19:0/1884966194 >> 172.21.15.19:0/1884966194 conn(0x7fa70409d850 msgr2=0x7fa70415d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.129+0000 7fa7091bd640 1 -- 172.21.15.19:0/1884966194 shutdown_connections 2024-09-12T02:07:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.129+0000 7fa7091bd640 1 -- 172.21.15.19:0/1884966194 wait complete. 2024-09-12T02:07:00.140 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:07:00.141 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:07:00.181 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:07:00.229 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:07:00.230 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:07:00.230 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:07:00.246 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:07:00.247 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T02:07:00.247 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:07:00.264 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:07:00.264 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:07:00.264 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:07:00.302 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:07:00.303 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T02:07:00.303 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:07:00.321 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:07:00.321 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:07:00.322 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:07:00.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.445+0000 7fa535d68640 1 Processor -- start 2024-09-12T02:07:00.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.445+0000 7fa535d68640 1 -- start start 2024-09-12T02:07:00.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.446+0000 7fa535d68640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa5300d1540 0x7fa53006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:00.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.446+0000 7fa535d68640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa53009b690 0x7fa53006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:00.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.446+0000 7fa535d68640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5300d1970 con 0x7fa53015e740 2024-09-12T02:07:00.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.446+0000 7fa535d68640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa53015eb20 con 0x7fa5300d1540 2024-09-12T02:07:00.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.446+0000 7fa535d68640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa53006d260 con 0x7fa53009b690 2024-09-12T02:07:00.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.446+0000 7fa52f7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa53015e740 0x7fa53006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52094/0 (socket says 172.21.15.19:52094) 2024-09-12T02:07:00.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.446+0000 7fa52f7fe640 1 -- 172.21.15.19:0/2817930846 learned_addr learned my addr 172.21.15.19:0/2817930846 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:00.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.446+0000 7fa52ffff640 1 --2- 172.21.15.19:0/2817930846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa53009b690 0x7fa53006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:00.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.446+0000 7fa52effd640 1 --2- 172.21.15.19:0/2817930846 >> v2:172.21.15.135:3300/0 conn(0x7fa5300d1540 0x7fa53006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:00.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.446+0000 7fa52e7fc640 1 -- 172.21.15.19:0/2817930846 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3679034334 0 0) 0x7fa5300d1970 con 0x7fa53015e740 2024-09-12T02:07:00.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.446+0000 7fa52e7fc640 1 -- 172.21.15.19:0/2817930846 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa518003520 con 0x7fa53015e740 2024-09-12T02:07:00.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.446+0000 7fa52e7fc640 1 -- 172.21.15.19:0/2817930846 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 544211001 0 0) 0x7fa518003520 con 0x7fa53015e740 2024-09-12T02:07:00.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.446+0000 7fa52e7fc640 1 -- 172.21.15.19:0/2817930846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa53009b690 msgr2=0x7fa53006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:00.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.446+0000 7fa52e7fc640 1 --2- 172.21.15.19:0/2817930846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa53009b690 0x7fa53006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.446+0000 7fa52e7fc640 1 -- 172.21.15.19:0/2817930846 >> v2:172.21.15.135:3300/0 conn(0x7fa5300d1540 msgr2=0x7fa53006dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:00.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.446+0000 7fa52e7fc640 1 --2- 172.21.15.19:0/2817930846 >> v2:172.21.15.135:3300/0 conn(0x7fa5300d1540 0x7fa53006dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.447+0000 7fa52e7fc640 1 -- 172.21.15.19:0/2817930846 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5300d0780 con 0x7fa53015e740 2024-09-12T02:07:00.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.447+0000 7fa52e7fc640 1 -- 172.21.15.19:0/2817930846 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fa520001670 con 0x7fa53015e740 2024-09-12T02:07:00.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.447+0000 7fa52e7fc640 1 -- 172.21.15.19:0/2817930846 >> v1:172.21.15.19:6789/0 conn(0x7fa53015e740 legacy=0x7fa53006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:00.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.447+0000 7fa52e7fc640 1 --2- 172.21.15.19:0/2817930846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa53009b690 0x7fa5180039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:00.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.447+0000 7fa52e7fc640 1 --2- 172.21.15.19:0/2817930846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa518003f60 0x7fa518004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:00.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.447+0000 7fa52e7fc640 1 --2- 172.21.15.19:0/2817930846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa518004d40 0x7fa5180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:00.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.447+0000 7fa52e7fc640 1 -- 172.21.15.19:0/2817930846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa53015eb20 con 0x7fa518004d40 2024-09-12T02:07:00.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.447+0000 7fa52e7fc640 1 -- 172.21.15.19:0/2817930846 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa53006d260 con 0x7fa518003f60 2024-09-12T02:07:00.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.447+0000 7fa52e7fc640 1 -- 172.21.15.19:0/2817930846 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa51800ba40 con 0x7fa53009b690 2024-09-12T02:07:00.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.447+0000 7fa52ffff640 1 --2- 172.21.15.19:0/2817930846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa518004d40 0x7fa5180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:00.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.447+0000 7fa52f7fe640 1 --2- 172.21.15.19:0/2817930846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa53009b690 0x7fa5180039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:00.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.447+0000 7fa52effd640 1 --2- 172.21.15.19:0/2817930846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa518003f60 0x7fa518004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:00.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.447+0000 7fa52ffff640 1 -- 172.21.15.19:0/2817930846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa53009b690 msgr2=0x7fa5180039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:00.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.447+0000 7fa52ffff640 1 --2- 172.21.15.19:0/2817930846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa53009b690 0x7fa5180039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.447+0000 7fa52ffff640 1 -- 172.21.15.19:0/2817930846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa518003f60 msgr2=0x7fa518004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:00.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.447+0000 7fa52ffff640 1 --2- 172.21.15.19:0/2817930846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa518003f60 0x7fa518004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.447+0000 7fa52ffff640 1 -- 172.21.15.19:0/2817930846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa518003520 con 0x7fa518004d40 2024-09-12T02:07:00.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.448+0000 7fa52ffff640 1 --2- 172.21.15.19:0/2817930846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa518004d40 0x7fa5180051c0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7fa528009fc0 tx=0x7fa518005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca44f22dc013bee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:00.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.448+0000 7fa52e7fc640 1 -- 172.21.15.19:0/2817930846 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa528009c10 con 0x7fa518004d40 2024-09-12T02:07:00.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.448+0000 7fa52e7fc640 1 -- 172.21.15.19:0/2817930846 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa528036070 con 0x7fa518004d40 2024-09-12T02:07:00.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.448+0000 7fa52e7fc640 1 -- 172.21.15.19:0/2817930846 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa528031880 con 0x7fa518004d40 2024-09-12T02:07:00.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.448+0000 7fa535d68640 1 -- 172.21.15.19:0/2817930846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa518004d40 msgr2=0x7fa5180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:00.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.448+0000 7fa535d68640 1 --2- 172.21.15.19:0/2817930846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa518004d40 0x7fa5180051c0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7fa528009fc0 tx=0x7fa518005830 comp rx=0 tx=0).stop 2024-09-12T02:07:00.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.448+0000 7fa52ffff640 1 -- 172.21.15.19:0/2817930846 reap_dead start 2024-09-12T02:07:00.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.448+0000 7fa535d68640 1 -- 172.21.15.19:0/2817930846 shutdown_connections 2024-09-12T02:07:00.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.448+0000 7fa535d68640 1 -- 172.21.15.19:0/2817930846 >> 172.21.15.19:0/2817930846 conn(0x7fa5300d23a0 msgr2=0x7fa5300d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:00.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.448+0000 7fa535d68640 1 -- 172.21.15.19:0/2817930846 shutdown_connections 2024-09-12T02:07:00.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.449+0000 7fa535d68640 1 -- 172.21.15.19:0/2817930846 wait complete. 2024-09-12T02:07:00.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.450+0000 7fa535d68640 1 Processor -- start 2024-09-12T02:07:00.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.450+0000 7fa535d68640 1 -- start start 2024-09-12T02:07:00.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa535d68640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa518004d40 0x7fa53014c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:00.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa535d68640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa53015beb0 0x7fa530149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:00.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa535d68640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5300b51f0 0x7fa53014ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:00.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa535d68640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa5300d1020 con 0x7fa518004d40 2024-09-12T02:07:00.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa535d68640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa5300d0d40 con 0x7fa5300b51f0 2024-09-12T02:07:00.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa535d68640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa53009bac0 con 0x7fa53015beb0 2024-09-12T02:07:00.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa52f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa518004d40 0x7fa53014c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:00.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa52f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa518004d40 0x7fa53014c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42272/0 (socket says 172.21.15.19:42272) 2024-09-12T02:07:00.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa52f7fe640 1 -- 172.21.15.19:0/1081245165 learned_addr learned my addr 172.21.15.19:0/1081245165 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:00.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa52ffff640 1 --2- 172.21.15.19:0/1081245165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5300b51f0 0x7fa53014ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:00.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa52effd640 1 --2- 172.21.15.19:0/1081245165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa53015beb0 0x7fa530149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:00.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa52f7fe640 1 -- 172.21.15.19:0/1081245165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa53015beb0 msgr2=0x7fa530149360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:00.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa52f7fe640 1 --2- 172.21.15.19:0/1081245165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa53015beb0 0x7fa530149360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa52f7fe640 1 -- 172.21.15.19:0/1081245165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5300b51f0 msgr2=0x7fa53014ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:00.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa52f7fe640 1 --2- 172.21.15.19:0/1081245165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5300b51f0 0x7fa53014ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa52f7fe640 1 -- 172.21.15.19:0/1081245165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa53015b0f0 con 0x7fa518004d40 2024-09-12T02:07:00.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa52f7fe640 1 --2- 172.21.15.19:0/1081245165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa518004d40 0x7fa53014c680 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7fa5200072c0 tx=0x7fa5200076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:00.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa517fff640 1 -- 172.21.15.19:0/1081245165 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52000f960 con 0x7fa518004d40 2024-09-12T02:07:00.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.451+0000 7fa517fff640 1 -- 172.21.15.19:0/1081245165 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa520018070 con 0x7fa518004d40 2024-09-12T02:07:00.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.452+0000 7fa517fff640 1 -- 172.21.15.19:0/1081245165 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52000fd60 con 0x7fa518004d40 2024-09-12T02:07:00.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.452+0000 7fa535d68640 1 -- 172.21.15.19:0/1081245165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa53015b3d0 con 0x7fa518004d40 2024-09-12T02:07:00.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.452+0000 7fa535d68640 1 -- 172.21.15.19:0/1081245165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa53015b990 con 0x7fa518004d40 2024-09-12T02:07:00.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.452+0000 7fa535d68640 1 -- 172.21.15.19:0/1081245165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa53006cd20 con 0x7fa518004d40 2024-09-12T02:07:00.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.453+0000 7fa517fff640 1 -- 172.21.15.19:0/1081245165 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa52001d460 con 0x7fa518004d40 2024-09-12T02:07:00.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.453+0000 7fa517fff640 1 --2- 172.21.15.19:0/1081245165 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa51c06be60 0x7fa51c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:00.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.454+0000 7fa517fff640 1 -- 172.21.15.19:0/1081245165 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 8689+0+0 (secure 0 0 0) 0x7fa52008bad0 con 0x7fa518004d40 2024-09-12T02:07:00.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.454+0000 7fa52effd640 1 --2- 172.21.15.19:0/1081245165 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa51c06be60 0x7fa51c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:00.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.454+0000 7fa52effd640 1 --2- 172.21.15.19:0/1081245165 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa51c06be60 0x7fa51c06e320 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa53014cbc0 tx=0x7fa524009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:00.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.458+0000 7fa517fff640 1 -- 172.21.15.19:0/1081245165 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa520059910 con 0x7fa518004d40 2024-09-12T02:07:00.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.668+0000 7fa535d68640 1 -- 172.21.15.19:0/1081245165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa53015def0 con 0x7fa518004d40 2024-09-12T02:07:00.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.669+0000 7fa517fff640 1 -- 172.21.15.19:0/1081245165 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 326 v326) ==== 95+0+3915 (secure 0 0 0) 0x7fa520059210 con 0x7fa518004d40 2024-09-12T02:07:00.670 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:00.670 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":326,"btime":"2024-09-12T02:06:54:767778+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3571445208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3571445208},{"type":"v1","addr":"172.21.15.19:6835","nonce":3571445208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/903132213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":903132213},{"type":"v1","addr":"172.21.15.135:6836","nonce":903132213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8150,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/739861373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":739861373},{"type":"v1","addr":"172.21.15.135:6837","nonce":739861373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":324},{"gid":10488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3905580508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3905580508},{"type":"v1","addr":"172.21.15.19:6834","nonce":3905580508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":320}],"filesystems":[]} 2024-09-12T02:07:00.670 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 326 2024-09-12T02:07:00.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.671+0000 7fa535d68640 1 -- 172.21.15.19:0/1081245165 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa51c06be60 msgr2=0x7fa51c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:00.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.671+0000 7fa535d68640 1 --2- 172.21.15.19:0/1081245165 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa51c06be60 0x7fa51c06e320 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa53014cbc0 tx=0x7fa524009190 comp rx=0 tx=0).stop 2024-09-12T02:07:00.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.671+0000 7fa535d68640 1 -- 172.21.15.19:0/1081245165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa518004d40 msgr2=0x7fa53014c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:00.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.671+0000 7fa535d68640 1 --2- 172.21.15.19:0/1081245165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa518004d40 0x7fa53014c680 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7fa5200072c0 tx=0x7fa5200076c0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.671+0000 7fa535d68640 1 -- 172.21.15.19:0/1081245165 shutdown_connections 2024-09-12T02:07:00.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.671+0000 7fa535d68640 1 --2- 172.21.15.19:0/1081245165 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa51c06be60 0x7fa51c06e320 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.671+0000 7fa535d68640 1 --2- 172.21.15.19:0/1081245165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5300b51f0 0x7fa53014ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.671+0000 7fa535d68640 1 --2- 172.21.15.19:0/1081245165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa53015beb0 0x7fa530149360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.671+0000 7fa535d68640 1 --2- 172.21.15.19:0/1081245165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa518004d40 0x7fa53014c680 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.671+0000 7fa535d68640 1 -- 172.21.15.19:0/1081245165 >> 172.21.15.19:0/1081245165 conn(0x7fa5300d23a0 msgr2=0x7fa5300b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:00.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.671+0000 7fa535d68640 1 -- 172.21.15.19:0/1081245165 shutdown_connections 2024-09-12T02:07:00.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.671+0000 7fa535d68640 1 -- 172.21.15.19:0/1081245165 wait complete. 2024-09-12T02:07:00.684 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:07:00.684 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:07:00.684 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:07:00.684 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:07:00.684 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:07:00.684 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:07:00.685 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:07:00.685 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:07:00.685 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:07:00.685 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:07:00.685 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:07:00.685 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:07:00.685 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:07:00.685 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:07:00.686 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:07:00.686 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:07:00.693 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:07:00.694 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:07:00.694 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:07:00.695 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:07:00.696 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:07:00.697 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:07:00.698 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:07:00.698 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:07:00.736 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:07:00.736 DEBUG:teuthology.parallel:result is None 2024-09-12T02:07:00.737 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:07:00.737 DEBUG:teuthology.parallel:result is None 2024-09-12T02:07:00.739 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:07:00.739 DEBUG:teuthology.parallel:result is None 2024-09-12T02:07:00.740 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:07:00.740 DEBUG:teuthology.parallel:result is None 2024-09-12T02:07:00.740 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:07:00.815 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-09-12T02:07:00.816 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-09-12T02:07:00.817 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2024-09-12T02:07:00.817 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-12T02:07:00.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.849+0000 7f9f5e465640 1 Processor -- start 2024-09-12T02:07:00.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.849+0000 7f9f5e465640 1 -- start start 2024-09-12T02:07:00.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.849+0000 7f9f5e465640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9f58072320 0x7f9f580cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:00.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.849+0000 7f9f5e465640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f58072de0 0x7f9f5806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:00.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.849+0000 7f9f5e465640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f58146140 con 0x7f9f58072700 2024-09-12T02:07:00.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.849+0000 7f9f5e465640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f9f580cd740 con 0x7f9f58072320 2024-09-12T02:07:00.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.849+0000 7f9f5e465640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9f580cda20 con 0x7f9f58072de0 2024-09-12T02:07:00.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.850+0000 7f9f57fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9f58072320 0x7f9f580cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:00.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.850+0000 7f9f57fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9f58072320 0x7f9f580cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42298/0 (socket says 172.21.15.19:42298) 2024-09-12T02:07:00.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.850+0000 7f9f57fff640 1 -- 172.21.15.19:0/2084199072 learned_addr learned my addr 172.21.15.19:0/2084199072 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:00.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.850+0000 7f9f577fe640 1 --2- 172.21.15.19:0/2084199072 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f58072de0 0x7f9f5806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:00.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.850+0000 7f9f57fff640 1 -- 172.21.15.19:0/2084199072 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f58072de0 msgr2=0x7f9f5806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:00.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.850+0000 7f9f57fff640 1 --2- 172.21.15.19:0/2084199072 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f58072de0 0x7f9f5806e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.850+0000 7f9f57fff640 1 -- 172.21.15.19:0/2084199072 >> v1:172.21.15.135:6789/0 conn(0x7f9f58072700 legacy=0x7f9f5806e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:00.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.850+0000 7f9f57fff640 1 -- 172.21.15.19:0/2084199072 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f580cdd00 con 0x7f9f58072320 2024-09-12T02:07:00.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.851+0000 7f9f57fff640 1 --2- 172.21.15.19:0/2084199072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f58072320 0x7f9f580cce60 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7f9f48009870 tx=0x7f9f4802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1ea77f0694d25e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:00.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.851+0000 7f9f56ffd640 1 -- 172.21.15.19:0/2084199072 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f48037070 con 0x7f9f58072320 2024-09-12T02:07:00.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.851+0000 7f9f56ffd640 1 -- 172.21.15.19:0/2084199072 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f48032440 con 0x7f9f58072320 2024-09-12T02:07:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.851+0000 7f9f56ffd640 1 -- 172.21.15.19:0/2084199072 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f48032810 con 0x7f9f58072320 2024-09-12T02:07:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.851+0000 7f9f5e465640 1 -- 172.21.15.19:0/2084199072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f58072320 msgr2=0x7f9f580cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.851+0000 7f9f5e465640 1 --2- 172.21.15.19:0/2084199072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f58072320 0x7f9f580cce60 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7f9f48009870 tx=0x7f9f4802a1c0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.851+0000 7f9f5e465640 1 -- 172.21.15.19:0/2084199072 shutdown_connections 2024-09-12T02:07:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.851+0000 7f9f5e465640 1 --2- 172.21.15.19:0/2084199072 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f58072de0 0x7f9f5806e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.851+0000 7f9f5e465640 1 --2- 172.21.15.19:0/2084199072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f58072320 0x7f9f580cce60 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.851+0000 7f9f5e465640 1 -- 172.21.15.19:0/2084199072 >> 172.21.15.19:0/2084199072 conn(0x7f9f58067d70 msgr2=0x7f9f5806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.852+0000 7f9f5e465640 1 -- 172.21.15.19:0/2084199072 shutdown_connections 2024-09-12T02:07:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.852+0000 7f9f5e465640 1 -- 172.21.15.19:0/2084199072 wait complete. 2024-09-12T02:07:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.853+0000 7f9f5e465640 1 Processor -- start 2024-09-12T02:07:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.853+0000 7f9f5e465640 1 -- start start 2024-09-12T02:07:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.854+0000 7f9f5e465640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f58072320 0x7f9f58140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.854+0000 7f9f5e465640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f58072700 0x7f9f581e6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.854+0000 7f9f5e465640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f58072de0 0x7f9f5813ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.854+0000 7f9f5e465640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9f580cd520 con 0x7f9f58072de0 2024-09-12T02:07:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.854+0000 7f9f5e465640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9f580cd3a0 con 0x7f9f58072700 2024-09-12T02:07:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.854+0000 7f9f5e465640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9f5806ed00 con 0x7f9f58072320 2024-09-12T02:07:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.854+0000 7f9f5ca02640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f58072de0 0x7f9f5813ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.854+0000 7f9f5ca02640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f58072de0 0x7f9f5813ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42302/0 (socket says 172.21.15.19:42302) 2024-09-12T02:07:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.854+0000 7f9f5ca02640 1 -- 172.21.15.19:0/1634441286 learned_addr learned my addr 172.21.15.19:0/1634441286 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.854+0000 7f9f57fff640 1 --2- 172.21.15.19:0/1634441286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f58072320 0x7f9f58140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.854+0000 7f9f577fe640 1 --2- 172.21.15.19:0/1634441286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f58072700 0x7f9f581e6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.854+0000 7f9f5ca02640 1 -- 172.21.15.19:0/1634441286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f58072320 msgr2=0x7f9f58140e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.854+0000 7f9f5ca02640 1 --2- 172.21.15.19:0/1634441286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f58072320 0x7f9f58140e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.854+0000 7f9f5ca02640 1 -- 172.21.15.19:0/1634441286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f58072700 msgr2=0x7f9f581e6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:00.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.854+0000 7f9f5ca02640 1 --2- 172.21.15.19:0/1634441286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f58072700 0x7f9f581e6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:00.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.854+0000 7f9f5ca02640 1 -- 172.21.15.19:0/1634441286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f581e7370 con 0x7f9f58072de0 2024-09-12T02:07:00.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.854+0000 7f9f5ca02640 1 --2- 172.21.15.19:0/1634441286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f58072de0 0x7f9f5813ec60 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000c7a0 tx=0x7f9f5000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:00.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.854+0000 7f9f54ff9640 1 -- 172.21.15.19:0/1634441286 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f50003b70 con 0x7f9f58072de0 2024-09-12T02:07:00.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.855+0000 7f9f54ff9640 1 -- 172.21.15.19:0/1634441286 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f50003d30 con 0x7f9f58072de0 2024-09-12T02:07:00.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.855+0000 7f9f54ff9640 1 -- 172.21.15.19:0/1634441286 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5000aa90 con 0x7f9f58072de0 2024-09-12T02:07:00.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.855+0000 7f9f5e465640 1 -- 172.21.15.19:0/1634441286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f581e7650 con 0x7f9f58072de0 2024-09-12T02:07:00.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.855+0000 7f9f5e465640 1 -- 172.21.15.19:0/1634441286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f5813f1a0 con 0x7f9f58072de0 2024-09-12T02:07:00.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.856+0000 7f9f5e465640 1 -- 172.21.15.19:0/1634441286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f581e7b70 con 0x7f9f58072de0 2024-09-12T02:07:00.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.856+0000 7f9f54ff9640 1 -- 172.21.15.19:0/1634441286 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f5000ac30 con 0x7f9f58072de0 2024-09-12T02:07:00.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.857+0000 7f9f54ff9640 1 --2- 172.21.15.19:0/1634441286 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9f4406be30 0x7f9f4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:00.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.857+0000 7f9f54ff9640 1 -- 172.21.15.19:0/1634441286 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 8689+0+0 (secure 0 0 0) 0x7f9f5008b960 con 0x7f9f58072de0 2024-09-12T02:07:00.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.857+0000 7f9f57fff640 1 --2- 172.21.15.19:0/1634441286 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9f4406be30 0x7f9f4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:00.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.857+0000 7f9f57fff640 1 --2- 172.21.15.19:0/1634441286 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9f4406be30 0x7f9f4406e2f0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9f48034000 tx=0x7f9f4802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:00.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:00.861+0000 7f9f54ff9640 1 -- 172.21.15.19:0/1634441286 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9f500597a0 con 0x7f9f58072de0 2024-09-12T02:07:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:01.046+0000 7f9f5e465640 1 -- 172.21.15.19:0/1634441286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f9f580cce60 con 0x7f9f58072de0 2024-09-12T02:07:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.143+0000 7f9f54ff9640 1 -- 172.21.15.19:0/1634441286 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v141) ==== 97+0+0 (secure 0 0 0) 0x7f9f500590a0 con 0x7f9f58072de0 2024-09-12T02:07:02.144 INFO:teuthology.orchestra.run.smithi019.stderr: removed all blocklist entries 2024-09-12T02:07:02.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.146+0000 7f9f5e465640 1 -- 172.21.15.19:0/1634441286 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9f4406be30 msgr2=0x7f9f4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.146+0000 7f9f5e465640 1 --2- 172.21.15.19:0/1634441286 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9f4406be30 0x7f9f4406e2f0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9f48034000 tx=0x7f9f4802e000 comp rx=0 tx=0).stop 2024-09-12T02:07:02.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.146+0000 7f9f5e465640 1 -- 172.21.15.19:0/1634441286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f58072de0 msgr2=0x7f9f5813ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.146+0000 7f9f5e465640 1 --2- 172.21.15.19:0/1634441286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f58072de0 0x7f9f5813ec60 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000c7a0 tx=0x7f9f5000cc60 comp rx=0 tx=0).stop 2024-09-12T02:07:02.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.146+0000 7f9f5e465640 1 -- 172.21.15.19:0/1634441286 shutdown_connections 2024-09-12T02:07:02.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.146+0000 7f9f5e465640 1 --2- 172.21.15.19:0/1634441286 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f9f4406be30 0x7f9f4406e2f0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.146+0000 7f9f5e465640 1 --2- 172.21.15.19:0/1634441286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f58072de0 0x7f9f5813ec60 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.146+0000 7f9f5e465640 1 --2- 172.21.15.19:0/1634441286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f58072700 0x7f9f581e6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.146+0000 7f9f5e465640 1 --2- 172.21.15.19:0/1634441286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f58072320 0x7f9f58140e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.146+0000 7f9f5e465640 1 -- 172.21.15.19:0/1634441286 >> 172.21.15.19:0/1634441286 conn(0x7f9f58067d70 msgr2=0x7f9f580c83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:02.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.146+0000 7f9f5e465640 1 -- 172.21.15.19:0/1634441286 shutdown_connections 2024-09-12T02:07:02.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.146+0000 7f9f5e465640 1 -- 172.21.15.19:0/1634441286 wait complete. 2024-09-12T02:07:02.160 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:07:02.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.269+0000 7f37dfb49640 1 Processor -- start 2024-09-12T02:07:02.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.270+0000 7f37dfb49640 1 -- start start 2024-09-12T02:07:02.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.270+0000 7f37dfb49640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37d80d0cf0 0x7f37d81690d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.270+0000 7f37dfb49640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37d80d12c0 con 0x7f37d809aca0 2024-09-12T02:07:02.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.270+0000 7f37dfb49640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37d80d15a0 con 0x7f37d8071750 2024-09-12T02:07:02.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.270+0000 7f37dfb49640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f37d806d040 con 0x7f37d80d0cf0 2024-09-12T02:07:02.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dd8e5640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f37d809aca0 0x7f37d809b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56376/0 (socket says 172.21.15.19:56376) 2024-09-12T02:07:02.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dd8e5640 1 -- 172.21.15.19:0/2546747129 learned_addr learned my addr 172.21.15.19:0/2546747129 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:02.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37de0e6640 1 --2- 172.21.15.19:0/2546747129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37d80d0cf0 0x7f37d81690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dc8e3640 1 -- 172.21.15.19:0/2546747129 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 530418502 0 0) 0x7f37d80d12c0 con 0x7f37d809aca0 2024-09-12T02:07:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dc8e3640 1 -- 172.21.15.19:0/2546747129 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37c0003520 con 0x7f37d809aca0 2024-09-12T02:07:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dc8e3640 1 -- 172.21.15.19:0/2546747129 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2315397610 0 0) 0x7f37c0003520 con 0x7f37d809aca0 2024-09-12T02:07:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dc8e3640 1 -- 172.21.15.19:0/2546747129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37d80d0cf0 msgr2=0x7f37d81690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dc8e3640 1 --2- 172.21.15.19:0/2546747129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37d80d0cf0 0x7f37d81690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dc8e3640 1 -- 172.21.15.19:0/2546747129 >> v1:172.21.15.135:6789/0 conn(0x7f37d8071750 legacy=0x7f37d80d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dc8e3640 1 -- 172.21.15.19:0/2546747129 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d80d1880 con 0x7f37d809aca0 2024-09-12T02:07:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dc8e3640 1 -- 172.21.15.19:0/2546747129 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f37c80019f0 con 0x7f37d809aca0 2024-09-12T02:07:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dc8e3640 1 -- 172.21.15.19:0/2546747129 >> v1:172.21.15.19:6789/0 conn(0x7f37d809aca0 legacy=0x7f37d809b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dc8e3640 1 --2- 172.21.15.19:0/2546747129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37c00039e0 0x7f37c0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dc8e3640 1 --2- 172.21.15.19:0/2546747129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37d80d0cf0 0x7f37c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dc8e3640 1 --2- 172.21.15.19:0/2546747129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c0004d40 0x7f37c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dc8e3640 1 -- 172.21.15.19:0/2546747129 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f37d806d040 con 0x7f37c00039e0 2024-09-12T02:07:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dc8e3640 1 -- 172.21.15.19:0/2546747129 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f37c000ba70 con 0x7f37c0004d40 2024-09-12T02:07:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dc8e3640 1 -- 172.21.15.19:0/2546747129 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f37c000bc70 con 0x7f37d80d0cf0 2024-09-12T02:07:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dd8e5640 1 --2- 172.21.15.19:0/2546747129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37c00039e0 0x7f37c0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37dd0e4640 1 --2- 172.21.15.19:0/2546747129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37d80d0cf0 0x7f37c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.271+0000 7f37de0e6640 1 --2- 172.21.15.19:0/2546747129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c0004d40 0x7f37c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.272+0000 7f37dd8e5640 1 -- 172.21.15.19:0/2546747129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37d80d0cf0 msgr2=0x7f37c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.272+0000 7f37dd8e5640 1 --2- 172.21.15.19:0/2546747129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37d80d0cf0 0x7f37c0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.272+0000 7f37dd8e5640 1 -- 172.21.15.19:0/2546747129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c0004d40 msgr2=0x7f37c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.272+0000 7f37dd8e5640 1 --2- 172.21.15.19:0/2546747129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c0004d40 0x7f37c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.272+0000 7f37dd8e5640 1 -- 172.21.15.19:0/2546747129 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c0003520 con 0x7f37c00039e0 2024-09-12T02:07:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.272+0000 7f37de0e6640 1 --2- 172.21.15.19:0/2546747129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c0004d40 0x7f37c00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.272+0000 7f37dd8e5640 1 --2- 172.21.15.19:0/2546747129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37c00039e0 0x7f37c0003e00 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7f37c8002230 tx=0x7f37c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a251529e896e88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.272+0000 7f37dc8e3640 1 -- 172.21.15.19:0/2546747129 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c800a4a0 con 0x7f37c00039e0 2024-09-12T02:07:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.273+0000 7f37dc8e3640 1 -- 172.21.15.19:0/2546747129 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c802f070 con 0x7f37c00039e0 2024-09-12T02:07:02.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.273+0000 7f37dc8e3640 1 -- 172.21.15.19:0/2546747129 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c802bcb0 con 0x7f37c00039e0 2024-09-12T02:07:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.273+0000 7f37dfb49640 1 -- 172.21.15.19:0/2546747129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37c00039e0 msgr2=0x7f37c0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.273+0000 7f37dfb49640 1 --2- 172.21.15.19:0/2546747129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37c00039e0 0x7f37c0003e00 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7f37c8002230 tx=0x7f37c0005830 comp rx=0 tx=0).stop 2024-09-12T02:07:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.273+0000 7f37de0e6640 1 -- 172.21.15.19:0/2546747129 reap_dead start 2024-09-12T02:07:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.273+0000 7f37dfb49640 1 -- 172.21.15.19:0/2546747129 shutdown_connections 2024-09-12T02:07:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.273+0000 7f37dfb49640 1 -- 172.21.15.19:0/2546747129 >> 172.21.15.19:0/2546747129 conn(0x7f37d80d23a0 msgr2=0x7f37d80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.273+0000 7f37dfb49640 1 -- 172.21.15.19:0/2546747129 shutdown_connections 2024-09-12T02:07:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.273+0000 7f37dfb49640 1 -- 172.21.15.19:0/2546747129 wait complete. 2024-09-12T02:07:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.274+0000 7f37dfb49640 1 Processor -- start 2024-09-12T02:07:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.275+0000 7f37dfb49640 1 -- start start 2024-09-12T02:07:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.275+0000 7f37dfb49640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c00039e0 0x7f37d80cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.275+0000 7f37dfb49640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37d80b2240 0x7f37d80b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.275+0000 7f37dfb49640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37d814f190 0x7f37d815cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.275+0000 7f37dfb49640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f37d809b790 con 0x7f37d80b2240 2024-09-12T02:07:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.275+0000 7f37dfb49640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f37d8070220 con 0x7f37c00039e0 2024-09-12T02:07:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.275+0000 7f37dfb49640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f37d81670c0 con 0x7f37d814f190 2024-09-12T02:07:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.275+0000 7f37dd0e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37d80b2240 0x7f37d80b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.275+0000 7f37dd0e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37d80b2240 0x7f37d80b3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54600/0 (socket says 172.21.15.19:54600) 2024-09-12T02:07:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.275+0000 7f37dd0e4640 1 -- 172.21.15.19:0/1482847946 learned_addr learned my addr 172.21.15.19:0/1482847946 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.276+0000 7f37dd0e4640 1 -- 172.21.15.19:0/1482847946 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37d814f190 msgr2=0x7f37d815cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.276+0000 7f37dd0e4640 1 --2- 172.21.15.19:0/1482847946 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37d814f190 0x7f37d815cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.276+0000 7f37dd0e4640 1 -- 172.21.15.19:0/1482847946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c00039e0 msgr2=0x7f37d80cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.276+0000 7f37dd0e4640 1 --2- 172.21.15.19:0/1482847946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c00039e0 0x7f37d80cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.276+0000 7f37dd0e4640 1 -- 172.21.15.19:0/1482847946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d80ca260 con 0x7f37d80b2240 2024-09-12T02:07:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.276+0000 7f37dd0e4640 1 --2- 172.21.15.19:0/1482847946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37d80b2240 0x7f37d80b3440 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00f880 tx=0x7f37cc00fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.276+0000 7f37d67fc640 1 -- 172.21.15.19:0/1482847946 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc001d20 con 0x7f37d80b2240 2024-09-12T02:07:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.276+0000 7f37d67fc640 1 -- 172.21.15.19:0/1482847946 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37cc018070 con 0x7f37d80b2240 2024-09-12T02:07:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.276+0000 7f37dfb49640 1 -- 172.21.15.19:0/1482847946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d80ca4e0 con 0x7f37d80b2240 2024-09-12T02:07:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.276+0000 7f37d67fc640 1 -- 172.21.15.19:0/1482847946 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc00d650 con 0x7f37d80b2240 2024-09-12T02:07:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.276+0000 7f37dfb49640 1 -- 172.21.15.19:0/1482847946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d80caaa0 con 0x7f37d80b2240 2024-09-12T02:07:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.277+0000 7f37dfb49640 1 -- 172.21.15.19:0/1482847946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37d80d05e0 con 0x7f37d80b2240 2024-09-12T02:07:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.277+0000 7f37d67fc640 1 -- 172.21.15.19:0/1482847946 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f37cc00d7f0 con 0x7f37d80b2240 2024-09-12T02:07:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.278+0000 7f37d67fc640 1 --2- 172.21.15.19:0/1482847946 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f37c406be60 0x7f37c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.278+0000 7f37d67fc640 1 -- 172.21.15.19:0/1482847946 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5249+0+0 (secure 0 0 0) 0x7f37cc08a9f0 con 0x7f37d80b2240 2024-09-12T02:07:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.278+0000 7f37dd8e5640 1 --2- 172.21.15.19:0/1482847946 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f37c406be60 0x7f37c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.279+0000 7f37dd8e5640 1 --2- 172.21.15.19:0/1482847946 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f37c406be60 0x7f37c406e320 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f37c8033000 tx=0x7f37c8038040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.282+0000 7f37d67fc640 1 -- 172.21.15.19:0/1482847946 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37d80ca260 con 0x7f37d80b2240 2024-09-12T02:07:02.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.529+0000 7f37dfb49640 1 -- 172.21.15.19:0/1482847946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f37d8074b00 con 0x7f37d80b2240 2024-09-12T02:07:02.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.529+0000 7f37d67fc640 1 -- 172.21.15.19:0/1482847946 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f37cc059560 con 0x7f37d80b2240 2024-09-12T02:07:02.530 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:02.530 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:07:02.530 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_dump": [ 2024-09-12T02:07:02.530 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.530 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.a", 2024-09-12T02:07:02.530 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJm5rSjChAA4H0OW7ubTgq4vmUaoGvvNA==", 2024-09-12T02:07:02.530 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.530 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:07:02.531 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T02:07:02.531 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T02:07:02.531 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:07:02.531 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.531 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:07:02.531 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.531 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.b", 2024-09-12T02:07:02.531 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmyaCyFhAAV87Ogacs5CmiAuG0p/61Fw==", 2024-09-12T02:07:02.531 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.531 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:07:02.531 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T02:07:02.531 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T02:07:02.532 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:07:02.532 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.532 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:07:02.532 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.532 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.c", 2024-09-12T02:07:02.532 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmVLrfERAAlIw2yLSJubtZ1o4NB9IDsg==", 2024-09-12T02:07:02.532 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.532 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:07:02.532 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T02:07:02.532 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T02:07:02.532 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:07:02.533 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.533 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:07:02.533 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.533 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.d", 2024-09-12T02:07:02.533 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmd6a1HRAA04/r87MKfFM1VQvG1Tjj8A==", 2024-09-12T02:07:02.533 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.533 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:07:02.533 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T02:07:02.533 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T02:07:02.533 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:07:02.533 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.533 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:07:02.533 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.533 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.0", 2024-09-12T02:07:02.534 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD0SeJme7ETBRAA/8v8aJcEzpHYmAPg5Hxdzg==", 2024-09-12T02:07:02.534 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.534 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:07:02.534 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:07:02.534 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:07:02.534 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.534 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:07:02.534 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.534 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.1", 2024-09-12T02:07:02.534 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD3SeJmfXQyFhAALiZjnIoDw+OtH9of5IUu0w==", 2024-09-12T02:07:02.534 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.534 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:07:02.534 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:07:02.534 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:07:02.535 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.535 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:07:02.535 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.535 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.2", 2024-09-12T02:07:02.535 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD6SeJmMDNwJxAABb+94TBxpZx3GovP1g1Q2A==", 2024-09-12T02:07:02.535 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.535 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:07:02.535 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:07:02.535 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:07:02.535 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.535 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:07:02.535 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.535 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.3", 2024-09-12T02:07:02.536 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD9SeJmZMgKOBAAgU+mzTBmPSHE7mUElUA9lA==", 2024-09-12T02:07:02.536 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.536 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:07:02.536 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:07:02.536 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:07:02.536 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.536 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:07:02.536 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.536 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.4", 2024-09-12T02:07:02.536 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAESuJmnb9kBBAA6PmrEGSckixHv73r9ogheQ==", 2024-09-12T02:07:02.536 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.536 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:07:02.536 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:07:02.537 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:07:02.537 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.537 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:07:02.537 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.537 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.5", 2024-09-12T02:07:02.537 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAHSuJmLU1hBhAAlFooSVxCEmIHSjqscaFnhQ==", 2024-09-12T02:07:02.537 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.537 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:07:02.537 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:07:02.537 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:07:02.537 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.537 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:07:02.537 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.537 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.6", 2024-09-12T02:07:02.538 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAKSuJmeIj7BxAADTmZtK8dk94LSGa88+xq3Q==", 2024-09-12T02:07:02.538 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.538 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:07:02.538 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:07:02.538 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:07:02.538 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.538 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:07:02.538 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.538 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.7", 2024-09-12T02:07:02.538 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQANSuJmw92iJxAAsjNKRSdndTUGmBtaN3g/pQ==", 2024-09-12T02:07:02.538 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.538 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-09-12T02:07:02.538 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-09-12T02:07:02.538 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:07:02.539 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.539 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:07:02.539 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.539 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.0", 2024-09-12T02:07:02.539 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmfHbXIRAALAvdYAlaB6WxWtubFnlxRw==", 2024-09-12T02:07:02.539 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.539 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:07:02.539 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow r", 2024-09-12T02:07:02.539 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T02:07:02.539 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.539 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:07:02.539 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.539 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.1", 2024-09-12T02:07:02.539 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmOjfDKhAA8h0ldWP6mNPgoqtIejhF+Q==", 2024-09-12T02:07:02.540 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.540 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:07:02.540 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T02:07:02.540 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T02:07:02.540 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T02:07:02.540 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.540 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:07:02.540 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.540 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.2", 2024-09-12T02:07:02.540 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmLQSOJxAA2RhDLfjVzPpg1kiJe++WHg==", 2024-09-12T02:07:02.540 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.540 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:07:02.540 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T02:07:02.541 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T02:07:02.541 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T02:07:02.541 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.541 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:07:02.541 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.541 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.3", 2024-09-12T02:07:02.541 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmXS5YMBAAXSS+3Omu0PYIz1bJcSxefw==", 2024-09-12T02:07:02.541 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.541 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-09-12T02:07:02.541 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-09-12T02:07:02.541 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-09-12T02:07:02.541 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-09-12T02:07:02.541 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.541 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:07:02.542 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.542 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.admin", 2024-09-12T02:07:02.542 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDvSeJmCljiKRAAQmsy5rl4ZPpm2pD1kXMO3g==", 2024-09-12T02:07:02.542 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.542 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-09-12T02:07:02.542 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-09-12T02:07:02.542 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-09-12T02:07:02.542 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:07:02.542 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.542 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:07:02.542 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.542 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.x", 2024-09-12T02:07:02.542 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmjx1VBxAAF80kgsMnFJn+gL44QZn6bg==", 2024-09-12T02:07:02.543 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.543 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-09-12T02:07:02.543 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-09-12T02:07:02.543 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:07:02.543 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.543 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T02:07:02.543 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.543 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.y", 2024-09-12T02:07:02.543 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDwSeJmXphnAxAAUnmZ3JPOt1Yzk0zqWh5+kg==", 2024-09-12T02:07:02.543 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-09-12T02:07:02.543 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-09-12T02:07:02.543 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-09-12T02:07:02.544 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-09-12T02:07:02.544 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.544 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.544 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T02:07:02.544 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:07:02.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.531+0000 7f37dfb49640 1 -- 172.21.15.19:0/1482847946 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f37c406be60 msgr2=0x7f37c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.531+0000 7f37dfb49640 1 --2- 172.21.15.19:0/1482847946 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f37c406be60 0x7f37c406e320 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f37c8033000 tx=0x7f37c8038040 comp rx=0 tx=0).stop 2024-09-12T02:07:02.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.531+0000 7f37dfb49640 1 -- 172.21.15.19:0/1482847946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37d80b2240 msgr2=0x7f37d80b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.531+0000 7f37dfb49640 1 --2- 172.21.15.19:0/1482847946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37d80b2240 0x7f37d80b3440 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00f880 tx=0x7f37cc00fd40 comp rx=0 tx=0).stop 2024-09-12T02:07:02.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.531+0000 7f37dfb49640 1 -- 172.21.15.19:0/1482847946 shutdown_connections 2024-09-12T02:07:02.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.531+0000 7f37dfb49640 1 --2- 172.21.15.19:0/1482847946 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f37c406be60 0x7f37c406e320 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.531+0000 7f37dfb49640 1 --2- 172.21.15.19:0/1482847946 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37d814f190 0x7f37d815cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.531+0000 7f37dfb49640 1 --2- 172.21.15.19:0/1482847946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37d80b2240 0x7f37d80b3440 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.531+0000 7f37dfb49640 1 --2- 172.21.15.19:0/1482847946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c00039e0 0x7f37d80cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.531+0000 7f37dfb49640 1 -- 172.21.15.19:0/1482847946 >> 172.21.15.19:0/1482847946 conn(0x7f37d80d23a0 msgr2=0x7f37d815bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:02.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.531+0000 7f37dfb49640 1 -- 172.21.15.19:0/1482847946 shutdown_connections 2024-09-12T02:07:02.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.531+0000 7f37dfb49640 1 -- 172.21.15.19:0/1482847946 wait complete. 2024-09-12T02:07:02.547 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:07:02.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.648+0000 7f69ce8c0640 1 Processor -- start 2024-09-12T02:07:02.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.648+0000 7f69ce8c0640 1 -- start start 2024-09-12T02:07:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.649+0000 7f69ce8c0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69c8161c80 0x7f69c806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.649+0000 7f69ce8c0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f69c8162060 0x7f69c80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.649+0000 7f69ce8c0640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69c806e870 con 0x7f69c80b64b0 2024-09-12T02:07:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.649+0000 7f69ce8c0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f69c806d9f0 con 0x7f69c8162060 2024-09-12T02:07:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.649+0000 7f69ce8c0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f69c806dcd0 con 0x7f69c8161c80 2024-09-12T02:07:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69cce5d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f69c80b64b0 0x7f69c8162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56378/0 (socket says 172.21.15.19:56378) 2024-09-12T02:07:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69cce5d640 1 -- 172.21.15.19:0/2297635410 learned_addr learned my addr 172.21.15.19:0/2297635410 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c6ffd640 1 -- 172.21.15.19:0/2297635410 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2135389305 0 0) 0x7f69c0001490 con 0x7f69c80b64b0 2024-09-12T02:07:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c7fff640 1 --2- 172.21.15.19:0/2297635410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69c8161c80 0x7f69c806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c77fe640 1 --2- 172.21.15.19:0/2297635410 >> v2:172.21.15.135:3300/0 conn(0x7f69c8162060 0x7f69c80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c6ffd640 1 -- 172.21.15.19:0/2297635410 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69b0003520 con 0x7f69c80b64b0 2024-09-12T02:07:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c6ffd640 1 -- 172.21.15.19:0/2297635410 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3193377410 0 0) 0x7f69b0003520 con 0x7f69c80b64b0 2024-09-12T02:07:02.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c6ffd640 1 -- 172.21.15.19:0/2297635410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69c8161c80 msgr2=0x7f69c806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:02.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c6ffd640 1 --2- 172.21.15.19:0/2297635410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69c8161c80 0x7f69c806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c6ffd640 1 -- 172.21.15.19:0/2297635410 >> v2:172.21.15.135:3300/0 conn(0x7f69c8162060 msgr2=0x7f69c80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:02.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c6ffd640 1 --2- 172.21.15.19:0/2297635410 >> v2:172.21.15.135:3300/0 conn(0x7f69c8162060 0x7f69c80b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c6ffd640 1 -- 172.21.15.19:0/2297635410 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c806dfb0 con 0x7f69c80b64b0 2024-09-12T02:07:02.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c6ffd640 1 -- 172.21.15.19:0/2297635410 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f69c0001bc0 con 0x7f69c80b64b0 2024-09-12T02:07:02.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c6ffd640 1 -- 172.21.15.19:0/2297635410 >> v1:172.21.15.19:6789/0 conn(0x7f69c80b64b0 legacy=0x7f69c8162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c6ffd640 1 --2- 172.21.15.19:0/2297635410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69b00039b0 0x7f69b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c6ffd640 1 --2- 172.21.15.19:0/2297635410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69c8161c80 0x7f69b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c6ffd640 1 --2- 172.21.15.19:0/2297635410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b0004d40 0x7f69b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c6ffd640 1 -- 172.21.15.19:0/2297635410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f69c806d9f0 con 0x7f69b00039b0 2024-09-12T02:07:02.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c6ffd640 1 -- 172.21.15.19:0/2297635410 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f69c806dcd0 con 0x7f69b0004d40 2024-09-12T02:07:02.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c6ffd640 1 -- 172.21.15.19:0/2297635410 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f69b000b9c0 con 0x7f69c8161c80 2024-09-12T02:07:02.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c7fff640 1 --2- 172.21.15.19:0/2297635410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69b00039b0 0x7f69b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69cce5d640 1 --2- 172.21.15.19:0/2297635410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b0004d40 0x7f69b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.650+0000 7f69c77fe640 1 --2- 172.21.15.19:0/2297635410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69c8161c80 0x7f69b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.651+0000 7f69c7fff640 1 -- 172.21.15.19:0/2297635410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69c8161c80 msgr2=0x7f69b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:02.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.651+0000 7f69c7fff640 1 --2- 172.21.15.19:0/2297635410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69c8161c80 0x7f69b0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.651+0000 7f69c7fff640 1 -- 172.21.15.19:0/2297635410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b0004d40 msgr2=0x7f69b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:02.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.651+0000 7f69c7fff640 1 --2- 172.21.15.19:0/2297635410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b0004d40 0x7f69b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.651+0000 7f69c7fff640 1 -- 172.21.15.19:0/2297635410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b0003520 con 0x7f69b00039b0 2024-09-12T02:07:02.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.651+0000 7f69c77fe640 1 --2- 172.21.15.19:0/2297635410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69c8161c80 0x7f69b0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:02.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.651+0000 7f69c7fff640 1 --2- 172.21.15.19:0/2297635410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69b00039b0 0x7f69b0003dd0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009ac0 tx=0x7f69b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ceb235c6f39d48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:02.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.651+0000 7f69c6ffd640 1 -- 172.21.15.19:0/2297635410 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b8036070 con 0x7f69b00039b0 2024-09-12T02:07:02.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.651+0000 7f69c6ffd640 1 -- 172.21.15.19:0/2297635410 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b8031400 con 0x7f69b00039b0 2024-09-12T02:07:02.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.651+0000 7f69c6ffd640 1 -- 172.21.15.19:0/2297635410 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b8009690 con 0x7f69b00039b0 2024-09-12T02:07:02.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.652+0000 7f69ce8c0640 1 -- 172.21.15.19:0/2297635410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69b00039b0 msgr2=0x7f69b0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.652+0000 7f69ce8c0640 1 --2- 172.21.15.19:0/2297635410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69b00039b0 0x7f69b0003dd0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009ac0 tx=0x7f69b0005830 comp rx=0 tx=0).stop 2024-09-12T02:07:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.652+0000 7f69cce5d640 1 -- 172.21.15.19:0/2297635410 reap_dead start 2024-09-12T02:07:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.652+0000 7f69ce8c0640 1 -- 172.21.15.19:0/2297635410 shutdown_connections 2024-09-12T02:07:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.652+0000 7f69ce8c0640 1 -- 172.21.15.19:0/2297635410 >> 172.21.15.19:0/2297635410 conn(0x7f69c80d44f0 msgr2=0x7f69c80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.652+0000 7f69ce8c0640 1 -- 172.21.15.19:0/2297635410 shutdown_connections 2024-09-12T02:07:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.652+0000 7f69ce8c0640 1 -- 172.21.15.19:0/2297635410 wait complete. 2024-09-12T02:07:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.653+0000 7f69ce8c0640 1 Processor -- start 2024-09-12T02:07:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.653+0000 7f69ce8c0640 1 -- start start 2024-09-12T02:07:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.654+0000 7f69ce8c0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69b00039b0 0x7f69c8159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.654+0000 7f69ce8c0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69c80b2220 0x7f69c80b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.654+0000 7f69ce8c0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69c80cc2e0 0x7f69c80cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.654+0000 7f69ce8c0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f69c80d2a10 con 0x7f69c80b2220 2024-09-12T02:07:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.654+0000 7f69ce8c0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f69c80d2890 con 0x7f69c80cc2e0 2024-09-12T02:07:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.654+0000 7f69ce8c0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f69c806e330 con 0x7f69b00039b0 2024-09-12T02:07:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.654+0000 7f69c77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69c80b2220 0x7f69c80b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.654+0000 7f69c77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69c80b2220 0x7f69c80b26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54620/0 (socket says 172.21.15.19:54620) 2024-09-12T02:07:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.654+0000 7f69c77fe640 1 -- 172.21.15.19:0/1559363770 learned_addr learned my addr 172.21.15.19:0/1559363770 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.654+0000 7f69c7fff640 1 --2- 172.21.15.19:0/1559363770 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69b00039b0 0x7f69c8159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.654+0000 7f69cce5d640 1 --2- 172.21.15.19:0/1559363770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69c80cc2e0 0x7f69c80cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.655+0000 7f69c77fe640 1 -- 172.21.15.19:0/1559363770 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69b00039b0 msgr2=0x7f69c8159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.655+0000 7f69c77fe640 1 --2- 172.21.15.19:0/1559363770 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69b00039b0 0x7f69c8159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.655+0000 7f69c77fe640 1 -- 172.21.15.19:0/1559363770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69c80cc2e0 msgr2=0x7f69c80cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.655+0000 7f69c77fe640 1 --2- 172.21.15.19:0/1559363770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69c80cc2e0 0x7f69c80cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.655+0000 7f69c77fe640 1 -- 172.21.15.19:0/1559363770 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c80b9270 con 0x7f69c80b2220 2024-09-12T02:07:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.655+0000 7f69c77fe640 1 --2- 172.21.15.19:0/1559363770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69c80b2220 0x7f69c80b26a0 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7f69bc011590 tx=0x7f69bc011990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.655+0000 7f69c4ff9640 1 -- 172.21.15.19:0/1559363770 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc015870 con 0x7f69c80b2220 2024-09-12T02:07:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.655+0000 7f69c4ff9640 1 -- 172.21.15.19:0/1559363770 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69bc015a10 con 0x7f69c80b2220 2024-09-12T02:07:02.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.655+0000 7f69ce8c0640 1 -- 172.21.15.19:0/1559363770 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c80b9550 con 0x7f69c80b2220 2024-09-12T02:07:02.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.655+0000 7f69c4ff9640 1 -- 172.21.15.19:0/1559363770 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc015e00 con 0x7f69c80b2220 2024-09-12T02:07:02.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.655+0000 7f69ce8c0640 1 -- 172.21.15.19:0/1559363770 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c80b9b10 con 0x7f69c80b2220 2024-09-12T02:07:02.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.656+0000 7f69ce8c0640 1 -- 172.21.15.19:0/1559363770 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69c8162ca0 con 0x7f69c80b2220 2024-09-12T02:07:02.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.657+0000 7f69c4ff9640 1 -- 172.21.15.19:0/1559363770 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f69bc013400 con 0x7f69c80b2220 2024-09-12T02:07:02.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.657+0000 7f69c4ff9640 1 --2- 172.21.15.19:0/1559363770 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f69b406be60 0x7f69b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.657+0000 7f69c4ff9640 1 -- 172.21.15.19:0/1559363770 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5249+0+0 (secure 0 0 0) 0x7f69bc08b3f0 con 0x7f69c80b2220 2024-09-12T02:07:02.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.657+0000 7f69c7fff640 1 --2- 172.21.15.19:0/1559363770 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f69b406be60 0x7f69b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.658+0000 7f69c7fff640 1 --2- 172.21.15.19:0/1559363770 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f69b406be60 0x7f69b406e320 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f69b8033000 tx=0x7f69b8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:02.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.662+0000 7f69c4ff9640 1 -- 172.21.15.19:0/1559363770 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f69bc019030 con 0x7f69c80b2220 2024-09-12T02:07:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.839+0000 7f69ce8c0640 1 -- 172.21.15.19:0/1559363770 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f69c81629c0 con 0x7f69c80b2220 2024-09-12T02:07:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.839+0000 7f69c4ff9640 1 -- 172.21.15.19:0/1559363770 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v141) ==== 84+0+65 (secure 0 0 0) 0x7f69bc059f60 con 0x7f69c80b2220 2024-09-12T02:07:02.839 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:02.840 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-09-12T02:07:02.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T02:07:02.840 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-09-12T02:07:02.840 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-09-12T02:07:02.840 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T02:07:02.840 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-09-12T02:07:02.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.841+0000 7f69ce8c0640 1 -- 172.21.15.19:0/1559363770 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f69b406be60 msgr2=0x7f69b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.841+0000 7f69ce8c0640 1 --2- 172.21.15.19:0/1559363770 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f69b406be60 0x7f69b406e320 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f69b8033000 tx=0x7f69b8008030 comp rx=0 tx=0).stop 2024-09-12T02:07:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.841+0000 7f69ce8c0640 1 -- 172.21.15.19:0/1559363770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69c80b2220 msgr2=0x7f69c80b26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.841+0000 7f69ce8c0640 1 --2- 172.21.15.19:0/1559363770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69c80b2220 0x7f69c80b26a0 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7f69bc011590 tx=0x7f69bc011990 comp rx=0 tx=0).stop 2024-09-12T02:07:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.841+0000 7f69ce8c0640 1 -- 172.21.15.19:0/1559363770 shutdown_connections 2024-09-12T02:07:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.841+0000 7f69ce8c0640 1 --2- 172.21.15.19:0/1559363770 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f69b406be60 0x7f69b406e320 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.841+0000 7f69ce8c0640 1 --2- 172.21.15.19:0/1559363770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69c80cc2e0 0x7f69c80cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.841+0000 7f69ce8c0640 1 --2- 172.21.15.19:0/1559363770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69c80b2220 0x7f69c80b26a0 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.841+0000 7f69ce8c0640 1 --2- 172.21.15.19:0/1559363770 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69b00039b0 0x7f69c8159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.841+0000 7f69ce8c0640 1 -- 172.21.15.19:0/1559363770 >> 172.21.15.19:0/1559363770 conn(0x7f69c80d44f0 msgr2=0x7f69c80d3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.841+0000 7f69ce8c0640 1 -- 172.21.15.19:0/1559363770 shutdown_connections 2024-09-12T02:07:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.841+0000 7f69ce8c0640 1 -- 172.21.15.19:0/1559363770 wait complete. 2024-09-12T02:07:02.853 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:07:02.853 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:07:02.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.958+0000 7f790d8af640 1 Processor -- start 2024-09-12T02:07:02.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.959+0000 7f790d8af640 1 -- start start 2024-09-12T02:07:02.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.959+0000 7f790d8af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7908158ec0 0x7f790815c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.959+0000 7f790d8af640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f79080b4d50 0x7f79080b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.959+0000 7f790d8af640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f790815c850 con 0x7f790815ca50 2024-09-12T02:07:02.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.959+0000 7f790d8af640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f79081592a0 con 0x7f79080b4d50 2024-09-12T02:07:02.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.959+0000 7f790d8af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f790815d010 con 0x7f7908158ec0 2024-09-12T02:07:02.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.960+0000 7f79077fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f79080b4d50 0x7f79080b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.960+0000 7f79067fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f790815ca50 0x7f79081594d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56382/0 (socket says 172.21.15.19:56382) 2024-09-12T02:07:02.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.960+0000 7f79067fc640 1 -- 172.21.15.19:0/530315418 learned_addr learned my addr 172.21.15.19:0/530315418 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:02.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.960+0000 7f7906ffd640 1 --2- 172.21.15.19:0/530315418 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7908158ec0 0x7f790815c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.960+0000 7f79077fe640 1 -- 172.21.15.19:0/530315418 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7908158ec0 msgr2=0x7f790815c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:02.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.960+0000 7f79077fe640 1 --2- 172.21.15.19:0/530315418 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7908158ec0 0x7f790815c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.960+0000 7f79077fe640 1 -- 172.21.15.19:0/530315418 >> v1:172.21.15.19:6789/0 conn(0x7f790815ca50 legacy=0x7f79081594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.960+0000 7f79077fe640 1 -- 172.21.15.19:0/530315418 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790815d2f0 con 0x7f79080b4d50 2024-09-12T02:07:02.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.960+0000 7f7905ffb640 1 -- 172.21.15.19:0/530315418 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 835266754 0 0) 0x7f78f0001110 con 0x7f790815ca50 2024-09-12T02:07:02.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.960+0000 7f7906ffd640 1 --2- 172.21.15.19:0/530315418 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7908158ec0 0x7f790815c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:02.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.961+0000 7f79077fe640 1 --2- 172.21.15.19:0/530315418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79080b4d50 0x7f79080b51e0 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009d90 tx=0x7f78f802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bff91cf3f7f6dfb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:02.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.961+0000 7f7905ffb640 1 -- 172.21.15.19:0/530315418 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8007740 con 0x7f79080b4d50 2024-09-12T02:07:02.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.961+0000 7f7905ffb640 1 -- 172.21.15.19:0/530315418 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f80078e0 con 0x7f79080b4d50 2024-09-12T02:07:02.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.961+0000 7f7905ffb640 1 -- 172.21.15.19:0/530315418 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8007cb0 con 0x7f79080b4d50 2024-09-12T02:07:02.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.961+0000 7f790d8af640 1 -- 172.21.15.19:0/530315418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79080b4d50 msgr2=0x7f79080b51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.961+0000 7f790d8af640 1 --2- 172.21.15.19:0/530315418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79080b4d50 0x7f79080b51e0 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009d90 tx=0x7f78f802a660 comp rx=0 tx=0).stop 2024-09-12T02:07:02.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.961+0000 7f790d8af640 1 -- 172.21.15.19:0/530315418 shutdown_connections 2024-09-12T02:07:02.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.961+0000 7f790d8af640 1 --2- 172.21.15.19:0/530315418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79080b4d50 0x7f79080b51e0 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.961+0000 7f790d8af640 1 --2- 172.21.15.19:0/530315418 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7908158ec0 0x7f790815c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.961+0000 7f790d8af640 1 -- 172.21.15.19:0/530315418 >> 172.21.15.19:0/530315418 conn(0x7f790809aa30 msgr2=0x7f79080b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:02.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.961+0000 7f790d8af640 1 -- 172.21.15.19:0/530315418 shutdown_connections 2024-09-12T02:07:02.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.962+0000 7f790d8af640 1 -- 172.21.15.19:0/530315418 wait complete. 2024-09-12T02:07:02.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.963+0000 7f790d8af640 1 Processor -- start 2024-09-12T02:07:02.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.963+0000 7f790d8af640 1 -- start start 2024-09-12T02:07:02.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.963+0000 7f790d8af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79080b4d50 0x7f79081522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f790d8af640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7908158ec0 0x7f790809ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f790d8af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f790815ca50 0x7f7908156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f790d8af640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f790815db90 con 0x7f790815ca50 2024-09-12T02:07:02.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f790d8af640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f790815d8b0 con 0x7f7908158ec0 2024-09-12T02:07:02.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f790d8af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f790815e0b0 con 0x7f79080b4d50 2024-09-12T02:07:02.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f79077fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f790815ca50 0x7f7908156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f79077fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f790815ca50 0x7f7908156e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54640/0 (socket says 172.21.15.19:54640) 2024-09-12T02:07:02.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f79077fe640 1 -- 172.21.15.19:0/1657155329 learned_addr learned my addr 172.21.15.19:0/1657155329 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:02.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f79077fe640 1 -- 172.21.15.19:0/1657155329 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79080b4d50 msgr2=0x7f79081522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f79077fe640 1 --2- 172.21.15.19:0/1657155329 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79080b4d50 0x7f79081522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f79067fc640 1 --2- 172.21.15.19:0/1657155329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7908158ec0 0x7f790809ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f79077fe640 1 -- 172.21.15.19:0/1657155329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7908158ec0 msgr2=0x7f790809ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f79077fe640 1 --2- 172.21.15.19:0/1657155329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7908158ec0 0x7f790809ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f79077fe640 1 -- 172.21.15.19:0/1657155329 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790809df50 con 0x7f790815ca50 2024-09-12T02:07:02.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f79077fe640 1 --2- 172.21.15.19:0/1657155329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f790815ca50 0x7f7908156e70 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009d90 tx=0x7f78f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:02.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f78fffff640 1 -- 172.21.15.19:0/1657155329 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8040070 con 0x7f790815ca50 2024-09-12T02:07:02.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f78fffff640 1 -- 172.21.15.19:0/1657155329 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f8031c40 con 0x7f790815ca50 2024-09-12T02:07:02.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f790d8af640 1 -- 172.21.15.19:0/1657155329 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790809e230 con 0x7f790815ca50 2024-09-12T02:07:02.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f78fffff640 1 -- 172.21.15.19:0/1657155329 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8003990 con 0x7f790815ca50 2024-09-12T02:07:02.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.964+0000 7f790d8af640 1 -- 172.21.15.19:0/1657155329 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790809dc40 con 0x7f790815ca50 2024-09-12T02:07:02.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.965+0000 7f790d8af640 1 -- 172.21.15.19:0/1657155329 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f790815fba0 con 0x7f790815ca50 2024-09-12T02:07:02.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.966+0000 7f78fffff640 1 -- 172.21.15.19:0/1657155329 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78f8039040 con 0x7f790815ca50 2024-09-12T02:07:02.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.966+0000 7f78fffff640 1 --2- 172.21.15.19:0/1657155329 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f78e806be30 0x7f78e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.966+0000 7f78fffff640 1 -- 172.21.15.19:0/1657155329 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5249+0+0 (secure 0 0 0) 0x7f78f80abdb0 con 0x7f790815ca50 2024-09-12T02:07:02.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.967+0000 7f7906ffd640 1 --2- 172.21.15.19:0/1657155329 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f78e806be30 0x7f78e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.967+0000 7f7906ffd640 1 --2- 172.21.15.19:0/1657155329 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f78e806be30 0x7f78e806e2f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f7900006fd0 tx=0x7f7900008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:02.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:02.971+0000 7f78fffff640 1 -- 172.21.15.19:0/1657155329 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f78f80b0070 con 0x7f790815ca50 2024-09-12T02:07:03.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:03.147+0000 7f790d8af640 1 -- 172.21.15.19:0/1657155329 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f790815c2b0 con 0x7f790815ca50 2024-09-12T02:07:04.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.146+0000 7f78fffff640 1 -- 172.21.15.19:0/1657155329 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v142) ==== 138+0+0 (secure 0 0 0) 0x7f78f807a880 con 0x7f790815ca50 2024-09-12T02:07:04.147 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-09-12T02:07:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.150+0000 7f790d8af640 1 -- 172.21.15.19:0/1657155329 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f78e806be30 msgr2=0x7f78e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.150+0000 7f790d8af640 1 --2- 172.21.15.19:0/1657155329 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f78e806be30 0x7f78e806e2f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f7900006fd0 tx=0x7f7900008040 comp rx=0 tx=0).stop 2024-09-12T02:07:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.150+0000 7f790d8af640 1 -- 172.21.15.19:0/1657155329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f790815ca50 msgr2=0x7f7908156e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.150+0000 7f790d8af640 1 --2- 172.21.15.19:0/1657155329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f790815ca50 0x7f7908156e70 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009d90 tx=0x7f78f8004a40 comp rx=0 tx=0).stop 2024-09-12T02:07:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.151+0000 7f790d8af640 1 -- 172.21.15.19:0/1657155329 shutdown_connections 2024-09-12T02:07:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.151+0000 7f790d8af640 1 --2- 172.21.15.19:0/1657155329 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f78e806be30 0x7f78e806e2f0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.151+0000 7f790d8af640 1 --2- 172.21.15.19:0/1657155329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f790815ca50 0x7f7908156e70 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.151+0000 7f790d8af640 1 --2- 172.21.15.19:0/1657155329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7908158ec0 0x7f790809ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.151+0000 7f790d8af640 1 --2- 172.21.15.19:0/1657155329 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79080b4d50 0x7f79081522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.151+0000 7f790d8af640 1 -- 172.21.15.19:0/1657155329 >> 172.21.15.19:0/1657155329 conn(0x7f790809aa30 msgr2=0x7f79080b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.151+0000 7f790d8af640 1 -- 172.21.15.19:0/1657155329 shutdown_connections 2024-09-12T02:07:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.151+0000 7f790d8af640 1 -- 172.21.15.19:0/1657155329 wait complete. 2024-09-12T02:07:04.168 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:07:04.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.283+0000 7ff67bfdf640 1 Processor -- start 2024-09-12T02:07:04.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.283+0000 7ff67bfdf640 1 -- start start 2024-09-12T02:07:04.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.284+0000 7ff67bfdf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6740d4c10 0x7ff674162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:04.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.284+0000 7ff67bfdf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff6740d3320 0x7ff6740d37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:04.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.284+0000 7ff67bfdf640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6740d2600 con 0x7ff6740b5f80 2024-09-12T02:07:04.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.284+0000 7ff67bfdf640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff6740d5420 con 0x7ff6740d3320 2024-09-12T02:07:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.284+0000 7ff67bfdf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff6740d2e90 con 0x7ff6740d4c10 2024-09-12T02:07:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.284+0000 7ff67a57c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff6740d3320 0x7ff6740d37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.284+0000 7ff679d7b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff6740b5f80 0x7ff6740b6360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56390/0 (socket says 172.21.15.19:56390) 2024-09-12T02:07:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.284+0000 7ff67a57c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff6740d3320 0x7ff6740d37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54642/0 (socket says 172.21.15.19:54642) 2024-09-12T02:07:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.284+0000 7ff679d7b640 1 -- 172.21.15.19:0/1643632472 learned_addr learned my addr 172.21.15.19:0/1643632472 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.284+0000 7ff67957a640 1 --2- 172.21.15.19:0/1643632472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6740d4c10 0x7ff674162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.284+0000 7ff67a57c640 1 -- 172.21.15.19:0/1643632472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6740d4c10 msgr2=0x7ff674162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.284+0000 7ff67a57c640 1 --2- 172.21.15.19:0/1643632472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6740d4c10 0x7ff674162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.284+0000 7ff67a57c640 1 -- 172.21.15.19:0/1643632472 >> v1:172.21.15.19:6789/0 conn(0x7ff6740b5f80 legacy=0x7ff6740b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.284+0000 7ff67a57c640 1 -- 172.21.15.19:0/1643632472 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6740b3c10 con 0x7ff6740d3320 2024-09-12T02:07:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.284+0000 7ff678d79640 1 -- 172.21.15.19:0/1643632472 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3822363284 0 0) 0x7ff670001110 con 0x7ff6740b5f80 2024-09-12T02:07:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.285+0000 7ff67a57c640 1 --2- 172.21.15.19:0/1643632472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6740d3320 0x7ff6740d37b0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009d90 tx=0x7ff66c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9718a931cbb7e4fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.285+0000 7ff678d79640 1 -- 172.21.15.19:0/1643632472 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c007740 con 0x7ff6740d3320 2024-09-12T02:07:04.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.285+0000 7ff678d79640 1 -- 172.21.15.19:0/1643632472 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff66c0078e0 con 0x7ff6740d3320 2024-09-12T02:07:04.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.285+0000 7ff678d79640 1 -- 172.21.15.19:0/1643632472 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c007cb0 con 0x7ff6740d3320 2024-09-12T02:07:04.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.286+0000 7ff67bfdf640 1 -- 172.21.15.19:0/1643632472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6740d3320 msgr2=0x7ff6740d37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:04.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.286+0000 7ff67bfdf640 1 --2- 172.21.15.19:0/1643632472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6740d3320 0x7ff6740d37b0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009d90 tx=0x7ff66c02a660 comp rx=0 tx=0).stop 2024-09-12T02:07:04.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.286+0000 7ff67bfdf640 1 -- 172.21.15.19:0/1643632472 shutdown_connections 2024-09-12T02:07:04.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.286+0000 7ff67bfdf640 1 --2- 172.21.15.19:0/1643632472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6740d3320 0x7ff6740d37b0 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:04.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.286+0000 7ff67bfdf640 1 --2- 172.21.15.19:0/1643632472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6740d4c10 0x7ff674162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:04.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.286+0000 7ff67bfdf640 1 -- 172.21.15.19:0/1643632472 >> 172.21.15.19:0/1643632472 conn(0x7ff67408bfc0 msgr2=0x7ff6740d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:04.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.286+0000 7ff67bfdf640 1 -- 172.21.15.19:0/1643632472 shutdown_connections 2024-09-12T02:07:04.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.286+0000 7ff67bfdf640 1 -- 172.21.15.19:0/1643632472 wait complete. 2024-09-12T02:07:04.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.287+0000 7ff67bfdf640 1 Processor -- start 2024-09-12T02:07:04.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.287+0000 7ff67bfdf640 1 -- start start 2024-09-12T02:07:04.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.288+0000 7ff67bfdf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6740b5f80 0x7ff674154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:04.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.288+0000 7ff67bfdf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6740d3320 0x7ff674155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:04.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.288+0000 7ff67bfdf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6740d4c10 0x7ff674155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:04.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.288+0000 7ff67bfdf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff6740d2b20 con 0x7ff6740d4c10 2024-09-12T02:07:04.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.288+0000 7ff67bfdf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff6740d2880 con 0x7ff6740b5f80 2024-09-12T02:07:04.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.288+0000 7ff67bfdf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff67415f690 con 0x7ff6740d3320 2024-09-12T02:07:04.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.288+0000 7ff67a57c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6740d4c10 0x7ff674155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:04.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.288+0000 7ff67a57c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6740d4c10 0x7ff674155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54656/0 (socket says 172.21.15.19:54656) 2024-09-12T02:07:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.288+0000 7ff67a57c640 1 -- 172.21.15.19:0/1665010713 learned_addr learned my addr 172.21.15.19:0/1665010713 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.288+0000 7ff679d7b640 1 --2- 172.21.15.19:0/1665010713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6740b5f80 0x7ff674154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.288+0000 7ff67957a640 1 --2- 172.21.15.19:0/1665010713 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6740d3320 0x7ff674155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.288+0000 7ff67a57c640 1 -- 172.21.15.19:0/1665010713 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6740d3320 msgr2=0x7ff674155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.288+0000 7ff67a57c640 1 --2- 172.21.15.19:0/1665010713 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6740d3320 0x7ff674155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.288+0000 7ff67a57c640 1 -- 172.21.15.19:0/1665010713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6740b5f80 msgr2=0x7ff674154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.288+0000 7ff67a57c640 1 --2- 172.21.15.19:0/1665010713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6740b5f80 0x7ff674154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.288+0000 7ff67a57c640 1 -- 172.21.15.19:0/1665010713 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6740b1450 con 0x7ff6740d4c10 2024-09-12T02:07:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.288+0000 7ff67a57c640 1 --2- 172.21.15.19:0/1665010713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6740d4c10 0x7ff674155940 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009d90 tx=0x7ff66c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.289+0000 7ff66a7fc640 1 -- 172.21.15.19:0/1665010713 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c040070 con 0x7ff6740d4c10 2024-09-12T02:07:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.289+0000 7ff66a7fc640 1 -- 172.21.15.19:0/1665010713 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff66c031c40 con 0x7ff6740d4c10 2024-09-12T02:07:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.289+0000 7ff67bfdf640 1 -- 172.21.15.19:0/1665010713 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff674156470 con 0x7ff6740d4c10 2024-09-12T02:07:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.289+0000 7ff66a7fc640 1 -- 172.21.15.19:0/1665010713 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c009450 con 0x7ff6740d4c10 2024-09-12T02:07:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.289+0000 7ff67bfdf640 1 -- 172.21.15.19:0/1665010713 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff674156a30 con 0x7ff6740d4c10 2024-09-12T02:07:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.290+0000 7ff67bfdf640 1 -- 172.21.15.19:0/1665010713 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6740d3f70 con 0x7ff6740d4c10 2024-09-12T02:07:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.290+0000 7ff66a7fc640 1 -- 172.21.15.19:0/1665010713 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff66c039040 con 0x7ff6740d4c10 2024-09-12T02:07:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.291+0000 7ff66a7fc640 1 --2- 172.21.15.19:0/1665010713 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff65806be30 0x7ff65806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.291+0000 7ff66a7fc640 1 -- 172.21.15.19:0/1665010713 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5619+0+0 (secure 0 0 0) 0x7ff66c0abd00 con 0x7ff6740d4c10 2024-09-12T02:07:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.291+0000 7ff679d7b640 1 --2- 172.21.15.19:0/1665010713 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff65806be30 0x7ff65806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.292+0000 7ff679d7b640 1 --2- 172.21.15.19:0/1665010713 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff65806be30 0x7ff65806e2f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff670007fd0 tx=0x7ff670007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.296+0000 7ff66a7fc640 1 -- 172.21.15.19:0/1665010713 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff6740b1450 con 0x7ff6740d4c10 2024-09-12T02:07:04.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:04.471+0000 7ff67bfdf640 1 -- 172.21.15.19:0/1665010713 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff67406d1e0 con 0x7ff6740d4c10 2024-09-12T02:07:05.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.153+0000 7ff66a7fc640 1 -- 172.21.15.19:0/1665010713 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v143) ==== 170+0+0 (secure 0 0 0) 0x7ff6740b3c10 con 0x7ff6740d4c10 2024-09-12T02:07:05.154 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-09-12T02:07:05.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.156+0000 7ff67bfdf640 1 -- 172.21.15.19:0/1665010713 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff65806be30 msgr2=0x7ff65806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:05.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.156+0000 7ff67bfdf640 1 --2- 172.21.15.19:0/1665010713 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff65806be30 0x7ff65806e2f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff670007fd0 tx=0x7ff670007de0 comp rx=0 tx=0).stop 2024-09-12T02:07:05.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.156+0000 7ff67bfdf640 1 -- 172.21.15.19:0/1665010713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6740d4c10 msgr2=0x7ff674155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:05.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.156+0000 7ff67bfdf640 1 --2- 172.21.15.19:0/1665010713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6740d4c10 0x7ff674155940 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009d90 tx=0x7ff66c004a40 comp rx=0 tx=0).stop 2024-09-12T02:07:05.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.156+0000 7ff67bfdf640 1 -- 172.21.15.19:0/1665010713 shutdown_connections 2024-09-12T02:07:05.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.156+0000 7ff67bfdf640 1 --2- 172.21.15.19:0/1665010713 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff65806be30 0x7ff65806e2f0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:05.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.156+0000 7ff67bfdf640 1 --2- 172.21.15.19:0/1665010713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6740d4c10 0x7ff674155940 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:05.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.156+0000 7ff67bfdf640 1 --2- 172.21.15.19:0/1665010713 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6740d3320 0x7ff674155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:05.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.156+0000 7ff67bfdf640 1 --2- 172.21.15.19:0/1665010713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6740b5f80 0x7ff674154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:05.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.156+0000 7ff67bfdf640 1 -- 172.21.15.19:0/1665010713 >> 172.21.15.19:0/1665010713 conn(0x7ff67408bfc0 msgr2=0x7ff674160260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:05.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.156+0000 7ff67bfdf640 1 -- 172.21.15.19:0/1665010713 shutdown_connections 2024-09-12T02:07:05.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.156+0000 7ff67bfdf640 1 -- 172.21.15.19:0/1665010713 wait complete. 2024-09-12T02:07:05.181 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:07:05.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.292+0000 7feddcc42640 1 Processor -- start 2024-09-12T02:07:05.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.292+0000 7feddcc42640 1 -- start start 2024-09-12T02:07:05.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.292+0000 7feddcc42640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedd815e900 0x7fedd80b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:05.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.293+0000 7feddcc42640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fedd80b4a20 0x7fedd80ad020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:05.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.293+0000 7feddcc42640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedd80b4620 con 0x7fedd8072050 2024-09-12T02:07:05.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.293+0000 7feddcc42640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fedd80ce100 con 0x7fedd80b4a20 2024-09-12T02:07:05.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.293+0000 7feddcc42640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fedd80ce3a0 con 0x7fedd815e900 2024-09-12T02:07:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.293+0000 7fedd5d9b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fedd80b4a20 0x7fedd80ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.293+0000 7fedd659c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedd815e900 0x7fedd80b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.293+0000 7fedd6d9d640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fedd8072050 0x7fedd80cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:37084/0 (socket says 172.21.15.19:37084) 2024-09-12T02:07:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.293+0000 7fedd6d9d640 1 -- 172.21.15.19:0/1536564892 learned_addr learned my addr 172.21.15.19:0/1536564892 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.293+0000 7fedd559a640 1 -- 172.21.15.19:0/1536564892 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4097749559 0 0) 0x7fedd80b4620 con 0x7fedd8072050 2024-09-12T02:07:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.293+0000 7fedd559a640 1 -- 172.21.15.19:0/1536564892 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedc0003520 con 0x7fedd8072050 2024-09-12T02:07:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.293+0000 7fedd5d9b640 1 -- 172.21.15.19:0/1536564892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedd815e900 msgr2=0x7fedd80b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.293+0000 7fedd5d9b640 1 --2- 172.21.15.19:0/1536564892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedd815e900 0x7fedd80b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.293+0000 7fedd5d9b640 1 -- 172.21.15.19:0/1536564892 >> v1:172.21.15.135:6789/0 conn(0x7fedd8072050 legacy=0x7fedd80cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.293+0000 7fedd5d9b640 1 -- 172.21.15.19:0/1536564892 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd80ce680 con 0x7fedd80b4a20 2024-09-12T02:07:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.293+0000 7fedd659c640 1 --2- 172.21.15.19:0/1536564892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedd815e900 0x7fedd80b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.294+0000 7fedd5d9b640 1 --2- 172.21.15.19:0/1536564892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedd80b4a20 0x7fedd80ad020 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0097a0 tx=0x7fedcc02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be6f4ed081844a4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:05.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.294+0000 7fedd559a640 1 -- 172.21.15.19:0/1536564892 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc037070 con 0x7fedd80b4a20 2024-09-12T02:07:05.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.294+0000 7fedd559a640 1 -- 172.21.15.19:0/1536564892 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedcc02ae50 con 0x7fedd80b4a20 2024-09-12T02:07:05.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.294+0000 7fedd559a640 1 -- 172.21.15.19:0/1536564892 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc032660 con 0x7fedd80b4a20 2024-09-12T02:07:05.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.295+0000 7feddcc42640 1 -- 172.21.15.19:0/1536564892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedd80b4a20 msgr2=0x7fedd80ad020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:05.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.295+0000 7feddcc42640 1 --2- 172.21.15.19:0/1536564892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedd80b4a20 0x7fedd80ad020 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0097a0 tx=0x7fedcc02a100 comp rx=0 tx=0).stop 2024-09-12T02:07:05.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.295+0000 7feddcc42640 1 -- 172.21.15.19:0/1536564892 shutdown_connections 2024-09-12T02:07:05.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.295+0000 7feddcc42640 1 --2- 172.21.15.19:0/1536564892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedd80b4a20 0x7fedd80ad020 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:05.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.295+0000 7feddcc42640 1 --2- 172.21.15.19:0/1536564892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedd815e900 0x7fedd80b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:05.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.295+0000 7feddcc42640 1 -- 172.21.15.19:0/1536564892 >> 172.21.15.19:0/1536564892 conn(0x7fedd806bdf0 msgr2=0x7fedd806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:05.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.295+0000 7feddcc42640 1 -- 172.21.15.19:0/1536564892 shutdown_connections 2024-09-12T02:07:05.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.295+0000 7feddcc42640 1 -- 172.21.15.19:0/1536564892 wait complete. 2024-09-12T02:07:05.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.296+0000 7feddcc42640 1 Processor -- start 2024-09-12T02:07:05.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.296+0000 7feddcc42640 1 -- start start 2024-09-12T02:07:05.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.297+0000 7feddcc42640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedd8072050 0x7fedd81503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:05.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.297+0000 7feddcc42640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedd80b4a20 0x7fedd809d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:05.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.297+0000 7feddcc42640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedd815e900 0x7fedd809dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:05.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.297+0000 7feddcc42640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fedd80ad560 con 0x7fedd80b4a20 2024-09-12T02:07:05.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.297+0000 7feddcc42640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fedd80b4e20 con 0x7fedd8072050 2024-09-12T02:07:05.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.297+0000 7feddcc42640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fedd80cf590 con 0x7fedd815e900 2024-09-12T02:07:05.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.297+0000 7fedd5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedd80b4a20 0x7fedd809d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:05.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.297+0000 7fedd5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedd80b4a20 0x7fedd809d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54672/0 (socket says 172.21.15.19:54672) 2024-09-12T02:07:05.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.297+0000 7fedd5d9b640 1 -- 172.21.15.19:0/4207256773 learned_addr learned my addr 172.21.15.19:0/4207256773 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:05.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.297+0000 7fedd659c640 1 --2- 172.21.15.19:0/4207256773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedd8072050 0x7fedd81503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:05.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.297+0000 7fedd6d9d640 1 --2- 172.21.15.19:0/4207256773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedd815e900 0x7fedd809dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:05.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.298+0000 7fedd659c640 1 -- 172.21.15.19:0/4207256773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedd815e900 msgr2=0x7fedd809dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:05.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.298+0000 7fedd659c640 1 --2- 172.21.15.19:0/4207256773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedd815e900 0x7fedd809dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:05.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.298+0000 7fedd659c640 1 -- 172.21.15.19:0/4207256773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedd80b4a20 msgr2=0x7fedd809d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:05.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.298+0000 7fedd659c640 1 --2- 172.21.15.19:0/4207256773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedd80b4a20 0x7fedd809d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:05.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.298+0000 7fedd659c640 1 -- 172.21.15.19:0/4207256773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd809e1a0 con 0x7fedd8072050 2024-09-12T02:07:05.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.298+0000 7fedd5d9b640 1 --2- 172.21.15.19:0/4207256773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedd80b4a20 0x7fedd809d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:05.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.298+0000 7fedd659c640 1 --2- 172.21.15.19:0/4207256773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedd8072050 0x7fedd81503d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fedc800e8a0 tx=0x7fedc800ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:05.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.298+0000 7fedc6ffd640 1 -- 172.21.15.19:0/4207256773 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc8017070 con 0x7fedd8072050 2024-09-12T02:07:05.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.298+0000 7fedc6ffd640 1 -- 172.21.15.19:0/4207256773 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc800c8e0 con 0x7fedd8072050 2024-09-12T02:07:05.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.298+0000 7fedc6ffd640 1 -- 172.21.15.19:0/4207256773 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc800ccd0 con 0x7fedd8072050 2024-09-12T02:07:05.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.298+0000 7feddcc42640 1 -- 172.21.15.19:0/4207256773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd8153a00 con 0x7fedd8072050 2024-09-12T02:07:05.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.298+0000 7feddcc42640 1 -- 172.21.15.19:0/4207256773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd8155720 con 0x7fedd8072050 2024-09-12T02:07:05.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.299+0000 7feddcc42640 1 -- 172.21.15.19:0/4207256773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedd80b3590 con 0x7fedd8072050 2024-09-12T02:07:05.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.300+0000 7fedc6ffd640 1 -- 172.21.15.19:0/4207256773 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fedc801a070 con 0x7fedd8072050 2024-09-12T02:07:05.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.300+0000 7fedc6ffd640 1 --2- 172.21.15.19:0/4207256773 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fedb806be30 0x7fedb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:05.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.300+0000 7fedc6ffd640 1 -- 172.21.15.19:0/4207256773 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6001+0+0 (secure 0 0 0) 0x7fedc808acc0 con 0x7fedd8072050 2024-09-12T02:07:05.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.300+0000 7fedd5d9b640 1 --2- 172.21.15.19:0/4207256773 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fedb806be30 0x7fedb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:05.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.301+0000 7fedd5d9b640 1 --2- 172.21.15.19:0/4207256773 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fedb806be30 0x7fedb806e2f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fedcc02a140 tx=0x7fedcc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:05.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.305+0000 7fedc6ffd640 1 -- 172.21.15.19:0/4207256773 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fedc8058ed0 con 0x7fedd8072050 2024-09-12T02:07:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:05.515+0000 7feddcc42640 1 -- 172.21.15.19:0/4207256773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fedd80ad020 con 0x7fedd8072050 2024-09-12T02:07:06.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.164+0000 7fedc6ffd640 1 -- 172.21.15.19:0/4207256773 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v328) ==== 174+0+0 (secure 0 0 0) 0x7fedc805d1d0 con 0x7fedd8072050 2024-09-12T02:07:06.166 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 15 and data pool 16 2024-09-12T02:07:06.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.176+0000 7feddcc42640 1 -- 172.21.15.19:0/4207256773 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fedb806be30 msgr2=0x7fedb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.176+0000 7feddcc42640 1 --2- 172.21.15.19:0/4207256773 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fedb806be30 0x7fedb806e2f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fedcc02a140 tx=0x7fedcc02e000 comp rx=0 tx=0).stop 2024-09-12T02:07:06.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.176+0000 7feddcc42640 1 -- 172.21.15.19:0/4207256773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedd8072050 msgr2=0x7fedd81503d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.176+0000 7feddcc42640 1 --2- 172.21.15.19:0/4207256773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedd8072050 0x7fedd81503d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fedc800e8a0 tx=0x7fedc800ed60 comp rx=0 tx=0).stop 2024-09-12T02:07:06.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.176+0000 7feddcc42640 1 -- 172.21.15.19:0/4207256773 shutdown_connections 2024-09-12T02:07:06.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.176+0000 7feddcc42640 1 --2- 172.21.15.19:0/4207256773 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fedb806be30 0x7fedb806e2f0 secure :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fedcc02a140 tx=0x7fedcc02e000 comp rx=0 tx=0).stop 2024-09-12T02:07:06.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.176+0000 7feddcc42640 1 --2- 172.21.15.19:0/4207256773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedd815e900 0x7fedd809dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.176+0000 7feddcc42640 1 --2- 172.21.15.19:0/4207256773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedd80b4a20 0x7fedd809d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.176+0000 7feddcc42640 1 --2- 172.21.15.19:0/4207256773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedd8072050 0x7fedd81503d0 secure :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fedc800e8a0 tx=0x7fedc800ed60 comp rx=0 tx=0).stop 2024-09-12T02:07:06.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.176+0000 7feddcc42640 1 -- 172.21.15.19:0/4207256773 >> 172.21.15.19:0/4207256773 conn(0x7fedd806bdf0 msgr2=0x7fedd806e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:06.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.179+0000 7feddcc42640 1 -- 172.21.15.19:0/4207256773 shutdown_connections 2024-09-12T02:07:06.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.179+0000 7feddcc42640 1 -- 172.21.15.19:0/4207256773 wait complete. 2024-09-12T02:07:06.202 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:07:06.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.309+0000 7f8a0ff2c640 1 Processor -- start 2024-09-12T02:07:06.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.309+0000 7f8a0ff2c640 1 -- start start 2024-09-12T02:07:06.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.310+0000 7f8a0ff2c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8a08072320 0x7f8a080cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.310+0000 7f8a0ff2c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a08146140 con 0x7f8a08072de0 2024-09-12T02:07:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.310+0000 7f8a0ff2c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a0806eed0 con 0x7f8a0815e1f0 2024-09-12T02:07:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.310+0000 7f8a0ff2c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8a080cd740 con 0x7f8a08072320 2024-09-12T02:07:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.310+0000 7f8a0dcc8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8a08072320 0x7f8a080cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.310+0000 7f8a0d4c7640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8a08072de0 0x7f8a0806e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56396/0 (socket says 172.21.15.19:56396) 2024-09-12T02:07:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.310+0000 7f8a0dcc8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8a08072320 0x7f8a080cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54680/0 (socket says 172.21.15.19:54680) 2024-09-12T02:07:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.310+0000 7f8a0d4c7640 1 -- 172.21.15.19:0/3299398713 learned_addr learned my addr 172.21.15.19:0/3299398713 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.310+0000 7f8a0dcc8640 1 -- 172.21.15.19:0/3299398713 >> v1:172.21.15.135:6789/0 conn(0x7f8a0815e1f0 legacy=0x7f8a0806e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.310+0000 7f8a0dcc8640 1 -- 172.21.15.19:0/3299398713 >> v1:172.21.15.19:6789/0 conn(0x7f8a08072de0 legacy=0x7f8a0806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.310+0000 7f8a0ccc6640 1 -- 172.21.15.19:0/3299398713 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1368022378 0 0) 0x7f8a08146140 con 0x7f8a08072de0 2024-09-12T02:07:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.310+0000 7f8a0dcc8640 1 -- 172.21.15.19:0/3299398713 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a080cda20 con 0x7f8a08072320 2024-09-12T02:07:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.311+0000 7f8a0dcc8640 1 --2- 172.21.15.19:0/3299398713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08072320 0x7f8a080cce60 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009d90 tx=0x7f8a0402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b440d027c54369a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.311+0000 7f8a0ccc6640 1 -- 172.21.15.19:0/3299398713 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a04031600 con 0x7f8a08072320 2024-09-12T02:07:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.311+0000 7f8a0ccc6640 1 -- 172.21.15.19:0/3299398713 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a040317a0 con 0x7f8a08072320 2024-09-12T02:07:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.311+0000 7f8a0ccc6640 1 -- 172.21.15.19:0/3299398713 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a04031b70 con 0x7f8a08072320 2024-09-12T02:07:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.312+0000 7f8a0ff2c640 1 -- 172.21.15.19:0/3299398713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08072320 msgr2=0x7f8a080cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.312+0000 7f8a0ff2c640 1 --2- 172.21.15.19:0/3299398713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08072320 0x7f8a080cce60 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009d90 tx=0x7f8a0402a610 comp rx=0 tx=0).stop 2024-09-12T02:07:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.312+0000 7f8a0ff2c640 1 -- 172.21.15.19:0/3299398713 shutdown_connections 2024-09-12T02:07:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.312+0000 7f8a0ff2c640 1 --2- 172.21.15.19:0/3299398713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08072320 0x7f8a080cce60 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.312+0000 7f8a0ff2c640 1 -- 172.21.15.19:0/3299398713 >> 172.21.15.19:0/3299398713 conn(0x7f8a08067d70 msgr2=0x7f8a0806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.312+0000 7f8a0ff2c640 1 -- 172.21.15.19:0/3299398713 shutdown_connections 2024-09-12T02:07:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.312+0000 7f8a0ff2c640 1 -- 172.21.15.19:0/3299398713 wait complete. 2024-09-12T02:07:06.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.313+0000 7f8a0ff2c640 1 Processor -- start 2024-09-12T02:07:06.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.313+0000 7f8a0ff2c640 1 -- start start 2024-09-12T02:07:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.314+0000 7f8a0ff2c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08072320 0x7f8a0815b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.314+0000 7f8a0ff2c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a08072de0 0x7f8a080cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.314+0000 7f8a0ff2c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0815e1f0 0x7f8a080cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.314+0000 7f8a0ff2c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8a080cd3a0 con 0x7f8a08072320 2024-09-12T02:07:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.314+0000 7f8a0ff2c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0815c9e0 con 0x7f8a0815e1f0 2024-09-12T02:07:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.314+0000 7f8a0ff2c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8a080cd520 con 0x7f8a08072de0 2024-09-12T02:07:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.314+0000 7f8a0dcc8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08072320 0x7f8a0815b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.314+0000 7f8a0dcc8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08072320 0x7f8a0815b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54690/0 (socket says 172.21.15.19:54690) 2024-09-12T02:07:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.314+0000 7f8a0dcc8640 1 -- 172.21.15.19:0/589665563 learned_addr learned my addr 172.21.15.19:0/589665563 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.315+0000 7f8a0dcc8640 1 -- 172.21.15.19:0/589665563 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a08072de0 msgr2=0x7f8a080cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.315+0000 7f8a0d4c7640 1 --2- 172.21.15.19:0/589665563 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a08072de0 0x7f8a080cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.315+0000 7f8a0e4c9640 1 --2- 172.21.15.19:0/589665563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0815e1f0 0x7f8a080cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.315+0000 7f8a0dcc8640 1 --2- 172.21.15.19:0/589665563 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a08072de0 0x7f8a080cc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.315+0000 7f8a0dcc8640 1 -- 172.21.15.19:0/589665563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0815e1f0 msgr2=0x7f8a080cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.315+0000 7f8a0dcc8640 1 --2- 172.21.15.19:0/589665563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0815e1f0 0x7f8a080cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.315+0000 7f8a0dcc8640 1 -- 172.21.15.19:0/589665563 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a081337a0 con 0x7f8a08072320 2024-09-12T02:07:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.315+0000 7f8a0dcc8640 1 --2- 172.21.15.19:0/589665563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08072320 0x7f8a0815b950 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009d90 tx=0x7f8a04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.315+0000 7f89fe7fc640 1 -- 172.21.15.19:0/589665563 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a04040070 con 0x7f8a08072320 2024-09-12T02:07:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.315+0000 7f89fe7fc640 1 -- 172.21.15.19:0/589665563 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a04030be0 con 0x7f8a08072320 2024-09-12T02:07:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.315+0000 7f8a0ff2c640 1 -- 172.21.15.19:0/589665563 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a080cb940 con 0x7f8a08072320 2024-09-12T02:07:06.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.315+0000 7f89fe7fc640 1 -- 172.21.15.19:0/589665563 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0403c420 con 0x7f8a08072320 2024-09-12T02:07:06.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.315+0000 7f8a0ff2c640 1 -- 172.21.15.19:0/589665563 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a08133a40 con 0x7f8a08072320 2024-09-12T02:07:06.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.316+0000 7f8a0ff2c640 1 -- 172.21.15.19:0/589665563 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a08072700 con 0x7f8a08072320 2024-09-12T02:07:06.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.317+0000 7f89fe7fc640 1 -- 172.21.15.19:0/589665563 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a04039040 con 0x7f8a08072320 2024-09-12T02:07:06.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.317+0000 7f89fe7fc640 1 --2- 172.21.15.19:0/589665563 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89ec06be30 0x7f89ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.317+0000 7f89fe7fc640 1 -- 172.21.15.19:0/589665563 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f8a040ac480 con 0x7f8a08072320 2024-09-12T02:07:06.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.317+0000 7f8a0d4c7640 1 --2- 172.21.15.19:0/589665563 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89ec06be30 0x7f89ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.318+0000 7f8a0d4c7640 1 --2- 172.21.15.19:0/589665563 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89ec06be30 0x7f89ec06e2f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f8a080cd280 tx=0x7f89f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:06.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.322+0000 7f89fe7fc640 1 -- 172.21.15.19:0/589665563 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a0407ad60 con 0x7f8a08072320 2024-09-12T02:07:06.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.498+0000 7f8a0ff2c640 1 -- 172.21.15.19:0/589665563 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a080b1f40 con 0x7f8a08072320 2024-09-12T02:07:06.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.499+0000 7f89fe7fc640 1 -- 172.21.15.19:0/589665563 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) ==== 74+0+16945 (secure 0 0 0) 0x7f8a0407a660 con 0x7f8a08072320 2024-09-12T02:07:06.500 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:06.500 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":144,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:07:05.517447+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:07:03.179551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-12T02:07:04.503322+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:07:06.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.501+0000 7f8a0ff2c640 1 -- 172.21.15.19:0/589665563 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89ec06be30 msgr2=0x7f89ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.501+0000 7f8a0ff2c640 1 --2- 172.21.15.19:0/589665563 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89ec06be30 0x7f89ec06e2f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f8a080cd280 tx=0x7f89f8009040 comp rx=0 tx=0).stop 2024-09-12T02:07:06.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.501+0000 7f8a0ff2c640 1 -- 172.21.15.19:0/589665563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08072320 msgr2=0x7f8a0815b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.501+0000 7f8a0ff2c640 1 --2- 172.21.15.19:0/589665563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08072320 0x7f8a0815b950 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009d90 tx=0x7f8a04004a40 comp rx=0 tx=0).stop 2024-09-12T02:07:06.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.501+0000 7f8a0ff2c640 1 -- 172.21.15.19:0/589665563 shutdown_connections 2024-09-12T02:07:06.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.501+0000 7f8a0ff2c640 1 --2- 172.21.15.19:0/589665563 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f89ec06be30 0x7f89ec06e2f0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.501+0000 7f8a0ff2c640 1 --2- 172.21.15.19:0/589665563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0815e1f0 0x7f8a080cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.501+0000 7f8a0ff2c640 1 --2- 172.21.15.19:0/589665563 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a08072de0 0x7f8a080cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.501+0000 7f8a0ff2c640 1 --2- 172.21.15.19:0/589665563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08072320 0x7f8a0815b950 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.501+0000 7f8a0ff2c640 1 -- 172.21.15.19:0/589665563 >> 172.21.15.19:0/589665563 conn(0x7f8a08067d70 msgr2=0x7f8a080b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.501+0000 7f8a0ff2c640 1 -- 172.21.15.19:0/589665563 shutdown_connections 2024-09-12T02:07:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.501+0000 7f8a0ff2c640 1 -- 172.21.15.19:0/589665563 wait complete. 2024-09-12T02:07:06.513 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:07:06.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.615+0000 7fbe2322e640 1 Processor -- start 2024-09-12T02:07:06.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.615+0000 7fbe2322e640 1 -- start start 2024-09-12T02:07:06.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.616+0000 7fbe2322e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe1c15b300 0x7fbe1c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.616+0000 7fbe2322e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbe1c06f8d0 0x7fbe1c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.616+0000 7fbe2322e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe1c0cdbe0 con 0x7fbe1c0cd3f0 2024-09-12T02:07:06.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.616+0000 7fbe2322e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fbe1c0728a0 con 0x7fbe1c15b300 2024-09-12T02:07:06.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.616+0000 7fbe2322e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fbe1c0cd900 con 0x7fbe1c06f8d0 2024-09-12T02:07:06.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.616+0000 7fbe20fca640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe1c15b300 0x7fbe1c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.616+0000 7fbe20fca640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe1c15b300 0x7fbe1c0cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54698/0 (socket says 172.21.15.19:54698) 2024-09-12T02:07:06.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.616+0000 7fbe20fca640 1 -- 172.21.15.19:0/1234833899 learned_addr learned my addr 172.21.15.19:0/1234833899 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:06.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.617+0000 7fbe217cb640 1 --2- 172.21.15.19:0/1234833899 >> v2:172.21.15.135:3300/0 conn(0x7fbe1c06f8d0 0x7fbe1c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.617+0000 7fbe20fca640 1 -- 172.21.15.19:0/1234833899 >> v2:172.21.15.135:3300/0 conn(0x7fbe1c06f8d0 msgr2=0x7fbe1c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:06.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.617+0000 7fbe20fca640 1 --2- 172.21.15.19:0/1234833899 >> v2:172.21.15.135:3300/0 conn(0x7fbe1c06f8d0 0x7fbe1c15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.617+0000 7fbe20fca640 1 -- 172.21.15.19:0/1234833899 >> v1:172.21.15.135:6789/0 conn(0x7fbe1c0cd3f0 legacy=0x7fbe1c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:06.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.617+0000 7fbe20fca640 1 -- 172.21.15.19:0/1234833899 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1c072250 con 0x7fbe1c15b300 2024-09-12T02:07:06.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.617+0000 7fbe217cb640 1 --2- 172.21.15.19:0/1234833899 >> v2:172.21.15.135:3300/0 conn(0x7fbe1c06f8d0 0x7fbe1c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:06.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.617+0000 7fbe20fca640 1 --2- 172.21.15.19:0/1234833899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c15b300 0x7fbe1c0cceb0 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0b38f0 tx=0x7fbe0c02c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b983c0d10bc37ae5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:06.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.618+0000 7fbe1b7fe640 1 -- 172.21.15.19:0/1234833899 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c0325a0 con 0x7fbe1c15b300 2024-09-12T02:07:06.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.618+0000 7fbe1b7fe640 1 -- 172.21.15.19:0/1234833899 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe0c038070 con 0x7fbe1c15b300 2024-09-12T02:07:06.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.618+0000 7fbe1b7fe640 1 -- 172.21.15.19:0/1234833899 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c032960 con 0x7fbe1c15b300 2024-09-12T02:07:06.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.618+0000 7fbe2322e640 1 -- 172.21.15.19:0/1234833899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c15b300 msgr2=0x7fbe1c0cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.618+0000 7fbe2322e640 1 --2- 172.21.15.19:0/1234833899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c15b300 0x7fbe1c0cceb0 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0b38f0 tx=0x7fbe0c02c8e0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.618+0000 7fbe2322e640 1 -- 172.21.15.19:0/1234833899 shutdown_connections 2024-09-12T02:07:06.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.618+0000 7fbe2322e640 1 --2- 172.21.15.19:0/1234833899 >> v2:172.21.15.135:3300/0 conn(0x7fbe1c06f8d0 0x7fbe1c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.618+0000 7fbe2322e640 1 --2- 172.21.15.19:0/1234833899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c15b300 0x7fbe1c0cceb0 unknown :-1 s=CLOSED pgs=2246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.618+0000 7fbe2322e640 1 -- 172.21.15.19:0/1234833899 >> 172.21.15.19:0/1234833899 conn(0x7fbe1c067d70 msgr2=0x7fbe1c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:06.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.618+0000 7fbe2322e640 1 -- 172.21.15.19:0/1234833899 shutdown_connections 2024-09-12T02:07:06.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.618+0000 7fbe2322e640 1 -- 172.21.15.19:0/1234833899 wait complete. 2024-09-12T02:07:06.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.619+0000 7fbe2322e640 1 Processor -- start 2024-09-12T02:07:06.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.619+0000 7fbe2322e640 1 -- start start 2024-09-12T02:07:06.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.620+0000 7fbe2322e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe1c06f8d0 0x7fbe1c1523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.620+0000 7fbe2322e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe1c0cd3f0 0x7fbe1c14fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.620+0000 7fbe2322e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c15b300 0x7fbe1c157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.620+0000 7fbe2322e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c0d0160 con 0x7fbe1c15b300 2024-09-12T02:07:06.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.620+0000 7fbe2322e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c0cffe0 con 0x7fbe1c06f8d0 2024-09-12T02:07:06.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.620+0000 7fbe2322e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbe1c072d30 con 0x7fbe1c0cd3f0 2024-09-12T02:07:06.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.621+0000 7fbe217cb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c15b300 0x7fbe1c157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.621+0000 7fbe217cb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c15b300 0x7fbe1c157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54702/0 (socket says 172.21.15.19:54702) 2024-09-12T02:07:06.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.621+0000 7fbe217cb640 1 -- 172.21.15.19:0/1240412728 learned_addr learned my addr 172.21.15.19:0/1240412728 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:06.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.621+0000 7fbe20fca640 1 --2- 172.21.15.19:0/1240412728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe1c06f8d0 0x7fbe1c1523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.621+0000 7fbe1bfff640 1 --2- 172.21.15.19:0/1240412728 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe1c0cd3f0 0x7fbe1c14fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.621+0000 7fbe217cb640 1 -- 172.21.15.19:0/1240412728 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe1c0cd3f0 msgr2=0x7fbe1c14fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.621+0000 7fbe217cb640 1 --2- 172.21.15.19:0/1240412728 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe1c0cd3f0 0x7fbe1c14fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.621+0000 7fbe217cb640 1 -- 172.21.15.19:0/1240412728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe1c06f8d0 msgr2=0x7fbe1c1523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.621+0000 7fbe217cb640 1 --2- 172.21.15.19:0/1240412728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe1c06f8d0 0x7fbe1c1523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.621+0000 7fbe217cb640 1 -- 172.21.15.19:0/1240412728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1c157ec0 con 0x7fbe1c15b300 2024-09-12T02:07:06.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.621+0000 7fbe217cb640 1 --2- 172.21.15.19:0/1240412728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c15b300 0x7fbe1c157720 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400c820 tx=0x7fbe1400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:06.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.621+0000 7fbe197fa640 1 -- 172.21.15.19:0/1240412728 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe14015070 con 0x7fbe1c15b300 2024-09-12T02:07:06.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.621+0000 7fbe197fa640 1 -- 172.21.15.19:0/1240412728 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe14007a30 con 0x7fbe1c15b300 2024-09-12T02:07:06.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.621+0000 7fbe197fa640 1 -- 172.21.15.19:0/1240412728 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe14007e20 con 0x7fbe1c15b300 2024-09-12T02:07:06.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.621+0000 7fbe2322e640 1 -- 172.21.15.19:0/1240412728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe1c1581a0 con 0x7fbe1c15b300 2024-09-12T02:07:06.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.621+0000 7fbe2322e640 1 -- 172.21.15.19:0/1240412728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe1c158760 con 0x7fbe1c15b300 2024-09-12T02:07:06.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.622+0000 7fbe2322e640 1 -- 172.21.15.19:0/1240412728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe1c0b4a60 con 0x7fbe1c15b300 2024-09-12T02:07:06.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.623+0000 7fbe197fa640 1 -- 172.21.15.19:0/1240412728 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe14018070 con 0x7fbe1c15b300 2024-09-12T02:07:06.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.623+0000 7fbe197fa640 1 --2- 172.21.15.19:0/1240412728 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbdfc06be30 0x7fbdfc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.624+0000 7fbe197fa640 1 -- 172.21.15.19:0/1240412728 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7fbe1408af80 con 0x7fbe1c15b300 2024-09-12T02:07:06.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.624+0000 7fbe20fca640 1 --2- 172.21.15.19:0/1240412728 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbdfc06be30 0x7fbdfc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.624+0000 7fbe20fca640 1 --2- 172.21.15.19:0/1240412728 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbdfc06be30 0x7fbdfc06e2f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c037000 tx=0x7fbe0c03e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:06.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.628+0000 7fbe197fa640 1 -- 172.21.15.19:0/1240412728 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe140590c0 con 0x7fbe1c15b300 2024-09-12T02:07:06.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.807+0000 7fbe2322e640 1 -- 172.21.15.19:0/1240412728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe1c0b4780 con 0x7fbe1c15b300 2024-09-12T02:07:06.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.808+0000 7fbe197fa640 1 -- 172.21.15.19:0/1240412728 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) ==== 74+0+16945 (secure 0 0 0) 0x7fbe1405d3c0 con 0x7fbe1c15b300 2024-09-12T02:07:06.809 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:06.809 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":144,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:07:05.517447+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:07:03.179551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-12T02:07:04.503322+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:07:06.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.811+0000 7fbe2322e640 1 -- 172.21.15.19:0/1240412728 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbdfc06be30 msgr2=0x7fbdfc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.811+0000 7fbe2322e640 1 --2- 172.21.15.19:0/1240412728 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbdfc06be30 0x7fbdfc06e2f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c037000 tx=0x7fbe0c03e040 comp rx=0 tx=0).stop 2024-09-12T02:07:06.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.811+0000 7fbe2322e640 1 -- 172.21.15.19:0/1240412728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c15b300 msgr2=0x7fbe1c157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.811+0000 7fbe2322e640 1 --2- 172.21.15.19:0/1240412728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c15b300 0x7fbe1c157720 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400c820 tx=0x7fbe1400cce0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.811+0000 7fbe2322e640 1 -- 172.21.15.19:0/1240412728 shutdown_connections 2024-09-12T02:07:06.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.811+0000 7fbe2322e640 1 --2- 172.21.15.19:0/1240412728 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbdfc06be30 0x7fbdfc06e2f0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.811+0000 7fbe2322e640 1 --2- 172.21.15.19:0/1240412728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c15b300 0x7fbe1c157720 unknown :-1 s=CLOSED pgs=2247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.811+0000 7fbe2322e640 1 --2- 172.21.15.19:0/1240412728 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe1c0cd3f0 0x7fbe1c14fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.811+0000 7fbe2322e640 1 --2- 172.21.15.19:0/1240412728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe1c06f8d0 0x7fbe1c1523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.811+0000 7fbe2322e640 1 -- 172.21.15.19:0/1240412728 >> 172.21.15.19:0/1240412728 conn(0x7fbe1c067d70 msgr2=0x7fbe1c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:06.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.811+0000 7fbe2322e640 1 -- 172.21.15.19:0/1240412728 shutdown_connections 2024-09-12T02:07:06.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.811+0000 7fbe2322e640 1 -- 172.21.15.19:0/1240412728 wait complete. 2024-09-12T02:07:06.818 INFO:tasks.ceph.mds.a.smithi019.stderr:2024-09-12T02:07:06.818+0000 7f9112e90640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:07:06.823 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:07:06.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.928+0000 7f2be9d9f640 1 Processor -- start 2024-09-12T02:07:06.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.928+0000 7f2be9d9f640 1 -- start start 2024-09-12T02:07:06.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.929+0000 7f2be9d9f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2be4147d80 0x7f2be406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.929+0000 7f2be9d9f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2be40716d0 0x7f2be40cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.929+0000 7f2be9d9f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2be40d1f70 con 0x7f2be40d0280 2024-09-12T02:07:06.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.929+0000 7f2be9d9f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f2be40d06d0 con 0x7f2be40716d0 2024-09-12T02:07:06.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.929+0000 7f2be9d9f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2be40b51a0 con 0x7f2be4147d80 2024-09-12T02:07:06.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.929+0000 7f2be8d9d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2be4147d80 0x7f2be406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.929+0000 7f2be959e640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f2be40d0280 0x7f2be40b5630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:37122/0 (socket says 172.21.15.19:37122) 2024-09-12T02:07:06.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.929+0000 7f2be3fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2be40716d0 0x7f2be40cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.929+0000 7f2be959e640 1 -- 172.21.15.19:0/1025175376 learned_addr learned my addr 172.21.15.19:0/1025175376 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:06.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.930+0000 7f2be37fe640 1 -- 172.21.15.19:0/1025175376 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1261316440 0 0) 0x7f2be40d1f70 con 0x7f2be40d0280 2024-09-12T02:07:06.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.930+0000 7f2be37fe640 1 -- 172.21.15.19:0/1025175376 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bd0003520 con 0x7f2be40d0280 2024-09-12T02:07:06.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.930+0000 7f2be3fff640 1 -- 172.21.15.19:0/1025175376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2be4147d80 msgr2=0x7f2be406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:06.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.930+0000 7f2be3fff640 1 --2- 172.21.15.19:0/1025175376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2be4147d80 0x7f2be406d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.930+0000 7f2be3fff640 1 -- 172.21.15.19:0/1025175376 >> v1:172.21.15.135:6789/0 conn(0x7f2be40d0280 legacy=0x7f2be40b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.930+0000 7f2be3fff640 1 -- 172.21.15.19:0/1025175376 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be406d8c0 con 0x7f2be40716d0 2024-09-12T02:07:06.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.930+0000 7f2be8d9d640 1 --2- 172.21.15.19:0/1025175376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2be4147d80 0x7f2be406d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:06.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.931+0000 7f2be3fff640 1 --2- 172.21.15.19:0/1025175376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2be40716d0 0x7f2be40cfd40 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc009d90 tx=0x7f2bcc02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b753b4465374f91e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:06.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.931+0000 7f2be37fe640 1 -- 172.21.15.19:0/1025175376 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc031600 con 0x7f2be40716d0 2024-09-12T02:07:06.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.931+0000 7f2be37fe640 1 -- 172.21.15.19:0/1025175376 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bcc0317a0 con 0x7f2be40716d0 2024-09-12T02:07:06.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.931+0000 7f2be37fe640 1 -- 172.21.15.19:0/1025175376 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc031b50 con 0x7f2be40716d0 2024-09-12T02:07:06.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.931+0000 7f2be9d9f640 1 -- 172.21.15.19:0/1025175376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2be40716d0 msgr2=0x7f2be40cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.931+0000 7f2be9d9f640 1 --2- 172.21.15.19:0/1025175376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2be40716d0 0x7f2be40cfd40 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc009d90 tx=0x7f2bcc02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.931+0000 7f2be9d9f640 1 -- 172.21.15.19:0/1025175376 shutdown_connections 2024-09-12T02:07:06.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.931+0000 7f2be9d9f640 1 --2- 172.21.15.19:0/1025175376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2be40716d0 0x7f2be40cfd40 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.931+0000 7f2be9d9f640 1 --2- 172.21.15.19:0/1025175376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2be4147d80 0x7f2be406d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.931+0000 7f2be9d9f640 1 -- 172.21.15.19:0/1025175376 >> 172.21.15.19:0/1025175376 conn(0x7f2be406fee0 msgr2=0x7f2be40702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:06.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.931+0000 7f2be9d9f640 1 -- 172.21.15.19:0/1025175376 shutdown_connections 2024-09-12T02:07:06.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.931+0000 7f2be9d9f640 1 -- 172.21.15.19:0/1025175376 wait complete. 2024-09-12T02:07:06.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.932+0000 7f2be9d9f640 1 Processor -- start 2024-09-12T02:07:06.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.933+0000 7f2be9d9f640 1 -- start start 2024-09-12T02:07:06.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.933+0000 7f2be9d9f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2be40716d0 0x7f2be40b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.933+0000 7f2be9d9f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2be40d0280 0x7f2be415d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.933+0000 7f2be9d9f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2be4147d80 0x7f2be41f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.933+0000 7f2be9d9f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2be406e160 con 0x7f2be4147d80 2024-09-12T02:07:06.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.933+0000 7f2be9d9f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2be406de80 con 0x7f2be40d0280 2024-09-12T02:07:06.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.933+0000 7f2be9d9f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2be40b5d40 con 0x7f2be40716d0 2024-09-12T02:07:06.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.934+0000 7f2be959e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2be4147d80 0x7f2be41f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.934+0000 7f2be959e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2be4147d80 0x7f2be41f3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54712/0 (socket says 172.21.15.19:54712) 2024-09-12T02:07:06.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.934+0000 7f2be959e640 1 -- 172.21.15.19:0/4197932181 learned_addr learned my addr 172.21.15.19:0/4197932181 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:06.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.934+0000 7f2be3fff640 1 --2- 172.21.15.19:0/4197932181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2be40d0280 0x7f2be415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.934+0000 7f2be8d9d640 1 --2- 172.21.15.19:0/4197932181 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2be40716d0 0x7f2be40b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.934+0000 7f2be959e640 1 -- 172.21.15.19:0/4197932181 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2be40716d0 msgr2=0x7f2be40b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.934+0000 7f2be959e640 1 --2- 172.21.15.19:0/4197932181 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2be40716d0 0x7f2be40b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.934+0000 7f2be959e640 1 -- 172.21.15.19:0/4197932181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2be40d0280 msgr2=0x7f2be415d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.934+0000 7f2be959e640 1 --2- 172.21.15.19:0/4197932181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2be40d0280 0x7f2be415d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.934+0000 7f2be959e640 1 -- 172.21.15.19:0/4197932181 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be40ced50 con 0x7f2be4147d80 2024-09-12T02:07:06.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.934+0000 7f2be959e640 1 --2- 172.21.15.19:0/4197932181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2be4147d80 0x7f2be41f3f60 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00c420 tx=0x7f2bdc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:06.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.934+0000 7f2be17fa640 1 -- 172.21.15.19:0/4197932181 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc017070 con 0x7f2be4147d80 2024-09-12T02:07:06.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.934+0000 7f2be17fa640 1 -- 172.21.15.19:0/4197932181 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bdc005ce0 con 0x7f2be4147d80 2024-09-12T02:07:06.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.934+0000 7f2be9d9f640 1 -- 172.21.15.19:0/4197932181 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be40cf030 con 0x7f2be4147d80 2024-09-12T02:07:06.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.934+0000 7f2be17fa640 1 -- 172.21.15.19:0/4197932181 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc0072d0 con 0x7f2be4147d80 2024-09-12T02:07:06.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.934+0000 7f2be9d9f640 1 -- 172.21.15.19:0/4197932181 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be40cb8a0 con 0x7f2be4147d80 2024-09-12T02:07:06.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.935+0000 7f2be9d9f640 1 -- 172.21.15.19:0/4197932181 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be40cfd40 con 0x7f2be4147d80 2024-09-12T02:07:06.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.936+0000 7f2be17fa640 1 -- 172.21.15.19:0/4197932181 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2bdc01a070 con 0x7f2be4147d80 2024-09-12T02:07:06.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.936+0000 7f2be17fa640 1 --2- 172.21.15.19:0/4197932181 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2bc406be30 0x7f2bc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.936+0000 7f2be17fa640 1 -- 172.21.15.19:0/4197932181 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f2bdc08a3a0 con 0x7f2be4147d80 2024-09-12T02:07:06.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.936+0000 7f2be8d9d640 1 --2- 172.21.15.19:0/4197932181 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2bc406be30 0x7f2bc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.937+0000 7f2be8d9d640 1 --2- 172.21.15.19:0/4197932181 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2bc406be30 0x7f2bc406e2f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4009560 tx=0x7f2bd4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:06.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:06.941+0000 7f2be17fa640 1 -- 172.21.15.19:0/4197932181 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2bdc0584f0 con 0x7f2be4147d80 2024-09-12T02:07:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.152+0000 7f2be9d9f640 1 -- 172.21.15.19:0/4197932181 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2be4074a50 con 0x7f2be4147d80 2024-09-12T02:07:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.763+0000 7f2be17fa640 1 -- 172.21.15.19:0/4197932181 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v330) ==== 118+0+0 (secure 0 0 0) 0x7f2bdc05c7f0 con 0x7f2be4147d80 2024-09-12T02:07:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.766+0000 7f2be9d9f640 1 -- 172.21.15.19:0/4197932181 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2bc406be30 msgr2=0x7f2bc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.766+0000 7f2be9d9f640 1 --2- 172.21.15.19:0/4197932181 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2bc406be30 0x7f2bc406e2f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4009560 tx=0x7f2bd4009190 comp rx=0 tx=0).stop 2024-09-12T02:07:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.766+0000 7f2be9d9f640 1 -- 172.21.15.19:0/4197932181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2be4147d80 msgr2=0x7f2be41f3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.766+0000 7f2be9d9f640 1 --2- 172.21.15.19:0/4197932181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2be4147d80 0x7f2be41f3f60 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00c420 tx=0x7f2bdc00c8e0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.766+0000 7f2be9d9f640 1 -- 172.21.15.19:0/4197932181 shutdown_connections 2024-09-12T02:07:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.767+0000 7f2be9d9f640 1 --2- 172.21.15.19:0/4197932181 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2bc406be30 0x7f2bc406e2f0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.767+0000 7f2be9d9f640 1 --2- 172.21.15.19:0/4197932181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2be4147d80 0x7f2be41f3f60 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.767+0000 7f2be9d9f640 1 --2- 172.21.15.19:0/4197932181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2be40d0280 0x7f2be415d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.767+0000 7f2be9d9f640 1 --2- 172.21.15.19:0/4197932181 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2be40716d0 0x7f2be40b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.767+0000 7f2be9d9f640 1 -- 172.21.15.19:0/4197932181 >> 172.21.15.19:0/4197932181 conn(0x7f2be406fee0 msgr2=0x7f2be4145370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:07.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.767+0000 7f2be9d9f640 1 -- 172.21.15.19:0/4197932181 shutdown_connections 2024-09-12T02:07:07.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.767+0000 7f2be9d9f640 1 -- 172.21.15.19:0/4197932181 wait complete. 2024-09-12T02:07:07.781 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:07:07.781 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:07:07.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.893+0000 7f96d074b640 1 Processor -- start 2024-09-12T02:07:07.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.893+0000 7f96d074b640 1 -- start start 2024-09-12T02:07:07.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.894+0000 7f96d074b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96c8161a20 0x7f96c80d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:07.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.894+0000 7f96d074b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f96c80cf330 0x7f96c806d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:07.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.894+0000 7f96d074b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96c80cf980 con 0x7f96c80d1420 2024-09-12T02:07:07.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.894+0000 7f96d074b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f96c8161e00 con 0x7f96c80cf330 2024-09-12T02:07:07.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.894+0000 7f96d074b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f96c806d050 con 0x7f96c8161a20 2024-09-12T02:07:07.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.894+0000 7f96ce4e7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96c8161a20 0x7f96c80d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.894+0000 7f96cece8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f96c80cf330 0x7f96c806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.894+0000 7f96cdce6640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f96c80d1420 0x7f96c80cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:37132/0 (socket says 172.21.15.19:37132) 2024-09-12T02:07:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.894+0000 7f96cdce6640 1 -- 172.21.15.19:0/1052912946 learned_addr learned my addr 172.21.15.19:0/1052912946 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.895+0000 7f96cece8640 1 -- 172.21.15.19:0/1052912946 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96c8161a20 msgr2=0x7f96c80d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.895+0000 7f96cece8640 1 --2- 172.21.15.19:0/1052912946 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96c8161a20 0x7f96c80d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.895+0000 7f96cece8640 1 -- 172.21.15.19:0/1052912946 >> v1:172.21.15.135:6789/0 conn(0x7f96c80d1420 legacy=0x7f96c80cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.895+0000 7f96cece8640 1 -- 172.21.15.19:0/1052912946 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c80d1800 con 0x7f96c80cf330 2024-09-12T02:07:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.895+0000 7f96ce4e7640 1 --2- 172.21.15.19:0/1052912946 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96c8161a20 0x7f96c80d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:07.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.895+0000 7f96cece8640 1 --2- 172.21.15.19:0/1052912946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c80cf330 0x7f96c806d810 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f96c80cfb50 tx=0x7f96c002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cba40f99516b2e99 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:07.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.896+0000 7f96cd4e5640 1 -- 172.21.15.19:0/1052912946 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c0037070 con 0x7f96c80cf330 2024-09-12T02:07:07.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.896+0000 7f96cd4e5640 1 -- 172.21.15.19:0/1052912946 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c0032440 con 0x7f96c80cf330 2024-09-12T02:07:07.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.896+0000 7f96cd4e5640 1 -- 172.21.15.19:0/1052912946 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c0032810 con 0x7f96c80cf330 2024-09-12T02:07:07.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.896+0000 7f96d074b640 1 -- 172.21.15.19:0/1052912946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c80cf330 msgr2=0x7f96c806d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:07.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.896+0000 7f96d074b640 1 --2- 172.21.15.19:0/1052912946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c80cf330 0x7f96c806d810 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f96c80cfb50 tx=0x7f96c002a180 comp rx=0 tx=0).stop 2024-09-12T02:07:07.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.896+0000 7f96d074b640 1 -- 172.21.15.19:0/1052912946 shutdown_connections 2024-09-12T02:07:07.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.896+0000 7f96d074b640 1 --2- 172.21.15.19:0/1052912946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c80cf330 0x7f96c806d810 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.896+0000 7f96d074b640 1 --2- 172.21.15.19:0/1052912946 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96c8161a20 0x7f96c80d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.896+0000 7f96d074b640 1 -- 172.21.15.19:0/1052912946 >> 172.21.15.19:0/1052912946 conn(0x7f96c809d850 msgr2=0x7f96c808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:07.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.896+0000 7f96d074b640 1 -- 172.21.15.19:0/1052912946 shutdown_connections 2024-09-12T02:07:07.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.896+0000 7f96d074b640 1 -- 172.21.15.19:0/1052912946 wait complete. 2024-09-12T02:07:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.898+0000 7f96d074b640 1 Processor -- start 2024-09-12T02:07:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.898+0000 7f96d074b640 1 -- start start 2024-09-12T02:07:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.898+0000 7f96d074b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c80cf330 0x7f96c8158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.898+0000 7f96d074b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96c80d1420 0x7f96c80cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:07.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.898+0000 7f96d074b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96c8161a20 0x7f96c806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:07.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.898+0000 7f96d074b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f96c806d2f0 con 0x7f96c8161a20 2024-09-12T02:07:07.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.898+0000 7f96d074b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f96c80cff00 con 0x7f96c80cf330 2024-09-12T02:07:07.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.898+0000 7f96d074b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f96c80b1040 con 0x7f96c80d1420 2024-09-12T02:07:07.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.899+0000 7f96cece8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96c8161a20 0x7f96c806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:07.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.899+0000 7f96cece8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96c8161a20 0x7f96c806d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54716/0 (socket says 172.21.15.19:54716) 2024-09-12T02:07:07.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.899+0000 7f96cece8640 1 -- 172.21.15.19:0/2635342786 learned_addr learned my addr 172.21.15.19:0/2635342786 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:07.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.899+0000 7f96cdce6640 1 --2- 172.21.15.19:0/2635342786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96c80d1420 0x7f96c80cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:07.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.899+0000 7f96ce4e7640 1 --2- 172.21.15.19:0/2635342786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c80cf330 0x7f96c8158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:07.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.899+0000 7f96cece8640 1 -- 172.21.15.19:0/2635342786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96c80d1420 msgr2=0x7f96c80cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:07.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.899+0000 7f96cece8640 1 --2- 172.21.15.19:0/2635342786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96c80d1420 0x7f96c80cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.899+0000 7f96cece8640 1 -- 172.21.15.19:0/2635342786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c80cf330 msgr2=0x7f96c8158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:07.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.899+0000 7f96cece8640 1 --2- 172.21.15.19:0/2635342786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c80cf330 0x7f96c8158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.899+0000 7f96cece8640 1 -- 172.21.15.19:0/2635342786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c80cc620 con 0x7f96c8161a20 2024-09-12T02:07:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.899+0000 7f96cdce6640 1 --2- 172.21.15.19:0/2635342786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96c80d1420 0x7f96c80cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.899+0000 7f96ce4e7640 1 --2- 172.21.15.19:0/2635342786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c80cf330 0x7f96c8158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.899+0000 7f96cece8640 1 --2- 172.21.15.19:0/2635342786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96c8161a20 0x7f96c806d710 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f96c0035040 tx=0x7f96c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.899+0000 7f96beffd640 1 -- 172.21.15.19:0/2635342786 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c0037040 con 0x7f96c8161a20 2024-09-12T02:07:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.899+0000 7f96beffd640 1 -- 172.21.15.19:0/2635342786 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c0042070 con 0x7f96c8161a20 2024-09-12T02:07:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.899+0000 7f96d074b640 1 -- 172.21.15.19:0/2635342786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c80cc060 con 0x7f96c8161a20 2024-09-12T02:07:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.899+0000 7f96beffd640 1 -- 172.21.15.19:0/2635342786 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c00308a0 con 0x7f96c8161a20 2024-09-12T02:07:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.899+0000 7f96d074b640 1 -- 172.21.15.19:0/2635342786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c80b74c0 con 0x7f96c8161a20 2024-09-12T02:07:07.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.901+0000 7f96d074b640 1 -- 172.21.15.19:0/2635342786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c80d0ee0 con 0x7f96c8161a20 2024-09-12T02:07:07.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.901+0000 7f96beffd640 1 -- 172.21.15.19:0/2635342786 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f96c0030a40 con 0x7f96c8161a20 2024-09-12T02:07:07.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.901+0000 7f96beffd640 1 --2- 172.21.15.19:0/2635342786 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f96ac06be30 0x7f96ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:07.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.902+0000 7f96beffd640 1 -- 172.21.15.19:0/2635342786 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6101+0+0 (secure 0 0 0) 0x7f96c00ab8c0 con 0x7f96c8161a20 2024-09-12T02:07:07.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.902+0000 7f96ce4e7640 1 --2- 172.21.15.19:0/2635342786 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f96ac06be30 0x7f96ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:07.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.902+0000 7f96ce4e7640 1 --2- 172.21.15.19:0/2635342786 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f96ac06be30 0x7f96ac06e2f0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009fd0 tx=0x7f96c400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:07.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:07.906+0000 7f96beffd640 1 -- 172.21.15.19:0/2635342786 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f96c007a170 con 0x7f96c8161a20 2024-09-12T02:07:08.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.117+0000 7f96d074b640 1 -- 172.21.15.19:0/2635342786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f96c80d3bf0 con 0x7f96c8161a20 2024-09-12T02:07:08.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.765+0000 7f96beffd640 1 -- 172.21.15.19:0/2635342786 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v331) ==== 122+0+0 (secure 0 0 0) 0x7f96c0079a70 con 0x7f96c8161a20 2024-09-12T02:07:08.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.768+0000 7f96d074b640 1 -- 172.21.15.19:0/2635342786 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f96ac06be30 msgr2=0x7f96ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:08.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.768+0000 7f96d074b640 1 --2- 172.21.15.19:0/2635342786 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f96ac06be30 0x7f96ac06e2f0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009fd0 tx=0x7f96c400b040 comp rx=0 tx=0).stop 2024-09-12T02:07:08.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.768+0000 7f96d074b640 1 -- 172.21.15.19:0/2635342786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96c8161a20 msgr2=0x7f96c806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:08.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.768+0000 7f96d074b640 1 --2- 172.21.15.19:0/2635342786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96c8161a20 0x7f96c806d710 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f96c0035040 tx=0x7f96c00046c0 comp rx=0 tx=0).stop 2024-09-12T02:07:08.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.768+0000 7f96d074b640 1 -- 172.21.15.19:0/2635342786 shutdown_connections 2024-09-12T02:07:08.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.768+0000 7f96d074b640 1 --2- 172.21.15.19:0/2635342786 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f96ac06be30 0x7f96ac06e2f0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:08.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.768+0000 7f96d074b640 1 --2- 172.21.15.19:0/2635342786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96c8161a20 0x7f96c806d710 unknown :-1 s=CLOSED pgs=2249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:08.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.768+0000 7f96d074b640 1 --2- 172.21.15.19:0/2635342786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96c80d1420 0x7f96c80cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:08.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.768+0000 7f96d074b640 1 --2- 172.21.15.19:0/2635342786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c80cf330 0x7f96c8158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:08.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.768+0000 7f96d074b640 1 -- 172.21.15.19:0/2635342786 >> 172.21.15.19:0/2635342786 conn(0x7f96c809d850 msgr2=0x7f96c80d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:08.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.768+0000 7f96d074b640 1 -- 172.21.15.19:0/2635342786 shutdown_connections 2024-09-12T02:07:08.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.768+0000 7f96d074b640 1 -- 172.21.15.19:0/2635342786 wait complete. 2024-09-12T02:07:08.782 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:07:08.782 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:07:08.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.891+0000 7fb7c0b31640 1 Processor -- start 2024-09-12T02:07:08.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.891+0000 7fb7c0b31640 1 -- start start 2024-09-12T02:07:08.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.892+0000 7fb7c0b31640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb7bc147360 0x7fb7bc070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:08.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.892+0000 7fb7c0b31640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7bc070dd0 0x7fb7bc0d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:08.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.892+0000 7fb7c0b31640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb7bc0d09e0 0x7fb7bc06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:08.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.892+0000 7fb7c0b31640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb7bc06cb30 con 0x7fb7bc0d09e0 2024-09-12T02:07:08.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.892+0000 7fb7c0b31640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb7bc06bfb0 con 0x7fb7bc147360 2024-09-12T02:07:08.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.892+0000 7fb7c0b31640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb7bc06c290 con 0x7fb7bc070dd0 2024-09-12T02:07:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.892+0000 7fb7bad9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb7bc0d09e0 0x7fb7bc06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.892+0000 7fb7bad9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb7bc0d09e0 0x7fb7bc06f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54726/0 (socket says 172.21.15.19:54726) 2024-09-12T02:07:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.892+0000 7fb7bad9d640 1 -- 172.21.15.19:0/2087587133 learned_addr learned my addr 172.21.15.19:0/2087587133 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.892+0000 7fb7ba59c640 1 --2- 172.21.15.19:0/2087587133 >> v2:172.21.15.135:3300/0 conn(0x7fb7bc147360 0x7fb7bc070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.892+0000 7fb7b9d9b640 1 --2- 172.21.15.19:0/2087587133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7bc070dd0 0x7fb7bc0d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.892+0000 7fb7bad9d640 1 -- 172.21.15.19:0/2087587133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7bc070dd0 msgr2=0x7fb7bc0d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.892+0000 7fb7bad9d640 1 --2- 172.21.15.19:0/2087587133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7bc070dd0 0x7fb7bc0d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.892+0000 7fb7bad9d640 1 -- 172.21.15.19:0/2087587133 >> v2:172.21.15.135:3300/0 conn(0x7fb7bc147360 msgr2=0x7fb7bc070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.892+0000 7fb7bad9d640 1 --2- 172.21.15.19:0/2087587133 >> v2:172.21.15.135:3300/0 conn(0x7fb7bc147360 0x7fb7bc070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.892+0000 7fb7bad9d640 1 -- 172.21.15.19:0/2087587133 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7bc06c570 con 0x7fb7bc0d09e0 2024-09-12T02:07:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.893+0000 7fb7ba59c640 1 --2- 172.21.15.19:0/2087587133 >> v2:172.21.15.135:3300/0 conn(0x7fb7bc147360 0x7fb7bc070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.893+0000 7fb7b9d9b640 1 --2- 172.21.15.19:0/2087587133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7bc070dd0 0x7fb7bc0d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.893+0000 7fb7bad9d640 1 --2- 172.21.15.19:0/2087587133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc0d09e0 0x7fb7bc06f060 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc1483f0 tx=0x7fb7b402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d5bd555daef254 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.893+0000 7fb7b959a640 1 -- 172.21.15.19:0/2087587133 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4036070 con 0x7fb7bc0d09e0 2024-09-12T02:07:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.893+0000 7fb7b959a640 1 -- 172.21.15.19:0/2087587133 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b4031600 con 0x7fb7bc0d09e0 2024-09-12T02:07:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.893+0000 7fb7b959a640 1 -- 172.21.15.19:0/2087587133 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b40319d0 con 0x7fb7bc0d09e0 2024-09-12T02:07:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.894+0000 7fb7c0b31640 1 -- 172.21.15.19:0/2087587133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc0d09e0 msgr2=0x7fb7bc06f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.894+0000 7fb7c0b31640 1 --2- 172.21.15.19:0/2087587133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc0d09e0 0x7fb7bc06f060 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc1483f0 tx=0x7fb7b402a610 comp rx=0 tx=0).stop 2024-09-12T02:07:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.894+0000 7fb7c0b31640 1 -- 172.21.15.19:0/2087587133 shutdown_connections 2024-09-12T02:07:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.894+0000 7fb7c0b31640 1 --2- 172.21.15.19:0/2087587133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc0d09e0 0x7fb7bc06f060 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:08.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.894+0000 7fb7c0b31640 1 --2- 172.21.15.19:0/2087587133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7bc070dd0 0x7fb7bc0d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:08.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.894+0000 7fb7c0b31640 1 --2- 172.21.15.19:0/2087587133 >> v2:172.21.15.135:3300/0 conn(0x7fb7bc147360 0x7fb7bc070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:08.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.894+0000 7fb7c0b31640 1 -- 172.21.15.19:0/2087587133 >> 172.21.15.19:0/2087587133 conn(0x7fb7bc0b2f40 msgr2=0x7fb7bc0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:08.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.894+0000 7fb7c0b31640 1 -- 172.21.15.19:0/2087587133 shutdown_connections 2024-09-12T02:07:08.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.894+0000 7fb7c0b31640 1 -- 172.21.15.19:0/2087587133 wait complete. 2024-09-12T02:07:08.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.895+0000 7fb7c0b31640 1 Processor -- start 2024-09-12T02:07:08.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.895+0000 7fb7c0b31640 1 -- start start 2024-09-12T02:07:08.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.896+0000 7fb7c0b31640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7bc070dd0 0x7fb7bc0b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:08.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.896+0000 7fb7c0b31640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7bc0d09e0 0x7fb7bc15ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:08.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.896+0000 7fb7c0b31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc147360 0x7fb7bc1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:08.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.896+0000 7fb7c0b31640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc06bc10 con 0x7fb7bc147360 2024-09-12T02:07:08.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.896+0000 7fb7c0b31640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc0d0e10 con 0x7fb7bc0d09e0 2024-09-12T02:07:08.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.896+0000 7fb7c0b31640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb7bc06bd90 con 0x7fb7bc070dd0 2024-09-12T02:07:08.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.896+0000 7fb7bad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc147360 0x7fb7bc1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:08.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.896+0000 7fb7bad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc147360 0x7fb7bc1591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54730/0 (socket says 172.21.15.19:54730) 2024-09-12T02:07:08.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.896+0000 7fb7bad9d640 1 -- 172.21.15.19:0/1470204812 learned_addr learned my addr 172.21.15.19:0/1470204812 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:08.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.896+0000 7fb7ba59c640 1 --2- 172.21.15.19:0/1470204812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7bc070dd0 0x7fb7bc0b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:08.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.896+0000 7fb7b9d9b640 1 --2- 172.21.15.19:0/1470204812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7bc0d09e0 0x7fb7bc15ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:08.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.897+0000 7fb7bad9d640 1 -- 172.21.15.19:0/1470204812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7bc070dd0 msgr2=0x7fb7bc0b6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:08.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.897+0000 7fb7bad9d640 1 --2- 172.21.15.19:0/1470204812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7bc070dd0 0x7fb7bc0b6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:08.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.897+0000 7fb7bad9d640 1 -- 172.21.15.19:0/1470204812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7bc0d09e0 msgr2=0x7fb7bc15ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:08.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.897+0000 7fb7bad9d640 1 --2- 172.21.15.19:0/1470204812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7bc0d09e0 0x7fb7bc15ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:08.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.897+0000 7fb7bad9d640 1 -- 172.21.15.19:0/1470204812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7bc0b5670 con 0x7fb7bc147360 2024-09-12T02:07:08.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.897+0000 7fb7bad9d640 1 --2- 172.21.15.19:0/1470204812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc147360 0x7fb7bc1591e0 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009f40 tx=0x7fb7b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:08.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.897+0000 7fb7aaffd640 1 -- 172.21.15.19:0/1470204812 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b403f020 con 0x7fb7bc147360 2024-09-12T02:07:08.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.897+0000 7fb7aaffd640 1 -- 172.21.15.19:0/1470204812 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b4037040 con 0x7fb7bc147360 2024-09-12T02:07:08.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.897+0000 7fb7aaffd640 1 -- 172.21.15.19:0/1470204812 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4036070 con 0x7fb7bc147360 2024-09-12T02:07:08.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.897+0000 7fb7c0b31640 1 -- 172.21.15.19:0/1470204812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7bc0b5950 con 0x7fb7bc147360 2024-09-12T02:07:08.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.897+0000 7fb7c0b31640 1 -- 172.21.15.19:0/1470204812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7bc0b5f10 con 0x7fb7bc147360 2024-09-12T02:07:08.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.898+0000 7fb7c0b31640 1 -- 172.21.15.19:0/1470204812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7bc0d0480 con 0x7fb7bc147360 2024-09-12T02:07:08.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.898+0000 7fb7aaffd640 1 -- 172.21.15.19:0/1470204812 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7b4042020 con 0x7fb7bc147360 2024-09-12T02:07:08.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.899+0000 7fb7aaffd640 1 --2- 172.21.15.19:0/1470204812 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb79c06be60 0x7fb79c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:08.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.899+0000 7fb7aaffd640 1 -- 172.21.15.19:0/1470204812 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6101+0+0 (secure 0 0 0) 0x7fb7b40ab710 con 0x7fb7bc147360 2024-09-12T02:07:08.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.899+0000 7fb7ba59c640 1 --2- 172.21.15.19:0/1470204812 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb79c06be60 0x7fb79c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:08.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.900+0000 7fb7ba59c640 1 --2- 172.21.15.19:0/1470204812 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb79c06be60 0x7fb79c06e320 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc070c40 tx=0x7fb7ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:08.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:08.903+0000 7fb7aaffd640 1 -- 172.21.15.19:0/1470204812 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7b4049020 con 0x7fb7bc147360 2024-09-12T02:07:09.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.117+0000 7fb7c0b31640 1 -- 172.21.15.19:0/1470204812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7bc0af1c0 con 0x7fb7bc147360 2024-09-12T02:07:09.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.117+0000 7fb7aaffd640 1 -- 172.21.15.19:0/1470204812 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 331 v331) ==== 95+0+5240 (secure 0 0 0) 0x7fb7b4079970 con 0x7fb7bc147360 2024-09-12T02:07:09.118 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:09.119 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":331,"btime":"2024-09-12T02:07:08:765046+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2607300298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2607300298},{"type":"v1","addr":"172.21.15.135:6836","nonce":2607300298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":9283,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/818911002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":818911002},{"type":"v1","addr":"172.21.15.135:6837","nonce":818911002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":10650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3527496552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3527496552},{"type":"v1","addr":"172.21.15.19:6834","nonce":3527496552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327}],"filesystems":[{"mdsmap":{"epoch":331,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:07:05.517761+0000","modified":"2024-09-12T02:07:08.119084+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10653":{"gid":10653,"name":"a","rank":0,"incarnation":328,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/3072429339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3072429339},{"type":"v1","addr":"172.21.15.19:6835","nonce":3072429339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10653,"qdb_cluster":[10653]},"id":7}]} 2024-09-12T02:07:09.119 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 331 2024-09-12T02:07:09.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.119+0000 7fb7c0b31640 1 -- 172.21.15.19:0/1470204812 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb79c06be60 msgr2=0x7fb79c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.119+0000 7fb7c0b31640 1 --2- 172.21.15.19:0/1470204812 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb79c06be60 0x7fb79c06e320 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc070c40 tx=0x7fb7ac008040 comp rx=0 tx=0).stop 2024-09-12T02:07:09.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.119+0000 7fb7c0b31640 1 -- 172.21.15.19:0/1470204812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc147360 msgr2=0x7fb7bc1591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.119+0000 7fb7c0b31640 1 --2- 172.21.15.19:0/1470204812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc147360 0x7fb7bc1591e0 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009f40 tx=0x7fb7b4004a40 comp rx=0 tx=0).stop 2024-09-12T02:07:09.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.119+0000 7fb7c0b31640 1 -- 172.21.15.19:0/1470204812 shutdown_connections 2024-09-12T02:07:09.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.119+0000 7fb7c0b31640 1 --2- 172.21.15.19:0/1470204812 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb79c06be60 0x7fb79c06e320 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.119+0000 7fb7c0b31640 1 --2- 172.21.15.19:0/1470204812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc147360 0x7fb7bc1591e0 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.120+0000 7fb7c0b31640 1 --2- 172.21.15.19:0/1470204812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7bc0d09e0 0x7fb7bc15ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.120+0000 7fb7c0b31640 1 --2- 172.21.15.19:0/1470204812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7bc070dd0 0x7fb7bc0b6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.120+0000 7fb7c0b31640 1 -- 172.21.15.19:0/1470204812 >> 172.21.15.19:0/1470204812 conn(0x7fb7bc0b2f40 msgr2=0x7fb7bc06f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:09.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.120+0000 7fb7c0b31640 1 -- 172.21.15.19:0/1470204812 shutdown_connections 2024-09-12T02:07:09.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.120+0000 7fb7c0b31640 1 -- 172.21.15.19:0/1470204812 wait complete. 2024-09-12T02:07:09.132 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:07:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.234+0000 7f2ddd282640 1 Processor -- start 2024-09-12T02:07:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.235+0000 7f2ddd282640 1 -- start start 2024-09-12T02:07:09.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.235+0000 7f2ddd282640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2dd8162060 0x7f2dd80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.235+0000 7f2ddd282640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dd80b64b0 0x7f2dd80b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.235+0000 7f2ddd282640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dd806d9f0 con 0x7f2dd8161c80 2024-09-12T02:07:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.235+0000 7f2ddd282640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2dd806dcd0 con 0x7f2dd8162060 2024-09-12T02:07:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.235+0000 7f2ddd282640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd806dfb0 con 0x7f2dd80b64b0 2024-09-12T02:07:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.235+0000 7f2dd67fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2dd8162060 0x7f2dd80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.235+0000 7f2dd6ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2dd8161c80 0x7f2dd806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56400/0 (socket says 172.21.15.19:56400) 2024-09-12T02:07:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.236+0000 7f2dd6ffd640 1 -- 172.21.15.19:0/681946038 learned_addr learned my addr 172.21.15.19:0/681946038 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.236+0000 7f2dd77fe640 1 --2- 172.21.15.19:0/681946038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dd80b64b0 0x7f2dd80b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.236+0000 7f2dd67fc640 1 -- 172.21.15.19:0/681946038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dd80b64b0 msgr2=0x7f2dd80b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.236+0000 7f2dd67fc640 1 --2- 172.21.15.19:0/681946038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dd80b64b0 0x7f2dd80b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.236+0000 7f2dd67fc640 1 -- 172.21.15.19:0/681946038 >> v1:172.21.15.19:6789/0 conn(0x7f2dd8161c80 legacy=0x7f2dd806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.236+0000 7f2dd67fc640 1 -- 172.21.15.19:0/681946038 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd80d01f0 con 0x7f2dd8162060 2024-09-12T02:07:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.236+0000 7f2dd5ffb640 1 -- 172.21.15.19:0/681946038 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2086254327 0 0) 0x7f2dd806d9f0 con 0x7f2dd8161c80 2024-09-12T02:07:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.236+0000 7f2dd77fe640 1 --2- 172.21.15.19:0/681946038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dd80b64b0 0x7f2dd80b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.237+0000 7f2dd67fc640 1 --2- 172.21.15.19:0/681946038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dd8162060 0x7f2dd80b5f70 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00097a0 tx=0x7f2dc002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5be0a0a68156036 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.237+0000 7f2dd5ffb640 1 -- 172.21.15.19:0/681946038 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0037070 con 0x7f2dd8162060 2024-09-12T02:07:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.237+0000 7f2dd5ffb640 1 -- 172.21.15.19:0/681946038 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc0032440 con 0x7f2dd8162060 2024-09-12T02:07:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.237+0000 7f2dd5ffb640 1 -- 172.21.15.19:0/681946038 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0032810 con 0x7f2dd8162060 2024-09-12T02:07:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.237+0000 7f2ddd282640 1 -- 172.21.15.19:0/681946038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dd8162060 msgr2=0x7f2dd80b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.237+0000 7f2ddd282640 1 --2- 172.21.15.19:0/681946038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dd8162060 0x7f2dd80b5f70 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00097a0 tx=0x7f2dc002a180 comp rx=0 tx=0).stop 2024-09-12T02:07:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.237+0000 7f2ddd282640 1 -- 172.21.15.19:0/681946038 shutdown_connections 2024-09-12T02:07:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.237+0000 7f2ddd282640 1 --2- 172.21.15.19:0/681946038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dd80b64b0 0x7f2dd80b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.237+0000 7f2ddd282640 1 --2- 172.21.15.19:0/681946038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dd8162060 0x7f2dd80b5f70 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.237+0000 7f2ddd282640 1 -- 172.21.15.19:0/681946038 >> 172.21.15.19:0/681946038 conn(0x7f2dd80d44f0 msgr2=0x7f2dd80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.237+0000 7f2ddd282640 1 -- 172.21.15.19:0/681946038 shutdown_connections 2024-09-12T02:07:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.237+0000 7f2ddd282640 1 -- 172.21.15.19:0/681946038 wait complete. 2024-09-12T02:07:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.239+0000 7f2ddd282640 1 Processor -- start 2024-09-12T02:07:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.239+0000 7f2ddd282640 1 -- start start 2024-09-12T02:07:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.239+0000 7f2ddd282640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dd80b64b0 0x7f2dd81561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.239+0000 7f2ddd282640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dd8161c80 0x7f2dd80b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.239+0000 7f2ddd282640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dd8162060 0x7f2dd80b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.239+0000 7f2ddd282640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd80cf360 con 0x7f2dd80b64b0 2024-09-12T02:07:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.239+0000 7f2ddd282640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd80cf1e0 con 0x7f2dd8161c80 2024-09-12T02:07:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.239+0000 7f2ddd282640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd80cf4e0 con 0x7f2dd8162060 2024-09-12T02:07:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.239+0000 7f2dd6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dd80b64b0 0x7f2dd81561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.239+0000 7f2dd6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dd80b64b0 0x7f2dd81561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54756/0 (socket says 172.21.15.19:54756) 2024-09-12T02:07:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.240+0000 7f2dd6ffd640 1 -- 172.21.15.19:0/395441640 learned_addr learned my addr 172.21.15.19:0/395441640 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.240+0000 7f2dd77fe640 1 --2- 172.21.15.19:0/395441640 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dd8162060 0x7f2dd80b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.240+0000 7f2dd67fc640 1 --2- 172.21.15.19:0/395441640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dd8161c80 0x7f2dd80b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.240+0000 7f2dd6ffd640 1 -- 172.21.15.19:0/395441640 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dd8162060 msgr2=0x7f2dd80b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.240+0000 7f2dd6ffd640 1 --2- 172.21.15.19:0/395441640 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dd8162060 0x7f2dd80b2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.240+0000 7f2dd6ffd640 1 -- 172.21.15.19:0/395441640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dd8161c80 msgr2=0x7f2dd80b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.240+0000 7f2dd6ffd640 1 --2- 172.21.15.19:0/395441640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dd8161c80 0x7f2dd80b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.240+0000 7f2dd6ffd640 1 -- 172.21.15.19:0/395441640 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd80b7340 con 0x7f2dd80b64b0 2024-09-12T02:07:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.240+0000 7f2dd6ffd640 1 --2- 172.21.15.19:0/395441640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dd80b64b0 0x7f2dd81561a0 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7f2dd000c4d0 tx=0x7f2dd000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.240+0000 7f2dcf7fe640 1 -- 172.21.15.19:0/395441640 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0018070 con 0x7f2dd80b64b0 2024-09-12T02:07:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.240+0000 7f2dcf7fe640 1 -- 172.21.15.19:0/395441640 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd0007500 con 0x7f2dd80b64b0 2024-09-12T02:07:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.240+0000 7f2dcf7fe640 1 -- 172.21.15.19:0/395441640 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0004a20 con 0x7f2dd80b64b0 2024-09-12T02:07:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.240+0000 7f2ddd282640 1 -- 172.21.15.19:0/395441640 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd80b75e0 con 0x7f2dd80b64b0 2024-09-12T02:07:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.240+0000 7f2ddd282640 1 -- 172.21.15.19:0/395441640 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd80b7ba0 con 0x7f2dd80b64b0 2024-09-12T02:07:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.241+0000 7f2ddd282640 1 -- 172.21.15.19:0/395441640 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd80b5f70 con 0x7f2dd80b64b0 2024-09-12T02:07:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.242+0000 7f2dcf7fe640 1 -- 172.21.15.19:0/395441640 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2dd001b070 con 0x7f2dd80b64b0 2024-09-12T02:07:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.242+0000 7f2dcf7fe640 1 --2- 172.21.15.19:0/395441640 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2db806be30 0x7f2db806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.242+0000 7f2dcf7fe640 1 -- 172.21.15.19:0/395441640 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6101+0+0 (secure 0 0 0) 0x7f2dd008a2e0 con 0x7f2dd80b64b0 2024-09-12T02:07:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.243+0000 7f2dd67fc640 1 --2- 172.21.15.19:0/395441640 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2db806be30 0x7f2db806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.243+0000 7f2dd67fc640 1 --2- 172.21.15.19:0/395441640 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2db806be30 0x7f2db806e2f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0034000 tx=0x7f2dc002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:09.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.247+0000 7f2dcf7fe640 1 -- 172.21.15.19:0/395441640 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2dd0058b90 con 0x7f2dd80b64b0 2024-09-12T02:07:09.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.423+0000 7f2ddd282640 1 -- 172.21.15.19:0/395441640 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2dd8075790 con 0x7f2dd80b64b0 2024-09-12T02:07:09.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.424+0000 7f2dcf7fe640 1 -- 172.21.15.19:0/395441640 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) ==== 74+0+16932 (secure 0 0 0) 0x7f2dd0058490 con 0x7f2dd80b64b0 2024-09-12T02:07:09.425 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:09.425 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":145,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:07:07.156919+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:07:03.179551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-12T02:07:04.503322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:07:09.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.426+0000 7f2ddd282640 1 -- 172.21.15.19:0/395441640 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2db806be30 msgr2=0x7f2db806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.426+0000 7f2ddd282640 1 --2- 172.21.15.19:0/395441640 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2db806be30 0x7f2db806e2f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0034000 tx=0x7f2dc002e000 comp rx=0 tx=0).stop 2024-09-12T02:07:09.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.426+0000 7f2ddd282640 1 -- 172.21.15.19:0/395441640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dd80b64b0 msgr2=0x7f2dd81561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.426+0000 7f2ddd282640 1 --2- 172.21.15.19:0/395441640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dd80b64b0 0x7f2dd81561a0 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7f2dd000c4d0 tx=0x7f2dd000c990 comp rx=0 tx=0).stop 2024-09-12T02:07:09.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.426+0000 7f2ddd282640 1 -- 172.21.15.19:0/395441640 shutdown_connections 2024-09-12T02:07:09.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.426+0000 7f2ddd282640 1 --2- 172.21.15.19:0/395441640 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2db806be30 0x7f2db806e2f0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.426+0000 7f2ddd282640 1 --2- 172.21.15.19:0/395441640 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dd8162060 0x7f2dd80b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.426+0000 7f2ddd282640 1 --2- 172.21.15.19:0/395441640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dd8161c80 0x7f2dd80b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.426+0000 7f2ddd282640 1 --2- 172.21.15.19:0/395441640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dd80b64b0 0x7f2dd81561a0 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.426+0000 7f2ddd282640 1 -- 172.21.15.19:0/395441640 >> 172.21.15.19:0/395441640 conn(0x7f2dd80d44f0 msgr2=0x7f2dd80d3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:09.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.426+0000 7f2ddd282640 1 -- 172.21.15.19:0/395441640 shutdown_connections 2024-09-12T02:07:09.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.426+0000 7f2ddd282640 1 -- 172.21.15.19:0/395441640 wait complete. 2024-09-12T02:07:09.443 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:07:09.443 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:07:09.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.545+0000 7fac0d1df640 1 Processor -- start 2024-09-12T02:07:09.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.545+0000 7fac0d1df640 1 -- start start 2024-09-12T02:07:09.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.546+0000 7fac0d1df640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fac08162060 0x7fac080b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.546+0000 7fac0d1df640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac0806d9f0 con 0x7fac080b64b0 2024-09-12T02:07:09.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.546+0000 7fac0d1df640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac0806dcd0 con 0x7fac08161c80 2024-09-12T02:07:09.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.546+0000 7fac0d1df640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fac0806dfb0 con 0x7fac08162060 2024-09-12T02:07:09.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.546+0000 7fac0759e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fac080b64b0 0x7fac080cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56414/0 (socket says 172.21.15.19:56414) 2024-09-12T02:07:09.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.546+0000 7fac0759e640 1 -- 172.21.15.19:0/2671841696 learned_addr learned my addr 172.21.15.19:0/2671841696 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:09.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.546+0000 7fac0659c640 1 --2- 172.21.15.19:0/2671841696 >> v2:172.21.15.135:3300/0 conn(0x7fac08162060 0x7fac080b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.546+0000 7fac05d9b640 1 -- 172.21.15.19:0/2671841696 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3071456001 0 0) 0x7fac0806d9f0 con 0x7fac080b64b0 2024-09-12T02:07:09.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.546+0000 7fac05d9b640 1 -- 172.21.15.19:0/2671841696 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabf0003520 con 0x7fac080b64b0 2024-09-12T02:07:09.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac05d9b640 1 -- 172.21.15.19:0/2671841696 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3869324752 0 0) 0x7fabf0003520 con 0x7fac080b64b0 2024-09-12T02:07:09.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac05d9b640 1 -- 172.21.15.19:0/2671841696 >> v2:172.21.15.135:3300/0 conn(0x7fac08162060 msgr2=0x7fac080b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:09.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac05d9b640 1 --2- 172.21.15.19:0/2671841696 >> v2:172.21.15.135:3300/0 conn(0x7fac08162060 0x7fac080b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac05d9b640 1 -- 172.21.15.19:0/2671841696 >> v1:172.21.15.135:6789/0 conn(0x7fac08161c80 legacy=0x7fac0806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac05d9b640 1 -- 172.21.15.19:0/2671841696 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac080d2890 con 0x7fac080b64b0 2024-09-12T02:07:09.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac05d9b640 1 -- 172.21.15.19:0/2671841696 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fac000019f0 con 0x7fac080b64b0 2024-09-12T02:07:09.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac05d9b640 1 -- 172.21.15.19:0/2671841696 >> v1:172.21.15.19:6789/0 conn(0x7fac080b64b0 legacy=0x7fac080cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac05d9b640 1 --2- 172.21.15.19:0/2671841696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabf00039b0 0x7fabf0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac05d9b640 1 --2- 172.21.15.19:0/2671841696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf0004800 0x7fabf0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac05d9b640 1 --2- 172.21.15.19:0/2671841696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabf00051c0 0x7fabf000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac05d9b640 1 -- 172.21.15.19:0/2671841696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fac0806dfb0 con 0x7fabf00051c0 2024-09-12T02:07:09.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac05d9b640 1 -- 172.21.15.19:0/2671841696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fabf000c060 con 0x7fabf0004800 2024-09-12T02:07:09.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac05d9b640 1 -- 172.21.15.19:0/2671841696 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fabf000c260 con 0x7fabf00039b0 2024-09-12T02:07:09.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac0759e640 1 --2- 172.21.15.19:0/2671841696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabf00051c0 0x7fabf000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac06d9d640 1 --2- 172.21.15.19:0/2671841696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabf00039b0 0x7fabf0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac0659c640 1 --2- 172.21.15.19:0/2671841696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf0004800 0x7fabf0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac0759e640 1 -- 172.21.15.19:0/2671841696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabf00039b0 msgr2=0x7fabf0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:09.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac0759e640 1 --2- 172.21.15.19:0/2671841696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabf00039b0 0x7fabf0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac0759e640 1 -- 172.21.15.19:0/2671841696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf0004800 msgr2=0x7fabf0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:09.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac0759e640 1 --2- 172.21.15.19:0/2671841696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf0004800 0x7fabf0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.547+0000 7fac0759e640 1 -- 172.21.15.19:0/2671841696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf0003520 con 0x7fabf00051c0 2024-09-12T02:07:09.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.548+0000 7fac0759e640 1 -- 172.21.15.19:0/2671841696 reap_dead start 2024-09-12T02:07:09.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.548+0000 7fac0759e640 1 --2- 172.21.15.19:0/2671841696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabf00051c0 0x7fabf000b9c0 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7fac0000a850 tx=0x7fabf0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a335d28fbaac68 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:09.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.548+0000 7fac05d9b640 1 -- 172.21.15.19:0/2671841696 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0000a4a0 con 0x7fabf00051c0 2024-09-12T02:07:09.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.548+0000 7fac05d9b640 1 -- 172.21.15.19:0/2671841696 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac0002f070 con 0x7fabf00051c0 2024-09-12T02:07:09.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.548+0000 7fac05d9b640 1 -- 172.21.15.19:0/2671841696 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0002bce0 con 0x7fabf00051c0 2024-09-12T02:07:09.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.549+0000 7fac0d1df640 1 -- 172.21.15.19:0/2671841696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabf00051c0 msgr2=0x7fabf000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.549+0000 7fac0d1df640 1 --2- 172.21.15.19:0/2671841696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabf00051c0 0x7fabf000b9c0 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7fac0000a850 tx=0x7fabf0005830 comp rx=0 tx=0).stop 2024-09-12T02:07:09.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.549+0000 7fac0d1df640 1 -- 172.21.15.19:0/2671841696 shutdown_connections 2024-09-12T02:07:09.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.549+0000 7fac0d1df640 1 --2- 172.21.15.19:0/2671841696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabf00051c0 0x7fabf000b9c0 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.549+0000 7fac0d1df640 1 -- 172.21.15.19:0/2671841696 >> 172.21.15.19:0/2671841696 conn(0x7fac080d44f0 msgr2=0x7fac080d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:09.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.549+0000 7fac0d1df640 1 -- 172.21.15.19:0/2671841696 shutdown_connections 2024-09-12T02:07:09.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.549+0000 7fac0d1df640 1 -- 172.21.15.19:0/2671841696 wait complete. 2024-09-12T02:07:09.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.550+0000 7fac0d1df640 1 Processor -- start 2024-09-12T02:07:09.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.550+0000 7fac0d1df640 1 -- start start 2024-09-12T02:07:09.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.551+0000 7fac0d1df640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabf00051c0 0x7fac080b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.551+0000 7fac0d1df640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac080b28c0 0x7fac080b8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.551+0000 7fac0d1df640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac080b93a0 0x7fac080b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.551+0000 7fac0d1df640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fac080b6300 con 0x7fac080b28c0 2024-09-12T02:07:09.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.551+0000 7fac0d1df640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fac080b6180 con 0x7fac080b93a0 2024-09-12T02:07:09.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.551+0000 7fac0d1df640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fac080b6960 con 0x7fabf00051c0 2024-09-12T02:07:09.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.551+0000 7fac0659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac080b28c0 0x7fac080b8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.551+0000 7fac0659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac080b28c0 0x7fac080b8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54780/0 (socket says 172.21.15.19:54780) 2024-09-12T02:07:09.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.551+0000 7fac0659c640 1 -- 172.21.15.19:0/4255731731 learned_addr learned my addr 172.21.15.19:0/4255731731 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:09.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.551+0000 7fac06d9d640 1 --2- 172.21.15.19:0/4255731731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabf00051c0 0x7fac080b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.551+0000 7fac0759e640 1 --2- 172.21.15.19:0/4255731731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac080b93a0 0x7fac080b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.552+0000 7fac0659c640 1 -- 172.21.15.19:0/4255731731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabf00051c0 msgr2=0x7fac080b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.552+0000 7fac0659c640 1 --2- 172.21.15.19:0/4255731731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabf00051c0 0x7fac080b7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.552+0000 7fac0659c640 1 -- 172.21.15.19:0/4255731731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac080b93a0 msgr2=0x7fac080b7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.552+0000 7fac0659c640 1 --2- 172.21.15.19:0/4255731731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac080b93a0 0x7fac080b7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.552+0000 7fac0659c640 1 -- 172.21.15.19:0/4255731731 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac081f48e0 con 0x7fac080b28c0 2024-09-12T02:07:09.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.552+0000 7fac06d9d640 1 --2- 172.21.15.19:0/4255731731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabf00051c0 0x7fac080b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:09.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.552+0000 7fac0759e640 1 --2- 172.21.15.19:0/4255731731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac080b93a0 0x7fac080b7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:09.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.552+0000 7fac0659c640 1 --2- 172.21.15.19:0/4255731731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac080b28c0 0x7fac080b8e60 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7fabfc011960 tx=0x7fabfc011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:09.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.552+0000 7fabef7fe640 1 -- 172.21.15.19:0/4255731731 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc019070 con 0x7fac080b28c0 2024-09-12T02:07:09.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.552+0000 7fabef7fe640 1 -- 172.21.15.19:0/4255731731 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabfc004240 con 0x7fac080b28c0 2024-09-12T02:07:09.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.552+0000 7fac0d1df640 1 -- 172.21.15.19:0/4255731731 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac081f4bc0 con 0x7fac080b28c0 2024-09-12T02:07:09.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.552+0000 7fabef7fe640 1 -- 172.21.15.19:0/4255731731 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc00f820 con 0x7fac080b28c0 2024-09-12T02:07:09.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.552+0000 7fac0d1df640 1 -- 172.21.15.19:0/4255731731 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac081f5180 con 0x7fac080b28c0 2024-09-12T02:07:09.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.553+0000 7fac0d1df640 1 -- 172.21.15.19:0/4255731731 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac080b6cf0 con 0x7fac080b28c0 2024-09-12T02:07:09.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.553+0000 7fabef7fe640 1 -- 172.21.15.19:0/4255731731 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fabfc01c070 con 0x7fac080b28c0 2024-09-12T02:07:09.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.554+0000 7fabef7fe640 1 --2- 172.21.15.19:0/4255731731 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabf406be30 0x7fabf406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.554+0000 7fabef7fe640 1 -- 172.21.15.19:0/4255731731 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6101+0+0 (secure 0 0 0) 0x7fabfc08b420 con 0x7fac080b28c0 2024-09-12T02:07:09.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.554+0000 7fac06d9d640 1 --2- 172.21.15.19:0/4255731731 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabf406be30 0x7fabf406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.555+0000 7fac06d9d640 1 --2- 172.21.15.19:0/4255731731 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabf406be30 0x7fabf406e2f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fabf80055c0 tx=0x7fabf8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:09.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.558+0000 7fabef7fe640 1 -- 172.21.15.19:0/4255731731 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fabfc059c40 con 0x7fac080b28c0 2024-09-12T02:07:09.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.729+0000 7fac0d1df640 1 -- 172.21.15.19:0/4255731731 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fac080ba470 con 0x7fabf406be30 2024-09-12T02:07:09.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.735+0000 7fabef7fe640 1 -- 172.21.15.19:0/4255731731 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248403 (secure 0 0 0) 0x7fac080ba470 con 0x7fabf406be30 2024-09-12T02:07:09.739 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:09.740 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T02:07:09.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.738+0000 7fac0d1df640 1 -- 172.21.15.19:0/4255731731 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabf406be30 msgr2=0x7fabf406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.738+0000 7fac0d1df640 1 --2- 172.21.15.19:0/4255731731 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabf406be30 0x7fabf406e2f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fabf80055c0 tx=0x7fabf8009040 comp rx=0 tx=0).stop 2024-09-12T02:07:09.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.738+0000 7fac0d1df640 1 -- 172.21.15.19:0/4255731731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac080b28c0 msgr2=0x7fac080b8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.738+0000 7fac0d1df640 1 --2- 172.21.15.19:0/4255731731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac080b28c0 0x7fac080b8e60 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7fabfc011960 tx=0x7fabfc011e20 comp rx=0 tx=0).stop 2024-09-12T02:07:09.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.738+0000 7fac0d1df640 1 -- 172.21.15.19:0/4255731731 shutdown_connections 2024-09-12T02:07:09.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.738+0000 7fac0d1df640 1 --2- 172.21.15.19:0/4255731731 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fabf406be30 0x7fabf406e2f0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.738+0000 7fac0d1df640 1 --2- 172.21.15.19:0/4255731731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac080b93a0 0x7fac080b7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.738+0000 7fac0d1df640 1 --2- 172.21.15.19:0/4255731731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac080b28c0 0x7fac080b8e60 unknown :-1 s=CLOSED pgs=2257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.738+0000 7fac0d1df640 1 --2- 172.21.15.19:0/4255731731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabf00051c0 0x7fac080b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.738+0000 7fac0d1df640 1 -- 172.21.15.19:0/4255731731 >> 172.21.15.19:0/4255731731 conn(0x7fac080d44f0 msgr2=0x7fac080d2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:09.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.738+0000 7fac0d1df640 1 -- 172.21.15.19:0/4255731731 shutdown_connections 2024-09-12T02:07:09.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.738+0000 7fac0d1df640 1 -- 172.21.15.19:0/4255731731 wait complete. 2024-09-12T02:07:09.750 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":481,"stamp":"2024-09-12T02:07:08.252057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":152,"acting":152,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":298520,"kb_used_data":15704,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754676200,"statfs":{"total":773094113280,"available":772788428800,"internally_reserved":0,"allocated":16080896,"data_stored":8730651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.103356"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164699+0000","last_change":"2024-09-12T02:07:06.188562+0000","last_active":"2024-09-12T02:07:07.164699+0000","last_peered":"2024-09-12T02:07:07.164699+0000","last_clean":"2024-09-12T02:07:07.164699+0000","last_became_active":"2024-09-12T02:07:06.188181+0000","last_became_peered":"2024-09-12T02:07:06.188181+0000","last_unstale":"2024-09-12T02:07:07.164699+0000","last_undegraded":"2024-09-12T02:07:07.164699+0000","last_fullsized":"2024-09-12T02:07:07.164699+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:30.948775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164673+0000","last_change":"2024-09-12T02:07:06.181043+0000","last_active":"2024-09-12T02:07:07.164673+0000","last_peered":"2024-09-12T02:07:07.164673+0000","last_clean":"2024-09-12T02:07:07.164673+0000","last_became_active":"2024-09-12T02:07:06.180739+0000","last_became_peered":"2024-09-12T02:07:06.180739+0000","last_unstale":"2024-09-12T02:07:07.164673+0000","last_undegraded":"2024-09-12T02:07:07.164673+0000","last_fullsized":"2024-09-12T02:07:07.164673+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:59.243937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188462+0000","last_change":"2024-09-12T02:07:06.182365+0000","last_active":"2024-09-12T02:07:06.188462+0000","last_peered":"2024-09-12T02:07:06.188462+0000","last_clean":"2024-09-12T02:07:06.188462+0000","last_became_active":"2024-09-12T02:07:06.182017+0000","last_became_peered":"2024-09-12T02:07:06.182017+0000","last_unstale":"2024-09-12T02:07:06.188462+0000","last_undegraded":"2024-09-12T02:07:06.188462+0000","last_fullsized":"2024-09-12T02:07:06.188462+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:23.103898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.159991+0000","last_change":"2024-09-12T02:07:06.174721+0000","last_active":"2024-09-12T02:07:07.159991+0000","last_peered":"2024-09-12T02:07:07.159991+0000","last_clean":"2024-09-12T02:07:07.159991+0000","last_became_active":"2024-09-12T02:07:06.174396+0000","last_became_peered":"2024-09-12T02:07:06.174396+0000","last_unstale":"2024-09-12T02:07:07.159991+0000","last_undegraded":"2024-09-12T02:07:07.159991+0000","last_fullsized":"2024-09-12T02:07:07.159991+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:38.012619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.191811+0000","last_change":"2024-09-12T02:07:06.187847+0000","last_active":"2024-09-12T02:07:06.191811+0000","last_peered":"2024-09-12T02:07:06.191811+0000","last_clean":"2024-09-12T02:07:06.191811+0000","last_became_active":"2024-09-12T02:07:06.187330+0000","last_became_peered":"2024-09-12T02:07:06.187330+0000","last_unstale":"2024-09-12T02:07:06.191811+0000","last_undegraded":"2024-09-12T02:07:06.191811+0000","last_fullsized":"2024-09-12T02:07:06.191811+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:57.702135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160269+0000","last_change":"2024-09-12T02:07:06.165191+0000","last_active":"2024-09-12T02:07:07.160269+0000","last_peered":"2024-09-12T02:07:07.160269+0000","last_clean":"2024-09-12T02:07:07.160269+0000","last_became_active":"2024-09-12T02:07:06.164894+0000","last_became_peered":"2024-09-12T02:07:06.164894+0000","last_unstale":"2024-09-12T02:07:07.160269+0000","last_undegraded":"2024-09-12T02:07:07.160269+0000","last_fullsized":"2024-09-12T02:07:07.160269+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:51.780792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161745+0000","last_change":"2024-09-12T02:07:06.170696+0000","last_active":"2024-09-12T02:07:07.161745+0000","last_peered":"2024-09-12T02:07:07.161745+0000","last_clean":"2024-09-12T02:07:07.161745+0000","last_became_active":"2024-09-12T02:07:06.170368+0000","last_became_peered":"2024-09-12T02:07:06.170368+0000","last_unstale":"2024-09-12T02:07:07.161745+0000","last_undegraded":"2024-09-12T02:07:07.161745+0000","last_fullsized":"2024-09-12T02:07:07.161745+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:57.778187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.185408+0000","last_change":"2024-09-12T02:07:06.181857+0000","last_active":"2024-09-12T02:07:06.185408+0000","last_peered":"2024-09-12T02:07:06.185408+0000","last_clean":"2024-09-12T02:07:06.185408+0000","last_became_active":"2024-09-12T02:07:06.181467+0000","last_became_peered":"2024-09-12T02:07:06.181467+0000","last_unstale":"2024-09-12T02:07:06.185408+0000","last_undegraded":"2024-09-12T02:07:06.185408+0000","last_fullsized":"2024-09-12T02:07:06.185408+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:56.597134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164742+0000","last_change":"2024-09-12T02:07:06.180361+0000","last_active":"2024-09-12T02:07:07.164742+0000","last_peered":"2024-09-12T02:07:07.164742+0000","last_clean":"2024-09-12T02:07:07.164742+0000","last_became_active":"2024-09-12T02:07:06.180017+0000","last_became_peered":"2024-09-12T02:07:06.180017+0000","last_unstale":"2024-09-12T02:07:07.164742+0000","last_undegraded":"2024-09-12T02:07:07.164742+0000","last_fullsized":"2024-09-12T02:07:07.164742+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:30.553159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164694+0000","last_change":"2024-09-12T02:07:06.184058+0000","last_active":"2024-09-12T02:07:07.164694+0000","last_peered":"2024-09-12T02:07:07.164694+0000","last_clean":"2024-09-12T02:07:07.164694+0000","last_became_active":"2024-09-12T02:07:06.183753+0000","last_became_peered":"2024-09-12T02:07:06.183753+0000","last_unstale":"2024-09-12T02:07:07.164694+0000","last_undegraded":"2024-09-12T02:07:07.164694+0000","last_fullsized":"2024-09-12T02:07:07.164694+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:58.979849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162191+0000","last_change":"2024-09-12T02:07:06.173004+0000","last_active":"2024-09-12T02:07:07.162191+0000","last_peered":"2024-09-12T02:07:07.162191+0000","last_clean":"2024-09-12T02:07:07.162191+0000","last_became_active":"2024-09-12T02:07:06.172715+0000","last_became_peered":"2024-09-12T02:07:06.172715+0000","last_unstale":"2024-09-12T02:07:07.162191+0000","last_undegraded":"2024-09-12T02:07:07.162191+0000","last_fullsized":"2024-09-12T02:07:07.162191+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:42.705993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.179326+0000","last_change":"2024-09-12T02:07:06.177889+0000","last_active":"2024-09-12T02:07:06.179326+0000","last_peered":"2024-09-12T02:07:06.179326+0000","last_clean":"2024-09-12T02:07:06.179326+0000","last_became_active":"2024-09-12T02:07:06.177498+0000","last_became_peered":"2024-09-12T02:07:06.177498+0000","last_unstale":"2024-09-12T02:07:06.179326+0000","last_undegraded":"2024-09-12T02:07:06.179326+0000","last_fullsized":"2024-09-12T02:07:06.179326+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:40.200757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160079+0000","last_change":"2024-09-12T02:07:06.185065+0000","last_active":"2024-09-12T02:07:07.160079+0000","last_peered":"2024-09-12T02:07:07.160079+0000","last_clean":"2024-09-12T02:07:07.160079+0000","last_became_active":"2024-09-12T02:07:06.184779+0000","last_became_peered":"2024-09-12T02:07:06.184779+0000","last_unstale":"2024-09-12T02:07:07.160079+0000","last_undegraded":"2024-09-12T02:07:07.160079+0000","last_fullsized":"2024-09-12T02:07:07.160079+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:13.412294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164498+0000","last_change":"2024-09-12T02:07:06.180301+0000","last_active":"2024-09-12T02:07:07.164498+0000","last_peered":"2024-09-12T02:07:07.164498+0000","last_clean":"2024-09-12T02:07:07.164498+0000","last_became_active":"2024-09-12T02:07:06.179930+0000","last_became_peered":"2024-09-12T02:07:06.179930+0000","last_unstale":"2024-09-12T02:07:07.164498+0000","last_undegraded":"2024-09-12T02:07:07.164498+0000","last_fullsized":"2024-09-12T02:07:07.164498+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:29.743856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160141+0000","last_change":"2024-09-12T02:07:06.173860+0000","last_active":"2024-09-12T02:07:07.160141+0000","last_peered":"2024-09-12T02:07:07.160141+0000","last_clean":"2024-09-12T02:07:07.160141+0000","last_became_active":"2024-09-12T02:07:06.173507+0000","last_became_peered":"2024-09-12T02:07:06.173507+0000","last_unstale":"2024-09-12T02:07:07.160141+0000","last_undegraded":"2024-09-12T02:07:07.160141+0000","last_fullsized":"2024-09-12T02:07:07.160141+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:55.442840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161259+0000","last_change":"2024-09-12T02:07:06.183545+0000","last_active":"2024-09-12T02:07:07.161259+0000","last_peered":"2024-09-12T02:07:07.161259+0000","last_clean":"2024-09-12T02:07:07.161259+0000","last_became_active":"2024-09-12T02:07:06.180674+0000","last_became_peered":"2024-09-12T02:07:06.180674+0000","last_unstale":"2024-09-12T02:07:07.161259+0000","last_undegraded":"2024-09-12T02:07:07.161259+0000","last_fullsized":"2024-09-12T02:07:07.161259+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:23.067644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161179+0000","last_change":"2024-09-12T02:07:06.171797+0000","last_active":"2024-09-12T02:07:07.161179+0000","last_peered":"2024-09-12T02:07:07.161179+0000","last_clean":"2024-09-12T02:07:07.161179+0000","last_became_active":"2024-09-12T02:07:06.171513+0000","last_became_peered":"2024-09-12T02:07:06.171513+0000","last_unstale":"2024-09-12T02:07:07.161179+0000","last_undegraded":"2024-09-12T02:07:07.161179+0000","last_fullsized":"2024-09-12T02:07:07.161179+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:58.954857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.179305+0000","last_change":"2024-09-12T02:07:06.177320+0000","last_active":"2024-09-12T02:07:06.179305+0000","last_peered":"2024-09-12T02:07:06.179305+0000","last_clean":"2024-09-12T02:07:06.179305+0000","last_became_active":"2024-09-12T02:07:06.176959+0000","last_became_peered":"2024-09-12T02:07:06.176959+0000","last_unstale":"2024-09-12T02:07:06.179305+0000","last_undegraded":"2024-09-12T02:07:06.179305+0000","last_fullsized":"2024-09-12T02:07:06.179305+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:02.600481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161419+0000","last_change":"2024-09-12T02:07:06.178211+0000","last_active":"2024-09-12T02:07:07.161419+0000","last_peered":"2024-09-12T02:07:07.161419+0000","last_clean":"2024-09-12T02:07:07.161419+0000","last_became_active":"2024-09-12T02:07:06.177168+0000","last_became_peered":"2024-09-12T02:07:06.177168+0000","last_unstale":"2024-09-12T02:07:07.161419+0000","last_undegraded":"2024-09-12T02:07:07.161419+0000","last_fullsized":"2024-09-12T02:07:07.161419+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:26.784396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.191783+0000","last_change":"2024-09-12T02:07:06.187602+0000","last_active":"2024-09-12T02:07:06.191783+0000","last_peered":"2024-09-12T02:07:06.191783+0000","last_clean":"2024-09-12T02:07:06.191783+0000","last_became_active":"2024-09-12T02:07:06.186930+0000","last_became_peered":"2024-09-12T02:07:06.186930+0000","last_unstale":"2024-09-12T02:07:06.191783+0000","last_undegraded":"2024-09-12T02:07:06.191783+0000","last_fullsized":"2024-09-12T02:07:06.191783+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:50.021035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164540+0000","last_change":"2024-09-12T02:07:06.182081+0000","last_active":"2024-09-12T02:07:07.164540+0000","last_peered":"2024-09-12T02:07:07.164540+0000","last_clean":"2024-09-12T02:07:07.164540+0000","last_became_active":"2024-09-12T02:07:06.181774+0000","last_became_peered":"2024-09-12T02:07:06.181774+0000","last_unstale":"2024-09-12T02:07:07.164540+0000","last_undegraded":"2024-09-12T02:07:07.164540+0000","last_fullsized":"2024-09-12T02:07:07.164540+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:41.166247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"144'4","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.187015+0000","last_change":"2024-09-12T02:07:05.168735+0000","last_active":"2024-09-12T02:07:06.187015+0000","last_peered":"2024-09-12T02:07:06.187015+0000","last_clean":"2024-09-12T02:07:06.187015+0000","last_became_active":"2024-09-12T02:07:05.168378+0000","last_became_peered":"2024-09-12T02:07:05.168378+0000","last_unstale":"2024-09-12T02:07:06.187015+0000","last_undegraded":"2024-09-12T02:07:06.187015+0000","last_fullsized":"2024-09-12T02:07:06.187015+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:56.775704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.192885+0000","last_change":"2024-09-12T02:07:06.189264+0000","last_active":"2024-09-12T02:07:06.192885+0000","last_peered":"2024-09-12T02:07:06.192885+0000","last_clean":"2024-09-12T02:07:06.192885+0000","last_became_active":"2024-09-12T02:07:06.188784+0000","last_became_peered":"2024-09-12T02:07:06.188784+0000","last_unstale":"2024-09-12T02:07:06.192885+0000","last_undegraded":"2024-09-12T02:07:06.192885+0000","last_fullsized":"2024-09-12T02:07:06.192885+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:47.546176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"144'1","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188900+0000","last_change":"2024-09-12T02:07:05.178805+0000","last_active":"2024-09-12T02:07:06.188900+0000","last_peered":"2024-09-12T02:07:06.188900+0000","last_clean":"2024-09-12T02:07:06.188900+0000","last_became_active":"2024-09-12T02:07:05.178340+0000","last_became_peered":"2024-09-12T02:07:05.178340+0000","last_unstale":"2024-09-12T02:07:06.188900+0000","last_undegraded":"2024-09-12T02:07:06.188900+0000","last_fullsized":"2024-09-12T02:07:06.188900+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:30.323418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161537+0000","last_change":"2024-09-12T02:07:06.170078+0000","last_active":"2024-09-12T02:07:07.161537+0000","last_peered":"2024-09-12T02:07:07.161537+0000","last_clean":"2024-09-12T02:07:07.161537+0000","last_became_active":"2024-09-12T02:07:06.169626+0000","last_became_peered":"2024-09-12T02:07:06.169626+0000","last_unstale":"2024-09-12T02:07:07.161537+0000","last_undegraded":"2024-09-12T02:07:07.161537+0000","last_fullsized":"2024-09-12T02:07:07.161537+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:02.746428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161354+0000","last_change":"2024-09-12T02:07:05.173497+0000","last_active":"2024-09-12T02:07:07.161354+0000","last_peered":"2024-09-12T02:07:07.161354+0000","last_clean":"2024-09-12T02:07:07.161354+0000","last_became_active":"2024-09-12T02:07:05.173240+0000","last_became_peered":"2024-09-12T02:07:05.173240+0000","last_unstale":"2024-09-12T02:07:07.161354+0000","last_undegraded":"2024-09-12T02:07:07.161354+0000","last_fullsized":"2024-09-12T02:07:07.161354+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:45.930215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160093+0000","last_change":"2024-09-12T02:07:05.174789+0000","last_active":"2024-09-12T02:07:07.160093+0000","last_peered":"2024-09-12T02:07:07.160093+0000","last_clean":"2024-09-12T02:07:07.160093+0000","last_became_active":"2024-09-12T02:07:05.174498+0000","last_became_peered":"2024-09-12T02:07:05.174498+0000","last_unstale":"2024-09-12T02:07:07.160093+0000","last_undegraded":"2024-09-12T02:07:07.160093+0000","last_fullsized":"2024-09-12T02:07:07.160093+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:39.219875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188440+0000","last_change":"2024-09-12T02:07:06.182146+0000","last_active":"2024-09-12T02:07:06.188440+0000","last_peered":"2024-09-12T02:07:06.188440+0000","last_clean":"2024-09-12T02:07:06.188440+0000","last_became_active":"2024-09-12T02:07:06.181487+0000","last_became_peered":"2024-09-12T02:07:06.181487+0000","last_unstale":"2024-09-12T02:07:06.188440+0000","last_undegraded":"2024-09-12T02:07:06.188440+0000","last_fullsized":"2024-09-12T02:07:06.188440+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:43.216454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.151998+0000","last_change":"2024-09-12T02:07:04.151998+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.151998+0000","last_undegraded":"2024-09-12T02:07:04.151998+0000","last_fullsized":"2024-09-12T02:07:04.151998+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164914+0000","last_change":"2024-09-12T02:07:06.180769+0000","last_active":"2024-09-12T02:07:07.164914+0000","last_peered":"2024-09-12T02:07:07.164914+0000","last_clean":"2024-09-12T02:07:07.164914+0000","last_became_active":"2024-09-12T02:07:06.180488+0000","last_became_peered":"2024-09-12T02:07:06.180488+0000","last_unstale":"2024-09-12T02:07:07.164914+0000","last_undegraded":"2024-09-12T02:07:07.164914+0000","last_fullsized":"2024-09-12T02:07:07.164914+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:53.889287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.156493+0000","last_change":"2024-09-12T02:07:04.156493+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.156493+0000","last_undegraded":"2024-09-12T02:07:04.156493+0000","last_fullsized":"2024-09-12T02:07:04.156493+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161246+0000","last_change":"2024-09-12T02:07:05.169281+0000","last_active":"2024-09-12T02:07:07.161246+0000","last_peered":"2024-09-12T02:07:07.161246+0000","last_clean":"2024-09-12T02:07:07.161246+0000","last_became_active":"2024-09-12T02:07:05.169013+0000","last_became_peered":"2024-09-12T02:07:05.169013+0000","last_unstale":"2024-09-12T02:07:07.161246+0000","last_undegraded":"2024-09-12T02:07:07.161246+0000","last_fullsized":"2024-09-12T02:07:07.161246+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:35.627376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.189655+0000","last_change":"2024-09-12T02:07:06.185740+0000","last_active":"2024-09-12T02:07:06.189655+0000","last_peered":"2024-09-12T02:07:06.189655+0000","last_clean":"2024-09-12T02:07:06.189655+0000","last_became_active":"2024-09-12T02:07:06.185464+0000","last_became_peered":"2024-09-12T02:07:06.185464+0000","last_unstale":"2024-09-12T02:07:06.189655+0000","last_undegraded":"2024-09-12T02:07:06.189655+0000","last_fullsized":"2024-09-12T02:07:06.189655+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:03.123101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.167409+0000","last_change":"2024-09-12T02:07:05.171827+0000","last_active":"2024-09-12T02:07:06.167409+0000","last_peered":"2024-09-12T02:07:06.167409+0000","last_clean":"2024-09-12T02:07:06.167409+0000","last_became_active":"2024-09-12T02:07:05.170929+0000","last_became_peered":"2024-09-12T02:07:05.170929+0000","last_unstale":"2024-09-12T02:07:06.167409+0000","last_undegraded":"2024-09-12T02:07:06.167409+0000","last_fullsized":"2024-09-12T02:07:06.167409+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:25.781913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164699+0000","last_change":"2024-09-12T02:07:06.182831+0000","last_active":"2024-09-12T02:07:07.164699+0000","last_peered":"2024-09-12T02:07:07.164699+0000","last_clean":"2024-09-12T02:07:07.164699+0000","last_became_active":"2024-09-12T02:07:06.182547+0000","last_became_peered":"2024-09-12T02:07:06.182547+0000","last_unstale":"2024-09-12T02:07:07.164699+0000","last_undegraded":"2024-09-12T02:07:07.164699+0000","last_fullsized":"2024-09-12T02:07:07.164699+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:46.521663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161205+0000","last_change":"2024-09-12T02:07:05.170472+0000","last_active":"2024-09-12T02:07:07.161205+0000","last_peered":"2024-09-12T02:07:07.161205+0000","last_clean":"2024-09-12T02:07:07.161205+0000","last_became_active":"2024-09-12T02:07:05.170230+0000","last_became_peered":"2024-09-12T02:07:05.170230+0000","last_unstale":"2024-09-12T02:07:07.161205+0000","last_undegraded":"2024-09-12T02:07:07.161205+0000","last_fullsized":"2024-09-12T02:07:07.161205+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:37.010136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.159884+0000","last_change":"2024-09-12T02:07:06.184089+0000","last_active":"2024-09-12T02:07:07.159884+0000","last_peered":"2024-09-12T02:07:07.159884+0000","last_clean":"2024-09-12T02:07:07.159884+0000","last_became_active":"2024-09-12T02:07:06.183803+0000","last_became_peered":"2024-09-12T02:07:06.183803+0000","last_unstale":"2024-09-12T02:07:07.159884+0000","last_undegraded":"2024-09-12T02:07:07.159884+0000","last_fullsized":"2024-09-12T02:07:07.159884+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:46.932699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164723+0000","last_change":"2024-09-12T02:07:05.169627+0000","last_active":"2024-09-12T02:07:07.164723+0000","last_peered":"2024-09-12T02:07:07.164723+0000","last_clean":"2024-09-12T02:07:07.164723+0000","last_became_active":"2024-09-12T02:07:05.169351+0000","last_became_peered":"2024-09-12T02:07:05.169351+0000","last_unstale":"2024-09-12T02:07:07.164723+0000","last_undegraded":"2024-09-12T02:07:07.164723+0000","last_fullsized":"2024-09-12T02:07:07.164723+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:16.639255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188132+0000","last_change":"2024-09-12T02:07:06.185105+0000","last_active":"2024-09-12T02:07:06.188132+0000","last_peered":"2024-09-12T02:07:06.188132+0000","last_clean":"2024-09-12T02:07:06.188132+0000","last_became_active":"2024-09-12T02:07:06.184834+0000","last_became_peered":"2024-09-12T02:07:06.184834+0000","last_unstale":"2024-09-12T02:07:06.188132+0000","last_undegraded":"2024-09-12T02:07:06.188132+0000","last_fullsized":"2024-09-12T02:07:06.188132+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:32.847267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.151821+0000","last_change":"2024-09-12T02:07:04.151821+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.151821+0000","last_undegraded":"2024-09-12T02:07:04.151821+0000","last_fullsized":"2024-09-12T02:07:04.151821+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160149+0000","last_change":"2024-09-12T02:07:06.185464+0000","last_active":"2024-09-12T02:07:07.160149+0000","last_peered":"2024-09-12T02:07:07.160149+0000","last_clean":"2024-09-12T02:07:07.160149+0000","last_became_active":"2024-09-12T02:07:06.184939+0000","last_became_peered":"2024-09-12T02:07:06.184939+0000","last_unstale":"2024-09-12T02:07:07.160149+0000","last_undegraded":"2024-09-12T02:07:07.160149+0000","last_fullsized":"2024-09-12T02:07:07.160149+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:43.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.150584+0000","last_change":"2024-09-12T02:07:04.150584+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.150584+0000","last_undegraded":"2024-09-12T02:07:04.150584+0000","last_fullsized":"2024-09-12T02:07:04.150584+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160245+0000","last_change":"2024-09-12T02:07:05.180245+0000","last_active":"2024-09-12T02:07:07.160245+0000","last_peered":"2024-09-12T02:07:07.160245+0000","last_clean":"2024-09-12T02:07:07.160245+0000","last_became_active":"2024-09-12T02:07:05.179890+0000","last_became_peered":"2024-09-12T02:07:05.179890+0000","last_unstale":"2024-09-12T02:07:07.160245+0000","last_undegraded":"2024-09-12T02:07:07.160245+0000","last_fullsized":"2024-09-12T02:07:07.160245+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:26.126486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.167494+0000","last_change":"2024-09-12T02:07:05.170442+0000","last_active":"2024-09-12T02:07:06.167494+0000","last_peered":"2024-09-12T02:07:06.167494+0000","last_clean":"2024-09-12T02:07:06.167494+0000","last_became_active":"2024-09-12T02:07:05.170143+0000","last_became_peered":"2024-09-12T02:07:05.170143+0000","last_unstale":"2024-09-12T02:07:06.167494+0000","last_undegraded":"2024-09-12T02:07:06.167494+0000","last_fullsized":"2024-09-12T02:07:06.167494+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:01.743945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.189010+0000","last_change":"2024-09-12T02:07:06.186466+0000","last_active":"2024-09-12T02:07:06.189010+0000","last_peered":"2024-09-12T02:07:06.189010+0000","last_clean":"2024-09-12T02:07:06.189010+0000","last_became_active":"2024-09-12T02:07:06.186144+0000","last_became_peered":"2024-09-12T02:07:06.186144+0000","last_unstale":"2024-09-12T02:07:06.189010+0000","last_undegraded":"2024-09-12T02:07:06.189010+0000","last_fullsized":"2024-09-12T02:07:06.189010+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:20.906453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.172327+0000","last_change":"2024-09-12T02:07:05.181325+0000","last_active":"2024-09-12T02:07:06.172327+0000","last_peered":"2024-09-12T02:07:06.172327+0000","last_clean":"2024-09-12T02:07:06.172327+0000","last_became_active":"2024-09-12T02:07:05.181048+0000","last_became_peered":"2024-09-12T02:07:05.181048+0000","last_unstale":"2024-09-12T02:07:06.172327+0000","last_undegraded":"2024-09-12T02:07:06.172327+0000","last_fullsized":"2024-09-12T02:07:06.172327+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:04.428549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164859+0000","last_change":"2024-09-12T02:07:06.180329+0000","last_active":"2024-09-12T02:07:07.164859+0000","last_peered":"2024-09-12T02:07:07.164859+0000","last_clean":"2024-09-12T02:07:07.164859+0000","last_became_active":"2024-09-12T02:07:06.179876+0000","last_became_peered":"2024-09-12T02:07:06.179876+0000","last_unstale":"2024-09-12T02:07:07.164859+0000","last_undegraded":"2024-09-12T02:07:07.164859+0000","last_fullsized":"2024-09-12T02:07:07.164859+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:47.471652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"144'8","reported_seq":22,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160927+0000","last_change":"2024-09-12T02:07:05.173863+0000","last_active":"2024-09-12T02:07:07.160927+0000","last_peered":"2024-09-12T02:07:07.160927+0000","last_clean":"2024-09-12T02:07:07.160927+0000","last_became_active":"2024-09-12T02:07:05.173135+0000","last_became_peered":"2024-09-12T02:07:05.173135+0000","last_unstale":"2024-09-12T02:07:07.160927+0000","last_undegraded":"2024-09-12T02:07:07.160927+0000","last_fullsized":"2024-09-12T02:07:07.160927+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:25.840163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188208+0000","last_change":"2024-09-12T02:07:06.183288+0000","last_active":"2024-09-12T02:07:06.188208+0000","last_peered":"2024-09-12T02:07:06.188208+0000","last_clean":"2024-09-12T02:07:06.188208+0000","last_became_active":"2024-09-12T02:07:06.182990+0000","last_became_peered":"2024-09-12T02:07:06.182990+0000","last_unstale":"2024-09-12T02:07:06.188208+0000","last_undegraded":"2024-09-12T02:07:06.188208+0000","last_fullsized":"2024-09-12T02:07:06.188208+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:11.283654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.150433+0000","last_change":"2024-09-12T02:07:04.150433+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.150433+0000","last_undegraded":"2024-09-12T02:07:04.150433+0000","last_fullsized":"2024-09-12T02:07:04.150433+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.151312+0000","last_change":"2024-09-12T02:07:04.151312+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.151312+0000","last_undegraded":"2024-09-12T02:07:04.151312+0000","last_fullsized":"2024-09-12T02:07:04.151312+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160154+0000","last_change":"2024-09-12T02:07:06.175575+0000","last_active":"2024-09-12T02:07:07.160154+0000","last_peered":"2024-09-12T02:07:07.160154+0000","last_clean":"2024-09-12T02:07:07.160154+0000","last_became_active":"2024-09-12T02:07:06.175285+0000","last_became_peered":"2024-09-12T02:07:06.175285+0000","last_unstale":"2024-09-12T02:07:07.160154+0000","last_undegraded":"2024-09-12T02:07:07.160154+0000","last_fullsized":"2024-09-12T02:07:07.160154+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:54.606749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.156489+0000","last_change":"2024-09-12T02:07:04.156489+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.156489+0000","last_undegraded":"2024-09-12T02:07:04.156489+0000","last_fullsized":"2024-09-12T02:07:04.156489+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164691+0000","last_change":"2024-09-12T02:07:06.186836+0000","last_active":"2024-09-12T02:07:07.164691+0000","last_peered":"2024-09-12T02:07:07.164691+0000","last_clean":"2024-09-12T02:07:07.164691+0000","last_became_active":"2024-09-12T02:07:06.186490+0000","last_became_peered":"2024-09-12T02:07:06.186490+0000","last_unstale":"2024-09-12T02:07:07.164691+0000","last_undegraded":"2024-09-12T02:07:07.164691+0000","last_fullsized":"2024-09-12T02:07:07.164691+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:52.748269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"144'2","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.182591+0000","last_change":"2024-09-12T02:07:05.178914+0000","last_active":"2024-09-12T02:07:06.182591+0000","last_peered":"2024-09-12T02:07:06.182591+0000","last_clean":"2024-09-12T02:07:06.182591+0000","last_became_active":"2024-09-12T02:07:05.178630+0000","last_became_peered":"2024-09-12T02:07:05.178630+0000","last_unstale":"2024-09-12T02:07:06.182591+0000","last_undegraded":"2024-09-12T02:07:06.182591+0000","last_fullsized":"2024-09-12T02:07:06.182591+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:53.781606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164915+0000","last_change":"2024-09-12T02:07:06.172346+0000","last_active":"2024-09-12T02:07:07.164915+0000","last_peered":"2024-09-12T02:07:07.164915+0000","last_clean":"2024-09-12T02:07:07.164915+0000","last_became_active":"2024-09-12T02:07:06.171758+0000","last_became_peered":"2024-09-12T02:07:06.171758+0000","last_unstale":"2024-09-12T02:07:07.164915+0000","last_undegraded":"2024-09-12T02:07:07.164915+0000","last_fullsized":"2024-09-12T02:07:07.164915+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:57.712570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.170854+0000","last_change":"2024-09-12T02:07:05.181025+0000","last_active":"2024-09-12T02:07:06.170854+0000","last_peered":"2024-09-12T02:07:06.170854+0000","last_clean":"2024-09-12T02:07:06.170854+0000","last_became_active":"2024-09-12T02:07:05.180707+0000","last_became_peered":"2024-09-12T02:07:05.180707+0000","last_unstale":"2024-09-12T02:07:06.170854+0000","last_undegraded":"2024-09-12T02:07:06.170854+0000","last_fullsized":"2024-09-12T02:07:06.170854+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:51.480271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.181619+0000","last_change":"2024-09-12T02:07:06.175102+0000","last_active":"2024-09-12T02:07:06.181619+0000","last_peered":"2024-09-12T02:07:06.181619+0000","last_clean":"2024-09-12T02:07:06.181619+0000","last_became_active":"2024-09-12T02:07:06.174811+0000","last_became_peered":"2024-09-12T02:07:06.174811+0000","last_unstale":"2024-09-12T02:07:06.181619+0000","last_undegraded":"2024-09-12T02:07:06.181619+0000","last_fullsized":"2024-09-12T02:07:06.181619+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:48.029678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.151066+0000","last_change":"2024-09-12T02:07:04.151066+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.151066+0000","last_undegraded":"2024-09-12T02:07:04.151066+0000","last_fullsized":"2024-09-12T02:07:04.151066+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188982+0000","last_change":"2024-09-12T02:07:06.186018+0000","last_active":"2024-09-12T02:07:06.188982+0000","last_peered":"2024-09-12T02:07:06.188982+0000","last_clean":"2024-09-12T02:07:06.188982+0000","last_became_active":"2024-09-12T02:07:06.185734+0000","last_became_peered":"2024-09-12T02:07:06.185734+0000","last_unstale":"2024-09-12T02:07:06.188982+0000","last_undegraded":"2024-09-12T02:07:06.188982+0000","last_fullsized":"2024-09-12T02:07:06.188982+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:45.609305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.171753+0000","last_change":"2024-09-12T02:07:05.178455+0000","last_active":"2024-09-12T02:07:06.171753+0000","last_peered":"2024-09-12T02:07:06.171753+0000","last_clean":"2024-09-12T02:07:06.171753+0000","last_became_active":"2024-09-12T02:07:05.178133+0000","last_became_peered":"2024-09-12T02:07:05.178133+0000","last_unstale":"2024-09-12T02:07:06.171753+0000","last_undegraded":"2024-09-12T02:07:06.171753+0000","last_fullsized":"2024-09-12T02:07:06.171753+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:55.251394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164380+0000","last_change":"2024-09-12T02:07:06.184322+0000","last_active":"2024-09-12T02:07:07.164380+0000","last_peered":"2024-09-12T02:07:07.164380+0000","last_clean":"2024-09-12T02:07:07.164380+0000","last_became_active":"2024-09-12T02:07:06.184012+0000","last_became_peered":"2024-09-12T02:07:06.184012+0000","last_unstale":"2024-09-12T02:07:07.164380+0000","last_undegraded":"2024-09-12T02:07:07.164380+0000","last_fullsized":"2024-09-12T02:07:07.164380+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:36.512194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160218+0000","last_change":"2024-09-12T02:07:05.177856+0000","last_active":"2024-09-12T02:07:07.160218+0000","last_peered":"2024-09-12T02:07:07.160218+0000","last_clean":"2024-09-12T02:07:07.160218+0000","last_became_active":"2024-09-12T02:07:05.177540+0000","last_became_peered":"2024-09-12T02:07:05.177540+0000","last_unstale":"2024-09-12T02:07:07.160218+0000","last_undegraded":"2024-09-12T02:07:07.160218+0000","last_fullsized":"2024-09-12T02:07:07.160218+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:10.671601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161000+0000","last_change":"2024-09-12T02:07:06.166133+0000","last_active":"2024-09-12T02:07:07.161000+0000","last_peered":"2024-09-12T02:07:07.161000+0000","last_clean":"2024-09-12T02:07:07.161000+0000","last_became_active":"2024-09-12T02:07:06.165891+0000","last_became_peered":"2024-09-12T02:07:06.165891+0000","last_unstale":"2024-09-12T02:07:07.161000+0000","last_undegraded":"2024-09-12T02:07:07.161000+0000","last_fullsized":"2024-09-12T02:07:07.161000+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:57.379027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"145'1","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.165996+0000","last_change":"2024-09-12T02:07:05.168685+0000","last_active":"2024-09-12T02:07:07.165996+0000","last_peered":"2024-09-12T02:07:07.165996+0000","last_clean":"2024-09-12T02:07:07.165996+0000","last_became_active":"2024-09-12T02:07:05.168379+0000","last_became_peered":"2024-09-12T02:07:05.168379+0000","last_unstale":"2024-09-12T02:07:07.165996+0000","last_undegraded":"2024-09-12T02:07:07.165996+0000","last_fullsized":"2024-09-12T02:07:07.165996+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:55.479228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.181044+0000","last_change":"2024-09-12T02:07:06.168431+0000","last_active":"2024-09-12T02:07:06.181044+0000","last_peered":"2024-09-12T02:07:06.181044+0000","last_clean":"2024-09-12T02:07:06.181044+0000","last_became_active":"2024-09-12T02:07:06.168080+0000","last_became_peered":"2024-09-12T02:07:06.168080+0000","last_unstale":"2024-09-12T02:07:06.181044+0000","last_undegraded":"2024-09-12T02:07:06.181044+0000","last_fullsized":"2024-09-12T02:07:06.181044+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:42.705993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.150525+0000","last_change":"2024-09-12T02:07:04.150525+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.150525+0000","last_undegraded":"2024-09-12T02:07:04.150525+0000","last_fullsized":"2024-09-12T02:07:04.150525+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160105+0000","last_change":"2024-09-12T02:07:05.169123+0000","last_active":"2024-09-12T02:07:07.160105+0000","last_peered":"2024-09-12T02:07:07.160105+0000","last_clean":"2024-09-12T02:07:07.160105+0000","last_became_active":"2024-09-12T02:07:05.168828+0000","last_became_peered":"2024-09-12T02:07:05.168828+0000","last_unstale":"2024-09-12T02:07:07.160105+0000","last_undegraded":"2024-09-12T02:07:07.160105+0000","last_fullsized":"2024-09-12T02:07:07.160105+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:10.926179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188173+0000","last_change":"2024-09-12T02:07:06.184423+0000","last_active":"2024-09-12T02:07:06.188173+0000","last_peered":"2024-09-12T02:07:06.188173+0000","last_clean":"2024-09-12T02:07:06.188173+0000","last_became_active":"2024-09-12T02:07:06.184135+0000","last_became_peered":"2024-09-12T02:07:06.184135+0000","last_unstale":"2024-09-12T02:07:06.188173+0000","last_undegraded":"2024-09-12T02:07:06.188173+0000","last_fullsized":"2024-09-12T02:07:06.188173+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:24.456509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161457+0000","last_change":"2024-09-12T02:07:05.167597+0000","last_active":"2024-09-12T02:07:07.161457+0000","last_peered":"2024-09-12T02:07:07.161457+0000","last_clean":"2024-09-12T02:07:07.161457+0000","last_became_active":"2024-09-12T02:07:05.167331+0000","last_became_peered":"2024-09-12T02:07:05.167331+0000","last_unstale":"2024-09-12T02:07:07.161457+0000","last_undegraded":"2024-09-12T02:07:07.161457+0000","last_fullsized":"2024-09-12T02:07:07.161457+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:51.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.191710+0000","last_change":"2024-09-12T02:07:06.188417+0000","last_active":"2024-09-12T02:07:06.191710+0000","last_peered":"2024-09-12T02:07:06.191710+0000","last_clean":"2024-09-12T02:07:06.191710+0000","last_became_active":"2024-09-12T02:07:06.188130+0000","last_became_peered":"2024-09-12T02:07:06.188130+0000","last_unstale":"2024-09-12T02:07:06.191710+0000","last_undegraded":"2024-09-12T02:07:06.191710+0000","last_fullsized":"2024-09-12T02:07:06.191710+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:30.566436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.171063+0000","last_change":"2024-09-12T02:07:05.178730+0000","last_active":"2024-09-12T02:07:06.171063+0000","last_peered":"2024-09-12T02:07:06.171063+0000","last_clean":"2024-09-12T02:07:06.171063+0000","last_became_active":"2024-09-12T02:07:05.178430+0000","last_became_peered":"2024-09-12T02:07:05.178430+0000","last_unstale":"2024-09-12T02:07:06.171063+0000","last_undegraded":"2024-09-12T02:07:06.171063+0000","last_fullsized":"2024-09-12T02:07:06.171063+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:45.524547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.150434+0000","last_change":"2024-09-12T02:07:04.150434+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.150434+0000","last_undegraded":"2024-09-12T02:07:04.150434+0000","last_fullsized":"2024-09-12T02:07:04.150434+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.171914+0000","last_change":"2024-09-12T02:07:05.179353+0000","last_active":"2024-09-12T02:07:06.171914+0000","last_peered":"2024-09-12T02:07:06.171914+0000","last_clean":"2024-09-12T02:07:06.171914+0000","last_became_active":"2024-09-12T02:07:05.178558+0000","last_became_peered":"2024-09-12T02:07:05.178558+0000","last_unstale":"2024-09-12T02:07:06.171914+0000","last_undegraded":"2024-09-12T02:07:06.171914+0000","last_fullsized":"2024-09-12T02:07:06.171914+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:39.636624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"144'2","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.190787+0000","last_change":"2024-09-12T02:07:05.179366+0000","last_active":"2024-09-12T02:07:06.190787+0000","last_peered":"2024-09-12T02:07:06.190787+0000","last_clean":"2024-09-12T02:07:06.190787+0000","last_became_active":"2024-09-12T02:07:05.179079+0000","last_became_peered":"2024-09-12T02:07:05.179079+0000","last_unstale":"2024-09-12T02:07:06.190787+0000","last_undegraded":"2024-09-12T02:07:06.190787+0000","last_fullsized":"2024-09-12T02:07:06.190787+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:43.865590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":401,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.151922+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T02:07:04.151922+0000","last_peered":"2024-09-12T02:07:04.151922+0000","last_clean":"2024-09-12T02:07:04.151922+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T02:07:04.151922+0000","last_undegraded":"2024-09-12T02:07:04.151922+0000","last_fullsized":"2024-09-12T02:07:04.151922+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":86,"acting":86,"num_store_stats":5},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509580,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37720,"kb_used_data":2368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334120,"statfs":{"total":96636764160,"available":96598138880,"internally_reserved":0,"allocated":2424832,"data_stored":1519602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41296,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330544,"statfs":{"total":96636764160,"available":96594477056,"internally_reserved":0,"allocated":1830912,"data_stored":929234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509580,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1830912,"data_stored":929234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542285,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1871872,"data_stored":949859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37180,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334660,"statfs":{"total":96636764160,"available":96598691840,"internally_reserved":0,"allocated":1871872,"data_stored":949311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37188,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334652,"statfs":{"total":96636764160,"available":96598683648,"internally_reserved":0,"allocated":1884160,"data_stored":956003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542285,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41948,"kb_used_data":2432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329892,"statfs":{"total":96636764160,"available":96593809408,"internally_reserved":0,"allocated":2490368,"data_stored":1548039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574989,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37188,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334652,"statfs":{"total":96636764160,"available":96598683648,"internally_reserved":0,"allocated":1875968,"data_stored":949369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:07:09.754 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:07:09.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.891+0000 7fbfbd0d0640 1 Processor -- start 2024-09-12T02:07:09.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.891+0000 7fbfbd0d0640 1 -- start start 2024-09-12T02:07:09.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.892+0000 7fbfbd0d0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb8162060 0x7fbfb80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.892+0000 7fbfbd0d0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbfb80b64b0 0x7fbfb80b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.892+0000 7fbfbd0d0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfb806d9f0 con 0x7fbfb8161c80 2024-09-12T02:07:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.892+0000 7fbfbd0d0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fbfb806dcd0 con 0x7fbfb80b64b0 2024-09-12T02:07:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.892+0000 7fbfbd0d0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb806dfb0 con 0x7fbfb8162060 2024-09-12T02:07:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.893+0000 7fbfb759e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbfb80b64b0 0x7fbfb80b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.893+0000 7fbfb659c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb8162060 0x7fbfb80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.893+0000 7fbfb6d9d640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fbfb8161c80 0x7fbfb806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:37144/0 (socket says 172.21.15.19:37144) 2024-09-12T02:07:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.893+0000 7fbfb6d9d640 1 -- 172.21.15.19:0/1411246896 learned_addr learned my addr 172.21.15.19:0/1411246896 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.893+0000 7fbfb5d9b640 1 -- 172.21.15.19:0/1411246896 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3615645781 0 0) 0x7fbfb806d9f0 con 0x7fbfb8161c80 2024-09-12T02:07:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.893+0000 7fbfb5d9b640 1 -- 172.21.15.19:0/1411246896 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfa4003520 con 0x7fbfb8161c80 2024-09-12T02:07:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.893+0000 7fbfb659c640 1 -- 172.21.15.19:0/1411246896 >> v2:172.21.15.135:3300/0 conn(0x7fbfb80b64b0 msgr2=0x7fbfb80b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.893+0000 7fbfb659c640 1 --2- 172.21.15.19:0/1411246896 >> v2:172.21.15.135:3300/0 conn(0x7fbfb80b64b0 0x7fbfb80b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.893+0000 7fbfb659c640 1 -- 172.21.15.19:0/1411246896 >> v1:172.21.15.135:6789/0 conn(0x7fbfb8161c80 legacy=0x7fbfb806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.893+0000 7fbfb659c640 1 -- 172.21.15.19:0/1411246896 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb80d01f0 con 0x7fbfb8162060 2024-09-12T02:07:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.893+0000 7fbfb759e640 1 --2- 172.21.15.19:0/1411246896 >> v2:172.21.15.135:3300/0 conn(0x7fbfb80b64b0 0x7fbfb80b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.894+0000 7fbfb659c640 1 --2- 172.21.15.19:0/1411246896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb8162060 0x7fbfb80b5f70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbfa00097a0 tx=0x7fbfa002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7404788c52fc7d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.894+0000 7fbfb5d9b640 1 -- 172.21.15.19:0/1411246896 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0037070 con 0x7fbfb8162060 2024-09-12T02:07:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.894+0000 7fbfb5d9b640 1 -- 172.21.15.19:0/1411246896 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa0032440 con 0x7fbfb8162060 2024-09-12T02:07:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.894+0000 7fbfb5d9b640 1 -- 172.21.15.19:0/1411246896 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa00327f0 con 0x7fbfb8162060 2024-09-12T02:07:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.894+0000 7fbfbd0d0640 1 -- 172.21.15.19:0/1411246896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb8162060 msgr2=0x7fbfb80b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.894+0000 7fbfbd0d0640 1 --2- 172.21.15.19:0/1411246896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb8162060 0x7fbfb80b5f70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbfa00097a0 tx=0x7fbfa002a180 comp rx=0 tx=0).stop 2024-09-12T02:07:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.895+0000 7fbfbd0d0640 1 -- 172.21.15.19:0/1411246896 shutdown_connections 2024-09-12T02:07:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.895+0000 7fbfbd0d0640 1 --2- 172.21.15.19:0/1411246896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb8162060 0x7fbfb80b5f70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.895+0000 7fbfbd0d0640 1 --2- 172.21.15.19:0/1411246896 >> v2:172.21.15.135:3300/0 conn(0x7fbfb80b64b0 0x7fbfb80b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.895+0000 7fbfbd0d0640 1 -- 172.21.15.19:0/1411246896 >> 172.21.15.19:0/1411246896 conn(0x7fbfb80d44f0 msgr2=0x7fbfb80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:09.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.895+0000 7fbfbd0d0640 1 -- 172.21.15.19:0/1411246896 shutdown_connections 2024-09-12T02:07:09.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.895+0000 7fbfbd0d0640 1 -- 172.21.15.19:0/1411246896 wait complete. 2024-09-12T02:07:09.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.896+0000 7fbfbd0d0640 1 Processor -- start 2024-09-12T02:07:09.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.896+0000 7fbfbd0d0640 1 -- start start 2024-09-12T02:07:09.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.897+0000 7fbfbd0d0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfb80b64b0 0x7fbfb8159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.897+0000 7fbfbd0d0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb8161c80 0x7fbfb80b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.897+0000 7fbfbd0d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfb8162060 0x7fbfb80b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.897+0000 7fbfbd0d0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb80cf1e0 con 0x7fbfb8162060 2024-09-12T02:07:09.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.897+0000 7fbfbd0d0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb80d2aa0 con 0x7fbfb80b64b0 2024-09-12T02:07:09.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.897+0000 7fbfbd0d0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb80cf360 con 0x7fbfb8161c80 2024-09-12T02:07:09.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.897+0000 7fbfb759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfb8162060 0x7fbfb80b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.897+0000 7fbfb759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfb8162060 0x7fbfb80b2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54786/0 (socket says 172.21.15.19:54786) 2024-09-12T02:07:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.897+0000 7fbfb759e640 1 -- 172.21.15.19:0/2131951601 learned_addr learned my addr 172.21.15.19:0/2131951601 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.897+0000 7fbfb6d9d640 1 --2- 172.21.15.19:0/2131951601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfb80b64b0 0x7fbfb8159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.897+0000 7fbfb659c640 1 --2- 172.21.15.19:0/2131951601 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb8161c80 0x7fbfb80b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.897+0000 7fbfb759e640 1 -- 172.21.15.19:0/2131951601 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb8161c80 msgr2=0x7fbfb80b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.897+0000 7fbfb759e640 1 --2- 172.21.15.19:0/2131951601 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb8161c80 0x7fbfb80b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.897+0000 7fbfb759e640 1 -- 172.21.15.19:0/2131951601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfb80b64b0 msgr2=0x7fbfb8159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.897+0000 7fbfb759e640 1 --2- 172.21.15.19:0/2131951601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfb80b64b0 0x7fbfb8159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.897+0000 7fbfb759e640 1 -- 172.21.15.19:0/2131951601 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb80b94c0 con 0x7fbfb8162060 2024-09-12T02:07:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.897+0000 7fbfb6d9d640 1 --2- 172.21.15.19:0/2131951601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfb80b64b0 0x7fbfb8159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.898+0000 7fbfb759e640 1 --2- 172.21.15.19:0/2131951601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfb8162060 0x7fbfb80b2720 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800e930 tx=0x7fbfa800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.898+0000 7fbfaf7fe640 1 -- 172.21.15.19:0/2131951601 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8017070 con 0x7fbfb8162060 2024-09-12T02:07:09.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.898+0000 7fbfaf7fe640 1 -- 172.21.15.19:0/2131951601 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa800ca00 con 0x7fbfb8162060 2024-09-12T02:07:09.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.898+0000 7fbfbd0d0640 1 -- 172.21.15.19:0/2131951601 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb80b97a0 con 0x7fbfb8162060 2024-09-12T02:07:09.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.898+0000 7fbfaf7fe640 1 -- 172.21.15.19:0/2131951601 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa800cdd0 con 0x7fbfb8162060 2024-09-12T02:07:09.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.898+0000 7fbfbd0d0640 1 -- 172.21.15.19:0/2131951601 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb80b9d60 con 0x7fbfb8162060 2024-09-12T02:07:09.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.899+0000 7fbfbd0d0640 1 -- 172.21.15.19:0/2131951601 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb80b5f70 con 0x7fbfb8162060 2024-09-12T02:07:09.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.899+0000 7fbfaf7fe640 1 -- 172.21.15.19:0/2131951601 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbfa8013470 con 0x7fbfb8162060 2024-09-12T02:07:09.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.900+0000 7fbfaf7fe640 1 --2- 172.21.15.19:0/2131951601 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf9806be60 0x7fbf9806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.900+0000 7fbfaf7fe640 1 -- 172.21.15.19:0/2131951601 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6101+0+0 (secure 0 0 0) 0x7fbfa808ae30 con 0x7fbfb8162060 2024-09-12T02:07:09.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.900+0000 7fbfb6d9d640 1 --2- 172.21.15.19:0/2131951601 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf9806be60 0x7fbf9806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.900+0000 7fbfb6d9d640 1 --2- 172.21.15.19:0/2131951601 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf9806be60 0x7fbf9806e320 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0005c00 tx=0x7fbfb0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:09.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:09.904+0000 7fbfaf7fe640 1 -- 172.21.15.19:0/2131951601 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbfa80590c0 con 0x7fbfb8162060 2024-09-12T02:07:10.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.078+0000 7fbfbd0d0640 1 -- 172.21.15.19:0/2131951601 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbfb80ba470 con 0x7fbf9806be60 2024-09-12T02:07:10.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.084+0000 7fbfaf7fe640 1 -- 172.21.15.19:0/2131951601 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248403 (secure 0 0 0) 0x7fbfb80ba470 con 0x7fbf9806be60 2024-09-12T02:07:10.087 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:10.088 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T02:07:10.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.087+0000 7fbfbd0d0640 1 -- 172.21.15.19:0/2131951601 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf9806be60 msgr2=0x7fbf9806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.087+0000 7fbfbd0d0640 1 --2- 172.21.15.19:0/2131951601 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf9806be60 0x7fbf9806e320 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0005c00 tx=0x7fbfb0009040 comp rx=0 tx=0).stop 2024-09-12T02:07:10.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.087+0000 7fbfbd0d0640 1 -- 172.21.15.19:0/2131951601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfb8162060 msgr2=0x7fbfb80b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.087+0000 7fbfbd0d0640 1 --2- 172.21.15.19:0/2131951601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfb8162060 0x7fbfb80b2720 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800e930 tx=0x7fbfa800edf0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.087+0000 7fbfbd0d0640 1 -- 172.21.15.19:0/2131951601 shutdown_connections 2024-09-12T02:07:10.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.087+0000 7fbfbd0d0640 1 --2- 172.21.15.19:0/2131951601 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fbf9806be60 0x7fbf9806e320 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.087+0000 7fbfbd0d0640 1 --2- 172.21.15.19:0/2131951601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfb8162060 0x7fbfb80b2720 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.087+0000 7fbfbd0d0640 1 --2- 172.21.15.19:0/2131951601 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb8161c80 0x7fbfb80b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.087+0000 7fbfbd0d0640 1 --2- 172.21.15.19:0/2131951601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfb80b64b0 0x7fbfb8159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.087+0000 7fbfbd0d0640 1 -- 172.21.15.19:0/2131951601 >> 172.21.15.19:0/2131951601 conn(0x7fbfb80d44f0 msgr2=0x7fbfb80746d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:10.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.087+0000 7fbfbd0d0640 1 -- 172.21.15.19:0/2131951601 shutdown_connections 2024-09-12T02:07:10.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.087+0000 7fbfbd0d0640 1 -- 172.21.15.19:0/2131951601 wait complete. 2024-09-12T02:07:10.098 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":481,"stamp":"2024-09-12T02:07:08.252057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":152,"acting":152,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":298520,"kb_used_data":15704,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754676200,"statfs":{"total":773094113280,"available":772788428800,"internally_reserved":0,"allocated":16080896,"data_stored":8730651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.103356"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164699+0000","last_change":"2024-09-12T02:07:06.188562+0000","last_active":"2024-09-12T02:07:07.164699+0000","last_peered":"2024-09-12T02:07:07.164699+0000","last_clean":"2024-09-12T02:07:07.164699+0000","last_became_active":"2024-09-12T02:07:06.188181+0000","last_became_peered":"2024-09-12T02:07:06.188181+0000","last_unstale":"2024-09-12T02:07:07.164699+0000","last_undegraded":"2024-09-12T02:07:07.164699+0000","last_fullsized":"2024-09-12T02:07:07.164699+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:30.948775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164673+0000","last_change":"2024-09-12T02:07:06.181043+0000","last_active":"2024-09-12T02:07:07.164673+0000","last_peered":"2024-09-12T02:07:07.164673+0000","last_clean":"2024-09-12T02:07:07.164673+0000","last_became_active":"2024-09-12T02:07:06.180739+0000","last_became_peered":"2024-09-12T02:07:06.180739+0000","last_unstale":"2024-09-12T02:07:07.164673+0000","last_undegraded":"2024-09-12T02:07:07.164673+0000","last_fullsized":"2024-09-12T02:07:07.164673+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:59.243937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188462+0000","last_change":"2024-09-12T02:07:06.182365+0000","last_active":"2024-09-12T02:07:06.188462+0000","last_peered":"2024-09-12T02:07:06.188462+0000","last_clean":"2024-09-12T02:07:06.188462+0000","last_became_active":"2024-09-12T02:07:06.182017+0000","last_became_peered":"2024-09-12T02:07:06.182017+0000","last_unstale":"2024-09-12T02:07:06.188462+0000","last_undegraded":"2024-09-12T02:07:06.188462+0000","last_fullsized":"2024-09-12T02:07:06.188462+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:23.103898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.159991+0000","last_change":"2024-09-12T02:07:06.174721+0000","last_active":"2024-09-12T02:07:07.159991+0000","last_peered":"2024-09-12T02:07:07.159991+0000","last_clean":"2024-09-12T02:07:07.159991+0000","last_became_active":"2024-09-12T02:07:06.174396+0000","last_became_peered":"2024-09-12T02:07:06.174396+0000","last_unstale":"2024-09-12T02:07:07.159991+0000","last_undegraded":"2024-09-12T02:07:07.159991+0000","last_fullsized":"2024-09-12T02:07:07.159991+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:38.012619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.191811+0000","last_change":"2024-09-12T02:07:06.187847+0000","last_active":"2024-09-12T02:07:06.191811+0000","last_peered":"2024-09-12T02:07:06.191811+0000","last_clean":"2024-09-12T02:07:06.191811+0000","last_became_active":"2024-09-12T02:07:06.187330+0000","last_became_peered":"2024-09-12T02:07:06.187330+0000","last_unstale":"2024-09-12T02:07:06.191811+0000","last_undegraded":"2024-09-12T02:07:06.191811+0000","last_fullsized":"2024-09-12T02:07:06.191811+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:57.702135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160269+0000","last_change":"2024-09-12T02:07:06.165191+0000","last_active":"2024-09-12T02:07:07.160269+0000","last_peered":"2024-09-12T02:07:07.160269+0000","last_clean":"2024-09-12T02:07:07.160269+0000","last_became_active":"2024-09-12T02:07:06.164894+0000","last_became_peered":"2024-09-12T02:07:06.164894+0000","last_unstale":"2024-09-12T02:07:07.160269+0000","last_undegraded":"2024-09-12T02:07:07.160269+0000","last_fullsized":"2024-09-12T02:07:07.160269+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:51.780792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161745+0000","last_change":"2024-09-12T02:07:06.170696+0000","last_active":"2024-09-12T02:07:07.161745+0000","last_peered":"2024-09-12T02:07:07.161745+0000","last_clean":"2024-09-12T02:07:07.161745+0000","last_became_active":"2024-09-12T02:07:06.170368+0000","last_became_peered":"2024-09-12T02:07:06.170368+0000","last_unstale":"2024-09-12T02:07:07.161745+0000","last_undegraded":"2024-09-12T02:07:07.161745+0000","last_fullsized":"2024-09-12T02:07:07.161745+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:57.778187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.185408+0000","last_change":"2024-09-12T02:07:06.181857+0000","last_active":"2024-09-12T02:07:06.185408+0000","last_peered":"2024-09-12T02:07:06.185408+0000","last_clean":"2024-09-12T02:07:06.185408+0000","last_became_active":"2024-09-12T02:07:06.181467+0000","last_became_peered":"2024-09-12T02:07:06.181467+0000","last_unstale":"2024-09-12T02:07:06.185408+0000","last_undegraded":"2024-09-12T02:07:06.185408+0000","last_fullsized":"2024-09-12T02:07:06.185408+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:56.597134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164742+0000","last_change":"2024-09-12T02:07:06.180361+0000","last_active":"2024-09-12T02:07:07.164742+0000","last_peered":"2024-09-12T02:07:07.164742+0000","last_clean":"2024-09-12T02:07:07.164742+0000","last_became_active":"2024-09-12T02:07:06.180017+0000","last_became_peered":"2024-09-12T02:07:06.180017+0000","last_unstale":"2024-09-12T02:07:07.164742+0000","last_undegraded":"2024-09-12T02:07:07.164742+0000","last_fullsized":"2024-09-12T02:07:07.164742+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:30.553159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164694+0000","last_change":"2024-09-12T02:07:06.184058+0000","last_active":"2024-09-12T02:07:07.164694+0000","last_peered":"2024-09-12T02:07:07.164694+0000","last_clean":"2024-09-12T02:07:07.164694+0000","last_became_active":"2024-09-12T02:07:06.183753+0000","last_became_peered":"2024-09-12T02:07:06.183753+0000","last_unstale":"2024-09-12T02:07:07.164694+0000","last_undegraded":"2024-09-12T02:07:07.164694+0000","last_fullsized":"2024-09-12T02:07:07.164694+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:58.979849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162191+0000","last_change":"2024-09-12T02:07:06.173004+0000","last_active":"2024-09-12T02:07:07.162191+0000","last_peered":"2024-09-12T02:07:07.162191+0000","last_clean":"2024-09-12T02:07:07.162191+0000","last_became_active":"2024-09-12T02:07:06.172715+0000","last_became_peered":"2024-09-12T02:07:06.172715+0000","last_unstale":"2024-09-12T02:07:07.162191+0000","last_undegraded":"2024-09-12T02:07:07.162191+0000","last_fullsized":"2024-09-12T02:07:07.162191+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:42.705993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.179326+0000","last_change":"2024-09-12T02:07:06.177889+0000","last_active":"2024-09-12T02:07:06.179326+0000","last_peered":"2024-09-12T02:07:06.179326+0000","last_clean":"2024-09-12T02:07:06.179326+0000","last_became_active":"2024-09-12T02:07:06.177498+0000","last_became_peered":"2024-09-12T02:07:06.177498+0000","last_unstale":"2024-09-12T02:07:06.179326+0000","last_undegraded":"2024-09-12T02:07:06.179326+0000","last_fullsized":"2024-09-12T02:07:06.179326+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:40.200757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160079+0000","last_change":"2024-09-12T02:07:06.185065+0000","last_active":"2024-09-12T02:07:07.160079+0000","last_peered":"2024-09-12T02:07:07.160079+0000","last_clean":"2024-09-12T02:07:07.160079+0000","last_became_active":"2024-09-12T02:07:06.184779+0000","last_became_peered":"2024-09-12T02:07:06.184779+0000","last_unstale":"2024-09-12T02:07:07.160079+0000","last_undegraded":"2024-09-12T02:07:07.160079+0000","last_fullsized":"2024-09-12T02:07:07.160079+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:13.412294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164498+0000","last_change":"2024-09-12T02:07:06.180301+0000","last_active":"2024-09-12T02:07:07.164498+0000","last_peered":"2024-09-12T02:07:07.164498+0000","last_clean":"2024-09-12T02:07:07.164498+0000","last_became_active":"2024-09-12T02:07:06.179930+0000","last_became_peered":"2024-09-12T02:07:06.179930+0000","last_unstale":"2024-09-12T02:07:07.164498+0000","last_undegraded":"2024-09-12T02:07:07.164498+0000","last_fullsized":"2024-09-12T02:07:07.164498+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:29.743856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160141+0000","last_change":"2024-09-12T02:07:06.173860+0000","last_active":"2024-09-12T02:07:07.160141+0000","last_peered":"2024-09-12T02:07:07.160141+0000","last_clean":"2024-09-12T02:07:07.160141+0000","last_became_active":"2024-09-12T02:07:06.173507+0000","last_became_peered":"2024-09-12T02:07:06.173507+0000","last_unstale":"2024-09-12T02:07:07.160141+0000","last_undegraded":"2024-09-12T02:07:07.160141+0000","last_fullsized":"2024-09-12T02:07:07.160141+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:55.442840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161259+0000","last_change":"2024-09-12T02:07:06.183545+0000","last_active":"2024-09-12T02:07:07.161259+0000","last_peered":"2024-09-12T02:07:07.161259+0000","last_clean":"2024-09-12T02:07:07.161259+0000","last_became_active":"2024-09-12T02:07:06.180674+0000","last_became_peered":"2024-09-12T02:07:06.180674+0000","last_unstale":"2024-09-12T02:07:07.161259+0000","last_undegraded":"2024-09-12T02:07:07.161259+0000","last_fullsized":"2024-09-12T02:07:07.161259+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:23.067644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161179+0000","last_change":"2024-09-12T02:07:06.171797+0000","last_active":"2024-09-12T02:07:07.161179+0000","last_peered":"2024-09-12T02:07:07.161179+0000","last_clean":"2024-09-12T02:07:07.161179+0000","last_became_active":"2024-09-12T02:07:06.171513+0000","last_became_peered":"2024-09-12T02:07:06.171513+0000","last_unstale":"2024-09-12T02:07:07.161179+0000","last_undegraded":"2024-09-12T02:07:07.161179+0000","last_fullsized":"2024-09-12T02:07:07.161179+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:58.954857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.179305+0000","last_change":"2024-09-12T02:07:06.177320+0000","last_active":"2024-09-12T02:07:06.179305+0000","last_peered":"2024-09-12T02:07:06.179305+0000","last_clean":"2024-09-12T02:07:06.179305+0000","last_became_active":"2024-09-12T02:07:06.176959+0000","last_became_peered":"2024-09-12T02:07:06.176959+0000","last_unstale":"2024-09-12T02:07:06.179305+0000","last_undegraded":"2024-09-12T02:07:06.179305+0000","last_fullsized":"2024-09-12T02:07:06.179305+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:02.600481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161419+0000","last_change":"2024-09-12T02:07:06.178211+0000","last_active":"2024-09-12T02:07:07.161419+0000","last_peered":"2024-09-12T02:07:07.161419+0000","last_clean":"2024-09-12T02:07:07.161419+0000","last_became_active":"2024-09-12T02:07:06.177168+0000","last_became_peered":"2024-09-12T02:07:06.177168+0000","last_unstale":"2024-09-12T02:07:07.161419+0000","last_undegraded":"2024-09-12T02:07:07.161419+0000","last_fullsized":"2024-09-12T02:07:07.161419+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:26.784396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.191783+0000","last_change":"2024-09-12T02:07:06.187602+0000","last_active":"2024-09-12T02:07:06.191783+0000","last_peered":"2024-09-12T02:07:06.191783+0000","last_clean":"2024-09-12T02:07:06.191783+0000","last_became_active":"2024-09-12T02:07:06.186930+0000","last_became_peered":"2024-09-12T02:07:06.186930+0000","last_unstale":"2024-09-12T02:07:06.191783+0000","last_undegraded":"2024-09-12T02:07:06.191783+0000","last_fullsized":"2024-09-12T02:07:06.191783+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:50.021035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164540+0000","last_change":"2024-09-12T02:07:06.182081+0000","last_active":"2024-09-12T02:07:07.164540+0000","last_peered":"2024-09-12T02:07:07.164540+0000","last_clean":"2024-09-12T02:07:07.164540+0000","last_became_active":"2024-09-12T02:07:06.181774+0000","last_became_peered":"2024-09-12T02:07:06.181774+0000","last_unstale":"2024-09-12T02:07:07.164540+0000","last_undegraded":"2024-09-12T02:07:07.164540+0000","last_fullsized":"2024-09-12T02:07:07.164540+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:41.166247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"144'4","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.187015+0000","last_change":"2024-09-12T02:07:05.168735+0000","last_active":"2024-09-12T02:07:06.187015+0000","last_peered":"2024-09-12T02:07:06.187015+0000","last_clean":"2024-09-12T02:07:06.187015+0000","last_became_active":"2024-09-12T02:07:05.168378+0000","last_became_peered":"2024-09-12T02:07:05.168378+0000","last_unstale":"2024-09-12T02:07:06.187015+0000","last_undegraded":"2024-09-12T02:07:06.187015+0000","last_fullsized":"2024-09-12T02:07:06.187015+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:56.775704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.192885+0000","last_change":"2024-09-12T02:07:06.189264+0000","last_active":"2024-09-12T02:07:06.192885+0000","last_peered":"2024-09-12T02:07:06.192885+0000","last_clean":"2024-09-12T02:07:06.192885+0000","last_became_active":"2024-09-12T02:07:06.188784+0000","last_became_peered":"2024-09-12T02:07:06.188784+0000","last_unstale":"2024-09-12T02:07:06.192885+0000","last_undegraded":"2024-09-12T02:07:06.192885+0000","last_fullsized":"2024-09-12T02:07:06.192885+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:47.546176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"144'1","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188900+0000","last_change":"2024-09-12T02:07:05.178805+0000","last_active":"2024-09-12T02:07:06.188900+0000","last_peered":"2024-09-12T02:07:06.188900+0000","last_clean":"2024-09-12T02:07:06.188900+0000","last_became_active":"2024-09-12T02:07:05.178340+0000","last_became_peered":"2024-09-12T02:07:05.178340+0000","last_unstale":"2024-09-12T02:07:06.188900+0000","last_undegraded":"2024-09-12T02:07:06.188900+0000","last_fullsized":"2024-09-12T02:07:06.188900+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:30.323418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161537+0000","last_change":"2024-09-12T02:07:06.170078+0000","last_active":"2024-09-12T02:07:07.161537+0000","last_peered":"2024-09-12T02:07:07.161537+0000","last_clean":"2024-09-12T02:07:07.161537+0000","last_became_active":"2024-09-12T02:07:06.169626+0000","last_became_peered":"2024-09-12T02:07:06.169626+0000","last_unstale":"2024-09-12T02:07:07.161537+0000","last_undegraded":"2024-09-12T02:07:07.161537+0000","last_fullsized":"2024-09-12T02:07:07.161537+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:02.746428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161354+0000","last_change":"2024-09-12T02:07:05.173497+0000","last_active":"2024-09-12T02:07:07.161354+0000","last_peered":"2024-09-12T02:07:07.161354+0000","last_clean":"2024-09-12T02:07:07.161354+0000","last_became_active":"2024-09-12T02:07:05.173240+0000","last_became_peered":"2024-09-12T02:07:05.173240+0000","last_unstale":"2024-09-12T02:07:07.161354+0000","last_undegraded":"2024-09-12T02:07:07.161354+0000","last_fullsized":"2024-09-12T02:07:07.161354+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:45.930215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160093+0000","last_change":"2024-09-12T02:07:05.174789+0000","last_active":"2024-09-12T02:07:07.160093+0000","last_peered":"2024-09-12T02:07:07.160093+0000","last_clean":"2024-09-12T02:07:07.160093+0000","last_became_active":"2024-09-12T02:07:05.174498+0000","last_became_peered":"2024-09-12T02:07:05.174498+0000","last_unstale":"2024-09-12T02:07:07.160093+0000","last_undegraded":"2024-09-12T02:07:07.160093+0000","last_fullsized":"2024-09-12T02:07:07.160093+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:39.219875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188440+0000","last_change":"2024-09-12T02:07:06.182146+0000","last_active":"2024-09-12T02:07:06.188440+0000","last_peered":"2024-09-12T02:07:06.188440+0000","last_clean":"2024-09-12T02:07:06.188440+0000","last_became_active":"2024-09-12T02:07:06.181487+0000","last_became_peered":"2024-09-12T02:07:06.181487+0000","last_unstale":"2024-09-12T02:07:06.188440+0000","last_undegraded":"2024-09-12T02:07:06.188440+0000","last_fullsized":"2024-09-12T02:07:06.188440+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:43.216454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.151998+0000","last_change":"2024-09-12T02:07:04.151998+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.151998+0000","last_undegraded":"2024-09-12T02:07:04.151998+0000","last_fullsized":"2024-09-12T02:07:04.151998+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164914+0000","last_change":"2024-09-12T02:07:06.180769+0000","last_active":"2024-09-12T02:07:07.164914+0000","last_peered":"2024-09-12T02:07:07.164914+0000","last_clean":"2024-09-12T02:07:07.164914+0000","last_became_active":"2024-09-12T02:07:06.180488+0000","last_became_peered":"2024-09-12T02:07:06.180488+0000","last_unstale":"2024-09-12T02:07:07.164914+0000","last_undegraded":"2024-09-12T02:07:07.164914+0000","last_fullsized":"2024-09-12T02:07:07.164914+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:53.889287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.156493+0000","last_change":"2024-09-12T02:07:04.156493+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.156493+0000","last_undegraded":"2024-09-12T02:07:04.156493+0000","last_fullsized":"2024-09-12T02:07:04.156493+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161246+0000","last_change":"2024-09-12T02:07:05.169281+0000","last_active":"2024-09-12T02:07:07.161246+0000","last_peered":"2024-09-12T02:07:07.161246+0000","last_clean":"2024-09-12T02:07:07.161246+0000","last_became_active":"2024-09-12T02:07:05.169013+0000","last_became_peered":"2024-09-12T02:07:05.169013+0000","last_unstale":"2024-09-12T02:07:07.161246+0000","last_undegraded":"2024-09-12T02:07:07.161246+0000","last_fullsized":"2024-09-12T02:07:07.161246+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:35.627376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.189655+0000","last_change":"2024-09-12T02:07:06.185740+0000","last_active":"2024-09-12T02:07:06.189655+0000","last_peered":"2024-09-12T02:07:06.189655+0000","last_clean":"2024-09-12T02:07:06.189655+0000","last_became_active":"2024-09-12T02:07:06.185464+0000","last_became_peered":"2024-09-12T02:07:06.185464+0000","last_unstale":"2024-09-12T02:07:06.189655+0000","last_undegraded":"2024-09-12T02:07:06.189655+0000","last_fullsized":"2024-09-12T02:07:06.189655+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:03.123101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.167409+0000","last_change":"2024-09-12T02:07:05.171827+0000","last_active":"2024-09-12T02:07:06.167409+0000","last_peered":"2024-09-12T02:07:06.167409+0000","last_clean":"2024-09-12T02:07:06.167409+0000","last_became_active":"2024-09-12T02:07:05.170929+0000","last_became_peered":"2024-09-12T02:07:05.170929+0000","last_unstale":"2024-09-12T02:07:06.167409+0000","last_undegraded":"2024-09-12T02:07:06.167409+0000","last_fullsized":"2024-09-12T02:07:06.167409+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:25.781913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164699+0000","last_change":"2024-09-12T02:07:06.182831+0000","last_active":"2024-09-12T02:07:07.164699+0000","last_peered":"2024-09-12T02:07:07.164699+0000","last_clean":"2024-09-12T02:07:07.164699+0000","last_became_active":"2024-09-12T02:07:06.182547+0000","last_became_peered":"2024-09-12T02:07:06.182547+0000","last_unstale":"2024-09-12T02:07:07.164699+0000","last_undegraded":"2024-09-12T02:07:07.164699+0000","last_fullsized":"2024-09-12T02:07:07.164699+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:46.521663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161205+0000","last_change":"2024-09-12T02:07:05.170472+0000","last_active":"2024-09-12T02:07:07.161205+0000","last_peered":"2024-09-12T02:07:07.161205+0000","last_clean":"2024-09-12T02:07:07.161205+0000","last_became_active":"2024-09-12T02:07:05.170230+0000","last_became_peered":"2024-09-12T02:07:05.170230+0000","last_unstale":"2024-09-12T02:07:07.161205+0000","last_undegraded":"2024-09-12T02:07:07.161205+0000","last_fullsized":"2024-09-12T02:07:07.161205+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:37.010136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.159884+0000","last_change":"2024-09-12T02:07:06.184089+0000","last_active":"2024-09-12T02:07:07.159884+0000","last_peered":"2024-09-12T02:07:07.159884+0000","last_clean":"2024-09-12T02:07:07.159884+0000","last_became_active":"2024-09-12T02:07:06.183803+0000","last_became_peered":"2024-09-12T02:07:06.183803+0000","last_unstale":"2024-09-12T02:07:07.159884+0000","last_undegraded":"2024-09-12T02:07:07.159884+0000","last_fullsized":"2024-09-12T02:07:07.159884+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:46.932699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164723+0000","last_change":"2024-09-12T02:07:05.169627+0000","last_active":"2024-09-12T02:07:07.164723+0000","last_peered":"2024-09-12T02:07:07.164723+0000","last_clean":"2024-09-12T02:07:07.164723+0000","last_became_active":"2024-09-12T02:07:05.169351+0000","last_became_peered":"2024-09-12T02:07:05.169351+0000","last_unstale":"2024-09-12T02:07:07.164723+0000","last_undegraded":"2024-09-12T02:07:07.164723+0000","last_fullsized":"2024-09-12T02:07:07.164723+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:16.639255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188132+0000","last_change":"2024-09-12T02:07:06.185105+0000","last_active":"2024-09-12T02:07:06.188132+0000","last_peered":"2024-09-12T02:07:06.188132+0000","last_clean":"2024-09-12T02:07:06.188132+0000","last_became_active":"2024-09-12T02:07:06.184834+0000","last_became_peered":"2024-09-12T02:07:06.184834+0000","last_unstale":"2024-09-12T02:07:06.188132+0000","last_undegraded":"2024-09-12T02:07:06.188132+0000","last_fullsized":"2024-09-12T02:07:06.188132+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:32.847267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.151821+0000","last_change":"2024-09-12T02:07:04.151821+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.151821+0000","last_undegraded":"2024-09-12T02:07:04.151821+0000","last_fullsized":"2024-09-12T02:07:04.151821+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160149+0000","last_change":"2024-09-12T02:07:06.185464+0000","last_active":"2024-09-12T02:07:07.160149+0000","last_peered":"2024-09-12T02:07:07.160149+0000","last_clean":"2024-09-12T02:07:07.160149+0000","last_became_active":"2024-09-12T02:07:06.184939+0000","last_became_peered":"2024-09-12T02:07:06.184939+0000","last_unstale":"2024-09-12T02:07:07.160149+0000","last_undegraded":"2024-09-12T02:07:07.160149+0000","last_fullsized":"2024-09-12T02:07:07.160149+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:43.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.150584+0000","last_change":"2024-09-12T02:07:04.150584+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.150584+0000","last_undegraded":"2024-09-12T02:07:04.150584+0000","last_fullsized":"2024-09-12T02:07:04.150584+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160245+0000","last_change":"2024-09-12T02:07:05.180245+0000","last_active":"2024-09-12T02:07:07.160245+0000","last_peered":"2024-09-12T02:07:07.160245+0000","last_clean":"2024-09-12T02:07:07.160245+0000","last_became_active":"2024-09-12T02:07:05.179890+0000","last_became_peered":"2024-09-12T02:07:05.179890+0000","last_unstale":"2024-09-12T02:07:07.160245+0000","last_undegraded":"2024-09-12T02:07:07.160245+0000","last_fullsized":"2024-09-12T02:07:07.160245+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:26.126486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.167494+0000","last_change":"2024-09-12T02:07:05.170442+0000","last_active":"2024-09-12T02:07:06.167494+0000","last_peered":"2024-09-12T02:07:06.167494+0000","last_clean":"2024-09-12T02:07:06.167494+0000","last_became_active":"2024-09-12T02:07:05.170143+0000","last_became_peered":"2024-09-12T02:07:05.170143+0000","last_unstale":"2024-09-12T02:07:06.167494+0000","last_undegraded":"2024-09-12T02:07:06.167494+0000","last_fullsized":"2024-09-12T02:07:06.167494+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:01.743945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.189010+0000","last_change":"2024-09-12T02:07:06.186466+0000","last_active":"2024-09-12T02:07:06.189010+0000","last_peered":"2024-09-12T02:07:06.189010+0000","last_clean":"2024-09-12T02:07:06.189010+0000","last_became_active":"2024-09-12T02:07:06.186144+0000","last_became_peered":"2024-09-12T02:07:06.186144+0000","last_unstale":"2024-09-12T02:07:06.189010+0000","last_undegraded":"2024-09-12T02:07:06.189010+0000","last_fullsized":"2024-09-12T02:07:06.189010+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:20.906453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.172327+0000","last_change":"2024-09-12T02:07:05.181325+0000","last_active":"2024-09-12T02:07:06.172327+0000","last_peered":"2024-09-12T02:07:06.172327+0000","last_clean":"2024-09-12T02:07:06.172327+0000","last_became_active":"2024-09-12T02:07:05.181048+0000","last_became_peered":"2024-09-12T02:07:05.181048+0000","last_unstale":"2024-09-12T02:07:06.172327+0000","last_undegraded":"2024-09-12T02:07:06.172327+0000","last_fullsized":"2024-09-12T02:07:06.172327+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:04.428549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164859+0000","last_change":"2024-09-12T02:07:06.180329+0000","last_active":"2024-09-12T02:07:07.164859+0000","last_peered":"2024-09-12T02:07:07.164859+0000","last_clean":"2024-09-12T02:07:07.164859+0000","last_became_active":"2024-09-12T02:07:06.179876+0000","last_became_peered":"2024-09-12T02:07:06.179876+0000","last_unstale":"2024-09-12T02:07:07.164859+0000","last_undegraded":"2024-09-12T02:07:07.164859+0000","last_fullsized":"2024-09-12T02:07:07.164859+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:47.471652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"144'8","reported_seq":22,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160927+0000","last_change":"2024-09-12T02:07:05.173863+0000","last_active":"2024-09-12T02:07:07.160927+0000","last_peered":"2024-09-12T02:07:07.160927+0000","last_clean":"2024-09-12T02:07:07.160927+0000","last_became_active":"2024-09-12T02:07:05.173135+0000","last_became_peered":"2024-09-12T02:07:05.173135+0000","last_unstale":"2024-09-12T02:07:07.160927+0000","last_undegraded":"2024-09-12T02:07:07.160927+0000","last_fullsized":"2024-09-12T02:07:07.160927+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:25.840163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188208+0000","last_change":"2024-09-12T02:07:06.183288+0000","last_active":"2024-09-12T02:07:06.188208+0000","last_peered":"2024-09-12T02:07:06.188208+0000","last_clean":"2024-09-12T02:07:06.188208+0000","last_became_active":"2024-09-12T02:07:06.182990+0000","last_became_peered":"2024-09-12T02:07:06.182990+0000","last_unstale":"2024-09-12T02:07:06.188208+0000","last_undegraded":"2024-09-12T02:07:06.188208+0000","last_fullsized":"2024-09-12T02:07:06.188208+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:11.283654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.150433+0000","last_change":"2024-09-12T02:07:04.150433+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.150433+0000","last_undegraded":"2024-09-12T02:07:04.150433+0000","last_fullsized":"2024-09-12T02:07:04.150433+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.151312+0000","last_change":"2024-09-12T02:07:04.151312+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.151312+0000","last_undegraded":"2024-09-12T02:07:04.151312+0000","last_fullsized":"2024-09-12T02:07:04.151312+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160154+0000","last_change":"2024-09-12T02:07:06.175575+0000","last_active":"2024-09-12T02:07:07.160154+0000","last_peered":"2024-09-12T02:07:07.160154+0000","last_clean":"2024-09-12T02:07:07.160154+0000","last_became_active":"2024-09-12T02:07:06.175285+0000","last_became_peered":"2024-09-12T02:07:06.175285+0000","last_unstale":"2024-09-12T02:07:07.160154+0000","last_undegraded":"2024-09-12T02:07:07.160154+0000","last_fullsized":"2024-09-12T02:07:07.160154+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:54.606749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.156489+0000","last_change":"2024-09-12T02:07:04.156489+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.156489+0000","last_undegraded":"2024-09-12T02:07:04.156489+0000","last_fullsized":"2024-09-12T02:07:04.156489+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164691+0000","last_change":"2024-09-12T02:07:06.186836+0000","last_active":"2024-09-12T02:07:07.164691+0000","last_peered":"2024-09-12T02:07:07.164691+0000","last_clean":"2024-09-12T02:07:07.164691+0000","last_became_active":"2024-09-12T02:07:06.186490+0000","last_became_peered":"2024-09-12T02:07:06.186490+0000","last_unstale":"2024-09-12T02:07:07.164691+0000","last_undegraded":"2024-09-12T02:07:07.164691+0000","last_fullsized":"2024-09-12T02:07:07.164691+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:52.748269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"144'2","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.182591+0000","last_change":"2024-09-12T02:07:05.178914+0000","last_active":"2024-09-12T02:07:06.182591+0000","last_peered":"2024-09-12T02:07:06.182591+0000","last_clean":"2024-09-12T02:07:06.182591+0000","last_became_active":"2024-09-12T02:07:05.178630+0000","last_became_peered":"2024-09-12T02:07:05.178630+0000","last_unstale":"2024-09-12T02:07:06.182591+0000","last_undegraded":"2024-09-12T02:07:06.182591+0000","last_fullsized":"2024-09-12T02:07:06.182591+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:53.781606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164915+0000","last_change":"2024-09-12T02:07:06.172346+0000","last_active":"2024-09-12T02:07:07.164915+0000","last_peered":"2024-09-12T02:07:07.164915+0000","last_clean":"2024-09-12T02:07:07.164915+0000","last_became_active":"2024-09-12T02:07:06.171758+0000","last_became_peered":"2024-09-12T02:07:06.171758+0000","last_unstale":"2024-09-12T02:07:07.164915+0000","last_undegraded":"2024-09-12T02:07:07.164915+0000","last_fullsized":"2024-09-12T02:07:07.164915+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:57.712570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.170854+0000","last_change":"2024-09-12T02:07:05.181025+0000","last_active":"2024-09-12T02:07:06.170854+0000","last_peered":"2024-09-12T02:07:06.170854+0000","last_clean":"2024-09-12T02:07:06.170854+0000","last_became_active":"2024-09-12T02:07:05.180707+0000","last_became_peered":"2024-09-12T02:07:05.180707+0000","last_unstale":"2024-09-12T02:07:06.170854+0000","last_undegraded":"2024-09-12T02:07:06.170854+0000","last_fullsized":"2024-09-12T02:07:06.170854+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:51.480271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.181619+0000","last_change":"2024-09-12T02:07:06.175102+0000","last_active":"2024-09-12T02:07:06.181619+0000","last_peered":"2024-09-12T02:07:06.181619+0000","last_clean":"2024-09-12T02:07:06.181619+0000","last_became_active":"2024-09-12T02:07:06.174811+0000","last_became_peered":"2024-09-12T02:07:06.174811+0000","last_unstale":"2024-09-12T02:07:06.181619+0000","last_undegraded":"2024-09-12T02:07:06.181619+0000","last_fullsized":"2024-09-12T02:07:06.181619+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:48.029678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.151066+0000","last_change":"2024-09-12T02:07:04.151066+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.151066+0000","last_undegraded":"2024-09-12T02:07:04.151066+0000","last_fullsized":"2024-09-12T02:07:04.151066+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188982+0000","last_change":"2024-09-12T02:07:06.186018+0000","last_active":"2024-09-12T02:07:06.188982+0000","last_peered":"2024-09-12T02:07:06.188982+0000","last_clean":"2024-09-12T02:07:06.188982+0000","last_became_active":"2024-09-12T02:07:06.185734+0000","last_became_peered":"2024-09-12T02:07:06.185734+0000","last_unstale":"2024-09-12T02:07:06.188982+0000","last_undegraded":"2024-09-12T02:07:06.188982+0000","last_fullsized":"2024-09-12T02:07:06.188982+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:45.609305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.171753+0000","last_change":"2024-09-12T02:07:05.178455+0000","last_active":"2024-09-12T02:07:06.171753+0000","last_peered":"2024-09-12T02:07:06.171753+0000","last_clean":"2024-09-12T02:07:06.171753+0000","last_became_active":"2024-09-12T02:07:05.178133+0000","last_became_peered":"2024-09-12T02:07:05.178133+0000","last_unstale":"2024-09-12T02:07:06.171753+0000","last_undegraded":"2024-09-12T02:07:06.171753+0000","last_fullsized":"2024-09-12T02:07:06.171753+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:55.251394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164380+0000","last_change":"2024-09-12T02:07:06.184322+0000","last_active":"2024-09-12T02:07:07.164380+0000","last_peered":"2024-09-12T02:07:07.164380+0000","last_clean":"2024-09-12T02:07:07.164380+0000","last_became_active":"2024-09-12T02:07:06.184012+0000","last_became_peered":"2024-09-12T02:07:06.184012+0000","last_unstale":"2024-09-12T02:07:07.164380+0000","last_undegraded":"2024-09-12T02:07:07.164380+0000","last_fullsized":"2024-09-12T02:07:07.164380+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:36.512194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160218+0000","last_change":"2024-09-12T02:07:05.177856+0000","last_active":"2024-09-12T02:07:07.160218+0000","last_peered":"2024-09-12T02:07:07.160218+0000","last_clean":"2024-09-12T02:07:07.160218+0000","last_became_active":"2024-09-12T02:07:05.177540+0000","last_became_peered":"2024-09-12T02:07:05.177540+0000","last_unstale":"2024-09-12T02:07:07.160218+0000","last_undegraded":"2024-09-12T02:07:07.160218+0000","last_fullsized":"2024-09-12T02:07:07.160218+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:10.671601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161000+0000","last_change":"2024-09-12T02:07:06.166133+0000","last_active":"2024-09-12T02:07:07.161000+0000","last_peered":"2024-09-12T02:07:07.161000+0000","last_clean":"2024-09-12T02:07:07.161000+0000","last_became_active":"2024-09-12T02:07:06.165891+0000","last_became_peered":"2024-09-12T02:07:06.165891+0000","last_unstale":"2024-09-12T02:07:07.161000+0000","last_undegraded":"2024-09-12T02:07:07.161000+0000","last_fullsized":"2024-09-12T02:07:07.161000+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:57.379027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"145'1","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.165996+0000","last_change":"2024-09-12T02:07:05.168685+0000","last_active":"2024-09-12T02:07:07.165996+0000","last_peered":"2024-09-12T02:07:07.165996+0000","last_clean":"2024-09-12T02:07:07.165996+0000","last_became_active":"2024-09-12T02:07:05.168379+0000","last_became_peered":"2024-09-12T02:07:05.168379+0000","last_unstale":"2024-09-12T02:07:07.165996+0000","last_undegraded":"2024-09-12T02:07:07.165996+0000","last_fullsized":"2024-09-12T02:07:07.165996+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:55.479228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.181044+0000","last_change":"2024-09-12T02:07:06.168431+0000","last_active":"2024-09-12T02:07:06.181044+0000","last_peered":"2024-09-12T02:07:06.181044+0000","last_clean":"2024-09-12T02:07:06.181044+0000","last_became_active":"2024-09-12T02:07:06.168080+0000","last_became_peered":"2024-09-12T02:07:06.168080+0000","last_unstale":"2024-09-12T02:07:06.181044+0000","last_undegraded":"2024-09-12T02:07:06.181044+0000","last_fullsized":"2024-09-12T02:07:06.181044+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:42.705993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.150525+0000","last_change":"2024-09-12T02:07:04.150525+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.150525+0000","last_undegraded":"2024-09-12T02:07:04.150525+0000","last_fullsized":"2024-09-12T02:07:04.150525+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160105+0000","last_change":"2024-09-12T02:07:05.169123+0000","last_active":"2024-09-12T02:07:07.160105+0000","last_peered":"2024-09-12T02:07:07.160105+0000","last_clean":"2024-09-12T02:07:07.160105+0000","last_became_active":"2024-09-12T02:07:05.168828+0000","last_became_peered":"2024-09-12T02:07:05.168828+0000","last_unstale":"2024-09-12T02:07:07.160105+0000","last_undegraded":"2024-09-12T02:07:07.160105+0000","last_fullsized":"2024-09-12T02:07:07.160105+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:10.926179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188173+0000","last_change":"2024-09-12T02:07:06.184423+0000","last_active":"2024-09-12T02:07:06.188173+0000","last_peered":"2024-09-12T02:07:06.188173+0000","last_clean":"2024-09-12T02:07:06.188173+0000","last_became_active":"2024-09-12T02:07:06.184135+0000","last_became_peered":"2024-09-12T02:07:06.184135+0000","last_unstale":"2024-09-12T02:07:06.188173+0000","last_undegraded":"2024-09-12T02:07:06.188173+0000","last_fullsized":"2024-09-12T02:07:06.188173+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:24.456509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161457+0000","last_change":"2024-09-12T02:07:05.167597+0000","last_active":"2024-09-12T02:07:07.161457+0000","last_peered":"2024-09-12T02:07:07.161457+0000","last_clean":"2024-09-12T02:07:07.161457+0000","last_became_active":"2024-09-12T02:07:05.167331+0000","last_became_peered":"2024-09-12T02:07:05.167331+0000","last_unstale":"2024-09-12T02:07:07.161457+0000","last_undegraded":"2024-09-12T02:07:07.161457+0000","last_fullsized":"2024-09-12T02:07:07.161457+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:51.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.191710+0000","last_change":"2024-09-12T02:07:06.188417+0000","last_active":"2024-09-12T02:07:06.191710+0000","last_peered":"2024-09-12T02:07:06.191710+0000","last_clean":"2024-09-12T02:07:06.191710+0000","last_became_active":"2024-09-12T02:07:06.188130+0000","last_became_peered":"2024-09-12T02:07:06.188130+0000","last_unstale":"2024-09-12T02:07:06.191710+0000","last_undegraded":"2024-09-12T02:07:06.191710+0000","last_fullsized":"2024-09-12T02:07:06.191710+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:30.566436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.171063+0000","last_change":"2024-09-12T02:07:05.178730+0000","last_active":"2024-09-12T02:07:06.171063+0000","last_peered":"2024-09-12T02:07:06.171063+0000","last_clean":"2024-09-12T02:07:06.171063+0000","last_became_active":"2024-09-12T02:07:05.178430+0000","last_became_peered":"2024-09-12T02:07:05.178430+0000","last_unstale":"2024-09-12T02:07:06.171063+0000","last_undegraded":"2024-09-12T02:07:06.171063+0000","last_fullsized":"2024-09-12T02:07:06.171063+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:45.524547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-12T02:07:04.150434+0000","last_change":"2024-09-12T02:07:04.150434+0000","last_active":"2024-09-12T02:07:04.145634+0000","last_peered":"2024-09-12T02:07:04.145634+0000","last_clean":"2024-09-12T02:07:04.145634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:04.150434+0000","last_undegraded":"2024-09-12T02:07:04.150434+0000","last_fullsized":"2024-09-12T02:07:04.150434+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.171914+0000","last_change":"2024-09-12T02:07:05.179353+0000","last_active":"2024-09-12T02:07:06.171914+0000","last_peered":"2024-09-12T02:07:06.171914+0000","last_clean":"2024-09-12T02:07:06.171914+0000","last_became_active":"2024-09-12T02:07:05.178558+0000","last_became_peered":"2024-09-12T02:07:05.178558+0000","last_unstale":"2024-09-12T02:07:06.171914+0000","last_undegraded":"2024-09-12T02:07:06.171914+0000","last_fullsized":"2024-09-12T02:07:06.171914+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:39.636624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:07:05.148118+0000","last_change":"2024-09-12T02:07:05.148118+0000","last_active":"2024-09-12T02:07:05.148118+0000","last_peered":"2024-09-12T02:07:05.148118+0000","last_clean":"2024-09-12T02:07:05.148118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:07:05.148118+0000","last_undegraded":"2024-09-12T02:07:05.148118+0000","last_fullsized":"2024-09-12T02:07:05.148118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"144'2","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.190787+0000","last_change":"2024-09-12T02:07:05.179366+0000","last_active":"2024-09-12T02:07:06.190787+0000","last_peered":"2024-09-12T02:07:06.190787+0000","last_clean":"2024-09-12T02:07:06.190787+0000","last_became_active":"2024-09-12T02:07:05.179079+0000","last_became_peered":"2024-09-12T02:07:05.179079+0000","last_unstale":"2024-09-12T02:07:06.190787+0000","last_undegraded":"2024-09-12T02:07:06.190787+0000","last_fullsized":"2024-09-12T02:07:06.190787+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:43.865590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":401,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.151922+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T02:07:04.151922+0000","last_peered":"2024-09-12T02:07:04.151922+0000","last_clean":"2024-09-12T02:07:04.151922+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T02:07:04.151922+0000","last_undegraded":"2024-09-12T02:07:04.151922+0000","last_fullsized":"2024-09-12T02:07:04.151922+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":86,"acting":86,"num_store_stats":5},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509580,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37720,"kb_used_data":2368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334120,"statfs":{"total":96636764160,"available":96598138880,"internally_reserved":0,"allocated":2424832,"data_stored":1519602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41296,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330544,"statfs":{"total":96636764160,"available":96594477056,"internally_reserved":0,"allocated":1830912,"data_stored":929234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509580,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1830912,"data_stored":929234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542285,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1871872,"data_stored":949859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37180,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334660,"statfs":{"total":96636764160,"available":96598691840,"internally_reserved":0,"allocated":1871872,"data_stored":949311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37188,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334652,"statfs":{"total":96636764160,"available":96598683648,"internally_reserved":0,"allocated":1884160,"data_stored":956003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542285,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41948,"kb_used_data":2432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329892,"statfs":{"total":96636764160,"available":96593809408,"internally_reserved":0,"allocated":2490368,"data_stored":1548039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574989,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37188,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334652,"statfs":{"total":96636764160,"available":96598683648,"internally_reserved":0,"allocated":1875968,"data_stored":949369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:07:10.102 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:07:10.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.241+0000 7f4032274640 1 Processor -- start 2024-09-12T02:07:10.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.241+0000 7f4032274640 1 -- start start 2024-09-12T02:07:10.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.242+0000 7f4032274640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f402c15e5d0 0x7f402c0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.242+0000 7f4032274640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f402c06df60 0x7f402c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.242+0000 7f4032274640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f402c0d1630 0x7f402c09af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.242+0000 7f4032274640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f402c06dad0 con 0x7f402c0d1630 2024-09-12T02:07:10.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.242+0000 7f4032274640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f402c06cec0 con 0x7f402c06df60 2024-09-12T02:07:10.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.242+0000 7f4032274640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f402c06d1a0 con 0x7f402c15e5d0 2024-09-12T02:07:10.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.242+0000 7f4030811640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f402c0d1630 0x7f402c09af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.242+0000 7f4030811640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f402c0d1630 0x7f402c09af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54790/0 (socket says 172.21.15.19:54790) 2024-09-12T02:07:10.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.242+0000 7f4030811640 1 -- 172.21.15.19:0/1325342211 learned_addr learned my addr 172.21.15.19:0/1325342211 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:10.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.243+0000 7f402bfff640 1 --2- 172.21.15.19:0/1325342211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f402c15e5d0 0x7f402c0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.243+0000 7f402b7fe640 1 --2- 172.21.15.19:0/1325342211 >> v2:172.21.15.135:3300/0 conn(0x7f402c06df60 0x7f402c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.243+0000 7f4030811640 1 -- 172.21.15.19:0/1325342211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f402c15e5d0 msgr2=0x7f402c0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:10.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.243+0000 7f4030811640 1 --2- 172.21.15.19:0/1325342211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f402c15e5d0 0x7f402c0d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.243+0000 7f4030811640 1 -- 172.21.15.19:0/1325342211 >> v2:172.21.15.135:3300/0 conn(0x7f402c06df60 msgr2=0x7f402c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:10.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.243+0000 7f4030811640 1 --2- 172.21.15.19:0/1325342211 >> v2:172.21.15.135:3300/0 conn(0x7f402c06df60 0x7f402c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.243+0000 7f4030811640 1 -- 172.21.15.19:0/1325342211 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402c06d480 con 0x7f402c0d1630 2024-09-12T02:07:10.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.243+0000 7f4030811640 1 --2- 172.21.15.19:0/1325342211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f402c0d1630 0x7f402c09af70 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f402c073d00 tx=0x7f402402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf897d52b8e284a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:10.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.244+0000 7f402affd640 1 -- 172.21.15.19:0/1325342211 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4024036070 con 0x7f402c0d1630 2024-09-12T02:07:10.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.244+0000 7f402affd640 1 -- 172.21.15.19:0/1325342211 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4024031600 con 0x7f402c0d1630 2024-09-12T02:07:10.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.244+0000 7f402affd640 1 -- 172.21.15.19:0/1325342211 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40240319d0 con 0x7f402c0d1630 2024-09-12T02:07:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.244+0000 7f4032274640 1 -- 172.21.15.19:0/1325342211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f402c0d1630 msgr2=0x7f402c09af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.244+0000 7f4032274640 1 --2- 172.21.15.19:0/1325342211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f402c0d1630 0x7f402c09af70 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f402c073d00 tx=0x7f402402a730 comp rx=0 tx=0).stop 2024-09-12T02:07:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.244+0000 7f4032274640 1 -- 172.21.15.19:0/1325342211 shutdown_connections 2024-09-12T02:07:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.244+0000 7f4032274640 1 --2- 172.21.15.19:0/1325342211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f402c0d1630 0x7f402c09af70 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.244+0000 7f4032274640 1 --2- 172.21.15.19:0/1325342211 >> v2:172.21.15.135:3300/0 conn(0x7f402c06df60 0x7f402c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.244+0000 7f4032274640 1 --2- 172.21.15.19:0/1325342211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f402c15e5d0 0x7f402c0d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.244+0000 7f4032274640 1 -- 172.21.15.19:0/1325342211 >> 172.21.15.19:0/1325342211 conn(0x7f402c0d23a0 msgr2=0x7f402c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.244+0000 7f4032274640 1 -- 172.21.15.19:0/1325342211 shutdown_connections 2024-09-12T02:07:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.244+0000 7f4032274640 1 -- 172.21.15.19:0/1325342211 wait complete. 2024-09-12T02:07:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.245+0000 7f4032274640 1 Processor -- start 2024-09-12T02:07:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.246+0000 7f4032274640 1 -- start start 2024-09-12T02:07:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.246+0000 7f4032274640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f402c06df60 0x7f402c0b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.246+0000 7f4032274640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f402c0d1630 0x7f402c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.246+0000 7f4032274640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f402c15e5d0 0x7f402c0c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.246+0000 7f4032274640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f402c15eb30 con 0x7f402c06df60 2024-09-12T02:07:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.246+0000 7f4032274640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f402c15e9b0 con 0x7f402c15e5d0 2024-09-12T02:07:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.246+0000 7f4032274640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f402c162230 con 0x7f402c0d1630 2024-09-12T02:07:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.246+0000 7f402bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f402c06df60 0x7f402c0b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.247+0000 7f402bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f402c06df60 0x7f402c0b5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54800/0 (socket says 172.21.15.19:54800) 2024-09-12T02:07:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.247+0000 7f402bfff640 1 -- 172.21.15.19:0/1156341618 learned_addr learned my addr 172.21.15.19:0/1156341618 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.247+0000 7f4030811640 1 --2- 172.21.15.19:0/1156341618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f402c15e5d0 0x7f402c0c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.247+0000 7f402b7fe640 1 --2- 172.21.15.19:0/1156341618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f402c0d1630 0x7f402c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.247+0000 7f402bfff640 1 -- 172.21.15.19:0/1156341618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f402c0d1630 msgr2=0x7f402c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.247+0000 7f402bfff640 1 --2- 172.21.15.19:0/1156341618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f402c0d1630 0x7f402c152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.247+0000 7f402bfff640 1 -- 172.21.15.19:0/1156341618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f402c15e5d0 msgr2=0x7f402c0c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.247+0000 7f402bfff640 1 --2- 172.21.15.19:0/1156341618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f402c15e5d0 0x7f402c0c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.247+0000 7f402bfff640 1 -- 172.21.15.19:0/1156341618 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402c0c7ba0 con 0x7f402c06df60 2024-09-12T02:07:10.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.247+0000 7f4030811640 1 --2- 172.21.15.19:0/1156341618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f402c15e5d0 0x7f402c0c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:10.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.247+0000 7f402bfff640 1 --2- 172.21.15.19:0/1156341618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f402c06df60 0x7f402c0b5e50 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f401c00e870 tx=0x7f401c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:10.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.247+0000 7f4028ff9640 1 -- 172.21.15.19:0/1156341618 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401c017070 con 0x7f402c06df60 2024-09-12T02:07:10.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.247+0000 7f4028ff9640 1 -- 172.21.15.19:0/1156341618 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f401c00c940 con 0x7f402c06df60 2024-09-12T02:07:10.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.247+0000 7f4032274640 1 -- 172.21.15.19:0/1156341618 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f402c0c78c0 con 0x7f402c06df60 2024-09-12T02:07:10.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.247+0000 7f4028ff9640 1 -- 172.21.15.19:0/1156341618 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401c00cd30 con 0x7f402c06df60 2024-09-12T02:07:10.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.247+0000 7f4032274640 1 -- 172.21.15.19:0/1156341618 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f402c0b5650 con 0x7f402c06df60 2024-09-12T02:07:10.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.248+0000 7f4032274640 1 -- 172.21.15.19:0/1156341618 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f402c0d10f0 con 0x7f402c06df60 2024-09-12T02:07:10.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.249+0000 7f4028ff9640 1 -- 172.21.15.19:0/1156341618 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f401c01a070 con 0x7f402c06df60 2024-09-12T02:07:10.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.249+0000 7f4028ff9640 1 --2- 172.21.15.19:0/1156341618 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f401806be30 0x7f401806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.249+0000 7f4028ff9640 1 -- 172.21.15.19:0/1156341618 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6101+0+0 (secure 0 0 0) 0x7f401c08aea0 con 0x7f402c06df60 2024-09-12T02:07:10.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.249+0000 7f402b7fe640 1 --2- 172.21.15.19:0/1156341618 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f401806be30 0x7f401806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.250+0000 7f402b7fe640 1 --2- 172.21.15.19:0/1156341618 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f401806be30 0x7f401806e2f0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f402c0b32a0 tx=0x7f4020008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:10.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.253+0000 7f4028ff9640 1 -- 172.21.15.19:0/1156341618 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f401c0596c0 con 0x7f402c06df60 2024-09-12T02:07:10.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.429+0000 7f4032274640 1 -- 172.21.15.19:0/1156341618 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f402c15d6b0 con 0x7f401806be30 2024-09-12T02:07:10.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.436+0000 7f4028ff9640 1 -- 172.21.15.19:0/1156341618 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252466 (secure 0 0 0) 0x7f402c15d6b0 con 0x7f401806be30 2024-09-12T02:07:10.439 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:10.440 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T02:07:10.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.439+0000 7f4032274640 1 -- 172.21.15.19:0/1156341618 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f401806be30 msgr2=0x7f401806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.439+0000 7f4032274640 1 --2- 172.21.15.19:0/1156341618 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f401806be30 0x7f401806e2f0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f402c0b32a0 tx=0x7f4020008040 comp rx=0 tx=0).stop 2024-09-12T02:07:10.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.439+0000 7f4032274640 1 -- 172.21.15.19:0/1156341618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f402c06df60 msgr2=0x7f402c0b5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.439+0000 7f4032274640 1 --2- 172.21.15.19:0/1156341618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f402c06df60 0x7f402c0b5e50 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f401c00e870 tx=0x7f401c00ed30 comp rx=0 tx=0).stop 2024-09-12T02:07:10.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.439+0000 7f4032274640 1 -- 172.21.15.19:0/1156341618 shutdown_connections 2024-09-12T02:07:10.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.439+0000 7f4032274640 1 --2- 172.21.15.19:0/1156341618 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f401806be30 0x7f401806e2f0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.439+0000 7f4032274640 1 --2- 172.21.15.19:0/1156341618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f402c15e5d0 0x7f402c0c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.439+0000 7f4032274640 1 --2- 172.21.15.19:0/1156341618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f402c0d1630 0x7f402c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.439+0000 7f4032274640 1 --2- 172.21.15.19:0/1156341618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f402c06df60 0x7f402c0b5e50 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.439+0000 7f4032274640 1 -- 172.21.15.19:0/1156341618 >> 172.21.15.19:0/1156341618 conn(0x7f402c0d23a0 msgr2=0x7f402c15cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:10.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.439+0000 7f4032274640 1 -- 172.21.15.19:0/1156341618 shutdown_connections 2024-09-12T02:07:10.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.439+0000 7f4032274640 1 -- 172.21.15.19:0/1156341618 wait complete. 2024-09-12T02:07:10.450 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":482,"stamp":"2024-09-12T02:07:10.252543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":298704,"kb_used_data":15876,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754676016,"statfs":{"total":773094113280,"available":772788240384,"internally_reserved":0,"allocated":16257024,"data_stored":8813232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001330"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164699+0000","last_change":"2024-09-12T02:07:06.188562+0000","last_active":"2024-09-12T02:07:07.164699+0000","last_peered":"2024-09-12T02:07:07.164699+0000","last_clean":"2024-09-12T02:07:07.164699+0000","last_became_active":"2024-09-12T02:07:06.188181+0000","last_became_peered":"2024-09-12T02:07:06.188181+0000","last_unstale":"2024-09-12T02:07:07.164699+0000","last_undegraded":"2024-09-12T02:07:07.164699+0000","last_fullsized":"2024-09-12T02:07:07.164699+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:30.948775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162342+0000","last_change":"2024-09-12T02:07:06.174390+0000","last_active":"2024-09-12T02:07:07.162342+0000","last_peered":"2024-09-12T02:07:07.162342+0000","last_clean":"2024-09-12T02:07:07.162342+0000","last_became_active":"2024-09-12T02:07:06.174074+0000","last_became_peered":"2024-09-12T02:07:06.174074+0000","last_unstale":"2024-09-12T02:07:07.162342+0000","last_undegraded":"2024-09-12T02:07:07.162342+0000","last_fullsized":"2024-09-12T02:07:07.162342+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:44.672172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164673+0000","last_change":"2024-09-12T02:07:06.181043+0000","last_active":"2024-09-12T02:07:07.164673+0000","last_peered":"2024-09-12T02:07:07.164673+0000","last_clean":"2024-09-12T02:07:07.164673+0000","last_became_active":"2024-09-12T02:07:06.180739+0000","last_became_peered":"2024-09-12T02:07:06.180739+0000","last_unstale":"2024-09-12T02:07:07.164673+0000","last_undegraded":"2024-09-12T02:07:07.164673+0000","last_fullsized":"2024-09-12T02:07:07.164673+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:59.243937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188462+0000","last_change":"2024-09-12T02:07:06.182365+0000","last_active":"2024-09-12T02:07:06.188462+0000","last_peered":"2024-09-12T02:07:06.188462+0000","last_clean":"2024-09-12T02:07:06.188462+0000","last_became_active":"2024-09-12T02:07:06.182017+0000","last_became_peered":"2024-09-12T02:07:06.182017+0000","last_unstale":"2024-09-12T02:07:06.188462+0000","last_undegraded":"2024-09-12T02:07:06.188462+0000","last_fullsized":"2024-09-12T02:07:06.188462+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:23.103898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.159991+0000","last_change":"2024-09-12T02:07:06.174721+0000","last_active":"2024-09-12T02:07:07.159991+0000","last_peered":"2024-09-12T02:07:07.159991+0000","last_clean":"2024-09-12T02:07:07.159991+0000","last_became_active":"2024-09-12T02:07:06.174396+0000","last_became_peered":"2024-09-12T02:07:06.174396+0000","last_unstale":"2024-09-12T02:07:07.159991+0000","last_undegraded":"2024-09-12T02:07:07.159991+0000","last_fullsized":"2024-09-12T02:07:07.159991+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:38.012619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161796+0000","last_change":"2024-09-12T02:07:06.169646+0000","last_active":"2024-09-12T02:07:07.161796+0000","last_peered":"2024-09-12T02:07:07.161796+0000","last_clean":"2024-09-12T02:07:07.161796+0000","last_became_active":"2024-09-12T02:07:06.169353+0000","last_became_peered":"2024-09-12T02:07:06.169353+0000","last_unstale":"2024-09-12T02:07:07.161796+0000","last_undegraded":"2024-09-12T02:07:07.161796+0000","last_fullsized":"2024-09-12T02:07:07.161796+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:09.522486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161049+0000","last_change":"2024-09-12T02:07:06.174812+0000","last_active":"2024-09-12T02:07:07.161049+0000","last_peered":"2024-09-12T02:07:07.161049+0000","last_clean":"2024-09-12T02:07:07.161049+0000","last_became_active":"2024-09-12T02:07:06.174515+0000","last_became_peered":"2024-09-12T02:07:06.174515+0000","last_unstale":"2024-09-12T02:07:07.161049+0000","last_undegraded":"2024-09-12T02:07:07.161049+0000","last_fullsized":"2024-09-12T02:07:07.161049+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:50.679377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.191811+0000","last_change":"2024-09-12T02:07:06.187847+0000","last_active":"2024-09-12T02:07:06.191811+0000","last_peered":"2024-09-12T02:07:06.191811+0000","last_clean":"2024-09-12T02:07:06.191811+0000","last_became_active":"2024-09-12T02:07:06.187330+0000","last_became_peered":"2024-09-12T02:07:06.187330+0000","last_unstale":"2024-09-12T02:07:06.191811+0000","last_undegraded":"2024-09-12T02:07:06.191811+0000","last_fullsized":"2024-09-12T02:07:06.191811+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:57.702135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162152+0000","last_change":"2024-09-12T02:07:06.186070+0000","last_active":"2024-09-12T02:07:07.162152+0000","last_peered":"2024-09-12T02:07:07.162152+0000","last_clean":"2024-09-12T02:07:07.162152+0000","last_became_active":"2024-09-12T02:07:06.185718+0000","last_became_peered":"2024-09-12T02:07:06.185718+0000","last_unstale":"2024-09-12T02:07:07.162152+0000","last_undegraded":"2024-09-12T02:07:07.162152+0000","last_fullsized":"2024-09-12T02:07:07.162152+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:02.274114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160269+0000","last_change":"2024-09-12T02:07:06.165191+0000","last_active":"2024-09-12T02:07:07.160269+0000","last_peered":"2024-09-12T02:07:07.160269+0000","last_clean":"2024-09-12T02:07:07.160269+0000","last_became_active":"2024-09-12T02:07:06.164894+0000","last_became_peered":"2024-09-12T02:07:06.164894+0000","last_unstale":"2024-09-12T02:07:07.160269+0000","last_undegraded":"2024-09-12T02:07:07.160269+0000","last_fullsized":"2024-09-12T02:07:07.160269+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:51.780792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166773+0000","last_change":"2024-09-12T02:07:06.176297+0000","last_active":"2024-09-12T02:07:07.166773+0000","last_peered":"2024-09-12T02:07:07.166773+0000","last_clean":"2024-09-12T02:07:07.166773+0000","last_became_active":"2024-09-12T02:07:06.175504+0000","last_became_peered":"2024-09-12T02:07:06.175504+0000","last_unstale":"2024-09-12T02:07:07.166773+0000","last_undegraded":"2024-09-12T02:07:07.166773+0000","last_fullsized":"2024-09-12T02:07:07.166773+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:15.961805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161745+0000","last_change":"2024-09-12T02:07:06.170696+0000","last_active":"2024-09-12T02:07:07.161745+0000","last_peered":"2024-09-12T02:07:07.161745+0000","last_clean":"2024-09-12T02:07:07.161745+0000","last_became_active":"2024-09-12T02:07:06.170368+0000","last_became_peered":"2024-09-12T02:07:06.170368+0000","last_unstale":"2024-09-12T02:07:07.161745+0000","last_undegraded":"2024-09-12T02:07:07.161745+0000","last_fullsized":"2024-09-12T02:07:07.161745+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:57.778187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.185408+0000","last_change":"2024-09-12T02:07:06.181857+0000","last_active":"2024-09-12T02:07:06.185408+0000","last_peered":"2024-09-12T02:07:06.185408+0000","last_clean":"2024-09-12T02:07:06.185408+0000","last_became_active":"2024-09-12T02:07:06.181467+0000","last_became_peered":"2024-09-12T02:07:06.181467+0000","last_unstale":"2024-09-12T02:07:06.185408+0000","last_undegraded":"2024-09-12T02:07:06.185408+0000","last_fullsized":"2024-09-12T02:07:06.185408+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:56.597134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152264+0000","last_change":"2024-09-12T02:07:06.182969+0000","last_active":"2024-09-12T02:07:08.152264+0000","last_peered":"2024-09-12T02:07:08.152264+0000","last_clean":"2024-09-12T02:07:08.152264+0000","last_became_active":"2024-09-12T02:07:06.182682+0000","last_became_peered":"2024-09-12T02:07:06.182682+0000","last_unstale":"2024-09-12T02:07:08.152264+0000","last_undegraded":"2024-09-12T02:07:08.152264+0000","last_fullsized":"2024-09-12T02:07:08.152264+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:47.959635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152317+0000","last_change":"2024-09-12T02:07:06.180638+0000","last_active":"2024-09-12T02:07:08.152317+0000","last_peered":"2024-09-12T02:07:08.152317+0000","last_clean":"2024-09-12T02:07:08.152317+0000","last_became_active":"2024-09-12T02:07:06.180381+0000","last_became_peered":"2024-09-12T02:07:06.180381+0000","last_unstale":"2024-09-12T02:07:08.152317+0000","last_undegraded":"2024-09-12T02:07:08.152317+0000","last_fullsized":"2024-09-12T02:07:08.152317+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:27.615773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152229+0000","last_change":"2024-09-12T02:07:06.177792+0000","last_active":"2024-09-12T02:07:08.152229+0000","last_peered":"2024-09-12T02:07:08.152229+0000","last_clean":"2024-09-12T02:07:08.152229+0000","last_became_active":"2024-09-12T02:07:06.177444+0000","last_became_peered":"2024-09-12T02:07:06.177444+0000","last_unstale":"2024-09-12T02:07:08.152229+0000","last_undegraded":"2024-09-12T02:07:08.152229+0000","last_fullsized":"2024-09-12T02:07:08.152229+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:56.590510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164742+0000","last_change":"2024-09-12T02:07:06.180361+0000","last_active":"2024-09-12T02:07:07.164742+0000","last_peered":"2024-09-12T02:07:07.164742+0000","last_clean":"2024-09-12T02:07:07.164742+0000","last_became_active":"2024-09-12T02:07:06.180017+0000","last_became_peered":"2024-09-12T02:07:06.180017+0000","last_unstale":"2024-09-12T02:07:07.164742+0000","last_undegraded":"2024-09-12T02:07:07.164742+0000","last_fullsized":"2024-09-12T02:07:07.164742+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:30.553159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162378+0000","last_change":"2024-09-12T02:07:06.175609+0000","last_active":"2024-09-12T02:07:07.162378+0000","last_peered":"2024-09-12T02:07:07.162378+0000","last_clean":"2024-09-12T02:07:07.162378+0000","last_became_active":"2024-09-12T02:07:06.175358+0000","last_became_peered":"2024-09-12T02:07:06.175358+0000","last_unstale":"2024-09-12T02:07:07.162378+0000","last_undegraded":"2024-09-12T02:07:07.162378+0000","last_fullsized":"2024-09-12T02:07:07.162378+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:06.129951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164694+0000","last_change":"2024-09-12T02:07:06.184058+0000","last_active":"2024-09-12T02:07:07.164694+0000","last_peered":"2024-09-12T02:07:07.164694+0000","last_clean":"2024-09-12T02:07:07.164694+0000","last_became_active":"2024-09-12T02:07:06.183753+0000","last_became_peered":"2024-09-12T02:07:06.183753+0000","last_unstale":"2024-09-12T02:07:07.164694+0000","last_undegraded":"2024-09-12T02:07:07.164694+0000","last_fullsized":"2024-09-12T02:07:07.164694+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:58.979849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162191+0000","last_change":"2024-09-12T02:07:06.173004+0000","last_active":"2024-09-12T02:07:07.162191+0000","last_peered":"2024-09-12T02:07:07.162191+0000","last_clean":"2024-09-12T02:07:07.162191+0000","last_became_active":"2024-09-12T02:07:06.172715+0000","last_became_peered":"2024-09-12T02:07:06.172715+0000","last_unstale":"2024-09-12T02:07:07.162191+0000","last_undegraded":"2024-09-12T02:07:07.162191+0000","last_fullsized":"2024-09-12T02:07:07.162191+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:42.705993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.179326+0000","last_change":"2024-09-12T02:07:06.177889+0000","last_active":"2024-09-12T02:07:06.179326+0000","last_peered":"2024-09-12T02:07:06.179326+0000","last_clean":"2024-09-12T02:07:06.179326+0000","last_became_active":"2024-09-12T02:07:06.177498+0000","last_became_peered":"2024-09-12T02:07:06.177498+0000","last_unstale":"2024-09-12T02:07:06.179326+0000","last_undegraded":"2024-09-12T02:07:06.179326+0000","last_fullsized":"2024-09-12T02:07:06.179326+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:40.200757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160079+0000","last_change":"2024-09-12T02:07:06.185065+0000","last_active":"2024-09-12T02:07:07.160079+0000","last_peered":"2024-09-12T02:07:07.160079+0000","last_clean":"2024-09-12T02:07:07.160079+0000","last_became_active":"2024-09-12T02:07:06.184779+0000","last_became_peered":"2024-09-12T02:07:06.184779+0000","last_unstale":"2024-09-12T02:07:07.160079+0000","last_undegraded":"2024-09-12T02:07:07.160079+0000","last_fullsized":"2024-09-12T02:07:07.160079+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:13.412294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164498+0000","last_change":"2024-09-12T02:07:06.180301+0000","last_active":"2024-09-12T02:07:07.164498+0000","last_peered":"2024-09-12T02:07:07.164498+0000","last_clean":"2024-09-12T02:07:07.164498+0000","last_became_active":"2024-09-12T02:07:06.179930+0000","last_became_peered":"2024-09-12T02:07:06.179930+0000","last_unstale":"2024-09-12T02:07:07.164498+0000","last_undegraded":"2024-09-12T02:07:07.164498+0000","last_fullsized":"2024-09-12T02:07:07.164498+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:29.743856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160141+0000","last_change":"2024-09-12T02:07:06.173860+0000","last_active":"2024-09-12T02:07:07.160141+0000","last_peered":"2024-09-12T02:07:07.160141+0000","last_clean":"2024-09-12T02:07:07.160141+0000","last_became_active":"2024-09-12T02:07:06.173507+0000","last_became_peered":"2024-09-12T02:07:06.173507+0000","last_unstale":"2024-09-12T02:07:07.160141+0000","last_undegraded":"2024-09-12T02:07:07.160141+0000","last_fullsized":"2024-09-12T02:07:07.160141+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:55.442840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161259+0000","last_change":"2024-09-12T02:07:06.183545+0000","last_active":"2024-09-12T02:07:07.161259+0000","last_peered":"2024-09-12T02:07:07.161259+0000","last_clean":"2024-09-12T02:07:07.161259+0000","last_became_active":"2024-09-12T02:07:06.180674+0000","last_became_peered":"2024-09-12T02:07:06.180674+0000","last_unstale":"2024-09-12T02:07:07.161259+0000","last_undegraded":"2024-09-12T02:07:07.161259+0000","last_fullsized":"2024-09-12T02:07:07.161259+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:23.067644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161179+0000","last_change":"2024-09-12T02:07:06.171797+0000","last_active":"2024-09-12T02:07:07.161179+0000","last_peered":"2024-09-12T02:07:07.161179+0000","last_clean":"2024-09-12T02:07:07.161179+0000","last_became_active":"2024-09-12T02:07:06.171513+0000","last_became_peered":"2024-09-12T02:07:06.171513+0000","last_unstale":"2024-09-12T02:07:07.161179+0000","last_undegraded":"2024-09-12T02:07:07.161179+0000","last_fullsized":"2024-09-12T02:07:07.161179+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:58.954857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166845+0000","last_change":"2024-09-12T02:07:06.178849+0000","last_active":"2024-09-12T02:07:07.166845+0000","last_peered":"2024-09-12T02:07:07.166845+0000","last_clean":"2024-09-12T02:07:07.166845+0000","last_became_active":"2024-09-12T02:07:06.178582+0000","last_became_peered":"2024-09-12T02:07:06.178582+0000","last_unstale":"2024-09-12T02:07:07.166845+0000","last_undegraded":"2024-09-12T02:07:07.166845+0000","last_fullsized":"2024-09-12T02:07:07.166845+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:22.419853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162191+0000","last_change":"2024-09-12T02:07:06.179357+0000","last_active":"2024-09-12T02:07:07.162191+0000","last_peered":"2024-09-12T02:07:07.162191+0000","last_clean":"2024-09-12T02:07:07.162191+0000","last_became_active":"2024-09-12T02:07:06.179095+0000","last_became_peered":"2024-09-12T02:07:06.179095+0000","last_unstale":"2024-09-12T02:07:07.162191+0000","last_undegraded":"2024-09-12T02:07:07.162191+0000","last_fullsized":"2024-09-12T02:07:07.162191+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:02.076504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.179305+0000","last_change":"2024-09-12T02:07:06.177320+0000","last_active":"2024-09-12T02:07:06.179305+0000","last_peered":"2024-09-12T02:07:06.179305+0000","last_clean":"2024-09-12T02:07:06.179305+0000","last_became_active":"2024-09-12T02:07:06.176959+0000","last_became_peered":"2024-09-12T02:07:06.176959+0000","last_unstale":"2024-09-12T02:07:06.179305+0000","last_undegraded":"2024-09-12T02:07:06.179305+0000","last_fullsized":"2024-09-12T02:07:06.179305+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:02.600481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161419+0000","last_change":"2024-09-12T02:07:06.178211+0000","last_active":"2024-09-12T02:07:07.161419+0000","last_peered":"2024-09-12T02:07:07.161419+0000","last_clean":"2024-09-12T02:07:07.161419+0000","last_became_active":"2024-09-12T02:07:06.177168+0000","last_became_peered":"2024-09-12T02:07:06.177168+0000","last_unstale":"2024-09-12T02:07:07.161419+0000","last_undegraded":"2024-09-12T02:07:07.161419+0000","last_fullsized":"2024-09-12T02:07:07.161419+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:26.784396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161207+0000","last_change":"2024-09-12T02:07:06.186273+0000","last_active":"2024-09-12T02:07:07.161207+0000","last_peered":"2024-09-12T02:07:07.161207+0000","last_clean":"2024-09-12T02:07:07.161207+0000","last_became_active":"2024-09-12T02:07:06.185981+0000","last_became_peered":"2024-09-12T02:07:06.185981+0000","last_unstale":"2024-09-12T02:07:07.161207+0000","last_undegraded":"2024-09-12T02:07:07.161207+0000","last_fullsized":"2024-09-12T02:07:07.161207+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:17.401197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.191783+0000","last_change":"2024-09-12T02:07:06.187602+0000","last_active":"2024-09-12T02:07:06.191783+0000","last_peered":"2024-09-12T02:07:06.191783+0000","last_clean":"2024-09-12T02:07:06.191783+0000","last_became_active":"2024-09-12T02:07:06.186930+0000","last_became_peered":"2024-09-12T02:07:06.186930+0000","last_unstale":"2024-09-12T02:07:06.191783+0000","last_undegraded":"2024-09-12T02:07:06.191783+0000","last_fullsized":"2024-09-12T02:07:06.191783+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:50.021035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164540+0000","last_change":"2024-09-12T02:07:06.182081+0000","last_active":"2024-09-12T02:07:07.164540+0000","last_peered":"2024-09-12T02:07:07.164540+0000","last_clean":"2024-09-12T02:07:07.164540+0000","last_became_active":"2024-09-12T02:07:06.181774+0000","last_became_peered":"2024-09-12T02:07:06.181774+0000","last_unstale":"2024-09-12T02:07:07.164540+0000","last_undegraded":"2024-09-12T02:07:07.164540+0000","last_fullsized":"2024-09-12T02:07:07.164540+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:41.166247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"144'4","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.187015+0000","last_change":"2024-09-12T02:07:05.168735+0000","last_active":"2024-09-12T02:07:06.187015+0000","last_peered":"2024-09-12T02:07:06.187015+0000","last_clean":"2024-09-12T02:07:06.187015+0000","last_became_active":"2024-09-12T02:07:05.168378+0000","last_became_peered":"2024-09-12T02:07:05.168378+0000","last_unstale":"2024-09-12T02:07:06.187015+0000","last_undegraded":"2024-09-12T02:07:06.187015+0000","last_fullsized":"2024-09-12T02:07:06.187015+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:56.775704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.192885+0000","last_change":"2024-09-12T02:07:06.189264+0000","last_active":"2024-09-12T02:07:06.192885+0000","last_peered":"2024-09-12T02:07:06.192885+0000","last_clean":"2024-09-12T02:07:06.192885+0000","last_became_active":"2024-09-12T02:07:06.188784+0000","last_became_peered":"2024-09-12T02:07:06.188784+0000","last_unstale":"2024-09-12T02:07:06.192885+0000","last_undegraded":"2024-09-12T02:07:06.192885+0000","last_fullsized":"2024-09-12T02:07:06.192885+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:47.546176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"144'1","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188900+0000","last_change":"2024-09-12T02:07:05.178805+0000","last_active":"2024-09-12T02:07:06.188900+0000","last_peered":"2024-09-12T02:07:06.188900+0000","last_clean":"2024-09-12T02:07:06.188900+0000","last_became_active":"2024-09-12T02:07:05.178340+0000","last_became_peered":"2024-09-12T02:07:05.178340+0000","last_unstale":"2024-09-12T02:07:06.188900+0000","last_undegraded":"2024-09-12T02:07:06.188900+0000","last_fullsized":"2024-09-12T02:07:06.188900+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:30.323418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161537+0000","last_change":"2024-09-12T02:07:06.170078+0000","last_active":"2024-09-12T02:07:07.161537+0000","last_peered":"2024-09-12T02:07:07.161537+0000","last_clean":"2024-09-12T02:07:07.161537+0000","last_became_active":"2024-09-12T02:07:06.169626+0000","last_became_peered":"2024-09-12T02:07:06.169626+0000","last_unstale":"2024-09-12T02:07:07.161537+0000","last_undegraded":"2024-09-12T02:07:07.161537+0000","last_fullsized":"2024-09-12T02:07:07.161537+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:02.746428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161354+0000","last_change":"2024-09-12T02:07:05.173497+0000","last_active":"2024-09-12T02:07:07.161354+0000","last_peered":"2024-09-12T02:07:07.161354+0000","last_clean":"2024-09-12T02:07:07.161354+0000","last_became_active":"2024-09-12T02:07:05.173240+0000","last_became_peered":"2024-09-12T02:07:05.173240+0000","last_unstale":"2024-09-12T02:07:07.161354+0000","last_undegraded":"2024-09-12T02:07:07.161354+0000","last_fullsized":"2024-09-12T02:07:07.161354+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:45.930215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166749+0000","last_change":"2024-09-12T02:07:06.175693+0000","last_active":"2024-09-12T02:07:07.166749+0000","last_peered":"2024-09-12T02:07:07.166749+0000","last_clean":"2024-09-12T02:07:07.166749+0000","last_became_active":"2024-09-12T02:07:06.175445+0000","last_became_peered":"2024-09-12T02:07:06.175445+0000","last_unstale":"2024-09-12T02:07:07.166749+0000","last_undegraded":"2024-09-12T02:07:07.166749+0000","last_fullsized":"2024-09-12T02:07:07.166749+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:32.944261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160093+0000","last_change":"2024-09-12T02:07:05.174789+0000","last_active":"2024-09-12T02:07:07.160093+0000","last_peered":"2024-09-12T02:07:07.160093+0000","last_clean":"2024-09-12T02:07:07.160093+0000","last_became_active":"2024-09-12T02:07:05.174498+0000","last_became_peered":"2024-09-12T02:07:05.174498+0000","last_unstale":"2024-09-12T02:07:07.160093+0000","last_undegraded":"2024-09-12T02:07:07.160093+0000","last_fullsized":"2024-09-12T02:07:07.160093+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:39.219875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188440+0000","last_change":"2024-09-12T02:07:06.182146+0000","last_active":"2024-09-12T02:07:06.188440+0000","last_peered":"2024-09-12T02:07:06.188440+0000","last_clean":"2024-09-12T02:07:06.188440+0000","last_became_active":"2024-09-12T02:07:06.181487+0000","last_became_peered":"2024-09-12T02:07:06.181487+0000","last_unstale":"2024-09-12T02:07:06.188440+0000","last_undegraded":"2024-09-12T02:07:06.188440+0000","last_fullsized":"2024-09-12T02:07:06.188440+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:43.216454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"144'1","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152222+0000","last_change":"2024-09-12T02:07:05.170859+0000","last_active":"2024-09-12T02:07:08.152222+0000","last_peered":"2024-09-12T02:07:08.152222+0000","last_clean":"2024-09-12T02:07:08.152222+0000","last_became_active":"2024-09-12T02:07:05.170461+0000","last_became_peered":"2024-09-12T02:07:05.170461+0000","last_unstale":"2024-09-12T02:07:08.152222+0000","last_undegraded":"2024-09-12T02:07:08.152222+0000","last_fullsized":"2024-09-12T02:07:08.152222+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:21.417369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164914+0000","last_change":"2024-09-12T02:07:06.180769+0000","last_active":"2024-09-12T02:07:07.164914+0000","last_peered":"2024-09-12T02:07:07.164914+0000","last_clean":"2024-09-12T02:07:07.164914+0000","last_became_active":"2024-09-12T02:07:06.180488+0000","last_became_peered":"2024-09-12T02:07:06.180488+0000","last_unstale":"2024-09-12T02:07:07.164914+0000","last_undegraded":"2024-09-12T02:07:07.164914+0000","last_fullsized":"2024-09-12T02:07:07.164914+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:53.889287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"144'1","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166448+0000","last_change":"2024-09-12T02:07:05.173595+0000","last_active":"2024-09-12T02:07:07.166448+0000","last_peered":"2024-09-12T02:07:07.166448+0000","last_clean":"2024-09-12T02:07:07.166448+0000","last_became_active":"2024-09-12T02:07:05.173302+0000","last_became_peered":"2024-09-12T02:07:05.173302+0000","last_unstale":"2024-09-12T02:07:07.166448+0000","last_undegraded":"2024-09-12T02:07:07.166448+0000","last_fullsized":"2024-09-12T02:07:07.166448+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:16.398714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162438+0000","last_change":"2024-09-12T02:07:06.178635+0000","last_active":"2024-09-12T02:07:07.162438+0000","last_peered":"2024-09-12T02:07:07.162438+0000","last_clean":"2024-09-12T02:07:07.162438+0000","last_became_active":"2024-09-12T02:07:06.178364+0000","last_became_peered":"2024-09-12T02:07:06.178364+0000","last_unstale":"2024-09-12T02:07:07.162438+0000","last_undegraded":"2024-09-12T02:07:07.162438+0000","last_fullsized":"2024-09-12T02:07:07.162438+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:48.232335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161246+0000","last_change":"2024-09-12T02:07:05.169281+0000","last_active":"2024-09-12T02:07:07.161246+0000","last_peered":"2024-09-12T02:07:07.161246+0000","last_clean":"2024-09-12T02:07:07.161246+0000","last_became_active":"2024-09-12T02:07:05.169013+0000","last_became_peered":"2024-09-12T02:07:05.169013+0000","last_unstale":"2024-09-12T02:07:07.161246+0000","last_undegraded":"2024-09-12T02:07:07.161246+0000","last_fullsized":"2024-09-12T02:07:07.161246+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:35.627376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.189655+0000","last_change":"2024-09-12T02:07:06.185740+0000","last_active":"2024-09-12T02:07:06.189655+0000","last_peered":"2024-09-12T02:07:06.189655+0000","last_clean":"2024-09-12T02:07:06.189655+0000","last_became_active":"2024-09-12T02:07:06.185464+0000","last_became_peered":"2024-09-12T02:07:06.185464+0000","last_unstale":"2024-09-12T02:07:06.189655+0000","last_undegraded":"2024-09-12T02:07:06.189655+0000","last_fullsized":"2024-09-12T02:07:06.189655+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:03.123101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.167409+0000","last_change":"2024-09-12T02:07:05.171827+0000","last_active":"2024-09-12T02:07:06.167409+0000","last_peered":"2024-09-12T02:07:06.167409+0000","last_clean":"2024-09-12T02:07:06.167409+0000","last_became_active":"2024-09-12T02:07:05.170929+0000","last_became_peered":"2024-09-12T02:07:05.170929+0000","last_unstale":"2024-09-12T02:07:06.167409+0000","last_undegraded":"2024-09-12T02:07:06.167409+0000","last_fullsized":"2024-09-12T02:07:06.167409+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:25.781913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164699+0000","last_change":"2024-09-12T02:07:06.182831+0000","last_active":"2024-09-12T02:07:07.164699+0000","last_peered":"2024-09-12T02:07:07.164699+0000","last_clean":"2024-09-12T02:07:07.164699+0000","last_became_active":"2024-09-12T02:07:06.182547+0000","last_became_peered":"2024-09-12T02:07:06.182547+0000","last_unstale":"2024-09-12T02:07:07.164699+0000","last_undegraded":"2024-09-12T02:07:07.164699+0000","last_fullsized":"2024-09-12T02:07:07.164699+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:46.521663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161205+0000","last_change":"2024-09-12T02:07:05.170472+0000","last_active":"2024-09-12T02:07:07.161205+0000","last_peered":"2024-09-12T02:07:07.161205+0000","last_clean":"2024-09-12T02:07:07.161205+0000","last_became_active":"2024-09-12T02:07:05.170230+0000","last_became_peered":"2024-09-12T02:07:05.170230+0000","last_unstale":"2024-09-12T02:07:07.161205+0000","last_undegraded":"2024-09-12T02:07:07.161205+0000","last_fullsized":"2024-09-12T02:07:07.161205+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:37.010136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.159884+0000","last_change":"2024-09-12T02:07:06.184089+0000","last_active":"2024-09-12T02:07:07.159884+0000","last_peered":"2024-09-12T02:07:07.159884+0000","last_clean":"2024-09-12T02:07:07.159884+0000","last_became_active":"2024-09-12T02:07:06.183803+0000","last_became_peered":"2024-09-12T02:07:06.183803+0000","last_unstale":"2024-09-12T02:07:07.159884+0000","last_undegraded":"2024-09-12T02:07:07.159884+0000","last_fullsized":"2024-09-12T02:07:07.159884+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:46.932699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164723+0000","last_change":"2024-09-12T02:07:05.169627+0000","last_active":"2024-09-12T02:07:07.164723+0000","last_peered":"2024-09-12T02:07:07.164723+0000","last_clean":"2024-09-12T02:07:07.164723+0000","last_became_active":"2024-09-12T02:07:05.169351+0000","last_became_peered":"2024-09-12T02:07:05.169351+0000","last_unstale":"2024-09-12T02:07:07.164723+0000","last_undegraded":"2024-09-12T02:07:07.164723+0000","last_fullsized":"2024-09-12T02:07:07.164723+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:16.639255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188132+0000","last_change":"2024-09-12T02:07:06.185105+0000","last_active":"2024-09-12T02:07:06.188132+0000","last_peered":"2024-09-12T02:07:06.188132+0000","last_clean":"2024-09-12T02:07:06.188132+0000","last_became_active":"2024-09-12T02:07:06.184834+0000","last_became_peered":"2024-09-12T02:07:06.184834+0000","last_unstale":"2024-09-12T02:07:06.188132+0000","last_undegraded":"2024-09-12T02:07:06.188132+0000","last_fullsized":"2024-09-12T02:07:06.188132+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:32.847267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"144'3","reported_seq":17,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152291+0000","last_change":"2024-09-12T02:07:05.171680+0000","last_active":"2024-09-12T02:07:08.152291+0000","last_peered":"2024-09-12T02:07:08.152291+0000","last_clean":"2024-09-12T02:07:08.152291+0000","last_became_active":"2024-09-12T02:07:05.171404+0000","last_became_peered":"2024-09-12T02:07:05.171404+0000","last_unstale":"2024-09-12T02:07:08.152291+0000","last_undegraded":"2024-09-12T02:07:08.152291+0000","last_fullsized":"2024-09-12T02:07:08.152291+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:35.660683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160149+0000","last_change":"2024-09-12T02:07:06.185464+0000","last_active":"2024-09-12T02:07:07.160149+0000","last_peered":"2024-09-12T02:07:07.160149+0000","last_clean":"2024-09-12T02:07:07.160149+0000","last_became_active":"2024-09-12T02:07:06.184939+0000","last_became_peered":"2024-09-12T02:07:06.184939+0000","last_unstale":"2024-09-12T02:07:07.160149+0000","last_undegraded":"2024-09-12T02:07:07.160149+0000","last_fullsized":"2024-09-12T02:07:07.160149+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:43.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"144'6","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162233+0000","last_change":"2024-09-12T02:07:05.167291+0000","last_active":"2024-09-12T02:07:07.162233+0000","last_peered":"2024-09-12T02:07:07.162233+0000","last_clean":"2024-09-12T02:07:07.162233+0000","last_became_active":"2024-09-12T02:07:05.167007+0000","last_became_peered":"2024-09-12T02:07:05.167007+0000","last_unstale":"2024-09-12T02:07:07.162233+0000","last_undegraded":"2024-09-12T02:07:07.162233+0000","last_fullsized":"2024-09-12T02:07:07.162233+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:24.643556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166672+0000","last_change":"2024-09-12T02:07:06.177960+0000","last_active":"2024-09-12T02:07:07.166672+0000","last_peered":"2024-09-12T02:07:07.166672+0000","last_clean":"2024-09-12T02:07:07.166672+0000","last_became_active":"2024-09-12T02:07:06.177674+0000","last_became_peered":"2024-09-12T02:07:06.177674+0000","last_unstale":"2024-09-12T02:07:07.166672+0000","last_undegraded":"2024-09-12T02:07:07.166672+0000","last_fullsized":"2024-09-12T02:07:07.166672+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:02.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160245+0000","last_change":"2024-09-12T02:07:05.180245+0000","last_active":"2024-09-12T02:07:07.160245+0000","last_peered":"2024-09-12T02:07:07.160245+0000","last_clean":"2024-09-12T02:07:07.160245+0000","last_became_active":"2024-09-12T02:07:05.179890+0000","last_became_peered":"2024-09-12T02:07:05.179890+0000","last_unstale":"2024-09-12T02:07:07.160245+0000","last_undegraded":"2024-09-12T02:07:07.160245+0000","last_fullsized":"2024-09-12T02:07:07.160245+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:26.126486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162237+0000","last_change":"2024-09-12T02:07:06.176853+0000","last_active":"2024-09-12T02:07:07.162237+0000","last_peered":"2024-09-12T02:07:07.162237+0000","last_clean":"2024-09-12T02:07:07.162237+0000","last_became_active":"2024-09-12T02:07:06.176544+0000","last_became_peered":"2024-09-12T02:07:06.176544+0000","last_unstale":"2024-09-12T02:07:07.162237+0000","last_undegraded":"2024-09-12T02:07:07.162237+0000","last_fullsized":"2024-09-12T02:07:07.162237+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:31.856009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.167494+0000","last_change":"2024-09-12T02:07:05.170442+0000","last_active":"2024-09-12T02:07:06.167494+0000","last_peered":"2024-09-12T02:07:06.167494+0000","last_clean":"2024-09-12T02:07:06.167494+0000","last_became_active":"2024-09-12T02:07:05.170143+0000","last_became_peered":"2024-09-12T02:07:05.170143+0000","last_unstale":"2024-09-12T02:07:06.167494+0000","last_undegraded":"2024-09-12T02:07:06.167494+0000","last_fullsized":"2024-09-12T02:07:06.167494+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:01.743945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.189010+0000","last_change":"2024-09-12T02:07:06.186466+0000","last_active":"2024-09-12T02:07:06.189010+0000","last_peered":"2024-09-12T02:07:06.189010+0000","last_clean":"2024-09-12T02:07:06.189010+0000","last_became_active":"2024-09-12T02:07:06.186144+0000","last_became_peered":"2024-09-12T02:07:06.186144+0000","last_unstale":"2024-09-12T02:07:06.189010+0000","last_undegraded":"2024-09-12T02:07:06.189010+0000","last_fullsized":"2024-09-12T02:07:06.189010+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:20.906453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.172327+0000","last_change":"2024-09-12T02:07:05.181325+0000","last_active":"2024-09-12T02:07:06.172327+0000","last_peered":"2024-09-12T02:07:06.172327+0000","last_clean":"2024-09-12T02:07:06.172327+0000","last_became_active":"2024-09-12T02:07:05.181048+0000","last_became_peered":"2024-09-12T02:07:05.181048+0000","last_unstale":"2024-09-12T02:07:06.172327+0000","last_undegraded":"2024-09-12T02:07:06.172327+0000","last_fullsized":"2024-09-12T02:07:06.172327+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:04.428549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164859+0000","last_change":"2024-09-12T02:07:06.180329+0000","last_active":"2024-09-12T02:07:07.164859+0000","last_peered":"2024-09-12T02:07:07.164859+0000","last_clean":"2024-09-12T02:07:07.164859+0000","last_became_active":"2024-09-12T02:07:06.179876+0000","last_became_peered":"2024-09-12T02:07:06.179876+0000","last_unstale":"2024-09-12T02:07:07.164859+0000","last_undegraded":"2024-09-12T02:07:07.164859+0000","last_fullsized":"2024-09-12T02:07:07.164859+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:47.471652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"144'8","reported_seq":22,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160927+0000","last_change":"2024-09-12T02:07:05.173863+0000","last_active":"2024-09-12T02:07:07.160927+0000","last_peered":"2024-09-12T02:07:07.160927+0000","last_clean":"2024-09-12T02:07:07.160927+0000","last_became_active":"2024-09-12T02:07:05.173135+0000","last_became_peered":"2024-09-12T02:07:05.173135+0000","last_unstale":"2024-09-12T02:07:07.160927+0000","last_undegraded":"2024-09-12T02:07:07.160927+0000","last_fullsized":"2024-09-12T02:07:07.160927+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:25.840163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188208+0000","last_change":"2024-09-12T02:07:06.183288+0000","last_active":"2024-09-12T02:07:06.188208+0000","last_peered":"2024-09-12T02:07:06.188208+0000","last_clean":"2024-09-12T02:07:06.188208+0000","last_became_active":"2024-09-12T02:07:06.182990+0000","last_became_peered":"2024-09-12T02:07:06.182990+0000","last_unstale":"2024-09-12T02:07:06.188208+0000","last_undegraded":"2024-09-12T02:07:06.188208+0000","last_fullsized":"2024-09-12T02:07:06.188208+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:11.283654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"144'1","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162086+0000","last_change":"2024-09-12T02:07:05.169182+0000","last_active":"2024-09-12T02:07:07.162086+0000","last_peered":"2024-09-12T02:07:07.162086+0000","last_clean":"2024-09-12T02:07:07.162086+0000","last_became_active":"2024-09-12T02:07:05.168915+0000","last_became_peered":"2024-09-12T02:07:05.168915+0000","last_unstale":"2024-09-12T02:07:07.162086+0000","last_undegraded":"2024-09-12T02:07:07.162086+0000","last_fullsized":"2024-09-12T02:07:07.162086+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:11.978173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161957+0000","last_change":"2024-09-12T02:07:06.173564+0000","last_active":"2024-09-12T02:07:07.161957+0000","last_peered":"2024-09-12T02:07:07.161957+0000","last_clean":"2024-09-12T02:07:07.161957+0000","last_became_active":"2024-09-12T02:07:06.173302+0000","last_became_peered":"2024-09-12T02:07:06.173302+0000","last_unstale":"2024-09-12T02:07:07.161957+0000","last_undegraded":"2024-09-12T02:07:07.161957+0000","last_fullsized":"2024-09-12T02:07:07.161957+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:06.437712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"144'1","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152303+0000","last_change":"2024-09-12T02:07:05.169086+0000","last_active":"2024-09-12T02:07:08.152303+0000","last_peered":"2024-09-12T02:07:08.152303+0000","last_clean":"2024-09-12T02:07:08.152303+0000","last_became_active":"2024-09-12T02:07:05.168800+0000","last_became_peered":"2024-09-12T02:07:05.168800+0000","last_unstale":"2024-09-12T02:07:08.152303+0000","last_undegraded":"2024-09-12T02:07:08.152303+0000","last_fullsized":"2024-09-12T02:07:08.152303+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:14.959321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160154+0000","last_change":"2024-09-12T02:07:06.175575+0000","last_active":"2024-09-12T02:07:07.160154+0000","last_peered":"2024-09-12T02:07:07.160154+0000","last_clean":"2024-09-12T02:07:07.160154+0000","last_became_active":"2024-09-12T02:07:06.175285+0000","last_became_peered":"2024-09-12T02:07:06.175285+0000","last_unstale":"2024-09-12T02:07:07.160154+0000","last_undegraded":"2024-09-12T02:07:07.160154+0000","last_fullsized":"2024-09-12T02:07:07.160154+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:54.606749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166583+0000","last_change":"2024-09-12T02:07:05.167828+0000","last_active":"2024-09-12T02:07:07.166583+0000","last_peered":"2024-09-12T02:07:07.166583+0000","last_clean":"2024-09-12T02:07:07.166583+0000","last_became_active":"2024-09-12T02:07:05.167536+0000","last_became_peered":"2024-09-12T02:07:05.167536+0000","last_unstale":"2024-09-12T02:07:07.166583+0000","last_undegraded":"2024-09-12T02:07:07.166583+0000","last_fullsized":"2024-09-12T02:07:07.166583+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:08.520003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164691+0000","last_change":"2024-09-12T02:07:06.186836+0000","last_active":"2024-09-12T02:07:07.164691+0000","last_peered":"2024-09-12T02:07:07.164691+0000","last_clean":"2024-09-12T02:07:07.164691+0000","last_became_active":"2024-09-12T02:07:06.186490+0000","last_became_peered":"2024-09-12T02:07:06.186490+0000","last_unstale":"2024-09-12T02:07:07.164691+0000","last_undegraded":"2024-09-12T02:07:07.164691+0000","last_fullsized":"2024-09-12T02:07:07.164691+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:52.748269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"144'2","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.182591+0000","last_change":"2024-09-12T02:07:05.178914+0000","last_active":"2024-09-12T02:07:06.182591+0000","last_peered":"2024-09-12T02:07:06.182591+0000","last_clean":"2024-09-12T02:07:06.182591+0000","last_became_active":"2024-09-12T02:07:05.178630+0000","last_became_peered":"2024-09-12T02:07:05.178630+0000","last_unstale":"2024-09-12T02:07:06.182591+0000","last_undegraded":"2024-09-12T02:07:06.182591+0000","last_fullsized":"2024-09-12T02:07:06.182591+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:53.781606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164915+0000","last_change":"2024-09-12T02:07:06.172346+0000","last_active":"2024-09-12T02:07:07.164915+0000","last_peered":"2024-09-12T02:07:07.164915+0000","last_clean":"2024-09-12T02:07:07.164915+0000","last_became_active":"2024-09-12T02:07:06.171758+0000","last_became_peered":"2024-09-12T02:07:06.171758+0000","last_unstale":"2024-09-12T02:07:07.164915+0000","last_undegraded":"2024-09-12T02:07:07.164915+0000","last_fullsized":"2024-09-12T02:07:07.164915+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:57.712570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.170854+0000","last_change":"2024-09-12T02:07:05.181025+0000","last_active":"2024-09-12T02:07:06.170854+0000","last_peered":"2024-09-12T02:07:06.170854+0000","last_clean":"2024-09-12T02:07:06.170854+0000","last_became_active":"2024-09-12T02:07:05.180707+0000","last_became_peered":"2024-09-12T02:07:05.180707+0000","last_unstale":"2024-09-12T02:07:06.170854+0000","last_undegraded":"2024-09-12T02:07:06.170854+0000","last_fullsized":"2024-09-12T02:07:06.170854+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:51.480271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.181619+0000","last_change":"2024-09-12T02:07:06.175102+0000","last_active":"2024-09-12T02:07:06.181619+0000","last_peered":"2024-09-12T02:07:06.181619+0000","last_clean":"2024-09-12T02:07:06.181619+0000","last_became_active":"2024-09-12T02:07:06.174811+0000","last_became_peered":"2024-09-12T02:07:06.174811+0000","last_unstale":"2024-09-12T02:07:06.181619+0000","last_undegraded":"2024-09-12T02:07:06.181619+0000","last_fullsized":"2024-09-12T02:07:06.181619+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:48.029678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161349+0000","last_change":"2024-09-12T02:07:05.170014+0000","last_active":"2024-09-12T02:07:07.161349+0000","last_peered":"2024-09-12T02:07:07.161349+0000","last_clean":"2024-09-12T02:07:07.161349+0000","last_became_active":"2024-09-12T02:07:05.169731+0000","last_became_peered":"2024-09-12T02:07:05.169731+0000","last_unstale":"2024-09-12T02:07:07.161349+0000","last_undegraded":"2024-09-12T02:07:07.161349+0000","last_fullsized":"2024-09-12T02:07:07.161349+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:48.278776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188982+0000","last_change":"2024-09-12T02:07:06.186018+0000","last_active":"2024-09-12T02:07:06.188982+0000","last_peered":"2024-09-12T02:07:06.188982+0000","last_clean":"2024-09-12T02:07:06.188982+0000","last_became_active":"2024-09-12T02:07:06.185734+0000","last_became_peered":"2024-09-12T02:07:06.185734+0000","last_unstale":"2024-09-12T02:07:06.188982+0000","last_undegraded":"2024-09-12T02:07:06.188982+0000","last_fullsized":"2024-09-12T02:07:06.188982+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:45.609305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.171753+0000","last_change":"2024-09-12T02:07:05.178455+0000","last_active":"2024-09-12T02:07:06.171753+0000","last_peered":"2024-09-12T02:07:06.171753+0000","last_clean":"2024-09-12T02:07:06.171753+0000","last_became_active":"2024-09-12T02:07:05.178133+0000","last_became_peered":"2024-09-12T02:07:05.178133+0000","last_unstale":"2024-09-12T02:07:06.171753+0000","last_undegraded":"2024-09-12T02:07:06.171753+0000","last_fullsized":"2024-09-12T02:07:06.171753+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:55.251394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164380+0000","last_change":"2024-09-12T02:07:06.184322+0000","last_active":"2024-09-12T02:07:07.164380+0000","last_peered":"2024-09-12T02:07:07.164380+0000","last_clean":"2024-09-12T02:07:07.164380+0000","last_became_active":"2024-09-12T02:07:06.184012+0000","last_became_peered":"2024-09-12T02:07:06.184012+0000","last_unstale":"2024-09-12T02:07:07.164380+0000","last_undegraded":"2024-09-12T02:07:07.164380+0000","last_fullsized":"2024-09-12T02:07:07.164380+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:36.512194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160218+0000","last_change":"2024-09-12T02:07:05.177856+0000","last_active":"2024-09-12T02:07:07.160218+0000","last_peered":"2024-09-12T02:07:07.160218+0000","last_clean":"2024-09-12T02:07:07.160218+0000","last_became_active":"2024-09-12T02:07:05.177540+0000","last_became_peered":"2024-09-12T02:07:05.177540+0000","last_unstale":"2024-09-12T02:07:07.160218+0000","last_undegraded":"2024-09-12T02:07:07.160218+0000","last_fullsized":"2024-09-12T02:07:07.160218+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:10.671601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161000+0000","last_change":"2024-09-12T02:07:06.166133+0000","last_active":"2024-09-12T02:07:07.161000+0000","last_peered":"2024-09-12T02:07:07.161000+0000","last_clean":"2024-09-12T02:07:07.161000+0000","last_became_active":"2024-09-12T02:07:06.165891+0000","last_became_peered":"2024-09-12T02:07:06.165891+0000","last_unstale":"2024-09-12T02:07:07.161000+0000","last_undegraded":"2024-09-12T02:07:07.161000+0000","last_fullsized":"2024-09-12T02:07:07.161000+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:57.379027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"145'1","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.165996+0000","last_change":"2024-09-12T02:07:05.168685+0000","last_active":"2024-09-12T02:07:07.165996+0000","last_peered":"2024-09-12T02:07:07.165996+0000","last_clean":"2024-09-12T02:07:07.165996+0000","last_became_active":"2024-09-12T02:07:05.168379+0000","last_became_peered":"2024-09-12T02:07:05.168379+0000","last_unstale":"2024-09-12T02:07:07.165996+0000","last_undegraded":"2024-09-12T02:07:07.165996+0000","last_fullsized":"2024-09-12T02:07:07.165996+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:55.479228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.181044+0000","last_change":"2024-09-12T02:07:06.168431+0000","last_active":"2024-09-12T02:07:06.181044+0000","last_peered":"2024-09-12T02:07:06.181044+0000","last_clean":"2024-09-12T02:07:06.181044+0000","last_became_active":"2024-09-12T02:07:06.168080+0000","last_became_peered":"2024-09-12T02:07:06.168080+0000","last_unstale":"2024-09-12T02:07:06.181044+0000","last_undegraded":"2024-09-12T02:07:06.181044+0000","last_fullsized":"2024-09-12T02:07:06.181044+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:42.705993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162294+0000","last_change":"2024-09-12T02:07:05.168316+0000","last_active":"2024-09-12T02:07:07.162294+0000","last_peered":"2024-09-12T02:07:07.162294+0000","last_clean":"2024-09-12T02:07:07.162294+0000","last_became_active":"2024-09-12T02:07:05.168016+0000","last_became_peered":"2024-09-12T02:07:05.168016+0000","last_unstale":"2024-09-12T02:07:07.162294+0000","last_undegraded":"2024-09-12T02:07:07.162294+0000","last_fullsized":"2024-09-12T02:07:07.162294+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:52.174429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166763+0000","last_change":"2024-09-12T02:07:06.177410+0000","last_active":"2024-09-12T02:07:07.166763+0000","last_peered":"2024-09-12T02:07:07.166763+0000","last_clean":"2024-09-12T02:07:07.166763+0000","last_became_active":"2024-09-12T02:07:06.177122+0000","last_became_peered":"2024-09-12T02:07:06.177122+0000","last_unstale":"2024-09-12T02:07:07.166763+0000","last_undegraded":"2024-09-12T02:07:07.166763+0000","last_fullsized":"2024-09-12T02:07:07.166763+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:36.663166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160105+0000","last_change":"2024-09-12T02:07:05.169123+0000","last_active":"2024-09-12T02:07:07.160105+0000","last_peered":"2024-09-12T02:07:07.160105+0000","last_clean":"2024-09-12T02:07:07.160105+0000","last_became_active":"2024-09-12T02:07:05.168828+0000","last_became_peered":"2024-09-12T02:07:05.168828+0000","last_unstale":"2024-09-12T02:07:07.160105+0000","last_undegraded":"2024-09-12T02:07:07.160105+0000","last_fullsized":"2024-09-12T02:07:07.160105+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:10.926179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188173+0000","last_change":"2024-09-12T02:07:06.184423+0000","last_active":"2024-09-12T02:07:06.188173+0000","last_peered":"2024-09-12T02:07:06.188173+0000","last_clean":"2024-09-12T02:07:06.188173+0000","last_became_active":"2024-09-12T02:07:06.184135+0000","last_became_peered":"2024-09-12T02:07:06.184135+0000","last_unstale":"2024-09-12T02:07:06.188173+0000","last_undegraded":"2024-09-12T02:07:06.188173+0000","last_fullsized":"2024-09-12T02:07:06.188173+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:24.456509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161457+0000","last_change":"2024-09-12T02:07:05.167597+0000","last_active":"2024-09-12T02:07:07.161457+0000","last_peered":"2024-09-12T02:07:07.161457+0000","last_clean":"2024-09-12T02:07:07.161457+0000","last_became_active":"2024-09-12T02:07:05.167331+0000","last_became_peered":"2024-09-12T02:07:05.167331+0000","last_unstale":"2024-09-12T02:07:07.161457+0000","last_undegraded":"2024-09-12T02:07:07.161457+0000","last_fullsized":"2024-09-12T02:07:07.161457+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:51.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.191710+0000","last_change":"2024-09-12T02:07:06.188417+0000","last_active":"2024-09-12T02:07:06.191710+0000","last_peered":"2024-09-12T02:07:06.191710+0000","last_clean":"2024-09-12T02:07:06.191710+0000","last_became_active":"2024-09-12T02:07:06.188130+0000","last_became_peered":"2024-09-12T02:07:06.188130+0000","last_unstale":"2024-09-12T02:07:06.191710+0000","last_undegraded":"2024-09-12T02:07:06.191710+0000","last_fullsized":"2024-09-12T02:07:06.191710+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:30.566436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.171063+0000","last_change":"2024-09-12T02:07:05.178730+0000","last_active":"2024-09-12T02:07:06.171063+0000","last_peered":"2024-09-12T02:07:06.171063+0000","last_clean":"2024-09-12T02:07:06.171063+0000","last_became_active":"2024-09-12T02:07:05.178430+0000","last_became_peered":"2024-09-12T02:07:05.178430+0000","last_unstale":"2024-09-12T02:07:06.171063+0000","last_undegraded":"2024-09-12T02:07:06.171063+0000","last_fullsized":"2024-09-12T02:07:06.171063+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:45.524547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152464+0000","last_change":"2024-09-12T02:07:06.183861+0000","last_active":"2024-09-12T02:07:08.152464+0000","last_peered":"2024-09-12T02:07:08.152464+0000","last_clean":"2024-09-12T02:07:08.152464+0000","last_became_active":"2024-09-12T02:07:06.183536+0000","last_became_peered":"2024-09-12T02:07:06.183536+0000","last_unstale":"2024-09-12T02:07:08.152464+0000","last_undegraded":"2024-09-12T02:07:08.152464+0000","last_fullsized":"2024-09-12T02:07:08.152464+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:34.648219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161460+0000","last_change":"2024-09-12T02:07:05.168669+0000","last_active":"2024-09-12T02:07:07.161460+0000","last_peered":"2024-09-12T02:07:07.161460+0000","last_clean":"2024-09-12T02:07:07.161460+0000","last_became_active":"2024-09-12T02:07:05.168394+0000","last_became_peered":"2024-09-12T02:07:05.168394+0000","last_unstale":"2024-09-12T02:07:07.161460+0000","last_undegraded":"2024-09-12T02:07:07.161460+0000","last_fullsized":"2024-09-12T02:07:07.161460+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:00.541517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166993+0000","last_change":"2024-09-12T02:07:06.178232+0000","last_active":"2024-09-12T02:07:07.166993+0000","last_peered":"2024-09-12T02:07:07.166993+0000","last_clean":"2024-09-12T02:07:07.166993+0000","last_became_active":"2024-09-12T02:07:06.177956+0000","last_became_peered":"2024-09-12T02:07:06.177956+0000","last_unstale":"2024-09-12T02:07:07.166993+0000","last_undegraded":"2024-09-12T02:07:07.166993+0000","last_fullsized":"2024-09-12T02:07:07.166993+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:20.796287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.171914+0000","last_change":"2024-09-12T02:07:05.179353+0000","last_active":"2024-09-12T02:07:06.171914+0000","last_peered":"2024-09-12T02:07:06.171914+0000","last_clean":"2024-09-12T02:07:06.171914+0000","last_became_active":"2024-09-12T02:07:05.178558+0000","last_became_peered":"2024-09-12T02:07:05.178558+0000","last_unstale":"2024-09-12T02:07:06.171914+0000","last_undegraded":"2024-09-12T02:07:06.171914+0000","last_fullsized":"2024-09-12T02:07:06.171914+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:39.636624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166714+0000","last_change":"2024-09-12T02:07:06.174986+0000","last_active":"2024-09-12T02:07:07.166714+0000","last_peered":"2024-09-12T02:07:07.166714+0000","last_clean":"2024-09-12T02:07:07.166714+0000","last_became_active":"2024-09-12T02:07:06.174725+0000","last_became_peered":"2024-09-12T02:07:06.174725+0000","last_unstale":"2024-09-12T02:07:07.166714+0000","last_undegraded":"2024-09-12T02:07:07.166714+0000","last_fullsized":"2024-09-12T02:07:07.166714+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:01.767337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"144'2","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.190787+0000","last_change":"2024-09-12T02:07:05.179366+0000","last_active":"2024-09-12T02:07:06.190787+0000","last_peered":"2024-09-12T02:07:06.190787+0000","last_clean":"2024-09-12T02:07:06.190787+0000","last_became_active":"2024-09-12T02:07:05.179079+0000","last_became_peered":"2024-09-12T02:07:05.179079+0000","last_unstale":"2024-09-12T02:07:06.190787+0000","last_undegraded":"2024-09-12T02:07:06.190787+0000","last_fullsized":"2024-09-12T02:07:06.190787+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:43.865590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":407,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152096+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T02:07:08.152096+0000","last_peered":"2024-09-12T02:07:08.152096+0000","last_clean":"2024-09-12T02:07:08.152096+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T02:07:08.152096+0000","last_undegraded":"2024-09-12T02:07:08.152096+0000","last_fullsized":"2024-09-12T02:07:08.152096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509581,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37772,"kb_used_data":2424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334068,"statfs":{"total":96636764160,"available":96598085632,"internally_reserved":0,"allocated":2482176,"data_stored":1546497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509580,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41372,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330468,"statfs":{"total":96636764160,"available":96594399232,"internally_reserved":0,"allocated":1900544,"data_stored":958185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509581,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1880064,"data_stored":955969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542285,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1871872,"data_stored":949859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37180,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334660,"statfs":{"total":96636764160,"available":96598691840,"internally_reserved":0,"allocated":1871872,"data_stored":949311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37188,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334652,"statfs":{"total":96636764160,"available":96598683648,"internally_reserved":0,"allocated":1884160,"data_stored":956003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542285,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41948,"kb_used_data":2432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329892,"statfs":{"total":96636764160,"available":96593809408,"internally_reserved":0,"allocated":2490368,"data_stored":1548039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574989,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37188,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334652,"statfs":{"total":96636764160,"available":96598683648,"internally_reserved":0,"allocated":1875968,"data_stored":949369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:07:10.454 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T02:07:10.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.591+0000 7fa366e96640 1 Processor -- start 2024-09-12T02:07:10.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.591+0000 7fa366e96640 1 -- start start 2024-09-12T02:07:10.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.592+0000 7fa366e96640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa360161c80 0x7fa36006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.592+0000 7fa366e96640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa360162060 0x7fa3600b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.592+0000 7fa366e96640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa36006e870 con 0x7fa3600b64b0 2024-09-12T02:07:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.592+0000 7fa366e96640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa36006d9f0 con 0x7fa360161c80 2024-09-12T02:07:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.592+0000 7fa366e96640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa36006dcd0 con 0x7fa360162060 2024-09-12T02:07:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.592+0000 7fa364c32640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa360161c80 0x7fa36006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.592+0000 7fa364c32640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa360161c80 0x7fa36006e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54802/0 (socket says 172.21.15.19:54802) 2024-09-12T02:07:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.592+0000 7fa364c32640 1 -- 172.21.15.19:0/594765616 learned_addr learned my addr 172.21.15.19:0/594765616 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.592+0000 7fa364c32640 1 -- 172.21.15.19:0/594765616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa360162060 msgr2=0x7fa3600b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.592+0000 7fa364c32640 1 --2- 172.21.15.19:0/594765616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa360162060 0x7fa3600b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.592+0000 7fa364c32640 1 -- 172.21.15.19:0/594765616 >> v1:172.21.15.135:6789/0 conn(0x7fa3600b64b0 legacy=0x7fa360162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.592+0000 7fa364c32640 1 -- 172.21.15.19:0/594765616 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36006dfb0 con 0x7fa360161c80 2024-09-12T02:07:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.593+0000 7fa364c32640 1 --2- 172.21.15.19:0/594765616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa360161c80 0x7fa36006e330 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7fa354009870 tx=0x7fa35402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca441c9fd2594491 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.593+0000 7fa35f7fe640 1 -- 172.21.15.19:0/594765616 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa354037070 con 0x7fa360161c80 2024-09-12T02:07:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.593+0000 7fa35f7fe640 1 -- 172.21.15.19:0/594765616 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa354032440 con 0x7fa360161c80 2024-09-12T02:07:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.593+0000 7fa35f7fe640 1 -- 172.21.15.19:0/594765616 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa354032810 con 0x7fa360161c80 2024-09-12T02:07:10.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.594+0000 7fa366e96640 1 -- 172.21.15.19:0/594765616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa360161c80 msgr2=0x7fa36006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.594+0000 7fa366e96640 1 --2- 172.21.15.19:0/594765616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa360161c80 0x7fa36006e330 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7fa354009870 tx=0x7fa35402a230 comp rx=0 tx=0).stop 2024-09-12T02:07:10.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.594+0000 7fa366e96640 1 -- 172.21.15.19:0/594765616 shutdown_connections 2024-09-12T02:07:10.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.594+0000 7fa366e96640 1 --2- 172.21.15.19:0/594765616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa360162060 0x7fa3600b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.594+0000 7fa366e96640 1 --2- 172.21.15.19:0/594765616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa360161c80 0x7fa36006e330 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.594+0000 7fa366e96640 1 -- 172.21.15.19:0/594765616 >> 172.21.15.19:0/594765616 conn(0x7fa3600d44f0 msgr2=0x7fa3600d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:10.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.594+0000 7fa366e96640 1 -- 172.21.15.19:0/594765616 shutdown_connections 2024-09-12T02:07:10.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.594+0000 7fa366e96640 1 -- 172.21.15.19:0/594765616 wait complete. 2024-09-12T02:07:10.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.595+0000 7fa366e96640 1 Processor -- start 2024-09-12T02:07:10.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.595+0000 7fa366e96640 1 -- start start 2024-09-12T02:07:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.596+0000 7fa366e96640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3600b64b0 0x7fa360156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.596+0000 7fa366e96640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa360161c80 0x7fa3601f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.596+0000 7fa366e96640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360162060 0x7fa3600b9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.596+0000 7fa366e96640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa3600d2a10 con 0x7fa3600b64b0 2024-09-12T02:07:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.596+0000 7fa366e96640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa3600d2890 con 0x7fa360162060 2024-09-12T02:07:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.596+0000 7fa366e96640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa3600b6960 con 0x7fa360161c80 2024-09-12T02:07:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.596+0000 7fa364c32640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3600b64b0 0x7fa360156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.596+0000 7fa364c32640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3600b64b0 0x7fa360156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54812/0 (socket says 172.21.15.19:54812) 2024-09-12T02:07:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.596+0000 7fa364c32640 1 -- 172.21.15.19:0/2855579661 learned_addr learned my addr 172.21.15.19:0/2855579661 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.596+0000 7fa365433640 1 --2- 172.21.15.19:0/2855579661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360162060 0x7fa3600b9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.596+0000 7fa35ffff640 1 --2- 172.21.15.19:0/2855579661 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa360161c80 0x7fa3601f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.596+0000 7fa364c32640 1 -- 172.21.15.19:0/2855579661 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa360161c80 msgr2=0x7fa3601f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.596+0000 7fa364c32640 1 --2- 172.21.15.19:0/2855579661 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa360161c80 0x7fa3601f5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.596+0000 7fa364c32640 1 -- 172.21.15.19:0/2855579661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360162060 msgr2=0x7fa3600b9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.596+0000 7fa364c32640 1 --2- 172.21.15.19:0/2855579661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360162060 0x7fa3600b9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.596+0000 7fa364c32640 1 -- 172.21.15.19:0/2855579661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3601f51f0 con 0x7fa3600b64b0 2024-09-12T02:07:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.596+0000 7fa35ffff640 1 --2- 172.21.15.19:0/2855579661 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa360161c80 0x7fa3601f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.596+0000 7fa364c32640 1 --2- 172.21.15.19:0/2855579661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3600b64b0 0x7fa360156780 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7fa354009870 tx=0x7fa3540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.597+0000 7fa35d7fa640 1 -- 172.21.15.19:0/2855579661 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa354041070 con 0x7fa3600b64b0 2024-09-12T02:07:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.597+0000 7fa35d7fa640 1 -- 172.21.15.19:0/2855579661 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa35403c870 con 0x7fa3600b64b0 2024-09-12T02:07:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.597+0000 7fa366e96640 1 -- 172.21.15.19:0/2855579661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3601f54d0 con 0x7fa3600b64b0 2024-09-12T02:07:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.597+0000 7fa35d7fa640 1 -- 172.21.15.19:0/2855579661 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa354037040 con 0x7fa3600b64b0 2024-09-12T02:07:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.597+0000 7fa366e96640 1 -- 172.21.15.19:0/2855579661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3601f5a90 con 0x7fa3600b64b0 2024-09-12T02:07:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.598+0000 7fa366e96640 1 -- 172.21.15.19:0/2855579661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa36006e330 con 0x7fa3600b64b0 2024-09-12T02:07:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.598+0000 7fa35d7fa640 1 -- 172.21.15.19:0/2855579661 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa354044070 con 0x7fa3600b64b0 2024-09-12T02:07:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.598+0000 7fa35d7fa640 1 --2- 172.21.15.19:0/2855579661 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa34406be30 0x7fa34406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.599+0000 7fa35d7fa640 1 -- 172.21.15.19:0/2855579661 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6101+0+0 (secure 0 0 0) 0x7fa3540abb60 con 0x7fa3600b64b0 2024-09-12T02:07:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.599+0000 7fa35ffff640 1 --2- 172.21.15.19:0/2855579661 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa34406be30 0x7fa34406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.599+0000 7fa35ffff640 1 --2- 172.21.15.19:0/2855579661 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa34406be30 0x7fa34406e2f0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa3600d4050 tx=0x7fa34c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:10.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.603+0000 7fa35d7fa640 1 -- 172.21.15.19:0/2855579661 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa36006e870 con 0x7fa3600b64b0 2024-09-12T02:07:10.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.846+0000 7fa366e96640 1 -- 172.21.15.19:0/2855579661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa3601633b0 con 0x7fa3600b64b0 2024-09-12T02:07:10.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.847+0000 7fa35d7fa640 1 -- 172.21.15.19:0/2855579661 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1059 (secure 0 0 0) 0x7fa354079d30 con 0x7fa3600b64b0 2024-09-12T02:07:10.847 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:10.847 INFO:teuthology.orchestra.run.smithi019.stdout:{"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":698,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":145,"num_osds":8,"num_up_osds":8,"osd_up_since":1726106143,"num_in_osds":8,"osd_in_since":1726106133,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":305872896,"bytes_avail":772788240384,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":331,"btime":"2024-09-12T02:07:08:765046+0000","id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":10653}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":48,"modified":"2024-09-12T02:06:42.245791+0000","services":{}},"progress_events":{}} 2024-09-12T02:07:10.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.849+0000 7fa366e96640 1 -- 172.21.15.19:0/2855579661 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa34406be30 msgr2=0x7fa34406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.849+0000 7fa366e96640 1 --2- 172.21.15.19:0/2855579661 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa34406be30 0x7fa34406e2f0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa3600d4050 tx=0x7fa34c008040 comp rx=0 tx=0).stop 2024-09-12T02:07:10.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.849+0000 7fa366e96640 1 -- 172.21.15.19:0/2855579661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3600b64b0 msgr2=0x7fa360156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.849+0000 7fa366e96640 1 --2- 172.21.15.19:0/2855579661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3600b64b0 0x7fa360156780 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7fa354009870 tx=0x7fa3540046c0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.849+0000 7fa366e96640 1 -- 172.21.15.19:0/2855579661 shutdown_connections 2024-09-12T02:07:10.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.849+0000 7fa366e96640 1 --2- 172.21.15.19:0/2855579661 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fa34406be30 0x7fa34406e2f0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.849+0000 7fa366e96640 1 --2- 172.21.15.19:0/2855579661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360162060 0x7fa3600b9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.849+0000 7fa366e96640 1 --2- 172.21.15.19:0/2855579661 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa360161c80 0x7fa3601f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.849+0000 7fa366e96640 1 --2- 172.21.15.19:0/2855579661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3600b64b0 0x7fa360156780 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.849+0000 7fa366e96640 1 -- 172.21.15.19:0/2855579661 >> 172.21.15.19:0/2855579661 conn(0x7fa3600d44f0 msgr2=0x7fa360162490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:10.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.849+0000 7fa366e96640 1 -- 172.21.15.19:0/2855579661 shutdown_connections 2024-09-12T02:07:10.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.849+0000 7fa366e96640 1 -- 172.21.15.19:0/2855579661 wait complete. 2024-09-12T02:07:10.860 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T02:07:10.861 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:07:10.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.962+0000 7f388f5fd640 1 Processor -- start 2024-09-12T02:07:10.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.962+0000 7f388f5fd640 1 -- start start 2024-09-12T02:07:10.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.963+0000 7f388f5fd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f388806dbd0 0x7f388809b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.963+0000 7f388f5fd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38880d1970 con 0x7f38880d1540 2024-09-12T02:07:10.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.963+0000 7f388f5fd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38880d0780 con 0x7f388815e740 2024-09-12T02:07:10.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.963+0000 7f388f5fd640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f388815eb20 con 0x7f388806dbd0 2024-09-12T02:07:10.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.963+0000 7f388cb98640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f38880d1540 0x7f3888070160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56416/0 (socket says 172.21.15.19:56416) 2024-09-12T02:07:10.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.963+0000 7f388cb98640 1 -- 172.21.15.19:0/3416086155 learned_addr learned my addr 172.21.15.19:0/3416086155 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:10.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.963+0000 7f388db9a640 1 --2- 172.21.15.19:0/3416086155 >> v2:172.21.15.135:3300/0 conn(0x7f388806dbd0 0x7f388809b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.963+0000 7f387ffff640 1 -- 172.21.15.19:0/3416086155 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2278540312 0 0) 0x7f38880d1970 con 0x7f38880d1540 2024-09-12T02:07:10.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.963+0000 7f387ffff640 1 -- 172.21.15.19:0/3416086155 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3874003520 con 0x7f38880d1540 2024-09-12T02:07:10.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.964+0000 7f387ffff640 1 -- 172.21.15.19:0/3416086155 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1366416333 0 0) 0x7f38880d0780 con 0x7f388815e740 2024-09-12T02:07:10.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.964+0000 7f387ffff640 1 -- 172.21.15.19:0/3416086155 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38880d1970 con 0x7f388815e740 2024-09-12T02:07:10.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.964+0000 7f387ffff640 1 -- 172.21.15.19:0/3416086155 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2827677351 0 0) 0x7f3874003520 con 0x7f38880d1540 2024-09-12T02:07:10.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.964+0000 7f388db9a640 1 -- 172.21.15.19:0/3416086155 >> v1:172.21.15.135:6789/0 conn(0x7f388815e740 legacy=0x7f388806d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.964+0000 7f388db9a640 1 -- 172.21.15.19:0/3416086155 >> v1:172.21.15.19:6789/0 conn(0x7f38880d1540 legacy=0x7f3888070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.964+0000 7f388db9a640 1 -- 172.21.15.19:0/3416086155 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38880d0a60 con 0x7f388806dbd0 2024-09-12T02:07:10.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.965+0000 7f388db9a640 1 --2- 172.21.15.19:0/3416086155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f388806dbd0 0x7f388809b690 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3880009d90 tx=0x7f388002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56d3656545ff9f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:10.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.965+0000 7f387ffff640 1 -- 172.21.15.19:0/3416086155 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878001670 con 0x7f388806dbd0 2024-09-12T02:07:10.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.965+0000 7f387ffff640 1 -- 172.21.15.19:0/3416086155 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3880007540 con 0x7f388806dbd0 2024-09-12T02:07:10.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.965+0000 7f387ffff640 1 -- 172.21.15.19:0/3416086155 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38800078f0 con 0x7f388806dbd0 2024-09-12T02:07:10.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.965+0000 7f388f5fd640 1 -- 172.21.15.19:0/3416086155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f388806dbd0 msgr2=0x7f388809b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.965+0000 7f388f5fd640 1 --2- 172.21.15.19:0/3416086155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f388806dbd0 0x7f388809b690 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3880009d90 tx=0x7f388002a710 comp rx=0 tx=0).stop 2024-09-12T02:07:10.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.965+0000 7f388f5fd640 1 -- 172.21.15.19:0/3416086155 shutdown_connections 2024-09-12T02:07:10.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.965+0000 7f388f5fd640 1 --2- 172.21.15.19:0/3416086155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f388806dbd0 0x7f388809b690 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.965+0000 7f388f5fd640 1 -- 172.21.15.19:0/3416086155 >> 172.21.15.19:0/3416086155 conn(0x7f38880d23a0 msgr2=0x7f38880d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:10.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.965+0000 7f388f5fd640 1 -- 172.21.15.19:0/3416086155 shutdown_connections 2024-09-12T02:07:10.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.965+0000 7f388f5fd640 1 -- 172.21.15.19:0/3416086155 wait complete. 2024-09-12T02:07:10.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.967+0000 7f388f5fd640 1 Processor -- start 2024-09-12T02:07:10.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.967+0000 7f388f5fd640 1 -- start start 2024-09-12T02:07:10.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.967+0000 7f388f5fd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f388806dbd0 0x7f38880b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.967+0000 7f388f5fd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38880d1540 0x7f3888157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.967+0000 7f388f5fd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f388815e740 0x7f38880c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.967+0000 7f388f5fd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f388806dfe0 con 0x7f388806dbd0 2024-09-12T02:07:10.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.967+0000 7f388f5fd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f38880d1020 con 0x7f38880d1540 2024-09-12T02:07:10.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.967+0000 7f388f5fd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f388806cd20 con 0x7f388815e740 2024-09-12T02:07:10.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.967+0000 7f388d399640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f388806dbd0 0x7f38880b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.967+0000 7f388d399640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f388806dbd0 0x7f38880b6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54822/0 (socket says 172.21.15.19:54822) 2024-09-12T02:07:10.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.967+0000 7f388d399640 1 -- 172.21.15.19:0/79528851 learned_addr learned my addr 172.21.15.19:0/79528851 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:10.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.968+0000 7f388db9a640 1 --2- 172.21.15.19:0/79528851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f388815e740 0x7f38880c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.968+0000 7f388cb98640 1 --2- 172.21.15.19:0/79528851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38880d1540 0x7f3888157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.968+0000 7f388d399640 1 -- 172.21.15.19:0/79528851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f388815e740 msgr2=0x7f38880c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.968+0000 7f388d399640 1 --2- 172.21.15.19:0/79528851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f388815e740 0x7f38880c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.968+0000 7f388d399640 1 -- 172.21.15.19:0/79528851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38880d1540 msgr2=0x7f3888157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.968+0000 7f388d399640 1 --2- 172.21.15.19:0/79528851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38880d1540 0x7f3888157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.968+0000 7f388d399640 1 -- 172.21.15.19:0/79528851 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38880b71d0 con 0x7f388806dbd0 2024-09-12T02:07:10.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.968+0000 7f388d399640 1 --2- 172.21.15.19:0/79528851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f388806dbd0 0x7f38880b6b40 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f388400c430 tx=0x7f388400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:10.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.968+0000 7f387dffb640 1 -- 172.21.15.19:0/79528851 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3884017070 con 0x7f388806dbd0 2024-09-12T02:07:10.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.968+0000 7f387dffb640 1 -- 172.21.15.19:0/79528851 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38840052f0 con 0x7f388806dbd0 2024-09-12T02:07:10.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.968+0000 7f388f5fd640 1 -- 172.21.15.19:0/79528851 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38881e7f80 con 0x7f388806dbd0 2024-09-12T02:07:10.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.968+0000 7f387dffb640 1 -- 172.21.15.19:0/79528851 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3884003830 con 0x7f388806dbd0 2024-09-12T02:07:10.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.968+0000 7f388f5fd640 1 -- 172.21.15.19:0/79528851 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38881e8540 con 0x7f388806dbd0 2024-09-12T02:07:10.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.969+0000 7f388f5fd640 1 -- 172.21.15.19:0/79528851 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38880d0780 con 0x7f388806dbd0 2024-09-12T02:07:10.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.970+0000 7f387dffb640 1 -- 172.21.15.19:0/79528851 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f388401a070 con 0x7f388806dbd0 2024-09-12T02:07:10.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.970+0000 7f387dffb640 1 --2- 172.21.15.19:0/79528851 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f386c06be30 0x7f386c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.970+0000 7f387dffb640 1 -- 172.21.15.19:0/79528851 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6101+0+0 (secure 0 0 0) 0x7f388408a3e0 con 0x7f388806dbd0 2024-09-12T02:07:10.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.971+0000 7f388cb98640 1 --2- 172.21.15.19:0/79528851 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f386c06be30 0x7f386c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.971+0000 7f388cb98640 1 --2- 172.21.15.19:0/79528851 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f386c06be30 0x7f386c06e2f0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f38880b33a0 tx=0x7f3878009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:10.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:10.975+0000 7f387dffb640 1 -- 172.21.15.19:0/79528851 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3884058c90 con 0x7f388806dbd0 2024-09-12T02:07:11.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:11.150+0000 7f388f5fd640 1 -- 172.21.15.19:0/79528851 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f38880d1cb0 con 0x7f386c06be30 2024-09-12T02:07:11.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:11.156+0000 7f387dffb640 1 -- 172.21.15.19:0/79528851 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252466 (secure 0 0 0) 0x7f38880d1cb0 con 0x7f386c06be30 2024-09-12T02:07:11.161 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:11.163 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T02:07:11.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:11.159+0000 7f388f5fd640 1 -- 172.21.15.19:0/79528851 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f386c06be30 msgr2=0x7f386c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:11.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:11.159+0000 7f388f5fd640 1 --2- 172.21.15.19:0/79528851 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f386c06be30 0x7f386c06e2f0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f38880b33a0 tx=0x7f3878009040 comp rx=0 tx=0).stop 2024-09-12T02:07:11.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:11.159+0000 7f388f5fd640 1 -- 172.21.15.19:0/79528851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f388806dbd0 msgr2=0x7f38880b6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:11.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:11.159+0000 7f388f5fd640 1 --2- 172.21.15.19:0/79528851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f388806dbd0 0x7f38880b6b40 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f388400c430 tx=0x7f388400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:07:11.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:11.159+0000 7f388f5fd640 1 -- 172.21.15.19:0/79528851 shutdown_connections 2024-09-12T02:07:11.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:11.160+0000 7f388f5fd640 1 --2- 172.21.15.19:0/79528851 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f386c06be30 0x7f386c06e2f0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:11.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:11.160+0000 7f388f5fd640 1 --2- 172.21.15.19:0/79528851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f388815e740 0x7f38880c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:11.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:11.160+0000 7f388f5fd640 1 --2- 172.21.15.19:0/79528851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38880d1540 0x7f3888157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:11.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:11.160+0000 7f388f5fd640 1 --2- 172.21.15.19:0/79528851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f388806dbd0 0x7f38880b6b40 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:11.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:11.160+0000 7f388f5fd640 1 -- 172.21.15.19:0/79528851 >> 172.21.15.19:0/79528851 conn(0x7f38880d23a0 msgr2=0x7f38880af240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:11.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:11.160+0000 7f388f5fd640 1 -- 172.21.15.19:0/79528851 shutdown_connections 2024-09-12T02:07:11.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:11.160+0000 7f388f5fd640 1 -- 172.21.15.19:0/79528851 wait complete. 2024-09-12T02:07:11.171 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":482,"stamp":"2024-09-12T02:07:10.252543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":298704,"kb_used_data":15876,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754676016,"statfs":{"total":773094113280,"available":772788240384,"internally_reserved":0,"allocated":16257024,"data_stored":8813232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001330"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164699+0000","last_change":"2024-09-12T02:07:06.188562+0000","last_active":"2024-09-12T02:07:07.164699+0000","last_peered":"2024-09-12T02:07:07.164699+0000","last_clean":"2024-09-12T02:07:07.164699+0000","last_became_active":"2024-09-12T02:07:06.188181+0000","last_became_peered":"2024-09-12T02:07:06.188181+0000","last_unstale":"2024-09-12T02:07:07.164699+0000","last_undegraded":"2024-09-12T02:07:07.164699+0000","last_fullsized":"2024-09-12T02:07:07.164699+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:30.948775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162342+0000","last_change":"2024-09-12T02:07:06.174390+0000","last_active":"2024-09-12T02:07:07.162342+0000","last_peered":"2024-09-12T02:07:07.162342+0000","last_clean":"2024-09-12T02:07:07.162342+0000","last_became_active":"2024-09-12T02:07:06.174074+0000","last_became_peered":"2024-09-12T02:07:06.174074+0000","last_unstale":"2024-09-12T02:07:07.162342+0000","last_undegraded":"2024-09-12T02:07:07.162342+0000","last_fullsized":"2024-09-12T02:07:07.162342+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:44.672172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164673+0000","last_change":"2024-09-12T02:07:06.181043+0000","last_active":"2024-09-12T02:07:07.164673+0000","last_peered":"2024-09-12T02:07:07.164673+0000","last_clean":"2024-09-12T02:07:07.164673+0000","last_became_active":"2024-09-12T02:07:06.180739+0000","last_became_peered":"2024-09-12T02:07:06.180739+0000","last_unstale":"2024-09-12T02:07:07.164673+0000","last_undegraded":"2024-09-12T02:07:07.164673+0000","last_fullsized":"2024-09-12T02:07:07.164673+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:59.243937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188462+0000","last_change":"2024-09-12T02:07:06.182365+0000","last_active":"2024-09-12T02:07:06.188462+0000","last_peered":"2024-09-12T02:07:06.188462+0000","last_clean":"2024-09-12T02:07:06.188462+0000","last_became_active":"2024-09-12T02:07:06.182017+0000","last_became_peered":"2024-09-12T02:07:06.182017+0000","last_unstale":"2024-09-12T02:07:06.188462+0000","last_undegraded":"2024-09-12T02:07:06.188462+0000","last_fullsized":"2024-09-12T02:07:06.188462+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:23.103898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.159991+0000","last_change":"2024-09-12T02:07:06.174721+0000","last_active":"2024-09-12T02:07:07.159991+0000","last_peered":"2024-09-12T02:07:07.159991+0000","last_clean":"2024-09-12T02:07:07.159991+0000","last_became_active":"2024-09-12T02:07:06.174396+0000","last_became_peered":"2024-09-12T02:07:06.174396+0000","last_unstale":"2024-09-12T02:07:07.159991+0000","last_undegraded":"2024-09-12T02:07:07.159991+0000","last_fullsized":"2024-09-12T02:07:07.159991+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:38.012619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161796+0000","last_change":"2024-09-12T02:07:06.169646+0000","last_active":"2024-09-12T02:07:07.161796+0000","last_peered":"2024-09-12T02:07:07.161796+0000","last_clean":"2024-09-12T02:07:07.161796+0000","last_became_active":"2024-09-12T02:07:06.169353+0000","last_became_peered":"2024-09-12T02:07:06.169353+0000","last_unstale":"2024-09-12T02:07:07.161796+0000","last_undegraded":"2024-09-12T02:07:07.161796+0000","last_fullsized":"2024-09-12T02:07:07.161796+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:09.522486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161049+0000","last_change":"2024-09-12T02:07:06.174812+0000","last_active":"2024-09-12T02:07:07.161049+0000","last_peered":"2024-09-12T02:07:07.161049+0000","last_clean":"2024-09-12T02:07:07.161049+0000","last_became_active":"2024-09-12T02:07:06.174515+0000","last_became_peered":"2024-09-12T02:07:06.174515+0000","last_unstale":"2024-09-12T02:07:07.161049+0000","last_undegraded":"2024-09-12T02:07:07.161049+0000","last_fullsized":"2024-09-12T02:07:07.161049+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:50.679377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.191811+0000","last_change":"2024-09-12T02:07:06.187847+0000","last_active":"2024-09-12T02:07:06.191811+0000","last_peered":"2024-09-12T02:07:06.191811+0000","last_clean":"2024-09-12T02:07:06.191811+0000","last_became_active":"2024-09-12T02:07:06.187330+0000","last_became_peered":"2024-09-12T02:07:06.187330+0000","last_unstale":"2024-09-12T02:07:06.191811+0000","last_undegraded":"2024-09-12T02:07:06.191811+0000","last_fullsized":"2024-09-12T02:07:06.191811+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:57.702135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162152+0000","last_change":"2024-09-12T02:07:06.186070+0000","last_active":"2024-09-12T02:07:07.162152+0000","last_peered":"2024-09-12T02:07:07.162152+0000","last_clean":"2024-09-12T02:07:07.162152+0000","last_became_active":"2024-09-12T02:07:06.185718+0000","last_became_peered":"2024-09-12T02:07:06.185718+0000","last_unstale":"2024-09-12T02:07:07.162152+0000","last_undegraded":"2024-09-12T02:07:07.162152+0000","last_fullsized":"2024-09-12T02:07:07.162152+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:02.274114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160269+0000","last_change":"2024-09-12T02:07:06.165191+0000","last_active":"2024-09-12T02:07:07.160269+0000","last_peered":"2024-09-12T02:07:07.160269+0000","last_clean":"2024-09-12T02:07:07.160269+0000","last_became_active":"2024-09-12T02:07:06.164894+0000","last_became_peered":"2024-09-12T02:07:06.164894+0000","last_unstale":"2024-09-12T02:07:07.160269+0000","last_undegraded":"2024-09-12T02:07:07.160269+0000","last_fullsized":"2024-09-12T02:07:07.160269+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:51.780792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166773+0000","last_change":"2024-09-12T02:07:06.176297+0000","last_active":"2024-09-12T02:07:07.166773+0000","last_peered":"2024-09-12T02:07:07.166773+0000","last_clean":"2024-09-12T02:07:07.166773+0000","last_became_active":"2024-09-12T02:07:06.175504+0000","last_became_peered":"2024-09-12T02:07:06.175504+0000","last_unstale":"2024-09-12T02:07:07.166773+0000","last_undegraded":"2024-09-12T02:07:07.166773+0000","last_fullsized":"2024-09-12T02:07:07.166773+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:15.961805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161745+0000","last_change":"2024-09-12T02:07:06.170696+0000","last_active":"2024-09-12T02:07:07.161745+0000","last_peered":"2024-09-12T02:07:07.161745+0000","last_clean":"2024-09-12T02:07:07.161745+0000","last_became_active":"2024-09-12T02:07:06.170368+0000","last_became_peered":"2024-09-12T02:07:06.170368+0000","last_unstale":"2024-09-12T02:07:07.161745+0000","last_undegraded":"2024-09-12T02:07:07.161745+0000","last_fullsized":"2024-09-12T02:07:07.161745+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:57.778187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.185408+0000","last_change":"2024-09-12T02:07:06.181857+0000","last_active":"2024-09-12T02:07:06.185408+0000","last_peered":"2024-09-12T02:07:06.185408+0000","last_clean":"2024-09-12T02:07:06.185408+0000","last_became_active":"2024-09-12T02:07:06.181467+0000","last_became_peered":"2024-09-12T02:07:06.181467+0000","last_unstale":"2024-09-12T02:07:06.185408+0000","last_undegraded":"2024-09-12T02:07:06.185408+0000","last_fullsized":"2024-09-12T02:07:06.185408+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:56.597134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152264+0000","last_change":"2024-09-12T02:07:06.182969+0000","last_active":"2024-09-12T02:07:08.152264+0000","last_peered":"2024-09-12T02:07:08.152264+0000","last_clean":"2024-09-12T02:07:08.152264+0000","last_became_active":"2024-09-12T02:07:06.182682+0000","last_became_peered":"2024-09-12T02:07:06.182682+0000","last_unstale":"2024-09-12T02:07:08.152264+0000","last_undegraded":"2024-09-12T02:07:08.152264+0000","last_fullsized":"2024-09-12T02:07:08.152264+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:47.959635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152317+0000","last_change":"2024-09-12T02:07:06.180638+0000","last_active":"2024-09-12T02:07:08.152317+0000","last_peered":"2024-09-12T02:07:08.152317+0000","last_clean":"2024-09-12T02:07:08.152317+0000","last_became_active":"2024-09-12T02:07:06.180381+0000","last_became_peered":"2024-09-12T02:07:06.180381+0000","last_unstale":"2024-09-12T02:07:08.152317+0000","last_undegraded":"2024-09-12T02:07:08.152317+0000","last_fullsized":"2024-09-12T02:07:08.152317+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:27.615773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152229+0000","last_change":"2024-09-12T02:07:06.177792+0000","last_active":"2024-09-12T02:07:08.152229+0000","last_peered":"2024-09-12T02:07:08.152229+0000","last_clean":"2024-09-12T02:07:08.152229+0000","last_became_active":"2024-09-12T02:07:06.177444+0000","last_became_peered":"2024-09-12T02:07:06.177444+0000","last_unstale":"2024-09-12T02:07:08.152229+0000","last_undegraded":"2024-09-12T02:07:08.152229+0000","last_fullsized":"2024-09-12T02:07:08.152229+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:56.590510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164742+0000","last_change":"2024-09-12T02:07:06.180361+0000","last_active":"2024-09-12T02:07:07.164742+0000","last_peered":"2024-09-12T02:07:07.164742+0000","last_clean":"2024-09-12T02:07:07.164742+0000","last_became_active":"2024-09-12T02:07:06.180017+0000","last_became_peered":"2024-09-12T02:07:06.180017+0000","last_unstale":"2024-09-12T02:07:07.164742+0000","last_undegraded":"2024-09-12T02:07:07.164742+0000","last_fullsized":"2024-09-12T02:07:07.164742+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:30.553159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162378+0000","last_change":"2024-09-12T02:07:06.175609+0000","last_active":"2024-09-12T02:07:07.162378+0000","last_peered":"2024-09-12T02:07:07.162378+0000","last_clean":"2024-09-12T02:07:07.162378+0000","last_became_active":"2024-09-12T02:07:06.175358+0000","last_became_peered":"2024-09-12T02:07:06.175358+0000","last_unstale":"2024-09-12T02:07:07.162378+0000","last_undegraded":"2024-09-12T02:07:07.162378+0000","last_fullsized":"2024-09-12T02:07:07.162378+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:06.129951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164694+0000","last_change":"2024-09-12T02:07:06.184058+0000","last_active":"2024-09-12T02:07:07.164694+0000","last_peered":"2024-09-12T02:07:07.164694+0000","last_clean":"2024-09-12T02:07:07.164694+0000","last_became_active":"2024-09-12T02:07:06.183753+0000","last_became_peered":"2024-09-12T02:07:06.183753+0000","last_unstale":"2024-09-12T02:07:07.164694+0000","last_undegraded":"2024-09-12T02:07:07.164694+0000","last_fullsized":"2024-09-12T02:07:07.164694+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:58.979849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162191+0000","last_change":"2024-09-12T02:07:06.173004+0000","last_active":"2024-09-12T02:07:07.162191+0000","last_peered":"2024-09-12T02:07:07.162191+0000","last_clean":"2024-09-12T02:07:07.162191+0000","last_became_active":"2024-09-12T02:07:06.172715+0000","last_became_peered":"2024-09-12T02:07:06.172715+0000","last_unstale":"2024-09-12T02:07:07.162191+0000","last_undegraded":"2024-09-12T02:07:07.162191+0000","last_fullsized":"2024-09-12T02:07:07.162191+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:42.705993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.179326+0000","last_change":"2024-09-12T02:07:06.177889+0000","last_active":"2024-09-12T02:07:06.179326+0000","last_peered":"2024-09-12T02:07:06.179326+0000","last_clean":"2024-09-12T02:07:06.179326+0000","last_became_active":"2024-09-12T02:07:06.177498+0000","last_became_peered":"2024-09-12T02:07:06.177498+0000","last_unstale":"2024-09-12T02:07:06.179326+0000","last_undegraded":"2024-09-12T02:07:06.179326+0000","last_fullsized":"2024-09-12T02:07:06.179326+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:40.200757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160079+0000","last_change":"2024-09-12T02:07:06.185065+0000","last_active":"2024-09-12T02:07:07.160079+0000","last_peered":"2024-09-12T02:07:07.160079+0000","last_clean":"2024-09-12T02:07:07.160079+0000","last_became_active":"2024-09-12T02:07:06.184779+0000","last_became_peered":"2024-09-12T02:07:06.184779+0000","last_unstale":"2024-09-12T02:07:07.160079+0000","last_undegraded":"2024-09-12T02:07:07.160079+0000","last_fullsized":"2024-09-12T02:07:07.160079+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:13.412294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164498+0000","last_change":"2024-09-12T02:07:06.180301+0000","last_active":"2024-09-12T02:07:07.164498+0000","last_peered":"2024-09-12T02:07:07.164498+0000","last_clean":"2024-09-12T02:07:07.164498+0000","last_became_active":"2024-09-12T02:07:06.179930+0000","last_became_peered":"2024-09-12T02:07:06.179930+0000","last_unstale":"2024-09-12T02:07:07.164498+0000","last_undegraded":"2024-09-12T02:07:07.164498+0000","last_fullsized":"2024-09-12T02:07:07.164498+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:29.743856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160141+0000","last_change":"2024-09-12T02:07:06.173860+0000","last_active":"2024-09-12T02:07:07.160141+0000","last_peered":"2024-09-12T02:07:07.160141+0000","last_clean":"2024-09-12T02:07:07.160141+0000","last_became_active":"2024-09-12T02:07:06.173507+0000","last_became_peered":"2024-09-12T02:07:06.173507+0000","last_unstale":"2024-09-12T02:07:07.160141+0000","last_undegraded":"2024-09-12T02:07:07.160141+0000","last_fullsized":"2024-09-12T02:07:07.160141+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:55.442840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161259+0000","last_change":"2024-09-12T02:07:06.183545+0000","last_active":"2024-09-12T02:07:07.161259+0000","last_peered":"2024-09-12T02:07:07.161259+0000","last_clean":"2024-09-12T02:07:07.161259+0000","last_became_active":"2024-09-12T02:07:06.180674+0000","last_became_peered":"2024-09-12T02:07:06.180674+0000","last_unstale":"2024-09-12T02:07:07.161259+0000","last_undegraded":"2024-09-12T02:07:07.161259+0000","last_fullsized":"2024-09-12T02:07:07.161259+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:23.067644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161179+0000","last_change":"2024-09-12T02:07:06.171797+0000","last_active":"2024-09-12T02:07:07.161179+0000","last_peered":"2024-09-12T02:07:07.161179+0000","last_clean":"2024-09-12T02:07:07.161179+0000","last_became_active":"2024-09-12T02:07:06.171513+0000","last_became_peered":"2024-09-12T02:07:06.171513+0000","last_unstale":"2024-09-12T02:07:07.161179+0000","last_undegraded":"2024-09-12T02:07:07.161179+0000","last_fullsized":"2024-09-12T02:07:07.161179+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:58.954857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166845+0000","last_change":"2024-09-12T02:07:06.178849+0000","last_active":"2024-09-12T02:07:07.166845+0000","last_peered":"2024-09-12T02:07:07.166845+0000","last_clean":"2024-09-12T02:07:07.166845+0000","last_became_active":"2024-09-12T02:07:06.178582+0000","last_became_peered":"2024-09-12T02:07:06.178582+0000","last_unstale":"2024-09-12T02:07:07.166845+0000","last_undegraded":"2024-09-12T02:07:07.166845+0000","last_fullsized":"2024-09-12T02:07:07.166845+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:22.419853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162191+0000","last_change":"2024-09-12T02:07:06.179357+0000","last_active":"2024-09-12T02:07:07.162191+0000","last_peered":"2024-09-12T02:07:07.162191+0000","last_clean":"2024-09-12T02:07:07.162191+0000","last_became_active":"2024-09-12T02:07:06.179095+0000","last_became_peered":"2024-09-12T02:07:06.179095+0000","last_unstale":"2024-09-12T02:07:07.162191+0000","last_undegraded":"2024-09-12T02:07:07.162191+0000","last_fullsized":"2024-09-12T02:07:07.162191+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:02.076504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.179305+0000","last_change":"2024-09-12T02:07:06.177320+0000","last_active":"2024-09-12T02:07:06.179305+0000","last_peered":"2024-09-12T02:07:06.179305+0000","last_clean":"2024-09-12T02:07:06.179305+0000","last_became_active":"2024-09-12T02:07:06.176959+0000","last_became_peered":"2024-09-12T02:07:06.176959+0000","last_unstale":"2024-09-12T02:07:06.179305+0000","last_undegraded":"2024-09-12T02:07:06.179305+0000","last_fullsized":"2024-09-12T02:07:06.179305+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:02.600481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161419+0000","last_change":"2024-09-12T02:07:06.178211+0000","last_active":"2024-09-12T02:07:07.161419+0000","last_peered":"2024-09-12T02:07:07.161419+0000","last_clean":"2024-09-12T02:07:07.161419+0000","last_became_active":"2024-09-12T02:07:06.177168+0000","last_became_peered":"2024-09-12T02:07:06.177168+0000","last_unstale":"2024-09-12T02:07:07.161419+0000","last_undegraded":"2024-09-12T02:07:07.161419+0000","last_fullsized":"2024-09-12T02:07:07.161419+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:26.784396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161207+0000","last_change":"2024-09-12T02:07:06.186273+0000","last_active":"2024-09-12T02:07:07.161207+0000","last_peered":"2024-09-12T02:07:07.161207+0000","last_clean":"2024-09-12T02:07:07.161207+0000","last_became_active":"2024-09-12T02:07:06.185981+0000","last_became_peered":"2024-09-12T02:07:06.185981+0000","last_unstale":"2024-09-12T02:07:07.161207+0000","last_undegraded":"2024-09-12T02:07:07.161207+0000","last_fullsized":"2024-09-12T02:07:07.161207+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:17.401197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.191783+0000","last_change":"2024-09-12T02:07:06.187602+0000","last_active":"2024-09-12T02:07:06.191783+0000","last_peered":"2024-09-12T02:07:06.191783+0000","last_clean":"2024-09-12T02:07:06.191783+0000","last_became_active":"2024-09-12T02:07:06.186930+0000","last_became_peered":"2024-09-12T02:07:06.186930+0000","last_unstale":"2024-09-12T02:07:06.191783+0000","last_undegraded":"2024-09-12T02:07:06.191783+0000","last_fullsized":"2024-09-12T02:07:06.191783+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:50.021035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164540+0000","last_change":"2024-09-12T02:07:06.182081+0000","last_active":"2024-09-12T02:07:07.164540+0000","last_peered":"2024-09-12T02:07:07.164540+0000","last_clean":"2024-09-12T02:07:07.164540+0000","last_became_active":"2024-09-12T02:07:06.181774+0000","last_became_peered":"2024-09-12T02:07:06.181774+0000","last_unstale":"2024-09-12T02:07:07.164540+0000","last_undegraded":"2024-09-12T02:07:07.164540+0000","last_fullsized":"2024-09-12T02:07:07.164540+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:41.166247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"144'4","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.187015+0000","last_change":"2024-09-12T02:07:05.168735+0000","last_active":"2024-09-12T02:07:06.187015+0000","last_peered":"2024-09-12T02:07:06.187015+0000","last_clean":"2024-09-12T02:07:06.187015+0000","last_became_active":"2024-09-12T02:07:05.168378+0000","last_became_peered":"2024-09-12T02:07:05.168378+0000","last_unstale":"2024-09-12T02:07:06.187015+0000","last_undegraded":"2024-09-12T02:07:06.187015+0000","last_fullsized":"2024-09-12T02:07:06.187015+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:56.775704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.192885+0000","last_change":"2024-09-12T02:07:06.189264+0000","last_active":"2024-09-12T02:07:06.192885+0000","last_peered":"2024-09-12T02:07:06.192885+0000","last_clean":"2024-09-12T02:07:06.192885+0000","last_became_active":"2024-09-12T02:07:06.188784+0000","last_became_peered":"2024-09-12T02:07:06.188784+0000","last_unstale":"2024-09-12T02:07:06.192885+0000","last_undegraded":"2024-09-12T02:07:06.192885+0000","last_fullsized":"2024-09-12T02:07:06.192885+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:47.546176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"144'1","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188900+0000","last_change":"2024-09-12T02:07:05.178805+0000","last_active":"2024-09-12T02:07:06.188900+0000","last_peered":"2024-09-12T02:07:06.188900+0000","last_clean":"2024-09-12T02:07:06.188900+0000","last_became_active":"2024-09-12T02:07:05.178340+0000","last_became_peered":"2024-09-12T02:07:05.178340+0000","last_unstale":"2024-09-12T02:07:06.188900+0000","last_undegraded":"2024-09-12T02:07:06.188900+0000","last_fullsized":"2024-09-12T02:07:06.188900+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:30.323418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161537+0000","last_change":"2024-09-12T02:07:06.170078+0000","last_active":"2024-09-12T02:07:07.161537+0000","last_peered":"2024-09-12T02:07:07.161537+0000","last_clean":"2024-09-12T02:07:07.161537+0000","last_became_active":"2024-09-12T02:07:06.169626+0000","last_became_peered":"2024-09-12T02:07:06.169626+0000","last_unstale":"2024-09-12T02:07:07.161537+0000","last_undegraded":"2024-09-12T02:07:07.161537+0000","last_fullsized":"2024-09-12T02:07:07.161537+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:02.746428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161354+0000","last_change":"2024-09-12T02:07:05.173497+0000","last_active":"2024-09-12T02:07:07.161354+0000","last_peered":"2024-09-12T02:07:07.161354+0000","last_clean":"2024-09-12T02:07:07.161354+0000","last_became_active":"2024-09-12T02:07:05.173240+0000","last_became_peered":"2024-09-12T02:07:05.173240+0000","last_unstale":"2024-09-12T02:07:07.161354+0000","last_undegraded":"2024-09-12T02:07:07.161354+0000","last_fullsized":"2024-09-12T02:07:07.161354+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:45.930215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166749+0000","last_change":"2024-09-12T02:07:06.175693+0000","last_active":"2024-09-12T02:07:07.166749+0000","last_peered":"2024-09-12T02:07:07.166749+0000","last_clean":"2024-09-12T02:07:07.166749+0000","last_became_active":"2024-09-12T02:07:06.175445+0000","last_became_peered":"2024-09-12T02:07:06.175445+0000","last_unstale":"2024-09-12T02:07:07.166749+0000","last_undegraded":"2024-09-12T02:07:07.166749+0000","last_fullsized":"2024-09-12T02:07:07.166749+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:32.944261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160093+0000","last_change":"2024-09-12T02:07:05.174789+0000","last_active":"2024-09-12T02:07:07.160093+0000","last_peered":"2024-09-12T02:07:07.160093+0000","last_clean":"2024-09-12T02:07:07.160093+0000","last_became_active":"2024-09-12T02:07:05.174498+0000","last_became_peered":"2024-09-12T02:07:05.174498+0000","last_unstale":"2024-09-12T02:07:07.160093+0000","last_undegraded":"2024-09-12T02:07:07.160093+0000","last_fullsized":"2024-09-12T02:07:07.160093+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:39.219875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188440+0000","last_change":"2024-09-12T02:07:06.182146+0000","last_active":"2024-09-12T02:07:06.188440+0000","last_peered":"2024-09-12T02:07:06.188440+0000","last_clean":"2024-09-12T02:07:06.188440+0000","last_became_active":"2024-09-12T02:07:06.181487+0000","last_became_peered":"2024-09-12T02:07:06.181487+0000","last_unstale":"2024-09-12T02:07:06.188440+0000","last_undegraded":"2024-09-12T02:07:06.188440+0000","last_fullsized":"2024-09-12T02:07:06.188440+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:43.216454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"144'1","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152222+0000","last_change":"2024-09-12T02:07:05.170859+0000","last_active":"2024-09-12T02:07:08.152222+0000","last_peered":"2024-09-12T02:07:08.152222+0000","last_clean":"2024-09-12T02:07:08.152222+0000","last_became_active":"2024-09-12T02:07:05.170461+0000","last_became_peered":"2024-09-12T02:07:05.170461+0000","last_unstale":"2024-09-12T02:07:08.152222+0000","last_undegraded":"2024-09-12T02:07:08.152222+0000","last_fullsized":"2024-09-12T02:07:08.152222+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:21.417369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164914+0000","last_change":"2024-09-12T02:07:06.180769+0000","last_active":"2024-09-12T02:07:07.164914+0000","last_peered":"2024-09-12T02:07:07.164914+0000","last_clean":"2024-09-12T02:07:07.164914+0000","last_became_active":"2024-09-12T02:07:06.180488+0000","last_became_peered":"2024-09-12T02:07:06.180488+0000","last_unstale":"2024-09-12T02:07:07.164914+0000","last_undegraded":"2024-09-12T02:07:07.164914+0000","last_fullsized":"2024-09-12T02:07:07.164914+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:53.889287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"144'1","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166448+0000","last_change":"2024-09-12T02:07:05.173595+0000","last_active":"2024-09-12T02:07:07.166448+0000","last_peered":"2024-09-12T02:07:07.166448+0000","last_clean":"2024-09-12T02:07:07.166448+0000","last_became_active":"2024-09-12T02:07:05.173302+0000","last_became_peered":"2024-09-12T02:07:05.173302+0000","last_unstale":"2024-09-12T02:07:07.166448+0000","last_undegraded":"2024-09-12T02:07:07.166448+0000","last_fullsized":"2024-09-12T02:07:07.166448+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:16.398714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162438+0000","last_change":"2024-09-12T02:07:06.178635+0000","last_active":"2024-09-12T02:07:07.162438+0000","last_peered":"2024-09-12T02:07:07.162438+0000","last_clean":"2024-09-12T02:07:07.162438+0000","last_became_active":"2024-09-12T02:07:06.178364+0000","last_became_peered":"2024-09-12T02:07:06.178364+0000","last_unstale":"2024-09-12T02:07:07.162438+0000","last_undegraded":"2024-09-12T02:07:07.162438+0000","last_fullsized":"2024-09-12T02:07:07.162438+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:48.232335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161246+0000","last_change":"2024-09-12T02:07:05.169281+0000","last_active":"2024-09-12T02:07:07.161246+0000","last_peered":"2024-09-12T02:07:07.161246+0000","last_clean":"2024-09-12T02:07:07.161246+0000","last_became_active":"2024-09-12T02:07:05.169013+0000","last_became_peered":"2024-09-12T02:07:05.169013+0000","last_unstale":"2024-09-12T02:07:07.161246+0000","last_undegraded":"2024-09-12T02:07:07.161246+0000","last_fullsized":"2024-09-12T02:07:07.161246+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:35.627376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.189655+0000","last_change":"2024-09-12T02:07:06.185740+0000","last_active":"2024-09-12T02:07:06.189655+0000","last_peered":"2024-09-12T02:07:06.189655+0000","last_clean":"2024-09-12T02:07:06.189655+0000","last_became_active":"2024-09-12T02:07:06.185464+0000","last_became_peered":"2024-09-12T02:07:06.185464+0000","last_unstale":"2024-09-12T02:07:06.189655+0000","last_undegraded":"2024-09-12T02:07:06.189655+0000","last_fullsized":"2024-09-12T02:07:06.189655+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:03.123101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.167409+0000","last_change":"2024-09-12T02:07:05.171827+0000","last_active":"2024-09-12T02:07:06.167409+0000","last_peered":"2024-09-12T02:07:06.167409+0000","last_clean":"2024-09-12T02:07:06.167409+0000","last_became_active":"2024-09-12T02:07:05.170929+0000","last_became_peered":"2024-09-12T02:07:05.170929+0000","last_unstale":"2024-09-12T02:07:06.167409+0000","last_undegraded":"2024-09-12T02:07:06.167409+0000","last_fullsized":"2024-09-12T02:07:06.167409+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:25.781913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164699+0000","last_change":"2024-09-12T02:07:06.182831+0000","last_active":"2024-09-12T02:07:07.164699+0000","last_peered":"2024-09-12T02:07:07.164699+0000","last_clean":"2024-09-12T02:07:07.164699+0000","last_became_active":"2024-09-12T02:07:06.182547+0000","last_became_peered":"2024-09-12T02:07:06.182547+0000","last_unstale":"2024-09-12T02:07:07.164699+0000","last_undegraded":"2024-09-12T02:07:07.164699+0000","last_fullsized":"2024-09-12T02:07:07.164699+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:46.521663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161205+0000","last_change":"2024-09-12T02:07:05.170472+0000","last_active":"2024-09-12T02:07:07.161205+0000","last_peered":"2024-09-12T02:07:07.161205+0000","last_clean":"2024-09-12T02:07:07.161205+0000","last_became_active":"2024-09-12T02:07:05.170230+0000","last_became_peered":"2024-09-12T02:07:05.170230+0000","last_unstale":"2024-09-12T02:07:07.161205+0000","last_undegraded":"2024-09-12T02:07:07.161205+0000","last_fullsized":"2024-09-12T02:07:07.161205+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:37.010136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.159884+0000","last_change":"2024-09-12T02:07:06.184089+0000","last_active":"2024-09-12T02:07:07.159884+0000","last_peered":"2024-09-12T02:07:07.159884+0000","last_clean":"2024-09-12T02:07:07.159884+0000","last_became_active":"2024-09-12T02:07:06.183803+0000","last_became_peered":"2024-09-12T02:07:06.183803+0000","last_unstale":"2024-09-12T02:07:07.159884+0000","last_undegraded":"2024-09-12T02:07:07.159884+0000","last_fullsized":"2024-09-12T02:07:07.159884+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:46.932699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164723+0000","last_change":"2024-09-12T02:07:05.169627+0000","last_active":"2024-09-12T02:07:07.164723+0000","last_peered":"2024-09-12T02:07:07.164723+0000","last_clean":"2024-09-12T02:07:07.164723+0000","last_became_active":"2024-09-12T02:07:05.169351+0000","last_became_peered":"2024-09-12T02:07:05.169351+0000","last_unstale":"2024-09-12T02:07:07.164723+0000","last_undegraded":"2024-09-12T02:07:07.164723+0000","last_fullsized":"2024-09-12T02:07:07.164723+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:16.639255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188132+0000","last_change":"2024-09-12T02:07:06.185105+0000","last_active":"2024-09-12T02:07:06.188132+0000","last_peered":"2024-09-12T02:07:06.188132+0000","last_clean":"2024-09-12T02:07:06.188132+0000","last_became_active":"2024-09-12T02:07:06.184834+0000","last_became_peered":"2024-09-12T02:07:06.184834+0000","last_unstale":"2024-09-12T02:07:06.188132+0000","last_undegraded":"2024-09-12T02:07:06.188132+0000","last_fullsized":"2024-09-12T02:07:06.188132+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:32.847267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"144'3","reported_seq":17,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152291+0000","last_change":"2024-09-12T02:07:05.171680+0000","last_active":"2024-09-12T02:07:08.152291+0000","last_peered":"2024-09-12T02:07:08.152291+0000","last_clean":"2024-09-12T02:07:08.152291+0000","last_became_active":"2024-09-12T02:07:05.171404+0000","last_became_peered":"2024-09-12T02:07:05.171404+0000","last_unstale":"2024-09-12T02:07:08.152291+0000","last_undegraded":"2024-09-12T02:07:08.152291+0000","last_fullsized":"2024-09-12T02:07:08.152291+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:35.660683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160149+0000","last_change":"2024-09-12T02:07:06.185464+0000","last_active":"2024-09-12T02:07:07.160149+0000","last_peered":"2024-09-12T02:07:07.160149+0000","last_clean":"2024-09-12T02:07:07.160149+0000","last_became_active":"2024-09-12T02:07:06.184939+0000","last_became_peered":"2024-09-12T02:07:06.184939+0000","last_unstale":"2024-09-12T02:07:07.160149+0000","last_undegraded":"2024-09-12T02:07:07.160149+0000","last_fullsized":"2024-09-12T02:07:07.160149+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:43.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"144'6","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162233+0000","last_change":"2024-09-12T02:07:05.167291+0000","last_active":"2024-09-12T02:07:07.162233+0000","last_peered":"2024-09-12T02:07:07.162233+0000","last_clean":"2024-09-12T02:07:07.162233+0000","last_became_active":"2024-09-12T02:07:05.167007+0000","last_became_peered":"2024-09-12T02:07:05.167007+0000","last_unstale":"2024-09-12T02:07:07.162233+0000","last_undegraded":"2024-09-12T02:07:07.162233+0000","last_fullsized":"2024-09-12T02:07:07.162233+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:24.643556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166672+0000","last_change":"2024-09-12T02:07:06.177960+0000","last_active":"2024-09-12T02:07:07.166672+0000","last_peered":"2024-09-12T02:07:07.166672+0000","last_clean":"2024-09-12T02:07:07.166672+0000","last_became_active":"2024-09-12T02:07:06.177674+0000","last_became_peered":"2024-09-12T02:07:06.177674+0000","last_unstale":"2024-09-12T02:07:07.166672+0000","last_undegraded":"2024-09-12T02:07:07.166672+0000","last_fullsized":"2024-09-12T02:07:07.166672+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:02.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160245+0000","last_change":"2024-09-12T02:07:05.180245+0000","last_active":"2024-09-12T02:07:07.160245+0000","last_peered":"2024-09-12T02:07:07.160245+0000","last_clean":"2024-09-12T02:07:07.160245+0000","last_became_active":"2024-09-12T02:07:05.179890+0000","last_became_peered":"2024-09-12T02:07:05.179890+0000","last_unstale":"2024-09-12T02:07:07.160245+0000","last_undegraded":"2024-09-12T02:07:07.160245+0000","last_fullsized":"2024-09-12T02:07:07.160245+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:26.126486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162237+0000","last_change":"2024-09-12T02:07:06.176853+0000","last_active":"2024-09-12T02:07:07.162237+0000","last_peered":"2024-09-12T02:07:07.162237+0000","last_clean":"2024-09-12T02:07:07.162237+0000","last_became_active":"2024-09-12T02:07:06.176544+0000","last_became_peered":"2024-09-12T02:07:06.176544+0000","last_unstale":"2024-09-12T02:07:07.162237+0000","last_undegraded":"2024-09-12T02:07:07.162237+0000","last_fullsized":"2024-09-12T02:07:07.162237+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:31.856009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.167494+0000","last_change":"2024-09-12T02:07:05.170442+0000","last_active":"2024-09-12T02:07:06.167494+0000","last_peered":"2024-09-12T02:07:06.167494+0000","last_clean":"2024-09-12T02:07:06.167494+0000","last_became_active":"2024-09-12T02:07:05.170143+0000","last_became_peered":"2024-09-12T02:07:05.170143+0000","last_unstale":"2024-09-12T02:07:06.167494+0000","last_undegraded":"2024-09-12T02:07:06.167494+0000","last_fullsized":"2024-09-12T02:07:06.167494+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:01.743945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.189010+0000","last_change":"2024-09-12T02:07:06.186466+0000","last_active":"2024-09-12T02:07:06.189010+0000","last_peered":"2024-09-12T02:07:06.189010+0000","last_clean":"2024-09-12T02:07:06.189010+0000","last_became_active":"2024-09-12T02:07:06.186144+0000","last_became_peered":"2024-09-12T02:07:06.186144+0000","last_unstale":"2024-09-12T02:07:06.189010+0000","last_undegraded":"2024-09-12T02:07:06.189010+0000","last_fullsized":"2024-09-12T02:07:06.189010+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:20.906453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.172327+0000","last_change":"2024-09-12T02:07:05.181325+0000","last_active":"2024-09-12T02:07:06.172327+0000","last_peered":"2024-09-12T02:07:06.172327+0000","last_clean":"2024-09-12T02:07:06.172327+0000","last_became_active":"2024-09-12T02:07:05.181048+0000","last_became_peered":"2024-09-12T02:07:05.181048+0000","last_unstale":"2024-09-12T02:07:06.172327+0000","last_undegraded":"2024-09-12T02:07:06.172327+0000","last_fullsized":"2024-09-12T02:07:06.172327+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:04.428549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164859+0000","last_change":"2024-09-12T02:07:06.180329+0000","last_active":"2024-09-12T02:07:07.164859+0000","last_peered":"2024-09-12T02:07:07.164859+0000","last_clean":"2024-09-12T02:07:07.164859+0000","last_became_active":"2024-09-12T02:07:06.179876+0000","last_became_peered":"2024-09-12T02:07:06.179876+0000","last_unstale":"2024-09-12T02:07:07.164859+0000","last_undegraded":"2024-09-12T02:07:07.164859+0000","last_fullsized":"2024-09-12T02:07:07.164859+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:47.471652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"144'8","reported_seq":22,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160927+0000","last_change":"2024-09-12T02:07:05.173863+0000","last_active":"2024-09-12T02:07:07.160927+0000","last_peered":"2024-09-12T02:07:07.160927+0000","last_clean":"2024-09-12T02:07:07.160927+0000","last_became_active":"2024-09-12T02:07:05.173135+0000","last_became_peered":"2024-09-12T02:07:05.173135+0000","last_unstale":"2024-09-12T02:07:07.160927+0000","last_undegraded":"2024-09-12T02:07:07.160927+0000","last_fullsized":"2024-09-12T02:07:07.160927+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:25.840163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188208+0000","last_change":"2024-09-12T02:07:06.183288+0000","last_active":"2024-09-12T02:07:06.188208+0000","last_peered":"2024-09-12T02:07:06.188208+0000","last_clean":"2024-09-12T02:07:06.188208+0000","last_became_active":"2024-09-12T02:07:06.182990+0000","last_became_peered":"2024-09-12T02:07:06.182990+0000","last_unstale":"2024-09-12T02:07:06.188208+0000","last_undegraded":"2024-09-12T02:07:06.188208+0000","last_fullsized":"2024-09-12T02:07:06.188208+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:11.283654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"144'1","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162086+0000","last_change":"2024-09-12T02:07:05.169182+0000","last_active":"2024-09-12T02:07:07.162086+0000","last_peered":"2024-09-12T02:07:07.162086+0000","last_clean":"2024-09-12T02:07:07.162086+0000","last_became_active":"2024-09-12T02:07:05.168915+0000","last_became_peered":"2024-09-12T02:07:05.168915+0000","last_unstale":"2024-09-12T02:07:07.162086+0000","last_undegraded":"2024-09-12T02:07:07.162086+0000","last_fullsized":"2024-09-12T02:07:07.162086+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:11.978173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161957+0000","last_change":"2024-09-12T02:07:06.173564+0000","last_active":"2024-09-12T02:07:07.161957+0000","last_peered":"2024-09-12T02:07:07.161957+0000","last_clean":"2024-09-12T02:07:07.161957+0000","last_became_active":"2024-09-12T02:07:06.173302+0000","last_became_peered":"2024-09-12T02:07:06.173302+0000","last_unstale":"2024-09-12T02:07:07.161957+0000","last_undegraded":"2024-09-12T02:07:07.161957+0000","last_fullsized":"2024-09-12T02:07:07.161957+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:06.437712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"144'1","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152303+0000","last_change":"2024-09-12T02:07:05.169086+0000","last_active":"2024-09-12T02:07:08.152303+0000","last_peered":"2024-09-12T02:07:08.152303+0000","last_clean":"2024-09-12T02:07:08.152303+0000","last_became_active":"2024-09-12T02:07:05.168800+0000","last_became_peered":"2024-09-12T02:07:05.168800+0000","last_unstale":"2024-09-12T02:07:08.152303+0000","last_undegraded":"2024-09-12T02:07:08.152303+0000","last_fullsized":"2024-09-12T02:07:08.152303+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:14.959321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160154+0000","last_change":"2024-09-12T02:07:06.175575+0000","last_active":"2024-09-12T02:07:07.160154+0000","last_peered":"2024-09-12T02:07:07.160154+0000","last_clean":"2024-09-12T02:07:07.160154+0000","last_became_active":"2024-09-12T02:07:06.175285+0000","last_became_peered":"2024-09-12T02:07:06.175285+0000","last_unstale":"2024-09-12T02:07:07.160154+0000","last_undegraded":"2024-09-12T02:07:07.160154+0000","last_fullsized":"2024-09-12T02:07:07.160154+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:54.606749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166583+0000","last_change":"2024-09-12T02:07:05.167828+0000","last_active":"2024-09-12T02:07:07.166583+0000","last_peered":"2024-09-12T02:07:07.166583+0000","last_clean":"2024-09-12T02:07:07.166583+0000","last_became_active":"2024-09-12T02:07:05.167536+0000","last_became_peered":"2024-09-12T02:07:05.167536+0000","last_unstale":"2024-09-12T02:07:07.166583+0000","last_undegraded":"2024-09-12T02:07:07.166583+0000","last_fullsized":"2024-09-12T02:07:07.166583+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:08.520003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164691+0000","last_change":"2024-09-12T02:07:06.186836+0000","last_active":"2024-09-12T02:07:07.164691+0000","last_peered":"2024-09-12T02:07:07.164691+0000","last_clean":"2024-09-12T02:07:07.164691+0000","last_became_active":"2024-09-12T02:07:06.186490+0000","last_became_peered":"2024-09-12T02:07:06.186490+0000","last_unstale":"2024-09-12T02:07:07.164691+0000","last_undegraded":"2024-09-12T02:07:07.164691+0000","last_fullsized":"2024-09-12T02:07:07.164691+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:52.748269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"144'2","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.182591+0000","last_change":"2024-09-12T02:07:05.178914+0000","last_active":"2024-09-12T02:07:06.182591+0000","last_peered":"2024-09-12T02:07:06.182591+0000","last_clean":"2024-09-12T02:07:06.182591+0000","last_became_active":"2024-09-12T02:07:05.178630+0000","last_became_peered":"2024-09-12T02:07:05.178630+0000","last_unstale":"2024-09-12T02:07:06.182591+0000","last_undegraded":"2024-09-12T02:07:06.182591+0000","last_fullsized":"2024-09-12T02:07:06.182591+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:53.781606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164915+0000","last_change":"2024-09-12T02:07:06.172346+0000","last_active":"2024-09-12T02:07:07.164915+0000","last_peered":"2024-09-12T02:07:07.164915+0000","last_clean":"2024-09-12T02:07:07.164915+0000","last_became_active":"2024-09-12T02:07:06.171758+0000","last_became_peered":"2024-09-12T02:07:06.171758+0000","last_unstale":"2024-09-12T02:07:07.164915+0000","last_undegraded":"2024-09-12T02:07:07.164915+0000","last_fullsized":"2024-09-12T02:07:07.164915+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:57.712570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.170854+0000","last_change":"2024-09-12T02:07:05.181025+0000","last_active":"2024-09-12T02:07:06.170854+0000","last_peered":"2024-09-12T02:07:06.170854+0000","last_clean":"2024-09-12T02:07:06.170854+0000","last_became_active":"2024-09-12T02:07:05.180707+0000","last_became_peered":"2024-09-12T02:07:05.180707+0000","last_unstale":"2024-09-12T02:07:06.170854+0000","last_undegraded":"2024-09-12T02:07:06.170854+0000","last_fullsized":"2024-09-12T02:07:06.170854+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:51.480271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.181619+0000","last_change":"2024-09-12T02:07:06.175102+0000","last_active":"2024-09-12T02:07:06.181619+0000","last_peered":"2024-09-12T02:07:06.181619+0000","last_clean":"2024-09-12T02:07:06.181619+0000","last_became_active":"2024-09-12T02:07:06.174811+0000","last_became_peered":"2024-09-12T02:07:06.174811+0000","last_unstale":"2024-09-12T02:07:06.181619+0000","last_undegraded":"2024-09-12T02:07:06.181619+0000","last_fullsized":"2024-09-12T02:07:06.181619+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:48.029678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161349+0000","last_change":"2024-09-12T02:07:05.170014+0000","last_active":"2024-09-12T02:07:07.161349+0000","last_peered":"2024-09-12T02:07:07.161349+0000","last_clean":"2024-09-12T02:07:07.161349+0000","last_became_active":"2024-09-12T02:07:05.169731+0000","last_became_peered":"2024-09-12T02:07:05.169731+0000","last_unstale":"2024-09-12T02:07:07.161349+0000","last_undegraded":"2024-09-12T02:07:07.161349+0000","last_fullsized":"2024-09-12T02:07:07.161349+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:48.278776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188982+0000","last_change":"2024-09-12T02:07:06.186018+0000","last_active":"2024-09-12T02:07:06.188982+0000","last_peered":"2024-09-12T02:07:06.188982+0000","last_clean":"2024-09-12T02:07:06.188982+0000","last_became_active":"2024-09-12T02:07:06.185734+0000","last_became_peered":"2024-09-12T02:07:06.185734+0000","last_unstale":"2024-09-12T02:07:06.188982+0000","last_undegraded":"2024-09-12T02:07:06.188982+0000","last_fullsized":"2024-09-12T02:07:06.188982+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:45.609305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.171753+0000","last_change":"2024-09-12T02:07:05.178455+0000","last_active":"2024-09-12T02:07:06.171753+0000","last_peered":"2024-09-12T02:07:06.171753+0000","last_clean":"2024-09-12T02:07:06.171753+0000","last_became_active":"2024-09-12T02:07:05.178133+0000","last_became_peered":"2024-09-12T02:07:05.178133+0000","last_unstale":"2024-09-12T02:07:06.171753+0000","last_undegraded":"2024-09-12T02:07:06.171753+0000","last_fullsized":"2024-09-12T02:07:06.171753+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:55.251394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164380+0000","last_change":"2024-09-12T02:07:06.184322+0000","last_active":"2024-09-12T02:07:07.164380+0000","last_peered":"2024-09-12T02:07:07.164380+0000","last_clean":"2024-09-12T02:07:07.164380+0000","last_became_active":"2024-09-12T02:07:06.184012+0000","last_became_peered":"2024-09-12T02:07:06.184012+0000","last_unstale":"2024-09-12T02:07:07.164380+0000","last_undegraded":"2024-09-12T02:07:07.164380+0000","last_fullsized":"2024-09-12T02:07:07.164380+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:36.512194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160218+0000","last_change":"2024-09-12T02:07:05.177856+0000","last_active":"2024-09-12T02:07:07.160218+0000","last_peered":"2024-09-12T02:07:07.160218+0000","last_clean":"2024-09-12T02:07:07.160218+0000","last_became_active":"2024-09-12T02:07:05.177540+0000","last_became_peered":"2024-09-12T02:07:05.177540+0000","last_unstale":"2024-09-12T02:07:07.160218+0000","last_undegraded":"2024-09-12T02:07:07.160218+0000","last_fullsized":"2024-09-12T02:07:07.160218+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:10.671601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161000+0000","last_change":"2024-09-12T02:07:06.166133+0000","last_active":"2024-09-12T02:07:07.161000+0000","last_peered":"2024-09-12T02:07:07.161000+0000","last_clean":"2024-09-12T02:07:07.161000+0000","last_became_active":"2024-09-12T02:07:06.165891+0000","last_became_peered":"2024-09-12T02:07:06.165891+0000","last_unstale":"2024-09-12T02:07:07.161000+0000","last_undegraded":"2024-09-12T02:07:07.161000+0000","last_fullsized":"2024-09-12T02:07:07.161000+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:57.379027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"145'1","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.165996+0000","last_change":"2024-09-12T02:07:05.168685+0000","last_active":"2024-09-12T02:07:07.165996+0000","last_peered":"2024-09-12T02:07:07.165996+0000","last_clean":"2024-09-12T02:07:07.165996+0000","last_became_active":"2024-09-12T02:07:05.168379+0000","last_became_peered":"2024-09-12T02:07:05.168379+0000","last_unstale":"2024-09-12T02:07:07.165996+0000","last_undegraded":"2024-09-12T02:07:07.165996+0000","last_fullsized":"2024-09-12T02:07:07.165996+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:55.479228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.181044+0000","last_change":"2024-09-12T02:07:06.168431+0000","last_active":"2024-09-12T02:07:06.181044+0000","last_peered":"2024-09-12T02:07:06.181044+0000","last_clean":"2024-09-12T02:07:06.181044+0000","last_became_active":"2024-09-12T02:07:06.168080+0000","last_became_peered":"2024-09-12T02:07:06.168080+0000","last_unstale":"2024-09-12T02:07:06.181044+0000","last_undegraded":"2024-09-12T02:07:06.181044+0000","last_fullsized":"2024-09-12T02:07:06.181044+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:42.705993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162294+0000","last_change":"2024-09-12T02:07:05.168316+0000","last_active":"2024-09-12T02:07:07.162294+0000","last_peered":"2024-09-12T02:07:07.162294+0000","last_clean":"2024-09-12T02:07:07.162294+0000","last_became_active":"2024-09-12T02:07:05.168016+0000","last_became_peered":"2024-09-12T02:07:05.168016+0000","last_unstale":"2024-09-12T02:07:07.162294+0000","last_undegraded":"2024-09-12T02:07:07.162294+0000","last_fullsized":"2024-09-12T02:07:07.162294+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:52.174429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166763+0000","last_change":"2024-09-12T02:07:06.177410+0000","last_active":"2024-09-12T02:07:07.166763+0000","last_peered":"2024-09-12T02:07:07.166763+0000","last_clean":"2024-09-12T02:07:07.166763+0000","last_became_active":"2024-09-12T02:07:06.177122+0000","last_became_peered":"2024-09-12T02:07:06.177122+0000","last_unstale":"2024-09-12T02:07:07.166763+0000","last_undegraded":"2024-09-12T02:07:07.166763+0000","last_fullsized":"2024-09-12T02:07:07.166763+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:36.663166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160105+0000","last_change":"2024-09-12T02:07:05.169123+0000","last_active":"2024-09-12T02:07:07.160105+0000","last_peered":"2024-09-12T02:07:07.160105+0000","last_clean":"2024-09-12T02:07:07.160105+0000","last_became_active":"2024-09-12T02:07:05.168828+0000","last_became_peered":"2024-09-12T02:07:05.168828+0000","last_unstale":"2024-09-12T02:07:07.160105+0000","last_undegraded":"2024-09-12T02:07:07.160105+0000","last_fullsized":"2024-09-12T02:07:07.160105+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:10.926179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.188173+0000","last_change":"2024-09-12T02:07:06.184423+0000","last_active":"2024-09-12T02:07:06.188173+0000","last_peered":"2024-09-12T02:07:06.188173+0000","last_clean":"2024-09-12T02:07:06.188173+0000","last_became_active":"2024-09-12T02:07:06.184135+0000","last_became_peered":"2024-09-12T02:07:06.184135+0000","last_unstale":"2024-09-12T02:07:06.188173+0000","last_undegraded":"2024-09-12T02:07:06.188173+0000","last_fullsized":"2024-09-12T02:07:06.188173+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:24.456509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161457+0000","last_change":"2024-09-12T02:07:05.167597+0000","last_active":"2024-09-12T02:07:07.161457+0000","last_peered":"2024-09-12T02:07:07.161457+0000","last_clean":"2024-09-12T02:07:07.161457+0000","last_became_active":"2024-09-12T02:07:05.167331+0000","last_became_peered":"2024-09-12T02:07:05.167331+0000","last_unstale":"2024-09-12T02:07:07.161457+0000","last_undegraded":"2024-09-12T02:07:07.161457+0000","last_fullsized":"2024-09-12T02:07:07.161457+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:51.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.191710+0000","last_change":"2024-09-12T02:07:06.188417+0000","last_active":"2024-09-12T02:07:06.191710+0000","last_peered":"2024-09-12T02:07:06.191710+0000","last_clean":"2024-09-12T02:07:06.191710+0000","last_became_active":"2024-09-12T02:07:06.188130+0000","last_became_peered":"2024-09-12T02:07:06.188130+0000","last_unstale":"2024-09-12T02:07:06.191710+0000","last_undegraded":"2024-09-12T02:07:06.191710+0000","last_fullsized":"2024-09-12T02:07:06.191710+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:30.566436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.171063+0000","last_change":"2024-09-12T02:07:05.178730+0000","last_active":"2024-09-12T02:07:06.171063+0000","last_peered":"2024-09-12T02:07:06.171063+0000","last_clean":"2024-09-12T02:07:06.171063+0000","last_became_active":"2024-09-12T02:07:05.178430+0000","last_became_peered":"2024-09-12T02:07:05.178430+0000","last_unstale":"2024-09-12T02:07:06.171063+0000","last_undegraded":"2024-09-12T02:07:06.171063+0000","last_fullsized":"2024-09-12T02:07:06.171063+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:45.524547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152464+0000","last_change":"2024-09-12T02:07:06.183861+0000","last_active":"2024-09-12T02:07:08.152464+0000","last_peered":"2024-09-12T02:07:08.152464+0000","last_clean":"2024-09-12T02:07:08.152464+0000","last_became_active":"2024-09-12T02:07:06.183536+0000","last_became_peered":"2024-09-12T02:07:06.183536+0000","last_unstale":"2024-09-12T02:07:08.152464+0000","last_undegraded":"2024-09-12T02:07:08.152464+0000","last_fullsized":"2024-09-12T02:07:08.152464+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:34.648219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161460+0000","last_change":"2024-09-12T02:07:05.168669+0000","last_active":"2024-09-12T02:07:07.161460+0000","last_peered":"2024-09-12T02:07:07.161460+0000","last_clean":"2024-09-12T02:07:07.161460+0000","last_became_active":"2024-09-12T02:07:05.168394+0000","last_became_peered":"2024-09-12T02:07:05.168394+0000","last_unstale":"2024-09-12T02:07:07.161460+0000","last_undegraded":"2024-09-12T02:07:07.161460+0000","last_fullsized":"2024-09-12T02:07:07.161460+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:00.541517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166993+0000","last_change":"2024-09-12T02:07:06.178232+0000","last_active":"2024-09-12T02:07:07.166993+0000","last_peered":"2024-09-12T02:07:07.166993+0000","last_clean":"2024-09-12T02:07:07.166993+0000","last_became_active":"2024-09-12T02:07:06.177956+0000","last_became_peered":"2024-09-12T02:07:06.177956+0000","last_unstale":"2024-09-12T02:07:07.166993+0000","last_undegraded":"2024-09-12T02:07:07.166993+0000","last_fullsized":"2024-09-12T02:07:07.166993+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:20.796287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.171914+0000","last_change":"2024-09-12T02:07:05.179353+0000","last_active":"2024-09-12T02:07:06.171914+0000","last_peered":"2024-09-12T02:07:06.171914+0000","last_clean":"2024-09-12T02:07:06.171914+0000","last_became_active":"2024-09-12T02:07:05.178558+0000","last_became_peered":"2024-09-12T02:07:05.178558+0000","last_unstale":"2024-09-12T02:07:06.171914+0000","last_undegraded":"2024-09-12T02:07:06.171914+0000","last_fullsized":"2024-09-12T02:07:06.171914+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:39.636624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166714+0000","last_change":"2024-09-12T02:07:06.174986+0000","last_active":"2024-09-12T02:07:07.166714+0000","last_peered":"2024-09-12T02:07:07.166714+0000","last_clean":"2024-09-12T02:07:07.166714+0000","last_became_active":"2024-09-12T02:07:06.174725+0000","last_became_peered":"2024-09-12T02:07:06.174725+0000","last_unstale":"2024-09-12T02:07:07.166714+0000","last_undegraded":"2024-09-12T02:07:07.166714+0000","last_fullsized":"2024-09-12T02:07:07.166714+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:01.767337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"144'2","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.190787+0000","last_change":"2024-09-12T02:07:05.179366+0000","last_active":"2024-09-12T02:07:06.190787+0000","last_peered":"2024-09-12T02:07:06.190787+0000","last_clean":"2024-09-12T02:07:06.190787+0000","last_became_active":"2024-09-12T02:07:05.179079+0000","last_became_peered":"2024-09-12T02:07:05.179079+0000","last_unstale":"2024-09-12T02:07:06.190787+0000","last_undegraded":"2024-09-12T02:07:06.190787+0000","last_fullsized":"2024-09-12T02:07:06.190787+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:43.865590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":407,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152096+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T02:07:08.152096+0000","last_peered":"2024-09-12T02:07:08.152096+0000","last_clean":"2024-09-12T02:07:08.152096+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T02:07:08.152096+0000","last_undegraded":"2024-09-12T02:07:08.152096+0000","last_fullsized":"2024-09-12T02:07:08.152096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509581,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37772,"kb_used_data":2424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334068,"statfs":{"total":96636764160,"available":96598085632,"internally_reserved":0,"allocated":2482176,"data_stored":1546497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509580,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41372,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330468,"statfs":{"total":96636764160,"available":96594399232,"internally_reserved":0,"allocated":1900544,"data_stored":958185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509581,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1880064,"data_stored":955969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542285,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1871872,"data_stored":949859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37180,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334660,"statfs":{"total":96636764160,"available":96598691840,"internally_reserved":0,"allocated":1871872,"data_stored":949311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37188,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334652,"statfs":{"total":96636764160,"available":96598683648,"internally_reserved":0,"allocated":1884160,"data_stored":956003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542285,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41948,"kb_used_data":2432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329892,"statfs":{"total":96636764160,"available":96593809408,"internally_reserved":0,"allocated":2490368,"data_stored":1548039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574989,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37188,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334652,"statfs":{"total":96636764160,"available":96598683648,"internally_reserved":0,"allocated":1875968,"data_stored":949369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:07:14.178 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:07:14.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.291+0000 7fb440be4640 1 Processor -- start 2024-09-12T02:07:14.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.291+0000 7fb440be4640 1 -- start start 2024-09-12T02:07:14.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.292+0000 7fb440be4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb43c0afd60 0x7fb43c0726b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:14.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.292+0000 7fb440be4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb43c0b44c0 con 0x7fb43c072bf0 2024-09-12T02:07:14.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.292+0000 7fb440be4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb43c15ead0 con 0x7fb43c0b3e60 2024-09-12T02:07:14.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.292+0000 7fb440be4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb43c0b4290 con 0x7fb43c0afd60 2024-09-12T02:07:14.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.292+0000 7fb43a59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb43c0afd60 0x7fb43c0726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:14.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.292+0000 7fb439d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb43c072bf0 0x7fb43c0b3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34146/0 (socket says 172.21.15.19:34146) 2024-09-12T02:07:14.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.292+0000 7fb439d9b640 1 -- 172.21.15.19:0/3842020571 learned_addr learned my addr 172.21.15.19:0/3842020571 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:14.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.292+0000 7fb43a59c640 1 --2- 172.21.15.19:0/3842020571 >> v2:172.21.15.19:3300/0 conn(0x7fb43c0afd60 0x7fb43c0726b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54296/0 (socket says 172.21.15.19:54296) 2024-09-12T02:07:14.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.293+0000 7fb43a59c640 1 -- 172.21.15.19:0/3842020571 >> v1:172.21.15.135:6789/0 conn(0x7fb43c0b3e60 legacy=0x7fb43c06f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:14.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.293+0000 7fb43a59c640 1 -- 172.21.15.19:0/3842020571 >> v1:172.21.15.19:6789/0 conn(0x7fb43c072bf0 legacy=0x7fb43c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:14.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.293+0000 7fb43959a640 1 -- 172.21.15.19:0/3842020571 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4252363241 0 0) 0x7fb43c0b44c0 con 0x7fb43c072bf0 2024-09-12T02:07:14.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.293+0000 7fb43a59c640 1 -- 172.21.15.19:0/3842020571 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c15edb0 con 0x7fb43c0afd60 2024-09-12T02:07:14.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.293+0000 7fb43a59c640 1 --2- 172.21.15.19:0/3842020571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb43c0afd60 0x7fb43c0726b0 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0097a0 tx=0x7fb42c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0c46afd9bd9ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:14.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.294+0000 7fb43959a640 1 -- 172.21.15.19:0/3842020571 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c037070 con 0x7fb43c0afd60 2024-09-12T02:07:14.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.294+0000 7fb43959a640 1 -- 172.21.15.19:0/3842020571 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42c032440 con 0x7fb43c0afd60 2024-09-12T02:07:14.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.294+0000 7fb43959a640 1 -- 172.21.15.19:0/3842020571 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c032810 con 0x7fb43c0afd60 2024-09-12T02:07:14.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.294+0000 7fb440be4640 1 -- 172.21.15.19:0/3842020571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb43c0afd60 msgr2=0x7fb43c0726b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:14.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.294+0000 7fb440be4640 1 --2- 172.21.15.19:0/3842020571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb43c0afd60 0x7fb43c0726b0 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0097a0 tx=0x7fb42c02a230 comp rx=0 tx=0).stop 2024-09-12T02:07:14.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.294+0000 7fb440be4640 1 -- 172.21.15.19:0/3842020571 shutdown_connections 2024-09-12T02:07:14.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.294+0000 7fb440be4640 1 --2- 172.21.15.19:0/3842020571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb43c0afd60 0x7fb43c0726b0 unknown :-1 s=CLOSED pgs=2266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.294+0000 7fb440be4640 1 -- 172.21.15.19:0/3842020571 >> 172.21.15.19:0/3842020571 conn(0x7fb43c06c030 msgr2=0x7fb43c06c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:14.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.294+0000 7fb440be4640 1 -- 172.21.15.19:0/3842020571 shutdown_connections 2024-09-12T02:07:14.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.294+0000 7fb440be4640 1 -- 172.21.15.19:0/3842020571 wait complete. 2024-09-12T02:07:14.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.296+0000 7fb440be4640 1 Processor -- start 2024-09-12T02:07:14.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.296+0000 7fb440be4640 1 -- start start 2024-09-12T02:07:14.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb440be4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb43c072bf0 0x7fb43c13e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:14.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb440be4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb43c0afd60 0x7fb43c1573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:14.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb440be4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb43c0b3e60 0x7fb43c1578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:14.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb440be4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c073030 con 0x7fb43c0afd60 2024-09-12T02:07:14.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb440be4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c0b0140 con 0x7fb43c072bf0 2024-09-12T02:07:14.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb440be4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb43c15f370 con 0x7fb43c0b3e60 2024-09-12T02:07:14.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb439d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb43c0afd60 0x7fb43c1573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:14.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb439d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb43c0afd60 0x7fb43c1573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54298/0 (socket says 172.21.15.19:54298) 2024-09-12T02:07:14.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb439d9b640 1 -- 172.21.15.19:0/202063694 learned_addr learned my addr 172.21.15.19:0/202063694 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:14.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb43a59c640 1 --2- 172.21.15.19:0/202063694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb43c072bf0 0x7fb43c13e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:14.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb43ad9d640 1 --2- 172.21.15.19:0/202063694 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb43c0b3e60 0x7fb43c1578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:14.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb439d9b640 1 -- 172.21.15.19:0/202063694 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb43c0b3e60 msgr2=0x7fb43c1578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:14.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb439d9b640 1 --2- 172.21.15.19:0/202063694 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb43c0b3e60 0x7fb43c1578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb439d9b640 1 -- 172.21.15.19:0/202063694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb43c072bf0 msgr2=0x7fb43c13e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:14.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb439d9b640 1 --2- 172.21.15.19:0/202063694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb43c072bf0 0x7fb43c13e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb439d9b640 1 -- 172.21.15.19:0/202063694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c151260 con 0x7fb43c0afd60 2024-09-12T02:07:14.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb43a59c640 1 --2- 172.21.15.19:0/202063694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb43c072bf0 0x7fb43c13e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:14.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb43ad9d640 1 --2- 172.21.15.19:0/202063694 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb43c0b3e60 0x7fb43c1578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:14.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb439d9b640 1 --2- 172.21.15.19:0/202063694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb43c0afd60 0x7fb43c1573b0 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7fb43000c4a0 tx=0x7fb43000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:14.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.297+0000 7fb42affd640 1 -- 172.21.15.19:0/202063694 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430018070 con 0x7fb43c0afd60 2024-09-12T02:07:14.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.298+0000 7fb42affd640 1 -- 172.21.15.19:0/202063694 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4300074e0 con 0x7fb43c0afd60 2024-09-12T02:07:14.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.298+0000 7fb42affd640 1 -- 172.21.15.19:0/202063694 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430004a20 con 0x7fb43c0afd60 2024-09-12T02:07:14.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.298+0000 7fb440be4640 1 -- 172.21.15.19:0/202063694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43c1622b0 con 0x7fb43c0afd60 2024-09-12T02:07:14.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.298+0000 7fb440be4640 1 -- 172.21.15.19:0/202063694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43c162870 con 0x7fb43c0afd60 2024-09-12T02:07:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.299+0000 7fb440be4640 1 -- 172.21.15.19:0/202063694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb43c15f890 con 0x7fb43c0afd60 2024-09-12T02:07:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.299+0000 7fb42affd640 1 -- 172.21.15.19:0/202063694 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb43001b070 con 0x7fb43c0afd60 2024-09-12T02:07:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.300+0000 7fb42affd640 1 --2- 172.21.15.19:0/202063694 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb41c06be30 0x7fb41c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.300+0000 7fb42affd640 1 -- 172.21.15.19:0/202063694 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6101+0+0 (secure 0 0 0) 0x7fb43008a3f0 con 0x7fb43c0afd60 2024-09-12T02:07:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.300+0000 7fb43a59c640 1 --2- 172.21.15.19:0/202063694 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb41c06be30 0x7fb41c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.300+0000 7fb43a59c640 1 --2- 172.21.15.19:0/202063694 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb41c06be30 0x7fb41c06e2f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fb42c034000 tx=0x7fb42c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:14.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.304+0000 7fb42affd640 1 -- 172.21.15.19:0/202063694 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb430058b70 con 0x7fb43c0afd60 2024-09-12T02:07:14.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.476+0000 7fb440be4640 1 -- 172.21.15.19:0/202063694 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb43c154980 con 0x7fb41c06be30 2024-09-12T02:07:14.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.483+0000 7fb42affd640 1 -- 172.21.15.19:0/202063694 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252374 (secure 0 0 0) 0x7fb43c154980 con 0x7fb41c06be30 2024-09-12T02:07:14.486 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:14.487 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T02:07:14.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.485+0000 7fb440be4640 1 -- 172.21.15.19:0/202063694 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb41c06be30 msgr2=0x7fb41c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:14.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.486+0000 7fb440be4640 1 --2- 172.21.15.19:0/202063694 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb41c06be30 0x7fb41c06e2f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fb42c034000 tx=0x7fb42c02e000 comp rx=0 tx=0).stop 2024-09-12T02:07:14.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.486+0000 7fb440be4640 1 -- 172.21.15.19:0/202063694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb43c0afd60 msgr2=0x7fb43c1573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:14.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.486+0000 7fb440be4640 1 --2- 172.21.15.19:0/202063694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb43c0afd60 0x7fb43c1573b0 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7fb43000c4a0 tx=0x7fb43000c960 comp rx=0 tx=0).stop 2024-09-12T02:07:14.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.486+0000 7fb440be4640 1 -- 172.21.15.19:0/202063694 shutdown_connections 2024-09-12T02:07:14.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.486+0000 7fb440be4640 1 --2- 172.21.15.19:0/202063694 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb41c06be30 0x7fb41c06e2f0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.486+0000 7fb440be4640 1 --2- 172.21.15.19:0/202063694 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb43c0b3e60 0x7fb43c1578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.486+0000 7fb440be4640 1 --2- 172.21.15.19:0/202063694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb43c0afd60 0x7fb43c1573b0 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.486+0000 7fb440be4640 1 --2- 172.21.15.19:0/202063694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb43c072bf0 0x7fb43c13e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.486+0000 7fb440be4640 1 -- 172.21.15.19:0/202063694 >> 172.21.15.19:0/202063694 conn(0x7fb43c06c030 msgr2=0x7fb43c0ad8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:14.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.486+0000 7fb440be4640 1 -- 172.21.15.19:0/202063694 shutdown_connections 2024-09-12T02:07:14.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.486+0000 7fb440be4640 1 -- 172.21.15.19:0/202063694 wait complete. 2024-09-12T02:07:14.497 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":484,"stamp":"2024-09-12T02:07:14.253451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":298720,"kb_used_data":15912,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754676000,"statfs":{"total":773094113280,"available":772788224000,"internally_reserved":0,"allocated":16293888,"data_stored":8833308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.095215"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164699+0000","last_change":"2024-09-12T02:07:06.188562+0000","last_active":"2024-09-12T02:07:07.164699+0000","last_peered":"2024-09-12T02:07:07.164699+0000","last_clean":"2024-09-12T02:07:07.164699+0000","last_became_active":"2024-09-12T02:07:06.188181+0000","last_became_peered":"2024-09-12T02:07:06.188181+0000","last_unstale":"2024-09-12T02:07:07.164699+0000","last_undegraded":"2024-09-12T02:07:07.164699+0000","last_fullsized":"2024-09-12T02:07:07.164699+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:30.948775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162342+0000","last_change":"2024-09-12T02:07:06.174390+0000","last_active":"2024-09-12T02:07:07.162342+0000","last_peered":"2024-09-12T02:07:07.162342+0000","last_clean":"2024-09-12T02:07:07.162342+0000","last_became_active":"2024-09-12T02:07:06.174074+0000","last_became_peered":"2024-09-12T02:07:06.174074+0000","last_unstale":"2024-09-12T02:07:07.162342+0000","last_undegraded":"2024-09-12T02:07:07.162342+0000","last_fullsized":"2024-09-12T02:07:07.162342+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:44.672172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164673+0000","last_change":"2024-09-12T02:07:06.181043+0000","last_active":"2024-09-12T02:07:07.164673+0000","last_peered":"2024-09-12T02:07:07.164673+0000","last_clean":"2024-09-12T02:07:07.164673+0000","last_became_active":"2024-09-12T02:07:06.180739+0000","last_became_peered":"2024-09-12T02:07:06.180739+0000","last_unstale":"2024-09-12T02:07:07.164673+0000","last_undegraded":"2024-09-12T02:07:07.164673+0000","last_fullsized":"2024-09-12T02:07:07.164673+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:59.243937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350578+0000","last_change":"2024-09-12T02:07:06.182365+0000","last_active":"2024-09-12T02:07:08.350578+0000","last_peered":"2024-09-12T02:07:08.350578+0000","last_clean":"2024-09-12T02:07:08.350578+0000","last_became_active":"2024-09-12T02:07:06.182017+0000","last_became_peered":"2024-09-12T02:07:06.182017+0000","last_unstale":"2024-09-12T02:07:08.350578+0000","last_undegraded":"2024-09-12T02:07:08.350578+0000","last_fullsized":"2024-09-12T02:07:08.350578+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:45.084750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.159991+0000","last_change":"2024-09-12T02:07:06.174721+0000","last_active":"2024-09-12T02:07:07.159991+0000","last_peered":"2024-09-12T02:07:07.159991+0000","last_clean":"2024-09-12T02:07:07.159991+0000","last_became_active":"2024-09-12T02:07:06.174396+0000","last_became_peered":"2024-09-12T02:07:06.174396+0000","last_unstale":"2024-09-12T02:07:07.159991+0000","last_undegraded":"2024-09-12T02:07:07.159991+0000","last_fullsized":"2024-09-12T02:07:07.159991+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:38.012619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161796+0000","last_change":"2024-09-12T02:07:06.169646+0000","last_active":"2024-09-12T02:07:07.161796+0000","last_peered":"2024-09-12T02:07:07.161796+0000","last_clean":"2024-09-12T02:07:07.161796+0000","last_became_active":"2024-09-12T02:07:06.169353+0000","last_became_peered":"2024-09-12T02:07:06.169353+0000","last_unstale":"2024-09-12T02:07:07.161796+0000","last_undegraded":"2024-09-12T02:07:07.161796+0000","last_fullsized":"2024-09-12T02:07:07.161796+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:09.522486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161049+0000","last_change":"2024-09-12T02:07:06.174812+0000","last_active":"2024-09-12T02:07:07.161049+0000","last_peered":"2024-09-12T02:07:07.161049+0000","last_clean":"2024-09-12T02:07:07.161049+0000","last_became_active":"2024-09-12T02:07:06.174515+0000","last_became_peered":"2024-09-12T02:07:06.174515+0000","last_unstale":"2024-09-12T02:07:07.161049+0000","last_undegraded":"2024-09-12T02:07:07.161049+0000","last_fullsized":"2024-09-12T02:07:07.161049+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:50.679377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350320+0000","last_change":"2024-09-12T02:07:06.187847+0000","last_active":"2024-09-12T02:07:08.350320+0000","last_peered":"2024-09-12T02:07:08.350320+0000","last_clean":"2024-09-12T02:07:08.350320+0000","last_became_active":"2024-09-12T02:07:06.187330+0000","last_became_peered":"2024-09-12T02:07:06.187330+0000","last_unstale":"2024-09-12T02:07:08.350320+0000","last_undegraded":"2024-09-12T02:07:08.350320+0000","last_fullsized":"2024-09-12T02:07:08.350320+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:09.201585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162152+0000","last_change":"2024-09-12T02:07:06.186070+0000","last_active":"2024-09-12T02:07:07.162152+0000","last_peered":"2024-09-12T02:07:07.162152+0000","last_clean":"2024-09-12T02:07:07.162152+0000","last_became_active":"2024-09-12T02:07:06.185718+0000","last_became_peered":"2024-09-12T02:07:06.185718+0000","last_unstale":"2024-09-12T02:07:07.162152+0000","last_undegraded":"2024-09-12T02:07:07.162152+0000","last_fullsized":"2024-09-12T02:07:07.162152+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:02.274114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160269+0000","last_change":"2024-09-12T02:07:06.165191+0000","last_active":"2024-09-12T02:07:07.160269+0000","last_peered":"2024-09-12T02:07:07.160269+0000","last_clean":"2024-09-12T02:07:07.160269+0000","last_became_active":"2024-09-12T02:07:06.164894+0000","last_became_peered":"2024-09-12T02:07:06.164894+0000","last_unstale":"2024-09-12T02:07:07.160269+0000","last_undegraded":"2024-09-12T02:07:07.160269+0000","last_fullsized":"2024-09-12T02:07:07.160269+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:51.780792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166773+0000","last_change":"2024-09-12T02:07:06.176297+0000","last_active":"2024-09-12T02:07:07.166773+0000","last_peered":"2024-09-12T02:07:07.166773+0000","last_clean":"2024-09-12T02:07:07.166773+0000","last_became_active":"2024-09-12T02:07:06.175504+0000","last_became_peered":"2024-09-12T02:07:06.175504+0000","last_unstale":"2024-09-12T02:07:07.166773+0000","last_undegraded":"2024-09-12T02:07:07.166773+0000","last_fullsized":"2024-09-12T02:07:07.166773+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:15.961805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161745+0000","last_change":"2024-09-12T02:07:06.170696+0000","last_active":"2024-09-12T02:07:07.161745+0000","last_peered":"2024-09-12T02:07:07.161745+0000","last_clean":"2024-09-12T02:07:07.161745+0000","last_became_active":"2024-09-12T02:07:06.170368+0000","last_became_peered":"2024-09-12T02:07:06.170368+0000","last_unstale":"2024-09-12T02:07:07.161745+0000","last_undegraded":"2024-09-12T02:07:07.161745+0000","last_fullsized":"2024-09-12T02:07:07.161745+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:57.778187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350627+0000","last_change":"2024-09-12T02:07:06.181857+0000","last_active":"2024-09-12T02:07:08.350627+0000","last_peered":"2024-09-12T02:07:08.350627+0000","last_clean":"2024-09-12T02:07:08.350627+0000","last_became_active":"2024-09-12T02:07:06.181467+0000","last_became_peered":"2024-09-12T02:07:06.181467+0000","last_unstale":"2024-09-12T02:07:08.350627+0000","last_undegraded":"2024-09-12T02:07:08.350627+0000","last_fullsized":"2024-09-12T02:07:08.350627+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:36.728703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152264+0000","last_change":"2024-09-12T02:07:06.182969+0000","last_active":"2024-09-12T02:07:08.152264+0000","last_peered":"2024-09-12T02:07:08.152264+0000","last_clean":"2024-09-12T02:07:08.152264+0000","last_became_active":"2024-09-12T02:07:06.182682+0000","last_became_peered":"2024-09-12T02:07:06.182682+0000","last_unstale":"2024-09-12T02:07:08.152264+0000","last_undegraded":"2024-09-12T02:07:08.152264+0000","last_fullsized":"2024-09-12T02:07:08.152264+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:47.959635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152317+0000","last_change":"2024-09-12T02:07:06.180638+0000","last_active":"2024-09-12T02:07:08.152317+0000","last_peered":"2024-09-12T02:07:08.152317+0000","last_clean":"2024-09-12T02:07:08.152317+0000","last_became_active":"2024-09-12T02:07:06.180381+0000","last_became_peered":"2024-09-12T02:07:06.180381+0000","last_unstale":"2024-09-12T02:07:08.152317+0000","last_undegraded":"2024-09-12T02:07:08.152317+0000","last_fullsized":"2024-09-12T02:07:08.152317+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:27.615773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152229+0000","last_change":"2024-09-12T02:07:06.177792+0000","last_active":"2024-09-12T02:07:08.152229+0000","last_peered":"2024-09-12T02:07:08.152229+0000","last_clean":"2024-09-12T02:07:08.152229+0000","last_became_active":"2024-09-12T02:07:06.177444+0000","last_became_peered":"2024-09-12T02:07:06.177444+0000","last_unstale":"2024-09-12T02:07:08.152229+0000","last_undegraded":"2024-09-12T02:07:08.152229+0000","last_fullsized":"2024-09-12T02:07:08.152229+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:56.590510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164742+0000","last_change":"2024-09-12T02:07:06.180361+0000","last_active":"2024-09-12T02:07:07.164742+0000","last_peered":"2024-09-12T02:07:07.164742+0000","last_clean":"2024-09-12T02:07:07.164742+0000","last_became_active":"2024-09-12T02:07:06.180017+0000","last_became_peered":"2024-09-12T02:07:06.180017+0000","last_unstale":"2024-09-12T02:07:07.164742+0000","last_undegraded":"2024-09-12T02:07:07.164742+0000","last_fullsized":"2024-09-12T02:07:07.164742+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:30.553159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162378+0000","last_change":"2024-09-12T02:07:06.175609+0000","last_active":"2024-09-12T02:07:07.162378+0000","last_peered":"2024-09-12T02:07:07.162378+0000","last_clean":"2024-09-12T02:07:07.162378+0000","last_became_active":"2024-09-12T02:07:06.175358+0000","last_became_peered":"2024-09-12T02:07:06.175358+0000","last_unstale":"2024-09-12T02:07:07.162378+0000","last_undegraded":"2024-09-12T02:07:07.162378+0000","last_fullsized":"2024-09-12T02:07:07.162378+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:06.129951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164694+0000","last_change":"2024-09-12T02:07:06.184058+0000","last_active":"2024-09-12T02:07:07.164694+0000","last_peered":"2024-09-12T02:07:07.164694+0000","last_clean":"2024-09-12T02:07:07.164694+0000","last_became_active":"2024-09-12T02:07:06.183753+0000","last_became_peered":"2024-09-12T02:07:06.183753+0000","last_unstale":"2024-09-12T02:07:07.164694+0000","last_undegraded":"2024-09-12T02:07:07.164694+0000","last_fullsized":"2024-09-12T02:07:07.164694+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:58.979849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162191+0000","last_change":"2024-09-12T02:07:06.173004+0000","last_active":"2024-09-12T02:07:07.162191+0000","last_peered":"2024-09-12T02:07:07.162191+0000","last_clean":"2024-09-12T02:07:07.162191+0000","last_became_active":"2024-09-12T02:07:06.172715+0000","last_became_peered":"2024-09-12T02:07:06.172715+0000","last_unstale":"2024-09-12T02:07:07.162191+0000","last_undegraded":"2024-09-12T02:07:07.162191+0000","last_fullsized":"2024-09-12T02:07:07.162191+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:42.705993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.351341+0000","last_change":"2024-09-12T02:07:06.177889+0000","last_active":"2024-09-12T02:07:08.351341+0000","last_peered":"2024-09-12T02:07:08.351341+0000","last_clean":"2024-09-12T02:07:08.351341+0000","last_became_active":"2024-09-12T02:07:06.177498+0000","last_became_peered":"2024-09-12T02:07:06.177498+0000","last_unstale":"2024-09-12T02:07:08.351341+0000","last_undegraded":"2024-09-12T02:07:08.351341+0000","last_fullsized":"2024-09-12T02:07:08.351341+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:01.544000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160079+0000","last_change":"2024-09-12T02:07:06.185065+0000","last_active":"2024-09-12T02:07:07.160079+0000","last_peered":"2024-09-12T02:07:07.160079+0000","last_clean":"2024-09-12T02:07:07.160079+0000","last_became_active":"2024-09-12T02:07:06.184779+0000","last_became_peered":"2024-09-12T02:07:06.184779+0000","last_unstale":"2024-09-12T02:07:07.160079+0000","last_undegraded":"2024-09-12T02:07:07.160079+0000","last_fullsized":"2024-09-12T02:07:07.160079+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:13.412294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164498+0000","last_change":"2024-09-12T02:07:06.180301+0000","last_active":"2024-09-12T02:07:07.164498+0000","last_peered":"2024-09-12T02:07:07.164498+0000","last_clean":"2024-09-12T02:07:07.164498+0000","last_became_active":"2024-09-12T02:07:06.179930+0000","last_became_peered":"2024-09-12T02:07:06.179930+0000","last_unstale":"2024-09-12T02:07:07.164498+0000","last_undegraded":"2024-09-12T02:07:07.164498+0000","last_fullsized":"2024-09-12T02:07:07.164498+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:29.743856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160141+0000","last_change":"2024-09-12T02:07:06.173860+0000","last_active":"2024-09-12T02:07:07.160141+0000","last_peered":"2024-09-12T02:07:07.160141+0000","last_clean":"2024-09-12T02:07:07.160141+0000","last_became_active":"2024-09-12T02:07:06.173507+0000","last_became_peered":"2024-09-12T02:07:06.173507+0000","last_unstale":"2024-09-12T02:07:07.160141+0000","last_undegraded":"2024-09-12T02:07:07.160141+0000","last_fullsized":"2024-09-12T02:07:07.160141+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:55.442840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161259+0000","last_change":"2024-09-12T02:07:06.183545+0000","last_active":"2024-09-12T02:07:07.161259+0000","last_peered":"2024-09-12T02:07:07.161259+0000","last_clean":"2024-09-12T02:07:07.161259+0000","last_became_active":"2024-09-12T02:07:06.180674+0000","last_became_peered":"2024-09-12T02:07:06.180674+0000","last_unstale":"2024-09-12T02:07:07.161259+0000","last_undegraded":"2024-09-12T02:07:07.161259+0000","last_fullsized":"2024-09-12T02:07:07.161259+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:23.067644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161179+0000","last_change":"2024-09-12T02:07:06.171797+0000","last_active":"2024-09-12T02:07:07.161179+0000","last_peered":"2024-09-12T02:07:07.161179+0000","last_clean":"2024-09-12T02:07:07.161179+0000","last_became_active":"2024-09-12T02:07:06.171513+0000","last_became_peered":"2024-09-12T02:07:06.171513+0000","last_unstale":"2024-09-12T02:07:07.161179+0000","last_undegraded":"2024-09-12T02:07:07.161179+0000","last_fullsized":"2024-09-12T02:07:07.161179+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:58.954857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166845+0000","last_change":"2024-09-12T02:07:06.178849+0000","last_active":"2024-09-12T02:07:07.166845+0000","last_peered":"2024-09-12T02:07:07.166845+0000","last_clean":"2024-09-12T02:07:07.166845+0000","last_became_active":"2024-09-12T02:07:06.178582+0000","last_became_peered":"2024-09-12T02:07:06.178582+0000","last_unstale":"2024-09-12T02:07:07.166845+0000","last_undegraded":"2024-09-12T02:07:07.166845+0000","last_fullsized":"2024-09-12T02:07:07.166845+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:22.419853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162191+0000","last_change":"2024-09-12T02:07:06.179357+0000","last_active":"2024-09-12T02:07:07.162191+0000","last_peered":"2024-09-12T02:07:07.162191+0000","last_clean":"2024-09-12T02:07:07.162191+0000","last_became_active":"2024-09-12T02:07:06.179095+0000","last_became_peered":"2024-09-12T02:07:06.179095+0000","last_unstale":"2024-09-12T02:07:07.162191+0000","last_undegraded":"2024-09-12T02:07:07.162191+0000","last_fullsized":"2024-09-12T02:07:07.162191+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:02.076504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.351228+0000","last_change":"2024-09-12T02:07:06.177320+0000","last_active":"2024-09-12T02:07:08.351228+0000","last_peered":"2024-09-12T02:07:08.351228+0000","last_clean":"2024-09-12T02:07:08.351228+0000","last_became_active":"2024-09-12T02:07:06.176959+0000","last_became_peered":"2024-09-12T02:07:06.176959+0000","last_unstale":"2024-09-12T02:07:08.351228+0000","last_undegraded":"2024-09-12T02:07:08.351228+0000","last_fullsized":"2024-09-12T02:07:08.351228+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:25.646040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161419+0000","last_change":"2024-09-12T02:07:06.178211+0000","last_active":"2024-09-12T02:07:07.161419+0000","last_peered":"2024-09-12T02:07:07.161419+0000","last_clean":"2024-09-12T02:07:07.161419+0000","last_became_active":"2024-09-12T02:07:06.177168+0000","last_became_peered":"2024-09-12T02:07:06.177168+0000","last_unstale":"2024-09-12T02:07:07.161419+0000","last_undegraded":"2024-09-12T02:07:07.161419+0000","last_fullsized":"2024-09-12T02:07:07.161419+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:26.784396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161207+0000","last_change":"2024-09-12T02:07:06.186273+0000","last_active":"2024-09-12T02:07:07.161207+0000","last_peered":"2024-09-12T02:07:07.161207+0000","last_clean":"2024-09-12T02:07:07.161207+0000","last_became_active":"2024-09-12T02:07:06.185981+0000","last_became_peered":"2024-09-12T02:07:06.185981+0000","last_unstale":"2024-09-12T02:07:07.161207+0000","last_undegraded":"2024-09-12T02:07:07.161207+0000","last_fullsized":"2024-09-12T02:07:07.161207+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:17.401197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350502+0000","last_change":"2024-09-12T02:07:06.187602+0000","last_active":"2024-09-12T02:07:08.350502+0000","last_peered":"2024-09-12T02:07:08.350502+0000","last_clean":"2024-09-12T02:07:08.350502+0000","last_became_active":"2024-09-12T02:07:06.186930+0000","last_became_peered":"2024-09-12T02:07:06.186930+0000","last_unstale":"2024-09-12T02:07:08.350502+0000","last_undegraded":"2024-09-12T02:07:08.350502+0000","last_fullsized":"2024-09-12T02:07:08.350502+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:39.722702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164540+0000","last_change":"2024-09-12T02:07:06.182081+0000","last_active":"2024-09-12T02:07:07.164540+0000","last_peered":"2024-09-12T02:07:07.164540+0000","last_clean":"2024-09-12T02:07:07.164540+0000","last_became_active":"2024-09-12T02:07:06.181774+0000","last_became_peered":"2024-09-12T02:07:06.181774+0000","last_unstale":"2024-09-12T02:07:07.164540+0000","last_undegraded":"2024-09-12T02:07:07.164540+0000","last_fullsized":"2024-09-12T02:07:07.164540+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:41.166247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"144'4","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.351090+0000","last_change":"2024-09-12T02:07:05.168735+0000","last_active":"2024-09-12T02:07:08.351090+0000","last_peered":"2024-09-12T02:07:08.351090+0000","last_clean":"2024-09-12T02:07:08.351090+0000","last_became_active":"2024-09-12T02:07:05.168378+0000","last_became_peered":"2024-09-12T02:07:05.168378+0000","last_unstale":"2024-09-12T02:07:08.351090+0000","last_undegraded":"2024-09-12T02:07:08.351090+0000","last_fullsized":"2024-09-12T02:07:08.351090+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:56.775704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350367+0000","last_change":"2024-09-12T02:07:06.189264+0000","last_active":"2024-09-12T02:07:08.350367+0000","last_peered":"2024-09-12T02:07:08.350367+0000","last_clean":"2024-09-12T02:07:08.350367+0000","last_became_active":"2024-09-12T02:07:06.188784+0000","last_became_peered":"2024-09-12T02:07:06.188784+0000","last_unstale":"2024-09-12T02:07:08.350367+0000","last_undegraded":"2024-09-12T02:07:08.350367+0000","last_fullsized":"2024-09-12T02:07:08.350367+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:21.524443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"144'1","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.351090+0000","last_change":"2024-09-12T02:07:05.178805+0000","last_active":"2024-09-12T02:07:08.351090+0000","last_peered":"2024-09-12T02:07:08.351090+0000","last_clean":"2024-09-12T02:07:08.351090+0000","last_became_active":"2024-09-12T02:07:05.178340+0000","last_became_peered":"2024-09-12T02:07:05.178340+0000","last_unstale":"2024-09-12T02:07:08.351090+0000","last_undegraded":"2024-09-12T02:07:08.351090+0000","last_fullsized":"2024-09-12T02:07:08.351090+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:30.323418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161537+0000","last_change":"2024-09-12T02:07:06.170078+0000","last_active":"2024-09-12T02:07:07.161537+0000","last_peered":"2024-09-12T02:07:07.161537+0000","last_clean":"2024-09-12T02:07:07.161537+0000","last_became_active":"2024-09-12T02:07:06.169626+0000","last_became_peered":"2024-09-12T02:07:06.169626+0000","last_unstale":"2024-09-12T02:07:07.161537+0000","last_undegraded":"2024-09-12T02:07:07.161537+0000","last_fullsized":"2024-09-12T02:07:07.161537+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:02.746428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161354+0000","last_change":"2024-09-12T02:07:05.173497+0000","last_active":"2024-09-12T02:07:07.161354+0000","last_peered":"2024-09-12T02:07:07.161354+0000","last_clean":"2024-09-12T02:07:07.161354+0000","last_became_active":"2024-09-12T02:07:05.173240+0000","last_became_peered":"2024-09-12T02:07:05.173240+0000","last_unstale":"2024-09-12T02:07:07.161354+0000","last_undegraded":"2024-09-12T02:07:07.161354+0000","last_fullsized":"2024-09-12T02:07:07.161354+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:45.930215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166749+0000","last_change":"2024-09-12T02:07:06.175693+0000","last_active":"2024-09-12T02:07:07.166749+0000","last_peered":"2024-09-12T02:07:07.166749+0000","last_clean":"2024-09-12T02:07:07.166749+0000","last_became_active":"2024-09-12T02:07:06.175445+0000","last_became_peered":"2024-09-12T02:07:06.175445+0000","last_unstale":"2024-09-12T02:07:07.166749+0000","last_undegraded":"2024-09-12T02:07:07.166749+0000","last_fullsized":"2024-09-12T02:07:07.166749+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:32.944261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160093+0000","last_change":"2024-09-12T02:07:05.174789+0000","last_active":"2024-09-12T02:07:07.160093+0000","last_peered":"2024-09-12T02:07:07.160093+0000","last_clean":"2024-09-12T02:07:07.160093+0000","last_became_active":"2024-09-12T02:07:05.174498+0000","last_became_peered":"2024-09-12T02:07:05.174498+0000","last_unstale":"2024-09-12T02:07:07.160093+0000","last_undegraded":"2024-09-12T02:07:07.160093+0000","last_fullsized":"2024-09-12T02:07:07.160093+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:39.219875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350650+0000","last_change":"2024-09-12T02:07:06.182146+0000","last_active":"2024-09-12T02:07:08.350650+0000","last_peered":"2024-09-12T02:07:08.350650+0000","last_clean":"2024-09-12T02:07:08.350650+0000","last_became_active":"2024-09-12T02:07:06.181487+0000","last_became_peered":"2024-09-12T02:07:06.181487+0000","last_unstale":"2024-09-12T02:07:08.350650+0000","last_undegraded":"2024-09-12T02:07:08.350650+0000","last_fullsized":"2024-09-12T02:07:08.350650+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:11.760033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"144'1","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152222+0000","last_change":"2024-09-12T02:07:05.170859+0000","last_active":"2024-09-12T02:07:08.152222+0000","last_peered":"2024-09-12T02:07:08.152222+0000","last_clean":"2024-09-12T02:07:08.152222+0000","last_became_active":"2024-09-12T02:07:05.170461+0000","last_became_peered":"2024-09-12T02:07:05.170461+0000","last_unstale":"2024-09-12T02:07:08.152222+0000","last_undegraded":"2024-09-12T02:07:08.152222+0000","last_fullsized":"2024-09-12T02:07:08.152222+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:21.417369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164914+0000","last_change":"2024-09-12T02:07:06.180769+0000","last_active":"2024-09-12T02:07:07.164914+0000","last_peered":"2024-09-12T02:07:07.164914+0000","last_clean":"2024-09-12T02:07:07.164914+0000","last_became_active":"2024-09-12T02:07:06.180488+0000","last_became_peered":"2024-09-12T02:07:06.180488+0000","last_unstale":"2024-09-12T02:07:07.164914+0000","last_undegraded":"2024-09-12T02:07:07.164914+0000","last_fullsized":"2024-09-12T02:07:07.164914+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:53.889287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"144'1","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166448+0000","last_change":"2024-09-12T02:07:05.173595+0000","last_active":"2024-09-12T02:07:07.166448+0000","last_peered":"2024-09-12T02:07:07.166448+0000","last_clean":"2024-09-12T02:07:07.166448+0000","last_became_active":"2024-09-12T02:07:05.173302+0000","last_became_peered":"2024-09-12T02:07:05.173302+0000","last_unstale":"2024-09-12T02:07:07.166448+0000","last_undegraded":"2024-09-12T02:07:07.166448+0000","last_fullsized":"2024-09-12T02:07:07.166448+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:16.398714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162438+0000","last_change":"2024-09-12T02:07:06.178635+0000","last_active":"2024-09-12T02:07:07.162438+0000","last_peered":"2024-09-12T02:07:07.162438+0000","last_clean":"2024-09-12T02:07:07.162438+0000","last_became_active":"2024-09-12T02:07:06.178364+0000","last_became_peered":"2024-09-12T02:07:06.178364+0000","last_unstale":"2024-09-12T02:07:07.162438+0000","last_undegraded":"2024-09-12T02:07:07.162438+0000","last_fullsized":"2024-09-12T02:07:07.162438+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:48.232335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161246+0000","last_change":"2024-09-12T02:07:05.169281+0000","last_active":"2024-09-12T02:07:07.161246+0000","last_peered":"2024-09-12T02:07:07.161246+0000","last_clean":"2024-09-12T02:07:07.161246+0000","last_became_active":"2024-09-12T02:07:05.169013+0000","last_became_peered":"2024-09-12T02:07:05.169013+0000","last_unstale":"2024-09-12T02:07:07.161246+0000","last_undegraded":"2024-09-12T02:07:07.161246+0000","last_fullsized":"2024-09-12T02:07:07.161246+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:35.627376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350951+0000","last_change":"2024-09-12T02:07:06.185740+0000","last_active":"2024-09-12T02:07:08.350951+0000","last_peered":"2024-09-12T02:07:08.350951+0000","last_clean":"2024-09-12T02:07:08.350951+0000","last_became_active":"2024-09-12T02:07:06.185464+0000","last_became_peered":"2024-09-12T02:07:06.185464+0000","last_unstale":"2024-09-12T02:07:08.350951+0000","last_undegraded":"2024-09-12T02:07:08.350951+0000","last_fullsized":"2024-09-12T02:07:08.350951+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:33.491390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350696+0000","last_change":"2024-09-12T02:07:05.171827+0000","last_active":"2024-09-12T02:07:08.350696+0000","last_peered":"2024-09-12T02:07:08.350696+0000","last_clean":"2024-09-12T02:07:08.350696+0000","last_became_active":"2024-09-12T02:07:05.170929+0000","last_became_peered":"2024-09-12T02:07:05.170929+0000","last_unstale":"2024-09-12T02:07:08.350696+0000","last_undegraded":"2024-09-12T02:07:08.350696+0000","last_fullsized":"2024-09-12T02:07:08.350696+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:25.781913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164699+0000","last_change":"2024-09-12T02:07:06.182831+0000","last_active":"2024-09-12T02:07:07.164699+0000","last_peered":"2024-09-12T02:07:07.164699+0000","last_clean":"2024-09-12T02:07:07.164699+0000","last_became_active":"2024-09-12T02:07:06.182547+0000","last_became_peered":"2024-09-12T02:07:06.182547+0000","last_unstale":"2024-09-12T02:07:07.164699+0000","last_undegraded":"2024-09-12T02:07:07.164699+0000","last_fullsized":"2024-09-12T02:07:07.164699+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:46.521663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161205+0000","last_change":"2024-09-12T02:07:05.170472+0000","last_active":"2024-09-12T02:07:07.161205+0000","last_peered":"2024-09-12T02:07:07.161205+0000","last_clean":"2024-09-12T02:07:07.161205+0000","last_became_active":"2024-09-12T02:07:05.170230+0000","last_became_peered":"2024-09-12T02:07:05.170230+0000","last_unstale":"2024-09-12T02:07:07.161205+0000","last_undegraded":"2024-09-12T02:07:07.161205+0000","last_fullsized":"2024-09-12T02:07:07.161205+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:37.010136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.159884+0000","last_change":"2024-09-12T02:07:06.184089+0000","last_active":"2024-09-12T02:07:07.159884+0000","last_peered":"2024-09-12T02:07:07.159884+0000","last_clean":"2024-09-12T02:07:07.159884+0000","last_became_active":"2024-09-12T02:07:06.183803+0000","last_became_peered":"2024-09-12T02:07:06.183803+0000","last_unstale":"2024-09-12T02:07:07.159884+0000","last_undegraded":"2024-09-12T02:07:07.159884+0000","last_fullsized":"2024-09-12T02:07:07.159884+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:46.932699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164723+0000","last_change":"2024-09-12T02:07:05.169627+0000","last_active":"2024-09-12T02:07:07.164723+0000","last_peered":"2024-09-12T02:07:07.164723+0000","last_clean":"2024-09-12T02:07:07.164723+0000","last_became_active":"2024-09-12T02:07:05.169351+0000","last_became_peered":"2024-09-12T02:07:05.169351+0000","last_unstale":"2024-09-12T02:07:07.164723+0000","last_undegraded":"2024-09-12T02:07:07.164723+0000","last_fullsized":"2024-09-12T02:07:07.164723+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:16.639255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350502+0000","last_change":"2024-09-12T02:07:06.185105+0000","last_active":"2024-09-12T02:07:08.350502+0000","last_peered":"2024-09-12T02:07:08.350502+0000","last_clean":"2024-09-12T02:07:08.350502+0000","last_became_active":"2024-09-12T02:07:06.184834+0000","last_became_peered":"2024-09-12T02:07:06.184834+0000","last_unstale":"2024-09-12T02:07:08.350502+0000","last_undegraded":"2024-09-12T02:07:08.350502+0000","last_fullsized":"2024-09-12T02:07:08.350502+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:22.564568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"144'3","reported_seq":17,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152291+0000","last_change":"2024-09-12T02:07:05.171680+0000","last_active":"2024-09-12T02:07:08.152291+0000","last_peered":"2024-09-12T02:07:08.152291+0000","last_clean":"2024-09-12T02:07:08.152291+0000","last_became_active":"2024-09-12T02:07:05.171404+0000","last_became_peered":"2024-09-12T02:07:05.171404+0000","last_unstale":"2024-09-12T02:07:08.152291+0000","last_undegraded":"2024-09-12T02:07:08.152291+0000","last_fullsized":"2024-09-12T02:07:08.152291+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:35.660683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160149+0000","last_change":"2024-09-12T02:07:06.185464+0000","last_active":"2024-09-12T02:07:07.160149+0000","last_peered":"2024-09-12T02:07:07.160149+0000","last_clean":"2024-09-12T02:07:07.160149+0000","last_became_active":"2024-09-12T02:07:06.184939+0000","last_became_peered":"2024-09-12T02:07:06.184939+0000","last_unstale":"2024-09-12T02:07:07.160149+0000","last_undegraded":"2024-09-12T02:07:07.160149+0000","last_fullsized":"2024-09-12T02:07:07.160149+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:43.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"144'6","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162233+0000","last_change":"2024-09-12T02:07:05.167291+0000","last_active":"2024-09-12T02:07:07.162233+0000","last_peered":"2024-09-12T02:07:07.162233+0000","last_clean":"2024-09-12T02:07:07.162233+0000","last_became_active":"2024-09-12T02:07:05.167007+0000","last_became_peered":"2024-09-12T02:07:05.167007+0000","last_unstale":"2024-09-12T02:07:07.162233+0000","last_undegraded":"2024-09-12T02:07:07.162233+0000","last_fullsized":"2024-09-12T02:07:07.162233+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:24.643556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166672+0000","last_change":"2024-09-12T02:07:06.177960+0000","last_active":"2024-09-12T02:07:07.166672+0000","last_peered":"2024-09-12T02:07:07.166672+0000","last_clean":"2024-09-12T02:07:07.166672+0000","last_became_active":"2024-09-12T02:07:06.177674+0000","last_became_peered":"2024-09-12T02:07:06.177674+0000","last_unstale":"2024-09-12T02:07:07.166672+0000","last_undegraded":"2024-09-12T02:07:07.166672+0000","last_fullsized":"2024-09-12T02:07:07.166672+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:02.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160245+0000","last_change":"2024-09-12T02:07:05.180245+0000","last_active":"2024-09-12T02:07:07.160245+0000","last_peered":"2024-09-12T02:07:07.160245+0000","last_clean":"2024-09-12T02:07:07.160245+0000","last_became_active":"2024-09-12T02:07:05.179890+0000","last_became_peered":"2024-09-12T02:07:05.179890+0000","last_unstale":"2024-09-12T02:07:07.160245+0000","last_undegraded":"2024-09-12T02:07:07.160245+0000","last_fullsized":"2024-09-12T02:07:07.160245+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:26.126486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162237+0000","last_change":"2024-09-12T02:07:06.176853+0000","last_active":"2024-09-12T02:07:07.162237+0000","last_peered":"2024-09-12T02:07:07.162237+0000","last_clean":"2024-09-12T02:07:07.162237+0000","last_became_active":"2024-09-12T02:07:06.176544+0000","last_became_peered":"2024-09-12T02:07:06.176544+0000","last_unstale":"2024-09-12T02:07:07.162237+0000","last_undegraded":"2024-09-12T02:07:07.162237+0000","last_fullsized":"2024-09-12T02:07:07.162237+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:31.856009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.351070+0000","last_change":"2024-09-12T02:07:05.170442+0000","last_active":"2024-09-12T02:07:08.351070+0000","last_peered":"2024-09-12T02:07:08.351070+0000","last_clean":"2024-09-12T02:07:08.351070+0000","last_became_active":"2024-09-12T02:07:05.170143+0000","last_became_peered":"2024-09-12T02:07:05.170143+0000","last_unstale":"2024-09-12T02:07:08.351070+0000","last_undegraded":"2024-09-12T02:07:08.351070+0000","last_fullsized":"2024-09-12T02:07:08.351070+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:01.743945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350981+0000","last_change":"2024-09-12T02:07:06.186466+0000","last_active":"2024-09-12T02:07:08.350981+0000","last_peered":"2024-09-12T02:07:08.350981+0000","last_clean":"2024-09-12T02:07:08.350981+0000","last_became_active":"2024-09-12T02:07:06.186144+0000","last_became_peered":"2024-09-12T02:07:06.186144+0000","last_unstale":"2024-09-12T02:07:08.350981+0000","last_undegraded":"2024-09-12T02:07:08.350981+0000","last_fullsized":"2024-09-12T02:07:08.350981+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:54.623729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350430+0000","last_change":"2024-09-12T02:07:05.181325+0000","last_active":"2024-09-12T02:07:08.350430+0000","last_peered":"2024-09-12T02:07:08.350430+0000","last_clean":"2024-09-12T02:07:08.350430+0000","last_became_active":"2024-09-12T02:07:05.181048+0000","last_became_peered":"2024-09-12T02:07:05.181048+0000","last_unstale":"2024-09-12T02:07:08.350430+0000","last_undegraded":"2024-09-12T02:07:08.350430+0000","last_fullsized":"2024-09-12T02:07:08.350430+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:04.428549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164859+0000","last_change":"2024-09-12T02:07:06.180329+0000","last_active":"2024-09-12T02:07:07.164859+0000","last_peered":"2024-09-12T02:07:07.164859+0000","last_clean":"2024-09-12T02:07:07.164859+0000","last_became_active":"2024-09-12T02:07:06.179876+0000","last_became_peered":"2024-09-12T02:07:06.179876+0000","last_unstale":"2024-09-12T02:07:07.164859+0000","last_undegraded":"2024-09-12T02:07:07.164859+0000","last_fullsized":"2024-09-12T02:07:07.164859+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:47.471652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"144'8","reported_seq":22,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160927+0000","last_change":"2024-09-12T02:07:05.173863+0000","last_active":"2024-09-12T02:07:07.160927+0000","last_peered":"2024-09-12T02:07:07.160927+0000","last_clean":"2024-09-12T02:07:07.160927+0000","last_became_active":"2024-09-12T02:07:05.173135+0000","last_became_peered":"2024-09-12T02:07:05.173135+0000","last_unstale":"2024-09-12T02:07:07.160927+0000","last_undegraded":"2024-09-12T02:07:07.160927+0000","last_fullsized":"2024-09-12T02:07:07.160927+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:25.840163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.351191+0000","last_change":"2024-09-12T02:07:06.183288+0000","last_active":"2024-09-12T02:07:08.351191+0000","last_peered":"2024-09-12T02:07:08.351191+0000","last_clean":"2024-09-12T02:07:08.351191+0000","last_became_active":"2024-09-12T02:07:06.182990+0000","last_became_peered":"2024-09-12T02:07:06.182990+0000","last_unstale":"2024-09-12T02:07:08.351191+0000","last_undegraded":"2024-09-12T02:07:08.351191+0000","last_fullsized":"2024-09-12T02:07:08.351191+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:49.281259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"144'1","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162086+0000","last_change":"2024-09-12T02:07:05.169182+0000","last_active":"2024-09-12T02:07:07.162086+0000","last_peered":"2024-09-12T02:07:07.162086+0000","last_clean":"2024-09-12T02:07:07.162086+0000","last_became_active":"2024-09-12T02:07:05.168915+0000","last_became_peered":"2024-09-12T02:07:05.168915+0000","last_unstale":"2024-09-12T02:07:07.162086+0000","last_undegraded":"2024-09-12T02:07:07.162086+0000","last_fullsized":"2024-09-12T02:07:07.162086+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:11.978173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161957+0000","last_change":"2024-09-12T02:07:06.173564+0000","last_active":"2024-09-12T02:07:07.161957+0000","last_peered":"2024-09-12T02:07:07.161957+0000","last_clean":"2024-09-12T02:07:07.161957+0000","last_became_active":"2024-09-12T02:07:06.173302+0000","last_became_peered":"2024-09-12T02:07:06.173302+0000","last_unstale":"2024-09-12T02:07:07.161957+0000","last_undegraded":"2024-09-12T02:07:07.161957+0000","last_fullsized":"2024-09-12T02:07:07.161957+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:06.437712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"144'1","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152303+0000","last_change":"2024-09-12T02:07:05.169086+0000","last_active":"2024-09-12T02:07:08.152303+0000","last_peered":"2024-09-12T02:07:08.152303+0000","last_clean":"2024-09-12T02:07:08.152303+0000","last_became_active":"2024-09-12T02:07:05.168800+0000","last_became_peered":"2024-09-12T02:07:05.168800+0000","last_unstale":"2024-09-12T02:07:08.152303+0000","last_undegraded":"2024-09-12T02:07:08.152303+0000","last_fullsized":"2024-09-12T02:07:08.152303+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:14.959321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160154+0000","last_change":"2024-09-12T02:07:06.175575+0000","last_active":"2024-09-12T02:07:07.160154+0000","last_peered":"2024-09-12T02:07:07.160154+0000","last_clean":"2024-09-12T02:07:07.160154+0000","last_became_active":"2024-09-12T02:07:06.175285+0000","last_became_peered":"2024-09-12T02:07:06.175285+0000","last_unstale":"2024-09-12T02:07:07.160154+0000","last_undegraded":"2024-09-12T02:07:07.160154+0000","last_fullsized":"2024-09-12T02:07:07.160154+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:54.606749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166583+0000","last_change":"2024-09-12T02:07:05.167828+0000","last_active":"2024-09-12T02:07:07.166583+0000","last_peered":"2024-09-12T02:07:07.166583+0000","last_clean":"2024-09-12T02:07:07.166583+0000","last_became_active":"2024-09-12T02:07:05.167536+0000","last_became_peered":"2024-09-12T02:07:05.167536+0000","last_unstale":"2024-09-12T02:07:07.166583+0000","last_undegraded":"2024-09-12T02:07:07.166583+0000","last_fullsized":"2024-09-12T02:07:07.166583+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:08.520003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164691+0000","last_change":"2024-09-12T02:07:06.186836+0000","last_active":"2024-09-12T02:07:07.164691+0000","last_peered":"2024-09-12T02:07:07.164691+0000","last_clean":"2024-09-12T02:07:07.164691+0000","last_became_active":"2024-09-12T02:07:06.186490+0000","last_became_peered":"2024-09-12T02:07:06.186490+0000","last_unstale":"2024-09-12T02:07:07.164691+0000","last_undegraded":"2024-09-12T02:07:07.164691+0000","last_fullsized":"2024-09-12T02:07:07.164691+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:52.748269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.351448+0000","last_change":"2024-09-12T02:07:05.178914+0000","last_active":"2024-09-12T02:07:08.351448+0000","last_peered":"2024-09-12T02:07:08.351448+0000","last_clean":"2024-09-12T02:07:08.351448+0000","last_became_active":"2024-09-12T02:07:05.178630+0000","last_became_peered":"2024-09-12T02:07:05.178630+0000","last_unstale":"2024-09-12T02:07:08.351448+0000","last_undegraded":"2024-09-12T02:07:08.351448+0000","last_fullsized":"2024-09-12T02:07:08.351448+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:53.781606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164915+0000","last_change":"2024-09-12T02:07:06.172346+0000","last_active":"2024-09-12T02:07:07.164915+0000","last_peered":"2024-09-12T02:07:07.164915+0000","last_clean":"2024-09-12T02:07:07.164915+0000","last_became_active":"2024-09-12T02:07:06.171758+0000","last_became_peered":"2024-09-12T02:07:06.171758+0000","last_unstale":"2024-09-12T02:07:07.164915+0000","last_undegraded":"2024-09-12T02:07:07.164915+0000","last_fullsized":"2024-09-12T02:07:07.164915+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:57.712570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350342+0000","last_change":"2024-09-12T02:07:05.181025+0000","last_active":"2024-09-12T02:07:08.350342+0000","last_peered":"2024-09-12T02:07:08.350342+0000","last_clean":"2024-09-12T02:07:08.350342+0000","last_became_active":"2024-09-12T02:07:05.180707+0000","last_became_peered":"2024-09-12T02:07:05.180707+0000","last_unstale":"2024-09-12T02:07:08.350342+0000","last_undegraded":"2024-09-12T02:07:08.350342+0000","last_fullsized":"2024-09-12T02:07:08.350342+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:51.480271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350836+0000","last_change":"2024-09-12T02:07:06.175102+0000","last_active":"2024-09-12T02:07:08.350836+0000","last_peered":"2024-09-12T02:07:08.350836+0000","last_clean":"2024-09-12T02:07:08.350836+0000","last_became_active":"2024-09-12T02:07:06.174811+0000","last_became_peered":"2024-09-12T02:07:06.174811+0000","last_unstale":"2024-09-12T02:07:08.350836+0000","last_undegraded":"2024-09-12T02:07:08.350836+0000","last_fullsized":"2024-09-12T02:07:08.350836+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:55.423810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161349+0000","last_change":"2024-09-12T02:07:05.170014+0000","last_active":"2024-09-12T02:07:07.161349+0000","last_peered":"2024-09-12T02:07:07.161349+0000","last_clean":"2024-09-12T02:07:07.161349+0000","last_became_active":"2024-09-12T02:07:05.169731+0000","last_became_peered":"2024-09-12T02:07:05.169731+0000","last_unstale":"2024-09-12T02:07:07.161349+0000","last_undegraded":"2024-09-12T02:07:07.161349+0000","last_fullsized":"2024-09-12T02:07:07.161349+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:48.278776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350800+0000","last_change":"2024-09-12T02:07:06.186018+0000","last_active":"2024-09-12T02:07:08.350800+0000","last_peered":"2024-09-12T02:07:08.350800+0000","last_clean":"2024-09-12T02:07:08.350800+0000","last_became_active":"2024-09-12T02:07:06.185734+0000","last_became_peered":"2024-09-12T02:07:06.185734+0000","last_unstale":"2024-09-12T02:07:08.350800+0000","last_undegraded":"2024-09-12T02:07:08.350800+0000","last_fullsized":"2024-09-12T02:07:08.350800+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:49.860045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350945+0000","last_change":"2024-09-12T02:07:05.178455+0000","last_active":"2024-09-12T02:07:08.350945+0000","last_peered":"2024-09-12T02:07:08.350945+0000","last_clean":"2024-09-12T02:07:08.350945+0000","last_became_active":"2024-09-12T02:07:05.178133+0000","last_became_peered":"2024-09-12T02:07:05.178133+0000","last_unstale":"2024-09-12T02:07:08.350945+0000","last_undegraded":"2024-09-12T02:07:08.350945+0000","last_fullsized":"2024-09-12T02:07:08.350945+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:55.251394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.164380+0000","last_change":"2024-09-12T02:07:06.184322+0000","last_active":"2024-09-12T02:07:07.164380+0000","last_peered":"2024-09-12T02:07:07.164380+0000","last_clean":"2024-09-12T02:07:07.164380+0000","last_became_active":"2024-09-12T02:07:06.184012+0000","last_became_peered":"2024-09-12T02:07:06.184012+0000","last_unstale":"2024-09-12T02:07:07.164380+0000","last_undegraded":"2024-09-12T02:07:07.164380+0000","last_fullsized":"2024-09-12T02:07:07.164380+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:36.512194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160218+0000","last_change":"2024-09-12T02:07:05.177856+0000","last_active":"2024-09-12T02:07:07.160218+0000","last_peered":"2024-09-12T02:07:07.160218+0000","last_clean":"2024-09-12T02:07:07.160218+0000","last_became_active":"2024-09-12T02:07:05.177540+0000","last_became_peered":"2024-09-12T02:07:05.177540+0000","last_unstale":"2024-09-12T02:07:07.160218+0000","last_undegraded":"2024-09-12T02:07:07.160218+0000","last_fullsized":"2024-09-12T02:07:07.160218+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:10.671601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161000+0000","last_change":"2024-09-12T02:07:06.166133+0000","last_active":"2024-09-12T02:07:07.161000+0000","last_peered":"2024-09-12T02:07:07.161000+0000","last_clean":"2024-09-12T02:07:07.161000+0000","last_became_active":"2024-09-12T02:07:06.165891+0000","last_became_peered":"2024-09-12T02:07:06.165891+0000","last_unstale":"2024-09-12T02:07:07.161000+0000","last_undegraded":"2024-09-12T02:07:07.161000+0000","last_fullsized":"2024-09-12T02:07:07.161000+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:57.379027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"145'1","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.165996+0000","last_change":"2024-09-12T02:07:05.168685+0000","last_active":"2024-09-12T02:07:07.165996+0000","last_peered":"2024-09-12T02:07:07.165996+0000","last_clean":"2024-09-12T02:07:07.165996+0000","last_became_active":"2024-09-12T02:07:05.168379+0000","last_became_peered":"2024-09-12T02:07:05.168379+0000","last_unstale":"2024-09-12T02:07:07.165996+0000","last_undegraded":"2024-09-12T02:07:07.165996+0000","last_fullsized":"2024-09-12T02:07:07.165996+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:55.479228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350980+0000","last_change":"2024-09-12T02:07:06.168431+0000","last_active":"2024-09-12T02:07:08.350980+0000","last_peered":"2024-09-12T02:07:08.350980+0000","last_clean":"2024-09-12T02:07:08.350980+0000","last_became_active":"2024-09-12T02:07:06.168080+0000","last_became_peered":"2024-09-12T02:07:06.168080+0000","last_unstale":"2024-09-12T02:07:08.350980+0000","last_undegraded":"2024-09-12T02:07:08.350980+0000","last_fullsized":"2024-09-12T02:07:08.350980+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:43.241775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.162294+0000","last_change":"2024-09-12T02:07:05.168316+0000","last_active":"2024-09-12T02:07:07.162294+0000","last_peered":"2024-09-12T02:07:07.162294+0000","last_clean":"2024-09-12T02:07:07.162294+0000","last_became_active":"2024-09-12T02:07:05.168016+0000","last_became_peered":"2024-09-12T02:07:05.168016+0000","last_unstale":"2024-09-12T02:07:07.162294+0000","last_undegraded":"2024-09-12T02:07:07.162294+0000","last_fullsized":"2024-09-12T02:07:07.162294+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:52.174429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166763+0000","last_change":"2024-09-12T02:07:06.177410+0000","last_active":"2024-09-12T02:07:07.166763+0000","last_peered":"2024-09-12T02:07:07.166763+0000","last_clean":"2024-09-12T02:07:07.166763+0000","last_became_active":"2024-09-12T02:07:06.177122+0000","last_became_peered":"2024-09-12T02:07:06.177122+0000","last_unstale":"2024-09-12T02:07:07.166763+0000","last_undegraded":"2024-09-12T02:07:07.166763+0000","last_fullsized":"2024-09-12T02:07:07.166763+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:36.663166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.160105+0000","last_change":"2024-09-12T02:07:05.169123+0000","last_active":"2024-09-12T02:07:07.160105+0000","last_peered":"2024-09-12T02:07:07.160105+0000","last_clean":"2024-09-12T02:07:07.160105+0000","last_became_active":"2024-09-12T02:07:05.168828+0000","last_became_peered":"2024-09-12T02:07:05.168828+0000","last_unstale":"2024-09-12T02:07:07.160105+0000","last_undegraded":"2024-09-12T02:07:07.160105+0000","last_fullsized":"2024-09-12T02:07:07.160105+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:10.926179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350780+0000","last_change":"2024-09-12T02:07:06.184423+0000","last_active":"2024-09-12T02:07:08.350780+0000","last_peered":"2024-09-12T02:07:08.350780+0000","last_clean":"2024-09-12T02:07:08.350780+0000","last_became_active":"2024-09-12T02:07:06.184135+0000","last_became_peered":"2024-09-12T02:07:06.184135+0000","last_unstale":"2024-09-12T02:07:08.350780+0000","last_undegraded":"2024-09-12T02:07:08.350780+0000","last_fullsized":"2024-09-12T02:07:08.350780+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:00.785525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161457+0000","last_change":"2024-09-12T02:07:05.167597+0000","last_active":"2024-09-12T02:07:07.161457+0000","last_peered":"2024-09-12T02:07:07.161457+0000","last_clean":"2024-09-12T02:07:07.161457+0000","last_became_active":"2024-09-12T02:07:05.167331+0000","last_became_peered":"2024-09-12T02:07:05.167331+0000","last_unstale":"2024-09-12T02:07:07.161457+0000","last_undegraded":"2024-09-12T02:07:07.161457+0000","last_fullsized":"2024-09-12T02:07:07.161457+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:51.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350963+0000","last_change":"2024-09-12T02:07:06.188417+0000","last_active":"2024-09-12T02:07:08.350963+0000","last_peered":"2024-09-12T02:07:08.350963+0000","last_clean":"2024-09-12T02:07:08.350963+0000","last_became_active":"2024-09-12T02:07:06.188130+0000","last_became_peered":"2024-09-12T02:07:06.188130+0000","last_unstale":"2024-09-12T02:07:08.350963+0000","last_undegraded":"2024-09-12T02:07:08.350963+0000","last_fullsized":"2024-09-12T02:07:08.350963+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:19.342585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.350608+0000","last_change":"2024-09-12T02:07:05.178730+0000","last_active":"2024-09-12T02:07:08.350608+0000","last_peered":"2024-09-12T02:07:08.350608+0000","last_clean":"2024-09-12T02:07:08.350608+0000","last_became_active":"2024-09-12T02:07:05.178430+0000","last_became_peered":"2024-09-12T02:07:05.178430+0000","last_unstale":"2024-09-12T02:07:08.350608+0000","last_undegraded":"2024-09-12T02:07:08.350608+0000","last_fullsized":"2024-09-12T02:07:08.350608+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:45.524547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152464+0000","last_change":"2024-09-12T02:07:06.183861+0000","last_active":"2024-09-12T02:07:08.152464+0000","last_peered":"2024-09-12T02:07:08.152464+0000","last_clean":"2024-09-12T02:07:08.152464+0000","last_became_active":"2024-09-12T02:07:06.183536+0000","last_became_peered":"2024-09-12T02:07:06.183536+0000","last_unstale":"2024-09-12T02:07:08.152464+0000","last_undegraded":"2024-09-12T02:07:08.152464+0000","last_fullsized":"2024-09-12T02:07:08.152464+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:34.648219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.161460+0000","last_change":"2024-09-12T02:07:05.168669+0000","last_active":"2024-09-12T02:07:07.161460+0000","last_peered":"2024-09-12T02:07:07.161460+0000","last_clean":"2024-09-12T02:07:07.161460+0000","last_became_active":"2024-09-12T02:07:05.168394+0000","last_became_peered":"2024-09-12T02:07:05.168394+0000","last_unstale":"2024-09-12T02:07:07.161460+0000","last_undegraded":"2024-09-12T02:07:07.161460+0000","last_fullsized":"2024-09-12T02:07:07.161460+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:00.541517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166993+0000","last_change":"2024-09-12T02:07:06.178232+0000","last_active":"2024-09-12T02:07:07.166993+0000","last_peered":"2024-09-12T02:07:07.166993+0000","last_clean":"2024-09-12T02:07:07.166993+0000","last_became_active":"2024-09-12T02:07:06.177956+0000","last_became_peered":"2024-09-12T02:07:06.177956+0000","last_unstale":"2024-09-12T02:07:07.166993+0000","last_undegraded":"2024-09-12T02:07:07.166993+0000","last_fullsized":"2024-09-12T02:07:07.166993+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:20.796287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.351045+0000","last_change":"2024-09-12T02:07:05.179353+0000","last_active":"2024-09-12T02:07:08.351045+0000","last_peered":"2024-09-12T02:07:08.351045+0000","last_clean":"2024-09-12T02:07:08.351045+0000","last_became_active":"2024-09-12T02:07:05.178558+0000","last_became_peered":"2024-09-12T02:07:05.178558+0000","last_unstale":"2024-09-12T02:07:08.351045+0000","last_undegraded":"2024-09-12T02:07:08.351045+0000","last_fullsized":"2024-09-12T02:07:08.351045+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:39.636624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.166714+0000","last_change":"2024-09-12T02:07:06.174986+0000","last_active":"2024-09-12T02:07:07.166714+0000","last_peered":"2024-09-12T02:07:07.166714+0000","last_clean":"2024-09-12T02:07:07.166714+0000","last_became_active":"2024-09-12T02:07:06.174725+0000","last_became_peered":"2024-09-12T02:07:06.174725+0000","last_unstale":"2024-09-12T02:07:07.166714+0000","last_undegraded":"2024-09-12T02:07:07.166714+0000","last_fullsized":"2024-09-12T02:07:07.166714+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.148118+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.148118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:01.767337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"144'2","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.351208+0000","last_change":"2024-09-12T02:07:05.179366+0000","last_active":"2024-09-12T02:07:08.351208+0000","last_peered":"2024-09-12T02:07:08.351208+0000","last_clean":"2024-09-12T02:07:08.351208+0000","last_became_active":"2024-09-12T02:07:05.179079+0000","last_became_peered":"2024-09-12T02:07:05.179079+0000","last_unstale":"2024-09-12T02:07:08.351208+0000","last_undegraded":"2024-09-12T02:07:08.351208+0000","last_fullsized":"2024-09-12T02:07:08.351208+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.145634+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.145634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:43.865590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":407,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.152096+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T02:07:08.152096+0000","last_peered":"2024-09-12T02:07:08.152096+0000","last_clean":"2024-09-12T02:07:08.152096+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T02:07:08.152096+0000","last_undegraded":"2024-09-12T02:07:08.152096+0000","last_fullsized":"2024-09-12T02:07:08.152096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509582,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37772,"kb_used_data":2424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334068,"statfs":{"total":96636764160,"available":96598085632,"internally_reserved":0,"allocated":2482176,"data_stored":1546497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509581,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41372,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330468,"statfs":{"total":96636764160,"available":96594399232,"internally_reserved":0,"allocated":1900544,"data_stored":958185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509582,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1880064,"data_stored":955969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542286,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33028,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1884160,"data_stored":956551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542286,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37188,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334652,"statfs":{"total":96636764160,"available":96598683648,"internally_reserved":0,"allocated":1884160,"data_stored":956003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542286,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37188,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334652,"statfs":{"total":96636764160,"available":96598683648,"internally_reserved":0,"allocated":1884160,"data_stored":956003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542286,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41948,"kb_used_data":2432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329892,"statfs":{"total":96636764160,"available":96593809408,"internally_reserved":0,"allocated":2490368,"data_stored":1548039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37192,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334648,"statfs":{"total":96636764160,"available":96598679552,"internally_reserved":0,"allocated":1888256,"data_stored":956061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:07:14.501 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:07:14.501 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:07:14.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.646+0000 7f5aa9b13640 1 Processor -- start 2024-09-12T02:07:14.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.647+0000 7f5aa9b13640 1 -- start start 2024-09-12T02:07:14.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.647+0000 7f5aa9b13640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa40b7c30 0x7f5aa40cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:14.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.647+0000 7f5aa9b13640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5aa40b4a50 0x7f5aa40cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:14.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.647+0000 7f5aa9b13640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5aa40cd340 0x7f5aa409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:14.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.647+0000 7f5aa9b13640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f5aa40ce1a0 con 0x7f5aa40b4a50 2024-09-12T02:07:14.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.647+0000 7f5aa9b13640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f5aa40b3010 con 0x7f5aa40cd340 2024-09-12T02:07:14.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.647+0000 7f5aa9b13640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa40b32f0 con 0x7f5aa40b7c30 2024-09-12T02:07:14.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.647+0000 7f5aa2ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5aa40b4a50 0x7f5aa40cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.647+0000 7f5aa2ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5aa40b4a50 0x7f5aa40cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54310/0 (socket says 172.21.15.19:54310) 2024-09-12T02:07:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.648+0000 7f5aa2ffd640 1 -- 172.21.15.19:0/1742262055 learned_addr learned my addr 172.21.15.19:0/1742262055 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.648+0000 7f5aa3fff640 1 --2- 172.21.15.19:0/1742262055 >> v2:172.21.15.135:3300/0 conn(0x7f5aa40cd340 0x7f5aa409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.648+0000 7f5aa37fe640 1 --2- 172.21.15.19:0/1742262055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa40b7c30 0x7f5aa40cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.648+0000 7f5aa2ffd640 1 -- 172.21.15.19:0/1742262055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa40b7c30 msgr2=0x7f5aa40cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.648+0000 7f5aa2ffd640 1 --2- 172.21.15.19:0/1742262055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa40b7c30 0x7f5aa40cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.648+0000 7f5aa2ffd640 1 -- 172.21.15.19:0/1742262055 >> v2:172.21.15.135:3300/0 conn(0x7f5aa40cd340 msgr2=0x7f5aa409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.648+0000 7f5aa2ffd640 1 --2- 172.21.15.19:0/1742262055 >> v2:172.21.15.135:3300/0 conn(0x7f5aa40cd340 0x7f5aa409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.648+0000 7f5aa2ffd640 1 -- 172.21.15.19:0/1742262055 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa40b35d0 con 0x7f5aa40b4a50 2024-09-12T02:07:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.649+0000 7f5aa2ffd640 1 --2- 172.21.15.19:0/1742262055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5aa40b4a50 0x7f5aa40cce00 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4073990 tx=0x7f5a9802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f314b9f3e13af5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.649+0000 7f5aa27fc640 1 -- 172.21.15.19:0/1742262055 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a98037070 con 0x7f5aa40b4a50 2024-09-12T02:07:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.649+0000 7f5aa27fc640 1 -- 172.21.15.19:0/1742262055 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a98032440 con 0x7f5aa40b4a50 2024-09-12T02:07:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.649+0000 7f5aa27fc640 1 -- 172.21.15.19:0/1742262055 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a98032810 con 0x7f5aa40b4a50 2024-09-12T02:07:14.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.649+0000 7f5aa9b13640 1 -- 172.21.15.19:0/1742262055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5aa40b4a50 msgr2=0x7f5aa40cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:14.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.649+0000 7f5aa9b13640 1 --2- 172.21.15.19:0/1742262055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5aa40b4a50 0x7f5aa40cce00 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4073990 tx=0x7f5a9802a140 comp rx=0 tx=0).stop 2024-09-12T02:07:14.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.649+0000 7f5aa9b13640 1 -- 172.21.15.19:0/1742262055 shutdown_connections 2024-09-12T02:07:14.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.649+0000 7f5aa9b13640 1 --2- 172.21.15.19:0/1742262055 >> v2:172.21.15.135:3300/0 conn(0x7f5aa40cd340 0x7f5aa409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.649+0000 7f5aa9b13640 1 --2- 172.21.15.19:0/1742262055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5aa40b4a50 0x7f5aa40cce00 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.649+0000 7f5aa9b13640 1 --2- 172.21.15.19:0/1742262055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa40b7c30 0x7f5aa40cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.649+0000 7f5aa9b13640 1 -- 172.21.15.19:0/1742262055 >> 172.21.15.19:0/1742262055 conn(0x7f5aa40b3de0 msgr2=0x7f5aa40b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:14.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.649+0000 7f5aa9b13640 1 -- 172.21.15.19:0/1742262055 shutdown_connections 2024-09-12T02:07:14.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.649+0000 7f5aa9b13640 1 -- 172.21.15.19:0/1742262055 wait complete. 2024-09-12T02:07:14.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.651+0000 7f5aa9b13640 1 Processor -- start 2024-09-12T02:07:14.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.651+0000 7f5aa9b13640 1 -- start start 2024-09-12T02:07:14.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.651+0000 7f5aa9b13640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5aa40b4a50 0x7f5aa415c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:14.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5aa9b13640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aa40b7c30 0x7f5aa40cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:14.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5aa9b13640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa40cd340 0x7f5aa40cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:14.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5aa9b13640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa40d0580 con 0x7f5aa40b4a50 2024-09-12T02:07:14.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5aa9b13640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa40d0400 con 0x7f5aa40b7c30 2024-09-12T02:07:14.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5aa9b13640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa40b8010 con 0x7f5aa40cd340 2024-09-12T02:07:14.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5aa37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5aa40b4a50 0x7f5aa415c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:14.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5aa37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5aa40b4a50 0x7f5aa415c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54318/0 (socket says 172.21.15.19:54318) 2024-09-12T02:07:14.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5aa37fe640 1 -- 172.21.15.19:0/4091482605 learned_addr learned my addr 172.21.15.19:0/4091482605 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:14.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5aa2ffd640 1 --2- 172.21.15.19:0/4091482605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aa40b7c30 0x7f5aa40cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:14.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5aa3fff640 1 --2- 172.21.15.19:0/4091482605 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa40cd340 0x7f5aa40cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:14.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5aa37fe640 1 -- 172.21.15.19:0/4091482605 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa40cd340 msgr2=0x7f5aa40cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:14.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5aa37fe640 1 --2- 172.21.15.19:0/4091482605 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa40cd340 0x7f5aa40cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5aa37fe640 1 -- 172.21.15.19:0/4091482605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aa40b7c30 msgr2=0x7f5aa40cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:14.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5aa37fe640 1 --2- 172.21.15.19:0/4091482605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aa40b7c30 0x7f5aa40cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5aa37fe640 1 -- 172.21.15.19:0/4091482605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa40af0f0 con 0x7f5aa40b4a50 2024-09-12T02:07:14.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5aa37fe640 1 --2- 172.21.15.19:0/4091482605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5aa40b4a50 0x7f5aa415c350 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f5a94007e40 tx=0x7f5a9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:14.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5a8bfff640 1 -- 172.21.15.19:0/4091482605 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a94014620 con 0x7f5aa40b4a50 2024-09-12T02:07:14.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5a8bfff640 1 -- 172.21.15.19:0/4091482605 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a94019070 con 0x7f5aa40b4a50 2024-09-12T02:07:14.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5aa9b13640 1 -- 172.21.15.19:0/4091482605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aa40af3d0 con 0x7f5aa40b4a50 2024-09-12T02:07:14.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5a8bfff640 1 -- 172.21.15.19:0/4091482605 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a94014a00 con 0x7f5aa40b4a50 2024-09-12T02:07:14.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.652+0000 7f5aa9b13640 1 -- 172.21.15.19:0/4091482605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aa40af990 con 0x7f5aa40b4a50 2024-09-12T02:07:14.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.653+0000 7f5aa9b13640 1 -- 172.21.15.19:0/4091482605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aa4068c60 con 0x7f5aa40b4a50 2024-09-12T02:07:14.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.654+0000 7f5a8bfff640 1 -- 172.21.15.19:0/4091482605 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a94014ba0 con 0x7f5aa40b4a50 2024-09-12T02:07:14.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.654+0000 7f5a8bfff640 1 --2- 172.21.15.19:0/4091482605 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a9006be30 0x7f5a9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:14.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.654+0000 7f5a8bfff640 1 -- 172.21.15.19:0/4091482605 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6101+0+0 (secure 0 0 0) 0x7f5a9408b6b0 con 0x7f5aa40b4a50 2024-09-12T02:07:14.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.655+0000 7f5aa2ffd640 1 --2- 172.21.15.19:0/4091482605 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a9006be30 0x7f5a9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:14.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.655+0000 7f5aa2ffd640 1 --2- 172.21.15.19:0/4091482605 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a9006be30 0x7f5a9006e2f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f5a98034000 tx=0x7f5a9802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:14.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.659+0000 7f5a8bfff640 1 -- 172.21.15.19:0/4091482605 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5aa4068c60 con 0x7f5aa40b4a50 2024-09-12T02:07:14.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.900+0000 7f5aa9b13640 1 -- 172.21.15.19:0/4091482605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f5aa40d0c70 con 0x7f5aa40b4a50 2024-09-12T02:07:14.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.904+0000 7f5a8bfff640 1 -- 172.21.15.19:0/4091482605 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f5aa40d0c70 con 0x7f5aa40b4a50 2024-09-12T02:07:14.905 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-09-12T02:07:14.906 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDwSeJmfHbXIRAALAvdYAlaB6WxWtubFnlxRw== 2024-09-12T02:07:14.906 INFO:teuthology.orchestra.run.smithi019.stdout: caps mds = "allow" 2024-09-12T02:07:14.906 INFO:teuthology.orchestra.run.smithi019.stdout: caps mon = "allow r" 2024-09-12T02:07:14.906 INFO:teuthology.orchestra.run.smithi019.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:07:14.906 INFO:teuthology.orchestra.run.smithi019.stderr:updated caps for client.0 2024-09-12T02:07:14.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.906+0000 7f5aa9b13640 1 -- 172.21.15.19:0/4091482605 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a9006be30 msgr2=0x7f5a9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:14.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.906+0000 7f5aa9b13640 1 --2- 172.21.15.19:0/4091482605 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a9006be30 0x7f5a9006e2f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f5a98034000 tx=0x7f5a9802e000 comp rx=0 tx=0).stop 2024-09-12T02:07:14.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.906+0000 7f5aa9b13640 1 -- 172.21.15.19:0/4091482605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5aa40b4a50 msgr2=0x7f5aa415c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:14.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.906+0000 7f5aa9b13640 1 --2- 172.21.15.19:0/4091482605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5aa40b4a50 0x7f5aa415c350 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f5a94007e40 tx=0x7f5a9400e4b0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.906+0000 7f5aa9b13640 1 -- 172.21.15.19:0/4091482605 shutdown_connections 2024-09-12T02:07:14.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.907+0000 7f5aa9b13640 1 --2- 172.21.15.19:0/4091482605 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5a9006be30 0x7f5a9006e2f0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.907+0000 7f5aa9b13640 1 --2- 172.21.15.19:0/4091482605 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aa40cd340 0x7f5aa40cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.907+0000 7f5aa9b13640 1 --2- 172.21.15.19:0/4091482605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aa40b7c30 0x7f5aa40cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.907+0000 7f5aa9b13640 1 --2- 172.21.15.19:0/4091482605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5aa40b4a50 0x7f5aa415c350 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:14.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.907+0000 7f5aa9b13640 1 -- 172.21.15.19:0/4091482605 >> 172.21.15.19:0/4091482605 conn(0x7f5aa40b3de0 msgr2=0x7f5aa40b5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:14.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.907+0000 7f5aa9b13640 1 -- 172.21.15.19:0/4091482605 shutdown_connections 2024-09-12T02:07:14.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:14.907+0000 7f5aa9b13640 1 -- 172.21.15.19:0/4091482605 wait complete. 2024-09-12T02:07:14.918 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:07:15.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.020+0000 7f3ffad31640 1 Processor -- start 2024-09-12T02:07:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.020+0000 7f3ffad31640 1 -- start start 2024-09-12T02:07:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.021+0000 7f3ffad31640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3ff4161c80 0x7f3ff406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.021+0000 7f3ffad31640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ff4162060 0x7f3ff40b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.021+0000 7f3ffad31640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ff406e870 con 0x7f3ff40b64b0 2024-09-12T02:07:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.021+0000 7f3ffad31640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f3ff406d9f0 con 0x7f3ff4161c80 2024-09-12T02:07:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.021+0000 7f3ffad31640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff406dcd0 con 0x7f3ff4162060 2024-09-12T02:07:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.021+0000 7f3ff8acd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3ff4161c80 0x7f3ff406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.021+0000 7f3ff8acd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3ff4161c80 0x7f3ff406e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54334/0 (socket says 172.21.15.19:54334) 2024-09-12T02:07:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.022+0000 7f3ff8acd640 1 -- 172.21.15.19:0/710591085 learned_addr learned my addr 172.21.15.19:0/710591085 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.022+0000 7f3ff3fff640 1 --2- 172.21.15.19:0/710591085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ff4162060 0x7f3ff40b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.022+0000 7f3ff8acd640 1 -- 172.21.15.19:0/710591085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ff4162060 msgr2=0x7f3ff40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.022+0000 7f3ff8acd640 1 --2- 172.21.15.19:0/710591085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ff4162060 0x7f3ff40b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.022+0000 7f3ff8acd640 1 -- 172.21.15.19:0/710591085 >> v1:172.21.15.135:6789/0 conn(0x7f3ff40b64b0 legacy=0x7f3ff4162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.022+0000 7f3ff8acd640 1 -- 172.21.15.19:0/710591085 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff406dfb0 con 0x7f3ff4161c80 2024-09-12T02:07:15.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.022+0000 7f3ff3fff640 1 --2- 172.21.15.19:0/710591085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ff4162060 0x7f3ff40b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:15.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.022+0000 7f3ff8acd640 1 --2- 172.21.15.19:0/710591085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ff4161c80 0x7f3ff406e330 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009870 tx=0x7f3fe802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd0c79f2882d27e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:15.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.023+0000 7f3ff37fe640 1 -- 172.21.15.19:0/710591085 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8037070 con 0x7f3ff4161c80 2024-09-12T02:07:15.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.023+0000 7f3ff37fe640 1 -- 172.21.15.19:0/710591085 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe8032440 con 0x7f3ff4161c80 2024-09-12T02:07:15.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.023+0000 7f3ff37fe640 1 -- 172.21.15.19:0/710591085 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8032810 con 0x7f3ff4161c80 2024-09-12T02:07:15.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.023+0000 7f3ffad31640 1 -- 172.21.15.19:0/710591085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ff4161c80 msgr2=0x7f3ff406e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.023+0000 7f3ffad31640 1 --2- 172.21.15.19:0/710591085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ff4161c80 0x7f3ff406e330 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009870 tx=0x7f3fe802a270 comp rx=0 tx=0).stop 2024-09-12T02:07:15.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.023+0000 7f3ffad31640 1 -- 172.21.15.19:0/710591085 shutdown_connections 2024-09-12T02:07:15.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.023+0000 7f3ffad31640 1 --2- 172.21.15.19:0/710591085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ff4162060 0x7f3ff40b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.023+0000 7f3ffad31640 1 --2- 172.21.15.19:0/710591085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ff4161c80 0x7f3ff406e330 unknown :-1 s=CLOSED pgs=2270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.023+0000 7f3ffad31640 1 -- 172.21.15.19:0/710591085 >> 172.21.15.19:0/710591085 conn(0x7f3ff40d44f0 msgr2=0x7f3ff40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:15.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.023+0000 7f3ffad31640 1 -- 172.21.15.19:0/710591085 shutdown_connections 2024-09-12T02:07:15.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.023+0000 7f3ffad31640 1 -- 172.21.15.19:0/710591085 wait complete. 2024-09-12T02:07:15.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.024+0000 7f3ffad31640 1 Processor -- start 2024-09-12T02:07:15.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.024+0000 7f3ffad31640 1 -- start start 2024-09-12T02:07:15.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.025+0000 7f3ffad31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ff40b64b0 0x7f3ff4155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.025+0000 7f3ffad31640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ff4161c80 0x7f3ff40b8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.025+0000 7f3ffad31640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff4162060 0x7f3ff415e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.025+0000 7f3ffad31640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff40d2a10 con 0x7f3ff40b64b0 2024-09-12T02:07:15.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.025+0000 7f3ffad31640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff40d2890 con 0x7f3ff4162060 2024-09-12T02:07:15.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.025+0000 7f3ffad31640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff40b6960 con 0x7f3ff4161c80 2024-09-12T02:07:15.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.025+0000 7f3ff8acd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ff40b64b0 0x7f3ff4155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.025+0000 7f3ff8acd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ff40b64b0 0x7f3ff4155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54350/0 (socket says 172.21.15.19:54350) 2024-09-12T02:07:15.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.025+0000 7f3ff8acd640 1 -- 172.21.15.19:0/1948785693 learned_addr learned my addr 172.21.15.19:0/1948785693 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:15.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.026+0000 7f3ff3fff640 1 --2- 172.21.15.19:0/1948785693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ff4161c80 0x7f3ff40b8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.026+0000 7f3ff92ce640 1 --2- 172.21.15.19:0/1948785693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff4162060 0x7f3ff415e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.026+0000 7f3ff8acd640 1 -- 172.21.15.19:0/1948785693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ff4161c80 msgr2=0x7f3ff40b8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.026+0000 7f3ff8acd640 1 --2- 172.21.15.19:0/1948785693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ff4161c80 0x7f3ff40b8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.026+0000 7f3ff8acd640 1 -- 172.21.15.19:0/1948785693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff4162060 msgr2=0x7f3ff415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.026+0000 7f3ff8acd640 1 --2- 172.21.15.19:0/1948785693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff4162060 0x7f3ff415e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.026+0000 7f3ff8acd640 1 -- 172.21.15.19:0/1948785693 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff40c87e0 con 0x7f3ff40b64b0 2024-09-12T02:07:15.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.026+0000 7f3ff3fff640 1 --2- 172.21.15.19:0/1948785693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ff4161c80 0x7f3ff40b8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:15.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.026+0000 7f3ff8acd640 1 --2- 172.21.15.19:0/1948785693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ff40b64b0 0x7f3ff4155ef0 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f3fe802a2b0 tx=0x7f3fe80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:15.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.026+0000 7f3ff17fa640 1 -- 172.21.15.19:0/1948785693 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8041020 con 0x7f3ff40b64b0 2024-09-12T02:07:15.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.026+0000 7f3ff17fa640 1 -- 172.21.15.19:0/1948785693 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe80306c0 con 0x7f3ff40b64b0 2024-09-12T02:07:15.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.026+0000 7f3ffad31640 1 -- 172.21.15.19:0/1948785693 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff40c8a80 con 0x7f3ff40b64b0 2024-09-12T02:07:15.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.026+0000 7f3ff17fa640 1 -- 172.21.15.19:0/1948785693 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8037040 con 0x7f3ff40b64b0 2024-09-12T02:07:15.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.026+0000 7f3ffad31640 1 -- 172.21.15.19:0/1948785693 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff40c9040 con 0x7f3ff40b64b0 2024-09-12T02:07:15.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.027+0000 7f3ffad31640 1 -- 172.21.15.19:0/1948785693 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ff406e330 con 0x7f3ff40b64b0 2024-09-12T02:07:15.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.028+0000 7f3ff17fa640 1 -- 172.21.15.19:0/1948785693 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3fe8044020 con 0x7f3ff40b64b0 2024-09-12T02:07:15.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.028+0000 7f3ff17fa640 1 --2- 172.21.15.19:0/1948785693 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3fd806be30 0x7f3fd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.028+0000 7f3ff17fa640 1 -- 172.21.15.19:0/1948785693 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6101+0+0 (secure 0 0 0) 0x7f3fe80ab7b0 con 0x7f3ff40b64b0 2024-09-12T02:07:15.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.028+0000 7f3ff3fff640 1 --2- 172.21.15.19:0/1948785693 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3fd806be30 0x7f3fd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.029+0000 7f3ff3fff640 1 --2- 172.21.15.19:0/1948785693 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3fd806be30 0x7f3fd806e2f0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f3ff40d2c70 tx=0x7f3fe0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:15.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.032+0000 7f3ff17fa640 1 -- 172.21.15.19:0/1948785693 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3fe804b030 con 0x7f3ff40b64b0 2024-09-12T02:07:15.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.242+0000 7f3ffad31640 1 -- 172.21.15.19:0/1948785693 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ff40ba470 con 0x7f3ff40b64b0 2024-09-12T02:07:15.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.243+0000 7f3ff17fa640 1 -- 172.21.15.19:0/1948785693 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 331 v331) ==== 95+0+5240 (secure 0 0 0) 0x7f3fe807a060 con 0x7f3ff40b64b0 2024-09-12T02:07:15.243 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:15.243 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":331,"btime":"2024-09-12T02:07:08:765046+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2607300298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2607300298},{"type":"v1","addr":"172.21.15.135:6836","nonce":2607300298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":9283,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/818911002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":818911002},{"type":"v1","addr":"172.21.15.135:6837","nonce":818911002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":10650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3527496552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3527496552},{"type":"v1","addr":"172.21.15.19:6834","nonce":3527496552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327}],"filesystems":[{"mdsmap":{"epoch":331,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:07:05.517761+0000","modified":"2024-09-12T02:07:08.119084+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10653":{"gid":10653,"name":"a","rank":0,"incarnation":328,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/3072429339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3072429339},{"type":"v1","addr":"172.21.15.19:6835","nonce":3072429339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10653,"qdb_cluster":[10653]},"id":7}]} 2024-09-12T02:07:15.244 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 331 2024-09-12T02:07:15.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.244+0000 7f3ffad31640 1 -- 172.21.15.19:0/1948785693 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3fd806be30 msgr2=0x7f3fd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.244+0000 7f3ffad31640 1 --2- 172.21.15.19:0/1948785693 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3fd806be30 0x7f3fd806e2f0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f3ff40d2c70 tx=0x7f3fe0008040 comp rx=0 tx=0).stop 2024-09-12T02:07:15.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.245+0000 7f3ffad31640 1 -- 172.21.15.19:0/1948785693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ff40b64b0 msgr2=0x7f3ff4155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.245+0000 7f3ffad31640 1 --2- 172.21.15.19:0/1948785693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ff40b64b0 0x7f3ff4155ef0 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f3fe802a2b0 tx=0x7f3fe80046c0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.245+0000 7f3ffad31640 1 -- 172.21.15.19:0/1948785693 shutdown_connections 2024-09-12T02:07:15.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.245+0000 7f3ffad31640 1 --2- 172.21.15.19:0/1948785693 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3fd806be30 0x7f3fd806e2f0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.245+0000 7f3ffad31640 1 --2- 172.21.15.19:0/1948785693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff4162060 0x7f3ff415e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.245+0000 7f3ffad31640 1 --2- 172.21.15.19:0/1948785693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ff4161c80 0x7f3ff40b8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.245+0000 7f3ffad31640 1 --2- 172.21.15.19:0/1948785693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ff40b64b0 0x7f3ff4155ef0 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.245+0000 7f3ffad31640 1 -- 172.21.15.19:0/1948785693 >> 172.21.15.19:0/1948785693 conn(0x7f3ff40d44f0 msgr2=0x7f3ff406ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:15.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.245+0000 7f3ffad31640 1 -- 172.21.15.19:0/1948785693 shutdown_connections 2024-09-12T02:07:15.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.245+0000 7f3ffad31640 1 -- 172.21.15.19:0/1948785693 wait complete. 2024-09-12T02:07:15.659 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 331, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:07:05.517761+0000', 'modified': '2024-09-12T02:07:08.119084+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10653}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10653': {'gid': 10653, 'name': 'a', 'rank': 0, 'incarnation': 328, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.19:6835/3072429339', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6833', 'nonce': 3072429339}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 3072429339}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10653, 'qdb_cluster': [10653]} 2024-09-12T02:07:15.659 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:07:15.659 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T02:07:15.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.765+0000 7fdcfdf5f640 1 Processor -- start 2024-09-12T02:07:15.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.765+0000 7fdcfdf5f640 1 -- start start 2024-09-12T02:07:15.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.766+0000 7fdcfdf5f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdcf8165260 0x7fdcf8167650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.766+0000 7fdcfdf5f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcf80d01c0 con 0x7fdcf815c490 2024-09-12T02:07:15.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.766+0000 7fdcfdf5f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcf80d04a0 con 0x7fdcf815c870 2024-09-12T02:07:15.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.766+0000 7fdcfdf5f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fdcf80cff70 con 0x7fdcf8165260 2024-09-12T02:07:15.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.766+0000 7fdcf77fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdcf815c490 0x7fdcf809b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34150/0 (socket says 172.21.15.19:34150) 2024-09-12T02:07:15.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.766+0000 7fdcf77fe640 1 -- 172.21.15.19:0/482251579 learned_addr learned my addr 172.21.15.19:0/482251579 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:15.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.766+0000 7fdcf7fff640 1 --2- 172.21.15.19:0/482251579 >> v2:172.21.15.135:3300/0 conn(0x7fdcf8165260 0x7fdcf8167650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.766+0000 7fdcf67fc640 1 -- 172.21.15.19:0/482251579 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1459623383 0 0) 0x7fdcf80d01c0 con 0x7fdcf815c490 2024-09-12T02:07:15.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.766+0000 7fdcf67fc640 1 -- 172.21.15.19:0/482251579 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce0003520 con 0x7fdcf815c490 2024-09-12T02:07:15.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.766+0000 7fdcf67fc640 1 -- 172.21.15.19:0/482251579 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 133577058 0 0) 0x7fdcf80d04a0 con 0x7fdcf815c870 2024-09-12T02:07:15.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.766+0000 7fdcf67fc640 1 -- 172.21.15.19:0/482251579 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcf80d01c0 con 0x7fdcf815c870 2024-09-12T02:07:15.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.766+0000 7fdcf67fc640 1 -- 172.21.15.19:0/482251579 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2900646735 0 0) 0x7fdce0003520 con 0x7fdcf815c490 2024-09-12T02:07:15.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.766+0000 7fdcf7fff640 1 -- 172.21.15.19:0/482251579 >> v1:172.21.15.135:6789/0 conn(0x7fdcf815c870 legacy=0x7fdcf815cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.767+0000 7fdcf7fff640 1 -- 172.21.15.19:0/482251579 >> v1:172.21.15.19:6789/0 conn(0x7fdcf815c490 legacy=0x7fdcf809b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.767+0000 7fdcf7fff640 1 -- 172.21.15.19:0/482251579 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf80d0780 con 0x7fdcf8165260 2024-09-12T02:07:15.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.767+0000 7fdcf7fff640 1 --2- 172.21.15.19:0/482251579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcf8165260 0x7fdcf8167650 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0009d90 tx=0x7fdcf002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9ca723b6cfcd72d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:15.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.768+0000 7fdcf67fc640 1 -- 172.21.15.19:0/482251579 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce8001670 con 0x7fdcf8165260 2024-09-12T02:07:15.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.768+0000 7fdcf67fc640 1 -- 172.21.15.19:0/482251579 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcf0007540 con 0x7fdcf8165260 2024-09-12T02:07:15.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.768+0000 7fdcf67fc640 1 -- 172.21.15.19:0/482251579 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0007910 con 0x7fdcf8165260 2024-09-12T02:07:15.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.768+0000 7fdcfdf5f640 1 -- 172.21.15.19:0/482251579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcf8165260 msgr2=0x7fdcf8167650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.768+0000 7fdcfdf5f640 1 --2- 172.21.15.19:0/482251579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcf8165260 0x7fdcf8167650 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0009d90 tx=0x7fdcf002a710 comp rx=0 tx=0).stop 2024-09-12T02:07:15.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.768+0000 7fdcfdf5f640 1 -- 172.21.15.19:0/482251579 shutdown_connections 2024-09-12T02:07:15.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.768+0000 7fdcfdf5f640 1 --2- 172.21.15.19:0/482251579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcf8165260 0x7fdcf8167650 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.768+0000 7fdcfdf5f640 1 -- 172.21.15.19:0/482251579 >> 172.21.15.19:0/482251579 conn(0x7fdcf80d23a0 msgr2=0x7fdcf80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.768+0000 7fdcfdf5f640 1 -- 172.21.15.19:0/482251579 shutdown_connections 2024-09-12T02:07:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.768+0000 7fdcfdf5f640 1 -- 172.21.15.19:0/482251579 wait complete. 2024-09-12T02:07:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.769+0000 7fdcfdf5f640 1 Processor -- start 2024-09-12T02:07:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.769+0000 7fdcfdf5f640 1 -- start start 2024-09-12T02:07:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.770+0000 7fdcfdf5f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcf815c490 0x7fdcf80c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.770+0000 7fdcfdf5f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdcf815c870 0x7fdcf80b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.770+0000 7fdcfdf5f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcf8165260 0x7fdcf8071b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.770+0000 7fdcfdf5f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf80cdfa0 con 0x7fdcf815c490 2024-09-12T02:07:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.770+0000 7fdcfdf5f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf80d0dd0 con 0x7fdcf8165260 2024-09-12T02:07:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.770+0000 7fdcfdf5f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdcf80d1260 con 0x7fdcf815c870 2024-09-12T02:07:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.770+0000 7fdcf77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcf815c490 0x7fdcf80c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.770+0000 7fdcf77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcf815c490 0x7fdcf80c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54362/0 (socket says 172.21.15.19:54362) 2024-09-12T02:07:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.770+0000 7fdcf77fe640 1 -- 172.21.15.19:0/4142304020 learned_addr learned my addr 172.21.15.19:0/4142304020 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.770+0000 7fdcf6ffd640 1 --2- 172.21.15.19:0/4142304020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdcf815c870 0x7fdcf80b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.770+0000 7fdcf7fff640 1 --2- 172.21.15.19:0/4142304020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcf8165260 0x7fdcf8071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.771+0000 7fdcf77fe640 1 -- 172.21.15.19:0/4142304020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdcf815c870 msgr2=0x7fdcf80b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.771+0000 7fdcf77fe640 1 --2- 172.21.15.19:0/4142304020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdcf815c870 0x7fdcf80b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.771+0000 7fdcf77fe640 1 -- 172.21.15.19:0/4142304020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcf8165260 msgr2=0x7fdcf8071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.771+0000 7fdcf77fe640 1 --2- 172.21.15.19:0/4142304020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcf8165260 0x7fdcf8071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.771+0000 7fdcf77fe640 1 -- 172.21.15.19:0/4142304020 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf80b59b0 con 0x7fdcf815c490 2024-09-12T02:07:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.771+0000 7fdcf7fff640 1 --2- 172.21.15.19:0/4142304020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcf8165260 0x7fdcf8071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.771+0000 7fdcf77fe640 1 --2- 172.21.15.19:0/4142304020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcf815c490 0x7fdcf80c52b0 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7fdce800c5a0 tx=0x7fdce800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.771+0000 7fdcdffff640 1 -- 172.21.15.19:0/4142304020 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce8017070 con 0x7fdcf815c490 2024-09-12T02:07:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.771+0000 7fdcdffff640 1 -- 172.21.15.19:0/4142304020 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce8005ce0 con 0x7fdcf815c490 2024-09-12T02:07:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.771+0000 7fdcfdf5f640 1 -- 172.21.15.19:0/4142304020 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf80b5730 con 0x7fdcf815c490 2024-09-12T02:07:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.771+0000 7fdcdffff640 1 -- 172.21.15.19:0/4142304020 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce80072b0 con 0x7fdcf815c490 2024-09-12T02:07:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.771+0000 7fdcfdf5f640 1 -- 172.21.15.19:0/4142304020 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf806dba0 con 0x7fdcf815c490 2024-09-12T02:07:15.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.773+0000 7fdcdffff640 1 -- 172.21.15.19:0/4142304020 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdce801a070 con 0x7fdcf815c490 2024-09-12T02:07:15.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.773+0000 7fdcdffff640 1 --2- 172.21.15.19:0/4142304020 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdce406be30 0x7fdce406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.774+0000 7fdcdffff640 1 -- 172.21.15.19:0/4142304020 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6101+0+0 (secure 0 0 0) 0x7fdce808a3e0 con 0x7fdcf815c490 2024-09-12T02:07:15.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.774+0000 7fdcf6ffd640 1 --2- 172.21.15.19:0/4142304020 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdce406be30 0x7fdce406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.774+0000 7fdcf6ffd640 1 --2- 172.21.15.19:0/4142304020 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdce406be30 0x7fdce406e2f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80c57f0 tx=0x7fdcec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.774+0000 7fdd00dd4740 1 Processor -- start 2024-09-12T02:07:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.774+0000 7fdd00dd4740 1 -- start start 2024-09-12T02:07:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.775+0000 7fdd00dd4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e752c0 0x560838ebaa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.775+0000 7fdd00dd4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e72a80 0x560838e756a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.775+0000 7fdd00dd4740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e76a50 0x560838e6f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.775+0000 7fdd00dd4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560838dd7520 con 0x560838e72a80 2024-09-12T02:07:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.775+0000 7fdd00dd4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560838d7f3e0 con 0x560838e752c0 2024-09-12T02:07:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.775+0000 7fdd00dd4740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560838dd34e0 con 0x560838e76a50 2024-09-12T02:07:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.775+0000 7fdcf6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e72a80 0x560838e756a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.775+0000 7fdcf6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e72a80 0x560838e756a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54374/0 (socket says 172.21.15.19:54374) 2024-09-12T02:07:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.775+0000 7fdcf6ffd640 1 -- 172.21.15.19:0/1596446599 learned_addr learned my addr 172.21.15.19:0/1596446599 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.775+0000 7fdcf77fe640 1 --2- 172.21.15.19:0/1596446599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e752c0 0x560838ebaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.775+0000 7fdcf7fff640 1 --2- 172.21.15.19:0/1596446599 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e76a50 0x560838e6f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.776+0000 7fdcf6ffd640 1 -- 172.21.15.19:0/1596446599 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e76a50 msgr2=0x560838e6f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.776+0000 7fdcf6ffd640 1 --2- 172.21.15.19:0/1596446599 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e76a50 0x560838e6f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.776+0000 7fdcf6ffd640 1 -- 172.21.15.19:0/1596446599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e752c0 msgr2=0x560838ebaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.776+0000 7fdcf6ffd640 1 --2- 172.21.15.19:0/1596446599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e752c0 0x560838ebaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.776+0000 7fdcf6ffd640 1 -- 172.21.15.19:0/1596446599 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560838d9a2f0 con 0x560838e72a80 2024-09-12T02:07:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.776+0000 7fdcf6ffd640 1 --2- 172.21.15.19:0/1596446599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e72a80 0x560838e756a0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00fba0 tx=0x7fdcec012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5e7cf3f943646b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.776+0000 7fdcdd7fa640 1 -- 172.21.15.19:0/1596446599 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec025070 con 0x560838e72a80 2024-09-12T02:07:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.776+0000 7fdcdd7fa640 1 -- 172.21.15.19:0/1596446599 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcec01b050 con 0x560838e72a80 2024-09-12T02:07:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.776+0000 7fdcdd7fa640 1 -- 172.21.15.19:0/1596446599 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec020410 con 0x560838e72a80 2024-09-12T02:07:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.777+0000 7fdd00dd4740 1 -- 172.21.15.19:0/1596446599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e72a80 msgr2=0x560838e756a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.777+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/1596446599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e72a80 0x560838e756a0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00fba0 tx=0x7fdcec012000 comp rx=0 tx=0).stop 2024-09-12T02:07:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.777+0000 7fdd00dd4740 1 -- 172.21.15.19:0/1596446599 shutdown_connections 2024-09-12T02:07:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.777+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/1596446599 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e76a50 0x560838e6f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.777+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/1596446599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e72a80 0x560838e756a0 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.777+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/1596446599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e752c0 0x560838ebaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.777+0000 7fdd00dd4740 1 -- 172.21.15.19:0/1596446599 >> 172.21.15.19:0/1596446599 conn(0x560838e71a80 msgr2=0x560838eb9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:15.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.777+0000 7fdd00dd4740 1 -- 172.21.15.19:0/1596446599 shutdown_connections 2024-09-12T02:07:15.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.777+0000 7fdd00dd4740 1 -- 172.21.15.19:0/1596446599 wait complete. 2024-09-12T02:07:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.777+0000 7fdd00dd4740 1 -- start start 2024-09-12T02:07:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.778+0000 7fdd00dd4740 1 Processor -- start 2024-09-12T02:07:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.778+0000 7fdd00dd4740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e752c0 0x560838e8b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.778+0000 7fdd00dd4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e76a50 0x560838e96990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.778+0000 7fdd00dd4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e9f3d0 0x560838e9f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.778+0000 7fdd00dd4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560838e70f20 con 0x560838e76a50 2024-09-12T02:07:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.778+0000 7fdd00dd4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560838d60450 con 0x560838e9f3d0 2024-09-12T02:07:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.778+0000 7fdd00dd4740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560838ebb290 con 0x560838e752c0 2024-09-12T02:07:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.778+0000 7fdd00dd4740 10 client.0 _ll_register_callbacks cb 0x560838ae9ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.778+0000 7fdcf6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e76a50 0x560838e96990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.779+0000 7fdcf6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e76a50 0x560838e96990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54380/0 (socket says 172.21.15.19:54380) 2024-09-12T02:07:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.779+0000 7fdcf6ffd640 1 -- 172.21.15.19:0/1058497849 learned_addr learned my addr 172.21.15.19:0/1058497849 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.779+0000 7fdcf77fe640 1 --2- 172.21.15.19:0/1058497849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e752c0 0x560838e8b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.779+0000 7fdcf7fff640 1 --2- 172.21.15.19:0/1058497849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e9f3d0 0x560838e9f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.779+0000 7fdcf6ffd640 1 -- 172.21.15.19:0/1058497849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e752c0 msgr2=0x560838e8b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.779+0000 7fdcf6ffd640 1 --2- 172.21.15.19:0/1058497849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e752c0 0x560838e8b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.779+0000 7fdcf6ffd640 1 -- 172.21.15.19:0/1058497849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e9f3d0 msgr2=0x560838e9f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.779+0000 7fdcf6ffd640 1 --2- 172.21.15.19:0/1058497849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e9f3d0 0x560838e9f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.779+0000 7fdcf6ffd640 1 -- 172.21.15.19:0/1058497849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560838aea2d0 con 0x560838e76a50 2024-09-12T02:07:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.779+0000 7fdcf7fff640 1 --2- 172.21.15.19:0/1058497849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e9f3d0 0x560838e9f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.779+0000 7fdcf6ffd640 1 --2- 172.21.15.19:0/1058497849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e76a50 0x560838e96990 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7fdcec010fd0 tx=0x7fdcec001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b71ad9e5aebaac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.779+0000 7fdcd67fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:07:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.779+0000 7fdcd67fc640 1 -- 172.21.15.19:0/1058497849 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec025040 con 0x560838e76a50 2024-09-12T02:07:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.779+0000 7fdcd67fc640 1 -- 172.21.15.19:0/1058497849 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(145..145 src has 1..145) ==== 6101+0+0 (secure 0 0 0) 0x7fdcec0209c0 con 0x560838e76a50 2024-09-12T02:07:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.779+0000 7fdd00dd4740 1 -- 172.21.15.19:0/1058497849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcec01b050 con 0x560838e76a50 2024-09-12T02:07:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.779+0000 7fdcd67fc640 1 -- 172.21.15.19:0/1058497849 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=331) ==== 24+0+0 (secure 0 0 0) 0x7fdcec039050 con 0x560838e76a50 2024-09-12T02:07:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.779+0000 7fdd00dd4740 10 client.10794 fetch_fsmap learned FSMap version 331 2024-09-12T02:07:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.779+0000 7fdd00dd4740 1 -- 172.21.15.19:0/1058497849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=331,monmap=2+}) -- 0x560838bb46b0 con 0x560838e76a50 2024-09-12T02:07:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.780+0000 7fdcd67fc640 1 -- 172.21.15.19:0/1058497849 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcec01b050 con 0x560838e76a50 2024-09-12T02:07:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.780+0000 7fdcd67fc640 1 -- 172.21.15.19:0/1058497849 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 331) ==== 3502+0+0 (secure 0 0 0) 0x7fdcec03c020 con 0x560838e76a50 2024-09-12T02:07:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.780+0000 7fdd00dd4740 10 client.10794 fetch_fsmap finished waiting for FSMap version 331 2024-09-12T02:07:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.780+0000 7fdd00dd4740 10 client.10794 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:07:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.780+0000 7fdd00dd4740 20 client.10794 populate_metadata read hostname 'smithi019' 2024-09-12T02:07:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.780+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/1058497849 >> [v2:172.21.15.19:6833/3072429339,v1:172.21.15.19:6835/3072429339] conn(0x560838e9d530 0x560838e9d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.780+0000 7fdd00dd4740 4 client.10794 mds_command: new command op to 10653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:07:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.780+0000 7fdd00dd4740 1 -- 172.21.15.19:0/1058497849 --> [v2:172.21.15.19:6833/3072429339,v1:172.21.15.19:6835/3072429339] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560838de4c50 con 0x560838e9d530 2024-09-12T02:07:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.780+0000 7fdcf77fe640 1 --2- 172.21.15.19:0/1058497849 >> [v2:172.21.15.19:6833/3072429339,v1:172.21.15.19:6835/3072429339] conn(0x560838e9d530 0x560838e9d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.780+0000 7fdcd67fc640 10 client.10794 ms_handle_connect on v2:172.21.15.19:6833/3072429339 2024-09-12T02:07:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.780+0000 7fdcf77fe640 1 --2- 172.21.15.19:0/1058497849 >> [v2:172.21.15.19:6833/3072429339,v1:172.21.15.19:6835/3072429339] conn(0x560838e9d530 0x560838e9d910 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd1db049dbcea929 server_cookie=bca62bb7906ca72 in_seq=0 out_seq=0 2024-09-12T02:07:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.781+0000 7fdcd67fc640 1 -- 172.21.15.19:0/1058497849 <== mds.0 v2:172.21.15.19:6833/3072429339 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560838de4c50 con 0x560838e9d530 2024-09-12T02:07:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.781+0000 7fdcd67fc640 10 client.10794 handle_command_reply: tid=0 2024-09-12T02:07:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.781+0000 7fdd00dd4740 1 client.10794 shutdown 2024-09-12T02:07:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.781+0000 7fdd00dd4740 1 -- 172.21.15.19:0/1058497849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e76a50 msgr2=0x560838e96990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.781+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/1058497849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e76a50 0x560838e96990 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7fdcec010fd0 tx=0x7fdcec001150 comp rx=0 tx=0).stop 2024-09-12T02:07:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.781+0000 7fdd00dd4740 1 -- 172.21.15.19:0/1058497849 shutdown_connections 2024-09-12T02:07:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.781+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/1058497849 >> [v2:172.21.15.19:6833/3072429339,v1:172.21.15.19:6835/3072429339] conn(0x560838e9d530 0x560838e9d910 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.781+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/1058497849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e9f3d0 0x560838e9f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.781+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/1058497849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e76a50 0x560838e96990 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.781+0000 7fdcd67fc640 0 client.10794 ms_handle_reset on v2:172.21.15.19:6833/3072429339 2024-09-12T02:07:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.781+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/1058497849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e752c0 0x560838e8b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.781+0000 7fdd00dd4740 1 -- 172.21.15.19:0/1058497849 >> 172.21.15.19:0/1058497849 conn(0x560838e72a80 msgr2=0x560838eb9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.781+0000 7fdd00dd4740 1 -- 172.21.15.19:0/1058497849 shutdown_connections 2024-09-12T02:07:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.781+0000 7fdd00dd4740 1 -- 172.21.15.19:0/1058497849 wait complete. 2024-09-12T02:07:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.781+0000 7fdd00dd4740 20 client.10794 trim_cache size 0 max 16384 2024-09-12T02:07:15.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.799+0000 7fdd00dd4740 1 Processor -- start 2024-09-12T02:07:15.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.800+0000 7fdd00dd4740 1 -- start start 2024-09-12T02:07:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.800+0000 7fdd00dd4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e752c0 0x560838e6b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.800+0000 7fdd00dd4740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e76a50 0x560838eb7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.800+0000 7fdd00dd4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e9f3d0 0x560838eb84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.800+0000 7fdd00dd4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf8200020 con 0x560838e9f3d0 2024-09-12T02:07:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.800+0000 7fdd00dd4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf8155fa0 con 0x560838e752c0 2024-09-12T02:07:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.800+0000 7fdd00dd4740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdcf8153aa0 con 0x560838e76a50 2024-09-12T02:07:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.800+0000 7fdcf7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e9f3d0 0x560838eb84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.801+0000 7fdcf7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e9f3d0 0x560838eb84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54396/0 (socket says 172.21.15.19:54396) 2024-09-12T02:07:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.801+0000 7fdcf7fff640 1 -- 172.21.15.19:0/2057319051 learned_addr learned my addr 172.21.15.19:0/2057319051 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.801+0000 7fdcf6ffd640 1 --2- 172.21.15.19:0/2057319051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e76a50 0x560838eb7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.801+0000 7fdcf77fe640 1 --2- 172.21.15.19:0/2057319051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e752c0 0x560838e6b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.801+0000 7fdcf7fff640 1 -- 172.21.15.19:0/2057319051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e76a50 msgr2=0x560838eb7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.801+0000 7fdcf7fff640 1 --2- 172.21.15.19:0/2057319051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e76a50 0x560838eb7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.801+0000 7fdcf7fff640 1 -- 172.21.15.19:0/2057319051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e752c0 msgr2=0x560838e6b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.801+0000 7fdcf7fff640 1 --2- 172.21.15.19:0/2057319051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e752c0 0x560838e6b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.801+0000 7fdcf7fff640 1 -- 172.21.15.19:0/2057319051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560838e989d0 con 0x560838e9f3d0 2024-09-12T02:07:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.801+0000 7fdcf7fff640 1 --2- 172.21.15.19:0/2057319051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e9f3d0 0x560838eb84f0 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7fdcf002ad00 tx=0x7fdcf002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7841633a399190 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.801+0000 7fdcdcff9640 1 -- 172.21.15.19:0/2057319051 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0007740 con 0x560838e9f3d0 2024-09-12T02:07:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.801+0000 7fdcdcff9640 1 -- 172.21.15.19:0/2057319051 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcf004b070 con 0x560838e9f3d0 2024-09-12T02:07:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.801+0000 7fdcdcff9640 1 -- 172.21.15.19:0/2057319051 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0007ae0 con 0x560838e9f3d0 2024-09-12T02:07:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.802+0000 7fdd00dd4740 1 -- 172.21.15.19:0/2057319051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e9f3d0 msgr2=0x560838eb84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.802+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/2057319051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e9f3d0 0x560838eb84f0 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7fdcf002ad00 tx=0x7fdcf002e000 comp rx=0 tx=0).stop 2024-09-12T02:07:15.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.802+0000 7fdd00dd4740 1 -- 172.21.15.19:0/2057319051 shutdown_connections 2024-09-12T02:07:15.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.802+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/2057319051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e9f3d0 0x560838eb84f0 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.802+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/2057319051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e76a50 0x560838eb7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.802+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/2057319051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e752c0 0x560838e6b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.802+0000 7fdd00dd4740 1 -- 172.21.15.19:0/2057319051 >> 172.21.15.19:0/2057319051 conn(0x560838e72a80 msgr2=0x560838e9c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:15.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.802+0000 7fdd00dd4740 1 -- 172.21.15.19:0/2057319051 shutdown_connections 2024-09-12T02:07:15.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.802+0000 7fdd00dd4740 1 -- 172.21.15.19:0/2057319051 wait complete. 2024-09-12T02:07:15.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.802+0000 7fdd00dd4740 1 -- start start 2024-09-12T02:07:15.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.803+0000 7fdd00dd4740 1 Processor -- start 2024-09-12T02:07:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.803+0000 7fdd00dd4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e752c0 0x560838f32130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.803+0000 7fdd00dd4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e76a50 0x560838eb7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.803+0000 7fdd00dd4740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e9f3d0 0x560838eb84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.803+0000 7fdd00dd4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560838e9d010 con 0x560838e752c0 2024-09-12T02:07:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.803+0000 7fdd00dd4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560838e97850 con 0x560838e76a50 2024-09-12T02:07:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.803+0000 7fdd00dd4740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x560838e96ed0 con 0x560838e9f3d0 2024-09-12T02:07:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.803+0000 7fdd00dd4740 10 client.0 _ll_register_callbacks cb 0x7fdcec023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.803+0000 7fdcf77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e752c0 0x560838f32130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.803+0000 7fdcf77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e752c0 0x560838f32130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54408/0 (socket says 172.21.15.19:54408) 2024-09-12T02:07:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.803+0000 7fdcf77fe640 1 -- 172.21.15.19:0/213884524 learned_addr learned my addr 172.21.15.19:0/213884524 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.804+0000 7fdcf7fff640 1 --2- 172.21.15.19:0/213884524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e9f3d0 0x560838eb84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.804+0000 7fdcf6ffd640 1 --2- 172.21.15.19:0/213884524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e76a50 0x560838eb7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.804+0000 7fdcf77fe640 1 -- 172.21.15.19:0/213884524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e9f3d0 msgr2=0x560838eb84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.804+0000 7fdcf77fe640 1 --2- 172.21.15.19:0/213884524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e9f3d0 0x560838eb84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.804+0000 7fdcf77fe640 1 -- 172.21.15.19:0/213884524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e76a50 msgr2=0x560838eb7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.804+0000 7fdcf77fe640 1 --2- 172.21.15.19:0/213884524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e76a50 0x560838eb7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.804+0000 7fdcf77fe640 1 -- 172.21.15.19:0/213884524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560838ede1b0 con 0x560838e752c0 2024-09-12T02:07:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.804+0000 7fdcf77fe640 1 --2- 172.21.15.19:0/213884524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e752c0 0x560838f32130 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7fdce8088810 tx=0x7fdce8001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869a17b342adc85a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.804+0000 7fdcd67fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:07:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.804+0000 7fdcd67fc640 1 -- 172.21.15.19:0/213884524 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce8083070 con 0x560838e752c0 2024-09-12T02:07:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.804+0000 7fdcd67fc640 1 -- 172.21.15.19:0/213884524 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(145..145 src has 1..145) ==== 6101+0+0 (secure 0 0 0) 0x7fdce8060ce0 con 0x560838e752c0 2024-09-12T02:07:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.804+0000 7fdd00dd4740 1 -- 172.21.15.19:0/213884524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcf004b070 con 0x560838e752c0 2024-09-12T02:07:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.804+0000 7fdcd67fc640 1 -- 172.21.15.19:0/213884524 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=331) ==== 24+0+0 (secure 0 0 0) 0x7fdce8060ee0 con 0x560838e752c0 2024-09-12T02:07:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.804+0000 7fdd00dd4740 10 client.10800 fetch_fsmap learned FSMap version 331 2024-09-12T02:07:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.804+0000 7fdd00dd4740 1 -- 172.21.15.19:0/213884524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=331,monmap=2+}) -- 0x560838eb7a90 con 0x560838e752c0 2024-09-12T02:07:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.804+0000 7fdcd67fc640 1 -- 172.21.15.19:0/213884524 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcf004b070 con 0x560838e752c0 2024-09-12T02:07:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.804+0000 7fdcd67fc640 1 -- 172.21.15.19:0/213884524 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 331) ==== 3502+0+0 (secure 0 0 0) 0x7fdce8086030 con 0x560838e752c0 2024-09-12T02:07:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdd00dd4740 10 client.10800 fetch_fsmap finished waiting for FSMap version 331 2024-09-12T02:07:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdd00dd4740 10 client.10800 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:07:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdd00dd4740 20 client.10800 populate_metadata read hostname 'smithi019' 2024-09-12T02:07:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/213884524 >> [v2:172.21.15.19:6833/3072429339,v1:172.21.15.19:6835/3072429339] conn(0x560838f38a70 0x560838e99f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdd00dd4740 4 client.10800 mds_command: new command op to 10653 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:07:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdd00dd4740 1 -- 172.21.15.19:0/213884524 --> [v2:172.21.15.19:6833/3072429339,v1:172.21.15.19:6835/3072429339] -- command(tid 0: {"prefix": "status"}) -- 0x560838ddefa0 con 0x560838f38a70 2024-09-12T02:07:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdcf6ffd640 1 --2- 172.21.15.19:0/213884524 >> [v2:172.21.15.19:6833/3072429339,v1:172.21.15.19:6835/3072429339] conn(0x560838f38a70 0x560838e99f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdcd67fc640 10 client.10800 ms_handle_connect on v2:172.21.15.19:6833/3072429339 2024-09-12T02:07:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdcf6ffd640 1 --2- 172.21.15.19:0/213884524 >> [v2:172.21.15.19:6833/3072429339,v1:172.21.15.19:6835/3072429339] conn(0x560838f38a70 0x560838e99f00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=303e15c637175204 server_cookie=459ea04acbe1c30b in_seq=0 out_seq=0 2024-09-12T02:07:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdcd67fc640 1 -- 172.21.15.19:0/213884524 <== mds.0 v2:172.21.15.19:6833/3072429339 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x560838ddefa0 con 0x560838f38a70 2024-09-12T02:07:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdcd67fc640 10 client.10800 handle_command_reply: tid=0 2024-09-12T02:07:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdd00dd4740 1 client.10800 shutdown 2024-09-12T02:07:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdd00dd4740 1 -- 172.21.15.19:0/213884524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e752c0 msgr2=0x560838f32130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/213884524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e752c0 0x560838f32130 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7fdce8088810 tx=0x7fdce8001150 comp rx=0 tx=0).stop 2024-09-12T02:07:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdd00dd4740 1 -- 172.21.15.19:0/213884524 shutdown_connections 2024-09-12T02:07:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/213884524 >> [v2:172.21.15.19:6833/3072429339,v1:172.21.15.19:6835/3072429339] conn(0x560838f38a70 0x560838e99f00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/213884524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560838e9f3d0 0x560838eb84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/213884524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560838e76a50 0x560838eb7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdcd67fc640 0 client.10800 ms_handle_reset on v2:172.21.15.19:6833/3072429339 2024-09-12T02:07:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdd00dd4740 1 --2- 172.21.15.19:0/213884524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560838e752c0 0x560838f32130 unknown :-1 s=CLOSED pgs=2277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdd00dd4740 1 -- 172.21.15.19:0/213884524 >> 172.21.15.19:0/213884524 conn(0x560838e72a80 msgr2=0x560838eb96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdd00dd4740 1 -- 172.21.15.19:0/213884524 shutdown_connections 2024-09-12T02:07:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.805+0000 7fdd00dd4740 1 -- 172.21.15.19:0/213884524 wait complete. 2024-09-12T02:07:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.806+0000 7fdd00dd4740 20 client.10800 trim_cache size 0 max 16384 2024-09-12T02:07:15.813 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:07:15.813 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T02:07:15.813 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T02:07:15.813 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 10653, 2024-09-12T02:07:15.813 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T02:07:15.813 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T02:07:15.813 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T02:07:15.813 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 9.6490534480000001, 2024-09-12T02:07:15.813 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 331, 2024-09-12T02:07:15.813 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 145, 2024-09-12T02:07:15.813 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 145, 2024-09-12T02:07:15.813 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 14.987938836 2024-09-12T02:07:15.813 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:07:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.806+0000 7fdcfdf5f640 1 -- 172.21.15.19:0/4142304020 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdce406be30 msgr2=0x7fdce406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.806+0000 7fdcfdf5f640 1 --2- 172.21.15.19:0/4142304020 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdce406be30 0x7fdce406e2f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80c57f0 tx=0x7fdcec009040 comp rx=0 tx=0).stop 2024-09-12T02:07:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.806+0000 7fdcfdf5f640 1 -- 172.21.15.19:0/4142304020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcf815c490 msgr2=0x7fdcf80c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.806+0000 7fdcfdf5f640 1 --2- 172.21.15.19:0/4142304020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcf815c490 0x7fdcf80c52b0 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7fdce800c5a0 tx=0x7fdce800ca60 comp rx=0 tx=0).stop 2024-09-12T02:07:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.806+0000 7fdcfdf5f640 1 -- 172.21.15.19:0/4142304020 shutdown_connections 2024-09-12T02:07:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.806+0000 7fdcfdf5f640 1 --2- 172.21.15.19:0/4142304020 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fdce406be30 0x7fdce406e2f0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.806+0000 7fdcfdf5f640 1 --2- 172.21.15.19:0/4142304020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcf8165260 0x7fdcf8071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.806+0000 7fdcfdf5f640 1 --2- 172.21.15.19:0/4142304020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdcf815c870 0x7fdcf80b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.806+0000 7fdcfdf5f640 1 --2- 172.21.15.19:0/4142304020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcf815c490 0x7fdcf80c52b0 unknown :-1 s=CLOSED pgs=2273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.806+0000 7fdcfdf5f640 1 -- 172.21.15.19:0/4142304020 >> 172.21.15.19:0/4142304020 conn(0x7fdcf80d23a0 msgr2=0x7fdcf8156bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.806+0000 7fdcfdf5f640 1 -- 172.21.15.19:0/4142304020 shutdown_connections 2024-09-12T02:07:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.806+0000 7fdcfdf5f640 1 -- 172.21.15.19:0/4142304020 wait complete. 2024-09-12T02:07:15.817 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:07:15.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.919+0000 7f1b0cffd640 1 Processor -- start 2024-09-12T02:07:15.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.919+0000 7f1b0cffd640 1 -- start start 2024-09-12T02:07:15.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.920+0000 7f1b0cffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b080d30f0 0x7f1b080b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.920+0000 7f1b0cffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b080b64c0 0x7f1b0806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.920+0000 7f1b0cffd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b080d3690 con 0x7f1b0815e5f0 2024-09-12T02:07:15.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.920+0000 7f1b0cffd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f1b0806d530 con 0x7f1b080d30f0 2024-09-12T02:07:15.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.920+0000 7f1b0cffd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1b080d3970 con 0x7f1b080b64c0 2024-09-12T02:07:15.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.920+0000 7f1b05d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b080d30f0 0x7f1b080b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.920+0000 7f1b0659c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1b0815e5f0 0x7f1b080d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34152/0 (socket says 172.21.15.19:34152) 2024-09-12T02:07:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.920+0000 7f1b0659c640 1 -- 172.21.15.19:0/3121190010 learned_addr learned my addr 172.21.15.19:0/3121190010 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.921+0000 7f1b06d9d640 1 --2- 172.21.15.19:0/3121190010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b080b64c0 0x7f1b0806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.921+0000 7f1b05d9b640 1 -- 172.21.15.19:0/3121190010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b080b64c0 msgr2=0x7f1b0806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.921+0000 7f1b05d9b640 1 --2- 172.21.15.19:0/3121190010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b080b64c0 0x7f1b0806d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.921+0000 7f1b05d9b640 1 -- 172.21.15.19:0/3121190010 >> v1:172.21.15.19:6789/0 conn(0x7f1b0815e5f0 legacy=0x7f1b080d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.921+0000 7f1b05d9b640 1 -- 172.21.15.19:0/3121190010 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0806cee0 con 0x7f1b080d30f0 2024-09-12T02:07:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.921+0000 7f1b06d9d640 1 --2- 172.21.15.19:0/3121190010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b080b64c0 0x7f1b0806d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:15.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.921+0000 7f1b05d9b640 1 --2- 172.21.15.19:0/3121190010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b080d30f0 0x7f1b080b5f80 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7f1afc0097a0 tx=0x7f1afc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9332ce0b8de08c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:15.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.921+0000 7f1b0559a640 1 -- 172.21.15.19:0/3121190010 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc037070 con 0x7f1b080d30f0 2024-09-12T02:07:15.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.921+0000 7f1b0559a640 1 -- 172.21.15.19:0/3121190010 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1afc032440 con 0x7f1b080d30f0 2024-09-12T02:07:15.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.921+0000 7f1b0559a640 1 -- 172.21.15.19:0/3121190010 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc032810 con 0x7f1b080d30f0 2024-09-12T02:07:15.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.922+0000 7f1b0cffd640 1 -- 172.21.15.19:0/3121190010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b080d30f0 msgr2=0x7f1b080b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.922+0000 7f1b0cffd640 1 --2- 172.21.15.19:0/3121190010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b080d30f0 0x7f1b080b5f80 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7f1afc0097a0 tx=0x7f1afc02a180 comp rx=0 tx=0).stop 2024-09-12T02:07:15.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.922+0000 7f1b0cffd640 1 -- 172.21.15.19:0/3121190010 shutdown_connections 2024-09-12T02:07:15.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.922+0000 7f1b0cffd640 1 --2- 172.21.15.19:0/3121190010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b080b64c0 0x7f1b0806d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.922+0000 7f1b0cffd640 1 --2- 172.21.15.19:0/3121190010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b080d30f0 0x7f1b080b5f80 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.922+0000 7f1b0cffd640 1 -- 172.21.15.19:0/3121190010 >> 172.21.15.19:0/3121190010 conn(0x7f1b0808bfc0 msgr2=0x7f1b080d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:15.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.922+0000 7f1b0cffd640 1 -- 172.21.15.19:0/3121190010 shutdown_connections 2024-09-12T02:07:15.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.922+0000 7f1b0cffd640 1 -- 172.21.15.19:0/3121190010 wait complete. 2024-09-12T02:07:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.923+0000 7f1b0cffd640 1 Processor -- start 2024-09-12T02:07:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.924+0000 7f1b0cffd640 1 -- start start 2024-09-12T02:07:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.924+0000 7f1b0cffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b080b64c0 0x7f1b081601a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.924+0000 7f1b0cffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b080d30f0 0x7f1b080a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.924+0000 7f1b0cffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b0815e5f0 0x7f1b080a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.924+0000 7f1b0cffd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0806df00 con 0x7f1b080b64c0 2024-09-12T02:07:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.924+0000 7f1b0cffd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0815e9d0 con 0x7f1b080d30f0 2024-09-12T02:07:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.924+0000 7f1b0cffd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0806e080 con 0x7f1b0815e5f0 2024-09-12T02:07:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.924+0000 7f1b0659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b080b64c0 0x7f1b081601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.924+0000 7f1b0659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b080b64c0 0x7f1b081601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54424/0 (socket says 172.21.15.19:54424) 2024-09-12T02:07:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.924+0000 7f1b0659c640 1 -- 172.21.15.19:0/248136791 learned_addr learned my addr 172.21.15.19:0/248136791 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.925+0000 7f1b06d9d640 1 --2- 172.21.15.19:0/248136791 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b0815e5f0 0x7f1b080a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.925+0000 7f1b05d9b640 1 --2- 172.21.15.19:0/248136791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b080d30f0 0x7f1b080a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.925+0000 7f1b0659c640 1 -- 172.21.15.19:0/248136791 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b0815e5f0 msgr2=0x7f1b080a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.925+0000 7f1b0659c640 1 --2- 172.21.15.19:0/248136791 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b0815e5f0 0x7f1b080a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.925+0000 7f1b0659c640 1 -- 172.21.15.19:0/248136791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b080d30f0 msgr2=0x7f1b080a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.925+0000 7f1b0659c640 1 --2- 172.21.15.19:0/248136791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b080d30f0 0x7f1b080a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.925+0000 7f1b0659c640 1 -- 172.21.15.19:0/248136791 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b08160bf0 con 0x7f1b080b64c0 2024-09-12T02:07:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.925+0000 7f1b0659c640 1 --2- 172.21.15.19:0/248136791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b080b64c0 0x7f1b081601a0 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f1af800c3c0 tx=0x7f1af800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.925+0000 7f1af6ffd640 1 -- 172.21.15.19:0/248136791 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af8017070 con 0x7f1b080b64c0 2024-09-12T02:07:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.925+0000 7f1af6ffd640 1 -- 172.21.15.19:0/248136791 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af8005ce0 con 0x7f1b080b64c0 2024-09-12T02:07:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.925+0000 7f1af6ffd640 1 -- 172.21.15.19:0/248136791 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af80072f0 con 0x7f1b080b64c0 2024-09-12T02:07:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.925+0000 7f1b0cffd640 1 -- 172.21.15.19:0/248136791 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b08160ed0 con 0x7f1b080b64c0 2024-09-12T02:07:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.925+0000 7f1b0cffd640 1 -- 172.21.15.19:0/248136791 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b08161770 con 0x7f1b080b64c0 2024-09-12T02:07:15.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.926+0000 7f1b0cffd640 1 -- 172.21.15.19:0/248136791 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b080d2bb0 con 0x7f1b080b64c0 2024-09-12T02:07:15.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.927+0000 7f1af6ffd640 1 -- 172.21.15.19:0/248136791 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1af801a070 con 0x7f1b080b64c0 2024-09-12T02:07:15.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.927+0000 7f1af6ffd640 1 --2- 172.21.15.19:0/248136791 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1ae806be30 0x7f1ae806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:15.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.927+0000 7f1af6ffd640 1 -- 172.21.15.19:0/248136791 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6101+0+0 (secure 0 0 0) 0x7f1af808a2a0 con 0x7f1b080b64c0 2024-09-12T02:07:15.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.927+0000 7f1b05d9b640 1 --2- 172.21.15.19:0/248136791 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1ae806be30 0x7f1ae806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:15.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.928+0000 7f1b05d9b640 1 --2- 172.21.15.19:0/248136791 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1ae806be30 0x7f1ae806e2f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f1afc034000 tx=0x7f1afc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:15.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:15.931+0000 7f1af6ffd640 1 -- 172.21.15.19:0/248136791 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b080d2bb0 con 0x7f1b080b64c0 2024-09-12T02:07:16.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:16.144+0000 7f1b0cffd640 1 -- 172.21.15.19:0/248136791 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1b081610a0 con 0x7f1b080b64c0 2024-09-12T02:07:16.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:16.145+0000 7f1af6ffd640 1 -- 172.21.15.19:0/248136791 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v331) ==== 53+0+73 (secure 0 0 0) 0x7f1af808a0c0 con 0x7f1b080b64c0 2024-09-12T02:07:16.145 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:07:16.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:16.147+0000 7f1b0cffd640 1 -- 172.21.15.19:0/248136791 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1ae806be30 msgr2=0x7f1ae806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:16.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:16.147+0000 7f1b0cffd640 1 --2- 172.21.15.19:0/248136791 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1ae806be30 0x7f1ae806e2f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f1afc034000 tx=0x7f1afc02e000 comp rx=0 tx=0).stop 2024-09-12T02:07:16.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:16.147+0000 7f1b0cffd640 1 -- 172.21.15.19:0/248136791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b080b64c0 msgr2=0x7f1b081601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:16.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:16.147+0000 7f1b0cffd640 1 --2- 172.21.15.19:0/248136791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b080b64c0 0x7f1b081601a0 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f1af800c3c0 tx=0x7f1af800c880 comp rx=0 tx=0).stop 2024-09-12T02:07:16.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:16.147+0000 7f1b0cffd640 1 -- 172.21.15.19:0/248136791 shutdown_connections 2024-09-12T02:07:16.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:16.147+0000 7f1b0cffd640 1 --2- 172.21.15.19:0/248136791 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1ae806be30 0x7f1ae806e2f0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:16.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:16.147+0000 7f1b0cffd640 1 --2- 172.21.15.19:0/248136791 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b0815e5f0 0x7f1b080a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:16.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:16.147+0000 7f1b0cffd640 1 --2- 172.21.15.19:0/248136791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b080d30f0 0x7f1b080a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:16.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:16.147+0000 7f1b0cffd640 1 --2- 172.21.15.19:0/248136791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b080b64c0 0x7f1b081601a0 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:16.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:16.147+0000 7f1b0cffd640 1 -- 172.21.15.19:0/248136791 >> 172.21.15.19:0/248136791 conn(0x7f1b0808bfc0 msgr2=0x7f1b080d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:16.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:16.147+0000 7f1b0cffd640 1 -- 172.21.15.19:0/248136791 shutdown_connections 2024-09-12T02:07:16.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:16.147+0000 7f1b0cffd640 1 -- 172.21.15.19:0/248136791 wait complete. 2024-09-12T02:07:16.161 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:07:16.161 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:07:16.161 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T02:07:16.161 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:07:16.161 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:07:16.161 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:07:16.161 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:07:16.161 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:07:16.161 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:07:16.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:16.162 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T02:07:16.178 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:07:16.178 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:07:16.178 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:07:16.178 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:07:16.178 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T02:07:16.178 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:07:16.179 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:07:16.179 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:07:16.179 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T02:07:16.179 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:07:16.179 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:07:16.179 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T02:07:16.179 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:07:16.179 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:07:16.179 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T02:07:16.179 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:07:16.179 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42124sec preferred_lft 42124sec 2024-09-12T02:07:16.179 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T02:07:16.180 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:07:16.180 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:07:16.180 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:07:16.180 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T02:07:16.180 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:07:16.180 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T02:07:16.180 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:07:16.180 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:07:16.180 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T02:07:16.180 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:07:16.180 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:07:16.180 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:07:16.180 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T02:07:16.181 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:07:16.181 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:07:16.181 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:07:16.181 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T02:07:16.181 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:07:16.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:16.181 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:07:16.242 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T02:07:16.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:16.244 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T02:07:16.301 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T02:07:16.301 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:07:16.301 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:07:16.301 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:07:16.301 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:07:16.301 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:07:16.301 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T02:07:16.302 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:07:16.302 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:07:16.302 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:07:16.302 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T02:07:16.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:07:16.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:07:16.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:16.431 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T02:07:16.446 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:07:16.447 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:07:16.447 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:07:16.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:16.448 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T02:07:16.513 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:07:16.513 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:07:16.569 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:07:16.570 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:07:16.570 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:07:16.626 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:07:16.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:16.626 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:07:16.712 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:07:16.712 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:07:16.713 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:07:16.721 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:07:16.721 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:07:16.721 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:07:16.722 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:07:16.722 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:07:16.731 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:07:16.731 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:07:16.732 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:07:16.732 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:07:16.732 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:07:16.732 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T02:07:16.732 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T02:07:16.732 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T02:07:16.732 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:07:16.732 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:07:16.733 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:07:16.733 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:07:16.733 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:07:16.734 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:07:16.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:16.734 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:07:16.761 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:07:16.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:07:16.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:07:16.866 INFO:teuthology.orchestra.run.smithi019.stdout:client10812 2024-09-12T02:07:16.866 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:07:16.866 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:07:16.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:16.883 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir1) 2024-09-12T02:07:16.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:16.945 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir1/file1) 2024-09-12T02:07:17.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:17.002 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir2) 2024-09-12T02:07:17.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:17.060 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir2/file2) 2024-09-12T02:07:17.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:17.120 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-12T02:07:17.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:17.178 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir1/file1 testdir/hardlink1) 2024-09-12T02:07:17.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:17.238 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir2/file2 testdir/hardlink2) 2024-09-12T02:07:17.295 DEBUG:teuthology.orchestra.run.smithi019:> stdin-killer -- python3 -c ' 2024-09-12T02:07:17.296 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-09-12T02:07:17.296 DEBUG:teuthology.orchestra.run.smithi019:> import stat 2024-09-12T02:07:17.296 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T02:07:17.296 DEBUG:teuthology.orchestra.run.smithi019:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir1/file1").st_ino) 2024-09-12T02:07:17.296 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-09-12T02:07:17.401 INFO:teuthology.orchestra.run.smithi019.stdout:1099511627777 2024-09-12T02:07:17.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:07:17.411 DEBUG:teuthology.orchestra.run.smithi019:> stdin-killer -- python3 -c ' 2024-09-12T02:07:17.411 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-09-12T02:07:17.411 DEBUG:teuthology.orchestra.run.smithi019:> import stat 2024-09-12T02:07:17.411 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T02:07:17.411 DEBUG:teuthology.orchestra.run.smithi019:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir2/file2").st_ino) 2024-09-12T02:07:17.411 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-09-12T02:07:17.518 INFO:teuthology.orchestra.run.smithi019.stdout:1099511628279 2024-09-12T02:07:17.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:07:17.527 DEBUG:teuthology.orchestra.run.smithi019:> stdin-killer -- python3 -c ' 2024-09-12T02:07:17.527 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-09-12T02:07:17.527 DEBUG:teuthology.orchestra.run.smithi019:> import stat 2024-09-12T02:07:17.528 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T02:07:17.528 DEBUG:teuthology.orchestra.run.smithi019:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir2").st_ino) 2024-09-12T02:07:17.528 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-09-12T02:07:17.634 INFO:teuthology.orchestra.run.smithi019.stdout:1099511628278 2024-09-12T02:07:17.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:07:17.643 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:07:17.643 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:07:17.699 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:07:17.700 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:07:17.756 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:07:17.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.899+0000 7f01897d6640 1 Processor -- start 2024-09-12T02:07:17.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.899+0000 7f01897d6640 1 -- start start 2024-09-12T02:07:17.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.900+0000 7f01897d6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0184162060 0x7f01840b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:17.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.900+0000 7f01897d6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f01840b64b0 0x7f01840b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:17.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.900+0000 7f01897d6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f018406d9f0 con 0x7f0184161c80 2024-09-12T02:07:17.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.900+0000 7f01897d6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f018406dcd0 con 0x7f01840b64b0 2024-09-12T02:07:17.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.900+0000 7f01897d6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f018406dfb0 con 0x7f0184162060 2024-09-12T02:07:17.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.900+0000 7f0182ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0184161c80 0x7f018406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34162/0 (socket says 172.21.15.19:34162) 2024-09-12T02:07:17.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.900+0000 7f0182ffd640 1 -- 172.21.15.19:0/3991082937 learned_addr learned my addr 172.21.15.19:0/3991082937 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:17.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f01837fe640 1 --2- 172.21.15.19:0/3991082937 >> v2:172.21.15.135:3300/0 conn(0x7f01840b64b0 0x7f01840b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:17.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f01827fc640 1 --2- 172.21.15.19:0/3991082937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0184162060 0x7f01840b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:17.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f0181ffb640 1 -- 172.21.15.19:0/3991082937 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 627818177 0 0) 0x7f018406d9f0 con 0x7f0184161c80 2024-09-12T02:07:17.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f0181ffb640 1 -- 172.21.15.19:0/3991082937 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0170003520 con 0x7f0184161c80 2024-09-12T02:07:17.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f0181ffb640 1 -- 172.21.15.19:0/3991082937 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 706471741 0 0) 0x7f0170003520 con 0x7f0184161c80 2024-09-12T02:07:17.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f0181ffb640 1 -- 172.21.15.19:0/3991082937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0184162060 msgr2=0x7f01840b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:17.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f0181ffb640 1 --2- 172.21.15.19:0/3991082937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0184162060 0x7f01840b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:17.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f0181ffb640 1 -- 172.21.15.19:0/3991082937 >> v2:172.21.15.135:3300/0 conn(0x7f01840b64b0 msgr2=0x7f01840b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:17.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f0181ffb640 1 --2- 172.21.15.19:0/3991082937 >> v2:172.21.15.135:3300/0 conn(0x7f01840b64b0 0x7f01840b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:17.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f0181ffb640 1 -- 172.21.15.19:0/3991082937 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01840d01f0 con 0x7f0184161c80 2024-09-12T02:07:17.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f0181ffb640 1 -- 172.21.15.19:0/3991082937 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f01740019f0 con 0x7f0184161c80 2024-09-12T02:07:17.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f0181ffb640 1 -- 172.21.15.19:0/3991082937 >> v1:172.21.15.19:6789/0 conn(0x7f0184161c80 legacy=0x7f018406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:17.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f0181ffb640 1 --2- 172.21.15.19:0/3991082937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01700039b0 0x7f0170003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:17.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f0181ffb640 1 --2- 172.21.15.19:0/3991082937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01700043a0 0x7f0170004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:17.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f0181ffb640 1 --2- 172.21.15.19:0/3991082937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0170004ef0 0x7f017000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:17.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f0181ffb640 1 -- 172.21.15.19:0/3991082937 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f018406dcd0 con 0x7f01700043a0 2024-09-12T02:07:17.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f0181ffb640 1 -- 172.21.15.19:0/3991082937 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f018406dfb0 con 0x7f0170004ef0 2024-09-12T02:07:17.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f0181ffb640 1 -- 172.21.15.19:0/3991082937 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f017000bf00 con 0x7f01700039b0 2024-09-12T02:07:17.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f01827fc640 1 --2- 172.21.15.19:0/3991082937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0184162060 0x7f01840b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:17.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f01837fe640 1 --2- 172.21.15.19:0/3991082937 >> v2:172.21.15.135:3300/0 conn(0x7f01840b64b0 0x7f01840b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:17.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f01827fc640 1 --2- 172.21.15.19:0/3991082937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01700043a0 0x7f0170004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:17.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f0182ffd640 1 --2- 172.21.15.19:0/3991082937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01700039b0 0x7f0170003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:17.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f01837fe640 1 --2- 172.21.15.19:0/3991082937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0170004ef0 0x7f017000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:17.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f01827fc640 1 -- 172.21.15.19:0/3991082937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01700039b0 msgr2=0x7f0170003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:17.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f01827fc640 1 --2- 172.21.15.19:0/3991082937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01700039b0 0x7f0170003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:17.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f01827fc640 1 -- 172.21.15.19:0/3991082937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0170004ef0 msgr2=0x7f017000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:17.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.901+0000 7f01827fc640 1 --2- 172.21.15.19:0/3991082937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0170004ef0 0x7f017000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:17.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.902+0000 7f01827fc640 1 -- 172.21.15.19:0/3991082937 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0170003520 con 0x7f01700043a0 2024-09-12T02:07:17.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.902+0000 7f01827fc640 1 --2- 172.21.15.19:0/3991082937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01700043a0 0x7f0170004880 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f018408e1d0 tx=0x7f0170005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608b6d054118bdb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:17.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.902+0000 7f0181ffb640 1 -- 172.21.15.19:0/3991082937 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c036070 con 0x7f01700043a0 2024-09-12T02:07:17.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.902+0000 7f0181ffb640 1 -- 172.21.15.19:0/3991082937 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f016c004030 con 0x7f01700043a0 2024-09-12T02:07:17.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.902+0000 7f0181ffb640 1 -- 172.21.15.19:0/3991082937 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c0097f0 con 0x7f01700043a0 2024-09-12T02:07:17.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.903+0000 7f01897d6640 1 -- 172.21.15.19:0/3991082937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01700043a0 msgr2=0x7f0170004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:17.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.903+0000 7f01897d6640 1 --2- 172.21.15.19:0/3991082937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01700043a0 0x7f0170004880 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f018408e1d0 tx=0x7f0170005830 comp rx=0 tx=0).stop 2024-09-12T02:07:17.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.903+0000 7f01837fe640 1 -- 172.21.15.19:0/3991082937 reap_dead start 2024-09-12T02:07:17.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.903+0000 7f01897d6640 1 -- 172.21.15.19:0/3991082937 shutdown_connections 2024-09-12T02:07:17.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.903+0000 7f01897d6640 1 -- 172.21.15.19:0/3991082937 >> 172.21.15.19:0/3991082937 conn(0x7f01840d44f0 msgr2=0x7f01840d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:17.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.903+0000 7f01897d6640 1 -- 172.21.15.19:0/3991082937 shutdown_connections 2024-09-12T02:07:17.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.903+0000 7f01897d6640 1 -- 172.21.15.19:0/3991082937 wait complete. 2024-09-12T02:07:17.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.904+0000 7f01897d6640 1 Processor -- start 2024-09-12T02:07:17.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.904+0000 7f01897d6640 1 -- start start 2024-09-12T02:07:17.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.905+0000 7f01897d6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01700043a0 0x7f0184159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:17.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.905+0000 7f01897d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01840b2600 0x7f01840b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:17.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.905+0000 7f01897d6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01840cc650 0x7f01840ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:17.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.905+0000 7f01897d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f01840b5f70 con 0x7f01840b2600 2024-09-12T02:07:17.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.905+0000 7f01897d6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f01840d2aa0 con 0x7f01840cc650 2024-09-12T02:07:17.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.905+0000 7f01897d6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f01840b60f0 con 0x7f01700043a0 2024-09-12T02:07:17.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.905+0000 7f01827fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01840b2600 0x7f01840b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:17.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.905+0000 7f01827fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01840b2600 0x7f01840b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54444/0 (socket says 172.21.15.19:54444) 2024-09-12T02:07:17.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.905+0000 7f01827fc640 1 -- 172.21.15.19:0/921913322 learned_addr learned my addr 172.21.15.19:0/921913322 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:17.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.905+0000 7f0182ffd640 1 --2- 172.21.15.19:0/921913322 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01700043a0 0x7f0184159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:17.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.905+0000 7f01837fe640 1 --2- 172.21.15.19:0/921913322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01840cc650 0x7f01840ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:17.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.905+0000 7f01827fc640 1 -- 172.21.15.19:0/921913322 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01700043a0 msgr2=0x7f0184159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:17.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.905+0000 7f01827fc640 1 --2- 172.21.15.19:0/921913322 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01700043a0 0x7f0184159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:17.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.905+0000 7f01827fc640 1 -- 172.21.15.19:0/921913322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01840cc650 msgr2=0x7f01840ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:17.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.905+0000 7f01827fc640 1 --2- 172.21.15.19:0/921913322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01840cc650 0x7f01840ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:17.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.905+0000 7f01827fc640 1 -- 172.21.15.19:0/921913322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01840cd010 con 0x7f01840b2600 2024-09-12T02:07:17.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.905+0000 7f01837fe640 1 --2- 172.21.15.19:0/921913322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01840cc650 0x7f01840ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:17.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.905+0000 7f0182ffd640 1 --2- 172.21.15.19:0/921913322 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01700043a0 0x7f0184159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:17.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.906+0000 7f01827fc640 1 --2- 172.21.15.19:0/921913322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01840b2600 0x7f01840b2a80 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f01840cb570 tx=0x7f016c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:17.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.906+0000 7f017b7fe640 1 -- 172.21.15.19:0/921913322 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c040020 con 0x7f01840b2600 2024-09-12T02:07:17.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.906+0000 7f017b7fe640 1 -- 172.21.15.19:0/921913322 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f016c003c70 con 0x7f01840b2600 2024-09-12T02:07:17.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.906+0000 7f01897d6640 1 -- 172.21.15.19:0/921913322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01840b95f0 con 0x7f01840b2600 2024-09-12T02:07:17.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.906+0000 7f017b7fe640 1 -- 172.21.15.19:0/921913322 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c036040 con 0x7f01840b2600 2024-09-12T02:07:17.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.906+0000 7f01897d6640 1 -- 172.21.15.19:0/921913322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01840b9bb0 con 0x7f01840b2600 2024-09-12T02:07:17.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.907+0000 7f01897d6640 1 -- 172.21.15.19:0/921913322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01840b6960 con 0x7f01840b2600 2024-09-12T02:07:17.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.907+0000 7f017b7fe640 1 -- 172.21.15.19:0/921913322 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f016c043020 con 0x7f01840b2600 2024-09-12T02:07:17.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.908+0000 7f017b7fe640 1 --2- 172.21.15.19:0/921913322 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f016406be30 0x7f016406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:17.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.908+0000 7f017b7fe640 1 -- 172.21.15.19:0/921913322 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6101+0+0 (secure 0 0 0) 0x7f016c0ab3f0 con 0x7f01840b2600 2024-09-12T02:07:17.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.908+0000 7f0182ffd640 1 --2- 172.21.15.19:0/921913322 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f016406be30 0x7f016406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:17.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.909+0000 7f0182ffd640 1 --2- 172.21.15.19:0/921913322 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f016406be30 0x7f016406e2f0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f01740018d0 tx=0x7f0174006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:17.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:17.912+0000 7f017b7fe640 1 -- 172.21.15.19:0/921913322 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f016c04a030 con 0x7f01840b2600 2024-09-12T02:07:18.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.100+0000 7f01897d6640 1 -- 172.21.15.19:0/921913322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f01841f45e0 con 0x7f01840b2600 2024-09-12T02:07:18.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.100+0000 7f017b7fe640 1 -- 172.21.15.19:0/921913322 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v145) ==== 80+0+0 (secure 0 0 0) 0x7f016c003e20 con 0x7f01840b2600 2024-09-12T02:07:18.101 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-09-12T02:07:18.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.102+0000 7f01897d6640 1 -- 172.21.15.19:0/921913322 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f016406be30 msgr2=0x7f016406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:18.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.102+0000 7f01897d6640 1 --2- 172.21.15.19:0/921913322 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f016406be30 0x7f016406e2f0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f01740018d0 tx=0x7f0174006040 comp rx=0 tx=0).stop 2024-09-12T02:07:18.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.102+0000 7f01897d6640 1 -- 172.21.15.19:0/921913322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01840b2600 msgr2=0x7f01840b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:18.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.102+0000 7f01897d6640 1 --2- 172.21.15.19:0/921913322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01840b2600 0x7f01840b2a80 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f01840cb570 tx=0x7f016c004730 comp rx=0 tx=0).stop 2024-09-12T02:07:18.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.102+0000 7f01897d6640 1 -- 172.21.15.19:0/921913322 shutdown_connections 2024-09-12T02:07:18.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.102+0000 7f01897d6640 1 --2- 172.21.15.19:0/921913322 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f016406be30 0x7f016406e2f0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:18.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.102+0000 7f01897d6640 1 --2- 172.21.15.19:0/921913322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01840cc650 0x7f01840ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:18.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.102+0000 7f01897d6640 1 --2- 172.21.15.19:0/921913322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01840b2600 0x7f01840b2a80 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:18.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.102+0000 7f01897d6640 1 --2- 172.21.15.19:0/921913322 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01700043a0 0x7f0184159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:18.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.102+0000 7f01897d6640 1 -- 172.21.15.19:0/921913322 >> 172.21.15.19:0/921913322 conn(0x7f01840d44f0 msgr2=0x7f01840b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:18.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.102+0000 7f01897d6640 1 -- 172.21.15.19:0/921913322 shutdown_connections 2024-09-12T02:07:18.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.102+0000 7f01897d6640 1 -- 172.21.15.19:0/921913322 wait complete. 2024-09-12T02:07:18.114 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:07:18.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:18.114 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:07:18.163 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:07:18.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:18.163 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:07:18.194 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:07:18.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.337+0000 7f93fba1e640 1 Processor -- start 2024-09-12T02:07:18.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.337+0000 7f93fba1e640 1 -- start start 2024-09-12T02:07:18.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.338+0000 7f93fba1e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93f40d30f0 0x7f93f40b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:18.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.338+0000 7f93fba1e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93f40d3690 con 0x7f93f415e5f0 2024-09-12T02:07:18.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.338+0000 7f93fba1e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93f40d3970 con 0x7f93f40b64c0 2024-09-12T02:07:18.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.338+0000 7f93fba1e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f93f406d530 con 0x7f93f40d30f0 2024-09-12T02:07:18.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.338+0000 7f93f97ba640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f93f415e5f0 0x7f93f40d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34176/0 (socket says 172.21.15.19:34176) 2024-09-12T02:07:18.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.338+0000 7f93f97ba640 1 -- 172.21.15.19:0/1417155823 learned_addr learned my addr 172.21.15.19:0/1417155823 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:18.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.338+0000 7f93f8fb9640 1 --2- 172.21.15.19:0/1417155823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93f40d30f0 0x7f93f40b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:18.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.338+0000 7f93ebfff640 1 -- 172.21.15.19:0/1417155823 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 587776784 0 0) 0x7f93f40d3690 con 0x7f93f415e5f0 2024-09-12T02:07:18.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.338+0000 7f93ebfff640 1 -- 172.21.15.19:0/1417155823 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93e0003520 con 0x7f93f415e5f0 2024-09-12T02:07:18.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.338+0000 7f93ebfff640 1 -- 172.21.15.19:0/1417155823 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3826241080 0 0) 0x7f93e0003520 con 0x7f93f415e5f0 2024-09-12T02:07:18.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.338+0000 7f93ebfff640 1 -- 172.21.15.19:0/1417155823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93f40d30f0 msgr2=0x7f93f40b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93ebfff640 1 --2- 172.21.15.19:0/1417155823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93f40d30f0 0x7f93f40b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93ebfff640 1 -- 172.21.15.19:0/1417155823 >> v1:172.21.15.135:6789/0 conn(0x7f93f40b64c0 legacy=0x7f93f406d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93ebfff640 1 -- 172.21.15.19:0/1417155823 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f406cee0 con 0x7f93f415e5f0 2024-09-12T02:07:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93ebfff640 1 -- 172.21.15.19:0/1417155823 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f93f0001670 con 0x7f93f415e5f0 2024-09-12T02:07:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93ebfff640 1 -- 172.21.15.19:0/1417155823 >> v1:172.21.15.19:6789/0 conn(0x7f93f415e5f0 legacy=0x7f93f40d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93ebfff640 1 --2- 172.21.15.19:0/1417155823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93f40d30f0 0x7f93e00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93ebfff640 1 --2- 172.21.15.19:0/1417155823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93e0003f20 0x7f93e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93ebfff640 1 --2- 172.21.15.19:0/1417155823 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93e0004d40 0x7f93e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93ebfff640 1 -- 172.21.15.19:0/1417155823 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f93f406d530 con 0x7f93e0004d40 2024-09-12T02:07:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93ebfff640 1 -- 172.21.15.19:0/1417155823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93e000ba20 con 0x7f93e0003f20 2024-09-12T02:07:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93ebfff640 1 -- 172.21.15.19:0/1417155823 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f93e000bc20 con 0x7f93f40d30f0 2024-09-12T02:07:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93f97ba640 1 --2- 172.21.15.19:0/1417155823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93f40d30f0 0x7f93e00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93f8fb9640 1 --2- 172.21.15.19:0/1417155823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93e0003f20 0x7f93e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93f9fbb640 1 --2- 172.21.15.19:0/1417155823 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93e0004d40 0x7f93e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:18.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93f8fb9640 1 -- 172.21.15.19:0/1417155823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93f40d30f0 msgr2=0x7f93e00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:18.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93f8fb9640 1 --2- 172.21.15.19:0/1417155823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93f40d30f0 0x7f93e00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:18.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93f8fb9640 1 -- 172.21.15.19:0/1417155823 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93e0004d40 msgr2=0x7f93e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:18.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93f8fb9640 1 --2- 172.21.15.19:0/1417155823 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93e0004d40 0x7f93e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:18.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93f8fb9640 1 -- 172.21.15.19:0/1417155823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e0003520 con 0x7f93e0003f20 2024-09-12T02:07:18.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93f97ba640 1 --2- 172.21.15.19:0/1417155823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93f40d30f0 0x7f93e00039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:18.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.339+0000 7f93f9fbb640 1 --2- 172.21.15.19:0/1417155823 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93e0004d40 0x7f93e00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:18.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.340+0000 7f93f8fb9640 1 --2- 172.21.15.19:0/1417155823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93e0003f20 0x7f93e0004800 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f93e4009a90 tx=0x7f93e0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba1ee02799a40fab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:18.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.340+0000 7f93ebfff640 1 -- 172.21.15.19:0/1417155823 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4036070 con 0x7f93e0003f20 2024-09-12T02:07:18.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.340+0000 7f93ebfff640 1 -- 172.21.15.19:0/1417155823 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e4031400 con 0x7f93e0003f20 2024-09-12T02:07:18.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.340+0000 7f93ebfff640 1 -- 172.21.15.19:0/1417155823 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4009690 con 0x7f93e0003f20 2024-09-12T02:07:18.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.341+0000 7f93fba1e640 1 -- 172.21.15.19:0/1417155823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93e0003f20 msgr2=0x7f93e0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:18.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.341+0000 7f93fba1e640 1 --2- 172.21.15.19:0/1417155823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93e0003f20 0x7f93e0004800 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f93e4009a90 tx=0x7f93e0005830 comp rx=0 tx=0).stop 2024-09-12T02:07:18.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.341+0000 7f93f9fbb640 1 -- 172.21.15.19:0/1417155823 reap_dead start 2024-09-12T02:07:18.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.341+0000 7f93fba1e640 1 -- 172.21.15.19:0/1417155823 shutdown_connections 2024-09-12T02:07:18.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.341+0000 7f93fba1e640 1 -- 172.21.15.19:0/1417155823 >> 172.21.15.19:0/1417155823 conn(0x7f93f408bfc0 msgr2=0x7f93f40d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:18.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.341+0000 7f93fba1e640 1 -- 172.21.15.19:0/1417155823 shutdown_connections 2024-09-12T02:07:18.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.341+0000 7f93fba1e640 1 -- 172.21.15.19:0/1417155823 wait complete. 2024-09-12T02:07:18.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.342+0000 7f93fba1e640 1 Processor -- start 2024-09-12T02:07:18.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.342+0000 7f93fba1e640 1 -- start start 2024-09-12T02:07:18.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.343+0000 7f93fba1e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93e0003f20 0x7f93f41596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:18.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.343+0000 7f93fba1e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93f4158de0 0x7f93f40b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:18.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.343+0000 7f93fba1e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93f40b1ee0 0x7f93f40c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:18.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.343+0000 7f93fba1e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f93f40b5f80 con 0x7f93f40b1ee0 2024-09-12T02:07:18.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.343+0000 7f93fba1e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93f415e9d0 con 0x7f93e0003f20 2024-09-12T02:07:18.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.343+0000 7f93fba1e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f93f40b6100 con 0x7f93f4158de0 2024-09-12T02:07:18.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.343+0000 7f93f9fbb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93f40b1ee0 0x7f93f40c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:18.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.343+0000 7f93f9fbb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93f40b1ee0 0x7f93f40c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54460/0 (socket says 172.21.15.19:54460) 2024-09-12T02:07:18.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.343+0000 7f93f9fbb640 1 -- 172.21.15.19:0/4234121606 learned_addr learned my addr 172.21.15.19:0/4234121606 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:18.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.343+0000 7f93f97ba640 1 --2- 172.21.15.19:0/4234121606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93e0003f20 0x7f93f41596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:18.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.343+0000 7f93f8fb9640 1 --2- 172.21.15.19:0/4234121606 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93f4158de0 0x7f93f40b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:18.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.343+0000 7f93f9fbb640 1 -- 172.21.15.19:0/4234121606 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93f4158de0 msgr2=0x7f93f40b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:18.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.343+0000 7f93f9fbb640 1 --2- 172.21.15.19:0/4234121606 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93f4158de0 0x7f93f40b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:18.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.343+0000 7f93f9fbb640 1 -- 172.21.15.19:0/4234121606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93e0003f20 msgr2=0x7f93f41596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:18.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.343+0000 7f93f9fbb640 1 --2- 172.21.15.19:0/4234121606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93e0003f20 0x7f93f41596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:18.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.343+0000 7f93f9fbb640 1 -- 172.21.15.19:0/4234121606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f40b73f0 con 0x7f93f40b1ee0 2024-09-12T02:07:18.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.343+0000 7f93f9fbb640 1 --2- 172.21.15.19:0/4234121606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93f40b1ee0 0x7f93f40c9b10 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7f93f408cf50 tx=0x7f93ec00d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:18.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.343+0000 7f93e9ffb640 1 -- 172.21.15.19:0/4234121606 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec001be0 con 0x7f93f40b1ee0 2024-09-12T02:07:18.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.344+0000 7f93e9ffb640 1 -- 172.21.15.19:0/4234121606 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93ec018070 con 0x7f93f40b1ee0 2024-09-12T02:07:18.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.344+0000 7f93fba1e640 1 -- 172.21.15.19:0/4234121606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93f40b76d0 con 0x7f93f40b1ee0 2024-09-12T02:07:18.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.344+0000 7f93e9ffb640 1 -- 172.21.15.19:0/4234121606 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0007cc0 con 0x7f93f40b1ee0 2024-09-12T02:07:18.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.344+0000 7f93fba1e640 1 -- 172.21.15.19:0/4234121606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93f40b7c90 con 0x7f93f40b1ee0 2024-09-12T02:07:18.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.345+0000 7f93fba1e640 1 -- 172.21.15.19:0/4234121606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93f40d3530 con 0x7f93f40b1ee0 2024-09-12T02:07:18.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.345+0000 7f93e9ffb640 1 -- 172.21.15.19:0/4234121606 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f93ec00dd40 con 0x7f93f40b1ee0 2024-09-12T02:07:18.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.346+0000 7f93e9ffb640 1 --2- 172.21.15.19:0/4234121606 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93d806be60 0x7f93d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:18.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.346+0000 7f93e9ffb640 1 -- 172.21.15.19:0/4234121606 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6101+0+0 (secure 0 0 0) 0x7f93ec08add0 con 0x7f93f40b1ee0 2024-09-12T02:07:18.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.346+0000 7f93f97ba640 1 --2- 172.21.15.19:0/4234121606 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93d806be60 0x7f93d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:18.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.346+0000 7f93f97ba640 1 --2- 172.21.15.19:0/4234121606 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93d806be60 0x7f93d806e320 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f93f0001550 tx=0x7f93f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:18.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.350+0000 7f93e9ffb640 1 -- 172.21.15.19:0/4234121606 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f93ec01a310 con 0x7f93f40b1ee0 2024-09-12T02:07:18.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.562+0000 7f93fba1e640 1 -- 172.21.15.19:0/4234121606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93f40d1bf0 con 0x7f93f40b1ee0 2024-09-12T02:07:18.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.562+0000 7f93e9ffb640 1 -- 172.21.15.19:0/4234121606 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 331 v331) ==== 95+0+5240 (secure 0 0 0) 0x7f93ec08c090 con 0x7f93f40b1ee0 2024-09-12T02:07:18.563 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:18.563 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":331,"btime":"2024-09-12T02:07:08:765046+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2607300298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2607300298},{"type":"v1","addr":"172.21.15.135:6836","nonce":2607300298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":9283,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/818911002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":818911002},{"type":"v1","addr":"172.21.15.135:6837","nonce":818911002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":10650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3527496552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3527496552},{"type":"v1","addr":"172.21.15.19:6834","nonce":3527496552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327}],"filesystems":[{"mdsmap":{"epoch":331,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:07:05.517761+0000","modified":"2024-09-12T02:07:08.119084+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10653":{"gid":10653,"name":"a","rank":0,"incarnation":328,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/3072429339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3072429339},{"type":"v1","addr":"172.21.15.19:6835","nonce":3072429339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10653,"qdb_cluster":[10653]},"id":7}]} 2024-09-12T02:07:18.563 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 331 2024-09-12T02:07:18.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.564+0000 7f93fba1e640 1 -- 172.21.15.19:0/4234121606 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93d806be60 msgr2=0x7f93d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:18.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.564+0000 7f93fba1e640 1 --2- 172.21.15.19:0/4234121606 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93d806be60 0x7f93d806e320 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f93f0001550 tx=0x7f93f0009040 comp rx=0 tx=0).stop 2024-09-12T02:07:18.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.564+0000 7f93fba1e640 1 -- 172.21.15.19:0/4234121606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93f40b1ee0 msgr2=0x7f93f40c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:18.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.564+0000 7f93fba1e640 1 --2- 172.21.15.19:0/4234121606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93f40b1ee0 0x7f93f40c9b10 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7f93f408cf50 tx=0x7f93ec00d520 comp rx=0 tx=0).stop 2024-09-12T02:07:18.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.564+0000 7f93fba1e640 1 -- 172.21.15.19:0/4234121606 shutdown_connections 2024-09-12T02:07:18.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.564+0000 7f93fba1e640 1 --2- 172.21.15.19:0/4234121606 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f93d806be60 0x7f93d806e320 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:18.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.564+0000 7f93fba1e640 1 --2- 172.21.15.19:0/4234121606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93f40b1ee0 0x7f93f40c9b10 unknown :-1 s=CLOSED pgs=2286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:18.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.564+0000 7f93fba1e640 1 --2- 172.21.15.19:0/4234121606 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93f4158de0 0x7f93f40b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:18.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.564+0000 7f93fba1e640 1 --2- 172.21.15.19:0/4234121606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93e0003f20 0x7f93f41596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:18.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.564+0000 7f93fba1e640 1 -- 172.21.15.19:0/4234121606 >> 172.21.15.19:0/4234121606 conn(0x7f93f408bfc0 msgr2=0x7f93f40b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:18.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.564+0000 7f93fba1e640 1 -- 172.21.15.19:0/4234121606 shutdown_connections 2024-09-12T02:07:18.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.564+0000 7f93fba1e640 1 -- 172.21.15.19:0/4234121606 wait complete. 2024-09-12T02:07:18.576 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-12T02:07:18.704 INFO:teuthology.orchestra.run.smithi019.stdout:{"message":"","return_code":0} 2024-09-12T02:07:18.705 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-12T02:07:18.705 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:07:18.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.818+0000 7fd9613fd640 1 Processor -- start 2024-09-12T02:07:18.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.818+0000 7fd9613fd640 1 -- start start 2024-09-12T02:07:18.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.819+0000 7fd9613fd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd95c15e5d0 0x7fd95c0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:18.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.819+0000 7fd9613fd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd95c06cec0 con 0x7fd95c09b140 2024-09-12T02:07:18.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.819+0000 7fd9613fd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd95c06d1a0 con 0x7fd95c06df60 2024-09-12T02:07:18.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.819+0000 7fd9613fd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd95c06dad0 con 0x7fd95c15e5d0 2024-09-12T02:07:18.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.819+0000 7fd95b7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd95c09b140 0x7fd95c168560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34188/0 (socket says 172.21.15.19:34188) 2024-09-12T02:07:18.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.819+0000 7fd95b7fe640 1 -- 172.21.15.19:0/89006781 learned_addr learned my addr 172.21.15.19:0/89006781 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:18.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.819+0000 7fd95affd640 1 --2- 172.21.15.19:0/89006781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd95c15e5d0 0x7fd95c0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:18.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd959ffb640 1 -- 172.21.15.19:0/89006781 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1342780680 0 0) 0x7fd95c06cec0 con 0x7fd95c09b140 2024-09-12T02:07:18.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd959ffb640 1 -- 172.21.15.19:0/89006781 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd944003520 con 0x7fd95c09b140 2024-09-12T02:07:18.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd959ffb640 1 -- 172.21.15.19:0/89006781 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2035568182 0 0) 0x7fd944003520 con 0x7fd95c09b140 2024-09-12T02:07:18.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd959ffb640 1 -- 172.21.15.19:0/89006781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd95c15e5d0 msgr2=0x7fd95c0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:18.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd959ffb640 1 --2- 172.21.15.19:0/89006781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd95c15e5d0 0x7fd95c0d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:18.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd959ffb640 1 -- 172.21.15.19:0/89006781 >> v1:172.21.15.135:6789/0 conn(0x7fd95c06df60 legacy=0x7fd95c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:18.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd959ffb640 1 -- 172.21.15.19:0/89006781 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95c06d480 con 0x7fd95c09b140 2024-09-12T02:07:18.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd959ffb640 1 -- 172.21.15.19:0/89006781 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fd9540019f0 con 0x7fd95c09b140 2024-09-12T02:07:18.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd959ffb640 1 -- 172.21.15.19:0/89006781 >> v1:172.21.15.19:6789/0 conn(0x7fd95c09b140 legacy=0x7fd95c168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:18.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd959ffb640 1 --2- 172.21.15.19:0/89006781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd95c15e5d0 0x7fd9440039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:18.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd959ffb640 1 --2- 172.21.15.19:0/89006781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd944003f60 0x7fd944004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:18.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd959ffb640 1 --2- 172.21.15.19:0/89006781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd944004d40 0x7fd9440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:18.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd959ffb640 1 -- 172.21.15.19:0/89006781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c06dad0 con 0x7fd944003f60 2024-09-12T02:07:18.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd959ffb640 1 -- 172.21.15.19:0/89006781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd94400bb30 con 0x7fd944004d40 2024-09-12T02:07:18.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd959ffb640 1 -- 172.21.15.19:0/89006781 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd94400bd30 con 0x7fd95c15e5d0 2024-09-12T02:07:18.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd95a7fc640 1 --2- 172.21.15.19:0/89006781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd944003f60 0x7fd944004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:18.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd95affd640 1 --2- 172.21.15.19:0/89006781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd95c15e5d0 0x7fd9440039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:18.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd95b7fe640 1 --2- 172.21.15.19:0/89006781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd944004d40 0x7fd9440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:18.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd95a7fc640 1 -- 172.21.15.19:0/89006781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd95c15e5d0 msgr2=0x7fd9440039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:18.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd95a7fc640 1 --2- 172.21.15.19:0/89006781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd95c15e5d0 0x7fd9440039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:18.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd95a7fc640 1 -- 172.21.15.19:0/89006781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd944004d40 msgr2=0x7fd9440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:18.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd95a7fc640 1 --2- 172.21.15.19:0/89006781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd944004d40 0x7fd9440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:18.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.820+0000 7fd95a7fc640 1 -- 172.21.15.19:0/89006781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd944003520 con 0x7fd944003f60 2024-09-12T02:07:18.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.821+0000 7fd95a7fc640 1 --2- 172.21.15.19:0/89006781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd944003f60 0x7fd944004800 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7fd950001720 tx=0x7fd944005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d7cdddd2ba7648 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:18.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.821+0000 7fd959ffb640 1 -- 172.21.15.19:0/89006781 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950001370 con 0x7fd944003f60 2024-09-12T02:07:18.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.821+0000 7fd959ffb640 1 -- 172.21.15.19:0/89006781 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9500052d0 con 0x7fd944003f60 2024-09-12T02:07:18.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.821+0000 7fd959ffb640 1 -- 172.21.15.19:0/89006781 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95002abc0 con 0x7fd944003f60 2024-09-12T02:07:18.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.822+0000 7fd9613fd640 1 -- 172.21.15.19:0/89006781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd944003f60 msgr2=0x7fd944004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:18.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.822+0000 7fd9613fd640 1 --2- 172.21.15.19:0/89006781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd944003f60 0x7fd944004800 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7fd950001720 tx=0x7fd944005830 comp rx=0 tx=0).stop 2024-09-12T02:07:18.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.822+0000 7fd95b7fe640 1 -- 172.21.15.19:0/89006781 reap_dead start 2024-09-12T02:07:18.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.822+0000 7fd9613fd640 1 -- 172.21.15.19:0/89006781 shutdown_connections 2024-09-12T02:07:18.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.822+0000 7fd9613fd640 1 -- 172.21.15.19:0/89006781 >> 172.21.15.19:0/89006781 conn(0x7fd95c0d23a0 msgr2=0x7fd95c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:18.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.822+0000 7fd9613fd640 1 -- 172.21.15.19:0/89006781 shutdown_connections 2024-09-12T02:07:18.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.822+0000 7fd9613fd640 1 -- 172.21.15.19:0/89006781 wait complete. 2024-09-12T02:07:18.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.823+0000 7fd9613fd640 1 Processor -- start 2024-09-12T02:07:18.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.823+0000 7fd9613fd640 1 -- start start 2024-09-12T02:07:18.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.824+0000 7fd9613fd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd944003f60 0x7fd95c1527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:18.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.824+0000 7fd9613fd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd95c1521c0 0x7fd95c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:18.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.824+0000 7fd9613fd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd95c071330 0x7fd95c0717b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:18.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.824+0000 7fd9613fd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c15eb30 con 0x7fd95c1521c0 2024-09-12T02:07:18.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.824+0000 7fd9613fd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c15e9b0 con 0x7fd944003f60 2024-09-12T02:07:18.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.824+0000 7fd9613fd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd95c0d10f0 con 0x7fd95c071330 2024-09-12T02:07:18.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.824+0000 7fd95a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd95c1521c0 0x7fd95c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:18.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.824+0000 7fd95a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd95c1521c0 0x7fd95c0b7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54478/0 (socket says 172.21.15.19:54478) 2024-09-12T02:07:18.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.824+0000 7fd95a7fc640 1 -- 172.21.15.19:0/4131408757 learned_addr learned my addr 172.21.15.19:0/4131408757 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:18.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.824+0000 7fd95b7fe640 1 --2- 172.21.15.19:0/4131408757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd95c071330 0x7fd95c0717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:18.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.824+0000 7fd95affd640 1 --2- 172.21.15.19:0/4131408757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd944003f60 0x7fd95c1527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:18.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.824+0000 7fd95a7fc640 1 -- 172.21.15.19:0/4131408757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd95c071330 msgr2=0x7fd95c0717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:18.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.824+0000 7fd95a7fc640 1 --2- 172.21.15.19:0/4131408757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd95c071330 0x7fd95c0717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:18.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.824+0000 7fd95a7fc640 1 -- 172.21.15.19:0/4131408757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd944003f60 msgr2=0x7fd95c1527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:18.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.824+0000 7fd95a7fc640 1 --2- 172.21.15.19:0/4131408757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd944003f60 0x7fd95c1527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:18.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.824+0000 7fd95a7fc640 1 -- 172.21.15.19:0/4131408757 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95c1f8bb0 con 0x7fd95c1521c0 2024-09-12T02:07:18.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.824+0000 7fd95a7fc640 1 --2- 172.21.15.19:0/4131408757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd95c1521c0 0x7fd95c0b7040 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7fd950008fd0 tx=0x7fd950001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:18.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.825+0000 7fd9437fe640 1 -- 172.21.15.19:0/4131408757 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950037040 con 0x7fd95c1521c0 2024-09-12T02:07:18.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.825+0000 7fd9437fe640 1 -- 172.21.15.19:0/4131408757 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd950005480 con 0x7fd95c1521c0 2024-09-12T02:07:18.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.825+0000 7fd9613fd640 1 -- 172.21.15.19:0/4131408757 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd95c1f7df0 con 0x7fd95c1521c0 2024-09-12T02:07:18.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.825+0000 7fd9437fe640 1 -- 172.21.15.19:0/4131408757 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950007a30 con 0x7fd95c1521c0 2024-09-12T02:07:18.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.825+0000 7fd9613fd640 1 -- 172.21.15.19:0/4131408757 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd95c1f83b0 con 0x7fd95c1521c0 2024-09-12T02:07:18.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.826+0000 7fd9613fd640 1 -- 172.21.15.19:0/4131408757 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd95c0d1d40 con 0x7fd95c1521c0 2024-09-12T02:07:18.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.826+0000 7fd9437fe640 1 -- 172.21.15.19:0/4131408757 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd950044020 con 0x7fd95c1521c0 2024-09-12T02:07:18.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.827+0000 7fd9437fe640 1 --2- 172.21.15.19:0/4131408757 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd94806be60 0x7fd94806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:18.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.827+0000 7fd9437fe640 1 -- 172.21.15.19:0/4131408757 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6101+0+0 (secure 0 0 0) 0x7fd9500aab60 con 0x7fd95c1521c0 2024-09-12T02:07:18.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.827+0000 7fd95affd640 1 --2- 172.21.15.19:0/4131408757 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd94806be60 0x7fd94806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:18.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.827+0000 7fd95affd640 1 --2- 172.21.15.19:0/4131408757 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd94806be60 0x7fd94806e320 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fd94c009b00 tx=0x7fd94c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:18.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:18.831+0000 7fd9437fe640 1 -- 172.21.15.19:0/4131408757 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd950079410 con 0x7fd95c1521c0 2024-09-12T02:07:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.041+0000 7fd9613fd640 1 -- 172.21.15.19:0/4131408757 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd95c0b8320 con 0x7fd95c1521c0 2024-09-12T02:07:19.042 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:07:19.042+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:07:19.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.043+0000 7fd9437fe640 1 -- 172.21.15.19:0/4131408757 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v332) ==== 161+0+0 (secure 0 0 0) 0x7fd950078d10 con 0x7fd95c1521c0 2024-09-12T02:07:19.044 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:07:19.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.047+0000 7fd9613fd640 1 -- 172.21.15.19:0/4131408757 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd94806be60 msgr2=0x7fd94806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.047+0000 7fd9613fd640 1 --2- 172.21.15.19:0/4131408757 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd94806be60 0x7fd94806e320 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fd94c009b00 tx=0x7fd94c008040 comp rx=0 tx=0).stop 2024-09-12T02:07:19.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.047+0000 7fd9613fd640 1 -- 172.21.15.19:0/4131408757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd95c1521c0 msgr2=0x7fd95c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.047+0000 7fd9613fd640 1 --2- 172.21.15.19:0/4131408757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd95c1521c0 0x7fd95c0b7040 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7fd950008fd0 tx=0x7fd950001120 comp rx=0 tx=0).stop 2024-09-12T02:07:19.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.047+0000 7fd9613fd640 1 -- 172.21.15.19:0/4131408757 shutdown_connections 2024-09-12T02:07:19.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.047+0000 7fd9613fd640 1 --2- 172.21.15.19:0/4131408757 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd94806be60 0x7fd94806e320 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.047+0000 7fd9613fd640 1 --2- 172.21.15.19:0/4131408757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd95c071330 0x7fd95c0717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.047+0000 7fd9613fd640 1 --2- 172.21.15.19:0/4131408757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd95c1521c0 0x7fd95c0b7040 unknown :-1 s=CLOSED pgs=2289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.047+0000 7fd9613fd640 1 --2- 172.21.15.19:0/4131408757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd944003f60 0x7fd95c1527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.047+0000 7fd9613fd640 1 -- 172.21.15.19:0/4131408757 >> 172.21.15.19:0/4131408757 conn(0x7fd95c0d23a0 msgr2=0x7fd95c0b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.047+0000 7fd9613fd640 1 -- 172.21.15.19:0/4131408757 shutdown_connections 2024-09-12T02:07:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.047+0000 7fd9613fd640 1 -- 172.21.15.19:0/4131408757 wait complete. 2024-09-12T02:07:19.050 INFO:tasks.ceph.mds.a.smithi019.stderr: -6521> 2024-09-12T02:07:06.818+0000 7f9112e90640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:07:19.060 DEBUG:teuthology.orchestra.run.smithi019:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --yes-i-really-really-mean-it 2024-09-12T02:07:19.084 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-09-12T02:07:19.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.105+0000 7ffadbfd6280 1 -- start start 2024-09-12T02:07:19.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.105+0000 7ffadbfd6280 1 Processor -- start 2024-09-12T02:07:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.106+0000 7ffadbfd6280 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c467cc00 0x55d0c46f8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.106+0000 7ffadbfd6280 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c467d800 0x55d0c46f8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.106+0000 7ffadbfd6280 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c467dc00 0x55d0c46f9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.106+0000 7ffadbfd6280 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d0c546c180 con 0x55d0c467d800 2024-09-12T02:07:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.106+0000 7ffadbfd6280 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d0c546c300 con 0x55d0c467dc00 2024-09-12T02:07:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.106+0000 7ffadbfd6280 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55d0c546c480 con 0x55d0c467cc00 2024-09-12T02:07:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.106+0000 7ffad9f7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c467d800 0x55d0c46f8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.106+0000 7ffad9f7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c467d800 0x55d0c46f8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54518/0 (socket says 172.21.15.19:54518) 2024-09-12T02:07:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.106+0000 7ffad9f7a640 1 -- 172.21.15.19:0/1130792403 learned_addr learned my addr 172.21.15.19:0/1130792403 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.106+0000 7ffadaf7c640 1 --2- 172.21.15.19:0/1130792403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c467dc00 0x55d0c46f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.106+0000 7ffada77b640 1 --2- 172.21.15.19:0/1130792403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c467cc00 0x55d0c46f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.106+0000 7ffad9f7a640 1 -- 172.21.15.19:0/1130792403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c467cc00 msgr2=0x55d0c46f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.106+0000 7ffad9f7a640 1 --2- 172.21.15.19:0/1130792403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c467cc00 0x55d0c46f8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.106+0000 7ffad9f7a640 1 -- 172.21.15.19:0/1130792403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c467dc00 msgr2=0x55d0c46f9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.106+0000 7ffad9f7a640 1 --2- 172.21.15.19:0/1130792403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c467dc00 0x55d0c46f9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.106+0000 7ffad9f7a640 1 -- 172.21.15.19:0/1130792403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c46b4780 con 0x55d0c467d800 2024-09-12T02:07:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.106+0000 7ffadaf7c640 1 --2- 172.21.15.19:0/1130792403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c467dc00 0x55d0c46f9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.106+0000 7ffada77b640 1 --2- 172.21.15.19:0/1130792403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c467cc00 0x55d0c46f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.107+0000 7ffad9f7a640 1 --2- 172.21.15.19:0/1130792403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c467d800 0x55d0c46f8b00 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x55d0c54a9740 tx=0x55d0c541eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20df9a93ecbe99c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.107+0000 7ffad7f76640 1 -- 172.21.15.19:0/1130792403 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d0c46a29c0 con 0x55d0c467d800 2024-09-12T02:07:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.107+0000 7ffad7f76640 1 -- 172.21.15.19:0/1130792403 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d0c46a8fc0 con 0x55d0c467d800 2024-09-12T02:07:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.107+0000 7ffad7f76640 1 -- 172.21.15.19:0/1130792403 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d0c46a2680 con 0x55d0c467d800 2024-09-12T02:07:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.107+0000 7ffadbfd6280 1 -- 172.21.15.19:0/1130792403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0c46b43c0 con 0x55d0c467d800 2024-09-12T02:07:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.107+0000 7ffadbfd6280 1 -- 172.21.15.19:0/1130792403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55d0c46b5680 con 0x55d0c467d800 2024-09-12T02:07:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.107+0000 7ffadbfd6280 4 waiting for MDS map... 2024-09-12T02:07:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.107+0000 7ffad7f76640 1 -- 172.21.15.19:0/1130792403 <== mon.0 v2:172.21.15.19:3300/0 4 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x55d0c5566600 con 0x55d0c467d800 2024-09-12T02:07:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.107+0000 7ffad7f76640 1 -- 172.21.15.19:0/1130792403 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 332) ==== 2893+0+0 (secure 0 0 0) 0x55d0c46d7180 con 0x55d0c467d800 2024-09-12T02:07:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.107+0000 7ffadbfd6280 4 Got MDS map 332 2024-09-12T02:07:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.107+0000 7ffadbfd6280 10 main: JournalTool::main 2024-09-12T02:07:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.107+0000 7ffadbfd6280 4 main: JournalTool: connecting to RADOS... 2024-09-12T02:07:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.108+0000 7ffadbfd6280 1 Processor -- start 2024-09-12T02:07:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.108+0000 7ffadbfd6280 1 -- start start 2024-09-12T02:07:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.108+0000 7ffadbfd6280 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c55ae000 0x55d0c46f9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.108+0000 7ffadbfd6280 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c55ae400 0x55d0c46f9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.108+0000 7ffadbfd6280 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c55ae800 0x55d0c46fa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.108+0000 7ffadbfd6280 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d0c546c600 con 0x55d0c55ae000 2024-09-12T02:07:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.108+0000 7ffadbfd6280 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d0c546c780 con 0x55d0c55ae400 2024-09-12T02:07:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.108+0000 7ffadbfd6280 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55d0c546c900 con 0x55d0c55ae800 2024-09-12T02:07:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.108+0000 7ffadaf7c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c55ae000 0x55d0c46f9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.108+0000 7ffadaf7c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c55ae000 0x55d0c46f9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54528/0 (socket says 172.21.15.19:54528) 2024-09-12T02:07:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.108+0000 7ffadaf7c640 1 -- 172.21.15.19:0/2585705527 learned_addr learned my addr 172.21.15.19:0/2585705527 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffada77b640 1 --2- 172.21.15.19:0/2585705527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c55ae400 0x55d0c46f9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffad9f7a640 1 --2- 172.21.15.19:0/2585705527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c55ae800 0x55d0c46fa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffadaf7c640 1 -- 172.21.15.19:0/2585705527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c55ae800 msgr2=0x55d0c46fa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffadaf7c640 1 --2- 172.21.15.19:0/2585705527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c55ae800 0x55d0c46fa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffadaf7c640 1 -- 172.21.15.19:0/2585705527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c55ae400 msgr2=0x55d0c46f9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffadaf7c640 1 --2- 172.21.15.19:0/2585705527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c55ae400 0x55d0c46f9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffadaf7c640 1 -- 172.21.15.19:0/2585705527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c46b54a0 con 0x55d0c55ae000 2024-09-12T02:07:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffadaf7c640 1 --2- 172.21.15.19:0/2585705527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c55ae000 0x55d0c46f9600 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x55d0c5462810 tx=0x55d0c556ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02fd4a367a6ea45 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffad5f72640 1 -- 172.21.15.19:0/2585705527 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d0c46a29c0 con 0x55d0c55ae000 2024-09-12T02:07:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffad5f72640 1 -- 172.21.15.19:0/2585705527 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d0c46a8a80 con 0x55d0c55ae000 2024-09-12T02:07:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffad5f72640 1 -- 172.21.15.19:0/2585705527 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d0c46a2680 con 0x55d0c55ae000 2024-09-12T02:07:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffadbfd6280 1 -- 172.21.15.19:0/2585705527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c55ae000 msgr2=0x55d0c46f9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/2585705527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c55ae000 0x55d0c46f9600 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x55d0c5462810 tx=0x55d0c556ac00 comp rx=0 tx=0).stop 2024-09-12T02:07:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffadbfd6280 1 -- 172.21.15.19:0/2585705527 shutdown_connections 2024-09-12T02:07:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/2585705527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c55ae800 0x55d0c46fa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/2585705527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c55ae400 0x55d0c46f9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/2585705527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c55ae000 0x55d0c46f9600 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffadbfd6280 1 -- 172.21.15.19:0/2585705527 >> 172.21.15.19:0/2585705527 conn(0x55d0c5475c00 msgr2=0x55d0c4775000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffadbfd6280 1 -- 172.21.15.19:0/2585705527 shutdown_connections 2024-09-12T02:07:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.109+0000 7ffadbfd6280 1 -- 172.21.15.19:0/2585705527 wait complete. 2024-09-12T02:07:19.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.110+0000 7ffadbfd6280 1 Processor -- start 2024-09-12T02:07:19.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.110+0000 7ffadbfd6280 1 -- start start 2024-09-12T02:07:19.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffadbfd6280 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c55ae000 0x55d0c46fb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffadbfd6280 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c55ae400 0x55d0c46fac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffadbfd6280 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c55ae800 0x55d0c46fa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffadbfd6280 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d0c546dc80 con 0x55d0c55ae000 2024-09-12T02:07:19.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffadbfd6280 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d0c546db00 con 0x55d0c55ae400 2024-09-12T02:07:19.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffadbfd6280 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55d0c546d980 con 0x55d0c55ae800 2024-09-12T02:07:19.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffadaf7c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c55ae000 0x55d0c46fb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffadaf7c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c55ae000 0x55d0c46fb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54536/0 (socket says 172.21.15.19:54536) 2024-09-12T02:07:19.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffadaf7c640 1 -- 172.21.15.19:0/3213136663 learned_addr learned my addr 172.21.15.19:0/3213136663 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:19.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffada77b640 1 --2- 172.21.15.19:0/3213136663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c55ae400 0x55d0c46fac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffad9f7a640 1 --2- 172.21.15.19:0/3213136663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c55ae800 0x55d0c46fa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffadaf7c640 1 -- 172.21.15.19:0/3213136663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c55ae800 msgr2=0x55d0c46fa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffadaf7c640 1 --2- 172.21.15.19:0/3213136663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c55ae800 0x55d0c46fa680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffadaf7c640 1 -- 172.21.15.19:0/3213136663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c55ae400 msgr2=0x55d0c46fac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffadaf7c640 1 --2- 172.21.15.19:0/3213136663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c55ae400 0x55d0c46fac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffadaf7c640 1 -- 172.21.15.19:0/3213136663 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c46b4000 con 0x55d0c55ae000 2024-09-12T02:07:19.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffadaf7c640 1 --2- 172.21.15.19:0/3213136663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c55ae000 0x55d0c46fb180 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x55d0c5463ad0 tx=0x55d0c5420240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffad476f640 1 -- 172.21.15.19:0/3213136663 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d0c46a24e0 con 0x55d0c55ae000 2024-09-12T02:07:19.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffad476f640 1 -- 172.21.15.19:0/3213136663 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d0c46a8c40 con 0x55d0c55ae000 2024-09-12T02:07:19.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffadbfd6280 1 -- 172.21.15.19:0/3213136663 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0c46b4960 con 0x55d0c55ae000 2024-09-12T02:07:19.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffad476f640 1 -- 172.21.15.19:0/3213136663 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d0c46a29c0 con 0x55d0c55ae000 2024-09-12T02:07:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffadbfd6280 1 -- 172.21.15.19:0/3213136663 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0c46b5860 con 0x55d0c55ae000 2024-09-12T02:07:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.111+0000 7ffadbfd6280 4 main: JournalTool: resolving pool 15 2024-09-12T02:07:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.113+0000 7ffad476f640 1 -- 172.21.15.19:0/3213136663 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55d0c55cac00 con 0x55d0c55ae000 2024-09-12T02:07:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.113+0000 7ffad476f640 1 --2- 172.21.15.19:0/3213136663 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x55d0c4a00000 0x55d0c46fb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.113+0000 7ffad476f640 1 -- 172.21.15.19:0/3213136663 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x55d0c55b5400 con 0x55d0c55ae000 2024-09-12T02:07:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.113+0000 7ffadbfd6280 4 main: JournalTool: creating IoCtx.. 2024-09-12T02:07:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.113+0000 7ffadbfd6280 4 main: Executing for rank 0 2024-09-12T02:07:19.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.113+0000 7ffada77b640 1 --2- 172.21.15.19:0/3213136663 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x55d0c4a00000 0x55d0c46fb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.113+0000 7ffada77b640 1 --2- 172.21.15.19:0/3213136663 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x55d0c4a00000 0x55d0c46fb700 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x55d0c47f8cf0 tx=0x55d0c4a42000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.114+0000 7ffadbfd6280 1 -- start start 2024-09-12T02:07:19.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.114+0000 7ffadbfd6280 1 Processor -- start 2024-09-12T02:07:19.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.114+0000 7ffadbfd6280 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c55af000 0x55d0c46fa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.114+0000 7ffadbfd6280 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c4a01000 0x55d0c46f9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.114+0000 7ffadbfd6280 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c4a01400 0x55d0c46f9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.114+0000 7ffadbfd6280 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d0c546d680 con 0x55d0c4a01400 2024-09-12T02:07:19.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.114+0000 7ffadbfd6280 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d0c546c600 con 0x55d0c4a01000 2024-09-12T02:07:19.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.114+0000 7ffadbfd6280 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55d0c546c780 con 0x55d0c55af000 2024-09-12T02:07:19.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.114+0000 7ffad9f7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c4a01400 0x55d0c46f9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.114+0000 7ffad9f7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c4a01400 0x55d0c46f9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54542/0 (socket says 172.21.15.19:54542) 2024-09-12T02:07:19.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.114+0000 7ffad9f7a640 1 -- 172.21.15.19:0/4276881744 learned_addr learned my addr 172.21.15.19:0/4276881744 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:19.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.114+0000 7ffadaf7c640 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c55af000 0x55d0c46fa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.114+0000 7ffada77b640 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c4a01000 0x55d0c46f9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.115+0000 7ffad9f7a640 1 -- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c55af000 msgr2=0x55d0c46fa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:19.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.115+0000 7ffad9f7a640 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c55af000 0x55d0c46fa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.115+0000 7ffad9f7a640 1 -- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c4a01000 msgr2=0x55d0c46f9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:19.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.115+0000 7ffad9f7a640 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c4a01000 0x55d0c46f9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.115+0000 7ffad9f7a640 1 -- 172.21.15.19:0/4276881744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c46b5a40 con 0x55d0c4a01400 2024-09-12T02:07:19.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.115+0000 7ffad9f7a640 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c4a01400 0x55d0c46f9600 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x55d0c54a9d40 tx=0x55d0c541e5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c840e20317b895 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.115+0000 7ffad1769640 1 -- 172.21.15.19:0/4276881744 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d0c46a2b60 con 0x55d0c4a01400 2024-09-12T02:07:19.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.115+0000 7ffad1769640 1 -- 172.21.15.19:0/4276881744 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d0c46a8e00 con 0x55d0c4a01400 2024-09-12T02:07:19.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.115+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0c46b54a0 con 0x55d0c4a01400 2024-09-12T02:07:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.115+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55d0c46b4000 con 0x55d0c4a01400 2024-09-12T02:07:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.115+0000 7ffadbfd6280 4 waiting for MDS map... 2024-09-12T02:07:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.115+0000 7ffad1769640 1 -- 172.21.15.19:0/4276881744 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d0c46a2820 con 0x55d0c4a01400 2024-09-12T02:07:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.115+0000 7ffad1769640 1 -- 172.21.15.19:0/4276881744 <== mon.0 v2:172.21.15.19:3300/0 4 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x55d0c55b4800 con 0x55d0c4a01400 2024-09-12T02:07:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.115+0000 7ffad1769640 1 -- 172.21.15.19:0/4276881744 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 332) ==== 2893+0+0 (secure 0 0 0) 0x55d0c46d7500 con 0x55d0c4a01400 2024-09-12T02:07:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.115+0000 7ffadbfd6280 4 Got MDS map 332 2024-09-12T02:07:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.115+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d0c4a01800 0x55d0c4a84000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.115+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:1 15.f 15:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e146) -- 0x55d0c4a01c00 con 0x55d0c4a01800 2024-09-12T02:07:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.116+0000 7ffadaf7c640 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d0c4a01800 0x55d0c4a84000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.116+0000 7ffadaf7c640 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d0c4a01800 0x55d0c4a84000 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=aa232595aa67196c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.117+0000 7ffadaf7c640 1 -- 172.21.15.19:0/4276881744 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55d0c540e000 con 0x55d0c4a01800 2024-09-12T02:07:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.117+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:2 15.14 15:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e146) -- 0x55d0c4a6f800 con 0x55d0c4a01800 2024-09-12T02:07:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.117+0000 7ffadaf7c640 1 -- 172.21.15.19:0/4276881744 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv22 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55d0c540e000 con 0x55d0c4a01800 2024-09-12T02:07:19.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.117+0000 7ffacff66640 1 -- 172.21.15.19:0/4276881744 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:3 15.14 15:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e146) -- 0x55d0c4a88000 con 0x55d0c4a01800 2024-09-12T02:07:19.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.117+0000 7ffacff66640 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d0c4a88400 0x55d0c4a86680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.117+0000 7ffacff66640 1 -- 172.21.15.19:0/4276881744 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:4 15.1b 15:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e146) -- 0x55d0c4a88800 con 0x55d0c4a88400 2024-09-12T02:07:19.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.117+0000 7ffadaf7c640 1 -- 172.21.15.19:0/4276881744 <== osd.6 v2:172.21.15.135:6816/580453075 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv19 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x55d0c540e000 con 0x55d0c4a01800 2024-09-12T02:07:19.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.117+0000 7ffada77b640 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d0c4a88400 0x55d0c4a86680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.118+0000 7ffada77b640 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d0c4a88400 0x55d0c4a86680 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=8ca74a4743602957 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.120+0000 7ffada77b640 1 -- 172.21.15.19:0/4276881744 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55d0c540e500 con 0x55d0c4a88400 2024-09-12T02:07:19.131 INFO:teuthology.orchestra.run.smithi019.stdout:old journal was 4226044~2030 2024-09-12T02:07:19.131 INFO:teuthology.orchestra.run.smithi019.stdout:new journal start will be 8388608 (4160534 bytes past old end) 2024-09-12T02:07:19.131 INFO:teuthology.orchestra.run.smithi019.stdout:writing journal head 2024-09-12T02:07:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.120+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- osd_op(unknown.0.0:5 15.14 15:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146) -- 0x55d0c4a6fc00 con 0x55d0c4a01800 2024-09-12T02:07:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.121+0000 7ffadaf7c640 1 -- 172.21.15.19:0/4276881744 <== osd.6 v2:172.21.15.135:6816/580453075 4 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v146'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55d0c540e000 con 0x55d0c4a01800 2024-09-12T02:07:19.132 INFO:teuthology.orchestra.run.smithi019.stdout:writing EResetJournal entry 2024-09-12T02:07:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.121+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:6 15.1b 15:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146) -- 0x55d0c4a88000 con 0x55d0c4a88400 2024-09-12T02:07:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.121+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x55d0c4a88c00 0x55d0c4a84580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.121+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 --> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] -- osd_op(unknown.0.0:7 15.b 15:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146) -- 0x55d0c4a89000 con 0x55d0c4a88c00 2024-09-12T02:07:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.121+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x55d0c4a89400 0x55d0c4a84b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.121+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 --> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] -- osd_op(unknown.0.0:8 15.1f 15:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146) -- 0x55d0c4a89800 con 0x55d0c4a89400 2024-09-12T02:07:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.121+0000 7ffadaf7c640 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x55d0c4a88c00 0x55d0c4a84580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.121+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d0c4a6f800 0x55d0c4a85080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.121+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- osd_op(unknown.0.0:9 15.1a 15:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146) -- 0x55d0c4a6fc00 con 0x55d0c4a6f800 2024-09-12T02:07:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.121+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 --> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] -- osd_op(unknown.0.0:10 15.1e 15:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146) -- 0x55d0c4a01c00 con 0x55d0c4a88c00 2024-09-12T02:07:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.121+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55d0c4a89c00 0x55d0c4a85600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.121+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- osd_op(unknown.0.0:11 15.1d 15:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146) -- 0x55d0c4aa4000 con 0x55d0c4a89c00 2024-09-12T02:07:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.122+0000 7ffad9f7a640 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d0c4a6f800 0x55d0c4a85080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.122+0000 7ffadaf7c640 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55d0c4a89c00 0x55d0c4a85600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.122+0000 7ffada77b640 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x55d0c4a89400 0x55d0c4a84b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.122+0000 7ffadaf7c640 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x55d0c4a88c00 0x55d0c4a84580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=e983677dbdf4e470 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.122+0000 7ffada77b640 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x55d0c4a89400 0x55d0c4a84b00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=9540d3f5d1368bc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.122+0000 7ffada77b640 1 -- 172.21.15.19:0/4276881744 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== osd_op_reply(6 200.00000002 [delete] v146'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55d0c540e500 con 0x55d0c4a88400 2024-09-12T02:07:19.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.123+0000 7ffad9f7a640 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d0c4a6f800 0x55d0c4a85080 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=d752d27e1faabfc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.123+0000 7ffadaf7c640 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55d0c4a89c00 0x55d0c4a85600 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=c90564da5e2e5559 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.124+0000 7ffadaf7c640 1 -- 172.21.15.19:0/4276881744 <== osd.2 v2:172.21.15.19:6816/1297238899 1 ==== osd_op_reply(7 200.00000003 [delete] v146'4 uv3 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55d0c540e000 con 0x55d0c4a88c00 2024-09-12T02:07:19.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.124+0000 7ffadaf7c640 1 -- 172.21.15.19:0/4276881744 <== osd.2 v2:172.21.15.19:6816/1297238899 2 ==== osd_op_reply(10 200.00000006 [delete] v146'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55d0c540e000 con 0x55d0c4a88c00 2024-09-12T02:07:19.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.124+0000 7ffacff66640 1 -- 172.21.15.19:0/4276881744 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- osd_op(unknown.0.0:12 15.1b 15:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146) -- 0x55d0c4a88800 con 0x55d0c4a88400 2024-09-12T02:07:19.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.124+0000 7ffadaf7c640 1 -- 172.21.15.19:0/4276881744 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== osd_op_reply(11 200.00000007 [delete] v146'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55d0c540e000 con 0x55d0c4a89c00 2024-09-12T02:07:19.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffada77b640 1 -- 172.21.15.19:0/4276881744 <== osd.7 v2:172.21.15.135:6824/872608380 3 ==== osd_op_reply(12 200.00000002 [write 0~48] v146'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55d0c540e500 con 0x55d0c4a88400 2024-09-12T02:07:19.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffada77b640 1 -- 172.21.15.19:0/4276881744 <== osd.3 v2:172.21.15.19:6800/2581301650 1 ==== osd_op_reply(8 200.00000004 [delete] v146'7 uv6 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55d0c540e500 con 0x55d0c4a89400 2024-09-12T02:07:19.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffad9f7a640 1 -- 172.21.15.19:0/4276881744 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== osd_op_reply(9 200.00000005 [delete] v146'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55d0c540e780 con 0x55d0c4a6f800 2024-09-12T02:07:19.136 INFO:teuthology.orchestra.run.smithi019.stdout:done 2024-09-12T02:07:19.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x55d0c4a88c00 msgr2=0x55d0c4a84580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x55d0c4a88c00 0x55d0c4a84580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x55d0c4a89400 msgr2=0x55d0c4a84b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x55d0c4a89400 0x55d0c4a84b00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55d0c4a89c00 msgr2=0x55d0c4a85600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x55d0c4a89c00 0x55d0c4a85600 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d0c4a6f800 msgr2=0x55d0c4a85080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x55d0c4a6f800 0x55d0c4a85080 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d0c4a01800 msgr2=0x55d0c4a84000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x55d0c4a01800 0x55d0c4a84000 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d0c4a88400 msgr2=0x55d0c4a86680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x55d0c4a88400 0x55d0c4a86680 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffad9f7a640 1 -- 172.21.15.19:0/4276881744 reap_dead start 2024-09-12T02:07:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c4a01400 msgr2=0x55d0c46f9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffad9f7a640 1 -- 172.21.15.19:0/4276881744 reap_dead start 2024-09-12T02:07:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/4276881744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c4a01400 0x55d0c46f9600 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x55d0c54a9d40 tx=0x55d0c541e5a0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffad9f7a640 1 -- 172.21.15.19:0/4276881744 reap_dead start 2024-09-12T02:07:19.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 shutdown_connections 2024-09-12T02:07:19.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 >> 172.21.15.19:0/4276881744 conn(0x55d0c55aec00 msgr2=0x55d0c4775800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:19.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 shutdown_connections 2024-09-12T02:07:19.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 -- 172.21.15.19:0/4276881744 wait complete. 2024-09-12T02:07:19.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 -- 172.21.15.19:0/3213136663 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x55d0c4a00000 msgr2=0x55d0c46fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/3213136663 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x55d0c4a00000 0x55d0c46fb700 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x55d0c47f8cf0 tx=0x55d0c4a42000 comp rx=0 tx=0).stop 2024-09-12T02:07:19.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 -- 172.21.15.19:0/3213136663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c55ae000 msgr2=0x55d0c46fb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.126+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/3213136663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c55ae000 0x55d0c46fb180 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x55d0c5463ad0 tx=0x55d0c5420240 comp rx=0 tx=0).stop 2024-09-12T02:07:19.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.127+0000 7ffadbfd6280 1 -- 172.21.15.19:0/3213136663 shutdown_connections 2024-09-12T02:07:19.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.127+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/3213136663 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x55d0c4a00000 0x55d0c46fb700 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.127+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/3213136663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c55ae800 0x55d0c46fa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.127+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/3213136663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c55ae400 0x55d0c46fac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.127+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/3213136663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c55ae000 0x55d0c46fb180 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.127+0000 7ffadbfd6280 1 -- 172.21.15.19:0/3213136663 >> 172.21.15.19:0/3213136663 conn(0x55d0c5475c00 msgr2=0x55d0c4775000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:19.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.127+0000 7ffadbfd6280 1 -- 172.21.15.19:0/3213136663 shutdown_connections 2024-09-12T02:07:19.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.127+0000 7ffadbfd6280 1 -- 172.21.15.19:0/3213136663 wait complete. 2024-09-12T02:07:19.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.127+0000 7ffadbfd6280 1 -- 172.21.15.19:0/1130792403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c467d800 msgr2=0x55d0c46f8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.127+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/1130792403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c467d800 0x55d0c46f8b00 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x55d0c54a9740 tx=0x55d0c541eb40 comp rx=0 tx=0).stop 2024-09-12T02:07:19.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.127+0000 7ffadbfd6280 1 -- 172.21.15.19:0/1130792403 shutdown_connections 2024-09-12T02:07:19.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.127+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/1130792403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c467dc00 0x55d0c46f9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.127+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/1130792403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d0c467d800 0x55d0c46f8b00 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.127+0000 7ffadbfd6280 1 --2- 172.21.15.19:0/1130792403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d0c467cc00 0x55d0c46f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.127+0000 7ffadbfd6280 1 -- 172.21.15.19:0/1130792403 >> 172.21.15.19:0/1130792403 conn(0x55d0c467d000 msgr2=0x55d0c4774800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:19.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.127+0000 7ffadbfd6280 1 -- 172.21.15.19:0/1130792403 shutdown_connections 2024-09-12T02:07:19.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.127+0000 7ffadbfd6280 1 -- 172.21.15.19:0/1130792403 wait complete. 2024-09-12T02:07:19.143 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--yes-i-really-really-mean-it'] in time 0:00:00.083768, result: old journal was 4226044~2030 new journal start will be 8388608 (4160534 bytes past old end) writing journal head writing EResetJournal entry done 2024-09-12T02:07:19.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:07:19.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.286+0000 7fae3dd9f640 1 Processor -- start 2024-09-12T02:07:19.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.286+0000 7fae3dd9f640 1 -- start start 2024-09-12T02:07:19.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.287+0000 7fae3dd9f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fae38161a20 0x7fae380d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.287+0000 7fae3dd9f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae380d1420 0x7fae380cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.287+0000 7fae3dd9f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae3806e820 con 0x7fae380cf160 2024-09-12T02:07:19.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.287+0000 7fae3dd9f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fae38161e00 con 0x7fae38161a20 2024-09-12T02:07:19.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.287+0000 7fae3dd9f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fae380d1830 con 0x7fae380d1420 2024-09-12T02:07:19.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.287+0000 7fae377fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fae38161a20 0x7fae380d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.287+0000 7fae37fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fae380cf160 0x7fae380b5f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34216/0 (socket says 172.21.15.19:34216) 2024-09-12T02:07:19.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.287+0000 7fae37fff640 1 -- 172.21.15.19:0/3780185676 learned_addr learned my addr 172.21.15.19:0/3780185676 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:19.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.287+0000 7fae377fe640 1 -- 172.21.15.19:0/3780185676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae380d1420 msgr2=0x7fae380cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:19.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.287+0000 7fae377fe640 1 --2- 172.21.15.19:0/3780185676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae380d1420 0x7fae380cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.287+0000 7fae377fe640 1 -- 172.21.15.19:0/3780185676 >> v1:172.21.15.19:6789/0 conn(0x7fae380cf160 legacy=0x7fae380b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.287+0000 7fae377fe640 1 -- 172.21.15.19:0/3780185676 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae380cf980 con 0x7fae38161a20 2024-09-12T02:07:19.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.288+0000 7fae377fe640 1 --2- 172.21.15.19:0/3780185676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae38161a20 0x7fae380d0ee0 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7fae280097a0 tx=0x7fae2802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28af873094eb928d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.288+0000 7fae367fc640 1 -- 172.21.15.19:0/3780185676 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae28037070 con 0x7fae38161a20 2024-09-12T02:07:19.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.288+0000 7fae367fc640 1 -- 172.21.15.19:0/3780185676 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae28032440 con 0x7fae38161a20 2024-09-12T02:07:19.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.288+0000 7fae367fc640 1 -- 172.21.15.19:0/3780185676 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae28032810 con 0x7fae38161a20 2024-09-12T02:07:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.289+0000 7fae3dd9f640 1 -- 172.21.15.19:0/3780185676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae38161a20 msgr2=0x7fae380d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.289+0000 7fae3dd9f640 1 --2- 172.21.15.19:0/3780185676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae38161a20 0x7fae380d0ee0 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7fae280097a0 tx=0x7fae2802a180 comp rx=0 tx=0).stop 2024-09-12T02:07:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.289+0000 7fae3dd9f640 1 -- 172.21.15.19:0/3780185676 shutdown_connections 2024-09-12T02:07:19.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.289+0000 7fae3dd9f640 1 --2- 172.21.15.19:0/3780185676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae380d1420 0x7fae380cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.289+0000 7fae3dd9f640 1 --2- 172.21.15.19:0/3780185676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae38161a20 0x7fae380d0ee0 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.289+0000 7fae3dd9f640 1 -- 172.21.15.19:0/3780185676 >> 172.21.15.19:0/3780185676 conn(0x7fae3809d850 msgr2=0x7fae3808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:19.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.289+0000 7fae3dd9f640 1 -- 172.21.15.19:0/3780185676 shutdown_connections 2024-09-12T02:07:19.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.289+0000 7fae3dd9f640 1 -- 172.21.15.19:0/3780185676 wait complete. 2024-09-12T02:07:19.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.290+0000 7fae3dd9f640 1 Processor -- start 2024-09-12T02:07:19.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.290+0000 7fae3dd9f640 1 -- start start 2024-09-12T02:07:19.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.291+0000 7fae3dd9f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae380cf160 0x7fae380cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.291+0000 7fae3dd9f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae380d1420 0x7fae381e86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.291+0000 7fae3dd9f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae38161a20 0x7fae381e8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.291+0000 7fae3dd9f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fae380cff00 con 0x7fae38161a20 2024-09-12T02:07:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.291+0000 7fae3dd9f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fae3806d050 con 0x7fae380cf160 2024-09-12T02:07:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.291+0000 7fae3dd9f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fae3806d2f0 con 0x7fae380d1420 2024-09-12T02:07:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.291+0000 7fae37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae38161a20 0x7fae381e8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.291+0000 7fae37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae38161a20 0x7fae381e8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54558/0 (socket says 172.21.15.19:54558) 2024-09-12T02:07:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.291+0000 7fae37fff640 1 -- 172.21.15.19:0/3015525568 learned_addr learned my addr 172.21.15.19:0/3015525568 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.291+0000 7fae36ffd640 1 --2- 172.21.15.19:0/3015525568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae380d1420 0x7fae381e86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.291+0000 7fae377fe640 1 --2- 172.21.15.19:0/3015525568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae380cf160 0x7fae380cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.291+0000 7fae37fff640 1 -- 172.21.15.19:0/3015525568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae380d1420 msgr2=0x7fae381e86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.291+0000 7fae37fff640 1 --2- 172.21.15.19:0/3015525568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae380d1420 0x7fae381e86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.291+0000 7fae37fff640 1 -- 172.21.15.19:0/3015525568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae380cf160 msgr2=0x7fae380cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.291+0000 7fae37fff640 1 --2- 172.21.15.19:0/3015525568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae380cf160 0x7fae380cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.291+0000 7fae37fff640 1 -- 172.21.15.19:0/3015525568 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae381e9ae0 con 0x7fae38161a20 2024-09-12T02:07:19.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.291+0000 7fae377fe640 1 --2- 172.21.15.19:0/3015525568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae380cf160 0x7fae380cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:19.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.292+0000 7fae37fff640 1 --2- 172.21.15.19:0/3015525568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae38161a20 0x7fae381e8c10 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7fae3000cbc0 tx=0x7fae3000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.292+0000 7fae1ffff640 1 -- 172.21.15.19:0/3015525568 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae30017070 con 0x7fae38161a20 2024-09-12T02:07:19.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.292+0000 7fae1ffff640 1 -- 172.21.15.19:0/3015525568 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae3000ad40 con 0x7fae38161a20 2024-09-12T02:07:19.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.292+0000 7fae3dd9f640 1 -- 172.21.15.19:0/3015525568 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae3809e4c0 con 0x7fae38161a20 2024-09-12T02:07:19.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.292+0000 7fae1ffff640 1 -- 172.21.15.19:0/3015525568 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae30012600 con 0x7fae38161a20 2024-09-12T02:07:19.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.292+0000 7fae3dd9f640 1 -- 172.21.15.19:0/3015525568 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae381e9800 con 0x7fae38161a20 2024-09-12T02:07:19.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.293+0000 7fae3dd9f640 1 -- 172.21.15.19:0/3015525568 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae380b1040 con 0x7fae38161a20 2024-09-12T02:07:19.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.293+0000 7fae1ffff640 1 -- 172.21.15.19:0/3015525568 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae3001a070 con 0x7fae38161a20 2024-09-12T02:07:19.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.294+0000 7fae1ffff640 1 --2- 172.21.15.19:0/3015525568 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae2406be30 0x7fae2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.294+0000 7fae1ffff640 1 -- 172.21.15.19:0/3015525568 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x7fae3008acc0 con 0x7fae38161a20 2024-09-12T02:07:19.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.294+0000 7fae377fe640 1 --2- 172.21.15.19:0/3015525568 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae2406be30 0x7fae2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.295+0000 7fae377fe640 1 --2- 172.21.15.19:0/3015525568 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae2406be30 0x7fae2406e2f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fae28034000 tx=0x7fae2802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.298+0000 7fae1ffff640 1 -- 172.21.15.19:0/3015525568 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae30058e40 con 0x7fae38161a20 2024-09-12T02:07:19.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:19.510+0000 7fae3dd9f640 1 -- 172.21.15.19:0/3015525568 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fae380d3580 con 0x7fae38161a20 2024-09-12T02:07:20.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.045+0000 7fae1ffff640 1 -- 172.21.15.19:0/3015525568 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v333) ==== 162+0+0 (secure 0 0 0) 0x7fae3005d140 con 0x7fae38161a20 2024-09-12T02:07:20.046 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:07:20.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.048+0000 7fae3dd9f640 1 -- 172.21.15.19:0/3015525568 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae2406be30 msgr2=0x7fae2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:20.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.048+0000 7fae3dd9f640 1 --2- 172.21.15.19:0/3015525568 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae2406be30 0x7fae2406e2f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fae28034000 tx=0x7fae2802e000 comp rx=0 tx=0).stop 2024-09-12T02:07:20.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.048+0000 7fae3dd9f640 1 -- 172.21.15.19:0/3015525568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae38161a20 msgr2=0x7fae381e8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:20.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.048+0000 7fae3dd9f640 1 --2- 172.21.15.19:0/3015525568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae38161a20 0x7fae381e8c10 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7fae3000cbc0 tx=0x7fae3000a430 comp rx=0 tx=0).stop 2024-09-12T02:07:20.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.049+0000 7fae3dd9f640 1 -- 172.21.15.19:0/3015525568 shutdown_connections 2024-09-12T02:07:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.049+0000 7fae3dd9f640 1 --2- 172.21.15.19:0/3015525568 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fae2406be30 0x7fae2406e2f0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.049+0000 7fae3dd9f640 1 --2- 172.21.15.19:0/3015525568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae38161a20 0x7fae381e8c10 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.049+0000 7fae3dd9f640 1 --2- 172.21.15.19:0/3015525568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae380d1420 0x7fae381e86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.049+0000 7fae3dd9f640 1 --2- 172.21.15.19:0/3015525568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae380cf160 0x7fae380cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.049+0000 7fae3dd9f640 1 -- 172.21.15.19:0/3015525568 >> 172.21.15.19:0/3015525568 conn(0x7fae3809d850 msgr2=0x7fae380ca560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.049+0000 7fae3dd9f640 1 -- 172.21.15.19:0/3015525568 shutdown_connections 2024-09-12T02:07:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.049+0000 7fae3dd9f640 1 -- 172.21.15.19:0/3015525568 wait complete. 2024-09-12T02:07:20.066 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:07:20.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.174+0000 7f2163f31640 1 Processor -- start 2024-09-12T02:07:20.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.175+0000 7f2163f31640 1 -- start start 2024-09-12T02:07:20.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.176+0000 7f2163f31640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f215c0720b0 0x7f215c072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.176+0000 7f2163f31640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f215c072a50 0x7f215c072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.176+0000 7f2163f31640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215c0b3570 con 0x7f215c15ba30 2024-09-12T02:07:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.176+0000 7f2163f31640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f215c0b4180 con 0x7f215c0720b0 2024-09-12T02:07:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.176+0000 7f2163f31640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f215c0b3850 con 0x7f215c072a50 2024-09-12T02:07:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.176+0000 7f21614cc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f215c0720b0 0x7f215c072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.176+0000 7f21614cc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f215c0720b0 0x7f215c072510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54572/0 (socket says 172.21.15.19:54572) 2024-09-12T02:07:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.176+0000 7f21614cc640 1 -- 172.21.15.19:0/3437516670 learned_addr learned my addr 172.21.15.19:0/3437516670 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.176+0000 7f21624ce640 1 --2- 172.21.15.19:0/3437516670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f215c072a50 0x7f215c072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.176+0000 7f21614cc640 1 -- 172.21.15.19:0/3437516670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f215c072a50 msgr2=0x7f215c072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.176+0000 7f21614cc640 1 --2- 172.21.15.19:0/3437516670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f215c072a50 0x7f215c072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.176+0000 7f21614cc640 1 -- 172.21.15.19:0/3437516670 >> v1:172.21.15.135:6789/0 conn(0x7f215c15ba30 legacy=0x7f215c06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.176+0000 7f21614cc640 1 -- 172.21.15.19:0/3437516670 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c0b3b30 con 0x7f215c0720b0 2024-09-12T02:07:20.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.176+0000 7f21624ce640 1 --2- 172.21.15.19:0/3437516670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f215c072a50 0x7f215c072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.177+0000 7f21614cc640 1 --2- 172.21.15.19:0/3437516670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f215c0720b0 0x7f215c072510 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f215000bb10 tx=0x7f215002c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89dd9c98417133 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.177+0000 7f2160ccb640 1 -- 172.21.15.19:0/3437516670 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150032790 con 0x7f215c0720b0 2024-09-12T02:07:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.177+0000 7f2160ccb640 1 -- 172.21.15.19:0/3437516670 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2150038070 con 0x7f215c0720b0 2024-09-12T02:07:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.177+0000 7f2160ccb640 1 -- 172.21.15.19:0/3437516670 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150032b50 con 0x7f215c0720b0 2024-09-12T02:07:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.178+0000 7f2163f31640 1 -- 172.21.15.19:0/3437516670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f215c0720b0 msgr2=0x7f215c072510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.178+0000 7f2163f31640 1 --2- 172.21.15.19:0/3437516670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f215c0720b0 0x7f215c072510 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f215000bb10 tx=0x7f215002c8d0 comp rx=0 tx=0).stop 2024-09-12T02:07:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.178+0000 7f2163f31640 1 -- 172.21.15.19:0/3437516670 shutdown_connections 2024-09-12T02:07:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.178+0000 7f2163f31640 1 --2- 172.21.15.19:0/3437516670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f215c072a50 0x7f215c072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.178+0000 7f2163f31640 1 --2- 172.21.15.19:0/3437516670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f215c0720b0 0x7f215c072510 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.178+0000 7f2163f31640 1 -- 172.21.15.19:0/3437516670 >> 172.21.15.19:0/3437516670 conn(0x7f215c067d70 msgr2=0x7f215c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.178+0000 7f2163f31640 1 -- 172.21.15.19:0/3437516670 shutdown_connections 2024-09-12T02:07:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.178+0000 7f2163f31640 1 -- 172.21.15.19:0/3437516670 wait complete. 2024-09-12T02:07:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.179+0000 7f2163f31640 1 Processor -- start 2024-09-12T02:07:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.179+0000 7f2163f31640 1 -- start start 2024-09-12T02:07:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.180+0000 7f2163f31640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f215c0720b0 0x7f215c154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.180+0000 7f2163f31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f215c072a50 0x7f215c144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.180+0000 7f2163f31640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c15ba30 0x7f215c152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.180+0000 7f2163f31640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f215c0ce810 con 0x7f215c072a50 2024-09-12T02:07:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.180+0000 7f2163f31640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f215c06ff20 con 0x7f215c15ba30 2024-09-12T02:07:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.180+0000 7f2163f31640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f215c0ccfe0 con 0x7f215c0720b0 2024-09-12T02:07:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.180+0000 7f21614cc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f215c072a50 0x7f215c144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.180+0000 7f21614cc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f215c072a50 0x7f215c144dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54574/0 (socket says 172.21.15.19:54574) 2024-09-12T02:07:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.180+0000 7f21614cc640 1 -- 172.21.15.19:0/1496603814 learned_addr learned my addr 172.21.15.19:0/1496603814 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.180+0000 7f21624ce640 1 --2- 172.21.15.19:0/1496603814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c15ba30 0x7f215c152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:20.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.180+0000 7f2161ccd640 1 --2- 172.21.15.19:0/1496603814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f215c0720b0 0x7f215c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:20.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.180+0000 7f21614cc640 1 -- 172.21.15.19:0/1496603814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f215c0720b0 msgr2=0x7f215c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:20.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.180+0000 7f21614cc640 1 --2- 172.21.15.19:0/1496603814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f215c0720b0 0x7f215c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:20.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.180+0000 7f21614cc640 1 -- 172.21.15.19:0/1496603814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c15ba30 msgr2=0x7f215c152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:20.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.180+0000 7f21614cc640 1 --2- 172.21.15.19:0/1496603814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c15ba30 0x7f215c152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:20.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.180+0000 7f21614cc640 1 -- 172.21.15.19:0/1496603814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c14fb70 con 0x7f215c072a50 2024-09-12T02:07:20.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.180+0000 7f21624ce640 1 --2- 172.21.15.19:0/1496603814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c15ba30 0x7f215c152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:20.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.181+0000 7f21614cc640 1 --2- 172.21.15.19:0/1496603814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f215c072a50 0x7f215c144dc0 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7f215000b2c0 tx=0x7f21500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:20.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.181+0000 7f215a7fc640 1 -- 172.21.15.19:0/1496603814 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150033620 con 0x7f215c072a50 2024-09-12T02:07:20.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.181+0000 7f215a7fc640 1 -- 172.21.15.19:0/1496603814 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21500337c0 con 0x7f215c072a50 2024-09-12T02:07:20.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.181+0000 7f2163f31640 1 -- 172.21.15.19:0/1496603814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215c14fe50 con 0x7f215c072a50 2024-09-12T02:07:20.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.181+0000 7f215a7fc640 1 -- 172.21.15.19:0/1496603814 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150033bb0 con 0x7f215c072a50 2024-09-12T02:07:20.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.181+0000 7f2163f31640 1 -- 172.21.15.19:0/1496603814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215c152eb0 con 0x7f215c072a50 2024-09-12T02:07:20.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.182+0000 7f2163f31640 1 -- 172.21.15.19:0/1496603814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f215c0cd590 con 0x7f215c072a50 2024-09-12T02:07:20.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.182+0000 7f215a7fc640 1 -- 172.21.15.19:0/1496603814 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f215004d060 con 0x7f215c072a50 2024-09-12T02:07:20.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.183+0000 7f215a7fc640 1 --2- 172.21.15.19:0/1496603814 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f214806be30 0x7f214806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:20.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.183+0000 7f215a7fc640 1 -- 172.21.15.19:0/1496603814 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x7f21500ad970 con 0x7f215c072a50 2024-09-12T02:07:20.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.183+0000 7f2161ccd640 1 --2- 172.21.15.19:0/1496603814 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f214806be30 0x7f214806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:20.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.184+0000 7f2161ccd640 1 --2- 172.21.15.19:0/1496603814 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f214806be30 0x7f214806e2f0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f2154006fd0 tx=0x7f2154008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:20.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.187+0000 7f215a7fc640 1 -- 172.21.15.19:0/1496603814 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f215c0cd590 con 0x7f215c072a50 2024-09-12T02:07:20.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.397+0000 7f2163f31640 1 -- 172.21.15.19:0/1496603814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f215c072510 con 0x7f215c072a50 2024-09-12T02:07:20.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.397+0000 7f215a7fc640 1 -- 172.21.15.19:0/1496603814 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 334 v334) ==== 95+0+5233 (secure 0 0 0) 0x7f2150041070 con 0x7f215c072a50 2024-09-12T02:07:20.398 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:20.398 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":334,"btime":"2024-09-12T02:07:20:049326+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2607300298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2607300298},{"type":"v1","addr":"172.21.15.135:6836","nonce":2607300298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":9283,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/818911002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":818911002},{"type":"v1","addr":"172.21.15.135:6837","nonce":818911002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":10650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3527496552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3527496552},{"type":"v1","addr":"172.21.15.19:6834","nonce":3527496552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327}],"filesystems":[{"mdsmap":{"epoch":334,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:07:05.517761+0000","modified":"2024-09-12T02:07:20.049304+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":146,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10836":{"gid":10836,"name":"a","rank":0,"incarnation":334,"state":"up:replay","state_seq":1,"addr":"172.21.15.19:6835/3413662523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3413662523},{"type":"v1","addr":"172.21.15.19:6835","nonce":3413662523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-09-12T02:07:20.398 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 334 2024-09-12T02:07:20.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.399+0000 7f2163f31640 1 -- 172.21.15.19:0/1496603814 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f214806be30 msgr2=0x7f214806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:20.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.399+0000 7f2163f31640 1 --2- 172.21.15.19:0/1496603814 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f214806be30 0x7f214806e2f0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f2154006fd0 tx=0x7f2154008040 comp rx=0 tx=0).stop 2024-09-12T02:07:20.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.399+0000 7f2163f31640 1 -- 172.21.15.19:0/1496603814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f215c072a50 msgr2=0x7f215c144dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:20.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.399+0000 7f2163f31640 1 --2- 172.21.15.19:0/1496603814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f215c072a50 0x7f215c144dc0 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7f215000b2c0 tx=0x7f21500046c0 comp rx=0 tx=0).stop 2024-09-12T02:07:20.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.399+0000 7f2163f31640 1 -- 172.21.15.19:0/1496603814 shutdown_connections 2024-09-12T02:07:20.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.399+0000 7f2163f31640 1 --2- 172.21.15.19:0/1496603814 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f214806be30 0x7f214806e2f0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:20.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.399+0000 7f2163f31640 1 --2- 172.21.15.19:0/1496603814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c15ba30 0x7f215c152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:20.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.399+0000 7f2163f31640 1 --2- 172.21.15.19:0/1496603814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f215c072a50 0x7f215c144dc0 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:20.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.399+0000 7f2163f31640 1 --2- 172.21.15.19:0/1496603814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f215c0720b0 0x7f215c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:20.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.399+0000 7f2163f31640 1 -- 172.21.15.19:0/1496603814 >> 172.21.15.19:0/1496603814 conn(0x7f215c067d70 msgr2=0x7f215c1597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:20.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.399+0000 7f2163f31640 1 -- 172.21.15.19:0/1496603814 shutdown_connections 2024-09-12T02:07:20.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:20.399+0000 7f2163f31640 1 -- 172.21.15.19:0/1496603814 wait complete. 2024-09-12T02:07:20.814 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 334, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:07:05.517761+0000', 'modified': '2024-09-12T02:07:20.049304+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 146, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10836}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10836': {'gid': 10836, 'name': 'a', 'rank': 0, 'incarnation': 334, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.19:6835/3413662523', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6833', 'nonce': 3413662523}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 3413662523}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:07:20.814 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10836:up:replay 2024-09-12T02:07:21.815 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:07:21.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.930+0000 7f020976f640 1 Processor -- start 2024-09-12T02:07:21.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.930+0000 7f020976f640 1 -- start start 2024-09-12T02:07:21.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.931+0000 7f020976f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0204161c80 0x7f020406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:21.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.931+0000 7f020976f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0204162060 0x7f02040b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:21.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.931+0000 7f020976f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f020406e870 con 0x7f02040b64b0 2024-09-12T02:07:21.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.931+0000 7f020976f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f020406d9f0 con 0x7f0204162060 2024-09-12T02:07:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.931+0000 7f020976f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f020406dcd0 con 0x7f0204161c80 2024-09-12T02:07:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.931+0000 7f02027fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0204162060 0x7f02040b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.931+0000 7f02027fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0204162060 0x7f02040b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38072/0 (socket says 172.21.15.19:38072) 2024-09-12T02:07:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.931+0000 7f02027fc640 1 -- 172.21.15.19:0/3000201695 learned_addr learned my addr 172.21.15.19:0/3000201695 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.932+0000 7f0202ffd640 1 --2- 172.21.15.19:0/3000201695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0204161c80 0x7f020406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.932+0000 7f02027fc640 1 -- 172.21.15.19:0/3000201695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0204161c80 msgr2=0x7f020406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.932+0000 7f02027fc640 1 --2- 172.21.15.19:0/3000201695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0204161c80 0x7f020406e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.932+0000 7f02027fc640 1 -- 172.21.15.19:0/3000201695 >> v1:172.21.15.135:6789/0 conn(0x7f02040b64b0 legacy=0x7f0204162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.932+0000 7f02027fc640 1 -- 172.21.15.19:0/3000201695 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f020406dfb0 con 0x7f0204162060 2024-09-12T02:07:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.932+0000 7f02027fc640 1 --2- 172.21.15.19:0/3000201695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0204162060 0x7f02040b5f70 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009870 tx=0x7f01f802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d776ca0911bc6f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.933+0000 7f0201ffb640 1 -- 172.21.15.19:0/3000201695 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f8037070 con 0x7f0204162060 2024-09-12T02:07:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.933+0000 7f0201ffb640 1 -- 172.21.15.19:0/3000201695 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f8032440 con 0x7f0204162060 2024-09-12T02:07:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.933+0000 7f0201ffb640 1 -- 172.21.15.19:0/3000201695 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f8032810 con 0x7f0204162060 2024-09-12T02:07:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.933+0000 7f020976f640 1 -- 172.21.15.19:0/3000201695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0204162060 msgr2=0x7f02040b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.933+0000 7f020976f640 1 --2- 172.21.15.19:0/3000201695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0204162060 0x7f02040b5f70 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009870 tx=0x7f01f802a210 comp rx=0 tx=0).stop 2024-09-12T02:07:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.933+0000 7f020976f640 1 -- 172.21.15.19:0/3000201695 shutdown_connections 2024-09-12T02:07:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.933+0000 7f020976f640 1 --2- 172.21.15.19:0/3000201695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0204162060 0x7f02040b5f70 unknown :-1 s=CLOSED pgs=2304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.933+0000 7f020976f640 1 --2- 172.21.15.19:0/3000201695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0204161c80 0x7f020406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.933+0000 7f020976f640 1 -- 172.21.15.19:0/3000201695 >> 172.21.15.19:0/3000201695 conn(0x7f02040d44f0 msgr2=0x7f02040d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.933+0000 7f020976f640 1 -- 172.21.15.19:0/3000201695 shutdown_connections 2024-09-12T02:07:21.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.933+0000 7f020976f640 1 -- 172.21.15.19:0/3000201695 wait complete. 2024-09-12T02:07:21.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.935+0000 7f020976f640 1 Processor -- start 2024-09-12T02:07:21.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.935+0000 7f020976f640 1 -- start start 2024-09-12T02:07:21.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.935+0000 7f020976f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02040b64b0 0x7f0204156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:21.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.935+0000 7f020976f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0204161c80 0x7f02040b8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:21.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.935+0000 7f020976f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0204162060 0x7f02040b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:21.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.935+0000 7f020976f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f02040d2a10 con 0x7f0204162060 2024-09-12T02:07:21.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.935+0000 7f020976f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f02040d2890 con 0x7f02040b64b0 2024-09-12T02:07:21.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.935+0000 7f020976f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f02040b6960 con 0x7f0204161c80 2024-09-12T02:07:21.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.935+0000 7f02037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0204162060 0x7f02040b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:21.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.936+0000 7f02037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0204162060 0x7f02040b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38078/0 (socket says 172.21.15.19:38078) 2024-09-12T02:07:21.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.936+0000 7f02037fe640 1 -- 172.21.15.19:0/142764662 learned_addr learned my addr 172.21.15.19:0/142764662 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:21.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.936+0000 7f02027fc640 1 --2- 172.21.15.19:0/142764662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0204161c80 0x7f02040b8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:21.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.936+0000 7f0202ffd640 1 --2- 172.21.15.19:0/142764662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02040b64b0 0x7f0204156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.936+0000 7f02037fe640 1 -- 172.21.15.19:0/142764662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0204161c80 msgr2=0x7f02040b8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.936+0000 7f02037fe640 1 --2- 172.21.15.19:0/142764662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0204161c80 0x7f02040b8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.936+0000 7f02037fe640 1 -- 172.21.15.19:0/142764662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02040b64b0 msgr2=0x7f0204156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.936+0000 7f02037fe640 1 --2- 172.21.15.19:0/142764662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02040b64b0 0x7f0204156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.936+0000 7f02037fe640 1 -- 172.21.15.19:0/142764662 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02040b8fc0 con 0x7f0204162060 2024-09-12T02:07:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.936+0000 7f02037fe640 1 --2- 172.21.15.19:0/142764662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0204162060 0x7f02040b20b0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00c780 tx=0x7f01fc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.936+0000 7f01eb7fe640 1 -- 172.21.15.19:0/142764662 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc004b60 con 0x7f0204162060 2024-09-12T02:07:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.936+0000 7f01eb7fe640 1 -- 172.21.15.19:0/142764662 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01fc004d00 con 0x7f0204162060 2024-09-12T02:07:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.936+0000 7f020976f640 1 -- 172.21.15.19:0/142764662 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02040b92a0 con 0x7f0204162060 2024-09-12T02:07:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.936+0000 7f01eb7fe640 1 -- 172.21.15.19:0/142764662 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc00aa90 con 0x7f0204162060 2024-09-12T02:07:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.936+0000 7f020976f640 1 -- 172.21.15.19:0/142764662 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02040b9860 con 0x7f0204162060 2024-09-12T02:07:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.937+0000 7f020976f640 1 -- 172.21.15.19:0/142764662 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f020406e330 con 0x7f0204162060 2024-09-12T02:07:21.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.938+0000 7f01eb7fe640 1 -- 172.21.15.19:0/142764662 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f01fc00ac30 con 0x7f0204162060 2024-09-12T02:07:21.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.938+0000 7f01eb7fe640 1 --2- 172.21.15.19:0/142764662 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f01f006be30 0x7f01f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:21.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.938+0000 7f01eb7fe640 1 -- 172.21.15.19:0/142764662 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x7f01fc08b1f0 con 0x7f0204162060 2024-09-12T02:07:21.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.939+0000 7f0202ffd640 1 --2- 172.21.15.19:0/142764662 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f01f006be30 0x7f01f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:21.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.939+0000 7f0202ffd640 1 --2- 172.21.15.19:0/142764662 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f01f006be30 0x7f01f006e2f0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f020406e660 tx=0x7f01f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:21.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:21.943+0000 7f01eb7fe640 1 -- 172.21.15.19:0/142764662 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f01fc020070 con 0x7f0204162060 2024-09-12T02:07:22.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:22.156+0000 7f020976f640 1 -- 172.21.15.19:0/142764662 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0204160250 con 0x7f0204162060 2024-09-12T02:07:22.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:22.156+0000 7f01eb7fe640 1 -- 172.21.15.19:0/142764662 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 336 v336) ==== 95+0+5233 (secure 0 0 0) 0x7f01fc059360 con 0x7f0204162060 2024-09-12T02:07:22.157 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:22.157 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":336,"btime":"2024-09-12T02:07:22:056083+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2607300298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2607300298},{"type":"v1","addr":"172.21.15.135:6836","nonce":2607300298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":9283,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/818911002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":818911002},{"type":"v1","addr":"172.21.15.135:6837","nonce":818911002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":10650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3527496552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3527496552},{"type":"v1","addr":"172.21.15.19:6834","nonce":3527496552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327}],"filesystems":[{"mdsmap":{"epoch":336,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:07:05.517761+0000","modified":"2024-09-12T02:07:21.057936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":146,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10836":{"gid":10836,"name":"a","rank":0,"incarnation":334,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.19:6835/3413662523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3413662523},{"type":"v1","addr":"172.21.15.19:6835","nonce":3413662523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-09-12T02:07:22.157 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 336 2024-09-12T02:07:22.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:22.158+0000 7f020976f640 1 -- 172.21.15.19:0/142764662 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f01f006be30 msgr2=0x7f01f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:22.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:22.158+0000 7f020976f640 1 --2- 172.21.15.19:0/142764662 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f01f006be30 0x7f01f006e2f0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f020406e660 tx=0x7f01f4008040 comp rx=0 tx=0).stop 2024-09-12T02:07:22.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:22.158+0000 7f020976f640 1 -- 172.21.15.19:0/142764662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0204162060 msgr2=0x7f02040b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:22.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:22.158+0000 7f020976f640 1 --2- 172.21.15.19:0/142764662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0204162060 0x7f02040b20b0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00c780 tx=0x7f01fc00cc40 comp rx=0 tx=0).stop 2024-09-12T02:07:22.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:22.158+0000 7f020976f640 1 -- 172.21.15.19:0/142764662 shutdown_connections 2024-09-12T02:07:22.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:22.159+0000 7f020976f640 1 --2- 172.21.15.19:0/142764662 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f01f006be30 0x7f01f006e2f0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:22.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:22.159+0000 7f020976f640 1 --2- 172.21.15.19:0/142764662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0204162060 0x7f02040b20b0 unknown :-1 s=CLOSED pgs=2305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:22.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:22.159+0000 7f020976f640 1 --2- 172.21.15.19:0/142764662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0204161c80 0x7f02040b8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:22.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:22.159+0000 7f020976f640 1 --2- 172.21.15.19:0/142764662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02040b64b0 0x7f0204156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:22.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:22.159+0000 7f020976f640 1 -- 172.21.15.19:0/142764662 >> 172.21.15.19:0/142764662 conn(0x7f02040d44f0 msgr2=0x7f02040b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:22.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:22.159+0000 7f020976f640 1 -- 172.21.15.19:0/142764662 shutdown_connections 2024-09-12T02:07:22.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:22.159+0000 7f020976f640 1 -- 172.21.15.19:0/142764662 wait complete. 2024-09-12T02:07:22.572 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 336, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:07:05.517761+0000', 'modified': '2024-09-12T02:07:21.057936+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 146, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10836}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10836': {'gid': 10836, 'name': 'a', 'rank': 0, 'incarnation': 334, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.19:6835/3413662523', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6833', 'nonce': 3413662523}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 3413662523}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:07:22.573 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10836:up:rejoin 2024-09-12T02:07:23.573 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:07:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.689+0000 7f79d61e8640 1 Processor -- start 2024-09-12T02:07:23.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.689+0000 7f79d61e8640 1 -- start start 2024-09-12T02:07:23.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.690+0000 7f79d61e8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f79d015e740 0x7f79d00d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:23.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.690+0000 7f79d61e8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f79d009b690 0x7f79d006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:23.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.690+0000 7f79d61e8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79d00d0780 con 0x7f79d006d4c0 2024-09-12T02:07:23.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.690+0000 7f79d61e8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f79d015eb20 con 0x7f79d015e740 2024-09-12T02:07:23.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.690+0000 7f79d61e8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f79d006d260 con 0x7f79d009b690 2024-09-12T02:07:23.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.690+0000 7f79cf7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f79d015e740 0x7f79d00d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:23.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.690+0000 7f79cffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f79d006d4c0 0x7f79d006d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59056/0 (socket says 172.21.15.19:59056) 2024-09-12T02:07:23.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.690+0000 7f79cffff640 1 -- 172.21.15.19:0/2697187372 learned_addr learned my addr 172.21.15.19:0/2697187372 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:23.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.690+0000 7f79ceffd640 1 --2- 172.21.15.19:0/2697187372 >> v2:172.21.15.135:3300/0 conn(0x7f79d009b690 0x7f79d006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:23.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.690+0000 7f79ce7fc640 1 -- 172.21.15.19:0/2697187372 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1675846526 0 0) 0x7f79d00d0780 con 0x7f79d006d4c0 2024-09-12T02:07:23.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.690+0000 7f79ce7fc640 1 -- 172.21.15.19:0/2697187372 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79b8003520 con 0x7f79d006d4c0 2024-09-12T02:07:23.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.690+0000 7f79cf7fe640 1 -- 172.21.15.19:0/2697187372 >> v2:172.21.15.135:3300/0 conn(0x7f79d009b690 msgr2=0x7f79d006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:23.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.690+0000 7f79cf7fe640 1 --2- 172.21.15.19:0/2697187372 >> v2:172.21.15.135:3300/0 conn(0x7f79d009b690 0x7f79d006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:23.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.690+0000 7f79cf7fe640 1 -- 172.21.15.19:0/2697187372 >> v1:172.21.15.19:6789/0 conn(0x7f79d006d4c0 legacy=0x7f79d006d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:23.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.690+0000 7f79cf7fe640 1 -- 172.21.15.19:0/2697187372 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d00d0a60 con 0x7f79d015e740 2024-09-12T02:07:23.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.691+0000 7f79cf7fe640 1 --2- 172.21.15.19:0/2697187372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79d015e740 0x7f79d00d1540 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f79d00691b0 tx=0x7f79c002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14ae20dd155e938 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:23.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.691+0000 7f79ce7fc640 1 -- 172.21.15.19:0/2697187372 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0037070 con 0x7f79d015e740 2024-09-12T02:07:23.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.691+0000 7f79ce7fc640 1 -- 172.21.15.19:0/2697187372 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c0032440 con 0x7f79d015e740 2024-09-12T02:07:23.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.691+0000 7f79ce7fc640 1 -- 172.21.15.19:0/2697187372 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c00327f0 con 0x7f79d015e740 2024-09-12T02:07:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.692+0000 7f79d61e8640 1 -- 172.21.15.19:0/2697187372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79d015e740 msgr2=0x7f79d00d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.692+0000 7f79d61e8640 1 --2- 172.21.15.19:0/2697187372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79d015e740 0x7f79d00d1540 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f79d00691b0 tx=0x7f79c002a230 comp rx=0 tx=0).stop 2024-09-12T02:07:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.692+0000 7f79d61e8640 1 -- 172.21.15.19:0/2697187372 shutdown_connections 2024-09-12T02:07:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.692+0000 7f79d61e8640 1 --2- 172.21.15.19:0/2697187372 >> v2:172.21.15.135:3300/0 conn(0x7f79d009b690 0x7f79d006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.692+0000 7f79d61e8640 1 --2- 172.21.15.19:0/2697187372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79d015e740 0x7f79d00d1540 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.692+0000 7f79d61e8640 1 -- 172.21.15.19:0/2697187372 >> 172.21.15.19:0/2697187372 conn(0x7f79d00d23a0 msgr2=0x7f79d00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.692+0000 7f79d61e8640 1 -- 172.21.15.19:0/2697187372 shutdown_connections 2024-09-12T02:07:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.692+0000 7f79d61e8640 1 -- 172.21.15.19:0/2697187372 wait complete. 2024-09-12T02:07:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.693+0000 7f79d61e8640 1 Processor -- start 2024-09-12T02:07:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.693+0000 7f79d61e8640 1 -- start start 2024-09-12T02:07:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.694+0000 7f79d61e8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79d006d4c0 0x7f79d0157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.694+0000 7f79d61e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79d009b690 0x7f79d00b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.694+0000 7f79d61e8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79d015e740 0x7f79d015c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.694+0000 7f79d61e8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f79d009bac0 con 0x7f79d009b690 2024-09-12T02:07:23.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.694+0000 7f79d61e8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f79d00d1020 con 0x7f79d006d4c0 2024-09-12T02:07:23.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.694+0000 7f79d61e8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f79d006dfe0 con 0x7f79d015e740 2024-09-12T02:07:23.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.694+0000 7f79ceffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79d009b690 0x7f79d00b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:23.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.694+0000 7f79ceffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79d009b690 0x7f79d00b6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38100/0 (socket says 172.21.15.19:38100) 2024-09-12T02:07:23.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.694+0000 7f79ceffd640 1 -- 172.21.15.19:0/2650119634 learned_addr learned my addr 172.21.15.19:0/2650119634 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:23.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.695+0000 7f79cf7fe640 1 --2- 172.21.15.19:0/2650119634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79d006d4c0 0x7f79d0157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:23.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.695+0000 7f79cffff640 1 --2- 172.21.15.19:0/2650119634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79d015e740 0x7f79d015c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:23.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.695+0000 7f79ceffd640 1 -- 172.21.15.19:0/2650119634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79d015e740 msgr2=0x7f79d015c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:23.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.695+0000 7f79ceffd640 1 --2- 172.21.15.19:0/2650119634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79d015e740 0x7f79d015c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:23.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.695+0000 7f79ceffd640 1 -- 172.21.15.19:0/2650119634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79d006d4c0 msgr2=0x7f79d0157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:23.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.695+0000 7f79ceffd640 1 --2- 172.21.15.19:0/2650119634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79d006d4c0 0x7f79d0157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:23.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.695+0000 7f79ceffd640 1 -- 172.21.15.19:0/2650119634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d00b5320 con 0x7f79d009b690 2024-09-12T02:07:23.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.695+0000 7f79ceffd640 1 --2- 172.21.15.19:0/2650119634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79d009b690 0x7f79d00b6d20 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7f79c400d620 tx=0x7f79c400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:23.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.695+0000 7f79b7fff640 1 -- 172.21.15.19:0/2650119634 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c400b620 con 0x7f79d009b690 2024-09-12T02:07:23.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.695+0000 7f79b7fff640 1 -- 172.21.15.19:0/2650119634 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c4019070 con 0x7f79d009b690 2024-09-12T02:07:23.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.695+0000 7f79b7fff640 1 -- 172.21.15.19:0/2650119634 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c400ba00 con 0x7f79d009b690 2024-09-12T02:07:23.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.695+0000 7f79d61e8640 1 -- 172.21.15.19:0/2650119634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d00b55c0 con 0x7f79d009b690 2024-09-12T02:07:23.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.695+0000 7f79d61e8640 1 -- 172.21.15.19:0/2650119634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d00b5b80 con 0x7f79d009b690 2024-09-12T02:07:23.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.696+0000 7f79d61e8640 1 -- 172.21.15.19:0/2650119634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d00d0780 con 0x7f79d009b690 2024-09-12T02:07:23.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.697+0000 7f79b7fff640 1 -- 172.21.15.19:0/2650119634 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f79c400bba0 con 0x7f79d009b690 2024-09-12T02:07:23.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.697+0000 7f79b7fff640 1 --2- 172.21.15.19:0/2650119634 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f79bc06be30 0x7f79bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:23.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.697+0000 7f79b7fff640 1 -- 172.21.15.19:0/2650119634 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x7f79c408b3c0 con 0x7f79d009b690 2024-09-12T02:07:23.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.697+0000 7f79cf7fe640 1 --2- 172.21.15.19:0/2650119634 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f79bc06be30 0x7f79bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:23.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.698+0000 7f79cf7fe640 1 --2- 172.21.15.19:0/2650119634 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f79bc06be30 0x7f79bc06e2f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f79c0034000 tx=0x7f79c002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:23.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.701+0000 7f79b7fff640 1 -- 172.21.15.19:0/2650119634 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f79c4059c20 con 0x7f79d009b690 2024-09-12T02:07:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.913+0000 7f79d61e8640 1 -- 172.21.15.19:0/2650119634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79d00d1cb0 con 0x7f79d009b690 2024-09-12T02:07:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.914+0000 7f79b7fff640 1 -- 172.21.15.19:0/2650119634 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 337 v337) ==== 95+0+5242 (secure 0 0 0) 0x7f79c4059520 con 0x7f79d009b690 2024-09-12T02:07:23.915 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:23.915 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":337,"btime":"2024-09-12T02:07:23:057360+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2607300298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2607300298},{"type":"v1","addr":"172.21.15.135:6836","nonce":2607300298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":9283,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/818911002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":818911002},{"type":"v1","addr":"172.21.15.135:6837","nonce":818911002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":10650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3527496552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3527496552},{"type":"v1","addr":"172.21.15.19:6834","nonce":3527496552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327}],"filesystems":[{"mdsmap":{"epoch":337,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:07:05.517761+0000","modified":"2024-09-12T02:07:23.057352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":146,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10836":{"gid":10836,"name":"a","rank":0,"incarnation":334,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/3413662523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3413662523},{"type":"v1","addr":"172.21.15.19:6835","nonce":3413662523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10836,"qdb_cluster":[10836]},"id":7}]} 2024-09-12T02:07:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 337 2024-09-12T02:07:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.916+0000 7f79d61e8640 1 -- 172.21.15.19:0/2650119634 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f79bc06be30 msgr2=0x7f79bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.916+0000 7f79d61e8640 1 --2- 172.21.15.19:0/2650119634 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f79bc06be30 0x7f79bc06e2f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f79c0034000 tx=0x7f79c002e000 comp rx=0 tx=0).stop 2024-09-12T02:07:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.916+0000 7f79d61e8640 1 -- 172.21.15.19:0/2650119634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79d009b690 msgr2=0x7f79d00b6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.916+0000 7f79d61e8640 1 --2- 172.21.15.19:0/2650119634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79d009b690 0x7f79d00b6d20 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7f79c400d620 tx=0x7f79c400dae0 comp rx=0 tx=0).stop 2024-09-12T02:07:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.916+0000 7f79d61e8640 1 -- 172.21.15.19:0/2650119634 shutdown_connections 2024-09-12T02:07:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.916+0000 7f79d61e8640 1 --2- 172.21.15.19:0/2650119634 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f79bc06be30 0x7f79bc06e2f0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.916+0000 7f79d61e8640 1 --2- 172.21.15.19:0/2650119634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79d015e740 0x7f79d015c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.916+0000 7f79d61e8640 1 --2- 172.21.15.19:0/2650119634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79d009b690 0x7f79d00b6d20 unknown :-1 s=CLOSED pgs=2308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.916+0000 7f79d61e8640 1 --2- 172.21.15.19:0/2650119634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79d006d4c0 0x7f79d0157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.916+0000 7f79d61e8640 1 -- 172.21.15.19:0/2650119634 >> 172.21.15.19:0/2650119634 conn(0x7f79d00d23a0 msgr2=0x7f79d0070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.916+0000 7f79d61e8640 1 -- 172.21.15.19:0/2650119634 shutdown_connections 2024-09-12T02:07:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:23.916+0000 7f79d61e8640 1 -- 172.21.15.19:0/2650119634 wait complete. 2024-09-12T02:07:24.332 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 337, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:07:05.517761+0000', 'modified': '2024-09-12T02:07:23.057352+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 146, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10836}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10836': {'gid': 10836, 'name': 'a', 'rank': 0, 'incarnation': 334, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.19:6835/3413662523', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6833', 'nonce': 3413662523}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 3413662523}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10836, 'qdb_cluster': [10836]} 2024-09-12T02:07:24.333 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:07:24.333 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T02:07:24.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.450+0000 7f6b1e92c640 1 Processor -- start 2024-09-12T02:07:24.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.450+0000 7f6b1e92c640 1 -- start start 2024-09-12T02:07:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.451+0000 7f6b1e92c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b1815b300 0x7f6b180cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.451+0000 7f6b1e92c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6b180cd3f0 0x7f6b1806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.451+0000 7f6b1e92c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b180cdbe0 con 0x7f6b18072d30 2024-09-12T02:07:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.451+0000 7f6b1e92c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f6b180728a0 con 0x7f6b1815b300 2024-09-12T02:07:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.451+0000 7f6b1e92c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6b180cd900 con 0x7f6b180cd3f0 2024-09-12T02:07:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.451+0000 7f6b17fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b1815b300 0x7f6b180cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.451+0000 7f6b1cec9640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6b18072d30 0x7f6b180b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59068/0 (socket says 172.21.15.19:59068) 2024-09-12T02:07:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.451+0000 7f6b1cec9640 1 -- 172.21.15.19:0/1659751589 learned_addr learned my addr 172.21.15.19:0/1659751589 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.451+0000 7f6b17fff640 1 -- 172.21.15.19:0/1659751589 >> v2:172.21.15.135:3300/0 conn(0x7f6b180cd3f0 msgr2=0x7f6b1806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.451+0000 7f6b177fe640 1 --2- 172.21.15.19:0/1659751589 >> v2:172.21.15.135:3300/0 conn(0x7f6b180cd3f0 0x7f6b1806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.451+0000 7f6b16ffd640 1 -- 172.21.15.19:0/1659751589 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3628415174 0 0) 0x7f6b180cdbe0 con 0x7f6b18072d30 2024-09-12T02:07:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.451+0000 7f6b17fff640 1 --2- 172.21.15.19:0/1659751589 >> v2:172.21.15.135:3300/0 conn(0x7f6b180cd3f0 0x7f6b1806f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.451+0000 7f6b17fff640 1 -- 172.21.15.19:0/1659751589 >> v1:172.21.15.19:6789/0 conn(0x7f6b18072d30 legacy=0x7f6b180b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.451+0000 7f6b17fff640 1 -- 172.21.15.19:0/1659751589 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b18072250 con 0x7f6b1815b300 2024-09-12T02:07:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.451+0000 7f6b177fe640 1 --2- 172.21.15.19:0/1659751589 >> v2:172.21.15.135:3300/0 conn(0x7f6b180cd3f0 0x7f6b1806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.452+0000 7f6b17fff640 1 --2- 172.21.15.19:0/1659751589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b1815b300 0x7f6b180cceb0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f6b180b57c0 tx=0x7f6b0802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc5c4376e96e493 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.452+0000 7f6b16ffd640 1 -- 172.21.15.19:0/1659751589 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08037070 con 0x7f6b1815b300 2024-09-12T02:07:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.452+0000 7f6b16ffd640 1 -- 172.21.15.19:0/1659751589 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b08032440 con 0x7f6b1815b300 2024-09-12T02:07:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.452+0000 7f6b16ffd640 1 -- 172.21.15.19:0/1659751589 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08032810 con 0x7f6b1815b300 2024-09-12T02:07:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.453+0000 7f6b1e92c640 1 -- 172.21.15.19:0/1659751589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b1815b300 msgr2=0x7f6b180cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.453+0000 7f6b1e92c640 1 --2- 172.21.15.19:0/1659751589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b1815b300 0x7f6b180cceb0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f6b180b57c0 tx=0x7f6b0802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.453+0000 7f6b1e92c640 1 -- 172.21.15.19:0/1659751589 shutdown_connections 2024-09-12T02:07:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.453+0000 7f6b1e92c640 1 --2- 172.21.15.19:0/1659751589 >> v2:172.21.15.135:3300/0 conn(0x7f6b180cd3f0 0x7f6b1806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.453+0000 7f6b1e92c640 1 --2- 172.21.15.19:0/1659751589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b1815b300 0x7f6b180cceb0 unknown :-1 s=CLOSED pgs=2310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.453+0000 7f6b1e92c640 1 -- 172.21.15.19:0/1659751589 >> 172.21.15.19:0/1659751589 conn(0x7f6b18067d70 msgr2=0x7f6b1806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.453+0000 7f6b1e92c640 1 -- 172.21.15.19:0/1659751589 shutdown_connections 2024-09-12T02:07:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.453+0000 7f6b1e92c640 1 -- 172.21.15.19:0/1659751589 wait complete. 2024-09-12T02:07:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.454+0000 7f6b1e92c640 1 Processor -- start 2024-09-12T02:07:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.454+0000 7f6b1e92c640 1 -- start start 2024-09-12T02:07:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.455+0000 7f6b1e92c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b18072d30 0x7f6b180b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.455+0000 7f6b1e92c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b180cd3f0 0x7f6b1814df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.455+0000 7f6b1e92c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b1815b300 0x7f6b1814e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.455+0000 7f6b1e92c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6b180d0160 con 0x7f6b1815b300 2024-09-12T02:07:24.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.455+0000 7f6b1e92c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b180cffe0 con 0x7f6b18072d30 2024-09-12T02:07:24.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.455+0000 7f6b1e92c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6b1806f700 con 0x7f6b180cd3f0 2024-09-12T02:07:24.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.455+0000 7f6b1cec9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b1815b300 0x7f6b1814e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.455+0000 7f6b1cec9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b1815b300 0x7f6b1814e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38112/0 (socket says 172.21.15.19:38112) 2024-09-12T02:07:24.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.455+0000 7f6b1cec9640 1 -- 172.21.15.19:0/745593834 learned_addr learned my addr 172.21.15.19:0/745593834 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:24.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.455+0000 7f6b17fff640 1 --2- 172.21.15.19:0/745593834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b18072d30 0x7f6b180b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.455+0000 7f6b177fe640 1 --2- 172.21.15.19:0/745593834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b180cd3f0 0x7f6b1814df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.456+0000 7f6b1cec9640 1 -- 172.21.15.19:0/745593834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b180cd3f0 msgr2=0x7f6b1814df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:24.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.456+0000 7f6b1cec9640 1 --2- 172.21.15.19:0/745593834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b180cd3f0 0x7f6b1814df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.456+0000 7f6b1cec9640 1 -- 172.21.15.19:0/745593834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b18072d30 msgr2=0x7f6b180b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:24.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.456+0000 7f6b1cec9640 1 --2- 172.21.15.19:0/745593834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b18072d30 0x7f6b180b2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.456+0000 7f6b1cec9640 1 -- 172.21.15.19:0/745593834 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b1814edc0 con 0x7f6b1815b300 2024-09-12T02:07:24.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.456+0000 7f6b1cec9640 1 --2- 172.21.15.19:0/745593834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b1815b300 0x7f6b1814e480 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c7a0 tx=0x7f6b1000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:24.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.456+0000 7f6b14ff9640 1 -- 172.21.15.19:0/745593834 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b10018070 con 0x7f6b1815b300 2024-09-12T02:07:24.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.456+0000 7f6b14ff9640 1 -- 172.21.15.19:0/745593834 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b1000a640 con 0x7f6b1815b300 2024-09-12T02:07:24.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.456+0000 7f6b14ff9640 1 -- 172.21.15.19:0/745593834 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1000aab0 con 0x7f6b1815b300 2024-09-12T02:07:24.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.456+0000 7f6b1e92c640 1 -- 172.21.15.19:0/745593834 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b1814eae0 con 0x7f6b1815b300 2024-09-12T02:07:24.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.456+0000 7f6b1e92c640 1 -- 172.21.15.19:0/745593834 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b18146440 con 0x7f6b1815b300 2024-09-12T02:07:24.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.458+0000 7f6b14ff9640 1 -- 172.21.15.19:0/745593834 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b1000ac50 con 0x7f6b1815b300 2024-09-12T02:07:24.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.458+0000 7f6b14ff9640 1 --2- 172.21.15.19:0/745593834 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b0406be30 0x7f6b0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.458+0000 7f6b14ff9640 1 -- 172.21.15.19:0/745593834 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x7f6b1008a590 con 0x7f6b1815b300 2024-09-12T02:07:24.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.458+0000 7f6b17fff640 1 --2- 172.21.15.19:0/745593834 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b0406be30 0x7f6b0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.459+0000 7f6b17fff640 1 --2- 172.21.15.19:0/745593834 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b0406be30 0x7f6b0406e2f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f6b08034000 tx=0x7f6b0802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:24.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.459+0000 7f6b216bd740 1 Processor -- start 2024-09-12T02:07:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.459+0000 7f6b216bd740 1 -- start start 2024-09-12T02:07:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.460+0000 7f6b216bd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc64a2c0 0x55adbc68fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.460+0000 7f6b216bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc647a80 0x55adbc64a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.460+0000 7f6b216bd740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc64ba50 0x55adbc6448b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.460+0000 7f6b216bd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55adbc5ac520 con 0x55adbc64a2c0 2024-09-12T02:07:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.460+0000 7f6b216bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55adbc5543e0 con 0x55adbc647a80 2024-09-12T02:07:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.460+0000 7f6b216bd740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55adbc5a84e0 con 0x55adbc64ba50 2024-09-12T02:07:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.460+0000 7f6b17fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc64a2c0 0x55adbc68fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.460+0000 7f6b17fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc64a2c0 0x55adbc68fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38124/0 (socket says 172.21.15.19:38124) 2024-09-12T02:07:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.460+0000 7f6b17fff640 1 -- 172.21.15.19:0/2850169189 learned_addr learned my addr 172.21.15.19:0/2850169189 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.460+0000 7f6b177fe640 1 --2- 172.21.15.19:0/2850169189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc647a80 0x55adbc64a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.460+0000 7f6b1cec9640 1 --2- 172.21.15.19:0/2850169189 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc64ba50 0x55adbc6448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.460+0000 7f6b17fff640 1 -- 172.21.15.19:0/2850169189 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc64ba50 msgr2=0x55adbc6448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.460+0000 7f6b17fff640 1 --2- 172.21.15.19:0/2850169189 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc64ba50 0x55adbc6448b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.460+0000 7f6b17fff640 1 -- 172.21.15.19:0/2850169189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc647a80 msgr2=0x55adbc64a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.460+0000 7f6b17fff640 1 --2- 172.21.15.19:0/2850169189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc647a80 0x55adbc64a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.460+0000 7f6b17fff640 1 -- 172.21.15.19:0/2850169189 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adbc56f2f0 con 0x55adbc64a2c0 2024-09-12T02:07:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.461+0000 7f6b17fff640 1 --2- 172.21.15.19:0/2850169189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc64a2c0 0x55adbc68fa60 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f6b0802a790 tx=0x7f6b0802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f352c0d5aea5820 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.461+0000 7f6afdffb640 1 -- 172.21.15.19:0/2850169189 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0804b070 con 0x55adbc64a2c0 2024-09-12T02:07:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.461+0000 7f6afdffb640 1 -- 172.21.15.19:0/2850169189 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b08038040 con 0x55adbc64a2c0 2024-09-12T02:07:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.461+0000 7f6afdffb640 1 -- 172.21.15.19:0/2850169189 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08041040 con 0x55adbc64a2c0 2024-09-12T02:07:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.461+0000 7f6b216bd740 1 -- 172.21.15.19:0/2850169189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc64a2c0 msgr2=0x55adbc68fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.461+0000 7f6b216bd740 1 --2- 172.21.15.19:0/2850169189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc64a2c0 0x55adbc68fa60 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f6b0802a790 tx=0x7f6b0802c000 comp rx=0 tx=0).stop 2024-09-12T02:07:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.461+0000 7f6b216bd740 1 -- 172.21.15.19:0/2850169189 shutdown_connections 2024-09-12T02:07:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.461+0000 7f6b216bd740 1 --2- 172.21.15.19:0/2850169189 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc64ba50 0x55adbc6448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.461+0000 7f6b216bd740 1 --2- 172.21.15.19:0/2850169189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc647a80 0x55adbc64a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.461+0000 7f6b216bd740 1 --2- 172.21.15.19:0/2850169189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc64a2c0 0x55adbc68fa60 unknown :-1 s=CLOSED pgs=2312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.461+0000 7f6b216bd740 1 -- 172.21.15.19:0/2850169189 >> 172.21.15.19:0/2850169189 conn(0x55adbc646a80 msgr2=0x55adbc68ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:24.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.462+0000 7f6b216bd740 1 -- 172.21.15.19:0/2850169189 shutdown_connections 2024-09-12T02:07:24.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.462+0000 7f6b216bd740 1 -- 172.21.15.19:0/2850169189 wait complete. 2024-09-12T02:07:24.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.462+0000 7f6b216bd740 1 -- start start 2024-09-12T02:07:24.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.462+0000 7f6b216bd740 1 Processor -- start 2024-09-12T02:07:24.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.463+0000 7f6b216bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc64a2c0 0x55adbc645280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.463+0000 7f6b216bd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc64ba50 0x55adbc6443e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.463+0000 7f6b216bd740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc66b560 0x55adbc6488c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.463+0000 7f6b216bd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55adbc645f20 con 0x55adbc64ba50 2024-09-12T02:07:24.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.463+0000 7f6b216bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55adbc535450 con 0x55adbc64a2c0 2024-09-12T02:07:24.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.463+0000 7f6b216bd740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55adbc690290 con 0x55adbc66b560 2024-09-12T02:07:24.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.463+0000 7f6b216bd740 10 client.0 _ll_register_callbacks cb 0x55adbc2beac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:24.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.463+0000 7f6b177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc64ba50 0x55adbc6443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.463+0000 7f6b177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc64ba50 0x55adbc6443e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38126/0 (socket says 172.21.15.19:38126) 2024-09-12T02:07:24.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.463+0000 7f6b177fe640 1 -- 172.21.15.19:0/3831560482 learned_addr learned my addr 172.21.15.19:0/3831560482 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:24.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.463+0000 7f6b1cec9640 1 --2- 172.21.15.19:0/3831560482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc66b560 0x55adbc6488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.463+0000 7f6b17fff640 1 --2- 172.21.15.19:0/3831560482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc64a2c0 0x55adbc645280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6b177fe640 1 -- 172.21.15.19:0/3831560482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc66b560 msgr2=0x55adbc6488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:24.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6b177fe640 1 --2- 172.21.15.19:0/3831560482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc66b560 0x55adbc6488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6b177fe640 1 -- 172.21.15.19:0/3831560482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc64a2c0 msgr2=0x55adbc645280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:24.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6b177fe640 1 --2- 172.21.15.19:0/3831560482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc64a2c0 0x55adbc645280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6b177fe640 1 -- 172.21.15.19:0/3831560482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adbc2bf2d0 con 0x55adbc64ba50 2024-09-12T02:07:24.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6b1cec9640 1 --2- 172.21.15.19:0/3831560482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc66b560 0x55adbc6488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:24.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6b177fe640 1 --2- 172.21.15.19:0/3831560482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc64ba50 0x55adbc6443e0 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c0122d0 tx=0x7f6b0c012790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35203730578e7f50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:24.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6af6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:07:24.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6af6ffd640 1 -- 172.21.15.19:0/3831560482 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c01a070 con 0x55adbc64ba50 2024-09-12T02:07:24.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6af6ffd640 1 -- 172.21.15.19:0/3831560482 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x7f6b0c004240 con 0x55adbc64ba50 2024-09-12T02:07:24.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6b216bd740 1 -- 172.21.15.19:0/3831560482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b08038040 con 0x55adbc64ba50 2024-09-12T02:07:24.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6af6ffd640 1 -- 172.21.15.19:0/3831560482 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=337) ==== 24+0+0 (secure 0 0 0) 0x7f6b0c025050 con 0x55adbc64ba50 2024-09-12T02:07:24.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6b216bd740 10 client.10899 fetch_fsmap learned FSMap version 337 2024-09-12T02:07:24.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6b216bd740 1 -- 172.21.15.19:0/3831560482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=337,monmap=2+}) -- 0x55adbc3896b0 con 0x55adbc64ba50 2024-09-12T02:07:24.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6af6ffd640 1 -- 172.21.15.19:0/3831560482 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b08038040 con 0x55adbc64ba50 2024-09-12T02:07:24.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6af6ffd640 1 -- 172.21.15.19:0/3831560482 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 337) ==== 3502+0+0 (secure 0 0 0) 0x7f6b0c028020 con 0x55adbc64ba50 2024-09-12T02:07:24.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6b216bd740 10 client.10899 fetch_fsmap finished waiting for FSMap version 337 2024-09-12T02:07:24.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6b216bd740 10 client.10899 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:07:24.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6b216bd740 20 client.10899 populate_metadata read hostname 'smithi019' 2024-09-12T02:07:24.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6b216bd740 1 --2- 172.21.15.19:0/3831560482 >> [v2:172.21.15.19:6833/3413662523,v1:172.21.15.19:6835/3413662523] conn(0x55adbc6a2910 0x55adbc6698c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6b216bd740 4 client.10899 mds_command: new command op to 10836 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:07:24.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.464+0000 7f6b216bd740 1 -- 172.21.15.19:0/3831560482 --> [v2:172.21.15.19:6833/3413662523,v1:172.21.15.19:6835/3413662523] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55adbc5b9c50 con 0x55adbc6a2910 2024-09-12T02:07:24.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.465+0000 7f6b17fff640 1 --2- 172.21.15.19:0/3831560482 >> [v2:172.21.15.19:6833/3413662523,v1:172.21.15.19:6835/3413662523] conn(0x55adbc6a2910 0x55adbc6698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.465+0000 7f6b17fff640 1 --2- 172.21.15.19:0/3831560482 >> [v2:172.21.15.19:6833/3413662523,v1:172.21.15.19:6835/3413662523] conn(0x55adbc6a2910 0x55adbc6698c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d52eb4c68608958 server_cookie=7cb95517e41fa91e in_seq=0 out_seq=0 2024-09-12T02:07:24.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.465+0000 7f6af6ffd640 10 client.10899 ms_handle_connect on v2:172.21.15.19:6833/3413662523 2024-09-12T02:07:24.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.466+0000 7f6af6ffd640 1 -- 172.21.15.19:0/3831560482 <== mds.0 v2:172.21.15.19:6833/3413662523 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55adbc5b9c50 con 0x55adbc6a2910 2024-09-12T02:07:24.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.466+0000 7f6af6ffd640 10 client.10899 handle_command_reply: tid=0 2024-09-12T02:07:24.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.466+0000 7f6b216bd740 1 client.10899 shutdown 2024-09-12T02:07:24.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.466+0000 7f6b216bd740 1 -- 172.21.15.19:0/3831560482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc64ba50 msgr2=0x55adbc6443e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:24.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.466+0000 7f6b216bd740 1 --2- 172.21.15.19:0/3831560482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc64ba50 0x55adbc6443e0 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c0122d0 tx=0x7f6b0c012790 comp rx=0 tx=0).stop 2024-09-12T02:07:24.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.466+0000 7f6b216bd740 1 -- 172.21.15.19:0/3831560482 shutdown_connections 2024-09-12T02:07:24.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.466+0000 7f6b216bd740 1 --2- 172.21.15.19:0/3831560482 >> [v2:172.21.15.19:6833/3413662523,v1:172.21.15.19:6835/3413662523] conn(0x55adbc6a2910 0x55adbc6698c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.466+0000 7f6b216bd740 1 --2- 172.21.15.19:0/3831560482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc66b560 0x55adbc6488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.466+0000 7f6b216bd740 1 --2- 172.21.15.19:0/3831560482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc64ba50 0x55adbc6443e0 unknown :-1 s=CLOSED pgs=2313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.466+0000 7f6b216bd740 1 --2- 172.21.15.19:0/3831560482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc64a2c0 0x55adbc645280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.466+0000 7f6af6ffd640 0 client.10899 ms_handle_reset on v2:172.21.15.19:6833/3413662523 2024-09-12T02:07:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.466+0000 7f6b216bd740 1 -- 172.21.15.19:0/3831560482 >> 172.21.15.19:0/3831560482 conn(0x55adbc647a80 msgr2=0x55adbc66ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.466+0000 7f6b216bd740 1 -- 172.21.15.19:0/3831560482 shutdown_connections 2024-09-12T02:07:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.466+0000 7f6b216bd740 1 -- 172.21.15.19:0/3831560482 wait complete. 2024-09-12T02:07:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.466+0000 7f6b216bd740 20 client.10899 trim_cache size 0 max 16384 2024-09-12T02:07:24.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.484+0000 7f6b216bd740 1 Processor -- start 2024-09-12T02:07:24.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.484+0000 7f6b216bd740 1 -- start start 2024-09-12T02:07:24.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.485+0000 7f6b216bd740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc64a2c0 0x55adbc668220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.485+0000 7f6b216bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc64ba50 0x55adbc668ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.485+0000 7f6b216bd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc66b560 0x55adbc64a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.485+0000 7f6b216bd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6b181fffa0 con 0x55adbc66b560 2024-09-12T02:07:24.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.485+0000 7f6b216bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b18147550 con 0x55adbc64ba50 2024-09-12T02:07:24.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.485+0000 7f6b216bd740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6b18147ba0 con 0x55adbc64a2c0 2024-09-12T02:07:24.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.485+0000 7f6b1cec9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc66b560 0x55adbc64a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.485+0000 7f6b1cec9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc66b560 0x55adbc64a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38130/0 (socket says 172.21.15.19:38130) 2024-09-12T02:07:24.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.485+0000 7f6b1cec9640 1 -- 172.21.15.19:0/953703819 learned_addr learned my addr 172.21.15.19:0/953703819 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:24.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.485+0000 7f6b1cec9640 1 -- 172.21.15.19:0/953703819 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc64a2c0 msgr2=0x55adbc668220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:24.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.485+0000 7f6b1cec9640 1 --2- 172.21.15.19:0/953703819 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc64a2c0 0x55adbc668220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.485+0000 7f6b1cec9640 1 -- 172.21.15.19:0/953703819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc64ba50 msgr2=0x55adbc668ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:24.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.485+0000 7f6b1cec9640 1 --2- 172.21.15.19:0/953703819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc64ba50 0x55adbc668ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.485+0000 7f6b1cec9640 1 -- 172.21.15.19:0/953703819 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adbc6463d0 con 0x55adbc66b560 2024-09-12T02:07:24.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.485+0000 7f6b1cec9640 1 --2- 172.21.15.19:0/953703819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc66b560 0x55adbc64a6a0 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f6b10088970 tx=0x7f6b10009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98ac6d585df7550 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:24.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.486+0000 7f6afd7fa640 1 -- 172.21.15.19:0/953703819 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b100612d0 con 0x55adbc66b560 2024-09-12T02:07:24.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.486+0000 7f6afd7fa640 1 -- 172.21.15.19:0/953703819 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b10056aa0 con 0x55adbc66b560 2024-09-12T02:07:24.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.486+0000 7f6afd7fa640 1 -- 172.21.15.19:0/953703819 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b10060e40 con 0x55adbc66b560 2024-09-12T02:07:24.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.486+0000 7f6b216bd740 1 -- 172.21.15.19:0/953703819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc66b560 msgr2=0x55adbc64a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:24.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.486+0000 7f6b216bd740 1 --2- 172.21.15.19:0/953703819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc66b560 0x55adbc64a6a0 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f6b10088970 tx=0x7f6b10009040 comp rx=0 tx=0).stop 2024-09-12T02:07:24.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.486+0000 7f6b216bd740 1 -- 172.21.15.19:0/953703819 shutdown_connections 2024-09-12T02:07:24.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.486+0000 7f6b216bd740 1 --2- 172.21.15.19:0/953703819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc66b560 0x55adbc64a6a0 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.486+0000 7f6b216bd740 1 --2- 172.21.15.19:0/953703819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc64ba50 0x55adbc668ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.486+0000 7f6b216bd740 1 --2- 172.21.15.19:0/953703819 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc64a2c0 0x55adbc668220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.486+0000 7f6b216bd740 1 -- 172.21.15.19:0/953703819 >> 172.21.15.19:0/953703819 conn(0x55adbc647a80 msgr2=0x55adbc643fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:24.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.486+0000 7f6b216bd740 1 -- 172.21.15.19:0/953703819 shutdown_connections 2024-09-12T02:07:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.486+0000 7f6b216bd740 1 -- 172.21.15.19:0/953703819 wait complete. 2024-09-12T02:07:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.487+0000 7f6b216bd740 1 -- start start 2024-09-12T02:07:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.487+0000 7f6b216bd740 1 Processor -- start 2024-09-12T02:07:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b216bd740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc64a2c0 0x55adbc68e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b216bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc64ba50 0x55adbc7109c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b216bd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc66b560 0x55adbc69d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b216bd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55adbc6a2790 con 0x55adbc66b560 2024-09-12T02:07:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b216bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55adbc69f970 con 0x55adbc64ba50 2024-09-12T02:07:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b216bd740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55adbc6a2d80 con 0x55adbc64a2c0 2024-09-12T02:07:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b216bd740 10 client.0 _ll_register_callbacks cb 0x7f6b0c00d540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b1cec9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc66b560 0x55adbc69d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b1cec9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc66b560 0x55adbc69d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38134/0 (socket says 172.21.15.19:38134) 2024-09-12T02:07:24.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b1cec9640 1 -- 172.21.15.19:0/4033136284 learned_addr learned my addr 172.21.15.19:0/4033136284 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b177fe640 1 --2- 172.21.15.19:0/4033136284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc64ba50 0x55adbc7109c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b17fff640 1 --2- 172.21.15.19:0/4033136284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc64a2c0 0x55adbc68e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b1cec9640 1 -- 172.21.15.19:0/4033136284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc64a2c0 msgr2=0x55adbc68e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b1cec9640 1 --2- 172.21.15.19:0/4033136284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc64a2c0 0x55adbc68e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b1cec9640 1 -- 172.21.15.19:0/4033136284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc64ba50 msgr2=0x55adbc7109c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b1cec9640 1 --2- 172.21.15.19:0/4033136284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc64ba50 0x55adbc7109c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b1cec9640 1 -- 172.21.15.19:0/4033136284 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adbc69db30 con 0x55adbc66b560 2024-09-12T02:07:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b177fe640 1 --2- 172.21.15.19:0/4033136284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc64ba50 0x55adbc7109c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6b1cec9640 1 --2- 172.21.15.19:0/4033136284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc66b560 0x55adbc69d5f0 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f6b100889c0 tx=0x7f6b10001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743e230ce5e7883d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6af6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-12T02:07:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.488+0000 7f6af6ffd640 1 -- 172.21.15.19:0/4033136284 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1006cb80 con 0x55adbc66b560 2024-09-12T02:07:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.489+0000 7f6af6ffd640 1 -- 172.21.15.19:0/4033136284 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x7f6b1006cd20 con 0x55adbc66b560 2024-09-12T02:07:24.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.489+0000 7f6b216bd740 1 -- 172.21.15.19:0/4033136284 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b10056aa0 con 0x55adbc66b560 2024-09-12T02:07:24.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.489+0000 7f6af6ffd640 1 -- 172.21.15.19:0/4033136284 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=337) ==== 24+0+0 (secure 0 0 0) 0x7f6b10057bf0 con 0x55adbc66b560 2024-09-12T02:07:24.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.489+0000 7f6b216bd740 10 client.10905 fetch_fsmap learned FSMap version 337 2024-09-12T02:07:24.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.489+0000 7f6b216bd740 1 -- 172.21.15.19:0/4033136284 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=337,monmap=2+}) -- 0x55adbc69e670 con 0x55adbc66b560 2024-09-12T02:07:24.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.489+0000 7f6af6ffd640 1 -- 172.21.15.19:0/4033136284 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b10056aa0 con 0x55adbc66b560 2024-09-12T02:07:24.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.489+0000 7f6af6ffd640 1 -- 172.21.15.19:0/4033136284 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 337) ==== 3502+0+0 (secure 0 0 0) 0x7f6b10057d90 con 0x55adbc66b560 2024-09-12T02:07:24.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.489+0000 7f6b216bd740 10 client.10905 fetch_fsmap finished waiting for FSMap version 337 2024-09-12T02:07:24.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.489+0000 7f6b216bd740 10 client.10905 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:07:24.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.489+0000 7f6b216bd740 20 client.10905 populate_metadata read hostname 'smithi019' 2024-09-12T02:07:24.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.489+0000 7f6b216bd740 1 --2- 172.21.15.19:0/4033136284 >> [v2:172.21.15.19:6833/3413662523,v1:172.21.15.19:6835/3413662523] conn(0x55adbc644950 0x55adbc6b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.489+0000 7f6b216bd740 4 client.10905 mds_command: new command op to 10836 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:07:24.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.489+0000 7f6b216bd740 1 -- 172.21.15.19:0/4033136284 --> [v2:172.21.15.19:6833/3413662523,v1:172.21.15.19:6835/3413662523] -- command(tid 0: {"prefix": "status"}) -- 0x55adbc5b3fa0 con 0x55adbc644950 2024-09-12T02:07:24.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.489+0000 7f6b17fff640 1 --2- 172.21.15.19:0/4033136284 >> [v2:172.21.15.19:6833/3413662523,v1:172.21.15.19:6835/3413662523] conn(0x55adbc644950 0x55adbc6b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.489+0000 7f6b17fff640 1 --2- 172.21.15.19:0/4033136284 >> [v2:172.21.15.19:6833/3413662523,v1:172.21.15.19:6835/3413662523] conn(0x55adbc644950 0x55adbc6b1c40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb9474dcb0bab314 server_cookie=22766aae0ed286f2 in_seq=0 out_seq=0 2024-09-12T02:07:24.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.489+0000 7f6af6ffd640 10 client.10905 ms_handle_connect on v2:172.21.15.19:6833/3413662523 2024-09-12T02:07:24.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6af6ffd640 1 -- 172.21.15.19:0/4033136284 <== mds.0 v2:172.21.15.19:6833/3413662523 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x55adbc5b3fa0 con 0x55adbc644950 2024-09-12T02:07:24.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6af6ffd640 10 client.10905 handle_command_reply: tid=0 2024-09-12T02:07:24.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6b216bd740 1 client.10905 shutdown 2024-09-12T02:07:24.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6b216bd740 1 -- 172.21.15.19:0/4033136284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc66b560 msgr2=0x55adbc69d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:24.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6b216bd740 1 --2- 172.21.15.19:0/4033136284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc66b560 0x55adbc69d5f0 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f6b100889c0 tx=0x7f6b10001250 comp rx=0 tx=0).stop 2024-09-12T02:07:24.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6b216bd740 1 -- 172.21.15.19:0/4033136284 shutdown_connections 2024-09-12T02:07:24.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6b216bd740 1 --2- 172.21.15.19:0/4033136284 >> [v2:172.21.15.19:6833/3413662523,v1:172.21.15.19:6835/3413662523] conn(0x55adbc644950 0x55adbc6b1c40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6b216bd740 1 --2- 172.21.15.19:0/4033136284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55adbc66b560 0x55adbc69d5f0 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6b216bd740 1 --2- 172.21.15.19:0/4033136284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adbc64ba50 0x55adbc7109c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6b216bd740 1 --2- 172.21.15.19:0/4033136284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55adbc64a2c0 0x55adbc68e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6af6ffd640 0 client.10905 ms_handle_reset on v2:172.21.15.19:6833/3413662523 2024-09-12T02:07:24.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6b216bd740 1 -- 172.21.15.19:0/4033136284 >> 172.21.15.19:0/4033136284 conn(0x55adbc647a80 msgr2=0x55adbc66a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:24.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6b216bd740 1 -- 172.21.15.19:0/4033136284 shutdown_connections 2024-09-12T02:07:24.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6b216bd740 1 -- 172.21.15.19:0/4033136284 wait complete. 2024-09-12T02:07:24.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6b216bd740 20 client.10905 trim_cache size 0 max 16384 2024-09-12T02:07:24.497 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:07:24.497 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "978259a0-e3d5-47df-8e62-5e92f95d9388", 2024-09-12T02:07:24.497 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T02:07:24.498 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 10836, 2024-09-12T02:07:24.498 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T02:07:24.498 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T02:07:24.498 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T02:07:24.498 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 4.4371928860000001, 2024-09-12T02:07:24.498 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 337, 2024-09-12T02:07:24.498 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 146, 2024-09-12T02:07:24.498 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 146, 2024-09-12T02:07:24.498 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 5.4041342500000003 2024-09-12T02:07:24.498 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:07:24.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6b1e92c640 1 -- 172.21.15.19:0/745593834 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b0406be30 msgr2=0x7f6b0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:24.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6b1e92c640 1 --2- 172.21.15.19:0/745593834 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b0406be30 0x7f6b0406e2f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f6b08034000 tx=0x7f6b0802e000 comp rx=0 tx=0).stop 2024-09-12T02:07:24.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6b1e92c640 1 -- 172.21.15.19:0/745593834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b1815b300 msgr2=0x7f6b1814e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:24.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.490+0000 7f6b1e92c640 1 --2- 172.21.15.19:0/745593834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b1815b300 0x7f6b1814e480 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c7a0 tx=0x7f6b1000cc60 comp rx=0 tx=0).stop 2024-09-12T02:07:24.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.491+0000 7f6b1e92c640 1 -- 172.21.15.19:0/745593834 shutdown_connections 2024-09-12T02:07:24.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.491+0000 7f6b1e92c640 1 --2- 172.21.15.19:0/745593834 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6b0406be30 0x7f6b0406e2f0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.491+0000 7f6b1e92c640 1 --2- 172.21.15.19:0/745593834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b1815b300 0x7f6b1814e480 unknown :-1 s=CLOSED pgs=2311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.491+0000 7f6b1e92c640 1 --2- 172.21.15.19:0/745593834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b180cd3f0 0x7f6b1814df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.491+0000 7f6b1e92c640 1 --2- 172.21.15.19:0/745593834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b18072d30 0x7f6b180b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.491+0000 7f6b1e92c640 1 -- 172.21.15.19:0/745593834 >> 172.21.15.19:0/745593834 conn(0x7f6b18067d70 msgr2=0x7f6b18151480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:24.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.491+0000 7f6b1e92c640 1 -- 172.21.15.19:0/745593834 shutdown_connections 2024-09-12T02:07:24.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.491+0000 7f6b1e92c640 1 -- 172.21.15.19:0/745593834 wait complete. 2024-09-12T02:07:24.502 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:07:24.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.609+0000 7f899013b640 1 Processor -- start 2024-09-12T02:07:24.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.609+0000 7f899013b640 1 -- start start 2024-09-12T02:07:24.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.610+0000 7f899013b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8988161c80 0x7f898806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.610+0000 7f899013b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f898806e870 con 0x7f89880b6680 2024-09-12T02:07:24.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.610+0000 7f899013b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f898806d9f0 con 0x7f8988162060 2024-09-12T02:07:24.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.610+0000 7f899013b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f898806dcd0 con 0x7f8988161c80 2024-09-12T02:07:24.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.610+0000 7f898e6d8640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f89880b6680 0x7f89880cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59082/0 (socket says 172.21.15.19:59082) 2024-09-12T02:07:24.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.610+0000 7f898e6d8640 1 -- 172.21.15.19:0/452547046 learned_addr learned my addr 172.21.15.19:0/452547046 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:24.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.610+0000 7f898ded7640 1 --2- 172.21.15.19:0/452547046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8988161c80 0x7f898806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.610+0000 7f898ced5640 1 -- 172.21.15.19:0/452547046 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1038911713 0 0) 0x7f8980001490 con 0x7f89880b6680 2024-09-12T02:07:24.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.610+0000 7f898ced5640 1 -- 172.21.15.19:0/452547046 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8974003520 con 0x7f89880b6680 2024-09-12T02:07:24.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898ced5640 1 -- 172.21.15.19:0/452547046 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3167101026 0 0) 0x7f8974003520 con 0x7f89880b6680 2024-09-12T02:07:24.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898ced5640 1 -- 172.21.15.19:0/452547046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8988161c80 msgr2=0x7f898806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:24.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898ced5640 1 --2- 172.21.15.19:0/452547046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8988161c80 0x7f898806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898ced5640 1 -- 172.21.15.19:0/452547046 >> v1:172.21.15.135:6789/0 conn(0x7f8988162060 legacy=0x7f89880b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:24.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898ced5640 1 -- 172.21.15.19:0/452547046 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898806dfb0 con 0x7f89880b6680 2024-09-12T02:07:24.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898ced5640 1 -- 172.21.15.19:0/452547046 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f8980001bc0 con 0x7f89880b6680 2024-09-12T02:07:24.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898ced5640 1 -- 172.21.15.19:0/452547046 >> v1:172.21.15.19:6789/0 conn(0x7f89880b6680 legacy=0x7f89880cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:24.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898ced5640 1 --2- 172.21.15.19:0/452547046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8988161c80 0x7f89740039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898ced5640 1 --2- 172.21.15.19:0/452547046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8974003f20 0x7f8974004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898ced5640 1 --2- 172.21.15.19:0/452547046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8974004d40 0x7f89740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898ced5640 1 -- 172.21.15.19:0/452547046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f898806dcd0 con 0x7f8974003f20 2024-09-12T02:07:24.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898ced5640 1 -- 172.21.15.19:0/452547046 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f897400ba20 con 0x7f8974004d40 2024-09-12T02:07:24.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898ced5640 1 -- 172.21.15.19:0/452547046 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f897400bc20 con 0x7f8988161c80 2024-09-12T02:07:24.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898d6d6640 1 --2- 172.21.15.19:0/452547046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8974003f20 0x7f8974004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898ded7640 1 --2- 172.21.15.19:0/452547046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8988161c80 0x7f89740039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898e6d8640 1 --2- 172.21.15.19:0/452547046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8974004d40 0x7f89740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898d6d6640 1 -- 172.21.15.19:0/452547046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8988161c80 msgr2=0x7f89740039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:24.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898d6d6640 1 --2- 172.21.15.19:0/452547046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8988161c80 0x7f89740039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898d6d6640 1 -- 172.21.15.19:0/452547046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8974004d40 msgr2=0x7f89740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:24.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898d6d6640 1 --2- 172.21.15.19:0/452547046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8974004d40 0x7f89740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.611+0000 7f898d6d6640 1 -- 172.21.15.19:0/452547046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8974003520 con 0x7f8974003f20 2024-09-12T02:07:24.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.612+0000 7f898d6d6640 1 --2- 172.21.15.19:0/452547046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8974003f20 0x7f8974004800 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f898808e830 tx=0x7f8974005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3b055648cb2b10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:24.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.612+0000 7f898ced5640 1 -- 172.21.15.19:0/452547046 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978037070 con 0x7f8974003f20 2024-09-12T02:07:24.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.612+0000 7f898ced5640 1 -- 172.21.15.19:0/452547046 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f897802aaa0 con 0x7f8974003f20 2024-09-12T02:07:24.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.612+0000 7f898ced5640 1 -- 172.21.15.19:0/452547046 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978001450 con 0x7f8974003f20 2024-09-12T02:07:24.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.612+0000 7f899013b640 1 -- 172.21.15.19:0/452547046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8974003f20 msgr2=0x7f8974004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:24.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.612+0000 7f899013b640 1 --2- 172.21.15.19:0/452547046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8974003f20 0x7f8974004800 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f898808e830 tx=0x7f8974005830 comp rx=0 tx=0).stop 2024-09-12T02:07:24.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.612+0000 7f898e6d8640 1 -- 172.21.15.19:0/452547046 reap_dead start 2024-09-12T02:07:24.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.613+0000 7f899013b640 1 -- 172.21.15.19:0/452547046 shutdown_connections 2024-09-12T02:07:24.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.613+0000 7f899013b640 1 -- 172.21.15.19:0/452547046 >> 172.21.15.19:0/452547046 conn(0x7f89880d44f0 msgr2=0x7f89880d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:24.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.613+0000 7f899013b640 1 -- 172.21.15.19:0/452547046 shutdown_connections 2024-09-12T02:07:24.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.613+0000 7f899013b640 1 -- 172.21.15.19:0/452547046 wait complete. 2024-09-12T02:07:24.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.614+0000 7f899013b640 1 Processor -- start 2024-09-12T02:07:24.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.614+0000 7f899013b640 1 -- start start 2024-09-12T02:07:24.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.614+0000 7f899013b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8974003f20 0x7f89880cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f899013b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f898809fd40 0x7f89881f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f899013b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89881f3f50 0x7f89881f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f899013b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f89880b6b30 con 0x7f898809fd40 2024-09-12T02:07:24.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f899013b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f89880d2aa0 con 0x7f89881f3f50 2024-09-12T02:07:24.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f899013b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f89880b6cb0 con 0x7f8974003f20 2024-09-12T02:07:24.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f898d6d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f898809fd40 0x7f89881f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f898d6d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f898809fd40 0x7f89881f3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38148/0 (socket says 172.21.15.19:38148) 2024-09-12T02:07:24.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f898d6d6640 1 -- 172.21.15.19:0/1981624924 learned_addr learned my addr 172.21.15.19:0/1981624924 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:24.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f898ded7640 1 --2- 172.21.15.19:0/1981624924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8974003f20 0x7f89880cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f898e6d8640 1 --2- 172.21.15.19:0/1981624924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89881f3f50 0x7f89881f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f898d6d6640 1 -- 172.21.15.19:0/1981624924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8974003f20 msgr2=0x7f89880cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:24.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f898d6d6640 1 --2- 172.21.15.19:0/1981624924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8974003f20 0x7f89880cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f898d6d6640 1 -- 172.21.15.19:0/1981624924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89881f3f50 msgr2=0x7f89881f7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:24.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f898d6d6640 1 --2- 172.21.15.19:0/1981624924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89881f3f50 0x7f89881f7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f898d6d6640 1 -- 172.21.15.19:0/1981624924 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898809e1e0 con 0x7f898809fd40 2024-09-12T02:07:24.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f898d6d6640 1 --2- 172.21.15.19:0/1981624924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f898809fd40 0x7f89881f3a10 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f8978001850 tx=0x7f8978001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:24.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f897e7fc640 1 -- 172.21.15.19:0/1981624924 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978037040 con 0x7f898809fd40 2024-09-12T02:07:24.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f897e7fc640 1 -- 172.21.15.19:0/1981624924 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8978042070 con 0x7f898809fd40 2024-09-12T02:07:24.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f899013b640 1 -- 172.21.15.19:0/1981624924 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f898809e480 con 0x7f898809fd40 2024-09-12T02:07:24.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f897e7fc640 1 -- 172.21.15.19:0/1981624924 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978001450 con 0x7f898809fd40 2024-09-12T02:07:24.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.615+0000 7f899013b640 1 -- 172.21.15.19:0/1981624924 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89880cc020 con 0x7f898809fd40 2024-09-12T02:07:24.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.616+0000 7f899013b640 1 -- 172.21.15.19:0/1981624924 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89880cbb70 con 0x7f898809fd40 2024-09-12T02:07:24.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.617+0000 7f897e7fc640 1 -- 172.21.15.19:0/1981624924 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8978007040 con 0x7f898809fd40 2024-09-12T02:07:24.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.617+0000 7f897e7fc640 1 --2- 172.21.15.19:0/1981624924 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f896c06be60 0x7f896c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:24.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.617+0000 7f897e7fc640 1 -- 172.21.15.19:0/1981624924 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x7f89780ab2d0 con 0x7f898809fd40 2024-09-12T02:07:24.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.618+0000 7f898ded7640 1 --2- 172.21.15.19:0/1981624924 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f896c06be60 0x7f896c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:24.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.618+0000 7f898ded7640 1 --2- 172.21.15.19:0/1981624924 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f896c06be60 0x7f896c06e320 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f8984009b00 tx=0x7f8984008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:24.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.621+0000 7f897e7fc640 1 -- 172.21.15.19:0/1981624924 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8978079aa0 con 0x7f898809fd40 2024-09-12T02:07:24.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.832+0000 7f899013b640 1 -- 172.21.15.19:0/1981624924 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f898806e330 con 0x7f898809fd40 2024-09-12T02:07:24.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.832+0000 7f897e7fc640 1 -- 172.21.15.19:0/1981624924 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v337) ==== 53+0+73 (secure 0 0 0) 0x7f89780793a0 con 0x7f898809fd40 2024-09-12T02:07:24.833 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:07:24.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.834+0000 7f899013b640 1 -- 172.21.15.19:0/1981624924 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f896c06be60 msgr2=0x7f896c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:24.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.834+0000 7f899013b640 1 --2- 172.21.15.19:0/1981624924 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f896c06be60 0x7f896c06e320 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f8984009b00 tx=0x7f8984008040 comp rx=0 tx=0).stop 2024-09-12T02:07:24.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.834+0000 7f899013b640 1 -- 172.21.15.19:0/1981624924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f898809fd40 msgr2=0x7f89881f3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:24.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.834+0000 7f899013b640 1 --2- 172.21.15.19:0/1981624924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f898809fd40 0x7f89881f3a10 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f8978001850 tx=0x7f8978001230 comp rx=0 tx=0).stop 2024-09-12T02:07:24.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.834+0000 7f899013b640 1 -- 172.21.15.19:0/1981624924 shutdown_connections 2024-09-12T02:07:24.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.834+0000 7f899013b640 1 --2- 172.21.15.19:0/1981624924 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f896c06be60 0x7f896c06e320 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.834+0000 7f899013b640 1 --2- 172.21.15.19:0/1981624924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89881f3f50 0x7f89881f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.834+0000 7f899013b640 1 --2- 172.21.15.19:0/1981624924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f898809fd40 0x7f89881f3a10 unknown :-1 s=CLOSED pgs=2318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.834+0000 7f899013b640 1 --2- 172.21.15.19:0/1981624924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8974003f20 0x7f89880cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:24.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.834+0000 7f899013b640 1 -- 172.21.15.19:0/1981624924 >> 172.21.15.19:0/1981624924 conn(0x7f89880d44f0 msgr2=0x7f89880b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:24.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.834+0000 7f899013b640 1 -- 172.21.15.19:0/1981624924 shutdown_connections 2024-09-12T02:07:24.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:24.835+0000 7f899013b640 1 -- 172.21.15.19:0/1981624924 wait complete. 2024-09-12T02:07:24.846 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:07:24.846 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:07:24.846 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T02:07:24.846 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:07:24.846 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:07:24.846 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:07:24.846 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:07:24.846 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:07:24.846 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:07:24.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:24.847 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T02:07:24.863 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:07:24.864 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:07:24.864 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:07:24.864 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:07:24.864 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T02:07:24.864 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:07:24.864 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:07:24.864 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:07:24.864 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T02:07:24.865 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:07:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:07:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T02:07:24.865 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:07:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:07:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T02:07:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:07:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42116sec preferred_lft 42116sec 2024-09-12T02:07:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T02:07:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:07:24.865 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:07:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:07:24.866 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T02:07:24.866 INFO:teuthology.orchestra.run.smithi019.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:07:24.866 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff 2024-09-12T02:07:24.866 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:07:24.866 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:07:24.866 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::8a:5fff:feb8:2512/64 scope link 2024-09-12T02:07:24.866 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:07:24.866 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:07:24.866 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 2a:0f:6c:2b:85:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:07:24.867 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::280f:6cff:fe2b:852c/64 scope link 2024-09-12T02:07:24.867 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:07:24.867 INFO:teuthology.orchestra.run.smithi019.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:07:24.867 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:c0:d3:bc:66:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:07:24.867 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::c0:d3ff:febc:66bf/64 scope link 2024-09-12T02:07:24.867 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:07:24.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:24.867 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:07:24.928 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T02:07:24.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:24.931 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T02:07:24.987 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T02:07:24.988 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:07:24.988 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:07:24.988 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:07:24.988 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:07:24.989 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:07:24.989 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T02:07:24.989 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:07:24.989 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:07:24.989 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:07:24.989 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T02:07:25.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:07:25.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:07:25.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:25.118 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T02:07:25.134 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:07:25.134 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:07:25.134 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:07:25.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:25.135 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T02:07:25.200 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:07:25.201 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:07:25.257 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:07:25.257 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:07:25.257 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:07:25.312 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T02:07:25.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:25.313 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:07:25.397 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:07:25.397 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:07:25.397 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:07:25.406 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:07:25.406 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:07:25.406 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:07:25.406 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:07:25.406 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:07:25.415 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T02:07:25.415 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T02:07:25.415 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-12T02:07:25.415 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-12T02:07:25.415 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T02:07:25.415 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-12T02:07:25.415 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-12T02:07:25.415 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=978259a0-e3d5-47df-8e62-5e92f95d9388" will pass to kernel 2024-09-12T02:07:25.416 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:07:25.416 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:07:25.416 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:07:25.416 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:07:25.416 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:07:25.417 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:07:25.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:25.418 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:07:25.443 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:07:25.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:07:25.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:07:25.542 INFO:teuthology.orchestra.run.smithi019.stdout:client9481 2024-09-12T02:07:25.542 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:07:25.542 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:07:25.559 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-12T02:07:25.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.644+0000 7fcf686d2f40 1 Processor -- start 2024-09-12T02:07:25.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.644+0000 7fcf686d2f40 1 -- start start 2024-09-12T02:07:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.644+0000 7fcf686d2f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617726c2f30 0x5617727465b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.644+0000 7fcf686d2f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56177274fd20 0x561772749060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.644+0000 7fcf686d2f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561772750100 0x561772751100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.645+0000 7fcf686d2f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5617726c46b0 con 0x56177274fd20 2024-09-12T02:07:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.645+0000 7fcf686d2f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5617725cc510 con 0x5617726c2f30 2024-09-12T02:07:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.645+0000 7fcf686d2f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x56177267f2d0 con 0x561772750100 2024-09-12T02:07:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.645+0000 7fcf659c7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56177274fd20 0x561772749060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.645+0000 7fcf659c7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56177274fd20 0x561772749060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38154/0 (socket says 172.21.15.19:38154) 2024-09-12T02:07:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.645+0000 7fcf659c7640 1 -- 172.21.15.19:0/4228166899 learned_addr learned my addr 172.21.15.19:0/4228166899 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.645+0000 7fcf669c9640 1 --2- 172.21.15.19:0/4228166899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561772750100 0x561772751100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.645+0000 7fcf661c8640 1 --2- 172.21.15.19:0/4228166899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617726c2f30 0x5617727465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.645+0000 7fcf659c7640 1 -- 172.21.15.19:0/4228166899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561772750100 msgr2=0x561772751100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.645+0000 7fcf659c7640 1 --2- 172.21.15.19:0/4228166899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561772750100 0x561772751100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.645+0000 7fcf659c7640 1 -- 172.21.15.19:0/4228166899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617726c2f30 msgr2=0x5617727465b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.645+0000 7fcf659c7640 1 --2- 172.21.15.19:0/4228166899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617726c2f30 0x5617727465b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.645+0000 7fcf659c7640 1 -- 172.21.15.19:0/4228166899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561772753020 con 0x56177274fd20 2024-09-12T02:07:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.645+0000 7fcf659c7640 1 --2- 172.21.15.19:0/4228166899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56177274fd20 0x561772749060 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7fcf50005cf0 tx=0x7fcf50051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a621e95d641401 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.645+0000 7fcf649c5640 1 -- 172.21.15.19:0/4228166899 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf50056070 con 0x56177274fd20 2024-09-12T02:07:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.645+0000 7fcf649c5640 1 -- 172.21.15.19:0/4228166899 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf50052bb0 con 0x56177274fd20 2024-09-12T02:07:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.645+0000 7fcf649c5640 1 -- 172.21.15.19:0/4228166899 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf50065440 con 0x56177274fd20 2024-09-12T02:07:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.646+0000 7fcf686d2f40 1 -- 172.21.15.19:0/4228166899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56177274fd20 msgr2=0x561772749060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.646+0000 7fcf686d2f40 1 --2- 172.21.15.19:0/4228166899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56177274fd20 0x561772749060 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7fcf50005cf0 tx=0x7fcf50051000 comp rx=0 tx=0).stop 2024-09-12T02:07:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.646+0000 7fcf686d2f40 1 -- 172.21.15.19:0/4228166899 shutdown_connections 2024-09-12T02:07:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.646+0000 7fcf686d2f40 1 --2- 172.21.15.19:0/4228166899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561772750100 0x561772751100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.646+0000 7fcf686d2f40 1 --2- 172.21.15.19:0/4228166899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56177274fd20 0x561772749060 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.646+0000 7fcf686d2f40 1 --2- 172.21.15.19:0/4228166899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617726c2f30 0x5617727465b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.646+0000 7fcf686d2f40 1 -- 172.21.15.19:0/4228166899 >> 172.21.15.19:0/4228166899 conn(0x5617726a8490 msgr2=0x5617726aab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.646+0000 7fcf686d2f40 1 -- 172.21.15.19:0/4228166899 shutdown_connections 2024-09-12T02:07:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.646+0000 7fcf686d2f40 1 -- 172.21.15.19:0/4228166899 wait complete. 2024-09-12T02:07:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.646+0000 7fcf686d2f40 1 Processor -- start 2024-09-12T02:07:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.646+0000 7fcf686d2f40 1 -- start start 2024-09-12T02:07:25.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.647+0000 7fcf686d2f40 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617726c2f30 0x5617726aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:25.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.647+0000 7fcf686d2f40 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56177274fd20 0x561772743330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:25.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.647+0000 7fcf686d2f40 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561772750100 0x561772748030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:25.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.647+0000 7fcf686d2f40 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5617726ab300 con 0x5617726c2f30 2024-09-12T02:07:25.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.647+0000 7fcf686d2f40 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561772753290 con 0x56177274fd20 2024-09-12T02:07:25.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.647+0000 7fcf686d2f40 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x561772746af0 con 0x561772750100 2024-09-12T02:07:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.647+0000 7fcf661c8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617726c2f30 0x5617726aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.647+0000 7fcf661c8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617726c2f30 0x5617726aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38168/0 (socket says 172.21.15.19:38168) 2024-09-12T02:07:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.647+0000 7fcf661c8640 1 -- 172.21.15.19:0/4179015314 learned_addr learned my addr 172.21.15.19:0/4179015314 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.647+0000 7fcf669c9640 1 --2- 172.21.15.19:0/4179015314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561772750100 0x561772748030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.647+0000 7fcf659c7640 1 --2- 172.21.15.19:0/4179015314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56177274fd20 0x561772743330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.647+0000 7fcf661c8640 1 -- 172.21.15.19:0/4179015314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561772750100 msgr2=0x561772748030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.647+0000 7fcf661c8640 1 --2- 172.21.15.19:0/4179015314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561772750100 0x561772748030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.647+0000 7fcf661c8640 1 -- 172.21.15.19:0/4179015314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56177274fd20 msgr2=0x561772743330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.647+0000 7fcf661c8640 1 --2- 172.21.15.19:0/4179015314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56177274fd20 0x561772743330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.647+0000 7fcf661c8640 1 -- 172.21.15.19:0/4179015314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617727ea810 con 0x5617726c2f30 2024-09-12T02:07:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.648+0000 7fcf661c8640 1 --2- 172.21.15.19:0/4179015314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617726c2f30 0x5617726aaa80 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800b480 tx=0x7fcf5800b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.648+0000 7fcf5f7fe640 1 -- 172.21.15.19:0/4179015314 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58016020 con 0x5617726c2f30 2024-09-12T02:07:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.648+0000 7fcf5f7fe640 1 -- 172.21.15.19:0/4179015314 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf58012660 con 0x5617726c2f30 2024-09-12T02:07:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.648+0000 7fcf686d2f40 1 -- 172.21.15.19:0/4179015314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617727d99f0 con 0x5617726c2f30 2024-09-12T02:07:25.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.648+0000 7fcf5f7fe640 1 -- 172.21.15.19:0/4179015314 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58012810 con 0x5617726c2f30 2024-09-12T02:07:25.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.648+0000 7fcf686d2f40 1 -- 172.21.15.19:0/4179015314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617727d9fb0 con 0x5617726c2f30 2024-09-12T02:07:25.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.649+0000 7fcf5f7fe640 1 -- 172.21.15.19:0/4179015314 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf58019020 con 0x5617726c2f30 2024-09-12T02:07:25.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.650+0000 7fcf5f7fe640 1 --2- 172.21.15.19:0/4179015314 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcf4806a810 0x7fcf4806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:25.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.650+0000 7fcf5f7fe640 1 -- 172.21.15.19:0/4179015314 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x7fcf58089f30 con 0x5617726c2f30 2024-09-12T02:07:25.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.650+0000 7fcf686d2f40 1 --2- 172.21.15.19:0/4179015314 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x561772743a50 0x5617727e8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:25.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.650+0000 7fcf686d2f40 1 -- 172.21.15.19:0/4179015314 --> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] -- osd_op(unknown.0.0:1 16.7 16:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e146) -- 0x5617727e8d70 con 0x561772743a50 2024-09-12T02:07:25.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.650+0000 7fcf659c7640 1 --2- 172.21.15.19:0/4179015314 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcf4806a810 0x7fcf4806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:25.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.650+0000 7fcf669c9640 1 --2- 172.21.15.19:0/4179015314 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x561772743a50 0x5617727e8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:25.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.651+0000 7fcf669c9640 1 --2- 172.21.15.19:0/4179015314 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x561772743a50 0x5617727e8830 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:25.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.651+0000 7fcf659c7640 1 --2- 172.21.15.19:0/4179015314 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcf4806a810 0x7fcf4806ccd0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fcf50062000 tx=0x7fcf50053000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:25.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.651+0000 7fcf669c9640 1 -- 172.21.15.19:0/4179015314 <== osd.3 v2:172.21.15.19:6800/2581301650 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (91) out=91b] v0'0 uv6 ondisk = 0) ==== 164+0+91 (crc 0 0 0) 0x7fcf60010620 con 0x561772743a50 2024-09-12T02:07:25.655 INFO:teuthology.orchestra.run.smithi019.stdout:Ufile1dir1 2024-09-12T02:07:25.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.651+0000 7fcf686d2f40 1 -- 172.21.15.19:0/4179015314 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x561772743a50 msgr2=0x5617727e8830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:25.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.651+0000 7fcf686d2f40 1 --2- 172.21.15.19:0/4179015314 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x561772743a50 0x5617727e8830 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:25.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.651+0000 7fcf686d2f40 1 -- 172.21.15.19:0/4179015314 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcf4806a810 msgr2=0x7fcf4806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:25.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.651+0000 7fcf686d2f40 1 --2- 172.21.15.19:0/4179015314 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fcf4806a810 0x7fcf4806ccd0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fcf50062000 tx=0x7fcf50053000 comp rx=0 tx=0).stop 2024-09-12T02:07:25.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.651+0000 7fcf686d2f40 1 -- 172.21.15.19:0/4179015314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617726c2f30 msgr2=0x5617726aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:25.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.651+0000 7fcf686d2f40 1 --2- 172.21.15.19:0/4179015314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617726c2f30 0x5617726aaa80 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800b480 tx=0x7fcf5800b940 comp rx=0 tx=0).stop 2024-09-12T02:07:25.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.651+0000 7fcf669c9640 1 -- 172.21.15.19:0/4179015314 reap_dead start 2024-09-12T02:07:25.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.651+0000 7fcf686d2f40 1 -- 172.21.15.19:0/4179015314 shutdown_connections 2024-09-12T02:07:25.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.651+0000 7fcf686d2f40 1 -- 172.21.15.19:0/4179015314 >> 172.21.15.19:0/4179015314 conn(0x5617726a8490 msgr2=0x5617726c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:25.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.651+0000 7fcf686d2f40 1 -- 172.21.15.19:0/4179015314 shutdown_connections 2024-09-12T02:07:25.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:25.651+0000 7fcf686d2f40 1 -- 172.21.15.19:0/4179015314 wait complete. 2024-09-12T02:07:25.657 DEBUG:teuthology.orchestra.run.smithi019:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-12T02:07:25.748 INFO:teuthology.orchestra.run.smithi019.stderr:error: stray data at end of buffer, offset 91 2024-09-12T02:07:25.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:07:25.770 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:07:25.770 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:07:25.817 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:07:25.860 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:07:25.860 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:07:25.860 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:07:25.860 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:07:25.876 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:07:25.876 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:07:25.932 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:07:26.053 INFO:tasks.ceph.mds.a.smithi019.stderr:2024-09-12T02:07:26.053+0000 7fe8bf3b5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:07:26.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.076+0000 7f3750f3a640 1 Processor -- start 2024-09-12T02:07:26.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.076+0000 7f3750f3a640 1 -- start start 2024-09-12T02:07:26.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.077+0000 7f3750f3a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f374c0d0cf0 0x7f374c1690d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.077+0000 7f3750f3a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f374c0d12c0 con 0x7f374c09aca0 2024-09-12T02:07:26.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.077+0000 7f3750f3a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f374c0d15a0 con 0x7f374c071750 2024-09-12T02:07:26.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.077+0000 7f3750f3a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f374c06d040 con 0x7f374c0d0cf0 2024-09-12T02:07:26.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.077+0000 7f374a59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f374c09aca0 0x7f374c09b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59094/0 (socket says 172.21.15.19:59094) 2024-09-12T02:07:26.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.077+0000 7f374a59c640 1 -- 172.21.15.19:0/643233403 learned_addr learned my addr 172.21.15.19:0/643233403 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:26.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374ad9d640 1 --2- 172.21.15.19:0/643233403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f374c0d0cf0 0x7f374c1690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:26.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374959a640 1 -- 172.21.15.19:0/643233403 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4001033295 0 0) 0x7f374c0d12c0 con 0x7f374c09aca0 2024-09-12T02:07:26.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374959a640 1 -- 172.21.15.19:0/643233403 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3738003520 con 0x7f374c09aca0 2024-09-12T02:07:26.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374959a640 1 -- 172.21.15.19:0/643233403 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3716482917 0 0) 0x7f374c0d15a0 con 0x7f374c071750 2024-09-12T02:07:26.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374959a640 1 -- 172.21.15.19:0/643233403 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f374c0d12c0 con 0x7f374c071750 2024-09-12T02:07:26.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374959a640 1 -- 172.21.15.19:0/643233403 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 766857610 0 0) 0x7f3738003520 con 0x7f374c09aca0 2024-09-12T02:07:26.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374959a640 1 -- 172.21.15.19:0/643233403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f374c0d0cf0 msgr2=0x7f374c1690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:26.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374959a640 1 --2- 172.21.15.19:0/643233403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f374c0d0cf0 0x7f374c1690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374959a640 1 -- 172.21.15.19:0/643233403 >> v1:172.21.15.135:6789/0 conn(0x7f374c071750 legacy=0x7f374c0d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:26.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374959a640 1 -- 172.21.15.19:0/643233403 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374c0d1880 con 0x7f374c09aca0 2024-09-12T02:07:26.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374959a640 1 -- 172.21.15.19:0/643233403 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f373c0019f0 con 0x7f374c09aca0 2024-09-12T02:07:26.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374959a640 1 -- 172.21.15.19:0/643233403 >> v1:172.21.15.19:6789/0 conn(0x7f374c09aca0 legacy=0x7f374c09b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:26.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374959a640 1 --2- 172.21.15.19:0/643233403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3738003b70 0x7f3738003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374959a640 1 --2- 172.21.15.19:0/643233403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3738004800 0x7f3738004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374959a640 1 --2- 172.21.15.19:0/643233403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f374c0d0cf0 0x7f37380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374959a640 1 -- 172.21.15.19:0/643233403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f374c06d040 con 0x7f3738003b70 2024-09-12T02:07:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374959a640 1 -- 172.21.15.19:0/643233403 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f373800ba70 con 0x7f3738004800 2024-09-12T02:07:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374959a640 1 -- 172.21.15.19:0/643233403 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f373800bc40 con 0x7f374c0d0cf0 2024-09-12T02:07:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374a59c640 1 --2- 172.21.15.19:0/643233403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3738003b70 0x7f3738003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f3749d9b640 1 --2- 172.21.15.19:0/643233403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3738004800 0x7f3738004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.078+0000 7f374ad9d640 1 --2- 172.21.15.19:0/643233403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f374c0d0cf0 0x7f37380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.079+0000 7f374a59c640 1 -- 172.21.15.19:0/643233403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f374c0d0cf0 msgr2=0x7f37380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.079+0000 7f374a59c640 1 --2- 172.21.15.19:0/643233403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f374c0d0cf0 0x7f37380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.079+0000 7f374a59c640 1 -- 172.21.15.19:0/643233403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3738004800 msgr2=0x7f3738004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.079+0000 7f374a59c640 1 --2- 172.21.15.19:0/643233403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3738004800 0x7f3738004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.079+0000 7f374a59c640 1 -- 172.21.15.19:0/643233403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3738003520 con 0x7f3738003b70 2024-09-12T02:07:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.079+0000 7f374a59c640 1 --2- 172.21.15.19:0/643233403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3738003b70 0x7f3738003f70 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7f373c00a800 tx=0x7f3738005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14cb8ee82cf89fb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.079+0000 7f374959a640 1 -- 172.21.15.19:0/643233403 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c00a430 con 0x7f3738003b70 2024-09-12T02:07:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.079+0000 7f374959a640 1 -- 172.21.15.19:0/643233403 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f373c02f070 con 0x7f3738003b70 2024-09-12T02:07:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.079+0000 7f374959a640 1 -- 172.21.15.19:0/643233403 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c02bc10 con 0x7f3738003b70 2024-09-12T02:07:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.080+0000 7f3750f3a640 1 -- 172.21.15.19:0/643233403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3738003b70 msgr2=0x7f3738003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.080+0000 7f3750f3a640 1 --2- 172.21.15.19:0/643233403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3738003b70 0x7f3738003f70 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7f373c00a800 tx=0x7f3738005830 comp rx=0 tx=0).stop 2024-09-12T02:07:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.080+0000 7f374ad9d640 1 -- 172.21.15.19:0/643233403 reap_dead start 2024-09-12T02:07:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.080+0000 7f3750f3a640 1 -- 172.21.15.19:0/643233403 shutdown_connections 2024-09-12T02:07:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.080+0000 7f3750f3a640 1 -- 172.21.15.19:0/643233403 >> 172.21.15.19:0/643233403 conn(0x7f374c0d23a0 msgr2=0x7f374c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.080+0000 7f3750f3a640 1 -- 172.21.15.19:0/643233403 shutdown_connections 2024-09-12T02:07:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.080+0000 7f3750f3a640 1 -- 172.21.15.19:0/643233403 wait complete. 2024-09-12T02:07:26.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.081+0000 7f3750f3a640 1 Processor -- start 2024-09-12T02:07:26.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.081+0000 7f3750f3a640 1 -- start start 2024-09-12T02:07:26.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.082+0000 7f3750f3a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3738003b70 0x7f374c14f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.082+0000 7f3750f3a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f374c1547c0 0x7f374c0af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.082+0000 7f3750f3a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f374c0b0d00 0x7f374c0cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.082+0000 7f3750f3a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f374c09b790 con 0x7f374c0b0d00 2024-09-12T02:07:26.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.082+0000 7f3750f3a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f374c070220 con 0x7f3738003b70 2024-09-12T02:07:26.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.082+0000 7f3750f3a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f374c1670c0 con 0x7f374c1547c0 2024-09-12T02:07:26.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.082+0000 7f374ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f374c0b0d00 0x7f374c0cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:26.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.082+0000 7f374ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f374c0b0d00 0x7f374c0cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38198/0 (socket says 172.21.15.19:38198) 2024-09-12T02:07:26.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.082+0000 7f374ad9d640 1 -- 172.21.15.19:0/4171263743 learned_addr learned my addr 172.21.15.19:0/4171263743 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:26.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.082+0000 7f374a59c640 1 --2- 172.21.15.19:0/4171263743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3738003b70 0x7f374c14f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:26.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.082+0000 7f3749d9b640 1 --2- 172.21.15.19:0/4171263743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f374c1547c0 0x7f374c0af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:26.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.083+0000 7f374ad9d640 1 -- 172.21.15.19:0/4171263743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f374c1547c0 msgr2=0x7f374c0af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:26.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.083+0000 7f374ad9d640 1 --2- 172.21.15.19:0/4171263743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f374c1547c0 0x7f374c0af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.083+0000 7f374ad9d640 1 -- 172.21.15.19:0/4171263743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3738003b70 msgr2=0x7f374c14f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.083+0000 7f374ad9d640 1 --2- 172.21.15.19:0/4171263743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3738003b70 0x7f374c14f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.083+0000 7f374ad9d640 1 -- 172.21.15.19:0/4171263743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374c0afc60 con 0x7f374c0b0d00 2024-09-12T02:07:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.083+0000 7f374a59c640 1 --2- 172.21.15.19:0/4171263743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3738003b70 0x7f374c14f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.083+0000 7f374ad9d640 1 --2- 172.21.15.19:0/4171263743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f374c0b0d00 0x7f374c0cce90 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7f374c073670 tx=0x7f3744011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.083+0000 7f3742ffd640 1 -- 172.21.15.19:0/4171263743 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3744019020 con 0x7f374c0b0d00 2024-09-12T02:07:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.083+0000 7f3742ffd640 1 -- 172.21.15.19:0/4171263743 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3744004240 con 0x7f374c0b0d00 2024-09-12T02:07:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.083+0000 7f3750f3a640 1 -- 172.21.15.19:0/4171263743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f374c0aff40 con 0x7f374c0b0d00 2024-09-12T02:07:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.083+0000 7f3742ffd640 1 -- 172.21.15.19:0/4171263743 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374400f710 con 0x7f374c0b0d00 2024-09-12T02:07:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.083+0000 7f3750f3a640 1 -- 172.21.15.19:0/4171263743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f374c0b0500 con 0x7f374c0b0d00 2024-09-12T02:07:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.084+0000 7f3750f3a640 1 -- 172.21.15.19:0/4171263743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f374c0d05e0 con 0x7f374c0b0d00 2024-09-12T02:07:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.084+0000 7f3742ffd640 1 -- 172.21.15.19:0/4171263743 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f374401c020 con 0x7f374c0b0d00 2024-09-12T02:07:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.085+0000 7f3742ffd640 1 --2- 172.21.15.19:0/4171263743 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f372c06be60 0x7f372c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.085+0000 7f3742ffd640 1 -- 172.21.15.19:0/4171263743 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x7f374408b310 con 0x7f374c0b0d00 2024-09-12T02:07:26.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.085+0000 7f374a59c640 1 --2- 172.21.15.19:0/4171263743 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f372c06be60 0x7f372c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:26.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.086+0000 7f374a59c640 1 --2- 172.21.15.19:0/4171263743 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f372c06be60 0x7f372c06e320 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f373c033000 tx=0x7f373c007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:26.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.089+0000 7f3742ffd640 1 -- 172.21.15.19:0/4171263743 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3744023020 con 0x7f374c0b0d00 2024-09-12T02:07:26.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.275+0000 7f3750f3a640 1 -- 172.21.15.19:0/4171263743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f374c15c8b0 con 0x7f374c0b0d00 2024-09-12T02:07:26.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.275+0000 7f3742ffd640 1 -- 172.21.15.19:0/4171263743 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v146) ==== 80+0+122 (secure 0 0 0) 0x7f3744059b70 con 0x7f374c0b0d00 2024-09-12T02:07:26.276 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6835/3072429339 2024-09-13T02:07:19.043391+0000 2024-09-12T02:07:26.276 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6833/3072429339 2024-09-13T02:07:19.043391+0000 2024-09-12T02:07:26.277 INFO:teuthology.orchestra.run.smithi019.stderr:listed 2 entries 2024-09-12T02:07:26.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.277+0000 7f3750f3a640 1 -- 172.21.15.19:0/4171263743 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f372c06be60 msgr2=0x7f372c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:26.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.277+0000 7f3750f3a640 1 --2- 172.21.15.19:0/4171263743 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f372c06be60 0x7f372c06e320 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f373c033000 tx=0x7f373c007000 comp rx=0 tx=0).stop 2024-09-12T02:07:26.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.277+0000 7f3750f3a640 1 -- 172.21.15.19:0/4171263743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f374c0b0d00 msgr2=0x7f374c0cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:26.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.277+0000 7f3750f3a640 1 --2- 172.21.15.19:0/4171263743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f374c0b0d00 0x7f374c0cce90 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7f374c073670 tx=0x7f3744011cf0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.277+0000 7f3750f3a640 1 -- 172.21.15.19:0/4171263743 shutdown_connections 2024-09-12T02:07:26.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.277+0000 7f3750f3a640 1 --2- 172.21.15.19:0/4171263743 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f372c06be60 0x7f372c06e320 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.277+0000 7f3750f3a640 1 --2- 172.21.15.19:0/4171263743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f374c0b0d00 0x7f374c0cce90 unknown :-1 s=CLOSED pgs=2325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.277+0000 7f3750f3a640 1 --2- 172.21.15.19:0/4171263743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f374c1547c0 0x7f374c0af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.277+0000 7f3750f3a640 1 --2- 172.21.15.19:0/4171263743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3738003b70 0x7f374c14f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.277+0000 7f3750f3a640 1 -- 172.21.15.19:0/4171263743 >> 172.21.15.19:0/4171263743 conn(0x7f374c0d23a0 msgr2=0x7f374c06d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:26.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.278+0000 7f3750f3a640 1 -- 172.21.15.19:0/4171263743 shutdown_connections 2024-09-12T02:07:26.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.278+0000 7f3750f3a640 1 -- 172.21.15.19:0/4171263743 wait complete. 2024-09-12T02:07:26.289 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:07:26.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:26.289 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:07:26.319 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:07:26.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:26.319 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:07:26.340 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:07:26.362 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:07:26.375 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:07:26.376 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T02:07:26.376 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:07:26.423 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:07:26.424 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:07:26.424 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:07:26.424 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:07:26.468 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:07:26.468 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:07:26.468 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T02:07:26.468 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:07:26.486 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:07:26.486 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:07:26.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.610+0000 7fce7f41e640 1 Processor -- start 2024-09-12T02:07:26.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.610+0000 7fce7f41e640 1 -- start start 2024-09-12T02:07:26.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.611+0000 7fce7f41e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce78072d30 0x7fce7806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.611+0000 7fce7f41e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce7806f700 0x7fce7815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.611+0000 7fce7f41e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce7806fae0 con 0x7fce7815b300 2024-09-12T02:07:26.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.611+0000 7fce7f41e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fce780728a0 con 0x7fce7806f700 2024-09-12T02:07:26.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.611+0000 7fce7f41e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fce780cdbe0 con 0x7fce78072d30 2024-09-12T02:07:26.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.611+0000 7fce7d9bb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce7806f700 0x7fce7815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:26.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.611+0000 7fce7d1ba640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fce7815b300 0x7fce780cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59100/0 (socket says 172.21.15.19:59100) 2024-09-12T02:07:26.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.611+0000 7fce7d1ba640 1 -- 172.21.15.19:0/3473656162 learned_addr learned my addr 172.21.15.19:0/3473656162 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:26.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.611+0000 7fce7c9b9640 1 --2- 172.21.15.19:0/3473656162 >> v2:172.21.15.135:3300/0 conn(0x7fce78072d30 0x7fce7806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:26.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.611+0000 7fce7d9bb640 1 -- 172.21.15.19:0/3473656162 >> v2:172.21.15.135:3300/0 conn(0x7fce78072d30 msgr2=0x7fce7806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:26.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.611+0000 7fce7d9bb640 1 --2- 172.21.15.19:0/3473656162 >> v2:172.21.15.135:3300/0 conn(0x7fce78072d30 0x7fce7806f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.611+0000 7fce7d9bb640 1 -- 172.21.15.19:0/3473656162 >> v1:172.21.15.19:6789/0 conn(0x7fce7815b300 legacy=0x7fce780cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:26.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.611+0000 7fce7d9bb640 1 -- 172.21.15.19:0/3473656162 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce780cd900 con 0x7fce7806f700 2024-09-12T02:07:26.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.612+0000 7fce7d9bb640 1 --2- 172.21.15.19:0/3473656162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7806f700 0x7fce7815b6e0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7fce780b57c0 tx=0x7fce7002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d98c7487c257d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:26.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.612+0000 7fce6ffff640 1 -- 172.21.15.19:0/3473656162 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70007740 con 0x7fce7806f700 2024-09-12T02:07:26.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.612+0000 7fce6ffff640 1 -- 172.21.15.19:0/3473656162 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce700078e0 con 0x7fce7806f700 2024-09-12T02:07:26.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.612+0000 7fce6ffff640 1 -- 172.21.15.19:0/3473656162 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70007cb0 con 0x7fce7806f700 2024-09-12T02:07:26.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.613+0000 7fce7f41e640 1 -- 172.21.15.19:0/3473656162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7806f700 msgr2=0x7fce7815b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:26.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.613+0000 7fce7f41e640 1 --2- 172.21.15.19:0/3473656162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7806f700 0x7fce7815b6e0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7fce780b57c0 tx=0x7fce7002a5f0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.613+0000 7fce7f41e640 1 -- 172.21.15.19:0/3473656162 shutdown_connections 2024-09-12T02:07:26.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.613+0000 7fce7f41e640 1 --2- 172.21.15.19:0/3473656162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7806f700 0x7fce7815b6e0 unknown :-1 s=CLOSED pgs=2327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.613+0000 7fce7f41e640 1 --2- 172.21.15.19:0/3473656162 >> v2:172.21.15.135:3300/0 conn(0x7fce78072d30 0x7fce7806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.613+0000 7fce7f41e640 1 -- 172.21.15.19:0/3473656162 >> 172.21.15.19:0/3473656162 conn(0x7fce78067d70 msgr2=0x7fce7806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:26.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.613+0000 7fce7f41e640 1 -- 172.21.15.19:0/3473656162 shutdown_connections 2024-09-12T02:07:26.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.613+0000 7fce7f41e640 1 -- 172.21.15.19:0/3473656162 wait complete. 2024-09-12T02:07:26.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.614+0000 7fce7f41e640 1 Processor -- start 2024-09-12T02:07:26.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.614+0000 7fce7f41e640 1 -- start start 2024-09-12T02:07:26.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7f41e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7806f700 0x7fce78157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7f41e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce78072d30 0x7fce7806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7f41e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7815b300 0x7fce7806e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7f41e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fce780cd5c0 con 0x7fce7815b300 2024-09-12T02:07:26.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7f41e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce78072530 con 0x7fce7806f700 2024-09-12T02:07:26.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7f41e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fce780cffe0 con 0x7fce78072d30 2024-09-12T02:07:26.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7d9bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7815b300 0x7fce7806e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:26.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7d9bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7815b300 0x7fce7806e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38208/0 (socket says 172.21.15.19:38208) 2024-09-12T02:07:26.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7d9bb640 1 -- 172.21.15.19:0/415613851 learned_addr learned my addr 172.21.15.19:0/415613851 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7d1ba640 1 --2- 172.21.15.19:0/415613851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7806f700 0x7fce78157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7c9b9640 1 --2- 172.21.15.19:0/415613851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce78072d30 0x7fce7806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7d9bb640 1 -- 172.21.15.19:0/415613851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce78072d30 msgr2=0x7fce7806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7d9bb640 1 --2- 172.21.15.19:0/415613851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce78072d30 0x7fce7806e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7d9bb640 1 -- 172.21.15.19:0/415613851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7806f700 msgr2=0x7fce78157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7d9bb640 1 --2- 172.21.15.19:0/415613851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7806f700 0x7fce78157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7d9bb640 1 -- 172.21.15.19:0/415613851 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce78155e50 con 0x7fce7815b300 2024-09-12T02:07:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7d1ba640 1 --2- 172.21.15.19:0/415613851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7806f700 0x7fce78157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7d9bb640 1 --2- 172.21.15.19:0/415613851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7815b300 0x7fce7806e5f0 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fce7002abe0 tx=0x7fce70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce6dffb640 1 -- 172.21.15.19:0/415613851 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7003f070 con 0x7fce7815b300 2024-09-12T02:07:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce6dffb640 1 -- 172.21.15.19:0/415613851 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce70031bc0 con 0x7fce7815b300 2024-09-12T02:07:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce7f41e640 1 -- 172.21.15.19:0/415613851 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce78156130 con 0x7fce7815b300 2024-09-12T02:07:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.615+0000 7fce6dffb640 1 -- 172.21.15.19:0/415613851 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70044460 con 0x7fce7815b300 2024-09-12T02:07:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.616+0000 7fce7f41e640 1 -- 172.21.15.19:0/415613851 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce781566f0 con 0x7fce7815b300 2024-09-12T02:07:26.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.617+0000 7fce7f41e640 1 -- 172.21.15.19:0/415613851 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce7806f1c0 con 0x7fce7815b300 2024-09-12T02:07:26.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.617+0000 7fce6dffb640 1 -- 172.21.15.19:0/415613851 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce70007790 con 0x7fce7815b300 2024-09-12T02:07:26.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.618+0000 7fce6dffb640 1 --2- 172.21.15.19:0/415613851 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce5c06be30 0x7fce5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.618+0000 7fce6dffb640 1 -- 172.21.15.19:0/415613851 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x7fce700ac870 con 0x7fce7815b300 2024-09-12T02:07:26.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.618+0000 7fce7d1ba640 1 --2- 172.21.15.19:0/415613851 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce5c06be30 0x7fce5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:26.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.619+0000 7fce7d1ba640 1 --2- 172.21.15.19:0/415613851 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce5c06be30 0x7fce5c06e2f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fce74000f60 tx=0x7fce74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:26.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.622+0000 7fce6dffb640 1 -- 172.21.15.19:0/415613851 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce7007b040 con 0x7fce7815b300 2024-09-12T02:07:26.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.833+0000 7fce7f41e640 1 -- 172.21.15.19:0/415613851 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce7806be10 con 0x7fce7815b300 2024-09-12T02:07:26.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.833+0000 7fce6dffb640 1 -- 172.21.15.19:0/415613851 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 337 v337) ==== 95+0+5242 (secure 0 0 0) 0x7fce7007a940 con 0x7fce7815b300 2024-09-12T02:07:26.835 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:26.835 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":337,"btime":"2024-09-12T02:07:23:057360+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2607300298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2607300298},{"type":"v1","addr":"172.21.15.135:6836","nonce":2607300298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":9283,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/818911002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":818911002},{"type":"v1","addr":"172.21.15.135:6837","nonce":818911002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":10650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3527496552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3527496552},{"type":"v1","addr":"172.21.15.19:6834","nonce":3527496552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327}],"filesystems":[{"mdsmap":{"epoch":337,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:07:05.517761+0000","modified":"2024-09-12T02:07:23.057352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":146,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10836":{"gid":10836,"name":"a","rank":0,"incarnation":334,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/3413662523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3413662523},{"type":"v1","addr":"172.21.15.19:6835","nonce":3413662523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10836,"qdb_cluster":[10836]},"id":7}]} 2024-09-12T02:07:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 337 2024-09-12T02:07:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.835+0000 7fce7f41e640 1 -- 172.21.15.19:0/415613851 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce5c06be30 msgr2=0x7fce5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.835+0000 7fce7f41e640 1 --2- 172.21.15.19:0/415613851 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce5c06be30 0x7fce5c06e2f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fce74000f60 tx=0x7fce74009040 comp rx=0 tx=0).stop 2024-09-12T02:07:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.835+0000 7fce7f41e640 1 -- 172.21.15.19:0/415613851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7815b300 msgr2=0x7fce7806e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.835+0000 7fce7f41e640 1 --2- 172.21.15.19:0/415613851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7815b300 0x7fce7806e5f0 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fce7002abe0 tx=0x7fce70004a40 comp rx=0 tx=0).stop 2024-09-12T02:07:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.835+0000 7fce7f41e640 1 -- 172.21.15.19:0/415613851 shutdown_connections 2024-09-12T02:07:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.835+0000 7fce7f41e640 1 --2- 172.21.15.19:0/415613851 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fce5c06be30 0x7fce5c06e2f0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.835+0000 7fce7f41e640 1 --2- 172.21.15.19:0/415613851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce7815b300 0x7fce7806e5f0 unknown :-1 s=CLOSED pgs=2328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.835+0000 7fce7f41e640 1 --2- 172.21.15.19:0/415613851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce78072d30 0x7fce7806e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.835+0000 7fce7f41e640 1 --2- 172.21.15.19:0/415613851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7806f700 0x7fce78157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.835+0000 7fce7f41e640 1 -- 172.21.15.19:0/415613851 >> 172.21.15.19:0/415613851 conn(0x7fce78067d70 msgr2=0x7fce780cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.835+0000 7fce7f41e640 1 -- 172.21.15.19:0/415613851 shutdown_connections 2024-09-12T02:07:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.835+0000 7fce7f41e640 1 -- 172.21.15.19:0/415613851 wait complete. 2024-09-12T02:07:26.847 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:07:26.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.949+0000 7ff9e7af1640 1 Processor -- start 2024-09-12T02:07:26.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.949+0000 7ff9e7af1640 1 -- start start 2024-09-12T02:07:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.950+0000 7ff9e7af1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9e015e760 0x7ff9e006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.950+0000 7ff9e7af1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e00cfcc0 0x7ff9e00d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.950+0000 7ff9e7af1640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e00d2700 con 0x7ff9e00d4fd0 2024-09-12T02:07:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.950+0000 7ff9e7af1640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e00cedb0 con 0x7ff9e015e760 2024-09-12T02:07:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.950+0000 7ff9e7af1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e00cf090 con 0x7ff9e00cfcc0 2024-09-12T02:07:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.950+0000 7ff9e588d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9e015e760 0x7ff9e006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.950+0000 7ff9e508c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff9e00d4fd0 0x7ff9e00cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59102/0 (socket says 172.21.15.19:59102) 2024-09-12T02:07:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.950+0000 7ff9e508c640 1 -- 172.21.15.19:0/387630280 learned_addr learned my addr 172.21.15.19:0/387630280 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.950+0000 7ff9e608e640 1 --2- 172.21.15.19:0/387630280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e00cfcc0 0x7ff9e00d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.950+0000 7ff9e588d640 1 -- 172.21.15.19:0/387630280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e00cfcc0 msgr2=0x7ff9e00d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.950+0000 7ff9e588d640 1 --2- 172.21.15.19:0/387630280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e00cfcc0 0x7ff9e00d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.950+0000 7ff9e588d640 1 -- 172.21.15.19:0/387630280 >> v1:172.21.15.19:6789/0 conn(0x7ff9e00d4fd0 legacy=0x7ff9e00cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:26.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.950+0000 7ff9e488b640 1 -- 172.21.15.19:0/387630280 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3021101127 0 0) 0x7ff9d0001290 con 0x7ff9e00d4fd0 2024-09-12T02:07:26.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.950+0000 7ff9e588d640 1 -- 172.21.15.19:0/387630280 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e00b3c80 con 0x7ff9e015e760 2024-09-12T02:07:26.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.950+0000 7ff9e608e640 1 --2- 172.21.15.19:0/387630280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e00cfcc0 0x7ff9e00d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.951+0000 7ff9e588d640 1 --2- 172.21.15.19:0/387630280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e015e760 0x7ff9e006cdd0 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0097a0 tx=0x7ff9dc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07b762ab12bb098 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.951+0000 7ff9e488b640 1 -- 172.21.15.19:0/387630280 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc037070 con 0x7ff9e015e760 2024-09-12T02:07:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.951+0000 7ff9e488b640 1 -- 172.21.15.19:0/387630280 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9dc032440 con 0x7ff9e015e760 2024-09-12T02:07:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.951+0000 7ff9e488b640 1 -- 172.21.15.19:0/387630280 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc032810 con 0x7ff9e015e760 2024-09-12T02:07:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.952+0000 7ff9e7af1640 1 -- 172.21.15.19:0/387630280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e015e760 msgr2=0x7ff9e006cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.952+0000 7ff9e7af1640 1 --2- 172.21.15.19:0/387630280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e015e760 0x7ff9e006cdd0 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0097a0 tx=0x7ff9dc02a180 comp rx=0 tx=0).stop 2024-09-12T02:07:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.952+0000 7ff9e7af1640 1 -- 172.21.15.19:0/387630280 shutdown_connections 2024-09-12T02:07:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.952+0000 7ff9e7af1640 1 --2- 172.21.15.19:0/387630280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e00cfcc0 0x7ff9e00d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.952+0000 7ff9e7af1640 1 --2- 172.21.15.19:0/387630280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e015e760 0x7ff9e006cdd0 unknown :-1 s=CLOSED pgs=2330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.952+0000 7ff9e7af1640 1 -- 172.21.15.19:0/387630280 >> 172.21.15.19:0/387630280 conn(0x7ff9e008bfc0 msgr2=0x7ff9e00d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:26.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.952+0000 7ff9e7af1640 1 -- 172.21.15.19:0/387630280 shutdown_connections 2024-09-12T02:07:26.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.952+0000 7ff9e7af1640 1 -- 172.21.15.19:0/387630280 wait complete. 2024-09-12T02:07:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.953+0000 7ff9e7af1640 1 Processor -- start 2024-09-12T02:07:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.953+0000 7ff9e7af1640 1 -- start start 2024-09-12T02:07:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9e7af1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e00cfcc0 0x7ff9e015f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9e7af1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e00d4fd0 0x7ff9e0151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9e7af1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e015e760 0x7ff9e01610b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9e7af1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e00d33e0 con 0x7ff9e00cfcc0 2024-09-12T02:07:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9e7af1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e00b38a0 con 0x7ff9e015e760 2024-09-12T02:07:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9e7af1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e00d3560 con 0x7ff9e00d4fd0 2024-09-12T02:07:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9e588d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e00cfcc0 0x7ff9e015f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9e588d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e00cfcc0 0x7ff9e015f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38212/0 (socket says 172.21.15.19:38212) 2024-09-12T02:07:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9e588d640 1 -- 172.21.15.19:0/3938322527 learned_addr learned my addr 172.21.15.19:0/3938322527 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9e588d640 1 -- 172.21.15.19:0/3938322527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e00d4fd0 msgr2=0x7ff9e0151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9e588d640 1 --2- 172.21.15.19:0/3938322527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e00d4fd0 0x7ff9e0151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9e588d640 1 -- 172.21.15.19:0/3938322527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e015e760 msgr2=0x7ff9e01610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9e588d640 1 --2- 172.21.15.19:0/3938322527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e015e760 0x7ff9e01610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9e588d640 1 -- 172.21.15.19:0/3938322527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e00b8410 con 0x7ff9e00cfcc0 2024-09-12T02:07:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9e588d640 1 --2- 172.21.15.19:0/3938322527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e00cfcc0 0x7ff9e015f450 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc000c00 tx=0x7ff9dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9d67fc640 1 -- 172.21.15.19:0/3938322527 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc037050 con 0x7ff9e00cfcc0 2024-09-12T02:07:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9d67fc640 1 -- 172.21.15.19:0/3938322527 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9dc038040 con 0x7ff9e00cfcc0 2024-09-12T02:07:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9d67fc640 1 -- 172.21.15.19:0/3938322527 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc004450 con 0x7ff9e00cfcc0 2024-09-12T02:07:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.954+0000 7ff9e7af1640 1 -- 172.21.15.19:0/3938322527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e00b86f0 con 0x7ff9e00cfcc0 2024-09-12T02:07:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.955+0000 7ff9e7af1640 1 -- 172.21.15.19:0/3938322527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e00b8cb0 con 0x7ff9e00cfcc0 2024-09-12T02:07:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.955+0000 7ff9e7af1640 1 -- 172.21.15.19:0/3938322527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e00d38e0 con 0x7ff9e00cfcc0 2024-09-12T02:07:26.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.956+0000 7ff9d67fc640 1 -- 172.21.15.19:0/3938322527 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9dc030980 con 0x7ff9e00cfcc0 2024-09-12T02:07:26.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.956+0000 7ff9d67fc640 1 --2- 172.21.15.19:0/3938322527 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9c406be30 0x7ff9c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:26.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.956+0000 7ff9d67fc640 1 -- 172.21.15.19:0/3938322527 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x7ff9dc0abc80 con 0x7ff9e00cfcc0 2024-09-12T02:07:26.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.957+0000 7ff9e508c640 1 --2- 172.21.15.19:0/3938322527 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9c406be30 0x7ff9c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:26.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.957+0000 7ff9e508c640 1 --2- 172.21.15.19:0/3938322527 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9c406be30 0x7ff9c406e2f0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00ce200 tx=0x7ff9d0001390 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:26.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:26.961+0000 7ff9d67fc640 1 -- 172.21.15.19:0/3938322527 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff9dc07a570 con 0x7ff9e00cfcc0 2024-09-12T02:07:27.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.171+0000 7ff9e7af1640 1 -- 172.21.15.19:0/3938322527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9e00b6d20 con 0x7ff9e00cfcc0 2024-09-12T02:07:27.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.172+0000 7ff9d67fc640 1 -- 172.21.15.19:0/3938322527 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 337 v337) ==== 95+0+5242 (secure 0 0 0) 0x7ff9dc079e70 con 0x7ff9e00cfcc0 2024-09-12T02:07:27.172 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:27.173 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":337,"btime":"2024-09-12T02:07:23:057360+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2607300298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2607300298},{"type":"v1","addr":"172.21.15.135:6836","nonce":2607300298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":9283,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/818911002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":818911002},{"type":"v1","addr":"172.21.15.135:6837","nonce":818911002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":10650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3527496552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3527496552},{"type":"v1","addr":"172.21.15.19:6834","nonce":3527496552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327}],"filesystems":[{"mdsmap":{"epoch":337,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:07:05.517761+0000","modified":"2024-09-12T02:07:23.057352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":146,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10836":{"gid":10836,"name":"a","rank":0,"incarnation":334,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/3413662523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3413662523},{"type":"v1","addr":"172.21.15.19:6835","nonce":3413662523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10836,"qdb_cluster":[10836]},"id":7}]} 2024-09-12T02:07:27.173 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 337 2024-09-12T02:07:27.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.174+0000 7ff9e7af1640 1 -- 172.21.15.19:0/3938322527 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9c406be30 msgr2=0x7ff9c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.174+0000 7ff9e7af1640 1 --2- 172.21.15.19:0/3938322527 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9c406be30 0x7ff9c406e2f0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00ce200 tx=0x7ff9d0001390 comp rx=0 tx=0).stop 2024-09-12T02:07:27.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.174+0000 7ff9e7af1640 1 -- 172.21.15.19:0/3938322527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e00cfcc0 msgr2=0x7ff9e015f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.174+0000 7ff9e7af1640 1 --2- 172.21.15.19:0/3938322527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e00cfcc0 0x7ff9e015f450 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc000c00 tx=0x7ff9dc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.174+0000 7ff9e7af1640 1 -- 172.21.15.19:0/3938322527 shutdown_connections 2024-09-12T02:07:27.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.174+0000 7ff9e7af1640 1 --2- 172.21.15.19:0/3938322527 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff9c406be30 0x7ff9c406e2f0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.174+0000 7ff9e7af1640 1 --2- 172.21.15.19:0/3938322527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e015e760 0x7ff9e01610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.174+0000 7ff9e7af1640 1 --2- 172.21.15.19:0/3938322527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9e00d4fd0 0x7ff9e0151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.174+0000 7ff9e7af1640 1 --2- 172.21.15.19:0/3938322527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e00cfcc0 0x7ff9e015f450 unknown :-1 s=CLOSED pgs=2331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.174+0000 7ff9e7af1640 1 -- 172.21.15.19:0/3938322527 >> 172.21.15.19:0/3938322527 conn(0x7ff9e008bfc0 msgr2=0x7ff9e00d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:27.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.174+0000 7ff9e7af1640 1 -- 172.21.15.19:0/3938322527 shutdown_connections 2024-09-12T02:07:27.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.174+0000 7ff9e7af1640 1 -- 172.21.15.19:0/3938322527 wait complete. 2024-09-12T02:07:27.186 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:07:27.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.289+0000 7f2a3632a640 1 Processor -- start 2024-09-12T02:07:27.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.289+0000 7f2a3632a640 1 -- start start 2024-09-12T02:07:27.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.289+0000 7f2a3632a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2a30161c80 0x7f2a3006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.289+0000 7f2a3632a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a3006e870 con 0x7f2a30162060 2024-09-12T02:07:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.289+0000 7f2a3632a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a3006d9f0 con 0x7f2a300b6680 2024-09-12T02:07:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.289+0000 7f2a3632a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f2a3006dcd0 con 0x7f2a30161c80 2024-09-12T02:07:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.290+0000 7f2a2f7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2a30162060 0x7f2a300b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59118/0 (socket says 172.21.15.19:59118) 2024-09-12T02:07:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.290+0000 7f2a2f7fe640 1 -- 172.21.15.19:0/2084817878 learned_addr learned my addr 172.21.15.19:0/2084817878 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.290+0000 7f2a2ffff640 1 --2- 172.21.15.19:0/2084817878 >> v2:172.21.15.135:3300/0 conn(0x7f2a30161c80 0x7f2a3006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.290+0000 7f2a2effd640 1 -- 172.21.15.19:0/2084817878 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3305457683 0 0) 0x7f2a24001110 con 0x7f2a30162060 2024-09-12T02:07:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.290+0000 7f2a2effd640 1 -- 172.21.15.19:0/2084817878 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a18003520 con 0x7f2a30162060 2024-09-12T02:07:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.290+0000 7f2a2ffff640 1 -- 172.21.15.19:0/2084817878 >> v1:172.21.15.135:6789/0 conn(0x7f2a300b6680 legacy=0x7f2a300cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.290+0000 7f2a2ffff640 1 -- 172.21.15.19:0/2084817878 >> v1:172.21.15.19:6789/0 conn(0x7f2a30162060 legacy=0x7f2a300b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.290+0000 7f2a2effd640 1 -- 172.21.15.19:0/2084817878 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3569294909 0 0) 0x7f2a18003520 con 0x7f2a30162060 2024-09-12T02:07:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.290+0000 7f2a2ffff640 1 -- 172.21.15.19:0/2084817878 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3006dfb0 con 0x7f2a30161c80 2024-09-12T02:07:27.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.291+0000 7f2a2ffff640 1 --2- 172.21.15.19:0/2084817878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a30161c80 0x7f2a3006e330 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2a200097a0 tx=0x7f2a2002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e5a2502470157c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.291+0000 7f2a2effd640 1 -- 172.21.15.19:0/2084817878 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a20037070 con 0x7f2a30161c80 2024-09-12T02:07:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.291+0000 7f2a2effd640 1 -- 172.21.15.19:0/2084817878 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a2002ac50 con 0x7f2a30161c80 2024-09-12T02:07:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.291+0000 7f2a2effd640 1 -- 172.21.15.19:0/2084817878 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a24001840 con 0x7f2a30161c80 2024-09-12T02:07:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.292+0000 7f2a3632a640 1 -- 172.21.15.19:0/2084817878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a30161c80 msgr2=0x7f2a3006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.292+0000 7f2a3632a640 1 --2- 172.21.15.19:0/2084817878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a30161c80 0x7f2a3006e330 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2a200097a0 tx=0x7f2a2002a1c0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.292+0000 7f2a3632a640 1 -- 172.21.15.19:0/2084817878 shutdown_connections 2024-09-12T02:07:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.292+0000 7f2a3632a640 1 --2- 172.21.15.19:0/2084817878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a30161c80 0x7f2a3006e330 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.292+0000 7f2a3632a640 1 -- 172.21.15.19:0/2084817878 >> 172.21.15.19:0/2084817878 conn(0x7f2a300d44f0 msgr2=0x7f2a300d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:27.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.292+0000 7f2a3632a640 1 -- 172.21.15.19:0/2084817878 shutdown_connections 2024-09-12T02:07:27.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.292+0000 7f2a3632a640 1 -- 172.21.15.19:0/2084817878 wait complete. 2024-09-12T02:07:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.293+0000 7f2a3632a640 1 Processor -- start 2024-09-12T02:07:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.293+0000 7f2a3632a640 1 -- start start 2024-09-12T02:07:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.294+0000 7f2a3632a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a300b6680 0x7f2a300c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.294+0000 7f2a3632a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a30161c80 0x7f2a301518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.294+0000 7f2a3632a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a30162060 0x7f2a300b9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.294+0000 7f2a3632a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2a300b6b30 con 0x7f2a30162060 2024-09-12T02:07:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.294+0000 7f2a3632a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2a300d2aa0 con 0x7f2a300b6680 2024-09-12T02:07:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.294+0000 7f2a3632a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2a300b6cb0 con 0x7f2a30161c80 2024-09-12T02:07:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.294+0000 7f2a348c7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a30162060 0x7f2a300b9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.294+0000 7f2a348c7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a30162060 0x7f2a300b9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38224/0 (socket says 172.21.15.19:38224) 2024-09-12T02:07:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.294+0000 7f2a348c7640 1 -- 172.21.15.19:0/4059868402 learned_addr learned my addr 172.21.15.19:0/4059868402 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:27.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.294+0000 7f2a2ffff640 1 --2- 172.21.15.19:0/4059868402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a300b6680 0x7f2a300c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.294+0000 7f2a2f7fe640 1 --2- 172.21.15.19:0/4059868402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a30161c80 0x7f2a301518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.294+0000 7f2a348c7640 1 -- 172.21.15.19:0/4059868402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a30161c80 msgr2=0x7f2a301518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.294+0000 7f2a348c7640 1 --2- 172.21.15.19:0/4059868402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a30161c80 0x7f2a301518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.294+0000 7f2a348c7640 1 -- 172.21.15.19:0/4059868402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a300b6680 msgr2=0x7f2a300c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.294+0000 7f2a348c7640 1 --2- 172.21.15.19:0/4059868402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a300b6680 0x7f2a300c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.294+0000 7f2a348c7640 1 -- 172.21.15.19:0/4059868402 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a300c86b0 con 0x7f2a30162060 2024-09-12T02:07:27.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.294+0000 7f2a2ffff640 1 --2- 172.21.15.19:0/4059868402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a300b6680 0x7f2a300c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:27.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.295+0000 7f2a348c7640 1 --2- 172.21.15.19:0/4059868402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a30162060 0x7f2a300b9870 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7f2a2800c6e0 tx=0x7f2a2800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:27.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.295+0000 7f2a2cff9640 1 -- 172.21.15.19:0/4059868402 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a28003b70 con 0x7f2a30162060 2024-09-12T02:07:27.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.295+0000 7f2a2cff9640 1 -- 172.21.15.19:0/4059868402 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a28003d30 con 0x7f2a30162060 2024-09-12T02:07:27.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.295+0000 7f2a3632a640 1 -- 172.21.15.19:0/4059868402 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a300c8990 con 0x7f2a30162060 2024-09-12T02:07:27.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.295+0000 7f2a2cff9640 1 -- 172.21.15.19:0/4059868402 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a28005310 con 0x7f2a30162060 2024-09-12T02:07:27.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.295+0000 7f2a3632a640 1 -- 172.21.15.19:0/4059868402 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a300b9350 con 0x7f2a30162060 2024-09-12T02:07:27.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.296+0000 7f2a3632a640 1 -- 172.21.15.19:0/4059868402 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a300b8ea0 con 0x7f2a30162060 2024-09-12T02:07:27.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.296+0000 7f2a2cff9640 1 -- 172.21.15.19:0/4059868402 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a280054b0 con 0x7f2a30162060 2024-09-12T02:07:27.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.297+0000 7f2a2cff9640 1 --2- 172.21.15.19:0/4059868402 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2a1c06be30 0x7f2a1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.297+0000 7f2a2cff9640 1 -- 172.21.15.19:0/4059868402 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x7f2a2808ae80 con 0x7f2a30162060 2024-09-12T02:07:27.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.297+0000 7f2a2ffff640 1 --2- 172.21.15.19:0/4059868402 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2a1c06be30 0x7f2a1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.298+0000 7f2a2ffff640 1 --2- 172.21.15.19:0/4059868402 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2a1c06be30 0x7f2a1c06e2f0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f2a20034000 tx=0x7f2a2002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:27.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.301+0000 7f2a2cff9640 1 -- 172.21.15.19:0/4059868402 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a28059650 con 0x7f2a30162060 2024-09-12T02:07:27.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.480+0000 7f2a3632a640 1 -- 172.21.15.19:0/4059868402 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a3006e330 con 0x7f2a30162060 2024-09-12T02:07:27.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.481+0000 7f2a2cff9640 1 -- 172.21.15.19:0/4059868402 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) ==== 74+0+17061 (secure 0 0 0) 0x7f2a28058f50 con 0x7f2a30162060 2024-09-12T02:07:27.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:27.482 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":146,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:07:19.043425+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:07:03.179551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-12T02:07:04.503322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6835/3072429339":"2024-09-13T02:07:19.043391+0000","172.21.15.19:6833/3072429339":"2024-09-13T02:07:19.043391+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:07:27.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.483+0000 7f2a3632a640 1 -- 172.21.15.19:0/4059868402 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2a1c06be30 msgr2=0x7f2a1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.483+0000 7f2a3632a640 1 --2- 172.21.15.19:0/4059868402 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2a1c06be30 0x7f2a1c06e2f0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f2a20034000 tx=0x7f2a2002e000 comp rx=0 tx=0).stop 2024-09-12T02:07:27.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.484+0000 7f2a3632a640 1 -- 172.21.15.19:0/4059868402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a30162060 msgr2=0x7f2a300b9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.484+0000 7f2a3632a640 1 --2- 172.21.15.19:0/4059868402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a30162060 0x7f2a300b9870 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7f2a2800c6e0 tx=0x7f2a2800cba0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.484+0000 7f2a3632a640 1 -- 172.21.15.19:0/4059868402 shutdown_connections 2024-09-12T02:07:27.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.484+0000 7f2a3632a640 1 --2- 172.21.15.19:0/4059868402 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2a1c06be30 0x7f2a1c06e2f0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.484+0000 7f2a3632a640 1 --2- 172.21.15.19:0/4059868402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a30162060 0x7f2a300b9870 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.484+0000 7f2a3632a640 1 --2- 172.21.15.19:0/4059868402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a30161c80 0x7f2a301518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.484+0000 7f2a3632a640 1 --2- 172.21.15.19:0/4059868402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a300b6680 0x7f2a300c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.484+0000 7f2a3632a640 1 -- 172.21.15.19:0/4059868402 >> 172.21.15.19:0/4059868402 conn(0x7f2a300d44f0 msgr2=0x7f2a300b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:27.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.484+0000 7f2a3632a640 1 -- 172.21.15.19:0/4059868402 shutdown_connections 2024-09-12T02:07:27.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.484+0000 7f2a3632a640 1 -- 172.21.15.19:0/4059868402 wait complete. 2024-09-12T02:07:27.496 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:07:27.496 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:07:27.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.597+0000 7f418c6a5640 1 Processor -- start 2024-09-12T02:07:27.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.598+0000 7f418c6a5640 1 -- start start 2024-09-12T02:07:27.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.598+0000 7f418c6a5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f418415e5f0 0x7f41840d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.598+0000 7f418c6a5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f41840d30f0 0x7f41840b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.598+0000 7f418c6a5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41840b64c0 0x7f41840cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.598+0000 7f418c6a5640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f418406d530 con 0x7f418415e5f0 2024-09-12T02:07:27.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.598+0000 7f418c6a5640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f41840d3690 con 0x7f41840d30f0 2024-09-12T02:07:27.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.598+0000 7f418c6a5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f41840d3970 con 0x7f41840b64c0 2024-09-12T02:07:27.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.599+0000 7f418a441640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f418415e5f0 0x7f41840d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.599+0000 7f418a441640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f418415e5f0 0x7f41840d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38236/0 (socket says 172.21.15.19:38236) 2024-09-12T02:07:27.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.599+0000 7f418a441640 1 -- 172.21.15.19:0/343897332 learned_addr learned my addr 172.21.15.19:0/343897332 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:27.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.599+0000 7f4189c40640 1 --2- 172.21.15.19:0/343897332 >> v2:172.21.15.135:3300/0 conn(0x7f41840d30f0 0x7f41840b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.599+0000 7f418ac42640 1 --2- 172.21.15.19:0/343897332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41840b64c0 0x7f41840cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.599+0000 7f418a441640 1 -- 172.21.15.19:0/343897332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41840b64c0 msgr2=0x7f41840cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:27.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.599+0000 7f418a441640 1 --2- 172.21.15.19:0/343897332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41840b64c0 0x7f41840cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.599+0000 7f418a441640 1 -- 172.21.15.19:0/343897332 >> v2:172.21.15.135:3300/0 conn(0x7f41840d30f0 msgr2=0x7f41840b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:27.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.599+0000 7f418a441640 1 --2- 172.21.15.19:0/343897332 >> v2:172.21.15.135:3300/0 conn(0x7f41840d30f0 0x7f41840b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.599+0000 7f418a441640 1 -- 172.21.15.19:0/343897332 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418406cee0 con 0x7f418415e5f0 2024-09-12T02:07:27.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.600+0000 7f418a441640 1 --2- 172.21.15.19:0/343897332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f418415e5f0 0x7f41840d4dd0 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f418408e520 tx=0x7f418002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c232fb7e3b3249 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:27.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.600+0000 7f418943f640 1 -- 172.21.15.19:0/343897332 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180037070 con 0x7f418415e5f0 2024-09-12T02:07:27.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.600+0000 7f418943f640 1 -- 172.21.15.19:0/343897332 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4180032440 con 0x7f418415e5f0 2024-09-12T02:07:27.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.600+0000 7f418943f640 1 -- 172.21.15.19:0/343897332 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180032810 con 0x7f418415e5f0 2024-09-12T02:07:27.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.600+0000 7f418c6a5640 1 -- 172.21.15.19:0/343897332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f418415e5f0 msgr2=0x7f41840d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.600+0000 7f418c6a5640 1 --2- 172.21.15.19:0/343897332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f418415e5f0 0x7f41840d4dd0 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f418408e520 tx=0x7f418002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.600+0000 7f418c6a5640 1 -- 172.21.15.19:0/343897332 shutdown_connections 2024-09-12T02:07:27.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.600+0000 7f418c6a5640 1 --2- 172.21.15.19:0/343897332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41840b64c0 0x7f41840cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.600+0000 7f418c6a5640 1 --2- 172.21.15.19:0/343897332 >> v2:172.21.15.135:3300/0 conn(0x7f41840d30f0 0x7f41840b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.600+0000 7f418c6a5640 1 --2- 172.21.15.19:0/343897332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f418415e5f0 0x7f41840d4dd0 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.600+0000 7f418c6a5640 1 -- 172.21.15.19:0/343897332 >> 172.21.15.19:0/343897332 conn(0x7f418408bfc0 msgr2=0x7f41840d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:27.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.601+0000 7f418c6a5640 1 -- 172.21.15.19:0/343897332 shutdown_connections 2024-09-12T02:07:27.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.601+0000 7f418c6a5640 1 -- 172.21.15.19:0/343897332 wait complete. 2024-09-12T02:07:27.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.602+0000 7f418c6a5640 1 Processor -- start 2024-09-12T02:07:27.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.602+0000 7f418c6a5640 1 -- start start 2024-09-12T02:07:27.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.602+0000 7f418c6a5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41840b64c0 0x7f41840b9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.602+0000 7f418c6a5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41840d30f0 0x7f41840b8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.602+0000 7f418c6a5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f418415e5f0 0x7f41840b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.602+0000 7f418c6a5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f41840d5310 con 0x7f418415e5f0 2024-09-12T02:07:27.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.602+0000 7f418c6a5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f418415e9d0 con 0x7f41840d30f0 2024-09-12T02:07:27.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.602+0000 7f418c6a5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f41840cf540 con 0x7f41840b64c0 2024-09-12T02:07:27.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.603+0000 7f418ac42640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f418415e5f0 0x7f41840b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.603+0000 7f418ac42640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f418415e5f0 0x7f41840b85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38242/0 (socket says 172.21.15.19:38242) 2024-09-12T02:07:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.603+0000 7f418ac42640 1 -- 172.21.15.19:0/1127435632 learned_addr learned my addr 172.21.15.19:0/1127435632 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.603+0000 7f418a441640 1 --2- 172.21.15.19:0/1127435632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41840b64c0 0x7f41840b9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.603+0000 7f4189c40640 1 --2- 172.21.15.19:0/1127435632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41840d30f0 0x7f41840b8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.603+0000 7f418ac42640 1 -- 172.21.15.19:0/1127435632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41840b64c0 msgr2=0x7f41840b9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.603+0000 7f418ac42640 1 --2- 172.21.15.19:0/1127435632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41840b64c0 0x7f41840b9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.603+0000 7f418ac42640 1 -- 172.21.15.19:0/1127435632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41840d30f0 msgr2=0x7f41840b8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.603+0000 7f418ac42640 1 --2- 172.21.15.19:0/1127435632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41840d30f0 0x7f41840b8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.603+0000 7f418ac42640 1 -- 172.21.15.19:0/1127435632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41840b7950 con 0x7f418415e5f0 2024-09-12T02:07:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.603+0000 7f4189c40640 1 --2- 172.21.15.19:0/1127435632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41840d30f0 0x7f41840b8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.603+0000 7f418ac42640 1 --2- 172.21.15.19:0/1127435632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f418415e5f0 0x7f41840b85d0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f417c007e40 tx=0x7f417c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.603+0000 7f417affd640 1 -- 172.21.15.19:0/1127435632 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c014620 con 0x7f418415e5f0 2024-09-12T02:07:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.603+0000 7f417affd640 1 -- 172.21.15.19:0/1127435632 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c019070 con 0x7f418415e5f0 2024-09-12T02:07:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.603+0000 7f418c6a5640 1 -- 172.21.15.19:0/1127435632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41840b7c30 con 0x7f418415e5f0 2024-09-12T02:07:27.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.603+0000 7f417affd640 1 -- 172.21.15.19:0/1127435632 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c014a20 con 0x7f418415e5f0 2024-09-12T02:07:27.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.603+0000 7f418c6a5640 1 -- 172.21.15.19:0/1127435632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41840c8560 con 0x7f418415e5f0 2024-09-12T02:07:27.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.604+0000 7f418c6a5640 1 -- 172.21.15.19:0/1127435632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41840b52b0 con 0x7f418415e5f0 2024-09-12T02:07:27.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.605+0000 7f417affd640 1 -- 172.21.15.19:0/1127435632 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f417c014bc0 con 0x7f418415e5f0 2024-09-12T02:07:27.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.605+0000 7f417affd640 1 --2- 172.21.15.19:0/1127435632 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f416806be30 0x7f416806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.606+0000 7f417affd640 1 -- 172.21.15.19:0/1127435632 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x7f417c08b820 con 0x7f418415e5f0 2024-09-12T02:07:27.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.606+0000 7f418a441640 1 --2- 172.21.15.19:0/1127435632 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f416806be30 0x7f416806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.606+0000 7f418a441640 1 --2- 172.21.15.19:0/1127435632 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f416806be30 0x7f416806e2f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f4180034000 tx=0x7f418002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:27.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.610+0000 7f417affd640 1 -- 172.21.15.19:0/1127435632 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41840b52b0 con 0x7f418415e5f0 2024-09-12T02:07:27.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.819+0000 7f418c6a5640 1 -- 172.21.15.19:0/1127435632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41840b5f80 con 0x7f418415e5f0 2024-09-12T02:07:27.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.820+0000 7f417affd640 1 -- 172.21.15.19:0/1127435632 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 337 v337) ==== 95+0+5242 (secure 0 0 0) 0x7f417c05a080 con 0x7f418415e5f0 2024-09-12T02:07:27.820 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:27.821 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":337,"btime":"2024-09-12T02:07:23:057360+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2607300298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2607300298},{"type":"v1","addr":"172.21.15.135:6836","nonce":2607300298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":9283,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/818911002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":818911002},{"type":"v1","addr":"172.21.15.135:6837","nonce":818911002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":10650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3527496552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3527496552},{"type":"v1","addr":"172.21.15.19:6834","nonce":3527496552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327}],"filesystems":[{"mdsmap":{"epoch":337,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:07:05.517761+0000","modified":"2024-09-12T02:07:23.057352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":146,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10836":{"gid":10836,"name":"a","rank":0,"incarnation":334,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/3413662523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3413662523},{"type":"v1","addr":"172.21.15.19:6835","nonce":3413662523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10836,"qdb_cluster":[10836]},"id":7}]} 2024-09-12T02:07:27.821 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 337 2024-09-12T02:07:27.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.822+0000 7f418c6a5640 1 -- 172.21.15.19:0/1127435632 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f416806be30 msgr2=0x7f416806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.822+0000 7f418c6a5640 1 --2- 172.21.15.19:0/1127435632 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f416806be30 0x7f416806e2f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f4180034000 tx=0x7f418002e000 comp rx=0 tx=0).stop 2024-09-12T02:07:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.822+0000 7f418c6a5640 1 -- 172.21.15.19:0/1127435632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f418415e5f0 msgr2=0x7f41840b85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.822+0000 7f418c6a5640 1 --2- 172.21.15.19:0/1127435632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f418415e5f0 0x7f41840b85d0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f417c007e40 tx=0x7f417c00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.822+0000 7f418c6a5640 1 -- 172.21.15.19:0/1127435632 shutdown_connections 2024-09-12T02:07:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.822+0000 7f418c6a5640 1 --2- 172.21.15.19:0/1127435632 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f416806be30 0x7f416806e2f0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.822+0000 7f418c6a5640 1 --2- 172.21.15.19:0/1127435632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f418415e5f0 0x7f41840b85d0 unknown :-1 s=CLOSED pgs=2335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.822+0000 7f418c6a5640 1 --2- 172.21.15.19:0/1127435632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41840d30f0 0x7f41840b8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.822+0000 7f418c6a5640 1 --2- 172.21.15.19:0/1127435632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41840b64c0 0x7f41840b9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.822+0000 7f418c6a5640 1 -- 172.21.15.19:0/1127435632 >> 172.21.15.19:0/1127435632 conn(0x7f418408bfc0 msgr2=0x7f41840b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.822+0000 7f418c6a5640 1 -- 172.21.15.19:0/1127435632 shutdown_connections 2024-09-12T02:07:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.822+0000 7f418c6a5640 1 -- 172.21.15.19:0/1127435632 wait complete. 2024-09-12T02:07:27.833 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:07:27.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.935+0000 7f00cf223640 1 Processor -- start 2024-09-12T02:07:27.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.935+0000 7f00cf223640 1 -- start start 2024-09-12T02:07:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00cf223640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f00c80b6680 0x7f00c8169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00cf223640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00c806d9f0 con 0x7f00c8162060 2024-09-12T02:07:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00cf223640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00c806dcd0 con 0x7f00c8161c80 2024-09-12T02:07:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00cf223640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f00c806dfb0 con 0x7f00c80b6680 2024-09-12T02:07:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00c7fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f00c8162060 0x7f00c80b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59134/0 (socket says 172.21.15.19:59134) 2024-09-12T02:07:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00c7fff640 1 -- 172.21.15.19:0/3625155871 learned_addr learned my addr 172.21.15.19:0/3625155871 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00c77fe640 1 -- 172.21.15.19:0/3625155871 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 674349288 0 0) 0x7f00c806d9f0 con 0x7f00c8162060 2024-09-12T02:07:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00cd7c0640 1 --2- 172.21.15.19:0/3625155871 >> v2:172.21.15.135:3300/0 conn(0x7f00c80b6680 0x7f00c8169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00c77fe640 1 -- 172.21.15.19:0/3625155871 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00b4003520 con 0x7f00c8162060 2024-09-12T02:07:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00c77fe640 1 -- 172.21.15.19:0/3625155871 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4257980732 0 0) 0x7f00b4003520 con 0x7f00c8162060 2024-09-12T02:07:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00c77fe640 1 -- 172.21.15.19:0/3625155871 >> v2:172.21.15.135:3300/0 conn(0x7f00c80b6680 msgr2=0x7f00c8169830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00c77fe640 1 --2- 172.21.15.19:0/3625155871 >> v2:172.21.15.135:3300/0 conn(0x7f00c80b6680 0x7f00c8169830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00c77fe640 1 -- 172.21.15.19:0/3625155871 >> v1:172.21.15.135:6789/0 conn(0x7f00c8161c80 legacy=0x7f00c806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00c77fe640 1 -- 172.21.15.19:0/3625155871 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c80d01f0 con 0x7f00c8162060 2024-09-12T02:07:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00c77fe640 1 -- 172.21.15.19:0/3625155871 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f00b00019f0 con 0x7f00c8162060 2024-09-12T02:07:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00c77fe640 1 -- 172.21.15.19:0/3625155871 >> v1:172.21.15.19:6789/0 conn(0x7f00c8162060 legacy=0x7f00c80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00c77fe640 1 --2- 172.21.15.19:0/3625155871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00b40039b0 0x7f00b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00c77fe640 1 --2- 172.21.15.19:0/3625155871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b4004800 0x7f00b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00c77fe640 1 --2- 172.21.15.19:0/3625155871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00b40051c0 0x7f00b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00c77fe640 1 -- 172.21.15.19:0/3625155871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f00c806dfb0 con 0x7f00b4004800 2024-09-12T02:07:27.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00c77fe640 1 -- 172.21.15.19:0/3625155871 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f00b400c110 con 0x7f00b40051c0 2024-09-12T02:07:27.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00c77fe640 1 -- 172.21.15.19:0/3625155871 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f00b400c310 con 0x7f00b40039b0 2024-09-12T02:07:27.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00cd7c0640 1 --2- 172.21.15.19:0/3625155871 >> v2:172.21.15.135:3300/0 conn(0x7f00c80b6680 0x7f00c8169830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:27.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.936+0000 7f00c7fff640 1 --2- 172.21.15.19:0/3625155871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b4004800 0x7f00b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.937+0000 7f00cd7c0640 1 --2- 172.21.15.19:0/3625155871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00b40051c0 0x7f00b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.937+0000 7f00ccfbf640 1 --2- 172.21.15.19:0/3625155871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00b40039b0 0x7f00b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.937+0000 7f00c7fff640 1 -- 172.21.15.19:0/3625155871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00b40039b0 msgr2=0x7f00b4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:27.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.937+0000 7f00c7fff640 1 --2- 172.21.15.19:0/3625155871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00b40039b0 0x7f00b4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.937+0000 7f00c7fff640 1 -- 172.21.15.19:0/3625155871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00b40051c0 msgr2=0x7f00b400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:27.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.937+0000 7f00c7fff640 1 --2- 172.21.15.19:0/3625155871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00b40051c0 0x7f00b400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.937+0000 7f00c7fff640 1 -- 172.21.15.19:0/3625155871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b4003520 con 0x7f00b4004800 2024-09-12T02:07:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.937+0000 7f00cd7c0640 1 -- 172.21.15.19:0/3625155871 reap_dead start 2024-09-12T02:07:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.938+0000 7f00c7fff640 1 --2- 172.21.15.19:0/3625155871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b4004800 0x7f00b4004c80 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7f00c8162460 tx=0x7f00b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c5ceddb00bea1e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.938+0000 7f00c77fe640 1 -- 172.21.15.19:0/3625155871 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b000a4a0 con 0x7f00b4004800 2024-09-12T02:07:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.938+0000 7f00c77fe640 1 -- 172.21.15.19:0/3625155871 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b002f070 con 0x7f00b4004800 2024-09-12T02:07:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.938+0000 7f00c77fe640 1 -- 172.21.15.19:0/3625155871 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b002bcf0 con 0x7f00b4004800 2024-09-12T02:07:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.938+0000 7f00cf223640 1 -- 172.21.15.19:0/3625155871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b4004800 msgr2=0x7f00b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.938+0000 7f00cf223640 1 --2- 172.21.15.19:0/3625155871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b4004800 0x7f00b4004c80 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7f00c8162460 tx=0x7f00b4005830 comp rx=0 tx=0).stop 2024-09-12T02:07:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.938+0000 7f00cf223640 1 -- 172.21.15.19:0/3625155871 shutdown_connections 2024-09-12T02:07:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.938+0000 7f00cf223640 1 --2- 172.21.15.19:0/3625155871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b4004800 0x7f00b4004c80 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.938+0000 7f00cf223640 1 -- 172.21.15.19:0/3625155871 >> 172.21.15.19:0/3625155871 conn(0x7f00c80d44f0 msgr2=0x7f00c80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.938+0000 7f00cf223640 1 -- 172.21.15.19:0/3625155871 shutdown_connections 2024-09-12T02:07:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.938+0000 7f00cf223640 1 -- 172.21.15.19:0/3625155871 wait complete. 2024-09-12T02:07:27.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.939+0000 7f00cf223640 1 Processor -- start 2024-09-12T02:07:27.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.939+0000 7f00cf223640 1 -- start start 2024-09-12T02:07:27.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.940+0000 7f00cf223640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00b4004800 0x7f00c81f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.940+0000 7f00cf223640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00c81569f0 0x7f00c815e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.940+0000 7f00cf223640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00c81f7740 0x7f00c815e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.940+0000 7f00cf223640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f00c80b6b30 con 0x7f00c81f7740 2024-09-12T02:07:27.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.940+0000 7f00cf223640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f00c80d2aa0 con 0x7f00c81569f0 2024-09-12T02:07:27.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.940+0000 7f00cf223640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f00c80b6cb0 con 0x7f00b4004800 2024-09-12T02:07:27.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.940+0000 7f00cd7c0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00c81f7740 0x7f00c815e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.941+0000 7f00cd7c0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00c81f7740 0x7f00c815e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38256/0 (socket says 172.21.15.19:38256) 2024-09-12T02:07:27.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.941+0000 7f00cd7c0640 1 -- 172.21.15.19:0/1818719889 learned_addr learned my addr 172.21.15.19:0/1818719889 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:27.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.941+0000 7f00ccfbf640 1 --2- 172.21.15.19:0/1818719889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00b4004800 0x7f00c81f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.941+0000 7f00c7fff640 1 --2- 172.21.15.19:0/1818719889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00c81569f0 0x7f00c815e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.941+0000 7f00cd7c0640 1 -- 172.21.15.19:0/1818719889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00b4004800 msgr2=0x7f00c81f3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.941+0000 7f00cd7c0640 1 --2- 172.21.15.19:0/1818719889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00b4004800 0x7f00c81f3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.941+0000 7f00cd7c0640 1 -- 172.21.15.19:0/1818719889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00c81569f0 msgr2=0x7f00c815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.941+0000 7f00cd7c0640 1 --2- 172.21.15.19:0/1818719889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00c81569f0 0x7f00c815e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.941+0000 7f00cd7c0640 1 -- 172.21.15.19:0/1818719889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c81f4040 con 0x7f00c81f7740 2024-09-12T02:07:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.941+0000 7f00c7fff640 1 --2- 172.21.15.19:0/1818719889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00c81569f0 0x7f00c815e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.941+0000 7f00cd7c0640 1 --2- 172.21.15.19:0/1818719889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00c81f7740 0x7f00c815e960 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7f00c81635a0 tx=0x7f00c00108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.941+0000 7f00c57fa640 1 -- 172.21.15.19:0/1818719889 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c000f040 con 0x7f00c81f7740 2024-09-12T02:07:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.941+0000 7f00c57fa640 1 -- 172.21.15.19:0/1818719889 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c001b070 con 0x7f00c81f7740 2024-09-12T02:07:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.941+0000 7f00cf223640 1 -- 172.21.15.19:0/1818719889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c80b8df0 con 0x7f00c81f7740 2024-09-12T02:07:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.941+0000 7f00c57fa640 1 -- 172.21.15.19:0/1818719889 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c0015ac0 con 0x7f00c81f7740 2024-09-12T02:07:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.941+0000 7f00cf223640 1 -- 172.21.15.19:0/1818719889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c80b93b0 con 0x7f00c81f7740 2024-09-12T02:07:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.942+0000 7f00cf223640 1 -- 172.21.15.19:0/1818719889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00c80b5f70 con 0x7f00c81f7740 2024-09-12T02:07:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.943+0000 7f00c57fa640 1 -- 172.21.15.19:0/1818719889 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f00c0015c60 con 0x7f00c81f7740 2024-09-12T02:07:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.943+0000 7f00c57fa640 1 --2- 172.21.15.19:0/1818719889 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f00a806be60 0x7f00a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.943+0000 7f00c57fa640 1 -- 172.21.15.19:0/1818719889 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x7f00c008af80 con 0x7f00c81f7740 2024-09-12T02:07:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.943+0000 7f00ccfbf640 1 --2- 172.21.15.19:0/1818719889 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f00a806be60 0x7f00a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.944+0000 7f00ccfbf640 1 --2- 172.21.15.19:0/1818719889 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f00a806be60 0x7f00a806e320 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f00b8007fd0 tx=0x7f00b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:27.947+0000 7f00c57fa640 1 -- 172.21.15.19:0/1818719889 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f00c81f4040 con 0x7f00c81f7740 2024-09-12T02:07:28.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.158+0000 7f00cf223640 1 -- 172.21.15.19:0/1818719889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00c8162a60 con 0x7f00c81f7740 2024-09-12T02:07:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.158+0000 7f00c57fa640 1 -- 172.21.15.19:0/1818719889 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 337 v337) ==== 95+0+5242 (secure 0 0 0) 0x7f00c00597e0 con 0x7f00c81f7740 2024-09-12T02:07:28.159 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:28.159 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":337,"btime":"2024-09-12T02:07:23:057360+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2607300298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2607300298},{"type":"v1","addr":"172.21.15.135:6836","nonce":2607300298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":9283,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/818911002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":818911002},{"type":"v1","addr":"172.21.15.135:6837","nonce":818911002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":10650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3527496552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3527496552},{"type":"v1","addr":"172.21.15.19:6834","nonce":3527496552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327}],"filesystems":[{"mdsmap":{"epoch":337,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:07:05.517761+0000","modified":"2024-09-12T02:07:23.057352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":146,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10836":{"gid":10836,"name":"a","rank":0,"incarnation":334,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/3413662523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":3413662523},{"type":"v1","addr":"172.21.15.19:6835","nonce":3413662523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10836,"qdb_cluster":[10836]},"id":7}]} 2024-09-12T02:07:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 337 2024-09-12T02:07:28.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.161+0000 7f00cf223640 1 -- 172.21.15.19:0/1818719889 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f00a806be60 msgr2=0x7f00a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.161+0000 7f00cf223640 1 --2- 172.21.15.19:0/1818719889 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f00a806be60 0x7f00a806e320 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f00b8007fd0 tx=0x7f00b8009040 comp rx=0 tx=0).stop 2024-09-12T02:07:28.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.161+0000 7f00cf223640 1 -- 172.21.15.19:0/1818719889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00c81f7740 msgr2=0x7f00c815e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.161+0000 7f00cf223640 1 --2- 172.21.15.19:0/1818719889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00c81f7740 0x7f00c815e960 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7f00c81635a0 tx=0x7f00c00108b0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.161+0000 7f00cf223640 1 -- 172.21.15.19:0/1818719889 shutdown_connections 2024-09-12T02:07:28.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.161+0000 7f00cf223640 1 --2- 172.21.15.19:0/1818719889 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f00a806be60 0x7f00a806e320 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.161+0000 7f00cf223640 1 --2- 172.21.15.19:0/1818719889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00c81f7740 0x7f00c815e960 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.161+0000 7f00cf223640 1 --2- 172.21.15.19:0/1818719889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00c81569f0 0x7f00c815e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.161+0000 7f00cf223640 1 --2- 172.21.15.19:0/1818719889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00b4004800 0x7f00c81f3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.161+0000 7f00cf223640 1 -- 172.21.15.19:0/1818719889 >> 172.21.15.19:0/1818719889 conn(0x7f00c80d44f0 msgr2=0x7f00c80b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:28.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.161+0000 7f00cf223640 1 -- 172.21.15.19:0/1818719889 shutdown_connections 2024-09-12T02:07:28.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.161+0000 7f00cf223640 1 -- 172.21.15.19:0/1818719889 wait complete. 2024-09-12T02:07:28.172 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:07:28.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.273+0000 7f6ece065640 1 Processor -- start 2024-09-12T02:07:28.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.273+0000 7f6ece065640 1 -- start start 2024-09-12T02:07:28.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.274+0000 7f6ece065640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6ec806df60 0x7f6ec809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.274+0000 7f6ece065640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec806cec0 con 0x7f6ec809af70 2024-09-12T02:07:28.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.274+0000 7f6ece065640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec806d1a0 con 0x7f6ec815e5d0 2024-09-12T02:07:28.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.274+0000 7f6ece065640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6ec806dad0 con 0x7f6ec806df60 2024-09-12T02:07:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.274+0000 7f6ec7fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6ec809af70 0x7f6ec8168560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59148/0 (socket says 172.21.15.19:59148) 2024-09-12T02:07:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.274+0000 7f6ec7fff640 1 -- 172.21.15.19:0/1785843066 learned_addr learned my addr 172.21.15.19:0/1785843066 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.274+0000 7f6ec6ffd640 1 --2- 172.21.15.19:0/1785843066 >> v2:172.21.15.135:3300/0 conn(0x7f6ec806df60 0x7f6ec809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.274+0000 7f6ec67fc640 1 -- 172.21.15.19:0/1785843066 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1779722984 0 0) 0x7f6ec806cec0 con 0x7f6ec809af70 2024-09-12T02:07:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.274+0000 7f6ec67fc640 1 -- 172.21.15.19:0/1785843066 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6eb0003520 con 0x7f6ec809af70 2024-09-12T02:07:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.274+0000 7f6ec67fc640 1 -- 172.21.15.19:0/1785843066 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3808095698 0 0) 0x7f6ec806d1a0 con 0x7f6ec815e5d0 2024-09-12T02:07:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.274+0000 7f6ec67fc640 1 -- 172.21.15.19:0/1785843066 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ec806cec0 con 0x7f6ec815e5d0 2024-09-12T02:07:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.275+0000 7f6ec6ffd640 1 -- 172.21.15.19:0/1785843066 >> v1:172.21.15.135:6789/0 conn(0x7f6ec815e5d0 legacy=0x7f6ec80d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.275+0000 7f6ec67fc640 1 -- 172.21.15.19:0/1785843066 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 845390692 0 0) 0x7f6eb0003520 con 0x7f6ec809af70 2024-09-12T02:07:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.275+0000 7f6ec6ffd640 1 -- 172.21.15.19:0/1785843066 >> v1:172.21.15.19:6789/0 conn(0x7f6ec809af70 legacy=0x7f6ec8168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.275+0000 7f6ec6ffd640 1 -- 172.21.15.19:0/1785843066 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec806d480 con 0x7f6ec806df60 2024-09-12T02:07:28.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.275+0000 7f6ec6ffd640 1 --2- 172.21.15.19:0/1785843066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec806df60 0x7f6ec809aa30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0097a0 tx=0x7f6ebc02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7442c265c504666 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:28.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.276+0000 7f6ec67fc640 1 -- 172.21.15.19:0/1785843066 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc037070 con 0x7f6ec806df60 2024-09-12T02:07:28.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.276+0000 7f6ec67fc640 1 -- 172.21.15.19:0/1785843066 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ebc02ace0 con 0x7f6ec806df60 2024-09-12T02:07:28.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.276+0000 7f6ec67fc640 1 -- 172.21.15.19:0/1785843066 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec00019f0 con 0x7f6ec806df60 2024-09-12T02:07:28.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.276+0000 7f6ece065640 1 -- 172.21.15.19:0/1785843066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec806df60 msgr2=0x7f6ec809aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.276+0000 7f6ece065640 1 --2- 172.21.15.19:0/1785843066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec806df60 0x7f6ec809aa30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0097a0 tx=0x7f6ebc02a250 comp rx=0 tx=0).stop 2024-09-12T02:07:28.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.276+0000 7f6ece065640 1 -- 172.21.15.19:0/1785843066 shutdown_connections 2024-09-12T02:07:28.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.276+0000 7f6ece065640 1 --2- 172.21.15.19:0/1785843066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec806df60 0x7f6ec809aa30 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.276+0000 7f6ece065640 1 -- 172.21.15.19:0/1785843066 >> 172.21.15.19:0/1785843066 conn(0x7f6ec80d23a0 msgr2=0x7f6ec80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:28.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.276+0000 7f6ece065640 1 -- 172.21.15.19:0/1785843066 shutdown_connections 2024-09-12T02:07:28.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.276+0000 7f6ece065640 1 -- 172.21.15.19:0/1785843066 wait complete. 2024-09-12T02:07:28.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.277+0000 7f6ece065640 1 Processor -- start 2024-09-12T02:07:28.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.278+0000 7f6ece065640 1 -- start start 2024-09-12T02:07:28.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.278+0000 7f6ece065640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec806df60 0x7f6ec81e8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.278+0000 7f6ece065640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec809af70 0x7f6ec81f7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.278+0000 7f6ece065640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ec815e5d0 0x7f6ec80b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.278+0000 7f6ece065640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec80d1980 con 0x7f6ec815e5d0 2024-09-12T02:07:28.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.278+0000 7f6ece065640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec80d1800 con 0x7f6ec806df60 2024-09-12T02:07:28.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.278+0000 7f6ece065640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec815e9b0 con 0x7f6ec809af70 2024-09-12T02:07:28.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.278+0000 7f6ec7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ec815e5d0 0x7f6ec80b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.278+0000 7f6ec7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ec815e5d0 0x7f6ec80b5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38260/0 (socket says 172.21.15.19:38260) 2024-09-12T02:07:28.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.279+0000 7f6ec7fff640 1 -- 172.21.15.19:0/271004867 learned_addr learned my addr 172.21.15.19:0/271004867 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:28.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.279+0000 7f6ec6ffd640 1 --2- 172.21.15.19:0/271004867 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec809af70 0x7f6ec81f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.279+0000 7f6ec77fe640 1 --2- 172.21.15.19:0/271004867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec806df60 0x7f6ec81e8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.279+0000 7f6ec7fff640 1 -- 172.21.15.19:0/271004867 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec809af70 msgr2=0x7f6ec81f7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.279+0000 7f6ec7fff640 1 --2- 172.21.15.19:0/271004867 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec809af70 0x7f6ec81f7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.279+0000 7f6ec7fff640 1 -- 172.21.15.19:0/271004867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec806df60 msgr2=0x7f6ec81e8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.279+0000 7f6ec7fff640 1 --2- 172.21.15.19:0/271004867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec806df60 0x7f6ec81e8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.279+0000 7f6ec7fff640 1 -- 172.21.15.19:0/271004867 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec80b6350 con 0x7f6ec815e5d0 2024-09-12T02:07:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.279+0000 7f6ec7fff640 1 --2- 172.21.15.19:0/271004867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ec815e5d0 0x7f6ec80b5be0 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0001350 tx=0x7f6ec000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.279+0000 7f6eaffff640 1 -- 172.21.15.19:0/271004867 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0017070 con 0x7f6ec815e5d0 2024-09-12T02:07:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.279+0000 7f6eaffff640 1 -- 172.21.15.19:0/271004867 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec0012400 con 0x7f6ec815e5d0 2024-09-12T02:07:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.279+0000 7f6ece065640 1 -- 172.21.15.19:0/271004867 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec80b6630 con 0x7f6ec815e5d0 2024-09-12T02:07:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.279+0000 7f6eaffff640 1 -- 172.21.15.19:0/271004867 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0012830 con 0x7f6ec815e5d0 2024-09-12T02:07:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.279+0000 7f6ece065640 1 -- 172.21.15.19:0/271004867 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec80b6bf0 con 0x7f6ec815e5d0 2024-09-12T02:07:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.280+0000 7f6ece065640 1 -- 172.21.15.19:0/271004867 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec809aa30 con 0x7f6ec815e5d0 2024-09-12T02:07:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.281+0000 7f6eaffff640 1 -- 172.21.15.19:0/271004867 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ec001a070 con 0x7f6ec815e5d0 2024-09-12T02:07:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.281+0000 7f6eaffff640 1 --2- 172.21.15.19:0/271004867 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6eb406be30 0x7f6eb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.281+0000 7f6eaffff640 1 -- 172.21.15.19:0/271004867 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x7f6ec008aed0 con 0x7f6ec815e5d0 2024-09-12T02:07:28.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.281+0000 7f6ec77fe640 1 --2- 172.21.15.19:0/271004867 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6eb406be30 0x7f6eb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.282+0000 7f6ec77fe640 1 --2- 172.21.15.19:0/271004867 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6eb406be30 0x7f6eb406e2f0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80011e0 tx=0x7f6eb8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:28.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.285+0000 7f6eaffff640 1 -- 172.21.15.19:0/271004867 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ec0059050 con 0x7f6ec815e5d0 2024-09-12T02:07:28.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.465+0000 7f6ece065640 1 -- 172.21.15.19:0/271004867 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ec80b8320 con 0x7f6ec815e5d0 2024-09-12T02:07:28.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.467+0000 7f6eaffff640 1 -- 172.21.15.19:0/271004867 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) ==== 74+0+17061 (secure 0 0 0) 0x7f6ec005d350 con 0x7f6ec815e5d0 2024-09-12T02:07:28.468 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:28.468 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":146,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:07:19.043425+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:07:03.179551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-12T02:07:04.503322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6835/3072429339":"2024-09-13T02:07:19.043391+0000","172.21.15.19:6833/3072429339":"2024-09-13T02:07:19.043391+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:07:28.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.469+0000 7f6ece065640 1 -- 172.21.15.19:0/271004867 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6eb406be30 msgr2=0x7f6eb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.469+0000 7f6ece065640 1 --2- 172.21.15.19:0/271004867 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6eb406be30 0x7f6eb406e2f0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80011e0 tx=0x7f6eb8009040 comp rx=0 tx=0).stop 2024-09-12T02:07:28.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.469+0000 7f6ece065640 1 -- 172.21.15.19:0/271004867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ec815e5d0 msgr2=0x7f6ec80b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.469+0000 7f6ece065640 1 --2- 172.21.15.19:0/271004867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ec815e5d0 0x7f6ec80b5be0 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0001350 tx=0x7f6ec000cf90 comp rx=0 tx=0).stop 2024-09-12T02:07:28.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.469+0000 7f6ece065640 1 -- 172.21.15.19:0/271004867 shutdown_connections 2024-09-12T02:07:28.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.469+0000 7f6ece065640 1 --2- 172.21.15.19:0/271004867 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f6eb406be30 0x7f6eb406e2f0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.469+0000 7f6ece065640 1 --2- 172.21.15.19:0/271004867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ec815e5d0 0x7f6ec80b5be0 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.469+0000 7f6ece065640 1 --2- 172.21.15.19:0/271004867 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec809af70 0x7f6ec81f7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.469+0000 7f6ece065640 1 --2- 172.21.15.19:0/271004867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec806df60 0x7f6ec81e8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.469+0000 7f6ece065640 1 -- 172.21.15.19:0/271004867 >> 172.21.15.19:0/271004867 conn(0x7f6ec80d23a0 msgr2=0x7f6ec80d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:28.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.469+0000 7f6ece065640 1 -- 172.21.15.19:0/271004867 shutdown_connections 2024-09-12T02:07:28.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.469+0000 7f6ece065640 1 -- 172.21.15.19:0/271004867 wait complete. 2024-09-12T02:07:28.481 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:07:28.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.583+0000 7f76d7349640 1 Processor -- start 2024-09-12T02:07:28.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.583+0000 7f76d7349640 1 -- start start 2024-09-12T02:07:28.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.584+0000 7f76d7349640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f76d015b300 0x7f76d00cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.584+0000 7f76d7349640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76d00cdbe0 con 0x7f76d00cd3f0 2024-09-12T02:07:28.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.584+0000 7f76d7349640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76d00cd900 con 0x7f76d006f8d0 2024-09-12T02:07:28.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.584+0000 7f76d7349640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f76d00728a0 con 0x7f76d015b300 2024-09-12T02:07:28.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.584+0000 7f76d48e4640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f76d00cd3f0 0x7f76d006f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59162/0 (socket says 172.21.15.19:59162) 2024-09-12T02:07:28.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.584+0000 7f76d48e4640 1 -- 172.21.15.19:0/4110016322 learned_addr learned my addr 172.21.15.19:0/4110016322 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:28.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.584+0000 7f76d50e5640 1 --2- 172.21.15.19:0/4110016322 >> v2:172.21.15.135:3300/0 conn(0x7f76d015b300 0x7f76d00cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.585+0000 7f76cffff640 1 -- 172.21.15.19:0/4110016322 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3195273219 0 0) 0x7f76d00cdbe0 con 0x7f76d00cd3f0 2024-09-12T02:07:28.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.585+0000 7f76cffff640 1 -- 172.21.15.19:0/4110016322 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76b8003520 con 0x7f76d00cd3f0 2024-09-12T02:07:28.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.585+0000 7f76cffff640 1 -- 172.21.15.19:0/4110016322 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1492459067 0 0) 0x7f76d00cd900 con 0x7f76d006f8d0 2024-09-12T02:07:28.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.585+0000 7f76cffff640 1 -- 172.21.15.19:0/4110016322 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76d00cdbe0 con 0x7f76d006f8d0 2024-09-12T02:07:28.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.585+0000 7f76d50e5640 1 -- 172.21.15.19:0/4110016322 >> v1:172.21.15.135:6789/0 conn(0x7f76d006f8d0 legacy=0x7f76d015b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.585+0000 7f76d50e5640 1 -- 172.21.15.19:0/4110016322 >> v1:172.21.15.19:6789/0 conn(0x7f76d00cd3f0 legacy=0x7f76d006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.585+0000 7f76d50e5640 1 -- 172.21.15.19:0/4110016322 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d0072250 con 0x7f76d015b300 2024-09-12T02:07:28.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.585+0000 7f76d50e5640 1 --2- 172.21.15.19:0/4110016322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d015b300 0x7f76d00cceb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f76c0009d90 tx=0x7f76c002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf1420da28a471ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:28.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.586+0000 7f76cffff640 1 -- 172.21.15.19:0/4110016322 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c0007740 con 0x7f76d015b300 2024-09-12T02:07:28.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.586+0000 7f76cffff640 1 -- 172.21.15.19:0/4110016322 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c00078e0 con 0x7f76d015b300 2024-09-12T02:07:28.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.586+0000 7f76cffff640 1 -- 172.21.15.19:0/4110016322 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c0007c90 con 0x7f76d015b300 2024-09-12T02:07:28.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.586+0000 7f76d7349640 1 -- 172.21.15.19:0/4110016322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d015b300 msgr2=0x7f76d00cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.586+0000 7f76d7349640 1 --2- 172.21.15.19:0/4110016322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d015b300 0x7f76d00cceb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f76c0009d90 tx=0x7f76c002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.586+0000 7f76d7349640 1 -- 172.21.15.19:0/4110016322 shutdown_connections 2024-09-12T02:07:28.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.586+0000 7f76d7349640 1 --2- 172.21.15.19:0/4110016322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d015b300 0x7f76d00cceb0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.586+0000 7f76d7349640 1 -- 172.21.15.19:0/4110016322 >> 172.21.15.19:0/4110016322 conn(0x7f76d0067d70 msgr2=0x7f76d006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:28.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.586+0000 7f76d7349640 1 -- 172.21.15.19:0/4110016322 shutdown_connections 2024-09-12T02:07:28.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.586+0000 7f76d7349640 1 -- 172.21.15.19:0/4110016322 wait complete. 2024-09-12T02:07:28.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.588+0000 7f76d7349640 1 Processor -- start 2024-09-12T02:07:28.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.588+0000 7f76d7349640 1 -- start start 2024-09-12T02:07:28.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.588+0000 7f76d7349640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d006f8d0 0x7f76d01e4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.588+0000 7f76d7349640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76d00cd3f0 0x7f76d0155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.588+0000 7f76d7349640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76d015b300 0x7f76d014ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.588+0000 7f76d7349640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f76d00d0160 con 0x7f76d00cd3f0 2024-09-12T02:07:28.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.588+0000 7f76d7349640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f76d00cffe0 con 0x7f76d006f8d0 2024-09-12T02:07:28.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.588+0000 7f76d7349640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f76d0072d30 con 0x7f76d015b300 2024-09-12T02:07:28.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.588+0000 7f76d48e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76d00cd3f0 0x7f76d0155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.589+0000 7f76d48e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76d00cd3f0 0x7f76d0155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38268/0 (socket says 172.21.15.19:38268) 2024-09-12T02:07:28.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.589+0000 7f76d48e4640 1 -- 172.21.15.19:0/4176510953 learned_addr learned my addr 172.21.15.19:0/4176510953 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:28.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.589+0000 7f76d50e5640 1 --2- 172.21.15.19:0/4176510953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d006f8d0 0x7f76d01e4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.589+0000 7f76d58e6640 1 --2- 172.21.15.19:0/4176510953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76d015b300 0x7f76d014ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.589+0000 7f76d48e4640 1 -- 172.21.15.19:0/4176510953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76d015b300 msgr2=0x7f76d014ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.589+0000 7f76d48e4640 1 --2- 172.21.15.19:0/4176510953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76d015b300 0x7f76d014ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.589+0000 7f76d48e4640 1 -- 172.21.15.19:0/4176510953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d006f8d0 msgr2=0x7f76d01e4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.589+0000 7f76d48e4640 1 --2- 172.21.15.19:0/4176510953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d006f8d0 0x7f76d01e4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.589+0000 7f76d48e4640 1 -- 172.21.15.19:0/4176510953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d0154110 con 0x7f76d00cd3f0 2024-09-12T02:07:28.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.589+0000 7f76d50e5640 1 --2- 172.21.15.19:0/4176510953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d006f8d0 0x7f76d01e4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:28.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.589+0000 7f76d48e4640 1 --2- 172.21.15.19:0/4176510953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76d00cd3f0 0x7f76d0155e80 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f76c400c530 tx=0x7f76c400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:28.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.589+0000 7f76cdffb640 1 -- 172.21.15.19:0/4176510953 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4017070 con 0x7f76d00cd3f0 2024-09-12T02:07:28.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.589+0000 7f76cdffb640 1 -- 172.21.15.19:0/4176510953 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c4005ce0 con 0x7f76d00cd3f0 2024-09-12T02:07:28.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.589+0000 7f76d7349640 1 -- 172.21.15.19:0/4176510953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d01543b0 con 0x7f76d00cd3f0 2024-09-12T02:07:28.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.589+0000 7f76cdffb640 1 -- 172.21.15.19:0/4176510953 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4007270 con 0x7f76d00cd3f0 2024-09-12T02:07:28.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.589+0000 7f76d7349640 1 -- 172.21.15.19:0/4176510953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d0154970 con 0x7f76d00cd3f0 2024-09-12T02:07:28.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.590+0000 7f76d7349640 1 -- 172.21.15.19:0/4176510953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d0154b70 con 0x7f76d00cd3f0 2024-09-12T02:07:28.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.591+0000 7f76cdffb640 1 -- 172.21.15.19:0/4176510953 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76c401a070 con 0x7f76d00cd3f0 2024-09-12T02:07:28.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.591+0000 7f76cdffb640 1 --2- 172.21.15.19:0/4176510953 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f76bc06be30 0x7f76bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.591+0000 7f76cdffb640 1 -- 172.21.15.19:0/4176510953 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 6187+0+0 (secure 0 0 0) 0x7f76c408a250 con 0x7f76d00cd3f0 2024-09-12T02:07:28.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.591+0000 7f76d50e5640 1 --2- 172.21.15.19:0/4176510953 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f76bc06be30 0x7f76bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.592+0000 7f76d50e5640 1 --2- 172.21.15.19:0/4176510953 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f76bc06be30 0x7f76bc06e2f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f76c0034000 tx=0x7f76c0033040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:28.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.595+0000 7f76cdffb640 1 -- 172.21.15.19:0/4176510953 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76d0154b70 con 0x7f76d00cd3f0 2024-09-12T02:07:28.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.805+0000 7f76d7349640 1 -- 172.21.15.19:0/4176510953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f76d00b0f00 con 0x7f76d00cd3f0 2024-09-12T02:07:28.805 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T02:07:28.805+0000 7f0212744640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:07:28.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.807+0000 7f76cdffb640 1 -- 172.21.15.19:0/4176510953 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v338) ==== 161+0+0 (secure 0 0 0) 0x7f76c4058460 con 0x7f76d00cd3f0 2024-09-12T02:07:28.807 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:07:28.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.810+0000 7f76d7349640 1 -- 172.21.15.19:0/4176510953 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f76bc06be30 msgr2=0x7f76bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.810+0000 7f76d7349640 1 --2- 172.21.15.19:0/4176510953 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f76bc06be30 0x7f76bc06e2f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f76c0034000 tx=0x7f76c0033040 comp rx=0 tx=0).stop 2024-09-12T02:07:28.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.810+0000 7f76d7349640 1 -- 172.21.15.19:0/4176510953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76d00cd3f0 msgr2=0x7f76d0155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.810+0000 7f76d7349640 1 --2- 172.21.15.19:0/4176510953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76d00cd3f0 0x7f76d0155e80 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f76c400c530 tx=0x7f76c400c9f0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.810+0000 7f76d7349640 1 -- 172.21.15.19:0/4176510953 shutdown_connections 2024-09-12T02:07:28.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.810+0000 7f76d7349640 1 --2- 172.21.15.19:0/4176510953 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f76bc06be30 0x7f76bc06e2f0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.810+0000 7f76d7349640 1 --2- 172.21.15.19:0/4176510953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76d015b300 0x7f76d014ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.810+0000 7f76d7349640 1 --2- 172.21.15.19:0/4176510953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76d00cd3f0 0x7f76d0155e80 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.810+0000 7f76d7349640 1 --2- 172.21.15.19:0/4176510953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d006f8d0 0x7f76d01e4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.810+0000 7f76d7349640 1 -- 172.21.15.19:0/4176510953 >> 172.21.15.19:0/4176510953 conn(0x7f76d0067d70 msgr2=0x7f76d006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:28.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.810+0000 7f76d7349640 1 -- 172.21.15.19:0/4176510953 shutdown_connections 2024-09-12T02:07:28.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.810+0000 7f76d7349640 1 -- 172.21.15.19:0/4176510953 wait complete. 2024-09-12T02:07:28.811 INFO:tasks.ceph.mds.a.smithi019.stderr: -124> 2024-09-12T02:07:26.053+0000 7fe8bf3b5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:07:28.822 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:07:28.837 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-09-12T02:07:28.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.927+0000 7f9156cac640 1 Processor -- start 2024-09-12T02:07:28.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.927+0000 7f9156cac640 1 -- start start 2024-09-12T02:07:28.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.927+0000 7f9156cac640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9150162e30 0x7f915006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.927+0000 7f9156cac640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f91500cf280 0x7f91500d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.927+0000 7f9156cac640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f915015ff70 con 0x7f9150162340 2024-09-12T02:07:28.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.927+0000 7f9156cac640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f915006de90 con 0x7f9150162e30 2024-09-12T02:07:28.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.927+0000 7f9156cac640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f9150163270 con 0x7f91500cf280 2024-09-12T02:07:28.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.928+0000 7f914ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9150162e30 0x7f915006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.928+0000 7f9154a48640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9150162340 0x7f9150162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59182/0 (socket says 172.21.15.19:59182) 2024-09-12T02:07:28.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.928+0000 7f9154a48640 1 -- 172.21.15.19:0/400281139 learned_addr learned my addr 172.21.15.19:0/400281139 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:28.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.928+0000 7f914ffff640 1 --2- 172.21.15.19:0/400281139 >> v2:172.21.15.19:3300/0 conn(0x7f9150162e30 0x7f915006d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38298/0 (socket says 172.21.15.19:38298) 2024-09-12T02:07:28.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.928+0000 7f9155249640 1 --2- 172.21.15.19:0/400281139 >> v2:172.21.15.135:3300/0 conn(0x7f91500cf280 0x7f91500d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.928+0000 7f914ffff640 1 -- 172.21.15.19:0/400281139 >> v2:172.21.15.135:3300/0 conn(0x7f91500cf280 msgr2=0x7f91500d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:28.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.928+0000 7f914ffff640 1 --2- 172.21.15.19:0/400281139 >> v2:172.21.15.135:3300/0 conn(0x7f91500cf280 0x7f91500d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.928+0000 7f914ffff640 1 -- 172.21.15.19:0/400281139 >> v1:172.21.15.19:6789/0 conn(0x7f9150162340 legacy=0x7f9150162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.928+0000 7f914ffff640 1 -- 172.21.15.19:0/400281139 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91500d4d10 con 0x7f9150162e30 2024-09-12T02:07:28.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.929+0000 7f914ffff640 1 --2- 172.21.15.19:0/400281139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9150162e30 0x7f915006d740 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7f915006c3d0 tx=0x7f913c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6cc47983fb338d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:28.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.929+0000 7f914f7fe640 1 -- 172.21.15.19:0/400281139 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c037070 con 0x7f9150162e30 2024-09-12T02:07:28.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.929+0000 7f914f7fe640 1 -- 172.21.15.19:0/400281139 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913c032440 con 0x7f9150162e30 2024-09-12T02:07:28.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.929+0000 7f914f7fe640 1 -- 172.21.15.19:0/400281139 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c02ae60 con 0x7f9150162e30 2024-09-12T02:07:28.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.929+0000 7f9156cac640 1 -- 172.21.15.19:0/400281139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9150162e30 msgr2=0x7f915006d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.929+0000 7f9156cac640 1 --2- 172.21.15.19:0/400281139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9150162e30 0x7f915006d740 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7f915006c3d0 tx=0x7f913c02a110 comp rx=0 tx=0).stop 2024-09-12T02:07:28.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.929+0000 7f9156cac640 1 -- 172.21.15.19:0/400281139 shutdown_connections 2024-09-12T02:07:28.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.929+0000 7f9156cac640 1 --2- 172.21.15.19:0/400281139 >> v2:172.21.15.135:3300/0 conn(0x7f91500cf280 0x7f91500d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.929+0000 7f9156cac640 1 --2- 172.21.15.19:0/400281139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9150162e30 0x7f915006d740 unknown :-1 s=CLOSED pgs=2347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.929+0000 7f9156cac640 1 -- 172.21.15.19:0/400281139 >> 172.21.15.19:0/400281139 conn(0x7f915008bfc0 msgr2=0x7f91500d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:28.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.929+0000 7f9156cac640 1 -- 172.21.15.19:0/400281139 shutdown_connections 2024-09-12T02:07:28.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.929+0000 7f9156cac640 1 -- 172.21.15.19:0/400281139 wait complete. 2024-09-12T02:07:28.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.931+0000 7f9156cac640 1 Processor -- start 2024-09-12T02:07:28.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.931+0000 7f9156cac640 1 -- start start 2024-09-12T02:07:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.931+0000 7f9156cac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91500cf280 0x7f915014e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f9156cac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9150162340 0x7f91500cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f9156cac640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9150162e30 0x7f91501e8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f9156cac640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f91500cf6f0 con 0x7f91500cf280 2024-09-12T02:07:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f9156cac640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f91500d2470 con 0x7f9150162340 2024-09-12T02:07:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f9156cac640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f91500d52d0 con 0x7f9150162e30 2024-09-12T02:07:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f9154a48640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91500cf280 0x7f915014e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f9154a48640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91500cf280 0x7f915014e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38304/0 (socket says 172.21.15.19:38304) 2024-09-12T02:07:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f9154a48640 1 -- 172.21.15.19:0/1839283526 learned_addr learned my addr 172.21.15.19:0/1839283526 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f9154a48640 1 -- 172.21.15.19:0/1839283526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9150162e30 msgr2=0x7f91501e8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f9154a48640 1 --2- 172.21.15.19:0/1839283526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9150162e30 0x7f91501e8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f9154a48640 1 -- 172.21.15.19:0/1839283526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9150162340 msgr2=0x7f91500cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f914ffff640 1 --2- 172.21.15.19:0/1839283526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9150162340 0x7f91500cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f9154a48640 1 --2- 172.21.15.19:0/1839283526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9150162340 0x7f91500cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f9154a48640 1 -- 172.21.15.19:0/1839283526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91500cb5a0 con 0x7f91500cf280 2024-09-12T02:07:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f9154a48640 1 --2- 172.21.15.19:0/1839283526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91500cf280 0x7f915014e8a0 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f914400c400 tx=0x7f914400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f914d7fa640 1 -- 172.21.15.19:0/1839283526 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9144017070 con 0x7f91500cf280 2024-09-12T02:07:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f914d7fa640 1 -- 172.21.15.19:0/1839283526 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9144005ce0 con 0x7f91500cf280 2024-09-12T02:07:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f9156cac640 1 -- 172.21.15.19:0/1839283526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91500ce370 con 0x7f91500cf280 2024-09-12T02:07:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f914d7fa640 1 -- 172.21.15.19:0/1839283526 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91440072f0 con 0x7f91500cf280 2024-09-12T02:07:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.932+0000 7f9156cac640 1 -- 172.21.15.19:0/1839283526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91500b69f0 con 0x7f91500cf280 2024-09-12T02:07:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.933+0000 7f9156cac640 1 -- 172.21.15.19:0/1839283526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f915006d740 con 0x7f91500cf280 2024-09-12T02:07:28.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.934+0000 7f914d7fa640 1 -- 172.21.15.19:0/1839283526 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f914401a070 con 0x7f91500cf280 2024-09-12T02:07:28.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.934+0000 7f914d7fa640 1 --2- 172.21.15.19:0/1839283526 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f913406be30 0x7f913406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.935+0000 7f914d7fa640 1 -- 172.21.15.19:0/1839283526 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 6273+0+0 (secure 0 0 0) 0x7f914408a560 con 0x7f91500cf280 2024-09-12T02:07:28.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.935+0000 7f914ffff640 1 --2- 172.21.15.19:0/1839283526 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f913406be30 0x7f913406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.935+0000 7f914ffff640 1 --2- 172.21.15.19:0/1839283526 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f913406be30 0x7f913406e2f0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f913c034000 tx=0x7f913c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:28.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:28.939+0000 7f914d7fa640 1 -- 172.21.15.19:0/1839283526 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9144058c40 con 0x7f91500cf280 2024-09-12T02:07:29.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.152+0000 7f9156cac640 1 -- 172.21.15.19:0/1839283526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f91500ba450 con 0x7f91500cf280 2024-09-12T02:07:29.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.808+0000 7f914d7fa640 1 -- 172.21.15.19:0/1839283526 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v339) ==== 104+0+0 (secure 0 0 0) 0x7f9144058540 con 0x7f91500cf280 2024-09-12T02:07:29.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.811+0000 7f9156cac640 1 -- 172.21.15.19:0/1839283526 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f913406be30 msgr2=0x7f913406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:29.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.811+0000 7f9156cac640 1 --2- 172.21.15.19:0/1839283526 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f913406be30 0x7f913406e2f0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f913c034000 tx=0x7f913c02e000 comp rx=0 tx=0).stop 2024-09-12T02:07:29.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.811+0000 7f9156cac640 1 -- 172.21.15.19:0/1839283526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91500cf280 msgr2=0x7f915014e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:29.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.811+0000 7f9156cac640 1 --2- 172.21.15.19:0/1839283526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91500cf280 0x7f915014e8a0 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f914400c400 tx=0x7f914400c8c0 comp rx=0 tx=0).stop 2024-09-12T02:07:29.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.811+0000 7f9156cac640 1 -- 172.21.15.19:0/1839283526 shutdown_connections 2024-09-12T02:07:29.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.811+0000 7f9156cac640 1 --2- 172.21.15.19:0/1839283526 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f913406be30 0x7f913406e2f0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:29.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.811+0000 7f9156cac640 1 --2- 172.21.15.19:0/1839283526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9150162e30 0x7f91501e8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:29.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.811+0000 7f9156cac640 1 --2- 172.21.15.19:0/1839283526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9150162340 0x7f91500cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:29.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.811+0000 7f9156cac640 1 --2- 172.21.15.19:0/1839283526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91500cf280 0x7f915014e8a0 unknown :-1 s=CLOSED pgs=2348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:29.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.811+0000 7f9156cac640 1 -- 172.21.15.19:0/1839283526 >> 172.21.15.19:0/1839283526 conn(0x7f915008bfc0 msgr2=0x7f9150160b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:29.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.812+0000 7f9156cac640 1 -- 172.21.15.19:0/1839283526 shutdown_connections 2024-09-12T02:07:29.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.812+0000 7f9156cac640 1 -- 172.21.15.19:0/1839283526 wait complete. 2024-09-12T02:07:29.827 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:07:29.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.982+0000 7f4f81477640 1 Processor -- start 2024-09-12T02:07:29.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.983+0000 7f4f81477640 1 -- start start 2024-09-12T02:07:29.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.983+0000 7f4f81477640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f7c161ac0 0x7f4f7c0b2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:29.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.983+0000 7f4f81477640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4f7c0b43b0 0x7f4f7c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:29.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.983+0000 7f4f81477640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7c15eff0 con 0x7f4f7c06c150 2024-09-12T02:07:29.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.983+0000 7f4f81477640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f4f7c06c5a0 con 0x7f4f7c0b43b0 2024-09-12T02:07:29.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.983+0000 7f4f81477640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4f7c15f920 con 0x7f4f7c161ac0 2024-09-12T02:07:29.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f7b7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4f7c06c150 0x7f4f7c162290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59192/0 (socket says 172.21.15.19:59192) 2024-09-12T02:07:29.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f7b7fe640 1 -- 172.21.15.19:0/2334069118 learned_addr learned my addr 172.21.15.19:0/2334069118 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:29.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f7a7fc640 1 --2- 172.21.15.19:0/2334069118 >> v2:172.21.15.135:3300/0 conn(0x7f4f7c0b43b0 0x7f4f7c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:29.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f7affd640 1 --2- 172.21.15.19:0/2334069118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f7c161ac0 0x7f4f7c0b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:29.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f79ffb640 1 -- 172.21.15.19:0/2334069118 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 505125664 0 0) 0x7f4f7c15eff0 con 0x7f4f7c06c150 2024-09-12T02:07:29.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f79ffb640 1 -- 172.21.15.19:0/2334069118 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f64003520 con 0x7f4f7c06c150 2024-09-12T02:07:29.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f79ffb640 1 -- 172.21.15.19:0/2334069118 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 340536816 0 0) 0x7f4f64003520 con 0x7f4f7c06c150 2024-09-12T02:07:29.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f79ffb640 1 -- 172.21.15.19:0/2334069118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f7c161ac0 msgr2=0x7f4f7c0b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:29.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f79ffb640 1 --2- 172.21.15.19:0/2334069118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f7c161ac0 0x7f4f7c0b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:29.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f79ffb640 1 -- 172.21.15.19:0/2334069118 >> v2:172.21.15.135:3300/0 conn(0x7f4f7c0b43b0 msgr2=0x7f4f7c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:29.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f79ffb640 1 --2- 172.21.15.19:0/2334069118 >> v2:172.21.15.135:3300/0 conn(0x7f4f7c0b43b0 0x7f4f7c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:29.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f79ffb640 1 -- 172.21.15.19:0/2334069118 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c15f2d0 con 0x7f4f7c06c150 2024-09-12T02:07:29.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f79ffb640 1 -- 172.21.15.19:0/2334069118 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f4f740019f0 con 0x7f4f7c06c150 2024-09-12T02:07:29.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f79ffb640 1 -- 172.21.15.19:0/2334069118 >> v1:172.21.15.19:6789/0 conn(0x7f4f7c06c150 legacy=0x7f4f7c162290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:29.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f79ffb640 1 --2- 172.21.15.19:0/2334069118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f640039b0 0x7f4f64003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:29.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f79ffb640 1 --2- 172.21.15.19:0/2334069118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f64004800 0x7f4f64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:29.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f79ffb640 1 --2- 172.21.15.19:0/2334069118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f7c161ac0 0x7f4f640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:29.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f79ffb640 1 -- 172.21.15.19:0/2334069118 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c06c5a0 con 0x7f4f64004800 2024-09-12T02:07:29.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f79ffb640 1 -- 172.21.15.19:0/2334069118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c15f920 con 0x7f4f640039b0 2024-09-12T02:07:29.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f79ffb640 1 -- 172.21.15.19:0/2334069118 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4f6400b9c0 con 0x7f4f7c161ac0 2024-09-12T02:07:29.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f7a7fc640 1 --2- 172.21.15.19:0/2334069118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f64004800 0x7f4f64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:29.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f7affd640 1 --2- 172.21.15.19:0/2334069118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f640039b0 0x7f4f64003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:29.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.984+0000 7f4f7b7fe640 1 --2- 172.21.15.19:0/2334069118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f7c161ac0 0x7f4f640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:29.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.985+0000 7f4f7a7fc640 1 -- 172.21.15.19:0/2334069118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f7c161ac0 msgr2=0x7f4f640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:29.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.985+0000 7f4f7a7fc640 1 --2- 172.21.15.19:0/2334069118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f7c161ac0 0x7f4f640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:29.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.985+0000 7f4f7a7fc640 1 -- 172.21.15.19:0/2334069118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f640039b0 msgr2=0x7f4f64003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:29.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.985+0000 7f4f7a7fc640 1 --2- 172.21.15.19:0/2334069118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f640039b0 0x7f4f64003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:29.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.985+0000 7f4f7a7fc640 1 -- 172.21.15.19:0/2334069118 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f64003520 con 0x7f4f64004800 2024-09-12T02:07:29.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.985+0000 7f4f7a7fc640 1 --2- 172.21.15.19:0/2334069118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f64004800 0x7f4f64004c80 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009a90 tx=0x7f4f64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3743921c0d4d4c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:29.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.986+0000 7f4f79ffb640 1 -- 172.21.15.19:0/2334069118 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f70036070 con 0x7f4f64004800 2024-09-12T02:07:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.986+0000 7f4f79ffb640 1 -- 172.21.15.19:0/2334069118 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f70031400 con 0x7f4f64004800 2024-09-12T02:07:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.986+0000 7f4f79ffb640 1 -- 172.21.15.19:0/2334069118 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f70009690 con 0x7f4f64004800 2024-09-12T02:07:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.986+0000 7f4f81477640 1 -- 172.21.15.19:0/2334069118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f64004800 msgr2=0x7f4f64004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.986+0000 7f4f81477640 1 --2- 172.21.15.19:0/2334069118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f64004800 0x7f4f64004c80 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009a90 tx=0x7f4f64005830 comp rx=0 tx=0).stop 2024-09-12T02:07:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.986+0000 7f4f7b7fe640 1 -- 172.21.15.19:0/2334069118 reap_dead start 2024-09-12T02:07:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.986+0000 7f4f81477640 1 -- 172.21.15.19:0/2334069118 shutdown_connections 2024-09-12T02:07:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.986+0000 7f4f81477640 1 -- 172.21.15.19:0/2334069118 >> 172.21.15.19:0/2334069118 conn(0x7f4f7c09aa30 msgr2=0x7f4f7c0b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.986+0000 7f4f81477640 1 -- 172.21.15.19:0/2334069118 shutdown_connections 2024-09-12T02:07:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.986+0000 7f4f81477640 1 -- 172.21.15.19:0/2334069118 wait complete. 2024-09-12T02:07:29.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.988+0000 7f4f81477640 1 Processor -- start 2024-09-12T02:07:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.988+0000 7f4f81477640 1 -- start start 2024-09-12T02:07:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f81477640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f64004800 0x7f4f7c15a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f81477640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f7c1428c0 0x7f4f7c0ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f81477640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f7c0ae7f0 0x7f4f7c0b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f81477640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c161ea0 con 0x7f4f64004800 2024-09-12T02:07:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f81477640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c15ece0 con 0x7f4f7c0ae7f0 2024-09-12T02:07:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f81477640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4f7c162020 con 0x7f4f7c1428c0 2024-09-12T02:07:29.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f7affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f64004800 0x7f4f7c15a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:29.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f7affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f64004800 0x7f4f7c15a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38314/0 (socket says 172.21.15.19:38314) 2024-09-12T02:07:29.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f7affd640 1 -- 172.21.15.19:0/2906388316 learned_addr learned my addr 172.21.15.19:0/2906388316 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:29.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f7b7fe640 1 --2- 172.21.15.19:0/2906388316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f7c0ae7f0 0x7f4f7c0b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:29.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f7a7fc640 1 --2- 172.21.15.19:0/2906388316 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f7c1428c0 0x7f4f7c0ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:29.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f7affd640 1 -- 172.21.15.19:0/2906388316 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f7c1428c0 msgr2=0x7f4f7c0ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:29.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f7affd640 1 --2- 172.21.15.19:0/2906388316 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f7c1428c0 0x7f4f7c0ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:29.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f7affd640 1 -- 172.21.15.19:0/2906388316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f7c0ae7f0 msgr2=0x7f4f7c0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:29.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f7affd640 1 --2- 172.21.15.19:0/2906388316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f7c0ae7f0 0x7f4f7c0b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:29.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f7affd640 1 -- 172.21.15.19:0/2906388316 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c0b1960 con 0x7f4f64004800 2024-09-12T02:07:29.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f7affd640 1 --2- 172.21.15.19:0/2906388316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f64004800 0x7f4f7c15a430 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c011910 tx=0x7f4f6c011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:29.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f637fe640 1 -- 172.21.15.19:0/2906388316 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c00fa30 con 0x7f4f64004800 2024-09-12T02:07:29.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f637fe640 1 -- 172.21.15.19:0/2906388316 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f6c00fbd0 con 0x7f4f64004800 2024-09-12T02:07:29.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f81477640 1 -- 172.21.15.19:0/2906388316 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7c1550e0 con 0x7f4f64004800 2024-09-12T02:07:29.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f637fe640 1 -- 172.21.15.19:0/2906388316 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c014440 con 0x7f4f64004800 2024-09-12T02:07:29.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.989+0000 7f4f81477640 1 -- 172.21.15.19:0/2906388316 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f7c1556a0 con 0x7f4f64004800 2024-09-12T02:07:29.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.991+0000 7f4f81477640 1 -- 172.21.15.19:0/2906388316 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f7c06bc10 con 0x7f4f64004800 2024-09-12T02:07:29.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.991+0000 7f4f637fe640 1 -- 172.21.15.19:0/2906388316 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f6c012040 con 0x7f4f64004800 2024-09-12T02:07:29.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.991+0000 7f4f637fe640 1 --2- 172.21.15.19:0/2906388316 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4f6806be60 0x7f4f6806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:29.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.992+0000 7f4f637fe640 1 -- 172.21.15.19:0/2906388316 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 6273+0+0 (secure 0 0 0) 0x7f4f6c08b370 con 0x7f4f64004800 2024-09-12T02:07:29.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.992+0000 7f4f7a7fc640 1 --2- 172.21.15.19:0/2906388316 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4f6806be60 0x7f4f6806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:29.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.992+0000 7f4f7a7fc640 1 --2- 172.21.15.19:0/2906388316 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4f6806be60 0x7f4f6806e320 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f4f70033000 tx=0x7f4f70008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:29.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:29.996+0000 7f4f637fe640 1 -- 172.21.15.19:0/2906388316 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f6c019030 con 0x7f4f64004800 2024-09-12T02:07:30.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.172+0000 7f4f81477640 1 -- 172.21.15.19:0/2906388316 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4f7c0aebd0 con 0x7f4f64004800 2024-09-12T02:07:30.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.814+0000 7f4f637fe640 1 -- 172.21.15.19:0/2906388316 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v148) ==== 181+0+0 (secure 0 0 0) 0x7f4f6c059b70 con 0x7f4f64004800 2024-09-12T02:07:30.814 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:07:30.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.816+0000 7f4f81477640 1 -- 172.21.15.19:0/2906388316 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4f6806be60 msgr2=0x7f4f6806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:30.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.816+0000 7f4f81477640 1 --2- 172.21.15.19:0/2906388316 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4f6806be60 0x7f4f6806e320 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f4f70033000 tx=0x7f4f70008030 comp rx=0 tx=0).stop 2024-09-12T02:07:30.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.816+0000 7f4f81477640 1 -- 172.21.15.19:0/2906388316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f64004800 msgr2=0x7f4f7c15a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:30.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.816+0000 7f4f81477640 1 --2- 172.21.15.19:0/2906388316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f64004800 0x7f4f7c15a430 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c011910 tx=0x7f4f6c011d10 comp rx=0 tx=0).stop 2024-09-12T02:07:30.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.816+0000 7f4f81477640 1 -- 172.21.15.19:0/2906388316 shutdown_connections 2024-09-12T02:07:30.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.816+0000 7f4f81477640 1 --2- 172.21.15.19:0/2906388316 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f4f6806be60 0x7f4f6806e320 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:30.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.816+0000 7f4f81477640 1 --2- 172.21.15.19:0/2906388316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f7c0ae7f0 0x7f4f7c0b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:30.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.816+0000 7f4f81477640 1 --2- 172.21.15.19:0/2906388316 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f7c1428c0 0x7f4f7c0ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:30.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.816+0000 7f4f81477640 1 --2- 172.21.15.19:0/2906388316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f64004800 0x7f4f7c15a430 unknown :-1 s=CLOSED pgs=2351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:30.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.816+0000 7f4f81477640 1 -- 172.21.15.19:0/2906388316 >> 172.21.15.19:0/2906388316 conn(0x7f4f7c09aa30 msgr2=0x7f4f7c1536a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:30.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.817+0000 7f4f81477640 1 -- 172.21.15.19:0/2906388316 shutdown_connections 2024-09-12T02:07:30.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.817+0000 7f4f81477640 1 -- 172.21.15.19:0/2906388316 wait complete. 2024-09-12T02:07:30.833 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:07:30.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.946+0000 7fd668e8d640 1 Processor -- start 2024-09-12T02:07:30.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.946+0000 7fd668e8d640 1 -- start start 2024-09-12T02:07:30.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.947+0000 7fd668e8d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd664162340 0x7fd66406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:30.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.947+0000 7fd668e8d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6640cf280 0x7fd664162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:30.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.947+0000 7fd668e8d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66415ff70 con 0x7fd664162c60 2024-09-12T02:07:30.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.947+0000 7fd668e8d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd66406de90 con 0x7fd664162340 2024-09-12T02:07:30.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.947+0000 7fd668e8d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd6640d4d10 con 0x7fd6640cf280 2024-09-12T02:07:30.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.947+0000 7fd66259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd664162340 0x7fd66406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:30.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.947+0000 7fd66259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd664162340 0x7fd66406d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38328/0 (socket says 172.21.15.19:38328) 2024-09-12T02:07:30.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.947+0000 7fd66259c640 1 -- 172.21.15.19:0/2767489431 learned_addr learned my addr 172.21.15.19:0/2767489431 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:30.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.947+0000 7fd66259c640 1 -- 172.21.15.19:0/2767489431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6640cf280 msgr2=0x7fd664162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:30.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.947+0000 7fd65bfff640 1 --2- 172.21.15.19:0/2767489431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6640cf280 0x7fd664162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:30.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.947+0000 7fd66259c640 1 --2- 172.21.15.19:0/2767489431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6640cf280 0x7fd664162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:30.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.947+0000 7fd66259c640 1 -- 172.21.15.19:0/2767489431 >> v1:172.21.15.135:6789/0 conn(0x7fd664162c60 legacy=0x7fd6640d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:30.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.947+0000 7fd66259c640 1 -- 172.21.15.19:0/2767489431 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6640d4ff0 con 0x7fd664162340 2024-09-12T02:07:30.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.947+0000 7fd65bfff640 1 --2- 172.21.15.19:0/2767489431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6640cf280 0x7fd664162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:30.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.948+0000 7fd66259c640 1 --2- 172.21.15.19:0/2767489431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd664162340 0x7fd66406d740 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7fd654009870 tx=0x7fd65402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6191068b6a46b180 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:30.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.948+0000 7fd661d9b640 1 -- 172.21.15.19:0/2767489431 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654037070 con 0x7fd664162340 2024-09-12T02:07:30.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.948+0000 7fd661d9b640 1 -- 172.21.15.19:0/2767489431 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd654032440 con 0x7fd664162340 2024-09-12T02:07:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.948+0000 7fd661d9b640 1 -- 172.21.15.19:0/2767489431 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654032810 con 0x7fd664162340 2024-09-12T02:07:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.949+0000 7fd668e8d640 1 -- 172.21.15.19:0/2767489431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd664162340 msgr2=0x7fd66406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.949+0000 7fd668e8d640 1 --2- 172.21.15.19:0/2767489431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd664162340 0x7fd66406d740 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7fd654009870 tx=0x7fd65402a180 comp rx=0 tx=0).stop 2024-09-12T02:07:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.949+0000 7fd668e8d640 1 -- 172.21.15.19:0/2767489431 shutdown_connections 2024-09-12T02:07:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.949+0000 7fd668e8d640 1 --2- 172.21.15.19:0/2767489431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6640cf280 0x7fd664162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.949+0000 7fd668e8d640 1 --2- 172.21.15.19:0/2767489431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd664162340 0x7fd66406d740 unknown :-1 s=CLOSED pgs=2352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.949+0000 7fd668e8d640 1 -- 172.21.15.19:0/2767489431 >> 172.21.15.19:0/2767489431 conn(0x7fd66408bfc0 msgr2=0x7fd6640d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.949+0000 7fd668e8d640 1 -- 172.21.15.19:0/2767489431 shutdown_connections 2024-09-12T02:07:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.949+0000 7fd668e8d640 1 -- 172.21.15.19:0/2767489431 wait complete. 2024-09-12T02:07:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.950+0000 7fd668e8d640 1 Processor -- start 2024-09-12T02:07:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.950+0000 7fd668e8d640 1 -- start start 2024-09-12T02:07:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.951+0000 7fd668e8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6640cf280 0x7fd6640b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.951+0000 7fd668e8d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd664162340 0x7fd6641518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:30.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.951+0000 7fd668e8d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd664162c60 0x7fd6640b8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:30.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.951+0000 7fd668e8d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd6640cf6c0 con 0x7fd6640cf280 2024-09-12T02:07:30.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.951+0000 7fd668e8d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd6640d52d0 con 0x7fd664162340 2024-09-12T02:07:30.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.951+0000 7fd668e8d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd6641630f0 con 0x7fd664162c60 2024-09-12T02:07:30.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.951+0000 7fd66259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6640cf280 0x7fd6640b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:30.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.951+0000 7fd66259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6640cf280 0x7fd6640b6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38330/0 (socket says 172.21.15.19:38330) 2024-09-12T02:07:30.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.951+0000 7fd66259c640 1 -- 172.21.15.19:0/1296284840 learned_addr learned my addr 172.21.15.19:0/1296284840 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:30.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.951+0000 7fd65bfff640 1 --2- 172.21.15.19:0/1296284840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd664162340 0x7fd6641518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:30.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.951+0000 7fd662d9d640 1 --2- 172.21.15.19:0/1296284840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd664162c60 0x7fd6640b8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:30.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.952+0000 7fd66259c640 1 -- 172.21.15.19:0/1296284840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd664162c60 msgr2=0x7fd6640b8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:30.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.952+0000 7fd66259c640 1 --2- 172.21.15.19:0/1296284840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd664162c60 0x7fd6640b8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:30.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.952+0000 7fd66259c640 1 -- 172.21.15.19:0/1296284840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd664162340 msgr2=0x7fd6641518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:30.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.952+0000 7fd66259c640 1 --2- 172.21.15.19:0/1296284840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd664162340 0x7fd6641518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:30.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.952+0000 7fd66259c640 1 -- 172.21.15.19:0/1296284840 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6640ba260 con 0x7fd6640cf280 2024-09-12T02:07:30.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.952+0000 7fd66259c640 1 --2- 172.21.15.19:0/1296284840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6640cf280 0x7fd6640b6a40 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7fd654000c00 tx=0x7fd6540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:30.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.952+0000 7fd65affd640 1 -- 172.21.15.19:0/1296284840 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654041070 con 0x7fd6640cf280 2024-09-12T02:07:30.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.952+0000 7fd65affd640 1 -- 172.21.15.19:0/1296284840 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd65403c870 con 0x7fd6640cf280 2024-09-12T02:07:30.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.952+0000 7fd668e8d640 1 -- 172.21.15.19:0/1296284840 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6640b7790 con 0x7fd6640cf280 2024-09-12T02:07:30.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.952+0000 7fd65affd640 1 -- 172.21.15.19:0/1296284840 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654037040 con 0x7fd6640cf280 2024-09-12T02:07:30.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.952+0000 7fd668e8d640 1 -- 172.21.15.19:0/1296284840 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6640b9f80 con 0x7fd6640cf280 2024-09-12T02:07:30.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.953+0000 7fd668e8d640 1 -- 172.21.15.19:0/1296284840 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd664162720 con 0x7fd6640cf280 2024-09-12T02:07:30.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.953+0000 7fd65affd640 1 -- 172.21.15.19:0/1296284840 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd654044070 con 0x7fd6640cf280 2024-09-12T02:07:30.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.954+0000 7fd65affd640 1 --2- 172.21.15.19:0/1296284840 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd64406be30 0x7fd64406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:30.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.954+0000 7fd65affd640 1 -- 172.21.15.19:0/1296284840 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 5835+0+0 (secure 0 0 0) 0x7fd6540ab940 con 0x7fd6640cf280 2024-09-12T02:07:30.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.954+0000 7fd65bfff640 1 --2- 172.21.15.19:0/1296284840 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd64406be30 0x7fd64406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:30.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.955+0000 7fd65bfff640 1 --2- 172.21.15.19:0/1296284840 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd64406be30 0x7fd64406e2f0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fd6641ea710 tx=0x7fd64c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:30.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:30.958+0000 7fd65affd640 1 -- 172.21.15.19:0/1296284840 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd654079d40 con 0x7fd6640cf280 2024-09-12T02:07:31.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.132+0000 7fd668e8d640 1 -- 172.21.15.19:0/1296284840 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd6640b4290 con 0x7fd6640cf280 2024-09-12T02:07:31.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.821+0000 7fd65affd640 1 -- 172.21.15.19:0/1296284840 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v149) ==== 169+0+0 (secure 0 0 0) 0x7fd65407e040 con 0x7fd6640cf280 2024-09-12T02:07:31.822 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-09-12T02:07:31.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.824+0000 7fd668e8d640 1 -- 172.21.15.19:0/1296284840 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd64406be30 msgr2=0x7fd64406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:31.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.824+0000 7fd668e8d640 1 --2- 172.21.15.19:0/1296284840 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd64406be30 0x7fd64406e2f0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fd6641ea710 tx=0x7fd64c008040 comp rx=0 tx=0).stop 2024-09-12T02:07:31.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.824+0000 7fd668e8d640 1 -- 172.21.15.19:0/1296284840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6640cf280 msgr2=0x7fd6640b6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:31.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.824+0000 7fd668e8d640 1 --2- 172.21.15.19:0/1296284840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6640cf280 0x7fd6640b6a40 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7fd654000c00 tx=0x7fd6540046c0 comp rx=0 tx=0).stop 2024-09-12T02:07:31.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.824+0000 7fd668e8d640 1 -- 172.21.15.19:0/1296284840 shutdown_connections 2024-09-12T02:07:31.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.824+0000 7fd668e8d640 1 --2- 172.21.15.19:0/1296284840 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd64406be30 0x7fd64406e2f0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:31.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.824+0000 7fd668e8d640 1 --2- 172.21.15.19:0/1296284840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd664162c60 0x7fd6640b8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:31.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.824+0000 7fd668e8d640 1 --2- 172.21.15.19:0/1296284840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd664162340 0x7fd6641518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:31.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.824+0000 7fd668e8d640 1 --2- 172.21.15.19:0/1296284840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6640cf280 0x7fd6640b6a40 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:31.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.824+0000 7fd668e8d640 1 -- 172.21.15.19:0/1296284840 >> 172.21.15.19:0/1296284840 conn(0x7fd66408bfc0 msgr2=0x7fd664161440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:31.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.824+0000 7fd668e8d640 1 -- 172.21.15.19:0/1296284840 shutdown_connections 2024-09-12T02:07:31.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.824+0000 7fd668e8d640 1 -- 172.21.15.19:0/1296284840 wait complete. 2024-09-12T02:07:31.842 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:07:31.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.953+0000 7fc967903640 1 Processor -- start 2024-09-12T02:07:31.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.953+0000 7fc967903640 1 -- start start 2024-09-12T02:07:31.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.954+0000 7fc967903640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc960155930 0x7fc9600addd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:31.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.954+0000 7fc967903640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc9600d0a80 0x7fc96015bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:31.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.954+0000 7fc967903640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc96015c1e0 con 0x7fc96015b720 2024-09-12T02:07:31.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.954+0000 7fc967903640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fc96015c4c0 con 0x7fc9600d0a80 2024-09-12T02:07:31.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.954+0000 7fc967903640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc9600b3340 con 0x7fc960155930 2024-09-12T02:07:31.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.954+0000 7fc965ea0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc9600d0a80 0x7fc96015bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:31.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.954+0000 7fc964e9e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc96015b720 0x7fc9600d0370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57632/0 (socket says 172.21.15.19:57632) 2024-09-12T02:07:31.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.954+0000 7fc964e9e640 1 -- 172.21.15.19:0/3614208349 learned_addr learned my addr 172.21.15.19:0/3614208349 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:31.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.954+0000 7fc96569f640 1 --2- 172.21.15.19:0/3614208349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc960155930 0x7fc9600addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:31.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.954+0000 7fc965ea0640 1 -- 172.21.15.19:0/3614208349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc960155930 msgr2=0x7fc9600addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:31.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.954+0000 7fc965ea0640 1 --2- 172.21.15.19:0/3614208349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc960155930 0x7fc9600addd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:31.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.954+0000 7fc965ea0640 1 -- 172.21.15.19:0/3614208349 >> v1:172.21.15.19:6789/0 conn(0x7fc96015b720 legacy=0x7fc9600d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:31.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.954+0000 7fc965ea0640 1 -- 172.21.15.19:0/3614208349 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9600b3620 con 0x7fc9600d0a80 2024-09-12T02:07:31.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.954+0000 7fc957fff640 1 -- 172.21.15.19:0/3614208349 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2771102676 0 0) 0x7fc96015c1e0 con 0x7fc96015b720 2024-09-12T02:07:31.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.955+0000 7fc965ea0640 1 --2- 172.21.15.19:0/3614208349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9600d0a80 0x7fc96015bb80 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7fc958009d90 tx=0x7fc95802c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5287d5c4dda8f533 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.955+0000 7fc957fff640 1 -- 172.21.15.19:0/3614208349 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc958032770 con 0x7fc9600d0a80 2024-09-12T02:07:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.955+0000 7fc957fff640 1 -- 172.21.15.19:0/3614208349 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc958038070 con 0x7fc9600d0a80 2024-09-12T02:07:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.955+0000 7fc957fff640 1 -- 172.21.15.19:0/3614208349 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc958032b30 con 0x7fc9600d0a80 2024-09-12T02:07:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.956+0000 7fc967903640 1 -- 172.21.15.19:0/3614208349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9600d0a80 msgr2=0x7fc96015bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.956+0000 7fc967903640 1 --2- 172.21.15.19:0/3614208349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9600d0a80 0x7fc96015bb80 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7fc958009d90 tx=0x7fc95802c870 comp rx=0 tx=0).stop 2024-09-12T02:07:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.956+0000 7fc967903640 1 -- 172.21.15.19:0/3614208349 shutdown_connections 2024-09-12T02:07:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.956+0000 7fc967903640 1 --2- 172.21.15.19:0/3614208349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9600d0a80 0x7fc96015bb80 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.956+0000 7fc967903640 1 --2- 172.21.15.19:0/3614208349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc960155930 0x7fc9600addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.956+0000 7fc967903640 1 -- 172.21.15.19:0/3614208349 >> 172.21.15.19:0/3614208349 conn(0x7fc96006bdf0 msgr2=0x7fc96006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.956+0000 7fc967903640 1 -- 172.21.15.19:0/3614208349 shutdown_connections 2024-09-12T02:07:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.956+0000 7fc967903640 1 -- 172.21.15.19:0/3614208349 wait complete. 2024-09-12T02:07:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.957+0000 7fc967903640 1 Processor -- start 2024-09-12T02:07:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.957+0000 7fc967903640 1 -- start start 2024-09-12T02:07:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.958+0000 7fc967903640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9600d0a80 0x7fc9601e9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.958+0000 7fc967903640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc960155930 0x7fc96015a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.958+0000 7fc967903640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc96015b720 0x7fc96015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.958+0000 7fc967903640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc9600ae490 con 0x7fc96015b720 2024-09-12T02:07:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.958+0000 7fc967903640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc9600ae310 con 0x7fc960155930 2024-09-12T02:07:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.958+0000 7fc967903640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc9600b3b40 con 0x7fc9600d0a80 2024-09-12T02:07:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.958+0000 7fc965ea0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc96015b720 0x7fc96015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.958+0000 7fc965ea0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc96015b720 0x7fc96015a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49714/0 (socket says 172.21.15.19:49714) 2024-09-12T02:07:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.958+0000 7fc965ea0640 1 -- 172.21.15.19:0/3108803814 learned_addr learned my addr 172.21.15.19:0/3108803814 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:31.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.958+0000 7fc96569f640 1 --2- 172.21.15.19:0/3108803814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9600d0a80 0x7fc9601e9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:31.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.958+0000 7fc965ea0640 1 -- 172.21.15.19:0/3108803814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9600d0a80 msgr2=0x7fc9601e9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:31.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.958+0000 7fc965ea0640 1 --2- 172.21.15.19:0/3108803814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9600d0a80 0x7fc9601e9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:31.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.958+0000 7fc964e9e640 1 --2- 172.21.15.19:0/3108803814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc960155930 0x7fc96015a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:31.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.958+0000 7fc965ea0640 1 -- 172.21.15.19:0/3108803814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc960155930 msgr2=0x7fc96015a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:31.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.958+0000 7fc965ea0640 1 --2- 172.21.15.19:0/3108803814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc960155930 0x7fc96015a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:31.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.958+0000 7fc965ea0640 1 -- 172.21.15.19:0/3108803814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9600cf400 con 0x7fc96015b720 2024-09-12T02:07:31.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.958+0000 7fc96569f640 1 --2- 172.21.15.19:0/3108803814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9600d0a80 0x7fc9601e9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:31.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.958+0000 7fc964e9e640 1 --2- 172.21.15.19:0/3108803814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc960155930 0x7fc96015a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:31.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.959+0000 7fc965ea0640 1 --2- 172.21.15.19:0/3108803814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc96015b720 0x7fc96015a660 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7fc958009d90 tx=0x7fc958004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:31.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.959+0000 7fc955ffb640 1 -- 172.21.15.19:0/3108803814 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc958003b90 con 0x7fc96015b720 2024-09-12T02:07:31.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.959+0000 7fc955ffb640 1 -- 172.21.15.19:0/3108803814 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc958003d50 con 0x7fc96015b720 2024-09-12T02:07:31.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.959+0000 7fc967903640 1 -- 172.21.15.19:0/3108803814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9601f5490 con 0x7fc96015b720 2024-09-12T02:07:31.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.959+0000 7fc955ffb640 1 -- 172.21.15.19:0/3108803814 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc958004270 con 0x7fc96015b720 2024-09-12T02:07:31.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.959+0000 7fc967903640 1 -- 172.21.15.19:0/3108803814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9601f5a50 con 0x7fc96015b720 2024-09-12T02:07:31.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.960+0000 7fc967903640 1 -- 172.21.15.19:0/3108803814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc960072850 con 0x7fc96015b720 2024-09-12T02:07:31.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.960+0000 7fc955ffb640 1 -- 172.21.15.19:0/3108803814 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc958032070 con 0x7fc96015b720 2024-09-12T02:07:31.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.961+0000 7fc955ffb640 1 --2- 172.21.15.19:0/3108803814 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc94406be60 0x7fc94406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:31.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.961+0000 7fc955ffb640 1 -- 172.21.15.19:0/3108803814 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7fc9580ab170 con 0x7fc96015b720 2024-09-12T02:07:31.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.961+0000 7fc96569f640 1 --2- 172.21.15.19:0/3108803814 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc94406be60 0x7fc94406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:31.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.962+0000 7fc96569f640 1 --2- 172.21.15.19:0/3108803814 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc94406be60 0x7fc94406e320 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fc95c006fd0 tx=0x7fc95c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:31.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:31.965+0000 7fc955ffb640 1 -- 172.21.15.19:0/3108803814 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc960072850 con 0x7fc96015b720 2024-09-12T02:07:32.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.142+0000 7fc967903640 1 -- 172.21.15.19:0/3108803814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fc96015bb80 con 0x7fc96015b720 2024-09-12T02:07:32.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.145+0000 7fc955ffb640 1 -- 172.21.15.19:0/3108803814 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7fc958079600 con 0x7fc96015b720 2024-09-12T02:07:32.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.148+0000 7fc967903640 1 -- 172.21.15.19:0/3108803814 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc94406be60 msgr2=0x7fc94406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:32.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.148+0000 7fc967903640 1 --2- 172.21.15.19:0/3108803814 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc94406be60 0x7fc94406e320 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fc95c006fd0 tx=0x7fc95c008040 comp rx=0 tx=0).stop 2024-09-12T02:07:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.148+0000 7fc967903640 1 -- 172.21.15.19:0/3108803814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc96015b720 msgr2=0x7fc96015a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.148+0000 7fc967903640 1 --2- 172.21.15.19:0/3108803814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc96015b720 0x7fc96015a660 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7fc958009d90 tx=0x7fc958004ab0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.148+0000 7fc967903640 1 -- 172.21.15.19:0/3108803814 shutdown_connections 2024-09-12T02:07:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.148+0000 7fc967903640 1 --2- 172.21.15.19:0/3108803814 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc94406be60 0x7fc94406e320 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.148+0000 7fc967903640 1 --2- 172.21.15.19:0/3108803814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc96015b720 0x7fc96015a660 unknown :-1 s=CLOSED pgs=2356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.148+0000 7fc967903640 1 --2- 172.21.15.19:0/3108803814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc960155930 0x7fc96015a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.148+0000 7fc967903640 1 --2- 172.21.15.19:0/3108803814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9600d0a80 0x7fc9601e9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.148+0000 7fc967903640 1 -- 172.21.15.19:0/3108803814 >> 172.21.15.19:0/3108803814 conn(0x7fc96006bdf0 msgr2=0x7fc960153f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.148+0000 7fc967903640 1 -- 172.21.15.19:0/3108803814 shutdown_connections 2024-09-12T02:07:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.148+0000 7fc967903640 1 -- 172.21.15.19:0/3108803814 wait complete. 2024-09-12T02:07:32.159 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_damage.TestDamage.test_open_ino_errors' 2024-09-12T02:07:32.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.262+0000 7fad638a6640 1 Processor -- start 2024-09-12T02:07:32.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.262+0000 7fad638a6640 1 -- start start 2024-09-12T02:07:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.263+0000 7fad638a6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fad5c072320 0x7fad5c0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.263+0000 7fad638a6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad5c146140 con 0x7fad5c072de0 2024-09-12T02:07:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.263+0000 7fad638a6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad5c06eed0 con 0x7fad5c15e1f0 2024-09-12T02:07:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.263+0000 7fad638a6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fad5c0cd740 con 0x7fad5c072320 2024-09-12T02:07:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.263+0000 7fad60e41640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fad5c072de0 0x7fad5c06e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57648/0 (socket says 172.21.15.19:57648) 2024-09-12T02:07:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.263+0000 7fad60e41640 1 -- 172.21.15.19:0/2790598429 learned_addr learned my addr 172.21.15.19:0/2790598429 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:32.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.263+0000 7fad61642640 1 --2- 172.21.15.19:0/2790598429 >> v2:172.21.15.135:3300/0 conn(0x7fad5c072320 0x7fad5c0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.263+0000 7fad53fff640 1 -- 172.21.15.19:0/2790598429 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3392079465 0 0) 0x7fad5c146140 con 0x7fad5c072de0 2024-09-12T02:07:32.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.263+0000 7fad53fff640 1 -- 172.21.15.19:0/2790598429 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad48003520 con 0x7fad5c072de0 2024-09-12T02:07:32.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.263+0000 7fad61642640 1 -- 172.21.15.19:0/2790598429 >> v1:172.21.15.135:6789/0 conn(0x7fad5c15e1f0 legacy=0x7fad5c06e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:32.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.263+0000 7fad61642640 1 -- 172.21.15.19:0/2790598429 >> v1:172.21.15.19:6789/0 conn(0x7fad5c072de0 legacy=0x7fad5c06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:32.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.263+0000 7fad61642640 1 -- 172.21.15.19:0/2790598429 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5c0cda20 con 0x7fad5c072320 2024-09-12T02:07:32.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.264+0000 7fad61642640 1 --2- 172.21.15.19:0/2790598429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad5c072320 0x7fad5c0cce60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fad580097a0 tx=0x7fad5802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8ac773902e06247 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:32.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.264+0000 7fad53fff640 1 -- 172.21.15.19:0/2790598429 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad58037070 con 0x7fad5c072320 2024-09-12T02:07:32.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.264+0000 7fad53fff640 1 -- 172.21.15.19:0/2790598429 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad5802adc0 con 0x7fad5c072320 2024-09-12T02:07:32.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.264+0000 7fad53fff640 1 -- 172.21.15.19:0/2790598429 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad58032660 con 0x7fad5c072320 2024-09-12T02:07:32.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.265+0000 7fad638a6640 1 -- 172.21.15.19:0/2790598429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad5c072320 msgr2=0x7fad5c0cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:32.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.265+0000 7fad638a6640 1 --2- 172.21.15.19:0/2790598429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad5c072320 0x7fad5c0cce60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fad580097a0 tx=0x7fad5802a130 comp rx=0 tx=0).stop 2024-09-12T02:07:32.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.265+0000 7fad638a6640 1 -- 172.21.15.19:0/2790598429 shutdown_connections 2024-09-12T02:07:32.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.265+0000 7fad638a6640 1 --2- 172.21.15.19:0/2790598429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad5c072320 0x7fad5c0cce60 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.265+0000 7fad638a6640 1 -- 172.21.15.19:0/2790598429 >> 172.21.15.19:0/2790598429 conn(0x7fad5c067d70 msgr2=0x7fad5c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:32.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.265+0000 7fad638a6640 1 -- 172.21.15.19:0/2790598429 shutdown_connections 2024-09-12T02:07:32.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.265+0000 7fad638a6640 1 -- 172.21.15.19:0/2790598429 wait complete. 2024-09-12T02:07:32.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.266+0000 7fad638a6640 1 Processor -- start 2024-09-12T02:07:32.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.266+0000 7fad638a6640 1 -- start start 2024-09-12T02:07:32.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.267+0000 7fad638a6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad5c072320 0x7fad5c1f5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.267+0000 7fad638a6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad5c072de0 0x7fad5c1e3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.267+0000 7fad638a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad5c15e1f0 0x7fad5c15b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.267+0000 7fad638a6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fad5c0cd3a0 con 0x7fad5c15e1f0 2024-09-12T02:07:32.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.267+0000 7fad638a6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad5c15c9e0 con 0x7fad5c072320 2024-09-12T02:07:32.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.267+0000 7fad638a6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fad5c0cd520 con 0x7fad5c072de0 2024-09-12T02:07:32.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.267+0000 7fad61e43640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad5c15e1f0 0x7fad5c15b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.267+0000 7fad61e43640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad5c15e1f0 0x7fad5c15b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49726/0 (socket says 172.21.15.19:49726) 2024-09-12T02:07:32.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.267+0000 7fad61e43640 1 -- 172.21.15.19:0/1562119822 learned_addr learned my addr 172.21.15.19:0/1562119822 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:32.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.267+0000 7fad60e41640 1 --2- 172.21.15.19:0/1562119822 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad5c072de0 0x7fad5c1e3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.267+0000 7fad61e43640 1 -- 172.21.15.19:0/1562119822 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad5c072de0 msgr2=0x7fad5c1e3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.267+0000 7fad61e43640 1 --2- 172.21.15.19:0/1562119822 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad5c072de0 0x7fad5c1e3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.267+0000 7fad61e43640 1 -- 172.21.15.19:0/1562119822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad5c072320 msgr2=0x7fad5c1f5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.267+0000 7fad61e43640 1 --2- 172.21.15.19:0/1562119822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad5c072320 0x7fad5c1f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.267+0000 7fad61e43640 1 -- 172.21.15.19:0/1562119822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5c0aa040 con 0x7fad5c15e1f0 2024-09-12T02:07:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.268+0000 7fad61e43640 1 --2- 172.21.15.19:0/1562119822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad5c15e1f0 0x7fad5c15b970 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7fad5400c680 tx=0x7fad5400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.268+0000 7fad51ffb640 1 -- 172.21.15.19:0/1562119822 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad54003b70 con 0x7fad5c15e1f0 2024-09-12T02:07:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.268+0000 7fad51ffb640 1 -- 172.21.15.19:0/1562119822 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad54003d10 con 0x7fad5c15e1f0 2024-09-12T02:07:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.268+0000 7fad51ffb640 1 -- 172.21.15.19:0/1562119822 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad54005310 con 0x7fad5c15e1f0 2024-09-12T02:07:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.268+0000 7fad638a6640 1 -- 172.21.15.19:0/1562119822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad5c0aa320 con 0x7fad5c15e1f0 2024-09-12T02:07:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.268+0000 7fad638a6640 1 -- 172.21.15.19:0/1562119822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad5c0cb080 con 0x7fad5c15e1f0 2024-09-12T02:07:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.269+0000 7fad638a6640 1 -- 172.21.15.19:0/1562119822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad5c072700 con 0x7fad5c15e1f0 2024-09-12T02:07:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.269+0000 7fad51ffb640 1 -- 172.21.15.19:0/1562119822 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad540054b0 con 0x7fad5c15e1f0 2024-09-12T02:07:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.270+0000 7fad51ffb640 1 --2- 172.21.15.19:0/1562119822 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fad4006be30 0x7fad4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.270+0000 7fad51ffb640 1 -- 172.21.15.19:0/1562119822 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7fad5408ab30 con 0x7fad5c15e1f0 2024-09-12T02:07:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.270+0000 7fad61642640 1 --2- 172.21.15.19:0/1562119822 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fad4006be30 0x7fad4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.271+0000 7fad61642640 1 --2- 172.21.15.19:0/1562119822 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fad4006be30 0x7fad4006e2f0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fad58034000 tx=0x7fad5802c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.274+0000 7fad51ffb640 1 -- 172.21.15.19:0/1562119822 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad54059690 con 0x7fad5c15e1f0 2024-09-12T02:07:32.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.517+0000 7fad638a6640 1 -- 172.21.15.19:0/1562119822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_open_ino_errors"]} v 0) -- 0x7fad5c1450a0 con 0x7fad5c15e1f0 2024-09-12T02:07:32.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.822+0000 7fad51ffb640 1 -- 172.21.15.19:0/1562119822 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_open_ino_errors"]}]=0 v596) ==== 135+0+0 (secure 0 0 0) 0x7fad54058f90 con 0x7fad5c15e1f0 2024-09-12T02:07:32.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.825+0000 7fad638a6640 1 -- 172.21.15.19:0/1562119822 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fad4006be30 msgr2=0x7fad4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:32.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.825+0000 7fad638a6640 1 --2- 172.21.15.19:0/1562119822 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fad4006be30 0x7fad4006e2f0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fad58034000 tx=0x7fad5802c000 comp rx=0 tx=0).stop 2024-09-12T02:07:32.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.825+0000 7fad638a6640 1 -- 172.21.15.19:0/1562119822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad5c15e1f0 msgr2=0x7fad5c15b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:32.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.825+0000 7fad638a6640 1 --2- 172.21.15.19:0/1562119822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad5c15e1f0 0x7fad5c15b970 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7fad5400c680 tx=0x7fad5400cb40 comp rx=0 tx=0).stop 2024-09-12T02:07:32.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.825+0000 7fad638a6640 1 -- 172.21.15.19:0/1562119822 shutdown_connections 2024-09-12T02:07:32.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.825+0000 7fad638a6640 1 --2- 172.21.15.19:0/1562119822 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fad4006be30 0x7fad4006e2f0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.825+0000 7fad638a6640 1 --2- 172.21.15.19:0/1562119822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad5c15e1f0 0x7fad5c15b970 unknown :-1 s=CLOSED pgs=2358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.825+0000 7fad638a6640 1 --2- 172.21.15.19:0/1562119822 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad5c072de0 0x7fad5c1e3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.825+0000 7fad638a6640 1 --2- 172.21.15.19:0/1562119822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad5c072320 0x7fad5c1f5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.825+0000 7fad638a6640 1 -- 172.21.15.19:0/1562119822 >> 172.21.15.19:0/1562119822 conn(0x7fad5c067d70 msgr2=0x7fad5c0ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:32.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.825+0000 7fad638a6640 1 -- 172.21.15.19:0/1562119822 shutdown_connections 2024-09-12T02:07:32.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:32.825+0000 7fad638a6640 1 -- 172.21.15.19:0/1562119822 wait complete. 2024-09-12T02:07:32.839 INFO:tasks.cephfs_test_runner:That errors encountered during opening inos are properly propagated ... ERROR 2024-09-12T02:07:32.839 INFO:tasks.cephfs_test_runner: 2024-09-12T02:07:32.840 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-12T02:07:32.840 INFO:tasks.cephfs_test_runner:ERROR: test_open_ino_errors (tasks.cephfs.test_damage.TestDamage) 2024-09-12T02:07:32.840 INFO:tasks.cephfs_test_runner:That errors encountered during opening inos are properly propagated 2024-09-12T02:07:32.840 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-12T02:07:32.840 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-12T02:07:32.840 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/test_damage.py", line 510, in test_open_ino_errors 2024-09-12T02:07:32.840 INFO:tasks.cephfs_test_runner: self.fs.read_backtrace(file1_ino) 2024-09-12T02:07:32.840 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-12T02:07:32.840 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-12T02:07:32.840 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-12T02:07:32.840 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-12T02:07:32.841 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-12T02:07:32.841 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-12T02:07:32.841 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-12T02:07:32.841 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-12T02:07:32.841 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-12T02:07:32.841 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-12T02:07:32.841 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-12T02:07:32.841 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-12T02:07:32.841 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-12T02:07:32.841 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-12T02:07:32.841 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-12T02:07:32.841 INFO:tasks.cephfs_test_runner: 2024-09-12T02:07:32.842 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-12T02:07:32.842 INFO:tasks.cephfs_test_runner:Ran 6 tests in 662.022s 2024-09-12T02:07:32.842 INFO:tasks.cephfs_test_runner: 2024-09-12T02:07:32.842 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-09-12T02:07:32.842 INFO:tasks.cephfs_test_runner: 2024-09-12T02:07:32.842 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-12T02:07:32.842 INFO:tasks.cephfs_test_runner:ERROR: test_open_ino_errors (tasks.cephfs.test_damage.TestDamage) 2024-09-12T02:07:32.842 INFO:tasks.cephfs_test_runner:That errors encountered during opening inos are properly propagated 2024-09-12T02:07:32.842 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-12T02:07:32.842 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-12T02:07:32.842 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/test_damage.py", line 510, in test_open_ino_errors 2024-09-12T02:07:32.842 INFO:tasks.cephfs_test_runner: self.fs.read_backtrace(file1_ino) 2024-09-12T02:07:32.843 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-12T02:07:32.843 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-12T02:07:32.843 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-12T02:07:32.843 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-12T02:07:32.843 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-12T02:07:32.843 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-12T02:07:32.843 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-12T02:07:32.843 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-12T02:07:32.843 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-12T02:07:32.843 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-12T02:07:32.843 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-12T02:07:32.843 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-12T02:07:32.844 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-12T02:07:32.844 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-12T02:07:32.844 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-12T02:07:32.844 INFO:tasks.cephfs_test_runner: 2024-09-12T02:07:32.844 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_open_ino_errors (tasks.cephfs.test_damage.TestDamage) 2024-09-12T02:07:33.871 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=4e5669a1d6d54793b9c79d7a2aac0c4c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_open_ino_errors (tasks.cephfs.test_damage.TestDamage) 2024-09-12T02:07:33.873 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-12T02:07:33.883 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T02:07:33.919 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T02:07:33.919 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:07:33.919 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:07:33.956 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:07:33.956 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T02:07:33.956 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:07:34.015 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14479 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:07:34.016 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T02:07:34.016 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:07:34.034 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:07:34.035 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T02:07:34.035 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:07:34.093 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=269 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:07:34.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:34.093 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T02:07:34.113 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:07:34.113 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:07:34.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:34.113 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:07:34.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:34.185 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:07:34.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:34.254 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-09-12T02:07:34.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:34.346 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T02:07:34.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:34.364 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-09-12T02:07:34.435 INFO:teuthology.orchestra.run.smithi019.stderr:Cannot find device "ceph-brx" 2024-09-12T02:07:34.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:07:34.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:34.437 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-09-12T02:07:34.457 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T02:07:34.458 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T02:07:34.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:34.458 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:07:34.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:34.528 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:07:34.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:34.598 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-09-12T02:07:34.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:34.691 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-09-12T02:07:34.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:07:34.709 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-09-12T02:07:34.777 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2024-09-12T02:07:34.778 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:07:34.778 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T02:07:34.787 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:07:34.788 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:07:34.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.898+0000 7f677536d640 1 Processor -- start 2024-09-12T02:07:34.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.898+0000 7f677536d640 1 -- start start 2024-09-12T02:07:34.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.899+0000 7f677536d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f677015ba30 0x7f677006f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:34.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.899+0000 7f677536d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67700b3570 con 0x7f6770073050 2024-09-12T02:07:34.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.899+0000 7f677536d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67700b3850 con 0x7f677006fd50 2024-09-12T02:07:34.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.899+0000 7f677536d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f67700b4180 con 0x7f677015ba30 2024-09-12T02:07:34.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.899+0000 7f676f7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6770073050 0x7f67700b4880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57660/0 (socket says 172.21.15.19:57660) 2024-09-12T02:07:34.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.899+0000 7f676f7fe640 1 -- 172.21.15.19:0/1223246417 learned_addr learned my addr 172.21.15.19:0/1223246417 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:34.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.899+0000 7f676effd640 1 --2- 172.21.15.19:0/1223246417 >> v2:172.21.15.135:3300/0 conn(0x7f677015ba30 0x7f677006f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:34.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.900+0000 7f676e7fc640 1 -- 172.21.15.19:0/1223246417 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2846267903 0 0) 0x7f67700b3570 con 0x7f6770073050 2024-09-12T02:07:34.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.900+0000 7f676e7fc640 1 -- 172.21.15.19:0/1223246417 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f675c004630 con 0x7f6770073050 2024-09-12T02:07:34.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.900+0000 7f676e7fc640 1 -- 172.21.15.19:0/1223246417 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 223229372 0 0) 0x7f67700b3850 con 0x7f677006fd50 2024-09-12T02:07:34.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.900+0000 7f676e7fc640 1 -- 172.21.15.19:0/1223246417 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67700b3570 con 0x7f677006fd50 2024-09-12T02:07:34.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.900+0000 7f676effd640 1 -- 172.21.15.19:0/1223246417 >> v1:172.21.15.135:6789/0 conn(0x7f677006fd50 legacy=0x7f6770072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:34.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.900+0000 7f676effd640 1 -- 172.21.15.19:0/1223246417 >> v1:172.21.15.19:6789/0 conn(0x7f6770073050 legacy=0x7f67700b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:34.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.900+0000 7f676effd640 1 -- 172.21.15.19:0/1223246417 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67700b3b30 con 0x7f677015ba30 2024-09-12T02:07:34.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.901+0000 7f676effd640 1 --2- 172.21.15.19:0/1223246417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677015ba30 0x7f677006f810 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f67700b4300 tx=0x7f676002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4a92cc2cad28677 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:34.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.901+0000 7f676e7fc640 1 -- 172.21.15.19:0/1223246417 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6760037070 con 0x7f677015ba30 2024-09-12T02:07:34.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.901+0000 7f676e7fc640 1 -- 172.21.15.19:0/1223246417 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6760032440 con 0x7f677015ba30 2024-09-12T02:07:34.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.901+0000 7f676e7fc640 1 -- 172.21.15.19:0/1223246417 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67600327f0 con 0x7f677015ba30 2024-09-12T02:07:34.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.901+0000 7f677536d640 1 -- 172.21.15.19:0/1223246417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677015ba30 msgr2=0x7f677006f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:34.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.901+0000 7f677536d640 1 --2- 172.21.15.19:0/1223246417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677015ba30 0x7f677006f810 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f67700b4300 tx=0x7f676002a210 comp rx=0 tx=0).stop 2024-09-12T02:07:34.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.901+0000 7f677536d640 1 -- 172.21.15.19:0/1223246417 shutdown_connections 2024-09-12T02:07:34.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.901+0000 7f677536d640 1 --2- 172.21.15.19:0/1223246417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677015ba30 0x7f677006f810 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:34.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.901+0000 7f677536d640 1 -- 172.21.15.19:0/1223246417 >> 172.21.15.19:0/1223246417 conn(0x7f6770067d70 msgr2=0x7f677006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:34.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.901+0000 7f677536d640 1 -- 172.21.15.19:0/1223246417 shutdown_connections 2024-09-12T02:07:34.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.902+0000 7f677536d640 1 -- 172.21.15.19:0/1223246417 wait complete. 2024-09-12T02:07:34.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.903+0000 7f677536d640 1 Processor -- start 2024-09-12T02:07:34.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.903+0000 7f677536d640 1 -- start start 2024-09-12T02:07:34.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.903+0000 7f677536d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f677006fd50 0x7f67701ef9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:34.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.903+0000 7f677536d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6770073050 0x7f677013e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:34.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.903+0000 7f677536d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677015ba30 0x7f6770141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:34.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.903+0000 7f677536d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f67700ccfe0 con 0x7f6770073050 2024-09-12T02:07:34.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.903+0000 7f677536d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f67700ce810 con 0x7f677015ba30 2024-09-12T02:07:34.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.903+0000 7f677536d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f67700cd160 con 0x7f677006fd50 2024-09-12T02:07:34.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.904+0000 7f6767fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6770073050 0x7f677013e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:34.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.904+0000 7f6767fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6770073050 0x7f677013e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49730/0 (socket says 172.21.15.19:49730) 2024-09-12T02:07:34.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.904+0000 7f6767fff640 1 -- 172.21.15.19:0/3707967931 learned_addr learned my addr 172.21.15.19:0/3707967931 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.904+0000 7f676effd640 1 --2- 172.21.15.19:0/3707967931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f677006fd50 0x7f67701ef9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.904+0000 7f676f7fe640 1 --2- 172.21.15.19:0/3707967931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677015ba30 0x7f6770141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.904+0000 7f6767fff640 1 -- 172.21.15.19:0/3707967931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f677006fd50 msgr2=0x7f67701ef9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.904+0000 7f6767fff640 1 --2- 172.21.15.19:0/3707967931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f677006fd50 0x7f67701ef9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.904+0000 7f6767fff640 1 -- 172.21.15.19:0/3707967931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677015ba30 msgr2=0x7f6770141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.904+0000 7f6767fff640 1 --2- 172.21.15.19:0/3707967931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677015ba30 0x7f6770141220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:34.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.904+0000 7f6767fff640 1 -- 172.21.15.19:0/3707967931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6770141760 con 0x7f6770073050 2024-09-12T02:07:34.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.904+0000 7f6767fff640 1 --2- 172.21.15.19:0/3707967931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6770073050 0x7f677013e7c0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f675800c530 tx=0x7f675800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:34.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.904+0000 7f67677fe640 1 -- 172.21.15.19:0/3707967931 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67580052d0 con 0x7f6770073050 2024-09-12T02:07:34.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.904+0000 7f67677fe640 1 -- 172.21.15.19:0/3707967931 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6758005490 con 0x7f6770073050 2024-09-12T02:07:34.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.904+0000 7f677536d640 1 -- 172.21.15.19:0/3707967931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67701526c0 con 0x7f6770073050 2024-09-12T02:07:34.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.904+0000 7f67677fe640 1 -- 172.21.15.19:0/3707967931 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6758012870 con 0x7f6770073050 2024-09-12T02:07:34.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.904+0000 7f677536d640 1 -- 172.21.15.19:0/3707967931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67701543d0 con 0x7f6770073050 2024-09-12T02:07:34.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.905+0000 7f677536d640 1 -- 172.21.15.19:0/3707967931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f677006f810 con 0x7f6770073050 2024-09-12T02:07:34.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.906+0000 7f67677fe640 1 -- 172.21.15.19:0/3707967931 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6758012a10 con 0x7f6770073050 2024-09-12T02:07:34.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.906+0000 7f67677fe640 1 --2- 172.21.15.19:0/3707967931 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f675006be30 0x7f675006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:34.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.906+0000 7f67677fe640 1 -- 172.21.15.19:0/3707967931 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7f675808a970 con 0x7f6770073050 2024-09-12T02:07:34.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.906+0000 7f676effd640 1 --2- 172.21.15.19:0/3707967931 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f675006be30 0x7f675006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:34.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.907+0000 7f676effd640 1 --2- 172.21.15.19:0/3707967931 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f675006be30 0x7f675006e2f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f6760034000 tx=0x7f676002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:34.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:34.911+0000 7f67677fe640 1 -- 172.21.15.19:0/3707967931 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6758059450 con 0x7f6770073050 2024-09-12T02:07:35.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.082+0000 7f677536d640 1 -- 172.21.15.19:0/3707967931 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f67700b1f40 con 0x7f675006be30 2024-09-12T02:07:35.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.083+0000 7f67677fe640 1 -- 172.21.15.19:0/3707967931 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13494 (secure 0 0 0) 0x7f67700b1f40 con 0x7f675006be30 2024-09-12T02:07:35.084 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:35.084 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T02:07:35.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.085+0000 7f677536d640 1 -- 172.21.15.19:0/3707967931 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f675006be30 msgr2=0x7f675006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.085+0000 7f677536d640 1 --2- 172.21.15.19:0/3707967931 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f675006be30 0x7f675006e2f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f6760034000 tx=0x7f676002e000 comp rx=0 tx=0).stop 2024-09-12T02:07:35.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.085+0000 7f677536d640 1 -- 172.21.15.19:0/3707967931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6770073050 msgr2=0x7f677013e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.085+0000 7f677536d640 1 --2- 172.21.15.19:0/3707967931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6770073050 0x7f677013e7c0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f675800c530 tx=0x7f675800c9f0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.086+0000 7f677536d640 1 -- 172.21.15.19:0/3707967931 shutdown_connections 2024-09-12T02:07:35.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.086+0000 7f677536d640 1 --2- 172.21.15.19:0/3707967931 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f675006be30 0x7f675006e2f0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.086+0000 7f677536d640 1 --2- 172.21.15.19:0/3707967931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677015ba30 0x7f6770141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.086+0000 7f677536d640 1 --2- 172.21.15.19:0/3707967931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6770073050 0x7f677013e7c0 unknown :-1 s=CLOSED pgs=2360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.086+0000 7f677536d640 1 --2- 172.21.15.19:0/3707967931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f677006fd50 0x7f67701ef9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.086+0000 7f677536d640 1 -- 172.21.15.19:0/3707967931 >> 172.21.15.19:0/3707967931 conn(0x7f6770067d70 msgr2=0x7f6770072800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:35.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.086+0000 7f677536d640 1 -- 172.21.15.19:0/3707967931 shutdown_connections 2024-09-12T02:07:35.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.086+0000 7f677536d640 1 -- 172.21.15.19:0/3707967931 wait complete. 2024-09-12T02:07:35.097 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2024-09-12T02:07:34.258647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":299036,"kb_used_data":16232,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754675684,"statfs":{"total":773094113280,"available":772787900416,"internally_reserved":0,"allocated":16621568,"data_stored":9008764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-35304,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-84,"num_read_kb":-86,"num_write":-92,"num_write_kb":-67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001477"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":415,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.845683+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T02:07:32.845683+0000","last_peered":"2024-09-12T02:07:32.845683+0000","last_clean":"2024-09-12T02:07:32.845683+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T02:07:32.845683+0000","last_undegraded":"2024-09-12T02:07:32.845683+0000","last_fullsized":"2024-09-12T02:07:32.845683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509586,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37824,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334016,"statfs":{"total":96636764160,"available":96598032384,"internally_reserved":0,"allocated":2531328,"data_stored":1571893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509585,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41400,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330440,"statfs":{"total":96636764160,"available":96594370560,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509586,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33084,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542290,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33084,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542290,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37228,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334612,"statfs":{"total":96636764160,"available":96598642688,"internally_reserved":0,"allocated":1921024,"data_stored":975482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542290,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37224,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334616,"statfs":{"total":96636764160,"available":96598646784,"internally_reserved":0,"allocated":1921024,"data_stored":975482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542290,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41964,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329876,"statfs":{"total":96636764160,"available":96593793024,"internally_reserved":0,"allocated":2514944,"data_stored":1565850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37228,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334612,"statfs":{"total":96636764160,"available":96598642688,"internally_reserved":0,"allocated":1921024,"data_stored":975482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:07:35.098 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:07:35.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.200+0000 7f3eb6d18640 1 Processor -- start 2024-09-12T02:07:35.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.200+0000 7f3eb6d18640 1 -- start start 2024-09-12T02:07:35.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.201+0000 7f3eb6d18640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb00720b0 0x7f3eb00cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.201+0000 7f3eb6d18640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3eb006f6f0 0x7f3eb00b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.201+0000 7f3eb6d18640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb00afa20 con 0x7f3eb0162ad0 2024-09-12T02:07:35.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.201+0000 7f3eb6d18640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f3eb00afce0 con 0x7f3eb006f6f0 2024-09-12T02:07:35.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.201+0000 7f3eb6d18640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3eb00b34d0 con 0x7f3eb00720b0 2024-09-12T02:07:35.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.201+0000 7f3eb4ab4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb00720b0 0x7f3eb00cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.201+0000 7f3eb52b5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3eb006f6f0 0x7f3eb00b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.201+0000 7f3eaffff640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f3eb0162ad0 0x7f3eb0072490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:43762/0 (socket says 172.21.15.19:43762) 2024-09-12T02:07:35.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.201+0000 7f3eaffff640 1 -- 172.21.15.19:0/4068838995 learned_addr learned my addr 172.21.15.19:0/4068838995 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.201+0000 7f3eb4ab4640 1 --2- 172.21.15.19:0/4068838995 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb00720b0 0x7f3eb00cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.19:38706/0 (socket says 172.21.15.19:38706) 2024-09-12T02:07:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.202+0000 7f3eb52b5640 1 -- 172.21.15.19:0/4068838995 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb00720b0 msgr2=0x7f3eb00cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.202+0000 7f3eb52b5640 1 --2- 172.21.15.19:0/4068838995 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb00720b0 0x7f3eb00cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.202+0000 7f3eb52b5640 1 -- 172.21.15.19:0/4068838995 >> v1:172.21.15.135:6789/0 conn(0x7f3eb0162ad0 legacy=0x7f3eb0072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.202+0000 7f3eaf7fe640 1 -- 172.21.15.19:0/4068838995 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3502178211 0 0) 0x7f3eb00afa20 con 0x7f3eb0162ad0 2024-09-12T02:07:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.202+0000 7f3eb52b5640 1 -- 172.21.15.19:0/4068838995 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb00b37b0 con 0x7f3eb006f6f0 2024-09-12T02:07:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.202+0000 7f3eb52b5640 1 --2- 172.21.15.19:0/4068838995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3eb006f6f0 0x7f3eb00b4290 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3e980097a0 tx=0x7f3e9802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d612a3066ad2df74 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.203+0000 7f3eaf7fe640 1 -- 172.21.15.19:0/4068838995 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e98037070 con 0x7f3eb006f6f0 2024-09-12T02:07:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.203+0000 7f3eaf7fe640 1 -- 172.21.15.19:0/4068838995 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e98032440 con 0x7f3eb006f6f0 2024-09-12T02:07:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.203+0000 7f3eaf7fe640 1 -- 172.21.15.19:0/4068838995 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e98032810 con 0x7f3eb006f6f0 2024-09-12T02:07:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.203+0000 7f3eb6d18640 1 -- 172.21.15.19:0/4068838995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3eb006f6f0 msgr2=0x7f3eb00b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.203+0000 7f3eb6d18640 1 --2- 172.21.15.19:0/4068838995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3eb006f6f0 0x7f3eb00b4290 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3e980097a0 tx=0x7f3e9802a180 comp rx=0 tx=0).stop 2024-09-12T02:07:35.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.203+0000 7f3eb6d18640 1 -- 172.21.15.19:0/4068838995 shutdown_connections 2024-09-12T02:07:35.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.203+0000 7f3eb6d18640 1 --2- 172.21.15.19:0/4068838995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3eb006f6f0 0x7f3eb00b4290 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.203+0000 7f3eb6d18640 1 --2- 172.21.15.19:0/4068838995 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb00720b0 0x7f3eb00cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.203+0000 7f3eb6d18640 1 -- 172.21.15.19:0/4068838995 >> 172.21.15.19:0/4068838995 conn(0x7f3eb0067d70 msgr2=0x7f3eb006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:35.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.203+0000 7f3eb6d18640 1 -- 172.21.15.19:0/4068838995 shutdown_connections 2024-09-12T02:07:35.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.203+0000 7f3eb6d18640 1 -- 172.21.15.19:0/4068838995 wait complete. 2024-09-12T02:07:35.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.204+0000 7f3eb6d18640 1 Processor -- start 2024-09-12T02:07:35.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.204+0000 7f3eb6d18640 1 -- start start 2024-09-12T02:07:35.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.205+0000 7f3eb6d18640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3eb006f6f0 0x7f3eb0156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.205+0000 7f3eb6d18640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3eb00720b0 0x7f3eb01f8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.205+0000 7f3eb6d18640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb0162ad0 0x7f3eb0154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.205+0000 7f3eb6d18640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb00b47d0 con 0x7f3eb00720b0 2024-09-12T02:07:35.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.205+0000 7f3eb6d18640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb00b3d70 con 0x7f3eb006f6f0 2024-09-12T02:07:35.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.205+0000 7f3eb6d18640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3eb00b4950 con 0x7f3eb0162ad0 2024-09-12T02:07:35.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.205+0000 7f3eaffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3eb00720b0 0x7f3eb01f8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.205+0000 7f3eaffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3eb00720b0 0x7f3eb01f8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49744/0 (socket says 172.21.15.19:49744) 2024-09-12T02:07:35.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.205+0000 7f3eaffff640 1 -- 172.21.15.19:0/1571630793 learned_addr learned my addr 172.21.15.19:0/1571630793 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:35.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.206+0000 7f3eb4ab4640 1 --2- 172.21.15.19:0/1571630793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3eb006f6f0 0x7f3eb0156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.206+0000 7f3eb52b5640 1 --2- 172.21.15.19:0/1571630793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb0162ad0 0x7f3eb0154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.206+0000 7f3eaffff640 1 -- 172.21.15.19:0/1571630793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb0162ad0 msgr2=0x7f3eb0154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.206+0000 7f3eaffff640 1 --2- 172.21.15.19:0/1571630793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb0162ad0 0x7f3eb0154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.206+0000 7f3eaffff640 1 -- 172.21.15.19:0/1571630793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3eb006f6f0 msgr2=0x7f3eb0156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.206+0000 7f3eaffff640 1 --2- 172.21.15.19:0/1571630793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3eb006f6f0 0x7f3eb0156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.206+0000 7f3eaffff640 1 -- 172.21.15.19:0/1571630793 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb01f87b0 con 0x7f3eb00720b0 2024-09-12T02:07:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.206+0000 7f3eaffff640 1 --2- 172.21.15.19:0/1571630793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3eb00720b0 0x7f3eb01f8060 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f3ea000c780 tx=0x7f3ea000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.206+0000 7f3ead7fa640 1 -- 172.21.15.19:0/1571630793 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0018070 con 0x7f3eb00720b0 2024-09-12T02:07:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.206+0000 7f3ead7fa640 1 -- 172.21.15.19:0/1571630793 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ea000a640 con 0x7f3eb00720b0 2024-09-12T02:07:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.206+0000 7f3ead7fa640 1 -- 172.21.15.19:0/1571630793 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea000aa30 con 0x7f3eb00720b0 2024-09-12T02:07:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.206+0000 7f3eb6d18640 1 -- 172.21.15.19:0/1571630793 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb01f8a90 con 0x7f3eb00720b0 2024-09-12T02:07:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.206+0000 7f3eb6d18640 1 -- 172.21.15.19:0/1571630793 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb0164220 con 0x7f3eb00720b0 2024-09-12T02:07:35.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.207+0000 7f3eb6d18640 1 -- 172.21.15.19:0/1571630793 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eb00b4290 con 0x7f3eb00720b0 2024-09-12T02:07:35.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.208+0000 7f3ead7fa640 1 -- 172.21.15.19:0/1571630793 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ea000abd0 con 0x7f3eb00720b0 2024-09-12T02:07:35.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.208+0000 7f3ead7fa640 1 --2- 172.21.15.19:0/1571630793 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3e9006be30 0x7f3e9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.208+0000 7f3ead7fa640 1 -- 172.21.15.19:0/1571630793 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7f3ea008a2e0 con 0x7f3eb00720b0 2024-09-12T02:07:35.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.208+0000 7f3eb4ab4640 1 --2- 172.21.15.19:0/1571630793 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3e9006be30 0x7f3e9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.209+0000 7f3eb4ab4640 1 --2- 172.21.15.19:0/1571630793 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3e9006be30 0x7f3e9006e2f0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009ad0 tx=0x7f3ea8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:35.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.212+0000 7f3ead7fa640 1 -- 172.21.15.19:0/1571630793 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ea0058dc0 con 0x7f3eb00720b0 2024-09-12T02:07:35.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.383+0000 7f3eb6d18640 1 -- 172.21.15.19:0/1571630793 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3eb00726a0 con 0x7f3e9006be30 2024-09-12T02:07:35.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.384+0000 7f3ead7fa640 1 -- 172.21.15.19:0/1571630793 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13494 (secure 0 0 0) 0x7f3eb00726a0 con 0x7f3e9006be30 2024-09-12T02:07:35.384 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:35.384 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T02:07:35.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.385+0000 7f3eb6d18640 1 -- 172.21.15.19:0/1571630793 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3e9006be30 msgr2=0x7f3e9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.385+0000 7f3eb6d18640 1 --2- 172.21.15.19:0/1571630793 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3e9006be30 0x7f3e9006e2f0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009ad0 tx=0x7f3ea8008040 comp rx=0 tx=0).stop 2024-09-12T02:07:35.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.385+0000 7f3eb6d18640 1 -- 172.21.15.19:0/1571630793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3eb00720b0 msgr2=0x7f3eb01f8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.385+0000 7f3eb6d18640 1 --2- 172.21.15.19:0/1571630793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3eb00720b0 0x7f3eb01f8060 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f3ea000c780 tx=0x7f3ea000cc40 comp rx=0 tx=0).stop 2024-09-12T02:07:35.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.386+0000 7f3eb6d18640 1 -- 172.21.15.19:0/1571630793 shutdown_connections 2024-09-12T02:07:35.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.386+0000 7f3eb6d18640 1 --2- 172.21.15.19:0/1571630793 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f3e9006be30 0x7f3e9006e2f0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.386+0000 7f3eb6d18640 1 --2- 172.21.15.19:0/1571630793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb0162ad0 0x7f3eb0154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.386+0000 7f3eb6d18640 1 --2- 172.21.15.19:0/1571630793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3eb00720b0 0x7f3eb01f8060 unknown :-1 s=CLOSED pgs=2361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.386+0000 7f3eb6d18640 1 --2- 172.21.15.19:0/1571630793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3eb006f6f0 0x7f3eb0156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.386+0000 7f3eb6d18640 1 -- 172.21.15.19:0/1571630793 >> 172.21.15.19:0/1571630793 conn(0x7f3eb0067d70 msgr2=0x7f3eb00cfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:35.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.386+0000 7f3eb6d18640 1 -- 172.21.15.19:0/1571630793 shutdown_connections 2024-09-12T02:07:35.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.386+0000 7f3eb6d18640 1 -- 172.21.15.19:0/1571630793 wait complete. 2024-09-12T02:07:35.397 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2024-09-12T02:07:34.258647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":299036,"kb_used_data":16232,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754675684,"statfs":{"total":773094113280,"available":772787900416,"internally_reserved":0,"allocated":16621568,"data_stored":9008764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-35304,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-84,"num_read_kb":-86,"num_write":-92,"num_write_kb":-67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001477"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":415,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.845683+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T02:07:32.845683+0000","last_peered":"2024-09-12T02:07:32.845683+0000","last_clean":"2024-09-12T02:07:32.845683+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T02:07:32.845683+0000","last_undegraded":"2024-09-12T02:07:32.845683+0000","last_fullsized":"2024-09-12T02:07:32.845683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509586,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37824,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334016,"statfs":{"total":96636764160,"available":96598032384,"internally_reserved":0,"allocated":2531328,"data_stored":1571893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509585,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41400,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330440,"statfs":{"total":96636764160,"available":96594370560,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509586,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33084,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542290,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33084,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542290,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37228,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334612,"statfs":{"total":96636764160,"available":96598642688,"internally_reserved":0,"allocated":1921024,"data_stored":975482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542290,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37224,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334616,"statfs":{"total":96636764160,"available":96598646784,"internally_reserved":0,"allocated":1921024,"data_stored":975482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542290,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41964,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329876,"statfs":{"total":96636764160,"available":96593793024,"internally_reserved":0,"allocated":2514944,"data_stored":1565850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37228,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334612,"statfs":{"total":96636764160,"available":96598642688,"internally_reserved":0,"allocated":1921024,"data_stored":975482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:07:35.398 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:07:35.398 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:07:35.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.499+0000 7f62c7e37640 1 Processor -- start 2024-09-12T02:07:35.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.500+0000 7f62c7e37640 1 -- start start 2024-09-12T02:07:35.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.500+0000 7f62c7e37640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f62c0161c80 0x7f62c006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.500+0000 7f62c7e37640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f62c00b6680 0x7f62c00cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.501+0000 7f62c7e37640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62c006e870 con 0x7f62c0162060 2024-09-12T02:07:35.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.501+0000 7f62c7e37640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f62c006d9f0 con 0x7f62c0161c80 2024-09-12T02:07:35.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.501+0000 7f62c7e37640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f62c006dcd0 con 0x7f62c00b6680 2024-09-12T02:07:35.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.501+0000 7f62c5bd3640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f62c0161c80 0x7f62c006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.501+0000 7f62c53d2640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f62c0162060 0x7f62c00b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57672/0 (socket says 172.21.15.19:57672) 2024-09-12T02:07:35.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.501+0000 7f62c53d2640 1 -- 172.21.15.19:0/2717162073 learned_addr learned my addr 172.21.15.19:0/2717162073 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:35.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.501+0000 7f62c63d4640 1 --2- 172.21.15.19:0/2717162073 >> v2:172.21.15.135:3300/0 conn(0x7f62c00b6680 0x7f62c00cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.501+0000 7f62c5bd3640 1 -- 172.21.15.19:0/2717162073 >> v2:172.21.15.135:3300/0 conn(0x7f62c00b6680 msgr2=0x7f62c00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:35.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.501+0000 7f62c5bd3640 1 --2- 172.21.15.19:0/2717162073 >> v2:172.21.15.135:3300/0 conn(0x7f62c00b6680 0x7f62c00cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.501+0000 7f62c5bd3640 1 -- 172.21.15.19:0/2717162073 >> v1:172.21.15.19:6789/0 conn(0x7f62c0162060 legacy=0x7f62c00b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.501+0000 7f62c5bd3640 1 -- 172.21.15.19:0/2717162073 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c006dfb0 con 0x7f62c0161c80 2024-09-12T02:07:35.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.501+0000 7f62c4bd1640 1 -- 172.21.15.19:0/2717162073 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2987426200 0 0) 0x7f62b0001110 con 0x7f62c0162060 2024-09-12T02:07:35.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.502+0000 7f62c5bd3640 1 --2- 172.21.15.19:0/2717162073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c0161c80 0x7f62c006e330 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7f62c008d750 tx=0x7f62bc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79444936ff616a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:35.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.502+0000 7f62c4bd1640 1 -- 172.21.15.19:0/2717162073 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc037070 con 0x7f62c0161c80 2024-09-12T02:07:35.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.502+0000 7f62c4bd1640 1 -- 172.21.15.19:0/2717162073 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62bc032440 con 0x7f62c0161c80 2024-09-12T02:07:35.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.502+0000 7f62c4bd1640 1 -- 172.21.15.19:0/2717162073 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc032810 con 0x7f62c0161c80 2024-09-12T02:07:35.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.502+0000 7f62c7e37640 1 -- 172.21.15.19:0/2717162073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c0161c80 msgr2=0x7f62c006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.502+0000 7f62c7e37640 1 --2- 172.21.15.19:0/2717162073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c0161c80 0x7f62c006e330 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7f62c008d750 tx=0x7f62bc02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.502+0000 7f62c7e37640 1 -- 172.21.15.19:0/2717162073 shutdown_connections 2024-09-12T02:07:35.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.502+0000 7f62c7e37640 1 --2- 172.21.15.19:0/2717162073 >> v2:172.21.15.135:3300/0 conn(0x7f62c00b6680 0x7f62c00cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.502+0000 7f62c7e37640 1 --2- 172.21.15.19:0/2717162073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c0161c80 0x7f62c006e330 unknown :-1 s=CLOSED pgs=2363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.502+0000 7f62c7e37640 1 -- 172.21.15.19:0/2717162073 >> 172.21.15.19:0/2717162073 conn(0x7f62c00d44f0 msgr2=0x7f62c00d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:35.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.503+0000 7f62c7e37640 1 -- 172.21.15.19:0/2717162073 shutdown_connections 2024-09-12T02:07:35.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.503+0000 7f62c7e37640 1 -- 172.21.15.19:0/2717162073 wait complete. 2024-09-12T02:07:35.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.504+0000 7f62c7e37640 1 Processor -- start 2024-09-12T02:07:35.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.504+0000 7f62c7e37640 1 -- start start 2024-09-12T02:07:35.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.504+0000 7f62c7e37640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c00b6680 0x7f62c01f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.504+0000 7f62c7e37640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62c0161c80 0x7f62c0160620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.504+0000 7f62c7e37640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c0162060 0x7f62c00b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.504+0000 7f62c7e37640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f62c00b6b30 con 0x7f62c0162060 2024-09-12T02:07:35.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.504+0000 7f62c7e37640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f62c00d2aa0 con 0x7f62c00b6680 2024-09-12T02:07:35.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.504+0000 7f62c7e37640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f62c00b6cb0 con 0x7f62c0161c80 2024-09-12T02:07:35.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.505+0000 7f62c63d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c0162060 0x7f62c00b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.505+0000 7f62c63d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c0162060 0x7f62c00b3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49758/0 (socket says 172.21.15.19:49758) 2024-09-12T02:07:35.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.505+0000 7f62c63d4640 1 -- 172.21.15.19:0/3297685006 learned_addr learned my addr 172.21.15.19:0/3297685006 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:35.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.505+0000 7f62c53d2640 1 --2- 172.21.15.19:0/3297685006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62c0161c80 0x7f62c0160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.505+0000 7f62c5bd3640 1 --2- 172.21.15.19:0/3297685006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c00b6680 0x7f62c01f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.505+0000 7f62c63d4640 1 -- 172.21.15.19:0/3297685006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62c0161c80 msgr2=0x7f62c0160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.505+0000 7f62c63d4640 1 --2- 172.21.15.19:0/3297685006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62c0161c80 0x7f62c0160620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.505+0000 7f62c63d4640 1 -- 172.21.15.19:0/3297685006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c00b6680 msgr2=0x7f62c01f3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.505+0000 7f62c63d4640 1 --2- 172.21.15.19:0/3297685006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c00b6680 0x7f62c01f3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.505+0000 7f62c63d4640 1 -- 172.21.15.19:0/3297685006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c00cd6c0 con 0x7f62c0162060 2024-09-12T02:07:35.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.505+0000 7f62c63d4640 1 --2- 172.21.15.19:0/3297685006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c0162060 0x7f62c00b3070 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7f62b8007e60 tx=0x7f62b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:35.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.505+0000 7f62b67fc640 1 -- 172.21.15.19:0/3297685006 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b8014420 con 0x7f62c0162060 2024-09-12T02:07:35.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.505+0000 7f62b67fc640 1 -- 172.21.15.19:0/3297685006 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b8019070 con 0x7f62c0162060 2024-09-12T02:07:35.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.505+0000 7f62c7e37640 1 -- 172.21.15.19:0/3297685006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62c00cd9a0 con 0x7f62c0162060 2024-09-12T02:07:35.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.505+0000 7f62b67fc640 1 -- 172.21.15.19:0/3297685006 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b8014820 con 0x7f62c0162060 2024-09-12T02:07:35.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.505+0000 7f62c7e37640 1 -- 172.21.15.19:0/3297685006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62c00cdf60 con 0x7f62c0162060 2024-09-12T02:07:35.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.506+0000 7f62c7e37640 1 -- 172.21.15.19:0/3297685006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62c006e330 con 0x7f62c0162060 2024-09-12T02:07:35.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.507+0000 7f62b67fc640 1 -- 172.21.15.19:0/3297685006 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f62b80149c0 con 0x7f62c0162060 2024-09-12T02:07:35.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.507+0000 7f62b67fc640 1 --2- 172.21.15.19:0/3297685006 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f62a406be30 0x7f62a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.507+0000 7f62b67fc640 1 -- 172.21.15.19:0/3297685006 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7f62b808b390 con 0x7f62c0162060 2024-09-12T02:07:35.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.507+0000 7f62c5bd3640 1 --2- 172.21.15.19:0/3297685006 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f62a406be30 0x7f62a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.508+0000 7f62c5bd3640 1 --2- 172.21.15.19:0/3297685006 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f62a406be30 0x7f62a406e2f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f62bc034000 tx=0x7f62bc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:35.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.511+0000 7f62b67fc640 1 -- 172.21.15.19:0/3297685006 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f62b80598a0 con 0x7f62c0162060 2024-09-12T02:07:35.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.684+0000 7f62c7e37640 1 -- 172.21.15.19:0/3297685006 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f62c00b4390 con 0x7f62a406be30 2024-09-12T02:07:35.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.685+0000 7f62b67fc640 1 -- 172.21.15.19:0/3297685006 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13494 (secure 0 0 0) 0x7f62c00b4390 con 0x7f62a406be30 2024-09-12T02:07:35.685 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:35.685 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T02:07:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.687+0000 7f62c7e37640 1 -- 172.21.15.19:0/3297685006 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f62a406be30 msgr2=0x7f62a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.687+0000 7f62c7e37640 1 --2- 172.21.15.19:0/3297685006 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f62a406be30 0x7f62a406e2f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f62bc034000 tx=0x7f62bc02e000 comp rx=0 tx=0).stop 2024-09-12T02:07:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.687+0000 7f62c7e37640 1 -- 172.21.15.19:0/3297685006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c0162060 msgr2=0x7f62c00b3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.687+0000 7f62c7e37640 1 --2- 172.21.15.19:0/3297685006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c0162060 0x7f62c00b3070 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7f62b8007e60 tx=0x7f62b800e4b0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.687+0000 7f62c7e37640 1 -- 172.21.15.19:0/3297685006 shutdown_connections 2024-09-12T02:07:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.687+0000 7f62c7e37640 1 --2- 172.21.15.19:0/3297685006 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f62a406be30 0x7f62a406e2f0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.687+0000 7f62c7e37640 1 --2- 172.21.15.19:0/3297685006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c0162060 0x7f62c00b3070 unknown :-1 s=CLOSED pgs=2364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.687+0000 7f62c7e37640 1 --2- 172.21.15.19:0/3297685006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62c0161c80 0x7f62c0160620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.687+0000 7f62c7e37640 1 --2- 172.21.15.19:0/3297685006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c00b6680 0x7f62c01f3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.687+0000 7f62c7e37640 1 -- 172.21.15.19:0/3297685006 >> 172.21.15.19:0/3297685006 conn(0x7f62c00d44f0 msgr2=0x7f62c00b5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.687+0000 7f62c7e37640 1 -- 172.21.15.19:0/3297685006 shutdown_connections 2024-09-12T02:07:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.687+0000 7f62c7e37640 1 -- 172.21.15.19:0/3297685006 wait complete. 2024-09-12T02:07:35.698 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2024-09-12T02:07:34.258647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":299036,"kb_used_data":16232,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754675684,"statfs":{"total":773094113280,"available":772787900416,"internally_reserved":0,"allocated":16621568,"data_stored":9008764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-35304,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-84,"num_read_kb":-86,"num_write":-92,"num_write_kb":-67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001477"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":415,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.845683+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T02:07:32.845683+0000","last_peered":"2024-09-12T02:07:32.845683+0000","last_clean":"2024-09-12T02:07:32.845683+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T02:07:32.845683+0000","last_undegraded":"2024-09-12T02:07:32.845683+0000","last_fullsized":"2024-09-12T02:07:32.845683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509586,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37824,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334016,"statfs":{"total":96636764160,"available":96598032384,"internally_reserved":0,"allocated":2531328,"data_stored":1571893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509585,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41400,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330440,"statfs":{"total":96636764160,"available":96594370560,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509586,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33084,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542290,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33084,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542290,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37228,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334612,"statfs":{"total":96636764160,"available":96598642688,"internally_reserved":0,"allocated":1921024,"data_stored":975482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542290,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37224,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334616,"statfs":{"total":96636764160,"available":96598646784,"internally_reserved":0,"allocated":1921024,"data_stored":975482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542290,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41964,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329876,"statfs":{"total":96636764160,"available":96593793024,"internally_reserved":0,"allocated":2514944,"data_stored":1565850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37228,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334612,"statfs":{"total":96636764160,"available":96598642688,"internally_reserved":0,"allocated":1921024,"data_stored":975482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:07:35.699 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:07:35.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.801+0000 7f3981791640 1 Processor -- start 2024-09-12T02:07:35.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.801+0000 7f3981791640 1 -- start start 2024-09-12T02:07:35.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.802+0000 7f3981791640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f397c0cfcc0 0x7f397c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.802+0000 7f3981791640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f397c0d2700 con 0x7f397c15e760 2024-09-12T02:07:35.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.802+0000 7f3981791640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f397c0cedb0 con 0x7f397c0d4fd0 2024-09-12T02:07:35.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.802+0000 7f3981791640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f397c0cf090 con 0x7f397c0cfcc0 2024-09-12T02:07:35.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.802+0000 7f397affd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f397c15e760 0x7f397c0cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57682/0 (socket says 172.21.15.19:57682) 2024-09-12T02:07:35.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.802+0000 7f397affd640 1 -- 172.21.15.19:0/3135396348 learned_addr learned my addr 172.21.15.19:0/3135396348 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:35.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.802+0000 7f397a7fc640 1 --2- 172.21.15.19:0/3135396348 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f397c0cfcc0 0x7f397c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.802+0000 7f3979ffb640 1 -- 172.21.15.19:0/3135396348 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1196106695 0 0) 0x7f396c001490 con 0x7f397c15e760 2024-09-12T02:07:35.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.803+0000 7f3979ffb640 1 -- 172.21.15.19:0/3135396348 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3968003520 con 0x7f397c15e760 2024-09-12T02:07:35.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.803+0000 7f3979ffb640 1 -- 172.21.15.19:0/3135396348 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088608668 0 0) 0x7f397c0cedb0 con 0x7f397c0d4fd0 2024-09-12T02:07:35.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.803+0000 7f3979ffb640 1 -- 172.21.15.19:0/3135396348 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f396c001490 con 0x7f397c0d4fd0 2024-09-12T02:07:35.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.803+0000 7f397a7fc640 1 -- 172.21.15.19:0/3135396348 >> v1:172.21.15.135:6789/0 conn(0x7f397c0d4fd0 legacy=0x7f397c0d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.803+0000 7f397a7fc640 1 -- 172.21.15.19:0/3135396348 >> v1:172.21.15.19:6789/0 conn(0x7f397c15e760 legacy=0x7f397c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.803+0000 7f397a7fc640 1 -- 172.21.15.19:0/3135396348 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397c0b3c80 con 0x7f397c0cfcc0 2024-09-12T02:07:35.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.803+0000 7f397a7fc640 1 --2- 172.21.15.19:0/3135396348 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f397c0cfcc0 0x7f397c06cdd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f39640097c0 tx=0x7f396402a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4d6c682adad318e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:35.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.804+0000 7f3979ffb640 1 -- 172.21.15.19:0/3135396348 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3964037070 con 0x7f397c0cfcc0 2024-09-12T02:07:35.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.804+0000 7f3979ffb640 1 -- 172.21.15.19:0/3135396348 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3964032440 con 0x7f397c0cfcc0 2024-09-12T02:07:35.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.804+0000 7f3979ffb640 1 -- 172.21.15.19:0/3135396348 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39640327f0 con 0x7f397c0cfcc0 2024-09-12T02:07:35.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.804+0000 7f3981791640 1 -- 172.21.15.19:0/3135396348 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f397c0cfcc0 msgr2=0x7f397c06cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.804+0000 7f3981791640 1 --2- 172.21.15.19:0/3135396348 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f397c0cfcc0 0x7f397c06cdd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f39640097c0 tx=0x7f396402a200 comp rx=0 tx=0).stop 2024-09-12T02:07:35.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.804+0000 7f3981791640 1 -- 172.21.15.19:0/3135396348 shutdown_connections 2024-09-12T02:07:35.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.804+0000 7f3981791640 1 --2- 172.21.15.19:0/3135396348 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f397c0cfcc0 0x7f397c06cdd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.804+0000 7f3981791640 1 -- 172.21.15.19:0/3135396348 >> 172.21.15.19:0/3135396348 conn(0x7f397c08bfc0 msgr2=0x7f397c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:35.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.804+0000 7f3981791640 1 -- 172.21.15.19:0/3135396348 shutdown_connections 2024-09-12T02:07:35.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.804+0000 7f3981791640 1 -- 172.21.15.19:0/3135396348 wait complete. 2024-09-12T02:07:35.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.805+0000 7f3981791640 1 Processor -- start 2024-09-12T02:07:35.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.806+0000 7f3981791640 1 -- start start 2024-09-12T02:07:35.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.806+0000 7f3981791640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f397c0cfcc0 0x7f397c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.806+0000 7f3981791640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f397c0d4fd0 0x7f397c0b95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.806+0000 7f3981791640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f397c15e760 0x7f397c0b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.806+0000 7f3981791640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f397c0d35b0 con 0x7f397c15e760 2024-09-12T02:07:35.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.806+0000 7f3981791640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f397c0b38a0 con 0x7f397c0cfcc0 2024-09-12T02:07:35.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.806+0000 7f3981791640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f397c0d3730 con 0x7f397c0d4fd0 2024-09-12T02:07:35.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.806+0000 7f397b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f397c15e760 0x7f397c0b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.806+0000 7f397b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f397c15e760 0x7f397c0b1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49774/0 (socket says 172.21.15.19:49774) 2024-09-12T02:07:35.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.806+0000 7f397b7fe640 1 -- 172.21.15.19:0/3837110221 learned_addr learned my addr 172.21.15.19:0/3837110221 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:35.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.806+0000 7f397affd640 1 --2- 172.21.15.19:0/3837110221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f397c0cfcc0 0x7f397c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.807+0000 7f397a7fc640 1 --2- 172.21.15.19:0/3837110221 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f397c0d4fd0 0x7f397c0b95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.807+0000 7f397b7fe640 1 -- 172.21.15.19:0/3837110221 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f397c0d4fd0 msgr2=0x7f397c0b95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.807+0000 7f397b7fe640 1 --2- 172.21.15.19:0/3837110221 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f397c0d4fd0 0x7f397c0b95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.807+0000 7f397b7fe640 1 -- 172.21.15.19:0/3837110221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f397c0cfcc0 msgr2=0x7f397c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.807+0000 7f397b7fe640 1 --2- 172.21.15.19:0/3837110221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f397c0cfcc0 0x7f397c15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.807+0000 7f397b7fe640 1 -- 172.21.15.19:0/3837110221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397c15ce10 con 0x7f397c15e760 2024-09-12T02:07:35.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.807+0000 7f397b7fe640 1 --2- 172.21.15.19:0/3837110221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f397c15e760 0x7f397c0b1c60 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f397400c3c0 tx=0x7f397400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:35.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.807+0000 7f39737fe640 1 -- 172.21.15.19:0/3837110221 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974017070 con 0x7f397c15e760 2024-09-12T02:07:35.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.807+0000 7f39737fe640 1 -- 172.21.15.19:0/3837110221 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39740052d0 con 0x7f397c15e760 2024-09-12T02:07:35.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.807+0000 7f3981791640 1 -- 172.21.15.19:0/3837110221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f397c0b9af0 con 0x7f397c15e760 2024-09-12T02:07:35.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.807+0000 7f39737fe640 1 -- 172.21.15.19:0/3837110221 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974003830 con 0x7f397c15e760 2024-09-12T02:07:35.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.807+0000 7f3981791640 1 -- 172.21.15.19:0/3837110221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f397c0ba180 con 0x7f397c15e760 2024-09-12T02:07:35.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.808+0000 7f3981791640 1 -- 172.21.15.19:0/3837110221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f397c0cedb0 con 0x7f397c15e760 2024-09-12T02:07:35.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.809+0000 7f39737fe640 1 -- 172.21.15.19:0/3837110221 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f397401a070 con 0x7f397c15e760 2024-09-12T02:07:35.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.809+0000 7f39737fe640 1 --2- 172.21.15.19:0/3837110221 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f395c06be30 0x7f395c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.809+0000 7f39737fe640 1 -- 172.21.15.19:0/3837110221 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7f397408a050 con 0x7f397c15e760 2024-09-12T02:07:35.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.809+0000 7f397affd640 1 --2- 172.21.15.19:0/3837110221 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f395c06be30 0x7f395c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.810+0000 7f397affd640 1 --2- 172.21.15.19:0/3837110221 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f395c06be30 0x7f395c06e2f0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f396c001730 tx=0x7f396c001bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:35.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.813+0000 7f39737fe640 1 -- 172.21.15.19:0/3837110221 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3974058440 con 0x7f397c15e760 2024-09-12T02:07:35.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.992+0000 7f3981791640 1 -- 172.21.15.19:0/3837110221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f397c0b5bd0 con 0x7f397c15e760 2024-09-12T02:07:35.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.992+0000 7f39737fe640 1 -- 172.21.15.19:0/3837110221 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) ==== 74+0+13433 (secure 0 0 0) 0x7f397405c740 con 0x7f397c15e760 2024-09-12T02:07:35.993 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:35.994 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":149,"fsid":"978259a0-e3d5-47df-8e62-5e92f95d9388","created":"2024-09-12T01:55:31.869666+0000","modified":"2024-09-12T02:07:31.815661+0000","last_up_change":"2024-09-12T01:55:43.559225+0000","last_in_change":"2024-09-12T01:55:33.944188+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:55:44.127030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19d26b01-4e11-47cf-a738-ba110c0e5c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6825","nonce":541180533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6827","nonce":541180533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6831","nonce":541180533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":541180533},{"type":"v1","addr":"172.21.15.19:6829","nonce":541180533}]},"public_addr":"172.21.15.19:6825/541180533","cluster_addr":"172.21.15.19:6827/541180533","heartbeat_back_addr":"172.21.15.19:6831/541180533","heartbeat_front_addr":"172.21.15.19:6829/541180533","state":["exists","up"]},{"osd":1,"uuid":"038660b9-e3de-4974-8439-69e04b14581a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6809","nonce":1048134887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6811","nonce":1048134887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6815","nonce":1048134887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1048134887},{"type":"v1","addr":"172.21.15.19:6813","nonce":1048134887}]},"public_addr":"172.21.15.19:6809/1048134887","cluster_addr":"172.21.15.19:6811/1048134887","heartbeat_back_addr":"172.21.15.19:6815/1048134887","heartbeat_front_addr":"172.21.15.19:6813/1048134887","state":["exists","up"]},{"osd":2,"uuid":"ad97b147-39cd-4be0-817e-2afd31daf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6817","nonce":1297238899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6819","nonce":1297238899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6823","nonce":1297238899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1297238899},{"type":"v1","addr":"172.21.15.19:6821","nonce":1297238899}]},"public_addr":"172.21.15.19:6817/1297238899","cluster_addr":"172.21.15.19:6819/1297238899","heartbeat_back_addr":"172.21.15.19:6823/1297238899","heartbeat_front_addr":"172.21.15.19:6821/1297238899","state":["exists","up"]},{"osd":3,"uuid":"3a014904-0ed5-428a-82d3-0c15544643c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6801","nonce":2581301650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6803","nonce":2581301650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6807","nonce":2581301650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2581301650},{"type":"v1","addr":"172.21.15.19:6805","nonce":2581301650}]},"public_addr":"172.21.15.19:6801/2581301650","cluster_addr":"172.21.15.19:6803/2581301650","heartbeat_back_addr":"172.21.15.19:6807/2581301650","heartbeat_front_addr":"172.21.15.19:6805/2581301650","state":["exists","up"]},{"osd":4,"uuid":"fbe6aea1-e944-4b67-acd0-c0113343021f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6801","nonce":1904467046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6803","nonce":1904467046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6807","nonce":1904467046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1904467046},{"type":"v1","addr":"172.21.15.135:6805","nonce":1904467046}]},"public_addr":"172.21.15.135:6801/1904467046","cluster_addr":"172.21.15.135:6803/1904467046","heartbeat_back_addr":"172.21.15.135:6807/1904467046","heartbeat_front_addr":"172.21.15.135:6805/1904467046","state":["exists","up"]},{"osd":5,"uuid":"d8b65a09-bc7b-49bd-ba5e-12d8b29c9b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6809","nonce":3846812594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6811","nonce":3846812594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6815","nonce":3846812594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3846812594},{"type":"v1","addr":"172.21.15.135:6813","nonce":3846812594}]},"public_addr":"172.21.15.135:6809/3846812594","cluster_addr":"172.21.15.135:6811/3846812594","heartbeat_back_addr":"172.21.15.135:6815/3846812594","heartbeat_front_addr":"172.21.15.135:6813/3846812594","state":["exists","up"]},{"osd":6,"uuid":"9b711c80-90b3-4f92-b353-f1066e3f1e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6817","nonce":580453075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6819","nonce":580453075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6823","nonce":580453075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":580453075},{"type":"v1","addr":"172.21.15.135:6821","nonce":580453075}]},"public_addr":"172.21.15.135:6817/580453075","cluster_addr":"172.21.15.135:6819/580453075","heartbeat_back_addr":"172.21.15.135:6823/580453075","heartbeat_front_addr":"172.21.15.135:6821/580453075","state":["exists","up"]},{"osd":7,"uuid":"5acf71ac-197b-4844-a2fa-2efb23a1bcb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6825","nonce":872608380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6827","nonce":872608380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6831","nonce":872608380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":872608380},{"type":"v1","addr":"172.21.15.135:6829","nonce":872608380}]},"public_addr":"172.21.15.135:6825/872608380","cluster_addr":"172.21.15.135:6827/872608380","heartbeat_back_addr":"172.21.15.135:6831/872608380","heartbeat_front_addr":"172.21.15.135:6829/872608380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.717970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.993467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.980349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.784674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:39.998657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.578147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.781554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:40.518700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6835/3413662523":"2024-09-13T02:07:28.806876+0000","172.21.15.19:6833/3413662523":"2024-09-13T02:07:28.806876+0000","172.21.15.19:6835/3072429339":"2024-09-13T02:07:19.043391+0000","172.21.15.19:6833/3072429339":"2024-09-13T02:07:19.043391+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:07:35.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.994+0000 7f3981791640 1 -- 172.21.15.19:0/3837110221 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f395c06be30 msgr2=0x7f395c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.994+0000 7f3981791640 1 --2- 172.21.15.19:0/3837110221 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f395c06be30 0x7f395c06e2f0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f396c001730 tx=0x7f396c001bc0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.994+0000 7f3981791640 1 -- 172.21.15.19:0/3837110221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f397c15e760 msgr2=0x7f397c0b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.994+0000 7f3981791640 1 --2- 172.21.15.19:0/3837110221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f397c15e760 0x7f397c0b1c60 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f397400c3c0 tx=0x7f397400c880 comp rx=0 tx=0).stop 2024-09-12T02:07:35.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.995+0000 7f3981791640 1 -- 172.21.15.19:0/3837110221 shutdown_connections 2024-09-12T02:07:35.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.995+0000 7f3981791640 1 --2- 172.21.15.19:0/3837110221 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f395c06be30 0x7f395c06e2f0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.995+0000 7f3981791640 1 --2- 172.21.15.19:0/3837110221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f397c15e760 0x7f397c0b1c60 unknown :-1 s=CLOSED pgs=2366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.995+0000 7f3981791640 1 --2- 172.21.15.19:0/3837110221 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f397c0d4fd0 0x7f397c0b95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.995+0000 7f3981791640 1 --2- 172.21.15.19:0/3837110221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f397c0cfcc0 0x7f397c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.995+0000 7f3981791640 1 -- 172.21.15.19:0/3837110221 >> 172.21.15.19:0/3837110221 conn(0x7f397c08bfc0 msgr2=0x7f397c0b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:35.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.995+0000 7f3981791640 1 -- 172.21.15.19:0/3837110221 shutdown_connections 2024-09-12T02:07:35.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:35.995+0000 7f3981791640 1 -- 172.21.15.19:0/3837110221 wait complete. 2024-09-12T02:07:37.008 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T02:07:37.008 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:07:37.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.128+0000 7f5b54b98640 1 Processor -- start 2024-09-12T02:07:37.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.128+0000 7f5b54b98640 1 -- start start 2024-09-12T02:07:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.129+0000 7f5b54b98640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5b50161a20 0x7f5b500d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.129+0000 7f5b54b98640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b500d1420 0x7f5b500cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.129+0000 7f5b54b98640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b5006e820 con 0x7f5b500cf160 2024-09-12T02:07:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.129+0000 7f5b54b98640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f5b50161e00 con 0x7f5b50161a20 2024-09-12T02:07:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.129+0000 7f5b54b98640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5b500d1830 con 0x7f5b500d1420 2024-09-12T02:07:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.129+0000 7f5b4ed9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5b500cf160 0x7f5b500b5f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57694/0 (socket says 172.21.15.19:57694) 2024-09-12T02:07:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.129+0000 7f5b4ed9d640 1 -- 172.21.15.19:0/1949427390 learned_addr learned my addr 172.21.15.19:0/1949427390 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.129+0000 7f5b4e59c640 1 --2- 172.21.15.19:0/1949427390 >> v2:172.21.15.135:3300/0 conn(0x7f5b50161a20 0x7f5b500d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.129+0000 7f5b47fff640 1 --2- 172.21.15.19:0/1949427390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b500d1420 0x7f5b500cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.129+0000 7f5b4dd9b640 1 -- 172.21.15.19:0/1949427390 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1200456903 0 0) 0x7f5b5006e820 con 0x7f5b500cf160 2024-09-12T02:07:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.129+0000 7f5b4dd9b640 1 -- 172.21.15.19:0/1949427390 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b3c003520 con 0x7f5b500cf160 2024-09-12T02:07:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.130+0000 7f5b47fff640 1 -- 172.21.15.19:0/1949427390 >> v2:172.21.15.135:3300/0 conn(0x7f5b50161a20 msgr2=0x7f5b500d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.130+0000 7f5b47fff640 1 --2- 172.21.15.19:0/1949427390 >> v2:172.21.15.135:3300/0 conn(0x7f5b50161a20 0x7f5b500d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.130+0000 7f5b47fff640 1 -- 172.21.15.19:0/1949427390 >> v1:172.21.15.19:6789/0 conn(0x7f5b500cf160 legacy=0x7f5b500b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.130+0000 7f5b47fff640 1 -- 172.21.15.19:0/1949427390 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b500cf980 con 0x7f5b500d1420 2024-09-12T02:07:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.130+0000 7f5b4e59c640 1 --2- 172.21.15.19:0/1949427390 >> v2:172.21.15.135:3300/0 conn(0x7f5b50161a20 0x7f5b500d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:37.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.130+0000 7f5b47fff640 1 --2- 172.21.15.19:0/1949427390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b500d1420 0x7f5b500cec20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5b380097a0 tx=0x7f5b3802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=306abe031e172ad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.131+0000 7f5b4dd9b640 1 -- 172.21.15.19:0/1949427390 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b38037070 con 0x7f5b500d1420 2024-09-12T02:07:37.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.131+0000 7f5b4dd9b640 1 -- 172.21.15.19:0/1949427390 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b38032440 con 0x7f5b500d1420 2024-09-12T02:07:37.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.131+0000 7f5b4dd9b640 1 -- 172.21.15.19:0/1949427390 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b38032810 con 0x7f5b500d1420 2024-09-12T02:07:37.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.131+0000 7f5b54b98640 1 -- 172.21.15.19:0/1949427390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b500d1420 msgr2=0x7f5b500cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.131+0000 7f5b54b98640 1 --2- 172.21.15.19:0/1949427390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b500d1420 0x7f5b500cec20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5b380097a0 tx=0x7f5b3802a180 comp rx=0 tx=0).stop 2024-09-12T02:07:37.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.131+0000 7f5b54b98640 1 -- 172.21.15.19:0/1949427390 shutdown_connections 2024-09-12T02:07:37.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.131+0000 7f5b54b98640 1 --2- 172.21.15.19:0/1949427390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b500d1420 0x7f5b500cec20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.131+0000 7f5b54b98640 1 --2- 172.21.15.19:0/1949427390 >> v2:172.21.15.135:3300/0 conn(0x7f5b50161a20 0x7f5b500d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.131+0000 7f5b54b98640 1 -- 172.21.15.19:0/1949427390 >> 172.21.15.19:0/1949427390 conn(0x7f5b5009d850 msgr2=0x7f5b5008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:37.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.131+0000 7f5b54b98640 1 -- 172.21.15.19:0/1949427390 shutdown_connections 2024-09-12T02:07:37.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.131+0000 7f5b54b98640 1 -- 172.21.15.19:0/1949427390 wait complete. 2024-09-12T02:07:37.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.133+0000 7f5b54b98640 1 Processor -- start 2024-09-12T02:07:37.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.133+0000 7f5b54b98640 1 -- start start 2024-09-12T02:07:37.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.133+0000 7f5b54b98640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b500cf160 0x7f5b500cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.133+0000 7f5b54b98640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b500d1420 0x7f5b501583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.133+0000 7f5b54b98640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b50161a20 0x7f5b500a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.133+0000 7f5b54b98640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5b500cff00 con 0x7f5b500d1420 2024-09-12T02:07:37.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.133+0000 7f5b54b98640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5006d050 con 0x7f5b500cf160 2024-09-12T02:07:37.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.133+0000 7f5b54b98640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5b5006d2f0 con 0x7f5b50161a20 2024-09-12T02:07:37.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.134+0000 7f5b47fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b500d1420 0x7f5b501583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.134+0000 7f5b47fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b500d1420 0x7f5b501583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49776/0 (socket says 172.21.15.19:49776) 2024-09-12T02:07:37.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.134+0000 7f5b47fff640 1 -- 172.21.15.19:0/1204135912 learned_addr learned my addr 172.21.15.19:0/1204135912 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:37.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.134+0000 7f5b4ed9d640 1 --2- 172.21.15.19:0/1204135912 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b50161a20 0x7f5b500a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.134+0000 7f5b4e59c640 1 --2- 172.21.15.19:0/1204135912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b500cf160 0x7f5b500cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.134+0000 7f5b47fff640 1 -- 172.21.15.19:0/1204135912 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b50161a20 msgr2=0x7f5b500a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.134+0000 7f5b47fff640 1 --2- 172.21.15.19:0/1204135912 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b50161a20 0x7f5b500a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.134+0000 7f5b47fff640 1 -- 172.21.15.19:0/1204135912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b500cf160 msgr2=0x7f5b500cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.134+0000 7f5b47fff640 1 --2- 172.21.15.19:0/1204135912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b500cf160 0x7f5b500cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.134+0000 7f5b47fff640 1 -- 172.21.15.19:0/1204135912 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b500a1fe0 con 0x7f5b500d1420 2024-09-12T02:07:37.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.134+0000 7f5b47fff640 1 --2- 172.21.15.19:0/1204135912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b500d1420 0x7f5b501583b0 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7f5b38035040 tx=0x7f5b380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.134+0000 7f5b46ffd640 1 -- 172.21.15.19:0/1204135912 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b38041030 con 0x7f5b500d1420 2024-09-12T02:07:37.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.134+0000 7f5b46ffd640 1 -- 172.21.15.19:0/1204135912 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b3803d4e0 con 0x7f5b500d1420 2024-09-12T02:07:37.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.134+0000 7f5b46ffd640 1 -- 172.21.15.19:0/1204135912 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b38037040 con 0x7f5b500d1420 2024-09-12T02:07:37.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.134+0000 7f5b54b98640 1 -- 172.21.15.19:0/1204135912 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b500ca520 con 0x7f5b500d1420 2024-09-12T02:07:37.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.134+0000 7f5b54b98640 1 -- 172.21.15.19:0/1204135912 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b50158bb0 con 0x7f5b500d1420 2024-09-12T02:07:37.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.135+0000 7f5b54b98640 1 -- 172.21.15.19:0/1204135912 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5b500cabe0 con 0x7f5b500d1420 2024-09-12T02:07:37.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.136+0000 7f5b46ffd640 1 -- 172.21.15.19:0/1204135912 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b38044070 con 0x7f5b500d1420 2024-09-12T02:07:37.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.136+0000 7f5b46ffd640 1 --2- 172.21.15.19:0/1204135912 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5b3006be30 0x7f5b3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.136+0000 7f5b46ffd640 1 -- 172.21.15.19:0/1204135912 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7f5b380ab200 con 0x7f5b500d1420 2024-09-12T02:07:37.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.137+0000 7f5b46ffd640 1 --2- 172.21.15.19:0/1204135912 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x7f5b30072370 0x7f5b300747b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.137+0000 7f5b46ffd640 1 -- 172.21.15.19:0/1204135912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b38049e70 con 0x7f5b30072370 2024-09-12T02:07:37.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.137+0000 7f5b46ffd640 1 -- 172.21.15.19:0/1204135912 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=149) ==== 24+0+0 (secure 0 0 0) 0x7f5b380b2050 con 0x7f5b500d1420 2024-09-12T02:07:37.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.137+0000 7f5b4ed9d640 1 --2- 172.21.15.19:0/1204135912 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x7f5b30072370 0x7f5b300747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.137+0000 7f5b4e59c640 1 --2- 172.21.15.19:0/1204135912 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5b3006be30 0x7f5b3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.137+0000 7f5b4ed9d640 1 --2- 172.21.15.19:0/1204135912 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x7f5b30072370 0x7f5b300747b0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.137+0000 7f5b4e59c640 1 --2- 172.21.15.19:0/1204135912 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5b3006be30 0x7f5b3006e2f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009560 tx=0x7f5b40009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.138+0000 7f5b46ffd640 1 -- 172.21.15.19:0/1204135912 <== osd.0 v2:172.21.15.19:6824/541180533 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b38049e70 con 0x7f5b30072370 2024-09-12T02:07:37.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.151+0000 7f5b54b98640 1 -- 172.21.15.19:0/1204135912 --> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5b500b1040 con 0x7f5b30072370 2024-09-12T02:07:37.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.151+0000 7f5b46ffd640 1 -- 172.21.15.19:0/1204135912 <== osd.0 v2:172.21.15.19:6824/541180533 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5b500b1040 con 0x7f5b30072370 2024-09-12T02:07:37.152 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:07:37.153 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:07:37.153 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:07:37.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.151+0000 7f5b54b98640 1 -- 172.21.15.19:0/1204135912 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x7f5b30072370 msgr2=0x7f5b300747b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.151+0000 7f5b54b98640 1 --2- 172.21.15.19:0/1204135912 >> [v2:172.21.15.19:6824/541180533,v1:172.21.15.19:6825/541180533] conn(0x7f5b30072370 0x7f5b300747b0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.151+0000 7f5b54b98640 1 -- 172.21.15.19:0/1204135912 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5b3006be30 msgr2=0x7f5b3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.151+0000 7f5b54b98640 1 --2- 172.21.15.19:0/1204135912 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f5b3006be30 0x7f5b3006e2f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009560 tx=0x7f5b40009190 comp rx=0 tx=0).stop 2024-09-12T02:07:37.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.151+0000 7f5b54b98640 1 -- 172.21.15.19:0/1204135912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b500d1420 msgr2=0x7f5b501583b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.151+0000 7f5b54b98640 1 --2- 172.21.15.19:0/1204135912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b500d1420 0x7f5b501583b0 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7f5b38035040 tx=0x7f5b380046c0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.151+0000 7f5b4ed9d640 1 -- 172.21.15.19:0/1204135912 reap_dead start 2024-09-12T02:07:37.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.151+0000 7f5b54b98640 1 -- 172.21.15.19:0/1204135912 shutdown_connections 2024-09-12T02:07:37.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.151+0000 7f5b54b98640 1 -- 172.21.15.19:0/1204135912 >> 172.21.15.19:0/1204135912 conn(0x7f5b5009d850 msgr2=0x7f5b500cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:37.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.152+0000 7f5b54b98640 1 -- 172.21.15.19:0/1204135912 shutdown_connections 2024-09-12T02:07:37.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.152+0000 7f5b54b98640 1 -- 172.21.15.19:0/1204135912 wait complete. 2024-09-12T02:07:37.163 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T02:07:37.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.269+0000 7f78312d0640 1 Processor -- start 2024-09-12T02:07:37.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.269+0000 7f78312d0640 1 -- start start 2024-09-12T02:07:37.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.270+0000 7f78312d0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f782c0cfcc0 0x7f782c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.270+0000 7f78312d0640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f782c0d2700 con 0x7f782c0d4fd0 2024-09-12T02:07:37.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.270+0000 7f78312d0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f782c0cedb0 con 0x7f782c15e760 2024-09-12T02:07:37.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.270+0000 7f78312d0640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f782c0cf090 con 0x7f782c0cfcc0 2024-09-12T02:07:37.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.270+0000 7f782a7fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f782c0cfcc0 0x7f782c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.270+0000 7f782b7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f782c0d4fd0 0x7f782c0d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57706/0 (socket says 172.21.15.19:57706) 2024-09-12T02:07:37.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.270+0000 7f782b7fe640 1 -- 172.21.15.19:0/2247902547 learned_addr learned my addr 172.21.15.19:0/2247902547 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:37.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.270+0000 7f782a7fc640 1 -- 172.21.15.19:0/2247902547 >> v1:172.21.15.135:6789/0 conn(0x7f782c15e760 legacy=0x7f782c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:37.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.270+0000 7f782a7fc640 1 -- 172.21.15.19:0/2247902547 >> v1:172.21.15.19:6789/0 conn(0x7f782c0d4fd0 legacy=0x7f782c0d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.270+0000 7f7829ffb640 1 -- 172.21.15.19:0/2247902547 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3876867330 0 0) 0x7f7824001490 con 0x7f782c0d4fd0 2024-09-12T02:07:37.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.270+0000 7f782a7fc640 1 -- 172.21.15.19:0/2247902547 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782c0b3c80 con 0x7f782c0cfcc0 2024-09-12T02:07:37.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.271+0000 7f782a7fc640 1 --2- 172.21.15.19:0/2247902547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f782c0cfcc0 0x7f782c06cdd0 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7f7820009790 tx=0x7f782002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea6b5ae4b2b9048 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.271+0000 7f7829ffb640 1 -- 172.21.15.19:0/2247902547 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7820037070 con 0x7f782c0cfcc0 2024-09-12T02:07:37.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.271+0000 7f7829ffb640 1 -- 172.21.15.19:0/2247902547 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7820032440 con 0x7f782c0cfcc0 2024-09-12T02:07:37.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.271+0000 7f7829ffb640 1 -- 172.21.15.19:0/2247902547 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7820032810 con 0x7f782c0cfcc0 2024-09-12T02:07:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.272+0000 7f78312d0640 1 -- 172.21.15.19:0/2247902547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f782c0cfcc0 msgr2=0x7f782c06cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.272+0000 7f78312d0640 1 --2- 172.21.15.19:0/2247902547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f782c0cfcc0 0x7f782c06cdd0 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7f7820009790 tx=0x7f782002a1c0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.272+0000 7f78312d0640 1 -- 172.21.15.19:0/2247902547 shutdown_connections 2024-09-12T02:07:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.272+0000 7f78312d0640 1 --2- 172.21.15.19:0/2247902547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f782c0cfcc0 0x7f782c06cdd0 unknown :-1 s=CLOSED pgs=2370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.272+0000 7f78312d0640 1 -- 172.21.15.19:0/2247902547 >> 172.21.15.19:0/2247902547 conn(0x7f782c08bfc0 msgr2=0x7f782c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.272+0000 7f78312d0640 1 -- 172.21.15.19:0/2247902547 shutdown_connections 2024-09-12T02:07:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.272+0000 7f78312d0640 1 -- 172.21.15.19:0/2247902547 wait complete. 2024-09-12T02:07:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.273+0000 7f78312d0640 1 Processor -- start 2024-09-12T02:07:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.273+0000 7f78312d0640 1 -- start start 2024-09-12T02:07:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.274+0000 7f78312d0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f782c0cfcc0 0x7f782c150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.274+0000 7f78312d0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f782c0d4fd0 0x7f782c0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.274+0000 7f78312d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f782c15e760 0x7f782c0b9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.274+0000 7f78312d0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f782c0d35b0 con 0x7f782c15e760 2024-09-12T02:07:37.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.274+0000 7f78312d0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f782c0b3920 con 0x7f782c0cfcc0 2024-09-12T02:07:37.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.274+0000 7f78312d0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f782c0d3730 con 0x7f782c0d4fd0 2024-09-12T02:07:37.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.274+0000 7f782b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f782c15e760 0x7f782c0b9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.274+0000 7f782b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f782c15e760 0x7f782c0b9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49794/0 (socket says 172.21.15.19:49794) 2024-09-12T02:07:37.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.274+0000 7f782b7fe640 1 -- 172.21.15.19:0/3721412215 learned_addr learned my addr 172.21.15.19:0/3721412215 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:37.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.274+0000 7f782affd640 1 --2- 172.21.15.19:0/3721412215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f782c0cfcc0 0x7f782c150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.274+0000 7f782a7fc640 1 --2- 172.21.15.19:0/3721412215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f782c0d4fd0 0x7f782c0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.274+0000 7f782b7fe640 1 -- 172.21.15.19:0/3721412215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f782c0d4fd0 msgr2=0x7f782c0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.274+0000 7f782b7fe640 1 --2- 172.21.15.19:0/3721412215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f782c0d4fd0 0x7f782c0cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.274+0000 7f782b7fe640 1 -- 172.21.15.19:0/3721412215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f782c0cfcc0 msgr2=0x7f782c150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.275+0000 7f782b7fe640 1 --2- 172.21.15.19:0/3721412215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f782c0cfcc0 0x7f782c150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.275+0000 7f782b7fe640 1 -- 172.21.15.19:0/3721412215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782c0cb6c0 con 0x7f782c15e760 2024-09-12T02:07:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.275+0000 7f782b7fe640 1 --2- 172.21.15.19:0/3721412215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f782c15e760 0x7f782c0b9c40 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7f782400c6e0 tx=0x7f782400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.275+0000 7f78137fe640 1 -- 172.21.15.19:0/3721412215 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7824018070 con 0x7f782c15e760 2024-09-12T02:07:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.275+0000 7f78137fe640 1 -- 172.21.15.19:0/3721412215 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7824004d80 con 0x7f782c15e760 2024-09-12T02:07:37.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.275+0000 7f78137fe640 1 -- 172.21.15.19:0/3721412215 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782400a820 con 0x7f782c15e760 2024-09-12T02:07:37.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.275+0000 7f78312d0640 1 -- 172.21.15.19:0/3721412215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f782c0cb9a0 con 0x7f782c15e760 2024-09-12T02:07:37.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.275+0000 7f78312d0640 1 -- 172.21.15.19:0/3721412215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f782c0cbf60 con 0x7f782c15e760 2024-09-12T02:07:37.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.276+0000 7f78312d0640 1 -- 172.21.15.19:0/3721412215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f782c0d3a60 con 0x7f782c15e760 2024-09-12T02:07:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.276+0000 7f78137fe640 1 -- 172.21.15.19:0/3721412215 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f782400a9c0 con 0x7f782c15e760 2024-09-12T02:07:37.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.277+0000 7f78137fe640 1 --2- 172.21.15.19:0/3721412215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f781806be30 0x7f781806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.277+0000 7f78137fe640 1 -- 172.21.15.19:0/3721412215 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7f782408a240 con 0x7f782c15e760 2024-09-12T02:07:37.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.277+0000 7f782affd640 1 --2- 172.21.15.19:0/3721412215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f781806be30 0x7f781806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.278+0000 7f782affd640 1 --2- 172.21.15.19:0/3721412215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f781806be30 0x7f781806e2f0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f781c006fd0 tx=0x7f781c009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.281+0000 7f78137fe640 1 -- 172.21.15.19:0/3721412215 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f782c0d2700 con 0x7f782c15e760 2024-09-12T02:07:37.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.457+0000 7f78312d0640 1 -- 172.21.15.19:0/3721412215 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f782c0b6d20 con 0x7f781806be30 2024-09-12T02:07:37.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.458+0000 7f78137fe640 1 -- 172.21.15.19:0/3721412215 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f782c0b6d20 con 0x7f781806be30 2024-09-12T02:07:37.458 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T02:07:37.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.460+0000 7f78312d0640 1 -- 172.21.15.19:0/3721412215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f781806be30 msgr2=0x7f781806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.460+0000 7f78312d0640 1 --2- 172.21.15.19:0/3721412215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f781806be30 0x7f781806e2f0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f781c006fd0 tx=0x7f781c009060 comp rx=0 tx=0).stop 2024-09-12T02:07:37.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.460+0000 7f78312d0640 1 -- 172.21.15.19:0/3721412215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f782c15e760 msgr2=0x7f782c0b9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.460+0000 7f78312d0640 1 --2- 172.21.15.19:0/3721412215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f782c15e760 0x7f782c0b9c40 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7f782400c6e0 tx=0x7f782400cba0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.460+0000 7f78312d0640 1 -- 172.21.15.19:0/3721412215 shutdown_connections 2024-09-12T02:07:37.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.460+0000 7f78312d0640 1 --2- 172.21.15.19:0/3721412215 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f781806be30 0x7f781806e2f0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.460+0000 7f78312d0640 1 --2- 172.21.15.19:0/3721412215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f782c15e760 0x7f782c0b9c40 unknown :-1 s=CLOSED pgs=2371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.460+0000 7f78312d0640 1 --2- 172.21.15.19:0/3721412215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f782c0d4fd0 0x7f782c0cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.460+0000 7f78312d0640 1 --2- 172.21.15.19:0/3721412215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f782c0cfcc0 0x7f782c150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.460+0000 7f78312d0640 1 -- 172.21.15.19:0/3721412215 >> 172.21.15.19:0/3721412215 conn(0x7f782c08bfc0 msgr2=0x7f782c0b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:37.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.460+0000 7f78312d0640 1 -- 172.21.15.19:0/3721412215 shutdown_connections 2024-09-12T02:07:37.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.460+0000 7f78312d0640 1 -- 172.21.15.19:0/3721412215 wait complete. 2024-09-12T02:07:37.471 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T02:07:37.472 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:07:37.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.578+0000 7fe9608e4640 1 Processor -- start 2024-09-12T02:07:37.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.578+0000 7fe9608e4640 1 -- start start 2024-09-12T02:07:37.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.579+0000 7fe9608e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe95c09b140 0x7fe95c0700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.579+0000 7fe9608e4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe95c0b14d0 0x7fe95c070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.579+0000 7fe9608e4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe95c072180 con 0x7fe95c15c490 2024-09-12T02:07:37.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.579+0000 7fe9608e4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fe95c15c870 con 0x7fe95c0b14d0 2024-09-12T02:07:37.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.579+0000 7fe9608e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe95c071bc0 con 0x7fe95c09b140 2024-09-12T02:07:37.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.579+0000 7fe95ad9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe95c0b14d0 0x7fe95c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.579+0000 7fe95a59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe95c15c490 0x7fe95c09aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57716/0 (socket says 172.21.15.19:57716) 2024-09-12T02:07:37.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.579+0000 7fe95a59c640 1 -- 172.21.15.19:0/420499021 learned_addr learned my addr 172.21.15.19:0/420499021 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:37.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.579+0000 7fe959d9b640 1 --2- 172.21.15.19:0/420499021 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe95c09b140 0x7fe95c0700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.580+0000 7fe95ad9d640 1 -- 172.21.15.19:0/420499021 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe95c09b140 msgr2=0x7fe95c0700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:37.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.580+0000 7fe95ad9d640 1 --2- 172.21.15.19:0/420499021 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe95c09b140 0x7fe95c0700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.580+0000 7fe95ad9d640 1 -- 172.21.15.19:0/420499021 >> v1:172.21.15.19:6789/0 conn(0x7fe95c15c490 legacy=0x7fe95c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.580+0000 7fe95ad9d640 1 -- 172.21.15.19:0/420499021 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95c071ea0 con 0x7fe95c0b14d0 2024-09-12T02:07:37.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.580+0000 7fe95959a640 1 -- 172.21.15.19:0/420499021 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2821856407 0 0) 0x7fe95c072180 con 0x7fe95c15c490 2024-09-12T02:07:37.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.580+0000 7fe95ad9d640 1 --2- 172.21.15.19:0/420499021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe95c0b14d0 0x7fe95c070630 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009d90 tx=0x7fe94c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b124ffff23ce67c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.580+0000 7fe95959a640 1 -- 172.21.15.19:0/420499021 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c007740 con 0x7fe95c0b14d0 2024-09-12T02:07:37.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.580+0000 7fe95959a640 1 -- 172.21.15.19:0/420499021 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe94c0078e0 con 0x7fe95c0b14d0 2024-09-12T02:07:37.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.580+0000 7fe95959a640 1 -- 172.21.15.19:0/420499021 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c007cb0 con 0x7fe95c0b14d0 2024-09-12T02:07:37.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.581+0000 7fe9608e4640 1 -- 172.21.15.19:0/420499021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe95c0b14d0 msgr2=0x7fe95c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.581+0000 7fe9608e4640 1 --2- 172.21.15.19:0/420499021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe95c0b14d0 0x7fe95c070630 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009d90 tx=0x7fe94c02a660 comp rx=0 tx=0).stop 2024-09-12T02:07:37.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.581+0000 7fe9608e4640 1 -- 172.21.15.19:0/420499021 shutdown_connections 2024-09-12T02:07:37.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.581+0000 7fe9608e4640 1 --2- 172.21.15.19:0/420499021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe95c0b14d0 0x7fe95c070630 unknown :-1 s=CLOSED pgs=2373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.581+0000 7fe9608e4640 1 --2- 172.21.15.19:0/420499021 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe95c09b140 0x7fe95c0700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.581+0000 7fe9608e4640 1 -- 172.21.15.19:0/420499021 >> 172.21.15.19:0/420499021 conn(0x7fe95c0b3f30 msgr2=0x7fe95c0b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:37.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.581+0000 7fe9608e4640 1 -- 172.21.15.19:0/420499021 shutdown_connections 2024-09-12T02:07:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.581+0000 7fe9608e4640 1 -- 172.21.15.19:0/420499021 wait complete. 2024-09-12T02:07:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.582+0000 7fe9608e4640 1 Processor -- start 2024-09-12T02:07:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.582+0000 7fe9608e4640 1 -- start start 2024-09-12T02:07:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.583+0000 7fe9608e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe95c09b140 0x7fe95c1ef170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.583+0000 7fe9608e4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe95c0b14d0 0x7fe95c09c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.583+0000 7fe9608e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe95c15c490 0x7fe95c09c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.583+0000 7fe9608e4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c09b8f0 con 0x7fe95c15c490 2024-09-12T02:07:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.583+0000 7fe9608e4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c0affa0 con 0x7fe95c0b14d0 2024-09-12T02:07:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.583+0000 7fe9608e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe95c070b70 con 0x7fe95c09b140 2024-09-12T02:07:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.583+0000 7fe95ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe95c15c490 0x7fe95c09c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.583+0000 7fe95ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe95c15c490 0x7fe95c09c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49822/0 (socket says 172.21.15.19:49822) 2024-09-12T02:07:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.583+0000 7fe95ad9d640 1 -- 172.21.15.19:0/3103013258 learned_addr learned my addr 172.21.15.19:0/3103013258 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:37.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.583+0000 7fe959d9b640 1 --2- 172.21.15.19:0/3103013258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe95c0b14d0 0x7fe95c09c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.583+0000 7fe95a59c640 1 --2- 172.21.15.19:0/3103013258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe95c09b140 0x7fe95c1ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.584+0000 7fe95ad9d640 1 -- 172.21.15.19:0/3103013258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe95c09b140 msgr2=0x7fe95c1ef170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.584+0000 7fe95ad9d640 1 --2- 172.21.15.19:0/3103013258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe95c09b140 0x7fe95c1ef170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.584+0000 7fe95ad9d640 1 -- 172.21.15.19:0/3103013258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe95c0b14d0 msgr2=0x7fe95c09c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.584+0000 7fe95ad9d640 1 --2- 172.21.15.19:0/3103013258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe95c0b14d0 0x7fe95c09c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.584+0000 7fe95ad9d640 1 -- 172.21.15.19:0/3103013258 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95c159790 con 0x7fe95c15c490 2024-09-12T02:07:37.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.584+0000 7fe95ad9d640 1 --2- 172.21.15.19:0/3103013258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe95c15c490 0x7fe95c09c860 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009eb0 tx=0x7fe94c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.584+0000 7fe952ffd640 1 -- 172.21.15.19:0/3103013258 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c040070 con 0x7fe95c15c490 2024-09-12T02:07:37.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.584+0000 7fe952ffd640 1 -- 172.21.15.19:0/3103013258 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe94c031bc0 con 0x7fe95c15c490 2024-09-12T02:07:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.584+0000 7fe9608e4640 1 -- 172.21.15.19:0/3103013258 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95c159a70 con 0x7fe95c15c490 2024-09-12T02:07:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.584+0000 7fe952ffd640 1 -- 172.21.15.19:0/3103013258 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c009450 con 0x7fe95c15c490 2024-09-12T02:07:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.584+0000 7fe9608e4640 1 -- 172.21.15.19:0/3103013258 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe95c15a030 con 0x7fe95c15c490 2024-09-12T02:07:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.585+0000 7fe9608e4640 1 -- 172.21.15.19:0/3103013258 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe95c09aa30 con 0x7fe95c15c490 2024-09-12T02:07:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.585+0000 7fe952ffd640 1 -- 172.21.15.19:0/3103013258 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe94c039040 con 0x7fe95c15c490 2024-09-12T02:07:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.586+0000 7fe952ffd640 1 --2- 172.21.15.19:0/3103013258 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe93c06be30 0x7fe93c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.586+0000 7fe952ffd640 1 -- 172.21.15.19:0/3103013258 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7fe94c0ac600 con 0x7fe95c15c490 2024-09-12T02:07:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.586+0000 7fe952ffd640 1 --2- 172.21.15.19:0/3103013258 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7fe93c072370 0x7fe93c0747b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.586+0000 7fe952ffd640 1 -- 172.21.15.19:0/3103013258 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe94c04ee50 con 0x7fe93c072370 2024-09-12T02:07:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.586+0000 7fe952ffd640 1 -- 172.21.15.19:0/3103013258 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=149) ==== 24+0+0 (secure 0 0 0) 0x7fe94c0b3050 con 0x7fe95c15c490 2024-09-12T02:07:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.586+0000 7fe95a59c640 1 --2- 172.21.15.19:0/3103013258 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe93c06be30 0x7fe93c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.586+0000 7fe959d9b640 1 --2- 172.21.15.19:0/3103013258 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7fe93c072370 0x7fe93c0747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.587+0000 7fe959d9b640 1 --2- 172.21.15.19:0/3103013258 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7fe93c072370 0x7fe93c0747b0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.587+0000 7fe95a59c640 1 --2- 172.21.15.19:0/3103013258 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe93c06be30 0x7fe93c06e2f0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fe954000f60 tx=0x7fe954007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.587+0000 7fe952ffd640 1 -- 172.21.15.19:0/3103013258 <== osd.1 v2:172.21.15.19:6808/1048134887 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe94c04ee50 con 0x7fe93c072370 2024-09-12T02:07:37.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.600+0000 7fe9608e4640 1 -- 172.21.15.19:0/3103013258 --> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe95c0b5880 con 0x7fe93c072370 2024-09-12T02:07:37.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.600+0000 7fe952ffd640 1 -- 172.21.15.19:0/3103013258 <== osd.1 v2:172.21.15.19:6808/1048134887 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe95c0b5880 con 0x7fe93c072370 2024-09-12T02:07:37.601 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:07:37.601 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:07:37.601 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:07:37.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.600+0000 7fe9608e4640 1 -- 172.21.15.19:0/3103013258 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7fe93c072370 msgr2=0x7fe93c0747b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.600+0000 7fe9608e4640 1 --2- 172.21.15.19:0/3103013258 >> [v2:172.21.15.19:6808/1048134887,v1:172.21.15.19:6809/1048134887] conn(0x7fe93c072370 0x7fe93c0747b0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.600+0000 7fe9608e4640 1 -- 172.21.15.19:0/3103013258 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe93c06be30 msgr2=0x7fe93c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.600+0000 7fe9608e4640 1 --2- 172.21.15.19:0/3103013258 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fe93c06be30 0x7fe93c06e2f0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fe954000f60 tx=0x7fe954007c00 comp rx=0 tx=0).stop 2024-09-12T02:07:37.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.600+0000 7fe9608e4640 1 -- 172.21.15.19:0/3103013258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe95c15c490 msgr2=0x7fe95c09c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.600+0000 7fe9608e4640 1 --2- 172.21.15.19:0/3103013258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe95c15c490 0x7fe95c09c860 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009eb0 tx=0x7fe94c004a40 comp rx=0 tx=0).stop 2024-09-12T02:07:37.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.600+0000 7fe95ad9d640 1 -- 172.21.15.19:0/3103013258 reap_dead start 2024-09-12T02:07:37.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.600+0000 7fe9608e4640 1 -- 172.21.15.19:0/3103013258 shutdown_connections 2024-09-12T02:07:37.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.600+0000 7fe9608e4640 1 -- 172.21.15.19:0/3103013258 >> 172.21.15.19:0/3103013258 conn(0x7fe95c0b3f30 msgr2=0x7fe95c0b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:37.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.600+0000 7fe9608e4640 1 -- 172.21.15.19:0/3103013258 shutdown_connections 2024-09-12T02:07:37.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.600+0000 7fe9608e4640 1 -- 172.21.15.19:0/3103013258 wait complete. 2024-09-12T02:07:37.612 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T02:07:37.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.715+0000 7fd1efaba640 1 Processor -- start 2024-09-12T02:07:37.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.715+0000 7fd1efaba640 1 -- start start 2024-09-12T02:07:37.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.716+0000 7fd1efaba640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1e8072de0 0x7fd1e815d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.716+0000 7fd1efaba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1e8072700 0x7fd1e815d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.716+0000 7fd1efaba640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e8146140 con 0x7fd1e8072320 2024-09-12T02:07:37.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.716+0000 7fd1efaba640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd1e80cd740 con 0x7fd1e8072de0 2024-09-12T02:07:37.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.716+0000 7fd1efaba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd1e80cda20 con 0x7fd1e8072700 2024-09-12T02:07:37.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.716+0000 7fd1ed055640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1e8072de0 0x7fd1e815d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.716+0000 7fd1ed055640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1e8072de0 0x7fd1e815d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49824/0 (socket says 172.21.15.19:49824) 2024-09-12T02:07:37.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.716+0000 7fd1ed055640 1 -- 172.21.15.19:0/2416878240 learned_addr learned my addr 172.21.15.19:0/2416878240 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:37.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.716+0000 7fd1ee057640 1 --2- 172.21.15.19:0/2416878240 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1e8072700 0x7fd1e815d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.717+0000 7fd1ed055640 1 -- 172.21.15.19:0/2416878240 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1e8072700 msgr2=0x7fd1e815d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:37.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.717+0000 7fd1ed055640 1 --2- 172.21.15.19:0/2416878240 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1e8072700 0x7fd1e815d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.717+0000 7fd1ed055640 1 -- 172.21.15.19:0/2416878240 >> v1:172.21.15.135:6789/0 conn(0x7fd1e8072320 legacy=0x7fd1e80cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.717+0000 7fd1ed055640 1 -- 172.21.15.19:0/2416878240 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e80cdd00 con 0x7fd1e8072de0 2024-09-12T02:07:37.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.717+0000 7fd1ed055640 1 --2- 172.21.15.19:0/2416878240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1e8072de0 0x7fd1e815d1e0 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009870 tx=0x7fd1dc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d090b1d2574fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.717+0000 7fd1ec854640 1 -- 172.21.15.19:0/2416878240 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc037070 con 0x7fd1e8072de0 2024-09-12T02:07:37.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.717+0000 7fd1ec854640 1 -- 172.21.15.19:0/2416878240 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1dc032440 con 0x7fd1e8072de0 2024-09-12T02:07:37.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.717+0000 7fd1ec854640 1 -- 172.21.15.19:0/2416878240 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc032810 con 0x7fd1e8072de0 2024-09-12T02:07:37.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.718+0000 7fd1efaba640 1 -- 172.21.15.19:0/2416878240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1e8072de0 msgr2=0x7fd1e815d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.718+0000 7fd1efaba640 1 --2- 172.21.15.19:0/2416878240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1e8072de0 0x7fd1e815d1e0 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009870 tx=0x7fd1dc02a1c0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.718+0000 7fd1efaba640 1 -- 172.21.15.19:0/2416878240 shutdown_connections 2024-09-12T02:07:37.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.718+0000 7fd1efaba640 1 --2- 172.21.15.19:0/2416878240 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1e8072700 0x7fd1e815d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.718+0000 7fd1efaba640 1 --2- 172.21.15.19:0/2416878240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1e8072de0 0x7fd1e815d1e0 unknown :-1 s=CLOSED pgs=2375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.718+0000 7fd1efaba640 1 -- 172.21.15.19:0/2416878240 >> 172.21.15.19:0/2416878240 conn(0x7fd1e8067d70 msgr2=0x7fd1e806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:37.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.718+0000 7fd1efaba640 1 -- 172.21.15.19:0/2416878240 shutdown_connections 2024-09-12T02:07:37.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.718+0000 7fd1efaba640 1 -- 172.21.15.19:0/2416878240 wait complete. 2024-09-12T02:07:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.719+0000 7fd1efaba640 1 Processor -- start 2024-09-12T02:07:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.719+0000 7fd1efaba640 1 -- start start 2024-09-12T02:07:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.720+0000 7fd1efaba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1e8072320 0x7fd1e80c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.720+0000 7fd1efaba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1e8072700 0x7fd1e8135b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.720+0000 7fd1efaba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1e8072de0 0x7fd1e80c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.720+0000 7fd1efaba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e815dde0 con 0x7fd1e8072700 2024-09-12T02:07:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.720+0000 7fd1efaba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e815dc60 con 0x7fd1e8072de0 2024-09-12T02:07:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.720+0000 7fd1efaba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd1e815df60 con 0x7fd1e8072320 2024-09-12T02:07:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.720+0000 7fd1ed055640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1e8072700 0x7fd1e8135b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.720+0000 7fd1ed055640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1e8072700 0x7fd1e8135b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49828/0 (socket says 172.21.15.19:49828) 2024-09-12T02:07:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.720+0000 7fd1ed055640 1 -- 172.21.15.19:0/1948379732 learned_addr learned my addr 172.21.15.19:0/1948379732 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.720+0000 7fd1ed856640 1 --2- 172.21.15.19:0/1948379732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1e8072320 0x7fd1e80c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.720+0000 7fd1ee057640 1 --2- 172.21.15.19:0/1948379732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1e8072de0 0x7fd1e80c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.721+0000 7fd1ed055640 1 -- 172.21.15.19:0/1948379732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1e8072320 msgr2=0x7fd1e80c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.721+0000 7fd1ed055640 1 --2- 172.21.15.19:0/1948379732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1e8072320 0x7fd1e80c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.721+0000 7fd1ed055640 1 -- 172.21.15.19:0/1948379732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1e8072de0 msgr2=0x7fd1e80c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.721+0000 7fd1ed055640 1 --2- 172.21.15.19:0/1948379732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1e8072de0 0x7fd1e80c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.721+0000 7fd1ed055640 1 -- 172.21.15.19:0/1948379732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e80c8040 con 0x7fd1e8072700 2024-09-12T02:07:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.721+0000 7fd1ed055640 1 --2- 172.21.15.19:0/1948379732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1e8072700 0x7fd1e8135b40 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc02a200 tx=0x7fd1dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.721+0000 7fd1e67fc640 1 -- 172.21.15.19:0/1948379732 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc041020 con 0x7fd1e8072700 2024-09-12T02:07:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.721+0000 7fd1e67fc640 1 -- 172.21.15.19:0/1948379732 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1dc0306c0 con 0x7fd1e8072700 2024-09-12T02:07:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.721+0000 7fd1efaba640 1 -- 172.21.15.19:0/1948379732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e8136080 con 0x7fd1e8072700 2024-09-12T02:07:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.721+0000 7fd1e67fc640 1 -- 172.21.15.19:0/1948379732 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc037040 con 0x7fd1e8072700 2024-09-12T02:07:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.721+0000 7fd1efaba640 1 -- 172.21.15.19:0/1948379732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e80c85c0 con 0x7fd1e8072700 2024-09-12T02:07:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.722+0000 7fd1efaba640 1 -- 172.21.15.19:0/1948379732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1e815e370 con 0x7fd1e8072700 2024-09-12T02:07:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.722+0000 7fd1e67fc640 1 -- 172.21.15.19:0/1948379732 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd1dc044020 con 0x7fd1e8072700 2024-09-12T02:07:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.723+0000 7fd1e67fc640 1 --2- 172.21.15.19:0/1948379732 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd1d406be30 0x7fd1d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.723+0000 7fd1e67fc640 1 -- 172.21.15.19:0/1948379732 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7fd1dc0ab380 con 0x7fd1e8072700 2024-09-12T02:07:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.723+0000 7fd1ed856640 1 --2- 172.21.15.19:0/1948379732 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd1d406be30 0x7fd1d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.724+0000 7fd1ed856640 1 --2- 172.21.15.19:0/1948379732 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd1d406be30 0x7fd1d406e2f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0001780 tx=0x7fd1e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.727+0000 7fd1e67fc640 1 -- 172.21.15.19:0/1948379732 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd1dc04b030 con 0x7fd1e8072700 2024-09-12T02:07:37.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.906+0000 7fd1efaba640 1 -- 172.21.15.19:0/1948379732 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fd1e8144400 con 0x7fd1d406be30 2024-09-12T02:07:37.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.907+0000 7fd1e67fc640 1 -- 172.21.15.19:0/1948379732 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd1e8144400 con 0x7fd1d406be30 2024-09-12T02:07:37.908 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T02:07:37.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.909+0000 7fd1efaba640 1 -- 172.21.15.19:0/1948379732 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd1d406be30 msgr2=0x7fd1d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.909+0000 7fd1efaba640 1 --2- 172.21.15.19:0/1948379732 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd1d406be30 0x7fd1d406e2f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0001780 tx=0x7fd1e0009040 comp rx=0 tx=0).stop 2024-09-12T02:07:37.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.909+0000 7fd1efaba640 1 -- 172.21.15.19:0/1948379732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1e8072700 msgr2=0x7fd1e8135b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.909+0000 7fd1efaba640 1 --2- 172.21.15.19:0/1948379732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1e8072700 0x7fd1e8135b40 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc02a200 tx=0x7fd1dc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.909+0000 7fd1efaba640 1 -- 172.21.15.19:0/1948379732 shutdown_connections 2024-09-12T02:07:37.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.909+0000 7fd1efaba640 1 --2- 172.21.15.19:0/1948379732 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd1d406be30 0x7fd1d406e2f0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.909+0000 7fd1efaba640 1 --2- 172.21.15.19:0/1948379732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1e8072de0 0x7fd1e80c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.909+0000 7fd1efaba640 1 --2- 172.21.15.19:0/1948379732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1e8072700 0x7fd1e8135b40 unknown :-1 s=CLOSED pgs=2376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.909+0000 7fd1efaba640 1 --2- 172.21.15.19:0/1948379732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1e8072320 0x7fd1e80c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.909+0000 7fd1efaba640 1 -- 172.21.15.19:0/1948379732 >> 172.21.15.19:0/1948379732 conn(0x7fd1e8067d70 msgr2=0x7fd1e806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:37.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.909+0000 7fd1efaba640 1 -- 172.21.15.19:0/1948379732 shutdown_connections 2024-09-12T02:07:37.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:37.909+0000 7fd1efaba640 1 -- 172.21.15.19:0/1948379732 wait complete. 2024-09-12T02:07:37.921 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T02:07:37.921 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:07:38.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.027+0000 7fc1da65e640 1 Processor -- start 2024-09-12T02:07:38.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.027+0000 7fc1da65e640 1 -- start start 2024-09-12T02:07:38.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.028+0000 7fc1da65e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc1d415e7f0 0x7fc1d40b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.028+0000 7fc1da65e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1d40af210 0x7fc1d4070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.028+0000 7fc1da65e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1d406cdc0 con 0x7fc1d40b7250 2024-09-12T02:07:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.028+0000 7fc1da65e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc1d406d0a0 con 0x7fc1d415e7f0 2024-09-12T02:07:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.028+0000 7fc1da65e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc1d406d380 con 0x7fc1d40af210 2024-09-12T02:07:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.029+0000 7fc1d3fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc1d415e7f0 0x7fc1d40b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.029+0000 7fc1cbfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1d40af210 0x7fc1d4070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.029+0000 7fc1d8bfb640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fc1d40b7250 0x7fc1d409aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.19:43800/0 (socket says 172.21.15.19:43800) 2024-09-12T02:07:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.029+0000 7fc1d8bfb640 1 -- 172.21.15.19:0/1632753435 learned_addr learned my addr 172.21.15.19:0/1632753435 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.029+0000 7fc1d3fff640 1 -- 172.21.15.19:0/1632753435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1d40af210 msgr2=0x7fc1d4070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:38.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.029+0000 7fc1d3fff640 1 --2- 172.21.15.19:0/1632753435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1d40af210 0x7fc1d4070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.029+0000 7fc1d3fff640 1 -- 172.21.15.19:0/1632753435 >> v1:172.21.15.135:6789/0 conn(0x7fc1d40b7250 legacy=0x7fc1d409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.029+0000 7fc1d3fff640 1 -- 172.21.15.19:0/1632753435 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d406d660 con 0x7fc1d415e7f0 2024-09-12T02:07:38.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.030+0000 7fc1d3fff640 1 --2- 172.21.15.19:0/1632753435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1d415e7f0 0x7fc1d40b6d10 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40097a0 tx=0x7fc1c402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7737d5280838d818 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.030+0000 7fc1d37fe640 1 -- 172.21.15.19:0/1632753435 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4037070 con 0x7fc1d415e7f0 2024-09-12T02:07:38.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.030+0000 7fc1d37fe640 1 -- 172.21.15.19:0/1632753435 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c4032440 con 0x7fc1d415e7f0 2024-09-12T02:07:38.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.030+0000 7fc1d37fe640 1 -- 172.21.15.19:0/1632753435 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4032810 con 0x7fc1d415e7f0 2024-09-12T02:07:38.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.031+0000 7fc1da65e640 1 -- 172.21.15.19:0/1632753435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1d415e7f0 msgr2=0x7fc1d40b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.031+0000 7fc1da65e640 1 --2- 172.21.15.19:0/1632753435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1d415e7f0 0x7fc1d40b6d10 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40097a0 tx=0x7fc1c402a180 comp rx=0 tx=0).stop 2024-09-12T02:07:38.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.031+0000 7fc1da65e640 1 -- 172.21.15.19:0/1632753435 shutdown_connections 2024-09-12T02:07:38.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.031+0000 7fc1da65e640 1 --2- 172.21.15.19:0/1632753435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1d40af210 0x7fc1d4070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.031+0000 7fc1da65e640 1 --2- 172.21.15.19:0/1632753435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1d415e7f0 0x7fc1d40b6d10 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.031+0000 7fc1da65e640 1 -- 172.21.15.19:0/1632753435 >> 172.21.15.19:0/1632753435 conn(0x7fc1d40b3f30 msgr2=0x7fc1d40b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:38.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.031+0000 7fc1da65e640 1 -- 172.21.15.19:0/1632753435 shutdown_connections 2024-09-12T02:07:38.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.031+0000 7fc1da65e640 1 -- 172.21.15.19:0/1632753435 wait complete. 2024-09-12T02:07:38.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.032+0000 7fc1da65e640 1 Processor -- start 2024-09-12T02:07:38.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.032+0000 7fc1da65e640 1 -- start start 2024-09-12T02:07:38.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1da65e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1d40af210 0x7fc1d4154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1da65e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1d40b7250 0x7fc1d415b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1da65e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1d415e7f0 0x7fc1d4153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1da65e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d4070fb0 con 0x7fc1d415e7f0 2024-09-12T02:07:38.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1da65e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d40b6150 con 0x7fc1d40b7250 2024-09-12T02:07:38.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1da65e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc1d4071130 con 0x7fc1d40af210 2024-09-12T02:07:38.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1d8bfb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1d415e7f0 0x7fc1d4153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1d8bfb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1d415e7f0 0x7fc1d4153bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49840/0 (socket says 172.21.15.19:49840) 2024-09-12T02:07:38.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1d8bfb640 1 -- 172.21.15.19:0/2161579086 learned_addr learned my addr 172.21.15.19:0/2161579086 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:38.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1d3fff640 1 --2- 172.21.15.19:0/2161579086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1d40af210 0x7fc1d4154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1cbfff640 1 --2- 172.21.15.19:0/2161579086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1d40b7250 0x7fc1d415b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1d8bfb640 1 -- 172.21.15.19:0/2161579086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1d40af210 msgr2=0x7fc1d4154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1d8bfb640 1 --2- 172.21.15.19:0/2161579086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1d40af210 0x7fc1d4154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1d8bfb640 1 -- 172.21.15.19:0/2161579086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1d40b7250 msgr2=0x7fc1d415b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1d8bfb640 1 --2- 172.21.15.19:0/2161579086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1d40b7250 0x7fc1d415b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1d8bfb640 1 -- 172.21.15.19:0/2161579086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d41f7db0 con 0x7fc1d415e7f0 2024-09-12T02:07:38.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1d8bfb640 1 --2- 172.21.15.19:0/2161579086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1d415e7f0 0x7fc1d4153bb0 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00caa0 tx=0x7fc1cc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1d17fa640 1 -- 172.21.15.19:0/2161579086 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc017070 con 0x7fc1d415e7f0 2024-09-12T02:07:38.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1d17fa640 1 -- 172.21.15.19:0/2161579086 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1cc00ab40 con 0x7fc1d415e7f0 2024-09-12T02:07:38.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.033+0000 7fc1d17fa640 1 -- 172.21.15.19:0/2161579086 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc012400 con 0x7fc1d415e7f0 2024-09-12T02:07:38.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.034+0000 7fc1da65e640 1 -- 172.21.15.19:0/2161579086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d41f8090 con 0x7fc1d415e7f0 2024-09-12T02:07:38.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.034+0000 7fc1da65e640 1 -- 172.21.15.19:0/2161579086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1d41f8650 con 0x7fc1d415e7f0 2024-09-12T02:07:38.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.034+0000 7fc1da65e640 1 -- 172.21.15.19:0/2161579086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc1d41f7b60 con 0x7fc1d415e7f0 2024-09-12T02:07:38.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.035+0000 7fc1d17fa640 1 -- 172.21.15.19:0/2161579086 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc1cc01a070 con 0x7fc1d415e7f0 2024-09-12T02:07:38.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.036+0000 7fc1d17fa640 1 --2- 172.21.15.19:0/2161579086 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc1b406be30 0x7fc1b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.036+0000 7fc1d17fa640 1 -- 172.21.15.19:0/2161579086 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7fc1cc08a990 con 0x7fc1d415e7f0 2024-09-12T02:07:38.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.036+0000 7fc1d17fa640 1 --2- 172.21.15.19:0/2161579086 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7fc1b4072370 0x7fc1b40747b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.036+0000 7fc1d3fff640 1 --2- 172.21.15.19:0/2161579086 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc1b406be30 0x7fc1b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.036+0000 7fc1d17fa640 1 -- 172.21.15.19:0/2161579086 --> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc1b4074e80 con 0x7fc1b4072370 2024-09-12T02:07:38.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.036+0000 7fc1d17fa640 1 -- 172.21.15.19:0/2161579086 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=149) ==== 24+0+0 (secure 0 0 0) 0x7fc1cc08f2c0 con 0x7fc1d415e7f0 2024-09-12T02:07:38.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.036+0000 7fc1cbfff640 1 --2- 172.21.15.19:0/2161579086 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7fc1b4072370 0x7fc1b40747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.036+0000 7fc1cbfff640 1 --2- 172.21.15.19:0/2161579086 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7fc1b4072370 0x7fc1b40747b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.036+0000 7fc1d3fff640 1 --2- 172.21.15.19:0/2161579086 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc1b406be30 0x7fc1b406e2f0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4034000 tx=0x7fc1c402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.037+0000 7fc1d17fa640 1 -- 172.21.15.19:0/2161579086 <== osd.2 v2:172.21.15.19:6816/1297238899 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc1b4074e80 con 0x7fc1b4072370 2024-09-12T02:07:38.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.049+0000 7fc1da65e640 1 -- 172.21.15.19:0/2161579086 --> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc1d4070a70 con 0x7fc1b4072370 2024-09-12T02:07:38.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.050+0000 7fc1d17fa640 1 -- 172.21.15.19:0/2161579086 <== osd.2 v2:172.21.15.19:6816/1297238899 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc1d4070a70 con 0x7fc1b4072370 2024-09-12T02:07:38.050 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:07:38.051 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:07:38.051 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:07:38.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.050+0000 7fc1da65e640 1 -- 172.21.15.19:0/2161579086 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7fc1b4072370 msgr2=0x7fc1b40747b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.050+0000 7fc1da65e640 1 --2- 172.21.15.19:0/2161579086 >> [v2:172.21.15.19:6816/1297238899,v1:172.21.15.19:6817/1297238899] conn(0x7fc1b4072370 0x7fc1b40747b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.050+0000 7fc1da65e640 1 -- 172.21.15.19:0/2161579086 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc1b406be30 msgr2=0x7fc1b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.050+0000 7fc1da65e640 1 --2- 172.21.15.19:0/2161579086 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fc1b406be30 0x7fc1b406e2f0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4034000 tx=0x7fc1c402e000 comp rx=0 tx=0).stop 2024-09-12T02:07:38.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.050+0000 7fc1da65e640 1 -- 172.21.15.19:0/2161579086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1d415e7f0 msgr2=0x7fc1d4153bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.050+0000 7fc1da65e640 1 --2- 172.21.15.19:0/2161579086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1d415e7f0 0x7fc1d4153bb0 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00caa0 tx=0x7fc1cc00cf60 comp rx=0 tx=0).stop 2024-09-12T02:07:38.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.050+0000 7fc1d8bfb640 1 -- 172.21.15.19:0/2161579086 reap_dead start 2024-09-12T02:07:38.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.050+0000 7fc1da65e640 1 -- 172.21.15.19:0/2161579086 shutdown_connections 2024-09-12T02:07:38.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.050+0000 7fc1da65e640 1 -- 172.21.15.19:0/2161579086 >> 172.21.15.19:0/2161579086 conn(0x7fc1d40b3f30 msgr2=0x7fc1d40af660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:38.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.050+0000 7fc1da65e640 1 -- 172.21.15.19:0/2161579086 shutdown_connections 2024-09-12T02:07:38.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.050+0000 7fc1da65e640 1 -- 172.21.15.19:0/2161579086 wait complete. 2024-09-12T02:07:38.061 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T02:07:38.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.165+0000 7f28c4349640 1 Processor -- start 2024-09-12T02:07:38.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.165+0000 7f28c4349640 1 -- start start 2024-09-12T02:07:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.166+0000 7f28c4349640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28bc15b300 0x7f28bc0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.166+0000 7f28c4349640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28bc0cd3f0 0x7f28bc06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.166+0000 7f28c4349640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f28bc072d30 0x7f28bc06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.166+0000 7f28c4349640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f28bc0728a0 con 0x7f28bc0cd3f0 2024-09-12T02:07:38.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.166+0000 7f28c4349640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f28bc0cdbe0 con 0x7f28bc072d30 2024-09-12T02:07:38.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.166+0000 7f28c4349640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f28bc0cd900 con 0x7f28bc15b300 2024-09-12T02:07:38.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.166+0000 7f28c18e4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28bc0cd3f0 0x7f28bc06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.166+0000 7f28c18e4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28bc0cd3f0 0x7f28bc06f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49852/0 (socket says 172.21.15.19:49852) 2024-09-12T02:07:38.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.166+0000 7f28c18e4640 1 -- 172.21.15.19:0/2073044819 learned_addr learned my addr 172.21.15.19:0/2073044819 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:38.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.166+0000 7f28c20e5640 1 --2- 172.21.15.19:0/2073044819 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28bc15b300 0x7f28bc0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.166+0000 7f28c28e6640 1 --2- 172.21.15.19:0/2073044819 >> v2:172.21.15.135:3300/0 conn(0x7f28bc072d30 0x7f28bc06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.166+0000 7f28c18e4640 1 -- 172.21.15.19:0/2073044819 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28bc15b300 msgr2=0x7f28bc0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:38.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.166+0000 7f28c18e4640 1 --2- 172.21.15.19:0/2073044819 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28bc15b300 0x7f28bc0cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.166+0000 7f28c18e4640 1 -- 172.21.15.19:0/2073044819 >> v2:172.21.15.135:3300/0 conn(0x7f28bc072d30 msgr2=0x7f28bc06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:38.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.166+0000 7f28c18e4640 1 --2- 172.21.15.19:0/2073044819 >> v2:172.21.15.135:3300/0 conn(0x7f28bc072d30 0x7f28bc06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.166+0000 7f28c18e4640 1 -- 172.21.15.19:0/2073044819 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28bc072250 con 0x7f28bc0cd3f0 2024-09-12T02:07:38.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.167+0000 7f28c18e4640 1 --2- 172.21.15.19:0/2073044819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28bc0cd3f0 0x7f28bc06f1c0 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7f28bc072040 tx=0x7f28ac02c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9900b5659735609 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.167+0000 7f28c10e3640 1 -- 172.21.15.19:0/2073044819 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac038070 con 0x7f28bc0cd3f0 2024-09-12T02:07:38.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.167+0000 7f28c10e3640 1 -- 172.21.15.19:0/2073044819 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28ac031710 con 0x7f28bc0cd3f0 2024-09-12T02:07:38.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.167+0000 7f28c10e3640 1 -- 172.21.15.19:0/2073044819 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac031ae0 con 0x7f28bc0cd3f0 2024-09-12T02:07:38.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.168+0000 7f28c4349640 1 -- 172.21.15.19:0/2073044819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28bc0cd3f0 msgr2=0x7f28bc06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.168+0000 7f28c4349640 1 --2- 172.21.15.19:0/2073044819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28bc0cd3f0 0x7f28bc06f1c0 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7f28bc072040 tx=0x7f28ac02c3f0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.168+0000 7f28c4349640 1 -- 172.21.15.19:0/2073044819 shutdown_connections 2024-09-12T02:07:38.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.168+0000 7f28c4349640 1 --2- 172.21.15.19:0/2073044819 >> v2:172.21.15.135:3300/0 conn(0x7f28bc072d30 0x7f28bc06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.168+0000 7f28c4349640 1 --2- 172.21.15.19:0/2073044819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28bc0cd3f0 0x7f28bc06f1c0 unknown :-1 s=CLOSED pgs=2378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.168+0000 7f28c4349640 1 --2- 172.21.15.19:0/2073044819 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28bc15b300 0x7f28bc0cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.168+0000 7f28c4349640 1 -- 172.21.15.19:0/2073044819 >> 172.21.15.19:0/2073044819 conn(0x7f28bc067d70 msgr2=0x7f28bc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:38.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.168+0000 7f28c4349640 1 -- 172.21.15.19:0/2073044819 shutdown_connections 2024-09-12T02:07:38.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.168+0000 7f28c4349640 1 -- 172.21.15.19:0/2073044819 wait complete. 2024-09-12T02:07:38.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.169+0000 7f28c4349640 1 Processor -- start 2024-09-12T02:07:38.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.169+0000 7f28c4349640 1 -- start start 2024-09-12T02:07:38.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.170+0000 7f28c4349640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28bc072d30 0x7f28bc14f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.170+0000 7f28c4349640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28bc0cd3f0 0x7f28bc0ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.170+0000 7f28c4349640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28bc15b300 0x7f28bc1534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.170+0000 7f28c4349640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc0d0160 con 0x7f28bc15b300 2024-09-12T02:07:38.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.170+0000 7f28c4349640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc0cffe0 con 0x7f28bc0cd3f0 2024-09-12T02:07:38.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.170+0000 7f28c4349640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f28bc0b3c40 con 0x7f28bc072d30 2024-09-12T02:07:38.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.170+0000 7f28c28e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28bc15b300 0x7f28bc1534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.170+0000 7f28c28e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28bc15b300 0x7f28bc1534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49864/0 (socket says 172.21.15.19:49864) 2024-09-12T02:07:38.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.170+0000 7f28c28e6640 1 -- 172.21.15.19:0/2401795905 learned_addr learned my addr 172.21.15.19:0/2401795905 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:38.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.170+0000 7f28c20e5640 1 --2- 172.21.15.19:0/2401795905 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28bc072d30 0x7f28bc14f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.170+0000 7f28c18e4640 1 --2- 172.21.15.19:0/2401795905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28bc0cd3f0 0x7f28bc0ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.170+0000 7f28c28e6640 1 -- 172.21.15.19:0/2401795905 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28bc072d30 msgr2=0x7f28bc14f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.170+0000 7f28c28e6640 1 --2- 172.21.15.19:0/2401795905 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28bc072d30 0x7f28bc14f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.170+0000 7f28c28e6640 1 -- 172.21.15.19:0/2401795905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28bc0cd3f0 msgr2=0x7f28bc0ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.170+0000 7f28c28e6640 1 --2- 172.21.15.19:0/2401795905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28bc0cd3f0 0x7f28bc0ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.170+0000 7f28c28e6640 1 -- 172.21.15.19:0/2401795905 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28bc155660 con 0x7f28bc15b300 2024-09-12T02:07:38.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.170+0000 7f28c28e6640 1 --2- 172.21.15.19:0/2401795905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28bc15b300 0x7f28bc1534d0 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f28b400d830 tx=0x7f28b400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.171+0000 7f28b2ffd640 1 -- 172.21.15.19:0/2401795905 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b4018020 con 0x7f28bc15b300 2024-09-12T02:07:38.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.171+0000 7f28b2ffd640 1 -- 172.21.15.19:0/2401795905 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b40096c0 con 0x7f28bc15b300 2024-09-12T02:07:38.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.171+0000 7f28c4349640 1 -- 172.21.15.19:0/2401795905 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28bc0cad90 con 0x7f28bc15b300 2024-09-12T02:07:38.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.171+0000 7f28b2ffd640 1 -- 172.21.15.19:0/2401795905 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b4009a90 con 0x7f28bc15b300 2024-09-12T02:07:38.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.171+0000 7f28c4349640 1 -- 172.21.15.19:0/2401795905 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28bc150ea0 con 0x7f28bc15b300 2024-09-12T02:07:38.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.172+0000 7f28c4349640 1 -- 172.21.15.19:0/2401795905 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28bc159610 con 0x7f28bc15b300 2024-09-12T02:07:38.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.172+0000 7f28b2ffd640 1 -- 172.21.15.19:0/2401795905 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28b401b020 con 0x7f28bc15b300 2024-09-12T02:07:38.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.172+0000 7f28b2ffd640 1 --2- 172.21.15.19:0/2401795905 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f28a006be30 0x7f28a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.173+0000 7f28b2ffd640 1 -- 172.21.15.19:0/2401795905 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7f28b408add0 con 0x7f28bc15b300 2024-09-12T02:07:38.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.173+0000 7f28c20e5640 1 --2- 172.21.15.19:0/2401795905 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f28a006be30 0x7f28a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.173+0000 7f28c20e5640 1 --2- 172.21.15.19:0/2401795905 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f28a006be30 0x7f28a006e2f0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f28b8003aa0 tx=0x7f28b8009830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.177+0000 7f28b2ffd640 1 -- 172.21.15.19:0/2401795905 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f28b4022030 con 0x7f28bc15b300 2024-09-12T02:07:38.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.356+0000 7f28c4349640 1 -- 172.21.15.19:0/2401795905 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f28bc150cf0 con 0x7f28a006be30 2024-09-12T02:07:38.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.357+0000 7f28b2ffd640 1 -- 172.21.15.19:0/2401795905 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f28bc150cf0 con 0x7f28a006be30 2024-09-12T02:07:38.357 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T02:07:38.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.359+0000 7f28c4349640 1 -- 172.21.15.19:0/2401795905 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f28a006be30 msgr2=0x7f28a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.359+0000 7f28c4349640 1 --2- 172.21.15.19:0/2401795905 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f28a006be30 0x7f28a006e2f0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f28b8003aa0 tx=0x7f28b8009830 comp rx=0 tx=0).stop 2024-09-12T02:07:38.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.359+0000 7f28c4349640 1 -- 172.21.15.19:0/2401795905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28bc15b300 msgr2=0x7f28bc1534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.359+0000 7f28c4349640 1 --2- 172.21.15.19:0/2401795905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28bc15b300 0x7f28bc1534d0 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f28b400d830 tx=0x7f28b400dcf0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.359+0000 7f28c4349640 1 -- 172.21.15.19:0/2401795905 shutdown_connections 2024-09-12T02:07:38.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.359+0000 7f28c4349640 1 --2- 172.21.15.19:0/2401795905 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f28a006be30 0x7f28a006e2f0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.359+0000 7f28c4349640 1 --2- 172.21.15.19:0/2401795905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28bc15b300 0x7f28bc1534d0 unknown :-1 s=CLOSED pgs=2379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.359+0000 7f28c4349640 1 --2- 172.21.15.19:0/2401795905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28bc0cd3f0 0x7f28bc0ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.359+0000 7f28c4349640 1 --2- 172.21.15.19:0/2401795905 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28bc072d30 0x7f28bc14f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.359+0000 7f28c4349640 1 -- 172.21.15.19:0/2401795905 >> 172.21.15.19:0/2401795905 conn(0x7f28bc067d70 msgr2=0x7f28bc15cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:38.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.359+0000 7f28c4349640 1 -- 172.21.15.19:0/2401795905 shutdown_connections 2024-09-12T02:07:38.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.359+0000 7f28c4349640 1 -- 172.21.15.19:0/2401795905 wait complete. 2024-09-12T02:07:38.370 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T02:07:38.370 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:07:38.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.477+0000 7f14f53a6640 1 Processor -- start 2024-09-12T02:07:38.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.477+0000 7f14f53a6640 1 -- start start 2024-09-12T02:07:38.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.478+0000 7f14f53a6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f14f015e6c0 0x7f14f00cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.478+0000 7f14f53a6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14f00d34f0 con 0x7f14f00cfcb0 2024-09-12T02:07:38.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.478+0000 7f14f53a6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14f00d3790 con 0x7f14f00d5090 2024-09-12T02:07:38.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.478+0000 7f14f53a6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f14f00cf400 con 0x7f14f015e6c0 2024-09-12T02:07:38.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.478+0000 7f14eeffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f14f015e6c0 0x7f14f00cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.478+0000 7f14ef7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f14f00cfcb0 0x7f14f00b1540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57730/0 (socket says 172.21.15.19:57730) 2024-09-12T02:07:38.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.478+0000 7f14ef7fe640 1 -- 172.21.15.19:0/568881612 learned_addr learned my addr 172.21.15.19:0/568881612 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:38.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.479+0000 7f14eeffd640 1 -- 172.21.15.19:0/568881612 >> v1:172.21.15.135:6789/0 conn(0x7f14f00d5090 legacy=0x7f14f00cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.479+0000 7f14eeffd640 1 -- 172.21.15.19:0/568881612 >> v1:172.21.15.19:6789/0 conn(0x7f14f00cfcb0 legacy=0x7f14f00b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.479+0000 7f14eeffd640 1 -- 172.21.15.19:0/568881612 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f00d3a70 con 0x7f14f015e6c0 2024-09-12T02:07:38.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.479+0000 7f14edffb640 1 -- 172.21.15.19:0/568881612 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3612308635 0 0) 0x7f14f00d34f0 con 0x7f14f00cfcb0 2024-09-12T02:07:38.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.479+0000 7f14eeffd640 1 --2- 172.21.15.19:0/568881612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14f015e6c0 0x7f14f00cebb0 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7f14e00097a0 tx=0x7f14e002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c94479ba381e610 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.480+0000 7f14edffb640 1 -- 172.21.15.19:0/568881612 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0037070 con 0x7f14f015e6c0 2024-09-12T02:07:38.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.480+0000 7f14edffb640 1 -- 172.21.15.19:0/568881612 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e0032440 con 0x7f14f015e6c0 2024-09-12T02:07:38.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.480+0000 7f14edffb640 1 -- 172.21.15.19:0/568881612 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0032810 con 0x7f14f015e6c0 2024-09-12T02:07:38.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.480+0000 7f14f53a6640 1 -- 172.21.15.19:0/568881612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14f015e6c0 msgr2=0x7f14f00cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.480+0000 7f14f53a6640 1 --2- 172.21.15.19:0/568881612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14f015e6c0 0x7f14f00cebb0 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7f14e00097a0 tx=0x7f14e002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.480+0000 7f14f53a6640 1 -- 172.21.15.19:0/568881612 shutdown_connections 2024-09-12T02:07:38.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.480+0000 7f14f53a6640 1 --2- 172.21.15.19:0/568881612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14f015e6c0 0x7f14f00cebb0 unknown :-1 s=CLOSED pgs=2381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.480+0000 7f14f53a6640 1 -- 172.21.15.19:0/568881612 >> 172.21.15.19:0/568881612 conn(0x7f14f008bfc0 msgr2=0x7f14f00d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.480+0000 7f14f53a6640 1 -- 172.21.15.19:0/568881612 shutdown_connections 2024-09-12T02:07:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.480+0000 7f14f53a6640 1 -- 172.21.15.19:0/568881612 wait complete. 2024-09-12T02:07:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.481+0000 7f14f53a6640 1 Processor -- start 2024-09-12T02:07:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.482+0000 7f14f53a6640 1 -- start start 2024-09-12T02:07:38.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.482+0000 7f14f53a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14f00cfcb0 0x7f14f015f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.482+0000 7f14f53a6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14f00d5090 0x7f14f0157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.482+0000 7f14f53a6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14f015e6c0 0x7f14f0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.482+0000 7f14f53a6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f14f015eaa0 con 0x7f14f00cfcb0 2024-09-12T02:07:38.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.482+0000 7f14f53a6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f14f00b10d0 con 0x7f14f015e6c0 2024-09-12T02:07:38.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.482+0000 7f14f53a6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f14f015ec20 con 0x7f14f00d5090 2024-09-12T02:07:38.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.482+0000 7f14eeffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14f00cfcb0 0x7f14f015f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.482+0000 7f14eeffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14f00cfcb0 0x7f14f015f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49882/0 (socket says 172.21.15.19:49882) 2024-09-12T02:07:38.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.482+0000 7f14eeffd640 1 -- 172.21.15.19:0/2035950375 learned_addr learned my addr 172.21.15.19:0/2035950375 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:38.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.483+0000 7f14eeffd640 1 -- 172.21.15.19:0/2035950375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14f00d5090 msgr2=0x7f14f0157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.483+0000 7f14ef7fe640 1 --2- 172.21.15.19:0/2035950375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14f015e6c0 0x7f14f0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.483+0000 7f14eeffd640 1 --2- 172.21.15.19:0/2035950375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14f00d5090 0x7f14f0157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.483+0000 7f14eeffd640 1 -- 172.21.15.19:0/2035950375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14f015e6c0 msgr2=0x7f14f0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.483+0000 7f14eeffd640 1 --2- 172.21.15.19:0/2035950375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14f015e6c0 0x7f14f0159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.483+0000 7f14eeffd640 1 -- 172.21.15.19:0/2035950375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f015a400 con 0x7f14f00cfcb0 2024-09-12T02:07:38.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.483+0000 7f14eeffd640 1 --2- 172.21.15.19:0/2035950375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14f00cfcb0 0x7f14f015f220 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f14e00098c0 tx=0x7f14e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.483+0000 7f14d77fe640 1 -- 172.21.15.19:0/2035950375 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0037040 con 0x7f14f00cfcb0 2024-09-12T02:07:38.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.483+0000 7f14d77fe640 1 -- 172.21.15.19:0/2035950375 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e0042070 con 0x7f14f00cfcb0 2024-09-12T02:07:38.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.483+0000 7f14f53a6640 1 -- 172.21.15.19:0/2035950375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f015f820 con 0x7f14f00cfcb0 2024-09-12T02:07:38.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.483+0000 7f14d77fe640 1 -- 172.21.15.19:0/2035950375 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0030a70 con 0x7f14f00cfcb0 2024-09-12T02:07:38.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.483+0000 7f14f53a6640 1 -- 172.21.15.19:0/2035950375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f015fde0 con 0x7f14f00cfcb0 2024-09-12T02:07:38.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.484+0000 7f14f53a6640 1 -- 172.21.15.19:0/2035950375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f14f00cebb0 con 0x7f14f00cfcb0 2024-09-12T02:07:38.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.485+0000 7f14d77fe640 1 -- 172.21.15.19:0/2035950375 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f14e0030c10 con 0x7f14f00cfcb0 2024-09-12T02:07:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.485+0000 7f14d77fe640 1 --2- 172.21.15.19:0/2035950375 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14dc06be30 0x7f14dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.485+0000 7f14d77fe640 1 -- 172.21.15.19:0/2035950375 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7f14e00ab7e0 con 0x7f14f00cfcb0 2024-09-12T02:07:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.485+0000 7f14d77fe640 1 --2- 172.21.15.19:0/2035950375 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x7f14dc072370 0x7f14dc0747b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.485+0000 7f14ee7fc640 1 --2- 172.21.15.19:0/2035950375 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14dc06be30 0x7f14dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.485+0000 7f14d77fe640 1 -- 172.21.15.19:0/2035950375 --> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14e0034e90 con 0x7f14dc072370 2024-09-12T02:07:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.485+0000 7f14d77fe640 1 -- 172.21.15.19:0/2035950375 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=149) ==== 24+0+0 (secure 0 0 0) 0x7f14e00b02c0 con 0x7f14f00cfcb0 2024-09-12T02:07:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.486+0000 7f14ef7fe640 1 --2- 172.21.15.19:0/2035950375 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x7f14dc072370 0x7f14dc0747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.486+0000 7f14ef7fe640 1 --2- 172.21.15.19:0/2035950375 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x7f14dc072370 0x7f14dc0747b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.486+0000 7f14ee7fc640 1 --2- 172.21.15.19:0/2035950375 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14dc06be30 0x7f14dc06e2f0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f14e4000f60 tx=0x7f14e40079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.486+0000 7f14d77fe640 1 -- 172.21.15.19:0/2035950375 <== osd.3 v2:172.21.15.19:6800/2581301650 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14e0034e90 con 0x7f14dc072370 2024-09-12T02:07:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.499+0000 7f14f53a6640 1 -- 172.21.15.19:0/2035950375 --> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f14f00b64d0 con 0x7f14dc072370 2024-09-12T02:07:38.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.499+0000 7f14d77fe640 1 -- 172.21.15.19:0/2035950375 <== osd.3 v2:172.21.15.19:6800/2581301650 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f14f00b64d0 con 0x7f14dc072370 2024-09-12T02:07:38.500 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:07:38.500 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:07:38.500 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:07:38.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.499+0000 7f14f53a6640 1 -- 172.21.15.19:0/2035950375 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x7f14dc072370 msgr2=0x7f14dc0747b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.499+0000 7f14f53a6640 1 --2- 172.21.15.19:0/2035950375 >> [v2:172.21.15.19:6800/2581301650,v1:172.21.15.19:6801/2581301650] conn(0x7f14dc072370 0x7f14dc0747b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.500+0000 7f14f53a6640 1 -- 172.21.15.19:0/2035950375 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14dc06be30 msgr2=0x7f14dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.500+0000 7f14f53a6640 1 --2- 172.21.15.19:0/2035950375 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f14dc06be30 0x7f14dc06e2f0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f14e4000f60 tx=0x7f14e40079b0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.500+0000 7f14f53a6640 1 -- 172.21.15.19:0/2035950375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14f00cfcb0 msgr2=0x7f14f015f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.500+0000 7f14f53a6640 1 --2- 172.21.15.19:0/2035950375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14f00cfcb0 0x7f14f015f220 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f14e00098c0 tx=0x7f14e00046c0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.500+0000 7f14ef7fe640 1 -- 172.21.15.19:0/2035950375 reap_dead start 2024-09-12T02:07:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.500+0000 7f14f53a6640 1 -- 172.21.15.19:0/2035950375 shutdown_connections 2024-09-12T02:07:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.500+0000 7f14f53a6640 1 -- 172.21.15.19:0/2035950375 >> 172.21.15.19:0/2035950375 conn(0x7f14f008bfc0 msgr2=0x7f14f00b5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.500+0000 7f14f53a6640 1 -- 172.21.15.19:0/2035950375 shutdown_connections 2024-09-12T02:07:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.500+0000 7f14f53a6640 1 -- 172.21.15.19:0/2035950375 wait complete. 2024-09-12T02:07:38.511 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T02:07:38.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.614+0000 7ff3c9265640 1 Processor -- start 2024-09-12T02:07:38.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.614+0000 7ff3c9265640 1 -- start start 2024-09-12T02:07:38.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.615+0000 7ff3c9265640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff3c415e760 0x7ff3c406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.615+0000 7ff3c9265640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff3c40cfcc0 0x7ff3c40d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.615+0000 7ff3c9265640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c40d2700 con 0x7ff3c40d4fd0 2024-09-12T02:07:38.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.615+0000 7ff3c9265640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c40cedb0 con 0x7ff3c415e760 2024-09-12T02:07:38.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.615+0000 7ff3c9265640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c40cf090 con 0x7ff3c40cfcc0 2024-09-12T02:07:38.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.615+0000 7ff3c2ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff3c415e760 0x7ff3c406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.615+0000 7ff3c27fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff3c40d4fd0 0x7ff3c40cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57744/0 (socket says 172.21.15.19:57744) 2024-09-12T02:07:38.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.615+0000 7ff3c27fc640 1 -- 172.21.15.19:0/1061886412 learned_addr learned my addr 172.21.15.19:0/1061886412 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:38.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.615+0000 7ff3c37fe640 1 --2- 172.21.15.19:0/1061886412 >> v2:172.21.15.135:3300/0 conn(0x7ff3c40cfcc0 0x7ff3c40d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.616+0000 7ff3c2ffd640 1 -- 172.21.15.19:0/1061886412 >> v2:172.21.15.135:3300/0 conn(0x7ff3c40cfcc0 msgr2=0x7ff3c40d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:38.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.616+0000 7ff3c2ffd640 1 --2- 172.21.15.19:0/1061886412 >> v2:172.21.15.135:3300/0 conn(0x7ff3c40cfcc0 0x7ff3c40d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.616+0000 7ff3c2ffd640 1 -- 172.21.15.19:0/1061886412 >> v1:172.21.15.19:6789/0 conn(0x7ff3c40d4fd0 legacy=0x7ff3c40cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.616+0000 7ff3c2ffd640 1 -- 172.21.15.19:0/1061886412 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c40b3c80 con 0x7ff3c415e760 2024-09-12T02:07:38.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.616+0000 7ff3c1ffb640 1 -- 172.21.15.19:0/1061886412 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1949955610 0 0) 0x7ff3ac001290 con 0x7ff3c40d4fd0 2024-09-12T02:07:38.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.616+0000 7ff3c2ffd640 1 --2- 172.21.15.19:0/1061886412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3c415e760 0x7ff3c406cdd0 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7ff3c408d890 tx=0x7ff3b402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c930604decc40c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.616+0000 7ff3c1ffb640 1 -- 172.21.15.19:0/1061886412 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4007740 con 0x7ff3c415e760 2024-09-12T02:07:38.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.617+0000 7ff3c1ffb640 1 -- 172.21.15.19:0/1061886412 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b40078e0 con 0x7ff3c415e760 2024-09-12T02:07:38.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.617+0000 7ff3c1ffb640 1 -- 172.21.15.19:0/1061886412 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4007cb0 con 0x7ff3c415e760 2024-09-12T02:07:38.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.617+0000 7ff3c9265640 1 -- 172.21.15.19:0/1061886412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3c415e760 msgr2=0x7ff3c406cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.617+0000 7ff3c9265640 1 --2- 172.21.15.19:0/1061886412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3c415e760 0x7ff3c406cdd0 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7ff3c408d890 tx=0x7ff3b402a680 comp rx=0 tx=0).stop 2024-09-12T02:07:38.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.617+0000 7ff3c9265640 1 -- 172.21.15.19:0/1061886412 shutdown_connections 2024-09-12T02:07:38.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.617+0000 7ff3c9265640 1 --2- 172.21.15.19:0/1061886412 >> v2:172.21.15.135:3300/0 conn(0x7ff3c40cfcc0 0x7ff3c40d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.617+0000 7ff3c9265640 1 --2- 172.21.15.19:0/1061886412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3c415e760 0x7ff3c406cdd0 unknown :-1 s=CLOSED pgs=2384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.617+0000 7ff3c9265640 1 -- 172.21.15.19:0/1061886412 >> 172.21.15.19:0/1061886412 conn(0x7ff3c408bfc0 msgr2=0x7ff3c40d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:38.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.617+0000 7ff3c9265640 1 -- 172.21.15.19:0/1061886412 shutdown_connections 2024-09-12T02:07:38.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.617+0000 7ff3c9265640 1 -- 172.21.15.19:0/1061886412 wait complete. 2024-09-12T02:07:38.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.618+0000 7ff3c9265640 1 Processor -- start 2024-09-12T02:07:38.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.618+0000 7ff3c9265640 1 -- start start 2024-09-12T02:07:38.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.619+0000 7ff3c9265640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3c40cfcc0 0x7ff3c41f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.619+0000 7ff3c9265640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3c40d4fd0 0x7ff3c41511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.619+0000 7ff3c9265640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3c415e760 0x7ff3c4160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.619+0000 7ff3c9265640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c40d33e0 con 0x7ff3c40cfcc0 2024-09-12T02:07:38.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.619+0000 7ff3c9265640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c40b38e0 con 0x7ff3c40d4fd0 2024-09-12T02:07:38.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.619+0000 7ff3c9265640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c40d3560 con 0x7ff3c415e760 2024-09-12T02:07:38.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.619+0000 7ff3c2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3c40cfcc0 0x7ff3c41f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.619+0000 7ff3c2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3c40cfcc0 0x7ff3c41f5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49910/0 (socket says 172.21.15.19:49910) 2024-09-12T02:07:38.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.619+0000 7ff3c2ffd640 1 -- 172.21.15.19:0/3641619426 learned_addr learned my addr 172.21.15.19:0/3641619426 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:38.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.619+0000 7ff3c37fe640 1 --2- 172.21.15.19:0/3641619426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3c415e760 0x7ff3c4160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.619+0000 7ff3c27fc640 1 --2- 172.21.15.19:0/3641619426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3c40d4fd0 0x7ff3c41511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.620+0000 7ff3c2ffd640 1 -- 172.21.15.19:0/3641619426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3c415e760 msgr2=0x7ff3c4160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.620+0000 7ff3c2ffd640 1 --2- 172.21.15.19:0/3641619426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3c415e760 0x7ff3c4160350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.620+0000 7ff3c2ffd640 1 -- 172.21.15.19:0/3641619426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3c40d4fd0 msgr2=0x7ff3c41511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.620+0000 7ff3c2ffd640 1 --2- 172.21.15.19:0/3641619426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3c40d4fd0 0x7ff3c41511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.620+0000 7ff3c2ffd640 1 -- 172.21.15.19:0/3641619426 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c4160aa0 con 0x7ff3c40cfcc0 2024-09-12T02:07:38.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.620+0000 7ff3c27fc640 1 --2- 172.21.15.19:0/3641619426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3c40d4fd0 0x7ff3c41511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:38.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.620+0000 7ff3c2ffd640 1 --2- 172.21.15.19:0/3641619426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3c40cfcc0 0x7ff3c41f5760 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7ff3b402ac70 tx=0x7ff3b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.620+0000 7ff3bb7fe640 1 -- 172.21.15.19:0/3641619426 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b403f070 con 0x7ff3c40cfcc0 2024-09-12T02:07:38.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.620+0000 7ff3bb7fe640 1 -- 172.21.15.19:0/3641619426 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b4031c40 con 0x7ff3c40cfcc0 2024-09-12T02:07:38.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.620+0000 7ff3bb7fe640 1 -- 172.21.15.19:0/3641619426 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4044460 con 0x7ff3c40cfcc0 2024-09-12T02:07:38.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.620+0000 7ff3c9265640 1 -- 172.21.15.19:0/3641619426 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c4160d80 con 0x7ff3c40cfcc0 2024-09-12T02:07:38.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.620+0000 7ff3c9265640 1 -- 172.21.15.19:0/3641619426 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c4161340 con 0x7ff3c40cfcc0 2024-09-12T02:07:38.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.621+0000 7ff3c9265640 1 -- 172.21.15.19:0/3641619426 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c40d3890 con 0x7ff3c40cfcc0 2024-09-12T02:07:38.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.621+0000 7ff3bb7fe640 1 -- 172.21.15.19:0/3641619426 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3b403b410 con 0x7ff3c40cfcc0 2024-09-12T02:07:38.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.622+0000 7ff3bb7fe640 1 --2- 172.21.15.19:0/3641619426 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3a406be30 0x7ff3a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.622+0000 7ff3bb7fe640 1 -- 172.21.15.19:0/3641619426 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7ff3b40ac610 con 0x7ff3c40cfcc0 2024-09-12T02:07:38.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.622+0000 7ff3c27fc640 1 --2- 172.21.15.19:0/3641619426 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3a406be30 0x7ff3a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.623+0000 7ff3c27fc640 1 --2- 172.21.15.19:0/3641619426 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3a406be30 0x7ff3a406e2f0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40a2470 tx=0x7ff3ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.626+0000 7ff3bb7fe640 1 -- 172.21.15.19:0/3641619426 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3b407b0e0 con 0x7ff3c40cfcc0 2024-09-12T02:07:38.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.804+0000 7ff3c9265640 1 -- 172.21.15.19:0/3641619426 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7ff3c40b6d20 con 0x7ff3a406be30 2024-09-12T02:07:38.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.805+0000 7ff3bb7fe640 1 -- 172.21.15.19:0/3641619426 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff3c40b6d20 con 0x7ff3a406be30 2024-09-12T02:07:38.805 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T02:07:38.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.806+0000 7ff3c9265640 1 -- 172.21.15.19:0/3641619426 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3a406be30 msgr2=0x7ff3a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.806+0000 7ff3c9265640 1 --2- 172.21.15.19:0/3641619426 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3a406be30 0x7ff3a406e2f0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40a2470 tx=0x7ff3ac009040 comp rx=0 tx=0).stop 2024-09-12T02:07:38.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.806+0000 7ff3c9265640 1 -- 172.21.15.19:0/3641619426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3c40cfcc0 msgr2=0x7ff3c41f5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.806+0000 7ff3c9265640 1 --2- 172.21.15.19:0/3641619426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3c40cfcc0 0x7ff3c41f5760 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7ff3b402ac70 tx=0x7ff3b4004a40 comp rx=0 tx=0).stop 2024-09-12T02:07:38.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.807+0000 7ff3c9265640 1 -- 172.21.15.19:0/3641619426 shutdown_connections 2024-09-12T02:07:38.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.807+0000 7ff3c9265640 1 --2- 172.21.15.19:0/3641619426 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7ff3a406be30 0x7ff3a406e2f0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.807+0000 7ff3c9265640 1 --2- 172.21.15.19:0/3641619426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3c415e760 0x7ff3c4160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.807+0000 7ff3c9265640 1 --2- 172.21.15.19:0/3641619426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3c40d4fd0 0x7ff3c41511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.807+0000 7ff3c9265640 1 --2- 172.21.15.19:0/3641619426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3c40cfcc0 0x7ff3c41f5760 unknown :-1 s=CLOSED pgs=2385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.807+0000 7ff3c9265640 1 -- 172.21.15.19:0/3641619426 >> 172.21.15.19:0/3641619426 conn(0x7ff3c408bfc0 msgr2=0x7ff3c415d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:38.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.807+0000 7ff3c9265640 1 -- 172.21.15.19:0/3641619426 shutdown_connections 2024-09-12T02:07:38.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.807+0000 7ff3c9265640 1 -- 172.21.15.19:0/3641619426 wait complete. 2024-09-12T02:07:38.818 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T02:07:38.818 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:07:38.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.924+0000 7f4290053640 1 Processor -- start 2024-09-12T02:07:38.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.925+0000 7f4290053640 1 -- start start 2024-09-12T02:07:38.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.925+0000 7f4290053640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42880b1920 0x7f428809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.925+0000 7f4290053640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f428809af70 0x7f42880cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.925+0000 7f4290053640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42880ce720 con 0x7f4288071160 2024-09-12T02:07:38.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.925+0000 7f4290053640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f42880cea00 con 0x7f428809af70 2024-09-12T02:07:38.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.925+0000 7f4290053640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f42880ccfe0 con 0x7f42880b1920 2024-09-12T02:07:38.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.926+0000 7f428d5ee640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f428809af70 0x7f42880cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.926+0000 7f428e5f0640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4288071160 0x7f42880700c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57754/0 (socket says 172.21.15.19:57754) 2024-09-12T02:07:38.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.926+0000 7f428e5f0640 1 -- 172.21.15.19:0/2824105466 learned_addr learned my addr 172.21.15.19:0/2824105466 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:38.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.926+0000 7f428d5ee640 1 -- 172.21.15.19:0/2824105466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42880b1920 msgr2=0x7f428809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:38.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.926+0000 7f428ddef640 1 --2- 172.21.15.19:0/2824105466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42880b1920 0x7f428809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.926+0000 7f428d5ee640 1 --2- 172.21.15.19:0/2824105466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42880b1920 0x7f428809aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.926+0000 7f428cded640 1 -- 172.21.15.19:0/2824105466 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 945559596 0 0) 0x7f42880ce720 con 0x7f4288071160 2024-09-12T02:07:38.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.926+0000 7f428d5ee640 1 -- 172.21.15.19:0/2824105466 >> v1:172.21.15.19:6789/0 conn(0x7f4288071160 legacy=0x7f42880700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.926+0000 7f428d5ee640 1 -- 172.21.15.19:0/2824105466 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42880cd2c0 con 0x7f428809af70 2024-09-12T02:07:38.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.927+0000 7f428d5ee640 1 --2- 172.21.15.19:0/2824105466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f428809af70 0x7f42880cd7e0 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7f427c0097a0 tx=0x7f427c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d556055baf9f0bea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.927+0000 7f428cded640 1 -- 172.21.15.19:0/2824105466 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c037070 con 0x7f428809af70 2024-09-12T02:07:38.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.927+0000 7f428cded640 1 -- 172.21.15.19:0/2824105466 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f427c02ae50 con 0x7f428809af70 2024-09-12T02:07:38.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.927+0000 7f428cded640 1 -- 172.21.15.19:0/2824105466 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c032660 con 0x7f428809af70 2024-09-12T02:07:38.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.927+0000 7f4290053640 1 -- 172.21.15.19:0/2824105466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f428809af70 msgr2=0x7f42880cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.927+0000 7f4290053640 1 --2- 172.21.15.19:0/2824105466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f428809af70 0x7f42880cd7e0 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7f427c0097a0 tx=0x7f427c02a100 comp rx=0 tx=0).stop 2024-09-12T02:07:38.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.927+0000 7f4290053640 1 -- 172.21.15.19:0/2824105466 shutdown_connections 2024-09-12T02:07:38.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.927+0000 7f4290053640 1 --2- 172.21.15.19:0/2824105466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f428809af70 0x7f42880cd7e0 unknown :-1 s=CLOSED pgs=2387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.927+0000 7f4290053640 1 --2- 172.21.15.19:0/2824105466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42880b1920 0x7f428809aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.927+0000 7f4290053640 1 -- 172.21.15.19:0/2824105466 >> 172.21.15.19:0/2824105466 conn(0x7f42880b3de0 msgr2=0x7f42880b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:38.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.927+0000 7f4290053640 1 -- 172.21.15.19:0/2824105466 shutdown_connections 2024-09-12T02:07:38.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.927+0000 7f4290053640 1 -- 172.21.15.19:0/2824105466 wait complete. 2024-09-12T02:07:38.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.929+0000 7f4290053640 1 Processor -- start 2024-09-12T02:07:38.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.929+0000 7f4290053640 1 -- start start 2024-09-12T02:07:38.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.929+0000 7f4290053640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4288071160 0x7f428815b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.929+0000 7f4290053640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f428809af70 0x7f42880cab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.929+0000 7f4290053640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42880b1920 0x7f428815e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.929+0000 7f4290053640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f42880d01f0 con 0x7f428809af70 2024-09-12T02:07:38.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.929+0000 7f4290053640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f42880d0070 con 0x7f4288071160 2024-09-12T02:07:38.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.929+0000 7f4290053640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f42880cdd20 con 0x7f42880b1920 2024-09-12T02:07:38.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.929+0000 7f428d5ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f428809af70 0x7f42880cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.929+0000 7f428d5ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f428809af70 0x7f42880cab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49936/0 (socket says 172.21.15.19:49936) 2024-09-12T02:07:38.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.929+0000 7f428d5ee640 1 -- 172.21.15.19:0/2230105541 learned_addr learned my addr 172.21.15.19:0/2230105541 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:38.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.930+0000 7f428ddef640 1 --2- 172.21.15.19:0/2230105541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4288071160 0x7f428815b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.930+0000 7f428e5f0640 1 --2- 172.21.15.19:0/2230105541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42880b1920 0x7f428815e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.930+0000 7f428d5ee640 1 -- 172.21.15.19:0/2230105541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42880b1920 msgr2=0x7f428815e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.930+0000 7f428d5ee640 1 --2- 172.21.15.19:0/2230105541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42880b1920 0x7f428815e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.930+0000 7f428d5ee640 1 -- 172.21.15.19:0/2230105541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4288071160 msgr2=0x7f428815b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.930+0000 7f428d5ee640 1 --2- 172.21.15.19:0/2230105541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4288071160 0x7f428815b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.930+0000 7f428d5ee640 1 -- 172.21.15.19:0/2230105541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42880cb8d0 con 0x7f428809af70 2024-09-12T02:07:38.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.930+0000 7f428ddef640 1 --2- 172.21.15.19:0/2230105541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4288071160 0x7f428815b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:38.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.930+0000 7f428e5f0640 1 --2- 172.21.15.19:0/2230105541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42880b1920 0x7f428815e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:38.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.930+0000 7f428d5ee640 1 --2- 172.21.15.19:0/2230105541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f428809af70 0x7f42880cab30 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7f427c035040 tx=0x7f427c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.930+0000 7f42867fc640 1 -- 172.21.15.19:0/2230105541 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c041070 con 0x7f428809af70 2024-09-12T02:07:38.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.930+0000 7f42867fc640 1 -- 172.21.15.19:0/2230105541 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f427c03c670 con 0x7f428809af70 2024-09-12T02:07:38.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.930+0000 7f42867fc640 1 -- 172.21.15.19:0/2230105541 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c037040 con 0x7f428809af70 2024-09-12T02:07:38.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.930+0000 7f4290053640 1 -- 172.21.15.19:0/2230105541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42880cb5f0 con 0x7f428809af70 2024-09-12T02:07:38.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.930+0000 7f4290053640 1 -- 172.21.15.19:0/2230105541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42881f5d80 con 0x7f428809af70 2024-09-12T02:07:38.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.931+0000 7f4290053640 1 -- 172.21.15.19:0/2230105541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f42880ce720 con 0x7f428809af70 2024-09-12T02:07:38.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.932+0000 7f42867fc640 1 -- 172.21.15.19:0/2230105541 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f427c03a070 con 0x7f428809af70 2024-09-12T02:07:38.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.932+0000 7f42867fc640 1 --2- 172.21.15.19:0/2230105541 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f427406be60 0x7f427406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.932+0000 7f42867fc640 1 -- 172.21.15.19:0/2230105541 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7f427c0ab110 con 0x7f428809af70 2024-09-12T02:07:38.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.932+0000 7f42867fc640 1 --2- 172.21.15.19:0/2230105541 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7f42740723a0 0x7f42740747e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.932+0000 7f42867fc640 1 -- 172.21.15.19:0/2230105541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4274074eb0 con 0x7f42740723a0 2024-09-12T02:07:38.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.932+0000 7f42867fc640 1 -- 172.21.15.19:0/2230105541 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=149) ==== 24+0+0 (secure 0 0 0) 0x7f427c0b2050 con 0x7f428809af70 2024-09-12T02:07:38.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.933+0000 7f428ddef640 1 --2- 172.21.15.19:0/2230105541 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f427406be60 0x7f427406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.933+0000 7f428e5f0640 1 --2- 172.21.15.19:0/2230105541 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7f42740723a0 0x7f42740747e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.933+0000 7f428ddef640 1 --2- 172.21.15.19:0/2230105541 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f427406be60 0x7f427406e320 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f4288160380 tx=0x7f42780075b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.933+0000 7f428e5f0640 1 --2- 172.21.15.19:0/2230105541 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7f42740723a0 0x7f42740747e0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.934+0000 7f42867fc640 1 -- 172.21.15.19:0/2230105541 <== osd.4 v2:172.21.15.135:6800/1904467046 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4274074eb0 con 0x7f42740723a0 2024-09-12T02:07:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.947+0000 7f4290053640 1 -- 172.21.15.19:0/2230105541 --> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f42880b4cf0 con 0x7f42740723a0 2024-09-12T02:07:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.947+0000 7f42867fc640 1 -- 172.21.15.19:0/2230105541 <== osd.4 v2:172.21.15.135:6800/1904467046 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f42880b4cf0 con 0x7f42740723a0 2024-09-12T02:07:38.948 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:07:38.948 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:07:38.948 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:07:38.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.948+0000 7f4290053640 1 -- 172.21.15.19:0/2230105541 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7f42740723a0 msgr2=0x7f42740747e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.948+0000 7f4290053640 1 --2- 172.21.15.19:0/2230105541 >> [v2:172.21.15.135:6800/1904467046,v1:172.21.15.135:6801/1904467046] conn(0x7f42740723a0 0x7f42740747e0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.948+0000 7f4290053640 1 -- 172.21.15.19:0/2230105541 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f427406be60 msgr2=0x7f427406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.948+0000 7f4290053640 1 --2- 172.21.15.19:0/2230105541 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f427406be60 0x7f427406e320 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f4288160380 tx=0x7f42780075b0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.948+0000 7f4290053640 1 -- 172.21.15.19:0/2230105541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f428809af70 msgr2=0x7f42880cab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.948+0000 7f4290053640 1 --2- 172.21.15.19:0/2230105541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f428809af70 0x7f42880cab30 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7f427c035040 tx=0x7f427c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.948+0000 7f428e5f0640 1 -- 172.21.15.19:0/2230105541 reap_dead start 2024-09-12T02:07:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.948+0000 7f4290053640 1 -- 172.21.15.19:0/2230105541 shutdown_connections 2024-09-12T02:07:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.948+0000 7f4290053640 1 -- 172.21.15.19:0/2230105541 >> 172.21.15.19:0/2230105541 conn(0x7f42880b3de0 msgr2=0x7f42880c89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.948+0000 7f4290053640 1 -- 172.21.15.19:0/2230105541 shutdown_connections 2024-09-12T02:07:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:38.948+0000 7f4290053640 1 -- 172.21.15.19:0/2230105541 wait complete. 2024-09-12T02:07:38.959 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T02:07:39.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.062+0000 7f3976b6d640 1 Processor -- start 2024-09-12T02:07:39.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.062+0000 7f3976b6d640 1 -- start start 2024-09-12T02:07:39.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f3976b6d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39700b6690 0x7f39701691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f3976b6d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39700d3690 con 0x7f397015e5f0 2024-09-12T02:07:39.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f3976b6d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39700d3970 con 0x7f39700d30f0 2024-09-12T02:07:39.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f3976b6d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f397006d530 con 0x7f39700b6690 2024-09-12T02:07:39.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f3974909640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f397015e5f0 0x7f39700d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57762/0 (socket says 172.21.15.19:57762) 2024-09-12T02:07:39.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f3974909640 1 -- 172.21.15.19:0/2198253989 learned_addr learned my addr 172.21.15.19:0/2198253989 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:39.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f397510a640 1 --2- 172.21.15.19:0/2198253989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39700b6690 0x7f39701691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f396f7fe640 1 -- 172.21.15.19:0/2198253989 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3518447754 0 0) 0x7f39700d3690 con 0x7f397015e5f0 2024-09-12T02:07:39.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f396f7fe640 1 -- 172.21.15.19:0/2198253989 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3960003520 con 0x7f397015e5f0 2024-09-12T02:07:39.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f396f7fe640 1 -- 172.21.15.19:0/2198253989 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 891976996 0 0) 0x7f3960003520 con 0x7f397015e5f0 2024-09-12T02:07:39.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f396f7fe640 1 -- 172.21.15.19:0/2198253989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39700b6690 msgr2=0x7f39701691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:39.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f396f7fe640 1 --2- 172.21.15.19:0/2198253989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39700b6690 0x7f39701691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f396f7fe640 1 -- 172.21.15.19:0/2198253989 >> v1:172.21.15.135:6789/0 conn(0x7f39700d30f0 legacy=0x7f39700b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f396f7fe640 1 -- 172.21.15.19:0/2198253989 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397006cee0 con 0x7f397015e5f0 2024-09-12T02:07:39.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f396f7fe640 1 -- 172.21.15.19:0/2198253989 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f3964001690 con 0x7f397015e5f0 2024-09-12T02:07:39.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f396f7fe640 1 -- 172.21.15.19:0/2198253989 >> v1:172.21.15.19:6789/0 conn(0x7f397015e5f0 legacy=0x7f39700d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f396f7fe640 1 --2- 172.21.15.19:0/2198253989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39600039e0 0x7f3960003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f396f7fe640 1 --2- 172.21.15.19:0/2198253989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3960004390 0x7f3960004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f396f7fe640 1 --2- 172.21.15.19:0/2198253989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3960005060 0x7f396000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.063+0000 7f396f7fe640 1 -- 172.21.15.19:0/2198253989 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f397006d530 con 0x7f39600039e0 2024-09-12T02:07:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.064+0000 7f396f7fe640 1 -- 172.21.15.19:0/2198253989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f396000bf30 con 0x7f3960004390 2024-09-12T02:07:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.064+0000 7f396f7fe640 1 -- 172.21.15.19:0/2198253989 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f396000c130 con 0x7f3960005060 2024-09-12T02:07:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.064+0000 7f397510a640 1 --2- 172.21.15.19:0/2198253989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39700b6690 0x7f39701691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.064+0000 7f3974909640 1 --2- 172.21.15.19:0/2198253989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39600039e0 0x7f3960003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.064+0000 7f396ffff640 1 --2- 172.21.15.19:0/2198253989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3960004390 0x7f3960004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.064+0000 7f397510a640 1 --2- 172.21.15.19:0/2198253989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3960005060 0x7f396000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.064+0000 7f3974909640 1 -- 172.21.15.19:0/2198253989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3960005060 msgr2=0x7f396000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.064+0000 7f3974909640 1 --2- 172.21.15.19:0/2198253989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3960005060 0x7f396000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.064+0000 7f3974909640 1 -- 172.21.15.19:0/2198253989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3960004390 msgr2=0x7f3960004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.064+0000 7f3974909640 1 --2- 172.21.15.19:0/2198253989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3960004390 0x7f3960004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.064+0000 7f3974909640 1 -- 172.21.15.19:0/2198253989 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3960003520 con 0x7f39600039e0 2024-09-12T02:07:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.064+0000 7f396ffff640 1 --2- 172.21.15.19:0/2198253989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3960004390 0x7f3960004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.065+0000 7f3974909640 1 --2- 172.21.15.19:0/2198253989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39600039e0 0x7f3960003dc0 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7f396400c210 tx=0x7f3960005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8dadcd76e4c3d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.065+0000 7f396f7fe640 1 -- 172.21.15.19:0/2198253989 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3964007d60 con 0x7f39600039e0 2024-09-12T02:07:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.065+0000 7f396f7fe640 1 -- 172.21.15.19:0/2198253989 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3964005af0 con 0x7f39600039e0 2024-09-12T02:07:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.065+0000 7f396f7fe640 1 -- 172.21.15.19:0/2198253989 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3964007070 con 0x7f39600039e0 2024-09-12T02:07:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.065+0000 7f3976b6d640 1 -- 172.21.15.19:0/2198253989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39600039e0 msgr2=0x7f3960003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.065+0000 7f3976b6d640 1 --2- 172.21.15.19:0/2198253989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39600039e0 0x7f3960003dc0 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7f396400c210 tx=0x7f3960005830 comp rx=0 tx=0).stop 2024-09-12T02:07:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.065+0000 7f397510a640 1 -- 172.21.15.19:0/2198253989 reap_dead start 2024-09-12T02:07:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.065+0000 7f3976b6d640 1 -- 172.21.15.19:0/2198253989 shutdown_connections 2024-09-12T02:07:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.065+0000 7f3976b6d640 1 -- 172.21.15.19:0/2198253989 >> 172.21.15.19:0/2198253989 conn(0x7f397008bfc0 msgr2=0x7f39700d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.065+0000 7f3976b6d640 1 -- 172.21.15.19:0/2198253989 shutdown_connections 2024-09-12T02:07:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.065+0000 7f3976b6d640 1 -- 172.21.15.19:0/2198253989 wait complete. 2024-09-12T02:07:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.066+0000 7f3976b6d640 1 Processor -- start 2024-09-12T02:07:39.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.067+0000 7f3976b6d640 1 -- start start 2024-09-12T02:07:39.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.067+0000 7f3976b6d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39600039e0 0x7f39700a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.067+0000 7f3976b6d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f397015d5e0 0x7f39700c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.067+0000 7f3976b6d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3970160d20 0x7f39701611a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.067+0000 7f3976b6d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f397006e9d0 con 0x7f39600039e0 2024-09-12T02:07:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.067+0000 7f3976b6d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f397015e9d0 con 0x7f397015d5e0 2024-09-12T02:07:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.067+0000 7f3976b6d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f397006eb50 con 0x7f3970160d20 2024-09-12T02:07:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.067+0000 7f3974909640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39600039e0 0x7f39700a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.067+0000 7f3974909640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39600039e0 0x7f39700a0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49942/0 (socket says 172.21.15.19:49942) 2024-09-12T02:07:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.067+0000 7f3974909640 1 -- 172.21.15.19:0/2771933658 learned_addr learned my addr 172.21.15.19:0/2771933658 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.068+0000 7f397510a640 1 --2- 172.21.15.19:0/2771933658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3970160d20 0x7f39701611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.068+0000 7f396ffff640 1 --2- 172.21.15.19:0/2771933658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f397015d5e0 0x7f39700c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.068+0000 7f3974909640 1 -- 172.21.15.19:0/2771933658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3970160d20 msgr2=0x7f39701611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.068+0000 7f3974909640 1 --2- 172.21.15.19:0/2771933658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3970160d20 0x7f39701611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.068+0000 7f3974909640 1 -- 172.21.15.19:0/2771933658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f397015d5e0 msgr2=0x7f39700c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.068+0000 7f3974909640 1 --2- 172.21.15.19:0/2771933658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f397015d5e0 0x7f39700c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.068+0000 7f3974909640 1 -- 172.21.15.19:0/2771933658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39700a1290 con 0x7f39600039e0 2024-09-12T02:07:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.068+0000 7f3974909640 1 --2- 172.21.15.19:0/2771933658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39600039e0 0x7f39700a0c20 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7f396400c300 tx=0x7f3964001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.068+0000 7f396d7fa640 1 -- 172.21.15.19:0/2771933658 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3964042020 con 0x7f39600039e0 2024-09-12T02:07:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.068+0000 7f396d7fa640 1 -- 172.21.15.19:0/2771933658 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3964000ed0 con 0x7f39600039e0 2024-09-12T02:07:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.068+0000 7f3976b6d640 1 -- 172.21.15.19:0/2771933658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39700a1570 con 0x7f39600039e0 2024-09-12T02:07:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.068+0000 7f396d7fa640 1 -- 172.21.15.19:0/2771933658 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3964007d60 con 0x7f39600039e0 2024-09-12T02:07:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.068+0000 7f3976b6d640 1 -- 172.21.15.19:0/2771933658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39700a1b30 con 0x7f39600039e0 2024-09-12T02:07:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.069+0000 7f3976b6d640 1 -- 172.21.15.19:0/2771933658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39700b5f80 con 0x7f39600039e0 2024-09-12T02:07:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.070+0000 7f396d7fa640 1 -- 172.21.15.19:0/2771933658 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3964045020 con 0x7f39600039e0 2024-09-12T02:07:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.070+0000 7f396d7fa640 1 --2- 172.21.15.19:0/2771933658 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f395406be30 0x7f395406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.070+0000 7f396d7fa640 1 -- 172.21.15.19:0/2771933658 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7f39640ab320 con 0x7f39600039e0 2024-09-12T02:07:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.070+0000 7f396ffff640 1 --2- 172.21.15.19:0/2771933658 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f395406be30 0x7f395406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.071+0000 7f396ffff640 1 --2- 172.21.15.19:0/2771933658 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f395406be30 0x7f395406e2f0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f39700d01c0 tx=0x7f395c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.075+0000 7f396d7fa640 1 -- 172.21.15.19:0/2771933658 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3964079e80 con 0x7f39600039e0 2024-09-12T02:07:39.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.250+0000 7f3976b6d640 1 -- 172.21.15.19:0/2771933658 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f39700b52b0 con 0x7f395406be30 2024-09-12T02:07:39.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.251+0000 7f396d7fa640 1 -- 172.21.15.19:0/2771933658 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f39700b52b0 con 0x7f395406be30 2024-09-12T02:07:39.251 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T02:07:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.253+0000 7f3976b6d640 1 -- 172.21.15.19:0/2771933658 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f395406be30 msgr2=0x7f395406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.253+0000 7f3976b6d640 1 --2- 172.21.15.19:0/2771933658 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f395406be30 0x7f395406e2f0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f39700d01c0 tx=0x7f395c009040 comp rx=0 tx=0).stop 2024-09-12T02:07:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.253+0000 7f3976b6d640 1 -- 172.21.15.19:0/2771933658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39600039e0 msgr2=0x7f39700a0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.253+0000 7f3976b6d640 1 --2- 172.21.15.19:0/2771933658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39600039e0 0x7f39700a0c20 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7f396400c300 tx=0x7f3964001a60 comp rx=0 tx=0).stop 2024-09-12T02:07:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.253+0000 7f3976b6d640 1 -- 172.21.15.19:0/2771933658 shutdown_connections 2024-09-12T02:07:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.253+0000 7f3976b6d640 1 --2- 172.21.15.19:0/2771933658 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f395406be30 0x7f395406e2f0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.253+0000 7f3976b6d640 1 --2- 172.21.15.19:0/2771933658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3970160d20 0x7f39701611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.253+0000 7f3976b6d640 1 --2- 172.21.15.19:0/2771933658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f397015d5e0 0x7f39700c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.253+0000 7f3976b6d640 1 --2- 172.21.15.19:0/2771933658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39600039e0 0x7f39700a0c20 unknown :-1 s=CLOSED pgs=2391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.253+0000 7f3976b6d640 1 -- 172.21.15.19:0/2771933658 >> 172.21.15.19:0/2771933658 conn(0x7f397008bfc0 msgr2=0x7f39700b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:39.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.253+0000 7f3976b6d640 1 -- 172.21.15.19:0/2771933658 shutdown_connections 2024-09-12T02:07:39.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.253+0000 7f3976b6d640 1 -- 172.21.15.19:0/2771933658 wait complete. 2024-09-12T02:07:39.266 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T02:07:39.268 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:07:39.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.374+0000 7f1cd43d6640 1 Processor -- start 2024-09-12T02:07:39.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.374+0000 7f1cd43d6640 1 -- start start 2024-09-12T02:07:39.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.375+0000 7f1cd43d6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1ccc0b5f80 0x7f1ccc162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.375+0000 7f1cd43d6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ccc0d4c10 0x7f1ccc0b6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.375+0000 7f1cd43d6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1ccc0d3320 0x7f1ccc0d37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.375+0000 7f1cd43d6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f1ccc0d5420 con 0x7f1ccc0d3320 2024-09-12T02:07:39.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.375+0000 7f1cd43d6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f1ccc0d2e90 con 0x7f1ccc0b5f80 2024-09-12T02:07:39.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.375+0000 7f1cd43d6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1ccc0d2600 con 0x7f1ccc0d4c10 2024-09-12T02:07:39.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.375+0000 7f1cd2973640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1ccc0d3320 0x7f1ccc0d37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.375+0000 7f1cd2973640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1ccc0d3320 0x7f1ccc0d37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49948/0 (socket says 172.21.15.19:49948) 2024-09-12T02:07:39.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.375+0000 7f1cd2973640 1 -- 172.21.15.19:0/1399136233 learned_addr learned my addr 172.21.15.19:0/1399136233 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:39.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.375+0000 7f1cd2172640 1 --2- 172.21.15.19:0/1399136233 >> v2:172.21.15.135:3300/0 conn(0x7f1ccc0b5f80 0x7f1ccc162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.375+0000 7f1cd1971640 1 --2- 172.21.15.19:0/1399136233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ccc0d4c10 0x7f1ccc0b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.375+0000 7f1cd2973640 1 -- 172.21.15.19:0/1399136233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ccc0d4c10 msgr2=0x7f1ccc0b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:39.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.375+0000 7f1cd2973640 1 --2- 172.21.15.19:0/1399136233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ccc0d4c10 0x7f1ccc0b6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.375+0000 7f1cd2973640 1 -- 172.21.15.19:0/1399136233 >> v2:172.21.15.135:3300/0 conn(0x7f1ccc0b5f80 msgr2=0x7f1ccc162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:39.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.375+0000 7f1cd2973640 1 --2- 172.21.15.19:0/1399136233 >> v2:172.21.15.135:3300/0 conn(0x7f1ccc0b5f80 0x7f1ccc162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.375+0000 7f1cd2973640 1 -- 172.21.15.19:0/1399136233 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ccc0b3c10 con 0x7f1ccc0d3320 2024-09-12T02:07:39.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.375+0000 7f1cd2172640 1 --2- 172.21.15.19:0/1399136233 >> v2:172.21.15.135:3300/0 conn(0x7f1ccc0b5f80 0x7f1ccc162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:39.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.375+0000 7f1cd1971640 1 --2- 172.21.15.19:0/1399136233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ccc0d4c10 0x7f1ccc0b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:39.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.376+0000 7f1cd2973640 1 --2- 172.21.15.19:0/1399136233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ccc0d3320 0x7f1ccc0d37b0 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc08c8f0 tx=0x7f1cc402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e763b252e71582e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:39.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.376+0000 7f1cd1170640 1 -- 172.21.15.19:0/1399136233 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4036070 con 0x7f1ccc0d3320 2024-09-12T02:07:39.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.376+0000 7f1cd1170640 1 -- 172.21.15.19:0/1399136233 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc4031600 con 0x7f1ccc0d3320 2024-09-12T02:07:39.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.376+0000 7f1cd1170640 1 -- 172.21.15.19:0/1399136233 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc40319d0 con 0x7f1ccc0d3320 2024-09-12T02:07:39.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.377+0000 7f1cd43d6640 1 -- 172.21.15.19:0/1399136233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ccc0d3320 msgr2=0x7f1ccc0d37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.377+0000 7f1cd43d6640 1 --2- 172.21.15.19:0/1399136233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ccc0d3320 0x7f1ccc0d37b0 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc08c8f0 tx=0x7f1cc402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.377+0000 7f1cd43d6640 1 -- 172.21.15.19:0/1399136233 shutdown_connections 2024-09-12T02:07:39.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.377+0000 7f1cd43d6640 1 --2- 172.21.15.19:0/1399136233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ccc0d3320 0x7f1ccc0d37b0 unknown :-1 s=CLOSED pgs=2392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.377+0000 7f1cd43d6640 1 --2- 172.21.15.19:0/1399136233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ccc0d4c10 0x7f1ccc0b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.377+0000 7f1cd43d6640 1 --2- 172.21.15.19:0/1399136233 >> v2:172.21.15.135:3300/0 conn(0x7f1ccc0b5f80 0x7f1ccc162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.377+0000 7f1cd43d6640 1 -- 172.21.15.19:0/1399136233 >> 172.21.15.19:0/1399136233 conn(0x7f1ccc08bfc0 msgr2=0x7f1ccc0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:39.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.377+0000 7f1cd43d6640 1 -- 172.21.15.19:0/1399136233 shutdown_connections 2024-09-12T02:07:39.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.377+0000 7f1cd43d6640 1 -- 172.21.15.19:0/1399136233 wait complete. 2024-09-12T02:07:39.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.378+0000 7f1cd43d6640 1 Processor -- start 2024-09-12T02:07:39.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.378+0000 7f1cd43d6640 1 -- start start 2024-09-12T02:07:39.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd43d6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ccc0b5f80 0x7f1ccc0b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd43d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ccc0d3320 0x7f1ccc0b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd43d6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ccc0d4c10 0x7f1ccc1562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd43d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1ccc0d5140 con 0x7f1ccc0d3320 2024-09-12T02:07:39.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd43d6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1ccc0d2880 con 0x7f1ccc0d4c10 2024-09-12T02:07:39.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd43d6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1ccc0d2b20 con 0x7f1ccc0b5f80 2024-09-12T02:07:39.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd1971640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ccc0d3320 0x7f1ccc0b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd1971640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ccc0d3320 0x7f1ccc0b73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49950/0 (socket says 172.21.15.19:49950) 2024-09-12T02:07:39.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd1971640 1 -- 172.21.15.19:0/1185916871 learned_addr learned my addr 172.21.15.19:0/1185916871 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:39.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd1971640 1 -- 172.21.15.19:0/1185916871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ccc0b5f80 msgr2=0x7f1ccc0b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd2973640 1 --2- 172.21.15.19:0/1185916871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ccc0d4c10 0x7f1ccc1562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd2172640 1 --2- 172.21.15.19:0/1185916871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ccc0b5f80 0x7f1ccc0b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd1971640 1 --2- 172.21.15.19:0/1185916871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ccc0b5f80 0x7f1ccc0b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd1971640 1 -- 172.21.15.19:0/1185916871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ccc0d4c10 msgr2=0x7f1ccc1562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd1971640 1 --2- 172.21.15.19:0/1185916871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ccc0d4c10 0x7f1ccc1562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd1971640 1 -- 172.21.15.19:0/1185916871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ccc1567f0 con 0x7f1ccc0d3320 2024-09-12T02:07:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd2973640 1 --2- 172.21.15.19:0/1185916871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ccc0d4c10 0x7f1ccc1562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd2172640 1 --2- 172.21.15.19:0/1185916871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ccc0b5f80 0x7f1ccc0b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd1971640 1 --2- 172.21.15.19:0/1185916871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ccc0d3320 0x7f1ccc0b73a0 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00c7f0 tx=0x7f1cbc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cc2ffd640 1 -- 172.21.15.19:0/1185916871 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc015070 con 0x7f1ccc0d3320 2024-09-12T02:07:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cc2ffd640 1 -- 172.21.15.19:0/1185916871 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cbc0077c0 con 0x7f1ccc0d3320 2024-09-12T02:07:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.379+0000 7f1cd43d6640 1 -- 172.21.15.19:0/1185916871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ccc0b22c0 con 0x7f1ccc0d3320 2024-09-12T02:07:39.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.380+0000 7f1cc2ffd640 1 -- 172.21.15.19:0/1185916871 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc007b70 con 0x7f1ccc0d3320 2024-09-12T02:07:39.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.380+0000 7f1cd43d6640 1 -- 172.21.15.19:0/1185916871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ccc0b7d70 con 0x7f1ccc0d3320 2024-09-12T02:07:39.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.380+0000 7f1cd43d6640 1 -- 172.21.15.19:0/1185916871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ccc0b27e0 con 0x7f1ccc0d3320 2024-09-12T02:07:39.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.381+0000 7f1cc2ffd640 1 -- 172.21.15.19:0/1185916871 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1cbc018070 con 0x7f1ccc0d3320 2024-09-12T02:07:39.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.381+0000 7f1cc2ffd640 1 --2- 172.21.15.19:0/1185916871 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cb006be30 0x7f1cb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.382+0000 7f1cc2ffd640 1 -- 172.21.15.19:0/1185916871 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7f1cbc08ab50 con 0x7f1ccc0d3320 2024-09-12T02:07:39.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.382+0000 7f1cc2ffd640 1 --2- 172.21.15.19:0/1185916871 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7f1cb0072370 0x7f1cb00747b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.382+0000 7f1cc2ffd640 1 -- 172.21.15.19:0/1185916871 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1cbc01be50 con 0x7f1cb0072370 2024-09-12T02:07:39.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.382+0000 7f1cc2ffd640 1 -- 172.21.15.19:0/1185916871 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=149) ==== 24+0+0 (secure 0 0 0) 0x7f1cbc08d460 con 0x7f1ccc0d3320 2024-09-12T02:07:39.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.382+0000 7f1cd2172640 1 --2- 172.21.15.19:0/1185916871 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cb006be30 0x7f1cb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.382+0000 7f1cd2973640 1 --2- 172.21.15.19:0/1185916871 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7f1cb0072370 0x7f1cb00747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.382+0000 7f1cd2172640 1 --2- 172.21.15.19:0/1185916871 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cb006be30 0x7f1cb006e2f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80088b0 tx=0x7f1cc8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:39.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.382+0000 7f1cd2973640 1 --2- 172.21.15.19:0/1185916871 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7f1cb0072370 0x7f1cb00747b0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:39.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.383+0000 7f1cc2ffd640 1 -- 172.21.15.19:0/1185916871 <== osd.5 v2:172.21.15.135:6808/3846812594 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1cbc01be50 con 0x7f1cb0072370 2024-09-12T02:07:39.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.395+0000 7f1cd43d6640 1 -- 172.21.15.19:0/1185916871 --> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1ccc0d37b0 con 0x7f1cb0072370 2024-09-12T02:07:39.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.396+0000 7f1cc2ffd640 1 -- 172.21.15.19:0/1185916871 <== osd.5 v2:172.21.15.135:6808/3846812594 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1ccc0d37b0 con 0x7f1cb0072370 2024-09-12T02:07:39.397 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:07:39.397 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:07:39.397 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:07:39.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.396+0000 7f1cd43d6640 1 -- 172.21.15.19:0/1185916871 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7f1cb0072370 msgr2=0x7f1cb00747b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.396+0000 7f1cd43d6640 1 --2- 172.21.15.19:0/1185916871 >> [v2:172.21.15.135:6808/3846812594,v1:172.21.15.135:6809/3846812594] conn(0x7f1cb0072370 0x7f1cb00747b0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.396+0000 7f1cd43d6640 1 -- 172.21.15.19:0/1185916871 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cb006be30 msgr2=0x7f1cb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.396+0000 7f1cd43d6640 1 --2- 172.21.15.19:0/1185916871 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cb006be30 0x7f1cb006e2f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80088b0 tx=0x7f1cc8008040 comp rx=0 tx=0).stop 2024-09-12T02:07:39.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.396+0000 7f1cd43d6640 1 -- 172.21.15.19:0/1185916871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ccc0d3320 msgr2=0x7f1ccc0b73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.396+0000 7f1cd43d6640 1 --2- 172.21.15.19:0/1185916871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ccc0d3320 0x7f1ccc0b73a0 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00c7f0 tx=0x7f1cbc00ccb0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.396+0000 7f1cd2973640 1 -- 172.21.15.19:0/1185916871 reap_dead start 2024-09-12T02:07:39.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.396+0000 7f1cd43d6640 1 -- 172.21.15.19:0/1185916871 shutdown_connections 2024-09-12T02:07:39.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.396+0000 7f1cd43d6640 1 -- 172.21.15.19:0/1185916871 >> 172.21.15.19:0/1185916871 conn(0x7f1ccc08bfc0 msgr2=0x7f1ccc0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:39.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.396+0000 7f1cd43d6640 1 -- 172.21.15.19:0/1185916871 shutdown_connections 2024-09-12T02:07:39.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.396+0000 7f1cd43d6640 1 -- 172.21.15.19:0/1185916871 wait complete. 2024-09-12T02:07:39.408 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T02:07:39.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.510+0000 7f81f2133640 1 Processor -- start 2024-09-12T02:07:39.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.510+0000 7f81f2133640 1 -- start start 2024-09-12T02:07:39.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.511+0000 7f81f2133640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f81ec072320 0x7f81ec0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.511+0000 7f81f2133640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81ec146140 con 0x7f81ec15e1f0 2024-09-12T02:07:39.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.511+0000 7f81f2133640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81ec06eed0 con 0x7f81ec072de0 2024-09-12T02:07:39.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.511+0000 7f81f2133640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f81ec0cd740 con 0x7f81ec072320 2024-09-12T02:07:39.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.511+0000 7f81ebfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f81ec15e1f0 0x7f81ec06e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57764/0 (socket says 172.21.15.19:57764) 2024-09-12T02:07:39.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.511+0000 7f81ebfff640 1 -- 172.21.15.19:0/656570005 learned_addr learned my addr 172.21.15.19:0/656570005 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:39.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.511+0000 7f81eb7fe640 1 --2- 172.21.15.19:0/656570005 >> v2:172.21.15.135:3300/0 conn(0x7f81ec072320 0x7f81ec0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.511+0000 7f81ea7fc640 1 -- 172.21.15.19:0/656570005 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551151277 0 0) 0x7f81ec146140 con 0x7f81ec15e1f0 2024-09-12T02:07:39.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.511+0000 7f81ea7fc640 1 -- 172.21.15.19:0/656570005 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81d4003520 con 0x7f81ec15e1f0 2024-09-12T02:07:39.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.512+0000 7f81ea7fc640 1 -- 172.21.15.19:0/656570005 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3127946238 0 0) 0x7f81ec06eed0 con 0x7f81ec072de0 2024-09-12T02:07:39.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.512+0000 7f81ea7fc640 1 -- 172.21.15.19:0/656570005 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81ec146140 con 0x7f81ec072de0 2024-09-12T02:07:39.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.512+0000 7f81ea7fc640 1 -- 172.21.15.19:0/656570005 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2731590484 0 0) 0x7f81d4003520 con 0x7f81ec15e1f0 2024-09-12T02:07:39.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.512+0000 7f81eb7fe640 1 -- 172.21.15.19:0/656570005 >> v1:172.21.15.135:6789/0 conn(0x7f81ec072de0 legacy=0x7f81ec06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.512+0000 7f81eb7fe640 1 -- 172.21.15.19:0/656570005 >> v1:172.21.15.19:6789/0 conn(0x7f81ec15e1f0 legacy=0x7f81ec06e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.512+0000 7f81eb7fe640 1 -- 172.21.15.19:0/656570005 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ec0cda20 con 0x7f81ec072320 2024-09-12T02:07:39.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.512+0000 7f81eb7fe640 1 --2- 172.21.15.19:0/656570005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81ec072320 0x7f81ec0cce60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0097a0 tx=0x7f81dc02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6f0e90008e3615 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:39.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.513+0000 7f81ea7fc640 1 -- 172.21.15.19:0/656570005 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc037070 con 0x7f81ec072320 2024-09-12T02:07:39.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.513+0000 7f81ea7fc640 1 -- 172.21.15.19:0/656570005 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc02abc0 con 0x7f81ec072320 2024-09-12T02:07:39.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.513+0000 7f81ea7fc640 1 -- 172.21.15.19:0/656570005 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e40019f0 con 0x7f81ec072320 2024-09-12T02:07:39.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.513+0000 7f81f2133640 1 -- 172.21.15.19:0/656570005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81ec072320 msgr2=0x7f81ec0cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.513+0000 7f81f2133640 1 --2- 172.21.15.19:0/656570005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81ec072320 0x7f81ec0cce60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0097a0 tx=0x7f81dc02a130 comp rx=0 tx=0).stop 2024-09-12T02:07:39.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.513+0000 7f81f2133640 1 -- 172.21.15.19:0/656570005 shutdown_connections 2024-09-12T02:07:39.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.513+0000 7f81f2133640 1 --2- 172.21.15.19:0/656570005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81ec072320 0x7f81ec0cce60 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.513+0000 7f81f2133640 1 -- 172.21.15.19:0/656570005 >> 172.21.15.19:0/656570005 conn(0x7f81ec067d70 msgr2=0x7f81ec06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:39.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.513+0000 7f81f2133640 1 -- 172.21.15.19:0/656570005 shutdown_connections 2024-09-12T02:07:39.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.513+0000 7f81f2133640 1 -- 172.21.15.19:0/656570005 wait complete. 2024-09-12T02:07:39.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.514+0000 7f81f2133640 1 Processor -- start 2024-09-12T02:07:39.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.515+0000 7f81f2133640 1 -- start start 2024-09-12T02:07:39.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.515+0000 7f81f2133640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81ec072320 0x7f81ec0cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.515+0000 7f81f2133640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81ec072de0 0x7f81ec1e5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.515+0000 7f81f2133640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81ec15e1f0 0x7f81ec1e6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.515+0000 7f81f2133640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec0cd3a0 con 0x7f81ec072320 2024-09-12T02:07:39.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.515+0000 7f81f2133640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec15c9e0 con 0x7f81ec15e1f0 2024-09-12T02:07:39.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.515+0000 7f81f2133640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f81ec0cd520 con 0x7f81ec072de0 2024-09-12T02:07:39.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.515+0000 7f81eb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81ec072320 0x7f81ec0cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.515+0000 7f81eb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81ec072320 0x7f81ec0cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49960/0 (socket says 172.21.15.19:49960) 2024-09-12T02:07:39.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.515+0000 7f81eb7fe640 1 -- 172.21.15.19:0/1418217397 learned_addr learned my addr 172.21.15.19:0/1418217397 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:39.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.516+0000 7f81eaffd640 1 --2- 172.21.15.19:0/1418217397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81ec072de0 0x7f81ec1e5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.516+0000 7f81ebfff640 1 --2- 172.21.15.19:0/1418217397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81ec15e1f0 0x7f81ec1e6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.516+0000 7f81eb7fe640 1 -- 172.21.15.19:0/1418217397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81ec072de0 msgr2=0x7f81ec1e5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.516+0000 7f81eb7fe640 1 --2- 172.21.15.19:0/1418217397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81ec072de0 0x7f81ec1e5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.516+0000 7f81eb7fe640 1 -- 172.21.15.19:0/1418217397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81ec15e1f0 msgr2=0x7f81ec1e6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.516+0000 7f81eb7fe640 1 --2- 172.21.15.19:0/1418217397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81ec15e1f0 0x7f81ec1e6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.516+0000 7f81eb7fe640 1 -- 172.21.15.19:0/1418217397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ec12ffe0 con 0x7f81ec072320 2024-09-12T02:07:39.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.516+0000 7f81eaffd640 1 --2- 172.21.15.19:0/1418217397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81ec072de0 0x7f81ec1e5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:39.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.516+0000 7f81eb7fe640 1 --2- 172.21.15.19:0/1418217397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81ec072320 0x7f81ec0cbeb0 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 crypto rx=0x7f81dc035040 tx=0x7f81dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:39.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.516+0000 7f81d3fff640 1 -- 172.21.15.19:0/1418217397 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc037050 con 0x7f81ec072320 2024-09-12T02:07:39.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.516+0000 7f81d3fff640 1 -- 172.21.15.19:0/1418217397 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc043070 con 0x7f81ec072320 2024-09-12T02:07:39.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.516+0000 7f81f2133640 1 -- 172.21.15.19:0/1418217397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81ec1302c0 con 0x7f81ec072320 2024-09-12T02:07:39.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.516+0000 7f81d3fff640 1 -- 172.21.15.19:0/1418217397 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc006e10 con 0x7f81ec072320 2024-09-12T02:07:39.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.516+0000 7f81f2133640 1 -- 172.21.15.19:0/1418217397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81ec130880 con 0x7f81ec072320 2024-09-12T02:07:39.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.517+0000 7f81f2133640 1 -- 172.21.15.19:0/1418217397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81ec072700 con 0x7f81ec072320 2024-09-12T02:07:39.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.518+0000 7f81d3fff640 1 -- 172.21.15.19:0/1418217397 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81dc03ca10 con 0x7f81ec072320 2024-09-12T02:07:39.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.518+0000 7f81d3fff640 1 --2- 172.21.15.19:0/1418217397 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f81d806be30 0x7f81d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.518+0000 7f81d3fff640 1 -- 172.21.15.19:0/1418217397 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7f81dc0ab860 con 0x7f81ec072320 2024-09-12T02:07:39.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.518+0000 7f81eaffd640 1 --2- 172.21.15.19:0/1418217397 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f81d806be30 0x7f81d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.519+0000 7f81eaffd640 1 --2- 172.21.15.19:0/1418217397 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f81d806be30 0x7f81d806e2f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0c7410 tx=0x7f81e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:39.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.523+0000 7f81d3fff640 1 -- 172.21.15.19:0/1418217397 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f81dc030e20 con 0x7f81ec072320 2024-09-12T02:07:39.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.701+0000 7f81f2133640 1 -- 172.21.15.19:0/1418217397 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f81ec130ac0 con 0x7f81d806be30 2024-09-12T02:07:39.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.702+0000 7f81d3fff640 1 -- 172.21.15.19:0/1418217397 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f81ec130ac0 con 0x7f81d806be30 2024-09-12T02:07:39.702 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T02:07:39.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.704+0000 7f81f2133640 1 -- 172.21.15.19:0/1418217397 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f81d806be30 msgr2=0x7f81d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.704+0000 7f81f2133640 1 --2- 172.21.15.19:0/1418217397 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f81d806be30 0x7f81d806e2f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0c7410 tx=0x7f81e0009040 comp rx=0 tx=0).stop 2024-09-12T02:07:39.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.704+0000 7f81f2133640 1 -- 172.21.15.19:0/1418217397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81ec072320 msgr2=0x7f81ec0cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.704+0000 7f81f2133640 1 --2- 172.21.15.19:0/1418217397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81ec072320 0x7f81ec0cbeb0 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 crypto rx=0x7f81dc035040 tx=0x7f81dc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.704+0000 7f81f2133640 1 -- 172.21.15.19:0/1418217397 shutdown_connections 2024-09-12T02:07:39.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.704+0000 7f81f2133640 1 --2- 172.21.15.19:0/1418217397 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f81d806be30 0x7f81d806e2f0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.704+0000 7f81f2133640 1 --2- 172.21.15.19:0/1418217397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81ec15e1f0 0x7f81ec1e6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.704+0000 7f81f2133640 1 --2- 172.21.15.19:0/1418217397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81ec072de0 0x7f81ec1e5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.704+0000 7f81f2133640 1 --2- 172.21.15.19:0/1418217397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81ec072320 0x7f81ec0cbeb0 unknown :-1 s=CLOSED pgs=2395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.704+0000 7f81f2133640 1 -- 172.21.15.19:0/1418217397 >> 172.21.15.19:0/1418217397 conn(0x7f81ec067d70 msgr2=0x7f81ec1449b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.704+0000 7f81f2133640 1 -- 172.21.15.19:0/1418217397 shutdown_connections 2024-09-12T02:07:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.704+0000 7f81f2133640 1 -- 172.21.15.19:0/1418217397 wait complete. 2024-09-12T02:07:39.715 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T02:07:39.715 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:07:39.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.820+0000 7f1ce465e640 1 Processor -- start 2024-09-12T02:07:39.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.820+0000 7f1ce465e640 1 -- start start 2024-09-12T02:07:39.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.821+0000 7f1ce465e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1cdc0d15f0 0x7f1cdc0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.821+0000 7f1ce465e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cdc0cf980 con 0x7f1cdc161a20 2024-09-12T02:07:39.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.821+0000 7f1ce465e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cdc06d050 con 0x7f1cdc0cf160 2024-09-12T02:07:39.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.821+0000 7f1ce465e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f1cdc161e00 con 0x7f1cdc0d15f0 2024-09-12T02:07:39.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.822+0000 7f1ce1bf9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1cdc0d15f0 0x7f1cdc0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.822+0000 7f1ce23fa640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1cdc161a20 0x7f1cdc0d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57776/0 (socket says 172.21.15.19:57776) 2024-09-12T02:07:39.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.822+0000 7f1ce23fa640 1 -- 172.21.15.19:0/3436560933 learned_addr learned my addr 172.21.15.19:0/3436560933 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:39.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.822+0000 7f1ce1bf9640 1 -- 172.21.15.19:0/3436560933 >> v1:172.21.15.135:6789/0 conn(0x7f1cdc0cf160 legacy=0x7f1cdc06d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:39.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.822+0000 7f1ce1bf9640 1 -- 172.21.15.19:0/3436560933 >> v1:172.21.15.19:6789/0 conn(0x7f1cdc161a20 legacy=0x7f1cdc0d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.822+0000 7f1ce1bf9640 1 -- 172.21.15.19:0/3436560933 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cdc0cfc20 con 0x7f1cdc0d15f0 2024-09-12T02:07:39.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.823+0000 7f1ce1bf9640 1 --2- 172.21.15.19:0/3436560933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cdc0d15f0 0x7f1cdc0cec20 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc0097a0 tx=0x7f1ccc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b992710596e2f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:39.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.823+0000 7f1ce13f8640 1 -- 172.21.15.19:0/3436560933 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc037070 con 0x7f1cdc0d15f0 2024-09-12T02:07:39.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.823+0000 7f1ce13f8640 1 -- 172.21.15.19:0/3436560933 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ccc032440 con 0x7f1cdc0d15f0 2024-09-12T02:07:39.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.823+0000 7f1ce13f8640 1 -- 172.21.15.19:0/3436560933 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc032810 con 0x7f1cdc0d15f0 2024-09-12T02:07:39.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.823+0000 7f1ce465e640 1 -- 172.21.15.19:0/3436560933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cdc0d15f0 msgr2=0x7f1cdc0cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.823+0000 7f1ce465e640 1 --2- 172.21.15.19:0/3436560933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cdc0d15f0 0x7f1cdc0cec20 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc0097a0 tx=0x7f1ccc02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.823+0000 7f1ce465e640 1 -- 172.21.15.19:0/3436560933 shutdown_connections 2024-09-12T02:07:39.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.823+0000 7f1ce465e640 1 --2- 172.21.15.19:0/3436560933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cdc0d15f0 0x7f1cdc0cec20 unknown :-1 s=CLOSED pgs=2397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.823+0000 7f1ce465e640 1 -- 172.21.15.19:0/3436560933 >> 172.21.15.19:0/3436560933 conn(0x7f1cdc09d850 msgr2=0x7f1cdc08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:39.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.823+0000 7f1ce465e640 1 -- 172.21.15.19:0/3436560933 shutdown_connections 2024-09-12T02:07:39.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.823+0000 7f1ce465e640 1 -- 172.21.15.19:0/3436560933 wait complete. 2024-09-12T02:07:39.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.825+0000 7f1ce465e640 1 Processor -- start 2024-09-12T02:07:39.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.825+0000 7f1ce465e640 1 -- start start 2024-09-12T02:07:39.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.825+0000 7f1ce465e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cdc0cf160 0x7f1cdc15f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.825+0000 7f1ce465e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cdc0d15f0 0x7f1cdc0c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.825+0000 7f1ce465e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cdc161a20 0x7f1cdc0c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.825+0000 7f1ce465e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc0b1040 con 0x7f1cdc0cf160 2024-09-12T02:07:39.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.825+0000 7f1ce465e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc06d2f0 con 0x7f1cdc161a20 2024-09-12T02:07:39.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.825+0000 7f1ce465e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1cdc0cf590 con 0x7f1cdc0d15f0 2024-09-12T02:07:39.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.826+0000 7f1ce23fa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cdc0cf160 0x7f1cdc15f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.826+0000 7f1ce23fa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cdc0cf160 0x7f1cdc15f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49980/0 (socket says 172.21.15.19:49980) 2024-09-12T02:07:39.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.826+0000 7f1ce23fa640 1 -- 172.21.15.19:0/1097618302 learned_addr learned my addr 172.21.15.19:0/1097618302 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:39.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.826+0000 7f1ce23fa640 1 -- 172.21.15.19:0/1097618302 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cdc0d15f0 msgr2=0x7f1cdc0c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.826+0000 7f1ce23fa640 1 --2- 172.21.15.19:0/1097618302 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cdc0d15f0 0x7f1cdc0c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.826+0000 7f1ce23fa640 1 -- 172.21.15.19:0/1097618302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cdc161a20 msgr2=0x7f1cdc0c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.826+0000 7f1ce23fa640 1 --2- 172.21.15.19:0/1097618302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cdc161a20 0x7f1cdc0c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.826+0000 7f1ce23fa640 1 -- 172.21.15.19:0/1097618302 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cdc0ca1e0 con 0x7f1cdc0cf160 2024-09-12T02:07:39.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.826+0000 7f1ce23fa640 1 --2- 172.21.15.19:0/1097618302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cdc0cf160 0x7f1cdc15f450 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800c3c0 tx=0x7f1cd800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.826+0000 7f1cd2ffd640 1 -- 172.21.15.19:0/1097618302 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8017070 con 0x7f1cdc0cf160 2024-09-12T02:07:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.826+0000 7f1cd2ffd640 1 -- 172.21.15.19:0/1097618302 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd8005ce0 con 0x7f1cdc0cf160 2024-09-12T02:07:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.826+0000 7f1cd2ffd640 1 -- 172.21.15.19:0/1097618302 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8007310 con 0x7f1cdc0cf160 2024-09-12T02:07:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.826+0000 7f1ce465e640 1 -- 172.21.15.19:0/1097618302 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cdc0ca4b0 con 0x7f1cdc0cf160 2024-09-12T02:07:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.826+0000 7f1ce465e640 1 -- 172.21.15.19:0/1097618302 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cdc0caa70 con 0x7f1cdc0cf160 2024-09-12T02:07:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.827+0000 7f1ce465e640 1 -- 172.21.15.19:0/1097618302 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1cdc0cae70 con 0x7f1cdc0cf160 2024-09-12T02:07:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.828+0000 7f1cd2ffd640 1 -- 172.21.15.19:0/1097618302 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1cd801a070 con 0x7f1cdc0cf160 2024-09-12T02:07:39.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.828+0000 7f1cd2ffd640 1 --2- 172.21.15.19:0/1097618302 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cc006be30 0x7f1cc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.828+0000 7f1cd2ffd640 1 -- 172.21.15.19:0/1097618302 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7f1cd808a020 con 0x7f1cdc0cf160 2024-09-12T02:07:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.828+0000 7f1cd2ffd640 1 --2- 172.21.15.19:0/1097618302 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x7f1cc0072370 0x7f1cc00747b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.828+0000 7f1cd2ffd640 1 -- 172.21.15.19:0/1097618302 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1cd8014ec0 con 0x7f1cc0072370 2024-09-12T02:07:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.828+0000 7f1cd2ffd640 1 -- 172.21.15.19:0/1097618302 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=149) ==== 24+0+0 (secure 0 0 0) 0x7f1cd8091050 con 0x7f1cdc0cf160 2024-09-12T02:07:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.828+0000 7f1ce1bf9640 1 --2- 172.21.15.19:0/1097618302 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cc006be30 0x7f1cc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.829+0000 7f1ce2bfb640 1 --2- 172.21.15.19:0/1097618302 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x7f1cc0072370 0x7f1cc00747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.829+0000 7f1ce1bf9640 1 --2- 172.21.15.19:0/1097618302 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cc006be30 0x7f1cc006e2f0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc034000 tx=0x7f1ccc02c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:39.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.829+0000 7f1ce2bfb640 1 --2- 172.21.15.19:0/1097618302 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x7f1cc0072370 0x7f1cc00747b0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:39.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.830+0000 7f1cd2ffd640 1 -- 172.21.15.19:0/1097618302 <== osd.6 v2:172.21.15.135:6816/580453075 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1cd8014ec0 con 0x7f1cc0072370 2024-09-12T02:07:39.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.842+0000 7f1ce465e640 1 -- 172.21.15.19:0/1097618302 --> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1cdc0cec20 con 0x7f1cc0072370 2024-09-12T02:07:39.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.843+0000 7f1cd2ffd640 1 -- 172.21.15.19:0/1097618302 <== osd.6 v2:172.21.15.135:6816/580453075 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1cdc0cec20 con 0x7f1cc0072370 2024-09-12T02:07:39.844 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:07:39.844 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:07:39.844 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:07:39.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.843+0000 7f1ce465e640 1 -- 172.21.15.19:0/1097618302 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x7f1cc0072370 msgr2=0x7f1cc00747b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.843+0000 7f1ce465e640 1 --2- 172.21.15.19:0/1097618302 >> [v2:172.21.15.135:6816/580453075,v1:172.21.15.135:6817/580453075] conn(0x7f1cc0072370 0x7f1cc00747b0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.843+0000 7f1ce465e640 1 -- 172.21.15.19:0/1097618302 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cc006be30 msgr2=0x7f1cc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.843+0000 7f1ce465e640 1 --2- 172.21.15.19:0/1097618302 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f1cc006be30 0x7f1cc006e2f0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc034000 tx=0x7f1ccc02c000 comp rx=0 tx=0).stop 2024-09-12T02:07:39.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.843+0000 7f1ce465e640 1 -- 172.21.15.19:0/1097618302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cdc0cf160 msgr2=0x7f1cdc15f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.843+0000 7f1ce465e640 1 --2- 172.21.15.19:0/1097618302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cdc0cf160 0x7f1cdc15f450 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800c3c0 tx=0x7f1cd800c880 comp rx=0 tx=0).stop 2024-09-12T02:07:39.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.843+0000 7f1ce2bfb640 1 -- 172.21.15.19:0/1097618302 reap_dead start 2024-09-12T02:07:39.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.843+0000 7f1ce465e640 1 -- 172.21.15.19:0/1097618302 shutdown_connections 2024-09-12T02:07:39.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.843+0000 7f1ce465e640 1 -- 172.21.15.19:0/1097618302 >> 172.21.15.19:0/1097618302 conn(0x7f1cdc09d850 msgr2=0x7f1cdc15d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:39.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.843+0000 7f1ce465e640 1 -- 172.21.15.19:0/1097618302 shutdown_connections 2024-09-12T02:07:39.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.843+0000 7f1ce465e640 1 -- 172.21.15.19:0/1097618302 wait complete. 2024-09-12T02:07:39.854 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T02:07:39.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.956+0000 7fd199f3b640 1 Processor -- start 2024-09-12T02:07:39.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.956+0000 7fd199f3b640 1 -- start start 2024-09-12T02:07:39.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.957+0000 7fd199f3b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd1940b6690 0x7fd1941691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.957+0000 7fd199f3b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1940d3690 con 0x7fd19415e5f0 2024-09-12T02:07:39.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.957+0000 7fd199f3b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1940d3970 con 0x7fd1940d30f0 2024-09-12T02:07:39.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.957+0000 7fd199f3b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd19406d530 con 0x7fd1940b6690 2024-09-12T02:07:39.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.957+0000 7fd1937fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd19415e5f0 0x7fd1940d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57786/0 (socket says 172.21.15.19:57786) 2024-09-12T02:07:39.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.957+0000 7fd1937fe640 1 -- 172.21.15.19:0/3055927705 learned_addr learned my addr 172.21.15.19:0/3055927705 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:39.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.957+0000 7fd193fff640 1 --2- 172.21.15.19:0/3055927705 >> v2:172.21.15.135:3300/0 conn(0x7fd1940b6690 0x7fd1941691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.957+0000 7fd1927fc640 1 -- 172.21.15.19:0/3055927705 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2268182861 0 0) 0x7fd1940d3690 con 0x7fd19415e5f0 2024-09-12T02:07:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.958+0000 7fd1927fc640 1 -- 172.21.15.19:0/3055927705 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd17c003520 con 0x7fd19415e5f0 2024-09-12T02:07:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.958+0000 7fd1927fc640 1 -- 172.21.15.19:0/3055927705 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2626621182 0 0) 0x7fd1940d3970 con 0x7fd1940d30f0 2024-09-12T02:07:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.958+0000 7fd1927fc640 1 -- 172.21.15.19:0/3055927705 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1940d3690 con 0x7fd1940d30f0 2024-09-12T02:07:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.958+0000 7fd193fff640 1 -- 172.21.15.19:0/3055927705 >> v1:172.21.15.135:6789/0 conn(0x7fd1940d30f0 legacy=0x7fd1940b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.958+0000 7fd193fff640 1 -- 172.21.15.19:0/3055927705 >> v1:172.21.15.19:6789/0 conn(0x7fd19415e5f0 legacy=0x7fd1940d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.958+0000 7fd1927fc640 1 -- 172.21.15.19:0/3055927705 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1232555262 0 0) 0x7fd17c003520 con 0x7fd19415e5f0 2024-09-12T02:07:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.958+0000 7fd193fff640 1 -- 172.21.15.19:0/3055927705 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd19406cee0 con 0x7fd1940b6690 2024-09-12T02:07:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.959+0000 7fd193fff640 1 --2- 172.21.15.19:0/3055927705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1940b6690 0x7fd1941691a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009dc0 tx=0x7fd18c02a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f93a53dae3c92016 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.959+0000 7fd1927fc640 1 -- 172.21.15.19:0/3055927705 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd184001670 con 0x7fd1940b6690 2024-09-12T02:07:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.959+0000 7fd1927fc640 1 -- 172.21.15.19:0/3055927705 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd18c007540 con 0x7fd1940b6690 2024-09-12T02:07:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.959+0000 7fd1927fc640 1 -- 172.21.15.19:0/3055927705 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c0078f0 con 0x7fd1940b6690 2024-09-12T02:07:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.959+0000 7fd199f3b640 1 -- 172.21.15.19:0/3055927705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1940b6690 msgr2=0x7fd1941691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.959+0000 7fd199f3b640 1 --2- 172.21.15.19:0/3055927705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1940b6690 0x7fd1941691a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009dc0 tx=0x7fd18c02a6c0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.959+0000 7fd199f3b640 1 -- 172.21.15.19:0/3055927705 shutdown_connections 2024-09-12T02:07:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.959+0000 7fd199f3b640 1 --2- 172.21.15.19:0/3055927705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1940b6690 0x7fd1941691a0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.959+0000 7fd199f3b640 1 -- 172.21.15.19:0/3055927705 >> 172.21.15.19:0/3055927705 conn(0x7fd19408bfc0 msgr2=0x7fd1940d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.959+0000 7fd199f3b640 1 -- 172.21.15.19:0/3055927705 shutdown_connections 2024-09-12T02:07:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.959+0000 7fd199f3b640 1 -- 172.21.15.19:0/3055927705 wait complete. 2024-09-12T02:07:39.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.960+0000 7fd199f3b640 1 Processor -- start 2024-09-12T02:07:39.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.961+0000 7fd199f3b640 1 -- start start 2024-09-12T02:07:39.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.961+0000 7fd199f3b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1940b6690 0x7fd1940cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.961+0000 7fd199f3b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1940d30f0 0x7fd1940b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.961+0000 7fd199f3b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd19415e5f0 0x7fd1941f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.961+0000 7fd199f3b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd19406e9d0 con 0x7fd1940b6690 2024-09-12T02:07:39.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.961+0000 7fd199f3b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd19415e9d0 con 0x7fd1940d30f0 2024-09-12T02:07:39.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.961+0000 7fd199f3b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd19406eb50 con 0x7fd19415e5f0 2024-09-12T02:07:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.962+0000 7fd1937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1940b6690 0x7fd1940cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.962+0000 7fd1937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1940b6690 0x7fd1940cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49992/0 (socket says 172.21.15.19:49992) 2024-09-12T02:07:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.962+0000 7fd1937fe640 1 -- 172.21.15.19:0/3452340926 learned_addr learned my addr 172.21.15.19:0/3452340926 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.962+0000 7fd192ffd640 1 --2- 172.21.15.19:0/3452340926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1940d30f0 0x7fd1940b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.962+0000 7fd193fff640 1 --2- 172.21.15.19:0/3452340926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd19415e5f0 0x7fd1941f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.962+0000 7fd1937fe640 1 -- 172.21.15.19:0/3452340926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd19415e5f0 msgr2=0x7fd1941f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.962+0000 7fd1937fe640 1 --2- 172.21.15.19:0/3452340926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd19415e5f0 0x7fd1941f40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.962+0000 7fd1937fe640 1 -- 172.21.15.19:0/3452340926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1940d30f0 msgr2=0x7fd1940b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:39.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.962+0000 7fd1937fe640 1 --2- 172.21.15.19:0/3452340926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1940d30f0 0x7fd1940b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:39.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.962+0000 7fd1937fe640 1 -- 172.21.15.19:0/3452340926 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1940b8ac0 con 0x7fd1940b6690 2024-09-12T02:07:39.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.962+0000 7fd192ffd640 1 --2- 172.21.15.19:0/3452340926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1940d30f0 0x7fd1940b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:39.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.962+0000 7fd193fff640 1 --2- 172.21.15.19:0/3452340926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd19415e5f0 0x7fd1941f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:39.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.962+0000 7fd1937fe640 1 --2- 172.21.15.19:0/3452340926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1940b6690 0x7fd1940cb5d0 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7fd18400c5f0 tx=0x7fd18400cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:39.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.962+0000 7fd17bfff640 1 -- 172.21.15.19:0/3452340926 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd184017070 con 0x7fd1940b6690 2024-09-12T02:07:39.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.962+0000 7fd17bfff640 1 -- 172.21.15.19:0/3452340926 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd184005d00 con 0x7fd1940b6690 2024-09-12T02:07:39.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.962+0000 7fd199f3b640 1 -- 172.21.15.19:0/3452340926 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1940b8da0 con 0x7fd1940b6690 2024-09-12T02:07:39.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.962+0000 7fd17bfff640 1 -- 172.21.15.19:0/3452340926 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1840072b0 con 0x7fd1940b6690 2024-09-12T02:07:39.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.962+0000 7fd199f3b640 1 -- 172.21.15.19:0/3452340926 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1941590a0 con 0x7fd1940b6690 2024-09-12T02:07:39.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.963+0000 7fd199f3b640 1 -- 172.21.15.19:0/3452340926 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1940b5f80 con 0x7fd1940b6690 2024-09-12T02:07:39.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.964+0000 7fd17bfff640 1 -- 172.21.15.19:0/3452340926 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd18401a070 con 0x7fd1940b6690 2024-09-12T02:07:39.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.964+0000 7fd17bfff640 1 --2- 172.21.15.19:0/3452340926 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd18006be30 0x7fd18006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:39.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.964+0000 7fd17bfff640 1 -- 172.21.15.19:0/3452340926 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7fd18408a2a0 con 0x7fd1940b6690 2024-09-12T02:07:39.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.964+0000 7fd192ffd640 1 --2- 172.21.15.19:0/3452340926 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd18006be30 0x7fd18006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:39.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.965+0000 7fd192ffd640 1 --2- 172.21.15.19:0/3452340926 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd18006be30 0x7fd18006e2f0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fd1940cbb10 tx=0x7fd188009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:39.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:39.969+0000 7fd17bfff640 1 -- 172.21.15.19:0/3452340926 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd184058e00 con 0x7fd1940b6690 2024-09-12T02:07:40.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.144+0000 7fd199f3b640 1 -- 172.21.15.19:0/3452340926 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fd1940b9510 con 0x7fd18006be30 2024-09-12T02:07:40.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.145+0000 7fd17bfff640 1 -- 172.21.15.19:0/3452340926 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd1940b9510 con 0x7fd18006be30 2024-09-12T02:07:40.145 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T02:07:40.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.146+0000 7fd199f3b640 1 -- 172.21.15.19:0/3452340926 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd18006be30 msgr2=0x7fd18006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.147+0000 7fd199f3b640 1 --2- 172.21.15.19:0/3452340926 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd18006be30 0x7fd18006e2f0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fd1940cbb10 tx=0x7fd188009040 comp rx=0 tx=0).stop 2024-09-12T02:07:40.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.147+0000 7fd199f3b640 1 -- 172.21.15.19:0/3452340926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1940b6690 msgr2=0x7fd1940cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.147+0000 7fd199f3b640 1 --2- 172.21.15.19:0/3452340926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1940b6690 0x7fd1940cb5d0 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7fd18400c5f0 tx=0x7fd18400cab0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.147+0000 7fd199f3b640 1 -- 172.21.15.19:0/3452340926 shutdown_connections 2024-09-12T02:07:40.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.147+0000 7fd199f3b640 1 --2- 172.21.15.19:0/3452340926 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fd18006be30 0x7fd18006e2f0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.147+0000 7fd199f3b640 1 --2- 172.21.15.19:0/3452340926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd19415e5f0 0x7fd1941f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.147+0000 7fd199f3b640 1 --2- 172.21.15.19:0/3452340926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1940d30f0 0x7fd1940b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.147+0000 7fd199f3b640 1 --2- 172.21.15.19:0/3452340926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1940b6690 0x7fd1940cb5d0 unknown :-1 s=CLOSED pgs=2400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.147+0000 7fd199f3b640 1 -- 172.21.15.19:0/3452340926 >> 172.21.15.19:0/3452340926 conn(0x7fd19408bfc0 msgr2=0x7fd1940b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:40.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.147+0000 7fd199f3b640 1 -- 172.21.15.19:0/3452340926 shutdown_connections 2024-09-12T02:07:40.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.147+0000 7fd199f3b640 1 -- 172.21.15.19:0/3452340926 wait complete. 2024-09-12T02:07:40.158 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T02:07:40.158 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:07:40.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.264+0000 7f2d3d7bd640 1 Processor -- start 2024-09-12T02:07:40.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.264+0000 7f2d3d7bd640 1 -- start start 2024-09-12T02:07:40.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.265+0000 7f2d3d7bd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d380cf790 0x7f2d380cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.265+0000 7f2d3d7bd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d380ce060 0x7f2d380ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.265+0000 7f2d3d7bd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d380b30e0 con 0x7f2d38156740 2024-09-12T02:07:40.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.265+0000 7f2d3d7bd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2d380d0140 con 0x7f2d380cf790 2024-09-12T02:07:40.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.265+0000 7f2d3d7bd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2d3806edc0 con 0x7f2d380ce060 2024-09-12T02:07:40.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.265+0000 7f2d367fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d380cf790 0x7f2d380cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.265+0000 7f2d367fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d380cf790 0x7f2d380cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50000/0 (socket says 172.21.15.19:50000) 2024-09-12T02:07:40.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.265+0000 7f2d367fc640 1 -- 172.21.15.19:0/3968024059 learned_addr learned my addr 172.21.15.19:0/3968024059 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:40.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.265+0000 7f2d377fe640 1 --2- 172.21.15.19:0/3968024059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d380ce060 0x7f2d380ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.266+0000 7f2d367fc640 1 -- 172.21.15.19:0/3968024059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d380ce060 msgr2=0x7f2d380ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:40.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.266+0000 7f2d367fc640 1 --2- 172.21.15.19:0/3968024059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d380ce060 0x7f2d380ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.266+0000 7f2d367fc640 1 -- 172.21.15.19:0/3968024059 >> v1:172.21.15.135:6789/0 conn(0x7f2d38156740 legacy=0x7f2d380b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.266+0000 7f2d367fc640 1 -- 172.21.15.19:0/3968024059 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d380b33c0 con 0x7f2d380cf790 2024-09-12T02:07:40.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.266+0000 7f2d367fc640 1 --2- 172.21.15.19:0/3968024059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d380cf790 0x7f2d380cfc00 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0098a0 tx=0x7f2d2c02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5fc077f32cd282 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:40.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.267+0000 7f2d35ffb640 1 -- 172.21.15.19:0/3968024059 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c037070 con 0x7f2d380cf790 2024-09-12T02:07:40.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.267+0000 7f2d35ffb640 1 -- 172.21.15.19:0/3968024059 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d2c032440 con 0x7f2d380cf790 2024-09-12T02:07:40.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.267+0000 7f2d35ffb640 1 -- 172.21.15.19:0/3968024059 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c032810 con 0x7f2d380cf790 2024-09-12T02:07:40.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.267+0000 7f2d3d7bd640 1 -- 172.21.15.19:0/3968024059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d380cf790 msgr2=0x7f2d380cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.267+0000 7f2d3d7bd640 1 --2- 172.21.15.19:0/3968024059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d380cf790 0x7f2d380cfc00 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0098a0 tx=0x7f2d2c02a290 comp rx=0 tx=0).stop 2024-09-12T02:07:40.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.267+0000 7f2d3d7bd640 1 -- 172.21.15.19:0/3968024059 shutdown_connections 2024-09-12T02:07:40.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.267+0000 7f2d3d7bd640 1 --2- 172.21.15.19:0/3968024059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d380ce060 0x7f2d380ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.267+0000 7f2d3d7bd640 1 --2- 172.21.15.19:0/3968024059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d380cf790 0x7f2d380cfc00 unknown :-1 s=CLOSED pgs=2401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.267+0000 7f2d3d7bd640 1 -- 172.21.15.19:0/3968024059 >> 172.21.15.19:0/3968024059 conn(0x7f2d3806bdf0 msgr2=0x7f2d3806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:40.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.267+0000 7f2d3d7bd640 1 -- 172.21.15.19:0/3968024059 shutdown_connections 2024-09-12T02:07:40.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.267+0000 7f2d3d7bd640 1 -- 172.21.15.19:0/3968024059 wait complete. 2024-09-12T02:07:40.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.268+0000 7f2d3d7bd640 1 Processor -- start 2024-09-12T02:07:40.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.269+0000 7f2d3d7bd640 1 -- start start 2024-09-12T02:07:40.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.269+0000 7f2d3d7bd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d380ce060 0x7f2d38152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.269+0000 7f2d3d7bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d380cf790 0x7f2d38098d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.269+0000 7f2d3d7bd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d38156740 0x7f2d380992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.269+0000 7f2d3d7bd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2d380b3c60 con 0x7f2d380cf790 2024-09-12T02:07:40.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.269+0000 7f2d3d7bd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2d380b3980 con 0x7f2d38156740 2024-09-12T02:07:40.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.269+0000 7f2d3d7bd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2d380b4cc0 con 0x7f2d380ce060 2024-09-12T02:07:40.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.269+0000 7f2d367fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d380cf790 0x7f2d38098d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.269+0000 7f2d367fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d380cf790 0x7f2d38098d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50014/0 (socket says 172.21.15.19:50014) 2024-09-12T02:07:40.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.269+0000 7f2d367fc640 1 -- 172.21.15.19:0/3245008145 learned_addr learned my addr 172.21.15.19:0/3245008145 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:40.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.270+0000 7f2d377fe640 1 --2- 172.21.15.19:0/3245008145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d38156740 0x7f2d380992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.270+0000 7f2d36ffd640 1 --2- 172.21.15.19:0/3245008145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d380ce060 0x7f2d38152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.270+0000 7f2d367fc640 1 -- 172.21.15.19:0/3245008145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d380ce060 msgr2=0x7f2d38152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.270+0000 7f2d367fc640 1 --2- 172.21.15.19:0/3245008145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d380ce060 0x7f2d38152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.270+0000 7f2d367fc640 1 -- 172.21.15.19:0/3245008145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d38156740 msgr2=0x7f2d380992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.270+0000 7f2d367fc640 1 --2- 172.21.15.19:0/3245008145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d38156740 0x7f2d380992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.270+0000 7f2d367fc640 1 -- 172.21.15.19:0/3245008145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d381e5ce0 con 0x7f2d380cf790 2024-09-12T02:07:40.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.270+0000 7f2d367fc640 1 --2- 172.21.15.19:0/3245008145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d380cf790 0x7f2d38098d70 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0098a0 tx=0x7f2d2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:40.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.270+0000 7f2d1f7fe640 1 -- 172.21.15.19:0/3245008145 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c037040 con 0x7f2d380cf790 2024-09-12T02:07:40.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.270+0000 7f2d1f7fe640 1 -- 172.21.15.19:0/3245008145 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d2c030440 con 0x7f2d380cf790 2024-09-12T02:07:40.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.270+0000 7f2d3d7bd640 1 -- 172.21.15.19:0/3245008145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3814c8b0 con 0x7f2d380cf790 2024-09-12T02:07:40.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.270+0000 7f2d1f7fe640 1 -- 172.21.15.19:0/3245008145 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c030830 con 0x7f2d380cf790 2024-09-12T02:07:40.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.270+0000 7f2d3d7bd640 1 -- 172.21.15.19:0/3245008145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d381e6230 con 0x7f2d380cf790 2024-09-12T02:07:40.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.271+0000 7f2d3d7bd640 1 -- 172.21.15.19:0/3245008145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2d381e6600 con 0x7f2d380cf790 2024-09-12T02:07:40.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.272+0000 7f2d1f7fe640 1 -- 172.21.15.19:0/3245008145 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d2c044030 con 0x7f2d380cf790 2024-09-12T02:07:40.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.272+0000 7f2d1f7fe640 1 --2- 172.21.15.19:0/3245008145 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2d2406be30 0x7f2d2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.272+0000 7f2d1f7fe640 1 -- 172.21.15.19:0/3245008145 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7f2d2c0aaa90 con 0x7f2d380cf790 2024-09-12T02:07:40.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.272+0000 7f2d1f7fe640 1 --2- 172.21.15.19:0/3245008145 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x7f2d24072370 0x7f2d240747b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.272+0000 7f2d1f7fe640 1 -- 172.21.15.19:0/3245008145 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d2c008f00 con 0x7f2d24072370 2024-09-12T02:07:40.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.272+0000 7f2d36ffd640 1 --2- 172.21.15.19:0/3245008145 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2d2406be30 0x7f2d2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.272+0000 7f2d1f7fe640 1 -- 172.21.15.19:0/3245008145 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=149) ==== 24+0+0 (secure 0 0 0) 0x7f2d2c0af2c0 con 0x7f2d380cf790 2024-09-12T02:07:40.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.273+0000 7f2d377fe640 1 --2- 172.21.15.19:0/3245008145 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x7f2d24072370 0x7f2d240747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.273+0000 7f2d36ffd640 1 --2- 172.21.15.19:0/3245008145 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2d2406be30 0x7f2d2406e2f0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f2d380ae160 tx=0x7f2d28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:40.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.273+0000 7f2d377fe640 1 --2- 172.21.15.19:0/3245008145 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x7f2d24072370 0x7f2d240747b0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:40.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.274+0000 7f2d1f7fe640 1 -- 172.21.15.19:0/3245008145 <== osd.7 v2:172.21.15.135:6824/872608380 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2d2c008f00 con 0x7f2d24072370 2024-09-12T02:07:40.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.286+0000 7f2d3d7bd640 1 -- 172.21.15.19:0/3245008145 --> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2d380d0920 con 0x7f2d24072370 2024-09-12T02:07:40.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.287+0000 7f2d1f7fe640 1 -- 172.21.15.19:0/3245008145 <== osd.7 v2:172.21.15.135:6824/872608380 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2d380d0920 con 0x7f2d24072370 2024-09-12T02:07:40.288 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T02:07:40.288 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:07:40.288 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T02:07:40.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.287+0000 7f2d3d7bd640 1 -- 172.21.15.19:0/3245008145 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x7f2d24072370 msgr2=0x7f2d240747b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.287+0000 7f2d3d7bd640 1 --2- 172.21.15.19:0/3245008145 >> [v2:172.21.15.135:6824/872608380,v1:172.21.15.135:6825/872608380] conn(0x7f2d24072370 0x7f2d240747b0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.287+0000 7f2d3d7bd640 1 -- 172.21.15.19:0/3245008145 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2d2406be30 msgr2=0x7f2d2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.287+0000 7f2d3d7bd640 1 --2- 172.21.15.19:0/3245008145 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f2d2406be30 0x7f2d2406e2f0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f2d380ae160 tx=0x7f2d28009040 comp rx=0 tx=0).stop 2024-09-12T02:07:40.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.288+0000 7f2d3d7bd640 1 -- 172.21.15.19:0/3245008145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d380cf790 msgr2=0x7f2d38098d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.288+0000 7f2d3d7bd640 1 --2- 172.21.15.19:0/3245008145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d380cf790 0x7f2d38098d70 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0098a0 tx=0x7f2d2c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.288+0000 7f2d377fe640 1 -- 172.21.15.19:0/3245008145 reap_dead start 2024-09-12T02:07:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.288+0000 7f2d3d7bd640 1 -- 172.21.15.19:0/3245008145 shutdown_connections 2024-09-12T02:07:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.288+0000 7f2d3d7bd640 1 -- 172.21.15.19:0/3245008145 >> 172.21.15.19:0/3245008145 conn(0x7f2d3806bdf0 msgr2=0x7f2d3815c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.288+0000 7f2d3d7bd640 1 -- 172.21.15.19:0/3245008145 shutdown_connections 2024-09-12T02:07:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.288+0000 7f2d3d7bd640 1 -- 172.21.15.19:0/3245008145 wait complete. 2024-09-12T02:07:40.298 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T02:07:40.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.401+0000 7f8a609d8640 1 Processor -- start 2024-09-12T02:07:40.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.401+0000 7f8a609d8640 1 -- start start 2024-09-12T02:07:40.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.402+0000 7f8a609d8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8a5c15ba30 0x7f8a5c06f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.402+0000 7f8a609d8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8a5c06fd50 0x7f8a5c072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.402+0000 7f8a609d8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5c0b3570 con 0x7f8a5c072e80 2024-09-12T02:07:40.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.402+0000 7f8a609d8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8a5c0732f0 con 0x7f8a5c06fd50 2024-09-12T02:07:40.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.402+0000 7f8a609d8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f8a5c0b4180 con 0x7f8a5c15ba30 2024-09-12T02:07:40.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.402+0000 7f8a59d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8a5c06fd50 0x7f8a5c072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.402+0000 7f8a59d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8a5c06fd50 0x7f8a5c072940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50026/0 (socket says 172.21.15.19:50026) 2024-09-12T02:07:40.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.402+0000 7f8a59d9b640 1 -- 172.21.15.19:0/2108921707 learned_addr learned my addr 172.21.15.19:0/2108921707 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:40.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.402+0000 7f8a5a59c640 1 --2- 172.21.15.19:0/2108921707 >> v2:172.21.15.135:3300/0 conn(0x7f8a5c15ba30 0x7f8a5c06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.402+0000 7f8a59d9b640 1 -- 172.21.15.19:0/2108921707 >> v2:172.21.15.135:3300/0 conn(0x7f8a5c15ba30 msgr2=0x7f8a5c06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:40.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.402+0000 7f8a59d9b640 1 --2- 172.21.15.19:0/2108921707 >> v2:172.21.15.135:3300/0 conn(0x7f8a5c15ba30 0x7f8a5c06f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.402+0000 7f8a59d9b640 1 -- 172.21.15.19:0/2108921707 >> v1:172.21.15.135:6789/0 conn(0x7f8a5c072e80 legacy=0x7f8a5c06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.402+0000 7f8a59d9b640 1 -- 172.21.15.19:0/2108921707 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c0b3850 con 0x7f8a5c06fd50 2024-09-12T02:07:40.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.403+0000 7f8a59d9b640 1 --2- 172.21.15.19:0/2108921707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a5c06fd50 0x7f8a5c072940 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c06ca90 tx=0x7f8a5002b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5652e2a95e293a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:40.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.403+0000 7f8a5959a640 1 -- 172.21.15.19:0/2108921707 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5000b040 con 0x7f8a5c06fd50 2024-09-12T02:07:40.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.403+0000 7f8a5959a640 1 -- 172.21.15.19:0/2108921707 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5002be50 con 0x7f8a5c06fd50 2024-09-12T02:07:40.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.403+0000 7f8a5959a640 1 -- 172.21.15.19:0/2108921707 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50030930 con 0x7f8a5c06fd50 2024-09-12T02:07:40.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.404+0000 7f8a609d8640 1 -- 172.21.15.19:0/2108921707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a5c06fd50 msgr2=0x7f8a5c072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.404+0000 7f8a609d8640 1 --2- 172.21.15.19:0/2108921707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a5c06fd50 0x7f8a5c072940 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c06ca90 tx=0x7f8a5002b630 comp rx=0 tx=0).stop 2024-09-12T02:07:40.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.404+0000 7f8a609d8640 1 -- 172.21.15.19:0/2108921707 shutdown_connections 2024-09-12T02:07:40.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.404+0000 7f8a609d8640 1 --2- 172.21.15.19:0/2108921707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a5c06fd50 0x7f8a5c072940 unknown :-1 s=CLOSED pgs=2403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.404+0000 7f8a609d8640 1 --2- 172.21.15.19:0/2108921707 >> v2:172.21.15.135:3300/0 conn(0x7f8a5c15ba30 0x7f8a5c06f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.404+0000 7f8a609d8640 1 -- 172.21.15.19:0/2108921707 >> 172.21.15.19:0/2108921707 conn(0x7f8a5c067d70 msgr2=0x7f8a5c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:40.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.404+0000 7f8a609d8640 1 -- 172.21.15.19:0/2108921707 shutdown_connections 2024-09-12T02:07:40.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.404+0000 7f8a609d8640 1 -- 172.21.15.19:0/2108921707 wait complete. 2024-09-12T02:07:40.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.405+0000 7f8a609d8640 1 Processor -- start 2024-09-12T02:07:40.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.405+0000 7f8a609d8640 1 -- start start 2024-09-12T02:07:40.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.406+0000 7f8a609d8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a5c06fd50 0x7f8a5c0cf670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.406+0000 7f8a609d8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a5c072e80 0x7f8a5c0b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.406+0000 7f8a609d8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a5c15ba30 0x7f8a5c0b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.406+0000 7f8a609d8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c0ce810 con 0x7f8a5c15ba30 2024-09-12T02:07:40.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.406+0000 7f8a609d8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c0b3e10 con 0x7f8a5c072e80 2024-09-12T02:07:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.406+0000 7f8a609d8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8a5c0b5890 con 0x7f8a5c06fd50 2024-09-12T02:07:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.406+0000 7f8a5ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a5c15ba30 0x7f8a5c0b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.406+0000 7f8a5ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a5c15ba30 0x7f8a5c0b5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50042/0 (socket says 172.21.15.19:50042) 2024-09-12T02:07:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.406+0000 7f8a5ad9d640 1 -- 172.21.15.19:0/3366727432 learned_addr learned my addr 172.21.15.19:0/3366727432 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.406+0000 7f8a59d9b640 1 --2- 172.21.15.19:0/3366727432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a5c072e80 0x7f8a5c0b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.406+0000 7f8a5a59c640 1 --2- 172.21.15.19:0/3366727432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a5c06fd50 0x7f8a5c0cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.406+0000 7f8a5ad9d640 1 -- 172.21.15.19:0/3366727432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a5c06fd50 msgr2=0x7f8a5c0cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.406+0000 7f8a5ad9d640 1 --2- 172.21.15.19:0/3366727432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a5c06fd50 0x7f8a5c0cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.406+0000 7f8a5ad9d640 1 -- 172.21.15.19:0/3366727432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a5c072e80 msgr2=0x7f8a5c0b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.406+0000 7f8a5ad9d640 1 --2- 172.21.15.19:0/3366727432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a5c072e80 0x7f8a5c0b4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.406+0000 7f8a5ad9d640 1 -- 172.21.15.19:0/3366727432 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c1f7f80 con 0x7f8a5c15ba30 2024-09-12T02:07:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.407+0000 7f8a5ad9d640 1 --2- 172.21.15.19:0/3366727432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a5c15ba30 0x7f8a5c0b5010 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400c7d0 tx=0x7f8a5400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.407+0000 7f8a4affd640 1 -- 172.21.15.19:0/3366727432 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54003b70 con 0x7f8a5c15ba30 2024-09-12T02:07:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.407+0000 7f8a4affd640 1 -- 172.21.15.19:0/3366727432 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a54003d30 con 0x7f8a5c15ba30 2024-09-12T02:07:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.407+0000 7f8a609d8640 1 -- 172.21.15.19:0/3366727432 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a5c1f8220 con 0x7f8a5c15ba30 2024-09-12T02:07:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.407+0000 7f8a4affd640 1 -- 172.21.15.19:0/3366727432 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5400aa90 con 0x7f8a5c15ba30 2024-09-12T02:07:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.407+0000 7f8a609d8640 1 -- 172.21.15.19:0/3366727432 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a5c1f4470 con 0x7f8a5c15ba30 2024-09-12T02:07:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.408+0000 7f8a609d8640 1 -- 172.21.15.19:0/3366727432 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a5c1f3f80 con 0x7f8a5c15ba30 2024-09-12T02:07:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.408+0000 7f8a4affd640 1 -- 172.21.15.19:0/3366727432 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a5400ac30 con 0x7f8a5c15ba30 2024-09-12T02:07:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.409+0000 7f8a4affd640 1 --2- 172.21.15.19:0/3366727432 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a3c06be30 0x7f8a3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.409+0000 7f8a4affd640 1 -- 172.21.15.19:0/3366727432 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7f8a5408aa70 con 0x7f8a5c15ba30 2024-09-12T02:07:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.409+0000 7f8a5a59c640 1 --2- 172.21.15.19:0/3366727432 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a3c06be30 0x7f8a3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.410+0000 7f8a5a59c640 1 --2- 172.21.15.19:0/3366727432 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a3c06be30 0x7f8a3c06e2f0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c1571c0 tx=0x7f8a4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.413+0000 7f8a4affd640 1 -- 172.21.15.19:0/3366727432 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a54058f80 con 0x7f8a5c15ba30 2024-09-12T02:07:40.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.588+0000 7f8a609d8640 1 -- 172.21.15.19:0/3366727432 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f8a5c0cf450 con 0x7f8a3c06be30 2024-09-12T02:07:40.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.588+0000 7f8a4affd640 1 -- 172.21.15.19:0/3366727432 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8a5c0cf450 con 0x7f8a3c06be30 2024-09-12T02:07:40.589 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T02:07:40.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.590+0000 7f8a609d8640 1 -- 172.21.15.19:0/3366727432 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a3c06be30 msgr2=0x7f8a3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.590+0000 7f8a609d8640 1 --2- 172.21.15.19:0/3366727432 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a3c06be30 0x7f8a3c06e2f0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c1571c0 tx=0x7f8a4c008040 comp rx=0 tx=0).stop 2024-09-12T02:07:40.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.590+0000 7f8a609d8640 1 -- 172.21.15.19:0/3366727432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a5c15ba30 msgr2=0x7f8a5c0b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.590+0000 7f8a609d8640 1 --2- 172.21.15.19:0/3366727432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a5c15ba30 0x7f8a5c0b5010 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400c7d0 tx=0x7f8a5400cc90 comp rx=0 tx=0).stop 2024-09-12T02:07:40.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.590+0000 7f8a609d8640 1 -- 172.21.15.19:0/3366727432 shutdown_connections 2024-09-12T02:07:40.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.590+0000 7f8a609d8640 1 --2- 172.21.15.19:0/3366727432 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f8a3c06be30 0x7f8a3c06e2f0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.590+0000 7f8a609d8640 1 --2- 172.21.15.19:0/3366727432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a5c15ba30 0x7f8a5c0b5010 unknown :-1 s=CLOSED pgs=2404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.590+0000 7f8a609d8640 1 --2- 172.21.15.19:0/3366727432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a5c072e80 0x7f8a5c0b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.590+0000 7f8a609d8640 1 --2- 172.21.15.19:0/3366727432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a5c06fd50 0x7f8a5c0cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.590+0000 7f8a609d8640 1 -- 172.21.15.19:0/3366727432 >> 172.21.15.19:0/3366727432 conn(0x7f8a5c067d70 msgr2=0x7f8a5c0b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.590+0000 7f8a609d8640 1 -- 172.21.15.19:0/3366727432 shutdown_connections 2024-09-12T02:07:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.590+0000 7f8a609d8640 1 -- 172.21.15.19:0/3366727432 wait complete. 2024-09-12T02:07:40.601 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:07:40.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.703+0000 7fb39bf52640 1 Processor -- start 2024-09-12T02:07:40.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.703+0000 7fb39bf52640 1 -- start start 2024-09-12T02:07:40.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb39bf52640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3940cfcc0 0x7fb39406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb39bf52640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb3940d4fd0 0x7fb3940d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb39bf52640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3940d2700 con 0x7fb39415e760 2024-09-12T02:07:40.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb39bf52640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb3940cedb0 con 0x7fb3940d4fd0 2024-09-12T02:07:40.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb39bf52640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb3940cf090 con 0x7fb3940cfcc0 2024-09-12T02:07:40.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb399cee640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb39415e760 0x7fb3940cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57790/0 (socket says 172.21.15.19:57790) 2024-09-12T02:07:40.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb399cee640 1 -- 172.21.15.19:0/4061953708 learned_addr learned my addr 172.21.15.19:0/4061953708 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:07:40.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb398cec640 1 -- 172.21.15.19:0/4061953708 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884875030 0 0) 0x7fb390001110 con 0x7fb39415e760 2024-09-12T02:07:40.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb398cec640 1 -- 172.21.15.19:0/4061953708 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb380003520 con 0x7fb39415e760 2024-09-12T02:07:40.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb39a4ef640 1 --2- 172.21.15.19:0/4061953708 >> v2:172.21.15.135:3300/0 conn(0x7fb3940d4fd0 0x7fb3940d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb3994ed640 1 --2- 172.21.15.19:0/4061953708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3940cfcc0 0x7fb39406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb398cec640 1 -- 172.21.15.19:0/4061953708 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2182281308 0 0) 0x7fb380003520 con 0x7fb39415e760 2024-09-12T02:07:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb398cec640 1 -- 172.21.15.19:0/4061953708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3940cfcc0 msgr2=0x7fb39406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb398cec640 1 --2- 172.21.15.19:0/4061953708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3940cfcc0 0x7fb39406cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb398cec640 1 -- 172.21.15.19:0/4061953708 >> v2:172.21.15.135:3300/0 conn(0x7fb3940d4fd0 msgr2=0x7fb3940d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb398cec640 1 --2- 172.21.15.19:0/4061953708 >> v2:172.21.15.135:3300/0 conn(0x7fb3940d4fd0 0x7fb3940d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb398cec640 1 -- 172.21.15.19:0/4061953708 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3940b3c80 con 0x7fb39415e760 2024-09-12T02:07:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb398cec640 1 -- 172.21.15.19:0/4061953708 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7fb390001840 con 0x7fb39415e760 2024-09-12T02:07:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb3994ed640 1 --2- 172.21.15.19:0/4061953708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3940cfcc0 0x7fb39406cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb398cec640 1 -- 172.21.15.19:0/4061953708 >> v1:172.21.15.19:6789/0 conn(0x7fb39415e760 legacy=0x7fb3940cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb398cec640 1 --2- 172.21.15.19:0/4061953708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3940cfcc0 0x7fb3800039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb398cec640 1 --2- 172.21.15.19:0/4061953708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb380003ef0 0x7fb380004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb398cec640 1 --2- 172.21.15.19:0/4061953708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb380004d40 0x7fb3800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb398cec640 1 -- 172.21.15.19:0/4061953708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb3940cedb0 con 0x7fb380004d40 2024-09-12T02:07:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb398cec640 1 -- 172.21.15.19:0/4061953708 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb3940cf090 con 0x7fb380003ef0 2024-09-12T02:07:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.704+0000 7fb398cec640 1 -- 172.21.15.19:0/4061953708 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb38000b9f0 con 0x7fb3940cfcc0 2024-09-12T02:07:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.705+0000 7fb39a4ef640 1 --2- 172.21.15.19:0/4061953708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb380004d40 0x7fb3800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.705+0000 7fb399cee640 1 --2- 172.21.15.19:0/4061953708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3940cfcc0 0x7fb3800039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.705+0000 7fb3994ed640 1 --2- 172.21.15.19:0/4061953708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb380003ef0 0x7fb380004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.705+0000 7fb39a4ef640 1 -- 172.21.15.19:0/4061953708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3940cfcc0 msgr2=0x7fb3800039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.705+0000 7fb39a4ef640 1 --2- 172.21.15.19:0/4061953708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3940cfcc0 0x7fb3800039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.705+0000 7fb39a4ef640 1 -- 172.21.15.19:0/4061953708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb380003ef0 msgr2=0x7fb380004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.705+0000 7fb39a4ef640 1 --2- 172.21.15.19:0/4061953708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb380003ef0 0x7fb380004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.705+0000 7fb39a4ef640 1 -- 172.21.15.19:0/4061953708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb380003520 con 0x7fb380004d40 2024-09-12T02:07:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.705+0000 7fb399cee640 1 --2- 172.21.15.19:0/4061953708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3940cfcc0 0x7fb3800039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.705+0000 7fb3994ed640 1 --2- 172.21.15.19:0/4061953708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb380003ef0 0x7fb380004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.706+0000 7fb39a4ef640 1 --2- 172.21.15.19:0/4061953708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb380004d40 0x7fb3800051c0 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7fb38c009fc0 tx=0x7fb380005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55202b139158cc0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.706+0000 7fb398cec640 1 -- 172.21.15.19:0/4061953708 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38c009c10 con 0x7fb380004d40 2024-09-12T02:07:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.706+0000 7fb398cec640 1 -- 172.21.15.19:0/4061953708 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb38c036070 con 0x7fb380004d40 2024-09-12T02:07:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.706+0000 7fb398cec640 1 -- 172.21.15.19:0/4061953708 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38c02d070 con 0x7fb380004d40 2024-09-12T02:07:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.706+0000 7fb39bf52640 1 -- 172.21.15.19:0/4061953708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb380004d40 msgr2=0x7fb3800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.706+0000 7fb39bf52640 1 --2- 172.21.15.19:0/4061953708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb380004d40 0x7fb3800051c0 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7fb38c009fc0 tx=0x7fb380005830 comp rx=0 tx=0).stop 2024-09-12T02:07:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.706+0000 7fb39a4ef640 1 -- 172.21.15.19:0/4061953708 reap_dead start 2024-09-12T02:07:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.706+0000 7fb39bf52640 1 -- 172.21.15.19:0/4061953708 shutdown_connections 2024-09-12T02:07:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.706+0000 7fb39bf52640 1 -- 172.21.15.19:0/4061953708 >> 172.21.15.19:0/4061953708 conn(0x7fb39408bfc0 msgr2=0x7fb3940d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.706+0000 7fb39bf52640 1 -- 172.21.15.19:0/4061953708 shutdown_connections 2024-09-12T02:07:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.706+0000 7fb39bf52640 1 -- 172.21.15.19:0/4061953708 wait complete. 2024-09-12T02:07:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.708+0000 7fb39bf52640 1 Processor -- start 2024-09-12T02:07:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.708+0000 7fb39bf52640 1 -- start start 2024-09-12T02:07:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.708+0000 7fb39bf52640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb380004d40 0x7fb3940b9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.708+0000 7fb39bf52640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3940b3e50 0x7fb3940b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.708+0000 7fb39bf52640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3940b4810 0x7fb3940b8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.708+0000 7fb39bf52640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb39406cdd0 con 0x7fb380004d40 2024-09-12T02:07:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.708+0000 7fb39bf52640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb3940b3860 con 0x7fb3940b3e50 2024-09-12T02:07:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.708+0000 7fb39bf52640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb39406cf50 con 0x7fb3940b4810 2024-09-12T02:07:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.708+0000 7fb399cee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb380004d40 0x7fb3940b9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.708+0000 7fb399cee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb380004d40 0x7fb3940b9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50060/0 (socket says 172.21.15.19:50060) 2024-09-12T02:07:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.708+0000 7fb399cee640 1 -- 172.21.15.19:0/2164306937 learned_addr learned my addr 172.21.15.19:0/2164306937 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:07:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.709+0000 7fb399cee640 1 -- 172.21.15.19:0/2164306937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3940b4810 msgr2=0x7fb3940b8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.709+0000 7fb399cee640 1 --2- 172.21.15.19:0/2164306937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3940b4810 0x7fb3940b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.709+0000 7fb399cee640 1 -- 172.21.15.19:0/2164306937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3940b3e50 msgr2=0x7fb3940b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.709+0000 7fb399cee640 1 --2- 172.21.15.19:0/2164306937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3940b3e50 0x7fb3940b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.709+0000 7fb399cee640 1 -- 172.21.15.19:0/2164306937 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3941572d0 con 0x7fb380004d40 2024-09-12T02:07:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.709+0000 7fb399cee640 1 --2- 172.21.15.19:0/2164306937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb380004d40 0x7fb3940b9e00 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7fb3900072b0 tx=0x7fb390007770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.709+0000 7fb38a7fc640 1 -- 172.21.15.19:0/2164306937 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39000e8d0 con 0x7fb380004d40 2024-09-12T02:07:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.709+0000 7fb38a7fc640 1 -- 172.21.15.19:0/2164306937 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb390018070 con 0x7fb380004d40 2024-09-12T02:07:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.709+0000 7fb39bf52640 1 -- 172.21.15.19:0/2164306937 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3940b4c90 con 0x7fb380004d40 2024-09-12T02:07:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.709+0000 7fb38a7fc640 1 -- 172.21.15.19:0/2164306937 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39000ec70 con 0x7fb380004d40 2024-09-12T02:07:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.709+0000 7fb39bf52640 1 -- 172.21.15.19:0/2164306937 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3940b74b0 con 0x7fb380004d40 2024-09-12T02:07:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.710+0000 7fb39bf52640 1 -- 172.21.15.19:0/2164306937 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3940b6d20 con 0x7fb380004d40 2024-09-12T02:07:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.711+0000 7fb38a7fc640 1 -- 172.21.15.19:0/2164306937 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb39001d460 con 0x7fb380004d40 2024-09-12T02:07:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.711+0000 7fb38a7fc640 1 --2- 172.21.15.19:0/2164306937 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb37806be30 0x7fb37806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.711+0000 7fb38a7fc640 1 -- 172.21.15.19:0/2164306937 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7fb39008ad80 con 0x7fb380004d40 2024-09-12T02:07:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.711+0000 7fb3994ed640 1 --2- 172.21.15.19:0/2164306937 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb37806be30 0x7fb37806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.712+0000 7fb3994ed640 1 --2- 172.21.15.19:0/2164306937 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb37806be30 0x7fb37806e2f0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fb384006ab0 tx=0x7fb384006a40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:40.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.715+0000 7fb38a7fc640 1 -- 172.21.15.19:0/2164306937 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb3940d2700 con 0x7fb380004d40 2024-09-12T02:07:40.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.886+0000 7fb39bf52640 1 -- 172.21.15.19:0/2164306937 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb3940b1640 con 0x7fb37806be30 2024-09-12T02:07:40.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.888+0000 7fb38a7fc640 1 -- 172.21.15.19:0/2164306937 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13375 (secure 0 0 0) 0x7fb3940b1640 con 0x7fb37806be30 2024-09-12T02:07:40.888 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:07:40.889 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T02:07:40.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.890+0000 7fb39bf52640 1 -- 172.21.15.19:0/2164306937 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb37806be30 msgr2=0x7fb37806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.890+0000 7fb39bf52640 1 --2- 172.21.15.19:0/2164306937 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb37806be30 0x7fb37806e2f0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fb384006ab0 tx=0x7fb384006a40 comp rx=0 tx=0).stop 2024-09-12T02:07:40.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.890+0000 7fb39bf52640 1 -- 172.21.15.19:0/2164306937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb380004d40 msgr2=0x7fb3940b9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.890+0000 7fb39bf52640 1 --2- 172.21.15.19:0/2164306937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb380004d40 0x7fb3940b9e00 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7fb3900072b0 tx=0x7fb390007770 comp rx=0 tx=0).stop 2024-09-12T02:07:40.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.890+0000 7fb39bf52640 1 -- 172.21.15.19:0/2164306937 shutdown_connections 2024-09-12T02:07:40.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.890+0000 7fb39bf52640 1 --2- 172.21.15.19:0/2164306937 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb37806be30 0x7fb37806e2f0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.890+0000 7fb39bf52640 1 --2- 172.21.15.19:0/2164306937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3940b4810 0x7fb3940b8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.890+0000 7fb39bf52640 1 --2- 172.21.15.19:0/2164306937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3940b3e50 0x7fb3940b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.890+0000 7fb39bf52640 1 --2- 172.21.15.19:0/2164306937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb380004d40 0x7fb3940b9e00 unknown :-1 s=CLOSED pgs=2407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.890+0000 7fb39bf52640 1 -- 172.21.15.19:0/2164306937 >> 172.21.15.19:0/2164306937 conn(0x7fb39408bfc0 msgr2=0x7fb39406d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:40.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.890+0000 7fb39bf52640 1 -- 172.21.15.19:0/2164306937 shutdown_connections 2024-09-12T02:07:40.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:07:40.890+0000 7fb39bf52640 1 -- 172.21.15.19:0/2164306937 wait complete. 2024-09-12T02:07:40.901 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":501,"stamp":"2024-09-12T02:07:40.260098+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":299100,"kb_used_data":16296,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754675620,"statfs":{"total":773094113280,"available":772787834880,"internally_reserved":0,"allocated":16687104,"data_stored":9032936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.441351"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":415,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.845683+0000","last_change":"2024-09-12T01:55:46.355900+0000","last_active":"2024-09-12T02:07:32.845683+0000","last_peered":"2024-09-12T02:07:32.845683+0000","last_clean":"2024-09-12T02:07:32.845683+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T02:07:32.845683+0000","last_undegraded":"2024-09-12T02:07:32.845683+0000","last_fullsized":"2024-09-12T02:07:32.845683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:44.562604+0000","last_clean_scrub_stamp":"2024-09-12T01:55:44.562604+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:01.328097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509587,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37824,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334016,"statfs":{"total":96636764160,"available":96598032384,"internally_reserved":0,"allocated":2531328,"data_stored":1571893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509586,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41400,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330440,"statfs":{"total":96636764160,"available":96594370560,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509587,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33084,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542291,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33084,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542291,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37240,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334600,"statfs":{"total":96636764160,"available":96598630400,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542291,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37244,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334596,"statfs":{"total":96636764160,"available":96598626304,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542291,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41984,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329856,"statfs":{"total":96636764160,"available":96593772544,"internally_reserved":0,"allocated":2531328,"data_stored":1571893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37240,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334600,"statfs":{"total":96636764160,"available":96598630400,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:07:40.906 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T01:55:44.562604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=55, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=7, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:40.906 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T02:07:56.421 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:07:56.424 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:08:00.907 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:08:01.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.022+0000 7f3160a1e640 1 Processor -- start 2024-09-12T02:08:01.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.022+0000 7f3160a1e640 1 -- start start 2024-09-12T02:08:01.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.023+0000 7f3160a1e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f315c161c80 0x7f315c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.023+0000 7f3160a1e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315c06e870 con 0x7f315c0b6680 2024-09-12T02:08:01.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.023+0000 7f3160a1e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315c06d9f0 con 0x7f315c162060 2024-09-12T02:08:01.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.023+0000 7f3160a1e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f315c06dcd0 con 0x7f315c161c80 2024-09-12T02:08:01.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.023+0000 7f315ad9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f315c0b6680 0x7f315c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37508/0 (socket says 172.21.15.19:37508) 2024-09-12T02:08:01.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f315ad9d640 1 -- 172.21.15.19:0/629439923 learned_addr learned my addr 172.21.15.19:0/629439923 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:08:01.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f315a59c640 1 --2- 172.21.15.19:0/629439923 >> v2:172.21.15.135:3300/0 conn(0x7f315c161c80 0x7f315c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f315959a640 1 -- 172.21.15.19:0/629439923 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1298486191 0 0) 0x7f3154001490 con 0x7f315c0b6680 2024-09-12T02:08:01.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f315959a640 1 -- 172.21.15.19:0/629439923 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3144003520 con 0x7f315c0b6680 2024-09-12T02:08:01.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f315959a640 1 -- 172.21.15.19:0/629439923 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3173945731 0 0) 0x7f3144003520 con 0x7f315c0b6680 2024-09-12T02:08:01.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f315959a640 1 -- 172.21.15.19:0/629439923 >> v2:172.21.15.135:3300/0 conn(0x7f315c161c80 msgr2=0x7f315c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:01.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f315959a640 1 --2- 172.21.15.19:0/629439923 >> v2:172.21.15.135:3300/0 conn(0x7f315c161c80 0x7f315c06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f315959a640 1 -- 172.21.15.19:0/629439923 >> v1:172.21.15.135:6789/0 conn(0x7f315c162060 legacy=0x7f315c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f315959a640 1 -- 172.21.15.19:0/629439923 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c06dfb0 con 0x7f315c0b6680 2024-09-12T02:08:01.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f315959a640 1 -- 172.21.15.19:0/629439923 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3275645217 0 0) 0x7f3154001bc0 con 0x7f315c0b6680 2024-09-12T02:08:01.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f315959a640 1 -- 172.21.15.19:0/629439923 >> v1:172.21.15.19:6789/0 conn(0x7f315c0b6680 legacy=0x7f315c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f315959a640 1 --2- 172.21.15.19:0/629439923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31440039b0 0x7f3144003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f315959a640 1 --2- 172.21.15.19:0/629439923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3144004800 0x7f3144004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f315959a640 1 --2- 172.21.15.19:0/629439923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31440051c0 0x7f314400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f315959a640 1 -- 172.21.15.19:0/629439923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f315c06dcd0 con 0x7f3144004800 2024-09-12T02:08:01.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f315959a640 1 -- 172.21.15.19:0/629439923 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f314400c060 con 0x7f31440039b0 2024-09-12T02:08:01.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f315959a640 1 -- 172.21.15.19:0/629439923 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f314400c260 con 0x7f31440051c0 2024-09-12T02:08:01.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f3159d9b640 1 --2- 172.21.15.19:0/629439923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3144004800 0x7f3144004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.024+0000 7f315a59c640 1 --2- 172.21.15.19:0/629439923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31440039b0 0x7f3144003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.025+0000 7f315ad9d640 1 --2- 172.21.15.19:0/629439923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31440051c0 0x7f314400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.025+0000 7f3159d9b640 1 -- 172.21.15.19:0/629439923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31440051c0 msgr2=0x7f314400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:01.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.025+0000 7f3159d9b640 1 --2- 172.21.15.19:0/629439923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31440051c0 0x7f314400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.025+0000 7f3159d9b640 1 -- 172.21.15.19:0/629439923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31440039b0 msgr2=0x7f3144003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:01.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.025+0000 7f3159d9b640 1 --2- 172.21.15.19:0/629439923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31440039b0 0x7f3144003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.025+0000 7f3159d9b640 1 -- 172.21.15.19:0/629439923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3144003520 con 0x7f3144004800 2024-09-12T02:08:01.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.025+0000 7f315ad9d640 1 -- 172.21.15.19:0/629439923 reap_dead start 2024-09-12T02:08:01.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.025+0000 7f3159d9b640 1 --2- 172.21.15.19:0/629439923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3144004800 0x7f3144004c80 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f3150001720 tx=0x7f3144005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1fa11af6959b593 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:01.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.025+0000 7f315959a640 1 -- 172.21.15.19:0/629439923 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3150001370 con 0x7f3144004800 2024-09-12T02:08:01.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.026+0000 7f315959a640 1 -- 172.21.15.19:0/629439923 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31500052d0 con 0x7f3144004800 2024-09-12T02:08:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.026+0000 7f315959a640 1 -- 172.21.15.19:0/629439923 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315002abc0 con 0x7f3144004800 2024-09-12T02:08:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.026+0000 7f3160a1e640 1 -- 172.21.15.19:0/629439923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3144004800 msgr2=0x7f3144004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.026+0000 7f3160a1e640 1 --2- 172.21.15.19:0/629439923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3144004800 0x7f3144004c80 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f3150001720 tx=0x7f3144005830 comp rx=0 tx=0).stop 2024-09-12T02:08:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.026+0000 7f3160a1e640 1 -- 172.21.15.19:0/629439923 shutdown_connections 2024-09-12T02:08:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.026+0000 7f3160a1e640 1 --2- 172.21.15.19:0/629439923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3144004800 0x7f3144004c80 unknown :-1 s=CLOSED pgs=2409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.026+0000 7f3160a1e640 1 -- 172.21.15.19:0/629439923 >> 172.21.15.19:0/629439923 conn(0x7f315c0d44f0 msgr2=0x7f315c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.026+0000 7f3160a1e640 1 -- 172.21.15.19:0/629439923 shutdown_connections 2024-09-12T02:08:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.026+0000 7f3160a1e640 1 -- 172.21.15.19:0/629439923 wait complete. 2024-09-12T02:08:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.028+0000 7f3160a1e640 1 Processor -- start 2024-09-12T02:08:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.028+0000 7f3160a1e640 1 -- start start 2024-09-12T02:08:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.028+0000 7f3160a1e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3144004800 0x7f315c15aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.028+0000 7f3160a1e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315c156440 0x7f315c0b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.028+0000 7f3160a1e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f315c0b7880 0x7f315c15eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.028+0000 7f3160a1e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f315c0b6b30 con 0x7f315c0b7880 2024-09-12T02:08:01.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.028+0000 7f3160a1e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f315c0d2aa0 con 0x7f315c156440 2024-09-12T02:08:01.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.028+0000 7f3160a1e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f315c0b6cb0 con 0x7f3144004800 2024-09-12T02:08:01.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.029+0000 7f315ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f315c0b7880 0x7f315c15eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.029+0000 7f315ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f315c0b7880 0x7f315c15eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44480/0 (socket says 172.21.15.19:44480) 2024-09-12T02:08:01.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.029+0000 7f315ad9d640 1 -- 172.21.15.19:0/616757251 learned_addr learned my addr 172.21.15.19:0/616757251 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:08:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.029+0000 7f3159d9b640 1 --2- 172.21.15.19:0/616757251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315c156440 0x7f315c0b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.029+0000 7f315a59c640 1 --2- 172.21.15.19:0/616757251 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3144004800 0x7f315c15aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.029+0000 7f315ad9d640 1 -- 172.21.15.19:0/616757251 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3144004800 msgr2=0x7f315c15aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.029+0000 7f315ad9d640 1 --2- 172.21.15.19:0/616757251 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3144004800 0x7f315c15aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.029+0000 7f315ad9d640 1 -- 172.21.15.19:0/616757251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315c156440 msgr2=0x7f315c0b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.029+0000 7f315ad9d640 1 --2- 172.21.15.19:0/616757251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315c156440 0x7f315c0b7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.029+0000 7f315ad9d640 1 -- 172.21.15.19:0/616757251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c15d290 con 0x7f315c0b7880 2024-09-12T02:08:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.029+0000 7f315ad9d640 1 --2- 172.21.15.19:0/616757251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f315c0b7880 0x7f315c15eaa0 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7f315c074250 tx=0x7f3154007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.029+0000 7f314affd640 1 -- 172.21.15.19:0/616757251 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3154017020 con 0x7f315c0b7880 2024-09-12T02:08:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.029+0000 7f314affd640 1 -- 172.21.15.19:0/616757251 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f315400e9e0 con 0x7f315c0b7880 2024-09-12T02:08:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.029+0000 7f314affd640 1 -- 172.21.15.19:0/616757251 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315400ee10 con 0x7f315c0b7880 2024-09-12T02:08:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.029+0000 7f3160a1e640 1 -- 172.21.15.19:0/616757251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315c1e9710 con 0x7f315c0b7880 2024-09-12T02:08:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.029+0000 7f3160a1e640 1 -- 172.21.15.19:0/616757251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315c1e9cd0 con 0x7f315c0b7880 2024-09-12T02:08:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.030+0000 7f3160a1e640 1 -- 172.21.15.19:0/616757251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315c06e330 con 0x7f315c0b7880 2024-09-12T02:08:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.031+0000 7f314affd640 1 -- 172.21.15.19:0/616757251 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f315401a020 con 0x7f315c0b7880 2024-09-12T02:08:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.031+0000 7f314affd640 1 --2- 172.21.15.19:0/616757251 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f313c06be30 0x7f313c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.031+0000 7f314affd640 1 -- 172.21.15.19:0/616757251 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7f315408ac00 con 0x7f315c0b7880 2024-09-12T02:08:01.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.032+0000 7f315a59c640 1 --2- 172.21.15.19:0/616757251 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f313c06be30 0x7f313c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.032+0000 7f315a59c640 1 --2- 172.21.15.19:0/616757251 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f313c06be30 0x7f313c06e2f0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f315c15a060 tx=0x7f314c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:01.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.036+0000 7f314affd640 1 -- 172.21.15.19:0/616757251 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3154091080 con 0x7f315c0b7880 2024-09-12T02:08:01.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.210+0000 7f3160a1e640 1 -- 172.21.15.19:0/616757251 --> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f315c0ba470 con 0x7f313c06be30 2024-09-12T02:08:01.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.211+0000 7f314affd640 1 -- 172.21.15.19:0/616757251 <== mgr.4105 v2:172.21.15.135:6832/1305006827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13379 (secure 0 0 0) 0x7f315c0ba470 con 0x7f313c06be30 2024-09-12T02:08:01.212 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:08:01.212 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T02:08:01.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.214+0000 7f3160a1e640 1 -- 172.21.15.19:0/616757251 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f313c06be30 msgr2=0x7f313c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.214+0000 7f3160a1e640 1 --2- 172.21.15.19:0/616757251 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f313c06be30 0x7f313c06e2f0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f315c15a060 tx=0x7f314c009190 comp rx=0 tx=0).stop 2024-09-12T02:08:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.214+0000 7f3160a1e640 1 -- 172.21.15.19:0/616757251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f315c0b7880 msgr2=0x7f315c15eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.214+0000 7f3160a1e640 1 --2- 172.21.15.19:0/616757251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f315c0b7880 0x7f315c15eaa0 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7f315c074250 tx=0x7f3154007ab0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.214+0000 7f3160a1e640 1 -- 172.21.15.19:0/616757251 shutdown_connections 2024-09-12T02:08:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.214+0000 7f3160a1e640 1 --2- 172.21.15.19:0/616757251 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f313c06be30 0x7f313c06e2f0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.214+0000 7f3160a1e640 1 --2- 172.21.15.19:0/616757251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f315c0b7880 0x7f315c15eaa0 unknown :-1 s=CLOSED pgs=2410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.214+0000 7f3160a1e640 1 --2- 172.21.15.19:0/616757251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315c156440 0x7f315c0b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.214+0000 7f3160a1e640 1 --2- 172.21.15.19:0/616757251 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3144004800 0x7f315c15aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.214+0000 7f3160a1e640 1 -- 172.21.15.19:0/616757251 >> 172.21.15.19:0/616757251 conn(0x7f315c0d44f0 msgr2=0x7f315c15fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.214+0000 7f3160a1e640 1 -- 172.21.15.19:0/616757251 shutdown_connections 2024-09-12T02:08:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.214+0000 7f3160a1e640 1 -- 172.21.15.19:0/616757251 wait complete. 2024-09-12T02:08:01.225 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":511,"stamp":"2024-09-12T02:08:00.264154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":299084,"kb_used_data":16296,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754675636,"statfs":{"total":773094113280,"available":772787851264,"internally_reserved":0,"allocated":16687104,"data_stored":9032936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002536"},"pg_stats":[{"pgid":"1.0","version":"149'119","reported_seq":427,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-12T02:07:41.556366+0000","last_change":"2024-09-12T02:07:41.556366+0000","last_active":"2024-09-12T02:07:41.556366+0000","last_peered":"2024-09-12T02:07:41.556366+0000","last_clean":"2024-09-12T02:07:41.556366+0000","last_became_active":"2024-09-12T01:55:46.355535+0000","last_became_peered":"2024-09-12T01:55:46.355535+0000","last_unstale":"2024-09-12T02:07:41.556366+0000","last_undegraded":"2024-09-12T02:07:41.556366+0000","last_fullsized":"2024-09-12T02:07:41.556366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"149'119","last_scrub_stamp":"2024-09-12T02:07:41.556235+0000","last_deep_scrub":"149'119","last_deep_scrub_stamp":"2024-09-12T02:07:41.556235+0000","last_clean_scrub_stamp":"2024-09-12T02:07:41.556235+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:54.049856+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509591,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37816,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334024,"statfs":{"total":96636764160,"available":96598040576,"internally_reserved":0,"allocated":2531328,"data_stored":1571893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509590,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41400,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330440,"statfs":{"total":96636764160,"available":96594370560,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33084,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542295,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33084,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542295,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37240,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334600,"statfs":{"total":96636764160,"available":96598630400,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542295,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37244,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334596,"statfs":{"total":96636764160,"available":96598626304,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542295,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41976,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329864,"statfs":{"total":96636764160,"available":96593780736,"internally_reserved":0,"allocated":2531328,"data_stored":1571893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37240,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334600,"statfs":{"total":96636764160,"available":96598630400,"internally_reserved":0,"allocated":1937408,"data_stored":981525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:08:01.226 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T02:08:01.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.328+0000 7fb239dd6640 1 Processor -- start 2024-09-12T02:08:01.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.328+0000 7fb239dd6640 1 -- start start 2024-09-12T02:08:01.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.328+0000 7fb239dd6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb234162340 0x7fb23406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.328+0000 7fb239dd6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23415ff70 con 0x7fb234162e30 2024-09-12T02:08:01.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.328+0000 7fb239dd6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2340d4d10 con 0x7fb2340cf280 2024-09-12T02:08:01.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.328+0000 7fb239dd6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb2341632a0 con 0x7fb234162340 2024-09-12T02:08:01.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.329+0000 7fb2337fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb234162340 0x7fb23406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.329+0000 7fb233fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb234162e30 0x7fb2340d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60962/0 (socket says 172.21.15.19:60962) 2024-09-12T02:08:01.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.329+0000 7fb233fff640 1 -- 172.21.15.19:0/3286796620 learned_addr learned my addr 172.21.15.19:0/3286796620 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:08:01.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.329+0000 7fb2337fe640 1 -- 172.21.15.19:0/3286796620 >> v1:172.21.15.135:6789/0 conn(0x7fb2340cf280 legacy=0x7fb234162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:01.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.329+0000 7fb2337fe640 1 -- 172.21.15.19:0/3286796620 >> v1:172.21.15.19:6789/0 conn(0x7fb234162e30 legacy=0x7fb2340d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.329+0000 7fb2327fc640 1 -- 172.21.15.19:0/3286796620 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4226100587 0 0) 0x7fb23415ff70 con 0x7fb234162e30 2024-09-12T02:08:01.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.329+0000 7fb2337fe640 1 -- 172.21.15.19:0/3286796620 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2340d4ff0 con 0x7fb234162340 2024-09-12T02:08:01.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.330+0000 7fb2337fe640 1 --2- 172.21.15.19:0/3286796620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb234162340 0x7fb23406d740 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7fb2240097a0 tx=0x7fb22402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4f1807fc29cd86 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:01.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.330+0000 7fb2327fc640 1 -- 172.21.15.19:0/3286796620 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224037070 con 0x7fb234162340 2024-09-12T02:08:01.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.330+0000 7fb2327fc640 1 -- 172.21.15.19:0/3286796620 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22402ae50 con 0x7fb234162340 2024-09-12T02:08:01.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.330+0000 7fb2327fc640 1 -- 172.21.15.19:0/3286796620 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224032660 con 0x7fb234162340 2024-09-12T02:08:01.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.330+0000 7fb239dd6640 1 -- 172.21.15.19:0/3286796620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb234162340 msgr2=0x7fb23406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.330+0000 7fb239dd6640 1 --2- 172.21.15.19:0/3286796620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb234162340 0x7fb23406d740 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7fb2240097a0 tx=0x7fb22402a140 comp rx=0 tx=0).stop 2024-09-12T02:08:01.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.330+0000 7fb239dd6640 1 -- 172.21.15.19:0/3286796620 shutdown_connections 2024-09-12T02:08:01.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.330+0000 7fb239dd6640 1 --2- 172.21.15.19:0/3286796620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb234162340 0x7fb23406d740 unknown :-1 s=CLOSED pgs=2412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.330+0000 7fb239dd6640 1 -- 172.21.15.19:0/3286796620 >> 172.21.15.19:0/3286796620 conn(0x7fb23408bfc0 msgr2=0x7fb2340d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:01.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.330+0000 7fb239dd6640 1 -- 172.21.15.19:0/3286796620 shutdown_connections 2024-09-12T02:08:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.331+0000 7fb239dd6640 1 -- 172.21.15.19:0/3286796620 wait complete. 2024-09-12T02:08:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.332+0000 7fb239dd6640 1 Processor -- start 2024-09-12T02:08:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.332+0000 7fb239dd6640 1 -- start start 2024-09-12T02:08:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb239dd6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2340cf280 0x7fb2340b9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb239dd6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb234162340 0x7fb2341f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb239dd6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb234162e30 0x7fb234151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb239dd6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb2340d52d0 con 0x7fb234162e30 2024-09-12T02:08:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb239dd6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb23406de90 con 0x7fb2340cf280 2024-09-12T02:08:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb239dd6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb2340cf6c0 con 0x7fb234162340 2024-09-12T02:08:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb233fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb234162e30 0x7fb234151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb233fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb234162e30 0x7fb234151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37680/0 (socket says 172.21.15.19:37680) 2024-09-12T02:08:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb233fff640 1 -- 172.21.15.19:0/2195211277 learned_addr learned my addr 172.21.15.19:0/2195211277 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:08:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb232ffd640 1 --2- 172.21.15.19:0/2195211277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb234162340 0x7fb2341f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb2337fe640 1 --2- 172.21.15.19:0/2195211277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2340cf280 0x7fb2340b9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb233fff640 1 -- 172.21.15.19:0/2195211277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb234162340 msgr2=0x7fb2341f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb233fff640 1 --2- 172.21.15.19:0/2195211277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb234162340 0x7fb2341f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb233fff640 1 -- 172.21.15.19:0/2195211277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2340cf280 msgr2=0x7fb2340b9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb233fff640 1 --2- 172.21.15.19:0/2195211277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2340cf280 0x7fb2340b9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb233fff640 1 -- 172.21.15.19:0/2195211277 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2340b73a0 con 0x7fb234162e30 2024-09-12T02:08:01.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb233fff640 1 --2- 172.21.15.19:0/2195211277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb234162e30 0x7fb234151810 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00c700 tx=0x7fb22c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:01.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb21bfff640 1 -- 172.21.15.19:0/2195211277 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c018070 con 0x7fb234162e30 2024-09-12T02:08:01.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb21bfff640 1 -- 172.21.15.19:0/2195211277 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22c00ce10 con 0x7fb234162e30 2024-09-12T02:08:01.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb239dd6640 1 -- 172.21.15.19:0/2195211277 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2340b7680 con 0x7fb234162e30 2024-09-12T02:08:01.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb21bfff640 1 -- 172.21.15.19:0/2195211277 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00a860 con 0x7fb234162e30 2024-09-12T02:08:01.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.333+0000 7fb239dd6640 1 -- 172.21.15.19:0/2195211277 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2340b7c40 con 0x7fb234162e30 2024-09-12T02:08:01.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.334+0000 7fb239dd6640 1 -- 172.21.15.19:0/2195211277 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb23406d740 con 0x7fb234162e30 2024-09-12T02:08:01.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.335+0000 7fb21bfff640 1 -- 172.21.15.19:0/2195211277 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb22c01b070 con 0x7fb234162e30 2024-09-12T02:08:01.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.335+0000 7fb21bfff640 1 --2- 172.21.15.19:0/2195211277 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb22006be30 0x7fb22006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.335+0000 7fb21bfff640 1 -- 172.21.15.19:0/2195211277 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7fb22c08a2a0 con 0x7fb234162e30 2024-09-12T02:08:01.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.336+0000 7fb2337fe640 1 --2- 172.21.15.19:0/2195211277 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb22006be30 0x7fb22006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.336+0000 7fb2337fe640 1 --2- 172.21.15.19:0/2195211277 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb22006be30 0x7fb22006e2f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fb224034000 tx=0x7fb22402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:01.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.340+0000 7fb21bfff640 1 -- 172.21.15.19:0/2195211277 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb22c058720 con 0x7fb234162e30 2024-09-12T02:08:01.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.515+0000 7fb239dd6640 1 -- 172.21.15.19:0/2195211277 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fb2340ba450 con 0x7fb234162e30 2024-09-12T02:08:01.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.518+0000 7fb21bfff640 1 -- 172.21.15.19:0/2195211277 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v30)=0 v30) ==== 123+0+0 (secure 0 0 0) 0x7fb22c08a0c0 con 0x7fb234162e30 2024-09-12T02:08:01.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.520+0000 7fb21bfff640 1 -- 172.21.15.19:0/2195211277 <== mon.0 v2:172.21.15.19:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb22c05ca20 con 0x7fb234162e30 2024-09-12T02:08:01.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.521+0000 7fb239dd6640 1 -- 172.21.15.19:0/2195211277 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb22006be30 msgr2=0x7fb22006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.521+0000 7fb239dd6640 1 --2- 172.21.15.19:0/2195211277 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb22006be30 0x7fb22006e2f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fb224034000 tx=0x7fb22402e000 comp rx=0 tx=0).stop 2024-09-12T02:08:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.521+0000 7fb239dd6640 1 -- 172.21.15.19:0/2195211277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb234162e30 msgr2=0x7fb234151810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.521+0000 7fb239dd6640 1 --2- 172.21.15.19:0/2195211277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb234162e30 0x7fb234151810 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00c700 tx=0x7fb22c00cbc0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.521+0000 7fb239dd6640 1 -- 172.21.15.19:0/2195211277 shutdown_connections 2024-09-12T02:08:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.521+0000 7fb239dd6640 1 --2- 172.21.15.19:0/2195211277 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7fb22006be30 0x7fb22006e2f0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.521+0000 7fb239dd6640 1 --2- 172.21.15.19:0/2195211277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb234162e30 0x7fb234151810 unknown :-1 s=CLOSED pgs=2413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.521+0000 7fb239dd6640 1 --2- 172.21.15.19:0/2195211277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb234162340 0x7fb2341f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.521+0000 7fb239dd6640 1 --2- 172.21.15.19:0/2195211277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2340cf280 0x7fb2340b9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.521+0000 7fb239dd6640 1 -- 172.21.15.19:0/2195211277 >> 172.21.15.19:0/2195211277 conn(0x7fb23408bfc0 msgr2=0x7fb234160240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.521+0000 7fb239dd6640 1 -- 172.21.15.19:0/2195211277 shutdown_connections 2024-09-12T02:08:01.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.521+0000 7fb239dd6640 1 -- 172.21.15.19:0/2195211277 wait complete. 2024-09-12T02:08:01.532 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:08:01.532 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:08:01.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.634+0000 7f4624aba640 1 Processor -- start 2024-09-12T02:08:01.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.634+0000 7f4624aba640 1 -- start start 2024-09-12T02:08:01.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.635+0000 7f4624aba640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4620072d30 0x7f462006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.635+0000 7f4624aba640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f462006f700 0x7f462015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.635+0000 7f4624aba640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f462006fae0 con 0x7f462015b300 2024-09-12T02:08:01.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.635+0000 7f4624aba640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f46200728a0 con 0x7f4620072d30 2024-09-12T02:08:01.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.635+0000 7f4624aba640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f46200cdbe0 con 0x7f462006f700 2024-09-12T02:08:01.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.635+0000 7f461dd9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4620072d30 0x7f462006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.635+0000 7f461e59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f462015b300 0x7f46200cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60970/0 (socket says 172.21.15.19:60970) 2024-09-12T02:08:01.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.635+0000 7f461e59c640 1 -- 172.21.15.19:0/1012873252 learned_addr learned my addr 172.21.15.19:0/1012873252 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-09-12T02:08:01.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.635+0000 7f461dd9b640 1 -- 172.21.15.19:0/1012873252 >> v2:172.21.15.135:3300/0 conn(0x7f462006f700 msgr2=0x7f462015b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:01.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.635+0000 7f461dd9b640 1 --2- 172.21.15.19:0/1012873252 >> v2:172.21.15.135:3300/0 conn(0x7f462006f700 0x7f462015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.635+0000 7f461dd9b640 1 -- 172.21.15.19:0/1012873252 >> v1:172.21.15.19:6789/0 conn(0x7f462015b300 legacy=0x7f46200cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.635+0000 7f461d59a640 1 -- 172.21.15.19:0/1012873252 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1560232796 0 0) 0x7f462006fae0 con 0x7f462015b300 2024-09-12T02:08:01.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.635+0000 7f461dd9b640 1 -- 172.21.15.19:0/1012873252 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46200cd900 con 0x7f4620072d30 2024-09-12T02:08:01.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.636+0000 7f461dd9b640 1 --2- 172.21.15.19:0/1012873252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4620072d30 0x7f462006f1c0 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7f46200b38f0 tx=0x7f461402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3ed80d86ba0f23 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:01.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.636+0000 7f461d59a640 1 -- 172.21.15.19:0/1012873252 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614037070 con 0x7f4620072d30 2024-09-12T02:08:01.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.636+0000 7f461d59a640 1 -- 172.21.15.19:0/1012873252 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4614032440 con 0x7f4620072d30 2024-09-12T02:08:01.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.636+0000 7f461d59a640 1 -- 172.21.15.19:0/1012873252 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461402ae60 con 0x7f4620072d30 2024-09-12T02:08:01.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.637+0000 7f4624aba640 1 -- 172.21.15.19:0/1012873252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4620072d30 msgr2=0x7f462006f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.637+0000 7f4624aba640 1 --2- 172.21.15.19:0/1012873252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4620072d30 0x7f462006f1c0 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7f46200b38f0 tx=0x7f461402a110 comp rx=0 tx=0).stop 2024-09-12T02:08:01.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.637+0000 7f4624aba640 1 -- 172.21.15.19:0/1012873252 shutdown_connections 2024-09-12T02:08:01.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.637+0000 7f4624aba640 1 --2- 172.21.15.19:0/1012873252 >> v2:172.21.15.135:3300/0 conn(0x7f462006f700 0x7f462015b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.637+0000 7f4624aba640 1 --2- 172.21.15.19:0/1012873252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4620072d30 0x7f462006f1c0 unknown :-1 s=CLOSED pgs=2415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.637+0000 7f4624aba640 1 -- 172.21.15.19:0/1012873252 >> 172.21.15.19:0/1012873252 conn(0x7f4620067d70 msgr2=0x7f462006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:01.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.637+0000 7f4624aba640 1 -- 172.21.15.19:0/1012873252 shutdown_connections 2024-09-12T02:08:01.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.637+0000 7f4624aba640 1 -- 172.21.15.19:0/1012873252 wait complete. 2024-09-12T02:08:01.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.638+0000 7f4624aba640 1 Processor -- start 2024-09-12T02:08:01.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.638+0000 7f4624aba640 1 -- start start 2024-09-12T02:08:01.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f4624aba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f462006f700 0x7f46201f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f4624aba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4620072d30 0x7f46201f2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f4624aba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f462015b300 0x7f46201544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f4624aba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f46200cd5c0 con 0x7f462006f700 2024-09-12T02:08:01.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f4624aba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4620072530 con 0x7f4620072d30 2024-09-12T02:08:01.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f4624aba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f46200cffe0 con 0x7f462015b300 2024-09-12T02:08:01.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f461e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f462006f700 0x7f46201f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f461e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f462006f700 0x7f46201f1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37702/0 (socket says 172.21.15.19:37702) 2024-09-12T02:08:01.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f461e59c640 1 -- 172.21.15.19:0/2977613111 learned_addr learned my addr 172.21.15.19:0/2977613111 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-12T02:08:01.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f461dd9b640 1 --2- 172.21.15.19:0/2977613111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4620072d30 0x7f46201f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f461ed9d640 1 --2- 172.21.15.19:0/2977613111 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f462015b300 0x7f46201544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f461e59c640 1 -- 172.21.15.19:0/2977613111 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f462015b300 msgr2=0x7f46201544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f461e59c640 1 --2- 172.21.15.19:0/2977613111 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f462015b300 0x7f46201544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f461e59c640 1 -- 172.21.15.19:0/2977613111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4620072d30 msgr2=0x7f46201f2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f461e59c640 1 --2- 172.21.15.19:0/2977613111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4620072d30 0x7f46201f2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f461e59c640 1 -- 172.21.15.19:0/2977613111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46201f22d0 con 0x7f462006f700 2024-09-12T02:08:01.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f461dd9b640 1 --2- 172.21.15.19:0/2977613111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4620072d30 0x7f46201f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:08:01.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f461ed9d640 1 --2- 172.21.15.19:0/2977613111 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f462015b300 0x7f46201544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:08:01.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f461e59c640 1 --2- 172.21.15.19:0/2977613111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f462006f700 0x7f46201f1b30 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7f461000c430 tx=0x7f461000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:01.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.639+0000 7f460effd640 1 -- 172.21.15.19:0/2977613111 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46100074e0 con 0x7f462006f700 2024-09-12T02:08:01.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.640+0000 7f460effd640 1 -- 172.21.15.19:0/2977613111 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f46100047e0 con 0x7f462006f700 2024-09-12T02:08:01.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.640+0000 7f460effd640 1 -- 172.21.15.19:0/2977613111 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4610004bf0 con 0x7f462006f700 2024-09-12T02:08:01.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.640+0000 7f4624aba640 1 -- 172.21.15.19:0/2977613111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4620151d40 con 0x7f462006f700 2024-09-12T02:08:01.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.640+0000 7f4624aba640 1 -- 172.21.15.19:0/2977613111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4620152300 con 0x7f462006f700 2024-09-12T02:08:01.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.641+0000 7f4624aba640 1 -- 172.21.15.19:0/2977613111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f462006f1c0 con 0x7f462006f700 2024-09-12T02:08:01.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.641+0000 7f460effd640 1 -- 172.21.15.19:0/2977613111 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4610011070 con 0x7f462006f700 2024-09-12T02:08:01.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.641+0000 7f460effd640 1 --2- 172.21.15.19:0/2977613111 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f460006be60 0x7f460006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.642+0000 7f460effd640 1 -- 172.21.15.19:0/2977613111 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5421+0+0 (secure 0 0 0) 0x7f461008a8b0 con 0x7f462006f700 2024-09-12T02:08:01.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.642+0000 7f461dd9b640 1 --2- 172.21.15.19:0/2977613111 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f460006be60 0x7f460006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.642+0000 7f461dd9b640 1 --2- 172.21.15.19:0/2977613111 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f460006be60 0x7f460006e320 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f4614034000 tx=0x7f461402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:01.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.646+0000 7f460effd640 1 -- 172.21.15.19:0/2977613111 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4610059410 con 0x7f462006f700 2024-09-12T02:08:01.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.858+0000 7f4624aba640 1 -- 172.21.15.19:0/2977613111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f462015c120 con 0x7f462006f700 2024-09-12T02:08:01.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.858+0000 7f460effd640 1 -- 172.21.15.19:0/2977613111 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 339 v339) ==== 95+0+3921 (secure 0 0 0) 0x7f4610058d10 con 0x7f462006f700 2024-09-12T02:08:01.859 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T02:08:01.859 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":339,"btime":"2024-09-12T02:07:29:808481+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2607300298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2607300298},{"type":"v1","addr":"172.21.15.135:6836","nonce":2607300298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":9283,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/818911002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":818911002},{"type":"v1","addr":"172.21.15.135:6837","nonce":818911002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":10650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/3527496552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3527496552},{"type":"v1","addr":"172.21.15.19:6834","nonce":3527496552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":327},{"gid":10986,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2465099544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2465099544},{"type":"v1","addr":"172.21.15.19:6835","nonce":2465099544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":339}],"filesystems":[]} 2024-09-12T02:08:01.859 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 339 2024-09-12T02:08:01.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.860+0000 7f4624aba640 1 -- 172.21.15.19:0/2977613111 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f460006be60 msgr2=0x7f460006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.860+0000 7f4624aba640 1 --2- 172.21.15.19:0/2977613111 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f460006be60 0x7f460006e320 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f4614034000 tx=0x7f461402e000 comp rx=0 tx=0).stop 2024-09-12T02:08:01.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.860+0000 7f4624aba640 1 -- 172.21.15.19:0/2977613111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f462006f700 msgr2=0x7f46201f1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.860+0000 7f4624aba640 1 --2- 172.21.15.19:0/2977613111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f462006f700 0x7f46201f1b30 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7f461000c430 tx=0x7f461000c8f0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.860+0000 7f4624aba640 1 -- 172.21.15.19:0/2977613111 shutdown_connections 2024-09-12T02:08:01.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.860+0000 7f4624aba640 1 --2- 172.21.15.19:0/2977613111 >> [v2:172.21.15.135:6832/1305006827,v1:172.21.15.135:6833/1305006827] conn(0x7f460006be60 0x7f460006e320 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.860+0000 7f4624aba640 1 --2- 172.21.15.19:0/2977613111 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f462015b300 0x7f46201544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.860+0000 7f4624aba640 1 --2- 172.21.15.19:0/2977613111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4620072d30 0x7f46201f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.860+0000 7f4624aba640 1 --2- 172.21.15.19:0/2977613111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f462006f700 0x7f46201f1b30 unknown :-1 s=CLOSED pgs=2416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.860+0000 7f4624aba640 1 -- 172.21.15.19:0/2977613111 >> 172.21.15.19:0/2977613111 conn(0x7f4620067d70 msgr2=0x7f462015a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:01.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.860+0000 7f4624aba640 1 -- 172.21.15.19:0/2977613111 shutdown_connections 2024-09-12T02:08:01.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T02:08:01.860+0000 7f4624aba640 1 -- 172.21.15.19:0/2977613111 wait complete. 2024-09-12T02:08:01.872 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-12T02:08:01.872 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T02:08:01.873 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:08:01.873 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:01.882 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:08:01.882 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:08:01.882 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:01.932 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:08:01.932 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:08:01.932 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:01.943 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:08:01.943 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:08:01.943 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:01.994 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:08:01.995 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T02:08:01.995 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T02:08:01.995 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:02.024 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T02:08:02.024 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T02:08:02.024 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:02.096 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T02:08:02.097 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T02:08:02.097 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:02.173 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T02:08:02.174 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T02:08:02.174 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:02.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-12T02:08:02.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-12T02:08:02.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-12T02:08:02.239 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T02:08:02.240 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T02:08:02.240 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:02.274 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T02:08:02.275 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T02:08:02.275 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:02.343 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T02:08:02.343 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T02:08:02.344 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:02.414 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T02:08:02.414 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T02:08:02.415 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:02.496 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T02:08:02.497 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T02:08:02.497 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T02:08:02.497 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:02.524 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T02:08:02.524 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T02:08:02.524 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:02.553 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T02:08:02.553 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T02:08:02.553 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T02:08:02.554 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:02.577 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T02:08:02.577 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T02:08:02.577 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:02.606 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T02:08:02.606 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T02:08:02.607 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:02.660 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T02:08:02.660 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T02:08:02.660 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'Error loading MDS rank' | egrep -v 'missing journal object' | egrep -v 'Error recovering journal' | egrep -v 'error decoding table object' | egrep -v 'failed to read JournalPointer' | egrep -v 'Corrupt directory entry' | egrep -v 'Corrupt fnode header' | egrep -v 'corrupt sessionmap header' | egrep -v 'Corrupt dentry' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v MDS_READ_ONLY | egrep -v 'force file system read-only' | egrep -v 'with standby daemon mds' | egrep -v 'MDS abort because newly corrupt dentry' | head -n 1 2024-09-12T02:08:02.703 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:08:02.704 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T02:08:02.910 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:08:02.910 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T02:08:03.013 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:08:03.013 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T02:08:03.069 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:08:03.069 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T02:08:03.119 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T02:08:03.120 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T02:08:03.262 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T02:08:03.263 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T02:08:03.366 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T02:08:03.366 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T02:08:03.423 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T02:08:03.423 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T02:08:03.482 INFO:tasks.ceph:Archiving mon data... 2024-09-12T02:08:03.487 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901578/data/mon.a.tgz 2024-09-12T02:08:03.487 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-12T02:08:03.508 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.R6fvdDeInd 2024-09-12T02:08:03.509 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.R6fvdDeInd 2024-09-12T02:08:03.710 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.R6fvdDeInd 2024-09-12T02:08:03.801 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.R6fvdDeInd is 608KB 2024-09-12T02:08:04.541 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.R6fvdDeInd 2024-09-12T02:08:04.557 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901578/data/mon.b.tgz 2024-09-12T02:08:04.557 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-09-12T02:08:04.577 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.6OIa9KO5Ia 2024-09-12T02:08:04.578 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.6OIa9KO5Ia 2024-09-12T02:08:04.777 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.6OIa9KO5Ia 2024-09-12T02:08:04.864 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.6OIa9KO5Ia is 618KB 2024-09-12T02:08:05.596 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.6OIa9KO5Ia 2024-09-12T02:08:05.614 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901578/data/mon.c.tgz 2024-09-12T02:08:05.614 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-09-12T02:08:05.670 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.99KNkT5ULo 2024-09-12T02:08:05.671 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.99KNkT5ULo 2024-09-12T02:08:05.854 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.99KNkT5ULo 2024-09-12T02:08:05.938 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.99KNkT5ULo is 618KB 2024-09-12T02:08:06.403 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.99KNkT5ULo 2024-09-12T02:08:06.418 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T02:08:06.419 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T02:08:06.422 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T02:08:06.511 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T02:08:06.541 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T02:08:06.541 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T02:08:06.781 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901578/remote/smithi019/crash 2024-09-12T02:08:06.813 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T02:08:06.892 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901578/remote/smithi135/crash 2024-09-12T02:08:06.894 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T02:08:06.960 INFO:tasks.ceph:Shutting down logrotate 2024-09-12T02:08:06.961 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:08:06.964 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:08:07.027 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-12T02:08:07.056 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-12T02:08:07.080 INFO:tasks.ceph:Compressing logs... 2024-09-12T02:08:07.081 DEBUG:teuthology.orchestra.run.smithi019:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:08:07.099 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:08:07.166 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T02:08:07.166 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42953.log 2024-09-12T02:08:07.166 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-12T02:08:07.166 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.3.42953.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.3.42953.log.gz 2024-09-12T02:08:07.167 INFO:teuthology.orchestra.run.smithi135.stderr: -- /var/log/ceph/ceph-client.1.42553.log 2024-09-12T02:08:07.167 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T02:08:07.167 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T02:08:07.167 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42949.log 2024-09-12T02:08:07.167 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42548.log 2024-09-12T02:08:07.167 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36524.log 2024-09-12T02:08:07.167 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-client.1.42553.log: /var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph.audit.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42553.log.gz 2024-09-12T02:08:07.167 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.3.42949.log: /var/log/ceph/ceph-client.1.42548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42949.log.gz 2024-09-12T02:08:07.168 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T02:08:07.168 INFO:teuthology.orchestra.run.smithi135.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42548.log.gz 2024-09-12T02:08:07.168 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36477.log 2024-09-12T02:08:07.168 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mon.c.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36524.log.gz 2024-09-12T02:08:07.168 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T02:08:07.168 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36477.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T02:08:07.168 INFO:teuthology.orchestra.run.smithi135.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36477.log.gz 2024-09-12T02:08:07.168 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-osd.5.log: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T02:08:07.169 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T02:08:07.169 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-12T02:08:07.169 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T02:08:07.169 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mds.d.log: 92.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T02:08:07.173 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36273.log 2024-09-12T02:08:07.184 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T02:08:07.185 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36273.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36273.log.gz 2024-09-12T02:08:07.197 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36353.log 2024-09-12T02:08:07.197 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mon.b.log: 93.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-12T02:08:07.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-12T02:08:07.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-12T02:08:07.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-12T02:08:07.210 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36313.log 2024-09-12T02:08:07.210 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36353.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36353.log.gz 2024-09-12T02:08:07.215 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36564.log 2024-09-12T02:08:07.230 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36313.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36313.log.gz 2024-09-12T02:08:07.230 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36433.log 2024-09-12T02:08:07.244 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36564.log: 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36393.log 2024-09-12T02:08:07.245 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36433.log: -- replaced with /var/log/ceph/ceph-client.admin.36564.log.gz 2024-09-12T02:08:07.245 INFO:teuthology.orchestra.run.smithi135.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36433.log.gz 2024-09-12T02:08:07.256 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36393.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36393.log.gz 2024-09-12T02:08:07.307 INFO:teuthology.orchestra.run.smithi135.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-12T02:08:07.354 INFO:teuthology.orchestra.run.smithi135.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T02:08:07.523 INFO:teuthology.orchestra.run.smithi135.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T02:08:07.578 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T02:08:07.579 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73048.log 2024-09-12T02:08:07.579 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55380.log 2024-09-12T02:08:07.579 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55212.log 2024-09-12T02:08:07.579 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61235.log 2024-09-12T02:08:07.579 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55380.log: /var/log/ceph/ceph-client.admin.55212.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73048.log.gz 2024-09-12T02:08:07.579 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70059.log 2024-09-12T02:08:07.580 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55212.log.gz 2024-09-12T02:08:07.580 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55380.log.gz 2024-09-12T02:08:07.580 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65908.log 2024-09-12T02:08:07.580 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61235.log: /var/log/ceph/ceph-client.admin.70059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86525.log 2024-09-12T02:08:07.580 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61235.log.gz 2024-09-12T02:08:07.580 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70059.log.gz 2024-09-12T02:08:07.580 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.65908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75945.log 2024-09-12T02:08:07.580 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65908.log.gz 2024-09-12T02:08:07.580 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.86525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82433.log 2024-09-12T02:08:07.581 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.86525.log.gz 2024-09-12T02:08:07.581 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44106.log 2024-09-12T02:08:07.581 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75945.log.gz 2024-09-12T02:08:07.581 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.82433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70704.log 2024-09-12T02:08:07.581 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46856.log 2024-09-12T02:08:07.581 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.70704.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44106.log.gz 2024-09-12T02:08:07.581 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89140.log 2024-09-12T02:08:07.581 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.70704.log.gz 2024-09-12T02:08:07.582 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44776.log 2024-09-12T02:08:07.582 INFO:teuthology.orchestra.run.smithi019.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.82433.log.gz 2024-09-12T02:08:07.582 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46856.log.gz 2024-09-12T02:08:07.582 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.89140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67809.log 2024-09-12T02:08:07.582 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.89140.log.gz 2024-09-12T02:08:07.582 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76314.log 2024-09-12T02:08:07.582 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44776.log.gz 2024-09-12T02:08:07.582 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61329.log 2024-09-12T02:08:07.582 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67809.log.gz 2024-09-12T02:08:07.583 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70746.log 2024-09-12T02:08:07.583 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76314.log.gz 2024-09-12T02:08:07.583 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72964.log 2024-09-12T02:08:07.583 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61329.log.gz 2024-09-12T02:08:07.583 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.70746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84889.log 2024-09-12T02:08:07.583 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70746.log.gz 2024-09-12T02:08:07.583 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85411.log 2024-09-12T02:08:07.583 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72964.log.gz 2024-09-12T02:08:07.584 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.84889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85327.log 2024-09-12T02:08:07.584 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.84889.log.gz 2024-09-12T02:08:07.584 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47606.log 2024-09-12T02:08:07.584 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.85411.log.gz 2024-09-12T02:08:07.584 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85327.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30131.log 2024-09-12T02:08:07.584 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47606.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.85327.log.gz 2024-09-12T02:08:07.584 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36531.log 2024-09-12T02:08:07.584 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47606.log.gz 2024-09-12T02:08:07.584 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.tmp-client.admin.30131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87853.log 2024-09-12T02:08:07.585 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30131.log.gz 2024-09-12T02:08:07.585 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68264.log 2024-09-12T02:08:07.585 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.87853.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36531.log.gz 2024-09-12T02:08:07.585 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52453.log 2024-09-12T02:08:07.585 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.87853.log.gz 2024-09-12T02:08:07.585 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.68264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49373.log 2024-09-12T02:08:07.585 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.68264.log.gz 2024-09-12T02:08:07.585 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71190.log 2024-09-12T02:08:07.585 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49373.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52453.log.gz 2024-09-12T02:08:07.586 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79204.log 2024-09-12T02:08:07.586 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6%/var/log/ceph/ceph-client.admin.71190.log: -- replaced with /var/log/ceph/ceph-client.admin.49373.log.gz 2024-09-12T02:08:07.586 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44818.log 2024-09-12T02:08:07.586 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71190.log.gz 2024-09-12T02:08:07.586 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.79204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85141.log 2024-09-12T02:08:07.586 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44818.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.79204.log.gz 2024-09-12T02:08:07.586 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87790.log 2024-09-12T02:08:07.586 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44818.log.gz 2024-09-12T02:08:07.587 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76598.log 2024-09-12T02:08:07.587 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.85141.log.gz 2024-09-12T02:08:07.587 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.87790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45893.log 2024-09-12T02:08:07.587 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.87790.log.gz 2024-09-12T02:08:07.587 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47522.log 2024-09-12T02:08:07.587 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.76598.log.gz 2024-09-12T02:08:07.587 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.2.45893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79246.log 2024-09-12T02:08:07.587 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45893.log.gz 2024-09-12T02:08:07.587 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65457.log 2024-09-12T02:08:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.79246.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47522.log.gz 2024-09-12T02:08:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80150.log 2024-09-12T02:08:07.588 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.79246.log.gz 2024-09-12T02:08:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86063.log 2024-09-12T02:08:07.588 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65457.log.gz 2024-09-12T02:08:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70863.log 2024-09-12T02:08:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.86063.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80150.log.gz 2024-09-12T02:08:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84103.log 2024-09-12T02:08:07.589 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.86063.log.gz 2024-09-12T02:08:07.589 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.70863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60188.log 2024-09-12T02:08:07.589 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70863.log.gz 2024-09-12T02:08:07.589 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.84103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69410.log 2024-09-12T02:08:07.589 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.60188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67400.log 2024-09-12T02:08:07.589 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60188.log.gz 2024-09-12T02:08:07.589 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.69410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78887.log 2024-09-12T02:08:07.589 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.69410.log.gz 2024-09-12T02:08:07.590 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43781.log 2024-09-12T02:08:07.590 INFO:teuthology.orchestra.run.smithi019.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.84103.log.gz 2024-09-12T02:08:07.590 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64970.log 2024-09-12T02:08:07.590 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78887.log: /var/log/ceph/ceph-client.admin.43781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45109.log 2024-09-12T02:08:07.590 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43781.log.gz 88.2% 2024-09-12T02:08:07.590 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78887.log.gz 2024-09-12T02:08:07.590 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64970.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.67400.log.gz 2024-09-12T02:08:07.590 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78004.log 2024-09-12T02:08:07.591 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.64970.log.gz 2024-09-12T02:08:07.591 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47066.log 2024-09-12T02:08:07.591 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45109.log.gz 2024-09-12T02:08:07.591 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58705.log 2024-09-12T02:08:07.591 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47066.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78004.log.gz 2024-09-12T02:08:07.591 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67588.log 2024-09-12T02:08:07.591 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47066.log.gz 2024-09-12T02:08:07.591 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73614.log 2024-09-12T02:08:07.591 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58705.log.gz 2024-09-12T02:08:07.592 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70017.log 2024-09-12T02:08:07.592 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73614.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67588.log.gz 2024-09-12T02:08:07.592 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87794.log 2024-09-12T02:08:07.592 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.70017.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.73614.log.gz 2024-09-12T02:08:07.592 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60373.log 2024-09-12T02:08:07.592 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70017.log.gz 2024-09-12T02:08:07.592 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.87794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54732.log 2024-09-12T02:08:07.592 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.87794.log.gz 2024-09-12T02:08:07.593 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73844.log 2024-09-12T02:08:07.593 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83505.log 2024-09-12T02:08:07.593 INFO:teuthology.orchestra.run.smithi019.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.60373.log.gz 2024-09-12T02:08:07.593 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54732.log.gz 2024-09-12T02:08:07.593 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52117.log 2024-09-12T02:08:07.593 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73844.log.gz 2024-09-12T02:08:07.593 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.83505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88486.log 2024-09-12T02:08:07.593 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.83505.log.gz 2024-09-12T02:08:07.594 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45447.log 2024-09-12T02:08:07.594 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52117.log.gz 2024-09-12T02:08:07.594 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.88486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65192.log 2024-09-12T02:08:07.594 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.45447.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88486.log.gz 2024-09-12T02:08:07.594 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.82272.log 2024-09-12T02:08:07.594 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.0.45447.log.gz 2024-09-12T02:08:07.594 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68771.log 2024-09-12T02:08:07.594 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.82272.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.65192.log.gz 2024-09-12T02:08:07.594 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49945.log 2024-09-12T02:08:07.595 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.82272.log.gz 2024-09-12T02:08:07.595 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.68771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83583.log 2024-09-12T02:08:07.595 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77383.log 2024-09-12T02:08:07.595 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.83583.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.68771.log.gz 2024-09-12T02:08:07.595 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73670.log 2024-09-12T02:08:07.595 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83583.log.gz 2024-09-12T02:08:07.595 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62828.log 2024-09-12T02:08:07.595 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.77383.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49945.log.gz 2024-09-12T02:08:07.596 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46551.log 2024-09-12T02:08:07.596 INFO:teuthology.orchestra.run.smithi019.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.77383.log.gz 2024-09-12T02:08:07.596 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73670.log.gz 2024-09-12T02:08:07.596 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53154.log 2024-09-12T02:08:07.596 INFO:teuthology.orchestra.run.smithi019.stderr:gzip 87.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.62828.log.gz --verbose 2024-09-12T02:08:07.596 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.87182.log 2024-09-12T02:08:07.596 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46551.log: /var/log/ceph/ceph-client.admin.53154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73887.log 2024-09-12T02:08:07.596 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46551.log.gz 2024-09-12T02:08:07.596 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53154.log.gz 2024-09-12T02:08:07.597 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.87182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57359.log 2024-09-12T02:08:07.597 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87182.log.gz/var/log/ceph/ceph-client.admin.73887.log: 2024-09-12T02:08:07.597 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43432.log 2024-09-12T02:08:07.597 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73887.log.gz 2024-09-12T02:08:07.597 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72016.log 2024-09-12T02:08:07.597 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57359.log.gz 2024-09-12T02:08:07.597 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.43432.log: -5 --verbose -- /var/log/ceph/ceph-client.0.86825.log 2024-09-12T02:08:07.597 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46814.log 2024-09-12T02:08:07.597 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43432.log.gz 2024-09-12T02:08:07.598 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72016.log.gz 2024-09-12T02:08:07.598 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.86825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81844.log 2024-09-12T02:08:07.598 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.86825.log.gz 2024-09-12T02:08:07.598 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66780.log 2024-09-12T02:08:07.598 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.81844.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46814.log.gz 2024-09-12T02:08:07.598 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68729.log 2024-09-12T02:08:07.598 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.81844.log.gz 2024-09-12T02:08:07.598 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50663.log 2024-09-12T02:08:07.599 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66780.log.gz 2024-09-12T02:08:07.599 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.68729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46940.log 2024-09-12T02:08:07.599 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50663.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.68729.log.gz 2024-09-12T02:08:07.599 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69317.log 2024-09-12T02:08:07.599 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50663.log.gz 2024-09-12T02:08:07.599 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43774.log 2024-09-12T02:08:07.599 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46940.log.gz 2024-09-12T02:08:07.599 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.69317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46642.log 2024-09-12T02:08:07.600 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87602.log 2024-09-12T02:08:07.600 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43774.log.gz 2024-09-12T02:08:07.600 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84607.log 2024-09-12T02:08:07.600 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79120.log 2024-09-12T02:08:07.600 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46642.log.gz 2024-09-12T02:08:07.600 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.87602.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.69317.log.gz 2024-09-12T02:08:07.600 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.84607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42239.log 2024-09-12T02:08:07.600 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87602.log.gz 2024-09-12T02:08:07.600 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.79120.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.84607.log.gz 2024-09-12T02:08:07.601 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89308.log 2024-09-12T02:08:07.601 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79120.log.gz 2024-09-12T02:08:07.601 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77182.log 2024-09-12T02:08:07.601 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42239.log.gz 2024-09-12T02:08:07.601 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.89308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82470.log 2024-09-12T02:08:07.601 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.77182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46110.log 2024-09-12T02:08:07.601 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.89308.log.gz 2024-09-12T02:08:07.601 INFO:teuthology.orchestra.run.smithi019.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.77182.log.gz 2024-09-12T02:08:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.82470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54651.log 2024-09-12T02:08:07.602 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.82470.log.gz 2024-09-12T02:08:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83120.log 2024-09-12T02:08:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54651.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46110.log.gz 2024-09-12T02:08:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81252.log 2024-09-12T02:08:07.602 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54651.log.gz 2024-09-12T02:08:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.83120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78215.log 2024-09-12T02:08:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.81252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54392.log 2024-09-12T02:08:07.602 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.81252.log.gz 2024-09-12T02:08:07.603 INFO:teuthology.orchestra.run.smithi019.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.83120.log.gz 2024-09-12T02:08:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57099.log 2024-09-12T02:08:07.603 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.78215.log.gz 2024-09-12T02:08:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86441.log 2024-09-12T02:08:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57099.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54392.log.gz 2024-09-12T02:08:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83944.log 2024-09-12T02:08:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.86441.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57099.log.gz 2024-09-12T02:08:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84140.log 2024-09-12T02:08:07.604 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86441.log.gz 2024-09-12T02:08:07.604 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.83944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61641.log 2024-09-12T02:08:07.604 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.83944.log.gz/var/log/ceph/ceph-client.admin.84140.log: 2024-09-12T02:08:07.604 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78845.log 2024-09-12T02:08:07.604 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61641.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.84140.log.gz 2024-09-12T02:08:07.604 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41753.log 2024-09-12T02:08:07.604 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61641.log.gz 2024-09-12T02:08:07.604 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64600.log 2024-09-12T02:08:07.605 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41753.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.78845.log.gz 2024-09-12T02:08:07.605 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T02:08:07.605 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41753.log.gz 2024-09-12T02:08:07.605 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79423.log 2024-09-12T02:08:07.605 INFO:teuthology.orchestra.run.smithi019.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.64600.log.gz 2024-09-12T02:08:07.605 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88444.log 2024-09-12T02:08:07.605 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.79423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69029.log 2024-09-12T02:08:07.605 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.88444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76472.log 2024-09-12T02:08:07.605 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.88444.log.gz 2024-09-12T02:08:07.606 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.69029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68574.log 2024-09-12T02:08:07.606 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69029.log.gz 2024-09-12T02:08:07.606 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87352.log 2024-09-12T02:08:07.606 INFO:teuthology.orchestra.run.smithi019.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.79423.log.gz 2024-09-12T02:08:07.606 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose 87.6% --/var/log/ceph/ceph-client.admin.68574.log: /var/log/ceph/ceph-client.admin.81491.log -- replaced with /var/log/ceph/ceph-client.admin.76472.log.gz 2024-09-12T02:08:07.606 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.606 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.87352.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.68574.log.gz 2024-09-12T02:08:07.606 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43180.log 2024-09-12T02:08:07.607 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.87352.log.gz -5 2024-09-12T02:08:07.607 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57825.log 2024-09-12T02:08:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.81491.log: /var/log/ceph/ceph-client.admin.43180.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.81491.log.gz 2024-09-12T02:08:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76692.log 2024-09-12T02:08:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50882.log 2024-09-12T02:08:07.607 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43180.log.gz 2024-09-12T02:08:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57825.log: /var/log/ceph/ceph-client.admin.76692.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.57825.log.gz 2024-09-12T02:08:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62576.log 2024-09-12T02:08:07.607 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.76692.log.gz 2024-09-12T02:08:07.608 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54816.log 2024-09-12T02:08:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50882.log: /var/log/ceph/ceph-client.admin.62576.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50882.log.gz 2024-09-12T02:08:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86105.log 2024-09-12T02:08:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82625.log 2024-09-12T02:08:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54816.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62576.log.gz 2024-09-12T02:08:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.86105.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54816.log.gz 2024-09-12T02:08:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44452.log 2024-09-12T02:08:07.608 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86105.log.gz 2024-09-12T02:08:07.609 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57023.log 2024-09-12T02:08:07.609 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.82625.log: /var/log/ceph/ceph-client.admin.44452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69797.log 2024-09-12T02:08:07.609 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.82625.log.gz 2024-09-12T02:08:07.609 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44452.log.gz 2024-09-12T02:08:07.609 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83078.log 2024-09-12T02:08:07.609 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57023.log.gz 2024-09-12T02:08:07.609 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.69797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71124.log 2024-09-12T02:08:07.609 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69797.log.gz 2024-09-12T02:08:07.610 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70886.log 2024-09-12T02:08:07.610 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.83078.log: /var/log/ceph/ceph-client.admin.71124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54476.log 2024-09-12T02:08:07.610 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83078.log.gz 2024-09-12T02:08:07.610 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.70886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60788.log 2024-09-12T02:08:07.610 INFO:teuthology.orchestra.run.smithi019.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.71124.log.gz 2024-09-12T02:08:07.610 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57191.log 2024-09-12T02:08:07.610 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose 88.8% -- -- replaced with /var/log/ceph/ceph-client.admin.54476.log.gz /var/log/ceph/ceph-client.admin.76416.log 2024-09-12T02:08:07.610 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.610 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60788.log: /var/log/ceph/ceph-client.admin.57191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44902.log 2024-09-12T02:08:07.611 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60788.log.gz 2024-09-12T02:08:07.611 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57191.log.gz 2024-09-12T02:08:07.611 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88972.log 2024-09-12T02:08:07.611 INFO:teuthology.orchestra.run.smithi019.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.70886.log.gz 2024-09-12T02:08:07.611 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66728.log 2024-09-12T02:08:07.611 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44902.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.76416.log.gz 2024-09-12T02:08:07.611 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.88972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47734.log 2024-09-12T02:08:07.611 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44902.log.gz 2024-09-12T02:08:07.612 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88972.log.gz 2024-09-12T02:08:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59682.log 2024-09-12T02:08:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83186.log 2024-09-12T02:08:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47734.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66728.log.gz 2024-09-12T02:08:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59682.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47734.log.gz 2024-09-12T02:08:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59598.log 2024-09-12T02:08:07.612 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59682.log.gz 2024-09-12T02:08:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70517.log 2024-09-12T02:08:07.613 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.83186.log: /var/log/ceph/ceph-client.admin.59598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60439.log 2024-09-12T02:08:07.613 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.83186.log.gz 2024-09-12T02:08:07.613 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59598.log.gz 2024-09-12T02:08:07.613 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.70517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64859.log 2024-09-12T02:08:07.613 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61497.log 2024-09-12T02:08:07.613 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60439.log: /var/log/ceph/ceph-client.admin.64859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52849.log 2024-09-12T02:08:07.613 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60439.log.gz 2024-09-12T02:08:07.613 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70433.log 2024-09-12T02:08:07.613 INFO:teuthology.orchestra.run.smithi019.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.64859.log.gz 2024-09-12T02:08:07.614 INFO:teuthology.orchestra.run.smithi019.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.70517.log.gz 2024-09-12T02:08:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52849.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61497.log.gz 2024-09-12T02:08:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43045.log 2024-09-12T02:08:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54248.log 2024-09-12T02:08:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.70433.log: /var/log/ceph/ceph-client.admin.43045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56422.log 2024-09-12T02:08:07.614 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70433.log.gz 2024-09-12T02:08:07.614 INFO:teuthology.orchestra.run.smithi019.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52849.log.gz 2024-09-12T02:08:07.614 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43045.log.gz 2024-09-12T02:08:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75062.log 2024-09-12T02:08:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78280.log 2024-09-12T02:08:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.56422.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54248.log.gz 2024-09-12T02:08:07.615 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56422.log.gz 2024-09-12T02:08:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84290.log 2024-09-12T02:08:07.615 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.75062.log.gz 2024-09-12T02:08:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62996.log 2024-09-12T02:08:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78280.log: /var/log/ceph/ceph-client.admin.84290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65007.log 2024-09-12T02:08:07.615 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.84290.log.gz 2024-09-12T02:08:07.616 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80980.log 2024-09-12T02:08:07.616 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72806.log 2024-09-12T02:08:07.616 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65007.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62996.log.gz 2024-09-12T02:08:07.616 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80980.log: 89.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.65007.log.gz -5 2024-09-12T02:08:07.616 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.76379.log 2024-09-12T02:08:07.616 INFO:teuthology.orchestra.run.smithi019.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.78280.log.gz 2024-09-12T02:08:07.616 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47648.log 2024-09-12T02:08:07.616 INFO:teuthology.orchestra.run.smithi019.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.80980.log.gz 2024-09-12T02:08:07.617 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76379.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72806.log.gz 2024-09-12T02:08:07.617 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72553.log 2024-09-12T02:08:07.617 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66293.log 2024-09-12T02:08:07.617 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47648.log.gz 2024-09-12T02:08:07.617 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70358.log 2024-09-12T02:08:07.617 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66293.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72553.log.gz 2024-09-12T02:08:07.617 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51987.log 2024-09-12T02:08:07.617 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66293.log.gz 2024-09-12T02:08:07.617 INFO:teuthology.orchestra.run.smithi019.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.76379.log.gz 2024-09-12T02:08:07.618 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.70358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89476.log 2024-09-12T02:08:07.618 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50353.log 2024-09-12T02:08:07.618 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70358.log.gz 2024-09-12T02:08:07.618 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51987.log: /var/log/ceph/ceph-client.admin.89476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61455.log 2024-09-12T02:08:07.618 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51987.log.gz 2024-09-12T02:08:07.618 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.50353.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89476.log.gz 2024-09-12T02:08:07.618 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52915.log 2024-09-12T02:08:07.618 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50353.log.gz 2024-09-12T02:08:07.619 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76921.log 2024-09-12T02:08:07.619 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61455.log.gz 2024-09-12T02:08:07.619 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65155.log 2024-09-12T02:08:07.619 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52915.log.gz 2024-09-12T02:08:07.619 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66939.log 2024-09-12T02:08:07.619 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76921.log: /var/log/ceph/ceph-client.admin.65155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77238.log 2024-09-12T02:08:07.619 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.76921.log.gz 2024-09-12T02:08:07.619 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66939.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.65155.log.gz 2024-09-12T02:08:07.619 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44114.log 2024-09-12T02:08:07.620 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.66939.log.gz 2024-09-12T02:08:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.77238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83643.log 2024-09-12T02:08:07.620 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77238.log.gz 2024-09-12T02:08:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88570.log 2024-09-12T02:08:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60704.log 2024-09-12T02:08:07.620 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44114.log.gz/var/log/ceph/ceph-client.admin.83643.log: 2024-09-12T02:08:07.620 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.83643.log.gz 2024-09-12T02:08:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.88570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75767.log 2024-09-12T02:08:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53606.log 2024-09-12T02:08:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60704.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.88570.log.gz 2024-09-12T02:08:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75767.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60704.log.gz 2024-09-12T02:08:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72395.log 2024-09-12T02:08:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47690.log 2024-09-12T02:08:07.621 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75767.log.gz 2024-09-12T02:08:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53606.log: /var/log/ceph/ceph-client.admin.72395.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53606.log.gz 2024-09-12T02:08:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42197.log 2024-09-12T02:08:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50485.log 2024-09-12T02:08:07.622 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72395.log.gz 2024-09-12T02:08:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47690.log: /var/log/ceph/ceph-client.admin.42197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71706.log 2024-09-12T02:08:07.622 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47690.log.gz 2024-09-12T02:08:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60662.log 2024-09-12T02:08:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50485.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42197.log.gz 2024-09-12T02:08:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.71706.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50485.log.gz 2024-09-12T02:08:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78098.log 2024-09-12T02:08:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88215.log 2024-09-12T02:08:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60662.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.71706.log.gz 2024-09-12T02:08:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78098.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60662.log.gz 2024-09-12T02:08:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77768.log 2024-09-12T02:08:07.623 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78098.log.gz 2024-09-12T02:08:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62660.log 2024-09-12T02:08:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.88215.log: /var/log/ceph/ceph-client.admin.77768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63515.log 2024-09-12T02:08:07.623 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.88215.log.gz 2024-09-12T02:08:07.623 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77768.log.gz 2024-09-12T02:08:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55040.log 2024-09-12T02:08:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75450.log 2024-09-12T02:08:07.624 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62660.log.gz 2024-09-12T02:08:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.63515.log: /var/log/ceph/ceph-client.admin.55040.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63515.log.gz 2024-09-12T02:08:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81568.log 2024-09-12T02:08:07.624 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55040.log.gz 2024-09-12T02:08:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64526.log 2024-09-12T02:08:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66346.log 2024-09-12T02:08:07.625 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.81568.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.75450.log.gz 2024-09-12T02:08:07.625 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64526.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.81568.log.gz 2024-09-12T02:08:07.625 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87267.log 2024-09-12T02:08:07.625 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66346.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64526.log.gz 2024-09-12T02:08:07.625 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62196.log 2024-09-12T02:08:07.625 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66346.log.gz 2024-09-12T02:08:07.625 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.87267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66864.log 2024-09-12T02:08:07.625 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64341.log 2024-09-12T02:08:07.626 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62196.log.gz 2024-09-12T02:08:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75869.log 2024-09-12T02:08:07.626 INFO:teuthology.orchestra.run.smithi019.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.87267.log.gz 2024-09-12T02:08:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63338.log 2024-09-12T02:08:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64341.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66864.log.gz 2024-09-12T02:08:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83813.log 2024-09-12T02:08:07.626 INFO:teuthology.orchestra.run.smithi019.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.64341.log.gz 2024-09-12T02:08:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.63338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52411.log 2024-09-12T02:08:07.626 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.75869.log.gz 2024-09-12T02:08:07.627 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.63338.log.gz 2024-09-12T02:08:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.83813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47436.log 2024-09-12T02:08:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52411.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.83813.log.gz 2024-09-12T02:08:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54332.log 2024-09-12T02:08:07.627 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52411.log.gz 2024-09-12T02:08:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58560.log 2024-09-12T02:08:07.627 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47436.log.gz 2024-09-12T02:08:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61811.log 2024-09-12T02:08:07.628 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67041.log 2024-09-12T02:08:07.628 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58560.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54332.log.gz 2024-09-12T02:08:07.628 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61811.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58560.log.gz 2024-09-12T02:08:07.628 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79569.log 2024-09-12T02:08:07.628 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89702.log 2024-09-12T02:08:07.628 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61811.log.gz 2024-09-12T02:08:07.628 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67041.log: /var/log/ceph/ceph-client.admin.79569.log: gzip 88.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.67041.log.gz 2024-09-12T02:08:07.628 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.81886.log 2024-09-12T02:08:07.629 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 87.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.79569.log.gz -- 2024-09-12T02:08:07.629 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.75669.log 2024-09-12T02:08:07.629 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.89702.log: /var/log/ceph/ceph-client.admin.81886.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89702.log.gz 2024-09-12T02:08:07.629 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53414.log 2024-09-12T02:08:07.629 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46068.log 2024-09-12T02:08:07.629 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75669.log: /var/log/ceph/ceph-client.admin.53414.log: 90.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85752.log 2024-09-12T02:08:07.629 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81886.log.gz 2024-09-12T02:08:07.629 INFO:teuthology.orchestra.run.smithi019.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.75669.log.gz 2024-09-12T02:08:07.630 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53414.log.gz 2024-09-12T02:08:07.630 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60989.log 2024-09-12T02:08:07.630 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65044.log 2024-09-12T02:08:07.630 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46068.log.gz 2024-09-12T02:08:07.630 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.85752.log.gz 2024-09-12T02:08:07.630 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69293.log 2024-09-12T02:08:07.630 INFO:teuthology.orchestra.run.smithi019.stderr:gzip 87.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.60989.log.gz --verbose 2024-09-12T02:08:07.630 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.47024.log 2024-09-12T02:08:07.630 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65044.log: /var/log/ceph/ceph-client.admin.69293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61031.log 2024-09-12T02:08:07.631 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65044.log.gz 2024-09-12T02:08:07.631 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69293.log.gz 2024-09-12T02:08:07.631 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78635.log 2024-09-12T02:08:07.631 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70175.log 2024-09-12T02:08:07.631 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47024.log.gz 2024-09-12T02:08:07.631 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68683.log 2024-09-12T02:08:07.631 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.78635.log.gz 2024-09-12T02:08:07.631 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.70175.log: /var/log/ceph/ceph-client.admin.60746.log 2024-09-12T02:08:07.632 INFO:teuthology.orchestra.run.smithi019.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61031.log.gz 2024-09-12T02:08:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.68683.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70175.log.gz 2024-09-12T02:08:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77911.log 2024-09-12T02:08:07.632 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68683.log.gz 2024-09-12T02:08:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58662.log 2024-09-12T02:08:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60746.log: /var/log/ceph/ceph-client.admin.77911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60830.log 2024-09-12T02:08:07.632 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60746.log.gz 2024-09-12T02:08:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82868.log 2024-09-12T02:08:07.632 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58662.log.gz 2024-09-12T02:08:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89014.log 2024-09-12T02:08:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76963.log 88.2% 2024-09-12T02:08:07.633 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60830.log.gz 2024-09-12T02:08:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.82868.log: /var/log/ceph/ceph-client.admin.89014.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.77911.log.gz 2024-09-12T02:08:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44734.log 2024-09-12T02:08:07.633 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.89014.log.gz 2024-09-12T02:08:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66392.log 2024-09-12T02:08:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76963.log: /var/log/ceph/ceph-client.admin.44734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55974.log 2024-09-12T02:08:07.634 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76963.log.gz 2024-09-12T02:08:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66392.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66176.log 2024-09-12T02:08:07.634 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44734.log.gz 2024-09-12T02:08:07.634 INFO:teuthology.orchestra.run.smithi019.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.82868.log.gz 2024-09-12T02:08:07.634 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66392.log.gz 2024-09-12T02:08:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.55974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55974.log.gz 2024-09-12T02:08:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59136.log 2024-09-12T02:08:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58873.log 2024-09-12T02:08:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59136.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66176.log.gz 2024-09-12T02:08:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53216.log 2024-09-12T02:08:07.635 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59136.log.gz 2024-09-12T02:08:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58915.log 2024-09-12T02:08:07.635 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58873.log.gz 2024-09-12T02:08:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82144.log 2024-09-12T02:08:07.635 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53216.log.gz 2024-09-12T02:08:07.636 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52033.log 2024-09-12T02:08:07.636 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58915.log.gz 2024-09-12T02:08:07.636 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.82144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.82144.log.gz 2024-09-12T02:08:07.636 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74703.log 2024-09-12T02:08:07.636 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55506.log 2024-09-12T02:08:07.636 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52033.log: /var/log/ceph/ceph-client.admin.74703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49219.log 2024-09-12T02:08:07.636 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52033.log.gz 2024-09-12T02:08:07.636 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.74703.log.gz 2024-09-12T02:08:07.636 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78962.log 2024-09-12T02:08:07.637 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62744.log 2024-09-12T02:08:07.637 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55506.log.gz 2024-09-12T02:08:07.637 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49219.log: /var/log/ceph/ceph-client.admin.78962.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49219.log.gz 2024-09-12T02:08:07.637 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51237.log 2024-09-12T02:08:07.637 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78962.log.gz 2024-09-12T02:08:07.637 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58789.log 2024-09-12T02:08:07.637 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62744.log: /var/log/ceph/ceph-client.admin.51237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58349.log 2024-09-12T02:08:07.638 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62744.log.gz 2024-09-12T02:08:07.638 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58789.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51237.log.gz 2024-09-12T02:08:07.638 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47959.log 2024-09-12T02:08:07.638 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73244.log 2024-09-12T02:08:07.638 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58789.log.gz 2024-09-12T02:08:07.638 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58349.log: /var/log/ceph/ceph-client.admin.47959.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58349.log.gz 2024-09-12T02:08:07.638 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57317.log 2024-09-12T02:08:07.638 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47959.log.gz 2024-09-12T02:08:07.638 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36440.log 2024-09-12T02:08:07.639 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73244.log: /var/log/ceph/ceph-client.admin.57317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72175.log 2024-09-12T02:08:07.639 INFO:teuthology.orchestra.run.smithi019.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.73244.log.gz 2024-09-12T02:08:07.639 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36440.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57317.log.gz 2024-09-12T02:08:07.639 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63805.log 2024-09-12T02:08:07.639 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36440.log.gz 2024-09-12T02:08:07.639 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77080.log 2024-09-12T02:08:07.639 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72175.log.gz 2024-09-12T02:08:07.639 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.63805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80457.log 2024-09-12T02:08:07.640 INFO:teuthology.orchestra.run.smithi019.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.63805.log.gz 2024-09-12T02:08:07.640 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.77080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73512.log 2024-09-12T02:08:07.640 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48085.log 2024-09-12T02:08:07.640 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.77080.log.gz 2024-09-12T02:08:07.640 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80457.log: /var/log/ceph/ceph-client.admin.73512.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.80457.log.gz 2024-09-12T02:08:07.640 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73353.log 2024-09-12T02:08:07.640 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50349.log 2024-09-12T02:08:07.640 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48085.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73512.log.gz 2024-09-12T02:08:07.641 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73353.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48085.log.gz 2024-09-12T02:08:07.641 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80839.log 2024-09-12T02:08:07.641 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73353.log.gz 2024-09-12T02:08:07.641 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56873.log 2024-09-12T02:08:07.641 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.50349.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50349.log.gz 2024-09-12T02:08:07.641 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72236.log 2024-09-12T02:08:07.641 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56873.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.80839.log.gz 2024-09-12T02:08:07.641 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84061.log 2024-09-12T02:08:07.641 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56873.log.gz 2024-09-12T02:08:07.642 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89560.log 2024-09-12T02:08:07.642 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.72236.log.gz 2024-09-12T02:08:07.642 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.84061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79064.log 2024-09-12T02:08:07.642 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.84061.log.gz 2024-09-12T02:08:07.642 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44116.log 2024-09-12T02:08:07.642 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.89560.log: /var/log/ceph/ceph-client.admin.79064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69639.log 2024-09-12T02:08:07.642 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.89560.log.gz 2024-09-12T02:08:07.642 INFO:teuthology.orchestra.run.smithi019.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.79064.log.gz 2024-09-12T02:08:07.643 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54998.log 2024-09-12T02:08:07.643 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44116.log.gz 2024-09-12T02:08:07.643 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58602.log 2024-09-12T02:08:07.643 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.69639.log: /var/log/ceph/ceph-client.admin.54998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69881.log 2024-09-12T02:08:07.643 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69639.log.gz 2024-09-12T02:08:07.643 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54998.log.gz 2024-09-12T02:08:07.643 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51111.log 2024-09-12T02:08:07.643 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58602.log.gz 2024-09-12T02:08:07.643 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58246.log 2024-09-12T02:08:07.644 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.69881.log: /var/log/ceph/ceph-client.admin.51111.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69881.log.gz 2024-09-12T02:08:07.644 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60925.log 2024-09-12T02:08:07.644 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51111.log.gz 2024-09-12T02:08:07.644 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89602.log 2024-09-12T02:08:07.644 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58246.log: /var/log/ceph/ceph-client.admin.60925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74373.log 2024-09-12T02:08:07.644 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58246.log.gz 2024-09-12T02:08:07.644 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.89602.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60925.log.gz 2024-09-12T02:08:07.644 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72829.log 2024-09-12T02:08:07.645 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.74373.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.89602.log.gz 2024-09-12T02:08:07.645 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43222.log 2024-09-12T02:08:07.645 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74373.log.gz 2024-09-12T02:08:07.645 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71082.log 2024-09-12T02:08:07.645 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69354.log 2024-09-12T02:08:07.645 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.71082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63731.log 2024-09-12T02:08:07.645 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43222.log.gz 2024-09-12T02:08:07.645 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71082.log.gz 2024-09-12T02:08:07.645 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.69354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81652.log 2024-09-12T02:08:07.646 INFO:teuthology.orchestra.run.smithi019.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.72829.log.gz 2024-09-12T02:08:07.646 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69704.log 2024-09-12T02:08:07.646 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.63731.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.69354.log.gz 2024-09-12T02:08:07.646 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.81652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87494.log 2024-09-12T02:08:07.646 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.63731.log.gz 2024-09-12T02:08:07.646 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.69704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54122.log 2024-09-12T02:08:07.646 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.87494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63916.log 2024-09-12T02:08:07.646 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54122.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.87494.log.gz 2024-09-12T02:08:07.647 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64230.log 2024-09-12T02:08:07.647 INFO:teuthology.orchestra.run.smithi019.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.81652.log.gz/var/log/ceph/ceph-client.admin.63916.log: 2024-09-12T02:08:07.647 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71856.log 2024-09-12T02:08:07.647 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54122.log.gz 2024-09-12T02:08:07.647 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64230.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.69704.log.gz 2024-09-12T02:08:07.647 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59514.log 2024-09-12T02:08:07.647 INFO:teuthology.orchestra.run.smithi019.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.63916.log.gz 2024-09-12T02:08:07.647 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.71856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65654.log 2024-09-12T02:08:07.648 INFO:teuthology.orchestra.run.smithi019.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.64230.log.gz 2024-09-12T02:08:07.648 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71856.log.gz 2024-09-12T02:08:07.648 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88804.log 2024-09-12T02:08:07.648 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43772.log 2024-09-12T02:08:07.648 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65654.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59514.log.gz 2024-09-12T02:08:07.648 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.88804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73929.log 2024-09-12T02:08:07.648 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88804.log.gz 2024-09-12T02:08:07.648 INFO:teuthology.orchestra.run.smithi019.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.65654.log.gz 2024-09-12T02:08:07.648 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71382.log 2024-09-12T02:08:07.649 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52753.log 2024-09-12T02:08:07.649 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43772.log.gz 2024-09-12T02:08:07.649 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.71382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68395.log 2024-09-12T02:08:07.649 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.71382.log.gz 2024-09-12T02:08:07.649 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.52753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88341.log 2024-09-12T02:08:07.649 INFO:teuthology.orchestra.run.smithi019.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.73929.log.gz 2024-09-12T02:08:07.649 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52753.log.gz 2024-09-12T02:08:07.649 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.68395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62320.log 2024-09-12T02:08:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.88341.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68395.log.gz 2024-09-12T02:08:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88930.log 2024-09-12T02:08:07.650 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88341.log.gz 2024-09-12T02:08:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89434.log 2024-09-12T02:08:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62320.log: /var/log/ceph/ceph-client.admin.88930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80746.log 2024-09-12T02:08:07.650 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.62320.log.gz 2024-09-12T02:08:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.89434.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88930.log.gz 2024-09-12T02:08:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50798.log 2024-09-12T02:08:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.89434.log.gz -5 2024-09-12T02:08:07.651 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43306.log 2024-09-12T02:08:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80746.log: /var/log/ceph/ceph-client.admin.50798.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T02:08:07.651 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50798.log.gz 2024-09-12T02:08:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76752.log 2024-09-12T02:08:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59850.log 2024-09-12T02:08:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.audit.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43306.log.gz 2024-09-12T02:08:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67968.log 2024-09-12T02:08:07.651 INFO:teuthology.orchestra.run.smithi019.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.80746.log.gz 2024-09-12T02:08:07.652 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.76752.log.gz 2024-09-12T02:08:07.652 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42071.log 2024-09-12T02:08:07.652 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67968.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59850.log.gz 2024-09-12T02:08:07.652 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68514.log 2024-09-12T02:08:07.652 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67968.log.gz 2024-09-12T02:08:07.652 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41575.log 2024-09-12T02:08:07.652 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.68514.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42071.log.gz 2024-09-12T02:08:07.652 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81745.log 2024-09-12T02:08:07.653 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41575.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68514.log.gz 2024-09-12T02:08:07.653 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85015.log 2024-09-12T02:08:07.653 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41575.log.gz 2024-09-12T02:08:07.653 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.81745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75020.log 2024-09-12T02:08:07.653 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81745.log.gz 2024-09-12T02:08:07.653 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79027.log 2024-09-12T02:08:07.653 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.85015.log.gz 2024-09-12T02:08:07.653 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48693.log 2024-09-12T02:08:07.654 INFO:teuthology.orchestra.run.smithi019.stderr: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T02:08:07.654 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.75020.log.gz 2024-09-12T02:08:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.79027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58999.log 2024-09-12T02:08:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.48693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48693.log.gz 2024-09-12T02:08:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69462.log 2024-09-12T02:08:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72278.log 2024-09-12T02:08:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.69462.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58999.log.gz 2024-09-12T02:08:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63146.log 2024-09-12T02:08:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose 87.9% -- /var/log/ceph/ceph-client.admin.67004.log -- replaced with /var/log/ceph/ceph-client.admin.69462.log.gz 2024-09-12T02:08:07.655 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72278.log: /var/log/ceph/ceph-client.admin.63146.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.79027.log.gz 2024-09-12T02:08:07.655 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72278.log.gz 2024-09-12T02:08:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52243.log 2024-09-12T02:08:07.655 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63146.log.gz 2024-09-12T02:08:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5/var/log/ceph/ceph-client.admin.67004.log: --verbose -- /var/log/ceph/ceph-client.admin.69546.log 2024-09-12T02:08:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77948.log 2024-09-12T02:08:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.69546.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52243.log.gz 2024-09-12T02:08:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54774.log 2024-09-12T02:08:07.656 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69546.log.gz 2024-09-12T02:08:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.77948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62406.log 2024-09-12T02:08:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56611.log 2024-09-12T02:08:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54774.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77948.log.gz 2024-09-12T02:08:07.656 INFO:teuthology.orchestra.run.smithi019.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.67004.log.gz 2024-09-12T02:08:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62406.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54774.log.gz 2024-09-12T02:08:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56732.log 2024-09-12T02:08:07.656 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62406.log.gz 2024-09-12T02:08:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59766.log 2024-09-12T02:08:07.657 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56611.log: /var/log/ceph/ceph-client.admin.56732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61581.log 2024-09-12T02:08:07.657 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56611.log.gz 2024-09-12T02:08:07.657 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59766.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56732.log.gz 2024-09-12T02:08:07.657 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64119.log 2024-09-12T02:08:07.657 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61581.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59766.log.gz 2024-09-12T02:08:07.657 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85590.log 2024-09-12T02:08:07.657 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61581.log.gz 2024-09-12T02:08:07.657 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49049.log 2024-09-12T02:08:07.658 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64119.log.gz 2024-09-12T02:08:07.658 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74820.log 2024-09-12T02:08:07.658 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67546.log 2024-09-12T02:08:07.658 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49049.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.85590.log.gz 2024-09-12T02:08:07.658 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.74820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55674.log 2024-09-12T02:08:07.658 INFO:teuthology.orchestra.run.smithi019.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.49049.log.gz 2024-09-12T02:08:07.658 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84565.log 2024-09-12T02:08:07.658 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0%/var/log/ceph/ceph-client.admin.67546.log: -- replaced with /var/log/ceph/ceph-client.admin.74820.log.gz 2024-09-12T02:08:07.659 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55674.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67546.log.gz 2024-09-12T02:08:07.659 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73554.log 2024-09-12T02:08:07.659 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44650.log 2024-09-12T02:08:07.659 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.84565.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55674.log.gz 2024-09-12T02:08:07.659 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73554.log: gzip -5 88.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.84565.log.gz -- 2024-09-12T02:08:07.659 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.66981.log 2024-09-12T02:08:07.659 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73554.log.gz 2024-09-12T02:08:07.659 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79915.log 2024-09-12T02:08:07.659 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44650.log: /var/log/ceph/ceph-client.admin.66981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56230.log 2024-09-12T02:08:07.660 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44650.log.gz 2024-09-12T02:08:07.660 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.79915.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66981.log.gz 2024-09-12T02:08:07.660 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.79915.log.gz 2024-09-12T02:08:07.660 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65612.log 2024-09-12T02:08:07.660 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87105.log 2024-09-12T02:08:07.660 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56230.log.gz 2024-09-12T02:08:07.660 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82349.log 2024-09-12T02:08:07.660 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65612.log.gz 2024-09-12T02:08:07.661 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82667.log 2024-09-12T02:08:07.661 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.87105.log: /var/log/ceph/ceph-client.admin.82349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53893.log 2024-09-12T02:08:07.661 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.87105.log.gz 2024-09-12T02:08:07.661 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.82667.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.82349.log.gz 2024-09-12T02:08:07.661 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65081.log 2024-09-12T02:08:07.661 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.82667.log.gz 2024-09-12T02:08:07.661 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52369.log 2024-09-12T02:08:07.661 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57640.log 2024-09-12T02:08:07.662 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53893.log.gz 2024-09-12T02:08:07.662 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65081.log: /var/log/ceph/ceph-client.admin.52369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89662.log 2024-09-12T02:08:07.662 INFO:teuthology.orchestra.run.smithi019.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.65081.log.gz 2024-09-12T02:08:07.662 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52369.log.gz 2024-09-12T02:08:07.662 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.57640.log: -- /var/log/ceph/ceph-client.admin.87244.log 2024-09-12T02:08:07.662 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.89662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64563.log 2024-09-12T02:08:07.662 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57640.log.gz 2024-09-12T02:08:07.662 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.87244.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.89662.log.gz 2024-09-12T02:08:07.663 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88089.log 2024-09-12T02:08:07.663 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87244.log.gz 2024-09-12T02:08:07.663 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56671.log 2024-09-12T02:08:07.663 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51195.log 2024-09-12T02:08:07.663 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.88089.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64563.log.gz 2024-09-12T02:08:07.663 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56671.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88089.log.gz 2024-09-12T02:08:07.663 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58391.log 2024-09-12T02:08:07.663 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56671.log.gz 2024-09-12T02:08:07.664 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65566.log 2024-09-12T02:08:07.664 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51195.log: /var/log/ceph/ceph-client.admin.58391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81689.log 2024-09-12T02:08:07.664 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51195.log.gz 2024-09-12T02:08:07.664 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65566.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58391.log.gz 2024-09-12T02:08:07.664 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49307.log 2024-09-12T02:08:07.664 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65566.log.gz 2024-09-12T02:08:07.664 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.81689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61413.log 2024-09-12T02:08:07.664 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52327.log 2024-09-12T02:08:07.665 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49307.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.81689.log.gz 2024-09-12T02:08:07.665 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51068.log 2024-09-12T02:08:07.665 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61413.log.gz 2024-09-12T02:08:07.665 INFO:teuthology.orchestra.run.smithi019.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49307.log.gz 2024-09-12T02:08:07.665 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48963.log 2024-09-12T02:08:07.665 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63592.log 2024-09-12T02:08:07.665 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52327.log.gz 2024-09-12T02:08:07.665 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51068.log.gz 2024-09-12T02:08:07.665 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64896.log 2024-09-12T02:08:07.666 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48963.log.gz 2024-09-12T02:08:07.666 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.63592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67223.log 2024-09-12T02:08:07.666 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81256.log 2024-09-12T02:08:07.666 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63592.log.gz 2024-09-12T02:08:07.666 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64896.log: /var/log/ceph/ceph-client.admin.67223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76775.log 2024-09-12T02:08:07.666 INFO:teuthology.orchestra.run.smithi019.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.64896.log.gz 2024-09-12T02:08:07.666 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67223.log.gz 2024-09-12T02:08:07.666 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79723.log 2024-09-12T02:08:07.667 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.81256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.81256.log.gz 2024-09-12T02:08:07.667 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54571.log 2024-09-12T02:08:07.667 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.79723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49123.log 2024-09-12T02:08:07.667 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.79723.log.gz 2024-09-12T02:08:07.667 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48253.log 2024-09-12T02:08:07.667 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82826.log 2024-09-12T02:08:07.667 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54571.log.gz/var/log/ceph/ceph-client.admin.49123.log: 2024-09-12T02:08:07.667 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48253.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.76775.log.gz 2024-09-12T02:08:07.668 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89392.log 2024-09-12T02:08:07.668 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49123.log.gz 2024-09-12T02:08:07.668 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48253.log.gz 2024-09-12T02:08:07.668 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80587.log 2024-09-12T02:08:07.668 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.82826.log: /var/log/ceph/ceph-client.admin.89392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83760.log 2024-09-12T02:08:07.668 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.82826.log.gz 2024-09-12T02:08:07.668 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80587.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.89392.log.gz 2024-09-12T02:08:07.668 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58025.log 2024-09-12T02:08:07.669 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.80587.log.gz 2024-09-12T02:08:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.83760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55970.log 2024-09-12T02:08:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.83760.log.gz -5 2024-09-12T02:08:07.669 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.72077.log 2024-09-12T02:08:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.58025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58025.log.gz 2024-09-12T02:08:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.55970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84407.log 2024-09-12T02:08:07.669 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55970.log.gz 2024-09-12T02:08:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54956.log 2024-09-12T02:08:07.670 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.84407.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.72077.log.gz 2024-09-12T02:08:07.670 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74037.log 2024-09-12T02:08:07.670 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.84407.log.gz 2024-09-12T02:08:07.670 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86633.log 2024-09-12T02:08:07.670 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54956.log.gz 2024-09-12T02:08:07.670 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.74037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46898.log 2024-09-12T02:08:07.670 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74037.log.gz 2024-09-12T02:08:07.670 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.86633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87978.log 2024-09-12T02:08:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84973.log 2024-09-12T02:08:07.671 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4%/var/log/ceph/ceph-client.admin.46898.log: -- replaced with /var/log/ceph/ceph-client.admin.86633.log.gz 2024-09-12T02:08:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.87978.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46898.log.gz 2024-09-12T02:08:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82140.log 2024-09-12T02:08:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.84973.log: /var/log/ceph/ceph-client.admin.72320.log 2024-09-12T02:08:07.671 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87978.log.gz 2024-09-12T02:08:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.82140.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.84973.log.gz 2024-09-12T02:08:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43348.log 2024-09-12T02:08:07.671 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.82140.log.gz 2024-09-12T02:08:07.672 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64748.log 2024-09-12T02:08:07.672 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43390.log 2024-09-12T02:08:07.672 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.72320.log.gz 2024-09-12T02:08:07.672 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43348.log.gz 2024-09-12T02:08:07.672 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62912.log 2024-09-12T02:08:07.672 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48043.log 2024-09-12T02:08:07.672 INFO:teuthology.orchestra.run.smithi019.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.64748.log.gz 2024-09-12T02:08:07.672 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43390.log.gz 2024-09-12T02:08:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59808.log 2024-09-12T02:08:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48043.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.62912.log.gz 2024-09-12T02:08:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52749.log 2024-09-12T02:08:07.673 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48043.log.gz 2024-09-12T02:08:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43776.log 2024-09-12T02:08:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.52749.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59808.log.gz 2024-09-12T02:08:07.673 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52749.log.gz 2024-09-12T02:08:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78415.log 2024-09-12T02:08:07.674 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84931.log 2024-09-12T02:08:07.674 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78415.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43776.log.gz 2024-09-12T02:08:07.674 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59041.log 2024-09-12T02:08:07.674 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78415.log.gz 2024-09-12T02:08:07.674 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.84931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68837.log 2024-09-12T02:08:07.674 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59041.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.84931.log.gz 2024-09-12T02:08:07.674 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75492.log 2024-09-12T02:08:07.674 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59041.log.gz 2024-09-12T02:08:07.674 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.68837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70821.log 2024-09-12T02:08:07.675 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68837.log.gz 2024-09-12T02:08:07.675 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62116.log 2024-09-12T02:08:07.675 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75492.log.gz 2024-09-12T02:08:07.675 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.70821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62534.log 2024-09-12T02:08:07.675 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70821.log.gz 2024-09-12T02:08:07.675 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78457.log 2024-09-12T02:08:07.675 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62116.log.gz 2024-09-12T02:08:07.675 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55086.log 2024-09-12T02:08:07.676 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64267.log 2024-09-12T02:08:07.676 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62534.log.gz 2024-09-12T02:08:07.676 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78457.log: /var/log/ceph/ceph-client.admin.55086.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.78457.log.gz 2024-09-12T02:08:07.676 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44117.log 2024-09-12T02:08:07.676 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88173.log 2024-09-12T02:08:07.676 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55086.log.gz 2024-09-12T02:08:07.676 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64267.log: /var/log/ceph/ceph-client.admin.44117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60271.log 2024-09-12T02:08:07.676 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64267.log.gz 2024-09-12T02:08:07.677 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66237.log 2024-09-12T02:08:07.677 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44117.log.gz 2024-09-12T02:08:07.677 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.88173.log: /var/log/ceph/ceph-client.admin.60271.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88173.log.gz 2024-09-12T02:08:07.677 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47564.log 2024-09-12T02:08:07.677 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59216.log 2024-09-12T02:08:07.677 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60271.log.gz 2024-09-12T02:08:07.677 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66237.log: /var/log/ceph/ceph-client.admin.47564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75408.log 2024-09-12T02:08:07.677 INFO:teuthology.orchestra.run.smithi019.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.66237.log.gz 2024-09-12T02:08:07.677 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73577.log 2024-09-12T02:08:07.678 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47564.log.gz 2024-09-12T02:08:07.678 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59216.log: /var/log/ceph/ceph-client.admin.75408.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59216.log.gz 2024-09-12T02:08:07.678 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79615.log 2024-09-12T02:08:07.678 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51903.log 2024-09-12T02:08:07.678 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73577.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75408.log.gz 2024-09-12T02:08:07.678 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.79615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80404.log 2024-09-12T02:08:07.678 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.79615.log.gz 2024-09-12T02:08:07.679 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77888.log 2024-09-12T02:08:07.679 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80404.log: gzip 88.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.51903.log.gz --verbose 2024-09-12T02:08:07.679 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.53721.log 2024-09-12T02:08:07.679 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.77888.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.80404.log.gz 2024-09-12T02:08:07.679 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61895.log 2024-09-12T02:08:07.679 INFO:teuthology.orchestra.run.smithi019.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.73577.log.gz 2024-09-12T02:08:07.679 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77888.log.gz 2024-09-12T02:08:07.679 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81952.log 2024-09-12T02:08:07.679 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67705.log 2024-09-12T02:08:07.680 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53721.log.gz 2024-09-12T02:08:07.680 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61895.log.gz 2024-09-12T02:08:07.680 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.81952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60578.log 2024-09-12T02:08:07.680 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.81952.log.gz 2024-09-12T02:08:07.680 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49868.log 2024-09-12T02:08:07.680 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77637.log 2024-09-12T02:08:07.680 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67705.log.gz 2024-09-12T02:08:07.680 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60578.log: /var/log/ceph/ceph-client.admin.49868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56915.log 88.5% 2024-09-12T02:08:07.681 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60578.log.gz 2024-09-12T02:08:07.681 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49868.log.gz 2024-09-12T02:08:07.681 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57682.log 2024-09-12T02:08:07.681 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.77637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.77637.log.gz 2024-09-12T02:08:07.681 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55716.log 2024-09-12T02:08:07.681 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74493.log 2024-09-12T02:08:07.681 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69233.log 2024-09-12T02:08:07.681 INFO:teuthology.orchestra.run.smithi019.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56915.log.gz 2024-09-12T02:08:07.682 INFO:teuthology.orchestra.run.smithi019.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57682.log.gz 2024-09-12T02:08:07.682 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.74493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44450.log 2024-09-12T02:08:07.682 INFO:teuthology.orchestra.run.smithi019.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55716.log.gz 2024-09-12T02:08:07.682 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59556.log 2024-09-12T02:08:07.682 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.69233.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74493.log.gz 2024-09-12T02:08:07.682 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50429.log 2024-09-12T02:08:07.682 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69233.log.gz 2024-09-12T02:08:07.682 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44450.log.gz 2024-09-12T02:08:07.682 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75300.log 2024-09-12T02:08:07.683 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43780.log 2024-09-12T02:08:07.683 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50429.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59556.log.gz 2024-09-12T02:08:07.683 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52561.log 2024-09-12T02:08:07.683 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50429.log.gz 2024-09-12T02:08:07.683 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36176.log 2024-09-12T02:08:07.683 INFO:teuthology.orchestra.run.smithi019.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.75300.log.gz 2024-09-12T02:08:07.683 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80892.log 2024-09-12T02:08:07.683 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43780.log.gz 2024-09-12T02:08:07.684 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52561.log.gz 2024-09-12T02:08:07.684 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63657.log 2024-09-12T02:08:07.684 INFO:teuthology.orchestra.run.smithi019.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.36176.log.gz 2024-09-12T02:08:07.684 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58476.log 2024-09-12T02:08:07.684 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48127.log 2024-09-12T02:08:07.684 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.63657.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.80892.log.gz 2024-09-12T02:08:07.684 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53564.log 2024-09-12T02:08:07.684 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58476.log.gz 2024-09-12T02:08:07.685 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48313.log 2024-09-12T02:08:07.685 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58518.log 2024-09-12T02:08:07.685 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53564.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48127.log.gz 2024-09-12T02:08:07.685 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50161.log 2024-09-12T02:08:07.685 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53564.log.gz 2024-09-12T02:08:07.685 INFO:teuthology.orchestra.run.smithi019.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.63657.log.gz 2024-09-12T02:08:07.685 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44944.log 2024-09-12T02:08:07.685 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48313.log.gz 2024-09-12T02:08:07.685 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58518.log.gz 2024-09-12T02:08:07.686 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84019.log 2024-09-12T02:08:07.686 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50161.log: /var/log/ceph/ceph-client.admin.44944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66593.log 2024-09-12T02:08:07.686 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50161.log.gz 2024-09-12T02:08:07.686 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.84019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71378.log 2024-09-12T02:08:07.686 INFO:teuthology.orchestra.run.smithi019.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.44944.log.gz 2024-09-12T02:08:07.686 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84019.log.gz 2024-09-12T02:08:07.686 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66593.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-12T02:08:07.686 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- 89.2% /var/log/ceph/ceph-client.admin.41943.log -- replaced with /var/log/ceph/ceph-client.admin.66593.log.gz 2024-09-12T02:08:07.687 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.687 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.71378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.71378.log.gz 2024-09-12T02:08:07.687 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75240.log 2024-09-12T02:08:07.687 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65355.log 2024-09-12T02:08:07.687 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41943.log.gz 2024-09-12T02:08:07.687 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88299.log 2024-09-12T02:08:07.687 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82526.log 2024-09-12T02:08:07.687 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75240.log.gz 2024-09-12T02:08:07.687 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.88299.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65355.log.gz 2024-09-12T02:08:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75809.log 2024-09-12T02:08:07.688 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88299.log.gz 2024-09-12T02:08:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.82526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65420.log 2024-09-12T02:08:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75809.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.82526.log.gz 2024-09-12T02:08:07.688 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.86189.log 2024-09-12T02:08:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65420.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75809.log.gzgzip 2024-09-12T02:08:07.688 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42871.log 2024-09-12T02:08:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.86189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85057.log 2024-09-12T02:08:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42871.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.46729.log 2024-09-12T02:08:07.689 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.86189.log.gz 2024-09-12T02:08:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66116.log 2024-09-12T02:08:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:gzip 89.5% -5 --verbose -- /var/log/ceph/ceph-client.admin.83860.log 2024-09-12T02:08:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46729.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.65420.log.gz 2024-09-12T02:08:07.689 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.85057.log.gz 2024-09-12T02:08:07.689 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46729.log.gz 2024-09-12T02:08:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42281.log 2024-09-12T02:08:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66116.log: /var/log/ceph/ceph-client.admin.83860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76514.log 2024-09-12T02:08:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48211.log 2024-09-12T02:08:07.690 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.83860.log.gz 2024-09-12T02:08:07.690 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66116.log.gz 2024-09-12T02:08:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76514.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.42871.log.gz 2024-09-12T02:08:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51321.log 2024-09-12T02:08:07.690 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42281.log.gz 2024-09-12T02:08:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76514.log.gz 2024-09-12T02:08:07.691 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose --/var/log/ceph/ceph-client.admin.48211.log: /var/log/ceph/ceph-client.admin.64489.log 2024-09-12T02:08:07.691 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51321.log: gzip -5 --verbose -- 87.9% /var/log/ceph/ceph-client.0.49561.log 2024-09-12T02:08:07.691 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48211.log.gz 2024-09-12T02:08:07.691 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51321.log.gz 2024-09-12T02:08:07.691 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69681.log 2024-09-12T02:08:07.691 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70475.log 2024-09-12T02:08:07.691 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.49561.log: 0.0% 89.5% -- replaced with /var/log/ceph/ceph-client.admin.64489.log.gz 2024-09-12T02:08:07.691 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.0.49561.log.gz 2024-09-12T02:08:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.69681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43600.log 2024-09-12T02:08:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.70475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88846.log 89.2% 2024-09-12T02:08:07.692 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69681.log.gz 2024-09-12T02:08:07.692 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70475.log.gz 2024-09-12T02:08:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73142.log 2024-09-12T02:08:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74609.log 2024-09-12T02:08:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.88846.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43600.log.gz 2024-09-12T02:08:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89350.log 2024-09-12T02:08:07.693 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88846.log.gz 2024-09-12T02:08:07.693 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73142.log.gz 2024-09-12T02:08:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.74609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69923.log 2024-09-12T02:08:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.89350.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.74609.log.gz 2024-09-12T02:08:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68268.log 2024-09-12T02:08:07.693 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.89350.log.gz 2024-09-12T02:08:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.69923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69839.log 2024-09-12T02:08:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.68268.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69923.log.gz 2024-09-12T02:08:07.693 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.68268.log.gz 2024-09-12T02:08:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55782.log 2024-09-12T02:08:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88131.log 2024-09-12T02:08:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.69839.log: /var/log/ceph/ceph-client.admin.55782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61371.log 2024-09-12T02:08:07.694 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69839.log.gz 2024-09-12T02:08:07.694 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8%/var/log/ceph/ceph-client.admin.88131.log: -- replaced with /var/log/ceph/ceph-client.admin.55782.log.gz 2024-09-12T02:08:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60535.log 2024-09-12T02:08:07.694 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88131.log.gz 2024-09-12T02:08:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53522.log 2024-09-12T02:08:07.695 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60535.log: gzip 88.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.61371.log.gz --verbose 2024-09-12T02:08:07.695 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.41985.log 2024-09-12T02:08:07.695 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60535.log.gz 2024-09-12T02:08:07.695 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72647.log 2024-09-12T02:08:07.695 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41985.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.53522.log.gz 2024-09-12T02:08:07.695 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43782.log 2024-09-12T02:08:07.695 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41985.log.gz 2024-09-12T02:08:07.695 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70923.log 2024-09-12T02:08:07.695 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43782.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72647.log.gz 2024-09-12T02:08:07.696 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55296.log 2024-09-12T02:08:07.696 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43782.log.gz 2024-09-12T02:08:07.696 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.70923.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.63634.log 2024-09-12T02:08:07.696 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86483.log 2024-09-12T02:08:07.696 INFO:teuthology.orchestra.run.smithi019.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.70923.log.gz 2024-09-12T02:08:07.696 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55296.log.gz 2024-09-12T02:08:07.696 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.63634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46236.log 2024-09-12T02:08:07.696 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.86483.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63634.log.gz 2024-09-12T02:08:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73754.log 2024-09-12T02:08:07.697 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.86483.log.gz 2024-09-12T02:08:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.46236.log: -- /var/log/ceph/ceph-client.admin.82409.log 2024-09-12T02:08:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71586.log 2024-09-12T02:08:07.697 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46236.log.gz 2024-09-12T02:08:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.82409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87448.log 88.3% 2024-09-12T02:08:07.697 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73754.log.gz 2024-09-12T02:08:07.697 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82409.log.gz 2024-09-12T02:08:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.71586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84472.log 2024-09-12T02:08:07.698 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71586.log.gz 2024-09-12T02:08:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.87448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60883.log 2024-09-12T02:08:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.84472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67772.log 2024-09-12T02:08:07.698 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87448.log.gz 2024-09-12T02:08:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77341.log 2024-09-12T02:08:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67772.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60883.log.gz 2024-09-12T02:08:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86017.log 2024-09-12T02:08:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.77341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82905.log 2024-09-12T02:08:07.699 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85183.log 2024-09-12T02:08:07.699 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.77341.log.gz 2024-09-12T02:08:07.699 INFO:teuthology.orchestra.run.smithi019.stderr: 92.5%/var/log/ceph/ceph-client.admin.86017.log: -- replaced with /var/log/ceph/ceph-client.admin.84472.log.gz 2024-09-12T02:08:07.699 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.82905.log: gzip -5 88.8% -- replaced with /var/log/ceph/ceph-client.admin.86017.log.gz 2024-09-12T02:08:07.699 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.80227.log 2024-09-12T02:08:07.699 INFO:teuthology.orchestra.run.smithi019.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.82905.log.gz 92.4% -- replaced with /var/log/ceph/ceph-client.admin.67772.log.gz 2024-09-12T02:08:07.699 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85183.log: 2024-09-12T02:08:07.699 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59472.log 2024-09-12T02:08:07.700 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.85183.log.gz 2024-09-12T02:08:07.700 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76103.log 2024-09-12T02:08:07.700 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59472.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80227.log.gz 2024-09-12T02:08:07.700 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72764.log 2024-09-12T02:08:07.700 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76103.log: gzip -5 88.7% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.59472.log.gz /var/log/ceph/ceph-client.2.45889.log 2024-09-12T02:08:07.700 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.700 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.76103.log.gz 2024-09-12T02:08:07.700 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80287.log 2024-09-12T02:08:07.701 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88401.log 2024-09-12T02:08:07.701 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72764.log.gz 2024-09-12T02:08:07.701 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.2.45889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45889.log.gz 2024-09-12T02:08:07.701 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67377.log 2024-09-12T02:08:07.701 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.80287.log.gz/var/log/ceph/ceph-client.admin.88401.log: 2024-09-12T02:08:07.701 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67865.log 2024-09-12T02:08:07.701 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67377.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88401.log.gz 2024-09-12T02:08:07.701 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75198.log 2024-09-12T02:08:07.701 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67377.log.gz 2024-09-12T02:08:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72922.log 2024-09-12T02:08:07.702 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67865.log.gz 2024-09-12T02:08:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80503.log 2024-09-12T02:08:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51852.log 2024-09-12T02:08:07.702 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9%/var/log/ceph/ceph-client.admin.72922.log: -- replaced with /var/log/ceph/ceph-client.admin.75198.log.gz 2024-09-12T02:08:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44115.log 2024-09-12T02:08:07.702 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72922.log.gz 2024-09-12T02:08:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63768.log 2024-09-12T02:08:07.702 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.80503.log.gz 2024-09-12T02:08:07.703 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51852.log.gz 2024-09-12T02:08:07.703 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59428.log 2024-09-12T02:08:07.703 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62702.log 2024-09-12T02:08:07.703 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.63768.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44115.log.gz 2024-09-12T02:08:07.703 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50527.log 2024-09-12T02:08:07.703 INFO:teuthology.orchestra.run.smithi019.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.63768.log.gz 2024-09-12T02:08:07.703 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62702.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59428.log.gzgzip 2024-09-12T02:08:07.703 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44692.log 2024-09-12T02:08:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56087.log 2024-09-12T02:08:07.704 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62702.log.gz 2024-09-12T02:08:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71762.log 2024-09-12T02:08:07.704 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44692.log.gz 2024-09-12T02:08:07.704 INFO:teuthology.orchestra.run.smithi019.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50527.log.gz 2024-09-12T02:08:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49565.log 2024-09-12T02:08:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.71762.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56087.log.gz 2024-09-12T02:08:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52957.log 2024-09-12T02:08:07.704 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71762.log.gz 2024-09-12T02:08:07.705 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.49565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53805.log 0.0% 2024-09-12T02:08:07.705 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.0.49565.log.gz 2024-09-12T02:08:07.705 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74885.log 2024-09-12T02:08:07.705 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52957.log: /var/log/ceph/ceph-client.admin.53805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53763.log 2024-09-12T02:08:07.705 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52957.log.gz 2024-09-12T02:08:07.705 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53805.log.gz 2024-09-12T02:08:07.705 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.74885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58957.log 2024-09-12T02:08:07.705 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70979.log 2024-09-12T02:08:07.706 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53763.log.gz 2024-09-12T02:08:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55422.log 2024-09-12T02:08:07.706 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58957.log.gz 2024-09-12T02:08:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.70979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77846.log 2024-09-12T02:08:07.706 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70979.log.gz 2024-09-12T02:08:07.706 INFO:teuthology.orchestra.run.smithi019.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.74885.log.gz 2024-09-12T02:08:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67493.log 2024-09-12T02:08:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.77846.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55422.log.gz 2024-09-12T02:08:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 88.7% 2024-09-12T02:08:07.707 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.77846.log.gz 2024-09-12T02:08:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60620.log 2024-09-12T02:08:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80052.log 2024-09-12T02:08:07.707 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67493.log.gz 2024-09-12T02:08:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57532.log 2024-09-12T02:08:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80052.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60620.log.gz 2024-09-12T02:08:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47108.log 2024-09-12T02:08:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76010.log 2024-09-12T02:08:07.708 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57532.log.gz 2024-09-12T02:08:07.708 INFO:teuthology.orchestra.run.smithi019.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.80052.log.gz 2024-09-12T02:08:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79004.log 2024-09-12T02:08:07.708 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47108.log.gz 2024-09-12T02:08:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65912.log 2024-09-12T02:08:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.79004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76356.log 2024-09-12T02:08:07.708 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.79004.log.gz 2024-09-12T02:08:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.65912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65912.log.gz 2024-09-12T02:08:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64452.log 2024-09-12T02:08:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50966.log 2024-09-12T02:08:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76356.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.76010.log.gz 2024-09-12T02:08:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43558.log 2024-09-12T02:08:07.709 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76356.log.gz 2024-09-12T02:08:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64452.log: /var/log/ceph/ceph-client.admin.50966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69741.log 2024-09-12T02:08:07.709 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5%/var/log/ceph/ceph-client.admin.43558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65720.log 2024-09-12T02:08:07.709 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50966.log.gz 2024-09-12T02:08:07.709 INFO:teuthology.orchestra.run.smithi019.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.64452.log.gz 2024-09-12T02:08:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.69741.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43558.log.gz 2024-09-12T02:08:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59640.log 2024-09-12T02:08:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65720.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.69741.log.gz 2024-09-12T02:08:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64822.log 2024-09-12T02:08:07.710 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65720.log.gz 2024-09-12T02:08:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54290.log 2024-09-12T02:08:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64822.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59640.log.gz 2024-09-12T02:08:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64156.log 2024-09-12T02:08:07.711 INFO:teuthology.orchestra.run.smithi019.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.64822.log.gz 2024-09-12T02:08:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86821.log 2024-09-12T02:08:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64156.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54290.log.gz 2024-09-12T02:08:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61539.log 2024-09-12T02:08:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.86821.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.64156.log.gz 2024-09-12T02:08:07.711 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.86821.log.gz 2024-09-12T02:08:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63038.log 2024-09-12T02:08:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66200.log 2024-09-12T02:08:07.712 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4%/var/log/ceph/ceph-client.admin.63038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65229.log 2024-09-12T02:08:07.712 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61539.log.gz 2024-09-12T02:08:07.712 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53276.log 2024-09-12T02:08:07.712 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63038.log.gz 2024-09-12T02:08:07.712 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69156.log 2024-09-12T02:08:07.712 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65229.log: /var/log/ceph/ceph-client.admin.53276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70274.log 2024-09-12T02:08:07.712 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.69156.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53276.log.gz 90.0% -- replaced with /var/log/ceph/ceph-client.admin.65229.log.gz 2024-09-12T02:08:07.712 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.713 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69156.log.gz 2024-09-12T02:08:07.713 INFO:teuthology.orchestra.run.smithi019.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.66200.log.gz 2024-09-12T02:08:07.713 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69504.log 2024-09-12T02:08:07.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.70274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42431.log 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70274.log.gz 2024-09-12T02:08:07.713 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.69504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78803.log 2024-09-12T02:08:07.713 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69504.log.gz 2024-09-12T02:08:07.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62954.log 2024-09-12T02:08:07.713 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42431.log.gz 2024-09-12T02:08:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74516.log 2024-09-12T02:08:07.714 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78803.log.gz 2024-09-12T02:08:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71898.log 2024-09-12T02:08:07.714 INFO:teuthology.orchestra.run.smithi019.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.62954.log.gz 2024-09-12T02:08:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.74516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55128.log 2024-09-12T02:08:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.71898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64193.log 2024-09-12T02:08:07.714 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.71898.log.gz 2024-09-12T02:08:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55464.log 2024-09-12T02:08:07.715 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55128.log.gz/var/log/ceph/ceph-client.admin.64193.log: 2024-09-12T02:08:07.715 INFO:teuthology.orchestra.run.smithi019.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.74516.log.gz 2024-09-12T02:08:07.715 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75567.log 2024-09-12T02:08:07.715 INFO:teuthology.orchestra.run.smithi019.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.64193.log.gz 2024-09-12T02:08:07.715 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63953.log 2024-09-12T02:08:07.715 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55464.log: /var/log/ceph/ceph-client.admin.75567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89098.log 2024-09-12T02:08:07.715 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55464.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81798.log 2024-09-12T02:08:07.715 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.716 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75567.log.gz 2024-09-12T02:08:07.716 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.63953.log: /var/log/ceph/ceph-client.admin.89098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72497.log 2024-09-12T02:08:07.716 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63953.log.gz 2024-09-12T02:08:07.716 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.89098.log.gz 2024-09-12T02:08:07.716 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.81798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87406.log 2024-09-12T02:08:07.716 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.81798.log.gz 2024-09-12T02:08:07.716 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44333.log 2024-09-12T02:08:07.716 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.87406.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.72497.log.gz 2024-09-12T02:08:07.716 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86399.log 2024-09-12T02:08:07.717 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87406.log.gz 2024-09-12T02:08:07.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71669.log 2024-09-12T02:08:07.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.86399.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44333.log.gz 2024-09-12T02:08:07.717 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72689.log 2024-09-12T02:08:07.717 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.86399.log.gz 2024-09-12T02:08:07.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.71669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47913.log 2024-09-12T02:08:07.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84752.log 2024-09-12T02:08:07.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47913.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72689.log.gz 2024-09-12T02:08:07.717 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85285.log 2024-09-12T02:08:07.718 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47913.log.gz 2024-09-12T02:08:07.718 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose 92.4% -- /var/log/ceph/ceph-client.admin.72040.log -- replaced with /var/log/ceph/ceph-client.admin.71669.log.gz 2024-09-12T02:08:07.718 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.718 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.84752.log: gzip/var/log/ceph/ceph-client.admin.85285.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.84752.log.gz 2024-09-12T02:08:07.718 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64674.log 2024-09-12T02:08:07.718 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72040.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.85285.log.gz 2024-09-12T02:08:07.718 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48697.log 2024-09-12T02:08:07.718 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55590.log 2024-09-12T02:08:07.718 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.48697.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.64674.log.gz 2024-09-12T02:08:07.719 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71814.log 2024-09-12T02:08:07.719 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48697.log.gz 2024-09-12T02:08:07.719 INFO:teuthology.orchestra.run.smithi019.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.72040.log.gz 2024-09-12T02:08:07.719 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84710.log 2024-09-12T02:08:07.719 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85880.log 2024-09-12T02:08:07.719 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.71814.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55590.log.gz 2024-09-12T02:08:07.719 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.84710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74862.log 2024-09-12T02:08:07.719 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71814.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70662.log 2024-09-12T02:08:07.720 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.720 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.84710.log.gz 2024-09-12T02:08:07.720 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85880.log: /var/log/ceph/ceph-client.admin.74862.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.85880.log.gz 2024-09-12T02:08:07.720 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose 89.3% -- replaced with /var/log/ceph/ceph-client.admin.74862.log.gz 2024-09-12T02:08:07.720 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.52285.log 2024-09-12T02:08:07.720 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.70662.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T02:08:07.720 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70662.log.gz 2024-09-12T02:08:07.720 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86357.log 2024-09-12T02:08:07.721 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.2.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52285.log.gz 2024-09-12T02:08:07.721 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48169.log 2024-09-12T02:08:07.721 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.86357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64027.log 2024-09-12T02:08:07.721 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86357.log.gz 2024-09-12T02:08:07.721 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67747.log 2024-09-12T02:08:07.721 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48169.log.gz 2024-09-12T02:08:07.721 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84332.log 2024-09-12T02:08:07.721 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72460.log 2024-09-12T02:08:07.721 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67747.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.64027.log.gz/var/log/ceph/ceph-client.admin.84332.log: 2024-09-12T02:08:07.722 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67747.log.gz 87.9% -- replaced with /var/log/ceph/ceph-client.admin.84332.log.gz 2024-09-12T02:08:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64711.log 2024-09-12T02:08:07.722 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78658.log 2024-09-12T02:08:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57401.log 2024-09-12T02:08:07.722 INFO:teuthology.orchestra.run.smithi019.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.64711.log.gz 2024-09-12T02:08:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78658.log: gzip 92.6% -- replaced with /var/log/ceph/ceph-client.admin.72460.log.gz 2024-09-12T02:08:07.722 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.80311.log 2024-09-12T02:08:07.723 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67181.log 2024-09-12T02:08:07.723 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57401.log.gz 2024-09-12T02:08:07.723 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79657.log 92.4% -- replaced with /var/log/ceph/ceph-client.admin.78658.log.gz 2024-09-12T02:08:07.723 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.723 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78140.log 2024-09-12T02:08:07.723 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67181.log.gz 2024-09-12T02:08:07.723 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.79657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64415.log 2024-09-12T02:08:07.723 INFO:teuthology.orchestra.run.smithi019.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.80311.log.gz 2024-09-12T02:08:07.723 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65118.log 2024-09-12T02:08:07.724 INFO:teuthology.orchestra.run.smithi019.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.79657.log.gz 2024-09-12T02:08:07.724 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78140.log.gz 2024-09-12T02:08:07.724 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85836.log 2024-09-12T02:08:07.724 INFO:teuthology.orchestra.run.smithi019.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.64415.log.gz/var/log/ceph/ceph-client.admin.65118.log: 2024-09-12T02:08:07.724 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47829.log 2024-09-12T02:08:07.724 INFO:teuthology.orchestra.run.smithi019.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.65118.log.gz 2024-09-12T02:08:07.724 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71973.log 2024-09-12T02:08:07.724 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.85836.log.gz 2024-09-12T02:08:07.725 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47192.log 2024-09-12T02:08:07.725 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47829.log: /var/log/ceph/ceph-client.admin.71973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52075.log 2024-09-12T02:08:07.725 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47192.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47829.log.gz 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71973.log.gz 2024-09-12T02:08:07.725 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.725 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47192.log.gz 2024-09-12T02:08:07.725 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49677.log 2024-09-12T02:08:07.725 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88888.log 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52075.log.gz 2024-09-12T02:08:07.725 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.726 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63080.log 2024-09-12T02:08:07.726 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49677.log.gz 2024-09-12T02:08:07.726 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.88888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78373.log 2024-09-12T02:08:07.726 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88888.log.gz 2024-09-12T02:08:07.726 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70082.log 2024-09-12T02:08:07.726 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.63080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56981.log 2024-09-12T02:08:07.726 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78373.log: /var/log/ceph/ceph-client.admin.70082.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78373.log.gz 2024-09-12T02:08:07.726 INFO:teuthology.orchestra.run.smithi019.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.63080.log.gz 2024-09-12T02:08:07.727 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70119.log 2024-09-12T02:08:07.727 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61979.log 2024-09-12T02:08:07.727 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56981.log.gz 2024-09-12T02:08:07.727 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.70119.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.70082.log.gz 2024-09-12T02:08:07.727 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55338.log 2024-09-12T02:08:07.727 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61979.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.70119.log.gz 2024-09-12T02:08:07.727 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61979.log.gz 2024-09-12T02:08:07.727 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78695.log 2024-09-12T02:08:07.727 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54080.log 2024-09-12T02:08:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55338.log: /var/log/ceph/ceph-client.admin.78695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88762.log 2024-09-12T02:08:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54080.log: 88.8% 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55338.log.gz 2024-09-12T02:08:07.728 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78695.log.gz 2024-09-12T02:08:07.728 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54080.log.gz 2024-09-12T02:08:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46152.log 2024-09-12T02:08:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86567.log 2024-09-12T02:08:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.88762.log: gzip -5/var/log/ceph/ceph-client.admin.46152.log: --verbose -- /var/log/ceph/ceph-client.admin.85495.log 2024-09-12T02:08:07.728 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88762.log.gz 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46152.log.gz 2024-09-12T02:08:07.729 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.86567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85794.log 2024-09-12T02:08:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74225.log 2024-09-12T02:08:07.729 INFO:teuthology.orchestra.run.smithi019.stderr: 90.8% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.85495.log.gz 2024-09-12T02:08:07.729 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.86567.log.gz 2024-09-12T02:08:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85794.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T02:08:07.729 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.85794.log.gz/var/log/ceph/ceph-client.0.74225.log: 2024-09-12T02:08:07.729 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.74225.log.gz 2024-09-12T02:08:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54206.log 2024-09-12T02:08:07.730 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose/var/log/ceph/ceph-mgr.y.log: -- /var/log/ceph/ceph-client.admin.73184.log 2024-09-12T02:08:07.730 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44118.log 2024-09-12T02:08:07.730 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54206.log.gz 2024-09-12T02:08:07.730 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66672.log 2024-09-12T02:08:07.730 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44118.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73184.log.gz 2024-09-12T02:08:07.730 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44118.log.gz 2024-09-12T02:08:07.730 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51945.log 2024-09-12T02:08:07.730 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67437.log 2024-09-12T02:08:07.731 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.66672.log.gz 2024-09-12T02:08:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51945.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89518.log 2024-09-12T02:08:07.731 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51945.log.gz 2024-09-12T02:08:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67437.log: gzip -5 --verbose 89.7% -- replaced with /var/log/ceph/ceph-client.admin.67437.log.gz 2024-09-12T02:08:07.731 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.43264.log 2024-09-12T02:08:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73300.log 2024-09-12T02:08:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.89518.log: /var/log/ceph/ceph-client.admin.43264.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.89518.log.gz 2024-09-12T02:08:07.731 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43264.log.gz 2024-09-12T02:08:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48439.log 2024-09-12T02:08:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73207.log 2024-09-12T02:08:07.732 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73300.log.gz 2024-09-12T02:08:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80010.log 2024-09-12T02:08:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73207.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48439.log.gz 2024-09-12T02:08:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68537.log 2024-09-12T02:08:07.732 INFO:teuthology.orchestra.run.smithi019.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.73207.log.gz 2024-09-12T02:08:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74661.log 2024-09-12T02:08:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.68537.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.80010.log.gz 2024-09-12T02:08:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74922.log 2024-09-12T02:08:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.74661.log: 94.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T02:08:07.733 INFO:teuthology.orchestra.run.smithi019.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.68537.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54861.log 2024-09-12T02:08:07.733 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.733 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74661.log.gz 2024-09-12T02:08:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.74922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79460.log 2024-09-12T02:08:07.733 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3%/var/log/ceph/ceph-client.admin.54861.log: -- replaced with /var/log/ceph/ceph-client.admin.74922.log.gz 2024-09-12T02:08:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77145.log 2024-09-12T02:08:07.734 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54861.log.gz 2024-09-12T02:08:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54037.log 2024-09-12T02:08:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.79460.log: /var/log/ceph/ceph-client.admin.77145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84196.log 2024-09-12T02:08:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54037.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.79460.log.gz 2024-09-12T02:08:07.734 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54037.log.gz 2024-09-12T02:08:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78056.log 2024-09-12T02:08:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.84196.log: -- /var/log/ceph/ceph-client.admin.51746.log 2024-09-12T02:08:07.734 INFO:teuthology.orchestra.run.smithi019.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.77145.log.gz 2024-09-12T02:08:07.735 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.84196.log.gz/var/log/ceph/ceph-client.admin.78056.log: 2024-09-12T02:08:07.735 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43779.log 2024-09-12T02:08:07.735 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78056.log.gz 2024-09-12T02:08:07.735 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82961.log 2024-09-12T02:08:07.735 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51746.log.gz 2024-09-12T02:08:07.735 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56785.log 2024-09-12T02:08:07.735 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43779.log.gz 2024-09-12T02:08:07.735 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.82961.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T02:08:07.735 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.82961.log.gz 2024-09-12T02:08:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66039.log 2024-09-12T02:08:07.736 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56785.log.gz 2024-09-12T02:08:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77005.log 2024-09-12T02:08:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43516.log 2024-09-12T02:08:07.736 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66039.log.gz 2024-09-12T02:08:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.77005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44451.log 2024-09-12T02:08:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43516.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.77005.log.gz 2024-09-12T02:08:07.736 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43516.log.gz 2024-09-12T02:08:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71021.log 2024-09-12T02:08:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52495.log 2024-09-12T02:08:07.737 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44451.log.gz 2024-09-12T02:08:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.71021.log: gzip -5 --verbose -- 87.1% /var/log/ceph/ceph-client.admin.76155.log 2024-09-12T02:08:07.737 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T02:08:07.737 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71021.log.gz 2024-09-12T02:08:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57594.log 2024-09-12T02:08:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76155.log: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42155.log 2024-09-12T02:08:07.738 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52495.log.gz 2024-09-12T02:08:07.738 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76155.log.gz 2024-09-12T02:08:07.738 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62618.log 2024-09-12T02:08:07.738 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57594.log: /var/log/ceph/ceph-client.admin.42155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73712.log 2024-09-12T02:08:07.738 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62618.log: 88.9% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42155.log.gz 2024-09-12T02:08:07.738 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57594.log.gz 2024-09-12T02:08:07.738 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62618.log.gz 2024-09-12T02:08:07.738 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83667.log 2024-09-12T02:08:07.738 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84449.log 2024-09-12T02:08:07.739 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73712.log.gz 2024-09-12T02:08:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.83667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85453.log 2024-09-12T02:08:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.84449.log: -- /var/log/ceph/ceph-client.admin.89182.log 2024-09-12T02:08:07.739 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.84449.log.gz 2024-09-12T02:08:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45452.log 2024-09-12T02:08:07.739 INFO:teuthology.orchestra.run.smithi019.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.83667.log.gz 2024-09-12T02:08:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.89182.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.85453.log.gz 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89224.log 2024-09-12T02:08:07.739 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.89182.log.gz 2024-09-12T02:08:07.739 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.740 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.45452.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.0.45452.log.gz 2024-09-12T02:08:07.740 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.77449.log 2024-09-12T02:08:07.740 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.89224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63694.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89224.log.gz 2024-09-12T02:08:07.740 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.740 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.77449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57233.log 2024-09-12T02:08:07.740 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77449.log.gz 2024-09-12T02:08:07.740 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.63694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59297.log 2024-09-12T02:08:07.740 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69025.log 2024-09-12T02:08:07.741 INFO:teuthology.orchestra.run.smithi019.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.63694.log.gz 2024-09-12T02:08:07.741 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57233.log.gz 2024-09-12T02:08:07.741 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77280.log 2024-09-12T02:08:07.741 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.69025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44449.log 2024-09-12T02:08:07.741 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59297.log.gz 2024-09-12T02:08:07.741 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.0.69025.log.gz 2024-09-12T02:08:07.741 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.77280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89744.log 2024-09-12T02:08:07.741 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.77280.log.gz 2024-09-12T02:08:07.741 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53318.log 2024-09-12T02:08:07.742 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44449.log.gz 2024-09-12T02:08:07.742 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41899.log 2024-09-12T02:08:07.742 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.89744.log: /var/log/ceph/ceph-client.admin.53318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81628.log 2024-09-12T02:08:07.742 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41899.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89744.log.gz 2024-09-12T02:08:07.742 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53318.log.gz 2024-09-12T02:08:07.742 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41899.log.gz 2024-09-12T02:08:07.742 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71628.log 2024-09-12T02:08:07.742 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.81628.log: gzip -5 --verbose -- 88.5% -- replaced with /var/log/ceph/ceph-client.admin.81628.log.gz 2024-09-12T02:08:07.743 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.63842.log 2024-09-12T02:08:07.743 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.71628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62362.log 2024-09-12T02:08:07.743 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.71628.log.gz 2024-09-12T02:08:07.743 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.63842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68630.log 2024-09-12T02:08:07.743 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.63842.log.gz/var/log/ceph/ceph-client.admin.62362.log: 2024-09-12T02:08:07.743 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46771.log 2024-09-12T02:08:07.743 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62362.log.gz 2024-09-12T02:08:07.743 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46278.log 2024-09-12T02:08:07.744 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.68630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47272.log 2024-09-12T02:08:07.744 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2%/var/log/ceph/ceph-client.admin.46771.log: -- replaced with /var/log/ceph/ceph-client.admin.68630.log.gz 2024-09-12T02:08:07.744 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46278.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46771.log.gz 2024-09-12T02:08:07.744 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46278.log.gz 2024-09-12T02:08:07.744 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61727.log 2024-09-12T02:08:07.744 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51363.log 2024-09-12T02:08:07.744 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5%/var/log/ceph/ceph-client.admin.61727.log: -- replaced with /var/log/ceph/ceph-client.admin.47272.log.gz 2024-09-12T02:08:07.744 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77641.log 2024-09-12T02:08:07.745 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61727.log.gz 2024-09-12T02:08:07.745 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47150.log 2024-09-12T02:08:07.745 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70316.log 2024-09-12T02:08:07.745 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.77641.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51363.log.gz 2024-09-12T02:08:07.745 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.77641.log.gz 2024-09-12T02:08:07.745 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47150.log.gz 2024-09-12T02:08:07.745 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.53360.log 2024-09-12T02:08:07.745 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.70316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52201.log 88.3% 2024-09-12T02:08:07.745 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70316.log.gz 2024-09-12T02:08:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53935.log 2024-09-12T02:08:07.746 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53360.log.gz 2024-09-12T02:08:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47352.log 88.4% 2024-09-12T02:08:07.746 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52201.log.gz 2024-09-12T02:08:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66476.log 2024-09-12T02:08:07.746 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53935.log.gz 2024-09-12T02:08:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75987.log 2024-09-12T02:08:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47352.log: /var/log/ceph/ceph-client.admin.66476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74229.log 2024-09-12T02:08:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75987.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47352.log.gz 88.3% 2024-09-12T02:08:07.747 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66476.log.gz 2024-09-12T02:08:07.747 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.75987.log.gz 2024-09-12T02:08:07.747 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55254.log 2024-09-12T02:08:07.747 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.74229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.74229.log.gz 2024-09-12T02:08:07.747 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46026.log 2024-09-12T02:08:07.747 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50840.log 2024-09-12T02:08:07.747 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55254.log.gz/var/log/ceph/ceph-client.admin.46026.log: 2024-09-12T02:08:07.747 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75356.log 2024-09-12T02:08:07.748 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46026.log.gz 2024-09-12T02:08:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53456.log 2024-09-12T02:08:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49719.log 2024-09-12T02:08:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75356.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50840.log.gz 2024-09-12T02:08:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53456.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.75356.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51405.log 2024-09-12T02:08:07.748 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62021.log 2024-09-12T02:08:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51405.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53456.log.gz 2024-09-12T02:08:07.749 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49719.log.gz 2024-09-12T02:08:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80704.log 2024-09-12T02:08:07.749 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51405.log.gz 2024-09-12T02:08:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5/var/log/ceph/ceph-client.admin.62021.log: --verbose -- /var/log/ceph/ceph-client.admin.72866.log 2024-09-12T02:08:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80704.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62021.log.gz 2024-09-12T02:08:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58127.log 2024-09-12T02:08:07.749 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.80704.log.gz 2024-09-12T02:08:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45585.log 2024-09-12T02:08:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72866.log: /var/log/ceph/ceph-client.admin.58127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73995.log 2024-09-12T02:08:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45585.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.72866.log.gz 2024-09-12T02:08:07.750 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45585.log.gz 2024-09-12T02:08:07.750 INFO:teuthology.orchestra.run.smithi019.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58127.log.gz 2024-09-12T02:08:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61769.log 2024-09-12T02:08:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49265.log 2024-09-12T02:08:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49177.log 2024-09-12T02:08:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61769.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73995.log.gz 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61769.log.gz 2024-09-12T02:08:07.750 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.751 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67907.log 2024-09-12T02:08:07.751 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49265.log.gz 2024-09-12T02:08:07.751 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80783.log 2024-09-12T02:08:07.751 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49177.log.gz 2024-09-12T02:08:07.751 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70554.log 2024-09-12T02:08:07.751 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67907.log.gz 2024-09-12T02:08:07.751 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85099.log 2024-09-12T02:08:07.751 INFO:teuthology.orchestra.run.smithi019.stderr:gzip 90.0% -- replaced with /var/log/ceph/ceph-client.admin.80783.log.gz 2024-09-12T02:08:07.751 INFO:teuthology.orchestra.run.smithi019.stderr: -5/var/log/ceph/ceph-client.admin.70554.log: --verbose -- /var/log/ceph/ceph-client.admin.52159.log 2024-09-12T02:08:07.752 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51500.log 2024-09-12T02:08:07.752 INFO:teuthology.orchestra.run.smithi019.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.70554.log.gz/var/log/ceph/ceph-client.admin.85099.log: 2024-09-12T02:08:07.752 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52159.log: 89.3%gzip -5 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52159.log.gz 2024-09-12T02:08:07.752 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.75104.log 2024-09-12T02:08:07.752 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.85099.log.gz 2024-09-12T02:08:07.752 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55548.log 2024-09-12T02:08:07.752 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51500.log.gz/var/log/ceph/ceph-client.admin.75104.log: 2024-09-12T02:08:07.752 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89266.log 87.4% -- replaced with /var/log/ceph/ceph-client.admin.75104.log.gz 2024-09-12T02:08:07.753 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.753 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86273.log 2024-09-12T02:08:07.753 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55548.log.gz 2024-09-12T02:08:07.753 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.89266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75725.log 2024-09-12T02:08:07.753 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2%/var/log/ceph/ceph-client.admin.86273.log: -- replaced with /var/log/ceph/ceph-client.admin.89266.log.gz 2024-09-12T02:08:07.753 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- 87.9% -- replaced with /var/log/ceph/ceph-client.admin.86273.log.gz 2024-09-12T02:08:07.753 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.84668.log 2024-09-12T02:08:07.753 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86147.log 2024-09-12T02:08:07.754 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.75725.log.gz 2024-09-12T02:08:07.754 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.84668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66551.log 2024-09-12T02:08:07.754 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.84668.log.gz 2024-09-12T02:08:07.754 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.86147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43474.log 2024-09-12T02:08:07.754 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.86147.log.gz 2024-09-12T02:08:07.754 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47480.log 2024-09-12T02:08:07.754 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66551.log: /var/log/ceph/ceph-client.admin.43474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51790.log 2024-09-12T02:08:07.754 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47480.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43474.log.gz 2024-09-12T02:08:07.754 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66551.log.gzgzip -5 89.4% --verbose -- /var/log/ceph/ceph-client.0.83378.log 2024-09-12T02:08:07.755 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47480.log.gz 2024-09-12T02:08:07.755 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.755 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74553.log 2024-09-12T02:08:07.755 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51790.log.gz 2024-09-12T02:08:07.755 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.83378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.83378.log.gz 2024-09-12T02:08:07.755 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76812.log 2024-09-12T02:08:07.755 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.74553.log: /var/log/ceph/ceph-client.admin.44453.log 2024-09-12T02:08:07.755 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65397.log 2024-09-12T02:08:07.756 INFO:teuthology.orchestra.run.smithi019.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.74553.log.gz 2024-09-12T02:08:07.756 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46982.log 2024-09-12T02:08:07.756 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44453.log: /var/log/ceph/ceph-client.admin.65397.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.76812.log.gz 2024-09-12T02:08:07.756 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44453.log.gz 2024-09-12T02:08:07.756 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65397.log.gz 2024-09-12T02:08:07.756 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68076.log 2024-09-12T02:08:07.756 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73395.log 2024-09-12T02:08:07.756 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.68076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64304.log 2024-09-12T02:08:07.757 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46982.log.gz 2024-09-12T02:08:07.757 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8%/var/log/ceph/ceph-client.admin.73395.log: -- replaced with /var/log/ceph/ceph-client.admin.68076.log.gz 2024-09-12T02:08:07.757 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59934.log 2024-09-12T02:08:07.757 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46320.log 2024-09-12T02:08:07.757 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73395.log.gz 2024-09-12T02:08:07.757 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64304.log: /var/log/ceph/ceph-client.admin.59934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86315.log 2024-09-12T02:08:07.757 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46320.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64304.log.gz 2024-09-12T02:08:07.757 INFO:teuthology.orchestra.run.smithi019.stderr: 91.1% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59934.log.gz 2024-09-12T02:08:07.757 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46320.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55632.log 2024-09-12T02:08:07.758 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85670.log 2024-09-12T02:08:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.86315.log: /var/log/ceph/ceph-client.admin.55632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62786.log 2024-09-12T02:08:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85670.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86315.log.gz 2024-09-12T02:08:07.758 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55632.log.gz 2024-09-12T02:08:07.758 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.85670.log.gz 2024-09-12T02:08:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70610.log 2024-09-12T02:08:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.62786.log: -- /var/log/ceph/ceph-client.admin.80662.log 2024-09-12T02:08:07.759 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.70610.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62786.log.gz 2024-09-12T02:08:07.759 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79400.log 2024-09-12T02:08:07.759 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70610.log.gz 2024-09-12T02:08:07.759 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47394.log 2024-09-12T02:08:07.759 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80662.log: /var/log/ceph/ceph-client.admin.79400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64933.log 2024-09-12T02:08:07.759 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.80662.log.gz 2024-09-12T02:08:07.759 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47394.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.79400.log.gz 2024-09-12T02:08:07.759 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79911.log 2024-09-12T02:08:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64933.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76047.log 2024-09-12T02:08:07.760 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47394.log.gz 2024-09-12T02:08:07.760 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64933.log.gz 2024-09-12T02:08:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.79911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73437.log 2024-09-12T02:08:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.79911.log.gz 2024-09-12T02:08:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65266.log 2024-09-12T02:08:07.760 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.76047.log.gz 2024-09-12T02:08:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72605.log 2024-09-12T02:08:07.760 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73437.log.gz 2024-09-12T02:08:07.761 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49025.log 2024-09-12T02:08:07.761 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72605.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.65266.log.gz 2024-09-12T02:08:07.761 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84847.log 2024-09-12T02:08:07.761 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64082.log 2024-09-12T02:08:07.761 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72605.log.gz/var/log/ceph/ceph-client.admin.49025.log: 2024-09-12T02:08:07.761 INFO:teuthology.orchestra.run.smithi019.stderr: 87.2%/var/log/ceph/ceph-client.admin.84847.log: -- replaced with /var/log/ceph/ceph-client.admin.49025.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51580.log 2024-09-12T02:08:07.761 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.761 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50011.log 2024-09-12T02:08:07.762 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84847.log.gz 2024-09-12T02:08:07.762 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51580.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64082.log.gz 2024-09-12T02:08:07.762 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62450.log 2024-09-12T02:08:07.762 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51580.log.gz 2024-09-12T02:08:07.762 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44454.log 2024-09-12T02:08:07.762 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50011.log: /var/log/ceph/ceph-client.admin.62450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76868.log 2024-09-12T02:08:07.762 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3%/var/log/ceph/ceph-client.admin.44454.log: -- replaced with /var/log/ceph/ceph-client.admin.62450.log.gz 2024-09-12T02:08:07.762 INFO:teuthology.orchestra.run.smithi019.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50011.log.gz 2024-09-12T02:08:07.762 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44454.log.gz 2024-09-12T02:08:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41837.log 2024-09-12T02:08:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76868.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.75632.log 2024-09-12T02:08:07.763 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76868.log.gz 2024-09-12T02:08:07.763 INFO:teuthology.orchestra.run.smithi019.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-12T02:08:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78317.log 2024-09-12T02:08:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:gzip 89.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.41837.log.gz -- 2024-09-12T02:08:07.763 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.48001.log 2024-09-12T02:08:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83014.log 2024-09-12T02:08:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43103.log 2024-09-12T02:08:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48001.log: /var/log/ceph/ceph-client.admin.83014.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.78317.log.gz 2024-09-12T02:08:07.764 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48001.log.gzgzip -5 --verbose 88.7% -- replaced with /var/log/ceph/ceph-client.admin.83014.log.gz 2024-09-12T02:08:07.764 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.61853.log 2024-09-12T02:08:07.764 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43103.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.75632.log.gz 2024-09-12T02:08:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56418.log 2024-09-12T02:08:07.764 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43103.log.gz 2024-09-12T02:08:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58831.log 2024-09-12T02:08:07.765 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.56418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60192.log 2024-09-12T02:08:07.765 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61853.log.gz 2024-09-12T02:08:07.765 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56418.log.gz 2024-09-12T02:08:07.765 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88528.log 2024-09-12T02:08:07.765 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58831.log.gz 2024-09-12T02:08:07.765 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.60192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53112.log 2024-09-12T02:08:07.765 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60192.log.gz 2024-09-12T02:08:07.765 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5/var/log/ceph/ceph-client.admin.88528.log: --verbose -- /var/log/ceph/ceph-client.0.83374.log 2024-09-12T02:08:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53112.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88528.log.gz 2024-09-12T02:08:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53112.log.gz 2024-09-12T02:08:07.766 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.61684.log 2024-09-12T02:08:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.83374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.83374.log.gz 2024-09-12T02:08:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74745.log 2024-09-12T02:08:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62278.log 2024-09-12T02:08:07.766 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61684.log.gz 2024-09-12T02:08:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.74745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79358.log 2024-09-12T02:08:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80545.log 2024-09-12T02:08:07.767 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.74745.log.gz 2024-09-12T02:08:07.767 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62278.log.gz 2024-09-12T02:08:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67630.log 2024-09-12T02:08:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.79358.log: /var/log/ceph/ceph-client.admin.80545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84509.log 2024-09-12T02:08:07.767 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.79358.log.gz 2024-09-12T02:08:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67630.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.80545.log.gz 2024-09-12T02:08:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73006.log 2024-09-12T02:08:07.767 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67630.log.gz 2024-09-12T02:08:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.84509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51662.log 2024-09-12T02:08:07.768 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73006.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.84509.log.gz 2024-09-12T02:08:07.768 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57275.log 2024-09-12T02:08:07.768 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73006.log.gz 2024-09-12T02:08:07.768 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48505.log 2024-09-12T02:08:07.768 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51662.log: /var/log/ceph/ceph-client.admin.57275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58029.log 2024-09-12T02:08:07.768 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51662.log.gz 2024-09-12T02:08:07.768 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47871.log 2024-09-12T02:08:07.768 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57275.log.gz 2024-09-12T02:08:07.769 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48505.log: /var/log/ceph/ceph-client.0.58029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53034.log 2024-09-12T02:08:07.769 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58029.log.gz 2024-09-12T02:08:07.769 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55170.log 2024-09-12T02:08:07.769 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47871.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48505.log.gz 2024-09-12T02:08:07.769 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53034.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.44860.log -- replaced with /var/log/ceph/ceph-client.admin.47871.log.gz 2024-09-12T02:08:07.769 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.769 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53034.log.gz 2024-09-12T02:08:07.769 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42323.log 2024-09-12T02:08:07.769 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55170.log: /var/log/ceph/ceph-client.admin.44860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54905.log 2024-09-12T02:08:07.770 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55170.log.gz 2024-09-12T02:08:07.770 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51153.log 2024-09-12T02:08:07.770 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44860.log.gz 2024-09-12T02:08:07.770 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85924.log 2024-09-12T02:08:07.770 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42323.log.gz 2024-09-12T02:08:07.770 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66635.log 2024-09-12T02:08:07.770 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51153.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54905.log.gz 2024-09-12T02:08:07.770 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50924.log 2024-09-12T02:08:07.771 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51153.log.gz 2024-09-12T02:08:07.771 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85924.log: /var/log/ceph/ceph-client.admin.66635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53977.log 2024-09-12T02:08:07.771 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75609.log 2024-09-12T02:08:07.771 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.85924.log.gz 2024-09-12T02:08:07.771 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82579.log 2024-09-12T02:08:07.771 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50924.log.gz/var/log/ceph/ceph-client.admin.53977.log: 2024-09-12T02:08:07.771 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58434.log 2024-09-12T02:08:07.771 INFO:teuthology.orchestra.run.smithi019.stderr: 92.5% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53977.log.gz 2024-09-12T02:08:07.772 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66635.log.gz 2024-09-12T02:08:07.772 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75609.log.gz 2024-09-12T02:08:07.772 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.82579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56534.log 2024-09-12T02:08:07.772 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.82579.log.gz 2024-09-12T02:08:07.772 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46473.log 2024-09-12T02:08:07.772 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58434.log: /var/log/ceph/ceph-client.admin.56534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89056.log 2024-09-12T02:08:07.772 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58434.log.gz 2024-09-12T02:08:07.772 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46473.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56534.log.gz 2024-09-12T02:08:07.772 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48397.log 2024-09-12T02:08:07.773 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46473.log.gz 2024-09-12T02:08:07.773 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.89056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78593.log 2024-09-12T02:08:07.773 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.89056.log.gz 2024-09-12T02:08:07.773 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77122.log 2024-09-12T02:08:07.773 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.78593.log: -5 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48397.log.gz 2024-09-12T02:08:07.773 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51704.log 2024-09-12T02:08:07.773 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.77122.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78593.log.gz 2024-09-12T02:08:07.773 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54434.log 2024-09-12T02:08:07.774 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.77122.log.gz 2024-09-12T02:08:07.774 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83902.log 2024-09-12T02:08:07.774 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1%/var/log/ceph/ceph-client.admin.54434.log: -- replaced with /var/log/ceph/ceph-client.admin.51704.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51279.log 2024-09-12T02:08:07.774 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.774 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.83902.log: -5 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54434.log.gz 2024-09-12T02:08:07.774 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60313.log 2024-09-12T02:08:07.774 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51279.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83902.log.gz 2024-09-12T02:08:07.774 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51279.log.gz 2024-09-12T02:08:07.774 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59892.log 2024-09-12T02:08:07.775 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41795.log 2024-09-12T02:08:07.775 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59892.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60313.log.gz 2024-09-12T02:08:07.775 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70228.log 2024-09-12T02:08:07.775 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41795.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59892.log.gz 2024-09-12T02:08:07.775 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86231.log 2024-09-12T02:08:07.775 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41795.log.gz 2024-09-12T02:08:07.775 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76556.log 2024-09-12T02:08:07.775 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.70228.log: /var/log/ceph/ceph-client.admin.86231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59383.log 2024-09-12T02:08:07.776 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70228.log.gz 2024-09-12T02:08:07.776 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42113.log 2024-09-12T02:08:07.776 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.86231.log.gz 2024-09-12T02:08:07.776 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59383.log: gzip 87.7% -5 --verbose -- /var/log/ceph/ceph-client.admin.85225.log 2024-09-12T02:08:07.776 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76556.log.gz 2024-09-12T02:08:07.776 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42113.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.59383.log.gz 2024-09-12T02:08:07.776 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.63879.log 2024-09-12T02:08:07.776 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85225.log: gzip -5 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42113.log.gz 2024-09-12T02:08:07.776 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50095.log 2024-09-12T02:08:07.777 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2%/var/log/ceph/ceph-client.admin.63879.log: -- replaced with /var/log/ceph/ceph-client.admin.85225.log.gz 2024-09-12T02:08:07.777 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64637.log 2024-09-12T02:08:07.777 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63879.log.gz 2024-09-12T02:08:07.777 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42365.log 2024-09-12T02:08:07.777 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50095.log: /var/log/ceph/ceph-client.admin.64637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44105.log 2024-09-12T02:08:07.777 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42365.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.64637.log.gz 2024-09-12T02:08:07.777 INFO:teuthology.orchestra.run.smithi019.stderr: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46362.log 2024-09-12T02:08:07.777 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50095.log.gz 2024-09-12T02:08:07.778 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68472.log 2024-09-12T02:08:07.778 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44105.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.42365.log.gz 2024-09-12T02:08:07.778 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59339.log 2024-09-12T02:08:07.778 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44105.log.gz 2024-09-12T02:08:07.778 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67097.log 2024-09-12T02:08:07.778 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46362.log.gz 2024-09-12T02:08:07.778 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.68472.log: /var/log/ceph/ceph-client.admin.59339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46194.log 2024-09-12T02:08:07.778 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- 87.8% /var/log/ceph/ceph-client.admin.62870.log 2024-09-12T02:08:07.778 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59339.log.gz 2024-09-12T02:08:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67097.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68472.log.gz 2024-09-12T02:08:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46194.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67097.log.gz 2024-09-12T02:08:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46194.log.gz 2024-09-12T02:08:07.779 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.79516.log 2024-09-12T02:08:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78257.log 2024-09-12T02:08:07.779 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62870.log.gz 2024-09-12T02:08:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.79516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53847.log 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79516.log.gz 2024-09-12T02:08:07.779 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78257.log: gzip 88.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.59724.log 2024-09-12T02:08:07.780 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78257.log.gz 2024-09-12T02:08:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75263.log 2024-09-12T02:08:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.59724.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53847.log.gz 2024-09-12T02:08:07.780 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.67335.log 2024-09-12T02:08:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75263.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59724.log.gz 2024-09-12T02:08:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44334.log 2024-09-12T02:08:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71509.log 2024-09-12T02:08:07.781 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67335.log.gz 2024-09-12T02:08:07.781 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44334.log: gzip -5 --verbose -- 92.5% -- replaced with /var/log/ceph/ceph-client.admin.75263.log.gz 2024-09-12T02:08:07.781 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.83704.log 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44334.log.gz 2024-09-12T02:08:07.781 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.781 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.71509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64378.log 2024-09-12T02:08:07.781 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.83704.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71509.log.gz 2024-09-12T02:08:07.781 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76239.log 2024-09-12T02:08:07.781 INFO:teuthology.orchestra.run.smithi019.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.83704.log.gz 2024-09-12T02:08:07.782 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72437.log 2024-09-12T02:08:07.782 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.64378.log.gz 2024-09-12T02:08:07.782 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47778.log 2024-09-12T02:08:07.782 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72437.log: gzip -5 89.4% -- replaced with /var/log/ceph/ceph-client.admin.76239.log.gz 2024-09-12T02:08:07.782 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.76197.log 2024-09-12T02:08:07.782 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72437.log.gz 2024-09-12T02:08:07.782 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61116.log 2024-09-12T02:08:07.782 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47778.log.gz 2024-09-12T02:08:07.782 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57084.log 2024-09-12T02:08:07.783 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61116.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.76197.log.gz 2024-09-12T02:08:07.783 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64785.log 2024-09-12T02:08:07.783 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67139.log 2024-09-12T02:08:07.783 INFO:teuthology.orchestra.run.smithi019.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.61116.log.gz 2024-09-12T02:08:07.783 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63990.log 2024-09-12T02:08:07.783 INFO:teuthology.orchestra.run.smithi019.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.57084.log.gz 2024-09-12T02:08:07.783 INFO:teuthology.orchestra.run.smithi019.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.64785.log.gz 2024-09-12T02:08:07.783 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87536.log 2024-09-12T02:08:07.784 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67139.log: gzip/var/log/ceph/ceph-client.admin.63990.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.85369.log 88.7% 2024-09-12T02:08:07.784 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67139.log.gz 2024-09-12T02:08:07.784 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.87536.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.63990.log.gz 2024-09-12T02:08:07.784 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41494.log 2024-09-12T02:08:07.784 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44113.log 2024-09-12T02:08:07.784 INFO:teuthology.orchestra.run.smithi019.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.87536.log.gz 2024-09-12T02:08:07.784 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41671.log 2024-09-12T02:08:07.784 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.85369.log.gz 2024-09-12T02:08:07.785 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41494.log.gz 2024-09-12T02:08:07.785 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58747.log 2024-09-12T02:08:07.785 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65513.log 2024-09-12T02:08:07.785 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44113.log.gz 2024-09-12T02:08:07.785 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58747.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-osd.3.log 2024-09-12T02:08:07.785 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz 2024-09-12T02:08:07.785 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58747.log.gz 2024-09-12T02:08:07.785 INFO:teuthology.orchestra.run.smithi019.stderr: --/var/log/ceph/ceph-client.admin.65513.log: /var/log/ceph/ceph-client.admin.81046.log 2024-09-12T02:08:07.785 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65513.log.gz 2024-09-12T02:08:07.786 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.78751.log 2024-09-12T02:08:07.786 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.81046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85975.log 88.9% -- replaced with /var/log/ceph/ceph-client.admin.81046.log.gz 2024-09-12T02:08:07.786 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.786 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68010.log 2024-09-12T02:08:07.786 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.78751.log.gz 2024-09-12T02:08:07.786 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48355.log 2024-09-12T02:08:07.786 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.85975.log.gz 2024-09-12T02:08:07.786 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.68010.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-12T02:08:07.786 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74451.log 2024-09-12T02:08:07.787 INFO:teuthology.orchestra.run.smithi019.stderr: 91.1%/var/log/ceph/ceph-client.admin.48355.log: -- replaced with /var/log/ceph/ceph-client.admin.68010.log.gz 2024-09-12T02:08:07.787 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60000.log 2024-09-12T02:08:07.787 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48355.log.gz 2024-09-12T02:08:07.787 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.74451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61937.log 2024-09-12T02:08:07.787 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74451.log.gz 2024-09-12T02:08:07.787 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80348.log 2024-09-12T02:08:07.787 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61937.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60000.log.gz 2024-09-12T02:08:07.787 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81351.log 2024-09-12T02:08:07.788 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61937.log.gz 2024-09-12T02:08:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54164.log 2024-09-12T02:08:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.81351.log: 88.9% 89.9% -- replaced with /var/log/ceph/ceph-client.admin.80348.log.gz 2024-09-12T02:08:07.788 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81351.log.gz 2024-09-12T02:08:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43771.log 2024-09-12T02:08:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82784.log 2024-09-12T02:08:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54164.log: /var/log/ceph/ceph-client.admin.43771.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54164.log.gz 2024-09-12T02:08:07.788 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43771.log.gz 2024-09-12T02:08:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66434.log 2024-09-12T02:08:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66822.log 2024-09-12T02:08:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66434.log: /var/log/ceph/ceph-client.admin.82784.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66434.log.gz 2024-09-12T02:08:07.789 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.82784.log.gz 2024-09-12T02:08:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80938.log 2024-09-12T02:08:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82709.log 2024-09-12T02:08:07.789 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66822.log.gz 2024-09-12T02:08:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.80938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81393.log 2024-09-12T02:08:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.82709.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.80938.log.gz 2024-09-12T02:08:07.790 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.82709.log.gz 2024-09-12T02:08:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56164.log 2024-09-12T02:08:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51008.log 2024-09-12T02:08:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.81393.log: /var/log/ceph/ceph-client.admin.56164.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.81393.log.gz 2024-09-12T02:08:07.790 INFO:teuthology.orchestra.run.smithi019.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.56164.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48876.log 2024-09-12T02:08:07.790 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56827.log 2024-09-12T02:08:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48876.log: /var/log/ceph/ceph-client.admin.51008.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48876.log.gz 2024-09-12T02:08:07.791 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51008.log.gz 2024-09-12T02:08:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79162.log 2024-09-12T02:08:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88257.log 2024-09-12T02:08:07.791 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56827.log.gz 2024-09-12T02:08:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.79162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62492.log 2024-09-12T02:08:07.791 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.79162.log.gz 2024-09-12T02:08:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.88257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63334.log 2024-09-12T02:08:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62492.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.88257.log.gz 2024-09-12T02:08:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78499.log 2024-09-12T02:08:07.792 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62492.log.gz 2024-09-12T02:08:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.63334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72133.log 2024-09-12T02:08:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.63334.log.gz 2024-09-12T02:08:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42027.log 2024-09-12T02:08:07.792 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.78499.log.gz 2024-09-12T02:08:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74978.log 2024-09-12T02:08:07.792 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72133.log.gz/var/log/ceph/ceph-client.admin.42027.log: 2024-09-12T02:08:07.793 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84248.log 2024-09-12T02:08:07.793 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.74978.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42027.log.gz 2024-09-12T02:08:07.793 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74978.log.gz 2024-09-12T02:08:07.793 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50756.log 2024-09-12T02:08:07.793 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.84248.log: /var/log/ceph/ceph-client.admin.50756.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84248.log.gz 2024-09-12T02:08:07.793 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50756.log.gz 2024-09-12T02:08:07.794 INFO:teuthology.orchestra.run.smithi019.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-12T02:08:07.794 INFO:teuthology.orchestra.run.smithi135.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T02:08:08.169 INFO:teuthology.orchestra.run.smithi019.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T02:08:08.559 INFO:teuthology.orchestra.run.smithi135.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T02:08:08.654 INFO:teuthology.orchestra.run.smithi019.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T02:08:08.765 INFO:teuthology.orchestra.run.smithi135.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T02:08:08.812 INFO:teuthology.orchestra.run.smithi135.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T02:08:08.858 INFO:teuthology.orchestra.run.smithi135.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T02:08:08.861 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-09-12T02:08:08.861 INFO:teuthology.orchestra.run.smithi135.stderr:real 0m1.721s 2024-09-12T02:08:08.861 INFO:teuthology.orchestra.run.smithi135.stderr:user 0m7.364s 2024-09-12T02:08:08.862 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m0.276s 2024-09-12T02:08:08.926 INFO:teuthology.orchestra.run.smithi019.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T02:08:09.057 INFO:teuthology.orchestra.run.smithi019.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T02:08:09.152 INFO:teuthology.orchestra.run.smithi019.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T02:08:09.153 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T02:08:09.154 INFO:teuthology.orchestra.run.smithi019.stderr:real 0m2.040s 2024-09-12T02:08:09.154 INFO:teuthology.orchestra.run.smithi019.stderr:user 0m8.200s 2024-09-12T02:08:09.154 INFO:teuthology.orchestra.run.smithi019.stderr:sys 0m0.827s 2024-09-12T02:08:09.154 INFO:tasks.ceph:Archiving logs... 2024-09-12T02:08:09.155 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901578/remote/smithi019/log 2024-09-12T02:08:09.156 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:08:10.978 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901578/remote/smithi135/log 2024-09-12T02:08:10.979 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:08:12.050 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T02:08:12.059 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T02:08:12.059 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:08:12.062 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:08:12.167 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T02:08:12.177 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T02:08:12.177 DEBUG:teuthology.orchestra.run.smithi019:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:08:12.180 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:08:12.195 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:08:12.196 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:08:12.200 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:08:12.200 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-09-12T02:08:12.200 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv01.front.sepia.ceph.com 3 6 377 50 -2831us[-2783us] +/- 58ms 2024-09-12T02:08:12.201 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 52 +724us[ +772us] +/- 67ms 2024-09-12T02:08:12.201 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 +3028us[+3076us] +/- 79ms 2024-09-12T02:08:12.201 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:08:12.202 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:08:12.203 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-09-12T02:08:12.203 INFO:teuthology.orchestra.run.smithi019.stdout:^* hv01.front.sepia.ceph.com 3 6 377 52 -2867us[-2843us] +/- 58ms 2024-09-12T02:08:12.203 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 52 +702us[ +702us] +/- 67ms 2024-09-12T02:08:12.203 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 +3012us[+3012us] +/- 79ms 2024-09-12T02:08:12.203 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:08:12.203 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T02:08:12.224 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T02:08:12.225 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T02:08:12.256 DEBUG:teuthology.orchestra.run.smithi019:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:08:12.352 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:08:12.422 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:08:12.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:08:12.455 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:08:12.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:08:12.485 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T02:08:12.495 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T02:08:12.527 INFO:teuthology.task.internal:Duration was 1128.606773 seconds 2024-09-12T02:08:12.527 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T02:08:12.557 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T02:08:12.558 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:08:12.560 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:08:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:08:12.601 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:08:12.832 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T02:08:12.833 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T02:08:12.833 DEBUG:teuthology.orchestra.run.smithi019:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:08:12.895 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T02:08:12.895 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:08:12.924 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T02:08:12.924 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:08:12.938 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:08:12.990 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T02:08:12.991 DEBUG:teuthology.orchestra.run.smithi019:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:08:13.007 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:08:13.148 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T02:08:13.160 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T02:08:13.161 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:08:13.186 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:08:13.211 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T02:08:13.222 DEBUG:teuthology.orchestra.run.smithi019:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:08:13.228 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:08:13.250 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = core 2024-09-12T02:08:13.275 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2024-09-12T02:08:13.288 DEBUG:teuthology.orchestra.run.smithi019:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:08:13.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:08:13.322 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:08:13.343 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:08:13.344 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T02:08:13.359 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T02:08:13.359 DEBUG:teuthology.misc:Transferring archived files from smithi019:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901578/remote/smithi019 2024-09-12T02:08:13.360 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:08:13.404 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901578/remote/smithi135 2024-09-12T02:08:13.404 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:08:13.437 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T02:08:13.437 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:08:13.440 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:08:13.488 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T02:08:13.501 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T02:08:13.501 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T02:08:13.538 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T02:08:13.538 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:08:13.541 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:08:13.554 INFO:teuthology.orchestra.run.smithi019.stdout: 265388 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:08 /home/ubuntu/cephtest 2024-09-12T02:08:13.556 INFO:teuthology.orchestra.run.smithi135.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:08 /home/ubuntu/cephtest 2024-09-12T02:08:13.557 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T02:08:13.583 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T02:08:13.662 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/damage} duration: 1128.6067728996277 failure_reason: 'Test failure: test_open_ino_errors (tasks.cephfs.test_damage.TestDamage)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=4e5669a1d6d54793b9c79d7a2aac0c4c status: fail success: false 2024-09-12T02:08:13.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:08:13.759 INFO:teuthology.run:FAIL